2024-09-14T10:53:41.901 INFO:root:teuthology version: 1.2.2.dev2+g3752d38 2024-09-14T10:53:41.923 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-09-14T10:53:42.013 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/teuthology-2024-09-13_20:40:18-rgw-main-distro-default-smithi/7904155 branch: main description: rgw/verify/{0-install accounts$/{main} clusters/fixed-2 datacache/no_datacache frontend/beast ignore-pg-availability inline-data$/{on} msgr-failures/few objectstore/bluestore-bitmap overrides proto/https rgw_pool_type/ec s3tests-branch sharding$/{default} striping$/{stripe-equals-chunk} supported-random-distro$/{ubuntu_latest} tasks/{bucket-check cls mp_reupload ragweed reshard s3tests-java s3tests versioning} validater/valgrind} email: ceph-qa@ceph.com first_in_suite: false job_id: '7904155' kernel: kdb: 1 sha1: distro ktype: distro last_in_suite: false machine_type: smithi name: teuthology-2024-09-13_20:40:18-rgw-main-distro-default-smithi no_nested_subset: false openstack: - volumes: count: 4 size: 10 os_type: ubuntu os_version: '22.04' overrides: admin_socket: branch: main ceph: conf: client: debug rgw: 20 debug rgw notification: 20 rgw bucket counters cache: true rgw crypt require ssl: false rgw crypt s3 kms backend: testing rgw crypt s3 kms encryption keys: testkey-1=YmluCmJvb3N0CmJvb3N0LWJ1aWxkCmNlcGguY29uZgo= testkey-2=aWIKTWFrZWZpbGUKbWFuCm91dApzcmMKVGVzdGluZwo= rgw reshard progress judge interval: 10 rgw s3 auth use sts: true rgw sts key: abcdefghijklmnop rgw torrent flag: true rgw user counters cache: true setgroup: ceph setuser: ceph global: mon client directed command retry: 5 ms inject socket failures: 5000 osd heartbeat grace: 40 osd_max_pg_log_entries: 10 osd_min_pg_log_entries: 10 mgr: debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 mon osd crush smoke test: false osd: bdev async discard: true bdev enable discard: true bluestore allocator: bitmap bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug ms: 1 debug objclass: 20 debug osd: 20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd fast shutdown: false osd objectstore: bluestore osd shutdown pgref assert: true flavor: default fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - \(PG_AVAILABILITY\) - \(PG_DEGRADED\) - \(POOL_APP_NOT_ENABLED\) - not have an application enabled - \(OSD_SLOW_PING_TIME sha1: a2782315255a3e7d5f6cdc9eb35785187ff6ddf8 ceph-deploy: bluestore: true conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: {} osd: bdev async discard: true bdev enable discard: true bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore fs: xfs install: ceph: flavor: default sha1: a2782315255a3e7d5f6cdc9eb35785187ff6ddf8 openssl_keys: rgw.client.0: ca: root client: client.0 embed-key: true root: client: client.0 cn: teuthology install: - client.0 key-type: rsa:4096 rgw: client.0: ssl certificate: rgw.client.0 valgrind: - --tool=memcheck - --max-threads=1024 compression type: random ec-data-pool: true frontend: beast storage classes: LUKEWARM, FROZEN s3tests: accounts: iam alt root: RGW99999999999999999 iam root: RGW88888888888888888 s3 main: RGW11111111111111111 force-branch: ceph-master slow_backend: true storage classes: LUKEWARM, FROZEN thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: main sha1: 1c941a66c1b420259b8fc5ac19e792dbbf60aded owner: scheduled_teuthology@teuthology priority: 950 repo: https://git.ceph.com/ceph.git roles: - - mon.a - mon.c - mgr.y - osd.0 - osd.1 - osd.2 - osd.3 - client.0 - node-exporter.a - - mon.b - mgr.x - osd.4 - osd.5 - osd.6 - osd.7 - client.1 - prometheus.a - node-exporter.b seed: 9419 sha1: a2782315255a3e7d5f6cdc9eb35785187ff6ddf8 sleep_before_teardown: 0 subset: 0/1 suite: rgw suite_branch: main suite_path: /home/teuthworker/src/git.ceph.com_ceph_1c941a66c1b420259b8fc5ac19e792dbbf60aded/qa suite_relpath: qa suite_repo: https://git.ceph.com/ceph.git suite_sha1: 1c941a66c1b420259b8fc5ac19e792dbbf60aded targets: smithi138.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBA3HcMCv3EgNLrmHubEDMEUOlYZgj/btMt9XzPHvLNHepFNT9kJDW89KxHP9rhok1iPXtlWs7koKlMsd26xdBJ0= smithi154.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBApvcwJ2ylCHIsybYBdfo7GEWl0M6MakZCoK4HdYOT4nsbfWrd7rpR0FZaDTNLhHVBcBK5MWMgVJ30a8ZJ9W7u0= tasks: - install: extra_system_packages: deb: - s3cmd - maven rpm: - s3cmd - maven - ceph: null - openssl_keys: null - rgw: client.0: null - tox: - client.0 - workunit: clients: client.0: - rgw/run-bucket-check.sh - workunit: clients: client.0: - cls/test_cls_lock.sh - cls/test_cls_log.sh - cls/test_cls_refcount.sh - cls/test_cls_rgw.sh - cls/test_cls_rgw_gc.sh - cls/test_cls_rgw_stats.sh - cls/test_cls_cmpomap.sh - cls/test_cls_2pc_queue.sh - cls/test_cls_user.sh - rgw/test_rgw_gc_log.sh - rgw/test_rgw_obj.sh - rgw/test_librgw_file.sh - rgw/test_awssdkv4_sig.sh - workunit: clients: client.0: - rgw/test_rgw_s3_mp_reupload.sh - ragweed: client.0: default-branch: ceph-master rgw_server: client.0 stages: prepare,check - workunit: clients: client.0: - rgw/run-reshard.sh - s3tests-java: client.0: force-branch: ceph-master force-repo: https://github.com/ceph/java_s3tests.git - s3tests: client.0: rgw_server: client.0 - workunit: clients: client.0: - rgw/run-versioning.sh teuthology: fragments_dropped: [] meta: {} postmerge: [] teuthology_branch: main teuthology_sha1: 3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a timestamp: 2024-09-13_20:40:18 tube: smithi user: teuthology verbose: false worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.3401856 2024-09-14T10:53:42.013 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/git.ceph.com_ceph_1c941a66c1b420259b8fc5ac19e792dbbf60aded/qa; will attempt to use it 2024-09-14T10:53:42.014 INFO:teuthology.run:Found tasks at /home/teuthworker/src/git.ceph.com_ceph_1c941a66c1b420259b8fc5ac19e792dbbf60aded/qa/tasks 2024-09-14T10:53:42.014 INFO:teuthology.run_tasks:Running task internal.check_packages... 2024-09-14T10:53:42.015 INFO:teuthology.task.internal:Checking packages... 2024-09-14T10:53:42.037 INFO:teuthology.task.internal:Checking packages for os_type 'ubuntu', flavor 'default' and ceph hash 'a2782315255a3e7d5f6cdc9eb35785187ff6ddf8' 2024-09-14T10:53:42.037 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-09-14T10:53:42.037 INFO:teuthology.packaging:ref: None 2024-09-14T10:53:42.037 INFO:teuthology.packaging:tag: None 2024-09-14T10:53:42.037 INFO:teuthology.packaging:branch: main 2024-09-14T10:53:42.037 INFO:teuthology.packaging:sha1: a2782315255a3e7d5f6cdc9eb35785187ff6ddf8 2024-09-14T10:53:42.038 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&ref=main 2024-09-14T10:53:42.270 INFO:teuthology.task.internal:Found packages for ceph version 19.3.0-4907-ga2782315-1jammy 2024-09-14T10:53:42.272 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2024-09-14T10:53:42.278 INFO:teuthology.task.internal:no buildpackages task found 2024-09-14T10:53:42.279 INFO:teuthology.run_tasks:Running task internal.save_config... 2024-09-14T10:53:42.405 INFO:teuthology.task.internal:Saving configuration 2024-09-14T10:53:42.421 INFO:teuthology.run_tasks:Running task internal.check_lock... 2024-09-14T10:53:42.426 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-09-14T10:53:42.452 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi138.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/teuthology-2024-09-13_20:40:18-rgw-main-distro-default-smithi/7904155', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '22.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-09-14 10:47:55.828505', 'locked_by': 'scheduled_teuthology@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIOa77/mIJzvTUMyrSJkQ6zW+sKJVc0Iu2M4wODy8eV7X'} 2024-09-14T10:53:42.470 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi154.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/teuthology-2024-09-13_20:40:18-rgw-main-distro-default-smithi/7904155', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '22.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-09-14 10:47:55.829528', 'locked_by': 'scheduled_teuthology@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAINuA1hlN5zUoaOH+SMRQ6+uHQ8McB6RGN5+hptcWuBYY'} 2024-09-14T10:53:42.470 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2024-09-14T10:53:42.476 INFO:teuthology.task.internal:roles: ubuntu@smithi138.front.sepia.ceph.com - ['mon.a', 'mon.c', 'mgr.y', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'node-exporter.a'] 2024-09-14T10:53:42.476 INFO:teuthology.task.internal:roles: ubuntu@smithi154.front.sepia.ceph.com - ['mon.b', 'mgr.x', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'prometheus.a', 'node-exporter.b'] 2024-09-14T10:53:42.476 INFO:teuthology.run_tasks:Running task console_log... 2024-09-14T10:53:42.566 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f72f3a78ca0>, signals=[15]) 2024-09-14T10:53:42.566 INFO:teuthology.run_tasks:Running task internal.connect... 2024-09-14T10:53:42.594 INFO:teuthology.task.internal:Opening connections... 2024-09-14T10:53:42.594 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi138.front.sepia.ceph.com 2024-09-14T10:53:42.596 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi138.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-14T10:53:42.675 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi154.front.sepia.ceph.com 2024-09-14T10:53:42.676 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi154.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-14T10:53:42.764 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2024-09-14T10:53:42.770 DEBUG:teuthology.orchestra.run.smithi138:> uname -m 2024-09-14T10:53:42.776 INFO:teuthology.orchestra.run.smithi138.stdout:x86_64 2024-09-14T10:53:42.776 DEBUG:teuthology.orchestra.run.smithi138:> cat /etc/os-release 2024-09-14T10:53:42.828 INFO:teuthology.orchestra.run.smithi138.stdout:PRETTY_NAME="Ubuntu 22.04.1 LTS" 2024-09-14T10:53:42.828 INFO:teuthology.orchestra.run.smithi138.stdout:NAME="Ubuntu" 2024-09-14T10:53:42.828 INFO:teuthology.orchestra.run.smithi138.stdout:VERSION_ID="22.04" 2024-09-14T10:53:42.828 INFO:teuthology.orchestra.run.smithi138.stdout:VERSION="22.04.1 LTS (Jammy Jellyfish)" 2024-09-14T10:53:42.828 INFO:teuthology.orchestra.run.smithi138.stdout:VERSION_CODENAME=jammy 2024-09-14T10:53:42.828 INFO:teuthology.orchestra.run.smithi138.stdout:ID=ubuntu 2024-09-14T10:53:42.828 INFO:teuthology.orchestra.run.smithi138.stdout:ID_LIKE=debian 2024-09-14T10:53:42.828 INFO:teuthology.orchestra.run.smithi138.stdout:HOME_URL="https://www.ubuntu.com/" 2024-09-14T10:53:42.828 INFO:teuthology.orchestra.run.smithi138.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2024-09-14T10:53:42.828 INFO:teuthology.orchestra.run.smithi138.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2024-09-14T10:53:42.828 INFO:teuthology.orchestra.run.smithi138.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2024-09-14T10:53:42.829 INFO:teuthology.orchestra.run.smithi138.stdout:UBUNTU_CODENAME=jammy 2024-09-14T10:53:42.829 INFO:teuthology.lock.ops:Updating smithi138.front.sepia.ceph.com on lock server 2024-09-14T10:53:42.852 DEBUG:teuthology.orchestra.run.smithi154:> uname -m 2024-09-14T10:53:42.857 INFO:teuthology.orchestra.run.smithi154.stdout:x86_64 2024-09-14T10:53:42.857 DEBUG:teuthology.orchestra.run.smithi154:> cat /etc/os-release 2024-09-14T10:53:42.905 INFO:teuthology.orchestra.run.smithi154.stdout:PRETTY_NAME="Ubuntu 22.04.1 LTS" 2024-09-14T10:53:42.906 INFO:teuthology.orchestra.run.smithi154.stdout:NAME="Ubuntu" 2024-09-14T10:53:42.906 INFO:teuthology.orchestra.run.smithi154.stdout:VERSION_ID="22.04" 2024-09-14T10:53:42.906 INFO:teuthology.orchestra.run.smithi154.stdout:VERSION="22.04.1 LTS (Jammy Jellyfish)" 2024-09-14T10:53:42.906 INFO:teuthology.orchestra.run.smithi154.stdout:VERSION_CODENAME=jammy 2024-09-14T10:53:42.906 INFO:teuthology.orchestra.run.smithi154.stdout:ID=ubuntu 2024-09-14T10:53:42.906 INFO:teuthology.orchestra.run.smithi154.stdout:ID_LIKE=debian 2024-09-14T10:53:42.906 INFO:teuthology.orchestra.run.smithi154.stdout:HOME_URL="https://www.ubuntu.com/" 2024-09-14T10:53:42.906 INFO:teuthology.orchestra.run.smithi154.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2024-09-14T10:53:42.906 INFO:teuthology.orchestra.run.smithi154.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2024-09-14T10:53:42.906 INFO:teuthology.orchestra.run.smithi154.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2024-09-14T10:53:42.906 INFO:teuthology.orchestra.run.smithi154.stdout:UBUNTU_CODENAME=jammy 2024-09-14T10:53:42.906 INFO:teuthology.lock.ops:Updating smithi154.front.sepia.ceph.com on lock server 2024-09-14T10:53:42.926 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2024-09-14T10:53:42.935 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2024-09-14T10:53:42.960 INFO:teuthology.task.internal:Checking for old test directory... 2024-09-14T10:53:42.960 DEBUG:teuthology.orchestra.run.smithi138:> test '!' -e /home/ubuntu/cephtest 2024-09-14T10:53:42.963 DEBUG:teuthology.orchestra.run.smithi154:> test '!' -e /home/ubuntu/cephtest 2024-09-14T10:53:42.967 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2024-09-14T10:53:43.046 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2024-09-14T10:53:43.046 DEBUG:teuthology.orchestra.run.smithi138:> test -z $(ls -A /var/lib/ceph) 2024-09-14T10:53:43.049 DEBUG:teuthology.orchestra.run.smithi154:> test -z $(ls -A /var/lib/ceph) 2024-09-14T10:53:43.274 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2024-09-14T10:53:43.331 INFO:teuthology.run_tasks:Running task kernel... 2024-09-14T10:53:43.364 INFO:teuthology.task.kernel:normalize config orig: {'kdb': 1, 'sha1': 'distro'} 2024-09-14T10:53:43.364 INFO:teuthology.task.kernel:config {'mon.a': {'kdb': 1, 'sha1': 'distro'}, 'mon.b': {'kdb': 1, 'sha1': 'distro'}}, timeout 300 2024-09-14T10:53:43.365 DEBUG:teuthology.orchestra.run.smithi138:> test -f /run/.containerenv -o -f /.dockerenv 2024-09-14T10:53:43.365 DEBUG:teuthology.orchestra.run.smithi154:> test -f /run/.containerenv -o -f /.dockerenv 2024-09-14T10:53:43.369 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-14T10:53:43.370 DEBUG:teuthology.orchestra.run.smithi138:> uname -r 2024-09-14T10:53:43.370 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-14T10:53:43.371 DEBUG:teuthology.orchestra.run.smithi154:> uname -r 2024-09-14T10:53:43.416 INFO:teuthology.orchestra.run.smithi138.stdout:5.15.0-56-generic 2024-09-14T10:53:43.416 INFO:teuthology.task.kernel:Running kernel on smithi138: 5.15.0-56-generic 2024-09-14T10:53:43.417 DEBUG:teuthology.orchestra.run.smithi138:> sudo apt-get clean 2024-09-14T10:53:43.418 INFO:teuthology.orchestra.run.smithi154.stdout:5.15.0-56-generic 2024-09-14T10:53:43.418 INFO:teuthology.task.kernel:Running kernel on smithi154: 5.15.0-56-generic 2024-09-14T10:53:43.418 DEBUG:teuthology.orchestra.run.smithi154:> sudo apt-get clean 2024-09-14T10:53:43.554 DEBUG:teuthology.orchestra.run.smithi154:> sudo apt-get update 2024-09-14T10:53:43.557 DEBUG:teuthology.orchestra.run.smithi138:> sudo apt-get update 2024-09-14T10:53:43.683 INFO:teuthology.orchestra.run.smithi138.stdout:Get:1 http://security.ubuntu.com/ubuntu jammy-security InRelease [129 kB] 2024-09-14T10:53:43.699 INFO:teuthology.orchestra.run.smithi154.stdout:Get:1 http://security.ubuntu.com/ubuntu jammy-security InRelease [129 kB] 2024-09-14T10:53:43.798 INFO:teuthology.orchestra.run.smithi138.stdout:Hit:2 http://archive.ubuntu.com/ubuntu jammy InRelease 2024-09-14T10:53:43.805 INFO:teuthology.orchestra.run.smithi154.stdout:Hit:2 http://archive.ubuntu.com/ubuntu jammy InRelease 2024-09-14T10:53:43.884 INFO:teuthology.orchestra.run.smithi138.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy-updates InRelease [128 kB] 2024-09-14T10:53:43.887 INFO:teuthology.orchestra.run.smithi154.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy-updates InRelease [128 kB] 2024-09-14T10:53:43.901 INFO:teuthology.orchestra.run.smithi138.stdout:Get:4 http://security.ubuntu.com/ubuntu jammy-security/main amd64 Packages [1,806 kB] 2024-09-14T10:53:43.915 INFO:teuthology.orchestra.run.smithi154.stdout:Get:4 http://security.ubuntu.com/ubuntu jammy-security/main amd64 Packages [1,806 kB] 2024-09-14T10:53:44.006 INFO:teuthology.orchestra.run.smithi138.stdout:Get:5 http://security.ubuntu.com/ubuntu jammy-security/main i386 Packages [539 kB] 2024-09-14T10:53:44.012 INFO:teuthology.orchestra.run.smithi138.stdout:Get:6 http://security.ubuntu.com/ubuntu jammy-security/main Translation-en [295 kB] 2024-09-14T10:53:44.015 INFO:teuthology.orchestra.run.smithi138.stdout:Get:7 http://security.ubuntu.com/ubuntu jammy-security/main amd64 c-n-f Metadata [13.3 kB] 2024-09-14T10:53:44.016 INFO:teuthology.orchestra.run.smithi154.stdout:Get:5 http://security.ubuntu.com/ubuntu jammy-security/main i386 Packages [539 kB] 2024-09-14T10:53:44.016 INFO:teuthology.orchestra.run.smithi138.stdout:Get:8 http://security.ubuntu.com/ubuntu jammy-security/restricted amd64 Packages [2,377 kB] 2024-09-14T10:53:44.020 INFO:teuthology.orchestra.run.smithi154.stdout:Get:6 http://security.ubuntu.com/ubuntu jammy-security/main Translation-en [295 kB] 2024-09-14T10:53:44.023 INFO:teuthology.orchestra.run.smithi154.stdout:Get:7 http://security.ubuntu.com/ubuntu jammy-security/main amd64 c-n-f Metadata [13.3 kB] 2024-09-14T10:53:44.023 INFO:teuthology.orchestra.run.smithi154.stdout:Get:8 http://security.ubuntu.com/ubuntu jammy-security/restricted i386 Packages [37.7 kB] 2024-09-14T10:53:44.024 INFO:teuthology.orchestra.run.smithi154.stdout:Get:9 http://security.ubuntu.com/ubuntu jammy-security/restricted amd64 Packages [2,377 kB] 2024-09-14T10:53:44.038 INFO:teuthology.orchestra.run.smithi138.stdout:Get:9 http://security.ubuntu.com/ubuntu jammy-security/restricted i386 Packages [37.7 kB] 2024-09-14T10:53:44.039 INFO:teuthology.orchestra.run.smithi138.stdout:Get:10 http://security.ubuntu.com/ubuntu jammy-security/restricted Translation-en [409 kB] 2024-09-14T10:53:44.043 INFO:teuthology.orchestra.run.smithi138.stdout:Get:11 http://security.ubuntu.com/ubuntu jammy-security/restricted amd64 c-n-f Metadata [584 B] 2024-09-14T10:53:44.043 INFO:teuthology.orchestra.run.smithi138.stdout:Get:12 http://security.ubuntu.com/ubuntu jammy-security/universe i386 Packages [627 kB] 2024-09-14T10:53:44.044 INFO:teuthology.orchestra.run.smithi154.stdout:Get:10 http://security.ubuntu.com/ubuntu jammy-security/restricted Translation-en [409 kB] 2024-09-14T10:53:44.048 INFO:teuthology.orchestra.run.smithi154.stdout:Get:11 http://security.ubuntu.com/ubuntu jammy-security/restricted amd64 c-n-f Metadata [584 B] 2024-09-14T10:53:44.048 INFO:teuthology.orchestra.run.smithi154.stdout:Get:12 http://security.ubuntu.com/ubuntu jammy-security/universe i386 Packages [627 kB] 2024-09-14T10:53:44.049 INFO:teuthology.orchestra.run.smithi138.stdout:Get:13 http://security.ubuntu.com/ubuntu jammy-security/universe amd64 Packages [902 kB] 2024-09-14T10:53:44.053 INFO:teuthology.orchestra.run.smithi154.stdout:Get:13 http://security.ubuntu.com/ubuntu jammy-security/universe amd64 Packages [902 kB] 2024-09-14T10:53:44.056 INFO:teuthology.orchestra.run.smithi138.stdout:Get:14 http://security.ubuntu.com/ubuntu jammy-security/universe Translation-en [176 kB] 2024-09-14T10:53:44.058 INFO:teuthology.orchestra.run.smithi138.stdout:Get:15 http://security.ubuntu.com/ubuntu jammy-security/universe amd64 c-n-f Metadata [19.2 kB] 2024-09-14T10:53:44.058 INFO:teuthology.orchestra.run.smithi138.stdout:Get:16 http://security.ubuntu.com/ubuntu jammy-security/multiverse amd64 Packages [37.2 kB] 2024-09-14T10:53:44.059 INFO:teuthology.orchestra.run.smithi138.stdout:Get:17 http://security.ubuntu.com/ubuntu jammy-security/multiverse i386 Packages [1,356 B] 2024-09-14T10:53:44.060 INFO:teuthology.orchestra.run.smithi154.stdout:Get:14 http://security.ubuntu.com/ubuntu jammy-security/universe Translation-en [176 kB] 2024-09-14T10:53:44.062 INFO:teuthology.orchestra.run.smithi154.stdout:Get:15 http://security.ubuntu.com/ubuntu jammy-security/universe amd64 c-n-f Metadata [19.2 kB] 2024-09-14T10:53:44.062 INFO:teuthology.orchestra.run.smithi154.stdout:Get:16 http://security.ubuntu.com/ubuntu jammy-security/multiverse amd64 Packages [37.2 kB] 2024-09-14T10:53:44.062 INFO:teuthology.orchestra.run.smithi154.stdout:Get:17 http://security.ubuntu.com/ubuntu jammy-security/multiverse i386 Packages [1,356 B] 2024-09-14T10:53:44.063 INFO:teuthology.orchestra.run.smithi154.stdout:Get:18 http://security.ubuntu.com/ubuntu jammy-security/multiverse Translation-en [7,588 B] 2024-09-14T10:53:44.068 INFO:teuthology.orchestra.run.smithi138.stdout:Get:18 http://security.ubuntu.com/ubuntu jammy-security/multiverse Translation-en [7,588 B] 2024-09-14T10:53:44.096 INFO:teuthology.orchestra.run.smithi154.stdout:Get:19 http://security.ubuntu.com/ubuntu jammy-security/multiverse amd64 c-n-f Metadata [228 B] 2024-09-14T10:53:44.101 INFO:teuthology.orchestra.run.smithi138.stdout:Get:19 http://security.ubuntu.com/ubuntu jammy-security/multiverse amd64 c-n-f Metadata [228 B] 2024-09-14T10:53:44.235 INFO:teuthology.orchestra.run.smithi138.stdout:Get:20 http://archive.ubuntu.com/ubuntu jammy-backports InRelease [127 kB] 2024-09-14T10:53:44.243 INFO:teuthology.orchestra.run.smithi154.stdout:Get:20 http://archive.ubuntu.com/ubuntu jammy-backports InRelease [127 kB] 2024-09-14T10:53:44.373 INFO:teuthology.orchestra.run.smithi138.stdout:Get:21 http://archive.ubuntu.com/ubuntu jammy-updates/main i386 Packages [696 kB] 2024-09-14T10:53:44.382 INFO:teuthology.orchestra.run.smithi154.stdout:Get:21 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 Packages [2,023 kB] 2024-09-14T10:53:44.567 INFO:teuthology.orchestra.run.smithi138.stdout:Get:22 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 Packages [2,023 kB] 2024-09-14T10:53:44.701 INFO:teuthology.orchestra.run.smithi154.stdout:Get:22 http://archive.ubuntu.com/ubuntu jammy-updates/main i386 Packages [696 kB] 2024-09-14T10:53:44.726 INFO:teuthology.orchestra.run.smithi138.stdout:Get:23 http://archive.ubuntu.com/ubuntu jammy-updates/main Translation-en [352 kB] 2024-09-14T10:53:44.736 INFO:teuthology.orchestra.run.smithi154.stdout:Get:23 http://archive.ubuntu.com/ubuntu jammy-updates/main Translation-en [352 kB] 2024-09-14T10:53:44.740 INFO:teuthology.orchestra.run.smithi138.stdout:Get:24 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 c-n-f Metadata [17.8 kB] 2024-09-14T10:53:44.741 INFO:teuthology.orchestra.run.smithi138.stdout:Get:25 http://archive.ubuntu.com/ubuntu jammy-updates/restricted amd64 Packages [2,437 kB] 2024-09-14T10:53:44.751 INFO:teuthology.orchestra.run.smithi154.stdout:Get:24 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 c-n-f Metadata [17.8 kB] 2024-09-14T10:53:44.751 INFO:teuthology.orchestra.run.smithi154.stdout:Get:25 http://archive.ubuntu.com/ubuntu jammy-updates/restricted i386 Packages [39.3 kB] 2024-09-14T10:53:44.752 INFO:teuthology.orchestra.run.smithi154.stdout:Get:26 http://archive.ubuntu.com/ubuntu jammy-updates/restricted amd64 Packages [2,437 kB] 2024-09-14T10:53:44.810 INFO:teuthology.orchestra.run.smithi138.stdout:Get:26 http://archive.ubuntu.com/ubuntu jammy-updates/restricted i386 Packages [39.3 kB] 2024-09-14T10:53:44.811 INFO:teuthology.orchestra.run.smithi138.stdout:Get:27 http://archive.ubuntu.com/ubuntu jammy-updates/restricted Translation-en [419 kB] 2024-09-14T10:53:44.822 INFO:teuthology.orchestra.run.smithi154.stdout:Get:27 http://archive.ubuntu.com/ubuntu jammy-updates/restricted Translation-en [419 kB] 2024-09-14T10:53:44.827 INFO:teuthology.orchestra.run.smithi138.stdout:Get:28 http://archive.ubuntu.com/ubuntu jammy-updates/restricted amd64 c-n-f Metadata [616 B] 2024-09-14T10:53:44.827 INFO:teuthology.orchestra.run.smithi138.stdout:Get:29 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 Packages [1,124 kB] 2024-09-14T10:53:44.838 INFO:teuthology.orchestra.run.smithi154.stdout:Get:28 http://archive.ubuntu.com/ubuntu jammy-updates/restricted amd64 c-n-f Metadata [616 B] 2024-09-14T10:53:44.838 INFO:teuthology.orchestra.run.smithi154.stdout:Get:29 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 Packages [1,124 kB] 2024-09-14T10:53:44.859 INFO:teuthology.orchestra.run.smithi138.stdout:Get:30 http://archive.ubuntu.com/ubuntu jammy-updates/universe i386 Packages [732 kB] 2024-09-14T10:53:44.868 INFO:teuthology.orchestra.run.smithi154.stdout:Get:30 http://archive.ubuntu.com/ubuntu jammy-updates/universe i386 Packages [732 kB] 2024-09-14T10:53:44.877 INFO:teuthology.orchestra.run.smithi138.stdout:Get:31 http://archive.ubuntu.com/ubuntu jammy-updates/universe Translation-en [261 kB] 2024-09-14T10:53:44.883 INFO:teuthology.orchestra.run.smithi138.stdout:Get:32 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 c-n-f Metadata [26.1 kB] 2024-09-14T10:53:44.889 INFO:teuthology.orchestra.run.smithi154.stdout:Get:31 http://archive.ubuntu.com/ubuntu jammy-updates/universe Translation-en [261 kB] 2024-09-14T10:53:44.890 INFO:teuthology.orchestra.run.smithi138.stdout:Get:33 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse amd64 Packages [43.3 kB] 2024-09-14T10:53:44.892 INFO:teuthology.orchestra.run.smithi138.stdout:Get:34 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse i386 Packages [4,752 B] 2024-09-14T10:53:44.894 INFO:teuthology.orchestra.run.smithi154.stdout:Get:32 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 c-n-f Metadata [26.1 kB] 2024-09-14T10:53:44.895 INFO:teuthology.orchestra.run.smithi154.stdout:Get:33 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse i386 Packages [4,752 B] 2024-09-14T10:53:44.896 INFO:teuthology.orchestra.run.smithi154.stdout:Get:34 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse amd64 Packages [43.3 kB] 2024-09-14T10:53:44.897 INFO:teuthology.orchestra.run.smithi154.stdout:Get:35 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse Translation-en [10.8 kB] 2024-09-14T10:53:44.946 INFO:teuthology.orchestra.run.smithi154.stdout:Get:36 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse amd64 c-n-f Metadata [444 B] 2024-09-14T10:53:44.947 INFO:teuthology.orchestra.run.smithi154.stdout:Get:37 http://archive.ubuntu.com/ubuntu jammy-backports/main amd64 Packages [67.8 kB] 2024-09-14T10:53:44.948 INFO:teuthology.orchestra.run.smithi154.stdout:Get:38 http://archive.ubuntu.com/ubuntu jammy-backports/main i386 Packages [59.9 kB] 2024-09-14T10:53:44.960 INFO:teuthology.orchestra.run.smithi138.stdout:Get:35 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse Translation-en [10.8 kB] 2024-09-14T10:53:44.961 INFO:teuthology.orchestra.run.smithi138.stdout:Get:36 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse amd64 c-n-f Metadata [444 B] 2024-09-14T10:53:44.961 INFO:teuthology.orchestra.run.smithi138.stdout:Get:37 http://archive.ubuntu.com/ubuntu jammy-backports/main i386 Packages [59.9 kB] 2024-09-14T10:53:44.962 INFO:teuthology.orchestra.run.smithi138.stdout:Get:38 http://archive.ubuntu.com/ubuntu jammy-backports/main amd64 Packages [67.8 kB] 2024-09-14T10:53:44.964 INFO:teuthology.orchestra.run.smithi138.stdout:Get:39 http://archive.ubuntu.com/ubuntu jammy-backports/main Translation-en [11.1 kB] 2024-09-14T10:53:44.972 INFO:teuthology.orchestra.run.smithi138.stdout:Get:40 http://archive.ubuntu.com/ubuntu jammy-backports/main amd64 c-n-f Metadata [388 B] 2024-09-14T10:53:44.972 INFO:teuthology.orchestra.run.smithi138.stdout:Get:41 http://archive.ubuntu.com/ubuntu jammy-backports/universe i386 Packages [17.3 kB] 2024-09-14T10:53:44.973 INFO:teuthology.orchestra.run.smithi138.stdout:Get:42 http://archive.ubuntu.com/ubuntu jammy-backports/universe amd64 Packages [28.8 kB] 2024-09-14T10:53:44.980 INFO:teuthology.orchestra.run.smithi154.stdout:Get:39 http://archive.ubuntu.com/ubuntu jammy-backports/main Translation-en [11.1 kB] 2024-09-14T10:53:44.981 INFO:teuthology.orchestra.run.smithi154.stdout:Get:40 http://archive.ubuntu.com/ubuntu jammy-backports/main amd64 c-n-f Metadata [388 B] 2024-09-14T10:53:44.981 INFO:teuthology.orchestra.run.smithi154.stdout:Get:41 http://archive.ubuntu.com/ubuntu jammy-backports/universe amd64 Packages [28.8 kB] 2024-09-14T10:53:44.982 INFO:teuthology.orchestra.run.smithi154.stdout:Get:42 http://archive.ubuntu.com/ubuntu jammy-backports/universe i386 Packages [17.3 kB] 2024-09-14T10:53:44.983 INFO:teuthology.orchestra.run.smithi154.stdout:Get:43 http://archive.ubuntu.com/ubuntu jammy-backports/universe Translation-en [16.5 kB] 2024-09-14T10:53:45.027 INFO:teuthology.orchestra.run.smithi154.stdout:Get:44 http://archive.ubuntu.com/ubuntu jammy-backports/universe amd64 c-n-f Metadata [672 B] 2024-09-14T10:53:45.053 INFO:teuthology.orchestra.run.smithi138.stdout:Get:43 http://archive.ubuntu.com/ubuntu jammy-backports/universe Translation-en [16.5 kB] 2024-09-14T10:53:45.054 INFO:teuthology.orchestra.run.smithi138.stdout:Get:44 http://archive.ubuntu.com/ubuntu jammy-backports/universe amd64 c-n-f Metadata [672 B] 2024-09-14T10:53:50.442 INFO:teuthology.orchestra.run.smithi154.stdout:Fetched 16.0 MB in 2s (7,328 kB/s) 2024-09-14T10:53:50.463 INFO:teuthology.orchestra.run.smithi138.stdout:Fetched 16.0 MB in 2s (7,462 kB/s) 2024-09-14T10:53:51.850 INFO:teuthology.orchestra.run.smithi154.stdout:Reading package lists... 2024-09-14T10:53:51.867 DEBUG:teuthology.orchestra.run.smithi154:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic 2024-09-14T10:53:51.885 INFO:teuthology.orchestra.run.smithi138.stdout:Reading package lists... 2024-09-14T10:53:51.903 DEBUG:teuthology.orchestra.run.smithi138:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic 2024-09-14T10:53:51.921 INFO:teuthology.orchestra.run.smithi154.stdout:Reading package lists... 2024-09-14T10:53:52.012 INFO:teuthology.orchestra.run.smithi138.stdout:Reading package lists... 2024-09-14T10:53:52.129 INFO:teuthology.orchestra.run.smithi154.stdout:Building dependency tree... 2024-09-14T10:53:52.130 INFO:teuthology.orchestra.run.smithi154.stdout:Reading state information... 2024-09-14T10:53:52.217 INFO:teuthology.orchestra.run.smithi138.stdout:Building dependency tree... 2024-09-14T10:53:52.217 INFO:teuthology.orchestra.run.smithi138.stdout:Reading state information... 2024-09-14T10:53:52.298 INFO:teuthology.orchestra.run.smithi154.stdout:The following packages were automatically installed and are no longer required: 2024-09-14T10:53:52.298 INFO:teuthology.orchestra.run.smithi154.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-09-14T10:53:52.298 INFO:teuthology.orchestra.run.smithi154.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-09-14T10:53:52.299 INFO:teuthology.orchestra.run.smithi154.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-09-14T10:53:52.299 INFO:teuthology.orchestra.run.smithi154.stdout: python2 python2-dev python2-minimal python2.7 python2.7-dev 2024-09-14T10:53:52.299 INFO:teuthology.orchestra.run.smithi154.stdout: python2.7-minimal 2024-09-14T10:53:52.299 INFO:teuthology.orchestra.run.smithi154.stdout:Use 'sudo apt autoremove' to remove them. 2024-09-14T10:53:52.300 INFO:teuthology.orchestra.run.smithi154.stdout:The following additional packages will be installed: 2024-09-14T10:53:52.300 INFO:teuthology.orchestra.run.smithi154.stdout: linux-generic linux-headers-5.15.0-121 linux-headers-5.15.0-121-generic 2024-09-14T10:53:52.300 INFO:teuthology.orchestra.run.smithi154.stdout: linux-headers-generic linux-image-5.15.0-121-generic 2024-09-14T10:53:52.301 INFO:teuthology.orchestra.run.smithi154.stdout: linux-modules-5.15.0-121-generic linux-modules-extra-5.15.0-121-generic 2024-09-14T10:53:52.302 INFO:teuthology.orchestra.run.smithi154.stdout:Suggested packages: 2024-09-14T10:53:52.302 INFO:teuthology.orchestra.run.smithi154.stdout: fdutils linux-doc | linux-source-5.15.0 linux-tools 2024-09-14T10:53:52.302 INFO:teuthology.orchestra.run.smithi154.stdout:Recommended packages: 2024-09-14T10:53:52.302 INFO:teuthology.orchestra.run.smithi154.stdout: thermald 2024-09-14T10:53:52.356 INFO:teuthology.orchestra.run.smithi154.stdout:The following NEW packages will be installed: 2024-09-14T10:53:52.356 INFO:teuthology.orchestra.run.smithi154.stdout: linux-headers-5.15.0-121 linux-headers-5.15.0-121-generic 2024-09-14T10:53:52.357 INFO:teuthology.orchestra.run.smithi154.stdout: linux-image-5.15.0-121-generic linux-modules-5.15.0-121-generic 2024-09-14T10:53:52.357 INFO:teuthology.orchestra.run.smithi154.stdout: linux-modules-extra-5.15.0-121-generic 2024-09-14T10:53:52.358 INFO:teuthology.orchestra.run.smithi154.stdout:The following packages will be upgraded: 2024-09-14T10:53:52.359 INFO:teuthology.orchestra.run.smithi154.stdout: linux-generic linux-headers-generic linux-image-generic 2024-09-14T10:53:52.407 INFO:teuthology.orchestra.run.smithi138.stdout:The following packages were automatically installed and are no longer required: 2024-09-14T10:53:52.407 INFO:teuthology.orchestra.run.smithi138.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-09-14T10:53:52.407 INFO:teuthology.orchestra.run.smithi138.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-09-14T10:53:52.407 INFO:teuthology.orchestra.run.smithi138.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-09-14T10:53:52.407 INFO:teuthology.orchestra.run.smithi138.stdout: python2 python2-dev python2-minimal python2.7 python2.7-dev 2024-09-14T10:53:52.408 INFO:teuthology.orchestra.run.smithi138.stdout: python2.7-minimal 2024-09-14T10:53:52.408 INFO:teuthology.orchestra.run.smithi138.stdout:Use 'sudo apt autoremove' to remove them. 2024-09-14T10:53:52.409 INFO:teuthology.orchestra.run.smithi138.stdout:The following additional packages will be installed: 2024-09-14T10:53:52.409 INFO:teuthology.orchestra.run.smithi138.stdout: linux-generic linux-headers-5.15.0-121 linux-headers-5.15.0-121-generic 2024-09-14T10:53:52.409 INFO:teuthology.orchestra.run.smithi138.stdout: linux-headers-generic linux-image-5.15.0-121-generic 2024-09-14T10:53:52.409 INFO:teuthology.orchestra.run.smithi138.stdout: linux-modules-5.15.0-121-generic linux-modules-extra-5.15.0-121-generic 2024-09-14T10:53:52.411 INFO:teuthology.orchestra.run.smithi138.stdout:Suggested packages: 2024-09-14T10:53:52.411 INFO:teuthology.orchestra.run.smithi138.stdout: fdutils linux-doc | linux-source-5.15.0 linux-tools 2024-09-14T10:53:52.411 INFO:teuthology.orchestra.run.smithi138.stdout:Recommended packages: 2024-09-14T10:53:52.411 INFO:teuthology.orchestra.run.smithi138.stdout: thermald 2024-09-14T10:53:52.459 INFO:teuthology.orchestra.run.smithi138.stdout:The following NEW packages will be installed: 2024-09-14T10:53:52.459 INFO:teuthology.orchestra.run.smithi138.stdout: linux-headers-5.15.0-121 linux-headers-5.15.0-121-generic 2024-09-14T10:53:52.459 INFO:teuthology.orchestra.run.smithi138.stdout: linux-image-5.15.0-121-generic linux-modules-5.15.0-121-generic 2024-09-14T10:53:52.460 INFO:teuthology.orchestra.run.smithi138.stdout: linux-modules-extra-5.15.0-121-generic 2024-09-14T10:53:52.461 INFO:teuthology.orchestra.run.smithi138.stdout:The following packages will be upgraded: 2024-09-14T10:53:52.461 INFO:teuthology.orchestra.run.smithi138.stdout: linux-generic linux-headers-generic linux-image-generic 2024-09-14T10:53:52.512 INFO:teuthology.orchestra.run.smithi138.stdout:3 upgraded, 5 newly installed, 0 to remove and 344 not upgraded. 2024-09-14T10:53:52.512 INFO:teuthology.orchestra.run.smithi138.stdout:Need to get 113 MB of archives. 2024-09-14T10:53:52.513 INFO:teuthology.orchestra.run.smithi138.stdout:After this operation, 584 MB of additional disk space will be used. 2024-09-14T10:53:52.513 INFO:teuthology.orchestra.run.smithi138.stdout:Get:1 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-modules-5.15.0-121-generic amd64 5.15.0-121.131 [22.7 MB] 2024-09-14T10:53:52.538 INFO:teuthology.orchestra.run.smithi154.stdout:3 upgraded, 5 newly installed, 0 to remove and 344 not upgraded. 2024-09-14T10:53:52.538 INFO:teuthology.orchestra.run.smithi154.stdout:Need to get 113 MB of archives. 2024-09-14T10:53:52.538 INFO:teuthology.orchestra.run.smithi154.stdout:After this operation, 584 MB of additional disk space will be used. 2024-09-14T10:53:52.538 INFO:teuthology.orchestra.run.smithi154.stdout:Get:1 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-modules-5.15.0-121-generic amd64 5.15.0-121.131 [22.7 MB] 2024-09-14T10:53:52.953 INFO:teuthology.orchestra.run.smithi138.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-image-5.15.0-121-generic amd64 5.15.0-121.131 [11.5 MB] 2024-09-14T10:53:53.046 INFO:teuthology.orchestra.run.smithi138.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-modules-extra-5.15.0-121-generic amd64 5.15.0-121.131 [63.9 MB] 2024-09-14T10:53:53.860 INFO:teuthology.orchestra.run.smithi138.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-generic amd64 5.15.0.121.121 [1,694 B] 2024-09-14T10:53:53.860 INFO:teuthology.orchestra.run.smithi138.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-image-generic amd64 5.15.0.121.121 [2,464 B] 2024-09-14T10:53:53.860 INFO:teuthology.orchestra.run.smithi138.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-headers-5.15.0-121 all 5.15.0-121.131 [12.3 MB] 2024-09-14T10:53:53.979 INFO:teuthology.orchestra.run.smithi138.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-headers-5.15.0-121-generic amd64 5.15.0-121.131 [2,827 kB] 2024-09-14T10:53:54.001 INFO:teuthology.orchestra.run.smithi138.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-headers-generic amd64 5.15.0.121.121 [2,316 B] 2024-09-14T10:53:54.048 INFO:teuthology.orchestra.run.smithi154.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-image-5.15.0-121-generic amd64 5.15.0-121.131 [11.5 MB] 2024-09-14T10:53:54.393 INFO:teuthology.orchestra.run.smithi138.stdout:Fetched 113 MB in 2s (73.9 MB/s) 2024-09-14T10:53:54.396 INFO:teuthology.orchestra.run.smithi154.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-modules-extra-5.15.0-121-generic amd64 5.15.0-121.131 [63.9 MB] 2024-09-14T10:53:54.570 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package linux-modules-5.15.0-121-generic. 2024-09-14T10:53:56.591 INFO:teuthology.orchestra.run.smithi138.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 129542 files and directories currently installed.) 2024-09-14T10:53:56.598 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../0-linux-modules-5.15.0-121-generic_5.15.0-121.131_amd64.deb ... 2024-09-14T10:53:56.607 INFO:teuthology.orchestra.run.smithi154.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-generic amd64 5.15.0.121.121 [1,694 B] 2024-09-14T10:53:56.607 INFO:teuthology.orchestra.run.smithi154.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-image-generic amd64 5.15.0.121.121 [2,464 B] 2024-09-14T10:53:56.607 INFO:teuthology.orchestra.run.smithi154.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-headers-5.15.0-121 all 5.15.0-121.131 [12.3 MB] 2024-09-14T10:53:56.659 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking linux-modules-5.15.0-121-generic (5.15.0-121.131) ... 2024-09-14T10:53:56.945 INFO:teuthology.orchestra.run.smithi154.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-headers-5.15.0-121-generic amd64 5.15.0-121.131 [2,827 kB] 2024-09-14T10:53:57.028 INFO:teuthology.orchestra.run.smithi154.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-headers-generic amd64 5.15.0.121.121 [2,316 B] 2024-09-14T10:53:57.420 INFO:teuthology.orchestra.run.smithi154.stdout:Fetched 113 MB in 5s (24.3 MB/s) 2024-09-14T10:53:57.571 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package linux-modules-5.15.0-121-generic. 2024-09-14T10:53:58.877 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package linux-image-5.15.0-121-generic. 2024-09-14T10:53:58.898 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../1-linux-image-5.15.0-121-generic_5.15.0-121.131_amd64.deb ... 2024-09-14T10:53:58.984 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking linux-image-5.15.0-121-generic (5.15.0-121.131) ... 2024-09-14T10:53:59.388 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package linux-modules-extra-5.15.0-121-generic. 2024-09-14T10:53:59.409 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../2-linux-modules-extra-5.15.0-121-generic_5.15.0-121.131_amd64.deb ... 2024-09-14T10:53:59.447 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking linux-modules-extra-5.15.0-121-generic (5.15.0-121.131) ... 2024-09-14T10:53:59.595 INFO:teuthology.orchestra.run.smithi154.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 129542 files and directories currently installed.) 2024-09-14T10:53:59.599 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../0-linux-modules-5.15.0-121-generic_5.15.0-121.131_amd64.deb ... 2024-09-14T10:53:59.661 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking linux-modules-5.15.0-121-generic (5.15.0-121.131) ... 2024-09-14T10:54:01.947 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package linux-image-5.15.0-121-generic. 2024-09-14T10:54:01.968 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../1-linux-image-5.15.0-121-generic_5.15.0-121.131_amd64.deb ... 2024-09-14T10:54:02.057 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking linux-image-5.15.0-121-generic (5.15.0-121.131) ... 2024-09-14T10:54:02.516 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package linux-modules-extra-5.15.0-121-generic. 2024-09-14T10:54:02.537 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../2-linux-modules-extra-5.15.0-121-generic_5.15.0-121.131_amd64.deb ... 2024-09-14T10:54:02.574 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking linux-modules-extra-5.15.0-121-generic (5.15.0-121.131) ... 2024-09-14T10:54:06.088 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../3-linux-generic_5.15.0.121.121_amd64.deb ... 2024-09-14T10:54:06.215 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking linux-generic (5.15.0.121.121) over (5.15.0.56.54) ... 2024-09-14T10:54:06.589 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../4-linux-image-generic_5.15.0.121.121_amd64.deb ... 2024-09-14T10:54:06.710 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking linux-image-generic (5.15.0.121.121) over (5.15.0.56.54) ... 2024-09-14T10:54:07.013 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package linux-headers-5.15.0-121. 2024-09-14T10:54:07.035 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../5-linux-headers-5.15.0-121_5.15.0-121.131_all.deb ... 2024-09-14T10:54:07.071 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking linux-headers-5.15.0-121 (5.15.0-121.131) ... 2024-09-14T10:54:08.476 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../3-linux-generic_5.15.0.121.121_amd64.deb ... 2024-09-14T10:54:08.586 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking linux-generic (5.15.0.121.121) over (5.15.0.56.54) ... 2024-09-14T10:54:08.877 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../4-linux-image-generic_5.15.0.121.121_amd64.deb ... 2024-09-14T10:54:08.981 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking linux-image-generic (5.15.0.121.121) over (5.15.0.56.54) ... 2024-09-14T10:54:09.285 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package linux-headers-5.15.0-121. 2024-09-14T10:54:09.307 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../5-linux-headers-5.15.0-121_5.15.0-121.131_all.deb ... 2024-09-14T10:54:09.351 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking linux-headers-5.15.0-121 (5.15.0-121.131) ... 2024-09-14T10:54:13.069 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package linux-headers-5.15.0-121-generic. 2024-09-14T10:54:13.106 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../6-linux-headers-5.15.0-121-generic_5.15.0-121.131_amd64.deb ... 2024-09-14T10:54:13.144 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking linux-headers-5.15.0-121-generic (5.15.0-121.131) ... 2024-09-14T10:54:14.889 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package linux-headers-5.15.0-121-generic. 2024-09-14T10:54:14.926 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../6-linux-headers-5.15.0-121-generic_5.15.0-121.131_amd64.deb ... 2024-09-14T10:54:14.964 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking linux-headers-5.15.0-121-generic (5.15.0-121.131) ... 2024-09-14T10:54:15.824 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../7-linux-headers-generic_5.15.0.121.121_amd64.deb ... 2024-09-14T10:54:15.950 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking linux-headers-generic (5.15.0.121.121) over (5.15.0.56.54) ... 2024-09-14T10:54:16.274 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up linux-headers-5.15.0-121 (5.15.0-121.131) ... 2024-09-14T10:54:16.388 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up linux-headers-5.15.0-121-generic (5.15.0-121.131) ... 2024-09-14T10:54:16.514 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up linux-headers-generic (5.15.0.121.121) ... 2024-09-14T10:54:16.633 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up linux-image-5.15.0-121-generic (5.15.0-121.131) ... 2024-09-14T10:54:17.493 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../7-linux-headers-generic_5.15.0.121.121_amd64.deb ... 2024-09-14T10:54:17.616 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking linux-headers-generic (5.15.0.121.121) over (5.15.0.56.54) ... 2024-09-14T10:54:17.937 INFO:teuthology.orchestra.run.smithi138.stdout:I: /vmlinuz.old is now a symlink to boot/vmlinuz-5.15.0-56-generic 2024-09-14T10:54:17.937 INFO:teuthology.orchestra.run.smithi138.stdout:I: /initrd.img.old is now a symlink to boot/initrd.img-5.15.0-56-generic 2024-09-14T10:54:17.938 INFO:teuthology.orchestra.run.smithi138.stdout:I: /vmlinuz is now a symlink to boot/vmlinuz-5.15.0-121-generic 2024-09-14T10:54:17.938 INFO:teuthology.orchestra.run.smithi138.stdout:I: /initrd.img is now a symlink to boot/initrd.img-5.15.0-121-generic 2024-09-14T10:54:17.957 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up linux-headers-5.15.0-121 (5.15.0-121.131) ... 2024-09-14T10:54:18.063 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up linux-headers-5.15.0-121-generic (5.15.0-121.131) ... 2024-09-14T10:54:18.112 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up linux-modules-5.15.0-121-generic (5.15.0-121.131) ... 2024-09-14T10:54:18.181 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up linux-headers-generic (5.15.0.121.121) ... 2024-09-14T10:54:18.300 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up linux-image-5.15.0-121-generic (5.15.0-121.131) ... 2024-09-14T10:54:19.773 INFO:teuthology.orchestra.run.smithi154.stdout:I: /vmlinuz.old is now a symlink to boot/vmlinuz-5.15.0-56-generic 2024-09-14T10:54:19.774 INFO:teuthology.orchestra.run.smithi154.stdout:I: /initrd.img.old is now a symlink to boot/initrd.img-5.15.0-56-generic 2024-09-14T10:54:19.774 INFO:teuthology.orchestra.run.smithi154.stdout:I: /vmlinuz is now a symlink to boot/vmlinuz-5.15.0-121-generic 2024-09-14T10:54:19.774 INFO:teuthology.orchestra.run.smithi154.stdout:I: /initrd.img is now a symlink to boot/initrd.img-5.15.0-121-generic 2024-09-14T10:54:19.995 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up linux-modules-5.15.0-121-generic (5.15.0-121.131) ... 2024-09-14T10:54:20.122 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up linux-modules-extra-5.15.0-121-generic (5.15.0-121.131) ... 2024-09-14T10:54:21.396 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up linux-modules-extra-5.15.0-121-generic (5.15.0-121.131) ... 2024-09-14T10:54:21.532 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up linux-image-generic (5.15.0.121.121) ... 2024-09-14T10:54:21.641 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up linux-generic (5.15.0.121.121) ... 2024-09-14T10:54:21.767 INFO:teuthology.orchestra.run.smithi138.stdout:Processing triggers for linux-image-5.15.0-121-generic (5.15.0-121.131) ... 2024-09-14T10:54:21.836 INFO:teuthology.orchestra.run.smithi138.stdout:/etc/kernel/postinst.d/initramfs-tools: 2024-09-14T10:54:21.836 INFO:teuthology.orchestra.run.smithi138.stdout:update-initramfs: Generating /boot/initrd.img-5.15.0-121-generic 2024-09-14T10:54:22.755 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up linux-image-generic (5.15.0.121.121) ... 2024-09-14T10:54:22.881 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up linux-generic (5.15.0.121.121) ... 2024-09-14T10:54:22.999 INFO:teuthology.orchestra.run.smithi154.stdout:Processing triggers for linux-image-5.15.0-121-generic (5.15.0-121.131) ... 2024-09-14T10:54:23.070 INFO:teuthology.orchestra.run.smithi154.stdout:/etc/kernel/postinst.d/initramfs-tools: 2024-09-14T10:54:23.070 INFO:teuthology.orchestra.run.smithi154.stdout:update-initramfs: Generating /boot/initrd.img-5.15.0-121-generic 2024-09-14T10:54:36.652 INFO:teuthology.orchestra.run.smithi138.stdout:/etc/kernel/postinst.d/zz-update-grub: 2024-09-14T10:54:36.652 INFO:teuthology.orchestra.run.smithi138.stdout:Sourcing file `/etc/default/grub' 2024-09-14T10:54:36.671 INFO:teuthology.orchestra.run.smithi138.stdout:Sourcing file `/etc/default/grub.d/init-select.cfg' 2024-09-14T10:54:36.690 INFO:teuthology.orchestra.run.smithi138.stdout:Generating grub configuration file ... 2024-09-14T10:54:37.041 INFO:teuthology.orchestra.run.smithi138.stdout:Found linux image: /boot/vmlinuz-5.15.0-121-generic 2024-09-14T10:54:37.062 INFO:teuthology.orchestra.run.smithi138.stdout:Found initrd image: /boot/initrd.img-5.15.0-121-generic 2024-09-14T10:54:37.216 INFO:teuthology.orchestra.run.smithi154.stdout:/etc/kernel/postinst.d/zz-update-grub: 2024-09-14T10:54:37.216 INFO:teuthology.orchestra.run.smithi154.stdout:Sourcing file `/etc/default/grub' 2024-09-14T10:54:37.244 INFO:teuthology.orchestra.run.smithi154.stdout:Sourcing file `/etc/default/grub.d/init-select.cfg' 2024-09-14T10:54:37.262 INFO:teuthology.orchestra.run.smithi154.stdout:Generating grub configuration file ... 2024-09-14T10:54:37.445 INFO:teuthology.orchestra.run.smithi138.stdout:Found linux image: /boot/vmlinuz-5.15.0-56-generic 2024-09-14T10:54:37.451 INFO:teuthology.orchestra.run.smithi138.stdout:Found initrd image: /boot/initrd.img-5.15.0-56-generic 2024-09-14T10:54:37.515 INFO:teuthology.orchestra.run.smithi138.stdout:Found linux image: /boot/vmlinuz-5.4.0-135-generic 2024-09-14T10:54:37.520 INFO:teuthology.orchestra.run.smithi138.stdout:Found initrd image: /boot/initrd.img-5.4.0-135-generic 2024-09-14T10:54:37.536 INFO:teuthology.orchestra.run.smithi154.stdout:Found linux image: /boot/vmlinuz-5.15.0-121-generic 2024-09-14T10:54:37.568 INFO:teuthology.orchestra.run.smithi154.stdout:Found initrd image: /boot/initrd.img-5.15.0-121-generic 2024-09-14T10:54:37.678 INFO:teuthology.orchestra.run.smithi138.stdout:Warning: os-prober will not be executed to detect other bootable partitions. 2024-09-14T10:54:37.678 INFO:teuthology.orchestra.run.smithi138.stdout:Systems on them will not be added to the GRUB boot configuration. 2024-09-14T10:54:37.678 INFO:teuthology.orchestra.run.smithi138.stdout:Check GRUB_DISABLE_OS_PROBER documentation entry. 2024-09-14T10:54:37.725 INFO:teuthology.orchestra.run.smithi138.stdout:done 2024-09-14T10:54:37.861 INFO:teuthology.orchestra.run.smithi154.stdout:Found linux image: /boot/vmlinuz-5.15.0-56-generic 2024-09-14T10:54:37.868 INFO:teuthology.orchestra.run.smithi154.stdout:Found initrd image: /boot/initrd.img-5.15.0-56-generic 2024-09-14T10:54:37.936 INFO:teuthology.orchestra.run.smithi154.stdout:Found linux image: /boot/vmlinuz-5.4.0-135-generic 2024-09-14T10:54:37.942 INFO:teuthology.orchestra.run.smithi154.stdout:Found initrd image: /boot/initrd.img-5.4.0-135-generic 2024-09-14T10:54:38.108 INFO:teuthology.orchestra.run.smithi154.stdout:Warning: os-prober will not be executed to detect other bootable partitions. 2024-09-14T10:54:38.108 INFO:teuthology.orchestra.run.smithi154.stdout:Systems on them will not be added to the GRUB boot configuration. 2024-09-14T10:54:38.108 INFO:teuthology.orchestra.run.smithi154.stdout:Check GRUB_DISABLE_OS_PROBER documentation entry. 2024-09-14T10:54:38.146 INFO:teuthology.orchestra.run.smithi154.stdout:done 2024-09-14T10:54:38.237 DEBUG:teuthology.orchestra.run.smithi138:> dpkg -s linux-image-generic 2024-09-14T10:54:38.261 INFO:teuthology.orchestra.run.smithi138.stdout:Package: linux-image-generic 2024-09-14T10:54:38.262 INFO:teuthology.orchestra.run.smithi138.stdout:Status: install ok installed 2024-09-14T10:54:38.262 INFO:teuthology.orchestra.run.smithi138.stdout:Priority: optional 2024-09-14T10:54:38.262 INFO:teuthology.orchestra.run.smithi138.stdout:Section: kernel 2024-09-14T10:54:38.262 INFO:teuthology.orchestra.run.smithi138.stdout:Installed-Size: 21 2024-09-14T10:54:38.262 INFO:teuthology.orchestra.run.smithi138.stdout:Maintainer: Ubuntu Kernel Team 2024-09-14T10:54:38.262 INFO:teuthology.orchestra.run.smithi138.stdout:Architecture: amd64 2024-09-14T10:54:38.262 INFO:teuthology.orchestra.run.smithi138.stdout:Source: linux-meta 2024-09-14T10:54:38.262 INFO:teuthology.orchestra.run.smithi138.stdout:Version: 5.15.0.121.121 2024-09-14T10:54:38.262 INFO:teuthology.orchestra.run.smithi138.stdout:Provides: spl-modules (= 2.1.5-1ubuntu6~22.04.4), v4l2loopback-modules (= 0.12.7-2ubuntu2~22.04.1), virtualbox-guest-modules (= 5.15.0-121), wireguard-modules (= 1.0.0), zfs-modules (= 2.1.5-1ubuntu6~22.04.4) 2024-09-14T10:54:38.262 INFO:teuthology.orchestra.run.smithi138.stdout:Depends: linux-image-5.15.0-121-generic, linux-modules-extra-5.15.0-121-generic, linux-firmware, intel-microcode, amd64-microcode 2024-09-14T10:54:38.262 INFO:teuthology.orchestra.run.smithi138.stdout:Recommends: thermald 2024-09-14T10:54:38.262 INFO:teuthology.orchestra.run.smithi138.stdout:Description: Generic Linux kernel image 2024-09-14T10:54:38.263 INFO:teuthology.orchestra.run.smithi138.stdout: This package will always depend on the latest generic kernel image 2024-09-14T10:54:38.263 INFO:teuthology.orchestra.run.smithi138.stdout: available. 2024-09-14T10:54:38.263 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.15.0-56-generic Expected: 5.15.0-121-generic 2024-09-14T10:54:38.263 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2024-09-14T10:54:38.263 DEBUG:teuthology.task.kernel:src is distro, skipping download 2024-09-14T10:54:38.263 INFO:teuthology.task.kernel:Installing distro kernel on mon.a... 2024-09-14T10:54:38.263 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi138.front.sepia.ceph.com, path=None, version=distro) 2024-09-14T10:54:38.263 DEBUG:teuthology.orchestra.run.smithi138:> sudo apt-get clean 2024-09-14T10:54:38.433 DEBUG:teuthology.orchestra.run.smithi138:> sudo apt-get update 2024-09-14T10:54:38.569 INFO:teuthology.orchestra.run.smithi138.stdout:Hit:1 http://archive.ubuntu.com/ubuntu jammy InRelease 2024-09-14T10:54:38.569 INFO:teuthology.orchestra.run.smithi138.stdout:Hit:2 http://security.ubuntu.com/ubuntu jammy-security InRelease 2024-09-14T10:54:38.578 INFO:teuthology.orchestra.run.smithi138.stdout:Hit:3 http://archive.ubuntu.com/ubuntu jammy-updates InRelease 2024-09-14T10:54:38.595 INFO:teuthology.orchestra.run.smithi138.stdout:Hit:4 http://archive.ubuntu.com/ubuntu jammy-backports InRelease 2024-09-14T10:54:38.656 DEBUG:teuthology.orchestra.run.smithi154:> dpkg -s linux-image-generic 2024-09-14T10:54:38.675 INFO:teuthology.orchestra.run.smithi154.stdout:Package: linux-image-generic 2024-09-14T10:54:38.675 INFO:teuthology.orchestra.run.smithi154.stdout:Status: install ok installed 2024-09-14T10:54:38.675 INFO:teuthology.orchestra.run.smithi154.stdout:Priority: optional 2024-09-14T10:54:38.675 INFO:teuthology.orchestra.run.smithi154.stdout:Section: kernel 2024-09-14T10:54:38.676 INFO:teuthology.orchestra.run.smithi154.stdout:Installed-Size: 21 2024-09-14T10:54:38.676 INFO:teuthology.orchestra.run.smithi154.stdout:Maintainer: Ubuntu Kernel Team 2024-09-14T10:54:38.676 INFO:teuthology.orchestra.run.smithi154.stdout:Architecture: amd64 2024-09-14T10:54:38.676 INFO:teuthology.orchestra.run.smithi154.stdout:Source: linux-meta 2024-09-14T10:54:38.676 INFO:teuthology.orchestra.run.smithi154.stdout:Version: 5.15.0.121.121 2024-09-14T10:54:38.676 INFO:teuthology.orchestra.run.smithi154.stdout:Provides: spl-modules (= 2.1.5-1ubuntu6~22.04.4), v4l2loopback-modules (= 0.12.7-2ubuntu2~22.04.1), virtualbox-guest-modules (= 5.15.0-121), wireguard-modules (= 1.0.0), zfs-modules (= 2.1.5-1ubuntu6~22.04.4) 2024-09-14T10:54:38.676 INFO:teuthology.orchestra.run.smithi154.stdout:Depends: linux-image-5.15.0-121-generic, linux-modules-extra-5.15.0-121-generic, linux-firmware, intel-microcode, amd64-microcode 2024-09-14T10:54:38.676 INFO:teuthology.orchestra.run.smithi154.stdout:Recommends: thermald 2024-09-14T10:54:38.676 INFO:teuthology.orchestra.run.smithi154.stdout:Description: Generic Linux kernel image 2024-09-14T10:54:38.676 INFO:teuthology.orchestra.run.smithi154.stdout: This package will always depend on the latest generic kernel image 2024-09-14T10:54:38.676 INFO:teuthology.orchestra.run.smithi154.stdout: available. 2024-09-14T10:54:38.677 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.15.0-56-generic Expected: 5.15.0-121-generic 2024-09-14T10:54:38.677 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2024-09-14T10:54:38.677 DEBUG:teuthology.task.kernel:src is distro, skipping download 2024-09-14T10:54:38.677 INFO:teuthology.task.kernel:Installing distro kernel on mon.b... 2024-09-14T10:54:38.677 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi154.front.sepia.ceph.com, path=None, version=distro) 2024-09-14T10:54:38.677 DEBUG:teuthology.orchestra.run.smithi154:> sudo apt-get clean 2024-09-14T10:54:38.825 DEBUG:teuthology.orchestra.run.smithi154:> sudo apt-get update 2024-09-14T10:54:39.073 INFO:teuthology.orchestra.run.smithi154.stdout:Hit:1 http://archive.ubuntu.com/ubuntu jammy InRelease 2024-09-14T10:54:39.074 INFO:teuthology.orchestra.run.smithi154.stdout:Hit:2 http://security.ubuntu.com/ubuntu jammy-security InRelease 2024-09-14T10:54:39.146 INFO:teuthology.orchestra.run.smithi154.stdout:Hit:3 http://archive.ubuntu.com/ubuntu jammy-updates InRelease 2024-09-14T10:54:39.228 INFO:teuthology.orchestra.run.smithi154.stdout:Hit:4 http://archive.ubuntu.com/ubuntu jammy-backports InRelease 2024-09-14T10:54:39.998 INFO:teuthology.orchestra.run.smithi138.stdout:Reading package lists... 2024-09-14T10:54:40.018 DEBUG:teuthology.orchestra.run.smithi138:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic 2024-09-14T10:54:40.074 INFO:teuthology.orchestra.run.smithi138.stdout:Reading package lists... 2024-09-14T10:54:40.261 INFO:teuthology.orchestra.run.smithi138.stdout:Building dependency tree... 2024-09-14T10:54:40.261 INFO:teuthology.orchestra.run.smithi138.stdout:Reading state information... 2024-09-14T10:54:40.430 INFO:teuthology.orchestra.run.smithi138.stdout:linux-image-generic is already the newest version (5.15.0.121.121). 2024-09-14T10:54:40.430 INFO:teuthology.orchestra.run.smithi138.stdout:The following packages were automatically installed and are no longer required: 2024-09-14T10:54:40.430 INFO:teuthology.orchestra.run.smithi138.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-09-14T10:54:40.430 INFO:teuthology.orchestra.run.smithi138.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-09-14T10:54:40.430 INFO:teuthology.orchestra.run.smithi138.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-09-14T10:54:40.431 INFO:teuthology.orchestra.run.smithi138.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2024-09-14T10:54:40.431 INFO:teuthology.orchestra.run.smithi138.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2024-09-14T10:54:40.431 INFO:teuthology.orchestra.run.smithi138.stdout:Use 'sudo apt autoremove' to remove them. 2024-09-14T10:54:40.472 INFO:teuthology.orchestra.run.smithi138.stdout:0 upgraded, 0 newly installed, 0 to remove and 344 not upgraded. 2024-09-14T10:54:40.474 DEBUG:teuthology.orchestra.run.smithi138:> dpkg -s linux-image-generic 2024-09-14T10:54:40.517 INFO:teuthology.orchestra.run.smithi154.stdout:Reading package lists... 2024-09-14T10:54:40.526 INFO:teuthology.orchestra.run.smithi138.stdout:Package: linux-image-generic 2024-09-14T10:54:40.526 INFO:teuthology.orchestra.run.smithi138.stdout:Status: install ok installed 2024-09-14T10:54:40.527 INFO:teuthology.orchestra.run.smithi138.stdout:Priority: optional 2024-09-14T10:54:40.527 INFO:teuthology.orchestra.run.smithi138.stdout:Section: kernel 2024-09-14T10:54:40.527 INFO:teuthology.orchestra.run.smithi138.stdout:Installed-Size: 21 2024-09-14T10:54:40.527 INFO:teuthology.orchestra.run.smithi138.stdout:Maintainer: Ubuntu Kernel Team 2024-09-14T10:54:40.527 INFO:teuthology.orchestra.run.smithi138.stdout:Architecture: amd64 2024-09-14T10:54:40.527 INFO:teuthology.orchestra.run.smithi138.stdout:Source: linux-meta 2024-09-14T10:54:40.527 INFO:teuthology.orchestra.run.smithi138.stdout:Version: 5.15.0.121.121 2024-09-14T10:54:40.527 INFO:teuthology.orchestra.run.smithi138.stdout:Provides: spl-modules (= 2.1.5-1ubuntu6~22.04.4), v4l2loopback-modules (= 0.12.7-2ubuntu2~22.04.1), virtualbox-guest-modules (= 5.15.0-121), wireguard-modules (= 1.0.0), zfs-modules (= 2.1.5-1ubuntu6~22.04.4) 2024-09-14T10:54:40.527 INFO:teuthology.orchestra.run.smithi138.stdout:Depends: linux-image-5.15.0-121-generic, linux-modules-extra-5.15.0-121-generic, linux-firmware, intel-microcode, amd64-microcode 2024-09-14T10:54:40.527 INFO:teuthology.orchestra.run.smithi138.stdout:Recommends: thermald 2024-09-14T10:54:40.527 INFO:teuthology.orchestra.run.smithi138.stdout:Description: Generic Linux kernel image 2024-09-14T10:54:40.527 INFO:teuthology.orchestra.run.smithi138.stdout: This package will always depend on the latest generic kernel image 2024-09-14T10:54:40.527 INFO:teuthology.orchestra.run.smithi138.stdout: available. 2024-09-14T10:54:40.528 DEBUG:teuthology.orchestra.run.smithi138:> mktemp 2024-09-14T10:54:40.537 DEBUG:teuthology.orchestra.run.smithi154:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic 2024-09-14T10:54:40.575 INFO:teuthology.orchestra.run.smithi138.stdout:/tmp/tmp.YQU5fFBaVJ 2024-09-14T10:54:40.575 DEBUG:teuthology.orchestra.run.smithi138:> sudo cp /boot/grub/grub.cfg /tmp/tmp.YQU5fFBaVJ 2024-09-14T10:54:40.590 INFO:teuthology.orchestra.run.smithi154.stdout:Reading package lists... 2024-09-14T10:54:40.630 DEBUG:teuthology.orchestra.run.smithi138:> sudo chmod 0666 /tmp/tmp.YQU5fFBaVJ 2024-09-14T10:54:40.759 DEBUG:teuthology.orchestra.remote:smithi138:/tmp/tmp.YQU5fFBaVJ is 10KB 2024-09-14T10:54:40.776 DEBUG:teuthology.orchestra.run.smithi138:> rm -fr /tmp/tmp.YQU5fFBaVJ 2024-09-14T10:54:40.777 INFO:teuthology.orchestra.run.smithi154.stdout:Building dependency tree... 2024-09-14T10:54:40.778 INFO:teuthology.orchestra.run.smithi154.stdout:Reading state information... 2024-09-14T10:54:40.784 DEBUG:teuthology.orchestra.run.smithi138:> sudo rm -f -- /etc/grub.d/01_ceph_kernel 2024-09-14T10:54:40.839 DEBUG:teuthology.orchestra.run.smithi138:> set -ex 2024-09-14T10:54:40.840 DEBUG:teuthology.orchestra.run.smithi138:> sudo dd of=/etc/grub.d/01_ceph_kernel 2024-09-14T10:54:40.840 DEBUG:teuthology.orchestra.run.smithi138:> sudo chmod 755 /etc/grub.d/01_ceph_kernel 2024-09-14T10:54:40.910 INFO:teuthology.task.kernel:Distro Kernel Version: 5.15.0-121-generic 2024-09-14T10:54:40.910 DEBUG:teuthology.orchestra.run.smithi138:> sudo update-grub 2024-09-14T10:54:40.942 INFO:teuthology.orchestra.run.smithi154.stdout:linux-image-generic is already the newest version (5.15.0.121.121). 2024-09-14T10:54:40.942 INFO:teuthology.orchestra.run.smithi154.stdout:The following packages were automatically installed and are no longer required: 2024-09-14T10:54:40.942 INFO:teuthology.orchestra.run.smithi154.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-09-14T10:54:40.942 INFO:teuthology.orchestra.run.smithi154.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-09-14T10:54:40.942 INFO:teuthology.orchestra.run.smithi154.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-09-14T10:54:40.942 INFO:teuthology.orchestra.run.smithi154.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2024-09-14T10:54:40.943 INFO:teuthology.orchestra.run.smithi154.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2024-09-14T10:54:40.943 INFO:teuthology.orchestra.run.smithi154.stdout:Use 'sudo apt autoremove' to remove them. 2024-09-14T10:54:40.982 INFO:teuthology.orchestra.run.smithi154.stdout:0 upgraded, 0 newly installed, 0 to remove and 344 not upgraded. 2024-09-14T10:54:40.984 DEBUG:teuthology.orchestra.run.smithi154:> dpkg -s linux-image-generic 2024-09-14T10:54:41.043 INFO:teuthology.orchestra.run.smithi154.stdout:Package: linux-image-generic 2024-09-14T10:54:41.043 INFO:teuthology.orchestra.run.smithi154.stdout:Status: install ok installed 2024-09-14T10:54:41.044 INFO:teuthology.orchestra.run.smithi154.stdout:Priority: optional 2024-09-14T10:54:41.044 INFO:teuthology.orchestra.run.smithi154.stdout:Section: kernel 2024-09-14T10:54:41.044 INFO:teuthology.orchestra.run.smithi154.stdout:Installed-Size: 21 2024-09-14T10:54:41.044 INFO:teuthology.orchestra.run.smithi154.stdout:Maintainer: Ubuntu Kernel Team 2024-09-14T10:54:41.044 INFO:teuthology.orchestra.run.smithi154.stdout:Architecture: amd64 2024-09-14T10:54:41.044 INFO:teuthology.orchestra.run.smithi154.stdout:Source: linux-meta 2024-09-14T10:54:41.044 INFO:teuthology.orchestra.run.smithi154.stdout:Version: 5.15.0.121.121 2024-09-14T10:54:41.044 INFO:teuthology.orchestra.run.smithi154.stdout:Provides: spl-modules (= 2.1.5-1ubuntu6~22.04.4), v4l2loopback-modules (= 0.12.7-2ubuntu2~22.04.1), virtualbox-guest-modules (= 5.15.0-121), wireguard-modules (= 1.0.0), zfs-modules (= 2.1.5-1ubuntu6~22.04.4) 2024-09-14T10:54:41.044 INFO:teuthology.orchestra.run.smithi154.stdout:Depends: linux-image-5.15.0-121-generic, linux-modules-extra-5.15.0-121-generic, linux-firmware, intel-microcode, amd64-microcode 2024-09-14T10:54:41.044 INFO:teuthology.orchestra.run.smithi154.stdout:Recommends: thermald 2024-09-14T10:54:41.044 INFO:teuthology.orchestra.run.smithi154.stdout:Description: Generic Linux kernel image 2024-09-14T10:54:41.044 INFO:teuthology.orchestra.run.smithi154.stdout: This package will always depend on the latest generic kernel image 2024-09-14T10:54:41.044 INFO:teuthology.orchestra.run.smithi154.stdout: available. 2024-09-14T10:54:41.045 DEBUG:teuthology.orchestra.run.smithi154:> mktemp 2024-09-14T10:54:41.089 INFO:teuthology.orchestra.run.smithi154.stdout:/tmp/tmp.fqmJSqFBxX 2024-09-14T10:54:41.089 DEBUG:teuthology.orchestra.run.smithi154:> sudo cp /boot/grub/grub.cfg /tmp/tmp.fqmJSqFBxX 2024-09-14T10:54:41.145 DEBUG:teuthology.orchestra.run.smithi154:> sudo chmod 0666 /tmp/tmp.fqmJSqFBxX 2024-09-14T10:54:41.262 DEBUG:teuthology.orchestra.remote:smithi154:/tmp/tmp.fqmJSqFBxX is 10KB 2024-09-14T10:54:41.274 DEBUG:teuthology.orchestra.run.smithi154:> rm -fr /tmp/tmp.fqmJSqFBxX 2024-09-14T10:54:41.280 DEBUG:teuthology.orchestra.run.smithi154:> sudo rm -f -- /etc/grub.d/01_ceph_kernel 2024-09-14T10:54:41.336 DEBUG:teuthology.orchestra.run.smithi154:> set -ex 2024-09-14T10:54:41.336 DEBUG:teuthology.orchestra.run.smithi154:> sudo dd of=/etc/grub.d/01_ceph_kernel 2024-09-14T10:54:41.336 DEBUG:teuthology.orchestra.run.smithi154:> sudo chmod 755 /etc/grub.d/01_ceph_kernel 2024-09-14T10:54:41.403 INFO:teuthology.task.kernel:Distro Kernel Version: 5.15.0-121-generic 2024-09-14T10:54:41.403 DEBUG:teuthology.orchestra.run.smithi154:> sudo update-grub 2024-09-14T10:54:42.215 INFO:teuthology.orchestra.run.smithi138.stderr:Sourcing file `/etc/default/grub' 2024-09-14T10:54:42.215 INFO:teuthology.orchestra.run.smithi138.stderr:Sourcing file `/etc/default/grub.d/init-select.cfg' 2024-09-14T10:54:42.218 INFO:teuthology.orchestra.run.smithi138.stderr:Generating grub configuration file ... 2024-09-14T10:54:42.477 INFO:teuthology.orchestra.run.smithi138.stderr:Found linux image: /boot/vmlinuz-5.15.0-121-generic 2024-09-14T10:54:42.482 INFO:teuthology.orchestra.run.smithi138.stderr:Found initrd image: /boot/initrd.img-5.15.0-121-generic 2024-09-14T10:54:42.528 INFO:teuthology.orchestra.run.smithi154.stderr:Sourcing file `/etc/default/grub' 2024-09-14T10:54:42.529 INFO:teuthology.orchestra.run.smithi154.stderr:Sourcing file `/etc/default/grub.d/init-select.cfg' 2024-09-14T10:54:42.532 INFO:teuthology.orchestra.run.smithi154.stderr:Generating grub configuration file ... 2024-09-14T10:54:42.730 INFO:teuthology.orchestra.run.smithi154.stderr:Found linux image: /boot/vmlinuz-5.15.0-121-generic 2024-09-14T10:54:42.736 INFO:teuthology.orchestra.run.smithi154.stderr:Found initrd image: /boot/initrd.img-5.15.0-121-generic 2024-09-14T10:54:42.791 INFO:teuthology.orchestra.run.smithi138.stderr:Found linux image: /boot/vmlinuz-5.15.0-56-generic 2024-09-14T10:54:42.796 INFO:teuthology.orchestra.run.smithi138.stderr:Found initrd image: /boot/initrd.img-5.15.0-56-generic 2024-09-14T10:54:42.834 INFO:teuthology.orchestra.run.smithi138.stderr:Found linux image: /boot/vmlinuz-5.4.0-135-generic 2024-09-14T10:54:42.838 INFO:teuthology.orchestra.run.smithi138.stderr:Found initrd image: /boot/initrd.img-5.4.0-135-generic 2024-09-14T10:54:42.965 INFO:teuthology.orchestra.run.smithi138.stderr:Warning: os-prober will not be executed to detect other bootable partitions. 2024-09-14T10:54:42.966 INFO:teuthology.orchestra.run.smithi138.stderr:Systems on them will not be added to the GRUB boot configuration. 2024-09-14T10:54:42.966 INFO:teuthology.orchestra.run.smithi138.stderr:Check GRUB_DISABLE_OS_PROBER documentation entry. 2024-09-14T10:54:42.970 INFO:teuthology.orchestra.run.smithi154.stderr:Found linux image: /boot/vmlinuz-5.15.0-56-generic 2024-09-14T10:54:42.976 INFO:teuthology.orchestra.run.smithi154.stderr:Found initrd image: /boot/initrd.img-5.15.0-56-generic 2024-09-14T10:54:42.976 INFO:teuthology.orchestra.run.smithi138.stderr:done 2024-09-14T10:54:42.991 DEBUG:teuthology.orchestra.run.smithi138:> sudo shutdown -r now 2024-09-14T10:54:43.016 INFO:teuthology.orchestra.run.smithi154.stderr:Found linux image: /boot/vmlinuz-5.4.0-135-generic 2024-09-14T10:54:43.021 INFO:teuthology.orchestra.run.smithi154.stderr:Found initrd image: /boot/initrd.img-5.4.0-135-generic 2024-09-14T10:54:43.133 INFO:teuthology.orchestra.run.smithi154.stderr:Warning: os-prober will not be executed to detect other bootable partitions. 2024-09-14T10:54:43.133 INFO:teuthology.orchestra.run.smithi154.stderr:Systems on them will not be added to the GRUB boot configuration. 2024-09-14T10:54:43.133 INFO:teuthology.orchestra.run.smithi154.stderr:Check GRUB_DISABLE_OS_PROBER documentation entry. 2024-09-14T10:54:43.143 INFO:teuthology.orchestra.run.smithi154.stderr:done 2024-09-14T10:54:43.156 DEBUG:teuthology.orchestra.run.smithi154:> sudo shutdown -r now 2024-09-14T10:55:13.022 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2024-09-14T10:55:13.023 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi138.front.sepia.ceph.com' 2024-09-14T10:55:13.024 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi138.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-14T10:55:13.158 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2024-09-14T10:55:13.159 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi154.front.sepia.ceph.com' 2024-09-14T10:55:13.159 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi154.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-14T10:55:31.389 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.138 2024-09-14T10:55:31.645 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.154 2024-09-14T10:55:40.398 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi138.front.sepia.ceph.com' 2024-09-14T10:55:40.399 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi138.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-14T10:55:40.646 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi154.front.sepia.ceph.com' 2024-09-14T10:55:40.647 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi154.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-14T10:55:43.453 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.138 2024-09-14T10:55:43.709 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.154 2024-09-14T10:55:55.461 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi138.front.sepia.ceph.com' 2024-09-14T10:55:55.462 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi138.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-14T10:55:55.710 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi154.front.sepia.ceph.com' 2024-09-14T10:55:55.710 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi154.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-14T10:56:13.885 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.138 2024-09-14T10:56:28.901 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi138.front.sepia.ceph.com' 2024-09-14T10:56:28.902 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi138.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-14T10:56:29.235 DEBUG:teuthology.orchestra.run.smithi138:> true 2024-09-14T10:56:29.885 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi138.front.sepia.ceph.com' 2024-09-14T10:56:29.885 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "5.15.0-121-generic"... 2024-09-14T10:56:29.886 DEBUG:teuthology.orchestra.run.smithi138:> uname -r 2024-09-14T10:56:29.933 INFO:teuthology.orchestra.run.smithi138.stdout:5.15.0-121-generic 2024-09-14T10:56:29.934 DEBUG:teuthology.task.kernel:current kernel version is 5.15.0-121-generic vs 5.15.0-121-generic 2024-09-14T10:56:29.934 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-09-14T10:56:29.934 DEBUG:teuthology.task.kernel:Distro of this test job: ubuntu 2024-09-14T10:56:30.934 INFO:teuthology.task.kernel:Enabling kdb on mon.a... 2024-09-14T10:56:30.935 DEBUG:teuthology.orchestra.run.smithi138:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2024-09-14T10:56:31.005 INFO:teuthology.orchestra.run.smithi138.stdout:ttyS1 2024-09-14T10:56:31.032 DEBUG:teuthology.parallel:result is None 2024-09-14T10:56:55.713 DEBUG:teuthology.orchestra.remote:timed out 2024-09-14T10:57:10.714 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi154.front.sepia.ceph.com' 2024-09-14T10:57:10.715 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi154.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-14T10:57:11.110 DEBUG:teuthology.orchestra.run.smithi154:> true 2024-09-14T10:57:11.664 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi154.front.sepia.ceph.com' 2024-09-14T10:57:11.664 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "5.15.0-121-generic"... 2024-09-14T10:57:11.664 DEBUG:teuthology.orchestra.run.smithi154:> uname -r 2024-09-14T10:57:11.710 INFO:teuthology.orchestra.run.smithi154.stdout:5.15.0-121-generic 2024-09-14T10:57:11.710 DEBUG:teuthology.task.kernel:current kernel version is 5.15.0-121-generic vs 5.15.0-121-generic 2024-09-14T10:57:11.710 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-09-14T10:57:11.710 DEBUG:teuthology.task.kernel:Distro of this test job: ubuntu 2024-09-14T10:57:12.711 INFO:teuthology.task.kernel:Enabling kdb on mon.b... 2024-09-14T10:57:12.712 DEBUG:teuthology.orchestra.run.smithi154:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2024-09-14T10:57:12.791 INFO:teuthology.orchestra.run.smithi154.stdout:ttyS1 2024-09-14T10:57:12.815 DEBUG:teuthology.parallel:result is None 2024-09-14T10:57:12.815 INFO:teuthology.run_tasks:Running task internal.base... 2024-09-14T10:57:12.824 INFO:teuthology.task.internal:Creating test directory... 2024-09-14T10:57:12.824 DEBUG:teuthology.orchestra.run.smithi138:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-09-14T10:57:12.827 DEBUG:teuthology.orchestra.run.smithi154:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-09-14T10:57:12.832 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2024-09-14T10:57:12.856 INFO:teuthology.run_tasks:Running task internal.archive... 2024-09-14T10:57:12.889 INFO:teuthology.task.internal:Creating archive directory... 2024-09-14T10:57:12.889 DEBUG:teuthology.orchestra.run.smithi138:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-09-14T10:57:12.892 DEBUG:teuthology.orchestra.run.smithi154:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-09-14T10:57:12.911 INFO:teuthology.run_tasks:Running task internal.coredump... 2024-09-14T10:57:12.922 INFO:teuthology.task.internal:Enabling coredump saving... 2024-09-14T10:57:12.922 DEBUG:teuthology.orchestra.run.smithi138:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-09-14T10:57:12.951 DEBUG:teuthology.orchestra.run.smithi154:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-09-14T10:57:12.971 INFO:teuthology.orchestra.run.smithi154.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-14T10:57:12.972 INFO:teuthology.orchestra.run.smithi138.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-14T10:57:12.979 INFO:teuthology.orchestra.run.smithi154.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-14T10:57:12.981 INFO:teuthology.orchestra.run.smithi138.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-14T10:57:12.982 INFO:teuthology.run_tasks:Running task internal.sudo... 2024-09-14T10:57:12.990 INFO:teuthology.task.internal:Configuring sudo... 2024-09-14T10:57:12.990 DEBUG:teuthology.orchestra.run.smithi138:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-09-14T10:57:13.027 DEBUG:teuthology.orchestra.run.smithi154:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-09-14T10:57:13.039 INFO:teuthology.run_tasks:Running task internal.syslog... 2024-09-14T10:57:13.049 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2024-09-14T10:57:13.050 DEBUG:teuthology.orchestra.run.smithi138:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-09-14T10:57:13.085 DEBUG:teuthology.orchestra.run.smithi154:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-09-14T10:57:13.090 DEBUG:teuthology.orchestra.run.smithi138:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-14T10:57:13.137 DEBUG:teuthology.orchestra.run.smithi138:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-14T10:57:13.186 DEBUG:teuthology.orchestra.run.smithi138:> set -ex 2024-09-14T10:57:13.186 DEBUG:teuthology.orchestra.run.smithi138:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-09-14T10:57:13.276 DEBUG:teuthology.orchestra.run.smithi154:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-14T10:57:13.282 DEBUG:teuthology.orchestra.run.smithi154:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-14T10:57:13.330 DEBUG:teuthology.orchestra.run.smithi154:> set -ex 2024-09-14T10:57:13.330 DEBUG:teuthology.orchestra.run.smithi154:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-09-14T10:57:13.402 DEBUG:teuthology.orchestra.run.smithi138:> sudo service rsyslog restart 2024-09-14T10:57:13.404 DEBUG:teuthology.orchestra.run.smithi154:> sudo service rsyslog restart 2024-09-14T10:57:13.479 INFO:teuthology.run_tasks:Running task internal.timer... 2024-09-14T10:57:13.487 INFO:teuthology.task.internal:Starting timer... 2024-09-14T10:57:13.487 INFO:teuthology.run_tasks:Running task pcp... 2024-09-14T10:57:13.554 INFO:teuthology.run_tasks:Running task selinux... 2024-09-14T10:57:13.666 DEBUG:teuthology.task.selinux:Excluding smithi138: OS 'ubuntu' does not support SELinux 2024-09-14T10:57:13.666 DEBUG:teuthology.task.selinux:Excluding smithi154: OS 'ubuntu' does not support SELinux 2024-09-14T10:57:13.667 DEBUG:teuthology.task.selinux:Getting current SELinux state 2024-09-14T10:57:13.667 DEBUG:teuthology.task.selinux:Existing SELinux modes: {} 2024-09-14T10:57:13.667 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2024-09-14T10:57:13.667 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2024-09-14T10:57:13.700 DEBUG:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2024-09-14T10:57:13.712 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2024-09-14T10:57:13.713 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi138.front.sepia.ceph.com,smithi154.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2024-09-14T11:04:44.931 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi138.front.sepia.ceph.com'), Remote(name='ubuntu@smithi154.front.sepia.ceph.com')] 2024-09-14T11:04:44.933 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi138.front.sepia.ceph.com' 2024-09-14T11:04:44.934 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi138.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-14T11:04:45.017 DEBUG:teuthology.orchestra.run.smithi138:> true 2024-09-14T11:04:45.092 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi138.front.sepia.ceph.com' 2024-09-14T11:04:45.093 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi154.front.sepia.ceph.com' 2024-09-14T11:04:45.093 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi154.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-14T11:04:45.173 DEBUG:teuthology.orchestra.run.smithi154:> true 2024-09-14T11:04:45.256 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi154.front.sepia.ceph.com' 2024-09-14T11:04:45.257 INFO:teuthology.run_tasks:Running task clock... 2024-09-14T11:04:45.269 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2024-09-14T11:04:45.269 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-09-14T11:04:45.269 DEBUG:teuthology.orchestra.run.smithi138:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-14T11:04:45.272 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-09-14T11:04:45.272 DEBUG:teuthology.orchestra.run.smithi154:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-14T11:04:45.299 INFO:teuthology.orchestra.run.smithi138.stdout:14 Sep 11:04:45 ntpd[18465]: ntpd 4.2.8p15@1.3728-o Wed Feb 16 17:13:02 UTC 2022 (1): Starting 2024-09-14T11:04:45.299 INFO:teuthology.orchestra.run.smithi138.stdout:14 Sep 11:04:45 ntpd[18465]: Command line: ntpd -gq 2024-09-14T11:04:45.299 INFO:teuthology.orchestra.run.smithi138.stdout:14 Sep 11:04:45 ntpd[18465]: ---------------------------------------------------- 2024-09-14T11:04:45.299 INFO:teuthology.orchestra.run.smithi138.stdout:14 Sep 11:04:45 ntpd[18465]: ntp-4 is maintained by Network Time Foundation, 2024-09-14T11:04:45.300 INFO:teuthology.orchestra.run.smithi138.stdout:14 Sep 11:04:45 ntpd[18465]: Inc. (NTF), a non-profit 501(c)(3) public-benefit 2024-09-14T11:04:45.300 INFO:teuthology.orchestra.run.smithi138.stdout:14 Sep 11:04:45 ntpd[18465]: corporation. Support and training for ntp-4 are 2024-09-14T11:04:45.300 INFO:teuthology.orchestra.run.smithi138.stdout:14 Sep 11:04:45 ntpd[18465]: available at https://www.nwtime.org/support 2024-09-14T11:04:45.300 INFO:teuthology.orchestra.run.smithi138.stdout:14 Sep 11:04:45 ntpd[18465]: ---------------------------------------------------- 2024-09-14T11:04:45.300 INFO:teuthology.orchestra.run.smithi138.stdout:14 Sep 11:04:45 ntpd[18465]: proto: precision = 0.058 usec (-24) 2024-09-14T11:04:45.300 INFO:teuthology.orchestra.run.smithi138.stdout:14 Sep 11:04:45 ntpd[18465]: basedate set to 2022-02-04 2024-09-14T11:04:45.300 INFO:teuthology.orchestra.run.smithi138.stdout:14 Sep 11:04:45 ntpd[18465]: gps base set to 2022-02-06 (week 2196) 2024-09-14T11:04:45.300 INFO:teuthology.orchestra.run.smithi138.stderr:restrict 0.0.0.0: KOD does nothing without LIMITED. 2024-09-14T11:04:45.301 INFO:teuthology.orchestra.run.smithi138.stdout:14 Sep 11:04:45 ntpd[18465]: restrict 0.0.0.0: KOD does nothing without LIMITED. 2024-09-14T11:04:45.301 INFO:teuthology.orchestra.run.smithi138.stdout:14 Sep 11:04:45 ntpd[18465]: restrict ::: KOD does nothing without LIMITED. 2024-09-14T11:04:45.301 INFO:teuthology.orchestra.run.smithi138.stderr:restrict ::: KOD does nothing without LIMITED. 2024-09-14T11:04:45.302 INFO:teuthology.orchestra.run.smithi138.stdout:14 Sep 11:04:45 ntpd[18465]: Listen and drop on 0 v6wildcard [::]:123 2024-09-14T11:04:45.302 INFO:teuthology.orchestra.run.smithi138.stdout:14 Sep 11:04:45 ntpd[18465]: Listen and drop on 1 v4wildcard 0.0.0.0:123 2024-09-14T11:04:45.302 INFO:teuthology.orchestra.run.smithi138.stdout:14 Sep 11:04:45 ntpd[18465]: Listen normally on 2 lo 127.0.0.1:123 2024-09-14T11:04:45.302 INFO:teuthology.orchestra.run.smithi138.stdout:14 Sep 11:04:45 ntpd[18465]: Listen normally on 3 enp3s0f1 172.21.15.138:123 2024-09-14T11:04:45.302 INFO:teuthology.orchestra.run.smithi138.stdout:14 Sep 11:04:45 ntpd[18465]: Listen normally on 4 lo [::1]:123 2024-09-14T11:04:45.302 INFO:teuthology.orchestra.run.smithi138.stdout:14 Sep 11:04:45 ntpd[18465]: Listen normally on 5 enp3s0f1 [fe80::ec4:7aff:fe88:6f71%5]:123 2024-09-14T11:04:45.303 INFO:teuthology.orchestra.run.smithi138.stdout:14 Sep 11:04:45 ntpd[18465]: Listening on routing socket on fd #22 for interface updates 2024-09-14T11:04:45.325 INFO:teuthology.orchestra.run.smithi154.stdout:14 Sep 11:04:45 ntpd[18511]: ntpd 4.2.8p15@1.3728-o Wed Feb 16 17:13:02 UTC 2022 (1): Starting 2024-09-14T11:04:45.326 INFO:teuthology.orchestra.run.smithi154.stdout:14 Sep 11:04:45 ntpd[18511]: Command line: ntpd -gq 2024-09-14T11:04:45.326 INFO:teuthology.orchestra.run.smithi154.stdout:14 Sep 11:04:45 ntpd[18511]: ---------------------------------------------------- 2024-09-14T11:04:45.326 INFO:teuthology.orchestra.run.smithi154.stdout:14 Sep 11:04:45 ntpd[18511]: ntp-4 is maintained by Network Time Foundation, 2024-09-14T11:04:45.326 INFO:teuthology.orchestra.run.smithi154.stdout:14 Sep 11:04:45 ntpd[18511]: Inc. (NTF), a non-profit 501(c)(3) public-benefit 2024-09-14T11:04:45.326 INFO:teuthology.orchestra.run.smithi154.stdout:14 Sep 11:04:45 ntpd[18511]: corporation. Support and training for ntp-4 are 2024-09-14T11:04:45.326 INFO:teuthology.orchestra.run.smithi154.stdout:14 Sep 11:04:45 ntpd[18511]: available at https://www.nwtime.org/support 2024-09-14T11:04:45.326 INFO:teuthology.orchestra.run.smithi154.stdout:14 Sep 11:04:45 ntpd[18511]: ---------------------------------------------------- 2024-09-14T11:04:45.326 INFO:teuthology.orchestra.run.smithi154.stdout:14 Sep 11:04:45 ntpd[18511]: proto: precision = 0.095 usec (-23) 2024-09-14T11:04:45.327 INFO:teuthology.orchestra.run.smithi154.stdout:14 Sep 11:04:45 ntpd[18511]: basedate set to 2022-02-04 2024-09-14T11:04:45.327 INFO:teuthology.orchestra.run.smithi154.stdout:14 Sep 11:04:45 ntpd[18511]: gps base set to 2022-02-06 (week 2196) 2024-09-14T11:04:45.327 INFO:teuthology.orchestra.run.smithi154.stderr:restrict 0.0.0.0: KOD does nothing without LIMITED. 2024-09-14T11:04:45.328 INFO:teuthology.orchestra.run.smithi154.stdout:14 Sep 11:04:45 ntpd[18511]: restrict 0.0.0.0: KOD does nothing without LIMITED. 2024-09-14T11:04:45.328 INFO:teuthology.orchestra.run.smithi154.stdout:14 Sep 11:04:45 ntpd[18511]: restrict ::: KOD does nothing without LIMITED. 2024-09-14T11:04:45.328 INFO:teuthology.orchestra.run.smithi154.stderr:restrict ::: KOD does nothing without LIMITED. 2024-09-14T11:04:45.329 INFO:teuthology.orchestra.run.smithi154.stdout:14 Sep 11:04:45 ntpd[18511]: Listen and drop on 0 v6wildcard [::]:123 2024-09-14T11:04:45.329 INFO:teuthology.orchestra.run.smithi154.stdout:14 Sep 11:04:45 ntpd[18511]: Listen and drop on 1 v4wildcard 0.0.0.0:123 2024-09-14T11:04:45.329 INFO:teuthology.orchestra.run.smithi154.stdout:14 Sep 11:04:45 ntpd[18511]: Listen normally on 2 lo 127.0.0.1:123 2024-09-14T11:04:45.329 INFO:teuthology.orchestra.run.smithi154.stdout:14 Sep 11:04:45 ntpd[18511]: Listen normally on 3 enp3s0f1 172.21.15.154:123 2024-09-14T11:04:45.329 INFO:teuthology.orchestra.run.smithi154.stdout:14 Sep 11:04:45 ntpd[18511]: Listen normally on 4 lo [::1]:123 2024-09-14T11:04:45.329 INFO:teuthology.orchestra.run.smithi154.stdout:14 Sep 11:04:45 ntpd[18511]: Listen normally on 5 enp3s0f1 [fe80::ec4:7aff:fe88:7761%5]:123 2024-09-14T11:04:45.329 INFO:teuthology.orchestra.run.smithi154.stdout:14 Sep 11:04:45 ntpd[18511]: Listening on routing socket on fd #22 for interface updates 2024-09-14T11:04:46.299 INFO:teuthology.orchestra.run.smithi138.stderr:14 Sep 11:04:46 ntpd[18465]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-14T11:04:46.299 INFO:teuthology.orchestra.run.smithi138.stderr:14 Sep 11:04:46 ntpd[18465]: can't open /var/log/ntpstats/rawstats.20240914: Permission denied 2024-09-14T11:04:46.299 INFO:teuthology.orchestra.run.smithi138.stderr:14 Sep 11:04:46 ntpd[18465]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-14T11:04:46.299 INFO:teuthology.orchestra.run.smithi138.stderr:14 Sep 11:04:46 ntpd[18465]: can't open /var/log/ntpstats/rawstats.20240914: Permission denied 2024-09-14T11:04:46.300 INFO:teuthology.orchestra.run.smithi138.stderr:14 Sep 11:04:46 ntpd[18465]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-14T11:04:46.300 INFO:teuthology.orchestra.run.smithi138.stderr:14 Sep 11:04:46 ntpd[18465]: can't open /var/log/ntpstats/peerstats.20240914: Permission denied 2024-09-14T11:04:46.326 INFO:teuthology.orchestra.run.smithi154.stderr:14 Sep 11:04:46 ntpd[18511]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-14T11:04:46.326 INFO:teuthology.orchestra.run.smithi154.stderr:14 Sep 11:04:46 ntpd[18511]: can't open /var/log/ntpstats/rawstats.20240914: Permission denied 2024-09-14T11:04:46.326 INFO:teuthology.orchestra.run.smithi154.stderr:14 Sep 11:04:46 ntpd[18511]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-14T11:04:46.326 INFO:teuthology.orchestra.run.smithi154.stderr:14 Sep 11:04:46 ntpd[18511]: can't open /var/log/ntpstats/rawstats.20240914: Permission denied 2024-09-14T11:04:46.326 INFO:teuthology.orchestra.run.smithi154.stderr:14 Sep 11:04:46 ntpd[18511]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-14T11:04:46.326 INFO:teuthology.orchestra.run.smithi154.stderr:14 Sep 11:04:46 ntpd[18511]: can't open /var/log/ntpstats/peerstats.20240914: Permission denied 2024-09-14T11:04:47.300 INFO:teuthology.orchestra.run.smithi138.stderr:14 Sep 11:04:47 ntpd[18465]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-14T11:04:47.300 INFO:teuthology.orchestra.run.smithi138.stderr:14 Sep 11:04:47 ntpd[18465]: can't open /var/log/ntpstats/rawstats.20240914: Permission denied 2024-09-14T11:04:47.301 INFO:teuthology.orchestra.run.smithi138.stderr:14 Sep 11:04:47 ntpd[18465]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-14T11:04:47.301 INFO:teuthology.orchestra.run.smithi138.stderr:14 Sep 11:04:47 ntpd[18465]: can't open /var/log/ntpstats/rawstats.20240914: Permission denied 2024-09-14T11:04:47.301 INFO:teuthology.orchestra.run.smithi138.stderr:14 Sep 11:04:47 ntpd[18465]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-14T11:04:47.301 INFO:teuthology.orchestra.run.smithi138.stderr:14 Sep 11:04:47 ntpd[18465]: can't open /var/log/ntpstats/rawstats.20240914: Permission denied 2024-09-14T11:04:47.301 INFO:teuthology.orchestra.run.smithi138.stderr:14 Sep 11:04:47 ntpd[18465]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-14T11:04:47.302 INFO:teuthology.orchestra.run.smithi138.stderr:14 Sep 11:04:47 ntpd[18465]: can't open /var/log/ntpstats/peerstats.20240914: Permission denied 2024-09-14T11:04:47.302 INFO:teuthology.orchestra.run.smithi138.stderr:14 Sep 11:04:47 ntpd[18465]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-14T11:04:47.302 INFO:teuthology.orchestra.run.smithi138.stderr:14 Sep 11:04:47 ntpd[18465]: can't open /var/log/ntpstats/rawstats.20240914: Permission denied 2024-09-14T11:04:47.302 INFO:teuthology.orchestra.run.smithi138.stderr:14 Sep 11:04:47 ntpd[18465]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-14T11:04:47.302 INFO:teuthology.orchestra.run.smithi138.stderr:14 Sep 11:04:47 ntpd[18465]: can't open /var/log/ntpstats/peerstats.20240914: Permission denied 2024-09-14T11:04:48.299 INFO:teuthology.orchestra.run.smithi138.stderr:14 Sep 11:04:48 ntpd[18465]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-14T11:04:48.299 INFO:teuthology.orchestra.run.smithi138.stderr:14 Sep 11:04:48 ntpd[18465]: can't open /var/log/ntpstats/rawstats.20240914: Permission denied 2024-09-14T11:04:48.299 INFO:teuthology.orchestra.run.smithi138.stderr:14 Sep 11:04:48 ntpd[18465]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-14T11:04:48.299 INFO:teuthology.orchestra.run.smithi138.stderr:14 Sep 11:04:48 ntpd[18465]: can't open /var/log/ntpstats/rawstats.20240914: Permission denied 2024-09-14T11:04:48.299 INFO:teuthology.orchestra.run.smithi138.stderr:14 Sep 11:04:48 ntpd[18465]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-14T11:04:48.299 INFO:teuthology.orchestra.run.smithi138.stderr:14 Sep 11:04:48 ntpd[18465]: can't open /var/log/ntpstats/peerstats.20240914: Permission denied 2024-09-14T11:04:48.326 INFO:teuthology.orchestra.run.smithi154.stderr:14 Sep 11:04:48 ntpd[18511]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-14T11:04:48.326 INFO:teuthology.orchestra.run.smithi154.stderr:14 Sep 11:04:48 ntpd[18511]: can't open /var/log/ntpstats/rawstats.20240914: Permission denied 2024-09-14T11:04:48.326 INFO:teuthology.orchestra.run.smithi154.stderr:14 Sep 11:04:48 ntpd[18511]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-14T11:04:48.326 INFO:teuthology.orchestra.run.smithi154.stderr:14 Sep 11:04:48 ntpd[18511]: can't open /var/log/ntpstats/rawstats.20240914: Permission denied 2024-09-14T11:04:48.326 INFO:teuthology.orchestra.run.smithi154.stderr:14 Sep 11:04:48 ntpd[18511]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-14T11:04:48.326 INFO:teuthology.orchestra.run.smithi154.stderr:14 Sep 11:04:48 ntpd[18511]: can't open /var/log/ntpstats/peerstats.20240914: Permission denied 2024-09-14T11:04:49.299 INFO:teuthology.orchestra.run.smithi138.stderr:14 Sep 11:04:49 ntpd[18465]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-14T11:04:49.300 INFO:teuthology.orchestra.run.smithi138.stderr:14 Sep 11:04:49 ntpd[18465]: can't open /var/log/ntpstats/rawstats.20240914: Permission denied 2024-09-14T11:04:49.300 INFO:teuthology.orchestra.run.smithi138.stderr:14 Sep 11:04:49 ntpd[18465]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-14T11:04:49.300 INFO:teuthology.orchestra.run.smithi138.stderr:14 Sep 11:04:49 ntpd[18465]: can't open /var/log/ntpstats/rawstats.20240914: Permission denied 2024-09-14T11:04:49.300 INFO:teuthology.orchestra.run.smithi138.stderr:14 Sep 11:04:49 ntpd[18465]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-14T11:04:49.300 INFO:teuthology.orchestra.run.smithi138.stderr:14 Sep 11:04:49 ntpd[18465]: can't open /var/log/ntpstats/rawstats.20240914: Permission denied 2024-09-14T11:04:49.300 INFO:teuthology.orchestra.run.smithi138.stderr:14 Sep 11:04:49 ntpd[18465]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-14T11:04:49.300 INFO:teuthology.orchestra.run.smithi138.stderr:14 Sep 11:04:49 ntpd[18465]: can't open /var/log/ntpstats/peerstats.20240914: Permission denied 2024-09-14T11:04:49.300 INFO:teuthology.orchestra.run.smithi138.stderr:14 Sep 11:04:49 ntpd[18465]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-14T11:04:49.300 INFO:teuthology.orchestra.run.smithi138.stderr:14 Sep 11:04:49 ntpd[18465]: can't open /var/log/ntpstats/rawstats.20240914: Permission denied 2024-09-14T11:04:49.300 INFO:teuthology.orchestra.run.smithi138.stderr:14 Sep 11:04:49 ntpd[18465]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-14T11:04:49.300 INFO:teuthology.orchestra.run.smithi138.stderr:14 Sep 11:04:49 ntpd[18465]: can't open /var/log/ntpstats/peerstats.20240914: Permission denied 2024-09-14T11:04:49.326 INFO:teuthology.orchestra.run.smithi154.stderr:14 Sep 11:04:49 ntpd[18511]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-14T11:04:49.326 INFO:teuthology.orchestra.run.smithi154.stderr:14 Sep 11:04:49 ntpd[18511]: can't open /var/log/ntpstats/rawstats.20240914: Permission denied 2024-09-14T11:04:49.327 INFO:teuthology.orchestra.run.smithi154.stderr:14 Sep 11:04:49 ntpd[18511]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-14T11:04:49.327 INFO:teuthology.orchestra.run.smithi154.stderr:14 Sep 11:04:49 ntpd[18511]: can't open /var/log/ntpstats/rawstats.20240914: Permission denied 2024-09-14T11:04:49.327 INFO:teuthology.orchestra.run.smithi154.stderr:14 Sep 11:04:49 ntpd[18511]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-14T11:04:49.327 INFO:teuthology.orchestra.run.smithi154.stderr:14 Sep 11:04:49 ntpd[18511]: can't open /var/log/ntpstats/rawstats.20240914: Permission denied 2024-09-14T11:04:49.327 INFO:teuthology.orchestra.run.smithi154.stderr:14 Sep 11:04:49 ntpd[18511]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-14T11:04:49.327 INFO:teuthology.orchestra.run.smithi154.stderr:14 Sep 11:04:49 ntpd[18511]: can't open /var/log/ntpstats/peerstats.20240914: Permission denied 2024-09-14T11:04:49.327 INFO:teuthology.orchestra.run.smithi154.stderr:14 Sep 11:04:49 ntpd[18511]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-14T11:04:49.327 INFO:teuthology.orchestra.run.smithi154.stderr:14 Sep 11:04:49 ntpd[18511]: can't open /var/log/ntpstats/rawstats.20240914: Permission denied 2024-09-14T11:04:49.327 INFO:teuthology.orchestra.run.smithi154.stderr:14 Sep 11:04:49 ntpd[18511]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-14T11:04:49.327 INFO:teuthology.orchestra.run.smithi154.stderr:14 Sep 11:04:49 ntpd[18511]: can't open /var/log/ntpstats/peerstats.20240914: Permission denied 2024-09-14T11:04:50.301 INFO:teuthology.orchestra.run.smithi138.stderr:14 Sep 11:04:50 ntpd[18465]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-14T11:04:50.302 INFO:teuthology.orchestra.run.smithi138.stderr:14 Sep 11:04:50 ntpd[18465]: can't open /var/log/ntpstats/rawstats.20240914: Permission denied 2024-09-14T11:04:50.302 INFO:teuthology.orchestra.run.smithi138.stderr:14 Sep 11:04:50 ntpd[18465]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-14T11:04:50.302 INFO:teuthology.orchestra.run.smithi138.stderr:14 Sep 11:04:50 ntpd[18465]: can't open /var/log/ntpstats/rawstats.20240914: Permission denied 2024-09-14T11:04:50.302 INFO:teuthology.orchestra.run.smithi138.stderr:14 Sep 11:04:50 ntpd[18465]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-14T11:04:50.302 INFO:teuthology.orchestra.run.smithi138.stderr:14 Sep 11:04:50 ntpd[18465]: can't open /var/log/ntpstats/rawstats.20240914: Permission denied 2024-09-14T11:04:50.302 INFO:teuthology.orchestra.run.smithi138.stderr:14 Sep 11:04:50 ntpd[18465]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-14T11:04:50.302 INFO:teuthology.orchestra.run.smithi138.stderr:14 Sep 11:04:50 ntpd[18465]: can't open /var/log/ntpstats/peerstats.20240914: Permission denied 2024-09-14T11:04:50.326 INFO:teuthology.orchestra.run.smithi154.stderr:14 Sep 11:04:50 ntpd[18511]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-14T11:04:50.326 INFO:teuthology.orchestra.run.smithi154.stderr:14 Sep 11:04:50 ntpd[18511]: can't open /var/log/ntpstats/rawstats.20240914: Permission denied 2024-09-14T11:04:50.326 INFO:teuthology.orchestra.run.smithi154.stderr:14 Sep 11:04:50 ntpd[18511]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-14T11:04:50.327 INFO:teuthology.orchestra.run.smithi154.stderr:14 Sep 11:04:50 ntpd[18511]: can't open /var/log/ntpstats/rawstats.20240914: Permission denied 2024-09-14T11:04:50.327 INFO:teuthology.orchestra.run.smithi154.stderr:14 Sep 11:04:50 ntpd[18511]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-14T11:04:50.327 INFO:teuthology.orchestra.run.smithi154.stderr:14 Sep 11:04:50 ntpd[18511]: can't open /var/log/ntpstats/rawstats.20240914: Permission denied 2024-09-14T11:04:50.327 INFO:teuthology.orchestra.run.smithi154.stderr:14 Sep 11:04:50 ntpd[18511]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-14T11:04:50.327 INFO:teuthology.orchestra.run.smithi154.stderr:14 Sep 11:04:50 ntpd[18511]: can't open /var/log/ntpstats/peerstats.20240914: Permission denied 2024-09-14T11:04:51.300 INFO:teuthology.orchestra.run.smithi138.stderr:14 Sep 11:04:51 ntpd[18465]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-14T11:04:51.300 INFO:teuthology.orchestra.run.smithi138.stderr:14 Sep 11:04:51 ntpd[18465]: can't open /var/log/ntpstats/rawstats.20240914: Permission denied 2024-09-14T11:04:51.300 INFO:teuthology.orchestra.run.smithi138.stderr:14 Sep 11:04:51 ntpd[18465]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-14T11:04:51.301 INFO:teuthology.orchestra.run.smithi138.stderr:14 Sep 11:04:51 ntpd[18465]: can't open /var/log/ntpstats/rawstats.20240914: Permission denied 2024-09-14T11:04:51.301 INFO:teuthology.orchestra.run.smithi138.stderr:14 Sep 11:04:51 ntpd[18465]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-14T11:04:51.301 INFO:teuthology.orchestra.run.smithi138.stderr:14 Sep 11:04:51 ntpd[18465]: can't open /var/log/ntpstats/rawstats.20240914: Permission denied 2024-09-14T11:04:51.301 INFO:teuthology.orchestra.run.smithi138.stderr:14 Sep 11:04:51 ntpd[18465]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-14T11:04:51.301 INFO:teuthology.orchestra.run.smithi138.stderr:14 Sep 11:04:51 ntpd[18465]: can't open /var/log/ntpstats/peerstats.20240914: Permission denied 2024-09-14T11:04:51.301 INFO:teuthology.orchestra.run.smithi138.stderr:14 Sep 11:04:51 ntpd[18465]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-14T11:04:51.301 INFO:teuthology.orchestra.run.smithi138.stderr:14 Sep 11:04:51 ntpd[18465]: can't open /var/log/ntpstats/rawstats.20240914: Permission denied 2024-09-14T11:04:51.301 INFO:teuthology.orchestra.run.smithi138.stderr:14 Sep 11:04:51 ntpd[18465]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-14T11:04:51.302 INFO:teuthology.orchestra.run.smithi138.stderr:14 Sep 11:04:51 ntpd[18465]: can't open /var/log/ntpstats/peerstats.20240914: Permission denied 2024-09-14T11:04:51.327 INFO:teuthology.orchestra.run.smithi154.stderr:14 Sep 11:04:51 ntpd[18511]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-14T11:04:51.327 INFO:teuthology.orchestra.run.smithi154.stderr:14 Sep 11:04:51 ntpd[18511]: can't open /var/log/ntpstats/rawstats.20240914: Permission denied 2024-09-14T11:04:51.327 INFO:teuthology.orchestra.run.smithi154.stderr:14 Sep 11:04:51 ntpd[18511]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-14T11:04:51.327 INFO:teuthology.orchestra.run.smithi154.stderr:14 Sep 11:04:51 ntpd[18511]: can't open /var/log/ntpstats/rawstats.20240914: Permission denied 2024-09-14T11:04:51.327 INFO:teuthology.orchestra.run.smithi154.stderr:14 Sep 11:04:51 ntpd[18511]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-14T11:04:51.327 INFO:teuthology.orchestra.run.smithi154.stderr:14 Sep 11:04:51 ntpd[18511]: can't open /var/log/ntpstats/rawstats.20240914: Permission denied 2024-09-14T11:04:51.327 INFO:teuthology.orchestra.run.smithi154.stderr:14 Sep 11:04:51 ntpd[18511]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-14T11:04:51.327 INFO:teuthology.orchestra.run.smithi154.stderr:14 Sep 11:04:51 ntpd[18511]: can't open /var/log/ntpstats/peerstats.20240914: Permission denied 2024-09-14T11:04:51.327 INFO:teuthology.orchestra.run.smithi154.stderr:14 Sep 11:04:51 ntpd[18511]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-14T11:04:51.328 INFO:teuthology.orchestra.run.smithi154.stderr:14 Sep 11:04:51 ntpd[18511]: can't open /var/log/ntpstats/rawstats.20240914: Permission denied 2024-09-14T11:04:51.328 INFO:teuthology.orchestra.run.smithi154.stderr:14 Sep 11:04:51 ntpd[18511]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-14T11:04:51.328 INFO:teuthology.orchestra.run.smithi154.stderr:14 Sep 11:04:51 ntpd[18511]: can't open /var/log/ntpstats/peerstats.20240914: Permission denied 2024-09-14T11:04:52.299 INFO:teuthology.orchestra.run.smithi138.stderr:14 Sep 11:04:52 ntpd[18465]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-14T11:04:52.299 INFO:teuthology.orchestra.run.smithi138.stderr:14 Sep 11:04:52 ntpd[18465]: can't open /var/log/ntpstats/rawstats.20240914: Permission denied 2024-09-14T11:04:52.299 INFO:teuthology.orchestra.run.smithi138.stderr:14 Sep 11:04:52 ntpd[18465]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-14T11:04:52.299 INFO:teuthology.orchestra.run.smithi138.stderr:14 Sep 11:04:52 ntpd[18465]: can't open /var/log/ntpstats/rawstats.20240914: Permission denied 2024-09-14T11:04:52.299 INFO:teuthology.orchestra.run.smithi138.stderr:14 Sep 11:04:52 ntpd[18465]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-14T11:04:52.300 INFO:teuthology.orchestra.run.smithi138.stderr:14 Sep 11:04:52 ntpd[18465]: can't open /var/log/ntpstats/peerstats.20240914: Permission denied 2024-09-14T11:04:52.300 INFO:teuthology.orchestra.run.smithi138.stdout:14 Sep 11:04:52 ntpd[18465]: ntpd: time slew -0.001464 s 2024-09-14T11:04:52.300 INFO:teuthology.orchestra.run.smithi138.stdout:ntpd: time slew -0.001464s 2024-09-14T11:04:52.300 INFO:teuthology.orchestra.run.smithi138.stderr:14 Sep 11:04:52 ntpd[18465]: couldn't unlink /var/log/ntpstats/loopstats: Permission denied 2024-09-14T11:04:52.300 INFO:teuthology.orchestra.run.smithi138.stderr:14 Sep 11:04:52 ntpd[18465]: can't open /var/log/ntpstats/loopstats.20240914: Permission denied 2024-09-14T11:04:52.326 INFO:teuthology.orchestra.run.smithi154.stderr:14 Sep 11:04:52 ntpd[18511]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-14T11:04:52.326 INFO:teuthology.orchestra.run.smithi154.stderr:14 Sep 11:04:52 ntpd[18511]: can't open /var/log/ntpstats/rawstats.20240914: Permission denied 2024-09-14T11:04:52.326 INFO:teuthology.orchestra.run.smithi154.stderr:14 Sep 11:04:52 ntpd[18511]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-14T11:04:52.326 INFO:teuthology.orchestra.run.smithi154.stderr:14 Sep 11:04:52 ntpd[18511]: can't open /var/log/ntpstats/rawstats.20240914: Permission denied 2024-09-14T11:04:52.326 INFO:teuthology.orchestra.run.smithi154.stderr:14 Sep 11:04:52 ntpd[18511]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-14T11:04:52.326 INFO:teuthology.orchestra.run.smithi154.stderr:14 Sep 11:04:52 ntpd[18511]: can't open /var/log/ntpstats/peerstats.20240914: Permission denied 2024-09-14T11:04:52.326 INFO:teuthology.orchestra.run.smithi154.stdout:14 Sep 11:04:52 ntpd[18511]: ntpd: time slew +0.004034 s 2024-09-14T11:04:52.326 INFO:teuthology.orchestra.run.smithi154.stdout:ntpd: time slew +0.004034s 2024-09-14T11:04:52.327 INFO:teuthology.orchestra.run.smithi154.stderr:14 Sep 11:04:52 ntpd[18511]: couldn't unlink /var/log/ntpstats/loopstats: Permission denied 2024-09-14T11:04:52.327 INFO:teuthology.orchestra.run.smithi154.stderr:14 Sep 11:04:52 ntpd[18511]: can't open /var/log/ntpstats/loopstats.20240914: Permission denied 2024-09-14T11:04:52.361 INFO:teuthology.orchestra.run.smithi138.stdout: remote refid st t when poll reach delay offset jitter 2024-09-14T11:04:52.361 INFO:teuthology.orchestra.run.smithi138.stdout:============================================================================== 2024-09-14T11:04:52.361 INFO:teuthology.orchestra.run.smithi138.stdout: hv01.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-09-14T11:04:52.361 INFO:teuthology.orchestra.run.smithi138.stdout: hv02.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-09-14T11:04:52.362 INFO:teuthology.orchestra.run.smithi138.stdout: hv03.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-09-14T11:04:52.362 INFO:teuthology.orchestra.run.smithi138.stdout: hv04.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-09-14T11:04:52.372 INFO:teuthology.orchestra.run.smithi154.stdout: remote refid st t when poll reach delay offset jitter 2024-09-14T11:04:52.372 INFO:teuthology.orchestra.run.smithi154.stdout:============================================================================== 2024-09-14T11:04:52.372 INFO:teuthology.orchestra.run.smithi154.stdout: hv01.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-09-14T11:04:52.372 INFO:teuthology.orchestra.run.smithi154.stdout: hv02.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-09-14T11:04:52.373 INFO:teuthology.orchestra.run.smithi154.stdout: hv03.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-09-14T11:04:52.373 INFO:teuthology.orchestra.run.smithi154.stdout: hv04.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-09-14T11:04:52.374 INFO:teuthology.run_tasks:Running task install... 2024-09-14T11:04:52.383 DEBUG:teuthology.task.install:project ceph 2024-09-14T11:04:52.383 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'default', 'sha1': 'a2782315255a3e7d5f6cdc9eb35785187ff6ddf8'}} 2024-09-14T11:04:52.383 DEBUG:teuthology.task.install:config {'extra_system_packages': {'deb': ['s3cmd', 'maven'], 'rpm': ['s3cmd', 'maven']}, 'flavor': 'default', 'sha1': 'a2782315255a3e7d5f6cdc9eb35785187ff6ddf8'} 2024-09-14T11:04:52.383 INFO:teuthology.task.install:Using flavor: default 2024-09-14T11:04:52.388 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'ceph-volume', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'ceph-volume', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2024-09-14T11:04:52.389 INFO:teuthology.task.install:extra packages: [] 2024-09-14T11:04:52.389 DEBUG:teuthology.orchestra.run.smithi138:> sudo apt-key list | grep Ceph 2024-09-14T11:04:52.390 DEBUG:teuthology.orchestra.run.smithi154:> sudo apt-key list | grep Ceph 2024-09-14T11:04:52.464 INFO:teuthology.orchestra.run.smithi138.stderr:Warning: apt-key is deprecated. Manage keyring files in trusted.gpg.d instead (see apt-key(8)). 2024-09-14T11:04:52.480 INFO:teuthology.orchestra.run.smithi154.stderr:Warning: apt-key is deprecated. Manage keyring files in trusted.gpg.d instead (see apt-key(8)). 2024-09-14T11:04:52.493 INFO:teuthology.orchestra.run.smithi138.stdout:uid [ unknown] Ceph automated package build (Ceph automated package build) 2024-09-14T11:04:52.494 INFO:teuthology.orchestra.run.smithi138.stdout:uid [ unknown] Ceph.com (release key) 2024-09-14T11:04:52.494 INFO:teuthology.task.install.deb:Installing packages: ceph, cephadm, ceph-mds, ceph-mgr, ceph-common, ceph-fuse, ceph-test, ceph-volume, radosgw, python3-rados, python3-rgw, python3-cephfs, python3-rbd, libcephfs2, libcephfs-dev, librados2, librbd1, rbd-fuse on remote deb x86_64 2024-09-14T11:04:52.494 INFO:teuthology.task.install.deb:Installing system (non-project) packages: s3cmd, maven on remote deb x86_64 2024-09-14T11:04:52.494 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=a2782315255a3e7d5f6cdc9eb35785187ff6ddf8 2024-09-14T11:04:52.508 INFO:teuthology.orchestra.run.smithi154.stdout:uid [ unknown] Ceph automated package build (Ceph automated package build) 2024-09-14T11:04:52.508 INFO:teuthology.orchestra.run.smithi154.stdout:uid [ unknown] Ceph.com (release key) 2024-09-14T11:04:52.509 INFO:teuthology.task.install.deb:Installing packages: ceph, cephadm, ceph-mds, ceph-mgr, ceph-common, ceph-fuse, ceph-test, ceph-volume, radosgw, python3-rados, python3-rgw, python3-cephfs, python3-rbd, libcephfs2, libcephfs-dev, librados2, librbd1, rbd-fuse on remote deb x86_64 2024-09-14T11:04:52.509 INFO:teuthology.task.install.deb:Installing system (non-project) packages: s3cmd, maven on remote deb x86_64 2024-09-14T11:04:52.510 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=a2782315255a3e7d5f6cdc9eb35785187ff6ddf8 2024-09-14T11:04:52.640 INFO:teuthology.task.install.deb:Pulling from https://4.chacra.ceph.com/r/ceph/main/a2782315255a3e7d5f6cdc9eb35785187ff6ddf8/ubuntu/jammy/flavors/default/ 2024-09-14T11:04:52.640 INFO:teuthology.task.install.deb:Package version is 19.3.0-4907-ga2782315-1jammy 2024-09-14T11:04:52.651 INFO:teuthology.task.install.deb:Pulling from https://4.chacra.ceph.com/r/ceph/main/a2782315255a3e7d5f6cdc9eb35785187ff6ddf8/ubuntu/jammy/flavors/default/ 2024-09-14T11:04:52.651 INFO:teuthology.task.install.deb:Package version is 19.3.0-4907-ga2782315-1jammy 2024-09-14T11:04:52.749 DEBUG:teuthology.orchestra.run.smithi138:> set -ex 2024-09-14T11:04:52.749 DEBUG:teuthology.orchestra.run.smithi138:> sudo dd of=/etc/apt/sources.list.d/ceph.list 2024-09-14T11:04:52.757 DEBUG:teuthology.orchestra.run.smithi154:> set -ex 2024-09-14T11:04:52.757 DEBUG:teuthology.orchestra.run.smithi154:> sudo dd of=/etc/apt/sources.list.d/ceph.list 2024-09-14T11:04:52.763 DEBUG:teuthology.orchestra.run.smithi138:> sudo apt-get update 2024-09-14T11:04:52.773 DEBUG:teuthology.orchestra.run.smithi154:> sudo apt-get update 2024-09-14T11:04:52.933 INFO:teuthology.orchestra.run.smithi138.stdout:Hit:1 http://security.ubuntu.com/ubuntu jammy-security InRelease 2024-09-14T11:04:52.934 INFO:teuthology.orchestra.run.smithi138.stdout:Hit:2 http://archive.ubuntu.com/ubuntu jammy InRelease 2024-09-14T11:04:52.941 INFO:teuthology.orchestra.run.smithi154.stdout:Hit:1 http://archive.ubuntu.com/ubuntu jammy InRelease 2024-09-14T11:04:52.951 INFO:teuthology.orchestra.run.smithi138.stdout:Hit:3 http://archive.ubuntu.com/ubuntu jammy-updates InRelease 2024-09-14T11:04:52.952 INFO:teuthology.orchestra.run.smithi154.stdout:Hit:2 http://archive.ubuntu.com/ubuntu jammy-updates InRelease 2024-09-14T11:04:52.968 INFO:teuthology.orchestra.run.smithi138.stdout:Hit:4 http://archive.ubuntu.com/ubuntu jammy-backports InRelease 2024-09-14T11:04:52.969 INFO:teuthology.orchestra.run.smithi154.stdout:Hit:3 http://archive.ubuntu.com/ubuntu jammy-backports InRelease 2024-09-14T11:04:52.986 INFO:teuthology.orchestra.run.smithi138.stdout:Ign:5 https://4.chacra.ceph.com/r/ceph/main/a2782315255a3e7d5f6cdc9eb35785187ff6ddf8/ubuntu/jammy/flavors/default jammy InRelease 2024-09-14T11:04:52.996 INFO:teuthology.orchestra.run.smithi154.stdout:Ign:4 https://4.chacra.ceph.com/r/ceph/main/a2782315255a3e7d5f6cdc9eb35785187ff6ddf8/ubuntu/jammy/flavors/default jammy InRelease 2024-09-14T11:04:53.008 INFO:teuthology.orchestra.run.smithi138.stdout:Get:6 https://4.chacra.ceph.com/r/ceph/main/a2782315255a3e7d5f6cdc9eb35785187ff6ddf8/ubuntu/jammy/flavors/default jammy Release [7,689 B] 2024-09-14T11:04:53.020 INFO:teuthology.orchestra.run.smithi154.stdout:Get:5 https://4.chacra.ceph.com/r/ceph/main/a2782315255a3e7d5f6cdc9eb35785187ff6ddf8/ubuntu/jammy/flavors/default jammy Release [7,689 B] 2024-09-14T11:04:53.029 INFO:teuthology.orchestra.run.smithi138.stdout:Ign:7 https://4.chacra.ceph.com/r/ceph/main/a2782315255a3e7d5f6cdc9eb35785187ff6ddf8/ubuntu/jammy/flavors/default jammy Release.gpg 2024-09-14T11:04:53.042 INFO:teuthology.orchestra.run.smithi154.stdout:Ign:6 https://4.chacra.ceph.com/r/ceph/main/a2782315255a3e7d5f6cdc9eb35785187ff6ddf8/ubuntu/jammy/flavors/default jammy Release.gpg 2024-09-14T11:04:53.051 INFO:teuthology.orchestra.run.smithi138.stdout:Get:8 https://4.chacra.ceph.com/r/ceph/main/a2782315255a3e7d5f6cdc9eb35785187ff6ddf8/ubuntu/jammy/flavors/default jammy/main amd64 Packages [18.2 kB] 2024-09-14T11:04:53.063 INFO:teuthology.orchestra.run.smithi154.stdout:Get:7 https://4.chacra.ceph.com/r/ceph/main/a2782315255a3e7d5f6cdc9eb35785187ff6ddf8/ubuntu/jammy/flavors/default jammy/main i386 Packages [3,421 B] 2024-09-14T11:04:53.068 INFO:teuthology.orchestra.run.smithi154.stdout:Get:8 http://security.ubuntu.com/ubuntu jammy-security InRelease [129 kB] 2024-09-14T11:04:53.078 INFO:teuthology.orchestra.run.smithi138.stdout:Get:9 https://4.chacra.ceph.com/r/ceph/main/a2782315255a3e7d5f6cdc9eb35785187ff6ddf8/ubuntu/jammy/flavors/default jammy/main i386 Packages [3,421 B] 2024-09-14T11:04:53.090 INFO:teuthology.orchestra.run.smithi154.stdout:Get:9 https://4.chacra.ceph.com/r/ceph/main/a2782315255a3e7d5f6cdc9eb35785187ff6ddf8/ubuntu/jammy/flavors/default jammy/main amd64 Packages [18.2 kB] 2024-09-14T11:04:53.287 INFO:teuthology.orchestra.run.smithi138.stdout:Fetched 29.3 kB in 0s (84.6 kB/s) 2024-09-14T11:04:53.526 INFO:teuthology.orchestra.run.smithi154.stdout:Fetched 158 kB in 1s (281 kB/s) 2024-09-14T11:04:54.282 INFO:teuthology.orchestra.run.smithi138.stdout:Reading package lists... 2024-09-14T11:04:54.299 DEBUG:teuthology.orchestra.run.smithi138:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install ceph=19.3.0-4907-ga2782315-1jammy cephadm=19.3.0-4907-ga2782315-1jammy ceph-mds=19.3.0-4907-ga2782315-1jammy ceph-mgr=19.3.0-4907-ga2782315-1jammy ceph-common=19.3.0-4907-ga2782315-1jammy ceph-fuse=19.3.0-4907-ga2782315-1jammy ceph-test=19.3.0-4907-ga2782315-1jammy ceph-volume=19.3.0-4907-ga2782315-1jammy radosgw=19.3.0-4907-ga2782315-1jammy python3-rados=19.3.0-4907-ga2782315-1jammy python3-rgw=19.3.0-4907-ga2782315-1jammy python3-cephfs=19.3.0-4907-ga2782315-1jammy python3-rbd=19.3.0-4907-ga2782315-1jammy libcephfs2=19.3.0-4907-ga2782315-1jammy libcephfs-dev=19.3.0-4907-ga2782315-1jammy librados2=19.3.0-4907-ga2782315-1jammy librbd1=19.3.0-4907-ga2782315-1jammy rbd-fuse=19.3.0-4907-ga2782315-1jammy 2024-09-14T11:04:54.354 INFO:teuthology.orchestra.run.smithi138.stdout:Reading package lists... 2024-09-14T11:04:54.539 INFO:teuthology.orchestra.run.smithi138.stdout:Building dependency tree... 2024-09-14T11:04:54.540 INFO:teuthology.orchestra.run.smithi138.stdout:Reading state information... 2024-09-14T11:04:54.586 INFO:teuthology.orchestra.run.smithi154.stdout:Reading package lists... 2024-09-14T11:04:54.603 DEBUG:teuthology.orchestra.run.smithi154:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install ceph=19.3.0-4907-ga2782315-1jammy cephadm=19.3.0-4907-ga2782315-1jammy ceph-mds=19.3.0-4907-ga2782315-1jammy ceph-mgr=19.3.0-4907-ga2782315-1jammy ceph-common=19.3.0-4907-ga2782315-1jammy ceph-fuse=19.3.0-4907-ga2782315-1jammy ceph-test=19.3.0-4907-ga2782315-1jammy ceph-volume=19.3.0-4907-ga2782315-1jammy radosgw=19.3.0-4907-ga2782315-1jammy python3-rados=19.3.0-4907-ga2782315-1jammy python3-rgw=19.3.0-4907-ga2782315-1jammy python3-cephfs=19.3.0-4907-ga2782315-1jammy python3-rbd=19.3.0-4907-ga2782315-1jammy libcephfs2=19.3.0-4907-ga2782315-1jammy libcephfs-dev=19.3.0-4907-ga2782315-1jammy librados2=19.3.0-4907-ga2782315-1jammy librbd1=19.3.0-4907-ga2782315-1jammy rbd-fuse=19.3.0-4907-ga2782315-1jammy 2024-09-14T11:04:54.666 INFO:teuthology.orchestra.run.smithi154.stdout:Reading package lists... 2024-09-14T11:04:54.723 INFO:teuthology.orchestra.run.smithi138.stdout:The following packages were automatically installed and are no longer required: 2024-09-14T11:04:54.723 INFO:teuthology.orchestra.run.smithi138.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-09-14T11:04:54.723 INFO:teuthology.orchestra.run.smithi138.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-09-14T11:04:54.724 INFO:teuthology.orchestra.run.smithi138.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-09-14T11:04:54.724 INFO:teuthology.orchestra.run.smithi138.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2024-09-14T11:04:54.724 INFO:teuthology.orchestra.run.smithi138.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2024-09-14T11:04:54.724 INFO:teuthology.orchestra.run.smithi138.stdout:Use 'sudo apt autoremove' to remove them. 2024-09-14T11:04:54.725 INFO:teuthology.orchestra.run.smithi138.stdout:The following additional packages will be installed: 2024-09-14T11:04:54.725 INFO:teuthology.orchestra.run.smithi138.stdout: ceph-base ceph-mgr-cephadm ceph-mgr-dashboard ceph-mgr-diskprediction-local 2024-09-14T11:04:54.725 INFO:teuthology.orchestra.run.smithi138.stdout: ceph-mgr-k8sevents ceph-mgr-modules-core ceph-mon ceph-osd jq 2024-09-14T11:04:54.725 INFO:teuthology.orchestra.run.smithi138.stdout: libdouble-conversion3 libjq1 liblttng-ust1 liblua5.3-dev libnbd0 liboath0 2024-09-14T11:04:54.725 INFO:teuthology.orchestra.run.smithi138.stdout: libonig5 libpcre2-16-0 libqt5core5a libqt5dbus5 libqt5network5 2024-09-14T11:04:54.726 INFO:teuthology.orchestra.run.smithi138.stdout: libradosstriper1 librdkafka1 libreadline-dev librgw2 libsqlite3-mod-ceph 2024-09-14T11:04:54.726 INFO:teuthology.orchestra.run.smithi138.stdout: libthrift-0.16.0 lua-any lua-sec lua-socket lua5.1 luarocks nvme-cli 2024-09-14T11:04:54.726 INFO:teuthology.orchestra.run.smithi138.stdout: pkg-config python-asyncssh-doc python-babel-localedata 2024-09-14T11:04:54.726 INFO:teuthology.orchestra.run.smithi138.stdout: python-pastedeploy-tpl python3-asyncssh python3-babel python3-bcrypt 2024-09-14T11:04:54.727 INFO:teuthology.orchestra.run.smithi138.stdout: python3-cachetools python3-ceph-argparse python3-ceph-common python3-certifi 2024-09-14T11:04:54.727 INFO:teuthology.orchestra.run.smithi138.stdout: python3-cheroot python3-cherrypy3 python3-google-auth python3-idna 2024-09-14T11:04:54.727 INFO:teuthology.orchestra.run.smithi138.stdout: python3-iniconfig python3-jaraco.classes python3-jaraco.collections 2024-09-14T11:04:54.727 INFO:teuthology.orchestra.run.smithi138.stdout: python3-jaraco.functools python3-jaraco.text python3-jinja2 python3-joblib 2024-09-14T11:04:54.727 INFO:teuthology.orchestra.run.smithi138.stdout: python3-kubernetes python3-logutils python3-mako python3-markupsafe 2024-09-14T11:04:54.727 INFO:teuthology.orchestra.run.smithi138.stdout: python3-natsort python3-openssl python3-paste python3-pastedeploy 2024-09-14T11:04:54.727 INFO:teuthology.orchestra.run.smithi138.stdout: python3-pastescript python3-pecan python3-pluggy python3-portend 2024-09-14T11:04:54.727 INFO:teuthology.orchestra.run.smithi138.stdout: python3-prettytable python3-psutil python3-py python3-pyasn1 2024-09-14T11:04:54.727 INFO:teuthology.orchestra.run.smithi138.stdout: python3-pyasn1-modules python3-pygments python3-pyinotify python3-pytest 2024-09-14T11:04:54.727 INFO:teuthology.orchestra.run.smithi138.stdout: python3-repoze.lru python3-requests python3-requests-oauthlib python3-routes 2024-09-14T11:04:54.727 INFO:teuthology.orchestra.run.smithi138.stdout: python3-rsa python3-simplegeneric python3-simplejson python3-singledispatch 2024-09-14T11:04:54.727 INFO:teuthology.orchestra.run.smithi138.stdout: python3-sklearn python3-sklearn-lib python3-tempita python3-tempora 2024-09-14T11:04:54.727 INFO:teuthology.orchestra.run.smithi138.stdout: python3-threadpoolctl python3-toml python3-urllib3 python3-waitress 2024-09-14T11:04:54.727 INFO:teuthology.orchestra.run.smithi138.stdout: python3-wcwidth python3-webob python3-websocket python3-webtest 2024-09-14T11:04:54.728 INFO:teuthology.orchestra.run.smithi138.stdout: python3-werkzeug python3-zc.lockfile qttranslations5-l10n socat unzip 2024-09-14T11:04:54.728 INFO:teuthology.orchestra.run.smithi138.stdout: xmlstarlet zip 2024-09-14T11:04:54.728 INFO:teuthology.orchestra.run.smithi138.stdout:Suggested packages: 2024-09-14T11:04:54.728 INFO:teuthology.orchestra.run.smithi138.stdout: python3-influxdb readline-doc python-jinja2-doc python3-beaker 2024-09-14T11:04:54.728 INFO:teuthology.orchestra.run.smithi138.stdout: python-mako-doc python-natsort-doc python-openssl-doc python3-openssl-dbg 2024-09-14T11:04:54.728 INFO:teuthology.orchestra.run.smithi138.stdout: httpd-wsgi libapache2-mod-python libapache2-mod-scgi libjs-mochikit 2024-09-14T11:04:54.728 INFO:teuthology.orchestra.run.smithi138.stdout: python-pecan-doc python-psutil-doc subversion python-pygments-doc 2024-09-14T11:04:54.728 INFO:teuthology.orchestra.run.smithi138.stdout: python-pyinotify-doc python3-socks python-requests-doc python3-dap 2024-09-14T11:04:54.728 INFO:teuthology.orchestra.run.smithi138.stdout: python-sklearn-doc ipython3 python-waitress-doc python-webob-doc 2024-09-14T11:04:54.729 INFO:teuthology.orchestra.run.smithi138.stdout: python-webtest-doc python-werkzeug-doc python3-watchdog 2024-09-14T11:04:54.729 INFO:teuthology.orchestra.run.smithi138.stdout:Recommended packages: 2024-09-14T11:04:54.729 INFO:teuthology.orchestra.run.smithi138.stdout: btrfs-tools 2024-09-14T11:04:54.830 INFO:teuthology.orchestra.run.smithi138.stdout:The following NEW packages will be installed: 2024-09-14T11:04:54.830 INFO:teuthology.orchestra.run.smithi138.stdout: ceph ceph-base ceph-common ceph-fuse ceph-mds ceph-mgr ceph-mgr-cephadm 2024-09-14T11:04:54.830 INFO:teuthology.orchestra.run.smithi138.stdout: ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-k8sevents 2024-09-14T11:04:54.830 INFO:teuthology.orchestra.run.smithi138.stdout: ceph-mgr-modules-core ceph-mon ceph-osd ceph-test ceph-volume cephadm jq 2024-09-14T11:04:54.830 INFO:teuthology.orchestra.run.smithi138.stdout: libcephfs-dev libcephfs2 libdouble-conversion3 libjq1 liblttng-ust1 2024-09-14T11:04:54.830 INFO:teuthology.orchestra.run.smithi138.stdout: liblua5.3-dev libnbd0 liboath0 libonig5 libpcre2-16-0 libqt5core5a 2024-09-14T11:04:54.830 INFO:teuthology.orchestra.run.smithi138.stdout: libqt5dbus5 libqt5network5 librados2 libradosstriper1 librbd1 librdkafka1 2024-09-14T11:04:54.831 INFO:teuthology.orchestra.run.smithi138.stdout: libreadline-dev librgw2 libsqlite3-mod-ceph libthrift-0.16.0 lua-any lua-sec 2024-09-14T11:04:54.832 INFO:teuthology.orchestra.run.smithi138.stdout: lua-socket lua5.1 luarocks nvme-cli pkg-config python-asyncssh-doc 2024-09-14T11:04:54.832 INFO:teuthology.orchestra.run.smithi138.stdout: python-babel-localedata python-pastedeploy-tpl python3-asyncssh 2024-09-14T11:04:54.832 INFO:teuthology.orchestra.run.smithi138.stdout: python3-babel python3-bcrypt python3-cachetools python3-ceph-argparse 2024-09-14T11:04:54.832 INFO:teuthology.orchestra.run.smithi138.stdout: python3-ceph-common python3-cephfs python3-certifi python3-cheroot 2024-09-14T11:04:54.832 INFO:teuthology.orchestra.run.smithi138.stdout: python3-cherrypy3 python3-google-auth python3-idna python3-iniconfig 2024-09-14T11:04:54.832 INFO:teuthology.orchestra.run.smithi138.stdout: python3-jaraco.classes python3-jaraco.collections python3-jaraco.functools 2024-09-14T11:04:54.832 INFO:teuthology.orchestra.run.smithi138.stdout: python3-jaraco.text python3-jinja2 python3-joblib python3-kubernetes 2024-09-14T11:04:54.832 INFO:teuthology.orchestra.run.smithi138.stdout: python3-logutils python3-mako python3-markupsafe python3-natsort 2024-09-14T11:04:54.832 INFO:teuthology.orchestra.run.smithi138.stdout: python3-openssl python3-paste python3-pastedeploy python3-pastescript 2024-09-14T11:04:54.832 INFO:teuthology.orchestra.run.smithi138.stdout: python3-pecan python3-pluggy python3-portend python3-prettytable 2024-09-14T11:04:54.832 INFO:teuthology.orchestra.run.smithi138.stdout: python3-psutil python3-py python3-pyasn1 python3-pyasn1-modules 2024-09-14T11:04:54.832 INFO:teuthology.orchestra.run.smithi138.stdout: python3-pygments python3-pyinotify python3-pytest python3-rados python3-rbd 2024-09-14T11:04:54.833 INFO:teuthology.orchestra.run.smithi138.stdout: python3-repoze.lru python3-requests python3-requests-oauthlib python3-rgw 2024-09-14T11:04:54.833 INFO:teuthology.orchestra.run.smithi138.stdout: python3-routes python3-rsa python3-simplegeneric python3-simplejson 2024-09-14T11:04:54.833 INFO:teuthology.orchestra.run.smithi138.stdout: python3-singledispatch python3-sklearn python3-sklearn-lib python3-tempita 2024-09-14T11:04:54.833 INFO:teuthology.orchestra.run.smithi138.stdout: python3-tempora python3-threadpoolctl python3-toml python3-urllib3 2024-09-14T11:04:54.833 INFO:teuthology.orchestra.run.smithi138.stdout: python3-waitress python3-wcwidth python3-webob python3-websocket 2024-09-14T11:04:54.833 INFO:teuthology.orchestra.run.smithi138.stdout: python3-webtest python3-werkzeug python3-zc.lockfile qttranslations5-l10n 2024-09-14T11:04:54.833 INFO:teuthology.orchestra.run.smithi138.stdout: radosgw rbd-fuse socat unzip xmlstarlet zip 2024-09-14T11:04:54.875 INFO:teuthology.orchestra.run.smithi154.stdout:Building dependency tree... 2024-09-14T11:04:54.875 INFO:teuthology.orchestra.run.smithi154.stdout:Reading state information... 2024-09-14T11:04:54.973 INFO:teuthology.orchestra.run.smithi138.stdout:0 upgraded, 119 newly installed, 0 to remove and 331 not upgraded. 2024-09-14T11:04:54.974 INFO:teuthology.orchestra.run.smithi138.stdout:Need to get 251 MB of archives. 2024-09-14T11:04:54.974 INFO:teuthology.orchestra.run.smithi138.stdout:After this operation, 934 MB of additional disk space will be used. 2024-09-14T11:04:54.974 INFO:teuthology.orchestra.run.smithi138.stdout:Get:1 https://4.chacra.ceph.com/r/ceph/main/a2782315255a3e7d5f6cdc9eb35785187ff6ddf8/ubuntu/jammy/flavors/default jammy/main amd64 librados2 amd64 19.3.0-4907-ga2782315-1jammy [3,634 kB] 2024-09-14T11:04:55.020 INFO:teuthology.orchestra.run.smithi138.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblttng-ust1 amd64 2.13.1-1ubuntu1 [190 kB] 2024-09-14T11:04:55.083 INFO:teuthology.orchestra.run.smithi154.stdout:The following packages were automatically installed and are no longer required: 2024-09-14T11:04:55.083 INFO:teuthology.orchestra.run.smithi154.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-09-14T11:04:55.084 INFO:teuthology.orchestra.run.smithi154.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-09-14T11:04:55.084 INFO:teuthology.orchestra.run.smithi154.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-09-14T11:04:55.084 INFO:teuthology.orchestra.run.smithi154.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2024-09-14T11:04:55.084 INFO:teuthology.orchestra.run.smithi154.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2024-09-14T11:04:55.084 INFO:teuthology.orchestra.run.smithi154.stdout:Use 'sudo apt autoremove' to remove them. 2024-09-14T11:04:55.085 INFO:teuthology.orchestra.run.smithi154.stdout:The following additional packages will be installed: 2024-09-14T11:04:55.085 INFO:teuthology.orchestra.run.smithi154.stdout: ceph-base ceph-mgr-cephadm ceph-mgr-dashboard ceph-mgr-diskprediction-local 2024-09-14T11:04:55.086 INFO:teuthology.orchestra.run.smithi154.stdout: ceph-mgr-k8sevents ceph-mgr-modules-core ceph-mon ceph-osd jq 2024-09-14T11:04:55.086 INFO:teuthology.orchestra.run.smithi154.stdout: libdouble-conversion3 libjq1 liblttng-ust1 liblua5.3-dev libnbd0 liboath0 2024-09-14T11:04:55.086 INFO:teuthology.orchestra.run.smithi154.stdout: libonig5 libpcre2-16-0 libqt5core5a libqt5dbus5 libqt5network5 2024-09-14T11:04:55.086 INFO:teuthology.orchestra.run.smithi154.stdout: libradosstriper1 librdkafka1 libreadline-dev librgw2 libsqlite3-mod-ceph 2024-09-14T11:04:55.087 INFO:teuthology.orchestra.run.smithi154.stdout: libthrift-0.16.0 lua-any lua-sec lua-socket lua5.1 luarocks nvme-cli 2024-09-14T11:04:55.087 INFO:teuthology.orchestra.run.smithi154.stdout: pkg-config python-asyncssh-doc python-babel-localedata 2024-09-14T11:04:55.087 INFO:teuthology.orchestra.run.smithi154.stdout: python-pastedeploy-tpl python3-asyncssh python3-babel python3-bcrypt 2024-09-14T11:04:55.087 INFO:teuthology.orchestra.run.smithi154.stdout: python3-cachetools python3-ceph-argparse python3-ceph-common python3-certifi 2024-09-14T11:04:55.087 INFO:teuthology.orchestra.run.smithi154.stdout: python3-cheroot python3-cherrypy3 python3-google-auth python3-idna 2024-09-14T11:04:55.087 INFO:teuthology.orchestra.run.smithi154.stdout: python3-iniconfig python3-jaraco.classes python3-jaraco.collections 2024-09-14T11:04:55.087 INFO:teuthology.orchestra.run.smithi154.stdout: python3-jaraco.functools python3-jaraco.text python3-jinja2 python3-joblib 2024-09-14T11:04:55.087 INFO:teuthology.orchestra.run.smithi154.stdout: python3-kubernetes python3-logutils python3-mako python3-markupsafe 2024-09-14T11:04:55.087 INFO:teuthology.orchestra.run.smithi154.stdout: python3-natsort python3-openssl python3-paste python3-pastedeploy 2024-09-14T11:04:55.087 INFO:teuthology.orchestra.run.smithi154.stdout: python3-pastescript python3-pecan python3-pluggy python3-portend 2024-09-14T11:04:55.088 INFO:teuthology.orchestra.run.smithi154.stdout: python3-prettytable python3-psutil python3-py python3-pyasn1 2024-09-14T11:04:55.088 INFO:teuthology.orchestra.run.smithi154.stdout: python3-pyasn1-modules python3-pygments python3-pyinotify python3-pytest 2024-09-14T11:04:55.088 INFO:teuthology.orchestra.run.smithi154.stdout: python3-repoze.lru python3-requests python3-requests-oauthlib python3-routes 2024-09-14T11:04:55.088 INFO:teuthology.orchestra.run.smithi154.stdout: python3-rsa python3-simplegeneric python3-simplejson python3-singledispatch 2024-09-14T11:04:55.088 INFO:teuthology.orchestra.run.smithi154.stdout: python3-sklearn python3-sklearn-lib python3-tempita python3-tempora 2024-09-14T11:04:55.088 INFO:teuthology.orchestra.run.smithi154.stdout: python3-threadpoolctl python3-toml python3-urllib3 python3-waitress 2024-09-14T11:04:55.088 INFO:teuthology.orchestra.run.smithi154.stdout: python3-wcwidth python3-webob python3-websocket python3-webtest 2024-09-14T11:04:55.088 INFO:teuthology.orchestra.run.smithi154.stdout: python3-werkzeug python3-zc.lockfile qttranslations5-l10n socat unzip 2024-09-14T11:04:55.088 INFO:teuthology.orchestra.run.smithi154.stdout: xmlstarlet zip 2024-09-14T11:04:55.088 INFO:teuthology.orchestra.run.smithi154.stdout:Suggested packages: 2024-09-14T11:04:55.089 INFO:teuthology.orchestra.run.smithi154.stdout: python3-influxdb readline-doc python-jinja2-doc python3-beaker 2024-09-14T11:04:55.089 INFO:teuthology.orchestra.run.smithi154.stdout: python-mako-doc python-natsort-doc python-openssl-doc python3-openssl-dbg 2024-09-14T11:04:55.089 INFO:teuthology.orchestra.run.smithi154.stdout: httpd-wsgi libapache2-mod-python libapache2-mod-scgi libjs-mochikit 2024-09-14T11:04:55.089 INFO:teuthology.orchestra.run.smithi154.stdout: python-pecan-doc python-psutil-doc subversion python-pygments-doc 2024-09-14T11:04:55.089 INFO:teuthology.orchestra.run.smithi154.stdout: python-pyinotify-doc python3-socks python-requests-doc python3-dap 2024-09-14T11:04:55.089 INFO:teuthology.orchestra.run.smithi154.stdout: python-sklearn-doc ipython3 python-waitress-doc python-webob-doc 2024-09-14T11:04:55.089 INFO:teuthology.orchestra.run.smithi154.stdout: python-webtest-doc python-werkzeug-doc python3-watchdog 2024-09-14T11:04:55.089 INFO:teuthology.orchestra.run.smithi154.stdout:Recommended packages: 2024-09-14T11:04:55.089 INFO:teuthology.orchestra.run.smithi154.stdout: btrfs-tools 2024-09-14T11:04:55.176 INFO:teuthology.orchestra.run.smithi138.stdout:Get:3 https://4.chacra.ceph.com/r/ceph/main/a2782315255a3e7d5f6cdc9eb35785187ff6ddf8/ubuntu/jammy/flavors/default jammy/main amd64 librbd1 amd64 19.3.0-4907-ga2782315-1jammy [3,334 kB] 2024-09-14T11:04:55.191 INFO:teuthology.orchestra.run.smithi154.stdout:The following NEW packages will be installed: 2024-09-14T11:04:55.191 INFO:teuthology.orchestra.run.smithi154.stdout: ceph ceph-base ceph-common ceph-fuse ceph-mds ceph-mgr ceph-mgr-cephadm 2024-09-14T11:04:55.191 INFO:teuthology.orchestra.run.smithi154.stdout: ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-k8sevents 2024-09-14T11:04:55.191 INFO:teuthology.orchestra.run.smithi154.stdout: ceph-mgr-modules-core ceph-mon ceph-osd ceph-test ceph-volume cephadm jq 2024-09-14T11:04:55.193 INFO:teuthology.orchestra.run.smithi154.stdout: libcephfs-dev libcephfs2 libdouble-conversion3 libjq1 liblttng-ust1 2024-09-14T11:04:55.194 INFO:teuthology.orchestra.run.smithi154.stdout: liblua5.3-dev libnbd0 liboath0 libonig5 libpcre2-16-0 libqt5core5a 2024-09-14T11:04:55.194 INFO:teuthology.orchestra.run.smithi154.stdout: libqt5dbus5 libqt5network5 librados2 libradosstriper1 librbd1 librdkafka1 2024-09-14T11:04:55.194 INFO:teuthology.orchestra.run.smithi154.stdout: libreadline-dev librgw2 libsqlite3-mod-ceph libthrift-0.16.0 lua-any lua-sec 2024-09-14T11:04:55.194 INFO:teuthology.orchestra.run.smithi154.stdout: lua-socket lua5.1 luarocks nvme-cli pkg-config python-asyncssh-doc 2024-09-14T11:04:55.194 INFO:teuthology.orchestra.run.smithi154.stdout: python-babel-localedata python-pastedeploy-tpl python3-asyncssh 2024-09-14T11:04:55.194 INFO:teuthology.orchestra.run.smithi154.stdout: python3-babel python3-bcrypt python3-cachetools python3-ceph-argparse 2024-09-14T11:04:55.194 INFO:teuthology.orchestra.run.smithi154.stdout: python3-ceph-common python3-cephfs python3-certifi python3-cheroot 2024-09-14T11:04:55.194 INFO:teuthology.orchestra.run.smithi154.stdout: python3-cherrypy3 python3-google-auth python3-idna python3-iniconfig 2024-09-14T11:04:55.194 INFO:teuthology.orchestra.run.smithi154.stdout: python3-jaraco.classes python3-jaraco.collections python3-jaraco.functools 2024-09-14T11:04:55.194 INFO:teuthology.orchestra.run.smithi154.stdout: python3-jaraco.text python3-jinja2 python3-joblib python3-kubernetes 2024-09-14T11:04:55.194 INFO:teuthology.orchestra.run.smithi154.stdout: python3-logutils python3-mako python3-markupsafe python3-natsort 2024-09-14T11:04:55.194 INFO:teuthology.orchestra.run.smithi154.stdout: python3-openssl python3-paste python3-pastedeploy python3-pastescript 2024-09-14T11:04:55.194 INFO:teuthology.orchestra.run.smithi154.stdout: python3-pecan python3-pluggy python3-portend python3-prettytable 2024-09-14T11:04:55.194 INFO:teuthology.orchestra.run.smithi154.stdout: python3-psutil python3-py python3-pyasn1 python3-pyasn1-modules 2024-09-14T11:04:55.195 INFO:teuthology.orchestra.run.smithi154.stdout: python3-pygments python3-pyinotify python3-pytest python3-rados python3-rbd 2024-09-14T11:04:55.195 INFO:teuthology.orchestra.run.smithi154.stdout: python3-repoze.lru python3-requests python3-requests-oauthlib python3-rgw 2024-09-14T11:04:55.195 INFO:teuthology.orchestra.run.smithi154.stdout: python3-routes python3-rsa python3-simplegeneric python3-simplejson 2024-09-14T11:04:55.195 INFO:teuthology.orchestra.run.smithi154.stdout: python3-singledispatch python3-sklearn python3-sklearn-lib python3-tempita 2024-09-14T11:04:55.195 INFO:teuthology.orchestra.run.smithi154.stdout: python3-tempora python3-threadpoolctl python3-toml python3-urllib3 2024-09-14T11:04:55.195 INFO:teuthology.orchestra.run.smithi154.stdout: python3-waitress python3-wcwidth python3-webob python3-websocket 2024-09-14T11:04:55.195 INFO:teuthology.orchestra.run.smithi154.stdout: python3-webtest python3-werkzeug python3-zc.lockfile qttranslations5-l10n 2024-09-14T11:04:55.195 INFO:teuthology.orchestra.run.smithi154.stdout: radosgw rbd-fuse socat unzip xmlstarlet zip 2024-09-14T11:04:55.254 INFO:teuthology.orchestra.run.smithi138.stdout:Get:4 https://4.chacra.ceph.com/r/ceph/main/a2782315255a3e7d5f6cdc9eb35785187ff6ddf8/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs2 amd64 19.3.0-4907-ga2782315-1jammy [721 kB] 2024-09-14T11:04:55.254 INFO:teuthology.orchestra.run.smithi154.stdout:0 upgraded, 119 newly installed, 0 to remove and 331 not upgraded. 2024-09-14T11:04:55.254 INFO:teuthology.orchestra.run.smithi154.stdout:Need to get 251 MB of archives. 2024-09-14T11:04:55.254 INFO:teuthology.orchestra.run.smithi154.stdout:After this operation, 934 MB of additional disk space will be used. 2024-09-14T11:04:55.254 INFO:teuthology.orchestra.run.smithi154.stdout:Get:1 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblttng-ust1 amd64 2.13.1-1ubuntu1 [190 kB] 2024-09-14T11:04:55.268 INFO:teuthology.orchestra.run.smithi138.stdout:Get:5 https://4.chacra.ceph.com/r/ceph/main/a2782315255a3e7d5f6cdc9eb35785187ff6ddf8/ubuntu/jammy/flavors/default jammy/main amd64 python3-rados amd64 19.3.0-4907-ga2782315-1jammy [357 kB] 2024-09-14T11:04:55.274 INFO:teuthology.orchestra.run.smithi138.stdout:Get:6 https://4.chacra.ceph.com/r/ceph/main/a2782315255a3e7d5f6cdc9eb35785187ff6ddf8/ubuntu/jammy/flavors/default jammy/main amd64 python3-ceph-argparse all 19.3.0-4907-ga2782315-1jammy [32.8 kB] 2024-09-14T11:04:55.275 INFO:teuthology.orchestra.run.smithi138.stdout:Get:7 https://4.chacra.ceph.com/r/ceph/main/a2782315255a3e7d5f6cdc9eb35785187ff6ddf8/ubuntu/jammy/flavors/default jammy/main amd64 python3-cephfs amd64 19.3.0-4907-ga2782315-1jammy [180 kB] 2024-09-14T11:04:55.281 INFO:teuthology.orchestra.run.smithi138.stdout:Get:8 https://4.chacra.ceph.com/r/ceph/main/a2782315255a3e7d5f6cdc9eb35785187ff6ddf8/ubuntu/jammy/flavors/default jammy/main amd64 python3-ceph-common all 19.3.0-4907-ga2782315-1jammy [71.3 kB] 2024-09-14T11:04:55.283 INFO:teuthology.orchestra.run.smithi138.stdout:Get:9 https://4.chacra.ceph.com/r/ceph/main/a2782315255a3e7d5f6cdc9eb35785187ff6ddf8/ubuntu/jammy/flavors/default jammy/main amd64 python3-rbd amd64 19.3.0-4907-ga2782315-1jammy [338 kB] 2024-09-14T11:04:55.288 INFO:teuthology.orchestra.run.smithi138.stdout:Get:10 https://4.chacra.ceph.com/r/ceph/main/a2782315255a3e7d5f6cdc9eb35785187ff6ddf8/ubuntu/jammy/flavors/default jammy/main amd64 librgw2 amd64 19.3.0-4907-ga2782315-1jammy [7,989 kB] 2024-09-14T11:04:55.338 INFO:teuthology.orchestra.run.smithi154.stdout:Get:2 https://4.chacra.ceph.com/r/ceph/main/a2782315255a3e7d5f6cdc9eb35785187ff6ddf8/ubuntu/jammy/flavors/default jammy/main amd64 librados2 amd64 19.3.0-4907-ga2782315-1jammy [3,634 kB] 2024-09-14T11:04:55.343 INFO:teuthology.orchestra.run.smithi154.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libdouble-conversion3 amd64 3.1.7-4 [39.0 kB] 2024-09-14T11:04:55.345 INFO:teuthology.orchestra.run.smithi154.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libpcre2-16-0 amd64 10.39-3ubuntu0.1 [203 kB] 2024-09-14T11:04:55.363 INFO:teuthology.orchestra.run.smithi154.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5core5a amd64 5.15.3+dfsg-2ubuntu0.2 [2,006 kB] 2024-09-14T11:04:55.421 INFO:teuthology.orchestra.run.smithi154.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5dbus5 amd64 5.15.3+dfsg-2ubuntu0.2 [222 kB] 2024-09-14T11:04:55.426 INFO:teuthology.orchestra.run.smithi138.stdout:Get:11 https://4.chacra.ceph.com/r/ceph/main/a2782315255a3e7d5f6cdc9eb35785187ff6ddf8/ubuntu/jammy/flavors/default jammy/main amd64 python3-rgw amd64 19.3.0-4907-ga2782315-1jammy [112 kB] 2024-09-14T11:04:55.426 INFO:teuthology.orchestra.run.smithi154.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5network5 amd64 5.15.3+dfsg-2ubuntu0.2 [731 kB] 2024-09-14T11:04:55.433 INFO:teuthology.orchestra.run.smithi138.stdout:Get:12 https://4.chacra.ceph.com/r/ceph/main/a2782315255a3e7d5f6cdc9eb35785187ff6ddf8/ubuntu/jammy/flavors/default jammy/main amd64 libradosstriper1 amd64 19.3.0-4907-ga2782315-1jammy [473 kB] 2024-09-14T11:04:55.438 INFO:teuthology.orchestra.run.smithi138.stdout:Get:13 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libdouble-conversion3 amd64 3.1.7-4 [39.0 kB] 2024-09-14T11:04:55.439 INFO:teuthology.orchestra.run.smithi154.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libthrift-0.16.0 amd64 0.16.0-2 [267 kB] 2024-09-14T11:04:55.441 INFO:teuthology.orchestra.run.smithi138.stdout:Get:14 https://4.chacra.ceph.com/r/ceph/main/a2782315255a3e7d5f6cdc9eb35785187ff6ddf8/ubuntu/jammy/flavors/default jammy/main amd64 ceph-common amd64 19.3.0-4907-ga2782315-1jammy [28.3 MB] 2024-09-14T11:04:55.443 INFO:teuthology.orchestra.run.smithi154.stdout:Get:9 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libnbd0 amd64 1.10.5-1 [71.3 kB] 2024-09-14T11:04:55.444 INFO:teuthology.orchestra.run.smithi154.stdout:Get:10 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-wcwidth all 0.2.5+dfsg1-1 [21.9 kB] 2024-09-14T11:04:55.444 INFO:teuthology.orchestra.run.smithi154.stdout:Get:11 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-prettytable all 2.5.0-2 [31.3 kB] 2024-09-14T11:04:55.445 INFO:teuthology.orchestra.run.smithi154.stdout:Get:12 http://archive.ubuntu.com/ubuntu jammy/universe amd64 librdkafka1 amd64 1.8.0-1build1 [633 kB] 2024-09-14T11:04:55.451 INFO:teuthology.orchestra.run.smithi138.stdout:Get:15 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libpcre2-16-0 amd64 10.39-3ubuntu0.1 [203 kB] 2024-09-14T11:04:55.453 INFO:teuthology.orchestra.run.smithi154.stdout:Get:13 http://archive.ubuntu.com/ubuntu jammy/main amd64 libreadline-dev amd64 8.1.2-1 [166 kB] 2024-09-14T11:04:55.456 INFO:teuthology.orchestra.run.smithi154.stdout:Get:14 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblua5.3-dev amd64 5.3.6-1build1 [167 kB] 2024-09-14T11:04:55.458 INFO:teuthology.orchestra.run.smithi154.stdout:Get:15 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua5.1 amd64 5.1.5-8.1build4 [94.6 kB] 2024-09-14T11:04:55.460 INFO:teuthology.orchestra.run.smithi154.stdout:Get:16 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-any all 27ubuntu1 [5,034 B] 2024-09-14T11:04:55.460 INFO:teuthology.orchestra.run.smithi154.stdout:Get:17 http://archive.ubuntu.com/ubuntu jammy/main amd64 zip amd64 3.0-12build2 [176 kB] 2024-09-14T11:04:55.477 INFO:teuthology.orchestra.run.smithi154.stdout:Get:18 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 unzip amd64 6.0-26ubuntu3.2 [175 kB] 2024-09-14T11:04:55.479 INFO:teuthology.orchestra.run.smithi154.stdout:Get:19 http://archive.ubuntu.com/ubuntu jammy/universe amd64 luarocks all 3.8.0+dfsg1-1 [140 kB] 2024-09-14T11:04:55.481 INFO:teuthology.orchestra.run.smithi154.stdout:Get:20 http://archive.ubuntu.com/ubuntu jammy/main amd64 liboath0 amd64 2.6.7-3build1 [41.1 kB] 2024-09-14T11:04:55.481 INFO:teuthology.orchestra.run.smithi154.stdout:Get:21 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.functools all 3.4.0-2 [9,030 B] 2024-09-14T11:04:55.482 INFO:teuthology.orchestra.run.smithi154.stdout:Get:22 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-cheroot all 8.5.2+ds1-1ubuntu3.1 [71.1 kB] 2024-09-14T11:04:55.483 INFO:teuthology.orchestra.run.smithi154.stdout:Get:23 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.classes all 3.2.1-3 [6,452 B] 2024-09-14T11:04:55.484 INFO:teuthology.orchestra.run.smithi154.stdout:Get:24 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.text all 3.6.0-2 [8,716 B] 2024-09-14T11:04:55.494 INFO:teuthology.orchestra.run.smithi154.stdout:Get:25 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.collections all 3.4.0-2 [11.4 kB] 2024-09-14T11:04:55.495 INFO:teuthology.orchestra.run.smithi154.stdout:Get:26 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-tempora all 4.1.2-1 [14.8 kB] 2024-09-14T11:04:55.495 INFO:teuthology.orchestra.run.smithi154.stdout:Get:27 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-portend all 3.0.0-1 [7,240 B] 2024-09-14T11:04:55.511 INFO:teuthology.orchestra.run.smithi154.stdout:Get:28 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-zc.lockfile all 2.0-1 [8,980 B] 2024-09-14T11:04:55.512 INFO:teuthology.orchestra.run.smithi154.stdout:Get:29 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cherrypy3 all 18.6.1-4 [208 kB] 2024-09-14T11:04:55.514 INFO:teuthology.orchestra.run.smithi154.stdout:Get:30 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-natsort all 8.0.2-1 [35.3 kB] 2024-09-14T11:04:55.514 INFO:teuthology.orchestra.run.smithi154.stdout:Get:31 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-logutils all 0.3.3-8 [17.6 kB] 2024-09-14T11:04:55.515 INFO:teuthology.orchestra.run.smithi154.stdout:Get:32 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-markupsafe amd64 2.0.1-2build1 [12.7 kB] 2024-09-14T11:04:55.515 INFO:teuthology.orchestra.run.smithi154.stdout:Get:33 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-mako all 1.1.3+ds1-2ubuntu0.1 [60.5 kB] 2024-09-14T11:04:55.516 INFO:teuthology.orchestra.run.smithi154.stdout:Get:34 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-simplegeneric all 0.8.1-3 [11.3 kB] 2024-09-14T11:04:55.528 INFO:teuthology.orchestra.run.smithi154.stdout:Get:35 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-singledispatch all 3.4.0.3-3 [7,320 B] 2024-09-14T11:04:55.529 INFO:teuthology.orchestra.run.smithi154.stdout:Get:36 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-webob all 1:1.8.6-1.1ubuntu0.1 [86.7 kB] 2024-09-14T11:04:55.530 INFO:teuthology.orchestra.run.smithi154.stdout:Get:37 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-waitress all 1.4.4-1.1ubuntu1 [47.3 kB] 2024-09-14T11:04:55.531 INFO:teuthology.orchestra.run.smithi138.stdout:Get:16 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5core5a amd64 5.15.3+dfsg-2ubuntu0.2 [2,006 kB] 2024-09-14T11:04:55.545 INFO:teuthology.orchestra.run.smithi154.stdout:Get:38 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-tempita all 0.5.2-6ubuntu1 [15.1 kB] 2024-09-14T11:04:55.546 INFO:teuthology.orchestra.run.smithi154.stdout:Get:39 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-paste all 3.5.0+dfsg1-1 [456 kB] 2024-09-14T11:04:55.551 INFO:teuthology.orchestra.run.smithi154.stdout:Get:40 http://archive.ubuntu.com/ubuntu jammy/main amd64 python-pastedeploy-tpl all 2.1.1-1 [4,892 B] 2024-09-14T11:04:55.551 INFO:teuthology.orchestra.run.smithi154.stdout:Get:41 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pastedeploy all 2.1.1-1 [26.6 kB] 2024-09-14T11:04:55.551 INFO:teuthology.orchestra.run.smithi154.stdout:Get:42 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-webtest all 2.0.35-1 [28.5 kB] 2024-09-14T11:04:55.552 INFO:teuthology.orchestra.run.smithi154.stdout:Get:43 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pecan all 1.3.3-4ubuntu2 [87.3 kB] 2024-09-14T11:04:55.553 INFO:teuthology.orchestra.run.smithi154.stdout:Get:44 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-certifi all 2020.6.20-1 [150 kB] 2024-09-14T11:04:55.562 INFO:teuthology.orchestra.run.smithi154.stdout:Get:45 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-idna all 3.3-1ubuntu0.1 [52.1 kB] 2024-09-14T11:04:55.563 INFO:teuthology.orchestra.run.smithi154.stdout:Get:46 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-urllib3 all 1.26.5-1~exp1ubuntu0.1 [98.2 kB] 2024-09-14T11:04:55.564 INFO:teuthology.orchestra.run.smithi154.stdout:Get:47 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-requests all 2.25.1+dfsg-2ubuntu0.1 [48.8 kB] 2024-09-14T11:04:55.579 INFO:teuthology.orchestra.run.smithi154.stdout:Get:48 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-werkzeug all 2.0.2+dfsg1-1ubuntu0.22.04.2 [181 kB] 2024-09-14T11:04:55.582 INFO:teuthology.orchestra.run.smithi154.stdout:Get:49 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-bcrypt amd64 3.2.0-1build1 [32.7 kB] 2024-09-14T11:04:55.582 INFO:teuthology.orchestra.run.smithi154.stdout:Get:50 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-openssl all 21.0.0-1 [45.2 kB] 2024-09-14T11:04:55.583 INFO:teuthology.orchestra.run.smithi154.stdout:Get:51 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-asyncssh all 2.5.0-1 [185 kB] 2024-09-14T11:04:55.585 INFO:teuthology.orchestra.run.smithi154.stdout:Get:52 http://archive.ubuntu.com/ubuntu jammy/main amd64 python-babel-localedata all 2.8.0+dfsg.1-7 [4,982 kB] 2024-09-14T11:04:55.617 INFO:teuthology.orchestra.run.smithi154.stdout:Get:53 https://4.chacra.ceph.com/r/ceph/main/a2782315255a3e7d5f6cdc9eb35785187ff6ddf8/ubuntu/jammy/flavors/default jammy/main amd64 librbd1 amd64 19.3.0-4907-ga2782315-1jammy [3,334 kB] 2024-09-14T11:04:55.637 INFO:teuthology.orchestra.run.smithi154.stdout:Get:54 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-babel all 2.8.0+dfsg.1-7 [85.1 kB] 2024-09-14T11:04:55.638 INFO:teuthology.orchestra.run.smithi154.stdout:Get:55 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-jinja2 all 3.0.3-1ubuntu0.2 [108 kB] 2024-09-14T11:04:55.639 INFO:teuthology.orchestra.run.smithi154.stdout:Get:56 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-repoze.lru all 0.7-2 [12.1 kB] 2024-09-14T11:04:55.639 INFO:teuthology.orchestra.run.smithi154.stdout:Get:57 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-routes all 2.5.1-1ubuntu1 [89.0 kB] 2024-09-14T11:04:55.640 INFO:teuthology.orchestra.run.smithi154.stdout:Get:58 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-sklearn-lib amd64 0.23.2-5ubuntu6 [2,058 kB] 2024-09-14T11:04:55.657 INFO:teuthology.orchestra.run.smithi154.stdout:Get:59 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-joblib all 0.17.0-4ubuntu1 [204 kB] 2024-09-14T11:04:55.659 INFO:teuthology.orchestra.run.smithi154.stdout:Get:60 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-threadpoolctl all 3.1.0-1 [21.3 kB] 2024-09-14T11:04:55.659 INFO:teuthology.orchestra.run.smithi154.stdout:Get:61 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-sklearn all 0.23.2-5ubuntu6 [1,829 kB] 2024-09-14T11:04:55.674 INFO:teuthology.orchestra.run.smithi154.stdout:Get:62 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cachetools all 5.0.0-1 [9,722 B] 2024-09-14T11:04:55.674 INFO:teuthology.orchestra.run.smithi154.stdout:Get:63 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyasn1 all 0.4.8-1 [50.9 kB] 2024-09-14T11:04:55.675 INFO:teuthology.orchestra.run.smithi154.stdout:Get:64 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyasn1-modules all 0.2.1-1 [33.0 kB] 2024-09-14T11:04:55.675 INFO:teuthology.orchestra.run.smithi154.stdout:Get:65 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-rsa all 4.8-1 [28.4 kB] 2024-09-14T11:04:55.675 INFO:teuthology.orchestra.run.smithi154.stdout:Get:66 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-google-auth all 1.5.1-3 [35.7 kB] 2024-09-14T11:04:55.676 INFO:teuthology.orchestra.run.smithi154.stdout:Get:67 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-requests-oauthlib all 1.3.0+ds-0.1 [18.7 kB] 2024-09-14T11:04:55.689 INFO:teuthology.orchestra.run.smithi154.stdout:Get:68 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-websocket all 1.2.3-1 [34.7 kB] 2024-09-14T11:04:55.690 INFO:teuthology.orchestra.run.smithi154.stdout:Get:69 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-kubernetes all 12.0.1-1ubuntu1 [353 kB] 2024-09-14T11:04:55.693 INFO:teuthology.orchestra.run.smithi154.stdout:Get:70 http://archive.ubuntu.com/ubuntu jammy/main amd64 libonig5 amd64 6.9.7.1-2build1 [172 kB] 2024-09-14T11:04:55.707 INFO:teuthology.orchestra.run.smithi154.stdout:Get:71 http://archive.ubuntu.com/ubuntu jammy/main amd64 libjq1 amd64 1.6-2.1ubuntu3 [133 kB] 2024-09-14T11:04:55.708 INFO:teuthology.orchestra.run.smithi154.stdout:Get:72 http://archive.ubuntu.com/ubuntu jammy/main amd64 jq amd64 1.6-2.1ubuntu3 [52.5 kB] 2024-09-14T11:04:55.709 INFO:teuthology.orchestra.run.smithi154.stdout:Get:73 http://archive.ubuntu.com/ubuntu jammy/main amd64 socat amd64 1.7.4.1-3ubuntu4 [349 kB] 2024-09-14T11:04:55.712 INFO:teuthology.orchestra.run.smithi154.stdout:Get:74 http://archive.ubuntu.com/ubuntu jammy/universe amd64 xmlstarlet amd64 1.6.1-2.1 [265 kB] 2024-09-14T11:04:55.714 INFO:teuthology.orchestra.run.smithi154.stdout:Get:75 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-socket amd64 3.0~rc1+git+ac3201d-6 [78.9 kB] 2024-09-14T11:04:55.715 INFO:teuthology.orchestra.run.smithi154.stdout:Get:76 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-sec amd64 1.0.2-1 [37.6 kB] 2024-09-14T11:04:55.715 INFO:teuthology.orchestra.run.smithi154.stdout:Get:77 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 nvme-cli amd64 1.16-3ubuntu0.3 [474 kB] 2024-09-14T11:04:55.724 INFO:teuthology.orchestra.run.smithi154.stdout:Get:78 http://archive.ubuntu.com/ubuntu jammy/main amd64 pkg-config amd64 0.29.2-1ubuntu3 [48.2 kB] 2024-09-14T11:04:55.724 INFO:teuthology.orchestra.run.smithi154.stdout:Get:79 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python-asyncssh-doc all 2.5.0-1 [318 kB] 2024-09-14T11:04:55.727 INFO:teuthology.orchestra.run.smithi154.stdout:Get:80 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-iniconfig all 1.1.1-2 [6,024 B] 2024-09-14T11:04:55.741 INFO:teuthology.orchestra.run.smithi154.stdout:Get:81 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pastescript all 2.0.2-4 [54.6 kB] 2024-09-14T11:04:55.741 INFO:teuthology.orchestra.run.smithi154.stdout:Get:82 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-pluggy all 0.13.0-7.1 [19.0 kB] 2024-09-14T11:04:55.742 INFO:teuthology.orchestra.run.smithi154.stdout:Get:83 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-psutil amd64 5.9.0-1build1 [158 kB] 2024-09-14T11:04:55.743 INFO:teuthology.orchestra.run.smithi154.stdout:Get:84 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-py all 1.10.0-1 [71.9 kB] 2024-09-14T11:04:55.744 INFO:teuthology.orchestra.run.smithi154.stdout:Get:85 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pygments all 2.11.2+dfsg-2 [750 kB] 2024-09-14T11:04:55.750 INFO:teuthology.orchestra.run.smithi154.stdout:Get:86 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyinotify all 0.9.6-1.3 [24.8 kB] 2024-09-14T11:04:55.750 INFO:teuthology.orchestra.run.smithi154.stdout:Get:87 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-toml all 0.10.2-1 [16.5 kB] 2024-09-14T11:04:55.758 INFO:teuthology.orchestra.run.smithi154.stdout:Get:88 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-pytest all 6.2.5-1ubuntu2 [214 kB] 2024-09-14T11:04:55.760 INFO:teuthology.orchestra.run.smithi154.stdout:Get:89 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-simplejson amd64 3.17.6-1build1 [54.7 kB] 2024-09-14T11:04:55.760 INFO:teuthology.orchestra.run.smithi138.stdout:Get:17 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5dbus5 amd64 5.15.3+dfsg-2ubuntu0.2 [222 kB] 2024-09-14T11:04:55.761 INFO:teuthology.orchestra.run.smithi154.stdout:Get:90 http://archive.ubuntu.com/ubuntu jammy/universe amd64 qttranslations5-l10n all 5.15.3-1 [1,983 kB] 2024-09-14T11:04:55.771 INFO:teuthology.orchestra.run.smithi138.stdout:Get:18 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5network5 amd64 5.15.3+dfsg-2ubuntu0.2 [731 kB] 2024-09-14T11:04:55.773 INFO:teuthology.orchestra.run.smithi154.stdout:Get:91 https://4.chacra.ceph.com/r/ceph/main/a2782315255a3e7d5f6cdc9eb35785187ff6ddf8/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs2 amd64 19.3.0-4907-ga2782315-1jammy [721 kB] 2024-09-14T11:04:55.800 INFO:teuthology.orchestra.run.smithi138.stdout:Get:19 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libthrift-0.16.0 amd64 0.16.0-2 [267 kB] 2024-09-14T11:04:55.809 INFO:teuthology.orchestra.run.smithi138.stdout:Get:20 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libnbd0 amd64 1.10.5-1 [71.3 kB] 2024-09-14T11:04:55.812 INFO:teuthology.orchestra.run.smithi138.stdout:Get:21 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-wcwidth all 0.2.5+dfsg1-1 [21.9 kB] 2024-09-14T11:04:55.812 INFO:teuthology.orchestra.run.smithi138.stdout:Get:22 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-prettytable all 2.5.0-2 [31.3 kB] 2024-09-14T11:04:55.814 INFO:teuthology.orchestra.run.smithi138.stdout:Get:23 http://archive.ubuntu.com/ubuntu jammy/universe amd64 librdkafka1 amd64 1.8.0-1build1 [633 kB] 2024-09-14T11:04:55.819 INFO:teuthology.orchestra.run.smithi154.stdout:Get:92 https://4.chacra.ceph.com/r/ceph/main/a2782315255a3e7d5f6cdc9eb35785187ff6ddf8/ubuntu/jammy/flavors/default jammy/main amd64 python3-rados amd64 19.3.0-4907-ga2782315-1jammy [357 kB] 2024-09-14T11:04:55.826 INFO:teuthology.orchestra.run.smithi154.stdout:Get:93 https://4.chacra.ceph.com/r/ceph/main/a2782315255a3e7d5f6cdc9eb35785187ff6ddf8/ubuntu/jammy/flavors/default jammy/main amd64 python3-ceph-argparse all 19.3.0-4907-ga2782315-1jammy [32.8 kB] 2024-09-14T11:04:55.827 INFO:teuthology.orchestra.run.smithi154.stdout:Get:94 https://4.chacra.ceph.com/r/ceph/main/a2782315255a3e7d5f6cdc9eb35785187ff6ddf8/ubuntu/jammy/flavors/default jammy/main amd64 python3-cephfs amd64 19.3.0-4907-ga2782315-1jammy [180 kB] 2024-09-14T11:04:55.831 INFO:teuthology.orchestra.run.smithi138.stdout:Get:24 http://archive.ubuntu.com/ubuntu jammy/main amd64 libreadline-dev amd64 8.1.2-1 [166 kB] 2024-09-14T11:04:55.835 INFO:teuthology.orchestra.run.smithi138.stdout:Get:25 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblua5.3-dev amd64 5.3.6-1build1 [167 kB] 2024-09-14T11:04:55.842 INFO:teuthology.orchestra.run.smithi138.stdout:Get:26 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua5.1 amd64 5.1.5-8.1build4 [94.6 kB] 2024-09-14T11:04:55.864 INFO:teuthology.orchestra.run.smithi154.stdout:Get:95 https://4.chacra.ceph.com/r/ceph/main/a2782315255a3e7d5f6cdc9eb35785187ff6ddf8/ubuntu/jammy/flavors/default jammy/main amd64 python3-ceph-common all 19.3.0-4907-ga2782315-1jammy [71.3 kB] 2024-09-14T11:04:55.866 INFO:teuthology.orchestra.run.smithi154.stdout:Get:96 https://4.chacra.ceph.com/r/ceph/main/a2782315255a3e7d5f6cdc9eb35785187ff6ddf8/ubuntu/jammy/flavors/default jammy/main amd64 python3-rbd amd64 19.3.0-4907-ga2782315-1jammy [338 kB] 2024-09-14T11:04:55.873 INFO:teuthology.orchestra.run.smithi154.stdout:Get:97 https://4.chacra.ceph.com/r/ceph/main/a2782315255a3e7d5f6cdc9eb35785187ff6ddf8/ubuntu/jammy/flavors/default jammy/main amd64 librgw2 amd64 19.3.0-4907-ga2782315-1jammy [7,989 kB] 2024-09-14T11:04:55.921 INFO:teuthology.orchestra.run.smithi138.stdout:Get:27 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-any all 27ubuntu1 [5,034 B] 2024-09-14T11:04:55.922 INFO:teuthology.orchestra.run.smithi138.stdout:Get:28 http://archive.ubuntu.com/ubuntu jammy/main amd64 zip amd64 3.0-12build2 [176 kB] 2024-09-14T11:04:55.926 INFO:teuthology.orchestra.run.smithi138.stdout:Get:29 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 unzip amd64 6.0-26ubuntu3.2 [175 kB] 2024-09-14T11:04:55.930 INFO:teuthology.orchestra.run.smithi138.stdout:Get:30 http://archive.ubuntu.com/ubuntu jammy/universe amd64 luarocks all 3.8.0+dfsg1-1 [140 kB] 2024-09-14T11:04:55.934 INFO:teuthology.orchestra.run.smithi138.stdout:Get:31 http://archive.ubuntu.com/ubuntu jammy/main amd64 liboath0 amd64 2.6.7-3build1 [41.1 kB] 2024-09-14T11:04:55.935 INFO:teuthology.orchestra.run.smithi138.stdout:Get:32 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.functools all 3.4.0-2 [9,030 B] 2024-09-14T11:04:55.936 INFO:teuthology.orchestra.run.smithi138.stdout:Get:33 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-cheroot all 8.5.2+ds1-1ubuntu3.1 [71.1 kB] 2024-09-14T11:04:55.938 INFO:teuthology.orchestra.run.smithi138.stdout:Get:34 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.classes all 3.2.1-3 [6,452 B] 2024-09-14T11:04:55.939 INFO:teuthology.orchestra.run.smithi138.stdout:Get:35 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.text all 3.6.0-2 [8,716 B] 2024-09-14T11:04:56.005 INFO:teuthology.orchestra.run.smithi138.stdout:Get:36 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.collections all 3.4.0-2 [11.4 kB] 2024-09-14T11:04:56.021 INFO:teuthology.orchestra.run.smithi138.stdout:Get:37 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-tempora all 4.1.2-1 [14.8 kB] 2024-09-14T11:04:56.022 INFO:teuthology.orchestra.run.smithi138.stdout:Get:38 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-portend all 3.0.0-1 [7,240 B] 2024-09-14T11:04:56.022 INFO:teuthology.orchestra.run.smithi138.stdout:Get:39 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-zc.lockfile all 2.0-1 [8,980 B] 2024-09-14T11:04:56.023 INFO:teuthology.orchestra.run.smithi138.stdout:Get:40 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cherrypy3 all 18.6.1-4 [208 kB] 2024-09-14T11:04:56.028 INFO:teuthology.orchestra.run.smithi138.stdout:Get:41 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-natsort all 8.0.2-1 [35.3 kB] 2024-09-14T11:04:56.086 INFO:teuthology.orchestra.run.smithi138.stdout:Get:42 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-logutils all 0.3.3-8 [17.6 kB] 2024-09-14T11:04:56.087 INFO:teuthology.orchestra.run.smithi138.stdout:Get:43 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-markupsafe amd64 2.0.1-2build1 [12.7 kB] 2024-09-14T11:04:56.088 INFO:teuthology.orchestra.run.smithi138.stdout:Get:44 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-mako all 1.1.3+ds1-2ubuntu0.1 [60.5 kB] 2024-09-14T11:04:56.089 INFO:teuthology.orchestra.run.smithi138.stdout:Get:45 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-simplegeneric all 0.8.1-3 [11.3 kB] 2024-09-14T11:04:56.167 INFO:teuthology.orchestra.run.smithi138.stdout:Get:46 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-singledispatch all 3.4.0.3-3 [7,320 B] 2024-09-14T11:04:56.179 INFO:teuthology.orchestra.run.smithi138.stdout:Get:47 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-webob all 1:1.8.6-1.1ubuntu0.1 [86.7 kB] 2024-09-14T11:04:56.231 INFO:teuthology.orchestra.run.smithi154.stdout:Get:98 https://4.chacra.ceph.com/r/ceph/main/a2782315255a3e7d5f6cdc9eb35785187ff6ddf8/ubuntu/jammy/flavors/default jammy/main amd64 python3-rgw amd64 19.3.0-4907-ga2782315-1jammy [112 kB] 2024-09-14T11:04:56.233 INFO:teuthology.orchestra.run.smithi154.stdout:Get:99 https://4.chacra.ceph.com/r/ceph/main/a2782315255a3e7d5f6cdc9eb35785187ff6ddf8/ubuntu/jammy/flavors/default jammy/main amd64 libradosstriper1 amd64 19.3.0-4907-ga2782315-1jammy [473 kB] 2024-09-14T11:04:56.241 INFO:teuthology.orchestra.run.smithi154.stdout:Get:100 https://4.chacra.ceph.com/r/ceph/main/a2782315255a3e7d5f6cdc9eb35785187ff6ddf8/ubuntu/jammy/flavors/default jammy/main amd64 ceph-common amd64 19.3.0-4907-ga2782315-1jammy [28.3 MB] 2024-09-14T11:04:56.245 INFO:teuthology.orchestra.run.smithi138.stdout:Get:48 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-waitress all 1.4.4-1.1ubuntu1 [47.3 kB] 2024-09-14T11:04:56.245 INFO:teuthology.orchestra.run.smithi138.stdout:Get:49 https://4.chacra.ceph.com/r/ceph/main/a2782315255a3e7d5f6cdc9eb35785187ff6ddf8/ubuntu/jammy/flavors/default jammy/main amd64 ceph-base amd64 19.3.0-4907-ga2782315-1jammy [5,207 kB] 2024-09-14T11:04:56.246 INFO:teuthology.orchestra.run.smithi138.stdout:Get:50 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-tempita all 0.5.2-6ubuntu1 [15.1 kB] 2024-09-14T11:04:56.247 INFO:teuthology.orchestra.run.smithi138.stdout:Get:51 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-paste all 3.5.0+dfsg1-1 [456 kB] 2024-09-14T11:04:56.258 INFO:teuthology.orchestra.run.smithi138.stdout:Get:52 http://archive.ubuntu.com/ubuntu jammy/main amd64 python-pastedeploy-tpl all 2.1.1-1 [4,892 B] 2024-09-14T11:04:56.258 INFO:teuthology.orchestra.run.smithi138.stdout:Get:53 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pastedeploy all 2.1.1-1 [26.6 kB] 2024-09-14T11:04:56.260 INFO:teuthology.orchestra.run.smithi138.stdout:Get:54 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-webtest all 2.0.35-1 [28.5 kB] 2024-09-14T11:04:56.261 INFO:teuthology.orchestra.run.smithi138.stdout:Get:55 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pecan all 1.3.3-4ubuntu2 [87.3 kB] 2024-09-14T11:04:56.263 INFO:teuthology.orchestra.run.smithi138.stdout:Get:56 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-certifi all 2020.6.20-1 [150 kB] 2024-09-14T11:04:56.322 INFO:teuthology.orchestra.run.smithi138.stdout:Get:57 https://4.chacra.ceph.com/r/ceph/main/a2782315255a3e7d5f6cdc9eb35785187ff6ddf8/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-modules-core all 19.3.0-4907-ga2782315-1jammy [251 kB] 2024-09-14T11:04:56.326 INFO:teuthology.orchestra.run.smithi138.stdout:Get:58 https://4.chacra.ceph.com/r/ceph/main/a2782315255a3e7d5f6cdc9eb35785187ff6ddf8/ubuntu/jammy/flavors/default jammy/main amd64 libsqlite3-mod-ceph amd64 19.3.0-4907-ga2782315-1jammy [124 kB] 2024-09-14T11:04:56.328 INFO:teuthology.orchestra.run.smithi138.stdout:Get:59 https://4.chacra.ceph.com/r/ceph/main/a2782315255a3e7d5f6cdc9eb35785187ff6ddf8/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr amd64 19.3.0-4907-ga2782315-1jammy [1,562 kB] 2024-09-14T11:04:56.329 INFO:teuthology.orchestra.run.smithi138.stdout:Get:60 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-idna all 3.3-1ubuntu0.1 [52.1 kB] 2024-09-14T11:04:56.331 INFO:teuthology.orchestra.run.smithi138.stdout:Get:61 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-urllib3 all 1.26.5-1~exp1ubuntu0.1 [98.2 kB] 2024-09-14T11:04:56.349 INFO:teuthology.orchestra.run.smithi138.stdout:Get:62 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-requests all 2.25.1+dfsg-2ubuntu0.1 [48.8 kB] 2024-09-14T11:04:56.350 INFO:teuthology.orchestra.run.smithi138.stdout:Get:63 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-werkzeug all 2.0.2+dfsg1-1ubuntu0.22.04.2 [181 kB] 2024-09-14T11:04:56.355 INFO:teuthology.orchestra.run.smithi138.stdout:Get:64 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-bcrypt amd64 3.2.0-1build1 [32.7 kB] 2024-09-14T11:04:56.356 INFO:teuthology.orchestra.run.smithi138.stdout:Get:65 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-openssl all 21.0.0-1 [45.2 kB] 2024-09-14T11:04:56.357 INFO:teuthology.orchestra.run.smithi138.stdout:Get:66 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-asyncssh all 2.5.0-1 [185 kB] 2024-09-14T11:04:56.372 INFO:teuthology.orchestra.run.smithi138.stdout:Get:67 https://4.chacra.ceph.com/r/ceph/main/a2782315255a3e7d5f6cdc9eb35785187ff6ddf8/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mon amd64 19.3.0-4907-ga2782315-1jammy [6,309 kB] 2024-09-14T11:04:56.413 INFO:teuthology.orchestra.run.smithi138.stdout:Get:68 http://archive.ubuntu.com/ubuntu jammy/main amd64 python-babel-localedata all 2.8.0+dfsg.1-7 [4,982 kB] 2024-09-14T11:04:56.574 INFO:teuthology.orchestra.run.smithi138.stdout:Get:69 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-babel all 2.8.0+dfsg.1-7 [85.1 kB] 2024-09-14T11:04:56.576 INFO:teuthology.orchestra.run.smithi138.stdout:Get:70 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-jinja2 all 3.0.3-1ubuntu0.2 [108 kB] 2024-09-14T11:04:56.578 INFO:teuthology.orchestra.run.smithi138.stdout:Get:71 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-repoze.lru all 0.7-2 [12.1 kB] 2024-09-14T11:04:56.578 INFO:teuthology.orchestra.run.smithi138.stdout:Get:72 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-routes all 2.5.1-1ubuntu1 [89.0 kB] 2024-09-14T11:04:56.580 INFO:teuthology.orchestra.run.smithi138.stdout:Get:73 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-sklearn-lib amd64 0.23.2-5ubuntu6 [2,058 kB] 2024-09-14T11:04:56.610 INFO:teuthology.orchestra.run.smithi138.stdout:Get:74 https://4.chacra.ceph.com/r/ceph/main/a2782315255a3e7d5f6cdc9eb35785187ff6ddf8/ubuntu/jammy/flavors/default jammy/main amd64 ceph-osd amd64 19.3.0-4907-ga2782315-1jammy [23.1 MB] 2024-09-14T11:04:56.613 INFO:teuthology.orchestra.run.smithi138.stdout:Get:75 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-joblib all 0.17.0-4ubuntu1 [204 kB] 2024-09-14T11:04:56.616 INFO:teuthology.orchestra.run.smithi138.stdout:Get:76 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-threadpoolctl all 3.1.0-1 [21.3 kB] 2024-09-14T11:04:56.616 INFO:teuthology.orchestra.run.smithi138.stdout:Get:77 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-sklearn all 0.23.2-5ubuntu6 [1,829 kB] 2024-09-14T11:04:56.677 INFO:teuthology.orchestra.run.smithi138.stdout:Get:78 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cachetools all 5.0.0-1 [9,722 B] 2024-09-14T11:04:56.677 INFO:teuthology.orchestra.run.smithi138.stdout:Get:79 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyasn1 all 0.4.8-1 [50.9 kB] 2024-09-14T11:04:56.741 INFO:teuthology.orchestra.run.smithi138.stdout:Get:80 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyasn1-modules all 0.2.1-1 [33.0 kB] 2024-09-14T11:04:56.742 INFO:teuthology.orchestra.run.smithi138.stdout:Get:81 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-rsa all 4.8-1 [28.4 kB] 2024-09-14T11:04:56.742 INFO:teuthology.orchestra.run.smithi138.stdout:Get:82 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-google-auth all 1.5.1-3 [35.7 kB] 2024-09-14T11:04:56.743 INFO:teuthology.orchestra.run.smithi138.stdout:Get:83 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-requests-oauthlib all 1.3.0+ds-0.1 [18.7 kB] 2024-09-14T11:04:56.744 INFO:teuthology.orchestra.run.smithi138.stdout:Get:84 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-websocket all 1.2.3-1 [34.7 kB] 2024-09-14T11:04:56.745 INFO:teuthology.orchestra.run.smithi138.stdout:Get:85 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-kubernetes all 12.0.1-1ubuntu1 [353 kB] 2024-09-14T11:04:56.751 INFO:teuthology.orchestra.run.smithi138.stdout:Get:86 http://archive.ubuntu.com/ubuntu jammy/main amd64 libonig5 amd64 6.9.7.1-2build1 [172 kB] 2024-09-14T11:04:56.822 INFO:teuthology.orchestra.run.smithi138.stdout:Get:87 http://archive.ubuntu.com/ubuntu jammy/main amd64 libjq1 amd64 1.6-2.1ubuntu3 [133 kB] 2024-09-14T11:04:56.825 INFO:teuthology.orchestra.run.smithi138.stdout:Get:88 http://archive.ubuntu.com/ubuntu jammy/main amd64 jq amd64 1.6-2.1ubuntu3 [52.5 kB] 2024-09-14T11:04:56.826 INFO:teuthology.orchestra.run.smithi138.stdout:Get:89 http://archive.ubuntu.com/ubuntu jammy/main amd64 socat amd64 1.7.4.1-3ubuntu4 [349 kB] 2024-09-14T11:04:56.903 INFO:teuthology.orchestra.run.smithi138.stdout:Get:90 http://archive.ubuntu.com/ubuntu jammy/universe amd64 xmlstarlet amd64 1.6.1-2.1 [265 kB] 2024-09-14T11:04:56.909 INFO:teuthology.orchestra.run.smithi138.stdout:Get:91 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-socket amd64 3.0~rc1+git+ac3201d-6 [78.9 kB] 2024-09-14T11:04:56.911 INFO:teuthology.orchestra.run.smithi138.stdout:Get:92 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-sec amd64 1.0.2-1 [37.6 kB] 2024-09-14T11:04:56.913 INFO:teuthology.orchestra.run.smithi138.stdout:Get:93 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 nvme-cli amd64 1.16-3ubuntu0.3 [474 kB] 2024-09-14T11:04:56.924 INFO:teuthology.orchestra.run.smithi138.stdout:Get:94 http://archive.ubuntu.com/ubuntu jammy/main amd64 pkg-config amd64 0.29.2-1ubuntu3 [48.2 kB] 2024-09-14T11:04:56.925 INFO:teuthology.orchestra.run.smithi138.stdout:Get:95 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python-asyncssh-doc all 2.5.0-1 [318 kB] 2024-09-14T11:04:56.933 INFO:teuthology.orchestra.run.smithi138.stdout:Get:96 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-iniconfig all 1.1.1-2 [6,024 B] 2024-09-14T11:04:56.984 INFO:teuthology.orchestra.run.smithi138.stdout:Get:97 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pastescript all 2.0.2-4 [54.6 kB] 2024-09-14T11:04:56.986 INFO:teuthology.orchestra.run.smithi138.stdout:Get:98 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-pluggy all 0.13.0-7.1 [19.0 kB] 2024-09-14T11:04:56.986 INFO:teuthology.orchestra.run.smithi138.stdout:Get:99 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-psutil amd64 5.9.0-1build1 [158 kB] 2024-09-14T11:04:57.065 INFO:teuthology.orchestra.run.smithi138.stdout:Get:100 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-py all 1.10.0-1 [71.9 kB] 2024-09-14T11:04:57.067 INFO:teuthology.orchestra.run.smithi138.stdout:Get:101 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pygments all 2.11.2+dfsg-2 [750 kB] 2024-09-14T11:04:57.084 INFO:teuthology.orchestra.run.smithi138.stdout:Get:102 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyinotify all 0.9.6-1.3 [24.8 kB] 2024-09-14T11:04:57.085 INFO:teuthology.orchestra.run.smithi138.stdout:Get:103 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-toml all 0.10.2-1 [16.5 kB] 2024-09-14T11:04:57.086 INFO:teuthology.orchestra.run.smithi138.stdout:Get:104 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-pytest all 6.2.5-1ubuntu2 [214 kB] 2024-09-14T11:04:57.091 INFO:teuthology.orchestra.run.smithi138.stdout:Get:105 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-simplejson amd64 3.17.6-1build1 [54.7 kB] 2024-09-14T11:04:57.092 INFO:teuthology.orchestra.run.smithi138.stdout:Get:106 http://archive.ubuntu.com/ubuntu jammy/universe amd64 qttranslations5-l10n all 5.15.3-1 [1,983 kB] 2024-09-14T11:04:57.184 INFO:teuthology.orchestra.run.smithi154.stdout:Get:101 https://4.chacra.ceph.com/r/ceph/main/a2782315255a3e7d5f6cdc9eb35785187ff6ddf8/ubuntu/jammy/flavors/default jammy/main amd64 ceph-base amd64 19.3.0-4907-ga2782315-1jammy [5,207 kB] 2024-09-14T11:04:57.284 INFO:teuthology.orchestra.run.smithi154.stdout:Get:102 https://4.chacra.ceph.com/r/ceph/main/a2782315255a3e7d5f6cdc9eb35785187ff6ddf8/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-modules-core all 19.3.0-4907-ga2782315-1jammy [251 kB] 2024-09-14T11:04:57.289 INFO:teuthology.orchestra.run.smithi154.stdout:Get:103 https://4.chacra.ceph.com/r/ceph/main/a2782315255a3e7d5f6cdc9eb35785187ff6ddf8/ubuntu/jammy/flavors/default jammy/main amd64 libsqlite3-mod-ceph amd64 19.3.0-4907-ga2782315-1jammy [124 kB] 2024-09-14T11:04:57.292 INFO:teuthology.orchestra.run.smithi154.stdout:Get:104 https://4.chacra.ceph.com/r/ceph/main/a2782315255a3e7d5f6cdc9eb35785187ff6ddf8/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr amd64 19.3.0-4907-ga2782315-1jammy [1,562 kB] 2024-09-14T11:04:57.327 INFO:teuthology.orchestra.run.smithi154.stdout:Get:105 https://4.chacra.ceph.com/r/ceph/main/a2782315255a3e7d5f6cdc9eb35785187ff6ddf8/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mon amd64 19.3.0-4907-ga2782315-1jammy [6,309 kB] 2024-09-14T11:04:57.540 INFO:teuthology.orchestra.run.smithi154.stdout:Get:106 https://4.chacra.ceph.com/r/ceph/main/a2782315255a3e7d5f6cdc9eb35785187ff6ddf8/ubuntu/jammy/flavors/default jammy/main amd64 ceph-osd amd64 19.3.0-4907-ga2782315-1jammy [23.1 MB] 2024-09-14T11:04:57.549 INFO:teuthology.orchestra.run.smithi138.stdout:Get:107 https://4.chacra.ceph.com/r/ceph/main/a2782315255a3e7d5f6cdc9eb35785187ff6ddf8/ubuntu/jammy/flavors/default jammy/main amd64 ceph amd64 19.3.0-4907-ga2782315-1jammy [14.0 kB] 2024-09-14T11:04:57.549 INFO:teuthology.orchestra.run.smithi138.stdout:Get:108 https://4.chacra.ceph.com/r/ceph/main/a2782315255a3e7d5f6cdc9eb35785187ff6ddf8/ubuntu/jammy/flavors/default jammy/main amd64 ceph-fuse amd64 19.3.0-4907-ga2782315-1jammy [880 kB] 2024-09-14T11:04:57.563 INFO:teuthology.orchestra.run.smithi138.stdout:Get:109 https://4.chacra.ceph.com/r/ceph/main/a2782315255a3e7d5f6cdc9eb35785187ff6ddf8/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mds amd64 19.3.0-4907-ga2782315-1jammy [2,454 kB] 2024-09-14T11:04:57.599 INFO:teuthology.orchestra.run.smithi138.stdout:Get:110 https://4.chacra.ceph.com/r/ceph/main/a2782315255a3e7d5f6cdc9eb35785187ff6ddf8/ubuntu/jammy/flavors/default jammy/main amd64 cephadm amd64 19.3.0-4907-ga2782315-1jammy [813 kB] 2024-09-14T11:04:57.628 INFO:teuthology.orchestra.run.smithi138.stdout:Get:111 https://4.chacra.ceph.com/r/ceph/main/a2782315255a3e7d5f6cdc9eb35785187ff6ddf8/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-cephadm all 19.3.0-4907-ga2782315-1jammy [160 kB] 2024-09-14T11:04:57.638 INFO:teuthology.orchestra.run.smithi138.stdout:Get:112 https://4.chacra.ceph.com/r/ceph/main/a2782315255a3e7d5f6cdc9eb35785187ff6ddf8/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-dashboard all 19.3.0-4907-ga2782315-1jammy [61.4 MB] 2024-09-14T11:04:58.357 INFO:teuthology.orchestra.run.smithi154.stdout:Get:107 https://4.chacra.ceph.com/r/ceph/main/a2782315255a3e7d5f6cdc9eb35785187ff6ddf8/ubuntu/jammy/flavors/default jammy/main amd64 ceph amd64 19.3.0-4907-ga2782315-1jammy [14.0 kB] 2024-09-14T11:04:58.358 INFO:teuthology.orchestra.run.smithi154.stdout:Get:108 https://4.chacra.ceph.com/r/ceph/main/a2782315255a3e7d5f6cdc9eb35785187ff6ddf8/ubuntu/jammy/flavors/default jammy/main amd64 ceph-fuse amd64 19.3.0-4907-ga2782315-1jammy [880 kB] 2024-09-14T11:04:58.375 INFO:teuthology.orchestra.run.smithi154.stdout:Get:109 https://4.chacra.ceph.com/r/ceph/main/a2782315255a3e7d5f6cdc9eb35785187ff6ddf8/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mds amd64 19.3.0-4907-ga2782315-1jammy [2,454 kB] 2024-09-14T11:04:58.416 INFO:teuthology.orchestra.run.smithi154.stdout:Get:110 https://4.chacra.ceph.com/r/ceph/main/a2782315255a3e7d5f6cdc9eb35785187ff6ddf8/ubuntu/jammy/flavors/default jammy/main amd64 cephadm amd64 19.3.0-4907-ga2782315-1jammy [813 kB] 2024-09-14T11:04:58.426 INFO:teuthology.orchestra.run.smithi154.stdout:Get:111 https://4.chacra.ceph.com/r/ceph/main/a2782315255a3e7d5f6cdc9eb35785187ff6ddf8/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-cephadm all 19.3.0-4907-ga2782315-1jammy [160 kB] 2024-09-14T11:04:58.428 INFO:teuthology.orchestra.run.smithi154.stdout:Get:112 https://4.chacra.ceph.com/r/ceph/main/a2782315255a3e7d5f6cdc9eb35785187ff6ddf8/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-dashboard all 19.3.0-4907-ga2782315-1jammy [61.4 MB] 2024-09-14T11:05:00.343 INFO:teuthology.orchestra.run.smithi154.stdout:Get:113 https://4.chacra.ceph.com/r/ceph/main/a2782315255a3e7d5f6cdc9eb35785187ff6ddf8/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-diskprediction-local all 19.3.0-4907-ga2782315-1jammy [8,625 kB] 2024-09-14T11:05:00.425 INFO:teuthology.orchestra.run.smithi138.stdout:Get:113 https://4.chacra.ceph.com/r/ceph/main/a2782315255a3e7d5f6cdc9eb35785187ff6ddf8/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-diskprediction-local all 19.3.0-4907-ga2782315-1jammy [8,625 kB] 2024-09-14T11:05:00.450 INFO:teuthology.orchestra.run.smithi154.stdout:Get:114 https://4.chacra.ceph.com/r/ceph/main/a2782315255a3e7d5f6cdc9eb35785187ff6ddf8/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-k8sevents all 19.3.0-4907-ga2782315-1jammy [14.2 kB] 2024-09-14T11:05:00.450 INFO:teuthology.orchestra.run.smithi154.stdout:Get:115 https://4.chacra.ceph.com/r/ceph/main/a2782315255a3e7d5f6cdc9eb35785187ff6ddf8/ubuntu/jammy/flavors/default jammy/main amd64 ceph-test amd64 19.3.0-4907-ga2782315-1jammy [55.8 MB] 2024-09-14T11:05:00.660 INFO:teuthology.orchestra.run.smithi138.stdout:Get:114 https://4.chacra.ceph.com/r/ceph/main/a2782315255a3e7d5f6cdc9eb35785187ff6ddf8/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-k8sevents all 19.3.0-4907-ga2782315-1jammy [14.2 kB] 2024-09-14T11:05:00.660 INFO:teuthology.orchestra.run.smithi138.stdout:Get:115 https://4.chacra.ceph.com/r/ceph/main/a2782315255a3e7d5f6cdc9eb35785187ff6ddf8/ubuntu/jammy/flavors/default jammy/main amd64 ceph-test amd64 19.3.0-4907-ga2782315-1jammy [55.8 MB] 2024-09-14T11:05:02.441 INFO:teuthology.orchestra.run.smithi154.stdout:Get:116 https://4.chacra.ceph.com/r/ceph/main/a2782315255a3e7d5f6cdc9eb35785187ff6ddf8/ubuntu/jammy/flavors/default jammy/main amd64 ceph-volume all 19.3.0-4907-ga2782315-1jammy [130 kB] 2024-09-14T11:05:02.444 INFO:teuthology.orchestra.run.smithi154.stdout:Get:117 https://4.chacra.ceph.com/r/ceph/main/a2782315255a3e7d5f6cdc9eb35785187ff6ddf8/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs-dev amd64 19.3.0-4907-ga2782315-1jammy [39.0 kB] 2024-09-14T11:05:02.445 INFO:teuthology.orchestra.run.smithi154.stdout:Get:118 https://4.chacra.ceph.com/r/ceph/main/a2782315255a3e7d5f6cdc9eb35785187ff6ddf8/ubuntu/jammy/flavors/default jammy/main amd64 radosgw amd64 19.3.0-4907-ga2782315-1jammy [15.9 MB] 2024-09-14T11:05:03.014 INFO:teuthology.orchestra.run.smithi154.stdout:Get:119 https://4.chacra.ceph.com/r/ceph/main/a2782315255a3e7d5f6cdc9eb35785187ff6ddf8/ubuntu/jammy/flavors/default jammy/main amd64 rbd-fuse amd64 19.3.0-4907-ga2782315-1jammy [91.2 kB] 2024-09-14T11:05:03.601 INFO:teuthology.orchestra.run.smithi154.stdout:Fetched 251 MB in 8s (32.1 MB/s) 2024-09-14T11:05:03.621 INFO:teuthology.orchestra.run.smithi138.stdout:Get:116 https://4.chacra.ceph.com/r/ceph/main/a2782315255a3e7d5f6cdc9eb35785187ff6ddf8/ubuntu/jammy/flavors/default jammy/main amd64 ceph-volume all 19.3.0-4907-ga2782315-1jammy [130 kB] 2024-09-14T11:05:03.623 INFO:teuthology.orchestra.run.smithi138.stdout:Get:117 https://4.chacra.ceph.com/r/ceph/main/a2782315255a3e7d5f6cdc9eb35785187ff6ddf8/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs-dev amd64 19.3.0-4907-ga2782315-1jammy [39.0 kB] 2024-09-14T11:05:03.701 INFO:teuthology.orchestra.run.smithi138.stdout:Get:118 https://4.chacra.ceph.com/r/ceph/main/a2782315255a3e7d5f6cdc9eb35785187ff6ddf8/ubuntu/jammy/flavors/default jammy/main amd64 radosgw amd64 19.3.0-4907-ga2782315-1jammy [15.9 MB] 2024-09-14T11:05:03.779 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package liblttng-ust1:amd64. 2024-09-14T11:05:03.880 INFO:teuthology.orchestra.run.smithi154.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 165990 files and directories currently installed.) 2024-09-14T11:05:03.885 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../000-liblttng-ust1_2.13.1-1ubuntu1_amd64.deb ... 2024-09-14T11:05:03.969 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking liblttng-ust1:amd64 (2.13.1-1ubuntu1) ... 2024-09-14T11:05:04.289 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package libdouble-conversion3:amd64. 2024-09-14T11:05:04.315 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../001-libdouble-conversion3_3.1.7-4_amd64.deb ... 2024-09-14T11:05:04.355 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking libdouble-conversion3:amd64 (3.1.7-4) ... 2024-09-14T11:05:04.547 INFO:teuthology.orchestra.run.smithi138.stdout:Get:119 https://4.chacra.ceph.com/r/ceph/main/a2782315255a3e7d5f6cdc9eb35785187ff6ddf8/ubuntu/jammy/flavors/default jammy/main amd64 rbd-fuse amd64 19.3.0-4907-ga2782315-1jammy [91.2 kB] 2024-09-14T11:05:04.683 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package libpcre2-16-0:amd64. 2024-09-14T11:05:04.709 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../002-libpcre2-16-0_10.39-3ubuntu0.1_amd64.deb ... 2024-09-14T11:05:04.750 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking libpcre2-16-0:amd64 (10.39-3ubuntu0.1) ... 2024-09-14T11:05:05.123 INFO:teuthology.orchestra.run.smithi138.stdout:Fetched 251 MB in 10s (25.9 MB/s) 2024-09-14T11:05:05.179 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package libqt5core5a:amd64. 2024-09-14T11:05:05.205 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../003-libqt5core5a_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-09-14T11:05:05.254 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking libqt5core5a:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-09-14T11:05:05.283 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package liblttng-ust1:amd64. 2024-09-14T11:05:05.382 INFO:teuthology.orchestra.run.smithi138.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 165990 files and directories currently installed.) 2024-09-14T11:05:05.387 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../000-liblttng-ust1_2.13.1-1ubuntu1_amd64.deb ... 2024-09-14T11:05:05.481 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking liblttng-ust1:amd64 (2.13.1-1ubuntu1) ... 2024-09-14T11:05:05.674 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package libqt5dbus5:amd64. 2024-09-14T11:05:05.700 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../004-libqt5dbus5_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-09-14T11:05:05.740 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking libqt5dbus5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-09-14T11:05:05.826 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package libdouble-conversion3:amd64. 2024-09-14T11:05:05.852 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../001-libdouble-conversion3_3.1.7-4_amd64.deb ... 2024-09-14T11:05:05.892 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking libdouble-conversion3:amd64 (3.1.7-4) ... 2024-09-14T11:05:06.052 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package libqt5network5:amd64. 2024-09-14T11:05:06.078 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../005-libqt5network5_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-09-14T11:05:06.118 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking libqt5network5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-09-14T11:05:06.170 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package libpcre2-16-0:amd64. 2024-09-14T11:05:06.185 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../002-libpcre2-16-0_10.39-3ubuntu0.1_amd64.deb ... 2024-09-14T11:05:06.220 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking libpcre2-16-0:amd64 (10.39-3ubuntu0.1) ... 2024-09-14T11:05:06.472 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package libthrift-0.16.0:amd64. 2024-09-14T11:05:06.498 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../006-libthrift-0.16.0_0.16.0-2_amd64.deb ... 2024-09-14T11:05:06.538 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking libthrift-0.16.0:amd64 (0.16.0-2) ... 2024-09-14T11:05:06.657 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package libqt5core5a:amd64. 2024-09-14T11:05:06.683 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../003-libqt5core5a_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-09-14T11:05:06.732 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking libqt5core5a:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-09-14T11:05:06.858 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package librados2. 2024-09-14T11:05:06.884 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../007-librados2_19.3.0-4907-ga2782315-1jammy_amd64.deb ... 2024-09-14T11:05:06.924 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking librados2 (19.3.0-4907-ga2782315-1jammy) ... 2024-09-14T11:05:07.144 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package libqt5dbus5:amd64. 2024-09-14T11:05:07.170 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../004-libqt5dbus5_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-09-14T11:05:07.210 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking libqt5dbus5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-09-14T11:05:07.344 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package libnbd0. 2024-09-14T11:05:07.359 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../008-libnbd0_1.10.5-1_amd64.deb ... 2024-09-14T11:05:07.402 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking libnbd0 (1.10.5-1) ... 2024-09-14T11:05:07.530 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package libqt5network5:amd64. 2024-09-14T11:05:07.557 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../005-libqt5network5_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-09-14T11:05:07.588 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking libqt5network5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-09-14T11:05:07.705 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package librbd1. 2024-09-14T11:05:07.731 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../009-librbd1_19.3.0-4907-ga2782315-1jammy_amd64.deb ... 2024-09-14T11:05:07.772 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking librbd1 (19.3.0-4907-ga2782315-1jammy) ... 2024-09-14T11:05:07.941 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package libthrift-0.16.0:amd64. 2024-09-14T11:05:07.967 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../006-libthrift-0.16.0_0.16.0-2_amd64.deb ... 2024-09-14T11:05:08.008 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking libthrift-0.16.0:amd64 (0.16.0-2) ... 2024-09-14T11:05:08.224 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package libcephfs2. 2024-09-14T11:05:08.250 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../010-libcephfs2_19.3.0-4907-ga2782315-1jammy_amd64.deb ... 2024-09-14T11:05:08.291 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking libcephfs2 (19.3.0-4907-ga2782315-1jammy) ... 2024-09-14T11:05:08.352 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package librados2. 2024-09-14T11:05:08.378 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../007-librados2_19.3.0-4907-ga2782315-1jammy_amd64.deb ... 2024-09-14T11:05:08.418 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking librados2 (19.3.0-4907-ga2782315-1jammy) ... 2024-09-14T11:05:08.569 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package python3-rados. 2024-09-14T11:05:08.594 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../011-python3-rados_19.3.0-4907-ga2782315-1jammy_amd64.deb ... 2024-09-14T11:05:08.635 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking python3-rados (19.3.0-4907-ga2782315-1jammy) ... 2024-09-14T11:05:08.880 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package libnbd0. 2024-09-14T11:05:08.907 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../008-libnbd0_1.10.5-1_amd64.deb ... 2024-09-14T11:05:08.938 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package python3-ceph-argparse. 2024-09-14T11:05:08.938 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking libnbd0 (1.10.5-1) ... 2024-09-14T11:05:08.964 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../012-python3-ceph-argparse_19.3.0-4907-ga2782315-1jammy_all.deb ... 2024-09-14T11:05:09.005 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking python3-ceph-argparse (19.3.0-4907-ga2782315-1jammy) ... 2024-09-14T11:05:09.224 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package librbd1. 2024-09-14T11:05:09.251 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../009-librbd1_19.3.0-4907-ga2782315-1jammy_amd64.deb ... 2024-09-14T11:05:09.257 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package python3-cephfs. 2024-09-14T11:05:09.272 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../013-python3-cephfs_19.3.0-4907-ga2782315-1jammy_amd64.deb ... 2024-09-14T11:05:09.291 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking librbd1 (19.3.0-4907-ga2782315-1jammy) ... 2024-09-14T11:05:09.315 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking python3-cephfs (19.3.0-4907-ga2782315-1jammy) ... 2024-09-14T11:05:09.626 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package python3-ceph-common. 2024-09-14T11:05:09.652 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../014-python3-ceph-common_19.3.0-4907-ga2782315-1jammy_all.deb ... 2024-09-14T11:05:09.693 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking python3-ceph-common (19.3.0-4907-ga2782315-1jammy) ... 2024-09-14T11:05:09.760 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package libcephfs2. 2024-09-14T11:05:09.787 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../010-libcephfs2_19.3.0-4907-ga2782315-1jammy_amd64.deb ... 2024-09-14T11:05:09.827 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking libcephfs2 (19.3.0-4907-ga2782315-1jammy) ... 2024-09-14T11:05:10.038 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package python3-wcwidth. 2024-09-14T11:05:10.065 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../015-python3-wcwidth_0.2.5+dfsg1-1_all.deb ... 2024-09-14T11:05:10.105 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking python3-wcwidth (0.2.5+dfsg1-1) ... 2024-09-14T11:05:10.121 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package python3-rados. 2024-09-14T11:05:10.137 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../011-python3-rados_19.3.0-4907-ga2782315-1jammy_amd64.deb ... 2024-09-14T11:05:10.188 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking python3-rados (19.3.0-4907-ga2782315-1jammy) ... 2024-09-14T11:05:10.391 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package python3-prettytable. 2024-09-14T11:05:10.406 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../016-python3-prettytable_2.5.0-2_all.deb ... 2024-09-14T11:05:10.440 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking python3-prettytable (2.5.0-2) ... 2024-09-14T11:05:10.465 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package python3-ceph-argparse. 2024-09-14T11:05:10.492 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../012-python3-ceph-argparse_19.3.0-4907-ga2782315-1jammy_all.deb ... 2024-09-14T11:05:10.523 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking python3-ceph-argparse (19.3.0-4907-ga2782315-1jammy) ... 2024-09-14T11:05:10.651 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package python3-rbd. 2024-09-14T11:05:10.667 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../017-python3-rbd_19.3.0-4907-ga2782315-1jammy_amd64.deb ... 2024-09-14T11:05:10.709 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking python3-rbd (19.3.0-4907-ga2782315-1jammy) ... 2024-09-14T11:05:10.742 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package python3-cephfs. 2024-09-14T11:05:10.770 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../013-python3-cephfs_19.3.0-4907-ga2782315-1jammy_amd64.deb ... 2024-09-14T11:05:10.809 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking python3-cephfs (19.3.0-4907-ga2782315-1jammy) ... 2024-09-14T11:05:11.055 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package librdkafka1:amd64. 2024-09-14T11:05:11.081 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../018-librdkafka1_1.8.0-1build1_amd64.deb ... 2024-09-14T11:05:11.120 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package python3-ceph-common. 2024-09-14T11:05:11.121 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking librdkafka1:amd64 (1.8.0-1build1) ... 2024-09-14T11:05:11.147 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../014-python3-ceph-common_19.3.0-4907-ga2782315-1jammy_all.deb ... 2024-09-14T11:05:11.187 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking python3-ceph-common (19.3.0-4907-ga2782315-1jammy) ... 2024-09-14T11:05:11.399 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package libreadline-dev:amd64. 2024-09-14T11:05:11.414 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../019-libreadline-dev_8.1.2-1_amd64.deb ... 2024-09-14T11:05:11.457 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking libreadline-dev:amd64 (8.1.2-1) ... 2024-09-14T11:05:11.515 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package python3-wcwidth. 2024-09-14T11:05:11.542 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../015-python3-wcwidth_0.2.5+dfsg1-1_all.deb ... 2024-09-14T11:05:11.581 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking python3-wcwidth (0.2.5+dfsg1-1) ... 2024-09-14T11:05:11.760 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package liblua5.3-dev:amd64. 2024-09-14T11:05:11.787 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../020-liblua5.3-dev_5.3.6-1build1_amd64.deb ... 2024-09-14T11:05:11.826 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking liblua5.3-dev:amd64 (5.3.6-1build1) ... 2024-09-14T11:05:11.901 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package python3-prettytable. 2024-09-14T11:05:11.928 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../016-python3-prettytable_2.5.0-2_all.deb ... 2024-09-14T11:05:11.959 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking python3-prettytable (2.5.0-2) ... 2024-09-14T11:05:12.130 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package lua5.1. 2024-09-14T11:05:12.156 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../021-lua5.1_5.1.5-8.1build4_amd64.deb ... 2024-09-14T11:05:12.188 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking lua5.1 (5.1.5-8.1build4) ... 2024-09-14T11:05:12.195 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package python3-rbd. 2024-09-14T11:05:12.222 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../017-python3-rbd_19.3.0-4907-ga2782315-1jammy_amd64.deb ... 2024-09-14T11:05:12.262 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking python3-rbd (19.3.0-4907-ga2782315-1jammy) ... 2024-09-14T11:05:12.499 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package lua-any. 2024-09-14T11:05:12.515 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../022-lua-any_27ubuntu1_all.deb ... 2024-09-14T11:05:12.558 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking lua-any (27ubuntu1) ... 2024-09-14T11:05:12.623 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package librdkafka1:amd64. 2024-09-14T11:05:12.650 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../018-librdkafka1_1.8.0-1build1_amd64.deb ... 2024-09-14T11:05:12.690 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking librdkafka1:amd64 (1.8.0-1build1) ... 2024-09-14T11:05:12.794 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package zip. 2024-09-14T11:05:12.809 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../023-zip_3.0-12build2_amd64.deb ... 2024-09-14T11:05:12.852 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking zip (3.0-12build2) ... 2024-09-14T11:05:12.976 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package libreadline-dev:amd64. 2024-09-14T11:05:13.002 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../019-libreadline-dev_8.1.2-1_amd64.deb ... 2024-09-14T11:05:13.042 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking libreadline-dev:amd64 (8.1.2-1) ... 2024-09-14T11:05:13.164 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package unzip. 2024-09-14T11:05:13.190 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../024-unzip_6.0-26ubuntu3.2_amd64.deb ... 2024-09-14T11:05:13.232 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking unzip (6.0-26ubuntu3.2) ... 2024-09-14T11:05:13.345 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package liblua5.3-dev:amd64. 2024-09-14T11:05:13.360 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../020-liblua5.3-dev_5.3.6-1build1_amd64.deb ... 2024-09-14T11:05:13.395 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking liblua5.3-dev:amd64 (5.3.6-1build1) ... 2024-09-14T11:05:13.918 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package luarocks. 2024-09-14T11:05:13.944 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../025-luarocks_3.8.0+dfsg1-1_all.deb ... 2024-09-14T11:05:13.984 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking luarocks (3.8.0+dfsg1-1) ... 2024-09-14T11:05:14.126 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package lua5.1. 2024-09-14T11:05:14.153 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../021-lua5.1_5.1.5-8.1build4_amd64.deb ... 2024-09-14T11:05:14.284 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking lua5.1 (5.1.5-8.1build4) ... 2024-09-14T11:05:14.367 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package librgw2. 2024-09-14T11:05:14.394 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../026-librgw2_19.3.0-4907-ga2782315-1jammy_amd64.deb ... 2024-09-14T11:05:14.434 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking librgw2 (19.3.0-4907-ga2782315-1jammy) ... 2024-09-14T11:05:14.605 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package lua-any. 2024-09-14T11:05:14.631 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../022-lua-any_27ubuntu1_all.deb ... 2024-09-14T11:05:14.673 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking lua-any (27ubuntu1) ... 2024-09-14T11:05:14.916 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package zip. 2024-09-14T11:05:14.931 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../023-zip_3.0-12build2_amd64.deb ... 2024-09-14T11:05:14.974 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking zip (3.0-12build2) ... 2024-09-14T11:05:15.053 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package python3-rgw. 2024-09-14T11:05:15.068 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../027-python3-rgw_19.3.0-4907-ga2782315-1jammy_amd64.deb ... 2024-09-14T11:05:15.111 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking python3-rgw (19.3.0-4907-ga2782315-1jammy) ... 2024-09-14T11:05:15.286 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package unzip. 2024-09-14T11:05:15.313 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../024-unzip_6.0-26ubuntu3.2_amd64.deb ... 2024-09-14T11:05:15.353 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking unzip (6.0-26ubuntu3.2) ... 2024-09-14T11:05:15.389 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package liboath0:amd64. 2024-09-14T11:05:15.404 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../028-liboath0_2.6.7-3build1_amd64.deb ... 2024-09-14T11:05:15.439 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking liboath0:amd64 (2.6.7-3build1) ... 2024-09-14T11:05:15.742 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package libradosstriper1. 2024-09-14T11:05:15.766 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package luarocks. 2024-09-14T11:05:15.768 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../029-libradosstriper1_19.3.0-4907-ga2782315-1jammy_amd64.deb ... 2024-09-14T11:05:15.793 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../025-luarocks_3.8.0+dfsg1-1_all.deb ... 2024-09-14T11:05:15.808 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking libradosstriper1 (19.3.0-4907-ga2782315-1jammy) ... 2024-09-14T11:05:15.832 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking luarocks (3.8.0+dfsg1-1) ... 2024-09-14T11:05:16.237 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package ceph-common. 2024-09-14T11:05:16.241 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package librgw2. 2024-09-14T11:05:16.264 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../030-ceph-common_19.3.0-4907-ga2782315-1jammy_amd64.deb ... 2024-09-14T11:05:16.268 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../026-librgw2_19.3.0-4907-ga2782315-1jammy_amd64.deb ... 2024-09-14T11:05:16.303 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking ceph-common (19.3.0-4907-ga2782315-1jammy) ... 2024-09-14T11:05:16.308 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking librgw2 (19.3.0-4907-ga2782315-1jammy) ... 2024-09-14T11:05:16.944 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package python3-rgw. 2024-09-14T11:05:16.959 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../027-python3-rgw_19.3.0-4907-ga2782315-1jammy_amd64.deb ... 2024-09-14T11:05:17.002 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking python3-rgw (19.3.0-4907-ga2782315-1jammy) ... 2024-09-14T11:05:17.297 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package liboath0:amd64. 2024-09-14T11:05:17.324 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../028-liboath0_2.6.7-3build1_amd64.deb ... 2024-09-14T11:05:17.364 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking liboath0:amd64 (2.6.7-3build1) ... 2024-09-14T11:05:17.667 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package libradosstriper1. 2024-09-14T11:05:17.694 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../029-libradosstriper1_19.3.0-4907-ga2782315-1jammy_amd64.deb ... 2024-09-14T11:05:17.734 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking libradosstriper1 (19.3.0-4907-ga2782315-1jammy) ... 2024-09-14T11:05:17.825 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package ceph-base. 2024-09-14T11:05:17.852 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../031-ceph-base_19.3.0-4907-ga2782315-1jammy_amd64.deb ... 2024-09-14T11:05:17.901 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking ceph-base (19.3.0-4907-ga2782315-1jammy) ... 2024-09-14T11:05:18.146 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package ceph-common. 2024-09-14T11:05:18.173 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../030-ceph-common_19.3.0-4907-ga2782315-1jammy_amd64.deb ... 2024-09-14T11:05:18.212 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking ceph-common (19.3.0-4907-ga2782315-1jammy) ... 2024-09-14T11:05:18.480 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package python3-jaraco.functools. 2024-09-14T11:05:18.506 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../032-python3-jaraco.functools_3.4.0-2_all.deb ... 2024-09-14T11:05:18.546 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking python3-jaraco.functools (3.4.0-2) ... 2024-09-14T11:05:18.949 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package python3-cheroot. 2024-09-14T11:05:18.975 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../033-python3-cheroot_8.5.2+ds1-1ubuntu3.1_all.deb ... 2024-09-14T11:05:19.016 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking python3-cheroot (8.5.2+ds1-1ubuntu3.1) ... 2024-09-14T11:05:19.335 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package python3-jaraco.classes. 2024-09-14T11:05:19.362 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../034-python3-jaraco.classes_3.2.1-3_all.deb ... 2024-09-14T11:05:19.411 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking python3-jaraco.classes (3.2.1-3) ... 2024-09-14T11:05:19.672 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package python3-jaraco.text. 2024-09-14T11:05:19.698 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../035-python3-jaraco.text_3.6.0-2_all.deb ... 2024-09-14T11:05:19.738 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking python3-jaraco.text (3.6.0-2) ... 2024-09-14T11:05:19.952 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package ceph-base. 2024-09-14T11:05:19.979 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../031-ceph-base_19.3.0-4907-ga2782315-1jammy_amd64.deb ... 2024-09-14T11:05:20.037 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking ceph-base (19.3.0-4907-ga2782315-1jammy) ... 2024-09-14T11:05:20.041 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package python3-jaraco.collections. 2024-09-14T11:05:20.068 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../036-python3-jaraco.collections_3.4.0-2_all.deb ... 2024-09-14T11:05:20.107 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking python3-jaraco.collections (3.4.0-2) ... 2024-09-14T11:05:20.411 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package python3-tempora. 2024-09-14T11:05:20.437 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../037-python3-tempora_4.1.2-1_all.deb ... 2024-09-14T11:05:20.477 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking python3-tempora (4.1.2-1) ... 2024-09-14T11:05:20.641 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package python3-jaraco.functools. 2024-09-14T11:05:20.667 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../032-python3-jaraco.functools_3.4.0-2_all.deb ... 2024-09-14T11:05:20.716 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking python3-jaraco.functools (3.4.0-2) ... 2024-09-14T11:05:20.772 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package python3-portend. 2024-09-14T11:05:20.799 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../038-python3-portend_3.0.0-1_all.deb ... 2024-09-14T11:05:20.830 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking python3-portend (3.0.0-1) ... 2024-09-14T11:05:21.052 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package python3-cheroot. 2024-09-14T11:05:21.079 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../033-python3-cheroot_8.5.2+ds1-1ubuntu3.1_all.deb ... 2024-09-14T11:05:21.125 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package python3-zc.lockfile. 2024-09-14T11:05:21.127 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking python3-cheroot (8.5.2+ds1-1ubuntu3.1) ... 2024-09-14T11:05:21.152 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../039-python3-zc.lockfile_2.0-1_all.deb ... 2024-09-14T11:05:21.191 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking python3-zc.lockfile (2.0-1) ... 2024-09-14T11:05:21.503 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package python3-cherrypy3. 2024-09-14T11:05:21.523 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package python3-jaraco.classes. 2024-09-14T11:05:21.529 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../040-python3-cherrypy3_18.6.1-4_all.deb ... 2024-09-14T11:05:21.549 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../034-python3-jaraco.classes_3.2.1-3_all.deb ... 2024-09-14T11:05:21.569 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking python3-cherrypy3 (18.6.1-4) ... 2024-09-14T11:05:21.598 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking python3-jaraco.classes (3.2.1-3) ... 2024-09-14T11:05:21.923 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package python3-natsort. 2024-09-14T11:05:21.934 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package python3-jaraco.text. 2024-09-14T11:05:21.950 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../041-python3-natsort_8.0.2-1_all.deb ... 2024-09-14T11:05:21.961 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../035-python3-jaraco.text_3.6.0-2_all.deb ... 2024-09-14T11:05:21.989 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking python3-natsort (8.0.2-1) ... 2024-09-14T11:05:22.000 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking python3-jaraco.text (3.6.0-2) ... 2024-09-14T11:05:22.287 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package python3-jaraco.collections. 2024-09-14T11:05:22.301 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package python3-logutils. 2024-09-14T11:05:22.314 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../036-python3-jaraco.collections_3.4.0-2_all.deb ... 2024-09-14T11:05:22.328 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../042-python3-logutils_0.3.3-8_all.deb ... 2024-09-14T11:05:22.354 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking python3-jaraco.collections (3.4.0-2) ... 2024-09-14T11:05:22.367 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking python3-logutils (0.3.3-8) ... 2024-09-14T11:05:22.670 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package python3-markupsafe. 2024-09-14T11:05:22.697 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../043-python3-markupsafe_2.0.1-2build1_amd64.deb ... 2024-09-14T11:05:22.707 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package python3-tempora. 2024-09-14T11:05:22.734 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../037-python3-tempora_4.1.2-1_all.deb ... 2024-09-14T11:05:22.737 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking python3-markupsafe (2.0.1-2build1) ... 2024-09-14T11:05:22.791 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking python3-tempora (4.1.2-1) ... 2024-09-14T11:05:23.031 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package python3-mako. 2024-09-14T11:05:23.046 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../044-python3-mako_1.1.3+ds1-2ubuntu0.1_all.deb ... 2024-09-14T11:05:23.090 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking python3-mako (1.1.3+ds1-2ubuntu0.1) ... 2024-09-14T11:05:23.128 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package python3-portend. 2024-09-14T11:05:23.154 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../038-python3-portend_3.0.0-1_all.deb ... 2024-09-14T11:05:23.194 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking python3-portend (3.0.0-1) ... 2024-09-14T11:05:23.410 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package python3-simplegeneric. 2024-09-14T11:05:23.436 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../045-python3-simplegeneric_0.8.1-3_all.deb ... 2024-09-14T11:05:23.476 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking python3-simplegeneric (0.8.1-3) ... 2024-09-14T11:05:23.497 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package python3-zc.lockfile. 2024-09-14T11:05:23.524 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../039-python3-zc.lockfile_2.0-1_all.deb ... 2024-09-14T11:05:23.572 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking python3-zc.lockfile (2.0-1) ... 2024-09-14T11:05:23.779 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package python3-singledispatch. 2024-09-14T11:05:23.806 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../046-python3-singledispatch_3.4.0.3-3_all.deb ... 2024-09-14T11:05:23.846 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking python3-singledispatch (3.4.0.3-3) ... 2024-09-14T11:05:23.951 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package python3-cherrypy3. 2024-09-14T11:05:23.978 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../040-python3-cherrypy3_18.6.1-4_all.deb ... 2024-09-14T11:05:24.026 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking python3-cherrypy3 (18.6.1-4) ... 2024-09-14T11:05:24.149 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package python3-webob. 2024-09-14T11:05:24.175 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../047-python3-webob_1%3a1.8.6-1.1ubuntu0.1_all.deb ... 2024-09-14T11:05:24.215 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking python3-webob (1:1.8.6-1.1ubuntu0.1) ... 2024-09-14T11:05:24.397 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package python3-natsort. 2024-09-14T11:05:24.424 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../041-python3-natsort_8.0.2-1_all.deb ... 2024-09-14T11:05:24.463 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking python3-natsort (8.0.2-1) ... 2024-09-14T11:05:24.568 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package python3-waitress. 2024-09-14T11:05:24.595 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../048-python3-waitress_1.4.4-1.1ubuntu1_all.deb ... 2024-09-14T11:05:24.638 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking python3-waitress (1.4.4-1.1ubuntu1) ... 2024-09-14T11:05:24.930 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package python3-tempita. 2024-09-14T11:05:24.942 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package python3-logutils. 2024-09-14T11:05:24.956 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../049-python3-tempita_0.5.2-6ubuntu1_all.deb ... 2024-09-14T11:05:24.969 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../042-python3-logutils_0.3.3-8_all.deb ... 2024-09-14T11:05:24.996 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking python3-tempita (0.5.2-6ubuntu1) ... 2024-09-14T11:05:25.000 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking python3-logutils (0.3.3-8) ... 2024-09-14T11:05:25.295 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package python3-markupsafe. 2024-09-14T11:05:25.316 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package python3-paste. 2024-09-14T11:05:25.321 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../043-python3-markupsafe_2.0.1-2build1_amd64.deb ... 2024-09-14T11:05:25.342 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../050-python3-paste_3.5.0+dfsg1-1_all.deb ... 2024-09-14T11:05:25.362 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking python3-markupsafe (2.0.1-2build1) ... 2024-09-14T11:05:25.382 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking python3-paste (3.5.0+dfsg1-1) ... 2024-09-14T11:05:25.665 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package python3-mako. 2024-09-14T11:05:25.691 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../044-python3-mako_1.1.3+ds1-2ubuntu0.1_all.deb ... 2024-09-14T11:05:25.694 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package python-pastedeploy-tpl. 2024-09-14T11:05:25.709 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../051-python-pastedeploy-tpl_2.1.1-1_all.deb ... 2024-09-14T11:05:25.731 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking python3-mako (1.1.3+ds1-2ubuntu0.1) ... 2024-09-14T11:05:25.743 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking python-pastedeploy-tpl (2.1.1-1) ... 2024-09-14T11:05:26.047 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package python3-pastedeploy. 2024-09-14T11:05:26.073 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../052-python3-pastedeploy_2.1.1-1_all.deb ... 2024-09-14T11:05:26.086 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package python3-simplegeneric. 2024-09-14T11:05:26.112 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../045-python3-simplegeneric_0.8.1-3_all.deb ... 2024-09-14T11:05:26.113 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking python3-pastedeploy (2.1.1-1) ... 2024-09-14T11:05:26.152 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking python3-simplegeneric (0.8.1-3) ... 2024-09-14T11:05:26.408 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package python3-webtest. 2024-09-14T11:05:26.431 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package python3-singledispatch. 2024-09-14T11:05:26.434 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../053-python3-webtest_2.0.35-1_all.deb ... 2024-09-14T11:05:26.457 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../046-python3-singledispatch_3.4.0.3-3_all.deb ... 2024-09-14T11:05:26.474 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking python3-webtest (2.0.35-1) ... 2024-09-14T11:05:26.497 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking python3-singledispatch (3.4.0.3-3) ... 2024-09-14T11:05:26.786 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package python3-pecan. 2024-09-14T11:05:26.800 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package python3-webob. 2024-09-14T11:05:26.812 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../054-python3-pecan_1.3.3-4ubuntu2_all.deb ... 2024-09-14T11:05:26.827 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../047-python3-webob_1%3a1.8.6-1.1ubuntu0.1_all.deb ... 2024-09-14T11:05:26.852 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking python3-pecan (1.3.3-4ubuntu2) ... 2024-09-14T11:05:26.867 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking python3-webob (1:1.8.6-1.1ubuntu0.1) ... 2024-09-14T11:05:27.201 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package python3-certifi. 2024-09-14T11:05:27.220 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package python3-waitress. 2024-09-14T11:05:27.228 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../055-python3-certifi_2020.6.20-1_all.deb ... 2024-09-14T11:05:27.247 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../048-python3-waitress_1.4.4-1.1ubuntu1_all.deb ... 2024-09-14T11:05:27.267 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking python3-certifi (2020.6.20-1) ... 2024-09-14T11:05:27.291 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking python3-waitress (1.4.4-1.1ubuntu1) ... 2024-09-14T11:05:27.587 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package python3-idna. 2024-09-14T11:05:27.607 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package python3-tempita. 2024-09-14T11:05:27.614 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../056-python3-idna_3.3-1ubuntu0.1_all.deb ... 2024-09-14T11:05:27.633 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../049-python3-tempita_0.5.2-6ubuntu1_all.deb ... 2024-09-14T11:05:27.653 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking python3-idna (3.3-1ubuntu0.1) ... 2024-09-14T11:05:27.674 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking python3-tempita (0.5.2-6ubuntu1) ... 2024-09-14T11:05:27.952 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package python3-paste. 2024-09-14T11:05:27.965 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package python3-urllib3. 2024-09-14T11:05:27.978 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../050-python3-paste_3.5.0+dfsg1-1_all.deb ... 2024-09-14T11:05:27.992 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../057-python3-urllib3_1.26.5-1~exp1ubuntu0.1_all.deb ... 2024-09-14T11:05:28.019 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking python3-paste (3.5.0+dfsg1-1) ... 2024-09-14T11:05:28.031 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking python3-urllib3 (1.26.5-1~exp1ubuntu0.1) ... 2024-09-14T11:05:29.315 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package python-pastedeploy-tpl. 2024-09-14T11:05:29.331 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../051-python-pastedeploy-tpl_2.1.1-1_all.deb ... 2024-09-14T11:05:29.365 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking python-pastedeploy-tpl (2.1.1-1) ... 2024-09-14T11:05:29.419 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package python3-requests. 2024-09-14T11:05:29.446 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../058-python3-requests_2.25.1+dfsg-2ubuntu0.1_all.deb ... 2024-09-14T11:05:29.476 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking python3-requests (2.25.1+dfsg-2ubuntu0.1) ... 2024-09-14T11:05:29.652 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package python3-pastedeploy. 2024-09-14T11:05:29.679 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../052-python3-pastedeploy_2.1.1-1_all.deb ... 2024-09-14T11:05:29.718 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking python3-pastedeploy (2.1.1-1) ... 2024-09-14T11:05:29.788 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package python3-werkzeug. 2024-09-14T11:05:29.814 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../059-python3-werkzeug_2.0.2+dfsg1-1ubuntu0.22.04.2_all.deb ... 2024-09-14T11:05:29.854 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking python3-werkzeug (2.0.2+dfsg1-1ubuntu0.22.04.2) ... 2024-09-14T11:05:30.030 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package python3-webtest. 2024-09-14T11:05:30.057 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../053-python3-webtest_2.0.35-1_all.deb ... 2024-09-14T11:05:30.097 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking python3-webtest (2.0.35-1) ... 2024-09-14T11:05:30.149 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package ceph-mgr-modules-core. 2024-09-14T11:05:30.165 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../060-ceph-mgr-modules-core_19.3.0-4907-ga2782315-1jammy_all.deb ... 2024-09-14T11:05:30.207 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking ceph-mgr-modules-core (19.3.0-4907-ga2782315-1jammy) ... 2024-09-14T11:05:30.409 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package python3-pecan. 2024-09-14T11:05:30.435 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../054-python3-pecan_1.3.3-4ubuntu2_all.deb ... 2024-09-14T11:05:30.475 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking python3-pecan (1.3.3-4ubuntu2) ... 2024-09-14T11:05:30.587 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package libsqlite3-mod-ceph. 2024-09-14T11:05:30.614 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../061-libsqlite3-mod-ceph_19.3.0-4907-ga2782315-1jammy_amd64.deb ... 2024-09-14T11:05:30.654 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking libsqlite3-mod-ceph (19.3.0-4907-ga2782315-1jammy) ... 2024-09-14T11:05:30.814 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package python3-certifi. 2024-09-14T11:05:30.841 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../055-python3-certifi_2020.6.20-1_all.deb ... 2024-09-14T11:05:30.881 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking python3-certifi (2020.6.20-1) ... 2024-09-14T11:05:30.965 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package python3-bcrypt. 2024-09-14T11:05:30.992 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../062-python3-bcrypt_3.2.0-1build1_amd64.deb ... 2024-09-14T11:05:31.032 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking python3-bcrypt (3.2.0-1build1) ... 2024-09-14T11:05:31.201 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package python3-idna. 2024-09-14T11:05:31.228 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../056-python3-idna_3.3-1ubuntu0.1_all.deb ... 2024-09-14T11:05:31.268 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking python3-idna (3.3-1ubuntu0.1) ... 2024-09-14T11:05:31.335 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package python3-openssl. 2024-09-14T11:05:31.361 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../063-python3-openssl_21.0.0-1_all.deb ... 2024-09-14T11:05:31.401 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking python3-openssl (21.0.0-1) ... 2024-09-14T11:05:31.588 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package python3-urllib3. 2024-09-14T11:05:31.614 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../057-python3-urllib3_1.26.5-1~exp1ubuntu0.1_all.deb ... 2024-09-14T11:05:31.654 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking python3-urllib3 (1.26.5-1~exp1ubuntu0.1) ... 2024-09-14T11:05:31.746 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package ceph-mgr. 2024-09-14T11:05:31.773 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../064-ceph-mgr_19.3.0-4907-ga2782315-1jammy_amd64.deb ... 2024-09-14T11:05:31.812 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking ceph-mgr (19.3.0-4907-ga2782315-1jammy) ... 2024-09-14T11:05:31.958 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package python3-requests. 2024-09-14T11:05:31.984 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../058-python3-requests_2.25.1+dfsg-2ubuntu0.1_all.deb ... 2024-09-14T11:05:32.024 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking python3-requests (2.25.1+dfsg-2ubuntu0.1) ... 2024-09-14T11:05:32.208 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package ceph-mon. 2024-09-14T11:05:32.234 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../065-ceph-mon_19.3.0-4907-ga2782315-1jammy_amd64.deb ... 2024-09-14T11:05:32.274 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking ceph-mon (19.3.0-4907-ga2782315-1jammy) ... 2024-09-14T11:05:32.336 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package python3-werkzeug. 2024-09-14T11:05:32.363 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../059-python3-werkzeug_2.0.2+dfsg1-1ubuntu0.22.04.2_all.deb ... 2024-09-14T11:05:32.403 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking python3-werkzeug (2.0.2+dfsg1-1ubuntu0.22.04.2) ... 2024-09-14T11:05:32.698 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package ceph-mgr-modules-core. 2024-09-14T11:05:32.713 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../060-ceph-mgr-modules-core_19.3.0-4907-ga2782315-1jammy_all.deb ... 2024-09-14T11:05:32.756 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking ceph-mgr-modules-core (19.3.0-4907-ga2782315-1jammy) ... 2024-09-14T11:05:32.894 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package ceph-osd. 2024-09-14T11:05:32.921 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../066-ceph-osd_19.3.0-4907-ga2782315-1jammy_amd64.deb ... 2024-09-14T11:05:32.960 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking ceph-osd (19.3.0-4907-ga2782315-1jammy) ... 2024-09-14T11:05:33.104 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package libsqlite3-mod-ceph. 2024-09-14T11:05:33.131 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../061-libsqlite3-mod-ceph_19.3.0-4907-ga2782315-1jammy_amd64.deb ... 2024-09-14T11:05:33.170 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking libsqlite3-mod-ceph (19.3.0-4907-ga2782315-1jammy) ... 2024-09-14T11:05:33.490 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package python3-bcrypt. 2024-09-14T11:05:33.517 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../062-python3-bcrypt_3.2.0-1build1_amd64.deb ... 2024-09-14T11:05:33.574 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking python3-bcrypt (3.2.0-1build1) ... 2024-09-14T11:05:33.885 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package python3-openssl. 2024-09-14T11:05:33.913 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../063-python3-openssl_21.0.0-1_all.deb ... 2024-09-14T11:05:33.952 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking python3-openssl (21.0.0-1) ... 2024-09-14T11:05:33.997 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package ceph. 2024-09-14T11:05:34.024 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../067-ceph_19.3.0-4907-ga2782315-1jammy_amd64.deb ... 2024-09-14T11:05:34.064 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking ceph (19.3.0-4907-ga2782315-1jammy) ... 2024-09-14T11:05:34.247 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package ceph-mgr. 2024-09-14T11:05:34.274 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../064-ceph-mgr_19.3.0-4907-ga2782315-1jammy_amd64.deb ... 2024-09-14T11:05:34.313 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking ceph-mgr (19.3.0-4907-ga2782315-1jammy) ... 2024-09-14T11:05:34.458 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package ceph-fuse. 2024-09-14T11:05:34.485 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../068-ceph-fuse_19.3.0-4907-ga2782315-1jammy_amd64.deb ... 2024-09-14T11:05:34.524 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking ceph-fuse (19.3.0-4907-ga2782315-1jammy) ... 2024-09-14T11:05:34.759 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package ceph-mon. 2024-09-14T11:05:34.786 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../065-ceph-mon_19.3.0-4907-ga2782315-1jammy_amd64.deb ... 2024-09-14T11:05:34.825 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking ceph-mon (19.3.0-4907-ga2782315-1jammy) ... 2024-09-14T11:05:34.903 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package ceph-mds. 2024-09-14T11:05:34.929 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../069-ceph-mds_19.3.0-4907-ga2782315-1jammy_amd64.deb ... 2024-09-14T11:05:34.969 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking ceph-mds (19.3.0-4907-ga2782315-1jammy) ... 2024-09-14T11:05:35.347 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package cephadm. 2024-09-14T11:05:35.374 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../070-cephadm_19.3.0-4907-ga2782315-1jammy_amd64.deb ... 2024-09-14T11:05:35.405 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking cephadm (19.3.0-4907-ga2782315-1jammy) ... 2024-09-14T11:05:35.580 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package ceph-osd. 2024-09-14T11:05:35.607 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../066-ceph-osd_19.3.0-4907-ga2782315-1jammy_amd64.deb ... 2024-09-14T11:05:35.646 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking ceph-osd (19.3.0-4907-ga2782315-1jammy) ... 2024-09-14T11:05:35.708 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package python3-asyncssh. 2024-09-14T11:05:35.735 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../071-python3-asyncssh_2.5.0-1_all.deb ... 2024-09-14T11:05:35.774 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking python3-asyncssh (2.5.0-1) ... 2024-09-14T11:05:36.085 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package python-babel-localedata. 2024-09-14T11:05:36.101 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../072-python-babel-localedata_2.8.0+dfsg.1-7_all.deb ... 2024-09-14T11:05:36.135 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking python-babel-localedata (2.8.0+dfsg.1-7) ... 2024-09-14T11:05:36.733 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package ceph. 2024-09-14T11:05:36.749 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../067-ceph_19.3.0-4907-ga2782315-1jammy_amd64.deb ... 2024-09-14T11:05:36.800 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking ceph (19.3.0-4907-ga2782315-1jammy) ... 2024-09-14T11:05:37.120 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package ceph-fuse. 2024-09-14T11:05:37.147 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../068-ceph-fuse_19.3.0-4907-ga2782315-1jammy_amd64.deb ... 2024-09-14T11:05:37.149 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package python3-babel. 2024-09-14T11:05:37.177 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../073-python3-babel_2.8.0+dfsg.1-7_all.deb ... 2024-09-14T11:05:37.186 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking ceph-fuse (19.3.0-4907-ga2782315-1jammy) ... 2024-09-14T11:05:37.216 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking python3-babel (2.8.0+dfsg.1-7) ... 2024-09-14T11:05:37.518 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package python3-jinja2. 2024-09-14T11:05:37.540 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package ceph-mds. 2024-09-14T11:05:37.545 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../074-python3-jinja2_3.0.3-1ubuntu0.2_all.deb ... 2024-09-14T11:05:37.567 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../069-ceph-mds_19.3.0-4907-ga2782315-1jammy_amd64.deb ... 2024-09-14T11:05:37.585 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking python3-jinja2 (3.0.3-1ubuntu0.2) ... 2024-09-14T11:05:37.606 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking ceph-mds (19.3.0-4907-ga2782315-1jammy) ... 2024-09-14T11:05:37.921 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package ceph-mgr-cephadm. 2024-09-14T11:05:37.948 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../075-ceph-mgr-cephadm_19.3.0-4907-ga2782315-1jammy_all.deb ... 2024-09-14T11:05:37.979 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking ceph-mgr-cephadm (19.3.0-4907-ga2782315-1jammy) ... 2024-09-14T11:05:38.010 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package cephadm. 2024-09-14T11:05:38.037 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../070-cephadm_19.3.0-4907-ga2782315-1jammy_amd64.deb ... 2024-09-14T11:05:38.077 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking cephadm (19.3.0-4907-ga2782315-1jammy) ... 2024-09-14T11:05:38.333 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package python3-repoze.lru. 2024-09-14T11:05:38.361 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../076-python3-repoze.lru_0.7-2_all.deb ... 2024-09-14T11:05:38.396 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package python3-asyncssh. 2024-09-14T11:05:38.399 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking python3-repoze.lru (0.7-2) ... 2024-09-14T11:05:38.423 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../071-python3-asyncssh_2.5.0-1_all.deb ... 2024-09-14T11:05:38.463 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking python3-asyncssh (2.5.0-1) ... 2024-09-14T11:05:38.702 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package python3-routes. 2024-09-14T11:05:38.730 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../077-python3-routes_2.5.1-1ubuntu1_all.deb ... 2024-09-14T11:05:38.769 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking python3-routes (2.5.1-1ubuntu1) ... 2024-09-14T11:05:38.791 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package python-babel-localedata. 2024-09-14T11:05:38.818 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../072-python-babel-localedata_2.8.0+dfsg.1-7_all.deb ... 2024-09-14T11:05:38.858 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking python-babel-localedata (2.8.0+dfsg.1-7) ... 2024-09-14T11:05:39.097 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package ceph-mgr-dashboard. 2024-09-14T11:05:39.125 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../078-ceph-mgr-dashboard_19.3.0-4907-ga2782315-1jammy_all.deb ... 2024-09-14T11:05:39.164 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking ceph-mgr-dashboard (19.3.0-4907-ga2782315-1jammy) ... 2024-09-14T11:05:39.897 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package python3-babel. 2024-09-14T11:05:39.925 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../073-python3-babel_2.8.0+dfsg.1-7_all.deb ... 2024-09-14T11:05:39.963 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking python3-babel (2.8.0+dfsg.1-7) ... 2024-09-14T11:05:40.275 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package python3-jinja2. 2024-09-14T11:05:40.302 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../074-python3-jinja2_3.0.3-1ubuntu0.2_all.deb ... 2024-09-14T11:05:40.350 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking python3-jinja2 (3.0.3-1ubuntu0.2) ... 2024-09-14T11:05:40.713 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package ceph-mgr-cephadm. 2024-09-14T11:05:40.739 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../075-ceph-mgr-cephadm_19.3.0-4907-ga2782315-1jammy_all.deb ... 2024-09-14T11:05:40.770 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking ceph-mgr-cephadm (19.3.0-4907-ga2782315-1jammy) ... 2024-09-14T11:05:41.108 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package python3-repoze.lru. 2024-09-14T11:05:41.135 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../076-python3-repoze.lru_0.7-2_all.deb ... 2024-09-14T11:05:41.174 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking python3-repoze.lru (0.7-2) ... 2024-09-14T11:05:41.453 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package python3-routes. 2024-09-14T11:05:41.480 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../077-python3-routes_2.5.1-1ubuntu1_all.deb ... 2024-09-14T11:05:41.519 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking python3-routes (2.5.1-1ubuntu1) ... 2024-09-14T11:05:41.831 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package ceph-mgr-dashboard. 2024-09-14T11:05:41.858 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../078-ceph-mgr-dashboard_19.3.0-4907-ga2782315-1jammy_all.deb ... 2024-09-14T11:05:41.889 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking ceph-mgr-dashboard (19.3.0-4907-ga2782315-1jammy) ... 2024-09-14T11:05:41.927 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package python3-sklearn-lib:amd64. 2024-09-14T11:05:41.957 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../079-python3-sklearn-lib_0.23.2-5ubuntu6_amd64.deb ... 2024-09-14T11:05:42.002 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking python3-sklearn-lib:amd64 (0.23.2-5ubuntu6) ... 2024-09-14T11:05:42.489 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package python3-joblib. 2024-09-14T11:05:42.516 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../080-python3-joblib_0.17.0-4ubuntu1_all.deb ... 2024-09-14T11:05:42.555 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking python3-joblib (0.17.0-4ubuntu1) ... 2024-09-14T11:05:42.926 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package python3-threadpoolctl. 2024-09-14T11:05:42.953 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../081-python3-threadpoolctl_3.1.0-1_all.deb ... 2024-09-14T11:05:42.992 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking python3-threadpoolctl (3.1.0-1) ... 2024-09-14T11:05:43.295 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package python3-sklearn. 2024-09-14T11:05:43.322 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../082-python3-sklearn_0.23.2-5ubuntu6_all.deb ... 2024-09-14T11:05:43.447 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking python3-sklearn (0.23.2-5ubuntu6) ... 2024-09-14T11:05:44.131 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package ceph-mgr-diskprediction-local. 2024-09-14T11:05:44.160 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../083-ceph-mgr-diskprediction-local_19.3.0-4907-ga2782315-1jammy_all.deb ... 2024-09-14T11:05:44.189 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking ceph-mgr-diskprediction-local (19.3.0-4907-ga2782315-1jammy) ... 2024-09-14T11:05:44.689 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package python3-sklearn-lib:amd64. 2024-09-14T11:05:44.718 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../079-python3-sklearn-lib_0.23.2-5ubuntu6_amd64.deb ... 2024-09-14T11:05:44.755 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking python3-sklearn-lib:amd64 (0.23.2-5ubuntu6) ... 2024-09-14T11:05:45.143 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package python3-cachetools. 2024-09-14T11:05:45.159 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../084-python3-cachetools_5.0.0-1_all.deb ... 2024-09-14T11:05:45.204 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking python3-cachetools (5.0.0-1) ... 2024-09-14T11:05:45.235 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package python3-joblib. 2024-09-14T11:05:45.262 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../080-python3-joblib_0.17.0-4ubuntu1_all.deb ... 2024-09-14T11:05:45.301 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking python3-joblib (0.17.0-4ubuntu1) ... 2024-09-14T11:05:45.487 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package python3-pyasn1. 2024-09-14T11:05:45.515 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../085-python3-pyasn1_0.4.8-1_all.deb ... 2024-09-14T11:05:45.553 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking python3-pyasn1 (0.4.8-1) ... 2024-09-14T11:05:45.864 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package python3-threadpoolctl. 2024-09-14T11:05:45.891 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package python3-pyasn1-modules. 2024-09-14T11:05:45.891 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../081-python3-threadpoolctl_3.1.0-1_all.deb ... 2024-09-14T11:05:45.919 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../086-python3-pyasn1-modules_0.2.1-1_all.deb ... 2024-09-14T11:05:45.921 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking python3-threadpoolctl (3.1.0-1) ... 2024-09-14T11:05:45.957 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking python3-pyasn1-modules (0.2.1-1) ... 2024-09-14T11:05:46.225 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package python3-sklearn. 2024-09-14T11:05:46.252 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../082-python3-sklearn_0.23.2-5ubuntu6_all.deb ... 2024-09-14T11:05:46.268 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package python3-rsa. 2024-09-14T11:05:46.296 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../087-python3-rsa_4.8-1_all.deb ... 2024-09-14T11:05:46.335 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking python3-rsa (4.8-1) ... 2024-09-14T11:05:46.386 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking python3-sklearn (0.23.2-5ubuntu6) ... 2024-09-14T11:05:46.655 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package python3-google-auth. 2024-09-14T11:05:46.683 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../088-python3-google-auth_1.5.1-3_all.deb ... 2024-09-14T11:05:46.722 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking python3-google-auth (1.5.1-3) ... 2024-09-14T11:05:47.042 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package python3-requests-oauthlib. 2024-09-14T11:05:47.070 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../089-python3-requests-oauthlib_1.3.0+ds-0.1_all.deb ... 2024-09-14T11:05:47.105 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package ceph-mgr-diskprediction-local. 2024-09-14T11:05:47.108 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking python3-requests-oauthlib (1.3.0+ds-0.1) ... 2024-09-14T11:05:47.133 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../083-ceph-mgr-diskprediction-local_19.3.0-4907-ga2782315-1jammy_all.deb ... 2024-09-14T11:05:47.171 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking ceph-mgr-diskprediction-local (19.3.0-4907-ga2782315-1jammy) ... 2024-09-14T11:05:47.420 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package python3-websocket. 2024-09-14T11:05:47.448 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../090-python3-websocket_1.2.3-1_all.deb ... 2024-09-14T11:05:47.478 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking python3-websocket (1.2.3-1) ... 2024-09-14T11:05:47.773 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package python3-kubernetes. 2024-09-14T11:05:47.801 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../091-python3-kubernetes_12.0.1-1ubuntu1_all.deb ... 2024-09-14T11:05:47.831 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking python3-kubernetes (12.0.1-1ubuntu1) ... 2024-09-14T11:05:48.128 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package python3-cachetools. 2024-09-14T11:05:48.153 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../084-python3-cachetools_5.0.0-1_all.deb ... 2024-09-14T11:05:48.183 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking python3-cachetools (5.0.0-1) ... 2024-09-14T11:05:48.428 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package ceph-mgr-k8sevents. 2024-09-14T11:05:48.445 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../092-ceph-mgr-k8sevents_19.3.0-4907-ga2782315-1jammy_all.deb ... 2024-09-14T11:05:48.486 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking ceph-mgr-k8sevents (19.3.0-4907-ga2782315-1jammy) ... 2024-09-14T11:05:48.487 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package python3-pyasn1. 2024-09-14T11:05:48.514 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../085-python3-pyasn1_0.4.8-1_all.deb ... 2024-09-14T11:05:48.553 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking python3-pyasn1 (0.4.8-1) ... 2024-09-14T11:05:48.781 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package libonig5:amd64. 2024-09-14T11:05:48.809 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../093-libonig5_6.9.7.1-2build1_amd64.deb ... 2024-09-14T11:05:48.848 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking libonig5:amd64 (6.9.7.1-2build1) ... 2024-09-14T11:05:48.899 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package python3-pyasn1-modules. 2024-09-14T11:05:48.927 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../086-python3-pyasn1-modules_0.2.1-1_all.deb ... 2024-09-14T11:05:48.966 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking python3-pyasn1-modules (0.2.1-1) ... 2024-09-14T11:05:49.184 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package libjq1:amd64. 2024-09-14T11:05:49.212 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../094-libjq1_1.6-2.1ubuntu3_amd64.deb ... 2024-09-14T11:05:49.250 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking libjq1:amd64 (1.6-2.1ubuntu3) ... 2024-09-14T11:05:49.286 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package python3-rsa. 2024-09-14T11:05:49.314 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../087-python3-rsa_4.8-1_all.deb ... 2024-09-14T11:05:49.352 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking python3-rsa (4.8-1) ... 2024-09-14T11:05:49.528 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package jq. 2024-09-14T11:05:49.544 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../095-jq_1.6-2.1ubuntu3_amd64.deb ... 2024-09-14T11:05:49.586 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking jq (1.6-2.1ubuntu3) ... 2024-09-14T11:05:49.624 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package python3-google-auth. 2024-09-14T11:05:49.652 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../088-python3-google-auth_1.5.1-3_all.deb ... 2024-09-14T11:05:49.721 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking python3-google-auth (1.5.1-3) ... 2024-09-14T11:05:49.964 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package socat. 2024-09-14T11:05:49.981 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../096-socat_1.7.4.1-3ubuntu4_amd64.deb ... 2024-09-14T11:05:50.014 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking socat (1.7.4.1-3ubuntu4) ... 2024-09-14T11:05:50.111 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package python3-requests-oauthlib. 2024-09-14T11:05:50.138 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../089-python3-requests-oauthlib_1.3.0+ds-0.1_all.deb ... 2024-09-14T11:05:50.177 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking python3-requests-oauthlib (1.3.0+ds-0.1) ... 2024-09-14T11:05:50.292 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package xmlstarlet. 2024-09-14T11:05:50.309 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../097-xmlstarlet_1.6.1-2.1_amd64.deb ... 2024-09-14T11:05:50.350 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking xmlstarlet (1.6.1-2.1) ... 2024-09-14T11:05:50.464 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package python3-websocket. 2024-09-14T11:05:50.491 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../090-python3-websocket_1.2.3-1_all.deb ... 2024-09-14T11:05:50.531 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking python3-websocket (1.2.3-1) ... 2024-09-14T11:05:50.696 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package ceph-test. 2024-09-14T11:05:50.712 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../098-ceph-test_19.3.0-4907-ga2782315-1jammy_amd64.deb ... 2024-09-14T11:05:50.754 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking ceph-test (19.3.0-4907-ga2782315-1jammy) ... 2024-09-14T11:05:50.834 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package python3-kubernetes. 2024-09-14T11:05:50.862 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../091-python3-kubernetes_12.0.1-1ubuntu1_all.deb ... 2024-09-14T11:05:50.903 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking python3-kubernetes (12.0.1-1ubuntu1) ... 2024-09-14T11:05:51.693 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package ceph-mgr-k8sevents. 2024-09-14T11:05:51.709 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../092-ceph-mgr-k8sevents_19.3.0-4907-ga2782315-1jammy_all.deb ... 2024-09-14T11:05:51.743 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking ceph-mgr-k8sevents (19.3.0-4907-ga2782315-1jammy) ... 2024-09-14T11:05:52.071 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package libonig5:amd64. 2024-09-14T11:05:52.099 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../093-libonig5_6.9.7.1-2build1_amd64.deb ... 2024-09-14T11:05:52.137 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking libonig5:amd64 (6.9.7.1-2build1) ... 2024-09-14T11:05:52.458 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package libjq1:amd64. 2024-09-14T11:05:52.485 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../094-libjq1_1.6-2.1ubuntu3_amd64.deb ... 2024-09-14T11:05:52.524 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking libjq1:amd64 (1.6-2.1ubuntu3) ... 2024-09-14T11:05:52.752 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package jq. 2024-09-14T11:05:52.768 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../095-jq_1.6-2.1ubuntu3_amd64.deb ... 2024-09-14T11:05:52.802 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking jq (1.6-2.1ubuntu3) ... 2024-09-14T11:05:53.065 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package socat. 2024-09-14T11:05:53.092 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../096-socat_1.7.4.1-3ubuntu4_amd64.deb ... 2024-09-14T11:05:53.131 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking socat (1.7.4.1-3ubuntu4) ... 2024-09-14T11:05:53.267 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package ceph-volume. 2024-09-14T11:05:53.284 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../099-ceph-volume_19.3.0-4907-ga2782315-1jammy_all.deb ... 2024-09-14T11:05:53.317 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking ceph-volume (19.3.0-4907-ga2782315-1jammy) ... 2024-09-14T11:05:53.443 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package xmlstarlet. 2024-09-14T11:05:53.459 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../097-xmlstarlet_1.6.1-2.1_amd64.deb ... 2024-09-14T11:05:53.501 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking xmlstarlet (1.6.1-2.1) ... 2024-09-14T11:05:53.604 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package libcephfs-dev. 2024-09-14T11:05:53.621 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../100-libcephfs-dev_19.3.0-4907-ga2782315-1jammy_amd64.deb ... 2024-09-14T11:05:53.663 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking libcephfs-dev (19.3.0-4907-ga2782315-1jammy) ... 2024-09-14T11:05:53.898 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package ceph-test. 2024-09-14T11:05:53.914 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../098-ceph-test_19.3.0-4907-ga2782315-1jammy_amd64.deb ... 2024-09-14T11:05:53.956 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking ceph-test (19.3.0-4907-ga2782315-1jammy) ... 2024-09-14T11:05:53.982 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package lua-socket:amd64. 2024-09-14T11:05:54.011 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../101-lua-socket_3.0~rc1+git+ac3201d-6_amd64.deb ... 2024-09-14T11:05:54.049 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking lua-socket:amd64 (3.0~rc1+git+ac3201d-6) ... 2024-09-14T11:05:54.387 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package lua-sec:amd64. 2024-09-14T11:05:54.415 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../102-lua-sec_1.0.2-1_amd64.deb ... 2024-09-14T11:05:54.453 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking lua-sec:amd64 (1.0.2-1) ... 2024-09-14T11:05:54.775 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package nvme-cli. 2024-09-14T11:05:54.803 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../103-nvme-cli_1.16-3ubuntu0.3_amd64.deb ... 2024-09-14T11:05:54.841 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking nvme-cli (1.16-3ubuntu0.3) ... 2024-09-14T11:05:55.221 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package pkg-config. 2024-09-14T11:05:55.250 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../104-pkg-config_0.29.2-1ubuntu3_amd64.deb ... 2024-09-14T11:05:55.279 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking pkg-config (0.29.2-1ubuntu3) ... 2024-09-14T11:05:55.541 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package python-asyncssh-doc. 2024-09-14T11:05:55.557 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../105-python-asyncssh-doc_2.5.0-1_all.deb ... 2024-09-14T11:05:55.599 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking python-asyncssh-doc (2.5.0-1) ... 2024-09-14T11:05:56.010 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package python3-iniconfig. 2024-09-14T11:05:56.039 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../106-python3-iniconfig_1.1.1-2_all.deb ... 2024-09-14T11:05:56.077 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking python3-iniconfig (1.1.1-2) ... 2024-09-14T11:05:56.379 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package python3-pastescript. 2024-09-14T11:05:56.396 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../107-python3-pastescript_2.0.2-4_all.deb ... 2024-09-14T11:05:56.438 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking python3-pastescript (2.0.2-4) ... 2024-09-14T11:05:56.494 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package ceph-volume. 2024-09-14T11:05:56.510 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../099-ceph-volume_19.3.0-4907-ga2782315-1jammy_all.deb ... 2024-09-14T11:05:56.544 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking ceph-volume (19.3.0-4907-ga2782315-1jammy) ... 2024-09-14T11:05:56.758 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package python3-pluggy. 2024-09-14T11:05:56.786 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../108-python3-pluggy_0.13.0-7.1_all.deb ... 2024-09-14T11:05:56.815 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package libcephfs-dev. 2024-09-14T11:05:56.824 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking python3-pluggy (0.13.0-7.1) ... 2024-09-14T11:05:56.832 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../100-libcephfs-dev_19.3.0-4907-ga2782315-1jammy_amd64.deb ... 2024-09-14T11:05:56.865 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking libcephfs-dev (19.3.0-4907-ga2782315-1jammy) ... 2024-09-14T11:05:57.136 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package python3-psutil. 2024-09-14T11:05:57.165 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../109-python3-psutil_5.9.0-1build1_amd64.deb ... 2024-09-14T11:05:57.177 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package lua-socket:amd64. 2024-09-14T11:05:57.194 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking python3-psutil (5.9.0-1build1) ... 2024-09-14T11:05:57.205 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../101-lua-socket_3.0~rc1+git+ac3201d-6_amd64.deb ... 2024-09-14T11:05:57.243 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking lua-socket:amd64 (3.0~rc1+git+ac3201d-6) ... 2024-09-14T11:05:57.539 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package python3-py. 2024-09-14T11:05:57.565 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package lua-sec:amd64. 2024-09-14T11:05:57.567 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../110-python3-py_1.10.0-1_all.deb ... 2024-09-14T11:05:57.593 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../102-lua-sec_1.0.2-1_amd64.deb ... 2024-09-14T11:05:57.614 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking python3-py (1.10.0-1) ... 2024-09-14T11:05:57.632 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking lua-sec:amd64 (1.0.2-1) ... 2024-09-14T11:05:57.926 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package python3-pygments. 2024-09-14T11:05:57.954 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../111-python3-pygments_2.11.2+dfsg-2_all.deb ... 2024-09-14T11:05:57.984 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking python3-pygments (2.11.2+dfsg-2) ... 2024-09-14T11:05:57.987 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package nvme-cli. 2024-09-14T11:05:58.014 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../103-nvme-cli_1.16-3ubuntu0.3_amd64.deb ... 2024-09-14T11:05:58.053 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking nvme-cli (1.16-3ubuntu0.3) ... 2024-09-14T11:05:58.413 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package python3-pyinotify. 2024-09-14T11:05:58.429 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../112-python3-pyinotify_0.9.6-1.3_all.deb ... 2024-09-14T11:05:58.463 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking python3-pyinotify (0.9.6-1.3) ... 2024-09-14T11:05:58.493 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package pkg-config. 2024-09-14T11:05:58.521 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../104-pkg-config_0.29.2-1ubuntu3_amd64.deb ... 2024-09-14T11:05:58.559 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking pkg-config (0.29.2-1ubuntu3) ... 2024-09-14T11:05:58.775 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package python3-toml. 2024-09-14T11:05:58.796 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package python-asyncssh-doc. 2024-09-14T11:05:58.802 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../113-python3-toml_0.10.2-1_all.deb ... 2024-09-14T11:05:58.812 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../105-python-asyncssh-doc_2.5.0-1_all.deb ... 2024-09-14T11:05:58.841 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking python3-toml (0.10.2-1) ... 2024-09-14T11:05:58.854 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking python-asyncssh-doc (2.5.0-1) ... 2024-09-14T11:05:59.144 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package python3-pytest. 2024-09-14T11:05:59.172 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../114-python3-pytest_6.2.5-1ubuntu2_all.deb ... 2024-09-14T11:05:59.210 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking python3-pytest (6.2.5-1ubuntu2) ... 2024-09-14T11:05:59.241 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package python3-iniconfig. 2024-09-14T11:05:59.269 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../106-python3-iniconfig_1.1.1-2_all.deb ... 2024-09-14T11:05:59.299 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking python3-iniconfig (1.1.1-2) ... 2024-09-14T11:05:59.564 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package python3-simplejson. 2024-09-14T11:05:59.592 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../115-python3-simplejson_3.17.6-1build1_amd64.deb ... 2024-09-14T11:05:59.602 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package python3-pastescript. 2024-09-14T11:05:59.630 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../107-python3-pastescript_2.0.2-4_all.deb ... 2024-09-14T11:05:59.639 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking python3-simplejson (3.17.6-1build1) ... 2024-09-14T11:05:59.690 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking python3-pastescript (2.0.2-4) ... 2024-09-14T11:05:59.908 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package qttranslations5-l10n. 2024-09-14T11:05:59.925 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../116-qttranslations5-l10n_5.15.3-1_all.deb ... 2024-09-14T11:05:59.967 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking qttranslations5-l10n (5.15.3-1) ... 2024-09-14T11:06:00.015 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package python3-pluggy. 2024-09-14T11:06:00.031 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../108-python3-pluggy_0.13.0-7.1_all.deb ... 2024-09-14T11:06:00.073 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking python3-pluggy (0.13.0-7.1) ... 2024-09-14T11:06:00.368 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package python3-psutil. 2024-09-14T11:06:00.396 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../109-python3-psutil_5.9.0-1build1_amd64.deb ... 2024-09-14T11:06:00.426 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking python3-psutil (5.9.0-1build1) ... 2024-09-14T11:06:00.696 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package radosgw. 2024-09-14T11:06:00.724 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../117-radosgw_19.3.0-4907-ga2782315-1jammy_amd64.deb ... 2024-09-14T11:06:00.730 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package python3-py. 2024-09-14T11:06:00.758 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../110-python3-py_1.10.0-1_all.deb ... 2024-09-14T11:06:00.762 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking radosgw (19.3.0-4907-ga2782315-1jammy) ... 2024-09-14T11:06:00.796 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking python3-py (1.10.0-1) ... 2024-09-14T11:06:01.075 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package python3-pygments. 2024-09-14T11:06:01.103 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../111-python3-pygments_2.11.2+dfsg-2_all.deb ... 2024-09-14T11:06:01.133 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking python3-pygments (2.11.2+dfsg-2) ... 2024-09-14T11:06:01.597 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package python3-pyinotify. 2024-09-14T11:06:01.626 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../112-python3-pyinotify_0.9.6-1.3_all.deb ... 2024-09-14T11:06:01.663 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking python3-pyinotify (0.9.6-1.3) ... 2024-09-14T11:06:01.691 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package rbd-fuse. 2024-09-14T11:06:01.707 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../118-rbd-fuse_19.3.0-4907-ga2782315-1jammy_amd64.deb ... 2024-09-14T11:06:01.749 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking rbd-fuse (19.3.0-4907-ga2782315-1jammy) ... 2024-09-14T11:06:01.983 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package python3-toml. 2024-09-14T11:06:02.011 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../113-python3-toml_0.10.2-1_all.deb ... 2024-09-14T11:06:02.027 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up python3-iniconfig (1.1.1-2) ... 2024-09-14T11:06:02.049 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking python3-toml (0.10.2-1) ... 2024-09-14T11:06:02.279 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up libdouble-conversion3:amd64 (3.1.7-4) ... 2024-09-14T11:06:02.311 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package python3-pytest. 2024-09-14T11:06:02.327 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../114-python3-pytest_6.2.5-1ubuntu2_all.deb ... 2024-09-14T11:06:02.361 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking python3-pytest (6.2.5-1ubuntu2) ... 2024-09-14T11:06:02.421 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up nvme-cli (1.16-3ubuntu0.3) ... 2024-09-14T11:06:02.708 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package python3-simplejson. 2024-09-14T11:06:02.708 INFO:teuthology.orchestra.run.smithi154.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmefc-boot-connections.service -> /lib/systemd/system/nvmefc-boot-connections.service. 2024-09-14T11:06:02.735 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../115-python3-simplejson_3.17.6-1build1_amd64.deb ... 2024-09-14T11:06:02.773 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking python3-simplejson (3.17.6-1build1) ... 2024-09-14T11:06:03.035 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package qttranslations5-l10n. 2024-09-14T11:06:03.052 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../116-qttranslations5-l10n_5.15.3-1_all.deb ... 2024-09-14T11:06:03.059 INFO:teuthology.orchestra.run.smithi154.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmf-autoconnect.service -> /lib/systemd/system/nvmf-autoconnect.service. 2024-09-14T11:06:03.085 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking qttranslations5-l10n (5.15.3-1) ... 2024-09-14T11:06:03.466 INFO:teuthology.orchestra.run.smithi154.stdout:nvmf-connect.target is a disabled or a static unit, not starting it. 2024-09-14T11:06:03.531 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up cephadm (19.3.0-4907-ga2782315-1jammy) ... 2024-09-14T11:06:03.831 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package radosgw. 2024-09-14T11:06:03.860 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../117-radosgw_19.3.0-4907-ga2782315-1jammy_amd64.deb ... 2024-09-14T11:06:03.898 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking radosgw (19.3.0-4907-ga2782315-1jammy) ... 2024-09-14T11:06:04.064 INFO:teuthology.orchestra.run.smithi154.stdout:Adding system user cephadm....done 2024-09-14T11:06:04.212 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up python3-waitress (1.4.4-1.1ubuntu1) ... 2024-09-14T11:06:04.497 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up python3-jaraco.classes (3.2.1-3) ... 2024-09-14T11:06:04.765 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up python-asyncssh-doc (2.5.0-1) ... 2024-09-14T11:06:04.818 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package rbd-fuse. 2024-09-14T11:06:04.847 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../118-rbd-fuse_19.3.0-4907-ga2782315-1jammy_amd64.deb ... 2024-09-14T11:06:04.884 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking rbd-fuse (19.3.0-4907-ga2782315-1jammy) ... 2024-09-14T11:06:04.891 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up python3-jaraco.functools (3.4.0-2) ... 2024-09-14T11:06:05.134 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up python3-repoze.lru (0.7-2) ... 2024-09-14T11:06:05.189 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up python3-iniconfig (1.1.1-2) ... 2024-09-14T11:06:05.385 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up liboath0:amd64 (2.6.7-3build1) ... 2024-09-14T11:06:05.432 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up libdouble-conversion3:amd64 (3.1.7-4) ... 2024-09-14T11:06:05.511 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up python3-py (1.10.0-1) ... 2024-09-14T11:06:05.550 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up nvme-cli (1.16-3ubuntu0.3) ... 2024-09-14T11:06:05.789 INFO:teuthology.orchestra.run.smithi138.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmefc-boot-connections.service -> /lib/systemd/system/nvmefc-boot-connections.service. 2024-09-14T11:06:05.821 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up python3-joblib (0.17.0-4ubuntu1) ... 2024-09-14T11:06:06.119 INFO:teuthology.orchestra.run.smithi138.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmf-autoconnect.service -> /lib/systemd/system/nvmf-autoconnect.service. 2024-09-14T11:06:06.181 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up python3-cachetools (5.0.0-1) ... 2024-09-14T11:06:06.441 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up python3-openssl (21.0.0-1) ... 2024-09-14T11:06:06.534 INFO:teuthology.orchestra.run.smithi138.stdout:nvmf-connect.target is a disabled or a static unit, not starting it. 2024-09-14T11:06:06.602 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up cephadm (19.3.0-4907-ga2782315-1jammy) ... 2024-09-14T11:06:06.685 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up unzip (6.0-26ubuntu3.2) ... 2024-09-14T11:06:06.993 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up python3-bcrypt (3.2.0-1build1) ... 2024-09-14T11:06:07.178 INFO:teuthology.orchestra.run.smithi138.stdout:Adding system user cephadm....done 2024-09-14T11:06:07.301 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up python3-waitress (1.4.4-1.1ubuntu1) ... 2024-09-14T11:06:07.436 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up python3-pyinotify (0.9.6-1.3) ... 2024-09-14T11:06:07.578 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up python3-jaraco.classes (3.2.1-3) ... 2024-09-14T11:06:07.695 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up python3-threadpoolctl (3.1.0-1) ... 2024-09-14T11:06:07.838 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up python-asyncssh-doc (2.5.0-1) ... 2024-09-14T11:06:07.964 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up python3-jaraco.functools (3.4.0-2) ... 2024-09-14T11:06:08.005 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up python3-ceph-argparse (19.3.0-4907-ga2782315-1jammy) ... 2024-09-14T11:06:08.240 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up python3-repoze.lru (0.7-2) ... 2024-09-14T11:06:08.256 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up python3-sklearn-lib:amd64 (0.23.2-5ubuntu6) ... 2024-09-14T11:06:08.382 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up libnbd0 (1.10.5-1) ... 2024-09-14T11:06:08.508 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up lua-socket:amd64 (3.0~rc1+git+ac3201d-6) ... 2024-09-14T11:06:08.509 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up liboath0:amd64 (2.6.7-3build1) ... 2024-09-14T11:06:08.609 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up libreadline-dev:amd64 (8.1.2-1) ... 2024-09-14T11:06:08.635 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up python3-py (1.10.0-1) ... 2024-09-14T11:06:08.735 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up python3-markupsafe (2.0.1-2build1) ... 2024-09-14T11:06:08.937 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up python3-joblib (0.17.0-4ubuntu1) ... 2024-09-14T11:06:08.994 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up lua5.1 (5.1.5-8.1build4) ... 2024-09-14T11:06:09.314 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up python3-cachetools (5.0.0-1) ... 2024-09-14T11:06:09.582 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up python3-openssl (21.0.0-1) ... 2024-09-14T11:06:09.635 INFO:teuthology.orchestra.run.smithi154.stdout:update-alternatives: using /usr/bin/lua5.1 to provide /usr/bin/lua (lua-interpreter) in auto mode 2024-09-14T11:06:09.667 INFO:teuthology.orchestra.run.smithi154.stdout:update-alternatives: using /usr/bin/luac5.1 to provide /usr/bin/luac (lua-compiler) in auto mode 2024-09-14T11:06:09.733 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up libpcre2-16-0:amd64 (10.39-3ubuntu0.1) ... 2024-09-14T11:06:09.859 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up python3-psutil (5.9.0-1build1) ... 2024-09-14T11:06:09.867 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up unzip (6.0-26ubuntu3.2) ... 2024-09-14T11:06:10.111 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up python3-bcrypt (3.2.0-1build1) ... 2024-09-14T11:06:10.218 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up python-babel-localedata (2.8.0+dfsg.1-7) ... 2024-09-14T11:06:10.345 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up python3-natsort (8.0.2-1) ... 2024-09-14T11:06:10.370 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up python3-pyinotify (0.9.6-1.3) ... 2024-09-14T11:06:10.612 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up python3-routes (2.5.1-1ubuntu1) ... 2024-09-14T11:06:10.638 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up python3-threadpoolctl (3.1.0-1) ... 2024-09-14T11:06:10.872 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up python3-simplejson (3.17.6-1build1) ... 2024-09-14T11:06:10.889 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up python3-ceph-argparse (19.3.0-4907-ga2782315-1jammy) ... 2024-09-14T11:06:11.195 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up zip (3.0-12build2) ... 2024-09-14T11:06:11.224 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up python3-sklearn-lib:amd64 (0.23.2-5ubuntu6) ... 2024-09-14T11:06:11.299 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up python3-pygments (2.11.2+dfsg-2) ... 2024-09-14T11:06:11.350 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up libnbd0 (1.10.5-1) ... 2024-09-14T11:06:11.476 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up lua-socket:amd64 (3.0~rc1+git+ac3201d-6) ... 2024-09-14T11:06:11.627 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up libreadline-dev:amd64 (8.1.2-1) ... 2024-09-14T11:06:11.762 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up python3-markupsafe (2.0.1-2build1) ... 2024-09-14T11:06:12.018 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up python3-tempita (0.5.2-6ubuntu1) ... 2024-09-14T11:06:12.030 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up lua5.1 (5.1.5-8.1build4) ... 2024-09-14T11:06:12.278 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up python-pastedeploy-tpl (2.1.1-1) ... 2024-09-14T11:06:12.403 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up qttranslations5-l10n (5.15.3-1) ... 2024-09-14T11:06:12.422 INFO:teuthology.orchestra.run.smithi138.stdout:update-alternatives: using /usr/bin/lua5.1 to provide /usr/bin/lua (lua-interpreter) in auto mode 2024-09-14T11:06:12.463 INFO:teuthology.orchestra.run.smithi138.stdout:update-alternatives: using /usr/bin/luac5.1 to provide /usr/bin/luac (lua-compiler) in auto mode 2024-09-14T11:06:12.529 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up python3-wcwidth (0.2.5+dfsg1-1) ... 2024-09-14T11:06:12.534 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up libpcre2-16-0:amd64 (10.39-3ubuntu0.1) ... 2024-09-14T11:06:12.685 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up python3-psutil (5.9.0-1build1) ... 2024-09-14T11:06:12.822 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up python3-asyncssh (2.5.0-1) ... 2024-09-14T11:06:13.078 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up python-babel-localedata (2.8.0+dfsg.1-7) ... 2024-09-14T11:06:13.196 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up python3-natsort (8.0.2-1) ... 2024-09-14T11:06:13.223 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up python3-certifi (2020.6.20-1) ... 2024-09-14T11:06:13.456 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up python3-routes (2.5.1-1ubuntu1) ... 2024-09-14T11:06:13.458 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up python3-paste (3.5.0+dfsg1-1) ... 2024-09-14T11:06:13.724 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up python3-simplejson (3.17.6-1build1) ... 2024-09-14T11:06:13.826 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up python3-cheroot (8.5.2+ds1-1ubuntu3.1) ... 2024-09-14T11:06:14.059 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up zip (3.0-12build2) ... 2024-09-14T11:06:14.119 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up python3-werkzeug (2.0.2+dfsg1-1ubuntu0.22.04.2) ... 2024-09-14T11:06:14.210 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up python3-pygments (2.11.2+dfsg-2) ... 2024-09-14T11:06:14.471 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up python3-jaraco.text (3.6.0-2) ... 2024-09-14T11:06:14.730 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up socat (1.7.4.1-3ubuntu4) ... 2024-09-14T11:06:14.856 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up python3-ceph-common (19.3.0-4907-ga2782315-1jammy) ... 2024-09-14T11:06:14.879 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up python3-tempita (0.5.2-6ubuntu1) ... 2024-09-14T11:06:15.122 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up python-pastedeploy-tpl (2.1.1-1) ... 2024-09-14T11:06:15.157 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up python3-idna (3.3-1ubuntu0.1) ... 2024-09-14T11:06:15.249 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up qttranslations5-l10n (5.15.3-1) ... 2024-09-14T11:06:15.417 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up python3-wcwidth (0.2.5+dfsg1-1) ... 2024-09-14T11:06:15.458 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up python3-sklearn (0.23.2-5ubuntu6) ... 2024-09-14T11:06:15.743 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up python3-asyncssh (2.5.0-1) ... 2024-09-14T11:06:16.161 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up python3-certifi (2020.6.20-1) ... 2024-09-14T11:06:16.412 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up python3-paste (3.5.0+dfsg1-1) ... 2024-09-14T11:06:16.664 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up pkg-config (0.29.2-1ubuntu3) ... 2024-09-14T11:06:16.781 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up python3-cheroot (8.5.2+ds1-1ubuntu3.1) ... 2024-09-14T11:06:16.908 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up libqt5core5a:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-09-14T11:06:17.042 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up python3-toml (0.10.2-1) ... 2024-09-14T11:06:17.066 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up python3-werkzeug (2.0.2+dfsg1-1ubuntu0.22.04.2) ... 2024-09-14T11:06:17.318 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up librdkafka1:amd64 (1.8.0-1build1) ... 2024-09-14T11:06:17.444 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up xmlstarlet (1.6.1-2.1) ... 2024-09-14T11:06:17.476 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up python3-jaraco.text (3.6.0-2) ... 2024-09-14T11:06:17.570 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up python3-urllib3 (1.26.5-1~exp1ubuntu0.1) ... 2024-09-14T11:06:17.744 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up socat (1.7.4.1-3ubuntu4) ... 2024-09-14T11:06:17.870 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up python3-ceph-common (19.3.0-4907-ga2782315-1jammy) ... 2024-09-14T11:06:17.871 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up python3-pluggy (0.13.0-7.1) ... 2024-09-14T11:06:18.115 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up python3-zc.lockfile (2.0-1) ... 2024-09-14T11:06:18.180 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up python3-idna (3.3-1ubuntu0.1) ... 2024-09-14T11:06:18.358 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up libqt5dbus5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-09-14T11:06:18.483 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up python3-pyasn1 (0.4.8-1) ... 2024-09-14T11:06:18.490 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up python3-sklearn (0.23.2-5ubuntu6) ... 2024-09-14T11:06:18.785 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up python3-singledispatch (3.4.0.3-3) ... 2024-09-14T11:06:19.044 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up python3-logutils (0.3.3-8) ... 2024-09-14T11:06:19.303 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up python3-tempora (4.1.2-1) ... 2024-09-14T11:06:19.563 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up python3-simplegeneric (0.8.1-3) ... 2024-09-14T11:06:19.655 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up pkg-config (0.29.2-1ubuntu3) ... 2024-09-14T11:06:19.822 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up python3-prettytable (2.5.0-2) ... 2024-09-14T11:06:19.874 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up libqt5core5a:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-09-14T11:06:20.008 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up python3-toml (0.10.2-1) ... 2024-09-14T11:06:20.107 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up liblttng-ust1:amd64 (2.13.1-1ubuntu1) ... 2024-09-14T11:06:20.225 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up python3-websocket (1.2.3-1) ... 2024-09-14T11:06:20.293 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up librdkafka1:amd64 (1.8.0-1build1) ... 2024-09-14T11:06:20.436 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up xmlstarlet (1.6.1-2.1) ... 2024-09-14T11:06:20.509 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up libonig5:amd64 (6.9.7.1-2build1) ... 2024-09-14T11:06:20.562 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up python3-urllib3 (1.26.5-1~exp1ubuntu0.1) ... 2024-09-14T11:06:20.635 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up python3-mako (1.1.3+ds1-2ubuntu0.1) ... 2024-09-14T11:06:20.855 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up python3-pluggy (0.13.0-7.1) ... 2024-09-14T11:06:20.928 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up python3-webob (1:1.8.6-1.1ubuntu0.1) ... 2024-09-14T11:06:21.106 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up python3-zc.lockfile (2.0-1) ... 2024-09-14T11:06:21.229 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up python3-jaraco.collections (3.4.0-2) ... 2024-09-14T11:06:21.383 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up libqt5dbus5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-09-14T11:06:21.489 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up liblua5.3-dev:amd64 (5.3.6-1build1) ... 2024-09-14T11:06:21.559 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up python3-pyasn1 (0.4.8-1) ... 2024-09-14T11:06:21.598 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up lua-sec:amd64 (1.0.2-1) ... 2024-09-14T11:06:21.707 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up python3-babel (2.8.0+dfsg.1-7) ... 2024-09-14T11:06:21.789 INFO:teuthology.orchestra.run.smithi154.stdout:update-alternatives: using /usr/bin/pybabel-python3 to provide /usr/bin/pybabel (pybabel) in auto mode 2024-09-14T11:06:22.034 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up libjq1:amd64 (1.6-2.1ubuntu3) ... 2024-09-14T11:06:22.094 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up python3-singledispatch (3.4.0.3-3) ... 2024-09-14T11:06:22.160 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up python3-pytest (6.2.5-1ubuntu2) ... 2024-09-14T11:06:22.362 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up python3-logutils (0.3.3-8) ... 2024-09-14T11:06:22.537 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up python3-pastedeploy (2.1.1-1) ... 2024-09-14T11:06:22.622 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up python3-tempora (4.1.2-1) ... 2024-09-14T11:06:22.788 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up lua-any (27ubuntu1) ... 2024-09-14T11:06:22.873 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up python3-simplegeneric (0.8.1-3) ... 2024-09-14T11:06:22.914 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up python3-portend (3.0.0-1) ... 2024-09-14T11:06:23.133 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up python3-prettytable (2.5.0-2) ... 2024-09-14T11:06:23.165 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up libqt5network5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-09-14T11:06:23.266 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up python3-jinja2 (3.0.3-1ubuntu0.2) ... 2024-09-14T11:06:23.418 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up liblttng-ust1:amd64 (2.13.1-1ubuntu1) ... 2024-09-14T11:06:23.569 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up python3-websocket (1.2.3-1) ... 2024-09-14T11:06:23.575 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up python3-pyasn1-modules (0.2.1-1) ... 2024-09-14T11:06:23.845 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up libonig5:amd64 (6.9.7.1-2build1) ... 2024-09-14T11:06:23.893 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up python3-requests (2.25.1+dfsg-2ubuntu0.1) ... 2024-09-14T11:06:23.980 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up python3-mako (1.1.3+ds1-2ubuntu0.1) ... 2024-09-14T11:06:24.161 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up jq (1.6-2.1ubuntu3) ... 2024-09-14T11:06:24.273 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up python3-webob (1:1.8.6-1.1ubuntu0.1) ... 2024-09-14T11:06:24.312 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up python3-rsa (4.8-1) ... 2024-09-14T11:06:24.580 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up python3-webtest (2.0.35-1) ... 2024-09-14T11:06:24.599 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up python3-jaraco.collections (3.4.0-2) ... 2024-09-14T11:06:24.875 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up liblua5.3-dev:amd64 (5.3.6-1build1) ... 2024-09-14T11:06:24.941 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up python3-requests-oauthlib (1.3.0+ds-0.1) ... 2024-09-14T11:06:25.027 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up lua-sec:amd64 (1.0.2-1) ... 2024-09-14T11:06:25.161 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up python3-babel (2.8.0+dfsg.1-7) ... 2024-09-14T11:06:25.209 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up python3-cherrypy3 (18.6.1-4) ... 2024-09-14T11:06:25.251 INFO:teuthology.orchestra.run.smithi138.stdout:update-alternatives: using /usr/bin/pybabel-python3 to provide /usr/bin/pybabel (pybabel) in auto mode 2024-09-14T11:06:25.513 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up libjq1:amd64 (1.6-2.1ubuntu3) ... 2024-09-14T11:06:25.585 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up python3-pastescript (2.0.2-4) ... 2024-09-14T11:06:25.640 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up python3-pytest (6.2.5-1ubuntu2) ... 2024-09-14T11:06:25.878 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up python3-pecan (1.3.3-4ubuntu2) ... 2024-09-14T11:06:26.033 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up python3-pastedeploy (2.1.1-1) ... 2024-09-14T11:06:26.222 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up libthrift-0.16.0:amd64 (0.16.0-2) ... 2024-09-14T11:06:26.309 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up lua-any (27ubuntu1) ... 2024-09-14T11:06:26.348 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up librados2 (19.3.0-4907-ga2782315-1jammy) ... 2024-09-14T11:06:26.450 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up libsqlite3-mod-ceph (19.3.0-4907-ga2782315-1jammy) ... 2024-09-14T11:06:26.460 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up python3-portend (3.0.0-1) ... 2024-09-14T11:06:26.567 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up luarocks (3.8.0+dfsg1-1) ... 2024-09-14T11:06:26.720 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up libqt5network5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-09-14T11:06:26.855 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up python3-jinja2 (3.0.3-1ubuntu0.2) ... 2024-09-14T11:06:26.903 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up libcephfs2 (19.3.0-4907-ga2782315-1jammy) ... 2024-09-14T11:06:27.029 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up libradosstriper1 (19.3.0-4907-ga2782315-1jammy) ... 2024-09-14T11:06:27.155 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up python3-google-auth (1.5.1-3) ... 2024-09-14T11:06:27.173 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up python3-pyasn1-modules (0.2.1-1) ... 2024-09-14T11:06:27.424 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up librbd1 (19.3.0-4907-ga2782315-1jammy) ... 2024-09-14T11:06:27.491 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up python3-requests (2.25.1+dfsg-2ubuntu0.1) ... 2024-09-14T11:06:27.550 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up ceph-mgr-modules-core (19.3.0-4907-ga2782315-1jammy) ... 2024-09-14T11:06:27.684 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up ceph-fuse (19.3.0-4907-ga2782315-1jammy) ... 2024-09-14T11:06:27.809 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up jq (1.6-2.1ubuntu3) ... 2024-09-14T11:06:27.899 INFO:teuthology.orchestra.run.smithi154.stdout:Created symlink /etc/systemd/system/remote-fs.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2024-09-14T11:06:27.900 INFO:teuthology.orchestra.run.smithi154.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2024-09-14T11:06:27.935 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up python3-rsa (4.8-1) ... 2024-09-14T11:06:28.220 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up python3-webtest (2.0.35-1) ... 2024-09-14T11:06:28.398 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up libcephfs-dev (19.3.0-4907-ga2782315-1jammy) ... 2024-09-14T11:06:28.545 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up python3-rados (19.3.0-4907-ga2782315-1jammy) ... 2024-09-14T11:06:28.582 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up python3-requests-oauthlib (1.3.0+ds-0.1) ... 2024-09-14T11:06:28.713 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up librgw2 (19.3.0-4907-ga2782315-1jammy) ... 2024-09-14T11:06:28.848 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up python3-kubernetes (12.0.1-1ubuntu1) ... 2024-09-14T11:06:28.867 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up python3-cherrypy3 (18.6.1-4) ... 2024-09-14T11:06:29.252 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up python3-pastescript (2.0.2-4) ... 2024-09-14T11:06:29.537 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up python3-pecan (1.3.3-4ubuntu2) ... 2024-09-14T11:06:29.874 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up libthrift-0.16.0:amd64 (0.16.0-2) ... 2024-09-14T11:06:30.025 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up librados2 (19.3.0-4907-ga2782315-1jammy) ... 2024-09-14T11:06:30.068 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up python3-rbd (19.3.0-4907-ga2782315-1jammy) ... 2024-09-14T11:06:30.193 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up libsqlite3-mod-ceph (19.3.0-4907-ga2782315-1jammy) ... 2024-09-14T11:06:30.194 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up rbd-fuse (19.3.0-4907-ga2782315-1jammy) ... 2024-09-14T11:06:30.321 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up python3-rgw (19.3.0-4907-ga2782315-1jammy) ... 2024-09-14T11:06:30.344 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up luarocks (3.8.0+dfsg1-1) ... 2024-09-14T11:06:30.447 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up python3-cephfs (19.3.0-4907-ga2782315-1jammy) ... 2024-09-14T11:06:30.572 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up ceph-common (19.3.0-4907-ga2782315-1jammy) ... 2024-09-14T11:06:30.698 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up libcephfs2 (19.3.0-4907-ga2782315-1jammy) ... 2024-09-14T11:06:30.824 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up libradosstriper1 (19.3.0-4907-ga2782315-1jammy) ... 2024-09-14T11:06:30.975 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up python3-google-auth (1.5.1-3) ... 2024-09-14T11:06:31.082 INFO:teuthology.orchestra.run.smithi154.stdout:Adding group ceph....done 2024-09-14T11:06:31.277 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up librbd1 (19.3.0-4907-ga2782315-1jammy) ... 2024-09-14T11:06:31.420 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up ceph-mgr-modules-core (19.3.0-4907-ga2782315-1jammy) ... 2024-09-14T11:06:31.433 INFO:teuthology.orchestra.run.smithi154.stdout:Adding system user ceph....done 2024-09-14T11:06:31.554 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up ceph-fuse (19.3.0-4907-ga2782315-1jammy) ... 2024-09-14T11:06:31.577 INFO:teuthology.orchestra.run.smithi154.stdout:Setting system user ceph properties....done 2024-09-14T11:06:31.589 INFO:teuthology.orchestra.run.smithi154.stdout:chown: cannot access '/var/log/ceph/*.log*': No such file or directory 2024-09-14T11:06:31.724 INFO:teuthology.orchestra.run.smithi154.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target -> /lib/systemd/system/ceph.target. 2024-09-14T11:06:31.775 INFO:teuthology.orchestra.run.smithi138.stdout:Created symlink /etc/systemd/system/remote-fs.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2024-09-14T11:06:31.775 INFO:teuthology.orchestra.run.smithi138.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2024-09-14T11:06:32.043 INFO:teuthology.orchestra.run.smithi154.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/rbdmap.service -> /lib/systemd/system/rbdmap.service. 2024-09-14T11:06:32.248 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up libcephfs-dev (19.3.0-4907-ga2782315-1jammy) ... 2024-09-14T11:06:32.383 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up python3-rados (19.3.0-4907-ga2782315-1jammy) ... 2024-09-14T11:06:32.499 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up ceph-test (19.3.0-4907-ga2782315-1jammy) ... 2024-09-14T11:06:32.534 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up librgw2 (19.3.0-4907-ga2782315-1jammy) ... 2024-09-14T11:06:32.625 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up radosgw (19.3.0-4907-ga2782315-1jammy) ... 2024-09-14T11:06:32.685 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up python3-kubernetes (12.0.1-1ubuntu1) ... 2024-09-14T11:06:33.107 INFO:teuthology.orchestra.run.smithi154.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2024-09-14T11:06:33.107 INFO:teuthology.orchestra.run.smithi154.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2024-09-14T11:06:33.552 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up ceph-base (19.3.0-4907-ga2782315-1jammy) ... 2024-09-14T11:06:33.906 INFO:teuthology.orchestra.run.smithi154.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service -> /lib/systemd/system/ceph-crash.service. 2024-09-14T11:06:33.931 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up python3-rbd (19.3.0-4907-ga2782315-1jammy) ... 2024-09-14T11:06:34.066 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up rbd-fuse (19.3.0-4907-ga2782315-1jammy) ... 2024-09-14T11:06:34.217 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up python3-rgw (19.3.0-4907-ga2782315-1jammy) ... 2024-09-14T11:06:34.368 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up python3-cephfs (19.3.0-4907-ga2782315-1jammy) ... 2024-09-14T11:06:34.404 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up ceph-mds (19.3.0-4907-ga2782315-1jammy) ... 2024-09-14T11:06:34.536 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up ceph-common (19.3.0-4907-ga2782315-1jammy) ... 2024-09-14T11:06:34.655 INFO:teuthology.orchestra.run.smithi154.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2024-09-14T11:06:34.655 INFO:teuthology.orchestra.run.smithi154.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2024-09-14T11:06:35.098 INFO:teuthology.orchestra.run.smithi138.stdout:Adding group ceph....done 2024-09-14T11:06:35.174 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up ceph-mgr (19.3.0-4907-ga2782315-1jammy) ... 2024-09-14T11:06:35.446 INFO:teuthology.orchestra.run.smithi154.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2024-09-14T11:06:35.446 INFO:teuthology.orchestra.run.smithi154.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2024-09-14T11:06:35.491 INFO:teuthology.orchestra.run.smithi138.stdout:Adding system user ceph....done 2024-09-14T11:06:35.660 INFO:teuthology.orchestra.run.smithi138.stdout:Setting system user ceph properties....done 2024-09-14T11:06:35.674 INFO:teuthology.orchestra.run.smithi138.stdout:chown: cannot access '/var/log/ceph/*.log*': No such file or directory 2024-09-14T11:06:35.810 INFO:teuthology.orchestra.run.smithi138.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target -> /lib/systemd/system/ceph.target. 2024-09-14T11:06:35.924 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up ceph-osd (19.3.0-4907-ga2782315-1jammy) ... 2024-09-14T11:06:36.161 INFO:teuthology.orchestra.run.smithi138.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/rbdmap.service -> /lib/systemd/system/rbdmap.service. 2024-09-14T11:06:36.261 INFO:teuthology.orchestra.run.smithi154.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2024-09-14T11:06:36.262 INFO:teuthology.orchestra.run.smithi154.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2024-09-14T11:06:36.648 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up ceph-test (19.3.0-4907-ga2782315-1jammy) ... 2024-09-14T11:06:36.710 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up ceph-mgr-k8sevents (19.3.0-4907-ga2782315-1jammy) ... 2024-09-14T11:06:36.791 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up radosgw (19.3.0-4907-ga2782315-1jammy) ... 2024-09-14T11:06:36.819 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up ceph-mgr-diskprediction-local (19.3.0-4907-ga2782315-1jammy) ... 2024-09-14T11:06:36.954 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up ceph-mon (19.3.0-4907-ga2782315-1jammy) ... 2024-09-14T11:06:37.163 INFO:teuthology.orchestra.run.smithi154.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2024-09-14T11:06:37.164 INFO:teuthology.orchestra.run.smithi154.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2024-09-14T11:06:37.283 INFO:teuthology.orchestra.run.smithi138.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2024-09-14T11:06:37.283 INFO:teuthology.orchestra.run.smithi138.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2024-09-14T11:06:37.605 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up ceph-mgr-cephadm (19.3.0-4907-ga2782315-1jammy) ... 2024-09-14T11:06:37.731 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up ceph (19.3.0-4907-ga2782315-1jammy) ... 2024-09-14T11:06:37.742 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up ceph-base (19.3.0-4907-ga2782315-1jammy) ... 2024-09-14T11:06:37.866 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up ceph-mgr-dashboard (19.3.0-4907-ga2782315-1jammy) ... 2024-09-14T11:06:38.017 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up ceph-volume (19.3.0-4907-ga2782315-1jammy) ... 2024-09-14T11:06:38.093 INFO:teuthology.orchestra.run.smithi138.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service -> /lib/systemd/system/ceph-crash.service. 2024-09-14T11:06:38.437 INFO:teuthology.orchestra.run.smithi154.stdout:Processing triggers for mailcap (3.70+nmu1ubuntu1) ... 2024-09-14T11:06:38.546 INFO:teuthology.orchestra.run.smithi154.stdout:Processing triggers for libc-bin (2.35-0ubuntu3.1) ... 2024-09-14T11:06:38.577 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up ceph-mds (19.3.0-4907-ga2782315-1jammy) ... 2024-09-14T11:06:38.698 INFO:teuthology.orchestra.run.smithi154.stdout:Processing triggers for man-db (2.10.2-1) ... 2024-09-14T11:06:38.788 INFO:teuthology.orchestra.run.smithi138.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2024-09-14T11:06:38.789 INFO:teuthology.orchestra.run.smithi138.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2024-09-14T11:06:39.237 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up ceph-mgr (19.3.0-4907-ga2782315-1jammy) ... 2024-09-14T11:06:39.449 INFO:teuthology.orchestra.run.smithi138.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2024-09-14T11:06:39.449 INFO:teuthology.orchestra.run.smithi138.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2024-09-14T11:06:39.465 INFO:teuthology.orchestra.run.smithi154.stdout:Processing triggers for install-info (6.8-4build1) ... 2024-09-14T11:06:39.914 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up ceph-osd (19.3.0-4907-ga2782315-1jammy) ... 2024-09-14T11:06:40.101 INFO:teuthology.orchestra.run.smithi154.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2024-09-14T11:06:40.105 DEBUG:teuthology.orchestra.run.smithi154:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install s3cmd maven 2024-09-14T11:06:40.160 INFO:teuthology.orchestra.run.smithi154.stdout:Reading package lists... 2024-09-14T11:06:40.189 INFO:teuthology.orchestra.run.smithi138.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2024-09-14T11:06:40.189 INFO:teuthology.orchestra.run.smithi138.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2024-09-14T11:06:40.370 INFO:teuthology.orchestra.run.smithi154.stdout:Building dependency tree... 2024-09-14T11:06:40.371 INFO:teuthology.orchestra.run.smithi154.stdout:Reading state information... 2024-09-14T11:06:40.553 INFO:teuthology.orchestra.run.smithi154.stdout:The following packages were automatically installed and are no longer required: 2024-09-14T11:06:40.553 INFO:teuthology.orchestra.run.smithi154.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-09-14T11:06:40.553 INFO:teuthology.orchestra.run.smithi154.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-09-14T11:06:40.553 INFO:teuthology.orchestra.run.smithi154.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-09-14T11:06:40.554 INFO:teuthology.orchestra.run.smithi154.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2024-09-14T11:06:40.554 INFO:teuthology.orchestra.run.smithi154.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2024-09-14T11:06:40.554 INFO:teuthology.orchestra.run.smithi154.stdout:Use 'sudo apt autoremove' to remove them. 2024-09-14T11:06:40.555 INFO:teuthology.orchestra.run.smithi154.stdout:The following additional packages will be installed: 2024-09-14T11:06:40.555 INFO:teuthology.orchestra.run.smithi154.stdout: libaopalliance-java libapache-pom-java libatinject-jsr330-api-java 2024-09-14T11:06:40.555 INFO:teuthology.orchestra.run.smithi154.stdout: libcdi-api-java libcommons-cli-java libcommons-io-java libcommons-lang3-java 2024-09-14T11:06:40.555 INFO:teuthology.orchestra.run.smithi154.stdout: libcommons-parent-java libgeronimo-annotation-1.3-spec-java 2024-09-14T11:06:40.555 INFO:teuthology.orchestra.run.smithi154.stdout: libgeronimo-interceptor-3.0-spec-java libguava-java libguice-java 2024-09-14T11:06:40.555 INFO:teuthology.orchestra.run.smithi154.stdout: libhawtjni-runtime-java libjansi-java libjansi-native-java libjsr305-java 2024-09-14T11:06:40.555 INFO:teuthology.orchestra.run.smithi154.stdout: libmaven-parent-java libmaven-resolver-java libmaven-shared-utils-java 2024-09-14T11:06:40.556 INFO:teuthology.orchestra.run.smithi154.stdout: libmaven3-core-java libplexus-cipher-java libplexus-classworlds-java 2024-09-14T11:06:40.556 INFO:teuthology.orchestra.run.smithi154.stdout: libplexus-component-annotations-java libplexus-interpolation-java 2024-09-14T11:06:40.556 INFO:teuthology.orchestra.run.smithi154.stdout: libplexus-sec-dispatcher-java libplexus-utils2-java libsisu-inject-java 2024-09-14T11:06:40.556 INFO:teuthology.orchestra.run.smithi154.stdout: libsisu-plexus-java libslf4j-java libwagon-file-java 2024-09-14T11:06:40.556 INFO:teuthology.orchestra.run.smithi154.stdout: libwagon-http-shaded-java libwagon-provider-api-java python3-magic 2024-09-14T11:06:40.557 INFO:teuthology.orchestra.run.smithi154.stdout:Suggested packages: 2024-09-14T11:06:40.557 INFO:teuthology.orchestra.run.smithi154.stdout: libaopalliance-java-doc libatinject-jsr330-api-java-doc libel-api-java 2024-09-14T11:06:40.557 INFO:teuthology.orchestra.run.smithi154.stdout: libcommons-io-java-doc libcommons-lang3-java-doc libasm-java libcglib-java 2024-09-14T11:06:40.557 INFO:teuthology.orchestra.run.smithi154.stdout: libjsr305-java-doc libmaven-shared-utils-java-doc liblogback-java 2024-09-14T11:06:40.557 INFO:teuthology.orchestra.run.smithi154.stdout: libplexus-classworlds-java-doc libplexus-sec-dispatcher-java-doc 2024-09-14T11:06:40.557 INFO:teuthology.orchestra.run.smithi154.stdout: libplexus-utils2-java-doc testng libcommons-logging-java liblog4j1.2-java 2024-09-14T11:06:40.595 INFO:teuthology.orchestra.run.smithi154.stdout:The following NEW packages will be installed: 2024-09-14T11:06:40.595 INFO:teuthology.orchestra.run.smithi154.stdout: libaopalliance-java libapache-pom-java libatinject-jsr330-api-java 2024-09-14T11:06:40.595 INFO:teuthology.orchestra.run.smithi154.stdout: libcdi-api-java libcommons-cli-java libcommons-io-java libcommons-lang3-java 2024-09-14T11:06:40.596 INFO:teuthology.orchestra.run.smithi154.stdout: libcommons-parent-java libgeronimo-annotation-1.3-spec-java 2024-09-14T11:06:40.596 INFO:teuthology.orchestra.run.smithi154.stdout: libgeronimo-interceptor-3.0-spec-java libguava-java libguice-java 2024-09-14T11:06:40.596 INFO:teuthology.orchestra.run.smithi154.stdout: libhawtjni-runtime-java libjansi-java libjansi-native-java libjsr305-java 2024-09-14T11:06:40.596 INFO:teuthology.orchestra.run.smithi154.stdout: libmaven-parent-java libmaven-resolver-java libmaven-shared-utils-java 2024-09-14T11:06:40.596 INFO:teuthology.orchestra.run.smithi154.stdout: libmaven3-core-java libplexus-cipher-java libplexus-classworlds-java 2024-09-14T11:06:40.596 INFO:teuthology.orchestra.run.smithi154.stdout: libplexus-component-annotations-java libplexus-interpolation-java 2024-09-14T11:06:40.596 INFO:teuthology.orchestra.run.smithi154.stdout: libplexus-sec-dispatcher-java libplexus-utils2-java libsisu-inject-java 2024-09-14T11:06:40.596 INFO:teuthology.orchestra.run.smithi154.stdout: libsisu-plexus-java libslf4j-java libwagon-file-java 2024-09-14T11:06:40.596 INFO:teuthology.orchestra.run.smithi154.stdout: libwagon-http-shaded-java libwagon-provider-api-java maven python3-magic 2024-09-14T11:06:40.596 INFO:teuthology.orchestra.run.smithi154.stdout: s3cmd 2024-09-14T11:06:40.651 INFO:teuthology.orchestra.run.smithi154.stdout:0 upgraded, 35 newly installed, 0 to remove and 331 not upgraded. 2024-09-14T11:06:40.651 INFO:teuthology.orchestra.run.smithi154.stdout:Need to get 10.4 MB of archives. 2024-09-14T11:06:40.651 INFO:teuthology.orchestra.run.smithi154.stdout:After this operation, 13.9 MB of additional disk space will be used. 2024-09-14T11:06:40.652 INFO:teuthology.orchestra.run.smithi154.stdout:Get:1 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libapache-pom-java all 18-1 [4,720 B] 2024-09-14T11:06:40.669 INFO:teuthology.orchestra.run.smithi154.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libatinject-jsr330-api-java all 1.0+ds1-5 [5,348 B] 2024-09-14T11:06:40.669 INFO:teuthology.orchestra.run.smithi154.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libgeronimo-interceptor-3.0-spec-java all 1.0.1-4fakesync [8,616 B] 2024-09-14T11:06:40.672 INFO:teuthology.orchestra.run.smithi154.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libcdi-api-java all 1.2-3 [54.3 kB] 2024-09-14T11:06:40.674 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up ceph-mgr-k8sevents (19.3.0-4907-ga2782315-1jammy) ... 2024-09-14T11:06:40.707 INFO:teuthology.orchestra.run.smithi154.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libcommons-cli-java all 1.4-2 [55.8 kB] 2024-09-14T11:06:40.722 INFO:teuthology.orchestra.run.smithi154.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libcommons-parent-java all 43-1 [10.8 kB] 2024-09-14T11:06:40.724 INFO:teuthology.orchestra.run.smithi154.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libcommons-io-java all 2.11.0-2 [297 kB] 2024-09-14T11:06:40.754 INFO:teuthology.orchestra.run.smithi154.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libcommons-lang3-java all 3.11-1 [526 kB] 2024-09-14T11:06:40.774 INFO:teuthology.orchestra.run.smithi154.stdout:Get:9 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libgeronimo-annotation-1.3-spec-java all 1.3-1 [11.2 kB] 2024-09-14T11:06:40.775 INFO:teuthology.orchestra.run.smithi154.stdout:Get:10 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libjsr305-java all 0.1~+svn49-11 [27.0 kB] 2024-09-14T11:06:40.776 INFO:teuthology.orchestra.run.smithi154.stdout:Get:11 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libguava-java all 29.0-6 [2,418 kB] 2024-09-14T11:06:40.800 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up ceph-mgr-diskprediction-local (19.3.0-4907-ga2782315-1jammy) ... 2024-09-14T11:06:40.822 INFO:teuthology.orchestra.run.smithi154.stdout:Get:12 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libaopalliance-java all 20070526-6 [9,084 B] 2024-09-14T11:06:40.822 INFO:teuthology.orchestra.run.smithi154.stdout:Get:13 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libguice-java all 4.2.3-2 [1,434 kB] 2024-09-14T11:06:40.840 INFO:teuthology.orchestra.run.smithi154.stdout:Get:14 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libhawtjni-runtime-java all 1.17-1 [28.8 kB] 2024-09-14T11:06:40.840 INFO:teuthology.orchestra.run.smithi154.stdout:Get:15 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libjansi-native-java all 1.8-1 [23.8 kB] 2024-09-14T11:06:40.841 INFO:teuthology.orchestra.run.smithi154.stdout:Get:16 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libjansi-java all 1.18-1 [56.8 kB] 2024-09-14T11:06:40.842 INFO:teuthology.orchestra.run.smithi154.stdout:Get:17 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libmaven-parent-java all 31-2 [5,140 B] 2024-09-14T11:06:40.842 INFO:teuthology.orchestra.run.smithi154.stdout:Get:18 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libplexus-utils2-java all 3.3.0-1 [250 kB] 2024-09-14T11:06:40.845 INFO:teuthology.orchestra.run.smithi154.stdout:Get:19 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libwagon-provider-api-java all 3.3.4-1 [48.5 kB] 2024-09-14T11:06:40.845 INFO:teuthology.orchestra.run.smithi154.stdout:Get:20 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libmaven-resolver-java all 1.4.2-3build1 [555 kB] 2024-09-14T11:06:40.851 INFO:teuthology.orchestra.run.smithi154.stdout:Get:21 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libmaven-shared-utils-java all 3.3.0-1ubuntu0.22.04.1 [148 kB] 2024-09-14T11:06:40.858 INFO:teuthology.orchestra.run.smithi154.stdout:Get:22 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libplexus-cipher-java all 1.8-2 [15.1 kB] 2024-09-14T11:06:40.859 INFO:teuthology.orchestra.run.smithi154.stdout:Get:23 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libplexus-classworlds-java all 2.6.0-1 [49.4 kB] 2024-09-14T11:06:40.871 INFO:teuthology.orchestra.run.smithi154.stdout:Get:24 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libplexus-component-annotations-java all 2.1.0-1 [6,564 B] 2024-09-14T11:06:40.871 INFO:teuthology.orchestra.run.smithi154.stdout:Get:25 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libplexus-interpolation-java all 1.26-1 [76.8 kB] 2024-09-14T11:06:40.872 INFO:teuthology.orchestra.run.smithi154.stdout:Get:26 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libplexus-sec-dispatcher-java all 1.4-4 [28.1 kB] 2024-09-14T11:06:40.872 INFO:teuthology.orchestra.run.smithi154.stdout:Get:27 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libslf4j-java all 1.7.32-1 [141 kB] 2024-09-14T11:06:40.874 INFO:teuthology.orchestra.run.smithi154.stdout:Get:28 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libsisu-inject-java all 0.3.4-2 [347 kB] 2024-09-14T11:06:40.877 INFO:teuthology.orchestra.run.smithi154.stdout:Get:29 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libsisu-plexus-java all 0.3.4-3 [181 kB] 2024-09-14T11:06:40.879 INFO:teuthology.orchestra.run.smithi154.stdout:Get:30 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libmaven3-core-java all 3.6.3-5 [1,535 kB] 2024-09-14T11:06:40.893 INFO:teuthology.orchestra.run.smithi154.stdout:Get:31 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libwagon-file-java all 3.3.4-1 [7,928 B] 2024-09-14T11:06:40.893 INFO:teuthology.orchestra.run.smithi154.stdout:Get:32 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libwagon-http-shaded-java all 3.3.4-1 [1,855 kB] 2024-09-14T11:06:40.912 INFO:teuthology.orchestra.run.smithi154.stdout:Get:33 http://archive.ubuntu.com/ubuntu jammy/universe amd64 maven all 3.6.3-5 [17.8 kB] 2024-09-14T11:06:40.912 INFO:teuthology.orchestra.run.smithi154.stdout:Get:34 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-magic all 2:0.4.24-2 [12.6 kB] 2024-09-14T11:06:40.912 INFO:teuthology.orchestra.run.smithi154.stdout:Get:35 http://archive.ubuntu.com/ubuntu jammy/universe amd64 s3cmd all 2.2.0-1 [120 kB] 2024-09-14T11:06:40.959 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up ceph-mon (19.3.0-4907-ga2782315-1jammy) ... 2024-09-14T11:06:41.185 INFO:teuthology.orchestra.run.smithi138.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2024-09-14T11:06:41.185 INFO:teuthology.orchestra.run.smithi138.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2024-09-14T11:06:41.350 INFO:teuthology.orchestra.run.smithi154.stdout:Fetched 10.4 MB in 0s (33.9 MB/s) 2024-09-14T11:06:41.437 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package libapache-pom-java. 2024-09-14T11:06:41.499 INFO:teuthology.orchestra.run.smithi154.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 176255 files and directories currently installed.) 2024-09-14T11:06:41.504 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../00-libapache-pom-java_18-1_all.deb ... 2024-09-14T11:06:41.544 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking libapache-pom-java (18-1) ... 2024-09-14T11:06:41.652 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up ceph-mgr-cephadm (19.3.0-4907-ga2782315-1jammy) ... 2024-09-14T11:06:41.778 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up ceph (19.3.0-4907-ga2782315-1jammy) ... 2024-09-14T11:06:41.797 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package libatinject-jsr330-api-java. 2024-09-14T11:06:41.813 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../01-libatinject-jsr330-api-java_1.0+ds1-5_all.deb ... 2024-09-14T11:06:41.855 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking libatinject-jsr330-api-java (1.0+ds1-5) ... 2024-09-14T11:06:41.879 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up ceph-mgr-dashboard (19.3.0-4907-ga2782315-1jammy) ... 2024-09-14T11:06:42.022 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up ceph-volume (19.3.0-4907-ga2782315-1jammy) ... 2024-09-14T11:06:42.117 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package libgeronimo-interceptor-3.0-spec-java. 2024-09-14T11:06:42.142 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../02-libgeronimo-interceptor-3.0-spec-java_1.0.1-4fakesync_all.deb ... 2024-09-14T11:06:42.183 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking libgeronimo-interceptor-3.0-spec-java (1.0.1-4fakesync) ... 2024-09-14T11:06:42.375 INFO:teuthology.orchestra.run.smithi138.stdout:Processing triggers for mailcap (3.70+nmu1ubuntu1) ... 2024-09-14T11:06:42.419 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package libcdi-api-java. 2024-09-14T11:06:42.436 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../03-libcdi-api-java_1.2-3_all.deb ... 2024-09-14T11:06:42.477 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking libcdi-api-java (1.2-3) ... 2024-09-14T11:06:42.637 INFO:teuthology.orchestra.run.smithi138.stdout:Processing triggers for libc-bin (2.35-0ubuntu3.1) ... 2024-09-14T11:06:42.705 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package libcommons-cli-java. 2024-09-14T11:06:42.733 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../04-libcommons-cli-java_1.4-2_all.deb ... 2024-09-14T11:06:42.772 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking libcommons-cli-java (1.4-2) ... 2024-09-14T11:06:42.788 INFO:teuthology.orchestra.run.smithi138.stdout:Processing triggers for man-db (2.10.2-1) ... 2024-09-14T11:06:43.058 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package libcommons-parent-java. 2024-09-14T11:06:43.087 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../05-libcommons-parent-java_43-1_all.deb ... 2024-09-14T11:06:43.125 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking libcommons-parent-java (43-1) ... 2024-09-14T11:06:43.464 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package libcommons-io-java. 2024-09-14T11:06:43.493 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../06-libcommons-io-java_2.11.0-2_all.deb ... 2024-09-14T11:06:43.536 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking libcommons-io-java (2.11.0-2) ... 2024-09-14T11:06:43.789 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package libcommons-lang3-java. 2024-09-14T11:06:43.814 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../07-libcommons-lang3-java_3.11-1_all.deb ... 2024-09-14T11:06:43.855 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking libcommons-lang3-java (3.11-1) ... 2024-09-14T11:06:43.864 INFO:teuthology.orchestra.run.smithi138.stdout:Processing triggers for install-info (6.8-4build1) ... 2024-09-14T11:06:44.142 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package libgeronimo-annotation-1.3-spec-java. 2024-09-14T11:06:44.170 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../08-libgeronimo-annotation-1.3-spec-java_1.3-1_all.deb ... 2024-09-14T11:06:44.208 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking libgeronimo-annotation-1.3-spec-java (1.3-1) ... 2024-09-14T11:06:44.461 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package libjsr305-java. 2024-09-14T11:06:44.477 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../09-libjsr305-java_0.1~+svn49-11_all.deb ... 2024-09-14T11:06:44.519 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking libjsr305-java (0.1~+svn49-11) ... 2024-09-14T11:06:44.534 INFO:teuthology.orchestra.run.smithi138.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2024-09-14T11:06:44.537 DEBUG:teuthology.orchestra.run.smithi138:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install s3cmd maven 2024-09-14T11:06:44.637 INFO:teuthology.orchestra.run.smithi138.stdout:Reading package lists... 2024-09-14T11:06:44.755 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package libguava-java. 2024-09-14T11:06:44.772 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../10-libguava-java_29.0-6_all.deb ... 2024-09-14T11:06:44.814 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking libguava-java (29.0-6) ... 2024-09-14T11:06:44.847 INFO:teuthology.orchestra.run.smithi138.stdout:Building dependency tree... 2024-09-14T11:06:44.848 INFO:teuthology.orchestra.run.smithi138.stdout:Reading state information... 2024-09-14T11:06:45.037 INFO:teuthology.orchestra.run.smithi138.stdout:The following packages were automatically installed and are no longer required: 2024-09-14T11:06:45.037 INFO:teuthology.orchestra.run.smithi138.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-09-14T11:06:45.037 INFO:teuthology.orchestra.run.smithi138.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-09-14T11:06:45.037 INFO:teuthology.orchestra.run.smithi138.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-09-14T11:06:45.037 INFO:teuthology.orchestra.run.smithi138.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2024-09-14T11:06:45.037 INFO:teuthology.orchestra.run.smithi138.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2024-09-14T11:06:45.037 INFO:teuthology.orchestra.run.smithi138.stdout:Use 'sudo apt autoremove' to remove them. 2024-09-14T11:06:45.038 INFO:teuthology.orchestra.run.smithi138.stdout:The following additional packages will be installed: 2024-09-14T11:06:45.038 INFO:teuthology.orchestra.run.smithi138.stdout: libaopalliance-java libapache-pom-java libatinject-jsr330-api-java 2024-09-14T11:06:45.038 INFO:teuthology.orchestra.run.smithi138.stdout: libcdi-api-java libcommons-cli-java libcommons-io-java libcommons-lang3-java 2024-09-14T11:06:45.038 INFO:teuthology.orchestra.run.smithi138.stdout: libcommons-parent-java libgeronimo-annotation-1.3-spec-java 2024-09-14T11:06:45.039 INFO:teuthology.orchestra.run.smithi138.stdout: libgeronimo-interceptor-3.0-spec-java libguava-java libguice-java 2024-09-14T11:06:45.039 INFO:teuthology.orchestra.run.smithi138.stdout: libhawtjni-runtime-java libjansi-java libjansi-native-java libjsr305-java 2024-09-14T11:06:45.039 INFO:teuthology.orchestra.run.smithi138.stdout: libmaven-parent-java libmaven-resolver-java libmaven-shared-utils-java 2024-09-14T11:06:45.039 INFO:teuthology.orchestra.run.smithi138.stdout: libmaven3-core-java libplexus-cipher-java libplexus-classworlds-java 2024-09-14T11:06:45.039 INFO:teuthology.orchestra.run.smithi138.stdout: libplexus-component-annotations-java libplexus-interpolation-java 2024-09-14T11:06:45.039 INFO:teuthology.orchestra.run.smithi138.stdout: libplexus-sec-dispatcher-java libplexus-utils2-java libsisu-inject-java 2024-09-14T11:06:45.039 INFO:teuthology.orchestra.run.smithi138.stdout: libsisu-plexus-java libslf4j-java libwagon-file-java 2024-09-14T11:06:45.039 INFO:teuthology.orchestra.run.smithi138.stdout: libwagon-http-shaded-java libwagon-provider-api-java python3-magic 2024-09-14T11:06:45.040 INFO:teuthology.orchestra.run.smithi138.stdout:Suggested packages: 2024-09-14T11:06:45.040 INFO:teuthology.orchestra.run.smithi138.stdout: libaopalliance-java-doc libatinject-jsr330-api-java-doc libel-api-java 2024-09-14T11:06:45.040 INFO:teuthology.orchestra.run.smithi138.stdout: libcommons-io-java-doc libcommons-lang3-java-doc libasm-java libcglib-java 2024-09-14T11:06:45.040 INFO:teuthology.orchestra.run.smithi138.stdout: libjsr305-java-doc libmaven-shared-utils-java-doc liblogback-java 2024-09-14T11:06:45.040 INFO:teuthology.orchestra.run.smithi138.stdout: libplexus-classworlds-java-doc libplexus-sec-dispatcher-java-doc 2024-09-14T11:06:45.040 INFO:teuthology.orchestra.run.smithi138.stdout: libplexus-utils2-java-doc testng libcommons-logging-java liblog4j1.2-java 2024-09-14T11:06:45.078 INFO:teuthology.orchestra.run.smithi138.stdout:The following NEW packages will be installed: 2024-09-14T11:06:45.078 INFO:teuthology.orchestra.run.smithi138.stdout: libaopalliance-java libapache-pom-java libatinject-jsr330-api-java 2024-09-14T11:06:45.078 INFO:teuthology.orchestra.run.smithi138.stdout: libcdi-api-java libcommons-cli-java libcommons-io-java libcommons-lang3-java 2024-09-14T11:06:45.078 INFO:teuthology.orchestra.run.smithi138.stdout: libcommons-parent-java libgeronimo-annotation-1.3-spec-java 2024-09-14T11:06:45.078 INFO:teuthology.orchestra.run.smithi138.stdout: libgeronimo-interceptor-3.0-spec-java libguava-java libguice-java 2024-09-14T11:06:45.078 INFO:teuthology.orchestra.run.smithi138.stdout: libhawtjni-runtime-java libjansi-java libjansi-native-java libjsr305-java 2024-09-14T11:06:45.078 INFO:teuthology.orchestra.run.smithi138.stdout: libmaven-parent-java libmaven-resolver-java libmaven-shared-utils-java 2024-09-14T11:06:45.079 INFO:teuthology.orchestra.run.smithi138.stdout: libmaven3-core-java libplexus-cipher-java libplexus-classworlds-java 2024-09-14T11:06:45.079 INFO:teuthology.orchestra.run.smithi138.stdout: libplexus-component-annotations-java libplexus-interpolation-java 2024-09-14T11:06:45.079 INFO:teuthology.orchestra.run.smithi138.stdout: libplexus-sec-dispatcher-java libplexus-utils2-java libsisu-inject-java 2024-09-14T11:06:45.079 INFO:teuthology.orchestra.run.smithi138.stdout: libsisu-plexus-java libslf4j-java libwagon-file-java 2024-09-14T11:06:45.079 INFO:teuthology.orchestra.run.smithi138.stdout: libwagon-http-shaded-java libwagon-provider-api-java maven python3-magic 2024-09-14T11:06:45.079 INFO:teuthology.orchestra.run.smithi138.stdout: s3cmd 2024-09-14T11:06:45.250 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package libaopalliance-java. 2024-09-14T11:06:45.260 INFO:teuthology.orchestra.run.smithi138.stdout:0 upgraded, 35 newly installed, 0 to remove and 331 not upgraded. 2024-09-14T11:06:45.260 INFO:teuthology.orchestra.run.smithi138.stdout:Need to get 10.4 MB of archives. 2024-09-14T11:06:45.260 INFO:teuthology.orchestra.run.smithi138.stdout:After this operation, 13.9 MB of additional disk space will be used. 2024-09-14T11:06:45.260 INFO:teuthology.orchestra.run.smithi138.stdout:Get:1 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libapache-pom-java all 18-1 [4,720 B] 2024-09-14T11:06:45.278 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../11-libaopalliance-java_20070526-6_all.deb ... 2024-09-14T11:06:45.316 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking libaopalliance-java (20070526-6) ... 2024-09-14T11:06:45.342 INFO:teuthology.orchestra.run.smithi138.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libatinject-jsr330-api-java all 1.0+ds1-5 [5,348 B] 2024-09-14T11:06:45.342 INFO:teuthology.orchestra.run.smithi138.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libgeronimo-interceptor-3.0-spec-java all 1.0.1-4fakesync [8,616 B] 2024-09-14T11:06:45.359 INFO:teuthology.orchestra.run.smithi138.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libcdi-api-java all 1.2-3 [54.3 kB] 2024-09-14T11:06:45.523 INFO:teuthology.orchestra.run.smithi138.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libcommons-cli-java all 1.4-2 [55.8 kB] 2024-09-14T11:06:45.569 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package libguice-java. 2024-09-14T11:06:45.585 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../12-libguice-java_4.2.3-2_all.deb ... 2024-09-14T11:06:45.594 INFO:teuthology.orchestra.run.smithi138.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libcommons-parent-java all 43-1 [10.8 kB] 2024-09-14T11:06:45.603 INFO:teuthology.orchestra.run.smithi138.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libcommons-io-java all 2.11.0-2 [297 kB] 2024-09-14T11:06:45.627 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking libguice-java (4.2.3-2) ... 2024-09-14T11:06:45.737 INFO:teuthology.orchestra.run.smithi138.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libcommons-lang3-java all 3.11-1 [526 kB] 2024-09-14T11:06:45.829 INFO:teuthology.orchestra.run.smithi138.stdout:Get:9 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libgeronimo-annotation-1.3-spec-java all 1.3-1 [11.2 kB] 2024-09-14T11:06:45.831 INFO:teuthology.orchestra.run.smithi138.stdout:Get:10 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libjsr305-java all 0.1~+svn49-11 [27.0 kB] 2024-09-14T11:06:45.836 INFO:teuthology.orchestra.run.smithi138.stdout:Get:11 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libguava-java all 29.0-6 [2,418 kB] 2024-09-14T11:06:45.978 INFO:teuthology.orchestra.run.smithi138.stdout:Get:12 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libaopalliance-java all 20070526-6 [9,084 B] 2024-09-14T11:06:45.979 INFO:teuthology.orchestra.run.smithi138.stdout:Get:13 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libguice-java all 4.2.3-2 [1,434 kB] 2024-09-14T11:06:46.006 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package libhawtjni-runtime-java. 2024-09-14T11:06:46.018 INFO:teuthology.orchestra.run.smithi138.stdout:Get:14 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libhawtjni-runtime-java all 1.17-1 [28.8 kB] 2024-09-14T11:06:46.019 INFO:teuthology.orchestra.run.smithi138.stdout:Get:15 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libjansi-native-java all 1.8-1 [23.8 kB] 2024-09-14T11:06:46.021 INFO:teuthology.orchestra.run.smithi138.stdout:Get:16 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libjansi-java all 1.18-1 [56.8 kB] 2024-09-14T11:06:46.025 INFO:teuthology.orchestra.run.smithi138.stdout:Get:17 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libmaven-parent-java all 31-2 [5,140 B] 2024-09-14T11:06:46.025 INFO:teuthology.orchestra.run.smithi138.stdout:Get:18 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libplexus-utils2-java all 3.3.0-1 [250 kB] 2024-09-14T11:06:46.031 INFO:teuthology.orchestra.run.smithi138.stdout:Get:19 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libwagon-provider-api-java all 3.3.4-1 [48.5 kB] 2024-09-14T11:06:46.032 INFO:teuthology.orchestra.run.smithi138.stdout:Get:20 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libmaven-resolver-java all 1.4.2-3build1 [555 kB] 2024-09-14T11:06:46.034 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../13-libhawtjni-runtime-java_1.17-1_all.deb ... 2024-09-14T11:06:46.073 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking libhawtjni-runtime-java (1.17-1) ... 2024-09-14T11:06:46.074 INFO:teuthology.orchestra.run.smithi138.stdout:Get:21 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libmaven-shared-utils-java all 3.3.0-1ubuntu0.22.04.1 [148 kB] 2024-09-14T11:06:46.077 INFO:teuthology.orchestra.run.smithi138.stdout:Get:22 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libplexus-cipher-java all 1.8-2 [15.1 kB] 2024-09-14T11:06:46.127 INFO:teuthology.orchestra.run.smithi138.stdout:Get:23 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libplexus-classworlds-java all 2.6.0-1 [49.4 kB] 2024-09-14T11:06:46.128 INFO:teuthology.orchestra.run.smithi138.stdout:Get:24 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libplexus-component-annotations-java all 2.1.0-1 [6,564 B] 2024-09-14T11:06:46.129 INFO:teuthology.orchestra.run.smithi138.stdout:Get:25 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libplexus-interpolation-java all 1.26-1 [76.8 kB] 2024-09-14T11:06:46.131 INFO:teuthology.orchestra.run.smithi138.stdout:Get:26 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libplexus-sec-dispatcher-java all 1.4-4 [28.1 kB] 2024-09-14T11:06:46.132 INFO:teuthology.orchestra.run.smithi138.stdout:Get:27 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libslf4j-java all 1.7.32-1 [141 kB] 2024-09-14T11:06:46.157 INFO:teuthology.orchestra.run.smithi138.stdout:Get:28 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libsisu-inject-java all 0.3.4-2 [347 kB] 2024-09-14T11:06:46.165 INFO:teuthology.orchestra.run.smithi138.stdout:Get:29 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libsisu-plexus-java all 0.3.4-3 [181 kB] 2024-09-14T11:06:46.170 INFO:teuthology.orchestra.run.smithi138.stdout:Get:30 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libmaven3-core-java all 3.6.3-5 [1,535 kB] 2024-09-14T11:06:46.237 INFO:teuthology.orchestra.run.smithi138.stdout:Get:31 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libwagon-file-java all 3.3.4-1 [7,928 B] 2024-09-14T11:06:46.238 INFO:teuthology.orchestra.run.smithi138.stdout:Get:32 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libwagon-http-shaded-java all 3.3.4-1 [1,855 kB] 2024-09-14T11:06:46.269 INFO:teuthology.orchestra.run.smithi138.stdout:Get:33 http://archive.ubuntu.com/ubuntu jammy/universe amd64 maven all 3.6.3-5 [17.8 kB] 2024-09-14T11:06:46.269 INFO:teuthology.orchestra.run.smithi138.stdout:Get:34 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-magic all 2:0.4.24-2 [12.6 kB] 2024-09-14T11:06:46.270 INFO:teuthology.orchestra.run.smithi138.stdout:Get:35 http://archive.ubuntu.com/ubuntu jammy/universe amd64 s3cmd all 2.2.0-1 [120 kB] 2024-09-14T11:06:46.317 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package libjansi-native-java. 2024-09-14T11:06:46.334 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../14-libjansi-native-java_1.8-1_all.deb ... 2024-09-14T11:06:46.376 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking libjansi-native-java (1.8-1) ... 2024-09-14T11:06:46.637 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package libjansi-java. 2024-09-14T11:06:46.653 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../15-libjansi-java_1.18-1_all.deb ... 2024-09-14T11:06:46.695 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking libjansi-java (1.18-1) ... 2024-09-14T11:06:46.716 INFO:teuthology.orchestra.run.smithi138.stdout:Fetched 10.4 MB in 1s (8,751 kB/s) 2024-09-14T11:06:46.820 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package libapache-pom-java. 2024-09-14T11:06:46.904 INFO:teuthology.orchestra.run.smithi138.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 176255 files and directories currently installed.) 2024-09-14T11:06:46.909 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../00-libapache-pom-java_18-1_all.deb ... 2024-09-14T11:06:46.922 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package libmaven-parent-java. 2024-09-14T11:06:46.939 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../16-libmaven-parent-java_31-2_all.deb ... 2024-09-14T11:06:46.969 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking libapache-pom-java (18-1) ... 2024-09-14T11:06:46.981 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking libmaven-parent-java (31-2) ... 2024-09-14T11:06:47.217 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package libplexus-utils2-java. 2024-09-14T11:06:47.233 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../17-libplexus-utils2-java_3.3.0-1_all.deb ... 2024-09-14T11:06:47.238 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package libatinject-jsr330-api-java. 2024-09-14T11:06:47.266 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../01-libatinject-jsr330-api-java_1.0+ds1-5_all.deb ... 2024-09-14T11:06:47.275 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking libplexus-utils2-java (3.3.0-1) ... 2024-09-14T11:06:47.305 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking libatinject-jsr330-api-java (1.0+ds1-5) ... 2024-09-14T11:06:47.553 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package libwagon-provider-api-java. 2024-09-14T11:06:47.569 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../18-libwagon-provider-api-java_3.3.4-1_all.deb ... 2024-09-14T11:06:47.607 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package libgeronimo-interceptor-3.0-spec-java. 2024-09-14T11:06:47.611 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking libwagon-provider-api-java (3.3.4-1) ... 2024-09-14T11:06:47.636 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../02-libgeronimo-interceptor-3.0-spec-java_1.0.1-4fakesync_all.deb ... 2024-09-14T11:06:47.682 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking libgeronimo-interceptor-3.0-spec-java (1.0.1-4fakesync) ... 2024-09-14T11:06:47.847 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package libmaven-resolver-java. 2024-09-14T11:06:47.864 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../19-libmaven-resolver-java_1.4.2-3build1_all.deb ... 2024-09-14T11:06:47.905 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking libmaven-resolver-java (1.4.2-3build1) ... 2024-09-14T11:06:48.201 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package libmaven-shared-utils-java. 2024-09-14T11:06:48.218 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../20-libmaven-shared-utils-java_3.3.0-1ubuntu0.22.04.1_all.deb ... 2024-09-14T11:06:48.251 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking libmaven-shared-utils-java (3.3.0-1ubuntu0.22.04.1) ... 2024-09-14T11:06:48.631 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package libcdi-api-java. 2024-09-14T11:06:48.655 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package libplexus-cipher-java. 2024-09-14T11:06:48.659 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../03-libcdi-api-java_1.2-3_all.deb ... 2024-09-14T11:06:48.683 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../21-libplexus-cipher-java_1.8-2_all.deb ... 2024-09-14T11:06:48.697 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking libcdi-api-java (1.2-3) ... 2024-09-14T11:06:48.722 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking libplexus-cipher-java (1.8-2) ... 2024-09-14T11:06:48.958 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package libcommons-cli-java. 2024-09-14T11:06:48.975 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package libplexus-classworlds-java. 2024-09-14T11:06:48.976 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../04-libcommons-cli-java_1.4-2_all.deb ... 2024-09-14T11:06:48.991 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../22-libplexus-classworlds-java_2.6.0-1_all.deb ... 2024-09-14T11:06:49.025 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking libcommons-cli-java (1.4-2) ... 2024-09-14T11:06:49.033 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking libplexus-classworlds-java (2.6.0-1) ... 2024-09-14T11:06:49.286 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package libplexus-component-annotations-java. 2024-09-14T11:06:49.302 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../23-libplexus-component-annotations-java_2.1.0-1_all.deb ... 2024-09-14T11:06:49.328 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package libcommons-parent-java. 2024-09-14T11:06:49.344 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking libplexus-component-annotations-java (2.1.0-1) ... 2024-09-14T11:06:49.355 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../05-libcommons-parent-java_43-1_all.deb ... 2024-09-14T11:06:49.402 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking libcommons-parent-java (43-1) ... 2024-09-14T11:06:49.555 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package libplexus-interpolation-java. 2024-09-14T11:06:49.572 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../24-libplexus-interpolation-java_1.26-1_all.deb ... 2024-09-14T11:06:49.605 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking libplexus-interpolation-java (1.26-1) ... 2024-09-14T11:06:49.697 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package libcommons-io-java. 2024-09-14T11:06:49.724 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../06-libcommons-io-java_2.11.0-2_all.deb ... 2024-09-14T11:06:49.763 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking libcommons-io-java (2.11.0-2) ... 2024-09-14T11:06:49.866 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package libplexus-sec-dispatcher-java. 2024-09-14T11:06:49.882 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../25-libplexus-sec-dispatcher-java_1.4-4_all.deb ... 2024-09-14T11:06:49.924 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking libplexus-sec-dispatcher-java (1.4-4) ... 2024-09-14T11:06:50.032 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package libcommons-lang3-java. 2024-09-14T11:06:50.048 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../07-libcommons-lang3-java_3.11-1_all.deb ... 2024-09-14T11:06:50.090 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking libcommons-lang3-java (3.11-1) ... 2024-09-14T11:06:50.185 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package libslf4j-java. 2024-09-14T11:06:50.202 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../26-libslf4j-java_1.7.32-1_all.deb ... 2024-09-14T11:06:50.243 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking libslf4j-java (1.7.32-1) ... 2024-09-14T11:06:50.393 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package libgeronimo-annotation-1.3-spec-java. 2024-09-14T11:06:50.407 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../08-libgeronimo-annotation-1.3-spec-java_1.3-1_all.deb ... 2024-09-14T11:06:50.451 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking libgeronimo-annotation-1.3-spec-java (1.3-1) ... 2024-09-14T11:06:50.530 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package libsisu-inject-java. 2024-09-14T11:06:50.547 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../27-libsisu-inject-java_0.3.4-2_all.deb ... 2024-09-14T11:06:50.589 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking libsisu-inject-java (0.3.4-2) ... 2024-09-14T11:06:50.704 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package libjsr305-java. 2024-09-14T11:06:50.719 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../09-libjsr305-java_0.1~+svn49-11_all.deb ... 2024-09-14T11:06:50.762 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking libjsr305-java (0.1~+svn49-11) ... 2024-09-14T11:06:50.867 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package libsisu-plexus-java. 2024-09-14T11:06:50.883 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../28-libsisu-plexus-java_0.3.4-3_all.deb ... 2024-09-14T11:06:50.925 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking libsisu-plexus-java (0.3.4-3) ... 2024-09-14T11:06:50.990 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package libguava-java. 2024-09-14T11:06:51.006 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../10-libguava-java_29.0-6_all.deb ... 2024-09-14T11:06:51.048 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking libguava-java (29.0-6) ... 2024-09-14T11:06:51.186 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package libmaven3-core-java. 2024-09-14T11:06:51.203 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../29-libmaven3-core-java_3.6.3-5_all.deb ... 2024-09-14T11:06:51.244 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking libmaven3-core-java (3.6.3-5) ... 2024-09-14T11:06:51.485 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package libaopalliance-java. 2024-09-14T11:06:51.512 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../11-libaopalliance-java_20070526-6_all.deb ... 2024-09-14T11:06:51.551 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking libaopalliance-java (20070526-6) ... 2024-09-14T11:06:51.607 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package libwagon-file-java. 2024-09-14T11:06:51.624 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../30-libwagon-file-java_3.3.4-1_all.deb ... 2024-09-14T11:06:51.665 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking libwagon-file-java (3.3.4-1) ... 2024-09-14T11:06:51.803 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package libguice-java. 2024-09-14T11:06:51.820 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../12-libguice-java_4.2.3-2_all.deb ... 2024-09-14T11:06:51.853 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking libguice-java (4.2.3-2) ... 2024-09-14T11:06:51.926 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package libwagon-http-shaded-java. 2024-09-14T11:06:51.943 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../31-libwagon-http-shaded-java_3.3.4-1_all.deb ... 2024-09-14T11:06:51.985 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking libwagon-http-shaded-java (3.3.4-1) ... 2024-09-14T11:06:52.241 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package libhawtjni-runtime-java. 2024-09-14T11:06:52.258 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../13-libhawtjni-runtime-java_1.17-1_all.deb ... 2024-09-14T11:06:52.299 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking libhawtjni-runtime-java (1.17-1) ... 2024-09-14T11:06:52.438 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package maven. 2024-09-14T11:06:52.466 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../32-maven_3.6.3-5_all.deb ... 2024-09-14T11:06:52.496 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking maven (3.6.3-5) ... 2024-09-14T11:06:52.577 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package libjansi-native-java. 2024-09-14T11:06:52.605 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../14-libjansi-native-java_1.8-1_all.deb ... 2024-09-14T11:06:52.651 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking libjansi-native-java (1.8-1) ... 2024-09-14T11:06:52.774 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package python3-magic. 2024-09-14T11:06:52.802 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../33-python3-magic_2%3a0.4.24-2_all.deb ... 2024-09-14T11:06:52.842 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking python3-magic (2:0.4.24-2) ... 2024-09-14T11:06:52.954 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package libjansi-java. 2024-09-14T11:06:52.982 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../15-libjansi-java_1.18-1_all.deb ... 2024-09-14T11:06:53.029 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking libjansi-java (1.18-1) ... 2024-09-14T11:06:53.144 INFO:teuthology.orchestra.run.smithi154.stdout:Selecting previously unselected package s3cmd. 2024-09-14T11:06:53.172 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing to unpack .../34-s3cmd_2.2.0-1_all.deb ... 2024-09-14T11:06:53.210 INFO:teuthology.orchestra.run.smithi154.stdout:Unpacking s3cmd (2.2.0-1) ... 2024-09-14T11:06:53.315 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package libmaven-parent-java. 2024-09-14T11:06:53.343 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../16-libmaven-parent-java_31-2_all.deb ... 2024-09-14T11:06:53.381 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking libmaven-parent-java (31-2) ... 2024-09-14T11:06:53.623 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up libslf4j-java (1.7.32-1) ... 2024-09-14T11:06:53.642 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package libplexus-utils2-java. 2024-09-14T11:06:53.659 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../17-libplexus-utils2-java_3.3.0-1_all.deb ... 2024-09-14T11:06:53.709 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking libplexus-utils2-java (3.3.0-1) ... 2024-09-14T11:06:53.774 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up libplexus-utils2-java (3.3.0-1) ... 2024-09-14T11:06:53.909 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up libplexus-classworlds-java (2.6.0-1) ... 2024-09-14T11:06:54.020 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package libwagon-provider-api-java. 2024-09-14T11:06:54.035 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up libjsr305-java (0.1~+svn49-11) ... 2024-09-14T11:06:54.048 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../18-libwagon-provider-api-java_3.3.4-1_all.deb ... 2024-09-14T11:06:54.095 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking libwagon-provider-api-java (3.3.4-1) ... 2024-09-14T11:06:54.161 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up libaopalliance-java (20070526-6) ... 2024-09-14T11:06:54.287 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up libcommons-cli-java (1.4-2) ... 2024-09-14T11:06:54.397 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package libmaven-resolver-java. 2024-09-14T11:06:54.413 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up libplexus-component-annotations-java (2.1.0-1) ... 2024-09-14T11:06:54.426 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../19-libmaven-resolver-java_1.4.2-3build1_all.deb ... 2024-09-14T11:06:54.472 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking libmaven-resolver-java (1.4.2-3build1) ... 2024-09-14T11:06:54.530 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up libplexus-cipher-java (1.8-2) ... 2024-09-14T11:06:54.640 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up libgeronimo-annotation-1.3-spec-java (1.3-1) ... 2024-09-14T11:06:54.768 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package libmaven-shared-utils-java. 2024-09-14T11:06:54.782 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up libgeronimo-interceptor-3.0-spec-java (1.0.1-4fakesync) ... 2024-09-14T11:06:54.784 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../20-libmaven-shared-utils-java_3.3.0-1ubuntu0.22.04.1_all.deb ... 2024-09-14T11:06:54.826 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking libmaven-shared-utils-java (3.3.0-1ubuntu0.22.04.1) ... 2024-09-14T11:06:54.910 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up libapache-pom-java (18-1) ... 2024-09-14T11:06:55.036 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up libatinject-jsr330-api-java (1.0+ds1-5) ... 2024-09-14T11:06:55.095 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package libplexus-cipher-java. 2024-09-14T11:06:55.111 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../21-libplexus-cipher-java_1.8-2_all.deb ... 2024-09-14T11:06:55.153 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking libplexus-cipher-java (1.8-2) ... 2024-09-14T11:06:55.162 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up libplexus-interpolation-java (1.26-1) ... 2024-09-14T11:06:55.288 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up libplexus-sec-dispatcher-java (1.4-4) ... 2024-09-14T11:06:55.406 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package libplexus-classworlds-java. 2024-09-14T11:06:55.434 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../22-libplexus-classworlds-java_2.6.0-1_all.deb ... 2024-09-14T11:06:55.439 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up libwagon-http-shaded-java (3.3.4-1) ... 2024-09-14T11:06:55.473 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking libplexus-classworlds-java (2.6.0-1) ... 2024-09-14T11:06:55.549 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up python3-magic (2:0.4.24-2) ... 2024-09-14T11:06:55.717 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package libplexus-component-annotations-java. 2024-09-14T11:06:55.733 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../23-libplexus-component-annotations-java_2.1.0-1_all.deb ... 2024-09-14T11:06:55.767 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking libplexus-component-annotations-java (2.1.0-1) ... 2024-09-14T11:06:55.808 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up libcdi-api-java (1.2-3) ... 2024-09-14T11:06:55.934 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up libhawtjni-runtime-java (1.17-1) ... 2024-09-14T11:06:55.986 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package libplexus-interpolation-java. 2024-09-14T11:06:56.014 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../24-libplexus-interpolation-java_1.26-1_all.deb ... 2024-09-14T11:06:56.053 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking libplexus-interpolation-java (1.26-1) ... 2024-09-14T11:06:56.060 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up libwagon-provider-api-java (3.3.4-1) ... 2024-09-14T11:06:56.186 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up libmaven-parent-java (31-2) ... 2024-09-14T11:06:56.312 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up libcommons-parent-java (43-1) ... 2024-09-14T11:06:56.363 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package libplexus-sec-dispatcher-java. 2024-09-14T11:06:56.379 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../25-libplexus-sec-dispatcher-java_1.4-4_all.deb ... 2024-09-14T11:06:56.421 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking libplexus-sec-dispatcher-java (1.4-4) ... 2024-09-14T11:06:56.438 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up libsisu-inject-java (0.3.4-2) ... 2024-09-14T11:06:56.565 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up s3cmd (2.2.0-1) ... 2024-09-14T11:06:56.677 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package libslf4j-java. 2024-09-14T11:06:56.702 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../26-libslf4j-java_1.7.32-1_all.deb ... 2024-09-14T11:06:56.741 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking libslf4j-java (1.7.32-1) ... 2024-09-14T11:06:56.857 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up libsisu-plexus-java (0.3.4-3) ... 2024-09-14T11:06:56.966 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up libmaven-resolver-java (1.4.2-3build1) ... 2024-09-14T11:06:57.003 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package libsisu-inject-java. 2024-09-14T11:06:57.019 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../27-libsisu-inject-java_0.3.4-2_all.deb ... 2024-09-14T11:06:57.061 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking libsisu-inject-java (0.3.4-2) ... 2024-09-14T11:06:57.092 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up libguava-java (29.0-6) ... 2024-09-14T11:06:57.219 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up libcommons-lang3-java (3.11-1) ... 2024-09-14T11:06:57.314 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package libsisu-plexus-java. 2024-09-14T11:06:57.332 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../28-libsisu-plexus-java_0.3.4-3_all.deb ... 2024-09-14T11:06:57.344 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up libjansi-native-java (1.8-1) ... 2024-09-14T11:06:57.372 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking libsisu-plexus-java (0.3.4-3) ... 2024-09-14T11:06:57.471 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up libwagon-file-java (3.3.4-1) ... 2024-09-14T11:06:57.597 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up libcommons-io-java (2.11.0-2) ... 2024-09-14T11:06:57.658 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package libmaven3-core-java. 2024-09-14T11:06:57.686 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../29-libmaven3-core-java_3.6.3-5_all.deb ... 2024-09-14T11:06:57.722 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up libguice-java (4.2.3-2) ... 2024-09-14T11:06:57.724 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking libmaven3-core-java (3.6.3-5) ... 2024-09-14T11:06:57.840 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up libjansi-java (1.18-1) ... 2024-09-14T11:06:57.941 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up libmaven-shared-utils-java (3.3.0-1ubuntu0.22.04.1) ... 2024-09-14T11:06:58.050 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up libmaven3-core-java (3.6.3-5) ... 2024-09-14T11:06:58.112 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package libwagon-file-java. 2024-09-14T11:06:58.140 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../30-libwagon-file-java_3.3.4-1_all.deb ... 2024-09-14T11:06:58.176 INFO:teuthology.orchestra.run.smithi154.stdout:Setting up maven (3.6.3-5) ... 2024-09-14T11:06:58.178 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking libwagon-file-java (3.3.4-1) ... 2024-09-14T11:06:58.431 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package libwagon-http-shaded-java. 2024-09-14T11:06:58.444 INFO:teuthology.orchestra.run.smithi154.stdout:update-alternatives: using /usr/share/maven/bin/mvn to provide /usr/bin/mvn (mvn) in auto mode 2024-09-14T11:06:58.456 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../31-libwagon-http-shaded-java_3.3.4-1_all.deb ... 2024-09-14T11:06:58.498 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking libwagon-http-shaded-java (3.3.4-1) ... 2024-09-14T11:06:58.514 INFO:teuthology.orchestra.run.smithi154.stdout:Processing triggers for man-db (2.10.2-1) ... 2024-09-14T11:06:58.976 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package maven. 2024-09-14T11:06:59.004 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../32-maven_3.6.3-5_all.deb ... 2024-09-14T11:06:59.042 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking maven (3.6.3-5) ... 2024-09-14T11:06:59.354 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package python3-magic. 2024-09-14T11:06:59.382 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../33-python3-magic_2%3a0.4.24-2_all.deb ... 2024-09-14T11:06:59.420 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking python3-magic (2:0.4.24-2) ... 2024-09-14T11:06:59.681 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package s3cmd. 2024-09-14T11:06:59.709 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../34-s3cmd_2.2.0-1_all.deb ... 2024-09-14T11:06:59.739 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking s3cmd (2.2.0-1) ... 2024-09-14T11:07:00.111 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up libslf4j-java (1.7.32-1) ... 2024-09-14T11:07:00.220 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up libplexus-utils2-java (3.3.0-1) ... 2024-09-14T11:07:00.263 INFO:teuthology.orchestra.run.smithi154.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2024-09-14T11:07:00.269 DEBUG:teuthology.parallel:result is None 2024-09-14T11:07:00.346 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up libplexus-classworlds-java (2.6.0-1) ... 2024-09-14T11:07:00.472 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up libjsr305-java (0.1~+svn49-11) ... 2024-09-14T11:07:00.614 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up libaopalliance-java (20070526-6) ... 2024-09-14T11:07:00.740 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up libcommons-cli-java (1.4-2) ... 2024-09-14T11:07:00.875 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up libplexus-component-annotations-java (2.1.0-1) ... 2024-09-14T11:07:01.001 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up libplexus-cipher-java (1.8-2) ... 2024-09-14T11:07:01.102 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up libgeronimo-annotation-1.3-spec-java (1.3-1) ... 2024-09-14T11:07:01.202 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up libgeronimo-interceptor-3.0-spec-java (1.0.1-4fakesync) ... 2024-09-14T11:07:01.312 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up libapache-pom-java (18-1) ... 2024-09-14T11:07:01.440 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up libatinject-jsr330-api-java (1.0+ds1-5) ... 2024-09-14T11:07:01.563 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up libplexus-interpolation-java (1.26-1) ... 2024-09-14T11:07:01.690 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up libplexus-sec-dispatcher-java (1.4-4) ... 2024-09-14T11:07:01.824 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up libwagon-http-shaded-java (3.3.4-1) ... 2024-09-14T11:07:01.950 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up python3-magic (2:0.4.24-2) ... 2024-09-14T11:07:02.202 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up libcdi-api-java (1.2-3) ... 2024-09-14T11:07:02.302 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up libhawtjni-runtime-java (1.17-1) ... 2024-09-14T11:07:02.420 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up libwagon-provider-api-java (3.3.4-1) ... 2024-09-14T11:07:02.546 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up libmaven-parent-java (31-2) ... 2024-09-14T11:07:02.672 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up libcommons-parent-java (43-1) ... 2024-09-14T11:07:02.798 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up libsisu-inject-java (0.3.4-2) ... 2024-09-14T11:07:02.924 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up s3cmd (2.2.0-1) ... 2024-09-14T11:07:03.225 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up libsisu-plexus-java (0.3.4-3) ... 2024-09-14T11:07:03.351 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up libmaven-resolver-java (1.4.2-3build1) ... 2024-09-14T11:07:03.477 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up libguava-java (29.0-6) ... 2024-09-14T11:07:03.603 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up libcommons-lang3-java (3.11-1) ... 2024-09-14T11:07:03.729 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up libjansi-native-java (1.8-1) ... 2024-09-14T11:07:03.839 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up libwagon-file-java (3.3.4-1) ... 2024-09-14T11:07:03.948 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up libcommons-io-java (2.11.0-2) ... 2024-09-14T11:07:04.099 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up libguice-java (4.2.3-2) ... 2024-09-14T11:07:04.242 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up libjansi-java (1.18-1) ... 2024-09-14T11:07:04.368 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up libmaven-shared-utils-java (3.3.0-1ubuntu0.22.04.1) ... 2024-09-14T11:07:04.494 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up libmaven3-core-java (3.6.3-5) ... 2024-09-14T11:07:04.620 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up maven (3.6.3-5) ... 2024-09-14T11:07:04.877 INFO:teuthology.orchestra.run.smithi138.stdout:update-alternatives: using /usr/share/maven/bin/mvn to provide /usr/bin/mvn (mvn) in auto mode 2024-09-14T11:07:04.940 INFO:teuthology.orchestra.run.smithi138.stdout:Processing triggers for man-db (2.10.2-1) ... 2024-09-14T11:07:06.556 INFO:teuthology.orchestra.run.smithi138.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2024-09-14T11:07:06.561 DEBUG:teuthology.parallel:result is None 2024-09-14T11:07:06.562 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=a2782315255a3e7d5f6cdc9eb35785187ff6ddf8 2024-09-14T11:07:06.704 DEBUG:teuthology.orchestra.run.smithi138:> dpkg-query -W -f '${Version}' ceph 2024-09-14T11:07:06.723 INFO:teuthology.orchestra.run.smithi138.stdout:19.3.0-4907-ga2782315-1jammy 2024-09-14T11:07:06.723 INFO:teuthology.packaging:The installed version of ceph is 19.3.0-4907-ga2782315-1jammy 2024-09-14T11:07:06.724 INFO:teuthology.task.install:The correct ceph version 19.3.0-4907-ga2782315-1jammy is installed. 2024-09-14T11:07:06.726 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=a2782315255a3e7d5f6cdc9eb35785187ff6ddf8 2024-09-14T11:07:06.864 DEBUG:teuthology.orchestra.run.smithi154:> dpkg-query -W -f '${Version}' ceph 2024-09-14T11:07:06.884 INFO:teuthology.orchestra.run.smithi154.stdout:19.3.0-4907-ga2782315-1jammy 2024-09-14T11:07:06.884 INFO:teuthology.packaging:The installed version of ceph is 19.3.0-4907-ga2782315-1jammy 2024-09-14T11:07:06.884 INFO:teuthology.task.install:The correct ceph version 19.3.0-4907-ga2782315-1jammy is installed. 2024-09-14T11:07:06.886 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2024-09-14T11:07:06.886 DEBUG:teuthology.orchestra.run.smithi138:> set -ex 2024-09-14T11:07:06.887 DEBUG:teuthology.orchestra.run.smithi138:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-09-14T11:07:06.902 DEBUG:teuthology.orchestra.run.smithi154:> set -ex 2024-09-14T11:07:06.902 DEBUG:teuthology.orchestra.run.smithi154:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-09-14T11:07:06.941 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2024-09-14T11:07:06.941 DEBUG:teuthology.orchestra.run.smithi138:> set -ex 2024-09-14T11:07:06.941 DEBUG:teuthology.orchestra.run.smithi138:> sudo dd of=/usr/bin/daemon-helper 2024-09-14T11:07:06.959 DEBUG:teuthology.orchestra.run.smithi138:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-09-14T11:07:07.013 DEBUG:teuthology.orchestra.run.smithi154:> set -ex 2024-09-14T11:07:07.013 DEBUG:teuthology.orchestra.run.smithi154:> sudo dd of=/usr/bin/daemon-helper 2024-09-14T11:07:07.027 DEBUG:teuthology.orchestra.run.smithi154:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-09-14T11:07:07.083 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2024-09-14T11:07:07.084 DEBUG:teuthology.orchestra.run.smithi138:> set -ex 2024-09-14T11:07:07.084 DEBUG:teuthology.orchestra.run.smithi138:> sudo dd of=/usr/bin/adjust-ulimits 2024-09-14T11:07:07.097 DEBUG:teuthology.orchestra.run.smithi138:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-09-14T11:07:07.149 DEBUG:teuthology.orchestra.run.smithi154:> set -ex 2024-09-14T11:07:07.149 DEBUG:teuthology.orchestra.run.smithi154:> sudo dd of=/usr/bin/adjust-ulimits 2024-09-14T11:07:07.163 DEBUG:teuthology.orchestra.run.smithi154:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-09-14T11:07:07.216 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2024-09-14T11:07:07.216 DEBUG:teuthology.orchestra.run.smithi138:> set -ex 2024-09-14T11:07:07.216 DEBUG:teuthology.orchestra.run.smithi138:> sudo dd of=/usr/bin/stdin-killer 2024-09-14T11:07:07.230 DEBUG:teuthology.orchestra.run.smithi138:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-09-14T11:07:07.285 DEBUG:teuthology.orchestra.run.smithi154:> set -ex 2024-09-14T11:07:07.285 DEBUG:teuthology.orchestra.run.smithi154:> sudo dd of=/usr/bin/stdin-killer 2024-09-14T11:07:07.299 DEBUG:teuthology.orchestra.run.smithi154:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-09-14T11:07:07.354 INFO:teuthology.run_tasks:Running task ceph... 2024-09-14T11:07:07.430 INFO:tasks.ceph:Making ceph log dir writeable by non-root... 2024-09-14T11:07:07.431 DEBUG:teuthology.orchestra.run.smithi138:> sudo chmod 777 /var/log/ceph 2024-09-14T11:07:07.433 DEBUG:teuthology.orchestra.run.smithi154:> sudo chmod 777 /var/log/ceph 2024-09-14T11:07:07.444 INFO:tasks.ceph:Disabling ceph logrotate... 2024-09-14T11:07:07.445 DEBUG:teuthology.orchestra.run.smithi138:> sudo rm -f -- /etc/logrotate.d/ceph 2024-09-14T11:07:07.487 DEBUG:teuthology.orchestra.run.smithi154:> sudo rm -f -- /etc/logrotate.d/ceph 2024-09-14T11:07:07.499 INFO:tasks.ceph:Creating extra log directories... 2024-09-14T11:07:07.500 DEBUG:teuthology.orchestra.run.smithi138:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2024-09-14T11:07:07.543 DEBUG:teuthology.orchestra.run.smithi154:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2024-09-14T11:07:07.567 INFO:tasks.ceph:Creating ceph cluster ceph... 2024-09-14T11:07:07.569 INFO:tasks.ceph:config {'conf': {'client': {'debug rgw': 20, 'debug rgw notification': 20, 'rgw bucket counters cache': True, 'rgw crypt require ssl': False, 'rgw crypt s3 kms backend': 'testing', 'rgw crypt s3 kms encryption keys': 'testkey-1=YmluCmJvb3N0CmJvb3N0LWJ1aWxkCmNlcGguY29uZgo= testkey-2=aWIKTWFrZWZpbGUKbWFuCm91dApzcmMKVGVzdGluZwo=', 'rgw reshard progress judge interval': 10, 'rgw s3 auth use sts': True, 'rgw sts key': 'abcdefghijklmnop', 'rgw torrent flag': True, 'rgw user counters cache': True, 'setgroup': 'ceph', 'setuser': 'ceph'}, 'global': {'mon client directed command retry': 5, 'ms inject socket failures': 5000, 'osd heartbeat grace': 40, 'osd_max_pg_log_entries': 10, 'osd_min_pg_log_entries': 10}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon osd crush smoke test': False}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug objclass': 20, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd fast shutdown': False, 'osd objectstore': 'bluestore', 'osd shutdown pgref assert': True}}, 'fs': 'xfs', 'mkfs_options': None, 'mount_options': None, 'skip_mgr_daemons': False, 'log_ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(PG_AVAILABILITY\\)', '\\(PG_DEGRADED\\)', '\\(POOL_APP_NOT_ENABLED\\)', 'not have an application enabled', '\\(OSD_SLOW_PING_TIME'], 'cpu_profile': set(), 'cluster': 'ceph', 'mon_bind_msgr2': True, 'mon_bind_addrvec': True} 2024-09-14T11:07:07.569 INFO:tasks.ceph:ctx.config {'archive_path': '/home/teuthworker/archive/teuthology-2024-09-13_20:40:18-rgw-main-distro-default-smithi/7904155', 'branch': 'main', 'description': 'rgw/verify/{0-install accounts$/{main} clusters/fixed-2 datacache/no_datacache frontend/beast ignore-pg-availability inline-data$/{on} msgr-failures/few objectstore/bluestore-bitmap overrides proto/https rgw_pool_type/ec s3tests-branch sharding$/{default} striping$/{stripe-equals-chunk} supported-random-distro$/{ubuntu_latest} tasks/{bucket-check cls mp_reupload ragweed reshard s3tests-java s3tests versioning} validater/valgrind}', 'email': 'ceph-qa@ceph.com', 'first_in_suite': False, 'job_id': '7904155', 'kernel': {'kdb': 1, 'sha1': 'distro'}, 'ktype': 'distro', 'last_in_suite': False, 'machine_type': 'smithi', 'name': 'teuthology-2024-09-13_20:40:18-rgw-main-distro-default-smithi', 'no_nested_subset': False, 'openstack': [{'volumes': {'count': 4, 'size': 10}}], 'os_type': 'ubuntu', 'os_version': '22.04', 'overrides': {'admin_socket': {'branch': 'main'}, 'ceph': {'conf': {'client': {'debug rgw': 20, 'debug rgw notification': 20, 'rgw bucket counters cache': True, 'rgw crypt require ssl': False, 'rgw crypt s3 kms backend': 'testing', 'rgw crypt s3 kms encryption keys': 'testkey-1=YmluCmJvb3N0CmJvb3N0LWJ1aWxkCmNlcGguY29uZgo= testkey-2=aWIKTWFrZWZpbGUKbWFuCm91dApzcmMKVGVzdGluZwo=', 'rgw reshard progress judge interval': 10, 'rgw s3 auth use sts': True, 'rgw sts key': 'abcdefghijklmnop', 'rgw torrent flag': True, 'rgw user counters cache': True, 'setgroup': 'ceph', 'setuser': 'ceph'}, 'global': {'mon client directed command retry': 5, 'ms inject socket failures': 5000, 'osd heartbeat grace': 40, 'osd_max_pg_log_entries': 10, 'osd_min_pg_log_entries': 10}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon osd crush smoke test': False}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug objclass': 20, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd fast shutdown': False, 'osd objectstore': 'bluestore', 'osd shutdown pgref assert': True}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(PG_AVAILABILITY\\)', '\\(PG_DEGRADED\\)', '\\(POOL_APP_NOT_ENABLED\\)', 'not have an application enabled', '\\(OSD_SLOW_PING_TIME'], 'sha1': 'a2782315255a3e7d5f6cdc9eb35785187ff6ddf8'}, 'ceph-deploy': {'bluestore': True, 'conf': {'client': {'log file': '/var/log/ceph/ceph-$name.$pid.log'}, 'mon': {}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore'}}, 'fs': 'xfs'}, 'install': {'ceph': {'flavor': 'default', 'sha1': 'a2782315255a3e7d5f6cdc9eb35785187ff6ddf8'}}, 'openssl_keys': {'rgw.client.0': {'ca': 'root', 'client': 'client.0', 'embed-key': True}, 'root': {'client': 'client.0', 'cn': 'teuthology', 'install': ['client.0'], 'key-type': 'rsa:4096'}}, 'rgw': {'client.0': {'ssl certificate': 'rgw.client.0', 'valgrind': ['--tool=memcheck', '--max-threads=1024']}, 'compression type': 'random', 'ec-data-pool': True, 'frontend': 'beast', 'storage classes': 'LUKEWARM, FROZEN'}, 's3tests': {'accounts': {'iam alt root': 'RGW99999999999999999', 'iam root': 'RGW88888888888888888', 's3 main': 'RGW11111111111111111'}, 'force-branch': 'ceph-master', 'slow_backend': True, 'storage classes': 'LUKEWARM, FROZEN'}, 'thrashosds': {'bdev_inject_crash': 2, 'bdev_inject_crash_probability': 0.5}, 'workunit': {'branch': 'main', 'sha1': '1c941a66c1b420259b8fc5ac19e792dbbf60aded'}}, 'owner': 'scheduled_teuthology@teuthology', 'priority': 950, 'repo': 'https://git.ceph.com/ceph.git', 'roles': [['mon.a', 'mon.c', 'mgr.y', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'node-exporter.a'], ['mon.b', 'mgr.x', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'prometheus.a', 'node-exporter.b']], 'seed': 9419, 'sha1': 'a2782315255a3e7d5f6cdc9eb35785187ff6ddf8', 'sleep_before_teardown': 0, 'subset': '0/1', 'suite': 'rgw', 'suite_branch': 'main', 'suite_path': '/home/teuthworker/src/git.ceph.com_ceph_1c941a66c1b420259b8fc5ac19e792dbbf60aded/qa', 'suite_relpath': 'qa', 'suite_repo': 'https://git.ceph.com/ceph.git', 'suite_sha1': '1c941a66c1b420259b8fc5ac19e792dbbf60aded', 'targets': {'smithi138.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBA3HcMCv3EgNLrmHubEDMEUOlYZgj/btMt9XzPHvLNHepFNT9kJDW89KxHP9rhok1iPXtlWs7koKlMsd26xdBJ0=', 'smithi154.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBApvcwJ2ylCHIsybYBdfo7GEWl0M6MakZCoK4HdYOT4nsbfWrd7rpR0FZaDTNLhHVBcBK5MWMgVJ30a8ZJ9W7u0='}, 'tasks': [{'internal.check_packages': None}, {'internal.buildpackages_prep': None}, {'internal.save_config': None}, {'internal.check_lock': None}, {'internal.add_remotes': None}, {'console_log': None}, {'internal.connect': None}, {'internal.push_inventory': None}, {'internal.serialize_remote_roles': None}, {'internal.check_conflict': None}, {'internal.check_ceph_data': None}, {'internal.vm_setup': None}, {'kernel': {'kdb': 1, 'sha1': 'distro'}}, {'internal.base': None}, {'internal.archive_upload': None}, {'internal.archive': None}, {'internal.coredump': None}, {'internal.sudo': None}, {'internal.syslog': None}, {'internal.timer': None}, {'pcp': None}, {'selinux': None}, {'ansible.cephlab': None}, {'clock': None}, {'install': {'extra_system_packages': {'deb': ['s3cmd', 'maven'], 'rpm': ['s3cmd', 'maven']}, 'flavor': 'default', 'sha1': 'a2782315255a3e7d5f6cdc9eb35785187ff6ddf8'}}, {'ceph': None}, {'openssl_keys': None}, {'rgw': {'client.0': None}}, {'tox': ['client.0']}, {'workunit': {'clients': {'client.0': ['rgw/run-bucket-check.sh']}}}, {'workunit': {'clients': {'client.0': ['cls/test_cls_lock.sh', 'cls/test_cls_log.sh', 'cls/test_cls_refcount.sh', 'cls/test_cls_rgw.sh', 'cls/test_cls_rgw_gc.sh', 'cls/test_cls_rgw_stats.sh', 'cls/test_cls_cmpomap.sh', 'cls/test_cls_2pc_queue.sh', 'cls/test_cls_user.sh', 'rgw/test_rgw_gc_log.sh', 'rgw/test_rgw_obj.sh', 'rgw/test_librgw_file.sh', 'rgw/test_awssdkv4_sig.sh']}}}, {'workunit': {'clients': {'client.0': ['rgw/test_rgw_s3_mp_reupload.sh']}}}, {'ragweed': {'client.0': {'default-branch': 'ceph-master', 'rgw_server': 'client.0', 'stages': 'prepare,check'}}}, {'workunit': {'clients': {'client.0': ['rgw/run-reshard.sh']}}}, {'s3tests-java': {'client.0': {'force-branch': 'ceph-master', 'force-repo': 'https://github.com/ceph/java_s3tests.git'}}}, {'s3tests': {'client.0': {'rgw_server': 'client.0'}}}, {'workunit': {'clients': {'client.0': ['rgw/run-versioning.sh']}}}], 'teuthology': {'fragments_dropped': [], 'meta': {}, 'postmerge': []}, 'teuthology_branch': 'main', 'teuthology_sha1': '3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a', 'timestamp': '2024-09-13_20:40:18', 'tube': 'smithi', 'user': 'teuthology', 'verbose': False, 'worker_log': '/home/teuthworker/archive/worker_logs/dispatcher.smithi.3401856'} 2024-09-14T11:07:07.569 DEBUG:teuthology.orchestra.run.smithi138:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2024-09-14T11:07:07.600 DEBUG:teuthology.orchestra.run.smithi154:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2024-09-14T11:07:07.605 DEBUG:teuthology.orchestra.run.smithi138:> sudo install -d -m0777 -- /var/run/ceph 2024-09-14T11:07:07.648 DEBUG:teuthology.orchestra.run.smithi154:> sudo install -d -m0777 -- /var/run/ceph 2024-09-14T11:07:07.661 DEBUG:teuthology.orchestra.run.smithi138:> set -ex 2024-09-14T11:07:07.661 DEBUG:teuthology.orchestra.run.smithi138:> dd if=/scratch_devs of=/dev/stdout 2024-09-14T11:07:07.706 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-09-14T11:07:07.706 DEBUG:teuthology.orchestra.run.smithi138:> stat /dev/vg_nvme/lv_1 2024-09-14T11:07:07.754 INFO:teuthology.orchestra.run.smithi138.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-09-14T11:07:07.755 INFO:teuthology.orchestra.run.smithi138.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-14T11:07:07.755 INFO:teuthology.orchestra.run.smithi138.stdout:Device: 5h/5d Inode: 884 Links: 1 2024-09-14T11:07:07.755 INFO:teuthology.orchestra.run.smithi138.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-14T11:07:07.755 INFO:teuthology.orchestra.run.smithi138.stdout:Access: 2024-09-14 11:01:15.896140407 +0000 2024-09-14T11:07:07.755 INFO:teuthology.orchestra.run.smithi138.stdout:Modify: 2024-09-14 11:01:15.588143159 +0000 2024-09-14T11:07:07.755 INFO:teuthology.orchestra.run.smithi138.stdout:Change: 2024-09-14 11:01:15.588143159 +0000 2024-09-14T11:07:07.755 INFO:teuthology.orchestra.run.smithi138.stdout: Birth: - 2024-09-14T11:07:07.755 DEBUG:teuthology.orchestra.run.smithi138:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-09-14T11:07:07.809 INFO:teuthology.orchestra.run.smithi138.stderr:1+0 records in 2024-09-14T11:07:07.809 INFO:teuthology.orchestra.run.smithi138.stderr:1+0 records out 2024-09-14T11:07:07.809 INFO:teuthology.orchestra.run.smithi138.stderr:512 bytes copied, 0.000447583 s, 1.1 MB/s 2024-09-14T11:07:07.810 DEBUG:teuthology.orchestra.run.smithi138:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-09-14T11:07:07.860 DEBUG:teuthology.orchestra.run.smithi138:> stat /dev/vg_nvme/lv_2 2024-09-14T11:07:07.906 INFO:teuthology.orchestra.run.smithi138.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-09-14T11:07:07.906 INFO:teuthology.orchestra.run.smithi138.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-14T11:07:07.906 INFO:teuthology.orchestra.run.smithi138.stdout:Device: 5h/5d Inode: 899 Links: 1 2024-09-14T11:07:07.906 INFO:teuthology.orchestra.run.smithi138.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-14T11:07:07.907 INFO:teuthology.orchestra.run.smithi138.stdout:Access: 2024-09-14 11:01:16.412135799 +0000 2024-09-14T11:07:07.907 INFO:teuthology.orchestra.run.smithi138.stdout:Modify: 2024-09-14 11:01:16.136138264 +0000 2024-09-14T11:07:07.907 INFO:teuthology.orchestra.run.smithi138.stdout:Change: 2024-09-14 11:01:16.136138264 +0000 2024-09-14T11:07:07.907 INFO:teuthology.orchestra.run.smithi138.stdout: Birth: - 2024-09-14T11:07:07.907 DEBUG:teuthology.orchestra.run.smithi138:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-09-14T11:07:07.960 INFO:teuthology.orchestra.run.smithi138.stderr:1+0 records in 2024-09-14T11:07:07.961 INFO:teuthology.orchestra.run.smithi138.stderr:1+0 records out 2024-09-14T11:07:07.961 INFO:teuthology.orchestra.run.smithi138.stderr:512 bytes copied, 0.000443846 s, 1.2 MB/s 2024-09-14T11:07:07.962 DEBUG:teuthology.orchestra.run.smithi138:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-09-14T11:07:08.012 DEBUG:teuthology.orchestra.run.smithi138:> stat /dev/vg_nvme/lv_3 2024-09-14T11:07:08.058 INFO:teuthology.orchestra.run.smithi138.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-09-14T11:07:08.059 INFO:teuthology.orchestra.run.smithi138.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-14T11:07:08.059 INFO:teuthology.orchestra.run.smithi138.stdout:Device: 5h/5d Inode: 921 Links: 1 2024-09-14T11:07:08.059 INFO:teuthology.orchestra.run.smithi138.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-14T11:07:08.059 INFO:teuthology.orchestra.run.smithi138.stdout:Access: 2024-09-14 11:01:16.904131403 +0000 2024-09-14T11:07:08.059 INFO:teuthology.orchestra.run.smithi138.stdout:Modify: 2024-09-14 11:01:16.656133618 +0000 2024-09-14T11:07:08.059 INFO:teuthology.orchestra.run.smithi138.stdout:Change: 2024-09-14 11:01:16.656133618 +0000 2024-09-14T11:07:08.059 INFO:teuthology.orchestra.run.smithi138.stdout: Birth: - 2024-09-14T11:07:08.059 DEBUG:teuthology.orchestra.run.smithi138:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-09-14T11:07:08.113 INFO:teuthology.orchestra.run.smithi138.stderr:1+0 records in 2024-09-14T11:07:08.113 INFO:teuthology.orchestra.run.smithi138.stderr:1+0 records out 2024-09-14T11:07:08.113 INFO:teuthology.orchestra.run.smithi138.stderr:512 bytes copied, 0.000354137 s, 1.4 MB/s 2024-09-14T11:07:08.114 DEBUG:teuthology.orchestra.run.smithi138:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-09-14T11:07:08.164 DEBUG:teuthology.orchestra.run.smithi138:> stat /dev/vg_nvme/lv_4 2024-09-14T11:07:08.211 INFO:teuthology.orchestra.run.smithi138.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-09-14T11:07:08.211 INFO:teuthology.orchestra.run.smithi138.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-14T11:07:08.211 INFO:teuthology.orchestra.run.smithi138.stdout:Device: 5h/5d Inode: 933 Links: 1 2024-09-14T11:07:08.211 INFO:teuthology.orchestra.run.smithi138.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-14T11:07:08.211 INFO:teuthology.orchestra.run.smithi138.stdout:Access: 2024-09-14 11:01:17.408126902 +0000 2024-09-14T11:07:08.211 INFO:teuthology.orchestra.run.smithi138.stdout:Modify: 2024-09-14 11:01:17.156129153 +0000 2024-09-14T11:07:08.211 INFO:teuthology.orchestra.run.smithi138.stdout:Change: 2024-09-14 11:01:17.156129153 +0000 2024-09-14T11:07:08.211 INFO:teuthology.orchestra.run.smithi138.stdout: Birth: - 2024-09-14T11:07:08.212 DEBUG:teuthology.orchestra.run.smithi138:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-09-14T11:07:08.265 INFO:teuthology.orchestra.run.smithi138.stderr:1+0 records in 2024-09-14T11:07:08.265 INFO:teuthology.orchestra.run.smithi138.stderr:1+0 records out 2024-09-14T11:07:08.265 INFO:teuthology.orchestra.run.smithi138.stderr:512 bytes copied, 0.00039031 s, 1.3 MB/s 2024-09-14T11:07:08.266 DEBUG:teuthology.orchestra.run.smithi138:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-09-14T11:07:08.316 INFO:tasks.ceph:osd dev map: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-09-14T11:07:08.316 DEBUG:teuthology.orchestra.run.smithi154:> set -ex 2024-09-14T11:07:08.316 DEBUG:teuthology.orchestra.run.smithi154:> dd if=/scratch_devs of=/dev/stdout 2024-09-14T11:07:08.322 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-09-14T11:07:08.322 DEBUG:teuthology.orchestra.run.smithi154:> stat /dev/vg_nvme/lv_1 2024-09-14T11:07:08.368 INFO:teuthology.orchestra.run.smithi154.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-09-14T11:07:08.368 INFO:teuthology.orchestra.run.smithi154.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-14T11:07:08.369 INFO:teuthology.orchestra.run.smithi154.stdout:Device: 5h/5d Inode: 888 Links: 1 2024-09-14T11:07:08.369 INFO:teuthology.orchestra.run.smithi154.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-14T11:07:08.369 INFO:teuthology.orchestra.run.smithi154.stdout:Access: 2024-09-14 11:01:15.557197772 +0000 2024-09-14T11:07:08.369 INFO:teuthology.orchestra.run.smithi154.stdout:Modify: 2024-09-14 11:01:15.553197808 +0000 2024-09-14T11:07:08.369 INFO:teuthology.orchestra.run.smithi154.stdout:Change: 2024-09-14 11:01:15.553197808 +0000 2024-09-14T11:07:08.369 INFO:teuthology.orchestra.run.smithi154.stdout: Birth: - 2024-09-14T11:07:08.369 DEBUG:teuthology.orchestra.run.smithi154:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-09-14T11:07:08.423 INFO:teuthology.orchestra.run.smithi154.stderr:1+0 records in 2024-09-14T11:07:08.423 INFO:teuthology.orchestra.run.smithi154.stderr:1+0 records out 2024-09-14T11:07:08.423 INFO:teuthology.orchestra.run.smithi154.stderr:512 bytes copied, 0.000448333 s, 1.1 MB/s 2024-09-14T11:07:08.424 DEBUG:teuthology.orchestra.run.smithi154:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-09-14T11:07:08.474 DEBUG:teuthology.orchestra.run.smithi154:> stat /dev/vg_nvme/lv_2 2024-09-14T11:07:08.520 INFO:teuthology.orchestra.run.smithi154.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-09-14T11:07:08.520 INFO:teuthology.orchestra.run.smithi154.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-14T11:07:08.520 INFO:teuthology.orchestra.run.smithi154.stdout:Device: 5h/5d Inode: 905 Links: 1 2024-09-14T11:07:08.520 INFO:teuthology.orchestra.run.smithi154.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-14T11:07:08.520 INFO:teuthology.orchestra.run.smithi154.stdout:Access: 2024-09-14 11:01:16.309191055 +0000 2024-09-14T11:07:08.521 INFO:teuthology.orchestra.run.smithi154.stdout:Modify: 2024-09-14 11:01:16.029193555 +0000 2024-09-14T11:07:08.521 INFO:teuthology.orchestra.run.smithi154.stdout:Change: 2024-09-14 11:01:16.029193555 +0000 2024-09-14T11:07:08.521 INFO:teuthology.orchestra.run.smithi154.stdout: Birth: - 2024-09-14T11:07:08.521 DEBUG:teuthology.orchestra.run.smithi154:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-09-14T11:07:08.574 INFO:teuthology.orchestra.run.smithi154.stderr:1+0 records in 2024-09-14T11:07:08.574 INFO:teuthology.orchestra.run.smithi154.stderr:1+0 records out 2024-09-14T11:07:08.574 INFO:teuthology.orchestra.run.smithi154.stderr:512 bytes copied, 0.000329016 s, 1.6 MB/s 2024-09-14T11:07:08.575 DEBUG:teuthology.orchestra.run.smithi154:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-09-14T11:07:08.625 DEBUG:teuthology.orchestra.run.smithi154:> stat /dev/vg_nvme/lv_3 2024-09-14T11:07:08.672 INFO:teuthology.orchestra.run.smithi154.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-09-14T11:07:08.672 INFO:teuthology.orchestra.run.smithi154.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-14T11:07:08.672 INFO:teuthology.orchestra.run.smithi154.stdout:Device: 5h/5d Inode: 923 Links: 1 2024-09-14T11:07:08.672 INFO:teuthology.orchestra.run.smithi154.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-14T11:07:08.672 INFO:teuthology.orchestra.run.smithi154.stdout:Access: 2024-09-14 11:01:16.793186732 +0000 2024-09-14T11:07:08.672 INFO:teuthology.orchestra.run.smithi154.stdout:Modify: 2024-09-14 11:01:16.537189018 +0000 2024-09-14T11:07:08.672 INFO:teuthology.orchestra.run.smithi154.stdout:Change: 2024-09-14 11:01:16.537189018 +0000 2024-09-14T11:07:08.673 INFO:teuthology.orchestra.run.smithi154.stdout: Birth: - 2024-09-14T11:07:08.673 DEBUG:teuthology.orchestra.run.smithi154:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-09-14T11:07:08.727 INFO:teuthology.orchestra.run.smithi154.stderr:1+0 records in 2024-09-14T11:07:08.727 INFO:teuthology.orchestra.run.smithi154.stderr:1+0 records out 2024-09-14T11:07:08.727 INFO:teuthology.orchestra.run.smithi154.stderr:512 bytes copied, 0.000440137 s, 1.2 MB/s 2024-09-14T11:07:08.728 DEBUG:teuthology.orchestra.run.smithi154:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-09-14T11:07:08.777 DEBUG:teuthology.orchestra.run.smithi154:> stat /dev/vg_nvme/lv_4 2024-09-14T11:07:08.824 INFO:teuthology.orchestra.run.smithi154.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-09-14T11:07:08.824 INFO:teuthology.orchestra.run.smithi154.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-14T11:07:08.824 INFO:teuthology.orchestra.run.smithi154.stdout:Device: 5h/5d Inode: 937 Links: 1 2024-09-14T11:07:08.824 INFO:teuthology.orchestra.run.smithi154.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-14T11:07:08.824 INFO:teuthology.orchestra.run.smithi154.stdout:Access: 2024-09-14 11:01:17.285182337 +0000 2024-09-14T11:07:08.824 INFO:teuthology.orchestra.run.smithi154.stdout:Modify: 2024-09-14 11:01:17.021184695 +0000 2024-09-14T11:07:08.824 INFO:teuthology.orchestra.run.smithi154.stdout:Change: 2024-09-14 11:01:17.021184695 +0000 2024-09-14T11:07:08.824 INFO:teuthology.orchestra.run.smithi154.stdout: Birth: - 2024-09-14T11:07:08.824 DEBUG:teuthology.orchestra.run.smithi154:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-09-14T11:07:08.878 INFO:teuthology.orchestra.run.smithi154.stderr:1+0 records in 2024-09-14T11:07:08.879 INFO:teuthology.orchestra.run.smithi154.stderr:1+0 records out 2024-09-14T11:07:08.879 INFO:teuthology.orchestra.run.smithi154.stderr:512 bytes copied, 0.000389534 s, 1.3 MB/s 2024-09-14T11:07:08.880 DEBUG:teuthology.orchestra.run.smithi154:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-09-14T11:07:08.929 INFO:tasks.ceph:osd dev map: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-09-14T11:07:08.929 INFO:tasks.ceph:remote_to_roles_to_devs: {Remote(name='ubuntu@smithi138.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi154.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2024-09-14T11:07:08.929 INFO:tasks.ceph:Generating config... 2024-09-14T11:07:08.931 INFO:tasks.ceph:[client] debug rgw = 20 2024-09-14T11:07:08.931 INFO:tasks.ceph:[client] debug rgw notification = 20 2024-09-14T11:07:08.931 INFO:tasks.ceph:[client] rgw bucket counters cache = True 2024-09-14T11:07:08.931 INFO:tasks.ceph:[client] rgw crypt require ssl = False 2024-09-14T11:07:08.931 INFO:tasks.ceph:[client] rgw crypt s3 kms backend = testing 2024-09-14T11:07:08.931 INFO:tasks.ceph:[client] rgw crypt s3 kms encryption keys = testkey-1=YmluCmJvb3N0CmJvb3N0LWJ1aWxkCmNlcGguY29uZgo= testkey-2=aWIKTWFrZWZpbGUKbWFuCm91dApzcmMKVGVzdGluZwo= 2024-09-14T11:07:08.931 INFO:tasks.ceph:[client] rgw reshard progress judge interval = 10 2024-09-14T11:07:08.931 INFO:tasks.ceph:[client] rgw s3 auth use sts = True 2024-09-14T11:07:08.931 INFO:tasks.ceph:[client] rgw sts key = abcdefghijklmnop 2024-09-14T11:07:08.931 INFO:tasks.ceph:[client] rgw torrent flag = True 2024-09-14T11:07:08.931 INFO:tasks.ceph:[client] rgw user counters cache = True 2024-09-14T11:07:08.931 INFO:tasks.ceph:[client] setgroup = ceph 2024-09-14T11:07:08.932 INFO:tasks.ceph:[client] setuser = ceph 2024-09-14T11:07:08.932 INFO:tasks.ceph:[global] mon client directed command retry = 5 2024-09-14T11:07:08.932 INFO:tasks.ceph:[global] ms inject socket failures = 5000 2024-09-14T11:07:08.932 INFO:tasks.ceph:[global] osd heartbeat grace = 40 2024-09-14T11:07:08.932 INFO:tasks.ceph:[global] osd_max_pg_log_entries = 10 2024-09-14T11:07:08.932 INFO:tasks.ceph:[global] osd_min_pg_log_entries = 10 2024-09-14T11:07:08.932 INFO:tasks.ceph:[mgr] debug mgr = 20 2024-09-14T11:07:08.932 INFO:tasks.ceph:[mgr] debug ms = 1 2024-09-14T11:07:08.932 INFO:tasks.ceph:[mon] debug mon = 20 2024-09-14T11:07:08.932 INFO:tasks.ceph:[mon] debug ms = 1 2024-09-14T11:07:08.932 INFO:tasks.ceph:[mon] debug paxos = 20 2024-09-14T11:07:08.932 INFO:tasks.ceph:[mon] mon osd crush smoke test = False 2024-09-14T11:07:08.932 INFO:tasks.ceph:[osd] bdev async discard = True 2024-09-14T11:07:08.933 INFO:tasks.ceph:[osd] bdev enable discard = True 2024-09-14T11:07:08.933 INFO:tasks.ceph:[osd] bluestore allocator = bitmap 2024-09-14T11:07:08.933 INFO:tasks.ceph:[osd] bluestore block size = 96636764160 2024-09-14T11:07:08.933 INFO:tasks.ceph:[osd] bluestore fsck on mount = True 2024-09-14T11:07:08.933 INFO:tasks.ceph:[osd] debug bluefs = 1/20 2024-09-14T11:07:08.933 INFO:tasks.ceph:[osd] debug bluestore = 1/20 2024-09-14T11:07:08.933 INFO:tasks.ceph:[osd] debug ms = 1 2024-09-14T11:07:08.933 INFO:tasks.ceph:[osd] debug objclass = 20 2024-09-14T11:07:08.933 INFO:tasks.ceph:[osd] debug osd = 20 2024-09-14T11:07:08.933 INFO:tasks.ceph:[osd] debug rocksdb = 4/10 2024-09-14T11:07:08.933 INFO:tasks.ceph:[osd] mon osd backfillfull_ratio = 0.85 2024-09-14T11:07:08.933 INFO:tasks.ceph:[osd] mon osd full ratio = 0.9 2024-09-14T11:07:08.933 INFO:tasks.ceph:[osd] mon osd nearfull ratio = 0.8 2024-09-14T11:07:08.933 INFO:tasks.ceph:[osd] osd failsafe full ratio = 0.95 2024-09-14T11:07:08.934 INFO:tasks.ceph:[osd] osd fast shutdown = False 2024-09-14T11:07:08.934 INFO:tasks.ceph:[osd] osd objectstore = bluestore 2024-09-14T11:07:08.934 INFO:tasks.ceph:[osd] osd shutdown pgref assert = True 2024-09-14T11:07:08.934 INFO:tasks.ceph:Setting up mon.a... 2024-09-14T11:07:08.934 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring /etc/ceph/ceph.keyring 2024-09-14T11:07:08.968 INFO:teuthology.orchestra.run.smithi138.stdout:creating /etc/ceph/ceph.keyring 2024-09-14T11:07:08.984 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=mon. /etc/ceph/ceph.keyring 2024-09-14T11:07:09.059 DEBUG:teuthology.orchestra.run.smithi138:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-09-14T11:07:09.114 DEBUG:tasks.ceph:Ceph mon addresses: [('mon.a', '172.21.15.138'), ('mon.c', '[v2:172.21.15.138:3301,v1:172.21.15.138:6790]'), ('mon.b', '172.21.15.154')] 2024-09-14T11:07:09.114 DEBUG:tasks.ceph:writing out conf {'global': {'chdir': '', 'pid file': '/var/run/ceph/$cluster-$name.pid', 'auth supported': 'cephx', 'filestore xattr use omap': 'true', 'mon clock drift allowed': '1.000', 'osd crush chooseleaf type': '0', 'auth debug': 'true', 'ms die on old message': 'true', 'ms die on bug': 'true', 'mon max pg per osd': '10000', 'mon pg warn max object skew': '0', 'osd_pool_default_pg_autoscale_mode': 'off', 'osd pool default size': '2', 'mon osd allow primary affinity': 'true', 'mon osd allow pg remap': 'true', 'mon warn on legacy crush tunables': 'false', 'mon warn on crush straw calc version zero': 'false', 'mon warn on no sortbitwise': 'false', 'mon warn on osd down out interval zero': 'false', 'mon warn on too few osds': 'false', 'mon_warn_on_pool_pg_num_not_power_of_two': 'false', 'mon_warn_on_pool_no_redundancy': 'false', 'mon_allow_pool_size_one': 'true', 'osd pool default erasure code profile': 'plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd', 'osd default data pool replay window': '5', 'mon allow pool delete': 'true', 'mon cluster log file level': 'debug', 'debug asserts on shutdown': 'true', 'mon health detail to clog': 'false', 'mon host': '172.21.15.138,[v2:172.21.15.138:3301,v1:172.21.15.138:6790],172.21.15.154', 'mon client directed command retry': 5, 'ms inject socket failures': 5000, 'osd heartbeat grace': 40, 'osd_max_pg_log_entries': 10, 'osd_min_pg_log_entries': 10}, 'osd': {'osd journal size': '100', 'osd scrub load threshold': '5.0', 'osd scrub max interval': '600', 'osd mclock profile': 'high_recovery_ops', 'osd recover clone overlap': 'true', 'osd recovery max chunk': '1048576', 'osd debug shutdown': 'true', 'osd debug op order': 'true', 'osd debug verify stray on activate': 'true', 'osd debug trim objects': 'true', 'osd open classes on start': 'true', 'osd debug pg log writeout': 'true', 'osd deep scrub update digest min age': '30', 'osd map max advance': '10', 'journal zero on create': 'true', 'filestore ondisk finisher threads': '3', 'filestore apply finisher threads': '3', 'bdev debug aio': 'true', 'osd debug misdirected ops': 'true', 'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug objclass': 20, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd fast shutdown': False, 'osd objectstore': 'bluestore', 'osd shutdown pgref assert': True}, 'mgr': {'debug ms': 1, 'debug mgr': 20, 'debug mon': '20', 'debug auth': '20', 'mon reweight min pgs per osd': '4', 'mon reweight min bytes per osd': '10', 'mgr/telemetry/nag': 'false'}, 'mon': {'debug ms': 1, 'debug mon': 20, 'debug paxos': 20, 'debug auth': '20', 'mon data avail warn': '5', 'mon mgr mkfs grace': '240', 'mon reweight min pgs per osd': '4', 'mon osd reporter subtree level': 'osd', 'mon osd prime pg temp': 'true', 'mon reweight min bytes per osd': '10', 'auth mon ticket ttl': '660', 'auth service ticket ttl': '240', 'mon_warn_on_insecure_global_id_reclaim': 'false', 'mon_warn_on_insecure_global_id_reclaim_allowed': 'false', 'mon_down_mkfs_grace': '2m', 'mon_warn_on_filestore_osds': 'false', 'mon osd crush smoke test': False}, 'client': {'rgw cache enabled': 'true', 'rgw enable ops log': 'true', 'rgw enable usage log': 'true', 'log file': '/var/log/ceph/$cluster-$name.$pid.log', 'admin socket': '/var/run/ceph/$cluster-$name.$pid.asok', 'debug rgw': 20, 'debug rgw notification': 20, 'rgw bucket counters cache': True, 'rgw crypt require ssl': False, 'rgw crypt s3 kms backend': 'testing', 'rgw crypt s3 kms encryption keys': 'testkey-1=YmluCmJvb3N0CmJvb3N0LWJ1aWxkCmNlcGguY29uZgo= testkey-2=aWIKTWFrZWZpbGUKbWFuCm91dApzcmMKVGVzdGluZwo=', 'rgw reshard progress judge interval': 10, 'rgw s3 auth use sts': True, 'rgw sts key': 'abcdefghijklmnop', 'rgw torrent flag': True, 'rgw user counters cache': True, 'setgroup': 'ceph', 'setuser': 'ceph'}, 'mon.a': {}, 'mon.c': {}, 'mon.b': {}} 2024-09-14T11:07:09.115 DEBUG:teuthology.orchestra.run.smithi138:> set -ex 2024-09-14T11:07:09.115 DEBUG:teuthology.orchestra.run.smithi138:> dd of=/home/ubuntu/cephtest/ceph.tmp.conf 2024-09-14T11:07:09.163 DEBUG:teuthology.orchestra.run.smithi138:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage monmaptool -c /home/ubuntu/cephtest/ceph.tmp.conf --create --clobber --enable-all-features --add a 172.21.15.138 --addv c '[v2:172.21.15.138:3301,v1:172.21.15.138:6790]' --add b 172.21.15.154 --print /home/ubuntu/cephtest/ceph.monmap 2024-09-14T11:07:09.249 INFO:teuthology.orchestra.run.smithi138.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:07:09.250 INFO:teuthology.orchestra.run.smithi138.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:07:09.250 INFO:teuthology.orchestra.run.smithi138.stdout:monmaptool: monmap file /home/ubuntu/cephtest/ceph.monmap 2024-09-14T11:07:09.250 INFO:teuthology.orchestra.run.smithi138.stdout:monmaptool: generated fsid 3f225f43-83a6-4aeb-b798-1f04bb49d597 2024-09-14T11:07:09.250 INFO:teuthology.orchestra.run.smithi138.stdout:setting min_mon_release = quincy 2024-09-14T11:07:09.250 INFO:teuthology.orchestra.run.smithi138.stdout:epoch 0 2024-09-14T11:07:09.250 INFO:teuthology.orchestra.run.smithi138.stdout:fsid 3f225f43-83a6-4aeb-b798-1f04bb49d597 2024-09-14T11:07:09.250 INFO:teuthology.orchestra.run.smithi138.stdout:last_changed 2024-09-14T11:07:09.252780+0000 2024-09-14T11:07:09.250 INFO:teuthology.orchestra.run.smithi138.stdout:created 2024-09-14T11:07:09.252780+0000 2024-09-14T11:07:09.251 INFO:teuthology.orchestra.run.smithi138.stdout:min_mon_release 17 (quincy) 2024-09-14T11:07:09.251 INFO:teuthology.orchestra.run.smithi138.stdout:election_strategy: 1 2024-09-14T11:07:09.251 INFO:teuthology.orchestra.run.smithi138.stdout:0: [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] mon.a 2024-09-14T11:07:09.251 INFO:teuthology.orchestra.run.smithi138.stdout:1: [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] mon.b 2024-09-14T11:07:09.251 INFO:teuthology.orchestra.run.smithi138.stdout:2: [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] mon.c 2024-09-14T11:07:09.251 INFO:teuthology.orchestra.run.smithi138.stdout:monmaptool: writing epoch 0 to /home/ubuntu/cephtest/ceph.monmap (3 monitors) 2024-09-14T11:07:09.252 DEBUG:teuthology.orchestra.run.smithi138:> rm -- /home/ubuntu/cephtest/ceph.tmp.conf 2024-09-14T11:07:09.299 INFO:tasks.ceph:Writing /etc/ceph/ceph.conf for FSID 3f225f43-83a6-4aeb-b798-1f04bb49d597... 2024-09-14T11:07:09.300 DEBUG:teuthology.orchestra.run.smithi138:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-09-14T11:07:09.344 DEBUG:teuthology.orchestra.run.smithi154:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-09-14T11:07:09.372 INFO:teuthology.orchestra.run.smithi138.stdout:[global] 2024-09-14T11:07:09.372 INFO:teuthology.orchestra.run.smithi138.stdout: chdir = "" 2024-09-14T11:07:09.372 INFO:teuthology.orchestra.run.smithi138.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-09-14T11:07:09.372 INFO:teuthology.orchestra.run.smithi138.stdout: auth supported = cephx 2024-09-14T11:07:09.372 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-09-14T11:07:09.372 INFO:teuthology.orchestra.run.smithi138.stdout: filestore xattr use omap = true 2024-09-14T11:07:09.372 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-09-14T11:07:09.372 INFO:teuthology.orchestra.run.smithi138.stdout: mon clock drift allowed = 1.000 2024-09-14T11:07:09.372 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-09-14T11:07:09.372 INFO:teuthology.orchestra.run.smithi138.stdout: osd crush chooseleaf type = 0 2024-09-14T11:07:09.373 INFO:teuthology.orchestra.run.smithi138.stdout: auth debug = true 2024-09-14T11:07:09.373 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-09-14T11:07:09.373 INFO:teuthology.orchestra.run.smithi138.stdout: ms die on old message = true 2024-09-14T11:07:09.373 INFO:teuthology.orchestra.run.smithi138.stdout: ms die on bug = true 2024-09-14T11:07:09.373 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-09-14T11:07:09.373 INFO:teuthology.orchestra.run.smithi138.stdout: mon max pg per osd = 10000 # >= luminous 2024-09-14T11:07:09.373 INFO:teuthology.orchestra.run.smithi138.stdout: mon pg warn max object skew = 0 2024-09-14T11:07:09.373 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-09-14T11:07:09.373 INFO:teuthology.orchestra.run.smithi138.stdout: # disable pg_autoscaler by default for new pools 2024-09-14T11:07:09.373 INFO:teuthology.orchestra.run.smithi138.stdout: osd_pool_default_pg_autoscale_mode = off 2024-09-14T11:07:09.373 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-09-14T11:07:09.373 INFO:teuthology.orchestra.run.smithi138.stdout: osd pool default size = 2 2024-09-14T11:07:09.374 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-09-14T11:07:09.374 INFO:teuthology.orchestra.run.smithi138.stdout: mon osd allow primary affinity = true 2024-09-14T11:07:09.374 INFO:teuthology.orchestra.run.smithi138.stdout: mon osd allow pg remap = true 2024-09-14T11:07:09.374 INFO:teuthology.orchestra.run.smithi138.stdout: mon warn on legacy crush tunables = false 2024-09-14T11:07:09.374 INFO:teuthology.orchestra.run.smithi138.stdout: mon warn on crush straw calc version zero = false 2024-09-14T11:07:09.374 INFO:teuthology.orchestra.run.smithi138.stdout: mon warn on no sortbitwise = false 2024-09-14T11:07:09.374 INFO:teuthology.orchestra.run.smithi138.stdout: mon warn on osd down out interval zero = false 2024-09-14T11:07:09.374 INFO:teuthology.orchestra.run.smithi138.stdout: mon warn on too few osds = false 2024-09-14T11:07:09.374 INFO:teuthology.orchestra.run.smithi138.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-09-14T11:07:09.374 INFO:teuthology.orchestra.run.smithi138.stdout: mon_warn_on_pool_no_redundancy = false 2024-09-14T11:07:09.374 INFO:teuthology.orchestra.run.smithi138.stdout: mon_allow_pool_size_one = true 2024-09-14T11:07:09.374 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-09-14T11:07:09.374 INFO:teuthology.orchestra.run.smithi138.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-09-14T11:07:09.375 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-09-14T11:07:09.375 INFO:teuthology.orchestra.run.smithi138.stdout: osd default data pool replay window = 5 2024-09-14T11:07:09.375 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-09-14T11:07:09.375 INFO:teuthology.orchestra.run.smithi138.stdout: mon allow pool delete = true 2024-09-14T11:07:09.375 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-09-14T11:07:09.375 INFO:teuthology.orchestra.run.smithi138.stdout: mon cluster log file level = debug 2024-09-14T11:07:09.375 INFO:teuthology.orchestra.run.smithi138.stdout: debug asserts on shutdown = true 2024-09-14T11:07:09.375 INFO:teuthology.orchestra.run.smithi138.stdout: mon health detail to clog = false 2024-09-14T11:07:09.375 INFO:teuthology.orchestra.run.smithi138.stdout: mon host = "172.21.15.138,[v2:172.21.15.138:3301,v1:172.21.15.138:6790],172.21.15.154" 2024-09-14T11:07:09.375 INFO:teuthology.orchestra.run.smithi138.stdout: mon client directed command retry = 5 2024-09-14T11:07:09.375 INFO:teuthology.orchestra.run.smithi138.stdout: ms inject socket failures = 5000 2024-09-14T11:07:09.375 INFO:teuthology.orchestra.run.smithi138.stdout: osd heartbeat grace = 40 2024-09-14T11:07:09.375 INFO:teuthology.orchestra.run.smithi138.stdout: osd_max_pg_log_entries = 10 2024-09-14T11:07:09.375 INFO:teuthology.orchestra.run.smithi138.stdout: osd_min_pg_log_entries = 10 2024-09-14T11:07:09.375 INFO:teuthology.orchestra.run.smithi138.stdout: fsid = 3f225f43-83a6-4aeb-b798-1f04bb49d597 2024-09-14T11:07:09.376 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-09-14T11:07:09.376 INFO:teuthology.orchestra.run.smithi138.stdout:[osd] 2024-09-14T11:07:09.376 INFO:teuthology.orchestra.run.smithi138.stdout: osd journal size = 100 2024-09-14T11:07:09.376 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-09-14T11:07:09.376 INFO:teuthology.orchestra.run.smithi138.stdout: osd scrub load threshold = 5.0 2024-09-14T11:07:09.376 INFO:teuthology.orchestra.run.smithi138.stdout: osd scrub max interval = 600 2024-09-14T11:07:09.376 INFO:teuthology.orchestra.run.smithi138.stdout: osd mclock profile = high_recovery_ops 2024-09-14T11:07:09.376 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-09-14T11:07:09.376 INFO:teuthology.orchestra.run.smithi138.stdout: osd recover clone overlap = true 2024-09-14T11:07:09.376 INFO:teuthology.orchestra.run.smithi138.stdout: osd recovery max chunk = 1048576 2024-09-14T11:07:09.376 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-09-14T11:07:09.376 INFO:teuthology.orchestra.run.smithi138.stdout: osd debug shutdown = true 2024-09-14T11:07:09.376 INFO:teuthology.orchestra.run.smithi138.stdout: osd debug op order = true 2024-09-14T11:07:09.376 INFO:teuthology.orchestra.run.smithi138.stdout: osd debug verify stray on activate = true 2024-09-14T11:07:09.376 INFO:teuthology.orchestra.run.smithi138.stdout: osd debug trim objects = true 2024-09-14T11:07:09.377 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-09-14T11:07:09.377 INFO:teuthology.orchestra.run.smithi138.stdout: osd open classes on start = true 2024-09-14T11:07:09.377 INFO:teuthology.orchestra.run.smithi138.stdout: osd debug pg log writeout = true 2024-09-14T11:07:09.377 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-09-14T11:07:09.377 INFO:teuthology.orchestra.run.smithi138.stdout: osd deep scrub update digest min age = 30 2024-09-14T11:07:09.377 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-09-14T11:07:09.377 INFO:teuthology.orchestra.run.smithi138.stdout: osd map max advance = 10 2024-09-14T11:07:09.377 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-09-14T11:07:09.377 INFO:teuthology.orchestra.run.smithi138.stdout: journal zero on create = true 2024-09-14T11:07:09.377 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-09-14T11:07:09.377 INFO:teuthology.orchestra.run.smithi138.stdout: filestore ondisk finisher threads = 3 2024-09-14T11:07:09.377 INFO:teuthology.orchestra.run.smithi138.stdout: filestore apply finisher threads = 3 2024-09-14T11:07:09.377 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-09-14T11:07:09.377 INFO:teuthology.orchestra.run.smithi138.stdout: bdev debug aio = true 2024-09-14T11:07:09.378 INFO:teuthology.orchestra.run.smithi138.stdout: osd debug misdirected ops = true 2024-09-14T11:07:09.378 INFO:teuthology.orchestra.run.smithi138.stdout: bdev async discard = True 2024-09-14T11:07:09.378 INFO:teuthology.orchestra.run.smithi138.stdout: bdev enable discard = True 2024-09-14T11:07:09.378 INFO:teuthology.orchestra.run.smithi138.stdout: bluestore allocator = bitmap 2024-09-14T11:07:09.378 INFO:teuthology.orchestra.run.smithi138.stdout: bluestore block size = 96636764160 2024-09-14T11:07:09.378 INFO:teuthology.orchestra.run.smithi138.stdout: bluestore fsck on mount = True 2024-09-14T11:07:09.378 INFO:teuthology.orchestra.run.smithi138.stdout: debug bluefs = 1/20 2024-09-14T11:07:09.378 INFO:teuthology.orchestra.run.smithi138.stdout: debug bluestore = 1/20 2024-09-14T11:07:09.378 INFO:teuthology.orchestra.run.smithi138.stdout: debug ms = 1 2024-09-14T11:07:09.378 INFO:teuthology.orchestra.run.smithi138.stdout: debug objclass = 20 2024-09-14T11:07:09.378 INFO:teuthology.orchestra.run.smithi138.stdout: debug osd = 20 2024-09-14T11:07:09.378 INFO:teuthology.orchestra.run.smithi138.stdout: debug rocksdb = 4/10 2024-09-14T11:07:09.378 INFO:teuthology.orchestra.run.smithi138.stdout: mon osd backfillfull_ratio = 0.85 2024-09-14T11:07:09.378 INFO:teuthology.orchestra.run.smithi138.stdout: mon osd full ratio = 0.9 2024-09-14T11:07:09.378 INFO:teuthology.orchestra.run.smithi138.stdout: mon osd nearfull ratio = 0.8 2024-09-14T11:07:09.379 INFO:teuthology.orchestra.run.smithi138.stdout: osd failsafe full ratio = 0.95 2024-09-14T11:07:09.379 INFO:teuthology.orchestra.run.smithi138.stdout: osd fast shutdown = False 2024-09-14T11:07:09.379 INFO:teuthology.orchestra.run.smithi138.stdout: osd objectstore = bluestore 2024-09-14T11:07:09.379 INFO:teuthology.orchestra.run.smithi138.stdout: osd shutdown pgref assert = True 2024-09-14T11:07:09.379 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-09-14T11:07:09.379 INFO:teuthology.orchestra.run.smithi138.stdout:[mgr] 2024-09-14T11:07:09.379 INFO:teuthology.orchestra.run.smithi138.stdout: debug ms = 1 2024-09-14T11:07:09.379 INFO:teuthology.orchestra.run.smithi138.stdout: debug mgr = 20 2024-09-14T11:07:09.379 INFO:teuthology.orchestra.run.smithi138.stdout: debug mon = 20 2024-09-14T11:07:09.379 INFO:teuthology.orchestra.run.smithi138.stdout: debug auth = 20 2024-09-14T11:07:09.379 INFO:teuthology.orchestra.run.smithi138.stdout: mon reweight min pgs per osd = 4 2024-09-14T11:07:09.379 INFO:teuthology.orchestra.run.smithi138.stdout: mon reweight min bytes per osd = 10 2024-09-14T11:07:09.379 INFO:teuthology.orchestra.run.smithi138.stdout: mgr/telemetry/nag = false 2024-09-14T11:07:09.379 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-09-14T11:07:09.380 INFO:teuthology.orchestra.run.smithi138.stdout:[mon] 2024-09-14T11:07:09.380 INFO:teuthology.orchestra.run.smithi138.stdout: debug ms = 1 2024-09-14T11:07:09.380 INFO:teuthology.orchestra.run.smithi138.stdout: debug mon = 20 2024-09-14T11:07:09.380 INFO:teuthology.orchestra.run.smithi138.stdout: debug paxos = 20 2024-09-14T11:07:09.380 INFO:teuthology.orchestra.run.smithi138.stdout: debug auth = 20 2024-09-14T11:07:09.380 INFO:teuthology.orchestra.run.smithi138.stdout: mon data avail warn = 5 2024-09-14T11:07:09.380 INFO:teuthology.orchestra.run.smithi138.stdout: mon mgr mkfs grace = 240 2024-09-14T11:07:09.380 INFO:teuthology.orchestra.run.smithi138.stdout: mon reweight min pgs per osd = 4 2024-09-14T11:07:09.380 INFO:teuthology.orchestra.run.smithi138.stdout: mon osd reporter subtree level = osd 2024-09-14T11:07:09.380 INFO:teuthology.orchestra.run.smithi138.stdout: mon osd prime pg temp = true 2024-09-14T11:07:09.380 INFO:teuthology.orchestra.run.smithi138.stdout: mon reweight min bytes per osd = 10 2024-09-14T11:07:09.380 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-09-14T11:07:09.380 INFO:teuthology.orchestra.run.smithi138.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-09-14T11:07:09.380 INFO:teuthology.orchestra.run.smithi138.stdout: auth mon ticket ttl = 660 # 11m 2024-09-14T11:07:09.380 INFO:teuthology.orchestra.run.smithi138.stdout: auth service ticket ttl = 240 # 4m 2024-09-14T11:07:09.381 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-09-14T11:07:09.381 INFO:teuthology.orchestra.run.smithi138.stdout: # don't complain about insecure global_id in the test suite 2024-09-14T11:07:09.381 INFO:teuthology.orchestra.run.smithi138.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-09-14T11:07:09.381 INFO:teuthology.orchestra.run.smithi138.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-09-14T11:07:09.381 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-09-14T11:07:09.381 INFO:teuthology.orchestra.run.smithi138.stdout: # 1m isn't quite enough 2024-09-14T11:07:09.381 INFO:teuthology.orchestra.run.smithi138.stdout: mon_down_mkfs_grace = 2m 2024-09-14T11:07:09.381 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-09-14T11:07:09.381 INFO:teuthology.orchestra.run.smithi138.stdout: mon_warn_on_filestore_osds = false 2024-09-14T11:07:09.381 INFO:teuthology.orchestra.run.smithi138.stdout: mon osd crush smoke test = False 2024-09-14T11:07:09.381 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-09-14T11:07:09.381 INFO:teuthology.orchestra.run.smithi138.stdout:[client] 2024-09-14T11:07:09.381 INFO:teuthology.orchestra.run.smithi138.stdout: rgw cache enabled = true 2024-09-14T11:07:09.381 INFO:teuthology.orchestra.run.smithi138.stdout: rgw enable ops log = true 2024-09-14T11:07:09.382 INFO:teuthology.orchestra.run.smithi138.stdout: rgw enable usage log = true 2024-09-14T11:07:09.382 INFO:teuthology.orchestra.run.smithi138.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-09-14T11:07:09.382 INFO:teuthology.orchestra.run.smithi138.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-09-14T11:07:09.382 INFO:teuthology.orchestra.run.smithi138.stdout: debug rgw = 20 2024-09-14T11:07:09.382 INFO:teuthology.orchestra.run.smithi138.stdout: debug rgw notification = 20 2024-09-14T11:07:09.382 INFO:teuthology.orchestra.run.smithi138.stdout: rgw bucket counters cache = True 2024-09-14T11:07:09.382 INFO:teuthology.orchestra.run.smithi138.stdout: rgw crypt require ssl = False 2024-09-14T11:07:09.382 INFO:teuthology.orchestra.run.smithi138.stdout: rgw crypt s3 kms backend = testing 2024-09-14T11:07:09.382 INFO:teuthology.orchestra.run.smithi138.stdout: rgw crypt s3 kms encryption keys = testkey-1=YmluCmJvb3N0CmJvb3N0LWJ1aWxkCmNlcGguY29uZgo= testkey-2=aWIKTWFrZWZpbGUKbWFuCm91dApzcmMKVGVzdGluZwo= 2024-09-14T11:07:09.382 INFO:teuthology.orchestra.run.smithi138.stdout: rgw reshard progress judge interval = 10 2024-09-14T11:07:09.382 INFO:teuthology.orchestra.run.smithi138.stdout: rgw s3 auth use sts = True 2024-09-14T11:07:09.382 INFO:teuthology.orchestra.run.smithi138.stdout: rgw sts key = abcdefghijklmnop 2024-09-14T11:07:09.382 INFO:teuthology.orchestra.run.smithi138.stdout: rgw torrent flag = True 2024-09-14T11:07:09.382 INFO:teuthology.orchestra.run.smithi138.stdout: rgw user counters cache = True 2024-09-14T11:07:09.383 INFO:teuthology.orchestra.run.smithi138.stdout: setgroup = ceph 2024-09-14T11:07:09.383 INFO:teuthology.orchestra.run.smithi138.stdout: setuser = ceph 2024-09-14T11:07:09.383 INFO:teuthology.orchestra.run.smithi138.stdout:[mon.a] 2024-09-14T11:07:09.383 INFO:teuthology.orchestra.run.smithi138.stdout:[mon.c] 2024-09-14T11:07:09.383 INFO:teuthology.orchestra.run.smithi138.stdout:[mon.b] 2024-09-14T11:07:09.384 INFO:teuthology.orchestra.run.smithi154.stdout:[global] 2024-09-14T11:07:09.384 INFO:teuthology.orchestra.run.smithi154.stdout: chdir = "" 2024-09-14T11:07:09.384 INFO:teuthology.orchestra.run.smithi154.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-09-14T11:07:09.384 INFO:teuthology.orchestra.run.smithi154.stdout: auth supported = cephx 2024-09-14T11:07:09.384 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-09-14T11:07:09.384 INFO:teuthology.orchestra.run.smithi154.stdout: filestore xattr use omap = true 2024-09-14T11:07:09.385 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-09-14T11:07:09.385 INFO:teuthology.orchestra.run.smithi154.stdout: mon clock drift allowed = 1.000 2024-09-14T11:07:09.385 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-09-14T11:07:09.385 INFO:teuthology.orchestra.run.smithi154.stdout: osd crush chooseleaf type = 0 2024-09-14T11:07:09.385 INFO:teuthology.orchestra.run.smithi154.stdout: auth debug = true 2024-09-14T11:07:09.385 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-09-14T11:07:09.385 INFO:teuthology.orchestra.run.smithi154.stdout: ms die on old message = true 2024-09-14T11:07:09.385 INFO:teuthology.orchestra.run.smithi154.stdout: ms die on bug = true 2024-09-14T11:07:09.385 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-09-14T11:07:09.385 INFO:teuthology.orchestra.run.smithi154.stdout: mon max pg per osd = 10000 # >= luminous 2024-09-14T11:07:09.385 INFO:teuthology.orchestra.run.smithi154.stdout: mon pg warn max object skew = 0 2024-09-14T11:07:09.386 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-09-14T11:07:09.386 INFO:teuthology.orchestra.run.smithi154.stdout: # disable pg_autoscaler by default for new pools 2024-09-14T11:07:09.386 INFO:teuthology.orchestra.run.smithi154.stdout: osd_pool_default_pg_autoscale_mode = off 2024-09-14T11:07:09.386 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-09-14T11:07:09.386 INFO:teuthology.orchestra.run.smithi154.stdout: osd pool default size = 2 2024-09-14T11:07:09.386 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-09-14T11:07:09.386 INFO:teuthology.orchestra.run.smithi154.stdout: mon osd allow primary affinity = true 2024-09-14T11:07:09.386 INFO:teuthology.orchestra.run.smithi154.stdout: mon osd allow pg remap = true 2024-09-14T11:07:09.386 INFO:teuthology.orchestra.run.smithi154.stdout: mon warn on legacy crush tunables = false 2024-09-14T11:07:09.386 INFO:teuthology.orchestra.run.smithi154.stdout: mon warn on crush straw calc version zero = false 2024-09-14T11:07:09.386 INFO:teuthology.orchestra.run.smithi154.stdout: mon warn on no sortbitwise = false 2024-09-14T11:07:09.386 INFO:teuthology.orchestra.run.smithi154.stdout: mon warn on osd down out interval zero = false 2024-09-14T11:07:09.386 INFO:teuthology.orchestra.run.smithi154.stdout: mon warn on too few osds = false 2024-09-14T11:07:09.386 INFO:teuthology.orchestra.run.smithi154.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-09-14T11:07:09.386 INFO:teuthology.orchestra.run.smithi154.stdout: mon_warn_on_pool_no_redundancy = false 2024-09-14T11:07:09.387 INFO:teuthology.orchestra.run.smithi154.stdout: mon_allow_pool_size_one = true 2024-09-14T11:07:09.387 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-09-14T11:07:09.387 INFO:teuthology.orchestra.run.smithi154.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-09-14T11:07:09.387 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-09-14T11:07:09.387 INFO:teuthology.orchestra.run.smithi154.stdout: osd default data pool replay window = 5 2024-09-14T11:07:09.387 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-09-14T11:07:09.387 INFO:teuthology.orchestra.run.smithi154.stdout: mon allow pool delete = true 2024-09-14T11:07:09.387 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-09-14T11:07:09.387 INFO:teuthology.orchestra.run.smithi154.stdout: mon cluster log file level = debug 2024-09-14T11:07:09.387 INFO:teuthology.orchestra.run.smithi154.stdout: debug asserts on shutdown = true 2024-09-14T11:07:09.387 INFO:teuthology.orchestra.run.smithi154.stdout: mon health detail to clog = false 2024-09-14T11:07:09.387 INFO:teuthology.orchestra.run.smithi154.stdout: mon host = "172.21.15.138,[v2:172.21.15.138:3301,v1:172.21.15.138:6790],172.21.15.154" 2024-09-14T11:07:09.387 INFO:teuthology.orchestra.run.smithi154.stdout: mon client directed command retry = 5 2024-09-14T11:07:09.387 INFO:teuthology.orchestra.run.smithi154.stdout: ms inject socket failures = 5000 2024-09-14T11:07:09.387 INFO:teuthology.orchestra.run.smithi154.stdout: osd heartbeat grace = 40 2024-09-14T11:07:09.388 INFO:teuthology.orchestra.run.smithi154.stdout: osd_max_pg_log_entries = 10 2024-09-14T11:07:09.388 INFO:teuthology.orchestra.run.smithi154.stdout: osd_min_pg_log_entries = 10 2024-09-14T11:07:09.388 INFO:teuthology.orchestra.run.smithi154.stdout: fsid = 3f225f43-83a6-4aeb-b798-1f04bb49d597 2024-09-14T11:07:09.388 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-09-14T11:07:09.388 INFO:teuthology.orchestra.run.smithi154.stdout:[osd] 2024-09-14T11:07:09.388 INFO:teuthology.orchestra.run.smithi154.stdout: osd journal size = 100 2024-09-14T11:07:09.388 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-09-14T11:07:09.388 INFO:teuthology.orchestra.run.smithi154.stdout: osd scrub load threshold = 5.0 2024-09-14T11:07:09.388 INFO:teuthology.orchestra.run.smithi154.stdout: osd scrub max interval = 600 2024-09-14T11:07:09.388 INFO:teuthology.orchestra.run.smithi154.stdout: osd mclock profile = high_recovery_ops 2024-09-14T11:07:09.388 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-09-14T11:07:09.388 INFO:teuthology.orchestra.run.smithi154.stdout: osd recover clone overlap = true 2024-09-14T11:07:09.388 INFO:teuthology.orchestra.run.smithi154.stdout: osd recovery max chunk = 1048576 2024-09-14T11:07:09.388 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-09-14T11:07:09.388 INFO:teuthology.orchestra.run.smithi154.stdout: osd debug shutdown = true 2024-09-14T11:07:09.389 INFO:teuthology.orchestra.run.smithi154.stdout: osd debug op order = true 2024-09-14T11:07:09.389 INFO:teuthology.orchestra.run.smithi154.stdout: osd debug verify stray on activate = true 2024-09-14T11:07:09.389 INFO:teuthology.orchestra.run.smithi154.stdout: osd debug trim objects = true 2024-09-14T11:07:09.389 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-09-14T11:07:09.389 INFO:teuthology.orchestra.run.smithi154.stdout: osd open classes on start = true 2024-09-14T11:07:09.389 INFO:teuthology.orchestra.run.smithi154.stdout: osd debug pg log writeout = true 2024-09-14T11:07:09.389 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-09-14T11:07:09.389 INFO:teuthology.orchestra.run.smithi154.stdout: osd deep scrub update digest min age = 30 2024-09-14T11:07:09.389 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-09-14T11:07:09.389 INFO:teuthology.orchestra.run.smithi154.stdout: osd map max advance = 10 2024-09-14T11:07:09.389 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-09-14T11:07:09.389 INFO:teuthology.orchestra.run.smithi154.stdout: journal zero on create = true 2024-09-14T11:07:09.389 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-09-14T11:07:09.389 INFO:teuthology.orchestra.run.smithi154.stdout: filestore ondisk finisher threads = 3 2024-09-14T11:07:09.390 INFO:teuthology.orchestra.run.smithi154.stdout: filestore apply finisher threads = 3 2024-09-14T11:07:09.390 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-09-14T11:07:09.390 INFO:teuthology.orchestra.run.smithi154.stdout: bdev debug aio = true 2024-09-14T11:07:09.390 INFO:teuthology.orchestra.run.smithi154.stdout: osd debug misdirected ops = true 2024-09-14T11:07:09.390 INFO:teuthology.orchestra.run.smithi154.stdout: bdev async discard = True 2024-09-14T11:07:09.390 INFO:teuthology.orchestra.run.smithi154.stdout: bdev enable discard = True 2024-09-14T11:07:09.390 INFO:teuthology.orchestra.run.smithi154.stdout: bluestore allocator = bitmap 2024-09-14T11:07:09.390 INFO:teuthology.orchestra.run.smithi154.stdout: bluestore block size = 96636764160 2024-09-14T11:07:09.390 INFO:teuthology.orchestra.run.smithi154.stdout: bluestore fsck on mount = True 2024-09-14T11:07:09.390 INFO:teuthology.orchestra.run.smithi154.stdout: debug bluefs = 1/20 2024-09-14T11:07:09.390 INFO:teuthology.orchestra.run.smithi154.stdout: debug bluestore = 1/20 2024-09-14T11:07:09.390 INFO:teuthology.orchestra.run.smithi154.stdout: debug ms = 1 2024-09-14T11:07:09.390 INFO:teuthology.orchestra.run.smithi154.stdout: debug objclass = 20 2024-09-14T11:07:09.390 INFO:teuthology.orchestra.run.smithi154.stdout: debug osd = 20 2024-09-14T11:07:09.390 INFO:teuthology.orchestra.run.smithi154.stdout: debug rocksdb = 4/10 2024-09-14T11:07:09.390 INFO:teuthology.orchestra.run.smithi154.stdout: mon osd backfillfull_ratio = 0.85 2024-09-14T11:07:09.391 INFO:teuthology.orchestra.run.smithi154.stdout: mon osd full ratio = 0.9 2024-09-14T11:07:09.391 INFO:teuthology.orchestra.run.smithi154.stdout: mon osd nearfull ratio = 0.8 2024-09-14T11:07:09.391 INFO:teuthology.orchestra.run.smithi154.stdout: osd failsafe full ratio = 0.95 2024-09-14T11:07:09.391 INFO:teuthology.orchestra.run.smithi154.stdout: osd fast shutdown = False 2024-09-14T11:07:09.391 INFO:teuthology.orchestra.run.smithi154.stdout: osd objectstore = bluestore 2024-09-14T11:07:09.391 INFO:teuthology.orchestra.run.smithi154.stdout: osd shutdown pgref assert = True 2024-09-14T11:07:09.391 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-09-14T11:07:09.391 INFO:teuthology.orchestra.run.smithi154.stdout:[mgr] 2024-09-14T11:07:09.391 INFO:teuthology.orchestra.run.smithi154.stdout: debug ms = 1 2024-09-14T11:07:09.391 INFO:teuthology.orchestra.run.smithi154.stdout: debug mgr = 20 2024-09-14T11:07:09.391 INFO:teuthology.orchestra.run.smithi154.stdout: debug mon = 20 2024-09-14T11:07:09.391 INFO:teuthology.orchestra.run.smithi154.stdout: debug auth = 20 2024-09-14T11:07:09.391 INFO:teuthology.orchestra.run.smithi154.stdout: mon reweight min pgs per osd = 4 2024-09-14T11:07:09.391 INFO:teuthology.orchestra.run.smithi154.stdout: mon reweight min bytes per osd = 10 2024-09-14T11:07:09.391 INFO:teuthology.orchestra.run.smithi154.stdout: mgr/telemetry/nag = false 2024-09-14T11:07:09.392 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-09-14T11:07:09.392 INFO:teuthology.orchestra.run.smithi154.stdout:[mon] 2024-09-14T11:07:09.392 INFO:teuthology.orchestra.run.smithi154.stdout: debug ms = 1 2024-09-14T11:07:09.392 INFO:teuthology.orchestra.run.smithi154.stdout: debug mon = 20 2024-09-14T11:07:09.392 INFO:teuthology.orchestra.run.smithi154.stdout: debug paxos = 20 2024-09-14T11:07:09.392 INFO:teuthology.orchestra.run.smithi154.stdout: debug auth = 20 2024-09-14T11:07:09.392 INFO:teuthology.orchestra.run.smithi154.stdout: mon data avail warn = 5 2024-09-14T11:07:09.392 INFO:teuthology.orchestra.run.smithi154.stdout: mon mgr mkfs grace = 240 2024-09-14T11:07:09.392 INFO:teuthology.orchestra.run.smithi154.stdout: mon reweight min pgs per osd = 4 2024-09-14T11:07:09.392 INFO:teuthology.orchestra.run.smithi154.stdout: mon osd reporter subtree level = osd 2024-09-14T11:07:09.392 INFO:teuthology.orchestra.run.smithi154.stdout: mon osd prime pg temp = true 2024-09-14T11:07:09.392 INFO:teuthology.orchestra.run.smithi154.stdout: mon reweight min bytes per osd = 10 2024-09-14T11:07:09.392 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-09-14T11:07:09.392 INFO:teuthology.orchestra.run.smithi154.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-09-14T11:07:09.393 INFO:teuthology.orchestra.run.smithi154.stdout: auth mon ticket ttl = 660 # 11m 2024-09-14T11:07:09.393 INFO:teuthology.orchestra.run.smithi154.stdout: auth service ticket ttl = 240 # 4m 2024-09-14T11:07:09.393 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-09-14T11:07:09.393 INFO:teuthology.orchestra.run.smithi154.stdout: # don't complain about insecure global_id in the test suite 2024-09-14T11:07:09.393 INFO:teuthology.orchestra.run.smithi154.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-09-14T11:07:09.393 INFO:teuthology.orchestra.run.smithi154.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-09-14T11:07:09.393 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-09-14T11:07:09.393 INFO:teuthology.orchestra.run.smithi154.stdout: # 1m isn't quite enough 2024-09-14T11:07:09.393 INFO:teuthology.orchestra.run.smithi154.stdout: mon_down_mkfs_grace = 2m 2024-09-14T11:07:09.393 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-09-14T11:07:09.393 INFO:teuthology.orchestra.run.smithi154.stdout: mon_warn_on_filestore_osds = false 2024-09-14T11:07:09.393 INFO:teuthology.orchestra.run.smithi154.stdout: mon osd crush smoke test = False 2024-09-14T11:07:09.393 INFO:teuthology.orchestra.run.smithi154.stdout: 2024-09-14T11:07:09.393 INFO:teuthology.orchestra.run.smithi154.stdout:[client] 2024-09-14T11:07:09.394 INFO:teuthology.orchestra.run.smithi154.stdout: rgw cache enabled = true 2024-09-14T11:07:09.394 INFO:teuthology.orchestra.run.smithi154.stdout: rgw enable ops log = true 2024-09-14T11:07:09.394 INFO:teuthology.orchestra.run.smithi154.stdout: rgw enable usage log = true 2024-09-14T11:07:09.394 INFO:teuthology.orchestra.run.smithi154.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-09-14T11:07:09.394 INFO:teuthology.orchestra.run.smithi154.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-09-14T11:07:09.394 INFO:teuthology.orchestra.run.smithi154.stdout: debug rgw = 20 2024-09-14T11:07:09.394 INFO:teuthology.orchestra.run.smithi154.stdout: debug rgw notification = 20 2024-09-14T11:07:09.394 INFO:teuthology.orchestra.run.smithi154.stdout: rgw bucket counters cache = True 2024-09-14T11:07:09.394 INFO:teuthology.orchestra.run.smithi154.stdout: rgw crypt require ssl = False 2024-09-14T11:07:09.394 INFO:teuthology.orchestra.run.smithi154.stdout: rgw crypt s3 kms backend = testing 2024-09-14T11:07:09.394 INFO:teuthology.orchestra.run.smithi154.stdout: rgw crypt s3 kms encryption keys = testkey-1=YmluCmJvb3N0CmJvb3N0LWJ1aWxkCmNlcGguY29uZgo= testkey-2=aWIKTWFrZWZpbGUKbWFuCm91dApzcmMKVGVzdGluZwo= 2024-09-14T11:07:09.394 INFO:teuthology.orchestra.run.smithi154.stdout: rgw reshard progress judge interval = 10 2024-09-14T11:07:09.394 INFO:teuthology.orchestra.run.smithi154.stdout: rgw s3 auth use sts = True 2024-09-14T11:07:09.394 INFO:teuthology.orchestra.run.smithi154.stdout: rgw sts key = abcdefghijklmnop 2024-09-14T11:07:09.394 INFO:teuthology.orchestra.run.smithi154.stdout: rgw torrent flag = True 2024-09-14T11:07:09.395 INFO:teuthology.orchestra.run.smithi154.stdout: rgw user counters cache = True 2024-09-14T11:07:09.395 INFO:teuthology.orchestra.run.smithi154.stdout: setgroup = ceph 2024-09-14T11:07:09.395 INFO:teuthology.orchestra.run.smithi154.stdout: setuser = ceph 2024-09-14T11:07:09.395 INFO:teuthology.orchestra.run.smithi154.stdout:[mon.a] 2024-09-14T11:07:09.395 INFO:teuthology.orchestra.run.smithi154.stdout:[mon.c] 2024-09-14T11:07:09.395 INFO:teuthology.orchestra.run.smithi154.stdout:[mon.b] 2024-09-14T11:07:09.395 INFO:tasks.ceph:Creating admin key on mon.a... 2024-09-14T11:07:09.395 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=client.admin --cap mon 'allow *' --cap osd 'allow *' --cap mds 'allow *' --cap mgr 'allow *' /etc/ceph/ceph.keyring 2024-09-14T11:07:09.477 INFO:tasks.ceph:Copying monmap to all nodes... 2024-09-14T11:07:09.477 DEBUG:teuthology.orchestra.run.smithi138:> set -ex 2024-09-14T11:07:09.477 DEBUG:teuthology.orchestra.run.smithi138:> dd if=/etc/ceph/ceph.keyring of=/dev/stdout 2024-09-14T11:07:09.482 DEBUG:teuthology.orchestra.run.smithi138:> set -ex 2024-09-14T11:07:09.482 DEBUG:teuthology.orchestra.run.smithi138:> dd if=/home/ubuntu/cephtest/ceph.monmap of=/dev/stdout 2024-09-14T11:07:09.530 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi138.front.sepia.ceph.com 2024-09-14T11:07:09.531 DEBUG:teuthology.orchestra.run.smithi138:> set -ex 2024-09-14T11:07:09.531 DEBUG:teuthology.orchestra.run.smithi138:> sudo dd of=/etc/ceph/ceph.keyring 2024-09-14T11:07:09.531 DEBUG:teuthology.orchestra.run.smithi138:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-09-14T11:07:09.595 DEBUG:teuthology.orchestra.run.smithi138:> set -ex 2024-09-14T11:07:09.595 DEBUG:teuthology.orchestra.run.smithi138:> dd of=/home/ubuntu/cephtest/ceph.monmap 2024-09-14T11:07:09.643 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi154.front.sepia.ceph.com 2024-09-14T11:07:09.643 DEBUG:teuthology.orchestra.run.smithi154:> set -ex 2024-09-14T11:07:09.643 DEBUG:teuthology.orchestra.run.smithi154:> sudo dd of=/etc/ceph/ceph.keyring 2024-09-14T11:07:09.643 DEBUG:teuthology.orchestra.run.smithi154:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-09-14T11:07:09.666 DEBUG:teuthology.orchestra.run.smithi154:> set -ex 2024-09-14T11:07:09.666 DEBUG:teuthology.orchestra.run.smithi154:> dd of=/home/ubuntu/cephtest/ceph.monmap 2024-09-14T11:07:09.712 INFO:tasks.ceph:Setting up mon nodes... 2024-09-14T11:07:09.712 INFO:tasks.ceph:Setting up mgr nodes... 2024-09-14T11:07:09.712 DEBUG:teuthology.orchestra.run.smithi138:> sudo mkdir -p /var/lib/ceph/mgr/ceph-y && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.y /var/lib/ceph/mgr/ceph-y/keyring 2024-09-14T11:07:09.756 INFO:teuthology.orchestra.run.smithi138.stdout:creating /var/lib/ceph/mgr/ceph-y/keyring 2024-09-14T11:07:09.759 DEBUG:teuthology.orchestra.run.smithi154:> sudo mkdir -p /var/lib/ceph/mgr/ceph-x && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.x /var/lib/ceph/mgr/ceph-x/keyring 2024-09-14T11:07:09.801 INFO:teuthology.orchestra.run.smithi154.stdout:creating /var/lib/ceph/mgr/ceph-x/keyring 2024-09-14T11:07:09.814 INFO:tasks.ceph:Setting up mds nodes... 2024-09-14T11:07:09.814 INFO:tasks.ceph_client:Setting up client nodes... 2024-09-14T11:07:09.815 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.0 /etc/ceph/ceph.client.0.keyring && sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2024-09-14T11:07:09.850 INFO:teuthology.orchestra.run.smithi138.stdout:creating /etc/ceph/ceph.client.0.keyring 2024-09-14T11:07:09.860 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.1 /etc/ceph/ceph.client.1.keyring && sudo chmod 0644 /etc/ceph/ceph.client.1.keyring 2024-09-14T11:07:09.895 INFO:teuthology.orchestra.run.smithi154.stdout:creating /etc/ceph/ceph.client.1.keyring 2024-09-14T11:07:09.907 INFO:tasks.ceph:Running mkfs on osd nodes... 2024-09-14T11:07:09.908 INFO:tasks.ceph:ctx.disk_config.remote_to_roles_to_dev: {Remote(name='ubuntu@smithi138.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi154.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2024-09-14T11:07:09.908 DEBUG:teuthology.orchestra.run.smithi138:> sudo mkdir -p /var/lib/ceph/osd/ceph-0 2024-09-14T11:07:09.919 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-09-14T11:07:09.919 INFO:tasks.ceph:role: osd.0 2024-09-14T11:07:09.919 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi138.front.sepia.ceph.com 2024-09-14T11:07:09.919 DEBUG:teuthology.orchestra.run.smithi138:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2024-09-14T11:07:09.981 INFO:teuthology.orchestra.run.smithi138.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2024-09-14T11:07:09.982 INFO:teuthology.orchestra.run.smithi138.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-14T11:07:09.982 INFO:teuthology.orchestra.run.smithi138.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-14T11:07:09.982 INFO:teuthology.orchestra.run.smithi138.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-09-14T11:07:09.982 INFO:teuthology.orchestra.run.smithi138.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-14T11:07:09.982 INFO:teuthology.orchestra.run.smithi138.stdout: = sunit=0 swidth=0 blks 2024-09-14T11:07:09.982 INFO:teuthology.orchestra.run.smithi138.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-14T11:07:09.982 INFO:teuthology.orchestra.run.smithi138.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-09-14T11:07:09.982 INFO:teuthology.orchestra.run.smithi138.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-14T11:07:09.982 INFO:teuthology.orchestra.run.smithi138.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-14T11:07:10.452 INFO:teuthology.orchestra.run.smithi138.stdout:Discarding blocks...Done. 2024-09-14T11:07:10.454 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi138.front.sepia.ceph.com -o noatime 2024-09-14T11:07:10.454 DEBUG:teuthology.orchestra.run.smithi138:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-0 2024-09-14T11:07:10.574 DEBUG:teuthology.orchestra.run.smithi138:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-0 2024-09-14T11:07:10.584 INFO:teuthology.orchestra.run.smithi138.stderr:sudo: /sbin/restorecon: command not found 2024-09-14T11:07:10.585 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-14T11:07:10.585 DEBUG:teuthology.orchestra.run.smithi138:> sudo mkdir -p /var/lib/ceph/osd/ceph-1 2024-09-14T11:07:10.642 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-09-14T11:07:10.642 INFO:tasks.ceph:role: osd.1 2024-09-14T11:07:10.642 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi138.front.sepia.ceph.com 2024-09-14T11:07:10.642 DEBUG:teuthology.orchestra.run.smithi138:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2024-09-14T11:07:10.706 INFO:teuthology.orchestra.run.smithi138.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2024-09-14T11:07:10.706 INFO:teuthology.orchestra.run.smithi138.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-14T11:07:10.706 INFO:teuthology.orchestra.run.smithi138.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-14T11:07:10.706 INFO:teuthology.orchestra.run.smithi138.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-09-14T11:07:10.706 INFO:teuthology.orchestra.run.smithi138.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-14T11:07:10.706 INFO:teuthology.orchestra.run.smithi138.stdout: = sunit=0 swidth=0 blks 2024-09-14T11:07:10.706 INFO:teuthology.orchestra.run.smithi138.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-14T11:07:10.706 INFO:teuthology.orchestra.run.smithi138.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-09-14T11:07:10.706 INFO:teuthology.orchestra.run.smithi138.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-14T11:07:10.707 INFO:teuthology.orchestra.run.smithi138.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-14T11:07:11.135 INFO:teuthology.orchestra.run.smithi138.stdout:Discarding blocks...Done. 2024-09-14T11:07:11.137 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi138.front.sepia.ceph.com -o noatime 2024-09-14T11:07:11.137 DEBUG:teuthology.orchestra.run.smithi138:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-1 2024-09-14T11:07:11.200 DEBUG:teuthology.orchestra.run.smithi138:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-1 2024-09-14T11:07:11.250 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-14T11:07:11.251 INFO:teuthology.orchestra.run.smithi138.stderr:sudo: /sbin/restorecon: command not found 2024-09-14T11:07:11.251 DEBUG:teuthology.orchestra.run.smithi138:> sudo mkdir -p /var/lib/ceph/osd/ceph-2 2024-09-14T11:07:11.304 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-09-14T11:07:11.304 INFO:tasks.ceph:role: osd.2 2024-09-14T11:07:11.304 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi138.front.sepia.ceph.com 2024-09-14T11:07:11.304 DEBUG:teuthology.orchestra.run.smithi138:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2024-09-14T11:07:11.365 INFO:teuthology.orchestra.run.smithi138.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2024-09-14T11:07:11.365 INFO:teuthology.orchestra.run.smithi138.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-14T11:07:11.365 INFO:teuthology.orchestra.run.smithi138.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-14T11:07:11.365 INFO:teuthology.orchestra.run.smithi138.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-09-14T11:07:11.366 INFO:teuthology.orchestra.run.smithi138.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-14T11:07:11.366 INFO:teuthology.orchestra.run.smithi138.stdout: = sunit=0 swidth=0 blks 2024-09-14T11:07:11.366 INFO:teuthology.orchestra.run.smithi138.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-14T11:07:11.366 INFO:teuthology.orchestra.run.smithi138.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-09-14T11:07:11.366 INFO:teuthology.orchestra.run.smithi138.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-14T11:07:11.366 INFO:teuthology.orchestra.run.smithi138.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-14T11:07:11.815 INFO:teuthology.orchestra.run.smithi138.stdout:Discarding blocks...Done. 2024-09-14T11:07:11.817 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi138.front.sepia.ceph.com -o noatime 2024-09-14T11:07:11.818 DEBUG:teuthology.orchestra.run.smithi138:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-2 2024-09-14T11:07:11.904 DEBUG:teuthology.orchestra.run.smithi138:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-2 2024-09-14T11:07:11.955 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-14T11:07:11.955 INFO:teuthology.orchestra.run.smithi138.stderr:sudo: /sbin/restorecon: command not found 2024-09-14T11:07:11.956 DEBUG:teuthology.orchestra.run.smithi138:> sudo mkdir -p /var/lib/ceph/osd/ceph-3 2024-09-14T11:07:12.008 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-09-14T11:07:12.008 INFO:tasks.ceph:role: osd.3 2024-09-14T11:07:12.008 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi138.front.sepia.ceph.com 2024-09-14T11:07:12.008 DEBUG:teuthology.orchestra.run.smithi138:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2024-09-14T11:07:12.070 INFO:teuthology.orchestra.run.smithi138.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2024-09-14T11:07:12.070 INFO:teuthology.orchestra.run.smithi138.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-14T11:07:12.070 INFO:teuthology.orchestra.run.smithi138.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-14T11:07:12.070 INFO:teuthology.orchestra.run.smithi138.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-09-14T11:07:12.070 INFO:teuthology.orchestra.run.smithi138.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-14T11:07:12.070 INFO:teuthology.orchestra.run.smithi138.stdout: = sunit=0 swidth=0 blks 2024-09-14T11:07:12.070 INFO:teuthology.orchestra.run.smithi138.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-14T11:07:12.070 INFO:teuthology.orchestra.run.smithi138.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-09-14T11:07:12.070 INFO:teuthology.orchestra.run.smithi138.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-14T11:07:12.071 INFO:teuthology.orchestra.run.smithi138.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-14T11:07:12.529 INFO:teuthology.orchestra.run.smithi138.stdout:Discarding blocks...Done. 2024-09-14T11:07:12.531 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi138.front.sepia.ceph.com -o noatime 2024-09-14T11:07:12.531 DEBUG:teuthology.orchestra.run.smithi138:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-3 2024-09-14T11:07:12.675 DEBUG:teuthology.orchestra.run.smithi138:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-3 2024-09-14T11:07:12.686 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-14T11:07:12.686 INFO:teuthology.orchestra.run.smithi138.stderr:sudo: /sbin/restorecon: command not found 2024-09-14T11:07:12.686 DEBUG:teuthology.orchestra.run.smithi138:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 0 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-14T11:07:12.803 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:07:12.804+0000 7fa1f96117c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-0/keyring: can't open /var/lib/ceph/osd/ceph-0/keyring: (2) No such file or directory 2024-09-14T11:07:12.805 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:07:12.804+0000 7fa1f96117c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-0/keyring 2024-09-14T11:07:12.805 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:07:12.804+0000 7fa1f96117c0 -1 bdev(0x55d64eee1800 /var/lib/ceph/osd/ceph-0/block) open stat got: (1) Operation not permitted 2024-09-14T11:07:12.805 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:07:12.804+0000 7fa1f96117c0 -1 bluestore(/var/lib/ceph/osd/ceph-0) _read_fsid unparsable uuid 2024-09-14T11:07:15.942 DEBUG:teuthology.orchestra.run.smithi138:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2024-09-14T11:07:15.956 DEBUG:teuthology.orchestra.run.smithi138:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 1 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-14T11:07:16.035 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:07:16.036+0000 7f6a4fc4d7c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-1/keyring: can't open /var/lib/ceph/osd/ceph-1/keyring: (2) No such file or directory 2024-09-14T11:07:16.036 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:07:16.036+0000 7f6a4fc4d7c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-1/keyring 2024-09-14T11:07:16.036 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:07:16.036+0000 7f6a4fc4d7c0 -1 bdev(0x562f6e365800 /var/lib/ceph/osd/ceph-1/block) open stat got: (1) Operation not permitted 2024-09-14T11:07:16.036 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:07:16.036+0000 7f6a4fc4d7c0 -1 bluestore(/var/lib/ceph/osd/ceph-1) _read_fsid unparsable uuid 2024-09-14T11:07:19.180 DEBUG:teuthology.orchestra.run.smithi138:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2024-09-14T11:07:19.235 DEBUG:teuthology.orchestra.run.smithi138:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 2 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-14T11:07:19.316 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:07:19.316+0000 7fad21b6c7c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-2/keyring: can't open /var/lib/ceph/osd/ceph-2/keyring: (2) No such file or directory 2024-09-14T11:07:19.317 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:07:19.316+0000 7fad21b6c7c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-2/keyring 2024-09-14T11:07:19.317 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:07:19.316+0000 7fad21b6c7c0 -1 bdev(0x55daabb55800 /var/lib/ceph/osd/ceph-2/block) open stat got: (1) Operation not permitted 2024-09-14T11:07:19.317 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:07:19.316+0000 7fad21b6c7c0 -1 bluestore(/var/lib/ceph/osd/ceph-2) _read_fsid unparsable uuid 2024-09-14T11:07:22.472 DEBUG:teuthology.orchestra.run.smithi138:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2024-09-14T11:07:22.526 DEBUG:teuthology.orchestra.run.smithi138:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 3 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-14T11:07:22.608 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:07:22.608+0000 7f73d2f8c7c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-3/keyring: can't open /var/lib/ceph/osd/ceph-3/keyring: (2) No such file or directory 2024-09-14T11:07:22.609 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:07:22.608+0000 7f73d2f8c7c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-3/keyring 2024-09-14T11:07:22.609 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:07:22.608+0000 7f73d2f8c7c0 -1 bdev(0x5627d3feb800 /var/lib/ceph/osd/ceph-3/block) open stat got: (1) Operation not permitted 2024-09-14T11:07:22.609 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:07:22.608+0000 7f73d2f8c7c0 -1 bluestore(/var/lib/ceph/osd/ceph-3) _read_fsid unparsable uuid 2024-09-14T11:07:25.720 DEBUG:teuthology.orchestra.run.smithi138:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2024-09-14T11:07:25.774 DEBUG:teuthology.orchestra.run.smithi154:> sudo mkdir -p /var/lib/ceph/osd/ceph-4 2024-09-14T11:07:25.788 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-09-14T11:07:25.788 INFO:tasks.ceph:role: osd.4 2024-09-14T11:07:25.788 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi154.front.sepia.ceph.com 2024-09-14T11:07:25.789 DEBUG:teuthology.orchestra.run.smithi154:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2024-09-14T11:07:25.851 INFO:teuthology.orchestra.run.smithi154.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2024-09-14T11:07:25.851 INFO:teuthology.orchestra.run.smithi154.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-14T11:07:25.851 INFO:teuthology.orchestra.run.smithi154.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-14T11:07:25.852 INFO:teuthology.orchestra.run.smithi154.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-09-14T11:07:25.852 INFO:teuthology.orchestra.run.smithi154.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-14T11:07:25.852 INFO:teuthology.orchestra.run.smithi154.stdout: = sunit=0 swidth=0 blks 2024-09-14T11:07:25.852 INFO:teuthology.orchestra.run.smithi154.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-14T11:07:25.852 INFO:teuthology.orchestra.run.smithi154.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-09-14T11:07:25.852 INFO:teuthology.orchestra.run.smithi154.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-14T11:07:25.852 INFO:teuthology.orchestra.run.smithi154.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-14T11:07:26.338 INFO:teuthology.orchestra.run.smithi154.stdout:Discarding blocks...Done. 2024-09-14T11:07:26.340 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi154.front.sepia.ceph.com -o noatime 2024-09-14T11:07:26.340 DEBUG:teuthology.orchestra.run.smithi154:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-4 2024-09-14T11:07:26.498 DEBUG:teuthology.orchestra.run.smithi154:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-4 2024-09-14T11:07:26.508 INFO:teuthology.orchestra.run.smithi154.stderr:sudo: /sbin/restorecon: command not found 2024-09-14T11:07:26.508 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-14T11:07:26.509 DEBUG:teuthology.orchestra.run.smithi154:> sudo mkdir -p /var/lib/ceph/osd/ceph-5 2024-09-14T11:07:26.562 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-09-14T11:07:26.562 INFO:tasks.ceph:role: osd.5 2024-09-14T11:07:26.562 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi154.front.sepia.ceph.com 2024-09-14T11:07:26.562 DEBUG:teuthology.orchestra.run.smithi154:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2024-09-14T11:07:26.624 INFO:teuthology.orchestra.run.smithi154.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2024-09-14T11:07:26.624 INFO:teuthology.orchestra.run.smithi154.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-14T11:07:26.624 INFO:teuthology.orchestra.run.smithi154.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-14T11:07:26.624 INFO:teuthology.orchestra.run.smithi154.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-09-14T11:07:26.624 INFO:teuthology.orchestra.run.smithi154.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-14T11:07:26.624 INFO:teuthology.orchestra.run.smithi154.stdout: = sunit=0 swidth=0 blks 2024-09-14T11:07:26.624 INFO:teuthology.orchestra.run.smithi154.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-14T11:07:26.624 INFO:teuthology.orchestra.run.smithi154.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-09-14T11:07:26.625 INFO:teuthology.orchestra.run.smithi154.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-14T11:07:26.625 INFO:teuthology.orchestra.run.smithi154.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-14T11:07:27.073 INFO:teuthology.orchestra.run.smithi154.stdout:Discarding blocks...Done. 2024-09-14T11:07:27.075 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi154.front.sepia.ceph.com -o noatime 2024-09-14T11:07:27.075 DEBUG:teuthology.orchestra.run.smithi154:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-5 2024-09-14T11:07:27.165 DEBUG:teuthology.orchestra.run.smithi154:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-5 2024-09-14T11:07:27.175 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-14T11:07:27.176 INFO:teuthology.orchestra.run.smithi154.stderr:sudo: /sbin/restorecon: command not found 2024-09-14T11:07:27.176 DEBUG:teuthology.orchestra.run.smithi154:> sudo mkdir -p /var/lib/ceph/osd/ceph-6 2024-09-14T11:07:27.230 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-09-14T11:07:27.230 INFO:tasks.ceph:role: osd.6 2024-09-14T11:07:27.230 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi154.front.sepia.ceph.com 2024-09-14T11:07:27.230 DEBUG:teuthology.orchestra.run.smithi154:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2024-09-14T11:07:27.289 INFO:teuthology.orchestra.run.smithi154.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2024-09-14T11:07:27.289 INFO:teuthology.orchestra.run.smithi154.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-14T11:07:27.289 INFO:teuthology.orchestra.run.smithi154.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-14T11:07:27.290 INFO:teuthology.orchestra.run.smithi154.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-09-14T11:07:27.290 INFO:teuthology.orchestra.run.smithi154.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-14T11:07:27.290 INFO:teuthology.orchestra.run.smithi154.stdout: = sunit=0 swidth=0 blks 2024-09-14T11:07:27.290 INFO:teuthology.orchestra.run.smithi154.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-14T11:07:27.290 INFO:teuthology.orchestra.run.smithi154.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-09-14T11:07:27.290 INFO:teuthology.orchestra.run.smithi154.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-14T11:07:27.290 INFO:teuthology.orchestra.run.smithi154.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-14T11:07:27.758 INFO:teuthology.orchestra.run.smithi154.stdout:Discarding blocks...Done. 2024-09-14T11:07:27.760 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi154.front.sepia.ceph.com -o noatime 2024-09-14T11:07:27.760 DEBUG:teuthology.orchestra.run.smithi154:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-6 2024-09-14T11:07:27.870 DEBUG:teuthology.orchestra.run.smithi154:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-6 2024-09-14T11:07:27.882 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-14T11:07:27.882 INFO:teuthology.orchestra.run.smithi154.stderr:sudo: /sbin/restorecon: command not found 2024-09-14T11:07:27.882 DEBUG:teuthology.orchestra.run.smithi154:> sudo mkdir -p /var/lib/ceph/osd/ceph-7 2024-09-14T11:07:27.937 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-09-14T11:07:27.938 INFO:tasks.ceph:role: osd.7 2024-09-14T11:07:27.939 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi154.front.sepia.ceph.com 2024-09-14T11:07:27.940 DEBUG:teuthology.orchestra.run.smithi154:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2024-09-14T11:07:27.999 INFO:teuthology.orchestra.run.smithi154.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2024-09-14T11:07:28.000 INFO:teuthology.orchestra.run.smithi154.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-14T11:07:28.000 INFO:teuthology.orchestra.run.smithi154.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-14T11:07:28.000 INFO:teuthology.orchestra.run.smithi154.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-09-14T11:07:28.000 INFO:teuthology.orchestra.run.smithi154.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-14T11:07:28.000 INFO:teuthology.orchestra.run.smithi154.stdout: = sunit=0 swidth=0 blks 2024-09-14T11:07:28.000 INFO:teuthology.orchestra.run.smithi154.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-14T11:07:28.000 INFO:teuthology.orchestra.run.smithi154.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-09-14T11:07:28.000 INFO:teuthology.orchestra.run.smithi154.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-14T11:07:28.000 INFO:teuthology.orchestra.run.smithi154.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-14T11:07:28.503 INFO:teuthology.orchestra.run.smithi154.stdout:Discarding blocks...Done. 2024-09-14T11:07:28.505 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi154.front.sepia.ceph.com -o noatime 2024-09-14T11:07:28.505 DEBUG:teuthology.orchestra.run.smithi154:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-7 2024-09-14T11:07:28.644 DEBUG:teuthology.orchestra.run.smithi154:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-7 2024-09-14T11:07:28.655 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-14T11:07:28.656 INFO:teuthology.orchestra.run.smithi154.stderr:sudo: /sbin/restorecon: command not found 2024-09-14T11:07:28.656 DEBUG:teuthology.orchestra.run.smithi154:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 4 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-14T11:07:28.772 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-14T11:07:28.785+0000 7fc8e75547c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-4/keyring: can't open /var/lib/ceph/osd/ceph-4/keyring: (2) No such file or directory 2024-09-14T11:07:28.775 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-14T11:07:28.789+0000 7fc8e75547c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-4/keyring 2024-09-14T11:07:28.775 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-14T11:07:28.789+0000 7fc8e75547c0 -1 bdev(0x55fe95069800 /var/lib/ceph/osd/ceph-4/block) open stat got: (1) Operation not permitted 2024-09-14T11:07:28.775 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-14T11:07:28.789+0000 7fc8e75547c0 -1 bluestore(/var/lib/ceph/osd/ceph-4) _read_fsid unparsable uuid 2024-09-14T11:07:31.905 DEBUG:teuthology.orchestra.run.smithi154:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-4 2024-09-14T11:07:31.920 DEBUG:teuthology.orchestra.run.smithi154:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 5 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-14T11:07:32.003 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-14T11:07:32.013+0000 7fcfc34867c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-5/keyring: can't open /var/lib/ceph/osd/ceph-5/keyring: (2) No such file or directory 2024-09-14T11:07:32.003 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-14T11:07:32.017+0000 7fcfc34867c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-5/keyring 2024-09-14T11:07:32.003 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-14T11:07:32.017+0000 7fcfc34867c0 -1 bdev(0x55818de85800 /var/lib/ceph/osd/ceph-5/block) open stat got: (1) Operation not permitted 2024-09-14T11:07:32.004 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-14T11:07:32.017+0000 7fcfc34867c0 -1 bluestore(/var/lib/ceph/osd/ceph-5) _read_fsid unparsable uuid 2024-09-14T11:07:35.119 DEBUG:teuthology.orchestra.run.smithi154:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-5 2024-09-14T11:07:35.175 DEBUG:teuthology.orchestra.run.smithi154:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 6 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-14T11:07:35.256 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-14T11:07:35.269+0000 7f2e016e87c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-6/keyring: can't open /var/lib/ceph/osd/ceph-6/keyring: (2) No such file or directory 2024-09-14T11:07:35.257 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-14T11:07:35.269+0000 7f2e016e87c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-6/keyring 2024-09-14T11:07:35.257 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-14T11:07:35.269+0000 7f2e016e87c0 -1 bdev(0x560743c19800 /var/lib/ceph/osd/ceph-6/block) open stat got: (1) Operation not permitted 2024-09-14T11:07:35.257 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-14T11:07:35.269+0000 7f2e016e87c0 -1 bluestore(/var/lib/ceph/osd/ceph-6) _read_fsid unparsable uuid 2024-09-14T11:07:38.403 DEBUG:teuthology.orchestra.run.smithi154:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-6 2024-09-14T11:07:38.460 DEBUG:teuthology.orchestra.run.smithi154:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 7 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-14T11:07:38.542 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-14T11:07:38.553+0000 7ff4154277c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-7/keyring: can't open /var/lib/ceph/osd/ceph-7/keyring: (2) No such file or directory 2024-09-14T11:07:38.542 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-14T11:07:38.553+0000 7ff4154277c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-7/keyring 2024-09-14T11:07:38.543 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-14T11:07:38.553+0000 7ff4154277c0 -1 bdev(0x55e235e77800 /var/lib/ceph/osd/ceph-7/block) open stat got: (1) Operation not permitted 2024-09-14T11:07:38.543 INFO:teuthology.orchestra.run.smithi154.stderr:2024-09-14T11:07:38.553+0000 7ff4154277c0 -1 bluestore(/var/lib/ceph/osd/ceph-7) _read_fsid unparsable uuid 2024-09-14T11:07:41.662 DEBUG:teuthology.orchestra.run.smithi154:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-7 2024-09-14T11:07:41.720 INFO:tasks.ceph:Reading keys from all nodes... 2024-09-14T11:07:41.720 DEBUG:teuthology.orchestra.run.smithi138:> set -ex 2024-09-14T11:07:41.720 DEBUG:teuthology.orchestra.run.smithi138:> sudo dd if=/var/lib/ceph/mgr/ceph-y/keyring of=/dev/stdout 2024-09-14T11:07:41.734 DEBUG:teuthology.orchestra.run.smithi138:> set -ex 2024-09-14T11:07:41.734 DEBUG:teuthology.orchestra.run.smithi138:> sudo dd if=/var/lib/ceph/osd/ceph-0/keyring of=/dev/stdout 2024-09-14T11:07:41.789 DEBUG:teuthology.orchestra.run.smithi138:> set -ex 2024-09-14T11:07:41.789 DEBUG:teuthology.orchestra.run.smithi138:> sudo dd if=/var/lib/ceph/osd/ceph-1/keyring of=/dev/stdout 2024-09-14T11:07:41.846 DEBUG:teuthology.orchestra.run.smithi138:> set -ex 2024-09-14T11:07:41.846 DEBUG:teuthology.orchestra.run.smithi138:> sudo dd if=/var/lib/ceph/osd/ceph-2/keyring of=/dev/stdout 2024-09-14T11:07:41.901 DEBUG:teuthology.orchestra.run.smithi138:> set -ex 2024-09-14T11:07:41.901 DEBUG:teuthology.orchestra.run.smithi138:> sudo dd if=/var/lib/ceph/osd/ceph-3/keyring of=/dev/stdout 2024-09-14T11:07:41.953 DEBUG:teuthology.orchestra.run.smithi154:> set -ex 2024-09-14T11:07:41.954 DEBUG:teuthology.orchestra.run.smithi154:> sudo dd if=/var/lib/ceph/mgr/ceph-x/keyring of=/dev/stdout 2024-09-14T11:07:41.967 DEBUG:teuthology.orchestra.run.smithi154:> set -ex 2024-09-14T11:07:41.967 DEBUG:teuthology.orchestra.run.smithi154:> sudo dd if=/var/lib/ceph/osd/ceph-4/keyring of=/dev/stdout 2024-09-14T11:07:42.022 DEBUG:teuthology.orchestra.run.smithi154:> set -ex 2024-09-14T11:07:42.022 DEBUG:teuthology.orchestra.run.smithi154:> sudo dd if=/var/lib/ceph/osd/ceph-5/keyring of=/dev/stdout 2024-09-14T11:07:42.075 DEBUG:teuthology.orchestra.run.smithi154:> set -ex 2024-09-14T11:07:42.075 DEBUG:teuthology.orchestra.run.smithi154:> sudo dd if=/var/lib/ceph/osd/ceph-6/keyring of=/dev/stdout 2024-09-14T11:07:42.130 DEBUG:teuthology.orchestra.run.smithi154:> set -ex 2024-09-14T11:07:42.130 DEBUG:teuthology.orchestra.run.smithi154:> sudo dd if=/var/lib/ceph/osd/ceph-7/keyring of=/dev/stdout 2024-09-14T11:07:42.186 DEBUG:teuthology.orchestra.run.smithi138:> set -ex 2024-09-14T11:07:42.186 DEBUG:teuthology.orchestra.run.smithi138:> dd if=/etc/ceph/ceph.client.0.keyring of=/dev/stdout 2024-09-14T11:07:42.192 DEBUG:teuthology.orchestra.run.smithi154:> set -ex 2024-09-14T11:07:42.192 DEBUG:teuthology.orchestra.run.smithi154:> dd if=/etc/ceph/ceph.client.1.keyring of=/dev/stdout 2024-09-14T11:07:42.232 INFO:tasks.ceph:Adding keys to all mons... 2024-09-14T11:07:42.232 DEBUG:teuthology.orchestra.run.smithi138:> sudo tee -a /etc/ceph/ceph.keyring 2024-09-14T11:07:42.235 DEBUG:teuthology.orchestra.run.smithi154:> sudo tee -a /etc/ceph/ceph.keyring 2024-09-14T11:07:42.277 INFO:teuthology.orchestra.run.smithi138.stdout:[mgr.y] 2024-09-14T11:07:42.277 INFO:teuthology.orchestra.run.smithi138.stdout: key = AQBdbuVmfUw+LRAAt+NZF+SMhK98JhHmXJ/90Q== 2024-09-14T11:07:42.277 INFO:teuthology.orchestra.run.smithi138.stdout:[osd.0] 2024-09-14T11:07:42.277 INFO:teuthology.orchestra.run.smithi138.stdout: key = AQBgbuVmJQcSMBAAewMN91OHm7kbHzmVV3Zsdg== 2024-09-14T11:07:42.278 INFO:teuthology.orchestra.run.smithi138.stdout:[osd.1] 2024-09-14T11:07:42.278 INFO:teuthology.orchestra.run.smithi138.stdout: key = AQBkbuVmL+xOAhAAlTT7TetEOLGq9+fdXPFVoA== 2024-09-14T11:07:42.278 INFO:teuthology.orchestra.run.smithi138.stdout:[osd.2] 2024-09-14T11:07:42.278 INFO:teuthology.orchestra.run.smithi138.stdout: key = AQBnbuVmBDsIExAA0qPJgEhYbWASH0bTe26T9w== 2024-09-14T11:07:42.278 INFO:teuthology.orchestra.run.smithi138.stdout:[osd.3] 2024-09-14T11:07:42.278 INFO:teuthology.orchestra.run.smithi138.stdout: key = AQBqbuVmiP9xJBAA1HvTEGWX5h+2XeOWq+3nXw== 2024-09-14T11:07:42.278 INFO:teuthology.orchestra.run.smithi138.stdout:[mgr.x] 2024-09-14T11:07:42.278 INFO:teuthology.orchestra.run.smithi138.stdout: key = AQBdbuVm5+2eMBAAI9RDO+OWu1ZIwXZYE7v73Q== 2024-09-14T11:07:42.278 INFO:teuthology.orchestra.run.smithi138.stdout:[osd.4] 2024-09-14T11:07:42.278 INFO:teuthology.orchestra.run.smithi138.stdout: key = AQBwbuVmdCbkLhAAvhRsaIJuovRVj4dB0VqWbw== 2024-09-14T11:07:42.278 INFO:teuthology.orchestra.run.smithi138.stdout:[osd.5] 2024-09-14T11:07:42.278 INFO:teuthology.orchestra.run.smithi138.stdout: key = AQB0buVmTrgOARAAP+5AMYHYsxoJxdFJGeDN9g== 2024-09-14T11:07:42.278 INFO:teuthology.orchestra.run.smithi138.stdout:[osd.6] 2024-09-14T11:07:42.278 INFO:teuthology.orchestra.run.smithi138.stdout: key = AQB3buVmZlUtEBAAzSJKxSFE9pVerMiqqNpfdA== 2024-09-14T11:07:42.278 INFO:teuthology.orchestra.run.smithi138.stdout:[osd.7] 2024-09-14T11:07:42.279 INFO:teuthology.orchestra.run.smithi138.stdout: key = AQB6buVmKIAzIRAAPA5DWIaIF9YL9QKN7tjuzg== 2024-09-14T11:07:42.279 INFO:teuthology.orchestra.run.smithi138.stdout:[client.0] 2024-09-14T11:07:42.279 INFO:teuthology.orchestra.run.smithi138.stdout: key = AQBdbuVmdHzdMhAAwZEzwD70sGm+16FFRvwahQ== 2024-09-14T11:07:42.279 INFO:teuthology.orchestra.run.smithi138.stdout:[client.1] 2024-09-14T11:07:42.279 INFO:teuthology.orchestra.run.smithi138.stdout: key = AQBdbuVmFKRBNhAA9AeX6PD3vXnVvgBOAUP4zw== 2024-09-14T11:07:42.286 INFO:teuthology.orchestra.run.smithi154.stdout:[mgr.y] 2024-09-14T11:07:42.286 INFO:teuthology.orchestra.run.smithi154.stdout: key = AQBdbuVmfUw+LRAAt+NZF+SMhK98JhHmXJ/90Q== 2024-09-14T11:07:42.286 INFO:teuthology.orchestra.run.smithi154.stdout:[osd.0] 2024-09-14T11:07:42.286 INFO:teuthology.orchestra.run.smithi154.stdout: key = AQBgbuVmJQcSMBAAewMN91OHm7kbHzmVV3Zsdg== 2024-09-14T11:07:42.286 INFO:teuthology.orchestra.run.smithi154.stdout:[osd.1] 2024-09-14T11:07:42.286 INFO:teuthology.orchestra.run.smithi154.stdout: key = AQBkbuVmL+xOAhAAlTT7TetEOLGq9+fdXPFVoA== 2024-09-14T11:07:42.286 INFO:teuthology.orchestra.run.smithi154.stdout:[osd.2] 2024-09-14T11:07:42.286 INFO:teuthology.orchestra.run.smithi154.stdout: key = AQBnbuVmBDsIExAA0qPJgEhYbWASH0bTe26T9w== 2024-09-14T11:07:42.286 INFO:teuthology.orchestra.run.smithi154.stdout:[osd.3] 2024-09-14T11:07:42.286 INFO:teuthology.orchestra.run.smithi154.stdout: key = AQBqbuVmiP9xJBAA1HvTEGWX5h+2XeOWq+3nXw== 2024-09-14T11:07:42.286 INFO:teuthology.orchestra.run.smithi154.stdout:[mgr.x] 2024-09-14T11:07:42.287 INFO:teuthology.orchestra.run.smithi154.stdout: key = AQBdbuVm5+2eMBAAI9RDO+OWu1ZIwXZYE7v73Q== 2024-09-14T11:07:42.287 INFO:teuthology.orchestra.run.smithi154.stdout:[osd.4] 2024-09-14T11:07:42.287 INFO:teuthology.orchestra.run.smithi154.stdout: key = AQBwbuVmdCbkLhAAvhRsaIJuovRVj4dB0VqWbw== 2024-09-14T11:07:42.287 INFO:teuthology.orchestra.run.smithi154.stdout:[osd.5] 2024-09-14T11:07:42.287 INFO:teuthology.orchestra.run.smithi154.stdout: key = AQB0buVmTrgOARAAP+5AMYHYsxoJxdFJGeDN9g== 2024-09-14T11:07:42.287 INFO:teuthology.orchestra.run.smithi154.stdout:[osd.6] 2024-09-14T11:07:42.287 INFO:teuthology.orchestra.run.smithi154.stdout: key = AQB3buVmZlUtEBAAzSJKxSFE9pVerMiqqNpfdA== 2024-09-14T11:07:42.287 INFO:teuthology.orchestra.run.smithi154.stdout:[osd.7] 2024-09-14T11:07:42.287 INFO:teuthology.orchestra.run.smithi154.stdout: key = AQB6buVmKIAzIRAAPA5DWIaIF9YL9QKN7tjuzg== 2024-09-14T11:07:42.287 INFO:teuthology.orchestra.run.smithi154.stdout:[client.0] 2024-09-14T11:07:42.287 INFO:teuthology.orchestra.run.smithi154.stdout: key = AQBdbuVmdHzdMhAAwZEzwD70sGm+16FFRvwahQ== 2024-09-14T11:07:42.287 INFO:teuthology.orchestra.run.smithi154.stdout:[client.1] 2024-09-14T11:07:42.287 INFO:teuthology.orchestra.run.smithi154.stdout: key = AQBdbuVmFKRBNhAA9AeX6PD3vXnVvgBOAUP4zw== 2024-09-14T11:07:42.288 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-09-14T11:07:42.323 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-09-14T11:07:42.377 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-14T11:07:42.379 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-14T11:07:42.422 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-14T11:07:42.467 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-14T11:07:42.506 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-14T11:07:42.551 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-14T11:07:42.590 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-14T11:07:42.635 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-14T11:07:42.678 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-09-14T11:07:42.723 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-09-14T11:07:42.766 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-14T11:07:42.768 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-14T11:07:42.847 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-14T11:07:42.851 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-14T11:07:42.936 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-14T11:07:42.938 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-14T11:07:42.982 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-14T11:07:42.985 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-14T11:07:43.065 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-09-14T11:07:43.071 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-09-14T11:07:43.150 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.1 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-09-14T11:07:43.152 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.1 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-09-14T11:07:43.237 INFO:tasks.ceph:Running mkfs on mon nodes... 2024-09-14T11:07:43.237 DEBUG:teuthology.orchestra.run.smithi138:> sudo mkdir -p /var/lib/ceph/mon/ceph-a 2024-09-14T11:07:43.249 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i a --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-09-14T11:07:43.343 DEBUG:teuthology.orchestra.run.smithi138:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-a 2024-09-14T11:07:43.354 DEBUG:teuthology.orchestra.run.smithi138:> sudo mkdir -p /var/lib/ceph/mon/ceph-c 2024-09-14T11:07:43.407 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i c --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-09-14T11:07:43.495 DEBUG:teuthology.orchestra.run.smithi138:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-c 2024-09-14T11:07:43.552 DEBUG:teuthology.orchestra.run.smithi154:> sudo mkdir -p /var/lib/ceph/mon/ceph-b 2024-09-14T11:07:43.566 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i b --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-09-14T11:07:43.665 DEBUG:teuthology.orchestra.run.smithi154:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-b 2024-09-14T11:07:43.677 DEBUG:teuthology.orchestra.run.smithi138:> rm -- /home/ubuntu/cephtest/ceph.monmap 2024-09-14T11:07:43.679 DEBUG:teuthology.orchestra.run.smithi154:> rm -- /home/ubuntu/cephtest/ceph.monmap 2024-09-14T11:07:43.723 INFO:tasks.ceph:Starting mon daemons in cluster ceph... 2024-09-14T11:07:43.723 INFO:tasks.ceph.mon.a:Restarting daemon 2024-09-14T11:07:43.723 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i a 2024-09-14T11:07:43.727 INFO:tasks.ceph.mon.a:Started 2024-09-14T11:07:43.727 INFO:tasks.ceph.mon.c:Restarting daemon 2024-09-14T11:07:43.727 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i c 2024-09-14T11:07:43.729 INFO:tasks.ceph.mon.c:Started 2024-09-14T11:07:43.730 INFO:tasks.ceph.mon.b:Restarting daemon 2024-09-14T11:07:43.730 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i b 2024-09-14T11:07:43.768 INFO:tasks.ceph.mon.b:Started 2024-09-14T11:07:43.768 INFO:tasks.ceph:Starting mgr daemons in cluster ceph... 2024-09-14T11:07:43.769 INFO:tasks.ceph.mgr.y:Restarting daemon 2024-09-14T11:07:43.769 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i y 2024-09-14T11:07:43.771 INFO:tasks.ceph.mgr.y:Started 2024-09-14T11:07:43.771 INFO:tasks.ceph.mgr.x:Restarting daemon 2024-09-14T11:07:43.771 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i x 2024-09-14T11:07:43.773 INFO:tasks.ceph.mgr.x:Started 2024-09-14T11:07:43.773 DEBUG:tasks.ceph:set 0 configs 2024-09-14T11:07:43.773 INFO:tasks.ceph:Setting crush tunables to default 2024-09-14T11:07:43.774 DEBUG:teuthology.orchestra.run.smithi138:> sudo ceph --cluster ceph osd crush tunables default 2024-09-14T11:07:49.268 INFO:teuthology.orchestra.run.smithi138.stderr:adjusted tunables profile to default 2024-09-14T11:07:49.287 INFO:tasks.ceph:check_enable_crimson: False 2024-09-14T11:07:49.287 INFO:tasks.ceph:Starting osd daemons in cluster ceph... 2024-09-14T11:07:49.288 DEBUG:teuthology.orchestra.run.smithi138:> set -ex 2024-09-14T11:07:49.288 DEBUG:teuthology.orchestra.run.smithi138:> sudo dd if=/var/lib/ceph/osd/ceph-0/fsid of=/dev/stdout 2024-09-14T11:07:49.300 DEBUG:teuthology.orchestra.run.smithi138:> set -ex 2024-09-14T11:07:49.300 DEBUG:teuthology.orchestra.run.smithi138:> sudo dd if=/var/lib/ceph/osd/ceph-1/fsid of=/dev/stdout 2024-09-14T11:07:49.353 DEBUG:teuthology.orchestra.run.smithi138:> set -ex 2024-09-14T11:07:49.353 DEBUG:teuthology.orchestra.run.smithi138:> sudo dd if=/var/lib/ceph/osd/ceph-2/fsid of=/dev/stdout 2024-09-14T11:07:49.405 DEBUG:teuthology.orchestra.run.smithi138:> set -ex 2024-09-14T11:07:49.405 DEBUG:teuthology.orchestra.run.smithi138:> sudo dd if=/var/lib/ceph/osd/ceph-3/fsid of=/dev/stdout 2024-09-14T11:07:49.456 DEBUG:teuthology.orchestra.run.smithi154:> set -ex 2024-09-14T11:07:49.456 DEBUG:teuthology.orchestra.run.smithi154:> sudo dd if=/var/lib/ceph/osd/ceph-4/fsid of=/dev/stdout 2024-09-14T11:07:49.471 DEBUG:teuthology.orchestra.run.smithi154:> set -ex 2024-09-14T11:07:49.471 DEBUG:teuthology.orchestra.run.smithi154:> sudo dd if=/var/lib/ceph/osd/ceph-5/fsid of=/dev/stdout 2024-09-14T11:07:49.526 DEBUG:teuthology.orchestra.run.smithi154:> set -ex 2024-09-14T11:07:49.526 DEBUG:teuthology.orchestra.run.smithi154:> sudo dd if=/var/lib/ceph/osd/ceph-6/fsid of=/dev/stdout 2024-09-14T11:07:49.581 DEBUG:teuthology.orchestra.run.smithi154:> set -ex 2024-09-14T11:07:49.581 DEBUG:teuthology.orchestra.run.smithi154:> sudo dd if=/var/lib/ceph/osd/ceph-7/fsid of=/dev/stdout 2024-09-14T11:07:49.635 DEBUG:teuthology.orchestra.run.smithi154:> sudo ceph --cluster ceph osd new 947de938-c674-418d-972a-cff0472a9a26 0 2024-09-14T11:07:49.914 INFO:teuthology.orchestra.run.smithi154.stdout:0 2024-09-14T11:07:49.932 DEBUG:teuthology.orchestra.run.smithi154:> sudo ceph --cluster ceph osd new 7ac84832-0a45-44f5-81fb-e1b7242c6a8f 1 2024-09-14T11:07:50.139 INFO:teuthology.orchestra.run.smithi154.stdout:1 2024-09-14T11:07:50.158 DEBUG:teuthology.orchestra.run.smithi154:> sudo ceph --cluster ceph osd new ef3e736d-f269-4fca-8ccf-f803d70c763f 2 2024-09-14T11:07:50.363 INFO:teuthology.orchestra.run.smithi154.stdout:2 2024-09-14T11:07:50.379 DEBUG:teuthology.orchestra.run.smithi154:> sudo ceph --cluster ceph osd new 5462705a-cf30-4d3f-88d7-f9ae0ed6e95a 3 2024-09-14T11:07:50.586 INFO:teuthology.orchestra.run.smithi154.stdout:3 2024-09-14T11:07:50.603 DEBUG:teuthology.orchestra.run.smithi154:> sudo ceph --cluster ceph osd new 22e8be21-7053-4e2f-9c88-a250c5e33e7a 4 2024-09-14T11:07:50.835 INFO:teuthology.orchestra.run.smithi154.stdout:4 2024-09-14T11:07:50.853 DEBUG:teuthology.orchestra.run.smithi154:> sudo ceph --cluster ceph osd new 2335b408-831d-400d-bf15-1942f44cfaef 5 2024-09-14T11:07:51.058 INFO:teuthology.orchestra.run.smithi154.stdout:5 2024-09-14T11:07:51.075 DEBUG:teuthology.orchestra.run.smithi154:> sudo ceph --cluster ceph osd new 54ab7858-af15-486f-9cfb-626e1541c86d 6 2024-09-14T11:07:51.265 INFO:teuthology.orchestra.run.smithi154.stdout:6 2024-09-14T11:07:51.281 DEBUG:teuthology.orchestra.run.smithi154:> sudo ceph --cluster ceph osd new a28d625e-6b5e-4a31-a651-dc89943d6a84 7 2024-09-14T11:07:51.476 INFO:teuthology.orchestra.run.smithi154.stdout:7 2024-09-14T11:07:51.493 INFO:tasks.ceph.osd.0:Restarting daemon 2024-09-14T11:07:51.493 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 0 2024-09-14T11:07:51.495 INFO:tasks.ceph.osd.0:Started 2024-09-14T11:07:51.496 INFO:tasks.ceph.osd.1:Restarting daemon 2024-09-14T11:07:51.496 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 1 2024-09-14T11:07:51.498 INFO:tasks.ceph.osd.1:Started 2024-09-14T11:07:51.498 INFO:tasks.ceph.osd.2:Restarting daemon 2024-09-14T11:07:51.498 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 2 2024-09-14T11:07:51.500 INFO:tasks.ceph.osd.2:Started 2024-09-14T11:07:51.500 INFO:tasks.ceph.osd.3:Restarting daemon 2024-09-14T11:07:51.500 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 3 2024-09-14T11:07:51.502 INFO:tasks.ceph.osd.3:Started 2024-09-14T11:07:51.503 INFO:tasks.ceph.osd.4:Restarting daemon 2024-09-14T11:07:51.503 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 4 2024-09-14T11:07:51.505 INFO:tasks.ceph.osd.4:Started 2024-09-14T11:07:51.505 INFO:tasks.ceph.osd.5:Restarting daemon 2024-09-14T11:07:51.505 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 5 2024-09-14T11:07:51.506 INFO:tasks.ceph.osd.5:Started 2024-09-14T11:07:51.507 INFO:tasks.ceph.osd.6:Restarting daemon 2024-09-14T11:07:51.507 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 6 2024-09-14T11:07:51.508 INFO:tasks.ceph.osd.6:Started 2024-09-14T11:07:51.509 INFO:tasks.ceph.osd.7:Restarting daemon 2024-09-14T11:07:51.509 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 7 2024-09-14T11:07:51.510 INFO:tasks.ceph.osd.7:Started 2024-09-14T11:07:51.511 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-14T11:07:51.702 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-09-14T11:07:51.702 INFO:teuthology.orchestra.run.smithi138.stdout:{"epoch":10,"fsid":"3f225f43-83a6-4aeb-b798-1f04bb49d597","created":"2024-09-14T11:07:49.131734+0000","modified":"2024-09-14T11:07:51.476209+0000","last_up_change":"0.000000","last_in_change":"2024-09-14T11:07:51.476209+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"947de938-c674-418d-972a-cff0472a9a26","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"7ac84832-0a45-44f5-81fb-e1b7242c6a8f","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"ef3e736d-f269-4fca-8ccf-f803d70c763f","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"5462705a-cf30-4d3f-88d7-f9ae0ed6e95a","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"22e8be21-7053-4e2f-9c88-a250c5e33e7a","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"2335b408-831d-400d-bf15-1942f44cfaef","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"54ab7858-af15-486f-9cfb-626e1541c86d","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"a28d625e-6b5e-4a31-a651-dc89943d6a84","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-14T11:07:51.717 INFO:tasks.ceph.ceph_manager.ceph:[] 2024-09-14T11:07:51.718 INFO:tasks.ceph:Waiting for OSDs to come up 2024-09-14T11:07:52.524 DEBUG:teuthology.orchestra.run.smithi138:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-09-14T11:07:52.705 INFO:teuthology.misc.health.smithi138.stdout: 2024-09-14T11:07:52.705 INFO:teuthology.misc.health.smithi138.stdout:{"epoch":10,"fsid":"3f225f43-83a6-4aeb-b798-1f04bb49d597","created":"2024-09-14T11:07:49.131734+0000","modified":"2024-09-14T11:07:51.476209+0000","last_up_change":"0.000000","last_in_change":"2024-09-14T11:07:51.476209+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"947de938-c674-418d-972a-cff0472a9a26","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"7ac84832-0a45-44f5-81fb-e1b7242c6a8f","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"ef3e736d-f269-4fca-8ccf-f803d70c763f","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"5462705a-cf30-4d3f-88d7-f9ae0ed6e95a","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"22e8be21-7053-4e2f-9c88-a250c5e33e7a","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"2335b408-831d-400d-bf15-1942f44cfaef","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"54ab7858-af15-486f-9cfb-626e1541c86d","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"a28d625e-6b5e-4a31-a651-dc89943d6a84","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-14T11:07:52.720 DEBUG:teuthology.misc:0 of 8 OSDs are up 2024-09-14T11:07:52.773 INFO:tasks.ceph.mgr.y.smithi138.stderr:/usr/lib/python3/dist-packages/scipy/__init__.py:67: UserWarning: NumPy was imported from a Python sub-interpreter but NumPy does not properly support sub-interpreters. This will likely work for most users but might cause hard to track down issues or subtle bugs. A common user of the rare sub-interpreter feature is wsgi which also allows single-interpreter mode. 2024-09-14T11:07:52.774 INFO:tasks.ceph.mgr.y.smithi138.stderr:Improvements in the case of bugs are welcome, but is not on the NumPy roadmap, and full support may require significant effort to achieve. 2024-09-14T11:07:52.774 INFO:tasks.ceph.mgr.y.smithi138.stderr: from numpy import show_config as show_numpy_config 2024-09-14T11:07:52.793 INFO:tasks.ceph.mgr.x.smithi154.stderr:/usr/lib/python3/dist-packages/scipy/__init__.py:67: UserWarning: NumPy was imported from a Python sub-interpreter but NumPy does not properly support sub-interpreters. This will likely work for most users but might cause hard to track down issues or subtle bugs. A common user of the rare sub-interpreter feature is wsgi which also allows single-interpreter mode. 2024-09-14T11:07:52.793 INFO:tasks.ceph.mgr.x.smithi154.stderr:Improvements in the case of bugs are welcome, but is not on the NumPy roadmap, and full support may require significant effort to achieve. 2024-09-14T11:07:52.793 INFO:tasks.ceph.mgr.x.smithi154.stderr: from numpy import show_config as show_numpy_config 2024-09-14T11:07:52.918 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-14T11:07:52.920+0000 7f3e69d6c7c0 -1 Falling back to public interface 2024-09-14T11:07:52.926 INFO:tasks.ceph.osd.3.smithi138.stderr:2024-09-14T11:07:52.928+0000 7f0d9653f7c0 -1 Falling back to public interface 2024-09-14T11:07:52.938 INFO:tasks.ceph.osd.0.smithi138.stderr:2024-09-14T11:07:52.940+0000 7efc2f5377c0 -1 Falling back to public interface 2024-09-14T11:07:52.942 INFO:tasks.ceph.osd.2.smithi138.stderr:2024-09-14T11:07:52.944+0000 7f5523caf7c0 -1 Falling back to public interface 2024-09-14T11:07:53.108 INFO:tasks.ceph.osd.5.smithi154.stderr:2024-09-14T11:07:53.120+0000 7f0d083ae7c0 -1 Falling back to public interface 2024-09-14T11:07:53.203 INFO:tasks.ceph.osd.7.smithi154.stderr:2024-09-14T11:07:53.216+0000 7fb086ac57c0 -1 Falling back to public interface 2024-09-14T11:07:53.364 INFO:tasks.ceph.osd.6.smithi154.stderr:2024-09-14T11:07:53.376+0000 7fb58067b7c0 -1 Falling back to public interface 2024-09-14T11:07:53.400 INFO:tasks.ceph.osd.4.smithi154.stderr:2024-09-14T11:07:53.412+0000 7f13051f47c0 -1 Falling back to public interface 2024-09-14T11:07:55.668 INFO:tasks.ceph.mgr.y.smithi138.stderr:2024-09-14T11:07:55.668+0000 7f039a010640 -1 mgr.server handle_report got status from non-daemon mon.c 2024-09-14T11:07:55.669 INFO:tasks.ceph.mgr.y.smithi138.stderr:2024-09-14T11:07:55.668+0000 7f039a010640 -1 mgr.server handle_report got status from non-daemon mon.b 2024-09-14T11:07:57.091 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-14T11:07:57.092+0000 7f3e69d6c7c0 -1 osd.1 0 log_to_monitors true 2024-09-14T11:07:57.092 INFO:tasks.ceph.osd.3.smithi138.stderr:2024-09-14T11:07:57.092+0000 7f0d9653f7c0 -1 osd.3 0 log_to_monitors true 2024-09-14T11:07:57.217 INFO:tasks.ceph.osd.7.smithi154.stderr:2024-09-14T11:07:57.228+0000 7fb086ac57c0 -1 osd.7 0 log_to_monitors true 2024-09-14T11:07:57.231 INFO:tasks.ceph.osd.0.smithi138.stderr:2024-09-14T11:07:57.232+0000 7efc2f5377c0 -1 osd.0 0 log_to_monitors true 2024-09-14T11:07:57.305 INFO:tasks.ceph.osd.2.smithi138.stderr:2024-09-14T11:07:57.308+0000 7f5523caf7c0 -1 osd.2 0 log_to_monitors true 2024-09-14T11:07:57.433 INFO:tasks.ceph.osd.5.smithi154.stderr:2024-09-14T11:07:57.444+0000 7f0d083ae7c0 -1 osd.5 0 log_to_monitors true 2024-09-14T11:07:57.454 INFO:tasks.ceph.osd.4.smithi154.stderr:2024-09-14T11:07:57.464+0000 7f13051f47c0 -1 osd.4 0 log_to_monitors true 2024-09-14T11:07:57.659 INFO:tasks.ceph.osd.6.smithi154.stderr:2024-09-14T11:07:57.672+0000 7fb58067b7c0 -1 osd.6 0 log_to_monitors true 2024-09-14T11:07:59.527 DEBUG:teuthology.orchestra.run.smithi138:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-09-14T11:07:59.896 INFO:teuthology.misc.health.smithi138.stdout: 2024-09-14T11:07:59.896 INFO:teuthology.misc.health.smithi138.stdout:{"epoch":12,"fsid":"3f225f43-83a6-4aeb-b798-1f04bb49d597","created":"2024-09-14T11:07:49.131734+0000","modified":"2024-09-14T11:07:58.705670+0000","last_up_change":"0.000000","last_in_change":"2024-09-14T11:07:51.476209+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"947de938-c674-418d-972a-cff0472a9a26","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"7ac84832-0a45-44f5-81fb-e1b7242c6a8f","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"ef3e736d-f269-4fca-8ccf-f803d70c763f","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"5462705a-cf30-4d3f-88d7-f9ae0ed6e95a","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"22e8be21-7053-4e2f-9c88-a250c5e33e7a","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"2335b408-831d-400d-bf15-1942f44cfaef","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"54ab7858-af15-486f-9cfb-626e1541c86d","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"a28d625e-6b5e-4a31-a651-dc89943d6a84","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-14T11:07:59.919 DEBUG:teuthology.misc:0 of 8 OSDs are up 2024-09-14T11:08:00.786 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-14T11:08:00.788+0000 7f3e65d15640 -1 osd.1 0 waiting for initial osdmap 2024-09-14T11:08:00.801 INFO:tasks.ceph.osd.0.smithi138.stderr:2024-09-14T11:08:00.800+0000 7efc2b4e0640 -1 osd.0 0 waiting for initial osdmap 2024-09-14T11:08:00.818 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-14T11:08:00.820+0000 7f3e5db47640 -1 osd.1 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-14T11:08:00.838 INFO:tasks.ceph.osd.4.smithi154.stderr:2024-09-14T11:08:00.848+0000 7f13019af640 -1 osd.4 0 waiting for initial osdmap 2024-09-14T11:08:00.842 INFO:tasks.ceph.osd.0.smithi138.stderr:2024-09-14T11:08:00.844+0000 7efc23312640 -1 osd.0 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-14T11:08:00.844 INFO:tasks.ceph.osd.3.smithi138.stderr:2024-09-14T11:08:00.844+0000 7f0d924e8640 -1 osd.3 0 waiting for initial osdmap 2024-09-14T11:08:00.871 INFO:tasks.ceph.osd.4.smithi154.stderr:2024-09-14T11:08:00.884+0000 7f12f8fcf640 -1 osd.4 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-14T11:08:00.874 INFO:tasks.ceph.osd.3.smithi138.stderr:2024-09-14T11:08:00.876+0000 7f0d8a31a640 -1 osd.3 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-14T11:08:00.874 INFO:tasks.ceph.osd.2.smithi138.stderr:2024-09-14T11:08:00.876+0000 7f551fc58640 -1 osd.2 0 waiting for initial osdmap 2024-09-14T11:08:00.910 INFO:tasks.ceph.osd.2.smithi138.stderr:2024-09-14T11:08:00.912+0000 7f5517a8a640 -1 osd.2 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-14T11:08:00.975 INFO:tasks.ceph.osd.7.smithi154.stderr:2024-09-14T11:08:00.988+0000 7fb082a6e640 -1 osd.7 0 waiting for initial osdmap 2024-09-14T11:08:00.980 INFO:tasks.ceph.osd.5.smithi154.stderr:2024-09-14T11:08:00.992+0000 7f0d04b69640 -1 osd.5 0 waiting for initial osdmap 2024-09-14T11:08:01.003 INFO:tasks.ceph.osd.7.smithi154.stderr:2024-09-14T11:08:01.016+0000 7fb07a8a0640 -1 osd.7 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-14T11:08:01.011 INFO:tasks.ceph.osd.5.smithi154.stderr:2024-09-14T11:08:01.024+0000 7f0cfc189640 -1 osd.5 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-14T11:08:01.120 INFO:tasks.ceph.osd.6.smithi154.stderr:2024-09-14T11:08:01.132+0000 7fb57c624640 -1 osd.6 0 waiting for initial osdmap 2024-09-14T11:08:01.155 INFO:tasks.ceph.osd.6.smithi154.stderr:2024-09-14T11:08:01.168+0000 7fb574456640 -1 osd.6 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-14T11:08:06.725 DEBUG:teuthology.orchestra.run.smithi138:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-09-14T11:08:07.032 INFO:teuthology.misc.health.smithi138.stdout: 2024-09-14T11:08:07.032 INFO:teuthology.misc.health.smithi138.stdout:{"epoch":16,"fsid":"3f225f43-83a6-4aeb-b798-1f04bb49d597","created":"2024-09-14T11:07:49.131734+0000","modified":"2024-09-14T11:08:04.853808+0000","last_up_change":"2024-09-14T11:08:01.813597+0000","last_in_change":"2024-09-14T11:07:51.476209+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-14T11:08:02.694350+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"947de938-c674-418d-972a-cff0472a9a26","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6816","nonce":326481658},{"type":"v1","addr":"172.21.15.138:6817","nonce":326481658}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6818","nonce":326481658},{"type":"v1","addr":"172.21.15.138:6819","nonce":326481658}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6822","nonce":326481658},{"type":"v1","addr":"172.21.15.138:6823","nonce":326481658}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6820","nonce":326481658},{"type":"v1","addr":"172.21.15.138:6821","nonce":326481658}]},"public_addr":"172.21.15.138:6817/326481658","cluster_addr":"172.21.15.138:6819/326481658","heartbeat_back_addr":"172.21.15.138:6823/326481658","heartbeat_front_addr":"172.21.15.138:6821/326481658","state":["exists","up"]},{"osd":1,"uuid":"7ac84832-0a45-44f5-81fb-e1b7242c6a8f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6800","nonce":1799335858},{"type":"v1","addr":"172.21.15.138:6801","nonce":1799335858}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6802","nonce":1799335858},{"type":"v1","addr":"172.21.15.138:6803","nonce":1799335858}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6806","nonce":1799335858},{"type":"v1","addr":"172.21.15.138:6807","nonce":1799335858}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6804","nonce":1799335858},{"type":"v1","addr":"172.21.15.138:6805","nonce":1799335858}]},"public_addr":"172.21.15.138:6801/1799335858","cluster_addr":"172.21.15.138:6803/1799335858","heartbeat_back_addr":"172.21.15.138:6807/1799335858","heartbeat_front_addr":"172.21.15.138:6805/1799335858","state":["exists","up"]},{"osd":2,"uuid":"ef3e736d-f269-4fca-8ccf-f803d70c763f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6824","nonce":2633984942},{"type":"v1","addr":"172.21.15.138:6825","nonce":2633984942}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6826","nonce":2633984942},{"type":"v1","addr":"172.21.15.138:6827","nonce":2633984942}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6830","nonce":2633984942},{"type":"v1","addr":"172.21.15.138:6831","nonce":2633984942}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6828","nonce":2633984942},{"type":"v1","addr":"172.21.15.138:6829","nonce":2633984942}]},"public_addr":"172.21.15.138:6825/2633984942","cluster_addr":"172.21.15.138:6827/2633984942","heartbeat_back_addr":"172.21.15.138:6831/2633984942","heartbeat_front_addr":"172.21.15.138:6829/2633984942","state":["exists","up"]},{"osd":3,"uuid":"5462705a-cf30-4d3f-88d7-f9ae0ed6e95a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6808","nonce":3258321916},{"type":"v1","addr":"172.21.15.138:6809","nonce":3258321916}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6810","nonce":3258321916},{"type":"v1","addr":"172.21.15.138:6811","nonce":3258321916}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6814","nonce":3258321916},{"type":"v1","addr":"172.21.15.138:6815","nonce":3258321916}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6812","nonce":3258321916},{"type":"v1","addr":"172.21.15.138:6813","nonce":3258321916}]},"public_addr":"172.21.15.138:6809/3258321916","cluster_addr":"172.21.15.138:6811/3258321916","heartbeat_back_addr":"172.21.15.138:6815/3258321916","heartbeat_front_addr":"172.21.15.138:6813/3258321916","state":["exists","up"]},{"osd":4,"uuid":"22e8be21-7053-4e2f-9c88-a250c5e33e7a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6824","nonce":416768175},{"type":"v1","addr":"172.21.15.154:6825","nonce":416768175}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6826","nonce":416768175},{"type":"v1","addr":"172.21.15.154:6827","nonce":416768175}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6830","nonce":416768175},{"type":"v1","addr":"172.21.15.154:6831","nonce":416768175}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6828","nonce":416768175},{"type":"v1","addr":"172.21.15.154:6829","nonce":416768175}]},"public_addr":"172.21.15.154:6825/416768175","cluster_addr":"172.21.15.154:6827/416768175","heartbeat_back_addr":"172.21.15.154:6831/416768175","heartbeat_front_addr":"172.21.15.154:6829/416768175","state":["exists","up"]},{"osd":5,"uuid":"2335b408-831d-400d-bf15-1942f44cfaef","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6800","nonce":3926081546},{"type":"v1","addr":"172.21.15.154:6801","nonce":3926081546}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6802","nonce":3926081546},{"type":"v1","addr":"172.21.15.154:6803","nonce":3926081546}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6806","nonce":3926081546},{"type":"v1","addr":"172.21.15.154:6807","nonce":3926081546}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6804","nonce":3926081546},{"type":"v1","addr":"172.21.15.154:6805","nonce":3926081546}]},"public_addr":"172.21.15.154:6801/3926081546","cluster_addr":"172.21.15.154:6803/3926081546","heartbeat_back_addr":"172.21.15.154:6807/3926081546","heartbeat_front_addr":"172.21.15.154:6805/3926081546","state":["exists","up"]},{"osd":6,"uuid":"54ab7858-af15-486f-9cfb-626e1541c86d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6816","nonce":1950550278},{"type":"v1","addr":"172.21.15.154:6817","nonce":1950550278}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6818","nonce":1950550278},{"type":"v1","addr":"172.21.15.154:6819","nonce":1950550278}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6822","nonce":1950550278},{"type":"v1","addr":"172.21.15.154:6823","nonce":1950550278}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6820","nonce":1950550278},{"type":"v1","addr":"172.21.15.154:6821","nonce":1950550278}]},"public_addr":"172.21.15.154:6817/1950550278","cluster_addr":"172.21.15.154:6819/1950550278","heartbeat_back_addr":"172.21.15.154:6823/1950550278","heartbeat_front_addr":"172.21.15.154:6821/1950550278","state":["exists","up"]},{"osd":7,"uuid":"a28d625e-6b5e-4a31-a651-dc89943d6a84","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6808","nonce":1468088432},{"type":"v1","addr":"172.21.15.154:6809","nonce":1468088432}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6810","nonce":1468088432},{"type":"v1","addr":"172.21.15.154:6811","nonce":1468088432}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6814","nonce":1468088432},{"type":"v1","addr":"172.21.15.154:6815","nonce":1468088432}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6812","nonce":1468088432},{"type":"v1","addr":"172.21.15.154:6813","nonce":1468088432}]},"public_addr":"172.21.15.154:6809/1468088432","cluster_addr":"172.21.15.154:6811/1468088432","heartbeat_back_addr":"172.21.15.154:6815/1468088432","heartbeat_front_addr":"172.21.15.154:6813/1468088432","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-14T11:07:58.266821+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-14T11:07:58.079344+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-14T11:07:58.300648+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-14T11:07:58.103923+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-14T11:07:58.446255+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-14T11:07:58.417224+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-14T11:07:58.686449+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-14T11:07:58.283669+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-14T11:08:07.050 DEBUG:teuthology.misc:8 of 8 OSDs are up 2024-09-14T11:08:07.051 INFO:tasks.ceph:Creating RBD pool 2024-09-14T11:08:07.051 DEBUG:teuthology.orchestra.run.smithi138:> sudo ceph --cluster ceph osd pool create rbd 8 2024-09-14T11:08:07.876 INFO:teuthology.orchestra.run.smithi138.stderr:pool 'rbd' created 2024-09-14T11:08:07.905 DEBUG:teuthology.orchestra.run.smithi138:> rbd --cluster ceph pool init rbd 2024-09-14T11:08:07.957 INFO:teuthology.orchestra.run.smithi138.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:08:07.957 INFO:teuthology.orchestra.run.smithi138.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:08:10.934 INFO:tasks.ceph:Starting mds daemons in cluster ceph... 2024-09-14T11:08:10.935 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config log 1 --format=json 2024-09-14T11:08:10.936 INFO:tasks.daemonwatchdog.daemon_watchdog:watchdog starting 2024-09-14T11:08:11.253 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-09-14T11:08:11.272 INFO:teuthology.orchestra.run.smithi138.stdout:[{"version":9,"timestamp":"2024-09-14T11:08:01.125113+0000","name":"","changes":[{"name":"osd.6/osd_mclock_max_capacity_iops_ssd","new_value":"3377.557408"}]}] 2024-09-14T11:08:11.272 INFO:tasks.ceph_manager:config epoch is 9 2024-09-14T11:08:11.272 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2024-09-14T11:08:11.272 INFO:tasks.ceph.ceph_manager.ceph:waiting for mgr available 2024-09-14T11:08:11.273 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr dump --format=json 2024-09-14T11:08:11.632 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-09-14T11:08:11.650 INFO:teuthology.orchestra.run.smithi138.stdout:{"epoch":5,"flags":0,"active_gid":4106,"active_name":"y","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6832","nonce":3778043143},{"type":"v1","addr":"172.21.15.138:6833","nonce":3778043143}]},"active_addr":"172.21.15.138:6833/3778043143","active_change":"2024-09-14T11:07:54.644540+0000","active_mgr_features":4540719139924082687,"available":true,"standbys":[{"gid":4123,"name":"x","mgr_features":4540719139924082687,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to, use commas to separate multiple","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.27.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:10.4.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_nginx":{"name":"container_image_nginx","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nginx:sclorg-nginx-126","min":"","max":"","enum_allowed":[],"desc":"Nginx container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.7.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.2.17","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_oauth2_proxy":{"name":"container_image_oauth2_proxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/oauth2-proxy/oauth2-proxy:v7.6.0","min":"","max":"","enum_allowed":[],"desc":"oauth2-proxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.51.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba_metrics":{"name":"container_image_samba_metrics","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-metrics:latest","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB metrics exporter container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"ssh_keepalive_count_max":{"name":"ssh_keepalive_count_max","type":"int","level":"advanced","flags":0,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"How many times ssh connections can fail liveness checks before the host is marked offline","long_desc":"","tags":[],"see_also":[]},"ssh_keepalive_interval":{"name":"ssh_keepalive_interval","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"How often ssh connections are checked for liveness","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MANAGED_BY_CLUSTERS":{"name":"MANAGED_BY_CLUSTERS","type":"str","level":"advanced","flags":0,"default_value":"[]","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MULTICLUSTER_CONFIG":{"name":"MULTICLUSTER_CONFIG","type":"str","level":"advanced","flags":0,"default_value":"{}","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_requests":{"name":"max_requests","type":"int","level":"advanced","flags":0,"default_value":"500","min":"","max":"","enum_allowed":[],"desc":"Maximum number of requests to keep in memory. When new request comes in, the oldest request will be removed if the number of requests exceeds the max request number.if un-finished request is removed, error message will be logged in the ceph-mgr log.","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"secondary_zone_period_retry_limit":{"name":"secondary_zone_period_retry_limit","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"RGW module period update retry limit for secondary site","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]}],"modules":["iostat","nfs","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to, use commas to separate multiple","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.27.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:10.4.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_nginx":{"name":"container_image_nginx","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nginx:sclorg-nginx-126","min":"","max":"","enum_allowed":[],"desc":"Nginx container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.7.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.2.17","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_oauth2_proxy":{"name":"container_image_oauth2_proxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/oauth2-proxy/oauth2-proxy:v7.6.0","min":"","max":"","enum_allowed":[],"desc":"oauth2-proxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.51.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba_metrics":{"name":"container_image_samba_metrics","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-metrics:latest","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB metrics exporter container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"ssh_keepalive_count_max":{"name":"ssh_keepalive_count_max","type":"int","level":"advanced","flags":0,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"How many times ssh connections can fail liveness checks before the host is marked offline","long_desc":"","tags":[],"see_also":[]},"ssh_keepalive_interval":{"name":"ssh_keepalive_interval","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"How often ssh connections are checked for liveness","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MANAGED_BY_CLUSTERS":{"name":"MANAGED_BY_CLUSTERS","type":"str","level":"advanced","flags":0,"default_value":"[]","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MULTICLUSTER_CONFIG":{"name":"MULTICLUSTER_CONFIG","type":"str","level":"advanced","flags":0,"default_value":"{}","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_requests":{"name":"max_requests","type":"int","level":"advanced","flags":0,"default_value":"500","min":"","max":"","enum_allowed":[],"desc":"Maximum number of requests to keep in memory. When new request comes in, the oldest request will be removed if the number of requests exceeds the max request number.if un-finished request is removed, error message will be logged in the ceph-mgr log.","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"secondary_zone_period_retry_limit":{"name":"secondary_zone_period_retry_limit","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"RGW module period update retry limit for secondary site","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"reef":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"squid":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"last_failure_osd_epoch":0,"active_clients":[{"name":"devicehealth","addrvec":[{"type":"v2","addr":"172.21.15.138:0","nonce":872125961}]},{"name":"libcephsqlite","addrvec":[{"type":"v2","addr":"172.21.15.138:0","nonce":1348328420}]},{"name":"rbd_support","addrvec":[{"type":"v2","addr":"172.21.15.138:0","nonce":3813086976}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.138:0","nonce":3978016897}]}]} 2024-09-14T11:08:11.655 INFO:tasks.ceph.ceph_manager.ceph:mgr available! 2024-09-14T11:08:11.655 INFO:tasks.ceph.ceph_manager.ceph:waiting for all up 2024-09-14T11:08:11.655 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-14T11:08:11.948 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-09-14T11:08:11.948 INFO:teuthology.orchestra.run.smithi138.stdout:{"epoch":20,"fsid":"3f225f43-83a6-4aeb-b798-1f04bb49d597","created":"2024-09-14T11:07:49.131734+0000","modified":"2024-09-14T11:08:10.897257+0000","last_up_change":"2024-09-14T11:08:01.813597+0000","last_in_change":"2024-09-14T11:07:51.476209+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":2,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-14T11:08:02.694350+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2024-09-14T11:08:07.362288+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":2,"snap_epoch":20,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"947de938-c674-418d-972a-cff0472a9a26","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6816","nonce":326481658},{"type":"v1","addr":"172.21.15.138:6817","nonce":326481658}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6818","nonce":326481658},{"type":"v1","addr":"172.21.15.138:6819","nonce":326481658}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6822","nonce":326481658},{"type":"v1","addr":"172.21.15.138:6823","nonce":326481658}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6820","nonce":326481658},{"type":"v1","addr":"172.21.15.138:6821","nonce":326481658}]},"public_addr":"172.21.15.138:6817/326481658","cluster_addr":"172.21.15.138:6819/326481658","heartbeat_back_addr":"172.21.15.138:6823/326481658","heartbeat_front_addr":"172.21.15.138:6821/326481658","state":["exists","up"]},{"osd":1,"uuid":"7ac84832-0a45-44f5-81fb-e1b7242c6a8f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6800","nonce":1799335858},{"type":"v1","addr":"172.21.15.138:6801","nonce":1799335858}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6802","nonce":1799335858},{"type":"v1","addr":"172.21.15.138:6803","nonce":1799335858}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6806","nonce":1799335858},{"type":"v1","addr":"172.21.15.138:6807","nonce":1799335858}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6804","nonce":1799335858},{"type":"v1","addr":"172.21.15.138:6805","nonce":1799335858}]},"public_addr":"172.21.15.138:6801/1799335858","cluster_addr":"172.21.15.138:6803/1799335858","heartbeat_back_addr":"172.21.15.138:6807/1799335858","heartbeat_front_addr":"172.21.15.138:6805/1799335858","state":["exists","up"]},{"osd":2,"uuid":"ef3e736d-f269-4fca-8ccf-f803d70c763f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6824","nonce":2633984942},{"type":"v1","addr":"172.21.15.138:6825","nonce":2633984942}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6826","nonce":2633984942},{"type":"v1","addr":"172.21.15.138:6827","nonce":2633984942}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6830","nonce":2633984942},{"type":"v1","addr":"172.21.15.138:6831","nonce":2633984942}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6828","nonce":2633984942},{"type":"v1","addr":"172.21.15.138:6829","nonce":2633984942}]},"public_addr":"172.21.15.138:6825/2633984942","cluster_addr":"172.21.15.138:6827/2633984942","heartbeat_back_addr":"172.21.15.138:6831/2633984942","heartbeat_front_addr":"172.21.15.138:6829/2633984942","state":["exists","up"]},{"osd":3,"uuid":"5462705a-cf30-4d3f-88d7-f9ae0ed6e95a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6808","nonce":3258321916},{"type":"v1","addr":"172.21.15.138:6809","nonce":3258321916}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6810","nonce":3258321916},{"type":"v1","addr":"172.21.15.138:6811","nonce":3258321916}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6814","nonce":3258321916},{"type":"v1","addr":"172.21.15.138:6815","nonce":3258321916}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6812","nonce":3258321916},{"type":"v1","addr":"172.21.15.138:6813","nonce":3258321916}]},"public_addr":"172.21.15.138:6809/3258321916","cluster_addr":"172.21.15.138:6811/3258321916","heartbeat_back_addr":"172.21.15.138:6815/3258321916","heartbeat_front_addr":"172.21.15.138:6813/3258321916","state":["exists","up"]},{"osd":4,"uuid":"22e8be21-7053-4e2f-9c88-a250c5e33e7a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6824","nonce":416768175},{"type":"v1","addr":"172.21.15.154:6825","nonce":416768175}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6826","nonce":416768175},{"type":"v1","addr":"172.21.15.154:6827","nonce":416768175}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6830","nonce":416768175},{"type":"v1","addr":"172.21.15.154:6831","nonce":416768175}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6828","nonce":416768175},{"type":"v1","addr":"172.21.15.154:6829","nonce":416768175}]},"public_addr":"172.21.15.154:6825/416768175","cluster_addr":"172.21.15.154:6827/416768175","heartbeat_back_addr":"172.21.15.154:6831/416768175","heartbeat_front_addr":"172.21.15.154:6829/416768175","state":["exists","up"]},{"osd":5,"uuid":"2335b408-831d-400d-bf15-1942f44cfaef","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6800","nonce":3926081546},{"type":"v1","addr":"172.21.15.154:6801","nonce":3926081546}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6802","nonce":3926081546},{"type":"v1","addr":"172.21.15.154:6803","nonce":3926081546}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6806","nonce":3926081546},{"type":"v1","addr":"172.21.15.154:6807","nonce":3926081546}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6804","nonce":3926081546},{"type":"v1","addr":"172.21.15.154:6805","nonce":3926081546}]},"public_addr":"172.21.15.154:6801/3926081546","cluster_addr":"172.21.15.154:6803/3926081546","heartbeat_back_addr":"172.21.15.154:6807/3926081546","heartbeat_front_addr":"172.21.15.154:6805/3926081546","state":["exists","up"]},{"osd":6,"uuid":"54ab7858-af15-486f-9cfb-626e1541c86d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6816","nonce":1950550278},{"type":"v1","addr":"172.21.15.154:6817","nonce":1950550278}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6818","nonce":1950550278},{"type":"v1","addr":"172.21.15.154:6819","nonce":1950550278}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6822","nonce":1950550278},{"type":"v1","addr":"172.21.15.154:6823","nonce":1950550278}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6820","nonce":1950550278},{"type":"v1","addr":"172.21.15.154:6821","nonce":1950550278}]},"public_addr":"172.21.15.154:6817/1950550278","cluster_addr":"172.21.15.154:6819/1950550278","heartbeat_back_addr":"172.21.15.154:6823/1950550278","heartbeat_front_addr":"172.21.15.154:6821/1950550278","state":["exists","up"]},{"osd":7,"uuid":"a28d625e-6b5e-4a31-a651-dc89943d6a84","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6808","nonce":1468088432},{"type":"v1","addr":"172.21.15.154:6809","nonce":1468088432}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6810","nonce":1468088432},{"type":"v1","addr":"172.21.15.154:6811","nonce":1468088432}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6814","nonce":1468088432},{"type":"v1","addr":"172.21.15.154:6815","nonce":1468088432}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6812","nonce":1468088432},{"type":"v1","addr":"172.21.15.154:6813","nonce":1468088432}]},"public_addr":"172.21.15.154:6809/1468088432","cluster_addr":"172.21.15.154:6811/1468088432","heartbeat_back_addr":"172.21.15.154:6815/1468088432","heartbeat_front_addr":"172.21.15.154:6813/1468088432","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-14T11:07:58.266821+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-14T11:07:58.079344+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-14T11:07:58.300648+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-14T11:07:58.103923+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-14T11:07:58.446255+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-14T11:07:58.417224+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-14T11:07:58.686449+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-14T11:07:58.283669+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":2,"snaps":[{"begin":2,"length":1}]}],"new_removed_snaps":[{"pool":2,"snaps":[{"begin":2,"length":1}]}],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-14T11:08:11.966 INFO:tasks.ceph.ceph_manager.ceph:all up! 2024-09-14T11:08:11.966 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-14T11:08:12.245 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-09-14T11:08:12.245 INFO:teuthology.orchestra.run.smithi138.stdout:{"epoch":20,"fsid":"3f225f43-83a6-4aeb-b798-1f04bb49d597","created":"2024-09-14T11:07:49.131734+0000","modified":"2024-09-14T11:08:10.897257+0000","last_up_change":"2024-09-14T11:08:01.813597+0000","last_in_change":"2024-09-14T11:07:51.476209+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":2,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-14T11:08:02.694350+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2024-09-14T11:08:07.362288+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":2,"snap_epoch":20,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"947de938-c674-418d-972a-cff0472a9a26","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6816","nonce":326481658},{"type":"v1","addr":"172.21.15.138:6817","nonce":326481658}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6818","nonce":326481658},{"type":"v1","addr":"172.21.15.138:6819","nonce":326481658}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6822","nonce":326481658},{"type":"v1","addr":"172.21.15.138:6823","nonce":326481658}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6820","nonce":326481658},{"type":"v1","addr":"172.21.15.138:6821","nonce":326481658}]},"public_addr":"172.21.15.138:6817/326481658","cluster_addr":"172.21.15.138:6819/326481658","heartbeat_back_addr":"172.21.15.138:6823/326481658","heartbeat_front_addr":"172.21.15.138:6821/326481658","state":["exists","up"]},{"osd":1,"uuid":"7ac84832-0a45-44f5-81fb-e1b7242c6a8f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6800","nonce":1799335858},{"type":"v1","addr":"172.21.15.138:6801","nonce":1799335858}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6802","nonce":1799335858},{"type":"v1","addr":"172.21.15.138:6803","nonce":1799335858}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6806","nonce":1799335858},{"type":"v1","addr":"172.21.15.138:6807","nonce":1799335858}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6804","nonce":1799335858},{"type":"v1","addr":"172.21.15.138:6805","nonce":1799335858}]},"public_addr":"172.21.15.138:6801/1799335858","cluster_addr":"172.21.15.138:6803/1799335858","heartbeat_back_addr":"172.21.15.138:6807/1799335858","heartbeat_front_addr":"172.21.15.138:6805/1799335858","state":["exists","up"]},{"osd":2,"uuid":"ef3e736d-f269-4fca-8ccf-f803d70c763f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6824","nonce":2633984942},{"type":"v1","addr":"172.21.15.138:6825","nonce":2633984942}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6826","nonce":2633984942},{"type":"v1","addr":"172.21.15.138:6827","nonce":2633984942}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6830","nonce":2633984942},{"type":"v1","addr":"172.21.15.138:6831","nonce":2633984942}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6828","nonce":2633984942},{"type":"v1","addr":"172.21.15.138:6829","nonce":2633984942}]},"public_addr":"172.21.15.138:6825/2633984942","cluster_addr":"172.21.15.138:6827/2633984942","heartbeat_back_addr":"172.21.15.138:6831/2633984942","heartbeat_front_addr":"172.21.15.138:6829/2633984942","state":["exists","up"]},{"osd":3,"uuid":"5462705a-cf30-4d3f-88d7-f9ae0ed6e95a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6808","nonce":3258321916},{"type":"v1","addr":"172.21.15.138:6809","nonce":3258321916}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6810","nonce":3258321916},{"type":"v1","addr":"172.21.15.138:6811","nonce":3258321916}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6814","nonce":3258321916},{"type":"v1","addr":"172.21.15.138:6815","nonce":3258321916}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6812","nonce":3258321916},{"type":"v1","addr":"172.21.15.138:6813","nonce":3258321916}]},"public_addr":"172.21.15.138:6809/3258321916","cluster_addr":"172.21.15.138:6811/3258321916","heartbeat_back_addr":"172.21.15.138:6815/3258321916","heartbeat_front_addr":"172.21.15.138:6813/3258321916","state":["exists","up"]},{"osd":4,"uuid":"22e8be21-7053-4e2f-9c88-a250c5e33e7a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6824","nonce":416768175},{"type":"v1","addr":"172.21.15.154:6825","nonce":416768175}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6826","nonce":416768175},{"type":"v1","addr":"172.21.15.154:6827","nonce":416768175}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6830","nonce":416768175},{"type":"v1","addr":"172.21.15.154:6831","nonce":416768175}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6828","nonce":416768175},{"type":"v1","addr":"172.21.15.154:6829","nonce":416768175}]},"public_addr":"172.21.15.154:6825/416768175","cluster_addr":"172.21.15.154:6827/416768175","heartbeat_back_addr":"172.21.15.154:6831/416768175","heartbeat_front_addr":"172.21.15.154:6829/416768175","state":["exists","up"]},{"osd":5,"uuid":"2335b408-831d-400d-bf15-1942f44cfaef","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6800","nonce":3926081546},{"type":"v1","addr":"172.21.15.154:6801","nonce":3926081546}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6802","nonce":3926081546},{"type":"v1","addr":"172.21.15.154:6803","nonce":3926081546}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6806","nonce":3926081546},{"type":"v1","addr":"172.21.15.154:6807","nonce":3926081546}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6804","nonce":3926081546},{"type":"v1","addr":"172.21.15.154:6805","nonce":3926081546}]},"public_addr":"172.21.15.154:6801/3926081546","cluster_addr":"172.21.15.154:6803/3926081546","heartbeat_back_addr":"172.21.15.154:6807/3926081546","heartbeat_front_addr":"172.21.15.154:6805/3926081546","state":["exists","up"]},{"osd":6,"uuid":"54ab7858-af15-486f-9cfb-626e1541c86d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6816","nonce":1950550278},{"type":"v1","addr":"172.21.15.154:6817","nonce":1950550278}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6818","nonce":1950550278},{"type":"v1","addr":"172.21.15.154:6819","nonce":1950550278}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6822","nonce":1950550278},{"type":"v1","addr":"172.21.15.154:6823","nonce":1950550278}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6820","nonce":1950550278},{"type":"v1","addr":"172.21.15.154:6821","nonce":1950550278}]},"public_addr":"172.21.15.154:6817/1950550278","cluster_addr":"172.21.15.154:6819/1950550278","heartbeat_back_addr":"172.21.15.154:6823/1950550278","heartbeat_front_addr":"172.21.15.154:6821/1950550278","state":["exists","up"]},{"osd":7,"uuid":"a28d625e-6b5e-4a31-a651-dc89943d6a84","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6808","nonce":1468088432},{"type":"v1","addr":"172.21.15.154:6809","nonce":1468088432}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6810","nonce":1468088432},{"type":"v1","addr":"172.21.15.154:6811","nonce":1468088432}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6814","nonce":1468088432},{"type":"v1","addr":"172.21.15.154:6815","nonce":1468088432}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6812","nonce":1468088432},{"type":"v1","addr":"172.21.15.154:6813","nonce":1468088432}]},"public_addr":"172.21.15.154:6809/1468088432","cluster_addr":"172.21.15.154:6811/1468088432","heartbeat_back_addr":"172.21.15.154:6815/1468088432","heartbeat_front_addr":"172.21.15.154:6813/1468088432","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-14T11:07:58.266821+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-14T11:07:58.079344+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-14T11:07:58.300648+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-14T11:07:58.103923+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-14T11:07:58.446255+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-14T11:07:58.417224+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-14T11:07:58.686449+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-14T11:07:58.283669+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":2,"snaps":[{"begin":2,"length":1}]}],"new_removed_snaps":[{"pool":2,"snaps":[{"begin":2,"length":1}]}],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-14T11:08:12.263 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 flush_pg_stats 2024-09-14T11:08:12.264 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 flush_pg_stats 2024-09-14T11:08:12.264 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 flush_pg_stats 2024-09-14T11:08:12.264 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 flush_pg_stats 2024-09-14T11:08:12.265 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 flush_pg_stats 2024-09-14T11:08:12.265 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 flush_pg_stats 2024-09-14T11:08:12.265 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 flush_pg_stats 2024-09-14T11:08:12.266 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 flush_pg_stats 2024-09-14T11:08:12.524 INFO:teuthology.orchestra.run.smithi138.stdout:55834574854 2024-09-14T11:08:12.525 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-09-14T11:08:12.532 INFO:teuthology.orchestra.run.smithi138.stdout:55834574853 2024-09-14T11:08:12.532 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2024-09-14T11:08:12.533 INFO:teuthology.orchestra.run.smithi138.stdout:55834574854 2024-09-14T11:08:12.533 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-09-14T11:08:12.540 INFO:teuthology.orchestra.run.smithi138.stdout:55834574851 2024-09-14T11:08:12.541 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2024-09-14T11:08:12.543 INFO:teuthology.orchestra.run.smithi138.stdout:55834574852 2024-09-14T11:08:12.543 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2024-09-14T11:08:12.545 INFO:teuthology.orchestra.run.smithi138.stdout:55834574853 2024-09-14T11:08:12.545 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2024-09-14T11:08:12.546 INFO:teuthology.orchestra.run.smithi138.stdout:55834574852 2024-09-14T11:08:12.547 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-09-14T11:08:12.547 INFO:teuthology.orchestra.run.smithi138.stdout:55834574852 2024-09-14T11:08:12.548 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2024-09-14T11:08:13.053 INFO:teuthology.orchestra.run.smithi138.stdout:55834574853 2024-09-14T11:08:13.064 INFO:teuthology.orchestra.run.smithi138.stdout:55834574854 2024-09-14T11:08:13.074 INFO:teuthology.orchestra.run.smithi138.stdout:55834574851 2024-09-14T11:08:13.075 INFO:teuthology.orchestra.run.smithi138.stdout:55834574854 2024-09-14T11:08:13.085 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574853 got 55834574853 for osd.6 2024-09-14T11:08:13.085 DEBUG:teuthology.parallel:result is None 2024-09-14T11:08:13.090 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574854 for osd.2 2024-09-14T11:08:13.090 DEBUG:teuthology.parallel:result is None 2024-09-14T11:08:13.102 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574854 for osd.1 2024-09-14T11:08:13.102 DEBUG:teuthology.parallel:result is None 2024-09-14T11:08:13.106 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574851 got 55834574851 for osd.7 2024-09-14T11:08:13.106 DEBUG:teuthology.parallel:result is None 2024-09-14T11:08:13.112 INFO:teuthology.orchestra.run.smithi138.stdout:55834574852 2024-09-14T11:08:13.114 INFO:teuthology.orchestra.run.smithi138.stdout:55834574853 2024-09-14T11:08:13.119 INFO:teuthology.orchestra.run.smithi138.stdout:55834574852 2024-09-14T11:08:13.136 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574852 got 55834574852 for osd.4 2024-09-14T11:08:13.136 DEBUG:teuthology.parallel:result is None 2024-09-14T11:08:13.137 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574853 got 55834574853 for osd.3 2024-09-14T11:08:13.137 DEBUG:teuthology.parallel:result is None 2024-09-14T11:08:13.141 INFO:teuthology.orchestra.run.smithi138.stdout:55834574852 2024-09-14T11:08:13.142 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574852 got 55834574852 for osd.5 2024-09-14T11:08:13.142 DEBUG:teuthology.parallel:result is None 2024-09-14T11:08:13.157 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574852 got 55834574852 for osd.0 2024-09-14T11:08:13.158 DEBUG:teuthology.parallel:result is None 2024-09-14T11:08:13.158 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-09-14T11:08:13.158 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-14T11:08:13.469 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-09-14T11:08:13.469 INFO:teuthology.orchestra.run.smithi138.stderr:dumped all 2024-09-14T11:08:13.486 INFO:teuthology.orchestra.run.smithi138.stdout:{"pg_ready":true,"pg_map":{"version":18,"stamp":"2024-09-14T11:08:12.658443+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590387,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":103,"num_write_kb":1630,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":75,"ondisk_log_size":75,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":16,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":7,"kb":754974720,"kb_used":219048,"kb_used_data":2768,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754755672,"statfs":{"total":773094113280,"available":772869808128,"internally_reserved":0,"allocated":2834432,"data_stored":1731942,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":221236784},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":9,"apply_latency_ms":9,"commit_latency_ns":9000000,"apply_latency_ns":9000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.784030"},"pg_stats":[{"pgid":"2.7","version":"0'0","reported_seq":20,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-14T11:08:11.214692+0000","last_change":"2024-09-14T11:08:11.214692+0000","last_active":"2024-09-14T11:08:11.214692+0000","last_peered":"2024-09-14T11:08:11.214692+0000","last_clean":"2024-09-14T11:08:11.214692+0000","last_became_active":"2024-09-14T11:08:08.905736+0000","last_became_peered":"2024-09-14T11:08:08.905736+0000","last_unstale":"2024-09-14T11:08:11.214692+0000","last_undegraded":"2024-09-14T11:08:11.214692+0000","last_fullsized":"2024-09-14T11:08:11.214692+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:08:07.870014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:08:07.870014+0000","last_clean_scrub_stamp":"2024-09-14T11:08:07.870014+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:16:43.551707+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0012835290000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.6","version":"0'0","reported_seq":20,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-14T11:08:10.911600+0000","last_change":"2024-09-14T11:08:10.911600+0000","last_active":"2024-09-14T11:08:10.911600+0000","last_peered":"2024-09-14T11:08:10.911600+0000","last_clean":"2024-09-14T11:08:10.911600+0000","last_became_active":"2024-09-14T11:08:08.891458+0000","last_became_peered":"2024-09-14T11:08:08.891458+0000","last_unstale":"2024-09-14T11:08:10.911600+0000","last_undegraded":"2024-09-14T11:08:10.911600+0000","last_fullsized":"2024-09-14T11:08:10.911600+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:08:07.870014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:08:07.870014+0000","last_clean_scrub_stamp":"2024-09-14T11:08:07.870014+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:05:05.170921+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0011468940000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.5","version":"0'0","reported_seq":20,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-14T11:08:11.214796+0000","last_change":"2024-09-14T11:08:11.214796+0000","last_active":"2024-09-14T11:08:11.214796+0000","last_peered":"2024-09-14T11:08:11.214796+0000","last_clean":"2024-09-14T11:08:11.214796+0000","last_became_active":"2024-09-14T11:08:08.903905+0000","last_became_peered":"2024-09-14T11:08:08.903905+0000","last_unstale":"2024-09-14T11:08:11.214796+0000","last_undegraded":"2024-09-14T11:08:11.214796+0000","last_fullsized":"2024-09-14T11:08:11.214796+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:08:07.870014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:08:07.870014+0000","last_clean_scrub_stamp":"2024-09-14T11:08:07.870014+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:58:06.786050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001173377,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.4","version":"0'0","reported_seq":20,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-14T11:08:10.911600+0000","last_change":"2024-09-14T11:08:10.911600+0000","last_active":"2024-09-14T11:08:10.911600+0000","last_peered":"2024-09-14T11:08:10.911600+0000","last_clean":"2024-09-14T11:08:10.911600+0000","last_became_active":"2024-09-14T11:08:08.888921+0000","last_became_peered":"2024-09-14T11:08:08.888921+0000","last_unstale":"2024-09-14T11:08:10.911600+0000","last_undegraded":"2024-09-14T11:08:10.911600+0000","last_fullsized":"2024-09-14T11:08:10.911600+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:08:07.870014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:08:07.870014+0000","last_clean_scrub_stamp":"2024-09-14T11:08:07.870014+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:29:02.760571+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001198714,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.2","version":"20'2","reported_seq":22,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-14T11:08:10.935213+0000","last_change":"2024-09-14T11:08:10.933870+0000","last_active":"2024-09-14T11:08:10.935213+0000","last_peered":"2024-09-14T11:08:10.935213+0000","last_clean":"2024-09-14T11:08:10.935213+0000","last_became_active":"2024-09-14T11:08:08.903062+0000","last_became_peered":"2024-09-14T11:08:08.903062+0000","last_unstale":"2024-09-14T11:08:10.935213+0000","last_undegraded":"2024-09-14T11:08:10.935213+0000","last_fullsized":"2024-09-14T11:08:10.935213+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:08:07.870014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:08:07.870014+0000","last_clean_scrub_stamp":"2024-09-14T11:08:07.870014+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:50:59.568798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0022728420000000002,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.1","version":"0'0","reported_seq":20,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-14T11:08:10.911966+0000","last_change":"2024-09-14T11:08:10.911966+0000","last_active":"2024-09-14T11:08:10.911966+0000","last_peered":"2024-09-14T11:08:10.911966+0000","last_clean":"2024-09-14T11:08:10.911966+0000","last_became_active":"2024-09-14T11:08:08.957848+0000","last_became_peered":"2024-09-14T11:08:08.957848+0000","last_unstale":"2024-09-14T11:08:10.911966+0000","last_undegraded":"2024-09-14T11:08:10.911966+0000","last_fullsized":"2024-09-14T11:08:10.911966+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:08:07.870014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:08:07.870014+0000","last_clean_scrub_stamp":"2024-09-14T11:08:07.870014+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:21:50.090415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001143142,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.0","version":"0'0","reported_seq":20,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-14T11:08:11.214664+0000","last_change":"2024-09-14T11:08:11.214664+0000","last_active":"2024-09-14T11:08:11.214664+0000","last_peered":"2024-09-14T11:08:11.214664+0000","last_clean":"2024-09-14T11:08:11.214664+0000","last_became_active":"2024-09-14T11:08:08.903386+0000","last_became_peered":"2024-09-14T11:08:08.903386+0000","last_unstale":"2024-09-14T11:08:11.214664+0000","last_undegraded":"2024-09-14T11:08:11.214664+0000","last_fullsized":"2024-09-14T11:08:11.214664+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:08:07.870014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:08:07.870014+0000","last_clean_scrub_stamp":"2024-09-14T11:08:07.870014+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:55:07.449307+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001192558,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.3","version":"18'1","reported_seq":21,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-14T11:08:10.932779+0000","last_change":"2024-09-14T11:08:10.932779+0000","last_active":"2024-09-14T11:08:10.932779+0000","last_peered":"2024-09-14T11:08:10.932779+0000","last_clean":"2024-09-14T11:08:10.932779+0000","last_became_active":"2024-09-14T11:08:08.902043+0000","last_became_peered":"2024-09-14T11:08:08.902043+0000","last_unstale":"2024-09-14T11:08:10.932779+0000","last_undegraded":"2024-09-14T11:08:10.932779+0000","last_fullsized":"2024-09-14T11:08:10.932779+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:08:07.870014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:08:07.870014+0000","last_clean_scrub_stamp":"2024-09-14T11:08:07.870014+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:04:35.417543+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0011624509999999999,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"1.0","version":"15'72","reported_seq":111,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-14T11:08:11.213357+0000","last_change":"2024-09-14T11:08:03.882483+0000","last_active":"2024-09-14T11:08:11.213357+0000","last_peered":"2024-09-14T11:08:11.213357+0000","last_clean":"2024-09-14T11:08:11.213357+0000","last_became_active":"2024-09-14T11:08:03.877126+0000","last_became_peered":"2024-09-14T11:08:03.877126+0000","last_unstale":"2024-09-14T11:08:11.213357+0000","last_undegraded":"2024-09-14T11:08:11.213357+0000","last_fullsized":"2024-09-14T11:08:11.213357+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:08:02.835447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:08:02.835447+0000","last_clean_scrub_stamp":"2024-09-14T11:08:02.835447+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:04:38.793105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574851,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27816,"kb_used_data":780,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344024,"statfs":{"total":96636764160,"available":96608280576,"internally_reserved":0,"allocated":798720,"data_stored":659264,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574853,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27236,"kb_used_data":200,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344604,"statfs":{"total":96636764160,"available":96608874496,"internally_reserved":0,"allocated":204800,"data_stored":68896,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574852,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27240,"kb_used_data":204,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344600,"statfs":{"total":96636764160,"available":96608870400,"internally_reserved":0,"allocated":208896,"data_stored":68915,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574852,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27236,"kb_used_data":200,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344604,"statfs":{"total":96636764160,"available":96608874496,"internally_reserved":0,"allocated":204800,"data_stored":68896,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574853,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27232,"kb_used_data":200,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344608,"statfs":{"total":96636764160,"available":96608878592,"internally_reserved":0,"allocated":204800,"data_stored":68896,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574854,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27236,"kb_used_data":200,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344604,"statfs":{"total":96636764160,"available":96608874496,"internally_reserved":0,"allocated":204800,"data_stored":68896,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574854,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27236,"kb_used_data":204,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344604,"statfs":{"total":96636764160,"available":96608874496,"internally_reserved":0,"allocated":208896,"data_stored":68915,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574852,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27816,"kb_used_data":780,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344024,"statfs":{"total":96636764160,"available":96608280576,"internally_reserved":0,"allocated":798720,"data_stored":659264,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-14T11:08:13.487 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-14T11:08:13.761 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-09-14T11:08:13.761 INFO:teuthology.orchestra.run.smithi138.stderr:dumped all 2024-09-14T11:08:13.778 INFO:teuthology.orchestra.run.smithi138.stdout:{"pg_ready":true,"pg_map":{"version":18,"stamp":"2024-09-14T11:08:12.658443+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590387,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":103,"num_write_kb":1630,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":75,"ondisk_log_size":75,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":16,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":7,"kb":754974720,"kb_used":219048,"kb_used_data":2768,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754755672,"statfs":{"total":773094113280,"available":772869808128,"internally_reserved":0,"allocated":2834432,"data_stored":1731942,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":221236784},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":9,"apply_latency_ms":9,"commit_latency_ns":9000000,"apply_latency_ns":9000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.784030"},"pg_stats":[{"pgid":"2.7","version":"0'0","reported_seq":20,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-14T11:08:11.214692+0000","last_change":"2024-09-14T11:08:11.214692+0000","last_active":"2024-09-14T11:08:11.214692+0000","last_peered":"2024-09-14T11:08:11.214692+0000","last_clean":"2024-09-14T11:08:11.214692+0000","last_became_active":"2024-09-14T11:08:08.905736+0000","last_became_peered":"2024-09-14T11:08:08.905736+0000","last_unstale":"2024-09-14T11:08:11.214692+0000","last_undegraded":"2024-09-14T11:08:11.214692+0000","last_fullsized":"2024-09-14T11:08:11.214692+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:08:07.870014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:08:07.870014+0000","last_clean_scrub_stamp":"2024-09-14T11:08:07.870014+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:16:43.551707+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0012835290000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.6","version":"0'0","reported_seq":20,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-14T11:08:10.911600+0000","last_change":"2024-09-14T11:08:10.911600+0000","last_active":"2024-09-14T11:08:10.911600+0000","last_peered":"2024-09-14T11:08:10.911600+0000","last_clean":"2024-09-14T11:08:10.911600+0000","last_became_active":"2024-09-14T11:08:08.891458+0000","last_became_peered":"2024-09-14T11:08:08.891458+0000","last_unstale":"2024-09-14T11:08:10.911600+0000","last_undegraded":"2024-09-14T11:08:10.911600+0000","last_fullsized":"2024-09-14T11:08:10.911600+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:08:07.870014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:08:07.870014+0000","last_clean_scrub_stamp":"2024-09-14T11:08:07.870014+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:05:05.170921+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0011468940000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.5","version":"0'0","reported_seq":20,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-14T11:08:11.214796+0000","last_change":"2024-09-14T11:08:11.214796+0000","last_active":"2024-09-14T11:08:11.214796+0000","last_peered":"2024-09-14T11:08:11.214796+0000","last_clean":"2024-09-14T11:08:11.214796+0000","last_became_active":"2024-09-14T11:08:08.903905+0000","last_became_peered":"2024-09-14T11:08:08.903905+0000","last_unstale":"2024-09-14T11:08:11.214796+0000","last_undegraded":"2024-09-14T11:08:11.214796+0000","last_fullsized":"2024-09-14T11:08:11.214796+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:08:07.870014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:08:07.870014+0000","last_clean_scrub_stamp":"2024-09-14T11:08:07.870014+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:58:06.786050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001173377,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.4","version":"0'0","reported_seq":20,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-14T11:08:10.911600+0000","last_change":"2024-09-14T11:08:10.911600+0000","last_active":"2024-09-14T11:08:10.911600+0000","last_peered":"2024-09-14T11:08:10.911600+0000","last_clean":"2024-09-14T11:08:10.911600+0000","last_became_active":"2024-09-14T11:08:08.888921+0000","last_became_peered":"2024-09-14T11:08:08.888921+0000","last_unstale":"2024-09-14T11:08:10.911600+0000","last_undegraded":"2024-09-14T11:08:10.911600+0000","last_fullsized":"2024-09-14T11:08:10.911600+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:08:07.870014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:08:07.870014+0000","last_clean_scrub_stamp":"2024-09-14T11:08:07.870014+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:29:02.760571+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001198714,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.2","version":"20'2","reported_seq":22,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-14T11:08:10.935213+0000","last_change":"2024-09-14T11:08:10.933870+0000","last_active":"2024-09-14T11:08:10.935213+0000","last_peered":"2024-09-14T11:08:10.935213+0000","last_clean":"2024-09-14T11:08:10.935213+0000","last_became_active":"2024-09-14T11:08:08.903062+0000","last_became_peered":"2024-09-14T11:08:08.903062+0000","last_unstale":"2024-09-14T11:08:10.935213+0000","last_undegraded":"2024-09-14T11:08:10.935213+0000","last_fullsized":"2024-09-14T11:08:10.935213+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:08:07.870014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:08:07.870014+0000","last_clean_scrub_stamp":"2024-09-14T11:08:07.870014+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:50:59.568798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0022728420000000002,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.1","version":"0'0","reported_seq":20,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-14T11:08:10.911966+0000","last_change":"2024-09-14T11:08:10.911966+0000","last_active":"2024-09-14T11:08:10.911966+0000","last_peered":"2024-09-14T11:08:10.911966+0000","last_clean":"2024-09-14T11:08:10.911966+0000","last_became_active":"2024-09-14T11:08:08.957848+0000","last_became_peered":"2024-09-14T11:08:08.957848+0000","last_unstale":"2024-09-14T11:08:10.911966+0000","last_undegraded":"2024-09-14T11:08:10.911966+0000","last_fullsized":"2024-09-14T11:08:10.911966+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:08:07.870014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:08:07.870014+0000","last_clean_scrub_stamp":"2024-09-14T11:08:07.870014+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:21:50.090415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001143142,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.0","version":"0'0","reported_seq":20,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-14T11:08:11.214664+0000","last_change":"2024-09-14T11:08:11.214664+0000","last_active":"2024-09-14T11:08:11.214664+0000","last_peered":"2024-09-14T11:08:11.214664+0000","last_clean":"2024-09-14T11:08:11.214664+0000","last_became_active":"2024-09-14T11:08:08.903386+0000","last_became_peered":"2024-09-14T11:08:08.903386+0000","last_unstale":"2024-09-14T11:08:11.214664+0000","last_undegraded":"2024-09-14T11:08:11.214664+0000","last_fullsized":"2024-09-14T11:08:11.214664+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:08:07.870014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:08:07.870014+0000","last_clean_scrub_stamp":"2024-09-14T11:08:07.870014+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:55:07.449307+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001192558,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.3","version":"18'1","reported_seq":21,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-14T11:08:10.932779+0000","last_change":"2024-09-14T11:08:10.932779+0000","last_active":"2024-09-14T11:08:10.932779+0000","last_peered":"2024-09-14T11:08:10.932779+0000","last_clean":"2024-09-14T11:08:10.932779+0000","last_became_active":"2024-09-14T11:08:08.902043+0000","last_became_peered":"2024-09-14T11:08:08.902043+0000","last_unstale":"2024-09-14T11:08:10.932779+0000","last_undegraded":"2024-09-14T11:08:10.932779+0000","last_fullsized":"2024-09-14T11:08:10.932779+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:08:07.870014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:08:07.870014+0000","last_clean_scrub_stamp":"2024-09-14T11:08:07.870014+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:04:35.417543+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0011624509999999999,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"1.0","version":"15'72","reported_seq":111,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-14T11:08:11.213357+0000","last_change":"2024-09-14T11:08:03.882483+0000","last_active":"2024-09-14T11:08:11.213357+0000","last_peered":"2024-09-14T11:08:11.213357+0000","last_clean":"2024-09-14T11:08:11.213357+0000","last_became_active":"2024-09-14T11:08:03.877126+0000","last_became_peered":"2024-09-14T11:08:03.877126+0000","last_unstale":"2024-09-14T11:08:11.213357+0000","last_undegraded":"2024-09-14T11:08:11.213357+0000","last_fullsized":"2024-09-14T11:08:11.213357+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:08:02.835447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:08:02.835447+0000","last_clean_scrub_stamp":"2024-09-14T11:08:02.835447+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:04:38.793105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574851,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27816,"kb_used_data":780,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344024,"statfs":{"total":96636764160,"available":96608280576,"internally_reserved":0,"allocated":798720,"data_stored":659264,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574853,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27236,"kb_used_data":200,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344604,"statfs":{"total":96636764160,"available":96608874496,"internally_reserved":0,"allocated":204800,"data_stored":68896,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574852,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27240,"kb_used_data":204,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344600,"statfs":{"total":96636764160,"available":96608870400,"internally_reserved":0,"allocated":208896,"data_stored":68915,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574852,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27236,"kb_used_data":200,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344604,"statfs":{"total":96636764160,"available":96608874496,"internally_reserved":0,"allocated":204800,"data_stored":68896,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574853,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27232,"kb_used_data":200,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344608,"statfs":{"total":96636764160,"available":96608878592,"internally_reserved":0,"allocated":204800,"data_stored":68896,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574854,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27236,"kb_used_data":200,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344604,"statfs":{"total":96636764160,"available":96608874496,"internally_reserved":0,"allocated":204800,"data_stored":68896,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574854,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27236,"kb_used_data":204,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344604,"statfs":{"total":96636764160,"available":96608874496,"internally_reserved":0,"allocated":208896,"data_stored":68915,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574852,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27816,"kb_used_data":780,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344024,"statfs":{"total":96636764160,"available":96608280576,"internally_reserved":0,"allocated":798720,"data_stored":659264,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-14T11:08:13.779 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-09-14T11:08:13.779 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2024-09-14T11:08:13.779 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy 2024-09-14T11:08:13.779 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2024-09-14T11:08:14.101 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-09-14T11:08:14.101 INFO:teuthology.orchestra.run.smithi138.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2024-09-14T11:08:14.118 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy done 2024-09-14T11:08:14.118 INFO:teuthology.run_tasks:Running task openssl_keys... 2024-09-14T11:08:14.130 DEBUG:teuthology.task:Applying overrides for task openssl_keys: {'rgw.client.0': {'ca': 'root', 'client': 'client.0', 'embed-key': True}, 'root': {'client': 'client.0', 'cn': 'teuthology', 'install': ['client.0'], 'key-type': 'rsa:4096'}} 2024-09-14T11:08:14.131 DEBUG:teuthology.orchestra.run.smithi138:> mkdir -p /home/ubuntu/cephtest/ca 2024-09-14T11:08:14.136 DEBUG:teuthology.orchestra.run.smithi138:> openssl req -x509 -nodes -newkey rsa:4096 -keyout /home/ubuntu/cephtest/ca/root.key -days 365 -out /home/ubuntu/cephtest/ca/root.crt -subj /CN=teuthology 2024-09-14T11:08:14.572 INFO:teuthology.orchestra.run.smithi138.stderr:..+...+...+..........+..+..........+............+...............+...+...+.....+....+++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++*.....+......+...+............+....+..+....+++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++*..+..........+....................+...+.........+.+..+.+......+........+......+...............+.+...........+.......+...+...+.........+.....+.+.....+.......+.....+....+........+............+...+.+.....+.+......+.....+.............+...........+.+.........+...............+......+..+.+++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++ 2024-09-14T11:08:15.255 INFO:teuthology.orchestra.run.smithi138.stderr:.......+.....+.+........+....+..+...+...............+.+++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++*.+.+...+...........+...+++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++*....................+.....+............+....+......+...+.........+..+......+.......+........+..........+............+...+..+......+.........+.....................+.+.....+......+...+......+...+..........+......+.....+.+...........+.......+..+.+........+......+..........+.....+...+...+..........+.....+...+.........+............+..........+...+...........+..............................+......+...............................+..+...+.............+..+....+...+......+..............+.............+...+.....+....+...+..+...+......................+......+...........................+..+.+............+.........+......+.........+...+.....+................+.....+....+..+...................+.....+..........+......+.....+.+...+............+..+.+.....+++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++ 2024-09-14T11:08:15.271 INFO:teuthology.orchestra.run.smithi138.stderr:----- 2024-09-14T11:08:15.279 DEBUG:teuthology.orchestra.run.smithi138:> sudo cp /home/ubuntu/cephtest/ca/root.crt /usr/local/share/ca-certificates/root.crt 2024-09-14T11:08:15.351 DEBUG:teuthology.orchestra.run.smithi138:> sudo update-ca-certificates 2024-09-14T11:08:15.412 INFO:teuthology.orchestra.run.smithi138.stdout:Updating certificates in /etc/ssl/certs... 2024-09-14T11:08:15.987 INFO:teuthology.orchestra.run.smithi138.stderr:rehash: warning: skipping ca-certificates.crt,it does not contain exactly one certificate or CRL 2024-09-14T11:08:16.007 INFO:teuthology.orchestra.run.smithi138.stdout:1 added, 0 removed; done. 2024-09-14T11:08:16.009 INFO:teuthology.orchestra.run.smithi138.stdout:Running hooks in /etc/ca-certificates/update.d... 2024-09-14T11:08:16.012 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-09-14T11:08:17.786 INFO:teuthology.orchestra.run.smithi138.stdout:Adding debian:root.pem 2024-09-14T11:08:17.812 INFO:teuthology.orchestra.run.smithi138.stdout:done. 2024-09-14T11:08:17.812 INFO:teuthology.orchestra.run.smithi138.stdout:done. 2024-09-14T11:08:17.816 DEBUG:teuthology.orchestra.run.smithi138:> mkdir -p /home/ubuntu/cephtest/ca 2024-09-14T11:08:17.862 DEBUG:teuthology.orchestra.run.smithi138:> openssl req -nodes -newkey rsa:2048 -keyout /home/ubuntu/cephtest/ca/rgw.client.0.key -out /home/ubuntu/cephtest/ca/rgw.client.0.csr -subj /CN=smithi138.front.sepia.ceph.com 2024-09-14T11:08:17.980 INFO:teuthology.orchestra.run.smithi138.stderr:.+........+...+.........+.+..+....+.....+.+...+.....+.+........+...+...+++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++*.+.........+.+...+..+.......+...+..+++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++*..+...........+..........+.....+...+....+...........................+...+..+...+.+..............+.+......+......+...+.....+......+++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++ 2024-09-14T11:08:17.995 INFO:teuthology.orchestra.run.smithi138.stderr:.+............+...+.......+......+...+......+...+...+........+.........+.+.....+.+...+..+..........+......+.....+............+.+..+.........+++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++*..+.........+......+.+...+.........+..+..........+..............+......+.+++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++*...+..+.+.........+++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++ 2024-09-14T11:08:17.998 INFO:teuthology.orchestra.run.smithi138.stderr:----- 2024-09-14T11:08:18.001 DEBUG:teuthology.orchestra.run.smithi138:> set -ex 2024-09-14T11:08:18.001 DEBUG:teuthology.orchestra.run.smithi138:> dd of=/home/ubuntu/cephtest/ca/rgw.client.0.ext 2024-09-14T11:08:18.046 DEBUG:teuthology.orchestra.run.smithi138:> openssl x509 -req -in /home/ubuntu/cephtest/ca/rgw.client.0.csr -CA /home/ubuntu/cephtest/ca/root.crt -CAkey /home/ubuntu/cephtest/ca/root.key -CAcreateserial -out /home/ubuntu/cephtest/ca/rgw.client.0.crt -days 365 -sha256 -extfile /home/ubuntu/cephtest/ca/rgw.client.0.ext 2024-09-14T11:08:18.097 INFO:teuthology.orchestra.run.smithi138.stderr:Certificate request self-signature ok 2024-09-14T11:08:18.098 INFO:teuthology.orchestra.run.smithi138.stderr:subject=CN = smithi138.front.sepia.ceph.com 2024-09-14T11:08:18.110 DEBUG:teuthology.orchestra.run.smithi138:> rm -f /home/ubuntu/cephtest/ca/rgw.client.0.csr /home/ubuntu/cephtest/ca/root.srl /home/ubuntu/cephtest/ca/rgw.client.0.ext 2024-09-14T11:08:18.158 DEBUG:teuthology.orchestra.run.smithi138:> openssl verify -CAfile /home/ubuntu/cephtest/ca/root.crt /home/ubuntu/cephtest/ca/rgw.client.0.crt 2024-09-14T11:08:18.210 INFO:teuthology.orchestra.run.smithi138.stdout:/home/ubuntu/cephtest/ca/rgw.client.0.crt: OK 2024-09-14T11:08:18.210 DEBUG:teuthology.orchestra.run.smithi138:> cat /home/ubuntu/cephtest/ca/rgw.client.0.key >> /home/ubuntu/cephtest/ca/rgw.client.0.crt 2024-09-14T11:08:18.259 INFO:teuthology.run_tasks:Running task rgw... 2024-09-14T11:08:18.274 DEBUG:tasks.rgw:config is {'client.0': {'ssl certificate': 'rgw.client.0', 'valgrind': ['--tool=memcheck', '--max-threads=1024']}} 2024-09-14T11:08:18.274 DEBUG:tasks.rgw:client list is dict_keys(['client.0']) 2024-09-14T11:08:18.274 INFO:tasks.rgw:Creating data pools 2024-09-14T11:08:18.275 DEBUG:tasks.rgw:Obtaining remote for client client.0 2024-09-14T11:08:18.275 DEBUG:teuthology.orchestra.run.smithi138:> sudo ceph osd erasure-code-profile set client.0 k=2 m=1 crush-failure-domain=osd --cluster ceph 2024-09-14T11:08:18.752 DEBUG:teuthology.orchestra.run.smithi138:> sudo ceph osd pool create default.rgw.buckets.data 64 64 erasure client.0 --cluster ceph 2024-09-14T11:08:20.752 INFO:teuthology.orchestra.run.smithi138.stderr:pool 'default.rgw.buckets.data' created 2024-09-14T11:08:20.788 DEBUG:teuthology.orchestra.run.smithi138:> sudo ceph osd pool application enable default.rgw.buckets.data rgw --cluster ceph 2024-09-14T11:08:21.748 INFO:teuthology.orchestra.run.smithi138.stderr:enabled application 'rgw' on pool 'default.rgw.buckets.data' 2024-09-14T11:08:21.794 DEBUG:teuthology.orchestra.run.smithi138:> sudo ceph osd pool create default.rgw.buckets.index 64 64 --cluster ceph 2024-09-14T11:08:22.769 INFO:teuthology.orchestra.run.smithi138.stderr:pool 'default.rgw.buckets.index' created 2024-09-14T11:08:22.803 DEBUG:teuthology.orchestra.run.smithi138:> sudo ceph osd pool application enable default.rgw.buckets.index rgw --cluster ceph 2024-09-14T11:08:23.755 INFO:teuthology.orchestra.run.smithi138.stderr:enabled application 'rgw' on pool 'default.rgw.buckets.index' 2024-09-14T11:08:23.803 DEBUG:tasks.rgw:Pools created 2024-09-14T11:08:23.804 INFO:tasks.rgw:Configuring compression type = random 2024-09-14T11:08:23.804 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'list'] 2024-09-14T11:08:23.804 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'list'] 2024-09-14T11:08:23.804 DEBUG:teuthology.orchestra.run.smithi138:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user list 2024-09-14T11:08:23.860 INFO:teuthology.orchestra.run.smithi138.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:08:23.861 INFO:teuthology.orchestra.run.smithi138.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:08:25.861 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:08:25.859+0000 7f25a6d68640 0 -- 172.21.15.138:0/586594735 >> [v2:172.21.15.138:6832/3778043143,v1:172.21.15.138:6833/3778043143] conn(0x7f247c0717b0 msgr2=0x7f247c073c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:08:25.866 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:08:25.867+0000 7f25a92629c0 20 rados->read ofs=0 len=0 2024-09-14T11:08:25.867 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:08:25.867+0000 7f25a7569640 0 -- 172.21.15.138:0/3398262173 >> [v2:172.21.15.138:6832/3778043143,v1:172.21.15.138:6833/3778043143] conn(0x7f246c0718a0 msgr2=0x7f246c073d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:08:25.869 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:08:25.867+0000 7f25a92629c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:08:25.869 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:08:25.867+0000 7f25a92629c0 20 realm 2024-09-14T11:08:25.869 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:08:25.867+0000 7f25a92629c0 20 rados->read ofs=0 len=0 2024-09-14T11:08:25.869 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:08:25.867+0000 7f25a92629c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:08:25.869 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:08:25.867+0000 7f25a92629c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:08:25.869 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:08:25.867+0000 7f25a92629c0 20 rados->read ofs=0 len=0 2024-09-14T11:08:25.869 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:08:25.867+0000 7f25a92629c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:08:25.869 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:08:25.867+0000 7f25a92629c0 20 rados->read ofs=0 len=0 2024-09-14T11:08:25.871 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:08:25.871+0000 7f25a92629c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:08:25.871 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:08:25.871+0000 7f25a92629c0 20 rados->read ofs=0 len=0 2024-09-14T11:08:25.872 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:08:25.871+0000 7f25a92629c0 20 rados_obj.operate() r=0 bl.length=993 2024-09-14T11:08:25.872 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:08:25.871+0000 7f25a92629c0 20 searching for the correct realm 2024-09-14T11:08:25.892 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:08:25.891+0000 7f25a92629c0 20 RGWRados::pool_iterate: got zone_info.d9e72d30-c60b-4d0d-9267-fdc36392d5ad 2024-09-14T11:08:25.892 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:08:25.891+0000 7f25a92629c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:08:25.893 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:08:25.891+0000 7f25a92629c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:08:25.893 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:08:25.891+0000 7f25a92629c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:08:25.893 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:08:25.891+0000 7f25a92629c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:08:25.893 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:08:25.891+0000 7f25a92629c0 20 RGWRados::pool_iterate: got zonegroup_info.65ab941b-da8c-4160-94fb-3672b069d44f 2024-09-14T11:08:25.893 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:08:25.891+0000 7f25a92629c0 20 rados->read ofs=0 len=0 2024-09-14T11:08:25.893 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:08:25.891+0000 7f25a92629c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:08:25.894 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:08:25.891+0000 7f25a92629c0 20 rados->read ofs=0 len=0 2024-09-14T11:08:25.894 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:08:25.895+0000 7f25a92629c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:08:25.894 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:08:25.895+0000 7f25a92629c0 20 rados->read ofs=0 len=0 2024-09-14T11:08:25.895 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:08:25.895+0000 7f25a92629c0 20 rados_obj.operate() r=0 bl.length=436 2024-09-14T11:08:25.895 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:08:25.895+0000 7f25a92629c0 20 zone default found 2024-09-14T11:08:25.895 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:08:25.895+0000 7f25a92629c0 4 Realm: () 2024-09-14T11:08:25.895 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:08:25.895+0000 7f25a92629c0 4 ZoneGroup: default (65ab941b-da8c-4160-94fb-3672b069d44f) 2024-09-14T11:08:25.895 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:08:25.895+0000 7f25a92629c0 4 Zone: default (d9e72d30-c60b-4d0d-9267-fdc36392d5ad) 2024-09-14T11:08:25.895 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:08:25.895+0000 7f25a92629c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:08:25.895 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:08:25.895+0000 7f25a92629c0 20 zonegroup default 2024-09-14T11:08:25.895 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:08:25.895+0000 7f25a92629c0 20 rados->read ofs=0 len=0 2024-09-14T11:08:25.896 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:08:25.895+0000 7f25a92629c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:08:25.896 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:08:25.895+0000 7f25a92629c0 20 rados->read ofs=0 len=0 2024-09-14T11:08:27.817 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:08:27.815+0000 7f25a92629c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:08:27.817 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:08:27.815+0000 7f25a92629c0 20 rados->read ofs=0 len=0 2024-09-14T11:08:27.819 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:08:27.819+0000 7f25a92629c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:08:27.820 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:08:27.819+0000 7f25a92629c0 20 started sync module instance, tier type = 2024-09-14T11:08:27.820 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:08:27.819+0000 7f25a92629c0 20 started zone id=d9e72d30-c60b-4d0d-9267-fdc36392d5ad (name=default) with tier type = 2024-09-14T11:08:29.860 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:08:29.859+0000 7f25a92629c0 20 add_watcher() i=0 2024-09-14T11:08:29.860 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:08:29.859+0000 7f25a92629c0 20 add_watcher() i=1 2024-09-14T11:08:29.860 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:08:29.859+0000 7f25a92629c0 20 add_watcher() i=2 2024-09-14T11:08:29.860 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:08:29.859+0000 7f25a92629c0 20 add_watcher() i=3 2024-09-14T11:08:29.860 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:08:29.859+0000 7f25a92629c0 20 add_watcher() i=4 2024-09-14T11:08:29.860 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:08:29.859+0000 7f25a92629c0 20 add_watcher() i=5 2024-09-14T11:08:29.860 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:08:29.859+0000 7f25a92629c0 20 add_watcher() i=6 2024-09-14T11:08:29.862 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:08:29.859+0000 7f25a92629c0 20 add_watcher() i=7 2024-09-14T11:08:29.862 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:08:29.859+0000 7f25a92629c0 2 all 8 watchers are set, enabling cache 2024-09-14T11:08:29.862 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:08:29.863+0000 7f25a92629c0 5 tl::expected, obj_version>, boost::system::error_code> logback_generations::read(const DoutPrefixProvider*, optional_yield):410: oid=data_loggenerations_metadata not found 2024-09-14T11:08:29.863 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:08:29.863+0000 7f25a92629c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.0 2024-09-14T11:08:29.863 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:08:29.863+0000 7f25a92629c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T11:08:29.863 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:08:29.863+0000 7f25a92629c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.0 does not exist 2024-09-14T11:08:29.863 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:08:29.863+0000 7f25a92629c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.1 2024-09-14T11:08:29.863 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:08:29.863+0000 7f25a92629c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T11:08:29.864 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:08:29.863+0000 7f25a92629c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.1 does not exist 2024-09-14T11:08:29.864 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:08:29.863+0000 7f25a92629c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.2 2024-09-14T11:08:29.864 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:08:29.863+0000 7f25a92629c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T11:08:29.864 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:08:29.863+0000 7f25a92629c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.2 does not exist 2024-09-14T11:08:29.865 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:08:29.863+0000 7f25a92629c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.3 2024-09-14T11:08:29.865 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:08:29.863+0000 7f25a92629c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T11:08:29.865 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:08:29.863+0000 7f25a92629c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.3 does not exist 2024-09-14T11:08:29.865 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:08:29.863+0000 7f25a92629c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.4 2024-09-14T11:08:29.865 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:08:29.863+0000 7f25a92629c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T11:08:29.865 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:08:29.863+0000 7f25a92629c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.4 does not exist 2024-09-14T11:08:29.866 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:08:29.863+0000 7f25a92629c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.5 2024-09-14T11:08:29.866 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:08:29.863+0000 7f25a92629c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T11:08:29.866 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:08:29.867+0000 7f25a92629c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.5 does not exist 2024-09-14T11:08:29.866 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:08:29.867+0000 7f25a92629c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.6 2024-09-14T11:08:29.866 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:08:29.867+0000 7f25a92629c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T11:08:29.867 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:08:29.867+0000 7f25a92629c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.6 does not exist 2024-09-14T11:08:29.867 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:08:29.867+0000 7f25a92629c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.7 2024-09-14T11:08:29.867 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:08:29.867+0000 7f25a92629c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T11:08:29.867 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:08:29.867+0000 7f25a92629c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.7 does not exist 2024-09-14T11:08:29.867 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:08:29.867+0000 7f25a92629c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.8 2024-09-14T11:08:29.867 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:08:29.867+0000 7f25a92629c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T11:08:29.868 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:08:29.867+0000 7f25a92629c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.8 does not exist 2024-09-14T11:08:29.868 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:08:29.867+0000 7f25a92629c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.9 2024-09-14T11:08:29.868 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:08:29.867+0000 7f25a92629c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T11:08:29.868 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:08:29.867+0000 7f25a92629c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.9 does not exist 2024-09-14T11:08:29.868 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:08:29.867+0000 7f25a92629c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.10 2024-09-14T11:08:29.868 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:08:29.867+0000 7f25a92629c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T11:08:29.869 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:08:29.867+0000 7f25a92629c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.10 does not exist 2024-09-14T11:08:29.869 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:08:29.867+0000 7f25a92629c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.11 2024-09-14T11:08:29.869 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:08:29.867+0000 7f25a92629c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T11:08:29.869 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:08:29.867+0000 7f25a92629c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.11 does not exist 2024-09-14T11:08:29.869 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:08:29.867+0000 7f25a92629c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.12 2024-09-14T11:08:29.869 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:08:29.867+0000 7f25a92629c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T11:08:29.870 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:08:29.867+0000 7f25a92629c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.12 does not exist 2024-09-14T11:08:29.870 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:08:29.867+0000 7f25a92629c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.13 2024-09-14T11:08:29.870 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:08:29.867+0000 7f25a92629c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T11:08:29.870 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:08:29.871+0000 7f25a92629c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.13 does not exist 2024-09-14T11:08:29.870 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:08:29.871+0000 7f25a92629c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.14 2024-09-14T11:08:29.871 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:08:29.871+0000 7f25a92629c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T11:08:29.871 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:08:29.871+0000 7f25a92629c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.14 does not exist 2024-09-14T11:08:29.871 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:08:29.871+0000 7f25a92629c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.15 2024-09-14T11:08:29.871 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:08:29.871+0000 7f25a92629c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T11:08:29.872 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:08:29.871+0000 7f25a92629c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.15 does not exist 2024-09-14T11:08:29.872 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:08:29.871+0000 7f25a92629c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.16 2024-09-14T11:08:29.872 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:08:29.871+0000 7f25a92629c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T11:08:29.872 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:08:29.871+0000 7f25a92629c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.16 does not exist 2024-09-14T11:08:29.873 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:08:29.871+0000 7f25a92629c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.17 2024-09-14T11:08:29.873 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:08:29.871+0000 7f25a92629c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T11:08:29.873 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:08:29.871+0000 7f25a92629c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.17 does not exist 2024-09-14T11:08:29.873 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:08:29.871+0000 7f25a92629c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.18 2024-09-14T11:08:29.873 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:08:29.871+0000 7f25a92629c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T11:08:29.873 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:08:29.871+0000 7f25a92629c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.18 does not exist 2024-09-14T11:08:29.874 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:08:29.871+0000 7f25a92629c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.19 2024-09-14T11:08:29.874 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:08:29.871+0000 7f25a92629c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T11:08:29.874 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:08:29.875+0000 7f25a92629c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.19 does not exist 2024-09-14T11:08:29.874 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:08:29.875+0000 7f25a92629c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.20 2024-09-14T11:08:29.875 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:08:29.875+0000 7f25a92629c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T11:08:29.875 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:08:29.875+0000 7f25a92629c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.20 does not exist 2024-09-14T11:08:29.875 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:08:29.875+0000 7f25a92629c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.21 2024-09-14T11:08:29.875 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:08:29.875+0000 7f25a92629c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T11:08:29.876 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:08:29.875+0000 7f25a92629c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.21 does not exist 2024-09-14T11:08:29.876 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:08:29.875+0000 7f25a92629c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.22 2024-09-14T11:08:29.876 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:08:29.875+0000 7f25a92629c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T11:08:29.876 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:08:29.875+0000 7f25a92629c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.22 does not exist 2024-09-14T11:08:29.877 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:08:29.875+0000 7f25a92629c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.23 2024-09-14T11:08:29.877 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:08:29.875+0000 7f25a92629c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T11:08:29.877 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:08:29.875+0000 7f25a92629c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.23 does not exist 2024-09-14T11:08:29.877 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:08:29.875+0000 7f25a92629c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.24 2024-09-14T11:08:29.877 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:08:29.875+0000 7f25a92629c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T11:08:29.878 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:08:29.879+0000 7f25a92629c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.24 does not exist 2024-09-14T11:08:29.878 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:08:29.879+0000 7f25a92629c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.25 2024-09-14T11:08:29.878 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:08:29.879+0000 7f25a92629c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T11:08:29.879 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:08:29.879+0000 7f25a92629c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.25 does not exist 2024-09-14T11:08:29.879 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:08:29.879+0000 7f25a92629c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.26 2024-09-14T11:08:29.879 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:08:29.879+0000 7f25a92629c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T11:08:29.879 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:08:29.879+0000 7f25a92629c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.26 does not exist 2024-09-14T11:08:29.879 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:08:29.879+0000 7f25a92629c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.27 2024-09-14T11:08:29.879 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:08:29.879+0000 7f25a92629c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T11:08:29.879 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:08:29.879+0000 7f25a92629c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.27 does not exist 2024-09-14T11:08:29.880 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:08:29.879+0000 7f25a92629c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.28 2024-09-14T11:08:29.880 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:08:29.879+0000 7f25a92629c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T11:08:29.880 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:08:29.879+0000 7f25a92629c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.28 does not exist 2024-09-14T11:08:29.881 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:08:29.879+0000 7f25a92629c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.29 2024-09-14T11:08:29.881 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:08:29.879+0000 7f25a92629c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T11:08:29.881 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:08:29.879+0000 7f25a92629c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.29 does not exist 2024-09-14T11:08:29.881 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:08:29.879+0000 7f25a92629c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.30 2024-09-14T11:08:29.881 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:08:29.879+0000 7f25a92629c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T11:08:29.881 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:08:29.879+0000 7f25a92629c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.30 does not exist 2024-09-14T11:08:29.882 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:08:29.879+0000 7f25a92629c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.31 2024-09-14T11:08:29.882 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:08:29.879+0000 7f25a92629c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T11:08:29.882 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:08:29.883+0000 7f25a92629c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.31 does not exist 2024-09-14T11:08:29.882 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:08:29.883+0000 7f25a92629c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.32 2024-09-14T11:08:29.882 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:08:29.883+0000 7f25a92629c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T11:08:29.883 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:08:29.883+0000 7f25a92629c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.32 does not exist 2024-09-14T11:08:29.883 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:08:29.883+0000 7f25a92629c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.33 2024-09-14T11:08:29.883 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:08:29.883+0000 7f25a92629c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T11:08:29.884 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:08:29.883+0000 7f25a92629c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.33 does not exist 2024-09-14T11:08:29.884 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:08:29.883+0000 7f25a92629c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.34 2024-09-14T11:08:29.884 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:08:29.883+0000 7f25a92629c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T11:08:29.884 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:08:29.883+0000 7f25a92629c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.34 does not exist 2024-09-14T11:08:29.885 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:08:29.883+0000 7f25a92629c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.35 2024-09-14T11:08:29.885 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:08:29.883+0000 7f25a92629c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T11:08:29.885 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:08:29.883+0000 7f25a92629c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.35 does not exist 2024-09-14T11:08:29.885 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:08:29.883+0000 7f25a92629c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.36 2024-09-14T11:08:29.885 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:08:29.883+0000 7f25a92629c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T11:08:29.885 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:08:29.883+0000 7f25a92629c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.36 does not exist 2024-09-14T11:08:29.886 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:08:29.883+0000 7f25a92629c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.37 2024-09-14T11:08:29.886 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:08:29.883+0000 7f25a92629c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T11:08:29.886 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:08:29.887+0000 7f25a92629c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.37 does not exist 2024-09-14T11:08:29.886 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:08:29.887+0000 7f25a92629c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.38 2024-09-14T11:08:29.887 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:08:29.887+0000 7f25a92629c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T11:08:29.887 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:08:29.887+0000 7f25a92629c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.38 does not exist 2024-09-14T11:08:29.887 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:08:29.887+0000 7f25a92629c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.39 2024-09-14T11:08:29.887 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:08:29.887+0000 7f25a92629c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T11:08:29.888 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:08:29.887+0000 7f25a92629c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.39 does not exist 2024-09-14T11:08:29.888 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:08:29.887+0000 7f25a92629c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.40 2024-09-14T11:08:29.889 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:08:29.887+0000 7f25a92629c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T11:08:29.889 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:08:29.887+0000 7f25a92629c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.40 does not exist 2024-09-14T11:08:29.889 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:08:29.887+0000 7f25a92629c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.41 2024-09-14T11:08:29.889 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:08:29.887+0000 7f25a92629c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T11:08:29.889 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:08:29.887+0000 7f25a92629c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.41 does not exist 2024-09-14T11:08:29.890 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:08:29.887+0000 7f25a92629c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.42 2024-09-14T11:08:29.890 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:08:29.887+0000 7f25a92629c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T11:08:29.890 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:08:29.891+0000 7f25a92629c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.42 does not exist 2024-09-14T11:08:29.891 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:08:29.891+0000 7f25a92629c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.43 2024-09-14T11:08:29.891 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:08:29.891+0000 7f25a92629c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T11:08:29.891 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:08:29.891+0000 7f25a92629c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.43 does not exist 2024-09-14T11:08:29.892 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:08:29.891+0000 7f25a92629c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.44 2024-09-14T11:08:29.892 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:08:29.891+0000 7f25a92629c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T11:08:29.892 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:08:29.891+0000 7f25a92629c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.44 does not exist 2024-09-14T11:08:29.892 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:08:29.891+0000 7f25a92629c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.45 2024-09-14T11:08:29.892 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:08:29.891+0000 7f25a92629c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T11:08:29.893 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:08:29.891+0000 7f25a92629c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.45 does not exist 2024-09-14T11:08:29.893 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:08:29.891+0000 7f25a92629c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.46 2024-09-14T11:08:29.893 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:08:29.891+0000 7f25a92629c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T11:08:29.894 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:08:29.891+0000 7f25a92629c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.46 does not exist 2024-09-14T11:08:29.894 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:08:29.891+0000 7f25a92629c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.47 2024-09-14T11:08:29.894 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:08:29.891+0000 7f25a92629c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T11:08:29.895 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:08:29.895+0000 7f25a92629c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.47 does not exist 2024-09-14T11:08:29.895 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:08:29.895+0000 7f25a92629c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.48 2024-09-14T11:08:29.895 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:08:29.895+0000 7f25a92629c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T11:08:29.895 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:08:29.895+0000 7f25a92629c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.48 does not exist 2024-09-14T11:08:29.895 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:08:29.895+0000 7f25a92629c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.49 2024-09-14T11:08:29.895 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:08:29.895+0000 7f25a92629c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T11:08:29.895 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:08:29.895+0000 7f25a92629c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.49 does not exist 2024-09-14T11:08:29.895 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:08:29.895+0000 7f25a92629c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.50 2024-09-14T11:08:29.895 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:08:29.895+0000 7f25a92629c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T11:08:29.896 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:08:29.895+0000 7f25a92629c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.50 does not exist 2024-09-14T11:08:29.896 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:08:29.895+0000 7f25a92629c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.51 2024-09-14T11:08:29.896 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:08:29.895+0000 7f25a92629c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T11:08:29.896 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:08:29.895+0000 7f25a92629c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.51 does not exist 2024-09-14T11:08:29.896 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:08:29.895+0000 7f25a92629c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.52 2024-09-14T11:08:29.897 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:08:29.895+0000 7f25a92629c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T11:08:29.897 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:08:29.895+0000 7f25a92629c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.52 does not exist 2024-09-14T11:08:29.897 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:08:29.895+0000 7f25a92629c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.53 2024-09-14T11:08:29.897 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:08:29.895+0000 7f25a92629c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T11:08:29.897 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:08:29.895+0000 7f25a92629c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.53 does not exist 2024-09-14T11:08:29.898 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:08:29.895+0000 7f25a92629c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.54 2024-09-14T11:08:29.898 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:08:29.895+0000 7f25a92629c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T11:08:29.898 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:08:29.899+0000 7f25a92629c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.54 does not exist 2024-09-14T11:08:29.898 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:08:29.899+0000 7f25a92629c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.55 2024-09-14T11:08:29.898 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:08:29.899+0000 7f25a92629c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T11:08:29.899 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:08:29.899+0000 7f25a92629c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.55 does not exist 2024-09-14T11:08:29.899 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:08:29.899+0000 7f25a92629c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.56 2024-09-14T11:08:29.899 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:08:29.899+0000 7f25a92629c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T11:08:29.899 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:08:29.899+0000 7f25a92629c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.56 does not exist 2024-09-14T11:08:29.899 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:08:29.899+0000 7f25a92629c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.57 2024-09-14T11:08:29.899 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:08:29.899+0000 7f25a92629c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T11:08:29.900 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:08:29.899+0000 7f25a92629c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.57 does not exist 2024-09-14T11:08:29.900 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:08:29.899+0000 7f25a92629c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.58 2024-09-14T11:08:29.900 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:08:29.899+0000 7f25a92629c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T11:08:29.900 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:08:29.899+0000 7f25a92629c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.58 does not exist 2024-09-14T11:08:29.901 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:08:29.899+0000 7f25a92629c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.59 2024-09-14T11:08:29.901 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:08:29.899+0000 7f25a92629c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T11:08:29.901 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:08:29.899+0000 7f25a92629c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.59 does not exist 2024-09-14T11:08:29.901 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:08:29.899+0000 7f25a92629c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.60 2024-09-14T11:08:29.901 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:08:29.899+0000 7f25a92629c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T11:08:29.902 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:08:29.899+0000 7f25a92629c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.60 does not exist 2024-09-14T11:08:29.902 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:08:29.899+0000 7f25a92629c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.61 2024-09-14T11:08:29.902 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:08:29.899+0000 7f25a92629c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T11:08:29.902 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:08:29.903+0000 7f25a92629c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.61 does not exist 2024-09-14T11:08:29.902 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:08:29.903+0000 7f25a92629c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.62 2024-09-14T11:08:29.902 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:08:29.903+0000 7f25a92629c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T11:08:29.903 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:08:29.903+0000 7f25a92629c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.62 does not exist 2024-09-14T11:08:29.903 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:08:29.903+0000 7f25a92629c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.63 2024-09-14T11:08:29.903 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:08:29.903+0000 7f25a92629c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T11:08:29.903 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:08:29.903+0000 7f25a92629c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.63 does not exist 2024-09-14T11:08:29.903 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:08:29.903+0000 7f25a92629c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.64 2024-09-14T11:08:29.903 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:08:29.903+0000 7f25a92629c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T11:08:29.904 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:08:29.903+0000 7f25a92629c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.64 does not exist 2024-09-14T11:08:29.904 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:08:29.903+0000 7f25a92629c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.65 2024-09-14T11:08:29.904 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:08:29.903+0000 7f25a92629c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T11:08:29.904 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:08:29.903+0000 7f25a92629c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.65 does not exist 2024-09-14T11:08:29.904 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:08:29.903+0000 7f25a92629c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.66 2024-09-14T11:08:29.904 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:08:29.903+0000 7f25a92629c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T11:08:29.905 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:08:29.903+0000 7f25a92629c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.66 does not exist 2024-09-14T11:08:29.905 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:08:29.903+0000 7f25a92629c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.67 2024-09-14T11:08:29.905 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:08:29.903+0000 7f25a92629c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T11:08:29.905 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:08:29.903+0000 7f25a92629c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.67 does not exist 2024-09-14T11:08:29.905 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:08:29.903+0000 7f25a92629c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.68 2024-09-14T11:08:29.905 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:08:29.903+0000 7f25a92629c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T11:08:29.906 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:08:29.903+0000 7f25a92629c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.68 does not exist 2024-09-14T11:08:29.906 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:08:29.903+0000 7f25a92629c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.69 2024-09-14T11:08:29.906 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:08:29.903+0000 7f25a92629c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T11:08:29.906 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:08:29.907+0000 7f25a92629c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.69 does not exist 2024-09-14T11:08:29.906 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:08:29.907+0000 7f25a92629c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.70 2024-09-14T11:08:29.907 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:08:29.907+0000 7f25a92629c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T11:08:29.907 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:08:29.907+0000 7f25a92629c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.70 does not exist 2024-09-14T11:08:29.907 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:08:29.907+0000 7f25a92629c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.71 2024-09-14T11:08:29.907 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:08:29.907+0000 7f25a92629c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T11:08:29.907 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:08:29.907+0000 7f25a92629c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.71 does not exist 2024-09-14T11:08:29.907 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:08:29.907+0000 7f25a92629c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.72 2024-09-14T11:08:29.908 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:08:29.907+0000 7f25a92629c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T11:08:29.908 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:08:29.907+0000 7f25a92629c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.72 does not exist 2024-09-14T11:08:29.908 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:08:29.907+0000 7f25a92629c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.73 2024-09-14T11:08:29.908 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:08:29.907+0000 7f25a92629c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T11:08:29.909 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:08:29.907+0000 7f25a92629c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.73 does not exist 2024-09-14T11:08:29.909 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:08:29.907+0000 7f25a92629c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.74 2024-09-14T11:08:29.909 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:08:29.907+0000 7f25a92629c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T11:08:29.909 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:08:29.907+0000 7f25a92629c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.74 does not exist 2024-09-14T11:08:29.910 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:08:29.907+0000 7f25a92629c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.75 2024-09-14T11:08:29.910 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:08:29.907+0000 7f25a92629c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T11:08:29.911 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:08:29.911+0000 7f25a92629c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.75 does not exist 2024-09-14T11:08:29.911 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:08:29.911+0000 7f25a92629c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.76 2024-09-14T11:08:29.911 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:08:29.911+0000 7f25a92629c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T11:08:29.911 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:08:29.911+0000 7f25a92629c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.76 does not exist 2024-09-14T11:08:29.911 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:08:29.911+0000 7f25a92629c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.77 2024-09-14T11:08:29.911 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:08:29.911+0000 7f25a92629c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T11:08:29.912 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:08:29.911+0000 7f25a92629c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.77 does not exist 2024-09-14T11:08:29.912 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:08:29.911+0000 7f25a92629c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.78 2024-09-14T11:08:29.912 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:08:29.911+0000 7f25a92629c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T11:08:29.913 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:08:29.911+0000 7f25a92629c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.78 does not exist 2024-09-14T11:08:29.913 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:08:29.911+0000 7f25a92629c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.79 2024-09-14T11:08:29.913 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:08:29.911+0000 7f25a92629c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T11:08:29.913 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:08:29.911+0000 7f25a92629c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.79 does not exist 2024-09-14T11:08:29.913 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:08:29.911+0000 7f25a92629c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.80 2024-09-14T11:08:29.913 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:08:29.911+0000 7f25a92629c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T11:08:29.914 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:08:29.915+0000 7f25a92629c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.80 does not exist 2024-09-14T11:08:29.914 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:08:29.915+0000 7f25a92629c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.81 2024-09-14T11:08:29.914 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:08:29.915+0000 7f25a92629c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T11:08:29.915 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:08:29.915+0000 7f25a92629c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.81 does not exist 2024-09-14T11:08:29.915 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:08:29.915+0000 7f25a92629c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.82 2024-09-14T11:08:29.915 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:08:29.915+0000 7f25a92629c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T11:08:29.915 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:08:29.915+0000 7f25a92629c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.82 does not exist 2024-09-14T11:08:29.916 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:08:29.915+0000 7f25a92629c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.83 2024-09-14T11:08:29.916 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:08:29.915+0000 7f25a92629c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T11:08:29.916 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:08:29.915+0000 7f25a92629c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.83 does not exist 2024-09-14T11:08:29.916 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:08:29.915+0000 7f25a92629c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.84 2024-09-14T11:08:29.916 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:08:29.915+0000 7f25a92629c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T11:08:29.917 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:08:29.915+0000 7f25a92629c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.84 does not exist 2024-09-14T11:08:29.917 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:08:29.915+0000 7f25a92629c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.85 2024-09-14T11:08:29.917 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:08:29.915+0000 7f25a92629c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T11:08:29.918 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:08:29.915+0000 7f25a92629c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.85 does not exist 2024-09-14T11:08:29.918 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:08:29.915+0000 7f25a92629c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.86 2024-09-14T11:08:29.918 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:08:29.915+0000 7f25a92629c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T11:08:29.918 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:08:29.919+0000 7f25a92629c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.86 does not exist 2024-09-14T11:08:29.919 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:08:29.919+0000 7f25a92629c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.87 2024-09-14T11:08:29.919 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:08:29.919+0000 7f25a92629c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T11:08:29.920 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:08:29.919+0000 7f25a92629c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.87 does not exist 2024-09-14T11:08:29.920 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:08:29.919+0000 7f25a92629c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.88 2024-09-14T11:08:29.920 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:08:29.919+0000 7f25a92629c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T11:08:29.920 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:08:29.919+0000 7f25a92629c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.88 does not exist 2024-09-14T11:08:29.920 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:08:29.919+0000 7f25a92629c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.89 2024-09-14T11:08:29.920 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:08:29.919+0000 7f25a92629c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T11:08:29.921 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:08:29.919+0000 7f25a92629c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.89 does not exist 2024-09-14T11:08:29.921 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:08:29.919+0000 7f25a92629c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.90 2024-09-14T11:08:29.921 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:08:29.919+0000 7f25a92629c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T11:08:29.921 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:08:29.919+0000 7f25a92629c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.90 does not exist 2024-09-14T11:08:29.921 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:08:29.919+0000 7f25a92629c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.91 2024-09-14T11:08:29.921 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:08:29.919+0000 7f25a92629c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T11:08:29.922 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:08:29.923+0000 7f25a92629c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.91 does not exist 2024-09-14T11:08:29.922 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:08:29.923+0000 7f25a92629c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.92 2024-09-14T11:08:29.922 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:08:29.923+0000 7f25a92629c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T11:08:29.922 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:08:29.923+0000 7f25a92629c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.92 does not exist 2024-09-14T11:08:29.923 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:08:29.923+0000 7f25a92629c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.93 2024-09-14T11:08:29.923 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:08:29.923+0000 7f25a92629c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T11:08:29.923 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:08:29.923+0000 7f25a92629c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.93 does not exist 2024-09-14T11:08:29.923 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:08:29.923+0000 7f25a92629c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.94 2024-09-14T11:08:29.923 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:08:29.923+0000 7f25a92629c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T11:08:29.924 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:08:29.923+0000 7f25a92629c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.94 does not exist 2024-09-14T11:08:29.924 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:08:29.923+0000 7f25a92629c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.95 2024-09-14T11:08:29.924 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:08:29.923+0000 7f25a92629c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T11:08:29.925 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:08:29.923+0000 7f25a92629c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.95 does not exist 2024-09-14T11:08:29.925 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:08:29.923+0000 7f25a92629c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.96 2024-09-14T11:08:29.925 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:08:29.923+0000 7f25a92629c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T11:08:29.926 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:08:29.923+0000 7f25a92629c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.96 does not exist 2024-09-14T11:08:29.926 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:08:29.923+0000 7f25a92629c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.97 2024-09-14T11:08:29.926 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:08:29.923+0000 7f25a92629c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T11:08:29.927 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:08:29.927+0000 7f25a92629c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.97 does not exist 2024-09-14T11:08:29.927 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:08:29.927+0000 7f25a92629c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.98 2024-09-14T11:08:29.927 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:08:29.927+0000 7f25a92629c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T11:08:29.927 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:08:29.927+0000 7f25a92629c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.98 does not exist 2024-09-14T11:08:29.927 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:08:29.927+0000 7f25a92629c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.99 2024-09-14T11:08:29.927 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:08:29.927+0000 7f25a92629c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T11:08:29.928 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:08:29.927+0000 7f25a92629c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.99 does not exist 2024-09-14T11:08:29.928 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:08:29.927+0000 7f25a92629c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.100 2024-09-14T11:08:29.928 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:08:29.927+0000 7f25a92629c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T11:08:29.929 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:08:29.927+0000 7f25a92629c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.100 does not exist 2024-09-14T11:08:29.929 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:08:29.927+0000 7f25a92629c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.101 2024-09-14T11:08:29.929 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:08:29.927+0000 7f25a92629c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T11:08:29.929 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:08:29.927+0000 7f25a92629c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.101 does not exist 2024-09-14T11:08:29.929 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:08:29.927+0000 7f25a92629c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.102 2024-09-14T11:08:29.930 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:08:29.927+0000 7f25a92629c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T11:08:29.930 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:08:29.931+0000 7f25a92629c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.102 does not exist 2024-09-14T11:08:29.930 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:08:29.931+0000 7f25a92629c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.103 2024-09-14T11:08:29.930 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:08:29.931+0000 7f25a92629c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T11:08:29.931 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:08:29.931+0000 7f25a92629c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.103 does not exist 2024-09-14T11:08:29.931 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:08:29.931+0000 7f25a92629c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.104 2024-09-14T11:08:29.931 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:08:29.931+0000 7f25a92629c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T11:08:29.931 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:08:29.931+0000 7f25a92629c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.104 does not exist 2024-09-14T11:08:29.931 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:08:29.931+0000 7f25a92629c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.105 2024-09-14T11:08:29.931 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:08:29.931+0000 7f25a92629c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T11:08:29.932 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:08:29.931+0000 7f25a92629c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.105 does not exist 2024-09-14T11:08:29.932 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:08:29.931+0000 7f25a92629c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.106 2024-09-14T11:08:29.932 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:08:29.931+0000 7f25a92629c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T11:08:29.932 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:08:29.931+0000 7f25a92629c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.106 does not exist 2024-09-14T11:08:29.933 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:08:29.931+0000 7f25a92629c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.107 2024-09-14T11:08:29.933 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:08:29.931+0000 7f25a92629c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T11:08:29.933 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:08:29.931+0000 7f25a92629c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.107 does not exist 2024-09-14T11:08:29.933 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:08:29.931+0000 7f25a92629c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.108 2024-09-14T11:08:29.933 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:08:29.931+0000 7f25a92629c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T11:08:29.933 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:08:29.931+0000 7f25a92629c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.108 does not exist 2024-09-14T11:08:29.934 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:08:29.931+0000 7f25a92629c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.109 2024-09-14T11:08:29.934 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:08:29.931+0000 7f25a92629c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T11:08:29.934 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:08:29.935+0000 7f25a92629c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.109 does not exist 2024-09-14T11:08:29.934 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:08:29.935+0000 7f25a92629c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.110 2024-09-14T11:08:29.934 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:08:29.935+0000 7f25a92629c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T11:08:29.935 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:08:29.935+0000 7f25a92629c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.110 does not exist 2024-09-14T11:08:29.935 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:08:29.935+0000 7f25a92629c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.111 2024-09-14T11:08:29.935 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:08:29.935+0000 7f25a92629c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T11:08:29.935 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:08:29.935+0000 7f25a92629c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.111 does not exist 2024-09-14T11:08:29.935 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:08:29.935+0000 7f25a92629c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.112 2024-09-14T11:08:29.935 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:08:29.935+0000 7f25a92629c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T11:08:29.936 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:08:29.935+0000 7f25a92629c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.112 does not exist 2024-09-14T11:08:29.936 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:08:29.935+0000 7f25a92629c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.113 2024-09-14T11:08:29.936 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:08:29.935+0000 7f25a92629c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T11:08:29.936 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:08:29.935+0000 7f25a92629c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.113 does not exist 2024-09-14T11:08:29.937 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:08:29.935+0000 7f25a92629c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.114 2024-09-14T11:08:29.937 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:08:29.935+0000 7f25a92629c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T11:08:29.937 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:08:29.935+0000 7f25a92629c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.114 does not exist 2024-09-14T11:08:29.937 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:08:29.935+0000 7f25a92629c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.115 2024-09-14T11:08:29.937 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:08:29.935+0000 7f25a92629c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T11:08:29.938 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:08:29.939+0000 7f25a92629c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.115 does not exist 2024-09-14T11:08:29.938 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:08:29.939+0000 7f25a92629c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.116 2024-09-14T11:08:29.938 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:08:29.939+0000 7f25a92629c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T11:08:29.938 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:08:29.939+0000 7f25a92629c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.116 does not exist 2024-09-14T11:08:29.938 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:08:29.939+0000 7f25a92629c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.117 2024-09-14T11:08:29.938 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:08:29.939+0000 7f25a92629c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T11:08:29.939 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:08:29.939+0000 7f25a92629c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.117 does not exist 2024-09-14T11:08:29.939 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:08:29.939+0000 7f25a92629c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.118 2024-09-14T11:08:29.939 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:08:29.939+0000 7f25a92629c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T11:08:29.939 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:08:29.939+0000 7f25a92629c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.118 does not exist 2024-09-14T11:08:29.940 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:08:29.939+0000 7f25a92629c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.119 2024-09-14T11:08:29.940 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:08:29.939+0000 7f25a92629c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T11:08:29.940 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:08:29.939+0000 7f25a92629c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.119 does not exist 2024-09-14T11:08:29.940 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:08:29.939+0000 7f25a92629c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.120 2024-09-14T11:08:29.940 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:08:29.939+0000 7f25a92629c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T11:08:29.941 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:08:29.939+0000 7f25a92629c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.120 does not exist 2024-09-14T11:08:29.941 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:08:29.939+0000 7f25a92629c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.121 2024-09-14T11:08:29.941 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:08:29.939+0000 7f25a92629c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T11:08:29.941 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:08:29.939+0000 7f25a92629c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.121 does not exist 2024-09-14T11:08:29.941 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:08:29.939+0000 7f25a92629c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.122 2024-09-14T11:08:29.942 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:08:29.939+0000 7f25a92629c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T11:08:29.942 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:08:29.943+0000 7f25a92629c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.122 does not exist 2024-09-14T11:08:29.942 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:08:29.943+0000 7f25a92629c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.123 2024-09-14T11:08:29.942 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:08:29.943+0000 7f25a92629c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T11:08:29.943 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:08:29.943+0000 7f25a92629c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.123 does not exist 2024-09-14T11:08:29.943 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:08:29.943+0000 7f25a92629c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.124 2024-09-14T11:08:29.943 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:08:29.943+0000 7f25a92629c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T11:08:29.943 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:08:29.943+0000 7f25a92629c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.124 does not exist 2024-09-14T11:08:29.943 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:08:29.943+0000 7f25a92629c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.125 2024-09-14T11:08:29.944 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:08:29.943+0000 7f25a92629c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T11:08:29.944 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:08:29.943+0000 7f25a92629c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.125 does not exist 2024-09-14T11:08:29.944 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:08:29.943+0000 7f25a92629c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.126 2024-09-14T11:08:29.944 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:08:29.943+0000 7f25a92629c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T11:08:29.945 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:08:29.943+0000 7f25a92629c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.126 does not exist 2024-09-14T11:08:29.945 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:08:29.943+0000 7f25a92629c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.127 2024-09-14T11:08:29.945 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:08:29.943+0000 7f25a92629c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T11:08:29.946 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:08:29.943+0000 7f25a92629c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.127 does not exist 2024-09-14T11:08:29.946 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:08:29.943+0000 7f25a92629c0 20 static int rgw::cls::fifo::FIFO::create(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, std::optional >, bool, uint64_t, uint64_t):1211 entering 2024-09-14T11:08:29.950 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:08:29.947+0000 7f25a92629c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T11:08:29.959 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:08:29.959+0000 7f24597e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:08:29.960 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:08:29.959+0000 7f25a92629c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:08:29.960 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:08:29.959+0000 7f25a92629c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:08:32.822 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:08:32.818+0000 7f25a92629c0 10 rgw_init_ioctx warning: failed to set recovery_priority on default.rgw.meta 2024-09-14T11:08:32.822 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:08:32.818+0000 7f25a92629c0 5 note: GC not initialized 2024-09-14T11:08:32.834 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:08:32.834+0000 7f23c3fff640 20 reqs_thread_entry: start 2024-09-14T11:08:32.835 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:08:32.834+0000 7f25a92629c0 20 init_complete bucket index max shards: 11 2024-09-14T11:08:32.835 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:08:32.834+0000 7f25a92629c0 20 Filter name: none 2024-09-14T11:08:32.835 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:08:32.834+0000 7f23c1ffb640 20 reqs_thread_entry: start 2024-09-14T11:08:32.886 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:08:32.882+0000 7f24597e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:08:32.892 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:08:32.890+0000 7f25a92629c0 20 remove_watcher() i=0 2024-09-14T11:08:32.892 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:08:32.890+0000 7f25a92629c0 2 removed watcher, disabling cache 2024-09-14T11:08:32.894 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:08:32.894+0000 7f25a92629c0 20 remove_watcher() i=1 2024-09-14T11:08:32.897 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:08:32.894+0000 7f25a92629c0 20 remove_watcher() i=2 2024-09-14T11:08:32.899 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:08:32.898+0000 7f25a92629c0 20 remove_watcher() i=3 2024-09-14T11:08:32.902 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:08:32.898+0000 7f25a92629c0 20 remove_watcher() i=4 2024-09-14T11:08:32.904 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:08:32.902+0000 7f25a92629c0 20 remove_watcher() i=5 2024-09-14T11:08:32.906 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:08:32.906+0000 7f25a92629c0 20 remove_watcher() i=6 2024-09-14T11:08:32.909 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:08:32.906+0000 7f25a92629c0 20 remove_watcher() i=7 2024-09-14T11:08:32.931 INFO:teuthology.orchestra.run.smithi138.stdout:[] 2024-09-14T11:08:32.932 DEBUG:tasks.util.rgw: json result: [] 2024-09-14T11:08:32.932 INFO:tasks.util.rgw:rgwadmin: client.0 : ['zone', 'placement', 'modify', '--rgw-zone', 'default', '--placement-id', 'default-placement', '--compression', 'random'] 2024-09-14T11:08:32.932 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'zone', 'placement', 'modify', '--rgw-zone', 'default', '--placement-id', 'default-placement', '--compression', 'random'] 2024-09-14T11:08:32.932 DEBUG:teuthology.orchestra.run.smithi138:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph zone placement modify --rgw-zone default --placement-id default-placement --compression random 2024-09-14T11:08:32.974 INFO:teuthology.orchestra.run.smithi138.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:08:32.974 INFO:teuthology.orchestra.run.smithi138.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:08:33.005 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:08:33.002+0000 7f32fa1839c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:08:33.005 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:08:33.002+0000 7f32fa1839c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:08:33.009 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:08:33.006+0000 7f31b5ffb640 20 reqs_thread_entry: start 2024-09-14T11:08:33.030 INFO:teuthology.orchestra.run.smithi138.stdout:{"id":"d9e72d30-c60b-4d0d-9267-fdc36392d5ad","name":"default","domain_root":"default.rgw.meta:root","control_pool":"default.rgw.control","gc_pool":"default.rgw.log:gc","lc_pool":"default.rgw.log:lc","log_pool":"default.rgw.log","intent_log_pool":"default.rgw.log:intent","usage_log_pool":"default.rgw.log:usage","roles_pool":"default.rgw.meta:roles","reshard_pool":"default.rgw.log:reshard","user_keys_pool":"default.rgw.meta:users.keys","user_email_pool":"default.rgw.meta:users.email","user_swift_pool":"default.rgw.meta:users.swift","user_uid_pool":"default.rgw.meta:users.uid","otp_pool":"default.rgw.otp","notif_pool":"default.rgw.log:notif","topics_pool":"default.rgw.meta:topics","account_pool":"default.rgw.meta:accounts","group_pool":"default.rgw.meta:groups","system_key":{"access_key":"","secret_key":""},"placement_pools":[{"key":"default-placement","val":{"index_pool":"default.rgw.buckets.index","storage_classes":{"STANDARD":{"data_pool":"default.rgw.buckets.data","compression_type":"random"}},"data_extra_pool":"default.rgw.buckets.non-ec","index_type":0,"inline_data":true}}],"realm_id":""} 2024-09-14T11:08:33.030 DEBUG:tasks.util.rgw: json result: {'id': 'd9e72d30-c60b-4d0d-9267-fdc36392d5ad', 'name': 'default', 'domain_root': 'default.rgw.meta:root', 'control_pool': 'default.rgw.control', 'gc_pool': 'default.rgw.log:gc', 'lc_pool': 'default.rgw.log:lc', 'log_pool': 'default.rgw.log', 'intent_log_pool': 'default.rgw.log:intent', 'usage_log_pool': 'default.rgw.log:usage', 'roles_pool': 'default.rgw.meta:roles', 'reshard_pool': 'default.rgw.log:reshard', 'user_keys_pool': 'default.rgw.meta:users.keys', 'user_email_pool': 'default.rgw.meta:users.email', 'user_swift_pool': 'default.rgw.meta:users.swift', 'user_uid_pool': 'default.rgw.meta:users.uid', 'otp_pool': 'default.rgw.otp', 'notif_pool': 'default.rgw.log:notif', 'topics_pool': 'default.rgw.meta:topics', 'account_pool': 'default.rgw.meta:accounts', 'group_pool': 'default.rgw.meta:groups', 'system_key': {'access_key': '', 'secret_key': ''}, 'placement_pools': [{'key': 'default-placement', 'val': {'index_pool': 'default.rgw.buckets.index', 'storage_classes': {'STANDARD': {'data_pool': 'default.rgw.buckets.data', 'compression_type': 'random'}}, 'data_extra_pool': 'default.rgw.buckets.non-ec', 'index_type': 0, 'inline_data': True}}], 'realm_id': ''} 2024-09-14T11:08:33.030 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'list'] 2024-09-14T11:08:33.030 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'list'] 2024-09-14T11:08:33.031 DEBUG:teuthology.orchestra.run.smithi138:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user list 2024-09-14T11:08:33.104 INFO:teuthology.orchestra.run.smithi138.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:08:33.104 INFO:teuthology.orchestra.run.smithi138.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:08:33.145 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:08:33.142+0000 7f9faace59c0 20 rados->read ofs=0 len=0 2024-09-14T11:08:33.147 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:08:33.146+0000 7f9faace59c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:08:33.147 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:08:33.146+0000 7f9faace59c0 20 realm 2024-09-14T11:08:33.147 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:08:33.146+0000 7f9faace59c0 20 rados->read ofs=0 len=0 2024-09-14T11:08:33.147 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:08:33.146+0000 7f9faace59c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:08:33.147 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:08:33.146+0000 7f9faace59c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:08:33.147 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:08:33.146+0000 7f9faace59c0 20 rados->read ofs=0 len=0 2024-09-14T11:08:33.147 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:08:33.146+0000 7f9faace59c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:08:33.147 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:08:33.146+0000 7f9faace59c0 20 rados->read ofs=0 len=0 2024-09-14T11:08:33.148 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:08:33.146+0000 7f9faace59c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:08:33.149 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:08:33.146+0000 7f9faace59c0 20 rados->read ofs=0 len=0 2024-09-14T11:08:33.149 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:08:33.146+0000 7f9faace59c0 20 rados_obj.operate() r=0 bl.length=1009 2024-09-14T11:08:33.149 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:08:33.146+0000 7f9faace59c0 20 searching for the correct realm 2024-09-14T11:08:33.360 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:08:33.358+0000 7f9fa7fea640 0 -- 172.21.15.138:0/3131992801 >> [v2:172.21.15.154:6808/1468088432,v1:172.21.15.154:6809/1468088432] conn(0x7f9f980d2420 msgr2=0x7f9f980d28a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:08:33.369 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:08:33.366+0000 7f9fa7fea640 0 -- 172.21.15.138:0/3131992801 >> [v2:172.21.15.138:6816/326481658,v1:172.21.15.138:6817/326481658] conn(0x7f9fa0017020 msgr2=0x7f9fa006b970 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:08:33.585 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:08:33.582+0000 7f9faace59c0 20 RGWRados::pool_iterate: got zone_info.d9e72d30-c60b-4d0d-9267-fdc36392d5ad 2024-09-14T11:08:33.585 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:08:33.582+0000 7f9faace59c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:08:33.586 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:08:33.582+0000 7f9faace59c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:08:33.586 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:08:33.582+0000 7f9faace59c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:08:33.586 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:08:33.582+0000 7f9faace59c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:08:33.586 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:08:33.582+0000 7f9faace59c0 20 RGWRados::pool_iterate: got zonegroup_info.65ab941b-da8c-4160-94fb-3672b069d44f 2024-09-14T11:08:33.586 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:08:33.582+0000 7f9faace59c0 20 rados->read ofs=0 len=0 2024-09-14T11:08:33.586 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:08:33.582+0000 7f9faace59c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:08:33.586 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:08:33.582+0000 7f9faace59c0 20 rados->read ofs=0 len=0 2024-09-14T11:08:33.587 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:08:33.586+0000 7f9faace59c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:08:33.587 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:08:33.586+0000 7f9faace59c0 20 rados->read ofs=0 len=0 2024-09-14T11:08:33.587 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:08:33.586+0000 7f9faace59c0 20 rados_obj.operate() r=0 bl.length=436 2024-09-14T11:08:33.588 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:08:33.586+0000 7f9faace59c0 20 zone default found 2024-09-14T11:08:33.588 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:08:33.586+0000 7f9faace59c0 4 Realm: () 2024-09-14T11:08:33.588 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:08:33.586+0000 7f9faace59c0 4 ZoneGroup: default (65ab941b-da8c-4160-94fb-3672b069d44f) 2024-09-14T11:08:33.588 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:08:33.586+0000 7f9faace59c0 4 Zone: default (d9e72d30-c60b-4d0d-9267-fdc36392d5ad) 2024-09-14T11:08:33.588 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:08:33.586+0000 7f9faace59c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:08:33.588 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:08:33.586+0000 7f9faace59c0 20 zonegroup default 2024-09-14T11:08:33.588 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:08:33.586+0000 7f9faace59c0 20 rados->read ofs=0 len=0 2024-09-14T11:08:33.589 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:08:33.586+0000 7f9faace59c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:08:33.589 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:08:33.586+0000 7f9faace59c0 20 rados->read ofs=0 len=0 2024-09-14T11:08:33.589 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:08:33.586+0000 7f9faace59c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:08:33.589 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:08:33.586+0000 7f9faace59c0 20 rados->read ofs=0 len=0 2024-09-14T11:08:33.590 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:08:33.586+0000 7f9faace59c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:08:33.590 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:08:33.586+0000 7f9faace59c0 20 started sync module instance, tier type = 2024-09-14T11:08:33.590 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:08:33.586+0000 7f9faace59c0 20 started zone id=d9e72d30-c60b-4d0d-9267-fdc36392d5ad (name=default) with tier type = 2024-09-14T11:08:33.613 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:08:33.610+0000 7f9faace59c0 20 add_watcher() i=0 2024-09-14T11:08:33.613 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:08:33.610+0000 7f9faace59c0 20 add_watcher() i=1 2024-09-14T11:08:33.613 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:08:33.610+0000 7f9faace59c0 20 add_watcher() i=2 2024-09-14T11:08:33.614 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:08:33.610+0000 7f9faace59c0 20 add_watcher() i=3 2024-09-14T11:08:33.614 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:08:33.610+0000 7f9faace59c0 20 add_watcher() i=4 2024-09-14T11:08:33.614 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:08:33.610+0000 7f9faace59c0 20 add_watcher() i=5 2024-09-14T11:08:33.614 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:08:33.610+0000 7f9faace59c0 20 add_watcher() i=6 2024-09-14T11:08:33.616 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:08:33.614+0000 7f9faace59c0 20 add_watcher() i=7 2024-09-14T11:08:33.616 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:08:33.614+0000 7f9faace59c0 2 all 8 watchers are set, enabling cache 2024-09-14T11:08:33.621 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:08:33.618+0000 7f9e5efdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:08:33.621 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:08:33.618+0000 7f9faace59c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:08:33.621 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:08:33.618+0000 7f9faace59c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:08:33.621 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:08:33.618+0000 7f9faace59c0 5 note: GC not initialized 2024-09-14T11:08:33.622 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:08:33.618+0000 7f9e5dfdb640 20 reqs_thread_entry: start 2024-09-14T11:08:33.622 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:08:33.618+0000 7f9faace59c0 20 init_complete bucket index max shards: 11 2024-09-14T11:08:33.622 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:08:33.618+0000 7f9faace59c0 20 Filter name: none 2024-09-14T11:08:33.622 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:08:33.618+0000 7f9dcf7fe640 20 reqs_thread_entry: start 2024-09-14T11:08:33.643 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:08:33.642+0000 7f9e5efdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:08:33.648 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:08:33.646+0000 7f9faace59c0 20 remove_watcher() i=0 2024-09-14T11:08:33.648 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:08:33.646+0000 7f9faace59c0 2 removed watcher, disabling cache 2024-09-14T11:08:33.650 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:08:33.650+0000 7f9faace59c0 20 remove_watcher() i=1 2024-09-14T11:08:33.652 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:08:33.650+0000 7f9faace59c0 20 remove_watcher() i=2 2024-09-14T11:08:33.654 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:08:33.654+0000 7f9faace59c0 20 remove_watcher() i=3 2024-09-14T11:08:33.657 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:08:33.654+0000 7f9faace59c0 20 remove_watcher() i=4 2024-09-14T11:08:33.658 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:08:33.658+0000 7f9faace59c0 20 remove_watcher() i=5 2024-09-14T11:08:33.660 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:08:33.658+0000 7f9faace59c0 20 remove_watcher() i=6 2024-09-14T11:08:33.661 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:08:33.658+0000 7f9faace59c0 20 remove_watcher() i=7 2024-09-14T11:08:33.677 INFO:teuthology.orchestra.run.smithi138.stdout:[] 2024-09-14T11:08:33.677 DEBUG:tasks.util.rgw: json result: [] 2024-09-14T11:08:33.677 INFO:tasks.rgw:Configuring storage class type = LUKEWARM 2024-09-14T11:08:33.677 INFO:tasks.util.rgw:rgwadmin: client.0 : ['zonegroup', 'placement', 'add', '--rgw-zone', 'default', '--placement-id', 'default-placement', '--storage-class', 'LUKEWARM'] 2024-09-14T11:08:33.678 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'zonegroup', 'placement', 'add', '--rgw-zone', 'default', '--placement-id', 'default-placement', '--storage-class', 'LUKEWARM'] 2024-09-14T11:08:33.678 DEBUG:teuthology.orchestra.run.smithi138:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph zonegroup placement add --rgw-zone default --placement-id default-placement --storage-class LUKEWARM 2024-09-14T11:08:33.760 INFO:teuthology.orchestra.run.smithi138.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:08:33.761 INFO:teuthology.orchestra.run.smithi138.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:08:33.791 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:08:33.790+0000 7f95a6bb89c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:08:33.791 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:08:33.790+0000 7f95a6bb89c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:08:33.795 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:08:33.794+0000 7f940a7fc640 20 reqs_thread_entry: start 2024-09-14T11:08:33.816 INFO:teuthology.orchestra.run.smithi138.stdout:[{"key":"default-placement","val":{"name":"default-placement","tags":[],"storage_classes":["LUKEWARM","STANDARD"]}}] 2024-09-14T11:08:33.817 DEBUG:tasks.util.rgw: json result: [{'key': 'default-placement', 'val': {'name': 'default-placement', 'tags': [], 'storage_classes': ['LUKEWARM', 'STANDARD']}}] 2024-09-14T11:08:33.817 INFO:tasks.util.rgw:rgwadmin: client.0 : ['zone', 'placement', 'add', '--rgw-zone', 'default', '--placement-id', 'default-placement', '--storage-class', 'LUKEWARM', '--data-pool', 'default.rgw.buckets.data.lukewarm'] 2024-09-14T11:08:33.817 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'zone', 'placement', 'add', '--rgw-zone', 'default', '--placement-id', 'default-placement', '--storage-class', 'LUKEWARM', '--data-pool', 'default.rgw.buckets.data.lukewarm'] 2024-09-14T11:08:33.817 DEBUG:teuthology.orchestra.run.smithi138:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph zone placement add --rgw-zone default --placement-id default-placement --storage-class LUKEWARM --data-pool default.rgw.buckets.data.lukewarm 2024-09-14T11:08:33.895 INFO:teuthology.orchestra.run.smithi138.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:08:33.895 INFO:teuthology.orchestra.run.smithi138.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:08:33.924 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:08:33.922+0000 7fa5944af9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:08:33.924 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:08:33.922+0000 7fa5944af9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:08:33.929 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:08:33.926+0000 7fa454fe1640 20 reqs_thread_entry: start 2024-09-14T11:08:33.949 INFO:teuthology.orchestra.run.smithi138.stdout:{"id":"d9e72d30-c60b-4d0d-9267-fdc36392d5ad","name":"default","domain_root":"default.rgw.meta:root","control_pool":"default.rgw.control","gc_pool":"default.rgw.log:gc","lc_pool":"default.rgw.log:lc","log_pool":"default.rgw.log","intent_log_pool":"default.rgw.log:intent","usage_log_pool":"default.rgw.log:usage","roles_pool":"default.rgw.meta:roles","reshard_pool":"default.rgw.log:reshard","user_keys_pool":"default.rgw.meta:users.keys","user_email_pool":"default.rgw.meta:users.email","user_swift_pool":"default.rgw.meta:users.swift","user_uid_pool":"default.rgw.meta:users.uid","otp_pool":"default.rgw.otp","notif_pool":"default.rgw.log:notif","topics_pool":"default.rgw.meta:topics","account_pool":"default.rgw.meta:accounts","group_pool":"default.rgw.meta:groups","system_key":{"access_key":"","secret_key":""},"placement_pools":[{"key":"default-placement","val":{"index_pool":"default.rgw.buckets.index","storage_classes":{"LUKEWARM":{"data_pool":"default.rgw.buckets.data.lukewarm"},"STANDARD":{"data_pool":"default.rgw.buckets.data","compression_type":"random"}},"data_extra_pool":"default.rgw.buckets.non-ec","index_type":0,"inline_data":true}}],"realm_id":""} 2024-09-14T11:08:33.949 DEBUG:tasks.util.rgw: json result: {'id': 'd9e72d30-c60b-4d0d-9267-fdc36392d5ad', 'name': 'default', 'domain_root': 'default.rgw.meta:root', 'control_pool': 'default.rgw.control', 'gc_pool': 'default.rgw.log:gc', 'lc_pool': 'default.rgw.log:lc', 'log_pool': 'default.rgw.log', 'intent_log_pool': 'default.rgw.log:intent', 'usage_log_pool': 'default.rgw.log:usage', 'roles_pool': 'default.rgw.meta:roles', 'reshard_pool': 'default.rgw.log:reshard', 'user_keys_pool': 'default.rgw.meta:users.keys', 'user_email_pool': 'default.rgw.meta:users.email', 'user_swift_pool': 'default.rgw.meta:users.swift', 'user_uid_pool': 'default.rgw.meta:users.uid', 'otp_pool': 'default.rgw.otp', 'notif_pool': 'default.rgw.log:notif', 'topics_pool': 'default.rgw.meta:topics', 'account_pool': 'default.rgw.meta:accounts', 'group_pool': 'default.rgw.meta:groups', 'system_key': {'access_key': '', 'secret_key': ''}, 'placement_pools': [{'key': 'default-placement', 'val': {'index_pool': 'default.rgw.buckets.index', 'storage_classes': {'LUKEWARM': {'data_pool': 'default.rgw.buckets.data.lukewarm'}, 'STANDARD': {'data_pool': 'default.rgw.buckets.data', 'compression_type': 'random'}}, 'data_extra_pool': 'default.rgw.buckets.non-ec', 'index_type': 0, 'inline_data': True}}], 'realm_id': ''} 2024-09-14T11:08:33.950 INFO:tasks.rgw:Configuring storage class type = FROZEN 2024-09-14T11:08:33.950 INFO:tasks.util.rgw:rgwadmin: client.0 : ['zonegroup', 'placement', 'add', '--rgw-zone', 'default', '--placement-id', 'default-placement', '--storage-class', 'FROZEN'] 2024-09-14T11:08:33.950 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'zonegroup', 'placement', 'add', '--rgw-zone', 'default', '--placement-id', 'default-placement', '--storage-class', 'FROZEN'] 2024-09-14T11:08:33.950 DEBUG:teuthology.orchestra.run.smithi138:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph zonegroup placement add --rgw-zone default --placement-id default-placement --storage-class FROZEN 2024-09-14T11:08:34.035 INFO:teuthology.orchestra.run.smithi138.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:08:34.036 INFO:teuthology.orchestra.run.smithi138.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:08:34.064 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:08:34.062+0000 7f588ff4e9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:08:34.064 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:08:34.062+0000 7f588ff4e9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:08:34.067 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:08:34.066+0000 7f5750fe1640 20 reqs_thread_entry: start 2024-09-14T11:08:34.087 INFO:teuthology.orchestra.run.smithi138.stdout:[{"key":"default-placement","val":{"name":"default-placement","tags":[],"storage_classes":["FROZEN","LUKEWARM","STANDARD"]}}] 2024-09-14T11:08:34.087 DEBUG:tasks.util.rgw: json result: [{'key': 'default-placement', 'val': {'name': 'default-placement', 'tags': [], 'storage_classes': ['FROZEN', 'LUKEWARM', 'STANDARD']}}] 2024-09-14T11:08:34.088 INFO:tasks.util.rgw:rgwadmin: client.0 : ['zone', 'placement', 'add', '--rgw-zone', 'default', '--placement-id', 'default-placement', '--storage-class', 'FROZEN', '--data-pool', 'default.rgw.buckets.data.frozen'] 2024-09-14T11:08:34.088 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'zone', 'placement', 'add', '--rgw-zone', 'default', '--placement-id', 'default-placement', '--storage-class', 'FROZEN', '--data-pool', 'default.rgw.buckets.data.frozen'] 2024-09-14T11:08:34.088 DEBUG:teuthology.orchestra.run.smithi138:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph zone placement add --rgw-zone default --placement-id default-placement --storage-class FROZEN --data-pool default.rgw.buckets.data.frozen 2024-09-14T11:08:34.168 INFO:teuthology.orchestra.run.smithi138.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:08:34.168 INFO:teuthology.orchestra.run.smithi138.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:08:34.195 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:08:34.194+0000 7f65cbfc89c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:08:34.195 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:08:34.194+0000 7f65cbfc89c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:08:34.199 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:08:34.198+0000 7f63fffff640 20 reqs_thread_entry: start 2024-09-14T11:08:34.219 INFO:teuthology.orchestra.run.smithi138.stdout:{"id":"d9e72d30-c60b-4d0d-9267-fdc36392d5ad","name":"default","domain_root":"default.rgw.meta:root","control_pool":"default.rgw.control","gc_pool":"default.rgw.log:gc","lc_pool":"default.rgw.log:lc","log_pool":"default.rgw.log","intent_log_pool":"default.rgw.log:intent","usage_log_pool":"default.rgw.log:usage","roles_pool":"default.rgw.meta:roles","reshard_pool":"default.rgw.log:reshard","user_keys_pool":"default.rgw.meta:users.keys","user_email_pool":"default.rgw.meta:users.email","user_swift_pool":"default.rgw.meta:users.swift","user_uid_pool":"default.rgw.meta:users.uid","otp_pool":"default.rgw.otp","notif_pool":"default.rgw.log:notif","topics_pool":"default.rgw.meta:topics","account_pool":"default.rgw.meta:accounts","group_pool":"default.rgw.meta:groups","system_key":{"access_key":"","secret_key":""},"placement_pools":[{"key":"default-placement","val":{"index_pool":"default.rgw.buckets.index","storage_classes":{"FROZEN":{"data_pool":"default.rgw.buckets.data.frozen"},"LUKEWARM":{"data_pool":"default.rgw.buckets.data.lukewarm"},"STANDARD":{"data_pool":"default.rgw.buckets.data","compression_type":"random"}},"data_extra_pool":"default.rgw.buckets.non-ec","index_type":0,"inline_data":true}}],"realm_id":""} 2024-09-14T11:08:34.219 DEBUG:tasks.util.rgw: json result: {'id': 'd9e72d30-c60b-4d0d-9267-fdc36392d5ad', 'name': 'default', 'domain_root': 'default.rgw.meta:root', 'control_pool': 'default.rgw.control', 'gc_pool': 'default.rgw.log:gc', 'lc_pool': 'default.rgw.log:lc', 'log_pool': 'default.rgw.log', 'intent_log_pool': 'default.rgw.log:intent', 'usage_log_pool': 'default.rgw.log:usage', 'roles_pool': 'default.rgw.meta:roles', 'reshard_pool': 'default.rgw.log:reshard', 'user_keys_pool': 'default.rgw.meta:users.keys', 'user_email_pool': 'default.rgw.meta:users.email', 'user_swift_pool': 'default.rgw.meta:users.swift', 'user_uid_pool': 'default.rgw.meta:users.uid', 'otp_pool': 'default.rgw.otp', 'notif_pool': 'default.rgw.log:notif', 'topics_pool': 'default.rgw.meta:topics', 'account_pool': 'default.rgw.meta:accounts', 'group_pool': 'default.rgw.meta:groups', 'system_key': {'access_key': '', 'secret_key': ''}, 'placement_pools': [{'key': 'default-placement', 'val': {'index_pool': 'default.rgw.buckets.index', 'storage_classes': {'FROZEN': {'data_pool': 'default.rgw.buckets.data.frozen'}, 'LUKEWARM': {'data_pool': 'default.rgw.buckets.data.lukewarm'}, 'STANDARD': {'data_pool': 'default.rgw.buckets.data', 'compression_type': 'random'}}, 'data_extra_pool': 'default.rgw.buckets.non-ec', 'index_type': 0, 'inline_data': True}}], 'realm_id': ''} 2024-09-14T11:08:34.220 INFO:tasks.rgw:Starting rgw... 2024-09-14T11:08:34.220 INFO:tasks.rgw:rgw client.0 config is {'ssl certificate': 'rgw.client.0', 'valgrind': ['--tool=memcheck', '--max-threads=1024']} 2024-09-14T11:08:34.220 INFO:tasks.rgw:Using beast as radosgw frontend 2024-09-14T11:08:34.220 DEBUG:teuthology.orchestra.run.smithi138:> sudo echo -n https://smithi138.front.sepia.ceph.com:443 | sudo tee /home/ubuntu/cephtest/url_file 2024-09-14T11:08:34.273 INFO:teuthology.orchestra.run.smithi138.stdout:https://smithi138.front.sepia.ceph.com:443 2024-09-14T11:08:34.274 DEBUG:teuthology.orchestra.run.smithi138:> sudo chown ceph /home/ubuntu/cephtest/url_file 2024-09-14T11:08:34.324 DEBUG:teuthology.orchestra.run.smithi138:> sudo keytool -import -alias smithi138.front.sepia.ceph.com -keystore $(readlink -e $(dirname $(readlink -e $(which keytool)))/../lib/security/cacerts) -file /home/ubuntu/cephtest/ca/rgw.client.0.crt -storepass changeit 2024-09-14T11:08:34.637 INFO:teuthology.orchestra.run.smithi138.stderr:Warning: use -cacerts option to access cacerts keystore 2024-09-14T11:08:34.874 INFO:teuthology.orchestra.run.smithi138.stderr:Certificate was added to keystore 2024-09-14T11:08:34.903 DEBUG:tasks.ceph_manager:running ceph.client.0 under valgrind with args ['cd', '/home/ubuntu/cephtest', Raw('&&'), 'sudo', 'adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'daemon-helper', 'term', 'env', 'OPENSSL_ia32cap=~0x1000000000000000', 'valgrind', '--trace-children=no', '--child-silent-after-fork=yes', '--soname-synonyms=somalloc=*tcmalloc*', '--num-callers=50', '--suppressions=/home/ubuntu/cephtest/valgrind.supp', '--gen-suppressions=all', '--xml=yes', '--xml-file=/var/log/ceph/valgrind/ceph.client.0.log', '--time-stamp=yes', '--vgdb=yes', '--tool=memcheck', '--max-threads=1024'] 2024-09-14T11:08:34.903 INFO:tasks.rgw.client.0:Restarting daemon 2024-09-14T11:08:34.904 DEBUG:teuthology.orchestra.run.smithi138:> cd /home/ubuntu/cephtest && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term env 'OPENSSL_ia32cap=~0x1000000000000000' valgrind --trace-children=no --child-silent-after-fork=yes '--soname-synonyms=somalloc=*tcmalloc*' --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --gen-suppressions=all --xml=yes --xml-file=/var/log/ceph/valgrind/ceph.client.0.log --time-stamp=yes --vgdb=yes --tool=memcheck --max-threads=1024 radosgw --rgw-frontends 'beast ssl_certificate=/home/ubuntu/cephtest/ca/rgw.client.0.crt ssl_port=443' -n client.0 --cluster ceph -k /etc/ceph/ceph.client.0.keyring --log-file /var/log/ceph/rgw.ceph.client.0.log --rgw_ops_log_socket_path /home/ubuntu/cephtest/rgw.opslog.ceph.client.0.sock --foreground | sudo tee /var/log/ceph/rgw.ceph.client.0.stdout 2>&1 2024-09-14T11:08:34.906 INFO:tasks.rgw.client.0:Started 2024-09-14T11:08:34.906 INFO:tasks.rgw:Polling client.0 until it starts accepting connections on https://smithi138.front.sepia.ceph.com:443/ 2024-09-14T11:08:34.906 DEBUG:teuthology.orchestra.run.smithi138:> curl https://smithi138.front.sepia.ceph.com:443/ 2024-09-14T11:08:34.932 DEBUG:teuthology.orchestra.run:got remote process result: 7 2024-09-14T11:08:34.932 INFO:teuthology.orchestra.run.smithi138.stderr: % Total % Received % Xferd Average Speed Time Time Time Current 2024-09-14T11:08:34.932 INFO:teuthology.orchestra.run.smithi138.stderr: Dload Upload Total Spent Left Speed 2024-09-14T11:08:34.932 INFO:teuthology.orchestra.run.smithi138.stderr: 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 2024-09-14T11:08:34.932 INFO:teuthology.orchestra.run.smithi138.stderr:curl: (7) Failed to connect to smithi138.front.sepia.ceph.com port 443 after 0 ms: Connection refused 2024-09-14T11:08:35.933 DEBUG:teuthology.orchestra.run.smithi138:> curl https://smithi138.front.sepia.ceph.com:443/ 2024-09-14T11:08:35.944 INFO:teuthology.orchestra.run.smithi138.stderr: % Total % Received % Xferd Average Speed Time Time Time Current 2024-09-14T11:08:35.944 INFO:teuthology.orchestra.run.smithi138.stderr: Dload Upload Total Spent Left Speed 2024-09-14T11:08:35.944 INFO:teuthology.orchestra.run.smithi138.stderr: 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 2024-09-14T11:08:35.944 INFO:teuthology.orchestra.run.smithi138.stderr:curl: (7) Failed to connect to smithi138.front.sepia.ceph.com port 443 after 0 ms: Connection refused 2024-09-14T11:08:35.945 DEBUG:teuthology.orchestra.run:got remote process result: 7 2024-09-14T11:08:37.946 DEBUG:teuthology.orchestra.run.smithi138:> curl https://smithi138.front.sepia.ceph.com:443/ 2024-09-14T11:08:37.957 INFO:teuthology.orchestra.run.smithi138.stderr: % Total % Received % Xferd Average Speed Time Time Time Current 2024-09-14T11:08:37.957 INFO:teuthology.orchestra.run.smithi138.stderr: Dload Upload Total Spent Left Speed 2024-09-14T11:08:37.957 INFO:teuthology.orchestra.run.smithi138.stderr: 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 2024-09-14T11:08:37.957 INFO:teuthology.orchestra.run.smithi138.stderr:curl: (7) Failed to connect to smithi138.front.sepia.ceph.com port 443 after 0 ms: Connection refused 2024-09-14T11:08:37.958 DEBUG:teuthology.orchestra.run:got remote process result: 7 2024-09-14T11:08:41.959 DEBUG:teuthology.orchestra.run.smithi138:> curl https://smithi138.front.sepia.ceph.com:443/ 2024-09-14T11:08:41.969 INFO:teuthology.orchestra.run.smithi138.stderr: % Total % Received % Xferd Average Speed Time Time Time Current 2024-09-14T11:08:41.969 INFO:teuthology.orchestra.run.smithi138.stderr: Dload Upload Total Spent Left Speed 2024-09-14T11:08:41.970 DEBUG:teuthology.orchestra.run:got remote process result: 7 2024-09-14T11:08:41.970 INFO:teuthology.orchestra.run.smithi138.stderr: 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 2024-09-14T11:08:41.970 INFO:teuthology.orchestra.run.smithi138.stderr:curl: (7) Failed to connect to smithi138.front.sepia.ceph.com port 443 after 0 ms: Connection refused 2024-09-14T11:08:49.972 DEBUG:teuthology.orchestra.run.smithi138:> curl https://smithi138.front.sepia.ceph.com:443/ 2024-09-14T11:08:49.983 DEBUG:teuthology.orchestra.run:got remote process result: 7 2024-09-14T11:08:49.984 INFO:teuthology.orchestra.run.smithi138.stderr: % Total % Received % Xferd Average Speed Time Time Time Current 2024-09-14T11:08:49.984 INFO:teuthology.orchestra.run.smithi138.stderr: Dload Upload Total Spent Left Speed 2024-09-14T11:08:49.984 INFO:teuthology.orchestra.run.smithi138.stderr: 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 2024-09-14T11:08:49.984 INFO:teuthology.orchestra.run.smithi138.stderr:curl: (7) Failed to connect to smithi138.front.sepia.ceph.com port 443 after 0 ms: Connection refused 2024-09-14T11:08:59.916 INFO:tasks.rgw.client.0.smithi138.stdout:2024-09-14T11:08:59.765+0000 8edcf80 -1 ssl_private_key was not found: rgw/cert//default.key 2024-09-14T11:09:05.986 DEBUG:teuthology.orchestra.run.smithi138:> curl https://smithi138.front.sepia.ceph.com:443/ 2024-09-14T11:09:05.997 INFO:teuthology.orchestra.run.smithi138.stderr: % Total % Received % Xferd Average Speed Time Time Time Current 2024-09-14T11:09:05.997 INFO:teuthology.orchestra.run.smithi138.stderr: Dload Upload Total Spent Left Speed 2024-09-14T11:09:07.144 INFO:teuthology.orchestra.run.smithi138.stderr: 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 0 0 0 0 0 0 0 0 --:--:-- 0:00:01 --:--:-- 0 100 187 0 187 0 0 163 0 --:--:-- 0:00:01 --:--:-- 163 2024-09-14T11:09:07.146 INFO:teuthology.orchestra.run.smithi138.stdout:anonymous 2024-09-14T11:09:07.146 INFO:teuthology.run_tasks:Running task tox... 2024-09-14T11:09:07.160 INFO:tasks.tox:Deploying tox from pip... 2024-09-14T11:09:07.161 DEBUG:teuthology.orchestra.run.smithi138:> python3 -m venv /home/ubuntu/cephtest/tox-venv 2024-09-14T11:09:10.068 DEBUG:teuthology.orchestra.run.smithi138:> source /home/ubuntu/cephtest/tox-venv/bin/activate && pip install tox==3.15.0 2024-09-14T11:09:10.764 INFO:teuthology.orchestra.run.smithi138.stdout:Collecting tox==3.15.0 2024-09-14T11:09:10.861 INFO:teuthology.orchestra.run.smithi138.stdout: Downloading tox-3.15.0-py2.py3-none-any.whl (82 kB) 2024-09-14T11:09:10.913 INFO:teuthology.orchestra.run.smithi138.stdout: ---------------------------------------- 82.1/82.1 KB 1.5 MB/s eta 0:00:00 2024-09-14T11:09:11.018 INFO:teuthology.orchestra.run.smithi138.stdout:Collecting toml>=0.9.4 2024-09-14T11:09:11.033 INFO:teuthology.orchestra.run.smithi138.stdout: Downloading toml-0.10.2-py2.py3-none-any.whl (16 kB) 2024-09-14T11:09:11.169 INFO:teuthology.orchestra.run.smithi138.stdout:Collecting packaging>=14 2024-09-14T11:09:11.183 INFO:teuthology.orchestra.run.smithi138.stdout: Downloading packaging-24.1-py3-none-any.whl (53 kB) 2024-09-14T11:09:11.224 INFO:teuthology.orchestra.run.smithi138.stdout: ---------------------------------------- 54.0/54.0 KB 1.2 MB/s eta 0:00:00 2024-09-14T11:09:11.326 INFO:teuthology.orchestra.run.smithi138.stdout:Collecting py<2,>=1.4.17 2024-09-14T11:09:11.342 INFO:teuthology.orchestra.run.smithi138.stdout: Downloading py-1.11.0-py2.py3-none-any.whl (98 kB) 2024-09-14T11:09:11.391 INFO:teuthology.orchestra.run.smithi138.stdout: ---------------------------------------- 98.7/98.7 KB 2.0 MB/s eta 0:00:00 2024-09-14T11:09:11.485 INFO:teuthology.orchestra.run.smithi138.stdout:Collecting pluggy<1,>=0.12.0 2024-09-14T11:09:11.500 INFO:teuthology.orchestra.run.smithi138.stdout: Downloading pluggy-0.13.1-py2.py3-none-any.whl (18 kB) 2024-09-14T11:09:11.646 INFO:teuthology.orchestra.run.smithi138.stdout:Collecting filelock<4,>=3.0.0 2024-09-14T11:09:11.661 INFO:teuthology.orchestra.run.smithi138.stdout: Downloading filelock-3.16.0-py3-none-any.whl (16 kB) 2024-09-14T11:09:11.769 INFO:teuthology.orchestra.run.smithi138.stdout:Collecting six<2,>=1.14.0 2024-09-14T11:09:11.785 INFO:teuthology.orchestra.run.smithi138.stdout: Downloading six-1.16.0-py2.py3-none-any.whl (11 kB) 2024-09-14T11:09:12.091 INFO:teuthology.orchestra.run.smithi138.stdout:Collecting virtualenv!=20.0.0,!=20.0.1,!=20.0.2,!=20.0.3,!=20.0.4,!=20.0.5,!=20.0.6,!=20.0.7,>=16.0.0 2024-09-14T11:09:12.106 INFO:teuthology.orchestra.run.smithi138.stdout: Downloading virtualenv-20.26.4-py3-none-any.whl (6.0 MB) 2024-09-14T11:09:12.606 INFO:teuthology.orchestra.run.smithi138.stdout: ---------------------------------------- 6.0/6.0 MB 12.1 MB/s eta 0:00:00 2024-09-14T11:09:12.771 INFO:teuthology.orchestra.run.smithi138.stdout:Collecting distlib<1,>=0.3.7 2024-09-14T11:09:12.787 INFO:teuthology.orchestra.run.smithi138.stdout: Downloading distlib-0.3.8-py2.py3-none-any.whl (468 kB) 2024-09-14T11:09:12.838 INFO:teuthology.orchestra.run.smithi138.stdout: -------------------------------------- 468.9/468.9 KB 10.0 MB/s eta 0:00:00 2024-09-14T11:09:12.946 INFO:teuthology.orchestra.run.smithi138.stdout:Collecting platformdirs<5,>=3.9.1 2024-09-14T11:09:12.960 INFO:teuthology.orchestra.run.smithi138.stdout: Downloading platformdirs-4.3.3-py3-none-any.whl (18 kB) 2024-09-14T11:09:13.137 INFO:teuthology.orchestra.run.smithi138.stdout:Installing collected packages: distlib, toml, six, py, pluggy, platformdirs, packaging, filelock, virtualenv, tox 2024-09-14T11:09:14.106 INFO:teuthology.orchestra.run.smithi138.stdout:Successfully installed distlib-0.3.8 filelock-3.16.0 packaging-24.1 platformdirs-4.3.3 pluggy-0.13.1 py-1.11.0 six-1.16.0 toml-0.10.2 tox-3.15.0 virtualenv-20.26.4 2024-09-14T11:09:14.201 INFO:teuthology.run_tasks:Running task workunit... 2024-09-14T11:09:14.215 INFO:tasks.workunit:Pulling workunits from ref 1c941a66c1b420259b8fc5ac19e792dbbf60aded 2024-09-14T11:09:14.215 INFO:tasks.workunit:Making a separate scratch dir for every client... 2024-09-14T11:09:14.216 DEBUG:teuthology.orchestra.run.smithi138:> stat -- /home/ubuntu/cephtest/mnt.0 2024-09-14T11:09:14.223 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-14T11:09:14.223 INFO:teuthology.orchestra.run.smithi138.stderr:stat: cannot statx '/home/ubuntu/cephtest/mnt.0': No such file or directory 2024-09-14T11:09:14.223 DEBUG:teuthology.orchestra.run.smithi138:> mkdir -- /home/ubuntu/cephtest/mnt.0 2024-09-14T11:09:14.271 INFO:tasks.workunit:Created dir /home/ubuntu/cephtest/mnt.0 2024-09-14T11:09:14.271 DEBUG:teuthology.orchestra.run.smithi138:> cd -- /home/ubuntu/cephtest/mnt.0 && mkdir -- client.0 2024-09-14T11:09:14.319 INFO:tasks.workunit:timeout=3h 2024-09-14T11:09:14.319 INFO:tasks.workunit:cleanup=True 2024-09-14T11:09:14.320 DEBUG:teuthology.orchestra.run.smithi138:> rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone https://git.ceph.com/ceph.git /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 && git checkout 1c941a66c1b420259b8fc5ac19e792dbbf60aded 2024-09-14T11:09:14.369 INFO:tasks.workunit.client.0.smithi138.stderr:Cloning into '/home/ubuntu/cephtest/clone.client.0'... 2024-09-14T11:10:10.003 INFO:tasks.workunit.client.0.smithi138.stderr:Updating files: 98% (12661/12889) Updating files: 99% (12761/12889) Updating files: 100% (12889/12889) Updating files: 100% (12889/12889), done. 2024-09-14T11:10:10.058 INFO:tasks.workunit.client.0.smithi138.stderr:Note: switching to '1c941a66c1b420259b8fc5ac19e792dbbf60aded'. 2024-09-14T11:10:10.058 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-14T11:10:10.058 INFO:tasks.workunit.client.0.smithi138.stderr:You are in 'detached HEAD' state. You can look around, make experimental 2024-09-14T11:10:10.058 INFO:tasks.workunit.client.0.smithi138.stderr:changes and commit them, and you can discard any commits you make in this 2024-09-14T11:10:10.058 INFO:tasks.workunit.client.0.smithi138.stderr:state without impacting any branches by switching back to a branch. 2024-09-14T11:10:10.058 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-14T11:10:10.059 INFO:tasks.workunit.client.0.smithi138.stderr:If you want to create a new branch to retain commits you create, you may 2024-09-14T11:10:10.059 INFO:tasks.workunit.client.0.smithi138.stderr:do so (now or later) by using -c with the switch command. Example: 2024-09-14T11:10:10.059 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-14T11:10:10.059 INFO:tasks.workunit.client.0.smithi138.stderr: git switch -c 2024-09-14T11:10:10.059 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-14T11:10:10.059 INFO:tasks.workunit.client.0.smithi138.stderr:Or undo this operation with: 2024-09-14T11:10:10.059 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-14T11:10:10.059 INFO:tasks.workunit.client.0.smithi138.stderr: git switch - 2024-09-14T11:10:10.059 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-14T11:10:10.059 INFO:tasks.workunit.client.0.smithi138.stderr:Turn off this advice by setting config variable advice.detachedHead to false 2024-09-14T11:10:10.059 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-14T11:10:10.059 INFO:tasks.workunit.client.0.smithi138.stderr:HEAD is now at 1c941a66c1b Merge pull request #54777 from cbodley/wip-rgw-meta-handlers 2024-09-14T11:10:10.061 DEBUG:teuthology.orchestra.run.smithi138:> cd -- /home/ubuntu/cephtest/clone.client.0/qa/workunits && if test -e Makefile ; then make ; fi && find -executable -type f -printf '%P\0' >/home/ubuntu/cephtest/workunits.list.client.0 2024-09-14T11:10:10.112 INFO:tasks.workunit.client.0.smithi138.stdout:for d in direct_io fs ; do ( cd $d ; make all ) ; done 2024-09-14T11:10:10.114 INFO:tasks.workunit.client.0.smithi138.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-09-14T11:10:10.115 INFO:tasks.workunit.client.0.smithi138.stdout:cc -Wall -Wextra -D_GNU_SOURCE direct_io_test.c -o direct_io_test 2024-09-14T11:10:10.914 INFO:tasks.workunit.client.0.smithi138.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_sync_io.c -o test_sync_io 2024-09-14T11:10:11.011 INFO:tasks.workunit.client.0.smithi138.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_short_dio_read.c -o test_short_dio_read 2024-09-14T11:10:11.063 INFO:tasks.workunit.client.0.smithi138.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-09-14T11:10:11.065 INFO:tasks.workunit.client.0.smithi138.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-09-14T11:10:11.065 INFO:tasks.workunit.client.0.smithi138.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_o_trunc.c -o test_o_trunc 2024-09-14T11:10:11.108 INFO:tasks.workunit.client.0.smithi138.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-09-14T11:10:11.112 DEBUG:teuthology.orchestra.run.smithi138:> set -ex 2024-09-14T11:10:11.113 DEBUG:teuthology.orchestra.run.smithi138:> dd if=/home/ubuntu/cephtest/workunits.list.client.0 of=/dev/stdout 2024-09-14T11:10:11.160 INFO:tasks.workunit:Running workunits matching rgw/run-bucket-check.sh on client.0... 2024-09-14T11:10:11.161 INFO:tasks.workunit:Running workunit rgw/run-bucket-check.sh... 2024-09-14T11:10:11.161 DEBUG:teuthology.orchestra.run.smithi138:workunit test rgw/run-bucket-check.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=1c941a66c1b420259b8fc5ac19e792dbbf60aded TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/run-bucket-check.sh 2024-09-14T11:10:11.213 INFO:tasks.workunit.client.0.smithi138.stderr:++ dirname /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/run-bucket-check.sh 2024-09-14T11:10:11.214 INFO:tasks.workunit.client.0.smithi138.stderr:+ mydir=/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw 2024-09-14T11:10:11.214 INFO:tasks.workunit.client.0.smithi138.stderr:+ python3 -m venv /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw 2024-09-14T11:10:14.110 INFO:tasks.workunit.client.0.smithi138.stderr:+ source /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/bin/activate 2024-09-14T11:10:14.111 INFO:tasks.workunit.client.0.smithi138.stderr:++ deactivate nondestructive 2024-09-14T11:10:14.111 INFO:tasks.workunit.client.0.smithi138.stderr:++ '[' -n '' ']' 2024-09-14T11:10:14.111 INFO:tasks.workunit.client.0.smithi138.stderr:++ '[' -n '' ']' 2024-09-14T11:10:14.111 INFO:tasks.workunit.client.0.smithi138.stderr:++ '[' -n /usr/bin/bash -o -n '' ']' 2024-09-14T11:10:14.111 INFO:tasks.workunit.client.0.smithi138.stderr:++ hash -r 2024-09-14T11:10:14.111 INFO:tasks.workunit.client.0.smithi138.stderr:++ '[' -n '' ']' 2024-09-14T11:10:14.111 INFO:tasks.workunit.client.0.smithi138.stderr:++ unset VIRTUAL_ENV 2024-09-14T11:10:14.111 INFO:tasks.workunit.client.0.smithi138.stderr:++ unset VIRTUAL_ENV_PROMPT 2024-09-14T11:10:14.111 INFO:tasks.workunit.client.0.smithi138.stderr:++ '[' '!' nondestructive = nondestructive ']' 2024-09-14T11:10:14.111 INFO:tasks.workunit.client.0.smithi138.stderr:++ VIRTUAL_ENV=/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw 2024-09-14T11:10:14.112 INFO:tasks.workunit.client.0.smithi138.stderr:++ export VIRTUAL_ENV 2024-09-14T11:10:14.112 INFO:tasks.workunit.client.0.smithi138.stderr:++ _OLD_VIRTUAL_PATH=/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/usr/games:/usr/local/games:/snap/bin:/usr/sbin 2024-09-14T11:10:14.112 INFO:tasks.workunit.client.0.smithi138.stderr:++ PATH=/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/usr/games:/usr/local/games:/snap/bin:/usr/sbin 2024-09-14T11:10:14.112 INFO:tasks.workunit.client.0.smithi138.stderr:++ export PATH 2024-09-14T11:10:14.112 INFO:tasks.workunit.client.0.smithi138.stderr:++ '[' -n '' ']' 2024-09-14T11:10:14.112 INFO:tasks.workunit.client.0.smithi138.stderr:++ '[' -z '' ']' 2024-09-14T11:10:14.112 INFO:tasks.workunit.client.0.smithi138.stderr:++ _OLD_VIRTUAL_PS1= 2024-09-14T11:10:14.112 INFO:tasks.workunit.client.0.smithi138.stderr:++ PS1='(rgw) ' 2024-09-14T11:10:14.112 INFO:tasks.workunit.client.0.smithi138.stderr:++ export PS1 2024-09-14T11:10:14.112 INFO:tasks.workunit.client.0.smithi138.stderr:++ VIRTUAL_ENV_PROMPT='(rgw) ' 2024-09-14T11:10:14.112 INFO:tasks.workunit.client.0.smithi138.stderr:++ export VIRTUAL_ENV_PROMPT 2024-09-14T11:10:14.112 INFO:tasks.workunit.client.0.smithi138.stderr:++ '[' -n /usr/bin/bash -o -n '' ']' 2024-09-14T11:10:14.112 INFO:tasks.workunit.client.0.smithi138.stderr:++ hash -r 2024-09-14T11:10:14.113 INFO:tasks.workunit.client.0.smithi138.stderr:+ pip install pip --upgrade 2024-09-14T11:10:14.498 INFO:tasks.workunit.client.0.smithi138.stdout:Requirement already satisfied: pip in /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages (22.0.2) 2024-09-14T11:10:14.736 INFO:tasks.workunit.client.0.smithi138.stdout:Collecting pip 2024-09-14T11:10:14.832 INFO:tasks.workunit.client.0.smithi138.stdout: Downloading pip-24.2-py3-none-any.whl (1.8 MB) 2024-09-14T11:10:15.125 INFO:tasks.workunit.client.0.smithi138.stdout: ---------------------------------------- 1.8/1.8 MB 6.3 MB/s eta 0:00:00 2024-09-14T11:10:15.200 INFO:tasks.workunit.client.0.smithi138.stdout:Installing collected packages: pip 2024-09-14T11:10:15.200 INFO:tasks.workunit.client.0.smithi138.stdout: Attempting uninstall: pip 2024-09-14T11:10:15.201 INFO:tasks.workunit.client.0.smithi138.stdout: Found existing installation: pip 22.0.2 2024-09-14T11:10:15.496 INFO:tasks.workunit.client.0.smithi138.stdout: Uninstalling pip-22.0.2: 2024-09-14T11:10:15.503 INFO:tasks.workunit.client.0.smithi138.stdout: Successfully uninstalled pip-22.0.2 2024-09-14T11:10:16.541 INFO:tasks.workunit.client.0.smithi138.stdout:Successfully installed pip-24.2 2024-09-14T11:10:16.616 INFO:tasks.workunit.client.0.smithi138.stderr:+ pip install boto3 2024-09-14T11:10:17.727 INFO:tasks.workunit.client.0.smithi138.stdout:Collecting boto3 2024-09-14T11:10:17.771 INFO:tasks.workunit.client.0.smithi138.stdout: Downloading boto3-1.35.19-py3-none-any.whl.metadata (6.6 kB) 2024-09-14T11:10:18.448 INFO:tasks.workunit.client.0.smithi138.stdout:Collecting botocore<1.36.0,>=1.35.19 (from boto3) 2024-09-14T11:10:18.462 INFO:tasks.workunit.client.0.smithi138.stdout: Downloading botocore-1.35.19-py3-none-any.whl.metadata (5.7 kB) 2024-09-14T11:10:18.598 INFO:tasks.workunit.client.0.smithi138.stdout:Collecting jmespath<2.0.0,>=0.7.1 (from boto3) 2024-09-14T11:10:18.613 INFO:tasks.workunit.client.0.smithi138.stdout: Downloading jmespath-1.0.1-py3-none-any.whl.metadata (7.6 kB) 2024-09-14T11:10:18.759 INFO:tasks.workunit.client.0.smithi138.stdout:Collecting s3transfer<0.11.0,>=0.10.0 (from boto3) 2024-09-14T11:10:18.776 INFO:tasks.workunit.client.0.smithi138.stdout: Downloading s3transfer-0.10.2-py3-none-any.whl.metadata (1.7 kB) 2024-09-14T11:10:18.932 INFO:tasks.workunit.client.0.smithi138.stdout:Collecting python-dateutil<3.0.0,>=2.1 (from botocore<1.36.0,>=1.35.19->boto3) 2024-09-14T11:10:18.948 INFO:tasks.workunit.client.0.smithi138.stdout: Downloading python_dateutil-2.9.0.post0-py2.py3-none-any.whl.metadata (8.4 kB) 2024-09-14T11:10:19.190 INFO:tasks.workunit.client.0.smithi138.stdout:Collecting urllib3!=2.2.0,<3,>=1.25.4 (from botocore<1.36.0,>=1.35.19->boto3) 2024-09-14T11:10:19.205 INFO:tasks.workunit.client.0.smithi138.stdout: Downloading urllib3-2.2.3-py3-none-any.whl.metadata (6.5 kB) 2024-09-14T11:10:19.520 INFO:tasks.workunit.client.0.smithi138.stdout:Collecting six>=1.5 (from python-dateutil<3.0.0,>=2.1->botocore<1.36.0,>=1.35.19->boto3) 2024-09-14T11:10:19.534 INFO:tasks.workunit.client.0.smithi138.stdout: Downloading six-1.16.0-py2.py3-none-any.whl.metadata (1.8 kB) 2024-09-14T11:10:19.609 INFO:tasks.workunit.client.0.smithi138.stdout:Downloading boto3-1.35.19-py3-none-any.whl (139 kB) 2024-09-14T11:10:19.698 INFO:tasks.workunit.client.0.smithi138.stdout:Downloading botocore-1.35.19-py3-none-any.whl (12.5 MB) 2024-09-14T11:10:19.956 INFO:tasks.workunit.client.0.smithi138.stdout: ---------------------------------------- 12.5/12.5 MB 50.8 MB/s eta 0:00:00 2024-09-14T11:10:19.976 INFO:tasks.workunit.client.0.smithi138.stdout:Downloading jmespath-1.0.1-py3-none-any.whl (20 kB) 2024-09-14T11:10:20.047 INFO:tasks.workunit.client.0.smithi138.stdout:Downloading s3transfer-0.10.2-py3-none-any.whl (82 kB) 2024-09-14T11:10:20.124 INFO:tasks.workunit.client.0.smithi138.stdout:Downloading python_dateutil-2.9.0.post0-py2.py3-none-any.whl (229 kB) 2024-09-14T11:10:20.188 INFO:tasks.workunit.client.0.smithi138.stdout:Downloading urllib3-2.2.3-py3-none-any.whl (126 kB) 2024-09-14T11:10:20.256 INFO:tasks.workunit.client.0.smithi138.stdout:Downloading six-1.16.0-py2.py3-none-any.whl (11 kB) 2024-09-14T11:10:20.386 INFO:tasks.workunit.client.0.smithi138.stdout:Installing collected packages: urllib3, six, jmespath, python-dateutil, botocore, s3transfer, boto3 2024-09-14T11:10:21.548 INFO:tasks.workunit.client.0.smithi138.stdout:Successfully installed boto3-1.35.19 botocore-1.35.19 jmespath-1.0.1 python-dateutil-2.9.0.post0 s3transfer-0.10.2 six-1.16.0 urllib3-2.2.3 2024-09-14T11:10:21.994 INFO:tasks.workunit.client.0.smithi138.stderr:+ /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/bin/python3 /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/test_rgw_bucket_check.py 2024-09-14T11:10:22.145 INFO:tasks.workunit.client.0.smithi138.stderr:radosgw-admin user create --uid check-tester --display-name "Check Testing" --access-key OJODXSLNX4LUNHQG99PA --secret 3l6ffld34qaymfomuh832j94738aie2x4p2o8h6n 2024-09-14T11:10:22.186 INFO:tasks.workunit.client.0.smithi138.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:10:22.186 INFO:tasks.workunit.client.0.smithi138.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:10:22.229 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:22.231+0000 7fcceea339c0 20 rados->read ofs=0 len=0 2024-09-14T11:10:22.231 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:22.235+0000 7fcceea339c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:10:22.232 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:22.235+0000 7fcceea339c0 20 realm 2024-09-14T11:10:22.232 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:22.235+0000 7fcceea339c0 20 rados->read ofs=0 len=0 2024-09-14T11:10:22.232 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:22.235+0000 7fcceea339c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:10:22.232 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:22.235+0000 7fcceea339c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:10:22.232 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:22.235+0000 7fcceea339c0 20 rados->read ofs=0 len=0 2024-09-14T11:10:22.232 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:22.235+0000 7fcceea339c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:10:22.232 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:22.235+0000 7fcceea339c0 20 rados->read ofs=0 len=0 2024-09-14T11:10:22.233 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:22.235+0000 7fcceea339c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:10:22.233 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:22.235+0000 7fcceea339c0 20 rados->read ofs=0 len=0 2024-09-14T11:10:22.234 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:22.235+0000 7fcceea339c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:10:22.234 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:22.235+0000 7fcceea339c0 20 searching for the correct realm 2024-09-14T11:10:22.238 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:22.239+0000 7fccebd38640 0 -- 172.21.15.138:0/1071367073 >> [v2:172.21.15.154:6808/1468088432,v1:172.21.15.154:6809/1468088432] conn(0x7fccdc064ed0 msgr2=0x7fccdc063940 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-14T11:10:22.245 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:22.247+0000 7fccebd38640 0 -- 172.21.15.138:0/1071367073 >> [v2:172.21.15.138:6816/326481658,v1:172.21.15.138:6817/326481658] conn(0x7fcce41033c0 msgr2=0x7fcce40022e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-14T11:10:22.460 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:22.463+0000 7fcceea339c0 20 RGWRados::pool_iterate: got zone_info.d9e72d30-c60b-4d0d-9267-fdc36392d5ad 2024-09-14T11:10:22.461 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:22.463+0000 7fcceea339c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:10:22.461 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:22.463+0000 7fcceea339c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:10:22.461 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:22.463+0000 7fcceea339c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:10:22.461 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:22.463+0000 7fcceea339c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:10:22.461 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:22.463+0000 7fcceea339c0 20 RGWRados::pool_iterate: got zonegroup_info.65ab941b-da8c-4160-94fb-3672b069d44f 2024-09-14T11:10:22.461 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:22.463+0000 7fcceea339c0 20 rados->read ofs=0 len=0 2024-09-14T11:10:22.461 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:22.463+0000 7fcceea339c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:10:22.461 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:22.463+0000 7fcceea339c0 20 rados->read ofs=0 len=0 2024-09-14T11:10:22.462 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:22.463+0000 7fcceea339c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:10:22.462 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:22.463+0000 7fcceea339c0 20 rados->read ofs=0 len=0 2024-09-14T11:10:22.463 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:22.463+0000 7fcceea339c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:10:22.463 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:22.463+0000 7fcceea339c0 20 zone default found 2024-09-14T11:10:22.463 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:22.463+0000 7fcceea339c0 4 Realm: () 2024-09-14T11:10:22.463 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:22.463+0000 7fcceea339c0 4 ZoneGroup: default (65ab941b-da8c-4160-94fb-3672b069d44f) 2024-09-14T11:10:22.463 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:22.463+0000 7fcceea339c0 4 Zone: default (d9e72d30-c60b-4d0d-9267-fdc36392d5ad) 2024-09-14T11:10:22.463 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:22.463+0000 7fcceea339c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:10:22.463 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:22.463+0000 7fcceea339c0 20 zonegroup default 2024-09-14T11:10:22.463 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:22.463+0000 7fcceea339c0 20 rados->read ofs=0 len=0 2024-09-14T11:10:22.464 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:22.467+0000 7fcceea339c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:10:22.464 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:22.467+0000 7fcceea339c0 20 rados->read ofs=0 len=0 2024-09-14T11:10:22.464 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:22.467+0000 7fcceea339c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:10:22.464 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:22.467+0000 7fcceea339c0 20 rados->read ofs=0 len=0 2024-09-14T11:10:22.465 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:22.467+0000 7fcceea339c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:10:22.465 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:22.467+0000 7fcceea339c0 20 started sync module instance, tier type = 2024-09-14T11:10:22.465 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:22.467+0000 7fcceea339c0 20 started zone id=d9e72d30-c60b-4d0d-9267-fdc36392d5ad (name=default) with tier type = 2024-09-14T11:10:22.493 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:22.495+0000 7fcceea339c0 20 add_watcher() i=0 2024-09-14T11:10:22.493 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:22.495+0000 7fcceea339c0 20 add_watcher() i=1 2024-09-14T11:10:22.493 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:22.495+0000 7fcceea339c0 20 add_watcher() i=2 2024-09-14T11:10:22.493 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:22.495+0000 7fcceea339c0 20 add_watcher() i=3 2024-09-14T11:10:22.494 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:22.495+0000 7fcceea339c0 20 add_watcher() i=4 2024-09-14T11:10:22.494 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:22.495+0000 7fcceea339c0 20 add_watcher() i=5 2024-09-14T11:10:22.494 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:22.495+0000 7fcceea339c0 20 add_watcher() i=6 2024-09-14T11:10:22.495 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:22.499+0000 7fcceea339c0 20 add_watcher() i=7 2024-09-14T11:10:22.495 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:22.499+0000 7fcceea339c0 2 all 8 watchers are set, enabling cache 2024-09-14T11:10:22.500 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:22.503+0000 7fcba2fdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:10:22.501 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:22.503+0000 7fcceea339c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:10:22.501 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:22.503+0000 7fcceea339c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:10:22.501 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:22.503+0000 7fcceea339c0 5 note: GC not initialized 2024-09-14T11:10:22.502 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:22.503+0000 7fcba1fdb640 20 reqs_thread_entry: start 2024-09-14T11:10:22.502 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:22.503+0000 7fcceea339c0 20 init_complete bucket index max shards: 11 2024-09-14T11:10:22.502 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:22.503+0000 7fcceea339c0 20 Filter name: none 2024-09-14T11:10:22.502 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:22.503+0000 7fcb137fe640 20 reqs_thread_entry: start 2024-09-14T11:10:22.502 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:22.503+0000 7fcceea339c0 10 cache get: name=default.rgw.meta+users.uid+check-tester : miss 2024-09-14T11:10:22.502 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:22.503+0000 7fcceea339c0 20 rados->read ofs=0 len=0 2024-09-14T11:10:22.503 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:22.507+0000 7fcceea339c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:10:22.503 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:22.507+0000 7fcceea339c0 10 cache put: name=default.rgw.meta+users.uid+check-tester info.flags=0x0 2024-09-14T11:10:22.503 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:22.507+0000 7fcceea339c0 10 adding default.rgw.meta+users.uid+check-tester to cache LRU end 2024-09-14T11:10:22.503 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:22.507+0000 7fcceea339c0 10 cache get: name=default.rgw.meta+users.keys+OJODXSLNX4LUNHQG99PA : miss 2024-09-14T11:10:22.503 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:22.507+0000 7fcceea339c0 20 rados->read ofs=0 len=0 2024-09-14T11:10:22.504 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:22.507+0000 7fcceea339c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:10:22.504 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:22.507+0000 7fcceea339c0 10 cache put: name=default.rgw.meta+users.keys+OJODXSLNX4LUNHQG99PA info.flags=0x0 2024-09-14T11:10:22.504 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:22.507+0000 7fcceea339c0 10 adding default.rgw.meta+users.keys+OJODXSLNX4LUNHQG99PA to cache LRU end 2024-09-14T11:10:22.504 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:22.507+0000 7fcceea339c0 10 cache get: name=default.rgw.meta+users.keys+OJODXSLNX4LUNHQG99PA : hit (negative entry) 2024-09-14T11:10:22.505 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:22.507+0000 7fcceea339c0 10 cache get: name=default.rgw.meta+users.keys+OJODXSLNX4LUNHQG99PA : hit (negative entry) 2024-09-14T11:10:22.508 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:22.511+0000 7fcceea339c0 10 cache put: name=default.rgw.meta+users.uid+check-tester info.flags=0x17 2024-09-14T11:10:22.508 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:22.511+0000 7fcceea339c0 10 moving default.rgw.meta+users.uid+check-tester to cache LRU end 2024-09-14T11:10:22.508 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:22.511+0000 7fcceea339c0 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:users.uid:check-tester, ofs0, ns] 2024-09-14T11:10:22.509 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:22.511+0000 7fcbc37fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 171798691840 cookie 93958178569040 notifier 4581 bl.length()=593 2024-09-14T11:10:22.509 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:22.511+0000 7fcbc37fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+check-tester info.flags=0x17 2024-09-14T11:10:22.509 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:22.511+0000 7fcbc37fe640 10 rgw watcher librados: moving default.rgw.meta+users.uid+check-tester to cache LRU end 2024-09-14T11:10:22.565 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:22.567+0000 7fcceea339c0 10 cache put: name=default.rgw.meta+users.keys+OJODXSLNX4LUNHQG99PA info.flags=0x7 2024-09-14T11:10:22.565 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:22.567+0000 7fcceea339c0 10 moving default.rgw.meta+users.keys+OJODXSLNX4LUNHQG99PA to cache LRU end 2024-09-14T11:10:22.565 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:22.567+0000 7fcceea339c0 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 0, obj: default.rgw.meta:users.keys:OJODXSLNX4LUNHQG99PA, ofs0, ns] 2024-09-14T11:10:22.566 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:22.567+0000 7fcbc37fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 171798691840 cookie 93958178561360 notifier 4581 bl.length()=186 2024-09-14T11:10:22.566 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:22.567+0000 7fcbc37fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.keys+OJODXSLNX4LUNHQG99PA info.flags=0x7 2024-09-14T11:10:22.566 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:22.567+0000 7fcbc37fe640 10 rgw watcher librados: moving default.rgw.meta+users.keys+OJODXSLNX4LUNHQG99PA to cache LRU end 2024-09-14T11:10:22.571 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:22.575+0000 7fcba2fdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:10:22.577 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:22.579+0000 7fcceea339c0 20 remove_watcher() i=0 2024-09-14T11:10:22.577 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:22.579+0000 7fcceea339c0 2 removed watcher, disabling cache 2024-09-14T11:10:22.580 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:22.583+0000 7fcceea339c0 20 remove_watcher() i=1 2024-09-14T11:10:22.582 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:22.583+0000 7fcceea339c0 20 remove_watcher() i=2 2024-09-14T11:10:22.585 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:22.587+0000 7fcceea339c0 20 remove_watcher() i=3 2024-09-14T11:10:22.587 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:22.591+0000 7fcceea339c0 20 remove_watcher() i=4 2024-09-14T11:10:22.589 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:22.591+0000 7fcceea339c0 20 remove_watcher() i=5 2024-09-14T11:10:22.591 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:22.595+0000 7fcceea339c0 20 remove_watcher() i=6 2024-09-14T11:10:22.593 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:22.595+0000 7fcceea339c0 20 remove_watcher() i=7 2024-09-14T11:10:22.892 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:10:22.892 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-14T11:10:23.153 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:10:23.153 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-14T11:10:23.325 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:10:23.325 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-14T11:10:23.923 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:10:23.923 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-14T11:10:24.539 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:10:24.539 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-14T11:10:24.797 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:10:24.797 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-14T11:10:24.966 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:10:24.967 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-14T11:10:25.043 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:10:25.043 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-14T11:10:25.210 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:10:25.210 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-14T11:10:25.617 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:10:25.617 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-14T11:10:25.721 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:10:25.721 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-14T11:10:25.882 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:10:25.882 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-14T11:10:25.958 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:10:25.958 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-14T11:10:26.107 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:10:26.107 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-14T11:10:26.185 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:10:26.185 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-14T11:10:26.332 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:10:26.332 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-14T11:10:26.402 INFO:tasks.workunit.client.0.smithi138.stderr:TEST: recalculated bucket check stats are correct 2024-09-14T11:10:26.402 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-14T11:10:26.402 INFO:tasks.workunit.client.0.smithi138.stderr:radosgw-admin bucket check --fix --bucket check-bucket 2024-09-14T11:10:26.437 INFO:tasks.workunit.client.0.smithi138.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:10:26.437 INFO:tasks.workunit.client.0.smithi138.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:10:26.482 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:26.483+0000 7f8a28b5a9c0 20 rados->read ofs=0 len=0 2024-09-14T11:10:26.484 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:26.487+0000 7f8a28b5a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:10:26.484 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:26.487+0000 7f8a28b5a9c0 20 realm 2024-09-14T11:10:26.484 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:26.487+0000 7f8a28b5a9c0 20 rados->read ofs=0 len=0 2024-09-14T11:10:26.485 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:26.487+0000 7f8a28b5a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:10:26.485 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:26.487+0000 7f8a28b5a9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:10:26.485 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:26.487+0000 7f8a28b5a9c0 20 rados->read ofs=0 len=0 2024-09-14T11:10:26.485 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:26.487+0000 7f8a28b5a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:10:26.485 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:26.487+0000 7f8a28b5a9c0 20 rados->read ofs=0 len=0 2024-09-14T11:10:26.486 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:26.487+0000 7f8a28b5a9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:10:26.486 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:26.487+0000 7f8a28b5a9c0 20 rados->read ofs=0 len=0 2024-09-14T11:10:26.487 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:26.487+0000 7f8a28b5a9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:10:26.487 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:26.487+0000 7f8a28b5a9c0 20 searching for the correct realm 2024-09-14T11:10:26.490 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:26.491+0000 7f8a26e61640 0 -- 172.21.15.138:0/1236093642 >> [v2:172.21.15.154:6824/416768175,v1:172.21.15.154:6825/416768175] conn(0x7f8a2003fb90 msgr2=0x7f8a20047ac0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:10:26.704 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:26.707+0000 7f8a25e5f640 0 -- 172.21.15.138:0/1236093642 >> [v2:172.21.15.138:6816/326481658,v1:172.21.15.138:6817/326481658] conn(0x7f8a20096650 msgr2=0x7f8a20066dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-14T11:10:26.924 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:26.927+0000 7f8a28b5a9c0 20 RGWRados::pool_iterate: got zone_info.d9e72d30-c60b-4d0d-9267-fdc36392d5ad 2024-09-14T11:10:26.924 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:26.927+0000 7f8a28b5a9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:10:26.924 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:26.927+0000 7f8a28b5a9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:10:26.924 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:26.927+0000 7f8a28b5a9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:10:26.924 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:26.927+0000 7f8a28b5a9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:10:26.924 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:26.927+0000 7f8a28b5a9c0 20 RGWRados::pool_iterate: got zonegroup_info.65ab941b-da8c-4160-94fb-3672b069d44f 2024-09-14T11:10:26.924 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:26.927+0000 7f8a28b5a9c0 20 rados->read ofs=0 len=0 2024-09-14T11:10:26.925 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:26.927+0000 7f8a28b5a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:10:26.925 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:26.927+0000 7f8a28b5a9c0 20 rados->read ofs=0 len=0 2024-09-14T11:10:26.925 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:26.927+0000 7f8a28b5a9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:10:26.925 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:26.927+0000 7f8a28b5a9c0 20 rados->read ofs=0 len=0 2024-09-14T11:10:26.926 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:26.927+0000 7f8a28b5a9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:10:26.926 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:26.927+0000 7f8a28b5a9c0 20 zone default found 2024-09-14T11:10:26.926 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:26.927+0000 7f8a28b5a9c0 4 Realm: () 2024-09-14T11:10:26.926 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:26.927+0000 7f8a28b5a9c0 4 ZoneGroup: default (65ab941b-da8c-4160-94fb-3672b069d44f) 2024-09-14T11:10:26.927 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:26.927+0000 7f8a28b5a9c0 4 Zone: default (d9e72d30-c60b-4d0d-9267-fdc36392d5ad) 2024-09-14T11:10:26.927 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:26.927+0000 7f8a28b5a9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:10:26.927 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:26.927+0000 7f8a28b5a9c0 20 zonegroup default 2024-09-14T11:10:26.927 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:26.927+0000 7f8a28b5a9c0 20 rados->read ofs=0 len=0 2024-09-14T11:10:26.927 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:26.931+0000 7f8a28b5a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:10:26.927 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:26.931+0000 7f8a28b5a9c0 20 rados->read ofs=0 len=0 2024-09-14T11:10:26.928 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:26.931+0000 7f8a28b5a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:10:26.928 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:26.931+0000 7f8a28b5a9c0 20 rados->read ofs=0 len=0 2024-09-14T11:10:26.929 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:26.931+0000 7f8a28b5a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:10:26.929 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:26.931+0000 7f8a28b5a9c0 20 started sync module instance, tier type = 2024-09-14T11:10:26.929 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:26.931+0000 7f8a28b5a9c0 20 started zone id=d9e72d30-c60b-4d0d-9267-fdc36392d5ad (name=default) with tier type = 2024-09-14T11:10:26.956 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:26.959+0000 7f8a28b5a9c0 20 add_watcher() i=0 2024-09-14T11:10:26.956 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:26.959+0000 7f8a28b5a9c0 20 add_watcher() i=1 2024-09-14T11:10:26.956 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:26.959+0000 7f8a28b5a9c0 20 add_watcher() i=2 2024-09-14T11:10:26.956 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:26.959+0000 7f8a28b5a9c0 20 add_watcher() i=3 2024-09-14T11:10:26.956 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:26.959+0000 7f8a28b5a9c0 20 add_watcher() i=4 2024-09-14T11:10:26.956 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:26.959+0000 7f8a28b5a9c0 20 add_watcher() i=5 2024-09-14T11:10:26.956 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:26.959+0000 7f8a28b5a9c0 20 add_watcher() i=6 2024-09-14T11:10:26.958 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:26.959+0000 7f8a28b5a9c0 20 add_watcher() i=7 2024-09-14T11:10:26.958 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:26.959+0000 7f8a28b5a9c0 2 all 8 watchers are set, enabling cache 2024-09-14T11:10:26.962 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:26.963+0000 7f88d77fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:10:26.963 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:26.967+0000 7f8a28b5a9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:10:26.963 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:26.967+0000 7f8a28b5a9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:10:26.963 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:26.967+0000 7f8a28b5a9c0 5 note: GC not initialized 2024-09-14T11:10:26.964 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:26.967+0000 7f88d67fc640 20 reqs_thread_entry: start 2024-09-14T11:10:26.964 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:26.967+0000 7f8a28b5a9c0 20 init_complete bucket index max shards: 11 2024-09-14T11:10:26.965 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:26.967+0000 7f8a28b5a9c0 20 Filter name: none 2024-09-14T11:10:26.966 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:26.967+0000 7f8847fff640 20 reqs_thread_entry: start 2024-09-14T11:10:26.966 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:26.967+0000 7f8a28b5a9c0 10 cache get: name=default.rgw.meta+root+check-bucket : miss 2024-09-14T11:10:26.966 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:26.967+0000 7f8a28b5a9c0 20 rados->read ofs=0 len=0 2024-09-14T11:10:26.966 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:26.967+0000 7f8a28b5a9c0 20 rados_obj.operate() r=0 bl.length=190 2024-09-14T11:10:26.966 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:26.967+0000 7f8a28b5a9c0 10 cache put: name=default.rgw.meta+root+check-bucket info.flags=0x11 2024-09-14T11:10:26.966 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:26.967+0000 7f8a28b5a9c0 10 adding default.rgw.meta+root+check-bucket to cache LRU end 2024-09-14T11:10:26.966 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:26.967+0000 7f8a28b5a9c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.check-bucket:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.1 : miss 2024-09-14T11:10:26.966 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:26.967+0000 7f8a28b5a9c0 20 rados->read ofs=0 len=0 2024-09-14T11:10:26.967 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:26.967+0000 7f8a28b5a9c0 20 rados_obj.operate() r=0 bl.length=412 2024-09-14T11:10:26.967 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:26.967+0000 7f8a28b5a9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.check-bucket:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.1 info.flags=0x17 2024-09-14T11:10:26.967 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:26.967+0000 7f8a28b5a9c0 10 adding default.rgw.meta+root+.bucket.meta.check-bucket:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.1 to cache LRU end 2024-09-14T11:10:26.967 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:26.967+0000 7f8a28b5a9c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:10:26.967 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:26.967+0000 7f8a28b5a9c0 10 updating xattr: name=user.rgw.acl bl.length()=179 2024-09-14T11:10:26.967 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:26.967+0000 7f8a28b5a9c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.check-bucket:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.1 2024-09-14T11:10:26.967 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:26.967+0000 7f8a28b5a9c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.1.0 2024-09-14T11:10:26.968 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:26.971+0000 7f8a28b5a9c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.1.1 2024-09-14T11:10:26.970 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:26.971+0000 7f8a28b5a9c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.1.2 2024-09-14T11:10:26.970 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:26.971+0000 7f8a28b5a9c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.1.3 2024-09-14T11:10:26.972 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:26.975+0000 7f8a28b5a9c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.1.4 2024-09-14T11:10:26.973 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:26.975+0000 7f8a28b5a9c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.1.5 2024-09-14T11:10:26.974 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:26.975+0000 7f8a28b5a9c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.1.6 2024-09-14T11:10:26.975 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:26.979+0000 7f8a28b5a9c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.1.7 2024-09-14T11:10:26.977 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:26.979+0000 7f8a28b5a9c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.1.8 2024-09-14T11:10:26.978 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:26.979+0000 7f8a28b5a9c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.1.9 2024-09-14T11:10:26.980 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:26.983+0000 7f8a28b5a9c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.1.10 2024-09-14T11:10:26.990 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:26.991+0000 7f88d77fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:10:26.995 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:26.999+0000 7f8a28b5a9c0 20 remove_watcher() i=0 2024-09-14T11:10:26.995 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:26.999+0000 7f8a28b5a9c0 2 removed watcher, disabling cache 2024-09-14T11:10:26.998 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:26.999+0000 7f8a28b5a9c0 20 remove_watcher() i=1 2024-09-14T11:10:27.000 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:27.003+0000 7f8a28b5a9c0 20 remove_watcher() i=2 2024-09-14T11:10:27.003 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:27.003+0000 7f8a28b5a9c0 20 remove_watcher() i=3 2024-09-14T11:10:27.005 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:27.007+0000 7f8a28b5a9c0 20 remove_watcher() i=4 2024-09-14T11:10:27.006 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:27.007+0000 7f8a28b5a9c0 20 remove_watcher() i=5 2024-09-14T11:10:27.008 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:27.011+0000 7f8a28b5a9c0 20 remove_watcher() i=6 2024-09-14T11:10:27.009 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:27.011+0000 7f8a28b5a9c0 20 remove_watcher() i=7 2024-09-14T11:10:27.025 INFO:tasks.workunit.client.0.smithi138.stderr:radosgw-admin bucket stats --bucket check-bucket 2024-09-14T11:10:27.052 INFO:tasks.workunit.client.0.smithi138.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:10:27.052 INFO:tasks.workunit.client.0.smithi138.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:10:27.097 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:27.099+0000 7fa9cdcbf9c0 20 rados->read ofs=0 len=0 2024-09-14T11:10:27.100 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:27.103+0000 7fa9cdcbf9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:10:27.100 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:27.103+0000 7fa9cdcbf9c0 20 realm 2024-09-14T11:10:27.100 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:27.103+0000 7fa9cdcbf9c0 20 rados->read ofs=0 len=0 2024-09-14T11:10:27.100 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:27.103+0000 7fa9cdcbf9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:10:27.100 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:27.103+0000 7fa9cdcbf9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:10:27.100 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:27.103+0000 7fa9cdcbf9c0 20 rados->read ofs=0 len=0 2024-09-14T11:10:27.100 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:27.103+0000 7fa9cdcbf9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:10:27.100 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:27.103+0000 7fa9cdcbf9c0 20 rados->read ofs=0 len=0 2024-09-14T11:10:27.101 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:27.103+0000 7fa9cdcbf9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:10:27.101 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:27.103+0000 7fa9cdcbf9c0 20 rados->read ofs=0 len=0 2024-09-14T11:10:27.102 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:27.103+0000 7fa9cdcbf9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:10:27.102 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:27.103+0000 7fa9cdcbf9c0 20 searching for the correct realm 2024-09-14T11:10:27.106 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:27.107+0000 7fa9cafc4640 0 -- 172.21.15.138:0/4221753578 >> [v2:172.21.15.154:6808/1468088432,v1:172.21.15.154:6809/1468088432] conn(0x7fa9bc100430 msgr2=0x7fa9bc108ff0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-14T11:10:27.113 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:27.115+0000 7fa9cafc4640 0 -- 172.21.15.138:0/4221753578 >> [v2:172.21.15.138:6816/326481658,v1:172.21.15.138:6817/326481658] conn(0x7fa9c4065440 msgr2=0x7fa9c40658c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:10:27.329 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:27.331+0000 7fa9cdcbf9c0 20 RGWRados::pool_iterate: got zone_info.d9e72d30-c60b-4d0d-9267-fdc36392d5ad 2024-09-14T11:10:27.329 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:27.331+0000 7fa9cdcbf9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:10:27.329 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:27.331+0000 7fa9cdcbf9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:10:27.329 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:27.331+0000 7fa9cdcbf9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:10:27.329 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:27.331+0000 7fa9cdcbf9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:10:27.330 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:27.331+0000 7fa9cdcbf9c0 20 RGWRados::pool_iterate: got zonegroup_info.65ab941b-da8c-4160-94fb-3672b069d44f 2024-09-14T11:10:27.330 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:27.331+0000 7fa9cdcbf9c0 20 rados->read ofs=0 len=0 2024-09-14T11:10:27.330 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:27.331+0000 7fa9cdcbf9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:10:27.330 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:27.331+0000 7fa9cdcbf9c0 20 rados->read ofs=0 len=0 2024-09-14T11:10:27.330 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:27.331+0000 7fa9cdcbf9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:10:27.331 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:27.331+0000 7fa9cdcbf9c0 20 rados->read ofs=0 len=0 2024-09-14T11:10:27.331 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:27.335+0000 7fa9cdcbf9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:10:27.332 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:27.335+0000 7fa9cdcbf9c0 20 zone default found 2024-09-14T11:10:27.332 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:27.335+0000 7fa9cdcbf9c0 4 Realm: () 2024-09-14T11:10:27.332 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:27.335+0000 7fa9cdcbf9c0 4 ZoneGroup: default (65ab941b-da8c-4160-94fb-3672b069d44f) 2024-09-14T11:10:27.332 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:27.335+0000 7fa9cdcbf9c0 4 Zone: default (d9e72d30-c60b-4d0d-9267-fdc36392d5ad) 2024-09-14T11:10:27.332 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:27.335+0000 7fa9cdcbf9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:10:27.332 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:27.335+0000 7fa9cdcbf9c0 20 zonegroup default 2024-09-14T11:10:27.332 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:27.335+0000 7fa9cdcbf9c0 20 rados->read ofs=0 len=0 2024-09-14T11:10:27.332 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:27.335+0000 7fa9cdcbf9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:10:27.333 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:27.335+0000 7fa9cdcbf9c0 20 rados->read ofs=0 len=0 2024-09-14T11:10:27.333 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:27.335+0000 7fa9cdcbf9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:10:27.333 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:27.335+0000 7fa9cdcbf9c0 20 rados->read ofs=0 len=0 2024-09-14T11:10:27.334 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:27.335+0000 7fa9cdcbf9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:10:27.334 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:27.335+0000 7fa9cdcbf9c0 20 started sync module instance, tier type = 2024-09-14T11:10:27.334 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:27.335+0000 7fa9cdcbf9c0 20 started zone id=d9e72d30-c60b-4d0d-9267-fdc36392d5ad (name=default) with tier type = 2024-09-14T11:10:27.358 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:27.359+0000 7fa9cdcbf9c0 20 add_watcher() i=0 2024-09-14T11:10:27.358 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:27.359+0000 7fa9cdcbf9c0 20 add_watcher() i=1 2024-09-14T11:10:27.358 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:27.359+0000 7fa9cdcbf9c0 20 add_watcher() i=2 2024-09-14T11:10:27.359 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:27.359+0000 7fa9cdcbf9c0 20 add_watcher() i=3 2024-09-14T11:10:27.359 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:27.359+0000 7fa9cdcbf9c0 20 add_watcher() i=4 2024-09-14T11:10:27.359 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:27.359+0000 7fa9cdcbf9c0 20 add_watcher() i=5 2024-09-14T11:10:27.359 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:27.359+0000 7fa9cdcbf9c0 20 add_watcher() i=6 2024-09-14T11:10:27.361 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:27.363+0000 7fa9cdcbf9c0 20 add_watcher() i=7 2024-09-14T11:10:27.361 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:27.363+0000 7fa9cdcbf9c0 2 all 8 watchers are set, enabling cache 2024-09-14T11:10:27.365 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:27.367+0000 7fa881fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:10:27.367 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:27.367+0000 7fa9cdcbf9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:10:27.367 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:27.367+0000 7fa9cdcbf9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:10:27.367 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:27.367+0000 7fa9cdcbf9c0 5 note: GC not initialized 2024-09-14T11:10:27.367 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:27.371+0000 7fa880fe1640 20 reqs_thread_entry: start 2024-09-14T11:10:27.367 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:27.371+0000 7fa9cdcbf9c0 20 init_complete bucket index max shards: 11 2024-09-14T11:10:27.367 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:27.371+0000 7fa9cdcbf9c0 20 Filter name: none 2024-09-14T11:10:27.368 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:27.371+0000 7fa7fa7fc640 20 reqs_thread_entry: start 2024-09-14T11:10:27.368 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:27.371+0000 7fa9cdcbf9c0 20 rados->read ofs=0 len=0 2024-09-14T11:10:27.368 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:27.371+0000 7fa9cdcbf9c0 20 rados_obj.operate() r=0 bl.length=190 2024-09-14T11:10:27.369 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:27.371+0000 7fa9cdcbf9c0 20 rados->read ofs=0 len=0 2024-09-14T11:10:27.369 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:27.371+0000 7fa9cdcbf9c0 20 rados_obj.operate() r=0 bl.length=412 2024-09-14T11:10:27.369 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:27.371+0000 7fa9cdcbf9c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:10:27.369 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:27.371+0000 7fa9cdcbf9c0 20 rados->read ofs=0 len=0 2024-09-14T11:10:27.370 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:27.371+0000 7fa9cdcbf9c0 20 rados_obj.operate() r=0 bl.length=190 2024-09-14T11:10:27.370 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:27.371+0000 7fa9cdcbf9c0 20 rados->read ofs=0 len=0 2024-09-14T11:10:27.370 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:27.371+0000 7fa9cdcbf9c0 20 rados_obj.operate() r=0 bl.length=412 2024-09-14T11:10:27.370 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:27.371+0000 7fa9cdcbf9c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:10:27.374 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:27.375+0000 7fa881fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:10:27.379 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:27.379+0000 7fa9cdcbf9c0 20 remove_watcher() i=0 2024-09-14T11:10:27.379 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:27.379+0000 7fa9cdcbf9c0 2 removed watcher, disabling cache 2024-09-14T11:10:27.381 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:27.383+0000 7fa9cdcbf9c0 20 remove_watcher() i=1 2024-09-14T11:10:27.383 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:27.387+0000 7fa9cdcbf9c0 20 remove_watcher() i=2 2024-09-14T11:10:27.386 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:27.387+0000 7fa9cdcbf9c0 20 remove_watcher() i=3 2024-09-14T11:10:27.389 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:27.391+0000 7fa9cdcbf9c0 20 remove_watcher() i=4 2024-09-14T11:10:27.390 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:27.391+0000 7fa9cdcbf9c0 20 remove_watcher() i=5 2024-09-14T11:10:27.392 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:27.395+0000 7fa9cdcbf9c0 20 remove_watcher() i=6 2024-09-14T11:10:27.394 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:27.395+0000 7fa9cdcbf9c0 20 remove_watcher() i=7 2024-09-14T11:10:27.409 INFO:tasks.workunit.client.0.smithi138.stderr:{'rgw.main': {'size': 54, 'size_actual': 24576, 'size_utilized': 87, 'size_kb': 1, 'size_kb_actual': 24, 'size_kb_utilized': 1, 'num_objects': 6}} 2024-09-14T11:10:27.409 INFO:tasks.workunit.client.0.smithi138.stderr:TEST: bucket check unlinked does not report normal entries 2024-09-14T11:10:27.410 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-14T11:10:27.410 INFO:tasks.workunit.client.0.smithi138.stderr:radosgw-admin bucket check unlinked --bucket check-bucket --min-age-hours 0 --dump-keys 2024-09-14T11:10:27.446 INFO:tasks.workunit.client.0.smithi138.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:10:27.446 INFO:tasks.workunit.client.0.smithi138.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:10:27.490 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:27.491+0000 7fdb823f69c0 20 rados->read ofs=0 len=0 2024-09-14T11:10:27.492 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:27.495+0000 7fdb823f69c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:10:27.492 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:27.495+0000 7fdb823f69c0 20 realm 2024-09-14T11:10:27.492 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:27.495+0000 7fdb823f69c0 20 rados->read ofs=0 len=0 2024-09-14T11:10:27.492 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:27.495+0000 7fdb823f69c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:10:27.492 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:27.495+0000 7fdb823f69c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:10:27.492 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:27.495+0000 7fdb823f69c0 20 rados->read ofs=0 len=0 2024-09-14T11:10:27.492 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:27.495+0000 7fdb823f69c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:10:27.493 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:27.495+0000 7fdb823f69c0 20 rados->read ofs=0 len=0 2024-09-14T11:10:27.494 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:27.495+0000 7fdb823f69c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:10:27.494 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:27.495+0000 7fdb823f69c0 20 rados->read ofs=0 len=0 2024-09-14T11:10:27.495 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:27.495+0000 7fdb823f69c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:10:27.495 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:27.495+0000 7fdb823f69c0 20 searching for the correct realm 2024-09-14T11:10:27.499 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:27.503+0000 7fdb7f6fb640 0 -- 172.21.15.138:0/3639556945 >> [v2:172.21.15.154:6808/1468088432,v1:172.21.15.154:6809/1468088432] conn(0x7fdb78027040 msgr2=0x7fdb78064560 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:10:27.505 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:27.507+0000 7fdb7f6fb640 0 -- 172.21.15.138:0/3639556945 >> [v2:172.21.15.138:6816/326481658,v1:172.21.15.138:6817/326481658] conn(0x7fdb700f9950 msgr2=0x7fdb700ec400 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:10:27.720 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:27.723+0000 7fdb823f69c0 20 RGWRados::pool_iterate: got zone_info.d9e72d30-c60b-4d0d-9267-fdc36392d5ad 2024-09-14T11:10:27.720 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:27.723+0000 7fdb823f69c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:10:27.720 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:27.723+0000 7fdb823f69c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:10:27.720 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:27.723+0000 7fdb823f69c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:10:27.721 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:27.723+0000 7fdb823f69c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:10:27.721 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:27.723+0000 7fdb823f69c0 20 RGWRados::pool_iterate: got zonegroup_info.65ab941b-da8c-4160-94fb-3672b069d44f 2024-09-14T11:10:27.721 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:27.723+0000 7fdb823f69c0 20 rados->read ofs=0 len=0 2024-09-14T11:10:27.721 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:27.723+0000 7fdb823f69c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:10:27.721 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:27.723+0000 7fdb823f69c0 20 rados->read ofs=0 len=0 2024-09-14T11:10:27.721 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:27.723+0000 7fdb823f69c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:10:27.721 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:27.723+0000 7fdb823f69c0 20 rados->read ofs=0 len=0 2024-09-14T11:10:27.722 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:27.723+0000 7fdb823f69c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:10:27.722 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:27.723+0000 7fdb823f69c0 20 zone default found 2024-09-14T11:10:27.722 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:27.723+0000 7fdb823f69c0 4 Realm: () 2024-09-14T11:10:27.723 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:27.723+0000 7fdb823f69c0 4 ZoneGroup: default (65ab941b-da8c-4160-94fb-3672b069d44f) 2024-09-14T11:10:27.723 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:27.723+0000 7fdb823f69c0 4 Zone: default (d9e72d30-c60b-4d0d-9267-fdc36392d5ad) 2024-09-14T11:10:27.723 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:27.723+0000 7fdb823f69c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:10:27.723 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:27.723+0000 7fdb823f69c0 20 zonegroup default 2024-09-14T11:10:27.723 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:27.723+0000 7fdb823f69c0 20 rados->read ofs=0 len=0 2024-09-14T11:10:27.723 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:27.723+0000 7fdb823f69c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:10:27.723 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:27.723+0000 7fdb823f69c0 20 rados->read ofs=0 len=0 2024-09-14T11:10:27.724 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:27.727+0000 7fdb823f69c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:10:27.724 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:27.727+0000 7fdb823f69c0 20 rados->read ofs=0 len=0 2024-09-14T11:10:27.724 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:27.727+0000 7fdb823f69c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:10:27.724 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:27.727+0000 7fdb823f69c0 20 started sync module instance, tier type = 2024-09-14T11:10:27.724 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:27.727+0000 7fdb823f69c0 20 started zone id=d9e72d30-c60b-4d0d-9267-fdc36392d5ad (name=default) with tier type = 2024-09-14T11:10:27.746 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:27.747+0000 7fdb823f69c0 20 add_watcher() i=0 2024-09-14T11:10:27.746 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:27.747+0000 7fdb823f69c0 20 add_watcher() i=1 2024-09-14T11:10:27.746 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:27.747+0000 7fdb823f69c0 20 add_watcher() i=2 2024-09-14T11:10:27.746 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:27.747+0000 7fdb823f69c0 20 add_watcher() i=3 2024-09-14T11:10:27.746 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:27.747+0000 7fdb823f69c0 20 add_watcher() i=4 2024-09-14T11:10:27.746 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:27.747+0000 7fdb823f69c0 20 add_watcher() i=5 2024-09-14T11:10:27.746 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:27.747+0000 7fdb823f69c0 20 add_watcher() i=6 2024-09-14T11:10:27.747 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:27.751+0000 7fdb823f69c0 20 add_watcher() i=7 2024-09-14T11:10:27.748 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:27.751+0000 7fdb823f69c0 2 all 8 watchers are set, enabling cache 2024-09-14T11:10:27.751 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:27.751+0000 7fda35fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:10:27.752 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:27.755+0000 7fdb823f69c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:10:27.752 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:27.755+0000 7fdb823f69c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:10:27.752 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:27.755+0000 7fdb823f69c0 5 note: GC not initialized 2024-09-14T11:10:27.752 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:27.755+0000 7fda34fe1640 20 reqs_thread_entry: start 2024-09-14T11:10:27.752 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:27.755+0000 7fdb823f69c0 20 init_complete bucket index max shards: 11 2024-09-14T11:10:27.752 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:27.755+0000 7fdb823f69c0 20 Filter name: none 2024-09-14T11:10:27.752 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:27.755+0000 7fd9ae7fc640 20 reqs_thread_entry: start 2024-09-14T11:10:27.752 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:27.755+0000 7fdb823f69c0 10 cache get: name=default.rgw.meta+root+check-bucket : miss 2024-09-14T11:10:27.753 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:27.755+0000 7fdb823f69c0 20 rados->read ofs=0 len=0 2024-09-14T11:10:27.753 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:27.755+0000 7fdb823f69c0 20 rados_obj.operate() r=0 bl.length=190 2024-09-14T11:10:27.754 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:27.755+0000 7fdb823f69c0 10 cache put: name=default.rgw.meta+root+check-bucket info.flags=0x11 2024-09-14T11:10:27.754 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:27.755+0000 7fdb823f69c0 10 adding default.rgw.meta+root+check-bucket to cache LRU end 2024-09-14T11:10:27.754 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:27.755+0000 7fdb823f69c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.check-bucket:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.1 : miss 2024-09-14T11:10:27.754 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:27.755+0000 7fdb823f69c0 20 rados->read ofs=0 len=0 2024-09-14T11:10:27.754 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:27.755+0000 7fdb823f69c0 20 rados_obj.operate() r=0 bl.length=412 2024-09-14T11:10:27.754 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:27.755+0000 7fdb823f69c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.check-bucket:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.1 info.flags=0x17 2024-09-14T11:10:27.754 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:27.755+0000 7fdb823f69c0 10 adding default.rgw.meta+root+.bucket.meta.check-bucket:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.1 to cache LRU end 2024-09-14T11:10:27.754 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:27.755+0000 7fdb823f69c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:10:27.754 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:27.755+0000 7fdb823f69c0 10 updating xattr: name=user.rgw.acl bl.length()=179 2024-09-14T11:10:27.754 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:27.755+0000 7fdb823f69c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.check-bucket:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.1 2024-09-14T11:10:27.754 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:27.755+0000 7fdb823f69c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.1.0 2024-09-14T11:10:27.755 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:27.755+0000 7fdb823f69c0 1 NOTICE: finished shard 0 (0 entries found) 2024-09-14T11:10:27.755 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:27.755+0000 7fdb823f69c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.1.1 2024-09-14T11:10:27.755 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:27.755+0000 7fdb823f69c0 1 NOTICE: finished shard 1 (0 entries found) 2024-09-14T11:10:27.755 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:27.755+0000 7fdb823f69c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.1.2 2024-09-14T11:10:27.755 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:27.759+0000 7fdb823f69c0 1 NOTICE: finished shard 2 (0 entries found) 2024-09-14T11:10:27.755 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:27.759+0000 7fdb823f69c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.1.3 2024-09-14T11:10:27.756 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:27.759+0000 7fdb823f69c0 1 NOTICE: finished shard 3 (0 entries found) 2024-09-14T11:10:27.756 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:27.759+0000 7fdb823f69c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.1.4 2024-09-14T11:10:27.757 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:27.759+0000 7fdb823f69c0 1 NOTICE: finished shard 4 (0 entries found) 2024-09-14T11:10:27.757 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:27.759+0000 7fdb823f69c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.1.5 2024-09-14T11:10:27.757 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:27.759+0000 7fdb823f69c0 1 NOTICE: finished shard 5 (0 entries found) 2024-09-14T11:10:27.758 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:27.759+0000 7fdb823f69c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.1.6 2024-09-14T11:10:27.758 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:27.759+0000 7fdb823f69c0 1 NOTICE: finished shard 6 (0 entries found) 2024-09-14T11:10:27.758 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:27.759+0000 7fdb823f69c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.1.7 2024-09-14T11:10:27.759 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:27.763+0000 7fdb823f69c0 1 NOTICE: finished shard 7 (0 entries found) 2024-09-14T11:10:27.759 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:27.763+0000 7fdb823f69c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.1.8 2024-09-14T11:10:27.761 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:27.763+0000 7fdb823f69c0 1 NOTICE: finished shard 8 (0 entries found) 2024-09-14T11:10:27.761 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:27.763+0000 7fdb823f69c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.1.9 2024-09-14T11:10:27.762 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:27.763+0000 7fdb823f69c0 1 NOTICE: finished shard 9 (0 entries found) 2024-09-14T11:10:27.762 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:27.763+0000 7fdb823f69c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.1.10 2024-09-14T11:10:27.762 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:27.763+0000 7fdb823f69c0 1 NOTICE: finished shard 10 (0 entries found) 2024-09-14T11:10:27.762 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:27.763+0000 7fdb823f69c0 1 NOTICE: finished all shards (0 entries found) 2024-09-14T11:10:27.764 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:27.767+0000 7fda35fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:10:27.772 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:27.771+0000 7fdb823f69c0 20 remove_watcher() i=0 2024-09-14T11:10:27.772 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:27.771+0000 7fdb823f69c0 2 removed watcher, disabling cache 2024-09-14T11:10:27.773 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:27.775+0000 7fdb823f69c0 20 remove_watcher() i=1 2024-09-14T11:10:27.774 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:27.775+0000 7fdb823f69c0 20 remove_watcher() i=2 2024-09-14T11:10:27.777 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:27.779+0000 7fdb823f69c0 20 remove_watcher() i=3 2024-09-14T11:10:27.779 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:27.783+0000 7fdb823f69c0 20 remove_watcher() i=4 2024-09-14T11:10:27.781 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:27.783+0000 7fdb823f69c0 20 remove_watcher() i=5 2024-09-14T11:10:27.783 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:27.783+0000 7fdb823f69c0 20 remove_watcher() i=6 2024-09-14T11:10:27.784 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:27.787+0000 7fdb823f69c0 20 remove_watcher() i=7 2024-09-14T11:10:27.799 INFO:tasks.workunit.client.0.smithi138.stderr:ceph config set client rgw_debug_inject_set_olh_err 2 2024-09-14T11:10:28.236 INFO:tasks.workunit.client.0.smithi138.stderr:ceph config set client rgw_debug_inject_olh_cancel_modification_err true 2024-09-14T11:10:29.665 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:10:29.665 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-14T11:10:29.860 INFO:tasks.workunit.client.0.smithi138.stderr:An error occurred (NoSuchKey) when calling the PutObject operation: None 2024-09-14T11:10:29.861 INFO:tasks.workunit.client.0.smithi138.stderr:radosgw-admin bi list --bucket check-bucket --object c 2024-09-14T11:10:29.895 INFO:tasks.workunit.client.0.smithi138.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:10:29.896 INFO:tasks.workunit.client.0.smithi138.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:10:29.942 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:29.943+0000 7f64065609c0 20 rados->read ofs=0 len=0 2024-09-14T11:10:29.944 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:29.947+0000 7f64065609c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:10:29.944 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:29.947+0000 7f64065609c0 20 realm 2024-09-14T11:10:29.944 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:29.947+0000 7f64065609c0 20 rados->read ofs=0 len=0 2024-09-14T11:10:29.944 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:29.947+0000 7f64065609c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:10:29.944 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:29.947+0000 7f64065609c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:10:29.944 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:29.947+0000 7f64065609c0 20 rados->read ofs=0 len=0 2024-09-14T11:10:29.944 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:29.947+0000 7f64065609c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:10:29.944 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:29.947+0000 7f64065609c0 20 rados->read ofs=0 len=0 2024-09-14T11:10:29.945 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:29.947+0000 7f64065609c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:10:29.945 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:29.947+0000 7f64065609c0 20 rados->read ofs=0 len=0 2024-09-14T11:10:29.946 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:29.947+0000 7f64065609c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:10:29.946 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:29.947+0000 7f64065609c0 20 searching for the correct realm 2024-09-14T11:10:29.951 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:29.951+0000 7f6404867640 0 -- 172.21.15.138:0/582582431 >> [v2:172.21.15.154:6824/416768175,v1:172.21.15.154:6825/416768175] conn(0x7f63fc0eab60 msgr2=0x7f63fc0e3440 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:10:29.957 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:29.959+0000 7f6403865640 0 -- 172.21.15.138:0/582582431 >> [v2:172.21.15.138:6816/326481658,v1:172.21.15.138:6817/326481658] conn(0x7f63fc0cd930 msgr2=0x7f63fc0d8410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:10:30.175 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:30.175+0000 7f64065609c0 20 RGWRados::pool_iterate: got zone_info.d9e72d30-c60b-4d0d-9267-fdc36392d5ad 2024-09-14T11:10:30.175 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:30.175+0000 7f64065609c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:10:30.175 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:30.175+0000 7f64065609c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:10:30.175 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:30.175+0000 7f64065609c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:10:30.175 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:30.175+0000 7f64065609c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:10:30.175 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:30.175+0000 7f64065609c0 20 RGWRados::pool_iterate: got zonegroup_info.65ab941b-da8c-4160-94fb-3672b069d44f 2024-09-14T11:10:30.175 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:30.175+0000 7f64065609c0 20 rados->read ofs=0 len=0 2024-09-14T11:10:30.175 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:30.175+0000 7f64065609c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:10:30.176 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:30.175+0000 7f64065609c0 20 rados->read ofs=0 len=0 2024-09-14T11:10:30.176 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:30.179+0000 7f64065609c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:10:30.176 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:30.179+0000 7f64065609c0 20 rados->read ofs=0 len=0 2024-09-14T11:10:30.177 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:30.179+0000 7f64065609c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:10:30.177 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:30.179+0000 7f64065609c0 20 zone default found 2024-09-14T11:10:30.178 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:30.179+0000 7f64065609c0 4 Realm: () 2024-09-14T11:10:30.178 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:30.179+0000 7f64065609c0 4 ZoneGroup: default (65ab941b-da8c-4160-94fb-3672b069d44f) 2024-09-14T11:10:30.178 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:30.179+0000 7f64065609c0 4 Zone: default (d9e72d30-c60b-4d0d-9267-fdc36392d5ad) 2024-09-14T11:10:30.178 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:30.179+0000 7f64065609c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:10:30.178 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:30.179+0000 7f64065609c0 20 zonegroup default 2024-09-14T11:10:30.178 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:30.179+0000 7f64065609c0 20 rados->read ofs=0 len=0 2024-09-14T11:10:30.179 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:30.179+0000 7f64065609c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:10:30.179 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:30.179+0000 7f64065609c0 20 rados->read ofs=0 len=0 2024-09-14T11:10:30.179 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:30.179+0000 7f64065609c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:10:30.179 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:30.179+0000 7f64065609c0 20 rados->read ofs=0 len=0 2024-09-14T11:10:30.180 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:30.183+0000 7f64065609c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:10:30.180 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:30.183+0000 7f64065609c0 20 started sync module instance, tier type = 2024-09-14T11:10:30.180 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:30.183+0000 7f64065609c0 20 started zone id=d9e72d30-c60b-4d0d-9267-fdc36392d5ad (name=default) with tier type = 2024-09-14T11:10:30.202 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:30.203+0000 7f64065609c0 20 add_watcher() i=0 2024-09-14T11:10:30.202 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:30.203+0000 7f64065609c0 20 add_watcher() i=1 2024-09-14T11:10:30.202 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:30.203+0000 7f64065609c0 20 add_watcher() i=2 2024-09-14T11:10:30.202 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:30.203+0000 7f64065609c0 20 add_watcher() i=3 2024-09-14T11:10:30.202 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:30.203+0000 7f64065609c0 20 add_watcher() i=4 2024-09-14T11:10:30.203 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:30.203+0000 7f64065609c0 20 add_watcher() i=5 2024-09-14T11:10:30.203 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:30.203+0000 7f64065609c0 20 add_watcher() i=6 2024-09-14T11:10:30.205 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:30.207+0000 7f64065609c0 20 add_watcher() i=7 2024-09-14T11:10:30.205 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:30.207+0000 7f64065609c0 2 all 8 watchers are set, enabling cache 2024-09-14T11:10:30.209 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:30.211+0000 7f62bafdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:10:30.209 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:30.211+0000 7f64065609c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:10:30.210 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:30.211+0000 7f64065609c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:10:30.210 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:30.211+0000 7f64065609c0 5 note: GC not initialized 2024-09-14T11:10:30.210 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:30.211+0000 7f62b9fdb640 20 reqs_thread_entry: start 2024-09-14T11:10:30.210 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:30.211+0000 7f64065609c0 20 init_complete bucket index max shards: 11 2024-09-14T11:10:30.210 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:30.211+0000 7f64065609c0 20 Filter name: none 2024-09-14T11:10:30.211 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:30.211+0000 7f622b7fe640 20 reqs_thread_entry: start 2024-09-14T11:10:30.211 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:30.211+0000 7f64065609c0 20 rados->read ofs=0 len=0 2024-09-14T11:10:30.211 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:30.215+0000 7f64065609c0 20 rados_obj.operate() r=0 bl.length=190 2024-09-14T11:10:30.212 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:30.215+0000 7f64065609c0 20 rados->read ofs=0 len=0 2024-09-14T11:10:30.213 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:30.215+0000 7f64065609c0 20 rados_obj.operate() r=0 bl.length=412 2024-09-14T11:10:30.213 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:30.215+0000 7f64065609c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:10:30.213 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:30.215+0000 7f64065609c0 20 INFO: main: max_entries=1000, index=gen=0, max_shards=11 2024-09-14T11:10:30.213 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:30.215+0000 7f64065609c0 20 INFO: main: starting shard=0 2024-09-14T11:10:30.213 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:30.215+0000 7f64065609c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.1.0 2024-09-14T11:10:30.214 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:30.215+0000 7f64065609c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:10:30.214 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:30.215+0000 7f64065609c0 20 INFO: main: starting shard=1 2024-09-14T11:10:30.214 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:30.215+0000 7f64065609c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.1.1 2024-09-14T11:10:30.214 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:30.215+0000 7f64065609c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:10:30.214 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:30.215+0000 7f64065609c0 20 INFO: main: starting shard=2 2024-09-14T11:10:30.215 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:30.215+0000 7f64065609c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.1.2 2024-09-14T11:10:30.215 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:30.215+0000 7f64065609c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:10:30.215 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:30.215+0000 7f64065609c0 20 INFO: main: starting shard=3 2024-09-14T11:10:30.215 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:30.215+0000 7f64065609c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.1.3 2024-09-14T11:10:30.216 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:30.219+0000 7f64065609c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:10:30.216 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:30.219+0000 7f64065609c0 20 INFO: main: starting shard=4 2024-09-14T11:10:30.216 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:30.219+0000 7f64065609c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.1.4 2024-09-14T11:10:30.217 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:30.219+0000 7f64065609c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:10:30.217 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:30.219+0000 7f64065609c0 20 INFO: main: starting shard=5 2024-09-14T11:10:30.217 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:30.219+0000 7f64065609c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.1.5 2024-09-14T11:10:30.219 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:30.219+0000 7f64065609c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:10:30.219 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:30.219+0000 7f64065609c0 20 INFO: main: starting shard=6 2024-09-14T11:10:30.219 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:30.219+0000 7f64065609c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.1.6 2024-09-14T11:10:30.220 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:30.223+0000 7f64065609c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:10:30.220 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:30.223+0000 7f64065609c0 20 INFO: main: starting shard=7 2024-09-14T11:10:30.220 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:30.223+0000 7f64065609c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.1.7 2024-09-14T11:10:30.221 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:30.223+0000 7f64065609c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:10:30.222 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:30.223+0000 7f64065609c0 20 INFO: main: starting shard=8 2024-09-14T11:10:30.222 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:30.223+0000 7f64065609c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.1.8 2024-09-14T11:10:30.223 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:30.227+0000 7f64065609c0 20 INFO: main: bi_list() returned without error; entries.size()=5, is_truncated=0, marker= 2024-09-14T11:10:30.224 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:30.227+0000 7f64065609c0 20 INFO: main: starting shard=9 2024-09-14T11:10:30.224 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:30.227+0000 7f64065609c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.1.9 2024-09-14T11:10:30.225 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:30.227+0000 7f64065609c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:10:30.225 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:30.227+0000 7f64065609c0 20 INFO: main: starting shard=10 2024-09-14T11:10:30.225 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:30.227+0000 7f64065609c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.1.10 2024-09-14T11:10:30.226 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:30.227+0000 7f64065609c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:10:30.226 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:30.227+0000 7f64065609c0 20 INFO: main: done 2024-09-14T11:10:30.227 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:30.231+0000 7f62bafdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:10:30.232 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:30.235+0000 7f64065609c0 20 remove_watcher() i=0 2024-09-14T11:10:30.232 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:30.235+0000 7f64065609c0 2 removed watcher, disabling cache 2024-09-14T11:10:30.235 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:30.235+0000 7f64065609c0 20 remove_watcher() i=1 2024-09-14T11:10:30.237 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:30.239+0000 7f64065609c0 20 remove_watcher() i=2 2024-09-14T11:10:30.240 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:30.243+0000 7f64065609c0 20 remove_watcher() i=3 2024-09-14T11:10:30.242 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:30.243+0000 7f64065609c0 20 remove_watcher() i=4 2024-09-14T11:10:30.243 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:30.247+0000 7f64065609c0 20 remove_watcher() i=5 2024-09-14T11:10:30.245 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:30.247+0000 7f64065609c0 20 remove_watcher() i=6 2024-09-14T11:10:30.246 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:30.247+0000 7f64065609c0 20 remove_watcher() i=7 2024-09-14T11:10:30.264 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:10:30.264 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-14T11:10:30.309 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:10:30.309 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-14T11:10:30.468 INFO:tasks.workunit.client.0.smithi138.stderr:An error occurred (NoSuchKey) when calling the PutObject operation: None 2024-09-14T11:10:30.469 INFO:tasks.workunit.client.0.smithi138.stderr:radosgw-admin bi list --bucket check-bucket --object d 2024-09-14T11:10:30.504 INFO:tasks.workunit.client.0.smithi138.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:10:30.504 INFO:tasks.workunit.client.0.smithi138.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:10:30.549 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:30.551+0000 7f025911b9c0 20 rados->read ofs=0 len=0 2024-09-14T11:10:30.552 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:30.555+0000 7f025911b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:10:30.552 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:30.555+0000 7f025911b9c0 20 realm 2024-09-14T11:10:30.552 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:30.555+0000 7f025911b9c0 20 rados->read ofs=0 len=0 2024-09-14T11:10:30.552 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:30.555+0000 7f025911b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:10:30.552 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:30.555+0000 7f025911b9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:10:30.552 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:30.555+0000 7f025911b9c0 20 rados->read ofs=0 len=0 2024-09-14T11:10:30.552 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:30.555+0000 7f025911b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:10:30.552 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:30.555+0000 7f025911b9c0 20 rados->read ofs=0 len=0 2024-09-14T11:10:30.554 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:30.555+0000 7f025911b9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:10:30.554 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:30.555+0000 7f025911b9c0 20 rados->read ofs=0 len=0 2024-09-14T11:10:30.555 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:30.555+0000 7f025911b9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:10:30.555 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:30.555+0000 7f025911b9c0 20 searching for the correct realm 2024-09-14T11:10:30.559 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:30.559+0000 7f0257422640 0 -- 172.21.15.138:0/3804410115 >> [v2:172.21.15.154:6824/416768175,v1:172.21.15.154:6825/416768175] conn(0x7f0250033040 msgr2=0x7f0250073440 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:10:30.565 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:30.567+0000 7f0256420640 0 -- 172.21.15.138:0/3804410115 >> [v2:172.21.15.138:6816/326481658,v1:172.21.15.138:6817/326481658] conn(0x7f0250073a70 msgr2=0x7f0250068940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-14T11:10:30.783 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:30.783+0000 7f025911b9c0 20 RGWRados::pool_iterate: got zone_info.d9e72d30-c60b-4d0d-9267-fdc36392d5ad 2024-09-14T11:10:30.783 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:30.783+0000 7f025911b9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:10:30.783 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:30.783+0000 7f025911b9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:10:30.783 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:30.783+0000 7f025911b9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:10:30.783 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:30.783+0000 7f025911b9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:10:30.783 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:30.783+0000 7f025911b9c0 20 RGWRados::pool_iterate: got zonegroup_info.65ab941b-da8c-4160-94fb-3672b069d44f 2024-09-14T11:10:30.783 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:30.783+0000 7f025911b9c0 20 rados->read ofs=0 len=0 2024-09-14T11:10:30.784 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:30.787+0000 7f025911b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:10:30.784 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:30.787+0000 7f025911b9c0 20 rados->read ofs=0 len=0 2024-09-14T11:10:30.784 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:30.787+0000 7f025911b9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:10:30.784 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:30.787+0000 7f025911b9c0 20 rados->read ofs=0 len=0 2024-09-14T11:10:30.785 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:30.787+0000 7f025911b9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:10:30.785 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:30.787+0000 7f025911b9c0 20 zone default found 2024-09-14T11:10:30.785 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:30.787+0000 7f025911b9c0 4 Realm: () 2024-09-14T11:10:30.785 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:30.787+0000 7f025911b9c0 4 ZoneGroup: default (65ab941b-da8c-4160-94fb-3672b069d44f) 2024-09-14T11:10:30.785 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:30.787+0000 7f025911b9c0 4 Zone: default (d9e72d30-c60b-4d0d-9267-fdc36392d5ad) 2024-09-14T11:10:30.785 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:30.787+0000 7f025911b9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:10:30.785 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:30.787+0000 7f025911b9c0 20 zonegroup default 2024-09-14T11:10:30.785 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:30.787+0000 7f025911b9c0 20 rados->read ofs=0 len=0 2024-09-14T11:10:30.786 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:30.787+0000 7f025911b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:10:30.786 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:30.787+0000 7f025911b9c0 20 rados->read ofs=0 len=0 2024-09-14T11:10:30.786 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:30.787+0000 7f025911b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:10:30.786 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:30.787+0000 7f025911b9c0 20 rados->read ofs=0 len=0 2024-09-14T11:10:30.787 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:30.791+0000 7f025911b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:10:30.787 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:30.791+0000 7f025911b9c0 20 started sync module instance, tier type = 2024-09-14T11:10:30.787 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:30.791+0000 7f025911b9c0 20 started zone id=d9e72d30-c60b-4d0d-9267-fdc36392d5ad (name=default) with tier type = 2024-09-14T11:10:30.810 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:30.811+0000 7f025911b9c0 20 add_watcher() i=0 2024-09-14T11:10:30.810 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:30.811+0000 7f025911b9c0 20 add_watcher() i=1 2024-09-14T11:10:30.810 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:30.811+0000 7f025911b9c0 20 add_watcher() i=2 2024-09-14T11:10:30.810 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:30.811+0000 7f025911b9c0 20 add_watcher() i=3 2024-09-14T11:10:30.810 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:30.811+0000 7f025911b9c0 20 add_watcher() i=4 2024-09-14T11:10:30.811 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:30.811+0000 7f025911b9c0 20 add_watcher() i=5 2024-09-14T11:10:30.813 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:30.815+0000 7f025911b9c0 20 add_watcher() i=6 2024-09-14T11:10:30.813 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:30.815+0000 7f025911b9c0 20 add_watcher() i=7 2024-09-14T11:10:30.813 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:30.815+0000 7f025911b9c0 2 all 8 watchers are set, enabling cache 2024-09-14T11:10:30.817 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:30.819+0000 7f010d7e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:10:30.817 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:30.819+0000 7f025911b9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:10:30.818 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:30.819+0000 7f025911b9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:10:30.818 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:30.819+0000 7f025911b9c0 5 note: GC not initialized 2024-09-14T11:10:30.818 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:30.819+0000 7f0087fff640 20 reqs_thread_entry: start 2024-09-14T11:10:30.819 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:30.819+0000 7f025911b9c0 20 init_complete bucket index max shards: 11 2024-09-14T11:10:30.819 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:30.819+0000 7f025911b9c0 20 Filter name: none 2024-09-14T11:10:30.819 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:30.819+0000 7f0085ffb640 20 reqs_thread_entry: start 2024-09-14T11:10:30.819 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:30.819+0000 7f025911b9c0 20 rados->read ofs=0 len=0 2024-09-14T11:10:30.820 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:30.823+0000 7f025911b9c0 20 rados_obj.operate() r=0 bl.length=190 2024-09-14T11:10:30.820 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:30.823+0000 7f025911b9c0 20 rados->read ofs=0 len=0 2024-09-14T11:10:30.820 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:30.823+0000 7f025911b9c0 20 rados_obj.operate() r=0 bl.length=412 2024-09-14T11:10:30.820 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:30.823+0000 7f025911b9c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:10:30.820 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:30.823+0000 7f025911b9c0 20 INFO: main: max_entries=1000, index=gen=0, max_shards=11 2024-09-14T11:10:30.820 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:30.823+0000 7f025911b9c0 20 INFO: main: starting shard=0 2024-09-14T11:10:30.820 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:30.823+0000 7f025911b9c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.1.0 2024-09-14T11:10:30.821 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:30.823+0000 7f025911b9c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:10:30.821 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:30.823+0000 7f025911b9c0 20 INFO: main: starting shard=1 2024-09-14T11:10:30.821 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:30.823+0000 7f025911b9c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.1.1 2024-09-14T11:10:30.821 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:30.823+0000 7f025911b9c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:10:30.821 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:30.823+0000 7f025911b9c0 20 INFO: main: starting shard=2 2024-09-14T11:10:30.821 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:30.823+0000 7f025911b9c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.1.2 2024-09-14T11:10:30.822 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:30.823+0000 7f025911b9c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:10:30.822 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:30.823+0000 7f025911b9c0 20 INFO: main: starting shard=3 2024-09-14T11:10:30.822 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:30.823+0000 7f025911b9c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.1.3 2024-09-14T11:10:30.823 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:30.823+0000 7f025911b9c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:10:30.823 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:30.823+0000 7f025911b9c0 20 INFO: main: starting shard=4 2024-09-14T11:10:30.823 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:30.823+0000 7f025911b9c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.1.4 2024-09-14T11:10:30.824 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:30.827+0000 7f025911b9c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:10:30.824 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:30.827+0000 7f025911b9c0 20 INFO: main: starting shard=5 2024-09-14T11:10:30.824 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:30.827+0000 7f025911b9c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.1.5 2024-09-14T11:10:30.825 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:30.827+0000 7f025911b9c0 20 INFO: main: bi_list() returned without error; entries.size()=5, is_truncated=0, marker= 2024-09-14T11:10:30.826 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:30.827+0000 7f025911b9c0 20 INFO: main: starting shard=6 2024-09-14T11:10:30.826 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:30.827+0000 7f025911b9c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.1.6 2024-09-14T11:10:30.826 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:30.827+0000 7f025911b9c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:10:30.826 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:30.827+0000 7f025911b9c0 20 INFO: main: starting shard=7 2024-09-14T11:10:30.826 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:30.827+0000 7f025911b9c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.1.7 2024-09-14T11:10:30.827 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:30.831+0000 7f025911b9c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:10:30.827 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:30.831+0000 7f025911b9c0 20 INFO: main: starting shard=8 2024-09-14T11:10:30.827 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:30.831+0000 7f025911b9c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.1.8 2024-09-14T11:10:30.828 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:30.831+0000 7f025911b9c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:10:30.829 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:30.831+0000 7f025911b9c0 20 INFO: main: starting shard=9 2024-09-14T11:10:30.829 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:30.831+0000 7f025911b9c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.1.9 2024-09-14T11:10:30.830 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:30.831+0000 7f025911b9c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:10:30.830 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:30.831+0000 7f025911b9c0 20 INFO: main: starting shard=10 2024-09-14T11:10:30.830 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:30.831+0000 7f025911b9c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.1.10 2024-09-14T11:10:30.831 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:30.831+0000 7f025911b9c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:10:30.831 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:30.831+0000 7f025911b9c0 20 INFO: main: done 2024-09-14T11:10:30.832 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:30.835+0000 7f010d7e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:10:30.837 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:30.839+0000 7f025911b9c0 20 remove_watcher() i=0 2024-09-14T11:10:30.837 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:30.839+0000 7f025911b9c0 2 removed watcher, disabling cache 2024-09-14T11:10:30.839 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:30.839+0000 7f025911b9c0 20 remove_watcher() i=1 2024-09-14T11:10:30.844 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:30.843+0000 7f025911b9c0 20 remove_watcher() i=2 2024-09-14T11:10:30.845 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:30.847+0000 7f025911b9c0 20 remove_watcher() i=3 2024-09-14T11:10:30.847 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:30.851+0000 7f025911b9c0 20 remove_watcher() i=4 2024-09-14T11:10:30.848 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:30.851+0000 7f025911b9c0 20 remove_watcher() i=5 2024-09-14T11:10:30.851 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:30.855+0000 7f025911b9c0 20 remove_watcher() i=6 2024-09-14T11:10:30.853 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:30.855+0000 7f025911b9c0 20 remove_watcher() i=7 2024-09-14T11:10:30.869 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:10:30.869 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-14T11:10:30.899 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:10:30.900 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-14T11:10:30.968 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:10:30.968 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-14T11:10:31.120 INFO:tasks.workunit.client.0.smithi138.stderr:An error occurred (NoSuchKey) when calling the PutObject operation: None 2024-09-14T11:10:31.121 INFO:tasks.workunit.client.0.smithi138.stderr:radosgw-admin bi list --bucket check-bucket --object e 2024-09-14T11:10:31.156 INFO:tasks.workunit.client.0.smithi138.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:10:31.156 INFO:tasks.workunit.client.0.smithi138.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:10:31.202 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:31.203+0000 7feea7f699c0 20 rados->read ofs=0 len=0 2024-09-14T11:10:31.204 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:31.207+0000 7feea7f699c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:10:31.204 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:31.207+0000 7feea7f699c0 20 realm 2024-09-14T11:10:31.204 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:31.207+0000 7feea7f699c0 20 rados->read ofs=0 len=0 2024-09-14T11:10:31.204 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:31.207+0000 7feea7f699c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:10:31.204 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:31.207+0000 7feea7f699c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:10:31.204 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:31.207+0000 7feea7f699c0 20 rados->read ofs=0 len=0 2024-09-14T11:10:31.204 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:31.207+0000 7feea7f699c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:10:31.204 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:31.207+0000 7feea7f699c0 20 rados->read ofs=0 len=0 2024-09-14T11:10:31.205 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:31.207+0000 7feea7f699c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:10:31.206 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:31.207+0000 7feea7f699c0 20 rados->read ofs=0 len=0 2024-09-14T11:10:31.206 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:31.207+0000 7feea7f699c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:10:31.206 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:31.207+0000 7feea7f699c0 20 searching for the correct realm 2024-09-14T11:10:31.211 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:31.215+0000 7feea526e640 0 -- 172.21.15.138:0/1589653218 >> [v2:172.21.15.154:6808/1468088432,v1:172.21.15.154:6809/1468088432] conn(0x7fee980f9a30 msgr2=0x7fee980f84a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:10:31.217 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:31.219+0000 7feea526e640 0 -- 172.21.15.138:0/1589653218 >> [v2:172.21.15.138:6816/326481658,v1:172.21.15.138:6817/326481658] conn(0x7feea0050460 msgr2=0x7feea00508e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:10:31.434 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:31.435+0000 7feea7f699c0 20 RGWRados::pool_iterate: got zone_info.d9e72d30-c60b-4d0d-9267-fdc36392d5ad 2024-09-14T11:10:31.434 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:31.435+0000 7feea7f699c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:10:31.434 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:31.435+0000 7feea7f699c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:10:31.434 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:31.435+0000 7feea7f699c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:10:31.434 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:31.435+0000 7feea7f699c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:10:31.435 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:31.435+0000 7feea7f699c0 20 RGWRados::pool_iterate: got zonegroup_info.65ab941b-da8c-4160-94fb-3672b069d44f 2024-09-14T11:10:31.435 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:31.435+0000 7feea7f699c0 20 rados->read ofs=0 len=0 2024-09-14T11:10:31.435 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:31.435+0000 7feea7f699c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:10:31.435 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:31.435+0000 7feea7f699c0 20 rados->read ofs=0 len=0 2024-09-14T11:10:31.435 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:31.439+0000 7feea7f699c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:10:31.435 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:31.439+0000 7feea7f699c0 20 rados->read ofs=0 len=0 2024-09-14T11:10:31.436 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:31.439+0000 7feea7f699c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:10:31.436 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:31.439+0000 7feea7f699c0 20 zone default found 2024-09-14T11:10:31.436 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:31.439+0000 7feea7f699c0 4 Realm: () 2024-09-14T11:10:31.436 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:31.439+0000 7feea7f699c0 4 ZoneGroup: default (65ab941b-da8c-4160-94fb-3672b069d44f) 2024-09-14T11:10:31.436 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:31.439+0000 7feea7f699c0 4 Zone: default (d9e72d30-c60b-4d0d-9267-fdc36392d5ad) 2024-09-14T11:10:31.436 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:31.439+0000 7feea7f699c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:10:31.436 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:31.439+0000 7feea7f699c0 20 zonegroup default 2024-09-14T11:10:31.437 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:31.439+0000 7feea7f699c0 20 rados->read ofs=0 len=0 2024-09-14T11:10:31.437 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:31.439+0000 7feea7f699c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:10:31.437 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:31.439+0000 7feea7f699c0 20 rados->read ofs=0 len=0 2024-09-14T11:10:31.437 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:31.439+0000 7feea7f699c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:10:31.437 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:31.439+0000 7feea7f699c0 20 rados->read ofs=0 len=0 2024-09-14T11:10:31.438 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:31.439+0000 7feea7f699c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:10:31.438 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:31.439+0000 7feea7f699c0 20 started sync module instance, tier type = 2024-09-14T11:10:31.438 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:31.439+0000 7feea7f699c0 20 started zone id=d9e72d30-c60b-4d0d-9267-fdc36392d5ad (name=default) with tier type = 2024-09-14T11:10:31.464 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:31.467+0000 7feea7f699c0 20 add_watcher() i=0 2024-09-14T11:10:31.464 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:31.467+0000 7feea7f699c0 20 add_watcher() i=1 2024-09-14T11:10:31.464 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:31.467+0000 7feea7f699c0 20 add_watcher() i=2 2024-09-14T11:10:31.464 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:31.467+0000 7feea7f699c0 20 add_watcher() i=3 2024-09-14T11:10:31.465 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:31.467+0000 7feea7f699c0 20 add_watcher() i=4 2024-09-14T11:10:31.465 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:31.467+0000 7feea7f699c0 20 add_watcher() i=5 2024-09-14T11:10:31.465 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:31.467+0000 7feea7f699c0 20 add_watcher() i=6 2024-09-14T11:10:31.467 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:31.471+0000 7feea7f699c0 20 add_watcher() i=7 2024-09-14T11:10:31.467 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:31.471+0000 7feea7f699c0 2 all 8 watchers are set, enabling cache 2024-09-14T11:10:31.472 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:31.475+0000 7fed577fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:10:31.473 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:31.475+0000 7feea7f699c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:10:31.473 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:31.475+0000 7feea7f699c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:10:31.473 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:31.475+0000 7feea7f699c0 5 note: GC not initialized 2024-09-14T11:10:31.473 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:31.475+0000 7fed567fc640 20 reqs_thread_entry: start 2024-09-14T11:10:31.473 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:31.475+0000 7feea7f699c0 20 init_complete bucket index max shards: 11 2024-09-14T11:10:31.474 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:31.475+0000 7feea7f699c0 20 Filter name: none 2024-09-14T11:10:31.474 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:31.475+0000 7fecc7fff640 20 reqs_thread_entry: start 2024-09-14T11:10:31.474 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:31.475+0000 7feea7f699c0 20 rados->read ofs=0 len=0 2024-09-14T11:10:31.474 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:31.475+0000 7feea7f699c0 20 rados_obj.operate() r=0 bl.length=190 2024-09-14T11:10:31.474 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:31.475+0000 7feea7f699c0 20 rados->read ofs=0 len=0 2024-09-14T11:10:31.475 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:31.475+0000 7feea7f699c0 20 rados_obj.operate() r=0 bl.length=412 2024-09-14T11:10:31.475 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:31.475+0000 7feea7f699c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:10:31.475 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:31.475+0000 7feea7f699c0 20 INFO: main: max_entries=1000, index=gen=0, max_shards=11 2024-09-14T11:10:31.475 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:31.475+0000 7feea7f699c0 20 INFO: main: starting shard=0 2024-09-14T11:10:31.475 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:31.475+0000 7feea7f699c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.1.0 2024-09-14T11:10:31.476 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:31.479+0000 7feea7f699c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:10:31.476 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:31.479+0000 7feea7f699c0 20 INFO: main: starting shard=1 2024-09-14T11:10:31.476 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:31.479+0000 7feea7f699c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.1.1 2024-09-14T11:10:31.477 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:31.479+0000 7feea7f699c0 20 INFO: main: bi_list() returned without error; entries.size()=1, is_truncated=0, marker= 2024-09-14T11:10:31.477 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:31.479+0000 7feea7f699c0 20 INFO: main: starting shard=2 2024-09-14T11:10:31.477 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:31.479+0000 7feea7f699c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.1.2 2024-09-14T11:10:31.477 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:31.479+0000 7feea7f699c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:10:31.478 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:31.479+0000 7feea7f699c0 20 INFO: main: starting shard=3 2024-09-14T11:10:31.478 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:31.479+0000 7feea7f699c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.1.3 2024-09-14T11:10:31.479 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:31.479+0000 7feea7f699c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:10:31.479 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:31.479+0000 7feea7f699c0 20 INFO: main: starting shard=4 2024-09-14T11:10:31.479 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:31.479+0000 7feea7f699c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.1.4 2024-09-14T11:10:31.480 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:31.483+0000 7feea7f699c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:10:31.480 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:31.483+0000 7feea7f699c0 20 INFO: main: starting shard=5 2024-09-14T11:10:31.480 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:31.483+0000 7feea7f699c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.1.5 2024-09-14T11:10:31.481 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:31.483+0000 7feea7f699c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:10:31.481 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:31.483+0000 7feea7f699c0 20 INFO: main: starting shard=6 2024-09-14T11:10:31.481 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:31.483+0000 7feea7f699c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.1.6 2024-09-14T11:10:31.482 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:31.483+0000 7feea7f699c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:10:31.482 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:31.483+0000 7feea7f699c0 20 INFO: main: starting shard=7 2024-09-14T11:10:31.482 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:31.483+0000 7feea7f699c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.1.7 2024-09-14T11:10:31.483 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:31.483+0000 7feea7f699c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:10:31.483 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:31.483+0000 7feea7f699c0 20 INFO: main: starting shard=8 2024-09-14T11:10:31.483 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:31.483+0000 7feea7f699c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.1.8 2024-09-14T11:10:31.484 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:31.487+0000 7feea7f699c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:10:31.484 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:31.487+0000 7feea7f699c0 20 INFO: main: starting shard=9 2024-09-14T11:10:31.484 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:31.487+0000 7feea7f699c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.1.9 2024-09-14T11:10:31.486 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:31.487+0000 7feea7f699c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:10:31.486 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:31.487+0000 7feea7f699c0 20 INFO: main: starting shard=10 2024-09-14T11:10:31.486 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:31.487+0000 7feea7f699c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.1.10 2024-09-14T11:10:31.486 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:31.487+0000 7feea7f699c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:10:31.486 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:31.487+0000 7feea7f699c0 20 INFO: main: done 2024-09-14T11:10:31.488 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:31.491+0000 7fed577fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:10:31.493 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:31.495+0000 7feea7f699c0 20 remove_watcher() i=0 2024-09-14T11:10:31.494 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:31.495+0000 7feea7f699c0 2 removed watcher, disabling cache 2024-09-14T11:10:31.496 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:31.499+0000 7feea7f699c0 20 remove_watcher() i=1 2024-09-14T11:10:31.498 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:31.499+0000 7feea7f699c0 20 remove_watcher() i=2 2024-09-14T11:10:31.501 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:31.503+0000 7feea7f699c0 20 remove_watcher() i=3 2024-09-14T11:10:31.503 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:31.503+0000 7feea7f699c0 20 remove_watcher() i=4 2024-09-14T11:10:31.505 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:31.507+0000 7feea7f699c0 20 remove_watcher() i=5 2024-09-14T11:10:31.506 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:31.507+0000 7feea7f699c0 20 remove_watcher() i=6 2024-09-14T11:10:31.508 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:31.511+0000 7feea7f699c0 20 remove_watcher() i=7 2024-09-14T11:10:31.527 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:10:31.527 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-14T11:10:31.557 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:10:31.557 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-14T11:10:31.664 INFO:tasks.workunit.client.0.smithi138.stderr:An error occurred (NoSuchKey) when calling the PutObject operation: None 2024-09-14T11:10:31.665 INFO:tasks.workunit.client.0.smithi138.stderr:radosgw-admin bi list --bucket check-bucket --object f 2024-09-14T11:10:31.699 INFO:tasks.workunit.client.0.smithi138.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:10:31.700 INFO:tasks.workunit.client.0.smithi138.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:10:31.744 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:31.747+0000 7fd3a55e59c0 20 rados->read ofs=0 len=0 2024-09-14T11:10:31.746 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:31.747+0000 7fd3a55e59c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:10:31.746 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:31.747+0000 7fd3a55e59c0 20 realm 2024-09-14T11:10:31.746 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:31.747+0000 7fd3a55e59c0 20 rados->read ofs=0 len=0 2024-09-14T11:10:31.747 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:31.747+0000 7fd3a55e59c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:10:31.747 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:31.747+0000 7fd3a55e59c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:10:31.747 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:31.747+0000 7fd3a55e59c0 20 rados->read ofs=0 len=0 2024-09-14T11:10:31.747 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:31.747+0000 7fd3a55e59c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:10:31.747 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:31.747+0000 7fd3a55e59c0 20 rados->read ofs=0 len=0 2024-09-14T11:10:31.748 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:31.751+0000 7fd3a55e59c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:10:31.749 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:31.751+0000 7fd3a55e59c0 20 rados->read ofs=0 len=0 2024-09-14T11:10:31.749 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:31.751+0000 7fd3a55e59c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:10:31.750 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:31.751+0000 7fd3a55e59c0 20 searching for the correct realm 2024-09-14T11:10:31.754 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:31.755+0000 7fd3a28ea640 0 -- 172.21.15.138:0/825598332 >> [v2:172.21.15.154:6808/1468088432,v1:172.21.15.154:6809/1468088432] conn(0x7fd394001260 msgr2=0x7fd3940803c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:10:31.761 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:31.763+0000 7fd3a28ea640 0 -- 172.21.15.138:0/825598332 >> [v2:172.21.15.138:6816/326481658,v1:172.21.15.138:6817/326481658] conn(0x7fd39c008050 msgr2=0x7fd39c05da30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-14T11:10:31.978 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:31.979+0000 7fd3a55e59c0 20 RGWRados::pool_iterate: got zone_info.d9e72d30-c60b-4d0d-9267-fdc36392d5ad 2024-09-14T11:10:31.979 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:31.979+0000 7fd3a55e59c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:10:31.979 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:31.979+0000 7fd3a55e59c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:10:31.979 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:31.979+0000 7fd3a55e59c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:10:31.979 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:31.979+0000 7fd3a55e59c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:10:31.979 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:31.979+0000 7fd3a55e59c0 20 RGWRados::pool_iterate: got zonegroup_info.65ab941b-da8c-4160-94fb-3672b069d44f 2024-09-14T11:10:31.979 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:31.979+0000 7fd3a55e59c0 20 rados->read ofs=0 len=0 2024-09-14T11:10:31.979 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:31.979+0000 7fd3a55e59c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:10:31.979 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:31.979+0000 7fd3a55e59c0 20 rados->read ofs=0 len=0 2024-09-14T11:10:31.980 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:31.983+0000 7fd3a55e59c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:10:31.980 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:31.983+0000 7fd3a55e59c0 20 rados->read ofs=0 len=0 2024-09-14T11:10:31.981 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:31.983+0000 7fd3a55e59c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:10:31.981 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:31.983+0000 7fd3a55e59c0 20 zone default found 2024-09-14T11:10:31.981 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:31.983+0000 7fd3a55e59c0 4 Realm: () 2024-09-14T11:10:31.981 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:31.983+0000 7fd3a55e59c0 4 ZoneGroup: default (65ab941b-da8c-4160-94fb-3672b069d44f) 2024-09-14T11:10:31.981 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:31.983+0000 7fd3a55e59c0 4 Zone: default (d9e72d30-c60b-4d0d-9267-fdc36392d5ad) 2024-09-14T11:10:31.981 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:31.983+0000 7fd3a55e59c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:10:31.981 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:31.983+0000 7fd3a55e59c0 20 zonegroup default 2024-09-14T11:10:31.982 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:31.983+0000 7fd3a55e59c0 20 rados->read ofs=0 len=0 2024-09-14T11:10:31.982 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:31.983+0000 7fd3a55e59c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:10:31.982 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:31.983+0000 7fd3a55e59c0 20 rados->read ofs=0 len=0 2024-09-14T11:10:31.982 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:31.983+0000 7fd3a55e59c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:10:31.982 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:31.983+0000 7fd3a55e59c0 20 rados->read ofs=0 len=0 2024-09-14T11:10:31.983 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:31.987+0000 7fd3a55e59c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:10:31.983 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:31.987+0000 7fd3a55e59c0 20 started sync module instance, tier type = 2024-09-14T11:10:31.983 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:31.987+0000 7fd3a55e59c0 20 started zone id=d9e72d30-c60b-4d0d-9267-fdc36392d5ad (name=default) with tier type = 2024-09-14T11:10:32.006 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:32.007+0000 7fd3a55e59c0 20 add_watcher() i=0 2024-09-14T11:10:32.006 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:32.007+0000 7fd3a55e59c0 20 add_watcher() i=1 2024-09-14T11:10:32.007 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:32.007+0000 7fd3a55e59c0 20 add_watcher() i=2 2024-09-14T11:10:32.007 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:32.007+0000 7fd3a55e59c0 20 add_watcher() i=3 2024-09-14T11:10:32.007 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:32.007+0000 7fd3a55e59c0 20 add_watcher() i=4 2024-09-14T11:10:32.007 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:32.007+0000 7fd3a55e59c0 20 add_watcher() i=5 2024-09-14T11:10:32.007 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:32.007+0000 7fd3a55e59c0 20 add_watcher() i=6 2024-09-14T11:10:32.008 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:32.011+0000 7fd3a55e59c0 20 add_watcher() i=7 2024-09-14T11:10:32.008 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:32.011+0000 7fd3a55e59c0 2 all 8 watchers are set, enabling cache 2024-09-14T11:10:32.013 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:32.015+0000 7fd259fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:10:32.014 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:32.015+0000 7fd3a55e59c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:10:32.014 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:32.015+0000 7fd3a55e59c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:10:32.014 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:32.015+0000 7fd3a55e59c0 5 note: GC not initialized 2024-09-14T11:10:32.014 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:32.015+0000 7fd258fe1640 20 reqs_thread_entry: start 2024-09-14T11:10:32.015 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:32.015+0000 7fd3a55e59c0 20 init_complete bucket index max shards: 11 2024-09-14T11:10:32.015 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:32.015+0000 7fd3a55e59c0 20 Filter name: none 2024-09-14T11:10:32.015 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:32.019+0000 7fd1d27fc640 20 reqs_thread_entry: start 2024-09-14T11:10:32.015 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:32.019+0000 7fd3a55e59c0 20 rados->read ofs=0 len=0 2024-09-14T11:10:32.016 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:32.019+0000 7fd3a55e59c0 20 rados_obj.operate() r=0 bl.length=190 2024-09-14T11:10:32.016 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:32.019+0000 7fd3a55e59c0 20 rados->read ofs=0 len=0 2024-09-14T11:10:32.017 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:32.019+0000 7fd3a55e59c0 20 rados_obj.operate() r=0 bl.length=412 2024-09-14T11:10:32.017 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:32.019+0000 7fd3a55e59c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:10:32.018 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:32.019+0000 7fd3a55e59c0 20 INFO: main: max_entries=1000, index=gen=0, max_shards=11 2024-09-14T11:10:32.018 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:32.019+0000 7fd3a55e59c0 20 INFO: main: starting shard=0 2024-09-14T11:10:32.018 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:32.019+0000 7fd3a55e59c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.1.0 2024-09-14T11:10:32.018 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:32.019+0000 7fd3a55e59c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:10:32.019 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:32.019+0000 7fd3a55e59c0 20 INFO: main: starting shard=1 2024-09-14T11:10:32.019 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:32.019+0000 7fd3a55e59c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.1.1 2024-09-14T11:10:32.019 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:32.019+0000 7fd3a55e59c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:10:32.019 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:32.019+0000 7fd3a55e59c0 20 INFO: main: starting shard=2 2024-09-14T11:10:32.019 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:32.019+0000 7fd3a55e59c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.1.2 2024-09-14T11:10:32.019 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:32.023+0000 7fd3a55e59c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:10:32.019 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:32.023+0000 7fd3a55e59c0 20 INFO: main: starting shard=3 2024-09-14T11:10:32.019 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:32.023+0000 7fd3a55e59c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.1.3 2024-09-14T11:10:32.020 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:32.023+0000 7fd3a55e59c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:10:32.021 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:32.023+0000 7fd3a55e59c0 20 INFO: main: starting shard=4 2024-09-14T11:10:32.021 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:32.023+0000 7fd3a55e59c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.1.4 2024-09-14T11:10:32.022 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:32.023+0000 7fd3a55e59c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:10:32.022 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:32.023+0000 7fd3a55e59c0 20 INFO: main: starting shard=5 2024-09-14T11:10:32.022 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:32.023+0000 7fd3a55e59c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.1.5 2024-09-14T11:10:32.022 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:32.023+0000 7fd3a55e59c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:10:32.022 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:32.023+0000 7fd3a55e59c0 20 INFO: main: starting shard=6 2024-09-14T11:10:32.023 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:32.023+0000 7fd3a55e59c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.1.6 2024-09-14T11:10:32.023 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:32.027+0000 7fd3a55e59c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:10:32.023 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:32.027+0000 7fd3a55e59c0 20 INFO: main: starting shard=7 2024-09-14T11:10:32.023 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:32.027+0000 7fd3a55e59c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.1.7 2024-09-14T11:10:32.024 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:32.027+0000 7fd3a55e59c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:10:32.025 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:32.027+0000 7fd3a55e59c0 20 INFO: main: starting shard=8 2024-09-14T11:10:32.025 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:32.027+0000 7fd3a55e59c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.1.8 2024-09-14T11:10:32.026 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:32.027+0000 7fd3a55e59c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:10:32.026 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:32.027+0000 7fd3a55e59c0 20 INFO: main: starting shard=9 2024-09-14T11:10:32.026 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:32.027+0000 7fd3a55e59c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.1.9 2024-09-14T11:10:32.027 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:32.031+0000 7fd3a55e59c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:10:32.027 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:32.031+0000 7fd3a55e59c0 20 INFO: main: starting shard=10 2024-09-14T11:10:32.027 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:32.031+0000 7fd3a55e59c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.1.10 2024-09-14T11:10:32.028 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:32.031+0000 7fd3a55e59c0 20 INFO: main: bi_list() returned without error; entries.size()=1, is_truncated=0, marker= 2024-09-14T11:10:32.028 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:32.031+0000 7fd3a55e59c0 20 INFO: main: done 2024-09-14T11:10:32.030 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:32.031+0000 7fd259fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:10:32.035 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:32.039+0000 7fd3a55e59c0 20 remove_watcher() i=0 2024-09-14T11:10:32.035 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:32.039+0000 7fd3a55e59c0 2 removed watcher, disabling cache 2024-09-14T11:10:32.037 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:32.039+0000 7fd3a55e59c0 20 remove_watcher() i=1 2024-09-14T11:10:32.039 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:32.043+0000 7fd3a55e59c0 20 remove_watcher() i=2 2024-09-14T11:10:32.041 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:32.043+0000 7fd3a55e59c0 20 remove_watcher() i=3 2024-09-14T11:10:32.043 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:32.047+0000 7fd3a55e59c0 20 remove_watcher() i=4 2024-09-14T11:10:32.045 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:32.047+0000 7fd3a55e59c0 20 remove_watcher() i=5 2024-09-14T11:10:32.047 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:32.047+0000 7fd3a55e59c0 20 remove_watcher() i=6 2024-09-14T11:10:32.048 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:32.051+0000 7fd3a55e59c0 20 remove_watcher() i=7 2024-09-14T11:10:32.065 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:10:32.065 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-14T11:10:32.094 INFO:tasks.workunit.client.0.smithi138.stderr:ceph config rm client rgw_debug_inject_set_olh_err 2024-09-14T11:10:32.524 INFO:tasks.workunit.client.0.smithi138.stderr:ceph config rm client rgw_debug_inject_olh_cancel_modification_err 2024-09-14T11:10:32.958 INFO:tasks.workunit.client.0.smithi138.stderr:TEST: bucket check unlinked finds unlistable entries 2024-09-14T11:10:32.958 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-14T11:10:32.958 INFO:tasks.workunit.client.0.smithi138.stderr:radosgw-admin bucket check unlinked --bucket check-bucket --min-age-hours 0 --dump-keys 2024-09-14T11:10:32.993 INFO:tasks.workunit.client.0.smithi138.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:10:32.994 INFO:tasks.workunit.client.0.smithi138.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:10:33.036 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:33.039+0000 7f6bed68c9c0 20 rados->read ofs=0 len=0 2024-09-14T11:10:33.037 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:33.039+0000 7f6bed68c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:10:33.037 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:33.039+0000 7f6bed68c9c0 20 realm 2024-09-14T11:10:33.037 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:33.039+0000 7f6bed68c9c0 20 rados->read ofs=0 len=0 2024-09-14T11:10:33.038 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:33.039+0000 7f6bed68c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:10:33.038 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:33.039+0000 7f6bed68c9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:10:33.038 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:33.039+0000 7f6bed68c9c0 20 rados->read ofs=0 len=0 2024-09-14T11:10:33.038 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:33.039+0000 7f6bed68c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:10:33.038 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:33.039+0000 7f6bed68c9c0 20 rados->read ofs=0 len=0 2024-09-14T11:10:33.039 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:33.039+0000 7f6bed68c9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:10:33.039 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:33.039+0000 7f6bed68c9c0 20 rados->read ofs=0 len=0 2024-09-14T11:10:33.040 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:33.043+0000 7f6bed68c9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:10:33.040 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:33.043+0000 7f6bed68c9c0 20 searching for the correct realm 2024-09-14T11:10:33.044 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:33.047+0000 7f6beb993640 0 -- 172.21.15.138:0/3508144425 >> [v2:172.21.15.154:6824/416768175,v1:172.21.15.154:6825/416768175] conn(0x7f6bdc0ab070 msgr2=0x7f6bdc0a4390 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:10:33.051 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:33.051+0000 7f6bea991640 0 -- 172.21.15.138:0/3508144425 >> [v2:172.21.15.138:6816/326481658,v1:172.21.15.138:6817/326481658] conn(0x7f6bdc108fc0 msgr2=0x7f6bdc101690 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-14T11:10:33.266 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:33.267+0000 7f6bed68c9c0 20 RGWRados::pool_iterate: got zone_info.d9e72d30-c60b-4d0d-9267-fdc36392d5ad 2024-09-14T11:10:33.266 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:33.267+0000 7f6bed68c9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:10:33.267 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:33.267+0000 7f6bed68c9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:10:33.267 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:33.267+0000 7f6bed68c9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:10:33.267 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:33.267+0000 7f6bed68c9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:10:33.267 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:33.267+0000 7f6bed68c9c0 20 RGWRados::pool_iterate: got zonegroup_info.65ab941b-da8c-4160-94fb-3672b069d44f 2024-09-14T11:10:33.267 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:33.267+0000 7f6bed68c9c0 20 rados->read ofs=0 len=0 2024-09-14T11:10:33.267 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:33.267+0000 7f6bed68c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:10:33.267 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:33.267+0000 7f6bed68c9c0 20 rados->read ofs=0 len=0 2024-09-14T11:10:33.268 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:33.271+0000 7f6bed68c9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:10:33.268 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:33.271+0000 7f6bed68c9c0 20 rados->read ofs=0 len=0 2024-09-14T11:10:33.269 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:33.271+0000 7f6bed68c9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:10:33.269 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:33.271+0000 7f6bed68c9c0 20 zone default found 2024-09-14T11:10:33.269 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:33.271+0000 7f6bed68c9c0 4 Realm: () 2024-09-14T11:10:33.269 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:33.271+0000 7f6bed68c9c0 4 ZoneGroup: default (65ab941b-da8c-4160-94fb-3672b069d44f) 2024-09-14T11:10:33.270 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:33.271+0000 7f6bed68c9c0 4 Zone: default (d9e72d30-c60b-4d0d-9267-fdc36392d5ad) 2024-09-14T11:10:33.270 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:33.271+0000 7f6bed68c9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:10:33.270 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:33.271+0000 7f6bed68c9c0 20 zonegroup default 2024-09-14T11:10:33.270 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:33.271+0000 7f6bed68c9c0 20 rados->read ofs=0 len=0 2024-09-14T11:10:33.271 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:33.271+0000 7f6bed68c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:10:33.271 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:33.271+0000 7f6bed68c9c0 20 rados->read ofs=0 len=0 2024-09-14T11:10:33.272 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:33.271+0000 7f6bed68c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:10:33.272 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:33.271+0000 7f6bed68c9c0 20 rados->read ofs=0 len=0 2024-09-14T11:10:33.272 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:33.275+0000 7f6bed68c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:10:33.272 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:33.275+0000 7f6bed68c9c0 20 started sync module instance, tier type = 2024-09-14T11:10:33.272 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:33.275+0000 7f6bed68c9c0 20 started zone id=d9e72d30-c60b-4d0d-9267-fdc36392d5ad (name=default) with tier type = 2024-09-14T11:10:33.295 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:33.295+0000 7f6bed68c9c0 20 add_watcher() i=0 2024-09-14T11:10:33.295 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:33.295+0000 7f6bed68c9c0 20 add_watcher() i=1 2024-09-14T11:10:33.295 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:33.295+0000 7f6bed68c9c0 20 add_watcher() i=2 2024-09-14T11:10:33.295 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:33.295+0000 7f6bed68c9c0 20 add_watcher() i=3 2024-09-14T11:10:33.296 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:33.295+0000 7f6bed68c9c0 20 add_watcher() i=4 2024-09-14T11:10:33.296 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:33.295+0000 7f6bed68c9c0 20 add_watcher() i=5 2024-09-14T11:10:33.296 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:33.299+0000 7f6bed68c9c0 20 add_watcher() i=6 2024-09-14T11:10:33.297 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:33.299+0000 7f6bed68c9c0 20 add_watcher() i=7 2024-09-14T11:10:33.297 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:33.299+0000 7f6bed68c9c0 2 all 8 watchers are set, enabling cache 2024-09-14T11:10:33.301 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:33.303+0000 7f6aa1fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:10:33.302 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:33.303+0000 7f6bed68c9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:10:33.303 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:33.303+0000 7f6bed68c9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:10:33.303 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:33.303+0000 7f6bed68c9c0 5 note: GC not initialized 2024-09-14T11:10:33.303 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:33.303+0000 7f6aa0fe1640 20 reqs_thread_entry: start 2024-09-14T11:10:33.303 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:33.303+0000 7f6bed68c9c0 20 init_complete bucket index max shards: 11 2024-09-14T11:10:33.303 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:33.303+0000 7f6bed68c9c0 20 Filter name: none 2024-09-14T11:10:33.304 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:33.303+0000 7f6a1a7fc640 20 reqs_thread_entry: start 2024-09-14T11:10:33.304 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:33.303+0000 7f6bed68c9c0 10 cache get: name=default.rgw.meta+root+check-bucket : miss 2024-09-14T11:10:33.304 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:33.303+0000 7f6bed68c9c0 20 rados->read ofs=0 len=0 2024-09-14T11:10:33.307 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:33.303+0000 7f6bed68c9c0 20 rados_obj.operate() r=0 bl.length=190 2024-09-14T11:10:33.307 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:33.303+0000 7f6bed68c9c0 10 cache put: name=default.rgw.meta+root+check-bucket info.flags=0x11 2024-09-14T11:10:33.307 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:33.303+0000 7f6bed68c9c0 10 adding default.rgw.meta+root+check-bucket to cache LRU end 2024-09-14T11:10:33.307 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:33.303+0000 7f6bed68c9c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.check-bucket:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.1 : miss 2024-09-14T11:10:33.307 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:33.303+0000 7f6bed68c9c0 20 rados->read ofs=0 len=0 2024-09-14T11:10:33.308 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:33.307+0000 7f6bed68c9c0 20 rados_obj.operate() r=0 bl.length=412 2024-09-14T11:10:33.308 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:33.307+0000 7f6bed68c9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.check-bucket:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.1 info.flags=0x17 2024-09-14T11:10:33.308 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:33.307+0000 7f6bed68c9c0 10 adding default.rgw.meta+root+.bucket.meta.check-bucket:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.1 to cache LRU end 2024-09-14T11:10:33.308 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:33.307+0000 7f6bed68c9c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:10:33.308 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:33.307+0000 7f6bed68c9c0 10 updating xattr: name=user.rgw.acl bl.length()=179 2024-09-14T11:10:33.309 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:33.307+0000 7f6bed68c9c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.check-bucket:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.1 2024-09-14T11:10:33.309 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:33.307+0000 7f6bed68c9c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.1.0 2024-09-14T11:10:33.309 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:33.307+0000 7f6bed68c9c0 1 NOTICE: finished shard 0 (0 entries found) 2024-09-14T11:10:33.309 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:33.307+0000 7f6bed68c9c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.1.1 2024-09-14T11:10:33.309 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:33.307+0000 7f6bed68c9c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.1.2 2024-09-14T11:10:33.309 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:33.307+0000 7f6bed68c9c0 1 NOTICE: finished shard 2 (0 entries found) 2024-09-14T11:10:33.310 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:33.307+0000 7f6bed68c9c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.1.3 2024-09-14T11:10:33.311 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:33.311+0000 7f6bed68c9c0 1 NOTICE: finished shard 3 (0 entries found) 2024-09-14T11:10:33.311 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:33.311+0000 7f6bed68c9c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.1.4 2024-09-14T11:10:33.311 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:33.311+0000 7f6bed68c9c0 1 NOTICE: finished shard 4 (0 entries found) 2024-09-14T11:10:33.311 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:33.311+0000 7f6bed68c9c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.1.5 2024-09-14T11:10:33.312 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:33.311+0000 7f6bed68c9c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.1.6 2024-09-14T11:10:33.312 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:33.311+0000 7f6bed68c9c0 1 NOTICE: finished shard 6 (0 entries found) 2024-09-14T11:10:33.312 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:33.311+0000 7f6bed68c9c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.1.7 2024-09-14T11:10:33.313 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:33.315+0000 7f6bed68c9c0 1 NOTICE: finished shard 7 (0 entries found) 2024-09-14T11:10:33.313 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:33.315+0000 7f6bed68c9c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.1.8 2024-09-14T11:10:33.314 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:33.315+0000 7f6bed68c9c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.1.9 2024-09-14T11:10:33.315 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:33.319+0000 7f6bed68c9c0 1 NOTICE: finished shard 9 (0 entries found) 2024-09-14T11:10:33.316 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:33.319+0000 7f6bed68c9c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.1.10 2024-09-14T11:10:33.317 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:33.319+0000 7f6bed68c9c0 1 NOTICE: finished shard 1 (1 entries found) 2024-09-14T11:10:33.317 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:33.319+0000 7f6bed68c9c0 1 NOTICE: finished shard 5 (1 entries found) 2024-09-14T11:10:33.317 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:33.319+0000 7f6bed68c9c0 1 NOTICE: finished shard 8 (1 entries found) 2024-09-14T11:10:33.317 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:33.319+0000 7f6bed68c9c0 1 NOTICE: finished shard 10 (1 entries found) 2024-09-14T11:10:33.318 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:33.319+0000 7f6bed68c9c0 1 NOTICE: finished all shards (4 entries found) 2024-09-14T11:10:33.318 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:33.319+0000 7f6aa1fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:10:33.323 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:33.323+0000 7f6bed68c9c0 20 remove_watcher() i=0 2024-09-14T11:10:33.323 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:33.323+0000 7f6bed68c9c0 2 removed watcher, disabling cache 2024-09-14T11:10:33.325 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:33.327+0000 7f6bed68c9c0 20 remove_watcher() i=1 2024-09-14T11:10:33.327 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:33.327+0000 7f6bed68c9c0 20 remove_watcher() i=2 2024-09-14T11:10:33.329 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:33.331+0000 7f6bed68c9c0 20 remove_watcher() i=3 2024-09-14T11:10:33.332 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:33.335+0000 7f6bed68c9c0 20 remove_watcher() i=4 2024-09-14T11:10:33.333 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:33.335+0000 7f6bed68c9c0 20 remove_watcher() i=5 2024-09-14T11:10:33.335 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:33.339+0000 7f6bed68c9c0 20 remove_watcher() i=6 2024-09-14T11:10:33.337 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:33.339+0000 7f6bed68c9c0 20 remove_watcher() i=7 2024-09-14T11:10:33.351 INFO:tasks.workunit.client.0.smithi138.stderr:TEST: unlinked entries are not listable 2024-09-14T11:10:33.351 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-14T11:10:33.353 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:10:33.354 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-14T11:10:33.560 INFO:tasks.workunit.client.0.smithi138.stderr:TEST: GET returns 404 for unlinked entry keys that have no other versions 2024-09-14T11:10:33.560 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-14T11:10:33.565 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:10:33.566 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-14T11:10:33.697 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:10:33.697 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-14T11:10:33.796 INFO:tasks.workunit.client.0.smithi138.stderr:TEST: bucket check unlinked fixes unlistable entries 2024-09-14T11:10:33.797 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-14T11:10:33.797 INFO:tasks.workunit.client.0.smithi138.stderr:radosgw-admin bucket check unlinked --bucket check-bucket --fix --min-age-hours 0 --rgw-olh-pending-timeout-sec 0 --dump-keys 2024-09-14T11:10:33.837 INFO:tasks.workunit.client.0.smithi138.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:10:33.837 INFO:tasks.workunit.client.0.smithi138.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:10:33.883 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:33.883+0000 7fac720bb9c0 20 rados->read ofs=0 len=0 2024-09-14T11:10:33.885 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:33.887+0000 7fac720bb9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:10:33.885 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:33.887+0000 7fac720bb9c0 20 realm 2024-09-14T11:10:33.885 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:33.887+0000 7fac720bb9c0 20 rados->read ofs=0 len=0 2024-09-14T11:10:33.885 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:33.887+0000 7fac720bb9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:10:33.885 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:33.887+0000 7fac720bb9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:10:33.885 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:33.887+0000 7fac720bb9c0 20 rados->read ofs=0 len=0 2024-09-14T11:10:33.885 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:33.887+0000 7fac720bb9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:10:33.885 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:33.887+0000 7fac720bb9c0 20 rados->read ofs=0 len=0 2024-09-14T11:10:33.886 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:33.887+0000 7fac720bb9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:10:33.887 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:33.887+0000 7fac720bb9c0 20 rados->read ofs=0 len=0 2024-09-14T11:10:33.887 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:33.891+0000 7fac720bb9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:10:33.888 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:33.891+0000 7fac720bb9c0 20 searching for the correct realm 2024-09-14T11:10:33.891 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:33.891+0000 7fac703c2640 0 -- 172.21.15.138:0/4082884296 >> [v2:172.21.15.154:6824/416768175,v1:172.21.15.154:6825/416768175] conn(0x7fac68027040 msgr2=0x7fac68027420 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:10:34.104 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:34.107+0000 7fac6f3c0640 0 -- 172.21.15.138:0/4082884296 >> [v2:172.21.15.138:6816/326481658,v1:172.21.15.138:6817/326481658] conn(0x7fac6802ec10 msgr2=0x7fac68055410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:10:34.323 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:34.327+0000 7fac720bb9c0 20 RGWRados::pool_iterate: got zone_info.d9e72d30-c60b-4d0d-9267-fdc36392d5ad 2024-09-14T11:10:34.324 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:34.327+0000 7fac720bb9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:10:34.324 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:34.327+0000 7fac720bb9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:10:34.324 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:34.327+0000 7fac720bb9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:10:34.324 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:34.327+0000 7fac720bb9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:10:34.324 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:34.327+0000 7fac720bb9c0 20 RGWRados::pool_iterate: got zonegroup_info.65ab941b-da8c-4160-94fb-3672b069d44f 2024-09-14T11:10:34.324 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:34.327+0000 7fac720bb9c0 20 rados->read ofs=0 len=0 2024-09-14T11:10:34.324 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:34.327+0000 7fac720bb9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:10:34.324 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:34.327+0000 7fac720bb9c0 20 rados->read ofs=0 len=0 2024-09-14T11:10:34.325 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:34.327+0000 7fac720bb9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:10:34.325 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:34.327+0000 7fac720bb9c0 20 rados->read ofs=0 len=0 2024-09-14T11:10:34.326 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:34.327+0000 7fac720bb9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:10:34.326 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:34.327+0000 7fac720bb9c0 20 zone default found 2024-09-14T11:10:34.326 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:34.327+0000 7fac720bb9c0 4 Realm: () 2024-09-14T11:10:34.326 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:34.327+0000 7fac720bb9c0 4 ZoneGroup: default (65ab941b-da8c-4160-94fb-3672b069d44f) 2024-09-14T11:10:34.326 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:34.327+0000 7fac720bb9c0 4 Zone: default (d9e72d30-c60b-4d0d-9267-fdc36392d5ad) 2024-09-14T11:10:34.326 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:34.327+0000 7fac720bb9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:10:34.327 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:34.327+0000 7fac720bb9c0 20 zonegroup default 2024-09-14T11:10:34.327 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:34.327+0000 7fac720bb9c0 20 rados->read ofs=0 len=0 2024-09-14T11:10:34.327 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:34.327+0000 7fac720bb9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:10:34.327 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:34.327+0000 7fac720bb9c0 20 rados->read ofs=0 len=0 2024-09-14T11:10:34.327 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:34.331+0000 7fac720bb9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:10:34.328 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:34.331+0000 7fac720bb9c0 20 rados->read ofs=0 len=0 2024-09-14T11:10:34.328 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:34.331+0000 7fac720bb9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:10:34.328 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:34.331+0000 7fac720bb9c0 20 started sync module instance, tier type = 2024-09-14T11:10:34.328 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:34.331+0000 7fac720bb9c0 20 started zone id=d9e72d30-c60b-4d0d-9267-fdc36392d5ad (name=default) with tier type = 2024-09-14T11:10:34.353 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:34.355+0000 7fac720bb9c0 20 add_watcher() i=0 2024-09-14T11:10:34.353 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:34.355+0000 7fac720bb9c0 20 add_watcher() i=1 2024-09-14T11:10:34.353 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:34.355+0000 7fac720bb9c0 20 add_watcher() i=2 2024-09-14T11:10:34.353 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:34.355+0000 7fac720bb9c0 20 add_watcher() i=3 2024-09-14T11:10:34.354 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:34.355+0000 7fac720bb9c0 20 add_watcher() i=4 2024-09-14T11:10:34.354 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:34.355+0000 7fac720bb9c0 20 add_watcher() i=5 2024-09-14T11:10:34.354 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:34.355+0000 7fac720bb9c0 20 add_watcher() i=6 2024-09-14T11:10:34.356 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:34.359+0000 7fac720bb9c0 20 add_watcher() i=7 2024-09-14T11:10:34.356 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:34.359+0000 7fac720bb9c0 2 all 8 watchers are set, enabling cache 2024-09-14T11:10:34.360 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:34.363+0000 7fab25fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:10:34.361 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:34.363+0000 7fac720bb9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:10:34.361 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:34.363+0000 7fac720bb9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:10:34.361 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:34.363+0000 7fac720bb9c0 5 note: GC not initialized 2024-09-14T11:10:34.361 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:34.363+0000 7fab24fe1640 20 reqs_thread_entry: start 2024-09-14T11:10:34.362 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:34.363+0000 7fac720bb9c0 20 init_complete bucket index max shards: 11 2024-09-14T11:10:34.362 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:34.363+0000 7fac720bb9c0 20 Filter name: none 2024-09-14T11:10:34.362 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:34.363+0000 7faa9e7fc640 20 reqs_thread_entry: start 2024-09-14T11:10:34.362 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:34.363+0000 7fac720bb9c0 10 cache get: name=default.rgw.meta+root+check-bucket : miss 2024-09-14T11:10:34.362 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:34.363+0000 7fac720bb9c0 20 rados->read ofs=0 len=0 2024-09-14T11:10:34.363 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:34.363+0000 7fac720bb9c0 20 rados_obj.operate() r=0 bl.length=190 2024-09-14T11:10:34.363 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:34.363+0000 7fac720bb9c0 10 cache put: name=default.rgw.meta+root+check-bucket info.flags=0x11 2024-09-14T11:10:34.363 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:34.363+0000 7fac720bb9c0 10 adding default.rgw.meta+root+check-bucket to cache LRU end 2024-09-14T11:10:34.363 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:34.363+0000 7fac720bb9c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.check-bucket:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.1 : miss 2024-09-14T11:10:34.363 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:34.363+0000 7fac720bb9c0 20 rados->read ofs=0 len=0 2024-09-14T11:10:34.364 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:34.367+0000 7fac720bb9c0 20 rados_obj.operate() r=0 bl.length=412 2024-09-14T11:10:34.364 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:34.367+0000 7fac720bb9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.check-bucket:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.1 info.flags=0x17 2024-09-14T11:10:34.364 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:34.367+0000 7fac720bb9c0 10 adding default.rgw.meta+root+.bucket.meta.check-bucket:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.1 to cache LRU end 2024-09-14T11:10:34.365 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:34.367+0000 7fac720bb9c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:10:34.365 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:34.367+0000 7fac720bb9c0 10 updating xattr: name=user.rgw.acl bl.length()=179 2024-09-14T11:10:34.365 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:34.367+0000 7fac720bb9c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.check-bucket:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.1 2024-09-14T11:10:34.365 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:34.367+0000 7fac720bb9c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.1.0 2024-09-14T11:10:34.365 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:34.367+0000 7fac720bb9c0 1 NOTICE: finished shard 0 (0 entries removed) 2024-09-14T11:10:34.365 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:34.367+0000 7fac720bb9c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.1.1 2024-09-14T11:10:34.366 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:34.367+0000 7fac720bb9c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.1.2 2024-09-14T11:10:34.366 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:34.367+0000 7fac720bb9c0 1 NOTICE: finished shard 2 (0 entries removed) 2024-09-14T11:10:34.366 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:34.367+0000 7fac720bb9c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.1.3 2024-09-14T11:10:34.367 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:34.371+0000 7fac720bb9c0 1 NOTICE: finished shard 3 (0 entries removed) 2024-09-14T11:10:34.367 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:34.371+0000 7fac720bb9c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.1.4 2024-09-14T11:10:34.368 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:34.371+0000 7fac720bb9c0 1 NOTICE: finished shard 4 (0 entries removed) 2024-09-14T11:10:34.368 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:34.371+0000 7fac720bb9c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.1.5 2024-09-14T11:10:34.369 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:34.371+0000 7fac720bb9c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.1.6 2024-09-14T11:10:34.370 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:34.371+0000 7fac720bb9c0 1 NOTICE: finished shard 6 (0 entries removed) 2024-09-14T11:10:34.370 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:34.371+0000 7fac720bb9c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.1.7 2024-09-14T11:10:34.371 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:34.371+0000 7fac720bb9c0 1 NOTICE: finished shard 7 (0 entries removed) 2024-09-14T11:10:34.371 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:34.371+0000 7fac720bb9c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.1.8 2024-09-14T11:10:34.372 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:34.375+0000 7fac720bb9c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.1.9 2024-09-14T11:10:34.373 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:34.375+0000 7fac720bb9c0 1 NOTICE: finished shard 9 (0 entries removed) 2024-09-14T11:10:34.373 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:34.375+0000 7fac720bb9c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.1.10 2024-09-14T11:10:34.374 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:34.375+0000 7fac720bb9c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.1.1 2024-09-14T11:10:34.375 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:34.375+0000 7fac720bb9c0 20 get_obj_state: octx=0x5637705bd930 obj=check-bucket:e state=0x563770874908 s->prefetch_data=0 2024-09-14T11:10:34.375 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:34.375+0000 7fac720bb9c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.1.5 2024-09-14T11:10:34.376 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:34.379+0000 7fac720bb9c0 20 get_obj_state: octx=0x5637705cf1e0 obj=check-bucket:d state=0x56377086a4b8 s->prefetch_data=0 2024-09-14T11:10:34.376 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:34.379+0000 7fac720bb9c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.1.8 2024-09-14T11:10:34.377 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:34.379+0000 7fac720bb9c0 20 get_obj_state: octx=0x56377086d300 obj=check-bucket:c state=0x56377086b018 s->prefetch_data=0 2024-09-14T11:10:34.377 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:34.379+0000 7fac720bb9c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.1.10 2024-09-14T11:10:34.377 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:34.379+0000 7fac720bb9c0 20 get_obj_state: octx=0x563770871530 obj=check-bucket:f state=0x56377086e2e8 s->prefetch_data=0 2024-09-14T11:10:34.377 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:34.379+0000 7fac720bb9c0 20 get_obj_state: setting s->obj_tag to z9nttsnb5f66fnw5h7z79kikk4d07ssu 2024-09-14T11:10:34.378 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:34.379+0000 7fac720bb9c0 20 get_obj_state_impl: setting s->olh_tag to gmnv2gwbvfwyqhgq74hvouqz5aahzf8x 2024-09-14T11:10:34.378 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:34.379+0000 7fac720bb9c0 20 bucket_index_guard_olh_op(): olh_state.olh_tag=gmnv2gwbvfwyqhgq74hvouqz5aahzf8x 2024-09-14T11:10:34.378 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:34.379+0000 7fac720bb9c0 20 get_obj_state: setting s->obj_tag to 1mmtrayngl0yhzookb7ex9soprrrdcrt 2024-09-14T11:10:34.378 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:34.379+0000 7fac720bb9c0 20 get_obj_state_impl: setting s->olh_tag to uhnbtunu964ed71955r4rfc5zlpwrdwa 2024-09-14T11:10:34.378 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:34.379+0000 7fac720bb9c0 20 bucket_index_guard_olh_op(): olh_state.olh_tag=uhnbtunu964ed71955r4rfc5zlpwrdwa 2024-09-14T11:10:34.378 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:34.379+0000 7fac720bb9c0 20 get_obj_state: setting s->obj_tag to 3t443ssjxlycf3zvvetsg9pmbpqhe8vv 2024-09-14T11:10:34.378 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:34.379+0000 7fac720bb9c0 20 get_obj_state_impl: setting s->olh_tag to syfx43intaq0qa87q5hg7i9rs5v5ok0g 2024-09-14T11:10:34.378 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:34.379+0000 7fac720bb9c0 20 bucket_index_guard_olh_op(): olh_state.olh_tag=syfx43intaq0qa87q5hg7i9rs5v5ok0g 2024-09-14T11:10:34.378 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:34.379+0000 7fac720bb9c0 20 get_obj_state: setting s->obj_tag to 7s8poefkfuuz1yw0dntu8gm5k7s8kywd 2024-09-14T11:10:34.378 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:34.379+0000 7fac720bb9c0 20 get_obj_state_impl: setting s->olh_tag to fec31erh4g2mhhzs0sxs52jkco4iqk71 2024-09-14T11:10:34.379 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:34.379+0000 7fac720bb9c0 20 bucket_index_guard_olh_op(): olh_state.olh_tag=fec31erh4g2mhhzs0sxs52jkco4iqk71 2024-09-14T11:10:34.381 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:34.383+0000 7fac720bb9c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.1.5 2024-09-14T11:10:34.382 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:34.383+0000 7fac720bb9c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.1.1 2024-09-14T11:10:34.383 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:34.383+0000 7fac720bb9c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.1.8 2024-09-14T11:10:34.386 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:34.387+0000 7fac720bb9c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.1.10 2024-09-14T11:10:34.386 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:34.387+0000 7fac720bb9c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.1.5 2024-09-14T11:10:34.387 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:34.387+0000 7fac720bb9c0 20 olh_log_entry: epoch=3 op=3 key=d[sHbJlJ4e3JelpeBGCTMHSHb5zkzPd27] 2024-09-14T11:10:34.387 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:34.387+0000 7fac720bb9c0 20 get_obj_state: octx=0x5637705cf1e0 obj=check-bucket:_:sHbJlJ4e3JelpeBGCTMHSHb5zkzPd27_d state=0x5637709177d8 s->prefetch_data=0 2024-09-14T11:10:34.387 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:34.391+0000 7fac720bb9c0 10 manifest: total_size = 22 2024-09-14T11:10:34.388 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:34.391+0000 7fac720bb9c0 20 get_obj_state: setting s->obj_tag to d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.9484167030228748208 2024-09-14T11:10:34.388 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:34.391+0000 7fac720bb9c0 20 get_obj_state: octx=0x5637705cf1e0 obj=check-bucket:_:sHbJlJ4e3JelpeBGCTMHSHb5zkzPd27_d state=0x5637709177d8 s->prefetch_data=0 2024-09-14T11:10:34.388 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:34.391+0000 7fac720bb9c0 20 prepare_atomic_modification: state is not atomic. state=0x5637709177d8 2024-09-14T11:10:34.388 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:34.391+0000 7fac720bb9c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.1.5 2024-09-14T11:10:34.388 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:34.391+0000 7fac720bb9c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.1.1 2024-09-14T11:10:34.389 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:34.391+0000 7fac720bb9c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.1.10 2024-09-14T11:10:34.389 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:34.391+0000 7fac720bb9c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.1.8 2024-09-14T11:10:34.390 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:34.391+0000 7fac720bb9c0 20 olh_log_entry: epoch=2 op=2 key=e[] 2024-09-14T11:10:34.390 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:34.391+0000 7fac720bb9c0 20 olh_log_entry: epoch=2 op=3 key=e[IvUJFJjAieA503LP9Bq3GH.5XgTsHbh] 2024-09-14T11:10:34.390 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:34.391+0000 7fac720bb9c0 20 get_obj_state: octx=0x5637705bd930 obj=check-bucket:_:IvUJFJjAieA503LP9Bq3GH.5XgTsHbh_e state=0x56377091da88 s->prefetch_data=0 2024-09-14T11:10:34.390 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:34.391+0000 7fac720bb9c0 20 olh_log_entry: epoch=2 op=2 key=f[] 2024-09-14T11:10:34.390 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:34.391+0000 7fac720bb9c0 20 olh_log_entry: epoch=2 op=3 key=f[aVde33itEzDJCPC1VZLlH4T8TPdjmmH] 2024-09-14T11:10:34.390 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:34.391+0000 7fac720bb9c0 20 get_obj_state: octx=0x563770871530 obj=check-bucket:_:aVde33itEzDJCPC1VZLlH4T8TPdjmmH_f state=0x563770924648 s->prefetch_data=0 2024-09-14T11:10:34.391 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:34.391+0000 7fac720bb9c0 10 manifest: total_size = 9 2024-09-14T11:10:34.391 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:34.391+0000 7fac720bb9c0 20 get_obj_state: setting s->obj_tag to d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.17416331525135973188 2024-09-14T11:10:34.391 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:34.391+0000 7fac720bb9c0 20 get_obj_state: octx=0x5637705bd930 obj=check-bucket:_:IvUJFJjAieA503LP9Bq3GH.5XgTsHbh_e state=0x56377091da88 s->prefetch_data=0 2024-09-14T11:10:34.391 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:34.391+0000 7fac720bb9c0 20 prepare_atomic_modification: state is not atomic. state=0x56377091da88 2024-09-14T11:10:34.391 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:34.391+0000 7fac720bb9c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.1.1 2024-09-14T11:10:34.391 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:34.391+0000 7fac720bb9c0 20 olh_log_entry: epoch=3 op=3 key=c[C3-u7.cbaoAzPYk6vWpzmlpogb2Ann9] 2024-09-14T11:10:34.391 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:34.391+0000 7fac720bb9c0 20 get_obj_state: octx=0x56377086d300 obj=check-bucket:_:C3-u7.cbaoAzPYk6vWpzmlpogb2Ann9_c state=0x56377092c128 s->prefetch_data=0 2024-09-14T11:10:34.391 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:34.391+0000 7fac720bb9c0 10 manifest: total_size = 22 2024-09-14T11:10:34.391 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:34.391+0000 7fac720bb9c0 20 get_obj_state: setting s->obj_tag to d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.17846658527991773076 2024-09-14T11:10:34.392 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:34.391+0000 7fac720bb9c0 20 get_obj_state: octx=0x563770871530 obj=check-bucket:_:aVde33itEzDJCPC1VZLlH4T8TPdjmmH_f state=0x563770924648 s->prefetch_data=0 2024-09-14T11:10:34.392 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:34.391+0000 7fac720bb9c0 20 prepare_atomic_modification: state is not atomic. state=0x563770924648 2024-09-14T11:10:34.392 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:34.391+0000 7fac720bb9c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.1.10 2024-09-14T11:10:34.392 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:34.391+0000 7fac720bb9c0 10 manifest: total_size = 22 2024-09-14T11:10:34.392 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:34.391+0000 7fac720bb9c0 20 get_obj_state: setting s->obj_tag to d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.16202157025630101530 2024-09-14T11:10:34.392 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:34.391+0000 7fac720bb9c0 20 get_obj_state: octx=0x56377086d300 obj=check-bucket:_:C3-u7.cbaoAzPYk6vWpzmlpogb2Ann9_c state=0x56377092c128 s->prefetch_data=0 2024-09-14T11:10:34.392 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:34.391+0000 7fac720bb9c0 20 prepare_atomic_modification: state is not atomic. state=0x56377092c128 2024-09-14T11:10:34.392 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:34.391+0000 7fac720bb9c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.1.8 2024-09-14T11:10:34.399 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:34.403+0000 7fab4e7fc640 20 handle_completion(): completion ok for obj=d[sHbJlJ4e3JelpeBGCTMHSHb5zkzPd27] 2024-09-14T11:10:34.399 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:34.403+0000 7fac720bb9c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.1.5 2024-09-14T11:10:34.399 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:34.403+0000 7fac720bb9c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.1.5 2024-09-14T11:10:34.400 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:34.403+0000 7fab4effd640 20 handle_completion(): completion ok for obj=e[IvUJFJjAieA503LP9Bq3GH.5XgTsHbh] 2024-09-14T11:10:34.402 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:34.403+0000 7fac720bb9c0 20 get_obj_state: octx=0x5637705bd930 obj=check-bucket:e state=0x563770874908 s->prefetch_data=0 2024-09-14T11:10:34.402 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:34.403+0000 7fac720bb9c0 20 bucket_index_guard_olh_op(): olh_state.olh_tag=gmnv2gwbvfwyqhgq74hvouqz5aahzf8x 2024-09-14T11:10:34.405 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:34.407+0000 7fab4effd640 20 handle_completion(): completion ok for obj=f[aVde33itEzDJCPC1VZLlH4T8TPdjmmH] 2024-09-14T11:10:34.405 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:34.407+0000 7fac720bb9c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.1.5 2024-09-14T11:10:34.405 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:34.407+0000 7fac720bb9c0 1 NOTICE: finished shard 5 (1 entries removed) 2024-09-14T11:10:34.406 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:34.407+0000 7fac720bb9c0 20 get_obj_state: octx=0x563770871530 obj=check-bucket:f state=0x56377086e2e8 s->prefetch_data=0 2024-09-14T11:10:34.406 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:34.407+0000 7fac720bb9c0 20 bucket_index_guard_olh_op(): olh_state.olh_tag=fec31erh4g2mhhzs0sxs52jkco4iqk71 2024-09-14T11:10:34.406 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:34.407+0000 7fac720bb9c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.1.8 2024-09-14T11:10:34.406 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:34.407+0000 7fac720bb9c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.1.8 2024-09-14T11:10:34.407 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:34.407+0000 7fab4effd640 20 handle_completion(): completion ok for obj=c[C3-u7.cbaoAzPYk6vWpzmlpogb2Ann9] 2024-09-14T11:10:34.411 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:34.415+0000 7fac720bb9c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.1.8 2024-09-14T11:10:34.411 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:34.415+0000 7fac720bb9c0 1 NOTICE: finished shard 8 (1 entries removed) 2024-09-14T11:10:34.415 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:34.415+0000 7fac720bb9c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.1.1 2024-09-14T11:10:34.416 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:34.419+0000 7fac720bb9c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.1.10 2024-09-14T11:10:34.417 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:34.419+0000 7fac720bb9c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.1.1 2024-09-14T11:10:34.417 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:34.419+0000 7fac720bb9c0 1 NOTICE: finished shard 1 (1 entries removed) 2024-09-14T11:10:34.419 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:34.419+0000 7fac720bb9c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.1.10 2024-09-14T11:10:34.419 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:34.419+0000 7fac720bb9c0 1 NOTICE: finished shard 10 (1 entries removed) 2024-09-14T11:10:34.419 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:34.419+0000 7fac720bb9c0 1 NOTICE: finished all shards (4 entries removed) 2024-09-14T11:10:34.420 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:34.423+0000 7fab25fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:10:34.425 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:34.427+0000 7fac720bb9c0 20 remove_watcher() i=0 2024-09-14T11:10:34.425 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:34.427+0000 7fac720bb9c0 2 removed watcher, disabling cache 2024-09-14T11:10:34.427 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:34.427+0000 7fac720bb9c0 20 remove_watcher() i=1 2024-09-14T11:10:34.429 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:34.431+0000 7fac720bb9c0 20 remove_watcher() i=2 2024-09-14T11:10:34.432 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:34.435+0000 7fac720bb9c0 20 remove_watcher() i=3 2024-09-14T11:10:34.434 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:34.435+0000 7fac720bb9c0 20 remove_watcher() i=4 2024-09-14T11:10:34.436 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:34.439+0000 7fac720bb9c0 20 remove_watcher() i=5 2024-09-14T11:10:34.437 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:34.439+0000 7fac720bb9c0 20 remove_watcher() i=6 2024-09-14T11:10:34.439 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:34.439+0000 7fac720bb9c0 20 remove_watcher() i=7 2024-09-14T11:10:34.457 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:10:34.457 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-14T11:10:34.487 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:10:34.487 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-14T11:10:34.524 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:10:34.524 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-14T11:10:34.588 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:10:34.588 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-14T11:10:34.645 INFO:tasks.workunit.client.0.smithi138.stderr:TEST: bucket check unlinked does not affect normal entries 2024-09-14T11:10:34.646 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-14T11:10:34.648 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:10:34.648 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-14T11:10:34.787 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:10:34.787 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-14T11:10:34.854 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:10:34.855 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-14T11:10:34.927 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:10:34.927 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-14T11:10:35.000 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:10:35.000 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-14T11:10:35.069 INFO:tasks.workunit.client.0.smithi138.stderr:TEST: bucket check unlinked does not find new unlistable entries after fix 2024-09-14T11:10:35.069 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-14T11:10:35.069 INFO:tasks.workunit.client.0.smithi138.stderr:radosgw-admin bucket check unlinked --bucket check-bucket --min-age-hours 0 --dump-keys 2024-09-14T11:10:35.108 INFO:tasks.workunit.client.0.smithi138.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:10:35.109 INFO:tasks.workunit.client.0.smithi138.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:10:35.155 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:35.155+0000 7f4c97d799c0 20 rados->read ofs=0 len=0 2024-09-14T11:10:35.157 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:35.159+0000 7f4c97d799c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:10:35.157 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:35.159+0000 7f4c97d799c0 20 realm 2024-09-14T11:10:35.157 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:35.159+0000 7f4c97d799c0 20 rados->read ofs=0 len=0 2024-09-14T11:10:35.157 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:35.159+0000 7f4c97d799c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:10:35.157 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:35.159+0000 7f4c97d799c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:10:35.157 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:35.159+0000 7f4c97d799c0 20 rados->read ofs=0 len=0 2024-09-14T11:10:35.157 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:35.159+0000 7f4c97d799c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:10:35.157 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:35.159+0000 7f4c97d799c0 20 rados->read ofs=0 len=0 2024-09-14T11:10:35.158 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:35.159+0000 7f4c97d799c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:10:35.158 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:35.159+0000 7f4c97d799c0 20 rados->read ofs=0 len=0 2024-09-14T11:10:35.159 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:35.163+0000 7f4c97d799c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:10:35.159 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:35.163+0000 7f4c97d799c0 20 searching for the correct realm 2024-09-14T11:10:35.164 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:35.167+0000 7f4c96080640 0 -- 172.21.15.138:0/1308439635 >> [v2:172.21.15.154:6824/416768175,v1:172.21.15.154:6825/416768175] conn(0x7f4c90029400 msgr2=0x7f4c90029840 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:10:35.170 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:35.170+0000 7f4c9507e640 0 -- 172.21.15.138:0/1308439635 >> [v2:172.21.15.138:6816/326481658,v1:172.21.15.138:6817/326481658] conn(0x7f4c9004c930 msgr2=0x7f4c900103e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:10:35.387 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:35.386+0000 7f4c97d799c0 20 RGWRados::pool_iterate: got zone_info.d9e72d30-c60b-4d0d-9267-fdc36392d5ad 2024-09-14T11:10:35.387 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:35.386+0000 7f4c97d799c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:10:35.387 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:35.386+0000 7f4c97d799c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:10:35.387 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:35.386+0000 7f4c97d799c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:10:35.387 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:35.386+0000 7f4c97d799c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:10:35.387 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:35.386+0000 7f4c97d799c0 20 RGWRados::pool_iterate: got zonegroup_info.65ab941b-da8c-4160-94fb-3672b069d44f 2024-09-14T11:10:35.387 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:35.386+0000 7f4c97d799c0 20 rados->read ofs=0 len=0 2024-09-14T11:10:35.388 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:35.390+0000 7f4c97d799c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:10:35.388 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:35.390+0000 7f4c97d799c0 20 rados->read ofs=0 len=0 2024-09-14T11:10:35.389 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:35.390+0000 7f4c97d799c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:10:35.389 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:35.390+0000 7f4c97d799c0 20 rados->read ofs=0 len=0 2024-09-14T11:10:35.390 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:35.390+0000 7f4c97d799c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:10:35.390 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:35.390+0000 7f4c97d799c0 20 zone default found 2024-09-14T11:10:35.390 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:35.390+0000 7f4c97d799c0 4 Realm: () 2024-09-14T11:10:35.390 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:35.390+0000 7f4c97d799c0 4 ZoneGroup: default (65ab941b-da8c-4160-94fb-3672b069d44f) 2024-09-14T11:10:35.390 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:35.390+0000 7f4c97d799c0 4 Zone: default (d9e72d30-c60b-4d0d-9267-fdc36392d5ad) 2024-09-14T11:10:35.390 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:35.390+0000 7f4c97d799c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:10:35.390 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:35.390+0000 7f4c97d799c0 20 zonegroup default 2024-09-14T11:10:35.390 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:35.390+0000 7f4c97d799c0 20 rados->read ofs=0 len=0 2024-09-14T11:10:35.391 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:35.390+0000 7f4c97d799c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:10:35.391 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:35.390+0000 7f4c97d799c0 20 rados->read ofs=0 len=0 2024-09-14T11:10:35.391 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:35.394+0000 7f4c97d799c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:10:35.391 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:35.394+0000 7f4c97d799c0 20 rados->read ofs=0 len=0 2024-09-14T11:10:35.392 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:35.394+0000 7f4c97d799c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:10:35.392 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:35.394+0000 7f4c97d799c0 20 started sync module instance, tier type = 2024-09-14T11:10:35.392 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:35.394+0000 7f4c97d799c0 20 started zone id=d9e72d30-c60b-4d0d-9267-fdc36392d5ad (name=default) with tier type = 2024-09-14T11:10:35.421 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:35.422+0000 7f4c97d799c0 20 add_watcher() i=0 2024-09-14T11:10:35.421 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:35.422+0000 7f4c97d799c0 20 add_watcher() i=1 2024-09-14T11:10:35.421 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:35.422+0000 7f4c97d799c0 20 add_watcher() i=2 2024-09-14T11:10:35.421 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:35.422+0000 7f4c97d799c0 20 add_watcher() i=3 2024-09-14T11:10:35.421 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:35.422+0000 7f4c97d799c0 20 add_watcher() i=4 2024-09-14T11:10:35.421 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:35.422+0000 7f4c97d799c0 20 add_watcher() i=5 2024-09-14T11:10:35.421 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:35.422+0000 7f4c97d799c0 20 add_watcher() i=6 2024-09-14T11:10:35.423 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:35.422+0000 7f4c97d799c0 20 add_watcher() i=7 2024-09-14T11:10:35.423 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:35.422+0000 7f4c97d799c0 2 all 8 watchers are set, enabling cache 2024-09-14T11:10:35.427 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:35.426+0000 7f4b477fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:10:35.428 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:35.430+0000 7f4c97d799c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:10:35.428 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:35.430+0000 7f4c97d799c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:10:35.428 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:35.430+0000 7f4c97d799c0 5 note: GC not initialized 2024-09-14T11:10:35.429 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:35.430+0000 7f4b467fc640 20 reqs_thread_entry: start 2024-09-14T11:10:35.429 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:35.430+0000 7f4c97d799c0 20 init_complete bucket index max shards: 11 2024-09-14T11:10:35.429 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:35.430+0000 7f4c97d799c0 20 Filter name: none 2024-09-14T11:10:35.430 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:35.430+0000 7f4ab7fff640 20 reqs_thread_entry: start 2024-09-14T11:10:35.430 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:35.430+0000 7f4c97d799c0 10 cache get: name=default.rgw.meta+root+check-bucket : miss 2024-09-14T11:10:35.430 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:35.430+0000 7f4c97d799c0 20 rados->read ofs=0 len=0 2024-09-14T11:10:35.431 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:35.430+0000 7f4c97d799c0 20 rados_obj.operate() r=0 bl.length=190 2024-09-14T11:10:35.431 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:35.430+0000 7f4c97d799c0 10 cache put: name=default.rgw.meta+root+check-bucket info.flags=0x11 2024-09-14T11:10:35.431 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:35.430+0000 7f4c97d799c0 10 adding default.rgw.meta+root+check-bucket to cache LRU end 2024-09-14T11:10:35.431 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:35.430+0000 7f4c97d799c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.check-bucket:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.1 : miss 2024-09-14T11:10:35.431 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:35.430+0000 7f4c97d799c0 20 rados->read ofs=0 len=0 2024-09-14T11:10:35.432 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:35.434+0000 7f4c97d799c0 20 rados_obj.operate() r=0 bl.length=412 2024-09-14T11:10:35.432 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:35.434+0000 7f4c97d799c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.check-bucket:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.1 info.flags=0x17 2024-09-14T11:10:35.432 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:35.434+0000 7f4c97d799c0 10 adding default.rgw.meta+root+.bucket.meta.check-bucket:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.1 to cache LRU end 2024-09-14T11:10:35.432 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:35.434+0000 7f4c97d799c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:10:35.432 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:35.434+0000 7f4c97d799c0 10 updating xattr: name=user.rgw.acl bl.length()=179 2024-09-14T11:10:35.432 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:35.434+0000 7f4c97d799c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.check-bucket:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.1 2024-09-14T11:10:35.432 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:35.434+0000 7f4c97d799c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.1.0 2024-09-14T11:10:35.433 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:35.434+0000 7f4c97d799c0 1 NOTICE: finished shard 0 (0 entries found) 2024-09-14T11:10:35.433 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:35.434+0000 7f4c97d799c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.1.1 2024-09-14T11:10:35.433 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:35.434+0000 7f4c97d799c0 1 NOTICE: finished shard 1 (0 entries found) 2024-09-14T11:10:35.433 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:35.434+0000 7f4c97d799c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.1.2 2024-09-14T11:10:35.434 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:35.434+0000 7f4c97d799c0 1 NOTICE: finished shard 2 (0 entries found) 2024-09-14T11:10:35.434 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:35.434+0000 7f4c97d799c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.1.3 2024-09-14T11:10:35.435 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:35.434+0000 7f4c97d799c0 1 NOTICE: finished shard 3 (0 entries found) 2024-09-14T11:10:35.435 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:35.434+0000 7f4c97d799c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.1.4 2024-09-14T11:10:35.437 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:35.438+0000 7f4c97d799c0 1 NOTICE: finished shard 4 (0 entries found) 2024-09-14T11:10:35.437 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:35.438+0000 7f4c97d799c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.1.5 2024-09-14T11:10:35.438 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:35.438+0000 7f4c97d799c0 1 NOTICE: finished shard 5 (0 entries found) 2024-09-14T11:10:35.438 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:35.438+0000 7f4c97d799c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.1.6 2024-09-14T11:10:35.439 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:35.438+0000 7f4c97d799c0 1 NOTICE: finished shard 6 (0 entries found) 2024-09-14T11:10:35.439 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:35.438+0000 7f4c97d799c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.1.7 2024-09-14T11:10:35.440 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:35.442+0000 7f4c97d799c0 1 NOTICE: finished shard 7 (0 entries found) 2024-09-14T11:10:35.440 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:35.442+0000 7f4c97d799c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.1.8 2024-09-14T11:10:35.442 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:35.442+0000 7f4c97d799c0 1 NOTICE: finished shard 8 (0 entries found) 2024-09-14T11:10:35.442 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:35.442+0000 7f4c97d799c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.1.9 2024-09-14T11:10:35.443 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:35.442+0000 7f4c97d799c0 1 NOTICE: finished shard 9 (0 entries found) 2024-09-14T11:10:35.443 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:35.442+0000 7f4c97d799c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.1.10 2024-09-14T11:10:35.444 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:35.446+0000 7f4c97d799c0 1 NOTICE: finished shard 10 (0 entries found) 2024-09-14T11:10:35.444 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:35.446+0000 7f4c97d799c0 1 NOTICE: finished all shards (0 entries found) 2024-09-14T11:10:35.445 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:35.446+0000 7f4b477fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:10:35.450 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:35.450+0000 7f4c97d799c0 20 remove_watcher() i=0 2024-09-14T11:10:35.451 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:35.450+0000 7f4c97d799c0 2 removed watcher, disabling cache 2024-09-14T11:10:35.453 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:35.454+0000 7f4c97d799c0 20 remove_watcher() i=1 2024-09-14T11:10:35.455 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:35.454+0000 7f4c97d799c0 20 remove_watcher() i=2 2024-09-14T11:10:35.457 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:35.458+0000 7f4c97d799c0 20 remove_watcher() i=3 2024-09-14T11:10:35.459 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:35.458+0000 7f4c97d799c0 20 remove_watcher() i=4 2024-09-14T11:10:35.460 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:35.462+0000 7f4c97d799c0 20 remove_watcher() i=5 2024-09-14T11:10:35.462 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:35.462+0000 7f4c97d799c0 20 remove_watcher() i=6 2024-09-14T11:10:35.464 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:35.466+0000 7f4c97d799c0 20 remove_watcher() i=7 2024-09-14T11:10:35.484 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:10:35.484 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-14T11:10:35.752 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:10:35.752 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-14T11:10:35.888 INFO:tasks.workunit.client.0.smithi138.stderr:radosgw-admin bi list --bucket check-bucket --object c 2024-09-14T11:10:35.922 INFO:tasks.workunit.client.0.smithi138.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:10:35.922 INFO:tasks.workunit.client.0.smithi138.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:10:35.969 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:35.970+0000 7fd4441769c0 20 rados->read ofs=0 len=0 2024-09-14T11:10:35.971 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:35.970+0000 7fd4441769c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:10:35.971 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:35.970+0000 7fd4441769c0 20 realm 2024-09-14T11:10:35.971 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:35.970+0000 7fd4441769c0 20 rados->read ofs=0 len=0 2024-09-14T11:10:35.971 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:35.970+0000 7fd4441769c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:10:35.971 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:35.970+0000 7fd4441769c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:10:35.971 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:35.970+0000 7fd4441769c0 20 rados->read ofs=0 len=0 2024-09-14T11:10:35.972 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:35.970+0000 7fd4441769c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:10:35.972 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:35.970+0000 7fd4441769c0 20 rados->read ofs=0 len=0 2024-09-14T11:10:35.973 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:35.974+0000 7fd4441769c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:10:35.973 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:35.974+0000 7fd4441769c0 20 rados->read ofs=0 len=0 2024-09-14T11:10:35.974 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:35.974+0000 7fd4441769c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:10:35.974 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:35.974+0000 7fd4441769c0 20 searching for the correct realm 2024-09-14T11:10:35.979 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:35.978+0000 7fd441c7c640 0 -- 172.21.15.138:0/553366175 >> [v2:172.21.15.138:6808/3258321916,v1:172.21.15.138:6809/3258321916] conn(0x560d16768940 msgr2=0x560d1676ae00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:10:35.984 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:35.986+0000 7fd44147b640 0 -- 172.21.15.138:0/553366175 >> [v2:172.21.15.138:6816/326481658,v1:172.21.15.138:6817/326481658] conn(0x7fd4341390b0 msgr2=0x7fd434113de0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:10:35.993 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:35.994+0000 7fd4441769c0 20 RGWRados::pool_iterate: got zone_info.d9e72d30-c60b-4d0d-9267-fdc36392d5ad 2024-09-14T11:10:35.993 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:35.994+0000 7fd4441769c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:10:35.993 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:35.994+0000 7fd4441769c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:10:35.993 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:35.994+0000 7fd4441769c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:10:35.993 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:35.994+0000 7fd4441769c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:10:35.993 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:35.994+0000 7fd4441769c0 20 RGWRados::pool_iterate: got zonegroup_info.65ab941b-da8c-4160-94fb-3672b069d44f 2024-09-14T11:10:35.993 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:35.994+0000 7fd4441769c0 20 rados->read ofs=0 len=0 2024-09-14T11:10:35.993 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:35.994+0000 7fd4441769c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:10:35.993 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:35.994+0000 7fd4441769c0 20 rados->read ofs=0 len=0 2024-09-14T11:10:35.994 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:35.994+0000 7fd4441769c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:10:35.994 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:35.994+0000 7fd4441769c0 20 rados->read ofs=0 len=0 2024-09-14T11:10:35.994 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:35.994+0000 7fd4441769c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:10:35.995 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:35.994+0000 7fd4441769c0 20 zone default found 2024-09-14T11:10:35.995 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:35.994+0000 7fd4441769c0 4 Realm: () 2024-09-14T11:10:35.995 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:35.994+0000 7fd4441769c0 4 ZoneGroup: default (65ab941b-da8c-4160-94fb-3672b069d44f) 2024-09-14T11:10:35.995 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:35.994+0000 7fd4441769c0 4 Zone: default (d9e72d30-c60b-4d0d-9267-fdc36392d5ad) 2024-09-14T11:10:35.995 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:35.994+0000 7fd4441769c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:10:35.995 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:35.994+0000 7fd4441769c0 20 zonegroup default 2024-09-14T11:10:35.995 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:35.994+0000 7fd4441769c0 20 rados->read ofs=0 len=0 2024-09-14T11:10:35.995 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:35.994+0000 7fd4441769c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:10:35.995 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:35.994+0000 7fd4441769c0 20 rados->read ofs=0 len=0 2024-09-14T11:10:35.996 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:35.998+0000 7fd4441769c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:10:35.996 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:35.998+0000 7fd4441769c0 20 rados->read ofs=0 len=0 2024-09-14T11:10:35.996 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:35.998+0000 7fd4441769c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:10:35.996 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:35.998+0000 7fd4441769c0 20 started sync module instance, tier type = 2024-09-14T11:10:35.996 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:35.998+0000 7fd4441769c0 20 started zone id=d9e72d30-c60b-4d0d-9267-fdc36392d5ad (name=default) with tier type = 2024-09-14T11:10:36.015 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:36.018+0000 7fd4441769c0 20 add_watcher() i=0 2024-09-14T11:10:36.016 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:36.018+0000 7fd4441769c0 20 add_watcher() i=1 2024-09-14T11:10:36.016 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:36.018+0000 7fd4441769c0 20 add_watcher() i=2 2024-09-14T11:10:36.016 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:36.018+0000 7fd4441769c0 20 add_watcher() i=3 2024-09-14T11:10:36.016 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:36.018+0000 7fd4441769c0 20 add_watcher() i=4 2024-09-14T11:10:36.016 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:36.018+0000 7fd4441769c0 20 add_watcher() i=5 2024-09-14T11:10:36.016 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:36.018+0000 7fd4441769c0 20 add_watcher() i=6 2024-09-14T11:10:36.017 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:36.018+0000 7fd4441769c0 20 add_watcher() i=7 2024-09-14T11:10:36.017 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:36.018+0000 7fd4441769c0 2 all 8 watchers are set, enabling cache 2024-09-14T11:10:36.020 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:36.022+0000 7fd2f37fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:10:36.021 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:36.022+0000 7fd4441769c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:10:36.021 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:36.022+0000 7fd4441769c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:10:36.021 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:36.022+0000 7fd4441769c0 5 note: GC not initialized 2024-09-14T11:10:36.021 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:36.022+0000 7fd2f27fc640 20 reqs_thread_entry: start 2024-09-14T11:10:36.021 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:36.022+0000 7fd4441769c0 20 init_complete bucket index max shards: 11 2024-09-14T11:10:36.021 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:36.022+0000 7fd4441769c0 20 Filter name: none 2024-09-14T11:10:36.021 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:36.022+0000 7fd263fff640 20 reqs_thread_entry: start 2024-09-14T11:10:36.021 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:36.022+0000 7fd4441769c0 20 rados->read ofs=0 len=0 2024-09-14T11:10:36.022 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:36.022+0000 7fd4441769c0 20 rados_obj.operate() r=0 bl.length=190 2024-09-14T11:10:36.022 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:36.022+0000 7fd4441769c0 20 rados->read ofs=0 len=0 2024-09-14T11:10:36.022 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:36.022+0000 7fd4441769c0 20 rados_obj.operate() r=0 bl.length=412 2024-09-14T11:10:36.022 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:36.022+0000 7fd4441769c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:10:36.022 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:36.022+0000 7fd4441769c0 20 INFO: main: max_entries=1000, index=gen=0, max_shards=11 2024-09-14T11:10:36.022 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:36.022+0000 7fd4441769c0 20 INFO: main: starting shard=0 2024-09-14T11:10:36.022 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:36.022+0000 7fd4441769c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.1.0 2024-09-14T11:10:36.023 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:36.022+0000 7fd4441769c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:10:36.023 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:36.022+0000 7fd4441769c0 20 INFO: main: starting shard=1 2024-09-14T11:10:36.023 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:36.022+0000 7fd4441769c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.1.1 2024-09-14T11:10:36.023 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:36.022+0000 7fd4441769c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:10:36.023 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:36.022+0000 7fd4441769c0 20 INFO: main: starting shard=2 2024-09-14T11:10:36.023 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:36.022+0000 7fd4441769c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.1.2 2024-09-14T11:10:36.024 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:36.026+0000 7fd4441769c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:10:36.024 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:36.026+0000 7fd4441769c0 20 INFO: main: starting shard=3 2024-09-14T11:10:36.024 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:36.026+0000 7fd4441769c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.1.3 2024-09-14T11:10:36.024 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:36.026+0000 7fd4441769c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:10:36.025 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:36.026+0000 7fd4441769c0 20 INFO: main: starting shard=4 2024-09-14T11:10:36.025 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:36.026+0000 7fd4441769c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.1.4 2024-09-14T11:10:36.026 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:36.026+0000 7fd4441769c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:10:36.026 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:36.026+0000 7fd4441769c0 20 INFO: main: starting shard=5 2024-09-14T11:10:36.026 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:36.026+0000 7fd4441769c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.1.5 2024-09-14T11:10:36.027 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:36.026+0000 7fd4441769c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:10:36.027 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:36.026+0000 7fd4441769c0 20 INFO: main: starting shard=6 2024-09-14T11:10:36.027 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:36.026+0000 7fd4441769c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.1.6 2024-09-14T11:10:36.027 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:36.030+0000 7fd4441769c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:10:36.027 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:36.030+0000 7fd4441769c0 20 INFO: main: starting shard=7 2024-09-14T11:10:36.027 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:36.030+0000 7fd4441769c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.1.7 2024-09-14T11:10:36.029 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:36.030+0000 7fd4441769c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:10:36.029 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:36.030+0000 7fd4441769c0 20 INFO: main: starting shard=8 2024-09-14T11:10:36.029 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:36.030+0000 7fd4441769c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.1.8 2024-09-14T11:10:36.030 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:36.030+0000 7fd4441769c0 20 INFO: main: bi_list() returned without error; entries.size()=2, is_truncated=0, marker= 2024-09-14T11:10:36.031 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:36.030+0000 7fd4441769c0 20 INFO: main: starting shard=9 2024-09-14T11:10:36.031 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:36.030+0000 7fd4441769c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.1.9 2024-09-14T11:10:36.032 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:36.034+0000 7fd4441769c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:10:36.032 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:36.034+0000 7fd4441769c0 20 INFO: main: starting shard=10 2024-09-14T11:10:36.032 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:36.034+0000 7fd4441769c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.1.10 2024-09-14T11:10:36.033 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:36.034+0000 7fd4441769c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:10:36.033 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:36.034+0000 7fd4441769c0 20 INFO: main: done 2024-09-14T11:10:36.034 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:36.034+0000 7fd2f37fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:10:36.039 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:36.038+0000 7fd4441769c0 20 remove_watcher() i=0 2024-09-14T11:10:36.039 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:36.038+0000 7fd4441769c0 2 removed watcher, disabling cache 2024-09-14T11:10:36.041 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:36.042+0000 7fd4441769c0 20 remove_watcher() i=1 2024-09-14T11:10:36.044 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:36.046+0000 7fd4441769c0 20 remove_watcher() i=2 2024-09-14T11:10:36.046 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:36.046+0000 7fd4441769c0 20 remove_watcher() i=3 2024-09-14T11:10:36.048 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:36.050+0000 7fd4441769c0 20 remove_watcher() i=4 2024-09-14T11:10:36.050 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:36.050+0000 7fd4441769c0 20 remove_watcher() i=5 2024-09-14T11:10:36.051 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:36.050+0000 7fd4441769c0 20 remove_watcher() i=6 2024-09-14T11:10:36.052 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:36.054+0000 7fd4441769c0 20 remove_watcher() i=7 2024-09-14T11:10:36.067 INFO:tasks.workunit.client.0.smithi138.stderr:radosgw-admin bi list --bucket check-bucket --object d 2024-09-14T11:10:36.095 INFO:tasks.workunit.client.0.smithi138.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:10:36.095 INFO:tasks.workunit.client.0.smithi138.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:10:36.139 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:36.138+0000 7f1ed5c659c0 20 rados->read ofs=0 len=0 2024-09-14T11:10:36.141 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:36.142+0000 7f1ed5c659c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:10:36.141 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:36.142+0000 7f1ed5c659c0 20 realm 2024-09-14T11:10:36.141 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:36.142+0000 7f1ed5c659c0 20 rados->read ofs=0 len=0 2024-09-14T11:10:36.141 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:36.142+0000 7f1ed5c659c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:10:36.141 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:36.142+0000 7f1ed5c659c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:10:36.142 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:36.142+0000 7f1ed5c659c0 20 rados->read ofs=0 len=0 2024-09-14T11:10:36.142 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:36.142+0000 7f1ed5c659c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:10:36.142 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:36.142+0000 7f1ed5c659c0 20 rados->read ofs=0 len=0 2024-09-14T11:10:36.143 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:36.142+0000 7f1ed5c659c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:10:36.143 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:36.142+0000 7f1ed5c659c0 20 rados->read ofs=0 len=0 2024-09-14T11:10:36.144 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:36.146+0000 7f1ed5c659c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:10:36.144 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:36.146+0000 7f1ed5c659c0 20 searching for the correct realm 2024-09-14T11:10:36.149 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:36.150+0000 7f1ed2f6a640 0 -- 172.21.15.138:0/3097070399 >> [v2:172.21.15.154:6808/1468088432,v1:172.21.15.154:6809/1468088432] conn(0x7f1ec4025040 msgr2=0x7f1ec4065f70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:10:36.155 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:36.154+0000 7f1ed2f6a640 0 -- 172.21.15.138:0/3097070399 >> [v2:172.21.15.138:6816/326481658,v1:172.21.15.138:6817/326481658] conn(0x7f1ecc036400 msgr2=0x7f1ecc036880 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:10:36.372 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:36.374+0000 7f1ed5c659c0 20 RGWRados::pool_iterate: got zone_info.d9e72d30-c60b-4d0d-9267-fdc36392d5ad 2024-09-14T11:10:36.372 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:36.374+0000 7f1ed5c659c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:10:36.372 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:36.374+0000 7f1ed5c659c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:10:36.372 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:36.374+0000 7f1ed5c659c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:10:36.372 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:36.374+0000 7f1ed5c659c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:10:36.373 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:36.374+0000 7f1ed5c659c0 20 RGWRados::pool_iterate: got zonegroup_info.65ab941b-da8c-4160-94fb-3672b069d44f 2024-09-14T11:10:36.373 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:36.374+0000 7f1ed5c659c0 20 rados->read ofs=0 len=0 2024-09-14T11:10:36.373 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:36.374+0000 7f1ed5c659c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:10:36.374 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:36.374+0000 7f1ed5c659c0 20 rados->read ofs=0 len=0 2024-09-14T11:10:36.374 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:36.374+0000 7f1ed5c659c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:10:36.374 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:36.374+0000 7f1ed5c659c0 20 rados->read ofs=0 len=0 2024-09-14T11:10:36.374 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:36.374+0000 7f1ed5c659c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:10:36.375 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:36.374+0000 7f1ed5c659c0 20 zone default found 2024-09-14T11:10:36.375 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:36.374+0000 7f1ed5c659c0 4 Realm: () 2024-09-14T11:10:36.375 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:36.374+0000 7f1ed5c659c0 4 ZoneGroup: default (65ab941b-da8c-4160-94fb-3672b069d44f) 2024-09-14T11:10:36.375 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:36.374+0000 7f1ed5c659c0 4 Zone: default (d9e72d30-c60b-4d0d-9267-fdc36392d5ad) 2024-09-14T11:10:36.375 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:36.374+0000 7f1ed5c659c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:10:36.375 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:36.374+0000 7f1ed5c659c0 20 zonegroup default 2024-09-14T11:10:36.375 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:36.374+0000 7f1ed5c659c0 20 rados->read ofs=0 len=0 2024-09-14T11:10:36.375 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:36.374+0000 7f1ed5c659c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:10:36.375 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:36.374+0000 7f1ed5c659c0 20 rados->read ofs=0 len=0 2024-09-14T11:10:36.375 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:36.378+0000 7f1ed5c659c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:10:36.376 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:36.378+0000 7f1ed5c659c0 20 rados->read ofs=0 len=0 2024-09-14T11:10:36.376 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:36.378+0000 7f1ed5c659c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:10:36.376 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:36.378+0000 7f1ed5c659c0 20 started sync module instance, tier type = 2024-09-14T11:10:36.377 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:36.378+0000 7f1ed5c659c0 20 started zone id=d9e72d30-c60b-4d0d-9267-fdc36392d5ad (name=default) with tier type = 2024-09-14T11:10:36.399 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:36.398+0000 7f1ed5c659c0 20 add_watcher() i=0 2024-09-14T11:10:36.399 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:36.398+0000 7f1ed5c659c0 20 add_watcher() i=1 2024-09-14T11:10:36.399 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:36.398+0000 7f1ed5c659c0 20 add_watcher() i=2 2024-09-14T11:10:36.399 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:36.398+0000 7f1ed5c659c0 20 add_watcher() i=3 2024-09-14T11:10:36.399 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:36.398+0000 7f1ed5c659c0 20 add_watcher() i=4 2024-09-14T11:10:36.399 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:36.398+0000 7f1ed5c659c0 20 add_watcher() i=5 2024-09-14T11:10:36.399 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:36.398+0000 7f1ed5c659c0 20 add_watcher() i=6 2024-09-14T11:10:36.401 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:36.402+0000 7f1ed5c659c0 20 add_watcher() i=7 2024-09-14T11:10:36.401 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:36.402+0000 7f1ed5c659c0 2 all 8 watchers are set, enabling cache 2024-09-14T11:10:36.405 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:36.406+0000 7f1d89fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:10:36.406 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:36.406+0000 7f1ed5c659c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:10:36.406 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:36.406+0000 7f1ed5c659c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:10:36.407 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:36.406+0000 7f1ed5c659c0 5 note: GC not initialized 2024-09-14T11:10:36.407 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:36.406+0000 7f1d88fe1640 20 reqs_thread_entry: start 2024-09-14T11:10:36.407 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:36.406+0000 7f1ed5c659c0 20 init_complete bucket index max shards: 11 2024-09-14T11:10:36.407 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:36.410+0000 7f1ed5c659c0 20 Filter name: none 2024-09-14T11:10:36.408 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:36.410+0000 7f1d027fc640 20 reqs_thread_entry: start 2024-09-14T11:10:36.408 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:36.410+0000 7f1ed5c659c0 20 rados->read ofs=0 len=0 2024-09-14T11:10:36.408 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:36.410+0000 7f1ed5c659c0 20 rados_obj.operate() r=0 bl.length=190 2024-09-14T11:10:36.408 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:36.410+0000 7f1ed5c659c0 20 rados->read ofs=0 len=0 2024-09-14T11:10:36.409 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:36.410+0000 7f1ed5c659c0 20 rados_obj.operate() r=0 bl.length=412 2024-09-14T11:10:36.409 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:36.410+0000 7f1ed5c659c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:10:36.409 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:36.410+0000 7f1ed5c659c0 20 INFO: main: max_entries=1000, index=gen=0, max_shards=11 2024-09-14T11:10:36.409 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:36.410+0000 7f1ed5c659c0 20 INFO: main: starting shard=0 2024-09-14T11:10:36.409 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:36.410+0000 7f1ed5c659c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.1.0 2024-09-14T11:10:36.411 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:36.410+0000 7f1ed5c659c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:10:36.411 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:36.410+0000 7f1ed5c659c0 20 INFO: main: starting shard=1 2024-09-14T11:10:36.411 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:36.410+0000 7f1ed5c659c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.1.1 2024-09-14T11:10:36.411 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:36.410+0000 7f1ed5c659c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:10:36.411 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:36.410+0000 7f1ed5c659c0 20 INFO: main: starting shard=2 2024-09-14T11:10:36.411 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:36.410+0000 7f1ed5c659c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.1.2 2024-09-14T11:10:36.412 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:36.414+0000 7f1ed5c659c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:10:36.412 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:36.414+0000 7f1ed5c659c0 20 INFO: main: starting shard=3 2024-09-14T11:10:36.412 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:36.414+0000 7f1ed5c659c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.1.3 2024-09-14T11:10:36.414 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:36.414+0000 7f1ed5c659c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:10:36.414 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:36.414+0000 7f1ed5c659c0 20 INFO: main: starting shard=4 2024-09-14T11:10:36.414 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:36.414+0000 7f1ed5c659c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.1.4 2024-09-14T11:10:36.415 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:36.414+0000 7f1ed5c659c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:10:36.415 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:36.414+0000 7f1ed5c659c0 20 INFO: main: starting shard=5 2024-09-14T11:10:36.415 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:36.414+0000 7f1ed5c659c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.1.5 2024-09-14T11:10:36.416 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:36.418+0000 7f1ed5c659c0 20 INFO: main: bi_list() returned without error; entries.size()=2, is_truncated=0, marker= 2024-09-14T11:10:36.416 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:36.418+0000 7f1ed5c659c0 20 INFO: main: starting shard=6 2024-09-14T11:10:36.416 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:36.418+0000 7f1ed5c659c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.1.6 2024-09-14T11:10:36.416 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:36.418+0000 7f1ed5c659c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:10:36.417 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:36.418+0000 7f1ed5c659c0 20 INFO: main: starting shard=7 2024-09-14T11:10:36.417 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:36.418+0000 7f1ed5c659c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.1.7 2024-09-14T11:10:36.418 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:36.418+0000 7f1ed5c659c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:10:36.418 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:36.418+0000 7f1ed5c659c0 20 INFO: main: starting shard=8 2024-09-14T11:10:36.418 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:36.418+0000 7f1ed5c659c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.1.8 2024-09-14T11:10:36.420 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:36.418+0000 7f1ed5c659c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:10:36.420 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:36.418+0000 7f1ed5c659c0 20 INFO: main: starting shard=9 2024-09-14T11:10:36.421 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:36.418+0000 7f1ed5c659c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.1.9 2024-09-14T11:10:36.421 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:36.422+0000 7f1ed5c659c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:10:36.421 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:36.422+0000 7f1ed5c659c0 20 INFO: main: starting shard=10 2024-09-14T11:10:36.421 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:36.422+0000 7f1ed5c659c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.1.10 2024-09-14T11:10:36.421 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:36.422+0000 7f1ed5c659c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:10:36.421 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:36.422+0000 7f1ed5c659c0 20 INFO: main: done 2024-09-14T11:10:36.422 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:36.422+0000 7f1d89fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:10:36.427 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:36.426+0000 7f1ed5c659c0 20 remove_watcher() i=0 2024-09-14T11:10:36.427 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:36.426+0000 7f1ed5c659c0 2 removed watcher, disabling cache 2024-09-14T11:10:36.429 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:36.430+0000 7f1ed5c659c0 20 remove_watcher() i=1 2024-09-14T11:10:36.431 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:36.434+0000 7f1ed5c659c0 20 remove_watcher() i=2 2024-09-14T11:10:36.433 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:36.434+0000 7f1ed5c659c0 20 remove_watcher() i=3 2024-09-14T11:10:36.436 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:36.438+0000 7f1ed5c659c0 20 remove_watcher() i=4 2024-09-14T11:10:36.437 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:36.438+0000 7f1ed5c659c0 20 remove_watcher() i=5 2024-09-14T11:10:36.443 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:36.442+0000 7f1ed5c659c0 20 remove_watcher() i=6 2024-09-14T11:10:36.445 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:36.446+0000 7f1ed5c659c0 20 remove_watcher() i=7 2024-09-14T11:10:36.458 INFO:tasks.workunit.client.0.smithi138.stderr:TEST: bucket check olh finds leftover OLH entries 2024-09-14T11:10:36.458 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-14T11:10:36.458 INFO:tasks.workunit.client.0.smithi138.stderr:radosgw-admin bucket check olh --bucket check-bucket --dump-keys 2024-09-14T11:10:36.490 INFO:tasks.workunit.client.0.smithi138.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:10:36.490 INFO:tasks.workunit.client.0.smithi138.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:10:36.534 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:36.534+0000 7f9706e019c0 20 rados->read ofs=0 len=0 2024-09-14T11:10:36.536 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:36.538+0000 7f9706e019c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:10:36.536 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:36.538+0000 7f9706e019c0 20 realm 2024-09-14T11:10:36.536 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:36.538+0000 7f9706e019c0 20 rados->read ofs=0 len=0 2024-09-14T11:10:36.536 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:36.538+0000 7f9706e019c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:10:36.536 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:36.538+0000 7f9706e019c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:10:36.536 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:36.538+0000 7f9706e019c0 20 rados->read ofs=0 len=0 2024-09-14T11:10:36.537 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:36.538+0000 7f9706e019c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:10:36.537 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:36.538+0000 7f9706e019c0 20 rados->read ofs=0 len=0 2024-09-14T11:10:36.538 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:36.538+0000 7f9706e019c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:10:36.538 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:36.538+0000 7f9706e019c0 20 rados->read ofs=0 len=0 2024-09-14T11:10:36.538 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:36.538+0000 7f9706e019c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:10:36.539 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:36.538+0000 7f9706e019c0 20 searching for the correct realm 2024-09-14T11:10:36.543 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:36.546+0000 7f9704907640 0 -- 172.21.15.138:0/2712698577 >> [v2:172.21.15.138:6808/3258321916,v1:172.21.15.138:6809/3258321916] conn(0x55cd633d3820 msgr2=0x55cd633d5ce0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:10:36.549 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:36.550+0000 7f9704106640 0 -- 172.21.15.138:0/2712698577 >> [v2:172.21.15.138:6816/326481658,v1:172.21.15.138:6817/326481658] conn(0x7f96fc002ba0 msgr2=0x7f96fc0609a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:10:36.557 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:36.558+0000 7f9706e019c0 20 RGWRados::pool_iterate: got zone_info.d9e72d30-c60b-4d0d-9267-fdc36392d5ad 2024-09-14T11:10:36.557 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:36.558+0000 7f9706e019c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:10:36.557 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:36.558+0000 7f9706e019c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:10:36.557 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:36.558+0000 7f9706e019c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:10:36.558 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:36.558+0000 7f9706e019c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:10:36.558 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:36.558+0000 7f9706e019c0 20 RGWRados::pool_iterate: got zonegroup_info.65ab941b-da8c-4160-94fb-3672b069d44f 2024-09-14T11:10:36.558 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:36.558+0000 7f9706e019c0 20 rados->read ofs=0 len=0 2024-09-14T11:10:36.558 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:36.558+0000 7f9706e019c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:10:36.558 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:36.558+0000 7f9706e019c0 20 rados->read ofs=0 len=0 2024-09-14T11:10:36.558 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:36.558+0000 7f9706e019c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:10:36.558 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:36.558+0000 7f9706e019c0 20 rados->read ofs=0 len=0 2024-09-14T11:10:36.559 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:36.558+0000 7f9706e019c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:10:36.559 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:36.558+0000 7f9706e019c0 20 zone default found 2024-09-14T11:10:36.559 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:36.558+0000 7f9706e019c0 4 Realm: () 2024-09-14T11:10:36.559 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:36.558+0000 7f9706e019c0 4 ZoneGroup: default (65ab941b-da8c-4160-94fb-3672b069d44f) 2024-09-14T11:10:36.560 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:36.558+0000 7f9706e019c0 4 Zone: default (d9e72d30-c60b-4d0d-9267-fdc36392d5ad) 2024-09-14T11:10:36.560 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:36.558+0000 7f9706e019c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:10:36.560 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:36.558+0000 7f9706e019c0 20 zonegroup default 2024-09-14T11:10:36.560 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:36.558+0000 7f9706e019c0 20 rados->read ofs=0 len=0 2024-09-14T11:10:36.560 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:36.558+0000 7f9706e019c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:10:36.560 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:36.558+0000 7f9706e019c0 20 rados->read ofs=0 len=0 2024-09-14T11:10:36.560 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:36.562+0000 7f9706e019c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:10:36.561 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:36.562+0000 7f9706e019c0 20 rados->read ofs=0 len=0 2024-09-14T11:10:36.561 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:36.562+0000 7f9706e019c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:10:36.561 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:36.562+0000 7f9706e019c0 20 started sync module instance, tier type = 2024-09-14T11:10:36.561 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:36.562+0000 7f9706e019c0 20 started zone id=d9e72d30-c60b-4d0d-9267-fdc36392d5ad (name=default) with tier type = 2024-09-14T11:10:36.582 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:36.582+0000 7f9706e019c0 20 add_watcher() i=0 2024-09-14T11:10:36.583 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:36.582+0000 7f9706e019c0 20 add_watcher() i=1 2024-09-14T11:10:36.584 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:36.582+0000 7f9706e019c0 20 add_watcher() i=2 2024-09-14T11:10:36.584 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:36.582+0000 7f9706e019c0 20 add_watcher() i=3 2024-09-14T11:10:36.584 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:36.582+0000 7f9706e019c0 20 add_watcher() i=4 2024-09-14T11:10:36.584 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:36.582+0000 7f9706e019c0 20 add_watcher() i=5 2024-09-14T11:10:36.584 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:36.582+0000 7f9706e019c0 20 add_watcher() i=6 2024-09-14T11:10:36.584 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:36.586+0000 7f9706e019c0 20 add_watcher() i=7 2024-09-14T11:10:36.584 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:36.586+0000 7f9706e019c0 2 all 8 watchers are set, enabling cache 2024-09-14T11:10:36.586 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:36.586+0000 7f95bb7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:10:36.587 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:36.586+0000 7f9706e019c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:10:36.587 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:36.586+0000 7f9706e019c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:10:36.587 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:36.586+0000 7f9706e019c0 5 note: GC not initialized 2024-09-14T11:10:36.588 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:36.586+0000 7f95ba7e4640 20 reqs_thread_entry: start 2024-09-14T11:10:36.588 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:36.586+0000 7f9706e019c0 20 init_complete bucket index max shards: 11 2024-09-14T11:10:36.588 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:36.590+0000 7f9706e019c0 20 Filter name: none 2024-09-14T11:10:36.588 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:36.590+0000 7f95b87e0640 20 reqs_thread_entry: start 2024-09-14T11:10:36.588 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:36.590+0000 7f9706e019c0 10 cache get: name=default.rgw.meta+root+check-bucket : miss 2024-09-14T11:10:36.588 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:36.590+0000 7f9706e019c0 20 rados->read ofs=0 len=0 2024-09-14T11:10:36.589 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:36.590+0000 7f9706e019c0 20 rados_obj.operate() r=0 bl.length=190 2024-09-14T11:10:36.589 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:36.590+0000 7f9706e019c0 10 cache put: name=default.rgw.meta+root+check-bucket info.flags=0x11 2024-09-14T11:10:36.589 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:36.590+0000 7f9706e019c0 10 adding default.rgw.meta+root+check-bucket to cache LRU end 2024-09-14T11:10:36.589 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:36.590+0000 7f9706e019c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.check-bucket:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.1 : miss 2024-09-14T11:10:36.589 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:36.590+0000 7f9706e019c0 20 rados->read ofs=0 len=0 2024-09-14T11:10:36.589 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:36.590+0000 7f9706e019c0 20 rados_obj.operate() r=0 bl.length=412 2024-09-14T11:10:36.589 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:36.590+0000 7f9706e019c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.check-bucket:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.1 info.flags=0x17 2024-09-14T11:10:36.589 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:36.590+0000 7f9706e019c0 10 adding default.rgw.meta+root+.bucket.meta.check-bucket:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.1 to cache LRU end 2024-09-14T11:10:36.590 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:36.590+0000 7f9706e019c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:10:36.590 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:36.590+0000 7f9706e019c0 10 updating xattr: name=user.rgw.acl bl.length()=179 2024-09-14T11:10:36.590 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:36.590+0000 7f9706e019c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.check-bucket:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.1 2024-09-14T11:10:36.590 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:36.590+0000 7f9706e019c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.1.0 2024-09-14T11:10:36.590 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:36.590+0000 7f9706e019c0 1 NOTICE: finished shard 0 (0 entries found) 2024-09-14T11:10:36.590 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:36.590+0000 7f9706e019c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.1.1 2024-09-14T11:10:36.590 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:36.590+0000 7f9706e019c0 1 NOTICE: finished shard 1 (0 entries found) 2024-09-14T11:10:36.591 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:36.590+0000 7f9706e019c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.1.2 2024-09-14T11:10:36.591 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:36.590+0000 7f9706e019c0 1 NOTICE: finished shard 2 (0 entries found) 2024-09-14T11:10:36.591 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:36.590+0000 7f9706e019c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.1.3 2024-09-14T11:10:36.591 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:36.594+0000 7f9706e019c0 1 NOTICE: finished shard 3 (0 entries found) 2024-09-14T11:10:36.591 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:36.594+0000 7f9706e019c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.1.4 2024-09-14T11:10:36.593 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:36.594+0000 7f9706e019c0 1 NOTICE: finished shard 4 (0 entries found) 2024-09-14T11:10:36.593 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:36.594+0000 7f9706e019c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.1.5 2024-09-14T11:10:36.593 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:36.594+0000 7f9706e019c0 1 NOTICE: finished shard 5 (1 entries found) 2024-09-14T11:10:36.593 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:36.594+0000 7f9706e019c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.1.6 2024-09-14T11:10:36.594 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:36.594+0000 7f9706e019c0 1 NOTICE: finished shard 6 (0 entries found) 2024-09-14T11:10:36.594 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:36.594+0000 7f9706e019c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.1.7 2024-09-14T11:10:36.595 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:36.598+0000 7f9706e019c0 1 NOTICE: finished shard 7 (0 entries found) 2024-09-14T11:10:36.595 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:36.598+0000 7f9706e019c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.1.8 2024-09-14T11:10:36.597 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:36.598+0000 7f9706e019c0 1 NOTICE: finished shard 8 (1 entries found) 2024-09-14T11:10:36.597 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:36.598+0000 7f9706e019c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.1.9 2024-09-14T11:10:36.598 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:36.598+0000 7f9706e019c0 1 NOTICE: finished shard 9 (0 entries found) 2024-09-14T11:10:36.598 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:36.598+0000 7f9706e019c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.1.10 2024-09-14T11:10:36.599 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:36.598+0000 7f9706e019c0 1 NOTICE: finished shard 10 (0 entries found) 2024-09-14T11:10:36.599 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:36.598+0000 7f9706e019c0 1 NOTICE: finished all shards (2 entries found) 2024-09-14T11:10:36.600 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:36.602+0000 7f95bb7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:10:36.605 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:36.606+0000 7f9706e019c0 20 remove_watcher() i=0 2024-09-14T11:10:36.605 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:36.606+0000 7f9706e019c0 2 removed watcher, disabling cache 2024-09-14T11:10:36.607 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:36.606+0000 7f9706e019c0 20 remove_watcher() i=1 2024-09-14T11:10:36.609 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:36.610+0000 7f9706e019c0 20 remove_watcher() i=2 2024-09-14T11:10:36.611 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:36.610+0000 7f9706e019c0 20 remove_watcher() i=3 2024-09-14T11:10:36.613 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:36.614+0000 7f9706e019c0 20 remove_watcher() i=4 2024-09-14T11:10:36.614 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:36.614+0000 7f9706e019c0 20 remove_watcher() i=5 2024-09-14T11:10:36.617 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:36.618+0000 7f9706e019c0 20 remove_watcher() i=6 2024-09-14T11:10:36.618 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:36.618+0000 7f9706e019c0 20 remove_watcher() i=7 2024-09-14T11:10:36.632 INFO:tasks.workunit.client.0.smithi138.stderr:TEST: bucket check olh fixes leftover OLH entries 2024-09-14T11:10:36.632 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-14T11:10:36.633 INFO:tasks.workunit.client.0.smithi138.stderr:radosgw-admin bucket check olh --bucket check-bucket --fix --rgw-olh-pending-timeout-sec 0 --dump-keys 2024-09-14T11:10:36.665 INFO:tasks.workunit.client.0.smithi138.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:10:36.665 INFO:tasks.workunit.client.0.smithi138.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:10:36.708 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:36.710+0000 7fd9886cd9c0 20 rados->read ofs=0 len=0 2024-09-14T11:10:36.710 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:36.710+0000 7fd9886cd9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:10:36.710 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:36.710+0000 7fd9886cd9c0 20 realm 2024-09-14T11:10:36.710 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:36.710+0000 7fd9886cd9c0 20 rados->read ofs=0 len=0 2024-09-14T11:10:36.710 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:36.710+0000 7fd9886cd9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:10:36.710 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:36.710+0000 7fd9886cd9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:10:36.710 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:36.710+0000 7fd9886cd9c0 20 rados->read ofs=0 len=0 2024-09-14T11:10:36.710 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:36.710+0000 7fd9886cd9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:10:36.710 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:36.710+0000 7fd9886cd9c0 20 rados->read ofs=0 len=0 2024-09-14T11:10:36.711 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:36.714+0000 7fd9886cd9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:10:36.711 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:36.714+0000 7fd9886cd9c0 20 rados->read ofs=0 len=0 2024-09-14T11:10:36.712 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:36.714+0000 7fd9886cd9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:10:36.713 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:36.714+0000 7fd9886cd9c0 20 searching for the correct realm 2024-09-14T11:10:36.717 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:36.718+0000 7fd9859d2640 0 -- 172.21.15.138:0/4105199903 >> [v2:172.21.15.154:6808/1468088432,v1:172.21.15.154:6809/1468088432] conn(0x7fd978115070 msgr2=0x7fd978136780 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-14T11:10:36.724 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:36.726+0000 7fd9859d2640 0 -- 172.21.15.138:0/4105199903 >> [v2:172.21.15.138:6816/326481658,v1:172.21.15.138:6817/326481658] conn(0x7fd98002b960 msgr2=0x7fd980024440 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:10:36.943 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:36.942+0000 7fd9886cd9c0 20 RGWRados::pool_iterate: got zone_info.d9e72d30-c60b-4d0d-9267-fdc36392d5ad 2024-09-14T11:10:36.943 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:36.942+0000 7fd9886cd9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:10:36.943 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:36.942+0000 7fd9886cd9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:10:36.943 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:36.942+0000 7fd9886cd9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:10:36.943 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:36.942+0000 7fd9886cd9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:10:36.943 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:36.942+0000 7fd9886cd9c0 20 RGWRados::pool_iterate: got zonegroup_info.65ab941b-da8c-4160-94fb-3672b069d44f 2024-09-14T11:10:36.944 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:36.942+0000 7fd9886cd9c0 20 rados->read ofs=0 len=0 2024-09-14T11:10:36.944 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:36.946+0000 7fd9886cd9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:10:36.944 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:36.946+0000 7fd9886cd9c0 20 rados->read ofs=0 len=0 2024-09-14T11:10:36.944 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:36.946+0000 7fd9886cd9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:10:36.944 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:36.946+0000 7fd9886cd9c0 20 rados->read ofs=0 len=0 2024-09-14T11:10:36.945 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:36.946+0000 7fd9886cd9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:10:36.945 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:36.946+0000 7fd9886cd9c0 20 zone default found 2024-09-14T11:10:36.946 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:36.946+0000 7fd9886cd9c0 4 Realm: () 2024-09-14T11:10:36.946 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:36.946+0000 7fd9886cd9c0 4 ZoneGroup: default (65ab941b-da8c-4160-94fb-3672b069d44f) 2024-09-14T11:10:36.946 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:36.946+0000 7fd9886cd9c0 4 Zone: default (d9e72d30-c60b-4d0d-9267-fdc36392d5ad) 2024-09-14T11:10:36.946 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:36.946+0000 7fd9886cd9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:10:36.946 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:36.946+0000 7fd9886cd9c0 20 zonegroup default 2024-09-14T11:10:36.946 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:36.946+0000 7fd9886cd9c0 20 rados->read ofs=0 len=0 2024-09-14T11:10:36.946 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:36.946+0000 7fd9886cd9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:10:36.947 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:36.946+0000 7fd9886cd9c0 20 rados->read ofs=0 len=0 2024-09-14T11:10:36.947 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:36.946+0000 7fd9886cd9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:10:36.947 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:36.946+0000 7fd9886cd9c0 20 rados->read ofs=0 len=0 2024-09-14T11:10:36.948 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:36.950+0000 7fd9886cd9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:10:36.948 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:36.950+0000 7fd9886cd9c0 20 started sync module instance, tier type = 2024-09-14T11:10:36.948 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:36.950+0000 7fd9886cd9c0 20 started zone id=d9e72d30-c60b-4d0d-9267-fdc36392d5ad (name=default) with tier type = 2024-09-14T11:10:36.975 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:36.974+0000 7fd9886cd9c0 20 add_watcher() i=0 2024-09-14T11:10:36.976 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:36.974+0000 7fd9886cd9c0 20 add_watcher() i=1 2024-09-14T11:10:36.976 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:36.974+0000 7fd9886cd9c0 20 add_watcher() i=2 2024-09-14T11:10:36.976 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:36.974+0000 7fd9886cd9c0 20 add_watcher() i=3 2024-09-14T11:10:36.976 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:36.974+0000 7fd9886cd9c0 20 add_watcher() i=4 2024-09-14T11:10:36.977 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:36.974+0000 7fd9886cd9c0 20 add_watcher() i=5 2024-09-14T11:10:36.977 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:36.974+0000 7fd9886cd9c0 20 add_watcher() i=6 2024-09-14T11:10:36.978 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:36.978+0000 7fd9886cd9c0 20 add_watcher() i=7 2024-09-14T11:10:36.978 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:36.978+0000 7fd9886cd9c0 2 all 8 watchers are set, enabling cache 2024-09-14T11:10:36.982 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:36.982+0000 7fd83d7e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:10:36.983 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:36.982+0000 7fd9886cd9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:10:36.984 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:36.982+0000 7fd9886cd9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:10:36.984 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:36.986+0000 7fd9886cd9c0 5 note: GC not initialized 2024-09-14T11:10:36.985 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:36.986+0000 7fd8377fe640 20 reqs_thread_entry: start 2024-09-14T11:10:36.985 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:36.986+0000 7fd9886cd9c0 20 init_complete bucket index max shards: 11 2024-09-14T11:10:36.985 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:36.986+0000 7fd9886cd9c0 20 Filter name: none 2024-09-14T11:10:36.985 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:36.986+0000 7fd8357fa640 20 reqs_thread_entry: start 2024-09-14T11:10:36.985 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:36.986+0000 7fd9886cd9c0 10 cache get: name=default.rgw.meta+root+check-bucket : miss 2024-09-14T11:10:36.985 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:36.986+0000 7fd9886cd9c0 20 rados->read ofs=0 len=0 2024-09-14T11:10:36.986 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:36.986+0000 7fd9886cd9c0 20 rados_obj.operate() r=0 bl.length=190 2024-09-14T11:10:36.986 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:36.986+0000 7fd9886cd9c0 10 cache put: name=default.rgw.meta+root+check-bucket info.flags=0x11 2024-09-14T11:10:36.986 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:36.986+0000 7fd9886cd9c0 10 adding default.rgw.meta+root+check-bucket to cache LRU end 2024-09-14T11:10:36.986 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:36.986+0000 7fd9886cd9c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.check-bucket:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.1 : miss 2024-09-14T11:10:36.986 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:36.986+0000 7fd9886cd9c0 20 rados->read ofs=0 len=0 2024-09-14T11:10:36.987 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:36.986+0000 7fd9886cd9c0 20 rados_obj.operate() r=0 bl.length=412 2024-09-14T11:10:36.987 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:36.986+0000 7fd9886cd9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.check-bucket:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.1 info.flags=0x17 2024-09-14T11:10:36.987 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:36.986+0000 7fd9886cd9c0 10 adding default.rgw.meta+root+.bucket.meta.check-bucket:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.1 to cache LRU end 2024-09-14T11:10:36.987 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:36.986+0000 7fd9886cd9c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:10:36.987 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:36.986+0000 7fd9886cd9c0 10 updating xattr: name=user.rgw.acl bl.length()=179 2024-09-14T11:10:36.988 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:36.986+0000 7fd9886cd9c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.check-bucket:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.1 2024-09-14T11:10:36.988 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:36.986+0000 7fd9886cd9c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.1.0 2024-09-14T11:10:36.988 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:36.990+0000 7fd9886cd9c0 1 NOTICE: finished shard 0 (0 entries removed) 2024-09-14T11:10:36.988 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:36.990+0000 7fd9886cd9c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.1.1 2024-09-14T11:10:36.988 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:36.990+0000 7fd9886cd9c0 1 NOTICE: finished shard 1 (0 entries removed) 2024-09-14T11:10:36.989 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:36.990+0000 7fd9886cd9c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.1.2 2024-09-14T11:10:36.989 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:36.990+0000 7fd9886cd9c0 1 NOTICE: finished shard 2 (0 entries removed) 2024-09-14T11:10:36.989 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:36.990+0000 7fd9886cd9c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.1.3 2024-09-14T11:10:36.993 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:36.990+0000 7fd9886cd9c0 1 NOTICE: finished shard 3 (0 entries removed) 2024-09-14T11:10:36.993 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:36.990+0000 7fd9886cd9c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.1.4 2024-09-14T11:10:36.993 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:36.994+0000 7fd9886cd9c0 1 NOTICE: finished shard 4 (0 entries removed) 2024-09-14T11:10:36.993 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:36.994+0000 7fd9886cd9c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.1.5 2024-09-14T11:10:36.993 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:36.994+0000 7fd9886cd9c0 20 get_obj_state: octx=0x555f63e31920 obj=check-bucket:d state=0x555f640e8268 s->prefetch_data=0 2024-09-14T11:10:36.993 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:36.994+0000 7fd9886cd9c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.1.6 2024-09-14T11:10:36.994 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:36.994+0000 7fd9886cd9c0 1 NOTICE: finished shard 6 (0 entries removed) 2024-09-14T11:10:36.994 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:36.994+0000 7fd9886cd9c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.1.7 2024-09-14T11:10:36.995 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:36.994+0000 7fd9886cd9c0 1 NOTICE: finished shard 7 (0 entries removed) 2024-09-14T11:10:36.995 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:36.994+0000 7fd9886cd9c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.1.8 2024-09-14T11:10:36.996 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:36.998+0000 7fd9886cd9c0 20 get_obj_state: octx=0x555f63e431d0 obj=check-bucket:c state=0x555f640e4d48 s->prefetch_data=0 2024-09-14T11:10:36.996 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:36.998+0000 7fd9886cd9c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.1.9 2024-09-14T11:10:36.998 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:36.998+0000 7fd9886cd9c0 1 NOTICE: finished shard 9 (0 entries removed) 2024-09-14T11:10:36.998 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:36.998+0000 7fd9886cd9c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.1.10 2024-09-14T11:10:36.999 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:36.998+0000 7fd9886cd9c0 1 NOTICE: finished shard 10 (0 entries removed) 2024-09-14T11:10:37.000 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:37.002+0000 7fd9886cd9c0 20 get_obj_state: setting s->obj_tag to 1mmtrayngl0yhzookb7ex9soprrrdcrt 2024-09-14T11:10:37.000 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:37.002+0000 7fd9886cd9c0 20 get_obj_state_impl: setting s->olh_tag to uhnbtunu964ed71955r4rfc5zlpwrdwa 2024-09-14T11:10:37.000 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:37.002+0000 7fd9886cd9c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.1.5 2024-09-14T11:10:37.000 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:37.002+0000 7fd9886cd9c0 20 get_obj_state: setting s->obj_tag to 3t443ssjxlycf3zvvetsg9pmbpqhe8vv 2024-09-14T11:10:37.000 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:37.002+0000 7fd9886cd9c0 20 get_obj_state_impl: setting s->olh_tag to syfx43intaq0qa87q5hg7i9rs5v5ok0g 2024-09-14T11:10:37.000 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:37.002+0000 7fd9886cd9c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.1.8 2024-09-14T11:10:37.001 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:37.002+0000 7fd9886cd9c0 20 olh_log_entry: epoch=4 op=2 key=d[] 2024-09-14T11:10:37.001 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:37.002+0000 7fd9886cd9c0 20 olh_log_entry: epoch=4 op=3 key=d[KH3GMYMeeryq.kgohpyRwHHUwn79-qd] 2024-09-14T11:10:37.001 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:37.002+0000 7fd9886cd9c0 20 get_obj_state: octx=0x555f6410fda0 obj=check-bucket:_:KH3GMYMeeryq.kgohpyRwHHUwn79-qd_d state=0x555f640e21c8 s->prefetch_data=0 2024-09-14T11:10:37.001 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:37.002+0000 7fd9886cd9c0 20 olh_log_entry: epoch=4 op=2 key=c[] 2024-09-14T11:10:37.001 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:37.002+0000 7fd9886cd9c0 20 olh_log_entry: epoch=4 op=3 key=c[ef-tMimbq6HoH2bgGNCKYBpzMk7Jr-v] 2024-09-14T11:10:37.002 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:37.002+0000 7fd9886cd9c0 20 get_obj_state: octx=0x555f6412fda0 obj=check-bucket:_:ef-tMimbq6HoH2bgGNCKYBpzMk7Jr-v_c state=0x555f6413b8e8 s->prefetch_data=0 2024-09-14T11:10:37.004 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:37.006+0000 7fd9886cd9c0 20 get_obj_state: octx=0x555f6410fda0 obj=check-bucket:d state=0x555f6413b888 s->prefetch_data=0 2024-09-14T11:10:37.005 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:37.006+0000 7fd9886cd9c0 20 get_obj_state: setting s->obj_tag to 1mmtrayngl0yhzookb7ex9soprrrdcrt 2024-09-14T11:10:37.005 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:37.006+0000 7fd9886cd9c0 20 get_obj_state_impl: setting s->olh_tag to uhnbtunu964ed71955r4rfc5zlpwrdwa 2024-09-14T11:10:37.005 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:37.006+0000 7fd9886cd9c0 20 bucket_index_guard_olh_op(): olh_state.olh_tag=uhnbtunu964ed71955r4rfc5zlpwrdwa 2024-09-14T11:10:37.005 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:37.006+0000 7fd9886cd9c0 20 get_obj_state: octx=0x555f6412fda0 obj=check-bucket:c state=0x555f64134c08 s->prefetch_data=0 2024-09-14T11:10:37.007 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:37.006+0000 7fd9886cd9c0 20 get_obj_state: setting s->obj_tag to 3t443ssjxlycf3zvvetsg9pmbpqhe8vv 2024-09-14T11:10:37.007 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:37.006+0000 7fd9886cd9c0 20 get_obj_state_impl: setting s->olh_tag to syfx43intaq0qa87q5hg7i9rs5v5ok0g 2024-09-14T11:10:37.007 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:37.006+0000 7fd9886cd9c0 20 bucket_index_guard_olh_op(): olh_state.olh_tag=syfx43intaq0qa87q5hg7i9rs5v5ok0g 2024-09-14T11:10:37.015 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:37.014+0000 7fd9886cd9c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.1.5 2024-09-14T11:10:37.017 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:37.018+0000 7fd9886cd9c0 1 NOTICE: finished shard 5 (1 entries removed) 2024-09-14T11:10:37.017 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:37.018+0000 7fd9886cd9c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.1.8 2024-09-14T11:10:37.022 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:37.022+0000 7fd9886cd9c0 1 NOTICE: finished shard 8 (1 entries removed) 2024-09-14T11:10:37.023 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:37.022+0000 7fd9886cd9c0 1 NOTICE: finished all shards (2 entries removed) 2024-09-14T11:10:37.024 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:37.026+0000 7fd83d7e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:10:37.029 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:37.030+0000 7fd9886cd9c0 20 remove_watcher() i=0 2024-09-14T11:10:37.029 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:37.030+0000 7fd9886cd9c0 2 removed watcher, disabling cache 2024-09-14T11:10:37.031 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:37.034+0000 7fd9886cd9c0 20 remove_watcher() i=1 2024-09-14T11:10:37.034 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:37.034+0000 7fd9886cd9c0 20 remove_watcher() i=2 2024-09-14T11:10:37.036 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:37.038+0000 7fd9886cd9c0 20 remove_watcher() i=3 2024-09-14T11:10:37.038 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:37.038+0000 7fd9886cd9c0 20 remove_watcher() i=4 2024-09-14T11:10:37.040 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:37.042+0000 7fd9886cd9c0 20 remove_watcher() i=5 2024-09-14T11:10:37.041 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:37.042+0000 7fd9886cd9c0 20 remove_watcher() i=6 2024-09-14T11:10:37.043 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:37.042+0000 7fd9886cd9c0 20 remove_watcher() i=7 2024-09-14T11:10:37.060 INFO:tasks.workunit.client.0.smithi138.stderr:radosgw-admin bi list --bucket check-bucket --object c 2024-09-14T11:10:37.091 INFO:tasks.workunit.client.0.smithi138.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:10:37.091 INFO:tasks.workunit.client.0.smithi138.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:10:37.136 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:37.138+0000 7f131a3aa9c0 20 rados->read ofs=0 len=0 2024-09-14T11:10:37.139 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:37.138+0000 7f131a3aa9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:10:37.139 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:37.138+0000 7f131a3aa9c0 20 realm 2024-09-14T11:10:37.139 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:37.138+0000 7f131a3aa9c0 20 rados->read ofs=0 len=0 2024-09-14T11:10:37.139 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:37.138+0000 7f131a3aa9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:10:37.139 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:37.138+0000 7f131a3aa9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:10:37.139 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:37.138+0000 7f131a3aa9c0 20 rados->read ofs=0 len=0 2024-09-14T11:10:37.139 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:37.138+0000 7f131a3aa9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:10:37.139 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:37.138+0000 7f131a3aa9c0 20 rados->read ofs=0 len=0 2024-09-14T11:10:37.140 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:37.142+0000 7f131a3aa9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:10:37.141 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:37.142+0000 7f131a3aa9c0 20 rados->read ofs=0 len=0 2024-09-14T11:10:37.141 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:37.142+0000 7f131a3aa9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:10:37.141 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:37.142+0000 7f131a3aa9c0 20 searching for the correct realm 2024-09-14T11:10:37.143 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:37.142+0000 7f13176af640 0 -- 172.21.15.138:0/69412270 >> [v2:172.21.15.154:6808/1468088432,v1:172.21.15.154:6809/1468088432] conn(0x7f1308073070 msgr2=0x7f130804d780 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:10:37.355 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:37.354+0000 7f13186b1640 0 -- 172.21.15.138:0/69412270 >> [v2:172.21.15.138:6824/2633984942,v1:172.21.15.138:6825/2633984942] conn(0x55b0340d6b80 msgr2=0x55b0340d8f70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:10:37.372 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:37.374+0000 7f131a3aa9c0 20 RGWRados::pool_iterate: got zone_info.d9e72d30-c60b-4d0d-9267-fdc36392d5ad 2024-09-14T11:10:37.372 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:37.374+0000 7f131a3aa9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:10:37.372 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:37.374+0000 7f131a3aa9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:10:37.372 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:37.374+0000 7f131a3aa9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:10:37.372 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:37.374+0000 7f131a3aa9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:10:37.372 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:37.374+0000 7f131a3aa9c0 20 RGWRados::pool_iterate: got zonegroup_info.65ab941b-da8c-4160-94fb-3672b069d44f 2024-09-14T11:10:37.372 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:37.374+0000 7f131a3aa9c0 20 rados->read ofs=0 len=0 2024-09-14T11:10:37.373 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:37.374+0000 7f131a3aa9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:10:37.373 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:37.374+0000 7f131a3aa9c0 20 rados->read ofs=0 len=0 2024-09-14T11:10:37.373 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:37.374+0000 7f131a3aa9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:10:37.373 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:37.374+0000 7f131a3aa9c0 20 rados->read ofs=0 len=0 2024-09-14T11:10:37.374 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:37.374+0000 7f131a3aa9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:10:37.374 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:37.374+0000 7f131a3aa9c0 20 zone default found 2024-09-14T11:10:37.374 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:37.374+0000 7f131a3aa9c0 4 Realm: () 2024-09-14T11:10:37.374 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:37.374+0000 7f131a3aa9c0 4 ZoneGroup: default (65ab941b-da8c-4160-94fb-3672b069d44f) 2024-09-14T11:10:37.374 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:37.374+0000 7f131a3aa9c0 4 Zone: default (d9e72d30-c60b-4d0d-9267-fdc36392d5ad) 2024-09-14T11:10:37.374 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:37.374+0000 7f131a3aa9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:10:37.374 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:37.374+0000 7f131a3aa9c0 20 zonegroup default 2024-09-14T11:10:37.374 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:37.374+0000 7f131a3aa9c0 20 rados->read ofs=0 len=0 2024-09-14T11:10:37.375 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:37.374+0000 7f131a3aa9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:10:37.375 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:37.374+0000 7f131a3aa9c0 20 rados->read ofs=0 len=0 2024-09-14T11:10:37.375 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:37.378+0000 7f131a3aa9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:10:37.375 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:37.378+0000 7f131a3aa9c0 20 rados->read ofs=0 len=0 2024-09-14T11:10:37.376 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:37.378+0000 7f131a3aa9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:10:37.376 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:37.378+0000 7f131a3aa9c0 20 started sync module instance, tier type = 2024-09-14T11:10:37.377 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:37.378+0000 7f131a3aa9c0 20 started zone id=d9e72d30-c60b-4d0d-9267-fdc36392d5ad (name=default) with tier type = 2024-09-14T11:10:37.400 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:37.398+0000 7f131a3aa9c0 20 add_watcher() i=0 2024-09-14T11:10:37.400 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:37.398+0000 7f131a3aa9c0 20 add_watcher() i=1 2024-09-14T11:10:37.400 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:37.398+0000 7f131a3aa9c0 20 add_watcher() i=2 2024-09-14T11:10:37.400 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:37.398+0000 7f131a3aa9c0 20 add_watcher() i=3 2024-09-14T11:10:37.400 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:37.398+0000 7f131a3aa9c0 20 add_watcher() i=4 2024-09-14T11:10:37.400 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:37.398+0000 7f131a3aa9c0 20 add_watcher() i=5 2024-09-14T11:10:37.401 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:37.402+0000 7f131a3aa9c0 20 add_watcher() i=6 2024-09-14T11:10:37.402 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:37.402+0000 7f131a3aa9c0 20 add_watcher() i=7 2024-09-14T11:10:37.402 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:37.402+0000 7f131a3aa9c0 2 all 8 watchers are set, enabling cache 2024-09-14T11:10:37.406 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:37.406+0000 7f11cdfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:10:37.407 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:37.406+0000 7f131a3aa9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:10:37.407 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:37.406+0000 7f131a3aa9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:10:37.407 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:37.406+0000 7f131a3aa9c0 5 note: GC not initialized 2024-09-14T11:10:37.408 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:37.406+0000 7f11ccfe1640 20 reqs_thread_entry: start 2024-09-14T11:10:37.408 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:37.410+0000 7f131a3aa9c0 20 init_complete bucket index max shards: 11 2024-09-14T11:10:37.408 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:37.410+0000 7f131a3aa9c0 20 Filter name: none 2024-09-14T11:10:37.408 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:37.410+0000 7f11467fc640 20 reqs_thread_entry: start 2024-09-14T11:10:37.408 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:37.410+0000 7f131a3aa9c0 20 rados->read ofs=0 len=0 2024-09-14T11:10:37.408 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:37.410+0000 7f131a3aa9c0 20 rados_obj.operate() r=0 bl.length=190 2024-09-14T11:10:37.409 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:37.410+0000 7f131a3aa9c0 20 rados->read ofs=0 len=0 2024-09-14T11:10:37.409 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:37.410+0000 7f131a3aa9c0 20 rados_obj.operate() r=0 bl.length=412 2024-09-14T11:10:37.409 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:37.410+0000 7f131a3aa9c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:10:37.409 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:37.410+0000 7f131a3aa9c0 20 INFO: main: max_entries=1000, index=gen=0, max_shards=11 2024-09-14T11:10:37.409 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:37.410+0000 7f131a3aa9c0 20 INFO: main: starting shard=0 2024-09-14T11:10:37.409 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:37.410+0000 7f131a3aa9c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.1.0 2024-09-14T11:10:37.410 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:37.410+0000 7f131a3aa9c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:10:37.410 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:37.410+0000 7f131a3aa9c0 20 INFO: main: starting shard=1 2024-09-14T11:10:37.410 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:37.410+0000 7f131a3aa9c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.1.1 2024-09-14T11:10:37.410 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:37.410+0000 7f131a3aa9c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:10:37.410 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:37.410+0000 7f131a3aa9c0 20 INFO: main: starting shard=2 2024-09-14T11:10:37.410 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:37.410+0000 7f131a3aa9c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.1.2 2024-09-14T11:10:37.411 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:37.410+0000 7f131a3aa9c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:10:37.411 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:37.410+0000 7f131a3aa9c0 20 INFO: main: starting shard=3 2024-09-14T11:10:37.411 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:37.410+0000 7f131a3aa9c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.1.3 2024-09-14T11:10:37.412 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:37.414+0000 7f131a3aa9c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:10:37.412 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:37.414+0000 7f131a3aa9c0 20 INFO: main: starting shard=4 2024-09-14T11:10:37.412 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:37.414+0000 7f131a3aa9c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.1.4 2024-09-14T11:10:37.413 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:37.414+0000 7f131a3aa9c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:10:37.413 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:37.414+0000 7f131a3aa9c0 20 INFO: main: starting shard=5 2024-09-14T11:10:37.413 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:37.414+0000 7f131a3aa9c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.1.5 2024-09-14T11:10:37.414 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:37.414+0000 7f131a3aa9c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:10:37.414 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:37.414+0000 7f131a3aa9c0 20 INFO: main: starting shard=6 2024-09-14T11:10:37.414 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:37.414+0000 7f131a3aa9c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.1.6 2024-09-14T11:10:37.414 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:37.414+0000 7f131a3aa9c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:10:37.414 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:37.414+0000 7f131a3aa9c0 20 INFO: main: starting shard=7 2024-09-14T11:10:37.415 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:37.414+0000 7f131a3aa9c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.1.7 2024-09-14T11:10:37.416 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:37.418+0000 7f131a3aa9c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:10:37.416 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:37.418+0000 7f131a3aa9c0 20 INFO: main: starting shard=8 2024-09-14T11:10:37.416 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:37.418+0000 7f131a3aa9c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.1.8 2024-09-14T11:10:37.417 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:37.418+0000 7f131a3aa9c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:10:37.417 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:37.418+0000 7f131a3aa9c0 20 INFO: main: starting shard=9 2024-09-14T11:10:37.417 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:37.418+0000 7f131a3aa9c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.1.9 2024-09-14T11:10:37.418 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:37.418+0000 7f131a3aa9c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:10:37.418 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:37.418+0000 7f131a3aa9c0 20 INFO: main: starting shard=10 2024-09-14T11:10:37.418 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:37.418+0000 7f131a3aa9c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.1.10 2024-09-14T11:10:37.419 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:37.418+0000 7f131a3aa9c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:10:37.419 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:37.418+0000 7f131a3aa9c0 20 INFO: main: done 2024-09-14T11:10:37.420 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:37.422+0000 7f11cdfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:10:37.425 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:37.426+0000 7f131a3aa9c0 20 remove_watcher() i=0 2024-09-14T11:10:37.425 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:37.426+0000 7f131a3aa9c0 2 removed watcher, disabling cache 2024-09-14T11:10:37.428 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:37.430+0000 7f131a3aa9c0 20 remove_watcher() i=1 2024-09-14T11:10:37.430 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:37.430+0000 7f131a3aa9c0 20 remove_watcher() i=2 2024-09-14T11:10:37.432 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:37.434+0000 7f131a3aa9c0 20 remove_watcher() i=3 2024-09-14T11:10:37.435 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:37.434+0000 7f131a3aa9c0 20 remove_watcher() i=4 2024-09-14T11:10:37.437 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:37.438+0000 7f131a3aa9c0 20 remove_watcher() i=5 2024-09-14T11:10:37.438 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:37.438+0000 7f131a3aa9c0 20 remove_watcher() i=6 2024-09-14T11:10:37.439 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:37.442+0000 7f131a3aa9c0 20 remove_watcher() i=7 2024-09-14T11:10:37.454 INFO:tasks.workunit.client.0.smithi138.stderr:radosgw-admin bi list --bucket check-bucket --object d 2024-09-14T11:10:37.487 INFO:tasks.workunit.client.0.smithi138.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:10:37.487 INFO:tasks.workunit.client.0.smithi138.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:10:37.533 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:37.534+0000 7facbf6c39c0 20 rados->read ofs=0 len=0 2024-09-14T11:10:37.535 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:37.534+0000 7facbf6c39c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:10:37.535 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:37.534+0000 7facbf6c39c0 20 realm 2024-09-14T11:10:37.535 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:37.534+0000 7facbf6c39c0 20 rados->read ofs=0 len=0 2024-09-14T11:10:37.535 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:37.534+0000 7facbf6c39c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:10:37.535 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:37.534+0000 7facbf6c39c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:10:37.535 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:37.534+0000 7facbf6c39c0 20 rados->read ofs=0 len=0 2024-09-14T11:10:37.535 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:37.534+0000 7facbf6c39c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:10:37.535 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:37.534+0000 7facbf6c39c0 20 rados->read ofs=0 len=0 2024-09-14T11:10:37.537 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:37.538+0000 7facbf6c39c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:10:37.537 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:37.538+0000 7facbf6c39c0 20 rados->read ofs=0 len=0 2024-09-14T11:10:37.537 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:37.538+0000 7facbf6c39c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:10:37.537 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:37.538+0000 7facbf6c39c0 20 searching for the correct realm 2024-09-14T11:10:37.538 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:37.538+0000 7facbc9c8640 0 -- 172.21.15.138:0/1358430131 >> [v2:172.21.15.154:6808/1468088432,v1:172.21.15.154:6809/1468088432] conn(0x7facb00a3c20 msgr2=0x7facb00f66a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:10:37.752 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:37.754+0000 7facbd9ca640 0 -- 172.21.15.138:0/1358430131 >> [v2:172.21.15.138:6824/2633984942,v1:172.21.15.138:6825/2633984942] conn(0x5574b0467470 msgr2=0x5574b0469860 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:10:37.769 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:37.770+0000 7facbf6c39c0 20 RGWRados::pool_iterate: got zone_info.d9e72d30-c60b-4d0d-9267-fdc36392d5ad 2024-09-14T11:10:37.769 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:37.770+0000 7facbf6c39c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:10:37.769 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:37.770+0000 7facbf6c39c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:10:37.769 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:37.770+0000 7facbf6c39c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:10:37.769 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:37.770+0000 7facbf6c39c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:10:37.769 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:37.770+0000 7facbf6c39c0 20 RGWRados::pool_iterate: got zonegroup_info.65ab941b-da8c-4160-94fb-3672b069d44f 2024-09-14T11:10:37.770 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:37.770+0000 7facbf6c39c0 20 rados->read ofs=0 len=0 2024-09-14T11:10:37.770 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:37.770+0000 7facbf6c39c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:10:37.770 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:37.770+0000 7facbf6c39c0 20 rados->read ofs=0 len=0 2024-09-14T11:10:37.770 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:37.770+0000 7facbf6c39c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:10:37.770 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:37.770+0000 7facbf6c39c0 20 rados->read ofs=0 len=0 2024-09-14T11:10:37.771 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:37.770+0000 7facbf6c39c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:10:37.771 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:37.770+0000 7facbf6c39c0 20 zone default found 2024-09-14T11:10:37.771 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:37.770+0000 7facbf6c39c0 4 Realm: () 2024-09-14T11:10:37.771 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:37.770+0000 7facbf6c39c0 4 ZoneGroup: default (65ab941b-da8c-4160-94fb-3672b069d44f) 2024-09-14T11:10:37.771 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:37.770+0000 7facbf6c39c0 4 Zone: default (d9e72d30-c60b-4d0d-9267-fdc36392d5ad) 2024-09-14T11:10:37.772 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:37.770+0000 7facbf6c39c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:10:37.772 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:37.770+0000 7facbf6c39c0 20 zonegroup default 2024-09-14T11:10:37.772 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:37.770+0000 7facbf6c39c0 20 rados->read ofs=0 len=0 2024-09-14T11:10:37.772 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:37.774+0000 7facbf6c39c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:10:37.772 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:37.774+0000 7facbf6c39c0 20 rados->read ofs=0 len=0 2024-09-14T11:10:37.773 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:37.774+0000 7facbf6c39c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:10:37.773 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:37.774+0000 7facbf6c39c0 20 rados->read ofs=0 len=0 2024-09-14T11:10:37.773 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:37.774+0000 7facbf6c39c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:10:37.774 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:37.774+0000 7facbf6c39c0 20 started sync module instance, tier type = 2024-09-14T11:10:37.774 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:37.774+0000 7facbf6c39c0 20 started zone id=d9e72d30-c60b-4d0d-9267-fdc36392d5ad (name=default) with tier type = 2024-09-14T11:10:37.799 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:37.798+0000 7facbf6c39c0 20 add_watcher() i=0 2024-09-14T11:10:37.799 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:37.798+0000 7facbf6c39c0 20 add_watcher() i=1 2024-09-14T11:10:37.799 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:37.798+0000 7facbf6c39c0 20 add_watcher() i=2 2024-09-14T11:10:37.799 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:37.798+0000 7facbf6c39c0 20 add_watcher() i=3 2024-09-14T11:10:37.799 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:37.798+0000 7facbf6c39c0 20 add_watcher() i=4 2024-09-14T11:10:37.799 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:37.798+0000 7facbf6c39c0 20 add_watcher() i=5 2024-09-14T11:10:37.799 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:37.798+0000 7facbf6c39c0 20 add_watcher() i=6 2024-09-14T11:10:37.802 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:37.802+0000 7facbf6c39c0 20 add_watcher() i=7 2024-09-14T11:10:37.802 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:37.802+0000 7facbf6c39c0 2 all 8 watchers are set, enabling cache 2024-09-14T11:10:37.808 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:37.806+0000 7fab737e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:10:37.808 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:37.806+0000 7facbf6c39c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:10:37.808 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:37.806+0000 7facbf6c39c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:10:37.808 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:37.806+0000 7facbf6c39c0 5 note: GC not initialized 2024-09-14T11:10:37.808 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:37.810+0000 7fab727e4640 20 reqs_thread_entry: start 2024-09-14T11:10:37.808 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:37.810+0000 7facbf6c39c0 20 init_complete bucket index max shards: 11 2024-09-14T11:10:37.809 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:37.810+0000 7facbf6c39c0 20 Filter name: none 2024-09-14T11:10:37.809 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:37.810+0000 7faae3fff640 20 reqs_thread_entry: start 2024-09-14T11:10:37.809 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:37.810+0000 7facbf6c39c0 20 rados->read ofs=0 len=0 2024-09-14T11:10:37.810 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:37.810+0000 7facbf6c39c0 20 rados_obj.operate() r=0 bl.length=190 2024-09-14T11:10:37.810 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:37.810+0000 7facbf6c39c0 20 rados->read ofs=0 len=0 2024-09-14T11:10:37.810 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:37.810+0000 7facbf6c39c0 20 rados_obj.operate() r=0 bl.length=412 2024-09-14T11:10:37.810 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:37.810+0000 7facbf6c39c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:10:37.810 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:37.810+0000 7facbf6c39c0 20 INFO: main: max_entries=1000, index=gen=0, max_shards=11 2024-09-14T11:10:37.810 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:37.810+0000 7facbf6c39c0 20 INFO: main: starting shard=0 2024-09-14T11:10:37.810 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:37.810+0000 7facbf6c39c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.1.0 2024-09-14T11:10:37.811 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:37.810+0000 7facbf6c39c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:10:37.811 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:37.810+0000 7facbf6c39c0 20 INFO: main: starting shard=1 2024-09-14T11:10:37.811 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:37.810+0000 7facbf6c39c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.1.1 2024-09-14T11:10:37.811 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:37.814+0000 7facbf6c39c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:10:37.812 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:37.814+0000 7facbf6c39c0 20 INFO: main: starting shard=2 2024-09-14T11:10:37.812 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:37.814+0000 7facbf6c39c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.1.2 2024-09-14T11:10:37.812 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:37.814+0000 7facbf6c39c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:10:37.812 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:37.814+0000 7facbf6c39c0 20 INFO: main: starting shard=3 2024-09-14T11:10:37.812 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:37.814+0000 7facbf6c39c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.1.3 2024-09-14T11:10:37.814 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:37.814+0000 7facbf6c39c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:10:37.814 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:37.814+0000 7facbf6c39c0 20 INFO: main: starting shard=4 2024-09-14T11:10:37.814 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:37.814+0000 7facbf6c39c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.1.4 2024-09-14T11:10:37.815 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:37.814+0000 7facbf6c39c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:10:37.815 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:37.814+0000 7facbf6c39c0 20 INFO: main: starting shard=5 2024-09-14T11:10:37.815 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:37.814+0000 7facbf6c39c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.1.5 2024-09-14T11:10:37.816 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:37.818+0000 7facbf6c39c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:10:37.816 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:37.818+0000 7facbf6c39c0 20 INFO: main: starting shard=6 2024-09-14T11:10:37.816 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:37.818+0000 7facbf6c39c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.1.6 2024-09-14T11:10:37.817 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:37.818+0000 7facbf6c39c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:10:37.817 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:37.818+0000 7facbf6c39c0 20 INFO: main: starting shard=7 2024-09-14T11:10:37.817 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:37.818+0000 7facbf6c39c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.1.7 2024-09-14T11:10:37.818 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:37.818+0000 7facbf6c39c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:10:37.819 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:37.818+0000 7facbf6c39c0 20 INFO: main: starting shard=8 2024-09-14T11:10:37.819 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:37.818+0000 7facbf6c39c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.1.8 2024-09-14T11:10:37.820 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:37.822+0000 7facbf6c39c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:10:37.820 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:37.822+0000 7facbf6c39c0 20 INFO: main: starting shard=9 2024-09-14T11:10:37.820 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:37.822+0000 7facbf6c39c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.1.9 2024-09-14T11:10:37.821 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:37.822+0000 7facbf6c39c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:10:37.821 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:37.822+0000 7facbf6c39c0 20 INFO: main: starting shard=10 2024-09-14T11:10:37.821 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:37.822+0000 7facbf6c39c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.1.10 2024-09-14T11:10:37.822 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:37.822+0000 7facbf6c39c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:10:37.822 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:37.822+0000 7facbf6c39c0 20 INFO: main: done 2024-09-14T11:10:37.823 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:37.822+0000 7fab737e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:10:37.829 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:37.830+0000 7facbf6c39c0 20 remove_watcher() i=0 2024-09-14T11:10:37.829 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:37.830+0000 7facbf6c39c0 2 removed watcher, disabling cache 2024-09-14T11:10:37.831 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:37.830+0000 7facbf6c39c0 20 remove_watcher() i=1 2024-09-14T11:10:37.833 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:37.834+0000 7facbf6c39c0 20 remove_watcher() i=2 2024-09-14T11:10:37.836 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:37.838+0000 7facbf6c39c0 20 remove_watcher() i=3 2024-09-14T11:10:37.838 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:37.838+0000 7facbf6c39c0 20 remove_watcher() i=4 2024-09-14T11:10:37.840 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:37.842+0000 7facbf6c39c0 20 remove_watcher() i=5 2024-09-14T11:10:37.841 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:37.842+0000 7facbf6c39c0 20 remove_watcher() i=6 2024-09-14T11:10:37.843 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:37.842+0000 7facbf6c39c0 20 remove_watcher() i=7 2024-09-14T11:10:37.858 INFO:tasks.workunit.client.0.smithi138.stderr:TEST: bucket check olh does not find new leftover OLH entries after fix 2024-09-14T11:10:37.858 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-14T11:10:37.859 INFO:tasks.workunit.client.0.smithi138.stderr:radosgw-admin bucket check olh --bucket check-bucket --dump-keys 2024-09-14T11:10:37.891 INFO:tasks.workunit.client.0.smithi138.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:10:37.891 INFO:tasks.workunit.client.0.smithi138.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:10:37.936 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:37.938+0000 7f98ac48b9c0 20 rados->read ofs=0 len=0 2024-09-14T11:10:37.938 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:37.938+0000 7f98ac48b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:10:37.938 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:37.938+0000 7f98ac48b9c0 20 realm 2024-09-14T11:10:37.938 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:37.938+0000 7f98ac48b9c0 20 rados->read ofs=0 len=0 2024-09-14T11:10:37.938 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:37.938+0000 7f98ac48b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:10:37.938 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:37.938+0000 7f98ac48b9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:10:37.938 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:37.938+0000 7f98ac48b9c0 20 rados->read ofs=0 len=0 2024-09-14T11:10:37.938 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:37.938+0000 7f98ac48b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:10:37.938 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:37.938+0000 7f98ac48b9c0 20 rados->read ofs=0 len=0 2024-09-14T11:10:37.940 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:37.942+0000 7f98ac48b9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:10:37.940 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:37.942+0000 7f98ac48b9c0 20 rados->read ofs=0 len=0 2024-09-14T11:10:37.940 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:37.942+0000 7f98ac48b9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:10:37.940 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:37.942+0000 7f98ac48b9c0 20 searching for the correct realm 2024-09-14T11:10:37.945 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:37.946+0000 7f98a9f91640 0 -- 172.21.15.138:0/1485874141 >> [v2:172.21.15.138:6808/3258321916,v1:172.21.15.138:6809/3258321916] conn(0x5623902420e0 msgr2=0x5623902445a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-14T11:10:37.952 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:37.954+0000 7f98a9790640 0 -- 172.21.15.138:0/1485874141 >> [v2:172.21.15.138:6816/326481658,v1:172.21.15.138:6817/326481658] conn(0x7f98a4018040 msgr2=0x7f98a4096a20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:10:38.172 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:38.174+0000 7f98ac48b9c0 20 RGWRados::pool_iterate: got zone_info.d9e72d30-c60b-4d0d-9267-fdc36392d5ad 2024-09-14T11:10:38.172 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:38.174+0000 7f98ac48b9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:10:38.172 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:38.174+0000 7f98ac48b9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:10:38.172 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:38.174+0000 7f98ac48b9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:10:38.172 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:38.174+0000 7f98ac48b9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:10:38.173 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:38.174+0000 7f98ac48b9c0 20 RGWRados::pool_iterate: got zonegroup_info.65ab941b-da8c-4160-94fb-3672b069d44f 2024-09-14T11:10:38.173 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:38.174+0000 7f98ac48b9c0 20 rados->read ofs=0 len=0 2024-09-14T11:10:38.173 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:38.174+0000 7f98ac48b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:10:38.173 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:38.174+0000 7f98ac48b9c0 20 rados->read ofs=0 len=0 2024-09-14T11:10:38.173 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:38.174+0000 7f98ac48b9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:10:38.173 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:38.174+0000 7f98ac48b9c0 20 rados->read ofs=0 len=0 2024-09-14T11:10:38.174 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:38.174+0000 7f98ac48b9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:10:38.174 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:38.174+0000 7f98ac48b9c0 20 zone default found 2024-09-14T11:10:38.174 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:38.174+0000 7f98ac48b9c0 4 Realm: () 2024-09-14T11:10:38.175 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:38.174+0000 7f98ac48b9c0 4 ZoneGroup: default (65ab941b-da8c-4160-94fb-3672b069d44f) 2024-09-14T11:10:38.175 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:38.174+0000 7f98ac48b9c0 4 Zone: default (d9e72d30-c60b-4d0d-9267-fdc36392d5ad) 2024-09-14T11:10:38.175 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:38.174+0000 7f98ac48b9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:10:38.175 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:38.174+0000 7f98ac48b9c0 20 zonegroup default 2024-09-14T11:10:38.175 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:38.174+0000 7f98ac48b9c0 20 rados->read ofs=0 len=0 2024-09-14T11:10:38.175 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:38.174+0000 7f98ac48b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:10:38.175 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:38.174+0000 7f98ac48b9c0 20 rados->read ofs=0 len=0 2024-09-14T11:10:38.175 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:38.178+0000 7f98ac48b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:10:38.176 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:38.178+0000 7f98ac48b9c0 20 rados->read ofs=0 len=0 2024-09-14T11:10:38.176 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:38.178+0000 7f98ac48b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:10:38.176 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:38.178+0000 7f98ac48b9c0 20 started sync module instance, tier type = 2024-09-14T11:10:38.176 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:38.178+0000 7f98ac48b9c0 20 started zone id=d9e72d30-c60b-4d0d-9267-fdc36392d5ad (name=default) with tier type = 2024-09-14T11:10:38.201 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:38.202+0000 7f98ac48b9c0 20 add_watcher() i=0 2024-09-14T11:10:38.202 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:38.202+0000 7f98ac48b9c0 20 add_watcher() i=1 2024-09-14T11:10:38.202 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:38.202+0000 7f98ac48b9c0 20 add_watcher() i=2 2024-09-14T11:10:38.202 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:38.202+0000 7f98ac48b9c0 20 add_watcher() i=3 2024-09-14T11:10:38.202 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:38.202+0000 7f98ac48b9c0 20 add_watcher() i=4 2024-09-14T11:10:38.202 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:38.202+0000 7f98ac48b9c0 20 add_watcher() i=5 2024-09-14T11:10:38.202 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:38.202+0000 7f98ac48b9c0 20 add_watcher() i=6 2024-09-14T11:10:38.204 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:38.206+0000 7f98ac48b9c0 20 add_watcher() i=7 2024-09-14T11:10:38.204 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:38.206+0000 7f98ac48b9c0 2 all 8 watchers are set, enabling cache 2024-09-14T11:10:38.208 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:38.210+0000 7f975b7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:10:38.209 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:38.210+0000 7f98ac48b9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:10:38.210 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:38.210+0000 7f98ac48b9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:10:38.210 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:38.210+0000 7f98ac48b9c0 5 note: GC not initialized 2024-09-14T11:10:38.211 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:38.210+0000 7f975a7fc640 20 reqs_thread_entry: start 2024-09-14T11:10:38.211 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:38.210+0000 7f98ac48b9c0 20 init_complete bucket index max shards: 11 2024-09-14T11:10:38.211 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:38.210+0000 7f98ac48b9c0 20 Filter name: none 2024-09-14T11:10:38.211 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:38.210+0000 7f96cbfff640 20 reqs_thread_entry: start 2024-09-14T11:10:38.211 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:38.210+0000 7f98ac48b9c0 10 cache get: name=default.rgw.meta+root+check-bucket : miss 2024-09-14T11:10:38.211 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:38.210+0000 7f98ac48b9c0 20 rados->read ofs=0 len=0 2024-09-14T11:10:38.212 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:38.214+0000 7f98ac48b9c0 20 rados_obj.operate() r=0 bl.length=190 2024-09-14T11:10:38.212 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:38.214+0000 7f98ac48b9c0 10 cache put: name=default.rgw.meta+root+check-bucket info.flags=0x11 2024-09-14T11:10:38.212 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:38.214+0000 7f98ac48b9c0 10 adding default.rgw.meta+root+check-bucket to cache LRU end 2024-09-14T11:10:38.213 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:38.214+0000 7f98ac48b9c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.check-bucket:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.1 : miss 2024-09-14T11:10:38.213 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:38.214+0000 7f98ac48b9c0 20 rados->read ofs=0 len=0 2024-09-14T11:10:38.214 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:38.214+0000 7f98ac48b9c0 20 rados_obj.operate() r=0 bl.length=412 2024-09-14T11:10:38.214 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:38.214+0000 7f98ac48b9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.check-bucket:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.1 info.flags=0x17 2024-09-14T11:10:38.214 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:38.214+0000 7f98ac48b9c0 10 adding default.rgw.meta+root+.bucket.meta.check-bucket:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.1 to cache LRU end 2024-09-14T11:10:38.214 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:38.214+0000 7f98ac48b9c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:10:38.214 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:38.214+0000 7f98ac48b9c0 10 updating xattr: name=user.rgw.acl bl.length()=179 2024-09-14T11:10:38.214 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:38.214+0000 7f98ac48b9c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.check-bucket:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.1 2024-09-14T11:10:38.214 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:38.214+0000 7f98ac48b9c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.1.0 2024-09-14T11:10:38.214 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:38.214+0000 7f98ac48b9c0 1 NOTICE: finished shard 0 (0 entries found) 2024-09-14T11:10:38.214 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:38.214+0000 7f98ac48b9c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.1.1 2024-09-14T11:10:38.215 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:38.214+0000 7f98ac48b9c0 1 NOTICE: finished shard 1 (0 entries found) 2024-09-14T11:10:38.215 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:38.214+0000 7f98ac48b9c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.1.2 2024-09-14T11:10:38.216 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:38.218+0000 7f98ac48b9c0 1 NOTICE: finished shard 2 (0 entries found) 2024-09-14T11:10:38.216 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:38.218+0000 7f98ac48b9c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.1.3 2024-09-14T11:10:38.217 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:38.218+0000 7f98ac48b9c0 1 NOTICE: finished shard 3 (0 entries found) 2024-09-14T11:10:38.217 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:38.218+0000 7f98ac48b9c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.1.4 2024-09-14T11:10:38.218 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:38.218+0000 7f98ac48b9c0 1 NOTICE: finished shard 4 (0 entries found) 2024-09-14T11:10:38.218 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:38.218+0000 7f98ac48b9c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.1.5 2024-09-14T11:10:38.219 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:38.218+0000 7f98ac48b9c0 1 NOTICE: finished shard 5 (0 entries found) 2024-09-14T11:10:38.219 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:38.218+0000 7f98ac48b9c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.1.6 2024-09-14T11:10:38.219 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:38.218+0000 7f98ac48b9c0 1 NOTICE: finished shard 6 (0 entries found) 2024-09-14T11:10:38.219 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:38.218+0000 7f98ac48b9c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.1.7 2024-09-14T11:10:38.220 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:38.222+0000 7f98ac48b9c0 1 NOTICE: finished shard 7 (0 entries found) 2024-09-14T11:10:38.221 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:38.222+0000 7f98ac48b9c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.1.8 2024-09-14T11:10:38.222 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:38.222+0000 7f98ac48b9c0 1 NOTICE: finished shard 8 (0 entries found) 2024-09-14T11:10:38.222 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:38.222+0000 7f98ac48b9c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.1.9 2024-09-14T11:10:38.222 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:38.222+0000 7f98ac48b9c0 1 NOTICE: finished shard 9 (0 entries found) 2024-09-14T11:10:38.223 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:38.222+0000 7f98ac48b9c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.1.10 2024-09-14T11:10:38.224 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:38.226+0000 7f98ac48b9c0 1 NOTICE: finished shard 10 (0 entries found) 2024-09-14T11:10:38.224 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:38.226+0000 7f98ac48b9c0 1 NOTICE: finished all shards (0 entries found) 2024-09-14T11:10:38.225 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:38.226+0000 7f975b7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:10:38.230 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:38.230+0000 7f98ac48b9c0 20 remove_watcher() i=0 2024-09-14T11:10:38.230 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:38.230+0000 7f98ac48b9c0 2 removed watcher, disabling cache 2024-09-14T11:10:38.232 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:38.234+0000 7f98ac48b9c0 20 remove_watcher() i=1 2024-09-14T11:10:38.235 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:38.234+0000 7f98ac48b9c0 20 remove_watcher() i=2 2024-09-14T11:10:38.237 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:38.238+0000 7f98ac48b9c0 20 remove_watcher() i=3 2024-09-14T11:10:38.239 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:38.238+0000 7f98ac48b9c0 20 remove_watcher() i=4 2024-09-14T11:10:38.240 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:38.242+0000 7f98ac48b9c0 20 remove_watcher() i=5 2024-09-14T11:10:38.242 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:38.242+0000 7f98ac48b9c0 20 remove_watcher() i=6 2024-09-14T11:10:38.244 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:38.246+0000 7f98ac48b9c0 20 remove_watcher() i=7 2024-09-14T11:10:38.265 INFO:tasks.workunit.client.0.smithi138.stderr:TEST: verify that bucket check fixes do not affect null version objects 2024-09-14T11:10:38.265 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-14T11:10:38.267 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:10:38.267 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-14T11:10:38.302 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:10:38.302 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-14T11:10:38.364 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:10:38.364 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-14T11:10:38.499 INFO:tasks.workunit.client.0.smithi138.stderr:TEST: bucket check stats are correct in the presence of unlinked entries 2024-09-14T11:10:38.499 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-14T11:10:38.502 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:10:38.502 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-14T11:10:38.636 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:10:38.636 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-14T11:10:39.129 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:10:39.129 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-14T11:10:39.251 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:10:39.251 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-14T11:10:39.323 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:10:39.323 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-14T11:10:39.461 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:10:39.461 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-14T11:10:39.532 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:10:39.533 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-14T11:10:39.661 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:10:39.662 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-14T11:10:39.731 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:10:39.732 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-14T11:10:39.880 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:10:39.880 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-14T11:10:39.941 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:10:39.941 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-14T11:10:40.085 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:10:40.085 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-14T11:10:40.159 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:10:40.159 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-14T11:10:40.291 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:10:40.291 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-14T11:10:40.379 INFO:tasks.workunit.client.0.smithi138.stderr:ceph config set client rgw_debug_inject_set_olh_err 2 2024-09-14T11:10:40.838 INFO:tasks.workunit.client.0.smithi138.stderr:ceph config set client rgw_debug_inject_olh_cancel_modification_err true 2024-09-14T11:10:42.279 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:10:42.279 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-14T11:10:42.428 INFO:tasks.workunit.client.0.smithi138.stderr:An error occurred (NoSuchKey) when calling the PutObject operation: None 2024-09-14T11:10:42.429 INFO:tasks.workunit.client.0.smithi138.stderr:radosgw-admin bi list --bucket check-bucket --object c 2024-09-14T11:10:42.464 INFO:tasks.workunit.client.0.smithi138.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:10:42.465 INFO:tasks.workunit.client.0.smithi138.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:10:42.512 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:42.514+0000 7fb6ab3c29c0 20 rados->read ofs=0 len=0 2024-09-14T11:10:42.536 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:42.514+0000 7fb6ab3c29c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:10:42.536 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:42.514+0000 7fb6ab3c29c0 20 realm 2024-09-14T11:10:42.537 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:42.514+0000 7fb6ab3c29c0 20 rados->read ofs=0 len=0 2024-09-14T11:10:42.537 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:42.514+0000 7fb6ab3c29c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:10:42.537 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:42.514+0000 7fb6ab3c29c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:10:42.537 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:42.514+0000 7fb6ab3c29c0 20 rados->read ofs=0 len=0 2024-09-14T11:10:42.537 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:42.514+0000 7fb6ab3c29c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:10:42.537 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:42.514+0000 7fb6ab3c29c0 20 rados->read ofs=0 len=0 2024-09-14T11:10:42.537 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:42.518+0000 7fb6ab3c29c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:10:42.537 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:42.518+0000 7fb6ab3c29c0 20 rados->read ofs=0 len=0 2024-09-14T11:10:42.537 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:42.518+0000 7fb6ab3c29c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:10:42.537 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:42.518+0000 7fb6ab3c29c0 20 searching for the correct realm 2024-09-14T11:10:42.537 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:42.518+0000 7fb6a8ec8640 0 -- 172.21.15.138:0/4027860048 >> [v2:172.21.15.138:6808/3258321916,v1:172.21.15.138:6809/3258321916] conn(0x5583a7d7ccc0 msgr2=0x5583a7d7f180 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:10:42.537 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:42.522+0000 7fb6a8ec8640 0 -- 172.21.15.138:0/4027860048 >> [v2:172.21.15.154:6816/1950550278,v1:172.21.15.154:6817/1950550278] conn(0x7fb6a00b1040 msgr2=0x7fb6a00b3040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:10:42.745 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:42.746+0000 7fb6ab3c29c0 20 RGWRados::pool_iterate: got zone_info.d9e72d30-c60b-4d0d-9267-fdc36392d5ad 2024-09-14T11:10:42.745 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:42.746+0000 7fb6ab3c29c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:10:42.745 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:42.746+0000 7fb6ab3c29c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:10:42.745 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:42.746+0000 7fb6ab3c29c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:10:42.745 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:42.746+0000 7fb6ab3c29c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:10:42.745 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:42.746+0000 7fb6ab3c29c0 20 RGWRados::pool_iterate: got zonegroup_info.65ab941b-da8c-4160-94fb-3672b069d44f 2024-09-14T11:10:42.745 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:42.746+0000 7fb6ab3c29c0 20 rados->read ofs=0 len=0 2024-09-14T11:10:42.746 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:42.746+0000 7fb6ab3c29c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:10:42.746 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:42.746+0000 7fb6ab3c29c0 20 rados->read ofs=0 len=0 2024-09-14T11:10:42.746 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:42.746+0000 7fb6ab3c29c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:10:42.746 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:42.746+0000 7fb6ab3c29c0 20 rados->read ofs=0 len=0 2024-09-14T11:10:42.747 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:42.746+0000 7fb6ab3c29c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:10:42.748 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:42.746+0000 7fb6ab3c29c0 20 zone default found 2024-09-14T11:10:42.748 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:42.746+0000 7fb6ab3c29c0 4 Realm: () 2024-09-14T11:10:42.748 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:42.746+0000 7fb6ab3c29c0 4 ZoneGroup: default (65ab941b-da8c-4160-94fb-3672b069d44f) 2024-09-14T11:10:42.748 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:42.746+0000 7fb6ab3c29c0 4 Zone: default (d9e72d30-c60b-4d0d-9267-fdc36392d5ad) 2024-09-14T11:10:42.748 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:42.746+0000 7fb6ab3c29c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:10:42.748 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:42.746+0000 7fb6ab3c29c0 20 zonegroup default 2024-09-14T11:10:42.749 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:42.746+0000 7fb6ab3c29c0 20 rados->read ofs=0 len=0 2024-09-14T11:10:42.750 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:42.750+0000 7fb6ab3c29c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:10:42.750 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:42.750+0000 7fb6ab3c29c0 20 rados->read ofs=0 len=0 2024-09-14T11:10:42.750 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:42.750+0000 7fb6ab3c29c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:10:42.750 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:42.750+0000 7fb6ab3c29c0 20 rados->read ofs=0 len=0 2024-09-14T11:10:42.750 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:42.750+0000 7fb6ab3c29c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:10:42.750 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:42.750+0000 7fb6ab3c29c0 20 started sync module instance, tier type = 2024-09-14T11:10:42.751 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:42.750+0000 7fb6ab3c29c0 20 started zone id=d9e72d30-c60b-4d0d-9267-fdc36392d5ad (name=default) with tier type = 2024-09-14T11:10:42.773 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:42.774+0000 7fb6ab3c29c0 20 add_watcher() i=0 2024-09-14T11:10:42.774 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:42.774+0000 7fb6ab3c29c0 20 add_watcher() i=1 2024-09-14T11:10:42.774 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:42.774+0000 7fb6ab3c29c0 20 add_watcher() i=2 2024-09-14T11:10:42.774 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:42.774+0000 7fb6ab3c29c0 20 add_watcher() i=3 2024-09-14T11:10:42.774 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:42.774+0000 7fb6ab3c29c0 20 add_watcher() i=4 2024-09-14T11:10:42.774 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:42.774+0000 7fb6ab3c29c0 20 add_watcher() i=5 2024-09-14T11:10:42.774 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:42.774+0000 7fb6ab3c29c0 20 add_watcher() i=6 2024-09-14T11:10:42.776 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:42.778+0000 7fb6ab3c29c0 20 add_watcher() i=7 2024-09-14T11:10:42.776 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:42.778+0000 7fb6ab3c29c0 2 all 8 watchers are set, enabling cache 2024-09-14T11:10:42.779 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:42.778+0000 7fb55efe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:10:42.780 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:42.782+0000 7fb6ab3c29c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:10:42.780 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:42.782+0000 7fb6ab3c29c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:10:42.780 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:42.782+0000 7fb6ab3c29c0 5 note: GC not initialized 2024-09-14T11:10:42.781 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:42.782+0000 7fb55dfe3640 20 reqs_thread_entry: start 2024-09-14T11:10:42.781 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:42.782+0000 7fb6ab3c29c0 20 init_complete bucket index max shards: 11 2024-09-14T11:10:42.781 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:42.782+0000 7fb6ab3c29c0 20 Filter name: none 2024-09-14T11:10:42.781 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:42.782+0000 7fb4cf7fe640 20 reqs_thread_entry: start 2024-09-14T11:10:42.781 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:42.782+0000 7fb6ab3c29c0 20 rados->read ofs=0 len=0 2024-09-14T11:10:42.782 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:42.782+0000 7fb6ab3c29c0 20 rados_obj.operate() r=0 bl.length=190 2024-09-14T11:10:42.782 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:42.782+0000 7fb6ab3c29c0 20 rados->read ofs=0 len=0 2024-09-14T11:10:42.782 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:42.782+0000 7fb6ab3c29c0 20 rados_obj.operate() r=0 bl.length=412 2024-09-14T11:10:42.782 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:42.782+0000 7fb6ab3c29c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:10:42.782 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:42.782+0000 7fb6ab3c29c0 20 INFO: main: max_entries=1000, index=gen=0, max_shards=11 2024-09-14T11:10:42.783 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:42.782+0000 7fb6ab3c29c0 20 INFO: main: starting shard=0 2024-09-14T11:10:42.783 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:42.782+0000 7fb6ab3c29c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.1.0 2024-09-14T11:10:42.783 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:42.782+0000 7fb6ab3c29c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:10:42.783 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:42.782+0000 7fb6ab3c29c0 20 INFO: main: starting shard=1 2024-09-14T11:10:42.783 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:42.782+0000 7fb6ab3c29c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.1.1 2024-09-14T11:10:42.784 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:42.786+0000 7fb6ab3c29c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:10:42.784 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:42.786+0000 7fb6ab3c29c0 20 INFO: main: starting shard=2 2024-09-14T11:10:42.784 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:42.786+0000 7fb6ab3c29c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.1.2 2024-09-14T11:10:42.784 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:42.786+0000 7fb6ab3c29c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:10:42.784 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:42.786+0000 7fb6ab3c29c0 20 INFO: main: starting shard=3 2024-09-14T11:10:42.784 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:42.786+0000 7fb6ab3c29c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.1.3 2024-09-14T11:10:42.786 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:42.786+0000 7fb6ab3c29c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:10:42.786 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:42.786+0000 7fb6ab3c29c0 20 INFO: main: starting shard=4 2024-09-14T11:10:42.786 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:42.786+0000 7fb6ab3c29c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.1.4 2024-09-14T11:10:42.787 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:42.786+0000 7fb6ab3c29c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:10:42.787 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:42.786+0000 7fb6ab3c29c0 20 INFO: main: starting shard=5 2024-09-14T11:10:42.787 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:42.786+0000 7fb6ab3c29c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.1.5 2024-09-14T11:10:42.788 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:42.790+0000 7fb6ab3c29c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:10:42.789 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:42.790+0000 7fb6ab3c29c0 20 INFO: main: starting shard=6 2024-09-14T11:10:42.789 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:42.790+0000 7fb6ab3c29c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.1.6 2024-09-14T11:10:42.789 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:42.790+0000 7fb6ab3c29c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:10:42.789 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:42.790+0000 7fb6ab3c29c0 20 INFO: main: starting shard=7 2024-09-14T11:10:42.789 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:42.790+0000 7fb6ab3c29c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.1.7 2024-09-14T11:10:42.790 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:42.790+0000 7fb6ab3c29c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:10:42.790 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:42.790+0000 7fb6ab3c29c0 20 INFO: main: starting shard=8 2024-09-14T11:10:42.790 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:42.790+0000 7fb6ab3c29c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.1.8 2024-09-14T11:10:42.792 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:42.794+0000 7fb6ab3c29c0 20 INFO: main: bi_list() returned without error; entries.size()=5, is_truncated=0, marker= 2024-09-14T11:10:42.792 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:42.794+0000 7fb6ab3c29c0 20 INFO: main: starting shard=9 2024-09-14T11:10:42.792 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:42.794+0000 7fb6ab3c29c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.1.9 2024-09-14T11:10:42.793 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:42.794+0000 7fb6ab3c29c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:10:42.793 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:42.794+0000 7fb6ab3c29c0 20 INFO: main: starting shard=10 2024-09-14T11:10:42.793 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:42.794+0000 7fb6ab3c29c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.1.10 2024-09-14T11:10:42.794 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:42.794+0000 7fb6ab3c29c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:10:42.794 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:42.794+0000 7fb6ab3c29c0 20 INFO: main: done 2024-09-14T11:10:42.795 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:42.798+0000 7fb55efe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:10:42.801 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:42.802+0000 7fb6ab3c29c0 20 remove_watcher() i=0 2024-09-14T11:10:42.801 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:42.802+0000 7fb6ab3c29c0 2 removed watcher, disabling cache 2024-09-14T11:10:42.803 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:42.802+0000 7fb6ab3c29c0 20 remove_watcher() i=1 2024-09-14T11:10:42.805 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:42.806+0000 7fb6ab3c29c0 20 remove_watcher() i=2 2024-09-14T11:10:42.807 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:42.806+0000 7fb6ab3c29c0 20 remove_watcher() i=3 2024-09-14T11:10:42.809 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:42.810+0000 7fb6ab3c29c0 20 remove_watcher() i=4 2024-09-14T11:10:42.812 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:42.814+0000 7fb6ab3c29c0 20 remove_watcher() i=5 2024-09-14T11:10:42.813 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:42.814+0000 7fb6ab3c29c0 20 remove_watcher() i=6 2024-09-14T11:10:42.815 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:42.814+0000 7fb6ab3c29c0 20 remove_watcher() i=7 2024-09-14T11:10:42.840 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:10:42.840 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-14T11:10:42.904 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:10:42.904 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-14T11:10:42.970 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:10:42.970 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-14T11:10:43.117 INFO:tasks.workunit.client.0.smithi138.stderr:An error occurred (NoSuchKey) when calling the PutObject operation: None 2024-09-14T11:10:43.117 INFO:tasks.workunit.client.0.smithi138.stderr:radosgw-admin bi list --bucket check-bucket --object d 2024-09-14T11:10:43.152 INFO:tasks.workunit.client.0.smithi138.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:10:43.152 INFO:tasks.workunit.client.0.smithi138.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:10:43.198 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:43.198+0000 7f0c02f7e9c0 20 rados->read ofs=0 len=0 2024-09-14T11:10:43.200 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:43.202+0000 7f0c02f7e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:10:43.200 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:43.202+0000 7f0c02f7e9c0 20 realm 2024-09-14T11:10:43.200 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:43.202+0000 7f0c02f7e9c0 20 rados->read ofs=0 len=0 2024-09-14T11:10:43.200 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:43.202+0000 7f0c02f7e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:10:43.200 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:43.202+0000 7f0c02f7e9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:10:43.200 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:43.202+0000 7f0c02f7e9c0 20 rados->read ofs=0 len=0 2024-09-14T11:10:43.200 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:43.202+0000 7f0c02f7e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:10:43.200 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:43.202+0000 7f0c02f7e9c0 20 rados->read ofs=0 len=0 2024-09-14T11:10:43.202 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:43.202+0000 7f0c02f7e9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:10:43.202 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:43.202+0000 7f0c02f7e9c0 20 rados->read ofs=0 len=0 2024-09-14T11:10:43.202 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:43.202+0000 7f0c02f7e9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:10:43.202 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:43.202+0000 7f0c02f7e9c0 20 searching for the correct realm 2024-09-14T11:10:43.206 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:43.206+0000 7f0c01285640 0 -- 172.21.15.138:0/1395585567 >> [v2:172.21.15.154:6824/416768175,v1:172.21.15.154:6825/416768175] conn(0x7f0bf8047020 msgr2=0x7f0bf802b0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:10:43.421 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:43.422+0000 7f0c00283640 0 -- 172.21.15.138:0/1395585567 >> [v2:172.21.15.138:6816/326481658,v1:172.21.15.138:6817/326481658] conn(0x7f0bf8048550 msgr2=0x7f0bf808a6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:10:43.640 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:43.642+0000 7f0c02f7e9c0 20 RGWRados::pool_iterate: got zone_info.d9e72d30-c60b-4d0d-9267-fdc36392d5ad 2024-09-14T11:10:43.640 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:43.642+0000 7f0c02f7e9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:10:43.640 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:43.642+0000 7f0c02f7e9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:10:43.640 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:43.642+0000 7f0c02f7e9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:10:43.640 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:43.642+0000 7f0c02f7e9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:10:43.641 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:43.642+0000 7f0c02f7e9c0 20 RGWRados::pool_iterate: got zonegroup_info.65ab941b-da8c-4160-94fb-3672b069d44f 2024-09-14T11:10:43.641 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:43.642+0000 7f0c02f7e9c0 20 rados->read ofs=0 len=0 2024-09-14T11:10:43.641 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:43.642+0000 7f0c02f7e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:10:43.641 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:43.642+0000 7f0c02f7e9c0 20 rados->read ofs=0 len=0 2024-09-14T11:10:43.641 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:43.642+0000 7f0c02f7e9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:10:43.641 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:43.642+0000 7f0c02f7e9c0 20 rados->read ofs=0 len=0 2024-09-14T11:10:43.642 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:43.642+0000 7f0c02f7e9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:10:43.642 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:43.642+0000 7f0c02f7e9c0 20 zone default found 2024-09-14T11:10:43.642 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:43.642+0000 7f0c02f7e9c0 4 Realm: () 2024-09-14T11:10:43.643 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:43.642+0000 7f0c02f7e9c0 4 ZoneGroup: default (65ab941b-da8c-4160-94fb-3672b069d44f) 2024-09-14T11:10:43.643 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:43.642+0000 7f0c02f7e9c0 4 Zone: default (d9e72d30-c60b-4d0d-9267-fdc36392d5ad) 2024-09-14T11:10:43.643 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:43.642+0000 7f0c02f7e9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:10:43.643 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:43.642+0000 7f0c02f7e9c0 20 zonegroup default 2024-09-14T11:10:43.643 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:43.642+0000 7f0c02f7e9c0 20 rados->read ofs=0 len=0 2024-09-14T11:10:43.643 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:43.642+0000 7f0c02f7e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:10:43.643 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:43.642+0000 7f0c02f7e9c0 20 rados->read ofs=0 len=0 2024-09-14T11:10:43.644 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:43.646+0000 7f0c02f7e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:10:43.644 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:43.646+0000 7f0c02f7e9c0 20 rados->read ofs=0 len=0 2024-09-14T11:10:43.644 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:43.646+0000 7f0c02f7e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:10:43.644 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:43.646+0000 7f0c02f7e9c0 20 started sync module instance, tier type = 2024-09-14T11:10:43.644 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:43.646+0000 7f0c02f7e9c0 20 started zone id=d9e72d30-c60b-4d0d-9267-fdc36392d5ad (name=default) with tier type = 2024-09-14T11:10:43.671 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:43.670+0000 7f0c02f7e9c0 20 add_watcher() i=0 2024-09-14T11:10:43.672 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:43.670+0000 7f0c02f7e9c0 20 add_watcher() i=1 2024-09-14T11:10:43.672 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:43.670+0000 7f0c02f7e9c0 20 add_watcher() i=2 2024-09-14T11:10:43.672 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:43.670+0000 7f0c02f7e9c0 20 add_watcher() i=3 2024-09-14T11:10:43.672 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:43.670+0000 7f0c02f7e9c0 20 add_watcher() i=4 2024-09-14T11:10:43.672 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:43.670+0000 7f0c02f7e9c0 20 add_watcher() i=5 2024-09-14T11:10:43.672 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:43.670+0000 7f0c02f7e9c0 20 add_watcher() i=6 2024-09-14T11:10:43.674 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:43.674+0000 7f0c02f7e9c0 20 add_watcher() i=7 2024-09-14T11:10:43.674 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:43.674+0000 7f0c02f7e9c0 2 all 8 watchers are set, enabling cache 2024-09-14T11:10:43.678 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:43.678+0000 7f0ab6fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:10:43.679 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:43.678+0000 7f0c02f7e9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:10:43.679 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:43.678+0000 7f0c02f7e9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:10:43.679 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:43.678+0000 7f0c02f7e9c0 5 note: GC not initialized 2024-09-14T11:10:43.680 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:43.682+0000 7f0ab5fe3640 20 reqs_thread_entry: start 2024-09-14T11:10:43.680 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:43.682+0000 7f0c02f7e9c0 20 init_complete bucket index max shards: 11 2024-09-14T11:10:43.681 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:43.682+0000 7f0c02f7e9c0 20 Filter name: none 2024-09-14T11:10:43.681 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:43.682+0000 7f0a277fe640 20 reqs_thread_entry: start 2024-09-14T11:10:43.681 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:43.682+0000 7f0c02f7e9c0 20 rados->read ofs=0 len=0 2024-09-14T11:10:43.681 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:43.682+0000 7f0c02f7e9c0 20 rados_obj.operate() r=0 bl.length=190 2024-09-14T11:10:43.681 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:43.682+0000 7f0c02f7e9c0 20 rados->read ofs=0 len=0 2024-09-14T11:10:43.682 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:43.682+0000 7f0c02f7e9c0 20 rados_obj.operate() r=0 bl.length=412 2024-09-14T11:10:43.682 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:43.682+0000 7f0c02f7e9c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:10:43.682 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:43.682+0000 7f0c02f7e9c0 20 INFO: main: max_entries=1000, index=gen=0, max_shards=11 2024-09-14T11:10:43.682 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:43.682+0000 7f0c02f7e9c0 20 INFO: main: starting shard=0 2024-09-14T11:10:43.682 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:43.682+0000 7f0c02f7e9c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.1.0 2024-09-14T11:10:43.683 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:43.682+0000 7f0c02f7e9c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:10:43.683 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:43.682+0000 7f0c02f7e9c0 20 INFO: main: starting shard=1 2024-09-14T11:10:43.683 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:43.682+0000 7f0c02f7e9c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.1.1 2024-09-14T11:10:43.683 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:43.682+0000 7f0c02f7e9c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:10:43.683 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:43.682+0000 7f0c02f7e9c0 20 INFO: main: starting shard=2 2024-09-14T11:10:43.683 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:43.682+0000 7f0c02f7e9c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.1.2 2024-09-14T11:10:43.684 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:43.686+0000 7f0c02f7e9c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:10:43.684 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:43.686+0000 7f0c02f7e9c0 20 INFO: main: starting shard=3 2024-09-14T11:10:43.684 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:43.686+0000 7f0c02f7e9c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.1.3 2024-09-14T11:10:43.685 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:43.686+0000 7f0c02f7e9c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:10:43.685 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:43.686+0000 7f0c02f7e9c0 20 INFO: main: starting shard=4 2024-09-14T11:10:43.685 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:43.686+0000 7f0c02f7e9c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.1.4 2024-09-14T11:10:43.686 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:43.686+0000 7f0c02f7e9c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:10:43.686 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:43.686+0000 7f0c02f7e9c0 20 INFO: main: starting shard=5 2024-09-14T11:10:43.686 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:43.686+0000 7f0c02f7e9c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.1.5 2024-09-14T11:10:43.687 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:43.686+0000 7f0c02f7e9c0 20 INFO: main: bi_list() returned without error; entries.size()=5, is_truncated=0, marker= 2024-09-14T11:10:43.687 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:43.690+0000 7f0c02f7e9c0 20 INFO: main: starting shard=6 2024-09-14T11:10:43.687 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:43.690+0000 7f0c02f7e9c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.1.6 2024-09-14T11:10:43.689 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:43.690+0000 7f0c02f7e9c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:10:43.689 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:43.690+0000 7f0c02f7e9c0 20 INFO: main: starting shard=7 2024-09-14T11:10:43.689 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:43.690+0000 7f0c02f7e9c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.1.7 2024-09-14T11:10:43.690 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:43.690+0000 7f0c02f7e9c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:10:43.690 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:43.690+0000 7f0c02f7e9c0 20 INFO: main: starting shard=8 2024-09-14T11:10:43.690 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:43.690+0000 7f0c02f7e9c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.1.8 2024-09-14T11:10:43.691 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:43.690+0000 7f0c02f7e9c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:10:43.691 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:43.690+0000 7f0c02f7e9c0 20 INFO: main: starting shard=9 2024-09-14T11:10:43.691 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:43.690+0000 7f0c02f7e9c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.1.9 2024-09-14T11:10:43.693 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:43.694+0000 7f0c02f7e9c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:10:43.693 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:43.694+0000 7f0c02f7e9c0 20 INFO: main: starting shard=10 2024-09-14T11:10:43.693 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:43.694+0000 7f0c02f7e9c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.1.10 2024-09-14T11:10:43.693 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:43.694+0000 7f0c02f7e9c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:10:43.693 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:43.694+0000 7f0c02f7e9c0 20 INFO: main: done 2024-09-14T11:10:43.695 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:43.694+0000 7f0ab6fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:10:43.700 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:43.702+0000 7f0c02f7e9c0 20 remove_watcher() i=0 2024-09-14T11:10:43.700 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:43.702+0000 7f0c02f7e9c0 2 removed watcher, disabling cache 2024-09-14T11:10:43.703 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:43.702+0000 7f0c02f7e9c0 20 remove_watcher() i=1 2024-09-14T11:10:43.705 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:43.706+0000 7f0c02f7e9c0 20 remove_watcher() i=2 2024-09-14T11:10:43.706 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:43.706+0000 7f0c02f7e9c0 20 remove_watcher() i=3 2024-09-14T11:10:43.709 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:43.710+0000 7f0c02f7e9c0 20 remove_watcher() i=4 2024-09-14T11:10:43.711 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:43.710+0000 7f0c02f7e9c0 20 remove_watcher() i=5 2024-09-14T11:10:43.713 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:43.714+0000 7f0c02f7e9c0 20 remove_watcher() i=6 2024-09-14T11:10:43.714 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:43.714+0000 7f0c02f7e9c0 20 remove_watcher() i=7 2024-09-14T11:10:43.733 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:10:43.733 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-14T11:10:43.767 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:10:43.767 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-14T11:10:43.877 INFO:tasks.workunit.client.0.smithi138.stderr:An error occurred (NoSuchKey) when calling the PutObject operation: None 2024-09-14T11:10:43.877 INFO:tasks.workunit.client.0.smithi138.stderr:radosgw-admin bi list --bucket check-bucket --object e 2024-09-14T11:10:43.911 INFO:tasks.workunit.client.0.smithi138.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:10:43.911 INFO:tasks.workunit.client.0.smithi138.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:10:43.958 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:43.958+0000 7f2d692c29c0 20 rados->read ofs=0 len=0 2024-09-14T11:10:43.959 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:43.962+0000 7f2d692c29c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:10:43.959 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:43.962+0000 7f2d692c29c0 20 realm 2024-09-14T11:10:43.960 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:43.962+0000 7f2d692c29c0 20 rados->read ofs=0 len=0 2024-09-14T11:10:43.960 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:43.962+0000 7f2d692c29c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:10:43.960 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:43.962+0000 7f2d692c29c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:10:43.960 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:43.962+0000 7f2d692c29c0 20 rados->read ofs=0 len=0 2024-09-14T11:10:43.960 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:43.962+0000 7f2d692c29c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:10:43.960 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:43.962+0000 7f2d692c29c0 20 rados->read ofs=0 len=0 2024-09-14T11:10:43.964 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:43.962+0000 7f2d692c29c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:10:43.964 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:43.962+0000 7f2d692c29c0 20 rados->read ofs=0 len=0 2024-09-14T11:10:43.964 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:43.962+0000 7f2d692c29c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:10:43.965 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:43.962+0000 7f2d692c29c0 20 searching for the correct realm 2024-09-14T11:10:43.965 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:43.966+0000 7f2d665c7640 0 -- 172.21.15.138:0/2885723849 >> [v2:172.21.15.154:6808/1468088432,v1:172.21.15.154:6809/1468088432] conn(0x7f2d6007a040 msgr2=0x7f2d6005f120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:10:44.180 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:44.178+0000 7f2d665c7640 0 -- 172.21.15.138:0/2885723849 >> [v2:172.21.15.154:6808/1468088432,v1:172.21.15.154:6809/1468088432] conn(0x7f2d6007a040 msgr2=0x7f2d6005f120 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-14T11:10:44.197 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:44.198+0000 7f2d692c29c0 20 RGWRados::pool_iterate: got zone_info.d9e72d30-c60b-4d0d-9267-fdc36392d5ad 2024-09-14T11:10:44.197 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:44.198+0000 7f2d692c29c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:10:44.197 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:44.198+0000 7f2d692c29c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:10:44.197 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:44.198+0000 7f2d692c29c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:10:44.197 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:44.198+0000 7f2d692c29c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:10:44.197 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:44.198+0000 7f2d692c29c0 20 RGWRados::pool_iterate: got zonegroup_info.65ab941b-da8c-4160-94fb-3672b069d44f 2024-09-14T11:10:44.197 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:44.198+0000 7f2d692c29c0 20 rados->read ofs=0 len=0 2024-09-14T11:10:44.198 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:44.198+0000 7f2d692c29c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:10:44.198 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:44.198+0000 7f2d692c29c0 20 rados->read ofs=0 len=0 2024-09-14T11:10:44.198 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:44.198+0000 7f2d692c29c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:10:44.198 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:44.198+0000 7f2d692c29c0 20 rados->read ofs=0 len=0 2024-09-14T11:10:44.199 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:44.198+0000 7f2d692c29c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:10:44.199 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:44.198+0000 7f2d692c29c0 20 zone default found 2024-09-14T11:10:44.199 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:44.198+0000 7f2d692c29c0 4 Realm: () 2024-09-14T11:10:44.199 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:44.198+0000 7f2d692c29c0 4 ZoneGroup: default (65ab941b-da8c-4160-94fb-3672b069d44f) 2024-09-14T11:10:44.199 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:44.198+0000 7f2d692c29c0 4 Zone: default (d9e72d30-c60b-4d0d-9267-fdc36392d5ad) 2024-09-14T11:10:44.199 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:44.198+0000 7f2d692c29c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:10:44.199 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:44.198+0000 7f2d692c29c0 20 zonegroup default 2024-09-14T11:10:44.199 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:44.198+0000 7f2d692c29c0 20 rados->read ofs=0 len=0 2024-09-14T11:10:44.200 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:44.198+0000 7f2d692c29c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:10:44.200 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:44.198+0000 7f2d692c29c0 20 rados->read ofs=0 len=0 2024-09-14T11:10:44.200 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:44.202+0000 7f2d692c29c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:10:44.200 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:44.202+0000 7f2d692c29c0 20 rados->read ofs=0 len=0 2024-09-14T11:10:44.201 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:44.202+0000 7f2d692c29c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:10:44.201 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:44.202+0000 7f2d692c29c0 20 started sync module instance, tier type = 2024-09-14T11:10:44.201 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:44.202+0000 7f2d692c29c0 20 started zone id=d9e72d30-c60b-4d0d-9267-fdc36392d5ad (name=default) with tier type = 2024-09-14T11:10:44.223 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:44.226+0000 7f2d692c29c0 20 add_watcher() i=0 2024-09-14T11:10:44.224 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:44.226+0000 7f2d692c29c0 20 add_watcher() i=1 2024-09-14T11:10:44.224 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:44.226+0000 7f2d692c29c0 20 add_watcher() i=2 2024-09-14T11:10:44.224 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:44.226+0000 7f2d692c29c0 20 add_watcher() i=3 2024-09-14T11:10:44.224 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:44.226+0000 7f2d692c29c0 20 add_watcher() i=4 2024-09-14T11:10:44.224 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:44.226+0000 7f2d692c29c0 20 add_watcher() i=5 2024-09-14T11:10:44.224 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:44.226+0000 7f2d692c29c0 20 add_watcher() i=6 2024-09-14T11:10:44.226 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:44.226+0000 7f2d692c29c0 20 add_watcher() i=7 2024-09-14T11:10:44.226 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:44.226+0000 7f2d692c29c0 2 all 8 watchers are set, enabling cache 2024-09-14T11:10:44.231 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:44.230+0000 7f2c1d7e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:10:44.231 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:44.230+0000 7f2d692c29c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:10:44.231 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:44.230+0000 7f2d692c29c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:10:44.231 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:44.230+0000 7f2d692c29c0 5 note: GC not initialized 2024-09-14T11:10:44.231 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:44.230+0000 7f2b97fff640 20 reqs_thread_entry: start 2024-09-14T11:10:44.231 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:44.230+0000 7f2d692c29c0 20 init_complete bucket index max shards: 11 2024-09-14T11:10:44.232 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:44.230+0000 7f2d692c29c0 20 Filter name: none 2024-09-14T11:10:44.232 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:44.230+0000 7f2b95ffb640 20 reqs_thread_entry: start 2024-09-14T11:10:44.232 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:44.230+0000 7f2d692c29c0 20 rados->read ofs=0 len=0 2024-09-14T11:10:44.233 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:44.234+0000 7f2d692c29c0 20 rados_obj.operate() r=0 bl.length=190 2024-09-14T11:10:44.233 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:44.234+0000 7f2d692c29c0 20 rados->read ofs=0 len=0 2024-09-14T11:10:44.234 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:44.234+0000 7f2d692c29c0 20 rados_obj.operate() r=0 bl.length=412 2024-09-14T11:10:44.234 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:44.234+0000 7f2d692c29c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:10:44.234 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:44.234+0000 7f2d692c29c0 20 INFO: main: max_entries=1000, index=gen=0, max_shards=11 2024-09-14T11:10:44.234 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:44.234+0000 7f2d692c29c0 20 INFO: main: starting shard=0 2024-09-14T11:10:44.234 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:44.234+0000 7f2d692c29c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.1.0 2024-09-14T11:10:44.234 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:44.234+0000 7f2d692c29c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:10:44.234 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:44.234+0000 7f2d692c29c0 20 INFO: main: starting shard=1 2024-09-14T11:10:44.234 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:44.234+0000 7f2d692c29c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.1.1 2024-09-14T11:10:44.234 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:44.234+0000 7f2d692c29c0 20 INFO: main: bi_list() returned without error; entries.size()=1, is_truncated=0, marker= 2024-09-14T11:10:44.234 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:44.234+0000 7f2d692c29c0 20 INFO: main: starting shard=2 2024-09-14T11:10:44.234 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:44.234+0000 7f2d692c29c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.1.2 2024-09-14T11:10:44.235 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:44.234+0000 7f2d692c29c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:10:44.235 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:44.234+0000 7f2d692c29c0 20 INFO: main: starting shard=3 2024-09-14T11:10:44.235 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:44.234+0000 7f2d692c29c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.1.3 2024-09-14T11:10:44.235 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:44.234+0000 7f2d692c29c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:10:44.235 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:44.234+0000 7f2d692c29c0 20 INFO: main: starting shard=4 2024-09-14T11:10:44.235 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:44.234+0000 7f2d692c29c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.1.4 2024-09-14T11:10:44.236 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:44.238+0000 7f2d692c29c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:10:44.236 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:44.238+0000 7f2d692c29c0 20 INFO: main: starting shard=5 2024-09-14T11:10:44.236 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:44.238+0000 7f2d692c29c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.1.5 2024-09-14T11:10:44.237 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:44.238+0000 7f2d692c29c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:10:44.237 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:44.238+0000 7f2d692c29c0 20 INFO: main: starting shard=6 2024-09-14T11:10:44.237 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:44.238+0000 7f2d692c29c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.1.6 2024-09-14T11:10:44.237 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:44.238+0000 7f2d692c29c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:10:44.237 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:44.238+0000 7f2d692c29c0 20 INFO: main: starting shard=7 2024-09-14T11:10:44.237 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:44.238+0000 7f2d692c29c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.1.7 2024-09-14T11:10:44.238 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:44.238+0000 7f2d692c29c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:10:44.239 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:44.238+0000 7f2d692c29c0 20 INFO: main: starting shard=8 2024-09-14T11:10:44.239 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:44.238+0000 7f2d692c29c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.1.8 2024-09-14T11:10:44.240 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:44.242+0000 7f2d692c29c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:10:44.240 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:44.242+0000 7f2d692c29c0 20 INFO: main: starting shard=9 2024-09-14T11:10:44.240 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:44.242+0000 7f2d692c29c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.1.9 2024-09-14T11:10:44.241 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:44.242+0000 7f2d692c29c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:10:44.241 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:44.242+0000 7f2d692c29c0 20 INFO: main: starting shard=10 2024-09-14T11:10:44.241 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:44.242+0000 7f2d692c29c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.1.10 2024-09-14T11:10:44.241 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:44.242+0000 7f2d692c29c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:10:44.242 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:44.242+0000 7f2d692c29c0 20 INFO: main: done 2024-09-14T11:10:44.242 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:44.242+0000 7f2c1d7e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:10:44.248 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:44.250+0000 7f2d692c29c0 20 remove_watcher() i=0 2024-09-14T11:10:44.248 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:44.250+0000 7f2d692c29c0 2 removed watcher, disabling cache 2024-09-14T11:10:44.250 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:44.250+0000 7f2d692c29c0 20 remove_watcher() i=1 2024-09-14T11:10:44.252 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:44.254+0000 7f2d692c29c0 20 remove_watcher() i=2 2024-09-14T11:10:44.254 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:44.254+0000 7f2d692c29c0 20 remove_watcher() i=3 2024-09-14T11:10:44.257 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:44.258+0000 7f2d692c29c0 20 remove_watcher() i=4 2024-09-14T11:10:44.258 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:44.258+0000 7f2d692c29c0 20 remove_watcher() i=5 2024-09-14T11:10:44.261 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:44.262+0000 7f2d692c29c0 20 remove_watcher() i=6 2024-09-14T11:10:44.262 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:44.262+0000 7f2d692c29c0 20 remove_watcher() i=7 2024-09-14T11:10:44.278 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:10:44.278 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-14T11:10:44.307 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:10:44.307 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-14T11:10:44.453 INFO:tasks.workunit.client.0.smithi138.stderr:An error occurred (NoSuchKey) when calling the PutObject operation: None 2024-09-14T11:10:44.453 INFO:tasks.workunit.client.0.smithi138.stderr:radosgw-admin bi list --bucket check-bucket --object f 2024-09-14T11:10:44.488 INFO:tasks.workunit.client.0.smithi138.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:10:44.489 INFO:tasks.workunit.client.0.smithi138.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:10:44.534 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:44.534+0000 7f7270b229c0 20 rados->read ofs=0 len=0 2024-09-14T11:10:44.537 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:44.538+0000 7f7270b229c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:10:44.537 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:44.538+0000 7f7270b229c0 20 realm 2024-09-14T11:10:44.537 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:44.538+0000 7f7270b229c0 20 rados->read ofs=0 len=0 2024-09-14T11:10:44.537 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:44.538+0000 7f7270b229c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:10:44.537 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:44.538+0000 7f7270b229c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:10:44.537 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:44.538+0000 7f7270b229c0 20 rados->read ofs=0 len=0 2024-09-14T11:10:44.537 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:44.538+0000 7f7270b229c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:10:44.537 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:44.538+0000 7f7270b229c0 20 rados->read ofs=0 len=0 2024-09-14T11:10:44.538 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:44.538+0000 7f7270b229c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:10:44.538 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:44.538+0000 7f7270b229c0 20 rados->read ofs=0 len=0 2024-09-14T11:10:44.539 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:44.538+0000 7f7270b229c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:10:44.539 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:44.538+0000 7f7270b229c0 20 searching for the correct realm 2024-09-14T11:10:44.543 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:44.542+0000 7f726ee29640 0 -- 172.21.15.138:0/1361120156 >> [v2:172.21.15.154:6824/416768175,v1:172.21.15.154:6825/416768175] conn(0x7f72680cf070 msgr2=0x7f72680efa70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-14T11:10:44.756 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:44.758+0000 7f726de27640 0 -- 172.21.15.138:0/1361120156 >> [v2:172.21.15.138:6816/326481658,v1:172.21.15.138:6817/326481658] conn(0x7f72680d0400 msgr2=0x7f72680d0860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:10:44.974 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:44.974+0000 7f7270b229c0 20 RGWRados::pool_iterate: got zone_info.d9e72d30-c60b-4d0d-9267-fdc36392d5ad 2024-09-14T11:10:44.975 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:44.974+0000 7f7270b229c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:10:44.975 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:44.974+0000 7f7270b229c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:10:44.975 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:44.974+0000 7f7270b229c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:10:44.975 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:44.974+0000 7f7270b229c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:10:44.975 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:44.974+0000 7f7270b229c0 20 RGWRados::pool_iterate: got zonegroup_info.65ab941b-da8c-4160-94fb-3672b069d44f 2024-09-14T11:10:44.975 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:44.974+0000 7f7270b229c0 20 rados->read ofs=0 len=0 2024-09-14T11:10:44.975 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:44.974+0000 7f7270b229c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:10:44.976 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:44.974+0000 7f7270b229c0 20 rados->read ofs=0 len=0 2024-09-14T11:10:44.976 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:44.978+0000 7f7270b229c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:10:44.976 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:44.978+0000 7f7270b229c0 20 rados->read ofs=0 len=0 2024-09-14T11:10:44.977 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:44.978+0000 7f7270b229c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:10:44.977 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:44.978+0000 7f7270b229c0 20 zone default found 2024-09-14T11:10:44.977 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:44.978+0000 7f7270b229c0 4 Realm: () 2024-09-14T11:10:44.977 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:44.978+0000 7f7270b229c0 4 ZoneGroup: default (65ab941b-da8c-4160-94fb-3672b069d44f) 2024-09-14T11:10:44.977 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:44.978+0000 7f7270b229c0 4 Zone: default (d9e72d30-c60b-4d0d-9267-fdc36392d5ad) 2024-09-14T11:10:44.977 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:44.978+0000 7f7270b229c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:10:44.977 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:44.978+0000 7f7270b229c0 20 zonegroup default 2024-09-14T11:10:44.977 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:44.978+0000 7f7270b229c0 20 rados->read ofs=0 len=0 2024-09-14T11:10:44.978 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:44.978+0000 7f7270b229c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:10:44.978 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:44.978+0000 7f7270b229c0 20 rados->read ofs=0 len=0 2024-09-14T11:10:44.978 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:44.978+0000 7f7270b229c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:10:44.979 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:44.978+0000 7f7270b229c0 20 rados->read ofs=0 len=0 2024-09-14T11:10:44.979 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:44.978+0000 7f7270b229c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:10:44.979 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:44.978+0000 7f7270b229c0 20 started sync module instance, tier type = 2024-09-14T11:10:44.979 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:44.978+0000 7f7270b229c0 20 started zone id=d9e72d30-c60b-4d0d-9267-fdc36392d5ad (name=default) with tier type = 2024-09-14T11:10:45.004 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:45.006+0000 7f7270b229c0 20 add_watcher() i=0 2024-09-14T11:10:45.004 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:45.006+0000 7f7270b229c0 20 add_watcher() i=1 2024-09-14T11:10:45.005 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:45.006+0000 7f7270b229c0 20 add_watcher() i=2 2024-09-14T11:10:45.005 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:45.006+0000 7f7270b229c0 20 add_watcher() i=3 2024-09-14T11:10:45.005 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:45.006+0000 7f7270b229c0 20 add_watcher() i=4 2024-09-14T11:10:45.005 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:45.006+0000 7f7270b229c0 20 add_watcher() i=5 2024-09-14T11:10:45.005 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:45.006+0000 7f7270b229c0 20 add_watcher() i=6 2024-09-14T11:10:45.007 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:45.006+0000 7f7270b229c0 20 add_watcher() i=7 2024-09-14T11:10:45.007 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:45.006+0000 7f7270b229c0 2 all 8 watchers are set, enabling cache 2024-09-14T11:10:45.011 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:45.010+0000 7f7124fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:10:45.012 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:45.014+0000 7f7270b229c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:10:45.012 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:45.014+0000 7f7270b229c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:10:45.012 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:45.014+0000 7f7270b229c0 5 note: GC not initialized 2024-09-14T11:10:45.013 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:45.014+0000 7f709f7fe640 20 reqs_thread_entry: start 2024-09-14T11:10:45.013 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:45.014+0000 7f7270b229c0 20 init_complete bucket index max shards: 11 2024-09-14T11:10:45.013 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:45.014+0000 7f7270b229c0 20 Filter name: none 2024-09-14T11:10:45.014 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:45.014+0000 7f709d7fa640 20 reqs_thread_entry: start 2024-09-14T11:10:45.014 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:45.014+0000 7f7270b229c0 20 rados->read ofs=0 len=0 2024-09-14T11:10:45.014 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:45.014+0000 7f7270b229c0 20 rados_obj.operate() r=0 bl.length=190 2024-09-14T11:10:45.014 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:45.014+0000 7f7270b229c0 20 rados->read ofs=0 len=0 2024-09-14T11:10:45.015 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:45.014+0000 7f7270b229c0 20 rados_obj.operate() r=0 bl.length=412 2024-09-14T11:10:45.015 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:45.014+0000 7f7270b229c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:10:45.015 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:45.014+0000 7f7270b229c0 20 INFO: main: max_entries=1000, index=gen=0, max_shards=11 2024-09-14T11:10:45.016 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:45.014+0000 7f7270b229c0 20 INFO: main: starting shard=0 2024-09-14T11:10:45.016 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:45.014+0000 7f7270b229c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.1.0 2024-09-14T11:10:45.016 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:45.018+0000 7f7270b229c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:10:45.016 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:45.018+0000 7f7270b229c0 20 INFO: main: starting shard=1 2024-09-14T11:10:45.016 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:45.018+0000 7f7270b229c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.1.1 2024-09-14T11:10:45.017 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:45.018+0000 7f7270b229c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:10:45.017 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:45.018+0000 7f7270b229c0 20 INFO: main: starting shard=2 2024-09-14T11:10:45.017 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:45.018+0000 7f7270b229c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.1.2 2024-09-14T11:10:45.018 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:45.018+0000 7f7270b229c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:10:45.018 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:45.018+0000 7f7270b229c0 20 INFO: main: starting shard=3 2024-09-14T11:10:45.018 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:45.018+0000 7f7270b229c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.1.3 2024-09-14T11:10:45.018 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:45.018+0000 7f7270b229c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:10:45.018 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:45.018+0000 7f7270b229c0 20 INFO: main: starting shard=4 2024-09-14T11:10:45.019 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:45.018+0000 7f7270b229c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.1.4 2024-09-14T11:10:45.019 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:45.022+0000 7f7270b229c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:10:45.020 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:45.022+0000 7f7270b229c0 20 INFO: main: starting shard=5 2024-09-14T11:10:45.020 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:45.022+0000 7f7270b229c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.1.5 2024-09-14T11:10:45.020 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:45.022+0000 7f7270b229c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:10:45.020 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:45.022+0000 7f7270b229c0 20 INFO: main: starting shard=6 2024-09-14T11:10:45.021 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:45.022+0000 7f7270b229c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.1.6 2024-09-14T11:10:45.021 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:45.022+0000 7f7270b229c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:10:45.021 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:45.022+0000 7f7270b229c0 20 INFO: main: starting shard=7 2024-09-14T11:10:45.021 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:45.022+0000 7f7270b229c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.1.7 2024-09-14T11:10:45.022 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:45.022+0000 7f7270b229c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:10:45.022 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:45.022+0000 7f7270b229c0 20 INFO: main: starting shard=8 2024-09-14T11:10:45.022 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:45.022+0000 7f7270b229c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.1.8 2024-09-14T11:10:45.023 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:45.022+0000 7f7270b229c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:10:45.024 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:45.022+0000 7f7270b229c0 20 INFO: main: starting shard=9 2024-09-14T11:10:45.024 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:45.022+0000 7f7270b229c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.1.9 2024-09-14T11:10:45.025 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:45.026+0000 7f7270b229c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:10:45.025 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:45.026+0000 7f7270b229c0 20 INFO: main: starting shard=10 2024-09-14T11:10:45.025 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:45.026+0000 7f7270b229c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.1.10 2024-09-14T11:10:45.025 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:45.026+0000 7f7270b229c0 20 INFO: main: bi_list() returned without error; entries.size()=1, is_truncated=0, marker= 2024-09-14T11:10:45.025 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:45.026+0000 7f7270b229c0 20 INFO: main: done 2024-09-14T11:10:45.026 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:45.026+0000 7f7124fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:10:45.031 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:45.030+0000 7f7270b229c0 20 remove_watcher() i=0 2024-09-14T11:10:45.031 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:45.030+0000 7f7270b229c0 2 removed watcher, disabling cache 2024-09-14T11:10:45.034 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:45.034+0000 7f7270b229c0 20 remove_watcher() i=1 2024-09-14T11:10:45.036 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:45.038+0000 7f7270b229c0 20 remove_watcher() i=2 2024-09-14T11:10:45.038 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:45.038+0000 7f7270b229c0 20 remove_watcher() i=3 2024-09-14T11:10:45.040 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:45.042+0000 7f7270b229c0 20 remove_watcher() i=4 2024-09-14T11:10:45.042 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:45.042+0000 7f7270b229c0 20 remove_watcher() i=5 2024-09-14T11:10:45.044 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:45.046+0000 7f7270b229c0 20 remove_watcher() i=6 2024-09-14T11:10:45.046 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:45.046+0000 7f7270b229c0 20 remove_watcher() i=7 2024-09-14T11:10:45.063 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:10:45.063 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-14T11:10:45.095 INFO:tasks.workunit.client.0.smithi138.stderr:ceph config rm client rgw_debug_inject_set_olh_err 2024-09-14T11:10:45.528 INFO:tasks.workunit.client.0.smithi138.stderr:ceph config rm client rgw_debug_inject_olh_cancel_modification_err 2024-09-14T11:10:45.967 INFO:tasks.workunit.client.0.smithi138.stderr:radosgw-admin bucket check --fix --bucket check-bucket 2024-09-14T11:10:45.997 INFO:tasks.workunit.client.0.smithi138.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:10:45.997 INFO:tasks.workunit.client.0.smithi138.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:10:46.040 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:46.042+0000 7ff7017cf9c0 20 rados->read ofs=0 len=0 2024-09-14T11:10:46.041 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:46.042+0000 7ff7017cf9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:10:46.041 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:46.042+0000 7ff7017cf9c0 20 realm 2024-09-14T11:10:46.041 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:46.042+0000 7ff7017cf9c0 20 rados->read ofs=0 len=0 2024-09-14T11:10:46.041 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:46.042+0000 7ff7017cf9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:10:46.041 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:46.042+0000 7ff7017cf9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:10:46.041 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:46.042+0000 7ff7017cf9c0 20 rados->read ofs=0 len=0 2024-09-14T11:10:46.041 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:46.042+0000 7ff7017cf9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:10:46.042 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:46.042+0000 7ff7017cf9c0 20 rados->read ofs=0 len=0 2024-09-14T11:10:46.043 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:46.042+0000 7ff7017cf9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:10:46.043 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:46.042+0000 7ff7017cf9c0 20 rados->read ofs=0 len=0 2024-09-14T11:10:46.044 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:46.046+0000 7ff7017cf9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:10:46.044 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:46.046+0000 7ff7017cf9c0 20 searching for the correct realm 2024-09-14T11:10:46.047 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:46.050+0000 7ff6ffad6640 0 -- 172.21.15.138:0/1233188803 >> [v2:172.21.15.154:6824/416768175,v1:172.21.15.154:6825/416768175] conn(0x7ff6f80e5040 msgr2=0x7ff6f80e6940 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:10:46.054 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:46.054+0000 7ff6fead4640 0 -- 172.21.15.138:0/1233188803 >> [v2:172.21.15.138:6816/326481658,v1:172.21.15.138:6817/326481658] conn(0x7ff6f80d7920 msgr2=0x7ff6f80d6400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:10:46.270 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:46.270+0000 7ff7017cf9c0 20 RGWRados::pool_iterate: got zone_info.d9e72d30-c60b-4d0d-9267-fdc36392d5ad 2024-09-14T11:10:46.270 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:46.270+0000 7ff7017cf9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:10:46.270 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:46.270+0000 7ff7017cf9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:10:46.270 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:46.270+0000 7ff7017cf9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:10:46.270 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:46.270+0000 7ff7017cf9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:10:46.271 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:46.270+0000 7ff7017cf9c0 20 RGWRados::pool_iterate: got zonegroup_info.65ab941b-da8c-4160-94fb-3672b069d44f 2024-09-14T11:10:46.271 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:46.270+0000 7ff7017cf9c0 20 rados->read ofs=0 len=0 2024-09-14T11:10:46.271 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:46.270+0000 7ff7017cf9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:10:46.271 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:46.270+0000 7ff7017cf9c0 20 rados->read ofs=0 len=0 2024-09-14T11:10:46.271 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:46.270+0000 7ff7017cf9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:10:46.272 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:46.270+0000 7ff7017cf9c0 20 rados->read ofs=0 len=0 2024-09-14T11:10:46.272 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:46.274+0000 7ff7017cf9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:10:46.272 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:46.274+0000 7ff7017cf9c0 20 zone default found 2024-09-14T11:10:46.272 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:46.274+0000 7ff7017cf9c0 4 Realm: () 2024-09-14T11:10:46.272 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:46.274+0000 7ff7017cf9c0 4 ZoneGroup: default (65ab941b-da8c-4160-94fb-3672b069d44f) 2024-09-14T11:10:46.272 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:46.274+0000 7ff7017cf9c0 4 Zone: default (d9e72d30-c60b-4d0d-9267-fdc36392d5ad) 2024-09-14T11:10:46.272 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:46.274+0000 7ff7017cf9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:10:46.272 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:46.274+0000 7ff7017cf9c0 20 zonegroup default 2024-09-14T11:10:46.273 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:46.274+0000 7ff7017cf9c0 20 rados->read ofs=0 len=0 2024-09-14T11:10:46.273 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:46.274+0000 7ff7017cf9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:10:46.273 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:46.274+0000 7ff7017cf9c0 20 rados->read ofs=0 len=0 2024-09-14T11:10:46.274 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:46.274+0000 7ff7017cf9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:10:46.274 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:46.274+0000 7ff7017cf9c0 20 rados->read ofs=0 len=0 2024-09-14T11:10:46.274 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:46.274+0000 7ff7017cf9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:10:46.274 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:46.274+0000 7ff7017cf9c0 20 started sync module instance, tier type = 2024-09-14T11:10:46.274 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:46.274+0000 7ff7017cf9c0 20 started zone id=d9e72d30-c60b-4d0d-9267-fdc36392d5ad (name=default) with tier type = 2024-09-14T11:10:46.301 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:46.302+0000 7ff7017cf9c0 20 add_watcher() i=0 2024-09-14T11:10:46.301 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:46.302+0000 7ff7017cf9c0 20 add_watcher() i=1 2024-09-14T11:10:46.302 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:46.302+0000 7ff7017cf9c0 20 add_watcher() i=2 2024-09-14T11:10:46.302 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:46.302+0000 7ff7017cf9c0 20 add_watcher() i=3 2024-09-14T11:10:46.302 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:46.302+0000 7ff7017cf9c0 20 add_watcher() i=4 2024-09-14T11:10:46.302 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:46.302+0000 7ff7017cf9c0 20 add_watcher() i=5 2024-09-14T11:10:46.302 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:46.302+0000 7ff7017cf9c0 20 add_watcher() i=6 2024-09-14T11:10:46.303 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:46.306+0000 7ff7017cf9c0 20 add_watcher() i=7 2024-09-14T11:10:46.304 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:46.306+0000 7ff7017cf9c0 2 all 8 watchers are set, enabling cache 2024-09-14T11:10:46.307 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:46.310+0000 7ff5b67e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:10:46.308 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:46.310+0000 7ff7017cf9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:10:46.309 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:46.310+0000 7ff7017cf9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:10:46.309 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:46.310+0000 7ff7017cf9c0 5 note: GC not initialized 2024-09-14T11:10:46.310 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:46.310+0000 7ff5b57e2640 20 reqs_thread_entry: start 2024-09-14T11:10:46.310 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:46.310+0000 7ff7017cf9c0 20 init_complete bucket index max shards: 11 2024-09-14T11:10:46.310 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:46.310+0000 7ff7017cf9c0 20 Filter name: none 2024-09-14T11:10:46.310 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:46.310+0000 7ff5ae7fc640 20 reqs_thread_entry: start 2024-09-14T11:10:46.310 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:46.310+0000 7ff7017cf9c0 10 cache get: name=default.rgw.meta+root+check-bucket : miss 2024-09-14T11:10:46.310 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:46.310+0000 7ff7017cf9c0 20 rados->read ofs=0 len=0 2024-09-14T11:10:46.311 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:46.310+0000 7ff7017cf9c0 20 rados_obj.operate() r=0 bl.length=190 2024-09-14T11:10:46.311 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:46.310+0000 7ff7017cf9c0 10 cache put: name=default.rgw.meta+root+check-bucket info.flags=0x11 2024-09-14T11:10:46.311 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:46.310+0000 7ff7017cf9c0 10 adding default.rgw.meta+root+check-bucket to cache LRU end 2024-09-14T11:10:46.311 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:46.310+0000 7ff7017cf9c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.check-bucket:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.1 : miss 2024-09-14T11:10:46.311 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:46.310+0000 7ff7017cf9c0 20 rados->read ofs=0 len=0 2024-09-14T11:10:46.312 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:46.310+0000 7ff7017cf9c0 20 rados_obj.operate() r=0 bl.length=412 2024-09-14T11:10:46.312 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:46.310+0000 7ff7017cf9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.check-bucket:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.1 info.flags=0x17 2024-09-14T11:10:46.312 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:46.310+0000 7ff7017cf9c0 10 adding default.rgw.meta+root+.bucket.meta.check-bucket:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.1 to cache LRU end 2024-09-14T11:10:46.312 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:46.310+0000 7ff7017cf9c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:10:46.312 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:46.310+0000 7ff7017cf9c0 10 updating xattr: name=user.rgw.acl bl.length()=179 2024-09-14T11:10:46.312 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:46.310+0000 7ff7017cf9c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.check-bucket:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.1 2024-09-14T11:10:46.312 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:46.310+0000 7ff7017cf9c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.1.0 2024-09-14T11:10:46.313 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:46.314+0000 7ff7017cf9c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.1.1 2024-09-14T11:10:46.313 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:46.314+0000 7ff7017cf9c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.1.2 2024-09-14T11:10:46.314 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:46.314+0000 7ff7017cf9c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.1.3 2024-09-14T11:10:46.315 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:46.314+0000 7ff7017cf9c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.1.4 2024-09-14T11:10:46.317 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:46.318+0000 7ff7017cf9c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.1.5 2024-09-14T11:10:46.318 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:46.318+0000 7ff7017cf9c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.1.6 2024-09-14T11:10:46.319 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:46.318+0000 7ff7017cf9c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.1.7 2024-09-14T11:10:46.320 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:46.322+0000 7ff7017cf9c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.1.8 2024-09-14T11:10:46.322 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:46.322+0000 7ff7017cf9c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.1.9 2024-09-14T11:10:46.323 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:46.322+0000 7ff7017cf9c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.1.10 2024-09-14T11:10:46.334 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:46.334+0000 7ff5b67e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:10:46.339 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:46.338+0000 7ff7017cf9c0 20 remove_watcher() i=0 2024-09-14T11:10:46.339 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:46.338+0000 7ff7017cf9c0 2 removed watcher, disabling cache 2024-09-14T11:10:46.341 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:46.342+0000 7ff7017cf9c0 20 remove_watcher() i=1 2024-09-14T11:10:46.343 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:46.342+0000 7ff7017cf9c0 20 remove_watcher() i=2 2024-09-14T11:10:46.345 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:46.346+0000 7ff7017cf9c0 20 remove_watcher() i=3 2024-09-14T11:10:46.347 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:46.346+0000 7ff7017cf9c0 20 remove_watcher() i=4 2024-09-14T11:10:46.349 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:46.350+0000 7ff7017cf9c0 20 remove_watcher() i=5 2024-09-14T11:10:46.350 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:46.350+0000 7ff7017cf9c0 20 remove_watcher() i=6 2024-09-14T11:10:46.352 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:46.354+0000 7ff7017cf9c0 20 remove_watcher() i=7 2024-09-14T11:10:46.370 INFO:tasks.workunit.client.0.smithi138.stderr:radosgw-admin bucket check unlinked --bucket check-bucket --fix --min-age-hours 0 --rgw-olh-pending-timeout-sec 0 --dump-keys 2024-09-14T11:10:46.407 INFO:tasks.workunit.client.0.smithi138.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:10:46.407 INFO:tasks.workunit.client.0.smithi138.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:10:46.451 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:46.450+0000 7fb1d32ab9c0 20 rados->read ofs=0 len=0 2024-09-14T11:10:46.453 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:46.454+0000 7fb1d32ab9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:10:46.453 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:46.454+0000 7fb1d32ab9c0 20 realm 2024-09-14T11:10:46.453 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:46.454+0000 7fb1d32ab9c0 20 rados->read ofs=0 len=0 2024-09-14T11:10:46.454 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:46.454+0000 7fb1d32ab9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:10:46.454 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:46.454+0000 7fb1d32ab9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:10:46.454 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:46.454+0000 7fb1d32ab9c0 20 rados->read ofs=0 len=0 2024-09-14T11:10:46.454 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:46.454+0000 7fb1d32ab9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:10:46.454 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:46.454+0000 7fb1d32ab9c0 20 rados->read ofs=0 len=0 2024-09-14T11:10:46.455 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:46.454+0000 7fb1d32ab9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:10:46.455 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:46.454+0000 7fb1d32ab9c0 20 rados->read ofs=0 len=0 2024-09-14T11:10:46.456 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:46.458+0000 7fb1d32ab9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:10:46.456 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:46.458+0000 7fb1d32ab9c0 20 searching for the correct realm 2024-09-14T11:10:46.460 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:46.462+0000 7fb1d05b0640 0 -- 172.21.15.138:0/3361850004 >> [v2:172.21.15.154:6808/1468088432,v1:172.21.15.154:6809/1468088432] conn(0x7fb1c005e050 msgr2=0x7fb1c005cac0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:10:46.466 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:46.466+0000 7fb1d05b0640 0 -- 172.21.15.138:0/3361850004 >> [v2:172.21.15.138:6816/326481658,v1:172.21.15.138:6817/326481658] conn(0x7fb1c80b7950 msgr2=0x7fb1c8009250 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-14T11:10:46.682 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:46.682+0000 7fb1d32ab9c0 20 RGWRados::pool_iterate: got zone_info.d9e72d30-c60b-4d0d-9267-fdc36392d5ad 2024-09-14T11:10:46.682 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:46.682+0000 7fb1d32ab9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:10:46.682 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:46.682+0000 7fb1d32ab9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:10:46.682 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:46.682+0000 7fb1d32ab9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:10:46.682 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:46.682+0000 7fb1d32ab9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:10:46.682 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:46.682+0000 7fb1d32ab9c0 20 RGWRados::pool_iterate: got zonegroup_info.65ab941b-da8c-4160-94fb-3672b069d44f 2024-09-14T11:10:46.682 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:46.682+0000 7fb1d32ab9c0 20 rados->read ofs=0 len=0 2024-09-14T11:10:46.682 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:46.682+0000 7fb1d32ab9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:10:46.682 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:46.682+0000 7fb1d32ab9c0 20 rados->read ofs=0 len=0 2024-09-14T11:10:46.683 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:46.682+0000 7fb1d32ab9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:10:46.683 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:46.682+0000 7fb1d32ab9c0 20 rados->read ofs=0 len=0 2024-09-14T11:10:46.684 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:46.686+0000 7fb1d32ab9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:10:46.684 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:46.686+0000 7fb1d32ab9c0 20 zone default found 2024-09-14T11:10:46.684 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:46.686+0000 7fb1d32ab9c0 4 Realm: () 2024-09-14T11:10:46.684 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:46.686+0000 7fb1d32ab9c0 4 ZoneGroup: default (65ab941b-da8c-4160-94fb-3672b069d44f) 2024-09-14T11:10:46.684 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:46.686+0000 7fb1d32ab9c0 4 Zone: default (d9e72d30-c60b-4d0d-9267-fdc36392d5ad) 2024-09-14T11:10:46.684 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:46.686+0000 7fb1d32ab9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:10:46.684 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:46.686+0000 7fb1d32ab9c0 20 zonegroup default 2024-09-14T11:10:46.684 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:46.686+0000 7fb1d32ab9c0 20 rados->read ofs=0 len=0 2024-09-14T11:10:46.685 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:46.686+0000 7fb1d32ab9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:10:46.685 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:46.686+0000 7fb1d32ab9c0 20 rados->read ofs=0 len=0 2024-09-14T11:10:46.685 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:46.686+0000 7fb1d32ab9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:10:46.685 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:46.686+0000 7fb1d32ab9c0 20 rados->read ofs=0 len=0 2024-09-14T11:10:46.686 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:46.686+0000 7fb1d32ab9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:10:46.686 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:46.686+0000 7fb1d32ab9c0 20 started sync module instance, tier type = 2024-09-14T11:10:46.686 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:46.686+0000 7fb1d32ab9c0 20 started zone id=d9e72d30-c60b-4d0d-9267-fdc36392d5ad (name=default) with tier type = 2024-09-14T11:10:46.709 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:46.710+0000 7fb1d32ab9c0 20 add_watcher() i=0 2024-09-14T11:10:46.709 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:46.710+0000 7fb1d32ab9c0 20 add_watcher() i=1 2024-09-14T11:10:46.709 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:46.710+0000 7fb1d32ab9c0 20 add_watcher() i=2 2024-09-14T11:10:46.709 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:46.710+0000 7fb1d32ab9c0 20 add_watcher() i=3 2024-09-14T11:10:46.709 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:46.710+0000 7fb1d32ab9c0 20 add_watcher() i=4 2024-09-14T11:10:46.709 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:46.710+0000 7fb1d32ab9c0 20 add_watcher() i=5 2024-09-14T11:10:46.709 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:46.710+0000 7fb1d32ab9c0 20 add_watcher() i=6 2024-09-14T11:10:46.711 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:46.710+0000 7fb1d32ab9c0 20 add_watcher() i=7 2024-09-14T11:10:46.711 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:46.710+0000 7fb1d32ab9c0 2 all 8 watchers are set, enabling cache 2024-09-14T11:10:46.715 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:46.714+0000 7fb086fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:10:46.716 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:46.718+0000 7fb1d32ab9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:10:46.716 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:46.718+0000 7fb1d32ab9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:10:46.716 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:46.718+0000 7fb1d32ab9c0 5 note: GC not initialized 2024-09-14T11:10:46.717 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:46.718+0000 7fb085fe3640 20 reqs_thread_entry: start 2024-09-14T11:10:46.717 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:46.718+0000 7fb1d32ab9c0 20 init_complete bucket index max shards: 11 2024-09-14T11:10:46.717 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:46.718+0000 7fb1d32ab9c0 20 Filter name: none 2024-09-14T11:10:46.717 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:46.718+0000 7faff77fe640 20 reqs_thread_entry: start 2024-09-14T11:10:46.717 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:46.718+0000 7fb1d32ab9c0 10 cache get: name=default.rgw.meta+root+check-bucket : miss 2024-09-14T11:10:46.717 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:46.718+0000 7fb1d32ab9c0 20 rados->read ofs=0 len=0 2024-09-14T11:10:46.718 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:46.718+0000 7fb1d32ab9c0 20 rados_obj.operate() r=0 bl.length=190 2024-09-14T11:10:46.718 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:46.718+0000 7fb1d32ab9c0 10 cache put: name=default.rgw.meta+root+check-bucket info.flags=0x11 2024-09-14T11:10:46.718 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:46.718+0000 7fb1d32ab9c0 10 adding default.rgw.meta+root+check-bucket to cache LRU end 2024-09-14T11:10:46.718 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:46.718+0000 7fb1d32ab9c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.check-bucket:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.1 : miss 2024-09-14T11:10:46.718 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:46.718+0000 7fb1d32ab9c0 20 rados->read ofs=0 len=0 2024-09-14T11:10:46.719 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:46.718+0000 7fb1d32ab9c0 20 rados_obj.operate() r=0 bl.length=412 2024-09-14T11:10:46.719 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:46.718+0000 7fb1d32ab9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.check-bucket:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.1 info.flags=0x17 2024-09-14T11:10:46.719 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:46.718+0000 7fb1d32ab9c0 10 adding default.rgw.meta+root+.bucket.meta.check-bucket:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.1 to cache LRU end 2024-09-14T11:10:46.719 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:46.718+0000 7fb1d32ab9c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:10:46.719 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:46.718+0000 7fb1d32ab9c0 10 updating xattr: name=user.rgw.acl bl.length()=179 2024-09-14T11:10:46.719 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:46.718+0000 7fb1d32ab9c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.check-bucket:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.1 2024-09-14T11:10:46.719 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:46.718+0000 7fb1d32ab9c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.1.0 2024-09-14T11:10:46.720 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:46.722+0000 7fb1d32ab9c0 1 NOTICE: finished shard 0 (0 entries removed) 2024-09-14T11:10:46.720 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:46.722+0000 7fb1d32ab9c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.1.1 2024-09-14T11:10:46.720 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:46.722+0000 7fb1d32ab9c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.1.2 2024-09-14T11:10:46.720 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:46.722+0000 7fb1d32ab9c0 1 NOTICE: finished shard 2 (0 entries removed) 2024-09-14T11:10:46.721 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:46.722+0000 7fb1d32ab9c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.1.3 2024-09-14T11:10:46.722 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:46.722+0000 7fb1d32ab9c0 1 NOTICE: finished shard 3 (0 entries removed) 2024-09-14T11:10:46.722 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:46.722+0000 7fb1d32ab9c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.1.4 2024-09-14T11:10:46.724 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:46.726+0000 7fb1d32ab9c0 1 NOTICE: finished shard 4 (0 entries removed) 2024-09-14T11:10:46.724 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:46.726+0000 7fb1d32ab9c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.1.5 2024-09-14T11:10:46.725 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:46.726+0000 7fb1d32ab9c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.1.6 2024-09-14T11:10:46.725 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:46.726+0000 7fb1d32ab9c0 1 NOTICE: finished shard 6 (0 entries removed) 2024-09-14T11:10:46.725 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:46.726+0000 7fb1d32ab9c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.1.7 2024-09-14T11:10:46.726 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:46.726+0000 7fb1d32ab9c0 1 NOTICE: finished shard 7 (0 entries removed) 2024-09-14T11:10:46.726 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:46.726+0000 7fb1d32ab9c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.1.8 2024-09-14T11:10:46.728 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:46.730+0000 7fb1d32ab9c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.1.9 2024-09-14T11:10:46.729 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:46.730+0000 7fb1d32ab9c0 1 NOTICE: finished shard 9 (0 entries removed) 2024-09-14T11:10:46.729 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:46.730+0000 7fb1d32ab9c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.1.10 2024-09-14T11:10:46.730 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:46.730+0000 7fb1d32ab9c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.1.1 2024-09-14T11:10:46.731 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:46.730+0000 7fb1d32ab9c0 20 get_obj_state: octx=0x55a27ae8e930 obj=check-bucket:e state=0x55a27b144a88 s->prefetch_data=0 2024-09-14T11:10:46.731 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:46.730+0000 7fb1d32ab9c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.1.5 2024-09-14T11:10:46.731 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:46.730+0000 7fb1d32ab9c0 20 get_obj_state: octx=0x55a27aea01e0 obj=check-bucket:d state=0x55a27b13dd88 s->prefetch_data=0 2024-09-14T11:10:46.731 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:46.730+0000 7fb1d32ab9c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.1.8 2024-09-14T11:10:46.732 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:46.734+0000 7fb1d32ab9c0 20 get_obj_state: octx=0x55a27b1403a0 obj=check-bucket:c state=0x55a27b13e8e8 s->prefetch_data=0 2024-09-14T11:10:46.732 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:46.734+0000 7fb1d32ab9c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.1.10 2024-09-14T11:10:46.733 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:46.734+0000 7fb1d32ab9c0 20 get_obj_state: octx=0x55a27b13fd10 obj=check-bucket:f state=0x55a27b143688 s->prefetch_data=0 2024-09-14T11:10:46.733 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:46.734+0000 7fb1d32ab9c0 20 get_obj_state: setting s->obj_tag to ds5dj1lvoo3ctvm2xczmgrk5clqlgjj1 2024-09-14T11:10:46.733 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:46.734+0000 7fb1d32ab9c0 20 get_obj_state_impl: setting s->olh_tag to jukpevbygysltkqa8pq4478hrx0li0gx 2024-09-14T11:10:46.733 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:46.734+0000 7fb1d32ab9c0 20 bucket_index_guard_olh_op(): olh_state.olh_tag=jukpevbygysltkqa8pq4478hrx0li0gx 2024-09-14T11:10:46.734 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:46.734+0000 7fb1d32ab9c0 20 get_obj_state: setting s->obj_tag to r19959oo8g3f73h1qaya7j0qas1q4a2c 2024-09-14T11:10:46.734 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:46.734+0000 7fb1d32ab9c0 20 get_obj_state_impl: setting s->olh_tag to khx5op22q5wg1k9s4xh40oxcoak589u1 2024-09-14T11:10:46.734 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:46.734+0000 7fb1d32ab9c0 20 bucket_index_guard_olh_op(): olh_state.olh_tag=khx5op22q5wg1k9s4xh40oxcoak589u1 2024-09-14T11:10:46.734 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:46.734+0000 7fb1d32ab9c0 20 get_obj_state: setting s->obj_tag to z1sx2foaj55c76rnjmetdz4vgw61hik0 2024-09-14T11:10:46.734 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:46.734+0000 7fb1d32ab9c0 20 get_obj_state_impl: setting s->olh_tag to haopgrj21jsyehbvlvx1owkeu1z0wd9l 2024-09-14T11:10:46.734 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:46.734+0000 7fb1d32ab9c0 20 bucket_index_guard_olh_op(): olh_state.olh_tag=haopgrj21jsyehbvlvx1owkeu1z0wd9l 2024-09-14T11:10:46.734 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:46.734+0000 7fb1d32ab9c0 20 get_obj_state: setting s->obj_tag to af2ahvbeumhw45c3eavw6z35mwiua0ku 2024-09-14T11:10:46.735 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:46.734+0000 7fb1d32ab9c0 20 get_obj_state_impl: setting s->olh_tag to mwgkghe8hrt1c2mgw8y410rd6gxqmeyl 2024-09-14T11:10:46.735 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:46.734+0000 7fb1d32ab9c0 20 bucket_index_guard_olh_op(): olh_state.olh_tag=mwgkghe8hrt1c2mgw8y410rd6gxqmeyl 2024-09-14T11:10:46.736 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:46.738+0000 7fb1d32ab9c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.1.5 2024-09-14T11:10:46.737 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:46.738+0000 7fb1d32ab9c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.1.1 2024-09-14T11:10:46.738 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:46.738+0000 7fb1d32ab9c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.1.5 2024-09-14T11:10:46.738 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:46.738+0000 7fb1d32ab9c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.1.8 2024-09-14T11:10:46.739 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:46.738+0000 7fb1d32ab9c0 20 olh_log_entry: epoch=3 op=3 key=d[1NiLZ.TRzLcyxr7TGBraZ3pLSiyzyhF] 2024-09-14T11:10:46.739 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:46.738+0000 7fb1d32ab9c0 20 get_obj_state: octx=0x55a27aea01e0 obj=check-bucket:_:1NiLZ.TRzLcyxr7TGBraZ3pLSiyzyhF_d state=0x55a27b1e8548 s->prefetch_data=0 2024-09-14T11:10:46.739 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:46.738+0000 7fb1d32ab9c0 10 manifest: total_size = 22 2024-09-14T11:10:46.739 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:46.738+0000 7fb1d32ab9c0 20 get_obj_state: setting s->obj_tag to d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.12118755697762925970 2024-09-14T11:10:46.739 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:46.738+0000 7fb1d32ab9c0 20 get_obj_state: octx=0x55a27aea01e0 obj=check-bucket:_:1NiLZ.TRzLcyxr7TGBraZ3pLSiyzyhF_d state=0x55a27b1e8548 s->prefetch_data=0 2024-09-14T11:10:46.740 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:46.738+0000 7fb1d32ab9c0 20 prepare_atomic_modification: state is not atomic. state=0x55a27b1e8548 2024-09-14T11:10:46.740 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:46.738+0000 7fb1d32ab9c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.1.5 2024-09-14T11:10:46.741 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:46.742+0000 7fb1d32ab9c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.1.10 2024-09-14T11:10:46.743 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:46.746+0000 7fb1d32ab9c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.1.8 2024-09-14T11:10:46.744 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:46.746+0000 7fb1d32ab9c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.1.1 2024-09-14T11:10:46.745 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:46.746+0000 7fb1d32ab9c0 20 olh_log_entry: epoch=3 op=3 key=c[s4JeVZD-bUMgagdA0r0GDMYvEufaaq5] 2024-09-14T11:10:46.745 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:46.746+0000 7fb1d32ab9c0 20 get_obj_state: octx=0x55a27b1403a0 obj=check-bucket:_:s4JeVZD-bUMgagdA0r0GDMYvEufaaq5_c state=0x55a27b1f2568 s->prefetch_data=0 2024-09-14T11:10:46.745 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:46.746+0000 7fb1d32ab9c0 20 olh_log_entry: epoch=2 op=2 key=e[] 2024-09-14T11:10:46.745 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:46.746+0000 7fb1d32ab9c0 20 olh_log_entry: epoch=2 op=3 key=e[rRp6IyCT1xnK82A5EGpLvrbh-lEcGq7] 2024-09-14T11:10:46.746 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:46.746+0000 7fb1d32ab9c0 20 get_obj_state: octx=0x55a27ae8e930 obj=check-bucket:_:rRp6IyCT1xnK82A5EGpLvrbh-lEcGq7_e state=0x55a27b1f9128 s->prefetch_data=0 2024-09-14T11:10:46.746 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:46.746+0000 7fb1d32ab9c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.1.10 2024-09-14T11:10:46.746 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:46.746+0000 7fb1d32ab9c0 10 manifest: total_size = 9 2024-09-14T11:10:46.746 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:46.746+0000 7fb1d32ab9c0 20 get_obj_state: setting s->obj_tag to d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.4909562608653161927 2024-09-14T11:10:46.746 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:46.746+0000 7fb1d32ab9c0 20 get_obj_state: octx=0x55a27b1403a0 obj=check-bucket:_:s4JeVZD-bUMgagdA0r0GDMYvEufaaq5_c state=0x55a27b1f2568 s->prefetch_data=0 2024-09-14T11:10:46.746 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:46.746+0000 7fb1d32ab9c0 20 prepare_atomic_modification: state is not atomic. state=0x55a27b1f2568 2024-09-14T11:10:46.746 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:46.746+0000 7fb1d32ab9c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.1.8 2024-09-14T11:10:46.747 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:46.746+0000 7fb1d32ab9c0 20 olh_log_entry: epoch=2 op=2 key=f[] 2024-09-14T11:10:46.747 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:46.746+0000 7fb1d32ab9c0 20 olh_log_entry: epoch=2 op=3 key=f[x8h4N22nWwOL9zbZHbvbsrL96Dhr5Mz] 2024-09-14T11:10:46.747 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:46.746+0000 7fb1d32ab9c0 20 get_obj_state: octx=0x55a27b13fd10 obj=check-bucket:_:x8h4N22nWwOL9zbZHbvbsrL96Dhr5Mz_f state=0x55a27b203058 s->prefetch_data=0 2024-09-14T11:10:46.747 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:46.746+0000 7fb1d32ab9c0 10 manifest: total_size = 22 2024-09-14T11:10:46.747 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:46.746+0000 7fb1d32ab9c0 20 get_obj_state: setting s->obj_tag to d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.16510360277662266268 2024-09-14T11:10:46.747 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:46.746+0000 7fb1d32ab9c0 20 get_obj_state: octx=0x55a27ae8e930 obj=check-bucket:_:rRp6IyCT1xnK82A5EGpLvrbh-lEcGq7_e state=0x55a27b1f9128 s->prefetch_data=0 2024-09-14T11:10:46.747 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:46.746+0000 7fb1d32ab9c0 20 prepare_atomic_modification: state is not atomic. state=0x55a27b1f9128 2024-09-14T11:10:46.747 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:46.746+0000 7fb0a7fff640 20 handle_completion(): completion ok for obj=d[1NiLZ.TRzLcyxr7TGBraZ3pLSiyzyhF] 2024-09-14T11:10:46.747 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:46.746+0000 7fb1d32ab9c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.1.1 2024-09-14T11:10:46.747 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:46.746+0000 7fb1d32ab9c0 10 manifest: total_size = 22 2024-09-14T11:10:46.747 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:46.746+0000 7fb1d32ab9c0 20 get_obj_state: setting s->obj_tag to d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.13498916477342577792 2024-09-14T11:10:46.747 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:46.746+0000 7fb1d32ab9c0 20 get_obj_state: octx=0x55a27b13fd10 obj=check-bucket:_:x8h4N22nWwOL9zbZHbvbsrL96Dhr5Mz_f state=0x55a27b203058 s->prefetch_data=0 2024-09-14T11:10:46.747 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:46.746+0000 7fb1d32ab9c0 20 prepare_atomic_modification: state is not atomic. state=0x55a27b203058 2024-09-14T11:10:46.747 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:46.746+0000 7fb1d32ab9c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.1.10 2024-09-14T11:10:46.748 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:46.746+0000 7fb1d32ab9c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.1.5 2024-09-14T11:10:46.748 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:46.746+0000 7fb1d32ab9c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.1.5 2024-09-14T11:10:46.749 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:46.750+0000 7fb1d32ab9c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.1.5 2024-09-14T11:10:46.749 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:46.750+0000 7fb1d32ab9c0 1 NOTICE: finished shard 5 (1 entries removed) 2024-09-14T11:10:46.757 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:46.758+0000 7fb0a7fff640 20 handle_completion(): completion ok for obj=e[rRp6IyCT1xnK82A5EGpLvrbh-lEcGq7] 2024-09-14T11:10:46.757 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:46.758+0000 7fb0a77fe640 20 handle_completion(): completion ok for obj=c[s4JeVZD-bUMgagdA0r0GDMYvEufaaq5] 2024-09-14T11:10:46.757 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:46.758+0000 7fb0a7fff640 20 handle_completion(): completion ok for obj=f[x8h4N22nWwOL9zbZHbvbsrL96Dhr5Mz] 2024-09-14T11:10:46.759 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:46.758+0000 7fb1d32ab9c0 20 get_obj_state: octx=0x55a27b13fd10 obj=check-bucket:f state=0x55a27b143688 s->prefetch_data=0 2024-09-14T11:10:46.759 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:46.758+0000 7fb1d32ab9c0 20 bucket_index_guard_olh_op(): olh_state.olh_tag=mwgkghe8hrt1c2mgw8y410rd6gxqmeyl 2024-09-14T11:10:46.760 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:46.762+0000 7fb1d32ab9c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.1.8 2024-09-14T11:10:46.760 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:46.762+0000 7fb1d32ab9c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.1.8 2024-09-14T11:10:46.761 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:46.762+0000 7fb1d32ab9c0 20 get_obj_state: octx=0x55a27ae8e930 obj=check-bucket:e state=0x55a27b144a88 s->prefetch_data=0 2024-09-14T11:10:46.761 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:46.762+0000 7fb1d32ab9c0 20 bucket_index_guard_olh_op(): olh_state.olh_tag=jukpevbygysltkqa8pq4478hrx0li0gx 2024-09-14T11:10:46.765 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:46.766+0000 7fb1d32ab9c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.1.8 2024-09-14T11:10:46.765 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:46.766+0000 7fb1d32ab9c0 1 NOTICE: finished shard 8 (1 entries removed) 2024-09-14T11:10:46.771 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:46.770+0000 7fb1d32ab9c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.1.10 2024-09-14T11:10:46.771 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:46.770+0000 7fb1d32ab9c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.1.1 2024-09-14T11:10:46.774 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:46.774+0000 7fb1d32ab9c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.1.1 2024-09-14T11:10:46.774 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:46.774+0000 7fb1d32ab9c0 1 NOTICE: finished shard 1 (1 entries removed) 2024-09-14T11:10:46.777 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:46.778+0000 7fb1d32ab9c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.1.10 2024-09-14T11:10:46.777 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:46.778+0000 7fb1d32ab9c0 1 NOTICE: finished shard 10 (1 entries removed) 2024-09-14T11:10:46.777 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:46.778+0000 7fb1d32ab9c0 1 NOTICE: finished all shards (4 entries removed) 2024-09-14T11:10:46.778 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:46.778+0000 7fb086fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:10:46.783 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:46.782+0000 7fb1d32ab9c0 20 remove_watcher() i=0 2024-09-14T11:10:46.783 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:46.782+0000 7fb1d32ab9c0 2 removed watcher, disabling cache 2024-09-14T11:10:46.785 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:46.786+0000 7fb1d32ab9c0 20 remove_watcher() i=1 2024-09-14T11:10:46.788 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:46.790+0000 7fb1d32ab9c0 20 remove_watcher() i=2 2024-09-14T11:10:46.790 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:46.790+0000 7fb1d32ab9c0 20 remove_watcher() i=3 2024-09-14T11:10:46.793 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:46.794+0000 7fb1d32ab9c0 20 remove_watcher() i=4 2024-09-14T11:10:46.794 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:46.794+0000 7fb1d32ab9c0 20 remove_watcher() i=5 2024-09-14T11:10:46.796 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:46.798+0000 7fb1d32ab9c0 20 remove_watcher() i=6 2024-09-14T11:10:46.797 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:46.798+0000 7fb1d32ab9c0 20 remove_watcher() i=7 2024-09-14T11:10:46.817 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:10:46.817 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-14T11:10:46.883 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:10:46.883 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-14T11:10:47.317 INFO:tasks.workunit.client.0.smithi138.stderr:radosgw-admin bucket stats --bucket check-bucket 2024-09-14T11:10:47.350 INFO:tasks.workunit.client.0.smithi138.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:10:47.350 INFO:tasks.workunit.client.0.smithi138.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:10:47.395 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:47.394+0000 7f3f528b59c0 20 rados->read ofs=0 len=0 2024-09-14T11:10:47.397 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:47.398+0000 7f3f528b59c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:10:47.397 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:47.398+0000 7f3f528b59c0 20 realm 2024-09-14T11:10:47.397 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:47.398+0000 7f3f528b59c0 20 rados->read ofs=0 len=0 2024-09-14T11:10:47.397 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:47.398+0000 7f3f528b59c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:10:47.397 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:47.398+0000 7f3f528b59c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:10:47.397 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:47.398+0000 7f3f528b59c0 20 rados->read ofs=0 len=0 2024-09-14T11:10:47.397 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:47.398+0000 7f3f528b59c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:10:47.397 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:47.398+0000 7f3f528b59c0 20 rados->read ofs=0 len=0 2024-09-14T11:10:47.399 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:47.398+0000 7f3f528b59c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:10:47.399 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:47.398+0000 7f3f528b59c0 20 rados->read ofs=0 len=0 2024-09-14T11:10:47.400 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:47.402+0000 7f3f528b59c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:10:47.400 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:47.402+0000 7f3f528b59c0 20 searching for the correct realm 2024-09-14T11:10:47.405 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:47.406+0000 7f3f4fbba640 0 -- 172.21.15.138:0/2733644288 >> [v2:172.21.15.154:6808/1468088432,v1:172.21.15.154:6809/1468088432] conn(0x7f3f40028070 msgr2=0x7f3f400673e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:10:47.410 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:47.410+0000 7f3f4fbba640 0 -- 172.21.15.138:0/2733644288 >> [v2:172.21.15.138:6816/326481658,v1:172.21.15.138:6817/326481658] conn(0x7f3f4806faf0 msgr2=0x7f3f48080130 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:10:47.626 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:47.626+0000 7f3f528b59c0 20 RGWRados::pool_iterate: got zone_info.d9e72d30-c60b-4d0d-9267-fdc36392d5ad 2024-09-14T11:10:47.627 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:47.626+0000 7f3f528b59c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:10:47.627 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:47.626+0000 7f3f528b59c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:10:47.627 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:47.626+0000 7f3f528b59c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:10:47.627 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:47.626+0000 7f3f528b59c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:10:47.627 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:47.626+0000 7f3f528b59c0 20 RGWRados::pool_iterate: got zonegroup_info.65ab941b-da8c-4160-94fb-3672b069d44f 2024-09-14T11:10:47.627 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:47.626+0000 7f3f528b59c0 20 rados->read ofs=0 len=0 2024-09-14T11:10:47.628 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:47.626+0000 7f3f528b59c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:10:47.628 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:47.626+0000 7f3f528b59c0 20 rados->read ofs=0 len=0 2024-09-14T11:10:47.628 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:47.630+0000 7f3f528b59c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:10:47.628 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:47.630+0000 7f3f528b59c0 20 rados->read ofs=0 len=0 2024-09-14T11:10:47.629 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:47.630+0000 7f3f528b59c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:10:47.629 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:47.630+0000 7f3f528b59c0 20 zone default found 2024-09-14T11:10:47.629 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:47.630+0000 7f3f528b59c0 4 Realm: () 2024-09-14T11:10:47.629 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:47.630+0000 7f3f528b59c0 4 ZoneGroup: default (65ab941b-da8c-4160-94fb-3672b069d44f) 2024-09-14T11:10:47.629 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:47.630+0000 7f3f528b59c0 4 Zone: default (d9e72d30-c60b-4d0d-9267-fdc36392d5ad) 2024-09-14T11:10:47.629 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:47.630+0000 7f3f528b59c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:10:47.629 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:47.630+0000 7f3f528b59c0 20 zonegroup default 2024-09-14T11:10:47.629 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:47.630+0000 7f3f528b59c0 20 rados->read ofs=0 len=0 2024-09-14T11:10:47.629 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:47.630+0000 7f3f528b59c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:10:47.629 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:47.630+0000 7f3f528b59c0 20 rados->read ofs=0 len=0 2024-09-14T11:10:47.630 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:47.630+0000 7f3f528b59c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:10:47.630 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:47.630+0000 7f3f528b59c0 20 rados->read ofs=0 len=0 2024-09-14T11:10:47.631 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:47.630+0000 7f3f528b59c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:10:47.631 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:47.630+0000 7f3f528b59c0 20 started sync module instance, tier type = 2024-09-14T11:10:47.631 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:47.630+0000 7f3f528b59c0 20 started zone id=d9e72d30-c60b-4d0d-9267-fdc36392d5ad (name=default) with tier type = 2024-09-14T11:10:47.656 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:47.658+0000 7f3f528b59c0 20 add_watcher() i=0 2024-09-14T11:10:47.656 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:47.658+0000 7f3f528b59c0 20 add_watcher() i=1 2024-09-14T11:10:47.656 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:47.658+0000 7f3f528b59c0 20 add_watcher() i=2 2024-09-14T11:10:47.656 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:47.658+0000 7f3f528b59c0 20 add_watcher() i=3 2024-09-14T11:10:47.656 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:47.658+0000 7f3f528b59c0 20 add_watcher() i=4 2024-09-14T11:10:47.656 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:47.658+0000 7f3f528b59c0 20 add_watcher() i=5 2024-09-14T11:10:47.656 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:47.658+0000 7f3f528b59c0 20 add_watcher() i=6 2024-09-14T11:10:47.658 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:47.658+0000 7f3f528b59c0 20 add_watcher() i=7 2024-09-14T11:10:47.658 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:47.658+0000 7f3f528b59c0 2 all 8 watchers are set, enabling cache 2024-09-14T11:10:47.662 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:47.662+0000 7f3e06fdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:10:47.664 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:47.662+0000 7f3f528b59c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:10:47.664 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:47.662+0000 7f3f528b59c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:10:47.664 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:47.666+0000 7f3f528b59c0 5 note: GC not initialized 2024-09-14T11:10:47.665 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:47.666+0000 7f3e05fdb640 20 reqs_thread_entry: start 2024-09-14T11:10:47.665 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:47.666+0000 7f3f528b59c0 20 init_complete bucket index max shards: 11 2024-09-14T11:10:47.665 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:47.666+0000 7f3f528b59c0 20 Filter name: none 2024-09-14T11:10:47.665 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:47.666+0000 7f3d777fe640 20 reqs_thread_entry: start 2024-09-14T11:10:47.665 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:47.666+0000 7f3f528b59c0 20 rados->read ofs=0 len=0 2024-09-14T11:10:47.666 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:47.666+0000 7f3f528b59c0 20 rados_obj.operate() r=0 bl.length=190 2024-09-14T11:10:47.666 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:47.666+0000 7f3f528b59c0 20 rados->read ofs=0 len=0 2024-09-14T11:10:47.666 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:47.666+0000 7f3f528b59c0 20 rados_obj.operate() r=0 bl.length=412 2024-09-14T11:10:47.666 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:47.666+0000 7f3f528b59c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:10:47.667 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:47.666+0000 7f3f528b59c0 20 rados->read ofs=0 len=0 2024-09-14T11:10:47.667 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:47.666+0000 7f3f528b59c0 20 rados_obj.operate() r=0 bl.length=190 2024-09-14T11:10:47.667 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:47.666+0000 7f3f528b59c0 20 rados->read ofs=0 len=0 2024-09-14T11:10:47.668 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:47.670+0000 7f3f528b59c0 20 rados_obj.operate() r=0 bl.length=412 2024-09-14T11:10:47.668 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:47.670+0000 7f3f528b59c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:10:47.671 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:47.670+0000 7f3e06fdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:10:47.677 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:47.678+0000 7f3f528b59c0 20 remove_watcher() i=0 2024-09-14T11:10:47.677 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:47.678+0000 7f3f528b59c0 2 removed watcher, disabling cache 2024-09-14T11:10:47.679 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:47.678+0000 7f3f528b59c0 20 remove_watcher() i=1 2024-09-14T11:10:47.681 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:47.682+0000 7f3f528b59c0 20 remove_watcher() i=2 2024-09-14T11:10:47.683 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:47.682+0000 7f3f528b59c0 20 remove_watcher() i=3 2024-09-14T11:10:47.685 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:47.686+0000 7f3f528b59c0 20 remove_watcher() i=4 2024-09-14T11:10:47.687 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:47.686+0000 7f3f528b59c0 20 remove_watcher() i=5 2024-09-14T11:10:47.688 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:47.690+0000 7f3f528b59c0 20 remove_watcher() i=6 2024-09-14T11:10:47.690 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:10:47.690+0000 7f3f528b59c0 20 remove_watcher() i=7 2024-09-14T11:10:47.705 INFO:tasks.workunit.client.0.smithi138.stderr:{'rgw.main': {'size': 0, 'size_actual': 0, 'size_utilized': 0, 'size_kb': 0, 'size_kb_actual': 0, 'size_kb_utilized': 0, 'num_objects': 0}} 2024-09-14T11:10:47.706 INFO:tasks.workunit.client.0.smithi138.stderr:Deleting bucket check-bucket 2024-09-14T11:10:47.707 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:10:47.707 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-14T11:10:47.755 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:10:47.755 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-14T11:10:48.329 INFO:tasks.workunit.client.0.smithi138.stderr:Completed bucket check tests 2024-09-14T11:10:48.329 INFO:tasks.workunit.client.0.smithi138.stdout:Could not connect to the endpoint URL: "http://localhost:80/" 2024-09-14T11:10:48.329 INFO:tasks.workunit.client.0.smithi138.stdout:Could not connect to the endpoint URL: "http://localhost:8000/" 2024-09-14T11:10:48.329 INFO:tasks.workunit.client.0.smithi138.stdout:connected to https://localhost:443 2024-09-14T11:10:48.428 INFO:tasks.workunit.client.0.smithi138.stderr:+ deactivate 2024-09-14T11:10:48.428 INFO:tasks.workunit.client.0.smithi138.stderr:+ '[' -n /usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/usr/games:/usr/local/games:/snap/bin:/usr/sbin ']' 2024-09-14T11:10:48.428 INFO:tasks.workunit.client.0.smithi138.stderr:+ PATH=/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/usr/games:/usr/local/games:/snap/bin:/usr/sbin 2024-09-14T11:10:48.428 INFO:tasks.workunit.client.0.smithi138.stderr:+ export PATH 2024-09-14T11:10:48.428 INFO:tasks.workunit.client.0.smithi138.stderr:+ unset _OLD_VIRTUAL_PATH 2024-09-14T11:10:48.429 INFO:tasks.workunit.client.0.smithi138.stderr:+ '[' -n '' ']' 2024-09-14T11:10:48.429 INFO:tasks.workunit.client.0.smithi138.stderr:+ '[' -n /usr/bin/bash -o -n '' ']' 2024-09-14T11:10:48.429 INFO:tasks.workunit.client.0.smithi138.stderr:+ hash -r 2024-09-14T11:10:48.429 INFO:tasks.workunit.client.0.smithi138.stderr:+ '[' -n '' ']' 2024-09-14T11:10:48.429 INFO:tasks.workunit.client.0.smithi138.stderr:+ unset VIRTUAL_ENV 2024-09-14T11:10:48.429 INFO:tasks.workunit.client.0.smithi138.stderr:+ unset VIRTUAL_ENV_PROMPT 2024-09-14T11:10:48.429 INFO:tasks.workunit.client.0.smithi138.stderr:+ '[' '!' '' = nondestructive ']' 2024-09-14T11:10:48.429 INFO:tasks.workunit.client.0.smithi138.stderr:+ unset -f deactivate 2024-09-14T11:10:48.429 INFO:tasks.workunit.client.0.smithi138.stderr:+ echo OK. 2024-09-14T11:10:48.430 INFO:tasks.workunit.client.0.smithi138.stdout:OK. 2024-09-14T11:10:48.431 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-09-14T11:10:48.431 DEBUG:teuthology.orchestra.run.smithi138:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-09-14T11:10:48.444 INFO:tasks.workunit:Stopping ['rgw/run-bucket-check.sh'] on client.0... 2024-09-14T11:10:48.444 DEBUG:teuthology.orchestra.run.smithi138:> sudo rm -rf -- /home/ubuntu/cephtest/workunits.list.client.0 /home/ubuntu/cephtest/clone.client.0 2024-09-14T11:10:48.871 DEBUG:teuthology.parallel:result is None 2024-09-14T11:10:48.872 DEBUG:teuthology.orchestra.run.smithi138:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0 2024-09-14T11:10:48.883 INFO:tasks.workunit:Deleted dir /home/ubuntu/cephtest/mnt.0/client.0 2024-09-14T11:10:48.884 DEBUG:teuthology.orchestra.run.smithi138:> rmdir -- /home/ubuntu/cephtest/mnt.0 2024-09-14T11:10:49.013 INFO:tasks.workunit:Deleted artificial mount point /home/ubuntu/cephtest/mnt.0/client.0 2024-09-14T11:10:49.013 INFO:teuthology.run_tasks:Running task workunit... 2024-09-14T11:10:49.024 INFO:tasks.workunit:Pulling workunits from ref 1c941a66c1b420259b8fc5ac19e792dbbf60aded 2024-09-14T11:10:49.024 INFO:tasks.workunit:Making a separate scratch dir for every client... 2024-09-14T11:10:49.024 DEBUG:teuthology.orchestra.run.smithi138:> stat -- /home/ubuntu/cephtest/mnt.0 2024-09-14T11:10:49.030 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-14T11:10:49.030 INFO:teuthology.orchestra.run.smithi138.stderr:stat: cannot statx '/home/ubuntu/cephtest/mnt.0': No such file or directory 2024-09-14T11:10:49.030 DEBUG:teuthology.orchestra.run.smithi138:> mkdir -- /home/ubuntu/cephtest/mnt.0 2024-09-14T11:10:49.076 INFO:tasks.workunit:Created dir /home/ubuntu/cephtest/mnt.0 2024-09-14T11:10:49.077 DEBUG:teuthology.orchestra.run.smithi138:> cd -- /home/ubuntu/cephtest/mnt.0 && mkdir -- client.0 2024-09-14T11:10:49.124 INFO:tasks.workunit:timeout=3h 2024-09-14T11:10:49.125 INFO:tasks.workunit:cleanup=True 2024-09-14T11:10:49.125 DEBUG:teuthology.orchestra.run.smithi138:> rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone https://git.ceph.com/ceph.git /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 && git checkout 1c941a66c1b420259b8fc5ac19e792dbbf60aded 2024-09-14T11:10:49.174 INFO:tasks.workunit.client.0.smithi138.stderr:Cloning into '/home/ubuntu/cephtest/clone.client.0'... 2024-09-14T11:11:43.568 INFO:tasks.workunit.client.0.smithi138.stderr:Note: switching to '1c941a66c1b420259b8fc5ac19e792dbbf60aded'. 2024-09-14T11:11:43.568 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-14T11:11:43.568 INFO:tasks.workunit.client.0.smithi138.stderr:You are in 'detached HEAD' state. You can look around, make experimental 2024-09-14T11:11:43.568 INFO:tasks.workunit.client.0.smithi138.stderr:changes and commit them, and you can discard any commits you make in this 2024-09-14T11:11:43.569 INFO:tasks.workunit.client.0.smithi138.stderr:state without impacting any branches by switching back to a branch. 2024-09-14T11:11:43.569 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-14T11:11:43.569 INFO:tasks.workunit.client.0.smithi138.stderr:If you want to create a new branch to retain commits you create, you may 2024-09-14T11:11:43.569 INFO:tasks.workunit.client.0.smithi138.stderr:do so (now or later) by using -c with the switch command. Example: 2024-09-14T11:11:43.569 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-14T11:11:43.569 INFO:tasks.workunit.client.0.smithi138.stderr: git switch -c 2024-09-14T11:11:43.569 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-14T11:11:43.569 INFO:tasks.workunit.client.0.smithi138.stderr:Or undo this operation with: 2024-09-14T11:11:43.569 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-14T11:11:43.569 INFO:tasks.workunit.client.0.smithi138.stderr: git switch - 2024-09-14T11:11:43.569 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-14T11:11:43.569 INFO:tasks.workunit.client.0.smithi138.stderr:Turn off this advice by setting config variable advice.detachedHead to false 2024-09-14T11:11:43.569 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-14T11:11:43.569 INFO:tasks.workunit.client.0.smithi138.stderr:HEAD is now at 1c941a66c1b Merge pull request #54777 from cbodley/wip-rgw-meta-handlers 2024-09-14T11:11:43.570 DEBUG:teuthology.orchestra.run.smithi138:> cd -- /home/ubuntu/cephtest/clone.client.0/qa/workunits && if test -e Makefile ; then make ; fi && find -executable -type f -printf '%P\0' >/home/ubuntu/cephtest/workunits.list.client.0 2024-09-14T11:11:43.618 INFO:tasks.workunit.client.0.smithi138.stdout:for d in direct_io fs ; do ( cd $d ; make all ) ; done 2024-09-14T11:11:43.621 INFO:tasks.workunit.client.0.smithi138.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-09-14T11:11:43.621 INFO:tasks.workunit.client.0.smithi138.stdout:cc -Wall -Wextra -D_GNU_SOURCE direct_io_test.c -o direct_io_test 2024-09-14T11:11:43.674 INFO:tasks.workunit.client.0.smithi138.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_sync_io.c -o test_sync_io 2024-09-14T11:11:43.729 INFO:tasks.workunit.client.0.smithi138.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_short_dio_read.c -o test_short_dio_read 2024-09-14T11:11:43.776 INFO:tasks.workunit.client.0.smithi138.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-09-14T11:11:43.777 INFO:tasks.workunit.client.0.smithi138.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-09-14T11:11:43.777 INFO:tasks.workunit.client.0.smithi138.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_o_trunc.c -o test_o_trunc 2024-09-14T11:11:43.823 INFO:tasks.workunit.client.0.smithi138.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-09-14T11:11:43.826 DEBUG:teuthology.orchestra.run.smithi138:> set -ex 2024-09-14T11:11:43.826 DEBUG:teuthology.orchestra.run.smithi138:> dd if=/home/ubuntu/cephtest/workunits.list.client.0 of=/dev/stdout 2024-09-14T11:11:43.872 INFO:tasks.workunit:Running workunits matching cls/test_cls_lock.sh on client.0... 2024-09-14T11:11:43.874 INFO:tasks.workunit:Running workunit cls/test_cls_lock.sh... 2024-09-14T11:11:43.874 DEBUG:teuthology.orchestra.run.smithi138:workunit test cls/test_cls_lock.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=1c941a66c1b420259b8fc5ac19e792dbbf60aded TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/cls/test_cls_lock.sh 2024-09-14T11:11:43.938 INFO:tasks.workunit.client.0.smithi138.stdout:Running main() from gmock_main.cc 2024-09-14T11:11:43.939 INFO:tasks.workunit.client.0.smithi138.stdout:[==========] Running 11 tests from 1 test suite. 2024-09-14T11:11:43.939 INFO:tasks.workunit.client.0.smithi138.stdout:[----------] Global test environment set-up. 2024-09-14T11:11:43.939 INFO:tasks.workunit.client.0.smithi138.stdout:[----------] 11 tests from ClsLock 2024-09-14T11:11:43.939 INFO:tasks.workunit.client.0.smithi138.stdout:[ RUN ] ClsLock.TestMultiLocking 2024-09-14T11:11:45.895 INFO:tasks.workunit.client.0.smithi138.stdout:lock: mylock 2024-09-14T11:11:45.895 INFO:tasks.workunit.client.0.smithi138.stdout: lock_type: exclusive 2024-09-14T11:11:45.896 INFO:tasks.workunit.client.0.smithi138.stdout: tag: 2024-09-14T11:11:45.896 INFO:tasks.workunit.client.0.smithi138.stdout: lockers: 2024-09-14T11:11:45.896 INFO:tasks.workunit.client.0.smithi138.stdout: client.5073 expiration=2024-09-14T11:13:45.892182+0000 addr=v1:172.21.15.138:0/1190967013 cookie= 2024-09-14T11:11:45.903 INFO:tasks.workunit.client.0.smithi138.stdout:lock: mylock 2024-09-14T11:11:45.903 INFO:tasks.workunit.client.0.smithi138.stdout: lock_type: shared 2024-09-14T11:11:45.903 INFO:tasks.workunit.client.0.smithi138.stdout: tag: 2024-09-14T11:11:45.903 INFO:tasks.workunit.client.0.smithi138.stdout: lockers: 2024-09-14T11:11:45.903 INFO:tasks.workunit.client.0.smithi138.stdout: client.5073 expiration=2024-09-14T11:13:45.903744+0000 addr=v1:172.21.15.138:0/1190967013 cookie= 2024-09-14T11:11:45.903 INFO:tasks.workunit.client.0.smithi138.stdout: client.5079 expiration=0.000000 addr=v1:172.21.15.138:0/14096599 cookie= 2024-09-14T11:11:45.905 INFO:tasks.workunit.client.0.smithi138.stdout:lock: mylock 2024-09-14T11:11:45.905 INFO:tasks.workunit.client.0.smithi138.stdout: lock_type: shared 2024-09-14T11:11:45.905 INFO:tasks.workunit.client.0.smithi138.stdout: tag: 2024-09-14T11:11:45.905 INFO:tasks.workunit.client.0.smithi138.stdout: lockers: 2024-09-14T11:11:45.905 INFO:tasks.workunit.client.0.smithi138.stdout: client.5079 expiration=0.000000 addr=v1:172.21.15.138:0/14096599 cookie= 2024-09-14T11:11:46.876 INFO:tasks.workunit.client.0.smithi138.stdout:[ OK ] ClsLock.TestMultiLocking (2937 ms) 2024-09-14T11:11:46.876 INFO:tasks.workunit.client.0.smithi138.stdout:[ RUN ] ClsLock.TestMeta 2024-09-14T11:11:48.954 INFO:tasks.workunit.client.0.smithi138.stdout:lock: mylock 2024-09-14T11:11:48.954 INFO:tasks.workunit.client.0.smithi138.stdout: lock_type: shared 2024-09-14T11:11:48.954 INFO:tasks.workunit.client.0.smithi138.stdout: tag: 2024-09-14T11:11:48.954 INFO:tasks.workunit.client.0.smithi138.stdout: lockers: 2024-09-14T11:11:48.954 INFO:tasks.workunit.client.0.smithi138.stdout: client.4922 expiration=0.000000 addr=v1:172.21.15.138:0/1566056471 cookie= 2024-09-14T11:11:48.959 INFO:tasks.workunit.client.0.smithi138.stdout:lock: mylock 2024-09-14T11:11:48.959 INFO:tasks.workunit.client.0.smithi138.stdout: lock_type: exclusive 2024-09-14T11:11:48.959 INFO:tasks.workunit.client.0.smithi138.stdout: tag: new_tag 2024-09-14T11:11:48.959 INFO:tasks.workunit.client.0.smithi138.stdout: lockers: 2024-09-14T11:11:48.959 INFO:tasks.workunit.client.0.smithi138.stdout: client.4916 expiration=0.000000 addr=v1:172.21.15.138:0/2148694730 cookie= 2024-09-14T11:11:49.894 INFO:tasks.workunit.client.0.smithi138.stdout:[ OK ] ClsLock.TestMeta (3018 ms) 2024-09-14T11:11:49.894 INFO:tasks.workunit.client.0.smithi138.stdout:[ RUN ] ClsLock.TestCookie 2024-09-14T11:11:51.979 INFO:tasks.workunit.client.0.smithi138.stdout:lock: mylock 2024-09-14T11:11:51.979 INFO:tasks.workunit.client.0.smithi138.stdout: lock_type: exclusive 2024-09-14T11:11:51.979 INFO:tasks.workunit.client.0.smithi138.stdout: tag: 2024-09-14T11:11:51.979 INFO:tasks.workunit.client.0.smithi138.stdout: lockers: 2024-09-14T11:11:51.983 INFO:tasks.workunit.client.0.smithi138.stdout:lock: mylock 2024-09-14T11:11:51.983 INFO:tasks.workunit.client.0.smithi138.stdout: lock_type: shared 2024-09-14T11:11:51.983 INFO:tasks.workunit.client.0.smithi138.stdout: tag: 2024-09-14T11:11:51.983 INFO:tasks.workunit.client.0.smithi138.stdout: lockers: 2024-09-14T11:11:51.984 INFO:tasks.workunit.client.0.smithi138.stdout: client.5097 expiration=0.000000 addr=v1:172.21.15.138:0/3440790638 cookie= 2024-09-14T11:11:51.984 INFO:tasks.workunit.client.0.smithi138.stdout: client.5097 expiration=0.000000 addr=v1:172.21.15.138:0/3440790638 cookie=new cookie 2024-09-14T11:11:52.941 INFO:tasks.workunit.client.0.smithi138.stdout:[ OK ] ClsLock.TestCookie (3047 ms) 2024-09-14T11:11:52.941 INFO:tasks.workunit.client.0.smithi138.stdout:[ RUN ] ClsLock.TestMultipleLocks 2024-09-14T11:11:55.999 INFO:tasks.workunit.client.0.smithi138.stdout:[ OK ] ClsLock.TestMultipleLocks (3058 ms) 2024-09-14T11:11:55.999 INFO:tasks.workunit.client.0.smithi138.stdout:[ RUN ] ClsLock.TestLockDuration 2024-09-14T11:12:03.839 INFO:tasks.workunit.client.0.smithi138.stdout:[ OK ] ClsLock.TestLockDuration (7839 ms) 2024-09-14T11:12:03.839 INFO:tasks.workunit.client.0.smithi138.stdout:[ RUN ] ClsLock.TestAssertLocked 2024-09-14T11:12:06.869 INFO:tasks.workunit.client.0.smithi138.stdout:[ OK ] ClsLock.TestAssertLocked (3030 ms) 2024-09-14T11:12:06.870 INFO:tasks.workunit.client.0.smithi138.stdout:[ RUN ] ClsLock.TestSetCookie 2024-09-14T11:12:09.921 INFO:tasks.workunit.client.0.smithi138.stdout:[ OK ] ClsLock.TestSetCookie (3052 ms) 2024-09-14T11:12:09.921 INFO:tasks.workunit.client.0.smithi138.stdout:[ RUN ] ClsLock.TestRenew 2024-09-14T11:12:30.866 INFO:tasks.workunit.client.0.smithi138.stdout:[ OK ] ClsLock.TestRenew (20944 ms) 2024-09-14T11:12:30.866 INFO:tasks.workunit.client.0.smithi138.stdout:[ RUN ] ClsLock.TestExclusiveEphemeralBasic 2024-09-14T11:12:37.849 INFO:tasks.workunit.client.0.smithi138.stdout:[ OK ] ClsLock.TestExclusiveEphemeralBasic (6981 ms) 2024-09-14T11:12:37.849 INFO:tasks.workunit.client.0.smithi138.stdout:[ RUN ] ClsLock.TestExclusiveEphemeralStealEphemeral 2024-09-14T11:12:45.882 INFO:tasks.workunit.client.0.smithi138.stdout:[ OK ] ClsLock.TestExclusiveEphemeralStealEphemeral (8035 ms) 2024-09-14T11:12:45.882 INFO:tasks.workunit.client.0.smithi138.stdout:[ RUN ] ClsLock.TestExclusiveEphemeralStealExclusive 2024-09-14T11:12:53.949 INFO:tasks.workunit.client.0.smithi138.stdout:[ OK ] ClsLock.TestExclusiveEphemeralStealExclusive (8063 ms) 2024-09-14T11:12:53.950 INFO:tasks.workunit.client.0.smithi138.stdout:[----------] 11 tests from ClsLock (70005 ms total) 2024-09-14T11:12:53.950 INFO:tasks.workunit.client.0.smithi138.stdout: 2024-09-14T11:12:53.950 INFO:tasks.workunit.client.0.smithi138.stdout:[----------] Global test environment tear-down 2024-09-14T11:12:53.950 INFO:tasks.workunit.client.0.smithi138.stdout:[==========] 11 tests from 1 test suite ran. (70005 ms total) 2024-09-14T11:12:53.950 INFO:tasks.workunit.client.0.smithi138.stdout:[ PASSED ] 11 tests. 2024-09-14T11:12:53.955 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-09-14T11:12:53.955 DEBUG:teuthology.orchestra.run.smithi138:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-09-14T11:12:54.012 INFO:tasks.workunit:Running workunits matching cls/test_cls_log.sh on client.0... 2024-09-14T11:12:54.013 INFO:tasks.workunit:Running workunit cls/test_cls_log.sh... 2024-09-14T11:12:54.014 DEBUG:teuthology.orchestra.run.smithi138:workunit test cls/test_cls_log.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=1c941a66c1b420259b8fc5ac19e792dbbf60aded TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/cls/test_cls_log.sh 2024-09-14T11:12:54.077 INFO:tasks.workunit.client.0.smithi138.stdout:Running main() from gmock_main.cc 2024-09-14T11:12:54.077 INFO:tasks.workunit.client.0.smithi138.stdout:[==========] Running 4 tests from 1 test suite. 2024-09-14T11:12:54.077 INFO:tasks.workunit.client.0.smithi138.stdout:[----------] Global test environment set-up. 2024-09-14T11:12:54.077 INFO:tasks.workunit.client.0.smithi138.stdout:[----------] 4 tests from cls_log 2024-09-14T11:12:54.077 INFO:tasks.workunit.client.0.smithi138.stdout:[ RUN ] cls_log.test_log_add_same_time 2024-09-14T11:12:56.979 INFO:tasks.workunit.client.0.smithi138.stdout:[ OK ] cls_log.test_log_add_same_time (2902 ms) 2024-09-14T11:12:56.980 INFO:tasks.workunit.client.0.smithi138.stdout:[ RUN ] cls_log.test_log_add_different_time 2024-09-14T11:13:00.023 INFO:tasks.workunit.client.0.smithi138.stdout:[ OK ] cls_log.test_log_add_different_time (3044 ms) 2024-09-14T11:13:00.023 INFO:tasks.workunit.client.0.smithi138.stdout:[ RUN ] cls_log.trim_by_time 2024-09-14T11:13:03.044 INFO:tasks.workunit.client.0.smithi138.stdout:[ OK ] cls_log.trim_by_time (3020 ms) 2024-09-14T11:13:03.044 INFO:tasks.workunit.client.0.smithi138.stdout:[ RUN ] cls_log.trim_by_marker 2024-09-14T11:13:06.105 INFO:tasks.workunit.client.0.smithi138.stdout:[ OK ] cls_log.trim_by_marker (3056 ms) 2024-09-14T11:13:06.105 INFO:tasks.workunit.client.0.smithi138.stdout:[----------] 4 tests from cls_log (12022 ms total) 2024-09-14T11:13:06.105 INFO:tasks.workunit.client.0.smithi138.stdout: 2024-09-14T11:13:06.105 INFO:tasks.workunit.client.0.smithi138.stdout:[----------] Global test environment tear-down 2024-09-14T11:13:06.105 INFO:tasks.workunit.client.0.smithi138.stdout:[==========] 4 tests from 1 test suite ran. (12023 ms total) 2024-09-14T11:13:06.105 INFO:tasks.workunit.client.0.smithi138.stdout:[ PASSED ] 4 tests. 2024-09-14T11:13:06.106 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-09-14T11:13:06.106 DEBUG:teuthology.orchestra.run.smithi138:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-09-14T11:13:06.159 INFO:tasks.workunit:Running workunits matching cls/test_cls_refcount.sh on client.0... 2024-09-14T11:13:06.160 INFO:tasks.workunit:Running workunit cls/test_cls_refcount.sh... 2024-09-14T11:13:06.160 DEBUG:teuthology.orchestra.run.smithi138:workunit test cls/test_cls_refcount.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=1c941a66c1b420259b8fc5ac19e792dbbf60aded TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/cls/test_cls_refcount.sh 2024-09-14T11:13:06.225 INFO:tasks.workunit.client.0.smithi138.stdout:Running main() from gmock_main.cc 2024-09-14T11:13:06.225 INFO:tasks.workunit.client.0.smithi138.stdout:[==========] Running 10 tests from 1 test suite. 2024-09-14T11:13:06.225 INFO:tasks.workunit.client.0.smithi138.stdout:[----------] Global test environment set-up. 2024-09-14T11:13:06.225 INFO:tasks.workunit.client.0.smithi138.stdout:[----------] 10 tests from cls_refcount 2024-09-14T11:13:06.225 INFO:tasks.workunit.client.0.smithi138.stdout:[ RUN ] cls_refcount.test_implicit 2024-09-14T11:13:09.137 INFO:tasks.workunit.client.0.smithi138.stdout:[ OK ] cls_refcount.test_implicit (2912 ms) 2024-09-14T11:13:09.137 INFO:tasks.workunit.client.0.smithi138.stdout:[ RUN ] cls_refcount.test_implicit_idempotent 2024-09-14T11:13:12.178 INFO:tasks.workunit.client.0.smithi138.stdout:[ OK ] cls_refcount.test_implicit_idempotent (3037 ms) 2024-09-14T11:13:12.178 INFO:tasks.workunit.client.0.smithi138.stdout:[ RUN ] cls_refcount.test_put_snap 2024-09-14T11:13:20.918 INFO:tasks.workunit.client.0.smithi138.stdout:[ OK ] cls_refcount.test_put_snap (8743 ms) 2024-09-14T11:13:20.918 INFO:tasks.workunit.client.0.smithi138.stdout:[ RUN ] cls_refcount.test_explicit 2024-09-14T11:13:23.925 INFO:tasks.workunit.client.0.smithi138.stdout:[ OK ] cls_refcount.test_explicit (3007 ms) 2024-09-14T11:13:23.925 INFO:tasks.workunit.client.0.smithi138.stdout:[ RUN ] cls_refcount.set 2024-09-14T11:13:26.972 INFO:tasks.workunit.client.0.smithi138.stdout:[ OK ] cls_refcount.set (3048 ms) 2024-09-14T11:13:26.972 INFO:tasks.workunit.client.0.smithi138.stdout:[ RUN ] cls_refcount.test_implicit_ec 2024-09-14T11:13:33.993 INFO:tasks.workunit.client.0.smithi138.stdout:[ OK ] cls_refcount.test_implicit_ec (7021 ms) 2024-09-14T11:13:33.993 INFO:tasks.workunit.client.0.smithi138.stdout:[ RUN ] cls_refcount.test_implicit_idempotent_ec 2024-09-14T11:13:41.076 INFO:tasks.workunit.client.0.smithi138.stdout:[ OK ] cls_refcount.test_implicit_idempotent_ec (7083 ms) 2024-09-14T11:13:41.076 INFO:tasks.workunit.client.0.smithi138.stdout:[ RUN ] cls_refcount.test_put_snap_ec 2024-09-14T11:13:53.181 INFO:tasks.workunit.client.0.smithi138.stdout:[ OK ] cls_refcount.test_put_snap_ec (12106 ms) 2024-09-14T11:13:53.182 INFO:tasks.workunit.client.0.smithi138.stdout:[ RUN ] cls_refcount.test_explicit_ec 2024-09-14T11:14:00.293 INFO:tasks.workunit.client.0.smithi138.stdout:[ OK ] cls_refcount.test_explicit_ec (7111 ms) 2024-09-14T11:14:00.293 INFO:tasks.workunit.client.0.smithi138.stdout:[ RUN ] cls_refcount.set_ec 2024-09-14T11:14:07.356 INFO:tasks.workunit.client.0.smithi138.stdout:[ OK ] cls_refcount.set_ec (7063 ms) 2024-09-14T11:14:07.356 INFO:tasks.workunit.client.0.smithi138.stdout:[----------] 10 tests from cls_refcount (61131 ms total) 2024-09-14T11:14:07.356 INFO:tasks.workunit.client.0.smithi138.stdout: 2024-09-14T11:14:07.356 INFO:tasks.workunit.client.0.smithi138.stdout:[----------] Global test environment tear-down 2024-09-14T11:14:07.356 INFO:tasks.workunit.client.0.smithi138.stdout:[==========] 10 tests from 1 test suite ran. (61131 ms total) 2024-09-14T11:14:07.356 INFO:tasks.workunit.client.0.smithi138.stdout:[ PASSED ] 10 tests. 2024-09-14T11:14:07.361 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-09-14T11:14:07.361 DEBUG:teuthology.orchestra.run.smithi138:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-09-14T11:14:07.417 INFO:tasks.workunit:Running workunits matching cls/test_cls_rgw.sh on client.0... 2024-09-14T11:14:07.418 INFO:tasks.workunit:Running workunit cls/test_cls_rgw.sh... 2024-09-14T11:14:07.418 DEBUG:teuthology.orchestra.run.smithi138:workunit test cls/test_cls_rgw.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=1c941a66c1b420259b8fc5ac19e792dbbf60aded TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/cls/test_cls_rgw.sh 2024-09-14T11:14:07.487 INFO:tasks.workunit.client.0.smithi138.stdout:Running main() from gmock_main.cc 2024-09-14T11:14:07.487 INFO:tasks.workunit.client.0.smithi138.stdout:[==========] Running 18 tests from 1 test suite. 2024-09-14T11:14:07.487 INFO:tasks.workunit.client.0.smithi138.stdout:[----------] Global test environment set-up. 2024-09-14T11:14:07.487 INFO:tasks.workunit.client.0.smithi138.stdout:[----------] 18 tests from cls_rgw 2024-09-14T11:14:09.368 INFO:tasks.workunit.client.0.smithi138.stdout:[ RUN ] cls_rgw.index_basic 2024-09-14T11:14:09.445 INFO:tasks.workunit.client.0.smithi138.stdout:[ OK ] cls_rgw.index_basic (78 ms) 2024-09-14T11:14:09.445 INFO:tasks.workunit.client.0.smithi138.stdout:[ RUN ] cls_rgw.index_multiple_obj_writers 2024-09-14T11:14:09.530 INFO:tasks.workunit.client.0.smithi138.stdout:[ OK ] cls_rgw.index_multiple_obj_writers (84 ms) 2024-09-14T11:14:09.530 INFO:tasks.workunit.client.0.smithi138.stdout:[ RUN ] cls_rgw.index_remove_object 2024-09-14T11:14:09.645 INFO:tasks.workunit.client.0.smithi138.stdout:[ OK ] cls_rgw.index_remove_object (115 ms) 2024-09-14T11:14:09.645 INFO:tasks.workunit.client.0.smithi138.stdout:[ RUN ] cls_rgw.index_suggest 2024-09-14T11:14:12.128 INFO:tasks.workunit.client.0.smithi138.stdout:[ OK ] cls_rgw.index_suggest (2483 ms) 2024-09-14T11:14:12.129 INFO:tasks.workunit.client.0.smithi138.stdout:[ RUN ] cls_rgw.index_suggest_complete 2024-09-14T11:14:12.142 INFO:tasks.workunit.client.0.smithi138.stdout:[ OK ] cls_rgw.index_suggest_complete (15 ms) 2024-09-14T11:14:12.143 INFO:tasks.workunit.client.0.smithi138.stdout:[ RUN ] cls_rgw.index_list 2024-09-14T11:14:12.195 INFO:tasks.workunit.client.0.smithi138.stdout:[ OK ] cls_rgw.index_list (52 ms) 2024-09-14T11:14:12.195 INFO:tasks.workunit.client.0.smithi138.stdout:[ RUN ] cls_rgw.index_list_delimited 2024-09-14T11:14:54.228 INFO:tasks.workunit.client.0.smithi138.stdout:[ OK ] cls_rgw.index_list_delimited (42034 ms) 2024-09-14T11:14:54.229 INFO:tasks.workunit.client.0.smithi138.stdout:[ RUN ] cls_rgw.bi_list 2024-09-14T11:14:54.374 INFO:tasks.workunit.client.0.smithi138.stdout:[ OK ] cls_rgw.bi_list (147 ms) 2024-09-14T11:14:54.375 INFO:tasks.workunit.client.0.smithi138.stdout:[ RUN ] cls_rgw.gc_set 2024-09-14T11:14:54.394 INFO:tasks.workunit.client.0.smithi138.stdout:[ OK ] cls_rgw.gc_set (19 ms) 2024-09-14T11:14:54.394 INFO:tasks.workunit.client.0.smithi138.stdout:[ RUN ] cls_rgw.gc_list 2024-09-14T11:14:54.414 INFO:tasks.workunit.client.0.smithi138.stdout:[ OK ] cls_rgw.gc_list (20 ms) 2024-09-14T11:14:54.414 INFO:tasks.workunit.client.0.smithi138.stdout:[ RUN ] cls_rgw.gc_defer 2024-09-14T11:15:01.921 INFO:tasks.workunit.client.0.smithi138.stdout:[ OK ] cls_rgw.gc_defer (7507 ms) 2024-09-14T11:15:01.921 INFO:tasks.workunit.client.0.smithi138.stdout:[ RUN ] cls_rgw.usage_basic 2024-09-14T11:15:02.131 INFO:tasks.workunit.client.0.smithi138.stdout:[ OK ] cls_rgw.usage_basic (210 ms) 2024-09-14T11:15:02.132 INFO:tasks.workunit.client.0.smithi138.stdout:[ RUN ] cls_rgw.usage_clear_no_obj 2024-09-14T11:15:02.134 INFO:tasks.workunit.client.0.smithi138.stdout:[ OK ] cls_rgw.usage_clear_no_obj (3 ms) 2024-09-14T11:15:02.134 INFO:tasks.workunit.client.0.smithi138.stdout:[ RUN ] cls_rgw.usage_clear 2024-09-14T11:15:02.359 INFO:tasks.workunit.client.0.smithi138.stdout:[ OK ] cls_rgw.usage_clear (225 ms) 2024-09-14T11:15:02.359 INFO:tasks.workunit.client.0.smithi138.stdout:[ RUN ] cls_rgw.bi_log_trim 2024-09-14T11:15:02.485 INFO:tasks.workunit.client.0.smithi138.stdout:[ OK ] cls_rgw.bi_log_trim (126 ms) 2024-09-14T11:15:02.485 INFO:tasks.workunit.client.0.smithi138.stdout:[ RUN ] cls_rgw.index_racing_removes 2024-09-14T11:15:02.517 INFO:tasks.workunit.client.0.smithi138.stdout:[ OK ] cls_rgw.index_racing_removes (32 ms) 2024-09-14T11:15:02.518 INFO:tasks.workunit.client.0.smithi138.stdout:[ RUN ] cls_rgw.reshardlog_list 2024-09-14T11:15:02.559 INFO:tasks.workunit.client.0.smithi138.stdout:[ OK ] cls_rgw.reshardlog_list (42 ms) 2024-09-14T11:15:02.559 INFO:tasks.workunit.client.0.smithi138.stdout:[ RUN ] cls_rgw.reshardlog_num 2024-09-14T11:15:02.586 INFO:tasks.workunit.client.0.smithi138.stdout:[ OK ] cls_rgw.reshardlog_num (27 ms) 2024-09-14T11:15:02.935 INFO:tasks.workunit.client.0.smithi138.stdout:[----------] 18 tests from cls_rgw (53219 ms total) 2024-09-14T11:15:02.935 INFO:tasks.workunit.client.0.smithi138.stdout: 2024-09-14T11:15:02.936 INFO:tasks.workunit.client.0.smithi138.stdout:[----------] Global test environment tear-down 2024-09-14T11:15:02.936 INFO:tasks.workunit.client.0.smithi138.stdout:[==========] 18 tests from 1 test suite ran. (55449 ms total) 2024-09-14T11:15:02.936 INFO:tasks.workunit.client.0.smithi138.stdout:[ PASSED ] 18 tests. 2024-09-14T11:15:02.948 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-09-14T11:15:02.948 DEBUG:teuthology.orchestra.run.smithi138:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-09-14T11:15:03.000 INFO:tasks.workunit:Running workunits matching cls/test_cls_rgw_gc.sh on client.0... 2024-09-14T11:15:03.001 INFO:tasks.workunit:Running workunit cls/test_cls_rgw_gc.sh... 2024-09-14T11:15:03.002 DEBUG:teuthology.orchestra.run.smithi138:workunit test cls/test_cls_rgw_gc.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=1c941a66c1b420259b8fc5ac19e792dbbf60aded TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/cls/test_cls_rgw_gc.sh 2024-09-14T11:15:03.143 INFO:tasks.workunit.client.0.smithi138.stdout:Running main() from gmock_main.cc 2024-09-14T11:15:03.143 INFO:tasks.workunit.client.0.smithi138.stdout:[==========] Running 9 tests from 1 test suite. 2024-09-14T11:15:03.143 INFO:tasks.workunit.client.0.smithi138.stdout:[----------] Global test environment set-up. 2024-09-14T11:15:03.143 INFO:tasks.workunit.client.0.smithi138.stdout:[----------] 9 tests from cls_rgw_gc 2024-09-14T11:15:03.143 INFO:tasks.workunit.client.0.smithi138.stdout:[ RUN ] cls_rgw_gc.init 2024-09-14T11:15:04.935 INFO:tasks.workunit.client.0.smithi138.stdout:[ OK ] cls_rgw_gc.init (1792 ms) 2024-09-14T11:15:04.935 INFO:tasks.workunit.client.0.smithi138.stdout:[ RUN ] cls_rgw_gc.gc_queue_ops1 2024-09-14T11:15:04.969 INFO:tasks.workunit.client.0.smithi138.stderr:[ ] list info tag = chain-0 2024-09-14T11:15:04.969 INFO:tasks.workunit.client.0.smithi138.stdout:[ OK ] cls_rgw_gc.gc_queue_ops1 (34 ms) 2024-09-14T11:15:04.969 INFO:tasks.workunit.client.0.smithi138.stdout:[ RUN ] cls_rgw_gc.gc_queue_ops2 2024-09-14T11:15:04.981 INFO:tasks.workunit.client.0.smithi138.stderr:[ ] next_marker is: = 0/4263 2024-09-14T11:15:04.981 INFO:tasks.workunit.client.0.smithi138.stdout:[ OK ] cls_rgw_gc.gc_queue_ops2 (13 ms) 2024-09-14T11:15:04.981 INFO:tasks.workunit.client.0.smithi138.stdout:[ RUN ] cls_rgw_gc.gc_queue_ops5 2024-09-14T11:15:04.996 INFO:tasks.workunit.client.0.smithi138.stdout:[ OK ] cls_rgw_gc.gc_queue_ops5 (14 ms) 2024-09-14T11:15:04.996 INFO:tasks.workunit.client.0.smithi138.stdout:[ RUN ] cls_rgw_gc.gc_queue_ops6 2024-09-14T11:15:05.255 INFO:tasks.workunit.client.0.smithi138.stdout:[ OK ] cls_rgw_gc.gc_queue_ops6 (259 ms) 2024-09-14T11:15:05.255 INFO:tasks.workunit.client.0.smithi138.stdout:[ RUN ] cls_rgw_gc.gc_queue_ops7 2024-09-14T11:15:05.797 INFO:tasks.workunit.client.0.smithi138.stdout:[ OK ] cls_rgw_gc.gc_queue_ops7 (542 ms) 2024-09-14T11:15:05.797 INFO:tasks.workunit.client.0.smithi138.stdout:[ RUN ] cls_rgw_gc.gc_queue_ops8 2024-09-14T11:15:05.816 INFO:tasks.workunit.client.0.smithi138.stdout:[ OK ] cls_rgw_gc.gc_queue_ops8 (20 ms) 2024-09-14T11:15:05.817 INFO:tasks.workunit.client.0.smithi138.stdout:[ RUN ] cls_rgw_gc.gc_queue_ops9 2024-09-14T11:15:05.834 INFO:tasks.workunit.client.0.smithi138.stdout:[ OK ] cls_rgw_gc.gc_queue_ops9 (17 ms) 2024-09-14T11:15:05.834 INFO:tasks.workunit.client.0.smithi138.stdout:[ RUN ] cls_rgw_gc.finalize 2024-09-14T11:15:05.941 INFO:tasks.workunit.client.0.smithi138.stdout:[ OK ] cls_rgw_gc.finalize (107 ms) 2024-09-14T11:15:05.941 INFO:tasks.workunit.client.0.smithi138.stdout:[----------] 9 tests from cls_rgw_gc (2798 ms total) 2024-09-14T11:15:05.941 INFO:tasks.workunit.client.0.smithi138.stdout: 2024-09-14T11:15:05.941 INFO:tasks.workunit.client.0.smithi138.stdout:[----------] Global test environment tear-down 2024-09-14T11:15:05.941 INFO:tasks.workunit.client.0.smithi138.stdout:[==========] 9 tests from 1 test suite ran. (2798 ms total) 2024-09-14T11:15:05.941 INFO:tasks.workunit.client.0.smithi138.stdout:[ PASSED ] 9 tests. 2024-09-14T11:15:05.948 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-09-14T11:15:05.948 DEBUG:teuthology.orchestra.run.smithi138:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-09-14T11:15:05.963 INFO:tasks.workunit:Running workunits matching cls/test_cls_rgw_stats.sh on client.0... 2024-09-14T11:15:05.964 INFO:tasks.workunit:Running workunit cls/test_cls_rgw_stats.sh... 2024-09-14T11:15:05.964 DEBUG:teuthology.orchestra.run.smithi138:workunit test cls/test_cls_rgw_stats.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=1c941a66c1b420259b8fc5ac19e792dbbf60aded TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/cls/test_cls_rgw_stats.sh 2024-09-14T11:15:06.038 INFO:tasks.workunit.client.0.smithi138.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:15:06.038 INFO:tasks.workunit.client.0.smithi138.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:15:06.039 INFO:tasks.workunit.client.0.smithi138.stdout:[==========] Running 1 test from 1 test suite. 2024-09-14T11:15:06.039 INFO:tasks.workunit.client.0.smithi138.stdout:[----------] Global test environment set-up. 2024-09-14T11:15:07.964 INFO:tasks.workunit.client.0.smithi138.stdout:[----------] 1 test from cls_rgw_stats 2024-09-14T11:15:07.964 INFO:tasks.workunit.client.0.smithi138.stdout:[ RUN ] cls_rgw_stats.simulate 2024-09-14T11:15:08.002 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:08.004+0000 7f76c1e8a8c0 1 > prepared operation key=S43U13LYETS4 tag=QZB0Y2CRXC0J type=del size=1308410 2024-09-14T11:15:08.006 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:08.008+0000 7f76c1e8a8c0 1 > prepared operation key=HJ701768A6I7 tag=4RTY9M9OGM9G type=write size=360060 2024-09-14T11:15:08.010 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:08.012+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_SUNCRV0C1XYL.2~WSODBIASTYF9.0 size=1048576 2024-09-14T11:15:08.012 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:08.012+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_SUNCRV0C1XYL.2~WSODBIASTYF9.1 size=1048576 2024-09-14T11:15:08.013 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:08.016+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_SUNCRV0C1XYL.2~WSODBIASTYF9.2 size=47302 2024-09-14T11:15:08.013 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:08.016+0000 7f76c1e8a8c0 1 > prepared multipart upload key=SUNCRV0C1XYL upload=WSODBIASTYF9 tag=HXHXJADUSZN5 type=write size=3193030 2024-09-14T11:15:08.015 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:08.016+0000 7f76c1e8a8c0 1 > prepared operation key=F3KFS0P1WM7W tag=V6P15Y6XPSO0 type=del size=4016471 2024-09-14T11:15:08.019 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:08.020+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_K2EEZLRK7MVO.2~R0KK2N5AZO2M.0 size=1048576 2024-09-14T11:15:08.021 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:08.024+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_K2EEZLRK7MVO.2~R0KK2N5AZO2M.1 size=488138 2024-09-14T11:15:08.021 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:08.024+0000 7f76c1e8a8c0 1 > prepared multipart upload key=K2EEZLRK7MVO upload=R0KK2N5AZO2M tag=7YCGTS35GHQY type=write size=2585290 2024-09-14T11:15:08.025 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:08.028+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_K9W031V6BFJP.2~5TLITRL6TH37.0 size=319383 2024-09-14T11:15:08.025 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:08.028+0000 7f76c1e8a8c0 1 > prepared multipart upload key=K9W031V6BFJP upload=5TLITRL6TH37 tag=WAKD477UNKRI type=write size=1367959 2024-09-14T11:15:08.029 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:08.032+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_1K8ESNXU6WDF.2~ILFRCN896AA1.0 size=1048576 2024-09-14T11:15:08.031 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:08.032+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_1K8ESNXU6WDF.2~ILFRCN896AA1.1 size=361125 2024-09-14T11:15:08.031 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:08.032+0000 7f76c1e8a8c0 1 > prepared multipart upload key=1K8ESNXU6WDF upload=ILFRCN896AA1 tag=C3V006ZP0MPX type=write size=2458277 2024-09-14T11:15:08.033 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:08.036+0000 7f76c1e8a8c0 1 > prepared operation key=TUFOZKTV9XIH tag=FEWAIVRMNJC2 type=write size=284647 2024-09-14T11:15:08.037 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:08.040+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_OUMUTEBQ1TD0.2~0SY7MPVF0EKU.0 size=1048576 2024-09-14T11:15:08.038 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:08.040+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_OUMUTEBQ1TD0.2~0SY7MPVF0EKU.1 size=300023 2024-09-14T11:15:08.038 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:08.040+0000 7f76c1e8a8c0 1 > prepared multipart upload key=OUMUTEBQ1TD0 upload=0SY7MPVF0EKU tag=W21V5B4C88YK type=write size=2397175 2024-09-14T11:15:08.040 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:08.044+0000 7f76c1e8a8c0 1 > prepared operation key=K2EEZLRK7MVO tag=5EJJ6NR3R48Q type=del size=2029743 2024-09-14T11:15:08.042 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:08.044+0000 7f76c1e8a8c0 1 > prepared operation key=Q5IY4J5FOD80 tag=IYERVJI5O6RI type=del size=2276811 2024-09-14T11:15:08.047 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:08.048+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_MEVTZ7OAD4CA.2~JLTEA54YU2YS.0 size=224190 2024-09-14T11:15:08.047 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:08.048+0000 7f76c1e8a8c0 1 > prepared multipart upload key=MEVTZ7OAD4CA upload=JLTEA54YU2YS tag=FECARTOBQ4QW type=write size=1272766 2024-09-14T11:15:08.050 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:08.052+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_GAVZRU8ZLW7S.2~KL1WRYCIN0D8.0 size=263677 2024-09-14T11:15:08.050 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:08.052+0000 7f76c1e8a8c0 1 > prepared multipart upload key=GAVZRU8ZLW7S upload=KL1WRYCIN0D8 tag=ZN140BP3XTWC type=write size=1312253 2024-09-14T11:15:08.053 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:08.056+0000 7f76c1e8a8c0 1 > prepared operation key=LZ0YNFOVFYCL tag=7XA4UR42A9EB type=write size=363347 2024-09-14T11:15:08.059 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:08.060+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_KS37ZO6MKAH9.2~9FC69JCDO15J.0 size=295988 2024-09-14T11:15:08.059 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:08.060+0000 7f76c1e8a8c0 1 > prepared multipart upload key=KS37ZO6MKAH9 upload=9FC69JCDO15J tag=4FHWQBBXZ6EJ type=write size=1344564 2024-09-14T11:15:08.062 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:08.064+0000 7f76c1e8a8c0 1 > prepared operation key=8PZOVFEYYSOG tag=LYX29H2RF9NA type=del size=3545829 2024-09-14T11:15:08.065 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:08.068+0000 7f76c1e8a8c0 1 < completed delete operation key=S43U13LYETS4 tag=QZB0Y2CRXC0J type=del 2024-09-14T11:15:08.070 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:08.072+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_F3KFS0P1WM7W.2~XUB936LARKD9.0 size=1048576 2024-09-14T11:15:08.073 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:08.076+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_F3KFS0P1WM7W.2~XUB936LARKD9.1 size=1048576 2024-09-14T11:15:08.076 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:08.076+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_F3KFS0P1WM7W.2~XUB936LARKD9.2 size=703829 2024-09-14T11:15:08.076 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:08.076+0000 7f76c1e8a8c0 1 > prepared multipart upload key=F3KFS0P1WM7W upload=XUB936LARKD9 tag=ZIREZ5WWPXKA type=write size=3849557 2024-09-14T11:15:08.079 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:08.080+0000 7f76c1e8a8c0 1 < completed write operation key=HJ701768A6I7 tag=4RTY9M9OGM9G type=write size=360060 2024-09-14T11:15:08.083 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:08.084+0000 7f76c1e8a8c0 1 > prepared operation key=GZM0AQVHNCMM tag=JJANQD0WRINP type=del size=2129300 2024-09-14T11:15:08.086 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:08.088+0000 7f76c1e8a8c0 1 < completed part key=_multipart_SUNCRV0C1XYL.2~WSODBIASTYF9.0 size=1048576 2024-09-14T11:15:08.089 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:08.092+0000 7f76c1e8a8c0 1 < completed part key=_multipart_SUNCRV0C1XYL.2~WSODBIASTYF9.1 size=1048576 2024-09-14T11:15:08.092 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:08.092+0000 7f76c1e8a8c0 1 < completed part key=_multipart_SUNCRV0C1XYL.2~WSODBIASTYF9.2 size=47302 2024-09-14T11:15:08.098 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:08.100+0000 7f76c1e8a8c0 1 < completed multipart upload key=SUNCRV0C1XYL upload=WSODBIASTYF9 tag=HXHXJADUSZN5 type=write size=3193030 2024-09-14T11:15:08.102 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:08.104+0000 7f76c1e8a8c0 1 > prepared operation key=S43U13LYETS4 tag=KYL3LUQXUPRA type=del size=336416 2024-09-14T11:15:08.106 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:08.108+0000 7f76c1e8a8c0 1 < completed delete operation key=F3KFS0P1WM7W tag=V6P15Y6XPSO0 type=del 2024-09-14T11:15:08.109 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:08.112+0000 7f76c1e8a8c0 1 > prepared operation key=KS37ZO6MKAH9 tag=MBJ7PJ53R3OB type=del size=2310405 2024-09-14T11:15:08.112 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:08.116+0000 7f76c1e8a8c0 1 < completed part key=_multipart_K2EEZLRK7MVO.2~R0KK2N5AZO2M.0 size=1048576 2024-09-14T11:15:08.112 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:08.116+0000 7f76c1e8a8c0 1 < canceled part key=_multipart_K2EEZLRK7MVO.2~R0KK2N5AZO2M.1 size=488138 2024-09-14T11:15:08.118 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:08.120+0000 7f76c1e8a8c0 1 < canceled multipart upload key=K2EEZLRK7MVO upload=R0KK2N5AZO2M tag=7YCGTS35GHQY type=write size=2585290 2024-09-14T11:15:08.124 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:08.124+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_K9W031V6BFJP.2~T2OYLFYAFNZB.0 size=441717 2024-09-14T11:15:08.124 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:08.124+0000 7f76c1e8a8c0 1 > prepared multipart upload key=K9W031V6BFJP upload=T2OYLFYAFNZB tag=97EWL1JL1WHW type=write size=1490293 2024-09-14T11:15:08.125 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:08.128+0000 7f76c1e8a8c0 1 < canceled part key=_multipart_K9W031V6BFJP.2~5TLITRL6TH37.0 size=319383 2024-09-14T11:15:08.130 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:08.132+0000 7f76c1e8a8c0 1 < canceled multipart upload key=K9W031V6BFJP upload=5TLITRL6TH37 tag=WAKD477UNKRI type=write size=1367959 2024-09-14T11:15:08.136 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:08.136+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_BOCIF4TL7X7J.2~A21EPFJFACH6.0 size=803772 2024-09-14T11:15:08.136 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:08.136+0000 7f76c1e8a8c0 1 > prepared multipart upload key=BOCIF4TL7X7J upload=A21EPFJFACH6 tag=5YDM1FAM85HR type=write size=1852348 2024-09-14T11:15:08.137 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:08.140+0000 7f76c1e8a8c0 1 < canceled part key=_multipart_1K8ESNXU6WDF.2~ILFRCN896AA1.0 size=1048576 2024-09-14T11:15:08.139 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:08.140+0000 7f76c1e8a8c0 1 < completed part key=_multipart_1K8ESNXU6WDF.2~ILFRCN896AA1.1 size=361125 2024-09-14T11:15:08.144 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:08.144+0000 7f76c1e8a8c0 1 < canceled multipart upload key=1K8ESNXU6WDF upload=ILFRCN896AA1 tag=C3V006ZP0MPX type=write size=2458277 2024-09-14T11:15:08.147 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:08.148+0000 7f76c1e8a8c0 1 > prepared operation key=GZM0AQVHNCMM tag=LKRVGBMLXCHO type=del size=4001660 2024-09-14T11:15:08.150 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:08.152+0000 7f76c1e8a8c0 1 < completed write operation key=TUFOZKTV9XIH tag=FEWAIVRMNJC2 type=write size=284647 2024-09-14T11:15:08.154 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:08.156+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_CIRQT9IDJ5OJ.2~CMFCR4Q5N5MP.0 size=185840 2024-09-14T11:15:08.155 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:08.156+0000 7f76c1e8a8c0 1 > prepared multipart upload key=CIRQT9IDJ5OJ upload=CMFCR4Q5N5MP tag=IEPP3SFEDJNW type=write size=1234416 2024-09-14T11:15:08.158 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:08.160+0000 7f76c1e8a8c0 1 < completed part key=_multipart_OUMUTEBQ1TD0.2~0SY7MPVF0EKU.0 size=1048576 2024-09-14T11:15:08.160 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:08.164+0000 7f76c1e8a8c0 1 < completed part key=_multipart_OUMUTEBQ1TD0.2~0SY7MPVF0EKU.1 size=300023 2024-09-14T11:15:08.165 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:08.168+0000 7f76c1e8a8c0 1 < completed multipart upload key=OUMUTEBQ1TD0 upload=0SY7MPVF0EKU tag=W21V5B4C88YK type=write size=2397175 2024-09-14T11:15:08.169 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:08.172+0000 7f76c1e8a8c0 1 > prepared operation key=TZO40K6J9877 tag=7LJBG1SL76QE type=del size=426100 2024-09-14T11:15:08.172 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:08.172+0000 7f76c1e8a8c0 1 < canceled operation key=K2EEZLRK7MVO tag=5EJJ6NR3R48Q type=del size=2029743 2024-09-14T11:15:08.176 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:08.180+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_S43U13LYETS4.2~HUCECJNSHPTH.0 size=1048576 2024-09-14T11:15:08.178 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:08.180+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_S43U13LYETS4.2~HUCECJNSHPTH.1 size=1048576 2024-09-14T11:15:08.180 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:08.184+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_S43U13LYETS4.2~HUCECJNSHPTH.2 size=641007 2024-09-14T11:15:08.180 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:08.184+0000 7f76c1e8a8c0 1 > prepared multipart upload key=S43U13LYETS4 upload=HUCECJNSHPTH tag=KBFPL9YKYQE0 type=write size=3786735 2024-09-14T11:15:08.185 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:08.188+0000 7f76c1e8a8c0 1 < suggested update operation key=Q5IY4J5FOD80 tag=IYERVJI5O6RI type=del size=2276811 2024-09-14T11:15:08.187 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:08.188+0000 7f76c1e8a8c0 1 > prepared operation key=K2EEZLRK7MVO tag=6XAG5B6UV4SM type=write size=418224 2024-09-14T11:15:08.190 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:08.192+0000 7f76c1e8a8c0 1 < completed part key=_multipart_MEVTZ7OAD4CA.2~JLTEA54YU2YS.0 size=224190 2024-09-14T11:15:08.195 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:08.196+0000 7f76c1e8a8c0 1 < completed multipart upload key=MEVTZ7OAD4CA upload=JLTEA54YU2YS tag=FECARTOBQ4QW type=write size=1272766 2024-09-14T11:15:08.197 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:08.200+0000 7f76c1e8a8c0 1 > prepared operation key=85G6NT78HAWQ tag=4ZXI0U5KHJBJ type=write size=136898 2024-09-14T11:15:08.405 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:08.408+0000 7f76c1e8a8c0 1 < completed part key=_multipart_GAVZRU8ZLW7S.2~KL1WRYCIN0D8.0 size=263677 2024-09-14T11:15:08.411 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:08.412+0000 7f76c1e8a8c0 1 < completed multipart upload key=GAVZRU8ZLW7S upload=KL1WRYCIN0D8 tag=ZN140BP3XTWC type=write size=1312253 2024-09-14T11:15:08.418 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:08.420+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_GAVZRU8ZLW7S.2~696MG5FGSAH7.0 size=687662 2024-09-14T11:15:08.418 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:08.420+0000 7f76c1e8a8c0 1 > prepared multipart upload key=GAVZRU8ZLW7S upload=696MG5FGSAH7 tag=HDOLKVCRDG22 type=write size=1736238 2024-09-14T11:15:08.422 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:08.424+0000 7f76c1e8a8c0 1 < completed write operation key=LZ0YNFOVFYCL tag=7XA4UR42A9EB type=write size=363347 2024-09-14T11:15:08.426 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:08.428+0000 7f76c1e8a8c0 1 > prepared operation key=SUNCRV0C1XYL tag=SY47USCN50CN type=write size=849355 2024-09-14T11:15:08.431 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:08.432+0000 7f76c1e8a8c0 1 < completed part key=_multipart_KS37ZO6MKAH9.2~9FC69JCDO15J.0 size=295988 2024-09-14T11:15:08.438 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:08.440+0000 7f76c1e8a8c0 1 < completed multipart upload key=KS37ZO6MKAH9 upload=9FC69JCDO15J tag=4FHWQBBXZ6EJ type=write size=1344564 2024-09-14T11:15:08.442 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:08.444+0000 7f76c1e8a8c0 1 > prepared operation key=BOCIF4TL7X7J tag=A21PO8JS870T type=del size=766198 2024-09-14T11:15:08.450 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:08.452+0000 7f76c1e8a8c0 1 < suggested remove operation key=8PZOVFEYYSOG tag=LYX29H2RF9NA type=del 2024-09-14T11:15:08.454 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:08.456+0000 7f76c1e8a8c0 1 > prepared operation key=TZO40K6J9877 tag=8UT14IXVYA38 type=del size=275981 2024-09-14T11:15:08.457 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:08.460+0000 7f76c1e8a8c0 1 < completed part key=_multipart_F3KFS0P1WM7W.2~XUB936LARKD9.0 size=1048576 2024-09-14T11:15:08.460 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:08.460+0000 7f76c1e8a8c0 1 < completed part key=_multipart_F3KFS0P1WM7W.2~XUB936LARKD9.1 size=1048576 2024-09-14T11:15:08.463 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:08.464+0000 7f76c1e8a8c0 1 < completed part key=_multipart_F3KFS0P1WM7W.2~XUB936LARKD9.2 size=703829 2024-09-14T11:15:08.469 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:08.472+0000 7f76c1e8a8c0 1 < completed multipart upload key=F3KFS0P1WM7W upload=XUB936LARKD9 tag=ZIREZ5WWPXKA type=write size=3849557 2024-09-14T11:15:08.476 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:08.476+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_K9W031V6BFJP.2~GL5L3CQDV60L.0 size=254219 2024-09-14T11:15:08.476 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:08.476+0000 7f76c1e8a8c0 1 > prepared multipart upload key=K9W031V6BFJP upload=GL5L3CQDV60L tag=SOISO85UXDS1 type=write size=1302795 2024-09-14T11:15:08.483 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:08.484+0000 7f76c1e8a8c0 1 < suggested remove operation key=GZM0AQVHNCMM tag=JJANQD0WRINP type=del 2024-09-14T11:15:08.489 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:08.492+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_HS7T50JORDQJ.2~BUEG2107GBUP.0 size=1048576 2024-09-14T11:15:08.492 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:08.496+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_HS7T50JORDQJ.2~BUEG2107GBUP.1 size=1048576 2024-09-14T11:15:08.495 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:08.496+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_HS7T50JORDQJ.2~BUEG2107GBUP.2 size=970696 2024-09-14T11:15:08.495 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:08.496+0000 7f76c1e8a8c0 1 > prepared multipart upload key=HS7T50JORDQJ upload=BUEG2107GBUP tag=IJFKSBFDC7SG type=write size=4116424 2024-09-14T11:15:08.498 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:08.500+0000 7f76c1e8a8c0 1 < completed delete operation key=S43U13LYETS4 tag=KYL3LUQXUPRA type=del 2024-09-14T11:15:08.505 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:08.508+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_HS7T50JORDQJ.2~T90010MCI43H.0 size=946748 2024-09-14T11:15:08.505 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:08.508+0000 7f76c1e8a8c0 1 > prepared multipart upload key=HS7T50JORDQJ upload=T90010MCI43H tag=G0VZ0Q8DY85N type=write size=1995324 2024-09-14T11:15:08.508 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:08.508+0000 7f76c1e8a8c0 1 < completed delete operation key=KS37ZO6MKAH9 tag=MBJ7PJ53R3OB type=del 2024-09-14T11:15:08.512 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:08.512+0000 7f76c1e8a8c0 1 > prepared operation key=H9CQV6L29SL5 tag=SNNM009AAMYW type=del size=3143890 2024-09-14T11:15:08.520 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:08.520+0000 7f76c1e8a8c0 1 < completed part key=_multipart_K9W031V6BFJP.2~T2OYLFYAFNZB.0 size=441717 2024-09-14T11:15:08.526 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:08.528+0000 7f76c1e8a8c0 1 < completed multipart upload key=K9W031V6BFJP upload=T2OYLFYAFNZB tag=97EWL1JL1WHW type=write size=1490293 2024-09-14T11:15:08.530 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:08.532+0000 7f76c1e8a8c0 1 > prepared operation key=XC8VWSHZOPFP tag=NMI2518HCS11 type=del size=133654 2024-09-14T11:15:08.533 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:08.536+0000 7f76c1e8a8c0 1 < completed part key=_multipart_BOCIF4TL7X7J.2~A21EPFJFACH6.0 size=803772 2024-09-14T11:15:08.538 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:08.540+0000 7f76c1e8a8c0 1 < completed multipart upload key=BOCIF4TL7X7J upload=A21EPFJFACH6 tag=5YDM1FAM85HR type=write size=1852348 2024-09-14T11:15:08.545 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:08.548+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_XC8VWSHZOPFP.2~LNQJ7XL82RDR.0 size=941207 2024-09-14T11:15:08.545 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:08.548+0000 7f76c1e8a8c0 1 > prepared multipart upload key=XC8VWSHZOPFP upload=LNQJ7XL82RDR tag=C3IC1D2XQYPG type=write size=1989783 2024-09-14T11:15:08.548 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:08.548+0000 7f76c1e8a8c0 -1 < failed to complete operation key=GZM0AQVHNCMM tag=LKRVGBMLXCHO type=del size=4001660: (22) Invalid argument 2024-09-14T11:15:08.551 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:08.552+0000 7f76c1e8a8c0 1 > prepared operation key=VI61O3K069BP tag=H7GG9LF6359U type=del size=3275053 2024-09-14T11:15:08.555 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:08.556+0000 7f76c1e8a8c0 1 < completed part key=_multipart_CIRQT9IDJ5OJ.2~CMFCR4Q5N5MP.0 size=185840 2024-09-14T11:15:08.560 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:08.560+0000 7f76c1e8a8c0 1 < completed multipart upload key=CIRQT9IDJ5OJ upload=CMFCR4Q5N5MP tag=IEPP3SFEDJNW type=write size=1234416 2024-09-14T11:15:08.564 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:08.564+0000 7f76c1e8a8c0 1 > prepared operation key=VI61O3K069BP tag=A3S1DXGC6BIZ type=del size=3231570 2024-09-14T11:15:08.567 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:08.568+0000 7f76c1e8a8c0 1 < completed delete operation key=TZO40K6J9877 tag=7LJBG1SL76QE type=del 2024-09-14T11:15:08.571 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:08.572+0000 7f76c1e8a8c0 1 > prepared operation key=S43U13LYETS4 tag=CFQWWT6OF18V type=del size=3392309 2024-09-14T11:15:08.574 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:08.576+0000 7f76c1e8a8c0 1 < completed part key=_multipart_S43U13LYETS4.2~HUCECJNSHPTH.0 size=1048576 2024-09-14T11:15:08.577 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:08.580+0000 7f76c1e8a8c0 1 < completed part key=_multipart_S43U13LYETS4.2~HUCECJNSHPTH.1 size=1048576 2024-09-14T11:15:08.579 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:08.580+0000 7f76c1e8a8c0 1 < completed part key=_multipart_S43U13LYETS4.2~HUCECJNSHPTH.2 size=641007 2024-09-14T11:15:08.585 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:08.588+0000 7f76c1e8a8c0 1 < completed multipart upload key=S43U13LYETS4 upload=HUCECJNSHPTH tag=KBFPL9YKYQE0 type=write size=3786735 2024-09-14T11:15:08.588 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:08.588+0000 7f76c1e8a8c0 1 > prepared operation key=H9CQV6L29SL5 tag=RT3XBQQOKM2S type=write size=287274 2024-09-14T11:15:08.591 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:08.592+0000 7f76c1e8a8c0 1 < completed write operation key=K2EEZLRK7MVO tag=6XAG5B6UV4SM type=write size=418224 2024-09-14T11:15:08.595 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:08.596+0000 7f76c1e8a8c0 1 > prepared operation key=SUNCRV0C1XYL tag=1E33JOZT2DSU type=del size=1905902 2024-09-14T11:15:08.601 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:08.604+0000 7f76c1e8a8c0 1 < suggested remove operation key=85G6NT78HAWQ tag=4ZXI0U5KHJBJ type=write 2024-09-14T11:15:08.605 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:08.608+0000 7f76c1e8a8c0 1 > prepared operation key=1K8ESNXU6WDF tag=QBMXVV0OZX16 type=del size=70928 2024-09-14T11:15:08.608 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:08.608+0000 7f76c1e8a8c0 1 < completed part key=_multipart_GAVZRU8ZLW7S.2~696MG5FGSAH7.0 size=687662 2024-09-14T11:15:08.614 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:08.616+0000 7f76c1e8a8c0 1 < completed multipart upload key=GAVZRU8ZLW7S upload=696MG5FGSAH7 tag=HDOLKVCRDG22 type=write size=1736238 2024-09-14T11:15:08.620 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:08.624+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_OOUEM16XL80W.2~2VUVMPQS40EL.0 size=708271 2024-09-14T11:15:08.620 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:08.624+0000 7f76c1e8a8c0 1 > prepared multipart upload key=OOUEM16XL80W upload=2VUVMPQS40EL tag=2HJDJWJVNT2V type=write size=1756847 2024-09-14T11:15:08.627 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:08.628+0000 7f76c1e8a8c0 1 < suggested update operation key=SUNCRV0C1XYL tag=SY47USCN50CN type=write size=849355 2024-09-14T11:15:08.631 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:08.632+0000 7f76c1e8a8c0 1 > prepared operation key=HS7T50JORDQJ tag=65X0D8U1EL11 type=del size=1659654 2024-09-14T11:15:08.635 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:08.636+0000 7f76c1e8a8c0 1 < completed delete operation key=BOCIF4TL7X7J tag=A21PO8JS870T type=del 2024-09-14T11:15:08.638 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:08.640+0000 7f76c1e8a8c0 1 > prepared operation key=85G6NT78HAWQ tag=FVZSSIJC6G9Y type=write size=302847 2024-09-14T11:15:08.646 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:08.648+0000 7f76c1e8a8c0 1 < suggested update operation key=TZO40K6J9877 tag=8UT14IXVYA38 type=del size=275981 2024-09-14T11:15:08.649 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:08.652+0000 7f76c1e8a8c0 1 > prepared operation key=W0MDRE9YO3UP tag=YKPA3AAYCB63 type=del size=87773 2024-09-14T11:15:08.650 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:08.652+0000 7f76c1e8a8c0 1 < canceled part key=_multipart_K9W031V6BFJP.2~GL5L3CQDV60L.0 size=254219 2024-09-14T11:15:08.655 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:08.656+0000 7f76c1e8a8c0 1 < canceled multipart upload key=K9W031V6BFJP upload=GL5L3CQDV60L tag=SOISO85UXDS1 type=write size=1302795 2024-09-14T11:15:08.659 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:08.660+0000 7f76c1e8a8c0 1 > prepared operation key=W0MDRE9YO3UP tag=SIFEXNXUZ1AU type=del size=1713106 2024-09-14T11:15:08.663 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:08.664+0000 7f76c1e8a8c0 1 < completed part key=_multipart_HS7T50JORDQJ.2~BUEG2107GBUP.0 size=1048576 2024-09-14T11:15:08.666 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:08.668+0000 7f76c1e8a8c0 1 < completed part key=_multipart_HS7T50JORDQJ.2~BUEG2107GBUP.1 size=1048576 2024-09-14T11:15:08.669 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:08.672+0000 7f76c1e8a8c0 1 < completed part key=_multipart_HS7T50JORDQJ.2~BUEG2107GBUP.2 size=970696 2024-09-14T11:15:08.674 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:08.676+0000 7f76c1e8a8c0 1 < completed multipart upload key=HS7T50JORDQJ upload=BUEG2107GBUP tag=IJFKSBFDC7SG type=write size=4116424 2024-09-14T11:15:08.678 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:08.680+0000 7f76c1e8a8c0 1 > prepared operation key=TZO40K6J9877 tag=I1UWIVXX59J5 type=del size=2528670 2024-09-14T11:15:08.682 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:08.684+0000 7f76c1e8a8c0 1 < completed part key=_multipart_HS7T50JORDQJ.2~T90010MCI43H.0 size=946748 2024-09-14T11:15:08.687 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:08.688+0000 7f76c1e8a8c0 1 < completed multipart upload key=HS7T50JORDQJ upload=T90010MCI43H tag=G0VZ0Q8DY85N type=write size=1995324 2024-09-14T11:15:08.691 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:08.692+0000 7f76c1e8a8c0 1 > prepared operation key=R5I9H7WAK7Z7 tag=4EZD6I3O949I type=del size=1146759 2024-09-14T11:15:08.698 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:08.700+0000 7f76c1e8a8c0 1 < suggested remove operation key=H9CQV6L29SL5 tag=SNNM009AAMYW type=del 2024-09-14T11:15:08.704 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:08.704+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_KS37ZO6MKAH9.2~8NLHJ8O9I16X.0 size=1048576 2024-09-14T11:15:08.707 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:08.708+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_KS37ZO6MKAH9.2~8NLHJ8O9I16X.1 size=391664 2024-09-14T11:15:08.707 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:08.708+0000 7f76c1e8a8c0 1 > prepared multipart upload key=KS37ZO6MKAH9 upload=8NLHJ8O9I16X tag=UEGEKPKHVWK9 type=write size=2488816 2024-09-14T11:15:08.711 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:08.712+0000 7f76c1e8a8c0 1 < completed delete operation key=XC8VWSHZOPFP tag=NMI2518HCS11 type=del 2024-09-14T11:15:08.715 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:08.716+0000 7f76c1e8a8c0 1 > prepared operation key=HJ701768A6I7 tag=QA0QDQJMJLX0 type=del size=2581594 2024-09-14T11:15:08.719 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:08.720+0000 7f76c1e8a8c0 1 < completed part key=_multipart_XC8VWSHZOPFP.2~LNQJ7XL82RDR.0 size=941207 2024-09-14T11:15:08.725 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:08.728+0000 7f76c1e8a8c0 1 < completed multipart upload key=XC8VWSHZOPFP upload=LNQJ7XL82RDR tag=C3IC1D2XQYPG type=write size=1989783 2024-09-14T11:15:08.731 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:08.732+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_GZM0AQVHNCMM.2~IHAYAJ6AQ08N.0 size=808997 2024-09-14T11:15:08.731 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:08.732+0000 7f76c1e8a8c0 1 > prepared multipart upload key=GZM0AQVHNCMM upload=IHAYAJ6AQ08N tag=BXKWBQFHF9Y6 type=write size=1857573 2024-09-14T11:15:08.734 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:08.736+0000 7f76c1e8a8c0 1 < completed delete operation key=VI61O3K069BP tag=H7GG9LF6359U type=del 2024-09-14T11:15:08.741 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:08.744+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_HJ701768A6I7.2~F64M396TXOKW.0 size=1048576 2024-09-14T11:15:08.743 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:08.744+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_HJ701768A6I7.2~F64M396TXOKW.1 size=1048576 2024-09-14T11:15:08.746 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:08.748+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_HJ701768A6I7.2~F64M396TXOKW.2 size=477804 2024-09-14T11:15:08.746 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:08.748+0000 7f76c1e8a8c0 1 > prepared multipart upload key=HJ701768A6I7 upload=F64M396TXOKW tag=NNJYBT7C96ZX type=write size=3623532 2024-09-14T11:15:08.750 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:08.752+0000 7f76c1e8a8c0 1 < completed delete operation key=VI61O3K069BP tag=A3S1DXGC6BIZ type=del 2024-09-14T11:15:08.753 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:08.756+0000 7f76c1e8a8c0 1 > prepared operation key=TUFOZKTV9XIH tag=7F3A6V2F0U9X type=del size=956643 2024-09-14T11:15:08.757 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:08.760+0000 7f76c1e8a8c0 1 < completed delete operation key=S43U13LYETS4 tag=CFQWWT6OF18V type=del 2024-09-14T11:15:08.763 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:08.764+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_F3KFS0P1WM7W.2~ASIX4H1HZE5X.0 size=1048576 2024-09-14T11:15:08.766 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:08.768+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_F3KFS0P1WM7W.2~ASIX4H1HZE5X.1 size=1048576 2024-09-14T11:15:08.769 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:08.772+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_F3KFS0P1WM7W.2~ASIX4H1HZE5X.2 size=304317 2024-09-14T11:15:08.769 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:08.772+0000 7f76c1e8a8c0 1 > prepared multipart upload key=F3KFS0P1WM7W upload=ASIX4H1HZE5X tag=EPET5SOVG2PT type=write size=3450045 2024-09-14T11:15:08.772 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:08.776+0000 7f76c1e8a8c0 -1 < failed to complete operation key=H9CQV6L29SL5 tag=RT3XBQQOKM2S type=write size=287274: (22) Invalid argument 2024-09-14T11:15:08.777 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:08.780+0000 7f76c1e8a8c0 1 > prepared operation key=8FFV9G6EQR8F tag=9FRUMC46ZUYE type=write size=15695 2024-09-14T11:15:08.781 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:08.784+0000 7f76c1e8a8c0 -1 < failed to complete operation key=SUNCRV0C1XYL tag=1E33JOZT2DSU type=del size=1905902: (22) Invalid argument 2024-09-14T11:15:08.785 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:08.788+0000 7f76c1e8a8c0 1 > prepared operation key=MEVTZ7OAD4CA tag=Z36X1A7IPR5H type=write size=147999 2024-09-14T11:15:08.789 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:08.792+0000 7f76c1e8a8c0 1 < completed delete operation key=1K8ESNXU6WDF tag=QBMXVV0OZX16 type=del 2024-09-14T11:15:08.793 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:08.796+0000 7f76c1e8a8c0 1 > prepared operation key=W0MDRE9YO3UP tag=82KL7N1Y41RX type=write size=634682 2024-09-14T11:15:08.797 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:08.800+0000 7f76c1e8a8c0 1 < completed part key=_multipart_OOUEM16XL80W.2~2VUVMPQS40EL.0 size=708271 2024-09-14T11:15:08.803 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:08.804+0000 7f76c1e8a8c0 1 < completed multipart upload key=OOUEM16XL80W upload=2VUVMPQS40EL tag=2HJDJWJVNT2V type=write size=1756847 2024-09-14T11:15:08.809 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:08.812+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_TZO40K6J9877.2~YPTP1F40DKJM.0 size=1048576 2024-09-14T11:15:08.811 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:08.812+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_TZO40K6J9877.2~YPTP1F40DKJM.1 size=1048576 2024-09-14T11:15:08.814 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:08.816+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_TZO40K6J9877.2~YPTP1F40DKJM.2 size=661774 2024-09-14T11:15:08.814 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:08.816+0000 7f76c1e8a8c0 1 > prepared multipart upload key=TZO40K6J9877 upload=YPTP1F40DKJM tag=MGI6M0Y62QDR type=write size=3807502 2024-09-14T11:15:08.821 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:08.824+0000 7f76c1e8a8c0 1 < suggested remove operation key=HS7T50JORDQJ tag=65X0D8U1EL11 type=del 2024-09-14T11:15:08.827 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:08.828+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_1K8ESNXU6WDF.2~4HPLC00JFLZH.0 size=683423 2024-09-14T11:15:08.827 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:08.828+0000 7f76c1e8a8c0 1 > prepared multipart upload key=1K8ESNXU6WDF upload=4HPLC00JFLZH tag=34FRZ36EJ4JX type=write size=1731999 2024-09-14T11:15:08.831 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:08.832+0000 7f76c1e8a8c0 1 < completed write operation key=85G6NT78HAWQ tag=FVZSSIJC6G9Y type=write size=302847 2024-09-14T11:15:08.834 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:08.836+0000 7f76c1e8a8c0 1 > prepared operation key=OOUEM16XL80W tag=5U9ID5GA0NRO type=del size=3917825 2024-09-14T11:15:08.837 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:08.840+0000 7f76c1e8a8c0 1 < completed delete operation key=W0MDRE9YO3UP tag=YKPA3AAYCB63 type=del 2024-09-14T11:15:08.844 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:08.844+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_HJ701768A6I7.2~RLLECW15SXES.0 size=1048576 2024-09-14T11:15:08.849 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:08.852+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_HJ701768A6I7.2~RLLECW15SXES.1 size=829014 2024-09-14T11:15:08.849 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:08.852+0000 7f76c1e8a8c0 1 > prepared multipart upload key=HJ701768A6I7 upload=RLLECW15SXES tag=68F0OXHV1C45 type=write size=2926166 2024-09-14T11:15:08.853 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:08.856+0000 7f76c1e8a8c0 1 < completed delete operation key=W0MDRE9YO3UP tag=SIFEXNXUZ1AU type=del 2024-09-14T11:15:08.856 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:08.860+0000 7f76c1e8a8c0 1 > prepared operation key=GZM0AQVHNCMM tag=PYAE4QXNEOYN type=del size=4183482 2024-09-14T11:15:08.860 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:08.860+0000 7f76c1e8a8c0 1 < completed delete operation key=TZO40K6J9877 tag=I1UWIVXX59J5 type=del 2024-09-14T11:15:08.863 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:08.864+0000 7f76c1e8a8c0 1 > prepared operation key=S43U13LYETS4 tag=ZC12XZ190PQ9 type=del size=1681083 2024-09-14T11:15:08.870 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:08.872+0000 7f76c1e8a8c0 1 < suggested update operation key=R5I9H7WAK7Z7 tag=4EZD6I3O949I type=del size=1146759 2024-09-14T11:15:08.874 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:08.876+0000 7f76c1e8a8c0 1 > prepared operation key=SUNCRV0C1XYL tag=7XF1L7B358U8 type=del size=3617097 2024-09-14T11:15:08.877 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:08.880+0000 7f76c1e8a8c0 1 < completed part key=_multipart_KS37ZO6MKAH9.2~8NLHJ8O9I16X.0 size=1048576 2024-09-14T11:15:08.879 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:08.880+0000 7f76c1e8a8c0 1 < completed part key=_multipart_KS37ZO6MKAH9.2~8NLHJ8O9I16X.1 size=391664 2024-09-14T11:15:08.885 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:08.888+0000 7f76c1e8a8c0 1 < completed multipart upload key=KS37ZO6MKAH9 upload=8NLHJ8O9I16X tag=UEGEKPKHVWK9 type=write size=2488816 2024-09-14T11:15:08.889 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:08.892+0000 7f76c1e8a8c0 1 > prepared operation key=Q5IY4J5FOD80 tag=FNMXSIML13LL type=del size=318196 2024-09-14T11:15:08.892 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:08.892+0000 7f76c1e8a8c0 1 < completed delete operation key=HJ701768A6I7 tag=QA0QDQJMJLX0 type=del 2024-09-14T11:15:08.896 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:08.896+0000 7f76c1e8a8c0 1 > prepared operation key=OUMUTEBQ1TD0 tag=UNEAZA7G39JU type=del size=252933 2024-09-14T11:15:08.899 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:08.900+0000 7f76c1e8a8c0 1 < completed part key=_multipart_GZM0AQVHNCMM.2~IHAYAJ6AQ08N.0 size=808997 2024-09-14T11:15:08.904 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:08.908+0000 7f76c1e8a8c0 1 < completed multipart upload key=GZM0AQVHNCMM upload=IHAYAJ6AQ08N tag=BXKWBQFHF9Y6 type=write size=1857573 2024-09-14T11:15:08.910 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:08.912+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_K2EEZLRK7MVO.2~H2W87FHITETZ.0 size=205165 2024-09-14T11:15:08.910 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:08.912+0000 7f76c1e8a8c0 1 > prepared multipart upload key=K2EEZLRK7MVO upload=H2W87FHITETZ tag=CVBS63X4XND1 type=write size=1253741 2024-09-14T11:15:08.911 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:08.912+0000 7f76c1e8a8c0 1 < canceled part key=_multipart_HJ701768A6I7.2~F64M396TXOKW.0 size=1048576 2024-09-14T11:15:08.914 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:08.916+0000 7f76c1e8a8c0 1 < completed part key=_multipart_HJ701768A6I7.2~F64M396TXOKW.1 size=1048576 2024-09-14T11:15:08.916 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:08.920+0000 7f76c1e8a8c0 1 < completed part key=_multipart_HJ701768A6I7.2~F64M396TXOKW.2 size=477804 2024-09-14T11:15:08.921 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:08.924+0000 7f76c1e8a8c0 1 < canceled multipart upload key=HJ701768A6I7 upload=F64M396TXOKW tag=NNJYBT7C96ZX type=write size=3623532 2024-09-14T11:15:08.927 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:08.928+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_1K8ESNXU6WDF.2~3OUYLSZD1R0A.0 size=73318 2024-09-14T11:15:08.927 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:08.928+0000 7f76c1e8a8c0 1 > prepared multipart upload key=1K8ESNXU6WDF upload=3OUYLSZD1R0A tag=R2VZ11GNXG76 type=write size=1121894 2024-09-14T11:15:08.930 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:08.932+0000 7f76c1e8a8c0 1 < completed delete operation key=TUFOZKTV9XIH tag=7F3A6V2F0U9X type=del 2024-09-14T11:15:08.933 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:08.936+0000 7f76c1e8a8c0 1 > prepared operation key=OUMUTEBQ1TD0 tag=CH0LT656JM4X type=del size=2152527 2024-09-14T11:15:08.937 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:08.940+0000 7f76c1e8a8c0 1 < completed part key=_multipart_F3KFS0P1WM7W.2~ASIX4H1HZE5X.0 size=1048576 2024-09-14T11:15:08.939 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:08.940+0000 7f76c1e8a8c0 1 < completed part key=_multipart_F3KFS0P1WM7W.2~ASIX4H1HZE5X.1 size=1048576 2024-09-14T11:15:08.942 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:08.944+0000 7f76c1e8a8c0 1 < completed part key=_multipart_F3KFS0P1WM7W.2~ASIX4H1HZE5X.2 size=304317 2024-09-14T11:15:08.947 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:08.948+0000 7f76c1e8a8c0 1 < completed multipart upload key=F3KFS0P1WM7W upload=ASIX4H1HZE5X tag=EPET5SOVG2PT type=write size=3450045 2024-09-14T11:15:08.953 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:08.956+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_OUMUTEBQ1TD0.2~UCJS2LUIMTFW.0 size=1048576 2024-09-14T11:15:08.956 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:08.960+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_OUMUTEBQ1TD0.2~UCJS2LUIMTFW.1 size=845244 2024-09-14T11:15:08.957 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:08.960+0000 7f76c1e8a8c0 1 > prepared multipart upload key=OUMUTEBQ1TD0 upload=UCJS2LUIMTFW tag=4X5LRKQ629MT type=write size=2942396 2024-09-14T11:15:08.960 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:08.964+0000 7f76c1e8a8c0 1 < completed write operation key=8FFV9G6EQR8F tag=9FRUMC46ZUYE type=write size=15695 2024-09-14T11:15:08.964 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:08.968+0000 7f76c1e8a8c0 1 > prepared operation key=F3KFS0P1WM7W tag=V34HCQ4PJL62 type=write size=191854 2024-09-14T11:15:08.982 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:08.984+0000 7f76c1e8a8c0 1 < suggested remove operation key=MEVTZ7OAD4CA tag=Z36X1A7IPR5H type=write 2024-09-14T11:15:08.985 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:08.988+0000 7f76c1e8a8c0 1 > prepared operation key=GZM0AQVHNCMM tag=4F9TZ8USZ8AQ type=write size=371590 2024-09-14T11:15:08.988 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:08.988+0000 7f76c1e8a8c0 1 < canceled operation key=W0MDRE9YO3UP tag=82KL7N1Y41RX type=write size=634682 2024-09-14T11:15:08.992 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:08.996+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_K2EEZLRK7MVO.2~V106K1G1GQHE.0 size=965025 2024-09-14T11:15:08.992 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:08.996+0000 7f76c1e8a8c0 1 > prepared multipart upload key=K2EEZLRK7MVO upload=V106K1G1GQHE tag=6Y5IA5OLEHJQ type=write size=2013601 2024-09-14T11:15:08.995 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:08.996+0000 7f76c1e8a8c0 1 < completed part key=_multipart_TZO40K6J9877.2~YPTP1F40DKJM.0 size=1048576 2024-09-14T11:15:08.997 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:09.000+0000 7f76c1e8a8c0 1 < completed part key=_multipart_TZO40K6J9877.2~YPTP1F40DKJM.1 size=1048576 2024-09-14T11:15:08.997 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:09.000+0000 7f76c1e8a8c0 1 < canceled part key=_multipart_TZO40K6J9877.2~YPTP1F40DKJM.2 size=661774 2024-09-14T11:15:09.001 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:09.004+0000 7f76c1e8a8c0 1 < canceled multipart upload key=TZO40K6J9877 upload=YPTP1F40DKJM tag=MGI6M0Y62QDR type=write size=3807502 2024-09-14T11:15:09.006 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:09.008+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_GAVZRU8ZLW7S.2~OL0J15PCU7D7.0 size=1048576 2024-09-14T11:15:09.008 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:09.012+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_GAVZRU8ZLW7S.2~OL0J15PCU7D7.1 size=1048576 2024-09-14T11:15:09.010 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:09.012+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_GAVZRU8ZLW7S.2~OL0J15PCU7D7.2 size=307635 2024-09-14T11:15:09.011 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:09.012+0000 7f76c1e8a8c0 1 > prepared multipart upload key=GAVZRU8ZLW7S upload=OL0J15PCU7D7 tag=1BWKJ655ZN4M type=write size=3453363 2024-09-14T11:15:09.013 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:09.016+0000 7f76c1e8a8c0 1 < completed part key=_multipart_1K8ESNXU6WDF.2~4HPLC00JFLZH.0 size=683423 2024-09-14T11:15:09.017 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:09.020+0000 7f76c1e8a8c0 1 < completed multipart upload key=1K8ESNXU6WDF upload=4HPLC00JFLZH tag=34FRZ36EJ4JX type=write size=1731999 2024-09-14T11:15:09.020 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:09.020+0000 7f76c1e8a8c0 1 > prepared operation key=Q5IY4J5FOD80 tag=QEJU6W44PPZ0 type=del size=2507205 2024-09-14T11:15:09.022 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:09.024+0000 7f76c1e8a8c0 1 < completed delete operation key=OOUEM16XL80W tag=5U9ID5GA0NRO type=del 2024-09-14T11:15:09.025 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:09.028+0000 7f76c1e8a8c0 1 > prepared operation key=BOCIF4TL7X7J tag=C35FE9HXV8KC type=write size=567361 2024-09-14T11:15:09.026 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:09.028+0000 7f76c1e8a8c0 1 < canceled part key=_multipart_HJ701768A6I7.2~RLLECW15SXES.0 size=1048576 2024-09-14T11:15:09.026 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:09.028+0000 7f76c1e8a8c0 1 < canceled part key=_multipart_HJ701768A6I7.2~RLLECW15SXES.1 size=829014 2024-09-14T11:15:09.031 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:09.032+0000 7f76c1e8a8c0 1 < canceled multipart upload key=HJ701768A6I7 upload=RLLECW15SXES tag=68F0OXHV1C45 type=write size=2926166 2024-09-14T11:15:09.033 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:09.036+0000 7f76c1e8a8c0 1 > prepared operation key=GAVZRU8ZLW7S tag=ZSXKR23OQJFJ type=write size=846431 2024-09-14T11:15:09.039 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:09.040+0000 7f76c1e8a8c0 1 < suggested update operation key=GZM0AQVHNCMM tag=PYAE4QXNEOYN type=del size=4183482 2024-09-14T11:15:09.043 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:09.044+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_TZO40K6J9877.2~J0U607355XHE.0 size=1048576 2024-09-14T11:15:09.045 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:09.048+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_TZO40K6J9877.2~J0U607355XHE.1 size=1048576 2024-09-14T11:15:09.047 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:09.048+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_TZO40K6J9877.2~J0U607355XHE.2 size=672264 2024-09-14T11:15:09.047 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:09.048+0000 7f76c1e8a8c0 1 > prepared multipart upload key=TZO40K6J9877 upload=J0U607355XHE tag=UZ7NW7Y1UXDZ type=write size=3817992 2024-09-14T11:15:09.052 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:09.052+0000 7f76c1e8a8c0 1 < suggested update operation key=S43U13LYETS4 tag=ZC12XZ190PQ9 type=del size=1681083 2024-09-14T11:15:09.054 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:09.056+0000 7f76c1e8a8c0 1 > prepared operation key=SHKU2PRNREKK tag=3HPZC3D3QUOJ type=del size=1453801 2024-09-14T11:15:09.059 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:09.060+0000 7f76c1e8a8c0 1 < suggested update operation key=SUNCRV0C1XYL tag=7XF1L7B358U8 type=del size=3617097 2024-09-14T11:15:09.063 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:09.064+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_R5I9H7WAK7Z7.2~6UUOAP2NSVM5.0 size=1048576 2024-09-14T11:15:09.065 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:09.068+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_R5I9H7WAK7Z7.2~6UUOAP2NSVM5.1 size=971716 2024-09-14T11:15:09.065 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:09.068+0000 7f76c1e8a8c0 1 > prepared multipart upload key=R5I9H7WAK7Z7 upload=6UUOAP2NSVM5 tag=52KLTWHJJN38 type=write size=3068868 2024-09-14T11:15:09.071 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:09.072+0000 7f76c1e8a8c0 1 < suggested remove operation key=Q5IY4J5FOD80 tag=FNMXSIML13LL type=del 2024-09-14T11:15:09.073 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:09.076+0000 7f76c1e8a8c0 1 > prepared operation key=HS7T50JORDQJ tag=U80VIG8YR5B0 type=del size=770023 2024-09-14T11:15:09.075 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:09.076+0000 7f76c1e8a8c0 1 < completed delete operation key=OUMUTEBQ1TD0 tag=UNEAZA7G39JU type=del 2024-09-14T11:15:09.078 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:09.080+0000 7f76c1e8a8c0 1 > prepared operation key=CIRQT9IDJ5OJ tag=5MR4BN6BC54J type=write size=275307 2024-09-14T11:15:09.078 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:09.080+0000 7f76c1e8a8c0 1 < canceled part key=_multipart_K2EEZLRK7MVO.2~H2W87FHITETZ.0 size=205165 2024-09-14T11:15:09.082 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:09.084+0000 7f76c1e8a8c0 1 < canceled multipart upload key=K2EEZLRK7MVO upload=H2W87FHITETZ tag=CVBS63X4XND1 type=write size=1253741 2024-09-14T11:15:09.084 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:09.088+0000 7f76c1e8a8c0 1 > prepared operation key=1K8ESNXU6WDF tag=MGENTX24SQXA type=write size=1048428 2024-09-14T11:15:09.087 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:09.088+0000 7f76c1e8a8c0 1 < completed part key=_multipart_1K8ESNXU6WDF.2~3OUYLSZD1R0A.0 size=73318 2024-09-14T11:15:09.091 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:09.092+0000 7f76c1e8a8c0 1 < completed multipart upload key=1K8ESNXU6WDF upload=3OUYLSZD1R0A tag=R2VZ11GNXG76 type=write size=1121894 2024-09-14T11:15:09.093 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:09.096+0000 7f76c1e8a8c0 1 > prepared operation key=6TIJR323NMOH tag=N08SG9R92R75 type=del size=599088 2024-09-14T11:15:09.095 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:09.096+0000 7f76c1e8a8c0 1 < completed delete operation key=OUMUTEBQ1TD0 tag=CH0LT656JM4X type=del 2024-09-14T11:15:09.097 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:09.100+0000 7f76c1e8a8c0 1 > prepared operation key=XC8VWSHZOPFP tag=LXS4172LBQTU type=del size=1600082 2024-09-14T11:15:09.100 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:09.100+0000 7f76c1e8a8c0 1 < completed part key=_multipart_OUMUTEBQ1TD0.2~UCJS2LUIMTFW.0 size=1048576 2024-09-14T11:15:09.102 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:09.104+0000 7f76c1e8a8c0 1 < completed part key=_multipart_OUMUTEBQ1TD0.2~UCJS2LUIMTFW.1 size=845244 2024-09-14T11:15:09.106 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:09.108+0000 7f76c1e8a8c0 1 < completed multipart upload key=OUMUTEBQ1TD0 upload=UCJS2LUIMTFW tag=4X5LRKQ629MT type=write size=2942396 2024-09-14T11:15:09.108 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:09.112+0000 7f76c1e8a8c0 1 > prepared operation key=BOCIF4TL7X7J tag=Y34OFH0SJB0T type=del size=1486164 2024-09-14T11:15:09.111 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:09.112+0000 7f76c1e8a8c0 1 < completed write operation key=F3KFS0P1WM7W tag=V34HCQ4PJL62 type=write size=191854 2024-09-14T11:15:09.113 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:09.116+0000 7f76c1e8a8c0 1 > prepared operation key=GAVZRU8ZLW7S tag=VA6CLNDBE8OB type=write size=416842 2024-09-14T11:15:09.115 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:09.116+0000 7f76c1e8a8c0 -1 < failed to complete operation key=GZM0AQVHNCMM tag=4F9TZ8USZ8AQ type=write size=371590: (22) Invalid argument 2024-09-14T11:15:09.118 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:09.120+0000 7f76c1e8a8c0 1 > prepared operation key=CIRQT9IDJ5OJ tag=7C9QVC7AERQI type=del size=2372930 2024-09-14T11:15:09.120 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:09.124+0000 7f76c1e8a8c0 1 < completed part key=_multipart_K2EEZLRK7MVO.2~V106K1G1GQHE.0 size=965025 2024-09-14T11:15:09.126 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:09.128+0000 7f76c1e8a8c0 1 < completed multipart upload key=K2EEZLRK7MVO upload=V106K1G1GQHE tag=6Y5IA5OLEHJQ type=write size=2013601 2024-09-14T11:15:09.128 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:09.132+0000 7f76c1e8a8c0 1 > prepared operation key=SUNCRV0C1XYL tag=ICE9W5DU1CLP type=del size=338925 2024-09-14T11:15:09.131 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:09.132+0000 7f76c1e8a8c0 1 < completed part key=_multipart_GAVZRU8ZLW7S.2~OL0J15PCU7D7.0 size=1048576 2024-09-14T11:15:09.133 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:09.136+0000 7f76c1e8a8c0 1 < completed part key=_multipart_GAVZRU8ZLW7S.2~OL0J15PCU7D7.1 size=1048576 2024-09-14T11:15:09.134 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:09.136+0000 7f76c1e8a8c0 1 < completed part key=_multipart_GAVZRU8ZLW7S.2~OL0J15PCU7D7.2 size=307635 2024-09-14T11:15:09.138 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:09.140+0000 7f76c1e8a8c0 1 < completed multipart upload key=GAVZRU8ZLW7S upload=OL0J15PCU7D7 tag=1BWKJ655ZN4M type=write size=3453363 2024-09-14T11:15:09.140 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:09.144+0000 7f76c1e8a8c0 1 > prepared operation key=H9CQV6L29SL5 tag=M6AOTPPS1190 type=del size=1805535 2024-09-14T11:15:09.142 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:09.144+0000 7f76c1e8a8c0 -1 < failed to complete operation key=Q5IY4J5FOD80 tag=QEJU6W44PPZ0 type=del size=2507205: (22) Invalid argument 2024-09-14T11:15:09.146 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:09.148+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_SUNCRV0C1XYL.2~26T0NQEO10EY.0 size=626810 2024-09-14T11:15:09.147 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:09.148+0000 7f76c1e8a8c0 1 > prepared multipart upload key=SUNCRV0C1XYL upload=26T0NQEO10EY tag=Z0N33HVSA5AR type=write size=1675386 2024-09-14T11:15:09.149 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:09.152+0000 7f76c1e8a8c0 1 < completed write operation key=BOCIF4TL7X7J tag=C35FE9HXV8KC type=write size=567361 2024-09-14T11:15:09.151 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:09.152+0000 7f76c1e8a8c0 1 > prepared operation key=OUMUTEBQ1TD0 tag=TYGJYT42BD81 type=write size=546001 2024-09-14T11:15:09.157 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:09.160+0000 7f76c1e8a8c0 1 < completed write operation key=GAVZRU8ZLW7S tag=ZSXKR23OQJFJ type=write size=846431 2024-09-14T11:15:09.159 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:09.160+0000 7f76c1e8a8c0 1 > prepared operation key=LZ0YNFOVFYCL tag=568YFBUY5P37 type=del size=2565478 2024-09-14T11:15:09.159 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:09.160+0000 7f76c1e8a8c0 1 < canceled part key=_multipart_TZO40K6J9877.2~J0U607355XHE.0 size=1048576 2024-09-14T11:15:09.161 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:09.164+0000 7f76c1e8a8c0 1 < completed part key=_multipart_TZO40K6J9877.2~J0U607355XHE.1 size=1048576 2024-09-14T11:15:09.163 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:09.164+0000 7f76c1e8a8c0 1 < completed part key=_multipart_TZO40K6J9877.2~J0U607355XHE.2 size=672264 2024-09-14T11:15:09.167 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:09.168+0000 7f76c1e8a8c0 1 < canceled multipart upload key=TZO40K6J9877 upload=J0U607355XHE tag=UZ7NW7Y1UXDZ type=write size=3817992 2024-09-14T11:15:09.170 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:09.172+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_85G6NT78HAWQ.2~1R5VHF8G55IB.0 size=1048576 2024-09-14T11:15:09.172 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:09.176+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_85G6NT78HAWQ.2~1R5VHF8G55IB.1 size=1048576 2024-09-14T11:15:09.174 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:09.176+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_85G6NT78HAWQ.2~1R5VHF8G55IB.2 size=36850 2024-09-14T11:15:09.174 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:09.176+0000 7f76c1e8a8c0 1 > prepared multipart upload key=85G6NT78HAWQ upload=1R5VHF8G55IB tag=FV634G89V9NK type=write size=3182578 2024-09-14T11:15:09.176 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:09.176+0000 7f76c1e8a8c0 1 < canceled operation key=SHKU2PRNREKK tag=3HPZC3D3QUOJ type=del size=1453801 2024-09-14T11:15:09.180 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:09.180+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_MEVTZ7OAD4CA.2~AXZ3RX690GD4.0 size=1048576 2024-09-14T11:15:09.181 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:09.184+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_MEVTZ7OAD4CA.2~AXZ3RX690GD4.1 size=1048576 2024-09-14T11:15:09.183 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:09.184+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_MEVTZ7OAD4CA.2~AXZ3RX690GD4.2 size=534367 2024-09-14T11:15:09.183 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:09.184+0000 7f76c1e8a8c0 1 > prepared multipart upload key=MEVTZ7OAD4CA upload=AXZ3RX690GD4 tag=6FCVSK0ZT6PH type=write size=3680095 2024-09-14T11:15:09.185 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:09.188+0000 7f76c1e8a8c0 1 < completed part key=_multipart_R5I9H7WAK7Z7.2~6UUOAP2NSVM5.0 size=1048576 2024-09-14T11:15:09.187 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:09.188+0000 7f76c1e8a8c0 1 < completed part key=_multipart_R5I9H7WAK7Z7.2~6UUOAP2NSVM5.1 size=971716 2024-09-14T11:15:09.191 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:09.192+0000 7f76c1e8a8c0 1 < completed multipart upload key=R5I9H7WAK7Z7 upload=6UUOAP2NSVM5 tag=52KLTWHJJN38 type=write size=3068868 2024-09-14T11:15:09.193 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:09.196+0000 7f76c1e8a8c0 1 > prepared operation key=HJ701768A6I7 tag=ST7XVAC3EW3M type=del size=1706066 2024-09-14T11:15:09.195 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:09.196+0000 7f76c1e8a8c0 1 < canceled operation key=HS7T50JORDQJ tag=U80VIG8YR5B0 type=del size=770023 2024-09-14T11:15:09.199 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:09.200+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_H9CQV6L29SL5.2~IBR8X6XCBVXL.0 size=1048576 2024-09-14T11:15:09.201 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:09.204+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_H9CQV6L29SL5.2~IBR8X6XCBVXL.1 size=1048576 2024-09-14T11:15:09.202 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:09.204+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_H9CQV6L29SL5.2~IBR8X6XCBVXL.2 size=181712 2024-09-14T11:15:09.202 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:09.204+0000 7f76c1e8a8c0 1 > prepared multipart upload key=H9CQV6L29SL5 upload=IBR8X6XCBVXL tag=GLKY23OV0JWT type=write size=3327440 2024-09-14T11:15:09.205 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:09.208+0000 7f76c1e8a8c0 1 < completed write operation key=CIRQT9IDJ5OJ tag=5MR4BN6BC54J type=write size=275307 2024-09-14T11:15:09.208 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:09.212+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_SHKU2PRNREKK.2~Y29I1K0OFOK7.0 size=1048576 2024-09-14T11:15:09.210 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:09.212+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_SHKU2PRNREKK.2~Y29I1K0OFOK7.1 size=184727 2024-09-14T11:15:09.210 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:09.212+0000 7f76c1e8a8c0 1 > prepared multipart upload key=SHKU2PRNREKK upload=Y29I1K0OFOK7 tag=CLNV22W7K6O2 type=write size=2281879 2024-09-14T11:15:09.212 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:09.216+0000 7f76c1e8a8c0 1 < completed write operation key=1K8ESNXU6WDF tag=MGENTX24SQXA type=write size=1048428 2024-09-14T11:15:09.216 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:09.220+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_S43U13LYETS4.2~C2O3SYHZFZAN.0 size=1048576 2024-09-14T11:15:09.218 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:09.220+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_S43U13LYETS4.2~C2O3SYHZFZAN.1 size=1048576 2024-09-14T11:15:09.220 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:09.220+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_S43U13LYETS4.2~C2O3SYHZFZAN.2 size=645696 2024-09-14T11:15:09.220 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:09.220+0000 7f76c1e8a8c0 1 > prepared multipart upload key=S43U13LYETS4 upload=C2O3SYHZFZAN tag=VJ6QZZJJLJE9 type=write size=3791424 2024-09-14T11:15:09.222 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:09.224+0000 7f76c1e8a8c0 1 < completed delete operation key=6TIJR323NMOH tag=N08SG9R92R75 type=del 2024-09-14T11:15:09.224 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:09.228+0000 7f76c1e8a8c0 1 > prepared operation key=HJ701768A6I7 tag=Q7GLIR0EJXNE type=del size=960852 2024-09-14T11:15:09.226 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:09.228+0000 7f76c1e8a8c0 1 < completed delete operation key=XC8VWSHZOPFP tag=LXS4172LBQTU type=del 2024-09-14T11:15:09.230 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:09.232+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_CIRQT9IDJ5OJ.2~2AU9922ODF8M.0 size=1048576 2024-09-14T11:15:09.232 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:09.236+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_CIRQT9IDJ5OJ.2~2AU9922ODF8M.1 size=1048576 2024-09-14T11:15:09.234 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:09.236+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_CIRQT9IDJ5OJ.2~2AU9922ODF8M.2 size=285779 2024-09-14T11:15:09.234 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:09.236+0000 7f76c1e8a8c0 1 > prepared multipart upload key=CIRQT9IDJ5OJ upload=2AU9922ODF8M tag=T6X9LQSGPVFW type=write size=3431507 2024-09-14T11:15:09.236 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:09.240+0000 7f76c1e8a8c0 1 < completed delete operation key=BOCIF4TL7X7J tag=Y34OFH0SJB0T type=del 2024-09-14T11:15:09.241 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:09.244+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_HS7T50JORDQJ.2~002XN8R6EB0O.0 size=1048576 2024-09-14T11:15:09.243 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:09.244+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_HS7T50JORDQJ.2~002XN8R6EB0O.1 size=1048576 2024-09-14T11:15:09.244 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:09.248+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_HS7T50JORDQJ.2~002XN8R6EB0O.2 size=65313 2024-09-14T11:15:09.244 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:09.248+0000 7f76c1e8a8c0 1 > prepared multipart upload key=HS7T50JORDQJ upload=002XN8R6EB0O tag=GIT2ESWW49CT type=write size=3211041 2024-09-14T11:15:09.247 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:09.248+0000 7f76c1e8a8c0 1 < completed write operation key=GAVZRU8ZLW7S tag=VA6CLNDBE8OB type=write size=416842 2024-09-14T11:15:09.249 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:09.252+0000 7f76c1e8a8c0 1 > prepared operation key=F3KFS0P1WM7W tag=FJBWVCLNMKC3 type=write size=496778 2024-09-14T11:15:09.251 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:09.252+0000 7f76c1e8a8c0 1 < completed delete operation key=CIRQT9IDJ5OJ tag=7C9QVC7AERQI type=del 2024-09-14T11:15:09.253 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:09.256+0000 7f76c1e8a8c0 1 > prepared operation key=SUNCRV0C1XYL tag=JRLW4SM140N5 type=del size=2626459 2024-09-14T11:15:09.256 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:09.256+0000 7f76c1e8a8c0 1 < completed delete operation key=SUNCRV0C1XYL tag=ICE9W5DU1CLP type=del 2024-09-14T11:15:09.260 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:09.264+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_K2EEZLRK7MVO.2~ZQP21B1TLLAW.0 size=1048576 2024-09-14T11:15:09.262 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:09.264+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_K2EEZLRK7MVO.2~ZQP21B1TLLAW.1 size=1048576 2024-09-14T11:15:09.264 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:09.268+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_K2EEZLRK7MVO.2~ZQP21B1TLLAW.2 size=445821 2024-09-14T11:15:09.265 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:09.268+0000 7f76c1e8a8c0 1 > prepared multipart upload key=K2EEZLRK7MVO upload=ZQP21B1TLLAW tag=21Q7D2IC6KRX type=write size=3591549 2024-09-14T11:15:09.267 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:09.268+0000 7f76c1e8a8c0 1 < completed delete operation key=H9CQV6L29SL5 tag=M6AOTPPS1190 type=del 2024-09-14T11:15:09.271 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:09.272+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_SUNCRV0C1XYL.2~9ODWZFQLTA6J.0 size=1048576 2024-09-14T11:15:09.273 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:09.276+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_SUNCRV0C1XYL.2~9ODWZFQLTA6J.1 size=563105 2024-09-14T11:15:09.273 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:09.276+0000 7f76c1e8a8c0 1 > prepared multipart upload key=SUNCRV0C1XYL upload=9ODWZFQLTA6J tag=U7YAXSZ7CNZ1 type=write size=2660257 2024-09-14T11:15:09.274 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:09.276+0000 7f76c1e8a8c0 1 < canceled part key=_multipart_SUNCRV0C1XYL.2~26T0NQEO10EY.0 size=626810 2024-09-14T11:15:09.278 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:09.280+0000 7f76c1e8a8c0 1 < canceled multipart upload key=SUNCRV0C1XYL upload=26T0NQEO10EY tag=Z0N33HVSA5AR type=write size=1675386 2024-09-14T11:15:09.280 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:09.284+0000 7f76c1e8a8c0 1 > prepared operation key=HJ701768A6I7 tag=AQ7FCXB4BY9J type=del size=808139 2024-09-14T11:15:09.283 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:09.284+0000 7f76c1e8a8c0 1 < completed write operation key=OUMUTEBQ1TD0 tag=TYGJYT42BD81 type=write size=546001 2024-09-14T11:15:09.285 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:09.288+0000 7f76c1e8a8c0 1 > prepared operation key=6TIJR323NMOH tag=2XCI1RQQWKZW type=del size=3925220 2024-09-14T11:15:09.287 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:09.288+0000 7f76c1e8a8c0 1 < canceled operation key=LZ0YNFOVFYCL tag=568YFBUY5P37 type=del size=2565478 2024-09-14T11:15:09.290 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:09.292+0000 7f76c1e8a8c0 1 > prepared operation key=1K8ESNXU6WDF tag=F27DO5XXA3FM type=del size=3550060 2024-09-14T11:15:09.292 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:09.296+0000 7f76c1e8a8c0 1 < completed part key=_multipart_85G6NT78HAWQ.2~1R5VHF8G55IB.0 size=1048576 2024-09-14T11:15:09.294 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:09.296+0000 7f76c1e8a8c0 1 < completed part key=_multipart_85G6NT78HAWQ.2~1R5VHF8G55IB.1 size=1048576 2024-09-14T11:15:09.296 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:09.300+0000 7f76c1e8a8c0 1 < completed part key=_multipart_85G6NT78HAWQ.2~1R5VHF8G55IB.2 size=36850 2024-09-14T11:15:09.300 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:09.304+0000 7f76c1e8a8c0 1 < completed multipart upload key=85G6NT78HAWQ upload=1R5VHF8G55IB tag=FV634G89V9NK type=write size=3182578 2024-09-14T11:15:09.303 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:09.304+0000 7f76c1e8a8c0 1 > prepared operation key=GZM0AQVHNCMM tag=6HW3BBG3WOGK type=write size=55755 2024-09-14T11:15:09.305 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:09.308+0000 7f76c1e8a8c0 1 < completed part key=_multipart_MEVTZ7OAD4CA.2~AXZ3RX690GD4.0 size=1048576 2024-09-14T11:15:09.307 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:09.308+0000 7f76c1e8a8c0 1 < completed part key=_multipart_MEVTZ7OAD4CA.2~AXZ3RX690GD4.1 size=1048576 2024-09-14T11:15:09.309 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:09.312+0000 7f76c1e8a8c0 1 < completed part key=_multipart_MEVTZ7OAD4CA.2~AXZ3RX690GD4.2 size=534367 2024-09-14T11:15:09.313 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:09.316+0000 7f76c1e8a8c0 1 < completed multipart upload key=MEVTZ7OAD4CA upload=AXZ3RX690GD4 tag=6FCVSK0ZT6PH type=write size=3680095 2024-09-14T11:15:09.316 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:09.316+0000 7f76c1e8a8c0 1 > prepared operation key=F3KFS0P1WM7W tag=8QGWJS8ADH7W type=del size=1480825 2024-09-14T11:15:09.320 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:09.324+0000 7f76c1e8a8c0 1 < suggested remove operation key=HJ701768A6I7 tag=ST7XVAC3EW3M type=del 2024-09-14T11:15:09.324 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:09.328+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_8PZOVFEYYSOG.2~M6ZRN1ZIUPNN.0 size=1048576 2024-09-14T11:15:09.326 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:09.328+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_8PZOVFEYYSOG.2~M6ZRN1ZIUPNN.1 size=1048576 2024-09-14T11:15:09.328 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:09.332+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_8PZOVFEYYSOG.2~M6ZRN1ZIUPNN.2 size=253296 2024-09-14T11:15:09.328 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:09.332+0000 7f76c1e8a8c0 1 > prepared multipart upload key=8PZOVFEYYSOG upload=M6ZRN1ZIUPNN tag=0O98GZXMN7S4 type=write size=3399024 2024-09-14T11:15:09.331 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:09.332+0000 7f76c1e8a8c0 1 < completed part key=_multipart_H9CQV6L29SL5.2~IBR8X6XCBVXL.0 size=1048576 2024-09-14T11:15:09.333 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:09.336+0000 7f76c1e8a8c0 1 < completed part key=_multipart_H9CQV6L29SL5.2~IBR8X6XCBVXL.1 size=1048576 2024-09-14T11:15:09.335 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:09.336+0000 7f76c1e8a8c0 1 < completed part key=_multipart_H9CQV6L29SL5.2~IBR8X6XCBVXL.2 size=181712 2024-09-14T11:15:09.341 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:09.344+0000 7f76c1e8a8c0 1 < completed multipart upload key=H9CQV6L29SL5 upload=IBR8X6XCBVXL tag=GLKY23OV0JWT type=write size=3327440 2024-09-14T11:15:09.345 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:09.348+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_85G6NT78HAWQ.2~BBUXP1QSFJHJ.0 size=1048576 2024-09-14T11:15:09.347 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:09.348+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_85G6NT78HAWQ.2~BBUXP1QSFJHJ.1 size=72364 2024-09-14T11:15:09.348 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:09.348+0000 7f76c1e8a8c0 1 > prepared multipart upload key=85G6NT78HAWQ upload=BBUXP1QSFJHJ tag=FA2ACCM1JVX2 type=write size=2169516 2024-09-14T11:15:09.350 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:09.352+0000 7f76c1e8a8c0 1 < completed part key=_multipart_SHKU2PRNREKK.2~Y29I1K0OFOK7.0 size=1048576 2024-09-14T11:15:09.352 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:09.356+0000 7f76c1e8a8c0 1 < completed part key=_multipart_SHKU2PRNREKK.2~Y29I1K0OFOK7.1 size=184727 2024-09-14T11:15:09.356 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:09.360+0000 7f76c1e8a8c0 1 < completed multipart upload key=SHKU2PRNREKK upload=Y29I1K0OFOK7 tag=CLNV22W7K6O2 type=write size=2281879 2024-09-14T11:15:09.360 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:09.364+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_8PZOVFEYYSOG.2~3YHA7M1550CW.0 size=1048576 2024-09-14T11:15:09.363 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:09.364+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_8PZOVFEYYSOG.2~3YHA7M1550CW.1 size=438336 2024-09-14T11:15:09.363 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:09.364+0000 7f76c1e8a8c0 1 > prepared multipart upload key=8PZOVFEYYSOG upload=3YHA7M1550CW tag=9WD4S4JBSCSG type=write size=2535488 2024-09-14T11:15:09.366 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:09.368+0000 7f76c1e8a8c0 1 < completed part key=_multipart_S43U13LYETS4.2~C2O3SYHZFZAN.0 size=1048576 2024-09-14T11:15:09.368 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:09.368+0000 7f76c1e8a8c0 1 < completed part key=_multipart_S43U13LYETS4.2~C2O3SYHZFZAN.1 size=1048576 2024-09-14T11:15:09.370 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:09.372+0000 7f76c1e8a8c0 1 < completed part key=_multipart_S43U13LYETS4.2~C2O3SYHZFZAN.2 size=645696 2024-09-14T11:15:09.374 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:09.376+0000 7f76c1e8a8c0 1 < completed multipart upload key=S43U13LYETS4 upload=C2O3SYHZFZAN tag=VJ6QZZJJLJE9 type=write size=3791424 2024-09-14T11:15:09.378 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:09.380+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_8PZOVFEYYSOG.2~Q3XOXFT4HET7.0 size=1048576 2024-09-14T11:15:09.380 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:09.384+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_8PZOVFEYYSOG.2~Q3XOXFT4HET7.1 size=404238 2024-09-14T11:15:09.381 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:09.384+0000 7f76c1e8a8c0 1 > prepared multipart upload key=8PZOVFEYYSOG upload=Q3XOXFT4HET7 tag=3H83632KEYX4 type=write size=2501390 2024-09-14T11:15:09.384 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:09.384+0000 7f76c1e8a8c0 -1 < failed to complete operation key=HJ701768A6I7 tag=Q7GLIR0EJXNE type=del size=960852: (22) Invalid argument 2024-09-14T11:15:09.387 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:09.388+0000 7f76c1e8a8c0 1 > prepared operation key=W0MDRE9YO3UP tag=P1YDMWOXLVYP type=del size=277290 2024-09-14T11:15:09.389 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:09.392+0000 7f76c1e8a8c0 1 < completed part key=_multipart_CIRQT9IDJ5OJ.2~2AU9922ODF8M.0 size=1048576 2024-09-14T11:15:09.391 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:09.392+0000 7f76c1e8a8c0 1 < completed part key=_multipart_CIRQT9IDJ5OJ.2~2AU9922ODF8M.1 size=1048576 2024-09-14T11:15:09.393 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:09.396+0000 7f76c1e8a8c0 1 < completed part key=_multipart_CIRQT9IDJ5OJ.2~2AU9922ODF8M.2 size=285779 2024-09-14T11:15:09.398 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:09.400+0000 7f76c1e8a8c0 1 < completed multipart upload key=CIRQT9IDJ5OJ upload=2AU9922ODF8M tag=T6X9LQSGPVFW type=write size=3431507 2024-09-14T11:15:09.402 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:09.404+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_SUNCRV0C1XYL.2~OMK12IUYRY87.0 size=1048576 2024-09-14T11:15:09.404 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:09.408+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_SUNCRV0C1XYL.2~OMK12IUYRY87.1 size=793334 2024-09-14T11:15:09.404 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:09.408+0000 7f76c1e8a8c0 1 > prepared multipart upload key=SUNCRV0C1XYL upload=OMK12IUYRY87 tag=SLI5GD4RT8HI type=write size=2890486 2024-09-14T11:15:09.407 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:09.408+0000 7f76c1e8a8c0 1 < completed part key=_multipart_HS7T50JORDQJ.2~002XN8R6EB0O.0 size=1048576 2024-09-14T11:15:09.409 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:09.412+0000 7f76c1e8a8c0 1 < completed part key=_multipart_HS7T50JORDQJ.2~002XN8R6EB0O.1 size=1048576 2024-09-14T11:15:09.411 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:09.412+0000 7f76c1e8a8c0 1 < completed part key=_multipart_HS7T50JORDQJ.2~002XN8R6EB0O.2 size=65313 2024-09-14T11:15:09.415 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:09.416+0000 7f76c1e8a8c0 1 < completed multipart upload key=HS7T50JORDQJ upload=002XN8R6EB0O tag=GIT2ESWW49CT type=write size=3211041 2024-09-14T11:15:09.419 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:09.420+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_K2EEZLRK7MVO.2~M7KXCQIGSOA9.0 size=299391 2024-09-14T11:15:09.419 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:09.420+0000 7f76c1e8a8c0 1 > prepared multipart upload key=K2EEZLRK7MVO upload=M7KXCQIGSOA9 tag=M6R73OCUOUN7 type=write size=1347967 2024-09-14T11:15:09.421 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:09.424+0000 7f76c1e8a8c0 1 < completed write operation key=F3KFS0P1WM7W tag=FJBWVCLNMKC3 type=write size=496778 2024-09-14T11:15:09.425 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:09.428+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_6TIJR323NMOH.2~KAX93LEVXE8K.0 size=485029 2024-09-14T11:15:09.425 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:09.428+0000 7f76c1e8a8c0 1 > prepared multipart upload key=6TIJR323NMOH upload=KAX93LEVXE8K tag=LMCXT812OR4O type=write size=1533605 2024-09-14T11:15:09.428 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:09.428+0000 7f76c1e8a8c0 1 < completed delete operation key=SUNCRV0C1XYL tag=JRLW4SM140N5 type=del 2024-09-14T11:15:09.433 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:09.436+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_Q5IY4J5FOD80.2~RMD0173OPZ5F.0 size=1048576 2024-09-14T11:15:09.435 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:09.436+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_Q5IY4J5FOD80.2~RMD0173OPZ5F.1 size=1048576 2024-09-14T11:15:09.437 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:09.440+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_Q5IY4J5FOD80.2~RMD0173OPZ5F.2 size=125299 2024-09-14T11:15:09.437 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:09.440+0000 7f76c1e8a8c0 1 > prepared multipart upload key=Q5IY4J5FOD80 upload=RMD0173OPZ5F tag=ERT6GT5QSSS1 type=write size=3271027 2024-09-14T11:15:09.440 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:09.444+0000 7f76c1e8a8c0 1 < completed part key=_multipart_K2EEZLRK7MVO.2~ZQP21B1TLLAW.0 size=1048576 2024-09-14T11:15:09.442 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:09.444+0000 7f76c1e8a8c0 1 < completed part key=_multipart_K2EEZLRK7MVO.2~ZQP21B1TLLAW.1 size=1048576 2024-09-14T11:15:09.445 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:09.448+0000 7f76c1e8a8c0 1 < completed part key=_multipart_K2EEZLRK7MVO.2~ZQP21B1TLLAW.2 size=445821 2024-09-14T11:15:09.449 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:09.452+0000 7f76c1e8a8c0 1 < completed multipart upload key=K2EEZLRK7MVO upload=ZQP21B1TLLAW tag=21Q7D2IC6KRX type=write size=3591549 2024-09-14T11:15:09.452 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:09.452+0000 7f76c1e8a8c0 1 > prepared operation key=15FU4CEGC22Q tag=UADIUMVKEO9Z type=del size=2576744 2024-09-14T11:15:09.455 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:09.456+0000 7f76c1e8a8c0 1 < completed part key=_multipart_SUNCRV0C1XYL.2~9ODWZFQLTA6J.0 size=1048576 2024-09-14T11:15:09.457 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:09.460+0000 7f76c1e8a8c0 1 < completed part key=_multipart_SUNCRV0C1XYL.2~9ODWZFQLTA6J.1 size=563105 2024-09-14T11:15:09.461 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:09.464+0000 7f76c1e8a8c0 1 < completed multipart upload key=SUNCRV0C1XYL upload=9ODWZFQLTA6J tag=U7YAXSZ7CNZ1 type=write size=2660257 2024-09-14T11:15:09.464 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:09.464+0000 7f76c1e8a8c0 1 > prepared operation key=CIRQT9IDJ5OJ tag=8E809LCF95KG type=del size=697245 2024-09-14T11:15:09.467 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:09.468+0000 7f76c1e8a8c0 -1 < failed to complete operation key=HJ701768A6I7 tag=AQ7FCXB4BY9J type=del size=808139: (22) Invalid argument 2024-09-14T11:15:09.472 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:09.472+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_HS7T50JORDQJ.2~P5G91EWFPW91.0 size=1048576 2024-09-14T11:15:09.474 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:09.476+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_HS7T50JORDQJ.2~P5G91EWFPW91.1 size=1048576 2024-09-14T11:15:09.476 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:09.476+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_HS7T50JORDQJ.2~P5G91EWFPW91.2 size=637544 2024-09-14T11:15:09.476 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:09.476+0000 7f76c1e8a8c0 1 > prepared multipart upload key=HS7T50JORDQJ upload=P5G91EWFPW91 tag=H1JF863HP5U5 type=write size=3783272 2024-09-14T11:15:09.479 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:09.480+0000 7f76c1e8a8c0 1 < completed delete operation key=6TIJR323NMOH tag=2XCI1RQQWKZW type=del 2024-09-14T11:15:09.484 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:09.484+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_BOCIF4TL7X7J.2~LV9SM0R6XEHT.0 size=431589 2024-09-14T11:15:09.484 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:09.484+0000 7f76c1e8a8c0 1 > prepared multipart upload key=BOCIF4TL7X7J upload=LV9SM0R6XEHT tag=3LC2HLS93DGA type=write size=1480165 2024-09-14T11:15:09.487 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:09.488+0000 7f76c1e8a8c0 1 < completed delete operation key=1K8ESNXU6WDF tag=F27DO5XXA3FM type=del 2024-09-14T11:15:09.489 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:09.492+0000 7f76c1e8a8c0 1 > prepared operation key=H9CQV6L29SL5 tag=2XO51UIZ0SS5 type=del size=3215905 2024-09-14T11:15:09.494 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:09.496+0000 7f76c1e8a8c0 1 < suggested remove operation key=GZM0AQVHNCMM tag=6HW3BBG3WOGK type=write 2024-09-14T11:15:09.498 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:09.500+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_F3KFS0P1WM7W.2~UJGOVUR00G0Z.0 size=1048576 2024-09-14T11:15:09.500 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:09.500+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_F3KFS0P1WM7W.2~UJGOVUR00G0Z.1 size=1048576 2024-09-14T11:15:09.501 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:09.504+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_F3KFS0P1WM7W.2~UJGOVUR00G0Z.2 size=5019 2024-09-14T11:15:09.502 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:09.504+0000 7f76c1e8a8c0 1 > prepared multipart upload key=F3KFS0P1WM7W upload=UJGOVUR00G0Z tag=5W4HRCBEHDYH type=write size=3150747 2024-09-14T11:15:09.504 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:09.504+0000 7f76c1e8a8c0 1 < completed delete operation key=F3KFS0P1WM7W tag=8QGWJS8ADH7W type=del 2024-09-14T11:15:09.507 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:09.508+0000 7f76c1e8a8c0 1 > prepared operation key=CIRQT9IDJ5OJ tag=KV3YI1BM6RBC type=del size=3297590 2024-09-14T11:15:09.509 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:09.512+0000 7f76c1e8a8c0 1 < completed part key=_multipart_8PZOVFEYYSOG.2~M6ZRN1ZIUPNN.0 size=1048576 2024-09-14T11:15:09.511 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:09.512+0000 7f76c1e8a8c0 1 < completed part key=_multipart_8PZOVFEYYSOG.2~M6ZRN1ZIUPNN.1 size=1048576 2024-09-14T11:15:09.513 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:09.516+0000 7f76c1e8a8c0 1 < completed part key=_multipart_8PZOVFEYYSOG.2~M6ZRN1ZIUPNN.2 size=253296 2024-09-14T11:15:09.516 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:09.520+0000 7f76c1e8a8c0 1 < completed multipart upload key=8PZOVFEYYSOG upload=M6ZRN1ZIUPNN tag=0O98GZXMN7S4 type=write size=3399024 2024-09-14T11:15:09.519 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:09.520+0000 7f76c1e8a8c0 1 > prepared operation key=OOUEM16XL80W tag=RQJUBB8GWFSL type=del size=417733 2024-09-14T11:15:09.521 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:09.524+0000 7f76c1e8a8c0 1 < completed part key=_multipart_85G6NT78HAWQ.2~BBUXP1QSFJHJ.0 size=1048576 2024-09-14T11:15:09.521 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:09.524+0000 7f76c1e8a8c0 1 < canceled part key=_multipart_85G6NT78HAWQ.2~BBUXP1QSFJHJ.1 size=72364 2024-09-14T11:15:09.524 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:09.528+0000 7f76c1e8a8c0 1 < canceled multipart upload key=85G6NT78HAWQ upload=BBUXP1QSFJHJ tag=FA2ACCM1JVX2 type=write size=2169516 2024-09-14T11:15:09.527 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:09.528+0000 7f76c1e8a8c0 1 > prepared operation key=TUFOZKTV9XIH tag=YSZ2427WSMMZ type=write size=278369 2024-09-14T11:15:09.529 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:09.532+0000 7f76c1e8a8c0 1 < completed part key=_multipart_8PZOVFEYYSOG.2~3YHA7M1550CW.0 size=1048576 2024-09-14T11:15:09.531 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:09.532+0000 7f76c1e8a8c0 1 < completed part key=_multipart_8PZOVFEYYSOG.2~3YHA7M1550CW.1 size=438336 2024-09-14T11:15:09.535 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:09.536+0000 7f76c1e8a8c0 1 < completed multipart upload key=8PZOVFEYYSOG upload=3YHA7M1550CW tag=9WD4S4JBSCSG type=write size=2535488 2024-09-14T11:15:09.537 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:09.540+0000 7f76c1e8a8c0 1 > prepared operation key=S43U13LYETS4 tag=SH53QBHK5QF4 type=del size=2877885 2024-09-14T11:15:09.539 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:09.540+0000 7f76c1e8a8c0 1 < completed part key=_multipart_8PZOVFEYYSOG.2~Q3XOXFT4HET7.0 size=1048576 2024-09-14T11:15:09.541 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:09.544+0000 7f76c1e8a8c0 1 < completed part key=_multipart_8PZOVFEYYSOG.2~Q3XOXFT4HET7.1 size=404238 2024-09-14T11:15:09.544 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:09.548+0000 7f76c1e8a8c0 1 < completed multipart upload key=8PZOVFEYYSOG upload=Q3XOXFT4HET7 tag=3H83632KEYX4 type=write size=2501390 2024-09-14T11:15:09.549 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:09.552+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_GAVZRU8ZLW7S.2~9F37JQQ5ZJGA.0 size=127241 2024-09-14T11:15:09.549 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:09.552+0000 7f76c1e8a8c0 1 > prepared multipart upload key=GAVZRU8ZLW7S upload=9F37JQQ5ZJGA tag=G3RDLO7929C1 type=write size=1175817 2024-09-14T11:15:09.551 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:09.552+0000 7f76c1e8a8c0 1 < completed delete operation key=W0MDRE9YO3UP tag=P1YDMWOXLVYP type=del 2024-09-14T11:15:09.555 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:09.556+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_8FFV9G6EQR8F.2~CG39KDPQVQBR.0 size=1048576 2024-09-14T11:15:09.557 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:09.560+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_8FFV9G6EQR8F.2~CG39KDPQVQBR.1 size=853038 2024-09-14T11:15:09.557 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:09.560+0000 7f76c1e8a8c0 1 > prepared multipart upload key=8FFV9G6EQR8F upload=CG39KDPQVQBR tag=XP8AW7W7SU5R type=write size=2950190 2024-09-14T11:15:09.559 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:09.560+0000 7f76c1e8a8c0 1 < completed part key=_multipart_SUNCRV0C1XYL.2~OMK12IUYRY87.0 size=1048576 2024-09-14T11:15:09.559 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:09.560+0000 7f76c1e8a8c0 1 < canceled part key=_multipart_SUNCRV0C1XYL.2~OMK12IUYRY87.1 size=793334 2024-09-14T11:15:09.564 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:09.564+0000 7f76c1e8a8c0 1 < canceled multipart upload key=SUNCRV0C1XYL upload=OMK12IUYRY87 tag=SLI5GD4RT8HI type=write size=2890486 2024-09-14T11:15:09.568 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:09.568+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_SHKU2PRNREKK.2~G19PLC94LT41.0 size=1048576 2024-09-14T11:15:09.570 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:09.572+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_SHKU2PRNREKK.2~G19PLC94LT41.1 size=137446 2024-09-14T11:15:09.570 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:09.572+0000 7f76c1e8a8c0 1 > prepared multipart upload key=SHKU2PRNREKK upload=G19PLC94LT41 tag=L033B0VUVTIM type=write size=2234598 2024-09-14T11:15:09.572 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:09.576+0000 7f76c1e8a8c0 1 < completed part key=_multipart_K2EEZLRK7MVO.2~M7KXCQIGSOA9.0 size=299391 2024-09-14T11:15:09.576 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:09.580+0000 7f76c1e8a8c0 1 < completed multipart upload key=K2EEZLRK7MVO upload=M7KXCQIGSOA9 tag=M6R73OCUOUN7 type=write size=1347967 2024-09-14T11:15:09.580 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:09.584+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_W0MDRE9YO3UP.2~39FHRMY6AFQJ.0 size=909272 2024-09-14T11:15:09.581 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:09.584+0000 7f76c1e8a8c0 1 > prepared multipart upload key=W0MDRE9YO3UP upload=39FHRMY6AFQJ tag=YSZKBQKNCPAO type=write size=1957848 2024-09-14T11:15:09.583 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:09.584+0000 7f76c1e8a8c0 1 < completed part key=_multipart_6TIJR323NMOH.2~KAX93LEVXE8K.0 size=485029 2024-09-14T11:15:09.587 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:09.588+0000 7f76c1e8a8c0 1 < completed multipart upload key=6TIJR323NMOH upload=KAX93LEVXE8K tag=LMCXT812OR4O type=write size=1533605 2024-09-14T11:15:09.589 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:09.592+0000 7f76c1e8a8c0 1 > prepared operation key=1K8ESNXU6WDF tag=WPYN2O96MCPX type=write size=690357 2024-09-14T11:15:09.592 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:09.592+0000 7f76c1e8a8c0 1 < completed part key=_multipart_Q5IY4J5FOD80.2~RMD0173OPZ5F.0 size=1048576 2024-09-14T11:15:09.592 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:09.592+0000 7f76c1e8a8c0 1 < canceled part key=_multipart_Q5IY4J5FOD80.2~RMD0173OPZ5F.1 size=1048576 2024-09-14T11:15:09.594 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:09.596+0000 7f76c1e8a8c0 1 < completed part key=_multipart_Q5IY4J5FOD80.2~RMD0173OPZ5F.2 size=125299 2024-09-14T11:15:09.598 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:09.600+0000 7f76c1e8a8c0 1 < canceled multipart upload key=Q5IY4J5FOD80 upload=RMD0173OPZ5F tag=ERT6GT5QSSS1 type=write size=3271027 2024-09-14T11:15:09.601 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:09.604+0000 7f76c1e8a8c0 1 > prepared operation key=BOCIF4TL7X7J tag=Y6I3HFO0FZWW type=del size=2039449 2024-09-14T11:15:09.603 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:09.604+0000 7f76c1e8a8c0 1 < completed delete operation key=15FU4CEGC22Q tag=UADIUMVKEO9Z type=del 2024-09-14T11:15:09.608 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:09.608+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_VI61O3K069BP.2~AB7QS4KB3ITQ.0 size=1048576 2024-09-14T11:15:09.610 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:09.612+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_VI61O3K069BP.2~AB7QS4KB3ITQ.1 size=514232 2024-09-14T11:15:09.610 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:09.612+0000 7f76c1e8a8c0 1 > prepared multipart upload key=VI61O3K069BP upload=AB7QS4KB3ITQ tag=GUO6PO5RQ2EI type=write size=2611384 2024-09-14T11:15:09.613 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:09.616+0000 7f76c1e8a8c0 1 < completed delete operation key=CIRQT9IDJ5OJ tag=8E809LCF95KG type=del 2024-09-14T11:15:09.617 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:09.620+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_8PZOVFEYYSOG.2~AN221QS079LM.0 size=1048576 2024-09-14T11:15:09.619 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:09.620+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_8PZOVFEYYSOG.2~AN221QS079LM.1 size=809583 2024-09-14T11:15:09.619 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:09.620+0000 7f76c1e8a8c0 1 > prepared multipart upload key=8PZOVFEYYSOG upload=AN221QS079LM tag=5ETO8OPXTVZ4 type=write size=2906735 2024-09-14T11:15:09.622 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:09.624+0000 7f76c1e8a8c0 1 < completed part key=_multipart_HS7T50JORDQJ.2~P5G91EWFPW91.0 size=1048576 2024-09-14T11:15:09.624 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:09.628+0000 7f76c1e8a8c0 1 < completed part key=_multipart_HS7T50JORDQJ.2~P5G91EWFPW91.1 size=1048576 2024-09-14T11:15:09.626 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:09.628+0000 7f76c1e8a8c0 1 < completed part key=_multipart_HS7T50JORDQJ.2~P5G91EWFPW91.2 size=637544 2024-09-14T11:15:09.630 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:09.632+0000 7f76c1e8a8c0 1 < completed multipart upload key=HS7T50JORDQJ upload=P5G91EWFPW91 tag=H1JF863HP5U5 type=write size=3783272 2024-09-14T11:15:09.633 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:09.636+0000 7f76c1e8a8c0 1 > prepared operation key=HS7T50JORDQJ tag=9X5CW4CU1NF7 type=del size=2969281 2024-09-14T11:15:09.636 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:09.636+0000 7f76c1e8a8c0 1 < completed part key=_multipart_BOCIF4TL7X7J.2~LV9SM0R6XEHT.0 size=431589 2024-09-14T11:15:09.640 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:09.644+0000 7f76c1e8a8c0 1 < completed multipart upload key=BOCIF4TL7X7J upload=LV9SM0R6XEHT tag=3LC2HLS93DGA type=write size=1480165 2024-09-14T11:15:09.645 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:09.648+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_W0MDRE9YO3UP.2~H2CC2PK8TY2Y.0 size=1048576 2024-09-14T11:15:09.647 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:09.648+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_W0MDRE9YO3UP.2~H2CC2PK8TY2Y.1 size=1048576 2024-09-14T11:15:09.650 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:09.652+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_W0MDRE9YO3UP.2~H2CC2PK8TY2Y.2 size=311782 2024-09-14T11:15:09.650 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:09.652+0000 7f76c1e8a8c0 1 > prepared multipart upload key=W0MDRE9YO3UP upload=H2CC2PK8TY2Y tag=FEOXL7QQBCT1 type=write size=3457510 2024-09-14T11:15:09.652 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:09.656+0000 7f76c1e8a8c0 1 < completed delete operation key=H9CQV6L29SL5 tag=2XO51UIZ0SS5 type=del 2024-09-14T11:15:09.658 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:09.660+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_HJ701768A6I7.2~N41MHP2KEZOQ.0 size=1048576 2024-09-14T11:15:09.660 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:09.660+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_HJ701768A6I7.2~N41MHP2KEZOQ.1 size=1048576 2024-09-14T11:15:09.662 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:09.664+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_HJ701768A6I7.2~N41MHP2KEZOQ.2 size=838666 2024-09-14T11:15:09.662 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:09.664+0000 7f76c1e8a8c0 1 > prepared multipart upload key=HJ701768A6I7 upload=N41MHP2KEZOQ tag=G7D7KORXLXP8 type=write size=3984394 2024-09-14T11:15:09.665 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:09.668+0000 7f76c1e8a8c0 1 < completed part key=_multipart_F3KFS0P1WM7W.2~UJGOVUR00G0Z.0 size=1048576 2024-09-14T11:15:09.667 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:09.668+0000 7f76c1e8a8c0 1 < completed part key=_multipart_F3KFS0P1WM7W.2~UJGOVUR00G0Z.1 size=1048576 2024-09-14T11:15:09.670 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:09.672+0000 7f76c1e8a8c0 1 < completed part key=_multipart_F3KFS0P1WM7W.2~UJGOVUR00G0Z.2 size=5019 2024-09-14T11:15:09.676 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:09.676+0000 7f76c1e8a8c0 1 < completed multipart upload key=F3KFS0P1WM7W upload=UJGOVUR00G0Z tag=5W4HRCBEHDYH type=write size=3150747 2024-09-14T11:15:09.681 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:09.684+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_HS7T50JORDQJ.2~E79LJHIDQLHJ.0 size=861153 2024-09-14T11:15:09.681 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:09.684+0000 7f76c1e8a8c0 1 > prepared multipart upload key=HS7T50JORDQJ upload=E79LJHIDQLHJ tag=NN0SS2NCAWTW type=write size=1909729 2024-09-14T11:15:09.684 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:09.688+0000 7f76c1e8a8c0 1 < completed delete operation key=CIRQT9IDJ5OJ tag=KV3YI1BM6RBC type=del 2024-09-14T11:15:09.687 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:09.688+0000 7f76c1e8a8c0 1 > prepared operation key=SUNCRV0C1XYL tag=ZI8H1G1D9EAM type=del size=3777246 2024-09-14T11:15:09.692 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:09.696+0000 7f76c1e8a8c0 1 < suggested remove operation key=OOUEM16XL80W tag=RQJUBB8GWFSL type=del 2024-09-14T11:15:09.697 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:09.700+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_SHKU2PRNREKK.2~PMJWAY2S2ZD2.0 size=1048576 2024-09-14T11:15:09.699 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:09.700+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_SHKU2PRNREKK.2~PMJWAY2S2ZD2.1 size=1048576 2024-09-14T11:15:09.701 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:09.704+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_SHKU2PRNREKK.2~PMJWAY2S2ZD2.2 size=996988 2024-09-14T11:15:09.702 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:09.704+0000 7f76c1e8a8c0 1 > prepared multipart upload key=SHKU2PRNREKK upload=PMJWAY2S2ZD2 tag=QBE73MGF1TMQ type=write size=4142716 2024-09-14T11:15:09.704 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:09.708+0000 7f76c1e8a8c0 1 < completed write operation key=TUFOZKTV9XIH tag=YSZ2427WSMMZ type=write size=278369 2024-09-14T11:15:09.707 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:09.708+0000 7f76c1e8a8c0 1 > prepared operation key=KS37ZO6MKAH9 tag=8HYOBXPMWN23 type=write size=239858 2024-09-14T11:15:09.713 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:09.716+0000 7f76c1e8a8c0 1 < suggested remove operation key=S43U13LYETS4 tag=SH53QBHK5QF4 type=del 2024-09-14T11:15:09.716 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:09.716+0000 7f76c1e8a8c0 1 > prepared operation key=KS37ZO6MKAH9 tag=4SHSR1LZJ0LV type=del size=4132055 2024-09-14T11:15:09.719 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:09.720+0000 7f76c1e8a8c0 1 < completed part key=_multipart_GAVZRU8ZLW7S.2~9F37JQQ5ZJGA.0 size=127241 2024-09-14T11:15:09.724 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:09.724+0000 7f76c1e8a8c0 1 < completed multipart upload key=GAVZRU8ZLW7S upload=9F37JQQ5ZJGA tag=G3RDLO7929C1 type=write size=1175817 2024-09-14T11:15:09.726 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:09.728+0000 7f76c1e8a8c0 1 > prepared operation key=W0MDRE9YO3UP tag=JFFN3XV1WIWR type=del size=2327035 2024-09-14T11:15:09.730 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:09.732+0000 7f76c1e8a8c0 1 < completed part key=_multipart_8FFV9G6EQR8F.2~CG39KDPQVQBR.0 size=1048576 2024-09-14T11:15:09.732 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:09.732+0000 7f76c1e8a8c0 1 < completed part key=_multipart_8FFV9G6EQR8F.2~CG39KDPQVQBR.1 size=853038 2024-09-14T11:15:09.736 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:09.740+0000 7f76c1e8a8c0 1 < completed multipart upload key=8FFV9G6EQR8F upload=CG39KDPQVQBR tag=XP8AW7W7SU5R type=write size=2950190 2024-09-14T11:15:09.741 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:09.744+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_BOCIF4TL7X7J.2~KOAIQ2J1I02W.0 size=1048576 2024-09-14T11:15:09.743 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:09.744+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_BOCIF4TL7X7J.2~KOAIQ2J1I02W.1 size=1048576 2024-09-14T11:15:09.745 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:09.748+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_BOCIF4TL7X7J.2~KOAIQ2J1I02W.2 size=1039512 2024-09-14T11:15:09.745 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:09.748+0000 7f76c1e8a8c0 1 > prepared multipart upload key=BOCIF4TL7X7J upload=KOAIQ2J1I02W tag=I5PCXX9JAFLQ type=write size=4185240 2024-09-14T11:15:09.748 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:09.748+0000 7f76c1e8a8c0 1 < completed part key=_multipart_SHKU2PRNREKK.2~G19PLC94LT41.0 size=1048576 2024-09-14T11:15:09.750 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:09.752+0000 7f76c1e8a8c0 1 < completed part key=_multipart_SHKU2PRNREKK.2~G19PLC94LT41.1 size=137446 2024-09-14T11:15:09.754 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:09.756+0000 7f76c1e8a8c0 1 < completed multipart upload key=SHKU2PRNREKK upload=G19PLC94LT41 tag=L033B0VUVTIM type=write size=2234598 2024-09-14T11:15:09.759 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:09.760+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_K9W031V6BFJP.2~4GAUHW7IPPDD.0 size=1048576 2024-09-14T11:15:09.762 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:09.764+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_K9W031V6BFJP.2~4GAUHW7IPPDD.1 size=1048576 2024-09-14T11:15:09.765 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:09.768+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_K9W031V6BFJP.2~4GAUHW7IPPDD.2 size=790027 2024-09-14T11:15:09.765 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:09.768+0000 7f76c1e8a8c0 1 > prepared multipart upload key=K9W031V6BFJP upload=4GAUHW7IPPDD tag=IBZI2SLVB12F type=write size=3935755 2024-09-14T11:15:09.768 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:09.768+0000 7f76c1e8a8c0 1 < completed part key=_multipart_W0MDRE9YO3UP.2~39FHRMY6AFQJ.0 size=909272 2024-09-14T11:15:09.774 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:09.776+0000 7f76c1e8a8c0 1 < completed multipart upload key=W0MDRE9YO3UP upload=39FHRMY6AFQJ tag=YSZKBQKNCPAO type=write size=1957848 2024-09-14T11:15:09.777 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:09.780+0000 7f76c1e8a8c0 1 > prepared operation key=BOCIF4TL7X7J tag=ATUXEVAXZC3F type=write size=929233 2024-09-14T11:15:09.784 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:09.784+0000 7f76c1e8a8c0 1 < suggested remove operation key=1K8ESNXU6WDF tag=WPYN2O96MCPX type=write 2024-09-14T11:15:09.789 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:09.792+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_HS7T50JORDQJ.2~WQHALQBTTW29.0 size=1048576 2024-09-14T11:15:09.792 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:09.792+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_HS7T50JORDQJ.2~WQHALQBTTW29.1 size=823343 2024-09-14T11:15:09.792 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:09.792+0000 7f76c1e8a8c0 1 > prepared multipart upload key=HS7T50JORDQJ upload=WQHALQBTTW29 tag=IL40KSQ0D1A3 type=write size=2920495 2024-09-14T11:15:09.795 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:09.796+0000 7f76c1e8a8c0 1 < completed delete operation key=BOCIF4TL7X7J tag=Y6I3HFO0FZWW type=del 2024-09-14T11:15:09.798 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:09.800+0000 7f76c1e8a8c0 1 > prepared operation key=OOUEM16XL80W tag=7NP9HV57CAFS type=del size=1250862 2024-09-14T11:15:09.802 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:09.804+0000 7f76c1e8a8c0 1 < completed part key=_multipart_VI61O3K069BP.2~AB7QS4KB3ITQ.0 size=1048576 2024-09-14T11:15:09.804 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:09.808+0000 7f76c1e8a8c0 1 < completed part key=_multipart_VI61O3K069BP.2~AB7QS4KB3ITQ.1 size=514232 2024-09-14T11:15:09.809 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:09.812+0000 7f76c1e8a8c0 1 < completed multipart upload key=VI61O3K069BP upload=AB7QS4KB3ITQ tag=GUO6PO5RQ2EI type=write size=2611384 2024-09-14T11:15:09.815 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:09.816+0000 7f76c1e8a8c0 1 > prepared operation key=XC8VWSHZOPFP tag=FWRBRK0U3JT3 type=write size=682083 2024-09-14T11:15:09.817 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:09.820+0000 7f76c1e8a8c0 1 < completed part key=_multipart_8PZOVFEYYSOG.2~AN221QS079LM.0 size=1048576 2024-09-14T11:15:09.817 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:09.820+0000 7f76c1e8a8c0 1 < canceled part key=_multipart_8PZOVFEYYSOG.2~AN221QS079LM.1 size=809583 2024-09-14T11:15:09.822 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:09.824+0000 7f76c1e8a8c0 1 < canceled multipart upload key=8PZOVFEYYSOG upload=AN221QS079LM tag=5ETO8OPXTVZ4 type=write size=2906735 2024-09-14T11:15:09.825 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:09.828+0000 7f76c1e8a8c0 1 > prepared operation key=OUMUTEBQ1TD0 tag=81GNVIBLL8SW type=del size=3316183 2024-09-14T11:15:09.828 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:09.832+0000 7f76c1e8a8c0 1 < completed delete operation key=HS7T50JORDQJ tag=9X5CW4CU1NF7 type=del 2024-09-14T11:15:09.831 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:09.832+0000 7f76c1e8a8c0 1 > prepared operation key=OOUEM16XL80W tag=RZ4DW64YMOYP type=del size=1948896 2024-09-14T11:15:09.834 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:09.836+0000 7f76c1e8a8c0 1 < completed part key=_multipart_W0MDRE9YO3UP.2~H2CC2PK8TY2Y.0 size=1048576 2024-09-14T11:15:09.836 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:09.840+0000 7f76c1e8a8c0 1 < completed part key=_multipart_W0MDRE9YO3UP.2~H2CC2PK8TY2Y.1 size=1048576 2024-09-14T11:15:09.836 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:09.840+0000 7f76c1e8a8c0 1 < canceled part key=_multipart_W0MDRE9YO3UP.2~H2CC2PK8TY2Y.2 size=311782 2024-09-14T11:15:09.841 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:09.844+0000 7f76c1e8a8c0 1 < canceled multipart upload key=W0MDRE9YO3UP upload=H2CC2PK8TY2Y tag=FEOXL7QQBCT1 type=write size=3457510 2024-09-14T11:15:09.844 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:09.844+0000 7f76c1e8a8c0 1 > prepared operation key=CIRQT9IDJ5OJ tag=VTWDIWDXAQ3O type=write size=539743 2024-09-14T11:15:09.846 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:09.848+0000 7f76c1e8a8c0 1 < completed part key=_multipart_HJ701768A6I7.2~N41MHP2KEZOQ.0 size=1048576 2024-09-14T11:15:09.848 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:09.848+0000 7f76c1e8a8c0 1 < completed part key=_multipart_HJ701768A6I7.2~N41MHP2KEZOQ.1 size=1048576 2024-09-14T11:15:09.850 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:09.852+0000 7f76c1e8a8c0 1 < completed part key=_multipart_HJ701768A6I7.2~N41MHP2KEZOQ.2 size=838666 2024-09-14T11:15:09.854 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:09.856+0000 7f76c1e8a8c0 1 < completed multipart upload key=HJ701768A6I7 upload=N41MHP2KEZOQ tag=G7D7KORXLXP8 type=write size=3984394 2024-09-14T11:15:09.856 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:09.860+0000 7f76c1e8a8c0 1 > prepared operation key=F3KFS0P1WM7W tag=GAT8PLDD9JAW type=del size=723188 2024-09-14T11:15:09.859 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:09.860+0000 7f76c1e8a8c0 1 < completed part key=_multipart_HS7T50JORDQJ.2~E79LJHIDQLHJ.0 size=861153 2024-09-14T11:15:09.863 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:09.864+0000 7f76c1e8a8c0 1 < completed multipart upload key=HS7T50JORDQJ upload=E79LJHIDQLHJ tag=NN0SS2NCAWTW type=write size=1909729 2024-09-14T11:15:09.865 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:09.868+0000 7f76c1e8a8c0 1 > prepared operation key=6TIJR323NMOH tag=DXZTZNOM8FL1 type=del size=2241128 2024-09-14T11:15:09.868 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:09.868+0000 7f76c1e8a8c0 1 < completed delete operation key=SUNCRV0C1XYL tag=ZI8H1G1D9EAM type=del 2024-09-14T11:15:09.872 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:09.872+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_W0MDRE9YO3UP.2~YI6U592EJWOH.0 size=339028 2024-09-14T11:15:09.872 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:09.872+0000 7f76c1e8a8c0 1 > prepared multipart upload key=W0MDRE9YO3UP upload=YI6U592EJWOH tag=KYEZGB3344NB type=write size=1387604 2024-09-14T11:15:09.875 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:09.876+0000 7f76c1e8a8c0 1 < completed part key=_multipart_SHKU2PRNREKK.2~PMJWAY2S2ZD2.0 size=1048576 2024-09-14T11:15:09.877 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:09.880+0000 7f76c1e8a8c0 1 < completed part key=_multipart_SHKU2PRNREKK.2~PMJWAY2S2ZD2.1 size=1048576 2024-09-14T11:15:09.878 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:09.880+0000 7f76c1e8a8c0 1 < completed part key=_multipart_SHKU2PRNREKK.2~PMJWAY2S2ZD2.2 size=996988 2024-09-14T11:15:09.882 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:09.884+0000 7f76c1e8a8c0 1 < completed multipart upload key=SHKU2PRNREKK upload=PMJWAY2S2ZD2 tag=QBE73MGF1TMQ type=write size=4142716 2024-09-14T11:15:09.885 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:09.888+0000 7f76c1e8a8c0 1 > prepared operation key=SHKU2PRNREKK tag=F7CQMT0SZTJ3 type=del size=3394144 2024-09-14T11:15:09.889 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:09.892+0000 7f76c1e8a8c0 1 < suggested update operation key=KS37ZO6MKAH9 tag=8HYOBXPMWN23 type=write size=239858 2024-09-14T11:15:09.892 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:09.892+0000 7f76c1e8a8c0 1 > prepared operation key=OOUEM16XL80W tag=001RYW5XRWRB type=del size=1384629 2024-09-14T11:15:09.894 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:09.896+0000 7f76c1e8a8c0 -1 < failed to complete operation key=KS37ZO6MKAH9 tag=4SHSR1LZJ0LV type=del size=4132055: (22) Invalid argument 2024-09-14T11:15:09.896 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:09.900+0000 7f76c1e8a8c0 1 > prepared operation key=HJ701768A6I7 tag=DUOWEBCXVY8X type=del size=1666012 2024-09-14T11:15:09.899 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:09.900+0000 7f76c1e8a8c0 1 < completed delete operation key=W0MDRE9YO3UP tag=JFFN3XV1WIWR type=del 2024-09-14T11:15:09.901 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:09.904+0000 7f76c1e8a8c0 1 > prepared operation key=CIRQT9IDJ5OJ tag=1X08UO6LJZQQ type=del size=3908539 2024-09-14T11:15:09.904 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:09.904+0000 7f76c1e8a8c0 1 < completed part key=_multipart_BOCIF4TL7X7J.2~KOAIQ2J1I02W.0 size=1048576 2024-09-14T11:15:09.906 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:09.908+0000 7f76c1e8a8c0 1 < completed part key=_multipart_BOCIF4TL7X7J.2~KOAIQ2J1I02W.1 size=1048576 2024-09-14T11:15:09.908 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:09.908+0000 7f76c1e8a8c0 1 < completed part key=_multipart_BOCIF4TL7X7J.2~KOAIQ2J1I02W.2 size=1039512 2024-09-14T11:15:09.912 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:09.916+0000 7f76c1e8a8c0 1 < completed multipart upload key=BOCIF4TL7X7J upload=KOAIQ2J1I02W tag=I5PCXX9JAFLQ type=write size=4185240 2024-09-14T11:15:09.915 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:09.916+0000 7f76c1e8a8c0 1 > prepared operation key=8PZOVFEYYSOG tag=K0X6D3OXSJYH type=del size=1515465 2024-09-14T11:15:09.917 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:09.920+0000 7f76c1e8a8c0 1 < completed part key=_multipart_K9W031V6BFJP.2~4GAUHW7IPPDD.0 size=1048576 2024-09-14T11:15:09.918 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:09.920+0000 7f76c1e8a8c0 1 < canceled part key=_multipart_K9W031V6BFJP.2~4GAUHW7IPPDD.1 size=1048576 2024-09-14T11:15:09.920 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:09.920+0000 7f76c1e8a8c0 1 < completed part key=_multipart_K9W031V6BFJP.2~4GAUHW7IPPDD.2 size=790027 2024-09-14T11:15:09.924 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:09.928+0000 7f76c1e8a8c0 1 < canceled multipart upload key=K9W031V6BFJP upload=4GAUHW7IPPDD tag=IBZI2SLVB12F type=write size=3935755 2024-09-14T11:15:09.929 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:09.932+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_Q5IY4J5FOD80.2~0FNEA8IIW6T4.0 size=1048576 2024-09-14T11:15:09.931 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:09.932+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_Q5IY4J5FOD80.2~0FNEA8IIW6T4.1 size=784100 2024-09-14T11:15:09.931 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:09.932+0000 7f76c1e8a8c0 1 > prepared multipart upload key=Q5IY4J5FOD80 upload=0FNEA8IIW6T4 tag=TSVHP1VUTEBB type=write size=2881252 2024-09-14T11:15:09.934 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:09.936+0000 7f76c1e8a8c0 1 < completed write operation key=BOCIF4TL7X7J tag=ATUXEVAXZC3F type=write size=929233 2024-09-14T11:15:09.937 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:09.940+0000 7f76c1e8a8c0 1 > prepared operation key=W0MDRE9YO3UP tag=XR7YM9BP7BVP type=del size=3404427 2024-09-14T11:15:09.941 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:09.944+0000 7f76c1e8a8c0 1 < completed part key=_multipart_HS7T50JORDQJ.2~WQHALQBTTW29.0 size=1048576 2024-09-14T11:15:09.943 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:09.944+0000 7f76c1e8a8c0 1 < completed part key=_multipart_HS7T50JORDQJ.2~WQHALQBTTW29.1 size=823343 2024-09-14T11:15:09.947 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:09.948+0000 7f76c1e8a8c0 1 < completed multipart upload key=HS7T50JORDQJ upload=WQHALQBTTW29 tag=IL40KSQ0D1A3 type=write size=2920495 2024-09-14T11:15:09.949 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:09.952+0000 7f76c1e8a8c0 1 > prepared operation key=OUMUTEBQ1TD0 tag=C771T7HS6EAU type=del size=3761766 2024-09-14T11:15:09.952 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:09.952+0000 7f76c1e8a8c0 1 < completed delete operation key=OOUEM16XL80W tag=7NP9HV57CAFS type=del 2024-09-14T11:15:09.956 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:09.960+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_BOCIF4TL7X7J.2~WTLO4SRVBNGH.0 size=200953 2024-09-14T11:15:09.956 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:09.960+0000 7f76c1e8a8c0 1 > prepared multipart upload key=BOCIF4TL7X7J upload=WTLO4SRVBNGH tag=CZJPHP90JKOQ type=write size=1249529 2024-09-14T11:15:09.961 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:09.964+0000 7f76c1e8a8c0 1 < suggested remove operation key=XC8VWSHZOPFP tag=FWRBRK0U3JT3 type=write 2024-09-14T11:15:09.965 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:09.968+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_SUNCRV0C1XYL.2~M9R09ZIEHA62.0 size=192545 2024-09-14T11:15:09.965 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:09.968+0000 7f76c1e8a8c0 1 > prepared multipart upload key=SUNCRV0C1XYL upload=M9R09ZIEHA62 tag=SFQBMD0G0MNP type=write size=1241121 2024-09-14T11:15:09.968 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:09.972+0000 7f76c1e8a8c0 1 < completed delete operation key=OUMUTEBQ1TD0 tag=81GNVIBLL8SW type=del 2024-09-14T11:15:09.972 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:09.976+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_1W5733SDHGDN.2~HAOIGR0FAV45.0 size=1048576 2024-09-14T11:15:09.974 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:09.976+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_1W5733SDHGDN.2~HAOIGR0FAV45.1 size=188737 2024-09-14T11:15:09.974 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:09.976+0000 7f76c1e8a8c0 1 > prepared multipart upload key=1W5733SDHGDN upload=HAOIGR0FAV45 tag=E5RT3D3PYIJC type=write size=2285889 2024-09-14T11:15:09.976 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:09.980+0000 7f76c1e8a8c0 1 < completed delete operation key=OOUEM16XL80W tag=RZ4DW64YMOYP type=del 2024-09-14T11:15:09.978 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:09.980+0000 7f76c1e8a8c0 1 > prepared operation key=GAVZRU8ZLW7S tag=JE63K0J3VMX1 type=del size=130403 2024-09-14T11:15:09.980 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:09.984+0000 7f76c1e8a8c0 1 < completed write operation key=CIRQT9IDJ5OJ tag=VTWDIWDXAQ3O type=write size=539743 2024-09-14T11:15:09.983 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:09.984+0000 7f76c1e8a8c0 1 > prepared operation key=85G6NT78HAWQ tag=7N52GUG9KN1U type=del size=3800199 2024-09-14T11:15:09.985 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:09.988+0000 7f76c1e8a8c0 1 < canceled operation key=F3KFS0P1WM7W tag=GAT8PLDD9JAW type=del size=723188 2024-09-14T11:15:09.989 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:09.992+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_8PZOVFEYYSOG.2~DA0OL8W24XT6.0 size=1048576 2024-09-14T11:15:09.991 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:09.992+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_8PZOVFEYYSOG.2~DA0OL8W24XT6.1 size=397679 2024-09-14T11:15:09.991 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:09.992+0000 7f76c1e8a8c0 1 > prepared multipart upload key=8PZOVFEYYSOG upload=DA0OL8W24XT6 tag=K9GZHDR29Z28 type=write size=2494831 2024-09-14T11:15:09.993 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:09.996+0000 7f76c1e8a8c0 1 < completed delete operation key=6TIJR323NMOH tag=DXZTZNOM8FL1 type=del 2024-09-14T11:15:09.996 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:09.996+0000 7f76c1e8a8c0 1 > prepared operation key=K2EEZLRK7MVO tag=0AR2V7TWLFS5 type=del size=307945 2024-09-14T11:15:09.999 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:10.000+0000 7f76c1e8a8c0 1 < completed part key=_multipart_W0MDRE9YO3UP.2~YI6U592EJWOH.0 size=339028 2024-09-14T11:15:10.003 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:10.004+0000 7f76c1e8a8c0 1 < completed multipart upload key=W0MDRE9YO3UP upload=YI6U592EJWOH tag=KYEZGB3344NB type=write size=1387604 2024-09-14T11:15:10.005 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:10.008+0000 7f76c1e8a8c0 1 > prepared operation key=SHKU2PRNREKK tag=MRB7YXONST74 type=write size=1038585 2024-09-14T11:15:10.007 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:10.008+0000 7f76c1e8a8c0 1 < completed delete operation key=SHKU2PRNREKK tag=F7CQMT0SZTJ3 type=del 2024-09-14T11:15:10.009 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:10.012+0000 7f76c1e8a8c0 1 > prepared operation key=R5I9H7WAK7Z7 tag=K5K3NSY6N0EX type=del size=3484951 2024-09-14T11:15:10.013 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:10.016+0000 7f76c1e8a8c0 1 < suggested remove operation key=OOUEM16XL80W tag=001RYW5XRWRB type=del 2024-09-14T11:15:10.017 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:10.020+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_1K8ESNXU6WDF.2~2NR5HTPVMBT8.0 size=820992 2024-09-14T11:15:10.017 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:10.020+0000 7f76c1e8a8c0 1 > prepared multipart upload key=1K8ESNXU6WDF upload=2NR5HTPVMBT8 tag=YH117WJHL3E6 type=write size=1869568 2024-09-14T11:15:10.019 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:10.020+0000 7f76c1e8a8c0 1 < completed delete operation key=HJ701768A6I7 tag=DUOWEBCXVY8X type=del 2024-09-14T11:15:10.021 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:10.024+0000 7f76c1e8a8c0 1 > prepared operation key=GZM0AQVHNCMM tag=TDHDST4CHDBH type=del size=1906944 2024-09-14T11:15:10.022 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:10.024+0000 7f76c1e8a8c0 1 < completed delete operation key=CIRQT9IDJ5OJ tag=1X08UO6LJZQQ type=del 2024-09-14T11:15:10.026 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:10.028+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_8PZOVFEYYSOG.2~2APB2RREQTUA.0 size=252375 2024-09-14T11:15:10.026 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:10.028+0000 7f76c1e8a8c0 1 > prepared multipart upload key=8PZOVFEYYSOG upload=2APB2RREQTUA tag=G4SF6QU7BW6Q type=write size=1300951 2024-09-14T11:15:10.028 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:10.028+0000 7f76c1e8a8c0 1 < completed delete operation key=8PZOVFEYYSOG tag=K0X6D3OXSJYH type=del 2024-09-14T11:15:10.030 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:10.032+0000 7f76c1e8a8c0 1 > prepared operation key=SHKU2PRNREKK tag=RJLTGP55WSR1 type=del size=3439961 2024-09-14T11:15:10.032 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:10.032+0000 7f76c1e8a8c0 1 < completed part key=_multipart_Q5IY4J5FOD80.2~0FNEA8IIW6T4.0 size=1048576 2024-09-14T11:15:10.034 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:10.036+0000 7f76c1e8a8c0 1 < completed part key=_multipart_Q5IY4J5FOD80.2~0FNEA8IIW6T4.1 size=784100 2024-09-14T11:15:10.037 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:10.040+0000 7f76c1e8a8c0 1 < completed multipart upload key=Q5IY4J5FOD80 upload=0FNEA8IIW6T4 tag=TSVHP1VUTEBB type=write size=2881252 2024-09-14T11:15:10.041 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:10.044+0000 7f76c1e8a8c0 1 > prepared operation key=R5I9H7WAK7Z7 tag=1HH96TZB8TE1 type=write size=681920 2024-09-14T11:15:10.045 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:10.048+0000 7f76c1e8a8c0 1 < suggested update operation key=W0MDRE9YO3UP tag=XR7YM9BP7BVP type=del size=3404427 2024-09-14T11:15:10.049 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:10.052+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_SUNCRV0C1XYL.2~YVH9HOL078DO.0 size=1048576 2024-09-14T11:15:10.050 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:10.052+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_SUNCRV0C1XYL.2~YVH9HOL078DO.1 size=1048576 2024-09-14T11:15:10.052 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:10.052+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_SUNCRV0C1XYL.2~YVH9HOL078DO.2 size=309535 2024-09-14T11:15:10.052 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:10.052+0000 7f76c1e8a8c0 1 > prepared multipart upload key=SUNCRV0C1XYL upload=YVH9HOL078DO tag=6UVCQV48R5HU type=write size=3455263 2024-09-14T11:15:10.054 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:10.056+0000 7f76c1e8a8c0 1 < completed delete operation key=OUMUTEBQ1TD0 tag=C771T7HS6EAU type=del 2024-09-14T11:15:10.056 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:10.060+0000 7f76c1e8a8c0 1 > prepared operation key=LZ0YNFOVFYCL tag=HPNLSGQUDJN7 type=del size=4143410 2024-09-14T11:15:10.059 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:10.060+0000 7f76c1e8a8c0 1 < completed part key=_multipart_BOCIF4TL7X7J.2~WTLO4SRVBNGH.0 size=200953 2024-09-14T11:15:10.062 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:10.064+0000 7f76c1e8a8c0 1 < completed multipart upload key=BOCIF4TL7X7J upload=WTLO4SRVBNGH tag=CZJPHP90JKOQ type=write size=1249529 2024-09-14T11:15:10.064 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:10.068+0000 7f76c1e8a8c0 1 > prepared operation key=HJ701768A6I7 tag=RFSE16YOZB1O type=del size=1816907 2024-09-14T11:15:10.066 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:10.068+0000 7f76c1e8a8c0 1 < completed part key=_multipart_SUNCRV0C1XYL.2~M9R09ZIEHA62.0 size=192545 2024-09-14T11:15:10.070 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:10.072+0000 7f76c1e8a8c0 1 < completed multipart upload key=SUNCRV0C1XYL upload=M9R09ZIEHA62 tag=SFQBMD0G0MNP type=write size=1241121 2024-09-14T11:15:10.072 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:10.076+0000 7f76c1e8a8c0 1 > prepared operation key=R5I9H7WAK7Z7 tag=6VRCE9GY1HJ0 type=del size=691773 2024-09-14T11:15:10.075 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:10.076+0000 7f76c1e8a8c0 1 < completed part key=_multipart_1W5733SDHGDN.2~HAOIGR0FAV45.0 size=1048576 2024-09-14T11:15:10.076 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:10.080+0000 7f76c1e8a8c0 1 < completed part key=_multipart_1W5733SDHGDN.2~HAOIGR0FAV45.1 size=188737 2024-09-14T11:15:10.080 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:10.080+0000 7f76c1e8a8c0 1 < completed multipart upload key=1W5733SDHGDN upload=HAOIGR0FAV45 tag=E5RT3D3PYIJC type=write size=2285889 2024-09-14T11:15:10.083 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:10.084+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_MEVTZ7OAD4CA.2~L2CVG4Y331H4.0 size=1048576 2024-09-14T11:15:10.085 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:10.088+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_MEVTZ7OAD4CA.2~L2CVG4Y331H4.1 size=1048576 2024-09-14T11:15:10.087 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:10.088+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_MEVTZ7OAD4CA.2~L2CVG4Y331H4.2 size=1044224 2024-09-14T11:15:10.087 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:10.088+0000 7f76c1e8a8c0 1 > prepared multipart upload key=MEVTZ7OAD4CA upload=L2CVG4Y331H4 tag=432R7EXA497Y type=write size=4189952 2024-09-14T11:15:10.090 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:10.092+0000 7f76c1e8a8c0 1 < completed delete operation key=GAVZRU8ZLW7S tag=JE63K0J3VMX1 type=del 2024-09-14T11:15:10.093 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:10.096+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_8PZOVFEYYSOG.2~3YFFZW1D838J.0 size=499117 2024-09-14T11:15:10.093 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:10.096+0000 7f76c1e8a8c0 1 > prepared multipart upload key=8PZOVFEYYSOG upload=3YFFZW1D838J tag=DCD8FZCAYJN4 type=write size=1547693 2024-09-14T11:15:10.096 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:10.096+0000 7f76c1e8a8c0 1 < completed delete operation key=85G6NT78HAWQ tag=7N52GUG9KN1U type=del 2024-09-14T11:15:10.098 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:10.100+0000 7f76c1e8a8c0 1 > prepared operation key=1W5733SDHGDN tag=E541JA03UR2J type=write size=671696 2024-09-14T11:15:10.100 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:10.100+0000 7f76c1e8a8c0 1 < completed part key=_multipart_8PZOVFEYYSOG.2~DA0OL8W24XT6.0 size=1048576 2024-09-14T11:15:10.101 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:10.104+0000 7f76c1e8a8c0 1 < completed part key=_multipart_8PZOVFEYYSOG.2~DA0OL8W24XT6.1 size=397679 2024-09-14T11:15:10.105 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:10.108+0000 7f76c1e8a8c0 1 < completed multipart upload key=8PZOVFEYYSOG upload=DA0OL8W24XT6 tag=K9GZHDR29Z28 type=write size=2494831 2024-09-14T11:15:10.109 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:10.112+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_OUMUTEBQ1TD0.2~IB6RS0LE4CX3.0 size=962858 2024-09-14T11:15:10.109 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:10.112+0000 7f76c1e8a8c0 1 > prepared multipart upload key=OUMUTEBQ1TD0 upload=IB6RS0LE4CX3 tag=241OACWODSLS type=write size=2011434 2024-09-14T11:15:10.113 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:10.116+0000 7f76c1e8a8c0 1 < suggested remove operation key=K2EEZLRK7MVO tag=0AR2V7TWLFS5 type=del 2024-09-14T11:15:10.115 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:10.116+0000 7f76c1e8a8c0 1 > prepared operation key=1W5733SDHGDN tag=GGSDDTREJWCR type=del size=1180699 2024-09-14T11:15:10.118 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:10.120+0000 7f76c1e8a8c0 1 < completed write operation key=SHKU2PRNREKK tag=MRB7YXONST74 type=write size=1038585 2024-09-14T11:15:10.120 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:10.120+0000 7f76c1e8a8c0 1 > prepared operation key=GAVZRU8ZLW7S tag=1R0P4VC7EMUW type=write size=936021 2024-09-14T11:15:10.122 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:10.124+0000 7f76c1e8a8c0 1 < completed delete operation key=R5I9H7WAK7Z7 tag=K5K3NSY6N0EX type=del 2024-09-14T11:15:10.124 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:10.128+0000 7f76c1e8a8c0 1 > prepared operation key=R5I9H7WAK7Z7 tag=ANNQAGXJR81M type=del size=3732115 2024-09-14T11:15:10.127 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:10.128+0000 7f76c1e8a8c0 1 < completed part key=_multipart_1K8ESNXU6WDF.2~2NR5HTPVMBT8.0 size=820992 2024-09-14T11:15:10.130 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:10.132+0000 7f76c1e8a8c0 1 < completed multipart upload key=1K8ESNXU6WDF upload=2NR5HTPVMBT8 tag=YH117WJHL3E6 type=write size=1869568 2024-09-14T11:15:10.132 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:10.136+0000 7f76c1e8a8c0 1 > prepared operation key=VI61O3K069BP tag=JLR4HCTKQ8I9 type=del size=1345463 2024-09-14T11:15:10.134 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:10.136+0000 7f76c1e8a8c0 1 < completed delete operation key=GZM0AQVHNCMM tag=TDHDST4CHDBH type=del 2024-09-14T11:15:10.137 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:10.140+0000 7f76c1e8a8c0 1 > prepared operation key=VI61O3K069BP tag=HT1I3DN1HI5U type=del size=2859089 2024-09-14T11:15:10.139 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:10.140+0000 7f76c1e8a8c0 1 < completed part key=_multipart_8PZOVFEYYSOG.2~2APB2RREQTUA.0 size=252375 2024-09-14T11:15:10.142 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:10.144+0000 7f76c1e8a8c0 1 < completed multipart upload key=8PZOVFEYYSOG upload=2APB2RREQTUA tag=G4SF6QU7BW6Q type=write size=1300951 2024-09-14T11:15:10.144 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:10.148+0000 7f76c1e8a8c0 1 > prepared operation key=CIRQT9IDJ5OJ tag=JHQQ3P0S3RSH type=write size=974677 2024-09-14T11:15:10.147 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:10.148+0000 7f76c1e8a8c0 1 < canceled operation key=SHKU2PRNREKK tag=RJLTGP55WSR1 type=del size=3439961 2024-09-14T11:15:10.151 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:10.152+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_XC8VWSHZOPFP.2~Y0K92AYGRIZ7.0 size=1048576 2024-09-14T11:15:10.152 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:10.152+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_XC8VWSHZOPFP.2~Y0K92AYGRIZ7.1 size=615298 2024-09-14T11:15:10.152 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:10.156+0000 7f76c1e8a8c0 1 > prepared multipart upload key=XC8VWSHZOPFP upload=Y0K92AYGRIZ7 tag=AZBDSIOKQ876 type=write size=2712450 2024-09-14T11:15:10.154 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:10.156+0000 7f76c1e8a8c0 1 < completed write operation key=R5I9H7WAK7Z7 tag=1HH96TZB8TE1 type=write size=681920 2024-09-14T11:15:10.156 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:10.160+0000 7f76c1e8a8c0 1 > prepared operation key=R5I9H7WAK7Z7 tag=HZ5HG622M0ZH type=del size=3489836 2024-09-14T11:15:10.158 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:10.160+0000 7f76c1e8a8c0 1 < completed part key=_multipart_SUNCRV0C1XYL.2~YVH9HOL078DO.0 size=1048576 2024-09-14T11:15:10.160 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:10.164+0000 7f76c1e8a8c0 1 < completed part key=_multipart_SUNCRV0C1XYL.2~YVH9HOL078DO.1 size=1048576 2024-09-14T11:15:10.160 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:10.164+0000 7f76c1e8a8c0 1 < canceled part key=_multipart_SUNCRV0C1XYL.2~YVH9HOL078DO.2 size=309535 2024-09-14T11:15:10.164 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:10.164+0000 7f76c1e8a8c0 1 < canceled multipart upload key=SUNCRV0C1XYL upload=YVH9HOL078DO tag=6UVCQV48R5HU type=write size=3455263 2024-09-14T11:15:10.168 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:10.168+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_H9CQV6L29SL5.2~JDCU6I0DF89Q.0 size=336375 2024-09-14T11:15:10.168 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:10.168+0000 7f76c1e8a8c0 1 > prepared multipart upload key=H9CQV6L29SL5 upload=JDCU6I0DF89Q tag=TA1CVIUS5QST type=write size=1384951 2024-09-14T11:15:10.170 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:10.172+0000 7f76c1e8a8c0 1 < completed delete operation key=LZ0YNFOVFYCL tag=HPNLSGQUDJN7 type=del 2024-09-14T11:15:10.173 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:10.176+0000 7f76c1e8a8c0 1 > prepared operation key=LZ0YNFOVFYCL tag=OTAS1EC830LA type=del size=714979 2024-09-14T11:15:10.175 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:10.176+0000 7f76c1e8a8c0 1 < completed delete operation key=HJ701768A6I7 tag=RFSE16YOZB1O type=del 2024-09-14T11:15:10.178 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:10.180+0000 7f76c1e8a8c0 1 > prepared operation key=GZM0AQVHNCMM tag=M8U47B8BW5MC type=del size=2515955 2024-09-14T11:15:10.180 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:10.184+0000 7f76c1e8a8c0 1 < completed delete operation key=R5I9H7WAK7Z7 tag=6VRCE9GY1HJ0 type=del 2024-09-14T11:15:10.182 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:10.184+0000 7f76c1e8a8c0 1 > prepared operation key=HS7T50JORDQJ tag=BPPKGTEM4I73 type=del size=3680434 2024-09-14T11:15:10.183 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:10.184+0000 7f76c1e8a8c0 1 < canceled part key=_multipart_MEVTZ7OAD4CA.2~L2CVG4Y331H4.0 size=1048576 2024-09-14T11:15:10.185 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:10.188+0000 7f76c1e8a8c0 1 < completed part key=_multipart_MEVTZ7OAD4CA.2~L2CVG4Y331H4.1 size=1048576 2024-09-14T11:15:10.187 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:10.188+0000 7f76c1e8a8c0 1 < completed part key=_multipart_MEVTZ7OAD4CA.2~L2CVG4Y331H4.2 size=1044224 2024-09-14T11:15:10.192 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:10.192+0000 7f76c1e8a8c0 1 < canceled multipart upload key=MEVTZ7OAD4CA upload=L2CVG4Y331H4 tag=432R7EXA497Y type=write size=4189952 2024-09-14T11:15:10.194 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:10.196+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_KS37ZO6MKAH9.2~7UVKZ7C841VQ.0 size=1048576 2024-09-14T11:15:10.196 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:10.196+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_KS37ZO6MKAH9.2~7UVKZ7C841VQ.1 size=743999 2024-09-14T11:15:10.196 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:10.196+0000 7f76c1e8a8c0 1 > prepared multipart upload key=KS37ZO6MKAH9 upload=7UVKZ7C841VQ tag=9P64Y5Q0O3F1 type=write size=2841151 2024-09-14T11:15:10.198 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:10.200+0000 7f76c1e8a8c0 1 < completed part key=_multipart_8PZOVFEYYSOG.2~3YFFZW1D838J.0 size=499117 2024-09-14T11:15:10.202 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:10.204+0000 7f76c1e8a8c0 1 < completed multipart upload key=8PZOVFEYYSOG upload=3YFFZW1D838J tag=DCD8FZCAYJN4 type=write size=1547693 2024-09-14T11:15:10.206 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:10.208+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_OOUEM16XL80W.2~JVXMZUHEP5ST.0 size=214353 2024-09-14T11:15:10.206 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:10.208+0000 7f76c1e8a8c0 1 > prepared multipart upload key=OOUEM16XL80W upload=JVXMZUHEP5ST tag=6JUGPXMCV8HZ type=write size=1262929 2024-09-14T11:15:10.208 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:10.212+0000 7f76c1e8a8c0 1 < completed write operation key=1W5733SDHGDN tag=E541JA03UR2J type=write size=671696 2024-09-14T11:15:10.210 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:10.212+0000 7f76c1e8a8c0 1 > prepared operation key=XC8VWSHZOPFP tag=0QEY9P0M7L50 type=del size=3305797 2024-09-14T11:15:10.212 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:10.216+0000 7f76c1e8a8c0 1 < completed part key=_multipart_OUMUTEBQ1TD0.2~IB6RS0LE4CX3.0 size=962858 2024-09-14T11:15:10.216 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:10.216+0000 7f76c1e8a8c0 1 < completed multipart upload key=OUMUTEBQ1TD0 upload=IB6RS0LE4CX3 tag=241OACWODSLS type=write size=2011434 2024-09-14T11:15:10.218 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:10.220+0000 7f76c1e8a8c0 1 > prepared operation key=MEVTZ7OAD4CA tag=V0QSBP3GB41Q type=del size=3043028 2024-09-14T11:15:10.220 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:10.224+0000 7f76c1e8a8c0 1 < completed delete operation key=1W5733SDHGDN tag=GGSDDTREJWCR type=del 2024-09-14T11:15:10.224 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:10.228+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_MEVTZ7OAD4CA.2~5ZRAC0FFEDQ8.0 size=46362 2024-09-14T11:15:10.225 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:10.228+0000 7f76c1e8a8c0 1 > prepared multipart upload key=MEVTZ7OAD4CA upload=5ZRAC0FFEDQ8 tag=P6VT3J41EV5K type=write size=1094938 2024-09-14T11:15:10.227 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:10.228+0000 7f76c1e8a8c0 1 < completed write operation key=GAVZRU8ZLW7S tag=1R0P4VC7EMUW type=write size=936021 2024-09-14T11:15:10.229 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:10.232+0000 7f76c1e8a8c0 1 > prepared operation key=K2EEZLRK7MVO tag=LSPXS5DDKUTL type=del size=2908380 2024-09-14T11:15:10.232 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:10.232+0000 7f76c1e8a8c0 1 < completed delete operation key=R5I9H7WAK7Z7 tag=ANNQAGXJR81M type=del 2024-09-14T11:15:10.235 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:10.236+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_HS7T50JORDQJ.2~Y25JQJXPTA9Y.0 size=695510 2024-09-14T11:15:10.235 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:10.236+0000 7f76c1e8a8c0 1 > prepared multipart upload key=HS7T50JORDQJ upload=Y25JQJXPTA9Y tag=5UQVPHR0EZV7 type=write size=1744086 2024-09-14T11:15:10.238 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:10.240+0000 7f76c1e8a8c0 1 < canceled operation key=VI61O3K069BP tag=JLR4HCTKQ8I9 type=del size=1345463 2024-09-14T11:15:10.242 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:10.244+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_KS37ZO6MKAH9.2~Z02X5OSBVJQE.0 size=653682 2024-09-14T11:15:10.242 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:10.244+0000 7f76c1e8a8c0 1 > prepared multipart upload key=KS37ZO6MKAH9 upload=Z02X5OSBVJQE tag=26RQ3HTD7RS5 type=write size=1702258 2024-09-14T11:15:10.246 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:10.248+0000 7f76c1e8a8c0 1 < completed delete operation key=VI61O3K069BP tag=HT1I3DN1HI5U type=del 2024-09-14T11:15:10.248 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:10.252+0000 7f76c1e8a8c0 1 > prepared operation key=15FU4CEGC22Q tag=2Y32I3OQ709D type=del size=3581675 2024-09-14T11:15:10.251 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:10.252+0000 7f76c1e8a8c0 1 < canceled operation key=CIRQT9IDJ5OJ tag=JHQQ3P0S3RSH type=write size=974677 2024-09-14T11:15:10.253 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:10.256+0000 7f76c1e8a8c0 1 > prepared operation key=MEVTZ7OAD4CA tag=4NSBETOWWTKU type=del size=1137811 2024-09-14T11:15:10.255 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:10.256+0000 7f76c1e8a8c0 1 < completed part key=_multipart_XC8VWSHZOPFP.2~Y0K92AYGRIZ7.0 size=1048576 2024-09-14T11:15:10.255 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:10.256+0000 7f76c1e8a8c0 1 < canceled part key=_multipart_XC8VWSHZOPFP.2~Y0K92AYGRIZ7.1 size=615298 2024-09-14T11:15:10.260 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:10.260+0000 7f76c1e8a8c0 1 < canceled multipart upload key=XC8VWSHZOPFP upload=Y0K92AYGRIZ7 tag=AZBDSIOKQ876 type=write size=2712450 2024-09-14T11:15:10.262 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:10.264+0000 7f76c1e8a8c0 1 > prepared operation key=S43U13LYETS4 tag=C4RB6TWUMCDB type=del size=435639 2024-09-14T11:15:10.267 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:10.268+0000 7f76c1e8a8c0 1 < suggested remove operation key=R5I9H7WAK7Z7 tag=HZ5HG622M0ZH type=del 2024-09-14T11:15:10.271 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:10.272+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_H9CQV6L29SL5.2~V0G0F8YZ8S0J.0 size=151885 2024-09-14T11:15:10.271 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:10.272+0000 7f76c1e8a8c0 1 > prepared multipart upload key=H9CQV6L29SL5 upload=V0G0F8YZ8S0J tag=WCSX1K8KN3F2 type=write size=1200461 2024-09-14T11:15:10.274 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:10.276+0000 7f76c1e8a8c0 1 < completed part key=_multipart_H9CQV6L29SL5.2~JDCU6I0DF89Q.0 size=336375 2024-09-14T11:15:10.277 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:10.280+0000 7f76c1e8a8c0 1 < completed multipart upload key=H9CQV6L29SL5 upload=JDCU6I0DF89Q tag=TA1CVIUS5QST type=write size=1384951 2024-09-14T11:15:10.281 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:10.284+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_Q5IY4J5FOD80.2~IWG0GY2ZCJMM.0 size=1048576 2024-09-14T11:15:10.283 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:10.284+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_Q5IY4J5FOD80.2~IWG0GY2ZCJMM.1 size=943293 2024-09-14T11:15:10.283 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:10.284+0000 7f76c1e8a8c0 1 > prepared multipart upload key=Q5IY4J5FOD80 upload=IWG0GY2ZCJMM tag=99WA0E5AXB67 type=write size=3040445 2024-09-14T11:15:10.285 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:10.288+0000 7f76c1e8a8c0 1 < completed delete operation key=LZ0YNFOVFYCL tag=OTAS1EC830LA type=del 2024-09-14T11:15:10.287 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:10.288+0000 7f76c1e8a8c0 1 > prepared operation key=VI61O3K069BP tag=23V8098ZAMZ5 type=del size=906308 2024-09-14T11:15:10.289 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:10.292+0000 7f76c1e8a8c0 1 < completed delete operation key=GZM0AQVHNCMM tag=M8U47B8BW5MC type=del 2024-09-14T11:15:10.291 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:10.292+0000 7f76c1e8a8c0 1 > prepared operation key=6TIJR323NMOH tag=26MJOE275HAI type=write size=1019512 2024-09-14T11:15:10.293 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:10.296+0000 7f76c1e8a8c0 1 < completed delete operation key=HS7T50JORDQJ tag=BPPKGTEM4I73 type=del 2024-09-14T11:15:10.297 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:10.300+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_OUMUTEBQ1TD0.2~8FD4YAM35E7R.0 size=1048576 2024-09-14T11:15:10.298 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:10.300+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_OUMUTEBQ1TD0.2~8FD4YAM35E7R.1 size=952865 2024-09-14T11:15:10.298 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:10.300+0000 7f76c1e8a8c0 1 > prepared multipart upload key=OUMUTEBQ1TD0 upload=8FD4YAM35E7R tag=OPASUVJ16CE2 type=write size=3050017 2024-09-14T11:15:10.301 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:10.304+0000 7f76c1e8a8c0 1 < completed part key=_multipart_KS37ZO6MKAH9.2~7UVKZ7C841VQ.0 size=1048576 2024-09-14T11:15:10.301 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:10.304+0000 7f76c1e8a8c0 1 < canceled part key=_multipart_KS37ZO6MKAH9.2~7UVKZ7C841VQ.1 size=743999 2024-09-14T11:15:10.304 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:10.304+0000 7f76c1e8a8c0 1 < canceled multipart upload key=KS37ZO6MKAH9 upload=7UVKZ7C841VQ tag=9P64Y5Q0O3F1 type=write size=2841151 2024-09-14T11:15:10.308 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:10.308+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_W0MDRE9YO3UP.2~ZJ2MSHMAMI3Q.0 size=785438 2024-09-14T11:15:10.308 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:10.308+0000 7f76c1e8a8c0 1 > prepared multipart upload key=W0MDRE9YO3UP upload=ZJ2MSHMAMI3Q tag=53W4D7B09T68 type=write size=1834014 2024-09-14T11:15:10.310 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:10.312+0000 7f76c1e8a8c0 1 < completed part key=_multipart_OOUEM16XL80W.2~JVXMZUHEP5ST.0 size=214353 2024-09-14T11:15:10.314 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:10.316+0000 7f76c1e8a8c0 1 < completed multipart upload key=OOUEM16XL80W upload=JVXMZUHEP5ST tag=6JUGPXMCV8HZ type=write size=1262929 2024-09-14T11:15:10.318 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:10.320+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_TZO40K6J9877.2~URQ1153LSRO7.0 size=1048576 2024-09-14T11:15:10.320 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:10.320+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_TZO40K6J9877.2~URQ1153LSRO7.1 size=1048576 2024-09-14T11:15:10.322 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:10.324+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_TZO40K6J9877.2~URQ1153LSRO7.2 size=837195 2024-09-14T11:15:10.322 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:10.324+0000 7f76c1e8a8c0 1 > prepared multipart upload key=TZO40K6J9877 upload=URQ1153LSRO7 tag=2FAU3MRQYT40 type=write size=3982923 2024-09-14T11:15:10.324 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:10.324+0000 7f76c1e8a8c0 1 < completed delete operation key=XC8VWSHZOPFP tag=0QEY9P0M7L50 type=del 2024-09-14T11:15:10.326 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:10.328+0000 7f76c1e8a8c0 1 > prepared operation key=HJ701768A6I7 tag=A6UEHQE9LQ0I type=del size=1502535 2024-09-14T11:15:10.328 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:10.332+0000 7f76c1e8a8c0 1 < canceled operation key=MEVTZ7OAD4CA tag=V0QSBP3GB41Q type=del size=3043028 2024-09-14T11:15:10.333 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:10.336+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_K2EEZLRK7MVO.2~I499KKC07FCL.0 size=1048576 2024-09-14T11:15:10.335 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:10.336+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_K2EEZLRK7MVO.2~I499KKC07FCL.1 size=762052 2024-09-14T11:15:10.335 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:10.336+0000 7f76c1e8a8c0 1 > prepared multipart upload key=K2EEZLRK7MVO upload=I499KKC07FCL tag=ZB5V1RYZOVDJ type=write size=2859204 2024-09-14T11:15:10.337 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:10.340+0000 7f76c1e8a8c0 1 < completed part key=_multipart_MEVTZ7OAD4CA.2~5ZRAC0FFEDQ8.0 size=46362 2024-09-14T11:15:10.341 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:10.344+0000 7f76c1e8a8c0 1 < completed multipart upload key=MEVTZ7OAD4CA upload=5ZRAC0FFEDQ8 tag=P6VT3J41EV5K type=write size=1094938 2024-09-14T11:15:10.343 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:10.344+0000 7f76c1e8a8c0 1 > prepared operation key=MEVTZ7OAD4CA tag=LHO4ZOV6WH7S type=del size=1743362 2024-09-14T11:15:10.347 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:10.348+0000 7f76c1e8a8c0 1 < suggested update operation key=K2EEZLRK7MVO tag=LSPXS5DDKUTL type=del size=2908380 2024-09-14T11:15:10.349 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:10.352+0000 7f76c1e8a8c0 1 > prepared operation key=TZO40K6J9877 tag=XFHEWZN3SFC1 type=del size=3910047 2024-09-14T11:15:10.351 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:10.352+0000 7f76c1e8a8c0 1 < completed part key=_multipart_HS7T50JORDQJ.2~Y25JQJXPTA9Y.0 size=695510 2024-09-14T11:15:10.355 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:10.356+0000 7f76c1e8a8c0 1 < completed multipart upload key=HS7T50JORDQJ upload=Y25JQJXPTA9Y tag=5UQVPHR0EZV7 type=write size=1744086 2024-09-14T11:15:10.357 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:10.360+0000 7f76c1e8a8c0 1 > prepared operation key=VI61O3K069BP tag=1UXKC77WTUVA type=del size=2851536 2024-09-14T11:15:10.358 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:10.360+0000 7f76c1e8a8c0 1 < canceled part key=_multipart_KS37ZO6MKAH9.2~Z02X5OSBVJQE.0 size=653682 2024-09-14T11:15:10.362 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:10.364+0000 7f76c1e8a8c0 1 < canceled multipart upload key=KS37ZO6MKAH9 upload=Z02X5OSBVJQE tag=26RQ3HTD7RS5 type=write size=1702258 2024-09-14T11:15:10.364 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:10.368+0000 7f76c1e8a8c0 1 > prepared operation key=8PZOVFEYYSOG tag=7C49ENG7Q1YM type=del size=2284064 2024-09-14T11:15:10.367 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:10.368+0000 7f76c1e8a8c0 1 < completed delete operation key=15FU4CEGC22Q tag=2Y32I3OQ709D type=del 2024-09-14T11:15:10.369 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:10.372+0000 7f76c1e8a8c0 1 > prepared operation key=8PZOVFEYYSOG tag=1643W8FHLR4E type=del size=3510351 2024-09-14T11:15:10.371 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:10.372+0000 7f76c1e8a8c0 1 < completed delete operation key=MEVTZ7OAD4CA tag=4NSBETOWWTKU type=del 2024-09-14T11:15:10.374 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:10.376+0000 7f76c1e8a8c0 1 > prepared operation key=HS7T50JORDQJ tag=EFUY693W1H4R type=del size=113663 2024-09-14T11:15:10.377 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:10.380+0000 7f76c1e8a8c0 1 < completed delete operation key=S43U13LYETS4 tag=C4RB6TWUMCDB type=del 2024-09-14T11:15:10.381 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:10.384+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_85G6NT78HAWQ.2~02N3TIASALY3.0 size=1048576 2024-09-14T11:15:10.383 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:10.384+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_85G6NT78HAWQ.2~02N3TIASALY3.1 size=1048576 2024-09-14T11:15:10.385 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:10.388+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_85G6NT78HAWQ.2~02N3TIASALY3.2 size=736950 2024-09-14T11:15:10.385 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:10.388+0000 7f76c1e8a8c0 1 > prepared multipart upload key=85G6NT78HAWQ upload=02N3TIASALY3 tag=TANOI6RWEB5C type=write size=3882678 2024-09-14T11:15:10.388 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:10.388+0000 7f76c1e8a8c0 1 < completed part key=_multipart_H9CQV6L29SL5.2~V0G0F8YZ8S0J.0 size=151885 2024-09-14T11:15:10.392 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:10.392+0000 7f76c1e8a8c0 1 < completed multipart upload key=H9CQV6L29SL5 upload=V0G0F8YZ8S0J tag=WCSX1K8KN3F2 type=write size=1200461 2024-09-14T11:15:10.396 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:10.400+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_S43U13LYETS4.2~IZXZ1KNTHB9P.0 size=1048576 2024-09-14T11:15:10.398 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:10.400+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_S43U13LYETS4.2~IZXZ1KNTHB9P.1 size=980652 2024-09-14T11:15:10.398 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:10.400+0000 7f76c1e8a8c0 1 > prepared multipart upload key=S43U13LYETS4 upload=IZXZ1KNTHB9P tag=EZPQTYZZTJVK type=write size=3077804 2024-09-14T11:15:10.400 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:10.404+0000 7f76c1e8a8c0 1 < completed part key=_multipart_Q5IY4J5FOD80.2~IWG0GY2ZCJMM.0 size=1048576 2024-09-14T11:15:10.402 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:10.404+0000 7f76c1e8a8c0 1 < completed part key=_multipart_Q5IY4J5FOD80.2~IWG0GY2ZCJMM.1 size=943293 2024-09-14T11:15:10.407 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:10.408+0000 7f76c1e8a8c0 1 < completed multipart upload key=Q5IY4J5FOD80 upload=IWG0GY2ZCJMM tag=99WA0E5AXB67 type=write size=3040445 2024-09-14T11:15:10.411 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:10.412+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_H9CQV6L29SL5.2~ZOPV6H1M5ZZU.0 size=1048576 2024-09-14T11:15:10.413 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:10.416+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_H9CQV6L29SL5.2~ZOPV6H1M5ZZU.1 size=327328 2024-09-14T11:15:10.413 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:10.416+0000 7f76c1e8a8c0 1 > prepared multipart upload key=H9CQV6L29SL5 upload=ZOPV6H1M5ZZU tag=B3C7P8DIKT7T type=write size=2424480 2024-09-14T11:15:10.418 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:10.420+0000 7f76c1e8a8c0 1 < suggested update operation key=VI61O3K069BP tag=23V8098ZAMZ5 type=del size=906308 2024-09-14T11:15:10.421 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:10.424+0000 7f76c1e8a8c0 1 > prepared operation key=SHKU2PRNREKK tag=YG409PFKHW1F type=del size=436535 2024-09-14T11:15:10.423 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:10.424+0000 7f76c1e8a8c0 1 < completed write operation key=6TIJR323NMOH tag=26MJOE275HAI type=write size=1019512 2024-09-14T11:15:10.426 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:10.428+0000 7f76c1e8a8c0 1 > prepared operation key=W0MDRE9YO3UP tag=U568YKVE63KZ type=del size=3890796 2024-09-14T11:15:10.428 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:10.432+0000 7f76c1e8a8c0 1 < completed part key=_multipart_OUMUTEBQ1TD0.2~8FD4YAM35E7R.0 size=1048576 2024-09-14T11:15:10.428 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:10.432+0000 7f76c1e8a8c0 1 < canceled part key=_multipart_OUMUTEBQ1TD0.2~8FD4YAM35E7R.1 size=952865 2024-09-14T11:15:10.432 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:10.436+0000 7f76c1e8a8c0 1 < canceled multipart upload key=OUMUTEBQ1TD0 upload=8FD4YAM35E7R tag=OPASUVJ16CE2 type=write size=3050017 2024-09-14T11:15:10.435 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:10.436+0000 7f76c1e8a8c0 1 > prepared operation key=8PZOVFEYYSOG tag=2DB4LEQRA1NF type=del size=2176327 2024-09-14T11:15:10.438 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:10.440+0000 7f76c1e8a8c0 1 < completed part key=_multipart_W0MDRE9YO3UP.2~ZJ2MSHMAMI3Q.0 size=785438 2024-09-14T11:15:10.442 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:10.444+0000 7f76c1e8a8c0 1 < completed multipart upload key=W0MDRE9YO3UP upload=ZJ2MSHMAMI3Q tag=53W4D7B09T68 type=write size=1834014 2024-09-14T11:15:10.445 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:10.448+0000 7f76c1e8a8c0 1 > prepared operation key=OUMUTEBQ1TD0 tag=JNK1X4YIIUJ9 type=del size=694803 2024-09-14T11:15:10.448 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:10.452+0000 7f76c1e8a8c0 1 < completed part key=_multipart_TZO40K6J9877.2~URQ1153LSRO7.0 size=1048576 2024-09-14T11:15:10.450 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:10.452+0000 7f76c1e8a8c0 1 < completed part key=_multipart_TZO40K6J9877.2~URQ1153LSRO7.1 size=1048576 2024-09-14T11:15:10.452 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:10.456+0000 7f76c1e8a8c0 1 < completed part key=_multipart_TZO40K6J9877.2~URQ1153LSRO7.2 size=837195 2024-09-14T11:15:10.457 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:10.460+0000 7f76c1e8a8c0 1 < completed multipart upload key=TZO40K6J9877 upload=URQ1153LSRO7 tag=2FAU3MRQYT40 type=write size=3982923 2024-09-14T11:15:10.460 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:10.460+0000 7f76c1e8a8c0 1 > prepared operation key=F3KFS0P1WM7W tag=AS49MT6IP9QF type=write size=1019054 2024-09-14T11:15:10.462 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:10.464+0000 7f76c1e8a8c0 1 < completed delete operation key=HJ701768A6I7 tag=A6UEHQE9LQ0I type=del 2024-09-14T11:15:10.467 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:10.468+0000 7f76c1e8a8c0 1 > prepared operation key=HJ701768A6I7 tag=2CLPXH69BU6V type=write size=221075 2024-09-14T11:15:10.470 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:10.472+0000 7f76c1e8a8c0 1 < completed part key=_multipart_K2EEZLRK7MVO.2~I499KKC07FCL.0 size=1048576 2024-09-14T11:15:10.472 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:10.476+0000 7f76c1e8a8c0 1 < completed part key=_multipart_K2EEZLRK7MVO.2~I499KKC07FCL.1 size=762052 2024-09-14T11:15:10.477 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:10.480+0000 7f76c1e8a8c0 1 < completed multipart upload key=K2EEZLRK7MVO upload=I499KKC07FCL tag=ZB5V1RYZOVDJ type=write size=2859204 2024-09-14T11:15:10.479 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:10.480+0000 7f76c1e8a8c0 1 > prepared operation key=XC8VWSHZOPFP tag=11RMSBOL30WY type=write size=268522 2024-09-14T11:15:10.482 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:10.484+0000 7f76c1e8a8c0 1 < completed delete operation key=MEVTZ7OAD4CA tag=LHO4ZOV6WH7S type=del 2024-09-14T11:15:10.487 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:10.488+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_SHKU2PRNREKK.2~93EDWO7GDCK4.0 size=1048576 2024-09-14T11:15:10.490 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:10.492+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_SHKU2PRNREKK.2~93EDWO7GDCK4.1 size=1048576 2024-09-14T11:15:10.493 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:10.496+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_SHKU2PRNREKK.2~93EDWO7GDCK4.2 size=430362 2024-09-14T11:15:10.493 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:10.496+0000 7f76c1e8a8c0 1 > prepared multipart upload key=SHKU2PRNREKK upload=93EDWO7GDCK4 tag=LLO1XF7HF9BW type=write size=3576090 2024-09-14T11:15:10.495 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:10.496+0000 7f76c1e8a8c0 1 < completed delete operation key=TZO40K6J9877 tag=XFHEWZN3SFC1 type=del 2024-09-14T11:15:10.498 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:10.500+0000 7f76c1e8a8c0 1 > prepared operation key=8FFV9G6EQR8F tag=3C1BK1QPCTL9 type=del size=2299076 2024-09-14T11:15:10.501 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:10.504+0000 7f76c1e8a8c0 -1 < failed to complete operation key=VI61O3K069BP tag=1UXKC77WTUVA type=del size=2851536: (22) Invalid argument 2024-09-14T11:15:10.503 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:10.504+0000 7f76c1e8a8c0 1 > prepared operation key=S43U13LYETS4 tag=SBJ232XFIQHM type=del size=1380733 2024-09-14T11:15:10.506 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:10.508+0000 7f76c1e8a8c0 1 < completed delete operation key=8PZOVFEYYSOG tag=7C49ENG7Q1YM type=del 2024-09-14T11:15:10.509 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:10.512+0000 7f76c1e8a8c0 1 > prepared operation key=K2EEZLRK7MVO tag=HAFX6H7WM3TT type=write size=538901 2024-09-14T11:15:10.514 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:10.516+0000 7f76c1e8a8c0 1 < suggested remove operation key=8PZOVFEYYSOG tag=1643W8FHLR4E type=del 2024-09-14T11:15:10.517 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:10.520+0000 7f76c1e8a8c0 1 > prepared operation key=MEVTZ7OAD4CA tag=H1E3WTWN0RQF type=del size=3534625 2024-09-14T11:15:10.520 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:10.520+0000 7f76c1e8a8c0 1 < completed delete operation key=HS7T50JORDQJ tag=EFUY693W1H4R type=del 2024-09-14T11:15:10.523 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:10.524+0000 7f76c1e8a8c0 1 > prepared operation key=LZ0YNFOVFYCL tag=E98WEV3X0D8V type=write size=537798 2024-09-14T11:15:10.526 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:10.528+0000 7f76c1e8a8c0 1 < completed part key=_multipart_85G6NT78HAWQ.2~02N3TIASALY3.0 size=1048576 2024-09-14T11:15:10.526 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:10.528+0000 7f76c1e8a8c0 1 < canceled part key=_multipart_85G6NT78HAWQ.2~02N3TIASALY3.1 size=1048576 2024-09-14T11:15:10.526 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:10.528+0000 7f76c1e8a8c0 1 < canceled part key=_multipart_85G6NT78HAWQ.2~02N3TIASALY3.2 size=736950 2024-09-14T11:15:10.531 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:10.532+0000 7f76c1e8a8c0 1 < canceled multipart upload key=85G6NT78HAWQ upload=02N3TIASALY3 tag=TANOI6RWEB5C type=write size=3882678 2024-09-14T11:15:10.536 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:10.536+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_Q5IY4J5FOD80.2~DKBR6ZXEIILY.0 size=1048576 2024-09-14T11:15:10.538 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:10.540+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_Q5IY4J5FOD80.2~DKBR6ZXEIILY.1 size=1048576 2024-09-14T11:15:10.540 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:10.544+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_Q5IY4J5FOD80.2~DKBR6ZXEIILY.2 size=636611 2024-09-14T11:15:10.540 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:10.544+0000 7f76c1e8a8c0 1 > prepared multipart upload key=Q5IY4J5FOD80 upload=DKBR6ZXEIILY tag=V5YDSSNI1BOI type=write size=3782339 2024-09-14T11:15:10.543 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:10.544+0000 7f76c1e8a8c0 1 < completed part key=_multipart_S43U13LYETS4.2~IZXZ1KNTHB9P.0 size=1048576 2024-09-14T11:15:10.545 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:10.548+0000 7f76c1e8a8c0 1 < completed part key=_multipart_S43U13LYETS4.2~IZXZ1KNTHB9P.1 size=980652 2024-09-14T11:15:10.550 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:10.552+0000 7f76c1e8a8c0 1 < completed multipart upload key=S43U13LYETS4 upload=IZXZ1KNTHB9P tag=EZPQTYZZTJVK type=write size=3077804 2024-09-14T11:15:10.553 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:10.556+0000 7f76c1e8a8c0 1 > prepared operation key=HJ701768A6I7 tag=P4QOOLHQ3RCP type=del size=4184016 2024-09-14T11:15:10.553 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:10.556+0000 7f76c1e8a8c0 1 < canceled part key=_multipart_H9CQV6L29SL5.2~ZOPV6H1M5ZZU.0 size=1048576 2024-09-14T11:15:10.555 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:10.556+0000 7f76c1e8a8c0 1 < completed part key=_multipart_H9CQV6L29SL5.2~ZOPV6H1M5ZZU.1 size=327328 2024-09-14T11:15:10.559 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:10.560+0000 7f76c1e8a8c0 1 < canceled multipart upload key=H9CQV6L29SL5 upload=ZOPV6H1M5ZZU tag=B3C7P8DIKT7T type=write size=2424480 2024-09-14T11:15:10.564 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:10.568+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_SHKU2PRNREKK.2~71T5DVZW0ZQQ.0 size=1048576 2024-09-14T11:15:10.566 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:10.568+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_SHKU2PRNREKK.2~71T5DVZW0ZQQ.1 size=102991 2024-09-14T11:15:10.566 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:10.568+0000 7f76c1e8a8c0 1 > prepared multipart upload key=SHKU2PRNREKK upload=71T5DVZW0ZQQ tag=8UR9RD60KL7Q type=write size=2200143 2024-09-14T11:15:10.569 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:10.572+0000 7f76c1e8a8c0 1 < completed delete operation key=SHKU2PRNREKK tag=YG409PFKHW1F type=del 2024-09-14T11:15:10.572 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:10.572+0000 7f76c1e8a8c0 1 > prepared operation key=6TIJR323NMOH tag=GFQ244E5WX1X type=del size=2120868 2024-09-14T11:15:10.575 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:10.576+0000 7f76c1e8a8c0 1 < completed delete operation key=W0MDRE9YO3UP tag=U568YKVE63KZ type=del 2024-09-14T11:15:10.579 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:10.580+0000 7f76c1e8a8c0 1 > prepared operation key=KS37ZO6MKAH9 tag=3EFQ2GBGFT57 type=del size=1325378 2024-09-14T11:15:10.582 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:10.584+0000 7f76c1e8a8c0 -1 < failed to complete operation key=8PZOVFEYYSOG tag=2DB4LEQRA1NF type=del size=2176327: (22) Invalid argument 2024-09-14T11:15:10.585 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:10.588+0000 7f76c1e8a8c0 1 > prepared operation key=K2EEZLRK7MVO tag=8HXGPO95RWXG type=write size=245712 2024-09-14T11:15:10.587 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:10.588+0000 7f76c1e8a8c0 1 < completed delete operation key=OUMUTEBQ1TD0 tag=JNK1X4YIIUJ9 type=del 2024-09-14T11:15:10.590 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:10.592+0000 7f76c1e8a8c0 1 > prepared operation key=K2EEZLRK7MVO tag=XM3TDU1U8731 type=del size=899738 2024-09-14T11:15:10.595 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:10.596+0000 7f76c1e8a8c0 1 < suggested remove operation key=F3KFS0P1WM7W tag=AS49MT6IP9QF type=write 2024-09-14T11:15:10.597 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:10.600+0000 7f76c1e8a8c0 1 > prepared operation key=MEVTZ7OAD4CA tag=3ISWRTH9IVTN type=del size=396429 2024-09-14T11:15:10.600 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:10.600+0000 7f76c1e8a8c0 1 < completed write operation key=HJ701768A6I7 tag=2CLPXH69BU6V type=write size=221075 2024-09-14T11:15:10.602 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:10.604+0000 7f76c1e8a8c0 1 > prepared operation key=F3KFS0P1WM7W tag=S5Z8HDNL302D type=write size=667360 2024-09-14T11:15:10.605 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:10.608+0000 7f76c1e8a8c0 1 < completed write operation key=XC8VWSHZOPFP tag=11RMSBOL30WY type=write size=268522 2024-09-14T11:15:10.607 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:10.608+0000 7f76c1e8a8c0 1 > prepared operation key=R5I9H7WAK7Z7 tag=M16113U08BA1 type=del size=151391 2024-09-14T11:15:10.610 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:10.612+0000 7f76c1e8a8c0 1 < completed part key=_multipart_SHKU2PRNREKK.2~93EDWO7GDCK4.0 size=1048576 2024-09-14T11:15:10.613 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:10.616+0000 7f76c1e8a8c0 1 < completed part key=_multipart_SHKU2PRNREKK.2~93EDWO7GDCK4.1 size=1048576 2024-09-14T11:15:10.615 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:10.616+0000 7f76c1e8a8c0 1 < completed part key=_multipart_SHKU2PRNREKK.2~93EDWO7GDCK4.2 size=430362 2024-09-14T11:15:10.620 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:10.620+0000 7f76c1e8a8c0 1 < completed multipart upload key=SHKU2PRNREKK upload=93EDWO7GDCK4 tag=LLO1XF7HF9BW type=write size=3576090 2024-09-14T11:15:10.624 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:10.624+0000 7f76c1e8a8c0 1 > prepared operation key=HS7T50JORDQJ tag=7JY1O7QFLRWN type=del size=950351 2024-09-14T11:15:10.627 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:10.628+0000 7f76c1e8a8c0 1 < completed delete operation key=8FFV9G6EQR8F tag=3C1BK1QPCTL9 type=del 2024-09-14T11:15:10.634 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:10.636+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_TUFOZKTV9XIH.2~MEW8G9TG6XDW.0 size=1048576 2024-09-14T11:15:10.636 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:10.640+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_TUFOZKTV9XIH.2~MEW8G9TG6XDW.1 size=15962 2024-09-14T11:15:10.637 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:10.640+0000 7f76c1e8a8c0 1 > prepared multipart upload key=TUFOZKTV9XIH upload=MEW8G9TG6XDW tag=C6E0ZGCPPL9Q type=write size=2113114 2024-09-14T11:15:10.640 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:10.640+0000 7f76c1e8a8c0 1 < completed delete operation key=S43U13LYETS4 tag=SBJ232XFIQHM type=del 2024-09-14T11:15:10.643 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:10.644+0000 7f76c1e8a8c0 1 > prepared operation key=XC8VWSHZOPFP tag=CVV5IUH5Z7Z0 type=del size=2797610 2024-09-14T11:15:10.647 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:10.648+0000 7f76c1e8a8c0 1 < completed write operation key=K2EEZLRK7MVO tag=HAFX6H7WM3TT type=write size=538901 2024-09-14T11:15:10.653 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:10.656+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_XC8VWSHZOPFP.2~8TOMS4RN24N9.0 size=1048576 2024-09-14T11:15:10.656 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:10.656+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_XC8VWSHZOPFP.2~8TOMS4RN24N9.1 size=540051 2024-09-14T11:15:10.656 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:10.656+0000 7f76c1e8a8c0 1 > prepared multipart upload key=XC8VWSHZOPFP upload=8TOMS4RN24N9 tag=73336DUQJCXU type=write size=2637203 2024-09-14T11:15:10.659 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:10.660+0000 7f76c1e8a8c0 1 < completed delete operation key=MEVTZ7OAD4CA tag=H1E3WTWN0RQF type=del 2024-09-14T11:15:10.665 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:10.668+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_R5I9H7WAK7Z7.2~95JRF51KG8Q5.0 size=1048576 2024-09-14T11:15:10.667 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:10.668+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_R5I9H7WAK7Z7.2~95JRF51KG8Q5.1 size=1048576 2024-09-14T11:15:10.670 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:10.672+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_R5I9H7WAK7Z7.2~95JRF51KG8Q5.2 size=789040 2024-09-14T11:15:10.670 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:10.672+0000 7f76c1e8a8c0 1 > prepared multipart upload key=R5I9H7WAK7Z7 upload=95JRF51KG8Q5 tag=HHXGN8W57FZM type=write size=3934768 2024-09-14T11:15:10.675 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:10.676+0000 7f76c1e8a8c0 1 < suggested remove operation key=LZ0YNFOVFYCL tag=E98WEV3X0D8V type=write 2024-09-14T11:15:10.679 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:10.680+0000 7f76c1e8a8c0 1 > prepared operation key=MEVTZ7OAD4CA tag=YL84XLAEQI3D type=del size=2195146 2024-09-14T11:15:10.681 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:10.684+0000 7f76c1e8a8c0 1 < completed part key=_multipart_Q5IY4J5FOD80.2~DKBR6ZXEIILY.0 size=1048576 2024-09-14T11:15:10.683 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:10.684+0000 7f76c1e8a8c0 1 < completed part key=_multipart_Q5IY4J5FOD80.2~DKBR6ZXEIILY.1 size=1048576 2024-09-14T11:15:10.686 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:10.688+0000 7f76c1e8a8c0 1 < completed part key=_multipart_Q5IY4J5FOD80.2~DKBR6ZXEIILY.2 size=636611 2024-09-14T11:15:10.691 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:10.692+0000 7f76c1e8a8c0 1 < completed multipart upload key=Q5IY4J5FOD80 upload=DKBR6ZXEIILY tag=V5YDSSNI1BOI type=write size=3782339 2024-09-14T11:15:10.694 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:10.696+0000 7f76c1e8a8c0 1 > prepared operation key=85G6NT78HAWQ tag=C7ADFYNVMI4M type=del size=2862791 2024-09-14T11:15:10.697 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:10.700+0000 7f76c1e8a8c0 1 < canceled operation key=HJ701768A6I7 tag=P4QOOLHQ3RCP type=del size=4184016 2024-09-14T11:15:10.703 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:10.704+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_8PZOVFEYYSOG.2~MA5IEEALMTP7.0 size=883716 2024-09-14T11:15:10.703 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:10.704+0000 7f76c1e8a8c0 1 > prepared multipart upload key=8PZOVFEYYSOG upload=MA5IEEALMTP7 tag=MVVQFE2OJIH3 type=write size=1932292 2024-09-14T11:15:10.706 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:10.708+0000 7f76c1e8a8c0 1 < completed part key=_multipart_SHKU2PRNREKK.2~71T5DVZW0ZQQ.0 size=1048576 2024-09-14T11:15:10.709 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:10.712+0000 7f76c1e8a8c0 1 < completed part key=_multipart_SHKU2PRNREKK.2~71T5DVZW0ZQQ.1 size=102991 2024-09-14T11:15:10.713 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:10.716+0000 7f76c1e8a8c0 1 < completed multipart upload key=SHKU2PRNREKK upload=71T5DVZW0ZQQ tag=8UR9RD60KL7Q type=write size=2200143 2024-09-14T11:15:10.718 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:10.720+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_OUMUTEBQ1TD0.2~JY2YFGG4XY0Y.0 size=1048576 2024-09-14T11:15:10.720 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:10.724+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_OUMUTEBQ1TD0.2~JY2YFGG4XY0Y.1 size=1048576 2024-09-14T11:15:10.722 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:10.724+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_OUMUTEBQ1TD0.2~JY2YFGG4XY0Y.2 size=170108 2024-09-14T11:15:10.722 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:10.724+0000 7f76c1e8a8c0 1 > prepared multipart upload key=OUMUTEBQ1TD0 upload=JY2YFGG4XY0Y tag=4IIW4739XS1A type=write size=3315836 2024-09-14T11:15:10.725 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:10.728+0000 7f76c1e8a8c0 1 < completed delete operation key=6TIJR323NMOH tag=GFQ244E5WX1X type=del 2024-09-14T11:15:10.728 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:10.728+0000 7f76c1e8a8c0 1 > prepared operation key=85G6NT78HAWQ tag=SSAMZUS8Y57F type=write size=915559 2024-09-14T11:15:10.731 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:10.732+0000 7f76c1e8a8c0 1 < completed delete operation key=KS37ZO6MKAH9 tag=3EFQ2GBGFT57 type=del 2024-09-14T11:15:10.733 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:10.736+0000 7f76c1e8a8c0 1 > prepared operation key=K9W031V6BFJP tag=9QU3MR1WHFVY type=write size=456713 2024-09-14T11:15:10.739 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:10.740+0000 7f76c1e8a8c0 1 < completed write operation key=K2EEZLRK7MVO tag=8HXGPO95RWXG type=write size=245712 2024-09-14T11:15:10.744 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:10.744+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_KS37ZO6MKAH9.2~BFD4473T8ILK.0 size=1048576 2024-09-14T11:15:10.746 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:10.748+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_KS37ZO6MKAH9.2~BFD4473T8ILK.1 size=1048576 2024-09-14T11:15:10.749 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:10.752+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_KS37ZO6MKAH9.2~BFD4473T8ILK.2 size=386827 2024-09-14T11:15:10.749 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:10.752+0000 7f76c1e8a8c0 1 > prepared multipart upload key=KS37ZO6MKAH9 upload=BFD4473T8ILK tag=ZOA76LL41GHW type=write size=3532555 2024-09-14T11:15:10.752 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:10.752+0000 7f76c1e8a8c0 1 < completed delete operation key=K2EEZLRK7MVO tag=XM3TDU1U8731 type=del 2024-09-14T11:15:10.755 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:10.756+0000 7f76c1e8a8c0 1 > prepared operation key=CIRQT9IDJ5OJ tag=NH60AA1E3U4T type=del size=394978 2024-09-14T11:15:10.758 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:10.760+0000 7f76c1e8a8c0 1 < completed delete operation key=MEVTZ7OAD4CA tag=3ISWRTH9IVTN type=del 2024-09-14T11:15:10.762 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:10.764+0000 7f76c1e8a8c0 1 > prepared operation key=CIRQT9IDJ5OJ tag=RSWLTJ0NTNCD type=write size=43769 2024-09-14T11:15:10.765 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:10.768+0000 7f76c1e8a8c0 1 < canceled operation key=F3KFS0P1WM7W tag=S5Z8HDNL302D type=write size=667360 2024-09-14T11:15:10.768 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:10.768+0000 7f76c1e8a8c0 1 > prepared operation key=1W5733SDHGDN tag=T8IF9SJ5D5VX type=write size=882281 2024-09-14T11:15:10.771 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:10.772+0000 7f76c1e8a8c0 1 < completed delete operation key=R5I9H7WAK7Z7 tag=M16113U08BA1 type=del 2024-09-14T11:15:10.774 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:10.776+0000 7f76c1e8a8c0 1 > prepared operation key=K2EEZLRK7MVO tag=VAD4UAVMON3X type=del size=3536593 2024-09-14T11:15:10.778 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:10.780+0000 7f76c1e8a8c0 1 < completed delete operation key=HS7T50JORDQJ tag=7JY1O7QFLRWN type=del 2024-09-14T11:15:10.784 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:10.784+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_K9W031V6BFJP.2~AK9EQD156BQX.0 size=1048576 2024-09-14T11:15:10.786 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:10.788+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_K9W031V6BFJP.2~AK9EQD156BQX.1 size=1048576 2024-09-14T11:15:10.789 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:10.792+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_K9W031V6BFJP.2~AK9EQD156BQX.2 size=875247 2024-09-14T11:15:10.789 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:10.792+0000 7f76c1e8a8c0 1 > prepared multipart upload key=K9W031V6BFJP upload=AK9EQD156BQX tag=5MDL2FJ3QZXV type=write size=4020975 2024-09-14T11:15:10.791 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:10.792+0000 7f76c1e8a8c0 1 < completed part key=_multipart_TUFOZKTV9XIH.2~MEW8G9TG6XDW.0 size=1048576 2024-09-14T11:15:10.794 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:10.796+0000 7f76c1e8a8c0 1 < completed part key=_multipart_TUFOZKTV9XIH.2~MEW8G9TG6XDW.1 size=15962 2024-09-14T11:15:10.798 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:10.800+0000 7f76c1e8a8c0 1 < completed multipart upload key=TUFOZKTV9XIH upload=MEW8G9TG6XDW tag=C6E0ZGCPPL9Q type=write size=2113114 2024-09-14T11:15:10.801 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:10.804+0000 7f76c1e8a8c0 1 > prepared operation key=15FU4CEGC22Q tag=O8J3TV2D5DQ6 type=write size=562906 2024-09-14T11:15:10.806 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:10.808+0000 7f76c1e8a8c0 1 < suggested remove operation key=XC8VWSHZOPFP tag=CVV5IUH5Z7Z0 type=del 2024-09-14T11:15:10.809 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:10.812+0000 7f76c1e8a8c0 1 > prepared operation key=15FU4CEGC22Q tag=G0MEXBFQ07BE type=del size=3954357 2024-09-14T11:15:10.812 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:10.816+0000 7f76c1e8a8c0 1 < completed part key=_multipart_XC8VWSHZOPFP.2~8TOMS4RN24N9.0 size=1048576 2024-09-14T11:15:10.812 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:10.816+0000 7f76c1e8a8c0 1 < canceled part key=_multipart_XC8VWSHZOPFP.2~8TOMS4RN24N9.1 size=540051 2024-09-14T11:15:10.817 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:10.820+0000 7f76c1e8a8c0 1 < canceled multipart upload key=XC8VWSHZOPFP upload=8TOMS4RN24N9 tag=73336DUQJCXU type=write size=2637203 2024-09-14T11:15:10.820 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:10.820+0000 7f76c1e8a8c0 1 > prepared operation key=8FFV9G6EQR8F tag=22ZVQQ9G3AHQ type=del size=349292 2024-09-14T11:15:10.822 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:10.824+0000 7f76c1e8a8c0 1 < completed part key=_multipart_R5I9H7WAK7Z7.2~95JRF51KG8Q5.0 size=1048576 2024-09-14T11:15:10.824 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:10.828+0000 7f76c1e8a8c0 1 < completed part key=_multipart_R5I9H7WAK7Z7.2~95JRF51KG8Q5.1 size=1048576 2024-09-14T11:15:10.826 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:10.828+0000 7f76c1e8a8c0 1 < completed part key=_multipart_R5I9H7WAK7Z7.2~95JRF51KG8Q5.2 size=789040 2024-09-14T11:15:10.831 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:10.832+0000 7f76c1e8a8c0 1 < completed multipart upload key=R5I9H7WAK7Z7 upload=95JRF51KG8Q5 tag=HHXGN8W57FZM type=write size=3934768 2024-09-14T11:15:10.833 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:10.836+0000 7f76c1e8a8c0 1 > prepared operation key=8FFV9G6EQR8F tag=219DZG3D42C5 type=del size=3948998 2024-09-14T11:15:10.839 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:10.840+0000 7f76c1e8a8c0 1 < suggested update operation key=MEVTZ7OAD4CA tag=YL84XLAEQI3D type=del size=2195146 2024-09-14T11:15:10.842 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:10.844+0000 7f76c1e8a8c0 1 > prepared operation key=BOCIF4TL7X7J tag=FVUSCIETAU4F type=del size=4058066 2024-09-14T11:15:10.844 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:10.848+0000 7f76c1e8a8c0 1 < completed delete operation key=85G6NT78HAWQ tag=C7ADFYNVMI4M type=del 2024-09-14T11:15:10.850 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:10.852+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_S43U13LYETS4.2~5TQL5B9ZMH8V.0 size=1048576 2024-09-14T11:15:10.852 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:10.852+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_S43U13LYETS4.2~5TQL5B9ZMH8V.1 size=236 2024-09-14T11:15:10.852 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:10.852+0000 7f76c1e8a8c0 1 > prepared multipart upload key=S43U13LYETS4 upload=5TQL5B9ZMH8V tag=2NTIQ6QO4O0G type=write size=2097388 2024-09-14T11:15:10.853 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:10.856+0000 7f76c1e8a8c0 1 < canceled part key=_multipart_8PZOVFEYYSOG.2~MA5IEEALMTP7.0 size=883716 2024-09-14T11:15:10.858 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:10.860+0000 7f76c1e8a8c0 1 < canceled multipart upload key=8PZOVFEYYSOG upload=MA5IEEALMTP7 tag=MVVQFE2OJIH3 type=write size=1932292 2024-09-14T11:15:10.860 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:10.864+0000 7f76c1e8a8c0 1 > prepared operation key=CIRQT9IDJ5OJ tag=AI72T7H4PIDF type=del size=484381 2024-09-14T11:15:10.864 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:10.864+0000 7f76c1e8a8c0 1 < completed part key=_multipart_OUMUTEBQ1TD0.2~JY2YFGG4XY0Y.0 size=1048576 2024-09-14T11:15:10.866 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:10.868+0000 7f76c1e8a8c0 1 < completed part key=_multipart_OUMUTEBQ1TD0.2~JY2YFGG4XY0Y.1 size=1048576 2024-09-14T11:15:10.869 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:10.872+0000 7f76c1e8a8c0 1 < completed part key=_multipart_OUMUTEBQ1TD0.2~JY2YFGG4XY0Y.2 size=170108 2024-09-14T11:15:10.874 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:10.876+0000 7f76c1e8a8c0 1 < completed multipart upload key=OUMUTEBQ1TD0 upload=JY2YFGG4XY0Y tag=4IIW4739XS1A type=write size=3315836 2024-09-14T11:15:10.880 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:10.884+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_1K8ESNXU6WDF.2~TVSZVTVQIKH4.0 size=1048576 2024-09-14T11:15:10.883 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:10.884+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_1K8ESNXU6WDF.2~TVSZVTVQIKH4.1 size=979626 2024-09-14T11:15:10.883 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:10.884+0000 7f76c1e8a8c0 1 > prepared multipart upload key=1K8ESNXU6WDF upload=TVSZVTVQIKH4 tag=YH2V3KSUXEB1 type=write size=3076778 2024-09-14T11:15:10.886 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:10.888+0000 7f76c1e8a8c0 1 < completed write operation key=85G6NT78HAWQ tag=SSAMZUS8Y57F type=write size=915559 2024-09-14T11:15:10.891 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:10.892+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_85G6NT78HAWQ.2~1EN1GE5JCPW4.0 size=344931 2024-09-14T11:15:10.891 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:10.892+0000 7f76c1e8a8c0 1 > prepared multipart upload key=85G6NT78HAWQ upload=1EN1GE5JCPW4 tag=ATVAGKIRS1LQ type=write size=1393507 2024-09-14T11:15:10.894 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:10.896+0000 7f76c1e8a8c0 1 < canceled operation key=K9W031V6BFJP tag=9QU3MR1WHFVY type=write size=456713 2024-09-14T11:15:10.896 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:10.900+0000 7f76c1e8a8c0 1 > prepared operation key=KS37ZO6MKAH9 tag=B2NTURA92W4X type=del size=3974149 2024-09-14T11:15:10.899 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:10.900+0000 7f76c1e8a8c0 1 < completed part key=_multipart_KS37ZO6MKAH9.2~BFD4473T8ILK.0 size=1048576 2024-09-14T11:15:10.901 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:10.904+0000 7f76c1e8a8c0 1 < completed part key=_multipart_KS37ZO6MKAH9.2~BFD4473T8ILK.1 size=1048576 2024-09-14T11:15:10.904 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:10.904+0000 7f76c1e8a8c0 1 < completed part key=_multipart_KS37ZO6MKAH9.2~BFD4473T8ILK.2 size=386827 2024-09-14T11:15:10.909 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:10.912+0000 7f76c1e8a8c0 1 < completed multipart upload key=KS37ZO6MKAH9 upload=BFD4473T8ILK tag=ZOA76LL41GHW type=write size=3532555 2024-09-14T11:15:10.911 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:10.912+0000 7f76c1e8a8c0 1 > prepared operation key=LZ0YNFOVFYCL tag=KFB8D7SIHHBV type=del size=468187 2024-09-14T11:15:10.914 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:10.916+0000 7f76c1e8a8c0 1 < completed delete operation key=CIRQT9IDJ5OJ tag=NH60AA1E3U4T type=del 2024-09-14T11:15:10.917 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:10.920+0000 7f76c1e8a8c0 1 > prepared operation key=15FU4CEGC22Q tag=J3NF85ZEMEIT type=del size=2695841 2024-09-14T11:15:10.920 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:10.920+0000 7f76c1e8a8c0 1 < completed write operation key=CIRQT9IDJ5OJ tag=RSWLTJ0NTNCD type=write size=43769 2024-09-14T11:15:10.922 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:10.924+0000 7f76c1e8a8c0 1 > prepared operation key=S43U13LYETS4 tag=0DQWY6LQO4WE type=del size=3040682 2024-09-14T11:15:10.925 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:10.928+0000 7f76c1e8a8c0 1 < completed write operation key=1W5733SDHGDN tag=T8IF9SJ5D5VX type=write size=882281 2024-09-14T11:15:10.928 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:10.928+0000 7f76c1e8a8c0 1 > prepared operation key=6TIJR323NMOH tag=U20PUGD6QFAA type=del size=449295 2024-09-14T11:15:10.931 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:10.932+0000 7f76c1e8a8c0 1 < completed delete operation key=K2EEZLRK7MVO tag=VAD4UAVMON3X type=del 2024-09-14T11:15:10.933 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:10.936+0000 7f76c1e8a8c0 1 > prepared operation key=GAVZRU8ZLW7S tag=PDRFDYQAFRJT type=del size=3874250 2024-09-14T11:15:10.936 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:10.940+0000 7f76c1e8a8c0 1 < completed part key=_multipart_K9W031V6BFJP.2~AK9EQD156BQX.0 size=1048576 2024-09-14T11:15:10.939 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:10.940+0000 7f76c1e8a8c0 1 < completed part key=_multipart_K9W031V6BFJP.2~AK9EQD156BQX.1 size=1048576 2024-09-14T11:15:10.941 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:10.944+0000 7f76c1e8a8c0 1 < completed part key=_multipart_K9W031V6BFJP.2~AK9EQD156BQX.2 size=875247 2024-09-14T11:15:10.946 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:10.948+0000 7f76c1e8a8c0 1 < completed multipart upload key=K9W031V6BFJP upload=AK9EQD156BQX tag=5MDL2FJ3QZXV type=write size=4020975 2024-09-14T11:15:10.949 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:10.952+0000 7f76c1e8a8c0 1 > prepared operation key=MEVTZ7OAD4CA tag=N798UX6FMTZF type=del size=2384084 2024-09-14T11:15:10.952 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:10.952+0000 7f76c1e8a8c0 1 < completed write operation key=15FU4CEGC22Q tag=O8J3TV2D5DQ6 type=write size=562906 2024-09-14T11:15:10.957 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:10.960+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_HS7T50JORDQJ.2~K03ZISE02S8Q.0 size=1048576 2024-09-14T11:15:10.958 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:10.960+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_HS7T50JORDQJ.2~K03ZISE02S8Q.1 size=443337 2024-09-14T11:15:10.959 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:10.960+0000 7f76c1e8a8c0 1 > prepared multipart upload key=HS7T50JORDQJ upload=K03ZISE02S8Q tag=W8BX2R9S45PW type=write size=2540489 2024-09-14T11:15:10.963 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:10.964+0000 7f76c1e8a8c0 1 < suggested update operation key=15FU4CEGC22Q tag=G0MEXBFQ07BE type=del size=3954357 2024-09-14T11:15:10.969 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:10.972+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_S43U13LYETS4.2~UCTT0N7MA85Q.0 size=1048576 2024-09-14T11:15:10.971 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:10.972+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_S43U13LYETS4.2~UCTT0N7MA85Q.1 size=974139 2024-09-14T11:15:10.971 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:10.972+0000 7f76c1e8a8c0 1 > prepared multipart upload key=S43U13LYETS4 upload=UCTT0N7MA85Q tag=QVAO61FAU6LM type=write size=3071291 2024-09-14T11:15:10.974 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:10.976+0000 7f76c1e8a8c0 1 < completed delete operation key=8FFV9G6EQR8F tag=22ZVQQ9G3AHQ type=del 2024-09-14T11:15:10.977 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:10.980+0000 7f76c1e8a8c0 1 > prepared operation key=K2EEZLRK7MVO tag=ELUNNCPPF9JV type=del size=1392136 2024-09-14T11:15:10.980 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:10.980+0000 7f76c1e8a8c0 1 < completed delete operation key=8FFV9G6EQR8F tag=219DZG3D42C5 type=del 2024-09-14T11:15:10.982 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:10.984+0000 7f76c1e8a8c0 1 > prepared operation key=85G6NT78HAWQ tag=2L4ZM8K5UCWH type=write size=456178 2024-09-14T11:15:10.984 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:10.988+0000 7f76c1e8a8c0 1 < completed delete operation key=BOCIF4TL7X7J tag=FVUSCIETAU4F type=del 2024-09-14T11:15:10.986 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:10.988+0000 7f76c1e8a8c0 1 > prepared operation key=BOCIF4TL7X7J tag=K5FDC89BHZAO type=del size=2876328 2024-09-14T11:15:10.988 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:10.992+0000 7f76c1e8a8c0 1 < completed part key=_multipart_S43U13LYETS4.2~5TQL5B9ZMH8V.0 size=1048576 2024-09-14T11:15:10.990 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:10.992+0000 7f76c1e8a8c0 1 < completed part key=_multipart_S43U13LYETS4.2~5TQL5B9ZMH8V.1 size=236 2024-09-14T11:15:10.994 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:10.996+0000 7f76c1e8a8c0 1 < completed multipart upload key=S43U13LYETS4 upload=5TQL5B9ZMH8V tag=2NTIQ6QO4O0G type=write size=2097388 2024-09-14T11:15:10.998 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:11.000+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_GZM0AQVHNCMM.2~QHN1N75OZIWO.0 size=1048576 2024-09-14T11:15:11.002 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:11.004+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_GZM0AQVHNCMM.2~QHN1N75OZIWO.1 size=328085 2024-09-14T11:15:11.002 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:11.004+0000 7f76c1e8a8c0 1 > prepared multipart upload key=GZM0AQVHNCMM upload=QHN1N75OZIWO tag=O8WGAHGANEWQ type=write size=2425237 2024-09-14T11:15:11.008 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:11.008+0000 7f76c1e8a8c0 1 < suggested update operation key=CIRQT9IDJ5OJ tag=AI72T7H4PIDF type=del size=484381 2024-09-14T11:15:11.012 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:11.016+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_KS37ZO6MKAH9.2~D8RFJH82XS43.0 size=1048576 2024-09-14T11:15:11.014 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:11.016+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_KS37ZO6MKAH9.2~D8RFJH82XS43.1 size=1048576 2024-09-14T11:15:11.016 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:11.016+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_KS37ZO6MKAH9.2~D8RFJH82XS43.2 size=288172 2024-09-14T11:15:11.016 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:11.016+0000 7f76c1e8a8c0 1 > prepared multipart upload key=KS37ZO6MKAH9 upload=D8RFJH82XS43 tag=LNLWRCUR4HZJ type=write size=3433900 2024-09-14T11:15:11.018 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:11.020+0000 7f76c1e8a8c0 1 < completed part key=_multipart_1K8ESNXU6WDF.2~TVSZVTVQIKH4.0 size=1048576 2024-09-14T11:15:11.020 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:11.024+0000 7f76c1e8a8c0 1 < completed part key=_multipart_1K8ESNXU6WDF.2~TVSZVTVQIKH4.1 size=979626 2024-09-14T11:15:11.024 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:11.028+0000 7f76c1e8a8c0 1 < completed multipart upload key=1K8ESNXU6WDF upload=TVSZVTVQIKH4 tag=YH2V3KSUXEB1 type=write size=3076778 2024-09-14T11:15:11.027 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:11.028+0000 7f76c1e8a8c0 1 > prepared operation key=W0MDRE9YO3UP tag=CXRRJ24FYD3D type=del size=964043 2024-09-14T11:15:11.029 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:11.032+0000 7f76c1e8a8c0 1 < completed part key=_multipart_85G6NT78HAWQ.2~1EN1GE5JCPW4.0 size=344931 2024-09-14T11:15:11.033 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:11.036+0000 7f76c1e8a8c0 1 < completed multipart upload key=85G6NT78HAWQ upload=1EN1GE5JCPW4 tag=ATVAGKIRS1LQ type=write size=1393507 2024-09-14T11:15:11.036 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:11.040+0000 7f76c1e8a8c0 1 > prepared operation key=SHKU2PRNREKK tag=ZTB2MQYA2TZV type=del size=759685 2024-09-14T11:15:11.041 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:11.044+0000 7f76c1e8a8c0 1 < suggested update operation key=KS37ZO6MKAH9 tag=B2NTURA92W4X type=del size=3974149 2024-09-14T11:15:11.044 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:11.044+0000 7f76c1e8a8c0 1 > prepared operation key=GZM0AQVHNCMM tag=6ZKKWW7CIITT type=del size=2266306 2024-09-14T11:15:11.046 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:11.048+0000 7f76c1e8a8c0 1 < completed delete operation key=LZ0YNFOVFYCL tag=KFB8D7SIHHBV type=del 2024-09-14T11:15:11.049 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:11.052+0000 7f76c1e8a8c0 1 > prepared operation key=K9W031V6BFJP tag=77ZDEFKKC431 type=write size=236592 2024-09-14T11:15:11.054 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:11.056+0000 7f76c1e8a8c0 1 < suggested update operation key=15FU4CEGC22Q tag=J3NF85ZEMEIT type=del size=2695841 2024-09-14T11:15:11.059 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:11.060+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_OOUEM16XL80W.2~4E5DMZ974GEK.0 size=1048576 2024-09-14T11:15:11.061 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:11.064+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_OOUEM16XL80W.2~4E5DMZ974GEK.1 size=1012924 2024-09-14T11:15:11.061 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:11.064+0000 7f76c1e8a8c0 1 > prepared multipart upload key=OOUEM16XL80W upload=4E5DMZ974GEK tag=12H9KG3G51M8 type=write size=3110076 2024-09-14T11:15:11.064 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:11.064+0000 7f76c1e8a8c0 1 < canceled operation key=S43U13LYETS4 tag=0DQWY6LQO4WE type=del size=3040682 2024-09-14T11:15:11.068 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:11.068+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_H9CQV6L29SL5.2~YRDKXMXQZ687.0 size=1048576 2024-09-14T11:15:11.070 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:11.072+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_H9CQV6L29SL5.2~YRDKXMXQZ687.1 size=1048576 2024-09-14T11:15:11.071 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:11.072+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_H9CQV6L29SL5.2~YRDKXMXQZ687.2 size=64896 2024-09-14T11:15:11.071 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:11.072+0000 7f76c1e8a8c0 1 > prepared multipart upload key=H9CQV6L29SL5 upload=YRDKXMXQZ687 tag=0RJDD010HGOR type=write size=3210624 2024-09-14T11:15:11.076 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:11.076+0000 7f76c1e8a8c0 1 < suggested update operation key=6TIJR323NMOH tag=U20PUGD6QFAA type=del size=449295 2024-09-14T11:15:11.079 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:11.080+0000 7f76c1e8a8c0 1 > prepared operation key=SHKU2PRNREKK tag=AMQFN0V1ENC0 type=del size=251350 2024-09-14T11:15:11.083 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:11.084+0000 7f76c1e8a8c0 1 < suggested remove operation key=GAVZRU8ZLW7S tag=PDRFDYQAFRJT type=del 2024-09-14T11:15:11.085 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:11.088+0000 7f76c1e8a8c0 1 > prepared operation key=OUMUTEBQ1TD0 tag=OPOF3FJEHOQL type=write size=325126 2024-09-14T11:15:11.090 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:11.092+0000 7f76c1e8a8c0 1 < suggested remove operation key=MEVTZ7OAD4CA tag=N798UX6FMTZF type=del 2024-09-14T11:15:11.093 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:11.096+0000 7f76c1e8a8c0 1 > prepared operation key=8FFV9G6EQR8F tag=CFN5EVQD8YTE type=del size=807159 2024-09-14T11:15:11.093 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:11.096+0000 7f76c1e8a8c0 1 < canceled part key=_multipart_HS7T50JORDQJ.2~K03ZISE02S8Q.0 size=1048576 2024-09-14T11:15:11.095 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:11.096+0000 7f76c1e8a8c0 1 < completed part key=_multipart_HS7T50JORDQJ.2~K03ZISE02S8Q.1 size=443337 2024-09-14T11:15:11.100 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:11.100+0000 7f76c1e8a8c0 1 < canceled multipart upload key=HS7T50JORDQJ upload=K03ZISE02S8Q tag=W8BX2R9S45PW type=write size=2540489 2024-09-14T11:15:11.102 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:11.104+0000 7f76c1e8a8c0 1 > prepared operation key=CIRQT9IDJ5OJ tag=IEDL0YSUG7WV type=del size=3717431 2024-09-14T11:15:11.103 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:11.104+0000 7f76c1e8a8c0 1 < canceled part key=_multipart_S43U13LYETS4.2~UCTT0N7MA85Q.0 size=1048576 2024-09-14T11:15:11.105 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:11.108+0000 7f76c1e8a8c0 1 < completed part key=_multipart_S43U13LYETS4.2~UCTT0N7MA85Q.1 size=974139 2024-09-14T11:15:11.109 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:11.112+0000 7f76c1e8a8c0 1 < canceled multipart upload key=S43U13LYETS4 upload=UCTT0N7MA85Q tag=QVAO61FAU6LM type=write size=3071291 2024-09-14T11:15:11.112 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:11.116+0000 7f76c1e8a8c0 1 > prepared operation key=LZ0YNFOVFYCL tag=HTGD9FBHFO5U type=del size=721597 2024-09-14T11:15:11.115 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:11.116+0000 7f76c1e8a8c0 1 < completed delete operation key=K2EEZLRK7MVO tag=ELUNNCPPF9JV type=del 2024-09-14T11:15:11.117 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:11.120+0000 7f76c1e8a8c0 1 > prepared operation key=TZO40K6J9877 tag=TI931L1MUFFE type=del size=568297 2024-09-14T11:15:11.120 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:11.124+0000 7f76c1e8a8c0 1 < completed write operation key=85G6NT78HAWQ tag=2L4ZM8K5UCWH type=write size=456178 2024-09-14T11:15:11.123 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:11.124+0000 7f76c1e8a8c0 1 > prepared operation key=VI61O3K069BP tag=0JZF5X0OZH0T type=del size=731995 2024-09-14T11:15:11.126 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:11.128+0000 7f76c1e8a8c0 1 < completed delete operation key=BOCIF4TL7X7J tag=K5FDC89BHZAO type=del 2024-09-14T11:15:11.131 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:11.132+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_BOCIF4TL7X7J.2~3PI5U5PHA042.0 size=1048576 2024-09-14T11:15:11.133 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:11.136+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_BOCIF4TL7X7J.2~3PI5U5PHA042.1 size=1048576 2024-09-14T11:15:11.135 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:11.136+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_BOCIF4TL7X7J.2~3PI5U5PHA042.2 size=207917 2024-09-14T11:15:11.135 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:11.136+0000 7f76c1e8a8c0 1 > prepared multipart upload key=BOCIF4TL7X7J upload=3PI5U5PHA042 tag=FJN3Z9T2YLLB type=write size=3353645 2024-09-14T11:15:11.138 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:11.140+0000 7f76c1e8a8c0 1 < completed part key=_multipart_GZM0AQVHNCMM.2~QHN1N75OZIWO.0 size=1048576 2024-09-14T11:15:11.140 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:11.140+0000 7f76c1e8a8c0 1 < completed part key=_multipart_GZM0AQVHNCMM.2~QHN1N75OZIWO.1 size=328085 2024-09-14T11:15:11.144 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:11.144+0000 7f76c1e8a8c0 1 < completed multipart upload key=GZM0AQVHNCMM upload=QHN1N75OZIWO tag=O8WGAHGANEWQ type=write size=2425237 2024-09-14T11:15:11.147 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:11.148+0000 7f76c1e8a8c0 1 > prepared operation key=H9CQV6L29SL5 tag=GO7PUX92QWWZ type=write size=220180 2024-09-14T11:15:11.149 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:11.152+0000 7f76c1e8a8c0 1 < completed part key=_multipart_KS37ZO6MKAH9.2~D8RFJH82XS43.0 size=1048576 2024-09-14T11:15:11.151 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:11.152+0000 7f76c1e8a8c0 1 < completed part key=_multipart_KS37ZO6MKAH9.2~D8RFJH82XS43.1 size=1048576 2024-09-14T11:15:11.154 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:11.156+0000 7f76c1e8a8c0 1 < completed part key=_multipart_KS37ZO6MKAH9.2~D8RFJH82XS43.2 size=288172 2024-09-14T11:15:11.159 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:11.160+0000 7f76c1e8a8c0 1 < completed multipart upload key=KS37ZO6MKAH9 upload=D8RFJH82XS43 tag=LNLWRCUR4HZJ type=write size=3433900 2024-09-14T11:15:11.162 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:11.164+0000 7f76c1e8a8c0 1 > prepared operation key=CIRQT9IDJ5OJ tag=PZBRPY4ADWIT type=del size=1420205 2024-09-14T11:15:11.164 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:11.168+0000 7f76c1e8a8c0 1 < completed delete operation key=W0MDRE9YO3UP tag=CXRRJ24FYD3D type=del 2024-09-14T11:15:11.168 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:11.172+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_GAVZRU8ZLW7S.2~TW2ETRX2M9AC.0 size=1048576 2024-09-14T11:15:11.171 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:11.172+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_GAVZRU8ZLW7S.2~TW2ETRX2M9AC.1 size=1048576 2024-09-14T11:15:11.173 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:11.176+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_GAVZRU8ZLW7S.2~TW2ETRX2M9AC.2 size=979488 2024-09-14T11:15:11.173 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:11.176+0000 7f76c1e8a8c0 1 > prepared multipart upload key=GAVZRU8ZLW7S upload=TW2ETRX2M9AC tag=NO9AQL4KP3VB type=write size=4125216 2024-09-14T11:15:11.175 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:11.176+0000 7f76c1e8a8c0 1 < completed delete operation key=SHKU2PRNREKK tag=ZTB2MQYA2TZV type=del 2024-09-14T11:15:11.180 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:11.180+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_SUNCRV0C1XYL.2~P4YYVEDK8F1I.0 size=1048576 2024-09-14T11:15:11.182 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:11.184+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_SUNCRV0C1XYL.2~P4YYVEDK8F1I.1 size=1048576 2024-09-14T11:15:11.184 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:11.184+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_SUNCRV0C1XYL.2~P4YYVEDK8F1I.2 size=125898 2024-09-14T11:15:11.184 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:11.184+0000 7f76c1e8a8c0 1 > prepared multipart upload key=SUNCRV0C1XYL upload=P4YYVEDK8F1I tag=NE7DRW58DAR1 type=write size=3271626 2024-09-14T11:15:11.189 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:11.192+0000 7f76c1e8a8c0 1 < suggested update operation key=GZM0AQVHNCMM tag=6ZKKWW7CIITT type=del size=2266306 2024-09-14T11:15:11.191 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:11.192+0000 7f76c1e8a8c0 1 > prepared operation key=GZM0AQVHNCMM tag=FY99KVXRSCN1 type=del size=4153210 2024-09-14T11:15:11.194 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:11.196+0000 7f76c1e8a8c0 1 < completed write operation key=K9W031V6BFJP tag=77ZDEFKKC431 type=write size=236592 2024-09-14T11:15:11.196 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:11.200+0000 7f76c1e8a8c0 1 > prepared operation key=OOUEM16XL80W tag=YAG519YF2DR7 type=del size=819931 2024-09-14T11:15:11.199 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:11.200+0000 7f76c1e8a8c0 1 < completed part key=_multipart_OOUEM16XL80W.2~4E5DMZ974GEK.0 size=1048576 2024-09-14T11:15:11.201 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:11.204+0000 7f76c1e8a8c0 1 < completed part key=_multipart_OOUEM16XL80W.2~4E5DMZ974GEK.1 size=1012924 2024-09-14T11:15:11.205 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:11.208+0000 7f76c1e8a8c0 1 < completed multipart upload key=OOUEM16XL80W upload=4E5DMZ974GEK tag=12H9KG3G51M8 type=write size=3110076 2024-09-14T11:15:11.212 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:11.212+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_K2EEZLRK7MVO.2~KKYDCFHC8VLN.0 size=1048576 2024-09-14T11:15:11.212 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:11.212+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_K2EEZLRK7MVO.2~KKYDCFHC8VLN.1 size=1023043 2024-09-14T11:15:11.212 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:11.212+0000 7f76c1e8a8c0 1 > prepared multipart upload key=K2EEZLRK7MVO upload=KKYDCFHC8VLN tag=M0V1NH2JAZM0 type=write size=3120195 2024-09-14T11:15:11.213 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:11.216+0000 7f76c1e8a8c0 1 < completed part key=_multipart_H9CQV6L29SL5.2~YRDKXMXQZ687.0 size=1048576 2024-09-14T11:15:11.215 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:11.216+0000 7f76c1e8a8c0 1 < completed part key=_multipart_H9CQV6L29SL5.2~YRDKXMXQZ687.1 size=1048576 2024-09-14T11:15:11.217 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:11.220+0000 7f76c1e8a8c0 1 < completed part key=_multipart_H9CQV6L29SL5.2~YRDKXMXQZ687.2 size=64896 2024-09-14T11:15:11.221 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:11.224+0000 7f76c1e8a8c0 1 < completed multipart upload key=H9CQV6L29SL5 upload=YRDKXMXQZ687 tag=0RJDD010HGOR type=write size=3210624 2024-09-14T11:15:11.225 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:11.228+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_BOCIF4TL7X7J.2~KAED6OLC1SJQ.0 size=1048576 2024-09-14T11:15:11.227 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:11.228+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_BOCIF4TL7X7J.2~KAED6OLC1SJQ.1 size=740432 2024-09-14T11:15:11.228 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:11.228+0000 7f76c1e8a8c0 1 > prepared multipart upload key=BOCIF4TL7X7J upload=KAED6OLC1SJQ tag=064WOAEEPVCQ type=write size=2837584 2024-09-14T11:15:11.232 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:11.236+0000 7f76c1e8a8c0 1 < suggested remove operation key=SHKU2PRNREKK tag=AMQFN0V1ENC0 type=del 2024-09-14T11:15:11.236 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:11.240+0000 7f76c1e8a8c0 1 > prepared operation key=SHKU2PRNREKK tag=ZOD15BA510J4 type=del size=3000873 2024-09-14T11:15:11.239 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:11.240+0000 7f76c1e8a8c0 1 < completed write operation key=OUMUTEBQ1TD0 tag=OPOF3FJEHOQL type=write size=325126 2024-09-14T11:15:11.242 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:11.244+0000 7f76c1e8a8c0 1 > prepared operation key=HJ701768A6I7 tag=Y7PGSYSP0L24 type=write size=953816 2024-09-14T11:15:11.244 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:11.244+0000 7f76c1e8a8c0 1 < completed delete operation key=8FFV9G6EQR8F tag=CFN5EVQD8YTE type=del 2024-09-14T11:15:11.246 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:11.248+0000 7f76c1e8a8c0 1 > prepared operation key=15FU4CEGC22Q tag=BVYN21GLEC4S type=del size=907131 2024-09-14T11:15:11.249 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:11.252+0000 7f76c1e8a8c0 1 < completed delete operation key=CIRQT9IDJ5OJ tag=IEDL0YSUG7WV type=del 2024-09-14T11:15:11.251 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:11.252+0000 7f76c1e8a8c0 1 > prepared operation key=SHKU2PRNREKK tag=0QXW96HI99JJ type=del size=3283564 2024-09-14T11:15:11.254 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:11.256+0000 7f76c1e8a8c0 1 < completed delete operation key=LZ0YNFOVFYCL tag=HTGD9FBHFO5U type=del 2024-09-14T11:15:11.259 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:11.260+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_TZO40K6J9877.2~F3YXPB7H5LFM.0 size=1048576 2024-09-14T11:15:11.261 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:11.264+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_TZO40K6J9877.2~F3YXPB7H5LFM.1 size=508401 2024-09-14T11:15:11.261 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:11.264+0000 7f76c1e8a8c0 1 > prepared multipart upload key=TZO40K6J9877 upload=F3YXPB7H5LFM tag=7XY99WWWA6HU type=write size=2605553 2024-09-14T11:15:11.263 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:11.264+0000 7f76c1e8a8c0 1 < completed delete operation key=TZO40K6J9877 tag=TI931L1MUFFE type=del 2024-09-14T11:15:11.266 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:11.268+0000 7f76c1e8a8c0 1 > prepared operation key=85G6NT78HAWQ tag=B0MWR7I1UXIA type=del size=1641952 2024-09-14T11:15:11.269 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:11.272+0000 7f76c1e8a8c0 1 < completed delete operation key=VI61O3K069BP tag=0JZF5X0OZH0T type=del 2024-09-14T11:15:11.272 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:11.272+0000 7f76c1e8a8c0 1 > prepared operation key=W0MDRE9YO3UP tag=3SOVIGJSL394 type=del size=3867135 2024-09-14T11:15:11.274 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:11.276+0000 7f76c1e8a8c0 1 < completed part key=_multipart_BOCIF4TL7X7J.2~3PI5U5PHA042.0 size=1048576 2024-09-14T11:15:11.277 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:11.280+0000 7f76c1e8a8c0 1 < completed part key=_multipart_BOCIF4TL7X7J.2~3PI5U5PHA042.1 size=1048576 2024-09-14T11:15:11.279 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:11.280+0000 7f76c1e8a8c0 1 < completed part key=_multipart_BOCIF4TL7X7J.2~3PI5U5PHA042.2 size=207917 2024-09-14T11:15:11.283 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:11.284+0000 7f76c1e8a8c0 1 < completed multipart upload key=BOCIF4TL7X7J upload=3PI5U5PHA042 tag=FJN3Z9T2YLLB type=write size=3353645 2024-09-14T11:15:11.285 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:11.288+0000 7f76c1e8a8c0 1 > prepared operation key=OOUEM16XL80W tag=DN5K1ZI3TOWL type=write size=362685 2024-09-14T11:15:11.287 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:11.288+0000 7f76c1e8a8c0 1 < completed write operation key=H9CQV6L29SL5 tag=GO7PUX92QWWZ type=write size=220180 2024-09-14T11:15:11.290 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:11.292+0000 7f76c1e8a8c0 1 > prepared operation key=MEVTZ7OAD4CA tag=F80881YGOLCC type=del size=2597085 2024-09-14T11:15:11.293 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:11.296+0000 7f76c1e8a8c0 1 < completed delete operation key=CIRQT9IDJ5OJ tag=PZBRPY4ADWIT type=del 2024-09-14T11:15:11.295 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:11.296+0000 7f76c1e8a8c0 1 > prepared operation key=TUFOZKTV9XIH tag=NJ7Z7HLMD5TH type=del size=1893149 2024-09-14T11:15:11.297 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:11.300+0000 7f76c1e8a8c0 1 < completed part key=_multipart_GAVZRU8ZLW7S.2~TW2ETRX2M9AC.0 size=1048576 2024-09-14T11:15:11.300 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:11.300+0000 7f76c1e8a8c0 1 < completed part key=_multipart_GAVZRU8ZLW7S.2~TW2ETRX2M9AC.1 size=1048576 2024-09-14T11:15:11.302 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:11.304+0000 7f76c1e8a8c0 1 < completed part key=_multipart_GAVZRU8ZLW7S.2~TW2ETRX2M9AC.2 size=979488 2024-09-14T11:15:11.306 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:11.308+0000 7f76c1e8a8c0 1 < completed multipart upload key=GAVZRU8ZLW7S upload=TW2ETRX2M9AC tag=NO9AQL4KP3VB type=write size=4125216 2024-09-14T11:15:11.311 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:11.312+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_6TIJR323NMOH.2~B7SE588P84SU.0 size=1048576 2024-09-14T11:15:11.313 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:11.316+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_6TIJR323NMOH.2~B7SE588P84SU.1 size=686009 2024-09-14T11:15:11.313 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:11.316+0000 7f76c1e8a8c0 1 > prepared multipart upload key=6TIJR323NMOH upload=B7SE588P84SU tag=KJRUMFBBXPG3 type=write size=2783161 2024-09-14T11:15:11.316 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:11.316+0000 7f76c1e8a8c0 1 < completed part key=_multipart_SUNCRV0C1XYL.2~P4YYVEDK8F1I.0 size=1048576 2024-09-14T11:15:11.318 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:11.320+0000 7f76c1e8a8c0 1 < completed part key=_multipart_SUNCRV0C1XYL.2~P4YYVEDK8F1I.1 size=1048576 2024-09-14T11:15:11.320 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:11.324+0000 7f76c1e8a8c0 1 < completed part key=_multipart_SUNCRV0C1XYL.2~P4YYVEDK8F1I.2 size=125898 2024-09-14T11:15:11.325 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:11.328+0000 7f76c1e8a8c0 1 < completed multipart upload key=SUNCRV0C1XYL upload=P4YYVEDK8F1I tag=NE7DRW58DAR1 type=write size=3271626 2024-09-14T11:15:11.327 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:11.328+0000 7f76c1e8a8c0 1 > prepared operation key=S43U13LYETS4 tag=OO5V2K3GRXU2 type=write size=672835 2024-09-14T11:15:11.330 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:11.332+0000 7f76c1e8a8c0 1 < completed delete operation key=GZM0AQVHNCMM tag=FY99KVXRSCN1 type=del 2024-09-14T11:15:11.333 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:11.336+0000 7f76c1e8a8c0 1 > prepared operation key=OOUEM16XL80W tag=1EVKW876BF8W type=del size=3789533 2024-09-14T11:15:11.336 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:11.336+0000 7f76c1e8a8c0 1 < completed delete operation key=OOUEM16XL80W tag=YAG519YF2DR7 type=del 2024-09-14T11:15:11.341 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:11.344+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_GAVZRU8ZLW7S.2~7VZIWNGU96RM.0 size=583988 2024-09-14T11:15:11.341 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:11.344+0000 7f76c1e8a8c0 1 > prepared multipart upload key=GAVZRU8ZLW7S upload=7VZIWNGU96RM tag=CS0AY05BJJMJ type=write size=1632564 2024-09-14T11:15:11.341 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:11.344+0000 7f76c1e8a8c0 1 < canceled part key=_multipart_K2EEZLRK7MVO.2~KKYDCFHC8VLN.0 size=1048576 2024-09-14T11:15:11.343 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:11.344+0000 7f76c1e8a8c0 1 < completed part key=_multipart_K2EEZLRK7MVO.2~KKYDCFHC8VLN.1 size=1023043 2024-09-14T11:15:11.348 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:11.348+0000 7f76c1e8a8c0 1 < canceled multipart upload key=K2EEZLRK7MVO upload=KKYDCFHC8VLN tag=M0V1NH2JAZM0 type=write size=3120195 2024-09-14T11:15:11.353 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:11.356+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_LZ0YNFOVFYCL.2~W57STNOFXH3D.0 size=1048576 2024-09-14T11:15:11.356 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:11.356+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_LZ0YNFOVFYCL.2~W57STNOFXH3D.1 size=887704 2024-09-14T11:15:11.356 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:11.356+0000 7f76c1e8a8c0 1 > prepared multipart upload key=LZ0YNFOVFYCL upload=W57STNOFXH3D tag=ME6TPT2GDCBQ type=write size=2984856 2024-09-14T11:15:11.358 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:11.360+0000 7f76c1e8a8c0 1 < completed part key=_multipart_BOCIF4TL7X7J.2~KAED6OLC1SJQ.0 size=1048576 2024-09-14T11:15:11.360 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:11.364+0000 7f76c1e8a8c0 1 < completed part key=_multipart_BOCIF4TL7X7J.2~KAED6OLC1SJQ.1 size=740432 2024-09-14T11:15:11.365 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:11.368+0000 7f76c1e8a8c0 1 < completed multipart upload key=BOCIF4TL7X7J upload=KAED6OLC1SJQ tag=064WOAEEPVCQ type=write size=2837584 2024-09-14T11:15:11.368 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:11.368+0000 7f76c1e8a8c0 1 > prepared operation key=HJ701768A6I7 tag=VB051RYKZ3VR type=del size=1251208 2024-09-14T11:15:11.370 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:11.372+0000 7f76c1e8a8c0 1 < completed delete operation key=SHKU2PRNREKK tag=ZOD15BA510J4 type=del 2024-09-14T11:15:11.373 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:11.376+0000 7f76c1e8a8c0 1 > prepared operation key=GZM0AQVHNCMM tag=U2UICXB51DRT type=del size=46564 2024-09-14T11:15:11.379 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:11.380+0000 7f76c1e8a8c0 1 < suggested remove operation key=HJ701768A6I7 tag=Y7PGSYSP0L24 type=write 2024-09-14T11:15:11.382 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:11.384+0000 7f76c1e8a8c0 1 > prepared operation key=F3KFS0P1WM7W tag=58990ZIFT81M type=del size=2236734 2024-09-14T11:15:11.384 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:11.388+0000 7f76c1e8a8c0 1 < completed delete operation key=15FU4CEGC22Q tag=BVYN21GLEC4S type=del 2024-09-14T11:15:11.388 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:11.388+0000 7f76c1e8a8c0 1 > prepared operation key=SUNCRV0C1XYL tag=Z7GJ2PJ91KXG type=del size=1964626 2024-09-14T11:15:11.391 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:11.392+0000 7f76c1e8a8c0 1 < canceled operation key=SHKU2PRNREKK tag=0QXW96HI99JJ type=del size=3283564 2024-09-14T11:15:11.397 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:11.400+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_CIRQT9IDJ5OJ.2~5BHH9TMP87MB.0 size=1048576 2024-09-14T11:15:11.400 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:11.404+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_CIRQT9IDJ5OJ.2~5BHH9TMP87MB.1 size=1048576 2024-09-14T11:15:11.403 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:11.404+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_CIRQT9IDJ5OJ.2~5BHH9TMP87MB.2 size=23247 2024-09-14T11:15:11.403 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:11.404+0000 7f76c1e8a8c0 1 > prepared multipart upload key=CIRQT9IDJ5OJ upload=5BHH9TMP87MB tag=ZK9VH4C8C75I type=write size=3168975 2024-09-14T11:15:11.407 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:11.408+0000 7f76c1e8a8c0 1 < completed part key=_multipart_TZO40K6J9877.2~F3YXPB7H5LFM.0 size=1048576 2024-09-14T11:15:11.409 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:11.412+0000 7f76c1e8a8c0 1 < completed part key=_multipart_TZO40K6J9877.2~F3YXPB7H5LFM.1 size=508401 2024-09-14T11:15:11.415 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:11.416+0000 7f76c1e8a8c0 1 < completed multipart upload key=TZO40K6J9877 upload=F3YXPB7H5LFM tag=7XY99WWWA6HU type=write size=2605553 2024-09-14T11:15:11.421 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:11.424+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_R5I9H7WAK7Z7.2~FP4DNHCPZ1MR.0 size=1048576 2024-09-14T11:15:11.423 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:11.424+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_R5I9H7WAK7Z7.2~FP4DNHCPZ1MR.1 size=1048576 2024-09-14T11:15:11.426 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:11.428+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_R5I9H7WAK7Z7.2~FP4DNHCPZ1MR.2 size=218303 2024-09-14T11:15:11.426 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:11.428+0000 7f76c1e8a8c0 1 > prepared multipart upload key=R5I9H7WAK7Z7 upload=FP4DNHCPZ1MR tag=Q6PH4Y57D5RN type=write size=3364031 2024-09-14T11:15:11.429 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:11.432+0000 7f76c1e8a8c0 1 < completed delete operation key=85G6NT78HAWQ tag=B0MWR7I1UXIA type=del 2024-09-14T11:15:11.432 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:11.432+0000 7f76c1e8a8c0 1 > prepared operation key=W0MDRE9YO3UP tag=01L4QVA0HRBV type=del size=1528366 2024-09-14T11:15:11.435 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:11.436+0000 7f76c1e8a8c0 1 < completed delete operation key=W0MDRE9YO3UP tag=3SOVIGJSL394 type=del 2024-09-14T11:15:11.438 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:11.440+0000 7f76c1e8a8c0 1 > prepared operation key=6TIJR323NMOH tag=HAVRGXH8Z7GB type=del size=939663 2024-09-14T11:15:11.441 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:11.444+0000 7f76c1e8a8c0 1 < completed write operation key=OOUEM16XL80W tag=DN5K1ZI3TOWL type=write size=362685 2024-09-14T11:15:11.447 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:11.448+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_S43U13LYETS4.2~JJEG3SNX46HQ.0 size=1048576 2024-09-14T11:15:11.449 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:11.452+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_S43U13LYETS4.2~JJEG3SNX46HQ.1 size=1048576 2024-09-14T11:15:11.452 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:11.456+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_S43U13LYETS4.2~JJEG3SNX46HQ.2 size=119242 2024-09-14T11:15:11.452 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:11.456+0000 7f76c1e8a8c0 1 > prepared multipart upload key=S43U13LYETS4 upload=JJEG3SNX46HQ tag=J5YI22AXF9I7 type=write size=3264970 2024-09-14T11:15:11.455 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:11.456+0000 7f76c1e8a8c0 1 < completed delete operation key=MEVTZ7OAD4CA tag=F80881YGOLCC type=del 2024-09-14T11:15:11.458 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:11.460+0000 7f76c1e8a8c0 1 > prepared operation key=OUMUTEBQ1TD0 tag=A82MQGNAHHS0 type=del size=3544862 2024-09-14T11:15:11.461 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:11.464+0000 7f76c1e8a8c0 1 < completed delete operation key=TUFOZKTV9XIH tag=NJ7Z7HLMD5TH type=del 2024-09-14T11:15:11.463 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:11.464+0000 7f76c1e8a8c0 1 > prepared operation key=LZ0YNFOVFYCL tag=4NOZ9ITAHLAK type=del size=1040160 2024-09-14T11:15:11.466 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:11.468+0000 7f76c1e8a8c0 1 < completed part key=_multipart_6TIJR323NMOH.2~B7SE588P84SU.0 size=1048576 2024-09-14T11:15:11.469 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:11.472+0000 7f76c1e8a8c0 1 < completed part key=_multipart_6TIJR323NMOH.2~B7SE588P84SU.1 size=686009 2024-09-14T11:15:11.473 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:11.476+0000 7f76c1e8a8c0 1 < completed multipart upload key=6TIJR323NMOH upload=B7SE588P84SU tag=KJRUMFBBXPG3 type=write size=2783161 2024-09-14T11:15:11.478 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:11.480+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_6TIJR323NMOH.2~ZQYU45DQHOQC.0 size=728794 2024-09-14T11:15:11.478 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:11.480+0000 7f76c1e8a8c0 1 > prepared multipart upload key=6TIJR323NMOH upload=ZQYU45DQHOQC tag=NZYJL79XFKON type=write size=1777370 2024-09-14T11:15:11.484 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:11.484+0000 7f76c1e8a8c0 1 < suggested update operation key=S43U13LYETS4 tag=OO5V2K3GRXU2 type=write size=672835 2024-09-14T11:15:11.489 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:11.492+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_8FFV9G6EQR8F.2~BLZI6N8XFVEN.0 size=53785 2024-09-14T11:15:11.489 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:11.492+0000 7f76c1e8a8c0 1 > prepared multipart upload key=8FFV9G6EQR8F upload=BLZI6N8XFVEN tag=WULF73OOMI4O type=write size=1102361 2024-09-14T11:15:11.491 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:11.492+0000 7f76c1e8a8c0 1 < completed delete operation key=OOUEM16XL80W tag=1EVKW876BF8W type=del 2024-09-14T11:15:11.494 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:11.496+0000 7f76c1e8a8c0 1 > prepared operation key=1K8ESNXU6WDF tag=2SEQFG6UH5LT type=write size=706523 2024-09-14T11:15:11.500 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:11.500+0000 7f76c1e8a8c0 1 < completed part key=_multipart_GAVZRU8ZLW7S.2~7VZIWNGU96RM.0 size=583988 2024-09-14T11:15:11.505 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:11.508+0000 7f76c1e8a8c0 1 < completed multipart upload key=GAVZRU8ZLW7S upload=7VZIWNGU96RM tag=CS0AY05BJJMJ type=write size=1632564 2024-09-14T11:15:11.510 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:11.512+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_XC8VWSHZOPFP.2~1B3KDNXOG1BU.0 size=1048576 2024-09-14T11:15:11.512 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:11.516+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_XC8VWSHZOPFP.2~1B3KDNXOG1BU.1 size=982085 2024-09-14T11:15:11.512 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:11.516+0000 7f76c1e8a8c0 1 > prepared multipart upload key=XC8VWSHZOPFP upload=1B3KDNXOG1BU tag=C332QXECTQB8 type=write size=3079237 2024-09-14T11:15:11.515 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:11.516+0000 7f76c1e8a8c0 1 < completed part key=_multipart_LZ0YNFOVFYCL.2~W57STNOFXH3D.0 size=1048576 2024-09-14T11:15:11.517 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:11.520+0000 7f76c1e8a8c0 1 < completed part key=_multipart_LZ0YNFOVFYCL.2~W57STNOFXH3D.1 size=887704 2024-09-14T11:15:11.522 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:11.524+0000 7f76c1e8a8c0 1 < completed multipart upload key=LZ0YNFOVFYCL upload=W57STNOFXH3D tag=ME6TPT2GDCBQ type=write size=2984856 2024-09-14T11:15:11.525 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:11.528+0000 7f76c1e8a8c0 1 > prepared operation key=LZ0YNFOVFYCL tag=FW50BCA3D1LJ type=write size=489817 2024-09-14T11:15:11.528 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:11.528+0000 7f76c1e8a8c0 -1 < failed to complete operation key=HJ701768A6I7 tag=VB051RYKZ3VR type=del size=1251208: (22) Invalid argument 2024-09-14T11:15:11.533 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:11.536+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_15FU4CEGC22Q.2~9WXENY9RAO3M.0 size=1048576 2024-09-14T11:15:11.535 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:11.536+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_15FU4CEGC22Q.2~9WXENY9RAO3M.1 size=274628 2024-09-14T11:15:11.535 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:11.536+0000 7f76c1e8a8c0 1 > prepared multipart upload key=15FU4CEGC22Q upload=9WXENY9RAO3M tag=JO923NNQ3O9I type=write size=2371780 2024-09-14T11:15:11.538 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:11.540+0000 7f76c1e8a8c0 1 < completed delete operation key=GZM0AQVHNCMM tag=U2UICXB51DRT type=del 2024-09-14T11:15:11.541 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:11.544+0000 7f76c1e8a8c0 1 > prepared operation key=VI61O3K069BP tag=1PI1WZNSLK9N type=del size=3091300 2024-09-14T11:15:11.544 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:11.544+0000 7f76c1e8a8c0 1 < completed delete operation key=F3KFS0P1WM7W tag=58990ZIFT81M type=del 2024-09-14T11:15:11.547 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:11.548+0000 7f76c1e8a8c0 1 > prepared operation key=K9W031V6BFJP tag=5DFJC80YC22U type=del size=491637 2024-09-14T11:15:11.552 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:11.556+0000 7f76c1e8a8c0 1 < suggested update operation key=SUNCRV0C1XYL tag=Z7GJ2PJ91KXG type=del size=1964626 2024-09-14T11:15:11.555 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:11.556+0000 7f76c1e8a8c0 1 > prepared operation key=TZO40K6J9877 tag=9S5V919ST8XH type=del size=564423 2024-09-14T11:15:11.558 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:11.560+0000 7f76c1e8a8c0 1 < completed part key=_multipart_CIRQT9IDJ5OJ.2~5BHH9TMP87MB.0 size=1048576 2024-09-14T11:15:11.560 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:11.560+0000 7f76c1e8a8c0 1 < completed part key=_multipart_CIRQT9IDJ5OJ.2~5BHH9TMP87MB.1 size=1048576 2024-09-14T11:15:11.562 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:11.564+0000 7f76c1e8a8c0 1 < completed part key=_multipart_CIRQT9IDJ5OJ.2~5BHH9TMP87MB.2 size=23247 2024-09-14T11:15:11.568 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:11.568+0000 7f76c1e8a8c0 1 < completed multipart upload key=CIRQT9IDJ5OJ upload=5BHH9TMP87MB tag=ZK9VH4C8C75I type=write size=3168975 2024-09-14T11:15:11.571 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:11.572+0000 7f76c1e8a8c0 1 > prepared operation key=6TIJR323NMOH tag=3VXDEM2VLNV0 type=del size=4124092 2024-09-14T11:15:11.574 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:11.576+0000 7f76c1e8a8c0 1 < completed part key=_multipart_R5I9H7WAK7Z7.2~FP4DNHCPZ1MR.0 size=1048576 2024-09-14T11:15:11.577 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:11.580+0000 7f76c1e8a8c0 1 < completed part key=_multipart_R5I9H7WAK7Z7.2~FP4DNHCPZ1MR.1 size=1048576 2024-09-14T11:15:11.580 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:11.580+0000 7f76c1e8a8c0 1 < completed part key=_multipart_R5I9H7WAK7Z7.2~FP4DNHCPZ1MR.2 size=218303 2024-09-14T11:15:11.585 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:11.588+0000 7f76c1e8a8c0 1 < completed multipart upload key=R5I9H7WAK7Z7 upload=FP4DNHCPZ1MR tag=Q6PH4Y57D5RN type=write size=3364031 2024-09-14T11:15:11.591 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:11.592+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_SHKU2PRNREKK.2~M7NBQ2269THD.0 size=1048576 2024-09-14T11:15:11.594 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:11.596+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_SHKU2PRNREKK.2~M7NBQ2269THD.1 size=1048576 2024-09-14T11:15:11.597 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:11.600+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_SHKU2PRNREKK.2~M7NBQ2269THD.2 size=109542 2024-09-14T11:15:11.597 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:11.600+0000 7f76c1e8a8c0 1 > prepared multipart upload key=SHKU2PRNREKK upload=M7NBQ2269THD tag=QE6M8Z0A7V7U type=write size=3255270 2024-09-14T11:15:11.601 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:11.604+0000 7f76c1e8a8c0 1 < completed delete operation key=W0MDRE9YO3UP tag=01L4QVA0HRBV type=del 2024-09-14T11:15:11.604 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:11.608+0000 7f76c1e8a8c0 1 > prepared operation key=1W5733SDHGDN tag=M5W2CL2NJMJF type=del size=434624 2024-09-14T11:15:11.610 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:11.612+0000 7f76c1e8a8c0 1 < suggested update operation key=6TIJR323NMOH tag=HAVRGXH8Z7GB type=del size=939663 2024-09-14T11:15:11.616 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:11.616+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_MEVTZ7OAD4CA.2~03PIRKCS6LCO.0 size=1048576 2024-09-14T11:15:11.619 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:11.620+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_MEVTZ7OAD4CA.2~03PIRKCS6LCO.1 size=164876 2024-09-14T11:15:11.619 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:11.620+0000 7f76c1e8a8c0 1 > prepared multipart upload key=MEVTZ7OAD4CA upload=03PIRKCS6LCO tag=09N2OQH3LLYG type=write size=2262028 2024-09-14T11:15:11.622 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:11.624+0000 7f76c1e8a8c0 1 < completed part key=_multipart_S43U13LYETS4.2~JJEG3SNX46HQ.0 size=1048576 2024-09-14T11:15:11.625 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:11.628+0000 7f76c1e8a8c0 1 < completed part key=_multipart_S43U13LYETS4.2~JJEG3SNX46HQ.1 size=1048576 2024-09-14T11:15:11.627 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:11.628+0000 7f76c1e8a8c0 1 < completed part key=_multipart_S43U13LYETS4.2~JJEG3SNX46HQ.2 size=119242 2024-09-14T11:15:11.633 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:11.636+0000 7f76c1e8a8c0 1 < completed multipart upload key=S43U13LYETS4 upload=JJEG3SNX46HQ tag=J5YI22AXF9I7 type=write size=3264970 2024-09-14T11:15:11.637 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:11.640+0000 7f76c1e8a8c0 1 > prepared operation key=8FFV9G6EQR8F tag=60LMU6TRYLH2 type=del size=2022169 2024-09-14T11:15:11.643 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:11.644+0000 7f76c1e8a8c0 1 < suggested remove operation key=OUMUTEBQ1TD0 tag=A82MQGNAHHS0 type=del 2024-09-14T11:15:11.649 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:11.652+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_SHKU2PRNREKK.2~N2PNZV3RG0KH.0 size=1048576 2024-09-14T11:15:11.652 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:11.652+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_SHKU2PRNREKK.2~N2PNZV3RG0KH.1 size=1048576 2024-09-14T11:15:11.654 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:11.656+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_SHKU2PRNREKK.2~N2PNZV3RG0KH.2 size=650318 2024-09-14T11:15:11.655 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:11.656+0000 7f76c1e8a8c0 1 > prepared multipart upload key=SHKU2PRNREKK upload=N2PNZV3RG0KH tag=STRF7WP3KNBM type=write size=3796046 2024-09-14T11:15:11.658 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:11.660+0000 7f76c1e8a8c0 1 < completed delete operation key=LZ0YNFOVFYCL tag=4NOZ9ITAHLAK type=del 2024-09-14T11:15:11.661 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:11.664+0000 7f76c1e8a8c0 1 > prepared operation key=OOUEM16XL80W tag=7U23PXCMIGEU type=write size=808758 2024-09-14T11:15:11.664 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:11.664+0000 7f76c1e8a8c0 1 < completed part key=_multipart_6TIJR323NMOH.2~ZQYU45DQHOQC.0 size=728794 2024-09-14T11:15:11.669 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:11.672+0000 7f76c1e8a8c0 1 < completed multipart upload key=6TIJR323NMOH upload=ZQYU45DQHOQC tag=NZYJL79XFKON type=write size=1777370 2024-09-14T11:15:11.676 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:11.676+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_HJ701768A6I7.2~WG80G3Z7TFOW.0 size=1048576 2024-09-14T11:15:11.678 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:11.680+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_HJ701768A6I7.2~WG80G3Z7TFOW.1 size=1048576 2024-09-14T11:15:11.681 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:11.684+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_HJ701768A6I7.2~WG80G3Z7TFOW.2 size=460448 2024-09-14T11:15:11.681 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:11.684+0000 7f76c1e8a8c0 1 > prepared multipart upload key=HJ701768A6I7 upload=WG80G3Z7TFOW tag=Z2FNBGMS11YJ type=write size=3606176 2024-09-14T11:15:11.681 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:11.684+0000 7f76c1e8a8c0 1 < canceled part key=_multipart_8FFV9G6EQR8F.2~BLZI6N8XFVEN.0 size=53785 2024-09-14T11:15:11.686 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:11.688+0000 7f76c1e8a8c0 1 < canceled multipart upload key=8FFV9G6EQR8F upload=BLZI6N8XFVEN tag=WULF73OOMI4O type=write size=1102361 2024-09-14T11:15:11.689 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:11.692+0000 7f76c1e8a8c0 1 > prepared operation key=6TIJR323NMOH tag=XRWK6G2XVK16 type=del size=968328 2024-09-14T11:15:11.692 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:11.696+0000 7f76c1e8a8c0 1 < completed write operation key=1K8ESNXU6WDF tag=2SEQFG6UH5LT type=write size=706523 2024-09-14T11:15:11.696 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:11.696+0000 7f76c1e8a8c0 1 > prepared operation key=85G6NT78HAWQ tag=8HEEK34U7TR8 type=del size=2207591 2024-09-14T11:15:11.699 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:11.700+0000 7f76c1e8a8c0 1 < completed part key=_multipart_XC8VWSHZOPFP.2~1B3KDNXOG1BU.0 size=1048576 2024-09-14T11:15:11.702 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:11.704+0000 7f76c1e8a8c0 1 < completed part key=_multipart_XC8VWSHZOPFP.2~1B3KDNXOG1BU.1 size=982085 2024-09-14T11:15:11.708 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:11.708+0000 7f76c1e8a8c0 1 < completed multipart upload key=XC8VWSHZOPFP upload=1B3KDNXOG1BU tag=C332QXECTQB8 type=write size=3079237 2024-09-14T11:15:11.712 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:11.712+0000 7f76c1e8a8c0 1 > prepared operation key=SUNCRV0C1XYL tag=YIUVGUZZOE63 type=del size=3957726 2024-09-14T11:15:11.715 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:11.716+0000 7f76c1e8a8c0 1 < canceled operation key=LZ0YNFOVFYCL tag=FW50BCA3D1LJ type=write size=489817 2024-09-14T11:15:11.721 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:11.724+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_OOUEM16XL80W.2~5HIA65HL55MZ.0 size=296981 2024-09-14T11:15:11.721 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:11.724+0000 7f76c1e8a8c0 1 > prepared multipart upload key=OOUEM16XL80W upload=5HIA65HL55MZ tag=A7QHIPF28B4K type=write size=1345557 2024-09-14T11:15:11.724 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:11.728+0000 7f76c1e8a8c0 1 < completed part key=_multipart_15FU4CEGC22Q.2~9WXENY9RAO3M.0 size=1048576 2024-09-14T11:15:11.727 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:11.728+0000 7f76c1e8a8c0 1 < completed part key=_multipart_15FU4CEGC22Q.2~9WXENY9RAO3M.1 size=274628 2024-09-14T11:15:11.733 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:11.736+0000 7f76c1e8a8c0 1 < completed multipart upload key=15FU4CEGC22Q upload=9WXENY9RAO3M tag=JO923NNQ3O9I type=write size=2371780 2024-09-14T11:15:11.739 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:11.740+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_6TIJR323NMOH.2~RG54USG1QCJ6.0 size=1048576 2024-09-14T11:15:11.741 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:11.744+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_6TIJR323NMOH.2~RG54USG1QCJ6.1 size=1048576 2024-09-14T11:15:11.744 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:11.744+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_6TIJR323NMOH.2~RG54USG1QCJ6.2 size=1011679 2024-09-14T11:15:11.744 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:11.744+0000 7f76c1e8a8c0 1 > prepared multipart upload key=6TIJR323NMOH upload=RG54USG1QCJ6 tag=B8V0BFCSCWPG type=write size=4157407 2024-09-14T11:15:11.747 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:11.748+0000 7f76c1e8a8c0 1 < completed delete operation key=VI61O3K069BP tag=1PI1WZNSLK9N type=del 2024-09-14T11:15:11.753 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:11.756+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_H9CQV6L29SL5.2~0B0NEODNQY01.0 size=832883 2024-09-14T11:15:11.753 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:11.756+0000 7f76c1e8a8c0 1 > prepared multipart upload key=H9CQV6L29SL5 upload=0B0NEODNQY01 tag=HRKS38Q0LLMC type=write size=1881459 2024-09-14T11:15:11.756 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:11.756+0000 7f76c1e8a8c0 1 < completed delete operation key=K9W031V6BFJP tag=5DFJC80YC22U type=del 2024-09-14T11:15:11.759 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:11.760+0000 7f76c1e8a8c0 1 > prepared operation key=15FU4CEGC22Q tag=VOMS0TDQZIVA type=write size=11505 2024-09-14T11:15:11.762 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:11.764+0000 7f76c1e8a8c0 1 < canceled operation key=TZO40K6J9877 tag=9S5V919ST8XH type=del size=564423 2024-09-14T11:15:11.765 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:11.768+0000 7f76c1e8a8c0 1 > prepared operation key=OUMUTEBQ1TD0 tag=B6AGJN1N06L1 type=del size=1474526 2024-09-14T11:15:11.769 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:11.772+0000 7f76c1e8a8c0 -1 < failed to complete operation key=6TIJR323NMOH tag=3VXDEM2VLNV0 type=del size=4124092: (22) Invalid argument 2024-09-14T11:15:11.772 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:11.772+0000 7f76c1e8a8c0 1 > prepared operation key=SUNCRV0C1XYL tag=DXTMQREP1E64 type=del size=3021695 2024-09-14T11:15:11.775 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:11.776+0000 7f76c1e8a8c0 1 < completed part key=_multipart_SHKU2PRNREKK.2~M7NBQ2269THD.0 size=1048576 2024-09-14T11:15:11.778 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:11.780+0000 7f76c1e8a8c0 1 < completed part key=_multipart_SHKU2PRNREKK.2~M7NBQ2269THD.1 size=1048576 2024-09-14T11:15:11.780 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:11.784+0000 7f76c1e8a8c0 1 < completed part key=_multipart_SHKU2PRNREKK.2~M7NBQ2269THD.2 size=109542 2024-09-14T11:15:11.785 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:11.788+0000 7f76c1e8a8c0 1 < completed multipart upload key=SHKU2PRNREKK upload=M7NBQ2269THD tag=QE6M8Z0A7V7U type=write size=3255270 2024-09-14T11:15:11.793 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:11.796+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_TUFOZKTV9XIH.2~WK7XIFGPXH7M.0 size=1048576 2024-09-14T11:15:11.796 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:11.796+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_TUFOZKTV9XIH.2~WK7XIFGPXH7M.1 size=1017609 2024-09-14T11:15:11.796 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:11.796+0000 7f76c1e8a8c0 1 > prepared multipart upload key=TUFOZKTV9XIH upload=WK7XIFGPXH7M tag=YP8106P1W3C3 type=write size=3114761 2024-09-14T11:15:11.799 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:11.800+0000 7f76c1e8a8c0 1 < completed delete operation key=1W5733SDHGDN tag=M5W2CL2NJMJF type=del 2024-09-14T11:15:11.802 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:11.804+0000 7f76c1e8a8c0 1 > prepared operation key=KS37ZO6MKAH9 tag=TMMWSTRSV3YU type=del size=152454 2024-09-14T11:15:11.806 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:11.808+0000 7f76c1e8a8c0 1 < completed part key=_multipart_MEVTZ7OAD4CA.2~03PIRKCS6LCO.0 size=1048576 2024-09-14T11:15:11.809 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:11.812+0000 7f76c1e8a8c0 1 < completed part key=_multipart_MEVTZ7OAD4CA.2~03PIRKCS6LCO.1 size=164876 2024-09-14T11:15:11.814 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:11.816+0000 7f76c1e8a8c0 1 < completed multipart upload key=MEVTZ7OAD4CA upload=03PIRKCS6LCO tag=09N2OQH3LLYG type=write size=2262028 2024-09-14T11:15:11.819 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:11.820+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_Q5IY4J5FOD80.2~O8SJU18LT3L7.0 size=1048576 2024-09-14T11:15:11.822 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:11.824+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_Q5IY4J5FOD80.2~O8SJU18LT3L7.1 size=1026059 2024-09-14T11:15:11.822 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:11.824+0000 7f76c1e8a8c0 1 > prepared multipart upload key=Q5IY4J5FOD80 upload=O8SJU18LT3L7 tag=HF0RID5PQAUQ type=write size=3123211 2024-09-14T11:15:11.825 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:11.828+0000 7f76c1e8a8c0 1 < completed delete operation key=8FFV9G6EQR8F tag=60LMU6TRYLH2 type=del 2024-09-14T11:15:11.831 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:11.832+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_GAVZRU8ZLW7S.2~R9TLYLU1Y0O4.0 size=714388 2024-09-14T11:15:11.831 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:11.832+0000 7f76c1e8a8c0 1 > prepared multipart upload key=GAVZRU8ZLW7S upload=R9TLYLU1Y0O4 tag=K8YL1PKAKWEA type=write size=1762964 2024-09-14T11:15:11.835 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:11.836+0000 7f76c1e8a8c0 1 < completed part key=_multipart_SHKU2PRNREKK.2~N2PNZV3RG0KH.0 size=1048576 2024-09-14T11:15:11.838 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:11.840+0000 7f76c1e8a8c0 1 < completed part key=_multipart_SHKU2PRNREKK.2~N2PNZV3RG0KH.1 size=1048576 2024-09-14T11:15:11.841 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:11.844+0000 7f76c1e8a8c0 1 < completed part key=_multipart_SHKU2PRNREKK.2~N2PNZV3RG0KH.2 size=650318 2024-09-14T11:15:11.847 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:11.848+0000 7f76c1e8a8c0 1 < completed multipart upload key=SHKU2PRNREKK upload=N2PNZV3RG0KH tag=STRF7WP3KNBM type=write size=3796046 2024-09-14T11:15:11.851 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:11.852+0000 7f76c1e8a8c0 1 > prepared operation key=6TIJR323NMOH tag=WHH9F3N5A198 type=del size=2851061 2024-09-14T11:15:11.857 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:11.860+0000 7f76c1e8a8c0 1 < suggested update operation key=OOUEM16XL80W tag=7U23PXCMIGEU type=write size=808758 2024-09-14T11:15:11.863 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:11.864+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_SUNCRV0C1XYL.2~4BDAW3G7IF5K.0 size=1048576 2024-09-14T11:15:11.865 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:11.868+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_SUNCRV0C1XYL.2~4BDAW3G7IF5K.1 size=1048576 2024-09-14T11:15:11.868 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:11.868+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_SUNCRV0C1XYL.2~4BDAW3G7IF5K.2 size=194440 2024-09-14T11:15:11.868 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:11.868+0000 7f76c1e8a8c0 1 > prepared multipart upload key=SUNCRV0C1XYL upload=4BDAW3G7IF5K tag=VGIEYDS9OGZP type=write size=3340168 2024-09-14T11:15:11.871 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:11.872+0000 7f76c1e8a8c0 1 < completed part key=_multipart_HJ701768A6I7.2~WG80G3Z7TFOW.0 size=1048576 2024-09-14T11:15:11.874 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:11.876+0000 7f76c1e8a8c0 1 < completed part key=_multipart_HJ701768A6I7.2~WG80G3Z7TFOW.1 size=1048576 2024-09-14T11:15:11.876 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:11.876+0000 7f76c1e8a8c0 1 < completed part key=_multipart_HJ701768A6I7.2~WG80G3Z7TFOW.2 size=460448 2024-09-14T11:15:11.881 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:11.884+0000 7f76c1e8a8c0 1 < completed multipart upload key=HJ701768A6I7 upload=WG80G3Z7TFOW tag=Z2FNBGMS11YJ type=write size=3606176 2024-09-14T11:15:11.884 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:11.888+0000 7f76c1e8a8c0 1 > prepared operation key=TUFOZKTV9XIH tag=M3LQ9UT6A3GI type=write size=540647 2024-09-14T11:15:11.891 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:11.892+0000 7f76c1e8a8c0 1 < suggested update operation key=6TIJR323NMOH tag=XRWK6G2XVK16 type=del size=968328 2024-09-14T11:15:11.893 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:11.896+0000 7f76c1e8a8c0 1 > prepared operation key=OOUEM16XL80W tag=FNE5RLQWBHVI type=del size=1009484 2024-09-14T11:15:11.899 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:11.900+0000 7f76c1e8a8c0 1 < suggested remove operation key=85G6NT78HAWQ tag=8HEEK34U7TR8 type=del 2024-09-14T11:15:11.902 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:11.904+0000 7f76c1e8a8c0 1 > prepared operation key=SHKU2PRNREKK tag=6WP5DIT1K1DD type=del size=52706 2024-09-14T11:15:11.905 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:11.908+0000 7f76c1e8a8c0 1 < completed delete operation key=SUNCRV0C1XYL tag=YIUVGUZZOE63 type=del 2024-09-14T11:15:11.908 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:11.908+0000 7f76c1e8a8c0 1 > prepared operation key=VI61O3K069BP tag=S07E06QYWP8D type=del size=3322814 2024-09-14T11:15:11.911 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:11.912+0000 7f76c1e8a8c0 1 < completed part key=_multipart_OOUEM16XL80W.2~5HIA65HL55MZ.0 size=296981 2024-09-14T11:15:11.915 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:11.916+0000 7f76c1e8a8c0 1 < completed multipart upload key=OOUEM16XL80W upload=5HIA65HL55MZ tag=A7QHIPF28B4K type=write size=1345557 2024-09-14T11:15:11.921 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:11.924+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_TZO40K6J9877.2~QP5R7MOACL2S.0 size=1048576 2024-09-14T11:15:11.924 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:11.924+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_TZO40K6J9877.2~QP5R7MOACL2S.1 size=51728 2024-09-14T11:15:11.924 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:11.924+0000 7f76c1e8a8c0 1 > prepared multipart upload key=TZO40K6J9877 upload=QP5R7MOACL2S tag=FQ5OVCYTXZG9 type=write size=2148880 2024-09-14T11:15:11.927 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:11.928+0000 7f76c1e8a8c0 1 < completed part key=_multipart_6TIJR323NMOH.2~RG54USG1QCJ6.0 size=1048576 2024-09-14T11:15:11.929 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:11.932+0000 7f76c1e8a8c0 1 < completed part key=_multipart_6TIJR323NMOH.2~RG54USG1QCJ6.1 size=1048576 2024-09-14T11:15:11.932 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:11.932+0000 7f76c1e8a8c0 1 < completed part key=_multipart_6TIJR323NMOH.2~RG54USG1QCJ6.2 size=1011679 2024-09-14T11:15:11.937 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:11.940+0000 7f76c1e8a8c0 1 < completed multipart upload key=6TIJR323NMOH upload=RG54USG1QCJ6 tag=B8V0BFCSCWPG type=write size=4157407 2024-09-14T11:15:11.940 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:11.940+0000 7f76c1e8a8c0 1 > prepared operation key=6TIJR323NMOH tag=NQ9Y14BGWSFF type=del size=77615 2024-09-14T11:15:11.943 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:11.944+0000 7f76c1e8a8c0 1 < completed part key=_multipart_H9CQV6L29SL5.2~0B0NEODNQY01.0 size=832883 2024-09-14T11:15:11.949 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:11.952+0000 7f76c1e8a8c0 1 < completed multipart upload key=H9CQV6L29SL5 upload=0B0NEODNQY01 tag=HRKS38Q0LLMC type=write size=1881459 2024-09-14T11:15:11.952 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:11.952+0000 7f76c1e8a8c0 1 > prepared operation key=F3KFS0P1WM7W tag=7YOY3Z7F6KCG type=del size=419842 2024-09-14T11:15:11.955 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:11.956+0000 7f76c1e8a8c0 1 < canceled operation key=15FU4CEGC22Q tag=VOMS0TDQZIVA type=write size=11505 2024-09-14T11:15:11.958 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:11.960+0000 7f76c1e8a8c0 1 > prepared operation key=K2EEZLRK7MVO tag=72LYSW1L1PP8 type=del size=1225089 2024-09-14T11:15:11.962 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:11.964+0000 7f76c1e8a8c0 1 < completed delete operation key=OUMUTEBQ1TD0 tag=B6AGJN1N06L1 type=del 2024-09-14T11:15:11.965 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:11.968+0000 7f76c1e8a8c0 1 > prepared operation key=SHKU2PRNREKK tag=72ROCJJVKKSX type=del size=3160782 2024-09-14T11:15:11.968 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:11.968+0000 7f76c1e8a8c0 1 < completed delete operation key=SUNCRV0C1XYL tag=DXTMQREP1E64 type=del 2024-09-14T11:15:11.974 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:11.976+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_K2EEZLRK7MVO.2~R0KAJUITXU2I.0 size=373749 2024-09-14T11:15:11.974 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:11.976+0000 7f76c1e8a8c0 1 > prepared multipart upload key=K2EEZLRK7MVO upload=R0KAJUITXU2I tag=E391TU6LLRN6 type=write size=1422325 2024-09-14T11:15:11.977 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:11.980+0000 7f76c1e8a8c0 1 < completed part key=_multipart_TUFOZKTV9XIH.2~WK7XIFGPXH7M.0 size=1048576 2024-09-14T11:15:11.980 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:11.980+0000 7f76c1e8a8c0 1 < completed part key=_multipart_TUFOZKTV9XIH.2~WK7XIFGPXH7M.1 size=1017609 2024-09-14T11:15:11.985 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:11.988+0000 7f76c1e8a8c0 1 < completed multipart upload key=TUFOZKTV9XIH upload=WK7XIFGPXH7M tag=YP8106P1W3C3 type=write size=3114761 2024-09-14T11:15:11.991 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:11.992+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_XC8VWSHZOPFP.2~CME3RD7SA194.0 size=1048576 2024-09-14T11:15:11.994 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:11.996+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_XC8VWSHZOPFP.2~CME3RD7SA194.1 size=631967 2024-09-14T11:15:11.995 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:11.996+0000 7f76c1e8a8c0 1 > prepared multipart upload key=XC8VWSHZOPFP upload=CME3RD7SA194 tag=MRHJVHQEZ2ZS type=write size=2729119 2024-09-14T11:15:11.998 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:12.000+0000 7f76c1e8a8c0 1 < completed delete operation key=KS37ZO6MKAH9 tag=TMMWSTRSV3YU type=del 2024-09-14T11:15:12.002 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:12.004+0000 7f76c1e8a8c0 1 > prepared operation key=85G6NT78HAWQ tag=Q0XXMJZRWZNI type=del size=3090686 2024-09-14T11:15:12.005 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:12.008+0000 7f76c1e8a8c0 1 < completed part key=_multipart_Q5IY4J5FOD80.2~O8SJU18LT3L7.0 size=1048576 2024-09-14T11:15:12.008 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:12.008+0000 7f76c1e8a8c0 1 < completed part key=_multipart_Q5IY4J5FOD80.2~O8SJU18LT3L7.1 size=1026059 2024-09-14T11:15:12.013 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:12.016+0000 7f76c1e8a8c0 1 < completed multipart upload key=Q5IY4J5FOD80 upload=O8SJU18LT3L7 tag=HF0RID5PQAUQ type=write size=3123211 2024-09-14T11:15:12.019 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:12.020+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_8PZOVFEYYSOG.2~PV79KLCIAJWI.0 size=1048576 2024-09-14T11:15:12.022 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:12.024+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_8PZOVFEYYSOG.2~PV79KLCIAJWI.1 size=612741 2024-09-14T11:15:12.022 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:12.024+0000 7f76c1e8a8c0 1 > prepared multipart upload key=8PZOVFEYYSOG upload=PV79KLCIAJWI tag=F2QOMG0L9PSF type=write size=2709893 2024-09-14T11:15:12.027 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:12.028+0000 7f76c1e8a8c0 1 < completed part key=_multipart_GAVZRU8ZLW7S.2~R9TLYLU1Y0O4.0 size=714388 2024-09-14T11:15:12.033 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:12.036+0000 7f76c1e8a8c0 1 < completed multipart upload key=GAVZRU8ZLW7S upload=R9TLYLU1Y0O4 tag=K8YL1PKAKWEA type=write size=1762964 2024-09-14T11:15:12.037 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:12.040+0000 7f76c1e8a8c0 1 > prepared operation key=HJ701768A6I7 tag=WS8OU8PH92QZ type=write size=995067 2024-09-14T11:15:12.041 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:12.044+0000 7f76c1e8a8c0 -1 < failed to complete operation key=6TIJR323NMOH tag=WHH9F3N5A198 type=del size=2851061: (22) Invalid argument 2024-09-14T11:15:12.044 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:12.044+0000 7f76c1e8a8c0 1 > prepared operation key=6TIJR323NMOH tag=DRQ1DE803Q4T type=del size=544015 2024-09-14T11:15:12.047 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:12.048+0000 7f76c1e8a8c0 1 < completed part key=_multipart_SUNCRV0C1XYL.2~4BDAW3G7IF5K.0 size=1048576 2024-09-14T11:15:12.050 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:12.052+0000 7f76c1e8a8c0 1 < completed part key=_multipart_SUNCRV0C1XYL.2~4BDAW3G7IF5K.1 size=1048576 2024-09-14T11:15:12.050 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:12.052+0000 7f76c1e8a8c0 1 < canceled part key=_multipart_SUNCRV0C1XYL.2~4BDAW3G7IF5K.2 size=194440 2024-09-14T11:15:12.055 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:12.056+0000 7f76c1e8a8c0 1 < canceled multipart upload key=SUNCRV0C1XYL upload=4BDAW3G7IF5K tag=VGIEYDS9OGZP type=write size=3340168 2024-09-14T11:15:12.061 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:12.064+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_HS7T50JORDQJ.2~9MQY24NQITXE.0 size=1048576 2024-09-14T11:15:12.063 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:12.064+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_HS7T50JORDQJ.2~9MQY24NQITXE.1 size=1048576 2024-09-14T11:15:12.066 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:12.068+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_HS7T50JORDQJ.2~9MQY24NQITXE.2 size=758415 2024-09-14T11:15:12.066 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:12.068+0000 7f76c1e8a8c0 1 > prepared multipart upload key=HS7T50JORDQJ upload=9MQY24NQITXE tag=CUDBXQ6795HJ type=write size=3904143 2024-09-14T11:15:12.069 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:12.072+0000 7f76c1e8a8c0 1 < completed write operation key=TUFOZKTV9XIH tag=M3LQ9UT6A3GI type=write size=540647 2024-09-14T11:15:12.072 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:12.076+0000 7f76c1e8a8c0 1 > prepared operation key=OUMUTEBQ1TD0 tag=TJWT0K6DDD95 type=write size=782936 2024-09-14T11:15:12.078 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:12.080+0000 7f76c1e8a8c0 1 < suggested update operation key=OOUEM16XL80W tag=FNE5RLQWBHVI type=del size=1009484 2024-09-14T11:15:12.084 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:12.084+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_BOCIF4TL7X7J.2~S2MQLGVNQ07S.0 size=1048576 2024-09-14T11:15:12.089 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:12.092+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_BOCIF4TL7X7J.2~S2MQLGVNQ07S.1 size=1048576 2024-09-14T11:15:12.091 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:12.092+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_BOCIF4TL7X7J.2~S2MQLGVNQ07S.2 size=229775 2024-09-14T11:15:12.091 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:12.092+0000 7f76c1e8a8c0 1 > prepared multipart upload key=BOCIF4TL7X7J upload=S2MQLGVNQ07S tag=R9GS14DOZGPV type=write size=3375503 2024-09-14T11:15:12.094 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:12.096+0000 7f76c1e8a8c0 1 < completed delete operation key=SHKU2PRNREKK tag=6WP5DIT1K1DD type=del 2024-09-14T11:15:12.098 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:12.100+0000 7f76c1e8a8c0 1 > prepared operation key=GAVZRU8ZLW7S tag=KZHQGGWCB1UX type=del size=386396 2024-09-14T11:15:12.101 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:12.104+0000 7f76c1e8a8c0 1 < completed delete operation key=VI61O3K069BP tag=S07E06QYWP8D type=del 2024-09-14T11:15:12.104 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:12.104+0000 7f76c1e8a8c0 1 > prepared operation key=R5I9H7WAK7Z7 tag=S9D90IFYF6PW type=del size=2594226 2024-09-14T11:15:12.104 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:12.108+0000 7f76c1e8a8c0 1 < canceled part key=_multipart_TZO40K6J9877.2~QP5R7MOACL2S.0 size=1048576 2024-09-14T11:15:12.105 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:12.108+0000 7f76c1e8a8c0 1 < canceled part key=_multipart_TZO40K6J9877.2~QP5R7MOACL2S.1 size=51728 2024-09-14T11:15:12.109 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:12.112+0000 7f76c1e8a8c0 1 < canceled multipart upload key=TZO40K6J9877 upload=QP5R7MOACL2S tag=FQ5OVCYTXZG9 type=write size=2148880 2024-09-14T11:15:12.114 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:12.116+0000 7f76c1e8a8c0 1 > prepared operation key=W0MDRE9YO3UP tag=PTHL1JJZWNLV type=del size=702857 2024-09-14T11:15:12.117 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:12.120+0000 7f76c1e8a8c0 1 < completed delete operation key=6TIJR323NMOH tag=NQ9Y14BGWSFF type=del 2024-09-14T11:15:12.121 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:12.124+0000 7f76c1e8a8c0 1 > prepared operation key=GAVZRU8ZLW7S tag=MG3G95KC51SV type=write size=1032575 2024-09-14T11:15:12.124 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:12.128+0000 7f76c1e8a8c0 1 < completed delete operation key=F3KFS0P1WM7W tag=7YOY3Z7F6KCG type=del 2024-09-14T11:15:12.127 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:12.128+0000 7f76c1e8a8c0 1 > prepared operation key=XC8VWSHZOPFP tag=4TQQSTEKM0TX type=del size=79354 2024-09-14T11:15:12.130 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:12.132+0000 7f76c1e8a8c0 1 < completed delete operation key=K2EEZLRK7MVO tag=72LYSW1L1PP8 type=del 2024-09-14T11:15:12.135 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:12.136+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_VI61O3K069BP.2~8BUWIBNKM8VO.0 size=1048576 2024-09-14T11:15:12.138 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:12.140+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_VI61O3K069BP.2~8BUWIBNKM8VO.1 size=1048576 2024-09-14T11:15:12.140 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:12.140+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_VI61O3K069BP.2~8BUWIBNKM8VO.2 size=925703 2024-09-14T11:15:12.140 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:12.140+0000 7f76c1e8a8c0 1 > prepared multipart upload key=VI61O3K069BP upload=8BUWIBNKM8VO tag=R179FJL9COM9 type=write size=4071431 2024-09-14T11:15:12.142 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:12.144+0000 7f76c1e8a8c0 1 < completed delete operation key=SHKU2PRNREKK tag=72ROCJJVKKSX type=del 2024-09-14T11:15:12.145 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:12.148+0000 7f76c1e8a8c0 1 > prepared operation key=Q5IY4J5FOD80 tag=FOZ374CFW5XS type=del size=2134981 2024-09-14T11:15:12.149 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:12.152+0000 7f76c1e8a8c0 1 < completed part key=_multipart_K2EEZLRK7MVO.2~R0KAJUITXU2I.0 size=373749 2024-09-14T11:15:12.154 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:12.156+0000 7f76c1e8a8c0 1 < completed multipart upload key=K2EEZLRK7MVO upload=R0KAJUITXU2I tag=E391TU6LLRN6 type=write size=1422325 2024-09-14T11:15:12.160 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:12.160+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_K9W031V6BFJP.2~V3NS5IAXV6T7.0 size=1048576 2024-09-14T11:15:12.163 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:12.164+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_K9W031V6BFJP.2~V3NS5IAXV6T7.1 size=1048576 2024-09-14T11:15:12.166 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:12.168+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_K9W031V6BFJP.2~V3NS5IAXV6T7.2 size=768303 2024-09-14T11:15:12.166 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:12.168+0000 7f76c1e8a8c0 1 > prepared multipart upload key=K9W031V6BFJP upload=V3NS5IAXV6T7 tag=G3C7VT5FXJJE type=write size=3914031 2024-09-14T11:15:12.169 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:12.172+0000 7f76c1e8a8c0 1 < completed part key=_multipart_XC8VWSHZOPFP.2~CME3RD7SA194.0 size=1048576 2024-09-14T11:15:12.172 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:12.172+0000 7f76c1e8a8c0 1 < completed part key=_multipart_XC8VWSHZOPFP.2~CME3RD7SA194.1 size=631967 2024-09-14T11:15:12.178 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:12.180+0000 7f76c1e8a8c0 1 < completed multipart upload key=XC8VWSHZOPFP upload=CME3RD7SA194 tag=MRHJVHQEZ2ZS type=write size=2729119 2024-09-14T11:15:12.181 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:12.184+0000 7f76c1e8a8c0 1 > prepared operation key=8PZOVFEYYSOG tag=AJBS0LZO808Q type=del size=3914032 2024-09-14T11:15:12.188 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:12.188+0000 7f76c1e8a8c0 1 < suggested remove operation key=85G6NT78HAWQ tag=Q0XXMJZRWZNI type=del 2024-09-14T11:15:12.191 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:12.192+0000 7f76c1e8a8c0 1 > prepared operation key=OOUEM16XL80W tag=VWH58LZH31OQ type=del size=3995351 2024-09-14T11:15:12.195 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:12.196+0000 7f76c1e8a8c0 1 < completed part key=_multipart_8PZOVFEYYSOG.2~PV79KLCIAJWI.0 size=1048576 2024-09-14T11:15:12.197 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:12.200+0000 7f76c1e8a8c0 1 < completed part key=_multipart_8PZOVFEYYSOG.2~PV79KLCIAJWI.1 size=612741 2024-09-14T11:15:12.202 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:12.204+0000 7f76c1e8a8c0 1 < completed multipart upload key=8PZOVFEYYSOG upload=PV79KLCIAJWI tag=F2QOMG0L9PSF type=write size=2709893 2024-09-14T11:15:12.206 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:12.208+0000 7f76c1e8a8c0 1 > prepared operation key=R5I9H7WAK7Z7 tag=CMT8QS9CTH75 type=del size=3631529 2024-09-14T11:15:12.209 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:12.212+0000 7f76c1e8a8c0 1 < completed write operation key=HJ701768A6I7 tag=WS8OU8PH92QZ type=write size=995067 2024-09-14T11:15:12.215 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:12.216+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_6TIJR323NMOH.2~1RB4WKDEJIHA.0 size=1048576 2024-09-14T11:15:12.217 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:12.220+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_6TIJR323NMOH.2~1RB4WKDEJIHA.1 size=299002 2024-09-14T11:15:12.217 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:12.220+0000 7f76c1e8a8c0 1 > prepared multipart upload key=6TIJR323NMOH upload=1RB4WKDEJIHA tag=WAM9ZOM1WQR5 type=write size=2396154 2024-09-14T11:15:12.220 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:12.224+0000 7f76c1e8a8c0 1 < completed delete operation key=6TIJR323NMOH tag=DRQ1DE803Q4T type=del 2024-09-14T11:15:12.226 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:12.228+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_TUFOZKTV9XIH.2~ZFJZMYE6CB47.0 size=1048576 2024-09-14T11:15:12.229 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:12.232+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_TUFOZKTV9XIH.2~ZFJZMYE6CB47.1 size=816522 2024-09-14T11:15:12.229 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:12.232+0000 7f76c1e8a8c0 1 > prepared multipart upload key=TUFOZKTV9XIH upload=ZFJZMYE6CB47 tag=2NH9D5874YIC type=write size=2913674 2024-09-14T11:15:12.233 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:12.236+0000 7f76c1e8a8c0 1 < completed part key=_multipart_HS7T50JORDQJ.2~9MQY24NQITXE.0 size=1048576 2024-09-14T11:15:12.236 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:12.236+0000 7f76c1e8a8c0 1 < completed part key=_multipart_HS7T50JORDQJ.2~9MQY24NQITXE.1 size=1048576 2024-09-14T11:15:12.238 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:12.240+0000 7f76c1e8a8c0 1 < completed part key=_multipart_HS7T50JORDQJ.2~9MQY24NQITXE.2 size=758415 2024-09-14T11:15:12.244 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:12.244+0000 7f76c1e8a8c0 1 < completed multipart upload key=HS7T50JORDQJ upload=9MQY24NQITXE tag=CUDBXQ6795HJ type=write size=3904143 2024-09-14T11:15:12.247 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:12.248+0000 7f76c1e8a8c0 1 > prepared operation key=H9CQV6L29SL5 tag=0ACDDC4BRAU8 type=del size=1839682 2024-09-14T11:15:12.250 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:12.252+0000 7f76c1e8a8c0 1 < completed write operation key=OUMUTEBQ1TD0 tag=TJWT0K6DDD95 type=write size=782936 2024-09-14T11:15:12.256 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:12.256+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_XC8VWSHZOPFP.2~RUNLBWNCH0A2.0 size=698024 2024-09-14T11:15:12.256 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:12.256+0000 7f76c1e8a8c0 1 > prepared multipart upload key=XC8VWSHZOPFP upload=RUNLBWNCH0A2 tag=KJXU8NXWREUO type=write size=1746600 2024-09-14T11:15:12.258 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:12.260+0000 7f76c1e8a8c0 1 < completed part key=_multipart_BOCIF4TL7X7J.2~S2MQLGVNQ07S.0 size=1048576 2024-09-14T11:15:12.261 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:12.264+0000 7f76c1e8a8c0 1 < completed part key=_multipart_BOCIF4TL7X7J.2~S2MQLGVNQ07S.1 size=1048576 2024-09-14T11:15:12.263 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:12.264+0000 7f76c1e8a8c0 1 < completed part key=_multipart_BOCIF4TL7X7J.2~S2MQLGVNQ07S.2 size=229775 2024-09-14T11:15:12.268 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:12.272+0000 7f76c1e8a8c0 1 < completed multipart upload key=BOCIF4TL7X7J upload=S2MQLGVNQ07S tag=R9GS14DOZGPV type=write size=3375503 2024-09-14T11:15:12.271 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:12.272+0000 7f76c1e8a8c0 1 > prepared operation key=CIRQT9IDJ5OJ tag=5477D4E2ZP1Z type=del size=3645876 2024-09-14T11:15:12.275 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:12.276+0000 7f76c1e8a8c0 1 < completed delete operation key=GAVZRU8ZLW7S tag=KZHQGGWCB1UX type=del 2024-09-14T11:15:12.278 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:12.280+0000 7f76c1e8a8c0 1 > prepared operation key=1K8ESNXU6WDF tag=JIC8N5UTAHUG type=write size=527335 2024-09-14T11:15:12.281 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:12.284+0000 7f76c1e8a8c0 1 < completed delete operation key=R5I9H7WAK7Z7 tag=S9D90IFYF6PW type=del 2024-09-14T11:15:12.284 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:12.284+0000 7f76c1e8a8c0 1 > prepared operation key=15FU4CEGC22Q tag=3DEYAC1NU79K type=write size=749395 2024-09-14T11:15:12.287 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:12.288+0000 7f76c1e8a8c0 1 < canceled operation key=W0MDRE9YO3UP tag=PTHL1JJZWNLV type=del size=702857 2024-09-14T11:15:12.290 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:12.292+0000 7f76c1e8a8c0 1 > prepared operation key=CIRQT9IDJ5OJ tag=85T7XNJVGOAQ type=del size=2567478 2024-09-14T11:15:12.293 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:12.296+0000 7f76c1e8a8c0 1 < canceled operation key=GAVZRU8ZLW7S tag=MG3G95KC51SV type=write size=1032575 2024-09-14T11:15:12.299 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:12.300+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_KS37ZO6MKAH9.2~UKXXWKD7YLO9.0 size=1048576 2024-09-14T11:15:12.302 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:12.304+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_KS37ZO6MKAH9.2~UKXXWKD7YLO9.1 size=1048576 2024-09-14T11:15:12.304 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:12.304+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_KS37ZO6MKAH9.2~UKXXWKD7YLO9.2 size=84354 2024-09-14T11:15:12.304 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:12.304+0000 7f76c1e8a8c0 1 > prepared multipart upload key=KS37ZO6MKAH9 upload=UKXXWKD7YLO9 tag=0IHVH8A6QRVS type=write size=3230082 2024-09-14T11:15:12.308 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:12.308+0000 7f76c1e8a8c0 1 < completed delete operation key=XC8VWSHZOPFP tag=4TQQSTEKM0TX type=del 2024-09-14T11:15:12.313 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:12.316+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_OUMUTEBQ1TD0.2~6HQ71G6GCQQ3.0 size=112884 2024-09-14T11:15:12.313 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:12.316+0000 7f76c1e8a8c0 1 > prepared multipart upload key=OUMUTEBQ1TD0 upload=6HQ71G6GCQQ3 tag=B022IM1O5R5L type=write size=1161460 2024-09-14T11:15:12.316 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:12.320+0000 7f76c1e8a8c0 1 < completed part key=_multipart_VI61O3K069BP.2~8BUWIBNKM8VO.0 size=1048576 2024-09-14T11:15:12.319 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:12.320+0000 7f76c1e8a8c0 1 < completed part key=_multipart_VI61O3K069BP.2~8BUWIBNKM8VO.1 size=1048576 2024-09-14T11:15:12.321 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:12.324+0000 7f76c1e8a8c0 1 < completed part key=_multipart_VI61O3K069BP.2~8BUWIBNKM8VO.2 size=925703 2024-09-14T11:15:12.327 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:12.328+0000 7f76c1e8a8c0 1 < completed multipart upload key=VI61O3K069BP upload=8BUWIBNKM8VO tag=R179FJL9COM9 type=write size=4071431 2024-09-14T11:15:12.330 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:12.332+0000 7f76c1e8a8c0 1 > prepared operation key=Q5IY4J5FOD80 tag=9QHL0AC1VN8U type=del size=2910206 2024-09-14T11:15:12.334 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:12.336+0000 7f76c1e8a8c0 1 < completed delete operation key=Q5IY4J5FOD80 tag=FOZ374CFW5XS type=del 2024-09-14T11:15:12.340 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:12.340+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_CIRQT9IDJ5OJ.2~Z5WELMMGRPMK.0 size=1048576 2024-09-14T11:15:12.342 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:12.344+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_CIRQT9IDJ5OJ.2~Z5WELMMGRPMK.1 size=1048576 2024-09-14T11:15:12.345 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:12.348+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_CIRQT9IDJ5OJ.2~Z5WELMMGRPMK.2 size=818969 2024-09-14T11:15:12.346 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:12.348+0000 7f76c1e8a8c0 1 > prepared multipart upload key=CIRQT9IDJ5OJ upload=Z5WELMMGRPMK tag=ZU6CRUEVESYZ type=write size=3964697 2024-09-14T11:15:12.349 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:12.352+0000 7f76c1e8a8c0 1 < completed part key=_multipart_K9W031V6BFJP.2~V3NS5IAXV6T7.0 size=1048576 2024-09-14T11:15:12.352 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:12.352+0000 7f76c1e8a8c0 1 < completed part key=_multipart_K9W031V6BFJP.2~V3NS5IAXV6T7.1 size=1048576 2024-09-14T11:15:12.354 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:12.356+0000 7f76c1e8a8c0 1 < completed part key=_multipart_K9W031V6BFJP.2~V3NS5IAXV6T7.2 size=768303 2024-09-14T11:15:12.359 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:12.360+0000 7f76c1e8a8c0 1 < completed multipart upload key=K9W031V6BFJP upload=V3NS5IAXV6T7 tag=G3C7VT5FXJJE type=write size=3914031 2024-09-14T11:15:12.366 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:12.368+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_XC8VWSHZOPFP.2~QMAQY84U4IVO.0 size=1048576 2024-09-14T11:15:12.368 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:12.372+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_XC8VWSHZOPFP.2~QMAQY84U4IVO.1 size=818671 2024-09-14T11:15:12.368 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:12.372+0000 7f76c1e8a8c0 1 > prepared multipart upload key=XC8VWSHZOPFP upload=QMAQY84U4IVO tag=THRIF9HQ7AXD type=write size=2915823 2024-09-14T11:15:12.374 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:12.376+0000 7f76c1e8a8c0 1 < suggested update operation key=8PZOVFEYYSOG tag=AJBS0LZO808Q type=del size=3914032 2024-09-14T11:15:12.380 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:12.384+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_HJ701768A6I7.2~MJQRJIB9OW5A.0 size=1048576 2024-09-14T11:15:12.385 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:12.388+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_HJ701768A6I7.2~MJQRJIB9OW5A.1 size=318735 2024-09-14T11:15:12.385 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:12.388+0000 7f76c1e8a8c0 1 > prepared multipart upload key=HJ701768A6I7 upload=MJQRJIB9OW5A tag=XQ7ACHM6VMZ6 type=write size=2415887 2024-09-14T11:15:12.388 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:12.392+0000 7f76c1e8a8c0 1 < completed delete operation key=OOUEM16XL80W tag=VWH58LZH31OQ type=del 2024-09-14T11:15:12.392 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:12.392+0000 7f76c1e8a8c0 1 > prepared operation key=6TIJR323NMOH tag=H8R18C6X4YYY type=del size=1664219 2024-09-14T11:15:12.395 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:12.396+0000 7f76c1e8a8c0 1 < completed delete operation key=R5I9H7WAK7Z7 tag=CMT8QS9CTH75 type=del 2024-09-14T11:15:12.400 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:12.404+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_85G6NT78HAWQ.2~C786EROO64GO.0 size=1048576 2024-09-14T11:15:12.402 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:12.404+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_85G6NT78HAWQ.2~C786EROO64GO.1 size=1048576 2024-09-14T11:15:12.405 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:12.408+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_85G6NT78HAWQ.2~C786EROO64GO.2 size=910936 2024-09-14T11:15:12.405 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:12.408+0000 7f76c1e8a8c0 1 > prepared multipart upload key=85G6NT78HAWQ upload=C786EROO64GO tag=MFBU0YEKEBBZ type=write size=4056664 2024-09-14T11:15:12.409 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:12.412+0000 7f76c1e8a8c0 1 < completed part key=_multipart_6TIJR323NMOH.2~1RB4WKDEJIHA.0 size=1048576 2024-09-14T11:15:12.411 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:12.412+0000 7f76c1e8a8c0 1 < completed part key=_multipart_6TIJR323NMOH.2~1RB4WKDEJIHA.1 size=299002 2024-09-14T11:15:12.417 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:12.420+0000 7f76c1e8a8c0 1 < completed multipart upload key=6TIJR323NMOH upload=1RB4WKDEJIHA tag=WAM9ZOM1WQR5 type=write size=2396154 2024-09-14T11:15:12.420 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:12.420+0000 7f76c1e8a8c0 1 > prepared operation key=BOCIF4TL7X7J tag=RWD5GZKUDJDC type=del size=4023551 2024-09-14T11:15:12.423 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:12.424+0000 7f76c1e8a8c0 1 < completed part key=_multipart_TUFOZKTV9XIH.2~ZFJZMYE6CB47.0 size=1048576 2024-09-14T11:15:12.426 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:12.428+0000 7f76c1e8a8c0 1 < completed part key=_multipart_TUFOZKTV9XIH.2~ZFJZMYE6CB47.1 size=816522 2024-09-14T11:15:12.431 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:12.432+0000 7f76c1e8a8c0 1 < completed multipart upload key=TUFOZKTV9XIH upload=ZFJZMYE6CB47 tag=2NH9D5874YIC type=write size=2913674 2024-09-14T11:15:12.435 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:12.436+0000 7f76c1e8a8c0 1 > prepared operation key=K2EEZLRK7MVO tag=A0SXFFANOII7 type=del size=1899314 2024-09-14T11:15:12.438 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:12.440+0000 7f76c1e8a8c0 1 < completed delete operation key=H9CQV6L29SL5 tag=0ACDDC4BRAU8 type=del 2024-09-14T11:15:12.444 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:12.444+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_1W5733SDHGDN.2~FBE84Q9F1EN7.0 size=1048576 2024-09-14T11:15:12.446 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:12.448+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_1W5733SDHGDN.2~FBE84Q9F1EN7.1 size=946202 2024-09-14T11:15:12.447 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:12.448+0000 7f76c1e8a8c0 1 > prepared multipart upload key=1W5733SDHGDN upload=FBE84Q9F1EN7 tag=RKF4WDNXJG1K type=write size=3043354 2024-09-14T11:15:12.450 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:12.452+0000 7f76c1e8a8c0 1 < completed part key=_multipart_XC8VWSHZOPFP.2~RUNLBWNCH0A2.0 size=698024 2024-09-14T11:15:12.455 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:12.456+0000 7f76c1e8a8c0 1 < completed multipart upload key=XC8VWSHZOPFP upload=RUNLBWNCH0A2 tag=KJXU8NXWREUO type=write size=1746600 2024-09-14T11:15:12.461 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:12.464+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_MEVTZ7OAD4CA.2~BECVR4LQD0H8.0 size=1048576 2024-09-14T11:15:12.464 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:12.464+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_MEVTZ7OAD4CA.2~BECVR4LQD0H8.1 size=736649 2024-09-14T11:15:12.464 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:12.464+0000 7f76c1e8a8c0 1 > prepared multipart upload key=MEVTZ7OAD4CA upload=BECVR4LQD0H8 tag=JO7XI1L62NTI type=write size=2833801 2024-09-14T11:15:12.470 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:12.472+0000 7f76c1e8a8c0 1 < suggested update operation key=CIRQT9IDJ5OJ tag=5477D4E2ZP1Z type=del size=3645876 2024-09-14T11:15:12.476 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:12.476+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_GAVZRU8ZLW7S.2~0TND8ISYXK8D.0 size=1048576 2024-09-14T11:15:12.478 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:12.480+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_GAVZRU8ZLW7S.2~0TND8ISYXK8D.1 size=1048576 2024-09-14T11:15:12.481 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:12.484+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_GAVZRU8ZLW7S.2~0TND8ISYXK8D.2 size=296042 2024-09-14T11:15:12.481 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:12.484+0000 7f76c1e8a8c0 1 > prepared multipart upload key=GAVZRU8ZLW7S upload=0TND8ISYXK8D tag=I2J8L0B13N1O type=write size=3441770 2024-09-14T11:15:12.484 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:12.484+0000 7f76c1e8a8c0 1 < completed write operation key=1K8ESNXU6WDF tag=JIC8N5UTAHUG type=write size=527335 2024-09-14T11:15:12.487 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:12.488+0000 7f76c1e8a8c0 1 > prepared operation key=BOCIF4TL7X7J tag=3TK2RFXNZ7OI type=del size=1724823 2024-09-14T11:15:12.490 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:12.492+0000 7f76c1e8a8c0 1 < canceled operation key=15FU4CEGC22Q tag=3DEYAC1NU79K type=write size=749395 2024-09-14T11:15:12.494 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:12.496+0000 7f76c1e8a8c0 1 > prepared operation key=LZ0YNFOVFYCL tag=0W06LR63MIM2 type=del size=3020866 2024-09-14T11:15:12.500 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:12.500+0000 7f76c1e8a8c0 1 < suggested remove operation key=CIRQT9IDJ5OJ tag=85T7XNJVGOAQ type=del 2024-09-14T11:15:12.505 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:12.508+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_SUNCRV0C1XYL.2~FAZ997OY9TEN.0 size=1000151 2024-09-14T11:15:12.505 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:12.508+0000 7f76c1e8a8c0 1 > prepared multipart upload key=SUNCRV0C1XYL upload=FAZ997OY9TEN tag=UAY7TF5VUR66 type=write size=2048727 2024-09-14T11:15:12.509 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:12.512+0000 7f76c1e8a8c0 1 < completed part key=_multipart_KS37ZO6MKAH9.2~UKXXWKD7YLO9.0 size=1048576 2024-09-14T11:15:12.511 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:12.512+0000 7f76c1e8a8c0 1 < completed part key=_multipart_KS37ZO6MKAH9.2~UKXXWKD7YLO9.1 size=1048576 2024-09-14T11:15:12.514 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:12.516+0000 7f76c1e8a8c0 1 < completed part key=_multipart_KS37ZO6MKAH9.2~UKXXWKD7YLO9.2 size=84354 2024-09-14T11:15:12.519 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:12.520+0000 7f76c1e8a8c0 1 < completed multipart upload key=KS37ZO6MKAH9 upload=UKXXWKD7YLO9 tag=0IHVH8A6QRVS type=write size=3230082 2024-09-14T11:15:12.524 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:12.524+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_Q5IY4J5FOD80.2~X06TT6HZUK2L.0 size=1048576 2024-09-14T11:15:12.526 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:12.528+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_Q5IY4J5FOD80.2~X06TT6HZUK2L.1 size=1048576 2024-09-14T11:15:12.529 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:12.532+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_Q5IY4J5FOD80.2~X06TT6HZUK2L.2 size=331546 2024-09-14T11:15:12.529 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:12.532+0000 7f76c1e8a8c0 1 > prepared multipart upload key=Q5IY4J5FOD80 upload=X06TT6HZUK2L tag=ZPZA9DBDV22B type=write size=3477274 2024-09-14T11:15:12.532 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:12.532+0000 7f76c1e8a8c0 1 < completed part key=_multipart_OUMUTEBQ1TD0.2~6HQ71G6GCQQ3.0 size=112884 2024-09-14T11:15:12.537 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:12.540+0000 7f76c1e8a8c0 1 < completed multipart upload key=OUMUTEBQ1TD0 upload=6HQ71G6GCQQ3 tag=B022IM1O5R5L type=write size=1161460 2024-09-14T11:15:12.542 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:12.544+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_OUMUTEBQ1TD0.2~WYFAT68E4B0U.0 size=811673 2024-09-14T11:15:12.542 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:12.544+0000 7f76c1e8a8c0 1 > prepared multipart upload key=OUMUTEBQ1TD0 upload=WYFAT68E4B0U tag=5YT4BNHSOOZF type=write size=1860249 2024-09-14T11:15:12.545 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:12.548+0000 7f76c1e8a8c0 1 < completed delete operation key=Q5IY4J5FOD80 tag=9QHL0AC1VN8U type=del 2024-09-14T11:15:12.551 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:12.552+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_15FU4CEGC22Q.2~WUT3PO8PN569.0 size=1048576 2024-09-14T11:15:12.555 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:12.556+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_15FU4CEGC22Q.2~WUT3PO8PN569.1 size=269248 2024-09-14T11:15:12.555 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:12.556+0000 7f76c1e8a8c0 1 > prepared multipart upload key=15FU4CEGC22Q upload=WUT3PO8PN569 tag=R5437QYQUEGR type=write size=2366400 2024-09-14T11:15:12.559 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:12.560+0000 7f76c1e8a8c0 1 < completed part key=_multipart_CIRQT9IDJ5OJ.2~Z5WELMMGRPMK.0 size=1048576 2024-09-14T11:15:12.561 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:12.564+0000 7f76c1e8a8c0 1 < completed part key=_multipart_CIRQT9IDJ5OJ.2~Z5WELMMGRPMK.1 size=1048576 2024-09-14T11:15:12.564 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:12.564+0000 7f76c1e8a8c0 1 < completed part key=_multipart_CIRQT9IDJ5OJ.2~Z5WELMMGRPMK.2 size=818969 2024-09-14T11:15:12.570 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:12.572+0000 7f76c1e8a8c0 1 < completed multipart upload key=CIRQT9IDJ5OJ upload=Z5WELMMGRPMK tag=ZU6CRUEVESYZ type=write size=3964697 2024-09-14T11:15:12.574 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:12.576+0000 7f76c1e8a8c0 1 > prepared operation key=HJ701768A6I7 tag=4RYUVQIYC885 type=del size=3741121 2024-09-14T11:15:12.577 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:12.580+0000 7f76c1e8a8c0 1 < completed part key=_multipart_XC8VWSHZOPFP.2~QMAQY84U4IVO.0 size=1048576 2024-09-14T11:15:12.580 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:12.580+0000 7f76c1e8a8c0 1 < completed part key=_multipart_XC8VWSHZOPFP.2~QMAQY84U4IVO.1 size=818671 2024-09-14T11:15:12.585 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:12.588+0000 7f76c1e8a8c0 1 < completed multipart upload key=XC8VWSHZOPFP upload=QMAQY84U4IVO tag=THRIF9HQ7AXD type=write size=2915823 2024-09-14T11:15:12.591 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:12.592+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_MEVTZ7OAD4CA.2~D9KR9R3YON7R.0 size=780060 2024-09-14T11:15:12.591 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:12.592+0000 7f76c1e8a8c0 1 > prepared multipart upload key=MEVTZ7OAD4CA upload=D9KR9R3YON7R tag=HO9GN4GP38P8 type=write size=1828636 2024-09-14T11:15:12.594 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:12.596+0000 7f76c1e8a8c0 1 < completed part key=_multipart_HJ701768A6I7.2~MJQRJIB9OW5A.0 size=1048576 2024-09-14T11:15:12.594 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:12.596+0000 7f76c1e8a8c0 1 < canceled part key=_multipart_HJ701768A6I7.2~MJQRJIB9OW5A.1 size=318735 2024-09-14T11:15:12.599 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:12.600+0000 7f76c1e8a8c0 1 < canceled multipart upload key=HJ701768A6I7 upload=MJQRJIB9OW5A tag=XQ7ACHM6VMZ6 type=write size=2415887 2024-09-14T11:15:12.602 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:12.604+0000 7f76c1e8a8c0 1 > prepared operation key=TUFOZKTV9XIH tag=8TLBIEIK8F8E type=del size=3097608 2024-09-14T11:15:12.609 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:12.612+0000 7f76c1e8a8c0 1 < suggested update operation key=6TIJR323NMOH tag=H8R18C6X4YYY type=del size=1664219 2024-09-14T11:15:12.612 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:12.612+0000 7f76c1e8a8c0 1 > prepared operation key=K2EEZLRK7MVO tag=6PJ1EHWORT11 type=del size=56824 2024-09-14T11:15:12.615 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:12.616+0000 7f76c1e8a8c0 1 < completed part key=_multipart_85G6NT78HAWQ.2~C786EROO64GO.0 size=1048576 2024-09-14T11:15:12.617 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:12.620+0000 7f76c1e8a8c0 1 < completed part key=_multipart_85G6NT78HAWQ.2~C786EROO64GO.1 size=1048576 2024-09-14T11:15:12.619 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:12.620+0000 7f76c1e8a8c0 1 < completed part key=_multipart_85G6NT78HAWQ.2~C786EROO64GO.2 size=910936 2024-09-14T11:15:12.624 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:12.624+0000 7f76c1e8a8c0 1 < completed multipart upload key=85G6NT78HAWQ upload=C786EROO64GO tag=MFBU0YEKEBBZ type=write size=4056664 2024-09-14T11:15:12.629 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:12.632+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_K9W031V6BFJP.2~YZFHR0FKGF7W.0 size=1048576 2024-09-14T11:15:12.631 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:12.632+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_K9W031V6BFJP.2~YZFHR0FKGF7W.1 size=349741 2024-09-14T11:15:12.631 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:12.632+0000 7f76c1e8a8c0 1 > prepared multipart upload key=K9W031V6BFJP upload=YZFHR0FKGF7W tag=D0INI651X2NU type=write size=2446893 2024-09-14T11:15:12.634 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:12.636+0000 7f76c1e8a8c0 1 < completed delete operation key=BOCIF4TL7X7J tag=RWD5GZKUDJDC type=del 2024-09-14T11:15:12.637 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:12.640+0000 7f76c1e8a8c0 1 > prepared operation key=HJ701768A6I7 tag=T8FVI3WUJ25X type=del size=4027477 2024-09-14T11:15:12.641 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:12.644+0000 7f76c1e8a8c0 1 < completed delete operation key=K2EEZLRK7MVO tag=A0SXFFANOII7 type=del 2024-09-14T11:15:12.644 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:12.644+0000 7f76c1e8a8c0 1 > prepared operation key=W0MDRE9YO3UP tag=A965P0ARZ2V5 type=del size=1805291 2024-09-14T11:15:12.647 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:12.648+0000 7f76c1e8a8c0 1 < completed part key=_multipart_1W5733SDHGDN.2~FBE84Q9F1EN7.0 size=1048576 2024-09-14T11:15:12.649 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:12.652+0000 7f76c1e8a8c0 1 < completed part key=_multipart_1W5733SDHGDN.2~FBE84Q9F1EN7.1 size=946202 2024-09-14T11:15:12.654 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:12.656+0000 7f76c1e8a8c0 1 < completed multipart upload key=1W5733SDHGDN upload=FBE84Q9F1EN7 tag=RKF4WDNXJG1K type=write size=3043354 2024-09-14T11:15:12.659 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:12.660+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_HJ701768A6I7.2~1ZGEP01HWKUL.0 size=727120 2024-09-14T11:15:12.659 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:12.660+0000 7f76c1e8a8c0 1 > prepared multipart upload key=HJ701768A6I7 upload=1ZGEP01HWKUL tag=DMG93NLNUBOO type=write size=1775696 2024-09-14T11:15:12.662 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:12.664+0000 7f76c1e8a8c0 1 < completed part key=_multipart_MEVTZ7OAD4CA.2~BECVR4LQD0H8.0 size=1048576 2024-09-14T11:15:12.664 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:12.668+0000 7f76c1e8a8c0 1 < completed part key=_multipart_MEVTZ7OAD4CA.2~BECVR4LQD0H8.1 size=736649 2024-09-14T11:15:12.671 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:12.672+0000 7f76c1e8a8c0 1 < completed multipart upload key=MEVTZ7OAD4CA upload=BECVR4LQD0H8 tag=JO7XI1L62NTI type=write size=2833801 2024-09-14T11:15:12.675 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:12.676+0000 7f76c1e8a8c0 1 > prepared operation key=LZ0YNFOVFYCL tag=GNUCJ8KTDEXQ type=del size=1870089 2024-09-14T11:15:12.678 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:12.680+0000 7f76c1e8a8c0 1 < completed part key=_multipart_GAVZRU8ZLW7S.2~0TND8ISYXK8D.0 size=1048576 2024-09-14T11:15:12.681 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:12.684+0000 7f76c1e8a8c0 1 < completed part key=_multipart_GAVZRU8ZLW7S.2~0TND8ISYXK8D.1 size=1048576 2024-09-14T11:15:12.683 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:12.684+0000 7f76c1e8a8c0 1 < completed part key=_multipart_GAVZRU8ZLW7S.2~0TND8ISYXK8D.2 size=296042 2024-09-14T11:15:12.688 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:12.692+0000 7f76c1e8a8c0 1 < completed multipart upload key=GAVZRU8ZLW7S upload=0TND8ISYXK8D tag=I2J8L0B13N1O type=write size=3441770 2024-09-14T11:15:12.692 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:12.692+0000 7f76c1e8a8c0 1 > prepared operation key=OUMUTEBQ1TD0 tag=SJH91H7B58MB type=del size=86711 2024-09-14T11:15:12.695 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:12.696+0000 7f76c1e8a8c0 1 < completed delete operation key=BOCIF4TL7X7J tag=3TK2RFXNZ7OI type=del 2024-09-14T11:15:12.701 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:12.704+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_Q5IY4J5FOD80.2~MGEKMKPIC6ZQ.0 size=200007 2024-09-14T11:15:12.702 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:12.704+0000 7f76c1e8a8c0 1 > prepared multipart upload key=Q5IY4J5FOD80 upload=MGEKMKPIC6ZQ tag=TYTRE6Z9QSRM type=write size=1248583 2024-09-14T11:15:12.705 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:12.708+0000 7f76c1e8a8c0 1 < completed delete operation key=LZ0YNFOVFYCL tag=0W06LR63MIM2 type=del 2024-09-14T11:15:12.709 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:12.712+0000 7f76c1e8a8c0 1 > prepared operation key=K9W031V6BFJP tag=WEB2ZINJITX9 type=del size=478549 2024-09-14T11:15:12.713 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:12.716+0000 7f76c1e8a8c0 1 < completed part key=_multipart_SUNCRV0C1XYL.2~FAZ997OY9TEN.0 size=1000151 2024-09-14T11:15:12.718 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:12.720+0000 7f76c1e8a8c0 1 < completed multipart upload key=SUNCRV0C1XYL upload=FAZ997OY9TEN tag=UAY7TF5VUR66 type=write size=2048727 2024-09-14T11:15:12.721 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:12.724+0000 7f76c1e8a8c0 1 > prepared operation key=TZO40K6J9877 tag=B427388EBLLC type=del size=656049 2024-09-14T11:15:12.724 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:12.728+0000 7f76c1e8a8c0 1 < completed part key=_multipart_Q5IY4J5FOD80.2~X06TT6HZUK2L.0 size=1048576 2024-09-14T11:15:12.727 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:12.728+0000 7f76c1e8a8c0 1 < completed part key=_multipart_Q5IY4J5FOD80.2~X06TT6HZUK2L.1 size=1048576 2024-09-14T11:15:12.729 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:12.732+0000 7f76c1e8a8c0 1 < completed part key=_multipart_Q5IY4J5FOD80.2~X06TT6HZUK2L.2 size=331546 2024-09-14T11:15:12.735 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:12.736+0000 7f76c1e8a8c0 1 < completed multipart upload key=Q5IY4J5FOD80 upload=X06TT6HZUK2L tag=ZPZA9DBDV22B type=write size=3477274 2024-09-14T11:15:12.738 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:12.740+0000 7f76c1e8a8c0 1 > prepared operation key=MEVTZ7OAD4CA tag=55FOZWKDRYY5 type=del size=1594116 2024-09-14T11:15:12.742 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:12.744+0000 7f76c1e8a8c0 1 < completed part key=_multipart_OUMUTEBQ1TD0.2~WYFAT68E4B0U.0 size=811673 2024-09-14T11:15:12.747 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:12.748+0000 7f76c1e8a8c0 1 < completed multipart upload key=OUMUTEBQ1TD0 upload=WYFAT68E4B0U tag=5YT4BNHSOOZF type=write size=1860249 2024-09-14T11:15:12.753 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:12.756+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_MEVTZ7OAD4CA.2~C4EH6ZSTMWIF.0 size=1048576 2024-09-14T11:15:12.756 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:12.756+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_MEVTZ7OAD4CA.2~C4EH6ZSTMWIF.1 size=1048576 2024-09-14T11:15:12.759 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:12.760+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_MEVTZ7OAD4CA.2~C4EH6ZSTMWIF.2 size=824800 2024-09-14T11:15:12.759 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:12.760+0000 7f76c1e8a8c0 1 > prepared multipart upload key=MEVTZ7OAD4CA upload=C4EH6ZSTMWIF tag=7CISJMBB0053 type=write size=3970528 2024-09-14T11:15:12.763 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:12.764+0000 7f76c1e8a8c0 1 < completed part key=_multipart_15FU4CEGC22Q.2~WUT3PO8PN569.0 size=1048576 2024-09-14T11:15:12.765 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:12.768+0000 7f76c1e8a8c0 1 < completed part key=_multipart_15FU4CEGC22Q.2~WUT3PO8PN569.1 size=269248 2024-09-14T11:15:12.771 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:12.772+0000 7f76c1e8a8c0 1 < completed multipart upload key=15FU4CEGC22Q upload=WUT3PO8PN569 tag=R5437QYQUEGR type=write size=2366400 2024-09-14T11:15:12.775 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:12.776+0000 7f76c1e8a8c0 1 > prepared operation key=1K8ESNXU6WDF tag=VFXOM94241LT type=del size=2851575 2024-09-14T11:15:12.783 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:12.784+0000 7f76c1e8a8c0 1 < suggested remove operation key=HJ701768A6I7 tag=4RYUVQIYC885 type=del 2024-09-14T11:15:12.787 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:12.788+0000 7f76c1e8a8c0 1 > prepared operation key=H9CQV6L29SL5 tag=F73UTC7OAFBK type=del size=2003651 2024-09-14T11:15:12.791 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:12.792+0000 7f76c1e8a8c0 1 < completed part key=_multipart_MEVTZ7OAD4CA.2~D9KR9R3YON7R.0 size=780060 2024-09-14T11:15:12.797 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:12.800+0000 7f76c1e8a8c0 1 < completed multipart upload key=MEVTZ7OAD4CA upload=D9KR9R3YON7R tag=HO9GN4GP38P8 type=write size=1828636 2024-09-14T11:15:12.801 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:12.804+0000 7f76c1e8a8c0 1 > prepared operation key=W0MDRE9YO3UP tag=0XW4ELT3IZ21 type=del size=3853040 2024-09-14T11:15:12.805 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:12.808+0000 7f76c1e8a8c0 1 < completed delete operation key=TUFOZKTV9XIH tag=8TLBIEIK8F8E type=del 2024-09-14T11:15:12.811 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:12.812+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_SUNCRV0C1XYL.2~1HVIJ0DCCDC7.0 size=1048576 2024-09-14T11:15:12.814 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:12.816+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_SUNCRV0C1XYL.2~1HVIJ0DCCDC7.1 size=1048576 2024-09-14T11:15:12.817 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:12.820+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_SUNCRV0C1XYL.2~1HVIJ0DCCDC7.2 size=1039119 2024-09-14T11:15:12.817 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:12.820+0000 7f76c1e8a8c0 1 > prepared multipart upload key=SUNCRV0C1XYL upload=1HVIJ0DCCDC7 tag=6ASVX81FYKVA type=write size=4184847 2024-09-14T11:15:12.821 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:12.824+0000 7f76c1e8a8c0 1 < completed delete operation key=K2EEZLRK7MVO tag=6PJ1EHWORT11 type=del 2024-09-14T11:15:12.824 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:12.828+0000 7f76c1e8a8c0 1 > prepared operation key=K9W031V6BFJP tag=6EUCB2FXEO38 type=del size=2573064 2024-09-14T11:15:12.828 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:12.828+0000 7f76c1e8a8c0 1 < completed part key=_multipart_K9W031V6BFJP.2~YZFHR0FKGF7W.0 size=1048576 2024-09-14T11:15:12.830 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:12.832+0000 7f76c1e8a8c0 1 < completed part key=_multipart_K9W031V6BFJP.2~YZFHR0FKGF7W.1 size=349741 2024-09-14T11:15:12.836 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:12.836+0000 7f76c1e8a8c0 1 < completed multipart upload key=K9W031V6BFJP upload=YZFHR0FKGF7W tag=D0INI651X2NU type=write size=2446893 2024-09-14T11:15:12.842 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:12.844+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_XC8VWSHZOPFP.2~F6JW8YAMTM2Z.0 size=939469 2024-09-14T11:15:12.842 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:12.844+0000 7f76c1e8a8c0 1 > prepared multipart upload key=XC8VWSHZOPFP upload=F6JW8YAMTM2Z tag=KDELJKSDJOB9 type=write size=1988045 2024-09-14T11:15:12.846 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:12.848+0000 7f76c1e8a8c0 -1 < failed to complete operation key=HJ701768A6I7 tag=T8FVI3WUJ25X type=del size=4027477: (22) Invalid argument 2024-09-14T11:15:12.849 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:12.852+0000 7f76c1e8a8c0 1 > prepared operation key=K9W031V6BFJP tag=B2LS59FLMIWS type=del size=2034163 2024-09-14T11:15:12.856 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:12.856+0000 7f76c1e8a8c0 1 < suggested update operation key=W0MDRE9YO3UP tag=A965P0ARZ2V5 type=del size=1805291 2024-09-14T11:15:12.859 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:12.860+0000 7f76c1e8a8c0 1 > prepared operation key=GAVZRU8ZLW7S tag=UX0YGU4NNRE8 type=del size=843139 2024-09-14T11:15:12.862 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:12.864+0000 7f76c1e8a8c0 1 < completed part key=_multipart_HJ701768A6I7.2~1ZGEP01HWKUL.0 size=727120 2024-09-14T11:15:12.867 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:12.868+0000 7f76c1e8a8c0 1 < completed multipart upload key=HJ701768A6I7 upload=1ZGEP01HWKUL tag=DMG93NLNUBOO type=write size=1775696 2024-09-14T11:15:12.870 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:12.872+0000 7f76c1e8a8c0 1 > prepared operation key=CIRQT9IDJ5OJ tag=4863IQS2IPZF type=del size=1269315 2024-09-14T11:15:12.873 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:12.876+0000 7f76c1e8a8c0 1 < completed delete operation key=LZ0YNFOVFYCL tag=GNUCJ8KTDEXQ type=del 2024-09-14T11:15:12.876 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:12.876+0000 7f76c1e8a8c0 1 > prepared operation key=15FU4CEGC22Q tag=0PBNPO6VMKF5 type=del size=394464 2024-09-14T11:15:12.878 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:12.880+0000 7f76c1e8a8c0 1 < completed delete operation key=OUMUTEBQ1TD0 tag=SJH91H7B58MB type=del 2024-09-14T11:15:12.881 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:12.884+0000 7f76c1e8a8c0 1 > prepared operation key=MEVTZ7OAD4CA tag=N7VLKW2S92NM type=write size=427608 2024-09-14T11:15:12.884 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:12.884+0000 7f76c1e8a8c0 1 < completed part key=_multipart_Q5IY4J5FOD80.2~MGEKMKPIC6ZQ.0 size=200007 2024-09-14T11:15:12.889 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:12.892+0000 7f76c1e8a8c0 1 < completed multipart upload key=Q5IY4J5FOD80 upload=MGEKMKPIC6ZQ tag=TYTRE6Z9QSRM type=write size=1248583 2024-09-14T11:15:12.891 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:12.892+0000 7f76c1e8a8c0 1 > prepared operation key=LZ0YNFOVFYCL tag=KFZTCG89670B type=del size=3012937 2024-09-14T11:15:12.894 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:12.896+0000 7f76c1e8a8c0 1 < completed delete operation key=K9W031V6BFJP tag=WEB2ZINJITX9 type=del 2024-09-14T11:15:12.898 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:12.900+0000 7f76c1e8a8c0 1 > prepared operation key=LZ0YNFOVFYCL tag=UKASVAAF59X6 type=del size=4184097 2024-09-14T11:15:12.901 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:12.904+0000 7f76c1e8a8c0 1 < completed delete operation key=TZO40K6J9877 tag=B427388EBLLC type=del 2024-09-14T11:15:12.904 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:12.908+0000 7f76c1e8a8c0 1 > prepared operation key=GAVZRU8ZLW7S tag=7QH4D2BVB49M type=del size=3925155 2024-09-14T11:15:12.907 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:12.908+0000 7f76c1e8a8c0 1 < completed delete operation key=MEVTZ7OAD4CA tag=55FOZWKDRYY5 type=del 2024-09-14T11:15:12.910 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:12.912+0000 7f76c1e8a8c0 1 > prepared operation key=HJ701768A6I7 tag=05YJXBCN1SFE type=del size=3660044 2024-09-14T11:15:12.913 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:12.916+0000 7f76c1e8a8c0 1 < completed part key=_multipart_MEVTZ7OAD4CA.2~C4EH6ZSTMWIF.0 size=1048576 2024-09-14T11:15:12.915 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:12.916+0000 7f76c1e8a8c0 1 < completed part key=_multipart_MEVTZ7OAD4CA.2~C4EH6ZSTMWIF.1 size=1048576 2024-09-14T11:15:12.918 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:12.920+0000 7f76c1e8a8c0 1 < completed part key=_multipart_MEVTZ7OAD4CA.2~C4EH6ZSTMWIF.2 size=824800 2024-09-14T11:15:12.923 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:12.924+0000 7f76c1e8a8c0 1 < completed multipart upload key=MEVTZ7OAD4CA upload=C4EH6ZSTMWIF tag=7CISJMBB0053 type=write size=3970528 2024-09-14T11:15:12.928 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:12.928+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_TUFOZKTV9XIH.2~BHZK21DLT2U7.0 size=1048576 2024-09-14T11:15:12.930 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:12.932+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_TUFOZKTV9XIH.2~BHZK21DLT2U7.1 size=1048576 2024-09-14T11:15:12.932 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:12.936+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_TUFOZKTV9XIH.2~BHZK21DLT2U7.2 size=14444 2024-09-14T11:15:12.932 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:12.936+0000 7f76c1e8a8c0 1 > prepared multipart upload key=TUFOZKTV9XIH upload=BHZK21DLT2U7 tag=XY1TBRB11E8H type=write size=3160172 2024-09-14T11:15:12.935 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:12.936+0000 7f76c1e8a8c0 1 < completed delete operation key=1K8ESNXU6WDF tag=VFXOM94241LT type=del 2024-09-14T11:15:12.938 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:12.940+0000 7f76c1e8a8c0 1 > prepared operation key=1W5733SDHGDN tag=E0AACTDAK9B9 type=del size=1019189 2024-09-14T11:15:12.940 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:12.944+0000 7f76c1e8a8c0 1 < canceled operation key=H9CQV6L29SL5 tag=F73UTC7OAFBK type=del size=2003651 2024-09-14T11:15:12.943 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:12.944+0000 7f76c1e8a8c0 1 > prepared operation key=XC8VWSHZOPFP tag=GIYXK3LC2HJU type=del size=3072467 2024-09-14T11:15:12.945 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:12.948+0000 7f76c1e8a8c0 -1 < failed to complete operation key=W0MDRE9YO3UP tag=0XW4ELT3IZ21 type=del size=3853040: (22) Invalid argument 2024-09-14T11:15:12.950 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:12.952+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_KS37ZO6MKAH9.2~ES37K4H03NF7.0 size=1048576 2024-09-14T11:15:12.952 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:12.956+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_KS37ZO6MKAH9.2~ES37K4H03NF7.1 size=1048576 2024-09-14T11:15:12.954 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:12.956+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_KS37ZO6MKAH9.2~ES37K4H03NF7.2 size=300554 2024-09-14T11:15:12.954 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:12.956+0000 7f76c1e8a8c0 1 > prepared multipart upload key=KS37ZO6MKAH9 upload=ES37K4H03NF7 tag=L11HULWRGHBN type=write size=3446282 2024-09-14T11:15:12.957 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:12.960+0000 7f76c1e8a8c0 1 < completed part key=_multipart_SUNCRV0C1XYL.2~1HVIJ0DCCDC7.0 size=1048576 2024-09-14T11:15:12.959 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:12.960+0000 7f76c1e8a8c0 1 < completed part key=_multipart_SUNCRV0C1XYL.2~1HVIJ0DCCDC7.1 size=1048576 2024-09-14T11:15:12.961 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:12.964+0000 7f76c1e8a8c0 1 < completed part key=_multipart_SUNCRV0C1XYL.2~1HVIJ0DCCDC7.2 size=1039119 2024-09-14T11:15:12.968 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:12.968+0000 7f76c1e8a8c0 1 < completed multipart upload key=SUNCRV0C1XYL upload=1HVIJ0DCCDC7 tag=6ASVX81FYKVA type=write size=4184847 2024-09-14T11:15:12.971 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:12.972+0000 7f76c1e8a8c0 1 > prepared operation key=6TIJR323NMOH tag=AYE5QEZNHYK1 type=del size=3025301 2024-09-14T11:15:12.973 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:12.976+0000 7f76c1e8a8c0 1 < canceled operation key=K9W031V6BFJP tag=6EUCB2FXEO38 type=del size=2573064 2024-09-14T11:15:12.978 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:12.980+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_8FFV9G6EQR8F.2~6RGJR68PNIDU.0 size=927257 2024-09-14T11:15:12.978 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:12.980+0000 7f76c1e8a8c0 1 > prepared multipart upload key=8FFV9G6EQR8F upload=6RGJR68PNIDU tag=UL7Z1CVZNWGQ type=write size=1975833 2024-09-14T11:15:12.981 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:12.984+0000 7f76c1e8a8c0 1 < completed part key=_multipart_XC8VWSHZOPFP.2~F6JW8YAMTM2Z.0 size=939469 2024-09-14T11:15:12.985 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:12.988+0000 7f76c1e8a8c0 1 < completed multipart upload key=XC8VWSHZOPFP upload=F6JW8YAMTM2Z tag=KDELJKSDJOB9 type=write size=1988045 2024-09-14T11:15:12.988 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:12.992+0000 7f76c1e8a8c0 1 > prepared operation key=TZO40K6J9877 tag=NPOHNT035SPT type=write size=122629 2024-09-14T11:15:12.991 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:12.992+0000 7f76c1e8a8c0 1 < completed delete operation key=K9W031V6BFJP tag=B2LS59FLMIWS type=del 2024-09-14T11:15:12.994 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:12.996+0000 7f76c1e8a8c0 1 > prepared operation key=15FU4CEGC22Q tag=XGX0J49734YN type=write size=467361 2024-09-14T11:15:12.999 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:13.000+0000 7f76c1e8a8c0 1 < suggested update operation key=GAVZRU8ZLW7S tag=UX0YGU4NNRE8 type=del size=843139 2024-09-14T11:15:13.002 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:13.004+0000 7f76c1e8a8c0 1 > prepared operation key=6TIJR323NMOH tag=8SBZIF0FGBX2 type=write size=977460 2024-09-14T11:15:13.008 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:13.008+0000 7f76c1e8a8c0 1 < suggested update operation key=CIRQT9IDJ5OJ tag=4863IQS2IPZF type=del size=1269315 2024-09-14T11:15:13.010 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:13.012+0000 7f76c1e8a8c0 1 > prepared operation key=8FFV9G6EQR8F tag=V759ZK92GE9W type=del size=3209661 2024-09-14T11:15:13.013 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:13.016+0000 7f76c1e8a8c0 1 < completed delete operation key=15FU4CEGC22Q tag=0PBNPO6VMKF5 type=del 2024-09-14T11:15:13.016 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:13.016+0000 7f76c1e8a8c0 1 > prepared operation key=TZO40K6J9877 tag=WE0J5ULOS3ZY type=del size=571323 2024-09-14T11:15:13.018 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:13.020+0000 7f76c1e8a8c0 1 < completed write operation key=MEVTZ7OAD4CA tag=N7VLKW2S92NM type=write size=427608 2024-09-14T11:15:13.023 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:13.024+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_OOUEM16XL80W.2~3BTSEVA4FQM6.0 size=845366 2024-09-14T11:15:13.023 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:13.024+0000 7f76c1e8a8c0 1 > prepared multipart upload key=OOUEM16XL80W upload=3BTSEVA4FQM6 tag=DE1RLYJPO56L type=write size=1893942 2024-09-14T11:15:13.026 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:13.028+0000 7f76c1e8a8c0 1 < completed delete operation key=LZ0YNFOVFYCL tag=KFZTCG89670B type=del 2024-09-14T11:15:13.031 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:13.032+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_OUMUTEBQ1TD0.2~ZFVZ0ENFAH32.0 size=1048576 2024-09-14T11:15:13.033 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:13.036+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_OUMUTEBQ1TD0.2~ZFVZ0ENFAH32.1 size=1048576 2024-09-14T11:15:13.035 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:13.036+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_OUMUTEBQ1TD0.2~ZFVZ0ENFAH32.2 size=798645 2024-09-14T11:15:13.035 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:13.036+0000 7f76c1e8a8c0 1 > prepared multipart upload key=OUMUTEBQ1TD0 upload=ZFVZ0ENFAH32 tag=GAQXEQ1EJPLP type=write size=3944373 2024-09-14T11:15:13.038 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:13.040+0000 7f76c1e8a8c0 1 < completed delete operation key=LZ0YNFOVFYCL tag=UKASVAAF59X6 type=del 2024-09-14T11:15:13.041 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:13.044+0000 7f76c1e8a8c0 1 > prepared operation key=KS37ZO6MKAH9 tag=2AVHDYF381SP type=del size=673267 2024-09-14T11:15:13.044 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:13.044+0000 7f76c1e8a8c0 -1 < failed to complete operation key=GAVZRU8ZLW7S tag=7QH4D2BVB49M type=del size=3925155: (22) Invalid argument 2024-09-14T11:15:13.049 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:13.052+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_GAVZRU8ZLW7S.2~JEGGD1MCR9MN.0 size=661627 2024-09-14T11:15:13.049 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:13.052+0000 7f76c1e8a8c0 1 > prepared multipart upload key=GAVZRU8ZLW7S upload=JEGGD1MCR9MN tag=AWRA2N6ST58A type=write size=1710203 2024-09-14T11:15:13.053 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:13.052+0000 7f76c1e8a8c0 1 < completed delete operation key=HJ701768A6I7 tag=05YJXBCN1SFE type=del 2024-09-14T11:15:13.054 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:13.056+0000 7f76c1e8a8c0 1 > prepared operation key=Q5IY4J5FOD80 tag=3S6KDC0ELXSN type=del size=1410330 2024-09-14T11:15:13.057 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:13.060+0000 7f76c1e8a8c0 1 < completed part key=_multipart_TUFOZKTV9XIH.2~BHZK21DLT2U7.0 size=1048576 2024-09-14T11:15:13.059 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:13.060+0000 7f76c1e8a8c0 1 < completed part key=_multipart_TUFOZKTV9XIH.2~BHZK21DLT2U7.1 size=1048576 2024-09-14T11:15:13.061 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:13.064+0000 7f76c1e8a8c0 1 < completed part key=_multipart_TUFOZKTV9XIH.2~BHZK21DLT2U7.2 size=14444 2024-09-14T11:15:13.066 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:13.068+0000 7f76c1e8a8c0 1 < completed multipart upload key=TUFOZKTV9XIH upload=BHZK21DLT2U7 tag=XY1TBRB11E8H type=write size=3160172 2024-09-14T11:15:13.071 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:13.072+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_85G6NT78HAWQ.2~AFELWNE32EGZ.0 size=1048576 2024-09-14T11:15:13.074 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:13.076+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_85G6NT78HAWQ.2~AFELWNE32EGZ.1 size=1048576 2024-09-14T11:15:13.076 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:13.076+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_85G6NT78HAWQ.2~AFELWNE32EGZ.2 size=243664 2024-09-14T11:15:13.076 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:13.076+0000 7f76c1e8a8c0 1 > prepared multipart upload key=85G6NT78HAWQ upload=AFELWNE32EGZ tag=HV34KOWC1A61 type=write size=3389392 2024-09-14T11:15:13.081 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:13.084+0000 7f76c1e8a8c0 1 < suggested update operation key=1W5733SDHGDN tag=E0AACTDAK9B9 type=del size=1019189 2024-09-14T11:15:13.084 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:13.084+0000 7f76c1e8a8c0 1 > prepared operation key=K2EEZLRK7MVO tag=NNLWQVAKHGQQ type=del size=1660833 2024-09-14T11:15:13.089 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:13.092+0000 7f76c1e8a8c0 1 < suggested update operation key=XC8VWSHZOPFP tag=GIYXK3LC2HJU type=del size=3072467 2024-09-14T11:15:13.092 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:13.092+0000 7f76c1e8a8c0 1 > prepared operation key=GZM0AQVHNCMM tag=A7UHEMLCTWBJ type=del size=1527680 2024-09-14T11:15:13.094 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:13.096+0000 7f76c1e8a8c0 1 < completed part key=_multipart_KS37ZO6MKAH9.2~ES37K4H03NF7.0 size=1048576 2024-09-14T11:15:13.096 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:13.100+0000 7f76c1e8a8c0 1 < completed part key=_multipart_KS37ZO6MKAH9.2~ES37K4H03NF7.1 size=1048576 2024-09-14T11:15:13.098 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:13.100+0000 7f76c1e8a8c0 1 < completed part key=_multipart_KS37ZO6MKAH9.2~ES37K4H03NF7.2 size=300554 2024-09-14T11:15:13.103 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:13.104+0000 7f76c1e8a8c0 1 < completed multipart upload key=KS37ZO6MKAH9 upload=ES37K4H03NF7 tag=L11HULWRGHBN type=write size=3446282 2024-09-14T11:15:13.106 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:13.108+0000 7f76c1e8a8c0 1 > prepared operation key=S43U13LYETS4 tag=UGTFGLS4GUS6 type=write size=185463 2024-09-14T11:15:13.108 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:13.112+0000 7f76c1e8a8c0 1 < completed delete operation key=6TIJR323NMOH tag=AYE5QEZNHYK1 type=del 2024-09-14T11:15:13.111 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:13.112+0000 7f76c1e8a8c0 1 > prepared operation key=LZ0YNFOVFYCL tag=4YA99HO75MLF type=del size=914516 2024-09-14T11:15:13.113 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:13.116+0000 7f76c1e8a8c0 1 < completed part key=_multipart_8FFV9G6EQR8F.2~6RGJR68PNIDU.0 size=927257 2024-09-14T11:15:13.118 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:13.120+0000 7f76c1e8a8c0 1 < completed multipart upload key=8FFV9G6EQR8F upload=6RGJR68PNIDU tag=UL7Z1CVZNWGQ type=write size=1975833 2024-09-14T11:15:13.122 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:13.124+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_1K8ESNXU6WDF.2~8ULLNRFQVEAV.0 size=1048576 2024-09-14T11:15:13.124 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:13.128+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_1K8ESNXU6WDF.2~8ULLNRFQVEAV.1 size=1048576 2024-09-14T11:15:13.126 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:13.128+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_1K8ESNXU6WDF.2~8ULLNRFQVEAV.2 size=467328 2024-09-14T11:15:13.127 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:13.128+0000 7f76c1e8a8c0 1 > prepared multipart upload key=1K8ESNXU6WDF upload=8ULLNRFQVEAV tag=802H50NTAQFA type=write size=3613056 2024-09-14T11:15:13.129 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:13.132+0000 7f76c1e8a8c0 1 < completed write operation key=TZO40K6J9877 tag=NPOHNT035SPT type=write size=122629 2024-09-14T11:15:13.132 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:13.132+0000 7f76c1e8a8c0 1 > prepared operation key=R5I9H7WAK7Z7 tag=VJYNNZBH304I type=del size=170494 2024-09-14T11:15:13.135 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:13.136+0000 7f76c1e8a8c0 1 < completed write operation key=15FU4CEGC22Q tag=XGX0J49734YN type=write size=467361 2024-09-14T11:15:13.138 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:13.140+0000 7f76c1e8a8c0 1 > prepared operation key=GAVZRU8ZLW7S tag=HVO3CE2NSD88 type=del size=2233769 2024-09-14T11:15:13.141 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:13.144+0000 7f76c1e8a8c0 1 < completed write operation key=6TIJR323NMOH tag=8SBZIF0FGBX2 type=write size=977460 2024-09-14T11:15:13.144 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:13.144+0000 7f76c1e8a8c0 1 > prepared operation key=OUMUTEBQ1TD0 tag=JPWSFGAADOUY type=del size=914911 2024-09-14T11:15:13.147 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:13.148+0000 7f76c1e8a8c0 1 < completed delete operation key=8FFV9G6EQR8F tag=V759ZK92GE9W type=del 2024-09-14T11:15:13.150 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:13.152+0000 7f76c1e8a8c0 1 > prepared operation key=6TIJR323NMOH tag=LT6OTESQ7FTB type=del size=2517092 2024-09-14T11:15:13.153 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:13.156+0000 7f76c1e8a8c0 1 < completed delete operation key=TZO40K6J9877 tag=WE0J5ULOS3ZY type=del 2024-09-14T11:15:13.156 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:13.156+0000 7f76c1e8a8c0 1 > prepared operation key=1W5733SDHGDN tag=Q8UEQRCKB1EK type=del size=1457075 2024-09-14T11:15:13.159 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:13.160+0000 7f76c1e8a8c0 1 < completed part key=_multipart_OOUEM16XL80W.2~3BTSEVA4FQM6.0 size=845366 2024-09-14T11:15:13.164 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:13.164+0000 7f76c1e8a8c0 1 < completed multipart upload key=OOUEM16XL80W upload=3BTSEVA4FQM6 tag=DE1RLYJPO56L type=write size=1893942 2024-09-14T11:15:13.169 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:13.172+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_GAVZRU8ZLW7S.2~OCRIAE9KKBXO.0 size=127165 2024-09-14T11:15:13.170 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:13.172+0000 7f76c1e8a8c0 1 > prepared multipart upload key=GAVZRU8ZLW7S upload=OCRIAE9KKBXO tag=KFGCUDC2GU2O type=write size=1175741 2024-09-14T11:15:13.172 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:13.176+0000 7f76c1e8a8c0 1 < completed part key=_multipart_OUMUTEBQ1TD0.2~ZFVZ0ENFAH32.0 size=1048576 2024-09-14T11:15:13.175 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:13.176+0000 7f76c1e8a8c0 1 < completed part key=_multipart_OUMUTEBQ1TD0.2~ZFVZ0ENFAH32.1 size=1048576 2024-09-14T11:15:13.177 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:13.180+0000 7f76c1e8a8c0 1 < completed part key=_multipart_OUMUTEBQ1TD0.2~ZFVZ0ENFAH32.2 size=798645 2024-09-14T11:15:13.181 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:13.184+0000 7f76c1e8a8c0 1 < completed multipart upload key=OUMUTEBQ1TD0 upload=ZFVZ0ENFAH32 tag=GAQXEQ1EJPLP type=write size=3944373 2024-09-14T11:15:13.185 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:13.188+0000 7f76c1e8a8c0 1 > prepared operation key=CIRQT9IDJ5OJ tag=TIK84E9B8JW2 type=del size=312818 2024-09-14T11:15:13.188 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:13.188+0000 7f76c1e8a8c0 1 < canceled operation key=KS37ZO6MKAH9 tag=2AVHDYF381SP type=del size=673267 2024-09-14T11:15:13.193 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:13.196+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_K9W031V6BFJP.2~ZBEAPRXNQD51.0 size=187993 2024-09-14T11:15:13.193 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:13.196+0000 7f76c1e8a8c0 1 > prepared multipart upload key=K9W031V6BFJP upload=ZBEAPRXNQD51 tag=PLZJDIGHDLHQ type=write size=1236569 2024-09-14T11:15:13.195 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:13.196+0000 7f76c1e8a8c0 1 < completed part key=_multipart_GAVZRU8ZLW7S.2~JEGGD1MCR9MN.0 size=661627 2024-09-14T11:15:13.200 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:13.200+0000 7f76c1e8a8c0 1 < completed multipart upload key=GAVZRU8ZLW7S upload=JEGGD1MCR9MN tag=AWRA2N6ST58A type=write size=1710203 2024-09-14T11:15:13.205 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:13.208+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_HJ701768A6I7.2~8LE6HL3FLHUR.0 size=246092 2024-09-14T11:15:13.205 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:13.208+0000 7f76c1e8a8c0 1 > prepared multipart upload key=HJ701768A6I7 upload=8LE6HL3FLHUR tag=ZJ66IDR4R8R9 type=write size=1294668 2024-09-14T11:15:13.208 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:13.208+0000 7f76c1e8a8c0 1 < completed delete operation key=Q5IY4J5FOD80 tag=3S6KDC0ELXSN type=del 2024-09-14T11:15:13.213 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:13.216+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_R5I9H7WAK7Z7.2~ZOGOND6BZTN5.0 size=613952 2024-09-14T11:15:13.214 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:13.216+0000 7f76c1e8a8c0 1 > prepared multipart upload key=R5I9H7WAK7Z7 upload=ZOGOND6BZTN5 tag=NUDGRHQMUYWK type=write size=1662528 2024-09-14T11:15:13.217 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:13.220+0000 7f76c1e8a8c0 1 < completed part key=_multipart_85G6NT78HAWQ.2~AFELWNE32EGZ.0 size=1048576 2024-09-14T11:15:13.217 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:13.220+0000 7f76c1e8a8c0 1 < canceled part key=_multipart_85G6NT78HAWQ.2~AFELWNE32EGZ.1 size=1048576 2024-09-14T11:15:13.219 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:13.220+0000 7f76c1e8a8c0 1 < completed part key=_multipart_85G6NT78HAWQ.2~AFELWNE32EGZ.2 size=243664 2024-09-14T11:15:13.224 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:13.224+0000 7f76c1e8a8c0 1 < canceled multipart upload key=85G6NT78HAWQ upload=AFELWNE32EGZ tag=HV34KOWC1A61 type=write size=3389392 2024-09-14T11:15:13.230 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:13.232+0000 7f76c1e8a8c0 1 > prepared operation key=F3KFS0P1WM7W tag=P6LO1C1Q57FU type=write size=14719 2024-09-14T11:15:13.233 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:13.236+0000 7f76c1e8a8c0 1 < completed delete operation key=K2EEZLRK7MVO tag=NNLWQVAKHGQQ type=del 2024-09-14T11:15:13.239 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:13.240+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_CIRQT9IDJ5OJ.2~6XQTCBC287N1.0 size=196171 2024-09-14T11:15:13.239 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:13.240+0000 7f76c1e8a8c0 1 > prepared multipart upload key=CIRQT9IDJ5OJ upload=6XQTCBC287N1 tag=KH89BKEZ31FK type=write size=1244747 2024-09-14T11:15:13.242 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:13.244+0000 7f76c1e8a8c0 1 < canceled operation key=GZM0AQVHNCMM tag=A7UHEMLCTWBJ type=del size=1527680 2024-09-14T11:15:13.245 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:13.248+0000 7f76c1e8a8c0 1 > prepared operation key=K9W031V6BFJP tag=5QFVZYDLIZUS type=del size=1601065 2024-09-14T11:15:13.248 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:13.252+0000 7f76c1e8a8c0 1 < canceled operation key=S43U13LYETS4 tag=UGTFGLS4GUS6 type=write size=185463 2024-09-14T11:15:13.252 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:13.252+0000 7f76c1e8a8c0 1 > prepared operation key=OOUEM16XL80W tag=1IPFUD1YH7VK type=del size=3184110 2024-09-14T11:15:13.258 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:13.260+0000 7f76c1e8a8c0 1 < suggested update operation key=LZ0YNFOVFYCL tag=4YA99HO75MLF type=del size=914516 2024-09-14T11:15:13.262 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:13.264+0000 7f76c1e8a8c0 1 > prepared operation key=CIRQT9IDJ5OJ tag=T3YUG19ER4OS type=del size=4059905 2024-09-14T11:15:13.265 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:13.268+0000 7f76c1e8a8c0 1 < completed part key=_multipart_1K8ESNXU6WDF.2~8ULLNRFQVEAV.0 size=1048576 2024-09-14T11:15:13.268 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:13.272+0000 7f76c1e8a8c0 1 < completed part key=_multipart_1K8ESNXU6WDF.2~8ULLNRFQVEAV.1 size=1048576 2024-09-14T11:15:13.271 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:13.272+0000 7f76c1e8a8c0 1 < completed part key=_multipart_1K8ESNXU6WDF.2~8ULLNRFQVEAV.2 size=467328 2024-09-14T11:15:13.276 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:13.280+0000 7f76c1e8a8c0 1 < completed multipart upload key=1K8ESNXU6WDF upload=8ULLNRFQVEAV tag=802H50NTAQFA type=write size=3613056 2024-09-14T11:15:13.280 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:13.280+0000 7f76c1e8a8c0 1 > prepared operation key=F3KFS0P1WM7W tag=0K2DVTFZ22HP type=write size=415019 2024-09-14T11:15:13.283 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:13.284+0000 7f76c1e8a8c0 1 < completed delete operation key=R5I9H7WAK7Z7 tag=VJYNNZBH304I type=del 2024-09-14T11:15:13.289 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:13.292+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_HS7T50JORDQJ.2~9CU2IWQ38RJ4.0 size=40188 2024-09-14T11:15:13.289 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:13.292+0000 7f76c1e8a8c0 1 > prepared multipart upload key=HS7T50JORDQJ upload=9CU2IWQ38RJ4 tag=L7BL3B5XBPNY type=write size=1088764 2024-09-14T11:15:13.296 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:13.296+0000 7f76c1e8a8c0 1 < suggested remove operation key=GAVZRU8ZLW7S tag=HVO3CE2NSD88 type=del 2024-09-14T11:15:13.299 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:13.300+0000 7f76c1e8a8c0 1 > prepared operation key=VI61O3K069BP tag=2NH0UDGCEK91 type=del size=1736454 2024-09-14T11:15:13.303 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:13.304+0000 7f76c1e8a8c0 1 < completed delete operation key=OUMUTEBQ1TD0 tag=JPWSFGAADOUY type=del 2024-09-14T11:15:13.309 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:13.312+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_K2EEZLRK7MVO.2~RH3PI80760X1.0 size=1048576 2024-09-14T11:15:13.311 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:13.312+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_K2EEZLRK7MVO.2~RH3PI80760X1.1 size=882491 2024-09-14T11:15:13.312 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:13.312+0000 7f76c1e8a8c0 1 > prepared multipart upload key=K2EEZLRK7MVO upload=RH3PI80760X1 tag=S1R5O8D0Q7CR type=write size=2979643 2024-09-14T11:15:13.315 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:13.316+0000 7f76c1e8a8c0 1 < completed delete operation key=6TIJR323NMOH tag=LT6OTESQ7FTB type=del 2024-09-14T11:15:13.318 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:13.320+0000 7f76c1e8a8c0 1 > prepared operation key=Q5IY4J5FOD80 tag=0HAMIA7GH1ZZ type=write size=35391 2024-09-14T11:15:13.321 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:13.324+0000 7f76c1e8a8c0 1 < completed delete operation key=1W5733SDHGDN tag=Q8UEQRCKB1EK type=del 2024-09-14T11:15:13.324 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:13.324+0000 7f76c1e8a8c0 1 > prepared operation key=8FFV9G6EQR8F tag=GUK4EM2SL23G type=del size=1683548 2024-09-14T11:15:13.326 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:13.328+0000 7f76c1e8a8c0 1 < completed part key=_multipart_GAVZRU8ZLW7S.2~OCRIAE9KKBXO.0 size=127165 2024-09-14T11:15:13.331 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:13.332+0000 7f76c1e8a8c0 1 < completed multipart upload key=GAVZRU8ZLW7S upload=OCRIAE9KKBXO tag=KFGCUDC2GU2O type=write size=1175741 2024-09-14T11:15:13.336 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:13.340+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_KS37ZO6MKAH9.2~T5EHB4SPP9H7.0 size=1048576 2024-09-14T11:15:13.338 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:13.340+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_KS37ZO6MKAH9.2~T5EHB4SPP9H7.1 size=500932 2024-09-14T11:15:13.338 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:13.340+0000 7f76c1e8a8c0 1 > prepared multipart upload key=KS37ZO6MKAH9 upload=T5EHB4SPP9H7 tag=U4FBOX8IDWTN type=write size=2598084 2024-09-14T11:15:13.341 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:13.344+0000 7f76c1e8a8c0 1 < completed delete operation key=CIRQT9IDJ5OJ tag=TIK84E9B8JW2 type=del 2024-09-14T11:15:13.344 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:13.344+0000 7f76c1e8a8c0 1 > prepared operation key=W0MDRE9YO3UP tag=RLQWLO0W4FPB type=del size=3048694 2024-09-14T11:15:13.347 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:13.348+0000 7f76c1e8a8c0 1 < completed part key=_multipart_K9W031V6BFJP.2~ZBEAPRXNQD51.0 size=187993 2024-09-14T11:15:13.352 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:13.352+0000 7f76c1e8a8c0 1 < completed multipart upload key=K9W031V6BFJP upload=ZBEAPRXNQD51 tag=PLZJDIGHDLHQ type=write size=1236569 2024-09-14T11:15:13.357 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:13.360+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_Q5IY4J5FOD80.2~F6JSLZRR5M4V.0 size=420826 2024-09-14T11:15:13.357 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:13.360+0000 7f76c1e8a8c0 1 > prepared multipart upload key=Q5IY4J5FOD80 upload=F6JSLZRR5M4V tag=WIJ55NBUSBYU type=write size=1469402 2024-09-14T11:15:13.360 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:13.364+0000 7f76c1e8a8c0 1 < completed part key=_multipart_HJ701768A6I7.2~8LE6HL3FLHUR.0 size=246092 2024-09-14T11:15:13.365 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:13.368+0000 7f76c1e8a8c0 1 < completed multipart upload key=HJ701768A6I7 upload=8LE6HL3FLHUR tag=ZJ66IDR4R8R9 type=write size=1294668 2024-09-14T11:15:13.368 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:13.368+0000 7f76c1e8a8c0 1 > prepared operation key=SUNCRV0C1XYL tag=WQGHVBNHZ0FK type=del size=104711 2024-09-14T11:15:13.371 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:13.372+0000 7f76c1e8a8c0 1 < completed part key=_multipart_R5I9H7WAK7Z7.2~ZOGOND6BZTN5.0 size=613952 2024-09-14T11:15:13.376 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:13.380+0000 7f76c1e8a8c0 1 < completed multipart upload key=R5I9H7WAK7Z7 upload=ZOGOND6BZTN5 tag=NUDGRHQMUYWK type=write size=1662528 2024-09-14T11:15:13.379 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:13.380+0000 7f76c1e8a8c0 1 > prepared operation key=OOUEM16XL80W tag=BLWRR3CHZ2JH type=del size=2145191 2024-09-14T11:15:13.385 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:13.388+0000 7f76c1e8a8c0 1 < suggested remove operation key=F3KFS0P1WM7W tag=P6LO1C1Q57FU type=write 2024-09-14T11:15:13.388 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:13.392+0000 7f76c1e8a8c0 1 > prepared operation key=SUNCRV0C1XYL tag=FRJIGK952X9X type=del size=3734726 2024-09-14T11:15:13.392 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:13.392+0000 7f76c1e8a8c0 1 < completed part key=_multipart_CIRQT9IDJ5OJ.2~6XQTCBC287N1.0 size=196171 2024-09-14T11:15:13.396 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:13.400+0000 7f76c1e8a8c0 1 < completed multipart upload key=CIRQT9IDJ5OJ upload=6XQTCBC287N1 tag=KH89BKEZ31FK type=write size=1244747 2024-09-14T11:15:13.402 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:13.404+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_Q5IY4J5FOD80.2~CRFZT2ZDS32E.0 size=1048576 2024-09-14T11:15:13.405 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:13.408+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_Q5IY4J5FOD80.2~CRFZT2ZDS32E.1 size=1048576 2024-09-14T11:15:13.407 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:13.408+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_Q5IY4J5FOD80.2~CRFZT2ZDS32E.2 size=404174 2024-09-14T11:15:13.407 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:13.408+0000 7f76c1e8a8c0 1 > prepared multipart upload key=Q5IY4J5FOD80 upload=CRFZT2ZDS32E tag=2SMCNZ3S8IGW type=write size=3549902 2024-09-14T11:15:13.410 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:13.412+0000 7f76c1e8a8c0 1 < canceled operation key=K9W031V6BFJP tag=5QFVZYDLIZUS type=del size=1601065 2024-09-14T11:15:13.414 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:13.416+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_TZO40K6J9877.2~PG2YIIV0RAAZ.0 size=751991 2024-09-14T11:15:13.415 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:13.416+0000 7f76c1e8a8c0 1 > prepared multipart upload key=TZO40K6J9877 upload=PG2YIIV0RAAZ tag=UG7WON0MGJS2 type=write size=1800567 2024-09-14T11:15:13.417 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:13.420+0000 7f76c1e8a8c0 1 < completed delete operation key=OOUEM16XL80W tag=1IPFUD1YH7VK type=del 2024-09-14T11:15:13.420 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:13.420+0000 7f76c1e8a8c0 1 > prepared operation key=Q5IY4J5FOD80 tag=FYFTLWD2RD96 type=del size=2681813 2024-09-14T11:15:13.423 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:13.424+0000 7f76c1e8a8c0 1 < completed delete operation key=CIRQT9IDJ5OJ tag=T3YUG19ER4OS type=del 2024-09-14T11:15:13.425 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:13.428+0000 7f76c1e8a8c0 1 > prepared operation key=MEVTZ7OAD4CA tag=U3TRFBAL78PV type=del size=4098580 2024-09-14T11:15:13.428 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:13.432+0000 7f76c1e8a8c0 -1 < failed to complete operation key=F3KFS0P1WM7W tag=0K2DVTFZ22HP type=write size=415019: (22) Invalid argument 2024-09-14T11:15:13.431 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:13.432+0000 7f76c1e8a8c0 1 > prepared operation key=F3KFS0P1WM7W tag=VZ4D2BTF21ME type=del size=3631940 2024-09-14T11:15:13.434 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:13.436+0000 7f76c1e8a8c0 1 < completed part key=_multipart_HS7T50JORDQJ.2~9CU2IWQ38RJ4.0 size=40188 2024-09-14T11:15:13.438 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:13.440+0000 7f76c1e8a8c0 1 < completed multipart upload key=HS7T50JORDQJ upload=9CU2IWQ38RJ4 tag=L7BL3B5XBPNY type=write size=1088764 2024-09-14T11:15:13.442 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:13.444+0000 7f76c1e8a8c0 1 > prepared operation key=SHKU2PRNREKK tag=C8L9Q6BSNOMM type=del size=319397 2024-09-14T11:15:13.444 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:13.448+0000 7f76c1e8a8c0 1 < completed delete operation key=VI61O3K069BP tag=2NH0UDGCEK91 type=del 2024-09-14T11:15:13.447 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:13.448+0000 7f76c1e8a8c0 1 > prepared operation key=BOCIF4TL7X7J tag=N08DU66NG43L type=del size=4133652 2024-09-14T11:15:13.450 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:13.452+0000 7f76c1e8a8c0 1 < completed part key=_multipart_K2EEZLRK7MVO.2~RH3PI80760X1.0 size=1048576 2024-09-14T11:15:13.452 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:13.456+0000 7f76c1e8a8c0 1 < completed part key=_multipart_K2EEZLRK7MVO.2~RH3PI80760X1.1 size=882491 2024-09-14T11:15:13.457 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:13.460+0000 7f76c1e8a8c0 1 < completed multipart upload key=K2EEZLRK7MVO upload=RH3PI80760X1 tag=S1R5O8D0Q7CR type=write size=2979643 2024-09-14T11:15:13.460 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:13.460+0000 7f76c1e8a8c0 1 > prepared operation key=SUNCRV0C1XYL tag=49DBVL2X23AC type=del size=1814902 2024-09-14T11:15:13.465 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:13.468+0000 7f76c1e8a8c0 1 < suggested remove operation key=Q5IY4J5FOD80 tag=0HAMIA7GH1ZZ type=write 2024-09-14T11:15:13.467 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:13.468+0000 7f76c1e8a8c0 1 > prepared operation key=HJ701768A6I7 tag=Q01ST643238Z type=del size=3183460 2024-09-14T11:15:13.470 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:13.472+0000 7f76c1e8a8c0 1 < completed delete operation key=8FFV9G6EQR8F tag=GUK4EM2SL23G type=del 2024-09-14T11:15:13.473 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:13.476+0000 7f76c1e8a8c0 1 > prepared operation key=F3KFS0P1WM7W tag=BL8FXN5K34H7 type=del size=1582529 2024-09-14T11:15:13.476 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:13.480+0000 7f76c1e8a8c0 1 < completed part key=_multipart_KS37ZO6MKAH9.2~T5EHB4SPP9H7.0 size=1048576 2024-09-14T11:15:13.478 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:13.480+0000 7f76c1e8a8c0 1 < completed part key=_multipart_KS37ZO6MKAH9.2~T5EHB4SPP9H7.1 size=500932 2024-09-14T11:15:13.484 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:13.484+0000 7f76c1e8a8c0 1 < completed multipart upload key=KS37ZO6MKAH9 upload=T5EHB4SPP9H7 tag=U4FBOX8IDWTN type=write size=2598084 2024-09-14T11:15:13.487 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:13.488+0000 7f76c1e8a8c0 1 > prepared operation key=LZ0YNFOVFYCL tag=PBWA78TQZ9M2 type=write size=402558 2024-09-14T11:15:13.490 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:13.492+0000 7f76c1e8a8c0 1 < completed delete operation key=W0MDRE9YO3UP tag=RLQWLO0W4FPB type=del 2024-09-14T11:15:13.494 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:13.496+0000 7f76c1e8a8c0 1 > prepared operation key=K2EEZLRK7MVO tag=1IPVCQ8VBUT3 type=del size=1025973 2024-09-14T11:15:13.498 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:13.500+0000 7f76c1e8a8c0 1 < completed part key=_multipart_Q5IY4J5FOD80.2~F6JSLZRR5M4V.0 size=420826 2024-09-14T11:15:13.503 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:13.504+0000 7f76c1e8a8c0 1 < completed multipart upload key=Q5IY4J5FOD80 upload=F6JSLZRR5M4V tag=WIJ55NBUSBYU type=write size=1469402 2024-09-14T11:15:13.507 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:13.508+0000 7f76c1e8a8c0 1 > prepared operation key=H9CQV6L29SL5 tag=NT6M9WYQSEN8 type=write size=922338 2024-09-14T11:15:13.510 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:13.512+0000 7f76c1e8a8c0 1 < completed delete operation key=SUNCRV0C1XYL tag=WQGHVBNHZ0FK type=del 2024-09-14T11:15:13.514 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:13.516+0000 7f76c1e8a8c0 1 > prepared operation key=Q5IY4J5FOD80 tag=8G94M0Q3SHY0 type=del size=258674 2024-09-14T11:15:13.519 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:13.520+0000 7f76c1e8a8c0 1 < completed delete operation key=OOUEM16XL80W tag=BLWRR3CHZ2JH type=del 2024-09-14T11:15:13.524 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:13.528+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_1W5733SDHGDN.2~RQ2C1CL17FPS.0 size=1048576 2024-09-14T11:15:13.527 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:13.528+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_1W5733SDHGDN.2~RQ2C1CL17FPS.1 size=282754 2024-09-14T11:15:13.527 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:13.528+0000 7f76c1e8a8c0 1 > prepared multipart upload key=1W5733SDHGDN upload=RQ2C1CL17FPS tag=D21Q1I9DH487 type=write size=2379906 2024-09-14T11:15:13.529 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:13.532+0000 7f76c1e8a8c0 1 < completed delete operation key=SUNCRV0C1XYL tag=FRJIGK952X9X type=del 2024-09-14T11:15:13.534 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:13.536+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_GAVZRU8ZLW7S.2~3YLZOKGRV3OO.0 size=190392 2024-09-14T11:15:13.534 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:13.536+0000 7f76c1e8a8c0 1 > prepared multipart upload key=GAVZRU8ZLW7S upload=3YLZOKGRV3OO tag=O6ABIDZ2JTKT type=write size=1238968 2024-09-14T11:15:13.537 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:13.540+0000 7f76c1e8a8c0 1 < completed part key=_multipart_Q5IY4J5FOD80.2~CRFZT2ZDS32E.0 size=1048576 2024-09-14T11:15:13.539 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:13.540+0000 7f76c1e8a8c0 1 < completed part key=_multipart_Q5IY4J5FOD80.2~CRFZT2ZDS32E.1 size=1048576 2024-09-14T11:15:13.542 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:13.544+0000 7f76c1e8a8c0 1 < completed part key=_multipart_Q5IY4J5FOD80.2~CRFZT2ZDS32E.2 size=404174 2024-09-14T11:15:13.548 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:13.548+0000 7f76c1e8a8c0 1 < completed multipart upload key=Q5IY4J5FOD80 upload=CRFZT2ZDS32E tag=2SMCNZ3S8IGW type=write size=3549902 2024-09-14T11:15:13.553 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:13.556+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_1W5733SDHGDN.2~JH0462GY1G00.0 size=1048576 2024-09-14T11:15:13.556 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:13.556+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_1W5733SDHGDN.2~JH0462GY1G00.1 size=1048576 2024-09-14T11:15:13.558 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:13.560+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_1W5733SDHGDN.2~JH0462GY1G00.2 size=285921 2024-09-14T11:15:13.558 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:13.560+0000 7f76c1e8a8c0 1 > prepared multipart upload key=1W5733SDHGDN upload=JH0462GY1G00 tag=8TK7P3WZ0F0D type=write size=3431649 2024-09-14T11:15:13.562 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:13.564+0000 7f76c1e8a8c0 1 < completed part key=_multipart_TZO40K6J9877.2~PG2YIIV0RAAZ.0 size=751991 2024-09-14T11:15:13.567 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:13.568+0000 7f76c1e8a8c0 1 < completed multipart upload key=TZO40K6J9877 upload=PG2YIIV0RAAZ tag=UG7WON0MGJS2 type=write size=1800567 2024-09-14T11:15:13.572 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:13.572+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_HJ701768A6I7.2~8Z9WLLZ12ZJL.0 size=1048576 2024-09-14T11:15:13.574 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:13.576+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_HJ701768A6I7.2~8Z9WLLZ12ZJL.1 size=287247 2024-09-14T11:15:13.574 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:13.576+0000 7f76c1e8a8c0 1 > prepared multipart upload key=HJ701768A6I7 upload=8Z9WLLZ12ZJL tag=358F0WZPGPNT type=write size=2384399 2024-09-14T11:15:13.577 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:13.580+0000 7f76c1e8a8c0 -1 < failed to complete operation key=Q5IY4J5FOD80 tag=FYFTLWD2RD96 type=del size=2681813: (22) Invalid argument 2024-09-14T11:15:13.584 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:13.584+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_SUNCRV0C1XYL.2~R5QXTGYSLNDW.0 size=1048576 2024-09-14T11:15:13.586 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:13.588+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_SUNCRV0C1XYL.2~R5QXTGYSLNDW.1 size=1048576 2024-09-14T11:15:13.589 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:13.592+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_SUNCRV0C1XYL.2~R5QXTGYSLNDW.2 size=855455 2024-09-14T11:15:13.589 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:13.592+0000 7f76c1e8a8c0 1 > prepared multipart upload key=SUNCRV0C1XYL upload=R5QXTGYSLNDW tag=6AS48JD0U2DM type=write size=4001183 2024-09-14T11:15:13.592 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:13.596+0000 7f76c1e8a8c0 1 < completed delete operation key=MEVTZ7OAD4CA tag=U3TRFBAL78PV type=del 2024-09-14T11:15:13.596 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:13.596+0000 7f76c1e8a8c0 1 > prepared operation key=OUMUTEBQ1TD0 tag=Q7KNCASOY7PS type=del size=1617555 2024-09-14T11:15:13.599 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:13.600+0000 7f76c1e8a8c0 1 < canceled operation key=F3KFS0P1WM7W tag=VZ4D2BTF21ME type=del size=3631940 2024-09-14T11:15:13.602 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:13.604+0000 7f76c1e8a8c0 1 > prepared operation key=KS37ZO6MKAH9 tag=0EW4VQGDJREN type=del size=3807948 2024-09-14T11:15:13.605 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:13.608+0000 7f76c1e8a8c0 1 < canceled operation key=SHKU2PRNREKK tag=C8L9Q6BSNOMM type=del size=319397 2024-09-14T11:15:13.611 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:13.612+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_GAVZRU8ZLW7S.2~CB3FHTXT82D2.0 size=380094 2024-09-14T11:15:13.611 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:13.612+0000 7f76c1e8a8c0 1 > prepared multipart upload key=GAVZRU8ZLW7S upload=CB3FHTXT82D2 tag=4DQN517QAOMK type=write size=1428670 2024-09-14T11:15:13.614 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:13.616+0000 7f76c1e8a8c0 1 < completed delete operation key=BOCIF4TL7X7J tag=N08DU66NG43L type=del 2024-09-14T11:15:13.617 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:13.620+0000 7f76c1e8a8c0 1 > prepared operation key=OOUEM16XL80W tag=MDCC8B9IRWF3 type=del size=2242482 2024-09-14T11:15:13.623 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:13.624+0000 7f76c1e8a8c0 1 < suggested remove operation key=SUNCRV0C1XYL tag=49DBVL2X23AC type=del 2024-09-14T11:15:13.626 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:13.628+0000 7f76c1e8a8c0 1 > prepared operation key=H9CQV6L29SL5 tag=NSD0EODBL499 type=del size=1340239 2024-09-14T11:15:13.629 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:13.632+0000 7f76c1e8a8c0 1 < completed delete operation key=HJ701768A6I7 tag=Q01ST643238Z type=del 2024-09-14T11:15:13.635 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:13.636+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_8FFV9G6EQR8F.2~9101PV2N63EG.0 size=1048576 2024-09-14T11:15:13.637 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:13.640+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_8FFV9G6EQR8F.2~9101PV2N63EG.1 size=1048576 2024-09-14T11:15:13.639 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:13.640+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_8FFV9G6EQR8F.2~9101PV2N63EG.2 size=753654 2024-09-14T11:15:13.639 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:13.640+0000 7f76c1e8a8c0 1 > prepared multipart upload key=8FFV9G6EQR8F upload=9101PV2N63EG tag=31PCTEDNCKTX type=write size=3899382 2024-09-14T11:15:13.642 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:13.644+0000 7f76c1e8a8c0 1 < completed delete operation key=F3KFS0P1WM7W tag=BL8FXN5K34H7 type=del 2024-09-14T11:15:13.649 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:13.652+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_SUNCRV0C1XYL.2~EYCIU3YWR7E3.0 size=1048576 2024-09-14T11:15:13.651 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:13.652+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_SUNCRV0C1XYL.2~EYCIU3YWR7E3.1 size=1048576 2024-09-14T11:15:13.653 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:13.656+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_SUNCRV0C1XYL.2~EYCIU3YWR7E3.2 size=307456 2024-09-14T11:15:13.653 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:13.656+0000 7f76c1e8a8c0 1 > prepared multipart upload key=SUNCRV0C1XYL upload=EYCIU3YWR7E3 tag=M46KS7DB46GB type=write size=3453184 2024-09-14T11:15:13.659 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:13.660+0000 7f76c1e8a8c0 1 < suggested remove operation key=LZ0YNFOVFYCL tag=PBWA78TQZ9M2 type=write 2024-09-14T11:15:13.662 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:13.664+0000 7f76c1e8a8c0 1 > prepared operation key=BOCIF4TL7X7J tag=P5RI80UDMCK4 type=write size=650032 2024-09-14T11:15:13.665 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:13.668+0000 7f76c1e8a8c0 1 < completed delete operation key=K2EEZLRK7MVO tag=1IPVCQ8VBUT3 type=del 2024-09-14T11:15:13.671 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:13.672+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_GZM0AQVHNCMM.2~4XPRCLRINWQ0.0 size=972511 2024-09-14T11:15:13.671 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:13.672+0000 7f76c1e8a8c0 1 > prepared multipart upload key=GZM0AQVHNCMM upload=4XPRCLRINWQ0 tag=NVLNOB8SZ1OL type=write size=2021087 2024-09-14T11:15:13.674 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:13.676+0000 7f76c1e8a8c0 1 < completed write operation key=H9CQV6L29SL5 tag=NT6M9WYQSEN8 type=write size=922338 2024-09-14T11:15:13.678 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:13.680+0000 7f76c1e8a8c0 1 > prepared operation key=OOUEM16XL80W tag=36Z94UYWO34F type=del size=2047625 2024-09-14T11:15:13.681 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:13.684+0000 7f76c1e8a8c0 1 < canceled operation key=Q5IY4J5FOD80 tag=8G94M0Q3SHY0 type=del size=258674 2024-09-14T11:15:13.685 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:13.688+0000 7f76c1e8a8c0 1 > prepared operation key=GAVZRU8ZLW7S tag=H3LXX3UUXP8N type=del size=1645580 2024-09-14T11:15:13.688 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:13.688+0000 7f76c1e8a8c0 1 < completed part key=_multipart_1W5733SDHGDN.2~RQ2C1CL17FPS.0 size=1048576 2024-09-14T11:15:13.691 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:13.692+0000 7f76c1e8a8c0 1 < completed part key=_multipart_1W5733SDHGDN.2~RQ2C1CL17FPS.1 size=282754 2024-09-14T11:15:13.696 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:13.696+0000 7f76c1e8a8c0 1 < completed multipart upload key=1W5733SDHGDN upload=RQ2C1CL17FPS tag=D21Q1I9DH487 type=write size=2379906 2024-09-14T11:15:13.702 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:13.704+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_K9W031V6BFJP.2~S2OTXL40JF1U.0 size=1048576 2024-09-14T11:15:13.704 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:13.708+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_K9W031V6BFJP.2~S2OTXL40JF1U.1 size=1048576 2024-09-14T11:15:13.707 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:13.708+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_K9W031V6BFJP.2~S2OTXL40JF1U.2 size=937513 2024-09-14T11:15:13.707 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:13.708+0000 7f76c1e8a8c0 1 > prepared multipart upload key=K9W031V6BFJP upload=S2OTXL40JF1U tag=1GFJNRB7G7L7 type=write size=4083241 2024-09-14T11:15:13.711 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:13.712+0000 7f76c1e8a8c0 1 < completed part key=_multipart_GAVZRU8ZLW7S.2~3YLZOKGRV3OO.0 size=190392 2024-09-14T11:15:13.716 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:13.720+0000 7f76c1e8a8c0 1 < completed multipart upload key=GAVZRU8ZLW7S upload=3YLZOKGRV3OO tag=O6ABIDZ2JTKT type=write size=1238968 2024-09-14T11:15:13.723 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:13.724+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_85G6NT78HAWQ.2~HMZKG6UTEHQZ.0 size=1048576 2024-09-14T11:15:13.725 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:13.728+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_85G6NT78HAWQ.2~HMZKG6UTEHQZ.1 size=1048576 2024-09-14T11:15:13.728 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:13.732+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_85G6NT78HAWQ.2~HMZKG6UTEHQZ.2 size=80122 2024-09-14T11:15:13.728 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:13.732+0000 7f76c1e8a8c0 1 > prepared multipart upload key=85G6NT78HAWQ upload=HMZKG6UTEHQZ tag=O7YAK17YSFY7 type=write size=3225850 2024-09-14T11:15:13.729 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:13.732+0000 7f76c1e8a8c0 1 < canceled part key=_multipart_1W5733SDHGDN.2~JH0462GY1G00.0 size=1048576 2024-09-14T11:15:13.731 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:13.732+0000 7f76c1e8a8c0 1 < completed part key=_multipart_1W5733SDHGDN.2~JH0462GY1G00.1 size=1048576 2024-09-14T11:15:13.734 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:13.736+0000 7f76c1e8a8c0 1 < completed part key=_multipart_1W5733SDHGDN.2~JH0462GY1G00.2 size=285921 2024-09-14T11:15:13.739 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:13.740+0000 7f76c1e8a8c0 1 < canceled multipart upload key=1W5733SDHGDN upload=JH0462GY1G00 tag=8TK7P3WZ0F0D type=write size=3431649 2024-09-14T11:15:13.742 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:13.744+0000 7f76c1e8a8c0 1 > prepared operation key=1K8ESNXU6WDF tag=I1KI9LX8I9SI type=write size=525243 2024-09-14T11:15:13.746 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:13.748+0000 7f76c1e8a8c0 1 < completed part key=_multipart_HJ701768A6I7.2~8Z9WLLZ12ZJL.0 size=1048576 2024-09-14T11:15:13.748 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:13.748+0000 7f76c1e8a8c0 1 < completed part key=_multipart_HJ701768A6I7.2~8Z9WLLZ12ZJL.1 size=287247 2024-09-14T11:15:13.753 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:13.756+0000 7f76c1e8a8c0 1 < completed multipart upload key=HJ701768A6I7 upload=8Z9WLLZ12ZJL tag=358F0WZPGPNT type=write size=2384399 2024-09-14T11:15:13.759 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:13.760+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_85G6NT78HAWQ.2~ZI7FYHF4ZDH6.0 size=1048576 2024-09-14T11:15:13.761 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:13.764+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_85G6NT78HAWQ.2~ZI7FYHF4ZDH6.1 size=679797 2024-09-14T11:15:13.761 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:13.764+0000 7f76c1e8a8c0 1 > prepared multipart upload key=85G6NT78HAWQ upload=ZI7FYHF4ZDH6 tag=2E319EH1PRG3 type=write size=2776949 2024-09-14T11:15:13.764 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:13.764+0000 7f76c1e8a8c0 1 < completed part key=_multipart_SUNCRV0C1XYL.2~R5QXTGYSLNDW.0 size=1048576 2024-09-14T11:15:13.767 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:13.768+0000 7f76c1e8a8c0 1 < completed part key=_multipart_SUNCRV0C1XYL.2~R5QXTGYSLNDW.1 size=1048576 2024-09-14T11:15:13.769 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:13.772+0000 7f76c1e8a8c0 1 < completed part key=_multipart_SUNCRV0C1XYL.2~R5QXTGYSLNDW.2 size=855455 2024-09-14T11:15:13.775 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:13.776+0000 7f76c1e8a8c0 1 < completed multipart upload key=SUNCRV0C1XYL upload=R5QXTGYSLNDW tag=6AS48JD0U2DM type=write size=4001183 2024-09-14T11:15:13.778 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:13.780+0000 7f76c1e8a8c0 1 > prepared operation key=KS37ZO6MKAH9 tag=JTAEF5NV712J type=del size=1571923 2024-09-14T11:15:13.781 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:13.784+0000 7f76c1e8a8c0 1 < completed delete operation key=OUMUTEBQ1TD0 tag=Q7KNCASOY7PS type=del 2024-09-14T11:15:13.783 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:13.784+0000 7f76c1e8a8c0 1 > prepared operation key=LZ0YNFOVFYCL tag=MJORN8E6I81B type=del size=863555 2024-09-14T11:15:13.786 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:13.788+0000 7f76c1e8a8c0 1 < completed delete operation key=KS37ZO6MKAH9 tag=0EW4VQGDJREN type=del 2024-09-14T11:15:13.788 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:13.792+0000 7f76c1e8a8c0 1 > prepared operation key=8PZOVFEYYSOG tag=565R71IJG1GI type=del size=2145574 2024-09-14T11:15:13.791 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:13.792+0000 7f76c1e8a8c0 1 < completed part key=_multipart_GAVZRU8ZLW7S.2~CB3FHTXT82D2.0 size=380094 2024-09-14T11:15:13.795 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:13.796+0000 7f76c1e8a8c0 1 < completed multipart upload key=GAVZRU8ZLW7S upload=CB3FHTXT82D2 tag=4DQN517QAOMK type=write size=1428670 2024-09-14T11:15:13.799 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:13.800+0000 7f76c1e8a8c0 1 > prepared operation key=K2EEZLRK7MVO tag=2L9DE9AP6ABS type=del size=618930 2024-09-14T11:15:13.807 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:13.808+0000 7f76c1e8a8c0 1 < suggested remove operation key=OOUEM16XL80W tag=MDCC8B9IRWF3 type=del 2024-09-14T11:15:13.810 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:13.812+0000 7f76c1e8a8c0 1 > prepared operation key=GZM0AQVHNCMM tag=G28JYL22OT0F type=del size=3734542 2024-09-14T11:15:13.814 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:13.816+0000 7f76c1e8a8c0 1 < completed delete operation key=H9CQV6L29SL5 tag=NSD0EODBL499 type=del 2024-09-14T11:15:13.819 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:13.820+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_XC8VWSHZOPFP.2~L3ZN82FB80BX.0 size=1048576 2024-09-14T11:15:13.822 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:13.824+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_XC8VWSHZOPFP.2~L3ZN82FB80BX.1 size=1048576 2024-09-14T11:15:13.825 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:13.828+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_XC8VWSHZOPFP.2~L3ZN82FB80BX.2 size=155475 2024-09-14T11:15:13.825 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:13.828+0000 7f76c1e8a8c0 1 > prepared multipart upload key=XC8VWSHZOPFP upload=L3ZN82FB80BX tag=1JXH4FUJ6W1G type=write size=3301203 2024-09-14T11:15:13.829 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:13.832+0000 7f76c1e8a8c0 1 < completed part key=_multipart_8FFV9G6EQR8F.2~9101PV2N63EG.0 size=1048576 2024-09-14T11:15:13.831 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:13.832+0000 7f76c1e8a8c0 1 < completed part key=_multipart_8FFV9G6EQR8F.2~9101PV2N63EG.1 size=1048576 2024-09-14T11:15:13.834 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:13.836+0000 7f76c1e8a8c0 1 < completed part key=_multipart_8FFV9G6EQR8F.2~9101PV2N63EG.2 size=753654 2024-09-14T11:15:13.840 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:13.840+0000 7f76c1e8a8c0 1 < completed multipart upload key=8FFV9G6EQR8F upload=9101PV2N63EG tag=31PCTEDNCKTX type=write size=3899382 2024-09-14T11:15:13.846 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:13.848+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_15FU4CEGC22Q.2~9XSNYFCUVA6Y.0 size=497161 2024-09-14T11:15:13.846 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:13.848+0000 7f76c1e8a8c0 1 > prepared multipart upload key=15FU4CEGC22Q upload=9XSNYFCUVA6Y tag=G7UD0JHBQ1D2 type=write size=1545737 2024-09-14T11:15:13.849 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:13.852+0000 7f76c1e8a8c0 1 < completed part key=_multipart_SUNCRV0C1XYL.2~EYCIU3YWR7E3.0 size=1048576 2024-09-14T11:15:13.852 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:13.852+0000 7f76c1e8a8c0 1 < completed part key=_multipart_SUNCRV0C1XYL.2~EYCIU3YWR7E3.1 size=1048576 2024-09-14T11:15:13.855 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:13.856+0000 7f76c1e8a8c0 1 < completed part key=_multipart_SUNCRV0C1XYL.2~EYCIU3YWR7E3.2 size=307456 2024-09-14T11:15:13.860 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:13.864+0000 7f76c1e8a8c0 1 < completed multipart upload key=SUNCRV0C1XYL upload=EYCIU3YWR7E3 tag=M46KS7DB46GB type=write size=3453184 2024-09-14T11:15:13.864 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:13.864+0000 7f76c1e8a8c0 1 > prepared operation key=SHKU2PRNREKK tag=1Q2ITUG285ZD type=write size=616627 2024-09-14T11:15:13.868 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:13.868+0000 7f76c1e8a8c0 1 < canceled operation key=BOCIF4TL7X7J tag=P5RI80UDMCK4 type=write size=650032 2024-09-14T11:15:13.872 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:13.876+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_CIRQT9IDJ5OJ.2~SHVH0IVSUJ2P.0 size=1048576 2024-09-14T11:15:13.875 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:13.876+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_CIRQT9IDJ5OJ.2~SHVH0IVSUJ2P.1 size=1048576 2024-09-14T11:15:13.877 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:13.880+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_CIRQT9IDJ5OJ.2~SHVH0IVSUJ2P.2 size=734871 2024-09-14T11:15:13.877 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:13.880+0000 7f76c1e8a8c0 1 > prepared multipart upload key=CIRQT9IDJ5OJ upload=SHVH0IVSUJ2P tag=GTPHUYHCNJOB type=write size=3880599 2024-09-14T11:15:13.880 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:13.884+0000 7f76c1e8a8c0 1 < completed part key=_multipart_GZM0AQVHNCMM.2~4XPRCLRINWQ0.0 size=972511 2024-09-14T11:15:13.886 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:13.888+0000 7f76c1e8a8c0 1 < completed multipart upload key=GZM0AQVHNCMM upload=4XPRCLRINWQ0 tag=NVLNOB8SZ1OL type=write size=2021087 2024-09-14T11:15:13.889 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:13.892+0000 7f76c1e8a8c0 1 > prepared operation key=VI61O3K069BP tag=5HE8GTYCNNG6 type=del size=1507979 2024-09-14T11:15:13.892 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:13.896+0000 7f76c1e8a8c0 -1 < failed to complete operation key=OOUEM16XL80W tag=36Z94UYWO34F type=del size=2047625: (22) Invalid argument 2024-09-14T11:15:13.898 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:13.900+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_CIRQT9IDJ5OJ.2~M85LAVOAV3ZR.0 size=882664 2024-09-14T11:15:13.898 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:13.900+0000 7f76c1e8a8c0 1 > prepared multipart upload key=CIRQT9IDJ5OJ upload=M85LAVOAV3ZR tag=UJOBMRTZQS0J type=write size=1931240 2024-09-14T11:15:13.902 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:13.904+0000 7f76c1e8a8c0 1 < completed delete operation key=GAVZRU8ZLW7S tag=H3LXX3UUXP8N type=del 2024-09-14T11:15:13.905 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:13.908+0000 7f76c1e8a8c0 1 > prepared operation key=VI61O3K069BP tag=ENOVSCJ4R584 type=del size=1228959 2024-09-14T11:15:13.908 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:13.912+0000 7f76c1e8a8c0 1 < completed part key=_multipart_K9W031V6BFJP.2~S2OTXL40JF1U.0 size=1048576 2024-09-14T11:15:13.911 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:13.912+0000 7f76c1e8a8c0 1 < completed part key=_multipart_K9W031V6BFJP.2~S2OTXL40JF1U.1 size=1048576 2024-09-14T11:15:13.913 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:13.916+0000 7f76c1e8a8c0 1 < completed part key=_multipart_K9W031V6BFJP.2~S2OTXL40JF1U.2 size=937513 2024-09-14T11:15:13.918 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:13.920+0000 7f76c1e8a8c0 1 < completed multipart upload key=K9W031V6BFJP upload=S2OTXL40JF1U tag=1GFJNRB7G7L7 type=write size=4083241 2024-09-14T11:15:13.921 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:13.924+0000 7f76c1e8a8c0 1 > prepared operation key=K2EEZLRK7MVO tag=IFS3MHKR47Q7 type=write size=81710 2024-09-14T11:15:13.924 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:13.928+0000 7f76c1e8a8c0 1 < completed part key=_multipart_85G6NT78HAWQ.2~HMZKG6UTEHQZ.0 size=1048576 2024-09-14T11:15:13.927 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:13.928+0000 7f76c1e8a8c0 1 < completed part key=_multipart_85G6NT78HAWQ.2~HMZKG6UTEHQZ.1 size=1048576 2024-09-14T11:15:13.929 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:13.932+0000 7f76c1e8a8c0 1 < completed part key=_multipart_85G6NT78HAWQ.2~HMZKG6UTEHQZ.2 size=80122 2024-09-14T11:15:13.933 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:13.936+0000 7f76c1e8a8c0 1 < completed multipart upload key=85G6NT78HAWQ upload=HMZKG6UTEHQZ tag=O7YAK17YSFY7 type=write size=3225850 2024-09-14T11:15:13.936 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:13.940+0000 7f76c1e8a8c0 1 > prepared operation key=K9W031V6BFJP tag=ZAZYCA1XPLQ0 type=write size=636308 2024-09-14T11:15:13.939 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:13.940+0000 7f76c1e8a8c0 1 < completed write operation key=1K8ESNXU6WDF tag=I1KI9LX8I9SI type=write size=525243 2024-09-14T11:15:13.942 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:13.944+0000 7f76c1e8a8c0 1 > prepared operation key=1K8ESNXU6WDF tag=FFLVAHP1JRHX type=write size=540250 2024-09-14T11:15:13.945 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:13.948+0000 7f76c1e8a8c0 1 < completed part key=_multipart_85G6NT78HAWQ.2~ZI7FYHF4ZDH6.0 size=1048576 2024-09-14T11:15:13.947 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:13.948+0000 7f76c1e8a8c0 1 < completed part key=_multipart_85G6NT78HAWQ.2~ZI7FYHF4ZDH6.1 size=679797 2024-09-14T11:15:13.951 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:13.952+0000 7f76c1e8a8c0 1 < completed multipart upload key=85G6NT78HAWQ upload=ZI7FYHF4ZDH6 tag=2E319EH1PRG3 type=write size=2776949 2024-09-14T11:15:13.954 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:13.956+0000 7f76c1e8a8c0 1 > prepared operation key=R5I9H7WAK7Z7 tag=YUS31NCA3D1P type=write size=958465 2024-09-14T11:15:13.960 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:13.964+0000 7f76c1e8a8c0 1 < suggested update operation key=KS37ZO6MKAH9 tag=JTAEF5NV712J type=del size=1571923 2024-09-14T11:15:13.963 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:13.964+0000 7f76c1e8a8c0 1 > prepared operation key=GAVZRU8ZLW7S tag=3YEZ6KAEQ6LH type=del size=4117291 2024-09-14T11:15:13.968 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:13.972+0000 7f76c1e8a8c0 1 < suggested update operation key=LZ0YNFOVFYCL tag=MJORN8E6I81B type=del size=863555 2024-09-14T11:15:13.971 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:13.972+0000 7f76c1e8a8c0 1 > prepared operation key=HJ701768A6I7 tag=LMXYL1FLB64H type=del size=2789800 2024-09-14T11:15:13.976 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:13.980+0000 7f76c1e8a8c0 1 < suggested update operation key=8PZOVFEYYSOG tag=565R71IJG1GI type=del size=2145574 2024-09-14T11:15:13.979 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:13.980+0000 7f76c1e8a8c0 1 > prepared operation key=6TIJR323NMOH tag=XFY4LFCLZXI5 type=del size=2890143 2024-09-14T11:15:13.982 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:13.984+0000 7f76c1e8a8c0 1 < completed delete operation key=K2EEZLRK7MVO tag=2L9DE9AP6ABS type=del 2024-09-14T11:15:13.985 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:13.988+0000 7f76c1e8a8c0 1 > prepared operation key=KS37ZO6MKAH9 tag=NSOHQ5D3HAOT type=del size=1424441 2024-09-14T11:15:13.988 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:13.988+0000 7f76c1e8a8c0 1 < completed delete operation key=GZM0AQVHNCMM tag=G28JYL22OT0F type=del 2024-09-14T11:15:13.990 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:13.992+0000 7f76c1e8a8c0 1 > prepared operation key=K2EEZLRK7MVO tag=QF42LBDIPZVR type=del size=4059335 2024-09-14T11:15:13.993 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:13.996+0000 7f76c1e8a8c0 1 < completed part key=_multipart_XC8VWSHZOPFP.2~L3ZN82FB80BX.0 size=1048576 2024-09-14T11:15:13.996 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:13.996+0000 7f76c1e8a8c0 1 < completed part key=_multipart_XC8VWSHZOPFP.2~L3ZN82FB80BX.1 size=1048576 2024-09-14T11:15:13.998 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:14.000+0000 7f76c1e8a8c0 1 < completed part key=_multipart_XC8VWSHZOPFP.2~L3ZN82FB80BX.2 size=155475 2024-09-14T11:15:14.003 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:14.004+0000 7f76c1e8a8c0 1 < completed multipart upload key=XC8VWSHZOPFP upload=L3ZN82FB80BX tag=1JXH4FUJ6W1G type=write size=3301203 2024-09-14T11:15:14.009 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:14.012+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_1K8ESNXU6WDF.2~5FRJ3M5KKPPD.0 size=1048576 2024-09-14T11:15:14.011 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:14.012+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_1K8ESNXU6WDF.2~5FRJ3M5KKPPD.1 size=1048576 2024-09-14T11:15:14.014 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:14.016+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_1K8ESNXU6WDF.2~5FRJ3M5KKPPD.2 size=622736 2024-09-14T11:15:14.014 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:14.016+0000 7f76c1e8a8c0 1 > prepared multipart upload key=1K8ESNXU6WDF upload=5FRJ3M5KKPPD tag=DSNHH1HLHIEW type=write size=3768464 2024-09-14T11:15:14.017 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:14.020+0000 7f76c1e8a8c0 1 < completed part key=_multipart_15FU4CEGC22Q.2~9XSNYFCUVA6Y.0 size=497161 2024-09-14T11:15:14.022 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:14.024+0000 7f76c1e8a8c0 1 < completed multipart upload key=15FU4CEGC22Q upload=9XSNYFCUVA6Y tag=G7UD0JHBQ1D2 type=write size=1545737 2024-09-14T11:15:14.028 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:14.028+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_S43U13LYETS4.2~OW2IETEISSWL.0 size=1048576 2024-09-14T11:15:14.031 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:14.032+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_S43U13LYETS4.2~OW2IETEISSWL.1 size=929959 2024-09-14T11:15:14.031 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:14.032+0000 7f76c1e8a8c0 1 > prepared multipart upload key=S43U13LYETS4 upload=OW2IETEISSWL tag=VRMF8HH6N15I type=write size=3027111 2024-09-14T11:15:14.037 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:14.040+0000 7f76c1e8a8c0 1 < suggested remove operation key=SHKU2PRNREKK tag=1Q2ITUG285ZD type=write 2024-09-14T11:15:14.041 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:14.044+0000 7f76c1e8a8c0 1 > prepared operation key=HS7T50JORDQJ tag=QJNAH009KJOJ type=del size=976689 2024-09-14T11:15:14.042 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:14.044+0000 7f76c1e8a8c0 1 < canceled part key=_multipart_CIRQT9IDJ5OJ.2~SHVH0IVSUJ2P.0 size=1048576 2024-09-14T11:15:14.044 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:14.048+0000 7f76c1e8a8c0 1 < completed part key=_multipart_CIRQT9IDJ5OJ.2~SHVH0IVSUJ2P.1 size=1048576 2024-09-14T11:15:14.047 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:14.048+0000 7f76c1e8a8c0 1 < completed part key=_multipart_CIRQT9IDJ5OJ.2~SHVH0IVSUJ2P.2 size=734871 2024-09-14T11:15:14.053 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:14.056+0000 7f76c1e8a8c0 1 < canceled multipart upload key=CIRQT9IDJ5OJ upload=SHVH0IVSUJ2P tag=GTPHUYHCNJOB type=write size=3880599 2024-09-14T11:15:14.056 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:14.056+0000 7f76c1e8a8c0 1 > prepared operation key=W0MDRE9YO3UP tag=HNUIJ6F65Y78 type=del size=758733 2024-09-14T11:15:14.059 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:14.060+0000 7f76c1e8a8c0 1 < completed delete operation key=VI61O3K069BP tag=5HE8GTYCNNG6 type=del 2024-09-14T11:15:14.065 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:14.068+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_MEVTZ7OAD4CA.2~JUR03GGVVFVF.0 size=1048576 2024-09-14T11:15:14.067 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:14.068+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_MEVTZ7OAD4CA.2~JUR03GGVVFVF.1 size=1048576 2024-09-14T11:15:14.072 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:14.072+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_MEVTZ7OAD4CA.2~JUR03GGVVFVF.2 size=783488 2024-09-14T11:15:14.073 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:14.072+0000 7f76c1e8a8c0 1 > prepared multipart upload key=MEVTZ7OAD4CA upload=JUR03GGVVFVF tag=JO33GNS7EGJE type=write size=3929216 2024-09-14T11:15:14.073 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:14.072+0000 7f76c1e8a8c0 1 < canceled part key=_multipart_CIRQT9IDJ5OJ.2~M85LAVOAV3ZR.0 size=882664 2024-09-14T11:15:14.076 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:14.076+0000 7f76c1e8a8c0 1 < canceled multipart upload key=CIRQT9IDJ5OJ upload=M85LAVOAV3ZR tag=UJOBMRTZQS0J type=write size=1931240 2024-09-14T11:15:14.082 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:14.084+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_XC8VWSHZOPFP.2~Z8JJSIAB4PWF.0 size=1048576 2024-09-14T11:15:14.084 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:14.088+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_XC8VWSHZOPFP.2~Z8JJSIAB4PWF.1 size=747834 2024-09-14T11:15:14.084 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:14.088+0000 7f76c1e8a8c0 1 > prepared multipart upload key=XC8VWSHZOPFP upload=Z8JJSIAB4PWF tag=5KYHE0FZ2D4G type=write size=2844986 2024-09-14T11:15:14.090 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:14.092+0000 7f76c1e8a8c0 1 < completed delete operation key=VI61O3K069BP tag=ENOVSCJ4R584 type=del 2024-09-14T11:15:14.095 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:14.096+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_CIRQT9IDJ5OJ.2~2R92D0DERFYN.0 size=1048576 2024-09-14T11:15:14.098 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:14.100+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_CIRQT9IDJ5OJ.2~2R92D0DERFYN.1 size=1048576 2024-09-14T11:15:14.101 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:14.104+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_CIRQT9IDJ5OJ.2~2R92D0DERFYN.2 size=404281 2024-09-14T11:15:14.101 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:14.104+0000 7f76c1e8a8c0 1 > prepared multipart upload key=CIRQT9IDJ5OJ upload=2R92D0DERFYN tag=D31HDMP6PY3Y type=write size=3550009 2024-09-14T11:15:14.104 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:14.104+0000 7f76c1e8a8c0 1 < completed write operation key=K2EEZLRK7MVO tag=IFS3MHKR47Q7 type=write size=81710 2024-09-14T11:15:14.110 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:14.112+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_GZM0AQVHNCMM.2~AI5Z4K630C27.0 size=1048576 2024-09-14T11:15:14.113 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:14.116+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_GZM0AQVHNCMM.2~AI5Z4K630C27.1 size=984366 2024-09-14T11:15:14.113 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:14.116+0000 7f76c1e8a8c0 1 > prepared multipart upload key=GZM0AQVHNCMM upload=AI5Z4K630C27 tag=XOYRHDDTAXCE type=write size=3081518 2024-09-14T11:15:14.116 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:14.116+0000 7f76c1e8a8c0 1 < completed write operation key=K9W031V6BFJP tag=ZAZYCA1XPLQ0 type=write size=636308 2024-09-14T11:15:14.121 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:14.124+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_OOUEM16XL80W.2~W288MTMPOHI5.0 size=1048576 2024-09-14T11:15:14.124 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:14.124+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_OOUEM16XL80W.2~W288MTMPOHI5.1 size=1048576 2024-09-14T11:15:14.126 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:14.128+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_OOUEM16XL80W.2~W288MTMPOHI5.2 size=823290 2024-09-14T11:15:14.126 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:14.128+0000 7f76c1e8a8c0 1 > prepared multipart upload key=OOUEM16XL80W upload=W288MTMPOHI5 tag=KFBALYY24SWD type=write size=3969018 2024-09-14T11:15:14.132 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:14.136+0000 7f76c1e8a8c0 1 < suggested update operation key=1K8ESNXU6WDF tag=FFLVAHP1JRHX type=write size=540250 2024-09-14T11:15:14.138 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:14.140+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_8PZOVFEYYSOG.2~KPY14IGMS0AS.0 size=1048576 2024-09-14T11:15:14.141 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:14.144+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_8PZOVFEYYSOG.2~KPY14IGMS0AS.1 size=320036 2024-09-14T11:15:14.141 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:14.144+0000 7f76c1e8a8c0 1 > prepared multipart upload key=8PZOVFEYYSOG upload=KPY14IGMS0AS tag=5GVYH9G17XMB type=write size=2417188 2024-09-14T11:15:14.144 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:14.144+0000 7f76c1e8a8c0 1 < completed write operation key=R5I9H7WAK7Z7 tag=YUS31NCA3D1P type=write size=958465 2024-09-14T11:15:14.147 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:14.148+0000 7f76c1e8a8c0 1 > prepared operation key=BOCIF4TL7X7J tag=QMG7TOEUCQ2O type=write size=872405 2024-09-14T11:15:14.150 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:14.152+0000 7f76c1e8a8c0 1 < completed delete operation key=GAVZRU8ZLW7S tag=3YEZ6KAEQ6LH type=del 2024-09-14T11:15:14.155 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:14.156+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_GAVZRU8ZLW7S.2~V9ZDFC5ICZ47.0 size=70904 2024-09-14T11:15:14.155 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:14.156+0000 7f76c1e8a8c0 1 > prepared multipart upload key=GAVZRU8ZLW7S upload=V9ZDFC5ICZ47 tag=801I5Z19NDHO type=write size=1119480 2024-09-14T11:15:14.161 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:14.164+0000 7f76c1e8a8c0 1 < suggested update operation key=HJ701768A6I7 tag=LMXYL1FLB64H type=del size=2789800 2024-09-14T11:15:14.165 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:14.168+0000 7f76c1e8a8c0 1 > prepared operation key=8FFV9G6EQR8F tag=UP96PQWEFV9A type=del size=616520 2024-09-14T11:15:14.167 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:14.168+0000 7f76c1e8a8c0 1 < completed delete operation key=6TIJR323NMOH tag=XFY4LFCLZXI5 type=del 2024-09-14T11:15:14.173 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:14.176+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_R5I9H7WAK7Z7.2~81HC23NCPXB7.0 size=1048576 2024-09-14T11:15:14.177 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:14.180+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_R5I9H7WAK7Z7.2~81HC23NCPXB7.1 size=122996 2024-09-14T11:15:14.177 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:14.180+0000 7f76c1e8a8c0 1 > prepared multipart upload key=R5I9H7WAK7Z7 upload=81HC23NCPXB7 tag=GQ3W0JKW67R0 type=write size=2220148 2024-09-14T11:15:14.180 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:14.180+0000 7f76c1e8a8c0 1 < completed delete operation key=KS37ZO6MKAH9 tag=NSOHQ5D3HAOT type=del 2024-09-14T11:15:14.182 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:14.184+0000 7f76c1e8a8c0 1 > prepared operation key=KS37ZO6MKAH9 tag=KX1AN6U9S48A type=write size=493838 2024-09-14T11:15:14.186 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:14.188+0000 7f76c1e8a8c0 1 < completed delete operation key=K2EEZLRK7MVO tag=QF42LBDIPZVR type=del 2024-09-14T11:15:14.189 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:14.192+0000 7f76c1e8a8c0 1 > prepared operation key=BOCIF4TL7X7J tag=MPRUE00DA64A type=del size=1817486 2024-09-14T11:15:14.193 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:14.196+0000 7f76c1e8a8c0 1 < completed part key=_multipart_1K8ESNXU6WDF.2~5FRJ3M5KKPPD.0 size=1048576 2024-09-14T11:15:14.195 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:14.196+0000 7f76c1e8a8c0 1 < completed part key=_multipart_1K8ESNXU6WDF.2~5FRJ3M5KKPPD.1 size=1048576 2024-09-14T11:15:14.198 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:14.200+0000 7f76c1e8a8c0 1 < completed part key=_multipart_1K8ESNXU6WDF.2~5FRJ3M5KKPPD.2 size=622736 2024-09-14T11:15:14.203 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:14.204+0000 7f76c1e8a8c0 1 < completed multipart upload key=1K8ESNXU6WDF upload=5FRJ3M5KKPPD tag=DSNHH1HLHIEW type=write size=3768464 2024-09-14T11:15:14.208 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:14.212+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_K9W031V6BFJP.2~YW5IGIJ7W78E.0 size=1048576 2024-09-14T11:15:14.211 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:14.212+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_K9W031V6BFJP.2~YW5IGIJ7W78E.1 size=1048576 2024-09-14T11:15:14.213 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:14.216+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_K9W031V6BFJP.2~YW5IGIJ7W78E.2 size=731611 2024-09-14T11:15:14.213 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:14.216+0000 7f76c1e8a8c0 1 > prepared multipart upload key=K9W031V6BFJP upload=YW5IGIJ7W78E tag=P50MI80I93OX type=write size=3877339 2024-09-14T11:15:14.216 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:14.220+0000 7f76c1e8a8c0 1 < completed part key=_multipart_S43U13LYETS4.2~OW2IETEISSWL.0 size=1048576 2024-09-14T11:15:14.219 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:14.220+0000 7f76c1e8a8c0 1 < completed part key=_multipart_S43U13LYETS4.2~OW2IETEISSWL.1 size=929959 2024-09-14T11:15:14.224 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:14.224+0000 7f76c1e8a8c0 1 < completed multipart upload key=S43U13LYETS4 upload=OW2IETEISSWL tag=VRMF8HH6N15I type=write size=3027111 2024-09-14T11:15:14.226 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:14.228+0000 7f76c1e8a8c0 1 > prepared operation key=S43U13LYETS4 tag=5AK2NV5XNGFL type=del size=2358647 2024-09-14T11:15:14.229 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:14.232+0000 7f76c1e8a8c0 1 < completed delete operation key=HS7T50JORDQJ tag=QJNAH009KJOJ type=del 2024-09-14T11:15:14.232 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:14.236+0000 7f76c1e8a8c0 1 > prepared operation key=MEVTZ7OAD4CA tag=21HSVRZP87TB type=del size=2912803 2024-09-14T11:15:14.235 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:14.236+0000 7f76c1e8a8c0 1 < canceled operation key=W0MDRE9YO3UP tag=HNUIJ6F65Y78 type=del size=758733 2024-09-14T11:15:14.238 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:14.240+0000 7f76c1e8a8c0 1 > prepared operation key=S43U13LYETS4 tag=HP20SGQLT3J0 type=del size=228942 2024-09-14T11:15:14.241 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:14.244+0000 7f76c1e8a8c0 1 < completed part key=_multipart_MEVTZ7OAD4CA.2~JUR03GGVVFVF.0 size=1048576 2024-09-14T11:15:14.243 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:14.244+0000 7f76c1e8a8c0 1 < completed part key=_multipart_MEVTZ7OAD4CA.2~JUR03GGVVFVF.1 size=1048576 2024-09-14T11:15:14.245 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:14.248+0000 7f76c1e8a8c0 1 < completed part key=_multipart_MEVTZ7OAD4CA.2~JUR03GGVVFVF.2 size=783488 2024-09-14T11:15:14.250 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:14.252+0000 7f76c1e8a8c0 1 < completed multipart upload key=MEVTZ7OAD4CA upload=JUR03GGVVFVF tag=JO33GNS7EGJE type=write size=3929216 2024-09-14T11:15:14.256 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:14.256+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_R5I9H7WAK7Z7.2~ZZX5SAK23CPV.0 size=436669 2024-09-14T11:15:14.256 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:14.256+0000 7f76c1e8a8c0 1 > prepared multipart upload key=R5I9H7WAK7Z7 upload=ZZX5SAK23CPV tag=K1ZUHGQ8BSLF type=write size=1485245 2024-09-14T11:15:14.259 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:14.260+0000 7f76c1e8a8c0 1 < completed part key=_multipart_XC8VWSHZOPFP.2~Z8JJSIAB4PWF.0 size=1048576 2024-09-14T11:15:14.261 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:14.264+0000 7f76c1e8a8c0 1 < completed part key=_multipart_XC8VWSHZOPFP.2~Z8JJSIAB4PWF.1 size=747834 2024-09-14T11:15:14.266 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:14.268+0000 7f76c1e8a8c0 1 < completed multipart upload key=XC8VWSHZOPFP upload=Z8JJSIAB4PWF tag=5KYHE0FZ2D4G type=write size=2844986 2024-09-14T11:15:14.269 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:14.272+0000 7f76c1e8a8c0 1 > prepared operation key=K9W031V6BFJP tag=I4FV0QR7OFM1 type=del size=812150 2024-09-14T11:15:14.269 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:14.272+0000 7f76c1e8a8c0 1 < canceled part key=_multipart_CIRQT9IDJ5OJ.2~2R92D0DERFYN.0 size=1048576 2024-09-14T11:15:14.272 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:14.272+0000 7f76c1e8a8c0 1 < completed part key=_multipart_CIRQT9IDJ5OJ.2~2R92D0DERFYN.1 size=1048576 2024-09-14T11:15:14.274 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:14.276+0000 7f76c1e8a8c0 1 < completed part key=_multipart_CIRQT9IDJ5OJ.2~2R92D0DERFYN.2 size=404281 2024-09-14T11:15:14.279 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:14.280+0000 7f76c1e8a8c0 1 < canceled multipart upload key=CIRQT9IDJ5OJ upload=2R92D0DERFYN tag=D31HDMP6PY3Y type=write size=3550009 2024-09-14T11:15:14.282 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:14.284+0000 7f76c1e8a8c0 1 > prepared operation key=OOUEM16XL80W tag=9TDK1NPAKURD type=del size=751721 2024-09-14T11:15:14.285 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:14.288+0000 7f76c1e8a8c0 1 < completed part key=_multipart_GZM0AQVHNCMM.2~AI5Z4K630C27.0 size=1048576 2024-09-14T11:15:14.288 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:14.288+0000 7f76c1e8a8c0 1 < completed part key=_multipart_GZM0AQVHNCMM.2~AI5Z4K630C27.1 size=984366 2024-09-14T11:15:14.293 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:14.296+0000 7f76c1e8a8c0 1 < completed multipart upload key=GZM0AQVHNCMM upload=AI5Z4K630C27 tag=XOYRHDDTAXCE type=write size=3081518 2024-09-14T11:15:14.296 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:14.300+0000 7f76c1e8a8c0 1 > prepared operation key=1K8ESNXU6WDF tag=8CICT5RM4GYM type=del size=710523 2024-09-14T11:15:14.300 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:14.300+0000 7f76c1e8a8c0 1 < completed part key=_multipart_OOUEM16XL80W.2~W288MTMPOHI5.0 size=1048576 2024-09-14T11:15:14.300 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:14.300+0000 7f76c1e8a8c0 1 < canceled part key=_multipart_OOUEM16XL80W.2~W288MTMPOHI5.1 size=1048576 2024-09-14T11:15:14.303 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:14.304+0000 7f76c1e8a8c0 1 < completed part key=_multipart_OOUEM16XL80W.2~W288MTMPOHI5.2 size=823290 2024-09-14T11:15:14.308 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:14.312+0000 7f76c1e8a8c0 1 < canceled multipart upload key=OOUEM16XL80W upload=W288MTMPOHI5 tag=KFBALYY24SWD type=write size=3969018 2024-09-14T11:15:14.312 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:14.312+0000 7f76c1e8a8c0 1 > prepared operation key=S43U13LYETS4 tag=AAFUBRBJELF6 type=write size=371858 2024-09-14T11:15:14.315 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:14.316+0000 7f76c1e8a8c0 1 < completed part key=_multipart_8PZOVFEYYSOG.2~KPY14IGMS0AS.0 size=1048576 2024-09-14T11:15:14.318 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:14.320+0000 7f76c1e8a8c0 1 < completed part key=_multipart_8PZOVFEYYSOG.2~KPY14IGMS0AS.1 size=320036 2024-09-14T11:15:14.322 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:14.324+0000 7f76c1e8a8c0 1 < completed multipart upload key=8PZOVFEYYSOG upload=KPY14IGMS0AS tag=5GVYH9G17XMB type=write size=2417188 2024-09-14T11:15:14.326 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:14.328+0000 7f76c1e8a8c0 1 > prepared operation key=SHKU2PRNREKK tag=WUV11XMLD5H0 type=write size=128086 2024-09-14T11:15:14.332 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:14.332+0000 7f76c1e8a8c0 1 < suggested remove operation key=BOCIF4TL7X7J tag=QMG7TOEUCQ2O type=write 2024-09-14T11:15:14.335 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:14.336+0000 7f76c1e8a8c0 1 > prepared operation key=SUNCRV0C1XYL tag=34PEORSOT9P9 type=write size=650293 2024-09-14T11:15:14.338 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:14.340+0000 7f76c1e8a8c0 1 < completed part key=_multipart_GAVZRU8ZLW7S.2~V9ZDFC5ICZ47.0 size=70904 2024-09-14T11:15:14.343 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:14.344+0000 7f76c1e8a8c0 1 < completed multipart upload key=GAVZRU8ZLW7S upload=V9ZDFC5ICZ47 tag=801I5Z19NDHO type=write size=1119480 2024-09-14T11:15:14.349 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:14.352+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_MEVTZ7OAD4CA.2~EP223VK5U73R.0 size=983838 2024-09-14T11:15:14.349 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:14.352+0000 7f76c1e8a8c0 1 > prepared multipart upload key=MEVTZ7OAD4CA upload=EP223VK5U73R tag=0PF7O0QML3ME type=write size=2032414 2024-09-14T11:15:14.355 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:14.356+0000 7f76c1e8a8c0 1 < suggested update operation key=8FFV9G6EQR8F tag=UP96PQWEFV9A type=del size=616520 2024-09-14T11:15:14.361 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:14.364+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_VI61O3K069BP.2~335WO3SDFPMJ.0 size=590345 2024-09-14T11:15:14.361 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:14.364+0000 7f76c1e8a8c0 1 > prepared multipart upload key=VI61O3K069BP upload=335WO3SDFPMJ tag=TUXGTR575HFJ type=write size=1638921 2024-09-14T11:15:14.364 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:14.364+0000 7f76c1e8a8c0 1 < completed part key=_multipart_R5I9H7WAK7Z7.2~81HC23NCPXB7.0 size=1048576 2024-09-14T11:15:14.366 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:14.368+0000 7f76c1e8a8c0 1 < completed part key=_multipart_R5I9H7WAK7Z7.2~81HC23NCPXB7.1 size=122996 2024-09-14T11:15:14.375 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:14.376+0000 7f76c1e8a8c0 1 < completed multipart upload key=R5I9H7WAK7Z7 upload=81HC23NCPXB7 tag=GQ3W0JKW67R0 type=write size=2220148 2024-09-14T11:15:14.381 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:14.384+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_F3KFS0P1WM7W.2~1H4B5TOLGW1D.0 size=189379 2024-09-14T11:15:14.381 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:14.384+0000 7f76c1e8a8c0 1 > prepared multipart upload key=F3KFS0P1WM7W upload=1H4B5TOLGW1D tag=KDNQR16VZT7Q type=write size=1237955 2024-09-14T11:15:14.385 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:14.388+0000 7f76c1e8a8c0 1 < completed write operation key=KS37ZO6MKAH9 tag=KX1AN6U9S48A type=write size=493838 2024-09-14T11:15:14.390 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:14.392+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_HS7T50JORDQJ.2~PYDFGGNOMSVO.0 size=1048576 2024-09-14T11:15:14.392 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:14.396+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_HS7T50JORDQJ.2~PYDFGGNOMSVO.1 size=1048576 2024-09-14T11:15:14.395 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:14.396+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_HS7T50JORDQJ.2~PYDFGGNOMSVO.2 size=424604 2024-09-14T11:15:14.395 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:14.396+0000 7f76c1e8a8c0 1 > prepared multipart upload key=HS7T50JORDQJ upload=PYDFGGNOMSVO tag=92HFYXB07E6R type=write size=3570332 2024-09-14T11:15:14.398 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:14.400+0000 7f76c1e8a8c0 -1 < failed to complete operation key=BOCIF4TL7X7J tag=MPRUE00DA64A type=del size=1817486: (22) Invalid argument 2024-09-14T11:15:14.403 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:14.404+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_15FU4CEGC22Q.2~Y3YJ38KDDZ2O.0 size=1048576 2024-09-14T11:15:14.405 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:14.408+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_15FU4CEGC22Q.2~Y3YJ38KDDZ2O.1 size=180432 2024-09-14T11:15:14.405 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:14.408+0000 7f76c1e8a8c0 1 > prepared multipart upload key=15FU4CEGC22Q upload=Y3YJ38KDDZ2O tag=2MSGYHSD1SIK type=write size=2277584 2024-09-14T11:15:14.409 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:14.412+0000 7f76c1e8a8c0 1 < completed part key=_multipart_K9W031V6BFJP.2~YW5IGIJ7W78E.0 size=1048576 2024-09-14T11:15:14.409 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:14.412+0000 7f76c1e8a8c0 1 < canceled part key=_multipart_K9W031V6BFJP.2~YW5IGIJ7W78E.1 size=1048576 2024-09-14T11:15:14.412 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:14.412+0000 7f76c1e8a8c0 1 < completed part key=_multipart_K9W031V6BFJP.2~YW5IGIJ7W78E.2 size=731611 2024-09-14T11:15:14.417 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:14.420+0000 7f76c1e8a8c0 1 < canceled multipart upload key=K9W031V6BFJP upload=YW5IGIJ7W78E tag=P50MI80I93OX type=write size=3877339 2024-09-14T11:15:14.420 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:14.424+0000 7f76c1e8a8c0 1 > prepared operation key=Q5IY4J5FOD80 tag=SMW1PKKCA4R4 type=del size=3573493 2024-09-14T11:15:14.423 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:14.424+0000 7f76c1e8a8c0 1 < completed delete operation key=S43U13LYETS4 tag=5AK2NV5XNGFL type=del 2024-09-14T11:15:14.430 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:14.432+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_XC8VWSHZOPFP.2~33HJ7HG7BIOP.0 size=1048576 2024-09-14T11:15:14.432 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:14.436+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_XC8VWSHZOPFP.2~33HJ7HG7BIOP.1 size=280795 2024-09-14T11:15:14.432 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:14.436+0000 7f76c1e8a8c0 1 > prepared multipart upload key=XC8VWSHZOPFP upload=33HJ7HG7BIOP tag=O9DWCC6GHQ7M type=write size=2377947 2024-09-14T11:15:14.436 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:14.436+0000 7f76c1e8a8c0 1 < canceled operation key=MEVTZ7OAD4CA tag=21HSVRZP87TB type=del size=2912803 2024-09-14T11:15:14.442 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:14.444+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_6TIJR323NMOH.2~DB38FL89ASOT.0 size=383191 2024-09-14T11:15:14.442 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:14.444+0000 7f76c1e8a8c0 1 > prepared multipart upload key=6TIJR323NMOH upload=DB38FL89ASOT tag=PSXU5HDPQG0E type=write size=1431767 2024-09-14T11:15:14.445 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:14.448+0000 7f76c1e8a8c0 1 < canceled operation key=S43U13LYETS4 tag=HP20SGQLT3J0 type=del size=228942 2024-09-14T11:15:14.448 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:14.452+0000 7f76c1e8a8c0 1 > prepared operation key=TUFOZKTV9XIH tag=P2CCOZXOVV2B type=del size=717061 2024-09-14T11:15:14.452 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:14.452+0000 7f76c1e8a8c0 1 < completed part key=_multipart_R5I9H7WAK7Z7.2~ZZX5SAK23CPV.0 size=436669 2024-09-14T11:15:14.458 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:14.460+0000 7f76c1e8a8c0 1 < completed multipart upload key=R5I9H7WAK7Z7 upload=ZZX5SAK23CPV tag=K1ZUHGQ8BSLF type=write size=1485245 2024-09-14T11:15:14.462 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:14.464+0000 7f76c1e8a8c0 1 > prepared operation key=6TIJR323NMOH tag=16AOCL2QR56S type=del size=2940873 2024-09-14T11:15:14.465 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:14.468+0000 7f76c1e8a8c0 1 < completed delete operation key=K9W031V6BFJP tag=I4FV0QR7OFM1 type=del 2024-09-14T11:15:14.469 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:14.472+0000 7f76c1e8a8c0 1 > prepared operation key=OUMUTEBQ1TD0 tag=1Q36PVX1B02L type=del size=1620512 2024-09-14T11:15:14.472 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:14.476+0000 7f76c1e8a8c0 1 < completed delete operation key=OOUEM16XL80W tag=9TDK1NPAKURD type=del 2024-09-14T11:15:14.479 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:14.480+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_K2EEZLRK7MVO.2~88F2K9OMBVWK.0 size=1048576 2024-09-14T11:15:14.482 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:14.484+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_K2EEZLRK7MVO.2~88F2K9OMBVWK.1 size=1033631 2024-09-14T11:15:14.482 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:14.484+0000 7f76c1e8a8c0 1 > prepared multipart upload key=K2EEZLRK7MVO upload=88F2K9OMBVWK tag=1J1L7QXQO52I type=write size=3130783 2024-09-14T11:15:14.485 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:14.488+0000 7f76c1e8a8c0 1 < completed delete operation key=1K8ESNXU6WDF tag=8CICT5RM4GYM type=del 2024-09-14T11:15:14.488 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:14.492+0000 7f76c1e8a8c0 1 > prepared operation key=GZM0AQVHNCMM tag=D7C8MB0SEM3Z type=write size=277488 2024-09-14T11:15:14.492 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:14.492+0000 7f76c1e8a8c0 1 < completed write operation key=S43U13LYETS4 tag=AAFUBRBJELF6 type=write size=371858 2024-09-14T11:15:14.495 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:14.496+0000 7f76c1e8a8c0 1 > prepared operation key=1K8ESNXU6WDF tag=864FSVXCCE9F type=del size=578120 2024-09-14T11:15:14.499 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:14.500+0000 7f76c1e8a8c0 1 < canceled operation key=SHKU2PRNREKK tag=WUV11XMLD5H0 type=write size=128086 2024-09-14T11:15:14.501 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:14.504+0000 7f76c1e8a8c0 1 > prepared operation key=LZ0YNFOVFYCL tag=RTETJ9UTW9KT type=write size=597126 2024-09-14T11:15:14.504 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:14.508+0000 7f76c1e8a8c0 1 < canceled operation key=SUNCRV0C1XYL tag=34PEORSOT9P9 type=write size=650293 2024-09-14T11:15:14.510 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:14.512+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_BOCIF4TL7X7J.2~LND9UMJF5115.0 size=1048576 2024-09-14T11:15:14.512 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:14.516+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_BOCIF4TL7X7J.2~LND9UMJF5115.1 size=1048576 2024-09-14T11:15:14.514 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:14.516+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_BOCIF4TL7X7J.2~LND9UMJF5115.2 size=730982 2024-09-14T11:15:14.515 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:14.516+0000 7f76c1e8a8c0 1 > prepared multipart upload key=BOCIF4TL7X7J upload=LND9UMJF5115 tag=B8H23RWPUD8D type=write size=3876710 2024-09-14T11:15:14.515 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:14.516+0000 7f76c1e8a8c0 1 < canceled part key=_multipart_MEVTZ7OAD4CA.2~EP223VK5U73R.0 size=983838 2024-09-14T11:15:14.520 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:14.520+0000 7f76c1e8a8c0 1 < canceled multipart upload key=MEVTZ7OAD4CA upload=EP223VK5U73R tag=0PF7O0QML3ME type=write size=2032414 2024-09-14T11:15:14.526 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:14.528+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_Q5IY4J5FOD80.2~63DQAB7BO1J9.0 size=487958 2024-09-14T11:15:14.526 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:14.528+0000 7f76c1e8a8c0 1 > prepared multipart upload key=Q5IY4J5FOD80 upload=63DQAB7BO1J9 tag=GC1J4GB0EIWH type=write size=1536534 2024-09-14T11:15:14.526 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:14.528+0000 7f76c1e8a8c0 1 < canceled part key=_multipart_VI61O3K069BP.2~335WO3SDFPMJ.0 size=590345 2024-09-14T11:15:14.532 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:14.532+0000 7f76c1e8a8c0 1 < canceled multipart upload key=VI61O3K069BP upload=335WO3SDFPMJ tag=TUXGTR575HFJ type=write size=1638921 2024-09-14T11:15:14.535 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:14.536+0000 7f76c1e8a8c0 1 > prepared operation key=F3KFS0P1WM7W tag=D4MV9FGPKQ7P type=write size=454174 2024-09-14T11:15:14.538 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:14.540+0000 7f76c1e8a8c0 1 < completed part key=_multipart_F3KFS0P1WM7W.2~1H4B5TOLGW1D.0 size=189379 2024-09-14T11:15:14.544 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:14.544+0000 7f76c1e8a8c0 1 < completed multipart upload key=F3KFS0P1WM7W upload=1H4B5TOLGW1D tag=KDNQR16VZT7Q type=write size=1237955 2024-09-14T11:15:14.547 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:14.548+0000 7f76c1e8a8c0 1 > prepared operation key=GAVZRU8ZLW7S tag=Y4TH1JNBWF95 type=write size=102699 2024-09-14T11:15:14.550 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:14.552+0000 7f76c1e8a8c0 1 < completed part key=_multipart_HS7T50JORDQJ.2~PYDFGGNOMSVO.0 size=1048576 2024-09-14T11:15:14.553 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:14.556+0000 7f76c1e8a8c0 1 < completed part key=_multipart_HS7T50JORDQJ.2~PYDFGGNOMSVO.1 size=1048576 2024-09-14T11:15:14.555 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:14.556+0000 7f76c1e8a8c0 1 < completed part key=_multipart_HS7T50JORDQJ.2~PYDFGGNOMSVO.2 size=424604 2024-09-14T11:15:14.561 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:14.564+0000 7f76c1e8a8c0 1 < completed multipart upload key=HS7T50JORDQJ upload=PYDFGGNOMSVO tag=92HFYXB07E6R type=write size=3570332 2024-09-14T11:15:14.567 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:14.568+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_OOUEM16XL80W.2~S9OQCC9X4NP2.0 size=467954 2024-09-14T11:15:14.567 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:14.568+0000 7f76c1e8a8c0 1 > prepared multipart upload key=OOUEM16XL80W upload=S9OQCC9X4NP2 tag=383BNAFZM9M5 type=write size=1516530 2024-09-14T11:15:14.568 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:14.572+0000 7f76c1e8a8c0 1 < canceled part key=_multipart_15FU4CEGC22Q.2~Y3YJ38KDDZ2O.0 size=1048576 2024-09-14T11:15:14.571 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:14.572+0000 7f76c1e8a8c0 1 < completed part key=_multipart_15FU4CEGC22Q.2~Y3YJ38KDDZ2O.1 size=180432 2024-09-14T11:15:14.577 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:14.580+0000 7f76c1e8a8c0 1 < canceled multipart upload key=15FU4CEGC22Q upload=Y3YJ38KDDZ2O tag=2MSGYHSD1SIK type=write size=2277584 2024-09-14T11:15:14.583 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:14.584+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_HJ701768A6I7.2~EG1UTFQHE004.0 size=499242 2024-09-14T11:15:14.583 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:14.584+0000 7f76c1e8a8c0 1 > prepared multipart upload key=HJ701768A6I7 upload=EG1UTFQHE004 tag=E9KJKIQ658GE type=write size=1547818 2024-09-14T11:15:14.590 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:14.592+0000 7f76c1e8a8c0 1 < suggested update operation key=Q5IY4J5FOD80 tag=SMW1PKKCA4R4 type=del size=3573493 2024-09-14T11:15:14.596 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:14.596+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_OUMUTEBQ1TD0.2~G0AZA5Y93WJY.0 size=1048576 2024-09-14T11:15:14.599 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:14.600+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_OUMUTEBQ1TD0.2~G0AZA5Y93WJY.1 size=1048576 2024-09-14T11:15:14.601 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:14.604+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_OUMUTEBQ1TD0.2~G0AZA5Y93WJY.2 size=530291 2024-09-14T11:15:14.601 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:14.604+0000 7f76c1e8a8c0 1 > prepared multipart upload key=OUMUTEBQ1TD0 upload=G0AZA5Y93WJY tag=HMW4EF03TVF0 type=write size=3676019 2024-09-14T11:15:14.605 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:14.608+0000 7f76c1e8a8c0 1 < completed part key=_multipart_XC8VWSHZOPFP.2~33HJ7HG7BIOP.0 size=1048576 2024-09-14T11:15:14.607 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:14.608+0000 7f76c1e8a8c0 1 < completed part key=_multipart_XC8VWSHZOPFP.2~33HJ7HG7BIOP.1 size=280795 2024-09-14T11:15:14.613 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:14.616+0000 7f76c1e8a8c0 1 < completed multipart upload key=XC8VWSHZOPFP upload=33HJ7HG7BIOP tag=O9DWCC6GHQ7M type=write size=2377947 2024-09-14T11:15:14.616 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:14.620+0000 7f76c1e8a8c0 1 > prepared operation key=S43U13LYETS4 tag=148Y2SUS47E6 type=del size=2908947 2024-09-14T11:15:14.619 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:14.620+0000 7f76c1e8a8c0 1 < completed part key=_multipart_6TIJR323NMOH.2~DB38FL89ASOT.0 size=383191 2024-09-14T11:15:14.624 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:14.628+0000 7f76c1e8a8c0 1 < completed multipart upload key=6TIJR323NMOH upload=DB38FL89ASOT tag=PSXU5HDPQG0E type=write size=1431767 2024-09-14T11:15:14.630 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:14.632+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_1W5733SDHGDN.2~6IXIC6Y3A2CG.0 size=75420 2024-09-14T11:15:14.630 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:14.632+0000 7f76c1e8a8c0 1 > prepared multipart upload key=1W5733SDHGDN upload=6IXIC6Y3A2CG tag=FWPWDK1FRNZQ type=write size=1123996 2024-09-14T11:15:14.637 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:14.640+0000 7f76c1e8a8c0 1 < suggested update operation key=TUFOZKTV9XIH tag=P2CCOZXOVV2B type=del size=717061 2024-09-14T11:15:14.640 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:14.644+0000 7f76c1e8a8c0 1 > prepared operation key=HS7T50JORDQJ tag=ZH5V1I0JLTDR type=del size=1216639 2024-09-14T11:15:14.644 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:14.644+0000 7f76c1e8a8c0 1 < completed delete operation key=6TIJR323NMOH tag=16AOCL2QR56S type=del 2024-09-14T11:15:14.649 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:14.652+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_GZM0AQVHNCMM.2~G6W8ZMNS4RE0.0 size=68117 2024-09-14T11:15:14.649 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:14.652+0000 7f76c1e8a8c0 1 > prepared multipart upload key=GZM0AQVHNCMM upload=G6W8ZMNS4RE0 tag=FEHKCPJ8A08Z type=write size=1116693 2024-09-14T11:15:14.652 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:14.656+0000 7f76c1e8a8c0 1 < completed delete operation key=OUMUTEBQ1TD0 tag=1Q36PVX1B02L type=del 2024-09-14T11:15:14.658 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:14.660+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_1W5733SDHGDN.2~J7DAKDR43ZHP.0 size=267755 2024-09-14T11:15:14.658 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:14.660+0000 7f76c1e8a8c0 1 > prepared multipart upload key=1W5733SDHGDN upload=J7DAKDR43ZHP tag=G67Z17IZP5Z8 type=write size=1316331 2024-09-14T11:15:14.661 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:14.664+0000 7f76c1e8a8c0 1 < completed part key=_multipart_K2EEZLRK7MVO.2~88F2K9OMBVWK.0 size=1048576 2024-09-14T11:15:14.661 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:14.664+0000 7f76c1e8a8c0 1 < canceled part key=_multipart_K2EEZLRK7MVO.2~88F2K9OMBVWK.1 size=1033631 2024-09-14T11:15:14.666 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:14.668+0000 7f76c1e8a8c0 1 < canceled multipart upload key=K2EEZLRK7MVO upload=88F2K9OMBVWK tag=1J1L7QXQO52I type=write size=3130783 2024-09-14T11:15:14.670 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:14.672+0000 7f76c1e8a8c0 1 > prepared operation key=6TIJR323NMOH tag=64N28DNAX711 type=write size=336772 2024-09-14T11:15:14.673 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:14.676+0000 7f76c1e8a8c0 1 < completed write operation key=GZM0AQVHNCMM tag=D7C8MB0SEM3Z type=write size=277488 2024-09-14T11:15:14.682 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:14.684+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_OOUEM16XL80W.2~4T97LX540D32.0 size=1048576 2024-09-14T11:15:14.685 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:14.688+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_OOUEM16XL80W.2~4T97LX540D32.1 size=752007 2024-09-14T11:15:14.685 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:14.688+0000 7f76c1e8a8c0 1 > prepared multipart upload key=OOUEM16XL80W upload=4T97LX540D32 tag=RI9T5NSG6NM4 type=write size=2849159 2024-09-14T11:15:14.688 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:14.692+0000 7f76c1e8a8c0 1 < completed delete operation key=1K8ESNXU6WDF tag=864FSVXCCE9F type=del 2024-09-14T11:15:14.694 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:14.696+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_Q5IY4J5FOD80.2~G5K40MCT8T4H.0 size=32572 2024-09-14T11:15:14.694 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:14.696+0000 7f76c1e8a8c0 1 > prepared multipart upload key=Q5IY4J5FOD80 upload=G5K40MCT8T4H tag=BE2I7OQALFGO type=write size=1081148 2024-09-14T11:15:14.698 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:14.700+0000 7f76c1e8a8c0 1 < completed write operation key=LZ0YNFOVFYCL tag=RTETJ9UTW9KT type=write size=597126 2024-09-14T11:15:14.701 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:14.704+0000 7f76c1e8a8c0 1 > prepared operation key=15FU4CEGC22Q tag=V8VEI0YDIYN0 type=write size=704800 2024-09-14T11:15:14.704 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:14.708+0000 7f76c1e8a8c0 1 < completed part key=_multipart_BOCIF4TL7X7J.2~LND9UMJF5115.0 size=1048576 2024-09-14T11:15:14.707 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:14.708+0000 7f76c1e8a8c0 1 < completed part key=_multipart_BOCIF4TL7X7J.2~LND9UMJF5115.1 size=1048576 2024-09-14T11:15:14.710 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:14.712+0000 7f76c1e8a8c0 1 < completed part key=_multipart_BOCIF4TL7X7J.2~LND9UMJF5115.2 size=730982 2024-09-14T11:15:14.715 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:14.716+0000 7f76c1e8a8c0 1 < completed multipart upload key=BOCIF4TL7X7J upload=LND9UMJF5115 tag=B8H23RWPUD8D type=write size=3876710 2024-09-14T11:15:14.721 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:14.724+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_MEVTZ7OAD4CA.2~UDI9GZ36P3YK.0 size=270441 2024-09-14T11:15:14.721 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:14.724+0000 7f76c1e8a8c0 1 > prepared multipart upload key=MEVTZ7OAD4CA upload=UDI9GZ36P3YK tag=RRTBG1M8DBFB type=write size=1319017 2024-09-14T11:15:14.725 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:14.728+0000 7f76c1e8a8c0 1 < completed part key=_multipart_Q5IY4J5FOD80.2~63DQAB7BO1J9.0 size=487958 2024-09-14T11:15:14.730 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:14.732+0000 7f76c1e8a8c0 1 < completed multipart upload key=Q5IY4J5FOD80 upload=63DQAB7BO1J9 tag=GC1J4GB0EIWH type=write size=1536534 2024-09-14T11:15:14.737 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:14.740+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_SHKU2PRNREKK.2~KUZAHIFUNPY0.0 size=1048576 2024-09-14T11:15:14.808 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:14.740+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_SHKU2PRNREKK.2~KUZAHIFUNPY0.1 size=1030748 2024-09-14T11:15:14.808 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:14.740+0000 7f76c1e8a8c0 1 > prepared multipart upload key=SHKU2PRNREKK upload=KUZAHIFUNPY0 tag=SFKAAOMWLDNZ type=write size=3127900 2024-09-14T11:15:14.808 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:14.744+0000 7f76c1e8a8c0 1 < completed write operation key=F3KFS0P1WM7W tag=D4MV9FGPKQ7P type=write size=454174 2024-09-14T11:15:14.808 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:14.752+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_15FU4CEGC22Q.2~HWZ7WIFGITMG.0 size=627791 2024-09-14T11:15:14.808 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:14.752+0000 7f76c1e8a8c0 1 > prepared multipart upload key=15FU4CEGC22Q upload=HWZ7WIFGITMG tag=SIWLYS4EIWO3 type=write size=1676367 2024-09-14T11:15:14.809 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:14.760+0000 7f76c1e8a8c0 1 < suggested remove operation key=GAVZRU8ZLW7S tag=Y4TH1JNBWF95 type=write 2024-09-14T11:15:14.809 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:14.764+0000 7f76c1e8a8c0 1 > prepared operation key=6TIJR323NMOH tag=CLV5EIC2FX9Y type=del size=2233041 2024-09-14T11:15:14.809 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:14.764+0000 7f76c1e8a8c0 1 < completed part key=_multipart_OOUEM16XL80W.2~S9OQCC9X4NP2.0 size=467954 2024-09-14T11:15:14.809 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:14.772+0000 7f76c1e8a8c0 1 < completed multipart upload key=OOUEM16XL80W upload=S9OQCC9X4NP2 tag=383BNAFZM9M5 type=write size=1516530 2024-09-14T11:15:14.811 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:14.812+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_KS37ZO6MKAH9.2~U0JR3F1X83QQ.0 size=750321 2024-09-14T11:15:14.811 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:14.812+0000 7f76c1e8a8c0 1 > prepared multipart upload key=KS37ZO6MKAH9 upload=U0JR3F1X83QQ tag=AMX6KC0VZAL7 type=write size=1798897 2024-09-14T11:15:14.814 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:14.816+0000 7f76c1e8a8c0 1 < completed part key=_multipart_HJ701768A6I7.2~EG1UTFQHE004.0 size=499242 2024-09-14T11:15:14.821 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:14.824+0000 7f76c1e8a8c0 1 < completed multipart upload key=HJ701768A6I7 upload=EG1UTFQHE004 tag=E9KJKIQ658GE type=write size=1547818 2024-09-14T11:15:14.824 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:14.824+0000 7f76c1e8a8c0 1 > prepared operation key=XC8VWSHZOPFP tag=WIQEJRJGWTWX type=del size=1677970 2024-09-14T11:15:14.827 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:14.828+0000 7f76c1e8a8c0 1 < completed part key=_multipart_OUMUTEBQ1TD0.2~G0AZA5Y93WJY.0 size=1048576 2024-09-14T11:15:14.830 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:14.832+0000 7f76c1e8a8c0 1 < completed part key=_multipart_OUMUTEBQ1TD0.2~G0AZA5Y93WJY.1 size=1048576 2024-09-14T11:15:14.833 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:14.836+0000 7f76c1e8a8c0 1 < completed part key=_multipart_OUMUTEBQ1TD0.2~G0AZA5Y93WJY.2 size=530291 2024-09-14T11:15:14.839 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:14.840+0000 7f76c1e8a8c0 1 < completed multipart upload key=OUMUTEBQ1TD0 upload=G0AZA5Y93WJY tag=HMW4EF03TVF0 type=write size=3676019 2024-09-14T11:15:14.842 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:14.844+0000 7f76c1e8a8c0 1 > prepared operation key=W0MDRE9YO3UP tag=E4H40AFTAYWN type=write size=612714 2024-09-14T11:15:14.846 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:14.848+0000 7f76c1e8a8c0 1 < completed delete operation key=S43U13LYETS4 tag=148Y2SUS47E6 type=del 2024-09-14T11:15:14.850 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:14.852+0000 7f76c1e8a8c0 1 > prepared operation key=6TIJR323NMOH tag=MC3X1YDMFQ17 type=del size=442669 2024-09-14T11:15:14.854 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:14.856+0000 7f76c1e8a8c0 1 < completed part key=_multipart_1W5733SDHGDN.2~6IXIC6Y3A2CG.0 size=75420 2024-09-14T11:15:14.859 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:14.860+0000 7f76c1e8a8c0 1 < completed multipart upload key=1W5733SDHGDN upload=6IXIC6Y3A2CG tag=FWPWDK1FRNZQ type=write size=1123996 2024-09-14T11:15:14.863 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:14.864+0000 7f76c1e8a8c0 1 > prepared operation key=K9W031V6BFJP tag=V6TMCJRY3933 type=del size=1947807 2024-09-14T11:15:14.866 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:14.868+0000 7f76c1e8a8c0 1 < completed delete operation key=HS7T50JORDQJ tag=ZH5V1I0JLTDR type=del 2024-09-14T11:15:14.874 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:14.876+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_K9W031V6BFJP.2~B4J7ZQ5PHKEI.0 size=1048576 2024-09-14T11:15:14.876 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:14.880+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_K9W031V6BFJP.2~B4J7ZQ5PHKEI.1 size=906494 2024-09-14T11:15:14.877 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:14.880+0000 7f76c1e8a8c0 1 > prepared multipart upload key=K9W031V6BFJP upload=B4J7ZQ5PHKEI tag=GK767U8GNK8D type=write size=3003646 2024-09-14T11:15:14.880 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:14.884+0000 7f76c1e8a8c0 1 < completed part key=_multipart_GZM0AQVHNCMM.2~G6W8ZMNS4RE0.0 size=68117 2024-09-14T11:15:14.887 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:14.888+0000 7f76c1e8a8c0 1 < completed multipart upload key=GZM0AQVHNCMM upload=G6W8ZMNS4RE0 tag=FEHKCPJ8A08Z type=write size=1116693 2024-09-14T11:15:14.890 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:14.892+0000 7f76c1e8a8c0 1 > prepared operation key=8FFV9G6EQR8F tag=SO0M7GMFW30Q type=del size=1094685 2024-09-14T11:15:14.894 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:14.896+0000 7f76c1e8a8c0 1 < completed part key=_multipart_1W5733SDHGDN.2~J7DAKDR43ZHP.0 size=267755 2024-09-14T11:15:14.900 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:14.900+0000 7f76c1e8a8c0 1 < completed multipart upload key=1W5733SDHGDN upload=J7DAKDR43ZHP tag=G67Z17IZP5Z8 type=write size=1316331 2024-09-14T11:15:14.907 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:14.908+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_SUNCRV0C1XYL.2~YI3RWPZLLF3F.0 size=1048576 2024-09-14T11:15:14.909 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:14.912+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_SUNCRV0C1XYL.2~YI3RWPZLLF3F.1 size=1048576 2024-09-14T11:15:14.912 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:14.912+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_SUNCRV0C1XYL.2~YI3RWPZLLF3F.2 size=95878 2024-09-14T11:15:14.912 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:14.912+0000 7f76c1e8a8c0 1 > prepared multipart upload key=SUNCRV0C1XYL upload=YI3RWPZLLF3F tag=RLGYRU5NWT5K type=write size=3241606 2024-09-14T11:15:14.915 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:14.916+0000 7f76c1e8a8c0 1 < canceled operation key=6TIJR323NMOH tag=64N28DNAX711 type=write size=336772 2024-09-14T11:15:14.921 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:14.924+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_XC8VWSHZOPFP.2~T5K0AAQ5MDHZ.0 size=1048576 2024-09-14T11:15:14.924 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:14.924+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_XC8VWSHZOPFP.2~T5K0AAQ5MDHZ.1 size=122845 2024-09-14T11:15:14.924 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:14.924+0000 7f76c1e8a8c0 1 > prepared multipart upload key=XC8VWSHZOPFP upload=T5K0AAQ5MDHZ tag=YHYJQHRSMXAC type=write size=2219997 2024-09-14T11:15:14.927 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:14.928+0000 7f76c1e8a8c0 1 < completed part key=_multipart_OOUEM16XL80W.2~4T97LX540D32.0 size=1048576 2024-09-14T11:15:14.929 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:14.932+0000 7f76c1e8a8c0 1 < completed part key=_multipart_OOUEM16XL80W.2~4T97LX540D32.1 size=752007 2024-09-14T11:15:14.934 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:14.936+0000 7f76c1e8a8c0 1 < completed multipart upload key=OOUEM16XL80W upload=4T97LX540D32 tag=RI9T5NSG6NM4 type=write size=2849159 2024-09-14T11:15:14.937 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:14.940+0000 7f76c1e8a8c0 1 > prepared operation key=8PZOVFEYYSOG tag=V2Z9TTDKL440 type=write size=606106 2024-09-14T11:15:14.940 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:14.940+0000 7f76c1e8a8c0 1 < completed part key=_multipart_Q5IY4J5FOD80.2~G5K40MCT8T4H.0 size=32572 2024-09-14T11:15:14.945 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:14.948+0000 7f76c1e8a8c0 1 < completed multipart upload key=Q5IY4J5FOD80 upload=G5K40MCT8T4H tag=BE2I7OQALFGO type=write size=1081148 2024-09-14T11:15:14.950 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:14.952+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_K9W031V6BFJP.2~24131641DT3U.0 size=1048576 2024-09-14T11:15:14.953 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:14.956+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_K9W031V6BFJP.2~24131641DT3U.1 size=1048576 2024-09-14T11:15:14.955 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:14.956+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_K9W031V6BFJP.2~24131641DT3U.2 size=271941 2024-09-14T11:15:14.956 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:14.956+0000 7f76c1e8a8c0 1 > prepared multipart upload key=K9W031V6BFJP upload=24131641DT3U tag=CZQZAV775AHS type=write size=3417669 2024-09-14T11:15:14.962 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:14.964+0000 7f76c1e8a8c0 1 < suggested update operation key=15FU4CEGC22Q tag=V8VEI0YDIYN0 type=write size=704800 2024-09-14T11:15:14.965 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:14.968+0000 7f76c1e8a8c0 1 > prepared operation key=85G6NT78HAWQ tag=FZ3CJAG7NRLX type=del size=264461 2024-09-14T11:15:14.968 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:14.972+0000 7f76c1e8a8c0 1 < completed part key=_multipart_MEVTZ7OAD4CA.2~UDI9GZ36P3YK.0 size=270441 2024-09-14T11:15:14.973 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:14.976+0000 7f76c1e8a8c0 1 < completed multipart upload key=MEVTZ7OAD4CA upload=UDI9GZ36P3YK tag=RRTBG1M8DBFB type=write size=1319017 2024-09-14T11:15:14.979 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:14.980+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_1K8ESNXU6WDF.2~EZFZ44H1SM8P.0 size=1048576 2024-09-14T11:15:14.981 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:14.984+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_1K8ESNXU6WDF.2~EZFZ44H1SM8P.1 size=1048576 2024-09-14T11:15:14.984 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:14.988+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_1K8ESNXU6WDF.2~EZFZ44H1SM8P.2 size=546397 2024-09-14T11:15:14.984 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:14.988+0000 7f76c1e8a8c0 1 > prepared multipart upload key=1K8ESNXU6WDF upload=EZFZ44H1SM8P tag=607210PJSWCV type=write size=3692125 2024-09-14T11:15:14.988 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:14.988+0000 7f76c1e8a8c0 1 < completed part key=_multipart_SHKU2PRNREKK.2~KUZAHIFUNPY0.0 size=1048576 2024-09-14T11:15:14.990 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:14.992+0000 7f76c1e8a8c0 1 < completed part key=_multipart_SHKU2PRNREKK.2~KUZAHIFUNPY0.1 size=1030748 2024-09-14T11:15:14.996 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:15.000+0000 7f76c1e8a8c0 1 < completed multipart upload key=SHKU2PRNREKK upload=KUZAHIFUNPY0 tag=SFKAAOMWLDNZ type=write size=3127900 2024-09-14T11:15:15.002 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:15.004+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_F3KFS0P1WM7W.2~GQRWBUHRUX07.0 size=329950 2024-09-14T11:15:15.002 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:15.004+0000 7f76c1e8a8c0 1 > prepared multipart upload key=F3KFS0P1WM7W upload=GQRWBUHRUX07 tag=N0AGML1QV65O type=write size=1378526 2024-09-14T11:15:15.006 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:15.008+0000 7f76c1e8a8c0 1 < completed part key=_multipart_15FU4CEGC22Q.2~HWZ7WIFGITMG.0 size=627791 2024-09-14T11:15:15.012 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:15.012+0000 7f76c1e8a8c0 1 < completed multipart upload key=15FU4CEGC22Q upload=HWZ7WIFGITMG tag=SIWLYS4EIWO3 type=write size=1676367 2024-09-14T11:15:15.019 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:15.020+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_GAVZRU8ZLW7S.2~7LXCF0OX7J6T.0 size=487262 2024-09-14T11:15:15.019 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:15.020+0000 7f76c1e8a8c0 1 > prepared multipart upload key=GAVZRU8ZLW7S upload=7LXCF0OX7J6T tag=U3MUSKOANFY1 type=write size=1535838 2024-09-14T11:15:15.030 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:15.032+0000 7f76c1e8a8c0 1 < suggested remove operation key=6TIJR323NMOH tag=CLV5EIC2FX9Y type=del 2024-09-14T11:15:15.036 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:15.040+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_HS7T50JORDQJ.2~D7TT46CEDGCQ.0 size=1048576 2024-09-14T11:15:15.039 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:15.040+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_HS7T50JORDQJ.2~D7TT46CEDGCQ.1 size=1048576 2024-09-14T11:15:15.042 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:15.044+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_HS7T50JORDQJ.2~D7TT46CEDGCQ.2 size=804998 2024-09-14T11:15:15.042 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:15.044+0000 7f76c1e8a8c0 1 > prepared multipart upload key=HS7T50JORDQJ upload=D7TT46CEDGCQ tag=9J6ZXFWKT07V type=write size=3950726 2024-09-14T11:15:15.043 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:15.044+0000 7f76c1e8a8c0 1 < canceled part key=_multipart_KS37ZO6MKAH9.2~U0JR3F1X83QQ.0 size=750321 2024-09-14T11:15:15.048 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:15.052+0000 7f76c1e8a8c0 1 < canceled multipart upload key=KS37ZO6MKAH9 upload=U0JR3F1X83QQ tag=AMX6KC0VZAL7 type=write size=1798897 2024-09-14T11:15:15.052 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:15.052+0000 7f76c1e8a8c0 1 > prepared operation key=Q5IY4J5FOD80 tag=LOWK6KSSB364 type=del size=2404107 2024-09-14T11:15:15.056 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:15.056+0000 7f76c1e8a8c0 1 < completed delete operation key=XC8VWSHZOPFP tag=WIQEJRJGWTWX type=del 2024-09-14T11:15:15.059 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:15.060+0000 7f76c1e8a8c0 1 > prepared operation key=CIRQT9IDJ5OJ tag=WK0ERWE58S96 type=del size=2093640 2024-09-14T11:15:15.062 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:15.064+0000 7f76c1e8a8c0 1 < canceled operation key=W0MDRE9YO3UP tag=E4H40AFTAYWN type=write size=612714 2024-09-14T11:15:15.066 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:15.068+0000 7f76c1e8a8c0 1 > prepared operation key=OUMUTEBQ1TD0 tag=5AO4X3NQT87B type=del size=22050 2024-09-14T11:15:15.067 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:15.068+0000 7f76c1e8a8c0 -1 < no bi entry to suggest for operation key=6TIJR323NMOH tag=MC3X1YDMFQ17 type=del size=442669: (2) No such file or directory 2024-09-14T11:15:15.070 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:15.072+0000 7f76c1e8a8c0 1 > prepared operation key=8FFV9G6EQR8F tag=J4L31RBFW9R1 type=del size=917787 2024-09-14T11:15:15.073 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:15.076+0000 7f76c1e8a8c0 1 < completed delete operation key=K9W031V6BFJP tag=V6TMCJRY3933 type=del 2024-09-14T11:15:15.077 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:15.080+0000 7f76c1e8a8c0 1 > prepared operation key=GAVZRU8ZLW7S tag=FMGMN23WD2MY type=del size=2109766 2024-09-14T11:15:15.080 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:15.080+0000 7f76c1e8a8c0 1 < completed part key=_multipart_K9W031V6BFJP.2~B4J7ZQ5PHKEI.0 size=1048576 2024-09-14T11:15:15.083 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:15.084+0000 7f76c1e8a8c0 1 < completed part key=_multipart_K9W031V6BFJP.2~B4J7ZQ5PHKEI.1 size=906494 2024-09-14T11:15:15.089 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:15.092+0000 7f76c1e8a8c0 1 < completed multipart upload key=K9W031V6BFJP upload=B4J7ZQ5PHKEI tag=GK767U8GNK8D type=write size=3003646 2024-09-14T11:15:15.095 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:15.096+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_F3KFS0P1WM7W.2~ESL3HOKS7DTQ.0 size=1048576 2024-09-14T11:15:15.097 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:15.100+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_F3KFS0P1WM7W.2~ESL3HOKS7DTQ.1 size=728182 2024-09-14T11:15:15.097 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:15.100+0000 7f76c1e8a8c0 1 > prepared multipart upload key=F3KFS0P1WM7W upload=ESL3HOKS7DTQ tag=6QPA6JQ2UOTZ type=write size=2825334 2024-09-14T11:15:15.104 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:15.108+0000 7f76c1e8a8c0 1 < suggested remove operation key=8FFV9G6EQR8F tag=SO0M7GMFW30Q type=del 2024-09-14T11:15:15.108 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:15.108+0000 7f76c1e8a8c0 1 > prepared operation key=W0MDRE9YO3UP tag=WW2ALZBGFBBU type=del size=1805296 2024-09-14T11:15:15.111 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:15.112+0000 7f76c1e8a8c0 1 < completed part key=_multipart_SUNCRV0C1XYL.2~YI3RWPZLLF3F.0 size=1048576 2024-09-14T11:15:15.114 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:15.116+0000 7f76c1e8a8c0 1 < completed part key=_multipart_SUNCRV0C1XYL.2~YI3RWPZLLF3F.1 size=1048576 2024-09-14T11:15:15.116 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:15.116+0000 7f76c1e8a8c0 1 < completed part key=_multipart_SUNCRV0C1XYL.2~YI3RWPZLLF3F.2 size=95878 2024-09-14T11:15:15.121 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:15.124+0000 7f76c1e8a8c0 1 < completed multipart upload key=SUNCRV0C1XYL upload=YI3RWPZLLF3F tag=RLGYRU5NWT5K type=write size=3241606 2024-09-14T11:15:15.127 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:15.128+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_R5I9H7WAK7Z7.2~OD40AQO1VD0H.0 size=1048576 2024-09-14T11:15:15.130 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:15.132+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_R5I9H7WAK7Z7.2~OD40AQO1VD0H.1 size=1048576 2024-09-14T11:15:15.132 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:15.132+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_R5I9H7WAK7Z7.2~OD40AQO1VD0H.2 size=13388 2024-09-14T11:15:15.132 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:15.132+0000 7f76c1e8a8c0 1 > prepared multipart upload key=R5I9H7WAK7Z7 upload=OD40AQO1VD0H tag=60YXF5VKNUGA type=write size=3159116 2024-09-14T11:15:15.135 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:15.136+0000 7f76c1e8a8c0 1 < completed part key=_multipart_XC8VWSHZOPFP.2~T5K0AAQ5MDHZ.0 size=1048576 2024-09-14T11:15:15.137 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:15.140+0000 7f76c1e8a8c0 1 < completed part key=_multipart_XC8VWSHZOPFP.2~T5K0AAQ5MDHZ.1 size=122845 2024-09-14T11:15:15.142 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:15.144+0000 7f76c1e8a8c0 1 < completed multipart upload key=XC8VWSHZOPFP upload=T5K0AAQ5MDHZ tag=YHYJQHRSMXAC type=write size=2219997 2024-09-14T11:15:15.147 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:15.148+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_K2EEZLRK7MVO.2~5JNFIJM2IA1L.0 size=1048576 2024-09-14T11:15:15.149 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:15.152+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_K2EEZLRK7MVO.2~5JNFIJM2IA1L.1 size=568592 2024-09-14T11:15:15.150 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:15.152+0000 7f76c1e8a8c0 1 > prepared multipart upload key=K2EEZLRK7MVO upload=5JNFIJM2IA1L tag=CWJ6SBI1FD9A type=write size=2665744 2024-09-14T11:15:15.152 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:15.156+0000 7f76c1e8a8c0 1 < canceled operation key=8PZOVFEYYSOG tag=V2Z9TTDKL440 type=write size=606106 2024-09-14T11:15:15.158 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:15.160+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_LZ0YNFOVFYCL.2~SAN1CBJEA40I.0 size=1048576 2024-09-14T11:15:15.160 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:15.164+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_LZ0YNFOVFYCL.2~SAN1CBJEA40I.1 size=1048576 2024-09-14T11:15:15.163 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:15.164+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_LZ0YNFOVFYCL.2~SAN1CBJEA40I.2 size=917546 2024-09-14T11:15:15.163 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:15.164+0000 7f76c1e8a8c0 1 > prepared multipart upload key=LZ0YNFOVFYCL upload=SAN1CBJEA40I tag=TP5I3X2N3UKM type=write size=4063274 2024-09-14T11:15:15.167 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:15.168+0000 7f76c1e8a8c0 1 < completed part key=_multipart_K9W031V6BFJP.2~24131641DT3U.0 size=1048576 2024-09-14T11:15:15.169 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:15.172+0000 7f76c1e8a8c0 1 < completed part key=_multipart_K9W031V6BFJP.2~24131641DT3U.1 size=1048576 2024-09-14T11:15:15.172 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:15.172+0000 7f76c1e8a8c0 1 < completed part key=_multipart_K9W031V6BFJP.2~24131641DT3U.2 size=271941 2024-09-14T11:15:15.177 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:15.180+0000 7f76c1e8a8c0 1 < completed multipart upload key=K9W031V6BFJP upload=24131641DT3U tag=CZQZAV775AHS type=write size=3417669 2024-09-14T11:15:15.180 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:15.180+0000 7f76c1e8a8c0 1 > prepared operation key=R5I9H7WAK7Z7 tag=WP8FYWP4BI69 type=write size=147340 2024-09-14T11:15:15.186 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:15.188+0000 7f76c1e8a8c0 1 < suggested remove operation key=85G6NT78HAWQ tag=FZ3CJAG7NRLX type=del 2024-09-14T11:15:15.189 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:15.192+0000 7f76c1e8a8c0 1 > prepared operation key=H9CQV6L29SL5 tag=IJRR3J2GCI47 type=del size=1447982 2024-09-14T11:15:15.192 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:15.192+0000 7f76c1e8a8c0 1 < completed part key=_multipart_1K8ESNXU6WDF.2~EZFZ44H1SM8P.0 size=1048576 2024-09-14T11:15:15.194 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:15.196+0000 7f76c1e8a8c0 1 < completed part key=_multipart_1K8ESNXU6WDF.2~EZFZ44H1SM8P.1 size=1048576 2024-09-14T11:15:15.197 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:15.200+0000 7f76c1e8a8c0 1 < completed part key=_multipart_1K8ESNXU6WDF.2~EZFZ44H1SM8P.2 size=546397 2024-09-14T11:15:15.201 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:15.204+0000 7f76c1e8a8c0 1 < completed multipart upload key=1K8ESNXU6WDF upload=EZFZ44H1SM8P tag=607210PJSWCV type=write size=3692125 2024-09-14T11:15:15.204 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:15.208+0000 7f76c1e8a8c0 1 > prepared operation key=LZ0YNFOVFYCL tag=XBG34T8BR8RB type=write size=600611 2024-09-14T11:15:15.205 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:15.208+0000 7f76c1e8a8c0 1 < canceled part key=_multipart_F3KFS0P1WM7W.2~GQRWBUHRUX07.0 size=329950 2024-09-14T11:15:15.210 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:15.212+0000 7f76c1e8a8c0 1 < canceled multipart upload key=F3KFS0P1WM7W upload=GQRWBUHRUX07 tag=N0AGML1QV65O type=write size=1378526 2024-09-14T11:15:15.215 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:15.216+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_H9CQV6L29SL5.2~9CDPRLUNNDXZ.0 size=764723 2024-09-14T11:15:15.215 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:15.216+0000 7f76c1e8a8c0 1 > prepared multipart upload key=H9CQV6L29SL5 upload=9CDPRLUNNDXZ tag=4IW2G5GPW2GS type=write size=1813299 2024-09-14T11:15:15.218 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:15.220+0000 7f76c1e8a8c0 1 < completed part key=_multipart_GAVZRU8ZLW7S.2~7LXCF0OX7J6T.0 size=487262 2024-09-14T11:15:15.223 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:15.224+0000 7f76c1e8a8c0 1 < completed multipart upload key=GAVZRU8ZLW7S upload=7LXCF0OX7J6T tag=U3MUSKOANFY1 type=write size=1535838 2024-09-14T11:15:15.227 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:15.228+0000 7f76c1e8a8c0 1 > prepared operation key=GAVZRU8ZLW7S tag=AKMKQ488MQO5 type=del size=1638018 2024-09-14T11:15:15.230 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:15.232+0000 7f76c1e8a8c0 1 < completed part key=_multipart_HS7T50JORDQJ.2~D7TT46CEDGCQ.0 size=1048576 2024-09-14T11:15:15.230 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:15.232+0000 7f76c1e8a8c0 1 < canceled part key=_multipart_HS7T50JORDQJ.2~D7TT46CEDGCQ.1 size=1048576 2024-09-14T11:15:15.232 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:15.236+0000 7f76c1e8a8c0 1 < completed part key=_multipart_HS7T50JORDQJ.2~D7TT46CEDGCQ.2 size=804998 2024-09-14T11:15:15.237 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:15.240+0000 7f76c1e8a8c0 1 < canceled multipart upload key=HS7T50JORDQJ upload=D7TT46CEDGCQ tag=9J6ZXFWKT07V type=write size=3950726 2024-09-14T11:15:15.243 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:15.244+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_KS37ZO6MKAH9.2~2JW45A9JJSXN.0 size=1048576 2024-09-14T11:15:15.246 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:15.248+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_KS37ZO6MKAH9.2~2JW45A9JJSXN.1 size=1048576 2024-09-14T11:15:15.248 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:15.252+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_KS37ZO6MKAH9.2~2JW45A9JJSXN.2 size=883321 2024-09-14T11:15:15.248 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:15.252+0000 7f76c1e8a8c0 1 > prepared multipart upload key=KS37ZO6MKAH9 upload=2JW45A9JJSXN tag=PFD46VULO8G4 type=write size=4029049 2024-09-14T11:15:15.254 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:15.256+0000 7f76c1e8a8c0 1 < suggested remove operation key=Q5IY4J5FOD80 tag=LOWK6KSSB364 type=del 2024-09-14T11:15:15.257 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:15.260+0000 7f76c1e8a8c0 1 > prepared operation key=Q5IY4J5FOD80 tag=5D8YCIC9FSSE type=del size=594124 2024-09-14T11:15:15.260 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:15.264+0000 7f76c1e8a8c0 1 < canceled operation key=CIRQT9IDJ5OJ tag=WK0ERWE58S96 type=del size=2093640 2024-09-14T11:15:15.263 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:15.264+0000 7f76c1e8a8c0 1 > prepared operation key=TZO40K6J9877 tag=ILQ6KO8GKRIA type=del size=2106545 2024-09-14T11:15:15.266 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:15.268+0000 7f76c1e8a8c0 1 < completed delete operation key=OUMUTEBQ1TD0 tag=5AO4X3NQT87B type=del 2024-09-14T11:15:15.272 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:15.276+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_1W5733SDHGDN.2~3J9V3JYJQ69J.0 size=1048576 2024-09-14T11:15:15.275 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:15.276+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_1W5733SDHGDN.2~3J9V3JYJQ69J.1 size=1048576 2024-09-14T11:15:15.277 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:15.280+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_1W5733SDHGDN.2~3J9V3JYJQ69J.2 size=804379 2024-09-14T11:15:15.277 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:15.280+0000 7f76c1e8a8c0 1 > prepared multipart upload key=1W5733SDHGDN upload=3J9V3JYJQ69J tag=GP15BJDL2O5Z type=write size=3950107 2024-09-14T11:15:15.280 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:15.284+0000 7f76c1e8a8c0 -1 < failed to complete operation key=8FFV9G6EQR8F tag=J4L31RBFW9R1 type=del size=917787: (22) Invalid argument 2024-09-14T11:15:15.283 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:15.284+0000 7f76c1e8a8c0 1 > prepared operation key=GZM0AQVHNCMM tag=TERYCKGWVVLO type=del size=1814215 2024-09-14T11:15:15.286 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:15.288+0000 7f76c1e8a8c0 1 < completed delete operation key=GAVZRU8ZLW7S tag=FMGMN23WD2MY type=del 2024-09-14T11:15:15.289 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:15.292+0000 7f76c1e8a8c0 1 > prepared operation key=1K8ESNXU6WDF tag=Z5R5T31YN950 type=write size=940276 2024-09-14T11:15:15.291 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:15.292+0000 7f76c1e8a8c0 1 < completed part key=_multipart_F3KFS0P1WM7W.2~ESL3HOKS7DTQ.0 size=1048576 2024-09-14T11:15:15.296 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:15.296+0000 7f76c1e8a8c0 1 < completed part key=_multipart_F3KFS0P1WM7W.2~ESL3HOKS7DTQ.1 size=728182 2024-09-14T11:15:15.298 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:15.300+0000 7f76c1e8a8c0 1 < completed multipart upload key=F3KFS0P1WM7W upload=ESL3HOKS7DTQ tag=6QPA6JQ2UOTZ type=write size=2825334 2024-09-14T11:15:15.300 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:15.304+0000 7f76c1e8a8c0 1 > prepared operation key=S43U13LYETS4 tag=8WHR2L8EC0SQ type=del size=3152658 2024-09-14T11:15:15.303 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:15.304+0000 7f76c1e8a8c0 1 < completed delete operation key=W0MDRE9YO3UP tag=WW2ALZBGFBBU type=del 2024-09-14T11:15:15.307 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:15.308+0000 7f76c1e8a8c0 1 > prepared operation key=HS7T50JORDQJ tag=1D3264OW6WRT type=del size=2694 2024-09-14T11:15:15.309 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:15.312+0000 7f76c1e8a8c0 1 < completed part key=_multipart_R5I9H7WAK7Z7.2~OD40AQO1VD0H.0 size=1048576 2024-09-14T11:15:15.315 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:15.316+0000 7f76c1e8a8c0 1 < completed part key=_multipart_R5I9H7WAK7Z7.2~OD40AQO1VD0H.1 size=1048576 2024-09-14T11:15:15.318 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:15.320+0000 7f76c1e8a8c0 1 < completed part key=_multipart_R5I9H7WAK7Z7.2~OD40AQO1VD0H.2 size=13388 2024-09-14T11:15:15.323 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:15.324+0000 7f76c1e8a8c0 1 < completed multipart upload key=R5I9H7WAK7Z7 upload=OD40AQO1VD0H tag=60YXF5VKNUGA type=write size=3159116 2024-09-14T11:15:15.329 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:15.332+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_SHKU2PRNREKK.2~RKLLO6MF6FH8.0 size=1048576 2024-09-14T11:15:15.332 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:15.332+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_SHKU2PRNREKK.2~RKLLO6MF6FH8.1 size=397342 2024-09-14T11:15:15.332 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:15.332+0000 7f76c1e8a8c0 1 > prepared multipart upload key=SHKU2PRNREKK upload=RKLLO6MF6FH8 tag=B5D1QQV2OIVI type=write size=2494494 2024-09-14T11:15:15.336 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:15.336+0000 7f76c1e8a8c0 1 < completed part key=_multipart_K2EEZLRK7MVO.2~5JNFIJM2IA1L.0 size=1048576 2024-09-14T11:15:15.336 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:15.336+0000 7f76c1e8a8c0 1 < canceled part key=_multipart_K2EEZLRK7MVO.2~5JNFIJM2IA1L.1 size=568592 2024-09-14T11:15:15.341 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:15.344+0000 7f76c1e8a8c0 1 < canceled multipart upload key=K2EEZLRK7MVO upload=5JNFIJM2IA1L tag=CWJ6SBI1FD9A type=write size=2665744 2024-09-14T11:15:15.344 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:15.348+0000 7f76c1e8a8c0 1 > prepared operation key=GAVZRU8ZLW7S tag=7FYYS3M3F5S8 type=del size=1169469 2024-09-14T11:15:15.345 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:15.348+0000 7f76c1e8a8c0 1 < canceled part key=_multipart_LZ0YNFOVFYCL.2~SAN1CBJEA40I.0 size=1048576 2024-09-14T11:15:15.348 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:15.348+0000 7f76c1e8a8c0 1 < completed part key=_multipart_LZ0YNFOVFYCL.2~SAN1CBJEA40I.1 size=1048576 2024-09-14T11:15:15.348 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:15.348+0000 7f76c1e8a8c0 1 < canceled part key=_multipart_LZ0YNFOVFYCL.2~SAN1CBJEA40I.2 size=917546 2024-09-14T11:15:15.353 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:15.356+0000 7f76c1e8a8c0 1 < canceled multipart upload key=LZ0YNFOVFYCL upload=SAN1CBJEA40I tag=TP5I3X2N3UKM type=write size=4063274 2024-09-14T11:15:15.357 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:15.360+0000 7f76c1e8a8c0 1 > prepared operation key=SUNCRV0C1XYL tag=OLEM5ZZQ76L1 type=del size=1233004 2024-09-14T11:15:15.363 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:15.364+0000 7f76c1e8a8c0 1 < suggested update operation key=R5I9H7WAK7Z7 tag=WP8FYWP4BI69 type=write size=147340 2024-09-14T11:15:15.366 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:15.368+0000 7f76c1e8a8c0 1 > prepared operation key=TUFOZKTV9XIH tag=65KCLHOALQPN type=del size=3326078 2024-09-14T11:15:15.369 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:15.372+0000 7f76c1e8a8c0 1 < completed delete operation key=H9CQV6L29SL5 tag=IJRR3J2GCI47 type=del 2024-09-14T11:15:15.373 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:15.376+0000 7f76c1e8a8c0 1 > prepared operation key=F3KFS0P1WM7W tag=N31J3PYEL6WJ type=del size=1419371 2024-09-14T11:15:15.376 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:15.376+0000 7f76c1e8a8c0 1 < completed write operation key=LZ0YNFOVFYCL tag=XBG34T8BR8RB type=write size=600611 2024-09-14T11:15:15.379 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:15.380+0000 7f76c1e8a8c0 1 > prepared operation key=MEVTZ7OAD4CA tag=HFKT9UH01Z6M type=del size=3104921 2024-09-14T11:15:15.382 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:15.384+0000 7f76c1e8a8c0 1 < completed part key=_multipart_H9CQV6L29SL5.2~9CDPRLUNNDXZ.0 size=764723 2024-09-14T11:15:15.387 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:15.388+0000 7f76c1e8a8c0 1 < completed multipart upload key=H9CQV6L29SL5 upload=9CDPRLUNNDXZ tag=4IW2G5GPW2GS type=write size=1813299 2024-09-14T11:15:15.390 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:15.392+0000 7f76c1e8a8c0 1 > prepared operation key=K9W031V6BFJP tag=OR6BRBEBMCTJ type=del size=3065825 2024-09-14T11:15:15.393 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:15.396+0000 7f76c1e8a8c0 1 < canceled operation key=GAVZRU8ZLW7S tag=AKMKQ488MQO5 type=del size=1638018 2024-09-14T11:15:15.398 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:15.400+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_F3KFS0P1WM7W.2~DBFPKLP7YZY7.0 size=287502 2024-09-14T11:15:15.399 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:15.400+0000 7f76c1e8a8c0 1 > prepared multipart upload key=F3KFS0P1WM7W upload=DBFPKLP7YZY7 tag=QIIGNOE7L1HA type=write size=1336078 2024-09-14T11:15:15.401 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:15.404+0000 7f76c1e8a8c0 1 < completed part key=_multipart_KS37ZO6MKAH9.2~2JW45A9JJSXN.0 size=1048576 2024-09-14T11:15:15.404 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:15.404+0000 7f76c1e8a8c0 1 < completed part key=_multipart_KS37ZO6MKAH9.2~2JW45A9JJSXN.1 size=1048576 2024-09-14T11:15:15.406 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:15.408+0000 7f76c1e8a8c0 1 < completed part key=_multipart_KS37ZO6MKAH9.2~2JW45A9JJSXN.2 size=883321 2024-09-14T11:15:15.411 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:15.412+0000 7f76c1e8a8c0 1 < completed multipart upload key=KS37ZO6MKAH9 upload=2JW45A9JJSXN tag=PFD46VULO8G4 type=write size=4029049 2024-09-14T11:15:15.414 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:15.416+0000 7f76c1e8a8c0 1 > prepared operation key=S43U13LYETS4 tag=OOJGZ2SWNDQL type=del size=2634274 2024-09-14T11:15:15.420 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:15.424+0000 7f76c1e8a8c0 1 < suggested update operation key=Q5IY4J5FOD80 tag=5D8YCIC9FSSE type=del size=594124 2024-09-14T11:15:15.423 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:15.424+0000 7f76c1e8a8c0 1 > prepared operation key=GAVZRU8ZLW7S tag=OR9QM63ZRFYF type=del size=2964490 2024-09-14T11:15:15.426 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:15.428+0000 7f76c1e8a8c0 1 < completed delete operation key=TZO40K6J9877 tag=ILQ6KO8GKRIA type=del 2024-09-14T11:15:15.432 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:15.432+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_85G6NT78HAWQ.2~IYX8Y68AY489.0 size=1026280 2024-09-14T11:15:15.432 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:15.432+0000 7f76c1e8a8c0 1 > prepared multipart upload key=85G6NT78HAWQ upload=IYX8Y68AY489 tag=J49AZ435DIXG type=write size=2074856 2024-09-14T11:15:15.435 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:15.436+0000 7f76c1e8a8c0 1 < completed part key=_multipart_1W5733SDHGDN.2~3J9V3JYJQ69J.0 size=1048576 2024-09-14T11:15:15.438 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:15.440+0000 7f76c1e8a8c0 1 < completed part key=_multipart_1W5733SDHGDN.2~3J9V3JYJQ69J.1 size=1048576 2024-09-14T11:15:15.440 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:15.444+0000 7f76c1e8a8c0 1 < completed part key=_multipart_1W5733SDHGDN.2~3J9V3JYJQ69J.2 size=804379 2024-09-14T11:15:15.446 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:15.448+0000 7f76c1e8a8c0 1 < completed multipart upload key=1W5733SDHGDN upload=3J9V3JYJQ69J tag=GP15BJDL2O5Z type=write size=3950107 2024-09-14T11:15:15.451 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:15.452+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_R5I9H7WAK7Z7.2~DDRTQVJH0YSO.0 size=1048576 2024-09-14T11:15:15.454 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:15.456+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_R5I9H7WAK7Z7.2~DDRTQVJH0YSO.1 size=783599 2024-09-14T11:15:15.454 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:15.456+0000 7f76c1e8a8c0 1 > prepared multipart upload key=R5I9H7WAK7Z7 upload=DDRTQVJH0YSO tag=2QLHUMFCD8BG type=write size=2880751 2024-09-14T11:15:15.457 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:15.460+0000 7f76c1e8a8c0 1 < completed delete operation key=GZM0AQVHNCMM tag=TERYCKGWVVLO type=del 2024-09-14T11:15:15.460 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:15.460+0000 7f76c1e8a8c0 1 > prepared operation key=1K8ESNXU6WDF tag=YJUO03QCWVZT type=del size=3009527 2024-09-14T11:15:15.463 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:15.464+0000 7f76c1e8a8c0 1 < completed write operation key=1K8ESNXU6WDF tag=Z5R5T31YN950 type=write size=940276 2024-09-14T11:15:15.467 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:15.468+0000 7f76c1e8a8c0 1 > prepared operation key=GZM0AQVHNCMM tag=76R7RBWC0WHQ type=del size=1478275 2024-09-14T11:15:15.469 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:15.472+0000 7f76c1e8a8c0 1 < canceled operation key=S43U13LYETS4 tag=8WHR2L8EC0SQ type=del size=3152658 2024-09-14T11:15:15.473 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:15.476+0000 7f76c1e8a8c0 1 > prepared operation key=R5I9H7WAK7Z7 tag=ARVMWVS014Q1 type=del size=865379 2024-09-14T11:15:15.477 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:15.480+0000 7f76c1e8a8c0 1 < completed delete operation key=HS7T50JORDQJ tag=1D3264OW6WRT type=del 2024-09-14T11:15:15.483 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:15.484+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_6TIJR323NMOH.2~JA4FU3A85VGP.0 size=1048576 2024-09-14T11:15:15.486 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:15.488+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_6TIJR323NMOH.2~JA4FU3A85VGP.1 size=259961 2024-09-14T11:15:15.486 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:15.488+0000 7f76c1e8a8c0 1 > prepared multipart upload key=6TIJR323NMOH upload=JA4FU3A85VGP tag=CL1BFAY254GA type=write size=2357113 2024-09-14T11:15:15.490 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:15.492+0000 7f76c1e8a8c0 1 < completed part key=_multipart_SHKU2PRNREKK.2~RKLLO6MF6FH8.0 size=1048576 2024-09-14T11:15:15.493 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:15.496+0000 7f76c1e8a8c0 1 < completed part key=_multipart_SHKU2PRNREKK.2~RKLLO6MF6FH8.1 size=397342 2024-09-14T11:15:15.500 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:15.500+0000 7f76c1e8a8c0 1 < completed multipart upload key=SHKU2PRNREKK upload=RKLLO6MF6FH8 tag=B5D1QQV2OIVI type=write size=2494494 2024-09-14T11:15:15.502 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:15.504+0000 7f76c1e8a8c0 1 > prepared operation key=K9W031V6BFJP tag=K82RC92Q5AT2 type=del size=1210155 2024-09-14T11:15:15.506 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:15.508+0000 7f76c1e8a8c0 1 < completed delete operation key=GAVZRU8ZLW7S tag=7FYYS3M3F5S8 type=del 2024-09-14T11:15:15.510 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:15.512+0000 7f76c1e8a8c0 1 > prepared operation key=K9W031V6BFJP tag=I7NXLMVZ271L type=del size=510828 2024-09-14T11:15:15.513 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:15.516+0000 7f76c1e8a8c0 1 < completed delete operation key=SUNCRV0C1XYL tag=OLEM5ZZQ76L1 type=del 2024-09-14T11:15:15.516 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:15.520+0000 7f76c1e8a8c0 1 > prepared operation key=HS7T50JORDQJ tag=P7KH4I8HU6UF type=del size=1763597 2024-09-14T11:15:15.523 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:15.524+0000 7f76c1e8a8c0 1 < suggested update operation key=TUFOZKTV9XIH tag=65KCLHOALQPN type=del size=3326078 2024-09-14T11:15:15.526 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:15.528+0000 7f76c1e8a8c0 1 > prepared operation key=HJ701768A6I7 tag=WP08ZDZGSRXJ type=del size=1587132 2024-09-14T11:15:15.529 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:15.532+0000 7f76c1e8a8c0 1 < completed delete operation key=F3KFS0P1WM7W tag=N31J3PYEL6WJ type=del 2024-09-14T11:15:15.535 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:15.536+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_XC8VWSHZOPFP.2~FC80DBI2ZZQE.0 size=1048576 2024-09-14T11:15:15.538 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:15.540+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_XC8VWSHZOPFP.2~FC80DBI2ZZQE.1 size=1048576 2024-09-14T11:15:15.541 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:15.544+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_XC8VWSHZOPFP.2~FC80DBI2ZZQE.2 size=141593 2024-09-14T11:15:15.541 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:15.544+0000 7f76c1e8a8c0 1 > prepared multipart upload key=XC8VWSHZOPFP upload=FC80DBI2ZZQE tag=5QVS8VCDO35V type=write size=3287321 2024-09-14T11:15:15.544 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:15.548+0000 7f76c1e8a8c0 1 < completed delete operation key=MEVTZ7OAD4CA tag=HFKT9UH01Z6M type=del 2024-09-14T11:15:15.547 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:15.548+0000 7f76c1e8a8c0 1 > prepared operation key=8PZOVFEYYSOG tag=LEGK6JADV9CS type=del size=3673950 2024-09-14T11:15:15.554 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:15.556+0000 7f76c1e8a8c0 1 < suggested update operation key=K9W031V6BFJP tag=OR6BRBEBMCTJ type=del size=3065825 2024-09-14T11:15:15.558 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:15.560+0000 7f76c1e8a8c0 1 > prepared operation key=R5I9H7WAK7Z7 tag=9249ZE4O4KJJ type=del size=946024 2024-09-14T11:15:15.561 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:15.564+0000 7f76c1e8a8c0 1 < completed part key=_multipart_F3KFS0P1WM7W.2~DBFPKLP7YZY7.0 size=287502 2024-09-14T11:15:15.567 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:15.568+0000 7f76c1e8a8c0 1 < completed multipart upload key=F3KFS0P1WM7W upload=DBFPKLP7YZY7 tag=QIIGNOE7L1HA type=write size=1336078 2024-09-14T11:15:15.570 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:15.572+0000 7f76c1e8a8c0 1 > prepared operation key=W0MDRE9YO3UP tag=QI52J4G4DH8N type=del size=2182455 2024-09-14T11:15:15.577 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:15.580+0000 7f76c1e8a8c0 1 < suggested remove operation key=S43U13LYETS4 tag=OOJGZ2SWNDQL type=del 2024-09-14T11:15:15.579 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:15.580+0000 7f76c1e8a8c0 1 > prepared operation key=VI61O3K069BP tag=QE849TIAQPKU type=del size=699975 2024-09-14T11:15:15.583 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:15.584+0000 7f76c1e8a8c0 1 < completed delete operation key=GAVZRU8ZLW7S tag=OR9QM63ZRFYF type=del 2024-09-14T11:15:15.586 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:15.588+0000 7f76c1e8a8c0 1 > prepared operation key=H9CQV6L29SL5 tag=RY5I6AMD12S5 type=del size=1958062 2024-09-14T11:15:15.589 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:15.592+0000 7f76c1e8a8c0 1 < completed part key=_multipart_85G6NT78HAWQ.2~IYX8Y68AY489.0 size=1026280 2024-09-14T11:15:15.594 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:15.596+0000 7f76c1e8a8c0 1 < completed multipart upload key=85G6NT78HAWQ upload=IYX8Y68AY489 tag=J49AZ435DIXG type=write size=2074856 2024-09-14T11:15:15.601 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:15.604+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_W0MDRE9YO3UP.2~NDGTWYAQ5HDM.0 size=1048576 2024-09-14T11:15:15.604 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:15.604+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_W0MDRE9YO3UP.2~NDGTWYAQ5HDM.1 size=1048576 2024-09-14T11:15:15.607 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:15.608+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_W0MDRE9YO3UP.2~NDGTWYAQ5HDM.2 size=587783 2024-09-14T11:15:15.607 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:15.608+0000 7f76c1e8a8c0 1 > prepared multipart upload key=W0MDRE9YO3UP upload=NDGTWYAQ5HDM tag=M51EPCBZWMDP type=write size=3733511 2024-09-14T11:15:15.611 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:15.612+0000 7f76c1e8a8c0 1 < completed part key=_multipart_R5I9H7WAK7Z7.2~DDRTQVJH0YSO.0 size=1048576 2024-09-14T11:15:15.613 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:15.616+0000 7f76c1e8a8c0 1 < completed part key=_multipart_R5I9H7WAK7Z7.2~DDRTQVJH0YSO.1 size=783599 2024-09-14T11:15:15.621 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:15.624+0000 7f76c1e8a8c0 1 < completed multipart upload key=R5I9H7WAK7Z7 upload=DDRTQVJH0YSO tag=2QLHUMFCD8BG type=write size=2880751 2024-09-14T11:15:15.625 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:15.628+0000 7f76c1e8a8c0 1 > prepared operation key=8PZOVFEYYSOG tag=HMXN6F70LNO2 type=del size=1650704 2024-09-14T11:15:15.628 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:15.628+0000 7f76c1e8a8c0 1 < completed delete operation key=1K8ESNXU6WDF tag=YJUO03QCWVZT type=del 2024-09-14T11:15:15.631 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:15.632+0000 7f76c1e8a8c0 1 > prepared operation key=15FU4CEGC22Q tag=IAWVKRI4C35W type=del size=772040 2024-09-14T11:15:15.635 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:15.636+0000 7f76c1e8a8c0 1 < completed delete operation key=GZM0AQVHNCMM tag=76R7RBWC0WHQ type=del 2024-09-14T11:15:15.641 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:15.644+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_MEVTZ7OAD4CA.2~GV3E0J3QB17W.0 size=1048576 2024-09-14T11:15:15.645 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:15.648+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_MEVTZ7OAD4CA.2~GV3E0J3QB17W.1 size=702481 2024-09-14T11:15:15.645 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:15.648+0000 7f76c1e8a8c0 1 > prepared multipart upload key=MEVTZ7OAD4CA upload=GV3E0J3QB17W tag=TQYBLR4UTS22 type=write size=2799633 2024-09-14T11:15:15.648 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:15.652+0000 7f76c1e8a8c0 1 < completed delete operation key=R5I9H7WAK7Z7 tag=ARVMWVS014Q1 type=del 2024-09-14T11:15:15.651 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:15.652+0000 7f76c1e8a8c0 1 > prepared operation key=BOCIF4TL7X7J tag=JE51NIBBTYRX type=write size=748589 2024-09-14T11:15:15.654 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:15.656+0000 7f76c1e8a8c0 1 < completed part key=_multipart_6TIJR323NMOH.2~JA4FU3A85VGP.0 size=1048576 2024-09-14T11:15:15.657 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:15.660+0000 7f76c1e8a8c0 1 < completed part key=_multipart_6TIJR323NMOH.2~JA4FU3A85VGP.1 size=259961 2024-09-14T11:15:15.661 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:15.664+0000 7f76c1e8a8c0 1 < completed multipart upload key=6TIJR323NMOH upload=JA4FU3A85VGP tag=CL1BFAY254GA type=write size=2357113 2024-09-14T11:15:15.667 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:15.668+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_TZO40K6J9877.2~91Z5N386Z7OR.0 size=1048576 2024-09-14T11:15:15.669 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:15.672+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_TZO40K6J9877.2~91Z5N386Z7OR.1 size=500755 2024-09-14T11:15:15.670 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:15.672+0000 7f76c1e8a8c0 1 > prepared multipart upload key=TZO40K6J9877 upload=91Z5N386Z7OR tag=VKGI69NEPA4M type=write size=2597907 2024-09-14T11:15:15.673 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:15.676+0000 7f76c1e8a8c0 -1 < failed to complete operation key=K9W031V6BFJP tag=K82RC92Q5AT2 type=del size=1210155: (22) Invalid argument 2024-09-14T11:15:15.676 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:15.676+0000 7f76c1e8a8c0 1 > prepared operation key=85G6NT78HAWQ tag=YP6HCCPDJGDK type=del size=290446 2024-09-14T11:15:15.678 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:15.680+0000 7f76c1e8a8c0 -1 < failed to complete operation key=K9W031V6BFJP tag=I7NXLMVZ271L type=del size=510828: (22) Invalid argument 2024-09-14T11:15:15.681 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:15.684+0000 7f76c1e8a8c0 1 > prepared operation key=TUFOZKTV9XIH tag=RZXNND0EQL9B type=del size=4046260 2024-09-14T11:15:15.686 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:15.688+0000 7f76c1e8a8c0 1 < suggested update operation key=HS7T50JORDQJ tag=P7KH4I8HU6UF type=del size=1763597 2024-09-14T11:15:15.689 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:15.692+0000 7f76c1e8a8c0 1 > prepared operation key=R5I9H7WAK7Z7 tag=PC8XRJEKV0DH type=del size=2931523 2024-09-14T11:15:15.692 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:15.692+0000 7f76c1e8a8c0 1 < completed delete operation key=HJ701768A6I7 tag=WP08ZDZGSRXJ type=del 2024-09-14T11:15:15.694 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:15.696+0000 7f76c1e8a8c0 1 > prepared operation key=H9CQV6L29SL5 tag=J2TYB8LR9M6Y type=del size=3991404 2024-09-14T11:15:15.698 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:15.700+0000 7f76c1e8a8c0 1 < completed part key=_multipart_XC8VWSHZOPFP.2~FC80DBI2ZZQE.0 size=1048576 2024-09-14T11:15:15.699 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:15.700+0000 7f76c1e8a8c0 1 < completed part key=_multipart_XC8VWSHZOPFP.2~FC80DBI2ZZQE.1 size=1048576 2024-09-14T11:15:15.701 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:15.704+0000 7f76c1e8a8c0 1 < completed part key=_multipart_XC8VWSHZOPFP.2~FC80DBI2ZZQE.2 size=141593 2024-09-14T11:15:15.706 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:15.708+0000 7f76c1e8a8c0 1 < completed multipart upload key=XC8VWSHZOPFP upload=FC80DBI2ZZQE tag=5QVS8VCDO35V type=write size=3287321 2024-09-14T11:15:15.711 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:15.712+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_SHKU2PRNREKK.2~Z0CD9IAKVFZC.0 size=1048576 2024-09-14T11:15:15.713 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:15.716+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_SHKU2PRNREKK.2~Z0CD9IAKVFZC.1 size=1048576 2024-09-14T11:15:15.715 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:15.716+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_SHKU2PRNREKK.2~Z0CD9IAKVFZC.2 size=50738 2024-09-14T11:15:15.715 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:15.716+0000 7f76c1e8a8c0 1 > prepared multipart upload key=SHKU2PRNREKK upload=Z0CD9IAKVFZC tag=Q3YSJFBH6YNF type=write size=3196466 2024-09-14T11:15:15.718 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:15.720+0000 7f76c1e8a8c0 1 < completed delete operation key=8PZOVFEYYSOG tag=LEGK6JADV9CS type=del 2024-09-14T11:15:15.723 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:15.724+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_8PZOVFEYYSOG.2~A1DA24S80II1.0 size=1048576 2024-09-14T11:15:15.725 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:15.728+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_8PZOVFEYYSOG.2~A1DA24S80II1.1 size=1048576 2024-09-14T11:15:15.727 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:15.728+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_8PZOVFEYYSOG.2~A1DA24S80II1.2 size=468768 2024-09-14T11:15:15.727 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:15.728+0000 7f76c1e8a8c0 1 > prepared multipart upload key=8PZOVFEYYSOG upload=A1DA24S80II1 tag=M1VRQQZY56YM type=write size=3614496 2024-09-14T11:15:15.730 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:15.732+0000 7f76c1e8a8c0 1 < completed delete operation key=R5I9H7WAK7Z7 tag=9249ZE4O4KJJ type=del 2024-09-14T11:15:15.736 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:15.736+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_85G6NT78HAWQ.2~MOP3Q1J7AQBK.0 size=1048576 2024-09-14T11:15:15.738 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:15.740+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_85G6NT78HAWQ.2~MOP3Q1J7AQBK.1 size=320190 2024-09-14T11:15:15.738 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:15.740+0000 7f76c1e8a8c0 1 > prepared multipart upload key=85G6NT78HAWQ upload=MOP3Q1J7AQBK tag=V4NZUJ305FGA type=write size=2417342 2024-09-14T11:15:15.741 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:15.744+0000 7f76c1e8a8c0 1 < completed delete operation key=W0MDRE9YO3UP tag=QI52J4G4DH8N type=del 2024-09-14T11:15:15.744 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:15.744+0000 7f76c1e8a8c0 1 > prepared operation key=8PZOVFEYYSOG tag=TGYIVJ3N4UOF type=del size=579550 2024-09-14T11:15:15.747 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:15.748+0000 7f76c1e8a8c0 1 < completed delete operation key=VI61O3K069BP tag=QE849TIAQPKU type=del 2024-09-14T11:15:15.752 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:15.752+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_BOCIF4TL7X7J.2~DNF5AOX05L91.0 size=1048576 2024-09-14T11:15:15.754 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:15.756+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_BOCIF4TL7X7J.2~DNF5AOX05L91.1 size=1048576 2024-09-14T11:15:15.756 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:15.760+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_BOCIF4TL7X7J.2~DNF5AOX05L91.2 size=700137 2024-09-14T11:15:15.757 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:15.760+0000 7f76c1e8a8c0 1 > prepared multipart upload key=BOCIF4TL7X7J upload=DNF5AOX05L91 tag=6BUMN5VI2FZT type=write size=3845865 2024-09-14T11:15:15.760 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:15.760+0000 7f76c1e8a8c0 1 < completed delete operation key=H9CQV6L29SL5 tag=RY5I6AMD12S5 type=del 2024-09-14T11:15:15.763 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:15.764+0000 7f76c1e8a8c0 1 > prepared operation key=F3KFS0P1WM7W tag=GFQLZPPU6W3K type=del size=231733 2024-09-14T11:15:15.766 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:15.768+0000 7f76c1e8a8c0 1 < completed part key=_multipart_W0MDRE9YO3UP.2~NDGTWYAQ5HDM.0 size=1048576 2024-09-14T11:15:15.768 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:15.768+0000 7f76c1e8a8c0 1 < completed part key=_multipart_W0MDRE9YO3UP.2~NDGTWYAQ5HDM.1 size=1048576 2024-09-14T11:15:15.770 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:15.772+0000 7f76c1e8a8c0 1 < completed part key=_multipart_W0MDRE9YO3UP.2~NDGTWYAQ5HDM.2 size=587783 2024-09-14T11:15:15.774 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:15.776+0000 7f76c1e8a8c0 1 < completed multipart upload key=W0MDRE9YO3UP upload=NDGTWYAQ5HDM tag=M51EPCBZWMDP type=write size=3733511 2024-09-14T11:15:15.779 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:15.780+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_VI61O3K069BP.2~NY7F4SVJ8OU7.0 size=1048576 2024-09-14T11:15:15.781 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:15.784+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_VI61O3K069BP.2~NY7F4SVJ8OU7.1 size=1048576 2024-09-14T11:15:15.784 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:15.784+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_VI61O3K069BP.2~NY7F4SVJ8OU7.2 size=702059 2024-09-14T11:15:15.784 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:15.784+0000 7f76c1e8a8c0 1 > prepared multipart upload key=VI61O3K069BP upload=NY7F4SVJ8OU7 tag=2MI2YUTTE0CJ type=write size=3847787 2024-09-14T11:15:15.787 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:15.788+0000 7f76c1e8a8c0 1 < completed delete operation key=8PZOVFEYYSOG tag=HMXN6F70LNO2 type=del 2024-09-14T11:15:15.790 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:15.792+0000 7f76c1e8a8c0 1 > prepared operation key=CIRQT9IDJ5OJ tag=FNNH390RY44W type=del size=648695 2024-09-14T11:15:15.793 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:15.796+0000 7f76c1e8a8c0 1 < completed delete operation key=15FU4CEGC22Q tag=IAWVKRI4C35W type=del 2024-09-14T11:15:15.795 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:15.796+0000 7f76c1e8a8c0 1 > prepared operation key=TUFOZKTV9XIH tag=3RBBA3XJVL5J type=write size=993766 2024-09-14T11:15:15.799 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:15.800+0000 7f76c1e8a8c0 1 < completed part key=_multipart_MEVTZ7OAD4CA.2~GV3E0J3QB17W.0 size=1048576 2024-09-14T11:15:15.801 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:15.804+0000 7f76c1e8a8c0 1 < completed part key=_multipart_MEVTZ7OAD4CA.2~GV3E0J3QB17W.1 size=702481 2024-09-14T11:15:15.806 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:15.808+0000 7f76c1e8a8c0 1 < completed multipart upload key=MEVTZ7OAD4CA upload=GV3E0J3QB17W tag=TQYBLR4UTS22 type=write size=2799633 2024-09-14T11:15:15.809 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:15.812+0000 7f76c1e8a8c0 1 > prepared operation key=Q5IY4J5FOD80 tag=B1X2M7UXSHOH type=del size=321269 2024-09-14T11:15:15.812 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:15.812+0000 7f76c1e8a8c0 1 < completed write operation key=BOCIF4TL7X7J tag=JE51NIBBTYRX type=write size=748589 2024-09-14T11:15:15.814 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:15.816+0000 7f76c1e8a8c0 1 > prepared operation key=6TIJR323NMOH tag=X1HWJH99DFZP type=del size=1522762 2024-09-14T11:15:15.817 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:15.820+0000 7f76c1e8a8c0 1 < completed part key=_multipart_TZO40K6J9877.2~91Z5N386Z7OR.0 size=1048576 2024-09-14T11:15:15.820 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:15.824+0000 7f76c1e8a8c0 1 < completed part key=_multipart_TZO40K6J9877.2~91Z5N386Z7OR.1 size=500755 2024-09-14T11:15:15.825 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:15.828+0000 7f76c1e8a8c0 1 < completed multipart upload key=TZO40K6J9877 upload=91Z5N386Z7OR tag=VKGI69NEPA4M type=write size=2597907 2024-09-14T11:15:15.828 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:15.832+0000 7f76c1e8a8c0 1 > prepared operation key=H9CQV6L29SL5 tag=LEXKU0P8ERSF type=del size=831198 2024-09-14T11:15:15.834 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:15.836+0000 7f76c1e8a8c0 1 < suggested update operation key=85G6NT78HAWQ tag=YP6HCCPDJGDK type=del size=290446 2024-09-14T11:15:15.839 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:15.840+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_HS7T50JORDQJ.2~3VIUYPKL2O28.0 size=1048576 2024-09-14T11:15:15.841 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:15.844+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_HS7T50JORDQJ.2~3VIUYPKL2O28.1 size=1048576 2024-09-14T11:15:15.844 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:15.844+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_HS7T50JORDQJ.2~3VIUYPKL2O28.2 size=842209 2024-09-14T11:15:15.844 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:15.844+0000 7f76c1e8a8c0 1 > prepared multipart upload key=HS7T50JORDQJ upload=3VIUYPKL2O28 tag=XSQZ5L1Q3C3N type=write size=3987937 2024-09-14T11:15:15.847 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:15.848+0000 7f76c1e8a8c0 1 < completed delete operation key=TUFOZKTV9XIH tag=RZXNND0EQL9B type=del 2024-09-14T11:15:15.852 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:15.852+0000 7f76c1e8a8c0 1 > prepared operation key=MEVTZ7OAD4CA tag=ASFWAXVAZ8BE type=del size=2793501 2024-09-14T11:15:15.855 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:15.856+0000 7f76c1e8a8c0 1 < completed delete operation key=R5I9H7WAK7Z7 tag=PC8XRJEKV0DH type=del 2024-09-14T11:15:15.861 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:15.864+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_GAVZRU8ZLW7S.2~47BSVKJCP6PG.0 size=1048576 2024-09-14T11:15:15.863 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:15.864+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_GAVZRU8ZLW7S.2~47BSVKJCP6PG.1 size=70883 2024-09-14T11:15:15.863 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:15.864+0000 7f76c1e8a8c0 1 > prepared multipart upload key=GAVZRU8ZLW7S upload=47BSVKJCP6PG tag=J6P0NE0RRE2Z type=write size=2168035 2024-09-14T11:15:15.866 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:15.868+0000 7f76c1e8a8c0 1 < completed delete operation key=H9CQV6L29SL5 tag=J2TYB8LR9M6Y type=del 2024-09-14T11:15:15.872 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:15.876+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_BOCIF4TL7X7J.2~646UEN48L6Q3.0 size=276926 2024-09-14T11:15:15.872 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:15.876+0000 7f76c1e8a8c0 1 > prepared multipart upload key=BOCIF4TL7X7J upload=646UEN48L6Q3 tag=H1ZMQQIS4ZOZ type=write size=1325502 2024-09-14T11:15:15.873 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:15.876+0000 7f76c1e8a8c0 1 < canceled part key=_multipart_SHKU2PRNREKK.2~Z0CD9IAKVFZC.0 size=1048576 2024-09-14T11:15:15.875 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:15.876+0000 7f76c1e8a8c0 1 < completed part key=_multipart_SHKU2PRNREKK.2~Z0CD9IAKVFZC.1 size=1048576 2024-09-14T11:15:15.878 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:15.880+0000 7f76c1e8a8c0 1 < completed part key=_multipart_SHKU2PRNREKK.2~Z0CD9IAKVFZC.2 size=50738 2024-09-14T11:15:15.884 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:15.884+0000 7f76c1e8a8c0 1 < canceled multipart upload key=SHKU2PRNREKK upload=Z0CD9IAKVFZC tag=Q3YSJFBH6YNF type=write size=3196466 2024-09-14T11:15:15.887 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:15.888+0000 7f76c1e8a8c0 1 > prepared operation key=S43U13LYETS4 tag=LL4BP07HGNAN type=write size=710297 2024-09-14T11:15:15.892 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:15.892+0000 7f76c1e8a8c0 1 < completed part key=_multipart_8PZOVFEYYSOG.2~A1DA24S80II1.0 size=1048576 2024-09-14T11:15:15.892 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:15.896+0000 7f76c1e8a8c0 1 < canceled part key=_multipart_8PZOVFEYYSOG.2~A1DA24S80II1.1 size=1048576 2024-09-14T11:15:15.895 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:15.896+0000 7f76c1e8a8c0 1 < completed part key=_multipart_8PZOVFEYYSOG.2~A1DA24S80II1.2 size=468768 2024-09-14T11:15:15.903 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:15.904+0000 7f76c1e8a8c0 1 < canceled multipart upload key=8PZOVFEYYSOG upload=A1DA24S80II1 tag=M1VRQQZY56YM type=write size=3614496 2024-09-14T11:15:15.908 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:15.908+0000 7f76c1e8a8c0 1 > prepared operation key=CIRQT9IDJ5OJ tag=F9RKV3S0EUHK type=del size=1203954 2024-09-14T11:15:15.911 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:15.912+0000 7f76c1e8a8c0 1 < completed part key=_multipart_85G6NT78HAWQ.2~MOP3Q1J7AQBK.0 size=1048576 2024-09-14T11:15:15.911 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:15.912+0000 7f76c1e8a8c0 1 < canceled part key=_multipart_85G6NT78HAWQ.2~MOP3Q1J7AQBK.1 size=320190 2024-09-14T11:15:15.916 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:15.916+0000 7f76c1e8a8c0 1 < canceled multipart upload key=85G6NT78HAWQ upload=MOP3Q1J7AQBK tag=V4NZUJ305FGA type=write size=2417342 2024-09-14T11:15:15.921 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:15.924+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_CIRQT9IDJ5OJ.2~0FI375I6XI94.0 size=1048576 2024-09-14T11:15:15.923 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:15.924+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_CIRQT9IDJ5OJ.2~0FI375I6XI94.1 size=156151 2024-09-14T11:15:15.923 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:15.924+0000 7f76c1e8a8c0 1 > prepared multipart upload key=CIRQT9IDJ5OJ upload=0FI375I6XI94 tag=78MNHRI9JU96 type=write size=2253303 2024-09-14T11:15:15.926 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:15.928+0000 7f76c1e8a8c0 1 < completed delete operation key=8PZOVFEYYSOG tag=TGYIVJ3N4UOF type=del 2024-09-14T11:15:15.929 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:15.932+0000 7f76c1e8a8c0 1 > prepared operation key=GAVZRU8ZLW7S tag=92LKG6YXWB7X type=del size=1002681 2024-09-14T11:15:15.932 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:15.932+0000 7f76c1e8a8c0 1 < completed part key=_multipart_BOCIF4TL7X7J.2~DNF5AOX05L91.0 size=1048576 2024-09-14T11:15:15.934 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:15.936+0000 7f76c1e8a8c0 1 < completed part key=_multipart_BOCIF4TL7X7J.2~DNF5AOX05L91.1 size=1048576 2024-09-14T11:15:15.937 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:15.940+0000 7f76c1e8a8c0 1 < completed part key=_multipart_BOCIF4TL7X7J.2~DNF5AOX05L91.2 size=700137 2024-09-14T11:15:15.942 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:15.944+0000 7f76c1e8a8c0 1 < completed multipart upload key=BOCIF4TL7X7J upload=DNF5AOX05L91 tag=6BUMN5VI2FZT type=write size=3845865 2024-09-14T11:15:15.945 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:15.948+0000 7f76c1e8a8c0 1 > prepared operation key=K2EEZLRK7MVO tag=Z7FD7H5SUTB6 type=del size=868740 2024-09-14T11:15:15.947 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:15.948+0000 7f76c1e8a8c0 1 < completed delete operation key=F3KFS0P1WM7W tag=GFQLZPPU6W3K type=del 2024-09-14T11:15:15.950 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:15.952+0000 7f76c1e8a8c0 1 > prepared operation key=MEVTZ7OAD4CA tag=QDTHQ4SOEP0C type=del size=1541527 2024-09-14T11:15:15.953 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:15.956+0000 7f76c1e8a8c0 1 < completed part key=_multipart_VI61O3K069BP.2~NY7F4SVJ8OU7.0 size=1048576 2024-09-14T11:15:15.956 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:15.956+0000 7f76c1e8a8c0 1 < completed part key=_multipart_VI61O3K069BP.2~NY7F4SVJ8OU7.1 size=1048576 2024-09-14T11:15:15.958 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:15.960+0000 7f76c1e8a8c0 1 < completed part key=_multipart_VI61O3K069BP.2~NY7F4SVJ8OU7.2 size=702059 2024-09-14T11:15:15.962 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:15.964+0000 7f76c1e8a8c0 1 < completed multipart upload key=VI61O3K069BP upload=NY7F4SVJ8OU7 tag=2MI2YUTTE0CJ type=write size=3847787 2024-09-14T11:15:15.967 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:15.968+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_VI61O3K069BP.2~28G04HZ57O8Q.0 size=1048576 2024-09-14T11:15:15.969 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:15.972+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_VI61O3K069BP.2~28G04HZ57O8Q.1 size=1048576 2024-09-14T11:15:15.971 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:15.972+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_VI61O3K069BP.2~28G04HZ57O8Q.2 size=391568 2024-09-14T11:15:15.971 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:15.972+0000 7f76c1e8a8c0 1 > prepared multipart upload key=VI61O3K069BP upload=28G04HZ57O8Q tag=0UTVUHRN4CX3 type=write size=3537296 2024-09-14T11:15:15.974 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:15.976+0000 7f76c1e8a8c0 1 < completed delete operation key=CIRQT9IDJ5OJ tag=FNNH390RY44W type=del 2024-09-14T11:15:15.977 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:15.980+0000 7f76c1e8a8c0 1 > prepared operation key=MEVTZ7OAD4CA tag=1RFG1G0C1QGS type=del size=3134181 2024-09-14T11:15:15.979 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:15.980+0000 7f76c1e8a8c0 1 < completed write operation key=TUFOZKTV9XIH tag=3RBBA3XJVL5J type=write size=993766 2024-09-14T11:15:15.981 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:15.984+0000 7f76c1e8a8c0 1 > prepared operation key=KS37ZO6MKAH9 tag=TKRBKSKTY6BT type=del size=2864904 2024-09-14T11:15:15.984 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:15.988+0000 7f76c1e8a8c0 1 < completed delete operation key=Q5IY4J5FOD80 tag=B1X2M7UXSHOH type=del 2024-09-14T11:15:15.989 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:15.992+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_K2EEZLRK7MVO.2~R3MQ2F5ESPR1.0 size=1048576 2024-09-14T11:15:15.991 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:15.992+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_K2EEZLRK7MVO.2~R3MQ2F5ESPR1.1 size=1048576 2024-09-14T11:15:15.993 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:15.996+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_K2EEZLRK7MVO.2~R3MQ2F5ESPR1.2 size=454025 2024-09-14T11:15:15.993 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:15.996+0000 7f76c1e8a8c0 1 > prepared multipart upload key=K2EEZLRK7MVO upload=R3MQ2F5ESPR1 tag=9ELPY3PRXV3X type=write size=3599753 2024-09-14T11:15:15.995 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:15.996+0000 7f76c1e8a8c0 1 < completed delete operation key=6TIJR323NMOH tag=X1HWJH99DFZP type=del 2024-09-14T11:15:15.998 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:16.000+0000 7f76c1e8a8c0 1 > prepared operation key=K9W031V6BFJP tag=UU0BNNSI0SFL type=del size=1519300 2024-09-14T11:15:16.001 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:16.004+0000 7f76c1e8a8c0 1 < canceled operation key=H9CQV6L29SL5 tag=LEXKU0P8ERSF type=del size=831198 2024-09-14T11:15:16.004 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:16.004+0000 7f76c1e8a8c0 1 > prepared operation key=GAVZRU8ZLW7S tag=99YIARLDM5L8 type=del size=3500684 2024-09-14T11:15:16.006 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:16.008+0000 7f76c1e8a8c0 1 < completed part key=_multipart_HS7T50JORDQJ.2~3VIUYPKL2O28.0 size=1048576 2024-09-14T11:15:16.009 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:16.012+0000 7f76c1e8a8c0 1 < completed part key=_multipart_HS7T50JORDQJ.2~3VIUYPKL2O28.1 size=1048576 2024-09-14T11:15:16.011 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:16.012+0000 7f76c1e8a8c0 1 < completed part key=_multipart_HS7T50JORDQJ.2~3VIUYPKL2O28.2 size=842209 2024-09-14T11:15:16.017 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:16.020+0000 7f76c1e8a8c0 1 < completed multipart upload key=HS7T50JORDQJ upload=3VIUYPKL2O28 tag=XSQZ5L1Q3C3N type=write size=3987937 2024-09-14T11:15:16.020 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:16.024+0000 7f76c1e8a8c0 1 > prepared operation key=1K8ESNXU6WDF tag=53AJP7CZY36U type=del size=2628209 2024-09-14T11:15:16.024 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:16.024+0000 7f76c1e8a8c0 1 < completed delete operation key=MEVTZ7OAD4CA tag=ASFWAXVAZ8BE type=del 2024-09-14T11:15:16.027 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:16.028+0000 7f76c1e8a8c0 1 > prepared operation key=15FU4CEGC22Q tag=WR3RW8FH4GBI type=del size=2206356 2024-09-14T11:15:16.030 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:16.032+0000 7f76c1e8a8c0 1 < completed part key=_multipart_GAVZRU8ZLW7S.2~47BSVKJCP6PG.0 size=1048576 2024-09-14T11:15:16.033 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:16.036+0000 7f76c1e8a8c0 1 < completed part key=_multipart_GAVZRU8ZLW7S.2~47BSVKJCP6PG.1 size=70883 2024-09-14T11:15:16.038 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:16.040+0000 7f76c1e8a8c0 1 < completed multipart upload key=GAVZRU8ZLW7S upload=47BSVKJCP6PG tag=J6P0NE0RRE2Z type=write size=2168035 2024-09-14T11:15:16.041 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:16.044+0000 7f76c1e8a8c0 1 > prepared operation key=K2EEZLRK7MVO tag=6J5N9XCG00VD type=del size=2093529 2024-09-14T11:15:16.044 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:16.044+0000 7f76c1e8a8c0 1 < completed part key=_multipart_BOCIF4TL7X7J.2~646UEN48L6Q3.0 size=276926 2024-09-14T11:15:16.049 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:16.052+0000 7f76c1e8a8c0 1 < completed multipart upload key=BOCIF4TL7X7J upload=646UEN48L6Q3 tag=H1ZMQQIS4ZOZ type=write size=1325502 2024-09-14T11:15:16.053 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:16.056+0000 7f76c1e8a8c0 1 > prepared operation key=1K8ESNXU6WDF tag=53QIIJHUP251 type=del size=1813488 2024-09-14T11:15:16.056 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:16.056+0000 7f76c1e8a8c0 1 < completed write operation key=S43U13LYETS4 tag=LL4BP07HGNAN type=write size=710297 2024-09-14T11:15:16.061 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:16.064+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_CIRQT9IDJ5OJ.2~218FQDT7Z9HL.0 size=1048576 2024-09-14T11:15:16.064 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:16.064+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_CIRQT9IDJ5OJ.2~218FQDT7Z9HL.1 size=1048576 2024-09-14T11:15:16.066 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:16.068+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_CIRQT9IDJ5OJ.2~218FQDT7Z9HL.2 size=769709 2024-09-14T11:15:16.066 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:16.068+0000 7f76c1e8a8c0 1 > prepared multipart upload key=CIRQT9IDJ5OJ upload=218FQDT7Z9HL tag=YKW9AMFY7X31 type=write size=3915437 2024-09-14T11:15:16.069 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:16.072+0000 7f76c1e8a8c0 1 < completed delete operation key=CIRQT9IDJ5OJ tag=F9RKV3S0EUHK type=del 2024-09-14T11:15:16.072 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:16.076+0000 7f76c1e8a8c0 1 > prepared operation key=CIRQT9IDJ5OJ tag=4911MG3DQN3T type=del size=412265 2024-09-14T11:15:16.075 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:16.076+0000 7f76c1e8a8c0 1 < completed part key=_multipart_CIRQT9IDJ5OJ.2~0FI375I6XI94.0 size=1048576 2024-09-14T11:15:16.077 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:16.080+0000 7f76c1e8a8c0 1 < completed part key=_multipart_CIRQT9IDJ5OJ.2~0FI375I6XI94.1 size=156151 2024-09-14T11:15:16.083 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:16.084+0000 7f76c1e8a8c0 1 < completed multipart upload key=CIRQT9IDJ5OJ upload=0FI375I6XI94 tag=78MNHRI9JU96 type=write size=2253303 2024-09-14T11:15:16.088 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:16.092+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_K2EEZLRK7MVO.2~4PKG1CZ2A4OH.0 size=908322 2024-09-14T11:15:16.088 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:16.092+0000 7f76c1e8a8c0 1 > prepared multipart upload key=K2EEZLRK7MVO upload=4PKG1CZ2A4OH tag=NHOAQQGWN6EL type=write size=1956898 2024-09-14T11:15:16.095 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:16.096+0000 7f76c1e8a8c0 1 < suggested update operation key=GAVZRU8ZLW7S tag=92LKG6YXWB7X type=del size=1002681 2024-09-14T11:15:16.100 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:16.100+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_15FU4CEGC22Q.2~U2IR776SJBRY.0 size=1048576 2024-09-14T11:15:16.102 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:16.104+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_15FU4CEGC22Q.2~U2IR776SJBRY.1 size=1048576 2024-09-14T11:15:16.104 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:16.104+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_15FU4CEGC22Q.2~U2IR776SJBRY.2 size=357825 2024-09-14T11:15:16.104 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:16.104+0000 7f76c1e8a8c0 1 > prepared multipart upload key=15FU4CEGC22Q upload=U2IR776SJBRY tag=GGLVMJQTZW09 type=write size=3503553 2024-09-14T11:15:16.106 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:16.108+0000 7f76c1e8a8c0 1 < completed delete operation key=K2EEZLRK7MVO tag=Z7FD7H5SUTB6 type=del 2024-09-14T11:15:16.112 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:16.112+0000 7f76c1e8a8c0 1 > prepared operation key=SUNCRV0C1XYL tag=2U3KJJFD2MVS type=del size=1592370 2024-09-14T11:15:16.112 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:16.112+0000 7f76c1e8a8c0 1 < completed delete operation key=MEVTZ7OAD4CA tag=QDTHQ4SOEP0C type=del 2024-09-14T11:15:16.117 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:16.120+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_SHKU2PRNREKK.2~J0O2JC3UX8GB.0 size=8261 2024-09-14T11:15:16.117 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:16.120+0000 7f76c1e8a8c0 1 > prepared multipart upload key=SHKU2PRNREKK upload=J0O2JC3UX8GB tag=1JD1FE2FKWO0 type=write size=1056837 2024-09-14T11:15:16.119 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:16.120+0000 7f76c1e8a8c0 1 < completed part key=_multipart_VI61O3K069BP.2~28G04HZ57O8Q.0 size=1048576 2024-09-14T11:15:16.122 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:16.124+0000 7f76c1e8a8c0 1 < completed part key=_multipart_VI61O3K069BP.2~28G04HZ57O8Q.1 size=1048576 2024-09-14T11:15:16.124 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:16.124+0000 7f76c1e8a8c0 1 < completed part key=_multipart_VI61O3K069BP.2~28G04HZ57O8Q.2 size=391568 2024-09-14T11:15:16.128 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:16.132+0000 7f76c1e8a8c0 1 < completed multipart upload key=VI61O3K069BP upload=28G04HZ57O8Q tag=0UTVUHRN4CX3 type=write size=3537296 2024-09-14T11:15:16.131 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:16.132+0000 7f76c1e8a8c0 1 > prepared operation key=W0MDRE9YO3UP tag=0L16HIK3Z0RO type=del size=2648694 2024-09-14T11:15:16.134 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:16.136+0000 7f76c1e8a8c0 1 < completed delete operation key=MEVTZ7OAD4CA tag=1RFG1G0C1QGS type=del 2024-09-14T11:15:16.136 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:16.140+0000 7f76c1e8a8c0 1 > prepared operation key=H9CQV6L29SL5 tag=LLCCE6S8K3P8 type=del size=3918898 2024-09-14T11:15:16.139 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:16.140+0000 7f76c1e8a8c0 1 < completed delete operation key=KS37ZO6MKAH9 tag=TKRBKSKTY6BT type=del 2024-09-14T11:15:16.142 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:16.144+0000 7f76c1e8a8c0 1 > prepared operation key=KS37ZO6MKAH9 tag=MIJKF7FX6VDG type=del size=3920547 2024-09-14T11:15:16.145 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:16.148+0000 7f76c1e8a8c0 1 < completed part key=_multipart_K2EEZLRK7MVO.2~R3MQ2F5ESPR1.0 size=1048576 2024-09-14T11:15:16.147 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:16.148+0000 7f76c1e8a8c0 1 < completed part key=_multipart_K2EEZLRK7MVO.2~R3MQ2F5ESPR1.1 size=1048576 2024-09-14T11:15:16.149 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:16.152+0000 7f76c1e8a8c0 1 < completed part key=_multipart_K2EEZLRK7MVO.2~R3MQ2F5ESPR1.2 size=454025 2024-09-14T11:15:16.154 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:16.156+0000 7f76c1e8a8c0 1 < completed multipart upload key=K2EEZLRK7MVO upload=R3MQ2F5ESPR1 tag=9ELPY3PRXV3X type=write size=3599753 2024-09-14T11:15:16.157 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:16.160+0000 7f76c1e8a8c0 1 > prepared operation key=1K8ESNXU6WDF tag=TDE10UQNALGF type=del size=825066 2024-09-14T11:15:16.160 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:16.160+0000 7f76c1e8a8c0 1 < completed delete operation key=K9W031V6BFJP tag=UU0BNNSI0SFL type=del 2024-09-14T11:15:16.163 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:16.164+0000 7f76c1e8a8c0 1 > prepared operation key=H9CQV6L29SL5 tag=GN06VIUWOFME type=del size=1432468 2024-09-14T11:15:16.168 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:16.168+0000 7f76c1e8a8c0 -1 < failed to complete operation key=GAVZRU8ZLW7S tag=99YIARLDM5L8 type=del size=3500684: (22) Invalid argument 2024-09-14T11:15:16.173 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:16.176+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_8PZOVFEYYSOG.2~FOXN1N0409H7.0 size=789312 2024-09-14T11:15:16.173 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:16.176+0000 7f76c1e8a8c0 1 > prepared multipart upload key=8PZOVFEYYSOG upload=FOXN1N0409H7 tag=FKIZ6D3SQF03 type=write size=1837888 2024-09-14T11:15:16.178 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:16.180+0000 7f76c1e8a8c0 1 < suggested remove operation key=1K8ESNXU6WDF tag=53AJP7CZY36U type=del 2024-09-14T11:15:16.181 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:16.184+0000 7f76c1e8a8c0 1 > prepared operation key=F3KFS0P1WM7W tag=4U0VWL1W84L0 type=del size=1215865 2024-09-14T11:15:16.184 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:16.184+0000 7f76c1e8a8c0 1 < completed delete operation key=15FU4CEGC22Q tag=WR3RW8FH4GBI type=del 2024-09-14T11:15:16.186 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:16.188+0000 7f76c1e8a8c0 1 > prepared operation key=1K8ESNXU6WDF tag=ZKTFEBBO573I type=del size=2917240 2024-09-14T11:15:16.189 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:16.192+0000 7f76c1e8a8c0 1 < completed delete operation key=K2EEZLRK7MVO tag=6J5N9XCG00VD type=del 2024-09-14T11:15:16.192 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:16.192+0000 7f76c1e8a8c0 1 > prepared operation key=CIRQT9IDJ5OJ tag=30VYC4VKDZPN type=del size=2716211 2024-09-14T11:15:16.194 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:16.196+0000 7f76c1e8a8c0 -1 < failed to complete operation key=1K8ESNXU6WDF tag=53QIIJHUP251 type=del size=1813488: (22) Invalid argument 2024-09-14T11:15:16.199 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:16.200+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_K9W031V6BFJP.2~E7N5ZFN0EWJO.0 size=1000622 2024-09-14T11:15:16.199 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:16.200+0000 7f76c1e8a8c0 1 > prepared multipart upload key=K9W031V6BFJP upload=E7N5ZFN0EWJO tag=P7HUZ8WSM6WU type=write size=2049198 2024-09-14T11:15:16.202 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:16.204+0000 7f76c1e8a8c0 1 < completed part key=_multipart_CIRQT9IDJ5OJ.2~218FQDT7Z9HL.0 size=1048576 2024-09-14T11:15:16.202 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:16.204+0000 7f76c1e8a8c0 1 < canceled part key=_multipart_CIRQT9IDJ5OJ.2~218FQDT7Z9HL.1 size=1048576 2024-09-14T11:15:16.204 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:16.208+0000 7f76c1e8a8c0 1 < completed part key=_multipart_CIRQT9IDJ5OJ.2~218FQDT7Z9HL.2 size=769709 2024-09-14T11:15:16.209 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:16.212+0000 7f76c1e8a8c0 1 < canceled multipart upload key=CIRQT9IDJ5OJ upload=218FQDT7Z9HL tag=YKW9AMFY7X31 type=write size=3915437 2024-09-14T11:15:16.211 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:16.212+0000 7f76c1e8a8c0 1 > prepared operation key=SUNCRV0C1XYL tag=69GX5OJH8S7V type=write size=1039842 2024-09-14T11:15:16.214 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:16.216+0000 7f76c1e8a8c0 1 < completed delete operation key=CIRQT9IDJ5OJ tag=4911MG3DQN3T type=del 2024-09-14T11:15:16.219 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:16.220+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_TUFOZKTV9XIH.2~4VCRUFI69IJG.0 size=1048576 2024-09-14T11:15:16.221 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:16.224+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_TUFOZKTV9XIH.2~4VCRUFI69IJG.1 size=1048576 2024-09-14T11:15:16.223 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:16.224+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_TUFOZKTV9XIH.2~4VCRUFI69IJG.2 size=192117 2024-09-14T11:15:16.223 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:16.224+0000 7f76c1e8a8c0 1 > prepared multipart upload key=TUFOZKTV9XIH upload=4VCRUFI69IJG tag=LSGI4DHGCSPS type=write size=3337845 2024-09-14T11:15:16.227 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:16.228+0000 7f76c1e8a8c0 1 < completed part key=_multipart_K2EEZLRK7MVO.2~4PKG1CZ2A4OH.0 size=908322 2024-09-14T11:15:16.232 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:16.232+0000 7f76c1e8a8c0 1 < completed multipart upload key=K2EEZLRK7MVO upload=4PKG1CZ2A4OH tag=NHOAQQGWN6EL type=write size=1956898 2024-09-14T11:15:16.235 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:16.236+0000 7f76c1e8a8c0 1 > prepared operation key=W0MDRE9YO3UP tag=FCFWRQ8XZTAO type=del size=4017663 2024-09-14T11:15:16.239 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:16.240+0000 7f76c1e8a8c0 1 < completed part key=_multipart_15FU4CEGC22Q.2~U2IR776SJBRY.0 size=1048576 2024-09-14T11:15:16.241 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:16.244+0000 7f76c1e8a8c0 1 < completed part key=_multipart_15FU4CEGC22Q.2~U2IR776SJBRY.1 size=1048576 2024-09-14T11:15:16.244 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:16.244+0000 7f76c1e8a8c0 1 < completed part key=_multipart_15FU4CEGC22Q.2~U2IR776SJBRY.2 size=357825 2024-09-14T11:15:16.250 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:16.252+0000 7f76c1e8a8c0 1 < completed multipart upload key=15FU4CEGC22Q upload=U2IR776SJBRY tag=GGLVMJQTZW09 type=write size=3503553 2024-09-14T11:15:16.255 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:16.256+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_TZO40K6J9877.2~TL1UHO09EV6O.0 size=1048576 2024-09-14T11:15:16.258 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:16.260+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_TZO40K6J9877.2~TL1UHO09EV6O.1 size=1048576 2024-09-14T11:15:16.260 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:16.264+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_TZO40K6J9877.2~TL1UHO09EV6O.2 size=479171 2024-09-14T11:15:16.260 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:16.264+0000 7f76c1e8a8c0 1 > prepared multipart upload key=TZO40K6J9877 upload=TL1UHO09EV6O tag=HL342FQ6MK1G type=write size=3624899 2024-09-14T11:15:16.264 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:16.264+0000 7f76c1e8a8c0 1 < completed delete operation key=SUNCRV0C1XYL tag=2U3KJJFD2MVS type=del 2024-09-14T11:15:16.269 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:16.272+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_1W5733SDHGDN.2~DVSKYAL1FMBI.0 size=1048576 2024-09-14T11:15:16.272 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:16.276+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_1W5733SDHGDN.2~DVSKYAL1FMBI.1 size=1048576 2024-09-14T11:15:16.275 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:16.276+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_1W5733SDHGDN.2~DVSKYAL1FMBI.2 size=262668 2024-09-14T11:15:16.276 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:16.276+0000 7f76c1e8a8c0 1 > prepared multipart upload key=1W5733SDHGDN upload=DVSKYAL1FMBI tag=95F3LK6UFUC0 type=write size=3408396 2024-09-14T11:15:16.279 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:16.280+0000 7f76c1e8a8c0 1 < completed part key=_multipart_SHKU2PRNREKK.2~J0O2JC3UX8GB.0 size=8261 2024-09-14T11:15:16.285 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:16.288+0000 7f76c1e8a8c0 1 < completed multipart upload key=SHKU2PRNREKK upload=J0O2JC3UX8GB tag=1JD1FE2FKWO0 type=write size=1056837 2024-09-14T11:15:16.290 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:16.292+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_8PZOVFEYYSOG.2~KP7A63Y330A2.0 size=1048576 2024-09-14T11:15:16.293 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:16.296+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_8PZOVFEYYSOG.2~KP7A63Y330A2.1 size=1048576 2024-09-14T11:15:16.297 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:16.300+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_8PZOVFEYYSOG.2~KP7A63Y330A2.2 size=204929 2024-09-14T11:15:16.297 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:16.300+0000 7f76c1e8a8c0 1 > prepared multipart upload key=8PZOVFEYYSOG upload=KP7A63Y330A2 tag=CTHLWA8YCCAQ type=write size=3350657 2024-09-14T11:15:16.302 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:16.304+0000 7f76c1e8a8c0 1 < suggested update operation key=W0MDRE9YO3UP tag=0L16HIK3Z0RO type=del size=2648694 2024-09-14T11:15:16.308 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:16.308+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_GZM0AQVHNCMM.2~HYFA8RVCZTKW.0 size=317381 2024-09-14T11:15:16.308 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:16.308+0000 7f76c1e8a8c0 1 > prepared multipart upload key=GZM0AQVHNCMM upload=HYFA8RVCZTKW tag=364HY0KHSKLS type=write size=1365957 2024-09-14T11:15:16.311 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:16.312+0000 7f76c1e8a8c0 1 < completed delete operation key=H9CQV6L29SL5 tag=LLCCE6S8K3P8 type=del 2024-09-14T11:15:16.314 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:16.316+0000 7f76c1e8a8c0 1 > prepared operation key=S43U13LYETS4 tag=9FOZDYG9FOQI type=del size=3625785 2024-09-14T11:15:16.317 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:16.320+0000 7f76c1e8a8c0 1 < completed delete operation key=KS37ZO6MKAH9 tag=MIJKF7FX6VDG type=del 2024-09-14T11:15:16.320 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:16.320+0000 7f76c1e8a8c0 1 > prepared operation key=K9W031V6BFJP tag=6343GZSEAGR1 type=del size=525260 2024-09-14T11:15:16.322 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:16.324+0000 7f76c1e8a8c0 -1 < failed to complete operation key=1K8ESNXU6WDF tag=TDE10UQNALGF type=del size=825066: (22) Invalid argument 2024-09-14T11:15:16.325 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:16.328+0000 7f76c1e8a8c0 1 > prepared operation key=H9CQV6L29SL5 tag=QL7WZXXA2A7V type=del size=245788 2024-09-14T11:15:16.328 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:16.328+0000 7f76c1e8a8c0 1 < completed delete operation key=H9CQV6L29SL5 tag=GN06VIUWOFME type=del 2024-09-14T11:15:16.331 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:16.332+0000 7f76c1e8a8c0 1 > prepared operation key=1W5733SDHGDN tag=RWV80KL49NF0 type=write size=652541 2024-09-14T11:15:16.334 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:16.336+0000 7f76c1e8a8c0 1 < completed part key=_multipart_8PZOVFEYYSOG.2~FOXN1N0409H7.0 size=789312 2024-09-14T11:15:16.340 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:16.340+0000 7f76c1e8a8c0 1 < completed multipart upload key=8PZOVFEYYSOG upload=FOXN1N0409H7 tag=FKIZ6D3SQF03 type=write size=1837888 2024-09-14T11:15:16.343 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:16.344+0000 7f76c1e8a8c0 1 > prepared operation key=LZ0YNFOVFYCL tag=2DFPX7ABKAS8 type=del size=1336101 2024-09-14T11:15:16.345 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:16.348+0000 7f76c1e8a8c0 1 < completed delete operation key=F3KFS0P1WM7W tag=4U0VWL1W84L0 type=del 2024-09-14T11:15:16.348 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:16.352+0000 7f76c1e8a8c0 1 > prepared operation key=GZM0AQVHNCMM tag=XTGH9HVM558Q type=del size=2139487 2024-09-14T11:15:16.351 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:16.352+0000 7f76c1e8a8c0 1 < completed delete operation key=1K8ESNXU6WDF tag=ZKTFEBBO573I type=del 2024-09-14T11:15:16.354 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:16.356+0000 7f76c1e8a8c0 1 > prepared operation key=Q5IY4J5FOD80 tag=Y0XWWNXXVSWO type=write size=800328 2024-09-14T11:15:16.357 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:16.360+0000 7f76c1e8a8c0 1 < completed delete operation key=CIRQT9IDJ5OJ tag=30VYC4VKDZPN type=del 2024-09-14T11:15:16.360 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:16.360+0000 7f76c1e8a8c0 1 > prepared operation key=XC8VWSHZOPFP tag=UWGVBB9ZSEE0 type=del size=1196249 2024-09-14T11:15:16.363 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:16.364+0000 7f76c1e8a8c0 1 < completed part key=_multipart_K9W031V6BFJP.2~E7N5ZFN0EWJO.0 size=1000622 2024-09-14T11:15:16.368 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:16.368+0000 7f76c1e8a8c0 1 < completed multipart upload key=K9W031V6BFJP upload=E7N5ZFN0EWJO tag=P7HUZ8WSM6WU type=write size=2049198 2024-09-14T11:15:16.374 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:16.376+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_OOUEM16XL80W.2~CT4NMAV17PBO.0 size=1048576 2024-09-14T11:15:16.377 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:16.380+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_OOUEM16XL80W.2~CT4NMAV17PBO.1 size=1048576 2024-09-14T11:15:16.379 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:16.380+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_OOUEM16XL80W.2~CT4NMAV17PBO.2 size=668838 2024-09-14T11:15:16.380 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:16.380+0000 7f76c1e8a8c0 1 > prepared multipart upload key=OOUEM16XL80W upload=CT4NMAV17PBO tag=L7PIWK7XJYO6 type=write size=3814566 2024-09-14T11:15:16.383 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:16.384+0000 7f76c1e8a8c0 1 < completed write operation key=SUNCRV0C1XYL tag=69GX5OJH8S7V type=write size=1039842 2024-09-14T11:15:16.390 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:16.392+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_W0MDRE9YO3UP.2~S1158UW2YZP0.0 size=699607 2024-09-14T11:15:16.390 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:16.392+0000 7f76c1e8a8c0 1 > prepared multipart upload key=W0MDRE9YO3UP upload=S1158UW2YZP0 tag=ES5FTHKQYXNE type=write size=1748183 2024-09-14T11:15:16.393 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:16.396+0000 7f76c1e8a8c0 1 < completed part key=_multipart_TUFOZKTV9XIH.2~4VCRUFI69IJG.0 size=1048576 2024-09-14T11:15:16.396 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:16.396+0000 7f76c1e8a8c0 1 < completed part key=_multipart_TUFOZKTV9XIH.2~4VCRUFI69IJG.1 size=1048576 2024-09-14T11:15:16.399 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:16.400+0000 7f76c1e8a8c0 1 < completed part key=_multipart_TUFOZKTV9XIH.2~4VCRUFI69IJG.2 size=192117 2024-09-14T11:15:16.405 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:16.408+0000 7f76c1e8a8c0 1 < completed multipart upload key=TUFOZKTV9XIH upload=4VCRUFI69IJG tag=LSGI4DHGCSPS type=write size=3337845 2024-09-14T11:15:16.409 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:16.412+0000 7f76c1e8a8c0 1 > prepared operation key=SUNCRV0C1XYL tag=SVQ1KGGJZ3G3 type=del size=3805078 2024-09-14T11:15:16.412 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:16.416+0000 7f76c1e8a8c0 -1 < failed to complete operation key=W0MDRE9YO3UP tag=FCFWRQ8XZTAO type=del size=4017663: (22) Invalid argument 2024-09-14T11:15:16.419 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:16.420+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_6TIJR323NMOH.2~4Y13A2K5S8GA.0 size=1048576 2024-09-14T11:15:16.422 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:16.424+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_6TIJR323NMOH.2~4Y13A2K5S8GA.1 size=1048576 2024-09-14T11:15:16.425 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:16.428+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_6TIJR323NMOH.2~4Y13A2K5S8GA.2 size=664907 2024-09-14T11:15:16.425 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:16.428+0000 7f76c1e8a8c0 1 > prepared multipart upload key=6TIJR323NMOH upload=4Y13A2K5S8GA tag=BCTXMBWDBCBP type=write size=3810635 2024-09-14T11:15:16.428 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:16.428+0000 7f76c1e8a8c0 1 < completed part key=_multipart_TZO40K6J9877.2~TL1UHO09EV6O.0 size=1048576 2024-09-14T11:15:16.430 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:16.432+0000 7f76c1e8a8c0 1 < completed part key=_multipart_TZO40K6J9877.2~TL1UHO09EV6O.1 size=1048576 2024-09-14T11:15:16.430 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:16.432+0000 7f76c1e8a8c0 1 < canceled part key=_multipart_TZO40K6J9877.2~TL1UHO09EV6O.2 size=479171 2024-09-14T11:15:16.436 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:16.436+0000 7f76c1e8a8c0 1 < canceled multipart upload key=TZO40K6J9877 upload=TL1UHO09EV6O tag=HL342FQ6MK1G type=write size=3624899 2024-09-14T11:15:16.438 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:16.440+0000 7f76c1e8a8c0 1 > prepared operation key=GAVZRU8ZLW7S tag=XR70SXUEFI22 type=del size=4010079 2024-09-14T11:15:16.441 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:16.444+0000 7f76c1e8a8c0 1 < completed part key=_multipart_1W5733SDHGDN.2~DVSKYAL1FMBI.0 size=1048576 2024-09-14T11:15:16.444 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:16.448+0000 7f76c1e8a8c0 1 < completed part key=_multipart_1W5733SDHGDN.2~DVSKYAL1FMBI.1 size=1048576 2024-09-14T11:15:16.447 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:16.448+0000 7f76c1e8a8c0 1 < completed part key=_multipart_1W5733SDHGDN.2~DVSKYAL1FMBI.2 size=262668 2024-09-14T11:15:16.455 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:16.456+0000 7f76c1e8a8c0 1 < completed multipart upload key=1W5733SDHGDN upload=DVSKYAL1FMBI tag=95F3LK6UFUC0 type=write size=3408396 2024-09-14T11:15:16.460 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:16.460+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_CIRQT9IDJ5OJ.2~ZTSOK9CUBW3X.0 size=1048576 2024-09-14T11:15:16.462 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:16.464+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_CIRQT9IDJ5OJ.2~ZTSOK9CUBW3X.1 size=503613 2024-09-14T11:15:16.462 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:16.464+0000 7f76c1e8a8c0 1 > prepared multipart upload key=CIRQT9IDJ5OJ upload=ZTSOK9CUBW3X tag=753QEK6PP2K0 type=write size=2600765 2024-09-14T11:15:16.465 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:16.468+0000 7f76c1e8a8c0 1 < completed part key=_multipart_8PZOVFEYYSOG.2~KP7A63Y330A2.0 size=1048576 2024-09-14T11:15:16.467 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:16.468+0000 7f76c1e8a8c0 1 < completed part key=_multipart_8PZOVFEYYSOG.2~KP7A63Y330A2.1 size=1048576 2024-09-14T11:15:16.470 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:16.472+0000 7f76c1e8a8c0 1 < completed part key=_multipart_8PZOVFEYYSOG.2~KP7A63Y330A2.2 size=204929 2024-09-14T11:15:16.475 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:16.476+0000 7f76c1e8a8c0 1 < completed multipart upload key=8PZOVFEYYSOG upload=KP7A63Y330A2 tag=CTHLWA8YCCAQ type=write size=3350657 2024-09-14T11:15:16.478 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:16.480+0000 7f76c1e8a8c0 1 > prepared operation key=VI61O3K069BP tag=MSBCE52RGBO2 type=del size=1744848 2024-09-14T11:15:16.482 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:16.484+0000 7f76c1e8a8c0 1 < completed part key=_multipart_GZM0AQVHNCMM.2~HYFA8RVCZTKW.0 size=317381 2024-09-14T11:15:16.487 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:16.488+0000 7f76c1e8a8c0 1 < completed multipart upload key=GZM0AQVHNCMM upload=HYFA8RVCZTKW tag=364HY0KHSKLS type=write size=1365957 2024-09-14T11:15:16.490 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:16.492+0000 7f76c1e8a8c0 1 > prepared operation key=KS37ZO6MKAH9 tag=AHUJVZJ0REU6 type=del size=2555818 2024-09-14T11:15:16.493 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:16.496+0000 7f76c1e8a8c0 1 < completed delete operation key=S43U13LYETS4 tag=9FOZDYG9FOQI type=del 2024-09-14T11:15:16.498 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:16.500+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_OOUEM16XL80W.2~U87J1MT07ZLG.0 size=1019998 2024-09-14T11:15:16.498 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:16.500+0000 7f76c1e8a8c0 1 > prepared multipart upload key=OOUEM16XL80W upload=U87J1MT07ZLG tag=2WA6D60GEOSB type=write size=2068574 2024-09-14T11:15:16.501 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:16.504+0000 7f76c1e8a8c0 1 < completed delete operation key=K9W031V6BFJP tag=6343GZSEAGR1 type=del 2024-09-14T11:15:16.507 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:16.508+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_GZM0AQVHNCMM.2~4M898U2O10DK.0 size=915298 2024-09-14T11:15:16.507 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:16.508+0000 7f76c1e8a8c0 1 > prepared multipart upload key=GZM0AQVHNCMM upload=4M898U2O10DK tag=954PLTX9766M type=write size=1963874 2024-09-14T11:15:16.511 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:16.512+0000 7f76c1e8a8c0 1 < canceled operation key=H9CQV6L29SL5 tag=QL7WZXXA2A7V type=del size=245788 2024-09-14T11:15:16.514 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:16.516+0000 7f76c1e8a8c0 1 > prepared operation key=F3KFS0P1WM7W tag=M7J7XELK7RVD type=write size=907966 2024-09-14T11:15:16.521 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:16.520+0000 7f76c1e8a8c0 1 < suggested remove operation key=1W5733SDHGDN tag=RWV80KL49NF0 type=write 2024-09-14T11:15:16.526 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:16.528+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_KS37ZO6MKAH9.2~T638S2V2ZUBB.0 size=1048576 2024-09-14T11:15:16.528 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:16.532+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_KS37ZO6MKAH9.2~T638S2V2ZUBB.1 size=95368 2024-09-14T11:15:16.528 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:16.532+0000 7f76c1e8a8c0 1 > prepared multipart upload key=KS37ZO6MKAH9 upload=T638S2V2ZUBB tag=EV2PMYD10U8J type=write size=2192520 2024-09-14T11:15:16.531 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:16.532+0000 7f76c1e8a8c0 1 < completed delete operation key=LZ0YNFOVFYCL tag=2DFPX7ABKAS8 type=del 2024-09-14T11:15:16.537 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:16.540+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_GAVZRU8ZLW7S.2~DHQYO4ICWG0B.0 size=588787 2024-09-14T11:15:16.537 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:16.540+0000 7f76c1e8a8c0 1 > prepared multipart upload key=GAVZRU8ZLW7S upload=DHQYO4ICWG0B tag=QQIVBN2EPF38 type=write size=1637363 2024-09-14T11:15:16.544 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:16.544+0000 7f76c1e8a8c0 1 < suggested remove operation key=GZM0AQVHNCMM tag=XTGH9HVM558Q type=del 2024-09-14T11:15:16.548 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:16.548+0000 7f76c1e8a8c0 1 > prepared operation key=TUFOZKTV9XIH tag=LHROJ5QOJPG9 type=del size=315979 2024-09-14T11:15:16.551 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:16.552+0000 7f76c1e8a8c0 1 < completed write operation key=Q5IY4J5FOD80 tag=Y0XWWNXXVSWO type=write size=800328 2024-09-14T11:15:16.554 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:16.556+0000 7f76c1e8a8c0 1 > prepared operation key=MEVTZ7OAD4CA tag=G8ILLT69L37P type=del size=136495 2024-09-14T11:15:16.558 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:16.560+0000 7f76c1e8a8c0 1 < completed delete operation key=XC8VWSHZOPFP tag=UWGVBB9ZSEE0 type=del 2024-09-14T11:15:16.561 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:16.564+0000 7f76c1e8a8c0 1 > prepared operation key=XC8VWSHZOPFP tag=LFZ2WR1242EG type=write size=278490 2024-09-14T11:15:16.565 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:16.568+0000 7f76c1e8a8c0 1 < completed part key=_multipart_OOUEM16XL80W.2~CT4NMAV17PBO.0 size=1048576 2024-09-14T11:15:16.568 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:16.568+0000 7f76c1e8a8c0 1 < completed part key=_multipart_OOUEM16XL80W.2~CT4NMAV17PBO.1 size=1048576 2024-09-14T11:15:16.570 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:16.572+0000 7f76c1e8a8c0 1 < completed part key=_multipart_OOUEM16XL80W.2~CT4NMAV17PBO.2 size=668838 2024-09-14T11:15:16.576 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:16.580+0000 7f76c1e8a8c0 1 < completed multipart upload key=OOUEM16XL80W upload=CT4NMAV17PBO tag=L7PIWK7XJYO6 type=write size=3814566 2024-09-14T11:15:16.582 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:16.584+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_R5I9H7WAK7Z7.2~NYOBCRB3VIWV.0 size=422643 2024-09-14T11:15:16.582 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:16.584+0000 7f76c1e8a8c0 1 > prepared multipart upload key=R5I9H7WAK7Z7 upload=NYOBCRB3VIWV tag=A5VGLXK0E5HP type=write size=1471219 2024-09-14T11:15:16.585 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:16.588+0000 7f76c1e8a8c0 1 < completed part key=_multipart_W0MDRE9YO3UP.2~S1158UW2YZP0.0 size=699607 2024-09-14T11:15:16.591 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:16.592+0000 7f76c1e8a8c0 1 < completed multipart upload key=W0MDRE9YO3UP upload=S1158UW2YZP0 tag=ES5FTHKQYXNE type=write size=1748183 2024-09-14T11:15:16.595 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:16.596+0000 7f76c1e8a8c0 1 > prepared operation key=OUMUTEBQ1TD0 tag=3IVBGSQOU7UZ type=write size=834411 2024-09-14T11:15:16.598 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:16.600+0000 7f76c1e8a8c0 1 < canceled operation key=SUNCRV0C1XYL tag=SVQ1KGGJZ3G3 type=del size=3805078 2024-09-14T11:15:16.601 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:16.604+0000 7f76c1e8a8c0 1 > prepared operation key=1W5733SDHGDN tag=IAOYD273H2KL type=write size=570262 2024-09-14T11:15:16.605 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:16.608+0000 7f76c1e8a8c0 1 < completed part key=_multipart_6TIJR323NMOH.2~4Y13A2K5S8GA.0 size=1048576 2024-09-14T11:15:16.607 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:16.608+0000 7f76c1e8a8c0 1 < completed part key=_multipart_6TIJR323NMOH.2~4Y13A2K5S8GA.1 size=1048576 2024-09-14T11:15:16.610 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:16.612+0000 7f76c1e8a8c0 1 < completed part key=_multipart_6TIJR323NMOH.2~4Y13A2K5S8GA.2 size=664907 2024-09-14T11:15:16.615 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:16.616+0000 7f76c1e8a8c0 1 < completed multipart upload key=6TIJR323NMOH upload=4Y13A2K5S8GA tag=BCTXMBWDBCBP type=write size=3810635 2024-09-14T11:15:16.618 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:16.620+0000 7f76c1e8a8c0 1 > prepared operation key=85G6NT78HAWQ tag=NERQ4MREOEMK type=del size=4133881 2024-09-14T11:15:16.622 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:16.624+0000 7f76c1e8a8c0 1 < completed delete operation key=GAVZRU8ZLW7S tag=XR70SXUEFI22 type=del 2024-09-14T11:15:16.625 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:16.628+0000 7f76c1e8a8c0 1 > prepared operation key=8FFV9G6EQR8F tag=TPKD92I2BJNO type=write size=497036 2024-09-14T11:15:16.629 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:16.632+0000 7f76c1e8a8c0 1 < completed part key=_multipart_CIRQT9IDJ5OJ.2~ZTSOK9CUBW3X.0 size=1048576 2024-09-14T11:15:16.631 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:16.632+0000 7f76c1e8a8c0 1 < completed part key=_multipart_CIRQT9IDJ5OJ.2~ZTSOK9CUBW3X.1 size=503613 2024-09-14T11:15:16.637 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:16.640+0000 7f76c1e8a8c0 1 < completed multipart upload key=CIRQT9IDJ5OJ upload=ZTSOK9CUBW3X tag=753QEK6PP2K0 type=write size=2600765 2024-09-14T11:15:16.645 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:16.648+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_BOCIF4TL7X7J.2~LT8BCIQD9W82.0 size=1048576 2024-09-14T11:15:16.647 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:16.648+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_BOCIF4TL7X7J.2~LT8BCIQD9W82.1 size=199848 2024-09-14T11:15:16.647 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:16.648+0000 7f76c1e8a8c0 1 > prepared multipart upload key=BOCIF4TL7X7J upload=LT8BCIQD9W82 tag=5HDRJJP6I13L type=write size=2297000 2024-09-14T11:15:16.651 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:16.652+0000 7f76c1e8a8c0 1 < completed delete operation key=VI61O3K069BP tag=MSBCE52RGBO2 type=del 2024-09-14T11:15:16.657 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:16.660+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_F3KFS0P1WM7W.2~265WY5B694W6.0 size=1048576 2024-09-14T11:15:16.660 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:16.660+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_F3KFS0P1WM7W.2~265WY5B694W6.1 size=833302 2024-09-14T11:15:16.660 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:16.660+0000 7f76c1e8a8c0 1 > prepared multipart upload key=F3KFS0P1WM7W upload=265WY5B694W6 tag=E5Y9BRY066KC type=write size=2930454 2024-09-14T11:15:16.663 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:16.664+0000 7f76c1e8a8c0 1 < completed delete operation key=KS37ZO6MKAH9 tag=AHUJVZJ0REU6 type=del 2024-09-14T11:15:16.667 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:16.668+0000 7f76c1e8a8c0 1 > prepared operation key=VI61O3K069BP tag=RJDK6TFZ1ZBY type=del size=981027 2024-09-14T11:15:16.670 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:16.672+0000 7f76c1e8a8c0 1 < completed part key=_multipart_OOUEM16XL80W.2~U87J1MT07ZLG.0 size=1019998 2024-09-14T11:15:16.676 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:16.676+0000 7f76c1e8a8c0 1 < completed multipart upload key=OOUEM16XL80W upload=U87J1MT07ZLG tag=2WA6D60GEOSB type=write size=2068574 2024-09-14T11:15:16.682 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:16.684+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_GZM0AQVHNCMM.2~0PMGTW9ODA9Y.0 size=1048576 2024-09-14T11:15:16.685 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:16.688+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_GZM0AQVHNCMM.2~0PMGTW9ODA9Y.1 size=808493 2024-09-14T11:15:16.685 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:16.688+0000 7f76c1e8a8c0 1 > prepared multipart upload key=GZM0AQVHNCMM upload=0PMGTW9ODA9Y tag=DT4Z2CO733CS type=write size=2905645 2024-09-14T11:15:16.689 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:16.692+0000 7f76c1e8a8c0 1 < completed part key=_multipart_GZM0AQVHNCMM.2~4M898U2O10DK.0 size=915298 2024-09-14T11:15:16.695 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:16.696+0000 7f76c1e8a8c0 1 < completed multipart upload key=GZM0AQVHNCMM upload=4M898U2O10DK tag=954PLTX9766M type=write size=1963874 2024-09-14T11:15:16.701 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:16.704+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_8PZOVFEYYSOG.2~H1PGWK6J4QHG.0 size=176406 2024-09-14T11:15:16.701 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:16.704+0000 7f76c1e8a8c0 1 > prepared multipart upload key=8PZOVFEYYSOG upload=H1PGWK6J4QHG tag=J73UUXZ1PWV6 type=write size=1224982 2024-09-14T11:15:16.704 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:16.708+0000 7f76c1e8a8c0 1 < canceled operation key=F3KFS0P1WM7W tag=M7J7XELK7RVD type=write size=907966 2024-09-14T11:15:16.711 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:16.712+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_KS37ZO6MKAH9.2~GXIF2VC6HAVO.0 size=1048576 2024-09-14T11:15:16.714 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:16.716+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_KS37ZO6MKAH9.2~GXIF2VC6HAVO.1 size=1048576 2024-09-14T11:15:16.717 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:16.720+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_KS37ZO6MKAH9.2~GXIF2VC6HAVO.2 size=64314 2024-09-14T11:15:16.717 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:16.720+0000 7f76c1e8a8c0 1 > prepared multipart upload key=KS37ZO6MKAH9 upload=GXIF2VC6HAVO tag=6DH1LHHZJLKK type=write size=3210042 2024-09-14T11:15:16.720 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:16.724+0000 7f76c1e8a8c0 1 < completed part key=_multipart_KS37ZO6MKAH9.2~T638S2V2ZUBB.0 size=1048576 2024-09-14T11:15:16.723 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:16.724+0000 7f76c1e8a8c0 1 < completed part key=_multipart_KS37ZO6MKAH9.2~T638S2V2ZUBB.1 size=95368 2024-09-14T11:15:16.729 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:16.732+0000 7f76c1e8a8c0 1 < completed multipart upload key=KS37ZO6MKAH9 upload=T638S2V2ZUBB tag=EV2PMYD10U8J type=write size=2192520 2024-09-14T11:15:16.733 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:16.736+0000 7f76c1e8a8c0 1 > prepared operation key=MEVTZ7OAD4CA tag=0UNEEBAJF9DH type=del size=126173 2024-09-14T11:15:16.736 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:16.740+0000 7f76c1e8a8c0 1 < completed part key=_multipart_GAVZRU8ZLW7S.2~DHQYO4ICWG0B.0 size=588787 2024-09-14T11:15:16.742 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:16.744+0000 7f76c1e8a8c0 1 < completed multipart upload key=GAVZRU8ZLW7S upload=DHQYO4ICWG0B tag=QQIVBN2EPF38 type=write size=1637363 2024-09-14T11:15:16.746 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:16.748+0000 7f76c1e8a8c0 1 > prepared operation key=GAVZRU8ZLW7S tag=BKJK4S0HH614 type=del size=2105704 2024-09-14T11:15:16.753 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:16.756+0000 7f76c1e8a8c0 1 < suggested remove operation key=TUFOZKTV9XIH tag=LHROJ5QOJPG9 type=del 2024-09-14T11:15:16.757 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:16.760+0000 7f76c1e8a8c0 1 > prepared operation key=Q5IY4J5FOD80 tag=JC2Z7JDCGUNI type=del size=3416023 2024-09-14T11:15:16.760 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:16.764+0000 7f76c1e8a8c0 1 < completed delete operation key=MEVTZ7OAD4CA tag=G8ILLT69L37P type=del 2024-09-14T11:15:16.772 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:16.772+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_SUNCRV0C1XYL.2~0ZJVHTNBRERD.0 size=1048576 2024-09-14T11:15:16.775 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:16.776+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_SUNCRV0C1XYL.2~0ZJVHTNBRERD.1 size=1048576 2024-09-14T11:15:16.778 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:16.780+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_SUNCRV0C1XYL.2~0ZJVHTNBRERD.2 size=965667 2024-09-14T11:15:16.778 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:16.780+0000 7f76c1e8a8c0 1 > prepared multipart upload key=SUNCRV0C1XYL upload=0ZJVHTNBRERD tag=X2LV9GD11SVQ type=write size=4111395 2024-09-14T11:15:16.781 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:16.784+0000 7f76c1e8a8c0 1 < completed write operation key=XC8VWSHZOPFP tag=LFZ2WR1242EG type=write size=278490 2024-09-14T11:15:16.784 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:16.788+0000 7f76c1e8a8c0 1 > prepared operation key=XC8VWSHZOPFP tag=HU382W6R2XPO type=del size=362800 2024-09-14T11:15:16.788 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:16.788+0000 7f76c1e8a8c0 1 < completed part key=_multipart_R5I9H7WAK7Z7.2~NYOBCRB3VIWV.0 size=422643 2024-09-14T11:15:16.793 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:16.796+0000 7f76c1e8a8c0 1 < completed multipart upload key=R5I9H7WAK7Z7 upload=NYOBCRB3VIWV tag=A5VGLXK0E5HP type=write size=1471219 2024-09-14T11:15:16.796 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:16.800+0000 7f76c1e8a8c0 1 > prepared operation key=VI61O3K069BP tag=KCS3YP7UMWWQ type=del size=2197285 2024-09-14T11:15:16.800 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:16.800+0000 7f76c1e8a8c0 1 < completed write operation key=OUMUTEBQ1TD0 tag=3IVBGSQOU7UZ type=write size=834411 2024-09-14T11:15:16.803 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:16.804+0000 7f76c1e8a8c0 1 > prepared operation key=CIRQT9IDJ5OJ tag=GRFN64DBZEYJ type=del size=3894193 2024-09-14T11:15:16.807 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:16.808+0000 7f76c1e8a8c0 1 < completed write operation key=1W5733SDHGDN tag=IAOYD273H2KL type=write size=570262 2024-09-14T11:15:16.813 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:16.816+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_K9W031V6BFJP.2~PXX75ACRF45P.0 size=394454 2024-09-14T11:15:16.813 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:16.816+0000 7f76c1e8a8c0 1 > prepared multipart upload key=K9W031V6BFJP upload=PXX75ACRF45P tag=RNOABMJER9GE type=write size=1443030 2024-09-14T11:15:16.816 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:16.820+0000 7f76c1e8a8c0 1 < canceled operation key=85G6NT78HAWQ tag=NERQ4MREOEMK type=del size=4133881 2024-09-14T11:15:16.820 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:16.820+0000 7f76c1e8a8c0 1 > prepared operation key=1K8ESNXU6WDF tag=9AU8YGT0Q015 type=del size=3368300 2024-09-14T11:15:16.823 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:16.824+0000 7f76c1e8a8c0 1 < completed write operation key=8FFV9G6EQR8F tag=TPKD92I2BJNO type=write size=497036 2024-09-14T11:15:16.826 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:16.828+0000 7f76c1e8a8c0 1 > prepared operation key=VI61O3K069BP tag=FR8US36TE4QE type=del size=3485638 2024-09-14T11:15:16.827 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:16.828+0000 7f76c1e8a8c0 1 < canceled part key=_multipart_BOCIF4TL7X7J.2~LT8BCIQD9W82.0 size=1048576 2024-09-14T11:15:16.830 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:16.832+0000 7f76c1e8a8c0 1 < completed part key=_multipart_BOCIF4TL7X7J.2~LT8BCIQD9W82.1 size=199848 2024-09-14T11:15:16.835 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:16.836+0000 7f76c1e8a8c0 1 < canceled multipart upload key=BOCIF4TL7X7J upload=LT8BCIQD9W82 tag=5HDRJJP6I13L type=write size=2297000 2024-09-14T11:15:16.842 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:16.844+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_H9CQV6L29SL5.2~AELI2SD318LG.0 size=1048576 2024-09-14T11:15:16.846 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:16.848+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_H9CQV6L29SL5.2~AELI2SD318LG.1 size=129436 2024-09-14T11:15:16.846 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:16.848+0000 7f76c1e8a8c0 1 > prepared multipart upload key=H9CQV6L29SL5 upload=AELI2SD318LG tag=70LC2WYJW407 type=write size=2226588 2024-09-14T11:15:16.849 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:16.852+0000 7f76c1e8a8c0 1 < completed part key=_multipart_F3KFS0P1WM7W.2~265WY5B694W6.0 size=1048576 2024-09-14T11:15:16.851 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:16.852+0000 7f76c1e8a8c0 1 < completed part key=_multipart_F3KFS0P1WM7W.2~265WY5B694W6.1 size=833302 2024-09-14T11:15:16.856 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:16.860+0000 7f76c1e8a8c0 1 < completed multipart upload key=F3KFS0P1WM7W upload=265WY5B694W6 tag=E5Y9BRY066KC type=write size=2930454 2024-09-14T11:15:16.862 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:16.864+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_1W5733SDHGDN.2~KBQ6UYDT0N1Z.0 size=1048576 2024-09-14T11:15:16.865 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:16.868+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_1W5733SDHGDN.2~KBQ6UYDT0N1Z.1 size=1048576 2024-09-14T11:15:16.868 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:16.872+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_1W5733SDHGDN.2~KBQ6UYDT0N1Z.2 size=483834 2024-09-14T11:15:16.868 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:16.872+0000 7f76c1e8a8c0 1 > prepared multipart upload key=1W5733SDHGDN upload=KBQ6UYDT0N1Z tag=K1E1P8SPH9XX type=write size=3629562 2024-09-14T11:15:16.871 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:16.872+0000 7f76c1e8a8c0 1 < completed delete operation key=VI61O3K069BP tag=RJDK6TFZ1ZBY type=del 2024-09-14T11:15:16.875 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:16.876+0000 7f76c1e8a8c0 1 > prepared operation key=F3KFS0P1WM7W tag=KZ3WIFHJPBD9 type=del size=2120520 2024-09-14T11:15:16.878 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:16.880+0000 7f76c1e8a8c0 1 < completed part key=_multipart_GZM0AQVHNCMM.2~0PMGTW9ODA9Y.0 size=1048576 2024-09-14T11:15:16.881 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:16.884+0000 7f76c1e8a8c0 1 < completed part key=_multipart_GZM0AQVHNCMM.2~0PMGTW9ODA9Y.1 size=808493 2024-09-14T11:15:16.885 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:16.888+0000 7f76c1e8a8c0 1 < completed multipart upload key=GZM0AQVHNCMM upload=0PMGTW9ODA9Y tag=DT4Z2CO733CS type=write size=2905645 2024-09-14T11:15:16.889 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:16.892+0000 7f76c1e8a8c0 1 > prepared operation key=CIRQT9IDJ5OJ tag=YLE1JV5G4XKP type=del size=2906996 2024-09-14T11:15:16.892 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:16.896+0000 7f76c1e8a8c0 1 < completed part key=_multipart_8PZOVFEYYSOG.2~H1PGWK6J4QHG.0 size=176406 2024-09-14T11:15:16.897 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:16.900+0000 7f76c1e8a8c0 1 < completed multipart upload key=8PZOVFEYYSOG upload=H1PGWK6J4QHG tag=J73UUXZ1PWV6 type=write size=1224982 2024-09-14T11:15:16.904 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:16.904+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_KS37ZO6MKAH9.2~3PL6THB03L97.0 size=423023 2024-09-14T11:15:16.904 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:16.904+0000 7f76c1e8a8c0 1 > prepared multipart upload key=KS37ZO6MKAH9 upload=3PL6THB03L97 tag=FMYYSUJFZIOQ type=write size=1471599 2024-09-14T11:15:16.907 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:16.908+0000 7f76c1e8a8c0 1 < completed part key=_multipart_KS37ZO6MKAH9.2~GXIF2VC6HAVO.0 size=1048576 2024-09-14T11:15:16.910 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:16.912+0000 7f76c1e8a8c0 1 < completed part key=_multipart_KS37ZO6MKAH9.2~GXIF2VC6HAVO.1 size=1048576 2024-09-14T11:15:16.910 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:16.912+0000 7f76c1e8a8c0 1 < canceled part key=_multipart_KS37ZO6MKAH9.2~GXIF2VC6HAVO.2 size=64314 2024-09-14T11:15:16.915 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:16.916+0000 7f76c1e8a8c0 1 < canceled multipart upload key=KS37ZO6MKAH9 upload=GXIF2VC6HAVO tag=6DH1LHHZJLKK type=write size=3210042 2024-09-14T11:15:16.921 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:16.924+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_8PZOVFEYYSOG.2~IX9FG6BUCQ8X.0 size=1048576 2024-09-14T11:15:16.923 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:16.924+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_8PZOVFEYYSOG.2~IX9FG6BUCQ8X.1 size=1048576 2024-09-14T11:15:16.925 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:16.928+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_8PZOVFEYYSOG.2~IX9FG6BUCQ8X.2 size=687369 2024-09-14T11:15:16.925 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:16.928+0000 7f76c1e8a8c0 1 > prepared multipart upload key=8PZOVFEYYSOG upload=IX9FG6BUCQ8X tag=FXL1H8SL8IG0 type=write size=3833097 2024-09-14T11:15:16.928 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:16.928+0000 7f76c1e8a8c0 1 < completed delete operation key=MEVTZ7OAD4CA tag=0UNEEBAJF9DH type=del 2024-09-14T11:15:16.931 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:16.932+0000 7f76c1e8a8c0 1 > prepared operation key=KS37ZO6MKAH9 tag=N3OF17RWAQDQ type=write size=57593 2024-09-14T11:15:16.934 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:16.936+0000 7f76c1e8a8c0 1 < completed delete operation key=GAVZRU8ZLW7S tag=BKJK4S0HH614 type=del 2024-09-14T11:15:16.939 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:16.940+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_VI61O3K069BP.2~RU54M5UCJJMZ.0 size=211369 2024-09-14T11:15:16.940 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:16.940+0000 7f76c1e8a8c0 1 > prepared multipart upload key=VI61O3K069BP upload=RU54M5UCJJMZ tag=0KU7ILI4ZWWC type=write size=1259945 2024-09-14T11:15:16.943 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:16.944+0000 7f76c1e8a8c0 1 < completed delete operation key=Q5IY4J5FOD80 tag=JC2Z7JDCGUNI type=del 2024-09-14T11:15:16.949 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:16.952+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_K9W031V6BFJP.2~UUSSSCK55UA0.0 size=1048576 2024-09-14T11:15:16.951 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:16.952+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_K9W031V6BFJP.2~UUSSSCK55UA0.1 size=1048576 2024-09-14T11:15:16.954 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:16.956+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_K9W031V6BFJP.2~UUSSSCK55UA0.2 size=952411 2024-09-14T11:15:16.954 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:16.956+0000 7f76c1e8a8c0 1 > prepared multipart upload key=K9W031V6BFJP upload=UUSSSCK55UA0 tag=IL9GEEHZUCCR type=write size=4098139 2024-09-14T11:15:16.957 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:16.960+0000 7f76c1e8a8c0 1 < completed part key=_multipart_SUNCRV0C1XYL.2~0ZJVHTNBRERD.0 size=1048576 2024-09-14T11:15:16.960 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:16.960+0000 7f76c1e8a8c0 1 < completed part key=_multipart_SUNCRV0C1XYL.2~0ZJVHTNBRERD.1 size=1048576 2024-09-14T11:15:16.962 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:16.964+0000 7f76c1e8a8c0 1 < completed part key=_multipart_SUNCRV0C1XYL.2~0ZJVHTNBRERD.2 size=965667 2024-09-14T11:15:16.967 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:16.968+0000 7f76c1e8a8c0 1 < completed multipart upload key=SUNCRV0C1XYL upload=0ZJVHTNBRERD tag=X2LV9GD11SVQ type=write size=4111395 2024-09-14T11:15:16.970 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:16.972+0000 7f76c1e8a8c0 1 > prepared operation key=GZM0AQVHNCMM tag=LS9CIMWQ3D97 type=del size=1184972 2024-09-14T11:15:16.974 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:16.976+0000 7f76c1e8a8c0 1 < canceled operation key=XC8VWSHZOPFP tag=HU382W6R2XPO type=del size=362800 2024-09-14T11:15:16.977 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:16.980+0000 7f76c1e8a8c0 1 > prepared operation key=TZO40K6J9877 tag=Z4EGD4GUAYL2 type=del size=2671077 2024-09-14T11:15:16.980 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:16.984+0000 7f76c1e8a8c0 1 < completed delete operation key=VI61O3K069BP tag=KCS3YP7UMWWQ type=del 2024-09-14T11:15:16.985 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:16.988+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_6TIJR323NMOH.2~8W704RIPONAN.0 size=205096 2024-09-14T11:15:16.985 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:16.988+0000 7f76c1e8a8c0 1 > prepared multipart upload key=6TIJR323NMOH upload=8W704RIPONAN tag=M7H0DDDIG3I5 type=write size=1253672 2024-09-14T11:15:16.988 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:16.992+0000 7f76c1e8a8c0 1 < completed delete operation key=CIRQT9IDJ5OJ tag=GRFN64DBZEYJ type=del 2024-09-14T11:15:16.994 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:16.996+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_OOUEM16XL80W.2~SFXJ62OV6SFQ.0 size=1048576 2024-09-14T11:15:16.996 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:16.996+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_OOUEM16XL80W.2~SFXJ62OV6SFQ.1 size=1048576 2024-09-14T11:15:16.998 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:17.000+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_OOUEM16XL80W.2~SFXJ62OV6SFQ.2 size=965248 2024-09-14T11:15:16.998 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:17.000+0000 7f76c1e8a8c0 1 > prepared multipart upload key=OOUEM16XL80W upload=SFXJ62OV6SFQ tag=DS5DN73NS3T5 type=write size=4110976 2024-09-14T11:15:17.001 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:17.004+0000 7f76c1e8a8c0 1 < completed part key=_multipart_K9W031V6BFJP.2~PXX75ACRF45P.0 size=394454 2024-09-14T11:15:17.006 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:17.008+0000 7f76c1e8a8c0 1 < completed multipart upload key=K9W031V6BFJP upload=PXX75ACRF45P tag=RNOABMJER9GE type=write size=1443030 2024-09-14T11:15:17.010 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:17.012+0000 7f76c1e8a8c0 1 > prepared operation key=VI61O3K069BP tag=9DNWFRA5422C type=del size=2508421 2024-09-14T11:15:17.013 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:17.016+0000 7f76c1e8a8c0 1 < completed delete operation key=1K8ESNXU6WDF tag=9AU8YGT0Q015 type=del 2024-09-14T11:15:17.019 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:17.020+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_1K8ESNXU6WDF.2~SUQKFMO2PJXD.0 size=1048576 2024-09-14T11:15:17.021 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:17.024+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_1K8ESNXU6WDF.2~SUQKFMO2PJXD.1 size=984741 2024-09-14T11:15:17.022 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:17.024+0000 7f76c1e8a8c0 1 > prepared multipart upload key=1K8ESNXU6WDF upload=SUQKFMO2PJXD tag=PC4ND45Y5OQD type=write size=3081893 2024-09-14T11:15:17.025 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:17.028+0000 7f76c1e8a8c0 1 < completed delete operation key=VI61O3K069BP tag=FR8US36TE4QE type=del 2024-09-14T11:15:17.028 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:17.028+0000 7f76c1e8a8c0 1 > prepared operation key=W0MDRE9YO3UP tag=DQSVRB497WA1 type=write size=480647 2024-09-14T11:15:17.031 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:17.032+0000 7f76c1e8a8c0 1 < completed part key=_multipart_H9CQV6L29SL5.2~AELI2SD318LG.0 size=1048576 2024-09-14T11:15:17.034 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:17.036+0000 7f76c1e8a8c0 1 < completed part key=_multipart_H9CQV6L29SL5.2~AELI2SD318LG.1 size=129436 2024-09-14T11:15:17.039 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:17.040+0000 7f76c1e8a8c0 1 < completed multipart upload key=H9CQV6L29SL5 upload=AELI2SD318LG tag=70LC2WYJW407 type=write size=2226588 2024-09-14T11:15:17.042 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:17.044+0000 7f76c1e8a8c0 1 > prepared operation key=OOUEM16XL80W tag=AYMYF4K8JIF6 type=del size=168714 2024-09-14T11:15:17.046 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:17.048+0000 7f76c1e8a8c0 1 < completed part key=_multipart_1W5733SDHGDN.2~KBQ6UYDT0N1Z.0 size=1048576 2024-09-14T11:15:17.048 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:17.052+0000 7f76c1e8a8c0 1 < completed part key=_multipart_1W5733SDHGDN.2~KBQ6UYDT0N1Z.1 size=1048576 2024-09-14T11:15:17.051 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:17.052+0000 7f76c1e8a8c0 1 < completed part key=_multipart_1W5733SDHGDN.2~KBQ6UYDT0N1Z.2 size=483834 2024-09-14T11:15:17.056 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:17.056+0000 7f76c1e8a8c0 1 < completed multipart upload key=1W5733SDHGDN upload=KBQ6UYDT0N1Z tag=K1E1P8SPH9XX type=write size=3629562 2024-09-14T11:15:17.059 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:17.060+0000 7f76c1e8a8c0 1 > prepared operation key=XC8VWSHZOPFP tag=ABHWUPS5K3DD type=del size=3644797 2024-09-14T11:15:17.067 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:17.068+0000 7f76c1e8a8c0 1 < completed delete operation key=F3KFS0P1WM7W tag=KZ3WIFHJPBD9 type=del 2024-09-14T11:15:17.071 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:17.072+0000 7f76c1e8a8c0 1 > prepared operation key=GZM0AQVHNCMM tag=TOF6HNXRA01M type=del size=246760 2024-09-14T11:15:17.074 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:17.076+0000 7f76c1e8a8c0 1 < completed delete operation key=CIRQT9IDJ5OJ tag=YLE1JV5G4XKP type=del 2024-09-14T11:15:17.081 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:17.084+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_LZ0YNFOVFYCL.2~6B2U4TQHU4OB.0 size=1048576 2024-09-14T11:15:17.083 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:17.084+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_LZ0YNFOVFYCL.2~6B2U4TQHU4OB.1 size=235599 2024-09-14T11:15:17.083 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:17.084+0000 7f76c1e8a8c0 1 > prepared multipart upload key=LZ0YNFOVFYCL upload=6B2U4TQHU4OB tag=2N7M5U8QAQET type=write size=2332751 2024-09-14T11:15:17.087 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:17.088+0000 7f76c1e8a8c0 1 < completed part key=_multipart_KS37ZO6MKAH9.2~3PL6THB03L97.0 size=423023 2024-09-14T11:15:17.093 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:17.096+0000 7f76c1e8a8c0 1 < completed multipart upload key=KS37ZO6MKAH9 upload=3PL6THB03L97 tag=FMYYSUJFZIOQ type=write size=1471599 2024-09-14T11:15:17.099 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:17.100+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_BOCIF4TL7X7J.2~R69RC7KN6Z41.0 size=282616 2024-09-14T11:15:17.099 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:17.100+0000 7f76c1e8a8c0 1 > prepared multipart upload key=BOCIF4TL7X7J upload=R69RC7KN6Z41 tag=184S5YA0RRMO type=write size=1331192 2024-09-14T11:15:17.102 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:17.104+0000 7f76c1e8a8c0 1 < completed part key=_multipart_8PZOVFEYYSOG.2~IX9FG6BUCQ8X.0 size=1048576 2024-09-14T11:15:17.105 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:17.108+0000 7f76c1e8a8c0 1 < completed part key=_multipart_8PZOVFEYYSOG.2~IX9FG6BUCQ8X.1 size=1048576 2024-09-14T11:15:17.106 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:17.108+0000 7f76c1e8a8c0 1 < canceled part key=_multipart_8PZOVFEYYSOG.2~IX9FG6BUCQ8X.2 size=687369 2024-09-14T11:15:17.111 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:17.112+0000 7f76c1e8a8c0 1 < canceled multipart upload key=8PZOVFEYYSOG upload=IX9FG6BUCQ8X tag=FXL1H8SL8IG0 type=write size=3833097 2024-09-14T11:15:17.115 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:17.116+0000 7f76c1e8a8c0 1 > prepared operation key=TUFOZKTV9XIH tag=GIQUPG4XKP48 type=del size=1596359 2024-09-14T11:15:17.121 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:17.124+0000 7f76c1e8a8c0 1 < suggested remove operation key=KS37ZO6MKAH9 tag=N3OF17RWAQDQ type=write 2024-09-14T11:15:17.127 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:17.128+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_1W5733SDHGDN.2~GWSFMLZW8W35.0 size=1048576 2024-09-14T11:15:17.129 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:17.132+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_1W5733SDHGDN.2~GWSFMLZW8W35.1 size=1048576 2024-09-14T11:15:17.131 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:17.132+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_1W5733SDHGDN.2~GWSFMLZW8W35.2 size=220929 2024-09-14T11:15:17.131 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:17.132+0000 7f76c1e8a8c0 1 > prepared multipart upload key=1W5733SDHGDN upload=GWSFMLZW8W35 tag=K2JBHRHN3CQ2 type=write size=3366657 2024-09-14T11:15:17.137 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:17.136+0000 7f76c1e8a8c0 1 < completed part key=_multipart_VI61O3K069BP.2~RU54M5UCJJMZ.0 size=211369 2024-09-14T11:15:17.138 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:17.140+0000 7f76c1e8a8c0 1 < completed multipart upload key=VI61O3K069BP upload=RU54M5UCJJMZ tag=0KU7ILI4ZWWC type=write size=1259945 2024-09-14T11:15:17.143 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:17.144+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_W0MDRE9YO3UP.2~R27L8A6JMSZR.0 size=1048576 2024-09-14T11:15:17.145 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:17.148+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_W0MDRE9YO3UP.2~R27L8A6JMSZR.1 size=1048576 2024-09-14T11:15:17.148 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:17.148+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_W0MDRE9YO3UP.2~R27L8A6JMSZR.2 size=451314 2024-09-14T11:15:17.148 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:17.148+0000 7f76c1e8a8c0 1 > prepared multipart upload key=W0MDRE9YO3UP upload=R27L8A6JMSZR tag=AKOVV5PN5ZR0 type=write size=3597042 2024-09-14T11:15:17.151 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:17.152+0000 7f76c1e8a8c0 1 < completed part key=_multipart_K9W031V6BFJP.2~UUSSSCK55UA0.0 size=1048576 2024-09-14T11:15:17.153 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:17.156+0000 7f76c1e8a8c0 1 < completed part key=_multipart_K9W031V6BFJP.2~UUSSSCK55UA0.1 size=1048576 2024-09-14T11:15:17.155 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:17.156+0000 7f76c1e8a8c0 1 < completed part key=_multipart_K9W031V6BFJP.2~UUSSSCK55UA0.2 size=952411 2024-09-14T11:15:17.160 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:17.164+0000 7f76c1e8a8c0 1 < completed multipart upload key=K9W031V6BFJP upload=UUSSSCK55UA0 tag=IL9GEEHZUCCR type=write size=4098139 2024-09-14T11:15:17.166 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:17.168+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_8PZOVFEYYSOG.2~XCC53SB0LI5Z.0 size=1048576 2024-09-14T11:15:17.168 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:17.172+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_8PZOVFEYYSOG.2~XCC53SB0LI5Z.1 size=1048576 2024-09-14T11:15:17.171 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:17.172+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_8PZOVFEYYSOG.2~XCC53SB0LI5Z.2 size=225197 2024-09-14T11:15:17.171 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:17.172+0000 7f76c1e8a8c0 1 > prepared multipart upload key=8PZOVFEYYSOG upload=XCC53SB0LI5Z tag=2N2ZGMRAEUA5 type=write size=3370925 2024-09-14T11:15:17.177 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:17.180+0000 7f76c1e8a8c0 1 < suggested remove operation key=GZM0AQVHNCMM tag=LS9CIMWQ3D97 type=del 2024-09-14T11:15:17.181 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:17.184+0000 7f76c1e8a8c0 1 > prepared operation key=Q5IY4J5FOD80 tag=AWYGK1D45WRB type=del size=3463140 2024-09-14T11:15:17.184 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:17.184+0000 7f76c1e8a8c0 1 < canceled operation key=TZO40K6J9877 tag=Z4EGD4GUAYL2 type=del size=2671077 2024-09-14T11:15:17.187 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:17.188+0000 7f76c1e8a8c0 1 > prepared operation key=W0MDRE9YO3UP tag=XWBNBY8R3Q0H type=del size=1587045 2024-09-14T11:15:17.188 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:17.192+0000 7f76c1e8a8c0 1 < canceled part key=_multipart_6TIJR323NMOH.2~8W704RIPONAN.0 size=205096 2024-09-14T11:15:17.193 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:17.196+0000 7f76c1e8a8c0 1 < canceled multipart upload key=6TIJR323NMOH upload=8W704RIPONAN tag=M7H0DDDIG3I5 type=write size=1253672 2024-09-14T11:15:17.199 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:17.200+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_TZO40K6J9877.2~8NAYSP1WZRSO.0 size=849540 2024-09-14T11:15:17.199 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:17.200+0000 7f76c1e8a8c0 1 > prepared multipart upload key=TZO40K6J9877 upload=8NAYSP1WZRSO tag=KCRYEY7AYAMZ type=write size=1898116 2024-09-14T11:15:17.200 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:17.204+0000 7f76c1e8a8c0 1 < canceled part key=_multipart_OOUEM16XL80W.2~SFXJ62OV6SFQ.0 size=1048576 2024-09-14T11:15:17.203 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:17.204+0000 7f76c1e8a8c0 1 < completed part key=_multipart_OOUEM16XL80W.2~SFXJ62OV6SFQ.1 size=1048576 2024-09-14T11:15:17.203 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:17.204+0000 7f76c1e8a8c0 1 < canceled part key=_multipart_OOUEM16XL80W.2~SFXJ62OV6SFQ.2 size=965248 2024-09-14T11:15:17.208 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:17.212+0000 7f76c1e8a8c0 1 < canceled multipart upload key=OOUEM16XL80W upload=SFXJ62OV6SFQ tag=DS5DN73NS3T5 type=write size=4110976 2024-09-14T11:15:17.212 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:17.212+0000 7f76c1e8a8c0 1 > prepared operation key=OOUEM16XL80W tag=3XKG2AKX8X9P type=del size=3617498 2024-09-14T11:15:17.215 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:17.216+0000 7f76c1e8a8c0 1 < completed delete operation key=VI61O3K069BP tag=9DNWFRA5422C type=del 2024-09-14T11:15:17.221 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:17.224+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_S43U13LYETS4.2~JO5LYQ5BTPKK.0 size=1048576 2024-09-14T11:15:17.224 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:17.224+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_S43U13LYETS4.2~JO5LYQ5BTPKK.1 size=708028 2024-09-14T11:15:17.224 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:17.224+0000 7f76c1e8a8c0 1 > prepared multipart upload key=S43U13LYETS4 upload=JO5LYQ5BTPKK tag=J8YJA9CWJGF7 type=write size=2805180 2024-09-14T11:15:17.227 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:17.228+0000 7f76c1e8a8c0 1 < completed part key=_multipart_1K8ESNXU6WDF.2~SUQKFMO2PJXD.0 size=1048576 2024-09-14T11:15:17.229 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:17.232+0000 7f76c1e8a8c0 1 < completed part key=_multipart_1K8ESNXU6WDF.2~SUQKFMO2PJXD.1 size=984741 2024-09-14T11:15:17.235 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:17.236+0000 7f76c1e8a8c0 1 < completed multipart upload key=1K8ESNXU6WDF upload=SUQKFMO2PJXD tag=PC4ND45Y5OQD type=write size=3081893 2024-09-14T11:15:17.238 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:17.240+0000 7f76c1e8a8c0 1 > prepared operation key=BOCIF4TL7X7J tag=CP3O53Q2TAJE type=write size=241518 2024-09-14T11:15:17.242 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:17.244+0000 7f76c1e8a8c0 1 < completed write operation key=W0MDRE9YO3UP tag=DQSVRB497WA1 type=write size=480647 2024-09-14T11:15:17.245 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:17.248+0000 7f76c1e8a8c0 1 > prepared operation key=OOUEM16XL80W tag=II52U5HQFS8Z type=write size=894603 2024-09-14T11:15:17.249 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:17.252+0000 7f76c1e8a8c0 1 < completed delete operation key=OOUEM16XL80W tag=AYMYF4K8JIF6 type=del 2024-09-14T11:15:17.252 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:17.252+0000 7f76c1e8a8c0 1 > prepared operation key=GZM0AQVHNCMM tag=MNHZ7G3L4RKQ type=del size=2018744 2024-09-14T11:15:17.255 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:17.256+0000 7f76c1e8a8c0 1 < completed delete operation key=XC8VWSHZOPFP tag=ABHWUPS5K3DD type=del 2024-09-14T11:15:17.259 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:17.260+0000 7f76c1e8a8c0 1 > prepared operation key=8FFV9G6EQR8F tag=QBN4SNS3C9EK type=del size=2428388 2024-09-14T11:15:17.262 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:17.264+0000 7f76c1e8a8c0 -1 < failed to complete operation key=GZM0AQVHNCMM tag=TOF6HNXRA01M type=del size=246760: (22) Invalid argument 2024-09-14T11:15:17.268 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:17.272+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_TZO40K6J9877.2~DFAOYQZZ7TD7.0 size=1048576 2024-09-14T11:15:17.271 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:17.272+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_TZO40K6J9877.2~DFAOYQZZ7TD7.1 size=287854 2024-09-14T11:15:17.271 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:17.272+0000 7f76c1e8a8c0 1 > prepared multipart upload key=TZO40K6J9877 upload=DFAOYQZZ7TD7 tag=2L3N0EY9S908 type=write size=2385006 2024-09-14T11:15:17.275 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:17.276+0000 7f76c1e8a8c0 1 < completed part key=_multipart_LZ0YNFOVFYCL.2~6B2U4TQHU4OB.0 size=1048576 2024-09-14T11:15:17.275 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:17.276+0000 7f76c1e8a8c0 1 < canceled part key=_multipart_LZ0YNFOVFYCL.2~6B2U4TQHU4OB.1 size=235599 2024-09-14T11:15:17.280 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:17.280+0000 7f76c1e8a8c0 1 < canceled multipart upload key=LZ0YNFOVFYCL upload=6B2U4TQHU4OB tag=2N7M5U8QAQET type=write size=2332751 2024-09-14T11:15:17.286 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:17.288+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_OUMUTEBQ1TD0.2~VZ9C7A3X4SBH.0 size=1048576 2024-09-14T11:15:17.289 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:17.292+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_OUMUTEBQ1TD0.2~VZ9C7A3X4SBH.1 size=1048576 2024-09-14T11:15:17.291 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:17.292+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_OUMUTEBQ1TD0.2~VZ9C7A3X4SBH.2 size=881802 2024-09-14T11:15:17.291 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:17.292+0000 7f76c1e8a8c0 1 > prepared multipart upload key=OUMUTEBQ1TD0 upload=VZ9C7A3X4SBH tag=C3DQKA4KNJPN type=write size=4027530 2024-09-14T11:15:17.295 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:17.296+0000 7f76c1e8a8c0 1 < completed part key=_multipart_BOCIF4TL7X7J.2~R69RC7KN6Z41.0 size=282616 2024-09-14T11:15:17.300 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:17.304+0000 7f76c1e8a8c0 1 < completed multipart upload key=BOCIF4TL7X7J upload=R69RC7KN6Z41 tag=184S5YA0RRMO type=write size=1331192 2024-09-14T11:15:17.303 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:17.304+0000 7f76c1e8a8c0 1 > prepared operation key=K2EEZLRK7MVO tag=6RF9GPIHMGQ1 type=write size=436438 2024-09-14T11:15:17.306 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:17.308+0000 7f76c1e8a8c0 1 < completed delete operation key=TUFOZKTV9XIH tag=GIQUPG4XKP48 type=del 2024-09-14T11:15:17.312 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:17.316+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_8FFV9G6EQR8F.2~K8G0ZUTE3LP3.0 size=1048576 2024-09-14T11:15:17.315 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:17.316+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_8FFV9G6EQR8F.2~K8G0ZUTE3LP3.1 size=363690 2024-09-14T11:15:17.315 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:17.316+0000 7f76c1e8a8c0 1 > prepared multipart upload key=8FFV9G6EQR8F upload=K8G0ZUTE3LP3 tag=Y623YVNSE7TH type=write size=2460842 2024-09-14T11:15:17.318 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:17.320+0000 7f76c1e8a8c0 1 < completed part key=_multipart_1W5733SDHGDN.2~GWSFMLZW8W35.0 size=1048576 2024-09-14T11:15:17.320 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:17.324+0000 7f76c1e8a8c0 1 < completed part key=_multipart_1W5733SDHGDN.2~GWSFMLZW8W35.1 size=1048576 2024-09-14T11:15:17.323 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:17.324+0000 7f76c1e8a8c0 1 < completed part key=_multipart_1W5733SDHGDN.2~GWSFMLZW8W35.2 size=220929 2024-09-14T11:15:17.329 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:17.332+0000 7f76c1e8a8c0 1 < completed multipart upload key=1W5733SDHGDN upload=GWSFMLZW8W35 tag=K2JBHRHN3CQ2 type=write size=3366657 2024-09-14T11:15:17.332 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:17.332+0000 7f76c1e8a8c0 1 > prepared operation key=MEVTZ7OAD4CA tag=EN1EDWRTH9BS type=del size=4082683 2024-09-14T11:15:17.335 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:17.336+0000 7f76c1e8a8c0 1 < completed part key=_multipart_W0MDRE9YO3UP.2~R27L8A6JMSZR.0 size=1048576 2024-09-14T11:15:17.338 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:17.340+0000 7f76c1e8a8c0 1 < completed part key=_multipart_W0MDRE9YO3UP.2~R27L8A6JMSZR.1 size=1048576 2024-09-14T11:15:17.341 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:17.344+0000 7f76c1e8a8c0 1 < completed part key=_multipart_W0MDRE9YO3UP.2~R27L8A6JMSZR.2 size=451314 2024-09-14T11:15:17.346 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:17.348+0000 7f76c1e8a8c0 1 < completed multipart upload key=W0MDRE9YO3UP upload=R27L8A6JMSZR tag=AKOVV5PN5ZR0 type=write size=3597042 2024-09-14T11:15:17.351 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:17.352+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_6TIJR323NMOH.2~JO627WI8Q0TM.0 size=1048576 2024-09-14T11:15:17.354 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:17.356+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_6TIJR323NMOH.2~JO627WI8Q0TM.1 size=627884 2024-09-14T11:15:17.354 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:17.356+0000 7f76c1e8a8c0 1 > prepared multipart upload key=6TIJR323NMOH upload=JO627WI8Q0TM tag=JFUTTCCON8VG type=write size=2725036 2024-09-14T11:15:17.357 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:17.360+0000 7f76c1e8a8c0 1 < completed part key=_multipart_8PZOVFEYYSOG.2~XCC53SB0LI5Z.0 size=1048576 2024-09-14T11:15:17.364 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:17.364+0000 7f76c1e8a8c0 1 < completed part key=_multipart_8PZOVFEYYSOG.2~XCC53SB0LI5Z.1 size=1048576 2024-09-14T11:15:17.366 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:17.368+0000 7f76c1e8a8c0 1 < completed part key=_multipart_8PZOVFEYYSOG.2~XCC53SB0LI5Z.2 size=225197 2024-09-14T11:15:17.371 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:17.372+0000 7f76c1e8a8c0 1 < completed multipart upload key=8PZOVFEYYSOG upload=XCC53SB0LI5Z tag=2N2ZGMRAEUA5 type=write size=3370925 2024-09-14T11:15:17.374 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:17.376+0000 7f76c1e8a8c0 1 > prepared operation key=GZM0AQVHNCMM tag=O1VDBGRH9GOV type=del size=2274546 2024-09-14T11:15:17.377 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:17.380+0000 7f76c1e8a8c0 1 < completed delete operation key=Q5IY4J5FOD80 tag=AWYGK1D45WRB type=del 2024-09-14T11:15:17.380 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:17.380+0000 7f76c1e8a8c0 1 > prepared operation key=S43U13LYETS4 tag=7OSCOVEKHIUV type=del size=2626445 2024-09-14T11:15:17.382 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:17.384+0000 7f76c1e8a8c0 1 < completed delete operation key=W0MDRE9YO3UP tag=XWBNBY8R3Q0H type=del 2024-09-14T11:15:17.386 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:17.388+0000 7f76c1e8a8c0 1 > prepared operation key=CIRQT9IDJ5OJ tag=UK0QNNXZX1OL type=del size=3333544 2024-09-14T11:15:17.389 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:17.392+0000 7f76c1e8a8c0 1 < completed part key=_multipart_TZO40K6J9877.2~8NAYSP1WZRSO.0 size=849540 2024-09-14T11:15:17.394 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:17.396+0000 7f76c1e8a8c0 1 < completed multipart upload key=TZO40K6J9877 upload=8NAYSP1WZRSO tag=KCRYEY7AYAMZ type=write size=1898116 2024-09-14T11:15:17.397 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:17.400+0000 7f76c1e8a8c0 1 > prepared operation key=H9CQV6L29SL5 tag=EZ72DAN7T3I6 type=del size=3021113 2024-09-14T11:15:17.404 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:17.404+0000 7f76c1e8a8c0 1 < suggested remove operation key=OOUEM16XL80W tag=3XKG2AKX8X9P type=del 2024-09-14T11:15:17.410 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:17.412+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_1K8ESNXU6WDF.2~V5QFEEOSGE5B.0 size=1048576 2024-09-14T11:15:17.413 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:17.416+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_1K8ESNXU6WDF.2~V5QFEEOSGE5B.1 size=1027248 2024-09-14T11:15:17.413 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:17.416+0000 7f76c1e8a8c0 1 > prepared multipart upload key=1K8ESNXU6WDF upload=V5QFEEOSGE5B tag=VG3W04D8JBW1 type=write size=3124400 2024-09-14T11:15:17.416 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:17.416+0000 7f76c1e8a8c0 1 < completed part key=_multipart_S43U13LYETS4.2~JO5LYQ5BTPKK.0 size=1048576 2024-09-14T11:15:17.418 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:17.420+0000 7f76c1e8a8c0 1 < completed part key=_multipart_S43U13LYETS4.2~JO5LYQ5BTPKK.1 size=708028 2024-09-14T11:15:17.424 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:17.424+0000 7f76c1e8a8c0 1 < completed multipart upload key=S43U13LYETS4 upload=JO5LYQ5BTPKK tag=J8YJA9CWJGF7 type=write size=2805180 2024-09-14T11:15:17.427 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:17.428+0000 7f76c1e8a8c0 1 > prepared operation key=HJ701768A6I7 tag=FMR054H4SQPS type=del size=1465945 2024-09-14T11:15:17.431 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:17.432+0000 7f76c1e8a8c0 1 < completed write operation key=BOCIF4TL7X7J tag=CP3O53Q2TAJE type=write size=241518 2024-09-14T11:15:17.437 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:17.440+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_SUNCRV0C1XYL.2~PCV3FLN30HZG.0 size=137209 2024-09-14T11:15:17.437 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:17.440+0000 7f76c1e8a8c0 1 > prepared multipart upload key=SUNCRV0C1XYL upload=PCV3FLN30HZG tag=30VZ378RFIWA type=write size=1185785 2024-09-14T11:15:17.438 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:17.440+0000 7f76c1e8a8c0 -1 < no bi entry to suggest for operation key=OOUEM16XL80W tag=II52U5HQFS8Z type=write size=894603: (2) No such file or directory 2024-09-14T11:15:17.441 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:17.444+0000 7f76c1e8a8c0 1 > prepared operation key=OOUEM16XL80W tag=2XGB1RRF82UW type=del size=1952281 2024-09-14T11:15:17.445 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:17.448+0000 7f76c1e8a8c0 1 < completed delete operation key=GZM0AQVHNCMM tag=MNHZ7G3L4RKQ type=del 2024-09-14T11:15:17.448 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:17.452+0000 7f76c1e8a8c0 1 > prepared operation key=OUMUTEBQ1TD0 tag=8SDAOGAO52PV type=del size=3786871 2024-09-14T11:15:17.451 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:17.452+0000 7f76c1e8a8c0 1 < completed delete operation key=8FFV9G6EQR8F tag=QBN4SNS3C9EK type=del 2024-09-14T11:15:17.457 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:17.460+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_HJ701768A6I7.2~6ITVAE5IVEYS.0 size=706973 2024-09-14T11:15:17.457 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:17.460+0000 7f76c1e8a8c0 1 > prepared multipart upload key=HJ701768A6I7 upload=6ITVAE5IVEYS tag=ZJC780U7Z799 type=write size=1755549 2024-09-14T11:15:17.461 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:17.464+0000 7f76c1e8a8c0 1 < completed part key=_multipart_TZO40K6J9877.2~DFAOYQZZ7TD7.0 size=1048576 2024-09-14T11:15:17.461 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:17.464+0000 7f76c1e8a8c0 1 < canceled part key=_multipart_TZO40K6J9877.2~DFAOYQZZ7TD7.1 size=287854 2024-09-14T11:15:17.465 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:17.468+0000 7f76c1e8a8c0 1 < canceled multipart upload key=TZO40K6J9877 upload=DFAOYQZZ7TD7 tag=2L3N0EY9S908 type=write size=2385006 2024-09-14T11:15:17.468 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:17.472+0000 7f76c1e8a8c0 1 > prepared operation key=HS7T50JORDQJ tag=B1G2CCFPZWT2 type=del size=4066789 2024-09-14T11:15:17.472 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:17.472+0000 7f76c1e8a8c0 1 < completed part key=_multipart_OUMUTEBQ1TD0.2~VZ9C7A3X4SBH.0 size=1048576 2024-09-14T11:15:17.474 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:17.476+0000 7f76c1e8a8c0 1 < completed part key=_multipart_OUMUTEBQ1TD0.2~VZ9C7A3X4SBH.1 size=1048576 2024-09-14T11:15:17.476 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:17.480+0000 7f76c1e8a8c0 1 < completed part key=_multipart_OUMUTEBQ1TD0.2~VZ9C7A3X4SBH.2 size=881802 2024-09-14T11:15:17.482 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:17.484+0000 7f76c1e8a8c0 1 < completed multipart upload key=OUMUTEBQ1TD0 upload=VZ9C7A3X4SBH tag=C3DQKA4KNJPN type=write size=4027530 2024-09-14T11:15:17.486 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:17.488+0000 7f76c1e8a8c0 1 > prepared operation key=H9CQV6L29SL5 tag=IC16NJKFXOSU type=write size=138649 2024-09-14T11:15:17.490 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:17.492+0000 7f76c1e8a8c0 1 < completed write operation key=K2EEZLRK7MVO tag=6RF9GPIHMGQ1 type=write size=436438 2024-09-14T11:15:17.496 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:17.496+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_LZ0YNFOVFYCL.2~VW1SIBYX7717.0 size=1048576 2024-09-14T11:15:17.498 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:17.500+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_LZ0YNFOVFYCL.2~VW1SIBYX7717.1 size=602651 2024-09-14T11:15:17.498 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:17.500+0000 7f76c1e8a8c0 1 > prepared multipart upload key=LZ0YNFOVFYCL upload=VW1SIBYX7717 tag=A4R6OCW5AMBX type=write size=2699803 2024-09-14T11:15:17.502 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:17.504+0000 7f76c1e8a8c0 1 < completed part key=_multipart_8FFV9G6EQR8F.2~K8G0ZUTE3LP3.0 size=1048576 2024-09-14T11:15:17.505 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:17.508+0000 7f76c1e8a8c0 1 < completed part key=_multipart_8FFV9G6EQR8F.2~K8G0ZUTE3LP3.1 size=363690 2024-09-14T11:15:17.510 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:17.512+0000 7f76c1e8a8c0 1 < completed multipart upload key=8FFV9G6EQR8F upload=K8G0ZUTE3LP3 tag=Y623YVNSE7TH type=write size=2460842 2024-09-14T11:15:17.513 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:17.516+0000 7f76c1e8a8c0 1 > prepared operation key=S43U13LYETS4 tag=S7670B8S61UM type=del size=3623814 2024-09-14T11:15:17.517 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:17.520+0000 7f76c1e8a8c0 1 < completed delete operation key=MEVTZ7OAD4CA tag=EN1EDWRTH9BS type=del 2024-09-14T11:15:17.520 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:17.524+0000 7f76c1e8a8c0 1 > prepared operation key=HJ701768A6I7 tag=M52064VSYN9Z type=del size=1442718 2024-09-14T11:15:17.524 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:17.524+0000 7f76c1e8a8c0 1 < completed part key=_multipart_6TIJR323NMOH.2~JO627WI8Q0TM.0 size=1048576 2024-09-14T11:15:17.527 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:17.528+0000 7f76c1e8a8c0 1 < completed part key=_multipart_6TIJR323NMOH.2~JO627WI8Q0TM.1 size=627884 2024-09-14T11:15:17.532 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:17.536+0000 7f76c1e8a8c0 1 < completed multipart upload key=6TIJR323NMOH upload=JO627WI8Q0TM tag=JFUTTCCON8VG type=write size=2725036 2024-09-14T11:15:17.538 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:17.540+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_VI61O3K069BP.2~5CBN8Q2VZ75A.0 size=1048576 2024-09-14T11:15:17.541 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:17.544+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_VI61O3K069BP.2~5CBN8Q2VZ75A.1 size=224117 2024-09-14T11:15:17.541 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:17.544+0000 7f76c1e8a8c0 1 > prepared multipart upload key=VI61O3K069BP upload=5CBN8Q2VZ75A tag=ZLFGW9T78QVM type=write size=2321269 2024-09-14T11:15:17.545 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:17.548+0000 7f76c1e8a8c0 1 < completed delete operation key=GZM0AQVHNCMM tag=O1VDBGRH9GOV type=del 2024-09-14T11:15:17.548 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:17.552+0000 7f76c1e8a8c0 1 > prepared operation key=SUNCRV0C1XYL tag=96D7A2ERCPU9 type=del size=1359786 2024-09-14T11:15:17.555 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:17.556+0000 7f76c1e8a8c0 1 < suggested update operation key=S43U13LYETS4 tag=7OSCOVEKHIUV type=del size=2626445 2024-09-14T11:15:17.558 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:17.560+0000 7f76c1e8a8c0 1 > prepared operation key=BOCIF4TL7X7J tag=ODV3MXESRX8G type=del size=2543307 2024-09-14T11:15:17.562 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:17.564+0000 7f76c1e8a8c0 1 < completed delete operation key=CIRQT9IDJ5OJ tag=UK0QNNXZX1OL type=del 2024-09-14T11:15:17.565 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:17.568+0000 7f76c1e8a8c0 1 > prepared operation key=HS7T50JORDQJ tag=7O4P1USGSUKK type=del size=3200605 2024-09-14T11:15:17.569 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:17.572+0000 7f76c1e8a8c0 1 < canceled operation key=H9CQV6L29SL5 tag=EZ72DAN7T3I6 type=del size=3021113 2024-09-14T11:15:17.575 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:17.576+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_K2EEZLRK7MVO.2~XAT7OKK51AAE.0 size=1048576 2024-09-14T11:15:17.578 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:17.580+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_K2EEZLRK7MVO.2~XAT7OKK51AAE.1 size=696440 2024-09-14T11:15:17.578 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:17.580+0000 7f76c1e8a8c0 1 > prepared multipart upload key=K2EEZLRK7MVO upload=XAT7OKK51AAE tag=B6I9WPUH8UDR type=write size=2793592 2024-09-14T11:15:17.581 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:17.584+0000 7f76c1e8a8c0 1 < completed part key=_multipart_1K8ESNXU6WDF.2~V5QFEEOSGE5B.0 size=1048576 2024-09-14T11:15:17.584 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:17.588+0000 7f76c1e8a8c0 1 < completed part key=_multipart_1K8ESNXU6WDF.2~V5QFEEOSGE5B.1 size=1027248 2024-09-14T11:15:17.590 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:17.592+0000 7f76c1e8a8c0 1 < completed multipart upload key=1K8ESNXU6WDF upload=V5QFEEOSGE5B tag=VG3W04D8JBW1 type=write size=3124400 2024-09-14T11:15:17.593 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:17.596+0000 7f76c1e8a8c0 1 > prepared operation key=GZM0AQVHNCMM tag=4ZAM5YWCX27O type=del size=793460 2024-09-14T11:15:17.600 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:17.600+0000 7f76c1e8a8c0 1 < suggested remove operation key=HJ701768A6I7 tag=FMR054H4SQPS type=del 2024-09-14T11:15:17.606 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:17.608+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_HS7T50JORDQJ.2~PIUFM2FE20TE.0 size=374714 2024-09-14T11:15:17.606 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:17.608+0000 7f76c1e8a8c0 1 > prepared multipart upload key=HS7T50JORDQJ upload=PIUFM2FE20TE tag=AXPSA6523B1J type=write size=1423290 2024-09-14T11:15:17.610 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:17.612+0000 7f76c1e8a8c0 1 < completed part key=_multipart_SUNCRV0C1XYL.2~PCV3FLN30HZG.0 size=137209 2024-09-14T11:15:17.616 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:17.616+0000 7f76c1e8a8c0 1 < completed multipart upload key=SUNCRV0C1XYL upload=PCV3FLN30HZG tag=30VZ378RFIWA type=write size=1185785 2024-09-14T11:15:17.623 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:17.624+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_GAVZRU8ZLW7S.2~KHYTXRZ8CGGR.0 size=1023326 2024-09-14T11:15:17.623 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:17.624+0000 7f76c1e8a8c0 1 > prepared multipart upload key=GAVZRU8ZLW7S upload=KHYTXRZ8CGGR tag=8CZA0Z72LZFD type=write size=2071902 2024-09-14T11:15:17.630 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:17.632+0000 7f76c1e8a8c0 1 < suggested update operation key=OOUEM16XL80W tag=2XGB1RRF82UW type=del size=1952281 2024-09-14T11:15:17.634 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:17.636+0000 7f76c1e8a8c0 1 > prepared operation key=SUNCRV0C1XYL tag=C9Q91ZA79VKE type=write size=888926 2024-09-14T11:15:17.637 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:17.640+0000 7f76c1e8a8c0 1 < canceled operation key=OUMUTEBQ1TD0 tag=8SDAOGAO52PV type=del size=3786871 2024-09-14T11:15:17.640 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:17.644+0000 7f76c1e8a8c0 1 > prepared operation key=F3KFS0P1WM7W tag=8ZP31R4O4P4T type=del size=2288801 2024-09-14T11:15:17.644 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:17.644+0000 7f76c1e8a8c0 1 < completed part key=_multipart_HJ701768A6I7.2~6ITVAE5IVEYS.0 size=706973 2024-09-14T11:15:17.650 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:17.652+0000 7f76c1e8a8c0 1 < completed multipart upload key=HJ701768A6I7 upload=6ITVAE5IVEYS tag=ZJC780U7Z799 type=write size=1755549 2024-09-14T11:15:17.653 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:17.656+0000 7f76c1e8a8c0 1 > prepared operation key=TZO40K6J9877 tag=O3QT3O5W5FIY type=del size=2874389 2024-09-14T11:15:17.657 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:17.660+0000 7f76c1e8a8c0 1 < completed delete operation key=HS7T50JORDQJ tag=B1G2CCFPZWT2 type=del 2024-09-14T11:15:17.663 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:17.664+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_XC8VWSHZOPFP.2~1ITZSCKJDUY6.0 size=634732 2024-09-14T11:15:17.663 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:17.664+0000 7f76c1e8a8c0 1 > prepared multipart upload key=XC8VWSHZOPFP upload=1ITZSCKJDUY6 tag=VXL9U0ZUT84M type=write size=1683308 2024-09-14T11:15:17.666 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:17.668+0000 7f76c1e8a8c0 1 < canceled operation key=H9CQV6L29SL5 tag=IC16NJKFXOSU type=write size=138649 2024-09-14T11:15:17.672 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:17.676+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_TZO40K6J9877.2~C7UYFIW2734B.0 size=1048576 2024-09-14T11:15:17.679 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:17.680+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_TZO40K6J9877.2~C7UYFIW2734B.1 size=716594 2024-09-14T11:15:17.679 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:17.680+0000 7f76c1e8a8c0 1 > prepared multipart upload key=TZO40K6J9877 upload=C7UYFIW2734B tag=W1BQ1E2GF84C type=write size=2813746 2024-09-14T11:15:17.683 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:17.684+0000 7f76c1e8a8c0 1 < completed part key=_multipart_LZ0YNFOVFYCL.2~VW1SIBYX7717.0 size=1048576 2024-09-14T11:15:17.683 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:17.684+0000 7f76c1e8a8c0 1 < canceled part key=_multipart_LZ0YNFOVFYCL.2~VW1SIBYX7717.1 size=602651 2024-09-14T11:15:17.689 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:17.692+0000 7f76c1e8a8c0 1 < canceled multipart upload key=LZ0YNFOVFYCL upload=VW1SIBYX7717 tag=A4R6OCW5AMBX type=write size=2699803 2024-09-14T11:15:17.695 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:17.696+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_F3KFS0P1WM7W.2~MNSDT0Y2MVVO.0 size=821690 2024-09-14T11:15:17.695 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:17.696+0000 7f76c1e8a8c0 1 > prepared multipart upload key=F3KFS0P1WM7W upload=MNSDT0Y2MVVO tag=K8WA8HCLHNYA type=write size=1870266 2024-09-14T11:15:17.698 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:17.700+0000 7f76c1e8a8c0 -1 < failed to complete operation key=S43U13LYETS4 tag=S7670B8S61UM type=del size=3623814: (22) Invalid argument 2024-09-14T11:15:17.704 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:17.704+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_HS7T50JORDQJ.2~ZG08OMG82VWG.0 size=125956 2024-09-14T11:15:17.704 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:17.704+0000 7f76c1e8a8c0 1 > prepared multipart upload key=HS7T50JORDQJ upload=ZG08OMG82VWG tag=H2S3BXUHWBBH type=write size=1174532 2024-09-14T11:15:17.710 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:17.712+0000 7f76c1e8a8c0 1 < suggested remove operation key=HJ701768A6I7 tag=M52064VSYN9Z type=del 2024-09-14T11:15:17.713 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:17.716+0000 7f76c1e8a8c0 1 > prepared operation key=KS37ZO6MKAH9 tag=3USOR14I4W7X type=del size=3863825 2024-09-14T11:15:17.716 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:17.720+0000 7f76c1e8a8c0 1 < completed part key=_multipart_VI61O3K069BP.2~5CBN8Q2VZ75A.0 size=1048576 2024-09-14T11:15:17.718 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:17.720+0000 7f76c1e8a8c0 1 < completed part key=_multipart_VI61O3K069BP.2~5CBN8Q2VZ75A.1 size=224117 2024-09-14T11:15:17.724 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:17.724+0000 7f76c1e8a8c0 1 < completed multipart upload key=VI61O3K069BP upload=5CBN8Q2VZ75A tag=ZLFGW9T78QVM type=write size=2321269 2024-09-14T11:15:17.729 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:17.732+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_MEVTZ7OAD4CA.2~DKVNVQXW12R4.0 size=1048576 2024-09-14T11:15:17.731 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:17.732+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_MEVTZ7OAD4CA.2~DKVNVQXW12R4.1 size=485235 2024-09-14T11:15:17.732 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:17.732+0000 7f76c1e8a8c0 1 > prepared multipart upload key=MEVTZ7OAD4CA upload=DKVNVQXW12R4 tag=K315MPTFS6PB type=write size=2582387 2024-09-14T11:15:17.735 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:17.736+0000 7f76c1e8a8c0 1 < completed delete operation key=SUNCRV0C1XYL tag=96D7A2ERCPU9 type=del 2024-09-14T11:15:17.738 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:17.740+0000 7f76c1e8a8c0 1 > prepared operation key=SHKU2PRNREKK tag=SVY0V839OJ0X type=del size=3923688 2024-09-14T11:15:17.741 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:17.744+0000 7f76c1e8a8c0 1 < completed delete operation key=BOCIF4TL7X7J tag=ODV3MXESRX8G type=del 2024-09-14T11:15:17.744 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:17.748+0000 7f76c1e8a8c0 1 > prepared operation key=LZ0YNFOVFYCL tag=L0AVI8Q28IYZ type=del size=989113 2024-09-14T11:15:17.747 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:17.748+0000 7f76c1e8a8c0 1 < completed delete operation key=HS7T50JORDQJ tag=7O4P1USGSUKK type=del 2024-09-14T11:15:17.750 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:17.752+0000 7f76c1e8a8c0 1 > prepared operation key=8FFV9G6EQR8F tag=W6W7BTPE0C3V type=write size=750724 2024-09-14T11:15:17.753 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:17.756+0000 7f76c1e8a8c0 1 < completed part key=_multipart_K2EEZLRK7MVO.2~XAT7OKK51AAE.0 size=1048576 2024-09-14T11:15:17.755 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:17.756+0000 7f76c1e8a8c0 1 < completed part key=_multipart_K2EEZLRK7MVO.2~XAT7OKK51AAE.1 size=696440 2024-09-14T11:15:17.760 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:17.764+0000 7f76c1e8a8c0 1 < completed multipart upload key=K2EEZLRK7MVO upload=XAT7OKK51AAE tag=B6I9WPUH8UDR type=write size=2793592 2024-09-14T11:15:17.770 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:17.772+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_1K8ESNXU6WDF.2~RKZ7HRLDY8BX.0 size=1048576 2024-09-14T11:15:17.772 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:17.776+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_1K8ESNXU6WDF.2~RKZ7HRLDY8BX.1 size=1048576 2024-09-14T11:15:17.775 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:17.776+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_1K8ESNXU6WDF.2~RKZ7HRLDY8BX.2 size=274094 2024-09-14T11:15:17.775 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:17.776+0000 7f76c1e8a8c0 1 > prepared multipart upload key=1K8ESNXU6WDF upload=RKZ7HRLDY8BX tag=SL0KDMI32S0R type=write size=3419822 2024-09-14T11:15:17.778 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:17.780+0000 7f76c1e8a8c0 1 < completed delete operation key=GZM0AQVHNCMM tag=4ZAM5YWCX27O type=del 2024-09-14T11:15:17.781 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:17.784+0000 7f76c1e8a8c0 1 > prepared operation key=HJ701768A6I7 tag=1W70QPCMMMAM type=del size=4100054 2024-09-14T11:15:17.785 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:17.788+0000 7f76c1e8a8c0 1 < completed part key=_multipart_HS7T50JORDQJ.2~PIUFM2FE20TE.0 size=374714 2024-09-14T11:15:17.790 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:17.792+0000 7f76c1e8a8c0 1 < completed multipart upload key=HS7T50JORDQJ upload=PIUFM2FE20TE tag=AXPSA6523B1J type=write size=1423290 2024-09-14T11:15:17.793 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:17.796+0000 7f76c1e8a8c0 1 > prepared operation key=GZM0AQVHNCMM tag=Y1DBXDPRIG6V type=write size=62236 2024-09-14T11:15:17.796 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:17.796+0000 7f76c1e8a8c0 1 < completed part key=_multipart_GAVZRU8ZLW7S.2~KHYTXRZ8CGGR.0 size=1023326 2024-09-14T11:15:17.801 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:17.804+0000 7f76c1e8a8c0 1 < completed multipart upload key=GAVZRU8ZLW7S upload=KHYTXRZ8CGGR tag=8CZA0Z72LZFD type=write size=2071902 2024-09-14T11:15:17.804 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:17.804+0000 7f76c1e8a8c0 1 > prepared operation key=Q5IY4J5FOD80 tag=0MTHM9KQN3W8 type=del size=1231124 2024-09-14T11:15:17.807 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:17.808+0000 7f76c1e8a8c0 1 < completed write operation key=SUNCRV0C1XYL tag=C9Q91ZA79VKE type=write size=888926 2024-09-14T11:15:17.810 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:17.812+0000 7f76c1e8a8c0 1 > prepared operation key=OOUEM16XL80W tag=PERGBY454J4L type=del size=2334722 2024-09-14T11:15:17.816 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:17.820+0000 7f76c1e8a8c0 1 < suggested update operation key=F3KFS0P1WM7W tag=8ZP31R4O4P4T type=del size=2288801 2024-09-14T11:15:17.819 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:17.820+0000 7f76c1e8a8c0 1 > prepared operation key=HS7T50JORDQJ tag=92P4RAG5300Q type=del size=1584183 2024-09-14T11:15:17.822 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:17.824+0000 7f76c1e8a8c0 1 < completed delete operation key=TZO40K6J9877 tag=O3QT3O5W5FIY type=del 2024-09-14T11:15:17.825 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:17.828+0000 7f76c1e8a8c0 1 > prepared operation key=CIRQT9IDJ5OJ tag=DW2P51BWCNVC type=del size=14599 2024-09-14T11:15:17.828 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:17.832+0000 7f76c1e8a8c0 1 < completed part key=_multipart_XC8VWSHZOPFP.2~1ITZSCKJDUY6.0 size=634732 2024-09-14T11:15:17.833 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:17.836+0000 7f76c1e8a8c0 1 < completed multipart upload key=XC8VWSHZOPFP upload=1ITZSCKJDUY6 tag=VXL9U0ZUT84M type=write size=1683308 2024-09-14T11:15:17.838 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:17.840+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_GZM0AQVHNCMM.2~7V1UQXOEG639.0 size=1048576 2024-09-14T11:15:17.840 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:17.840+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_GZM0AQVHNCMM.2~7V1UQXOEG639.1 size=1048576 2024-09-14T11:15:17.842 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:17.844+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_GZM0AQVHNCMM.2~7V1UQXOEG639.2 size=484826 2024-09-14T11:15:17.842 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:17.844+0000 7f76c1e8a8c0 1 > prepared multipart upload key=GZM0AQVHNCMM upload=7V1UQXOEG639 tag=5675LRU99GCH type=write size=3630554 2024-09-14T11:15:17.845 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:17.848+0000 7f76c1e8a8c0 1 < completed part key=_multipart_TZO40K6J9877.2~C7UYFIW2734B.0 size=1048576 2024-09-14T11:15:17.846 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:17.848+0000 7f76c1e8a8c0 1 < completed part key=_multipart_TZO40K6J9877.2~C7UYFIW2734B.1 size=716594 2024-09-14T11:15:17.850 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:17.852+0000 7f76c1e8a8c0 1 < completed multipart upload key=TZO40K6J9877 upload=C7UYFIW2734B tag=W1BQ1E2GF84C type=write size=2813746 2024-09-14T11:15:17.853 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:17.856+0000 7f76c1e8a8c0 1 > prepared operation key=85G6NT78HAWQ tag=7HF9K8QD9TWX type=del size=1584294 2024-09-14T11:15:17.853 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:17.856+0000 7f76c1e8a8c0 1 < canceled part key=_multipart_F3KFS0P1WM7W.2~MNSDT0Y2MVVO.0 size=821690 2024-09-14T11:15:17.857 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:17.860+0000 7f76c1e8a8c0 1 < canceled multipart upload key=F3KFS0P1WM7W upload=MNSDT0Y2MVVO tag=K8WA8HCLHNYA type=write size=1870266 2024-09-14T11:15:17.860 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:17.860+0000 7f76c1e8a8c0 1 > prepared operation key=8PZOVFEYYSOG tag=3NRHN0I2WZ0U type=del size=3977588 2024-09-14T11:15:17.862 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:17.864+0000 7f76c1e8a8c0 1 < completed part key=_multipart_HS7T50JORDQJ.2~ZG08OMG82VWG.0 size=125956 2024-09-14T11:15:17.866 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:17.868+0000 7f76c1e8a8c0 1 < completed multipart upload key=HS7T50JORDQJ upload=ZG08OMG82VWG tag=H2S3BXUHWBBH type=write size=1174532 2024-09-14T11:15:17.871 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:17.872+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_SHKU2PRNREKK.2~HC1093C7EVT3.0 size=936931 2024-09-14T11:15:17.871 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:17.872+0000 7f76c1e8a8c0 1 > prepared multipart upload key=SHKU2PRNREKK upload=HC1093C7EVT3 tag=LCN58B3QWJD5 type=write size=1985507 2024-09-14T11:15:17.873 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:17.876+0000 7f76c1e8a8c0 1 < completed delete operation key=KS37ZO6MKAH9 tag=3USOR14I4W7X type=del 2024-09-14T11:15:17.878 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:17.880+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_8FFV9G6EQR8F.2~KHFXOTJJ84BE.0 size=1048576 2024-09-14T11:15:17.880 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:17.880+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_8FFV9G6EQR8F.2~KHFXOTJJ84BE.1 size=557764 2024-09-14T11:15:17.880 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:17.880+0000 7f76c1e8a8c0 1 > prepared multipart upload key=8FFV9G6EQR8F upload=KHFXOTJJ84BE tag=WZBM4299FDQX type=write size=2654916 2024-09-14T11:15:17.882 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:17.884+0000 7f76c1e8a8c0 1 < completed part key=_multipart_MEVTZ7OAD4CA.2~DKVNVQXW12R4.0 size=1048576 2024-09-14T11:15:17.884 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:17.888+0000 7f76c1e8a8c0 1 < completed part key=_multipart_MEVTZ7OAD4CA.2~DKVNVQXW12R4.1 size=485235 2024-09-14T11:15:17.888 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:17.892+0000 7f76c1e8a8c0 1 < completed multipart upload key=MEVTZ7OAD4CA upload=DKVNVQXW12R4 tag=K315MPTFS6PB type=write size=2582387 2024-09-14T11:15:17.891 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:17.892+0000 7f76c1e8a8c0 1 > prepared operation key=15FU4CEGC22Q tag=NOKHXKN6Y9M4 type=del size=2457312 2024-09-14T11:15:17.893 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:17.896+0000 7f76c1e8a8c0 1 < completed delete operation key=SHKU2PRNREKK tag=SVY0V839OJ0X type=del 2024-09-14T11:15:17.898 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:17.900+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_8PZOVFEYYSOG.2~EKXOJDHAQOXR.0 size=432456 2024-09-14T11:15:17.898 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:17.900+0000 7f76c1e8a8c0 1 > prepared multipart upload key=8PZOVFEYYSOG upload=EKXOJDHAQOXR tag=WL6AP80XESDF type=write size=1481032 2024-09-14T11:15:17.901 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:17.904+0000 7f76c1e8a8c0 1 < canceled operation key=LZ0YNFOVFYCL tag=L0AVI8Q28IYZ type=del size=989113 2024-09-14T11:15:17.905 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:17.908+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_F3KFS0P1WM7W.2~ISMRBCB8QPZP.0 size=1048576 2024-09-14T11:15:17.907 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:17.908+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_F3KFS0P1WM7W.2~ISMRBCB8QPZP.1 size=1048576 2024-09-14T11:15:17.910 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:17.912+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_F3KFS0P1WM7W.2~ISMRBCB8QPZP.2 size=990498 2024-09-14T11:15:17.910 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:17.912+0000 7f76c1e8a8c0 1 > prepared multipart upload key=F3KFS0P1WM7W upload=ISMRBCB8QPZP tag=7DPPJL1SARHU type=write size=4136226 2024-09-14T11:15:17.913 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:17.916+0000 7f76c1e8a8c0 1 < completed write operation key=8FFV9G6EQR8F tag=W6W7BTPE0C3V type=write size=750724 2024-09-14T11:15:17.917 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:17.920+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_8PZOVFEYYSOG.2~V3UOWC7S2S4E.0 size=1048576 2024-09-14T11:15:17.919 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:17.920+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_8PZOVFEYYSOG.2~V3UOWC7S2S4E.1 size=303974 2024-09-14T11:15:17.919 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:17.920+0000 7f76c1e8a8c0 1 > prepared multipart upload key=8PZOVFEYYSOG upload=V3UOWC7S2S4E tag=2WUP5JIC6IEB type=write size=2401126 2024-09-14T11:15:17.921 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:17.924+0000 7f76c1e8a8c0 1 < completed part key=_multipart_1K8ESNXU6WDF.2~RKZ7HRLDY8BX.0 size=1048576 2024-09-14T11:15:17.923 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:17.924+0000 7f76c1e8a8c0 1 < completed part key=_multipart_1K8ESNXU6WDF.2~RKZ7HRLDY8BX.1 size=1048576 2024-09-14T11:15:17.926 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:17.928+0000 7f76c1e8a8c0 1 < completed part key=_multipart_1K8ESNXU6WDF.2~RKZ7HRLDY8BX.2 size=274094 2024-09-14T11:15:17.930 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:17.932+0000 7f76c1e8a8c0 1 < completed multipart upload key=1K8ESNXU6WDF upload=RKZ7HRLDY8BX tag=SL0KDMI32S0R type=write size=3419822 2024-09-14T11:15:17.934 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:17.936+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_GZM0AQVHNCMM.2~QR8H71F7MSP6.0 size=1048576 2024-09-14T11:15:17.936 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:17.936+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_GZM0AQVHNCMM.2~QR8H71F7MSP6.1 size=1048576 2024-09-14T11:15:17.938 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:17.940+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_GZM0AQVHNCMM.2~QR8H71F7MSP6.2 size=339490 2024-09-14T11:15:17.938 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:17.940+0000 7f76c1e8a8c0 1 > prepared multipart upload key=GZM0AQVHNCMM upload=QR8H71F7MSP6 tag=F79B9MQVDSJ1 type=write size=3485218 2024-09-14T11:15:17.943 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:17.944+0000 7f76c1e8a8c0 1 < completed delete operation key=HJ701768A6I7 tag=1W70QPCMMMAM type=del 2024-09-14T11:15:17.947 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:17.948+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_1W5733SDHGDN.2~FJZO67F1X64L.0 size=841628 2024-09-14T11:15:17.947 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:17.948+0000 7f76c1e8a8c0 1 > prepared multipart upload key=1W5733SDHGDN upload=FJZO67F1X64L tag=CIBDBCU8L0IL type=write size=1890204 2024-09-14T11:15:17.950 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:17.952+0000 7f76c1e8a8c0 1 < completed write operation key=GZM0AQVHNCMM tag=Y1DBXDPRIG6V type=write size=62236 2024-09-14T11:15:17.952 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:17.956+0000 7f76c1e8a8c0 1 > prepared operation key=H9CQV6L29SL5 tag=55C4HSGCQS6J type=del size=558562 2024-09-14T11:15:17.955 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:17.956+0000 7f76c1e8a8c0 1 < completed delete operation key=Q5IY4J5FOD80 tag=0MTHM9KQN3W8 type=del 2024-09-14T11:15:17.957 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:17.960+0000 7f76c1e8a8c0 1 > prepared operation key=GAVZRU8ZLW7S tag=STZ3Z9BL1AP6 type=write size=893906 2024-09-14T11:15:17.960 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:17.960+0000 7f76c1e8a8c0 1 < completed delete operation key=OOUEM16XL80W tag=PERGBY454J4L type=del 2024-09-14T11:15:17.964 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:17.964+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_VI61O3K069BP.2~RIRR1X69B88P.0 size=1048576 2024-09-14T11:15:17.966 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:17.968+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_VI61O3K069BP.2~RIRR1X69B88P.1 size=1048576 2024-09-14T11:15:17.967 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:17.968+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_VI61O3K069BP.2~RIRR1X69B88P.2 size=182536 2024-09-14T11:15:17.967 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:17.968+0000 7f76c1e8a8c0 1 > prepared multipart upload key=VI61O3K069BP upload=RIRR1X69B88P tag=2JJI47OEYL3Q type=write size=3328264 2024-09-14T11:15:17.970 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:17.972+0000 7f76c1e8a8c0 1 < completed delete operation key=HS7T50JORDQJ tag=92P4RAG5300Q type=del 2024-09-14T11:15:17.972 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:17.976+0000 7f76c1e8a8c0 1 > prepared operation key=VI61O3K069BP tag=F0GUDXN836UZ type=del size=2212891 2024-09-14T11:15:17.975 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:17.976+0000 7f76c1e8a8c0 1 < completed delete operation key=CIRQT9IDJ5OJ tag=DW2P51BWCNVC type=del 2024-09-14T11:15:17.979 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:17.980+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_Q5IY4J5FOD80.2~KKZAX9ZP5MX3.0 size=1048576 2024-09-14T11:15:17.981 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:17.984+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_Q5IY4J5FOD80.2~KKZAX9ZP5MX3.1 size=1048576 2024-09-14T11:15:17.983 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:17.984+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_Q5IY4J5FOD80.2~KKZAX9ZP5MX3.2 size=34729 2024-09-14T11:15:17.983 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:17.984+0000 7f76c1e8a8c0 1 > prepared multipart upload key=Q5IY4J5FOD80 upload=KKZAX9ZP5MX3 tag=F14X5JY7JXLW type=write size=3180457 2024-09-14T11:15:17.986 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:17.988+0000 7f76c1e8a8c0 1 < completed part key=_multipart_GZM0AQVHNCMM.2~7V1UQXOEG639.0 size=1048576 2024-09-14T11:15:17.988 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:17.988+0000 7f76c1e8a8c0 1 < completed part key=_multipart_GZM0AQVHNCMM.2~7V1UQXOEG639.1 size=1048576 2024-09-14T11:15:17.990 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:17.992+0000 7f76c1e8a8c0 1 < completed part key=_multipart_GZM0AQVHNCMM.2~7V1UQXOEG639.2 size=484826 2024-09-14T11:15:17.994 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:17.996+0000 7f76c1e8a8c0 1 < completed multipart upload key=GZM0AQVHNCMM upload=7V1UQXOEG639 tag=5675LRU99GCH type=write size=3630554 2024-09-14T11:15:17.999 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:18.000+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_6TIJR323NMOH.2~GXYGUKCR303P.0 size=1048576 2024-09-14T11:15:18.001 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:18.004+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_6TIJR323NMOH.2~GXYGUKCR303P.1 size=1048576 2024-09-14T11:15:18.003 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:18.004+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_6TIJR323NMOH.2~GXYGUKCR303P.2 size=319027 2024-09-14T11:15:18.003 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:18.004+0000 7f76c1e8a8c0 1 > prepared multipart upload key=6TIJR323NMOH upload=GXYGUKCR303P tag=NOP51EXFY5UN type=write size=3464755 2024-09-14T11:15:18.005 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:18.008+0000 7f76c1e8a8c0 1 < completed delete operation key=85G6NT78HAWQ tag=7HF9K8QD9TWX type=del 2024-09-14T11:15:18.008 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:18.008+0000 7f76c1e8a8c0 1 > prepared operation key=1K8ESNXU6WDF tag=HYS6QQHPAS96 type=del size=1133661 2024-09-14T11:15:18.010 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:18.012+0000 7f76c1e8a8c0 1 < completed delete operation key=8PZOVFEYYSOG tag=3NRHN0I2WZ0U type=del 2024-09-14T11:15:18.014 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:18.016+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_Q5IY4J5FOD80.2~VU5BM7HEW28S.0 size=1048576 2024-09-14T11:15:18.016 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:18.020+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_Q5IY4J5FOD80.2~VU5BM7HEW28S.1 size=350615 2024-09-14T11:15:18.016 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:18.020+0000 7f76c1e8a8c0 1 > prepared multipart upload key=Q5IY4J5FOD80 upload=VU5BM7HEW28S tag=O0LSAT0NOW1Z type=write size=2447767 2024-09-14T11:15:18.019 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:18.020+0000 7f76c1e8a8c0 1 < completed part key=_multipart_SHKU2PRNREKK.2~HC1093C7EVT3.0 size=936931 2024-09-14T11:15:18.023 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:18.024+0000 7f76c1e8a8c0 1 < completed multipart upload key=SHKU2PRNREKK upload=HC1093C7EVT3 tag=LCN58B3QWJD5 type=write size=1985507 2024-09-14T11:15:18.025 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:18.028+0000 7f76c1e8a8c0 1 > prepared operation key=GZM0AQVHNCMM tag=BJM5GX0H7DZ9 type=del size=1431490 2024-09-14T11:15:18.028 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:18.028+0000 7f76c1e8a8c0 1 < completed part key=_multipart_8FFV9G6EQR8F.2~KHFXOTJJ84BE.0 size=1048576 2024-09-14T11:15:18.031 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:18.032+0000 7f76c1e8a8c0 1 < completed part key=_multipart_8FFV9G6EQR8F.2~KHFXOTJJ84BE.1 size=557764 2024-09-14T11:15:18.035 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:18.036+0000 7f76c1e8a8c0 1 < completed multipart upload key=8FFV9G6EQR8F upload=KHFXOTJJ84BE tag=WZBM4299FDQX type=write size=2654916 2024-09-14T11:15:18.040 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:18.040+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_1W5733SDHGDN.2~VRASE57QU32C.0 size=174510 2024-09-14T11:15:18.040 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:18.040+0000 7f76c1e8a8c0 1 > prepared multipart upload key=1W5733SDHGDN upload=VRASE57QU32C tag=6OLXONI0II8I type=write size=1223086 2024-09-14T11:15:18.042 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:18.044+0000 7f76c1e8a8c0 1 < completed delete operation key=15FU4CEGC22Q tag=NOKHXKN6Y9M4 type=del 2024-09-14T11:15:18.045 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:18.048+0000 7f76c1e8a8c0 1 > prepared operation key=XC8VWSHZOPFP tag=V43A5D1O1AH7 type=del size=808429 2024-09-14T11:15:18.048 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:18.052+0000 7f76c1e8a8c0 1 < completed part key=_multipart_8PZOVFEYYSOG.2~EKXOJDHAQOXR.0 size=432456 2024-09-14T11:15:18.052 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:18.052+0000 7f76c1e8a8c0 1 < completed multipart upload key=8PZOVFEYYSOG upload=EKXOJDHAQOXR tag=WL6AP80XESDF type=write size=1481032 2024-09-14T11:15:18.054 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:18.056+0000 7f76c1e8a8c0 1 > prepared operation key=TZO40K6J9877 tag=ZW02UAV4C05P type=del size=3743195 2024-09-14T11:15:18.055 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:18.056+0000 7f76c1e8a8c0 1 < canceled part key=_multipart_F3KFS0P1WM7W.2~ISMRBCB8QPZP.0 size=1048576 2024-09-14T11:15:18.056 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:18.060+0000 7f76c1e8a8c0 1 < completed part key=_multipart_F3KFS0P1WM7W.2~ISMRBCB8QPZP.1 size=1048576 2024-09-14T11:15:18.058 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:18.060+0000 7f76c1e8a8c0 1 < completed part key=_multipart_F3KFS0P1WM7W.2~ISMRBCB8QPZP.2 size=990498 2024-09-14T11:15:18.062 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:18.064+0000 7f76c1e8a8c0 1 < canceled multipart upload key=F3KFS0P1WM7W upload=ISMRBCB8QPZP tag=7DPPJL1SARHU type=write size=4136226 2024-09-14T11:15:18.067 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:18.068+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_SHKU2PRNREKK.2~5JBRKYV39G0R.0 size=358546 2024-09-14T11:15:18.067 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:18.068+0000 7f76c1e8a8c0 1 > prepared multipart upload key=SHKU2PRNREKK upload=5JBRKYV39G0R tag=I1ZAQ5PSRLG3 type=write size=1407122 2024-09-14T11:15:18.070 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:18.072+0000 7f76c1e8a8c0 1 < completed part key=_multipart_8PZOVFEYYSOG.2~V3UOWC7S2S4E.0 size=1048576 2024-09-14T11:15:18.071 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:18.072+0000 7f76c1e8a8c0 1 < completed part key=_multipart_8PZOVFEYYSOG.2~V3UOWC7S2S4E.1 size=303974 2024-09-14T11:15:18.075 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:18.076+0000 7f76c1e8a8c0 1 < completed multipart upload key=8PZOVFEYYSOG upload=V3UOWC7S2S4E tag=2WUP5JIC6IEB type=write size=2401126 2024-09-14T11:15:18.078 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:18.080+0000 7f76c1e8a8c0 1 > prepared operation key=8FFV9G6EQR8F tag=4G067MN1KZVP type=del size=694526 2024-09-14T11:15:18.081 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:18.084+0000 7f76c1e8a8c0 1 < completed part key=_multipart_GZM0AQVHNCMM.2~QR8H71F7MSP6.0 size=1048576 2024-09-14T11:15:18.082 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:18.084+0000 7f76c1e8a8c0 1 < completed part key=_multipart_GZM0AQVHNCMM.2~QR8H71F7MSP6.1 size=1048576 2024-09-14T11:15:18.085 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:18.088+0000 7f76c1e8a8c0 1 < completed part key=_multipart_GZM0AQVHNCMM.2~QR8H71F7MSP6.2 size=339490 2024-09-14T11:15:18.089 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:18.092+0000 7f76c1e8a8c0 1 < completed multipart upload key=GZM0AQVHNCMM upload=QR8H71F7MSP6 tag=F79B9MQVDSJ1 type=write size=3485218 2024-09-14T11:15:18.092 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:18.092+0000 7f76c1e8a8c0 1 > prepared operation key=SUNCRV0C1XYL tag=V7BVSVURVOUS type=write size=588136 2024-09-14T11:15:18.095 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:18.096+0000 7f76c1e8a8c0 1 < completed part key=_multipart_1W5733SDHGDN.2~FJZO67F1X64L.0 size=841628 2024-09-14T11:15:18.100 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:18.100+0000 7f76c1e8a8c0 1 < completed multipart upload key=1W5733SDHGDN upload=FJZO67F1X64L tag=CIBDBCU8L0IL type=write size=1890204 2024-09-14T11:15:18.105 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:18.108+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_Q5IY4J5FOD80.2~FCHJIWO7FEV8.0 size=338245 2024-09-14T11:15:18.105 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:18.108+0000 7f76c1e8a8c0 1 > prepared multipart upload key=Q5IY4J5FOD80 upload=FCHJIWO7FEV8 tag=S2VWP2E56V8L type=write size=1386821 2024-09-14T11:15:18.110 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:18.112+0000 7f76c1e8a8c0 1 < suggested remove operation key=H9CQV6L29SL5 tag=55C4HSGCQS6J type=del 2024-09-14T11:15:18.115 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:18.116+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_HJ701768A6I7.2~BXQCP6RI32BF.0 size=1048576 2024-09-14T11:15:18.117 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:18.120+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_HJ701768A6I7.2~BXQCP6RI32BF.1 size=1048576 2024-09-14T11:15:18.119 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:18.120+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_HJ701768A6I7.2~BXQCP6RI32BF.2 size=882886 2024-09-14T11:15:18.119 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:18.120+0000 7f76c1e8a8c0 1 > prepared multipart upload key=HJ701768A6I7 upload=BXQCP6RI32BF tag=3FWVE17KE91T type=write size=4028614 2024-09-14T11:15:18.122 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:18.124+0000 7f76c1e8a8c0 1 < completed write operation key=GAVZRU8ZLW7S tag=STZ3Z9BL1AP6 type=write size=893906 2024-09-14T11:15:18.125 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:18.128+0000 7f76c1e8a8c0 1 > prepared operation key=F3KFS0P1WM7W tag=7Z3EW9B3T041 type=del size=850203 2024-09-14T11:15:18.127 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:18.128+0000 7f76c1e8a8c0 1 < completed part key=_multipart_VI61O3K069BP.2~RIRR1X69B88P.0 size=1048576 2024-09-14T11:15:18.130 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:18.132+0000 7f76c1e8a8c0 1 < completed part key=_multipart_VI61O3K069BP.2~RIRR1X69B88P.1 size=1048576 2024-09-14T11:15:18.132 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:18.132+0000 7f76c1e8a8c0 1 < completed part key=_multipart_VI61O3K069BP.2~RIRR1X69B88P.2 size=182536 2024-09-14T11:15:18.136 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:18.140+0000 7f76c1e8a8c0 1 < completed multipart upload key=VI61O3K069BP upload=RIRR1X69B88P tag=2JJI47OEYL3Q type=write size=3328264 2024-09-14T11:15:18.139 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:18.140+0000 7f76c1e8a8c0 1 > prepared operation key=MEVTZ7OAD4CA tag=SLK1M8C1PHFR type=del size=4096863 2024-09-14T11:15:18.142 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:18.144+0000 7f76c1e8a8c0 1 < completed delete operation key=VI61O3K069BP tag=F0GUDXN836UZ type=del 2024-09-14T11:15:18.145 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:18.148+0000 7f76c1e8a8c0 1 > prepared operation key=1K8ESNXU6WDF tag=V24EPXNEI4WX type=del size=1755323 2024-09-14T11:15:18.145 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:18.148+0000 7f76c1e8a8c0 1 < canceled part key=_multipart_Q5IY4J5FOD80.2~KKZAX9ZP5MX3.0 size=1048576 2024-09-14T11:15:18.147 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:18.148+0000 7f76c1e8a8c0 1 < completed part key=_multipart_Q5IY4J5FOD80.2~KKZAX9ZP5MX3.1 size=1048576 2024-09-14T11:15:18.147 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:18.148+0000 7f76c1e8a8c0 1 < canceled part key=_multipart_Q5IY4J5FOD80.2~KKZAX9ZP5MX3.2 size=34729 2024-09-14T11:15:18.152 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:18.152+0000 7f76c1e8a8c0 1 < canceled multipart upload key=Q5IY4J5FOD80 upload=KKZAX9ZP5MX3 tag=F14X5JY7JXLW type=write size=3180457 2024-09-14T11:15:18.155 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:18.156+0000 7f76c1e8a8c0 1 > prepared operation key=6TIJR323NMOH tag=MXOCF53ZXN54 type=del size=3681111 2024-09-14T11:15:18.158 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:18.160+0000 7f76c1e8a8c0 1 < completed part key=_multipart_6TIJR323NMOH.2~GXYGUKCR303P.0 size=1048576 2024-09-14T11:15:18.160 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:18.160+0000 7f76c1e8a8c0 1 < completed part key=_multipart_6TIJR323NMOH.2~GXYGUKCR303P.1 size=1048576 2024-09-14T11:15:18.165 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:18.164+0000 7f76c1e8a8c0 1 < completed part key=_multipart_6TIJR323NMOH.2~GXYGUKCR303P.2 size=319027 2024-09-14T11:15:18.167 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:18.168+0000 7f76c1e8a8c0 1 < completed multipart upload key=6TIJR323NMOH upload=GXYGUKCR303P tag=NOP51EXFY5UN type=write size=3464755 2024-09-14T11:15:18.170 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:18.172+0000 7f76c1e8a8c0 1 > prepared operation key=H9CQV6L29SL5 tag=LE5VKL2QFXN4 type=del size=3638086 2024-09-14T11:15:18.173 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:18.176+0000 7f76c1e8a8c0 1 < completed delete operation key=1K8ESNXU6WDF tag=HYS6QQHPAS96 type=del 2024-09-14T11:15:18.176 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:18.176+0000 7f76c1e8a8c0 1 > prepared operation key=6TIJR323NMOH tag=F9O2LT9KA033 type=del size=2956876 2024-09-14T11:15:18.183 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:18.184+0000 7f76c1e8a8c0 1 < completed part key=_multipart_Q5IY4J5FOD80.2~VU5BM7HEW28S.0 size=1048576 2024-09-14T11:15:18.186 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:18.188+0000 7f76c1e8a8c0 1 < completed part key=_multipart_Q5IY4J5FOD80.2~VU5BM7HEW28S.1 size=350615 2024-09-14T11:15:18.190 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:18.192+0000 7f76c1e8a8c0 1 < completed multipart upload key=Q5IY4J5FOD80 upload=VU5BM7HEW28S tag=O0LSAT0NOW1Z type=write size=2447767 2024-09-14T11:15:18.193 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:18.196+0000 7f76c1e8a8c0 1 > prepared operation key=SHKU2PRNREKK tag=JXXRU0J0N2N3 type=del size=662269 2024-09-14T11:15:18.195 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:18.196+0000 7f76c1e8a8c0 1 < completed delete operation key=GZM0AQVHNCMM tag=BJM5GX0H7DZ9 type=del 2024-09-14T11:15:18.200 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:18.204+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_BOCIF4TL7X7J.2~16HVSZSBRDDF.0 size=1048576 2024-09-14T11:15:18.202 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:18.204+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_BOCIF4TL7X7J.2~16HVSZSBRDDF.1 size=196401 2024-09-14T11:15:18.202 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:18.204+0000 7f76c1e8a8c0 1 > prepared multipart upload key=BOCIF4TL7X7J upload=16HVSZSBRDDF tag=ODQTOT44D0IA type=write size=2293553 2024-09-14T11:15:18.205 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:18.208+0000 7f76c1e8a8c0 1 < completed part key=_multipart_1W5733SDHGDN.2~VRASE57QU32C.0 size=174510 2024-09-14T11:15:18.209 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:18.212+0000 7f76c1e8a8c0 1 < completed multipart upload key=1W5733SDHGDN upload=VRASE57QU32C tag=6OLXONI0II8I type=write size=1223086 2024-09-14T11:15:18.211 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:18.212+0000 7f76c1e8a8c0 1 > prepared operation key=8PZOVFEYYSOG tag=ZN0OL0TIZDL2 type=del size=415083 2024-09-14T11:15:18.214 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:18.216+0000 7f76c1e8a8c0 1 < canceled operation key=XC8VWSHZOPFP tag=V43A5D1O1AH7 type=del size=808429 2024-09-14T11:15:18.219 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:18.220+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_MEVTZ7OAD4CA.2~P5KPRKV5QU5L.0 size=685272 2024-09-14T11:15:18.219 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:18.220+0000 7f76c1e8a8c0 1 > prepared multipart upload key=MEVTZ7OAD4CA upload=P5KPRKV5QU5L tag=AQEVOL7L5X5R type=write size=1733848 2024-09-14T11:15:18.224 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:18.228+0000 7f76c1e8a8c0 1 < suggested update operation key=TZO40K6J9877 tag=ZW02UAV4C05P type=del size=3743195 2024-09-14T11:15:18.227 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:18.228+0000 7f76c1e8a8c0 1 > prepared operation key=HS7T50JORDQJ tag=RMBTK6PVIUAZ type=del size=1100109 2024-09-14T11:15:18.230 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:18.232+0000 7f76c1e8a8c0 1 < completed part key=_multipart_SHKU2PRNREKK.2~5JBRKYV39G0R.0 size=358546 2024-09-14T11:15:18.235 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:18.236+0000 7f76c1e8a8c0 1 < completed multipart upload key=SHKU2PRNREKK upload=5JBRKYV39G0R tag=I1ZAQ5PSRLG3 type=write size=1407122 2024-09-14T11:15:18.237 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:18.240+0000 7f76c1e8a8c0 1 > prepared operation key=TZO40K6J9877 tag=DMM2QHMFHJT1 type=del size=1623087 2024-09-14T11:15:18.243 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:18.244+0000 7f76c1e8a8c0 1 < suggested update operation key=8FFV9G6EQR8F tag=4G067MN1KZVP type=del size=694526 2024-09-14T11:15:18.249 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:18.252+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_VI61O3K069BP.2~WN0ON1H0VWP6.0 size=1048576 2024-09-14T11:15:18.251 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:18.252+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_VI61O3K069BP.2~WN0ON1H0VWP6.1 size=1048576 2024-09-14T11:15:18.253 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:18.256+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_VI61O3K069BP.2~WN0ON1H0VWP6.2 size=20847 2024-09-14T11:15:18.253 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:18.256+0000 7f76c1e8a8c0 1 > prepared multipart upload key=VI61O3K069BP upload=WN0ON1H0VWP6 tag=ZP2DIF58PAQ2 type=write size=3166575 2024-09-14T11:15:18.256 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:18.256+0000 7f76c1e8a8c0 1 < canceled operation key=SUNCRV0C1XYL tag=V7BVSVURVOUS type=write size=588136 2024-09-14T11:15:18.262 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:18.264+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_VI61O3K069BP.2~033WX8CQ3QT4.0 size=27344 2024-09-14T11:15:18.262 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:18.264+0000 7f76c1e8a8c0 1 > prepared multipart upload key=VI61O3K069BP upload=033WX8CQ3QT4 tag=HPD2UZY6YNTA type=write size=1075920 2024-09-14T11:15:18.264 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:18.268+0000 7f76c1e8a8c0 1 < completed part key=_multipart_Q5IY4J5FOD80.2~FCHJIWO7FEV8.0 size=338245 2024-09-14T11:15:18.269 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:18.272+0000 7f76c1e8a8c0 1 < completed multipart upload key=Q5IY4J5FOD80 upload=FCHJIWO7FEV8 tag=S2VWP2E56V8L type=write size=1386821 2024-09-14T11:15:18.273 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:18.276+0000 7f76c1e8a8c0 1 > prepared operation key=HS7T50JORDQJ tag=YS0MY6BPFXF7 type=write size=167635 2024-09-14T11:15:18.277 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:18.280+0000 7f76c1e8a8c0 1 < completed part key=_multipart_HJ701768A6I7.2~BXQCP6RI32BF.0 size=1048576 2024-09-14T11:15:18.279 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:18.280+0000 7f76c1e8a8c0 1 < completed part key=_multipart_HJ701768A6I7.2~BXQCP6RI32BF.1 size=1048576 2024-09-14T11:15:18.282 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:18.284+0000 7f76c1e8a8c0 1 < completed part key=_multipart_HJ701768A6I7.2~BXQCP6RI32BF.2 size=882886 2024-09-14T11:15:18.287 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:18.288+0000 7f76c1e8a8c0 1 < completed multipart upload key=HJ701768A6I7 upload=BXQCP6RI32BF tag=3FWVE17KE91T type=write size=4028614 2024-09-14T11:15:18.293 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:18.296+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_S43U13LYETS4.2~6B8MXL3TMTNB.0 size=844316 2024-09-14T11:15:18.293 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:18.296+0000 7f76c1e8a8c0 1 > prepared multipart upload key=S43U13LYETS4 upload=6B8MXL3TMTNB tag=E01WP05B0NPR type=write size=1892892 2024-09-14T11:15:18.299 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:18.300+0000 7f76c1e8a8c0 1 < suggested update operation key=F3KFS0P1WM7W tag=7Z3EW9B3T041 type=del size=850203 2024-09-14T11:15:18.302 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:18.304+0000 7f76c1e8a8c0 1 > prepared operation key=1W5733SDHGDN tag=UO1V23U1XJX4 type=del size=3977755 2024-09-14T11:15:18.308 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:18.308+0000 7f76c1e8a8c0 1 < suggested update operation key=MEVTZ7OAD4CA tag=SLK1M8C1PHFR type=del size=4096863 2024-09-14T11:15:18.313 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:18.316+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_BOCIF4TL7X7J.2~LKA2AX8UYX8A.0 size=1031855 2024-09-14T11:15:18.313 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:18.316+0000 7f76c1e8a8c0 1 > prepared multipart upload key=BOCIF4TL7X7J upload=LKA2AX8UYX8A tag=PT4UAUY28ST3 type=write size=2080431 2024-09-14T11:15:18.320 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:18.320+0000 7f76c1e8a8c0 1 < suggested remove operation key=1K8ESNXU6WDF tag=V24EPXNEI4WX type=del 2024-09-14T11:15:18.326 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:18.328+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_S43U13LYETS4.2~WJ6VCU2S3WUQ.0 size=1048576 2024-09-14T11:15:18.328 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:18.332+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_S43U13LYETS4.2~WJ6VCU2S3WUQ.1 size=654021 2024-09-14T11:15:18.328 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:18.332+0000 7f76c1e8a8c0 1 > prepared multipart upload key=S43U13LYETS4 upload=WJ6VCU2S3WUQ tag=VIFTKR817FAH type=write size=2751173 2024-09-14T11:15:18.331 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:18.332+0000 7f76c1e8a8c0 1 < completed delete operation key=6TIJR323NMOH tag=MXOCF53ZXN54 type=del 2024-09-14T11:15:18.336 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:18.336+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_F3KFS0P1WM7W.2~HNFQW525ZOXF.0 size=1048576 2024-09-14T11:15:18.338 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:18.340+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_F3KFS0P1WM7W.2~HNFQW525ZOXF.1 size=599468 2024-09-14T11:15:18.338 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:18.340+0000 7f76c1e8a8c0 1 > prepared multipart upload key=F3KFS0P1WM7W upload=HNFQW525ZOXF tag=SBGQ7KBVPEN2 type=write size=2696620 2024-09-14T11:15:18.340 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:18.344+0000 7f76c1e8a8c0 1 < completed delete operation key=H9CQV6L29SL5 tag=LE5VKL2QFXN4 type=del 2024-09-14T11:15:18.343 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:18.344+0000 7f76c1e8a8c0 1 > prepared operation key=85G6NT78HAWQ tag=NEZSEV22M2PC type=del size=991861 2024-09-14T11:15:18.347 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:18.348+0000 7f76c1e8a8c0 1 < completed delete operation key=6TIJR323NMOH tag=F9O2LT9KA033 type=del 2024-09-14T11:15:18.352 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:18.356+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_SHKU2PRNREKK.2~5A8GAG57IZA8.0 size=1048576 2024-09-14T11:15:18.355 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:18.356+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_SHKU2PRNREKK.2~5A8GAG57IZA8.1 size=1048576 2024-09-14T11:15:18.357 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:18.360+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_SHKU2PRNREKK.2~5A8GAG57IZA8.2 size=717110 2024-09-14T11:15:18.357 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:18.360+0000 7f76c1e8a8c0 1 > prepared multipart upload key=SHKU2PRNREKK upload=5A8GAG57IZA8 tag=J1DER3AOS8H5 type=write size=3862838 2024-09-14T11:15:18.361 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:18.364+0000 7f76c1e8a8c0 1 < completed delete operation key=SHKU2PRNREKK tag=JXXRU0J0N2N3 type=del 2024-09-14T11:15:18.365 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:18.368+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_8PZOVFEYYSOG.2~JPKHUK3O64JJ.0 size=224116 2024-09-14T11:15:18.365 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:18.368+0000 7f76c1e8a8c0 1 > prepared multipart upload key=8PZOVFEYYSOG upload=JPKHUK3O64JJ tag=OLEMMJ0JGATO type=write size=1272692 2024-09-14T11:15:18.367 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:18.368+0000 7f76c1e8a8c0 1 < completed part key=_multipart_BOCIF4TL7X7J.2~16HVSZSBRDDF.0 size=1048576 2024-09-14T11:15:18.370 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:18.372+0000 7f76c1e8a8c0 1 < completed part key=_multipart_BOCIF4TL7X7J.2~16HVSZSBRDDF.1 size=196401 2024-09-14T11:15:18.374 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:18.376+0000 7f76c1e8a8c0 1 < completed multipart upload key=BOCIF4TL7X7J upload=16HVSZSBRDDF tag=ODQTOT44D0IA type=write size=2293553 2024-09-14T11:15:18.377 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:18.380+0000 7f76c1e8a8c0 1 > prepared operation key=R5I9H7WAK7Z7 tag=0FRKP3TB6SX1 type=del size=2938958 2024-09-14T11:15:18.379 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:18.380+0000 7f76c1e8a8c0 1 < completed delete operation key=8PZOVFEYYSOG tag=ZN0OL0TIZDL2 type=del 2024-09-14T11:15:18.382 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:18.384+0000 7f76c1e8a8c0 1 > prepared operation key=8FFV9G6EQR8F tag=Z1222MGZY8AD type=del size=2648753 2024-09-14T11:15:18.382 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:18.384+0000 7f76c1e8a8c0 1 < canceled part key=_multipart_MEVTZ7OAD4CA.2~P5KPRKV5QU5L.0 size=685272 2024-09-14T11:15:18.388 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:18.388+0000 7f76c1e8a8c0 1 < canceled multipart upload key=MEVTZ7OAD4CA upload=P5KPRKV5QU5L tag=AQEVOL7L5X5R type=write size=1733848 2024-09-14T11:15:18.393 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:18.396+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_1K8ESNXU6WDF.2~OYOW5LPYST2O.0 size=1048576 2024-09-14T11:15:18.395 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:18.396+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_1K8ESNXU6WDF.2~OYOW5LPYST2O.1 size=148574 2024-09-14T11:15:18.396 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:18.396+0000 7f76c1e8a8c0 1 > prepared multipart upload key=1K8ESNXU6WDF upload=OYOW5LPYST2O tag=BLJ5X6VV7C30 type=write size=2245726 2024-09-14T11:15:18.401 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:18.404+0000 7f76c1e8a8c0 1 < suggested remove operation key=HS7T50JORDQJ tag=RMBTK6PVIUAZ type=del 2024-09-14T11:15:18.405 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:18.408+0000 7f76c1e8a8c0 1 > prepared operation key=K2EEZLRK7MVO tag=Z2IMPYRI9BK9 type=write size=429449 2024-09-14T11:15:18.408 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:18.408+0000 7f76c1e8a8c0 1 < completed delete operation key=TZO40K6J9877 tag=DMM2QHMFHJT1 type=del 2024-09-14T11:15:18.411 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:18.412+0000 7f76c1e8a8c0 1 > prepared operation key=SHKU2PRNREKK tag=JU2TIZXV0OE4 type=del size=949353 2024-09-14T11:15:18.414 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:18.416+0000 7f76c1e8a8c0 1 < completed part key=_multipart_VI61O3K069BP.2~WN0ON1H0VWP6.0 size=1048576 2024-09-14T11:15:18.416 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:18.420+0000 7f76c1e8a8c0 1 < completed part key=_multipart_VI61O3K069BP.2~WN0ON1H0VWP6.1 size=1048576 2024-09-14T11:15:18.418 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:18.420+0000 7f76c1e8a8c0 1 < completed part key=_multipart_VI61O3K069BP.2~WN0ON1H0VWP6.2 size=20847 2024-09-14T11:15:18.423 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:18.424+0000 7f76c1e8a8c0 1 < completed multipart upload key=VI61O3K069BP upload=WN0ON1H0VWP6 tag=ZP2DIF58PAQ2 type=write size=3166575 2024-09-14T11:15:18.428 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:18.428+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_XC8VWSHZOPFP.2~KOHXD8RXEL7Z.0 size=1048576 2024-09-14T11:15:18.430 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:18.432+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_XC8VWSHZOPFP.2~KOHXD8RXEL7Z.1 size=594821 2024-09-14T11:15:18.430 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:18.432+0000 7f76c1e8a8c0 1 > prepared multipart upload key=XC8VWSHZOPFP upload=KOHXD8RXEL7Z tag=G7BDJ8ZRA0H1 type=write size=2691973 2024-09-14T11:15:18.433 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:18.436+0000 7f76c1e8a8c0 1 < completed part key=_multipart_VI61O3K069BP.2~033WX8CQ3QT4.0 size=27344 2024-09-14T11:15:18.438 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:18.440+0000 7f76c1e8a8c0 1 < completed multipart upload key=VI61O3K069BP upload=033WX8CQ3QT4 tag=HPD2UZY6YNTA type=write size=1075920 2024-09-14T11:15:18.441 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:18.444+0000 7f76c1e8a8c0 1 > prepared operation key=SHKU2PRNREKK tag=LQ7IA65B2CO0 type=write size=883563 2024-09-14T11:15:18.444 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:18.444+0000 7f76c1e8a8c0 -1 < failed to complete operation key=HS7T50JORDQJ tag=YS0MY6BPFXF7 type=write size=167635: (22) Invalid argument 2024-09-14T11:15:18.447 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:18.448+0000 7f76c1e8a8c0 1 > prepared operation key=HJ701768A6I7 tag=WO83E3HG9T49 type=del size=1644737 2024-09-14T11:15:18.456 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:18.456+0000 7f76c1e8a8c0 1 < completed part key=_multipart_S43U13LYETS4.2~6B8MXL3TMTNB.0 size=844316 2024-09-14T11:15:18.461 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:18.464+0000 7f76c1e8a8c0 1 < completed multipart upload key=S43U13LYETS4 upload=6B8MXL3TMTNB tag=E01WP05B0NPR type=write size=1892892 2024-09-14T11:15:18.464 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:18.464+0000 7f76c1e8a8c0 1 > prepared operation key=Q5IY4J5FOD80 tag=S236EJUH3ETI type=del size=2802094 2024-09-14T11:15:18.467 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:18.468+0000 7f76c1e8a8c0 1 < completed delete operation key=1W5733SDHGDN tag=UO1V23U1XJX4 type=del 2024-09-14T11:15:18.472 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:18.476+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_CIRQT9IDJ5OJ.2~VHFCWV8808FK.0 size=1048576 2024-09-14T11:15:18.474 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:18.476+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_CIRQT9IDJ5OJ.2~VHFCWV8808FK.1 size=1048576 2024-09-14T11:15:18.477 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:18.480+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_CIRQT9IDJ5OJ.2~VHFCWV8808FK.2 size=69652 2024-09-14T11:15:18.477 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:18.480+0000 7f76c1e8a8c0 1 > prepared multipart upload key=CIRQT9IDJ5OJ upload=VHFCWV8808FK tag=TKKMMHPKMDFY type=write size=3215380 2024-09-14T11:15:18.480 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:18.480+0000 7f76c1e8a8c0 1 < completed part key=_multipart_BOCIF4TL7X7J.2~LKA2AX8UYX8A.0 size=1031855 2024-09-14T11:15:18.486 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:18.488+0000 7f76c1e8a8c0 1 < completed multipart upload key=BOCIF4TL7X7J upload=LKA2AX8UYX8A tag=PT4UAUY28ST3 type=write size=2080431 2024-09-14T11:15:18.492 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:18.492+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_R5I9H7WAK7Z7.2~MG4IPO0H29IM.0 size=1048576 2024-09-14T11:15:18.494 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:18.496+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_R5I9H7WAK7Z7.2~MG4IPO0H29IM.1 size=412057 2024-09-14T11:15:18.495 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:18.496+0000 7f76c1e8a8c0 1 > prepared multipart upload key=R5I9H7WAK7Z7 upload=MG4IPO0H29IM tag=VBC9LZYX8BWV type=write size=2509209 2024-09-14T11:15:18.495 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:18.496+0000 7f76c1e8a8c0 1 < canceled part key=_multipart_S43U13LYETS4.2~WJ6VCU2S3WUQ.0 size=1048576 2024-09-14T11:15:18.498 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:18.500+0000 7f76c1e8a8c0 1 < completed part key=_multipart_S43U13LYETS4.2~WJ6VCU2S3WUQ.1 size=654021 2024-09-14T11:15:18.504 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:18.504+0000 7f76c1e8a8c0 1 < canceled multipart upload key=S43U13LYETS4 upload=WJ6VCU2S3WUQ tag=VIFTKR817FAH type=write size=2751173 2024-09-14T11:15:18.507 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:18.508+0000 7f76c1e8a8c0 1 > prepared operation key=H9CQV6L29SL5 tag=OCGBES6FJD53 type=del size=711274 2024-09-14T11:15:18.510 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:18.512+0000 7f76c1e8a8c0 1 < completed part key=_multipart_F3KFS0P1WM7W.2~HNFQW525ZOXF.0 size=1048576 2024-09-14T11:15:18.513 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:18.516+0000 7f76c1e8a8c0 1 < completed part key=_multipart_F3KFS0P1WM7W.2~HNFQW525ZOXF.1 size=599468 2024-09-14T11:15:18.519 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:18.520+0000 7f76c1e8a8c0 1 < completed multipart upload key=F3KFS0P1WM7W upload=HNFQW525ZOXF tag=SBGQ7KBVPEN2 type=write size=2696620 2024-09-14T11:15:18.524 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:18.528+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_8PZOVFEYYSOG.2~41LJ2SCU1L8I.0 size=1048576 2024-09-14T11:15:18.527 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:18.528+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_8PZOVFEYYSOG.2~41LJ2SCU1L8I.1 size=864086 2024-09-14T11:15:18.527 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:18.528+0000 7f76c1e8a8c0 1 > prepared multipart upload key=8PZOVFEYYSOG upload=41LJ2SCU1L8I tag=X32DW7BEUW9Y type=write size=2961238 2024-09-14T11:15:18.530 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:18.532+0000 7f76c1e8a8c0 1 < completed delete operation key=85G6NT78HAWQ tag=NEZSEV22M2PC type=del 2024-09-14T11:15:18.533 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:18.536+0000 7f76c1e8a8c0 1 > prepared operation key=TUFOZKTV9XIH tag=BYYFBV5PPB8I type=del size=3717651 2024-09-14T11:15:18.535 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:18.536+0000 7f76c1e8a8c0 1 < completed part key=_multipart_SHKU2PRNREKK.2~5A8GAG57IZA8.0 size=1048576 2024-09-14T11:15:18.538 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:18.540+0000 7f76c1e8a8c0 1 < completed part key=_multipart_SHKU2PRNREKK.2~5A8GAG57IZA8.1 size=1048576 2024-09-14T11:15:18.540 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:18.544+0000 7f76c1e8a8c0 1 < completed part key=_multipart_SHKU2PRNREKK.2~5A8GAG57IZA8.2 size=717110 2024-09-14T11:15:18.545 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:18.548+0000 7f76c1e8a8c0 1 < completed multipart upload key=SHKU2PRNREKK upload=5A8GAG57IZA8 tag=J1DER3AOS8H5 type=write size=3862838 2024-09-14T11:15:18.548 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:18.552+0000 7f76c1e8a8c0 1 > prepared operation key=SHKU2PRNREKK tag=RAVP062JMO40 type=del size=3544151 2024-09-14T11:15:18.549 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:18.552+0000 7f76c1e8a8c0 1 < canceled part key=_multipart_8PZOVFEYYSOG.2~JPKHUK3O64JJ.0 size=224116 2024-09-14T11:15:18.555 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:18.556+0000 7f76c1e8a8c0 1 < canceled multipart upload key=8PZOVFEYYSOG upload=JPKHUK3O64JJ tag=OLEMMJ0JGATO type=write size=1272692 2024-09-14T11:15:18.561 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:18.564+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_Q5IY4J5FOD80.2~UESSHKZVH81W.0 size=1048576 2024-09-14T11:15:18.563 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:18.564+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_Q5IY4J5FOD80.2~UESSHKZVH81W.1 size=869541 2024-09-14T11:15:18.563 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:18.564+0000 7f76c1e8a8c0 1 > prepared multipart upload key=Q5IY4J5FOD80 upload=UESSHKZVH81W tag=90L42X82V21W type=write size=2966693 2024-09-14T11:15:18.567 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:18.568+0000 7f76c1e8a8c0 1 < completed delete operation key=R5I9H7WAK7Z7 tag=0FRKP3TB6SX1 type=del 2024-09-14T11:15:18.571 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:18.572+0000 7f76c1e8a8c0 1 > prepared operation key=W0MDRE9YO3UP tag=T4BX0ZAOPSBY type=del size=3449320 2024-09-14T11:15:18.574 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:18.576+0000 7f76c1e8a8c0 1 < completed delete operation key=8FFV9G6EQR8F tag=Z1222MGZY8AD type=del 2024-09-14T11:15:18.578 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:18.580+0000 7f76c1e8a8c0 1 > prepared operation key=LZ0YNFOVFYCL tag=MMUITOVSC60Y type=del size=797415 2024-09-14T11:15:18.578 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:18.580+0000 7f76c1e8a8c0 1 < canceled part key=_multipart_1K8ESNXU6WDF.2~OYOW5LPYST2O.0 size=1048576 2024-09-14T11:15:18.578 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:18.580+0000 7f76c1e8a8c0 1 < canceled part key=_multipart_1K8ESNXU6WDF.2~OYOW5LPYST2O.1 size=148574 2024-09-14T11:15:18.584 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:18.588+0000 7f76c1e8a8c0 1 < canceled multipart upload key=1K8ESNXU6WDF upload=OYOW5LPYST2O tag=BLJ5X6VV7C30 type=write size=2245726 2024-09-14T11:15:18.590 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:18.592+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_1W5733SDHGDN.2~W69H3ELFYZKI.0 size=205908 2024-09-14T11:15:18.590 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:18.592+0000 7f76c1e8a8c0 1 > prepared multipart upload key=1W5733SDHGDN upload=W69H3ELFYZKI tag=KQPOT4AWC8MW type=write size=1254484 2024-09-14T11:15:18.594 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:18.596+0000 7f76c1e8a8c0 1 < canceled operation key=K2EEZLRK7MVO tag=Z2IMPYRI9BK9 type=write size=429449 2024-09-14T11:15:18.597 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:18.600+0000 7f76c1e8a8c0 1 > prepared operation key=85G6NT78HAWQ tag=P2BL1A6PSSUC type=del size=476137 2024-09-14T11:15:18.603 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:18.604+0000 7f76c1e8a8c0 1 < suggested remove operation key=SHKU2PRNREKK tag=JU2TIZXV0OE4 type=del 2024-09-14T11:15:18.606 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:18.608+0000 7f76c1e8a8c0 1 > prepared operation key=85G6NT78HAWQ tag=5I6LDP3E967J type=del size=3086583 2024-09-14T11:15:18.607 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:18.608+0000 7f76c1e8a8c0 1 < canceled part key=_multipart_XC8VWSHZOPFP.2~KOHXD8RXEL7Z.0 size=1048576 2024-09-14T11:15:18.609 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:18.612+0000 7f76c1e8a8c0 1 < completed part key=_multipart_XC8VWSHZOPFP.2~KOHXD8RXEL7Z.1 size=594821 2024-09-14T11:15:18.615 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:18.616+0000 7f76c1e8a8c0 1 < canceled multipart upload key=XC8VWSHZOPFP upload=KOHXD8RXEL7Z tag=G7BDJ8ZRA0H1 type=write size=2691973 2024-09-14T11:15:18.621 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:18.624+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_R5I9H7WAK7Z7.2~UVZ0BLZ3F4EE.0 size=1048576 2024-09-14T11:15:18.623 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:18.624+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_R5I9H7WAK7Z7.2~UVZ0BLZ3F4EE.1 size=1048576 2024-09-14T11:15:18.626 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:18.628+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_R5I9H7WAK7Z7.2~UVZ0BLZ3F4EE.2 size=165994 2024-09-14T11:15:18.626 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:18.628+0000 7f76c1e8a8c0 1 > prepared multipart upload key=R5I9H7WAK7Z7 upload=UVZ0BLZ3F4EE tag=4FM8D272JDNA type=write size=3311722 2024-09-14T11:15:18.630 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:18.632+0000 7f76c1e8a8c0 -1 < failed to complete operation key=SHKU2PRNREKK tag=LQ7IA65B2CO0 type=write size=883563: (22) Invalid argument 2024-09-14T11:15:18.635 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:18.636+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_VI61O3K069BP.2~WKE10MYAZDZC.0 size=1048576 2024-09-14T11:15:18.638 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:18.640+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_VI61O3K069BP.2~WKE10MYAZDZC.1 size=427174 2024-09-14T11:15:18.638 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:18.640+0000 7f76c1e8a8c0 1 > prepared multipart upload key=VI61O3K069BP upload=WKE10MYAZDZC tag=VTDXW83EEYTG type=write size=2524326 2024-09-14T11:15:18.641 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:18.644+0000 7f76c1e8a8c0 1 < completed delete operation key=HJ701768A6I7 tag=WO83E3HG9T49 type=del 2024-09-14T11:15:18.644 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:18.648+0000 7f76c1e8a8c0 1 > prepared operation key=TUFOZKTV9XIH tag=V0RVM9VQRK1W type=del size=3589044 2024-09-14T11:15:18.647 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:18.648+0000 7f76c1e8a8c0 1 < completed delete operation key=Q5IY4J5FOD80 tag=S236EJUH3ETI type=del 2024-09-14T11:15:18.651 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:18.652+0000 7f76c1e8a8c0 1 > prepared operation key=BOCIF4TL7X7J tag=8GCZYIDPTY7S type=del size=4063915 2024-09-14T11:15:18.657 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:18.656+0000 7f76c1e8a8c0 1 < completed part key=_multipart_CIRQT9IDJ5OJ.2~VHFCWV8808FK.0 size=1048576 2024-09-14T11:15:18.657 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:18.660+0000 7f76c1e8a8c0 1 < completed part key=_multipart_CIRQT9IDJ5OJ.2~VHFCWV8808FK.1 size=1048576 2024-09-14T11:15:18.660 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:18.660+0000 7f76c1e8a8c0 1 < completed part key=_multipart_CIRQT9IDJ5OJ.2~VHFCWV8808FK.2 size=69652 2024-09-14T11:15:18.666 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:18.668+0000 7f76c1e8a8c0 1 < completed multipart upload key=CIRQT9IDJ5OJ upload=VHFCWV8808FK tag=TKKMMHPKMDFY type=write size=3215380 2024-09-14T11:15:18.673 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:18.676+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_W0MDRE9YO3UP.2~0D2NX10VFMGM.0 size=1048576 2024-09-14T11:15:18.675 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:18.676+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_W0MDRE9YO3UP.2~0D2NX10VFMGM.1 size=1048576 2024-09-14T11:15:18.678 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:18.680+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_W0MDRE9YO3UP.2~0D2NX10VFMGM.2 size=418563 2024-09-14T11:15:18.678 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:18.680+0000 7f76c1e8a8c0 1 > prepared multipart upload key=W0MDRE9YO3UP upload=0D2NX10VFMGM tag=81GPDGR0EN3M type=write size=3564291 2024-09-14T11:15:18.682 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:18.684+0000 7f76c1e8a8c0 1 < completed part key=_multipart_R5I9H7WAK7Z7.2~MG4IPO0H29IM.0 size=1048576 2024-09-14T11:15:18.682 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:18.684+0000 7f76c1e8a8c0 1 < canceled part key=_multipart_R5I9H7WAK7Z7.2~MG4IPO0H29IM.1 size=412057 2024-09-14T11:15:18.688 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:18.688+0000 7f76c1e8a8c0 1 < canceled multipart upload key=R5I9H7WAK7Z7 upload=MG4IPO0H29IM tag=VBC9LZYX8BWV type=write size=2509209 2024-09-14T11:15:18.692 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:18.692+0000 7f76c1e8a8c0 1 > prepared operation key=TUFOZKTV9XIH tag=C6UIJNLKQ8V3 type=del size=972440 2024-09-14T11:15:18.695 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:18.696+0000 7f76c1e8a8c0 1 < canceled operation key=H9CQV6L29SL5 tag=OCGBES6FJD53 type=del size=711274 2024-09-14T11:15:18.702 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:18.704+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_SUNCRV0C1XYL.2~37KY0L4F9YC1.0 size=1048576 2024-09-14T11:15:18.704 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:18.704+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_SUNCRV0C1XYL.2~37KY0L4F9YC1.1 size=1048576 2024-09-14T11:15:18.706 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:18.708+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_SUNCRV0C1XYL.2~37KY0L4F9YC1.2 size=371617 2024-09-14T11:15:18.706 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:18.708+0000 7f76c1e8a8c0 1 > prepared multipart upload key=SUNCRV0C1XYL upload=37KY0L4F9YC1 tag=6PK0JR600BC2 type=write size=3517345 2024-09-14T11:15:18.709 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:18.712+0000 7f76c1e8a8c0 1 < completed part key=_multipart_8PZOVFEYYSOG.2~41LJ2SCU1L8I.0 size=1048576 2024-09-14T11:15:18.711 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:18.712+0000 7f76c1e8a8c0 1 < completed part key=_multipart_8PZOVFEYYSOG.2~41LJ2SCU1L8I.1 size=864086 2024-09-14T11:15:18.716 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:18.716+0000 7f76c1e8a8c0 1 < completed multipart upload key=8PZOVFEYYSOG upload=41LJ2SCU1L8I tag=X32DW7BEUW9Y type=write size=2961238 2024-09-14T11:15:18.721 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:18.724+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_8FFV9G6EQR8F.2~6103CKCDDYC0.0 size=1048576 2024-09-14T11:15:18.723 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:18.724+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_8FFV9G6EQR8F.2~6103CKCDDYC0.1 size=946568 2024-09-14T11:15:18.723 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:18.724+0000 7f76c1e8a8c0 1 > prepared multipart upload key=8FFV9G6EQR8F upload=6103CKCDDYC0 tag=BDYPKMNL1O07 type=write size=3043720 2024-09-14T11:15:18.726 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:18.728+0000 7f76c1e8a8c0 1 < completed delete operation key=TUFOZKTV9XIH tag=BYYFBV5PPB8I type=del 2024-09-14T11:15:18.731 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:18.732+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_KS37ZO6MKAH9.2~K92KTI7UG96Z.0 size=1048576 2024-09-14T11:15:18.734 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:18.736+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_KS37ZO6MKAH9.2~K92KTI7UG96Z.1 size=1048576 2024-09-14T11:15:18.736 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:18.740+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_KS37ZO6MKAH9.2~K92KTI7UG96Z.2 size=994619 2024-09-14T11:15:18.736 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:18.740+0000 7f76c1e8a8c0 1 > prepared multipart upload key=KS37ZO6MKAH9 upload=K92KTI7UG96Z tag=WSONH10NE3LY type=write size=4140347 2024-09-14T11:15:18.739 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:18.740+0000 7f76c1e8a8c0 -1 < failed to complete operation key=SHKU2PRNREKK tag=RAVP062JMO40 type=del size=3544151: (22) Invalid argument 2024-09-14T11:15:18.744 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:18.748+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_15FU4CEGC22Q.2~JNLH14L3ASA4.0 size=1048576 2024-09-14T11:15:18.750 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:18.752+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_15FU4CEGC22Q.2~JNLH14L3ASA4.1 size=927430 2024-09-14T11:15:18.750 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:18.752+0000 7f76c1e8a8c0 1 > prepared multipart upload key=15FU4CEGC22Q upload=JNLH14L3ASA4 tag=CSG8NIDPXQ3Q type=write size=3024582 2024-09-14T11:15:18.753 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:18.756+0000 7f76c1e8a8c0 1 < completed part key=_multipart_Q5IY4J5FOD80.2~UESSHKZVH81W.0 size=1048576 2024-09-14T11:15:18.755 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:18.756+0000 7f76c1e8a8c0 1 < completed part key=_multipart_Q5IY4J5FOD80.2~UESSHKZVH81W.1 size=869541 2024-09-14T11:15:18.760 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:18.760+0000 7f76c1e8a8c0 1 < completed multipart upload key=Q5IY4J5FOD80 upload=UESSHKZVH81W tag=90L42X82V21W type=write size=2966693 2024-09-14T11:15:18.763 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:18.764+0000 7f76c1e8a8c0 1 > prepared operation key=1W5733SDHGDN tag=81FZRDVFKM13 type=write size=591599 2024-09-14T11:15:18.766 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:18.768+0000 7f76c1e8a8c0 1 < completed delete operation key=W0MDRE9YO3UP tag=T4BX0ZAOPSBY type=del 2024-09-14T11:15:18.769 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:18.772+0000 7f76c1e8a8c0 1 > prepared operation key=W0MDRE9YO3UP tag=PWEXDQJYL8HB type=del size=3171123 2024-09-14T11:15:18.775 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:18.776+0000 7f76c1e8a8c0 1 < suggested update operation key=LZ0YNFOVFYCL tag=MMUITOVSC60Y type=del size=797415 2024-09-14T11:15:18.778 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:18.780+0000 7f76c1e8a8c0 1 > prepared operation key=TZO40K6J9877 tag=2UKO1WRF496L type=write size=1002888 2024-09-14T11:15:18.781 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:18.784+0000 7f76c1e8a8c0 1 < completed part key=_multipart_1W5733SDHGDN.2~W69H3ELFYZKI.0 size=205908 2024-09-14T11:15:18.785 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:18.788+0000 7f76c1e8a8c0 1 < completed multipart upload key=1W5733SDHGDN upload=W69H3ELFYZKI tag=KQPOT4AWC8MW type=write size=1254484 2024-09-14T11:15:18.791 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:18.792+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_OUMUTEBQ1TD0.2~89QJU3BWT0VQ.0 size=1048576 2024-09-14T11:15:18.793 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:18.796+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_OUMUTEBQ1TD0.2~89QJU3BWT0VQ.1 size=295856 2024-09-14T11:15:18.793 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:18.796+0000 7f76c1e8a8c0 1 > prepared multipart upload key=OUMUTEBQ1TD0 upload=89QJU3BWT0VQ tag=WS7168JKC4CU type=write size=2393008 2024-09-14T11:15:18.798 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:18.800+0000 7f76c1e8a8c0 1 < suggested remove operation key=85G6NT78HAWQ tag=P2BL1A6PSSUC type=del 2024-09-14T11:15:18.801 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:18.804+0000 7f76c1e8a8c0 1 > prepared operation key=W0MDRE9YO3UP tag=X1U305M7MB8K type=del size=1664896 2024-09-14T11:15:18.804 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:18.808+0000 7f76c1e8a8c0 -1 < failed to complete operation key=85G6NT78HAWQ tag=5I6LDP3E967J type=del size=3086583: (22) Invalid argument 2024-09-14T11:15:18.807 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:18.808+0000 7f76c1e8a8c0 1 > prepared operation key=TUFOZKTV9XIH tag=8FPROEHM3Z3S type=del size=666402 2024-09-14T11:15:18.810 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:18.812+0000 7f76c1e8a8c0 1 < completed part key=_multipart_R5I9H7WAK7Z7.2~UVZ0BLZ3F4EE.0 size=1048576 2024-09-14T11:15:18.813 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:18.816+0000 7f76c1e8a8c0 1 < completed part key=_multipart_R5I9H7WAK7Z7.2~UVZ0BLZ3F4EE.1 size=1048576 2024-09-14T11:15:18.815 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:18.816+0000 7f76c1e8a8c0 1 < completed part key=_multipart_R5I9H7WAK7Z7.2~UVZ0BLZ3F4EE.2 size=165994 2024-09-14T11:15:18.820 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:18.820+0000 7f76c1e8a8c0 1 < completed multipart upload key=R5I9H7WAK7Z7 upload=UVZ0BLZ3F4EE tag=4FM8D272JDNA type=write size=3311722 2024-09-14T11:15:18.823 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:18.824+0000 7f76c1e8a8c0 1 > prepared operation key=H9CQV6L29SL5 tag=UVQIVH1SOJUL type=write size=437152 2024-09-14T11:15:18.826 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:18.828+0000 7f76c1e8a8c0 1 < completed part key=_multipart_VI61O3K069BP.2~WKE10MYAZDZC.0 size=1048576 2024-09-14T11:15:18.829 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:18.832+0000 7f76c1e8a8c0 1 < completed part key=_multipart_VI61O3K069BP.2~WKE10MYAZDZC.1 size=427174 2024-09-14T11:15:18.834 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:18.836+0000 7f76c1e8a8c0 1 < completed multipart upload key=VI61O3K069BP upload=WKE10MYAZDZC tag=VTDXW83EEYTG type=write size=2524326 2024-09-14T11:15:18.838 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:18.840+0000 7f76c1e8a8c0 1 > prepared operation key=8PZOVFEYYSOG tag=V3XRH532HHRO type=del size=725230 2024-09-14T11:15:18.841 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:18.844+0000 7f76c1e8a8c0 1 < completed delete operation key=TUFOZKTV9XIH tag=V0RVM9VQRK1W type=del 2024-09-14T11:15:18.847 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:18.848+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_1W5733SDHGDN.2~2GYGHEP7RFRP.0 size=1048576 2024-09-14T11:15:18.850 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:18.852+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_1W5733SDHGDN.2~2GYGHEP7RFRP.1 size=965328 2024-09-14T11:15:18.850 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:18.852+0000 7f76c1e8a8c0 1 > prepared multipart upload key=1W5733SDHGDN upload=2GYGHEP7RFRP tag=BCEG4DWLUBX1 type=write size=3062480 2024-09-14T11:15:18.853 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:18.856+0000 7f76c1e8a8c0 1 < completed delete operation key=BOCIF4TL7X7J tag=8GCZYIDPTY7S type=del 2024-09-14T11:15:18.856 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:18.856+0000 7f76c1e8a8c0 1 > prepared operation key=K9W031V6BFJP tag=CTA4VJE13ERR type=del size=821359 2024-09-14T11:15:18.859 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:18.860+0000 7f76c1e8a8c0 1 < completed part key=_multipart_W0MDRE9YO3UP.2~0D2NX10VFMGM.0 size=1048576 2024-09-14T11:15:18.861 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:18.864+0000 7f76c1e8a8c0 1 < completed part key=_multipart_W0MDRE9YO3UP.2~0D2NX10VFMGM.1 size=1048576 2024-09-14T11:15:18.864 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:18.864+0000 7f76c1e8a8c0 1 < completed part key=_multipart_W0MDRE9YO3UP.2~0D2NX10VFMGM.2 size=418563 2024-09-14T11:15:18.869 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:18.872+0000 7f76c1e8a8c0 1 < completed multipart upload key=W0MDRE9YO3UP upload=0D2NX10VFMGM tag=81GPDGR0EN3M type=write size=3564291 2024-09-14T11:15:18.875 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:18.876+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_H9CQV6L29SL5.2~R3KOL0CKEVFH.0 size=1048576 2024-09-14T11:15:18.877 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:18.880+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_H9CQV6L29SL5.2~R3KOL0CKEVFH.1 size=1048576 2024-09-14T11:15:18.879 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:18.880+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_H9CQV6L29SL5.2~R3KOL0CKEVFH.2 size=760203 2024-09-14T11:15:18.879 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:18.880+0000 7f76c1e8a8c0 1 > prepared multipart upload key=H9CQV6L29SL5 upload=R3KOL0CKEVFH tag=HJHMC5WM1Q9Z type=write size=3905931 2024-09-14T11:15:18.882 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:18.884+0000 7f76c1e8a8c0 1 < completed delete operation key=TUFOZKTV9XIH tag=C6UIJNLKQ8V3 type=del 2024-09-14T11:15:18.885 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:18.888+0000 7f76c1e8a8c0 1 > prepared operation key=8FFV9G6EQR8F tag=9ZDDOGY15JDJ type=del size=823111 2024-09-14T11:15:18.887 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:18.888+0000 7f76c1e8a8c0 1 < completed part key=_multipart_SUNCRV0C1XYL.2~37KY0L4F9YC1.0 size=1048576 2024-09-14T11:15:18.890 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:18.892+0000 7f76c1e8a8c0 1 < completed part key=_multipart_SUNCRV0C1XYL.2~37KY0L4F9YC1.1 size=1048576 2024-09-14T11:15:18.892 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:18.896+0000 7f76c1e8a8c0 1 < completed part key=_multipart_SUNCRV0C1XYL.2~37KY0L4F9YC1.2 size=371617 2024-09-14T11:15:18.898 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:18.900+0000 7f76c1e8a8c0 1 < completed multipart upload key=SUNCRV0C1XYL upload=37KY0L4F9YC1 tag=6PK0JR600BC2 type=write size=3517345 2024-09-14T11:15:18.903 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:18.904+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_KS37ZO6MKAH9.2~NDM3Q0HGSBCC.0 size=1048576 2024-09-14T11:15:18.906 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:18.908+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_KS37ZO6MKAH9.2~NDM3Q0HGSBCC.1 size=435535 2024-09-14T11:15:18.906 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:18.908+0000 7f76c1e8a8c0 1 > prepared multipart upload key=KS37ZO6MKAH9 upload=NDM3Q0HGSBCC tag=FVRUURRJXMTJ type=write size=2532687 2024-09-14T11:15:18.909 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:18.912+0000 7f76c1e8a8c0 1 < completed part key=_multipart_8FFV9G6EQR8F.2~6103CKCDDYC0.0 size=1048576 2024-09-14T11:15:18.911 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:18.912+0000 7f76c1e8a8c0 1 < completed part key=_multipart_8FFV9G6EQR8F.2~6103CKCDDYC0.1 size=946568 2024-09-14T11:15:18.916 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:18.920+0000 7f76c1e8a8c0 1 < completed multipart upload key=8FFV9G6EQR8F upload=6103CKCDDYC0 tag=BDYPKMNL1O07 type=write size=3043720 2024-09-14T11:15:18.919 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:18.920+0000 7f76c1e8a8c0 1 > prepared operation key=K9W031V6BFJP tag=9GWZ7LX07FZ0 type=write size=966035 2024-09-14T11:15:18.922 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:18.924+0000 7f76c1e8a8c0 1 < completed part key=_multipart_KS37ZO6MKAH9.2~K92KTI7UG96Z.0 size=1048576 2024-09-14T11:15:18.924 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:18.928+0000 7f76c1e8a8c0 1 < completed part key=_multipart_KS37ZO6MKAH9.2~K92KTI7UG96Z.1 size=1048576 2024-09-14T11:15:18.927 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:18.928+0000 7f76c1e8a8c0 1 < completed part key=_multipart_KS37ZO6MKAH9.2~K92KTI7UG96Z.2 size=994619 2024-09-14T11:15:18.931 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:18.932+0000 7f76c1e8a8c0 1 < completed multipart upload key=KS37ZO6MKAH9 upload=K92KTI7UG96Z tag=WSONH10NE3LY type=write size=4140347 2024-09-14T11:15:18.936 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:18.940+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_GAVZRU8ZLW7S.2~21GSWAADJYIP.0 size=1048576 2024-09-14T11:15:18.939 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:18.940+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_GAVZRU8ZLW7S.2~21GSWAADJYIP.1 size=1048576 2024-09-14T11:15:18.941 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:18.944+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_GAVZRU8ZLW7S.2~21GSWAADJYIP.2 size=635965 2024-09-14T11:15:18.941 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:18.944+0000 7f76c1e8a8c0 1 > prepared multipart upload key=GAVZRU8ZLW7S upload=21GSWAADJYIP tag=V64XUI2UPEUO type=write size=3781693 2024-09-14T11:15:18.941 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:18.944+0000 7f76c1e8a8c0 1 < canceled part key=_multipart_15FU4CEGC22Q.2~JNLH14L3ASA4.0 size=1048576 2024-09-14T11:15:18.944 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:18.944+0000 7f76c1e8a8c0 1 < completed part key=_multipart_15FU4CEGC22Q.2~JNLH14L3ASA4.1 size=927430 2024-09-14T11:15:18.948 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:18.952+0000 7f76c1e8a8c0 1 < canceled multipart upload key=15FU4CEGC22Q upload=JNLH14L3ASA4 tag=CSG8NIDPXQ3Q type=write size=3024582 2024-09-14T11:15:18.953 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:18.956+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_F3KFS0P1WM7W.2~J23BM2ZD16CF.0 size=1048576 2024-09-14T11:15:18.954 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:18.956+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_F3KFS0P1WM7W.2~J23BM2ZD16CF.1 size=770131 2024-09-14T11:15:18.954 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:18.956+0000 7f76c1e8a8c0 1 > prepared multipart upload key=F3KFS0P1WM7W upload=J23BM2ZD16CF tag=NVKCMJ02L57F type=write size=2867283 2024-09-14T11:15:18.957 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:18.960+0000 7f76c1e8a8c0 1 < canceled operation key=1W5733SDHGDN tag=81FZRDVFKM13 type=write size=591599 2024-09-14T11:15:18.962 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:18.964+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_W0MDRE9YO3UP.2~KG4ZWFS5RQL3.0 size=606010 2024-09-14T11:15:18.962 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:18.964+0000 7f76c1e8a8c0 1 > prepared multipart upload key=W0MDRE9YO3UP upload=KG4ZWFS5RQL3 tag=0TU2E7QUAM2N type=write size=1654586 2024-09-14T11:15:18.967 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:18.968+0000 7f76c1e8a8c0 1 < suggested update operation key=W0MDRE9YO3UP tag=PWEXDQJYL8HB type=del size=3171123 2024-09-14T11:15:18.971 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:18.972+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_F3KFS0P1WM7W.2~GACNWF1UWHFI.0 size=1048576 2024-09-14T11:15:18.973 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:18.976+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_F3KFS0P1WM7W.2~GACNWF1UWHFI.1 size=802442 2024-09-14T11:15:18.973 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:18.976+0000 7f76c1e8a8c0 1 > prepared multipart upload key=F3KFS0P1WM7W upload=GACNWF1UWHFI tag=MC3K06N1ZKHT type=write size=2899594 2024-09-14T11:15:18.978 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:18.980+0000 7f76c1e8a8c0 1 < suggested remove operation key=TZO40K6J9877 tag=2UKO1WRF496L type=write 2024-09-14T11:15:18.981 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:18.984+0000 7f76c1e8a8c0 1 > prepared operation key=KS37ZO6MKAH9 tag=M6D7MNERPJFS type=del size=2778181 2024-09-14T11:15:18.983 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:18.984+0000 7f76c1e8a8c0 1 < completed part key=_multipart_OUMUTEBQ1TD0.2~89QJU3BWT0VQ.0 size=1048576 2024-09-14T11:15:18.985 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:18.988+0000 7f76c1e8a8c0 1 < completed part key=_multipart_OUMUTEBQ1TD0.2~89QJU3BWT0VQ.1 size=295856 2024-09-14T11:15:18.989 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:18.992+0000 7f76c1e8a8c0 1 < completed multipart upload key=OUMUTEBQ1TD0 upload=89QJU3BWT0VQ tag=WS7168JKC4CU type=write size=2393008 2024-09-14T11:15:18.992 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:18.996+0000 7f76c1e8a8c0 1 > prepared operation key=OOUEM16XL80W tag=UY7WGEONBEGC type=del size=3366121 2024-09-14T11:15:18.995 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:18.996+0000 7f76c1e8a8c0 -1 < failed to complete operation key=W0MDRE9YO3UP tag=X1U305M7MB8K type=del size=1664896: (22) Invalid argument 2024-09-14T11:15:18.997 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:19.000+0000 7f76c1e8a8c0 1 > prepared operation key=1W5733SDHGDN tag=ONGRD5VRT910 type=del size=4165344 2024-09-14T11:15:18.999 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:19.000+0000 7f76c1e8a8c0 1 < completed delete operation key=TUFOZKTV9XIH tag=8FPROEHM3Z3S type=del 2024-09-14T11:15:19.002 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:19.004+0000 7f76c1e8a8c0 1 > prepared operation key=HS7T50JORDQJ tag=6WVPL712WPXS type=del size=1768400 2024-09-14T11:15:19.004 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:19.008+0000 7f76c1e8a8c0 1 < completed write operation key=H9CQV6L29SL5 tag=UVQIVH1SOJUL type=write size=437152 2024-09-14T11:15:19.013 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:19.016+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_K2EEZLRK7MVO.2~JNMMAQSJMTD0.0 size=1048576 2024-09-14T11:15:19.015 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:19.016+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_K2EEZLRK7MVO.2~JNMMAQSJMTD0.1 size=1048576 2024-09-14T11:15:19.017 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:19.020+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_K2EEZLRK7MVO.2~JNMMAQSJMTD0.2 size=40287 2024-09-14T11:15:19.017 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:19.020+0000 7f76c1e8a8c0 1 > prepared multipart upload key=K2EEZLRK7MVO upload=JNMMAQSJMTD0 tag=VLXPTA32E0F5 type=write size=3186015 2024-09-14T11:15:19.020 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:19.020+0000 7f76c1e8a8c0 1 < completed delete operation key=8PZOVFEYYSOG tag=V3XRH532HHRO type=del 2024-09-14T11:15:19.024 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:19.028+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_K2EEZLRK7MVO.2~1U6IECOHFXNP.0 size=993593 2024-09-14T11:15:19.024 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:19.028+0000 7f76c1e8a8c0 1 > prepared multipart upload key=K2EEZLRK7MVO upload=1U6IECOHFXNP tag=1FI916FSUH6F type=write size=2042169 2024-09-14T11:15:19.026 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:19.028+0000 7f76c1e8a8c0 1 < completed part key=_multipart_1W5733SDHGDN.2~2GYGHEP7RFRP.0 size=1048576 2024-09-14T11:15:19.029 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:19.032+0000 7f76c1e8a8c0 1 < completed part key=_multipart_1W5733SDHGDN.2~2GYGHEP7RFRP.1 size=965328 2024-09-14T11:15:19.033 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:19.036+0000 7f76c1e8a8c0 1 < completed multipart upload key=1W5733SDHGDN upload=2GYGHEP7RFRP tag=BCEG4DWLUBX1 type=write size=3062480 2024-09-14T11:15:19.036 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:19.036+0000 7f76c1e8a8c0 1 > prepared operation key=R5I9H7WAK7Z7 tag=5WONV3D2WX4C type=write size=103118 2024-09-14T11:15:19.038 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:19.040+0000 7f76c1e8a8c0 1 < completed delete operation key=K9W031V6BFJP tag=CTA4VJE13ERR type=del 2024-09-14T11:15:19.043 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:19.044+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_HJ701768A6I7.2~0OYFZ5182SCK.0 size=1048576 2024-09-14T11:15:19.045 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:19.048+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_HJ701768A6I7.2~0OYFZ5182SCK.1 size=698424 2024-09-14T11:15:19.045 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:19.048+0000 7f76c1e8a8c0 1 > prepared multipart upload key=HJ701768A6I7 upload=0OYFZ5182SCK tag=VO4VDBT8LLS7 type=write size=2795576 2024-09-14T11:15:19.047 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:19.048+0000 7f76c1e8a8c0 1 < completed part key=_multipart_H9CQV6L29SL5.2~R3KOL0CKEVFH.0 size=1048576 2024-09-14T11:15:19.049 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:19.052+0000 7f76c1e8a8c0 1 < completed part key=_multipart_H9CQV6L29SL5.2~R3KOL0CKEVFH.1 size=1048576 2024-09-14T11:15:19.052 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:19.052+0000 7f76c1e8a8c0 1 < completed part key=_multipart_H9CQV6L29SL5.2~R3KOL0CKEVFH.2 size=760203 2024-09-14T11:15:19.058 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:19.060+0000 7f76c1e8a8c0 1 < completed multipart upload key=H9CQV6L29SL5 upload=R3KOL0CKEVFH tag=HJHMC5WM1Q9Z type=write size=3905931 2024-09-14T11:15:19.061 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:19.064+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_TUFOZKTV9XIH.2~HEPRXO46QWVD.0 size=367952 2024-09-14T11:15:19.062 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:19.064+0000 7f76c1e8a8c0 1 > prepared multipart upload key=TUFOZKTV9XIH upload=HEPRXO46QWVD tag=31A2VEQI9A6M type=write size=1416528 2024-09-14T11:15:19.064 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:19.068+0000 7f76c1e8a8c0 1 < canceled operation key=8FFV9G6EQR8F tag=9ZDDOGY15JDJ type=del size=823111 2024-09-14T11:15:19.069 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:19.072+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_F3KFS0P1WM7W.2~FVN683075DLS.0 size=86703 2024-09-14T11:15:19.069 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:19.072+0000 7f76c1e8a8c0 1 > prepared multipart upload key=F3KFS0P1WM7W upload=FVN683075DLS tag=YRPQ5ZU6XFTR type=write size=1135279 2024-09-14T11:15:19.072 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:19.072+0000 7f76c1e8a8c0 1 < completed part key=_multipart_KS37ZO6MKAH9.2~NDM3Q0HGSBCC.0 size=1048576 2024-09-14T11:15:19.074 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:19.076+0000 7f76c1e8a8c0 1 < completed part key=_multipart_KS37ZO6MKAH9.2~NDM3Q0HGSBCC.1 size=435535 2024-09-14T11:15:19.079 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:19.080+0000 7f76c1e8a8c0 1 < completed multipart upload key=KS37ZO6MKAH9 upload=NDM3Q0HGSBCC tag=FVRUURRJXMTJ type=write size=2532687 2024-09-14T11:15:19.083 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:19.084+0000 7f76c1e8a8c0 1 > prepared operation key=K2EEZLRK7MVO tag=9O9K7Z2DQI8J type=del size=4130929 2024-09-14T11:15:19.086 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:19.088+0000 7f76c1e8a8c0 1 < completed write operation key=K9W031V6BFJP tag=9GWZ7LX07FZ0 type=write size=966035 2024-09-14T11:15:19.090 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:19.092+0000 7f76c1e8a8c0 1 > prepared operation key=8FFV9G6EQR8F tag=B98EXWF7D17R type=del size=1315250 2024-09-14T11:15:19.091 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:19.092+0000 7f76c1e8a8c0 1 < canceled part key=_multipart_GAVZRU8ZLW7S.2~21GSWAADJYIP.0 size=1048576 2024-09-14T11:15:19.091 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:19.092+0000 7f76c1e8a8c0 1 < canceled part key=_multipart_GAVZRU8ZLW7S.2~21GSWAADJYIP.1 size=1048576 2024-09-14T11:15:19.094 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:19.096+0000 7f76c1e8a8c0 1 < completed part key=_multipart_GAVZRU8ZLW7S.2~21GSWAADJYIP.2 size=635965 2024-09-14T11:15:19.099 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:19.100+0000 7f76c1e8a8c0 1 < canceled multipart upload key=GAVZRU8ZLW7S upload=21GSWAADJYIP tag=V64XUI2UPEUO type=write size=3781693 2024-09-14T11:15:19.105 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:19.108+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_S43U13LYETS4.2~R59C0UU81QUF.0 size=1048576 2024-09-14T11:15:19.108 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:19.108+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_S43U13LYETS4.2~R59C0UU81QUF.1 size=1048576 2024-09-14T11:15:19.110 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:19.112+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_S43U13LYETS4.2~R59C0UU81QUF.2 size=680392 2024-09-14T11:15:19.110 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:19.112+0000 7f76c1e8a8c0 1 > prepared multipart upload key=S43U13LYETS4 upload=R59C0UU81QUF tag=1EG2EZGHSKXC type=write size=3826120 2024-09-14T11:15:19.113 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:19.116+0000 7f76c1e8a8c0 1 < completed part key=_multipart_F3KFS0P1WM7W.2~J23BM2ZD16CF.0 size=1048576 2024-09-14T11:15:19.116 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:19.120+0000 7f76c1e8a8c0 1 < completed part key=_multipart_F3KFS0P1WM7W.2~J23BM2ZD16CF.1 size=770131 2024-09-14T11:15:19.122 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:19.124+0000 7f76c1e8a8c0 1 < completed multipart upload key=F3KFS0P1WM7W upload=J23BM2ZD16CF tag=NVKCMJ02L57F type=write size=2867283 2024-09-14T11:15:19.125 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:19.128+0000 7f76c1e8a8c0 1 > prepared operation key=HJ701768A6I7 tag=8WXS0RDAOW33 type=del size=3896097 2024-09-14T11:15:19.127 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:19.128+0000 7f76c1e8a8c0 1 < completed part key=_multipart_W0MDRE9YO3UP.2~KG4ZWFS5RQL3.0 size=606010 2024-09-14T11:15:19.132 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:19.136+0000 7f76c1e8a8c0 1 < completed multipart upload key=W0MDRE9YO3UP upload=KG4ZWFS5RQL3 tag=0TU2E7QUAM2N type=write size=1654586 2024-09-14T11:15:19.135 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:19.136+0000 7f76c1e8a8c0 1 > prepared operation key=8FFV9G6EQR8F tag=I8GXEXD000GB type=del size=454180 2024-09-14T11:15:19.138 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:19.140+0000 7f76c1e8a8c0 1 < completed part key=_multipart_F3KFS0P1WM7W.2~GACNWF1UWHFI.0 size=1048576 2024-09-14T11:15:19.141 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:19.144+0000 7f76c1e8a8c0 1 < completed part key=_multipart_F3KFS0P1WM7W.2~GACNWF1UWHFI.1 size=802442 2024-09-14T11:15:19.146 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:19.148+0000 7f76c1e8a8c0 1 < completed multipart upload key=F3KFS0P1WM7W upload=GACNWF1UWHFI tag=MC3K06N1ZKHT type=write size=2899594 2024-09-14T11:15:19.151 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:19.152+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_BOCIF4TL7X7J.2~WGV3AJTGZVIB.0 size=1048576 2024-09-14T11:15:19.153 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:19.156+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_BOCIF4TL7X7J.2~WGV3AJTGZVIB.1 size=1048576 2024-09-14T11:15:19.155 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:19.156+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_BOCIF4TL7X7J.2~WGV3AJTGZVIB.2 size=903969 2024-09-14T11:15:19.155 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:19.156+0000 7f76c1e8a8c0 1 > prepared multipart upload key=BOCIF4TL7X7J upload=WGV3AJTGZVIB tag=4PSY4YOUD3OL type=write size=4049697 2024-09-14T11:15:19.159 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:19.160+0000 7f76c1e8a8c0 1 < completed delete operation key=KS37ZO6MKAH9 tag=M6D7MNERPJFS type=del 2024-09-14T11:15:19.161 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:19.164+0000 7f76c1e8a8c0 1 > prepared operation key=8PZOVFEYYSOG tag=V6XWYN6CV30T type=del size=3097200 2024-09-14T11:15:19.164 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:19.168+0000 7f76c1e8a8c0 1 < completed delete operation key=OOUEM16XL80W tag=UY7WGEONBEGC type=del 2024-09-14T11:15:19.167 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:19.168+0000 7f76c1e8a8c0 1 > prepared operation key=XC8VWSHZOPFP tag=1NLUC1O600IS type=del size=1963481 2024-09-14T11:15:19.170 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:19.172+0000 7f76c1e8a8c0 1 < completed delete operation key=1W5733SDHGDN tag=ONGRD5VRT910 type=del 2024-09-14T11:15:19.174 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:19.176+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_GZM0AQVHNCMM.2~8ZQKEYJPKEAX.0 size=741512 2024-09-14T11:15:19.174 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:19.176+0000 7f76c1e8a8c0 1 > prepared multipart upload key=GZM0AQVHNCMM upload=8ZQKEYJPKEAX tag=O6TDDPUKOX3I type=write size=1790088 2024-09-14T11:15:19.177 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:19.180+0000 7f76c1e8a8c0 1 < canceled operation key=HS7T50JORDQJ tag=6WVPL712WPXS type=del size=1768400 2024-09-14T11:15:19.180 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:19.180+0000 7f76c1e8a8c0 1 > prepared operation key=SHKU2PRNREKK tag=HRHRPB655T63 type=del size=2569144 2024-09-14T11:15:19.183 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:19.184+0000 7f76c1e8a8c0 1 < completed part key=_multipart_K2EEZLRK7MVO.2~JNMMAQSJMTD0.0 size=1048576 2024-09-14T11:15:19.184 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:19.188+0000 7f76c1e8a8c0 1 < completed part key=_multipart_K2EEZLRK7MVO.2~JNMMAQSJMTD0.1 size=1048576 2024-09-14T11:15:19.186 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:19.188+0000 7f76c1e8a8c0 1 < completed part key=_multipart_K2EEZLRK7MVO.2~JNMMAQSJMTD0.2 size=40287 2024-09-14T11:15:19.190 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:19.192+0000 7f76c1e8a8c0 1 < completed multipart upload key=K2EEZLRK7MVO upload=JNMMAQSJMTD0 tag=VLXPTA32E0F5 type=write size=3186015 2024-09-14T11:15:19.193 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:19.196+0000 7f76c1e8a8c0 1 > prepared operation key=F3KFS0P1WM7W tag=LL7HONYEPBHH type=del size=1979086 2024-09-14T11:15:19.195 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:19.196+0000 7f76c1e8a8c0 1 < completed part key=_multipart_K2EEZLRK7MVO.2~1U6IECOHFXNP.0 size=993593 2024-09-14T11:15:19.198 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:19.200+0000 7f76c1e8a8c0 1 < completed multipart upload key=K2EEZLRK7MVO upload=1U6IECOHFXNP tag=1FI916FSUH6F type=write size=2042169 2024-09-14T11:15:19.203 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:19.204+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_KS37ZO6MKAH9.2~QR6IV2S4UCRJ.0 size=976523 2024-09-14T11:15:19.203 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:19.204+0000 7f76c1e8a8c0 1 > prepared multipart upload key=KS37ZO6MKAH9 upload=QR6IV2S4UCRJ tag=EBD9B2WUV4RW type=write size=2025099 2024-09-14T11:15:19.206 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:19.208+0000 7f76c1e8a8c0 1 < completed write operation key=R5I9H7WAK7Z7 tag=5WONV3D2WX4C type=write size=103118 2024-09-14T11:15:19.211 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:19.212+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_MEVTZ7OAD4CA.2~4EZYX1TGOLML.0 size=1048576 2024-09-14T11:15:19.213 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:19.216+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_MEVTZ7OAD4CA.2~4EZYX1TGOLML.1 size=1048576 2024-09-14T11:15:19.214 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:19.216+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_MEVTZ7OAD4CA.2~4EZYX1TGOLML.2 size=182223 2024-09-14T11:15:19.215 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:19.216+0000 7f76c1e8a8c0 1 > prepared multipart upload key=MEVTZ7OAD4CA upload=4EZYX1TGOLML tag=24XCRH8J0SGO type=write size=3327951 2024-09-14T11:15:19.217 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:19.220+0000 7f76c1e8a8c0 1 < completed part key=_multipart_HJ701768A6I7.2~0OYFZ5182SCK.0 size=1048576 2024-09-14T11:15:19.220 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:19.220+0000 7f76c1e8a8c0 1 < completed part key=_multipart_HJ701768A6I7.2~0OYFZ5182SCK.1 size=698424 2024-09-14T11:15:19.224 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:19.228+0000 7f76c1e8a8c0 1 < completed multipart upload key=HJ701768A6I7 upload=0OYFZ5182SCK tag=VO4VDBT8LLS7 type=write size=2795576 2024-09-14T11:15:19.227 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:19.228+0000 7f76c1e8a8c0 1 > prepared operation key=GAVZRU8ZLW7S tag=63EE2WW5RJ8J type=write size=497911 2024-09-14T11:15:19.230 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:19.232+0000 7f76c1e8a8c0 1 < completed part key=_multipart_TUFOZKTV9XIH.2~HEPRXO46QWVD.0 size=367952 2024-09-14T11:15:19.234 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:19.236+0000 7f76c1e8a8c0 1 < completed multipart upload key=TUFOZKTV9XIH upload=HEPRXO46QWVD tag=31A2VEQI9A6M type=write size=1416528 2024-09-14T11:15:19.237 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:19.240+0000 7f76c1e8a8c0 1 > prepared operation key=K2EEZLRK7MVO tag=FEV45767UR33 type=del size=2838405 2024-09-14T11:15:19.240 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:19.240+0000 7f76c1e8a8c0 1 < completed part key=_multipart_F3KFS0P1WM7W.2~FVN683075DLS.0 size=86703 2024-09-14T11:15:19.245 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:19.248+0000 7f76c1e8a8c0 1 < completed multipart upload key=F3KFS0P1WM7W upload=FVN683075DLS tag=YRPQ5ZU6XFTR type=write size=1135279 2024-09-14T11:15:19.250 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:19.252+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_HS7T50JORDQJ.2~ZCHNSGNK10U1.0 size=1006840 2024-09-14T11:15:19.250 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:19.252+0000 7f76c1e8a8c0 1 > prepared multipart upload key=HS7T50JORDQJ upload=ZCHNSGNK10U1 tag=YEVV70XLBWRA type=write size=2055416 2024-09-14T11:15:19.256 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:19.260+0000 7f76c1e8a8c0 1 < suggested update operation key=K2EEZLRK7MVO tag=9O9K7Z2DQI8J type=del size=4130929 2024-09-14T11:15:19.260 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:19.264+0000 7f76c1e8a8c0 1 > prepared operation key=OUMUTEBQ1TD0 tag=3D8FBEG34WKY type=del size=648003 2024-09-14T11:15:19.263 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:19.264+0000 7f76c1e8a8c0 1 < completed delete operation key=8FFV9G6EQR8F tag=B98EXWF7D17R type=del 2024-09-14T11:15:19.266 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:19.268+0000 7f76c1e8a8c0 1 > prepared operation key=GZM0AQVHNCMM tag=VOL2W3NILF1R type=del size=63624 2024-09-14T11:15:19.272 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:19.276+0000 7f76c1e8a8c0 1 < completed part key=_multipart_S43U13LYETS4.2~R59C0UU81QUF.0 size=1048576 2024-09-14T11:15:19.275 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:19.276+0000 7f76c1e8a8c0 1 < completed part key=_multipart_S43U13LYETS4.2~R59C0UU81QUF.1 size=1048576 2024-09-14T11:15:19.277 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:19.280+0000 7f76c1e8a8c0 1 < completed part key=_multipart_S43U13LYETS4.2~R59C0UU81QUF.2 size=680392 2024-09-14T11:15:19.282 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:19.284+0000 7f76c1e8a8c0 1 < completed multipart upload key=S43U13LYETS4 upload=R59C0UU81QUF tag=1EG2EZGHSKXC type=write size=3826120 2024-09-14T11:15:19.285 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:19.288+0000 7f76c1e8a8c0 1 > prepared operation key=OUMUTEBQ1TD0 tag=OREE0HYO13BO type=write size=725235 2024-09-14T11:15:19.288 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:19.292+0000 7f76c1e8a8c0 1 < completed delete operation key=HJ701768A6I7 tag=8WXS0RDAOW33 type=del 2024-09-14T11:15:19.291 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:19.292+0000 7f76c1e8a8c0 1 > prepared operation key=F3KFS0P1WM7W tag=RBT6GW0U3Y66 type=del size=3826858 2024-09-14T11:15:19.294 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:19.296+0000 7f76c1e8a8c0 1 < completed delete operation key=8FFV9G6EQR8F tag=I8GXEXD000GB type=del 2024-09-14T11:15:19.299 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:19.300+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_SUNCRV0C1XYL.2~GFU0W8OJGLT6.0 size=60378 2024-09-14T11:15:19.299 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:19.300+0000 7f76c1e8a8c0 1 > prepared multipart upload key=SUNCRV0C1XYL upload=GFU0W8OJGLT6 tag=VHOXZWFIIE3Z type=write size=1108954 2024-09-14T11:15:19.300 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:19.300+0000 7f76c1e8a8c0 1 < canceled part key=_multipart_BOCIF4TL7X7J.2~WGV3AJTGZVIB.0 size=1048576 2024-09-14T11:15:19.302 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:19.304+0000 7f76c1e8a8c0 1 < completed part key=_multipart_BOCIF4TL7X7J.2~WGV3AJTGZVIB.1 size=1048576 2024-09-14T11:15:19.305 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:19.308+0000 7f76c1e8a8c0 1 < completed part key=_multipart_BOCIF4TL7X7J.2~WGV3AJTGZVIB.2 size=903969 2024-09-14T11:15:19.310 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:19.312+0000 7f76c1e8a8c0 1 < canceled multipart upload key=BOCIF4TL7X7J upload=WGV3AJTGZVIB tag=4PSY4YOUD3OL type=write size=4049697 2024-09-14T11:15:19.313 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:19.316+0000 7f76c1e8a8c0 1 > prepared operation key=SHKU2PRNREKK tag=155P73MJR8PH type=del size=4137765 2024-09-14T11:15:19.316 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:19.316+0000 7f76c1e8a8c0 1 < canceled operation key=8PZOVFEYYSOG tag=V6XWYN6CV30T type=del size=3097200 2024-09-14T11:15:19.322 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:19.324+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_HS7T50JORDQJ.2~4XA2VQDUNG84.0 size=1048576 2024-09-14T11:15:19.324 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:19.324+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_HS7T50JORDQJ.2~4XA2VQDUNG84.1 size=1048576 2024-09-14T11:15:19.327 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:19.328+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_HS7T50JORDQJ.2~4XA2VQDUNG84.2 size=229485 2024-09-14T11:15:19.327 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:19.328+0000 7f76c1e8a8c0 1 > prepared multipart upload key=HS7T50JORDQJ upload=4XA2VQDUNG84 tag=K2DCXM4JAH2N type=write size=3375213 2024-09-14T11:15:19.329 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:19.332+0000 7f76c1e8a8c0 1 < completed delete operation key=XC8VWSHZOPFP tag=1NLUC1O600IS type=del 2024-09-14T11:15:19.332 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:19.336+0000 7f76c1e8a8c0 1 > prepared operation key=85G6NT78HAWQ tag=31I1QFX5R85L type=del size=1359372 2024-09-14T11:15:19.336 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:19.336+0000 7f76c1e8a8c0 1 < completed part key=_multipart_GZM0AQVHNCMM.2~8ZQKEYJPKEAX.0 size=741512 2024-09-14T11:15:19.341 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:19.344+0000 7f76c1e8a8c0 1 < completed multipart upload key=GZM0AQVHNCMM upload=8ZQKEYJPKEAX tag=O6TDDPUKOX3I type=write size=1790088 2024-09-14T11:15:19.344 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:19.348+0000 7f76c1e8a8c0 1 > prepared operation key=R5I9H7WAK7Z7 tag=LZFZ1NGWUOGB type=write size=106402 2024-09-14T11:15:19.348 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:19.348+0000 7f76c1e8a8c0 1 < completed delete operation key=SHKU2PRNREKK tag=HRHRPB655T63 type=del 2024-09-14T11:15:19.351 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:19.352+0000 7f76c1e8a8c0 1 > prepared operation key=XC8VWSHZOPFP tag=4KZTJ30ABM6X type=del size=1548327 2024-09-14T11:15:19.356 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:19.360+0000 7f76c1e8a8c0 1 < suggested update operation key=F3KFS0P1WM7W tag=LL7HONYEPBHH type=del size=1979086 2024-09-14T11:15:19.359 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:19.360+0000 7f76c1e8a8c0 1 > prepared operation key=CIRQT9IDJ5OJ tag=Q0VU8CV0354K type=del size=1165637 2024-09-14T11:15:19.363 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:19.364+0000 7f76c1e8a8c0 1 < completed part key=_multipart_KS37ZO6MKAH9.2~QR6IV2S4UCRJ.0 size=976523 2024-09-14T11:15:19.368 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:19.372+0000 7f76c1e8a8c0 1 < completed multipart upload key=KS37ZO6MKAH9 upload=QR6IV2S4UCRJ tag=EBD9B2WUV4RW type=write size=2025099 2024-09-14T11:15:19.371 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:19.372+0000 7f76c1e8a8c0 1 > prepared operation key=LZ0YNFOVFYCL tag=EIE3GDJ8L6GS type=del size=1519899 2024-09-14T11:15:19.374 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:19.376+0000 7f76c1e8a8c0 1 < completed part key=_multipart_MEVTZ7OAD4CA.2~4EZYX1TGOLML.0 size=1048576 2024-09-14T11:15:19.376 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:19.380+0000 7f76c1e8a8c0 1 < completed part key=_multipart_MEVTZ7OAD4CA.2~4EZYX1TGOLML.1 size=1048576 2024-09-14T11:15:19.379 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:19.380+0000 7f76c1e8a8c0 1 < completed part key=_multipart_MEVTZ7OAD4CA.2~4EZYX1TGOLML.2 size=182223 2024-09-14T11:15:19.384 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:19.384+0000 7f76c1e8a8c0 1 < completed multipart upload key=MEVTZ7OAD4CA upload=4EZYX1TGOLML tag=24XCRH8J0SGO type=write size=3327951 2024-09-14T11:15:19.386 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:19.388+0000 7f76c1e8a8c0 1 > prepared operation key=Q5IY4J5FOD80 tag=DHI2CFKLEMYL type=del size=802786 2024-09-14T11:15:19.389 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:19.392+0000 7f76c1e8a8c0 1 < completed write operation key=GAVZRU8ZLW7S tag=63EE2WW5RJ8J type=write size=497911 2024-09-14T11:15:19.392 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:19.392+0000 7f76c1e8a8c0 1 > prepared operation key=W0MDRE9YO3UP tag=H6EDAL2RGVNF type=write size=163996 2024-09-14T11:15:19.395 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:19.396+0000 7f76c1e8a8c0 -1 < failed to complete operation key=K2EEZLRK7MVO tag=FEV45767UR33 type=del size=2838405: (22) Invalid argument 2024-09-14T11:15:19.398 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:19.400+0000 7f76c1e8a8c0 1 > prepared operation key=H9CQV6L29SL5 tag=13TATTK30RJ6 type=del size=1865418 2024-09-14T11:15:19.401 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:19.404+0000 7f76c1e8a8c0 1 < completed part key=_multipart_HS7T50JORDQJ.2~ZCHNSGNK10U1.0 size=1006840 2024-09-14T11:15:19.406 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:19.408+0000 7f76c1e8a8c0 1 < completed multipart upload key=HS7T50JORDQJ upload=ZCHNSGNK10U1 tag=YEVV70XLBWRA type=write size=2055416 2024-09-14T11:15:19.409 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:19.412+0000 7f76c1e8a8c0 1 > prepared operation key=S43U13LYETS4 tag=H2HD3BI6GO1E type=del size=3286337 2024-09-14T11:15:19.412 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:19.416+0000 7f76c1e8a8c0 1 < completed delete operation key=OUMUTEBQ1TD0 tag=3D8FBEG34WKY type=del 2024-09-14T11:15:19.415 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:19.416+0000 7f76c1e8a8c0 1 > prepared operation key=VI61O3K069BP tag=77LDQW7P2T4U type=del size=3822979 2024-09-14T11:15:19.421 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:19.424+0000 7f76c1e8a8c0 1 < suggested update operation key=GZM0AQVHNCMM tag=VOL2W3NILF1R type=del size=63624 2024-09-14T11:15:19.425 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:19.428+0000 7f76c1e8a8c0 1 > prepared operation key=VI61O3K069BP tag=CIGYHUSS7PFS type=del size=1911197 2024-09-14T11:15:19.428 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:19.428+0000 7f76c1e8a8c0 1 < completed write operation key=OUMUTEBQ1TD0 tag=OREE0HYO13BO type=write size=725235 2024-09-14T11:15:19.431 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:19.432+0000 7f76c1e8a8c0 1 > prepared operation key=Q5IY4J5FOD80 tag=T8IBWXCHPDSB type=del size=416004 2024-09-14T11:15:19.434 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:19.436+0000 7f76c1e8a8c0 -1 < failed to complete operation key=F3KFS0P1WM7W tag=RBT6GW0U3Y66 type=del size=3826858: (22) Invalid argument 2024-09-14T11:15:19.440 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:19.440+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_MEVTZ7OAD4CA.2~ZV31MKBKHITX.0 size=1048576 2024-09-14T11:15:19.442 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:19.444+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_MEVTZ7OAD4CA.2~ZV31MKBKHITX.1 size=460366 2024-09-14T11:15:19.443 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:19.444+0000 7f76c1e8a8c0 1 > prepared multipart upload key=MEVTZ7OAD4CA upload=ZV31MKBKHITX tag=J1EB2E49H2KR type=write size=2557518 2024-09-14T11:15:19.446 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:19.448+0000 7f76c1e8a8c0 1 < completed part key=_multipart_SUNCRV0C1XYL.2~GFU0W8OJGLT6.0 size=60378 2024-09-14T11:15:19.451 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:19.452+0000 7f76c1e8a8c0 1 < completed multipart upload key=SUNCRV0C1XYL upload=GFU0W8OJGLT6 tag=VHOXZWFIIE3Z type=write size=1108954 2024-09-14T11:15:19.454 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:19.456+0000 7f76c1e8a8c0 1 > prepared operation key=HS7T50JORDQJ tag=XO2J8B64ERED type=del size=1596526 2024-09-14T11:15:19.457 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:19.460+0000 7f76c1e8a8c0 1 < completed delete operation key=SHKU2PRNREKK tag=155P73MJR8PH type=del 2024-09-14T11:15:19.461 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:19.464+0000 7f76c1e8a8c0 1 > prepared operation key=MEVTZ7OAD4CA tag=ABDFP02UCMZ8 type=del size=1684037 2024-09-14T11:15:19.464 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:19.468+0000 7f76c1e8a8c0 1 < completed part key=_multipart_HS7T50JORDQJ.2~4XA2VQDUNG84.0 size=1048576 2024-09-14T11:15:19.467 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:19.468+0000 7f76c1e8a8c0 1 < completed part key=_multipart_HS7T50JORDQJ.2~4XA2VQDUNG84.1 size=1048576 2024-09-14T11:15:19.469 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:19.472+0000 7f76c1e8a8c0 1 < completed part key=_multipart_HS7T50JORDQJ.2~4XA2VQDUNG84.2 size=229485 2024-09-14T11:15:19.475 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:19.476+0000 7f76c1e8a8c0 1 < completed multipart upload key=HS7T50JORDQJ upload=4XA2VQDUNG84 tag=K2DCXM4JAH2N type=write size=3375213 2024-09-14T11:15:19.478 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:19.480+0000 7f76c1e8a8c0 1 > prepared operation key=15FU4CEGC22Q tag=2YL041YYE7LR type=del size=3254229 2024-09-14T11:15:19.482 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:19.484+0000 7f76c1e8a8c0 1 < completed delete operation key=85G6NT78HAWQ tag=31I1QFX5R85L type=del 2024-09-14T11:15:19.485 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:19.488+0000 7f76c1e8a8c0 1 > prepared operation key=K2EEZLRK7MVO tag=8M11K74FANV3 type=del size=4138088 2024-09-14T11:15:19.488 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:19.492+0000 7f76c1e8a8c0 1 < completed write operation key=R5I9H7WAK7Z7 tag=LZFZ1NGWUOGB type=write size=106402 2024-09-14T11:15:19.495 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:19.496+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_Q5IY4J5FOD80.2~9WBMARVLL1FR.0 size=183026 2024-09-14T11:15:19.495 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:19.496+0000 7f76c1e8a8c0 1 > prepared multipart upload key=Q5IY4J5FOD80 upload=9WBMARVLL1FR tag=P0LBT76ZP9U3 type=write size=1231602 2024-09-14T11:15:19.498 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:19.500+0000 7f76c1e8a8c0 1 < completed delete operation key=XC8VWSHZOPFP tag=4KZTJ30ABM6X type=del 2024-09-14T11:15:19.501 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:19.504+0000 7f76c1e8a8c0 1 > prepared operation key=MEVTZ7OAD4CA tag=A25M9XSKEW6Y type=del size=195652 2024-09-14T11:15:19.504 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:19.508+0000 7f76c1e8a8c0 1 < completed delete operation key=CIRQT9IDJ5OJ tag=Q0VU8CV0354K type=del 2024-09-14T11:15:19.508 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:19.508+0000 7f76c1e8a8c0 1 > prepared operation key=TZO40K6J9877 tag=KAGXXBA7HG8E type=del size=3482275 2024-09-14T11:15:19.511 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:19.512+0000 7f76c1e8a8c0 1 < completed delete operation key=LZ0YNFOVFYCL tag=EIE3GDJ8L6GS type=del 2024-09-14T11:15:19.514 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:19.516+0000 7f76c1e8a8c0 1 > prepared operation key=Q5IY4J5FOD80 tag=XZYJQ6YOCC8T type=del size=1349155 2024-09-14T11:15:19.518 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:19.520+0000 7f76c1e8a8c0 1 < completed delete operation key=Q5IY4J5FOD80 tag=DHI2CFKLEMYL type=del 2024-09-14T11:15:19.524 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:19.524+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_OOUEM16XL80W.2~VMI1PBN9UKNP.0 size=290624 2024-09-14T11:15:19.524 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:19.524+0000 7f76c1e8a8c0 1 > prepared multipart upload key=OOUEM16XL80W upload=VMI1PBN9UKNP tag=M4CXSIWY0YBO type=write size=1339200 2024-09-14T11:15:19.527 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:19.528+0000 7f76c1e8a8c0 1 < completed write operation key=W0MDRE9YO3UP tag=H6EDAL2RGVNF type=write size=163996 2024-09-14T11:15:19.530 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:19.532+0000 7f76c1e8a8c0 1 > prepared operation key=1K8ESNXU6WDF tag=65PK2AL2P92W type=write size=953238 2024-09-14T11:15:19.536 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:19.540+0000 7f76c1e8a8c0 1 < suggested remove operation key=H9CQV6L29SL5 tag=13TATTK30RJ6 type=del 2024-09-14T11:15:19.543 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:19.544+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_F3KFS0P1WM7W.2~P75SYEVCBJBZ.0 size=585870 2024-09-14T11:15:19.543 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:19.544+0000 7f76c1e8a8c0 1 > prepared multipart upload key=F3KFS0P1WM7W upload=P75SYEVCBJBZ tag=MVGTDBCXC5TE type=write size=1634446 2024-09-14T11:15:19.546 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:19.548+0000 7f76c1e8a8c0 1 < completed delete operation key=S43U13LYETS4 tag=H2HD3BI6GO1E type=del 2024-09-14T11:15:19.549 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:19.552+0000 7f76c1e8a8c0 1 > prepared operation key=OUMUTEBQ1TD0 tag=Z2N29OPQLU3Y type=del size=950152 2024-09-14T11:15:19.552 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:19.556+0000 7f76c1e8a8c0 1 < completed delete operation key=VI61O3K069BP tag=77LDQW7P2T4U type=del 2024-09-14T11:15:19.558 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:19.560+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_GAVZRU8ZLW7S.2~YU2SHDFOPOBA.0 size=885732 2024-09-14T11:15:19.559 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:19.560+0000 7f76c1e8a8c0 1 > prepared multipart upload key=GAVZRU8ZLW7S upload=YU2SHDFOPOBA tag=9WU8TULUZ0GI type=write size=1934308 2024-09-14T11:15:19.562 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:19.564+0000 7f76c1e8a8c0 1 < completed delete operation key=VI61O3K069BP tag=CIGYHUSS7PFS type=del 2024-09-14T11:15:19.573 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:19.576+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_SHKU2PRNREKK.2~HGQQW649X69G.0 size=84632 2024-09-14T11:15:19.573 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:19.576+0000 7f76c1e8a8c0 1 > prepared multipart upload key=SHKU2PRNREKK upload=HGQQW649X69G tag=C448JG4CXR2U type=write size=1133208 2024-09-14T11:15:19.576 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:19.580+0000 7f76c1e8a8c0 1 < canceled operation key=Q5IY4J5FOD80 tag=T8IBWXCHPDSB type=del size=416004 2024-09-14T11:15:19.582 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:19.584+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_LZ0YNFOVFYCL.2~LG8GBVAJ5YIN.0 size=796577 2024-09-14T11:15:19.582 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:19.584+0000 7f76c1e8a8c0 1 > prepared multipart upload key=LZ0YNFOVFYCL upload=LG8GBVAJ5YIN tag=OF2KVESR5HP1 type=write size=1845153 2024-09-14T11:15:19.586 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:19.588+0000 7f76c1e8a8c0 1 < completed part key=_multipart_MEVTZ7OAD4CA.2~ZV31MKBKHITX.0 size=1048576 2024-09-14T11:15:19.589 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:19.592+0000 7f76c1e8a8c0 1 < completed part key=_multipart_MEVTZ7OAD4CA.2~ZV31MKBKHITX.1 size=460366 2024-09-14T11:15:19.594 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:19.596+0000 7f76c1e8a8c0 1 < completed multipart upload key=MEVTZ7OAD4CA upload=ZV31MKBKHITX tag=J1EB2E49H2KR type=write size=2557518 2024-09-14T11:15:19.599 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:19.600+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_CIRQT9IDJ5OJ.2~V1BMNFI3TUGJ.0 size=99099 2024-09-14T11:15:19.599 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:19.600+0000 7f76c1e8a8c0 1 > prepared multipart upload key=CIRQT9IDJ5OJ upload=V1BMNFI3TUGJ tag=KRASS79L1IYE type=write size=1147675 2024-09-14T11:15:19.602 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:19.604+0000 7f76c1e8a8c0 1 < completed delete operation key=HS7T50JORDQJ tag=XO2J8B64ERED type=del 2024-09-14T11:15:19.609 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:19.612+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_F3KFS0P1WM7W.2~NOEST9LMMITF.0 size=1048576 2024-09-14T11:15:19.612 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:19.616+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_F3KFS0P1WM7W.2~NOEST9LMMITF.1 size=1048576 2024-09-14T11:15:19.615 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:19.616+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_F3KFS0P1WM7W.2~NOEST9LMMITF.2 size=952328 2024-09-14T11:15:19.615 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:19.616+0000 7f76c1e8a8c0 1 > prepared multipart upload key=F3KFS0P1WM7W upload=NOEST9LMMITF tag=U505UQ493TW8 type=write size=4098056 2024-09-14T11:15:19.622 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:19.624+0000 7f76c1e8a8c0 1 < suggested remove operation key=MEVTZ7OAD4CA tag=ABDFP02UCMZ8 type=del 2024-09-14T11:15:19.627 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:19.628+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_MEVTZ7OAD4CA.2~C3H4R91RPD5U.0 size=1048576 2024-09-14T11:15:19.630 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:19.632+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_MEVTZ7OAD4CA.2~C3H4R91RPD5U.1 size=831310 2024-09-14T11:15:19.630 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:19.632+0000 7f76c1e8a8c0 1 > prepared multipart upload key=MEVTZ7OAD4CA upload=C3H4R91RPD5U tag=JRSDJCQ88UY7 type=write size=2928462 2024-09-14T11:15:19.633 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:19.636+0000 7f76c1e8a8c0 1 < completed delete operation key=15FU4CEGC22Q tag=2YL041YYE7LR type=del 2024-09-14T11:15:19.636 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:19.640+0000 7f76c1e8a8c0 1 > prepared operation key=TZO40K6J9877 tag=WN2IROHN5OVY type=del size=2847841 2024-09-14T11:15:19.643 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:19.644+0000 7f76c1e8a8c0 1 < suggested remove operation key=K2EEZLRK7MVO tag=8M11K74FANV3 type=del 2024-09-14T11:15:19.647 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:19.648+0000 7f76c1e8a8c0 1 > prepared operation key=KS37ZO6MKAH9 tag=WBLKNO4TUOLG type=del size=2132604 2024-09-14T11:15:19.650 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:19.652+0000 7f76c1e8a8c0 1 < completed part key=_multipart_Q5IY4J5FOD80.2~9WBMARVLL1FR.0 size=183026 2024-09-14T11:15:19.655 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:19.656+0000 7f76c1e8a8c0 1 < completed multipart upload key=Q5IY4J5FOD80 upload=9WBMARVLL1FR tag=P0LBT76ZP9U3 type=write size=1231602 2024-09-14T11:15:19.658 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:19.660+0000 7f76c1e8a8c0 1 > prepared operation key=XC8VWSHZOPFP tag=F6WEX7YHISZ4 type=del size=723657 2024-09-14T11:15:19.660 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:19.660+0000 7f76c1e8a8c0 -1 < no bi entry to suggest for operation key=MEVTZ7OAD4CA tag=A25M9XSKEW6Y type=del size=195652: (2) No such file or directory 2024-09-14T11:15:19.665 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:19.668+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_1K8ESNXU6WDF.2~J6ON376UD1V4.0 size=1048576 2024-09-14T11:15:19.668 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:19.668+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_1K8ESNXU6WDF.2~J6ON376UD1V4.1 size=592628 2024-09-14T11:15:19.668 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:19.668+0000 7f76c1e8a8c0 1 > prepared multipart upload key=1K8ESNXU6WDF upload=J6ON376UD1V4 tag=0G5CC9S0WSOT type=write size=2689780 2024-09-14T11:15:19.674 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:19.676+0000 7f76c1e8a8c0 1 < suggested update operation key=TZO40K6J9877 tag=KAGXXBA7HG8E type=del size=3482275 2024-09-14T11:15:19.677 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:19.680+0000 7f76c1e8a8c0 1 > prepared operation key=CIRQT9IDJ5OJ tag=NZMDH1M35D5M type=del size=889882 2024-09-14T11:15:19.680 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:19.680+0000 7f76c1e8a8c0 1 < completed delete operation key=Q5IY4J5FOD80 tag=XZYJQ6YOCC8T type=del 2024-09-14T11:15:19.683 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:19.684+0000 7f76c1e8a8c0 1 > prepared operation key=F3KFS0P1WM7W tag=GJS2GMULO6CC type=del size=123963 2024-09-14T11:15:19.687 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:19.688+0000 7f76c1e8a8c0 1 < completed part key=_multipart_OOUEM16XL80W.2~VMI1PBN9UKNP.0 size=290624 2024-09-14T11:15:19.692 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:19.692+0000 7f76c1e8a8c0 1 < completed multipart upload key=OOUEM16XL80W upload=VMI1PBN9UKNP tag=M4CXSIWY0YBO type=write size=1339200 2024-09-14T11:15:19.695 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:19.696+0000 7f76c1e8a8c0 1 > prepared operation key=15FU4CEGC22Q tag=03ONG394WJPV type=del size=654096 2024-09-14T11:15:19.698 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:19.700+0000 7f76c1e8a8c0 1 < completed write operation key=1K8ESNXU6WDF tag=65PK2AL2P92W type=write size=953238 2024-09-14T11:15:19.702 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:19.704+0000 7f76c1e8a8c0 1 > prepared operation key=HJ701768A6I7 tag=BCMT8XYJ6M07 type=write size=436693 2024-09-14T11:15:19.705 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:19.708+0000 7f76c1e8a8c0 1 < completed part key=_multipart_F3KFS0P1WM7W.2~P75SYEVCBJBZ.0 size=585870 2024-09-14T11:15:19.711 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:19.712+0000 7f76c1e8a8c0 1 < completed multipart upload key=F3KFS0P1WM7W upload=P75SYEVCBJBZ tag=MVGTDBCXC5TE type=write size=1634446 2024-09-14T11:15:19.714 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:19.716+0000 7f76c1e8a8c0 1 > prepared operation key=SUNCRV0C1XYL tag=8RNZ6L2UH22Z type=del size=148018 2024-09-14T11:15:19.718 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:19.720+0000 7f76c1e8a8c0 1 < completed delete operation key=OUMUTEBQ1TD0 tag=Z2N29OPQLU3Y type=del 2024-09-14T11:15:19.721 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:19.724+0000 7f76c1e8a8c0 1 > prepared operation key=GAVZRU8ZLW7S tag=7H16VMPNRRG8 type=del size=3908002 2024-09-14T11:15:19.724 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:19.728+0000 7f76c1e8a8c0 1 < completed part key=_multipart_GAVZRU8ZLW7S.2~YU2SHDFOPOBA.0 size=885732 2024-09-14T11:15:19.730 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:19.732+0000 7f76c1e8a8c0 1 < completed multipart upload key=GAVZRU8ZLW7S upload=YU2SHDFOPOBA tag=9WU8TULUZ0GI type=write size=1934308 2024-09-14T11:15:19.734 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:19.736+0000 7f76c1e8a8c0 1 > prepared operation key=F3KFS0P1WM7W tag=MQV1W4YGXL84 type=write size=306720 2024-09-14T11:15:19.737 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:19.740+0000 7f76c1e8a8c0 1 < completed part key=_multipart_SHKU2PRNREKK.2~HGQQW649X69G.0 size=84632 2024-09-14T11:15:19.743 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:19.744+0000 7f76c1e8a8c0 1 < completed multipart upload key=SHKU2PRNREKK upload=HGQQW649X69G tag=C448JG4CXR2U type=write size=1133208 2024-09-14T11:15:19.747 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:19.748+0000 7f76c1e8a8c0 1 > prepared operation key=8PZOVFEYYSOG tag=6FT9QT9JN7F0 type=del size=666407 2024-09-14T11:15:19.750 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:19.752+0000 7f76c1e8a8c0 1 < completed part key=_multipart_LZ0YNFOVFYCL.2~LG8GBVAJ5YIN.0 size=796577 2024-09-14T11:15:19.755 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:19.756+0000 7f76c1e8a8c0 1 < completed multipart upload key=LZ0YNFOVFYCL upload=LG8GBVAJ5YIN tag=OF2KVESR5HP1 type=write size=1845153 2024-09-14T11:15:19.761 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:19.764+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_85G6NT78HAWQ.2~DUJH7LCAOMD7.0 size=1048576 2024-09-14T11:15:19.763 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:19.764+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_85G6NT78HAWQ.2~DUJH7LCAOMD7.1 size=873844 2024-09-14T11:15:19.764 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:19.764+0000 7f76c1e8a8c0 1 > prepared multipart upload key=85G6NT78HAWQ upload=DUJH7LCAOMD7 tag=AJY0UJKUK2M2 type=write size=2970996 2024-09-14T11:15:19.767 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:19.768+0000 7f76c1e8a8c0 1 < completed part key=_multipart_CIRQT9IDJ5OJ.2~V1BMNFI3TUGJ.0 size=99099 2024-09-14T11:15:19.772 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:19.776+0000 7f76c1e8a8c0 1 < completed multipart upload key=CIRQT9IDJ5OJ upload=V1BMNFI3TUGJ tag=KRASS79L1IYE type=write size=1147675 2024-09-14T11:15:19.775 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:19.776+0000 7f76c1e8a8c0 1 > prepared operation key=TUFOZKTV9XIH tag=8UE1B0GF7Q03 type=del size=1489501 2024-09-14T11:15:19.779 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:19.780+0000 7f76c1e8a8c0 1 < completed part key=_multipart_F3KFS0P1WM7W.2~NOEST9LMMITF.0 size=1048576 2024-09-14T11:15:19.782 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:19.784+0000 7f76c1e8a8c0 1 < completed part key=_multipart_F3KFS0P1WM7W.2~NOEST9LMMITF.1 size=1048576 2024-09-14T11:15:19.785 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:19.788+0000 7f76c1e8a8c0 1 < completed part key=_multipart_F3KFS0P1WM7W.2~NOEST9LMMITF.2 size=952328 2024-09-14T11:15:19.791 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:19.792+0000 7f76c1e8a8c0 1 < completed multipart upload key=F3KFS0P1WM7W upload=NOEST9LMMITF tag=U505UQ493TW8 type=write size=4098056 2024-09-14T11:15:19.794 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:19.796+0000 7f76c1e8a8c0 1 > prepared operation key=SHKU2PRNREKK tag=B98P0J8VVG3L type=del size=2647726 2024-09-14T11:15:19.797 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:19.800+0000 7f76c1e8a8c0 1 < completed part key=_multipart_MEVTZ7OAD4CA.2~C3H4R91RPD5U.0 size=1048576 2024-09-14T11:15:19.800 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:19.800+0000 7f76c1e8a8c0 1 < completed part key=_multipart_MEVTZ7OAD4CA.2~C3H4R91RPD5U.1 size=831310 2024-09-14T11:15:19.805 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:19.808+0000 7f76c1e8a8c0 1 < completed multipart upload key=MEVTZ7OAD4CA upload=C3H4R91RPD5U tag=JRSDJCQ88UY7 type=write size=2928462 2024-09-14T11:15:19.811 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:19.812+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_OOUEM16XL80W.2~9SUCYINEARP6.0 size=1048576 2024-09-14T11:15:19.813 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:19.816+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_OOUEM16XL80W.2~9SUCYINEARP6.1 size=879562 2024-09-14T11:15:19.813 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:19.816+0000 7f76c1e8a8c0 1 > prepared multipart upload key=OOUEM16XL80W upload=9SUCYINEARP6 tag=ZV8INPXC9FNI type=write size=2976714 2024-09-14T11:15:19.816 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:19.816+0000 7f76c1e8a8c0 -1 < failed to complete operation key=TZO40K6J9877 tag=WN2IROHN5OVY type=del size=2847841: (22) Invalid argument 2024-09-14T11:15:19.818 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:19.820+0000 7f76c1e8a8c0 1 > prepared operation key=KS37ZO6MKAH9 tag=21X7NNKNBVSA type=del size=3133921 2024-09-14T11:15:19.821 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:19.824+0000 7f76c1e8a8c0 1 < completed delete operation key=KS37ZO6MKAH9 tag=WBLKNO4TUOLG type=del 2024-09-14T11:15:19.823 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:19.824+0000 7f76c1e8a8c0 1 > prepared operation key=KS37ZO6MKAH9 tag=TX8XAQZUAMJT type=del size=1403415 2024-09-14T11:15:19.826 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:19.828+0000 7f76c1e8a8c0 1 < completed delete operation key=XC8VWSHZOPFP tag=F6WEX7YHISZ4 type=del 2024-09-14T11:15:19.831 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:19.832+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_SUNCRV0C1XYL.2~TGZR3B89PUWV.0 size=536822 2024-09-14T11:15:19.831 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:19.832+0000 7f76c1e8a8c0 1 > prepared multipart upload key=SUNCRV0C1XYL upload=TGZR3B89PUWV tag=LXH3BDX865M5 type=write size=1585398 2024-09-14T11:15:19.834 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:19.836+0000 7f76c1e8a8c0 1 < completed part key=_multipart_1K8ESNXU6WDF.2~J6ON376UD1V4.0 size=1048576 2024-09-14T11:15:19.836 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:19.840+0000 7f76c1e8a8c0 1 < completed part key=_multipart_1K8ESNXU6WDF.2~J6ON376UD1V4.1 size=592628 2024-09-14T11:15:19.841 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:19.844+0000 7f76c1e8a8c0 1 < completed multipart upload key=1K8ESNXU6WDF upload=J6ON376UD1V4 tag=0G5CC9S0WSOT type=write size=2689780 2024-09-14T11:15:19.846 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:19.848+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_KS37ZO6MKAH9.2~BAPF6S8ENVA3.0 size=1048576 2024-09-14T11:15:19.848 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:19.848+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_KS37ZO6MKAH9.2~BAPF6S8ENVA3.1 size=934884 2024-09-14T11:15:19.848 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:19.848+0000 7f76c1e8a8c0 1 > prepared multipart upload key=KS37ZO6MKAH9 upload=BAPF6S8ENVA3 tag=5K12W9150LIW type=write size=3032036 2024-09-14T11:15:19.850 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:19.852+0000 7f76c1e8a8c0 1 < completed delete operation key=CIRQT9IDJ5OJ tag=NZMDH1M35D5M type=del 2024-09-14T11:15:19.856 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:19.856+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_VI61O3K069BP.2~14ESTVB1KZ8X.0 size=1048576 2024-09-14T11:15:19.858 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:19.860+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_VI61O3K069BP.2~14ESTVB1KZ8X.1 size=1048576 2024-09-14T11:15:19.860 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:19.864+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_VI61O3K069BP.2~14ESTVB1KZ8X.2 size=1038601 2024-09-14T11:15:19.860 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:19.864+0000 7f76c1e8a8c0 1 > prepared multipart upload key=VI61O3K069BP upload=14ESTVB1KZ8X tag=UITUR3BK8AYO type=write size=4184329 2024-09-14T11:15:19.870 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:19.872+0000 7f76c1e8a8c0 1 < suggested remove operation key=F3KFS0P1WM7W tag=GJS2GMULO6CC type=del 2024-09-14T11:15:19.873 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:19.876+0000 7f76c1e8a8c0 1 > prepared operation key=Q5IY4J5FOD80 tag=7AL3W5N5K59U type=del size=1315542 2024-09-14T11:15:19.879 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:19.880+0000 7f76c1e8a8c0 1 < suggested remove operation key=15FU4CEGC22Q tag=03ONG394WJPV type=del 2024-09-14T11:15:19.882 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:19.884+0000 7f76c1e8a8c0 1 > prepared operation key=GZM0AQVHNCMM tag=P13360BMMAV9 type=write size=847657 2024-09-14T11:15:19.885 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:19.888+0000 7f76c1e8a8c0 1 < canceled operation key=HJ701768A6I7 tag=BCMT8XYJ6M07 type=write size=436693 2024-09-14T11:15:19.889 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:19.892+0000 7f76c1e8a8c0 1 > prepared operation key=OOUEM16XL80W tag=0CQUWVFN9QE6 type=del size=1949058 2024-09-14T11:15:19.892 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:19.892+0000 7f76c1e8a8c0 1 < completed delete operation key=SUNCRV0C1XYL tag=8RNZ6L2UH22Z type=del 2024-09-14T11:15:19.897 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:19.900+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_KS37ZO6MKAH9.2~69J7D0U43MNQ.0 size=1048576 2024-09-14T11:15:19.900 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:19.900+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_KS37ZO6MKAH9.2~69J7D0U43MNQ.1 size=965885 2024-09-14T11:15:19.900 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:19.900+0000 7f76c1e8a8c0 1 > prepared multipart upload key=KS37ZO6MKAH9 upload=69J7D0U43MNQ tag=2265EQCCQVYX type=write size=3063037 2024-09-14T11:15:19.903 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:19.904+0000 7f76c1e8a8c0 1 < completed delete operation key=GAVZRU8ZLW7S tag=7H16VMPNRRG8 type=del 2024-09-14T11:15:19.906 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:19.908+0000 7f76c1e8a8c0 1 > prepared operation key=SHKU2PRNREKK tag=GQBN7KVYTGSA type=del size=3733810 2024-09-14T11:15:19.909 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:19.912+0000 7f76c1e8a8c0 -1 < failed to complete operation key=F3KFS0P1WM7W tag=MQV1W4YGXL84 type=write size=306720: (22) Invalid argument 2024-09-14T11:15:19.913 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:19.916+0000 7f76c1e8a8c0 1 > prepared operation key=K9W031V6BFJP tag=OR7AT1JJHFHT type=del size=3051137 2024-09-14T11:15:19.916 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:19.920+0000 7f76c1e8a8c0 1 < completed delete operation key=8PZOVFEYYSOG tag=6FT9QT9JN7F0 type=del 2024-09-14T11:15:19.919 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:19.920+0000 7f76c1e8a8c0 1 > prepared operation key=K9W031V6BFJP tag=KICZE4RUK4PT type=del size=1833323 2024-09-14T11:15:19.921 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:19.924+0000 7f76c1e8a8c0 1 < completed part key=_multipart_85G6NT78HAWQ.2~DUJH7LCAOMD7.0 size=1048576 2024-09-14T11:15:19.924 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:19.924+0000 7f76c1e8a8c0 1 < completed part key=_multipart_85G6NT78HAWQ.2~DUJH7LCAOMD7.1 size=873844 2024-09-14T11:15:19.928 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:19.932+0000 7f76c1e8a8c0 1 < completed multipart upload key=85G6NT78HAWQ upload=DUJH7LCAOMD7 tag=AJY0UJKUK2M2 type=write size=2970996 2024-09-14T11:15:19.933 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:19.936+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_Q5IY4J5FOD80.2~ZD7W91MXJISB.0 size=1048576 2024-09-14T11:15:19.935 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:19.936+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_Q5IY4J5FOD80.2~ZD7W91MXJISB.1 size=1048576 2024-09-14T11:15:19.937 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:19.940+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_Q5IY4J5FOD80.2~ZD7W91MXJISB.2 size=587652 2024-09-14T11:15:19.937 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:19.940+0000 7f76c1e8a8c0 1 > prepared multipart upload key=Q5IY4J5FOD80 upload=ZD7W91MXJISB tag=DG2YIVBG0U0V type=write size=3733380 2024-09-14T11:15:19.939 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:19.940+0000 7f76c1e8a8c0 1 < completed delete operation key=TUFOZKTV9XIH tag=8UE1B0GF7Q03 type=del 2024-09-14T11:15:19.944 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:19.944+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_F3KFS0P1WM7W.2~TEKUFDUN51RI.0 size=1048576 2024-09-14T11:15:19.946 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:19.948+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_F3KFS0P1WM7W.2~TEKUFDUN51RI.1 size=803992 2024-09-14T11:15:19.946 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:19.948+0000 7f76c1e8a8c0 1 > prepared multipart upload key=F3KFS0P1WM7W upload=TEKUFDUN51RI tag=D22ECY3LU5FM type=write size=2901144 2024-09-14T11:15:19.949 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:19.952+0000 7f76c1e8a8c0 1 < completed delete operation key=SHKU2PRNREKK tag=B98P0J8VVG3L type=del 2024-09-14T11:15:19.952 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:19.952+0000 7f76c1e8a8c0 1 > prepared operation key=8PZOVFEYYSOG tag=9MUFR3NJHBA3 type=del size=2033154 2024-09-14T11:15:19.954 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:19.956+0000 7f76c1e8a8c0 1 < completed part key=_multipart_OOUEM16XL80W.2~9SUCYINEARP6.0 size=1048576 2024-09-14T11:15:19.957 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:19.960+0000 7f76c1e8a8c0 1 < completed part key=_multipart_OOUEM16XL80W.2~9SUCYINEARP6.1 size=879562 2024-09-14T11:15:19.961 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:19.964+0000 7f76c1e8a8c0 1 < completed multipart upload key=OOUEM16XL80W upload=9SUCYINEARP6 tag=ZV8INPXC9FNI type=write size=2976714 2024-09-14T11:15:19.966 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:19.968+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_1K8ESNXU6WDF.2~O50205ZP1IDU.0 size=1048576 2024-09-14T11:15:19.968 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:19.968+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_1K8ESNXU6WDF.2~O50205ZP1IDU.1 size=448888 2024-09-14T11:15:19.968 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:19.968+0000 7f76c1e8a8c0 1 > prepared multipart upload key=1K8ESNXU6WDF upload=O50205ZP1IDU tag=EL2P9ULLB7XH type=write size=2546040 2024-09-14T11:15:19.970 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:19.972+0000 7f76c1e8a8c0 1 < completed delete operation key=KS37ZO6MKAH9 tag=21X7NNKNBVSA type=del 2024-09-14T11:15:19.973 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:19.976+0000 7f76c1e8a8c0 1 > prepared operation key=6TIJR323NMOH tag=O83AMHQF2JN3 type=del size=1025369 2024-09-14T11:15:19.975 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:19.976+0000 7f76c1e8a8c0 1 < completed delete operation key=KS37ZO6MKAH9 tag=TX8XAQZUAMJT type=del 2024-09-14T11:15:19.981 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:19.984+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_SHKU2PRNREKK.2~TWNBSET55Y4X.0 size=1048576 2024-09-14T11:15:19.982 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:19.984+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_SHKU2PRNREKK.2~TWNBSET55Y4X.1 size=428642 2024-09-14T11:15:19.983 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:19.984+0000 7f76c1e8a8c0 1 > prepared multipart upload key=SHKU2PRNREKK upload=TWNBSET55Y4X tag=FVH8I4RGOFGQ type=write size=2525794 2024-09-14T11:15:19.985 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:19.988+0000 7f76c1e8a8c0 1 < completed part key=_multipart_SUNCRV0C1XYL.2~TGZR3B89PUWV.0 size=536822 2024-09-14T11:15:19.990 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:19.992+0000 7f76c1e8a8c0 1 < completed multipart upload key=SUNCRV0C1XYL upload=TGZR3B89PUWV tag=LXH3BDX865M5 type=write size=1585398 2024-09-14T11:15:19.992 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:19.996+0000 7f76c1e8a8c0 1 > prepared operation key=OOUEM16XL80W tag=LHER62BTSTPO type=del size=2253107 2024-09-14T11:15:19.994 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:19.996+0000 7f76c1e8a8c0 1 < completed part key=_multipart_KS37ZO6MKAH9.2~BAPF6S8ENVA3.0 size=1048576 2024-09-14T11:15:19.996 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:20.000+0000 7f76c1e8a8c0 1 < completed part key=_multipart_KS37ZO6MKAH9.2~BAPF6S8ENVA3.1 size=934884 2024-09-14T11:15:20.000 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:20.004+0000 7f76c1e8a8c0 1 < completed multipart upload key=KS37ZO6MKAH9 upload=BAPF6S8ENVA3 tag=5K12W9150LIW type=write size=3032036 2024-09-14T11:15:20.002 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:20.004+0000 7f76c1e8a8c0 1 > prepared operation key=8PZOVFEYYSOG tag=Q0E2XXGYNPPI type=write size=5613 2024-09-14T11:15:20.004 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:20.008+0000 7f76c1e8a8c0 1 < completed part key=_multipart_VI61O3K069BP.2~14ESTVB1KZ8X.0 size=1048576 2024-09-14T11:15:20.006 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:20.008+0000 7f76c1e8a8c0 1 < completed part key=_multipart_VI61O3K069BP.2~14ESTVB1KZ8X.1 size=1048576 2024-09-14T11:15:20.008 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:20.012+0000 7f76c1e8a8c0 1 < completed part key=_multipart_VI61O3K069BP.2~14ESTVB1KZ8X.2 size=1038601 2024-09-14T11:15:20.012 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:20.016+0000 7f76c1e8a8c0 1 < completed multipart upload key=VI61O3K069BP upload=14ESTVB1KZ8X tag=UITUR3BK8AYO type=write size=4184329 2024-09-14T11:15:20.016 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:20.020+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_OOUEM16XL80W.2~F1CXBNQVMKLG.0 size=1048576 2024-09-14T11:15:20.018 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:20.020+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_OOUEM16XL80W.2~F1CXBNQVMKLG.1 size=1048576 2024-09-14T11:15:20.020 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:20.020+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_OOUEM16XL80W.2~F1CXBNQVMKLG.2 size=242532 2024-09-14T11:15:20.020 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:20.020+0000 7f76c1e8a8c0 1 > prepared multipart upload key=OOUEM16XL80W upload=F1CXBNQVMKLG tag=Y0VG3BPOVWLB type=write size=3388260 2024-09-14T11:15:20.022 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:20.024+0000 7f76c1e8a8c0 1 < completed delete operation key=Q5IY4J5FOD80 tag=7AL3W5N5K59U type=del 2024-09-14T11:15:20.024 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:20.028+0000 7f76c1e8a8c0 1 > prepared operation key=8PZOVFEYYSOG tag=5NNV7NSMG09V type=write size=827523 2024-09-14T11:15:20.027 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:20.028+0000 7f76c1e8a8c0 1 < completed write operation key=GZM0AQVHNCMM tag=P13360BMMAV9 type=write size=847657 2024-09-14T11:15:20.029 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:20.032+0000 7f76c1e8a8c0 1 > prepared operation key=GAVZRU8ZLW7S tag=AQUIVEMANK2Z type=del size=1996384 2024-09-14T11:15:20.031 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:20.032+0000 7f76c1e8a8c0 1 < canceled operation key=OOUEM16XL80W tag=0CQUWVFN9QE6 type=del size=1949058 2024-09-14T11:15:20.036 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:20.036+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_K2EEZLRK7MVO.2~QV6HA7E37P4W.0 size=1048576 2024-09-14T11:15:20.038 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:20.040+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_K2EEZLRK7MVO.2~QV6HA7E37P4W.1 size=1048576 2024-09-14T11:15:20.040 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:20.044+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_K2EEZLRK7MVO.2~QV6HA7E37P4W.2 size=1018180 2024-09-14T11:15:20.040 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:20.044+0000 7f76c1e8a8c0 1 > prepared multipart upload key=K2EEZLRK7MVO upload=QV6HA7E37P4W tag=LPHB3M4DZAYG type=write size=4163908 2024-09-14T11:15:20.043 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:20.044+0000 7f76c1e8a8c0 1 < completed part key=_multipart_KS37ZO6MKAH9.2~69J7D0U43MNQ.0 size=1048576 2024-09-14T11:15:20.045 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:20.048+0000 7f76c1e8a8c0 1 < completed part key=_multipart_KS37ZO6MKAH9.2~69J7D0U43MNQ.1 size=965885 2024-09-14T11:15:20.048 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:20.052+0000 7f76c1e8a8c0 1 < completed multipart upload key=KS37ZO6MKAH9 upload=69J7D0U43MNQ tag=2265EQCCQVYX type=write size=3063037 2024-09-14T11:15:20.053 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:20.056+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_W0MDRE9YO3UP.2~WJHOG2JFW1PQ.0 size=476579 2024-09-14T11:15:20.053 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:20.056+0000 7f76c1e8a8c0 1 > prepared multipart upload key=W0MDRE9YO3UP upload=WJHOG2JFW1PQ tag=3CGRWZETCL2W type=write size=1525155 2024-09-14T11:15:20.055 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:20.056+0000 7f76c1e8a8c0 1 < completed delete operation key=SHKU2PRNREKK tag=GQBN7KVYTGSA type=del 2024-09-14T11:15:20.059 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:20.060+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_F3KFS0P1WM7W.2~TGQV60V638YY.0 size=581954 2024-09-14T11:15:20.059 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:20.060+0000 7f76c1e8a8c0 1 > prepared multipart upload key=F3KFS0P1WM7W upload=TGQV60V638YY tag=PY1E2OZ65R31 type=write size=1630530 2024-09-14T11:15:20.062 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:20.064+0000 7f76c1e8a8c0 1 < completed delete operation key=K9W031V6BFJP tag=OR7AT1JJHFHT type=del 2024-09-14T11:15:20.064 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:20.068+0000 7f76c1e8a8c0 1 > prepared operation key=6TIJR323NMOH tag=7ZOI55AT4P9R type=del size=994098 2024-09-14T11:15:20.066 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:20.068+0000 7f76c1e8a8c0 1 < completed delete operation key=K9W031V6BFJP tag=KICZE4RUK4PT type=del 2024-09-14T11:15:20.068 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:20.072+0000 7f76c1e8a8c0 1 > prepared operation key=OUMUTEBQ1TD0 tag=95TXKJ4597T4 type=del size=2199158 2024-09-14T11:15:20.069 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:20.072+0000 7f76c1e8a8c0 1 < canceled part key=_multipart_Q5IY4J5FOD80.2~ZD7W91MXJISB.0 size=1048576 2024-09-14T11:15:20.071 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:20.072+0000 7f76c1e8a8c0 1 < completed part key=_multipart_Q5IY4J5FOD80.2~ZD7W91MXJISB.1 size=1048576 2024-09-14T11:15:20.072 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:20.076+0000 7f76c1e8a8c0 1 < completed part key=_multipart_Q5IY4J5FOD80.2~ZD7W91MXJISB.2 size=587652 2024-09-14T11:15:20.076 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:20.076+0000 7f76c1e8a8c0 1 < canceled multipart upload key=Q5IY4J5FOD80 upload=ZD7W91MXJISB tag=DG2YIVBG0U0V type=write size=3733380 2024-09-14T11:15:20.080 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:20.084+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_85G6NT78HAWQ.2~EU5W64PD3UR4.0 size=1048576 2024-09-14T11:15:20.082 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:20.084+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_85G6NT78HAWQ.2~EU5W64PD3UR4.1 size=196984 2024-09-14T11:15:20.082 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:20.084+0000 7f76c1e8a8c0 1 > prepared multipart upload key=85G6NT78HAWQ upload=EU5W64PD3UR4 tag=QHM2NJ5DRM3H type=write size=2294136 2024-09-14T11:15:20.085 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:20.088+0000 7f76c1e8a8c0 1 < completed part key=_multipart_F3KFS0P1WM7W.2~TEKUFDUN51RI.0 size=1048576 2024-09-14T11:15:20.087 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:20.088+0000 7f76c1e8a8c0 1 < completed part key=_multipart_F3KFS0P1WM7W.2~TEKUFDUN51RI.1 size=803992 2024-09-14T11:15:20.090 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:20.092+0000 7f76c1e8a8c0 1 < completed multipart upload key=F3KFS0P1WM7W upload=TEKUFDUN51RI tag=D22ECY3LU5FM type=write size=2901144 2024-09-14T11:15:20.095 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:20.096+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_85G6NT78HAWQ.2~A1TO5SXL1767.0 size=1048576 2024-09-14T11:15:20.096 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:20.100+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_85G6NT78HAWQ.2~A1TO5SXL1767.1 size=882891 2024-09-14T11:15:20.097 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:20.100+0000 7f76c1e8a8c0 1 > prepared multipart upload key=85G6NT78HAWQ upload=A1TO5SXL1767 tag=WSV336IH5QKH type=write size=2980043 2024-09-14T11:15:20.099 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:20.100+0000 7f76c1e8a8c0 1 < canceled operation key=8PZOVFEYYSOG tag=9MUFR3NJHBA3 type=del size=2033154 2024-09-14T11:15:20.106 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:20.108+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_6TIJR323NMOH.2~RJ6I2N31I6P8.0 size=1048576 2024-09-14T11:15:20.107 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:20.108+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_6TIJR323NMOH.2~RJ6I2N31I6P8.1 size=67502 2024-09-14T11:15:20.107 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:20.108+0000 7f76c1e8a8c0 1 > prepared multipart upload key=6TIJR323NMOH upload=RJ6I2N31I6P8 tag=FLEUHEZW3SBF type=write size=2164654 2024-09-14T11:15:20.108 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:20.108+0000 7f76c1e8a8c0 1 < canceled part key=_multipart_1K8ESNXU6WDF.2~O50205ZP1IDU.0 size=1048576 2024-09-14T11:15:20.109 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:20.112+0000 7f76c1e8a8c0 1 < completed part key=_multipart_1K8ESNXU6WDF.2~O50205ZP1IDU.1 size=448888 2024-09-14T11:15:20.113 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:20.116+0000 7f76c1e8a8c0 1 < canceled multipart upload key=1K8ESNXU6WDF upload=O50205ZP1IDU tag=EL2P9ULLB7XH type=write size=2546040 2024-09-14T11:15:20.115 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:20.116+0000 7f76c1e8a8c0 1 > prepared operation key=OUMUTEBQ1TD0 tag=V7TUQTS7NFQW type=del size=2622594 2024-09-14T11:15:20.117 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:20.120+0000 7f76c1e8a8c0 1 < completed delete operation key=6TIJR323NMOH tag=O83AMHQF2JN3 type=del 2024-09-14T11:15:20.121 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:20.124+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_TUFOZKTV9XIH.2~T10N2QY466Z2.0 size=1048576 2024-09-14T11:15:20.123 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:20.124+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_TUFOZKTV9XIH.2~T10N2QY466Z2.1 size=1048576 2024-09-14T11:15:20.124 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:20.128+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_TUFOZKTV9XIH.2~T10N2QY466Z2.2 size=403455 2024-09-14T11:15:20.125 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:20.128+0000 7f76c1e8a8c0 1 > prepared multipart upload key=TUFOZKTV9XIH upload=T10N2QY466Z2 tag=ZEOFIFB59SHS type=write size=3549183 2024-09-14T11:15:20.127 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:20.128+0000 7f76c1e8a8c0 1 < completed part key=_multipart_SHKU2PRNREKK.2~TWNBSET55Y4X.0 size=1048576 2024-09-14T11:15:20.128 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:20.132+0000 7f76c1e8a8c0 1 < completed part key=_multipart_SHKU2PRNREKK.2~TWNBSET55Y4X.1 size=428642 2024-09-14T11:15:20.132 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:20.132+0000 7f76c1e8a8c0 1 < completed multipart upload key=SHKU2PRNREKK upload=TWNBSET55Y4X tag=FVH8I4RGOFGQ type=write size=2525794 2024-09-14T11:15:20.134 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:20.136+0000 7f76c1e8a8c0 1 > prepared operation key=8FFV9G6EQR8F tag=W7SSOVCMTZ0W type=write size=171419 2024-09-14T11:15:20.136 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:20.140+0000 7f76c1e8a8c0 1 < completed delete operation key=OOUEM16XL80W tag=LHER62BTSTPO type=del 2024-09-14T11:15:20.139 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:20.140+0000 7f76c1e8a8c0 1 > prepared operation key=6TIJR323NMOH tag=6QO7JDB35I53 type=del size=3903920 2024-09-14T11:15:20.141 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:20.144+0000 7f76c1e8a8c0 1 < completed write operation key=8PZOVFEYYSOG tag=Q0E2XXGYNPPI type=write size=5613 2024-09-14T11:15:20.143 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:20.144+0000 7f76c1e8a8c0 1 > prepared operation key=XC8VWSHZOPFP tag=322DC9IUBBEL type=del size=1090433 2024-09-14T11:15:20.146 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:20.148+0000 7f76c1e8a8c0 1 < completed part key=_multipart_OOUEM16XL80W.2~F1CXBNQVMKLG.0 size=1048576 2024-09-14T11:15:20.148 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:20.148+0000 7f76c1e8a8c0 1 < completed part key=_multipart_OOUEM16XL80W.2~F1CXBNQVMKLG.1 size=1048576 2024-09-14T11:15:20.150 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:20.152+0000 7f76c1e8a8c0 1 < completed part key=_multipart_OOUEM16XL80W.2~F1CXBNQVMKLG.2 size=242532 2024-09-14T11:15:20.154 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:20.156+0000 7f76c1e8a8c0 1 < completed multipart upload key=OOUEM16XL80W upload=F1CXBNQVMKLG tag=Y0VG3BPOVWLB type=write size=3388260 2024-09-14T11:15:20.157 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:20.160+0000 7f76c1e8a8c0 1 > prepared operation key=OUMUTEBQ1TD0 tag=Z120EE62YDSK type=del size=3033186 2024-09-14T11:15:20.160 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:20.160+0000 7f76c1e8a8c0 1 < completed write operation key=8PZOVFEYYSOG tag=5NNV7NSMG09V type=write size=827523 2024-09-14T11:15:20.162 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:20.164+0000 7f76c1e8a8c0 1 > prepared operation key=K2EEZLRK7MVO tag=TJOJCW298LO2 type=del size=2312867 2024-09-14T11:15:20.165 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:20.168+0000 7f76c1e8a8c0 1 < completed delete operation key=GAVZRU8ZLW7S tag=AQUIVEMANK2Z type=del 2024-09-14T11:15:20.167 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:20.168+0000 7f76c1e8a8c0 1 > prepared operation key=1K8ESNXU6WDF tag=S6Y9FI26LSIG type=del size=4191410 2024-09-14T11:15:20.169 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:20.172+0000 7f76c1e8a8c0 1 < completed part key=_multipart_K2EEZLRK7MVO.2~QV6HA7E37P4W.0 size=1048576 2024-09-14T11:15:20.171 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:20.172+0000 7f76c1e8a8c0 1 < completed part key=_multipart_K2EEZLRK7MVO.2~QV6HA7E37P4W.1 size=1048576 2024-09-14T11:15:20.173 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:20.176+0000 7f76c1e8a8c0 1 < completed part key=_multipart_K2EEZLRK7MVO.2~QV6HA7E37P4W.2 size=1018180 2024-09-14T11:15:20.177 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:20.180+0000 7f76c1e8a8c0 1 < completed multipart upload key=K2EEZLRK7MVO upload=QV6HA7E37P4W tag=LPHB3M4DZAYG type=write size=4163908 2024-09-14T11:15:20.179 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:20.180+0000 7f76c1e8a8c0 1 > prepared operation key=8FFV9G6EQR8F tag=C01A227YKHC6 type=del size=2514646 2024-09-14T11:15:20.181 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:20.184+0000 7f76c1e8a8c0 1 < completed part key=_multipart_W0MDRE9YO3UP.2~WJHOG2JFW1PQ.0 size=476579 2024-09-14T11:15:20.185 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:20.188+0000 7f76c1e8a8c0 1 < completed multipart upload key=W0MDRE9YO3UP upload=WJHOG2JFW1PQ tag=3CGRWZETCL2W type=write size=1525155 2024-09-14T11:15:20.189 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:20.192+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_8FFV9G6EQR8F.2~G2UEJ29BRCP1.0 size=22964 2024-09-14T11:15:20.189 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:20.192+0000 7f76c1e8a8c0 1 > prepared multipart upload key=8FFV9G6EQR8F upload=G2UEJ29BRCP1 tag=QA24CGMC1SKB type=write size=1071540 2024-09-14T11:15:20.192 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:20.192+0000 7f76c1e8a8c0 1 < completed part key=_multipart_F3KFS0P1WM7W.2~TGQV60V638YY.0 size=581954 2024-09-14T11:15:20.195 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:20.196+0000 7f76c1e8a8c0 1 < completed multipart upload key=F3KFS0P1WM7W upload=TGQV60V638YY tag=PY1E2OZ65R31 type=write size=1630530 2024-09-14T11:15:20.197 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:20.200+0000 7f76c1e8a8c0 1 > prepared operation key=K9W031V6BFJP tag=D6ZBGN1B1KTV type=del size=3121860 2024-09-14T11:15:20.202 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:20.204+0000 7f76c1e8a8c0 1 < suggested update operation key=6TIJR323NMOH tag=7ZOI55AT4P9R type=del size=994098 2024-09-14T11:15:20.206 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:20.208+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_LZ0YNFOVFYCL.2~6BKB98N8A7CA.0 size=1048576 2024-09-14T11:15:20.208 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:20.208+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_LZ0YNFOVFYCL.2~6BKB98N8A7CA.1 size=365978 2024-09-14T11:15:20.208 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:20.208+0000 7f76c1e8a8c0 1 > prepared multipart upload key=LZ0YNFOVFYCL upload=6BKB98N8A7CA tag=52V7SI3NQ90V type=write size=2463130 2024-09-14T11:15:20.210 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:20.212+0000 7f76c1e8a8c0 1 < completed delete operation key=OUMUTEBQ1TD0 tag=95TXKJ4597T4 type=del 2024-09-14T11:15:20.214 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:20.216+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_XC8VWSHZOPFP.2~9HRNN14DP5O5.0 size=1048576 2024-09-14T11:15:20.216 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:20.216+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_XC8VWSHZOPFP.2~9HRNN14DP5O5.1 size=897966 2024-09-14T11:15:20.216 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:20.216+0000 7f76c1e8a8c0 1 > prepared multipart upload key=XC8VWSHZOPFP upload=9HRNN14DP5O5 tag=CIUKO66F18ZQ type=write size=2995118 2024-09-14T11:15:20.218 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:20.220+0000 7f76c1e8a8c0 1 < completed part key=_multipart_85G6NT78HAWQ.2~EU5W64PD3UR4.0 size=1048576 2024-09-14T11:15:20.219 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:20.220+0000 7f76c1e8a8c0 1 < completed part key=_multipart_85G6NT78HAWQ.2~EU5W64PD3UR4.1 size=196984 2024-09-14T11:15:20.223 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:20.224+0000 7f76c1e8a8c0 1 < completed multipart upload key=85G6NT78HAWQ upload=EU5W64PD3UR4 tag=QHM2NJ5DRM3H type=write size=2294136 2024-09-14T11:15:20.225 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:20.228+0000 7f76c1e8a8c0 1 > prepared operation key=BOCIF4TL7X7J tag=TXT72OAPFCAF type=del size=755308 2024-09-14T11:15:20.227 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:20.228+0000 7f76c1e8a8c0 1 < completed part key=_multipart_85G6NT78HAWQ.2~A1TO5SXL1767.0 size=1048576 2024-09-14T11:15:20.229 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:20.232+0000 7f76c1e8a8c0 1 < completed part key=_multipart_85G6NT78HAWQ.2~A1TO5SXL1767.1 size=882891 2024-09-14T11:15:20.233 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:20.236+0000 7f76c1e8a8c0 1 < completed multipart upload key=85G6NT78HAWQ upload=A1TO5SXL1767 tag=WSV336IH5QKH type=write size=2980043 2024-09-14T11:15:20.235 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:20.236+0000 7f76c1e8a8c0 1 > prepared operation key=CIRQT9IDJ5OJ tag=PIXH3XEO77YA type=del size=3052859 2024-09-14T11:15:20.238 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:20.240+0000 7f76c1e8a8c0 1 < completed part key=_multipart_6TIJR323NMOH.2~RJ6I2N31I6P8.0 size=1048576 2024-09-14T11:15:20.239 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:20.240+0000 7f76c1e8a8c0 1 < completed part key=_multipart_6TIJR323NMOH.2~RJ6I2N31I6P8.1 size=67502 2024-09-14T11:15:20.243 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:20.244+0000 7f76c1e8a8c0 1 < completed multipart upload key=6TIJR323NMOH upload=RJ6I2N31I6P8 tag=FLEUHEZW3SBF type=write size=2164654 2024-09-14T11:15:20.245 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:20.248+0000 7f76c1e8a8c0 1 > prepared operation key=K9W031V6BFJP tag=KE4I49CJHVJT type=del size=363561 2024-09-14T11:15:20.247 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:20.248+0000 7f76c1e8a8c0 1 < completed delete operation key=OUMUTEBQ1TD0 tag=V7TUQTS7NFQW type=del 2024-09-14T11:15:20.251 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:20.252+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_8PZOVFEYYSOG.2~2PFCZHST1D6I.0 size=1048576 2024-09-14T11:15:20.253 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:20.256+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_8PZOVFEYYSOG.2~2PFCZHST1D6I.1 size=730026 2024-09-14T11:15:20.253 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:20.256+0000 7f76c1e8a8c0 1 > prepared multipart upload key=8PZOVFEYYSOG upload=2PFCZHST1D6I tag=OEOSERRI0EW4 type=write size=2827178 2024-09-14T11:15:20.255 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:20.256+0000 7f76c1e8a8c0 1 < completed part key=_multipart_TUFOZKTV9XIH.2~T10N2QY466Z2.0 size=1048576 2024-09-14T11:15:20.257 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:20.260+0000 7f76c1e8a8c0 1 < completed part key=_multipart_TUFOZKTV9XIH.2~T10N2QY466Z2.1 size=1048576 2024-09-14T11:15:20.258 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:20.260+0000 7f76c1e8a8c0 1 < completed part key=_multipart_TUFOZKTV9XIH.2~T10N2QY466Z2.2 size=403455 2024-09-14T11:15:20.262 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:20.264+0000 7f76c1e8a8c0 1 < completed multipart upload key=TUFOZKTV9XIH upload=T10N2QY466Z2 tag=ZEOFIFB59SHS type=write size=3549183 2024-09-14T11:15:20.264 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:20.268+0000 7f76c1e8a8c0 1 > prepared operation key=8FFV9G6EQR8F tag=Y4G3MEORE03B type=del size=2213253 2024-09-14T11:15:20.266 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:20.268+0000 7f76c1e8a8c0 1 < completed write operation key=8FFV9G6EQR8F tag=W7SSOVCMTZ0W type=write size=171419 2024-09-14T11:15:20.270 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:20.272+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_8PZOVFEYYSOG.2~O8X1VTVY0HB7.0 size=1048576 2024-09-14T11:15:20.272 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:20.276+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_8PZOVFEYYSOG.2~O8X1VTVY0HB7.1 size=1048576 2024-09-14T11:15:20.274 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:20.276+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_8PZOVFEYYSOG.2~O8X1VTVY0HB7.2 size=53356 2024-09-14T11:15:20.274 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:20.276+0000 7f76c1e8a8c0 1 > prepared multipart upload key=8PZOVFEYYSOG upload=O8X1VTVY0HB7 tag=R11I6P7QPN4E type=write size=3199084 2024-09-14T11:15:20.276 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:20.280+0000 7f76c1e8a8c0 -1 < failed to complete operation key=6TIJR323NMOH tag=6QO7JDB35I53 type=del size=3903920: (22) Invalid argument 2024-09-14T11:15:20.281 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:20.284+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_CIRQT9IDJ5OJ.2~H237VLT00KGE.0 size=1048576 2024-09-14T11:15:20.282 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:20.284+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_CIRQT9IDJ5OJ.2~H237VLT00KGE.1 size=1048576 2024-09-14T11:15:20.284 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:20.288+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_CIRQT9IDJ5OJ.2~H237VLT00KGE.2 size=770753 2024-09-14T11:15:20.284 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:20.288+0000 7f76c1e8a8c0 1 > prepared multipart upload key=CIRQT9IDJ5OJ upload=H237VLT00KGE tag=BB9V0J470HNE type=write size=3916481 2024-09-14T11:15:20.287 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:20.288+0000 7f76c1e8a8c0 1 < canceled operation key=XC8VWSHZOPFP tag=322DC9IUBBEL type=del size=1090433 2024-09-14T11:15:20.291 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:20.292+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_K2EEZLRK7MVO.2~K2QERDYG9CVZ.0 size=1048576 2024-09-14T11:15:20.293 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:20.296+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_K2EEZLRK7MVO.2~K2QERDYG9CVZ.1 size=982995 2024-09-14T11:15:20.293 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:20.296+0000 7f76c1e8a8c0 1 > prepared multipart upload key=K2EEZLRK7MVO upload=K2QERDYG9CVZ tag=M7NCTDHXVKQ4 type=write size=3080147 2024-09-14T11:15:20.295 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:20.296+0000 7f76c1e8a8c0 1 < completed delete operation key=OUMUTEBQ1TD0 tag=Z120EE62YDSK type=del 2024-09-14T11:15:20.298 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:20.300+0000 7f76c1e8a8c0 1 > prepared operation key=XC8VWSHZOPFP tag=6NOIP8S9U5Z6 type=del size=3982558 2024-09-14T11:15:20.300 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:20.304+0000 7f76c1e8a8c0 1 < completed delete operation key=K2EEZLRK7MVO tag=TJOJCW298LO2 type=del 2024-09-14T11:15:20.303 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:20.304+0000 7f76c1e8a8c0 1 > prepared operation key=K9W031V6BFJP tag=LR48EF5GHR6D type=del size=235801 2024-09-14T11:15:20.305 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:20.308+0000 7f76c1e8a8c0 1 < canceled operation key=1K8ESNXU6WDF tag=S6Y9FI26LSIG type=del size=4191410 2024-09-14T11:15:20.308 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:20.308+0000 7f76c1e8a8c0 1 > prepared operation key=H9CQV6L29SL5 tag=FVDD392X3MQD type=write size=959894 2024-09-14T11:15:20.310 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:20.312+0000 7f76c1e8a8c0 1 < completed delete operation key=8FFV9G6EQR8F tag=C01A227YKHC6 type=del 2024-09-14T11:15:20.316 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:20.316+0000 7f76c1e8a8c0 1 > prepared operation key=8PZOVFEYYSOG tag=QIJWG4CUNZC3 type=write size=1036463 2024-09-14T11:15:20.316 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:20.320+0000 7f76c1e8a8c0 1 < canceled part key=_multipart_8FFV9G6EQR8F.2~G2UEJ29BRCP1.0 size=22964 2024-09-14T11:15:20.320 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:20.324+0000 7f76c1e8a8c0 1 < canceled multipart upload key=8FFV9G6EQR8F upload=G2UEJ29BRCP1 tag=QA24CGMC1SKB type=write size=1071540 2024-09-14T11:15:20.323 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:20.324+0000 7f76c1e8a8c0 1 > prepared operation key=XC8VWSHZOPFP tag=COFGMQZA2T6Y type=del size=861913 2024-09-14T11:15:20.325 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:20.328+0000 7f76c1e8a8c0 1 < canceled operation key=K9W031V6BFJP tag=D6ZBGN1B1KTV type=del size=3121860 2024-09-14T11:15:20.328 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:20.328+0000 7f76c1e8a8c0 1 > prepared operation key=R5I9H7WAK7Z7 tag=HUZ33MFEU11H type=write size=175627 2024-09-14T11:15:20.330 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:20.332+0000 7f76c1e8a8c0 1 < completed part key=_multipart_LZ0YNFOVFYCL.2~6BKB98N8A7CA.0 size=1048576 2024-09-14T11:15:20.332 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:20.336+0000 7f76c1e8a8c0 1 < completed part key=_multipart_LZ0YNFOVFYCL.2~6BKB98N8A7CA.1 size=365978 2024-09-14T11:15:20.336 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:20.340+0000 7f76c1e8a8c0 1 < completed multipart upload key=LZ0YNFOVFYCL upload=6BKB98N8A7CA tag=52V7SI3NQ90V type=write size=2463130 2024-09-14T11:15:20.341 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:20.344+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_TZO40K6J9877.2~WNN9YJE8GY1E.0 size=1048576 2024-09-14T11:15:20.343 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:20.344+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_TZO40K6J9877.2~WNN9YJE8GY1E.1 size=1048576 2024-09-14T11:15:20.345 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:20.348+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_TZO40K6J9877.2~WNN9YJE8GY1E.2 size=789680 2024-09-14T11:15:20.345 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:20.348+0000 7f76c1e8a8c0 1 > prepared multipart upload key=TZO40K6J9877 upload=WNN9YJE8GY1E tag=SMVM3UIFHD67 type=write size=3935408 2024-09-14T11:15:20.347 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:20.348+0000 7f76c1e8a8c0 1 < completed part key=_multipart_XC8VWSHZOPFP.2~9HRNN14DP5O5.0 size=1048576 2024-09-14T11:15:20.349 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:20.352+0000 7f76c1e8a8c0 1 < completed part key=_multipart_XC8VWSHZOPFP.2~9HRNN14DP5O5.1 size=897966 2024-09-14T11:15:20.353 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:20.356+0000 7f76c1e8a8c0 1 < completed multipart upload key=XC8VWSHZOPFP upload=9HRNN14DP5O5 tag=CIUKO66F18ZQ type=write size=2995118 2024-09-14T11:15:20.357 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:20.360+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_XC8VWSHZOPFP.2~81033Y9TKYPX.0 size=1048576 2024-09-14T11:15:20.359 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:20.360+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_XC8VWSHZOPFP.2~81033Y9TKYPX.1 size=385636 2024-09-14T11:15:20.359 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:20.360+0000 7f76c1e8a8c0 1 > prepared multipart upload key=XC8VWSHZOPFP upload=81033Y9TKYPX tag=JHFE63CM442X type=write size=2482788 2024-09-14T11:15:20.361 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:20.364+0000 7f76c1e8a8c0 1 < completed delete operation key=BOCIF4TL7X7J tag=TXT72OAPFCAF type=del 2024-09-14T11:15:20.364 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:20.364+0000 7f76c1e8a8c0 1 > prepared operation key=6TIJR323NMOH tag=3SPADLRBTJTH type=del size=1531258 2024-09-14T11:15:20.366 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:20.368+0000 7f76c1e8a8c0 1 < completed delete operation key=CIRQT9IDJ5OJ tag=PIXH3XEO77YA type=del 2024-09-14T11:15:20.368 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:20.372+0000 7f76c1e8a8c0 1 > prepared operation key=S43U13LYETS4 tag=SN62AJG2TBFR type=del size=1003671 2024-09-14T11:15:20.371 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:20.372+0000 7f76c1e8a8c0 1 < completed delete operation key=K9W031V6BFJP tag=KE4I49CJHVJT type=del 2024-09-14T11:15:20.375 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:20.376+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_CIRQT9IDJ5OJ.2~TQ06FN6TFOQZ.0 size=1048576 2024-09-14T11:15:20.377 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:20.380+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_CIRQT9IDJ5OJ.2~TQ06FN6TFOQZ.1 size=615443 2024-09-14T11:15:20.377 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:20.380+0000 7f76c1e8a8c0 1 > prepared multipart upload key=CIRQT9IDJ5OJ upload=TQ06FN6TFOQZ tag=YFA351CPDPSP type=write size=2712595 2024-09-14T11:15:20.379 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:20.380+0000 7f76c1e8a8c0 1 < completed part key=_multipart_8PZOVFEYYSOG.2~2PFCZHST1D6I.0 size=1048576 2024-09-14T11:15:20.381 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:20.384+0000 7f76c1e8a8c0 1 < completed part key=_multipart_8PZOVFEYYSOG.2~2PFCZHST1D6I.1 size=730026 2024-09-14T11:15:20.385 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:20.388+0000 7f76c1e8a8c0 1 < completed multipart upload key=8PZOVFEYYSOG upload=2PFCZHST1D6I tag=OEOSERRI0EW4 type=write size=2827178 2024-09-14T11:15:20.387 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:20.388+0000 7f76c1e8a8c0 1 > prepared operation key=K9W031V6BFJP tag=2OQBH528UJTU type=write size=813424 2024-09-14T11:15:20.391 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:20.392+0000 7f76c1e8a8c0 1 < suggested update operation key=8FFV9G6EQR8F tag=Y4G3MEORE03B type=del size=2213253 2024-09-14T11:15:20.394 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:20.396+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_K9W031V6BFJP.2~KUUX6FNHQLTK.0 size=1048576 2024-09-14T11:15:20.396 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:20.396+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_K9W031V6BFJP.2~KUUX6FNHQLTK.1 size=454639 2024-09-14T11:15:20.396 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:20.396+0000 7f76c1e8a8c0 1 > prepared multipart upload key=K9W031V6BFJP upload=KUUX6FNHQLTK tag=YLTF0JOW6M8D type=write size=2551791 2024-09-14T11:15:20.398 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:20.400+0000 7f76c1e8a8c0 1 < completed part key=_multipart_8PZOVFEYYSOG.2~O8X1VTVY0HB7.0 size=1048576 2024-09-14T11:15:20.399 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:20.400+0000 7f76c1e8a8c0 1 < completed part key=_multipart_8PZOVFEYYSOG.2~O8X1VTVY0HB7.1 size=1048576 2024-09-14T11:15:20.401 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:20.404+0000 7f76c1e8a8c0 1 < completed part key=_multipart_8PZOVFEYYSOG.2~O8X1VTVY0HB7.2 size=53356 2024-09-14T11:15:20.404 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:20.408+0000 7f76c1e8a8c0 1 < completed multipart upload key=8PZOVFEYYSOG upload=O8X1VTVY0HB7 tag=R11I6P7QPN4E type=write size=3199084 2024-09-14T11:15:20.406 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:20.408+0000 7f76c1e8a8c0 1 > prepared operation key=R5I9H7WAK7Z7 tag=CC1BQNIU0V8C type=del size=621465 2024-09-14T11:15:20.408 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:20.412+0000 7f76c1e8a8c0 1 < completed part key=_multipart_CIRQT9IDJ5OJ.2~H237VLT00KGE.0 size=1048576 2024-09-14T11:15:20.410 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:20.412+0000 7f76c1e8a8c0 1 < completed part key=_multipart_CIRQT9IDJ5OJ.2~H237VLT00KGE.1 size=1048576 2024-09-14T11:15:20.412 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:20.412+0000 7f76c1e8a8c0 1 < completed part key=_multipart_CIRQT9IDJ5OJ.2~H237VLT00KGE.2 size=770753 2024-09-14T11:15:20.415 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:20.416+0000 7f76c1e8a8c0 1 < completed multipart upload key=CIRQT9IDJ5OJ upload=H237VLT00KGE tag=BB9V0J470HNE type=write size=3916481 2024-09-14T11:15:20.417 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:20.420+0000 7f76c1e8a8c0 1 > prepared operation key=MEVTZ7OAD4CA tag=HWJ1521DBP63 type=del size=4108185 2024-09-14T11:15:20.419 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:20.420+0000 7f76c1e8a8c0 1 < completed part key=_multipart_K2EEZLRK7MVO.2~K2QERDYG9CVZ.0 size=1048576 2024-09-14T11:15:20.421 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:20.424+0000 7f76c1e8a8c0 1 < completed part key=_multipart_K2EEZLRK7MVO.2~K2QERDYG9CVZ.1 size=982995 2024-09-14T11:15:20.425 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:20.428+0000 7f76c1e8a8c0 1 < completed multipart upload key=K2EEZLRK7MVO upload=K2QERDYG9CVZ tag=M7NCTDHXVKQ4 type=write size=3080147 2024-09-14T11:15:20.429 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:20.432+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_TUFOZKTV9XIH.2~2JAY8PT2FK56.0 size=1048576 2024-09-14T11:15:20.431 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:20.432+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_TUFOZKTV9XIH.2~2JAY8PT2FK56.1 size=227806 2024-09-14T11:15:20.431 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:20.432+0000 7f76c1e8a8c0 1 > prepared multipart upload key=TUFOZKTV9XIH upload=2JAY8PT2FK56 tag=LUEZ30TZF098 type=write size=2324958 2024-09-14T11:15:20.436 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:20.440+0000 7f76c1e8a8c0 1 < suggested update operation key=XC8VWSHZOPFP tag=6NOIP8S9U5Z6 type=del size=3982558 2024-09-14T11:15:20.441 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:20.444+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_K9W031V6BFJP.2~HECFGGA9EXIZ.0 size=920857 2024-09-14T11:15:20.441 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:20.444+0000 7f76c1e8a8c0 1 > prepared multipart upload key=K9W031V6BFJP upload=HECFGGA9EXIZ tag=K4G3HZW6U6OC type=write size=1969433 2024-09-14T11:15:20.444 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:20.444+0000 7f76c1e8a8c0 1 < completed delete operation key=K9W031V6BFJP tag=LR48EF5GHR6D type=del 2024-09-14T11:15:20.446 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:20.448+0000 7f76c1e8a8c0 1 > prepared operation key=8PZOVFEYYSOG tag=PPOEH0H263CG type=write size=626772 2024-09-14T11:15:20.449 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:20.452+0000 7f76c1e8a8c0 1 < completed write operation key=H9CQV6L29SL5 tag=FVDD392X3MQD type=write size=959894 2024-09-14T11:15:20.454 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:20.456+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_SUNCRV0C1XYL.2~O8W9ATRQA9IM.0 size=549613 2024-09-14T11:15:20.454 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:20.456+0000 7f76c1e8a8c0 1 > prepared multipart upload key=SUNCRV0C1XYL upload=O8W9ATRQA9IM tag=BYUT5Z85UWJ7 type=write size=1598189 2024-09-14T11:15:20.457 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:20.460+0000 7f76c1e8a8c0 1 < completed write operation key=8PZOVFEYYSOG tag=QIJWG4CUNZC3 type=write size=1036463 2024-09-14T11:15:20.462 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:20.464+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_6TIJR323NMOH.2~02AJV9ZCVD2T.0 size=1048576 2024-09-14T11:15:20.464 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:20.468+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_6TIJR323NMOH.2~02AJV9ZCVD2T.1 size=543571 2024-09-14T11:15:20.464 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:20.468+0000 7f76c1e8a8c0 1 > prepared multipart upload key=6TIJR323NMOH upload=02AJV9ZCVD2T tag=RT5OWX29FDZ0 type=write size=2640723 2024-09-14T11:15:20.467 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:20.468+0000 7f76c1e8a8c0 -1 < failed to complete operation key=XC8VWSHZOPFP tag=COFGMQZA2T6Y type=del size=861913: (22) Invalid argument 2024-09-14T11:15:20.469 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:20.472+0000 7f76c1e8a8c0 1 > prepared operation key=KS37ZO6MKAH9 tag=AC8W77KW57UM type=del size=1347628 2024-09-14T11:15:20.472 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:20.472+0000 7f76c1e8a8c0 1 < completed write operation key=R5I9H7WAK7Z7 tag=HUZ33MFEU11H type=write size=175627 2024-09-14T11:15:20.475 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:20.476+0000 7f76c1e8a8c0 1 > prepared operation key=GZM0AQVHNCMM tag=50TIUSAWKP9J type=del size=2894218 2024-09-14T11:15:20.478 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:20.480+0000 7f76c1e8a8c0 1 < completed part key=_multipart_TZO40K6J9877.2~WNN9YJE8GY1E.0 size=1048576 2024-09-14T11:15:20.480 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:20.480+0000 7f76c1e8a8c0 1 < completed part key=_multipart_TZO40K6J9877.2~WNN9YJE8GY1E.1 size=1048576 2024-09-14T11:15:20.480 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:20.480+0000 7f76c1e8a8c0 1 < canceled part key=_multipart_TZO40K6J9877.2~WNN9YJE8GY1E.2 size=789680 2024-09-14T11:15:20.485 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:20.488+0000 7f76c1e8a8c0 1 < canceled multipart upload key=TZO40K6J9877 upload=WNN9YJE8GY1E tag=SMVM3UIFHD67 type=write size=3935408 2024-09-14T11:15:20.488 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:20.488+0000 7f76c1e8a8c0 1 > prepared operation key=R5I9H7WAK7Z7 tag=FH05H7SL1SQ6 type=del size=2083497 2024-09-14T11:15:20.491 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:20.492+0000 7f76c1e8a8c0 1 < completed part key=_multipart_XC8VWSHZOPFP.2~81033Y9TKYPX.0 size=1048576 2024-09-14T11:15:20.494 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:20.496+0000 7f76c1e8a8c0 1 < completed part key=_multipart_XC8VWSHZOPFP.2~81033Y9TKYPX.1 size=385636 2024-09-14T11:15:20.499 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:20.500+0000 7f76c1e8a8c0 1 < completed multipart upload key=XC8VWSHZOPFP upload=81033Y9TKYPX tag=JHFE63CM442X type=write size=2482788 2024-09-14T11:15:20.502 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:20.504+0000 7f76c1e8a8c0 1 > prepared operation key=K9W031V6BFJP tag=1AUGIMUMTWKM type=del size=166063 2024-09-14T11:15:20.507 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:20.508+0000 7f76c1e8a8c0 1 < suggested update operation key=6TIJR323NMOH tag=3SPADLRBTJTH type=del size=1531258 2024-09-14T11:15:20.510 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:20.512+0000 7f76c1e8a8c0 1 > prepared operation key=1W5733SDHGDN tag=BWVLEG75YL2I type=del size=3286849 2024-09-14T11:15:20.513 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:20.516+0000 7f76c1e8a8c0 1 < canceled operation key=S43U13LYETS4 tag=SN62AJG2TBFR type=del size=1003671 2024-09-14T11:15:20.515 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:20.516+0000 7f76c1e8a8c0 1 > prepared operation key=6TIJR323NMOH tag=9DFVF904C7L8 type=del size=2604448 2024-09-14T11:15:20.518 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:20.520+0000 7f76c1e8a8c0 1 < completed part key=_multipart_CIRQT9IDJ5OJ.2~TQ06FN6TFOQZ.0 size=1048576 2024-09-14T11:15:20.520 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:20.524+0000 7f76c1e8a8c0 1 < completed part key=_multipart_CIRQT9IDJ5OJ.2~TQ06FN6TFOQZ.1 size=615443 2024-09-14T11:15:20.524 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:20.528+0000 7f76c1e8a8c0 1 < completed multipart upload key=CIRQT9IDJ5OJ upload=TQ06FN6TFOQZ tag=YFA351CPDPSP type=write size=2712595 2024-09-14T11:15:20.527 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:20.528+0000 7f76c1e8a8c0 1 > prepared operation key=BOCIF4TL7X7J tag=P0J6XX6ERBC7 type=del size=3143696 2024-09-14T11:15:20.529 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:20.532+0000 7f76c1e8a8c0 1 < completed write operation key=K9W031V6BFJP tag=2OQBH528UJTU type=write size=813424 2024-09-14T11:15:20.532 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:20.532+0000 7f76c1e8a8c0 1 > prepared operation key=8FFV9G6EQR8F tag=UTC0GD2EA9TO type=del size=2558711 2024-09-14T11:15:20.534 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:20.536+0000 7f76c1e8a8c0 1 < completed part key=_multipart_K9W031V6BFJP.2~KUUX6FNHQLTK.0 size=1048576 2024-09-14T11:15:20.536 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:20.540+0000 7f76c1e8a8c0 1 < completed part key=_multipart_K9W031V6BFJP.2~KUUX6FNHQLTK.1 size=454639 2024-09-14T11:15:20.544 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:20.548+0000 7f76c1e8a8c0 1 < completed multipart upload key=K9W031V6BFJP upload=KUUX6FNHQLTK tag=YLTF0JOW6M8D type=write size=2551791 2024-09-14T11:15:20.550 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:20.552+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_15FU4CEGC22Q.2~Y52OX90ODYNR.0 size=1048576 2024-09-14T11:15:20.552 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:20.552+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_15FU4CEGC22Q.2~Y52OX90ODYNR.1 size=464795 2024-09-14T11:15:20.552 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:20.552+0000 7f76c1e8a8c0 1 > prepared multipart upload key=15FU4CEGC22Q upload=Y52OX90ODYNR tag=QHXIH88XI8KZ type=write size=2561947 2024-09-14T11:15:20.555 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:20.556+0000 7f76c1e8a8c0 1 < completed delete operation key=R5I9H7WAK7Z7 tag=CC1BQNIU0V8C type=del 2024-09-14T11:15:20.557 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:20.560+0000 7f76c1e8a8c0 1 > prepared operation key=VI61O3K069BP tag=P1FWBZLDX7Y0 type=del size=3188150 2024-09-14T11:15:20.563 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:20.564+0000 7f76c1e8a8c0 1 < suggested remove operation key=MEVTZ7OAD4CA tag=HWJ1521DBP63 type=del 2024-09-14T11:15:20.565 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:20.568+0000 7f76c1e8a8c0 1 > prepared operation key=F3KFS0P1WM7W tag=MQSGNIJ0UFLF type=del size=3403252 2024-09-14T11:15:20.568 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:20.568+0000 7f76c1e8a8c0 1 < completed part key=_multipart_TUFOZKTV9XIH.2~2JAY8PT2FK56.0 size=1048576 2024-09-14T11:15:20.570 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:20.572+0000 7f76c1e8a8c0 1 < completed part key=_multipart_TUFOZKTV9XIH.2~2JAY8PT2FK56.1 size=227806 2024-09-14T11:15:20.574 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:20.576+0000 7f76c1e8a8c0 1 < completed multipart upload key=TUFOZKTV9XIH upload=2JAY8PT2FK56 tag=LUEZ30TZF098 type=write size=2324958 2024-09-14T11:15:20.576 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:20.580+0000 7f76c1e8a8c0 1 > prepared operation key=VI61O3K069BP tag=JNV3GVPCO1J4 type=del size=1131896 2024-09-14T11:15:20.578 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:20.580+0000 7f76c1e8a8c0 1 < completed part key=_multipart_K9W031V6BFJP.2~HECFGGA9EXIZ.0 size=920857 2024-09-14T11:15:20.583 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:20.584+0000 7f76c1e8a8c0 1 < completed multipart upload key=K9W031V6BFJP upload=HECFGGA9EXIZ tag=K4G3HZW6U6OC type=write size=1969433 2024-09-14T11:15:20.586 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:20.588+0000 7f76c1e8a8c0 1 > prepared operation key=8PZOVFEYYSOG tag=SCDMYX2I3E10 type=del size=471128 2024-09-14T11:15:20.592 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:20.592+0000 7f76c1e8a8c0 1 < suggested update operation key=8PZOVFEYYSOG tag=PPOEH0H263CG type=write size=626772 2024-09-14T11:15:20.595 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:20.596+0000 7f76c1e8a8c0 1 > prepared operation key=OUMUTEBQ1TD0 tag=RN2XOI85ETR9 type=del size=1986817 2024-09-14T11:15:20.597 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:20.600+0000 7f76c1e8a8c0 1 < completed part key=_multipart_SUNCRV0C1XYL.2~O8W9ATRQA9IM.0 size=549613 2024-09-14T11:15:20.601 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:20.604+0000 7f76c1e8a8c0 1 < completed multipart upload key=SUNCRV0C1XYL upload=O8W9ATRQA9IM tag=BYUT5Z85UWJ7 type=write size=1598189 2024-09-14T11:15:20.606 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:20.608+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_H9CQV6L29SL5.2~PFABWYD80807.0 size=1048576 2024-09-14T11:15:20.608 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:20.612+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_H9CQV6L29SL5.2~PFABWYD80807.1 size=182267 2024-09-14T11:15:20.608 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:20.612+0000 7f76c1e8a8c0 1 > prepared multipart upload key=H9CQV6L29SL5 upload=PFABWYD80807 tag=LXLP8EWOKIT2 type=write size=2279419 2024-09-14T11:15:20.609 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:20.612+0000 7f76c1e8a8c0 1 < canceled part key=_multipart_6TIJR323NMOH.2~02AJV9ZCVD2T.0 size=1048576 2024-09-14T11:15:20.611 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:20.612+0000 7f76c1e8a8c0 1 < completed part key=_multipart_6TIJR323NMOH.2~02AJV9ZCVD2T.1 size=543571 2024-09-14T11:15:20.616 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:20.620+0000 7f76c1e8a8c0 1 < canceled multipart upload key=6TIJR323NMOH upload=02AJV9ZCVD2T tag=RT5OWX29FDZ0 type=write size=2640723 2024-09-14T11:15:20.619 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:20.620+0000 7f76c1e8a8c0 1 > prepared operation key=S43U13LYETS4 tag=S0JWOA3O21XW type=del size=3136361 2024-09-14T11:15:20.626 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:20.628+0000 7f76c1e8a8c0 1 < suggested update operation key=KS37ZO6MKAH9 tag=AC8W77KW57UM type=del size=1347628 2024-09-14T11:15:20.629 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:20.632+0000 7f76c1e8a8c0 1 > prepared operation key=OUMUTEBQ1TD0 tag=EZ6VUO4LPCI3 type=del size=2129152 2024-09-14T11:15:20.632 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:20.636+0000 7f76c1e8a8c0 1 < canceled operation key=GZM0AQVHNCMM tag=50TIUSAWKP9J type=del size=2894218 2024-09-14T11:15:20.635 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:20.636+0000 7f76c1e8a8c0 1 > prepared operation key=6TIJR323NMOH tag=FONQB2ZCTOLJ type=del size=290151 2024-09-14T11:15:20.638 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:20.640+0000 7f76c1e8a8c0 1 < completed delete operation key=R5I9H7WAK7Z7 tag=FH05H7SL1SQ6 type=del 2024-09-14T11:15:20.641 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:20.644+0000 7f76c1e8a8c0 1 > prepared operation key=Q5IY4J5FOD80 tag=I03QB8H472XH type=del size=3208287 2024-09-14T11:15:20.643 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:20.644+0000 7f76c1e8a8c0 1 < completed delete operation key=K9W031V6BFJP tag=1AUGIMUMTWKM type=del 2024-09-14T11:15:20.647 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:20.648+0000 7f76c1e8a8c0 1 > prepared operation key=F3KFS0P1WM7W tag=8CSUKNKOYO54 type=del size=2237078 2024-09-14T11:15:20.650 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:20.652+0000 7f76c1e8a8c0 1 < completed delete operation key=1W5733SDHGDN tag=BWVLEG75YL2I type=del 2024-09-14T11:15:20.655 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:20.656+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_OOUEM16XL80W.2~Y8AV7UA4MYVP.0 size=541517 2024-09-14T11:15:20.656 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:20.656+0000 7f76c1e8a8c0 1 > prepared multipart upload key=OOUEM16XL80W upload=Y8AV7UA4MYVP tag=Z275FTEQ2VC1 type=write size=1590093 2024-09-14T11:15:20.661 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:20.664+0000 7f76c1e8a8c0 1 < suggested remove operation key=6TIJR323NMOH tag=9DFVF904C7L8 type=del 2024-09-14T11:15:20.663 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:20.664+0000 7f76c1e8a8c0 1 > prepared operation key=GAVZRU8ZLW7S tag=6HZMBVWA99BM type=del size=3896112 2024-09-14T11:15:20.666 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:20.668+0000 7f76c1e8a8c0 1 < completed delete operation key=BOCIF4TL7X7J tag=P0J6XX6ERBC7 type=del 2024-09-14T11:15:20.668 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:20.672+0000 7f76c1e8a8c0 1 > prepared operation key=H9CQV6L29SL5 tag=F9A3T38EXW81 type=del size=1960293 2024-09-14T11:15:20.672 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:20.672+0000 7f76c1e8a8c0 1 < completed delete operation key=8FFV9G6EQR8F tag=UTC0GD2EA9TO type=del 2024-09-14T11:15:20.675 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:20.676+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_W0MDRE9YO3UP.2~0W72KFV920YN.0 size=1048576 2024-09-14T11:15:20.677 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:20.680+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_W0MDRE9YO3UP.2~0W72KFV920YN.1 size=1048576 2024-09-14T11:15:20.678 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:20.680+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_W0MDRE9YO3UP.2~0W72KFV920YN.2 size=209123 2024-09-14T11:15:20.678 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:20.680+0000 7f76c1e8a8c0 1 > prepared multipart upload key=W0MDRE9YO3UP upload=0W72KFV920YN tag=I9BRPE9LZRE5 type=write size=3354851 2024-09-14T11:15:20.680 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:20.684+0000 7f76c1e8a8c0 1 < completed part key=_multipart_15FU4CEGC22Q.2~Y52OX90ODYNR.0 size=1048576 2024-09-14T11:15:20.682 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:20.684+0000 7f76c1e8a8c0 1 < completed part key=_multipart_15FU4CEGC22Q.2~Y52OX90ODYNR.1 size=464795 2024-09-14T11:15:20.686 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:20.688+0000 7f76c1e8a8c0 1 < completed multipart upload key=15FU4CEGC22Q upload=Y52OX90ODYNR tag=QHXIH88XI8KZ type=write size=2561947 2024-09-14T11:15:20.688 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:20.688+0000 7f76c1e8a8c0 1 > prepared operation key=85G6NT78HAWQ tag=5GWY0IY5CP5O type=del size=2833904 2024-09-14T11:15:20.690 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:20.692+0000 7f76c1e8a8c0 1 < completed delete operation key=VI61O3K069BP tag=P1FWBZLDX7Y0 type=del 2024-09-14T11:15:20.692 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:20.692+0000 7f76c1e8a8c0 1 > prepared operation key=S43U13LYETS4 tag=X19HJWXKEQMA type=del size=2551924 2024-09-14T11:15:20.694 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:20.696+0000 7f76c1e8a8c0 1 < completed delete operation key=F3KFS0P1WM7W tag=MQSGNIJ0UFLF type=del 2024-09-14T11:15:20.696 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:20.700+0000 7f76c1e8a8c0 1 > prepared operation key=CIRQT9IDJ5OJ tag=NL98OG27ZQ4I type=write size=413991 2024-09-14T11:15:20.699 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:20.700+0000 7f76c1e8a8c0 1 < completed delete operation key=VI61O3K069BP tag=JNV3GVPCO1J4 type=del 2024-09-14T11:15:20.702 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:20.704+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_MEVTZ7OAD4CA.2~QYQNQ41UB4YJ.0 size=1048576 2024-09-14T11:15:20.704 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:20.708+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_MEVTZ7OAD4CA.2~QYQNQ41UB4YJ.1 size=901719 2024-09-14T11:15:20.704 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:20.708+0000 7f76c1e8a8c0 1 > prepared multipart upload key=MEVTZ7OAD4CA upload=QYQNQ41UB4YJ tag=BT329FJCJZVO type=write size=2998871 2024-09-14T11:15:20.706 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:20.708+0000 7f76c1e8a8c0 -1 < failed to complete operation key=8PZOVFEYYSOG tag=SCDMYX2I3E10 type=del size=471128: (22) Invalid argument 2024-09-14T11:15:20.710 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:20.712+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_SHKU2PRNREKK.2~F03E42EL2UUI.0 size=1048576 2024-09-14T11:15:20.711 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:20.712+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_SHKU2PRNREKK.2~F03E42EL2UUI.1 size=1048576 2024-09-14T11:15:20.713 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:20.716+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_SHKU2PRNREKK.2~F03E42EL2UUI.2 size=259448 2024-09-14T11:15:20.713 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:20.716+0000 7f76c1e8a8c0 1 > prepared multipart upload key=SHKU2PRNREKK upload=F03E42EL2UUI tag=0RRKO5OKPNLH type=write size=3405176 2024-09-14T11:15:20.717 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:20.720+0000 7f76c1e8a8c0 1 < suggested remove operation key=OUMUTEBQ1TD0 tag=RN2XOI85ETR9 type=del 2024-09-14T11:15:20.719 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:20.720+0000 7f76c1e8a8c0 1 > prepared operation key=Q5IY4J5FOD80 tag=BUP40864DO94 type=del size=1947449 2024-09-14T11:15:20.721 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:20.724+0000 7f76c1e8a8c0 1 < completed part key=_multipart_H9CQV6L29SL5.2~PFABWYD80807.0 size=1048576 2024-09-14T11:15:20.723 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:20.724+0000 7f76c1e8a8c0 1 < completed part key=_multipart_H9CQV6L29SL5.2~PFABWYD80807.1 size=182267 2024-09-14T11:15:20.726 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:20.728+0000 7f76c1e8a8c0 1 < completed multipart upload key=H9CQV6L29SL5 upload=PFABWYD80807 tag=LXLP8EWOKIT2 type=write size=2279419 2024-09-14T11:15:20.728 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:20.732+0000 7f76c1e8a8c0 1 > prepared operation key=K2EEZLRK7MVO tag=CJXSETYR6FG4 type=del size=3918344 2024-09-14T11:15:20.731 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:20.732+0000 7f76c1e8a8c0 1 < completed delete operation key=S43U13LYETS4 tag=S0JWOA3O21XW type=del 2024-09-14T11:15:20.733 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:20.736+0000 7f76c1e8a8c0 1 > prepared operation key=8PZOVFEYYSOG tag=YPWTLMZOBKRT type=del size=1445091 2024-09-14T11:15:20.735 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:20.736+0000 7f76c1e8a8c0 -1 < failed to complete operation key=OUMUTEBQ1TD0 tag=EZ6VUO4LPCI3 type=del size=2129152: (22) Invalid argument 2024-09-14T11:15:20.738 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:20.740+0000 7f76c1e8a8c0 1 > prepared operation key=HS7T50JORDQJ tag=BMPZ391ARN7E type=del size=3162638 2024-09-14T11:15:20.739 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:20.740+0000 7f76c1e8a8c0 -1 < no bi entry to suggest for operation key=6TIJR323NMOH tag=FONQB2ZCTOLJ type=del size=290151: (2) No such file or directory 2024-09-14T11:15:20.743 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:20.744+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_OOUEM16XL80W.2~RF9GHE6WSHX9.0 size=1048576 2024-09-14T11:15:20.746 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:20.748+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_OOUEM16XL80W.2~RF9GHE6WSHX9.1 size=821030 2024-09-14T11:15:20.746 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:20.748+0000 7f76c1e8a8c0 1 > prepared multipart upload key=OOUEM16XL80W upload=RF9GHE6WSHX9 tag=XUHRUT95WRV1 type=write size=2918182 2024-09-14T11:15:20.749 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:20.752+0000 7f76c1e8a8c0 1 < completed delete operation key=Q5IY4J5FOD80 tag=I03QB8H472XH type=del 2024-09-14T11:15:20.754 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:20.756+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_R5I9H7WAK7Z7.2~6NN2R09KIH6B.0 size=531261 2024-09-14T11:15:20.754 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:20.756+0000 7f76c1e8a8c0 1 > prepared multipart upload key=R5I9H7WAK7Z7 upload=6NN2R09KIH6B tag=T11T710YXB4T type=write size=1579837 2024-09-14T11:15:20.759 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:20.760+0000 7f76c1e8a8c0 1 < suggested remove operation key=F3KFS0P1WM7W tag=8CSUKNKOYO54 type=del 2024-09-14T11:15:20.764 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:20.768+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_OUMUTEBQ1TD0.2~ON8RJC9BNLUN.0 size=1048576 2024-09-14T11:15:20.767 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:20.768+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_OUMUTEBQ1TD0.2~ON8RJC9BNLUN.1 size=340084 2024-09-14T11:15:20.767 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:20.768+0000 7f76c1e8a8c0 1 > prepared multipart upload key=OUMUTEBQ1TD0 upload=ON8RJC9BNLUN tag=HWTWYZR58S29 type=write size=2437236 2024-09-14T11:15:20.770 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:20.772+0000 7f76c1e8a8c0 1 < completed part key=_multipart_OOUEM16XL80W.2~Y8AV7UA4MYVP.0 size=541517 2024-09-14T11:15:20.774 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:20.776+0000 7f76c1e8a8c0 1 < completed multipart upload key=OOUEM16XL80W upload=Y8AV7UA4MYVP tag=Z275FTEQ2VC1 type=write size=1590093 2024-09-14T11:15:20.780 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:20.780+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_1W5733SDHGDN.2~39P9AIEIKIR3.0 size=416533 2024-09-14T11:15:20.780 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:20.780+0000 7f76c1e8a8c0 1 > prepared multipart upload key=1W5733SDHGDN upload=39P9AIEIKIR3 tag=LK9QB27P38L8 type=write size=1465109 2024-09-14T11:15:20.782 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:20.784+0000 7f76c1e8a8c0 1 < completed delete operation key=GAVZRU8ZLW7S tag=6HZMBVWA99BM type=del 2024-09-14T11:15:20.789 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:20.792+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_K9W031V6BFJP.2~MXDMSFIEVLA3.0 size=866952 2024-09-14T11:15:20.789 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:20.792+0000 7f76c1e8a8c0 1 > prepared multipart upload key=K9W031V6BFJP upload=MXDMSFIEVLA3 tag=BL1AIL4MAH0W type=write size=1915528 2024-09-14T11:15:20.792 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:20.792+0000 7f76c1e8a8c0 1 < completed delete operation key=H9CQV6L29SL5 tag=F9A3T38EXW81 type=del 2024-09-14T11:15:20.794 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:20.796+0000 7f76c1e8a8c0 1 > prepared operation key=LZ0YNFOVFYCL tag=J8HPQ2T57UT5 type=write size=124447 2024-09-14T11:15:20.797 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:20.800+0000 7f76c1e8a8c0 1 < completed part key=_multipart_W0MDRE9YO3UP.2~0W72KFV920YN.0 size=1048576 2024-09-14T11:15:20.798 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:20.800+0000 7f76c1e8a8c0 1 < completed part key=_multipart_W0MDRE9YO3UP.2~0W72KFV920YN.1 size=1048576 2024-09-14T11:15:20.800 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:20.804+0000 7f76c1e8a8c0 1 < completed part key=_multipart_W0MDRE9YO3UP.2~0W72KFV920YN.2 size=209123 2024-09-14T11:15:20.805 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:20.808+0000 7f76c1e8a8c0 1 < completed multipart upload key=W0MDRE9YO3UP upload=0W72KFV920YN tag=I9BRPE9LZRE5 type=write size=3354851 2024-09-14T11:15:20.807 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:20.808+0000 7f76c1e8a8c0 1 > prepared operation key=HS7T50JORDQJ tag=3XOBF2ML3V8S type=del size=3940229 2024-09-14T11:15:20.810 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:20.812+0000 7f76c1e8a8c0 1 < canceled operation key=85G6NT78HAWQ tag=5GWY0IY5CP5O type=del size=2833904 2024-09-14T11:15:20.814 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:20.816+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_15FU4CEGC22Q.2~6E0J4TW196JR.0 size=1048576 2024-09-14T11:15:20.816 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:20.816+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_15FU4CEGC22Q.2~6E0J4TW196JR.1 size=500149 2024-09-14T11:15:20.816 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:20.816+0000 7f76c1e8a8c0 1 > prepared multipart upload key=15FU4CEGC22Q upload=6E0J4TW196JR tag=BJRP5HP8LH33 type=write size=2597301 2024-09-14T11:15:20.818 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:20.820+0000 7f76c1e8a8c0 1 < completed delete operation key=S43U13LYETS4 tag=X19HJWXKEQMA type=del 2024-09-14T11:15:20.822 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:20.824+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_OUMUTEBQ1TD0.2~6RB5BT552W12.0 size=1048576 2024-09-14T11:15:20.824 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:20.828+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_OUMUTEBQ1TD0.2~6RB5BT552W12.1 size=442207 2024-09-14T11:15:20.824 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:20.828+0000 7f76c1e8a8c0 1 > prepared multipart upload key=OUMUTEBQ1TD0 upload=6RB5BT552W12 tag=B0Z47Y74A0EB type=write size=2539359 2024-09-14T11:15:20.826 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:20.828+0000 7f76c1e8a8c0 1 < completed write operation key=CIRQT9IDJ5OJ tag=NL98OG27ZQ4I type=write size=413991 2024-09-14T11:15:20.829 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:20.832+0000 7f76c1e8a8c0 1 > prepared operation key=8FFV9G6EQR8F tag=PJ7R1W8UC4PC type=del size=3480194 2024-09-14T11:15:20.832 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:20.832+0000 7f76c1e8a8c0 1 < completed part key=_multipart_MEVTZ7OAD4CA.2~QYQNQ41UB4YJ.0 size=1048576 2024-09-14T11:15:20.834 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:20.836+0000 7f76c1e8a8c0 1 < completed part key=_multipart_MEVTZ7OAD4CA.2~QYQNQ41UB4YJ.1 size=901719 2024-09-14T11:15:20.838 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:20.840+0000 7f76c1e8a8c0 1 < completed multipart upload key=MEVTZ7OAD4CA upload=QYQNQ41UB4YJ tag=BT329FJCJZVO type=write size=2998871 2024-09-14T11:15:20.840 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:20.844+0000 7f76c1e8a8c0 1 > prepared operation key=KS37ZO6MKAH9 tag=EB3DGMU4380U type=write size=576498 2024-09-14T11:15:20.843 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:20.844+0000 7f76c1e8a8c0 1 < completed part key=_multipart_SHKU2PRNREKK.2~F03E42EL2UUI.0 size=1048576 2024-09-14T11:15:20.845 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:20.848+0000 7f76c1e8a8c0 1 < completed part key=_multipart_SHKU2PRNREKK.2~F03E42EL2UUI.1 size=1048576 2024-09-14T11:15:20.845 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:20.848+0000 7f76c1e8a8c0 1 < canceled part key=_multipart_SHKU2PRNREKK.2~F03E42EL2UUI.2 size=259448 2024-09-14T11:15:20.849 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:20.852+0000 7f76c1e8a8c0 1 < canceled multipart upload key=SHKU2PRNREKK upload=F03E42EL2UUI tag=0RRKO5OKPNLH type=write size=3405176 2024-09-14T11:15:20.853 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:20.856+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_Q5IY4J5FOD80.2~DO8H7WVP7TZN.0 size=1048576 2024-09-14T11:15:20.855 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:20.856+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_Q5IY4J5FOD80.2~DO8H7WVP7TZN.1 size=1048576 2024-09-14T11:15:20.857 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:20.860+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_Q5IY4J5FOD80.2~DO8H7WVP7TZN.2 size=135256 2024-09-14T11:15:20.857 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:20.860+0000 7f76c1e8a8c0 1 > prepared multipart upload key=Q5IY4J5FOD80 upload=DO8H7WVP7TZN tag=U4C519DEQA5W type=write size=3280984 2024-09-14T11:15:20.859 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:20.860+0000 7f76c1e8a8c0 1 < completed delete operation key=Q5IY4J5FOD80 tag=BUP40864DO94 type=del 2024-09-14T11:15:20.861 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:20.864+0000 7f76c1e8a8c0 1 > prepared operation key=H9CQV6L29SL5 tag=FGP576R69ML6 type=write size=576923 2024-09-14T11:15:20.865 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:20.868+0000 7f76c1e8a8c0 1 < suggested remove operation key=K2EEZLRK7MVO tag=CJXSETYR6FG4 type=del 2024-09-14T11:15:20.869 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:20.872+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_8FFV9G6EQR8F.2~LHYZ50F7DKET.0 size=279315 2024-09-14T11:15:20.869 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:20.872+0000 7f76c1e8a8c0 1 > prepared multipart upload key=8FFV9G6EQR8F upload=LHYZ50F7DKET tag=VOFYF7JA0HOD type=write size=1327891 2024-09-14T11:15:20.871 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:20.872+0000 7f76c1e8a8c0 1 < completed delete operation key=8PZOVFEYYSOG tag=YPWTLMZOBKRT type=del 2024-09-14T11:15:20.873 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:20.876+0000 7f76c1e8a8c0 1 > prepared operation key=VI61O3K069BP tag=2DT8M6MUN55X type=del size=2656179 2024-09-14T11:15:20.876 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:20.876+0000 7f76c1e8a8c0 1 < completed delete operation key=HS7T50JORDQJ tag=BMPZ391ARN7E type=del 2024-09-14T11:15:20.878 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:20.880+0000 7f76c1e8a8c0 1 > prepared operation key=R5I9H7WAK7Z7 tag=A0LN3RUW6L2I type=del size=231139 2024-09-14T11:15:20.880 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:20.884+0000 7f76c1e8a8c0 1 < completed part key=_multipart_OOUEM16XL80W.2~RF9GHE6WSHX9.0 size=1048576 2024-09-14T11:15:20.882 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:20.884+0000 7f76c1e8a8c0 1 < completed part key=_multipart_OOUEM16XL80W.2~RF9GHE6WSHX9.1 size=821030 2024-09-14T11:15:20.886 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:20.888+0000 7f76c1e8a8c0 1 < completed multipart upload key=OOUEM16XL80W upload=RF9GHE6WSHX9 tag=XUHRUT95WRV1 type=write size=2918182 2024-09-14T11:15:20.888 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:20.892+0000 7f76c1e8a8c0 1 > prepared operation key=15FU4CEGC22Q tag=LASAN6U8KVE6 type=del size=2028921 2024-09-14T11:15:20.890 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:20.892+0000 7f76c1e8a8c0 1 < completed part key=_multipart_R5I9H7WAK7Z7.2~6NN2R09KIH6B.0 size=531261 2024-09-14T11:15:20.893 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:20.896+0000 7f76c1e8a8c0 1 < completed multipart upload key=R5I9H7WAK7Z7 upload=6NN2R09KIH6B tag=T11T710YXB4T type=write size=1579837 2024-09-14T11:15:20.895 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:20.896+0000 7f76c1e8a8c0 1 > prepared operation key=8PZOVFEYYSOG tag=I3J10JJXYMV3 type=write size=72062 2024-09-14T11:15:20.898 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:20.900+0000 7f76c1e8a8c0 1 < completed part key=_multipart_OUMUTEBQ1TD0.2~ON8RJC9BNLUN.0 size=1048576 2024-09-14T11:15:20.899 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:20.900+0000 7f76c1e8a8c0 1 < completed part key=_multipart_OUMUTEBQ1TD0.2~ON8RJC9BNLUN.1 size=340084 2024-09-14T11:15:20.903 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:20.904+0000 7f76c1e8a8c0 1 < completed multipart upload key=OUMUTEBQ1TD0 upload=ON8RJC9BNLUN tag=HWTWYZR58S29 type=write size=2437236 2024-09-14T11:15:20.907 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:20.908+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_TUFOZKTV9XIH.2~LLDUZTBFP0TG.0 size=1048576 2024-09-14T11:15:20.908 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:20.912+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_TUFOZKTV9XIH.2~LLDUZTBFP0TG.1 size=918557 2024-09-14T11:15:20.908 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:20.912+0000 7f76c1e8a8c0 1 > prepared multipart upload key=TUFOZKTV9XIH upload=LLDUZTBFP0TG tag=C9NO595SYMG1 type=write size=3015709 2024-09-14T11:15:20.911 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:20.912+0000 7f76c1e8a8c0 1 < completed part key=_multipart_1W5733SDHGDN.2~39P9AIEIKIR3.0 size=416533 2024-09-14T11:15:20.915 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:20.916+0000 7f76c1e8a8c0 1 < completed multipart upload key=1W5733SDHGDN upload=39P9AIEIKIR3 tag=LK9QB27P38L8 type=write size=1465109 2024-09-14T11:15:20.917 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:20.920+0000 7f76c1e8a8c0 1 > prepared operation key=8FFV9G6EQR8F tag=1TP1RQNAX9JF type=del size=1257021 2024-09-14T11:15:20.919 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:20.920+0000 7f76c1e8a8c0 1 < completed part key=_multipart_K9W031V6BFJP.2~MXDMSFIEVLA3.0 size=866952 2024-09-14T11:15:20.922 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:20.924+0000 7f76c1e8a8c0 1 < completed multipart upload key=K9W031V6BFJP upload=MXDMSFIEVLA3 tag=BL1AIL4MAH0W type=write size=1915528 2024-09-14T11:15:20.924 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:20.928+0000 7f76c1e8a8c0 1 > prepared operation key=KS37ZO6MKAH9 tag=FM6WBO5F40UI type=del size=3011326 2024-09-14T11:15:20.928 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:20.928+0000 7f76c1e8a8c0 1 < suggested update operation key=LZ0YNFOVFYCL tag=J8HPQ2T57UT5 type=write size=124447 2024-09-14T11:15:20.931 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:20.932+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_6TIJR323NMOH.2~TMZY0HPS0BIO.0 size=1048576 2024-09-14T11:15:20.933 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:20.936+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_6TIJR323NMOH.2~TMZY0HPS0BIO.1 size=989866 2024-09-14T11:15:20.933 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:20.936+0000 7f76c1e8a8c0 1 > prepared multipart upload key=6TIJR323NMOH upload=TMZY0HPS0BIO tag=BIE85JB404LL type=write size=3087018 2024-09-14T11:15:20.935 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:20.936+0000 7f76c1e8a8c0 1 < completed delete operation key=HS7T50JORDQJ tag=3XOBF2ML3V8S type=del 2024-09-14T11:15:20.937 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:20.940+0000 7f76c1e8a8c0 1 > prepared operation key=MEVTZ7OAD4CA tag=DFMH13TAAYTZ type=del size=427509 2024-09-14T11:15:20.939 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:20.940+0000 7f76c1e8a8c0 1 < completed part key=_multipart_15FU4CEGC22Q.2~6E0J4TW196JR.0 size=1048576 2024-09-14T11:15:20.940 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:20.944+0000 7f76c1e8a8c0 1 < completed part key=_multipart_15FU4CEGC22Q.2~6E0J4TW196JR.1 size=500149 2024-09-14T11:15:20.943 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:20.944+0000 7f76c1e8a8c0 1 < completed multipart upload key=15FU4CEGC22Q upload=6E0J4TW196JR tag=BJRP5HP8LH33 type=write size=2597301 2024-09-14T11:15:20.947 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:20.948+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_15FU4CEGC22Q.2~04VVKWRHFCL4.0 size=1048576 2024-09-14T11:15:20.948 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:20.952+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_15FU4CEGC22Q.2~04VVKWRHFCL4.1 size=778409 2024-09-14T11:15:20.949 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:20.952+0000 7f76c1e8a8c0 1 > prepared multipart upload key=15FU4CEGC22Q upload=04VVKWRHFCL4 tag=B7XCGI4J4M9Z type=write size=2875561 2024-09-14T11:15:20.950 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:20.952+0000 7f76c1e8a8c0 1 < completed part key=_multipart_OUMUTEBQ1TD0.2~6RB5BT552W12.0 size=1048576 2024-09-14T11:15:20.952 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:20.952+0000 7f76c1e8a8c0 1 < completed part key=_multipart_OUMUTEBQ1TD0.2~6RB5BT552W12.1 size=442207 2024-09-14T11:15:20.955 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:20.956+0000 7f76c1e8a8c0 1 < completed multipart upload key=OUMUTEBQ1TD0 upload=6RB5BT552W12 tag=B0Z47Y74A0EB type=write size=2539359 2024-09-14T11:15:20.957 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:20.960+0000 7f76c1e8a8c0 1 > prepared operation key=8FFV9G6EQR8F tag=M1S4WOG4QZD9 type=del size=1258435 2024-09-14T11:15:20.959 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:20.960+0000 7f76c1e8a8c0 1 < completed delete operation key=8FFV9G6EQR8F tag=PJ7R1W8UC4PC type=del 2024-09-14T11:15:20.961 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:20.964+0000 7f76c1e8a8c0 1 > prepared operation key=H9CQV6L29SL5 tag=NHAQCS2NVODO type=del size=1328637 2024-09-14T11:15:20.963 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:20.964+0000 7f76c1e8a8c0 1 < completed write operation key=KS37ZO6MKAH9 tag=EB3DGMU4380U type=write size=576498 2024-09-14T11:15:20.966 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:20.968+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_VI61O3K069BP.2~SS4ZBP335W20.0 size=575550 2024-09-14T11:15:20.966 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:20.968+0000 7f76c1e8a8c0 1 > prepared multipart upload key=VI61O3K069BP upload=SS4ZBP335W20 tag=XGUXWUKKS8EQ type=write size=1624126 2024-09-14T11:15:20.968 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:20.972+0000 7f76c1e8a8c0 1 < completed part key=_multipart_Q5IY4J5FOD80.2~DO8H7WVP7TZN.0 size=1048576 2024-09-14T11:15:20.970 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:20.972+0000 7f76c1e8a8c0 1 < completed part key=_multipart_Q5IY4J5FOD80.2~DO8H7WVP7TZN.1 size=1048576 2024-09-14T11:15:20.971 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:20.972+0000 7f76c1e8a8c0 1 < completed part key=_multipart_Q5IY4J5FOD80.2~DO8H7WVP7TZN.2 size=135256 2024-09-14T11:15:20.975 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:20.976+0000 7f76c1e8a8c0 1 < completed multipart upload key=Q5IY4J5FOD80 upload=DO8H7WVP7TZN tag=U4C519DEQA5W type=write size=3280984 2024-09-14T11:15:20.978 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:20.980+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_GAVZRU8ZLW7S.2~6XZHKKF297WN.0 size=1048576 2024-09-14T11:15:20.980 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:20.980+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_GAVZRU8ZLW7S.2~6XZHKKF297WN.1 size=1048576 2024-09-14T11:15:20.981 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:20.984+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_GAVZRU8ZLW7S.2~6XZHKKF297WN.2 size=718707 2024-09-14T11:15:20.981 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:20.984+0000 7f76c1e8a8c0 1 > prepared multipart upload key=GAVZRU8ZLW7S upload=6XZHKKF297WN tag=8O58VA6H49ZU type=write size=3864435 2024-09-14T11:15:20.986 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:20.988+0000 7f76c1e8a8c0 1 < completed write operation key=H9CQV6L29SL5 tag=FGP576R69ML6 type=write size=576923 2024-09-14T11:15:20.988 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:20.992+0000 7f76c1e8a8c0 1 > prepared operation key=SUNCRV0C1XYL tag=67A86JCCHZ9A type=del size=785484 2024-09-14T11:15:20.990 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:20.992+0000 7f76c1e8a8c0 1 < completed part key=_multipart_8FFV9G6EQR8F.2~LHYZ50F7DKET.0 size=279315 2024-09-14T11:15:20.993 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:20.996+0000 7f76c1e8a8c0 1 < completed multipart upload key=8FFV9G6EQR8F upload=LHYZ50F7DKET tag=VOFYF7JA0HOD type=write size=1327891 2024-09-14T11:15:20.998 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:21.000+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_GAVZRU8ZLW7S.2~S1FH0RPBSMXU.0 size=1048576 2024-09-14T11:15:20.999 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:21.000+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_GAVZRU8ZLW7S.2~S1FH0RPBSMXU.1 size=193001 2024-09-14T11:15:20.999 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:21.000+0000 7f76c1e8a8c0 1 > prepared multipart upload key=GAVZRU8ZLW7S upload=S1FH0RPBSMXU tag=WPFGX2OT2YGU type=write size=2290153 2024-09-14T11:15:21.001 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:21.004+0000 7f76c1e8a8c0 1 < completed delete operation key=VI61O3K069BP tag=2DT8M6MUN55X type=del 2024-09-14T11:15:21.003 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:21.004+0000 7f76c1e8a8c0 1 > prepared operation key=BOCIF4TL7X7J tag=OU6A609GIWFT type=write size=757979 2024-09-14T11:15:21.006 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:21.008+0000 7f76c1e8a8c0 1 < completed delete operation key=R5I9H7WAK7Z7 tag=A0LN3RUW6L2I type=del 2024-09-14T11:15:21.007 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:21.008+0000 7f76c1e8a8c0 1 > prepared operation key=H9CQV6L29SL5 tag=GPA2SU60MVD5 type=del size=3574076 2024-09-14T11:15:21.009 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:21.012+0000 7f76c1e8a8c0 1 < completed delete operation key=15FU4CEGC22Q tag=LASAN6U8KVE6 type=del 2024-09-14T11:15:21.013 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:21.016+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_LZ0YNFOVFYCL.2~ZI9SPI2F50DH.0 size=1048576 2024-09-14T11:15:21.014 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:21.016+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_LZ0YNFOVFYCL.2~ZI9SPI2F50DH.1 size=633452 2024-09-14T11:15:21.015 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:21.016+0000 7f76c1e8a8c0 1 > prepared multipart upload key=LZ0YNFOVFYCL upload=ZI9SPI2F50DH tag=Q0BAYZKYB3UY type=write size=2730604 2024-09-14T11:15:21.017 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:21.020+0000 7f76c1e8a8c0 1 < completed write operation key=8PZOVFEYYSOG tag=I3J10JJXYMV3 type=write size=72062 2024-09-14T11:15:21.019 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:21.020+0000 7f76c1e8a8c0 1 > prepared operation key=R5I9H7WAK7Z7 tag=TQVXY04ZHR3X type=del size=1319112 2024-09-14T11:15:21.021 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:21.024+0000 7f76c1e8a8c0 1 < completed part key=_multipart_TUFOZKTV9XIH.2~LLDUZTBFP0TG.0 size=1048576 2024-09-14T11:15:21.023 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:21.024+0000 7f76c1e8a8c0 1 < completed part key=_multipart_TUFOZKTV9XIH.2~LLDUZTBFP0TG.1 size=918557 2024-09-14T11:15:21.027 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:21.028+0000 7f76c1e8a8c0 1 < completed multipart upload key=TUFOZKTV9XIH upload=LLDUZTBFP0TG tag=C9NO595SYMG1 type=write size=3015709 2024-09-14T11:15:21.029 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:21.032+0000 7f76c1e8a8c0 1 > prepared operation key=F3KFS0P1WM7W tag=H4W0MK2F8KK2 type=del size=323369 2024-09-14T11:15:21.034 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:21.036+0000 7f76c1e8a8c0 1 < suggested remove operation key=8FFV9G6EQR8F tag=1TP1RQNAX9JF type=del 2024-09-14T11:15:21.038 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:21.040+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_BOCIF4TL7X7J.2~CS83UH2JAXCQ.0 size=1048576 2024-09-14T11:15:21.040 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:21.040+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_BOCIF4TL7X7J.2~CS83UH2JAXCQ.1 size=1048576 2024-09-14T11:15:21.041 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:21.044+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_BOCIF4TL7X7J.2~CS83UH2JAXCQ.2 size=769154 2024-09-14T11:15:21.041 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:21.044+0000 7f76c1e8a8c0 1 > prepared multipart upload key=BOCIF4TL7X7J upload=CS83UH2JAXCQ tag=QU2M3YVSWUTF type=write size=3914882 2024-09-14T11:15:21.043 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:21.044+0000 7f76c1e8a8c0 1 < completed delete operation key=KS37ZO6MKAH9 tag=FM6WBO5F40UI type=del 2024-09-14T11:15:21.047 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:21.048+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_GAVZRU8ZLW7S.2~PDVS7JGOFCO7.0 size=1048576 2024-09-14T11:15:21.049 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:21.052+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_GAVZRU8ZLW7S.2~PDVS7JGOFCO7.1 size=1048576 2024-09-14T11:15:21.050 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:21.052+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_GAVZRU8ZLW7S.2~PDVS7JGOFCO7.2 size=280063 2024-09-14T11:15:21.050 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:21.052+0000 7f76c1e8a8c0 1 > prepared multipart upload key=GAVZRU8ZLW7S upload=PDVS7JGOFCO7 tag=3V9GD8EQ99O0 type=write size=3425791 2024-09-14T11:15:21.052 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:21.056+0000 7f76c1e8a8c0 1 < completed part key=_multipart_6TIJR323NMOH.2~TMZY0HPS0BIO.0 size=1048576 2024-09-14T11:15:21.054 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:21.056+0000 7f76c1e8a8c0 1 < completed part key=_multipart_6TIJR323NMOH.2~TMZY0HPS0BIO.1 size=989866 2024-09-14T11:15:21.057 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:21.060+0000 7f76c1e8a8c0 1 < completed multipart upload key=6TIJR323NMOH upload=TMZY0HPS0BIO tag=BIE85JB404LL type=write size=3087018 2024-09-14T11:15:21.059 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:21.060+0000 7f76c1e8a8c0 1 > prepared operation key=F3KFS0P1WM7W tag=BYG9E65NP3IY type=del size=1908806 2024-09-14T11:15:21.061 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:21.064+0000 7f76c1e8a8c0 1 < completed delete operation key=MEVTZ7OAD4CA tag=DFMH13TAAYTZ type=del 2024-09-14T11:15:21.064 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:21.068+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_6TIJR323NMOH.2~FWUPT334TYCX.0 size=1048576 2024-09-14T11:15:21.066 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:21.068+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_6TIJR323NMOH.2~FWUPT334TYCX.1 size=1048576 2024-09-14T11:15:21.068 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:21.068+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_6TIJR323NMOH.2~FWUPT334TYCX.2 size=611103 2024-09-14T11:15:21.068 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:21.072+0000 7f76c1e8a8c0 1 > prepared multipart upload key=6TIJR323NMOH upload=FWUPT334TYCX tag=SMV1Q1GQBV5C type=write size=3756831 2024-09-14T11:15:21.070 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:21.072+0000 7f76c1e8a8c0 1 < completed part key=_multipart_15FU4CEGC22Q.2~04VVKWRHFCL4.0 size=1048576 2024-09-14T11:15:21.072 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:21.072+0000 7f76c1e8a8c0 1 < completed part key=_multipart_15FU4CEGC22Q.2~04VVKWRHFCL4.1 size=778409 2024-09-14T11:15:21.075 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:21.076+0000 7f76c1e8a8c0 1 < completed multipart upload key=15FU4CEGC22Q upload=04VVKWRHFCL4 tag=B7XCGI4J4M9Z type=write size=2875561 2024-09-14T11:15:21.079 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:21.080+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_1K8ESNXU6WDF.2~8WHKHL4UEY5Q.0 size=1048576 2024-09-14T11:15:21.081 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:21.084+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_1K8ESNXU6WDF.2~8WHKHL4UEY5Q.1 size=336566 2024-09-14T11:15:21.081 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:21.084+0000 7f76c1e8a8c0 1 > prepared multipart upload key=1K8ESNXU6WDF upload=8WHKHL4UEY5Q tag=EAIYUZCPR9LJ type=write size=2433718 2024-09-14T11:15:21.081 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:21.084+0000 7f76c1e8a8c0 -1 < no bi entry to suggest for operation key=8FFV9G6EQR8F tag=M1S4WOG4QZD9 type=del size=1258435: (2) No such file or directory 2024-09-14T11:15:21.085 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:21.088+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_BOCIF4TL7X7J.2~FLTQIGMI0850.0 size=1048576 2024-09-14T11:15:21.087 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:21.088+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_BOCIF4TL7X7J.2~FLTQIGMI0850.1 size=1048576 2024-09-14T11:15:21.089 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:21.092+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_BOCIF4TL7X7J.2~FLTQIGMI0850.2 size=73279 2024-09-14T11:15:21.089 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:21.092+0000 7f76c1e8a8c0 1 > prepared multipart upload key=BOCIF4TL7X7J upload=FLTQIGMI0850 tag=VXVILC5XMVKU type=write size=3219007 2024-09-14T11:15:21.091 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:21.092+0000 7f76c1e8a8c0 1 < completed delete operation key=H9CQV6L29SL5 tag=NHAQCS2NVODO type=del 2024-09-14T11:15:21.093 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:21.096+0000 7f76c1e8a8c0 1 > prepared operation key=W0MDRE9YO3UP tag=JI8KSQFIMBL6 type=del size=3026787 2024-09-14T11:15:21.095 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:21.096+0000 7f76c1e8a8c0 1 < completed part key=_multipart_VI61O3K069BP.2~SS4ZBP335W20.0 size=575550 2024-09-14T11:15:21.099 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:21.100+0000 7f76c1e8a8c0 1 < completed multipart upload key=VI61O3K069BP upload=SS4ZBP335W20 tag=XGUXWUKKS8EQ type=write size=1624126 2024-09-14T11:15:21.102 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:21.104+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_HS7T50JORDQJ.2~S3UAZ8C328A5.0 size=1048576 2024-09-14T11:15:21.104 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:21.108+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_HS7T50JORDQJ.2~S3UAZ8C328A5.1 size=1048576 2024-09-14T11:15:21.105 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:21.108+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_HS7T50JORDQJ.2~S3UAZ8C328A5.2 size=216438 2024-09-14T11:15:21.106 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:21.108+0000 7f76c1e8a8c0 1 > prepared multipart upload key=HS7T50JORDQJ upload=S3UAZ8C328A5 tag=BNFDQF9T2M9H type=write size=3362166 2024-09-14T11:15:21.108 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:21.108+0000 7f76c1e8a8c0 1 < completed part key=_multipart_GAVZRU8ZLW7S.2~6XZHKKF297WN.0 size=1048576 2024-09-14T11:15:21.108 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:21.108+0000 7f76c1e8a8c0 1 < canceled part key=_multipart_GAVZRU8ZLW7S.2~6XZHKKF297WN.1 size=1048576 2024-09-14T11:15:21.108 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:21.108+0000 7f76c1e8a8c0 1 < canceled part key=_multipart_GAVZRU8ZLW7S.2~6XZHKKF297WN.2 size=718707 2024-09-14T11:15:21.111 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:21.112+0000 7f76c1e8a8c0 1 < canceled multipart upload key=GAVZRU8ZLW7S upload=6XZHKKF297WN tag=8O58VA6H49ZU type=write size=3864435 2024-09-14T11:15:21.113 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:21.116+0000 7f76c1e8a8c0 1 > prepared operation key=85G6NT78HAWQ tag=FBDX1URB87BY type=del size=584917 2024-09-14T11:15:21.117 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:21.120+0000 7f76c1e8a8c0 1 < suggested remove operation key=SUNCRV0C1XYL tag=67A86JCCHZ9A type=del 2024-09-14T11:15:21.121 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:21.124+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_W0MDRE9YO3UP.2~8GDG94KS0E1U.0 size=1048576 2024-09-14T11:15:21.123 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:21.124+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_W0MDRE9YO3UP.2~8GDG94KS0E1U.1 size=1048576 2024-09-14T11:15:21.124 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:21.128+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_W0MDRE9YO3UP.2~8GDG94KS0E1U.2 size=704640 2024-09-14T11:15:21.124 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:21.128+0000 7f76c1e8a8c0 1 > prepared multipart upload key=W0MDRE9YO3UP upload=8GDG94KS0E1U tag=2J4FLHXV18TR type=write size=3850368 2024-09-14T11:15:21.126 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:21.128+0000 7f76c1e8a8c0 1 < completed part key=_multipart_GAVZRU8ZLW7S.2~S1FH0RPBSMXU.0 size=1048576 2024-09-14T11:15:21.128 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:21.132+0000 7f76c1e8a8c0 1 < completed part key=_multipart_GAVZRU8ZLW7S.2~S1FH0RPBSMXU.1 size=193001 2024-09-14T11:15:21.131 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:21.132+0000 7f76c1e8a8c0 1 < completed multipart upload key=GAVZRU8ZLW7S upload=S1FH0RPBSMXU tag=WPFGX2OT2YGU type=write size=2290153 2024-09-14T11:15:21.134 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:21.136+0000 7f76c1e8a8c0 1 > prepared operation key=MEVTZ7OAD4CA tag=OQ2LH1COB0K3 type=del size=280558 2024-09-14T11:15:21.136 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:21.140+0000 7f76c1e8a8c0 1 < canceled operation key=BOCIF4TL7X7J tag=OU6A609GIWFT type=write size=757979 2024-09-14T11:15:21.138 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:21.140+0000 7f76c1e8a8c0 1 > prepared operation key=R5I9H7WAK7Z7 tag=2NCWGYIEKWEJ type=del size=3366459 2024-09-14T11:15:21.140 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:21.144+0000 7f76c1e8a8c0 1 < completed delete operation key=H9CQV6L29SL5 tag=GPA2SU60MVD5 type=del 2024-09-14T11:15:21.143 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:21.144+0000 7f76c1e8a8c0 1 > prepared operation key=BOCIF4TL7X7J tag=BE1JE2VDN64C type=del size=3428060 2024-09-14T11:15:21.145 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:21.148+0000 7f76c1e8a8c0 1 < completed part key=_multipart_LZ0YNFOVFYCL.2~ZI9SPI2F50DH.0 size=1048576 2024-09-14T11:15:21.146 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:21.148+0000 7f76c1e8a8c0 1 < completed part key=_multipart_LZ0YNFOVFYCL.2~ZI9SPI2F50DH.1 size=633452 2024-09-14T11:15:21.150 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:21.152+0000 7f76c1e8a8c0 1 < completed multipart upload key=LZ0YNFOVFYCL upload=ZI9SPI2F50DH tag=Q0BAYZKYB3UY type=write size=2730604 2024-09-14T11:15:21.154 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:21.156+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_MEVTZ7OAD4CA.2~578URNPADZ10.0 size=1048576 2024-09-14T11:15:21.155 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:21.156+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_MEVTZ7OAD4CA.2~578URNPADZ10.1 size=775966 2024-09-14T11:15:21.155 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:21.156+0000 7f76c1e8a8c0 1 > prepared multipart upload key=MEVTZ7OAD4CA upload=578URNPADZ10 tag=YHA4E9HP3474 type=write size=2873118 2024-09-14T11:15:21.158 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:21.160+0000 7f76c1e8a8c0 1 < completed delete operation key=R5I9H7WAK7Z7 tag=TQVXY04ZHR3X type=del 2024-09-14T11:15:21.160 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:21.160+0000 7f76c1e8a8c0 1 > prepared operation key=OUMUTEBQ1TD0 tag=CUT5F3WFA5WQ type=del size=3619842 2024-09-14T11:15:21.162 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:21.164+0000 7f76c1e8a8c0 1 < completed delete operation key=F3KFS0P1WM7W tag=H4W0MK2F8KK2 type=del 2024-09-14T11:15:21.165 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:21.168+0000 7f76c1e8a8c0 1 > prepared operation key=LZ0YNFOVFYCL tag=B4ONO2BLNI1N type=del size=3942413 2024-09-14T11:15:21.167 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:21.168+0000 7f76c1e8a8c0 1 < completed part key=_multipart_BOCIF4TL7X7J.2~CS83UH2JAXCQ.0 size=1048576 2024-09-14T11:15:21.169 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:21.172+0000 7f76c1e8a8c0 1 < completed part key=_multipart_BOCIF4TL7X7J.2~CS83UH2JAXCQ.1 size=1048576 2024-09-14T11:15:21.171 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:21.172+0000 7f76c1e8a8c0 1 < completed part key=_multipart_BOCIF4TL7X7J.2~CS83UH2JAXCQ.2 size=769154 2024-09-14T11:15:21.175 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:21.176+0000 7f76c1e8a8c0 1 < completed multipart upload key=BOCIF4TL7X7J upload=CS83UH2JAXCQ tag=QU2M3YVSWUTF type=write size=3914882 2024-09-14T11:15:21.177 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:21.180+0000 7f76c1e8a8c0 1 > prepared operation key=HJ701768A6I7 tag=PN15E65HKWMB type=del size=33142 2024-09-14T11:15:21.182 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:21.184+0000 7f76c1e8a8c0 1 < completed part key=_multipart_GAVZRU8ZLW7S.2~PDVS7JGOFCO7.0 size=1048576 2024-09-14T11:15:21.184 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:21.184+0000 7f76c1e8a8c0 1 < completed part key=_multipart_GAVZRU8ZLW7S.2~PDVS7JGOFCO7.1 size=1048576 2024-09-14T11:15:21.185 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:21.188+0000 7f76c1e8a8c0 1 < completed part key=_multipart_GAVZRU8ZLW7S.2~PDVS7JGOFCO7.2 size=280063 2024-09-14T11:15:21.189 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:21.192+0000 7f76c1e8a8c0 1 < completed multipart upload key=GAVZRU8ZLW7S upload=PDVS7JGOFCO7 tag=3V9GD8EQ99O0 type=write size=3425791 2024-09-14T11:15:21.193 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:21.196+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_SHKU2PRNREKK.2~OH87SX6512Z6.0 size=1048576 2024-09-14T11:15:21.194 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:21.196+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_SHKU2PRNREKK.2~OH87SX6512Z6.1 size=123052 2024-09-14T11:15:21.195 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:21.196+0000 7f76c1e8a8c0 1 > prepared multipart upload key=SHKU2PRNREKK upload=OH87SX6512Z6 tag=3OZI9M39A3B7 type=write size=2220204 2024-09-14T11:15:21.198 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:21.200+0000 7f76c1e8a8c0 1 < suggested remove operation key=F3KFS0P1WM7W tag=BYG9E65NP3IY type=del 2024-09-14T11:15:21.200 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:21.204+0000 7f76c1e8a8c0 1 > prepared operation key=F3KFS0P1WM7W tag=AH61Y9C2H0J5 type=del size=1391640 2024-09-14T11:15:21.202 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:21.204+0000 7f76c1e8a8c0 1 < completed part key=_multipart_6TIJR323NMOH.2~FWUPT334TYCX.0 size=1048576 2024-09-14T11:15:21.204 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:21.208+0000 7f76c1e8a8c0 1 < completed part key=_multipart_6TIJR323NMOH.2~FWUPT334TYCX.1 size=1048576 2024-09-14T11:15:21.205 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:21.208+0000 7f76c1e8a8c0 1 < completed part key=_multipart_6TIJR323NMOH.2~FWUPT334TYCX.2 size=611103 2024-09-14T11:15:21.209 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:21.212+0000 7f76c1e8a8c0 1 < completed multipart upload key=6TIJR323NMOH upload=FWUPT334TYCX tag=SMV1Q1GQBV5C type=write size=3756831 2024-09-14T11:15:21.211 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:21.212+0000 7f76c1e8a8c0 1 > prepared operation key=OUMUTEBQ1TD0 tag=BKIJBOWHM3U9 type=del size=2250057 2024-09-14T11:15:21.213 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:21.216+0000 7f76c1e8a8c0 1 < completed part key=_multipart_1K8ESNXU6WDF.2~8WHKHL4UEY5Q.0 size=1048576 2024-09-14T11:15:21.215 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:21.216+0000 7f76c1e8a8c0 1 < completed part key=_multipart_1K8ESNXU6WDF.2~8WHKHL4UEY5Q.1 size=336566 2024-09-14T11:15:21.218 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:21.220+0000 7f76c1e8a8c0 1 < completed multipart upload key=1K8ESNXU6WDF upload=8WHKHL4UEY5Q tag=EAIYUZCPR9LJ type=write size=2433718 2024-09-14T11:15:21.220 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:21.224+0000 7f76c1e8a8c0 1 > prepared operation key=OOUEM16XL80W tag=BPMNSOSGLNHP type=del size=1268692 2024-09-14T11:15:21.223 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:21.224+0000 7f76c1e8a8c0 1 < completed part key=_multipart_BOCIF4TL7X7J.2~FLTQIGMI0850.0 size=1048576 2024-09-14T11:15:21.224 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:21.224+0000 7f76c1e8a8c0 1 < completed part key=_multipart_BOCIF4TL7X7J.2~FLTQIGMI0850.1 size=1048576 2024-09-14T11:15:21.225 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:21.228+0000 7f76c1e8a8c0 1 < completed part key=_multipart_BOCIF4TL7X7J.2~FLTQIGMI0850.2 size=73279 2024-09-14T11:15:21.229 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:21.232+0000 7f76c1e8a8c0 1 < completed multipart upload key=BOCIF4TL7X7J upload=FLTQIGMI0850 tag=VXVILC5XMVKU type=write size=3219007 2024-09-14T11:15:21.231 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:21.232+0000 7f76c1e8a8c0 1 > prepared operation key=VI61O3K069BP tag=PB1OIPC1EQOB type=del size=3543038 2024-09-14T11:15:21.234 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:21.236+0000 7f76c1e8a8c0 1 < completed delete operation key=W0MDRE9YO3UP tag=JI8KSQFIMBL6 type=del 2024-09-14T11:15:21.238 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:21.240+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_GZM0AQVHNCMM.2~TU6WUKBT9JHR.0 size=1048576 2024-09-14T11:15:21.239 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:21.240+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_GZM0AQVHNCMM.2~TU6WUKBT9JHR.1 size=1048576 2024-09-14T11:15:21.241 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:21.244+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_GZM0AQVHNCMM.2~TU6WUKBT9JHR.2 size=12003 2024-09-14T11:15:21.241 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:21.244+0000 7f76c1e8a8c0 1 > prepared multipart upload key=GZM0AQVHNCMM upload=TU6WUKBT9JHR tag=6K25TLTMZJ3S type=write size=3157731 2024-09-14T11:15:21.243 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:21.244+0000 7f76c1e8a8c0 1 < completed part key=_multipart_HS7T50JORDQJ.2~S3UAZ8C328A5.0 size=1048576 2024-09-14T11:15:21.245 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:21.248+0000 7f76c1e8a8c0 1 < completed part key=_multipart_HS7T50JORDQJ.2~S3UAZ8C328A5.1 size=1048576 2024-09-14T11:15:21.247 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:21.248+0000 7f76c1e8a8c0 1 < completed part key=_multipart_HS7T50JORDQJ.2~S3UAZ8C328A5.2 size=216438 2024-09-14T11:15:21.251 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:21.252+0000 7f76c1e8a8c0 1 < completed multipart upload key=HS7T50JORDQJ upload=S3UAZ8C328A5 tag=BNFDQF9T2M9H type=write size=3362166 2024-09-14T11:15:21.253 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:21.256+0000 7f76c1e8a8c0 1 > prepared operation key=15FU4CEGC22Q tag=WXT64FH97R1W type=del size=2824292 2024-09-14T11:15:21.258 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:21.260+0000 7f76c1e8a8c0 1 < suggested update operation key=85G6NT78HAWQ tag=FBDX1URB87BY type=del size=584917 2024-09-14T11:15:21.262 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:21.264+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_MEVTZ7OAD4CA.2~OQN78GUBR3MI.0 size=443492 2024-09-14T11:15:21.262 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:21.264+0000 7f76c1e8a8c0 1 > prepared multipart upload key=MEVTZ7OAD4CA upload=OQN78GUBR3MI tag=PWGTH2N0M017 type=write size=1492068 2024-09-14T11:15:21.264 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:21.268+0000 7f76c1e8a8c0 1 < completed part key=_multipart_W0MDRE9YO3UP.2~8GDG94KS0E1U.0 size=1048576 2024-09-14T11:15:21.264 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:21.268+0000 7f76c1e8a8c0 1 < canceled part key=_multipart_W0MDRE9YO3UP.2~8GDG94KS0E1U.1 size=1048576 2024-09-14T11:15:21.266 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:21.268+0000 7f76c1e8a8c0 1 < completed part key=_multipart_W0MDRE9YO3UP.2~8GDG94KS0E1U.2 size=704640 2024-09-14T11:15:21.270 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:21.272+0000 7f76c1e8a8c0 1 < canceled multipart upload key=W0MDRE9YO3UP upload=8GDG94KS0E1U tag=2J4FLHXV18TR type=write size=3850368 2024-09-14T11:15:21.272 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:21.276+0000 7f76c1e8a8c0 1 > prepared operation key=S43U13LYETS4 tag=2ML50DS1QOXK type=write size=329452 2024-09-14T11:15:21.274 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:21.276+0000 7f76c1e8a8c0 1 < completed delete operation key=MEVTZ7OAD4CA tag=OQ2LH1COB0K3 type=del 2024-09-14T11:15:21.277 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:21.280+0000 7f76c1e8a8c0 1 > prepared operation key=8PZOVFEYYSOG tag=D1XX9L22Y42H type=del size=2501610 2024-09-14T11:15:21.279 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:21.280+0000 7f76c1e8a8c0 1 < completed delete operation key=R5I9H7WAK7Z7 tag=2NCWGYIEKWEJ type=del 2024-09-14T11:15:21.284 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:21.284+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_15FU4CEGC22Q.2~4LTYS2QZ7W0G.0 size=1048576 2024-09-14T11:15:21.285 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:21.288+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_15FU4CEGC22Q.2~4LTYS2QZ7W0G.1 size=817221 2024-09-14T11:15:21.285 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:21.288+0000 7f76c1e8a8c0 1 > prepared multipart upload key=15FU4CEGC22Q upload=4LTYS2QZ7W0G tag=X7TEXQJ2TL0V type=write size=2914373 2024-09-14T11:15:21.287 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:21.288+0000 7f76c1e8a8c0 1 < completed delete operation key=BOCIF4TL7X7J tag=BE1JE2VDN64C type=del 2024-09-14T11:15:21.290 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:21.292+0000 7f76c1e8a8c0 1 > prepared operation key=85G6NT78HAWQ tag=K1JCSRHX2WX9 type=del size=1041157 2024-09-14T11:15:21.292 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:21.296+0000 7f76c1e8a8c0 1 < completed part key=_multipart_MEVTZ7OAD4CA.2~578URNPADZ10.0 size=1048576 2024-09-14T11:15:21.295 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:21.296+0000 7f76c1e8a8c0 1 < completed part key=_multipart_MEVTZ7OAD4CA.2~578URNPADZ10.1 size=775966 2024-09-14T11:15:21.300 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:21.300+0000 7f76c1e8a8c0 1 < completed multipart upload key=MEVTZ7OAD4CA upload=578URNPADZ10 tag=YHA4E9HP3474 type=write size=2873118 2024-09-14T11:15:21.303 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:21.304+0000 7f76c1e8a8c0 1 > prepared operation key=XC8VWSHZOPFP tag=KRWGZE0OS16I type=del size=822119 2024-09-14T11:15:21.306 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:21.308+0000 7f76c1e8a8c0 1 < completed delete operation key=OUMUTEBQ1TD0 tag=CUT5F3WFA5WQ type=del 2024-09-14T11:15:21.308 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:21.312+0000 7f76c1e8a8c0 1 > prepared operation key=1W5733SDHGDN tag=LM07ZWDNK22C type=del size=2122357 2024-09-14T11:15:21.311 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:21.312+0000 7f76c1e8a8c0 1 < completed delete operation key=LZ0YNFOVFYCL tag=B4ONO2BLNI1N type=del 2024-09-14T11:15:21.313 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:21.316+0000 7f76c1e8a8c0 1 > prepared operation key=F3KFS0P1WM7W tag=HPSONOF99TFY type=del size=1668556 2024-09-14T11:15:21.316 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:21.316+0000 7f76c1e8a8c0 1 < canceled operation key=HJ701768A6I7 tag=PN15E65HKWMB type=del size=33142 2024-09-14T11:15:21.319 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:21.320+0000 7f76c1e8a8c0 1 > prepared operation key=8PZOVFEYYSOG tag=FX7Y24CHHHG9 type=del size=4060023 2024-09-14T11:15:21.321 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:21.324+0000 7f76c1e8a8c0 1 < completed part key=_multipart_SHKU2PRNREKK.2~OH87SX6512Z6.0 size=1048576 2024-09-14T11:15:21.321 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:21.324+0000 7f76c1e8a8c0 1 < canceled part key=_multipart_SHKU2PRNREKK.2~OH87SX6512Z6.1 size=123052 2024-09-14T11:15:21.325 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:21.328+0000 7f76c1e8a8c0 1 < canceled multipart upload key=SHKU2PRNREKK upload=OH87SX6512Z6 tag=3OZI9M39A3B7 type=write size=2220204 2024-09-14T11:15:21.331 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:21.332+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_MEVTZ7OAD4CA.2~HDGRCBNFI6CS.0 size=1048576 2024-09-14T11:15:21.333 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:21.336+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_MEVTZ7OAD4CA.2~HDGRCBNFI6CS.1 size=1048576 2024-09-14T11:15:21.335 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:21.336+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_MEVTZ7OAD4CA.2~HDGRCBNFI6CS.2 size=197199 2024-09-14T11:15:21.335 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:21.336+0000 7f76c1e8a8c0 1 > prepared multipart upload key=MEVTZ7OAD4CA upload=HDGRCBNFI6CS tag=LRC4EK316P43 type=write size=3342927 2024-09-14T11:15:21.341 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:21.344+0000 7f76c1e8a8c0 1 < suggested remove operation key=F3KFS0P1WM7W tag=AH61Y9C2H0J5 type=del 2024-09-14T11:15:21.343 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:21.344+0000 7f76c1e8a8c0 1 > prepared operation key=F3KFS0P1WM7W tag=74RSS015SN0W type=write size=9022 2024-09-14T11:15:21.346 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:21.348+0000 7f76c1e8a8c0 1 < canceled operation key=OUMUTEBQ1TD0 tag=BKIJBOWHM3U9 type=del size=2250057 2024-09-14T11:15:21.351 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:21.352+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_HJ701768A6I7.2~XT7CUC6RQA62.0 size=1048576 2024-09-14T11:15:21.353 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:21.356+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_HJ701768A6I7.2~XT7CUC6RQA62.1 size=1048576 2024-09-14T11:15:21.355 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:21.356+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_HJ701768A6I7.2~XT7CUC6RQA62.2 size=914087 2024-09-14T11:15:21.355 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:21.356+0000 7f76c1e8a8c0 1 > prepared multipart upload key=HJ701768A6I7 upload=XT7CUC6RQA62 tag=OURBHK9VFMPV type=write size=4059815 2024-09-14T11:15:21.358 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:21.360+0000 7f76c1e8a8c0 1 < completed delete operation key=OOUEM16XL80W tag=BPMNSOSGLNHP type=del 2024-09-14T11:15:21.361 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:21.364+0000 7f76c1e8a8c0 1 > prepared operation key=SHKU2PRNREKK tag=U6V5PV6EWVPW type=del size=956025 2024-09-14T11:15:21.364 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:21.364+0000 7f76c1e8a8c0 1 < completed delete operation key=VI61O3K069BP tag=PB1OIPC1EQOB type=del 2024-09-14T11:15:21.367 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:21.368+0000 7f76c1e8a8c0 1 > prepared operation key=SHKU2PRNREKK tag=C3VAQHJRPD1V type=del size=139755 2024-09-14T11:15:21.370 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:21.372+0000 7f76c1e8a8c0 1 < completed part key=_multipart_GZM0AQVHNCMM.2~TU6WUKBT9JHR.0 size=1048576 2024-09-14T11:15:21.372 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:21.372+0000 7f76c1e8a8c0 1 < completed part key=_multipart_GZM0AQVHNCMM.2~TU6WUKBT9JHR.1 size=1048576 2024-09-14T11:15:21.374 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:21.376+0000 7f76c1e8a8c0 1 < completed part key=_multipart_GZM0AQVHNCMM.2~TU6WUKBT9JHR.2 size=12003 2024-09-14T11:15:21.378 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:21.380+0000 7f76c1e8a8c0 1 < completed multipart upload key=GZM0AQVHNCMM upload=TU6WUKBT9JHR tag=6K25TLTMZJ3S type=write size=3157731 2024-09-14T11:15:21.381 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:21.384+0000 7f76c1e8a8c0 1 > prepared operation key=SHKU2PRNREKK tag=QU1AXMW564GH type=del size=1039510 2024-09-14T11:15:21.387 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:21.388+0000 7f76c1e8a8c0 1 < suggested remove operation key=15FU4CEGC22Q tag=WXT64FH97R1W type=del 2024-09-14T11:15:21.389 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:21.392+0000 7f76c1e8a8c0 1 > prepared operation key=HS7T50JORDQJ tag=Y9KC9B3IMQRX type=del size=3107669 2024-09-14T11:15:21.392 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:21.392+0000 7f76c1e8a8c0 1 < completed part key=_multipart_MEVTZ7OAD4CA.2~OQN78GUBR3MI.0 size=443492 2024-09-14T11:15:21.395 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:21.396+0000 7f76c1e8a8c0 1 < completed multipart upload key=MEVTZ7OAD4CA upload=OQN78GUBR3MI tag=PWGTH2N0M017 type=write size=1492068 2024-09-14T11:15:21.399 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:21.400+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_HJ701768A6I7.2~DA1ZR5BP2Y1B.0 size=1048576 2024-09-14T11:15:21.404 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:21.404+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_HJ701768A6I7.2~DA1ZR5BP2Y1B.1 size=1048576 2024-09-14T11:15:21.406 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:21.408+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_HJ701768A6I7.2~DA1ZR5BP2Y1B.2 size=185968 2024-09-14T11:15:21.406 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:21.408+0000 7f76c1e8a8c0 1 > prepared multipart upload key=HJ701768A6I7 upload=DA1ZR5BP2Y1B tag=ET1FXABA2R2P type=write size=3331696 2024-09-14T11:15:21.408 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:21.412+0000 7f76c1e8a8c0 1 < completed write operation key=S43U13LYETS4 tag=2ML50DS1QOXK type=write size=329452 2024-09-14T11:15:21.411 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:21.412+0000 7f76c1e8a8c0 1 > prepared operation key=S43U13LYETS4 tag=VYC73HNBYI63 type=del size=795216 2024-09-14T11:15:21.416 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:21.420+0000 7f76c1e8a8c0 1 < suggested remove operation key=8PZOVFEYYSOG tag=D1XX9L22Y42H type=del 2024-09-14T11:15:21.421 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:21.424+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_8PZOVFEYYSOG.2~JC3C4SR3OLAE.0 size=331007 2024-09-14T11:15:21.421 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:21.424+0000 7f76c1e8a8c0 1 > prepared multipart upload key=8PZOVFEYYSOG upload=JC3C4SR3OLAE tag=O724D3H43HBN type=write size=1379583 2024-09-14T11:15:21.423 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:21.424+0000 7f76c1e8a8c0 1 < completed part key=_multipart_15FU4CEGC22Q.2~4LTYS2QZ7W0G.0 size=1048576 2024-09-14T11:15:21.425 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:21.428+0000 7f76c1e8a8c0 1 < completed part key=_multipart_15FU4CEGC22Q.2~4LTYS2QZ7W0G.1 size=817221 2024-09-14T11:15:21.430 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:21.432+0000 7f76c1e8a8c0 1 < completed multipart upload key=15FU4CEGC22Q upload=4LTYS2QZ7W0G tag=X7TEXQJ2TL0V type=write size=2914373 2024-09-14T11:15:21.435 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:21.436+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_XC8VWSHZOPFP.2~ENBVZ8WKOLZ7.0 size=943943 2024-09-14T11:15:21.435 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:21.436+0000 7f76c1e8a8c0 1 > prepared multipart upload key=XC8VWSHZOPFP upload=ENBVZ8WKOLZ7 tag=V2N54UX9O1LN type=write size=1992519 2024-09-14T11:15:21.437 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:21.440+0000 7f76c1e8a8c0 1 < completed delete operation key=85G6NT78HAWQ tag=K1JCSRHX2WX9 type=del 2024-09-14T11:15:21.442 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:21.444+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_OOUEM16XL80W.2~GJKROI9S5KH5.0 size=983756 2024-09-14T11:15:21.442 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:21.444+0000 7f76c1e8a8c0 1 > prepared multipart upload key=OOUEM16XL80W upload=GJKROI9S5KH5 tag=Y3YI1DKF4UOX type=write size=2032332 2024-09-14T11:15:21.445 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:21.448+0000 7f76c1e8a8c0 1 < completed delete operation key=XC8VWSHZOPFP tag=KRWGZE0OS16I type=del 2024-09-14T11:15:21.448 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:21.448+0000 7f76c1e8a8c0 1 > prepared operation key=F3KFS0P1WM7W tag=DD8FNPWT5G3X type=write size=260989 2024-09-14T11:15:21.450 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:21.452+0000 7f76c1e8a8c0 1 < completed delete operation key=1W5733SDHGDN tag=LM07ZWDNK22C type=del 2024-09-14T11:15:21.453 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:21.456+0000 7f76c1e8a8c0 1 > prepared operation key=K2EEZLRK7MVO tag=WP24U4NSU0JP type=del size=518665 2024-09-14T11:15:21.458 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:21.460+0000 7f76c1e8a8c0 1 < suggested remove operation key=F3KFS0P1WM7W tag=HPSONOF99TFY type=del 2024-09-14T11:15:21.461 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:21.464+0000 7f76c1e8a8c0 1 > prepared operation key=1K8ESNXU6WDF tag=E92Z0F753P56 type=del size=2693737 2024-09-14T11:15:21.464 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:21.464+0000 7f76c1e8a8c0 -1 < failed to complete operation key=8PZOVFEYYSOG tag=FX7Y24CHHHG9 type=del size=4060023: (22) Invalid argument 2024-09-14T11:15:21.468 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:21.472+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_1K8ESNXU6WDF.2~USLWW06RHLD4.0 size=519261 2024-09-14T11:15:21.468 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:21.472+0000 7f76c1e8a8c0 1 > prepared multipart upload key=1K8ESNXU6WDF upload=USLWW06RHLD4 tag=91LF488F5SPX type=write size=1567837 2024-09-14T11:15:21.471 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:21.472+0000 7f76c1e8a8c0 1 < completed part key=_multipart_MEVTZ7OAD4CA.2~HDGRCBNFI6CS.0 size=1048576 2024-09-14T11:15:21.473 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:21.476+0000 7f76c1e8a8c0 1 < completed part key=_multipart_MEVTZ7OAD4CA.2~HDGRCBNFI6CS.1 size=1048576 2024-09-14T11:15:21.475 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:21.476+0000 7f76c1e8a8c0 1 < completed part key=_multipart_MEVTZ7OAD4CA.2~HDGRCBNFI6CS.2 size=197199 2024-09-14T11:15:21.479 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:21.480+0000 7f76c1e8a8c0 1 < completed multipart upload key=MEVTZ7OAD4CA upload=HDGRCBNFI6CS tag=LRC4EK316P43 type=write size=3342927 2024-09-14T11:15:21.482 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:21.484+0000 7f76c1e8a8c0 1 > prepared operation key=GZM0AQVHNCMM tag=GEYF13VS4DD2 type=del size=1448203 2024-09-14T11:15:21.485 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:21.488+0000 7f76c1e8a8c0 -1 < failed to complete operation key=F3KFS0P1WM7W tag=74RSS015SN0W type=write size=9022: (22) Invalid argument 2024-09-14T11:15:21.488 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:21.488+0000 7f76c1e8a8c0 1 > prepared operation key=F3KFS0P1WM7W tag=C0MJ1QOMFLZV type=del size=1155873 2024-09-14T11:15:21.490 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:21.492+0000 7f76c1e8a8c0 1 < completed part key=_multipart_HJ701768A6I7.2~XT7CUC6RQA62.0 size=1048576 2024-09-14T11:15:21.493 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:21.496+0000 7f76c1e8a8c0 1 < completed part key=_multipart_HJ701768A6I7.2~XT7CUC6RQA62.1 size=1048576 2024-09-14T11:15:21.495 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:21.496+0000 7f76c1e8a8c0 1 < completed part key=_multipart_HJ701768A6I7.2~XT7CUC6RQA62.2 size=914087 2024-09-14T11:15:21.500 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:21.504+0000 7f76c1e8a8c0 1 < completed multipart upload key=HJ701768A6I7 upload=XT7CUC6RQA62 tag=OURBHK9VFMPV type=write size=4059815 2024-09-14T11:15:21.503 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:21.504+0000 7f76c1e8a8c0 1 > prepared operation key=XC8VWSHZOPFP tag=R2ZF6U1ED2UH type=write size=849485 2024-09-14T11:15:21.506 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:21.508+0000 7f76c1e8a8c0 1 < completed delete operation key=SHKU2PRNREKK tag=U6V5PV6EWVPW type=del 2024-09-14T11:15:21.509 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:21.512+0000 7f76c1e8a8c0 1 > prepared operation key=8PZOVFEYYSOG tag=6COTRTTUICHR type=del size=3803924 2024-09-14T11:15:21.512 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:21.512+0000 7f76c1e8a8c0 1 < completed delete operation key=SHKU2PRNREKK tag=C3VAQHJRPD1V type=del 2024-09-14T11:15:21.515 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:21.516+0000 7f76c1e8a8c0 1 > prepared operation key=1W5733SDHGDN tag=H0MLOWLRMBUS type=del size=1761776 2024-09-14T11:15:21.518 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:21.520+0000 7f76c1e8a8c0 1 < completed delete operation key=SHKU2PRNREKK tag=QU1AXMW564GH type=del 2024-09-14T11:15:21.521 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:21.524+0000 7f76c1e8a8c0 1 > prepared operation key=TZO40K6J9877 tag=7WW2MRS2544O type=del size=3706154 2024-09-14T11:15:21.524 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:21.528+0000 7f76c1e8a8c0 1 < completed delete operation key=HS7T50JORDQJ tag=Y9KC9B3IMQRX type=del 2024-09-14T11:15:21.528 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:21.528+0000 7f76c1e8a8c0 1 > prepared operation key=HJ701768A6I7 tag=6KZG11I03R2B type=del size=535013 2024-09-14T11:15:21.531 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:21.532+0000 7f76c1e8a8c0 1 < completed part key=_multipart_HJ701768A6I7.2~DA1ZR5BP2Y1B.0 size=1048576 2024-09-14T11:15:21.534 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:21.536+0000 7f76c1e8a8c0 1 < completed part key=_multipart_HJ701768A6I7.2~DA1ZR5BP2Y1B.1 size=1048576 2024-09-14T11:15:21.534 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:21.536+0000 7f76c1e8a8c0 1 < canceled part key=_multipart_HJ701768A6I7.2~DA1ZR5BP2Y1B.2 size=185968 2024-09-14T11:15:21.539 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:21.540+0000 7f76c1e8a8c0 1 < canceled multipart upload key=HJ701768A6I7 upload=DA1ZR5BP2Y1B tag=ET1FXABA2R2P type=write size=3331696 2024-09-14T11:15:21.542 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:21.544+0000 7f76c1e8a8c0 1 > prepared operation key=6TIJR323NMOH tag=JKIZNVN3ZBK5 type=del size=2005095 2024-09-14T11:15:21.545 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:21.548+0000 7f76c1e8a8c0 1 < completed delete operation key=S43U13LYETS4 tag=VYC73HNBYI63 type=del 2024-09-14T11:15:21.548 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:21.552+0000 7f76c1e8a8c0 1 > prepared operation key=W0MDRE9YO3UP tag=YTD5MJSS6TWD type=del size=2621942 2024-09-14T11:15:21.551 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:21.552+0000 7f76c1e8a8c0 1 < completed part key=_multipart_8PZOVFEYYSOG.2~JC3C4SR3OLAE.0 size=331007 2024-09-14T11:15:21.556 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:21.556+0000 7f76c1e8a8c0 1 < completed multipart upload key=8PZOVFEYYSOG upload=JC3C4SR3OLAE tag=O724D3H43HBN type=write size=1379583 2024-09-14T11:15:21.559 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:21.560+0000 7f76c1e8a8c0 1 > prepared operation key=LZ0YNFOVFYCL tag=RJ0S00WP97FG type=del size=932208 2024-09-14T11:15:21.561 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:21.564+0000 7f76c1e8a8c0 1 < completed part key=_multipart_XC8VWSHZOPFP.2~ENBVZ8WKOLZ7.0 size=943943 2024-09-14T11:15:21.566 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:21.568+0000 7f76c1e8a8c0 1 < completed multipart upload key=XC8VWSHZOPFP upload=ENBVZ8WKOLZ7 tag=V2N54UX9O1LN type=write size=1992519 2024-09-14T11:15:21.569 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:21.572+0000 7f76c1e8a8c0 1 > prepared operation key=KS37ZO6MKAH9 tag=Q8X35CH2UEEO type=del size=1965490 2024-09-14T11:15:21.572 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:21.572+0000 7f76c1e8a8c0 1 < completed part key=_multipart_OOUEM16XL80W.2~GJKROI9S5KH5.0 size=983756 2024-09-14T11:15:21.577 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:21.580+0000 7f76c1e8a8c0 1 < completed multipart upload key=OOUEM16XL80W upload=GJKROI9S5KH5 tag=Y3YI1DKF4UOX type=write size=2032332 2024-09-14T11:15:21.579 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:21.580+0000 7f76c1e8a8c0 1 > prepared operation key=1W5733SDHGDN tag=2OS3DMKFR3YF type=del size=1884581 2024-09-14T11:15:21.582 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:21.584+0000 7f76c1e8a8c0 -1 < failed to complete operation key=F3KFS0P1WM7W tag=DD8FNPWT5G3X type=write size=260989: (22) Invalid argument 2024-09-14T11:15:21.585 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:21.588+0000 7f76c1e8a8c0 1 > prepared operation key=1K8ESNXU6WDF tag=CGRYDLMZ597T type=del size=2817248 2024-09-14T11:15:21.588 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:21.592+0000 7f76c1e8a8c0 1 < completed delete operation key=K2EEZLRK7MVO tag=WP24U4NSU0JP type=del 2024-09-14T11:15:21.591 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:21.592+0000 7f76c1e8a8c0 1 > prepared operation key=TUFOZKTV9XIH tag=XA64W095PJKK type=del size=1970795 2024-09-14T11:15:21.593 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:21.596+0000 7f76c1e8a8c0 1 < completed delete operation key=1K8ESNXU6WDF tag=E92Z0F753P56 type=del 2024-09-14T11:15:21.596 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:21.600+0000 7f76c1e8a8c0 1 > prepared operation key=F3KFS0P1WM7W tag=GB296CY7926R type=del size=1335411 2024-09-14T11:15:21.599 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:21.600+0000 7f76c1e8a8c0 1 < completed part key=_multipart_1K8ESNXU6WDF.2~USLWW06RHLD4.0 size=519261 2024-09-14T11:15:21.604 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:21.608+0000 7f76c1e8a8c0 1 < completed multipart upload key=1K8ESNXU6WDF upload=USLWW06RHLD4 tag=91LF488F5SPX type=write size=1567837 2024-09-14T11:15:21.607 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:21.608+0000 7f76c1e8a8c0 1 > prepared operation key=MEVTZ7OAD4CA tag=X0C4ZGJN1VVV type=del size=3979379 2024-09-14T11:15:21.610 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:21.612+0000 7f76c1e8a8c0 1 < completed delete operation key=GZM0AQVHNCMM tag=GEYF13VS4DD2 type=del 2024-09-14T11:15:21.613 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:21.616+0000 7f76c1e8a8c0 1 > prepared operation key=TUFOZKTV9XIH tag=OV8SS90EXL2W type=del size=187646 2024-09-14T11:15:21.616 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:21.616+0000 7f76c1e8a8c0 1 < completed delete operation key=F3KFS0P1WM7W tag=C0MJ1QOMFLZV type=del 2024-09-14T11:15:21.619 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:21.620+0000 7f76c1e8a8c0 1 > prepared operation key=R5I9H7WAK7Z7 tag=UW20LWBC82FA type=del size=2545207 2024-09-14T11:15:21.622 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:21.624+0000 7f76c1e8a8c0 1 < completed write operation key=XC8VWSHZOPFP tag=R2ZF6U1ED2UH type=write size=849485 2024-09-14T11:15:21.625 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:21.628+0000 7f76c1e8a8c0 1 > prepared operation key=LZ0YNFOVFYCL tag=3S9SQRIC5Y1O type=del size=104862 2024-09-14T11:15:21.627 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:21.628+0000 7f76c1e8a8c0 1 < completed delete operation key=8PZOVFEYYSOG tag=6COTRTTUICHR type=del 2024-09-14T11:15:21.630 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:21.632+0000 7f76c1e8a8c0 1 > prepared operation key=W0MDRE9YO3UP tag=UKVQF5EXD0KC type=del size=34979 2024-09-14T11:15:21.633 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:21.636+0000 7f76c1e8a8c0 1 < completed delete operation key=1W5733SDHGDN tag=H0MLOWLRMBUS type=del 2024-09-14T11:15:21.636 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:21.640+0000 7f76c1e8a8c0 1 > prepared operation key=F3KFS0P1WM7W tag=N4038LEQZEX8 type=del size=1800870 2024-09-14T11:15:21.642 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:21.644+0000 7f76c1e8a8c0 1 < suggested update operation key=TZO40K6J9877 tag=7WW2MRS2544O type=del size=3706154 2024-09-14T11:15:21.648 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:21.648+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_TZO40K6J9877.2~91ESAA7YLQ20.0 size=448806 2024-09-14T11:15:21.648 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:21.648+0000 7f76c1e8a8c0 1 > prepared multipart upload key=TZO40K6J9877 upload=91ESAA7YLQ20 tag=LZ6K7A0R8P3F type=write size=1497382 2024-09-14T11:15:21.651 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:21.652+0000 7f76c1e8a8c0 1 < completed delete operation key=HJ701768A6I7 tag=6KZG11I03R2B type=del 2024-09-14T11:15:21.657 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:21.660+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_TZO40K6J9877.2~6LCADNULGRNY.0 size=1048576 2024-09-14T11:15:21.659 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:21.660+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_TZO40K6J9877.2~6LCADNULGRNY.1 size=151721 2024-09-14T11:15:21.660 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:21.660+0000 7f76c1e8a8c0 1 > prepared multipart upload key=TZO40K6J9877 upload=6LCADNULGRNY tag=VRPDTGBK8KCQ type=write size=2248873 2024-09-14T11:15:21.663 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:21.664+0000 7f76c1e8a8c0 1 < completed delete operation key=6TIJR323NMOH tag=JKIZNVN3ZBK5 type=del 2024-09-14T11:15:21.669 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:21.672+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_1W5733SDHGDN.2~1L1FZ7TEKLH8.0 size=231953 2024-09-14T11:15:21.669 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:21.672+0000 7f76c1e8a8c0 1 > prepared multipart upload key=1W5733SDHGDN upload=1L1FZ7TEKLH8 tag=TISLC0FSVFMO type=write size=1280529 2024-09-14T11:15:21.679 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:21.680+0000 7f76c1e8a8c0 1 < suggested update operation key=W0MDRE9YO3UP tag=YTD5MJSS6TWD type=del size=2621942 2024-09-14T11:15:21.682 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:21.684+0000 7f76c1e8a8c0 1 > prepared operation key=HJ701768A6I7 tag=50TQ0EZF2107 type=del size=2170964 2024-09-14T11:15:21.688 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:21.692+0000 7f76c1e8a8c0 1 < suggested remove operation key=LZ0YNFOVFYCL tag=RJ0S00WP97FG type=del 2024-09-14T11:15:21.692 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:21.692+0000 7f76c1e8a8c0 1 > prepared operation key=15FU4CEGC22Q tag=XLC3ZR92UDCX type=del size=340275 2024-09-14T11:15:21.696 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:21.700+0000 7f76c1e8a8c0 1 < completed delete operation key=KS37ZO6MKAH9 tag=Q8X35CH2UEEO type=del 2024-09-14T11:15:21.701 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:21.704+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_85G6NT78HAWQ.2~9MBRVHHYTUO1.0 size=1048576 2024-09-14T11:15:21.703 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:21.704+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_85G6NT78HAWQ.2~9MBRVHHYTUO1.1 size=837687 2024-09-14T11:15:21.704 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:21.704+0000 7f76c1e8a8c0 1 > prepared multipart upload key=85G6NT78HAWQ upload=9MBRVHHYTUO1 tag=1G90HP07JLHO type=write size=2934839 2024-09-14T11:15:21.708 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:21.712+0000 7f76c1e8a8c0 1 < suggested remove operation key=1W5733SDHGDN tag=2OS3DMKFR3YF type=del 2024-09-14T11:15:21.714 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:21.716+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_OOUEM16XL80W.2~EFCQVPP27IDN.0 size=359286 2024-09-14T11:15:21.714 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:21.716+0000 7f76c1e8a8c0 1 > prepared multipart upload key=OOUEM16XL80W upload=EFCQVPP27IDN tag=EQ6ZP44HNBI4 type=write size=1407862 2024-09-14T11:15:21.717 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:21.720+0000 7f76c1e8a8c0 1 < completed delete operation key=1K8ESNXU6WDF tag=CGRYDLMZ597T type=del 2024-09-14T11:15:21.720 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:21.720+0000 7f76c1e8a8c0 1 > prepared operation key=F3KFS0P1WM7W tag=S0L0SZ4HX07J type=del size=1503101 2024-09-14T11:15:21.723 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:21.724+0000 7f76c1e8a8c0 1 < completed delete operation key=TUFOZKTV9XIH tag=XA64W095PJKK type=del 2024-09-14T11:15:21.725 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:21.728+0000 7f76c1e8a8c0 1 > prepared operation key=SHKU2PRNREKK tag=YPM5E9OP4Y9M type=del size=2135397 2024-09-14T11:15:21.728 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:21.732+0000 7f76c1e8a8c0 1 < canceled operation key=F3KFS0P1WM7W tag=GB296CY7926R type=del size=1335411 2024-09-14T11:15:21.731 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:21.732+0000 7f76c1e8a8c0 1 > prepared operation key=GZM0AQVHNCMM tag=QE4YTF8FWVFM type=del size=1113643 2024-09-14T11:15:21.734 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:21.736+0000 7f76c1e8a8c0 1 < completed delete operation key=MEVTZ7OAD4CA tag=X0C4ZGJN1VVV type=del 2024-09-14T11:15:21.739 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:21.740+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_1K8ESNXU6WDF.2~FRB6KW61H27H.0 size=1048576 2024-09-14T11:15:21.742 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:21.744+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_1K8ESNXU6WDF.2~FRB6KW61H27H.1 size=493145 2024-09-14T11:15:21.742 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:21.744+0000 7f76c1e8a8c0 1 > prepared multipart upload key=1K8ESNXU6WDF upload=FRB6KW61H27H tag=R2TH4MFGTWD6 type=write size=2590297 2024-09-14T11:15:21.745 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:21.748+0000 7f76c1e8a8c0 1 < completed delete operation key=TUFOZKTV9XIH tag=OV8SS90EXL2W type=del 2024-09-14T11:15:21.748 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:21.748+0000 7f76c1e8a8c0 1 > prepared operation key=H9CQV6L29SL5 tag=BA0GYG4235CM type=del size=3286759 2024-09-14T11:15:21.751 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:21.752+0000 7f76c1e8a8c0 1 < completed delete operation key=R5I9H7WAK7Z7 tag=UW20LWBC82FA type=del 2024-09-14T11:15:21.754 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:21.756+0000 7f76c1e8a8c0 1 > prepared operation key=SHKU2PRNREKK tag=H82YZ39R0MPC type=write size=27108 2024-09-14T11:15:21.757 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:21.760+0000 7f76c1e8a8c0 -1 < failed to complete operation key=LZ0YNFOVFYCL tag=3S9SQRIC5Y1O type=del size=104862: (22) Invalid argument 2024-09-14T11:15:21.760 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:21.764+0000 7f76c1e8a8c0 1 > prepared operation key=S43U13LYETS4 tag=1TGU3Y3DOQP0 type=write size=363607 2024-09-14T11:15:21.766 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:21.768+0000 7f76c1e8a8c0 1 < suggested update operation key=W0MDRE9YO3UP tag=UKVQF5EXD0KC type=del size=34979 2024-09-14T11:15:21.768 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:21.772+0000 7f76c1e8a8c0 1 > prepared operation key=SUNCRV0C1XYL tag=7SPVATUEUMLS type=write size=108980 2024-09-14T11:15:21.771 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:21.772+0000 7f76c1e8a8c0 1 < completed delete operation key=F3KFS0P1WM7W tag=N4038LEQZEX8 type=del 2024-09-14T11:15:21.774 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:21.776+0000 7f76c1e8a8c0 1 > prepared operation key=BOCIF4TL7X7J tag=G105F7XDT9RP type=write size=788724 2024-09-14T11:15:21.777 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:21.780+0000 7f76c1e8a8c0 1 < completed part key=_multipart_TZO40K6J9877.2~91ESAA7YLQ20.0 size=448806 2024-09-14T11:15:21.781 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:21.784+0000 7f76c1e8a8c0 1 < completed multipart upload key=TZO40K6J9877 upload=91ESAA7YLQ20 tag=LZ6K7A0R8P3F type=write size=1497382 2024-09-14T11:15:21.784 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:21.788+0000 7f76c1e8a8c0 1 > prepared operation key=8FFV9G6EQR8F tag=J0J1WJSP0JYC type=del size=243345 2024-09-14T11:15:21.787 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:21.788+0000 7f76c1e8a8c0 1 < completed part key=_multipart_TZO40K6J9877.2~6LCADNULGRNY.0 size=1048576 2024-09-14T11:15:21.790 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:21.792+0000 7f76c1e8a8c0 1 < completed part key=_multipart_TZO40K6J9877.2~6LCADNULGRNY.1 size=151721 2024-09-14T11:15:21.794 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:21.796+0000 7f76c1e8a8c0 1 < completed multipart upload key=TZO40K6J9877 upload=6LCADNULGRNY tag=VRPDTGBK8KCQ type=write size=2248873 2024-09-14T11:15:21.797 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:21.800+0000 7f76c1e8a8c0 1 > prepared operation key=SUNCRV0C1XYL tag=2812VEVTM7SH type=del size=2779164 2024-09-14T11:15:21.799 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:21.800+0000 7f76c1e8a8c0 1 < completed part key=_multipart_1W5733SDHGDN.2~1L1FZ7TEKLH8.0 size=231953 2024-09-14T11:15:21.804 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:21.808+0000 7f76c1e8a8c0 1 < completed multipart upload key=1W5733SDHGDN upload=1L1FZ7TEKLH8 tag=TISLC0FSVFMO type=write size=1280529 2024-09-14T11:15:21.807 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:21.808+0000 7f76c1e8a8c0 1 > prepared operation key=OUMUTEBQ1TD0 tag=WEIMM9AMAG26 type=write size=645877 2024-09-14T11:15:21.810 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:21.812+0000 7f76c1e8a8c0 1 < canceled operation key=HJ701768A6I7 tag=50TQ0EZF2107 type=del size=2170964 2024-09-14T11:15:21.814 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:21.816+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_SUNCRV0C1XYL.2~6ZUYFNTDLK1H.0 size=1048576 2024-09-14T11:15:21.816 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:21.820+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_SUNCRV0C1XYL.2~6ZUYFNTDLK1H.1 size=1048576 2024-09-14T11:15:21.818 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:21.820+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_SUNCRV0C1XYL.2~6ZUYFNTDLK1H.2 size=363427 2024-09-14T11:15:21.818 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:21.820+0000 7f76c1e8a8c0 1 > prepared multipart upload key=SUNCRV0C1XYL upload=6ZUYFNTDLK1H tag=02212S0J7KKZ type=write size=3509155 2024-09-14T11:15:21.820 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:21.824+0000 7f76c1e8a8c0 1 < canceled operation key=15FU4CEGC22Q tag=XLC3ZR92UDCX type=del size=340275 2024-09-14T11:15:21.823 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:21.824+0000 7f76c1e8a8c0 1 > prepared operation key=GAVZRU8ZLW7S tag=A1YLJBDIJLZ5 type=write size=155230 2024-09-14T11:15:21.825 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:21.828+0000 7f76c1e8a8c0 1 < completed part key=_multipart_85G6NT78HAWQ.2~9MBRVHHYTUO1.0 size=1048576 2024-09-14T11:15:21.827 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:21.828+0000 7f76c1e8a8c0 1 < completed part key=_multipart_85G6NT78HAWQ.2~9MBRVHHYTUO1.1 size=837687 2024-09-14T11:15:21.831 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:21.832+0000 7f76c1e8a8c0 1 < completed multipart upload key=85G6NT78HAWQ upload=9MBRVHHYTUO1 tag=1G90HP07JLHO type=write size=2934839 2024-09-14T11:15:21.835 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:21.836+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_Q5IY4J5FOD80.2~9DW5PAY3OU1P.0 size=676153 2024-09-14T11:15:21.835 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:21.836+0000 7f76c1e8a8c0 1 > prepared multipart upload key=Q5IY4J5FOD80 upload=9DW5PAY3OU1P tag=MJJP51ET1OSW type=write size=1724729 2024-09-14T11:15:21.837 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:21.840+0000 7f76c1e8a8c0 1 < completed part key=_multipart_OOUEM16XL80W.2~EFCQVPP27IDN.0 size=359286 2024-09-14T11:15:21.841 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:21.844+0000 7f76c1e8a8c0 1 < completed multipart upload key=OOUEM16XL80W upload=EFCQVPP27IDN tag=EQ6ZP44HNBI4 type=write size=1407862 2024-09-14T11:15:21.843 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:21.844+0000 7f76c1e8a8c0 1 > prepared operation key=BOCIF4TL7X7J tag=B3QK7JIVQIZ4 type=del size=951350 2024-09-14T11:15:21.846 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:21.848+0000 7f76c1e8a8c0 1 < completed delete operation key=F3KFS0P1WM7W tag=S0L0SZ4HX07J type=del 2024-09-14T11:15:21.848 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:21.852+0000 7f76c1e8a8c0 1 > prepared operation key=SUNCRV0C1XYL tag=IKSWABOP82WH type=del size=2481639 2024-09-14T11:15:21.851 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:21.852+0000 7f76c1e8a8c0 1 < completed delete operation key=SHKU2PRNREKK tag=YPM5E9OP4Y9M type=del 2024-09-14T11:15:21.857 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:21.860+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_HJ701768A6I7.2~38D51C55KGL3.0 size=86974 2024-09-14T11:15:21.857 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:21.860+0000 7f76c1e8a8c0 1 > prepared multipart upload key=HJ701768A6I7 upload=38D51C55KGL3 tag=ZB6S4Q2BJKGB type=write size=1135550 2024-09-14T11:15:21.860 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:21.864+0000 7f76c1e8a8c0 1 < completed delete operation key=GZM0AQVHNCMM tag=QE4YTF8FWVFM type=del 2024-09-14T11:15:21.866 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:21.868+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_R5I9H7WAK7Z7.2~4DA185MM5EH8.0 size=587880 2024-09-14T11:15:21.866 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:21.868+0000 7f76c1e8a8c0 1 > prepared multipart upload key=R5I9H7WAK7Z7 upload=4DA185MM5EH8 tag=QTMOIGV62DDR type=write size=1636456 2024-09-14T11:15:21.869 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:21.872+0000 7f76c1e8a8c0 1 < completed part key=_multipart_1K8ESNXU6WDF.2~FRB6KW61H27H.0 size=1048576 2024-09-14T11:15:21.869 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:21.872+0000 7f76c1e8a8c0 1 < canceled part key=_multipart_1K8ESNXU6WDF.2~FRB6KW61H27H.1 size=493145 2024-09-14T11:15:21.874 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:21.876+0000 7f76c1e8a8c0 1 < canceled multipart upload key=1K8ESNXU6WDF upload=FRB6KW61H27H tag=R2TH4MFGTWD6 type=write size=2590297 2024-09-14T11:15:21.879 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:21.880+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_SUNCRV0C1XYL.2~D8VOQW241ISX.0 size=875569 2024-09-14T11:15:21.879 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:21.880+0000 7f76c1e8a8c0 1 > prepared multipart upload key=SUNCRV0C1XYL upload=D8VOQW241ISX tag=QM41LMT7SUNI type=write size=1924145 2024-09-14T11:15:21.884 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:21.888+0000 7f76c1e8a8c0 1 < suggested update operation key=H9CQV6L29SL5 tag=BA0GYG4235CM type=del size=3286759 2024-09-14T11:15:21.887 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:21.888+0000 7f76c1e8a8c0 1 > prepared operation key=GZM0AQVHNCMM tag=1NKTM3KG5W1T type=del size=1947867 2024-09-14T11:15:21.890 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:21.892+0000 7f76c1e8a8c0 1 < canceled operation key=SHKU2PRNREKK tag=H82YZ39R0MPC type=write size=27108 2024-09-14T11:15:21.895 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:21.896+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_TZO40K6J9877.2~JRRRFCIRI574.0 size=537517 2024-09-14T11:15:21.895 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:21.896+0000 7f76c1e8a8c0 1 > prepared multipart upload key=TZO40K6J9877 upload=JRRRFCIRI574 tag=FDQIEYX50J7U type=write size=1586093 2024-09-14T11:15:21.901 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:21.904+0000 7f76c1e8a8c0 1 < suggested remove operation key=S43U13LYETS4 tag=1TGU3Y3DOQP0 type=write 2024-09-14T11:15:21.907 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:21.908+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_OUMUTEBQ1TD0.2~71YUIDVLW50M.0 size=1048576 2024-09-14T11:15:21.909 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:21.912+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_OUMUTEBQ1TD0.2~71YUIDVLW50M.1 size=1048576 2024-09-14T11:15:21.912 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:21.912+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_OUMUTEBQ1TD0.2~71YUIDVLW50M.2 size=97738 2024-09-14T11:15:21.912 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:21.912+0000 7f76c1e8a8c0 1 > prepared multipart upload key=OUMUTEBQ1TD0 upload=71YUIDVLW50M tag=6RPKAC6KZDN7 type=write size=3243466 2024-09-14T11:15:21.915 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:21.916+0000 7f76c1e8a8c0 1 < completed write operation key=SUNCRV0C1XYL tag=7SPVATUEUMLS type=write size=108980 2024-09-14T11:15:21.919 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:21.920+0000 7f76c1e8a8c0 1 > prepared operation key=BOCIF4TL7X7J tag=B724RHLSUOUT type=del size=3713375 2024-09-14T11:15:21.921 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:21.924+0000 7f76c1e8a8c0 1 < completed write operation key=BOCIF4TL7X7J tag=G105F7XDT9RP type=write size=788724 2024-09-14T11:15:21.926 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:21.928+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_R5I9H7WAK7Z7.2~1Z69SWMGEJ2I.0 size=1048576 2024-09-14T11:15:21.928 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:21.932+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_R5I9H7WAK7Z7.2~1Z69SWMGEJ2I.1 size=435705 2024-09-14T11:15:21.928 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:21.932+0000 7f76c1e8a8c0 1 > prepared multipart upload key=R5I9H7WAK7Z7 upload=1Z69SWMGEJ2I tag=WCLYJET6Y7PX type=write size=2532857 2024-09-14T11:15:21.930 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:21.932+0000 7f76c1e8a8c0 1 < completed delete operation key=8FFV9G6EQR8F tag=J0J1WJSP0JYC type=del 2024-09-14T11:15:21.933 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:21.936+0000 7f76c1e8a8c0 1 > prepared operation key=6TIJR323NMOH tag=DNRK2GPVI3NL type=del size=2203421 2024-09-14T11:15:21.935 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:21.936+0000 7f76c1e8a8c0 1 < canceled operation key=SUNCRV0C1XYL tag=2812VEVTM7SH type=del size=2779164 2024-09-14T11:15:21.938 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:21.940+0000 7f76c1e8a8c0 1 > prepared operation key=SHKU2PRNREKK tag=QKEOIVSWOZSF type=del size=2632030 2024-09-14T11:15:21.945 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:21.948+0000 7f76c1e8a8c0 1 < suggested remove operation key=OUMUTEBQ1TD0 tag=WEIMM9AMAG26 type=write 2024-09-14T11:15:21.949 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:21.952+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_CIRQT9IDJ5OJ.2~RTSOPKI31WF4.0 size=1048576 2024-09-14T11:15:21.951 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:21.952+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_CIRQT9IDJ5OJ.2~RTSOPKI31WF4.1 size=862148 2024-09-14T11:15:21.951 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:21.952+0000 7f76c1e8a8c0 1 > prepared multipart upload key=CIRQT9IDJ5OJ upload=RTSOPKI31WF4 tag=RSBBOH5X8RF1 type=write size=2959300 2024-09-14T11:15:21.952 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:21.952+0000 7f76c1e8a8c0 1 < canceled part key=_multipart_SUNCRV0C1XYL.2~6ZUYFNTDLK1H.0 size=1048576 2024-09-14T11:15:21.954 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:21.956+0000 7f76c1e8a8c0 1 < completed part key=_multipart_SUNCRV0C1XYL.2~6ZUYFNTDLK1H.1 size=1048576 2024-09-14T11:15:21.955 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:21.956+0000 7f76c1e8a8c0 1 < completed part key=_multipart_SUNCRV0C1XYL.2~6ZUYFNTDLK1H.2 size=363427 2024-09-14T11:15:21.959 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:21.960+0000 7f76c1e8a8c0 1 < canceled multipart upload key=SUNCRV0C1XYL upload=6ZUYFNTDLK1H tag=02212S0J7KKZ type=write size=3509155 2024-09-14T11:15:21.961 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:21.964+0000 7f76c1e8a8c0 1 > prepared operation key=85G6NT78HAWQ tag=XE1EJUM0SB2Y type=del size=220576 2024-09-14T11:15:21.966 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:21.968+0000 7f76c1e8a8c0 1 < suggested update operation key=GAVZRU8ZLW7S tag=A1YLJBDIJLZ5 type=write size=155230 2024-09-14T11:15:21.968 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:21.972+0000 7f76c1e8a8c0 1 > prepared operation key=K2EEZLRK7MVO tag=C7G80U0E2GSU type=del size=2808532 2024-09-14T11:15:21.969 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:21.972+0000 7f76c1e8a8c0 1 < canceled part key=_multipart_Q5IY4J5FOD80.2~9DW5PAY3OU1P.0 size=676153 2024-09-14T11:15:21.973 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:21.976+0000 7f76c1e8a8c0 1 < canceled multipart upload key=Q5IY4J5FOD80 upload=9DW5PAY3OU1P tag=MJJP51ET1OSW type=write size=1724729 2024-09-14T11:15:21.978 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:21.980+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_8PZOVFEYYSOG.2~312KHTO05978.0 size=1048576 2024-09-14T11:15:21.980 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:21.984+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_8PZOVFEYYSOG.2~312KHTO05978.1 size=932908 2024-09-14T11:15:21.980 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:21.984+0000 7f76c1e8a8c0 1 > prepared multipart upload key=8PZOVFEYYSOG upload=312KHTO05978 tag=XT55L04P1O4I type=write size=3030060 2024-09-14T11:15:21.983 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:21.984+0000 7f76c1e8a8c0 1 < canceled operation key=BOCIF4TL7X7J tag=B3QK7JIVQIZ4 type=del size=951350 2024-09-14T11:15:21.988 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:21.988+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_H9CQV6L29SL5.2~RXM3FSU8UU94.0 size=1048576 2024-09-14T11:15:21.990 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:21.992+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_H9CQV6L29SL5.2~RXM3FSU8UU94.1 size=1048576 2024-09-14T11:15:21.992 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:21.992+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_H9CQV6L29SL5.2~RXM3FSU8UU94.2 size=282746 2024-09-14T11:15:21.992 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:21.992+0000 7f76c1e8a8c0 1 > prepared multipart upload key=H9CQV6L29SL5 upload=RXM3FSU8UU94 tag=NHCD4CKNBT5V type=write size=3428474 2024-09-14T11:15:21.994 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:21.996+0000 7f76c1e8a8c0 1 < completed delete operation key=SUNCRV0C1XYL tag=IKSWABOP82WH type=del 2024-09-14T11:15:21.999 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:22.000+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_8PZOVFEYYSOG.2~UECHEZLELTDG.0 size=1048576 2024-09-14T11:15:22.001 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:22.004+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_8PZOVFEYYSOG.2~UECHEZLELTDG.1 size=1048576 2024-09-14T11:15:22.003 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:22.004+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_8PZOVFEYYSOG.2~UECHEZLELTDG.2 size=132855 2024-09-14T11:15:22.003 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:22.004+0000 7f76c1e8a8c0 1 > prepared multipart upload key=8PZOVFEYYSOG upload=UECHEZLELTDG tag=QUTW8V1TXEFK type=write size=3278583 2024-09-14T11:15:22.006 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:22.008+0000 7f76c1e8a8c0 1 < completed part key=_multipart_HJ701768A6I7.2~38D51C55KGL3.0 size=86974 2024-09-14T11:15:22.010 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:22.012+0000 7f76c1e8a8c0 1 < completed multipart upload key=HJ701768A6I7 upload=38D51C55KGL3 tag=ZB6S4Q2BJKGB type=write size=1135550 2024-09-14T11:15:22.012 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:22.016+0000 7f76c1e8a8c0 1 > prepared operation key=KS37ZO6MKAH9 tag=JD8BCYACVKM0 type=del size=551474 2024-09-14T11:15:22.015 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:22.016+0000 7f76c1e8a8c0 1 < completed part key=_multipart_R5I9H7WAK7Z7.2~4DA185MM5EH8.0 size=587880 2024-09-14T11:15:22.019 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:22.020+0000 7f76c1e8a8c0 1 < completed multipart upload key=R5I9H7WAK7Z7 upload=4DA185MM5EH8 tag=QTMOIGV62DDR type=write size=1636456 2024-09-14T11:15:22.021 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:22.024+0000 7f76c1e8a8c0 1 > prepared operation key=BOCIF4TL7X7J tag=0JFVQDDL0LJA type=del size=1412211 2024-09-14T11:15:22.024 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:22.028+0000 7f76c1e8a8c0 1 < completed part key=_multipart_SUNCRV0C1XYL.2~D8VOQW241ISX.0 size=875569 2024-09-14T11:15:22.028 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:22.032+0000 7f76c1e8a8c0 1 < completed multipart upload key=SUNCRV0C1XYL upload=D8VOQW241ISX tag=QM41LMT7SUNI type=write size=1924145 2024-09-14T11:15:22.030 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:22.032+0000 7f76c1e8a8c0 1 > prepared operation key=GZM0AQVHNCMM tag=H5EIDCMXUUYI type=del size=4125528 2024-09-14T11:15:22.035 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:22.036+0000 7f76c1e8a8c0 1 < suggested update operation key=GZM0AQVHNCMM tag=1NKTM3KG5W1T type=del size=1947867 2024-09-14T11:15:22.038 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:22.040+0000 7f76c1e8a8c0 1 > prepared operation key=S43U13LYETS4 tag=0O5VKW5O77R2 type=del size=1550834 2024-09-14T11:15:22.040 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:22.044+0000 7f76c1e8a8c0 1 < completed part key=_multipart_TZO40K6J9877.2~JRRRFCIRI574.0 size=537517 2024-09-14T11:15:22.044 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:22.044+0000 7f76c1e8a8c0 1 < completed multipart upload key=TZO40K6J9877 upload=JRRRFCIRI574 tag=FDQIEYX50J7U type=write size=1586093 2024-09-14T11:15:22.049 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:22.052+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_8FFV9G6EQR8F.2~B0AXUPAL4CX1.0 size=590735 2024-09-14T11:15:22.049 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:22.052+0000 7f76c1e8a8c0 1 > prepared multipart upload key=8FFV9G6EQR8F upload=B0AXUPAL4CX1 tag=8S9311GBK26U type=write size=1639311 2024-09-14T11:15:22.049 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:22.052+0000 7f76c1e8a8c0 1 < canceled part key=_multipart_OUMUTEBQ1TD0.2~71YUIDVLW50M.0 size=1048576 2024-09-14T11:15:22.052 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:22.052+0000 7f76c1e8a8c0 1 < completed part key=_multipart_OUMUTEBQ1TD0.2~71YUIDVLW50M.1 size=1048576 2024-09-14T11:15:22.054 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:22.056+0000 7f76c1e8a8c0 1 < completed part key=_multipart_OUMUTEBQ1TD0.2~71YUIDVLW50M.2 size=97738 2024-09-14T11:15:22.059 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:22.060+0000 7f76c1e8a8c0 1 < canceled multipart upload key=OUMUTEBQ1TD0 upload=71YUIDVLW50M tag=6RPKAC6KZDN7 type=write size=3243466 2024-09-14T11:15:22.062 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:22.064+0000 7f76c1e8a8c0 1 > prepared operation key=TZO40K6J9877 tag=K1ZXULGWKETI type=del size=3308186 2024-09-14T11:15:22.065 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:22.068+0000 7f76c1e8a8c0 1 < completed delete operation key=BOCIF4TL7X7J tag=B724RHLSUOUT type=del 2024-09-14T11:15:22.070 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:22.072+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_85G6NT78HAWQ.2~S1SYF7K1BXSE.0 size=1048576 2024-09-14T11:15:22.072 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:22.076+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_85G6NT78HAWQ.2~S1SYF7K1BXSE.1 size=1048576 2024-09-14T11:15:22.075 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:22.076+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_85G6NT78HAWQ.2~S1SYF7K1BXSE.2 size=365732 2024-09-14T11:15:22.075 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:22.076+0000 7f76c1e8a8c0 1 > prepared multipart upload key=85G6NT78HAWQ upload=S1SYF7K1BXSE tag=84AKSHKB4FIU type=write size=3511460 2024-09-14T11:15:22.078 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:22.080+0000 7f76c1e8a8c0 1 < completed part key=_multipart_R5I9H7WAK7Z7.2~1Z69SWMGEJ2I.0 size=1048576 2024-09-14T11:15:22.080 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:22.084+0000 7f76c1e8a8c0 1 < completed part key=_multipart_R5I9H7WAK7Z7.2~1Z69SWMGEJ2I.1 size=435705 2024-09-14T11:15:22.085 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:22.088+0000 7f76c1e8a8c0 1 < completed multipart upload key=R5I9H7WAK7Z7 upload=1Z69SWMGEJ2I tag=WCLYJET6Y7PX type=write size=2532857 2024-09-14T11:15:22.088 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:22.092+0000 7f76c1e8a8c0 1 > prepared operation key=XC8VWSHZOPFP tag=QKCIEQ659232 type=write size=930361 2024-09-14T11:15:22.091 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:22.092+0000 7f76c1e8a8c0 1 < completed delete operation key=6TIJR323NMOH tag=DNRK2GPVI3NL type=del 2024-09-14T11:15:22.096 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:22.100+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_SUNCRV0C1XYL.2~33INDMG8G8V1.0 size=1048576 2024-09-14T11:15:22.099 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:22.100+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_SUNCRV0C1XYL.2~33INDMG8G8V1.1 size=746267 2024-09-14T11:15:22.099 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:22.100+0000 7f76c1e8a8c0 1 > prepared multipart upload key=SUNCRV0C1XYL upload=33INDMG8G8V1 tag=XJKQL7NFN8YD type=write size=2843419 2024-09-14T11:15:22.102 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:22.104+0000 7f76c1e8a8c0 1 < completed delete operation key=SHKU2PRNREKK tag=QKEOIVSWOZSF type=del 2024-09-14T11:15:22.108 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:22.112+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_Q5IY4J5FOD80.2~H319ZA1NQNMD.0 size=1048576 2024-09-14T11:15:22.111 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:22.112+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_Q5IY4J5FOD80.2~H319ZA1NQNMD.1 size=747815 2024-09-14T11:15:22.111 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:22.112+0000 7f76c1e8a8c0 1 > prepared multipart upload key=Q5IY4J5FOD80 upload=H319ZA1NQNMD tag=NBH292F4UTDF type=write size=2844967 2024-09-14T11:15:22.114 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:22.116+0000 7f76c1e8a8c0 1 < completed part key=_multipart_CIRQT9IDJ5OJ.2~RTSOPKI31WF4.0 size=1048576 2024-09-14T11:15:22.114 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:22.116+0000 7f76c1e8a8c0 1 < canceled part key=_multipart_CIRQT9IDJ5OJ.2~RTSOPKI31WF4.1 size=862148 2024-09-14T11:15:22.120 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:22.120+0000 7f76c1e8a8c0 1 < canceled multipart upload key=CIRQT9IDJ5OJ upload=RTSOPKI31WF4 tag=RSBBOH5X8RF1 type=write size=2959300 2024-09-14T11:15:22.123 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:22.124+0000 7f76c1e8a8c0 1 > prepared operation key=1K8ESNXU6WDF tag=JB7P2HZYSFLO type=del size=1037233 2024-09-14T11:15:22.129 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:22.132+0000 7f76c1e8a8c0 1 < suggested update operation key=85G6NT78HAWQ tag=XE1EJUM0SB2Y type=del size=220576 2024-09-14T11:15:22.133 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:22.136+0000 7f76c1e8a8c0 1 > prepared operation key=LZ0YNFOVFYCL tag=KID1SQ0KALIT type=del size=3424154 2024-09-14T11:15:22.140 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:22.140+0000 7f76c1e8a8c0 1 < suggested update operation key=K2EEZLRK7MVO tag=C7G80U0E2GSU type=del size=2808532 2024-09-14T11:15:22.145 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:22.148+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_TUFOZKTV9XIH.2~CAZYAW7LB9OI.0 size=1048576 2024-09-14T11:15:22.148 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:22.148+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_TUFOZKTV9XIH.2~CAZYAW7LB9OI.1 size=1048576 2024-09-14T11:15:22.150 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:22.152+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_TUFOZKTV9XIH.2~CAZYAW7LB9OI.2 size=388951 2024-09-14T11:15:22.150 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:22.152+0000 7f76c1e8a8c0 1 > prepared multipart upload key=TUFOZKTV9XIH upload=CAZYAW7LB9OI tag=PM5GLU7471XE type=write size=3534679 2024-09-14T11:15:22.153 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:22.156+0000 7f76c1e8a8c0 1 < completed part key=_multipart_8PZOVFEYYSOG.2~312KHTO05978.0 size=1048576 2024-09-14T11:15:22.156 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:22.156+0000 7f76c1e8a8c0 1 < completed part key=_multipart_8PZOVFEYYSOG.2~312KHTO05978.1 size=932908 2024-09-14T11:15:22.161 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:22.164+0000 7f76c1e8a8c0 1 < completed multipart upload key=8PZOVFEYYSOG upload=312KHTO05978 tag=XT55L04P1O4I type=write size=3030060 2024-09-14T11:15:22.164 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:22.168+0000 7f76c1e8a8c0 1 > prepared operation key=W0MDRE9YO3UP tag=R98WY65VL9OP type=write size=323566 2024-09-14T11:15:22.165 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:22.168+0000 7f76c1e8a8c0 1 < canceled part key=_multipart_H9CQV6L29SL5.2~RXM3FSU8UU94.0 size=1048576 2024-09-14T11:15:22.168 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:22.168+0000 7f76c1e8a8c0 1 < completed part key=_multipart_H9CQV6L29SL5.2~RXM3FSU8UU94.1 size=1048576 2024-09-14T11:15:22.170 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:22.172+0000 7f76c1e8a8c0 1 < completed part key=_multipart_H9CQV6L29SL5.2~RXM3FSU8UU94.2 size=282746 2024-09-14T11:15:22.176 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:22.176+0000 7f76c1e8a8c0 1 < canceled multipart upload key=H9CQV6L29SL5 upload=RXM3FSU8UU94 tag=NHCD4CKNBT5V type=write size=3428474 2024-09-14T11:15:22.178 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:22.180+0000 7f76c1e8a8c0 1 > prepared operation key=S43U13LYETS4 tag=50O00XN1J1DI type=del size=2146462 2024-09-14T11:15:22.182 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:22.184+0000 7f76c1e8a8c0 1 < completed part key=_multipart_8PZOVFEYYSOG.2~UECHEZLELTDG.0 size=1048576 2024-09-14T11:15:22.184 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:22.188+0000 7f76c1e8a8c0 1 < completed part key=_multipart_8PZOVFEYYSOG.2~UECHEZLELTDG.1 size=1048576 2024-09-14T11:15:22.186 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:22.188+0000 7f76c1e8a8c0 1 < completed part key=_multipart_8PZOVFEYYSOG.2~UECHEZLELTDG.2 size=132855 2024-09-14T11:15:22.191 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:22.192+0000 7f76c1e8a8c0 1 < completed multipart upload key=8PZOVFEYYSOG upload=UECHEZLELTDG tag=QUTW8V1TXEFK type=write size=3278583 2024-09-14T11:15:22.196 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:22.200+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_H9CQV6L29SL5.2~7E5597HPH276.0 size=886661 2024-09-14T11:15:22.196 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:22.200+0000 7f76c1e8a8c0 1 > prepared multipart upload key=H9CQV6L29SL5 upload=7E5597HPH276 tag=Q518A350DC51 type=write size=1935237 2024-09-14T11:15:22.201 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:22.204+0000 7f76c1e8a8c0 1 < completed delete operation key=KS37ZO6MKAH9 tag=JD8BCYACVKM0 type=del 2024-09-14T11:15:22.206 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:22.208+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_1W5733SDHGDN.2~LYYFZ35XRMRO.0 size=1048576 2024-09-14T11:15:22.208 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:22.212+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_1W5733SDHGDN.2~LYYFZ35XRMRO.1 size=1048576 2024-09-14T11:15:22.211 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:22.212+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_1W5733SDHGDN.2~LYYFZ35XRMRO.2 size=226365 2024-09-14T11:15:22.211 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:22.212+0000 7f76c1e8a8c0 1 > prepared multipart upload key=1W5733SDHGDN upload=LYYFZ35XRMRO tag=KHDCXX9UC5EK type=write size=3372093 2024-09-14T11:15:22.214 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:22.216+0000 7f76c1e8a8c0 1 < completed delete operation key=BOCIF4TL7X7J tag=0JFVQDDL0LJA type=del 2024-09-14T11:15:22.217 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:22.220+0000 7f76c1e8a8c0 1 > prepared operation key=MEVTZ7OAD4CA tag=C7MEGD0MGSLG type=del size=902387 2024-09-14T11:15:22.220 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:22.220+0000 7f76c1e8a8c0 -1 < failed to complete operation key=GZM0AQVHNCMM tag=H5EIDCMXUUYI type=del size=4125528: (22) Invalid argument 2024-09-14T11:15:22.226 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:22.228+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_OUMUTEBQ1TD0.2~YDEH14AMF4AA.0 size=39489 2024-09-14T11:15:22.226 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:22.228+0000 7f76c1e8a8c0 1 > prepared multipart upload key=OUMUTEBQ1TD0 upload=YDEH14AMF4AA tag=2SGVOQJO04F1 type=write size=1088065 2024-09-14T11:15:22.229 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:22.232+0000 7f76c1e8a8c0 1 < completed delete operation key=S43U13LYETS4 tag=0O5VKW5O77R2 type=del 2024-09-14T11:15:22.232 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:22.232+0000 7f76c1e8a8c0 1 > prepared operation key=HJ701768A6I7 tag=PPD6NP9CRRF5 type=del size=2496888 2024-09-14T11:15:22.235 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:22.236+0000 7f76c1e8a8c0 1 < completed part key=_multipart_8FFV9G6EQR8F.2~B0AXUPAL4CX1.0 size=590735 2024-09-14T11:15:22.240 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:22.244+0000 7f76c1e8a8c0 1 < completed multipart upload key=8FFV9G6EQR8F upload=B0AXUPAL4CX1 tag=8S9311GBK26U type=write size=1639311 2024-09-14T11:15:22.243 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:22.244+0000 7f76c1e8a8c0 1 > prepared operation key=KS37ZO6MKAH9 tag=M8QMYDRV2C3V type=del size=3420467 2024-09-14T11:15:22.246 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:22.248+0000 7f76c1e8a8c0 1 < completed delete operation key=TZO40K6J9877 tag=K1ZXULGWKETI type=del 2024-09-14T11:15:22.249 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:22.252+0000 7f76c1e8a8c0 1 > prepared operation key=W0MDRE9YO3UP tag=217CEAH9XXOE type=del size=120566 2024-09-14T11:15:22.252 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:22.256+0000 7f76c1e8a8c0 1 < completed part key=_multipart_85G6NT78HAWQ.2~S1SYF7K1BXSE.0 size=1048576 2024-09-14T11:15:22.254 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:22.256+0000 7f76c1e8a8c0 1 < completed part key=_multipart_85G6NT78HAWQ.2~S1SYF7K1BXSE.1 size=1048576 2024-09-14T11:15:22.256 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:22.260+0000 7f76c1e8a8c0 1 < completed part key=_multipart_85G6NT78HAWQ.2~S1SYF7K1BXSE.2 size=365732 2024-09-14T11:15:22.261 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:22.264+0000 7f76c1e8a8c0 1 < completed multipart upload key=85G6NT78HAWQ upload=S1SYF7K1BXSE tag=84AKSHKB4FIU type=write size=3511460 2024-09-14T11:15:22.263 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:22.264+0000 7f76c1e8a8c0 1 > prepared operation key=H9CQV6L29SL5 tag=0Q1LCY9E3PBI type=del size=2173461 2024-09-14T11:15:22.269 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:22.272+0000 7f76c1e8a8c0 1 < suggested remove operation key=XC8VWSHZOPFP tag=QKCIEQ659232 type=write 2024-09-14T11:15:22.274 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:22.276+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_S43U13LYETS4.2~AFMXLQYASJUX.0 size=1048576 2024-09-14T11:15:22.277 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:22.280+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_S43U13LYETS4.2~AFMXLQYASJUX.1 size=156198 2024-09-14T11:15:22.277 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:22.280+0000 7f76c1e8a8c0 1 > prepared multipart upload key=S43U13LYETS4 upload=AFMXLQYASJUX tag=J58BJU98C8SZ type=write size=2253350 2024-09-14T11:15:22.279 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:22.280+0000 7f76c1e8a8c0 1 < completed part key=_multipart_SUNCRV0C1XYL.2~33INDMG8G8V1.0 size=1048576 2024-09-14T11:15:22.282 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:22.284+0000 7f76c1e8a8c0 1 < completed part key=_multipart_SUNCRV0C1XYL.2~33INDMG8G8V1.1 size=746267 2024-09-14T11:15:22.287 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:22.288+0000 7f76c1e8a8c0 1 < completed multipart upload key=SUNCRV0C1XYL upload=33INDMG8G8V1 tag=XJKQL7NFN8YD type=write size=2843419 2024-09-14T11:15:22.292 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:22.296+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_SHKU2PRNREKK.2~WW9CZ9Q42BYM.0 size=1048576 2024-09-14T11:15:22.295 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:22.296+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_SHKU2PRNREKK.2~WW9CZ9Q42BYM.1 size=358084 2024-09-14T11:15:22.295 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:22.296+0000 7f76c1e8a8c0 1 > prepared multipart upload key=SHKU2PRNREKK upload=WW9CZ9Q42BYM tag=6UYF42GKIHAE type=write size=2455236 2024-09-14T11:15:22.298 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:22.300+0000 7f76c1e8a8c0 1 < completed part key=_multipart_Q5IY4J5FOD80.2~H319ZA1NQNMD.0 size=1048576 2024-09-14T11:15:22.300 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:22.304+0000 7f76c1e8a8c0 1 < completed part key=_multipart_Q5IY4J5FOD80.2~H319ZA1NQNMD.1 size=747815 2024-09-14T11:15:22.305 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:22.308+0000 7f76c1e8a8c0 1 < completed multipart upload key=Q5IY4J5FOD80 upload=H319ZA1NQNMD tag=NBH292F4UTDF type=write size=2844967 2024-09-14T11:15:22.310 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:22.312+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_F3KFS0P1WM7W.2~O88QCW7M79KB.0 size=1048576 2024-09-14T11:15:22.312 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:22.316+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_F3KFS0P1WM7W.2~O88QCW7M79KB.1 size=215208 2024-09-14T11:15:22.313 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:22.316+0000 7f76c1e8a8c0 1 > prepared multipart upload key=F3KFS0P1WM7W upload=O88QCW7M79KB tag=E502JXS1ENG8 type=write size=2312360 2024-09-14T11:15:22.315 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:22.316+0000 7f76c1e8a8c0 1 < completed delete operation key=1K8ESNXU6WDF tag=JB7P2HZYSFLO type=del 2024-09-14T11:15:22.319 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:22.320+0000 7f76c1e8a8c0 1 > prepared operation key=XC8VWSHZOPFP tag=MSKD9Y8F24HX type=del size=3268102 2024-09-14T11:15:22.322 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:22.324+0000 7f76c1e8a8c0 1 < canceled operation key=LZ0YNFOVFYCL tag=KID1SQ0KALIT type=del size=3424154 2024-09-14T11:15:22.325 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:22.328+0000 7f76c1e8a8c0 1 > prepared operation key=W0MDRE9YO3UP tag=UPRNEPTH2EB9 type=del size=1150131 2024-09-14T11:15:22.329 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:22.332+0000 7f76c1e8a8c0 1 < completed part key=_multipart_TUFOZKTV9XIH.2~CAZYAW7LB9OI.0 size=1048576 2024-09-14T11:15:22.331 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:22.332+0000 7f76c1e8a8c0 1 < completed part key=_multipart_TUFOZKTV9XIH.2~CAZYAW7LB9OI.1 size=1048576 2024-09-14T11:15:22.334 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:22.336+0000 7f76c1e8a8c0 1 < completed part key=_multipart_TUFOZKTV9XIH.2~CAZYAW7LB9OI.2 size=388951 2024-09-14T11:15:22.339 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:22.340+0000 7f76c1e8a8c0 1 < completed multipart upload key=TUFOZKTV9XIH upload=CAZYAW7LB9OI tag=PM5GLU7471XE type=write size=3534679 2024-09-14T11:15:22.342 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:22.344+0000 7f76c1e8a8c0 1 > prepared operation key=R5I9H7WAK7Z7 tag=5BWSN13INOSM type=del size=3126163 2024-09-14T11:15:22.345 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:22.348+0000 7f76c1e8a8c0 1 < completed write operation key=W0MDRE9YO3UP tag=R98WY65VL9OP type=write size=323566 2024-09-14T11:15:22.348 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:22.352+0000 7f76c1e8a8c0 1 > prepared operation key=K2EEZLRK7MVO tag=SASUJFWJPXP0 type=del size=3505386 2024-09-14T11:15:22.352 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:22.352+0000 7f76c1e8a8c0 1 < completed delete operation key=S43U13LYETS4 tag=50O00XN1J1DI type=del 2024-09-14T11:15:22.355 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:22.356+0000 7f76c1e8a8c0 1 > prepared operation key=GZM0AQVHNCMM tag=IPPCJ0HSOK3I type=del size=104959 2024-09-14T11:15:22.358 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:22.360+0000 7f76c1e8a8c0 1 < completed part key=_multipart_H9CQV6L29SL5.2~7E5597HPH276.0 size=886661 2024-09-14T11:15:22.363 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:22.364+0000 7f76c1e8a8c0 1 < completed multipart upload key=H9CQV6L29SL5 upload=7E5597HPH276 tag=Q518A350DC51 type=write size=1935237 2024-09-14T11:15:22.366 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:22.368+0000 7f76c1e8a8c0 1 > prepared operation key=TZO40K6J9877 tag=MDST0YYIYNV9 type=del size=3734068 2024-09-14T11:15:22.369 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:22.372+0000 7f76c1e8a8c0 1 < completed part key=_multipart_1W5733SDHGDN.2~LYYFZ35XRMRO.0 size=1048576 2024-09-14T11:15:22.371 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:22.372+0000 7f76c1e8a8c0 1 < completed part key=_multipart_1W5733SDHGDN.2~LYYFZ35XRMRO.1 size=1048576 2024-09-14T11:15:22.371 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:22.372+0000 7f76c1e8a8c0 1 < canceled part key=_multipart_1W5733SDHGDN.2~LYYFZ35XRMRO.2 size=226365 2024-09-14T11:15:22.376 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:22.376+0000 7f76c1e8a8c0 1 < canceled multipart upload key=1W5733SDHGDN upload=LYYFZ35XRMRO tag=KHDCXX9UC5EK type=write size=3372093 2024-09-14T11:15:22.381 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:22.384+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_8PZOVFEYYSOG.2~5CLJT1H32MKL.0 size=1048576 2024-09-14T11:15:22.383 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:22.384+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_8PZOVFEYYSOG.2~5CLJT1H32MKL.1 size=414227 2024-09-14T11:15:22.383 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:22.384+0000 7f76c1e8a8c0 1 > prepared multipart upload key=8PZOVFEYYSOG upload=5CLJT1H32MKL tag=27WQOOMKREFH type=write size=2511379 2024-09-14T11:15:22.386 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:22.388+0000 7f76c1e8a8c0 1 < completed delete operation key=MEVTZ7OAD4CA tag=C7MEGD0MGSLG type=del 2024-09-14T11:15:22.389 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:22.392+0000 7f76c1e8a8c0 1 > prepared operation key=TUFOZKTV9XIH tag=P5NXNO8ZBAIW type=del size=1843339 2024-09-14T11:15:22.390 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:22.392+0000 7f76c1e8a8c0 1 < canceled part key=_multipart_OUMUTEBQ1TD0.2~YDEH14AMF4AA.0 size=39489 2024-09-14T11:15:22.394 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:22.396+0000 7f76c1e8a8c0 1 < canceled multipart upload key=OUMUTEBQ1TD0 upload=YDEH14AMF4AA tag=2SGVOQJO04F1 type=write size=1088065 2024-09-14T11:15:22.400 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:22.400+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_OOUEM16XL80W.2~YBMIIT0ALX0P.0 size=1048576 2024-09-14T11:15:22.402 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:22.404+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_OOUEM16XL80W.2~YBMIIT0ALX0P.1 size=398880 2024-09-14T11:15:22.402 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:22.404+0000 7f76c1e8a8c0 1 > prepared multipart upload key=OOUEM16XL80W upload=YBMIIT0ALX0P tag=XMKYMLTLC9K4 type=write size=2496032 2024-09-14T11:15:22.405 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:22.408+0000 7f76c1e8a8c0 1 < completed delete operation key=HJ701768A6I7 tag=PPD6NP9CRRF5 type=del 2024-09-14T11:15:22.410 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:22.412+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_6TIJR323NMOH.2~NUBB70YWROY3.0 size=1048576 2024-09-14T11:15:22.412 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:22.416+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_6TIJR323NMOH.2~NUBB70YWROY3.1 size=765230 2024-09-14T11:15:22.412 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:22.416+0000 7f76c1e8a8c0 1 > prepared multipart upload key=6TIJR323NMOH upload=NUBB70YWROY3 tag=3B8A6TB63LZM type=write size=2862382 2024-09-14T11:15:22.415 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:22.416+0000 7f76c1e8a8c0 1 < completed delete operation key=KS37ZO6MKAH9 tag=M8QMYDRV2C3V type=del 2024-09-14T11:15:22.420 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:22.424+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_OUMUTEBQ1TD0.2~4EP0Q6ACGKP4.0 size=1048576 2024-09-14T11:15:22.422 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:22.424+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_OUMUTEBQ1TD0.2~4EP0Q6ACGKP4.1 size=1048576 2024-09-14T11:15:22.425 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:22.428+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_OUMUTEBQ1TD0.2~4EP0Q6ACGKP4.2 size=317652 2024-09-14T11:15:22.425 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:22.428+0000 7f76c1e8a8c0 1 > prepared multipart upload key=OUMUTEBQ1TD0 upload=4EP0Q6ACGKP4 tag=BXZOGJPB9TP6 type=write size=3463380 2024-09-14T11:15:22.428 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:22.428+0000 7f76c1e8a8c0 1 < canceled operation key=W0MDRE9YO3UP tag=217CEAH9XXOE type=del size=120566 2024-09-14T11:15:22.433 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:22.436+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_GAVZRU8ZLW7S.2~ISLSX6JM8NJY.0 size=1048576 2024-09-14T11:15:22.435 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:22.436+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_GAVZRU8ZLW7S.2~ISLSX6JM8NJY.1 size=1048576 2024-09-14T11:15:22.438 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:22.440+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_GAVZRU8ZLW7S.2~ISLSX6JM8NJY.2 size=594576 2024-09-14T11:15:22.438 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:22.440+0000 7f76c1e8a8c0 1 > prepared multipart upload key=GAVZRU8ZLW7S upload=ISLSX6JM8NJY tag=8GP3W2VKDPLJ type=write size=3740304 2024-09-14T11:15:22.441 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:22.444+0000 7f76c1e8a8c0 1 < completed delete operation key=H9CQV6L29SL5 tag=0Q1LCY9E3PBI type=del 2024-09-14T11:15:22.447 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:22.448+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_XC8VWSHZOPFP.2~WU8Y2Y43W65S.0 size=1048576 2024-09-14T11:15:22.449 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:22.452+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_XC8VWSHZOPFP.2~WU8Y2Y43W65S.1 size=809647 2024-09-14T11:15:22.450 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:22.452+0000 7f76c1e8a8c0 1 > prepared multipart upload key=XC8VWSHZOPFP upload=WU8Y2Y43W65S tag=292C182P14PQ type=write size=2906799 2024-09-14T11:15:22.450 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:22.452+0000 7f76c1e8a8c0 1 < canceled part key=_multipart_S43U13LYETS4.2~AFMXLQYASJUX.0 size=1048576 2024-09-14T11:15:22.452 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:22.456+0000 7f76c1e8a8c0 1 < completed part key=_multipart_S43U13LYETS4.2~AFMXLQYASJUX.1 size=156198 2024-09-14T11:15:22.457 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:22.460+0000 7f76c1e8a8c0 1 < canceled multipart upload key=S43U13LYETS4 upload=AFMXLQYASJUX tag=J58BJU98C8SZ type=write size=2253350 2024-09-14T11:15:22.460 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:22.460+0000 7f76c1e8a8c0 1 > prepared operation key=85G6NT78HAWQ tag=UVQKS9X3SAQD type=del size=2275772 2024-09-14T11:15:22.462 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:22.464+0000 7f76c1e8a8c0 1 < completed part key=_multipart_SHKU2PRNREKK.2~WW9CZ9Q42BYM.0 size=1048576 2024-09-14T11:15:22.465 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:22.468+0000 7f76c1e8a8c0 1 < completed part key=_multipart_SHKU2PRNREKK.2~WW9CZ9Q42BYM.1 size=358084 2024-09-14T11:15:22.474 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:22.476+0000 7f76c1e8a8c0 1 < completed multipart upload key=SHKU2PRNREKK upload=WW9CZ9Q42BYM tag=6UYF42GKIHAE type=write size=2455236 2024-09-14T11:15:22.481 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:22.484+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_HS7T50JORDQJ.2~65I8JLYQCOB1.0 size=1048576 2024-09-14T11:15:22.483 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:22.484+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_HS7T50JORDQJ.2~65I8JLYQCOB1.1 size=333205 2024-09-14T11:15:22.484 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:22.484+0000 7f76c1e8a8c0 1 > prepared multipart upload key=HS7T50JORDQJ upload=65I8JLYQCOB1 tag=6VEDSBNUHFGV type=write size=2430357 2024-09-14T11:15:22.487 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:22.488+0000 7f76c1e8a8c0 1 < completed part key=_multipart_F3KFS0P1WM7W.2~O88QCW7M79KB.0 size=1048576 2024-09-14T11:15:22.487 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:22.488+0000 7f76c1e8a8c0 1 < canceled part key=_multipart_F3KFS0P1WM7W.2~O88QCW7M79KB.1 size=215208 2024-09-14T11:15:22.492 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:22.496+0000 7f76c1e8a8c0 1 < canceled multipart upload key=F3KFS0P1WM7W upload=O88QCW7M79KB tag=E502JXS1ENG8 type=write size=2312360 2024-09-14T11:15:22.496 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:22.500+0000 7f76c1e8a8c0 1 > prepared operation key=CIRQT9IDJ5OJ tag=9757L2YPLK4I type=del size=3057929 2024-09-14T11:15:22.500 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:22.504+0000 7f76c1e8a8c0 1 < completed delete operation key=XC8VWSHZOPFP tag=MSKD9Y8F24HX type=del 2024-09-14T11:15:22.503 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:22.504+0000 7f76c1e8a8c0 1 > prepared operation key=H9CQV6L29SL5 tag=KQPRUP345QJ1 type=del size=2612476 2024-09-14T11:15:22.507 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:22.508+0000 7f76c1e8a8c0 1 < canceled operation key=W0MDRE9YO3UP tag=UPRNEPTH2EB9 type=del size=1150131 2024-09-14T11:15:22.511 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:22.512+0000 7f76c1e8a8c0 1 > prepared operation key=OUMUTEBQ1TD0 tag=Z30E8XCZEV6T type=del size=1865380 2024-09-14T11:15:22.518 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:22.520+0000 7f76c1e8a8c0 1 < suggested update operation key=R5I9H7WAK7Z7 tag=5BWSN13INOSM type=del size=3126163 2024-09-14T11:15:22.521 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:22.524+0000 7f76c1e8a8c0 1 > prepared operation key=1K8ESNXU6WDF tag=ZWGJ237WKKIX type=write size=782447 2024-09-14T11:15:22.528 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:22.532+0000 7f76c1e8a8c0 1 < suggested remove operation key=K2EEZLRK7MVO tag=SASUJFWJPXP0 type=del 2024-09-14T11:15:22.532 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:22.532+0000 7f76c1e8a8c0 1 > prepared operation key=SUNCRV0C1XYL tag=4UZIXIYSLQKM type=del size=470539 2024-09-14T11:15:22.535 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:22.536+0000 7f76c1e8a8c0 1 < completed delete operation key=GZM0AQVHNCMM tag=IPPCJ0HSOK3I type=del 2024-09-14T11:15:22.538 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:22.540+0000 7f76c1e8a8c0 1 > prepared operation key=VI61O3K069BP tag=VL98N1YPTDRW type=del size=2655701 2024-09-14T11:15:22.541 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:22.544+0000 7f76c1e8a8c0 1 < completed delete operation key=TZO40K6J9877 tag=MDST0YYIYNV9 type=del 2024-09-14T11:15:22.544 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:22.548+0000 7f76c1e8a8c0 1 > prepared operation key=LZ0YNFOVFYCL tag=FZ74OMNYIJSQ type=del size=4141860 2024-09-14T11:15:22.547 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:22.548+0000 7f76c1e8a8c0 1 < completed part key=_multipart_8PZOVFEYYSOG.2~5CLJT1H32MKL.0 size=1048576 2024-09-14T11:15:22.550 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:22.552+0000 7f76c1e8a8c0 1 < completed part key=_multipart_8PZOVFEYYSOG.2~5CLJT1H32MKL.1 size=414227 2024-09-14T11:15:22.555 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:22.556+0000 7f76c1e8a8c0 1 < completed multipart upload key=8PZOVFEYYSOG upload=5CLJT1H32MKL tag=27WQOOMKREFH type=write size=2511379 2024-09-14T11:15:22.561 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:22.564+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_OOUEM16XL80W.2~0TFUGDRU98NA.0 size=424582 2024-09-14T11:15:22.561 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:22.564+0000 7f76c1e8a8c0 1 > prepared multipart upload key=OOUEM16XL80W upload=0TFUGDRU98NA tag=91IXZ3JS5OEL type=write size=1473158 2024-09-14T11:15:22.564 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:22.568+0000 7f76c1e8a8c0 1 < completed delete operation key=TUFOZKTV9XIH tag=P5NXNO8ZBAIW type=del 2024-09-14T11:15:22.568 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:22.568+0000 7f76c1e8a8c0 1 > prepared operation key=SUNCRV0C1XYL tag=I9L52SVCA27A type=del size=3849764 2024-09-14T11:15:22.571 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:22.572+0000 7f76c1e8a8c0 1 < completed part key=_multipart_OOUEM16XL80W.2~YBMIIT0ALX0P.0 size=1048576 2024-09-14T11:15:22.571 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:22.572+0000 7f76c1e8a8c0 1 < canceled part key=_multipart_OOUEM16XL80W.2~YBMIIT0ALX0P.1 size=398880 2024-09-14T11:15:22.576 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:22.580+0000 7f76c1e8a8c0 1 < canceled multipart upload key=OOUEM16XL80W upload=YBMIIT0ALX0P tag=XMKYMLTLC9K4 type=write size=2496032 2024-09-14T11:15:22.582 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:22.584+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_TZO40K6J9877.2~087SXMCIQES0.0 size=1048576 2024-09-14T11:15:22.585 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:22.588+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_TZO40K6J9877.2~087SXMCIQES0.1 size=1048576 2024-09-14T11:15:22.587 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:22.588+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_TZO40K6J9877.2~087SXMCIQES0.2 size=364026 2024-09-14T11:15:22.587 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:22.588+0000 7f76c1e8a8c0 1 > prepared multipart upload key=TZO40K6J9877 upload=087SXMCIQES0 tag=TGCW7O9KFR0C type=write size=3509754 2024-09-14T11:15:22.591 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:22.592+0000 7f76c1e8a8c0 1 < completed part key=_multipart_6TIJR323NMOH.2~NUBB70YWROY3.0 size=1048576 2024-09-14T11:15:22.591 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:22.592+0000 7f76c1e8a8c0 1 < canceled part key=_multipart_6TIJR323NMOH.2~NUBB70YWROY3.1 size=765230 2024-09-14T11:15:22.596 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:22.600+0000 7f76c1e8a8c0 1 < canceled multipart upload key=6TIJR323NMOH upload=NUBB70YWROY3 tag=3B8A6TB63LZM type=write size=2862382 2024-09-14T11:15:22.602 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:22.604+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_CIRQT9IDJ5OJ.2~JVTT5FU2RLYF.0 size=1048576 2024-09-14T11:15:22.605 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:22.608+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_CIRQT9IDJ5OJ.2~JVTT5FU2RLYF.1 size=788979 2024-09-14T11:15:22.605 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:22.608+0000 7f76c1e8a8c0 1 > prepared multipart upload key=CIRQT9IDJ5OJ upload=JVTT5FU2RLYF tag=5LHF52IXCQVQ type=write size=2886131 2024-09-14T11:15:22.608 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:22.612+0000 7f76c1e8a8c0 1 < completed part key=_multipart_OUMUTEBQ1TD0.2~4EP0Q6ACGKP4.0 size=1048576 2024-09-14T11:15:22.610 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:22.612+0000 7f76c1e8a8c0 1 < completed part key=_multipart_OUMUTEBQ1TD0.2~4EP0Q6ACGKP4.1 size=1048576 2024-09-14T11:15:22.613 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:22.616+0000 7f76c1e8a8c0 1 < completed part key=_multipart_OUMUTEBQ1TD0.2~4EP0Q6ACGKP4.2 size=317652 2024-09-14T11:15:22.618 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:22.620+0000 7f76c1e8a8c0 1 < completed multipart upload key=OUMUTEBQ1TD0 upload=4EP0Q6ACGKP4 tag=BXZOGJPB9TP6 type=write size=3463380 2024-09-14T11:15:22.623 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:22.624+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_8FFV9G6EQR8F.2~WYU6171OYSNH.0 size=1048576 2024-09-14T11:15:22.626 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:22.628+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_8FFV9G6EQR8F.2~WYU6171OYSNH.1 size=1048576 2024-09-14T11:15:22.628 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:22.632+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_8FFV9G6EQR8F.2~WYU6171OYSNH.2 size=478239 2024-09-14T11:15:22.628 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:22.632+0000 7f76c1e8a8c0 1 > prepared multipart upload key=8FFV9G6EQR8F upload=WYU6171OYSNH tag=3QZHGWZJGOYM type=write size=3623967 2024-09-14T11:15:22.632 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:22.632+0000 7f76c1e8a8c0 1 < completed part key=_multipart_GAVZRU8ZLW7S.2~ISLSX6JM8NJY.0 size=1048576 2024-09-14T11:15:22.634 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:22.636+0000 7f76c1e8a8c0 1 < completed part key=_multipart_GAVZRU8ZLW7S.2~ISLSX6JM8NJY.1 size=1048576 2024-09-14T11:15:22.637 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:22.640+0000 7f76c1e8a8c0 1 < completed part key=_multipart_GAVZRU8ZLW7S.2~ISLSX6JM8NJY.2 size=594576 2024-09-14T11:15:22.642 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:22.644+0000 7f76c1e8a8c0 1 < completed multipart upload key=GAVZRU8ZLW7S upload=ISLSX6JM8NJY tag=8GP3W2VKDPLJ type=write size=3740304 2024-09-14T11:15:22.648 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:22.648+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_TUFOZKTV9XIH.2~IAGHDA010E4S.0 size=246369 2024-09-14T11:15:22.648 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:22.648+0000 7f76c1e8a8c0 1 > prepared multipart upload key=TUFOZKTV9XIH upload=IAGHDA010E4S tag=SBEIO5JM6IM1 type=write size=1294945 2024-09-14T11:15:22.651 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:22.652+0000 7f76c1e8a8c0 1 < completed part key=_multipart_XC8VWSHZOPFP.2~WU8Y2Y43W65S.0 size=1048576 2024-09-14T11:15:22.653 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:22.656+0000 7f76c1e8a8c0 1 < completed part key=_multipart_XC8VWSHZOPFP.2~WU8Y2Y43W65S.1 size=809647 2024-09-14T11:15:22.658 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:22.660+0000 7f76c1e8a8c0 1 < completed multipart upload key=XC8VWSHZOPFP upload=WU8Y2Y43W65S tag=292C182P14PQ type=write size=2906799 2024-09-14T11:15:22.661 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:22.664+0000 7f76c1e8a8c0 1 > prepared operation key=GZM0AQVHNCMM tag=9DOEAYSSA908 type=del size=2895596 2024-09-14T11:15:22.668 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:22.668+0000 7f76c1e8a8c0 1 < suggested remove operation key=85G6NT78HAWQ tag=UVQKS9X3SAQD type=del 2024-09-14T11:15:22.671 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:22.672+0000 7f76c1e8a8c0 1 > prepared operation key=K2EEZLRK7MVO tag=16B4TE47SBW9 type=del size=1575935 2024-09-14T11:15:22.674 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:22.676+0000 7f76c1e8a8c0 1 < completed part key=_multipart_HS7T50JORDQJ.2~65I8JLYQCOB1.0 size=1048576 2024-09-14T11:15:22.676 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:22.680+0000 7f76c1e8a8c0 1 < completed part key=_multipart_HS7T50JORDQJ.2~65I8JLYQCOB1.1 size=333205 2024-09-14T11:15:22.682 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:22.684+0000 7f76c1e8a8c0 1 < completed multipart upload key=HS7T50JORDQJ upload=65I8JLYQCOB1 tag=6VEDSBNUHFGV type=write size=2430357 2024-09-14T11:15:22.686 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:22.688+0000 7f76c1e8a8c0 1 > prepared operation key=SHKU2PRNREKK tag=JHO6FZEZZQX7 type=del size=3788642 2024-09-14T11:15:22.689 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:22.692+0000 7f76c1e8a8c0 1 < completed delete operation key=CIRQT9IDJ5OJ tag=9757L2YPLK4I type=del 2024-09-14T11:15:22.696 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:22.696+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_15FU4CEGC22Q.2~HJ1AN24LMA13.0 size=523574 2024-09-14T11:15:22.696 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:22.696+0000 7f76c1e8a8c0 1 > prepared multipart upload key=15FU4CEGC22Q upload=HJ1AN24LMA13 tag=RE2H3YNO2087 type=write size=1572150 2024-09-14T11:15:22.699 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:22.700+0000 7f76c1e8a8c0 1 < completed delete operation key=H9CQV6L29SL5 tag=KQPRUP345QJ1 type=del 2024-09-14T11:15:22.703 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:22.704+0000 7f76c1e8a8c0 1 > prepared operation key=CIRQT9IDJ5OJ tag=SGWON3KK7VEV type=del size=1312577 2024-09-14T11:15:22.706 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:22.708+0000 7f76c1e8a8c0 1 < completed delete operation key=OUMUTEBQ1TD0 tag=Z30E8XCZEV6T type=del 2024-09-14T11:15:22.712 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:22.716+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_W0MDRE9YO3UP.2~SM8ICA0MABT4.0 size=1048576 2024-09-14T11:15:22.715 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:22.716+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_W0MDRE9YO3UP.2~SM8ICA0MABT4.1 size=1048576 2024-09-14T11:15:22.717 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:22.720+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_W0MDRE9YO3UP.2~SM8ICA0MABT4.2 size=375440 2024-09-14T11:15:22.717 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:22.720+0000 7f76c1e8a8c0 1 > prepared multipart upload key=W0MDRE9YO3UP upload=SM8ICA0MABT4 tag=6CT1CERW2BJG type=write size=3521168 2024-09-14T11:15:22.724 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:22.724+0000 7f76c1e8a8c0 1 < suggested update operation key=1K8ESNXU6WDF tag=ZWGJ237WKKIX type=write size=782447 2024-09-14T11:15:22.730 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:22.732+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_1W5733SDHGDN.2~WPQ1ZS0QUY0C.0 size=1048576 2024-09-14T11:15:22.733 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:22.736+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_1W5733SDHGDN.2~WPQ1ZS0QUY0C.1 size=1048576 2024-09-14T11:15:22.735 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:22.736+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_1W5733SDHGDN.2~WPQ1ZS0QUY0C.2 size=709524 2024-09-14T11:15:22.735 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:22.736+0000 7f76c1e8a8c0 1 > prepared multipart upload key=1W5733SDHGDN upload=WPQ1ZS0QUY0C tag=E6KJN5FICE3P type=write size=3855252 2024-09-14T11:15:22.742 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:22.744+0000 7f76c1e8a8c0 1 < suggested remove operation key=SUNCRV0C1XYL tag=4UZIXIYSLQKM type=del 2024-09-14T11:15:22.745 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:22.748+0000 7f76c1e8a8c0 1 > prepared operation key=OUMUTEBQ1TD0 tag=VIDTIRS64HMW type=del size=155333 2024-09-14T11:15:22.752 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:22.752+0000 7f76c1e8a8c0 1 < suggested remove operation key=VI61O3K069BP tag=VL98N1YPTDRW type=del 2024-09-14T11:15:22.755 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:22.756+0000 7f76c1e8a8c0 1 > prepared operation key=SHKU2PRNREKK tag=RZ7RPB5783XJ type=del size=3960634 2024-09-14T11:15:22.759 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:22.760+0000 7f76c1e8a8c0 1 < completed delete operation key=LZ0YNFOVFYCL tag=FZ74OMNYIJSQ type=del 2024-09-14T11:15:22.762 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:22.764+0000 7f76c1e8a8c0 1 > prepared operation key=MEVTZ7OAD4CA tag=S0DTRIO7DZ2D type=del size=2162575 2024-09-14T11:15:22.766 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:22.768+0000 7f76c1e8a8c0 1 < completed part key=_multipart_OOUEM16XL80W.2~0TFUGDRU98NA.0 size=424582 2024-09-14T11:15:22.771 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:22.772+0000 7f76c1e8a8c0 1 < completed multipart upload key=OOUEM16XL80W upload=0TFUGDRU98NA tag=91IXZ3JS5OEL type=write size=1473158 2024-09-14T11:15:22.774 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:22.776+0000 7f76c1e8a8c0 1 > prepared operation key=6TIJR323NMOH tag=SHPT5HW220JQ type=del size=2954547 2024-09-14T11:15:22.782 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:22.784+0000 7f76c1e8a8c0 -1 < failed to complete operation key=SUNCRV0C1XYL tag=I9L52SVCA27A type=del size=3849764: (22) Invalid argument 2024-09-14T11:15:22.788 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:22.788+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_MEVTZ7OAD4CA.2~9U1R7L08TI1I.0 size=1048576 2024-09-14T11:15:22.790 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:22.792+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_MEVTZ7OAD4CA.2~9U1R7L08TI1I.1 size=940573 2024-09-14T11:15:22.790 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:22.792+0000 7f76c1e8a8c0 1 > prepared multipart upload key=MEVTZ7OAD4CA upload=9U1R7L08TI1I tag=0J4FBSB08S2H type=write size=3037725 2024-09-14T11:15:22.793 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:22.796+0000 7f76c1e8a8c0 1 < completed part key=_multipart_TZO40K6J9877.2~087SXMCIQES0.0 size=1048576 2024-09-14T11:15:22.796 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:22.800+0000 7f76c1e8a8c0 1 < completed part key=_multipart_TZO40K6J9877.2~087SXMCIQES0.1 size=1048576 2024-09-14T11:15:22.798 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:22.800+0000 7f76c1e8a8c0 1 < completed part key=_multipart_TZO40K6J9877.2~087SXMCIQES0.2 size=364026 2024-09-14T11:15:22.804 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:22.808+0000 7f76c1e8a8c0 1 < completed multipart upload key=TZO40K6J9877 upload=087SXMCIQES0 tag=TGCW7O9KFR0C type=write size=3509754 2024-09-14T11:15:22.810 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:22.812+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_HJ701768A6I7.2~CX96D3DQDYZI.0 size=1048576 2024-09-14T11:15:22.813 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:22.816+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_HJ701768A6I7.2~CX96D3DQDYZI.1 size=1048576 2024-09-14T11:15:22.815 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:22.816+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_HJ701768A6I7.2~CX96D3DQDYZI.2 size=608374 2024-09-14T11:15:22.815 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:22.816+0000 7f76c1e8a8c0 1 > prepared multipart upload key=HJ701768A6I7 upload=CX96D3DQDYZI tag=RIIZGWSII90C type=write size=3754102 2024-09-14T11:15:22.818 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:22.820+0000 7f76c1e8a8c0 1 < completed part key=_multipart_CIRQT9IDJ5OJ.2~JVTT5FU2RLYF.0 size=1048576 2024-09-14T11:15:22.821 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:22.824+0000 7f76c1e8a8c0 1 < completed part key=_multipart_CIRQT9IDJ5OJ.2~JVTT5FU2RLYF.1 size=788979 2024-09-14T11:15:22.827 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:22.828+0000 7f76c1e8a8c0 1 < completed multipart upload key=CIRQT9IDJ5OJ upload=JVTT5FU2RLYF tag=5LHF52IXCQVQ type=write size=2886131 2024-09-14T11:15:22.832 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:22.836+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_BOCIF4TL7X7J.2~YU56VATP35P5.0 size=1048576 2024-09-14T11:15:22.835 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:22.836+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_BOCIF4TL7X7J.2~YU56VATP35P5.1 size=826581 2024-09-14T11:15:22.835 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:22.836+0000 7f76c1e8a8c0 1 > prepared multipart upload key=BOCIF4TL7X7J upload=YU56VATP35P5 tag=974M3RTGDADY type=write size=2923733 2024-09-14T11:15:22.838 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:22.840+0000 7f76c1e8a8c0 1 < completed part key=_multipart_8FFV9G6EQR8F.2~WYU6171OYSNH.0 size=1048576 2024-09-14T11:15:22.841 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:22.844+0000 7f76c1e8a8c0 1 < completed part key=_multipart_8FFV9G6EQR8F.2~WYU6171OYSNH.1 size=1048576 2024-09-14T11:15:22.841 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:22.844+0000 7f76c1e8a8c0 1 < canceled part key=_multipart_8FFV9G6EQR8F.2~WYU6171OYSNH.2 size=478239 2024-09-14T11:15:22.847 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:22.848+0000 7f76c1e8a8c0 1 < canceled multipart upload key=8FFV9G6EQR8F upload=WYU6171OYSNH tag=3QZHGWZJGOYM type=write size=3623967 2024-09-14T11:15:22.853 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:22.856+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_W0MDRE9YO3UP.2~W030DGQBC63V.0 size=1048576 2024-09-14T11:15:22.855 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:22.856+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_W0MDRE9YO3UP.2~W030DGQBC63V.1 size=1048576 2024-09-14T11:15:22.857 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:22.860+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_W0MDRE9YO3UP.2~W030DGQBC63V.2 size=405714 2024-09-14T11:15:22.858 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:22.860+0000 7f76c1e8a8c0 1 > prepared multipart upload key=W0MDRE9YO3UP upload=W030DGQBC63V tag=J86GK09J1H89 type=write size=3551442 2024-09-14T11:15:22.861 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:22.864+0000 7f76c1e8a8c0 1 < completed part key=_multipart_TUFOZKTV9XIH.2~IAGHDA010E4S.0 size=246369 2024-09-14T11:15:22.866 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:22.868+0000 7f76c1e8a8c0 1 < completed multipart upload key=TUFOZKTV9XIH upload=IAGHDA010E4S tag=SBEIO5JM6IM1 type=write size=1294945 2024-09-14T11:15:22.869 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:22.872+0000 7f76c1e8a8c0 1 > prepared operation key=CIRQT9IDJ5OJ tag=OR6KYGJNMTT3 type=del size=1040850 2024-09-14T11:15:22.872 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:22.872+0000 7f76c1e8a8c0 1 < completed delete operation key=GZM0AQVHNCMM tag=9DOEAYSSA908 type=del 2024-09-14T11:15:22.875 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:22.876+0000 7f76c1e8a8c0 1 > prepared operation key=Q5IY4J5FOD80 tag=OLKBLTXGX0SN type=del size=1911562 2024-09-14T11:15:22.878 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:22.880+0000 7f76c1e8a8c0 1 < completed delete operation key=K2EEZLRK7MVO tag=16B4TE47SBW9 type=del 2024-09-14T11:15:22.883 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:22.884+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_6TIJR323NMOH.2~0F70HMW6VCX0.0 size=1048576 2024-09-14T11:15:22.886 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:22.888+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_6TIJR323NMOH.2~0F70HMW6VCX0.1 size=350480 2024-09-14T11:15:22.886 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:22.888+0000 7f76c1e8a8c0 1 > prepared multipart upload key=6TIJR323NMOH upload=0F70HMW6VCX0 tag=ODREP7UHH13V type=write size=2447632 2024-09-14T11:15:22.889 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:22.892+0000 7f76c1e8a8c0 1 < completed delete operation key=SHKU2PRNREKK tag=JHO6FZEZZQX7 type=del 2024-09-14T11:15:22.894 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:22.896+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_OOUEM16XL80W.2~1X47MZ7NPVYE.0 size=1048576 2024-09-14T11:15:22.896 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:22.900+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_OOUEM16XL80W.2~1X47MZ7NPVYE.1 size=1048576 2024-09-14T11:15:22.899 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:22.900+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_OOUEM16XL80W.2~1X47MZ7NPVYE.2 size=206131 2024-09-14T11:15:22.899 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:22.900+0000 7f76c1e8a8c0 1 > prepared multipart upload key=OOUEM16XL80W upload=1X47MZ7NPVYE tag=671V2YF2BDH4 type=write size=3351859 2024-09-14T11:15:22.899 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:22.900+0000 7f76c1e8a8c0 1 < canceled part key=_multipart_15FU4CEGC22Q.2~HJ1AN24LMA13.0 size=523574 2024-09-14T11:15:22.905 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:22.908+0000 7f76c1e8a8c0 1 < canceled multipart upload key=15FU4CEGC22Q upload=HJ1AN24LMA13 tag=RE2H3YNO2087 type=write size=1572150 2024-09-14T11:15:22.910 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:22.912+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_S43U13LYETS4.2~GPY5VPS0JK6T.0 size=1048576 2024-09-14T11:15:22.913 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:22.916+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_S43U13LYETS4.2~GPY5VPS0JK6T.1 size=632630 2024-09-14T11:15:22.913 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:22.916+0000 7f76c1e8a8c0 1 > prepared multipart upload key=S43U13LYETS4 upload=GPY5VPS0JK6T tag=JD9SCUTTM5CW type=write size=2729782 2024-09-14T11:15:22.919 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:22.920+0000 7f76c1e8a8c0 1 < suggested update operation key=CIRQT9IDJ5OJ tag=SGWON3KK7VEV type=del size=1312577 2024-09-14T11:15:22.923 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:22.924+0000 7f76c1e8a8c0 1 > prepared operation key=SHKU2PRNREKK tag=VTU579RHH7IE type=del size=3291489 2024-09-14T11:15:22.926 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:22.928+0000 7f76c1e8a8c0 1 < completed part key=_multipart_W0MDRE9YO3UP.2~SM8ICA0MABT4.0 size=1048576 2024-09-14T11:15:22.928 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:22.932+0000 7f76c1e8a8c0 1 < completed part key=_multipart_W0MDRE9YO3UP.2~SM8ICA0MABT4.1 size=1048576 2024-09-14T11:15:22.930 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:22.932+0000 7f76c1e8a8c0 1 < completed part key=_multipart_W0MDRE9YO3UP.2~SM8ICA0MABT4.2 size=375440 2024-09-14T11:15:22.935 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:22.936+0000 7f76c1e8a8c0 1 < completed multipart upload key=W0MDRE9YO3UP upload=SM8ICA0MABT4 tag=6CT1CERW2BJG type=write size=3521168 2024-09-14T11:15:22.941 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:22.944+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_CIRQT9IDJ5OJ.2~0TTGZ8PBYA7I.0 size=972931 2024-09-14T11:15:22.941 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:22.944+0000 7f76c1e8a8c0 1 > prepared multipart upload key=CIRQT9IDJ5OJ upload=0TTGZ8PBYA7I tag=YF4TOJ0XH9V3 type=write size=2021507 2024-09-14T11:15:22.944 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:22.944+0000 7f76c1e8a8c0 1 < completed part key=_multipart_1W5733SDHGDN.2~WPQ1ZS0QUY0C.0 size=1048576 2024-09-14T11:15:22.946 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:22.948+0000 7f76c1e8a8c0 1 < completed part key=_multipart_1W5733SDHGDN.2~WPQ1ZS0QUY0C.1 size=1048576 2024-09-14T11:15:22.949 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:22.952+0000 7f76c1e8a8c0 1 < completed part key=_multipart_1W5733SDHGDN.2~WPQ1ZS0QUY0C.2 size=709524 2024-09-14T11:15:22.954 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:22.956+0000 7f76c1e8a8c0 1 < completed multipart upload key=1W5733SDHGDN upload=WPQ1ZS0QUY0C tag=E6KJN5FICE3P type=write size=3855252 2024-09-14T11:15:22.959 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:22.960+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_W0MDRE9YO3UP.2~D7R7574AJK8E.0 size=1048576 2024-09-14T11:15:22.961 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:22.964+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_W0MDRE9YO3UP.2~D7R7574AJK8E.1 size=1048576 2024-09-14T11:15:22.964 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:22.964+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_W0MDRE9YO3UP.2~D7R7574AJK8E.2 size=1011126 2024-09-14T11:15:22.964 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:22.964+0000 7f76c1e8a8c0 1 > prepared multipart upload key=W0MDRE9YO3UP upload=D7R7574AJK8E tag=TH4SGUMXC7I1 type=write size=4156854 2024-09-14T11:15:22.966 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:22.968+0000 7f76c1e8a8c0 1 < completed delete operation key=OUMUTEBQ1TD0 tag=VIDTIRS64HMW type=del 2024-09-14T11:15:22.969 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:22.972+0000 7f76c1e8a8c0 1 > prepared operation key=SUNCRV0C1XYL tag=JT1H0PB2HYAU type=write size=456502 2024-09-14T11:15:22.972 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:22.972+0000 7f76c1e8a8c0 1 < completed delete operation key=SHKU2PRNREKK tag=RZ7RPB5783XJ type=del 2024-09-14T11:15:22.974 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:22.976+0000 7f76c1e8a8c0 1 > prepared operation key=BOCIF4TL7X7J tag=IR0R1HFZ3SG5 type=del size=4188020 2024-09-14T11:15:22.977 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:22.980+0000 7f76c1e8a8c0 1 < canceled operation key=MEVTZ7OAD4CA tag=S0DTRIO7DZ2D type=del size=2162575 2024-09-14T11:15:22.983 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:22.984+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_TZO40K6J9877.2~RYADCX65965K.0 size=1048576 2024-09-14T11:15:22.985 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:22.988+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_TZO40K6J9877.2~RYADCX65965K.1 size=442992 2024-09-14T11:15:22.985 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:22.988+0000 7f76c1e8a8c0 1 > prepared multipart upload key=TZO40K6J9877 upload=RYADCX65965K tag=0PDKDCMWFHHX type=write size=2540144 2024-09-14T11:15:22.988 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:22.988+0000 7f76c1e8a8c0 1 < completed delete operation key=6TIJR323NMOH tag=SHPT5HW220JQ type=del 2024-09-14T11:15:22.993 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:22.996+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_8PZOVFEYYSOG.2~3U2KCRXSRBI3.0 size=901380 2024-09-14T11:15:22.993 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:22.996+0000 7f76c1e8a8c0 1 > prepared multipart upload key=8PZOVFEYYSOG upload=3U2KCRXSRBI3 tag=EQNYNU2FFN9X type=write size=1949956 2024-09-14T11:15:22.996 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:22.996+0000 7f76c1e8a8c0 1 < completed part key=_multipart_MEVTZ7OAD4CA.2~9U1R7L08TI1I.0 size=1048576 2024-09-14T11:15:22.998 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:23.000+0000 7f76c1e8a8c0 1 < completed part key=_multipart_MEVTZ7OAD4CA.2~9U1R7L08TI1I.1 size=940573 2024-09-14T11:15:23.003 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:23.004+0000 7f76c1e8a8c0 1 < completed multipart upload key=MEVTZ7OAD4CA upload=9U1R7L08TI1I tag=0J4FBSB08S2H type=write size=3037725 2024-09-14T11:15:23.009 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:23.012+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_SHKU2PRNREKK.2~HB8H2XQZV1QC.0 size=242277 2024-09-14T11:15:23.009 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:23.012+0000 7f76c1e8a8c0 1 > prepared multipart upload key=SHKU2PRNREKK upload=HB8H2XQZV1QC tag=6SE8Q7UV01QP type=write size=1290853 2024-09-14T11:15:23.012 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:23.012+0000 7f76c1e8a8c0 1 < completed part key=_multipart_HJ701768A6I7.2~CX96D3DQDYZI.0 size=1048576 2024-09-14T11:15:23.012 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:23.012+0000 7f76c1e8a8c0 1 < canceled part key=_multipart_HJ701768A6I7.2~CX96D3DQDYZI.1 size=1048576 2024-09-14T11:15:23.012 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:23.012+0000 7f76c1e8a8c0 1 < canceled part key=_multipart_HJ701768A6I7.2~CX96D3DQDYZI.2 size=608374 2024-09-14T11:15:23.017 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:23.020+0000 7f76c1e8a8c0 1 < canceled multipart upload key=HJ701768A6I7 upload=CX96D3DQDYZI tag=RIIZGWSII90C type=write size=3754102 2024-09-14T11:15:23.019 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:23.020+0000 7f76c1e8a8c0 1 > prepared operation key=H9CQV6L29SL5 tag=IY96MW3G9IOI type=del size=2857086 2024-09-14T11:15:23.023 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:23.024+0000 7f76c1e8a8c0 1 < completed part key=_multipart_BOCIF4TL7X7J.2~YU56VATP35P5.0 size=1048576 2024-09-14T11:15:23.025 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:23.028+0000 7f76c1e8a8c0 1 < completed part key=_multipart_BOCIF4TL7X7J.2~YU56VATP35P5.1 size=826581 2024-09-14T11:15:23.031 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:23.032+0000 7f76c1e8a8c0 1 < completed multipart upload key=BOCIF4TL7X7J upload=YU56VATP35P5 tag=974M3RTGDADY type=write size=2923733 2024-09-14T11:15:23.033 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:23.036+0000 7f76c1e8a8c0 1 > prepared operation key=R5I9H7WAK7Z7 tag=2469DDPK9UEM type=del size=1016630 2024-09-14T11:15:23.037 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:23.040+0000 7f76c1e8a8c0 1 < completed part key=_multipart_W0MDRE9YO3UP.2~W030DGQBC63V.0 size=1048576 2024-09-14T11:15:23.039 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:23.040+0000 7f76c1e8a8c0 1 < completed part key=_multipart_W0MDRE9YO3UP.2~W030DGQBC63V.1 size=1048576 2024-09-14T11:15:23.042 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:23.044+0000 7f76c1e8a8c0 1 < completed part key=_multipart_W0MDRE9YO3UP.2~W030DGQBC63V.2 size=405714 2024-09-14T11:15:23.047 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:23.048+0000 7f76c1e8a8c0 1 < completed multipart upload key=W0MDRE9YO3UP upload=W030DGQBC63V tag=J86GK09J1H89 type=write size=3551442 2024-09-14T11:15:23.051 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:23.052+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_OOUEM16XL80W.2~4BSWFNM2A0SK.0 size=1048576 2024-09-14T11:15:23.057 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:23.060+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_OOUEM16XL80W.2~4BSWFNM2A0SK.1 size=611185 2024-09-14T11:15:23.057 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:23.060+0000 7f76c1e8a8c0 1 > prepared multipart upload key=OOUEM16XL80W upload=4BSWFNM2A0SK tag=W0KRTUH6AB2S type=write size=2708337 2024-09-14T11:15:23.060 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:23.064+0000 7f76c1e8a8c0 -1 < failed to complete operation key=CIRQT9IDJ5OJ tag=OR6KYGJNMTT3 type=del size=1040850: (22) Invalid argument 2024-09-14T11:15:23.066 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:23.068+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_K2EEZLRK7MVO.2~X534PXHMNSPT.0 size=112959 2024-09-14T11:15:23.066 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:23.068+0000 7f76c1e8a8c0 1 > prepared multipart upload key=K2EEZLRK7MVO upload=X534PXHMNSPT tag=0GJNURAXWLET type=write size=1161535 2024-09-14T11:15:23.072 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:23.076+0000 7f76c1e8a8c0 1 < suggested remove operation key=Q5IY4J5FOD80 tag=OLKBLTXGX0SN type=del 2024-09-14T11:15:23.076 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:23.076+0000 7f76c1e8a8c0 1 > prepared operation key=K9W031V6BFJP tag=GZFKNJD3QDD6 type=del size=668239 2024-09-14T11:15:23.079 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:23.080+0000 7f76c1e8a8c0 1 < completed part key=_multipart_6TIJR323NMOH.2~0F70HMW6VCX0.0 size=1048576 2024-09-14T11:15:23.082 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:23.084+0000 7f76c1e8a8c0 1 < completed part key=_multipart_6TIJR323NMOH.2~0F70HMW6VCX0.1 size=350480 2024-09-14T11:15:23.087 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:23.088+0000 7f76c1e8a8c0 1 < completed multipart upload key=6TIJR323NMOH upload=0F70HMW6VCX0 tag=ODREP7UHH13V type=write size=2447632 2024-09-14T11:15:23.093 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:23.096+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_LZ0YNFOVFYCL.2~EQ3J2MHNK32M.0 size=1048576 2024-09-14T11:15:23.096 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:23.100+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_LZ0YNFOVFYCL.2~EQ3J2MHNK32M.1 size=1048576 2024-09-14T11:15:23.098 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:23.100+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_LZ0YNFOVFYCL.2~EQ3J2MHNK32M.2 size=325822 2024-09-14T11:15:23.099 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:23.100+0000 7f76c1e8a8c0 1 > prepared multipart upload key=LZ0YNFOVFYCL upload=EQ3J2MHNK32M tag=F8UE9LNSQ1FS type=write size=3471550 2024-09-14T11:15:23.101 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:23.104+0000 7f76c1e8a8c0 1 < completed part key=_multipart_OOUEM16XL80W.2~1X47MZ7NPVYE.0 size=1048576 2024-09-14T11:15:23.104 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:23.108+0000 7f76c1e8a8c0 1 < completed part key=_multipart_OOUEM16XL80W.2~1X47MZ7NPVYE.1 size=1048576 2024-09-14T11:15:23.107 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:23.108+0000 7f76c1e8a8c0 1 < completed part key=_multipart_OOUEM16XL80W.2~1X47MZ7NPVYE.2 size=206131 2024-09-14T11:15:23.112 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:23.116+0000 7f76c1e8a8c0 1 < completed multipart upload key=OOUEM16XL80W upload=1X47MZ7NPVYE tag=671V2YF2BDH4 type=write size=3351859 2024-09-14T11:15:23.115 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:23.116+0000 7f76c1e8a8c0 1 > prepared operation key=OUMUTEBQ1TD0 tag=I6V0B59DQ9GP type=del size=3756929 2024-09-14T11:15:23.118 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:23.120+0000 7f76c1e8a8c0 1 < completed part key=_multipart_S43U13LYETS4.2~GPY5VPS0JK6T.0 size=1048576 2024-09-14T11:15:23.121 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:23.124+0000 7f76c1e8a8c0 1 < completed part key=_multipart_S43U13LYETS4.2~GPY5VPS0JK6T.1 size=632630 2024-09-14T11:15:23.126 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:23.128+0000 7f76c1e8a8c0 1 < completed multipart upload key=S43U13LYETS4 upload=GPY5VPS0JK6T tag=JD9SCUTTM5CW type=write size=2729782 2024-09-14T11:15:23.129 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:23.132+0000 7f76c1e8a8c0 1 > prepared operation key=R5I9H7WAK7Z7 tag=QKKENTK9V629 type=del size=37455 2024-09-14T11:15:23.132 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:23.136+0000 7f76c1e8a8c0 1 < completed delete operation key=SHKU2PRNREKK tag=VTU579RHH7IE type=del 2024-09-14T11:15:23.135 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:23.136+0000 7f76c1e8a8c0 1 > prepared operation key=1K8ESNXU6WDF tag=7646VBAL3BOW type=del size=297097 2024-09-14T11:15:23.138 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:23.140+0000 7f76c1e8a8c0 1 < completed part key=_multipart_CIRQT9IDJ5OJ.2~0TTGZ8PBYA7I.0 size=972931 2024-09-14T11:15:23.143 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:23.144+0000 7f76c1e8a8c0 1 < completed multipart upload key=CIRQT9IDJ5OJ upload=0TTGZ8PBYA7I tag=YF4TOJ0XH9V3 type=write size=2021507 2024-09-14T11:15:23.149 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:23.152+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_XC8VWSHZOPFP.2~D7YRFY1OZD8L.0 size=93233 2024-09-14T11:15:23.149 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:23.152+0000 7f76c1e8a8c0 1 > prepared multipart upload key=XC8VWSHZOPFP upload=D7YRFY1OZD8L tag=WGCJSHTX9GTY type=write size=1141809 2024-09-14T11:15:23.152 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:23.152+0000 7f76c1e8a8c0 1 < completed part key=_multipart_W0MDRE9YO3UP.2~D7R7574AJK8E.0 size=1048576 2024-09-14T11:15:23.154 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:23.156+0000 7f76c1e8a8c0 1 < completed part key=_multipart_W0MDRE9YO3UP.2~D7R7574AJK8E.1 size=1048576 2024-09-14T11:15:23.157 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:23.160+0000 7f76c1e8a8c0 1 < completed part key=_multipart_W0MDRE9YO3UP.2~D7R7574AJK8E.2 size=1011126 2024-09-14T11:15:23.162 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:23.164+0000 7f76c1e8a8c0 1 < completed multipart upload key=W0MDRE9YO3UP upload=D7R7574AJK8E tag=TH4SGUMXC7I1 type=write size=4156854 2024-09-14T11:15:23.168 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:23.168+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_TZO40K6J9877.2~MKWDCY12LWSZ.0 size=1048576 2024-09-14T11:15:23.170 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:23.172+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_TZO40K6J9877.2~MKWDCY12LWSZ.1 size=1048576 2024-09-14T11:15:23.173 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:23.176+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_TZO40K6J9877.2~MKWDCY12LWSZ.2 size=233173 2024-09-14T11:15:23.173 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:23.176+0000 7f76c1e8a8c0 1 > prepared multipart upload key=TZO40K6J9877 upload=MKWDCY12LWSZ tag=JD3DMKSV5WOC type=write size=3378901 2024-09-14T11:15:23.179 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:23.180+0000 7f76c1e8a8c0 1 < suggested update operation key=SUNCRV0C1XYL tag=JT1H0PB2HYAU type=write size=456502 2024-09-14T11:15:23.182 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:23.184+0000 7f76c1e8a8c0 1 > prepared operation key=TZO40K6J9877 tag=M5S27YDHBP0X type=del size=1236078 2024-09-14T11:15:23.185 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:23.188+0000 7f76c1e8a8c0 1 < completed delete operation key=BOCIF4TL7X7J tag=IR0R1HFZ3SG5 type=del 2024-09-14T11:15:23.188 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:23.192+0000 7f76c1e8a8c0 1 > prepared operation key=TZO40K6J9877 tag=35SMU48BNYZ0 type=write size=525134 2024-09-14T11:15:23.191 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:23.192+0000 7f76c1e8a8c0 1 < completed part key=_multipart_TZO40K6J9877.2~RYADCX65965K.0 size=1048576 2024-09-14T11:15:23.194 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:23.196+0000 7f76c1e8a8c0 1 < completed part key=_multipart_TZO40K6J9877.2~RYADCX65965K.1 size=442992 2024-09-14T11:15:23.199 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:23.200+0000 7f76c1e8a8c0 1 < completed multipart upload key=TZO40K6J9877 upload=RYADCX65965K tag=0PDKDCMWFHHX type=write size=2540144 2024-09-14T11:15:23.205 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:23.208+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_K2EEZLRK7MVO.2~7W2TXH5R2BHG.0 size=1048576 2024-09-14T11:15:23.207 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:23.208+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_K2EEZLRK7MVO.2~7W2TXH5R2BHG.1 size=25028 2024-09-14T11:15:23.208 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:23.208+0000 7f76c1e8a8c0 1 > prepared multipart upload key=K2EEZLRK7MVO upload=7W2TXH5R2BHG tag=M7SAHFMK1UAM type=write size=2122180 2024-09-14T11:15:23.211 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:23.212+0000 7f76c1e8a8c0 1 < completed part key=_multipart_8PZOVFEYYSOG.2~3U2KCRXSRBI3.0 size=901380 2024-09-14T11:15:23.216 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:23.220+0000 7f76c1e8a8c0 1 < completed multipart upload key=8PZOVFEYYSOG upload=3U2KCRXSRBI3 tag=EQNYNU2FFN9X type=write size=1949956 2024-09-14T11:15:23.219 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:23.220+0000 7f76c1e8a8c0 1 > prepared operation key=K2EEZLRK7MVO tag=AY88AP3MHE7S type=write size=522196 2024-09-14T11:15:23.223 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:23.224+0000 7f76c1e8a8c0 1 < completed part key=_multipart_SHKU2PRNREKK.2~HB8H2XQZV1QC.0 size=242277 2024-09-14T11:15:23.228 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:23.232+0000 7f76c1e8a8c0 1 < completed multipart upload key=SHKU2PRNREKK upload=HB8H2XQZV1QC tag=6SE8Q7UV01QP type=write size=1290853 2024-09-14T11:15:23.231 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:23.232+0000 7f76c1e8a8c0 1 > prepared operation key=SUNCRV0C1XYL tag=43CPFUBP3C5K type=del size=3818456 2024-09-14T11:15:23.234 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:23.236+0000 7f76c1e8a8c0 1 < canceled operation key=H9CQV6L29SL5 tag=IY96MW3G9IOI type=del size=2857086 2024-09-14T11:15:23.237 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:23.240+0000 7f76c1e8a8c0 1 > prepared operation key=1W5733SDHGDN tag=7RDXE9DCNA0Q type=del size=2929889 2024-09-14T11:15:23.241 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:23.244+0000 7f76c1e8a8c0 1 < completed delete operation key=R5I9H7WAK7Z7 tag=2469DDPK9UEM type=del 2024-09-14T11:15:23.246 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:23.248+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_K2EEZLRK7MVO.2~NGVDVDHKXHP1.0 size=1048576 2024-09-14T11:15:23.249 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:23.252+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_K2EEZLRK7MVO.2~NGVDVDHKXHP1.1 size=1048576 2024-09-14T11:15:23.251 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:23.252+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_K2EEZLRK7MVO.2~NGVDVDHKXHP1.2 size=616363 2024-09-14T11:15:23.251 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:23.252+0000 7f76c1e8a8c0 1 > prepared multipart upload key=K2EEZLRK7MVO upload=NGVDVDHKXHP1 tag=P8R44Y1814GK type=write size=3762091 2024-09-14T11:15:23.255 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:23.256+0000 7f76c1e8a8c0 1 < completed part key=_multipart_OOUEM16XL80W.2~4BSWFNM2A0SK.0 size=1048576 2024-09-14T11:15:23.257 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:23.260+0000 7f76c1e8a8c0 1 < completed part key=_multipart_OOUEM16XL80W.2~4BSWFNM2A0SK.1 size=611185 2024-09-14T11:15:23.263 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:23.264+0000 7f76c1e8a8c0 1 < completed multipart upload key=OOUEM16XL80W upload=4BSWFNM2A0SK tag=W0KRTUH6AB2S type=write size=2708337 2024-09-14T11:15:23.266 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:23.268+0000 7f76c1e8a8c0 1 > prepared operation key=F3KFS0P1WM7W tag=0EH2EBR8R58U type=del size=533133 2024-09-14T11:15:23.269 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:23.272+0000 7f76c1e8a8c0 1 < completed part key=_multipart_K2EEZLRK7MVO.2~X534PXHMNSPT.0 size=112959 2024-09-14T11:15:23.275 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:23.276+0000 7f76c1e8a8c0 1 < completed multipart upload key=K2EEZLRK7MVO upload=X534PXHMNSPT tag=0GJNURAXWLET type=write size=1161535 2024-09-14T11:15:23.279 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:23.280+0000 7f76c1e8a8c0 1 > prepared operation key=LZ0YNFOVFYCL tag=CCUOSGXXWC00 type=write size=847845 2024-09-14T11:15:23.282 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:23.284+0000 7f76c1e8a8c0 1 < completed delete operation key=K9W031V6BFJP tag=GZFKNJD3QDD6 type=del 2024-09-14T11:15:23.288 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:23.292+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_K9W031V6BFJP.2~A3MBUP07ROEU.0 size=1048576 2024-09-14T11:15:23.291 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:23.292+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_K9W031V6BFJP.2~A3MBUP07ROEU.1 size=539565 2024-09-14T11:15:23.291 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:23.292+0000 7f76c1e8a8c0 1 > prepared multipart upload key=K9W031V6BFJP upload=A3MBUP07ROEU tag=BGNVFY06D80U type=write size=2636717 2024-09-14T11:15:23.294 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:23.296+0000 7f76c1e8a8c0 1 < completed part key=_multipart_LZ0YNFOVFYCL.2~EQ3J2MHNK32M.0 size=1048576 2024-09-14T11:15:23.297 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:23.300+0000 7f76c1e8a8c0 1 < completed part key=_multipart_LZ0YNFOVFYCL.2~EQ3J2MHNK32M.1 size=1048576 2024-09-14T11:15:23.300 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:23.304+0000 7f76c1e8a8c0 1 < completed part key=_multipart_LZ0YNFOVFYCL.2~EQ3J2MHNK32M.2 size=325822 2024-09-14T11:15:23.306 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:23.308+0000 7f76c1e8a8c0 1 < completed multipart upload key=LZ0YNFOVFYCL upload=EQ3J2MHNK32M tag=F8UE9LNSQ1FS type=write size=3471550 2024-09-14T11:15:23.309 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:23.312+0000 7f76c1e8a8c0 1 > prepared operation key=BOCIF4TL7X7J tag=Q9WS477TJANW type=del size=414423 2024-09-14T11:15:23.312 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:23.316+0000 7f76c1e8a8c0 1 < completed delete operation key=OUMUTEBQ1TD0 tag=I6V0B59DQ9GP type=del 2024-09-14T11:15:23.316 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:23.320+0000 7f76c1e8a8c0 1 > prepared operation key=F3KFS0P1WM7W tag=AJ0W3KTDAZGC type=write size=923470 2024-09-14T11:15:23.322 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:23.324+0000 7f76c1e8a8c0 1 < suggested remove operation key=R5I9H7WAK7Z7 tag=QKKENTK9V629 type=del 2024-09-14T11:15:23.329 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:23.332+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_BOCIF4TL7X7J.2~C5OOGOCB2UKN.0 size=360968 2024-09-14T11:15:23.329 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:23.332+0000 7f76c1e8a8c0 1 > prepared multipart upload key=BOCIF4TL7X7J upload=C5OOGOCB2UKN tag=ZW8PFS7C2FB0 type=write size=1409544 2024-09-14T11:15:23.335 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:23.336+0000 7f76c1e8a8c0 1 < suggested update operation key=1K8ESNXU6WDF tag=7646VBAL3BOW type=del size=297097 2024-09-14T11:15:23.339 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:23.340+0000 7f76c1e8a8c0 1 > prepared operation key=W0MDRE9YO3UP tag=D4SWVNIX7H9H type=write size=392098 2024-09-14T11:15:23.343 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:23.344+0000 7f76c1e8a8c0 1 < completed part key=_multipart_XC8VWSHZOPFP.2~D7YRFY1OZD8L.0 size=93233 2024-09-14T11:15:23.348 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:23.352+0000 7f76c1e8a8c0 1 < completed multipart upload key=XC8VWSHZOPFP upload=D7YRFY1OZD8L tag=WGCJSHTX9GTY type=write size=1141809 2024-09-14T11:15:23.356 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:23.360+0000 7f76c1e8a8c0 1 > prepared operation key=VI61O3K069BP tag=XE0Q8D5HJD37 type=del size=4084872 2024-09-14T11:15:23.360 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:23.364+0000 7f76c1e8a8c0 1 < completed part key=_multipart_TZO40K6J9877.2~MKWDCY12LWSZ.0 size=1048576 2024-09-14T11:15:23.363 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:23.364+0000 7f76c1e8a8c0 1 < completed part key=_multipart_TZO40K6J9877.2~MKWDCY12LWSZ.1 size=1048576 2024-09-14T11:15:23.366 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:23.368+0000 7f76c1e8a8c0 1 < completed part key=_multipart_TZO40K6J9877.2~MKWDCY12LWSZ.2 size=233173 2024-09-14T11:15:23.372 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:23.376+0000 7f76c1e8a8c0 1 < completed multipart upload key=TZO40K6J9877 upload=MKWDCY12LWSZ tag=JD3DMKSV5WOC type=write size=3378901 2024-09-14T11:15:23.379 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:23.380+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_CIRQT9IDJ5OJ.2~QKQ1TRTEE5LM.0 size=411373 2024-09-14T11:15:23.379 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:23.380+0000 7f76c1e8a8c0 1 > prepared multipart upload key=CIRQT9IDJ5OJ upload=QKQ1TRTEE5LM tag=B46ELSNFXVSW type=write size=1459949 2024-09-14T11:15:23.383 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:23.384+0000 7f76c1e8a8c0 1 < completed delete operation key=TZO40K6J9877 tag=M5S27YDHBP0X type=del 2024-09-14T11:15:23.386 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:23.388+0000 7f76c1e8a8c0 1 > prepared operation key=OUMUTEBQ1TD0 tag=0KZHYECDTN30 type=del size=4102318 2024-09-14T11:15:23.393 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:23.396+0000 7f76c1e8a8c0 1 < suggested remove operation key=TZO40K6J9877 tag=35SMU48BNYZ0 type=write 2024-09-14T11:15:23.399 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:23.400+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_VI61O3K069BP.2~EKW4DYUSLWLL.0 size=1048576 2024-09-14T11:15:23.403 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:23.404+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_VI61O3K069BP.2~EKW4DYUSLWLL.1 size=873919 2024-09-14T11:15:23.403 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:23.404+0000 7f76c1e8a8c0 1 > prepared multipart upload key=VI61O3K069BP upload=EKW4DYUSLWLL tag=0CLH2QI1BX89 type=write size=2971071 2024-09-14T11:15:23.406 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:23.408+0000 7f76c1e8a8c0 1 < completed part key=_multipart_K2EEZLRK7MVO.2~7W2TXH5R2BHG.0 size=1048576 2024-09-14T11:15:23.410 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:23.412+0000 7f76c1e8a8c0 1 < completed part key=_multipart_K2EEZLRK7MVO.2~7W2TXH5R2BHG.1 size=25028 2024-09-14T11:15:23.417 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:23.420+0000 7f76c1e8a8c0 1 < completed multipart upload key=K2EEZLRK7MVO upload=7W2TXH5R2BHG tag=M7SAHFMK1UAM type=write size=2122180 2024-09-14T11:15:23.421 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:23.424+0000 7f76c1e8a8c0 1 > prepared operation key=BOCIF4TL7X7J tag=GCOFMDWLDS0A type=del size=3273731 2024-09-14T11:15:23.424 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:23.428+0000 7f76c1e8a8c0 1 < completed write operation key=K2EEZLRK7MVO tag=AY88AP3MHE7S type=write size=522196 2024-09-14T11:15:23.429 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:23.432+0000 7f76c1e8a8c0 1 > prepared operation key=LZ0YNFOVFYCL tag=5LAHKN32MXRV type=del size=926059 2024-09-14T11:15:23.433 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:23.436+0000 7f76c1e8a8c0 1 < completed delete operation key=SUNCRV0C1XYL tag=43CPFUBP3C5K type=del 2024-09-14T11:15:23.439 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:23.440+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_XC8VWSHZOPFP.2~1MYA0TFI4GRO.0 size=1048576 2024-09-14T11:15:23.442 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:23.444+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_XC8VWSHZOPFP.2~1MYA0TFI4GRO.1 size=1048576 2024-09-14T11:15:23.445 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:23.448+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_XC8VWSHZOPFP.2~1MYA0TFI4GRO.2 size=147374 2024-09-14T11:15:23.445 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:23.448+0000 7f76c1e8a8c0 1 > prepared multipart upload key=XC8VWSHZOPFP upload=1MYA0TFI4GRO tag=JJ416GFU5DBS type=write size=3293102 2024-09-14T11:15:23.448 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:23.452+0000 7f76c1e8a8c0 1 < canceled operation key=1W5733SDHGDN tag=7RDXE9DCNA0Q type=del size=2929889 2024-09-14T11:15:23.452 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:23.452+0000 7f76c1e8a8c0 1 > prepared operation key=XC8VWSHZOPFP tag=9H0OJBQDXQTR type=del size=2853733 2024-09-14T11:15:23.455 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:23.456+0000 7f76c1e8a8c0 1 < completed part key=_multipart_K2EEZLRK7MVO.2~NGVDVDHKXHP1.0 size=1048576 2024-09-14T11:15:23.458 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:23.460+0000 7f76c1e8a8c0 1 < completed part key=_multipart_K2EEZLRK7MVO.2~NGVDVDHKXHP1.1 size=1048576 2024-09-14T11:15:23.460 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:23.464+0000 7f76c1e8a8c0 1 < completed part key=_multipart_K2EEZLRK7MVO.2~NGVDVDHKXHP1.2 size=616363 2024-09-14T11:15:23.467 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:23.468+0000 7f76c1e8a8c0 1 < completed multipart upload key=K2EEZLRK7MVO upload=NGVDVDHKXHP1 tag=P8R44Y1814GK type=write size=3762091 2024-09-14T11:15:23.470 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:23.472+0000 7f76c1e8a8c0 1 > prepared operation key=K9W031V6BFJP tag=HW9M1P40JX3Y type=del size=307459 2024-09-14T11:15:23.473 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:23.476+0000 7f76c1e8a8c0 1 < completed delete operation key=F3KFS0P1WM7W tag=0EH2EBR8R58U type=del 2024-09-14T11:15:23.477 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:23.480+0000 7f76c1e8a8c0 1 > prepared operation key=TUFOZKTV9XIH tag=05I34CM5MT5W type=del size=3468220 2024-09-14T11:15:23.480 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:23.484+0000 7f76c1e8a8c0 1 < completed write operation key=LZ0YNFOVFYCL tag=CCUOSGXXWC00 type=write size=847845 2024-09-14T11:15:23.484 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:23.488+0000 7f76c1e8a8c0 1 > prepared operation key=R5I9H7WAK7Z7 tag=WG65S23IDYX4 type=del size=2683957 2024-09-14T11:15:23.488 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:23.488+0000 7f76c1e8a8c0 1 < completed part key=_multipart_K9W031V6BFJP.2~A3MBUP07ROEU.0 size=1048576 2024-09-14T11:15:23.491 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:23.492+0000 7f76c1e8a8c0 1 < completed part key=_multipart_K9W031V6BFJP.2~A3MBUP07ROEU.1 size=539565 2024-09-14T11:15:23.497 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:23.500+0000 7f76c1e8a8c0 1 < completed multipart upload key=K9W031V6BFJP upload=A3MBUP07ROEU tag=BGNVFY06D80U type=write size=2636717 2024-09-14T11:15:23.501 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:23.504+0000 7f76c1e8a8c0 1 > prepared operation key=Q5IY4J5FOD80 tag=KQ7DJKQ9HPQV type=del size=4053096 2024-09-14T11:15:23.505 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:23.508+0000 7f76c1e8a8c0 1 < completed delete operation key=BOCIF4TL7X7J tag=Q9WS477TJANW type=del 2024-09-14T11:15:23.509 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:23.512+0000 7f76c1e8a8c0 1 > prepared operation key=OUMUTEBQ1TD0 tag=2HHNJIY5G0SA type=del size=757022 2024-09-14T11:15:23.513 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:23.516+0000 7f76c1e8a8c0 1 < completed write operation key=F3KFS0P1WM7W tag=AJ0W3KTDAZGC type=write size=923470 2024-09-14T11:15:23.519 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:23.520+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_GZM0AQVHNCMM.2~1HHNNS831A2E.0 size=1048576 2024-09-14T11:15:23.522 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:23.524+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_GZM0AQVHNCMM.2~1HHNNS831A2E.1 size=1048576 2024-09-14T11:15:23.524 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:23.528+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_GZM0AQVHNCMM.2~1HHNNS831A2E.2 size=627856 2024-09-14T11:15:23.525 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:23.528+0000 7f76c1e8a8c0 1 > prepared multipart upload key=GZM0AQVHNCMM upload=1HHNNS831A2E tag=4ACDGLSXWZO5 type=write size=3773584 2024-09-14T11:15:23.528 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:23.528+0000 7f76c1e8a8c0 1 < completed part key=_multipart_BOCIF4TL7X7J.2~C5OOGOCB2UKN.0 size=360968 2024-09-14T11:15:23.533 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:23.536+0000 7f76c1e8a8c0 1 < completed multipart upload key=BOCIF4TL7X7J upload=C5OOGOCB2UKN tag=ZW8PFS7C2FB0 type=write size=1409544 2024-09-14T11:15:23.536 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:23.540+0000 7f76c1e8a8c0 1 > prepared operation key=TZO40K6J9877 tag=1V6AWNKX9TBL type=del size=1426504 2024-09-14T11:15:23.539 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:23.540+0000 7f76c1e8a8c0 1 < completed write operation key=W0MDRE9YO3UP tag=D4SWVNIX7H9H type=write size=392098 2024-09-14T11:15:23.545 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:23.548+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_R5I9H7WAK7Z7.2~5B2R7KGJBN99.0 size=539892 2024-09-14T11:15:23.545 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:23.548+0000 7f76c1e8a8c0 1 > prepared multipart upload key=R5I9H7WAK7Z7 upload=5B2R7KGJBN99 tag=CFL5RH6QEE89 type=write size=1588468 2024-09-14T11:15:23.549 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:23.552+0000 7f76c1e8a8c0 1 < completed delete operation key=VI61O3K069BP tag=XE0Q8D5HJD37 type=del 2024-09-14T11:15:23.552 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:23.556+0000 7f76c1e8a8c0 1 > prepared operation key=VI61O3K069BP tag=LZJJVG8M5TLV type=del size=3447998 2024-09-14T11:15:23.556 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:23.560+0000 7f76c1e8a8c0 1 < completed part key=_multipart_CIRQT9IDJ5OJ.2~QKQ1TRTEE5LM.0 size=411373 2024-09-14T11:15:23.562 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:23.564+0000 7f76c1e8a8c0 1 < completed multipart upload key=CIRQT9IDJ5OJ upload=QKQ1TRTEE5LM tag=B46ELSNFXVSW type=write size=1459949 2024-09-14T11:15:23.566 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:23.568+0000 7f76c1e8a8c0 1 > prepared operation key=OOUEM16XL80W tag=JXZ43IKM4196 type=del size=1344042 2024-09-14T11:15:23.573 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:23.576+0000 7f76c1e8a8c0 1 < suggested update operation key=OUMUTEBQ1TD0 tag=0KZHYECDTN30 type=del size=4102318 2024-09-14T11:15:23.576 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:23.580+0000 7f76c1e8a8c0 1 > prepared operation key=R5I9H7WAK7Z7 tag=961VKPXID3HT type=del size=1167129 2024-09-14T11:15:23.580 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:23.580+0000 7f76c1e8a8c0 1 < completed part key=_multipart_VI61O3K069BP.2~EKW4DYUSLWLL.0 size=1048576 2024-09-14T11:15:23.582 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:23.584+0000 7f76c1e8a8c0 1 < completed part key=_multipart_VI61O3K069BP.2~EKW4DYUSLWLL.1 size=873919 2024-09-14T11:15:23.588 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:23.588+0000 7f76c1e8a8c0 1 < completed multipart upload key=VI61O3K069BP upload=EKW4DYUSLWLL tag=0CLH2QI1BX89 type=write size=2971071 2024-09-14T11:15:23.591 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:23.592+0000 7f76c1e8a8c0 1 > prepared operation key=F3KFS0P1WM7W tag=YC83KGQ95T1D type=del size=897691 2024-09-14T11:15:23.598 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:23.600+0000 7f76c1e8a8c0 1 < suggested update operation key=BOCIF4TL7X7J tag=GCOFMDWLDS0A type=del size=3273731 2024-09-14T11:15:23.601 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:23.604+0000 7f76c1e8a8c0 1 > prepared operation key=HJ701768A6I7 tag=P43MZ7PTYC0Z type=del size=869921 2024-09-14T11:15:23.605 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:23.608+0000 7f76c1e8a8c0 1 < canceled operation key=LZ0YNFOVFYCL tag=5LAHKN32MXRV type=del size=926059 2024-09-14T11:15:23.608 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:23.612+0000 7f76c1e8a8c0 1 > prepared operation key=BOCIF4TL7X7J tag=MAMCOBMR5R0N type=del size=2744232 2024-09-14T11:15:23.611 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:23.612+0000 7f76c1e8a8c0 1 < completed part key=_multipart_XC8VWSHZOPFP.2~1MYA0TFI4GRO.0 size=1048576 2024-09-14T11:15:23.614 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:23.616+0000 7f76c1e8a8c0 1 < completed part key=_multipart_XC8VWSHZOPFP.2~1MYA0TFI4GRO.1 size=1048576 2024-09-14T11:15:23.617 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:23.620+0000 7f76c1e8a8c0 1 < completed part key=_multipart_XC8VWSHZOPFP.2~1MYA0TFI4GRO.2 size=147374 2024-09-14T11:15:23.623 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:23.624+0000 7f76c1e8a8c0 1 < completed multipart upload key=XC8VWSHZOPFP upload=1MYA0TFI4GRO tag=JJ416GFU5DBS type=write size=3293102 2024-09-14T11:15:23.626 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:23.628+0000 7f76c1e8a8c0 1 > prepared operation key=MEVTZ7OAD4CA tag=W170S3CLURF7 type=write size=465406 2024-09-14T11:15:23.633 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:23.636+0000 7f76c1e8a8c0 1 < suggested remove operation key=XC8VWSHZOPFP tag=9H0OJBQDXQTR type=del 2024-09-14T11:15:23.636 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:23.640+0000 7f76c1e8a8c0 1 > prepared operation key=6TIJR323NMOH tag=E7K6D4I1HH7S type=del size=2298417 2024-09-14T11:15:23.639 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:23.640+0000 7f76c1e8a8c0 1 < completed delete operation key=K9W031V6BFJP tag=HW9M1P40JX3Y type=del 2024-09-14T11:15:23.642 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:23.644+0000 7f76c1e8a8c0 1 > prepared operation key=1W5733SDHGDN tag=FRU6JW490CN4 type=del size=3674182 2024-09-14T11:15:23.646 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:23.648+0000 7f76c1e8a8c0 1 < canceled operation key=TUFOZKTV9XIH tag=05I34CM5MT5W type=del size=3468220 2024-09-14T11:15:23.649 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:23.652+0000 7f76c1e8a8c0 1 > prepared operation key=F3KFS0P1WM7W tag=SRJB7V7Y07E8 type=del size=3553541 2024-09-14T11:15:23.653 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:23.656+0000 7f76c1e8a8c0 1 < completed delete operation key=R5I9H7WAK7Z7 tag=WG65S23IDYX4 type=del 2024-09-14T11:15:23.656 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:23.656+0000 7f76c1e8a8c0 1 > prepared operation key=1W5733SDHGDN tag=0M9BSK4CSOYL type=del size=261309 2024-09-14T11:15:23.659 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:23.660+0000 7f76c1e8a8c0 1 < canceled operation key=Q5IY4J5FOD80 tag=KQ7DJKQ9HPQV type=del size=4053096 2024-09-14T11:15:23.665 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:23.668+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_SUNCRV0C1XYL.2~M6MCBGMDD7LK.0 size=1048576 2024-09-14T11:15:23.668 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:23.668+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_SUNCRV0C1XYL.2~M6MCBGMDD7LK.1 size=1048576 2024-09-14T11:15:23.670 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:23.672+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_SUNCRV0C1XYL.2~M6MCBGMDD7LK.2 size=634754 2024-09-14T11:15:23.671 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:23.672+0000 7f76c1e8a8c0 1 > prepared multipart upload key=SUNCRV0C1XYL upload=M6MCBGMDD7LK tag=M0TBVBZMPG8J type=write size=3780482 2024-09-14T11:15:23.677 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:23.680+0000 7f76c1e8a8c0 1 < suggested update operation key=OUMUTEBQ1TD0 tag=2HHNJIY5G0SA type=del size=757022 2024-09-14T11:15:23.687 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:23.688+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_6TIJR323NMOH.2~PR8Q35KNBY2C.0 size=730287 2024-09-14T11:15:23.687 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:23.688+0000 7f76c1e8a8c0 1 > prepared multipart upload key=6TIJR323NMOH upload=PR8Q35KNBY2C tag=J71I7IVG99M5 type=write size=1778863 2024-09-14T11:15:23.690 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:23.692+0000 7f76c1e8a8c0 1 < completed part key=_multipart_GZM0AQVHNCMM.2~1HHNNS831A2E.0 size=1048576 2024-09-14T11:15:23.691 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:23.692+0000 7f76c1e8a8c0 1 < canceled part key=_multipart_GZM0AQVHNCMM.2~1HHNNS831A2E.1 size=1048576 2024-09-14T11:15:23.693 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:23.696+0000 7f76c1e8a8c0 1 < completed part key=_multipart_GZM0AQVHNCMM.2~1HHNNS831A2E.2 size=627856 2024-09-14T11:15:23.699 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:23.700+0000 7f76c1e8a8c0 1 < canceled multipart upload key=GZM0AQVHNCMM upload=1HHNNS831A2E tag=4ACDGLSXWZO5 type=write size=3773584 2024-09-14T11:15:23.702 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:23.704+0000 7f76c1e8a8c0 1 > prepared operation key=85G6NT78HAWQ tag=89KD0BJT5Q0E type=del size=2099738 2024-09-14T11:15:23.706 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:23.708+0000 7f76c1e8a8c0 1 < completed delete operation key=TZO40K6J9877 tag=1V6AWNKX9TBL type=del 2024-09-14T11:15:23.712 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:23.712+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_HJ701768A6I7.2~N4EMDU8D0XAZ.0 size=903836 2024-09-14T11:15:23.712 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:23.712+0000 7f76c1e8a8c0 1 > prepared multipart upload key=HJ701768A6I7 upload=N4EMDU8D0XAZ tag=JM1D3WPDYGJI type=write size=1952412 2024-09-14T11:15:23.715 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:23.716+0000 7f76c1e8a8c0 1 < completed part key=_multipart_R5I9H7WAK7Z7.2~5B2R7KGJBN99.0 size=539892 2024-09-14T11:15:23.720 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:23.720+0000 7f76c1e8a8c0 1 < completed multipart upload key=R5I9H7WAK7Z7 upload=5B2R7KGJBN99 tag=CFL5RH6QEE89 type=write size=1588468 2024-09-14T11:15:23.723 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:23.724+0000 7f76c1e8a8c0 1 > prepared operation key=1K8ESNXU6WDF tag=YL65WGYOQWED type=del size=1617292 2024-09-14T11:15:23.726 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:23.728+0000 7f76c1e8a8c0 1 < completed delete operation key=VI61O3K069BP tag=LZJJVG8M5TLV type=del 2024-09-14T11:15:23.729 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:23.732+0000 7f76c1e8a8c0 1 > prepared operation key=H9CQV6L29SL5 tag=24825JNJ281X type=write size=17865 2024-09-14T11:15:23.732 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:23.736+0000 7f76c1e8a8c0 1 < completed delete operation key=OOUEM16XL80W tag=JXZ43IKM4196 type=del 2024-09-14T11:15:23.736 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:23.736+0000 7f76c1e8a8c0 1 > prepared operation key=F3KFS0P1WM7W tag=M6FW52NUEX7J type=write size=284365 2024-09-14T11:15:23.742 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:23.744+0000 7f76c1e8a8c0 1 < suggested remove operation key=R5I9H7WAK7Z7 tag=961VKPXID3HT type=del 2024-09-14T11:15:23.745 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:23.748+0000 7f76c1e8a8c0 1 > prepared operation key=R5I9H7WAK7Z7 tag=61RWXMK87P1M type=del size=1806105 2024-09-14T11:15:23.752 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:23.756+0000 7f76c1e8a8c0 1 < suggested update operation key=F3KFS0P1WM7W tag=YC83KGQ95T1D type=del size=897691 2024-09-14T11:15:23.755 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:23.756+0000 7f76c1e8a8c0 1 > prepared operation key=LZ0YNFOVFYCL tag=0FVVLPYEMBIJ type=del size=2786620 2024-09-14T11:15:23.759 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:23.760+0000 7f76c1e8a8c0 1 < completed delete operation key=HJ701768A6I7 tag=P43MZ7PTYC0Z type=del 2024-09-14T11:15:23.765 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:23.768+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_S43U13LYETS4.2~9PW6F9LLKB13.0 size=1048576 2024-09-14T11:15:23.768 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:23.768+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_S43U13LYETS4.2~9PW6F9LLKB13.1 size=802847 2024-09-14T11:15:23.768 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:23.768+0000 7f76c1e8a8c0 1 > prepared multipart upload key=S43U13LYETS4 upload=9PW6F9LLKB13 tag=8OHMIURT0RTJ type=write size=2899999 2024-09-14T11:15:23.771 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:23.772+0000 7f76c1e8a8c0 1 < completed delete operation key=BOCIF4TL7X7J tag=MAMCOBMR5R0N type=del 2024-09-14T11:15:23.775 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:23.776+0000 7f76c1e8a8c0 1 > prepared operation key=XC8VWSHZOPFP tag=XEKQXMX0MQXQ type=del size=1826681 2024-09-14T11:15:23.779 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:23.780+0000 7f76c1e8a8c0 1 < completed write operation key=MEVTZ7OAD4CA tag=W170S3CLURF7 type=write size=465406 2024-09-14T11:15:23.782 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:23.784+0000 7f76c1e8a8c0 1 > prepared operation key=HJ701768A6I7 tag=LFFLO3VD1R6T type=del size=1803327 2024-09-14T11:15:23.786 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:23.788+0000 7f76c1e8a8c0 1 < completed delete operation key=6TIJR323NMOH tag=E7K6D4I1HH7S type=del 2024-09-14T11:15:23.789 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:23.792+0000 7f76c1e8a8c0 1 > prepared operation key=1W5733SDHGDN tag=ETAXXBJ3TIY6 type=del size=2983988 2024-09-14T11:15:23.792 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:23.796+0000 7f76c1e8a8c0 1 < completed delete operation key=1W5733SDHGDN tag=FRU6JW490CN4 type=del 2024-09-14T11:15:23.796 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:23.800+0000 7f76c1e8a8c0 1 > prepared operation key=85G6NT78HAWQ tag=PM1VATQ3OQU9 type=write size=1839 2024-09-14T11:15:23.799 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:23.800+0000 7f76c1e8a8c0 -1 < failed to complete operation key=F3KFS0P1WM7W tag=SRJB7V7Y07E8 type=del size=3553541: (22) Invalid argument 2024-09-14T11:15:23.806 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:23.808+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_MEVTZ7OAD4CA.2~CCRUTD1YK9PX.0 size=569290 2024-09-14T11:15:23.806 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:23.808+0000 7f76c1e8a8c0 1 > prepared multipart upload key=MEVTZ7OAD4CA upload=CCRUTD1YK9PX tag=3H1M6OF02MLW type=write size=1617866 2024-09-14T11:15:23.813 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:23.816+0000 7f76c1e8a8c0 1 < suggested remove operation key=1W5733SDHGDN tag=0M9BSK4CSOYL type=del 2024-09-14T11:15:23.816 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:23.820+0000 7f76c1e8a8c0 1 > prepared operation key=BOCIF4TL7X7J tag=RM1I5AS9S9U9 type=del size=3787042 2024-09-14T11:15:23.820 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:23.820+0000 7f76c1e8a8c0 1 < completed part key=_multipart_SUNCRV0C1XYL.2~M6MCBGMDD7LK.0 size=1048576 2024-09-14T11:15:23.820 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:23.820+0000 7f76c1e8a8c0 1 < canceled part key=_multipart_SUNCRV0C1XYL.2~M6MCBGMDD7LK.1 size=1048576 2024-09-14T11:15:23.820 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:23.820+0000 7f76c1e8a8c0 1 < canceled part key=_multipart_SUNCRV0C1XYL.2~M6MCBGMDD7LK.2 size=634754 2024-09-14T11:15:23.825 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:23.828+0000 7f76c1e8a8c0 1 < canceled multipart upload key=SUNCRV0C1XYL upload=M6MCBGMDD7LK tag=M0TBVBZMPG8J type=write size=3780482 2024-09-14T11:15:23.829 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:23.832+0000 7f76c1e8a8c0 1 > prepared operation key=F3KFS0P1WM7W tag=7DD3QTCATUP8 type=del size=1031595 2024-09-14T11:15:23.833 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:23.836+0000 7f76c1e8a8c0 1 < completed part key=_multipart_6TIJR323NMOH.2~PR8Q35KNBY2C.0 size=730287 2024-09-14T11:15:23.838 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:23.840+0000 7f76c1e8a8c0 1 < completed multipart upload key=6TIJR323NMOH upload=PR8Q35KNBY2C tag=J71I7IVG99M5 type=write size=1778863 2024-09-14T11:15:23.845 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:23.848+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_6TIJR323NMOH.2~WELLBOD6Y590.0 size=1048576 2024-09-14T11:15:23.847 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:23.848+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_6TIJR323NMOH.2~WELLBOD6Y590.1 size=190 2024-09-14T11:15:23.848 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:23.848+0000 7f76c1e8a8c0 1 > prepared multipart upload key=6TIJR323NMOH upload=WELLBOD6Y590 tag=2NM3188JJH55 type=write size=2097342 2024-09-14T11:15:23.851 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:23.852+0000 7f76c1e8a8c0 1 < completed delete operation key=85G6NT78HAWQ tag=89KD0BJT5Q0E type=del 2024-09-14T11:15:23.855 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:23.856+0000 7f76c1e8a8c0 1 > prepared operation key=LZ0YNFOVFYCL tag=4AA69G8P9K8G type=del size=2060152 2024-09-14T11:15:23.859 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:23.860+0000 7f76c1e8a8c0 1 < completed part key=_multipart_HJ701768A6I7.2~N4EMDU8D0XAZ.0 size=903836 2024-09-14T11:15:23.864 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:23.864+0000 7f76c1e8a8c0 1 < completed multipart upload key=HJ701768A6I7 upload=N4EMDU8D0XAZ tag=JM1D3WPDYGJI type=write size=1952412 2024-09-14T11:15:23.867 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:23.868+0000 7f76c1e8a8c0 1 > prepared operation key=H9CQV6L29SL5 tag=5PHNXDZIN4UW type=del size=3254016 2024-09-14T11:15:23.871 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:23.872+0000 7f76c1e8a8c0 1 < completed delete operation key=1K8ESNXU6WDF tag=YL65WGYOQWED type=del 2024-09-14T11:15:23.877 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:23.880+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_R5I9H7WAK7Z7.2~8V35VCZELX6B.0 size=283779 2024-09-14T11:15:23.877 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:23.880+0000 7f76c1e8a8c0 1 > prepared multipart upload key=R5I9H7WAK7Z7 upload=8V35VCZELX6B tag=W55Y73VSGKU1 type=write size=1332355 2024-09-14T11:15:23.880 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:23.884+0000 7f76c1e8a8c0 1 < completed write operation key=H9CQV6L29SL5 tag=24825JNJ281X type=write size=17865 2024-09-14T11:15:23.883 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:23.884+0000 7f76c1e8a8c0 1 > prepared operation key=K9W031V6BFJP tag=NLBVYZLNTYM0 type=write size=304654 2024-09-14T11:15:23.886 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:23.888+0000 7f76c1e8a8c0 -1 < failed to complete operation key=F3KFS0P1WM7W tag=M6FW52NUEX7J type=write size=284365: (22) Invalid argument 2024-09-14T11:15:23.891 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:23.892+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_HS7T50JORDQJ.2~IECDO91843C3.0 size=1048576 2024-09-14T11:15:23.893 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:23.896+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_HS7T50JORDQJ.2~IECDO91843C3.1 size=479247 2024-09-14T11:15:23.893 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:23.896+0000 7f76c1e8a8c0 1 > prepared multipart upload key=HS7T50JORDQJ upload=IECDO91843C3 tag=35IXT9HX8C4J type=write size=2576399 2024-09-14T11:15:23.896 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:23.900+0000 7f76c1e8a8c0 1 < completed delete operation key=R5I9H7WAK7Z7 tag=61RWXMK87P1M type=del 2024-09-14T11:15:23.899 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:23.900+0000 7f76c1e8a8c0 1 > prepared operation key=TZO40K6J9877 tag=4IOKRF79S6LH type=del size=589247 2024-09-14T11:15:23.903 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:23.904+0000 7f76c1e8a8c0 1 < completed delete operation key=LZ0YNFOVFYCL tag=0FVVLPYEMBIJ type=del 2024-09-14T11:15:23.906 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:23.908+0000 7f76c1e8a8c0 1 > prepared operation key=GAVZRU8ZLW7S tag=NX6DE8UROP10 type=del size=1877123 2024-09-14T11:15:23.909 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:23.912+0000 7f76c1e8a8c0 1 < completed part key=_multipart_S43U13LYETS4.2~9PW6F9LLKB13.0 size=1048576 2024-09-14T11:15:23.912 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:23.912+0000 7f76c1e8a8c0 1 < completed part key=_multipart_S43U13LYETS4.2~9PW6F9LLKB13.1 size=802847 2024-09-14T11:15:23.917 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:23.920+0000 7f76c1e8a8c0 1 < completed multipart upload key=S43U13LYETS4 upload=9PW6F9LLKB13 tag=8OHMIURT0RTJ type=write size=2899999 2024-09-14T11:15:23.922 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:23.924+0000 7f76c1e8a8c0 1 > prepared operation key=Q5IY4J5FOD80 tag=THSI0DU0XHKS type=del size=2374239 2024-09-14T11:15:23.929 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:23.932+0000 7f76c1e8a8c0 1 < suggested remove operation key=XC8VWSHZOPFP tag=XEKQXMX0MQXQ type=del 2024-09-14T11:15:23.934 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:23.936+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_1K8ESNXU6WDF.2~LJJ1ZAZYJGSL.0 size=37630 2024-09-14T11:15:23.934 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:23.936+0000 7f76c1e8a8c0 1 > prepared multipart upload key=1K8ESNXU6WDF upload=LJJ1ZAZYJGSL tag=IDLEWAIZ4JZN type=write size=1086206 2024-09-14T11:15:23.937 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:23.940+0000 7f76c1e8a8c0 1 < canceled operation key=HJ701768A6I7 tag=LFFLO3VD1R6T type=del size=1803327 2024-09-14T11:15:23.940 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:23.940+0000 7f76c1e8a8c0 1 > prepared operation key=BOCIF4TL7X7J tag=BO497I02EHH5 type=del size=751821 2024-09-14T11:15:23.943 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:23.944+0000 7f76c1e8a8c0 -1 < failed to complete operation key=1W5733SDHGDN tag=ETAXXBJ3TIY6 type=del size=2983988: (22) Invalid argument 2024-09-14T11:15:23.948 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:23.952+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_K9W031V6BFJP.2~GTA71XT8P1LP.0 size=1048576 2024-09-14T11:15:23.951 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:23.952+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_K9W031V6BFJP.2~GTA71XT8P1LP.1 size=1048576 2024-09-14T11:15:23.953 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:23.956+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_K9W031V6BFJP.2~GTA71XT8P1LP.2 size=199181 2024-09-14T11:15:23.953 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:23.956+0000 7f76c1e8a8c0 1 > prepared multipart upload key=K9W031V6BFJP upload=GTA71XT8P1LP tag=DPXP0DUBC6OY type=write size=3344909 2024-09-14T11:15:23.959 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:23.960+0000 7f76c1e8a8c0 1 < suggested remove operation key=85G6NT78HAWQ tag=PM1VATQ3OQU9 type=write 2024-09-14T11:15:23.962 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:23.964+0000 7f76c1e8a8c0 1 > prepared operation key=W0MDRE9YO3UP tag=443P5WUAKKYB type=write size=120871 2024-09-14T11:15:23.965 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:23.968+0000 7f76c1e8a8c0 1 < completed part key=_multipart_MEVTZ7OAD4CA.2~CCRUTD1YK9PX.0 size=569290 2024-09-14T11:15:23.970 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:23.972+0000 7f76c1e8a8c0 1 < completed multipart upload key=MEVTZ7OAD4CA upload=CCRUTD1YK9PX tag=3H1M6OF02MLW type=write size=1617866 2024-09-14T11:15:23.977 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:23.980+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_K2EEZLRK7MVO.2~3BUD8QR4T7IY.0 size=1048576 2024-09-14T11:15:23.979 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:23.980+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_K2EEZLRK7MVO.2~3BUD8QR4T7IY.1 size=964728 2024-09-14T11:15:23.979 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:23.980+0000 7f76c1e8a8c0 1 > prepared multipart upload key=K2EEZLRK7MVO upload=3BUD8QR4T7IY tag=126RH1Y1GUEA type=write size=3061880 2024-09-14T11:15:23.984 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:23.988+0000 7f76c1e8a8c0 1 < suggested remove operation key=BOCIF4TL7X7J tag=RM1I5AS9S9U9 type=del 2024-09-14T11:15:23.990 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:23.992+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_8PZOVFEYYSOG.2~NMBMXB3V5C3D.0 size=1048576 2024-09-14T11:15:23.992 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:23.996+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_8PZOVFEYYSOG.2~NMBMXB3V5C3D.1 size=77424 2024-09-14T11:15:23.992 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:23.996+0000 7f76c1e8a8c0 1 > prepared multipart upload key=8PZOVFEYYSOG upload=NMBMXB3V5C3D tag=AJLL5WJBYGRP type=write size=2174576 2024-09-14T11:15:23.999 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:24.000+0000 7f76c1e8a8c0 1 < completed delete operation key=F3KFS0P1WM7W tag=7DD3QTCATUP8 type=del 2024-09-14T11:15:24.001 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:24.004+0000 7f76c1e8a8c0 1 > prepared operation key=W0MDRE9YO3UP tag=FAGTQQJNBF5X type=del size=4131359 2024-09-14T11:15:24.005 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:24.008+0000 7f76c1e8a8c0 1 < completed part key=_multipart_6TIJR323NMOH.2~WELLBOD6Y590.0 size=1048576 2024-09-14T11:15:24.007 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:24.008+0000 7f76c1e8a8c0 1 < completed part key=_multipart_6TIJR323NMOH.2~WELLBOD6Y590.1 size=190 2024-09-14T11:15:24.011 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:24.012+0000 7f76c1e8a8c0 1 < completed multipart upload key=6TIJR323NMOH upload=WELLBOD6Y590 tag=2NM3188JJH55 type=write size=2097342 2024-09-14T11:15:24.014 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:24.016+0000 7f76c1e8a8c0 1 > prepared operation key=VI61O3K069BP tag=878KR4RIUEWR type=del size=317154 2024-09-14T11:15:24.016 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:24.020+0000 7f76c1e8a8c0 1 < completed delete operation key=LZ0YNFOVFYCL tag=4AA69G8P9K8G type=del 2024-09-14T11:15:24.021 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:24.024+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_SHKU2PRNREKK.2~UEL6C3SPM60Z.0 size=409125 2024-09-14T11:15:24.021 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:24.024+0000 7f76c1e8a8c0 1 > prepared multipart upload key=SHKU2PRNREKK upload=UEL6C3SPM60Z tag=A55B1GQWRO5H type=write size=1457701 2024-09-14T11:15:24.024 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:24.024+0000 7f76c1e8a8c0 1 < completed delete operation key=H9CQV6L29SL5 tag=5PHNXDZIN4UW type=del 2024-09-14T11:15:24.027 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:24.028+0000 7f76c1e8a8c0 1 > prepared operation key=K9W031V6BFJP tag=RSHWHR9YL1CS type=del size=2869183 2024-09-14T11:15:24.029 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:24.032+0000 7f76c1e8a8c0 1 < completed part key=_multipart_R5I9H7WAK7Z7.2~8V35VCZELX6B.0 size=283779 2024-09-14T11:15:24.033 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:24.036+0000 7f76c1e8a8c0 1 < completed multipart upload key=R5I9H7WAK7Z7 upload=8V35VCZELX6B tag=W55Y73VSGKU1 type=write size=1332355 2024-09-14T11:15:24.036 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:24.036+0000 7f76c1e8a8c0 1 > prepared operation key=8FFV9G6EQR8F tag=UVLGUG2MD338 type=del size=2605522 2024-09-14T11:15:24.041 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:24.044+0000 7f76c1e8a8c0 1 < suggested update operation key=K9W031V6BFJP tag=NLBVYZLNTYM0 type=write size=304654 2024-09-14T11:15:24.044 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:24.048+0000 7f76c1e8a8c0 1 > prepared operation key=TZO40K6J9877 tag=108PYEQD93XF type=write size=621112 2024-09-14T11:15:24.047 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:24.048+0000 7f76c1e8a8c0 1 < completed part key=_multipart_HS7T50JORDQJ.2~IECDO91843C3.0 size=1048576 2024-09-14T11:15:24.049 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:24.052+0000 7f76c1e8a8c0 1 < completed part key=_multipart_HS7T50JORDQJ.2~IECDO91843C3.1 size=479247 2024-09-14T11:15:24.054 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:24.056+0000 7f76c1e8a8c0 1 < completed multipart upload key=HS7T50JORDQJ upload=IECDO91843C3 tag=35IXT9HX8C4J type=write size=2576399 2024-09-14T11:15:24.058 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:24.060+0000 7f76c1e8a8c0 1 > prepared operation key=HJ701768A6I7 tag=HAR7YAWKTQ8L type=del size=45854 2024-09-14T11:15:24.060 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:24.064+0000 7f76c1e8a8c0 1 < completed delete operation key=TZO40K6J9877 tag=4IOKRF79S6LH type=del 2024-09-14T11:15:24.063 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:24.064+0000 7f76c1e8a8c0 1 > prepared operation key=Q5IY4J5FOD80 tag=WO1AVV22A9EP type=del size=3733617 2024-09-14T11:15:24.067 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:24.068+0000 7f76c1e8a8c0 1 < completed delete operation key=GAVZRU8ZLW7S tag=NX6DE8UROP10 type=del 2024-09-14T11:15:24.070 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:24.072+0000 7f76c1e8a8c0 1 > prepared operation key=W0MDRE9YO3UP tag=XUQ3IW2DXJYE type=del size=1309564 2024-09-14T11:15:24.073 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:24.076+0000 7f76c1e8a8c0 1 < completed delete operation key=Q5IY4J5FOD80 tag=THSI0DU0XHKS type=del 2024-09-14T11:15:24.076 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:24.076+0000 7f76c1e8a8c0 1 > prepared operation key=LZ0YNFOVFYCL tag=IJP3J4WV8B4E type=del size=3933684 2024-09-14T11:15:24.079 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:24.080+0000 7f76c1e8a8c0 1 < completed part key=_multipart_1K8ESNXU6WDF.2~LJJ1ZAZYJGSL.0 size=37630 2024-09-14T11:15:24.083 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:24.084+0000 7f76c1e8a8c0 1 < completed multipart upload key=1K8ESNXU6WDF upload=LJJ1ZAZYJGSL tag=IDLEWAIZ4JZN type=write size=1086206 2024-09-14T11:15:24.087 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:24.088+0000 7f76c1e8a8c0 1 > prepared operation key=KS37ZO6MKAH9 tag=TM5EBWTDCDPV type=write size=964373 2024-09-14T11:15:24.090 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:24.092+0000 7f76c1e8a8c0 -1 < failed to complete operation key=BOCIF4TL7X7J tag=BO497I02EHH5 type=del size=751821: (22) Invalid argument 2024-09-14T11:15:24.093 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:24.096+0000 7f76c1e8a8c0 1 > prepared operation key=1W5733SDHGDN tag=S01NUK3Q7VZ1 type=del size=4074039 2024-09-14T11:15:24.096 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:24.100+0000 7f76c1e8a8c0 1 < completed part key=_multipart_K9W031V6BFJP.2~GTA71XT8P1LP.0 size=1048576 2024-09-14T11:15:24.142 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:24.100+0000 7f76c1e8a8c0 1 < completed part key=_multipart_K9W031V6BFJP.2~GTA71XT8P1LP.1 size=1048576 2024-09-14T11:15:24.143 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:24.104+0000 7f76c1e8a8c0 1 < completed part key=_multipart_K9W031V6BFJP.2~GTA71XT8P1LP.2 size=199181 2024-09-14T11:15:24.143 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:24.108+0000 7f76c1e8a8c0 1 < completed multipart upload key=K9W031V6BFJP upload=GTA71XT8P1LP tag=DPXP0DUBC6OY type=write size=3344909 2024-09-14T11:15:24.143 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:24.112+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_CIRQT9IDJ5OJ.2~FT7700P7EMLN.0 size=1048576 2024-09-14T11:15:24.143 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:24.116+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_CIRQT9IDJ5OJ.2~FT7700P7EMLN.1 size=538810 2024-09-14T11:15:24.143 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:24.116+0000 7f76c1e8a8c0 1 > prepared multipart upload key=CIRQT9IDJ5OJ upload=FT7700P7EMLN tag=T6WER5GJFRO2 type=write size=2635962 2024-09-14T11:15:24.143 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:24.120+0000 7f76c1e8a8c0 1 < completed write operation key=W0MDRE9YO3UP tag=443P5WUAKKYB type=write size=120871 2024-09-14T11:15:24.143 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:24.120+0000 7f76c1e8a8c0 1 > prepared operation key=K9W031V6BFJP tag=GEBE2IN9OTW2 type=del size=1928666 2024-09-14T11:15:24.144 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:24.124+0000 7f76c1e8a8c0 1 < completed part key=_multipart_K2EEZLRK7MVO.2~3BUD8QR4T7IY.0 size=1048576 2024-09-14T11:15:24.144 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:24.128+0000 7f76c1e8a8c0 1 < completed part key=_multipart_K2EEZLRK7MVO.2~3BUD8QR4T7IY.1 size=964728 2024-09-14T11:15:24.144 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:24.132+0000 7f76c1e8a8c0 1 < completed multipart upload key=K2EEZLRK7MVO upload=3BUD8QR4T7IY tag=126RH1Y1GUEA type=write size=3061880 2024-09-14T11:15:24.144 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:24.136+0000 7f76c1e8a8c0 1 > prepared operation key=KS37ZO6MKAH9 tag=OCQDL9H8BWLJ type=del size=1371113 2024-09-14T11:15:24.144 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:24.140+0000 7f76c1e8a8c0 1 < completed part key=_multipart_8PZOVFEYYSOG.2~NMBMXB3V5C3D.0 size=1048576 2024-09-14T11:15:24.144 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:24.140+0000 7f76c1e8a8c0 1 < canceled part key=_multipart_8PZOVFEYYSOG.2~NMBMXB3V5C3D.1 size=77424 2024-09-14T11:15:24.144 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:24.144+0000 7f76c1e8a8c0 1 < canceled multipart upload key=8PZOVFEYYSOG upload=NMBMXB3V5C3D tag=AJLL5WJBYGRP type=write size=2174576 2024-09-14T11:15:24.145 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:24.148+0000 7f76c1e8a8c0 1 > prepared operation key=OOUEM16XL80W tag=IMMFECZ4Z8X6 type=write size=807655 2024-09-14T11:15:24.148 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:24.152+0000 7f76c1e8a8c0 1 < canceled operation key=W0MDRE9YO3UP tag=FAGTQQJNBF5X type=del size=4131359 2024-09-14T11:15:24.151 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:24.152+0000 7f76c1e8a8c0 1 > prepared operation key=BOCIF4TL7X7J tag=OPYCL3AR0G95 type=del size=3140903 2024-09-14T11:15:24.154 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:24.156+0000 7f76c1e8a8c0 1 < completed delete operation key=VI61O3K069BP tag=878KR4RIUEWR type=del 2024-09-14T11:15:24.157 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:24.160+0000 7f76c1e8a8c0 1 > prepared operation key=SHKU2PRNREKK tag=51LQ2GSS8B74 type=del size=1851166 2024-09-14T11:15:24.160 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:24.160+0000 7f76c1e8a8c0 1 < completed part key=_multipart_SHKU2PRNREKK.2~UEL6C3SPM60Z.0 size=409125 2024-09-14T11:15:24.165 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:24.168+0000 7f76c1e8a8c0 1 < completed multipart upload key=SHKU2PRNREKK upload=UEL6C3SPM60Z tag=A55B1GQWRO5H type=write size=1457701 2024-09-14T11:15:24.167 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:24.168+0000 7f76c1e8a8c0 1 > prepared operation key=F3KFS0P1WM7W tag=BZT5329V3AL7 type=del size=2049319 2024-09-14T11:15:24.170 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:24.172+0000 7f76c1e8a8c0 -1 < failed to complete operation key=K9W031V6BFJP tag=RSHWHR9YL1CS type=del size=2869183: (22) Invalid argument 2024-09-14T11:15:24.176 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:24.180+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_HJ701768A6I7.2~0KZF6FRB3FWH.0 size=1048576 2024-09-14T11:15:24.179 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:24.180+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_HJ701768A6I7.2~0KZF6FRB3FWH.1 size=1048576 2024-09-14T11:15:24.181 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:24.184+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_HJ701768A6I7.2~0KZF6FRB3FWH.2 size=415438 2024-09-14T11:15:24.181 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:24.184+0000 7f76c1e8a8c0 1 > prepared multipart upload key=HJ701768A6I7 upload=0KZF6FRB3FWH tag=RSHJVXOZE6N7 type=write size=3561166 2024-09-14T11:15:24.184 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:24.188+0000 7f76c1e8a8c0 1 < canceled operation key=8FFV9G6EQR8F tag=UVLGUG2MD338 type=del size=2605522 2024-09-14T11:15:24.187 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:24.188+0000 7f76c1e8a8c0 1 > prepared operation key=1W5733SDHGDN tag=Q9SG3EWMBVKY type=del size=4172094 2024-09-14T11:15:24.190 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:24.192+0000 7f76c1e8a8c0 1 < completed write operation key=TZO40K6J9877 tag=108PYEQD93XF type=write size=621112 2024-09-14T11:15:24.195 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:24.196+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_GZM0AQVHNCMM.2~ZZ8VQ0V13H04.0 size=166052 2024-09-14T11:15:24.195 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:24.196+0000 7f76c1e8a8c0 1 > prepared multipart upload key=GZM0AQVHNCMM upload=ZZ8VQ0V13H04 tag=72NWJRKDCOCG type=write size=1214628 2024-09-14T11:15:24.197 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:24.200+0000 7f76c1e8a8c0 1 < completed delete operation key=HJ701768A6I7 tag=HAR7YAWKTQ8L type=del 2024-09-14T11:15:24.200 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:24.204+0000 7f76c1e8a8c0 1 > prepared operation key=Q5IY4J5FOD80 tag=FWJCQAAHW0ZC type=del size=3311498 2024-09-14T11:15:24.203 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:24.204+0000 7f76c1e8a8c0 1 < completed delete operation key=Q5IY4J5FOD80 tag=WO1AVV22A9EP type=del 2024-09-14T11:15:24.207 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:24.208+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_Q5IY4J5FOD80.2~J2ELWJ4EI854.0 size=73536 2024-09-14T11:15:24.208 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:24.208+0000 7f76c1e8a8c0 1 > prepared multipart upload key=Q5IY4J5FOD80 upload=J2ELWJ4EI854 tag=QDOIYU5N1VSR type=write size=1122112 2024-09-14T11:15:24.210 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:24.212+0000 7f76c1e8a8c0 1 < completed delete operation key=W0MDRE9YO3UP tag=XUQ3IW2DXJYE type=del 2024-09-14T11:15:24.215 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:24.216+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_S43U13LYETS4.2~IP7534CXIK9P.0 size=1048576 2024-09-14T11:15:24.217 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:24.220+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_S43U13LYETS4.2~IP7534CXIK9P.1 size=1048576 2024-09-14T11:15:24.220 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:24.220+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_S43U13LYETS4.2~IP7534CXIK9P.2 size=815085 2024-09-14T11:15:24.220 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:24.220+0000 7f76c1e8a8c0 1 > prepared multipart upload key=S43U13LYETS4 upload=IP7534CXIK9P tag=FDUVEF1DJWBI type=write size=3960813 2024-09-14T11:15:24.223 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:24.224+0000 7f76c1e8a8c0 1 < completed delete operation key=LZ0YNFOVFYCL tag=IJP3J4WV8B4E type=del 2024-09-14T11:15:24.226 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:24.228+0000 7f76c1e8a8c0 1 > prepared operation key=K2EEZLRK7MVO tag=I0ZAT2NUO9W2 type=del size=1329337 2024-09-14T11:15:24.229 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:24.232+0000 7f76c1e8a8c0 1 < completed write operation key=KS37ZO6MKAH9 tag=TM5EBWTDCDPV type=write size=964373 2024-09-14T11:15:24.231 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:24.232+0000 7f76c1e8a8c0 1 > prepared operation key=CIRQT9IDJ5OJ tag=4WH0IEA9XGLZ type=write size=967408 2024-09-14T11:15:24.234 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:24.236+0000 7f76c1e8a8c0 1 < completed delete operation key=1W5733SDHGDN tag=S01NUK3Q7VZ1 type=del 2024-09-14T11:15:24.237 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:24.240+0000 7f76c1e8a8c0 1 > prepared operation key=SUNCRV0C1XYL tag=866NC3I7RZED type=write size=289166 2024-09-14T11:15:24.239 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:24.240+0000 7f76c1e8a8c0 1 < completed part key=_multipart_CIRQT9IDJ5OJ.2~FT7700P7EMLN.0 size=1048576 2024-09-14T11:15:24.239 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:24.240+0000 7f76c1e8a8c0 1 < canceled part key=_multipart_CIRQT9IDJ5OJ.2~FT7700P7EMLN.1 size=538810 2024-09-14T11:15:24.244 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:24.244+0000 7f76c1e8a8c0 1 < canceled multipart upload key=CIRQT9IDJ5OJ upload=FT7700P7EMLN tag=T6WER5GJFRO2 type=write size=2635962 2024-09-14T11:15:24.247 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:24.248+0000 7f76c1e8a8c0 1 > prepared operation key=K9W031V6BFJP tag=BN8ECRF7J17H type=del size=763839 2024-09-14T11:15:24.250 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:24.252+0000 7f76c1e8a8c0 1 < completed delete operation key=K9W031V6BFJP tag=GEBE2IN9OTW2 type=del 2024-09-14T11:15:24.253 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:24.256+0000 7f76c1e8a8c0 1 > prepared operation key=1W5733SDHGDN tag=TM5KV4609XOQ type=del size=3257286 2024-09-14T11:15:24.256 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:24.256+0000 7f76c1e8a8c0 1 < completed delete operation key=KS37ZO6MKAH9 tag=OCQDL9H8BWLJ type=del 2024-09-14T11:15:24.261 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:24.264+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_R5I9H7WAK7Z7.2~N88R1NLUI9IA.0 size=1048576 2024-09-14T11:15:24.263 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:24.264+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_R5I9H7WAK7Z7.2~N88R1NLUI9IA.1 size=1048576 2024-09-14T11:15:24.265 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:24.268+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_R5I9H7WAK7Z7.2~N88R1NLUI9IA.2 size=1001870 2024-09-14T11:15:24.265 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:24.268+0000 7f76c1e8a8c0 1 > prepared multipart upload key=R5I9H7WAK7Z7 upload=N88R1NLUI9IA tag=7DBZ7YHN0TZ7 type=write size=4147598 2024-09-14T11:15:24.271 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:24.272+0000 7f76c1e8a8c0 1 < completed write operation key=OOUEM16XL80W tag=IMMFECZ4Z8X6 type=write size=807655 2024-09-14T11:15:24.276 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:24.280+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_S43U13LYETS4.2~64DHS0B97L02.0 size=1048576 2024-09-14T11:15:24.278 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:24.280+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_S43U13LYETS4.2~64DHS0B97L02.1 size=1048576 2024-09-14T11:15:24.281 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:24.284+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_S43U13LYETS4.2~64DHS0B97L02.2 size=360995 2024-09-14T11:15:24.281 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:24.284+0000 7f76c1e8a8c0 1 > prepared multipart upload key=S43U13LYETS4 upload=64DHS0B97L02 tag=RLX6T4TKNYV7 type=write size=3506723 2024-09-14T11:15:24.284 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:24.288+0000 7f76c1e8a8c0 1 < completed delete operation key=BOCIF4TL7X7J tag=OPYCL3AR0G95 type=del 2024-09-14T11:15:24.287 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:24.288+0000 7f76c1e8a8c0 1 > prepared operation key=HS7T50JORDQJ tag=QKLZ45RCQPR0 type=write size=784733 2024-09-14T11:15:24.290 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:24.292+0000 7f76c1e8a8c0 1 < completed delete operation key=SHKU2PRNREKK tag=51LQ2GSS8B74 type=del 2024-09-14T11:15:24.292 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:24.296+0000 7f76c1e8a8c0 1 > prepared operation key=K2EEZLRK7MVO tag=WJAXT14JLENP type=write size=732097 2024-09-14T11:15:24.295 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:24.296+0000 7f76c1e8a8c0 1 < completed delete operation key=F3KFS0P1WM7W tag=BZT5329V3AL7 type=del 2024-09-14T11:15:24.297 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:24.300+0000 7f76c1e8a8c0 1 > prepared operation key=K2EEZLRK7MVO tag=1IVH13SOWR16 type=write size=394752 2024-09-14T11:15:24.301 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:24.304+0000 7f76c1e8a8c0 1 < completed part key=_multipart_HJ701768A6I7.2~0KZF6FRB3FWH.0 size=1048576 2024-09-14T11:15:24.303 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:24.304+0000 7f76c1e8a8c0 1 < completed part key=_multipart_HJ701768A6I7.2~0KZF6FRB3FWH.1 size=1048576 2024-09-14T11:15:24.305 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:24.308+0000 7f76c1e8a8c0 1 < completed part key=_multipart_HJ701768A6I7.2~0KZF6FRB3FWH.2 size=415438 2024-09-14T11:15:24.310 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:24.312+0000 7f76c1e8a8c0 1 < completed multipart upload key=HJ701768A6I7 upload=0KZF6FRB3FWH tag=RSHJVXOZE6N7 type=write size=3561166 2024-09-14T11:15:24.315 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:24.316+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_K2EEZLRK7MVO.2~FM3P1BFSI1WS.0 size=26904 2024-09-14T11:15:24.315 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:24.316+0000 7f76c1e8a8c0 1 > prepared multipart upload key=K2EEZLRK7MVO upload=FM3P1BFSI1WS tag=7AQW44E194IT type=write size=1075480 2024-09-14T11:15:24.321 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:24.324+0000 7f76c1e8a8c0 1 < suggested update operation key=1W5733SDHGDN tag=Q9SG3EWMBVKY type=del size=4172094 2024-09-14T11:15:24.325 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:24.328+0000 7f76c1e8a8c0 1 > prepared operation key=F3KFS0P1WM7W tag=4HLT8FV0OZXL type=write size=324442 2024-09-14T11:15:24.328 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:24.332+0000 7f76c1e8a8c0 1 < completed part key=_multipart_GZM0AQVHNCMM.2~ZZ8VQ0V13H04.0 size=166052 2024-09-14T11:15:24.332 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:24.336+0000 7f76c1e8a8c0 1 < completed multipart upload key=GZM0AQVHNCMM upload=ZZ8VQ0V13H04 tag=72NWJRKDCOCG type=write size=1214628 2024-09-14T11:15:24.337 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:24.340+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_MEVTZ7OAD4CA.2~KKDP93EPXOMZ.0 size=535158 2024-09-14T11:15:24.337 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:24.340+0000 7f76c1e8a8c0 1 > prepared multipart upload key=MEVTZ7OAD4CA upload=KKDP93EPXOMZ tag=7PD30NMD40SZ type=write size=1583734 2024-09-14T11:15:24.340 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:24.344+0000 7f76c1e8a8c0 1 < completed delete operation key=Q5IY4J5FOD80 tag=FWJCQAAHW0ZC type=del 2024-09-14T11:15:24.342 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:24.344+0000 7f76c1e8a8c0 1 > prepared operation key=GAVZRU8ZLW7S tag=SJPXBOTXPI6U type=del size=1081370 2024-09-14T11:15:24.345 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:24.348+0000 7f76c1e8a8c0 1 < completed part key=_multipart_Q5IY4J5FOD80.2~J2ELWJ4EI854.0 size=73536 2024-09-14T11:15:24.350 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:24.352+0000 7f76c1e8a8c0 1 < completed multipart upload key=Q5IY4J5FOD80 upload=J2ELWJ4EI854 tag=QDOIYU5N1VSR type=write size=1122112 2024-09-14T11:15:24.353 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:24.356+0000 7f76c1e8a8c0 1 > prepared operation key=S43U13LYETS4 tag=YS3MVPTZNULZ type=del size=1593810 2024-09-14T11:15:24.353 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:24.356+0000 7f76c1e8a8c0 1 < canceled part key=_multipart_S43U13LYETS4.2~IP7534CXIK9P.0 size=1048576 2024-09-14T11:15:24.353 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:24.356+0000 7f76c1e8a8c0 1 < canceled part key=_multipart_S43U13LYETS4.2~IP7534CXIK9P.1 size=1048576 2024-09-14T11:15:24.355 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:24.356+0000 7f76c1e8a8c0 1 < completed part key=_multipart_S43U13LYETS4.2~IP7534CXIK9P.2 size=815085 2024-09-14T11:15:24.360 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:24.364+0000 7f76c1e8a8c0 1 < canceled multipart upload key=S43U13LYETS4 upload=IP7534CXIK9P tag=FDUVEF1DJWBI type=write size=3960813 2024-09-14T11:15:24.365 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:24.368+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_8FFV9G6EQR8F.2~5DQ0SN2401X1.0 size=453439 2024-09-14T11:15:24.365 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:24.368+0000 7f76c1e8a8c0 1 > prepared multipart upload key=8FFV9G6EQR8F upload=5DQ0SN2401X1 tag=R5CNZB7SWOH6 type=write size=1502015 2024-09-14T11:15:24.368 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:24.372+0000 7f76c1e8a8c0 1 < completed delete operation key=K2EEZLRK7MVO tag=I0ZAT2NUO9W2 type=del 2024-09-14T11:15:24.373 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:24.376+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_HJ701768A6I7.2~XIYTEG84ZLH0.0 size=1048576 2024-09-14T11:15:24.375 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:24.376+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_HJ701768A6I7.2~XIYTEG84ZLH0.1 size=1048576 2024-09-14T11:15:24.377 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:24.380+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_HJ701768A6I7.2~XIYTEG84ZLH0.2 size=52124 2024-09-14T11:15:24.377 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:24.380+0000 7f76c1e8a8c0 1 > prepared multipart upload key=HJ701768A6I7 upload=XIYTEG84ZLH0 tag=KPLXWITCEX7H type=write size=3197852 2024-09-14T11:15:24.380 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:24.384+0000 7f76c1e8a8c0 1 < canceled operation key=CIRQT9IDJ5OJ tag=4WH0IEA9XGLZ type=write size=967408 2024-09-14T11:15:24.385 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:24.388+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_LZ0YNFOVFYCL.2~363B78B09VWD.0 size=105706 2024-09-14T11:15:24.385 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:24.388+0000 7f76c1e8a8c0 1 > prepared multipart upload key=LZ0YNFOVFYCL upload=363B78B09VWD tag=OHWX1V8PLUJL type=write size=1154282 2024-09-14T11:15:24.391 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:24.392+0000 7f76c1e8a8c0 1 < suggested remove operation key=SUNCRV0C1XYL tag=866NC3I7RZED type=write 2024-09-14T11:15:24.393 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:24.396+0000 7f76c1e8a8c0 1 > prepared operation key=SHKU2PRNREKK tag=CGYOJC5CNW8H type=del size=797638 2024-09-14T11:15:24.396 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:24.400+0000 7f76c1e8a8c0 1 < completed delete operation key=K9W031V6BFJP tag=BN8ECRF7J17H type=del 2024-09-14T11:15:24.399 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:24.400+0000 7f76c1e8a8c0 1 > prepared operation key=R5I9H7WAK7Z7 tag=KGJJX07AMBK1 type=del size=1272686 2024-09-14T11:15:24.402 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:24.404+0000 7f76c1e8a8c0 -1 < failed to complete operation key=1W5733SDHGDN tag=TM5KV4609XOQ type=del size=3257286: (22) Invalid argument 2024-09-14T11:15:24.405 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:24.408+0000 7f76c1e8a8c0 1 > prepared operation key=K2EEZLRK7MVO tag=DHXI73QLXCT6 type=del size=2549936 2024-09-14T11:15:24.408 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:24.408+0000 7f76c1e8a8c0 1 < completed part key=_multipart_R5I9H7WAK7Z7.2~N88R1NLUI9IA.0 size=1048576 2024-09-14T11:15:24.408 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:24.408+0000 7f76c1e8a8c0 1 < canceled part key=_multipart_R5I9H7WAK7Z7.2~N88R1NLUI9IA.1 size=1048576 2024-09-14T11:15:24.410 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:24.412+0000 7f76c1e8a8c0 1 < completed part key=_multipart_R5I9H7WAK7Z7.2~N88R1NLUI9IA.2 size=1001870 2024-09-14T11:15:24.415 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:24.416+0000 7f76c1e8a8c0 1 < canceled multipart upload key=R5I9H7WAK7Z7 upload=N88R1NLUI9IA tag=7DBZ7YHN0TZ7 type=write size=4147598 2024-09-14T11:15:24.418 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:24.420+0000 7f76c1e8a8c0 1 > prepared operation key=GAVZRU8ZLW7S tag=6QWAEXYLGNHB type=del size=4122219 2024-09-14T11:15:24.421 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:24.424+0000 7f76c1e8a8c0 1 < completed part key=_multipart_S43U13LYETS4.2~64DHS0B97L02.0 size=1048576 2024-09-14T11:15:24.424 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:24.424+0000 7f76c1e8a8c0 1 < completed part key=_multipart_S43U13LYETS4.2~64DHS0B97L02.1 size=1048576 2024-09-14T11:15:24.424 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:24.424+0000 7f76c1e8a8c0 1 < canceled part key=_multipart_S43U13LYETS4.2~64DHS0B97L02.2 size=360995 2024-09-14T11:15:24.428 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:24.432+0000 7f76c1e8a8c0 1 < canceled multipart upload key=S43U13LYETS4 upload=64DHS0B97L02 tag=RLX6T4TKNYV7 type=write size=3506723 2024-09-14T11:15:24.431 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:24.432+0000 7f76c1e8a8c0 1 > prepared operation key=TZO40K6J9877 tag=LBFF7Q396PMV type=del size=853881 2024-09-14T11:15:24.434 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:24.436+0000 7f76c1e8a8c0 1 < completed write operation key=HS7T50JORDQJ tag=QKLZ45RCQPR0 type=write size=784733 2024-09-14T11:15:24.436 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:24.440+0000 7f76c1e8a8c0 1 > prepared operation key=KS37ZO6MKAH9 tag=HYC7YHVVXLOS type=del size=3524297 2024-09-14T11:15:24.439 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:24.440+0000 7f76c1e8a8c0 1 < completed write operation key=K2EEZLRK7MVO tag=WJAXT14JLENP type=write size=732097 2024-09-14T11:15:24.444 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:24.448+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_XC8VWSHZOPFP.2~M44V4ZJFTOE5.0 size=422283 2024-09-14T11:15:24.444 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:24.448+0000 7f76c1e8a8c0 1 > prepared multipart upload key=XC8VWSHZOPFP upload=M44V4ZJFTOE5 tag=864ZL0JDXI1R type=write size=1470859 2024-09-14T11:15:24.447 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:24.448+0000 7f76c1e8a8c0 1 < completed write operation key=K2EEZLRK7MVO tag=1IVH13SOWR16 type=write size=394752 2024-09-14T11:15:24.451 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:24.452+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_LZ0YNFOVFYCL.2~0EFI5V39R8YO.0 size=298096 2024-09-14T11:15:24.451 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:24.452+0000 7f76c1e8a8c0 1 > prepared multipart upload key=LZ0YNFOVFYCL upload=0EFI5V39R8YO tag=R3QCMUM4YYSD type=write size=1346672 2024-09-14T11:15:24.454 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:24.456+0000 7f76c1e8a8c0 1 < completed part key=_multipart_K2EEZLRK7MVO.2~FM3P1BFSI1WS.0 size=26904 2024-09-14T11:15:24.458 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:24.460+0000 7f76c1e8a8c0 1 < completed multipart upload key=K2EEZLRK7MVO upload=FM3P1BFSI1WS tag=7AQW44E194IT type=write size=1075480 2024-09-14T11:15:24.463 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:24.464+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_1K8ESNXU6WDF.2~N2LU18OXHDL3.0 size=1048576 2024-09-14T11:15:24.465 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:24.468+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_1K8ESNXU6WDF.2~N2LU18OXHDL3.1 size=1048576 2024-09-14T11:15:24.466 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:24.468+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_1K8ESNXU6WDF.2~N2LU18OXHDL3.2 size=906571 2024-09-14T11:15:24.467 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:24.468+0000 7f76c1e8a8c0 1 > prepared multipart upload key=1K8ESNXU6WDF upload=N2LU18OXHDL3 tag=7QYUM11V05C4 type=write size=4052299 2024-09-14T11:15:24.472 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:24.472+0000 7f76c1e8a8c0 1 < suggested remove operation key=F3KFS0P1WM7W tag=4HLT8FV0OZXL type=write 2024-09-14T11:15:24.477 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:24.480+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_Q5IY4J5FOD80.2~7JJOKRFJEHRD.0 size=1048576 2024-09-14T11:15:24.479 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:24.480+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_Q5IY4J5FOD80.2~7JJOKRFJEHRD.1 size=1048576 2024-09-14T11:15:24.481 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:24.484+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_Q5IY4J5FOD80.2~7JJOKRFJEHRD.2 size=663036 2024-09-14T11:15:24.481 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:24.484+0000 7f76c1e8a8c0 1 > prepared multipart upload key=Q5IY4J5FOD80 upload=7JJOKRFJEHRD tag=UA6AVVSXWJWL type=write size=3808764 2024-09-14T11:15:24.483 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:24.484+0000 7f76c1e8a8c0 1 < completed part key=_multipart_MEVTZ7OAD4CA.2~KKDP93EPXOMZ.0 size=535158 2024-09-14T11:15:24.487 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:24.488+0000 7f76c1e8a8c0 1 < completed multipart upload key=MEVTZ7OAD4CA upload=KKDP93EPXOMZ tag=7PD30NMD40SZ type=write size=1583734 2024-09-14T11:15:24.492 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:24.496+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_Q5IY4J5FOD80.2~2R6022G13UOG.0 size=1048576 2024-09-14T11:15:24.494 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:24.496+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_Q5IY4J5FOD80.2~2R6022G13UOG.1 size=1048576 2024-09-14T11:15:24.496 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:24.500+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_Q5IY4J5FOD80.2~2R6022G13UOG.2 size=843454 2024-09-14T11:15:24.496 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:24.500+0000 7f76c1e8a8c0 1 > prepared multipart upload key=Q5IY4J5FOD80 upload=2R6022G13UOG tag=YKTG00Q8E13P type=write size=3989182 2024-09-14T11:15:24.499 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:24.500+0000 7f76c1e8a8c0 1 < completed delete operation key=GAVZRU8ZLW7S tag=SJPXBOTXPI6U type=del 2024-09-14T11:15:24.503 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:24.504+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_SHKU2PRNREKK.2~MDOBMQ3I44XD.0 size=1048576 2024-09-14T11:15:24.506 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:24.508+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_SHKU2PRNREKK.2~MDOBMQ3I44XD.1 size=239121 2024-09-14T11:15:24.506 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:24.508+0000 7f76c1e8a8c0 1 > prepared multipart upload key=SHKU2PRNREKK upload=MDOBMQ3I44XD tag=JEW7YD226F6S type=write size=2336273 2024-09-14T11:15:24.508 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:24.512+0000 7f76c1e8a8c0 1 < completed delete operation key=S43U13LYETS4 tag=YS3MVPTZNULZ type=del 2024-09-14T11:15:24.511 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:24.512+0000 7f76c1e8a8c0 1 > prepared operation key=KS37ZO6MKAH9 tag=Y578YDQU3CFY type=del size=1098705 2024-09-14T11:15:24.511 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:24.512+0000 7f76c1e8a8c0 1 < canceled part key=_multipart_8FFV9G6EQR8F.2~5DQ0SN2401X1.0 size=453439 2024-09-14T11:15:24.515 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:24.516+0000 7f76c1e8a8c0 1 < canceled multipart upload key=8FFV9G6EQR8F upload=5DQ0SN2401X1 tag=R5CNZB7SWOH6 type=write size=1502015 2024-09-14T11:15:24.520 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:24.524+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_S43U13LYETS4.2~B6K90D4500P4.0 size=1048576 2024-09-14T11:15:24.525 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:24.528+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_S43U13LYETS4.2~B6K90D4500P4.1 size=907720 2024-09-14T11:15:24.525 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:24.528+0000 7f76c1e8a8c0 1 > prepared multipart upload key=S43U13LYETS4 upload=B6K90D4500P4 tag=NAZM02CCRF1R type=write size=3004872 2024-09-14T11:15:24.527 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:24.528+0000 7f76c1e8a8c0 1 < completed part key=_multipart_HJ701768A6I7.2~XIYTEG84ZLH0.0 size=1048576 2024-09-14T11:15:24.529 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:24.532+0000 7f76c1e8a8c0 1 < completed part key=_multipart_HJ701768A6I7.2~XIYTEG84ZLH0.1 size=1048576 2024-09-14T11:15:24.531 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:24.532+0000 7f76c1e8a8c0 1 < completed part key=_multipart_HJ701768A6I7.2~XIYTEG84ZLH0.2 size=52124 2024-09-14T11:15:24.536 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:24.536+0000 7f76c1e8a8c0 1 < completed multipart upload key=HJ701768A6I7 upload=XIYTEG84ZLH0 tag=KPLXWITCEX7H type=write size=3197852 2024-09-14T11:15:24.538 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:24.540+0000 7f76c1e8a8c0 1 > prepared operation key=TZO40K6J9877 tag=DVBRAKFB6NG5 type=write size=106262 2024-09-14T11:15:24.541 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:24.544+0000 7f76c1e8a8c0 1 < completed part key=_multipart_LZ0YNFOVFYCL.2~363B78B09VWD.0 size=105706 2024-09-14T11:15:24.545 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:24.548+0000 7f76c1e8a8c0 1 < completed multipart upload key=LZ0YNFOVFYCL upload=363B78B09VWD tag=OHWX1V8PLUJL type=write size=1154282 2024-09-14T11:15:24.548 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:24.548+0000 7f76c1e8a8c0 1 > prepared operation key=S43U13LYETS4 tag=YZE619RBB703 type=del size=2422641 2024-09-14T11:15:24.550 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:24.552+0000 7f76c1e8a8c0 1 < completed delete operation key=SHKU2PRNREKK tag=CGYOJC5CNW8H type=del 2024-09-14T11:15:24.553 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:24.556+0000 7f76c1e8a8c0 1 > prepared operation key=8FFV9G6EQR8F tag=6W9MHWWEC6W8 type=del size=202962 2024-09-14T11:15:24.556 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:24.556+0000 7f76c1e8a8c0 1 < completed delete operation key=R5I9H7WAK7Z7 tag=KGJJX07AMBK1 type=del 2024-09-14T11:15:24.558 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:24.560+0000 7f76c1e8a8c0 1 > prepared operation key=MEVTZ7OAD4CA tag=JN1QZL9ONWLN type=del size=3054171 2024-09-14T11:15:24.561 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:24.564+0000 7f76c1e8a8c0 1 < completed delete operation key=K2EEZLRK7MVO tag=DHXI73QLXCT6 type=del 2024-09-14T11:15:24.566 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:24.568+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_HS7T50JORDQJ.2~38RCCE85N5FY.0 size=1048576 2024-09-14T11:15:24.568 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:24.568+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_HS7T50JORDQJ.2~38RCCE85N5FY.1 size=1048576 2024-09-14T11:15:24.570 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:24.572+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_HS7T50JORDQJ.2~38RCCE85N5FY.2 size=10240 2024-09-14T11:15:24.570 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:24.572+0000 7f76c1e8a8c0 1 > prepared multipart upload key=HS7T50JORDQJ upload=38RCCE85N5FY tag=XJTXTD2OI6M4 type=write size=3155968 2024-09-14T11:15:24.573 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:24.576+0000 7f76c1e8a8c0 1 < completed delete operation key=GAVZRU8ZLW7S tag=6QWAEXYLGNHB type=del 2024-09-14T11:15:24.577 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:24.580+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_R5I9H7WAK7Z7.2~XFYTI7AIC8GN.0 size=1048576 2024-09-14T11:15:24.579 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:24.580+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_R5I9H7WAK7Z7.2~XFYTI7AIC8GN.1 size=1048576 2024-09-14T11:15:24.581 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:24.584+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_R5I9H7WAK7Z7.2~XFYTI7AIC8GN.2 size=799666 2024-09-14T11:15:24.582 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:24.584+0000 7f76c1e8a8c0 1 > prepared multipart upload key=R5I9H7WAK7Z7 upload=XFYTI7AIC8GN tag=1YV9WFSZONN4 type=write size=3945394 2024-09-14T11:15:24.584 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:24.588+0000 7f76c1e8a8c0 1 < completed delete operation key=TZO40K6J9877 tag=LBFF7Q396PMV type=del 2024-09-14T11:15:24.589 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:24.592+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_S43U13LYETS4.2~QEPXO5H03832.0 size=1048576 2024-09-14T11:15:24.592 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:24.592+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_S43U13LYETS4.2~QEPXO5H03832.1 size=471853 2024-09-14T11:15:24.592 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:24.592+0000 7f76c1e8a8c0 1 > prepared multipart upload key=S43U13LYETS4 upload=QEPXO5H03832 tag=SL1WRWT3HK6S type=write size=2569005 2024-09-14T11:15:24.597 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:24.600+0000 7f76c1e8a8c0 1 < suggested update operation key=KS37ZO6MKAH9 tag=HYC7YHVVXLOS type=del size=3524297 2024-09-14T11:15:24.600 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:24.604+0000 7f76c1e8a8c0 1 > prepared operation key=8PZOVFEYYSOG tag=ONCZRQ6HZV6I type=write size=598506 2024-09-14T11:15:24.603 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:24.604+0000 7f76c1e8a8c0 1 < completed part key=_multipart_XC8VWSHZOPFP.2~M44V4ZJFTOE5.0 size=422283 2024-09-14T11:15:24.607 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:24.608+0000 7f76c1e8a8c0 1 < completed multipart upload key=XC8VWSHZOPFP upload=M44V4ZJFTOE5 tag=864ZL0JDXI1R type=write size=1470859 2024-09-14T11:15:24.609 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:24.612+0000 7f76c1e8a8c0 1 > prepared operation key=XC8VWSHZOPFP tag=EKC84QQYCBPC type=del size=2355934 2024-09-14T11:15:24.610 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:24.612+0000 7f76c1e8a8c0 1 < canceled part key=_multipart_LZ0YNFOVFYCL.2~0EFI5V39R8YO.0 size=298096 2024-09-14T11:15:24.614 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:24.616+0000 7f76c1e8a8c0 1 < canceled multipart upload key=LZ0YNFOVFYCL upload=0EFI5V39R8YO tag=R3QCMUM4YYSD type=write size=1346672 2024-09-14T11:15:24.620 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:24.624+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_K9W031V6BFJP.2~48KT27A2GU71.0 size=1048576 2024-09-14T11:15:24.623 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:24.624+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_K9W031V6BFJP.2~48KT27A2GU71.1 size=177953 2024-09-14T11:15:24.623 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:24.624+0000 7f76c1e8a8c0 1 > prepared multipart upload key=K9W031V6BFJP upload=48KT27A2GU71 tag=RHPAH3Z3N701 type=write size=2275105 2024-09-14T11:15:24.626 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:24.628+0000 7f76c1e8a8c0 1 < completed part key=_multipart_1K8ESNXU6WDF.2~N2LU18OXHDL3.0 size=1048576 2024-09-14T11:15:24.629 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:24.632+0000 7f76c1e8a8c0 1 < completed part key=_multipart_1K8ESNXU6WDF.2~N2LU18OXHDL3.1 size=1048576 2024-09-14T11:15:24.632 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:24.632+0000 7f76c1e8a8c0 1 < completed part key=_multipart_1K8ESNXU6WDF.2~N2LU18OXHDL3.2 size=906571 2024-09-14T11:15:24.637 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:24.640+0000 7f76c1e8a8c0 1 < completed multipart upload key=1K8ESNXU6WDF upload=N2LU18OXHDL3 tag=7QYUM11V05C4 type=write size=4052299 2024-09-14T11:15:24.641 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:24.644+0000 7f76c1e8a8c0 1 > prepared operation key=MEVTZ7OAD4CA tag=NS0S9XTWJZZ0 type=write size=154384 2024-09-14T11:15:24.645 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:24.648+0000 7f76c1e8a8c0 1 < completed part key=_multipart_Q5IY4J5FOD80.2~7JJOKRFJEHRD.0 size=1048576 2024-09-14T11:15:24.648 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:24.648+0000 7f76c1e8a8c0 1 < completed part key=_multipart_Q5IY4J5FOD80.2~7JJOKRFJEHRD.1 size=1048576 2024-09-14T11:15:24.650 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:24.652+0000 7f76c1e8a8c0 1 < completed part key=_multipart_Q5IY4J5FOD80.2~7JJOKRFJEHRD.2 size=663036 2024-09-14T11:15:24.655 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:24.656+0000 7f76c1e8a8c0 1 < completed multipart upload key=Q5IY4J5FOD80 upload=7JJOKRFJEHRD tag=UA6AVVSXWJWL type=write size=3808764 2024-09-14T11:15:24.657 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:24.660+0000 7f76c1e8a8c0 1 > prepared operation key=LZ0YNFOVFYCL tag=4WVCNEP6BHN2 type=del size=2389233 2024-09-14T11:15:24.661 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:24.664+0000 7f76c1e8a8c0 1 < completed part key=_multipart_Q5IY4J5FOD80.2~2R6022G13UOG.0 size=1048576 2024-09-14T11:15:24.663 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:24.664+0000 7f76c1e8a8c0 1 < completed part key=_multipart_Q5IY4J5FOD80.2~2R6022G13UOG.1 size=1048576 2024-09-14T11:15:24.666 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:24.668+0000 7f76c1e8a8c0 1 < completed part key=_multipart_Q5IY4J5FOD80.2~2R6022G13UOG.2 size=843454 2024-09-14T11:15:24.671 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:24.672+0000 7f76c1e8a8c0 1 < completed multipart upload key=Q5IY4J5FOD80 upload=2R6022G13UOG tag=YKTG00Q8E13P type=write size=3989182 2024-09-14T11:15:24.675 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:24.676+0000 7f76c1e8a8c0 1 > prepared operation key=8FFV9G6EQR8F tag=1EM2OO0MYCWM type=del size=490840 2024-09-14T11:15:24.675 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:24.676+0000 7f76c1e8a8c0 1 < canceled part key=_multipart_SHKU2PRNREKK.2~MDOBMQ3I44XD.0 size=1048576 2024-09-14T11:15:24.678 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:24.680+0000 7f76c1e8a8c0 1 < completed part key=_multipart_SHKU2PRNREKK.2~MDOBMQ3I44XD.1 size=239121 2024-09-14T11:15:24.683 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:24.684+0000 7f76c1e8a8c0 1 < canceled multipart upload key=SHKU2PRNREKK upload=MDOBMQ3I44XD tag=JEW7YD226F6S type=write size=2336273 2024-09-14T11:15:24.686 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:24.688+0000 7f76c1e8a8c0 1 > prepared operation key=TUFOZKTV9XIH tag=GGZTK8SPXYL5 type=del size=3792770 2024-09-14T11:15:24.689 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:24.692+0000 7f76c1e8a8c0 -1 < failed to complete operation key=KS37ZO6MKAH9 tag=Y578YDQU3CFY type=del size=1098705: (22) Invalid argument 2024-09-14T11:15:24.695 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:24.696+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_85G6NT78HAWQ.2~GYOH95U68TRS.0 size=1048576 2024-09-14T11:15:24.697 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:24.700+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_85G6NT78HAWQ.2~GYOH95U68TRS.1 size=1048576 2024-09-14T11:15:24.699 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:24.700+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_85G6NT78HAWQ.2~GYOH95U68TRS.2 size=199650 2024-09-14T11:15:24.700 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:24.700+0000 7f76c1e8a8c0 1 > prepared multipart upload key=85G6NT78HAWQ upload=GYOH95U68TRS tag=BYDX4W91X4PC type=write size=3345378 2024-09-14T11:15:24.700 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:24.704+0000 7f76c1e8a8c0 1 < canceled part key=_multipart_S43U13LYETS4.2~B6K90D4500P4.0 size=1048576 2024-09-14T11:15:24.703 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:24.704+0000 7f76c1e8a8c0 1 < completed part key=_multipart_S43U13LYETS4.2~B6K90D4500P4.1 size=907720 2024-09-14T11:15:24.707 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:24.708+0000 7f76c1e8a8c0 1 < canceled multipart upload key=S43U13LYETS4 upload=B6K90D4500P4 tag=NAZM02CCRF1R type=write size=3004872 2024-09-14T11:15:24.710 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:24.712+0000 7f76c1e8a8c0 1 > prepared operation key=VI61O3K069BP tag=UA5QCIHSERF6 type=del size=912727 2024-09-14T11:15:24.716 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:24.720+0000 7f76c1e8a8c0 1 < suggested remove operation key=TZO40K6J9877 tag=DVBRAKFB6NG5 type=write 2024-09-14T11:15:24.719 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:24.720+0000 7f76c1e8a8c0 1 > prepared operation key=BOCIF4TL7X7J tag=TE8P8Z5FHAMM type=del size=2963821 2024-09-14T11:15:24.725 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:24.728+0000 7f76c1e8a8c0 1 < suggested update operation key=S43U13LYETS4 tag=YZE619RBB703 type=del size=2422641 2024-09-14T11:15:24.728 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:24.732+0000 7f76c1e8a8c0 1 > prepared operation key=R5I9H7WAK7Z7 tag=QM9ZL9IJA58W type=del size=3694404 2024-09-14T11:15:24.731 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:24.732+0000 7f76c1e8a8c0 1 < completed delete operation key=8FFV9G6EQR8F tag=6W9MHWWEC6W8 type=del 2024-09-14T11:15:24.734 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:24.736+0000 7f76c1e8a8c0 1 > prepared operation key=GAVZRU8ZLW7S tag=6047H2TJYQ1K type=del size=3149828 2024-09-14T11:15:24.737 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:24.740+0000 7f76c1e8a8c0 1 < canceled operation key=MEVTZ7OAD4CA tag=JN1QZL9ONWLN type=del size=3054171 2024-09-14T11:15:24.741 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:24.744+0000 7f76c1e8a8c0 1 > prepared operation key=K2EEZLRK7MVO tag=6X51A4JKWP7X type=del size=1704583 2024-09-14T11:15:24.741 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:24.744+0000 7f76c1e8a8c0 1 < canceled part key=_multipart_HS7T50JORDQJ.2~38RCCE85N5FY.0 size=1048576 2024-09-14T11:15:24.744 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:24.748+0000 7f76c1e8a8c0 1 < completed part key=_multipart_HS7T50JORDQJ.2~38RCCE85N5FY.1 size=1048576 2024-09-14T11:15:24.746 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:24.748+0000 7f76c1e8a8c0 1 < completed part key=_multipart_HS7T50JORDQJ.2~38RCCE85N5FY.2 size=10240 2024-09-14T11:15:24.752 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:24.756+0000 7f76c1e8a8c0 1 < canceled multipart upload key=HS7T50JORDQJ upload=38RCCE85N5FY tag=XJTXTD2OI6M4 type=write size=3155968 2024-09-14T11:15:24.755 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:24.756+0000 7f76c1e8a8c0 1 > prepared operation key=F3KFS0P1WM7W tag=EGVLUYEGON6K type=del size=569742 2024-09-14T11:15:24.758 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:24.760+0000 7f76c1e8a8c0 1 < completed part key=_multipart_R5I9H7WAK7Z7.2~XFYTI7AIC8GN.0 size=1048576 2024-09-14T11:15:24.761 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:24.764+0000 7f76c1e8a8c0 1 < completed part key=_multipart_R5I9H7WAK7Z7.2~XFYTI7AIC8GN.1 size=1048576 2024-09-14T11:15:24.764 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:24.764+0000 7f76c1e8a8c0 1 < completed part key=_multipart_R5I9H7WAK7Z7.2~XFYTI7AIC8GN.2 size=799666 2024-09-14T11:15:24.769 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:24.772+0000 7f76c1e8a8c0 1 < completed multipart upload key=R5I9H7WAK7Z7 upload=XFYTI7AIC8GN tag=1YV9WFSZONN4 type=write size=3945394 2024-09-14T11:15:24.775 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:24.776+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_H9CQV6L29SL5.2~WOWTVMTJGQGZ.0 size=1048576 2024-09-14T11:15:24.777 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:24.780+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_H9CQV6L29SL5.2~WOWTVMTJGQGZ.1 size=1006890 2024-09-14T11:15:24.778 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:24.780+0000 7f76c1e8a8c0 1 > prepared multipart upload key=H9CQV6L29SL5 upload=WOWTVMTJGQGZ tag=GJKPE03SRHW1 type=write size=3104042 2024-09-14T11:15:24.781 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:24.784+0000 7f76c1e8a8c0 1 < completed part key=_multipart_S43U13LYETS4.2~QEPXO5H03832.0 size=1048576 2024-09-14T11:15:24.783 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:24.784+0000 7f76c1e8a8c0 1 < completed part key=_multipart_S43U13LYETS4.2~QEPXO5H03832.1 size=471853 2024-09-14T11:15:24.789 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:24.792+0000 7f76c1e8a8c0 1 < completed multipart upload key=S43U13LYETS4 upload=QEPXO5H03832 tag=SL1WRWT3HK6S type=write size=2569005 2024-09-14T11:15:24.792 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:24.796+0000 7f76c1e8a8c0 1 > prepared operation key=VI61O3K069BP tag=016A1H64TFJI type=write size=163329 2024-09-14T11:15:24.802 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:24.804+0000 7f76c1e8a8c0 1 < suggested update operation key=8PZOVFEYYSOG tag=ONCZRQ6HZV6I type=write size=598506 2024-09-14T11:15:24.806 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:24.808+0000 7f76c1e8a8c0 1 > prepared operation key=HJ701768A6I7 tag=8KGX65RPPNHU type=del size=3250960 2024-09-14T11:15:24.810 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:24.812+0000 7f76c1e8a8c0 1 < completed delete operation key=XC8VWSHZOPFP tag=EKC84QQYCBPC type=del 2024-09-14T11:15:24.816 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:24.820+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_BOCIF4TL7X7J.2~P549PW8YU096.0 size=1048576 2024-09-14T11:15:24.819 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:24.820+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_BOCIF4TL7X7J.2~P549PW8YU096.1 size=1048576 2024-09-14T11:15:24.821 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:24.824+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_BOCIF4TL7X7J.2~P549PW8YU096.2 size=837540 2024-09-14T11:15:24.822 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:24.824+0000 7f76c1e8a8c0 1 > prepared multipart upload key=BOCIF4TL7X7J upload=P549PW8YU096 tag=A8KTZKOEUKAQ type=write size=3983268 2024-09-14T11:15:24.825 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:24.828+0000 7f76c1e8a8c0 1 < completed part key=_multipart_K9W031V6BFJP.2~48KT27A2GU71.0 size=1048576 2024-09-14T11:15:24.827 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:24.828+0000 7f76c1e8a8c0 1 < completed part key=_multipart_K9W031V6BFJP.2~48KT27A2GU71.1 size=177953 2024-09-14T11:15:24.833 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:24.836+0000 7f76c1e8a8c0 1 < completed multipart upload key=K9W031V6BFJP upload=48KT27A2GU71 tag=RHPAH3Z3N701 type=write size=2275105 2024-09-14T11:15:24.837 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:24.840+0000 7f76c1e8a8c0 1 > prepared operation key=K2EEZLRK7MVO tag=0J1TDKNXITSK type=del size=3625199 2024-09-14T11:15:24.842 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:24.844+0000 7f76c1e8a8c0 1 < suggested update operation key=MEVTZ7OAD4CA tag=NS0S9XTWJZZ0 type=write size=154384 2024-09-14T11:15:24.847 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:24.848+0000 7f76c1e8a8c0 1 > prepared operation key=85G6NT78HAWQ tag=YT62EF0DRK1S type=del size=3498646 2024-09-14T11:15:24.851 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:24.852+0000 7f76c1e8a8c0 1 < canceled operation key=LZ0YNFOVFYCL tag=4WVCNEP6BHN2 type=del size=2389233 2024-09-14T11:15:24.854 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:24.856+0000 7f76c1e8a8c0 1 > prepared operation key=HS7T50JORDQJ tag=6EOC1RGJDKXO type=write size=663597 2024-09-14T11:15:24.857 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:24.860+0000 7f76c1e8a8c0 1 < completed delete operation key=8FFV9G6EQR8F tag=1EM2OO0MYCWM type=del 2024-09-14T11:15:24.860 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:24.864+0000 7f76c1e8a8c0 1 > prepared operation key=K2EEZLRK7MVO tag=VNYCXSK2PIP4 type=del size=1632356 2024-09-14T11:15:24.867 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:24.868+0000 7f76c1e8a8c0 1 < suggested remove operation key=TUFOZKTV9XIH tag=GGZTK8SPXYL5 type=del 2024-09-14T11:15:24.870 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:24.872+0000 7f76c1e8a8c0 1 > prepared operation key=OUMUTEBQ1TD0 tag=0I1ISJU1KAT1 type=del size=1790604 2024-09-14T11:15:24.873 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:24.876+0000 7f76c1e8a8c0 1 < completed part key=_multipart_85G6NT78HAWQ.2~GYOH95U68TRS.0 size=1048576 2024-09-14T11:15:24.875 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:24.876+0000 7f76c1e8a8c0 1 < completed part key=_multipart_85G6NT78HAWQ.2~GYOH95U68TRS.1 size=1048576 2024-09-14T11:15:24.879 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:24.880+0000 7f76c1e8a8c0 1 < completed part key=_multipart_85G6NT78HAWQ.2~GYOH95U68TRS.2 size=199650 2024-09-14T11:15:24.885 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:24.888+0000 7f76c1e8a8c0 1 < completed multipart upload key=85G6NT78HAWQ upload=GYOH95U68TRS tag=BYDX4W91X4PC type=write size=3345378 2024-09-14T11:15:24.891 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:24.892+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_SUNCRV0C1XYL.2~JVYK5AD4U7EE.0 size=468850 2024-09-14T11:15:24.891 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:24.892+0000 7f76c1e8a8c0 1 > prepared multipart upload key=SUNCRV0C1XYL upload=JVYK5AD4U7EE tag=PPXNTYCJJL0H type=write size=1517426 2024-09-14T11:15:24.894 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:24.896+0000 7f76c1e8a8c0 1 < completed delete operation key=VI61O3K069BP tag=UA5QCIHSERF6 type=del 2024-09-14T11:15:24.897 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:24.900+0000 7f76c1e8a8c0 1 > prepared operation key=SUNCRV0C1XYL tag=14WERXHQFYT1 type=del size=1645584 2024-09-14T11:15:24.904 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:24.904+0000 7f76c1e8a8c0 1 < suggested update operation key=BOCIF4TL7X7J tag=TE8P8Z5FHAMM type=del size=2963821 2024-09-14T11:15:24.907 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:24.908+0000 7f76c1e8a8c0 1 > prepared operation key=H9CQV6L29SL5 tag=C61ZEVKOZ52N type=del size=2686277 2024-09-14T11:15:24.915 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:24.916+0000 7f76c1e8a8c0 1 < suggested update operation key=R5I9H7WAK7Z7 tag=QM9ZL9IJA58W type=del size=3694404 2024-09-14T11:15:24.922 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:24.924+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_XC8VWSHZOPFP.2~MWAT3M7EIOTT.0 size=1048576 2024-09-14T11:15:24.924 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:24.928+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_XC8VWSHZOPFP.2~MWAT3M7EIOTT.1 size=344996 2024-09-14T11:15:24.924 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:24.928+0000 7f76c1e8a8c0 1 > prepared multipart upload key=XC8VWSHZOPFP upload=MWAT3M7EIOTT tag=KFMTD8XR0QAW type=write size=2442148 2024-09-14T11:15:24.927 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:24.928+0000 7f76c1e8a8c0 1 < completed delete operation key=GAVZRU8ZLW7S tag=6047H2TJYQ1K type=del 2024-09-14T11:15:24.933 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:24.936+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_6TIJR323NMOH.2~PQA47S9GVRCA.0 size=1048576 2024-09-14T11:15:24.935 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:24.936+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_6TIJR323NMOH.2~PQA47S9GVRCA.1 size=873324 2024-09-14T11:15:24.935 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:24.936+0000 7f76c1e8a8c0 1 > prepared multipart upload key=6TIJR323NMOH upload=PQA47S9GVRCA tag=75WR2BFGSYA1 type=write size=2970476 2024-09-14T11:15:24.937 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:24.940+0000 7f76c1e8a8c0 1 < completed delete operation key=K2EEZLRK7MVO tag=6X51A4JKWP7X type=del 2024-09-14T11:15:24.940 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:24.944+0000 7f76c1e8a8c0 1 > prepared operation key=VI61O3K069BP tag=ZOT2E242JP77 type=del size=877436 2024-09-14T11:15:24.946 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:24.948+0000 7f76c1e8a8c0 1 < suggested update operation key=F3KFS0P1WM7W tag=EGVLUYEGON6K type=del size=569742 2024-09-14T11:15:24.948 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:24.952+0000 7f76c1e8a8c0 1 > prepared operation key=LZ0YNFOVFYCL tag=1KYSDS7LCQX9 type=del size=3516897 2024-09-14T11:15:24.949 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:24.952+0000 7f76c1e8a8c0 1 < canceled part key=_multipart_H9CQV6L29SL5.2~WOWTVMTJGQGZ.0 size=1048576 2024-09-14T11:15:24.951 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:24.952+0000 7f76c1e8a8c0 1 < completed part key=_multipart_H9CQV6L29SL5.2~WOWTVMTJGQGZ.1 size=1006890 2024-09-14T11:15:24.955 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:24.956+0000 7f76c1e8a8c0 1 < canceled multipart upload key=H9CQV6L29SL5 upload=WOWTVMTJGQGZ tag=GJKPE03SRHW1 type=write size=3104042 2024-09-14T11:15:24.961 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:24.964+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_TZO40K6J9877.2~72SBM1WFH8QZ.0 size=176160 2024-09-14T11:15:24.961 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:24.964+0000 7f76c1e8a8c0 1 > prepared multipart upload key=TZO40K6J9877 upload=72SBM1WFH8QZ tag=W0CW9OR1F3TC type=write size=1224736 2024-09-14T11:15:24.963 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:24.964+0000 7f76c1e8a8c0 1 < canceled operation key=VI61O3K069BP tag=016A1H64TFJI type=write size=163329 2024-09-14T11:15:24.966 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:24.968+0000 7f76c1e8a8c0 1 > prepared operation key=85G6NT78HAWQ tag=AUHRS63LMTE1 type=del size=2809299 2024-09-14T11:15:24.972 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:24.972+0000 7f76c1e8a8c0 1 < suggested update operation key=HJ701768A6I7 tag=8KGX65RPPNHU type=del size=3250960 2024-09-14T11:15:24.975 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:24.976+0000 7f76c1e8a8c0 1 > prepared operation key=Q5IY4J5FOD80 tag=KF1J3YP2Y3EH type=del size=3889001 2024-09-14T11:15:24.978 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:24.980+0000 7f76c1e8a8c0 1 < completed part key=_multipart_BOCIF4TL7X7J.2~P549PW8YU096.0 size=1048576 2024-09-14T11:15:24.980 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:24.984+0000 7f76c1e8a8c0 1 < completed part key=_multipart_BOCIF4TL7X7J.2~P549PW8YU096.1 size=1048576 2024-09-14T11:15:24.980 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:24.984+0000 7f76c1e8a8c0 1 < canceled part key=_multipart_BOCIF4TL7X7J.2~P549PW8YU096.2 size=837540 2024-09-14T11:15:24.985 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:24.988+0000 7f76c1e8a8c0 1 < canceled multipart upload key=BOCIF4TL7X7J upload=P549PW8YU096 tag=A8KTZKOEUKAQ type=write size=3983268 2024-09-14T11:15:24.988 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:24.988+0000 7f76c1e8a8c0 1 > prepared operation key=H9CQV6L29SL5 tag=OT5JM0KXI82G type=write size=304910 2024-09-14T11:15:24.991 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:24.992+0000 7f76c1e8a8c0 1 < completed delete operation key=K2EEZLRK7MVO tag=0J1TDKNXITSK type=del 2024-09-14T11:15:24.993 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:24.996+0000 7f76c1e8a8c0 1 > prepared operation key=S43U13LYETS4 tag=O1V53NCVIBHR type=del size=1669480 2024-09-14T11:15:24.996 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:25.000+0000 7f76c1e8a8c0 1 < completed delete operation key=85G6NT78HAWQ tag=YT62EF0DRK1S type=del 2024-09-14T11:15:25.002 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:25.004+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_SHKU2PRNREKK.2~APCVPJLVC0RC.0 size=539061 2024-09-14T11:15:25.002 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:25.004+0000 7f76c1e8a8c0 1 > prepared multipart upload key=SHKU2PRNREKK upload=APCVPJLVC0RC tag=YRDFIDCU44XN type=write size=1587637 2024-09-14T11:15:25.006 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:25.008+0000 7f76c1e8a8c0 1 < completed write operation key=HS7T50JORDQJ tag=6EOC1RGJDKXO type=write size=663597 2024-09-14T11:15:25.009 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:25.012+0000 7f76c1e8a8c0 1 > prepared operation key=SUNCRV0C1XYL tag=STJY1OT937O8 type=del size=208206 2024-09-14T11:15:25.012 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:25.016+0000 7f76c1e8a8c0 1 < completed delete operation key=K2EEZLRK7MVO tag=VNYCXSK2PIP4 type=del 2024-09-14T11:15:25.015 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:25.016+0000 7f76c1e8a8c0 1 > prepared operation key=GAVZRU8ZLW7S tag=1SCCCNNST9V2 type=del size=2986111 2024-09-14T11:15:25.022 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:25.024+0000 7f76c1e8a8c0 1 < suggested remove operation key=OUMUTEBQ1TD0 tag=0I1ISJU1KAT1 type=del 2024-09-14T11:15:25.026 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:25.028+0000 7f76c1e8a8c0 1 > prepared operation key=8FFV9G6EQR8F tag=RVWPGCA7WVO0 type=del size=2442987 2024-09-14T11:15:25.029 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:25.032+0000 7f76c1e8a8c0 1 < completed part key=_multipart_SUNCRV0C1XYL.2~JVYK5AD4U7EE.0 size=468850 2024-09-14T11:15:25.034 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:25.036+0000 7f76c1e8a8c0 1 < completed multipart upload key=SUNCRV0C1XYL upload=JVYK5AD4U7EE tag=PPXNTYCJJL0H type=write size=1517426 2024-09-14T11:15:25.038 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:25.040+0000 7f76c1e8a8c0 1 > prepared operation key=LZ0YNFOVFYCL tag=AA5BAY7MUVVS type=del size=2002797 2024-09-14T11:15:25.041 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:25.044+0000 7f76c1e8a8c0 1 < completed delete operation key=SUNCRV0C1XYL tag=14WERXHQFYT1 type=del 2024-09-14T11:15:25.046 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:25.048+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_8PZOVFEYYSOG.2~HCCJ684VPO4J.0 size=1048576 2024-09-14T11:15:25.049 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:25.052+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_8PZOVFEYYSOG.2~HCCJ684VPO4J.1 size=1048576 2024-09-14T11:15:25.051 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:25.052+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_8PZOVFEYYSOG.2~HCCJ684VPO4J.2 size=648162 2024-09-14T11:15:25.051 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:25.052+0000 7f76c1e8a8c0 1 > prepared multipart upload key=8PZOVFEYYSOG upload=HCCJ684VPO4J tag=L26KLQ48FU9G type=write size=3793890 2024-09-14T11:15:25.054 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:25.056+0000 7f76c1e8a8c0 1 < completed delete operation key=H9CQV6L29SL5 tag=C61ZEVKOZ52N type=del 2024-09-14T11:15:25.057 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:25.060+0000 7f76c1e8a8c0 1 > prepared operation key=8FFV9G6EQR8F tag=MBI4HEP0MXTT type=write size=305104 2024-09-14T11:15:25.060 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:25.060+0000 7f76c1e8a8c0 1 < completed part key=_multipart_XC8VWSHZOPFP.2~MWAT3M7EIOTT.0 size=1048576 2024-09-14T11:15:25.062 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:25.064+0000 7f76c1e8a8c0 1 < completed part key=_multipart_XC8VWSHZOPFP.2~MWAT3M7EIOTT.1 size=344996 2024-09-14T11:15:25.067 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:25.068+0000 7f76c1e8a8c0 1 < completed multipart upload key=XC8VWSHZOPFP upload=MWAT3M7EIOTT tag=KFMTD8XR0QAW type=write size=2442148 2024-09-14T11:15:25.070 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:25.072+0000 7f76c1e8a8c0 1 > prepared operation key=HJ701768A6I7 tag=FPMTCQ2E3OHN type=del size=1851899 2024-09-14T11:15:25.073 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:25.076+0000 7f76c1e8a8c0 1 < completed part key=_multipart_6TIJR323NMOH.2~PQA47S9GVRCA.0 size=1048576 2024-09-14T11:15:25.076 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:25.076+0000 7f76c1e8a8c0 1 < completed part key=_multipart_6TIJR323NMOH.2~PQA47S9GVRCA.1 size=873324 2024-09-14T11:15:25.081 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:25.084+0000 7f76c1e8a8c0 1 < completed multipart upload key=6TIJR323NMOH upload=PQA47S9GVRCA tag=75WR2BFGSYA1 type=write size=2970476 2024-09-14T11:15:25.084 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:25.084+0000 7f76c1e8a8c0 1 > prepared operation key=6TIJR323NMOH tag=JMLA4Y076E3T type=del size=4049245 2024-09-14T11:15:25.086 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:25.088+0000 7f76c1e8a8c0 1 < canceled operation key=VI61O3K069BP tag=ZOT2E242JP77 type=del size=877436 2024-09-14T11:15:25.089 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:25.092+0000 7f76c1e8a8c0 1 > prepared operation key=15FU4CEGC22Q tag=Q704DS0906MN type=del size=4168415 2024-09-14T11:15:25.093 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:25.096+0000 7f76c1e8a8c0 1 < completed delete operation key=LZ0YNFOVFYCL tag=1KYSDS7LCQX9 type=del 2024-09-14T11:15:25.101 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:25.104+0000 7f76c1e8a8c0 1 > prepared operation key=1W5733SDHGDN tag=UKCIS14GBYR1 type=del size=963288 2024-09-14T11:15:25.104 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:25.108+0000 7f76c1e8a8c0 1 < completed part key=_multipart_TZO40K6J9877.2~72SBM1WFH8QZ.0 size=176160 2024-09-14T11:15:25.109 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:25.112+0000 7f76c1e8a8c0 1 < completed multipart upload key=TZO40K6J9877 upload=72SBM1WFH8QZ tag=W0CW9OR1F3TC type=write size=1224736 2024-09-14T11:15:25.115 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:25.116+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_KS37ZO6MKAH9.2~XM0FWP3OBXSN.0 size=141025 2024-09-14T11:15:25.115 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:25.116+0000 7f76c1e8a8c0 1 > prepared multipart upload key=KS37ZO6MKAH9 upload=XM0FWP3OBXSN tag=G79M7LHNE5FY type=write size=1189601 2024-09-14T11:15:25.118 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:25.120+0000 7f76c1e8a8c0 1 < completed delete operation key=85G6NT78HAWQ tag=AUHRS63LMTE1 type=del 2024-09-14T11:15:25.123 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:25.124+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_OUMUTEBQ1TD0.2~SMENCXJNTKDU.0 size=1048576 2024-09-14T11:15:25.125 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:25.128+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_OUMUTEBQ1TD0.2~SMENCXJNTKDU.1 size=1048576 2024-09-14T11:15:25.128 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:25.132+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_OUMUTEBQ1TD0.2~SMENCXJNTKDU.2 size=249210 2024-09-14T11:15:25.128 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:25.132+0000 7f76c1e8a8c0 1 > prepared multipart upload key=OUMUTEBQ1TD0 upload=SMENCXJNTKDU tag=MEUXCWF0W4SU type=write size=3394938 2024-09-14T11:15:25.134 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:25.136+0000 7f76c1e8a8c0 1 < suggested remove operation key=Q5IY4J5FOD80 tag=KF1J3YP2Y3EH type=del 2024-09-14T11:15:25.137 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:25.140+0000 7f76c1e8a8c0 1 > prepared operation key=GZM0AQVHNCMM tag=HD53O8TW4L5F type=del size=2515750 2024-09-14T11:15:25.143 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:25.144+0000 7f76c1e8a8c0 1 < suggested update operation key=H9CQV6L29SL5 tag=OT5JM0KXI82G type=write size=304910 2024-09-14T11:15:25.148 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:25.148+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_GZM0AQVHNCMM.2~2AHQMZLA37Z7.0 size=863806 2024-09-14T11:15:25.148 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:25.148+0000 7f76c1e8a8c0 1 > prepared multipart upload key=GZM0AQVHNCMM upload=2AHQMZLA37Z7 tag=AZBU5MZFROU9 type=write size=1912382 2024-09-14T11:15:25.154 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:25.156+0000 7f76c1e8a8c0 1 < suggested update operation key=S43U13LYETS4 tag=O1V53NCVIBHR type=del size=1669480 2024-09-14T11:15:25.159 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:25.160+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_CIRQT9IDJ5OJ.2~4BJ0D6ZTE0RV.0 size=1048576 2024-09-14T11:15:25.162 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:25.164+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_CIRQT9IDJ5OJ.2~4BJ0D6ZTE0RV.1 size=1048576 2024-09-14T11:15:25.165 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:25.168+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_CIRQT9IDJ5OJ.2~4BJ0D6ZTE0RV.2 size=593629 2024-09-14T11:15:25.165 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:25.168+0000 7f76c1e8a8c0 1 > prepared multipart upload key=CIRQT9IDJ5OJ upload=4BJ0D6ZTE0RV tag=AH0A6PEVVGDJ type=write size=3739357 2024-09-14T11:15:25.168 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:25.168+0000 7f76c1e8a8c0 1 < completed part key=_multipart_SHKU2PRNREKK.2~APCVPJLVC0RC.0 size=539061 2024-09-14T11:15:25.173 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:25.176+0000 7f76c1e8a8c0 1 < completed multipart upload key=SHKU2PRNREKK upload=APCVPJLVC0RC tag=YRDFIDCU44XN type=write size=1587637 2024-09-14T11:15:25.176 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:25.180+0000 7f76c1e8a8c0 1 > prepared operation key=TZO40K6J9877 tag=A5XJ6QRB367J type=del size=3724163 2024-09-14T11:15:25.179 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:25.180+0000 7f76c1e8a8c0 1 < completed delete operation key=SUNCRV0C1XYL tag=STJY1OT937O8 type=del 2024-09-14T11:15:25.182 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:25.184+0000 7f76c1e8a8c0 1 > prepared operation key=OUMUTEBQ1TD0 tag=F96W03N3VNUV type=write size=909015 2024-09-14T11:15:25.186 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:25.188+0000 7f76c1e8a8c0 1 < completed delete operation key=GAVZRU8ZLW7S tag=1SCCCNNST9V2 type=del 2024-09-14T11:15:25.189 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:25.192+0000 7f76c1e8a8c0 1 > prepared operation key=TZO40K6J9877 tag=MNWX9XUSZZ1Z type=del size=3353680 2024-09-14T11:15:25.195 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:25.196+0000 7f76c1e8a8c0 1 < suggested remove operation key=8FFV9G6EQR8F tag=RVWPGCA7WVO0 type=del 2024-09-14T11:15:25.198 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:25.200+0000 7f76c1e8a8c0 1 > prepared operation key=8FFV9G6EQR8F tag=MT2VKBHU75YZ type=del size=1215891 2024-09-14T11:15:25.201 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:25.204+0000 7f76c1e8a8c0 1 < completed delete operation key=LZ0YNFOVFYCL tag=AA5BAY7MUVVS type=del 2024-09-14T11:15:25.204 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:25.208+0000 7f76c1e8a8c0 1 > prepared operation key=H9CQV6L29SL5 tag=86338VE7MTCK type=del size=2989847 2024-09-14T11:15:25.208 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:25.208+0000 7f76c1e8a8c0 1 < completed part key=_multipart_8PZOVFEYYSOG.2~HCCJ684VPO4J.0 size=1048576 2024-09-14T11:15:25.210 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:25.212+0000 7f76c1e8a8c0 1 < completed part key=_multipart_8PZOVFEYYSOG.2~HCCJ684VPO4J.1 size=1048576 2024-09-14T11:15:25.213 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:25.216+0000 7f76c1e8a8c0 1 < completed part key=_multipart_8PZOVFEYYSOG.2~HCCJ684VPO4J.2 size=648162 2024-09-14T11:15:25.218 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:25.220+0000 7f76c1e8a8c0 1 < completed multipart upload key=8PZOVFEYYSOG upload=HCCJ684VPO4J tag=L26KLQ48FU9G type=write size=3793890 2024-09-14T11:15:25.221 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:25.224+0000 7f76c1e8a8c0 1 > prepared operation key=K2EEZLRK7MVO tag=8PHSCEWTUVCW type=del size=2503177 2024-09-14T11:15:25.224 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:25.228+0000 7f76c1e8a8c0 -1 < failed to complete operation key=8FFV9G6EQR8F tag=MBI4HEP0MXTT type=write size=305104: (22) Invalid argument 2024-09-14T11:15:25.230 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:25.232+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_XC8VWSHZOPFP.2~YJH82P3M6YFR.0 size=1048576 2024-09-14T11:15:25.233 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:25.236+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_XC8VWSHZOPFP.2~YJH82P3M6YFR.1 size=797182 2024-09-14T11:15:25.233 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:25.236+0000 7f76c1e8a8c0 1 > prepared multipart upload key=XC8VWSHZOPFP upload=YJH82P3M6YFR tag=7TOIZOB77OG2 type=write size=2894334 2024-09-14T11:15:25.239 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:25.240+0000 7f76c1e8a8c0 1 < suggested remove operation key=HJ701768A6I7 tag=FPMTCQ2E3OHN type=del 2024-09-14T11:15:25.244 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:25.244+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_LZ0YNFOVFYCL.2~D9CC5I9CYG1T.0 size=1048576 2024-09-14T11:15:25.245 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:25.248+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_LZ0YNFOVFYCL.2~D9CC5I9CYG1T.1 size=1048576 2024-09-14T11:15:25.247 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:25.248+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_LZ0YNFOVFYCL.2~D9CC5I9CYG1T.2 size=813045 2024-09-14T11:15:25.248 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:25.248+0000 7f76c1e8a8c0 1 > prepared multipart upload key=LZ0YNFOVFYCL upload=D9CC5I9CYG1T tag=WP5BZ5ABSQCV type=write size=3958773 2024-09-14T11:15:25.252 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:25.256+0000 7f76c1e8a8c0 1 < suggested remove operation key=6TIJR323NMOH tag=JMLA4Y076E3T type=del 2024-09-14T11:15:25.255 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:25.256+0000 7f76c1e8a8c0 1 > prepared operation key=HJ701768A6I7 tag=LGUWR1TUHSKT type=del size=2616843 2024-09-14T11:15:25.258 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:25.260+0000 7f76c1e8a8c0 1 < completed delete operation key=15FU4CEGC22Q tag=Q704DS0906MN type=del 2024-09-14T11:15:25.261 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:25.264+0000 7f76c1e8a8c0 1 > prepared operation key=OOUEM16XL80W tag=5FRAQCKCELTP type=del size=2885649 2024-09-14T11:15:25.264 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:25.264+0000 7f76c1e8a8c0 1 < completed delete operation key=1W5733SDHGDN tag=UKCIS14GBYR1 type=del 2024-09-14T11:15:25.269 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:25.272+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_GZM0AQVHNCMM.2~5G1GL6UUP6KV.0 size=1048576 2024-09-14T11:15:25.271 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:25.272+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_GZM0AQVHNCMM.2~5G1GL6UUP6KV.1 size=1048576 2024-09-14T11:15:25.273 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:25.276+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_GZM0AQVHNCMM.2~5G1GL6UUP6KV.2 size=120636 2024-09-14T11:15:25.273 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:25.276+0000 7f76c1e8a8c0 1 > prepared multipart upload key=GZM0AQVHNCMM upload=5G1GL6UUP6KV tag=XG1547IFXVZ3 type=write size=3266364 2024-09-14T11:15:25.274 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:25.276+0000 7f76c1e8a8c0 1 < canceled part key=_multipart_KS37ZO6MKAH9.2~XM0FWP3OBXSN.0 size=141025 2024-09-14T11:15:25.278 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:25.280+0000 7f76c1e8a8c0 1 < canceled multipart upload key=KS37ZO6MKAH9 upload=XM0FWP3OBXSN tag=G79M7LHNE5FY type=write size=1189601 2024-09-14T11:15:25.282 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:25.284+0000 7f76c1e8a8c0 1 > prepared operation key=HS7T50JORDQJ tag=LAUCXG36HMZB type=write size=484383 2024-09-14T11:15:25.285 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:25.288+0000 7f76c1e8a8c0 1 < completed part key=_multipart_OUMUTEBQ1TD0.2~SMENCXJNTKDU.0 size=1048576 2024-09-14T11:15:25.287 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:25.288+0000 7f76c1e8a8c0 1 < completed part key=_multipart_OUMUTEBQ1TD0.2~SMENCXJNTKDU.1 size=1048576 2024-09-14T11:15:25.289 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:25.292+0000 7f76c1e8a8c0 1 < completed part key=_multipart_OUMUTEBQ1TD0.2~SMENCXJNTKDU.2 size=249210 2024-09-14T11:15:25.294 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:25.296+0000 7f76c1e8a8c0 1 < completed multipart upload key=OUMUTEBQ1TD0 upload=SMENCXJNTKDU tag=MEUXCWF0W4SU type=write size=3394938 2024-09-14T11:15:25.300 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:25.300+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_KS37ZO6MKAH9.2~HULUWN6S7XAS.0 size=1048576 2024-09-14T11:15:25.302 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:25.304+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_KS37ZO6MKAH9.2~HULUWN6S7XAS.1 size=1048576 2024-09-14T11:15:25.304 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:25.308+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_KS37ZO6MKAH9.2~HULUWN6S7XAS.2 size=675168 2024-09-14T11:15:25.304 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:25.308+0000 7f76c1e8a8c0 1 > prepared multipart upload key=KS37ZO6MKAH9 upload=HULUWN6S7XAS tag=NI1TCTJKB7K0 type=write size=3820896 2024-09-14T11:15:25.308 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:25.308+0000 7f76c1e8a8c0 1 < completed delete operation key=GZM0AQVHNCMM tag=HD53O8TW4L5F type=del 2024-09-14T11:15:25.311 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:25.312+0000 7f76c1e8a8c0 1 > prepared operation key=1K8ESNXU6WDF tag=FYXM0KFSMFI3 type=write size=118220 2024-09-14T11:15:25.314 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:25.316+0000 7f76c1e8a8c0 1 < completed part key=_multipart_GZM0AQVHNCMM.2~2AHQMZLA37Z7.0 size=863806 2024-09-14T11:15:25.318 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:25.320+0000 7f76c1e8a8c0 1 < completed multipart upload key=GZM0AQVHNCMM upload=2AHQMZLA37Z7 tag=AZBU5MZFROU9 type=write size=1912382 2024-09-14T11:15:25.321 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:25.324+0000 7f76c1e8a8c0 1 > prepared operation key=GAVZRU8ZLW7S tag=E6TDERSBEK95 type=del size=3646890 2024-09-14T11:15:25.324 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:25.328+0000 7f76c1e8a8c0 1 < completed part key=_multipart_CIRQT9IDJ5OJ.2~4BJ0D6ZTE0RV.0 size=1048576 2024-09-14T11:15:25.327 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:25.328+0000 7f76c1e8a8c0 1 < completed part key=_multipart_CIRQT9IDJ5OJ.2~4BJ0D6ZTE0RV.1 size=1048576 2024-09-14T11:15:25.329 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:25.332+0000 7f76c1e8a8c0 1 < completed part key=_multipart_CIRQT9IDJ5OJ.2~4BJ0D6ZTE0RV.2 size=593629 2024-09-14T11:15:25.334 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:25.336+0000 7f76c1e8a8c0 1 < completed multipart upload key=CIRQT9IDJ5OJ upload=4BJ0D6ZTE0RV tag=AH0A6PEVVGDJ type=write size=3739357 2024-09-14T11:15:25.340 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:25.344+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_6TIJR323NMOH.2~V8V1HN0F64T3.0 size=1048576 2024-09-14T11:15:25.342 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:25.344+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_6TIJR323NMOH.2~V8V1HN0F64T3.1 size=557144 2024-09-14T11:15:25.342 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:25.344+0000 7f76c1e8a8c0 1 > prepared multipart upload key=6TIJR323NMOH upload=V8V1HN0F64T3 tag=R1084ZTSGP9C type=write size=2654296 2024-09-14T11:15:25.347 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:25.348+0000 7f76c1e8a8c0 1 < suggested remove operation key=TZO40K6J9877 tag=A5XJ6QRB367J type=del 2024-09-14T11:15:25.350 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:25.352+0000 7f76c1e8a8c0 1 > prepared operation key=W0MDRE9YO3UP tag=749WZPZQA4O3 type=write size=805965 2024-09-14T11:15:25.355 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:25.356+0000 7f76c1e8a8c0 1 < suggested remove operation key=OUMUTEBQ1TD0 tag=F96W03N3VNUV type=write 2024-09-14T11:15:25.359 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:25.360+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_K2EEZLRK7MVO.2~M7IBV22YDKJJ.0 size=1048576 2024-09-14T11:15:25.362 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:25.364+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_K2EEZLRK7MVO.2~M7IBV22YDKJJ.1 size=1048576 2024-09-14T11:15:25.364 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:25.364+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_K2EEZLRK7MVO.2~M7IBV22YDKJJ.2 size=983327 2024-09-14T11:15:25.364 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:25.364+0000 7f76c1e8a8c0 1 > prepared multipart upload key=K2EEZLRK7MVO upload=M7IBV22YDKJJ tag=TKVIN1L0W85U type=write size=4129055 2024-09-14T11:15:25.365 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:25.368+0000 7f76c1e8a8c0 -1 < no bi entry to suggest for operation key=TZO40K6J9877 tag=MNWX9XUSZZ1Z type=del size=3353680: (2) No such file or directory 2024-09-14T11:15:25.368 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:25.368+0000 7f76c1e8a8c0 1 > prepared operation key=HJ701768A6I7 tag=8ROP6QSLF9W5 type=del size=3029508 2024-09-14T11:15:25.370 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:25.372+0000 7f76c1e8a8c0 1 < completed delete operation key=8FFV9G6EQR8F tag=MT2VKBHU75YZ type=del 2024-09-14T11:15:25.377 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:25.380+0000 7f76c1e8a8c0 1 > prepared operation key=HS7T50JORDQJ tag=WFV98CPET8KB type=del size=3749109 2024-09-14T11:15:25.380 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:25.384+0000 7f76c1e8a8c0 1 < completed delete operation key=H9CQV6L29SL5 tag=86338VE7MTCK type=del 2024-09-14T11:15:25.383 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:25.384+0000 7f76c1e8a8c0 1 > prepared operation key=MEVTZ7OAD4CA tag=G4C900XM9SAL type=write size=594001 2024-09-14T11:15:25.386 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:25.388+0000 7f76c1e8a8c0 1 < completed delete operation key=K2EEZLRK7MVO tag=8PHSCEWTUVCW type=del 2024-09-14T11:15:25.391 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:25.392+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_VI61O3K069BP.2~YXN73DM0EZ3M.0 size=1048576 2024-09-14T11:15:25.393 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:25.396+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_VI61O3K069BP.2~YXN73DM0EZ3M.1 size=88734 2024-09-14T11:15:25.393 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:25.396+0000 7f76c1e8a8c0 1 > prepared multipart upload key=VI61O3K069BP upload=YXN73DM0EZ3M tag=W4AUWVLNXKYV type=write size=2185886 2024-09-14T11:15:25.396 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:25.396+0000 7f76c1e8a8c0 1 < completed part key=_multipart_XC8VWSHZOPFP.2~YJH82P3M6YFR.0 size=1048576 2024-09-14T11:15:25.398 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:25.400+0000 7f76c1e8a8c0 1 < completed part key=_multipart_XC8VWSHZOPFP.2~YJH82P3M6YFR.1 size=797182 2024-09-14T11:15:25.402 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:25.404+0000 7f76c1e8a8c0 1 < completed multipart upload key=XC8VWSHZOPFP upload=YJH82P3M6YFR tag=7TOIZOB77OG2 type=write size=2894334 2024-09-14T11:15:25.405 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:25.408+0000 7f76c1e8a8c0 1 > prepared operation key=15FU4CEGC22Q tag=W58X47CW3XGD type=del size=4118224 2024-09-14T11:15:25.408 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:25.408+0000 7f76c1e8a8c0 1 < completed part key=_multipart_LZ0YNFOVFYCL.2~D9CC5I9CYG1T.0 size=1048576 2024-09-14T11:15:25.410 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:25.412+0000 7f76c1e8a8c0 1 < completed part key=_multipart_LZ0YNFOVFYCL.2~D9CC5I9CYG1T.1 size=1048576 2024-09-14T11:15:25.412 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:25.416+0000 7f76c1e8a8c0 1 < completed part key=_multipart_LZ0YNFOVFYCL.2~D9CC5I9CYG1T.2 size=813045 2024-09-14T11:15:25.417 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:25.420+0000 7f76c1e8a8c0 1 < completed multipart upload key=LZ0YNFOVFYCL upload=D9CC5I9CYG1T tag=WP5BZ5ABSQCV type=write size=3958773 2024-09-14T11:15:25.422 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:25.424+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_OOUEM16XL80W.2~E70TKB0B5E2R.0 size=265906 2024-09-14T11:15:25.422 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:25.424+0000 7f76c1e8a8c0 1 > prepared multipart upload key=OOUEM16XL80W upload=E70TKB0B5E2R tag=R2K91U5MNZXR type=write size=1314482 2024-09-14T11:15:25.425 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:25.428+0000 7f76c1e8a8c0 1 < completed delete operation key=HJ701768A6I7 tag=LGUWR1TUHSKT type=del 2024-09-14T11:15:25.430 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:25.432+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_HS7T50JORDQJ.2~WOR0UQBHYBNR.0 size=107310 2024-09-14T11:15:25.430 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:25.432+0000 7f76c1e8a8c0 1 > prepared multipart upload key=HS7T50JORDQJ upload=WOR0UQBHYBNR tag=0SKVBXTSDDT7 type=write size=1155886 2024-09-14T11:15:25.433 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:25.436+0000 7f76c1e8a8c0 1 < completed delete operation key=OOUEM16XL80W tag=5FRAQCKCELTP type=del 2024-09-14T11:15:25.439 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:25.440+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_S43U13LYETS4.2~RH2F9BTPPHCP.0 size=1048576 2024-09-14T11:15:25.441 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:25.444+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_S43U13LYETS4.2~RH2F9BTPPHCP.1 size=1044738 2024-09-14T11:15:25.441 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:25.444+0000 7f76c1e8a8c0 1 > prepared multipart upload key=S43U13LYETS4 upload=RH2F9BTPPHCP tag=GQJQYPDHTNT2 type=write size=3141890 2024-09-14T11:15:25.444 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:25.444+0000 7f76c1e8a8c0 1 < completed part key=_multipart_GZM0AQVHNCMM.2~5G1GL6UUP6KV.0 size=1048576 2024-09-14T11:15:25.446 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:25.448+0000 7f76c1e8a8c0 1 < completed part key=_multipart_GZM0AQVHNCMM.2~5G1GL6UUP6KV.1 size=1048576 2024-09-14T11:15:25.449 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:25.452+0000 7f76c1e8a8c0 1 < completed part key=_multipart_GZM0AQVHNCMM.2~5G1GL6UUP6KV.2 size=120636 2024-09-14T11:15:25.453 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:25.456+0000 7f76c1e8a8c0 1 < completed multipart upload key=GZM0AQVHNCMM upload=5G1GL6UUP6KV tag=XG1547IFXVZ3 type=write size=3266364 2024-09-14T11:15:25.458 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:25.460+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_OOUEM16XL80W.2~WN4X1KBNTDFV.0 size=1048576 2024-09-14T11:15:25.460 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:25.464+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_OOUEM16XL80W.2~WN4X1KBNTDFV.1 size=786750 2024-09-14T11:15:25.461 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:25.464+0000 7f76c1e8a8c0 1 > prepared multipart upload key=OOUEM16XL80W upload=WN4X1KBNTDFV tag=Q22QZNVVX25O type=write size=2883902 2024-09-14T11:15:25.464 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:25.464+0000 7f76c1e8a8c0 1 < completed write operation key=HS7T50JORDQJ tag=LAUCXG36HMZB type=write size=484383 2024-09-14T11:15:25.467 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:25.468+0000 7f76c1e8a8c0 1 > prepared operation key=1K8ESNXU6WDF tag=E3P0XDP2SB96 type=del size=2432059 2024-09-14T11:15:25.471 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:25.472+0000 7f76c1e8a8c0 1 < completed part key=_multipart_KS37ZO6MKAH9.2~HULUWN6S7XAS.0 size=1048576 2024-09-14T11:15:25.473 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:25.476+0000 7f76c1e8a8c0 1 < completed part key=_multipart_KS37ZO6MKAH9.2~HULUWN6S7XAS.1 size=1048576 2024-09-14T11:15:25.476 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:25.476+0000 7f76c1e8a8c0 1 < completed part key=_multipart_KS37ZO6MKAH9.2~HULUWN6S7XAS.2 size=675168 2024-09-14T11:15:25.481 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:25.484+0000 7f76c1e8a8c0 1 < completed multipart upload key=KS37ZO6MKAH9 upload=HULUWN6S7XAS tag=NI1TCTJKB7K0 type=write size=3820896 2024-09-14T11:15:25.484 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:25.488+0000 7f76c1e8a8c0 1 > prepared operation key=BOCIF4TL7X7J tag=O391N9RMRZUT type=del size=1553871 2024-09-14T11:15:25.487 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:25.488+0000 7f76c1e8a8c0 1 < completed write operation key=1K8ESNXU6WDF tag=FYXM0KFSMFI3 type=write size=118220 2024-09-14T11:15:25.490 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:25.492+0000 7f76c1e8a8c0 1 > prepared operation key=85G6NT78HAWQ tag=DVAA6NC20W3B type=del size=2036787 2024-09-14T11:15:25.493 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:25.496+0000 7f76c1e8a8c0 1 < completed delete operation key=GAVZRU8ZLW7S tag=E6TDERSBEK95 type=del 2024-09-14T11:15:25.499 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:25.500+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_TUFOZKTV9XIH.2~Y2OUX4KPUFLF.0 size=774893 2024-09-14T11:15:25.499 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:25.500+0000 7f76c1e8a8c0 1 > prepared multipart upload key=TUFOZKTV9XIH upload=Y2OUX4KPUFLF tag=J3W2GGS5B9JG type=write size=1823469 2024-09-14T11:15:25.502 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:25.504+0000 7f76c1e8a8c0 1 < completed part key=_multipart_6TIJR323NMOH.2~V8V1HN0F64T3.0 size=1048576 2024-09-14T11:15:25.505 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:25.508+0000 7f76c1e8a8c0 1 < completed part key=_multipart_6TIJR323NMOH.2~V8V1HN0F64T3.1 size=557144 2024-09-14T11:15:25.510 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:25.512+0000 7f76c1e8a8c0 1 < completed multipart upload key=6TIJR323NMOH upload=V8V1HN0F64T3 tag=R1084ZTSGP9C type=write size=2654296 2024-09-14T11:15:25.513 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:25.516+0000 7f76c1e8a8c0 1 > prepared operation key=SUNCRV0C1XYL tag=WM9LI0KR4OQA type=write size=289031 2024-09-14T11:15:25.516 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:25.520+0000 7f76c1e8a8c0 1 < completed write operation key=W0MDRE9YO3UP tag=749WZPZQA4O3 type=write size=805965 2024-09-14T11:15:25.519 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:25.520+0000 7f76c1e8a8c0 1 > prepared operation key=1K8ESNXU6WDF tag=JT8GGIOIRXVV type=del size=1518578 2024-09-14T11:15:25.522 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:25.524+0000 7f76c1e8a8c0 1 < completed part key=_multipart_K2EEZLRK7MVO.2~M7IBV22YDKJJ.0 size=1048576 2024-09-14T11:15:25.525 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:25.528+0000 7f76c1e8a8c0 1 < completed part key=_multipart_K2EEZLRK7MVO.2~M7IBV22YDKJJ.1 size=1048576 2024-09-14T11:15:25.528 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:25.528+0000 7f76c1e8a8c0 1 < completed part key=_multipart_K2EEZLRK7MVO.2~M7IBV22YDKJJ.2 size=983327 2024-09-14T11:15:25.533 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:25.536+0000 7f76c1e8a8c0 1 < completed multipart upload key=K2EEZLRK7MVO upload=M7IBV22YDKJJ tag=TKVIN1L0W85U type=write size=4129055 2024-09-14T11:15:25.536 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:25.536+0000 7f76c1e8a8c0 1 > prepared operation key=OOUEM16XL80W tag=6Y71ZGU4UTWY type=write size=209732 2024-09-14T11:15:25.539 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:25.540+0000 7f76c1e8a8c0 1 < completed delete operation key=HJ701768A6I7 tag=8ROP6QSLF9W5 type=del 2024-09-14T11:15:25.544 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:25.544+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_MEVTZ7OAD4CA.2~LM55YBUKD1SB.0 size=1048576 2024-09-14T11:15:25.546 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:25.548+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_MEVTZ7OAD4CA.2~LM55YBUKD1SB.1 size=1048576 2024-09-14T11:15:25.549 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:25.552+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_MEVTZ7OAD4CA.2~LM55YBUKD1SB.2 size=969881 2024-09-14T11:15:25.549 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:25.552+0000 7f76c1e8a8c0 1 > prepared multipart upload key=MEVTZ7OAD4CA upload=LM55YBUKD1SB tag=MY105O4G32QX type=write size=4115609 2024-09-14T11:15:25.552 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:25.556+0000 7f76c1e8a8c0 1 < completed delete operation key=HS7T50JORDQJ tag=WFV98CPET8KB type=del 2024-09-14T11:15:25.556 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:25.556+0000 7f76c1e8a8c0 1 > prepared operation key=W0MDRE9YO3UP tag=DBVSDYYM5CVZ type=del size=2664484 2024-09-14T11:15:25.559 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:25.560+0000 7f76c1e8a8c0 1 < canceled operation key=MEVTZ7OAD4CA tag=G4C900XM9SAL type=write size=594001 2024-09-14T11:15:25.562 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:25.564+0000 7f76c1e8a8c0 1 > prepared operation key=S43U13LYETS4 tag=UHM3MU335WZG type=del size=1056917 2024-09-14T11:15:25.565 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:25.568+0000 7f76c1e8a8c0 1 < completed part key=_multipart_VI61O3K069BP.2~YXN73DM0EZ3M.0 size=1048576 2024-09-14T11:15:25.567 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:25.568+0000 7f76c1e8a8c0 1 < completed part key=_multipart_VI61O3K069BP.2~YXN73DM0EZ3M.1 size=88734 2024-09-14T11:15:25.573 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:25.576+0000 7f76c1e8a8c0 1 < completed multipart upload key=VI61O3K069BP upload=YXN73DM0EZ3M tag=W4AUWVLNXKYV type=write size=2185886 2024-09-14T11:15:25.578 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:25.580+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_R5I9H7WAK7Z7.2~D5M4WPZKVQ2X.0 size=1048576 2024-09-14T11:15:25.581 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:25.584+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_R5I9H7WAK7Z7.2~D5M4WPZKVQ2X.1 size=1048576 2024-09-14T11:15:25.583 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:25.584+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_R5I9H7WAK7Z7.2~D5M4WPZKVQ2X.2 size=659482 2024-09-14T11:15:25.583 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:25.584+0000 7f76c1e8a8c0 1 > prepared multipart upload key=R5I9H7WAK7Z7 upload=D5M4WPZKVQ2X tag=EX8COAM2R78E type=write size=3805210 2024-09-14T11:15:25.587 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:25.588+0000 7f76c1e8a8c0 1 < canceled operation key=15FU4CEGC22Q tag=W58X47CW3XGD type=del size=4118224 2024-09-14T11:15:25.590 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:25.592+0000 7f76c1e8a8c0 1 > prepared operation key=KS37ZO6MKAH9 tag=S0IUKZPHIHBU type=del size=448478 2024-09-14T11:15:25.594 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:25.596+0000 7f76c1e8a8c0 1 < completed part key=_multipart_OOUEM16XL80W.2~E70TKB0B5E2R.0 size=265906 2024-09-14T11:15:25.599 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:25.600+0000 7f76c1e8a8c0 1 < completed multipart upload key=OOUEM16XL80W upload=E70TKB0B5E2R tag=R2K91U5MNZXR type=write size=1314482 2024-09-14T11:15:25.606 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:25.608+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_CIRQT9IDJ5OJ.2~IL3EUDS8ENVW.0 size=1048576 2024-09-14T11:15:25.609 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:25.612+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_CIRQT9IDJ5OJ.2~IL3EUDS8ENVW.1 size=1048576 2024-09-14T11:15:25.612 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:25.612+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_CIRQT9IDJ5OJ.2~IL3EUDS8ENVW.2 size=93528 2024-09-14T11:15:25.612 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:25.612+0000 7f76c1e8a8c0 1 > prepared multipart upload key=CIRQT9IDJ5OJ upload=IL3EUDS8ENVW tag=I6E072TPMWF9 type=write size=3239256 2024-09-14T11:15:25.615 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:25.616+0000 7f76c1e8a8c0 1 < completed part key=_multipart_HS7T50JORDQJ.2~WOR0UQBHYBNR.0 size=107310 2024-09-14T11:15:25.620 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:25.624+0000 7f76c1e8a8c0 1 < completed multipart upload key=HS7T50JORDQJ upload=WOR0UQBHYBNR tag=0SKVBXTSDDT7 type=write size=1155886 2024-09-14T11:15:25.625 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:25.628+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_HJ701768A6I7.2~O726YLX1MLXB.0 size=1048576 2024-09-14T11:15:25.628 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:25.628+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_HJ701768A6I7.2~O726YLX1MLXB.1 size=1048576 2024-09-14T11:15:25.630 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:25.632+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_HJ701768A6I7.2~O726YLX1MLXB.2 size=888024 2024-09-14T11:15:25.630 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:25.632+0000 7f76c1e8a8c0 1 > prepared multipart upload key=HJ701768A6I7 upload=O726YLX1MLXB tag=9B0PI3CJCZ5X type=write size=4033752 2024-09-14T11:15:25.631 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:25.632+0000 7f76c1e8a8c0 1 < canceled part key=_multipart_S43U13LYETS4.2~RH2F9BTPPHCP.0 size=1048576 2024-09-14T11:15:25.633 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:25.636+0000 7f76c1e8a8c0 1 < completed part key=_multipart_S43U13LYETS4.2~RH2F9BTPPHCP.1 size=1044738 2024-09-14T11:15:25.638 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:25.640+0000 7f76c1e8a8c0 1 < canceled multipart upload key=S43U13LYETS4 upload=RH2F9BTPPHCP tag=GQJQYPDHTNT2 type=write size=3141890 2024-09-14T11:15:25.644 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:25.648+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_XC8VWSHZOPFP.2~7FZ8NAP43BBN.0 size=781621 2024-09-14T11:15:25.644 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:25.648+0000 7f76c1e8a8c0 1 > prepared multipart upload key=XC8VWSHZOPFP upload=7FZ8NAP43BBN tag=ADBB6XR9VQ7H type=write size=1830197 2024-09-14T11:15:25.647 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:25.648+0000 7f76c1e8a8c0 1 < completed part key=_multipart_OOUEM16XL80W.2~WN4X1KBNTDFV.0 size=1048576 2024-09-14T11:15:25.650 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:25.652+0000 7f76c1e8a8c0 1 < completed part key=_multipart_OOUEM16XL80W.2~WN4X1KBNTDFV.1 size=786750 2024-09-14T11:15:25.659 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:25.660+0000 7f76c1e8a8c0 1 < completed multipart upload key=OOUEM16XL80W upload=WN4X1KBNTDFV tag=Q22QZNVVX25O type=write size=2883902 2024-09-14T11:15:25.663 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:25.664+0000 7f76c1e8a8c0 1 > prepared operation key=VI61O3K069BP tag=R9YA1DUYRTQP type=del size=1911197 2024-09-14T11:15:25.666 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:25.668+0000 7f76c1e8a8c0 1 < completed delete operation key=1K8ESNXU6WDF tag=E3P0XDP2SB96 type=del 2024-09-14T11:15:25.671 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:25.672+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_BOCIF4TL7X7J.2~1Z4DK6IUWNOH.0 size=1048576 2024-09-14T11:15:25.673 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:25.676+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_BOCIF4TL7X7J.2~1Z4DK6IUWNOH.1 size=1048576 2024-09-14T11:15:25.675 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:25.676+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_BOCIF4TL7X7J.2~1Z4DK6IUWNOH.2 size=527971 2024-09-14T11:15:25.675 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:25.676+0000 7f76c1e8a8c0 1 > prepared multipart upload key=BOCIF4TL7X7J upload=1Z4DK6IUWNOH tag=PL7ZR1D2VW2H type=write size=3673699 2024-09-14T11:15:25.680 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:25.684+0000 7f76c1e8a8c0 1 < suggested update operation key=BOCIF4TL7X7J tag=O391N9RMRZUT type=del size=1553871 2024-09-14T11:15:25.685 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:25.688+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_F3KFS0P1WM7W.2~HBF0MQWZ7BJ7.0 size=1048576 2024-09-14T11:15:25.687 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:25.688+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_F3KFS0P1WM7W.2~HBF0MQWZ7BJ7.1 size=1048576 2024-09-14T11:15:25.689 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:25.692+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_F3KFS0P1WM7W.2~HBF0MQWZ7BJ7.2 size=422306 2024-09-14T11:15:25.689 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:25.692+0000 7f76c1e8a8c0 1 > prepared multipart upload key=F3KFS0P1WM7W upload=HBF0MQWZ7BJ7 tag=XACKT5YSM7IX type=write size=3568034 2024-09-14T11:15:25.691 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:25.692+0000 7f76c1e8a8c0 1 < completed delete operation key=85G6NT78HAWQ tag=DVAA6NC20W3B type=del 2024-09-14T11:15:25.694 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:25.696+0000 7f76c1e8a8c0 1 > prepared operation key=OOUEM16XL80W tag=JPMJ4XYVLHZ3 type=del size=4104814 2024-09-14T11:15:25.696 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:25.700+0000 7f76c1e8a8c0 1 < completed part key=_multipart_TUFOZKTV9XIH.2~Y2OUX4KPUFLF.0 size=774893 2024-09-14T11:15:25.701 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:25.704+0000 7f76c1e8a8c0 1 < completed multipart upload key=TUFOZKTV9XIH upload=Y2OUX4KPUFLF tag=J3W2GGS5B9JG type=write size=1823469 2024-09-14T11:15:25.703 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:25.704+0000 7f76c1e8a8c0 1 > prepared operation key=OOUEM16XL80W tag=OCO70UG45N9F type=write size=703762 2024-09-14T11:15:25.706 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:25.708+0000 7f76c1e8a8c0 1 < completed write operation key=SUNCRV0C1XYL tag=WM9LI0KR4OQA type=write size=289031 2024-09-14T11:15:25.708 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:25.712+0000 7f76c1e8a8c0 1 > prepared operation key=SHKU2PRNREKK tag=Q0DRJBK3FK7N type=del size=1354924 2024-09-14T11:15:25.711 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:25.712+0000 7f76c1e8a8c0 1 < completed delete operation key=1K8ESNXU6WDF tag=JT8GGIOIRXVV type=del 2024-09-14T11:15:25.714 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:25.716+0000 7f76c1e8a8c0 1 > prepared operation key=HS7T50JORDQJ tag=WPAMLAX3YHCC type=del size=1191527 2024-09-14T11:15:25.719 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:25.720+0000 7f76c1e8a8c0 1 < suggested remove operation key=OOUEM16XL80W tag=6Y71ZGU4UTWY type=write 2024-09-14T11:15:25.721 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:25.724+0000 7f76c1e8a8c0 1 > prepared operation key=6TIJR323NMOH tag=SXWGBMPJ47BC type=del size=1885868 2024-09-14T11:15:25.724 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:25.728+0000 7f76c1e8a8c0 1 < completed part key=_multipart_MEVTZ7OAD4CA.2~LM55YBUKD1SB.0 size=1048576 2024-09-14T11:15:25.726 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:25.728+0000 7f76c1e8a8c0 1 < completed part key=_multipart_MEVTZ7OAD4CA.2~LM55YBUKD1SB.1 size=1048576 2024-09-14T11:15:25.728 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:25.732+0000 7f76c1e8a8c0 1 < completed part key=_multipart_MEVTZ7OAD4CA.2~LM55YBUKD1SB.2 size=969881 2024-09-14T11:15:25.733 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:25.736+0000 7f76c1e8a8c0 1 < completed multipart upload key=MEVTZ7OAD4CA upload=LM55YBUKD1SB tag=MY105O4G32QX type=write size=4115609 2024-09-14T11:15:25.735 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:25.736+0000 7f76c1e8a8c0 1 > prepared operation key=R5I9H7WAK7Z7 tag=O4CAV26TROC1 type=del size=258742 2024-09-14T11:15:25.738 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:25.740+0000 7f76c1e8a8c0 1 < completed delete operation key=W0MDRE9YO3UP tag=DBVSDYYM5CVZ type=del 2024-09-14T11:15:25.743 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:25.744+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_SUNCRV0C1XYL.2~JUQ645IJZ98Y.0 size=763673 2024-09-14T11:15:25.743 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:25.744+0000 7f76c1e8a8c0 1 > prepared multipart upload key=SUNCRV0C1XYL upload=JUQ645IJZ98Y tag=1WCMZSS8T9A7 type=write size=1812249 2024-09-14T11:15:25.745 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:25.748+0000 7f76c1e8a8c0 1 < completed delete operation key=S43U13LYETS4 tag=UHM3MU335WZG type=del 2024-09-14T11:15:25.748 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:25.752+0000 7f76c1e8a8c0 1 > prepared operation key=MEVTZ7OAD4CA tag=TZE3NCEF513I type=del size=2686017 2024-09-14T11:15:25.751 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:25.752+0000 7f76c1e8a8c0 1 < completed part key=_multipart_R5I9H7WAK7Z7.2~D5M4WPZKVQ2X.0 size=1048576 2024-09-14T11:15:25.753 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:25.756+0000 7f76c1e8a8c0 1 < completed part key=_multipart_R5I9H7WAK7Z7.2~D5M4WPZKVQ2X.1 size=1048576 2024-09-14T11:15:25.756 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:25.756+0000 7f76c1e8a8c0 1 < completed part key=_multipart_R5I9H7WAK7Z7.2~D5M4WPZKVQ2X.2 size=659482 2024-09-14T11:15:25.760 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:25.764+0000 7f76c1e8a8c0 1 < completed multipart upload key=R5I9H7WAK7Z7 upload=D5M4WPZKVQ2X tag=EX8COAM2R78E type=write size=3805210 2024-09-14T11:15:25.766 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:25.768+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_H9CQV6L29SL5.2~3UL08G5CRUIC.0 size=1048576 2024-09-14T11:15:25.768 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:25.772+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_H9CQV6L29SL5.2~3UL08G5CRUIC.1 size=11137 2024-09-14T11:15:25.768 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:25.772+0000 7f76c1e8a8c0 1 > prepared multipart upload key=H9CQV6L29SL5 upload=3UL08G5CRUIC tag=S3AC24ZGQA9Q type=write size=2108289 2024-09-14T11:15:25.771 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:25.772+0000 7f76c1e8a8c0 1 < completed delete operation key=KS37ZO6MKAH9 tag=S0IUKZPHIHBU type=del 2024-09-14T11:15:25.774 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:25.776+0000 7f76c1e8a8c0 1 > prepared operation key=K9W031V6BFJP tag=L5Z3H0PQB3XX type=del size=2455817 2024-09-14T11:15:25.778 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:25.780+0000 7f76c1e8a8c0 1 < completed part key=_multipart_CIRQT9IDJ5OJ.2~IL3EUDS8ENVW.0 size=1048576 2024-09-14T11:15:25.781 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:25.784+0000 7f76c1e8a8c0 1 < completed part key=_multipart_CIRQT9IDJ5OJ.2~IL3EUDS8ENVW.1 size=1048576 2024-09-14T11:15:25.784 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:25.784+0000 7f76c1e8a8c0 1 < completed part key=_multipart_CIRQT9IDJ5OJ.2~IL3EUDS8ENVW.2 size=93528 2024-09-14T11:15:25.788 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:25.792+0000 7f76c1e8a8c0 1 < completed multipart upload key=CIRQT9IDJ5OJ upload=IL3EUDS8ENVW tag=I6E072TPMWF9 type=write size=3239256 2024-09-14T11:15:25.794 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:25.796+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_8FFV9G6EQR8F.2~AHE7E1WFG1OE.0 size=1048576 2024-09-14T11:15:25.797 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:25.800+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_8FFV9G6EQR8F.2~AHE7E1WFG1OE.1 size=557019 2024-09-14T11:15:25.797 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:25.800+0000 7f76c1e8a8c0 1 > prepared multipart upload key=8FFV9G6EQR8F upload=AHE7E1WFG1OE tag=FIVFS20ICAD9 type=write size=2654171 2024-09-14T11:15:25.801 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:25.804+0000 7f76c1e8a8c0 1 < completed part key=_multipart_HJ701768A6I7.2~O726YLX1MLXB.0 size=1048576 2024-09-14T11:15:25.803 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:25.804+0000 7f76c1e8a8c0 1 < completed part key=_multipart_HJ701768A6I7.2~O726YLX1MLXB.1 size=1048576 2024-09-14T11:15:25.803 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:25.804+0000 7f76c1e8a8c0 1 < canceled part key=_multipart_HJ701768A6I7.2~O726YLX1MLXB.2 size=888024 2024-09-14T11:15:25.808 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:25.812+0000 7f76c1e8a8c0 1 < canceled multipart upload key=HJ701768A6I7 upload=O726YLX1MLXB tag=9B0PI3CJCZ5X type=write size=4033752 2024-09-14T11:15:25.811 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:25.812+0000 7f76c1e8a8c0 1 > prepared operation key=W0MDRE9YO3UP tag=1GU5QSB2KF6E type=del size=3945063 2024-09-14T11:15:25.815 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:25.816+0000 7f76c1e8a8c0 1 < completed part key=_multipart_XC8VWSHZOPFP.2~7FZ8NAP43BBN.0 size=781621 2024-09-14T11:15:25.819 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:25.820+0000 7f76c1e8a8c0 1 < completed multipart upload key=XC8VWSHZOPFP upload=7FZ8NAP43BBN tag=ADBB6XR9VQ7H type=write size=1830197 2024-09-14T11:15:25.823 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:25.824+0000 7f76c1e8a8c0 1 > prepared operation key=Q5IY4J5FOD80 tag=Q13MXF8LIHCI type=write size=768717 2024-09-14T11:15:25.826 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:25.828+0000 7f76c1e8a8c0 1 < completed delete operation key=VI61O3K069BP tag=R9YA1DUYRTQP type=del 2024-09-14T11:15:25.828 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:25.832+0000 7f76c1e8a8c0 1 > prepared operation key=XC8VWSHZOPFP tag=8XNAZ6COP542 type=del size=1629025 2024-09-14T11:15:25.832 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:25.836+0000 7f76c1e8a8c0 1 < completed part key=_multipart_BOCIF4TL7X7J.2~1Z4DK6IUWNOH.0 size=1048576 2024-09-14T11:15:25.835 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:25.836+0000 7f76c1e8a8c0 1 < completed part key=_multipart_BOCIF4TL7X7J.2~1Z4DK6IUWNOH.1 size=1048576 2024-09-14T11:15:25.835 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:25.836+0000 7f76c1e8a8c0 1 < canceled part key=_multipart_BOCIF4TL7X7J.2~1Z4DK6IUWNOH.2 size=527971 2024-09-14T11:15:25.839 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:25.840+0000 7f76c1e8a8c0 1 < canceled multipart upload key=BOCIF4TL7X7J upload=1Z4DK6IUWNOH tag=PL7ZR1D2VW2H type=write size=3673699 2024-09-14T11:15:25.844 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:25.844+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_GZM0AQVHNCMM.2~17Z4VWHWEV3J.0 size=1048576 2024-09-14T11:15:25.846 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:25.848+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_GZM0AQVHNCMM.2~17Z4VWHWEV3J.1 size=396714 2024-09-14T11:15:25.846 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:25.848+0000 7f76c1e8a8c0 1 > prepared multipart upload key=GZM0AQVHNCMM upload=17Z4VWHWEV3J tag=PJN3CW41IILH type=write size=2493866 2024-09-14T11:15:25.849 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:25.852+0000 7f76c1e8a8c0 1 < completed part key=_multipart_F3KFS0P1WM7W.2~HBF0MQWZ7BJ7.0 size=1048576 2024-09-14T11:15:25.852 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:25.852+0000 7f76c1e8a8c0 1 < completed part key=_multipart_F3KFS0P1WM7W.2~HBF0MQWZ7BJ7.1 size=1048576 2024-09-14T11:15:25.854 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:25.856+0000 7f76c1e8a8c0 1 < completed part key=_multipart_F3KFS0P1WM7W.2~HBF0MQWZ7BJ7.2 size=422306 2024-09-14T11:15:25.858 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:25.860+0000 7f76c1e8a8c0 1 < completed multipart upload key=F3KFS0P1WM7W upload=HBF0MQWZ7BJ7 tag=XACKT5YSM7IX type=write size=3568034 2024-09-14T11:15:25.863 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:25.864+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_OOUEM16XL80W.2~HERWKYMTEA2G.0 size=1048576 2024-09-14T11:15:25.865 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:25.868+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_OOUEM16XL80W.2~HERWKYMTEA2G.1 size=1048576 2024-09-14T11:15:25.867 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:25.868+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_OOUEM16XL80W.2~HERWKYMTEA2G.2 size=1003259 2024-09-14T11:15:25.867 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:25.868+0000 7f76c1e8a8c0 1 > prepared multipart upload key=OOUEM16XL80W upload=HERWKYMTEA2G tag=BQ0P8YRPIYBW type=write size=4148987 2024-09-14T11:15:25.869 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:25.872+0000 7f76c1e8a8c0 -1 < failed to complete operation key=OOUEM16XL80W tag=JPMJ4XYVLHZ3 type=del size=4104814: (22) Invalid argument 2024-09-14T11:15:25.874 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:25.876+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_8FFV9G6EQR8F.2~SZTYW0M5WF2G.0 size=462951 2024-09-14T11:15:25.874 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:25.876+0000 7f76c1e8a8c0 1 > prepared multipart upload key=8FFV9G6EQR8F upload=SZTYW0M5WF2G tag=AG4WT3F0FJ8I type=write size=1511527 2024-09-14T11:15:25.876 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:25.880+0000 7f76c1e8a8c0 -1 < failed to complete operation key=OOUEM16XL80W tag=OCO70UG45N9F type=write size=703762: (22) Invalid argument 2024-09-14T11:15:25.879 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:25.880+0000 7f76c1e8a8c0 1 > prepared operation key=OUMUTEBQ1TD0 tag=0D4EJZ0RMWH7 type=del size=2105153 2024-09-14T11:15:25.882 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:25.884+0000 7f76c1e8a8c0 1 < canceled operation key=SHKU2PRNREKK tag=Q0DRJBK3FK7N type=del size=1354924 2024-09-14T11:15:25.886 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:25.888+0000 7f76c1e8a8c0 1 > prepared operation key=XC8VWSHZOPFP tag=RBRNU14B3VTB type=del size=2540152 2024-09-14T11:15:25.889 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:25.892+0000 7f76c1e8a8c0 1 < completed delete operation key=HS7T50JORDQJ tag=WPAMLAX3YHCC type=del 2024-09-14T11:15:25.894 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:25.896+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_HJ701768A6I7.2~VUZ6NHP5CCT7.0 size=1048576 2024-09-14T11:15:25.897 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:25.900+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_HJ701768A6I7.2~VUZ6NHP5CCT7.1 size=1048576 2024-09-14T11:15:25.899 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:25.900+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_HJ701768A6I7.2~VUZ6NHP5CCT7.2 size=283348 2024-09-14T11:15:25.899 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:25.900+0000 7f76c1e8a8c0 1 > prepared multipart upload key=HJ701768A6I7 upload=VUZ6NHP5CCT7 tag=Y84BSEJEUJZC type=write size=3429076 2024-09-14T11:15:25.902 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:25.904+0000 7f76c1e8a8c0 1 < completed delete operation key=6TIJR323NMOH tag=SXWGBMPJ47BC type=del 2024-09-14T11:15:25.905 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:25.908+0000 7f76c1e8a8c0 1 > prepared operation key=HS7T50JORDQJ tag=NQI9PFPB81B3 type=del size=2138694 2024-09-14T11:15:25.910 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:25.912+0000 7f76c1e8a8c0 1 < suggested remove operation key=R5I9H7WAK7Z7 tag=O4CAV26TROC1 type=del 2024-09-14T11:15:25.920 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:25.920+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_85G6NT78HAWQ.2~GGIQUCHBOGL1.0 size=1048576 2024-09-14T11:15:25.922 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:25.924+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_85G6NT78HAWQ.2~GGIQUCHBOGL1.1 size=995405 2024-09-14T11:15:25.922 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:25.924+0000 7f76c1e8a8c0 1 > prepared multipart upload key=85G6NT78HAWQ upload=GGIQUCHBOGL1 tag=MS287SJZC2U9 type=write size=3092557 2024-09-14T11:15:25.925 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:25.928+0000 7f76c1e8a8c0 1 < completed part key=_multipart_SUNCRV0C1XYL.2~JUQ645IJZ98Y.0 size=763673 2024-09-14T11:15:25.930 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:25.932+0000 7f76c1e8a8c0 1 < completed multipart upload key=SUNCRV0C1XYL upload=JUQ645IJZ98Y tag=1WCMZSS8T9A7 type=write size=1812249 2024-09-14T11:15:25.932 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:25.936+0000 7f76c1e8a8c0 1 > prepared operation key=HJ701768A6I7 tag=82B5C9OHSTAA type=del size=3350536 2024-09-14T11:15:25.935 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:25.936+0000 7f76c1e8a8c0 1 < completed delete operation key=MEVTZ7OAD4CA tag=TZE3NCEF513I type=del 2024-09-14T11:15:25.938 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:25.940+0000 7f76c1e8a8c0 1 > prepared operation key=BOCIF4TL7X7J tag=YUTS4SL0WQUL type=del size=512269 2024-09-14T11:15:25.940 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:25.944+0000 7f76c1e8a8c0 1 < completed part key=_multipart_H9CQV6L29SL5.2~3UL08G5CRUIC.0 size=1048576 2024-09-14T11:15:25.942 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:25.944+0000 7f76c1e8a8c0 1 < completed part key=_multipart_H9CQV6L29SL5.2~3UL08G5CRUIC.1 size=11137 2024-09-14T11:15:25.946 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:25.948+0000 7f76c1e8a8c0 1 < completed multipart upload key=H9CQV6L29SL5 upload=3UL08G5CRUIC tag=S3AC24ZGQA9Q type=write size=2108289 2024-09-14T11:15:25.951 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:25.952+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_1K8ESNXU6WDF.2~VDLWTGSKTHUV.0 size=361290 2024-09-14T11:15:25.951 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:25.952+0000 7f76c1e8a8c0 1 > prepared multipart upload key=1K8ESNXU6WDF upload=VDLWTGSKTHUV tag=FATGTSFSMA0L type=write size=1409866 2024-09-14T11:15:25.953 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:25.956+0000 7f76c1e8a8c0 1 < completed delete operation key=K9W031V6BFJP tag=L5Z3H0PQB3XX type=del 2024-09-14T11:15:25.956 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:25.960+0000 7f76c1e8a8c0 1 > prepared operation key=MEVTZ7OAD4CA tag=KE3ERY87U07I type=del size=1905843 2024-09-14T11:15:25.958 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:25.960+0000 7f76c1e8a8c0 1 < completed part key=_multipart_8FFV9G6EQR8F.2~AHE7E1WFG1OE.0 size=1048576 2024-09-14T11:15:25.961 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:25.964+0000 7f76c1e8a8c0 1 < completed part key=_multipart_8FFV9G6EQR8F.2~AHE7E1WFG1OE.1 size=557019 2024-09-14T11:15:25.965 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:25.968+0000 7f76c1e8a8c0 1 < completed multipart upload key=8FFV9G6EQR8F upload=AHE7E1WFG1OE tag=FIVFS20ICAD9 type=write size=2654171 2024-09-14T11:15:25.969 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:25.972+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_8PZOVFEYYSOG.2~ATBX40Q5MINE.0 size=1048576 2024-09-14T11:15:25.971 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:25.972+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_8PZOVFEYYSOG.2~ATBX40Q5MINE.1 size=1048576 2024-09-14T11:15:25.973 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:25.976+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_8PZOVFEYYSOG.2~ATBX40Q5MINE.2 size=1010855 2024-09-14T11:15:25.973 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:25.976+0000 7f76c1e8a8c0 1 > prepared multipart upload key=8PZOVFEYYSOG upload=ATBX40Q5MINE tag=49D5MGRYEIY7 type=write size=4156583 2024-09-14T11:15:25.975 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:25.976+0000 7f76c1e8a8c0 1 < completed delete operation key=W0MDRE9YO3UP tag=1GU5QSB2KF6E type=del 2024-09-14T11:15:25.980 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:25.984+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_TZO40K6J9877.2~OH0HGCSBWYYH.0 size=1048576 2024-09-14T11:15:25.982 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:25.984+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_TZO40K6J9877.2~OH0HGCSBWYYH.1 size=1048576 2024-09-14T11:15:25.984 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:25.988+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_TZO40K6J9877.2~OH0HGCSBWYYH.2 size=570475 2024-09-14T11:15:25.984 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:25.988+0000 7f76c1e8a8c0 1 > prepared multipart upload key=TZO40K6J9877 upload=OH0HGCSBWYYH tag=EPRYL6FEX3IS type=write size=3716203 2024-09-14T11:15:25.989 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:25.992+0000 7f76c1e8a8c0 1 < suggested update operation key=Q5IY4J5FOD80 tag=Q13MXF8LIHCI type=write size=768717 2024-09-14T11:15:25.992 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:25.992+0000 7f76c1e8a8c0 1 > prepared operation key=H9CQV6L29SL5 tag=D72PHJSESTJB type=del size=311870 2024-09-14T11:15:25.997 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:26.000+0000 7f76c1e8a8c0 1 < suggested remove operation key=XC8VWSHZOPFP tag=8XNAZ6COP542 type=del 2024-09-14T11:15:26.002 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:26.004+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_TUFOZKTV9XIH.2~VT0WZGPM0P0N.0 size=1048576 2024-09-14T11:15:26.004 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:26.008+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_TUFOZKTV9XIH.2~VT0WZGPM0P0N.1 size=4967 2024-09-14T11:15:26.005 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:26.008+0000 7f76c1e8a8c0 1 > prepared multipart upload key=TUFOZKTV9XIH upload=VT0WZGPM0P0N tag=115WSQJLIAXK type=write size=2102119 2024-09-14T11:15:26.007 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:26.008+0000 7f76c1e8a8c0 1 < completed part key=_multipart_GZM0AQVHNCMM.2~17Z4VWHWEV3J.0 size=1048576 2024-09-14T11:15:26.010 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:26.012+0000 7f76c1e8a8c0 1 < completed part key=_multipart_GZM0AQVHNCMM.2~17Z4VWHWEV3J.1 size=396714 2024-09-14T11:15:26.014 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:26.016+0000 7f76c1e8a8c0 1 < completed multipart upload key=GZM0AQVHNCMM upload=17Z4VWHWEV3J tag=PJN3CW41IILH type=write size=2493866 2024-09-14T11:15:26.019 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:26.020+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_KS37ZO6MKAH9.2~W6W66Z0H3Y8I.0 size=732768 2024-09-14T11:15:26.019 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:26.020+0000 7f76c1e8a8c0 1 > prepared multipart upload key=KS37ZO6MKAH9 upload=W6W66Z0H3Y8I tag=UVCP0D0O3OND type=write size=1781344 2024-09-14T11:15:26.020 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:26.020+0000 7f76c1e8a8c0 1 < canceled part key=_multipart_OOUEM16XL80W.2~HERWKYMTEA2G.0 size=1048576 2024-09-14T11:15:26.022 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:26.024+0000 7f76c1e8a8c0 1 < completed part key=_multipart_OOUEM16XL80W.2~HERWKYMTEA2G.1 size=1048576 2024-09-14T11:15:26.024 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:26.028+0000 7f76c1e8a8c0 1 < completed part key=_multipart_OOUEM16XL80W.2~HERWKYMTEA2G.2 size=1003259 2024-09-14T11:15:26.029 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:26.032+0000 7f76c1e8a8c0 1 < canceled multipart upload key=OOUEM16XL80W upload=HERWKYMTEA2G tag=BQ0P8YRPIYBW type=write size=4148987 2024-09-14T11:15:26.032 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:26.032+0000 7f76c1e8a8c0 1 > prepared operation key=SHKU2PRNREKK tag=2TLOJXV376YJ type=del size=2183870 2024-09-14T11:15:26.035 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:26.036+0000 7f76c1e8a8c0 1 < completed part key=_multipart_8FFV9G6EQR8F.2~SZTYW0M5WF2G.0 size=462951 2024-09-14T11:15:26.039 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:26.040+0000 7f76c1e8a8c0 1 < completed multipart upload key=8FFV9G6EQR8F upload=SZTYW0M5WF2G tag=AG4WT3F0FJ8I type=write size=1511527 2024-09-14T11:15:26.041 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:26.044+0000 7f76c1e8a8c0 1 > prepared operation key=1W5733SDHGDN tag=V86MB7BAXAM0 type=del size=1112389 2024-09-14T11:15:26.044 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:26.048+0000 7f76c1e8a8c0 1 < completed delete operation key=OUMUTEBQ1TD0 tag=0D4EJZ0RMWH7 type=del 2024-09-14T11:15:26.049 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:26.052+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_F3KFS0P1WM7W.2~00KX6K6K38RE.0 size=701718 2024-09-14T11:15:26.049 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:26.052+0000 7f76c1e8a8c0 1 > prepared multipart upload key=F3KFS0P1WM7W upload=00KX6K6K38RE tag=KJ9QW4TBGX7F type=write size=1750294 2024-09-14T11:15:26.052 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:26.056+0000 7f76c1e8a8c0 -1 < failed to complete operation key=XC8VWSHZOPFP tag=RBRNU14B3VTB type=del size=2540152: (22) Invalid argument 2024-09-14T11:15:26.055 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:26.056+0000 7f76c1e8a8c0 1 > prepared operation key=MEVTZ7OAD4CA tag=86ZF3V1YHMFX type=del size=441171 2024-09-14T11:15:26.059 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:26.060+0000 7f76c1e8a8c0 1 < completed part key=_multipart_HJ701768A6I7.2~VUZ6NHP5CCT7.0 size=1048576 2024-09-14T11:15:26.061 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:26.064+0000 7f76c1e8a8c0 1 < completed part key=_multipart_HJ701768A6I7.2~VUZ6NHP5CCT7.1 size=1048576 2024-09-14T11:15:26.064 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:26.068+0000 7f76c1e8a8c0 1 < completed part key=_multipart_HJ701768A6I7.2~VUZ6NHP5CCT7.2 size=283348 2024-09-14T11:15:26.069 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:26.072+0000 7f76c1e8a8c0 1 < completed multipart upload key=HJ701768A6I7 upload=VUZ6NHP5CCT7 tag=Y84BSEJEUJZC type=write size=3429076 2024-09-14T11:15:26.072 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:26.076+0000 7f76c1e8a8c0 1 > prepared operation key=K9W031V6BFJP tag=AS0VO1EH9UDM type=del size=2842804 2024-09-14T11:15:26.079 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:26.080+0000 7f76c1e8a8c0 1 < suggested update operation key=HS7T50JORDQJ tag=NQI9PFPB81B3 type=del size=2138694 2024-09-14T11:15:26.085 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:26.088+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_W0MDRE9YO3UP.2~KDRO2O46DQDG.0 size=243483 2024-09-14T11:15:26.085 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:26.088+0000 7f76c1e8a8c0 1 > prepared multipart upload key=W0MDRE9YO3UP upload=KDRO2O46DQDG tag=U656DCSTBW37 type=write size=1292059 2024-09-14T11:15:26.089 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:26.092+0000 7f76c1e8a8c0 1 < completed part key=_multipart_85G6NT78HAWQ.2~GGIQUCHBOGL1.0 size=1048576 2024-09-14T11:15:26.091 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:26.092+0000 7f76c1e8a8c0 1 < completed part key=_multipart_85G6NT78HAWQ.2~GGIQUCHBOGL1.1 size=995405 2024-09-14T11:15:26.096 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:26.100+0000 7f76c1e8a8c0 1 < completed multipart upload key=85G6NT78HAWQ upload=GGIQUCHBOGL1 tag=MS287SJZC2U9 type=write size=3092557 2024-09-14T11:15:26.099 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:26.100+0000 7f76c1e8a8c0 1 > prepared operation key=K2EEZLRK7MVO tag=QFPNVHJPD3DM type=write size=344470 2024-09-14T11:15:26.102 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:26.104+0000 7f76c1e8a8c0 1 < completed delete operation key=HJ701768A6I7 tag=82B5C9OHSTAA type=del 2024-09-14T11:15:26.108 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:26.112+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_8PZOVFEYYSOG.2~1O0XS2WV57F9.0 size=636880 2024-09-14T11:15:26.108 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:26.112+0000 7f76c1e8a8c0 1 > prepared multipart upload key=8PZOVFEYYSOG upload=1O0XS2WV57F9 tag=WWWSHHVNDUSY type=write size=1685456 2024-09-14T11:15:26.111 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:26.112+0000 7f76c1e8a8c0 1 < completed delete operation key=BOCIF4TL7X7J tag=YUTS4SL0WQUL type=del 2024-09-14T11:15:26.117 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:26.120+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_GZM0AQVHNCMM.2~OM3Q99B33LIK.0 size=1048576 2024-09-14T11:15:26.120 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:26.124+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_GZM0AQVHNCMM.2~OM3Q99B33LIK.1 size=873732 2024-09-14T11:15:26.120 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:26.124+0000 7f76c1e8a8c0 1 > prepared multipart upload key=GZM0AQVHNCMM upload=OM3Q99B33LIK tag=3PPRE5VU41IS type=write size=2970884 2024-09-14T11:15:26.123 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:26.124+0000 7f76c1e8a8c0 1 < completed part key=_multipart_1K8ESNXU6WDF.2~VDLWTGSKTHUV.0 size=361290 2024-09-14T11:15:26.128 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:26.132+0000 7f76c1e8a8c0 1 < completed multipart upload key=1K8ESNXU6WDF upload=VDLWTGSKTHUV tag=FATGTSFSMA0L type=write size=1409866 2024-09-14T11:15:26.135 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:26.136+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_85G6NT78HAWQ.2~3F7ILG23OGG1.0 size=159386 2024-09-14T11:15:26.135 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:26.136+0000 7f76c1e8a8c0 1 > prepared multipart upload key=85G6NT78HAWQ upload=3F7ILG23OGG1 tag=LKB9EL53G51R type=write size=1207962 2024-09-14T11:15:26.137 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:26.140+0000 7f76c1e8a8c0 1 < completed delete operation key=MEVTZ7OAD4CA tag=KE3ERY87U07I type=del 2024-09-14T11:15:26.143 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:26.144+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_K9W031V6BFJP.2~9HABI8SKZKT6.0 size=1048576 2024-09-14T11:15:26.146 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:26.148+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_K9W031V6BFJP.2~9HABI8SKZKT6.1 size=1048576 2024-09-14T11:15:26.148 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:26.152+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_K9W031V6BFJP.2~9HABI8SKZKT6.2 size=493445 2024-09-14T11:15:26.149 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:26.152+0000 7f76c1e8a8c0 1 > prepared multipart upload key=K9W031V6BFJP upload=9HABI8SKZKT6 tag=QJQHD2QT3POE type=write size=3639173 2024-09-14T11:15:26.149 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:26.152+0000 7f76c1e8a8c0 1 < canceled part key=_multipart_8PZOVFEYYSOG.2~ATBX40Q5MINE.0 size=1048576 2024-09-14T11:15:26.152 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:26.152+0000 7f76c1e8a8c0 1 < completed part key=_multipart_8PZOVFEYYSOG.2~ATBX40Q5MINE.1 size=1048576 2024-09-14T11:15:26.154 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:26.156+0000 7f76c1e8a8c0 1 < completed part key=_multipart_8PZOVFEYYSOG.2~ATBX40Q5MINE.2 size=1010855 2024-09-14T11:15:26.159 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:26.160+0000 7f76c1e8a8c0 1 < canceled multipart upload key=8PZOVFEYYSOG upload=ATBX40Q5MINE tag=49D5MGRYEIY7 type=write size=4156583 2024-09-14T11:15:26.162 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:26.164+0000 7f76c1e8a8c0 1 > prepared operation key=SUNCRV0C1XYL tag=5GA0SLRPUM2Q type=del size=2716911 2024-09-14T11:15:26.166 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:26.168+0000 7f76c1e8a8c0 1 < completed part key=_multipart_TZO40K6J9877.2~OH0HGCSBWYYH.0 size=1048576 2024-09-14T11:15:26.169 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:26.172+0000 7f76c1e8a8c0 1 < completed part key=_multipart_TZO40K6J9877.2~OH0HGCSBWYYH.1 size=1048576 2024-09-14T11:15:26.171 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:26.172+0000 7f76c1e8a8c0 1 < completed part key=_multipart_TZO40K6J9877.2~OH0HGCSBWYYH.2 size=570475 2024-09-14T11:15:26.175 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:26.176+0000 7f76c1e8a8c0 1 < completed multipart upload key=TZO40K6J9877 upload=OH0HGCSBWYYH tag=EPRYL6FEX3IS type=write size=3716203 2024-09-14T11:15:26.179 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:26.180+0000 7f76c1e8a8c0 1 > prepared operation key=GZM0AQVHNCMM tag=QDXE3RPC4J0O type=del size=992004 2024-09-14T11:15:26.188 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:26.192+0000 7f76c1e8a8c0 1 < suggested remove operation key=H9CQV6L29SL5 tag=D72PHJSESTJB type=del 2024-09-14T11:15:26.194 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:26.196+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_H9CQV6L29SL5.2~Z4Z4N1G9IITE.0 size=797006 2024-09-14T11:15:26.194 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:26.196+0000 7f76c1e8a8c0 1 > prepared multipart upload key=H9CQV6L29SL5 upload=Z4Z4N1G9IITE tag=LHD8LFCNMAGW type=write size=1845582 2024-09-14T11:15:26.197 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:26.200+0000 7f76c1e8a8c0 1 < completed part key=_multipart_TUFOZKTV9XIH.2~VT0WZGPM0P0N.0 size=1048576 2024-09-14T11:15:26.200 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:26.200+0000 7f76c1e8a8c0 1 < completed part key=_multipart_TUFOZKTV9XIH.2~VT0WZGPM0P0N.1 size=4967 2024-09-14T11:15:26.204 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:26.208+0000 7f76c1e8a8c0 1 < completed multipart upload key=TUFOZKTV9XIH upload=VT0WZGPM0P0N tag=115WSQJLIAXK type=write size=2102119 2024-09-14T11:15:26.209 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:26.212+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_BOCIF4TL7X7J.2~DKAAD5NO22EQ.0 size=1048576 2024-09-14T11:15:26.212 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:26.212+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_BOCIF4TL7X7J.2~DKAAD5NO22EQ.1 size=247122 2024-09-14T11:15:26.212 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:26.212+0000 7f76c1e8a8c0 1 > prepared multipart upload key=BOCIF4TL7X7J upload=DKAAD5NO22EQ tag=UFH0T36KIX0C type=write size=2344274 2024-09-14T11:15:26.214 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:26.216+0000 7f76c1e8a8c0 1 < completed part key=_multipart_KS37ZO6MKAH9.2~W6W66Z0H3Y8I.0 size=732768 2024-09-14T11:15:26.219 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:26.220+0000 7f76c1e8a8c0 1 < completed multipart upload key=KS37ZO6MKAH9 upload=W6W66Z0H3Y8I tag=UVCP0D0O3OND type=write size=1781344 2024-09-14T11:15:26.223 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:26.224+0000 7f76c1e8a8c0 1 > prepared operation key=HS7T50JORDQJ tag=VKD6LPHG1LN0 type=del size=826026 2024-09-14T11:15:26.226 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:26.228+0000 7f76c1e8a8c0 1 < completed delete operation key=SHKU2PRNREKK tag=2TLOJXV376YJ type=del 2024-09-14T11:15:26.229 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:26.232+0000 7f76c1e8a8c0 1 > prepared operation key=OUMUTEBQ1TD0 tag=3U6WTNCDTF86 type=write size=559479 2024-09-14T11:15:26.232 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:26.232+0000 7f76c1e8a8c0 1 < completed delete operation key=1W5733SDHGDN tag=V86MB7BAXAM0 type=del 2024-09-14T11:15:26.235 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:26.236+0000 7f76c1e8a8c0 1 > prepared operation key=F3KFS0P1WM7W tag=GBK79L7WO31L type=del size=2698790 2024-09-14T11:15:26.238 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:26.240+0000 7f76c1e8a8c0 1 < completed part key=_multipart_F3KFS0P1WM7W.2~00KX6K6K38RE.0 size=701718 2024-09-14T11:15:26.243 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:26.244+0000 7f76c1e8a8c0 1 < completed multipart upload key=F3KFS0P1WM7W upload=00KX6K6K38RE tag=KJ9QW4TBGX7F type=write size=1750294 2024-09-14T11:15:26.246 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:26.248+0000 7f76c1e8a8c0 1 > prepared operation key=SUNCRV0C1XYL tag=OSESYF1SLRGX type=write size=878503 2024-09-14T11:15:26.249 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:26.252+0000 7f76c1e8a8c0 1 < completed delete operation key=MEVTZ7OAD4CA tag=86ZF3V1YHMFX type=del 2024-09-14T11:15:26.254 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:26.256+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_Q5IY4J5FOD80.2~U0TLBX82DUIW.0 size=1048576 2024-09-14T11:15:26.256 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:26.260+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_Q5IY4J5FOD80.2~U0TLBX82DUIW.1 size=940901 2024-09-14T11:15:26.257 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:26.260+0000 7f76c1e8a8c0 1 > prepared multipart upload key=Q5IY4J5FOD80 upload=U0TLBX82DUIW tag=PV1COM6FC50F type=write size=3038053 2024-09-14T11:15:26.260 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:26.260+0000 7f76c1e8a8c0 1 < canceled operation key=K9W031V6BFJP tag=AS0VO1EH9UDM type=del size=2842804 2024-09-14T11:15:26.265 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:26.268+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_S43U13LYETS4.2~U8C8KLN2EYLX.0 size=1048576 2024-09-14T11:15:26.268 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:26.268+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_S43U13LYETS4.2~U8C8KLN2EYLX.1 size=336555 2024-09-14T11:15:26.268 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:26.268+0000 7f76c1e8a8c0 1 > prepared multipart upload key=S43U13LYETS4 upload=U8C8KLN2EYLX tag=3LWA7XNUNBOI type=write size=2433707 2024-09-14T11:15:26.268 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:26.272+0000 7f76c1e8a8c0 1 < canceled part key=_multipart_W0MDRE9YO3UP.2~KDRO2O46DQDG.0 size=243483 2024-09-14T11:15:26.274 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:26.276+0000 7f76c1e8a8c0 1 < canceled multipart upload key=W0MDRE9YO3UP upload=KDRO2O46DQDG tag=U656DCSTBW37 type=write size=1292059 2024-09-14T11:15:26.279 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:26.280+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_LZ0YNFOVFYCL.2~TVUH87YJN8NF.0 size=1048576 2024-09-14T11:15:26.281 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:26.284+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_LZ0YNFOVFYCL.2~TVUH87YJN8NF.1 size=156452 2024-09-14T11:15:26.282 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:26.284+0000 7f76c1e8a8c0 1 > prepared multipart upload key=LZ0YNFOVFYCL upload=TVUH87YJN8NF tag=4DEOG9I1J4NQ type=write size=2253604 2024-09-14T11:15:26.284 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:26.288+0000 7f76c1e8a8c0 1 < completed write operation key=K2EEZLRK7MVO tag=QFPNVHJPD3DM type=write size=344470 2024-09-14T11:15:26.287 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:26.288+0000 7f76c1e8a8c0 1 > prepared operation key=R5I9H7WAK7Z7 tag=VLCON75RXI7E type=del size=499589 2024-09-14T11:15:26.290 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:26.292+0000 7f76c1e8a8c0 1 < completed part key=_multipart_8PZOVFEYYSOG.2~1O0XS2WV57F9.0 size=636880 2024-09-14T11:15:26.295 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:26.296+0000 7f76c1e8a8c0 1 < completed multipart upload key=8PZOVFEYYSOG upload=1O0XS2WV57F9 tag=WWWSHHVNDUSY type=write size=1685456 2024-09-14T11:15:26.301 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:26.304+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_BOCIF4TL7X7J.2~6030AN0075R7.0 size=1048576 2024-09-14T11:15:26.303 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:26.304+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_BOCIF4TL7X7J.2~6030AN0075R7.1 size=1048576 2024-09-14T11:15:26.306 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:26.308+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_BOCIF4TL7X7J.2~6030AN0075R7.2 size=160160 2024-09-14T11:15:26.306 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:26.308+0000 7f76c1e8a8c0 1 > prepared multipart upload key=BOCIF4TL7X7J upload=6030AN0075R7 tag=X9IAII3LQVMD type=write size=3305888 2024-09-14T11:15:26.308 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:26.312+0000 7f76c1e8a8c0 1 < completed part key=_multipart_GZM0AQVHNCMM.2~OM3Q99B33LIK.0 size=1048576 2024-09-14T11:15:26.311 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:26.312+0000 7f76c1e8a8c0 1 < completed part key=_multipart_GZM0AQVHNCMM.2~OM3Q99B33LIK.1 size=873732 2024-09-14T11:15:26.316 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:26.320+0000 7f76c1e8a8c0 1 < completed multipart upload key=GZM0AQVHNCMM upload=OM3Q99B33LIK tag=3PPRE5VU41IS type=write size=2970884 2024-09-14T11:15:26.319 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:26.320+0000 7f76c1e8a8c0 1 > prepared operation key=6TIJR323NMOH tag=HXF1CC91OAD0 type=write size=458360 2024-09-14T11:15:26.323 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:26.324+0000 7f76c1e8a8c0 1 < completed part key=_multipart_85G6NT78HAWQ.2~3F7ILG23OGG1.0 size=159386 2024-09-14T11:15:26.328 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:26.328+0000 7f76c1e8a8c0 1 < completed multipart upload key=85G6NT78HAWQ upload=3F7ILG23OGG1 tag=LKB9EL53G51R type=write size=1207962 2024-09-14T11:15:26.331 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:26.332+0000 7f76c1e8a8c0 1 > prepared operation key=F3KFS0P1WM7W tag=WQRPWYGSW4T2 type=del size=3332639 2024-09-14T11:15:26.334 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:26.336+0000 7f76c1e8a8c0 1 < completed part key=_multipart_K9W031V6BFJP.2~9HABI8SKZKT6.0 size=1048576 2024-09-14T11:15:26.336 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:26.340+0000 7f76c1e8a8c0 1 < completed part key=_multipart_K9W031V6BFJP.2~9HABI8SKZKT6.1 size=1048576 2024-09-14T11:15:26.338 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:26.340+0000 7f76c1e8a8c0 1 < completed part key=_multipart_K9W031V6BFJP.2~9HABI8SKZKT6.2 size=493445 2024-09-14T11:15:26.343 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:26.344+0000 7f76c1e8a8c0 1 < completed multipart upload key=K9W031V6BFJP upload=9HABI8SKZKT6 tag=QJQHD2QT3POE type=write size=3639173 2024-09-14T11:15:26.346 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:26.348+0000 7f76c1e8a8c0 1 > prepared operation key=8FFV9G6EQR8F tag=6H7TODKDF6CA type=del size=3943872 2024-09-14T11:15:26.350 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:26.352+0000 7f76c1e8a8c0 1 < completed delete operation key=SUNCRV0C1XYL tag=5GA0SLRPUM2Q type=del 2024-09-14T11:15:26.355 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:26.356+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_S43U13LYETS4.2~WP6T51XF350H.0 size=839715 2024-09-14T11:15:26.355 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:26.356+0000 7f76c1e8a8c0 1 > prepared multipart upload key=S43U13LYETS4 upload=WP6T51XF350H tag=K072YZNB2KUP type=write size=1888291 2024-09-14T11:15:26.358 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:26.360+0000 7f76c1e8a8c0 1 < completed delete operation key=GZM0AQVHNCMM tag=QDXE3RPC4J0O type=del 2024-09-14T11:15:26.361 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:26.364+0000 7f76c1e8a8c0 1 > prepared operation key=BOCIF4TL7X7J tag=LOX8MT9V3TYK type=del size=3398265 2024-09-14T11:15:26.364 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:26.368+0000 7f76c1e8a8c0 1 < completed part key=_multipart_H9CQV6L29SL5.2~Z4Z4N1G9IITE.0 size=797006 2024-09-14T11:15:26.369 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:26.372+0000 7f76c1e8a8c0 1 < completed multipart upload key=H9CQV6L29SL5 upload=Z4Z4N1G9IITE tag=LHD8LFCNMAGW type=write size=1845582 2024-09-14T11:15:26.372 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:26.376+0000 7f76c1e8a8c0 1 > prepared operation key=K2EEZLRK7MVO tag=AXGZBLNWLY7O type=del size=1025420 2024-09-14T11:15:26.375 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:26.376+0000 7f76c1e8a8c0 1 < completed part key=_multipart_BOCIF4TL7X7J.2~DKAAD5NO22EQ.0 size=1048576 2024-09-14T11:15:26.377 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:26.380+0000 7f76c1e8a8c0 1 < completed part key=_multipart_BOCIF4TL7X7J.2~DKAAD5NO22EQ.1 size=247122 2024-09-14T11:15:26.383 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:26.384+0000 7f76c1e8a8c0 1 < completed multipart upload key=BOCIF4TL7X7J upload=DKAAD5NO22EQ tag=UFH0T36KIX0C type=write size=2344274 2024-09-14T11:15:26.386 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:26.388+0000 7f76c1e8a8c0 1 > prepared operation key=HS7T50JORDQJ tag=00I7PUYX0TVL type=del size=2263023 2024-09-14T11:15:26.389 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:26.392+0000 7f76c1e8a8c0 1 < completed delete operation key=HS7T50JORDQJ tag=VKD6LPHG1LN0 type=del 2024-09-14T11:15:26.392 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:26.396+0000 7f76c1e8a8c0 1 > prepared operation key=6TIJR323NMOH tag=QDSKQJL5DKGG type=del size=1837282 2024-09-14T11:15:26.395 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:26.396+0000 7f76c1e8a8c0 1 < completed write operation key=OUMUTEBQ1TD0 tag=3U6WTNCDTF86 type=write size=559479 2024-09-14T11:15:26.398 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:26.400+0000 7f76c1e8a8c0 1 > prepared operation key=KS37ZO6MKAH9 tag=3HEN18EJUGSI type=del size=1257583 2024-09-14T11:15:26.402 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:26.404+0000 7f76c1e8a8c0 1 < completed delete operation key=F3KFS0P1WM7W tag=GBK79L7WO31L type=del 2024-09-14T11:15:26.405 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:26.408+0000 7f76c1e8a8c0 1 > prepared operation key=XC8VWSHZOPFP tag=HUZCHUY7LB5A type=del size=1688798 2024-09-14T11:15:26.408 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:26.412+0000 7f76c1e8a8c0 1 < completed write operation key=SUNCRV0C1XYL tag=OSESYF1SLRGX type=write size=878503 2024-09-14T11:15:26.411 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:26.412+0000 7f76c1e8a8c0 1 > prepared operation key=R5I9H7WAK7Z7 tag=S2S51AYIBTWL type=del size=3559846 2024-09-14T11:15:26.414 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:26.416+0000 7f76c1e8a8c0 1 < completed part key=_multipart_Q5IY4J5FOD80.2~U0TLBX82DUIW.0 size=1048576 2024-09-14T11:15:26.417 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:26.420+0000 7f76c1e8a8c0 1 < completed part key=_multipart_Q5IY4J5FOD80.2~U0TLBX82DUIW.1 size=940901 2024-09-14T11:15:26.422 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:26.424+0000 7f76c1e8a8c0 1 < completed multipart upload key=Q5IY4J5FOD80 upload=U0TLBX82DUIW tag=PV1COM6FC50F type=write size=3038053 2024-09-14T11:15:26.427 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:26.428+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_HS7T50JORDQJ.2~9W7DDT4OMCM6.0 size=982002 2024-09-14T11:15:26.427 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:26.428+0000 7f76c1e8a8c0 1 > prepared multipart upload key=HS7T50JORDQJ upload=9W7DDT4OMCM6 tag=AHI98NO9K9H7 type=write size=2030578 2024-09-14T11:15:26.431 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:26.432+0000 7f76c1e8a8c0 1 < completed part key=_multipart_S43U13LYETS4.2~U8C8KLN2EYLX.0 size=1048576 2024-09-14T11:15:26.431 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:26.432+0000 7f76c1e8a8c0 1 < canceled part key=_multipart_S43U13LYETS4.2~U8C8KLN2EYLX.1 size=336555 2024-09-14T11:15:26.435 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:26.436+0000 7f76c1e8a8c0 1 < canceled multipart upload key=S43U13LYETS4 upload=U8C8KLN2EYLX tag=3LWA7XNUNBOI type=write size=2433707 2024-09-14T11:15:26.441 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:26.444+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_SUNCRV0C1XYL.2~G2FO8MPU1ZY5.0 size=1048576 2024-09-14T11:15:26.444 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:26.444+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_SUNCRV0C1XYL.2~G2FO8MPU1ZY5.1 size=1048576 2024-09-14T11:15:26.446 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:26.448+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_SUNCRV0C1XYL.2~G2FO8MPU1ZY5.2 size=491365 2024-09-14T11:15:26.446 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:26.448+0000 7f76c1e8a8c0 1 > prepared multipart upload key=SUNCRV0C1XYL upload=G2FO8MPU1ZY5 tag=VFTYQUH6DG17 type=write size=3637093 2024-09-14T11:15:26.450 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:26.452+0000 7f76c1e8a8c0 1 < completed part key=_multipart_LZ0YNFOVFYCL.2~TVUH87YJN8NF.0 size=1048576 2024-09-14T11:15:26.452 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:26.456+0000 7f76c1e8a8c0 1 < completed part key=_multipart_LZ0YNFOVFYCL.2~TVUH87YJN8NF.1 size=156452 2024-09-14T11:15:26.457 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:26.460+0000 7f76c1e8a8c0 1 < completed multipart upload key=LZ0YNFOVFYCL upload=TVUH87YJN8NF tag=4DEOG9I1J4NQ type=write size=2253604 2024-09-14T11:15:26.466 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:26.468+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_XC8VWSHZOPFP.2~MZIKYOJ447HW.0 size=1048576 2024-09-14T11:15:26.469 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:26.472+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_XC8VWSHZOPFP.2~MZIKYOJ447HW.1 size=1048576 2024-09-14T11:15:26.471 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:26.472+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_XC8VWSHZOPFP.2~MZIKYOJ447HW.2 size=557187 2024-09-14T11:15:26.472 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:26.472+0000 7f76c1e8a8c0 1 > prepared multipart upload key=XC8VWSHZOPFP upload=MZIKYOJ447HW tag=IKMGMW36YWCA type=write size=3702915 2024-09-14T11:15:26.475 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:26.476+0000 7f76c1e8a8c0 1 < completed delete operation key=R5I9H7WAK7Z7 tag=VLCON75RXI7E type=del 2024-09-14T11:15:26.480 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:26.480+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_W0MDRE9YO3UP.2~AN7UNTGHHBDL.0 size=1048576 2024-09-14T11:15:26.482 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:26.484+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_W0MDRE9YO3UP.2~AN7UNTGHHBDL.1 size=25032 2024-09-14T11:15:26.482 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:26.484+0000 7f76c1e8a8c0 1 > prepared multipart upload key=W0MDRE9YO3UP upload=AN7UNTGHHBDL tag=3K380LF4T9G2 type=write size=2122184 2024-09-14T11:15:26.485 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:26.488+0000 7f76c1e8a8c0 1 < completed part key=_multipart_BOCIF4TL7X7J.2~6030AN0075R7.0 size=1048576 2024-09-14T11:15:26.487 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:26.488+0000 7f76c1e8a8c0 1 < completed part key=_multipart_BOCIF4TL7X7J.2~6030AN0075R7.1 size=1048576 2024-09-14T11:15:26.487 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:26.488+0000 7f76c1e8a8c0 1 < canceled part key=_multipart_BOCIF4TL7X7J.2~6030AN0075R7.2 size=160160 2024-09-14T11:15:26.492 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:26.496+0000 7f76c1e8a8c0 1 < canceled multipart upload key=BOCIF4TL7X7J upload=6030AN0075R7 tag=X9IAII3LQVMD type=write size=3305888 2024-09-14T11:15:26.496 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:26.496+0000 7f76c1e8a8c0 1 > prepared operation key=15FU4CEGC22Q tag=FE3323N4Y1EX type=write size=512925 2024-09-14T11:15:26.499 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:26.500+0000 7f76c1e8a8c0 1 < completed write operation key=6TIJR323NMOH tag=HXF1CC91OAD0 type=write size=458360 2024-09-14T11:15:26.502 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:26.504+0000 7f76c1e8a8c0 1 > prepared operation key=MEVTZ7OAD4CA tag=P6EITZP4TZ15 type=del size=688624 2024-09-14T11:15:26.504 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:26.508+0000 7f76c1e8a8c0 1 < completed delete operation key=F3KFS0P1WM7W tag=WQRPWYGSW4T2 type=del 2024-09-14T11:15:26.508 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:26.508+0000 7f76c1e8a8c0 1 > prepared operation key=R5I9H7WAK7Z7 tag=CLVBNKY9UXE4 type=del size=132672 2024-09-14T11:15:26.511 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:26.512+0000 7f76c1e8a8c0 1 < completed delete operation key=8FFV9G6EQR8F tag=6H7TODKDF6CA type=del 2024-09-14T11:15:26.514 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:26.516+0000 7f76c1e8a8c0 1 > prepared operation key=GZM0AQVHNCMM tag=PSKQ32SILZWO type=write size=418763 2024-09-14T11:15:26.517 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:26.520+0000 7f76c1e8a8c0 1 < completed part key=_multipart_S43U13LYETS4.2~WP6T51XF350H.0 size=839715 2024-09-14T11:15:26.522 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:26.524+0000 7f76c1e8a8c0 1 < completed multipart upload key=S43U13LYETS4 upload=WP6T51XF350H tag=K072YZNB2KUP type=write size=1888291 2024-09-14T11:15:26.528 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:26.528+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_MEVTZ7OAD4CA.2~ZFKVCUJZY3XO.0 size=626913 2024-09-14T11:15:26.528 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:26.528+0000 7f76c1e8a8c0 1 > prepared multipart upload key=MEVTZ7OAD4CA upload=ZFKVCUJZY3XO tag=BO7VHPY9KODP type=write size=1675489 2024-09-14T11:15:26.531 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:26.532+0000 7f76c1e8a8c0 1 < completed delete operation key=BOCIF4TL7X7J tag=LOX8MT9V3TYK type=del 2024-09-14T11:15:26.536 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:26.540+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_KS37ZO6MKAH9.2~IA3YI3QY43ZN.0 size=145738 2024-09-14T11:15:26.536 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:26.540+0000 7f76c1e8a8c0 1 > prepared multipart upload key=KS37ZO6MKAH9 upload=IA3YI3QY43ZN tag=V4GR8FC32A2T type=write size=1194314 2024-09-14T11:15:26.540 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:26.540+0000 7f76c1e8a8c0 1 < completed delete operation key=K2EEZLRK7MVO tag=AXGZBLNWLY7O type=del 2024-09-14T11:15:26.543 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:26.544+0000 7f76c1e8a8c0 1 > prepared operation key=LZ0YNFOVFYCL tag=GF776QM7J1AD type=del size=2510374 2024-09-14T11:15:26.546 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:26.548+0000 7f76c1e8a8c0 1 < completed delete operation key=HS7T50JORDQJ tag=00I7PUYX0TVL type=del 2024-09-14T11:15:26.549 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:26.552+0000 7f76c1e8a8c0 1 > prepared operation key=8PZOVFEYYSOG tag=5T2X04H9CBPZ type=write size=924279 2024-09-14T11:15:26.552 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:26.556+0000 7f76c1e8a8c0 1 < completed delete operation key=6TIJR323NMOH tag=QDSKQJL5DKGG type=del 2024-09-14T11:15:26.558 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:26.560+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_HS7T50JORDQJ.2~UV00IP2PW2WA.0 size=1048576 2024-09-14T11:15:26.561 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:26.564+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_HS7T50JORDQJ.2~UV00IP2PW2WA.1 size=110142 2024-09-14T11:15:26.561 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:26.564+0000 7f76c1e8a8c0 1 > prepared multipart upload key=HS7T50JORDQJ upload=UV00IP2PW2WA tag=E2N88TNGYEGV type=write size=2207294 2024-09-14T11:15:26.564 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:26.568+0000 7f76c1e8a8c0 1 < completed delete operation key=KS37ZO6MKAH9 tag=3HEN18EJUGSI type=del 2024-09-14T11:15:26.567 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:26.568+0000 7f76c1e8a8c0 1 > prepared operation key=85G6NT78HAWQ tag=PRGEJCCPEU52 type=del size=3428436 2024-09-14T11:15:26.573 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:26.576+0000 7f76c1e8a8c0 1 < suggested remove operation key=XC8VWSHZOPFP tag=HUZCHUY7LB5A type=del 2024-09-14T11:15:26.576 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:26.580+0000 7f76c1e8a8c0 1 > prepared operation key=8FFV9G6EQR8F tag=SYHGPZ5J58QU type=del size=780588 2024-09-14T11:15:26.579 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:26.580+0000 7f76c1e8a8c0 1 < completed delete operation key=R5I9H7WAK7Z7 tag=S2S51AYIBTWL type=del 2024-09-14T11:15:26.582 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:26.584+0000 7f76c1e8a8c0 1 > prepared operation key=S43U13LYETS4 tag=WESA64ZE57PL type=write size=842703 2024-09-14T11:15:26.585 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:26.588+0000 7f76c1e8a8c0 1 < completed part key=_multipart_HS7T50JORDQJ.2~9W7DDT4OMCM6.0 size=982002 2024-09-14T11:15:26.590 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:26.592+0000 7f76c1e8a8c0 1 < completed multipart upload key=HS7T50JORDQJ upload=9W7DDT4OMCM6 tag=AHI98NO9K9H7 type=write size=2030578 2024-09-14T11:15:26.593 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:26.596+0000 7f76c1e8a8c0 1 > prepared operation key=6TIJR323NMOH tag=CR05GW4MWIGS type=del size=3195292 2024-09-14T11:15:26.596 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:26.600+0000 7f76c1e8a8c0 1 < completed part key=_multipart_SUNCRV0C1XYL.2~G2FO8MPU1ZY5.0 size=1048576 2024-09-14T11:15:26.599 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:26.600+0000 7f76c1e8a8c0 1 < completed part key=_multipart_SUNCRV0C1XYL.2~G2FO8MPU1ZY5.1 size=1048576 2024-09-14T11:15:26.601 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:26.604+0000 7f76c1e8a8c0 1 < completed part key=_multipart_SUNCRV0C1XYL.2~G2FO8MPU1ZY5.2 size=491365 2024-09-14T11:15:26.606 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:26.608+0000 7f76c1e8a8c0 1 < completed multipart upload key=SUNCRV0C1XYL upload=G2FO8MPU1ZY5 tag=VFTYQUH6DG17 type=write size=3637093 2024-09-14T11:15:26.609 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:26.612+0000 7f76c1e8a8c0 1 > prepared operation key=15FU4CEGC22Q tag=6K32YV2KYTSE type=del size=4047794 2024-09-14T11:15:26.612 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:26.616+0000 7f76c1e8a8c0 1 < completed part key=_multipart_XC8VWSHZOPFP.2~MZIKYOJ447HW.0 size=1048576 2024-09-14T11:15:26.615 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:26.616+0000 7f76c1e8a8c0 1 < completed part key=_multipart_XC8VWSHZOPFP.2~MZIKYOJ447HW.1 size=1048576 2024-09-14T11:15:26.617 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:26.620+0000 7f76c1e8a8c0 1 < completed part key=_multipart_XC8VWSHZOPFP.2~MZIKYOJ447HW.2 size=557187 2024-09-14T11:15:26.623 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:26.624+0000 7f76c1e8a8c0 1 < completed multipart upload key=XC8VWSHZOPFP upload=MZIKYOJ447HW tag=IKMGMW36YWCA type=write size=3702915 2024-09-14T11:15:26.629 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:26.632+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_R5I9H7WAK7Z7.2~TX1I21ELDVIZ.0 size=1048576 2024-09-14T11:15:26.631 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:26.632+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_R5I9H7WAK7Z7.2~TX1I21ELDVIZ.1 size=1048576 2024-09-14T11:15:26.634 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:26.636+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_R5I9H7WAK7Z7.2~TX1I21ELDVIZ.2 size=71768 2024-09-14T11:15:26.634 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:26.636+0000 7f76c1e8a8c0 1 > prepared multipart upload key=R5I9H7WAK7Z7 upload=TX1I21ELDVIZ tag=08PA5YLFVIRD type=write size=3217496 2024-09-14T11:15:26.637 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:26.640+0000 7f76c1e8a8c0 1 < completed part key=_multipart_W0MDRE9YO3UP.2~AN7UNTGHHBDL.0 size=1048576 2024-09-14T11:15:26.640 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:26.644+0000 7f76c1e8a8c0 1 < completed part key=_multipart_W0MDRE9YO3UP.2~AN7UNTGHHBDL.1 size=25032 2024-09-14T11:15:26.645 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:26.648+0000 7f76c1e8a8c0 1 < completed multipart upload key=W0MDRE9YO3UP upload=AN7UNTGHHBDL tag=3K380LF4T9G2 type=write size=2122184 2024-09-14T11:15:26.649 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:26.652+0000 7f76c1e8a8c0 1 > prepared operation key=LZ0YNFOVFYCL tag=GOB102QOG673 type=del size=1847942 2024-09-14T11:15:26.652 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:26.656+0000 7f76c1e8a8c0 1 < completed write operation key=15FU4CEGC22Q tag=FE3323N4Y1EX type=write size=512925 2024-09-14T11:15:26.655 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:26.656+0000 7f76c1e8a8c0 1 > prepared operation key=TUFOZKTV9XIH tag=64FNZUDOE2KW type=del size=2675860 2024-09-14T11:15:26.659 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:26.660+0000 7f76c1e8a8c0 1 < completed delete operation key=MEVTZ7OAD4CA tag=P6EITZP4TZ15 type=del 2024-09-14T11:15:26.665 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:26.668+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_KS37ZO6MKAH9.2~ZSC5ELJBIW64.0 size=793899 2024-09-14T11:15:26.665 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:26.668+0000 7f76c1e8a8c0 1 > prepared multipart upload key=KS37ZO6MKAH9 upload=ZSC5ELJBIW64 tag=BZZEY70MXEA6 type=write size=1842475 2024-09-14T11:15:26.668 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:26.672+0000 7f76c1e8a8c0 1 < completed delete operation key=R5I9H7WAK7Z7 tag=CLVBNKY9UXE4 type=del 2024-09-14T11:15:26.671 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:26.672+0000 7f76c1e8a8c0 1 > prepared operation key=1K8ESNXU6WDF tag=XR7X110W9Y0J type=del size=428840 2024-09-14T11:15:26.675 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:26.676+0000 7f76c1e8a8c0 1 < canceled operation key=GZM0AQVHNCMM tag=PSKQ32SILZWO type=write size=418763 2024-09-14T11:15:26.678 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:26.680+0000 7f76c1e8a8c0 1 > prepared operation key=CIRQT9IDJ5OJ tag=LCZG0R2LSNN6 type=del size=965528 2024-09-14T11:15:26.681 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:26.684+0000 7f76c1e8a8c0 1 < completed part key=_multipart_MEVTZ7OAD4CA.2~ZFKVCUJZY3XO.0 size=626913 2024-09-14T11:15:26.687 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:26.688+0000 7f76c1e8a8c0 1 < completed multipart upload key=MEVTZ7OAD4CA upload=ZFKVCUJZY3XO tag=BO7VHPY9KODP type=write size=1675489 2024-09-14T11:15:26.690 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:26.692+0000 7f76c1e8a8c0 1 > prepared operation key=85G6NT78HAWQ tag=FWC1OHNH2FX0 type=del size=4103488 2024-09-14T11:15:26.693 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:26.696+0000 7f76c1e8a8c0 1 < completed part key=_multipart_KS37ZO6MKAH9.2~IA3YI3QY43ZN.0 size=145738 2024-09-14T11:15:26.698 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:26.700+0000 7f76c1e8a8c0 1 < completed multipart upload key=KS37ZO6MKAH9 upload=IA3YI3QY43ZN tag=V4GR8FC32A2T type=write size=1194314 2024-09-14T11:15:26.704 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:26.708+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_8FFV9G6EQR8F.2~6V8Q2DJERMMS.0 size=1048576 2024-09-14T11:15:26.707 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:26.708+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_8FFV9G6EQR8F.2~6V8Q2DJERMMS.1 size=949495 2024-09-14T11:15:26.707 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:26.708+0000 7f76c1e8a8c0 1 > prepared multipart upload key=8FFV9G6EQR8F upload=6V8Q2DJERMMS tag=B02E2OO5BAA5 type=write size=3046647 2024-09-14T11:15:26.710 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:26.712+0000 7f76c1e8a8c0 1 < completed delete operation key=LZ0YNFOVFYCL tag=GF776QM7J1AD type=del 2024-09-14T11:15:26.713 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:26.716+0000 7f76c1e8a8c0 1 > prepared operation key=8PZOVFEYYSOG tag=CAI617R7MMI3 type=del size=3265245 2024-09-14T11:15:26.717 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:26.720+0000 7f76c1e8a8c0 1 < completed write operation key=8PZOVFEYYSOG tag=5T2X04H9CBPZ type=write size=924279 2024-09-14T11:15:26.720 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:26.720+0000 7f76c1e8a8c0 1 > prepared operation key=W0MDRE9YO3UP tag=ZSC5VD511WJK type=del size=3885958 2024-09-14T11:15:26.720 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:26.724+0000 7f76c1e8a8c0 1 < canceled part key=_multipart_HS7T50JORDQJ.2~UV00IP2PW2WA.0 size=1048576 2024-09-14T11:15:26.723 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:26.724+0000 7f76c1e8a8c0 1 < completed part key=_multipart_HS7T50JORDQJ.2~UV00IP2PW2WA.1 size=110142 2024-09-14T11:15:26.728 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:26.732+0000 7f76c1e8a8c0 1 < canceled multipart upload key=HS7T50JORDQJ upload=UV00IP2PW2WA tag=E2N88TNGYEGV type=write size=2207294 2024-09-14T11:15:26.731 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:26.732+0000 7f76c1e8a8c0 1 > prepared operation key=KS37ZO6MKAH9 tag=UMVRN2FYRARM type=del size=807704 2024-09-14T11:15:26.737 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:26.740+0000 7f76c1e8a8c0 1 < suggested remove operation key=85G6NT78HAWQ tag=PRGEJCCPEU52 type=del 2024-09-14T11:15:26.741 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:26.744+0000 7f76c1e8a8c0 1 > prepared operation key=KS37ZO6MKAH9 tag=4W108GBMXE2Q type=del size=799724 2024-09-14T11:15:26.744 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:26.744+0000 7f76c1e8a8c0 1 < completed delete operation key=8FFV9G6EQR8F tag=SYHGPZ5J58QU type=del 2024-09-14T11:15:26.747 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:26.748+0000 7f76c1e8a8c0 1 > prepared operation key=1K8ESNXU6WDF tag=V6W3A8OPAV5I type=del size=370808 2024-09-14T11:15:26.750 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:26.752+0000 7f76c1e8a8c0 1 < completed write operation key=S43U13LYETS4 tag=WESA64ZE57PL type=write size=842703 2024-09-14T11:15:26.753 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:26.756+0000 7f76c1e8a8c0 1 > prepared operation key=SHKU2PRNREKK tag=ZK4CFRCYEGXN type=del size=1951599 2024-09-14T11:15:26.757 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:26.760+0000 7f76c1e8a8c0 1 < completed delete operation key=6TIJR323NMOH tag=CR05GW4MWIGS type=del 2024-09-14T11:15:26.764 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:26.768+0000 7f76c1e8a8c0 1 > prepared operation key=GAVZRU8ZLW7S tag=0L39R569ZN78 type=del size=3035111 2024-09-14T11:15:26.771 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:26.772+0000 7f76c1e8a8c0 1 < suggested remove operation key=15FU4CEGC22Q tag=6K32YV2KYTSE type=del 2024-09-14T11:15:26.776 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:26.780+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_1K8ESNXU6WDF.2~PHK6QG2T4OP3.0 size=60991 2024-09-14T11:15:26.776 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:26.780+0000 7f76c1e8a8c0 1 > prepared multipart upload key=1K8ESNXU6WDF upload=PHK6QG2T4OP3 tag=87DANKLU45NK type=write size=1109567 2024-09-14T11:15:26.780 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:26.780+0000 7f76c1e8a8c0 1 < completed part key=_multipart_R5I9H7WAK7Z7.2~TX1I21ELDVIZ.0 size=1048576 2024-09-14T11:15:26.782 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:26.784+0000 7f76c1e8a8c0 1 < completed part key=_multipart_R5I9H7WAK7Z7.2~TX1I21ELDVIZ.1 size=1048576 2024-09-14T11:15:26.785 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:26.788+0000 7f76c1e8a8c0 1 < completed part key=_multipart_R5I9H7WAK7Z7.2~TX1I21ELDVIZ.2 size=71768 2024-09-14T11:15:26.790 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:26.792+0000 7f76c1e8a8c0 1 < completed multipart upload key=R5I9H7WAK7Z7 upload=TX1I21ELDVIZ tag=08PA5YLFVIRD type=write size=3217496 2024-09-14T11:15:26.794 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:26.796+0000 7f76c1e8a8c0 1 > prepared operation key=HJ701768A6I7 tag=BK6Y0QTE6Q02 type=del size=3296043 2024-09-14T11:15:26.797 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:26.800+0000 7f76c1e8a8c0 1 < completed delete operation key=LZ0YNFOVFYCL tag=GOB102QOG673 type=del 2024-09-14T11:15:26.801 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:26.804+0000 7f76c1e8a8c0 1 > prepared operation key=GAVZRU8ZLW7S tag=8BEHE5T5R0XF type=del size=2939589 2024-09-14T11:15:26.807 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:26.808+0000 7f76c1e8a8c0 1 < suggested remove operation key=TUFOZKTV9XIH tag=64FNZUDOE2KW type=del 2024-09-14T11:15:26.811 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:26.812+0000 7f76c1e8a8c0 1 > prepared operation key=6TIJR323NMOH tag=5HUV0W79YGF6 type=del size=3584647 2024-09-14T11:15:26.815 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:26.816+0000 7f76c1e8a8c0 1 < completed part key=_multipart_KS37ZO6MKAH9.2~ZSC5ELJBIW64.0 size=793899 2024-09-14T11:15:26.820 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:26.824+0000 7f76c1e8a8c0 1 < completed multipart upload key=KS37ZO6MKAH9 upload=ZSC5ELJBIW64 tag=BZZEY70MXEA6 type=write size=1842475 2024-09-14T11:15:26.823 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:26.824+0000 7f76c1e8a8c0 1 > prepared operation key=S43U13LYETS4 tag=3EO5CNW2LJ8R type=del size=1870903 2024-09-14T11:15:26.831 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:26.832+0000 7f76c1e8a8c0 1 < suggested remove operation key=1K8ESNXU6WDF tag=XR7X110W9Y0J type=del 2024-09-14T11:15:26.834 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:26.836+0000 7f76c1e8a8c0 1 > prepared operation key=OUMUTEBQ1TD0 tag=Z9D83PMFJ4S5 type=del size=200113 2024-09-14T11:15:26.838 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:26.840+0000 7f76c1e8a8c0 1 < completed delete operation key=CIRQT9IDJ5OJ tag=LCZG0R2LSNN6 type=del 2024-09-14T11:15:26.841 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:26.844+0000 7f76c1e8a8c0 1 > prepared operation key=K2EEZLRK7MVO tag=FLCW4UB00LZV type=write size=352103 2024-09-14T11:15:26.843 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:26.844+0000 7f76c1e8a8c0 -1 < no bi entry to suggest for operation key=85G6NT78HAWQ tag=FWC1OHNH2FX0 type=del size=4103488: (2) No such file or directory 2024-09-14T11:15:26.846 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:26.848+0000 7f76c1e8a8c0 1 > prepared operation key=OOUEM16XL80W tag=9HOKCWXUHZGG type=del size=499997 2024-09-14T11:15:26.850 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:26.852+0000 7f76c1e8a8c0 1 < completed part key=_multipart_8FFV9G6EQR8F.2~6V8Q2DJERMMS.0 size=1048576 2024-09-14T11:15:26.850 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:26.852+0000 7f76c1e8a8c0 1 < canceled part key=_multipart_8FFV9G6EQR8F.2~6V8Q2DJERMMS.1 size=949495 2024-09-14T11:15:26.856 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:26.856+0000 7f76c1e8a8c0 1 < canceled multipart upload key=8FFV9G6EQR8F upload=6V8Q2DJERMMS tag=B02E2OO5BAA5 type=write size=3046647 2024-09-14T11:15:26.859 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:26.860+0000 7f76c1e8a8c0 1 > prepared operation key=MEVTZ7OAD4CA tag=P8QQ2OQ63R9J type=del size=665687 2024-09-14T11:15:26.865 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:26.868+0000 7f76c1e8a8c0 1 < suggested remove operation key=8PZOVFEYYSOG tag=CAI617R7MMI3 type=del 2024-09-14T11:15:26.868 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:26.872+0000 7f76c1e8a8c0 1 > prepared operation key=W0MDRE9YO3UP tag=1W6OK440NW4T type=write size=885796 2024-09-14T11:15:26.871 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:26.872+0000 7f76c1e8a8c0 1 < completed delete operation key=W0MDRE9YO3UP tag=ZSC5VD511WJK type=del 2024-09-14T11:15:26.876 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:26.880+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_F3KFS0P1WM7W.2~FS8ZYJJGWG6P.0 size=1048576 2024-09-14T11:15:26.878 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:26.880+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_F3KFS0P1WM7W.2~FS8ZYJJGWG6P.1 size=7546 2024-09-14T11:15:26.879 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:26.880+0000 7f76c1e8a8c0 1 > prepared multipart upload key=F3KFS0P1WM7W upload=FS8ZYJJGWG6P tag=XA69M421E5QR type=write size=2104698 2024-09-14T11:15:26.885 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:26.888+0000 7f76c1e8a8c0 1 < suggested remove operation key=KS37ZO6MKAH9 tag=UMVRN2FYRARM type=del 2024-09-14T11:15:26.890 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:26.892+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_H9CQV6L29SL5.2~R52AS443V8W3.0 size=1048576 2024-09-14T11:15:26.892 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:26.896+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_H9CQV6L29SL5.2~R52AS443V8W3.1 size=330011 2024-09-14T11:15:26.892 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:26.896+0000 7f76c1e8a8c0 1 > prepared multipart upload key=H9CQV6L29SL5 upload=R52AS443V8W3 tag=238EXLL2RHYJ type=write size=2427163 2024-09-14T11:15:26.895 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:26.896+0000 7f76c1e8a8c0 -1 < failed to complete operation key=KS37ZO6MKAH9 tag=4W108GBMXE2Q type=del size=799724: (22) Invalid argument 2024-09-14T11:15:26.898 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:26.900+0000 7f76c1e8a8c0 1 > prepared operation key=OOUEM16XL80W tag=9PFSY1UB9585 type=del size=1920900 2024-09-14T11:15:26.899 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:26.900+0000 7f76c1e8a8c0 -1 < no bi entry to suggest for operation key=1K8ESNXU6WDF tag=V6W3A8OPAV5I type=del size=370808: (2) No such file or directory 2024-09-14T11:15:26.902 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:26.904+0000 7f76c1e8a8c0 1 > prepared operation key=SHKU2PRNREKK tag=R5AMESDS286U type=write size=176106 2024-09-14T11:15:26.908 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:26.912+0000 7f76c1e8a8c0 1 < suggested remove operation key=SHKU2PRNREKK tag=ZK4CFRCYEGXN type=del 2024-09-14T11:15:26.911 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:26.912+0000 7f76c1e8a8c0 1 > prepared operation key=XC8VWSHZOPFP tag=4ZLRX4VGQ7C5 type=write size=455913 2024-09-14T11:15:26.914 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:26.916+0000 7f76c1e8a8c0 1 < completed delete operation key=GAVZRU8ZLW7S tag=0L39R569ZN78 type=del 2024-09-14T11:15:26.919 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:26.920+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_SUNCRV0C1XYL.2~HQ4SIKIP8AOG.0 size=458706 2024-09-14T11:15:26.919 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:26.920+0000 7f76c1e8a8c0 1 > prepared multipart upload key=SUNCRV0C1XYL upload=HQ4SIKIP8AOG tag=33KVCUP4YY04 type=write size=1507282 2024-09-14T11:15:26.920 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:26.920+0000 7f76c1e8a8c0 1 < canceled part key=_multipart_1K8ESNXU6WDF.2~PHK6QG2T4OP3.0 size=60991 2024-09-14T11:15:26.925 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:26.928+0000 7f76c1e8a8c0 1 < canceled multipart upload key=1K8ESNXU6WDF upload=PHK6QG2T4OP3 tag=87DANKLU45NK type=write size=1109567 2024-09-14T11:15:26.929 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:26.932+0000 7f76c1e8a8c0 1 > prepared operation key=CIRQT9IDJ5OJ tag=1KK2RENNODRN type=del size=2130286 2024-09-14T11:15:26.932 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:26.936+0000 7f76c1e8a8c0 1 < completed delete operation key=HJ701768A6I7 tag=BK6Y0QTE6Q02 type=del 2024-09-14T11:15:26.935 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:26.936+0000 7f76c1e8a8c0 1 > prepared operation key=1W5733SDHGDN tag=BLX85BJMO0M9 type=write size=633837 2024-09-14T11:15:26.938 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:26.940+0000 7f76c1e8a8c0 1 < completed delete operation key=GAVZRU8ZLW7S tag=8BEHE5T5R0XF type=del 2024-09-14T11:15:26.941 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:26.944+0000 7f76c1e8a8c0 1 > prepared operation key=CIRQT9IDJ5OJ tag=MUOZJYHYE69M type=write size=617439 2024-09-14T11:15:26.944 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:26.948+0000 7f76c1e8a8c0 1 < completed delete operation key=6TIJR323NMOH tag=5HUV0W79YGF6 type=del 2024-09-14T11:15:26.947 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:26.948+0000 7f76c1e8a8c0 1 > prepared operation key=85G6NT78HAWQ tag=R45BSC0ZC6SK type=write size=345548 2024-09-14T11:15:26.949 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:26.952+0000 7f76c1e8a8c0 1 < completed delete operation key=S43U13LYETS4 tag=3EO5CNW2LJ8R type=del 2024-09-14T11:15:26.953 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:26.956+0000 7f76c1e8a8c0 1 > prepared operation key=MEVTZ7OAD4CA tag=1J8LVEV4V3E5 type=del size=4003639 2024-09-14T11:15:26.956 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:26.960+0000 7f76c1e8a8c0 1 < completed delete operation key=OUMUTEBQ1TD0 tag=Z9D83PMFJ4S5 type=del 2024-09-14T11:15:26.962 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:26.964+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_GAVZRU8ZLW7S.2~BCJZ5BBNFDQ2.0 size=1048576 2024-09-14T11:15:26.964 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:26.968+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_GAVZRU8ZLW7S.2~BCJZ5BBNFDQ2.1 size=336009 2024-09-14T11:15:26.964 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:26.968+0000 7f76c1e8a8c0 1 > prepared multipart upload key=GAVZRU8ZLW7S upload=BCJZ5BBNFDQ2 tag=30ZKFT6TAMYV type=write size=2433161 2024-09-14T11:15:26.967 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:26.968+0000 7f76c1e8a8c0 1 < completed write operation key=K2EEZLRK7MVO tag=FLCW4UB00LZV type=write size=352103 2024-09-14T11:15:26.969 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:26.972+0000 7f76c1e8a8c0 1 > prepared operation key=SHKU2PRNREKK tag=9OPE9WL2RXYK type=del size=939709 2024-09-14T11:15:26.975 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:26.976+0000 7f76c1e8a8c0 1 < suggested update operation key=OOUEM16XL80W tag=9HOKCWXUHZGG type=del size=499997 2024-09-14T11:15:26.978 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:26.980+0000 7f76c1e8a8c0 1 > prepared operation key=GZM0AQVHNCMM tag=KPGT2HKBQUK0 type=del size=2665969 2024-09-14T11:15:26.981 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:26.984+0000 7f76c1e8a8c0 1 < completed delete operation key=MEVTZ7OAD4CA tag=P8QQ2OQ63R9J type=del 2024-09-14T11:15:26.985 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:26.988+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_SUNCRV0C1XYL.2~5HOZYBQ7FH5Q.0 size=1048576 2024-09-14T11:15:26.988 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:26.988+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_SUNCRV0C1XYL.2~5HOZYBQ7FH5Q.1 size=1048576 2024-09-14T11:15:26.990 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:26.992+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_SUNCRV0C1XYL.2~5HOZYBQ7FH5Q.2 size=843540 2024-09-14T11:15:26.990 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:26.992+0000 7f76c1e8a8c0 1 > prepared multipart upload key=SUNCRV0C1XYL upload=5HOZYBQ7FH5Q tag=9T0QTJJDXS67 type=write size=3989268 2024-09-14T11:15:26.995 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:26.996+0000 7f76c1e8a8c0 1 < suggested update operation key=W0MDRE9YO3UP tag=1W6OK440NW4T type=write size=885796 2024-09-14T11:15:26.999 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:27.000+0000 7f76c1e8a8c0 1 > prepared operation key=85G6NT78HAWQ tag=QYWK02PU0MUV type=del size=1440626 2024-09-14T11:15:27.001 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:27.004+0000 7f76c1e8a8c0 1 < completed part key=_multipart_F3KFS0P1WM7W.2~FS8ZYJJGWG6P.0 size=1048576 2024-09-14T11:15:27.001 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:27.004+0000 7f76c1e8a8c0 1 < canceled part key=_multipart_F3KFS0P1WM7W.2~FS8ZYJJGWG6P.1 size=7546 2024-09-14T11:15:27.006 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:27.008+0000 7f76c1e8a8c0 1 < canceled multipart upload key=F3KFS0P1WM7W upload=FS8ZYJJGWG6P tag=XA69M421E5QR type=write size=2104698 2024-09-14T11:15:27.011 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:27.012+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_GZM0AQVHNCMM.2~7WGQ4RQUYEW8.0 size=213156 2024-09-14T11:15:27.011 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:27.012+0000 7f76c1e8a8c0 1 > prepared multipart upload key=GZM0AQVHNCMM upload=7WGQ4RQUYEW8 tag=1E6BEF12N6FM type=write size=1261732 2024-09-14T11:15:27.011 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:27.012+0000 7f76c1e8a8c0 1 < canceled part key=_multipart_H9CQV6L29SL5.2~R52AS443V8W3.0 size=1048576 2024-09-14T11:15:27.014 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:27.016+0000 7f76c1e8a8c0 1 < completed part key=_multipart_H9CQV6L29SL5.2~R52AS443V8W3.1 size=330011 2024-09-14T11:15:27.018 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:27.020+0000 7f76c1e8a8c0 1 < canceled multipart upload key=H9CQV6L29SL5 upload=R52AS443V8W3 tag=238EXLL2RHYJ type=write size=2427163 2024-09-14T11:15:27.021 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:27.024+0000 7f76c1e8a8c0 1 > prepared operation key=SUNCRV0C1XYL tag=ASP10LWTZ6HM type=del size=2207871 2024-09-14T11:15:27.023 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:27.024+0000 7f76c1e8a8c0 -1 < failed to complete operation key=OOUEM16XL80W tag=9PFSY1UB9585 type=del size=1920900: (22) Invalid argument 2024-09-14T11:15:27.026 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:27.028+0000 7f76c1e8a8c0 1 > prepared operation key=K9W031V6BFJP tag=A6SOXEH2FURZ type=del size=454114 2024-09-14T11:15:27.031 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:27.032+0000 7f76c1e8a8c0 1 < suggested update operation key=SHKU2PRNREKK tag=R5AMESDS286U type=write size=176106 2024-09-14T11:15:27.034 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:27.036+0000 7f76c1e8a8c0 1 > prepared operation key=SUNCRV0C1XYL tag=N510L73E0C92 type=write size=565610 2024-09-14T11:15:27.036 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:27.040+0000 7f76c1e8a8c0 1 < canceled operation key=XC8VWSHZOPFP tag=4ZLRX4VGQ7C5 type=write size=455913 2024-09-14T11:15:27.039 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:27.040+0000 7f76c1e8a8c0 1 > prepared operation key=OUMUTEBQ1TD0 tag=36I33W0XJ9PB type=write size=760246 2024-09-14T11:15:27.041 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:27.044+0000 7f76c1e8a8c0 1 < completed part key=_multipart_SUNCRV0C1XYL.2~HQ4SIKIP8AOG.0 size=458706 2024-09-14T11:15:27.045 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:27.048+0000 7f76c1e8a8c0 1 < completed multipart upload key=SUNCRV0C1XYL upload=HQ4SIKIP8AOG tag=33KVCUP4YY04 type=write size=1507282 2024-09-14T11:15:27.048 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:27.048+0000 7f76c1e8a8c0 1 > prepared operation key=1W5733SDHGDN tag=0X0EV6254JZM type=del size=939848 2024-09-14T11:15:27.050 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:27.052+0000 7f76c1e8a8c0 1 < completed delete operation key=CIRQT9IDJ5OJ tag=1KK2RENNODRN type=del 2024-09-14T11:15:27.055 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:27.056+0000 7f76c1e8a8c0 1 > prepared operation key=8PZOVFEYYSOG tag=QGTPJDDM8AYG type=del size=2482818 2024-09-14T11:15:27.058 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:27.060+0000 7f76c1e8a8c0 1 < completed write operation key=1W5733SDHGDN tag=BLX85BJMO0M9 type=write size=633837 2024-09-14T11:15:27.063 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:27.064+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_1K8ESNXU6WDF.2~EAHCMZR7ZD2L.0 size=1048576 2024-09-14T11:15:27.065 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:27.068+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_1K8ESNXU6WDF.2~EAHCMZR7ZD2L.1 size=1048576 2024-09-14T11:15:27.066 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:27.068+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_1K8ESNXU6WDF.2~EAHCMZR7ZD2L.2 size=572890 2024-09-14T11:15:27.067 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:27.068+0000 7f76c1e8a8c0 1 > prepared multipart upload key=1K8ESNXU6WDF upload=EAHCMZR7ZD2L tag=F2746H1Y7EE1 type=write size=3718618 2024-09-14T11:15:27.069 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:27.072+0000 7f76c1e8a8c0 1 < completed write operation key=CIRQT9IDJ5OJ tag=MUOZJYHYE69M type=write size=617439 2024-09-14T11:15:27.072 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:27.072+0000 7f76c1e8a8c0 1 > prepared operation key=H9CQV6L29SL5 tag=TSX6ZXTFNA8E type=del size=3090091 2024-09-14T11:15:27.077 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:27.080+0000 7f76c1e8a8c0 1 < suggested update operation key=85G6NT78HAWQ tag=R45BSC0ZC6SK type=write size=345548 2024-09-14T11:15:27.080 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:27.080+0000 7f76c1e8a8c0 1 > prepared operation key=8PZOVFEYYSOG tag=HTQ2MQVAN26P type=del size=784472 2024-09-14T11:15:27.082 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:27.084+0000 7f76c1e8a8c0 1 < completed delete operation key=MEVTZ7OAD4CA tag=1J8LVEV4V3E5 type=del 2024-09-14T11:15:27.087 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:27.088+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_HJ701768A6I7.2~H872Q1LX7QO3.0 size=1048576 2024-09-14T11:15:27.089 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:27.092+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_HJ701768A6I7.2~H872Q1LX7QO3.1 size=1048576 2024-09-14T11:15:27.091 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:27.092+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_HJ701768A6I7.2~H872Q1LX7QO3.2 size=667080 2024-09-14T11:15:27.091 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:27.092+0000 7f76c1e8a8c0 1 > prepared multipart upload key=HJ701768A6I7 upload=H872Q1LX7QO3 tag=W27CN5TFVAOX type=write size=3812808 2024-09-14T11:15:27.093 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:27.096+0000 7f76c1e8a8c0 1 < completed part key=_multipart_GAVZRU8ZLW7S.2~BCJZ5BBNFDQ2.0 size=1048576 2024-09-14T11:15:27.093 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:27.096+0000 7f76c1e8a8c0 1 < canceled part key=_multipart_GAVZRU8ZLW7S.2~BCJZ5BBNFDQ2.1 size=336009 2024-09-14T11:15:27.097 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:27.100+0000 7f76c1e8a8c0 1 < canceled multipart upload key=GAVZRU8ZLW7S upload=BCJZ5BBNFDQ2 tag=30ZKFT6TAMYV type=write size=2433161 2024-09-14T11:15:27.099 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:27.100+0000 7f76c1e8a8c0 1 > prepared operation key=BOCIF4TL7X7J tag=GEE40A68AZV6 type=write size=75516 2024-09-14T11:15:27.102 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:27.104+0000 7f76c1e8a8c0 -1 < failed to complete operation key=SHKU2PRNREKK tag=9OPE9WL2RXYK type=del size=939709: (22) Invalid argument 2024-09-14T11:15:27.104 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:27.108+0000 7f76c1e8a8c0 1 > prepared operation key=15FU4CEGC22Q tag=XXN0YVZ7NNNZ type=write size=1041586 2024-09-14T11:15:27.107 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:27.108+0000 7f76c1e8a8c0 1 < completed delete operation key=GZM0AQVHNCMM tag=KPGT2HKBQUK0 type=del 2024-09-14T11:15:27.111 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:27.112+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_K9W031V6BFJP.2~81KC9G07WEI2.0 size=1048576 2024-09-14T11:15:27.113 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:27.116+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_K9W031V6BFJP.2~81KC9G07WEI2.1 size=727103 2024-09-14T11:15:27.113 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:27.116+0000 7f76c1e8a8c0 1 > prepared multipart upload key=K9W031V6BFJP upload=81KC9G07WEI2 tag=SEXSTK00GT90 type=write size=2824255 2024-09-14T11:15:27.115 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:27.116+0000 7f76c1e8a8c0 1 < completed part key=_multipart_SUNCRV0C1XYL.2~5HOZYBQ7FH5Q.0 size=1048576 2024-09-14T11:15:27.117 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:27.120+0000 7f76c1e8a8c0 1 < completed part key=_multipart_SUNCRV0C1XYL.2~5HOZYBQ7FH5Q.1 size=1048576 2024-09-14T11:15:27.120 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:27.120+0000 7f76c1e8a8c0 1 < completed part key=_multipart_SUNCRV0C1XYL.2~5HOZYBQ7FH5Q.2 size=843540 2024-09-14T11:15:27.123 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:27.124+0000 7f76c1e8a8c0 1 < completed multipart upload key=SUNCRV0C1XYL upload=5HOZYBQ7FH5Q tag=9T0QTJJDXS67 type=write size=3989268 2024-09-14T11:15:27.126 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:27.128+0000 7f76c1e8a8c0 1 > prepared operation key=HS7T50JORDQJ tag=D51NHR4RXYTR type=write size=887546 2024-09-14T11:15:27.128 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:27.132+0000 7f76c1e8a8c0 -1 < failed to complete operation key=85G6NT78HAWQ tag=QYWK02PU0MUV type=del size=1440626: (22) Invalid argument 2024-09-14T11:15:27.132 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:27.136+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_Q5IY4J5FOD80.2~YIUR4V2XBZQB.0 size=1048576 2024-09-14T11:15:27.134 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:27.136+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_Q5IY4J5FOD80.2~YIUR4V2XBZQB.1 size=609811 2024-09-14T11:15:27.134 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:27.136+0000 7f76c1e8a8c0 1 > prepared multipart upload key=Q5IY4J5FOD80 upload=YIUR4V2XBZQB tag=O71WI218MXR5 type=write size=2706963 2024-09-14T11:15:27.137 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:27.140+0000 7f76c1e8a8c0 1 < completed part key=_multipart_GZM0AQVHNCMM.2~7WGQ4RQUYEW8.0 size=213156 2024-09-14T11:15:27.141 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:27.144+0000 7f76c1e8a8c0 1 < completed multipart upload key=GZM0AQVHNCMM upload=7WGQ4RQUYEW8 tag=1E6BEF12N6FM type=write size=1261732 2024-09-14T11:15:27.143 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:27.144+0000 7f76c1e8a8c0 1 > prepared operation key=SUNCRV0C1XYL tag=I9ZSQBOLDX2H type=del size=2411909 2024-09-14T11:15:27.145 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:27.148+0000 7f76c1e8a8c0 1 < completed delete operation key=SUNCRV0C1XYL tag=ASP10LWTZ6HM type=del 2024-09-14T11:15:27.150 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:27.152+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_K2EEZLRK7MVO.2~1HV6912JO31W.0 size=131976 2024-09-14T11:15:27.150 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:27.152+0000 7f76c1e8a8c0 1 > prepared multipart upload key=K2EEZLRK7MVO upload=1HV6912JO31W tag=8JX7D5MBO5ND type=write size=1180552 2024-09-14T11:15:27.153 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:27.156+0000 7f76c1e8a8c0 1 < completed delete operation key=K9W031V6BFJP tag=A6SOXEH2FURZ type=del 2024-09-14T11:15:27.155 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:27.156+0000 7f76c1e8a8c0 1 > prepared operation key=MEVTZ7OAD4CA tag=7I3RWZ6QB8PH type=write size=996320 2024-09-14T11:15:27.157 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:27.160+0000 7f76c1e8a8c0 1 < completed write operation key=SUNCRV0C1XYL tag=N510L73E0C92 type=write size=565610 2024-09-14T11:15:27.160 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:27.164+0000 7f76c1e8a8c0 1 > prepared operation key=R5I9H7WAK7Z7 tag=YPIRVV5FG1BS type=del size=2928071 2024-09-14T11:15:27.165 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:27.168+0000 7f76c1e8a8c0 1 < suggested update operation key=OUMUTEBQ1TD0 tag=36I33W0XJ9PB type=write size=760246 2024-09-14T11:15:27.167 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:27.168+0000 7f76c1e8a8c0 1 > prepared operation key=SUNCRV0C1XYL tag=WYW4C61MZMR9 type=del size=2203593 2024-09-14T11:15:27.170 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:27.172+0000 7f76c1e8a8c0 1 < completed delete operation key=1W5733SDHGDN tag=0X0EV6254JZM type=del 2024-09-14T11:15:27.173 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:27.176+0000 7f76c1e8a8c0 1 > prepared operation key=85G6NT78HAWQ tag=RMUKBAUUUVV8 type=write size=135816 2024-09-14T11:15:27.177 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:27.180+0000 7f76c1e8a8c0 1 < suggested update operation key=8PZOVFEYYSOG tag=QGTPJDDM8AYG type=del size=2482818 2024-09-14T11:15:27.179 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:27.180+0000 7f76c1e8a8c0 1 > prepared operation key=H9CQV6L29SL5 tag=5W9OPGWNUQWF type=del size=1629694 2024-09-14T11:15:27.182 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:27.184+0000 7f76c1e8a8c0 1 < completed part key=_multipart_1K8ESNXU6WDF.2~EAHCMZR7ZD2L.0 size=1048576 2024-09-14T11:15:27.183 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:27.184+0000 7f76c1e8a8c0 1 < completed part key=_multipart_1K8ESNXU6WDF.2~EAHCMZR7ZD2L.1 size=1048576 2024-09-14T11:15:27.185 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:27.188+0000 7f76c1e8a8c0 1 < completed part key=_multipart_1K8ESNXU6WDF.2~EAHCMZR7ZD2L.2 size=572890 2024-09-14T11:15:27.188 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:27.192+0000 7f76c1e8a8c0 1 < completed multipart upload key=1K8ESNXU6WDF upload=EAHCMZR7ZD2L tag=F2746H1Y7EE1 type=write size=3718618 2024-09-14T11:15:27.191 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:27.192+0000 7f76c1e8a8c0 1 > prepared operation key=TZO40K6J9877 tag=DKMJK2N4ISQW type=del size=3297186 2024-09-14T11:15:27.193 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:27.196+0000 7f76c1e8a8c0 1 < completed delete operation key=H9CQV6L29SL5 tag=TSX6ZXTFNA8E type=del 2024-09-14T11:15:27.195 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:27.196+0000 7f76c1e8a8c0 1 > prepared operation key=K2EEZLRK7MVO tag=LT4KLZSGMH0C type=del size=3132308 2024-09-14T11:15:27.198 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:27.200+0000 7f76c1e8a8c0 -1 < failed to complete operation key=8PZOVFEYYSOG tag=HTQ2MQVAN26P type=del size=784472: (22) Invalid argument 2024-09-14T11:15:27.200 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:27.204+0000 7f76c1e8a8c0 1 > prepared operation key=GZM0AQVHNCMM tag=33GAIUZKGYXZ type=del size=3700214 2024-09-14T11:15:27.202 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:27.204+0000 7f76c1e8a8c0 1 < completed part key=_multipart_HJ701768A6I7.2~H872Q1LX7QO3.0 size=1048576 2024-09-14T11:15:27.204 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:27.208+0000 7f76c1e8a8c0 1 < completed part key=_multipart_HJ701768A6I7.2~H872Q1LX7QO3.1 size=1048576 2024-09-14T11:15:27.206 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:27.208+0000 7f76c1e8a8c0 1 < completed part key=_multipart_HJ701768A6I7.2~H872Q1LX7QO3.2 size=667080 2024-09-14T11:15:27.209 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:27.212+0000 7f76c1e8a8c0 1 < completed multipart upload key=HJ701768A6I7 upload=H872Q1LX7QO3 tag=W27CN5TFVAOX type=write size=3812808 2024-09-14T11:15:27.213 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:27.216+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_1W5733SDHGDN.2~1D46331GZ343.0 size=552041 2024-09-14T11:15:27.213 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:27.216+0000 7f76c1e8a8c0 1 > prepared multipart upload key=1W5733SDHGDN upload=1D46331GZ343 tag=F8O93NL5UFUB type=write size=1600617 2024-09-14T11:15:27.215 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:27.216+0000 7f76c1e8a8c0 1 < completed write operation key=BOCIF4TL7X7J tag=GEE40A68AZV6 type=write size=75516 2024-09-14T11:15:27.217 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:27.220+0000 7f76c1e8a8c0 1 > prepared operation key=K9W031V6BFJP tag=PC9V5D87JVW4 type=del size=2295376 2024-09-14T11:15:27.220 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:27.220+0000 7f76c1e8a8c0 1 < completed write operation key=15FU4CEGC22Q tag=XXN0YVZ7NNNZ type=write size=1041586 2024-09-14T11:15:27.222 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:27.224+0000 7f76c1e8a8c0 1 > prepared operation key=R5I9H7WAK7Z7 tag=4IPX2OW3LNTM type=del size=369038 2024-09-14T11:15:27.224 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:27.228+0000 7f76c1e8a8c0 1 < completed part key=_multipart_K9W031V6BFJP.2~81KC9G07WEI2.0 size=1048576 2024-09-14T11:15:27.226 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:27.228+0000 7f76c1e8a8c0 1 < completed part key=_multipart_K9W031V6BFJP.2~81KC9G07WEI2.1 size=727103 2024-09-14T11:15:27.230 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:27.232+0000 7f76c1e8a8c0 1 < completed multipart upload key=K9W031V6BFJP upload=81KC9G07WEI2 tag=SEXSTK00GT90 type=write size=2824255 2024-09-14T11:15:27.232 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:27.236+0000 7f76c1e8a8c0 1 > prepared operation key=GZM0AQVHNCMM tag=C2B2ZHOUNVAK type=del size=1594981 2024-09-14T11:15:27.235 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:27.236+0000 7f76c1e8a8c0 1 < completed write operation key=HS7T50JORDQJ tag=D51NHR4RXYTR type=write size=887546 2024-09-14T11:15:27.237 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:27.240+0000 7f76c1e8a8c0 1 > prepared operation key=VI61O3K069BP tag=KWLTVHY3DQLC type=write size=984282 2024-09-14T11:15:27.239 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:27.240+0000 7f76c1e8a8c0 1 < completed part key=_multipart_Q5IY4J5FOD80.2~YIUR4V2XBZQB.0 size=1048576 2024-09-14T11:15:27.241 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:27.244+0000 7f76c1e8a8c0 1 < completed part key=_multipart_Q5IY4J5FOD80.2~YIUR4V2XBZQB.1 size=609811 2024-09-14T11:15:27.244 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:27.248+0000 7f76c1e8a8c0 1 < completed multipart upload key=Q5IY4J5FOD80 upload=YIUR4V2XBZQB tag=O71WI218MXR5 type=write size=2706963 2024-09-14T11:15:27.248 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:27.252+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_GAVZRU8ZLW7S.2~GRCYVF2J6ML5.0 size=1048576 2024-09-14T11:15:27.250 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:27.252+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_GAVZRU8ZLW7S.2~GRCYVF2J6ML5.1 size=489388 2024-09-14T11:15:27.250 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:27.252+0000 7f76c1e8a8c0 1 > prepared multipart upload key=GAVZRU8ZLW7S upload=GRCYVF2J6ML5 tag=HZM3KUWBGD03 type=write size=2586540 2024-09-14T11:15:27.256 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:27.256+0000 7f76c1e8a8c0 1 < suggested remove operation key=SUNCRV0C1XYL tag=I9ZSQBOLDX2H type=del 2024-09-14T11:15:27.258 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:27.260+0000 7f76c1e8a8c0 1 > prepared operation key=HJ701768A6I7 tag=3GUU61KDXM32 type=write size=642356 2024-09-14T11:15:27.261 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:27.264+0000 7f76c1e8a8c0 1 < completed part key=_multipart_K2EEZLRK7MVO.2~1HV6912JO31W.0 size=131976 2024-09-14T11:15:27.266 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:27.268+0000 7f76c1e8a8c0 1 < completed multipart upload key=K2EEZLRK7MVO upload=1HV6912JO31W tag=8JX7D5MBO5ND type=write size=1180552 2024-09-14T11:15:27.268 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:27.272+0000 7f76c1e8a8c0 1 > prepared operation key=K9W031V6BFJP tag=Z4OI5G1DNIMO type=del size=2998363 2024-09-14T11:15:27.273 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:27.276+0000 7f76c1e8a8c0 1 < suggested remove operation key=MEVTZ7OAD4CA tag=7I3RWZ6QB8PH type=write 2024-09-14T11:15:27.276 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:27.276+0000 7f76c1e8a8c0 1 > prepared operation key=OOUEM16XL80W tag=BPCGIJJ20RBN type=write size=394624 2024-09-14T11:15:27.283 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:27.284+0000 7f76c1e8a8c0 1 < suggested remove operation key=R5I9H7WAK7Z7 tag=YPIRVV5FG1BS type=del 2024-09-14T11:15:27.286 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:27.288+0000 7f76c1e8a8c0 1 > prepared operation key=R5I9H7WAK7Z7 tag=MNOCAFHFO7AB type=del size=275803 2024-09-14T11:15:27.288 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:27.292+0000 7f76c1e8a8c0 -1 < failed to complete operation key=SUNCRV0C1XYL tag=WYW4C61MZMR9 type=del size=2203593: (22) Invalid argument 2024-09-14T11:15:27.291 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:27.292+0000 7f76c1e8a8c0 1 > prepared operation key=HJ701768A6I7 tag=1PWJF0EP7PDV type=del size=3744930 2024-09-14T11:15:27.294 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:27.296+0000 7f76c1e8a8c0 1 < canceled operation key=85G6NT78HAWQ tag=RMUKBAUUUVV8 type=write size=135816 2024-09-14T11:15:27.296 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:27.300+0000 7f76c1e8a8c0 1 > prepared operation key=1K8ESNXU6WDF tag=Z4IM4FJC3JI2 type=del size=826709 2024-09-14T11:15:27.301 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:27.304+0000 7f76c1e8a8c0 1 < suggested remove operation key=H9CQV6L29SL5 tag=5W9OPGWNUQWF type=del 2024-09-14T11:15:27.306 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:27.308+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_Q5IY4J5FOD80.2~AHBX1185LWQM.0 size=50786 2024-09-14T11:15:27.307 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:27.308+0000 7f76c1e8a8c0 1 > prepared multipart upload key=Q5IY4J5FOD80 upload=AHBX1185LWQM tag=3YCLVHWF65HT type=write size=1099362 2024-09-14T11:15:27.309 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:27.312+0000 7f76c1e8a8c0 1 < completed delete operation key=TZO40K6J9877 tag=DKMJK2N4ISQW type=del 2024-09-14T11:15:27.312 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:27.316+0000 7f76c1e8a8c0 1 > prepared operation key=SHKU2PRNREKK tag=C690P5Q8U3O1 type=del size=2020021 2024-09-14T11:15:27.315 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:27.316+0000 7f76c1e8a8c0 1 < completed delete operation key=K2EEZLRK7MVO tag=LT4KLZSGMH0C type=del 2024-09-14T11:15:27.317 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:27.320+0000 7f76c1e8a8c0 1 > prepared operation key=XC8VWSHZOPFP tag=KQCHAX3O9AFM type=del size=1647521 2024-09-14T11:15:27.320 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:27.320+0000 7f76c1e8a8c0 1 < completed delete operation key=GZM0AQVHNCMM tag=33GAIUZKGYXZ type=del 2024-09-14T11:15:27.322 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:27.324+0000 7f76c1e8a8c0 1 > prepared operation key=HS7T50JORDQJ tag=90DERH9QL3IJ type=write size=153187 2024-09-14T11:15:27.325 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:27.328+0000 7f76c1e8a8c0 1 < completed part key=_multipart_1W5733SDHGDN.2~1D46331GZ343.0 size=552041 2024-09-14T11:15:27.329 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:27.332+0000 7f76c1e8a8c0 1 < completed multipart upload key=1W5733SDHGDN upload=1D46331GZ343 tag=F8O93NL5UFUB type=write size=1600617 2024-09-14T11:15:27.332 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:27.332+0000 7f76c1e8a8c0 1 > prepared operation key=K9W031V6BFJP tag=9V8GJPYCJRUQ type=del size=86166 2024-09-14T11:15:27.334 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:27.336+0000 7f76c1e8a8c0 1 < completed delete operation key=K9W031V6BFJP tag=PC9V5D87JVW4 type=del 2024-09-14T11:15:27.339 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:27.340+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_K9W031V6BFJP.2~3MRUOVQ5MO09.0 size=1048576 2024-09-14T11:15:27.341 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:27.344+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_K9W031V6BFJP.2~3MRUOVQ5MO09.1 size=1048576 2024-09-14T11:15:27.343 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:27.344+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_K9W031V6BFJP.2~3MRUOVQ5MO09.2 size=557892 2024-09-14T11:15:27.343 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:27.344+0000 7f76c1e8a8c0 1 > prepared multipart upload key=K9W031V6BFJP upload=3MRUOVQ5MO09 tag=6SBJ9473DPYD type=write size=3703620 2024-09-14T11:15:27.345 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:27.348+0000 7f76c1e8a8c0 -1 < failed to complete operation key=R5I9H7WAK7Z7 tag=4IPX2OW3LNTM type=del size=369038: (22) Invalid argument 2024-09-14T11:15:27.349 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:27.352+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_XC8VWSHZOPFP.2~4KYGRMNB10NY.0 size=1048576 2024-09-14T11:15:27.351 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:27.352+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_XC8VWSHZOPFP.2~4KYGRMNB10NY.1 size=230514 2024-09-14T11:15:27.351 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:27.352+0000 7f76c1e8a8c0 1 > prepared multipart upload key=XC8VWSHZOPFP upload=4KYGRMNB10NY tag=07DTZG80I6EA type=write size=2327666 2024-09-14T11:15:27.354 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:27.356+0000 7f76c1e8a8c0 1 < completed delete operation key=GZM0AQVHNCMM tag=C2B2ZHOUNVAK type=del 2024-09-14T11:15:27.356 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:27.360+0000 7f76c1e8a8c0 1 > prepared operation key=H9CQV6L29SL5 tag=6J3D4EZMF6XV type=del size=1561076 2024-09-14T11:15:27.361 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:27.364+0000 7f76c1e8a8c0 1 < suggested update operation key=VI61O3K069BP tag=KWLTVHY3DQLC type=write size=984282 2024-09-14T11:15:27.365 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:27.368+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_8FFV9G6EQR8F.2~QG1Z3ZXCRRXR.0 size=1048576 2024-09-14T11:15:27.367 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:27.368+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_8FFV9G6EQR8F.2~QG1Z3ZXCRRXR.1 size=988825 2024-09-14T11:15:27.368 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:27.368+0000 7f76c1e8a8c0 1 > prepared multipart upload key=8FFV9G6EQR8F upload=QG1Z3ZXCRRXR tag=07MLCINP0X7M type=write size=3085977 2024-09-14T11:15:27.370 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:27.372+0000 7f76c1e8a8c0 1 < completed part key=_multipart_GAVZRU8ZLW7S.2~GRCYVF2J6ML5.0 size=1048576 2024-09-14T11:15:27.372 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:27.376+0000 7f76c1e8a8c0 1 < completed part key=_multipart_GAVZRU8ZLW7S.2~GRCYVF2J6ML5.1 size=489388 2024-09-14T11:15:27.376 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:27.380+0000 7f76c1e8a8c0 1 < completed multipart upload key=GAVZRU8ZLW7S upload=GRCYVF2J6ML5 tag=HZM3KUWBGD03 type=write size=2586540 2024-09-14T11:15:27.379 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:27.380+0000 7f76c1e8a8c0 1 > prepared operation key=8FFV9G6EQR8F tag=G5P1G5UIP7HT type=del size=705241 2024-09-14T11:15:27.381 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:27.384+0000 7f76c1e8a8c0 1 < completed write operation key=HJ701768A6I7 tag=3GUU61KDXM32 type=write size=642356 2024-09-14T11:15:27.384 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:27.384+0000 7f76c1e8a8c0 1 > prepared operation key=15FU4CEGC22Q tag=JCGN47G6OSZO type=del size=2754074 2024-09-14T11:15:27.390 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:27.392+0000 7f76c1e8a8c0 1 < suggested remove operation key=K9W031V6BFJP tag=Z4OI5G1DNIMO type=del 2024-09-14T11:15:27.392 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:27.396+0000 7f76c1e8a8c0 1 > prepared operation key=TUFOZKTV9XIH tag=F17AYT3I3SRK type=del size=3605405 2024-09-14T11:15:27.395 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:27.396+0000 7f76c1e8a8c0 1 < canceled operation key=OOUEM16XL80W tag=BPCGIJJ20RBN type=write size=394624 2024-09-14T11:15:27.397 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:27.400+0000 7f76c1e8a8c0 1 > prepared operation key=F3KFS0P1WM7W tag=NQYTS7919BWQ type=del size=237712 2024-09-14T11:15:27.400 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:27.404+0000 7f76c1e8a8c0 1 < completed delete operation key=R5I9H7WAK7Z7 tag=MNOCAFHFO7AB type=del 2024-09-14T11:15:27.405 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:27.408+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_KS37ZO6MKAH9.2~AQMK8TDP5V47.0 size=1048576 2024-09-14T11:15:27.407 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:27.408+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_KS37ZO6MKAH9.2~AQMK8TDP5V47.1 size=115940 2024-09-14T11:15:27.407 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:27.408+0000 7f76c1e8a8c0 1 > prepared multipart upload key=KS37ZO6MKAH9 upload=AQMK8TDP5V47 tag=ZEIQL9XSFM6Q type=write size=2213092 2024-09-14T11:15:27.410 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:27.412+0000 7f76c1e8a8c0 1 < completed delete operation key=HJ701768A6I7 tag=1PWJF0EP7PDV type=del 2024-09-14T11:15:27.412 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:27.416+0000 7f76c1e8a8c0 1 > prepared operation key=GZM0AQVHNCMM tag=O07DU1J0JOX9 type=del size=1319690 2024-09-14T11:15:27.415 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:27.416+0000 7f76c1e8a8c0 1 < completed delete operation key=1K8ESNXU6WDF tag=Z4IM4FJC3JI2 type=del 2024-09-14T11:15:27.418 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:27.420+0000 7f76c1e8a8c0 1 > prepared operation key=TUFOZKTV9XIH tag=415X55AO8F2I type=write size=187451 2024-09-14T11:15:27.420 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:27.424+0000 7f76c1e8a8c0 1 < completed part key=_multipart_Q5IY4J5FOD80.2~AHBX1185LWQM.0 size=50786 2024-09-14T11:15:27.425 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:27.428+0000 7f76c1e8a8c0 1 < completed multipart upload key=Q5IY4J5FOD80 upload=AHBX1185LWQM tag=3YCLVHWF65HT type=write size=1099362 2024-09-14T11:15:27.430 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:27.432+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_HS7T50JORDQJ.2~S2F4YNI3WWBJ.0 size=148825 2024-09-14T11:15:27.430 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:27.432+0000 7f76c1e8a8c0 1 > prepared multipart upload key=HS7T50JORDQJ upload=S2F4YNI3WWBJ tag=ACCQ29QCOZA2 type=write size=1197401 2024-09-14T11:15:27.432 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:27.436+0000 7f76c1e8a8c0 1 < completed delete operation key=SHKU2PRNREKK tag=C690P5Q8U3O1 type=del 2024-09-14T11:15:27.436 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:27.440+0000 7f76c1e8a8c0 1 > prepared operation key=1W5733SDHGDN tag=4XOI8I1A3C28 type=write size=636471 2024-09-14T11:15:27.439 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:27.440+0000 7f76c1e8a8c0 1 < completed delete operation key=XC8VWSHZOPFP tag=KQCHAX3O9AFM type=del 2024-09-14T11:15:27.442 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:27.444+0000 7f76c1e8a8c0 1 > prepared operation key=TZO40K6J9877 tag=BTM3SSSDS9YL type=write size=28593 2024-09-14T11:15:27.446 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:27.448+0000 7f76c1e8a8c0 1 < completed write operation key=HS7T50JORDQJ tag=90DERH9QL3IJ type=write size=153187 2024-09-14T11:15:27.450 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:27.452+0000 7f76c1e8a8c0 1 > prepared operation key=K2EEZLRK7MVO tag=1RV00AC7EMJB type=write size=988977 2024-09-14T11:15:27.451 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:27.452+0000 7f76c1e8a8c0 -1 < no bi entry to suggest for operation key=K9W031V6BFJP tag=9V8GJPYCJRUQ type=del size=86166: (2) No such file or directory 2024-09-14T11:15:27.455 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:27.456+0000 7f76c1e8a8c0 1 > prepared operation key=85G6NT78HAWQ tag=7VOFFCG3CN3S type=del size=1554724 2024-09-14T11:15:27.458 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:27.460+0000 7f76c1e8a8c0 1 < completed part key=_multipart_K9W031V6BFJP.2~3MRUOVQ5MO09.0 size=1048576 2024-09-14T11:15:27.461 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:27.464+0000 7f76c1e8a8c0 1 < completed part key=_multipart_K9W031V6BFJP.2~3MRUOVQ5MO09.1 size=1048576 2024-09-14T11:15:27.464 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:27.468+0000 7f76c1e8a8c0 1 < completed part key=_multipart_K9W031V6BFJP.2~3MRUOVQ5MO09.2 size=557892 2024-09-14T11:15:27.470 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:27.472+0000 7f76c1e8a8c0 1 < completed multipart upload key=K9W031V6BFJP upload=3MRUOVQ5MO09 tag=6SBJ9473DPYD type=write size=3703620 2024-09-14T11:15:27.473 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:27.476+0000 7f76c1e8a8c0 1 > prepared operation key=S43U13LYETS4 tag=PN1OMKVPVY43 type=write size=583720 2024-09-14T11:15:27.476 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:27.480+0000 7f76c1e8a8c0 1 < completed part key=_multipart_XC8VWSHZOPFP.2~4KYGRMNB10NY.0 size=1048576 2024-09-14T11:15:27.479 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:27.480+0000 7f76c1e8a8c0 1 < completed part key=_multipart_XC8VWSHZOPFP.2~4KYGRMNB10NY.1 size=230514 2024-09-14T11:15:27.485 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:27.488+0000 7f76c1e8a8c0 1 < completed multipart upload key=XC8VWSHZOPFP upload=4KYGRMNB10NY tag=07DTZG80I6EA type=write size=2327666 2024-09-14T11:15:27.489 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:27.492+0000 7f76c1e8a8c0 1 > prepared operation key=GZM0AQVHNCMM tag=20XGI3A9L03I type=del size=1418523 2024-09-14T11:15:27.492 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:27.496+0000 7f76c1e8a8c0 1 < canceled operation key=H9CQV6L29SL5 tag=6J3D4EZMF6XV type=del size=1561076 2024-09-14T11:15:27.496 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:27.496+0000 7f76c1e8a8c0 1 > prepared operation key=OOUEM16XL80W tag=XNPOPFI26G93 type=del size=997824 2024-09-14T11:15:27.499 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:27.500+0000 7f76c1e8a8c0 1 < completed part key=_multipart_8FFV9G6EQR8F.2~QG1Z3ZXCRRXR.0 size=1048576 2024-09-14T11:15:27.502 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:27.504+0000 7f76c1e8a8c0 1 < completed part key=_multipart_8FFV9G6EQR8F.2~QG1Z3ZXCRRXR.1 size=988825 2024-09-14T11:15:27.507 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:27.508+0000 7f76c1e8a8c0 1 < completed multipart upload key=8FFV9G6EQR8F upload=QG1Z3ZXCRRXR tag=07MLCINP0X7M type=write size=3085977 2024-09-14T11:15:27.512 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:27.516+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_SHKU2PRNREKK.2~LSFCY6Y0GNZB.0 size=1048576 2024-09-14T11:15:27.514 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:27.516+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_SHKU2PRNREKK.2~LSFCY6Y0GNZB.1 size=627831 2024-09-14T11:15:27.514 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:27.516+0000 7f76c1e8a8c0 1 > prepared multipart upload key=SHKU2PRNREKK upload=LSFCY6Y0GNZB tag=VF0LDTIOL62T type=write size=2724983 2024-09-14T11:15:27.518 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:27.520+0000 7f76c1e8a8c0 1 < completed delete operation key=8FFV9G6EQR8F tag=G5P1G5UIP7HT type=del 2024-09-14T11:15:27.521 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:27.524+0000 7f76c1e8a8c0 1 > prepared operation key=GAVZRU8ZLW7S tag=YQA0PDKP7O4W type=write size=909001 2024-09-14T11:15:27.525 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:27.528+0000 7f76c1e8a8c0 1 < completed delete operation key=15FU4CEGC22Q tag=JCGN47G6OSZO type=del 2024-09-14T11:15:27.528 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:27.532+0000 7f76c1e8a8c0 1 > prepared operation key=HS7T50JORDQJ tag=6CC9WQGXQ03N type=del size=367418 2024-09-14T11:15:27.532 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:27.536+0000 7f76c1e8a8c0 1 < completed delete operation key=TUFOZKTV9XIH tag=F17AYT3I3SRK type=del 2024-09-14T11:15:27.535 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:27.536+0000 7f76c1e8a8c0 1 > prepared operation key=R5I9H7WAK7Z7 tag=H48OMHQX61VU type=write size=371878 2024-09-14T11:15:27.540 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:27.544+0000 7f76c1e8a8c0 1 < suggested remove operation key=F3KFS0P1WM7W tag=NQYTS7919BWQ type=del 2024-09-14T11:15:27.543 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:27.544+0000 7f76c1e8a8c0 1 > prepared operation key=TZO40K6J9877 tag=32M6GA95KQRZ type=del size=46172 2024-09-14T11:15:27.546 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:27.548+0000 7f76c1e8a8c0 1 < completed part key=_multipart_KS37ZO6MKAH9.2~AQMK8TDP5V47.0 size=1048576 2024-09-14T11:15:27.549 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:27.552+0000 7f76c1e8a8c0 1 < completed part key=_multipart_KS37ZO6MKAH9.2~AQMK8TDP5V47.1 size=115940 2024-09-14T11:15:27.558 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:27.560+0000 7f76c1e8a8c0 1 < completed multipart upload key=KS37ZO6MKAH9 upload=AQMK8TDP5V47 tag=ZEIQL9XSFM6Q type=write size=2213092 2024-09-14T11:15:27.563 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:27.564+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_6TIJR323NMOH.2~2GYQ126FV3VH.0 size=1048576 2024-09-14T11:15:27.566 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:27.568+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_6TIJR323NMOH.2~2GYQ126FV3VH.1 size=796330 2024-09-14T11:15:27.566 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:27.568+0000 7f76c1e8a8c0 1 > prepared multipart upload key=6TIJR323NMOH upload=2GYQ126FV3VH tag=OVTQF9VKAR5D type=write size=2893482 2024-09-14T11:15:27.569 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:27.572+0000 7f76c1e8a8c0 1 < completed delete operation key=GZM0AQVHNCMM tag=O07DU1J0JOX9 type=del 2024-09-14T11:15:27.575 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:27.576+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_TZO40K6J9877.2~0J53J6WLIO7E.0 size=1048576 2024-09-14T11:15:27.577 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:27.580+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_TZO40K6J9877.2~0J53J6WLIO7E.1 size=394087 2024-09-14T11:15:27.577 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:27.580+0000 7f76c1e8a8c0 1 > prepared multipart upload key=TZO40K6J9877 upload=0J53J6WLIO7E tag=D73WQALIGVI7 type=write size=2491239 2024-09-14T11:15:27.583 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:27.584+0000 7f76c1e8a8c0 1 < suggested update operation key=TUFOZKTV9XIH tag=415X55AO8F2I type=write size=187451 2024-09-14T11:15:27.589 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:27.592+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_85G6NT78HAWQ.2~5H49GPFR9FAM.0 size=1048576 2024-09-14T11:15:27.592 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:27.592+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_85G6NT78HAWQ.2~5H49GPFR9FAM.1 size=1048576 2024-09-14T11:15:27.594 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:27.596+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_85G6NT78HAWQ.2~5H49GPFR9FAM.2 size=471395 2024-09-14T11:15:27.594 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:27.596+0000 7f76c1e8a8c0 1 > prepared multipart upload key=85G6NT78HAWQ upload=5H49GPFR9FAM tag=LJAMV4PVB9FX type=write size=3617123 2024-09-14T11:15:27.598 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:27.600+0000 7f76c1e8a8c0 1 < completed part key=_multipart_HS7T50JORDQJ.2~S2F4YNI3WWBJ.0 size=148825 2024-09-14T11:15:27.603 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:27.604+0000 7f76c1e8a8c0 1 < completed multipart upload key=HS7T50JORDQJ upload=S2F4YNI3WWBJ tag=ACCQ29QCOZA2 type=write size=1197401 2024-09-14T11:15:27.606 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:27.608+0000 7f76c1e8a8c0 1 > prepared operation key=KS37ZO6MKAH9 tag=2OO0QK729DCB type=del size=7724 2024-09-14T11:15:27.610 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:27.612+0000 7f76c1e8a8c0 1 < completed write operation key=1W5733SDHGDN tag=4XOI8I1A3C28 type=write size=636471 2024-09-14T11:15:27.615 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:27.616+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_R5I9H7WAK7Z7.2~Y16RIHMR0J7G.0 size=97511 2024-09-14T11:15:27.615 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:27.616+0000 7f76c1e8a8c0 1 > prepared multipart upload key=R5I9H7WAK7Z7 upload=Y16RIHMR0J7G tag=2XQCF36HTRPD type=write size=1146087 2024-09-14T11:15:27.619 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:27.620+0000 7f76c1e8a8c0 1 < completed write operation key=TZO40K6J9877 tag=BTM3SSSDS9YL type=write size=28593 2024-09-14T11:15:27.621 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:27.624+0000 7f76c1e8a8c0 1 > prepared operation key=K2EEZLRK7MVO tag=Q0TY2CEZ79GY type=del size=3861119 2024-09-14T11:15:27.625 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:27.628+0000 7f76c1e8a8c0 1 < completed write operation key=K2EEZLRK7MVO tag=1RV00AC7EMJB type=write size=988977 2024-09-14T11:15:27.630 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:27.632+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_TUFOZKTV9XIH.2~BZMXP3H6WU2Z.0 size=740513 2024-09-14T11:15:27.630 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:27.632+0000 7f76c1e8a8c0 1 > prepared multipart upload key=TUFOZKTV9XIH upload=BZMXP3H6WU2Z tag=3OCLAKBN0AM1 type=write size=1789089 2024-09-14T11:15:27.633 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:27.636+0000 7f76c1e8a8c0 1 < canceled operation key=85G6NT78HAWQ tag=7VOFFCG3CN3S type=del size=1554724 2024-09-14T11:15:27.636 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:27.640+0000 7f76c1e8a8c0 1 > prepared operation key=TUFOZKTV9XIH tag=OK3F2FNIV8E9 type=del size=3185249 2024-09-14T11:15:27.640 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:27.640+0000 7f76c1e8a8c0 1 < completed write operation key=S43U13LYETS4 tag=PN1OMKVPVY43 type=write size=583720 2024-09-14T11:15:27.645 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:27.648+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_85G6NT78HAWQ.2~CK4W3P7VYDOU.0 size=611974 2024-09-14T11:15:27.645 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:27.648+0000 7f76c1e8a8c0 1 > prepared multipart upload key=85G6NT78HAWQ upload=CK4W3P7VYDOU tag=UOSSGQN1C7YQ type=write size=1660550 2024-09-14T11:15:27.648 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:27.652+0000 7f76c1e8a8c0 1 < completed delete operation key=GZM0AQVHNCMM tag=20XGI3A9L03I type=del 2024-09-14T11:15:27.654 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:27.656+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_85G6NT78HAWQ.2~34FLK4XHER0L.0 size=1048576 2024-09-14T11:15:27.656 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:27.660+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_85G6NT78HAWQ.2~34FLK4XHER0L.1 size=135066 2024-09-14T11:15:27.656 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:27.660+0000 7f76c1e8a8c0 1 > prepared multipart upload key=85G6NT78HAWQ upload=34FLK4XHER0L tag=ZUVK3PVJZV4X type=write size=2232218 2024-09-14T11:15:27.662 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:27.664+0000 7f76c1e8a8c0 1 < suggested remove operation key=OOUEM16XL80W tag=XNPOPFI26G93 type=del 2024-09-14T11:15:27.665 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:27.668+0000 7f76c1e8a8c0 1 > prepared operation key=1W5733SDHGDN tag=BVWPR6YF0GA8 type=write size=357749 2024-09-14T11:15:27.668 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:27.672+0000 7f76c1e8a8c0 1 < completed part key=_multipart_SHKU2PRNREKK.2~LSFCY6Y0GNZB.0 size=1048576 2024-09-14T11:15:27.671 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:27.672+0000 7f76c1e8a8c0 1 < completed part key=_multipart_SHKU2PRNREKK.2~LSFCY6Y0GNZB.1 size=627831 2024-09-14T11:15:27.676 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:27.676+0000 7f76c1e8a8c0 1 < completed multipart upload key=SHKU2PRNREKK upload=LSFCY6Y0GNZB tag=VF0LDTIOL62T type=write size=2724983 2024-09-14T11:15:27.679 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:27.680+0000 7f76c1e8a8c0 1 > prepared operation key=HJ701768A6I7 tag=946FE6M9R5IH type=del size=2907278 2024-09-14T11:15:27.682 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:27.684+0000 7f76c1e8a8c0 1 < canceled operation key=GAVZRU8ZLW7S tag=YQA0PDKP7O4W type=write size=909001 2024-09-14T11:15:27.685 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:27.688+0000 7f76c1e8a8c0 1 > prepared operation key=OOUEM16XL80W tag=7L2FAVS1YR7X type=del size=1642079 2024-09-14T11:15:27.691 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:27.692+0000 7f76c1e8a8c0 1 < suggested update operation key=HS7T50JORDQJ tag=6CC9WQGXQ03N type=del size=367418 2024-09-14T11:15:27.696 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:27.700+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_KS37ZO6MKAH9.2~FG087SKGOYP0.0 size=1048576 2024-09-14T11:15:27.698 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:27.700+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_KS37ZO6MKAH9.2~FG087SKGOYP0.1 size=296012 2024-09-14T11:15:27.699 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:27.700+0000 7f76c1e8a8c0 1 > prepared multipart upload key=KS37ZO6MKAH9 upload=FG087SKGOYP0 tag=9A9IQ17TWWIX type=write size=2393164 2024-09-14T11:15:27.702 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:27.704+0000 7f76c1e8a8c0 1 < completed write operation key=R5I9H7WAK7Z7 tag=H48OMHQX61VU type=write size=371878 2024-09-14T11:15:27.707 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:27.708+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_S43U13LYETS4.2~N2SEG2NM7L8D.0 size=778658 2024-09-14T11:15:27.707 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:27.708+0000 7f76c1e8a8c0 1 > prepared multipart upload key=S43U13LYETS4 upload=N2SEG2NM7L8D tag=OPG028UXBU33 type=write size=1827234 2024-09-14T11:15:27.710 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:27.712+0000 7f76c1e8a8c0 1 < completed delete operation key=TZO40K6J9877 tag=32M6GA95KQRZ type=del 2024-09-14T11:15:27.713 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:27.716+0000 7f76c1e8a8c0 1 > prepared operation key=Q5IY4J5FOD80 tag=ON0HYTGRMSSZ type=del size=260126 2024-09-14T11:15:27.717 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:27.720+0000 7f76c1e8a8c0 1 < completed part key=_multipart_6TIJR323NMOH.2~2GYQ126FV3VH.0 size=1048576 2024-09-14T11:15:27.719 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:27.720+0000 7f76c1e8a8c0 1 < completed part key=_multipart_6TIJR323NMOH.2~2GYQ126FV3VH.1 size=796330 2024-09-14T11:15:27.725 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:27.728+0000 7f76c1e8a8c0 1 < completed multipart upload key=6TIJR323NMOH upload=2GYQ126FV3VH tag=OVTQF9VKAR5D type=write size=2893482 2024-09-14T11:15:27.730 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:27.732+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_S43U13LYETS4.2~9IHOALSD9T4C.0 size=1048576 2024-09-14T11:15:27.733 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:27.736+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_S43U13LYETS4.2~9IHOALSD9T4C.1 size=4280 2024-09-14T11:15:27.733 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:27.736+0000 7f76c1e8a8c0 1 > prepared multipart upload key=S43U13LYETS4 upload=9IHOALSD9T4C tag=RVQYGS0SUTSP type=write size=2101432 2024-09-14T11:15:27.736 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:27.740+0000 7f76c1e8a8c0 1 < completed part key=_multipart_TZO40K6J9877.2~0J53J6WLIO7E.0 size=1048576 2024-09-14T11:15:27.738 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:27.740+0000 7f76c1e8a8c0 1 < completed part key=_multipart_TZO40K6J9877.2~0J53J6WLIO7E.1 size=394087 2024-09-14T11:15:27.744 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:27.748+0000 7f76c1e8a8c0 1 < completed multipart upload key=TZO40K6J9877 upload=0J53J6WLIO7E tag=D73WQALIGVI7 type=write size=2491239 2024-09-14T11:15:27.748 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:27.748+0000 7f76c1e8a8c0 1 > prepared operation key=R5I9H7WAK7Z7 tag=WIPEFV0AJ1LM type=write size=299620 2024-09-14T11:15:27.751 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:27.752+0000 7f76c1e8a8c0 1 < completed part key=_multipart_85G6NT78HAWQ.2~5H49GPFR9FAM.0 size=1048576 2024-09-14T11:15:27.754 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:27.756+0000 7f76c1e8a8c0 1 < completed part key=_multipart_85G6NT78HAWQ.2~5H49GPFR9FAM.1 size=1048576 2024-09-14T11:15:27.754 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:27.756+0000 7f76c1e8a8c0 1 < canceled part key=_multipart_85G6NT78HAWQ.2~5H49GPFR9FAM.2 size=471395 2024-09-14T11:15:27.759 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:27.760+0000 7f76c1e8a8c0 1 < canceled multipart upload key=85G6NT78HAWQ upload=5H49GPFR9FAM tag=LJAMV4PVB9FX type=write size=3617123 2024-09-14T11:15:27.762 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:27.764+0000 7f76c1e8a8c0 1 > prepared operation key=8PZOVFEYYSOG tag=WW8FJAZU820A type=del size=825445 2024-09-14T11:15:27.769 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:27.772+0000 7f76c1e8a8c0 1 < suggested update operation key=KS37ZO6MKAH9 tag=2OO0QK729DCB type=del size=7724 2024-09-14T11:15:27.775 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:27.776+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_LZ0YNFOVFYCL.2~IL6NYHVCF3IR.0 size=116818 2024-09-14T11:15:27.775 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:27.776+0000 7f76c1e8a8c0 1 > prepared multipart upload key=LZ0YNFOVFYCL upload=IL6NYHVCF3IR tag=KIHJXNIWESKW type=write size=1165394 2024-09-14T11:15:27.779 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:27.780+0000 7f76c1e8a8c0 1 < completed part key=_multipart_R5I9H7WAK7Z7.2~Y16RIHMR0J7G.0 size=97511 2024-09-14T11:15:27.784 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:27.788+0000 7f76c1e8a8c0 1 < completed multipart upload key=R5I9H7WAK7Z7 upload=Y16RIHMR0J7G tag=2XQCF36HTRPD type=write size=1146087 2024-09-14T11:15:27.790 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:27.792+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_15FU4CEGC22Q.2~XSVT8076K8LO.0 size=849227 2024-09-14T11:15:27.790 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:27.792+0000 7f76c1e8a8c0 1 > prepared multipart upload key=15FU4CEGC22Q upload=XSVT8076K8LO tag=Y8GDRU7ML3QL type=write size=1897803 2024-09-14T11:15:27.794 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:27.796+0000 7f76c1e8a8c0 1 < completed delete operation key=K2EEZLRK7MVO tag=Q0TY2CEZ79GY type=del 2024-09-14T11:15:27.801 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:27.804+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_LZ0YNFOVFYCL.2~1AAJNVTWKMWJ.0 size=1048576 2024-09-14T11:15:27.803 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:27.804+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_LZ0YNFOVFYCL.2~1AAJNVTWKMWJ.1 size=342118 2024-09-14T11:15:27.804 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:27.804+0000 7f76c1e8a8c0 1 > prepared multipart upload key=LZ0YNFOVFYCL upload=1AAJNVTWKMWJ tag=LYR8QSSKZHNE type=write size=2439270 2024-09-14T11:15:27.807 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:27.808+0000 7f76c1e8a8c0 1 < completed part key=_multipart_TUFOZKTV9XIH.2~BZMXP3H6WU2Z.0 size=740513 2024-09-14T11:15:27.812 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:27.816+0000 7f76c1e8a8c0 1 < completed multipart upload key=TUFOZKTV9XIH upload=BZMXP3H6WU2Z tag=3OCLAKBN0AM1 type=write size=1789089 2024-09-14T11:15:27.817 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:27.820+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_K9W031V6BFJP.2~Z3RZA1O047FY.0 size=1048576 2024-09-14T11:15:27.820 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:27.824+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_K9W031V6BFJP.2~Z3RZA1O047FY.1 size=473979 2024-09-14T11:15:27.820 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:27.824+0000 7f76c1e8a8c0 1 > prepared multipart upload key=K9W031V6BFJP upload=Z3RZA1O047FY tag=4D5WOGFVCS28 type=write size=2571131 2024-09-14T11:15:27.823 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:27.824+0000 7f76c1e8a8c0 1 < completed delete operation key=TUFOZKTV9XIH tag=OK3F2FNIV8E9 type=del 2024-09-14T11:15:27.829 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:27.832+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_TUFOZKTV9XIH.2~M8PX9HVO2C0I.0 size=1048576 2024-09-14T11:15:27.831 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:27.832+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_TUFOZKTV9XIH.2~M8PX9HVO2C0I.1 size=908071 2024-09-14T11:15:27.831 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:27.832+0000 7f76c1e8a8c0 1 > prepared multipart upload key=TUFOZKTV9XIH upload=M8PX9HVO2C0I tag=FCX5UEGLBUN5 type=write size=3005223 2024-09-14T11:15:27.834 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:27.836+0000 7f76c1e8a8c0 1 < completed part key=_multipart_85G6NT78HAWQ.2~CK4W3P7VYDOU.0 size=611974 2024-09-14T11:15:27.839 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:27.840+0000 7f76c1e8a8c0 1 < completed multipart upload key=85G6NT78HAWQ upload=CK4W3P7VYDOU tag=UOSSGQN1C7YQ type=write size=1660550 2024-09-14T11:15:27.842 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:27.844+0000 7f76c1e8a8c0 1 > prepared operation key=F3KFS0P1WM7W tag=JFONMVMFR6IS type=del size=1688572 2024-09-14T11:15:27.843 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:27.844+0000 7f76c1e8a8c0 1 < canceled part key=_multipart_85G6NT78HAWQ.2~34FLK4XHER0L.0 size=1048576 2024-09-14T11:15:27.849 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:27.852+0000 7f76c1e8a8c0 1 < completed part key=_multipart_85G6NT78HAWQ.2~34FLK4XHER0L.1 size=135066 2024-09-14T11:15:27.854 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:27.856+0000 7f76c1e8a8c0 1 < canceled multipart upload key=85G6NT78HAWQ upload=34FLK4XHER0L tag=ZUVK3PVJZV4X type=write size=2232218 2024-09-14T11:15:27.857 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:27.860+0000 7f76c1e8a8c0 1 > prepared operation key=MEVTZ7OAD4CA tag=L51CIIJ72PYY type=del size=194542 2024-09-14T11:15:27.860 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:27.864+0000 7f76c1e8a8c0 1 < canceled operation key=1W5733SDHGDN tag=BVWPR6YF0GA8 type=write size=357749 2024-09-14T11:15:27.865 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:27.868+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_F3KFS0P1WM7W.2~OKW5CWQLR3MB.0 size=407203 2024-09-14T11:15:27.865 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:27.868+0000 7f76c1e8a8c0 1 > prepared multipart upload key=F3KFS0P1WM7W upload=OKW5CWQLR3MB tag=9GXK2ESFJY0L type=write size=1455779 2024-09-14T11:15:27.868 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:27.872+0000 7f76c1e8a8c0 1 < canceled operation key=HJ701768A6I7 tag=946FE6M9R5IH type=del size=2907278 2024-09-14T11:15:27.872 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:27.872+0000 7f76c1e8a8c0 1 > prepared operation key=SUNCRV0C1XYL tag=2A3I5N16KH9H type=del size=1819068 2024-09-14T11:15:27.875 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:27.876+0000 7f76c1e8a8c0 1 < completed delete operation key=OOUEM16XL80W tag=7L2FAVS1YR7X type=del 2024-09-14T11:15:27.881 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:27.884+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_SUNCRV0C1XYL.2~UTXYDH0K3D7Q.0 size=1048576 2024-09-14T11:15:27.883 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:27.884+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_SUNCRV0C1XYL.2~UTXYDH0K3D7Q.1 size=1048576 2024-09-14T11:15:27.885 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:27.888+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_SUNCRV0C1XYL.2~UTXYDH0K3D7Q.2 size=48433 2024-09-14T11:15:27.885 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:27.888+0000 7f76c1e8a8c0 1 > prepared multipart upload key=SUNCRV0C1XYL upload=UTXYDH0K3D7Q tag=KI4GNUHMHQVZ type=write size=3194161 2024-09-14T11:15:27.888 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:27.892+0000 7f76c1e8a8c0 1 < completed part key=_multipart_KS37ZO6MKAH9.2~FG087SKGOYP0.0 size=1048576 2024-09-14T11:15:27.891 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:27.892+0000 7f76c1e8a8c0 1 < completed part key=_multipart_KS37ZO6MKAH9.2~FG087SKGOYP0.1 size=296012 2024-09-14T11:15:27.896 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:27.896+0000 7f76c1e8a8c0 1 < completed multipart upload key=KS37ZO6MKAH9 upload=FG087SKGOYP0 tag=9A9IQ17TWWIX type=write size=2393164 2024-09-14T11:15:27.899 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:27.900+0000 7f76c1e8a8c0 1 > prepared operation key=8PZOVFEYYSOG tag=BQEBNTQVVEWM type=del size=2321753 2024-09-14T11:15:27.902 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:27.904+0000 7f76c1e8a8c0 1 < completed part key=_multipart_S43U13LYETS4.2~N2SEG2NM7L8D.0 size=778658 2024-09-14T11:15:27.907 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:27.908+0000 7f76c1e8a8c0 1 < completed multipart upload key=S43U13LYETS4 upload=N2SEG2NM7L8D tag=OPG028UXBU33 type=write size=1827234 2024-09-14T11:15:27.910 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:27.912+0000 7f76c1e8a8c0 1 > prepared operation key=8FFV9G6EQR8F tag=0GLQXTTCS5GL type=del size=1347258 2024-09-14T11:15:27.913 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:27.916+0000 7f76c1e8a8c0 1 < canceled operation key=Q5IY4J5FOD80 tag=ON0HYTGRMSSZ type=del size=260126 2024-09-14T11:15:27.918 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:27.920+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_15FU4CEGC22Q.2~61CHZEVCMQ67.0 size=1048576 2024-09-14T11:15:27.921 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:27.924+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_15FU4CEGC22Q.2~61CHZEVCMQ67.1 size=1048576 2024-09-14T11:15:27.923 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:27.924+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_15FU4CEGC22Q.2~61CHZEVCMQ67.2 size=971142 2024-09-14T11:15:27.923 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:27.924+0000 7f76c1e8a8c0 1 > prepared multipart upload key=15FU4CEGC22Q upload=61CHZEVCMQ67 tag=8U4PHH0FYG93 type=write size=4116870 2024-09-14T11:15:27.927 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:27.928+0000 7f76c1e8a8c0 1 < completed part key=_multipart_S43U13LYETS4.2~9IHOALSD9T4C.0 size=1048576 2024-09-14T11:15:27.930 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:27.932+0000 7f76c1e8a8c0 1 < completed part key=_multipart_S43U13LYETS4.2~9IHOALSD9T4C.1 size=4280 2024-09-14T11:15:27.935 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:27.936+0000 7f76c1e8a8c0 1 < completed multipart upload key=S43U13LYETS4 upload=9IHOALSD9T4C tag=RVQYGS0SUTSP type=write size=2101432 2024-09-14T11:15:27.938 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:27.940+0000 7f76c1e8a8c0 1 > prepared operation key=HJ701768A6I7 tag=DOIW2KQIY150 type=del size=1114731 2024-09-14T11:15:27.943 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:27.944+0000 7f76c1e8a8c0 1 < suggested update operation key=R5I9H7WAK7Z7 tag=WIPEFV0AJ1LM type=write size=299620 2024-09-14T11:15:27.946 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:27.948+0000 7f76c1e8a8c0 1 > prepared operation key=LZ0YNFOVFYCL tag=VSLB60GLH54O type=write size=217280 2024-09-14T11:15:27.950 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:27.952+0000 7f76c1e8a8c0 1 < completed delete operation key=8PZOVFEYYSOG tag=WW8FJAZU820A type=del 2024-09-14T11:15:27.953 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:27.956+0000 7f76c1e8a8c0 1 > prepared operation key=HS7T50JORDQJ tag=BDRKINATQLLM type=write size=424061 2024-09-14T11:15:27.956 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:27.960+0000 7f76c1e8a8c0 1 < completed part key=_multipart_LZ0YNFOVFYCL.2~IL6NYHVCF3IR.0 size=116818 2024-09-14T11:15:27.961 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:27.964+0000 7f76c1e8a8c0 1 < completed multipart upload key=LZ0YNFOVFYCL upload=IL6NYHVCF3IR tag=KIHJXNIWESKW type=write size=1165394 2024-09-14T11:15:27.964 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:27.968+0000 7f76c1e8a8c0 1 > prepared operation key=HS7T50JORDQJ tag=RHJ60JCEC78X type=write size=753744 2024-09-14T11:15:27.967 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:27.968+0000 7f76c1e8a8c0 1 < completed part key=_multipart_15FU4CEGC22Q.2~XSVT8076K8LO.0 size=849227 2024-09-14T11:15:27.972 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:27.972+0000 7f76c1e8a8c0 1 < completed multipart upload key=15FU4CEGC22Q upload=XSVT8076K8LO tag=Y8GDRU7ML3QL type=write size=1897803 2024-09-14T11:15:27.978 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:27.980+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_XC8VWSHZOPFP.2~375DN1JI31X7.0 size=1048576 2024-09-14T11:15:27.980 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:27.980+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_XC8VWSHZOPFP.2~375DN1JI31X7.1 size=1048576 2024-09-14T11:15:27.982 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:27.984+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_XC8VWSHZOPFP.2~375DN1JI31X7.2 size=342326 2024-09-14T11:15:27.982 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:27.984+0000 7f76c1e8a8c0 1 > prepared multipart upload key=XC8VWSHZOPFP upload=375DN1JI31X7 tag=BR3J0D5U9Z06 type=write size=3488054 2024-09-14T11:15:27.985 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:27.988+0000 7f76c1e8a8c0 1 < completed part key=_multipart_LZ0YNFOVFYCL.2~1AAJNVTWKMWJ.0 size=1048576 2024-09-14T11:15:27.989 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:27.992+0000 7f76c1e8a8c0 1 < completed part key=_multipart_LZ0YNFOVFYCL.2~1AAJNVTWKMWJ.1 size=342118 2024-09-14T11:15:27.993 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:27.996+0000 7f76c1e8a8c0 1 < completed multipart upload key=LZ0YNFOVFYCL upload=1AAJNVTWKMWJ tag=LYR8QSSKZHNE type=write size=2439270 2024-09-14T11:15:27.998 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:28.000+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_R5I9H7WAK7Z7.2~SIYR9VFJUZFU.0 size=1048576 2024-09-14T11:15:28.001 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:28.004+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_R5I9H7WAK7Z7.2~SIYR9VFJUZFU.1 size=1048576 2024-09-14T11:15:28.003 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:28.004+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_R5I9H7WAK7Z7.2~SIYR9VFJUZFU.2 size=816606 2024-09-14T11:15:28.003 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:28.004+0000 7f76c1e8a8c0 1 > prepared multipart upload key=R5I9H7WAK7Z7 upload=SIYR9VFJUZFU tag=29D30X4JSYJK type=write size=3962334 2024-09-14T11:15:28.006 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:28.008+0000 7f76c1e8a8c0 1 < completed part key=_multipart_K9W031V6BFJP.2~Z3RZA1O047FY.0 size=1048576 2024-09-14T11:15:28.008 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:28.012+0000 7f76c1e8a8c0 1 < completed part key=_multipart_K9W031V6BFJP.2~Z3RZA1O047FY.1 size=473979 2024-09-14T11:15:28.012 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:28.016+0000 7f76c1e8a8c0 1 < completed multipart upload key=K9W031V6BFJP upload=Z3RZA1O047FY tag=4D5WOGFVCS28 type=write size=2571131 2024-09-14T11:15:28.015 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:28.016+0000 7f76c1e8a8c0 1 > prepared operation key=BOCIF4TL7X7J tag=PUEQJ0BWSHFK type=del size=2843310 2024-09-14T11:15:28.018 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:28.020+0000 7f76c1e8a8c0 1 < completed part key=_multipart_TUFOZKTV9XIH.2~M8PX9HVO2C0I.0 size=1048576 2024-09-14T11:15:28.021 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:28.024+0000 7f76c1e8a8c0 1 < completed part key=_multipart_TUFOZKTV9XIH.2~M8PX9HVO2C0I.1 size=908071 2024-09-14T11:15:28.025 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:28.028+0000 7f76c1e8a8c0 1 < completed multipart upload key=TUFOZKTV9XIH upload=M8PX9HVO2C0I tag=FCX5UEGLBUN5 type=write size=3005223 2024-09-14T11:15:28.028 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:28.032+0000 7f76c1e8a8c0 1 > prepared operation key=W0MDRE9YO3UP tag=5MYL4U9HIRB7 type=write size=484158 2024-09-14T11:15:28.034 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:28.036+0000 7f76c1e8a8c0 1 < suggested remove operation key=F3KFS0P1WM7W tag=JFONMVMFR6IS type=del 2024-09-14T11:15:28.039 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:28.040+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_LZ0YNFOVFYCL.2~TFBON6WZCU49.0 size=1048576 2024-09-14T11:15:28.041 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:28.044+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_LZ0YNFOVFYCL.2~TFBON6WZCU49.1 size=330750 2024-09-14T11:15:28.041 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:28.044+0000 7f76c1e8a8c0 1 > prepared multipart upload key=LZ0YNFOVFYCL upload=TFBON6WZCU49 tag=TA5WG2TANAFQ type=write size=2427902 2024-09-14T11:15:28.044 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:28.044+0000 7f76c1e8a8c0 1 < completed delete operation key=MEVTZ7OAD4CA tag=L51CIIJ72PYY type=del 2024-09-14T11:15:28.049 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:28.052+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_8PZOVFEYYSOG.2~B0WM9PAG6U16.0 size=1048576 2024-09-14T11:15:28.051 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:28.052+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_8PZOVFEYYSOG.2~B0WM9PAG6U16.1 size=1048576 2024-09-14T11:15:28.053 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:28.056+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_8PZOVFEYYSOG.2~B0WM9PAG6U16.2 size=434559 2024-09-14T11:15:28.053 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:28.056+0000 7f76c1e8a8c0 1 > prepared multipart upload key=8PZOVFEYYSOG upload=B0WM9PAG6U16 tag=YV948C714FHQ type=write size=3580287 2024-09-14T11:15:28.056 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:28.060+0000 7f76c1e8a8c0 1 < completed part key=_multipart_F3KFS0P1WM7W.2~OKW5CWQLR3MB.0 size=407203 2024-09-14T11:15:28.061 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:28.064+0000 7f76c1e8a8c0 1 < completed multipart upload key=F3KFS0P1WM7W upload=OKW5CWQLR3MB tag=9GXK2ESFJY0L type=write size=1455779 2024-09-14T11:15:28.066 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:28.068+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_F3KFS0P1WM7W.2~P62C2GKARDSI.0 size=1048576 2024-09-14T11:15:28.068 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:28.072+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_F3KFS0P1WM7W.2~P62C2GKARDSI.1 size=384504 2024-09-14T11:15:28.068 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:28.072+0000 7f76c1e8a8c0 1 > prepared multipart upload key=F3KFS0P1WM7W upload=P62C2GKARDSI tag=4FD7Y9DEMOJT type=write size=2481656 2024-09-14T11:15:28.071 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:28.072+0000 7f76c1e8a8c0 1 < completed delete operation key=SUNCRV0C1XYL tag=2A3I5N16KH9H type=del 2024-09-14T11:15:28.074 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:28.076+0000 7f76c1e8a8c0 1 > prepared operation key=6TIJR323NMOH tag=9QZ6Q0OE1JOG type=write size=30877 2024-09-14T11:15:28.077 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:28.080+0000 7f76c1e8a8c0 1 < completed part key=_multipart_SUNCRV0C1XYL.2~UTXYDH0K3D7Q.0 size=1048576 2024-09-14T11:15:28.079 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:28.080+0000 7f76c1e8a8c0 1 < completed part key=_multipart_SUNCRV0C1XYL.2~UTXYDH0K3D7Q.1 size=1048576 2024-09-14T11:15:28.082 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:28.084+0000 7f76c1e8a8c0 1 < completed part key=_multipart_SUNCRV0C1XYL.2~UTXYDH0K3D7Q.2 size=48433 2024-09-14T11:15:28.087 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:28.088+0000 7f76c1e8a8c0 1 < completed multipart upload key=SUNCRV0C1XYL upload=UTXYDH0K3D7Q tag=KI4GNUHMHQVZ type=write size=3194161 2024-09-14T11:15:28.090 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:28.092+0000 7f76c1e8a8c0 1 > prepared operation key=1W5733SDHGDN tag=W8QEYHGAULJI type=del size=3356719 2024-09-14T11:15:28.093 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:28.096+0000 7f76c1e8a8c0 1 < completed delete operation key=8PZOVFEYYSOG tag=BQEBNTQVVEWM type=del 2024-09-14T11:15:28.096 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:28.100+0000 7f76c1e8a8c0 1 > prepared operation key=W0MDRE9YO3UP tag=120EDQGPXLVF type=del size=3714366 2024-09-14T11:15:28.099 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:28.100+0000 7f76c1e8a8c0 1 < completed delete operation key=8FFV9G6EQR8F tag=0GLQXTTCS5GL type=del 2024-09-14T11:15:28.105 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:28.108+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_VI61O3K069BP.2~VITC0VKFKZ0S.0 size=1048576 2024-09-14T11:15:28.107 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:28.108+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_VI61O3K069BP.2~VITC0VKFKZ0S.1 size=271892 2024-09-14T11:15:28.107 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:28.108+0000 7f76c1e8a8c0 1 > prepared multipart upload key=VI61O3K069BP upload=VITC0VKFKZ0S tag=PRWT5UNPHCDX type=write size=2369044 2024-09-14T11:15:28.110 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:28.112+0000 7f76c1e8a8c0 1 < completed part key=_multipart_15FU4CEGC22Q.2~61CHZEVCMQ67.0 size=1048576 2024-09-14T11:15:28.112 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:28.116+0000 7f76c1e8a8c0 1 < completed part key=_multipart_15FU4CEGC22Q.2~61CHZEVCMQ67.1 size=1048576 2024-09-14T11:15:28.114 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:28.116+0000 7f76c1e8a8c0 1 < completed part key=_multipart_15FU4CEGC22Q.2~61CHZEVCMQ67.2 size=971142 2024-09-14T11:15:28.123 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:28.124+0000 7f76c1e8a8c0 1 < completed multipart upload key=15FU4CEGC22Q upload=61CHZEVCMQ67 tag=8U4PHH0FYG93 type=write size=4116870 2024-09-14T11:15:28.126 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:28.128+0000 7f76c1e8a8c0 1 > prepared operation key=W0MDRE9YO3UP tag=2O4UC2FMD35S type=write size=182947 2024-09-14T11:15:28.129 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:28.132+0000 7f76c1e8a8c0 1 < completed delete operation key=HJ701768A6I7 tag=DOIW2KQIY150 type=del 2024-09-14T11:15:28.131 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:28.132+0000 7f76c1e8a8c0 1 > prepared operation key=6TIJR323NMOH tag=ZHRAU1WRXDI1 type=del size=2175675 2024-09-14T11:15:28.137 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:28.140+0000 7f76c1e8a8c0 1 < suggested update operation key=LZ0YNFOVFYCL tag=VSLB60GLH54O type=write size=217280 2024-09-14T11:15:28.140 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:28.140+0000 7f76c1e8a8c0 1 > prepared operation key=S43U13LYETS4 tag=KVWN13PZQE21 type=del size=1868889 2024-09-14T11:15:28.145 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:28.148+0000 7f76c1e8a8c0 1 < suggested update operation key=HS7T50JORDQJ tag=BDRKINATQLLM type=write size=424061 2024-09-14T11:15:28.148 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:28.148+0000 7f76c1e8a8c0 1 > prepared operation key=HS7T50JORDQJ tag=ECJF3DU2O1I8 type=del size=3889336 2024-09-14T11:15:28.150 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:28.152+0000 7f76c1e8a8c0 -1 < failed to complete operation key=HS7T50JORDQJ tag=RHJ60JCEC78X type=write size=753744: (22) Invalid argument 2024-09-14T11:15:28.155 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:28.156+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_Q5IY4J5FOD80.2~C6YSI2XS133E.0 size=252421 2024-09-14T11:15:28.155 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:28.156+0000 7f76c1e8a8c0 1 > prepared multipart upload key=Q5IY4J5FOD80 upload=C6YSI2XS133E tag=82H16096YG8K type=write size=1300997 2024-09-14T11:15:28.156 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:28.156+0000 7f76c1e8a8c0 1 < canceled part key=_multipart_XC8VWSHZOPFP.2~375DN1JI31X7.0 size=1048576 2024-09-14T11:15:28.158 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:28.160+0000 7f76c1e8a8c0 1 < completed part key=_multipart_XC8VWSHZOPFP.2~375DN1JI31X7.1 size=1048576 2024-09-14T11:15:28.160 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:28.164+0000 7f76c1e8a8c0 1 < completed part key=_multipart_XC8VWSHZOPFP.2~375DN1JI31X7.2 size=342326 2024-09-14T11:15:28.165 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:28.168+0000 7f76c1e8a8c0 1 < canceled multipart upload key=XC8VWSHZOPFP upload=375DN1JI31X7 tag=BR3J0D5U9Z06 type=write size=3488054 2024-09-14T11:15:28.168 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:28.172+0000 7f76c1e8a8c0 1 > prepared operation key=VI61O3K069BP tag=VJ1ML7LUBR0B type=del size=241688 2024-09-14T11:15:28.170 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:28.172+0000 7f76c1e8a8c0 1 < completed part key=_multipart_R5I9H7WAK7Z7.2~SIYR9VFJUZFU.0 size=1048576 2024-09-14T11:15:28.173 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:28.176+0000 7f76c1e8a8c0 1 < completed part key=_multipart_R5I9H7WAK7Z7.2~SIYR9VFJUZFU.1 size=1048576 2024-09-14T11:15:28.175 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:28.176+0000 7f76c1e8a8c0 1 < completed part key=_multipart_R5I9H7WAK7Z7.2~SIYR9VFJUZFU.2 size=816606 2024-09-14T11:15:28.179 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:28.180+0000 7f76c1e8a8c0 1 < completed multipart upload key=R5I9H7WAK7Z7 upload=SIYR9VFJUZFU tag=29D30X4JSYJK type=write size=3962334 2024-09-14T11:15:28.182 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:28.184+0000 7f76c1e8a8c0 1 > prepared operation key=8FFV9G6EQR8F tag=00RKQ42BK3A5 type=del size=3120645 2024-09-14T11:15:28.184 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:28.188+0000 7f76c1e8a8c0 1 < completed delete operation key=BOCIF4TL7X7J tag=PUEQJ0BWSHFK type=del 2024-09-14T11:15:28.187 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:28.188+0000 7f76c1e8a8c0 1 > prepared operation key=S43U13LYETS4 tag=NAPCYK06LV4L type=del size=2990484 2024-09-14T11:15:28.190 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:28.192+0000 7f76c1e8a8c0 1 < completed write operation key=W0MDRE9YO3UP tag=5MYL4U9HIRB7 type=write size=484158 2024-09-14T11:15:28.194 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:28.196+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_XC8VWSHZOPFP.2~WWX8XJSAQGBK.0 size=284630 2024-09-14T11:15:28.194 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:28.196+0000 7f76c1e8a8c0 1 > prepared multipart upload key=XC8VWSHZOPFP upload=WWX8XJSAQGBK tag=GRK4VI62FCDI type=write size=1333206 2024-09-14T11:15:28.197 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:28.200+0000 7f76c1e8a8c0 1 < completed part key=_multipart_LZ0YNFOVFYCL.2~TFBON6WZCU49.0 size=1048576 2024-09-14T11:15:28.199 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:28.200+0000 7f76c1e8a8c0 1 < completed part key=_multipart_LZ0YNFOVFYCL.2~TFBON6WZCU49.1 size=330750 2024-09-14T11:15:28.203 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:28.204+0000 7f76c1e8a8c0 1 < completed multipart upload key=LZ0YNFOVFYCL upload=TFBON6WZCU49 tag=TA5WG2TANAFQ type=write size=2427902 2024-09-14T11:15:28.206 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:28.208+0000 7f76c1e8a8c0 1 > prepared operation key=MEVTZ7OAD4CA tag=HWL9IQ1EXSFE type=del size=3585408 2024-09-14T11:15:28.206 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:28.208+0000 7f76c1e8a8c0 1 < canceled part key=_multipart_8PZOVFEYYSOG.2~B0WM9PAG6U16.0 size=1048576 2024-09-14T11:15:28.208 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:28.212+0000 7f76c1e8a8c0 1 < completed part key=_multipart_8PZOVFEYYSOG.2~B0WM9PAG6U16.1 size=1048576 2024-09-14T11:15:28.210 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:28.212+0000 7f76c1e8a8c0 1 < completed part key=_multipart_8PZOVFEYYSOG.2~B0WM9PAG6U16.2 size=434559 2024-09-14T11:15:28.215 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:28.216+0000 7f76c1e8a8c0 1 < canceled multipart upload key=8PZOVFEYYSOG upload=B0WM9PAG6U16 tag=YV948C714FHQ type=write size=3580287 2024-09-14T11:15:28.217 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:28.220+0000 7f76c1e8a8c0 1 > prepared operation key=F3KFS0P1WM7W tag=QF0LMHMRC3IV type=del size=1010804 2024-09-14T11:15:28.220 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:28.224+0000 7f76c1e8a8c0 1 < completed part key=_multipart_F3KFS0P1WM7W.2~P62C2GKARDSI.0 size=1048576 2024-09-14T11:15:28.222 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:28.224+0000 7f76c1e8a8c0 1 < completed part key=_multipart_F3KFS0P1WM7W.2~P62C2GKARDSI.1 size=384504 2024-09-14T11:15:28.227 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:28.228+0000 7f76c1e8a8c0 1 < completed multipart upload key=F3KFS0P1WM7W upload=P62C2GKARDSI tag=4FD7Y9DEMOJT type=write size=2481656 2024-09-14T11:15:28.232 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:28.236+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_K9W031V6BFJP.2~K6M6MBNKVOLB.0 size=1048576 2024-09-14T11:15:28.235 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:28.236+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_K9W031V6BFJP.2~K6M6MBNKVOLB.1 size=549064 2024-09-14T11:15:28.235 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:28.236+0000 7f76c1e8a8c0 1 > prepared multipart upload key=K9W031V6BFJP upload=K6M6MBNKVOLB tag=F7874K2PZ2L4 type=write size=2646216 2024-09-14T11:15:28.238 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:28.240+0000 7f76c1e8a8c0 1 < completed write operation key=6TIJR323NMOH tag=9QZ6Q0OE1JOG type=write size=30877 2024-09-14T11:15:28.243 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:28.244+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_8FFV9G6EQR8F.2~3V37RFSO6XVK.0 size=1048576 2024-09-14T11:15:28.245 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:28.248+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_8FFV9G6EQR8F.2~3V37RFSO6XVK.1 size=775222 2024-09-14T11:15:28.245 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:28.248+0000 7f76c1e8a8c0 1 > prepared multipart upload key=8FFV9G6EQR8F upload=3V37RFSO6XVK tag=OSCR6B9OLQOF type=write size=2872374 2024-09-14T11:15:28.248 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:28.252+0000 7f76c1e8a8c0 1 < completed delete operation key=1W5733SDHGDN tag=W8QEYHGAULJI type=del 2024-09-14T11:15:28.254 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:28.256+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_1W5733SDHGDN.2~G8VBLLTIP1K7.0 size=902569 2024-09-14T11:15:28.254 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:28.256+0000 7f76c1e8a8c0 1 > prepared multipart upload key=1W5733SDHGDN upload=G8VBLLTIP1K7 tag=EHCB1Z4S0GHB type=write size=1951145 2024-09-14T11:15:28.259 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:28.260+0000 7f76c1e8a8c0 1 < suggested update operation key=W0MDRE9YO3UP tag=120EDQGPXLVF type=del size=3714366 2024-09-14T11:15:28.265 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:28.268+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_85G6NT78HAWQ.2~4VH2WOX55K0P.0 size=1048576 2024-09-14T11:15:28.268 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:28.268+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_85G6NT78HAWQ.2~4VH2WOX55K0P.1 size=479388 2024-09-14T11:15:28.268 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:28.268+0000 7f76c1e8a8c0 1 > prepared multipart upload key=85G6NT78HAWQ upload=4VH2WOX55K0P tag=PV4XCZEVSDCG type=write size=2576540 2024-09-14T11:15:28.271 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:28.272+0000 7f76c1e8a8c0 1 < completed part key=_multipart_VI61O3K069BP.2~VITC0VKFKZ0S.0 size=1048576 2024-09-14T11:15:28.274 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:28.276+0000 7f76c1e8a8c0 1 < completed part key=_multipart_VI61O3K069BP.2~VITC0VKFKZ0S.1 size=271892 2024-09-14T11:15:28.279 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:28.280+0000 7f76c1e8a8c0 1 < completed multipart upload key=VI61O3K069BP upload=VITC0VKFKZ0S tag=PRWT5UNPHCDX type=write size=2369044 2024-09-14T11:15:28.282 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:28.284+0000 7f76c1e8a8c0 1 > prepared operation key=85G6NT78HAWQ tag=60JO9790FU6J type=del size=2348933 2024-09-14T11:15:28.286 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:28.288+0000 7f76c1e8a8c0 -1 < failed to complete operation key=W0MDRE9YO3UP tag=2O4UC2FMD35S type=write size=182947: (22) Invalid argument 2024-09-14T11:15:28.289 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:28.292+0000 7f76c1e8a8c0 1 > prepared operation key=1W5733SDHGDN tag=242ETT2QMQ0H type=write size=896899 2024-09-14T11:15:28.293 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:28.296+0000 7f76c1e8a8c0 1 < completed delete operation key=6TIJR323NMOH tag=ZHRAU1WRXDI1 type=del 2024-09-14T11:15:28.299 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:28.300+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_GZM0AQVHNCMM.2~JSE0NUZK802G.0 size=1048576 2024-09-14T11:15:28.302 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:28.304+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_GZM0AQVHNCMM.2~JSE0NUZK802G.1 size=1048576 2024-09-14T11:15:28.305 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:28.308+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_GZM0AQVHNCMM.2~JSE0NUZK802G.2 size=150127 2024-09-14T11:15:28.305 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:28.308+0000 7f76c1e8a8c0 1 > prepared multipart upload key=GZM0AQVHNCMM upload=JSE0NUZK802G tag=8LV16PJ3RY6H type=write size=3295855 2024-09-14T11:15:28.308 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:28.312+0000 7f76c1e8a8c0 1 < canceled operation key=S43U13LYETS4 tag=KVWN13PZQE21 type=del size=1868889 2024-09-14T11:15:28.311 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:28.312+0000 7f76c1e8a8c0 1 > prepared operation key=K9W031V6BFJP tag=1WIN0UAQK4QC type=del size=855849 2024-09-14T11:15:28.315 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:28.316+0000 7f76c1e8a8c0 1 < completed delete operation key=HS7T50JORDQJ tag=ECJF3DU2O1I8 type=del 2024-09-14T11:15:28.321 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:28.324+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_OUMUTEBQ1TD0.2~IZO4XJ0RXAJ0.0 size=1048576 2024-09-14T11:15:28.323 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:28.324+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_OUMUTEBQ1TD0.2~IZO4XJ0RXAJ0.1 size=1048576 2024-09-14T11:15:28.326 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:28.328+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_OUMUTEBQ1TD0.2~IZO4XJ0RXAJ0.2 size=673851 2024-09-14T11:15:28.326 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:28.328+0000 7f76c1e8a8c0 1 > prepared multipart upload key=OUMUTEBQ1TD0 upload=IZO4XJ0RXAJ0 tag=L5GYO3XG3E5P type=write size=3819579 2024-09-14T11:15:28.329 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:28.332+0000 7f76c1e8a8c0 1 < completed part key=_multipart_Q5IY4J5FOD80.2~C6YSI2XS133E.0 size=252421 2024-09-14T11:15:28.335 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:28.336+0000 7f76c1e8a8c0 1 < completed multipart upload key=Q5IY4J5FOD80 upload=C6YSI2XS133E tag=82H16096YG8K type=write size=1300997 2024-09-14T11:15:28.341 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:28.344+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_KS37ZO6MKAH9.2~9BRDVN0CT78W.0 size=758183 2024-09-14T11:15:28.341 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:28.344+0000 7f76c1e8a8c0 1 > prepared multipart upload key=KS37ZO6MKAH9 upload=9BRDVN0CT78W tag=9UKUYK9GXQE2 type=write size=1806759 2024-09-14T11:15:28.344 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:28.348+0000 7f76c1e8a8c0 1 < completed delete operation key=VI61O3K069BP tag=VJ1ML7LUBR0B type=del 2024-09-14T11:15:28.350 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:28.352+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_K2EEZLRK7MVO.2~9CPK8GJR9IPB.0 size=793520 2024-09-14T11:15:28.350 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:28.352+0000 7f76c1e8a8c0 1 > prepared multipart upload key=K2EEZLRK7MVO upload=9CPK8GJR9IPB tag=4ZI6CHOU4S1O type=write size=1842096 2024-09-14T11:15:28.353 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:28.356+0000 7f76c1e8a8c0 1 < canceled operation key=8FFV9G6EQR8F tag=00RKQ42BK3A5 type=del size=3120645 2024-09-14T11:15:28.359 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:28.360+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_W0MDRE9YO3UP.2~IFJKBXCD4BHH.0 size=937737 2024-09-14T11:15:28.359 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:28.360+0000 7f76c1e8a8c0 1 > prepared multipart upload key=W0MDRE9YO3UP upload=IFJKBXCD4BHH tag=JURTTMK3KO83 type=write size=1986313 2024-09-14T11:15:28.362 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:28.364+0000 7f76c1e8a8c0 1 < completed delete operation key=S43U13LYETS4 tag=NAPCYK06LV4L type=del 2024-09-14T11:15:28.365 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:28.368+0000 7f76c1e8a8c0 1 > prepared operation key=1W5733SDHGDN tag=0NX0LMQBZPG0 type=del size=1379689 2024-09-14T11:15:28.369 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:28.372+0000 7f76c1e8a8c0 1 < completed part key=_multipart_XC8VWSHZOPFP.2~WWX8XJSAQGBK.0 size=284630 2024-09-14T11:15:28.374 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:28.376+0000 7f76c1e8a8c0 1 < completed multipart upload key=XC8VWSHZOPFP upload=WWX8XJSAQGBK tag=GRK4VI62FCDI type=write size=1333206 2024-09-14T11:15:28.377 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:28.380+0000 7f76c1e8a8c0 1 > prepared operation key=OOUEM16XL80W tag=E3MEPH9HKLB6 type=del size=4064919 2024-09-14T11:15:28.380 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:28.384+0000 7f76c1e8a8c0 1 < completed delete operation key=MEVTZ7OAD4CA tag=HWL9IQ1EXSFE type=del 2024-09-14T11:15:28.383 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:28.384+0000 7f76c1e8a8c0 1 > prepared operation key=KS37ZO6MKAH9 tag=9AX3NKZI3SY8 type=del size=2231741 2024-09-14T11:15:28.386 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:28.388+0000 7f76c1e8a8c0 1 < completed delete operation key=F3KFS0P1WM7W tag=QF0LMHMRC3IV type=del 2024-09-14T11:15:28.392 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:28.396+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_TZO40K6J9877.2~H5Y3QN6P5QCG.0 size=1048576 2024-09-14T11:15:28.399 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:28.400+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_TZO40K6J9877.2~H5Y3QN6P5QCG.1 size=343622 2024-09-14T11:15:28.399 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:28.400+0000 7f76c1e8a8c0 1 > prepared multipart upload key=TZO40K6J9877 upload=H5Y3QN6P5QCG tag=GJTIKKG5VEE9 type=write size=2440774 2024-09-14T11:15:28.402 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:28.404+0000 7f76c1e8a8c0 1 < completed part key=_multipart_K9W031V6BFJP.2~K6M6MBNKVOLB.0 size=1048576 2024-09-14T11:15:28.404 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:28.408+0000 7f76c1e8a8c0 1 < completed part key=_multipart_K9W031V6BFJP.2~K6M6MBNKVOLB.1 size=549064 2024-09-14T11:15:28.409 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:28.412+0000 7f76c1e8a8c0 1 < completed multipart upload key=K9W031V6BFJP upload=K6M6MBNKVOLB tag=F7874K2PZ2L4 type=write size=2646216 2024-09-14T11:15:28.414 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:28.416+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_BOCIF4TL7X7J.2~3K4FJ9SQV3Q8.0 size=978879 2024-09-14T11:15:28.414 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:28.416+0000 7f76c1e8a8c0 1 > prepared multipart upload key=BOCIF4TL7X7J upload=3K4FJ9SQV3Q8 tag=N02P5DFN2L8E type=write size=2027455 2024-09-14T11:15:28.417 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:28.420+0000 7f76c1e8a8c0 1 < completed part key=_multipart_8FFV9G6EQR8F.2~3V37RFSO6XVK.0 size=1048576 2024-09-14T11:15:28.420 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:28.424+0000 7f76c1e8a8c0 1 < completed part key=_multipart_8FFV9G6EQR8F.2~3V37RFSO6XVK.1 size=775222 2024-09-14T11:15:28.426 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:28.428+0000 7f76c1e8a8c0 1 < completed multipart upload key=8FFV9G6EQR8F upload=3V37RFSO6XVK tag=OSCR6B9OLQOF type=write size=2872374 2024-09-14T11:15:28.431 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:28.432+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_HS7T50JORDQJ.2~4H99ZUMHDWV6.0 size=1048576 2024-09-14T11:15:28.433 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:28.436+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_HS7T50JORDQJ.2~4H99ZUMHDWV6.1 size=1048576 2024-09-14T11:15:28.435 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:28.436+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_HS7T50JORDQJ.2~4H99ZUMHDWV6.2 size=384647 2024-09-14T11:15:28.436 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:28.436+0000 7f76c1e8a8c0 1 > prepared multipart upload key=HS7T50JORDQJ upload=4H99ZUMHDWV6 tag=EAK7JP9AJL78 type=write size=3530375 2024-09-14T11:15:28.439 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:28.440+0000 7f76c1e8a8c0 1 < completed part key=_multipart_1W5733SDHGDN.2~G8VBLLTIP1K7.0 size=902569 2024-09-14T11:15:28.444 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:28.444+0000 7f76c1e8a8c0 1 < completed multipart upload key=1W5733SDHGDN upload=G8VBLLTIP1K7 tag=EHCB1Z4S0GHB type=write size=1951145 2024-09-14T11:15:28.449 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:28.452+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_8PZOVFEYYSOG.2~N755OH2WET0K.0 size=1048576 2024-09-14T11:15:28.451 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:28.452+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_8PZOVFEYYSOG.2~N755OH2WET0K.1 size=549609 2024-09-14T11:15:28.451 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:28.452+0000 7f76c1e8a8c0 1 > prepared multipart upload key=8PZOVFEYYSOG upload=N755OH2WET0K tag=O6H2SOPO1STT type=write size=2646761 2024-09-14T11:15:28.455 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:28.456+0000 7f76c1e8a8c0 1 < completed part key=_multipart_85G6NT78HAWQ.2~4VH2WOX55K0P.0 size=1048576 2024-09-14T11:15:28.457 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:28.460+0000 7f76c1e8a8c0 1 < completed part key=_multipart_85G6NT78HAWQ.2~4VH2WOX55K0P.1 size=479388 2024-09-14T11:15:28.463 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:28.464+0000 7f76c1e8a8c0 1 < completed multipart upload key=85G6NT78HAWQ upload=4VH2WOX55K0P tag=PV4XCZEVSDCG type=write size=2576540 2024-09-14T11:15:28.467 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:28.468+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_SHKU2PRNREKK.2~489XLAYUS735.0 size=967173 2024-09-14T11:15:28.468 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:28.468+0000 7f76c1e8a8c0 1 > prepared multipart upload key=SHKU2PRNREKK upload=489XLAYUS735 tag=KXZ9BDZ6XYO3 type=write size=2015749 2024-09-14T11:15:28.470 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:28.472+0000 7f76c1e8a8c0 1 < completed delete operation key=85G6NT78HAWQ tag=60JO9790FU6J type=del 2024-09-14T11:15:28.476 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:28.480+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_K2EEZLRK7MVO.2~X7RROT35CSPT.0 size=483637 2024-09-14T11:15:28.476 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:28.480+0000 7f76c1e8a8c0 1 > prepared multipart upload key=K2EEZLRK7MVO upload=X7RROT35CSPT tag=B4I5E6WK2DGT type=write size=1532213 2024-09-14T11:15:28.479 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:28.480+0000 7f76c1e8a8c0 1 < completed write operation key=1W5733SDHGDN tag=242ETT2QMQ0H type=write size=896899 2024-09-14T11:15:28.482 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:28.484+0000 7f76c1e8a8c0 1 > prepared operation key=K9W031V6BFJP tag=9FEKFP9KM8U7 type=write size=468920 2024-09-14T11:15:28.485 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:28.488+0000 7f76c1e8a8c0 1 < completed part key=_multipart_GZM0AQVHNCMM.2~JSE0NUZK802G.0 size=1048576 2024-09-14T11:15:28.488 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:28.492+0000 7f76c1e8a8c0 1 < completed part key=_multipart_GZM0AQVHNCMM.2~JSE0NUZK802G.1 size=1048576 2024-09-14T11:15:28.490 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:28.492+0000 7f76c1e8a8c0 1 < completed part key=_multipart_GZM0AQVHNCMM.2~JSE0NUZK802G.2 size=150127 2024-09-14T11:15:28.496 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:28.496+0000 7f76c1e8a8c0 1 < completed multipart upload key=GZM0AQVHNCMM upload=JSE0NUZK802G tag=8LV16PJ3RY6H type=write size=3295855 2024-09-14T11:15:28.501 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:28.504+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_HJ701768A6I7.2~5H656SW7PWA0.0 size=1048576 2024-09-14T11:15:28.503 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:28.504+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_HJ701768A6I7.2~5H656SW7PWA0.1 size=516006 2024-09-14T11:15:28.503 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:28.504+0000 7f76c1e8a8c0 1 > prepared multipart upload key=HJ701768A6I7 upload=5H656SW7PWA0 tag=0HRCGHKEA2OU type=write size=2613158 2024-09-14T11:15:28.507 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:28.508+0000 7f76c1e8a8c0 1 < completed delete operation key=K9W031V6BFJP tag=1WIN0UAQK4QC type=del 2024-09-14T11:15:28.512 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:28.512+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_S43U13LYETS4.2~936VM6W2DE62.0 size=1048576 2024-09-14T11:15:28.514 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:28.516+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_S43U13LYETS4.2~936VM6W2DE62.1 size=1048576 2024-09-14T11:15:28.516 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:28.520+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_S43U13LYETS4.2~936VM6W2DE62.2 size=769671 2024-09-14T11:15:28.516 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:28.520+0000 7f76c1e8a8c0 1 > prepared multipart upload key=S43U13LYETS4 upload=936VM6W2DE62 tag=H3F29DKQEUYS type=write size=3915399 2024-09-14T11:15:28.519 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:28.520+0000 7f76c1e8a8c0 1 < completed part key=_multipart_OUMUTEBQ1TD0.2~IZO4XJ0RXAJ0.0 size=1048576 2024-09-14T11:15:28.521 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:28.524+0000 7f76c1e8a8c0 1 < completed part key=_multipart_OUMUTEBQ1TD0.2~IZO4XJ0RXAJ0.1 size=1048576 2024-09-14T11:15:28.521 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:28.524+0000 7f76c1e8a8c0 1 < canceled part key=_multipart_OUMUTEBQ1TD0.2~IZO4XJ0RXAJ0.2 size=673851 2024-09-14T11:15:28.525 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:28.528+0000 7f76c1e8a8c0 1 < canceled multipart upload key=OUMUTEBQ1TD0 upload=IZO4XJ0RXAJ0 tag=L5GYO3XG3E5P type=write size=3819579 2024-09-14T11:15:28.528 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:28.528+0000 7f76c1e8a8c0 1 > prepared operation key=SHKU2PRNREKK tag=F9IW8LIIZWJW type=write size=69455 2024-09-14T11:15:28.531 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:28.532+0000 7f76c1e8a8c0 1 < completed part key=_multipart_KS37ZO6MKAH9.2~9BRDVN0CT78W.0 size=758183 2024-09-14T11:15:28.535 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:28.536+0000 7f76c1e8a8c0 1 < completed multipart upload key=KS37ZO6MKAH9 upload=9BRDVN0CT78W tag=9UKUYK9GXQE2 type=write size=1806759 2024-09-14T11:15:28.537 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:28.540+0000 7f76c1e8a8c0 1 > prepared operation key=HS7T50JORDQJ tag=5PNORSNACAV7 type=write size=912161 2024-09-14T11:15:28.540 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:28.544+0000 7f76c1e8a8c0 1 < completed part key=_multipart_K2EEZLRK7MVO.2~9CPK8GJR9IPB.0 size=793520 2024-09-14T11:15:28.544 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:28.548+0000 7f76c1e8a8c0 1 < completed multipart upload key=K2EEZLRK7MVO upload=9CPK8GJR9IPB tag=4ZI6CHOU4S1O type=write size=1842096 2024-09-14T11:15:28.547 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:28.548+0000 7f76c1e8a8c0 1 > prepared operation key=1W5733SDHGDN tag=71M4YDR2ZLWO type=del size=3625688 2024-09-14T11:15:28.550 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:28.552+0000 7f76c1e8a8c0 1 < completed part key=_multipart_W0MDRE9YO3UP.2~IFJKBXCD4BHH.0 size=937737 2024-09-14T11:15:28.554 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:28.556+0000 7f76c1e8a8c0 1 < completed multipart upload key=W0MDRE9YO3UP upload=IFJKBXCD4BHH tag=JURTTMK3KO83 type=write size=1986313 2024-09-14T11:15:28.557 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:28.560+0000 7f76c1e8a8c0 1 > prepared operation key=TZO40K6J9877 tag=1QHANGM2DQCU type=del size=3078081 2024-09-14T11:15:28.561 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:28.564+0000 7f76c1e8a8c0 1 < canceled operation key=1W5733SDHGDN tag=0NX0LMQBZPG0 type=del size=1379689 2024-09-14T11:15:28.563 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:28.564+0000 7f76c1e8a8c0 1 > prepared operation key=8FFV9G6EQR8F tag=4J6EBO0V07KT type=del size=899089 2024-09-14T11:15:28.566 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:28.568+0000 7f76c1e8a8c0 1 < completed delete operation key=OOUEM16XL80W tag=E3MEPH9HKLB6 type=del 2024-09-14T11:15:28.572 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:28.576+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_SHKU2PRNREKK.2~NCF6NT1AHW95.0 size=323815 2024-09-14T11:15:28.572 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:28.576+0000 7f76c1e8a8c0 1 > prepared multipart upload key=SHKU2PRNREKK upload=NCF6NT1AHW95 tag=L90KWCLKIZ4W type=write size=1372391 2024-09-14T11:15:28.575 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:28.576+0000 7f76c1e8a8c0 1 < completed delete operation key=KS37ZO6MKAH9 tag=9AX3NKZI3SY8 type=del 2024-09-14T11:15:28.579 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:28.580+0000 7f76c1e8a8c0 1 > prepared operation key=OOUEM16XL80W tag=BJX68LO9CNLR type=del size=1395 2024-09-14T11:15:28.582 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:28.584+0000 7f76c1e8a8c0 1 < completed part key=_multipart_TZO40K6J9877.2~H5Y3QN6P5QCG.0 size=1048576 2024-09-14T11:15:28.585 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:28.588+0000 7f76c1e8a8c0 1 < completed part key=_multipart_TZO40K6J9877.2~H5Y3QN6P5QCG.1 size=343622 2024-09-14T11:15:28.592 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:28.592+0000 7f76c1e8a8c0 1 < completed multipart upload key=TZO40K6J9877 upload=H5Y3QN6P5QCG tag=GJTIKKG5VEE9 type=write size=2440774 2024-09-14T11:15:28.598 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:28.600+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_KS37ZO6MKAH9.2~OX45SKVD8HRJ.0 size=589245 2024-09-14T11:15:28.598 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:28.600+0000 7f76c1e8a8c0 1 > prepared multipart upload key=KS37ZO6MKAH9 upload=OX45SKVD8HRJ tag=OFNS1UTOCARC type=write size=1637821 2024-09-14T11:15:28.598 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:28.600+0000 7f76c1e8a8c0 1 < canceled part key=_multipart_BOCIF4TL7X7J.2~3K4FJ9SQV3Q8.0 size=978879 2024-09-14T11:15:28.604 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:28.608+0000 7f76c1e8a8c0 1 < canceled multipart upload key=BOCIF4TL7X7J upload=3K4FJ9SQV3Q8 tag=N02P5DFN2L8E type=write size=2027455 2024-09-14T11:15:28.607 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:28.608+0000 7f76c1e8a8c0 1 > prepared operation key=OUMUTEBQ1TD0 tag=HISBN3ZOG90S type=write size=13072 2024-09-14T11:15:28.611 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:28.612+0000 7f76c1e8a8c0 1 < completed part key=_multipart_HS7T50JORDQJ.2~4H99ZUMHDWV6.0 size=1048576 2024-09-14T11:15:28.614 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:28.616+0000 7f76c1e8a8c0 1 < completed part key=_multipart_HS7T50JORDQJ.2~4H99ZUMHDWV6.1 size=1048576 2024-09-14T11:15:28.616 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:28.620+0000 7f76c1e8a8c0 1 < completed part key=_multipart_HS7T50JORDQJ.2~4H99ZUMHDWV6.2 size=384647 2024-09-14T11:15:28.623 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:28.624+0000 7f76c1e8a8c0 1 < completed multipart upload key=HS7T50JORDQJ upload=4H99ZUMHDWV6 tag=EAK7JP9AJL78 type=write size=3530375 2024-09-14T11:15:28.626 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:28.628+0000 7f76c1e8a8c0 1 > prepared operation key=W0MDRE9YO3UP tag=63ED1Z3UCN1Y type=del size=134124 2024-09-14T11:15:28.629 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:28.632+0000 7f76c1e8a8c0 1 < completed part key=_multipart_8PZOVFEYYSOG.2~N755OH2WET0K.0 size=1048576 2024-09-14T11:15:28.632 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:28.636+0000 7f76c1e8a8c0 1 < completed part key=_multipart_8PZOVFEYYSOG.2~N755OH2WET0K.1 size=549609 2024-09-14T11:15:28.638 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:28.640+0000 7f76c1e8a8c0 1 < completed multipart upload key=8PZOVFEYYSOG upload=N755OH2WET0K tag=O6H2SOPO1STT type=write size=2646761 2024-09-14T11:15:28.644 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:28.648+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_1W5733SDHGDN.2~T90FG0S4E15L.0 size=1048576 2024-09-14T11:15:28.647 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:28.648+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_1W5733SDHGDN.2~T90FG0S4E15L.1 size=1048576 2024-09-14T11:15:28.650 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:28.652+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_1W5733SDHGDN.2~T90FG0S4E15L.2 size=506256 2024-09-14T11:15:28.650 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:28.652+0000 7f76c1e8a8c0 1 > prepared multipart upload key=1W5733SDHGDN upload=T90FG0S4E15L tag=4FE9RWSQI20V type=write size=3651984 2024-09-14T11:15:28.653 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:28.656+0000 7f76c1e8a8c0 1 < completed part key=_multipart_SHKU2PRNREKK.2~489XLAYUS735.0 size=967173 2024-09-14T11:15:28.659 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:28.660+0000 7f76c1e8a8c0 1 < completed multipart upload key=SHKU2PRNREKK upload=489XLAYUS735 tag=KXZ9BDZ6XYO3 type=write size=2015749 2024-09-14T11:15:28.662 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:28.664+0000 7f76c1e8a8c0 1 > prepared operation key=H9CQV6L29SL5 tag=W907NQNNXF7P type=del size=2460598 2024-09-14T11:15:28.666 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:28.668+0000 7f76c1e8a8c0 1 < completed part key=_multipart_K2EEZLRK7MVO.2~X7RROT35CSPT.0 size=483637 2024-09-14T11:15:28.671 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:28.672+0000 7f76c1e8a8c0 1 < completed multipart upload key=K2EEZLRK7MVO upload=X7RROT35CSPT tag=B4I5E6WK2DGT type=write size=1532213 2024-09-14T11:15:28.675 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:28.676+0000 7f76c1e8a8c0 1 > prepared operation key=KS37ZO6MKAH9 tag=H6BD8JNUEU10 type=del size=2460626 2024-09-14T11:15:28.682 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:28.684+0000 7f76c1e8a8c0 1 < completed write operation key=K9W031V6BFJP tag=9FEKFP9KM8U7 type=write size=468920 2024-09-14T11:15:28.688 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:28.692+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_1W5733SDHGDN.2~HW3S080ZO0JU.0 size=1048576 2024-09-14T11:15:28.691 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:28.692+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_1W5733SDHGDN.2~HW3S080ZO0JU.1 size=1048576 2024-09-14T11:15:28.693 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:28.696+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_1W5733SDHGDN.2~HW3S080ZO0JU.2 size=981195 2024-09-14T11:15:28.694 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:28.696+0000 7f76c1e8a8c0 1 > prepared multipart upload key=1W5733SDHGDN upload=HW3S080ZO0JU tag=GGEK5K9KRN3B type=write size=4126923 2024-09-14T11:15:28.697 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:28.700+0000 7f76c1e8a8c0 1 < completed part key=_multipart_HJ701768A6I7.2~5H656SW7PWA0.0 size=1048576 2024-09-14T11:15:28.700 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:28.700+0000 7f76c1e8a8c0 1 < completed part key=_multipart_HJ701768A6I7.2~5H656SW7PWA0.1 size=516006 2024-09-14T11:15:28.705 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:28.708+0000 7f76c1e8a8c0 1 < completed multipart upload key=HJ701768A6I7 upload=5H656SW7PWA0 tag=0HRCGHKEA2OU type=write size=2613158 2024-09-14T11:15:28.711 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:28.712+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_LZ0YNFOVFYCL.2~1S4AODJ2G39C.0 size=137886 2024-09-14T11:15:28.711 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:28.712+0000 7f76c1e8a8c0 1 > prepared multipart upload key=LZ0YNFOVFYCL upload=1S4AODJ2G39C tag=Q6TK6MB4C5NB type=write size=1186462 2024-09-14T11:15:28.715 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:28.716+0000 7f76c1e8a8c0 1 < completed part key=_multipart_S43U13LYETS4.2~936VM6W2DE62.0 size=1048576 2024-09-14T11:15:28.715 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:28.716+0000 7f76c1e8a8c0 1 < canceled part key=_multipart_S43U13LYETS4.2~936VM6W2DE62.1 size=1048576 2024-09-14T11:15:28.715 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:28.716+0000 7f76c1e8a8c0 1 < canceled part key=_multipart_S43U13LYETS4.2~936VM6W2DE62.2 size=769671 2024-09-14T11:15:28.720 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:28.724+0000 7f76c1e8a8c0 1 < canceled multipart upload key=S43U13LYETS4 upload=936VM6W2DE62 tag=H3F29DKQEUYS type=write size=3915399 2024-09-14T11:15:28.723 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:28.724+0000 7f76c1e8a8c0 1 > prepared operation key=8FFV9G6EQR8F tag=KC0PCI797OMU type=del size=350520 2024-09-14T11:15:28.727 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:28.728+0000 7f76c1e8a8c0 1 < completed write operation key=SHKU2PRNREKK tag=F9IW8LIIZWJW type=write size=69455 2024-09-14T11:15:28.730 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:28.732+0000 7f76c1e8a8c0 1 > prepared operation key=TZO40K6J9877 tag=S9DBI5I91XEW type=del size=3372267 2024-09-14T11:15:28.733 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:28.736+0000 7f76c1e8a8c0 1 < completed write operation key=HS7T50JORDQJ tag=5PNORSNACAV7 type=write size=912161 2024-09-14T11:15:28.740 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:28.740+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_15FU4CEGC22Q.2~DG0BZXBSREDE.0 size=724903 2024-09-14T11:15:28.740 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:28.740+0000 7f76c1e8a8c0 1 > prepared multipart upload key=15FU4CEGC22Q upload=DG0BZXBSREDE tag=4EAWV4FWVEGF type=write size=1773479 2024-09-14T11:15:28.742 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:28.744+0000 7f76c1e8a8c0 1 < completed delete operation key=1W5733SDHGDN tag=71M4YDR2ZLWO type=del 2024-09-14T11:15:28.746 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:28.748+0000 7f76c1e8a8c0 1 > prepared operation key=OUMUTEBQ1TD0 tag=GVUBXOS9S3RC type=write size=354234 2024-09-14T11:15:28.749 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:28.752+0000 7f76c1e8a8c0 1 < completed delete operation key=TZO40K6J9877 tag=1QHANGM2DQCU type=del 2024-09-14T11:15:28.752 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:28.756+0000 7f76c1e8a8c0 1 > prepared operation key=CIRQT9IDJ5OJ tag=LDPBOJPTLN57 type=del size=1452108 2024-09-14T11:15:28.755 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:28.756+0000 7f76c1e8a8c0 1 < completed delete operation key=8FFV9G6EQR8F tag=4J6EBO0V07KT type=del 2024-09-14T11:15:28.758 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:28.760+0000 7f76c1e8a8c0 1 > prepared operation key=1K8ESNXU6WDF tag=VY5DRBNPZMT0 type=del size=3651978 2024-09-14T11:15:28.762 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:28.764+0000 7f76c1e8a8c0 1 < completed part key=_multipart_SHKU2PRNREKK.2~NCF6NT1AHW95.0 size=323815 2024-09-14T11:15:28.767 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:28.768+0000 7f76c1e8a8c0 1 < completed multipart upload key=SHKU2PRNREKK upload=NCF6NT1AHW95 tag=L90KWCLKIZ4W type=write size=1372391 2024-09-14T11:15:28.770 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:28.772+0000 7f76c1e8a8c0 1 > prepared operation key=VI61O3K069BP tag=S7TKYC84JVZN type=del size=3242239 2024-09-14T11:15:28.772 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:28.776+0000 7f76c1e8a8c0 1 < completed delete operation key=OOUEM16XL80W tag=BJX68LO9CNLR type=del 2024-09-14T11:15:28.775 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:28.776+0000 7f76c1e8a8c0 1 > prepared operation key=HJ701768A6I7 tag=7LSFR5QWV4DH type=del size=4084476 2024-09-14T11:15:28.779 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:28.780+0000 7f76c1e8a8c0 1 < completed part key=_multipart_KS37ZO6MKAH9.2~OX45SKVD8HRJ.0 size=589245 2024-09-14T11:15:28.784 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:28.784+0000 7f76c1e8a8c0 1 < completed multipart upload key=KS37ZO6MKAH9 upload=OX45SKVD8HRJ tag=OFNS1UTOCARC type=write size=1637821 2024-09-14T11:15:28.786 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:28.788+0000 7f76c1e8a8c0 1 > prepared operation key=6TIJR323NMOH tag=D5OMEUGLWDGJ type=del size=161345 2024-09-14T11:15:28.792 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:28.792+0000 7f76c1e8a8c0 1 < suggested remove operation key=OUMUTEBQ1TD0 tag=HISBN3ZOG90S type=write 2024-09-14T11:15:28.795 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:28.796+0000 7f76c1e8a8c0 1 > prepared operation key=K9W031V6BFJP tag=G1BRI7VAIZSA type=del size=2644107 2024-09-14T11:15:28.798 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:28.800+0000 7f76c1e8a8c0 1 < completed delete operation key=W0MDRE9YO3UP tag=63ED1Z3UCN1Y type=del 2024-09-14T11:15:28.803 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:28.804+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_15FU4CEGC22Q.2~2MG554RADDHH.0 size=976761 2024-09-14T11:15:28.803 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:28.804+0000 7f76c1e8a8c0 1 > prepared multipart upload key=15FU4CEGC22Q upload=2MG554RADDHH tag=E6F7WT1SPJMM type=write size=2025337 2024-09-14T11:15:28.806 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:28.808+0000 7f76c1e8a8c0 1 < completed part key=_multipart_1W5733SDHGDN.2~T90FG0S4E15L.0 size=1048576 2024-09-14T11:15:28.808 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:28.812+0000 7f76c1e8a8c0 1 < completed part key=_multipart_1W5733SDHGDN.2~T90FG0S4E15L.1 size=1048576 2024-09-14T11:15:28.811 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:28.812+0000 7f76c1e8a8c0 1 < completed part key=_multipart_1W5733SDHGDN.2~T90FG0S4E15L.2 size=506256 2024-09-14T11:15:28.815 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:28.816+0000 7f76c1e8a8c0 1 < completed multipart upload key=1W5733SDHGDN upload=T90FG0S4E15L tag=4FE9RWSQI20V type=write size=3651984 2024-09-14T11:15:28.821 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:28.824+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_HJ701768A6I7.2~QAYMRKGGZ9A6.0 size=1048576 2024-09-14T11:15:28.823 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:28.824+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_HJ701768A6I7.2~QAYMRKGGZ9A6.1 size=469915 2024-09-14T11:15:28.823 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:28.824+0000 7f76c1e8a8c0 1 > prepared multipart upload key=HJ701768A6I7 upload=QAYMRKGGZ9A6 tag=VZ8U21803I22 type=write size=2567067 2024-09-14T11:15:28.826 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:28.828+0000 7f76c1e8a8c0 1 < completed delete operation key=H9CQV6L29SL5 tag=W907NQNNXF7P type=del 2024-09-14T11:15:28.829 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:28.832+0000 7f76c1e8a8c0 1 > prepared operation key=OUMUTEBQ1TD0 tag=23UKMVR8MI0U type=del size=856567 2024-09-14T11:15:28.833 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:28.836+0000 7f76c1e8a8c0 1 < completed delete operation key=KS37ZO6MKAH9 tag=H6BD8JNUEU10 type=del 2024-09-14T11:15:28.836 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:28.840+0000 7f76c1e8a8c0 1 > prepared operation key=W0MDRE9YO3UP tag=9UKVFM1TPZL5 type=del size=3362342 2024-09-14T11:15:28.839 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:28.840+0000 7f76c1e8a8c0 1 < completed part key=_multipart_1W5733SDHGDN.2~HW3S080ZO0JU.0 size=1048576 2024-09-14T11:15:28.842 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:28.844+0000 7f76c1e8a8c0 1 < completed part key=_multipart_1W5733SDHGDN.2~HW3S080ZO0JU.1 size=1048576 2024-09-14T11:15:28.845 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:28.848+0000 7f76c1e8a8c0 1 < completed part key=_multipart_1W5733SDHGDN.2~HW3S080ZO0JU.2 size=981195 2024-09-14T11:15:28.852 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:28.856+0000 7f76c1e8a8c0 1 < completed multipart upload key=1W5733SDHGDN upload=HW3S080ZO0JU tag=GGEK5K9KRN3B type=write size=4126923 2024-09-14T11:15:28.856 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:28.860+0000 7f76c1e8a8c0 1 > prepared operation key=OOUEM16XL80W tag=KVY0XBL3WU7I type=del size=2508099 2024-09-14T11:15:28.859 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:28.860+0000 7f76c1e8a8c0 1 < completed part key=_multipart_LZ0YNFOVFYCL.2~1S4AODJ2G39C.0 size=137886 2024-09-14T11:15:28.865 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:28.868+0000 7f76c1e8a8c0 1 < completed multipart upload key=LZ0YNFOVFYCL upload=1S4AODJ2G39C tag=Q6TK6MB4C5NB type=write size=1186462 2024-09-14T11:15:28.869 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:28.872+0000 7f76c1e8a8c0 1 > prepared operation key=1W5733SDHGDN tag=X7RIFYKOW5HM type=del size=1883742 2024-09-14T11:15:28.872 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:28.876+0000 7f76c1e8a8c0 1 < completed delete operation key=8FFV9G6EQR8F tag=KC0PCI797OMU type=del 2024-09-14T11:15:28.875 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:28.876+0000 7f76c1e8a8c0 1 > prepared operation key=H9CQV6L29SL5 tag=KDR3L3BVDXMQ type=del size=27783 2024-09-14T11:15:28.882 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:28.884+0000 7f76c1e8a8c0 1 < suggested update operation key=TZO40K6J9877 tag=S9DBI5I91XEW type=del size=3372267 2024-09-14T11:15:28.886 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:28.888+0000 7f76c1e8a8c0 1 > prepared operation key=GZM0AQVHNCMM tag=4370M30EQ6UZ type=del size=2456432 2024-09-14T11:15:28.889 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:28.892+0000 7f76c1e8a8c0 1 < completed part key=_multipart_15FU4CEGC22Q.2~DG0BZXBSREDE.0 size=724903 2024-09-14T11:15:28.894 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:28.896+0000 7f76c1e8a8c0 1 < completed multipart upload key=15FU4CEGC22Q upload=DG0BZXBSREDE tag=4EAWV4FWVEGF type=write size=1773479 2024-09-14T11:15:28.898 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:28.900+0000 7f76c1e8a8c0 1 > prepared operation key=S43U13LYETS4 tag=IWRYLM7E38Y3 type=del size=2200201 2024-09-14T11:15:28.904 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:28.908+0000 7f76c1e8a8c0 1 < suggested remove operation key=OUMUTEBQ1TD0 tag=GVUBXOS9S3RC type=write 2024-09-14T11:15:28.908 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:28.912+0000 7f76c1e8a8c0 1 > prepared operation key=S43U13LYETS4 tag=2RHQZ4ML84BU type=del size=3881385 2024-09-14T11:15:28.912 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:28.912+0000 7f76c1e8a8c0 1 < completed delete operation key=CIRQT9IDJ5OJ tag=LDPBOJPTLN57 type=del 2024-09-14T11:15:28.915 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:28.916+0000 7f76c1e8a8c0 1 > prepared operation key=HJ701768A6I7 tag=3T6QIBP53HG5 type=del size=712647 2024-09-14T11:15:28.918 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:28.920+0000 7f76c1e8a8c0 1 < canceled operation key=1K8ESNXU6WDF tag=VY5DRBNPZMT0 type=del size=3651978 2024-09-14T11:15:28.922 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:28.924+0000 7f76c1e8a8c0 1 > prepared operation key=XC8VWSHZOPFP tag=U5DA7682J9AN type=del size=742060 2024-09-14T11:15:28.925 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:28.928+0000 7f76c1e8a8c0 1 < completed delete operation key=VI61O3K069BP tag=S7TKYC84JVZN type=del 2024-09-14T11:15:28.928 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:28.932+0000 7f76c1e8a8c0 1 > prepared operation key=15FU4CEGC22Q tag=W2Z856MDVCHR type=del size=120474 2024-09-14T11:15:28.932 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:28.936+0000 7f76c1e8a8c0 1 < completed delete operation key=HJ701768A6I7 tag=7LSFR5QWV4DH type=del 2024-09-14T11:15:28.936 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:28.940+0000 7f76c1e8a8c0 1 > prepared operation key=R5I9H7WAK7Z7 tag=SVH6WPXBX0FP type=write size=189338 2024-09-14T11:15:28.942 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:28.944+0000 7f76c1e8a8c0 1 < suggested remove operation key=6TIJR323NMOH tag=D5OMEUGLWDGJ type=del 2024-09-14T11:15:28.949 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:28.952+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_H9CQV6L29SL5.2~EJNQTZMRI3YA.0 size=524198 2024-09-14T11:15:28.949 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:28.952+0000 7f76c1e8a8c0 1 > prepared multipart upload key=H9CQV6L29SL5 upload=EJNQTZMRI3YA tag=0LOIFSNQHA3X type=write size=1572774 2024-09-14T11:15:28.952 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:28.956+0000 7f76c1e8a8c0 1 < completed delete operation key=K9W031V6BFJP tag=G1BRI7VAIZSA type=del 2024-09-14T11:15:28.956 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:28.956+0000 7f76c1e8a8c0 1 > prepared operation key=K2EEZLRK7MVO tag=JPQ2R7IXMG0V type=del size=237950 2024-09-14T11:15:28.959 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:28.960+0000 7f76c1e8a8c0 1 < completed part key=_multipart_15FU4CEGC22Q.2~2MG554RADDHH.0 size=976761 2024-09-14T11:15:28.965 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:28.968+0000 7f76c1e8a8c0 1 < completed multipart upload key=15FU4CEGC22Q upload=2MG554RADDHH tag=E6F7WT1SPJMM type=write size=2025337 2024-09-14T11:15:28.968 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:28.968+0000 7f76c1e8a8c0 1 > prepared operation key=MEVTZ7OAD4CA tag=2H5NH7V6EDPE type=del size=1104727 2024-09-14T11:15:28.971 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:28.972+0000 7f76c1e8a8c0 1 < completed part key=_multipart_HJ701768A6I7.2~QAYMRKGGZ9A6.0 size=1048576 2024-09-14T11:15:28.974 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:28.976+0000 7f76c1e8a8c0 1 < completed part key=_multipart_HJ701768A6I7.2~QAYMRKGGZ9A6.1 size=469915 2024-09-14T11:15:28.979 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:28.980+0000 7f76c1e8a8c0 1 < completed multipart upload key=HJ701768A6I7 upload=QAYMRKGGZ9A6 tag=VZ8U21803I22 type=write size=2567067 2024-09-14T11:15:28.982 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:28.984+0000 7f76c1e8a8c0 1 > prepared operation key=GAVZRU8ZLW7S tag=948LUS6PO8DQ type=del size=3284175 2024-09-14T11:15:28.985 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:28.988+0000 7f76c1e8a8c0 -1 < failed to complete operation key=OUMUTEBQ1TD0 tag=23UKMVR8MI0U type=del size=856567: (22) Invalid argument 2024-09-14T11:15:28.993 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:28.996+0000 7f76c1e8a8c0 1 > prepared operation key=SUNCRV0C1XYL tag=SB0WI2RJJ6NI type=del size=146213 2024-09-14T11:15:28.996 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:29.000+0000 7f76c1e8a8c0 1 < completed delete operation key=W0MDRE9YO3UP tag=9UKVFM1TPZL5 type=del 2024-09-14T11:15:29.001 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:29.004+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_KS37ZO6MKAH9.2~KZXV1SJ5NMEI.0 size=1048576 2024-09-14T11:15:29.004 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:29.004+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_KS37ZO6MKAH9.2~KZXV1SJ5NMEI.1 size=1048576 2024-09-14T11:15:29.006 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:29.008+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_KS37ZO6MKAH9.2~KZXV1SJ5NMEI.2 size=344659 2024-09-14T11:15:29.006 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:29.008+0000 7f76c1e8a8c0 1 > prepared multipart upload key=KS37ZO6MKAH9 upload=KZXV1SJ5NMEI tag=D80VHPNV025E type=write size=3490387 2024-09-14T11:15:29.009 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:29.012+0000 7f76c1e8a8c0 1 < canceled operation key=OOUEM16XL80W tag=KVY0XBL3WU7I type=del size=2508099 2024-09-14T11:15:29.014 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:29.016+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_6TIJR323NMOH.2~OOB3CMBM6U8X.0 size=1048576 2024-09-14T11:15:29.017 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:29.020+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_6TIJR323NMOH.2~OOB3CMBM6U8X.1 size=13966 2024-09-14T11:15:29.017 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:29.020+0000 7f76c1e8a8c0 1 > prepared multipart upload key=6TIJR323NMOH upload=OOB3CMBM6U8X tag=RIBO1N2FSA8B type=write size=2111118 2024-09-14T11:15:29.020 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:29.020+0000 7f76c1e8a8c0 1 < completed delete operation key=1W5733SDHGDN tag=X7RIFYKOW5HM type=del 2024-09-14T11:15:29.023 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:29.024+0000 7f76c1e8a8c0 1 > prepared operation key=GZM0AQVHNCMM tag=BCNP6ZZ0FO60 type=del size=2006480 2024-09-14T11:15:29.026 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:29.028+0000 7f76c1e8a8c0 1 < completed delete operation key=H9CQV6L29SL5 tag=KDR3L3BVDXMQ type=del 2024-09-14T11:15:29.029 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:29.032+0000 7f76c1e8a8c0 1 > prepared operation key=TZO40K6J9877 tag=5NV792E4WZQG type=del size=1168486 2024-09-14T11:15:29.032 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:29.036+0000 7f76c1e8a8c0 1 < canceled operation key=GZM0AQVHNCMM tag=4370M30EQ6UZ type=del size=2456432 2024-09-14T11:15:29.038 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:29.040+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_K9W031V6BFJP.2~W15KFMHZ1GES.0 size=1048576 2024-09-14T11:15:29.041 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:29.044+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_K9W031V6BFJP.2~W15KFMHZ1GES.1 size=1048576 2024-09-14T11:15:29.044 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:29.044+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_K9W031V6BFJP.2~W15KFMHZ1GES.2 size=604813 2024-09-14T11:15:29.044 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:29.044+0000 7f76c1e8a8c0 1 > prepared multipart upload key=K9W031V6BFJP upload=W15KFMHZ1GES tag=O5Y16WQZ2RD2 type=write size=3750541 2024-09-14T11:15:29.046 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:29.048+0000 7f76c1e8a8c0 1 < completed delete operation key=S43U13LYETS4 tag=IWRYLM7E38Y3 type=del 2024-09-14T11:15:29.050 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:29.052+0000 7f76c1e8a8c0 1 > prepared operation key=SHKU2PRNREKK tag=G4233SZNCTQZ type=del size=3720826 2024-09-14T11:15:29.052 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:29.056+0000 7f76c1e8a8c0 1 < completed delete operation key=S43U13LYETS4 tag=2RHQZ4ML84BU type=del 2024-09-14T11:15:29.055 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:29.056+0000 7f76c1e8a8c0 1 > prepared operation key=8PZOVFEYYSOG tag=AF0NXS953Q54 type=del size=1465895 2024-09-14T11:15:29.058 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:29.060+0000 7f76c1e8a8c0 1 < completed delete operation key=HJ701768A6I7 tag=3T6QIBP53HG5 type=del 2024-09-14T11:15:29.061 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:29.064+0000 7f76c1e8a8c0 1 > prepared operation key=F3KFS0P1WM7W tag=V04W1925USAH type=del size=4062295 2024-09-14T11:15:29.067 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:29.068+0000 7f76c1e8a8c0 1 < suggested remove operation key=XC8VWSHZOPFP tag=U5DA7682J9AN type=del 2024-09-14T11:15:29.070 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:29.072+0000 7f76c1e8a8c0 1 > prepared operation key=8FFV9G6EQR8F tag=GLLM478SF1VZ type=del size=2679444 2024-09-14T11:15:29.074 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:29.076+0000 7f76c1e8a8c0 1 < completed delete operation key=15FU4CEGC22Q tag=W2Z856MDVCHR type=del 2024-09-14T11:15:29.077 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:29.080+0000 7f76c1e8a8c0 1 > prepared operation key=H9CQV6L29SL5 tag=EBD6RYKL52GY type=del size=2171519 2024-09-14T11:15:29.080 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:29.084+0000 7f76c1e8a8c0 1 < completed write operation key=R5I9H7WAK7Z7 tag=SVH6WPXBX0FP type=write size=189338 2024-09-14T11:15:29.086 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:29.088+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_K2EEZLRK7MVO.2~8LED743Q8YWW.0 size=1048576 2024-09-14T11:15:29.088 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:29.092+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_K2EEZLRK7MVO.2~8LED743Q8YWW.1 size=1048576 2024-09-14T11:15:29.091 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:29.092+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_K2EEZLRK7MVO.2~8LED743Q8YWW.2 size=468813 2024-09-14T11:15:29.091 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:29.092+0000 7f76c1e8a8c0 1 > prepared multipart upload key=K2EEZLRK7MVO upload=8LED743Q8YWW tag=97CBAO8PNGYU type=write size=3614541 2024-09-14T11:15:29.095 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:29.096+0000 7f76c1e8a8c0 1 < completed part key=_multipart_H9CQV6L29SL5.2~EJNQTZMRI3YA.0 size=524198 2024-09-14T11:15:29.101 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:29.104+0000 7f76c1e8a8c0 1 < completed multipart upload key=H9CQV6L29SL5 upload=EJNQTZMRI3YA tag=0LOIFSNQHA3X type=write size=1572774 2024-09-14T11:15:29.103 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:29.104+0000 7f76c1e8a8c0 1 > prepared operation key=S43U13LYETS4 tag=8ZHQGISZUZ4Q type=del size=446352 2024-09-14T11:15:29.107 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:29.108+0000 7f76c1e8a8c0 1 < canceled operation key=K2EEZLRK7MVO tag=JPQ2R7IXMG0V type=del size=237950 2024-09-14T11:15:29.110 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:29.112+0000 7f76c1e8a8c0 1 > prepared operation key=XC8VWSHZOPFP tag=MD1CTUF1D2BL type=del size=3968319 2024-09-14T11:15:29.113 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:29.116+0000 7f76c1e8a8c0 1 < completed delete operation key=MEVTZ7OAD4CA tag=2H5NH7V6EDPE type=del 2024-09-14T11:15:29.116 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:29.120+0000 7f76c1e8a8c0 1 > prepared operation key=CIRQT9IDJ5OJ tag=WTLGYZ1N9USO type=del size=231593 2024-09-14T11:15:29.122 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:29.124+0000 7f76c1e8a8c0 1 < suggested remove operation key=GAVZRU8ZLW7S tag=948LUS6PO8DQ type=del 2024-09-14T11:15:29.126 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:29.128+0000 7f76c1e8a8c0 1 > prepared operation key=8PZOVFEYYSOG tag=2JI0UW08C0GV type=del size=3544962 2024-09-14T11:15:29.132 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:29.136+0000 7f76c1e8a8c0 1 < suggested remove operation key=SUNCRV0C1XYL tag=SB0WI2RJJ6NI type=del 2024-09-14T11:15:29.135 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:29.136+0000 7f76c1e8a8c0 1 > prepared operation key=R5I9H7WAK7Z7 tag=46CS72ZYCABW type=del size=84959 2024-09-14T11:15:29.138 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:29.140+0000 7f76c1e8a8c0 1 < completed part key=_multipart_KS37ZO6MKAH9.2~KZXV1SJ5NMEI.0 size=1048576 2024-09-14T11:15:29.141 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:29.144+0000 7f76c1e8a8c0 1 < completed part key=_multipart_KS37ZO6MKAH9.2~KZXV1SJ5NMEI.1 size=1048576 2024-09-14T11:15:29.143 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:29.144+0000 7f76c1e8a8c0 1 < completed part key=_multipart_KS37ZO6MKAH9.2~KZXV1SJ5NMEI.2 size=344659 2024-09-14T11:15:29.149 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:29.152+0000 7f76c1e8a8c0 1 < completed multipart upload key=KS37ZO6MKAH9 upload=KZXV1SJ5NMEI tag=D80VHPNV025E type=write size=3490387 2024-09-14T11:15:29.152 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:29.156+0000 7f76c1e8a8c0 1 > prepared operation key=K2EEZLRK7MVO tag=T1YB11MSAJ1C type=del size=4102432 2024-09-14T11:15:29.155 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:29.156+0000 7f76c1e8a8c0 1 < completed part key=_multipart_6TIJR323NMOH.2~OOB3CMBM6U8X.0 size=1048576 2024-09-14T11:15:29.158 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:29.160+0000 7f76c1e8a8c0 1 < completed part key=_multipart_6TIJR323NMOH.2~OOB3CMBM6U8X.1 size=13966 2024-09-14T11:15:29.164 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:29.168+0000 7f76c1e8a8c0 1 < completed multipart upload key=6TIJR323NMOH upload=OOB3CMBM6U8X tag=RIBO1N2FSA8B type=write size=2111118 2024-09-14T11:15:29.170 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:29.172+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_85G6NT78HAWQ.2~YIAMYTBJZLMK.0 size=1048576 2024-09-14T11:15:29.173 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:29.176+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_85G6NT78HAWQ.2~YIAMYTBJZLMK.1 size=1048576 2024-09-14T11:15:29.175 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:29.176+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_85G6NT78HAWQ.2~YIAMYTBJZLMK.2 size=343973 2024-09-14T11:15:29.175 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:29.176+0000 7f76c1e8a8c0 1 > prepared multipart upload key=85G6NT78HAWQ upload=YIAMYTBJZLMK tag=KM8T89OUYKFR type=write size=3489701 2024-09-14T11:15:29.182 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:29.184+0000 7f76c1e8a8c0 1 < suggested remove operation key=GZM0AQVHNCMM tag=BCNP6ZZ0FO60 type=del 2024-09-14T11:15:29.185 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:29.188+0000 7f76c1e8a8c0 1 > prepared operation key=OUMUTEBQ1TD0 tag=LW6D3IKH3ZS0 type=del size=3600984 2024-09-14T11:15:29.188 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:29.192+0000 7f76c1e8a8c0 1 < completed delete operation key=TZO40K6J9877 tag=5NV792E4WZQG type=del 2024-09-14T11:15:29.195 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:29.196+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_TZO40K6J9877.2~4ACR4Z2GK98C.0 size=1048576 2024-09-14T11:15:29.197 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:29.200+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_TZO40K6J9877.2~4ACR4Z2GK98C.1 size=978015 2024-09-14T11:15:29.197 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:29.200+0000 7f76c1e8a8c0 1 > prepared multipart upload key=TZO40K6J9877 upload=4ACR4Z2GK98C tag=LEFWTU1ZGTAZ type=write size=3075167 2024-09-14T11:15:29.200 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:29.204+0000 7f76c1e8a8c0 1 < completed part key=_multipart_K9W031V6BFJP.2~W15KFMHZ1GES.0 size=1048576 2024-09-14T11:15:29.203 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:29.204+0000 7f76c1e8a8c0 1 < completed part key=_multipart_K9W031V6BFJP.2~W15KFMHZ1GES.1 size=1048576 2024-09-14T11:15:29.205 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:29.208+0000 7f76c1e8a8c0 1 < completed part key=_multipart_K9W031V6BFJP.2~W15KFMHZ1GES.2 size=604813 2024-09-14T11:15:29.210 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:29.212+0000 7f76c1e8a8c0 1 < completed multipart upload key=K9W031V6BFJP upload=W15KFMHZ1GES tag=O5Y16WQZ2RD2 type=write size=3750541 2024-09-14T11:15:29.216 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:29.216+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_R5I9H7WAK7Z7.2~ODLXQYJKXGLL.0 size=1048576 2024-09-14T11:15:29.218 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:29.220+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_R5I9H7WAK7Z7.2~ODLXQYJKXGLL.1 size=791896 2024-09-14T11:15:29.218 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:29.220+0000 7f76c1e8a8c0 1 > prepared multipart upload key=R5I9H7WAK7Z7 upload=ODLXQYJKXGLL tag=I4O7BKWJA1TG type=write size=2889048 2024-09-14T11:15:29.221 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:29.224+0000 7f76c1e8a8c0 1 < canceled operation key=SHKU2PRNREKK tag=G4233SZNCTQZ type=del size=3720826 2024-09-14T11:15:29.227 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:29.228+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_KS37ZO6MKAH9.2~BCSODYY1AS5W.0 size=1048576 2024-09-14T11:15:29.230 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:29.232+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_KS37ZO6MKAH9.2~BCSODYY1AS5W.1 size=1048576 2024-09-14T11:15:29.232 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:29.236+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_KS37ZO6MKAH9.2~BCSODYY1AS5W.2 size=311107 2024-09-14T11:15:29.232 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:29.236+0000 7f76c1e8a8c0 1 > prepared multipart upload key=KS37ZO6MKAH9 upload=BCSODYY1AS5W tag=30P2I26PF4B7 type=write size=3456835 2024-09-14T11:15:29.235 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:29.236+0000 7f76c1e8a8c0 1 < completed delete operation key=8PZOVFEYYSOG tag=AF0NXS953Q54 type=del 2024-09-14T11:15:29.239 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:29.240+0000 7f76c1e8a8c0 1 > prepared operation key=VI61O3K069BP tag=4041GWBV88YC type=del size=878916 2024-09-14T11:15:29.242 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:29.244+0000 7f76c1e8a8c0 1 < canceled operation key=F3KFS0P1WM7W tag=V04W1925USAH type=del size=4062295 2024-09-14T11:15:29.245 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:29.248+0000 7f76c1e8a8c0 1 > prepared operation key=85G6NT78HAWQ tag=SM9H2O9J9LVR type=del size=1010932 2024-09-14T11:15:29.249 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:29.252+0000 7f76c1e8a8c0 1 < completed delete operation key=8FFV9G6EQR8F tag=GLLM478SF1VZ type=del 2024-09-14T11:15:29.255 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:29.256+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_TUFOZKTV9XIH.2~JEIHR21TWJZ6.0 size=1048576 2024-09-14T11:15:29.257 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:29.260+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_TUFOZKTV9XIH.2~JEIHR21TWJZ6.1 size=1048576 2024-09-14T11:15:29.260 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:29.264+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_TUFOZKTV9XIH.2~JEIHR21TWJZ6.2 size=61732 2024-09-14T11:15:29.260 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:29.264+0000 7f76c1e8a8c0 1 > prepared multipart upload key=TUFOZKTV9XIH upload=JEIHR21TWJZ6 tag=03YBAVBN05A9 type=write size=3207460 2024-09-14T11:15:29.264 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:29.264+0000 7f76c1e8a8c0 1 < completed delete operation key=H9CQV6L29SL5 tag=EBD6RYKL52GY type=del 2024-09-14T11:15:29.270 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:29.272+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_GAVZRU8ZLW7S.2~0OKJPRMNS092.0 size=1048576 2024-09-14T11:15:29.272 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:29.276+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_GAVZRU8ZLW7S.2~0OKJPRMNS092.1 size=1048576 2024-09-14T11:15:29.275 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:29.276+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_GAVZRU8ZLW7S.2~0OKJPRMNS092.2 size=840575 2024-09-14T11:15:29.275 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:29.276+0000 7f76c1e8a8c0 1 > prepared multipart upload key=GAVZRU8ZLW7S upload=0OKJPRMNS092 tag=8H1JXFU591L3 type=write size=3986303 2024-09-14T11:15:29.277 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:29.280+0000 7f76c1e8a8c0 1 < completed part key=_multipart_K2EEZLRK7MVO.2~8LED743Q8YWW.0 size=1048576 2024-09-14T11:15:29.280 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:29.284+0000 7f76c1e8a8c0 1 < completed part key=_multipart_K2EEZLRK7MVO.2~8LED743Q8YWW.1 size=1048576 2024-09-14T11:15:29.283 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:29.284+0000 7f76c1e8a8c0 1 < completed part key=_multipart_K2EEZLRK7MVO.2~8LED743Q8YWW.2 size=468813 2024-09-14T11:15:29.291 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:29.292+0000 7f76c1e8a8c0 1 < completed multipart upload key=K2EEZLRK7MVO upload=8LED743Q8YWW tag=97CBAO8PNGYU type=write size=3614541 2024-09-14T11:15:29.297 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:29.300+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_HS7T50JORDQJ.2~KQJH5H0J46ZG.0 size=1048576 2024-09-14T11:15:29.299 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:29.300+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_HS7T50JORDQJ.2~KQJH5H0J46ZG.1 size=1048576 2024-09-14T11:15:29.303 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:29.304+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_HS7T50JORDQJ.2~KQJH5H0J46ZG.2 size=4593 2024-09-14T11:15:29.303 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:29.304+0000 7f76c1e8a8c0 1 > prepared multipart upload key=HS7T50JORDQJ upload=KQJH5H0J46ZG tag=DD0K7IQFGQB3 type=write size=3150321 2024-09-14T11:15:29.307 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:29.308+0000 7f76c1e8a8c0 1 < completed delete operation key=S43U13LYETS4 tag=8ZHQGISZUZ4Q type=del 2024-09-14T11:15:29.311 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:29.312+0000 7f76c1e8a8c0 1 > prepared operation key=BOCIF4TL7X7J tag=UU5LQWM5VQD7 type=del size=1347409 2024-09-14T11:15:29.314 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:29.316+0000 7f76c1e8a8c0 1 < completed delete operation key=XC8VWSHZOPFP tag=MD1CTUF1D2BL type=del 2024-09-14T11:15:29.321 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:29.324+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_SHKU2PRNREKK.2~C8HZVU5N40BR.0 size=1048576 2024-09-14T11:15:29.324 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:29.328+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_SHKU2PRNREKK.2~C8HZVU5N40BR.1 size=1048576 2024-09-14T11:15:29.327 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:29.328+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_SHKU2PRNREKK.2~C8HZVU5N40BR.2 size=25485 2024-09-14T11:15:29.327 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:29.328+0000 7f76c1e8a8c0 1 > prepared multipart upload key=SHKU2PRNREKK upload=C8HZVU5N40BR tag=ENM6LA5L1IWP type=write size=3171213 2024-09-14T11:15:29.330 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:29.332+0000 7f76c1e8a8c0 1 < completed delete operation key=CIRQT9IDJ5OJ tag=WTLGYZ1N9USO type=del 2024-09-14T11:15:29.336 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:29.340+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_BOCIF4TL7X7J.2~EYXH2E4MN3YO.0 size=408524 2024-09-14T11:15:29.336 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:29.340+0000 7f76c1e8a8c0 1 > prepared multipart upload key=BOCIF4TL7X7J upload=EYXH2E4MN3YO tag=9VDH9O6FQZAY type=write size=1457100 2024-09-14T11:15:29.340 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:29.340+0000 7f76c1e8a8c0 1 < completed delete operation key=8PZOVFEYYSOG tag=2JI0UW08C0GV type=del 2024-09-14T11:15:29.343 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:29.344+0000 7f76c1e8a8c0 1 > prepared operation key=85G6NT78HAWQ tag=6TA7OFPWEKUL type=write size=956847 2024-09-14T11:15:29.346 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:29.348+0000 7f76c1e8a8c0 1 < completed delete operation key=R5I9H7WAK7Z7 tag=46CS72ZYCABW type=del 2024-09-14T11:15:29.352 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:29.352+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_8PZOVFEYYSOG.2~PAC7XN3I4SRM.0 size=1048576 2024-09-14T11:15:29.354 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:29.356+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_8PZOVFEYYSOG.2~PAC7XN3I4SRM.1 size=232926 2024-09-14T11:15:29.354 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:29.356+0000 7f76c1e8a8c0 1 > prepared multipart upload key=8PZOVFEYYSOG upload=PAC7XN3I4SRM tag=P5XNLK9CNP31 type=write size=2330078 2024-09-14T11:15:29.358 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:29.360+0000 7f76c1e8a8c0 1 < completed delete operation key=K2EEZLRK7MVO tag=T1YB11MSAJ1C type=del 2024-09-14T11:15:29.362 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:29.364+0000 7f76c1e8a8c0 1 > prepared operation key=GZM0AQVHNCMM tag=CVMTHLP4VS1R type=del size=1942867 2024-09-14T11:15:29.363 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:29.364+0000 7f76c1e8a8c0 1 < canceled part key=_multipart_85G6NT78HAWQ.2~YIAMYTBJZLMK.0 size=1048576 2024-09-14T11:15:29.366 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:29.368+0000 7f76c1e8a8c0 1 < completed part key=_multipart_85G6NT78HAWQ.2~YIAMYTBJZLMK.1 size=1048576 2024-09-14T11:15:29.369 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:29.372+0000 7f76c1e8a8c0 1 < completed part key=_multipart_85G6NT78HAWQ.2~YIAMYTBJZLMK.2 size=343973 2024-09-14T11:15:29.374 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:29.376+0000 7f76c1e8a8c0 1 < canceled multipart upload key=85G6NT78HAWQ upload=YIAMYTBJZLMK tag=KM8T89OUYKFR type=write size=3489701 2024-09-14T11:15:29.380 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:29.384+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_CIRQT9IDJ5OJ.2~SJ4SLFAW5Y9G.0 size=179030 2024-09-14T11:15:29.380 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:29.384+0000 7f76c1e8a8c0 1 > prepared multipart upload key=CIRQT9IDJ5OJ upload=SJ4SLFAW5Y9G tag=WMO62T7RW4N3 type=write size=1227606 2024-09-14T11:15:29.383 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:29.384+0000 7f76c1e8a8c0 1 < completed delete operation key=OUMUTEBQ1TD0 tag=LW6D3IKH3ZS0 type=del 2024-09-14T11:15:29.386 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:29.388+0000 7f76c1e8a8c0 1 > prepared operation key=MEVTZ7OAD4CA tag=G53SWEADAAZZ type=write size=838785 2024-09-14T11:15:29.390 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:29.392+0000 7f76c1e8a8c0 1 < completed part key=_multipart_TZO40K6J9877.2~4ACR4Z2GK98C.0 size=1048576 2024-09-14T11:15:29.392 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:29.396+0000 7f76c1e8a8c0 1 < completed part key=_multipart_TZO40K6J9877.2~4ACR4Z2GK98C.1 size=978015 2024-09-14T11:15:29.397 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:29.400+0000 7f76c1e8a8c0 1 < completed multipart upload key=TZO40K6J9877 upload=4ACR4Z2GK98C tag=LEFWTU1ZGTAZ type=write size=3075167 2024-09-14T11:15:29.401 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:29.404+0000 7f76c1e8a8c0 1 > prepared operation key=SUNCRV0C1XYL tag=MXGMIGVMIQ01 type=del size=3639936 2024-09-14T11:15:29.403 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:29.404+0000 7f76c1e8a8c0 1 < completed part key=_multipart_R5I9H7WAK7Z7.2~ODLXQYJKXGLL.0 size=1048576 2024-09-14T11:15:29.406 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:29.408+0000 7f76c1e8a8c0 1 < completed part key=_multipart_R5I9H7WAK7Z7.2~ODLXQYJKXGLL.1 size=791896 2024-09-14T11:15:29.410 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:29.412+0000 7f76c1e8a8c0 1 < completed multipart upload key=R5I9H7WAK7Z7 upload=ODLXQYJKXGLL tag=I4O7BKWJA1TG type=write size=2889048 2024-09-14T11:15:29.413 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:29.416+0000 7f76c1e8a8c0 1 > prepared operation key=8FFV9G6EQR8F tag=9YVV8QI1DPE2 type=del size=3044008 2024-09-14T11:15:29.416 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:29.416+0000 7f76c1e8a8c0 1 < completed part key=_multipart_KS37ZO6MKAH9.2~BCSODYY1AS5W.0 size=1048576 2024-09-14T11:15:29.418 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:29.420+0000 7f76c1e8a8c0 1 < completed part key=_multipart_KS37ZO6MKAH9.2~BCSODYY1AS5W.1 size=1048576 2024-09-14T11:15:29.420 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:29.424+0000 7f76c1e8a8c0 1 < completed part key=_multipart_KS37ZO6MKAH9.2~BCSODYY1AS5W.2 size=311107 2024-09-14T11:15:29.425 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:29.428+0000 7f76c1e8a8c0 1 < completed multipart upload key=KS37ZO6MKAH9 upload=BCSODYY1AS5W tag=30P2I26PF4B7 type=write size=3456835 2024-09-14T11:15:29.428 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:29.432+0000 7f76c1e8a8c0 1 > prepared operation key=Q5IY4J5FOD80 tag=JR70QGIP5GWR type=del size=596953 2024-09-14T11:15:29.431 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:29.432+0000 7f76c1e8a8c0 1 < completed delete operation key=VI61O3K069BP tag=4041GWBV88YC type=del 2024-09-14T11:15:29.434 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:29.436+0000 7f76c1e8a8c0 1 > prepared operation key=1W5733SDHGDN tag=RKCREI4SI7M0 type=del size=3460811 2024-09-14T11:15:29.437 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:29.440+0000 7f76c1e8a8c0 1 < completed delete operation key=85G6NT78HAWQ tag=SM9H2O9J9LVR type=del 2024-09-14T11:15:29.440 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:29.440+0000 7f76c1e8a8c0 1 > prepared operation key=85G6NT78HAWQ tag=KGY3MO1ODL93 type=del size=3340217 2024-09-14T11:15:29.443 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:29.444+0000 7f76c1e8a8c0 1 < completed part key=_multipart_TUFOZKTV9XIH.2~JEIHR21TWJZ6.0 size=1048576 2024-09-14T11:15:29.445 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:29.448+0000 7f76c1e8a8c0 1 < completed part key=_multipart_TUFOZKTV9XIH.2~JEIHR21TWJZ6.1 size=1048576 2024-09-14T11:15:29.447 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:29.448+0000 7f76c1e8a8c0 1 < completed part key=_multipart_TUFOZKTV9XIH.2~JEIHR21TWJZ6.2 size=61732 2024-09-14T11:15:29.452 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:29.456+0000 7f76c1e8a8c0 1 < completed multipart upload key=TUFOZKTV9XIH upload=JEIHR21TWJZ6 tag=03YBAVBN05A9 type=write size=3207460 2024-09-14T11:15:29.457 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:29.460+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_15FU4CEGC22Q.2~EEQEST39W1O9.0 size=798647 2024-09-14T11:15:29.457 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:29.460+0000 7f76c1e8a8c0 1 > prepared multipart upload key=15FU4CEGC22Q upload=EEQEST39W1O9 tag=70CCHWDD5G2U type=write size=1847223 2024-09-14T11:15:29.460 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:29.464+0000 7f76c1e8a8c0 1 < completed part key=_multipart_GAVZRU8ZLW7S.2~0OKJPRMNS092.0 size=1048576 2024-09-14T11:15:29.463 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:29.464+0000 7f76c1e8a8c0 1 < completed part key=_multipart_GAVZRU8ZLW7S.2~0OKJPRMNS092.1 size=1048576 2024-09-14T11:15:29.465 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:29.468+0000 7f76c1e8a8c0 1 < completed part key=_multipart_GAVZRU8ZLW7S.2~0OKJPRMNS092.2 size=840575 2024-09-14T11:15:29.470 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:29.472+0000 7f76c1e8a8c0 1 < completed multipart upload key=GAVZRU8ZLW7S upload=0OKJPRMNS092 tag=8H1JXFU591L3 type=write size=3986303 2024-09-14T11:15:29.472 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:29.476+0000 7f76c1e8a8c0 1 > prepared operation key=K2EEZLRK7MVO tag=7TZCOIT72P4I type=write size=727219 2024-09-14T11:15:29.475 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:29.476+0000 7f76c1e8a8c0 1 < completed part key=_multipart_HS7T50JORDQJ.2~KQJH5H0J46ZG.0 size=1048576 2024-09-14T11:15:29.478 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:29.480+0000 7f76c1e8a8c0 1 < completed part key=_multipart_HS7T50JORDQJ.2~KQJH5H0J46ZG.1 size=1048576 2024-09-14T11:15:29.480 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:29.484+0000 7f76c1e8a8c0 1 < completed part key=_multipart_HS7T50JORDQJ.2~KQJH5H0J46ZG.2 size=4593 2024-09-14T11:15:29.485 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:29.488+0000 7f76c1e8a8c0 1 < completed multipart upload key=HS7T50JORDQJ upload=KQJH5H0J46ZG tag=DD0K7IQFGQB3 type=write size=3150321 2024-09-14T11:15:29.489 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:29.492+0000 7f76c1e8a8c0 1 > prepared operation key=CIRQT9IDJ5OJ tag=53AJWSSFJ1YO type=write size=358033 2024-09-14T11:15:29.492 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:29.492+0000 7f76c1e8a8c0 1 < completed delete operation key=BOCIF4TL7X7J tag=UU5LQWM5VQD7 type=del 2024-09-14T11:15:29.498 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:29.500+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_1W5733SDHGDN.2~3HMKYJIK37MY.0 size=1048576 2024-09-14T11:15:29.500 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:29.504+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_1W5733SDHGDN.2~3HMKYJIK37MY.1 size=1048576 2024-09-14T11:15:29.503 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:29.504+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_1W5733SDHGDN.2~3HMKYJIK37MY.2 size=921545 2024-09-14T11:15:29.503 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:29.504+0000 7f76c1e8a8c0 1 > prepared multipart upload key=1W5733SDHGDN upload=3HMKYJIK37MY tag=UVNQDA7WZMPC type=write size=4067273 2024-09-14T11:15:29.506 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:29.508+0000 7f76c1e8a8c0 1 < completed part key=_multipart_SHKU2PRNREKK.2~C8HZVU5N40BR.0 size=1048576 2024-09-14T11:15:29.509 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:29.512+0000 7f76c1e8a8c0 1 < completed part key=_multipart_SHKU2PRNREKK.2~C8HZVU5N40BR.1 size=1048576 2024-09-14T11:15:29.511 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:29.512+0000 7f76c1e8a8c0 1 < completed part key=_multipart_SHKU2PRNREKK.2~C8HZVU5N40BR.2 size=25485 2024-09-14T11:15:29.517 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:29.520+0000 7f76c1e8a8c0 1 < completed multipart upload key=SHKU2PRNREKK upload=C8HZVU5N40BR tag=ENM6LA5L1IWP type=write size=3171213 2024-09-14T11:15:29.520 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:29.524+0000 7f76c1e8a8c0 1 > prepared operation key=TUFOZKTV9XIH tag=7EJQCX3CR69O type=del size=1173165 2024-09-14T11:15:29.523 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:29.524+0000 7f76c1e8a8c0 1 < completed part key=_multipart_BOCIF4TL7X7J.2~EYXH2E4MN3YO.0 size=408524 2024-09-14T11:15:29.529 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:29.532+0000 7f76c1e8a8c0 1 < completed multipart upload key=BOCIF4TL7X7J upload=EYXH2E4MN3YO tag=9VDH9O6FQZAY type=write size=1457100 2024-09-14T11:15:29.532 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:29.536+0000 7f76c1e8a8c0 1 > prepared operation key=GAVZRU8ZLW7S tag=MNV9OBHR6BBX type=write size=908693 2024-09-14T11:15:29.539 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:29.540+0000 7f76c1e8a8c0 1 < suggested update operation key=85G6NT78HAWQ tag=6TA7OFPWEKUL type=write size=956847 2024-09-14T11:15:29.542 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:29.544+0000 7f76c1e8a8c0 1 > prepared operation key=W0MDRE9YO3UP tag=YHL6B11T6VF6 type=del size=2501111 2024-09-14T11:15:29.545 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:29.548+0000 7f76c1e8a8c0 1 < completed part key=_multipart_8PZOVFEYYSOG.2~PAC7XN3I4SRM.0 size=1048576 2024-09-14T11:15:29.548 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:29.552+0000 7f76c1e8a8c0 1 < completed part key=_multipart_8PZOVFEYYSOG.2~PAC7XN3I4SRM.1 size=232926 2024-09-14T11:15:29.554 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:29.556+0000 7f76c1e8a8c0 1 < completed multipart upload key=8PZOVFEYYSOG upload=PAC7XN3I4SRM tag=P5XNLK9CNP31 type=write size=2330078 2024-09-14T11:15:29.557 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:29.560+0000 7f76c1e8a8c0 1 > prepared operation key=MEVTZ7OAD4CA tag=2CF38BYWBN86 type=del size=3564281 2024-09-14T11:15:29.560 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:29.564+0000 7f76c1e8a8c0 1 < completed delete operation key=GZM0AQVHNCMM tag=CVMTHLP4VS1R type=del 2024-09-14T11:15:29.566 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:29.568+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_HS7T50JORDQJ.2~FCYV3TPUB4AQ.0 size=1048576 2024-09-14T11:15:29.569 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:29.572+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_HS7T50JORDQJ.2~FCYV3TPUB4AQ.1 size=1048576 2024-09-14T11:15:29.572 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:29.572+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_HS7T50JORDQJ.2~FCYV3TPUB4AQ.2 size=812865 2024-09-14T11:15:29.572 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:29.572+0000 7f76c1e8a8c0 1 > prepared multipart upload key=HS7T50JORDQJ upload=FCYV3TPUB4AQ tag=2JL20YO9N9E2 type=write size=3958593 2024-09-14T11:15:29.575 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:29.576+0000 7f76c1e8a8c0 1 < completed part key=_multipart_CIRQT9IDJ5OJ.2~SJ4SLFAW5Y9G.0 size=179030 2024-09-14T11:15:29.585 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:29.588+0000 7f76c1e8a8c0 1 < completed multipart upload key=CIRQT9IDJ5OJ upload=SJ4SLFAW5Y9G tag=WMO62T7RW4N3 type=write size=1227606 2024-09-14T11:15:29.591 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:29.592+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_GZM0AQVHNCMM.2~CDL3HUOY7YDW.0 size=1048576 2024-09-14T11:15:29.594 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:29.596+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_GZM0AQVHNCMM.2~CDL3HUOY7YDW.1 size=324558 2024-09-14T11:15:29.594 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:29.596+0000 7f76c1e8a8c0 1 > prepared multipart upload key=GZM0AQVHNCMM upload=CDL3HUOY7YDW tag=IYWUWFVXZ0XM type=write size=2421710 2024-09-14T11:15:29.598 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:29.600+0000 7f76c1e8a8c0 1 < canceled operation key=MEVTZ7OAD4CA tag=G53SWEADAAZZ type=write size=838785 2024-09-14T11:15:29.604 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:29.608+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_KS37ZO6MKAH9.2~V7P5TFF2RKUW.0 size=1048576 2024-09-14T11:15:29.607 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:29.608+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_KS37ZO6MKAH9.2~V7P5TFF2RKUW.1 size=1048576 2024-09-14T11:15:29.610 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:29.612+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_KS37ZO6MKAH9.2~V7P5TFF2RKUW.2 size=738946 2024-09-14T11:15:29.610 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:29.612+0000 7f76c1e8a8c0 1 > prepared multipart upload key=KS37ZO6MKAH9 upload=V7P5TFF2RKUW tag=V7J9ZUR0OQI4 type=write size=3884674 2024-09-14T11:15:29.613 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:29.616+0000 7f76c1e8a8c0 1 < completed delete operation key=SUNCRV0C1XYL tag=MXGMIGVMIQ01 type=del 2024-09-14T11:15:29.616 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:29.620+0000 7f76c1e8a8c0 1 > prepared operation key=H9CQV6L29SL5 tag=D0AOZ1IZ337X type=del size=1144606 2024-09-14T11:15:29.620 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:29.620+0000 7f76c1e8a8c0 1 < completed delete operation key=8FFV9G6EQR8F tag=9YVV8QI1DPE2 type=del 2024-09-14T11:15:29.626 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:29.628+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_KS37ZO6MKAH9.2~DWV6TKP03PD6.0 size=1048576 2024-09-14T11:15:29.629 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:29.632+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_KS37ZO6MKAH9.2~DWV6TKP03PD6.1 size=1048576 2024-09-14T11:15:29.631 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:29.632+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_KS37ZO6MKAH9.2~DWV6TKP03PD6.2 size=850470 2024-09-14T11:15:29.631 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:29.632+0000 7f76c1e8a8c0 1 > prepared multipart upload key=KS37ZO6MKAH9 upload=DWV6TKP03PD6 tag=WKFAVWHVT4TB type=write size=3996198 2024-09-14T11:15:29.635 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:29.636+0000 7f76c1e8a8c0 1 < completed delete operation key=Q5IY4J5FOD80 tag=JR70QGIP5GWR type=del 2024-09-14T11:15:29.642 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:29.644+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_BOCIF4TL7X7J.2~R3AQ307N9CVW.0 size=1048576 2024-09-14T11:15:29.645 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:29.648+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_BOCIF4TL7X7J.2~R3AQ307N9CVW.1 size=307186 2024-09-14T11:15:29.645 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:29.648+0000 7f76c1e8a8c0 1 > prepared multipart upload key=BOCIF4TL7X7J upload=R3AQ307N9CVW tag=X8EEB62RFPXG type=write size=2404338 2024-09-14T11:15:29.649 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:29.652+0000 7f76c1e8a8c0 1 < completed delete operation key=1W5733SDHGDN tag=RKCREI4SI7M0 type=del 2024-09-14T11:15:29.652 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:29.656+0000 7f76c1e8a8c0 1 > prepared operation key=OOUEM16XL80W tag=20AHET0GPBJN type=del size=2797766 2024-09-14T11:15:29.656 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:29.660+0000 7f76c1e8a8c0 -1 < failed to complete operation key=85G6NT78HAWQ tag=KGY3MO1ODL93 type=del size=3340217: (22) Invalid argument 2024-09-14T11:15:29.660 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:29.660+0000 7f76c1e8a8c0 1 > prepared operation key=F3KFS0P1WM7W tag=4FUSH9LFE0F6 type=write size=25062 2024-09-14T11:15:29.664 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:29.664+0000 7f76c1e8a8c0 1 < completed part key=_multipart_15FU4CEGC22Q.2~EEQEST39W1O9.0 size=798647 2024-09-14T11:15:29.669 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:29.672+0000 7f76c1e8a8c0 1 < completed multipart upload key=15FU4CEGC22Q upload=EEQEST39W1O9 tag=70CCHWDD5G2U type=write size=1847223 2024-09-14T11:15:29.677 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:29.680+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_R5I9H7WAK7Z7.2~3534ENNFJS3C.0 size=1048576 2024-09-14T11:15:29.680 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:29.680+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_R5I9H7WAK7Z7.2~3534ENNFJS3C.1 size=291860 2024-09-14T11:15:29.680 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:29.680+0000 7f76c1e8a8c0 1 > prepared multipart upload key=R5I9H7WAK7Z7 upload=3534ENNFJS3C tag=67NIP0H3TYZK type=write size=2389012 2024-09-14T11:15:29.684 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:29.688+0000 7f76c1e8a8c0 1 < completed write operation key=K2EEZLRK7MVO tag=7TZCOIT72P4I type=write size=727219 2024-09-14T11:15:29.688 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:29.692+0000 7f76c1e8a8c0 1 > prepared operation key=LZ0YNFOVFYCL tag=BM5UT4VB1213 type=del size=3538454 2024-09-14T11:15:29.695 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:29.696+0000 7f76c1e8a8c0 1 < suggested remove operation key=CIRQT9IDJ5OJ tag=53AJWSSFJ1YO type=write 2024-09-14T11:15:29.702 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:29.704+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_6TIJR323NMOH.2~2R8O67MW845A.0 size=1048576 2024-09-14T11:15:29.704 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:29.708+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_6TIJR323NMOH.2~2R8O67MW845A.1 size=1048576 2024-09-14T11:15:29.707 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:29.708+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_6TIJR323NMOH.2~2R8O67MW845A.2 size=1024145 2024-09-14T11:15:29.707 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:29.708+0000 7f76c1e8a8c0 1 > prepared multipart upload key=6TIJR323NMOH upload=2R8O67MW845A tag=7DQIO8WDGORF type=write size=4169873 2024-09-14T11:15:29.711 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:29.712+0000 7f76c1e8a8c0 1 < completed part key=_multipart_1W5733SDHGDN.2~3HMKYJIK37MY.0 size=1048576 2024-09-14T11:15:29.713 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:29.716+0000 7f76c1e8a8c0 1 < completed part key=_multipart_1W5733SDHGDN.2~3HMKYJIK37MY.1 size=1048576 2024-09-14T11:15:29.716 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:29.720+0000 7f76c1e8a8c0 1 < completed part key=_multipart_1W5733SDHGDN.2~3HMKYJIK37MY.2 size=921545 2024-09-14T11:15:29.722 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:29.724+0000 7f76c1e8a8c0 1 < completed multipart upload key=1W5733SDHGDN upload=3HMKYJIK37MY tag=UVNQDA7WZMPC type=write size=4067273 2024-09-14T11:15:29.725 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:29.728+0000 7f76c1e8a8c0 1 > prepared operation key=TUFOZKTV9XIH tag=JU9W1ZQ9MEGY type=del size=2159191 2024-09-14T11:15:29.732 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:29.736+0000 7f76c1e8a8c0 1 < suggested update operation key=TUFOZKTV9XIH tag=7EJQCX3CR69O type=del size=1173165 2024-09-14T11:15:29.738 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:29.740+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_CIRQT9IDJ5OJ.2~JW47799UL2EB.0 size=85835 2024-09-14T11:15:29.738 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:29.740+0000 7f76c1e8a8c0 1 > prepared multipart upload key=CIRQT9IDJ5OJ upload=JW47799UL2EB tag=J5H6D8TCGUDL type=write size=1134411 2024-09-14T11:15:29.742 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:29.744+0000 7f76c1e8a8c0 1 < completed write operation key=GAVZRU8ZLW7S tag=MNV9OBHR6BBX type=write size=908693 2024-09-14T11:15:29.748 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:29.748+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_1W5733SDHGDN.2~M8HXUK9Y6VD3.0 size=266837 2024-09-14T11:15:29.748 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:29.748+0000 7f76c1e8a8c0 1 > prepared multipart upload key=1W5733SDHGDN upload=M8HXUK9Y6VD3 tag=LXAKAYVI061V type=write size=1315413 2024-09-14T11:15:29.751 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:29.752+0000 7f76c1e8a8c0 1 < completed delete operation key=W0MDRE9YO3UP tag=YHL6B11T6VF6 type=del 2024-09-14T11:15:29.756 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:29.760+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_LZ0YNFOVFYCL.2~USJYV3XL3TQU.0 size=212729 2024-09-14T11:15:29.756 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:29.760+0000 7f76c1e8a8c0 1 > prepared multipart upload key=LZ0YNFOVFYCL upload=USJYV3XL3TQU tag=3I6F9X3CJDFZ type=write size=1261305 2024-09-14T11:15:29.759 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:29.760+0000 7f76c1e8a8c0 1 < completed delete operation key=MEVTZ7OAD4CA tag=2CF38BYWBN86 type=del 2024-09-14T11:15:29.762 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:29.764+0000 7f76c1e8a8c0 1 > prepared operation key=HJ701768A6I7 tag=ET7GP4HUEQAD type=del size=1665105 2024-09-14T11:15:29.766 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:29.768+0000 7f76c1e8a8c0 1 < completed part key=_multipart_HS7T50JORDQJ.2~FCYV3TPUB4AQ.0 size=1048576 2024-09-14T11:15:29.768 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:29.768+0000 7f76c1e8a8c0 1 < completed part key=_multipart_HS7T50JORDQJ.2~FCYV3TPUB4AQ.1 size=1048576 2024-09-14T11:15:29.770 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:29.772+0000 7f76c1e8a8c0 1 < completed part key=_multipart_HS7T50JORDQJ.2~FCYV3TPUB4AQ.2 size=812865 2024-09-14T11:15:29.775 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:29.776+0000 7f76c1e8a8c0 1 < completed multipart upload key=HS7T50JORDQJ upload=FCYV3TPUB4AQ tag=2JL20YO9N9E2 type=write size=3958593 2024-09-14T11:15:29.779 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:29.780+0000 7f76c1e8a8c0 1 > prepared operation key=H9CQV6L29SL5 tag=05XX0QY44BUP type=del size=307208 2024-09-14T11:15:29.782 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:29.784+0000 7f76c1e8a8c0 1 < completed part key=_multipart_GZM0AQVHNCMM.2~CDL3HUOY7YDW.0 size=1048576 2024-09-14T11:15:29.785 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:29.788+0000 7f76c1e8a8c0 1 < completed part key=_multipart_GZM0AQVHNCMM.2~CDL3HUOY7YDW.1 size=324558 2024-09-14T11:15:29.791 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:29.792+0000 7f76c1e8a8c0 1 < completed multipart upload key=GZM0AQVHNCMM upload=CDL3HUOY7YDW tag=IYWUWFVXZ0XM type=write size=2421710 2024-09-14T11:15:29.797 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:29.800+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_8FFV9G6EQR8F.2~1B827302LHE1.0 size=1048576 2024-09-14T11:15:29.800 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:29.804+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_8FFV9G6EQR8F.2~1B827302LHE1.1 size=284994 2024-09-14T11:15:29.800 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:29.804+0000 7f76c1e8a8c0 1 > prepared multipart upload key=8FFV9G6EQR8F upload=1B827302LHE1 tag=Y6VVR3RYVWO4 type=write size=2382146 2024-09-14T11:15:29.804 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:29.804+0000 7f76c1e8a8c0 1 < completed part key=_multipart_KS37ZO6MKAH9.2~V7P5TFF2RKUW.0 size=1048576 2024-09-14T11:15:29.806 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:29.808+0000 7f76c1e8a8c0 1 < completed part key=_multipart_KS37ZO6MKAH9.2~V7P5TFF2RKUW.1 size=1048576 2024-09-14T11:15:29.810 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:29.812+0000 7f76c1e8a8c0 1 < completed part key=_multipart_KS37ZO6MKAH9.2~V7P5TFF2RKUW.2 size=738946 2024-09-14T11:15:29.815 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:29.816+0000 7f76c1e8a8c0 1 < completed multipart upload key=KS37ZO6MKAH9 upload=V7P5TFF2RKUW tag=V7J9ZUR0OQI4 type=write size=3884674 2024-09-14T11:15:29.821 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:29.824+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_8PZOVFEYYSOG.2~CK63FAJ01GUY.0 size=1048576 2024-09-14T11:15:29.824 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:29.828+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_8PZOVFEYYSOG.2~CK63FAJ01GUY.1 size=899577 2024-09-14T11:15:29.824 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:29.828+0000 7f76c1e8a8c0 1 > prepared multipart upload key=8PZOVFEYYSOG upload=CK63FAJ01GUY tag=JP1QXSJEC0WM type=write size=2996729 2024-09-14T11:15:29.827 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:29.828+0000 7f76c1e8a8c0 1 < completed delete operation key=H9CQV6L29SL5 tag=D0AOZ1IZ337X type=del 2024-09-14T11:15:29.834 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:29.836+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_1W5733SDHGDN.2~NDPHNQWVX54V.0 size=1048576 2024-09-14T11:15:29.837 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:29.840+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_1W5733SDHGDN.2~NDPHNQWVX54V.1 size=369246 2024-09-14T11:15:29.837 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:29.840+0000 7f76c1e8a8c0 1 > prepared multipart upload key=1W5733SDHGDN upload=NDPHNQWVX54V tag=JEEKOATJHGY3 type=write size=2466398 2024-09-14T11:15:29.841 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:29.844+0000 7f76c1e8a8c0 1 < completed part key=_multipart_KS37ZO6MKAH9.2~DWV6TKP03PD6.0 size=1048576 2024-09-14T11:15:29.844 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:29.844+0000 7f76c1e8a8c0 1 < completed part key=_multipart_KS37ZO6MKAH9.2~DWV6TKP03PD6.1 size=1048576 2024-09-14T11:15:29.846 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:29.848+0000 7f76c1e8a8c0 1 < completed part key=_multipart_KS37ZO6MKAH9.2~DWV6TKP03PD6.2 size=850470 2024-09-14T11:15:29.852 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:29.856+0000 7f76c1e8a8c0 1 < completed multipart upload key=KS37ZO6MKAH9 upload=DWV6TKP03PD6 tag=WKFAVWHVT4TB type=write size=3996198 2024-09-14T11:15:29.855 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:29.856+0000 7f76c1e8a8c0 1 > prepared operation key=6TIJR323NMOH tag=IWN4TIDTMZO2 type=del size=2693307 2024-09-14T11:15:29.859 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:29.860+0000 7f76c1e8a8c0 1 < completed part key=_multipart_BOCIF4TL7X7J.2~R3AQ307N9CVW.0 size=1048576 2024-09-14T11:15:29.862 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:29.864+0000 7f76c1e8a8c0 1 < completed part key=_multipart_BOCIF4TL7X7J.2~R3AQ307N9CVW.1 size=307186 2024-09-14T11:15:29.867 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:29.868+0000 7f76c1e8a8c0 1 < completed multipart upload key=BOCIF4TL7X7J upload=R3AQ307N9CVW tag=X8EEB62RFPXG type=write size=2404338 2024-09-14T11:15:29.871 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:29.872+0000 7f76c1e8a8c0 1 > prepared operation key=SHKU2PRNREKK tag=0PXTA045X8OR type=del size=2761748 2024-09-14T11:15:29.874 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:29.876+0000 7f76c1e8a8c0 1 < completed delete operation key=OOUEM16XL80W tag=20AHET0GPBJN type=del 2024-09-14T11:15:29.877 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:29.880+0000 7f76c1e8a8c0 1 > prepared operation key=15FU4CEGC22Q tag=KKO36X4X17SM type=del size=2444789 2024-09-14T11:15:29.881 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:29.884+0000 7f76c1e8a8c0 1 < completed write operation key=F3KFS0P1WM7W tag=4FUSH9LFE0F6 type=write size=25062 2024-09-14T11:15:29.884 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:29.888+0000 7f76c1e8a8c0 1 > prepared operation key=LZ0YNFOVFYCL tag=PS8HXN9CEMVZ type=del size=2177097 2024-09-14T11:15:29.887 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:29.888+0000 7f76c1e8a8c0 1 < completed part key=_multipart_R5I9H7WAK7Z7.2~3534ENNFJS3C.0 size=1048576 2024-09-14T11:15:29.890 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:29.892+0000 7f76c1e8a8c0 1 < completed part key=_multipart_R5I9H7WAK7Z7.2~3534ENNFJS3C.1 size=291860 2024-09-14T11:15:29.901 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:29.904+0000 7f76c1e8a8c0 1 < completed multipart upload key=R5I9H7WAK7Z7 upload=3534ENNFJS3C tag=67NIP0H3TYZK type=write size=2389012 2024-09-14T11:15:29.904 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:29.904+0000 7f76c1e8a8c0 1 > prepared operation key=GAVZRU8ZLW7S tag=9QNM7ZXGG5UO type=del size=3942395 2024-09-14T11:15:29.907 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:29.908+0000 7f76c1e8a8c0 1 < completed delete operation key=LZ0YNFOVFYCL tag=BM5UT4VB1213 type=del 2024-09-14T11:15:29.911 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:29.912+0000 7f76c1e8a8c0 1 > prepared operation key=GAVZRU8ZLW7S tag=J2QXXKDHWO1V type=del size=343132 2024-09-14T11:15:29.914 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:29.916+0000 7f76c1e8a8c0 1 < completed part key=_multipart_6TIJR323NMOH.2~2R8O67MW845A.0 size=1048576 2024-09-14T11:15:29.916 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:29.920+0000 7f76c1e8a8c0 1 < completed part key=_multipart_6TIJR323NMOH.2~2R8O67MW845A.1 size=1048576 2024-09-14T11:15:29.919 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:29.920+0000 7f76c1e8a8c0 1 < completed part key=_multipart_6TIJR323NMOH.2~2R8O67MW845A.2 size=1024145 2024-09-14T11:15:29.924 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:29.928+0000 7f76c1e8a8c0 1 < completed multipart upload key=6TIJR323NMOH upload=2R8O67MW845A tag=7DQIO8WDGORF type=write size=4169873 2024-09-14T11:15:29.927 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:29.928+0000 7f76c1e8a8c0 1 > prepared operation key=F3KFS0P1WM7W tag=GGN23MY9YOUF type=del size=1466644 2024-09-14T11:15:29.931 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:29.932+0000 7f76c1e8a8c0 -1 < failed to complete operation key=TUFOZKTV9XIH tag=JU9W1ZQ9MEGY type=del size=2159191: (22) Invalid argument 2024-09-14T11:15:29.937 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:29.940+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_OOUEM16XL80W.2~ROU34P9IP7RK.0 size=1048576 2024-09-14T11:15:29.939 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:29.940+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_OOUEM16XL80W.2~ROU34P9IP7RK.1 size=984692 2024-09-14T11:15:29.939 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:29.940+0000 7f76c1e8a8c0 1 > prepared multipart upload key=OOUEM16XL80W upload=ROU34P9IP7RK tag=0H11KYNGXPJ1 type=write size=3081844 2024-09-14T11:15:29.942 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:29.944+0000 7f76c1e8a8c0 1 < completed part key=_multipart_CIRQT9IDJ5OJ.2~JW47799UL2EB.0 size=85835 2024-09-14T11:15:29.947 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:29.948+0000 7f76c1e8a8c0 1 < completed multipart upload key=CIRQT9IDJ5OJ upload=JW47799UL2EB tag=J5H6D8TCGUDL type=write size=1134411 2024-09-14T11:15:29.952 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:29.956+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_CIRQT9IDJ5OJ.2~45BII4OMF1IG.0 size=1048576 2024-09-14T11:15:29.955 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:29.956+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_CIRQT9IDJ5OJ.2~45BII4OMF1IG.1 size=1048576 2024-09-14T11:15:29.957 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:29.960+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_CIRQT9IDJ5OJ.2~45BII4OMF1IG.2 size=656798 2024-09-14T11:15:29.957 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:29.960+0000 7f76c1e8a8c0 1 > prepared multipart upload key=CIRQT9IDJ5OJ upload=45BII4OMF1IG tag=IB08GACN8KCY type=write size=3802526 2024-09-14T11:15:29.961 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:29.964+0000 7f76c1e8a8c0 1 < completed part key=_multipart_1W5733SDHGDN.2~M8HXUK9Y6VD3.0 size=266837 2024-09-14T11:15:29.966 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:29.968+0000 7f76c1e8a8c0 1 < completed multipart upload key=1W5733SDHGDN upload=M8HXUK9Y6VD3 tag=LXAKAYVI061V type=write size=1315413 2024-09-14T11:15:29.969 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:29.972+0000 7f76c1e8a8c0 1 > prepared operation key=GZM0AQVHNCMM tag=OVNEU3Y2RLRH type=del size=3660180 2024-09-14T11:15:29.970 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:29.972+0000 7f76c1e8a8c0 1 < canceled part key=_multipart_LZ0YNFOVFYCL.2~USJYV3XL3TQU.0 size=212729 2024-09-14T11:15:29.975 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:29.976+0000 7f76c1e8a8c0 1 < canceled multipart upload key=LZ0YNFOVFYCL upload=USJYV3XL3TQU tag=3I6F9X3CJDFZ type=write size=1261305 2024-09-14T11:15:29.979 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:29.980+0000 7f76c1e8a8c0 1 > prepared operation key=TZO40K6J9877 tag=XN6G8EV3T1GN type=del size=3100180 2024-09-14T11:15:29.982 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:29.984+0000 7f76c1e8a8c0 1 < completed delete operation key=HJ701768A6I7 tag=ET7GP4HUEQAD type=del 2024-09-14T11:15:29.985 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:29.988+0000 7f76c1e8a8c0 1 > prepared operation key=GZM0AQVHNCMM tag=OLX79DIIJ3C1 type=del size=2154317 2024-09-14T11:15:29.988 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:29.992+0000 7f76c1e8a8c0 1 < completed delete operation key=H9CQV6L29SL5 tag=05XX0QY44BUP type=del 2024-09-14T11:15:29.991 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:29.992+0000 7f76c1e8a8c0 1 > prepared operation key=VI61O3K069BP tag=Q0AH8ROQP9CE type=del size=3652894 2024-09-14T11:15:29.995 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:29.996+0000 7f76c1e8a8c0 1 < completed part key=_multipart_8FFV9G6EQR8F.2~1B827302LHE1.0 size=1048576 2024-09-14T11:15:29.998 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:30.000+0000 7f76c1e8a8c0 1 < completed part key=_multipart_8FFV9G6EQR8F.2~1B827302LHE1.1 size=284994 2024-09-14T11:15:30.003 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:30.004+0000 7f76c1e8a8c0 1 < completed multipart upload key=8FFV9G6EQR8F upload=1B827302LHE1 tag=Y6VVR3RYVWO4 type=write size=2382146 2024-09-14T11:15:30.009 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:30.012+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_SHKU2PRNREKK.2~TXN43L0O505B.0 size=1048576 2024-09-14T11:15:30.011 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:30.012+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_SHKU2PRNREKK.2~TXN43L0O505B.1 size=1048576 2024-09-14T11:15:30.013 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:30.016+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_SHKU2PRNREKK.2~TXN43L0O505B.2 size=68259 2024-09-14T11:15:30.013 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:30.016+0000 7f76c1e8a8c0 1 > prepared multipart upload key=SHKU2PRNREKK upload=TXN43L0O505B tag=LT20GKE1SROP type=write size=3213987 2024-09-14T11:15:30.016 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:30.020+0000 7f76c1e8a8c0 1 < completed part key=_multipart_8PZOVFEYYSOG.2~CK63FAJ01GUY.0 size=1048576 2024-09-14T11:15:30.018 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:30.020+0000 7f76c1e8a8c0 1 < completed part key=_multipart_8PZOVFEYYSOG.2~CK63FAJ01GUY.1 size=899577 2024-09-14T11:15:30.023 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:30.024+0000 7f76c1e8a8c0 1 < completed multipart upload key=8PZOVFEYYSOG upload=CK63FAJ01GUY tag=JP1QXSJEC0WM type=write size=2996729 2024-09-14T11:15:30.029 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:30.032+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_KS37ZO6MKAH9.2~KFP35KVYLPAP.0 size=84656 2024-09-14T11:15:30.029 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:30.032+0000 7f76c1e8a8c0 1 > prepared multipart upload key=KS37ZO6MKAH9 upload=KFP35KVYLPAP tag=UE8EHCVSM35O type=write size=1133232 2024-09-14T11:15:30.031 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:30.032+0000 7f76c1e8a8c0 1 < completed part key=_multipart_1W5733SDHGDN.2~NDPHNQWVX54V.0 size=1048576 2024-09-14T11:15:30.033 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:30.036+0000 7f76c1e8a8c0 1 < completed part key=_multipart_1W5733SDHGDN.2~NDPHNQWVX54V.1 size=369246 2024-09-14T11:15:30.037 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:30.040+0000 7f76c1e8a8c0 1 < completed multipart upload key=1W5733SDHGDN upload=NDPHNQWVX54V tag=JEEKOATJHGY3 type=write size=2466398 2024-09-14T11:15:30.041 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:30.044+0000 7f76c1e8a8c0 1 > prepared operation key=BOCIF4TL7X7J tag=QGOQWUZFR487 type=write size=525151 2024-09-14T11:15:30.046 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:30.048+0000 7f76c1e8a8c0 1 < suggested remove operation key=6TIJR323NMOH tag=IWN4TIDTMZO2 type=del 2024-09-14T11:15:30.052 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:30.056+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_VI61O3K069BP.2~0ES5MIQQZ61M.0 size=966522 2024-09-14T11:15:30.052 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:30.056+0000 7f76c1e8a8c0 1 > prepared multipart upload key=VI61O3K069BP upload=0ES5MIQQZ61M tag=BYDJ821L16VL type=write size=2015098 2024-09-14T11:15:30.055 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:30.056+0000 7f76c1e8a8c0 1 < completed delete operation key=SHKU2PRNREKK tag=0PXTA045X8OR type=del 2024-09-14T11:15:30.058 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:30.060+0000 7f76c1e8a8c0 1 > prepared operation key=LZ0YNFOVFYCL tag=Q7C6FZFGJCYZ type=del size=87652 2024-09-14T11:15:30.061 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:30.064+0000 7f76c1e8a8c0 1 < completed delete operation key=15FU4CEGC22Q tag=KKO36X4X17SM type=del 2024-09-14T11:15:30.067 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:30.068+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_8FFV9G6EQR8F.2~6IPMR77OE6EF.0 size=1048576 2024-09-14T11:15:30.069 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:30.072+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_8FFV9G6EQR8F.2~6IPMR77OE6EF.1 size=1048576 2024-09-14T11:15:30.072 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:30.076+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_8FFV9G6EQR8F.2~6IPMR77OE6EF.2 size=468005 2024-09-14T11:15:30.072 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:30.076+0000 7f76c1e8a8c0 1 > prepared multipart upload key=8FFV9G6EQR8F upload=6IPMR77OE6EF tag=2SXE1HC3K0OZ type=write size=3613733 2024-09-14T11:15:30.075 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:30.076+0000 7f76c1e8a8c0 1 < completed delete operation key=LZ0YNFOVFYCL tag=PS8HXN9CEMVZ type=del 2024-09-14T11:15:30.079 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:30.080+0000 7f76c1e8a8c0 1 > prepared operation key=W0MDRE9YO3UP tag=DOMS7A1AHN2G type=write size=229641 2024-09-14T11:15:30.082 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:30.084+0000 7f76c1e8a8c0 1 < completed delete operation key=GAVZRU8ZLW7S tag=9QNM7ZXGG5UO type=del 2024-09-14T11:15:30.088 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:30.092+0000 7f76c1e8a8c0 1 > prepared part key=_multipart_K9W031V6BFJP.2~C507I3F6IC42.0 size=457383 2024-09-14T11:15:30.088 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:15:30.092+0000 7f76c1e8a8c0 1 > prepared multipart upload key=K9W031V6BFJP upload=C507I3F6IC42 tag=6RFBYQ13QBUW type=write size=1505959 2024-09-14T11:15:30.089 INFO:tasks.workunit.client.0.smithi138.stdout:[ OK ] cls_rgw_stats.simulate (22127 ms) 2024-09-14T11:15:30.089 INFO:tasks.workunit.client.0.smithi138.stdout:[----------] 1 test from cls_rgw_stats (22127 ms total) 2024-09-14T11:15:30.089 INFO:tasks.workunit.client.0.smithi138.stdout: 2024-09-14T11:15:30.089 INFO:tasks.workunit.client.0.smithi138.stdout:[----------] Global test environment tear-down 2024-09-14T11:15:30.962 INFO:tasks.workunit.client.0.smithi138.stdout:[==========] 1 test from 1 test suite ran. (24924 ms total) 2024-09-14T11:15:30.963 INFO:tasks.workunit.client.0.smithi138.stdout:[ PASSED ] 1 test. 2024-09-14T11:15:30.968 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-09-14T11:15:30.968 DEBUG:teuthology.orchestra.run.smithi138:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-09-14T11:15:31.025 INFO:tasks.workunit:Running workunits matching cls/test_cls_cmpomap.sh on client.0... 2024-09-14T11:15:31.026 INFO:tasks.workunit:Running workunit cls/test_cls_cmpomap.sh... 2024-09-14T11:15:31.026 DEBUG:teuthology.orchestra.run.smithi138:workunit test cls/test_cls_cmpomap.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=1c941a66c1b420259b8fc5ac19e792dbbf60aded TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/cls/test_cls_cmpomap.sh 2024-09-14T11:15:31.090 INFO:tasks.workunit.client.0.smithi138.stdout:Running main() from gmock_main.cc 2024-09-14T11:15:31.090 INFO:tasks.workunit.client.0.smithi138.stdout:[==========] Running 31 tests from 1 test suite. 2024-09-14T11:15:31.090 INFO:tasks.workunit.client.0.smithi138.stdout:[----------] Global test environment set-up. 2024-09-14T11:15:32.958 INFO:tasks.workunit.client.0.smithi138.stdout:[----------] 31 tests from CmpOmap 2024-09-14T11:15:32.958 INFO:tasks.workunit.client.0.smithi138.stdout:[ RUN ] CmpOmap.cmp_vals_noexist_str 2024-09-14T11:15:32.982 INFO:tasks.workunit.client.0.smithi138.stdout:[ OK ] CmpOmap.cmp_vals_noexist_str (24 ms) 2024-09-14T11:15:32.983 INFO:tasks.workunit.client.0.smithi138.stdout:[ RUN ] CmpOmap.cmp_vals_noexist_str_default 2024-09-14T11:15:33.009 INFO:tasks.workunit.client.0.smithi138.stdout:[ OK ] CmpOmap.cmp_vals_noexist_str_default (27 ms) 2024-09-14T11:15:33.009 INFO:tasks.workunit.client.0.smithi138.stdout:[ RUN ] CmpOmap.cmp_vals_noexist_u64 2024-09-14T11:15:33.015 INFO:tasks.workunit.client.0.smithi138.stdout:[ OK ] CmpOmap.cmp_vals_noexist_u64 (6 ms) 2024-09-14T11:15:33.015 INFO:tasks.workunit.client.0.smithi138.stdout:[ RUN ] CmpOmap.cmp_vals_noexist_u64_default 2024-09-14T11:15:33.022 INFO:tasks.workunit.client.0.smithi138.stdout:[ OK ] CmpOmap.cmp_vals_noexist_u64_default (7 ms) 2024-09-14T11:15:33.022 INFO:tasks.workunit.client.0.smithi138.stdout:[ RUN ] CmpOmap.cmp_vals_str 2024-09-14T11:15:33.037 INFO:tasks.workunit.client.0.smithi138.stdout:[ OK ] CmpOmap.cmp_vals_str (15 ms) 2024-09-14T11:15:33.037 INFO:tasks.workunit.client.0.smithi138.stdout:[ RUN ] CmpOmap.cmp_vals_u64 2024-09-14T11:15:33.051 INFO:tasks.workunit.client.0.smithi138.stdout:[ OK ] CmpOmap.cmp_vals_u64 (14 ms) 2024-09-14T11:15:33.051 INFO:tasks.workunit.client.0.smithi138.stdout:[ RUN ] CmpOmap.cmp_vals_u64_invalid_input 2024-09-14T11:15:33.058 INFO:tasks.workunit.client.0.smithi138.stdout:[ OK ] CmpOmap.cmp_vals_u64_invalid_input (6 ms) 2024-09-14T11:15:33.058 INFO:tasks.workunit.client.0.smithi138.stdout:[ RUN ] CmpOmap.cmp_vals_u64_invalid_default 2024-09-14T11:15:33.067 INFO:tasks.workunit.client.0.smithi138.stdout:[ OK ] CmpOmap.cmp_vals_u64_invalid_default (10 ms) 2024-09-14T11:15:33.067 INFO:tasks.workunit.client.0.smithi138.stdout:[ RUN ] CmpOmap.cmp_vals_u64_empty_default 2024-09-14T11:15:33.078 INFO:tasks.workunit.client.0.smithi138.stdout:[ OK ] CmpOmap.cmp_vals_u64_empty_default (10 ms) 2024-09-14T11:15:33.078 INFO:tasks.workunit.client.0.smithi138.stdout:[ RUN ] CmpOmap.cmp_vals_u64_invalid_value 2024-09-14T11:15:33.089 INFO:tasks.workunit.client.0.smithi138.stdout:[ OK ] CmpOmap.cmp_vals_u64_invalid_value (12 ms) 2024-09-14T11:15:33.089 INFO:tasks.workunit.client.0.smithi138.stdout:[ RUN ] CmpOmap.cmp_vals_at_max_keys 2024-09-14T11:15:33.091 INFO:tasks.workunit.client.0.smithi138.stdout:[ OK ] CmpOmap.cmp_vals_at_max_keys (2 ms) 2024-09-14T11:15:33.091 INFO:tasks.workunit.client.0.smithi138.stdout:[ RUN ] CmpOmap.cmp_vals_over_max_keys 2024-09-14T11:15:33.093 INFO:tasks.workunit.client.0.smithi138.stdout:[ OK ] CmpOmap.cmp_vals_over_max_keys (1 ms) 2024-09-14T11:15:33.093 INFO:tasks.workunit.client.0.smithi138.stdout:[ RUN ] CmpOmap.cmp_set_vals_noexist_str 2024-09-14T11:15:33.111 INFO:tasks.workunit.client.0.smithi138.stdout:[ OK ] CmpOmap.cmp_set_vals_noexist_str (18 ms) 2024-09-14T11:15:33.111 INFO:tasks.workunit.client.0.smithi138.stdout:[ RUN ] CmpOmap.cmp_set_vals_noexist_str_default 2024-09-14T11:15:33.128 INFO:tasks.workunit.client.0.smithi138.stdout:[ OK ] CmpOmap.cmp_set_vals_noexist_str_default (18 ms) 2024-09-14T11:15:33.128 INFO:tasks.workunit.client.0.smithi138.stdout:[ RUN ] CmpOmap.cmp_set_vals_noexist_u64 2024-09-14T11:15:33.145 INFO:tasks.workunit.client.0.smithi138.stdout:[ OK ] CmpOmap.cmp_set_vals_noexist_u64 (17 ms) 2024-09-14T11:15:33.145 INFO:tasks.workunit.client.0.smithi138.stdout:[ RUN ] CmpOmap.cmp_set_vals_noexist_u64_default 2024-09-14T11:15:33.161 INFO:tasks.workunit.client.0.smithi138.stdout:[ OK ] CmpOmap.cmp_set_vals_noexist_u64_default (16 ms) 2024-09-14T11:15:33.161 INFO:tasks.workunit.client.0.smithi138.stdout:[ RUN ] CmpOmap.cmp_set_vals_str 2024-09-14T11:15:33.181 INFO:tasks.workunit.client.0.smithi138.stdout:[ OK ] CmpOmap.cmp_set_vals_str (19 ms) 2024-09-14T11:15:33.181 INFO:tasks.workunit.client.0.smithi138.stdout:[ RUN ] CmpOmap.cmp_set_vals_u64 2024-09-14T11:15:33.202 INFO:tasks.workunit.client.0.smithi138.stdout:[ OK ] CmpOmap.cmp_set_vals_u64 (21 ms) 2024-09-14T11:15:33.202 INFO:tasks.workunit.client.0.smithi138.stdout:[ RUN ] CmpOmap.cmp_set_vals_u64_einval 2024-09-14T11:15:33.210 INFO:tasks.workunit.client.0.smithi138.stdout:[ OK ] CmpOmap.cmp_set_vals_u64_einval (8 ms) 2024-09-14T11:15:33.210 INFO:tasks.workunit.client.0.smithi138.stdout:[ RUN ] CmpOmap.cmp_set_vals_u64_eio 2024-09-14T11:15:33.216 INFO:tasks.workunit.client.0.smithi138.stdout:[ OK ] CmpOmap.cmp_set_vals_u64_eio (7 ms) 2024-09-14T11:15:33.216 INFO:tasks.workunit.client.0.smithi138.stdout:[ RUN ] CmpOmap.cmp_set_vals_at_max_keys 2024-09-14T11:15:33.219 INFO:tasks.workunit.client.0.smithi138.stdout:[ OK ] CmpOmap.cmp_set_vals_at_max_keys (3 ms) 2024-09-14T11:15:33.219 INFO:tasks.workunit.client.0.smithi138.stdout:[ RUN ] CmpOmap.cmp_set_vals_over_max_keys 2024-09-14T11:15:33.221 INFO:tasks.workunit.client.0.smithi138.stdout:[ OK ] CmpOmap.cmp_set_vals_over_max_keys (2 ms) 2024-09-14T11:15:33.221 INFO:tasks.workunit.client.0.smithi138.stdout:[ RUN ] CmpOmap.cmp_rm_keys_noexist_str 2024-09-14T11:15:33.237 INFO:tasks.workunit.client.0.smithi138.stdout:[ OK ] CmpOmap.cmp_rm_keys_noexist_str (16 ms) 2024-09-14T11:15:33.238 INFO:tasks.workunit.client.0.smithi138.stdout:[ RUN ] CmpOmap.cmp_rm_keys_noexist_u64 2024-09-14T11:15:33.254 INFO:tasks.workunit.client.0.smithi138.stdout:[ OK ] CmpOmap.cmp_rm_keys_noexist_u64 (16 ms) 2024-09-14T11:15:33.254 INFO:tasks.workunit.client.0.smithi138.stdout:[ RUN ] CmpOmap.cmp_rm_keys_str 2024-09-14T11:15:33.273 INFO:tasks.workunit.client.0.smithi138.stdout:[ OK ] CmpOmap.cmp_rm_keys_str (19 ms) 2024-09-14T11:15:33.273 INFO:tasks.workunit.client.0.smithi138.stdout:[ RUN ] CmpOmap.cmp_rm_keys_u64 2024-09-14T11:15:33.293 INFO:tasks.workunit.client.0.smithi138.stdout:[ OK ] CmpOmap.cmp_rm_keys_u64 (21 ms) 2024-09-14T11:15:33.293 INFO:tasks.workunit.client.0.smithi138.stdout:[ RUN ] CmpOmap.cmp_rm_keys_u64_einval 2024-09-14T11:15:33.299 INFO:tasks.workunit.client.0.smithi138.stdout:[ OK ] CmpOmap.cmp_rm_keys_u64_einval (6 ms) 2024-09-14T11:15:33.299 INFO:tasks.workunit.client.0.smithi138.stdout:[ RUN ] CmpOmap.cmp_rm_keys_u64_eio 2024-09-14T11:15:33.307 INFO:tasks.workunit.client.0.smithi138.stdout:[ OK ] CmpOmap.cmp_rm_keys_u64_eio (7 ms) 2024-09-14T11:15:33.307 INFO:tasks.workunit.client.0.smithi138.stdout:[ RUN ] CmpOmap.cmp_rm_keys_at_max_keys 2024-09-14T11:15:33.309 INFO:tasks.workunit.client.0.smithi138.stdout:[ OK ] CmpOmap.cmp_rm_keys_at_max_keys (3 ms) 2024-09-14T11:15:33.309 INFO:tasks.workunit.client.0.smithi138.stdout:[ RUN ] CmpOmap.cmp_rm_keys_over_max_keys 2024-09-14T11:15:33.312 INFO:tasks.workunit.client.0.smithi138.stdout:[ OK ] CmpOmap.cmp_rm_keys_over_max_keys (2 ms) 2024-09-14T11:15:33.312 INFO:tasks.workunit.client.0.smithi138.stdout:[ RUN ] CmpOmap.cmp_rm_keys_u64_empty 2024-09-14T11:15:33.330 INFO:tasks.workunit.client.0.smithi138.stdout:[ OK ] CmpOmap.cmp_rm_keys_u64_empty (19 ms) 2024-09-14T11:15:33.331 INFO:tasks.workunit.client.0.smithi138.stdout:[----------] 31 tests from CmpOmap (372 ms total) 2024-09-14T11:15:33.331 INFO:tasks.workunit.client.0.smithi138.stdout: 2024-09-14T11:15:33.331 INFO:tasks.workunit.client.0.smithi138.stdout:[----------] Global test environment tear-down 2024-09-14T11:15:33.977 INFO:tasks.workunit.client.0.smithi138.stdout:[==========] 31 tests from 1 test suite ran. (2887 ms total) 2024-09-14T11:15:33.977 INFO:tasks.workunit.client.0.smithi138.stdout:[ PASSED ] 31 tests. 2024-09-14T11:15:33.984 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-09-14T11:15:33.984 DEBUG:teuthology.orchestra.run.smithi138:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-09-14T11:15:34.042 INFO:tasks.workunit:Running workunits matching cls/test_cls_2pc_queue.sh on client.0... 2024-09-14T11:15:34.043 INFO:tasks.workunit:Running workunit cls/test_cls_2pc_queue.sh... 2024-09-14T11:15:34.043 DEBUG:teuthology.orchestra.run.smithi138:workunit test cls/test_cls_2pc_queue.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=1c941a66c1b420259b8fc5ac19e792dbbf60aded TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/cls/test_cls_2pc_queue.sh 2024-09-14T11:15:34.107 INFO:tasks.workunit.client.0.smithi138.stdout:Running main() from gmock_main.cc 2024-09-14T11:15:34.108 INFO:tasks.workunit.client.0.smithi138.stdout:[==========] Running 24 tests from 1 test suite. 2024-09-14T11:15:34.108 INFO:tasks.workunit.client.0.smithi138.stdout:[----------] Global test environment set-up. 2024-09-14T11:15:34.108 INFO:tasks.workunit.client.0.smithi138.stdout:[----------] 24 tests from TestCls2PCQueue 2024-09-14T11:15:34.108 INFO:tasks.workunit.client.0.smithi138.stdout:[ RUN ] TestCls2PCQueue.GetCapacity 2024-09-14T11:15:37.011 INFO:tasks.workunit.client.0.smithi138.stdout:[ OK ] TestCls2PCQueue.GetCapacity (2904 ms) 2024-09-14T11:15:37.011 INFO:tasks.workunit.client.0.smithi138.stdout:[ RUN ] TestCls2PCQueue.AsyncGetCapacity 2024-09-14T11:15:40.060 INFO:tasks.workunit.client.0.smithi138.stdout:[ OK ] TestCls2PCQueue.AsyncGetCapacity (3050 ms) 2024-09-14T11:15:40.060 INFO:tasks.workunit.client.0.smithi138.stdout:[ RUN ] TestCls2PCQueue.Reserve 2024-09-14T11:15:43.085 INFO:tasks.workunit.client.0.smithi138.stdout:[ OK ] TestCls2PCQueue.Reserve (3024 ms) 2024-09-14T11:15:43.085 INFO:tasks.workunit.client.0.smithi138.stdout:[ RUN ] TestCls2PCQueue.AsyncReserve 2024-09-14T11:15:46.140 INFO:tasks.workunit.client.0.smithi138.stdout:[ OK ] TestCls2PCQueue.AsyncReserve (3055 ms) 2024-09-14T11:15:46.140 INFO:tasks.workunit.client.0.smithi138.stdout:[ RUN ] TestCls2PCQueue.Commit 2024-09-14T11:15:50.208 INFO:tasks.workunit.client.0.smithi138.stdout:[ OK ] TestCls2PCQueue.Commit (4067 ms) 2024-09-14T11:15:50.208 INFO:tasks.workunit.client.0.smithi138.stdout:[ RUN ] TestCls2PCQueue.Stats 2024-09-14T11:15:54.952 INFO:tasks.workunit.client.0.smithi138.stdout:[ OK ] TestCls2PCQueue.Stats (4745 ms) 2024-09-14T11:15:54.952 INFO:tasks.workunit.client.0.smithi138.stdout:[ RUN ] TestCls2PCQueue.UpgradeFromReef 2024-09-14T11:15:59.019 INFO:tasks.workunit.client.0.smithi138.stdout:[ OK ] TestCls2PCQueue.UpgradeFromReef (4067 ms) 2024-09-14T11:15:59.019 INFO:tasks.workunit.client.0.smithi138.stdout:[ RUN ] TestCls2PCQueue.Abort 2024-09-14T11:16:02.023 INFO:tasks.workunit.client.0.smithi138.stdout:[ OK ] TestCls2PCQueue.Abort (3004 ms) 2024-09-14T11:16:02.024 INFO:tasks.workunit.client.0.smithi138.stdout:[ RUN ] TestCls2PCQueue.ReserveError 2024-09-14T11:16:05.049 INFO:tasks.workunit.client.0.smithi138.stdout:[ OK ] TestCls2PCQueue.ReserveError (3026 ms) 2024-09-14T11:16:05.049 INFO:tasks.workunit.client.0.smithi138.stdout:[ RUN ] TestCls2PCQueue.CommitError 2024-09-14T11:16:08.108 INFO:tasks.workunit.client.0.smithi138.stdout:[ OK ] TestCls2PCQueue.CommitError (3058 ms) 2024-09-14T11:16:08.108 INFO:tasks.workunit.client.0.smithi138.stdout:[ RUN ] TestCls2PCQueue.AbortError 2024-09-14T11:16:11.128 INFO:tasks.workunit.client.0.smithi138.stdout:[ OK ] TestCls2PCQueue.AbortError (3021 ms) 2024-09-14T11:16:11.128 INFO:tasks.workunit.client.0.smithi138.stdout:[ RUN ] TestCls2PCQueue.MultiReserve 2024-09-14T11:16:14.203 INFO:tasks.workunit.client.0.smithi138.stdout:[ OK ] TestCls2PCQueue.MultiReserve (3071 ms) 2024-09-14T11:16:14.204 INFO:tasks.workunit.client.0.smithi138.stdout:[ RUN ] TestCls2PCQueue.MultiCommit 2024-09-14T11:16:17.222 INFO:tasks.workunit.client.0.smithi138.stdout:[ OK ] TestCls2PCQueue.MultiCommit (3023 ms) 2024-09-14T11:16:17.223 INFO:tasks.workunit.client.0.smithi138.stdout:[ RUN ] TestCls2PCQueue.MultiAbort 2024-09-14T11:16:20.231 INFO:tasks.workunit.client.0.smithi138.stdout:[ OK ] TestCls2PCQueue.MultiAbort (3009 ms) 2024-09-14T11:16:20.232 INFO:tasks.workunit.client.0.smithi138.stdout:[ RUN ] TestCls2PCQueue.ReserveCommit 2024-09-14T11:16:23.287 INFO:tasks.workunit.client.0.smithi138.stdout:[ OK ] TestCls2PCQueue.ReserveCommit (3056 ms) 2024-09-14T11:16:23.287 INFO:tasks.workunit.client.0.smithi138.stdout:[ RUN ] TestCls2PCQueue.ReserveAbort 2024-09-14T11:16:26.367 INFO:tasks.workunit.client.0.smithi138.stdout:[ OK ] TestCls2PCQueue.ReserveAbort (3069 ms) 2024-09-14T11:16:26.367 INFO:tasks.workunit.client.0.smithi138.stdout:[ RUN ] TestCls2PCQueue.ManualCleanup 2024-09-14T11:16:29.367 INFO:tasks.workunit.client.0.smithi138.stdout:[ OK ] TestCls2PCQueue.ManualCleanup (3009 ms) 2024-09-14T11:16:29.367 INFO:tasks.workunit.client.0.smithi138.stdout:[ RUN ] TestCls2PCQueue.Cleanup 2024-09-14T11:16:32.434 INFO:tasks.workunit.client.0.smithi138.stdout:[ OK ] TestCls2PCQueue.Cleanup (3069 ms) 2024-09-14T11:16:32.434 INFO:tasks.workunit.client.0.smithi138.stdout:[ RUN ] TestCls2PCQueue.MultiProducer 2024-09-14T11:16:44.974 INFO:tasks.workunit.client.0.smithi138.stdout:[ OK ] TestCls2PCQueue.MultiProducer (12537 ms) 2024-09-14T11:16:44.975 INFO:tasks.workunit.client.0.smithi138.stdout:[ RUN ] TestCls2PCQueue.AsyncConsumer 2024-09-14T11:16:50.027 INFO:tasks.workunit.client.0.smithi138.stdout:[ OK ] TestCls2PCQueue.AsyncConsumer (5055 ms) 2024-09-14T11:16:50.027 INFO:tasks.workunit.client.0.smithi138.stdout:[ RUN ] TestCls2PCQueue.MultiProducerConsumer 2024-09-14T11:17:03.987 INFO:tasks.workunit.client.0.smithi138.stdout:[ OK ] TestCls2PCQueue.MultiProducerConsumer (13961 ms) 2024-09-14T11:17:03.987 INFO:tasks.workunit.client.0.smithi138.stdout:[ RUN ] TestCls2PCQueue.ReserveSpillover 2024-09-14T11:17:10.051 INFO:tasks.workunit.client.0.smithi138.stdout:[ OK ] TestCls2PCQueue.ReserveSpillover (6058 ms) 2024-09-14T11:17:10.051 INFO:tasks.workunit.client.0.smithi138.stdout:[ RUN ] TestCls2PCQueue.CommitSpillover 2024-09-14T11:17:19.985 INFO:tasks.workunit.client.0.smithi138.stdout:[ OK ] TestCls2PCQueue.CommitSpillover (9940 ms) 2024-09-14T11:17:19.985 INFO:tasks.workunit.client.0.smithi138.stdout:[ RUN ] TestCls2PCQueue.AbortSpillover 2024-09-14T11:17:29.993 INFO:tasks.workunit.client.0.smithi138.stdout:[ OK ] TestCls2PCQueue.AbortSpillover (10008 ms) 2024-09-14T11:17:29.993 INFO:tasks.workunit.client.0.smithi138.stdout:[----------] 24 tests from TestCls2PCQueue (115888 ms total) 2024-09-14T11:17:29.993 INFO:tasks.workunit.client.0.smithi138.stdout: 2024-09-14T11:17:29.993 INFO:tasks.workunit.client.0.smithi138.stdout:[----------] Global test environment tear-down 2024-09-14T11:17:29.994 INFO:tasks.workunit.client.0.smithi138.stdout:[==========] 24 tests from 1 test suite ran. (115889 ms total) 2024-09-14T11:17:29.994 INFO:tasks.workunit.client.0.smithi138.stdout:[ PASSED ] 24 tests. 2024-09-14T11:17:30.001 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-09-14T11:17:30.001 DEBUG:teuthology.orchestra.run.smithi138:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-09-14T11:17:30.059 INFO:tasks.workunit:Running workunits matching cls/test_cls_user.sh on client.0... 2024-09-14T11:17:30.060 INFO:tasks.workunit:Running workunit cls/test_cls_user.sh... 2024-09-14T11:17:30.061 DEBUG:teuthology.orchestra.run.smithi138:workunit test cls/test_cls_user.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=1c941a66c1b420259b8fc5ac19e792dbbf60aded TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/cls/test_cls_user.sh 2024-09-14T11:17:30.134 INFO:tasks.workunit.client.0.smithi138.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:17:30.134 INFO:tasks.workunit.client.0.smithi138.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:17:30.134 INFO:tasks.workunit.client.0.smithi138.stdout:[==========] Running 4 tests from 1 test suite. 2024-09-14T11:17:30.134 INFO:tasks.workunit.client.0.smithi138.stdout:[----------] Global test environment set-up. 2024-09-14T11:17:32.013 INFO:tasks.workunit.client.0.smithi138.stdout:[----------] 4 tests from ClsAccount 2024-09-14T11:17:32.013 INFO:tasks.workunit.client.0.smithi138.stdout:[ RUN ] ClsAccount.add 2024-09-14T11:17:32.057 INFO:tasks.workunit.client.0.smithi138.stdout:[ OK ] ClsAccount.add (45 ms) 2024-09-14T11:17:32.058 INFO:tasks.workunit.client.0.smithi138.stdout:[ RUN ] ClsAccount.get 2024-09-14T11:17:32.065 INFO:tasks.workunit.client.0.smithi138.stdout:[ OK ] ClsAccount.get (7 ms) 2024-09-14T11:17:32.065 INFO:tasks.workunit.client.0.smithi138.stdout:[ RUN ] ClsAccount.rm 2024-09-14T11:17:32.074 INFO:tasks.workunit.client.0.smithi138.stdout:[ OK ] ClsAccount.rm (9 ms) 2024-09-14T11:17:32.074 INFO:tasks.workunit.client.0.smithi138.stdout:[ RUN ] ClsAccount.list 2024-09-14T11:17:32.120 INFO:tasks.workunit.client.0.smithi138.stdout:[ OK ] ClsAccount.list (46 ms) 2024-09-14T11:17:32.120 INFO:tasks.workunit.client.0.smithi138.stdout:[----------] 4 tests from ClsAccount (107 ms total) 2024-09-14T11:17:32.120 INFO:tasks.workunit.client.0.smithi138.stdout: 2024-09-14T11:17:32.120 INFO:tasks.workunit.client.0.smithi138.stdout:[----------] Global test environment tear-down 2024-09-14T11:17:33.014 INFO:tasks.workunit.client.0.smithi138.stdout:[==========] 4 tests from 1 test suite ran. (2880 ms total) 2024-09-14T11:17:33.015 INFO:tasks.workunit.client.0.smithi138.stdout:[ PASSED ] 4 tests. 2024-09-14T11:17:33.021 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-09-14T11:17:33.021 DEBUG:teuthology.orchestra.run.smithi138:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-09-14T11:17:33.075 INFO:tasks.workunit:Running workunits matching rgw/test_rgw_gc_log.sh on client.0... 2024-09-14T11:17:33.076 INFO:tasks.workunit:Running workunit rgw/test_rgw_gc_log.sh... 2024-09-14T11:17:33.076 DEBUG:teuthology.orchestra.run.smithi138:workunit test rgw/test_rgw_gc_log.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=1c941a66c1b420259b8fc5ac19e792dbbf60aded TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/test_rgw_gc_log.sh 2024-09-14T11:17:33.152 INFO:tasks.workunit.client.0.smithi138.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:17:33.152 INFO:tasks.workunit.client.0.smithi138.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:17:33.153 INFO:tasks.workunit.client.0.smithi138.stdout:[==========] Running 6 tests from 1 test suite. 2024-09-14T11:17:33.153 INFO:tasks.workunit.client.0.smithi138.stdout:[----------] Global test environment set-up. 2024-09-14T11:17:35.067 INFO:tasks.workunit.client.0.smithi138.stdout:[----------] 6 tests from rgw_gc_log 2024-09-14T11:17:35.067 INFO:tasks.workunit.client.0.smithi138.stdout:[ RUN ] rgw_gc_log.init_existing_queue 2024-09-14T11:17:35.104 INFO:tasks.workunit.client.0.smithi138.stdout:[ OK ] rgw_gc_log.init_existing_queue (37 ms) 2024-09-14T11:17:35.104 INFO:tasks.workunit.client.0.smithi138.stdout:[ RUN ] rgw_gc_log.init_existing_omap 2024-09-14T11:17:35.109 INFO:tasks.workunit.client.0.smithi138.stdout:[ OK ] rgw_gc_log.init_existing_omap (6 ms) 2024-09-14T11:17:35.110 INFO:tasks.workunit.client.0.smithi138.stdout:[ RUN ] rgw_gc_log.enqueue1_after_init 2024-09-14T11:17:35.116 INFO:tasks.workunit.client.0.smithi138.stdout:[ OK ] rgw_gc_log.enqueue1_after_init (6 ms) 2024-09-14T11:17:35.116 INFO:tasks.workunit.client.0.smithi138.stdout:[ RUN ] rgw_gc_log.enqueue2_before_init 2024-09-14T11:17:35.119 INFO:tasks.workunit.client.0.smithi138.stdout:[ OK ] rgw_gc_log.enqueue2_before_init (3 ms) 2024-09-14T11:17:35.119 INFO:tasks.workunit.client.0.smithi138.stdout:[ RUN ] rgw_gc_log.defer1_after_init 2024-09-14T11:17:35.124 INFO:tasks.workunit.client.0.smithi138.stdout:[ OK ] rgw_gc_log.defer1_after_init (5 ms) 2024-09-14T11:17:35.124 INFO:tasks.workunit.client.0.smithi138.stdout:[ RUN ] rgw_gc_log.defer2_before_init 2024-09-14T11:17:35.127 INFO:tasks.workunit.client.0.smithi138.stdout:[ OK ] rgw_gc_log.defer2_before_init (3 ms) 2024-09-14T11:17:35.127 INFO:tasks.workunit.client.0.smithi138.stdout:[----------] 6 tests from rgw_gc_log (60 ms total) 2024-09-14T11:17:35.127 INFO:tasks.workunit.client.0.smithi138.stdout: 2024-09-14T11:17:35.127 INFO:tasks.workunit.client.0.smithi138.stdout:[----------] Global test environment tear-down 2024-09-14T11:17:36.074 INFO:tasks.workunit.client.0.smithi138.stdout:[==========] 6 tests from 1 test suite ran. (2921 ms total) 2024-09-14T11:17:36.074 INFO:tasks.workunit.client.0.smithi138.stdout:[ PASSED ] 6 tests. 2024-09-14T11:17:36.080 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-09-14T11:17:36.080 DEBUG:teuthology.orchestra.run.smithi138:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-09-14T11:17:36.137 INFO:tasks.workunit:Running workunits matching rgw/test_rgw_obj.sh on client.0... 2024-09-14T11:17:36.138 INFO:tasks.workunit:Running workunit rgw/test_rgw_obj.sh... 2024-09-14T11:17:36.138 DEBUG:teuthology.orchestra.run.smithi138:workunit test rgw/test_rgw_obj.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=1c941a66c1b420259b8fc5ac19e792dbbf60aded TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/test_rgw_obj.sh 2024-09-14T11:17:36.208 INFO:tasks.workunit.client.0.smithi138.stdout:Running main() from gmock_main.cc 2024-09-14T11:17:36.208 INFO:tasks.workunit.client.0.smithi138.stdout:[==========] Running 4 tests from 1 test suite. 2024-09-14T11:17:36.208 INFO:tasks.workunit.client.0.smithi138.stdout:[----------] Global test environment set-up. 2024-09-14T11:17:36.208 INFO:tasks.workunit.client.0.smithi138.stdout:[----------] 4 tests from TestRGWObj 2024-09-14T11:17:36.208 INFO:tasks.workunit.client.0.smithi138.stdout:[ RUN ] TestRGWObj.underscore 2024-09-14T11:17:36.208 INFO:tasks.workunit.client.0.smithi138.stdout:parsed: _obj 2024-09-14T11:17:36.208 INFO:tasks.workunit.client.0.smithi138.stdout:parsed: _obj 2024-09-14T11:17:36.209 INFO:tasks.workunit.client.0.smithi138.stdout:stripped: _obj ns= i= 2024-09-14T11:17:36.209 INFO:tasks.workunit.client.0.smithi138.stdout:parsed: _obj 2024-09-14T11:17:36.209 INFO:tasks.workunit.client.0.smithi138.stdout:parsed: _obj 2024-09-14T11:17:36.209 INFO:tasks.workunit.client.0.smithi138.stdout:stripped: _obj ns= i= 2024-09-14T11:17:36.209 INFO:tasks.workunit.client.0.smithi138.stdout:parsed: _obj 2024-09-14T11:17:36.209 INFO:tasks.workunit.client.0.smithi138.stdout:parsed: _obj 2024-09-14T11:17:36.209 INFO:tasks.workunit.client.0.smithi138.stdout:stripped: _obj ns= i= 2024-09-14T11:17:36.209 INFO:tasks.workunit.client.0.smithi138.stdout:{ 2024-09-14T11:17:36.209 INFO:tasks.workunit.client.0.smithi138.stdout: "obj1": { 2024-09-14T11:17:36.209 INFO:tasks.workunit.client.0.smithi138.stdout: "bucket": { 2024-09-14T11:17:36.209 INFO:tasks.workunit.client.0.smithi138.stdout: "name": "test", 2024-09-14T11:17:36.209 INFO:tasks.workunit.client.0.smithi138.stdout: "marker": "marker", 2024-09-14T11:17:36.209 INFO:tasks.workunit.client.0.smithi138.stdout: "bucket_id": "bucket-id", 2024-09-14T11:17:36.209 INFO:tasks.workunit.client.0.smithi138.stdout: "tenant": "", 2024-09-14T11:17:36.209 INFO:tasks.workunit.client.0.smithi138.stdout: "explicit_placement": { 2024-09-14T11:17:36.209 INFO:tasks.workunit.client.0.smithi138.stdout: "data_pool": "", 2024-09-14T11:17:36.210 INFO:tasks.workunit.client.0.smithi138.stdout: "data_extra_pool": "", 2024-09-14T11:17:36.210 INFO:tasks.workunit.client.0.smithi138.stdout: "index_pool": "" 2024-09-14T11:17:36.210 INFO:tasks.workunit.client.0.smithi138.stdout: } 2024-09-14T11:17:36.210 INFO:tasks.workunit.client.0.smithi138.stdout: }, 2024-09-14T11:17:36.210 INFO:tasks.workunit.client.0.smithi138.stdout: "key": { 2024-09-14T11:17:36.210 INFO:tasks.workunit.client.0.smithi138.stdout: "name": "_obj", 2024-09-14T11:17:36.210 INFO:tasks.workunit.client.0.smithi138.stdout: "instance": "", 2024-09-14T11:17:36.210 INFO:tasks.workunit.client.0.smithi138.stdout: "ns": "" 2024-09-14T11:17:36.210 INFO:tasks.workunit.client.0.smithi138.stdout: } 2024-09-14T11:17:36.210 INFO:tasks.workunit.client.0.smithi138.stdout: }, 2024-09-14T11:17:36.210 INFO:tasks.workunit.client.0.smithi138.stdout: "obj2": { 2024-09-14T11:17:36.210 INFO:tasks.workunit.client.0.smithi138.stdout: "bucket": { 2024-09-14T11:17:36.211 INFO:tasks.workunit.client.0.smithi138.stdout: "name": "test", 2024-09-14T11:17:36.211 INFO:tasks.workunit.client.0.smithi138.stdout: "marker": "marker", 2024-09-14T11:17:36.211 INFO:tasks.workunit.client.0.smithi138.stdout: "bucket_id": "bucket-id", 2024-09-14T11:17:36.211 INFO:tasks.workunit.client.0.smithi138.stdout: "tenant": "", 2024-09-14T11:17:36.211 INFO:tasks.workunit.client.0.smithi138.stdout: "explicit_placement": { 2024-09-14T11:17:36.211 INFO:tasks.workunit.client.0.smithi138.stdout: "data_pool": "", 2024-09-14T11:17:36.211 INFO:tasks.workunit.client.0.smithi138.stdout: "data_extra_pool": "", 2024-09-14T11:17:36.211 INFO:tasks.workunit.client.0.smithi138.stdout: "index_pool": "" 2024-09-14T11:17:36.211 INFO:tasks.workunit.client.0.smithi138.stdout: } 2024-09-14T11:17:36.211 INFO:tasks.workunit.client.0.smithi138.stdout: }, 2024-09-14T11:17:36.211 INFO:tasks.workunit.client.0.smithi138.stdout: "key": { 2024-09-14T11:17:36.211 INFO:tasks.workunit.client.0.smithi138.stdout: "name": "_obj", 2024-09-14T11:17:36.211 INFO:tasks.workunit.client.0.smithi138.stdout: "instance": "", 2024-09-14T11:17:36.211 INFO:tasks.workunit.client.0.smithi138.stdout: "ns": "" 2024-09-14T11:17:36.212 INFO:tasks.workunit.client.0.smithi138.stdout: } 2024-09-14T11:17:36.212 INFO:tasks.workunit.client.0.smithi138.stdout: }, 2024-09-14T11:17:36.212 INFO:tasks.workunit.client.0.smithi138.stdout: "obj3": { 2024-09-14T11:17:36.212 INFO:tasks.workunit.client.0.smithi138.stdout: "bucket": { 2024-09-14T11:17:36.212 INFO:tasks.workunit.client.0.smithi138.stdout: "name": "test", 2024-09-14T11:17:36.212 INFO:tasks.workunit.client.0.smithi138.stdout: "marker": "marker", 2024-09-14T11:17:36.212 INFO:tasks.workunit.client.0.smithi138.stdout: "bucket_id": "bucket-id", 2024-09-14T11:17:36.212 INFO:tasks.workunit.client.0.smithi138.stdout: "tenant": "", 2024-09-14T11:17:36.212 INFO:tasks.workunit.client.0.smithi138.stdout: "explicit_placement": { 2024-09-14T11:17:36.212 INFO:tasks.workunit.client.0.smithi138.stdout: "data_pool": "", 2024-09-14T11:17:36.212 INFO:tasks.workunit.client.0.smithi138.stdout: "data_extra_pool": "", 2024-09-14T11:17:36.212 INFO:tasks.workunit.client.0.smithi138.stdout: "index_pool": "" 2024-09-14T11:17:36.212 INFO:tasks.workunit.client.0.smithi138.stdout: } 2024-09-14T11:17:36.212 INFO:tasks.workunit.client.0.smithi138.stdout: }, 2024-09-14T11:17:36.212 INFO:tasks.workunit.client.0.smithi138.stdout: "key": { 2024-09-14T11:17:36.213 INFO:tasks.workunit.client.0.smithi138.stdout: "name": "_obj", 2024-09-14T11:17:36.213 INFO:tasks.workunit.client.0.smithi138.stdout: "instance": "", 2024-09-14T11:17:36.213 INFO:tasks.workunit.client.0.smithi138.stdout: "ns": "" 2024-09-14T11:17:36.213 INFO:tasks.workunit.client.0.smithi138.stdout: } 2024-09-14T11:17:36.213 INFO:tasks.workunit.client.0.smithi138.stdout: }, 2024-09-14T11:17:36.213 INFO:tasks.workunit.client.0.smithi138.stdout: "obj3-2": { 2024-09-14T11:17:36.213 INFO:tasks.workunit.client.0.smithi138.stdout: "bucket": { 2024-09-14T11:17:36.213 INFO:tasks.workunit.client.0.smithi138.stdout: "name": "test", 2024-09-14T11:17:36.213 INFO:tasks.workunit.client.0.smithi138.stdout: "marker": "marker", 2024-09-14T11:17:36.213 INFO:tasks.workunit.client.0.smithi138.stdout: "bucket_id": "bucket-id", 2024-09-14T11:17:36.213 INFO:tasks.workunit.client.0.smithi138.stdout: "tenant": "", 2024-09-14T11:17:36.213 INFO:tasks.workunit.client.0.smithi138.stdout: "explicit_placement": { 2024-09-14T11:17:36.213 INFO:tasks.workunit.client.0.smithi138.stdout: "data_pool": "", 2024-09-14T11:17:36.213 INFO:tasks.workunit.client.0.smithi138.stdout: "data_extra_pool": "", 2024-09-14T11:17:36.213 INFO:tasks.workunit.client.0.smithi138.stdout: "index_pool": "" 2024-09-14T11:17:36.214 INFO:tasks.workunit.client.0.smithi138.stdout: } 2024-09-14T11:17:36.214 INFO:tasks.workunit.client.0.smithi138.stdout: }, 2024-09-14T11:17:36.214 INFO:tasks.workunit.client.0.smithi138.stdout: "key": { 2024-09-14T11:17:36.214 INFO:tasks.workunit.client.0.smithi138.stdout: "name": "_obj", 2024-09-14T11:17:36.214 INFO:tasks.workunit.client.0.smithi138.stdout: "instance": "", 2024-09-14T11:17:36.214 INFO:tasks.workunit.client.0.smithi138.stdout: "ns": "" 2024-09-14T11:17:36.214 INFO:tasks.workunit.client.0.smithi138.stdout: } 2024-09-14T11:17:36.214 INFO:tasks.workunit.client.0.smithi138.stdout: } 2024-09-14T11:17:36.214 INFO:tasks.workunit.client.0.smithi138.stdout:} 2024-09-14T11:17:36.214 INFO:tasks.workunit.client.0.smithi138.stdout:parsed: _obj 2024-09-14T11:17:36.214 INFO:tasks.workunit.client.0.smithi138.stdout:parsed: _obj 2024-09-14T11:17:36.214 INFO:tasks.workunit.client.0.smithi138.stdout:stripped: _obj ns=ns i= 2024-09-14T11:17:36.214 INFO:tasks.workunit.client.0.smithi138.stdout:parsed: _obj 2024-09-14T11:17:36.214 INFO:tasks.workunit.client.0.smithi138.stdout:parsed: _obj 2024-09-14T11:17:36.215 INFO:tasks.workunit.client.0.smithi138.stdout:stripped: _obj ns=ns i= 2024-09-14T11:17:36.215 INFO:tasks.workunit.client.0.smithi138.stdout:parsed: _obj 2024-09-14T11:17:36.215 INFO:tasks.workunit.client.0.smithi138.stdout:parsed: _obj 2024-09-14T11:17:36.215 INFO:tasks.workunit.client.0.smithi138.stdout:stripped: _obj ns=ns i= 2024-09-14T11:17:36.215 INFO:tasks.workunit.client.0.smithi138.stdout:{ 2024-09-14T11:17:36.215 INFO:tasks.workunit.client.0.smithi138.stdout: "obj1": { 2024-09-14T11:17:36.215 INFO:tasks.workunit.client.0.smithi138.stdout: "bucket": { 2024-09-14T11:17:36.215 INFO:tasks.workunit.client.0.smithi138.stdout: "name": "test", 2024-09-14T11:17:36.215 INFO:tasks.workunit.client.0.smithi138.stdout: "marker": "marker", 2024-09-14T11:17:36.215 INFO:tasks.workunit.client.0.smithi138.stdout: "bucket_id": "bucket-id", 2024-09-14T11:17:36.215 INFO:tasks.workunit.client.0.smithi138.stdout: "tenant": "", 2024-09-14T11:17:36.215 INFO:tasks.workunit.client.0.smithi138.stdout: "explicit_placement": { 2024-09-14T11:17:36.215 INFO:tasks.workunit.client.0.smithi138.stdout: "data_pool": "", 2024-09-14T11:17:36.215 INFO:tasks.workunit.client.0.smithi138.stdout: "data_extra_pool": "", 2024-09-14T11:17:36.216 INFO:tasks.workunit.client.0.smithi138.stdout: "index_pool": "" 2024-09-14T11:17:36.216 INFO:tasks.workunit.client.0.smithi138.stdout: } 2024-09-14T11:17:36.216 INFO:tasks.workunit.client.0.smithi138.stdout: }, 2024-09-14T11:17:36.216 INFO:tasks.workunit.client.0.smithi138.stdout: "key": { 2024-09-14T11:17:36.216 INFO:tasks.workunit.client.0.smithi138.stdout: "name": "_obj", 2024-09-14T11:17:36.216 INFO:tasks.workunit.client.0.smithi138.stdout: "instance": "", 2024-09-14T11:17:36.216 INFO:tasks.workunit.client.0.smithi138.stdout: "ns": "ns" 2024-09-14T11:17:36.216 INFO:tasks.workunit.client.0.smithi138.stdout: } 2024-09-14T11:17:36.216 INFO:tasks.workunit.client.0.smithi138.stdout: }, 2024-09-14T11:17:36.216 INFO:tasks.workunit.client.0.smithi138.stdout: "obj2": { 2024-09-14T11:17:36.216 INFO:tasks.workunit.client.0.smithi138.stdout: "bucket": { 2024-09-14T11:17:36.216 INFO:tasks.workunit.client.0.smithi138.stdout: "name": "test", 2024-09-14T11:17:36.216 INFO:tasks.workunit.client.0.smithi138.stdout: "marker": "marker", 2024-09-14T11:17:36.216 INFO:tasks.workunit.client.0.smithi138.stdout: "bucket_id": "bucket-id", 2024-09-14T11:17:36.216 INFO:tasks.workunit.client.0.smithi138.stdout: "tenant": "", 2024-09-14T11:17:36.217 INFO:tasks.workunit.client.0.smithi138.stdout: "explicit_placement": { 2024-09-14T11:17:36.217 INFO:tasks.workunit.client.0.smithi138.stdout: "data_pool": "", 2024-09-14T11:17:36.217 INFO:tasks.workunit.client.0.smithi138.stdout: "data_extra_pool": "", 2024-09-14T11:17:36.217 INFO:tasks.workunit.client.0.smithi138.stdout: "index_pool": "" 2024-09-14T11:17:36.217 INFO:tasks.workunit.client.0.smithi138.stdout: } 2024-09-14T11:17:36.217 INFO:tasks.workunit.client.0.smithi138.stdout: }, 2024-09-14T11:17:36.217 INFO:tasks.workunit.client.0.smithi138.stdout: "key": { 2024-09-14T11:17:36.217 INFO:tasks.workunit.client.0.smithi138.stdout: "name": "_obj", 2024-09-14T11:17:36.217 INFO:tasks.workunit.client.0.smithi138.stdout: "instance": "", 2024-09-14T11:17:36.217 INFO:tasks.workunit.client.0.smithi138.stdout: "ns": "ns" 2024-09-14T11:17:36.217 INFO:tasks.workunit.client.0.smithi138.stdout: } 2024-09-14T11:17:36.217 INFO:tasks.workunit.client.0.smithi138.stdout: }, 2024-09-14T11:17:36.217 INFO:tasks.workunit.client.0.smithi138.stdout: "obj3": { 2024-09-14T11:17:36.218 INFO:tasks.workunit.client.0.smithi138.stdout: "bucket": { 2024-09-14T11:17:36.218 INFO:tasks.workunit.client.0.smithi138.stdout: "name": "test", 2024-09-14T11:17:36.218 INFO:tasks.workunit.client.0.smithi138.stdout: "marker": "marker", 2024-09-14T11:17:36.218 INFO:tasks.workunit.client.0.smithi138.stdout: "bucket_id": "bucket-id", 2024-09-14T11:17:36.218 INFO:tasks.workunit.client.0.smithi138.stdout: "tenant": "", 2024-09-14T11:17:36.218 INFO:tasks.workunit.client.0.smithi138.stdout: "explicit_placement": { 2024-09-14T11:17:36.218 INFO:tasks.workunit.client.0.smithi138.stdout: "data_pool": "", 2024-09-14T11:17:36.218 INFO:tasks.workunit.client.0.smithi138.stdout: "data_extra_pool": "", 2024-09-14T11:17:36.218 INFO:tasks.workunit.client.0.smithi138.stdout: "index_pool": "" 2024-09-14T11:17:36.218 INFO:tasks.workunit.client.0.smithi138.stdout: } 2024-09-14T11:17:36.218 INFO:tasks.workunit.client.0.smithi138.stdout: }, 2024-09-14T11:17:36.218 INFO:tasks.workunit.client.0.smithi138.stdout: "key": { 2024-09-14T11:17:36.218 INFO:tasks.workunit.client.0.smithi138.stdout: "name": "_obj", 2024-09-14T11:17:36.218 INFO:tasks.workunit.client.0.smithi138.stdout: "instance": "", 2024-09-14T11:17:36.219 INFO:tasks.workunit.client.0.smithi138.stdout: "ns": "" 2024-09-14T11:17:36.219 INFO:tasks.workunit.client.0.smithi138.stdout: } 2024-09-14T11:17:36.219 INFO:tasks.workunit.client.0.smithi138.stdout: }, 2024-09-14T11:17:36.219 INFO:tasks.workunit.client.0.smithi138.stdout: "obj3-2": { 2024-09-14T11:17:36.219 INFO:tasks.workunit.client.0.smithi138.stdout: "bucket": { 2024-09-14T11:17:36.219 INFO:tasks.workunit.client.0.smithi138.stdout: "name": "test", 2024-09-14T11:17:36.219 INFO:tasks.workunit.client.0.smithi138.stdout: "marker": "marker", 2024-09-14T11:17:36.219 INFO:tasks.workunit.client.0.smithi138.stdout: "bucket_id": "bucket-id", 2024-09-14T11:17:36.219 INFO:tasks.workunit.client.0.smithi138.stdout: "tenant": "", 2024-09-14T11:17:36.219 INFO:tasks.workunit.client.0.smithi138.stdout: "explicit_placement": { 2024-09-14T11:17:36.219 INFO:tasks.workunit.client.0.smithi138.stdout: "data_pool": "", 2024-09-14T11:17:36.219 INFO:tasks.workunit.client.0.smithi138.stdout: "data_extra_pool": "", 2024-09-14T11:17:36.219 INFO:tasks.workunit.client.0.smithi138.stdout: "index_pool": "" 2024-09-14T11:17:36.219 INFO:tasks.workunit.client.0.smithi138.stdout: } 2024-09-14T11:17:36.219 INFO:tasks.workunit.client.0.smithi138.stdout: }, 2024-09-14T11:17:36.220 INFO:tasks.workunit.client.0.smithi138.stdout: "key": { 2024-09-14T11:17:36.220 INFO:tasks.workunit.client.0.smithi138.stdout: "name": "_obj", 2024-09-14T11:17:36.220 INFO:tasks.workunit.client.0.smithi138.stdout: "instance": "", 2024-09-14T11:17:36.220 INFO:tasks.workunit.client.0.smithi138.stdout: "ns": "ns" 2024-09-14T11:17:36.220 INFO:tasks.workunit.client.0.smithi138.stdout: } 2024-09-14T11:17:36.220 INFO:tasks.workunit.client.0.smithi138.stdout: } 2024-09-14T11:17:36.220 INFO:tasks.workunit.client.0.smithi138.stdout:} 2024-09-14T11:17:36.220 INFO:tasks.workunit.client.0.smithi138.stdout:parsed: _obj[v1] 2024-09-14T11:17:36.220 INFO:tasks.workunit.client.0.smithi138.stdout:parsed: _obj[v1] 2024-09-14T11:17:36.220 INFO:tasks.workunit.client.0.smithi138.stdout:stripped: _obj ns= i=v1 2024-09-14T11:17:36.220 INFO:tasks.workunit.client.0.smithi138.stdout:parsed: _obj[v1] 2024-09-14T11:17:36.220 INFO:tasks.workunit.client.0.smithi138.stdout:parsed: _obj[v1] 2024-09-14T11:17:36.220 INFO:tasks.workunit.client.0.smithi138.stdout:stripped: _obj ns= i=v1 2024-09-14T11:17:36.220 INFO:tasks.workunit.client.0.smithi138.stdout:parsed: _obj[v1] 2024-09-14T11:17:36.221 INFO:tasks.workunit.client.0.smithi138.stdout:parsed: _obj[v1] 2024-09-14T11:17:36.221 INFO:tasks.workunit.client.0.smithi138.stdout:stripped: _obj ns= i=v1 2024-09-14T11:17:36.221 INFO:tasks.workunit.client.0.smithi138.stdout:{ 2024-09-14T11:17:36.221 INFO:tasks.workunit.client.0.smithi138.stdout: "obj1": { 2024-09-14T11:17:36.221 INFO:tasks.workunit.client.0.smithi138.stdout: "bucket": { 2024-09-14T11:17:36.221 INFO:tasks.workunit.client.0.smithi138.stdout: "name": "test", 2024-09-14T11:17:36.221 INFO:tasks.workunit.client.0.smithi138.stdout: "marker": "marker", 2024-09-14T11:17:36.221 INFO:tasks.workunit.client.0.smithi138.stdout: "bucket_id": "bucket-id", 2024-09-14T11:17:36.221 INFO:tasks.workunit.client.0.smithi138.stdout: "tenant": "", 2024-09-14T11:17:36.221 INFO:tasks.workunit.client.0.smithi138.stdout: "explicit_placement": { 2024-09-14T11:17:36.221 INFO:tasks.workunit.client.0.smithi138.stdout: "data_pool": "", 2024-09-14T11:17:36.221 INFO:tasks.workunit.client.0.smithi138.stdout: "data_extra_pool": "", 2024-09-14T11:17:36.221 INFO:tasks.workunit.client.0.smithi138.stdout: "index_pool": "" 2024-09-14T11:17:36.221 INFO:tasks.workunit.client.0.smithi138.stdout: } 2024-09-14T11:17:36.222 INFO:tasks.workunit.client.0.smithi138.stdout: }, 2024-09-14T11:17:36.222 INFO:tasks.workunit.client.0.smithi138.stdout: "key": { 2024-09-14T11:17:36.222 INFO:tasks.workunit.client.0.smithi138.stdout: "name": "_obj", 2024-09-14T11:17:36.222 INFO:tasks.workunit.client.0.smithi138.stdout: "instance": "v1", 2024-09-14T11:17:36.222 INFO:tasks.workunit.client.0.smithi138.stdout: "ns": "" 2024-09-14T11:17:36.222 INFO:tasks.workunit.client.0.smithi138.stdout: } 2024-09-14T11:17:36.222 INFO:tasks.workunit.client.0.smithi138.stdout: }, 2024-09-14T11:17:36.222 INFO:tasks.workunit.client.0.smithi138.stdout: "obj2": { 2024-09-14T11:17:36.222 INFO:tasks.workunit.client.0.smithi138.stdout: "bucket": { 2024-09-14T11:17:36.222 INFO:tasks.workunit.client.0.smithi138.stdout: "name": "test", 2024-09-14T11:17:36.222 INFO:tasks.workunit.client.0.smithi138.stdout: "marker": "marker", 2024-09-14T11:17:36.222 INFO:tasks.workunit.client.0.smithi138.stdout: "bucket_id": "bucket-id", 2024-09-14T11:17:36.222 INFO:tasks.workunit.client.0.smithi138.stdout: "tenant": "", 2024-09-14T11:17:36.222 INFO:tasks.workunit.client.0.smithi138.stdout: "explicit_placement": { 2024-09-14T11:17:36.223 INFO:tasks.workunit.client.0.smithi138.stdout: "data_pool": "", 2024-09-14T11:17:36.223 INFO:tasks.workunit.client.0.smithi138.stdout: "data_extra_pool": "", 2024-09-14T11:17:36.223 INFO:tasks.workunit.client.0.smithi138.stdout: "index_pool": "" 2024-09-14T11:17:36.223 INFO:tasks.workunit.client.0.smithi138.stdout: } 2024-09-14T11:17:36.223 INFO:tasks.workunit.client.0.smithi138.stdout: }, 2024-09-14T11:17:36.223 INFO:tasks.workunit.client.0.smithi138.stdout: "key": { 2024-09-14T11:17:36.223 INFO:tasks.workunit.client.0.smithi138.stdout: "name": "_obj", 2024-09-14T11:17:36.223 INFO:tasks.workunit.client.0.smithi138.stdout: "instance": "v1", 2024-09-14T11:17:36.223 INFO:tasks.workunit.client.0.smithi138.stdout: "ns": "" 2024-09-14T11:17:36.223 INFO:tasks.workunit.client.0.smithi138.stdout: } 2024-09-14T11:17:36.223 INFO:tasks.workunit.client.0.smithi138.stdout: }, 2024-09-14T11:17:36.223 INFO:tasks.workunit.client.0.smithi138.stdout: "obj3": { 2024-09-14T11:17:36.223 INFO:tasks.workunit.client.0.smithi138.stdout: "bucket": { 2024-09-14T11:17:36.223 INFO:tasks.workunit.client.0.smithi138.stdout: "name": "test", 2024-09-14T11:17:36.223 INFO:tasks.workunit.client.0.smithi138.stdout: "marker": "marker", 2024-09-14T11:17:36.224 INFO:tasks.workunit.client.0.smithi138.stdout: "bucket_id": "bucket-id", 2024-09-14T11:17:36.224 INFO:tasks.workunit.client.0.smithi138.stdout: "tenant": "", 2024-09-14T11:17:36.224 INFO:tasks.workunit.client.0.smithi138.stdout: "explicit_placement": { 2024-09-14T11:17:36.224 INFO:tasks.workunit.client.0.smithi138.stdout: "data_pool": "", 2024-09-14T11:17:36.224 INFO:tasks.workunit.client.0.smithi138.stdout: "data_extra_pool": "", 2024-09-14T11:17:36.224 INFO:tasks.workunit.client.0.smithi138.stdout: "index_pool": "" 2024-09-14T11:17:36.224 INFO:tasks.workunit.client.0.smithi138.stdout: } 2024-09-14T11:17:36.224 INFO:tasks.workunit.client.0.smithi138.stdout: }, 2024-09-14T11:17:36.224 INFO:tasks.workunit.client.0.smithi138.stdout: "key": { 2024-09-14T11:17:36.224 INFO:tasks.workunit.client.0.smithi138.stdout: "name": "_obj", 2024-09-14T11:17:36.224 INFO:tasks.workunit.client.0.smithi138.stdout: "instance": "", 2024-09-14T11:17:36.224 INFO:tasks.workunit.client.0.smithi138.stdout: "ns": "" 2024-09-14T11:17:36.224 INFO:tasks.workunit.client.0.smithi138.stdout: } 2024-09-14T11:17:36.224 INFO:tasks.workunit.client.0.smithi138.stdout: }, 2024-09-14T11:17:36.224 INFO:tasks.workunit.client.0.smithi138.stdout: "obj3-2": { 2024-09-14T11:17:36.225 INFO:tasks.workunit.client.0.smithi138.stdout: "bucket": { 2024-09-14T11:17:36.225 INFO:tasks.workunit.client.0.smithi138.stdout: "name": "test", 2024-09-14T11:17:36.225 INFO:tasks.workunit.client.0.smithi138.stdout: "marker": "marker", 2024-09-14T11:17:36.225 INFO:tasks.workunit.client.0.smithi138.stdout: "bucket_id": "bucket-id", 2024-09-14T11:17:36.225 INFO:tasks.workunit.client.0.smithi138.stdout: "tenant": "", 2024-09-14T11:17:36.225 INFO:tasks.workunit.client.0.smithi138.stdout: "explicit_placement": { 2024-09-14T11:17:36.225 INFO:tasks.workunit.client.0.smithi138.stdout: "data_pool": "", 2024-09-14T11:17:36.225 INFO:tasks.workunit.client.0.smithi138.stdout: "data_extra_pool": "", 2024-09-14T11:17:36.225 INFO:tasks.workunit.client.0.smithi138.stdout: "index_pool": "" 2024-09-14T11:17:36.225 INFO:tasks.workunit.client.0.smithi138.stdout: } 2024-09-14T11:17:36.225 INFO:tasks.workunit.client.0.smithi138.stdout: }, 2024-09-14T11:17:36.225 INFO:tasks.workunit.client.0.smithi138.stdout: "key": { 2024-09-14T11:17:36.225 INFO:tasks.workunit.client.0.smithi138.stdout: "name": "_obj", 2024-09-14T11:17:36.225 INFO:tasks.workunit.client.0.smithi138.stdout: "instance": "v1", 2024-09-14T11:17:36.226 INFO:tasks.workunit.client.0.smithi138.stdout: "ns": "" 2024-09-14T11:17:36.226 INFO:tasks.workunit.client.0.smithi138.stdout: } 2024-09-14T11:17:36.226 INFO:tasks.workunit.client.0.smithi138.stdout: } 2024-09-14T11:17:36.226 INFO:tasks.workunit.client.0.smithi138.stdout:} 2024-09-14T11:17:36.226 INFO:tasks.workunit.client.0.smithi138.stdout:parsed: _obj[v1] 2024-09-14T11:17:36.226 INFO:tasks.workunit.client.0.smithi138.stdout:parsed: _obj[v1] 2024-09-14T11:17:36.226 INFO:tasks.workunit.client.0.smithi138.stdout:stripped: _obj ns=ns i=v1 2024-09-14T11:17:36.226 INFO:tasks.workunit.client.0.smithi138.stdout:parsed: _obj[v1] 2024-09-14T11:17:36.226 INFO:tasks.workunit.client.0.smithi138.stdout:parsed: _obj[v1] 2024-09-14T11:17:36.226 INFO:tasks.workunit.client.0.smithi138.stdout:stripped: _obj ns=ns i=v1 2024-09-14T11:17:36.226 INFO:tasks.workunit.client.0.smithi138.stdout:parsed: _obj[v1] 2024-09-14T11:17:36.226 INFO:tasks.workunit.client.0.smithi138.stdout:parsed: _obj[v1] 2024-09-14T11:17:36.226 INFO:tasks.workunit.client.0.smithi138.stdout:stripped: _obj ns=ns i=v1 2024-09-14T11:17:36.226 INFO:tasks.workunit.client.0.smithi138.stdout:{ 2024-09-14T11:17:36.226 INFO:tasks.workunit.client.0.smithi138.stdout: "obj1": { 2024-09-14T11:17:36.227 INFO:tasks.workunit.client.0.smithi138.stdout: "bucket": { 2024-09-14T11:17:36.227 INFO:tasks.workunit.client.0.smithi138.stdout: "name": "test", 2024-09-14T11:17:36.227 INFO:tasks.workunit.client.0.smithi138.stdout: "marker": "marker", 2024-09-14T11:17:36.227 INFO:tasks.workunit.client.0.smithi138.stdout: "bucket_id": "bucket-id", 2024-09-14T11:17:36.227 INFO:tasks.workunit.client.0.smithi138.stdout: "tenant": "", 2024-09-14T11:17:36.227 INFO:tasks.workunit.client.0.smithi138.stdout: "explicit_placement": { 2024-09-14T11:17:36.227 INFO:tasks.workunit.client.0.smithi138.stdout: "data_pool": "", 2024-09-14T11:17:36.227 INFO:tasks.workunit.client.0.smithi138.stdout: "data_extra_pool": "", 2024-09-14T11:17:36.227 INFO:tasks.workunit.client.0.smithi138.stdout: "index_pool": "" 2024-09-14T11:17:36.227 INFO:tasks.workunit.client.0.smithi138.stdout: } 2024-09-14T11:17:36.227 INFO:tasks.workunit.client.0.smithi138.stdout: }, 2024-09-14T11:17:36.227 INFO:tasks.workunit.client.0.smithi138.stdout: "key": { 2024-09-14T11:17:36.227 INFO:tasks.workunit.client.0.smithi138.stdout: "name": "_obj", 2024-09-14T11:17:36.228 INFO:tasks.workunit.client.0.smithi138.stdout: "instance": "v1", 2024-09-14T11:17:36.228 INFO:tasks.workunit.client.0.smithi138.stdout: "ns": "ns" 2024-09-14T11:17:36.228 INFO:tasks.workunit.client.0.smithi138.stdout: } 2024-09-14T11:17:36.228 INFO:tasks.workunit.client.0.smithi138.stdout: }, 2024-09-14T11:17:36.228 INFO:tasks.workunit.client.0.smithi138.stdout: "obj2": { 2024-09-14T11:17:36.228 INFO:tasks.workunit.client.0.smithi138.stdout: "bucket": { 2024-09-14T11:17:36.228 INFO:tasks.workunit.client.0.smithi138.stdout: "name": "test", 2024-09-14T11:17:36.228 INFO:tasks.workunit.client.0.smithi138.stdout: "marker": "marker", 2024-09-14T11:17:36.228 INFO:tasks.workunit.client.0.smithi138.stdout: "bucket_id": "bucket-id", 2024-09-14T11:17:36.228 INFO:tasks.workunit.client.0.smithi138.stdout: "tenant": "", 2024-09-14T11:17:36.228 INFO:tasks.workunit.client.0.smithi138.stdout: "explicit_placement": { 2024-09-14T11:17:36.228 INFO:tasks.workunit.client.0.smithi138.stdout: "data_pool": "", 2024-09-14T11:17:36.228 INFO:tasks.workunit.client.0.smithi138.stdout: "data_extra_pool": "", 2024-09-14T11:17:36.228 INFO:tasks.workunit.client.0.smithi138.stdout: "index_pool": "" 2024-09-14T11:17:36.228 INFO:tasks.workunit.client.0.smithi138.stdout: } 2024-09-14T11:17:36.229 INFO:tasks.workunit.client.0.smithi138.stdout: }, 2024-09-14T11:17:36.229 INFO:tasks.workunit.client.0.smithi138.stdout: "key": { 2024-09-14T11:17:36.229 INFO:tasks.workunit.client.0.smithi138.stdout: "name": "_obj", 2024-09-14T11:17:36.229 INFO:tasks.workunit.client.0.smithi138.stdout: "instance": "v1", 2024-09-14T11:17:36.229 INFO:tasks.workunit.client.0.smithi138.stdout: "ns": "ns" 2024-09-14T11:17:36.229 INFO:tasks.workunit.client.0.smithi138.stdout: } 2024-09-14T11:17:36.229 INFO:tasks.workunit.client.0.smithi138.stdout: }, 2024-09-14T11:17:36.229 INFO:tasks.workunit.client.0.smithi138.stdout: "obj3": { 2024-09-14T11:17:36.229 INFO:tasks.workunit.client.0.smithi138.stdout: "bucket": { 2024-09-14T11:17:36.229 INFO:tasks.workunit.client.0.smithi138.stdout: "name": "test", 2024-09-14T11:17:36.229 INFO:tasks.workunit.client.0.smithi138.stdout: "marker": "marker", 2024-09-14T11:17:36.229 INFO:tasks.workunit.client.0.smithi138.stdout: "bucket_id": "bucket-id", 2024-09-14T11:17:36.229 INFO:tasks.workunit.client.0.smithi138.stdout: "tenant": "", 2024-09-14T11:17:36.229 INFO:tasks.workunit.client.0.smithi138.stdout: "explicit_placement": { 2024-09-14T11:17:36.229 INFO:tasks.workunit.client.0.smithi138.stdout: "data_pool": "", 2024-09-14T11:17:36.230 INFO:tasks.workunit.client.0.smithi138.stdout: "data_extra_pool": "", 2024-09-14T11:17:36.230 INFO:tasks.workunit.client.0.smithi138.stdout: "index_pool": "" 2024-09-14T11:17:36.230 INFO:tasks.workunit.client.0.smithi138.stdout: } 2024-09-14T11:17:36.230 INFO:tasks.workunit.client.0.smithi138.stdout: }, 2024-09-14T11:17:36.230 INFO:tasks.workunit.client.0.smithi138.stdout: "key": { 2024-09-14T11:17:36.230 INFO:tasks.workunit.client.0.smithi138.stdout: "name": "_obj", 2024-09-14T11:17:36.230 INFO:tasks.workunit.client.0.smithi138.stdout: "instance": "", 2024-09-14T11:17:36.230 INFO:tasks.workunit.client.0.smithi138.stdout: "ns": "" 2024-09-14T11:17:36.230 INFO:tasks.workunit.client.0.smithi138.stdout: } 2024-09-14T11:17:36.230 INFO:tasks.workunit.client.0.smithi138.stdout: }, 2024-09-14T11:17:36.230 INFO:tasks.workunit.client.0.smithi138.stdout: "obj3-2": { 2024-09-14T11:17:36.230 INFO:tasks.workunit.client.0.smithi138.stdout: "bucket": { 2024-09-14T11:17:36.230 INFO:tasks.workunit.client.0.smithi138.stdout: "name": "test", 2024-09-14T11:17:36.230 INFO:tasks.workunit.client.0.smithi138.stdout: "marker": "marker", 2024-09-14T11:17:36.230 INFO:tasks.workunit.client.0.smithi138.stdout: "bucket_id": "bucket-id", 2024-09-14T11:17:36.231 INFO:tasks.workunit.client.0.smithi138.stdout: "tenant": "", 2024-09-14T11:17:36.231 INFO:tasks.workunit.client.0.smithi138.stdout: "explicit_placement": { 2024-09-14T11:17:36.231 INFO:tasks.workunit.client.0.smithi138.stdout: "data_pool": "", 2024-09-14T11:17:36.231 INFO:tasks.workunit.client.0.smithi138.stdout: "data_extra_pool": "", 2024-09-14T11:17:36.231 INFO:tasks.workunit.client.0.smithi138.stdout: "index_pool": "" 2024-09-14T11:17:36.231 INFO:tasks.workunit.client.0.smithi138.stdout: } 2024-09-14T11:17:36.231 INFO:tasks.workunit.client.0.smithi138.stdout: }, 2024-09-14T11:17:36.231 INFO:tasks.workunit.client.0.smithi138.stdout: "key": { 2024-09-14T11:17:36.231 INFO:tasks.workunit.client.0.smithi138.stdout: "name": "_obj", 2024-09-14T11:17:36.231 INFO:tasks.workunit.client.0.smithi138.stdout: "instance": "v1", 2024-09-14T11:17:36.231 INFO:tasks.workunit.client.0.smithi138.stdout: "ns": "ns" 2024-09-14T11:17:36.231 INFO:tasks.workunit.client.0.smithi138.stdout: } 2024-09-14T11:17:36.231 INFO:tasks.workunit.client.0.smithi138.stdout: } 2024-09-14T11:17:36.231 INFO:tasks.workunit.client.0.smithi138.stdout:} 2024-09-14T11:17:36.231 INFO:tasks.workunit.client.0.smithi138.stdout:[ OK ] TestRGWObj.underscore (1 ms) 2024-09-14T11:17:36.231 INFO:tasks.workunit.client.0.smithi138.stdout:[ RUN ] TestRGWObj.no_underscore 2024-09-14T11:17:36.232 INFO:tasks.workunit.client.0.smithi138.stdout:parsed: obj 2024-09-14T11:17:36.232 INFO:tasks.workunit.client.0.smithi138.stdout:parsed: obj 2024-09-14T11:17:36.232 INFO:tasks.workunit.client.0.smithi138.stdout:stripped: obj ns= i= 2024-09-14T11:17:36.232 INFO:tasks.workunit.client.0.smithi138.stdout:parsed: obj 2024-09-14T11:17:36.232 INFO:tasks.workunit.client.0.smithi138.stdout:parsed: obj 2024-09-14T11:17:36.232 INFO:tasks.workunit.client.0.smithi138.stdout:stripped: obj ns= i= 2024-09-14T11:17:36.232 INFO:tasks.workunit.client.0.smithi138.stdout:parsed: obj 2024-09-14T11:17:36.232 INFO:tasks.workunit.client.0.smithi138.stdout:parsed: obj 2024-09-14T11:17:36.232 INFO:tasks.workunit.client.0.smithi138.stdout:stripped: obj ns= i= 2024-09-14T11:17:36.232 INFO:tasks.workunit.client.0.smithi138.stdout:{ 2024-09-14T11:17:36.232 INFO:tasks.workunit.client.0.smithi138.stdout: "obj1": { 2024-09-14T11:17:36.232 INFO:tasks.workunit.client.0.smithi138.stdout: "bucket": { 2024-09-14T11:17:36.232 INFO:tasks.workunit.client.0.smithi138.stdout: "name": "test", 2024-09-14T11:17:36.232 INFO:tasks.workunit.client.0.smithi138.stdout: "marker": "marker", 2024-09-14T11:17:36.233 INFO:tasks.workunit.client.0.smithi138.stdout: "bucket_id": "bucket-id", 2024-09-14T11:17:36.233 INFO:tasks.workunit.client.0.smithi138.stdout: "tenant": "", 2024-09-14T11:17:36.233 INFO:tasks.workunit.client.0.smithi138.stdout: "explicit_placement": { 2024-09-14T11:17:36.233 INFO:tasks.workunit.client.0.smithi138.stdout: "data_pool": "", 2024-09-14T11:17:36.233 INFO:tasks.workunit.client.0.smithi138.stdout: "data_extra_pool": "", 2024-09-14T11:17:36.233 INFO:tasks.workunit.client.0.smithi138.stdout: "index_pool": "" 2024-09-14T11:17:36.233 INFO:tasks.workunit.client.0.smithi138.stdout: } 2024-09-14T11:17:36.233 INFO:tasks.workunit.client.0.smithi138.stdout: }, 2024-09-14T11:17:36.233 INFO:tasks.workunit.client.0.smithi138.stdout: "key": { 2024-09-14T11:17:36.233 INFO:tasks.workunit.client.0.smithi138.stdout: "name": "obj", 2024-09-14T11:17:36.233 INFO:tasks.workunit.client.0.smithi138.stdout: "instance": "", 2024-09-14T11:17:36.233 INFO:tasks.workunit.client.0.smithi138.stdout: "ns": "" 2024-09-14T11:17:36.233 INFO:tasks.workunit.client.0.smithi138.stdout: } 2024-09-14T11:17:36.233 INFO:tasks.workunit.client.0.smithi138.stdout: }, 2024-09-14T11:17:36.234 INFO:tasks.workunit.client.0.smithi138.stdout: "obj2": { 2024-09-14T11:17:36.234 INFO:tasks.workunit.client.0.smithi138.stdout: "bucket": { 2024-09-14T11:17:36.234 INFO:tasks.workunit.client.0.smithi138.stdout: "name": "test", 2024-09-14T11:17:36.234 INFO:tasks.workunit.client.0.smithi138.stdout: "marker": "marker", 2024-09-14T11:17:36.234 INFO:tasks.workunit.client.0.smithi138.stdout: "bucket_id": "bucket-id", 2024-09-14T11:17:36.234 INFO:tasks.workunit.client.0.smithi138.stdout: "tenant": "", 2024-09-14T11:17:36.234 INFO:tasks.workunit.client.0.smithi138.stdout: "explicit_placement": { 2024-09-14T11:17:36.234 INFO:tasks.workunit.client.0.smithi138.stdout: "data_pool": "", 2024-09-14T11:17:36.234 INFO:tasks.workunit.client.0.smithi138.stdout: "data_extra_pool": "", 2024-09-14T11:17:36.234 INFO:tasks.workunit.client.0.smithi138.stdout: "index_pool": "" 2024-09-14T11:17:36.234 INFO:tasks.workunit.client.0.smithi138.stdout: } 2024-09-14T11:17:36.234 INFO:tasks.workunit.client.0.smithi138.stdout: }, 2024-09-14T11:17:36.234 INFO:tasks.workunit.client.0.smithi138.stdout: "key": { 2024-09-14T11:17:36.234 INFO:tasks.workunit.client.0.smithi138.stdout: "name": "obj", 2024-09-14T11:17:36.234 INFO:tasks.workunit.client.0.smithi138.stdout: "instance": "", 2024-09-14T11:17:36.234 INFO:tasks.workunit.client.0.smithi138.stdout: "ns": "" 2024-09-14T11:17:36.235 INFO:tasks.workunit.client.0.smithi138.stdout: } 2024-09-14T11:17:36.235 INFO:tasks.workunit.client.0.smithi138.stdout: }, 2024-09-14T11:17:36.235 INFO:tasks.workunit.client.0.smithi138.stdout: "obj3": { 2024-09-14T11:17:36.235 INFO:tasks.workunit.client.0.smithi138.stdout: "bucket": { 2024-09-14T11:17:36.235 INFO:tasks.workunit.client.0.smithi138.stdout: "name": "test", 2024-09-14T11:17:36.235 INFO:tasks.workunit.client.0.smithi138.stdout: "marker": "marker", 2024-09-14T11:17:36.235 INFO:tasks.workunit.client.0.smithi138.stdout: "bucket_id": "bucket-id", 2024-09-14T11:17:36.235 INFO:tasks.workunit.client.0.smithi138.stdout: "tenant": "", 2024-09-14T11:17:36.235 INFO:tasks.workunit.client.0.smithi138.stdout: "explicit_placement": { 2024-09-14T11:17:36.235 INFO:tasks.workunit.client.0.smithi138.stdout: "data_pool": "", 2024-09-14T11:17:36.235 INFO:tasks.workunit.client.0.smithi138.stdout: "data_extra_pool": "", 2024-09-14T11:17:36.235 INFO:tasks.workunit.client.0.smithi138.stdout: "index_pool": "" 2024-09-14T11:17:36.235 INFO:tasks.workunit.client.0.smithi138.stdout: } 2024-09-14T11:17:36.235 INFO:tasks.workunit.client.0.smithi138.stdout: }, 2024-09-14T11:17:36.235 INFO:tasks.workunit.client.0.smithi138.stdout: "key": { 2024-09-14T11:17:36.236 INFO:tasks.workunit.client.0.smithi138.stdout: "name": "obj", 2024-09-14T11:17:36.236 INFO:tasks.workunit.client.0.smithi138.stdout: "instance": "", 2024-09-14T11:17:36.236 INFO:tasks.workunit.client.0.smithi138.stdout: "ns": "" 2024-09-14T11:17:36.236 INFO:tasks.workunit.client.0.smithi138.stdout: } 2024-09-14T11:17:36.236 INFO:tasks.workunit.client.0.smithi138.stdout: }, 2024-09-14T11:17:36.236 INFO:tasks.workunit.client.0.smithi138.stdout: "obj3-2": { 2024-09-14T11:17:36.236 INFO:tasks.workunit.client.0.smithi138.stdout: "bucket": { 2024-09-14T11:17:36.236 INFO:tasks.workunit.client.0.smithi138.stdout: "name": "test", 2024-09-14T11:17:36.236 INFO:tasks.workunit.client.0.smithi138.stdout: "marker": "marker", 2024-09-14T11:17:36.236 INFO:tasks.workunit.client.0.smithi138.stdout: "bucket_id": "bucket-id", 2024-09-14T11:17:36.236 INFO:tasks.workunit.client.0.smithi138.stdout: "tenant": "", 2024-09-14T11:17:36.236 INFO:tasks.workunit.client.0.smithi138.stdout: "explicit_placement": { 2024-09-14T11:17:36.236 INFO:tasks.workunit.client.0.smithi138.stdout: "data_pool": "", 2024-09-14T11:17:36.236 INFO:tasks.workunit.client.0.smithi138.stdout: "data_extra_pool": "", 2024-09-14T11:17:36.236 INFO:tasks.workunit.client.0.smithi138.stdout: "index_pool": "" 2024-09-14T11:17:36.237 INFO:tasks.workunit.client.0.smithi138.stdout: } 2024-09-14T11:17:36.237 INFO:tasks.workunit.client.0.smithi138.stdout: }, 2024-09-14T11:17:36.237 INFO:tasks.workunit.client.0.smithi138.stdout: "key": { 2024-09-14T11:17:36.237 INFO:tasks.workunit.client.0.smithi138.stdout: "name": "obj", 2024-09-14T11:17:36.237 INFO:tasks.workunit.client.0.smithi138.stdout: "instance": "", 2024-09-14T11:17:36.237 INFO:tasks.workunit.client.0.smithi138.stdout: "ns": "" 2024-09-14T11:17:36.237 INFO:tasks.workunit.client.0.smithi138.stdout: } 2024-09-14T11:17:36.237 INFO:tasks.workunit.client.0.smithi138.stdout: } 2024-09-14T11:17:36.237 INFO:tasks.workunit.client.0.smithi138.stdout:} 2024-09-14T11:17:36.237 INFO:tasks.workunit.client.0.smithi138.stdout:parsed: obj 2024-09-14T11:17:36.237 INFO:tasks.workunit.client.0.smithi138.stdout:parsed: obj 2024-09-14T11:17:36.237 INFO:tasks.workunit.client.0.smithi138.stdout:stripped: obj ns=ns i= 2024-09-14T11:17:36.237 INFO:tasks.workunit.client.0.smithi138.stdout:parsed: obj 2024-09-14T11:17:36.237 INFO:tasks.workunit.client.0.smithi138.stdout:parsed: obj 2024-09-14T11:17:36.238 INFO:tasks.workunit.client.0.smithi138.stdout:stripped: obj ns=ns i= 2024-09-14T11:17:36.238 INFO:tasks.workunit.client.0.smithi138.stdout:parsed: obj 2024-09-14T11:17:36.238 INFO:tasks.workunit.client.0.smithi138.stdout:parsed: obj 2024-09-14T11:17:36.238 INFO:tasks.workunit.client.0.smithi138.stdout:stripped: obj ns=ns i= 2024-09-14T11:17:36.238 INFO:tasks.workunit.client.0.smithi138.stdout:{ 2024-09-14T11:17:36.238 INFO:tasks.workunit.client.0.smithi138.stdout: "obj1": { 2024-09-14T11:17:36.238 INFO:tasks.workunit.client.0.smithi138.stdout: "bucket": { 2024-09-14T11:17:36.238 INFO:tasks.workunit.client.0.smithi138.stdout: "name": "test", 2024-09-14T11:17:36.238 INFO:tasks.workunit.client.0.smithi138.stdout: "marker": "marker", 2024-09-14T11:17:36.238 INFO:tasks.workunit.client.0.smithi138.stdout: "bucket_id": "bucket-id", 2024-09-14T11:17:36.238 INFO:tasks.workunit.client.0.smithi138.stdout: "tenant": "", 2024-09-14T11:17:36.238 INFO:tasks.workunit.client.0.smithi138.stdout: "explicit_placement": { 2024-09-14T11:17:36.238 INFO:tasks.workunit.client.0.smithi138.stdout: "data_pool": "", 2024-09-14T11:17:36.238 INFO:tasks.workunit.client.0.smithi138.stdout: "data_extra_pool": "", 2024-09-14T11:17:36.238 INFO:tasks.workunit.client.0.smithi138.stdout: "index_pool": "" 2024-09-14T11:17:36.239 INFO:tasks.workunit.client.0.smithi138.stdout: } 2024-09-14T11:17:36.239 INFO:tasks.workunit.client.0.smithi138.stdout: }, 2024-09-14T11:17:36.239 INFO:tasks.workunit.client.0.smithi138.stdout: "key": { 2024-09-14T11:17:36.239 INFO:tasks.workunit.client.0.smithi138.stdout: "name": "obj", 2024-09-14T11:17:36.239 INFO:tasks.workunit.client.0.smithi138.stdout: "instance": "", 2024-09-14T11:17:36.239 INFO:tasks.workunit.client.0.smithi138.stdout: "ns": "ns" 2024-09-14T11:17:36.239 INFO:tasks.workunit.client.0.smithi138.stdout: } 2024-09-14T11:17:36.239 INFO:tasks.workunit.client.0.smithi138.stdout: }, 2024-09-14T11:17:36.239 INFO:tasks.workunit.client.0.smithi138.stdout: "obj2": { 2024-09-14T11:17:36.239 INFO:tasks.workunit.client.0.smithi138.stdout: "bucket": { 2024-09-14T11:17:36.239 INFO:tasks.workunit.client.0.smithi138.stdout: "name": "test", 2024-09-14T11:17:36.239 INFO:tasks.workunit.client.0.smithi138.stdout: "marker": "marker", 2024-09-14T11:17:36.239 INFO:tasks.workunit.client.0.smithi138.stdout: "bucket_id": "bucket-id", 2024-09-14T11:17:36.239 INFO:tasks.workunit.client.0.smithi138.stdout: "tenant": "", 2024-09-14T11:17:36.239 INFO:tasks.workunit.client.0.smithi138.stdout: "explicit_placement": { 2024-09-14T11:17:36.239 INFO:tasks.workunit.client.0.smithi138.stdout: "data_pool": "", 2024-09-14T11:17:36.240 INFO:tasks.workunit.client.0.smithi138.stdout: "data_extra_pool": "", 2024-09-14T11:17:36.240 INFO:tasks.workunit.client.0.smithi138.stdout: "index_pool": "" 2024-09-14T11:17:36.240 INFO:tasks.workunit.client.0.smithi138.stdout: } 2024-09-14T11:17:36.240 INFO:tasks.workunit.client.0.smithi138.stdout: }, 2024-09-14T11:17:36.240 INFO:tasks.workunit.client.0.smithi138.stdout: "key": { 2024-09-14T11:17:36.240 INFO:tasks.workunit.client.0.smithi138.stdout: "name": "obj", 2024-09-14T11:17:36.240 INFO:tasks.workunit.client.0.smithi138.stdout: "instance": "", 2024-09-14T11:17:36.240 INFO:tasks.workunit.client.0.smithi138.stdout: "ns": "ns" 2024-09-14T11:17:36.240 INFO:tasks.workunit.client.0.smithi138.stdout: } 2024-09-14T11:17:36.240 INFO:tasks.workunit.client.0.smithi138.stdout: }, 2024-09-14T11:17:36.240 INFO:tasks.workunit.client.0.smithi138.stdout: "obj3": { 2024-09-14T11:17:36.240 INFO:tasks.workunit.client.0.smithi138.stdout: "bucket": { 2024-09-14T11:17:36.240 INFO:tasks.workunit.client.0.smithi138.stdout: "name": "test", 2024-09-14T11:17:36.240 INFO:tasks.workunit.client.0.smithi138.stdout: "marker": "marker", 2024-09-14T11:17:36.240 INFO:tasks.workunit.client.0.smithi138.stdout: "bucket_id": "bucket-id", 2024-09-14T11:17:36.241 INFO:tasks.workunit.client.0.smithi138.stdout: "tenant": "", 2024-09-14T11:17:36.241 INFO:tasks.workunit.client.0.smithi138.stdout: "explicit_placement": { 2024-09-14T11:17:36.241 INFO:tasks.workunit.client.0.smithi138.stdout: "data_pool": "", 2024-09-14T11:17:36.241 INFO:tasks.workunit.client.0.smithi138.stdout: "data_extra_pool": "", 2024-09-14T11:17:36.241 INFO:tasks.workunit.client.0.smithi138.stdout: "index_pool": "" 2024-09-14T11:17:36.241 INFO:tasks.workunit.client.0.smithi138.stdout: } 2024-09-14T11:17:36.241 INFO:tasks.workunit.client.0.smithi138.stdout: }, 2024-09-14T11:17:36.241 INFO:tasks.workunit.client.0.smithi138.stdout: "key": { 2024-09-14T11:17:36.241 INFO:tasks.workunit.client.0.smithi138.stdout: "name": "obj", 2024-09-14T11:17:36.241 INFO:tasks.workunit.client.0.smithi138.stdout: "instance": "", 2024-09-14T11:17:36.241 INFO:tasks.workunit.client.0.smithi138.stdout: "ns": "" 2024-09-14T11:17:36.241 INFO:tasks.workunit.client.0.smithi138.stdout: } 2024-09-14T11:17:36.241 INFO:tasks.workunit.client.0.smithi138.stdout: }, 2024-09-14T11:17:36.241 INFO:tasks.workunit.client.0.smithi138.stdout: "obj3-2": { 2024-09-14T11:17:36.241 INFO:tasks.workunit.client.0.smithi138.stdout: "bucket": { 2024-09-14T11:17:36.242 INFO:tasks.workunit.client.0.smithi138.stdout: "name": "test", 2024-09-14T11:17:36.242 INFO:tasks.workunit.client.0.smithi138.stdout: "marker": "marker", 2024-09-14T11:17:36.242 INFO:tasks.workunit.client.0.smithi138.stdout: "bucket_id": "bucket-id", 2024-09-14T11:17:36.242 INFO:tasks.workunit.client.0.smithi138.stdout: "tenant": "", 2024-09-14T11:17:36.242 INFO:tasks.workunit.client.0.smithi138.stdout: "explicit_placement": { 2024-09-14T11:17:36.242 INFO:tasks.workunit.client.0.smithi138.stdout: "data_pool": "", 2024-09-14T11:17:36.242 INFO:tasks.workunit.client.0.smithi138.stdout: "data_extra_pool": "", 2024-09-14T11:17:36.242 INFO:tasks.workunit.client.0.smithi138.stdout: "index_pool": "" 2024-09-14T11:17:36.242 INFO:tasks.workunit.client.0.smithi138.stdout: } 2024-09-14T11:17:36.242 INFO:tasks.workunit.client.0.smithi138.stdout: }, 2024-09-14T11:17:36.242 INFO:tasks.workunit.client.0.smithi138.stdout: "key": { 2024-09-14T11:17:36.242 INFO:tasks.workunit.client.0.smithi138.stdout: "name": "obj", 2024-09-14T11:17:36.242 INFO:tasks.workunit.client.0.smithi138.stdout: "instance": "", 2024-09-14T11:17:36.242 INFO:tasks.workunit.client.0.smithi138.stdout: "ns": "ns" 2024-09-14T11:17:36.242 INFO:tasks.workunit.client.0.smithi138.stdout: } 2024-09-14T11:17:36.243 INFO:tasks.workunit.client.0.smithi138.stdout: } 2024-09-14T11:17:36.243 INFO:tasks.workunit.client.0.smithi138.stdout:} 2024-09-14T11:17:36.243 INFO:tasks.workunit.client.0.smithi138.stdout:parsed: obj[v1] 2024-09-14T11:17:36.243 INFO:tasks.workunit.client.0.smithi138.stdout:parsed: obj[v1] 2024-09-14T11:17:36.243 INFO:tasks.workunit.client.0.smithi138.stdout:stripped: obj ns= i=v1 2024-09-14T11:17:36.243 INFO:tasks.workunit.client.0.smithi138.stdout:parsed: obj[v1] 2024-09-14T11:17:36.243 INFO:tasks.workunit.client.0.smithi138.stdout:parsed: obj[v1] 2024-09-14T11:17:36.243 INFO:tasks.workunit.client.0.smithi138.stdout:stripped: obj ns= i=v1 2024-09-14T11:17:36.243 INFO:tasks.workunit.client.0.smithi138.stdout:parsed: obj[v1] 2024-09-14T11:17:36.243 INFO:tasks.workunit.client.0.smithi138.stdout:parsed: obj[v1] 2024-09-14T11:17:36.243 INFO:tasks.workunit.client.0.smithi138.stdout:stripped: obj ns= i=v1 2024-09-14T11:17:36.243 INFO:tasks.workunit.client.0.smithi138.stdout:{ 2024-09-14T11:17:36.243 INFO:tasks.workunit.client.0.smithi138.stdout: "obj1": { 2024-09-14T11:17:36.243 INFO:tasks.workunit.client.0.smithi138.stdout: "bucket": { 2024-09-14T11:17:36.243 INFO:tasks.workunit.client.0.smithi138.stdout: "name": "test", 2024-09-14T11:17:36.243 INFO:tasks.workunit.client.0.smithi138.stdout: "marker": "marker", 2024-09-14T11:17:36.244 INFO:tasks.workunit.client.0.smithi138.stdout: "bucket_id": "bucket-id", 2024-09-14T11:17:36.244 INFO:tasks.workunit.client.0.smithi138.stdout: "tenant": "", 2024-09-14T11:17:36.244 INFO:tasks.workunit.client.0.smithi138.stdout: "explicit_placement": { 2024-09-14T11:17:36.244 INFO:tasks.workunit.client.0.smithi138.stdout: "data_pool": "", 2024-09-14T11:17:36.244 INFO:tasks.workunit.client.0.smithi138.stdout: "data_extra_pool": "", 2024-09-14T11:17:36.244 INFO:tasks.workunit.client.0.smithi138.stdout: "index_pool": "" 2024-09-14T11:17:36.244 INFO:tasks.workunit.client.0.smithi138.stdout: } 2024-09-14T11:17:36.244 INFO:tasks.workunit.client.0.smithi138.stdout: }, 2024-09-14T11:17:36.244 INFO:tasks.workunit.client.0.smithi138.stdout: "key": { 2024-09-14T11:17:36.244 INFO:tasks.workunit.client.0.smithi138.stdout: "name": "obj", 2024-09-14T11:17:36.244 INFO:tasks.workunit.client.0.smithi138.stdout: "instance": "v1", 2024-09-14T11:17:36.244 INFO:tasks.workunit.client.0.smithi138.stdout: "ns": "" 2024-09-14T11:17:36.244 INFO:tasks.workunit.client.0.smithi138.stdout: } 2024-09-14T11:17:36.244 INFO:tasks.workunit.client.0.smithi138.stdout: }, 2024-09-14T11:17:36.244 INFO:tasks.workunit.client.0.smithi138.stdout: "obj2": { 2024-09-14T11:17:36.245 INFO:tasks.workunit.client.0.smithi138.stdout: "bucket": { 2024-09-14T11:17:36.245 INFO:tasks.workunit.client.0.smithi138.stdout: "name": "test", 2024-09-14T11:17:36.245 INFO:tasks.workunit.client.0.smithi138.stdout: "marker": "marker", 2024-09-14T11:17:36.245 INFO:tasks.workunit.client.0.smithi138.stdout: "bucket_id": "bucket-id", 2024-09-14T11:17:36.245 INFO:tasks.workunit.client.0.smithi138.stdout: "tenant": "", 2024-09-14T11:17:36.245 INFO:tasks.workunit.client.0.smithi138.stdout: "explicit_placement": { 2024-09-14T11:17:36.245 INFO:tasks.workunit.client.0.smithi138.stdout: "data_pool": "", 2024-09-14T11:17:36.245 INFO:tasks.workunit.client.0.smithi138.stdout: "data_extra_pool": "", 2024-09-14T11:17:36.245 INFO:tasks.workunit.client.0.smithi138.stdout: "index_pool": "" 2024-09-14T11:17:36.245 INFO:tasks.workunit.client.0.smithi138.stdout: } 2024-09-14T11:17:36.245 INFO:tasks.workunit.client.0.smithi138.stdout: }, 2024-09-14T11:17:36.245 INFO:tasks.workunit.client.0.smithi138.stdout: "key": { 2024-09-14T11:17:36.245 INFO:tasks.workunit.client.0.smithi138.stdout: "name": "obj", 2024-09-14T11:17:36.245 INFO:tasks.workunit.client.0.smithi138.stdout: "instance": "v1", 2024-09-14T11:17:36.245 INFO:tasks.workunit.client.0.smithi138.stdout: "ns": "" 2024-09-14T11:17:36.246 INFO:tasks.workunit.client.0.smithi138.stdout: } 2024-09-14T11:17:36.246 INFO:tasks.workunit.client.0.smithi138.stdout: }, 2024-09-14T11:17:36.246 INFO:tasks.workunit.client.0.smithi138.stdout: "obj3": { 2024-09-14T11:17:36.246 INFO:tasks.workunit.client.0.smithi138.stdout: "bucket": { 2024-09-14T11:17:36.246 INFO:tasks.workunit.client.0.smithi138.stdout: "name": "test", 2024-09-14T11:17:36.246 INFO:tasks.workunit.client.0.smithi138.stdout: "marker": "marker", 2024-09-14T11:17:36.246 INFO:tasks.workunit.client.0.smithi138.stdout: "bucket_id": "bucket-id", 2024-09-14T11:17:36.246 INFO:tasks.workunit.client.0.smithi138.stdout: "tenant": "", 2024-09-14T11:17:36.246 INFO:tasks.workunit.client.0.smithi138.stdout: "explicit_placement": { 2024-09-14T11:17:36.246 INFO:tasks.workunit.client.0.smithi138.stdout: "data_pool": "", 2024-09-14T11:17:36.246 INFO:tasks.workunit.client.0.smithi138.stdout: "data_extra_pool": "", 2024-09-14T11:17:36.246 INFO:tasks.workunit.client.0.smithi138.stdout: "index_pool": "" 2024-09-14T11:17:36.247 INFO:tasks.workunit.client.0.smithi138.stdout: } 2024-09-14T11:17:36.247 INFO:tasks.workunit.client.0.smithi138.stdout: }, 2024-09-14T11:17:36.247 INFO:tasks.workunit.client.0.smithi138.stdout: "key": { 2024-09-14T11:17:36.247 INFO:tasks.workunit.client.0.smithi138.stdout: "name": "obj", 2024-09-14T11:17:36.247 INFO:tasks.workunit.client.0.smithi138.stdout: "instance": "", 2024-09-14T11:17:36.247 INFO:tasks.workunit.client.0.smithi138.stdout: "ns": "" 2024-09-14T11:17:36.247 INFO:tasks.workunit.client.0.smithi138.stdout: } 2024-09-14T11:17:36.247 INFO:tasks.workunit.client.0.smithi138.stdout: }, 2024-09-14T11:17:36.247 INFO:tasks.workunit.client.0.smithi138.stdout: "obj3-2": { 2024-09-14T11:17:36.247 INFO:tasks.workunit.client.0.smithi138.stdout: "bucket": { 2024-09-14T11:17:36.247 INFO:tasks.workunit.client.0.smithi138.stdout: "name": "test", 2024-09-14T11:17:36.247 INFO:tasks.workunit.client.0.smithi138.stdout: "marker": "marker", 2024-09-14T11:17:36.247 INFO:tasks.workunit.client.0.smithi138.stdout: "bucket_id": "bucket-id", 2024-09-14T11:17:36.247 INFO:tasks.workunit.client.0.smithi138.stdout: "tenant": "", 2024-09-14T11:17:36.247 INFO:tasks.workunit.client.0.smithi138.stdout: "explicit_placement": { 2024-09-14T11:17:36.247 INFO:tasks.workunit.client.0.smithi138.stdout: "data_pool": "", 2024-09-14T11:17:36.248 INFO:tasks.workunit.client.0.smithi138.stdout: "data_extra_pool": "", 2024-09-14T11:17:36.248 INFO:tasks.workunit.client.0.smithi138.stdout: "index_pool": "" 2024-09-14T11:17:36.248 INFO:tasks.workunit.client.0.smithi138.stdout: } 2024-09-14T11:17:36.248 INFO:tasks.workunit.client.0.smithi138.stdout: }, 2024-09-14T11:17:36.248 INFO:tasks.workunit.client.0.smithi138.stdout: "key": { 2024-09-14T11:17:36.248 INFO:tasks.workunit.client.0.smithi138.stdout: "name": "obj", 2024-09-14T11:17:36.248 INFO:tasks.workunit.client.0.smithi138.stdout: "instance": "v1", 2024-09-14T11:17:36.248 INFO:tasks.workunit.client.0.smithi138.stdout: "ns": "" 2024-09-14T11:17:36.248 INFO:tasks.workunit.client.0.smithi138.stdout: } 2024-09-14T11:17:36.248 INFO:tasks.workunit.client.0.smithi138.stdout: } 2024-09-14T11:17:36.248 INFO:tasks.workunit.client.0.smithi138.stdout:} 2024-09-14T11:17:36.248 INFO:tasks.workunit.client.0.smithi138.stdout:parsed: obj[v1] 2024-09-14T11:17:36.248 INFO:tasks.workunit.client.0.smithi138.stdout:parsed: obj[v1] 2024-09-14T11:17:36.248 INFO:tasks.workunit.client.0.smithi138.stdout:stripped: obj ns=ns i=v1 2024-09-14T11:17:36.248 INFO:tasks.workunit.client.0.smithi138.stdout:parsed: obj[v1] 2024-09-14T11:17:36.249 INFO:tasks.workunit.client.0.smithi138.stdout:parsed: obj[v1] 2024-09-14T11:17:36.249 INFO:tasks.workunit.client.0.smithi138.stdout:stripped: obj ns=ns i=v1 2024-09-14T11:17:36.249 INFO:tasks.workunit.client.0.smithi138.stdout:parsed: obj[v1] 2024-09-14T11:17:36.249 INFO:tasks.workunit.client.0.smithi138.stdout:parsed: obj[v1] 2024-09-14T11:17:36.249 INFO:tasks.workunit.client.0.smithi138.stdout:stripped: obj ns=ns i=v1 2024-09-14T11:17:36.249 INFO:tasks.workunit.client.0.smithi138.stdout:{ 2024-09-14T11:17:36.249 INFO:tasks.workunit.client.0.smithi138.stdout: "obj1": { 2024-09-14T11:17:36.249 INFO:tasks.workunit.client.0.smithi138.stdout: "bucket": { 2024-09-14T11:17:36.249 INFO:tasks.workunit.client.0.smithi138.stdout: "name": "test", 2024-09-14T11:17:36.249 INFO:tasks.workunit.client.0.smithi138.stdout: "marker": "marker", 2024-09-14T11:17:36.249 INFO:tasks.workunit.client.0.smithi138.stdout: "bucket_id": "bucket-id", 2024-09-14T11:17:36.249 INFO:tasks.workunit.client.0.smithi138.stdout: "tenant": "", 2024-09-14T11:17:36.249 INFO:tasks.workunit.client.0.smithi138.stdout: "explicit_placement": { 2024-09-14T11:17:36.249 INFO:tasks.workunit.client.0.smithi138.stdout: "data_pool": "", 2024-09-14T11:17:36.249 INFO:tasks.workunit.client.0.smithi138.stdout: "data_extra_pool": "", 2024-09-14T11:17:36.250 INFO:tasks.workunit.client.0.smithi138.stdout: "index_pool": "" 2024-09-14T11:17:36.250 INFO:tasks.workunit.client.0.smithi138.stdout: } 2024-09-14T11:17:36.250 INFO:tasks.workunit.client.0.smithi138.stdout: }, 2024-09-14T11:17:36.250 INFO:tasks.workunit.client.0.smithi138.stdout: "key": { 2024-09-14T11:17:36.250 INFO:tasks.workunit.client.0.smithi138.stdout: "name": "obj", 2024-09-14T11:17:36.250 INFO:tasks.workunit.client.0.smithi138.stdout: "instance": "v1", 2024-09-14T11:17:36.250 INFO:tasks.workunit.client.0.smithi138.stdout: "ns": "ns" 2024-09-14T11:17:36.250 INFO:tasks.workunit.client.0.smithi138.stdout: } 2024-09-14T11:17:36.250 INFO:tasks.workunit.client.0.smithi138.stdout: }, 2024-09-14T11:17:36.250 INFO:tasks.workunit.client.0.smithi138.stdout: "obj2": { 2024-09-14T11:17:36.250 INFO:tasks.workunit.client.0.smithi138.stdout: "bucket": { 2024-09-14T11:17:36.250 INFO:tasks.workunit.client.0.smithi138.stdout: "name": "test", 2024-09-14T11:17:36.250 INFO:tasks.workunit.client.0.smithi138.stdout: "marker": "marker", 2024-09-14T11:17:36.250 INFO:tasks.workunit.client.0.smithi138.stdout: "bucket_id": "bucket-id", 2024-09-14T11:17:36.250 INFO:tasks.workunit.client.0.smithi138.stdout: "tenant": "", 2024-09-14T11:17:36.251 INFO:tasks.workunit.client.0.smithi138.stdout: "explicit_placement": { 2024-09-14T11:17:36.251 INFO:tasks.workunit.client.0.smithi138.stdout: "data_pool": "", 2024-09-14T11:17:36.251 INFO:tasks.workunit.client.0.smithi138.stdout: "data_extra_pool": "", 2024-09-14T11:17:36.251 INFO:tasks.workunit.client.0.smithi138.stdout: "index_pool": "" 2024-09-14T11:17:36.251 INFO:tasks.workunit.client.0.smithi138.stdout: } 2024-09-14T11:17:36.251 INFO:tasks.workunit.client.0.smithi138.stdout: }, 2024-09-14T11:17:36.251 INFO:tasks.workunit.client.0.smithi138.stdout: "key": { 2024-09-14T11:17:36.251 INFO:tasks.workunit.client.0.smithi138.stdout: "name": "obj", 2024-09-14T11:17:36.251 INFO:tasks.workunit.client.0.smithi138.stdout: "instance": "v1", 2024-09-14T11:17:36.251 INFO:tasks.workunit.client.0.smithi138.stdout: "ns": "ns" 2024-09-14T11:17:36.251 INFO:tasks.workunit.client.0.smithi138.stdout: } 2024-09-14T11:17:36.251 INFO:tasks.workunit.client.0.smithi138.stdout: }, 2024-09-14T11:17:36.251 INFO:tasks.workunit.client.0.smithi138.stdout: "obj3": { 2024-09-14T11:17:36.251 INFO:tasks.workunit.client.0.smithi138.stdout: "bucket": { 2024-09-14T11:17:36.251 INFO:tasks.workunit.client.0.smithi138.stdout: "name": "test", 2024-09-14T11:17:36.252 INFO:tasks.workunit.client.0.smithi138.stdout: "marker": "marker", 2024-09-14T11:17:36.252 INFO:tasks.workunit.client.0.smithi138.stdout: "bucket_id": "bucket-id", 2024-09-14T11:17:36.252 INFO:tasks.workunit.client.0.smithi138.stdout: "tenant": "", 2024-09-14T11:17:36.252 INFO:tasks.workunit.client.0.smithi138.stdout: "explicit_placement": { 2024-09-14T11:17:36.252 INFO:tasks.workunit.client.0.smithi138.stdout: "data_pool": "", 2024-09-14T11:17:36.252 INFO:tasks.workunit.client.0.smithi138.stdout: "data_extra_pool": "", 2024-09-14T11:17:36.252 INFO:tasks.workunit.client.0.smithi138.stdout: "index_pool": "" 2024-09-14T11:17:36.252 INFO:tasks.workunit.client.0.smithi138.stdout: } 2024-09-14T11:17:36.252 INFO:tasks.workunit.client.0.smithi138.stdout: }, 2024-09-14T11:17:36.252 INFO:tasks.workunit.client.0.smithi138.stdout: "key": { 2024-09-14T11:17:36.252 INFO:tasks.workunit.client.0.smithi138.stdout: "name": "obj", 2024-09-14T11:17:36.252 INFO:tasks.workunit.client.0.smithi138.stdout: "instance": "", 2024-09-14T11:17:36.252 INFO:tasks.workunit.client.0.smithi138.stdout: "ns": "" 2024-09-14T11:17:36.252 INFO:tasks.workunit.client.0.smithi138.stdout: } 2024-09-14T11:17:36.253 INFO:tasks.workunit.client.0.smithi138.stdout: }, 2024-09-14T11:17:36.253 INFO:tasks.workunit.client.0.smithi138.stdout: "obj3-2": { 2024-09-14T11:17:36.253 INFO:tasks.workunit.client.0.smithi138.stdout: "bucket": { 2024-09-14T11:17:36.253 INFO:tasks.workunit.client.0.smithi138.stdout: "name": "test", 2024-09-14T11:17:36.253 INFO:tasks.workunit.client.0.smithi138.stdout: "marker": "marker", 2024-09-14T11:17:36.253 INFO:tasks.workunit.client.0.smithi138.stdout: "bucket_id": "bucket-id", 2024-09-14T11:17:36.253 INFO:tasks.workunit.client.0.smithi138.stdout: "tenant": "", 2024-09-14T11:17:36.253 INFO:tasks.workunit.client.0.smithi138.stdout: "explicit_placement": { 2024-09-14T11:17:36.253 INFO:tasks.workunit.client.0.smithi138.stdout: "data_pool": "", 2024-09-14T11:17:36.253 INFO:tasks.workunit.client.0.smithi138.stdout: "data_extra_pool": "", 2024-09-14T11:17:36.253 INFO:tasks.workunit.client.0.smithi138.stdout: "index_pool": "" 2024-09-14T11:17:36.253 INFO:tasks.workunit.client.0.smithi138.stdout: } 2024-09-14T11:17:36.253 INFO:tasks.workunit.client.0.smithi138.stdout: }, 2024-09-14T11:17:36.253 INFO:tasks.workunit.client.0.smithi138.stdout: "key": { 2024-09-14T11:17:36.254 INFO:tasks.workunit.client.0.smithi138.stdout: "name": "obj", 2024-09-14T11:17:36.254 INFO:tasks.workunit.client.0.smithi138.stdout: "instance": "v1", 2024-09-14T11:17:36.254 INFO:tasks.workunit.client.0.smithi138.stdout: "ns": "ns" 2024-09-14T11:17:36.254 INFO:tasks.workunit.client.0.smithi138.stdout: } 2024-09-14T11:17:36.254 INFO:tasks.workunit.client.0.smithi138.stdout: } 2024-09-14T11:17:36.254 INFO:tasks.workunit.client.0.smithi138.stdout:} 2024-09-14T11:17:36.254 INFO:tasks.workunit.client.0.smithi138.stdout:[ OK ] TestRGWObj.no_underscore (0 ms) 2024-09-14T11:17:36.254 INFO:tasks.workunit.client.0.smithi138.stdout:[ RUN ] TestRGWObj.obj_to_raw 2024-09-14T11:17:36.254 INFO:tasks.workunit.client.0.smithi138.stdout:{ 2024-09-14T11:17:36.254 INFO:tasks.workunit.client.0.smithi138.stdout: "bucket": { 2024-09-14T11:17:36.254 INFO:tasks.workunit.client.0.smithi138.stdout: "name": "test", 2024-09-14T11:17:36.254 INFO:tasks.workunit.client.0.smithi138.stdout: "marker": "marker", 2024-09-14T11:17:36.254 INFO:tasks.workunit.client.0.smithi138.stdout: "bucket_id": "bucket-id", 2024-09-14T11:17:36.255 INFO:tasks.workunit.client.0.smithi138.stdout: "tenant": "", 2024-09-14T11:17:36.255 INFO:tasks.workunit.client.0.smithi138.stdout: "explicit_placement": { 2024-09-14T11:17:36.255 INFO:tasks.workunit.client.0.smithi138.stdout: "data_pool": "", 2024-09-14T11:17:36.255 INFO:tasks.workunit.client.0.smithi138.stdout: "data_extra_pool": "", 2024-09-14T11:17:36.255 INFO:tasks.workunit.client.0.smithi138.stdout: "index_pool": "" 2024-09-14T11:17:36.255 INFO:tasks.workunit.client.0.smithi138.stdout: } 2024-09-14T11:17:36.255 INFO:tasks.workunit.client.0.smithi138.stdout: } 2024-09-14T11:17:36.255 INFO:tasks.workunit.client.0.smithi138.stdout:} 2024-09-14T11:17:36.255 INFO:tasks.workunit.client.0.smithi138.stdout:{ 2024-09-14T11:17:36.255 INFO:tasks.workunit.client.0.smithi138.stdout: "obj": { 2024-09-14T11:17:36.255 INFO:tasks.workunit.client.0.smithi138.stdout: "bucket": { 2024-09-14T11:17:36.255 INFO:tasks.workunit.client.0.smithi138.stdout: "name": "test", 2024-09-14T11:17:36.255 INFO:tasks.workunit.client.0.smithi138.stdout: "marker": "marker", 2024-09-14T11:17:36.255 INFO:tasks.workunit.client.0.smithi138.stdout: "bucket_id": "bucket-id", 2024-09-14T11:17:36.255 INFO:tasks.workunit.client.0.smithi138.stdout: "tenant": "", 2024-09-14T11:17:36.256 INFO:tasks.workunit.client.0.smithi138.stdout: "explicit_placement": { 2024-09-14T11:17:36.256 INFO:tasks.workunit.client.0.smithi138.stdout: "data_pool": "", 2024-09-14T11:17:36.256 INFO:tasks.workunit.client.0.smithi138.stdout: "data_extra_pool": "", 2024-09-14T11:17:36.256 INFO:tasks.workunit.client.0.smithi138.stdout: "index_pool": "" 2024-09-14T11:17:36.256 INFO:tasks.workunit.client.0.smithi138.stdout: } 2024-09-14T11:17:36.256 INFO:tasks.workunit.client.0.smithi138.stdout: }, 2024-09-14T11:17:36.256 INFO:tasks.workunit.client.0.smithi138.stdout: "key": { 2024-09-14T11:17:36.256 INFO:tasks.workunit.client.0.smithi138.stdout: "name": "myobj", 2024-09-14T11:17:36.256 INFO:tasks.workunit.client.0.smithi138.stdout: "instance": "", 2024-09-14T11:17:36.256 INFO:tasks.workunit.client.0.smithi138.stdout: "ns": "" 2024-09-14T11:17:36.256 INFO:tasks.workunit.client.0.smithi138.stdout: } 2024-09-14T11:17:36.256 INFO:tasks.workunit.client.0.smithi138.stdout: } 2024-09-14T11:17:36.256 INFO:tasks.workunit.client.0.smithi138.stdout:} 2024-09-14T11:17:36.256 INFO:tasks.workunit.client.0.smithi138.stdout:{ 2024-09-14T11:17:36.257 INFO:tasks.workunit.client.0.smithi138.stdout: "raw_obj": { 2024-09-14T11:17:36.257 INFO:tasks.workunit.client.0.smithi138.stdout: "pool": "default-placement.data", 2024-09-14T11:17:36.257 INFO:tasks.workunit.client.0.smithi138.stdout: "oid": "marker_myobj", 2024-09-14T11:17:36.257 INFO:tasks.workunit.client.0.smithi138.stdout: "loc": "" 2024-09-14T11:17:36.257 INFO:tasks.workunit.client.0.smithi138.stdout: } 2024-09-14T11:17:36.257 INFO:tasks.workunit.client.0.smithi138.stdout:} 2024-09-14T11:17:36.257 INFO:tasks.workunit.client.0.smithi138.stdout:{ 2024-09-14T11:17:36.257 INFO:tasks.workunit.client.0.smithi138.stdout: "new_obj": { 2024-09-14T11:17:36.257 INFO:tasks.workunit.client.0.smithi138.stdout: "bucket": { 2024-09-14T11:17:36.257 INFO:tasks.workunit.client.0.smithi138.stdout: "name": "test", 2024-09-14T11:17:36.257 INFO:tasks.workunit.client.0.smithi138.stdout: "marker": "marker", 2024-09-14T11:17:36.257 INFO:tasks.workunit.client.0.smithi138.stdout: "bucket_id": "bucket-id", 2024-09-14T11:17:36.257 INFO:tasks.workunit.client.0.smithi138.stdout: "tenant": "", 2024-09-14T11:17:36.257 INFO:tasks.workunit.client.0.smithi138.stdout: "explicit_placement": { 2024-09-14T11:17:36.258 INFO:tasks.workunit.client.0.smithi138.stdout: "data_pool": "", 2024-09-14T11:17:36.258 INFO:tasks.workunit.client.0.smithi138.stdout: "data_extra_pool": "", 2024-09-14T11:17:36.258 INFO:tasks.workunit.client.0.smithi138.stdout: "index_pool": "" 2024-09-14T11:17:36.258 INFO:tasks.workunit.client.0.smithi138.stdout: } 2024-09-14T11:17:36.258 INFO:tasks.workunit.client.0.smithi138.stdout: }, 2024-09-14T11:17:36.258 INFO:tasks.workunit.client.0.smithi138.stdout: "key": { 2024-09-14T11:17:36.258 INFO:tasks.workunit.client.0.smithi138.stdout: "name": "myobj", 2024-09-14T11:17:36.258 INFO:tasks.workunit.client.0.smithi138.stdout: "instance": "", 2024-09-14T11:17:36.258 INFO:tasks.workunit.client.0.smithi138.stdout: "ns": "" 2024-09-14T11:17:36.258 INFO:tasks.workunit.client.0.smithi138.stdout: } 2024-09-14T11:17:36.258 INFO:tasks.workunit.client.0.smithi138.stdout: } 2024-09-14T11:17:36.258 INFO:tasks.workunit.client.0.smithi138.stdout:} 2024-09-14T11:17:36.259 INFO:tasks.workunit.client.0.smithi138.stdout:{ 2024-09-14T11:17:36.259 INFO:tasks.workunit.client.0.smithi138.stdout: "bucket": { 2024-09-14T11:17:36.259 INFO:tasks.workunit.client.0.smithi138.stdout: "name": "ebtest", 2024-09-14T11:17:36.259 INFO:tasks.workunit.client.0.smithi138.stdout: "marker": "marker", 2024-09-14T11:17:36.259 INFO:tasks.workunit.client.0.smithi138.stdout: "bucket_id": "bucket-id", 2024-09-14T11:17:36.259 INFO:tasks.workunit.client.0.smithi138.stdout: "tenant": "", 2024-09-14T11:17:36.259 INFO:tasks.workunit.client.0.smithi138.stdout: "explicit_placement": { 2024-09-14T11:17:36.259 INFO:tasks.workunit.client.0.smithi138.stdout: "data_pool": ".data-pool", 2024-09-14T11:17:36.259 INFO:tasks.workunit.client.0.smithi138.stdout: "data_extra_pool": "", 2024-09-14T11:17:36.259 INFO:tasks.workunit.client.0.smithi138.stdout: "index_pool": ".index-pool" 2024-09-14T11:17:36.259 INFO:tasks.workunit.client.0.smithi138.stdout: } 2024-09-14T11:17:36.259 INFO:tasks.workunit.client.0.smithi138.stdout: } 2024-09-14T11:17:36.259 INFO:tasks.workunit.client.0.smithi138.stdout:} 2024-09-14T11:17:36.259 INFO:tasks.workunit.client.0.smithi138.stdout:{ 2024-09-14T11:17:36.260 INFO:tasks.workunit.client.0.smithi138.stdout: "obj": { 2024-09-14T11:17:36.260 INFO:tasks.workunit.client.0.smithi138.stdout: "bucket": { 2024-09-14T11:17:36.260 INFO:tasks.workunit.client.0.smithi138.stdout: "name": "ebtest", 2024-09-14T11:17:36.260 INFO:tasks.workunit.client.0.smithi138.stdout: "marker": "marker", 2024-09-14T11:17:36.260 INFO:tasks.workunit.client.0.smithi138.stdout: "bucket_id": "bucket-id", 2024-09-14T11:17:36.260 INFO:tasks.workunit.client.0.smithi138.stdout: "tenant": "", 2024-09-14T11:17:36.260 INFO:tasks.workunit.client.0.smithi138.stdout: "explicit_placement": { 2024-09-14T11:17:36.260 INFO:tasks.workunit.client.0.smithi138.stdout: "data_pool": ".data-pool", 2024-09-14T11:17:36.260 INFO:tasks.workunit.client.0.smithi138.stdout: "data_extra_pool": "", 2024-09-14T11:17:36.260 INFO:tasks.workunit.client.0.smithi138.stdout: "index_pool": ".index-pool" 2024-09-14T11:17:36.260 INFO:tasks.workunit.client.0.smithi138.stdout: } 2024-09-14T11:17:36.260 INFO:tasks.workunit.client.0.smithi138.stdout: }, 2024-09-14T11:17:36.260 INFO:tasks.workunit.client.0.smithi138.stdout: "key": { 2024-09-14T11:17:36.260 INFO:tasks.workunit.client.0.smithi138.stdout: "name": "myobj", 2024-09-14T11:17:36.261 INFO:tasks.workunit.client.0.smithi138.stdout: "instance": "", 2024-09-14T11:17:36.261 INFO:tasks.workunit.client.0.smithi138.stdout: "ns": "" 2024-09-14T11:17:36.261 INFO:tasks.workunit.client.0.smithi138.stdout: } 2024-09-14T11:17:36.261 INFO:tasks.workunit.client.0.smithi138.stdout: } 2024-09-14T11:17:36.261 INFO:tasks.workunit.client.0.smithi138.stdout:} 2024-09-14T11:17:36.261 INFO:tasks.workunit.client.0.smithi138.stdout:{ 2024-09-14T11:17:36.261 INFO:tasks.workunit.client.0.smithi138.stdout: "raw_obj": { 2024-09-14T11:17:36.261 INFO:tasks.workunit.client.0.smithi138.stdout: "pool": ".data-pool", 2024-09-14T11:17:36.261 INFO:tasks.workunit.client.0.smithi138.stdout: "oid": "marker_myobj", 2024-09-14T11:17:36.261 INFO:tasks.workunit.client.0.smithi138.stdout: "loc": "" 2024-09-14T11:17:36.261 INFO:tasks.workunit.client.0.smithi138.stdout: } 2024-09-14T11:17:36.261 INFO:tasks.workunit.client.0.smithi138.stdout:} 2024-09-14T11:17:36.261 INFO:tasks.workunit.client.0.smithi138.stdout:{ 2024-09-14T11:17:36.262 INFO:tasks.workunit.client.0.smithi138.stdout: "new_obj": { 2024-09-14T11:17:36.262 INFO:tasks.workunit.client.0.smithi138.stdout: "bucket": { 2024-09-14T11:17:36.262 INFO:tasks.workunit.client.0.smithi138.stdout: "name": "ebtest", 2024-09-14T11:17:36.262 INFO:tasks.workunit.client.0.smithi138.stdout: "marker": "marker", 2024-09-14T11:17:36.262 INFO:tasks.workunit.client.0.smithi138.stdout: "bucket_id": "bucket-id", 2024-09-14T11:17:36.262 INFO:tasks.workunit.client.0.smithi138.stdout: "tenant": "", 2024-09-14T11:17:36.262 INFO:tasks.workunit.client.0.smithi138.stdout: "explicit_placement": { 2024-09-14T11:17:36.262 INFO:tasks.workunit.client.0.smithi138.stdout: "data_pool": ".data-pool", 2024-09-14T11:17:36.262 INFO:tasks.workunit.client.0.smithi138.stdout: "data_extra_pool": "", 2024-09-14T11:17:36.262 INFO:tasks.workunit.client.0.smithi138.stdout: "index_pool": ".index-pool" 2024-09-14T11:17:36.262 INFO:tasks.workunit.client.0.smithi138.stdout: } 2024-09-14T11:17:36.262 INFO:tasks.workunit.client.0.smithi138.stdout: }, 2024-09-14T11:17:36.262 INFO:tasks.workunit.client.0.smithi138.stdout: "key": { 2024-09-14T11:17:36.262 INFO:tasks.workunit.client.0.smithi138.stdout: "name": "myobj", 2024-09-14T11:17:36.262 INFO:tasks.workunit.client.0.smithi138.stdout: "instance": "", 2024-09-14T11:17:36.263 INFO:tasks.workunit.client.0.smithi138.stdout: "ns": "" 2024-09-14T11:17:36.263 INFO:tasks.workunit.client.0.smithi138.stdout: } 2024-09-14T11:17:36.263 INFO:tasks.workunit.client.0.smithi138.stdout: } 2024-09-14T11:17:36.263 INFO:tasks.workunit.client.0.smithi138.stdout:} 2024-09-14T11:17:36.263 INFO:tasks.workunit.client.0.smithi138.stdout:{ 2024-09-14T11:17:36.263 INFO:tasks.workunit.client.0.smithi138.stdout: "bucket": { 2024-09-14T11:17:36.263 INFO:tasks.workunit.client.0.smithi138.stdout: "name": "test", 2024-09-14T11:17:36.263 INFO:tasks.workunit.client.0.smithi138.stdout: "marker": "marker", 2024-09-14T11:17:36.263 INFO:tasks.workunit.client.0.smithi138.stdout: "bucket_id": "bucket-id", 2024-09-14T11:17:36.263 INFO:tasks.workunit.client.0.smithi138.stdout: "tenant": "", 2024-09-14T11:17:36.263 INFO:tasks.workunit.client.0.smithi138.stdout: "explicit_placement": { 2024-09-14T11:17:36.263 INFO:tasks.workunit.client.0.smithi138.stdout: "data_pool": "", 2024-09-14T11:17:36.263 INFO:tasks.workunit.client.0.smithi138.stdout: "data_extra_pool": "", 2024-09-14T11:17:36.263 INFO:tasks.workunit.client.0.smithi138.stdout: "index_pool": "" 2024-09-14T11:17:36.264 INFO:tasks.workunit.client.0.smithi138.stdout: } 2024-09-14T11:17:36.264 INFO:tasks.workunit.client.0.smithi138.stdout: } 2024-09-14T11:17:36.264 INFO:tasks.workunit.client.0.smithi138.stdout:} 2024-09-14T11:17:36.264 INFO:tasks.workunit.client.0.smithi138.stdout:{ 2024-09-14T11:17:36.264 INFO:tasks.workunit.client.0.smithi138.stdout: "obj": { 2024-09-14T11:17:36.264 INFO:tasks.workunit.client.0.smithi138.stdout: "bucket": { 2024-09-14T11:17:36.264 INFO:tasks.workunit.client.0.smithi138.stdout: "name": "test", 2024-09-14T11:17:36.264 INFO:tasks.workunit.client.0.smithi138.stdout: "marker": "marker", 2024-09-14T11:17:36.264 INFO:tasks.workunit.client.0.smithi138.stdout: "bucket_id": "bucket-id", 2024-09-14T11:17:36.264 INFO:tasks.workunit.client.0.smithi138.stdout: "tenant": "", 2024-09-14T11:17:36.264 INFO:tasks.workunit.client.0.smithi138.stdout: "explicit_placement": { 2024-09-14T11:17:36.264 INFO:tasks.workunit.client.0.smithi138.stdout: "data_pool": "", 2024-09-14T11:17:36.264 INFO:tasks.workunit.client.0.smithi138.stdout: "data_extra_pool": "", 2024-09-14T11:17:36.264 INFO:tasks.workunit.client.0.smithi138.stdout: "index_pool": "" 2024-09-14T11:17:36.264 INFO:tasks.workunit.client.0.smithi138.stdout: } 2024-09-14T11:17:36.265 INFO:tasks.workunit.client.0.smithi138.stdout: }, 2024-09-14T11:17:36.265 INFO:tasks.workunit.client.0.smithi138.stdout: "key": { 2024-09-14T11:17:36.265 INFO:tasks.workunit.client.0.smithi138.stdout: "name": "myobj", 2024-09-14T11:17:36.265 INFO:tasks.workunit.client.0.smithi138.stdout: "instance": "", 2024-09-14T11:17:36.265 INFO:tasks.workunit.client.0.smithi138.stdout: "ns": "ns" 2024-09-14T11:17:36.265 INFO:tasks.workunit.client.0.smithi138.stdout: } 2024-09-14T11:17:36.265 INFO:tasks.workunit.client.0.smithi138.stdout: } 2024-09-14T11:17:36.265 INFO:tasks.workunit.client.0.smithi138.stdout:} 2024-09-14T11:17:36.265 INFO:tasks.workunit.client.0.smithi138.stdout:{ 2024-09-14T11:17:36.265 INFO:tasks.workunit.client.0.smithi138.stdout: "raw_obj": { 2024-09-14T11:17:36.266 INFO:tasks.workunit.client.0.smithi138.stdout: "pool": "default-placement.data", 2024-09-14T11:17:36.266 INFO:tasks.workunit.client.0.smithi138.stdout: "oid": "marker__ns_myobj", 2024-09-14T11:17:36.266 INFO:tasks.workunit.client.0.smithi138.stdout: "loc": "" 2024-09-14T11:17:36.266 INFO:tasks.workunit.client.0.smithi138.stdout: } 2024-09-14T11:17:36.266 INFO:tasks.workunit.client.0.smithi138.stdout:} 2024-09-14T11:17:36.266 INFO:tasks.workunit.client.0.smithi138.stdout:{ 2024-09-14T11:17:36.266 INFO:tasks.workunit.client.0.smithi138.stdout: "new_obj": { 2024-09-14T11:17:36.266 INFO:tasks.workunit.client.0.smithi138.stdout: "bucket": { 2024-09-14T11:17:36.266 INFO:tasks.workunit.client.0.smithi138.stdout: "name": "test", 2024-09-14T11:17:36.266 INFO:tasks.workunit.client.0.smithi138.stdout: "marker": "marker", 2024-09-14T11:17:36.266 INFO:tasks.workunit.client.0.smithi138.stdout: "bucket_id": "bucket-id", 2024-09-14T11:17:36.266 INFO:tasks.workunit.client.0.smithi138.stdout: "tenant": "", 2024-09-14T11:17:36.266 INFO:tasks.workunit.client.0.smithi138.stdout: "explicit_placement": { 2024-09-14T11:17:36.266 INFO:tasks.workunit.client.0.smithi138.stdout: "data_pool": "", 2024-09-14T11:17:36.266 INFO:tasks.workunit.client.0.smithi138.stdout: "data_extra_pool": "", 2024-09-14T11:17:36.267 INFO:tasks.workunit.client.0.smithi138.stdout: "index_pool": "" 2024-09-14T11:17:36.267 INFO:tasks.workunit.client.0.smithi138.stdout: } 2024-09-14T11:17:36.267 INFO:tasks.workunit.client.0.smithi138.stdout: }, 2024-09-14T11:17:36.267 INFO:tasks.workunit.client.0.smithi138.stdout: "key": { 2024-09-14T11:17:36.267 INFO:tasks.workunit.client.0.smithi138.stdout: "name": "myobj", 2024-09-14T11:17:36.267 INFO:tasks.workunit.client.0.smithi138.stdout: "instance": "", 2024-09-14T11:17:36.267 INFO:tasks.workunit.client.0.smithi138.stdout: "ns": "ns" 2024-09-14T11:17:36.267 INFO:tasks.workunit.client.0.smithi138.stdout: } 2024-09-14T11:17:36.267 INFO:tasks.workunit.client.0.smithi138.stdout: } 2024-09-14T11:17:36.267 INFO:tasks.workunit.client.0.smithi138.stdout:} 2024-09-14T11:17:36.267 INFO:tasks.workunit.client.0.smithi138.stdout:{ 2024-09-14T11:17:36.267 INFO:tasks.workunit.client.0.smithi138.stdout: "bucket": { 2024-09-14T11:17:36.267 INFO:tasks.workunit.client.0.smithi138.stdout: "name": "ebtest", 2024-09-14T11:17:36.268 INFO:tasks.workunit.client.0.smithi138.stdout: "marker": "marker", 2024-09-14T11:17:36.268 INFO:tasks.workunit.client.0.smithi138.stdout: "bucket_id": "bucket-id", 2024-09-14T11:17:36.268 INFO:tasks.workunit.client.0.smithi138.stdout: "tenant": "", 2024-09-14T11:17:36.268 INFO:tasks.workunit.client.0.smithi138.stdout: "explicit_placement": { 2024-09-14T11:17:36.268 INFO:tasks.workunit.client.0.smithi138.stdout: "data_pool": ".data-pool", 2024-09-14T11:17:36.268 INFO:tasks.workunit.client.0.smithi138.stdout: "data_extra_pool": "", 2024-09-14T11:17:36.268 INFO:tasks.workunit.client.0.smithi138.stdout: "index_pool": ".index-pool" 2024-09-14T11:17:36.268 INFO:tasks.workunit.client.0.smithi138.stdout: } 2024-09-14T11:17:36.268 INFO:tasks.workunit.client.0.smithi138.stdout: } 2024-09-14T11:17:36.268 INFO:tasks.workunit.client.0.smithi138.stdout:} 2024-09-14T11:17:36.268 INFO:tasks.workunit.client.0.smithi138.stdout:{ 2024-09-14T11:17:36.268 INFO:tasks.workunit.client.0.smithi138.stdout: "obj": { 2024-09-14T11:17:36.268 INFO:tasks.workunit.client.0.smithi138.stdout: "bucket": { 2024-09-14T11:17:36.269 INFO:tasks.workunit.client.0.smithi138.stdout: "name": "ebtest", 2024-09-14T11:17:36.269 INFO:tasks.workunit.client.0.smithi138.stdout: "marker": "marker", 2024-09-14T11:17:36.269 INFO:tasks.workunit.client.0.smithi138.stdout: "bucket_id": "bucket-id", 2024-09-14T11:17:36.269 INFO:tasks.workunit.client.0.smithi138.stdout: "tenant": "", 2024-09-14T11:17:36.269 INFO:tasks.workunit.client.0.smithi138.stdout: "explicit_placement": { 2024-09-14T11:17:36.269 INFO:tasks.workunit.client.0.smithi138.stdout: "data_pool": ".data-pool", 2024-09-14T11:17:36.269 INFO:tasks.workunit.client.0.smithi138.stdout: "data_extra_pool": "", 2024-09-14T11:17:36.269 INFO:tasks.workunit.client.0.smithi138.stdout: "index_pool": ".index-pool" 2024-09-14T11:17:36.269 INFO:tasks.workunit.client.0.smithi138.stdout: } 2024-09-14T11:17:36.269 INFO:tasks.workunit.client.0.smithi138.stdout: }, 2024-09-14T11:17:36.269 INFO:tasks.workunit.client.0.smithi138.stdout: "key": { 2024-09-14T11:17:36.269 INFO:tasks.workunit.client.0.smithi138.stdout: "name": "myobj", 2024-09-14T11:17:36.269 INFO:tasks.workunit.client.0.smithi138.stdout: "instance": "", 2024-09-14T11:17:36.269 INFO:tasks.workunit.client.0.smithi138.stdout: "ns": "ns" 2024-09-14T11:17:36.269 INFO:tasks.workunit.client.0.smithi138.stdout: } 2024-09-14T11:17:36.270 INFO:tasks.workunit.client.0.smithi138.stdout: } 2024-09-14T11:17:36.270 INFO:tasks.workunit.client.0.smithi138.stdout:} 2024-09-14T11:17:36.270 INFO:tasks.workunit.client.0.smithi138.stdout:{ 2024-09-14T11:17:36.270 INFO:tasks.workunit.client.0.smithi138.stdout: "raw_obj": { 2024-09-14T11:17:36.270 INFO:tasks.workunit.client.0.smithi138.stdout: "pool": ".data-pool", 2024-09-14T11:17:36.270 INFO:tasks.workunit.client.0.smithi138.stdout: "oid": "marker__ns_myobj", 2024-09-14T11:17:36.270 INFO:tasks.workunit.client.0.smithi138.stdout: "loc": "" 2024-09-14T11:17:36.270 INFO:tasks.workunit.client.0.smithi138.stdout: } 2024-09-14T11:17:36.270 INFO:tasks.workunit.client.0.smithi138.stdout:} 2024-09-14T11:17:36.270 INFO:tasks.workunit.client.0.smithi138.stdout:{ 2024-09-14T11:17:36.270 INFO:tasks.workunit.client.0.smithi138.stdout: "new_obj": { 2024-09-14T11:17:36.270 INFO:tasks.workunit.client.0.smithi138.stdout: "bucket": { 2024-09-14T11:17:36.270 INFO:tasks.workunit.client.0.smithi138.stdout: "name": "ebtest", 2024-09-14T11:17:36.271 INFO:tasks.workunit.client.0.smithi138.stdout: "marker": "marker", 2024-09-14T11:17:36.271 INFO:tasks.workunit.client.0.smithi138.stdout: "bucket_id": "bucket-id", 2024-09-14T11:17:36.271 INFO:tasks.workunit.client.0.smithi138.stdout: "tenant": "", 2024-09-14T11:17:36.271 INFO:tasks.workunit.client.0.smithi138.stdout: "explicit_placement": { 2024-09-14T11:17:36.271 INFO:tasks.workunit.client.0.smithi138.stdout: "data_pool": ".data-pool", 2024-09-14T11:17:36.271 INFO:tasks.workunit.client.0.smithi138.stdout: "data_extra_pool": "", 2024-09-14T11:17:36.271 INFO:tasks.workunit.client.0.smithi138.stdout: "index_pool": ".index-pool" 2024-09-14T11:17:36.271 INFO:tasks.workunit.client.0.smithi138.stdout: } 2024-09-14T11:17:36.271 INFO:tasks.workunit.client.0.smithi138.stdout: }, 2024-09-14T11:17:36.271 INFO:tasks.workunit.client.0.smithi138.stdout: "key": { 2024-09-14T11:17:36.272 INFO:tasks.workunit.client.0.smithi138.stdout: "name": "myobj", 2024-09-14T11:17:36.272 INFO:tasks.workunit.client.0.smithi138.stdout: "instance": "", 2024-09-14T11:17:36.272 INFO:tasks.workunit.client.0.smithi138.stdout: "ns": "ns" 2024-09-14T11:17:36.272 INFO:tasks.workunit.client.0.smithi138.stdout: } 2024-09-14T11:17:36.272 INFO:tasks.workunit.client.0.smithi138.stdout: } 2024-09-14T11:17:36.272 INFO:tasks.workunit.client.0.smithi138.stdout:} 2024-09-14T11:17:36.272 INFO:tasks.workunit.client.0.smithi138.stdout:{ 2024-09-14T11:17:36.272 INFO:tasks.workunit.client.0.smithi138.stdout: "bucket": { 2024-09-14T11:17:36.272 INFO:tasks.workunit.client.0.smithi138.stdout: "name": "test", 2024-09-14T11:17:36.272 INFO:tasks.workunit.client.0.smithi138.stdout: "marker": "marker", 2024-09-14T11:17:36.272 INFO:tasks.workunit.client.0.smithi138.stdout: "bucket_id": "bucket-id", 2024-09-14T11:17:36.272 INFO:tasks.workunit.client.0.smithi138.stdout: "tenant": "", 2024-09-14T11:17:36.272 INFO:tasks.workunit.client.0.smithi138.stdout: "explicit_placement": { 2024-09-14T11:17:36.273 INFO:tasks.workunit.client.0.smithi138.stdout: "data_pool": "", 2024-09-14T11:17:36.273 INFO:tasks.workunit.client.0.smithi138.stdout: "data_extra_pool": "", 2024-09-14T11:17:36.273 INFO:tasks.workunit.client.0.smithi138.stdout: "index_pool": "" 2024-09-14T11:17:36.273 INFO:tasks.workunit.client.0.smithi138.stdout: } 2024-09-14T11:17:36.273 INFO:tasks.workunit.client.0.smithi138.stdout: } 2024-09-14T11:17:36.273 INFO:tasks.workunit.client.0.smithi138.stdout:} 2024-09-14T11:17:36.273 INFO:tasks.workunit.client.0.smithi138.stdout:{ 2024-09-14T11:17:36.273 INFO:tasks.workunit.client.0.smithi138.stdout: "obj": { 2024-09-14T11:17:36.273 INFO:tasks.workunit.client.0.smithi138.stdout: "bucket": { 2024-09-14T11:17:36.273 INFO:tasks.workunit.client.0.smithi138.stdout: "name": "test", 2024-09-14T11:17:36.273 INFO:tasks.workunit.client.0.smithi138.stdout: "marker": "marker", 2024-09-14T11:17:36.273 INFO:tasks.workunit.client.0.smithi138.stdout: "bucket_id": "bucket-id", 2024-09-14T11:17:36.273 INFO:tasks.workunit.client.0.smithi138.stdout: "tenant": "", 2024-09-14T11:17:36.273 INFO:tasks.workunit.client.0.smithi138.stdout: "explicit_placement": { 2024-09-14T11:17:36.274 INFO:tasks.workunit.client.0.smithi138.stdout: "data_pool": "", 2024-09-14T11:17:36.274 INFO:tasks.workunit.client.0.smithi138.stdout: "data_extra_pool": "", 2024-09-14T11:17:36.274 INFO:tasks.workunit.client.0.smithi138.stdout: "index_pool": "" 2024-09-14T11:17:36.274 INFO:tasks.workunit.client.0.smithi138.stdout: } 2024-09-14T11:17:36.274 INFO:tasks.workunit.client.0.smithi138.stdout: }, 2024-09-14T11:17:36.274 INFO:tasks.workunit.client.0.smithi138.stdout: "key": { 2024-09-14T11:17:36.274 INFO:tasks.workunit.client.0.smithi138.stdout: "name": "myobj", 2024-09-14T11:17:36.274 INFO:tasks.workunit.client.0.smithi138.stdout: "instance": "inst", 2024-09-14T11:17:36.274 INFO:tasks.workunit.client.0.smithi138.stdout: "ns": "" 2024-09-14T11:17:36.274 INFO:tasks.workunit.client.0.smithi138.stdout: } 2024-09-14T11:17:36.274 INFO:tasks.workunit.client.0.smithi138.stdout: } 2024-09-14T11:17:36.274 INFO:tasks.workunit.client.0.smithi138.stdout:} 2024-09-14T11:17:36.274 INFO:tasks.workunit.client.0.smithi138.stdout:{ 2024-09-14T11:17:36.274 INFO:tasks.workunit.client.0.smithi138.stdout: "raw_obj": { 2024-09-14T11:17:36.274 INFO:tasks.workunit.client.0.smithi138.stdout: "pool": "default-placement.data", 2024-09-14T11:17:36.274 INFO:tasks.workunit.client.0.smithi138.stdout: "oid": "marker__:inst_myobj", 2024-09-14T11:17:36.275 INFO:tasks.workunit.client.0.smithi138.stdout: "loc": "" 2024-09-14T11:17:36.275 INFO:tasks.workunit.client.0.smithi138.stdout: } 2024-09-14T11:17:36.275 INFO:tasks.workunit.client.0.smithi138.stdout:} 2024-09-14T11:17:36.275 INFO:tasks.workunit.client.0.smithi138.stdout:{ 2024-09-14T11:17:36.275 INFO:tasks.workunit.client.0.smithi138.stdout: "new_obj": { 2024-09-14T11:17:36.275 INFO:tasks.workunit.client.0.smithi138.stdout: "bucket": { 2024-09-14T11:17:36.275 INFO:tasks.workunit.client.0.smithi138.stdout: "name": "test", 2024-09-14T11:17:36.275 INFO:tasks.workunit.client.0.smithi138.stdout: "marker": "marker", 2024-09-14T11:17:36.275 INFO:tasks.workunit.client.0.smithi138.stdout: "bucket_id": "bucket-id", 2024-09-14T11:17:36.275 INFO:tasks.workunit.client.0.smithi138.stdout: "tenant": "", 2024-09-14T11:17:36.275 INFO:tasks.workunit.client.0.smithi138.stdout: "explicit_placement": { 2024-09-14T11:17:36.275 INFO:tasks.workunit.client.0.smithi138.stdout: "data_pool": "", 2024-09-14T11:17:36.275 INFO:tasks.workunit.client.0.smithi138.stdout: "data_extra_pool": "", 2024-09-14T11:17:36.275 INFO:tasks.workunit.client.0.smithi138.stdout: "index_pool": "" 2024-09-14T11:17:36.275 INFO:tasks.workunit.client.0.smithi138.stdout: } 2024-09-14T11:17:36.275 INFO:tasks.workunit.client.0.smithi138.stdout: }, 2024-09-14T11:17:36.276 INFO:tasks.workunit.client.0.smithi138.stdout: "key": { 2024-09-14T11:17:36.276 INFO:tasks.workunit.client.0.smithi138.stdout: "name": "myobj", 2024-09-14T11:17:36.276 INFO:tasks.workunit.client.0.smithi138.stdout: "instance": "inst", 2024-09-14T11:17:36.276 INFO:tasks.workunit.client.0.smithi138.stdout: "ns": "" 2024-09-14T11:17:36.276 INFO:tasks.workunit.client.0.smithi138.stdout: } 2024-09-14T11:17:36.276 INFO:tasks.workunit.client.0.smithi138.stdout: } 2024-09-14T11:17:36.276 INFO:tasks.workunit.client.0.smithi138.stdout:} 2024-09-14T11:17:36.276 INFO:tasks.workunit.client.0.smithi138.stdout:{ 2024-09-14T11:17:36.276 INFO:tasks.workunit.client.0.smithi138.stdout: "bucket": { 2024-09-14T11:17:36.276 INFO:tasks.workunit.client.0.smithi138.stdout: "name": "ebtest", 2024-09-14T11:17:36.276 INFO:tasks.workunit.client.0.smithi138.stdout: "marker": "marker", 2024-09-14T11:17:36.276 INFO:tasks.workunit.client.0.smithi138.stdout: "bucket_id": "bucket-id", 2024-09-14T11:17:36.276 INFO:tasks.workunit.client.0.smithi138.stdout: "tenant": "", 2024-09-14T11:17:36.276 INFO:tasks.workunit.client.0.smithi138.stdout: "explicit_placement": { 2024-09-14T11:17:36.276 INFO:tasks.workunit.client.0.smithi138.stdout: "data_pool": ".data-pool", 2024-09-14T11:17:36.277 INFO:tasks.workunit.client.0.smithi138.stdout: "data_extra_pool": "", 2024-09-14T11:17:36.277 INFO:tasks.workunit.client.0.smithi138.stdout: "index_pool": ".index-pool" 2024-09-14T11:17:36.277 INFO:tasks.workunit.client.0.smithi138.stdout: } 2024-09-14T11:17:36.277 INFO:tasks.workunit.client.0.smithi138.stdout: } 2024-09-14T11:17:36.277 INFO:tasks.workunit.client.0.smithi138.stdout:} 2024-09-14T11:17:36.277 INFO:tasks.workunit.client.0.smithi138.stdout:{ 2024-09-14T11:17:36.277 INFO:tasks.workunit.client.0.smithi138.stdout: "obj": { 2024-09-14T11:17:36.277 INFO:tasks.workunit.client.0.smithi138.stdout: "bucket": { 2024-09-14T11:17:36.277 INFO:tasks.workunit.client.0.smithi138.stdout: "name": "ebtest", 2024-09-14T11:17:36.277 INFO:tasks.workunit.client.0.smithi138.stdout: "marker": "marker", 2024-09-14T11:17:36.277 INFO:tasks.workunit.client.0.smithi138.stdout: "bucket_id": "bucket-id", 2024-09-14T11:17:36.277 INFO:tasks.workunit.client.0.smithi138.stdout: "tenant": "", 2024-09-14T11:17:36.278 INFO:tasks.workunit.client.0.smithi138.stdout: "explicit_placement": { 2024-09-14T11:17:36.278 INFO:tasks.workunit.client.0.smithi138.stdout: "data_pool": ".data-pool", 2024-09-14T11:17:36.278 INFO:tasks.workunit.client.0.smithi138.stdout: "data_extra_pool": "", 2024-09-14T11:17:36.278 INFO:tasks.workunit.client.0.smithi138.stdout: "index_pool": ".index-pool" 2024-09-14T11:17:36.278 INFO:tasks.workunit.client.0.smithi138.stdout: } 2024-09-14T11:17:36.278 INFO:tasks.workunit.client.0.smithi138.stdout: }, 2024-09-14T11:17:36.278 INFO:tasks.workunit.client.0.smithi138.stdout: "key": { 2024-09-14T11:17:36.278 INFO:tasks.workunit.client.0.smithi138.stdout: "name": "myobj", 2024-09-14T11:17:36.278 INFO:tasks.workunit.client.0.smithi138.stdout: "instance": "inst", 2024-09-14T11:17:36.278 INFO:tasks.workunit.client.0.smithi138.stdout: "ns": "" 2024-09-14T11:17:36.278 INFO:tasks.workunit.client.0.smithi138.stdout: } 2024-09-14T11:17:36.278 INFO:tasks.workunit.client.0.smithi138.stdout: } 2024-09-14T11:17:36.278 INFO:tasks.workunit.client.0.smithi138.stdout:} 2024-09-14T11:17:36.278 INFO:tasks.workunit.client.0.smithi138.stdout:{ 2024-09-14T11:17:36.278 INFO:tasks.workunit.client.0.smithi138.stdout: "raw_obj": { 2024-09-14T11:17:36.278 INFO:tasks.workunit.client.0.smithi138.stdout: "pool": ".data-pool", 2024-09-14T11:17:36.279 INFO:tasks.workunit.client.0.smithi138.stdout: "oid": "marker__:inst_myobj", 2024-09-14T11:17:36.279 INFO:tasks.workunit.client.0.smithi138.stdout: "loc": "" 2024-09-14T11:17:36.279 INFO:tasks.workunit.client.0.smithi138.stdout: } 2024-09-14T11:17:36.279 INFO:tasks.workunit.client.0.smithi138.stdout:} 2024-09-14T11:17:36.279 INFO:tasks.workunit.client.0.smithi138.stdout:{ 2024-09-14T11:17:36.279 INFO:tasks.workunit.client.0.smithi138.stdout: "new_obj": { 2024-09-14T11:17:36.279 INFO:tasks.workunit.client.0.smithi138.stdout: "bucket": { 2024-09-14T11:17:36.279 INFO:tasks.workunit.client.0.smithi138.stdout: "name": "ebtest", 2024-09-14T11:17:36.279 INFO:tasks.workunit.client.0.smithi138.stdout: "marker": "marker", 2024-09-14T11:17:36.279 INFO:tasks.workunit.client.0.smithi138.stdout: "bucket_id": "bucket-id", 2024-09-14T11:17:36.279 INFO:tasks.workunit.client.0.smithi138.stdout: "tenant": "", 2024-09-14T11:17:36.279 INFO:tasks.workunit.client.0.smithi138.stdout: "explicit_placement": { 2024-09-14T11:17:36.279 INFO:tasks.workunit.client.0.smithi138.stdout: "data_pool": ".data-pool", 2024-09-14T11:17:36.279 INFO:tasks.workunit.client.0.smithi138.stdout: "data_extra_pool": "", 2024-09-14T11:17:36.279 INFO:tasks.workunit.client.0.smithi138.stdout: "index_pool": ".index-pool" 2024-09-14T11:17:36.280 INFO:tasks.workunit.client.0.smithi138.stdout: } 2024-09-14T11:17:36.280 INFO:tasks.workunit.client.0.smithi138.stdout: }, 2024-09-14T11:17:36.280 INFO:tasks.workunit.client.0.smithi138.stdout: "key": { 2024-09-14T11:17:36.280 INFO:tasks.workunit.client.0.smithi138.stdout: "name": "myobj", 2024-09-14T11:17:36.280 INFO:tasks.workunit.client.0.smithi138.stdout: "instance": "inst", 2024-09-14T11:17:36.280 INFO:tasks.workunit.client.0.smithi138.stdout: "ns": "" 2024-09-14T11:17:36.280 INFO:tasks.workunit.client.0.smithi138.stdout: } 2024-09-14T11:17:36.280 INFO:tasks.workunit.client.0.smithi138.stdout: } 2024-09-14T11:17:36.280 INFO:tasks.workunit.client.0.smithi138.stdout:} 2024-09-14T11:17:36.280 INFO:tasks.workunit.client.0.smithi138.stdout:{ 2024-09-14T11:17:36.280 INFO:tasks.workunit.client.0.smithi138.stdout: "bucket": { 2024-09-14T11:17:36.280 INFO:tasks.workunit.client.0.smithi138.stdout: "name": "test", 2024-09-14T11:17:36.280 INFO:tasks.workunit.client.0.smithi138.stdout: "marker": "marker", 2024-09-14T11:17:36.280 INFO:tasks.workunit.client.0.smithi138.stdout: "bucket_id": "bucket-id", 2024-09-14T11:17:36.280 INFO:tasks.workunit.client.0.smithi138.stdout: "tenant": "", 2024-09-14T11:17:36.281 INFO:tasks.workunit.client.0.smithi138.stdout: "explicit_placement": { 2024-09-14T11:17:36.281 INFO:tasks.workunit.client.0.smithi138.stdout: "data_pool": "", 2024-09-14T11:17:36.281 INFO:tasks.workunit.client.0.smithi138.stdout: "data_extra_pool": "", 2024-09-14T11:17:36.281 INFO:tasks.workunit.client.0.smithi138.stdout: "index_pool": "" 2024-09-14T11:17:36.281 INFO:tasks.workunit.client.0.smithi138.stdout: } 2024-09-14T11:17:36.281 INFO:tasks.workunit.client.0.smithi138.stdout: } 2024-09-14T11:17:36.281 INFO:tasks.workunit.client.0.smithi138.stdout:} 2024-09-14T11:17:36.281 INFO:tasks.workunit.client.0.smithi138.stdout:{ 2024-09-14T11:17:36.281 INFO:tasks.workunit.client.0.smithi138.stdout: "obj": { 2024-09-14T11:17:36.281 INFO:tasks.workunit.client.0.smithi138.stdout: "bucket": { 2024-09-14T11:17:36.281 INFO:tasks.workunit.client.0.smithi138.stdout: "name": "test", 2024-09-14T11:17:36.281 INFO:tasks.workunit.client.0.smithi138.stdout: "marker": "marker", 2024-09-14T11:17:36.281 INFO:tasks.workunit.client.0.smithi138.stdout: "bucket_id": "bucket-id", 2024-09-14T11:17:36.281 INFO:tasks.workunit.client.0.smithi138.stdout: "tenant": "", 2024-09-14T11:17:36.281 INFO:tasks.workunit.client.0.smithi138.stdout: "explicit_placement": { 2024-09-14T11:17:36.282 INFO:tasks.workunit.client.0.smithi138.stdout: "data_pool": "", 2024-09-14T11:17:36.282 INFO:tasks.workunit.client.0.smithi138.stdout: "data_extra_pool": "", 2024-09-14T11:17:36.282 INFO:tasks.workunit.client.0.smithi138.stdout: "index_pool": "" 2024-09-14T11:17:36.282 INFO:tasks.workunit.client.0.smithi138.stdout: } 2024-09-14T11:17:36.282 INFO:tasks.workunit.client.0.smithi138.stdout: }, 2024-09-14T11:17:36.282 INFO:tasks.workunit.client.0.smithi138.stdout: "key": { 2024-09-14T11:17:36.282 INFO:tasks.workunit.client.0.smithi138.stdout: "name": "myobj", 2024-09-14T11:17:36.282 INFO:tasks.workunit.client.0.smithi138.stdout: "instance": "inst", 2024-09-14T11:17:36.282 INFO:tasks.workunit.client.0.smithi138.stdout: "ns": "ns" 2024-09-14T11:17:36.282 INFO:tasks.workunit.client.0.smithi138.stdout: } 2024-09-14T11:17:36.282 INFO:tasks.workunit.client.0.smithi138.stdout: } 2024-09-14T11:17:36.282 INFO:tasks.workunit.client.0.smithi138.stdout:} 2024-09-14T11:17:36.282 INFO:tasks.workunit.client.0.smithi138.stdout:{ 2024-09-14T11:17:36.282 INFO:tasks.workunit.client.0.smithi138.stdout: "raw_obj": { 2024-09-14T11:17:36.283 INFO:tasks.workunit.client.0.smithi138.stdout: "pool": "default-placement.data", 2024-09-14T11:17:36.283 INFO:tasks.workunit.client.0.smithi138.stdout: "oid": "marker__ns:inst_myobj", 2024-09-14T11:17:36.283 INFO:tasks.workunit.client.0.smithi138.stdout: "loc": "" 2024-09-14T11:17:36.283 INFO:tasks.workunit.client.0.smithi138.stdout: } 2024-09-14T11:17:36.283 INFO:tasks.workunit.client.0.smithi138.stdout:} 2024-09-14T11:17:36.283 INFO:tasks.workunit.client.0.smithi138.stdout:{ 2024-09-14T11:17:36.283 INFO:tasks.workunit.client.0.smithi138.stdout: "new_obj": { 2024-09-14T11:17:36.283 INFO:tasks.workunit.client.0.smithi138.stdout: "bucket": { 2024-09-14T11:17:36.283 INFO:tasks.workunit.client.0.smithi138.stdout: "name": "test", 2024-09-14T11:17:36.283 INFO:tasks.workunit.client.0.smithi138.stdout: "marker": "marker", 2024-09-14T11:17:36.283 INFO:tasks.workunit.client.0.smithi138.stdout: "bucket_id": "bucket-id", 2024-09-14T11:17:36.283 INFO:tasks.workunit.client.0.smithi138.stdout: "tenant": "", 2024-09-14T11:17:36.283 INFO:tasks.workunit.client.0.smithi138.stdout: "explicit_placement": { 2024-09-14T11:17:36.283 INFO:tasks.workunit.client.0.smithi138.stdout: "data_pool": "", 2024-09-14T11:17:36.283 INFO:tasks.workunit.client.0.smithi138.stdout: "data_extra_pool": "", 2024-09-14T11:17:36.283 INFO:tasks.workunit.client.0.smithi138.stdout: "index_pool": "" 2024-09-14T11:17:36.284 INFO:tasks.workunit.client.0.smithi138.stdout: } 2024-09-14T11:17:36.284 INFO:tasks.workunit.client.0.smithi138.stdout: }, 2024-09-14T11:17:36.284 INFO:tasks.workunit.client.0.smithi138.stdout: "key": { 2024-09-14T11:17:36.284 INFO:tasks.workunit.client.0.smithi138.stdout: "name": "myobj", 2024-09-14T11:17:36.284 INFO:tasks.workunit.client.0.smithi138.stdout: "instance": "inst", 2024-09-14T11:17:36.284 INFO:tasks.workunit.client.0.smithi138.stdout: "ns": "ns" 2024-09-14T11:17:36.284 INFO:tasks.workunit.client.0.smithi138.stdout: } 2024-09-14T11:17:36.284 INFO:tasks.workunit.client.0.smithi138.stdout: } 2024-09-14T11:17:36.284 INFO:tasks.workunit.client.0.smithi138.stdout:} 2024-09-14T11:17:36.284 INFO:tasks.workunit.client.0.smithi138.stdout:{ 2024-09-14T11:17:36.284 INFO:tasks.workunit.client.0.smithi138.stdout: "bucket": { 2024-09-14T11:17:36.284 INFO:tasks.workunit.client.0.smithi138.stdout: "name": "ebtest", 2024-09-14T11:17:36.284 INFO:tasks.workunit.client.0.smithi138.stdout: "marker": "marker", 2024-09-14T11:17:36.285 INFO:tasks.workunit.client.0.smithi138.stdout: "bucket_id": "bucket-id", 2024-09-14T11:17:36.285 INFO:tasks.workunit.client.0.smithi138.stdout: "tenant": "", 2024-09-14T11:17:36.285 INFO:tasks.workunit.client.0.smithi138.stdout: "explicit_placement": { 2024-09-14T11:17:36.285 INFO:tasks.workunit.client.0.smithi138.stdout: "data_pool": ".data-pool", 2024-09-14T11:17:36.285 INFO:tasks.workunit.client.0.smithi138.stdout: "data_extra_pool": "", 2024-09-14T11:17:36.285 INFO:tasks.workunit.client.0.smithi138.stdout: "index_pool": ".index-pool" 2024-09-14T11:17:36.285 INFO:tasks.workunit.client.0.smithi138.stdout: } 2024-09-14T11:17:36.285 INFO:tasks.workunit.client.0.smithi138.stdout: } 2024-09-14T11:17:36.285 INFO:tasks.workunit.client.0.smithi138.stdout:} 2024-09-14T11:17:36.285 INFO:tasks.workunit.client.0.smithi138.stdout:{ 2024-09-14T11:17:36.285 INFO:tasks.workunit.client.0.smithi138.stdout: "obj": { 2024-09-14T11:17:36.285 INFO:tasks.workunit.client.0.smithi138.stdout: "bucket": { 2024-09-14T11:17:36.285 INFO:tasks.workunit.client.0.smithi138.stdout: "name": "ebtest", 2024-09-14T11:17:36.285 INFO:tasks.workunit.client.0.smithi138.stdout: "marker": "marker", 2024-09-14T11:17:36.285 INFO:tasks.workunit.client.0.smithi138.stdout: "bucket_id": "bucket-id", 2024-09-14T11:17:36.286 INFO:tasks.workunit.client.0.smithi138.stdout: "tenant": "", 2024-09-14T11:17:36.286 INFO:tasks.workunit.client.0.smithi138.stdout: "explicit_placement": { 2024-09-14T11:17:36.286 INFO:tasks.workunit.client.0.smithi138.stdout: "data_pool": ".data-pool", 2024-09-14T11:17:36.286 INFO:tasks.workunit.client.0.smithi138.stdout: "data_extra_pool": "", 2024-09-14T11:17:36.286 INFO:tasks.workunit.client.0.smithi138.stdout: "index_pool": ".index-pool" 2024-09-14T11:17:36.286 INFO:tasks.workunit.client.0.smithi138.stdout: } 2024-09-14T11:17:36.286 INFO:tasks.workunit.client.0.smithi138.stdout: }, 2024-09-14T11:17:36.286 INFO:tasks.workunit.client.0.smithi138.stdout: "key": { 2024-09-14T11:17:36.286 INFO:tasks.workunit.client.0.smithi138.stdout: "name": "myobj", 2024-09-14T11:17:36.286 INFO:tasks.workunit.client.0.smithi138.stdout: "instance": "inst", 2024-09-14T11:17:36.286 INFO:tasks.workunit.client.0.smithi138.stdout: "ns": "ns" 2024-09-14T11:17:36.286 INFO:tasks.workunit.client.0.smithi138.stdout: } 2024-09-14T11:17:36.287 INFO:tasks.workunit.client.0.smithi138.stdout: } 2024-09-14T11:17:36.287 INFO:tasks.workunit.client.0.smithi138.stdout:} 2024-09-14T11:17:36.287 INFO:tasks.workunit.client.0.smithi138.stdout:{ 2024-09-14T11:17:36.287 INFO:tasks.workunit.client.0.smithi138.stdout: "raw_obj": { 2024-09-14T11:17:36.287 INFO:tasks.workunit.client.0.smithi138.stdout: "pool": ".data-pool", 2024-09-14T11:17:36.287 INFO:tasks.workunit.client.0.smithi138.stdout: "oid": "marker__ns:inst_myobj", 2024-09-14T11:17:36.287 INFO:tasks.workunit.client.0.smithi138.stdout: "loc": "" 2024-09-14T11:17:36.287 INFO:tasks.workunit.client.0.smithi138.stdout: } 2024-09-14T11:17:36.287 INFO:tasks.workunit.client.0.smithi138.stdout:} 2024-09-14T11:17:36.287 INFO:tasks.workunit.client.0.smithi138.stdout:{ 2024-09-14T11:17:36.287 INFO:tasks.workunit.client.0.smithi138.stdout: "new_obj": { 2024-09-14T11:17:36.287 INFO:tasks.workunit.client.0.smithi138.stdout: "bucket": { 2024-09-14T11:17:36.287 INFO:tasks.workunit.client.0.smithi138.stdout: "name": "ebtest", 2024-09-14T11:17:36.287 INFO:tasks.workunit.client.0.smithi138.stdout: "marker": "marker", 2024-09-14T11:17:36.287 INFO:tasks.workunit.client.0.smithi138.stdout: "bucket_id": "bucket-id", 2024-09-14T11:17:36.288 INFO:tasks.workunit.client.0.smithi138.stdout: "tenant": "", 2024-09-14T11:17:36.288 INFO:tasks.workunit.client.0.smithi138.stdout: "explicit_placement": { 2024-09-14T11:17:36.288 INFO:tasks.workunit.client.0.smithi138.stdout: "data_pool": ".data-pool", 2024-09-14T11:17:36.288 INFO:tasks.workunit.client.0.smithi138.stdout: "data_extra_pool": "", 2024-09-14T11:17:36.288 INFO:tasks.workunit.client.0.smithi138.stdout: "index_pool": ".index-pool" 2024-09-14T11:17:36.288 INFO:tasks.workunit.client.0.smithi138.stdout: } 2024-09-14T11:17:36.288 INFO:tasks.workunit.client.0.smithi138.stdout: }, 2024-09-14T11:17:36.288 INFO:tasks.workunit.client.0.smithi138.stdout: "key": { 2024-09-14T11:17:36.288 INFO:tasks.workunit.client.0.smithi138.stdout: "name": "myobj", 2024-09-14T11:17:36.288 INFO:tasks.workunit.client.0.smithi138.stdout: "instance": "inst", 2024-09-14T11:17:36.288 INFO:tasks.workunit.client.0.smithi138.stdout: "ns": "ns" 2024-09-14T11:17:36.288 INFO:tasks.workunit.client.0.smithi138.stdout: } 2024-09-14T11:17:36.288 INFO:tasks.workunit.client.0.smithi138.stdout: } 2024-09-14T11:17:36.288 INFO:tasks.workunit.client.0.smithi138.stdout:} 2024-09-14T11:17:36.288 INFO:tasks.workunit.client.0.smithi138.stdout:{ 2024-09-14T11:17:36.289 INFO:tasks.workunit.client.0.smithi138.stdout: "bucket": { 2024-09-14T11:17:36.289 INFO:tasks.workunit.client.0.smithi138.stdout: "name": "test", 2024-09-14T11:17:36.289 INFO:tasks.workunit.client.0.smithi138.stdout: "marker": "marker", 2024-09-14T11:17:36.289 INFO:tasks.workunit.client.0.smithi138.stdout: "bucket_id": "bucket-id", 2024-09-14T11:17:36.289 INFO:tasks.workunit.client.0.smithi138.stdout: "tenant": "", 2024-09-14T11:17:36.289 INFO:tasks.workunit.client.0.smithi138.stdout: "explicit_placement": { 2024-09-14T11:17:36.289 INFO:tasks.workunit.client.0.smithi138.stdout: "data_pool": "", 2024-09-14T11:17:36.289 INFO:tasks.workunit.client.0.smithi138.stdout: "data_extra_pool": "", 2024-09-14T11:17:36.289 INFO:tasks.workunit.client.0.smithi138.stdout: "index_pool": "" 2024-09-14T11:17:36.289 INFO:tasks.workunit.client.0.smithi138.stdout: } 2024-09-14T11:17:36.289 INFO:tasks.workunit.client.0.smithi138.stdout: } 2024-09-14T11:17:36.289 INFO:tasks.workunit.client.0.smithi138.stdout:} 2024-09-14T11:17:36.289 INFO:tasks.workunit.client.0.smithi138.stdout:{ 2024-09-14T11:17:36.289 INFO:tasks.workunit.client.0.smithi138.stdout: "obj": { 2024-09-14T11:17:36.290 INFO:tasks.workunit.client.0.smithi138.stdout: "bucket": { 2024-09-14T11:17:36.290 INFO:tasks.workunit.client.0.smithi138.stdout: "name": "test", 2024-09-14T11:17:36.290 INFO:tasks.workunit.client.0.smithi138.stdout: "marker": "marker", 2024-09-14T11:17:36.290 INFO:tasks.workunit.client.0.smithi138.stdout: "bucket_id": "bucket-id", 2024-09-14T11:17:36.290 INFO:tasks.workunit.client.0.smithi138.stdout: "tenant": "", 2024-09-14T11:17:36.290 INFO:tasks.workunit.client.0.smithi138.stdout: "explicit_placement": { 2024-09-14T11:17:36.290 INFO:tasks.workunit.client.0.smithi138.stdout: "data_pool": "", 2024-09-14T11:17:36.290 INFO:tasks.workunit.client.0.smithi138.stdout: "data_extra_pool": "", 2024-09-14T11:17:36.290 INFO:tasks.workunit.client.0.smithi138.stdout: "index_pool": "" 2024-09-14T11:17:36.290 INFO:tasks.workunit.client.0.smithi138.stdout: } 2024-09-14T11:17:36.290 INFO:tasks.workunit.client.0.smithi138.stdout: }, 2024-09-14T11:17:36.290 INFO:tasks.workunit.client.0.smithi138.stdout: "key": { 2024-09-14T11:17:36.290 INFO:tasks.workunit.client.0.smithi138.stdout: "name": "_myobj", 2024-09-14T11:17:36.290 INFO:tasks.workunit.client.0.smithi138.stdout: "instance": "", 2024-09-14T11:17:36.291 INFO:tasks.workunit.client.0.smithi138.stdout: "ns": "" 2024-09-14T11:17:36.291 INFO:tasks.workunit.client.0.smithi138.stdout: } 2024-09-14T11:17:36.291 INFO:tasks.workunit.client.0.smithi138.stdout: } 2024-09-14T11:17:36.291 INFO:tasks.workunit.client.0.smithi138.stdout:} 2024-09-14T11:17:36.291 INFO:tasks.workunit.client.0.smithi138.stdout:{ 2024-09-14T11:17:36.291 INFO:tasks.workunit.client.0.smithi138.stdout: "raw_obj": { 2024-09-14T11:17:36.291 INFO:tasks.workunit.client.0.smithi138.stdout: "pool": "default-placement.data", 2024-09-14T11:17:36.291 INFO:tasks.workunit.client.0.smithi138.stdout: "oid": "marker___myobj", 2024-09-14T11:17:36.291 INFO:tasks.workunit.client.0.smithi138.stdout: "loc": "marker__myobj" 2024-09-14T11:17:36.291 INFO:tasks.workunit.client.0.smithi138.stdout: } 2024-09-14T11:17:36.291 INFO:tasks.workunit.client.0.smithi138.stdout:} 2024-09-14T11:17:36.291 INFO:tasks.workunit.client.0.smithi138.stdout:{ 2024-09-14T11:17:36.291 INFO:tasks.workunit.client.0.smithi138.stdout: "new_obj": { 2024-09-14T11:17:36.291 INFO:tasks.workunit.client.0.smithi138.stdout: "bucket": { 2024-09-14T11:17:36.292 INFO:tasks.workunit.client.0.smithi138.stdout: "name": "test", 2024-09-14T11:17:36.292 INFO:tasks.workunit.client.0.smithi138.stdout: "marker": "marker", 2024-09-14T11:17:36.292 INFO:tasks.workunit.client.0.smithi138.stdout: "bucket_id": "bucket-id", 2024-09-14T11:17:36.292 INFO:tasks.workunit.client.0.smithi138.stdout: "tenant": "", 2024-09-14T11:17:36.292 INFO:tasks.workunit.client.0.smithi138.stdout: "explicit_placement": { 2024-09-14T11:17:36.292 INFO:tasks.workunit.client.0.smithi138.stdout: "data_pool": "", 2024-09-14T11:17:36.292 INFO:tasks.workunit.client.0.smithi138.stdout: "data_extra_pool": "", 2024-09-14T11:17:36.292 INFO:tasks.workunit.client.0.smithi138.stdout: "index_pool": "" 2024-09-14T11:17:36.292 INFO:tasks.workunit.client.0.smithi138.stdout: } 2024-09-14T11:17:36.292 INFO:tasks.workunit.client.0.smithi138.stdout: }, 2024-09-14T11:17:36.292 INFO:tasks.workunit.client.0.smithi138.stdout: "key": { 2024-09-14T11:17:36.292 INFO:tasks.workunit.client.0.smithi138.stdout: "name": "_myobj", 2024-09-14T11:17:36.292 INFO:tasks.workunit.client.0.smithi138.stdout: "instance": "", 2024-09-14T11:17:36.293 INFO:tasks.workunit.client.0.smithi138.stdout: "ns": "" 2024-09-14T11:17:36.293 INFO:tasks.workunit.client.0.smithi138.stdout: } 2024-09-14T11:17:36.293 INFO:tasks.workunit.client.0.smithi138.stdout: } 2024-09-14T11:17:36.293 INFO:tasks.workunit.client.0.smithi138.stdout:} 2024-09-14T11:17:36.293 INFO:tasks.workunit.client.0.smithi138.stdout:{ 2024-09-14T11:17:36.293 INFO:tasks.workunit.client.0.smithi138.stdout: "bucket": { 2024-09-14T11:17:36.293 INFO:tasks.workunit.client.0.smithi138.stdout: "name": "ebtest", 2024-09-14T11:17:36.293 INFO:tasks.workunit.client.0.smithi138.stdout: "marker": "marker", 2024-09-14T11:17:36.293 INFO:tasks.workunit.client.0.smithi138.stdout: "bucket_id": "bucket-id", 2024-09-14T11:17:36.293 INFO:tasks.workunit.client.0.smithi138.stdout: "tenant": "", 2024-09-14T11:17:36.293 INFO:tasks.workunit.client.0.smithi138.stdout: "explicit_placement": { 2024-09-14T11:17:36.293 INFO:tasks.workunit.client.0.smithi138.stdout: "data_pool": ".data-pool", 2024-09-14T11:17:36.293 INFO:tasks.workunit.client.0.smithi138.stdout: "data_extra_pool": "", 2024-09-14T11:17:36.293 INFO:tasks.workunit.client.0.smithi138.stdout: "index_pool": ".index-pool" 2024-09-14T11:17:36.294 INFO:tasks.workunit.client.0.smithi138.stdout: } 2024-09-14T11:17:36.294 INFO:tasks.workunit.client.0.smithi138.stdout: } 2024-09-14T11:17:36.294 INFO:tasks.workunit.client.0.smithi138.stdout:} 2024-09-14T11:17:36.294 INFO:tasks.workunit.client.0.smithi138.stdout:{ 2024-09-14T11:17:36.294 INFO:tasks.workunit.client.0.smithi138.stdout: "obj": { 2024-09-14T11:17:36.294 INFO:tasks.workunit.client.0.smithi138.stdout: "bucket": { 2024-09-14T11:17:36.294 INFO:tasks.workunit.client.0.smithi138.stdout: "name": "ebtest", 2024-09-14T11:17:36.294 INFO:tasks.workunit.client.0.smithi138.stdout: "marker": "marker", 2024-09-14T11:17:36.294 INFO:tasks.workunit.client.0.smithi138.stdout: "bucket_id": "bucket-id", 2024-09-14T11:17:36.294 INFO:tasks.workunit.client.0.smithi138.stdout: "tenant": "", 2024-09-14T11:17:36.294 INFO:tasks.workunit.client.0.smithi138.stdout: "explicit_placement": { 2024-09-14T11:17:36.294 INFO:tasks.workunit.client.0.smithi138.stdout: "data_pool": ".data-pool", 2024-09-14T11:17:36.294 INFO:tasks.workunit.client.0.smithi138.stdout: "data_extra_pool": "", 2024-09-14T11:17:36.294 INFO:tasks.workunit.client.0.smithi138.stdout: "index_pool": ".index-pool" 2024-09-14T11:17:36.295 INFO:tasks.workunit.client.0.smithi138.stdout: } 2024-09-14T11:17:36.295 INFO:tasks.workunit.client.0.smithi138.stdout: }, 2024-09-14T11:17:36.295 INFO:tasks.workunit.client.0.smithi138.stdout: "key": { 2024-09-14T11:17:36.295 INFO:tasks.workunit.client.0.smithi138.stdout: "name": "_myobj", 2024-09-14T11:17:36.295 INFO:tasks.workunit.client.0.smithi138.stdout: "instance": "", 2024-09-14T11:17:36.295 INFO:tasks.workunit.client.0.smithi138.stdout: "ns": "" 2024-09-14T11:17:36.295 INFO:tasks.workunit.client.0.smithi138.stdout: } 2024-09-14T11:17:36.295 INFO:tasks.workunit.client.0.smithi138.stdout: } 2024-09-14T11:17:36.295 INFO:tasks.workunit.client.0.smithi138.stdout:} 2024-09-14T11:17:36.295 INFO:tasks.workunit.client.0.smithi138.stdout:{ 2024-09-14T11:17:36.295 INFO:tasks.workunit.client.0.smithi138.stdout: "raw_obj": { 2024-09-14T11:17:36.295 INFO:tasks.workunit.client.0.smithi138.stdout: "pool": ".data-pool", 2024-09-14T11:17:36.295 INFO:tasks.workunit.client.0.smithi138.stdout: "oid": "marker___myobj", 2024-09-14T11:17:36.295 INFO:tasks.workunit.client.0.smithi138.stdout: "loc": "marker__myobj" 2024-09-14T11:17:36.295 INFO:tasks.workunit.client.0.smithi138.stdout: } 2024-09-14T11:17:36.296 INFO:tasks.workunit.client.0.smithi138.stdout:} 2024-09-14T11:17:36.296 INFO:tasks.workunit.client.0.smithi138.stdout:{ 2024-09-14T11:17:36.296 INFO:tasks.workunit.client.0.smithi138.stdout: "new_obj": { 2024-09-14T11:17:36.296 INFO:tasks.workunit.client.0.smithi138.stdout: "bucket": { 2024-09-14T11:17:36.296 INFO:tasks.workunit.client.0.smithi138.stdout: "name": "ebtest", 2024-09-14T11:17:36.296 INFO:tasks.workunit.client.0.smithi138.stdout: "marker": "marker", 2024-09-14T11:17:36.296 INFO:tasks.workunit.client.0.smithi138.stdout: "bucket_id": "bucket-id", 2024-09-14T11:17:36.296 INFO:tasks.workunit.client.0.smithi138.stdout: "tenant": "", 2024-09-14T11:17:36.296 INFO:tasks.workunit.client.0.smithi138.stdout: "explicit_placement": { 2024-09-14T11:17:36.296 INFO:tasks.workunit.client.0.smithi138.stdout: "data_pool": ".data-pool", 2024-09-14T11:17:36.296 INFO:tasks.workunit.client.0.smithi138.stdout: "data_extra_pool": "", 2024-09-14T11:17:36.296 INFO:tasks.workunit.client.0.smithi138.stdout: "index_pool": ".index-pool" 2024-09-14T11:17:36.296 INFO:tasks.workunit.client.0.smithi138.stdout: } 2024-09-14T11:17:36.296 INFO:tasks.workunit.client.0.smithi138.stdout: }, 2024-09-14T11:17:36.296 INFO:tasks.workunit.client.0.smithi138.stdout: "key": { 2024-09-14T11:17:36.297 INFO:tasks.workunit.client.0.smithi138.stdout: "name": "_myobj", 2024-09-14T11:17:36.297 INFO:tasks.workunit.client.0.smithi138.stdout: "instance": "", 2024-09-14T11:17:36.297 INFO:tasks.workunit.client.0.smithi138.stdout: "ns": "" 2024-09-14T11:17:36.297 INFO:tasks.workunit.client.0.smithi138.stdout: } 2024-09-14T11:17:36.297 INFO:tasks.workunit.client.0.smithi138.stdout: } 2024-09-14T11:17:36.297 INFO:tasks.workunit.client.0.smithi138.stdout:} 2024-09-14T11:17:36.297 INFO:tasks.workunit.client.0.smithi138.stdout:{ 2024-09-14T11:17:36.297 INFO:tasks.workunit.client.0.smithi138.stdout: "bucket": { 2024-09-14T11:17:36.297 INFO:tasks.workunit.client.0.smithi138.stdout: "name": "test", 2024-09-14T11:17:36.297 INFO:tasks.workunit.client.0.smithi138.stdout: "marker": "marker", 2024-09-14T11:17:36.297 INFO:tasks.workunit.client.0.smithi138.stdout: "bucket_id": "bucket-id", 2024-09-14T11:17:36.297 INFO:tasks.workunit.client.0.smithi138.stdout: "tenant": "", 2024-09-14T11:17:36.297 INFO:tasks.workunit.client.0.smithi138.stdout: "explicit_placement": { 2024-09-14T11:17:36.297 INFO:tasks.workunit.client.0.smithi138.stdout: "data_pool": "", 2024-09-14T11:17:36.298 INFO:tasks.workunit.client.0.smithi138.stdout: "data_extra_pool": "", 2024-09-14T11:17:36.298 INFO:tasks.workunit.client.0.smithi138.stdout: "index_pool": "" 2024-09-14T11:17:36.298 INFO:tasks.workunit.client.0.smithi138.stdout: } 2024-09-14T11:17:36.298 INFO:tasks.workunit.client.0.smithi138.stdout: } 2024-09-14T11:17:36.298 INFO:tasks.workunit.client.0.smithi138.stdout:} 2024-09-14T11:17:36.298 INFO:tasks.workunit.client.0.smithi138.stdout:{ 2024-09-14T11:17:36.298 INFO:tasks.workunit.client.0.smithi138.stdout: "obj": { 2024-09-14T11:17:36.298 INFO:tasks.workunit.client.0.smithi138.stdout: "bucket": { 2024-09-14T11:17:36.298 INFO:tasks.workunit.client.0.smithi138.stdout: "name": "test", 2024-09-14T11:17:36.298 INFO:tasks.workunit.client.0.smithi138.stdout: "marker": "marker", 2024-09-14T11:17:36.298 INFO:tasks.workunit.client.0.smithi138.stdout: "bucket_id": "bucket-id", 2024-09-14T11:17:36.298 INFO:tasks.workunit.client.0.smithi138.stdout: "tenant": "", 2024-09-14T11:17:36.298 INFO:tasks.workunit.client.0.smithi138.stdout: "explicit_placement": { 2024-09-14T11:17:36.298 INFO:tasks.workunit.client.0.smithi138.stdout: "data_pool": "", 2024-09-14T11:17:36.298 INFO:tasks.workunit.client.0.smithi138.stdout: "data_extra_pool": "", 2024-09-14T11:17:36.299 INFO:tasks.workunit.client.0.smithi138.stdout: "index_pool": "" 2024-09-14T11:17:36.299 INFO:tasks.workunit.client.0.smithi138.stdout: } 2024-09-14T11:17:36.299 INFO:tasks.workunit.client.0.smithi138.stdout: }, 2024-09-14T11:17:36.299 INFO:tasks.workunit.client.0.smithi138.stdout: "key": { 2024-09-14T11:17:36.299 INFO:tasks.workunit.client.0.smithi138.stdout: "name": "_myobj", 2024-09-14T11:17:36.299 INFO:tasks.workunit.client.0.smithi138.stdout: "instance": "", 2024-09-14T11:17:36.299 INFO:tasks.workunit.client.0.smithi138.stdout: "ns": "ns" 2024-09-14T11:17:36.299 INFO:tasks.workunit.client.0.smithi138.stdout: } 2024-09-14T11:17:36.299 INFO:tasks.workunit.client.0.smithi138.stdout: } 2024-09-14T11:17:36.299 INFO:tasks.workunit.client.0.smithi138.stdout:} 2024-09-14T11:17:36.299 INFO:tasks.workunit.client.0.smithi138.stdout:{ 2024-09-14T11:17:36.299 INFO:tasks.workunit.client.0.smithi138.stdout: "raw_obj": { 2024-09-14T11:17:36.299 INFO:tasks.workunit.client.0.smithi138.stdout: "pool": "default-placement.data", 2024-09-14T11:17:36.299 INFO:tasks.workunit.client.0.smithi138.stdout: "oid": "marker__ns__myobj", 2024-09-14T11:17:36.299 INFO:tasks.workunit.client.0.smithi138.stdout: "loc": "" 2024-09-14T11:17:36.300 INFO:tasks.workunit.client.0.smithi138.stdout: } 2024-09-14T11:17:36.300 INFO:tasks.workunit.client.0.smithi138.stdout:} 2024-09-14T11:17:36.300 INFO:tasks.workunit.client.0.smithi138.stdout:{ 2024-09-14T11:17:36.300 INFO:tasks.workunit.client.0.smithi138.stdout: "new_obj": { 2024-09-14T11:17:36.300 INFO:tasks.workunit.client.0.smithi138.stdout: "bucket": { 2024-09-14T11:17:36.300 INFO:tasks.workunit.client.0.smithi138.stdout: "name": "test", 2024-09-14T11:17:36.300 INFO:tasks.workunit.client.0.smithi138.stdout: "marker": "marker", 2024-09-14T11:17:36.300 INFO:tasks.workunit.client.0.smithi138.stdout: "bucket_id": "bucket-id", 2024-09-14T11:17:36.300 INFO:tasks.workunit.client.0.smithi138.stdout: "tenant": "", 2024-09-14T11:17:36.300 INFO:tasks.workunit.client.0.smithi138.stdout: "explicit_placement": { 2024-09-14T11:17:36.300 INFO:tasks.workunit.client.0.smithi138.stdout: "data_pool": "", 2024-09-14T11:17:36.300 INFO:tasks.workunit.client.0.smithi138.stdout: "data_extra_pool": "", 2024-09-14T11:17:36.300 INFO:tasks.workunit.client.0.smithi138.stdout: "index_pool": "" 2024-09-14T11:17:36.301 INFO:tasks.workunit.client.0.smithi138.stdout: } 2024-09-14T11:17:36.301 INFO:tasks.workunit.client.0.smithi138.stdout: }, 2024-09-14T11:17:36.301 INFO:tasks.workunit.client.0.smithi138.stdout: "key": { 2024-09-14T11:17:36.301 INFO:tasks.workunit.client.0.smithi138.stdout: "name": "_myobj", 2024-09-14T11:17:36.301 INFO:tasks.workunit.client.0.smithi138.stdout: "instance": "", 2024-09-14T11:17:36.301 INFO:tasks.workunit.client.0.smithi138.stdout: "ns": "ns" 2024-09-14T11:17:36.301 INFO:tasks.workunit.client.0.smithi138.stdout: } 2024-09-14T11:17:36.301 INFO:tasks.workunit.client.0.smithi138.stdout: } 2024-09-14T11:17:36.301 INFO:tasks.workunit.client.0.smithi138.stdout:} 2024-09-14T11:17:36.301 INFO:tasks.workunit.client.0.smithi138.stdout:{ 2024-09-14T11:17:36.301 INFO:tasks.workunit.client.0.smithi138.stdout: "bucket": { 2024-09-14T11:17:36.301 INFO:tasks.workunit.client.0.smithi138.stdout: "name": "ebtest", 2024-09-14T11:17:36.301 INFO:tasks.workunit.client.0.smithi138.stdout: "marker": "marker", 2024-09-14T11:17:36.302 INFO:tasks.workunit.client.0.smithi138.stdout: "bucket_id": "bucket-id", 2024-09-14T11:17:36.302 INFO:tasks.workunit.client.0.smithi138.stdout: "tenant": "", 2024-09-14T11:17:36.302 INFO:tasks.workunit.client.0.smithi138.stdout: "explicit_placement": { 2024-09-14T11:17:36.302 INFO:tasks.workunit.client.0.smithi138.stdout: "data_pool": ".data-pool", 2024-09-14T11:17:36.302 INFO:tasks.workunit.client.0.smithi138.stdout: "data_extra_pool": "", 2024-09-14T11:17:36.302 INFO:tasks.workunit.client.0.smithi138.stdout: "index_pool": ".index-pool" 2024-09-14T11:17:36.302 INFO:tasks.workunit.client.0.smithi138.stdout: } 2024-09-14T11:17:36.302 INFO:tasks.workunit.client.0.smithi138.stdout: } 2024-09-14T11:17:36.302 INFO:tasks.workunit.client.0.smithi138.stdout:} 2024-09-14T11:17:36.302 INFO:tasks.workunit.client.0.smithi138.stdout:{ 2024-09-14T11:17:36.302 INFO:tasks.workunit.client.0.smithi138.stdout: "obj": { 2024-09-14T11:17:36.302 INFO:tasks.workunit.client.0.smithi138.stdout: "bucket": { 2024-09-14T11:17:36.302 INFO:tasks.workunit.client.0.smithi138.stdout: "name": "ebtest", 2024-09-14T11:17:36.302 INFO:tasks.workunit.client.0.smithi138.stdout: "marker": "marker", 2024-09-14T11:17:36.303 INFO:tasks.workunit.client.0.smithi138.stdout: "bucket_id": "bucket-id", 2024-09-14T11:17:36.303 INFO:tasks.workunit.client.0.smithi138.stdout: "tenant": "", 2024-09-14T11:17:36.303 INFO:tasks.workunit.client.0.smithi138.stdout: "explicit_placement": { 2024-09-14T11:17:36.303 INFO:tasks.workunit.client.0.smithi138.stdout: "data_pool": ".data-pool", 2024-09-14T11:17:36.303 INFO:tasks.workunit.client.0.smithi138.stdout: "data_extra_pool": "", 2024-09-14T11:17:36.303 INFO:tasks.workunit.client.0.smithi138.stdout: "index_pool": ".index-pool" 2024-09-14T11:17:36.303 INFO:tasks.workunit.client.0.smithi138.stdout: } 2024-09-14T11:17:36.303 INFO:tasks.workunit.client.0.smithi138.stdout: }, 2024-09-14T11:17:36.303 INFO:tasks.workunit.client.0.smithi138.stdout: "key": { 2024-09-14T11:17:36.303 INFO:tasks.workunit.client.0.smithi138.stdout: "name": "_myobj", 2024-09-14T11:17:36.303 INFO:tasks.workunit.client.0.smithi138.stdout: "instance": "", 2024-09-14T11:17:36.303 INFO:tasks.workunit.client.0.smithi138.stdout: "ns": "ns" 2024-09-14T11:17:36.303 INFO:tasks.workunit.client.0.smithi138.stdout: } 2024-09-14T11:17:36.304 INFO:tasks.workunit.client.0.smithi138.stdout: } 2024-09-14T11:17:36.304 INFO:tasks.workunit.client.0.smithi138.stdout:} 2024-09-14T11:17:36.304 INFO:tasks.workunit.client.0.smithi138.stdout:{ 2024-09-14T11:17:36.304 INFO:tasks.workunit.client.0.smithi138.stdout: "raw_obj": { 2024-09-14T11:17:36.304 INFO:tasks.workunit.client.0.smithi138.stdout: "pool": ".data-pool", 2024-09-14T11:17:36.304 INFO:tasks.workunit.client.0.smithi138.stdout: "oid": "marker__ns__myobj", 2024-09-14T11:17:36.304 INFO:tasks.workunit.client.0.smithi138.stdout: "loc": "" 2024-09-14T11:17:36.304 INFO:tasks.workunit.client.0.smithi138.stdout: } 2024-09-14T11:17:36.304 INFO:tasks.workunit.client.0.smithi138.stdout:} 2024-09-14T11:17:36.304 INFO:tasks.workunit.client.0.smithi138.stdout:{ 2024-09-14T11:17:36.304 INFO:tasks.workunit.client.0.smithi138.stdout: "new_obj": { 2024-09-14T11:17:36.304 INFO:tasks.workunit.client.0.smithi138.stdout: "bucket": { 2024-09-14T11:17:36.304 INFO:tasks.workunit.client.0.smithi138.stdout: "name": "ebtest", 2024-09-14T11:17:36.304 INFO:tasks.workunit.client.0.smithi138.stdout: "marker": "marker", 2024-09-14T11:17:36.304 INFO:tasks.workunit.client.0.smithi138.stdout: "bucket_id": "bucket-id", 2024-09-14T11:17:36.305 INFO:tasks.workunit.client.0.smithi138.stdout: "tenant": "", 2024-09-14T11:17:36.305 INFO:tasks.workunit.client.0.smithi138.stdout: "explicit_placement": { 2024-09-14T11:17:36.305 INFO:tasks.workunit.client.0.smithi138.stdout: "data_pool": ".data-pool", 2024-09-14T11:17:36.305 INFO:tasks.workunit.client.0.smithi138.stdout: "data_extra_pool": "", 2024-09-14T11:17:36.305 INFO:tasks.workunit.client.0.smithi138.stdout: "index_pool": ".index-pool" 2024-09-14T11:17:36.305 INFO:tasks.workunit.client.0.smithi138.stdout: } 2024-09-14T11:17:36.305 INFO:tasks.workunit.client.0.smithi138.stdout: }, 2024-09-14T11:17:36.305 INFO:tasks.workunit.client.0.smithi138.stdout: "key": { 2024-09-14T11:17:36.305 INFO:tasks.workunit.client.0.smithi138.stdout: "name": "_myobj", 2024-09-14T11:17:36.305 INFO:tasks.workunit.client.0.smithi138.stdout: "instance": "", 2024-09-14T11:17:36.305 INFO:tasks.workunit.client.0.smithi138.stdout: "ns": "ns" 2024-09-14T11:17:36.305 INFO:tasks.workunit.client.0.smithi138.stdout: } 2024-09-14T11:17:36.305 INFO:tasks.workunit.client.0.smithi138.stdout: } 2024-09-14T11:17:36.305 INFO:tasks.workunit.client.0.smithi138.stdout:} 2024-09-14T11:17:36.305 INFO:tasks.workunit.client.0.smithi138.stdout:{ 2024-09-14T11:17:36.305 INFO:tasks.workunit.client.0.smithi138.stdout: "bucket": { 2024-09-14T11:17:36.306 INFO:tasks.workunit.client.0.smithi138.stdout: "name": "test", 2024-09-14T11:17:36.308 INFO:tasks.workunit.client.0.smithi138.stdout: "marker": "marker", 2024-09-14T11:17:36.308 INFO:tasks.workunit.client.0.smithi138.stdout: "bucket_id": "bucket-id", 2024-09-14T11:17:36.308 INFO:tasks.workunit.client.0.smithi138.stdout: "tenant": "", 2024-09-14T11:17:36.308 INFO:tasks.workunit.client.0.smithi138.stdout: "explicit_placement": { 2024-09-14T11:17:36.308 INFO:tasks.workunit.client.0.smithi138.stdout: "data_pool": "", 2024-09-14T11:17:36.308 INFO:tasks.workunit.client.0.smithi138.stdout: "data_extra_pool": "", 2024-09-14T11:17:36.308 INFO:tasks.workunit.client.0.smithi138.stdout: "index_pool": "" 2024-09-14T11:17:36.308 INFO:tasks.workunit.client.0.smithi138.stdout: } 2024-09-14T11:17:36.308 INFO:tasks.workunit.client.0.smithi138.stdout: } 2024-09-14T11:17:36.308 INFO:tasks.workunit.client.0.smithi138.stdout:} 2024-09-14T11:17:36.308 INFO:tasks.workunit.client.0.smithi138.stdout:{ 2024-09-14T11:17:36.308 INFO:tasks.workunit.client.0.smithi138.stdout: "obj": { 2024-09-14T11:17:36.308 INFO:tasks.workunit.client.0.smithi138.stdout: "bucket": { 2024-09-14T11:17:36.309 INFO:tasks.workunit.client.0.smithi138.stdout: "name": "test", 2024-09-14T11:17:36.309 INFO:tasks.workunit.client.0.smithi138.stdout: "marker": "marker", 2024-09-14T11:17:36.309 INFO:tasks.workunit.client.0.smithi138.stdout: "bucket_id": "bucket-id", 2024-09-14T11:17:36.309 INFO:tasks.workunit.client.0.smithi138.stdout: "tenant": "", 2024-09-14T11:17:36.309 INFO:tasks.workunit.client.0.smithi138.stdout: "explicit_placement": { 2024-09-14T11:17:36.309 INFO:tasks.workunit.client.0.smithi138.stdout: "data_pool": "", 2024-09-14T11:17:36.309 INFO:tasks.workunit.client.0.smithi138.stdout: "data_extra_pool": "", 2024-09-14T11:17:36.309 INFO:tasks.workunit.client.0.smithi138.stdout: "index_pool": "" 2024-09-14T11:17:36.309 INFO:tasks.workunit.client.0.smithi138.stdout: } 2024-09-14T11:17:36.309 INFO:tasks.workunit.client.0.smithi138.stdout: }, 2024-09-14T11:17:36.309 INFO:tasks.workunit.client.0.smithi138.stdout: "key": { 2024-09-14T11:17:36.309 INFO:tasks.workunit.client.0.smithi138.stdout: "name": "_myobj", 2024-09-14T11:17:36.309 INFO:tasks.workunit.client.0.smithi138.stdout: "instance": "inst", 2024-09-14T11:17:36.309 INFO:tasks.workunit.client.0.smithi138.stdout: "ns": "" 2024-09-14T11:17:36.309 INFO:tasks.workunit.client.0.smithi138.stdout: } 2024-09-14T11:17:36.309 INFO:tasks.workunit.client.0.smithi138.stdout: } 2024-09-14T11:17:36.310 INFO:tasks.workunit.client.0.smithi138.stdout:} 2024-09-14T11:17:36.310 INFO:tasks.workunit.client.0.smithi138.stdout:{ 2024-09-14T11:17:36.310 INFO:tasks.workunit.client.0.smithi138.stdout: "raw_obj": { 2024-09-14T11:17:36.310 INFO:tasks.workunit.client.0.smithi138.stdout: "pool": "default-placement.data", 2024-09-14T11:17:36.310 INFO:tasks.workunit.client.0.smithi138.stdout: "oid": "marker__:inst__myobj", 2024-09-14T11:17:36.310 INFO:tasks.workunit.client.0.smithi138.stdout: "loc": "marker__myobj" 2024-09-14T11:17:36.310 INFO:tasks.workunit.client.0.smithi138.stdout: } 2024-09-14T11:17:36.310 INFO:tasks.workunit.client.0.smithi138.stdout:} 2024-09-14T11:17:36.310 INFO:tasks.workunit.client.0.smithi138.stdout:{ 2024-09-14T11:17:36.310 INFO:tasks.workunit.client.0.smithi138.stdout: "new_obj": { 2024-09-14T11:17:36.310 INFO:tasks.workunit.client.0.smithi138.stdout: "bucket": { 2024-09-14T11:17:36.310 INFO:tasks.workunit.client.0.smithi138.stdout: "name": "test", 2024-09-14T11:17:36.310 INFO:tasks.workunit.client.0.smithi138.stdout: "marker": "marker", 2024-09-14T11:17:36.310 INFO:tasks.workunit.client.0.smithi138.stdout: "bucket_id": "bucket-id", 2024-09-14T11:17:36.310 INFO:tasks.workunit.client.0.smithi138.stdout: "tenant": "", 2024-09-14T11:17:36.310 INFO:tasks.workunit.client.0.smithi138.stdout: "explicit_placement": { 2024-09-14T11:17:36.311 INFO:tasks.workunit.client.0.smithi138.stdout: "data_pool": "", 2024-09-14T11:17:36.311 INFO:tasks.workunit.client.0.smithi138.stdout: "data_extra_pool": "", 2024-09-14T11:17:36.311 INFO:tasks.workunit.client.0.smithi138.stdout: "index_pool": "" 2024-09-14T11:17:36.311 INFO:tasks.workunit.client.0.smithi138.stdout: } 2024-09-14T11:17:36.311 INFO:tasks.workunit.client.0.smithi138.stdout: }, 2024-09-14T11:17:36.311 INFO:tasks.workunit.client.0.smithi138.stdout: "key": { 2024-09-14T11:17:36.311 INFO:tasks.workunit.client.0.smithi138.stdout: "name": "_myobj", 2024-09-14T11:17:36.311 INFO:tasks.workunit.client.0.smithi138.stdout: "instance": "inst", 2024-09-14T11:17:36.311 INFO:tasks.workunit.client.0.smithi138.stdout: "ns": "" 2024-09-14T11:17:36.311 INFO:tasks.workunit.client.0.smithi138.stdout: } 2024-09-14T11:17:36.311 INFO:tasks.workunit.client.0.smithi138.stdout: } 2024-09-14T11:17:36.311 INFO:tasks.workunit.client.0.smithi138.stdout:} 2024-09-14T11:17:36.311 INFO:tasks.workunit.client.0.smithi138.stdout:{ 2024-09-14T11:17:36.311 INFO:tasks.workunit.client.0.smithi138.stdout: "bucket": { 2024-09-14T11:17:36.311 INFO:tasks.workunit.client.0.smithi138.stdout: "name": "ebtest", 2024-09-14T11:17:36.312 INFO:tasks.workunit.client.0.smithi138.stdout: "marker": "marker", 2024-09-14T11:17:36.312 INFO:tasks.workunit.client.0.smithi138.stdout: "bucket_id": "bucket-id", 2024-09-14T11:17:36.312 INFO:tasks.workunit.client.0.smithi138.stdout: "tenant": "", 2024-09-14T11:17:36.312 INFO:tasks.workunit.client.0.smithi138.stdout: "explicit_placement": { 2024-09-14T11:17:36.312 INFO:tasks.workunit.client.0.smithi138.stdout: "data_pool": ".data-pool", 2024-09-14T11:17:36.312 INFO:tasks.workunit.client.0.smithi138.stdout: "data_extra_pool": "", 2024-09-14T11:17:36.312 INFO:tasks.workunit.client.0.smithi138.stdout: "index_pool": ".index-pool" 2024-09-14T11:17:36.312 INFO:tasks.workunit.client.0.smithi138.stdout: } 2024-09-14T11:17:36.312 INFO:tasks.workunit.client.0.smithi138.stdout: } 2024-09-14T11:17:36.312 INFO:tasks.workunit.client.0.smithi138.stdout:} 2024-09-14T11:17:36.312 INFO:tasks.workunit.client.0.smithi138.stdout:{ 2024-09-14T11:17:36.312 INFO:tasks.workunit.client.0.smithi138.stdout: "obj": { 2024-09-14T11:17:36.312 INFO:tasks.workunit.client.0.smithi138.stdout: "bucket": { 2024-09-14T11:17:36.312 INFO:tasks.workunit.client.0.smithi138.stdout: "name": "ebtest", 2024-09-14T11:17:36.312 INFO:tasks.workunit.client.0.smithi138.stdout: "marker": "marker", 2024-09-14T11:17:36.313 INFO:tasks.workunit.client.0.smithi138.stdout: "bucket_id": "bucket-id", 2024-09-14T11:17:36.313 INFO:tasks.workunit.client.0.smithi138.stdout: "tenant": "", 2024-09-14T11:17:36.313 INFO:tasks.workunit.client.0.smithi138.stdout: "explicit_placement": { 2024-09-14T11:17:36.313 INFO:tasks.workunit.client.0.smithi138.stdout: "data_pool": ".data-pool", 2024-09-14T11:17:36.313 INFO:tasks.workunit.client.0.smithi138.stdout: "data_extra_pool": "", 2024-09-14T11:17:36.313 INFO:tasks.workunit.client.0.smithi138.stdout: "index_pool": ".index-pool" 2024-09-14T11:17:36.313 INFO:tasks.workunit.client.0.smithi138.stdout: } 2024-09-14T11:17:36.313 INFO:tasks.workunit.client.0.smithi138.stdout: }, 2024-09-14T11:17:36.313 INFO:tasks.workunit.client.0.smithi138.stdout: "key": { 2024-09-14T11:17:36.313 INFO:tasks.workunit.client.0.smithi138.stdout: "name": "_myobj", 2024-09-14T11:17:36.313 INFO:tasks.workunit.client.0.smithi138.stdout: "instance": "inst", 2024-09-14T11:17:36.313 INFO:tasks.workunit.client.0.smithi138.stdout: "ns": "" 2024-09-14T11:17:36.313 INFO:tasks.workunit.client.0.smithi138.stdout: } 2024-09-14T11:17:36.313 INFO:tasks.workunit.client.0.smithi138.stdout: } 2024-09-14T11:17:36.313 INFO:tasks.workunit.client.0.smithi138.stdout:} 2024-09-14T11:17:36.314 INFO:tasks.workunit.client.0.smithi138.stdout:{ 2024-09-14T11:17:36.314 INFO:tasks.workunit.client.0.smithi138.stdout: "raw_obj": { 2024-09-14T11:17:36.314 INFO:tasks.workunit.client.0.smithi138.stdout: "pool": ".data-pool", 2024-09-14T11:17:36.314 INFO:tasks.workunit.client.0.smithi138.stdout: "oid": "marker__:inst__myobj", 2024-09-14T11:17:36.314 INFO:tasks.workunit.client.0.smithi138.stdout: "loc": "marker__myobj" 2024-09-14T11:17:36.314 INFO:tasks.workunit.client.0.smithi138.stdout: } 2024-09-14T11:17:36.314 INFO:tasks.workunit.client.0.smithi138.stdout:} 2024-09-14T11:17:36.314 INFO:tasks.workunit.client.0.smithi138.stdout:{ 2024-09-14T11:17:36.314 INFO:tasks.workunit.client.0.smithi138.stdout: "new_obj": { 2024-09-14T11:17:36.314 INFO:tasks.workunit.client.0.smithi138.stdout: "bucket": { 2024-09-14T11:17:36.314 INFO:tasks.workunit.client.0.smithi138.stdout: "name": "ebtest", 2024-09-14T11:17:36.314 INFO:tasks.workunit.client.0.smithi138.stdout: "marker": "marker", 2024-09-14T11:17:36.314 INFO:tasks.workunit.client.0.smithi138.stdout: "bucket_id": "bucket-id", 2024-09-14T11:17:36.314 INFO:tasks.workunit.client.0.smithi138.stdout: "tenant": "", 2024-09-14T11:17:36.314 INFO:tasks.workunit.client.0.smithi138.stdout: "explicit_placement": { 2024-09-14T11:17:36.315 INFO:tasks.workunit.client.0.smithi138.stdout: "data_pool": ".data-pool", 2024-09-14T11:17:36.315 INFO:tasks.workunit.client.0.smithi138.stdout: "data_extra_pool": "", 2024-09-14T11:17:36.315 INFO:tasks.workunit.client.0.smithi138.stdout: "index_pool": ".index-pool" 2024-09-14T11:17:36.315 INFO:tasks.workunit.client.0.smithi138.stdout: } 2024-09-14T11:17:36.315 INFO:tasks.workunit.client.0.smithi138.stdout: }, 2024-09-14T11:17:36.315 INFO:tasks.workunit.client.0.smithi138.stdout: "key": { 2024-09-14T11:17:36.315 INFO:tasks.workunit.client.0.smithi138.stdout: "name": "_myobj", 2024-09-14T11:17:36.315 INFO:tasks.workunit.client.0.smithi138.stdout: "instance": "inst", 2024-09-14T11:17:36.315 INFO:tasks.workunit.client.0.smithi138.stdout: "ns": "" 2024-09-14T11:17:36.315 INFO:tasks.workunit.client.0.smithi138.stdout: } 2024-09-14T11:17:36.315 INFO:tasks.workunit.client.0.smithi138.stdout: } 2024-09-14T11:17:36.315 INFO:tasks.workunit.client.0.smithi138.stdout:} 2024-09-14T11:17:36.315 INFO:tasks.workunit.client.0.smithi138.stdout:{ 2024-09-14T11:17:36.315 INFO:tasks.workunit.client.0.smithi138.stdout: "bucket": { 2024-09-14T11:17:36.315 INFO:tasks.workunit.client.0.smithi138.stdout: "name": "test", 2024-09-14T11:17:36.315 INFO:tasks.workunit.client.0.smithi138.stdout: "marker": "marker", 2024-09-14T11:17:36.316 INFO:tasks.workunit.client.0.smithi138.stdout: "bucket_id": "bucket-id", 2024-09-14T11:17:36.316 INFO:tasks.workunit.client.0.smithi138.stdout: "tenant": "", 2024-09-14T11:17:36.316 INFO:tasks.workunit.client.0.smithi138.stdout: "explicit_placement": { 2024-09-14T11:17:36.316 INFO:tasks.workunit.client.0.smithi138.stdout: "data_pool": "", 2024-09-14T11:17:36.316 INFO:tasks.workunit.client.0.smithi138.stdout: "data_extra_pool": "", 2024-09-14T11:17:36.316 INFO:tasks.workunit.client.0.smithi138.stdout: "index_pool": "" 2024-09-14T11:17:36.316 INFO:tasks.workunit.client.0.smithi138.stdout: } 2024-09-14T11:17:36.316 INFO:tasks.workunit.client.0.smithi138.stdout: } 2024-09-14T11:17:36.316 INFO:tasks.workunit.client.0.smithi138.stdout:} 2024-09-14T11:17:36.316 INFO:tasks.workunit.client.0.smithi138.stdout:{ 2024-09-14T11:17:36.316 INFO:tasks.workunit.client.0.smithi138.stdout: "obj": { 2024-09-14T11:17:36.316 INFO:tasks.workunit.client.0.smithi138.stdout: "bucket": { 2024-09-14T11:17:36.316 INFO:tasks.workunit.client.0.smithi138.stdout: "name": "test", 2024-09-14T11:17:36.316 INFO:tasks.workunit.client.0.smithi138.stdout: "marker": "marker", 2024-09-14T11:17:36.316 INFO:tasks.workunit.client.0.smithi138.stdout: "bucket_id": "bucket-id", 2024-09-14T11:17:36.317 INFO:tasks.workunit.client.0.smithi138.stdout: "tenant": "", 2024-09-14T11:17:36.317 INFO:tasks.workunit.client.0.smithi138.stdout: "explicit_placement": { 2024-09-14T11:17:36.317 INFO:tasks.workunit.client.0.smithi138.stdout: "data_pool": "", 2024-09-14T11:17:36.317 INFO:tasks.workunit.client.0.smithi138.stdout: "data_extra_pool": "", 2024-09-14T11:17:36.317 INFO:tasks.workunit.client.0.smithi138.stdout: "index_pool": "" 2024-09-14T11:17:36.317 INFO:tasks.workunit.client.0.smithi138.stdout: } 2024-09-14T11:17:36.317 INFO:tasks.workunit.client.0.smithi138.stdout: }, 2024-09-14T11:17:36.317 INFO:tasks.workunit.client.0.smithi138.stdout: "key": { 2024-09-14T11:17:36.317 INFO:tasks.workunit.client.0.smithi138.stdout: "name": "_myobj", 2024-09-14T11:17:36.317 INFO:tasks.workunit.client.0.smithi138.stdout: "instance": "inst", 2024-09-14T11:17:36.317 INFO:tasks.workunit.client.0.smithi138.stdout: "ns": "ns" 2024-09-14T11:17:36.317 INFO:tasks.workunit.client.0.smithi138.stdout: } 2024-09-14T11:17:36.317 INFO:tasks.workunit.client.0.smithi138.stdout: } 2024-09-14T11:17:36.317 INFO:tasks.workunit.client.0.smithi138.stdout:} 2024-09-14T11:17:36.317 INFO:tasks.workunit.client.0.smithi138.stdout:{ 2024-09-14T11:17:36.317 INFO:tasks.workunit.client.0.smithi138.stdout: "raw_obj": { 2024-09-14T11:17:36.318 INFO:tasks.workunit.client.0.smithi138.stdout: "pool": "default-placement.data", 2024-09-14T11:17:36.318 INFO:tasks.workunit.client.0.smithi138.stdout: "oid": "marker__ns:inst__myobj", 2024-09-14T11:17:36.318 INFO:tasks.workunit.client.0.smithi138.stdout: "loc": "" 2024-09-14T11:17:36.318 INFO:tasks.workunit.client.0.smithi138.stdout: } 2024-09-14T11:17:36.318 INFO:tasks.workunit.client.0.smithi138.stdout:} 2024-09-14T11:17:36.318 INFO:tasks.workunit.client.0.smithi138.stdout:{ 2024-09-14T11:17:36.318 INFO:tasks.workunit.client.0.smithi138.stdout: "new_obj": { 2024-09-14T11:17:36.318 INFO:tasks.workunit.client.0.smithi138.stdout: "bucket": { 2024-09-14T11:17:36.318 INFO:tasks.workunit.client.0.smithi138.stdout: "name": "test", 2024-09-14T11:17:36.318 INFO:tasks.workunit.client.0.smithi138.stdout: "marker": "marker", 2024-09-14T11:17:36.318 INFO:tasks.workunit.client.0.smithi138.stdout: "bucket_id": "bucket-id", 2024-09-14T11:17:36.318 INFO:tasks.workunit.client.0.smithi138.stdout: "tenant": "", 2024-09-14T11:17:36.318 INFO:tasks.workunit.client.0.smithi138.stdout: "explicit_placement": { 2024-09-14T11:17:36.318 INFO:tasks.workunit.client.0.smithi138.stdout: "data_pool": "", 2024-09-14T11:17:36.318 INFO:tasks.workunit.client.0.smithi138.stdout: "data_extra_pool": "", 2024-09-14T11:17:36.319 INFO:tasks.workunit.client.0.smithi138.stdout: "index_pool": "" 2024-09-14T11:17:36.319 INFO:tasks.workunit.client.0.smithi138.stdout: } 2024-09-14T11:17:36.319 INFO:tasks.workunit.client.0.smithi138.stdout: }, 2024-09-14T11:17:36.319 INFO:tasks.workunit.client.0.smithi138.stdout: "key": { 2024-09-14T11:17:36.319 INFO:tasks.workunit.client.0.smithi138.stdout: "name": "_myobj", 2024-09-14T11:17:36.319 INFO:tasks.workunit.client.0.smithi138.stdout: "instance": "inst", 2024-09-14T11:17:36.319 INFO:tasks.workunit.client.0.smithi138.stdout: "ns": "ns" 2024-09-14T11:17:36.319 INFO:tasks.workunit.client.0.smithi138.stdout: } 2024-09-14T11:17:36.319 INFO:tasks.workunit.client.0.smithi138.stdout: } 2024-09-14T11:17:36.319 INFO:tasks.workunit.client.0.smithi138.stdout:} 2024-09-14T11:17:36.319 INFO:tasks.workunit.client.0.smithi138.stdout:{ 2024-09-14T11:17:36.319 INFO:tasks.workunit.client.0.smithi138.stdout: "bucket": { 2024-09-14T11:17:36.319 INFO:tasks.workunit.client.0.smithi138.stdout: "name": "ebtest", 2024-09-14T11:17:36.319 INFO:tasks.workunit.client.0.smithi138.stdout: "marker": "marker", 2024-09-14T11:17:36.319 INFO:tasks.workunit.client.0.smithi138.stdout: "bucket_id": "bucket-id", 2024-09-14T11:17:36.320 INFO:tasks.workunit.client.0.smithi138.stdout: "tenant": "", 2024-09-14T11:17:36.320 INFO:tasks.workunit.client.0.smithi138.stdout: "explicit_placement": { 2024-09-14T11:17:36.320 INFO:tasks.workunit.client.0.smithi138.stdout: "data_pool": ".data-pool", 2024-09-14T11:17:36.320 INFO:tasks.workunit.client.0.smithi138.stdout: "data_extra_pool": "", 2024-09-14T11:17:36.320 INFO:tasks.workunit.client.0.smithi138.stdout: "index_pool": ".index-pool" 2024-09-14T11:17:36.320 INFO:tasks.workunit.client.0.smithi138.stdout: } 2024-09-14T11:17:36.320 INFO:tasks.workunit.client.0.smithi138.stdout: } 2024-09-14T11:17:36.320 INFO:tasks.workunit.client.0.smithi138.stdout:} 2024-09-14T11:17:36.320 INFO:tasks.workunit.client.0.smithi138.stdout:{ 2024-09-14T11:17:36.320 INFO:tasks.workunit.client.0.smithi138.stdout: "obj": { 2024-09-14T11:17:36.320 INFO:tasks.workunit.client.0.smithi138.stdout: "bucket": { 2024-09-14T11:17:36.320 INFO:tasks.workunit.client.0.smithi138.stdout: "name": "ebtest", 2024-09-14T11:17:36.320 INFO:tasks.workunit.client.0.smithi138.stdout: "marker": "marker", 2024-09-14T11:17:36.321 INFO:tasks.workunit.client.0.smithi138.stdout: "bucket_id": "bucket-id", 2024-09-14T11:17:36.321 INFO:tasks.workunit.client.0.smithi138.stdout: "tenant": "", 2024-09-14T11:17:36.321 INFO:tasks.workunit.client.0.smithi138.stdout: "explicit_placement": { 2024-09-14T11:17:36.321 INFO:tasks.workunit.client.0.smithi138.stdout: "data_pool": ".data-pool", 2024-09-14T11:17:36.321 INFO:tasks.workunit.client.0.smithi138.stdout: "data_extra_pool": "", 2024-09-14T11:17:36.321 INFO:tasks.workunit.client.0.smithi138.stdout: "index_pool": ".index-pool" 2024-09-14T11:17:36.321 INFO:tasks.workunit.client.0.smithi138.stdout: } 2024-09-14T11:17:36.321 INFO:tasks.workunit.client.0.smithi138.stdout: }, 2024-09-14T11:17:36.321 INFO:tasks.workunit.client.0.smithi138.stdout: "key": { 2024-09-14T11:17:36.321 INFO:tasks.workunit.client.0.smithi138.stdout: "name": "_myobj", 2024-09-14T11:17:36.321 INFO:tasks.workunit.client.0.smithi138.stdout: "instance": "inst", 2024-09-14T11:17:36.321 INFO:tasks.workunit.client.0.smithi138.stdout: "ns": "ns" 2024-09-14T11:17:36.321 INFO:tasks.workunit.client.0.smithi138.stdout: } 2024-09-14T11:17:36.322 INFO:tasks.workunit.client.0.smithi138.stdout: } 2024-09-14T11:17:36.322 INFO:tasks.workunit.client.0.smithi138.stdout:} 2024-09-14T11:17:36.322 INFO:tasks.workunit.client.0.smithi138.stdout:{ 2024-09-14T11:17:36.322 INFO:tasks.workunit.client.0.smithi138.stdout: "raw_obj": { 2024-09-14T11:17:36.322 INFO:tasks.workunit.client.0.smithi138.stdout: "pool": ".data-pool", 2024-09-14T11:17:36.322 INFO:tasks.workunit.client.0.smithi138.stdout: "oid": "marker__ns:inst__myobj", 2024-09-14T11:17:36.322 INFO:tasks.workunit.client.0.smithi138.stdout: "loc": "" 2024-09-14T11:17:36.322 INFO:tasks.workunit.client.0.smithi138.stdout: } 2024-09-14T11:17:36.322 INFO:tasks.workunit.client.0.smithi138.stdout:} 2024-09-14T11:17:36.322 INFO:tasks.workunit.client.0.smithi138.stdout:{ 2024-09-14T11:17:36.322 INFO:tasks.workunit.client.0.smithi138.stdout: "new_obj": { 2024-09-14T11:17:36.322 INFO:tasks.workunit.client.0.smithi138.stdout: "bucket": { 2024-09-14T11:17:36.322 INFO:tasks.workunit.client.0.smithi138.stdout: "name": "ebtest", 2024-09-14T11:17:36.322 INFO:tasks.workunit.client.0.smithi138.stdout: "marker": "marker", 2024-09-14T11:17:36.322 INFO:tasks.workunit.client.0.smithi138.stdout: "bucket_id": "bucket-id", 2024-09-14T11:17:36.323 INFO:tasks.workunit.client.0.smithi138.stdout: "tenant": "", 2024-09-14T11:17:36.323 INFO:tasks.workunit.client.0.smithi138.stdout: "explicit_placement": { 2024-09-14T11:17:36.323 INFO:tasks.workunit.client.0.smithi138.stdout: "data_pool": ".data-pool", 2024-09-14T11:17:36.323 INFO:tasks.workunit.client.0.smithi138.stdout: "data_extra_pool": "", 2024-09-14T11:17:36.323 INFO:tasks.workunit.client.0.smithi138.stdout: "index_pool": ".index-pool" 2024-09-14T11:17:36.323 INFO:tasks.workunit.client.0.smithi138.stdout: } 2024-09-14T11:17:36.323 INFO:tasks.workunit.client.0.smithi138.stdout: }, 2024-09-14T11:17:36.323 INFO:tasks.workunit.client.0.smithi138.stdout: "key": { 2024-09-14T11:17:36.323 INFO:tasks.workunit.client.0.smithi138.stdout: "name": "_myobj", 2024-09-14T11:17:36.323 INFO:tasks.workunit.client.0.smithi138.stdout: "instance": "inst", 2024-09-14T11:17:36.323 INFO:tasks.workunit.client.0.smithi138.stdout: "ns": "ns" 2024-09-14T11:17:36.323 INFO:tasks.workunit.client.0.smithi138.stdout: } 2024-09-14T11:17:36.323 INFO:tasks.workunit.client.0.smithi138.stdout: } 2024-09-14T11:17:36.323 INFO:tasks.workunit.client.0.smithi138.stdout:} 2024-09-14T11:17:36.323 INFO:tasks.workunit.client.0.smithi138.stdout:{ 2024-09-14T11:17:36.324 INFO:tasks.workunit.client.0.smithi138.stdout: "bucket": { 2024-09-14T11:17:36.324 INFO:tasks.workunit.client.0.smithi138.stdout: "name": "test", 2024-09-14T11:17:36.324 INFO:tasks.workunit.client.0.smithi138.stdout: "marker": "marker", 2024-09-14T11:17:36.324 INFO:tasks.workunit.client.0.smithi138.stdout: "bucket_id": "bucket-id", 2024-09-14T11:17:36.324 INFO:tasks.workunit.client.0.smithi138.stdout: "tenant": "", 2024-09-14T11:17:36.324 INFO:tasks.workunit.client.0.smithi138.stdout: "explicit_placement": { 2024-09-14T11:17:36.324 INFO:tasks.workunit.client.0.smithi138.stdout: "data_pool": "", 2024-09-14T11:17:36.324 INFO:tasks.workunit.client.0.smithi138.stdout: "data_extra_pool": "", 2024-09-14T11:17:36.324 INFO:tasks.workunit.client.0.smithi138.stdout: "index_pool": "" 2024-09-14T11:17:36.324 INFO:tasks.workunit.client.0.smithi138.stdout: } 2024-09-14T11:17:36.324 INFO:tasks.workunit.client.0.smithi138.stdout: } 2024-09-14T11:17:36.324 INFO:tasks.workunit.client.0.smithi138.stdout:} 2024-09-14T11:17:36.324 INFO:tasks.workunit.client.0.smithi138.stdout:{ 2024-09-14T11:17:36.325 INFO:tasks.workunit.client.0.smithi138.stdout: "obj": { 2024-09-14T11:17:36.325 INFO:tasks.workunit.client.0.smithi138.stdout: "bucket": { 2024-09-14T11:17:36.325 INFO:tasks.workunit.client.0.smithi138.stdout: "name": "test", 2024-09-14T11:17:36.325 INFO:tasks.workunit.client.0.smithi138.stdout: "marker": "marker", 2024-09-14T11:17:36.325 INFO:tasks.workunit.client.0.smithi138.stdout: "bucket_id": "bucket-id", 2024-09-14T11:17:36.325 INFO:tasks.workunit.client.0.smithi138.stdout: "tenant": "", 2024-09-14T11:17:36.325 INFO:tasks.workunit.client.0.smithi138.stdout: "explicit_placement": { 2024-09-14T11:17:36.325 INFO:tasks.workunit.client.0.smithi138.stdout: "data_pool": "", 2024-09-14T11:17:36.325 INFO:tasks.workunit.client.0.smithi138.stdout: "data_extra_pool": "", 2024-09-14T11:17:36.325 INFO:tasks.workunit.client.0.smithi138.stdout: "index_pool": "" 2024-09-14T11:17:36.325 INFO:tasks.workunit.client.0.smithi138.stdout: } 2024-09-14T11:17:36.325 INFO:tasks.workunit.client.0.smithi138.stdout: }, 2024-09-14T11:17:36.325 INFO:tasks.workunit.client.0.smithi138.stdout: "key": { 2024-09-14T11:17:36.325 INFO:tasks.workunit.client.0.smithi138.stdout: "name": "_myobj_", 2024-09-14T11:17:36.326 INFO:tasks.workunit.client.0.smithi138.stdout: "instance": "", 2024-09-14T11:17:36.326 INFO:tasks.workunit.client.0.smithi138.stdout: "ns": "" 2024-09-14T11:17:36.326 INFO:tasks.workunit.client.0.smithi138.stdout: } 2024-09-14T11:17:36.326 INFO:tasks.workunit.client.0.smithi138.stdout: } 2024-09-14T11:17:36.326 INFO:tasks.workunit.client.0.smithi138.stdout:} 2024-09-14T11:17:36.326 INFO:tasks.workunit.client.0.smithi138.stdout:{ 2024-09-14T11:17:36.326 INFO:tasks.workunit.client.0.smithi138.stdout: "raw_obj": { 2024-09-14T11:17:36.326 INFO:tasks.workunit.client.0.smithi138.stdout: "pool": "default-placement.data", 2024-09-14T11:17:36.326 INFO:tasks.workunit.client.0.smithi138.stdout: "oid": "marker___myobj_", 2024-09-14T11:17:36.326 INFO:tasks.workunit.client.0.smithi138.stdout: "loc": "marker__myobj_" 2024-09-14T11:17:36.326 INFO:tasks.workunit.client.0.smithi138.stdout: } 2024-09-14T11:17:36.326 INFO:tasks.workunit.client.0.smithi138.stdout:} 2024-09-14T11:17:36.326 INFO:tasks.workunit.client.0.smithi138.stdout:{ 2024-09-14T11:17:36.326 INFO:tasks.workunit.client.0.smithi138.stdout: "new_obj": { 2024-09-14T11:17:36.326 INFO:tasks.workunit.client.0.smithi138.stdout: "bucket": { 2024-09-14T11:17:36.327 INFO:tasks.workunit.client.0.smithi138.stdout: "name": "test", 2024-09-14T11:17:36.327 INFO:tasks.workunit.client.0.smithi138.stdout: "marker": "marker", 2024-09-14T11:17:36.327 INFO:tasks.workunit.client.0.smithi138.stdout: "bucket_id": "bucket-id", 2024-09-14T11:17:36.327 INFO:tasks.workunit.client.0.smithi138.stdout: "tenant": "", 2024-09-14T11:17:36.327 INFO:tasks.workunit.client.0.smithi138.stdout: "explicit_placement": { 2024-09-14T11:17:36.327 INFO:tasks.workunit.client.0.smithi138.stdout: "data_pool": "", 2024-09-14T11:17:36.327 INFO:tasks.workunit.client.0.smithi138.stdout: "data_extra_pool": "", 2024-09-14T11:17:36.327 INFO:tasks.workunit.client.0.smithi138.stdout: "index_pool": "" 2024-09-14T11:17:36.327 INFO:tasks.workunit.client.0.smithi138.stdout: } 2024-09-14T11:17:36.327 INFO:tasks.workunit.client.0.smithi138.stdout: }, 2024-09-14T11:17:36.327 INFO:tasks.workunit.client.0.smithi138.stdout: "key": { 2024-09-14T11:17:36.327 INFO:tasks.workunit.client.0.smithi138.stdout: "name": "_myobj_", 2024-09-14T11:17:36.327 INFO:tasks.workunit.client.0.smithi138.stdout: "instance": "", 2024-09-14T11:17:36.328 INFO:tasks.workunit.client.0.smithi138.stdout: "ns": "" 2024-09-14T11:17:36.328 INFO:tasks.workunit.client.0.smithi138.stdout: } 2024-09-14T11:17:36.328 INFO:tasks.workunit.client.0.smithi138.stdout: } 2024-09-14T11:17:36.328 INFO:tasks.workunit.client.0.smithi138.stdout:} 2024-09-14T11:17:36.328 INFO:tasks.workunit.client.0.smithi138.stdout:{ 2024-09-14T11:17:36.328 INFO:tasks.workunit.client.0.smithi138.stdout: "bucket": { 2024-09-14T11:17:36.328 INFO:tasks.workunit.client.0.smithi138.stdout: "name": "ebtest", 2024-09-14T11:17:36.328 INFO:tasks.workunit.client.0.smithi138.stdout: "marker": "marker", 2024-09-14T11:17:36.328 INFO:tasks.workunit.client.0.smithi138.stdout: "bucket_id": "bucket-id", 2024-09-14T11:17:36.328 INFO:tasks.workunit.client.0.smithi138.stdout: "tenant": "", 2024-09-14T11:17:36.328 INFO:tasks.workunit.client.0.smithi138.stdout: "explicit_placement": { 2024-09-14T11:17:36.328 INFO:tasks.workunit.client.0.smithi138.stdout: "data_pool": ".data-pool", 2024-09-14T11:17:36.328 INFO:tasks.workunit.client.0.smithi138.stdout: "data_extra_pool": "", 2024-09-14T11:17:36.329 INFO:tasks.workunit.client.0.smithi138.stdout: "index_pool": ".index-pool" 2024-09-14T11:17:36.329 INFO:tasks.workunit.client.0.smithi138.stdout: } 2024-09-14T11:17:36.329 INFO:tasks.workunit.client.0.smithi138.stdout: } 2024-09-14T11:17:36.329 INFO:tasks.workunit.client.0.smithi138.stdout:} 2024-09-14T11:17:36.329 INFO:tasks.workunit.client.0.smithi138.stdout:{ 2024-09-14T11:17:36.329 INFO:tasks.workunit.client.0.smithi138.stdout: "obj": { 2024-09-14T11:17:36.329 INFO:tasks.workunit.client.0.smithi138.stdout: "bucket": { 2024-09-14T11:17:36.329 INFO:tasks.workunit.client.0.smithi138.stdout: "name": "ebtest", 2024-09-14T11:17:36.329 INFO:tasks.workunit.client.0.smithi138.stdout: "marker": "marker", 2024-09-14T11:17:36.329 INFO:tasks.workunit.client.0.smithi138.stdout: "bucket_id": "bucket-id", 2024-09-14T11:17:36.329 INFO:tasks.workunit.client.0.smithi138.stdout: "tenant": "", 2024-09-14T11:17:36.329 INFO:tasks.workunit.client.0.smithi138.stdout: "explicit_placement": { 2024-09-14T11:17:36.329 INFO:tasks.workunit.client.0.smithi138.stdout: "data_pool": ".data-pool", 2024-09-14T11:17:36.329 INFO:tasks.workunit.client.0.smithi138.stdout: "data_extra_pool": "", 2024-09-14T11:17:36.329 INFO:tasks.workunit.client.0.smithi138.stdout: "index_pool": ".index-pool" 2024-09-14T11:17:36.330 INFO:tasks.workunit.client.0.smithi138.stdout: } 2024-09-14T11:17:36.330 INFO:tasks.workunit.client.0.smithi138.stdout: }, 2024-09-14T11:17:36.330 INFO:tasks.workunit.client.0.smithi138.stdout: "key": { 2024-09-14T11:17:36.330 INFO:tasks.workunit.client.0.smithi138.stdout: "name": "_myobj_", 2024-09-14T11:17:36.330 INFO:tasks.workunit.client.0.smithi138.stdout: "instance": "", 2024-09-14T11:17:36.330 INFO:tasks.workunit.client.0.smithi138.stdout: "ns": "" 2024-09-14T11:17:36.330 INFO:tasks.workunit.client.0.smithi138.stdout: } 2024-09-14T11:17:36.330 INFO:tasks.workunit.client.0.smithi138.stdout: } 2024-09-14T11:17:36.330 INFO:tasks.workunit.client.0.smithi138.stdout:} 2024-09-14T11:17:36.330 INFO:tasks.workunit.client.0.smithi138.stdout:{ 2024-09-14T11:17:36.330 INFO:tasks.workunit.client.0.smithi138.stdout: "raw_obj": { 2024-09-14T11:17:36.330 INFO:tasks.workunit.client.0.smithi138.stdout: "pool": ".data-pool", 2024-09-14T11:17:36.330 INFO:tasks.workunit.client.0.smithi138.stdout: "oid": "marker___myobj_", 2024-09-14T11:17:36.330 INFO:tasks.workunit.client.0.smithi138.stdout: "loc": "marker__myobj_" 2024-09-14T11:17:36.330 INFO:tasks.workunit.client.0.smithi138.stdout: } 2024-09-14T11:17:36.331 INFO:tasks.workunit.client.0.smithi138.stdout:} 2024-09-14T11:17:36.331 INFO:tasks.workunit.client.0.smithi138.stdout:{ 2024-09-14T11:17:36.331 INFO:tasks.workunit.client.0.smithi138.stdout: "new_obj": { 2024-09-14T11:17:36.331 INFO:tasks.workunit.client.0.smithi138.stdout: "bucket": { 2024-09-14T11:17:36.331 INFO:tasks.workunit.client.0.smithi138.stdout: "name": "ebtest", 2024-09-14T11:17:36.331 INFO:tasks.workunit.client.0.smithi138.stdout: "marker": "marker", 2024-09-14T11:17:36.331 INFO:tasks.workunit.client.0.smithi138.stdout: "bucket_id": "bucket-id", 2024-09-14T11:17:36.331 INFO:tasks.workunit.client.0.smithi138.stdout: "tenant": "", 2024-09-14T11:17:36.331 INFO:tasks.workunit.client.0.smithi138.stdout: "explicit_placement": { 2024-09-14T11:17:36.331 INFO:tasks.workunit.client.0.smithi138.stdout: "data_pool": ".data-pool", 2024-09-14T11:17:36.331 INFO:tasks.workunit.client.0.smithi138.stdout: "data_extra_pool": "", 2024-09-14T11:17:36.331 INFO:tasks.workunit.client.0.smithi138.stdout: "index_pool": ".index-pool" 2024-09-14T11:17:36.331 INFO:tasks.workunit.client.0.smithi138.stdout: } 2024-09-14T11:17:36.331 INFO:tasks.workunit.client.0.smithi138.stdout: }, 2024-09-14T11:17:36.332 INFO:tasks.workunit.client.0.smithi138.stdout: "key": { 2024-09-14T11:17:36.332 INFO:tasks.workunit.client.0.smithi138.stdout: "name": "_myobj_", 2024-09-14T11:17:36.332 INFO:tasks.workunit.client.0.smithi138.stdout: "instance": "", 2024-09-14T11:17:36.332 INFO:tasks.workunit.client.0.smithi138.stdout: "ns": "" 2024-09-14T11:17:36.332 INFO:tasks.workunit.client.0.smithi138.stdout: } 2024-09-14T11:17:36.332 INFO:tasks.workunit.client.0.smithi138.stdout: } 2024-09-14T11:17:36.332 INFO:tasks.workunit.client.0.smithi138.stdout:} 2024-09-14T11:17:36.332 INFO:tasks.workunit.client.0.smithi138.stdout:{ 2024-09-14T11:17:36.332 INFO:tasks.workunit.client.0.smithi138.stdout: "bucket": { 2024-09-14T11:17:36.332 INFO:tasks.workunit.client.0.smithi138.stdout: "name": "test", 2024-09-14T11:17:36.332 INFO:tasks.workunit.client.0.smithi138.stdout: "marker": "marker", 2024-09-14T11:17:36.332 INFO:tasks.workunit.client.0.smithi138.stdout: "bucket_id": "bucket-id", 2024-09-14T11:17:36.332 INFO:tasks.workunit.client.0.smithi138.stdout: "tenant": "", 2024-09-14T11:17:36.332 INFO:tasks.workunit.client.0.smithi138.stdout: "explicit_placement": { 2024-09-14T11:17:36.333 INFO:tasks.workunit.client.0.smithi138.stdout: "data_pool": "", 2024-09-14T11:17:36.333 INFO:tasks.workunit.client.0.smithi138.stdout: "data_extra_pool": "", 2024-09-14T11:17:36.333 INFO:tasks.workunit.client.0.smithi138.stdout: "index_pool": "" 2024-09-14T11:17:36.333 INFO:tasks.workunit.client.0.smithi138.stdout: } 2024-09-14T11:17:36.333 INFO:tasks.workunit.client.0.smithi138.stdout: } 2024-09-14T11:17:36.333 INFO:tasks.workunit.client.0.smithi138.stdout:} 2024-09-14T11:17:36.333 INFO:tasks.workunit.client.0.smithi138.stdout:{ 2024-09-14T11:17:36.333 INFO:tasks.workunit.client.0.smithi138.stdout: "obj": { 2024-09-14T11:17:36.333 INFO:tasks.workunit.client.0.smithi138.stdout: "bucket": { 2024-09-14T11:17:36.333 INFO:tasks.workunit.client.0.smithi138.stdout: "name": "test", 2024-09-14T11:17:36.333 INFO:tasks.workunit.client.0.smithi138.stdout: "marker": "marker", 2024-09-14T11:17:36.333 INFO:tasks.workunit.client.0.smithi138.stdout: "bucket_id": "bucket-id", 2024-09-14T11:17:36.333 INFO:tasks.workunit.client.0.smithi138.stdout: "tenant": "", 2024-09-14T11:17:36.333 INFO:tasks.workunit.client.0.smithi138.stdout: "explicit_placement": { 2024-09-14T11:17:36.334 INFO:tasks.workunit.client.0.smithi138.stdout: "data_pool": "", 2024-09-14T11:17:36.334 INFO:tasks.workunit.client.0.smithi138.stdout: "data_extra_pool": "", 2024-09-14T11:17:36.334 INFO:tasks.workunit.client.0.smithi138.stdout: "index_pool": "" 2024-09-14T11:17:36.334 INFO:tasks.workunit.client.0.smithi138.stdout: } 2024-09-14T11:17:36.334 INFO:tasks.workunit.client.0.smithi138.stdout: }, 2024-09-14T11:17:36.334 INFO:tasks.workunit.client.0.smithi138.stdout: "key": { 2024-09-14T11:17:36.334 INFO:tasks.workunit.client.0.smithi138.stdout: "name": "_myobj_", 2024-09-14T11:17:36.334 INFO:tasks.workunit.client.0.smithi138.stdout: "instance": "", 2024-09-14T11:17:36.334 INFO:tasks.workunit.client.0.smithi138.stdout: "ns": "ns" 2024-09-14T11:17:36.334 INFO:tasks.workunit.client.0.smithi138.stdout: } 2024-09-14T11:17:36.334 INFO:tasks.workunit.client.0.smithi138.stdout: } 2024-09-14T11:17:36.334 INFO:tasks.workunit.client.0.smithi138.stdout:} 2024-09-14T11:17:36.334 INFO:tasks.workunit.client.0.smithi138.stdout:{ 2024-09-14T11:17:36.335 INFO:tasks.workunit.client.0.smithi138.stdout: "raw_obj": { 2024-09-14T11:17:36.335 INFO:tasks.workunit.client.0.smithi138.stdout: "pool": "default-placement.data", 2024-09-14T11:17:36.335 INFO:tasks.workunit.client.0.smithi138.stdout: "oid": "marker__ns__myobj_", 2024-09-14T11:17:36.335 INFO:tasks.workunit.client.0.smithi138.stdout: "loc": "" 2024-09-14T11:17:36.335 INFO:tasks.workunit.client.0.smithi138.stdout: } 2024-09-14T11:17:36.335 INFO:tasks.workunit.client.0.smithi138.stdout:} 2024-09-14T11:17:36.335 INFO:tasks.workunit.client.0.smithi138.stdout:{ 2024-09-14T11:17:36.335 INFO:tasks.workunit.client.0.smithi138.stdout: "new_obj": { 2024-09-14T11:17:36.335 INFO:tasks.workunit.client.0.smithi138.stdout: "bucket": { 2024-09-14T11:17:36.335 INFO:tasks.workunit.client.0.smithi138.stdout: "name": "test", 2024-09-14T11:17:36.335 INFO:tasks.workunit.client.0.smithi138.stdout: "marker": "marker", 2024-09-14T11:17:36.335 INFO:tasks.workunit.client.0.smithi138.stdout: "bucket_id": "bucket-id", 2024-09-14T11:17:36.335 INFO:tasks.workunit.client.0.smithi138.stdout: "tenant": "", 2024-09-14T11:17:36.335 INFO:tasks.workunit.client.0.smithi138.stdout: "explicit_placement": { 2024-09-14T11:17:36.335 INFO:tasks.workunit.client.0.smithi138.stdout: "data_pool": "", 2024-09-14T11:17:36.336 INFO:tasks.workunit.client.0.smithi138.stdout: "data_extra_pool": "", 2024-09-14T11:17:36.336 INFO:tasks.workunit.client.0.smithi138.stdout: "index_pool": "" 2024-09-14T11:17:36.336 INFO:tasks.workunit.client.0.smithi138.stdout: } 2024-09-14T11:17:36.336 INFO:tasks.workunit.client.0.smithi138.stdout: }, 2024-09-14T11:17:36.336 INFO:tasks.workunit.client.0.smithi138.stdout: "key": { 2024-09-14T11:17:36.336 INFO:tasks.workunit.client.0.smithi138.stdout: "name": "_myobj_", 2024-09-14T11:17:36.336 INFO:tasks.workunit.client.0.smithi138.stdout: "instance": "", 2024-09-14T11:17:36.336 INFO:tasks.workunit.client.0.smithi138.stdout: "ns": "ns" 2024-09-14T11:17:36.336 INFO:tasks.workunit.client.0.smithi138.stdout: } 2024-09-14T11:17:36.336 INFO:tasks.workunit.client.0.smithi138.stdout: } 2024-09-14T11:17:36.336 INFO:tasks.workunit.client.0.smithi138.stdout:} 2024-09-14T11:17:36.336 INFO:tasks.workunit.client.0.smithi138.stdout:{ 2024-09-14T11:17:36.337 INFO:tasks.workunit.client.0.smithi138.stdout: "bucket": { 2024-09-14T11:17:36.337 INFO:tasks.workunit.client.0.smithi138.stdout: "name": "ebtest", 2024-09-14T11:17:36.337 INFO:tasks.workunit.client.0.smithi138.stdout: "marker": "marker", 2024-09-14T11:17:36.337 INFO:tasks.workunit.client.0.smithi138.stdout: "bucket_id": "bucket-id", 2024-09-14T11:17:36.337 INFO:tasks.workunit.client.0.smithi138.stdout: "tenant": "", 2024-09-14T11:17:36.337 INFO:tasks.workunit.client.0.smithi138.stdout: "explicit_placement": { 2024-09-14T11:17:36.337 INFO:tasks.workunit.client.0.smithi138.stdout: "data_pool": ".data-pool", 2024-09-14T11:17:36.337 INFO:tasks.workunit.client.0.smithi138.stdout: "data_extra_pool": "", 2024-09-14T11:17:36.337 INFO:tasks.workunit.client.0.smithi138.stdout: "index_pool": ".index-pool" 2024-09-14T11:17:36.337 INFO:tasks.workunit.client.0.smithi138.stdout: } 2024-09-14T11:17:36.337 INFO:tasks.workunit.client.0.smithi138.stdout: } 2024-09-14T11:17:36.337 INFO:tasks.workunit.client.0.smithi138.stdout:} 2024-09-14T11:17:36.338 INFO:tasks.workunit.client.0.smithi138.stdout:{ 2024-09-14T11:17:36.338 INFO:tasks.workunit.client.0.smithi138.stdout: "obj": { 2024-09-14T11:17:36.338 INFO:tasks.workunit.client.0.smithi138.stdout: "bucket": { 2024-09-14T11:17:36.338 INFO:tasks.workunit.client.0.smithi138.stdout: "name": "ebtest", 2024-09-14T11:17:36.338 INFO:tasks.workunit.client.0.smithi138.stdout: "marker": "marker", 2024-09-14T11:17:36.338 INFO:tasks.workunit.client.0.smithi138.stdout: "bucket_id": "bucket-id", 2024-09-14T11:17:36.338 INFO:tasks.workunit.client.0.smithi138.stdout: "tenant": "", 2024-09-14T11:17:36.338 INFO:tasks.workunit.client.0.smithi138.stdout: "explicit_placement": { 2024-09-14T11:17:36.338 INFO:tasks.workunit.client.0.smithi138.stdout: "data_pool": ".data-pool", 2024-09-14T11:17:36.338 INFO:tasks.workunit.client.0.smithi138.stdout: "data_extra_pool": "", 2024-09-14T11:17:36.338 INFO:tasks.workunit.client.0.smithi138.stdout: "index_pool": ".index-pool" 2024-09-14T11:17:36.338 INFO:tasks.workunit.client.0.smithi138.stdout: } 2024-09-14T11:17:36.338 INFO:tasks.workunit.client.0.smithi138.stdout: }, 2024-09-14T11:17:36.338 INFO:tasks.workunit.client.0.smithi138.stdout: "key": { 2024-09-14T11:17:36.338 INFO:tasks.workunit.client.0.smithi138.stdout: "name": "_myobj_", 2024-09-14T11:17:36.339 INFO:tasks.workunit.client.0.smithi138.stdout: "instance": "", 2024-09-14T11:17:36.339 INFO:tasks.workunit.client.0.smithi138.stdout: "ns": "ns" 2024-09-14T11:17:36.339 INFO:tasks.workunit.client.0.smithi138.stdout: } 2024-09-14T11:17:36.339 INFO:tasks.workunit.client.0.smithi138.stdout: } 2024-09-14T11:17:36.339 INFO:tasks.workunit.client.0.smithi138.stdout:} 2024-09-14T11:17:36.339 INFO:tasks.workunit.client.0.smithi138.stdout:{ 2024-09-14T11:17:36.339 INFO:tasks.workunit.client.0.smithi138.stdout: "raw_obj": { 2024-09-14T11:17:36.339 INFO:tasks.workunit.client.0.smithi138.stdout: "pool": ".data-pool", 2024-09-14T11:17:36.339 INFO:tasks.workunit.client.0.smithi138.stdout: "oid": "marker__ns__myobj_", 2024-09-14T11:17:36.339 INFO:tasks.workunit.client.0.smithi138.stdout: "loc": "" 2024-09-14T11:17:36.339 INFO:tasks.workunit.client.0.smithi138.stdout: } 2024-09-14T11:17:36.339 INFO:tasks.workunit.client.0.smithi138.stdout:} 2024-09-14T11:17:36.339 INFO:tasks.workunit.client.0.smithi138.stdout:{ 2024-09-14T11:17:36.340 INFO:tasks.workunit.client.0.smithi138.stdout: "new_obj": { 2024-09-14T11:17:36.340 INFO:tasks.workunit.client.0.smithi138.stdout: "bucket": { 2024-09-14T11:17:36.340 INFO:tasks.workunit.client.0.smithi138.stdout: "name": "ebtest", 2024-09-14T11:17:36.340 INFO:tasks.workunit.client.0.smithi138.stdout: "marker": "marker", 2024-09-14T11:17:36.340 INFO:tasks.workunit.client.0.smithi138.stdout: "bucket_id": "bucket-id", 2024-09-14T11:17:36.340 INFO:tasks.workunit.client.0.smithi138.stdout: "tenant": "", 2024-09-14T11:17:36.340 INFO:tasks.workunit.client.0.smithi138.stdout: "explicit_placement": { 2024-09-14T11:17:36.340 INFO:tasks.workunit.client.0.smithi138.stdout: "data_pool": ".data-pool", 2024-09-14T11:17:36.340 INFO:tasks.workunit.client.0.smithi138.stdout: "data_extra_pool": "", 2024-09-14T11:17:36.340 INFO:tasks.workunit.client.0.smithi138.stdout: "index_pool": ".index-pool" 2024-09-14T11:17:36.340 INFO:tasks.workunit.client.0.smithi138.stdout: } 2024-09-14T11:17:36.340 INFO:tasks.workunit.client.0.smithi138.stdout: }, 2024-09-14T11:17:36.340 INFO:tasks.workunit.client.0.smithi138.stdout: "key": { 2024-09-14T11:17:36.341 INFO:tasks.workunit.client.0.smithi138.stdout: "name": "_myobj_", 2024-09-14T11:17:36.341 INFO:tasks.workunit.client.0.smithi138.stdout: "instance": "", 2024-09-14T11:17:36.341 INFO:tasks.workunit.client.0.smithi138.stdout: "ns": "ns" 2024-09-14T11:17:36.341 INFO:tasks.workunit.client.0.smithi138.stdout: } 2024-09-14T11:17:36.341 INFO:tasks.workunit.client.0.smithi138.stdout: } 2024-09-14T11:17:36.341 INFO:tasks.workunit.client.0.smithi138.stdout:} 2024-09-14T11:17:36.341 INFO:tasks.workunit.client.0.smithi138.stdout:{ 2024-09-14T11:17:36.341 INFO:tasks.workunit.client.0.smithi138.stdout: "bucket": { 2024-09-14T11:17:36.341 INFO:tasks.workunit.client.0.smithi138.stdout: "name": "test", 2024-09-14T11:17:36.341 INFO:tasks.workunit.client.0.smithi138.stdout: "marker": "marker", 2024-09-14T11:17:36.341 INFO:tasks.workunit.client.0.smithi138.stdout: "bucket_id": "bucket-id", 2024-09-14T11:17:36.341 INFO:tasks.workunit.client.0.smithi138.stdout: "tenant": "", 2024-09-14T11:17:36.341 INFO:tasks.workunit.client.0.smithi138.stdout: "explicit_placement": { 2024-09-14T11:17:36.342 INFO:tasks.workunit.client.0.smithi138.stdout: "data_pool": "", 2024-09-14T11:17:36.342 INFO:tasks.workunit.client.0.smithi138.stdout: "data_extra_pool": "", 2024-09-14T11:17:36.342 INFO:tasks.workunit.client.0.smithi138.stdout: "index_pool": "" 2024-09-14T11:17:36.342 INFO:tasks.workunit.client.0.smithi138.stdout: } 2024-09-14T11:17:36.342 INFO:tasks.workunit.client.0.smithi138.stdout: } 2024-09-14T11:17:36.342 INFO:tasks.workunit.client.0.smithi138.stdout:} 2024-09-14T11:17:36.342 INFO:tasks.workunit.client.0.smithi138.stdout:{ 2024-09-14T11:17:36.342 INFO:tasks.workunit.client.0.smithi138.stdout: "obj": { 2024-09-14T11:17:36.342 INFO:tasks.workunit.client.0.smithi138.stdout: "bucket": { 2024-09-14T11:17:36.342 INFO:tasks.workunit.client.0.smithi138.stdout: "name": "test", 2024-09-14T11:17:36.342 INFO:tasks.workunit.client.0.smithi138.stdout: "marker": "marker", 2024-09-14T11:17:36.342 INFO:tasks.workunit.client.0.smithi138.stdout: "bucket_id": "bucket-id", 2024-09-14T11:17:36.342 INFO:tasks.workunit.client.0.smithi138.stdout: "tenant": "", 2024-09-14T11:17:36.342 INFO:tasks.workunit.client.0.smithi138.stdout: "explicit_placement": { 2024-09-14T11:17:36.343 INFO:tasks.workunit.client.0.smithi138.stdout: "data_pool": "", 2024-09-14T11:17:36.343 INFO:tasks.workunit.client.0.smithi138.stdout: "data_extra_pool": "", 2024-09-14T11:17:36.343 INFO:tasks.workunit.client.0.smithi138.stdout: "index_pool": "" 2024-09-14T11:17:36.343 INFO:tasks.workunit.client.0.smithi138.stdout: } 2024-09-14T11:17:36.343 INFO:tasks.workunit.client.0.smithi138.stdout: }, 2024-09-14T11:17:36.343 INFO:tasks.workunit.client.0.smithi138.stdout: "key": { 2024-09-14T11:17:36.343 INFO:tasks.workunit.client.0.smithi138.stdout: "name": "_myobj_", 2024-09-14T11:17:36.343 INFO:tasks.workunit.client.0.smithi138.stdout: "instance": "inst", 2024-09-14T11:17:36.343 INFO:tasks.workunit.client.0.smithi138.stdout: "ns": "" 2024-09-14T11:17:36.343 INFO:tasks.workunit.client.0.smithi138.stdout: } 2024-09-14T11:17:36.343 INFO:tasks.workunit.client.0.smithi138.stdout: } 2024-09-14T11:17:36.343 INFO:tasks.workunit.client.0.smithi138.stdout:} 2024-09-14T11:17:36.343 INFO:tasks.workunit.client.0.smithi138.stdout:{ 2024-09-14T11:17:36.343 INFO:tasks.workunit.client.0.smithi138.stdout: "raw_obj": { 2024-09-14T11:17:36.343 INFO:tasks.workunit.client.0.smithi138.stdout: "pool": "default-placement.data", 2024-09-14T11:17:36.344 INFO:tasks.workunit.client.0.smithi138.stdout: "oid": "marker__:inst__myobj_", 2024-09-14T11:17:36.344 INFO:tasks.workunit.client.0.smithi138.stdout: "loc": "marker__myobj_" 2024-09-14T11:17:36.344 INFO:tasks.workunit.client.0.smithi138.stdout: } 2024-09-14T11:17:36.344 INFO:tasks.workunit.client.0.smithi138.stdout:} 2024-09-14T11:17:36.344 INFO:tasks.workunit.client.0.smithi138.stdout:{ 2024-09-14T11:17:36.344 INFO:tasks.workunit.client.0.smithi138.stdout: "new_obj": { 2024-09-14T11:17:36.344 INFO:tasks.workunit.client.0.smithi138.stdout: "bucket": { 2024-09-14T11:17:36.344 INFO:tasks.workunit.client.0.smithi138.stdout: "name": "test", 2024-09-14T11:17:36.344 INFO:tasks.workunit.client.0.smithi138.stdout: "marker": "marker", 2024-09-14T11:17:36.344 INFO:tasks.workunit.client.0.smithi138.stdout: "bucket_id": "bucket-id", 2024-09-14T11:17:36.344 INFO:tasks.workunit.client.0.smithi138.stdout: "tenant": "", 2024-09-14T11:17:36.344 INFO:tasks.workunit.client.0.smithi138.stdout: "explicit_placement": { 2024-09-14T11:17:36.344 INFO:tasks.workunit.client.0.smithi138.stdout: "data_pool": "", 2024-09-14T11:17:36.344 INFO:tasks.workunit.client.0.smithi138.stdout: "data_extra_pool": "", 2024-09-14T11:17:36.344 INFO:tasks.workunit.client.0.smithi138.stdout: "index_pool": "" 2024-09-14T11:17:36.345 INFO:tasks.workunit.client.0.smithi138.stdout: } 2024-09-14T11:17:36.345 INFO:tasks.workunit.client.0.smithi138.stdout: }, 2024-09-14T11:17:36.345 INFO:tasks.workunit.client.0.smithi138.stdout: "key": { 2024-09-14T11:17:36.345 INFO:tasks.workunit.client.0.smithi138.stdout: "name": "_myobj_", 2024-09-14T11:17:36.345 INFO:tasks.workunit.client.0.smithi138.stdout: "instance": "inst", 2024-09-14T11:17:36.345 INFO:tasks.workunit.client.0.smithi138.stdout: "ns": "" 2024-09-14T11:17:36.345 INFO:tasks.workunit.client.0.smithi138.stdout: } 2024-09-14T11:17:36.345 INFO:tasks.workunit.client.0.smithi138.stdout: } 2024-09-14T11:17:36.345 INFO:tasks.workunit.client.0.smithi138.stdout:} 2024-09-14T11:17:36.345 INFO:tasks.workunit.client.0.smithi138.stdout:{ 2024-09-14T11:17:36.345 INFO:tasks.workunit.client.0.smithi138.stdout: "bucket": { 2024-09-14T11:17:36.345 INFO:tasks.workunit.client.0.smithi138.stdout: "name": "ebtest", 2024-09-14T11:17:36.345 INFO:tasks.workunit.client.0.smithi138.stdout: "marker": "marker", 2024-09-14T11:17:36.345 INFO:tasks.workunit.client.0.smithi138.stdout: "bucket_id": "bucket-id", 2024-09-14T11:17:36.345 INFO:tasks.workunit.client.0.smithi138.stdout: "tenant": "", 2024-09-14T11:17:36.346 INFO:tasks.workunit.client.0.smithi138.stdout: "explicit_placement": { 2024-09-14T11:17:36.346 INFO:tasks.workunit.client.0.smithi138.stdout: "data_pool": ".data-pool", 2024-09-14T11:17:36.346 INFO:tasks.workunit.client.0.smithi138.stdout: "data_extra_pool": "", 2024-09-14T11:17:36.346 INFO:tasks.workunit.client.0.smithi138.stdout: "index_pool": ".index-pool" 2024-09-14T11:17:36.346 INFO:tasks.workunit.client.0.smithi138.stdout: } 2024-09-14T11:17:36.346 INFO:tasks.workunit.client.0.smithi138.stdout: } 2024-09-14T11:17:36.346 INFO:tasks.workunit.client.0.smithi138.stdout:} 2024-09-14T11:17:36.346 INFO:tasks.workunit.client.0.smithi138.stdout:{ 2024-09-14T11:17:36.346 INFO:tasks.workunit.client.0.smithi138.stdout: "obj": { 2024-09-14T11:17:36.346 INFO:tasks.workunit.client.0.smithi138.stdout: "bucket": { 2024-09-14T11:17:36.346 INFO:tasks.workunit.client.0.smithi138.stdout: "name": "ebtest", 2024-09-14T11:17:36.347 INFO:tasks.workunit.client.0.smithi138.stdout: "marker": "marker", 2024-09-14T11:17:36.347 INFO:tasks.workunit.client.0.smithi138.stdout: "bucket_id": "bucket-id", 2024-09-14T11:17:36.347 INFO:tasks.workunit.client.0.smithi138.stdout: "tenant": "", 2024-09-14T11:17:36.347 INFO:tasks.workunit.client.0.smithi138.stdout: "explicit_placement": { 2024-09-14T11:17:36.347 INFO:tasks.workunit.client.0.smithi138.stdout: "data_pool": ".data-pool", 2024-09-14T11:17:36.347 INFO:tasks.workunit.client.0.smithi138.stdout: "data_extra_pool": "", 2024-09-14T11:17:36.347 INFO:tasks.workunit.client.0.smithi138.stdout: "index_pool": ".index-pool" 2024-09-14T11:17:36.347 INFO:tasks.workunit.client.0.smithi138.stdout: } 2024-09-14T11:17:36.347 INFO:tasks.workunit.client.0.smithi138.stdout: }, 2024-09-14T11:17:36.347 INFO:tasks.workunit.client.0.smithi138.stdout: "key": { 2024-09-14T11:17:36.347 INFO:tasks.workunit.client.0.smithi138.stdout: "name": "_myobj_", 2024-09-14T11:17:36.347 INFO:tasks.workunit.client.0.smithi138.stdout: "instance": "inst", 2024-09-14T11:17:36.347 INFO:tasks.workunit.client.0.smithi138.stdout: "ns": "" 2024-09-14T11:17:36.347 INFO:tasks.workunit.client.0.smithi138.stdout: } 2024-09-14T11:17:36.347 INFO:tasks.workunit.client.0.smithi138.stdout: } 2024-09-14T11:17:36.347 INFO:tasks.workunit.client.0.smithi138.stdout:} 2024-09-14T11:17:36.348 INFO:tasks.workunit.client.0.smithi138.stdout:{ 2024-09-14T11:17:36.348 INFO:tasks.workunit.client.0.smithi138.stdout: "raw_obj": { 2024-09-14T11:17:36.348 INFO:tasks.workunit.client.0.smithi138.stdout: "pool": ".data-pool", 2024-09-14T11:17:36.348 INFO:tasks.workunit.client.0.smithi138.stdout: "oid": "marker__:inst__myobj_", 2024-09-14T11:17:36.348 INFO:tasks.workunit.client.0.smithi138.stdout: "loc": "marker__myobj_" 2024-09-14T11:17:36.348 INFO:tasks.workunit.client.0.smithi138.stdout: } 2024-09-14T11:17:36.348 INFO:tasks.workunit.client.0.smithi138.stdout:} 2024-09-14T11:17:36.348 INFO:tasks.workunit.client.0.smithi138.stdout:{ 2024-09-14T11:17:36.348 INFO:tasks.workunit.client.0.smithi138.stdout: "new_obj": { 2024-09-14T11:17:36.348 INFO:tasks.workunit.client.0.smithi138.stdout: "bucket": { 2024-09-14T11:17:36.348 INFO:tasks.workunit.client.0.smithi138.stdout: "name": "ebtest", 2024-09-14T11:17:36.348 INFO:tasks.workunit.client.0.smithi138.stdout: "marker": "marker", 2024-09-14T11:17:36.348 INFO:tasks.workunit.client.0.smithi138.stdout: "bucket_id": "bucket-id", 2024-09-14T11:17:36.348 INFO:tasks.workunit.client.0.smithi138.stdout: "tenant": "", 2024-09-14T11:17:36.348 INFO:tasks.workunit.client.0.smithi138.stdout: "explicit_placement": { 2024-09-14T11:17:36.349 INFO:tasks.workunit.client.0.smithi138.stdout: "data_pool": ".data-pool", 2024-09-14T11:17:36.349 INFO:tasks.workunit.client.0.smithi138.stdout: "data_extra_pool": "", 2024-09-14T11:17:36.349 INFO:tasks.workunit.client.0.smithi138.stdout: "index_pool": ".index-pool" 2024-09-14T11:17:36.349 INFO:tasks.workunit.client.0.smithi138.stdout: } 2024-09-14T11:17:36.349 INFO:tasks.workunit.client.0.smithi138.stdout: }, 2024-09-14T11:17:36.349 INFO:tasks.workunit.client.0.smithi138.stdout: "key": { 2024-09-14T11:17:36.349 INFO:tasks.workunit.client.0.smithi138.stdout: "name": "_myobj_", 2024-09-14T11:17:36.349 INFO:tasks.workunit.client.0.smithi138.stdout: "instance": "inst", 2024-09-14T11:17:36.349 INFO:tasks.workunit.client.0.smithi138.stdout: "ns": "" 2024-09-14T11:17:36.349 INFO:tasks.workunit.client.0.smithi138.stdout: } 2024-09-14T11:17:36.349 INFO:tasks.workunit.client.0.smithi138.stdout: } 2024-09-14T11:17:36.349 INFO:tasks.workunit.client.0.smithi138.stdout:} 2024-09-14T11:17:36.349 INFO:tasks.workunit.client.0.smithi138.stdout:{ 2024-09-14T11:17:36.349 INFO:tasks.workunit.client.0.smithi138.stdout: "bucket": { 2024-09-14T11:17:36.349 INFO:tasks.workunit.client.0.smithi138.stdout: "name": "test", 2024-09-14T11:17:36.350 INFO:tasks.workunit.client.0.smithi138.stdout: "marker": "marker", 2024-09-14T11:17:36.350 INFO:tasks.workunit.client.0.smithi138.stdout: "bucket_id": "bucket-id", 2024-09-14T11:17:36.350 INFO:tasks.workunit.client.0.smithi138.stdout: "tenant": "", 2024-09-14T11:17:36.350 INFO:tasks.workunit.client.0.smithi138.stdout: "explicit_placement": { 2024-09-14T11:17:36.350 INFO:tasks.workunit.client.0.smithi138.stdout: "data_pool": "", 2024-09-14T11:17:36.350 INFO:tasks.workunit.client.0.smithi138.stdout: "data_extra_pool": "", 2024-09-14T11:17:36.350 INFO:tasks.workunit.client.0.smithi138.stdout: "index_pool": "" 2024-09-14T11:17:36.350 INFO:tasks.workunit.client.0.smithi138.stdout: } 2024-09-14T11:17:36.350 INFO:tasks.workunit.client.0.smithi138.stdout: } 2024-09-14T11:17:36.350 INFO:tasks.workunit.client.0.smithi138.stdout:} 2024-09-14T11:17:36.350 INFO:tasks.workunit.client.0.smithi138.stdout:{ 2024-09-14T11:17:36.350 INFO:tasks.workunit.client.0.smithi138.stdout: "obj": { 2024-09-14T11:17:36.350 INFO:tasks.workunit.client.0.smithi138.stdout: "bucket": { 2024-09-14T11:17:36.350 INFO:tasks.workunit.client.0.smithi138.stdout: "name": "test", 2024-09-14T11:17:36.350 INFO:tasks.workunit.client.0.smithi138.stdout: "marker": "marker", 2024-09-14T11:17:36.351 INFO:tasks.workunit.client.0.smithi138.stdout: "bucket_id": "bucket-id", 2024-09-14T11:17:36.351 INFO:tasks.workunit.client.0.smithi138.stdout: "tenant": "", 2024-09-14T11:17:36.351 INFO:tasks.workunit.client.0.smithi138.stdout: "explicit_placement": { 2024-09-14T11:17:36.351 INFO:tasks.workunit.client.0.smithi138.stdout: "data_pool": "", 2024-09-14T11:17:36.351 INFO:tasks.workunit.client.0.smithi138.stdout: "data_extra_pool": "", 2024-09-14T11:17:36.351 INFO:tasks.workunit.client.0.smithi138.stdout: "index_pool": "" 2024-09-14T11:17:36.351 INFO:tasks.workunit.client.0.smithi138.stdout: } 2024-09-14T11:17:36.351 INFO:tasks.workunit.client.0.smithi138.stdout: }, 2024-09-14T11:17:36.351 INFO:tasks.workunit.client.0.smithi138.stdout: "key": { 2024-09-14T11:17:36.351 INFO:tasks.workunit.client.0.smithi138.stdout: "name": "_myobj_", 2024-09-14T11:17:36.351 INFO:tasks.workunit.client.0.smithi138.stdout: "instance": "inst", 2024-09-14T11:17:36.351 INFO:tasks.workunit.client.0.smithi138.stdout: "ns": "ns" 2024-09-14T11:17:36.351 INFO:tasks.workunit.client.0.smithi138.stdout: } 2024-09-14T11:17:36.351 INFO:tasks.workunit.client.0.smithi138.stdout: } 2024-09-14T11:17:36.352 INFO:tasks.workunit.client.0.smithi138.stdout:} 2024-09-14T11:17:36.352 INFO:tasks.workunit.client.0.smithi138.stdout:{ 2024-09-14T11:17:36.352 INFO:tasks.workunit.client.0.smithi138.stdout: "raw_obj": { 2024-09-14T11:17:36.352 INFO:tasks.workunit.client.0.smithi138.stdout: "pool": "default-placement.data", 2024-09-14T11:17:36.352 INFO:tasks.workunit.client.0.smithi138.stdout: "oid": "marker__ns:inst__myobj_", 2024-09-14T11:17:36.352 INFO:tasks.workunit.client.0.smithi138.stdout: "loc": "" 2024-09-14T11:17:36.352 INFO:tasks.workunit.client.0.smithi138.stdout: } 2024-09-14T11:17:36.352 INFO:tasks.workunit.client.0.smithi138.stdout:} 2024-09-14T11:17:36.352 INFO:tasks.workunit.client.0.smithi138.stdout:{ 2024-09-14T11:17:36.352 INFO:tasks.workunit.client.0.smithi138.stdout: "new_obj": { 2024-09-14T11:17:36.352 INFO:tasks.workunit.client.0.smithi138.stdout: "bucket": { 2024-09-14T11:17:36.352 INFO:tasks.workunit.client.0.smithi138.stdout: "name": "test", 2024-09-14T11:17:36.352 INFO:tasks.workunit.client.0.smithi138.stdout: "marker": "marker", 2024-09-14T11:17:36.353 INFO:tasks.workunit.client.0.smithi138.stdout: "bucket_id": "bucket-id", 2024-09-14T11:17:36.353 INFO:tasks.workunit.client.0.smithi138.stdout: "tenant": "", 2024-09-14T11:17:36.353 INFO:tasks.workunit.client.0.smithi138.stdout: "explicit_placement": { 2024-09-14T11:17:36.353 INFO:tasks.workunit.client.0.smithi138.stdout: "data_pool": "", 2024-09-14T11:17:36.353 INFO:tasks.workunit.client.0.smithi138.stdout: "data_extra_pool": "", 2024-09-14T11:17:36.353 INFO:tasks.workunit.client.0.smithi138.stdout: "index_pool": "" 2024-09-14T11:17:36.353 INFO:tasks.workunit.client.0.smithi138.stdout: } 2024-09-14T11:17:36.353 INFO:tasks.workunit.client.0.smithi138.stdout: }, 2024-09-14T11:17:36.353 INFO:tasks.workunit.client.0.smithi138.stdout: "key": { 2024-09-14T11:17:36.353 INFO:tasks.workunit.client.0.smithi138.stdout: "name": "_myobj_", 2024-09-14T11:17:36.353 INFO:tasks.workunit.client.0.smithi138.stdout: "instance": "inst", 2024-09-14T11:17:36.353 INFO:tasks.workunit.client.0.smithi138.stdout: "ns": "ns" 2024-09-14T11:17:36.354 INFO:tasks.workunit.client.0.smithi138.stdout: } 2024-09-14T11:17:36.354 INFO:tasks.workunit.client.0.smithi138.stdout: } 2024-09-14T11:17:36.354 INFO:tasks.workunit.client.0.smithi138.stdout:} 2024-09-14T11:17:36.354 INFO:tasks.workunit.client.0.smithi138.stdout:{ 2024-09-14T11:17:36.354 INFO:tasks.workunit.client.0.smithi138.stdout: "bucket": { 2024-09-14T11:17:36.354 INFO:tasks.workunit.client.0.smithi138.stdout: "name": "ebtest", 2024-09-14T11:17:36.354 INFO:tasks.workunit.client.0.smithi138.stdout: "marker": "marker", 2024-09-14T11:17:36.354 INFO:tasks.workunit.client.0.smithi138.stdout: "bucket_id": "bucket-id", 2024-09-14T11:17:36.354 INFO:tasks.workunit.client.0.smithi138.stdout: "tenant": "", 2024-09-14T11:17:36.354 INFO:tasks.workunit.client.0.smithi138.stdout: "explicit_placement": { 2024-09-14T11:17:36.354 INFO:tasks.workunit.client.0.smithi138.stdout: "data_pool": ".data-pool", 2024-09-14T11:17:36.354 INFO:tasks.workunit.client.0.smithi138.stdout: "data_extra_pool": "", 2024-09-14T11:17:36.354 INFO:tasks.workunit.client.0.smithi138.stdout: "index_pool": ".index-pool" 2024-09-14T11:17:36.355 INFO:tasks.workunit.client.0.smithi138.stdout: } 2024-09-14T11:17:36.355 INFO:tasks.workunit.client.0.smithi138.stdout: } 2024-09-14T11:17:36.355 INFO:tasks.workunit.client.0.smithi138.stdout:} 2024-09-14T11:17:36.355 INFO:tasks.workunit.client.0.smithi138.stdout:{ 2024-09-14T11:17:36.355 INFO:tasks.workunit.client.0.smithi138.stdout: "obj": { 2024-09-14T11:17:36.355 INFO:tasks.workunit.client.0.smithi138.stdout: "bucket": { 2024-09-14T11:17:36.355 INFO:tasks.workunit.client.0.smithi138.stdout: "name": "ebtest", 2024-09-14T11:17:36.355 INFO:tasks.workunit.client.0.smithi138.stdout: "marker": "marker", 2024-09-14T11:17:36.355 INFO:tasks.workunit.client.0.smithi138.stdout: "bucket_id": "bucket-id", 2024-09-14T11:17:36.355 INFO:tasks.workunit.client.0.smithi138.stdout: "tenant": "", 2024-09-14T11:17:36.355 INFO:tasks.workunit.client.0.smithi138.stdout: "explicit_placement": { 2024-09-14T11:17:36.355 INFO:tasks.workunit.client.0.smithi138.stdout: "data_pool": ".data-pool", 2024-09-14T11:17:36.355 INFO:tasks.workunit.client.0.smithi138.stdout: "data_extra_pool": "", 2024-09-14T11:17:36.355 INFO:tasks.workunit.client.0.smithi138.stdout: "index_pool": ".index-pool" 2024-09-14T11:17:36.355 INFO:tasks.workunit.client.0.smithi138.stdout: } 2024-09-14T11:17:36.356 INFO:tasks.workunit.client.0.smithi138.stdout: }, 2024-09-14T11:17:36.356 INFO:tasks.workunit.client.0.smithi138.stdout: "key": { 2024-09-14T11:17:36.356 INFO:tasks.workunit.client.0.smithi138.stdout: "name": "_myobj_", 2024-09-14T11:17:36.356 INFO:tasks.workunit.client.0.smithi138.stdout: "instance": "inst", 2024-09-14T11:17:36.356 INFO:tasks.workunit.client.0.smithi138.stdout: "ns": "ns" 2024-09-14T11:17:36.356 INFO:tasks.workunit.client.0.smithi138.stdout: } 2024-09-14T11:17:36.356 INFO:tasks.workunit.client.0.smithi138.stdout: } 2024-09-14T11:17:36.356 INFO:tasks.workunit.client.0.smithi138.stdout:} 2024-09-14T11:17:36.356 INFO:tasks.workunit.client.0.smithi138.stdout:{ 2024-09-14T11:17:36.356 INFO:tasks.workunit.client.0.smithi138.stdout: "raw_obj": { 2024-09-14T11:17:36.356 INFO:tasks.workunit.client.0.smithi138.stdout: "pool": ".data-pool", 2024-09-14T11:17:36.356 INFO:tasks.workunit.client.0.smithi138.stdout: "oid": "marker__ns:inst__myobj_", 2024-09-14T11:17:36.356 INFO:tasks.workunit.client.0.smithi138.stdout: "loc": "" 2024-09-14T11:17:36.356 INFO:tasks.workunit.client.0.smithi138.stdout: } 2024-09-14T11:17:36.356 INFO:tasks.workunit.client.0.smithi138.stdout:} 2024-09-14T11:17:36.357 INFO:tasks.workunit.client.0.smithi138.stdout:{ 2024-09-14T11:17:36.357 INFO:tasks.workunit.client.0.smithi138.stdout: "new_obj": { 2024-09-14T11:17:36.357 INFO:tasks.workunit.client.0.smithi138.stdout: "bucket": { 2024-09-14T11:17:36.357 INFO:tasks.workunit.client.0.smithi138.stdout: "name": "ebtest", 2024-09-14T11:17:36.357 INFO:tasks.workunit.client.0.smithi138.stdout: "marker": "marker", 2024-09-14T11:17:36.357 INFO:tasks.workunit.client.0.smithi138.stdout: "bucket_id": "bucket-id", 2024-09-14T11:17:36.357 INFO:tasks.workunit.client.0.smithi138.stdout: "tenant": "", 2024-09-14T11:17:36.357 INFO:tasks.workunit.client.0.smithi138.stdout: "explicit_placement": { 2024-09-14T11:17:36.357 INFO:tasks.workunit.client.0.smithi138.stdout: "data_pool": ".data-pool", 2024-09-14T11:17:36.357 INFO:tasks.workunit.client.0.smithi138.stdout: "data_extra_pool": "", 2024-09-14T11:17:36.357 INFO:tasks.workunit.client.0.smithi138.stdout: "index_pool": ".index-pool" 2024-09-14T11:17:36.357 INFO:tasks.workunit.client.0.smithi138.stdout: } 2024-09-14T11:17:36.357 INFO:tasks.workunit.client.0.smithi138.stdout: }, 2024-09-14T11:17:36.357 INFO:tasks.workunit.client.0.smithi138.stdout: "key": { 2024-09-14T11:17:36.358 INFO:tasks.workunit.client.0.smithi138.stdout: "name": "_myobj_", 2024-09-14T11:17:36.358 INFO:tasks.workunit.client.0.smithi138.stdout: "instance": "inst", 2024-09-14T11:17:36.358 INFO:tasks.workunit.client.0.smithi138.stdout: "ns": "ns" 2024-09-14T11:17:36.358 INFO:tasks.workunit.client.0.smithi138.stdout: } 2024-09-14T11:17:36.358 INFO:tasks.workunit.client.0.smithi138.stdout: } 2024-09-14T11:17:36.358 INFO:tasks.workunit.client.0.smithi138.stdout:} 2024-09-14T11:17:36.358 INFO:tasks.workunit.client.0.smithi138.stdout:[ OK ] TestRGWObj.obj_to_raw (0 ms) 2024-09-14T11:17:36.358 INFO:tasks.workunit.client.0.smithi138.stdout:[ RUN ] TestRGWObj.old_to_raw 2024-09-14T11:17:36.358 INFO:tasks.workunit.client.0.smithi138.stdout:{ 2024-09-14T11:17:36.358 INFO:tasks.workunit.client.0.smithi138.stdout: "raw_obj": { 2024-09-14T11:17:36.358 INFO:tasks.workunit.client.0.smithi138.stdout: "pool": ".data-pool", 2024-09-14T11:17:36.358 INFO:tasks.workunit.client.0.smithi138.stdout: "oid": "marker_myobj", 2024-09-14T11:17:36.358 INFO:tasks.workunit.client.0.smithi138.stdout: "loc": "" 2024-09-14T11:17:36.359 INFO:tasks.workunit.client.0.smithi138.stdout: } 2024-09-14T11:17:36.359 INFO:tasks.workunit.client.0.smithi138.stdout:} 2024-09-14T11:17:36.359 INFO:tasks.workunit.client.0.smithi138.stdout:{ 2024-09-14T11:17:36.359 INFO:tasks.workunit.client.0.smithi138.stdout: "new_obj": { 2024-09-14T11:17:36.359 INFO:tasks.workunit.client.0.smithi138.stdout: "bucket": { 2024-09-14T11:17:36.359 INFO:tasks.workunit.client.0.smithi138.stdout: "name": "ebtest", 2024-09-14T11:17:36.359 INFO:tasks.workunit.client.0.smithi138.stdout: "marker": "marker", 2024-09-14T11:17:36.359 INFO:tasks.workunit.client.0.smithi138.stdout: "bucket_id": "bucket-id", 2024-09-14T11:17:36.359 INFO:tasks.workunit.client.0.smithi138.stdout: "tenant": "", 2024-09-14T11:17:36.359 INFO:tasks.workunit.client.0.smithi138.stdout: "explicit_placement": { 2024-09-14T11:17:36.359 INFO:tasks.workunit.client.0.smithi138.stdout: "data_pool": ".data-pool", 2024-09-14T11:17:36.359 INFO:tasks.workunit.client.0.smithi138.stdout: "data_extra_pool": "", 2024-09-14T11:17:36.359 INFO:tasks.workunit.client.0.smithi138.stdout: "index_pool": ".index-pool" 2024-09-14T11:17:36.359 INFO:tasks.workunit.client.0.smithi138.stdout: } 2024-09-14T11:17:36.359 INFO:tasks.workunit.client.0.smithi138.stdout: }, 2024-09-14T11:17:36.360 INFO:tasks.workunit.client.0.smithi138.stdout: "key": { 2024-09-14T11:17:36.360 INFO:tasks.workunit.client.0.smithi138.stdout: "name": "myobj", 2024-09-14T11:17:36.360 INFO:tasks.workunit.client.0.smithi138.stdout: "instance": "", 2024-09-14T11:17:36.360 INFO:tasks.workunit.client.0.smithi138.stdout: "ns": "" 2024-09-14T11:17:36.360 INFO:tasks.workunit.client.0.smithi138.stdout: } 2024-09-14T11:17:36.360 INFO:tasks.workunit.client.0.smithi138.stdout: } 2024-09-14T11:17:36.360 INFO:tasks.workunit.client.0.smithi138.stdout:} 2024-09-14T11:17:36.360 INFO:tasks.workunit.client.0.smithi138.stdout:raw=.data-pool:marker_myobj 2024-09-14T11:17:36.360 INFO:tasks.workunit.client.0.smithi138.stdout:{ 2024-09-14T11:17:36.360 INFO:tasks.workunit.client.0.smithi138.stdout: "raw_obj2": { 2024-09-14T11:17:36.360 INFO:tasks.workunit.client.0.smithi138.stdout: "pool": ".data-pool", 2024-09-14T11:17:36.360 INFO:tasks.workunit.client.0.smithi138.stdout: "oid": "marker_myobj", 2024-09-14T11:17:36.360 INFO:tasks.workunit.client.0.smithi138.stdout: "loc": "" 2024-09-14T11:17:36.360 INFO:tasks.workunit.client.0.smithi138.stdout: } 2024-09-14T11:17:36.360 INFO:tasks.workunit.client.0.smithi138.stdout:} 2024-09-14T11:17:36.361 INFO:tasks.workunit.client.0.smithi138.stdout:{ 2024-09-14T11:17:36.361 INFO:tasks.workunit.client.0.smithi138.stdout: "new_obj2": { 2024-09-14T11:17:36.361 INFO:tasks.workunit.client.0.smithi138.stdout: "bucket": { 2024-09-14T11:17:36.361 INFO:tasks.workunit.client.0.smithi138.stdout: "name": "ebtest", 2024-09-14T11:17:36.361 INFO:tasks.workunit.client.0.smithi138.stdout: "marker": "marker", 2024-09-14T11:17:36.361 INFO:tasks.workunit.client.0.smithi138.stdout: "bucket_id": "bucket-id", 2024-09-14T11:17:36.361 INFO:tasks.workunit.client.0.smithi138.stdout: "tenant": "", 2024-09-14T11:17:36.361 INFO:tasks.workunit.client.0.smithi138.stdout: "explicit_placement": { 2024-09-14T11:17:36.361 INFO:tasks.workunit.client.0.smithi138.stdout: "data_pool": ".data-pool", 2024-09-14T11:17:36.361 INFO:tasks.workunit.client.0.smithi138.stdout: "data_extra_pool": "", 2024-09-14T11:17:36.361 INFO:tasks.workunit.client.0.smithi138.stdout: "index_pool": ".index-pool" 2024-09-14T11:17:36.361 INFO:tasks.workunit.client.0.smithi138.stdout: } 2024-09-14T11:17:36.361 INFO:tasks.workunit.client.0.smithi138.stdout: }, 2024-09-14T11:17:36.362 INFO:tasks.workunit.client.0.smithi138.stdout: "key": { 2024-09-14T11:17:36.362 INFO:tasks.workunit.client.0.smithi138.stdout: "name": "myobj", 2024-09-14T11:17:36.362 INFO:tasks.workunit.client.0.smithi138.stdout: "instance": "", 2024-09-14T11:17:36.362 INFO:tasks.workunit.client.0.smithi138.stdout: "ns": "" 2024-09-14T11:17:36.362 INFO:tasks.workunit.client.0.smithi138.stdout: } 2024-09-14T11:17:36.362 INFO:tasks.workunit.client.0.smithi138.stdout: } 2024-09-14T11:17:36.362 INFO:tasks.workunit.client.0.smithi138.stdout:} 2024-09-14T11:17:36.362 INFO:tasks.workunit.client.0.smithi138.stdout:raw2=.data-pool:marker_myobj 2024-09-14T11:17:36.362 INFO:tasks.workunit.client.0.smithi138.stdout:{ 2024-09-14T11:17:36.362 INFO:tasks.workunit.client.0.smithi138.stdout: "raw_obj": { 2024-09-14T11:17:36.362 INFO:tasks.workunit.client.0.smithi138.stdout: "pool": ".data-pool", 2024-09-14T11:17:36.362 INFO:tasks.workunit.client.0.smithi138.stdout: "oid": "marker__ns_myobj", 2024-09-14T11:17:36.363 INFO:tasks.workunit.client.0.smithi138.stdout: "loc": "" 2024-09-14T11:17:36.363 INFO:tasks.workunit.client.0.smithi138.stdout: } 2024-09-14T11:17:36.363 INFO:tasks.workunit.client.0.smithi138.stdout:} 2024-09-14T11:17:36.363 INFO:tasks.workunit.client.0.smithi138.stdout:{ 2024-09-14T11:17:36.363 INFO:tasks.workunit.client.0.smithi138.stdout: "new_obj": { 2024-09-14T11:17:36.363 INFO:tasks.workunit.client.0.smithi138.stdout: "bucket": { 2024-09-14T11:17:36.363 INFO:tasks.workunit.client.0.smithi138.stdout: "name": "ebtest", 2024-09-14T11:17:36.363 INFO:tasks.workunit.client.0.smithi138.stdout: "marker": "marker", 2024-09-14T11:17:36.363 INFO:tasks.workunit.client.0.smithi138.stdout: "bucket_id": "bucket-id", 2024-09-14T11:17:36.363 INFO:tasks.workunit.client.0.smithi138.stdout: "tenant": "", 2024-09-14T11:17:36.363 INFO:tasks.workunit.client.0.smithi138.stdout: "explicit_placement": { 2024-09-14T11:17:36.363 INFO:tasks.workunit.client.0.smithi138.stdout: "data_pool": ".data-pool", 2024-09-14T11:17:36.363 INFO:tasks.workunit.client.0.smithi138.stdout: "data_extra_pool": "", 2024-09-14T11:17:36.363 INFO:tasks.workunit.client.0.smithi138.stdout: "index_pool": ".index-pool" 2024-09-14T11:17:36.363 INFO:tasks.workunit.client.0.smithi138.stdout: } 2024-09-14T11:17:36.364 INFO:tasks.workunit.client.0.smithi138.stdout: }, 2024-09-14T11:17:36.364 INFO:tasks.workunit.client.0.smithi138.stdout: "key": { 2024-09-14T11:17:36.364 INFO:tasks.workunit.client.0.smithi138.stdout: "name": "myobj", 2024-09-14T11:17:36.364 INFO:tasks.workunit.client.0.smithi138.stdout: "instance": "", 2024-09-14T11:17:36.364 INFO:tasks.workunit.client.0.smithi138.stdout: "ns": "ns" 2024-09-14T11:17:36.364 INFO:tasks.workunit.client.0.smithi138.stdout: } 2024-09-14T11:17:36.364 INFO:tasks.workunit.client.0.smithi138.stdout: } 2024-09-14T11:17:36.364 INFO:tasks.workunit.client.0.smithi138.stdout:} 2024-09-14T11:17:36.364 INFO:tasks.workunit.client.0.smithi138.stdout:raw=.data-pool:marker__ns_myobj 2024-09-14T11:17:36.364 INFO:tasks.workunit.client.0.smithi138.stdout:{ 2024-09-14T11:17:36.364 INFO:tasks.workunit.client.0.smithi138.stdout: "raw_obj2": { 2024-09-14T11:17:36.364 INFO:tasks.workunit.client.0.smithi138.stdout: "pool": ".data-pool", 2024-09-14T11:17:36.364 INFO:tasks.workunit.client.0.smithi138.stdout: "oid": "marker__ns_myobj", 2024-09-14T11:17:36.364 INFO:tasks.workunit.client.0.smithi138.stdout: "loc": "" 2024-09-14T11:17:36.364 INFO:tasks.workunit.client.0.smithi138.stdout: } 2024-09-14T11:17:36.365 INFO:tasks.workunit.client.0.smithi138.stdout:} 2024-09-14T11:17:36.365 INFO:tasks.workunit.client.0.smithi138.stdout:{ 2024-09-14T11:17:36.365 INFO:tasks.workunit.client.0.smithi138.stdout: "new_obj2": { 2024-09-14T11:17:36.365 INFO:tasks.workunit.client.0.smithi138.stdout: "bucket": { 2024-09-14T11:17:36.365 INFO:tasks.workunit.client.0.smithi138.stdout: "name": "ebtest", 2024-09-14T11:17:36.365 INFO:tasks.workunit.client.0.smithi138.stdout: "marker": "marker", 2024-09-14T11:17:36.365 INFO:tasks.workunit.client.0.smithi138.stdout: "bucket_id": "bucket-id", 2024-09-14T11:17:36.365 INFO:tasks.workunit.client.0.smithi138.stdout: "tenant": "", 2024-09-14T11:17:36.365 INFO:tasks.workunit.client.0.smithi138.stdout: "explicit_placement": { 2024-09-14T11:17:36.365 INFO:tasks.workunit.client.0.smithi138.stdout: "data_pool": ".data-pool", 2024-09-14T11:17:36.365 INFO:tasks.workunit.client.0.smithi138.stdout: "data_extra_pool": "", 2024-09-14T11:17:36.365 INFO:tasks.workunit.client.0.smithi138.stdout: "index_pool": ".index-pool" 2024-09-14T11:17:36.365 INFO:tasks.workunit.client.0.smithi138.stdout: } 2024-09-14T11:17:36.366 INFO:tasks.workunit.client.0.smithi138.stdout: }, 2024-09-14T11:17:36.366 INFO:tasks.workunit.client.0.smithi138.stdout: "key": { 2024-09-14T11:17:36.366 INFO:tasks.workunit.client.0.smithi138.stdout: "name": "myobj", 2024-09-14T11:17:36.366 INFO:tasks.workunit.client.0.smithi138.stdout: "instance": "", 2024-09-14T11:17:36.366 INFO:tasks.workunit.client.0.smithi138.stdout: "ns": "ns" 2024-09-14T11:17:36.366 INFO:tasks.workunit.client.0.smithi138.stdout: } 2024-09-14T11:17:36.366 INFO:tasks.workunit.client.0.smithi138.stdout: } 2024-09-14T11:17:36.366 INFO:tasks.workunit.client.0.smithi138.stdout:} 2024-09-14T11:17:36.366 INFO:tasks.workunit.client.0.smithi138.stdout:raw2=.data-pool:marker__ns_myobj 2024-09-14T11:17:36.366 INFO:tasks.workunit.client.0.smithi138.stdout:{ 2024-09-14T11:17:36.366 INFO:tasks.workunit.client.0.smithi138.stdout: "raw_obj": { 2024-09-14T11:17:36.367 INFO:tasks.workunit.client.0.smithi138.stdout: "pool": ".data-pool", 2024-09-14T11:17:36.367 INFO:tasks.workunit.client.0.smithi138.stdout: "oid": "marker__:inst_myobj", 2024-09-14T11:17:36.367 INFO:tasks.workunit.client.0.smithi138.stdout: "loc": "" 2024-09-14T11:17:36.367 INFO:tasks.workunit.client.0.smithi138.stdout: } 2024-09-14T11:17:36.367 INFO:tasks.workunit.client.0.smithi138.stdout:} 2024-09-14T11:17:36.367 INFO:tasks.workunit.client.0.smithi138.stdout:{ 2024-09-14T11:17:36.367 INFO:tasks.workunit.client.0.smithi138.stdout: "new_obj": { 2024-09-14T11:17:36.367 INFO:tasks.workunit.client.0.smithi138.stdout: "bucket": { 2024-09-14T11:17:36.367 INFO:tasks.workunit.client.0.smithi138.stdout: "name": "ebtest", 2024-09-14T11:17:36.367 INFO:tasks.workunit.client.0.smithi138.stdout: "marker": "marker", 2024-09-14T11:17:36.367 INFO:tasks.workunit.client.0.smithi138.stdout: "bucket_id": "bucket-id", 2024-09-14T11:17:36.367 INFO:tasks.workunit.client.0.smithi138.stdout: "tenant": "", 2024-09-14T11:17:36.367 INFO:tasks.workunit.client.0.smithi138.stdout: "explicit_placement": { 2024-09-14T11:17:36.367 INFO:tasks.workunit.client.0.smithi138.stdout: "data_pool": ".data-pool", 2024-09-14T11:17:36.368 INFO:tasks.workunit.client.0.smithi138.stdout: "data_extra_pool": "", 2024-09-14T11:17:36.368 INFO:tasks.workunit.client.0.smithi138.stdout: "index_pool": ".index-pool" 2024-09-14T11:17:36.368 INFO:tasks.workunit.client.0.smithi138.stdout: } 2024-09-14T11:17:36.368 INFO:tasks.workunit.client.0.smithi138.stdout: }, 2024-09-14T11:17:36.368 INFO:tasks.workunit.client.0.smithi138.stdout: "key": { 2024-09-14T11:17:36.368 INFO:tasks.workunit.client.0.smithi138.stdout: "name": "myobj", 2024-09-14T11:17:36.368 INFO:tasks.workunit.client.0.smithi138.stdout: "instance": "inst", 2024-09-14T11:17:36.368 INFO:tasks.workunit.client.0.smithi138.stdout: "ns": "" 2024-09-14T11:17:36.368 INFO:tasks.workunit.client.0.smithi138.stdout: } 2024-09-14T11:17:36.368 INFO:tasks.workunit.client.0.smithi138.stdout: } 2024-09-14T11:17:36.368 INFO:tasks.workunit.client.0.smithi138.stdout:} 2024-09-14T11:17:36.368 INFO:tasks.workunit.client.0.smithi138.stdout:raw=.data-pool:marker__:inst_myobj 2024-09-14T11:17:36.369 INFO:tasks.workunit.client.0.smithi138.stdout:{ 2024-09-14T11:17:36.369 INFO:tasks.workunit.client.0.smithi138.stdout: "raw_obj2": { 2024-09-14T11:17:36.369 INFO:tasks.workunit.client.0.smithi138.stdout: "pool": ".data-pool", 2024-09-14T11:17:36.369 INFO:tasks.workunit.client.0.smithi138.stdout: "oid": "marker__:inst_myobj", 2024-09-14T11:17:36.369 INFO:tasks.workunit.client.0.smithi138.stdout: "loc": "" 2024-09-14T11:17:36.369 INFO:tasks.workunit.client.0.smithi138.stdout: } 2024-09-14T11:17:36.369 INFO:tasks.workunit.client.0.smithi138.stdout:} 2024-09-14T11:17:36.369 INFO:tasks.workunit.client.0.smithi138.stdout:{ 2024-09-14T11:17:36.369 INFO:tasks.workunit.client.0.smithi138.stdout: "new_obj2": { 2024-09-14T11:17:36.369 INFO:tasks.workunit.client.0.smithi138.stdout: "bucket": { 2024-09-14T11:17:36.369 INFO:tasks.workunit.client.0.smithi138.stdout: "name": "ebtest", 2024-09-14T11:17:36.369 INFO:tasks.workunit.client.0.smithi138.stdout: "marker": "marker", 2024-09-14T11:17:36.369 INFO:tasks.workunit.client.0.smithi138.stdout: "bucket_id": "bucket-id", 2024-09-14T11:17:36.369 INFO:tasks.workunit.client.0.smithi138.stdout: "tenant": "", 2024-09-14T11:17:36.369 INFO:tasks.workunit.client.0.smithi138.stdout: "explicit_placement": { 2024-09-14T11:17:36.369 INFO:tasks.workunit.client.0.smithi138.stdout: "data_pool": ".data-pool", 2024-09-14T11:17:36.370 INFO:tasks.workunit.client.0.smithi138.stdout: "data_extra_pool": "", 2024-09-14T11:17:36.370 INFO:tasks.workunit.client.0.smithi138.stdout: "index_pool": ".index-pool" 2024-09-14T11:17:36.370 INFO:tasks.workunit.client.0.smithi138.stdout: } 2024-09-14T11:17:36.370 INFO:tasks.workunit.client.0.smithi138.stdout: }, 2024-09-14T11:17:36.370 INFO:tasks.workunit.client.0.smithi138.stdout: "key": { 2024-09-14T11:17:36.370 INFO:tasks.workunit.client.0.smithi138.stdout: "name": "myobj", 2024-09-14T11:17:36.370 INFO:tasks.workunit.client.0.smithi138.stdout: "instance": "inst", 2024-09-14T11:17:36.370 INFO:tasks.workunit.client.0.smithi138.stdout: "ns": "" 2024-09-14T11:17:36.370 INFO:tasks.workunit.client.0.smithi138.stdout: } 2024-09-14T11:17:36.370 INFO:tasks.workunit.client.0.smithi138.stdout: } 2024-09-14T11:17:36.370 INFO:tasks.workunit.client.0.smithi138.stdout:} 2024-09-14T11:17:36.370 INFO:tasks.workunit.client.0.smithi138.stdout:raw2=.data-pool:marker__:inst_myobj 2024-09-14T11:17:36.370 INFO:tasks.workunit.client.0.smithi138.stdout:{ 2024-09-14T11:17:36.370 INFO:tasks.workunit.client.0.smithi138.stdout: "raw_obj": { 2024-09-14T11:17:36.370 INFO:tasks.workunit.client.0.smithi138.stdout: "pool": ".data-pool", 2024-09-14T11:17:36.371 INFO:tasks.workunit.client.0.smithi138.stdout: "oid": "marker__ns:inst_myobj", 2024-09-14T11:17:36.371 INFO:tasks.workunit.client.0.smithi138.stdout: "loc": "" 2024-09-14T11:17:36.371 INFO:tasks.workunit.client.0.smithi138.stdout: } 2024-09-14T11:17:36.371 INFO:tasks.workunit.client.0.smithi138.stdout:} 2024-09-14T11:17:36.371 INFO:tasks.workunit.client.0.smithi138.stdout:{ 2024-09-14T11:17:36.371 INFO:tasks.workunit.client.0.smithi138.stdout: "new_obj": { 2024-09-14T11:17:36.371 INFO:tasks.workunit.client.0.smithi138.stdout: "bucket": { 2024-09-14T11:17:36.371 INFO:tasks.workunit.client.0.smithi138.stdout: "name": "ebtest", 2024-09-14T11:17:36.371 INFO:tasks.workunit.client.0.smithi138.stdout: "marker": "marker", 2024-09-14T11:17:36.371 INFO:tasks.workunit.client.0.smithi138.stdout: "bucket_id": "bucket-id", 2024-09-14T11:17:36.371 INFO:tasks.workunit.client.0.smithi138.stdout: "tenant": "", 2024-09-14T11:17:36.372 INFO:tasks.workunit.client.0.smithi138.stdout: "explicit_placement": { 2024-09-14T11:17:36.372 INFO:tasks.workunit.client.0.smithi138.stdout: "data_pool": ".data-pool", 2024-09-14T11:17:36.372 INFO:tasks.workunit.client.0.smithi138.stdout: "data_extra_pool": "", 2024-09-14T11:17:36.372 INFO:tasks.workunit.client.0.smithi138.stdout: "index_pool": ".index-pool" 2024-09-14T11:17:36.372 INFO:tasks.workunit.client.0.smithi138.stdout: } 2024-09-14T11:17:36.372 INFO:tasks.workunit.client.0.smithi138.stdout: }, 2024-09-14T11:17:36.372 INFO:tasks.workunit.client.0.smithi138.stdout: "key": { 2024-09-14T11:17:36.372 INFO:tasks.workunit.client.0.smithi138.stdout: "name": "myobj", 2024-09-14T11:17:36.372 INFO:tasks.workunit.client.0.smithi138.stdout: "instance": "inst", 2024-09-14T11:17:36.372 INFO:tasks.workunit.client.0.smithi138.stdout: "ns": "ns" 2024-09-14T11:17:36.372 INFO:tasks.workunit.client.0.smithi138.stdout: } 2024-09-14T11:17:36.372 INFO:tasks.workunit.client.0.smithi138.stdout: } 2024-09-14T11:17:36.372 INFO:tasks.workunit.client.0.smithi138.stdout:} 2024-09-14T11:17:36.373 INFO:tasks.workunit.client.0.smithi138.stdout:raw=.data-pool:marker__ns:inst_myobj 2024-09-14T11:17:36.373 INFO:tasks.workunit.client.0.smithi138.stdout:{ 2024-09-14T11:17:36.373 INFO:tasks.workunit.client.0.smithi138.stdout: "raw_obj2": { 2024-09-14T11:17:36.373 INFO:tasks.workunit.client.0.smithi138.stdout: "pool": ".data-pool", 2024-09-14T11:17:36.373 INFO:tasks.workunit.client.0.smithi138.stdout: "oid": "marker__ns:inst_myobj", 2024-09-14T11:17:36.373 INFO:tasks.workunit.client.0.smithi138.stdout: "loc": "" 2024-09-14T11:17:36.373 INFO:tasks.workunit.client.0.smithi138.stdout: } 2024-09-14T11:17:36.373 INFO:tasks.workunit.client.0.smithi138.stdout:} 2024-09-14T11:17:36.373 INFO:tasks.workunit.client.0.smithi138.stdout:{ 2024-09-14T11:17:36.373 INFO:tasks.workunit.client.0.smithi138.stdout: "new_obj2": { 2024-09-14T11:17:36.373 INFO:tasks.workunit.client.0.smithi138.stdout: "bucket": { 2024-09-14T11:17:36.373 INFO:tasks.workunit.client.0.smithi138.stdout: "name": "ebtest", 2024-09-14T11:17:36.373 INFO:tasks.workunit.client.0.smithi138.stdout: "marker": "marker", 2024-09-14T11:17:36.374 INFO:tasks.workunit.client.0.smithi138.stdout: "bucket_id": "bucket-id", 2024-09-14T11:17:36.374 INFO:tasks.workunit.client.0.smithi138.stdout: "tenant": "", 2024-09-14T11:17:36.374 INFO:tasks.workunit.client.0.smithi138.stdout: "explicit_placement": { 2024-09-14T11:17:36.374 INFO:tasks.workunit.client.0.smithi138.stdout: "data_pool": ".data-pool", 2024-09-14T11:17:36.374 INFO:tasks.workunit.client.0.smithi138.stdout: "data_extra_pool": "", 2024-09-14T11:17:36.374 INFO:tasks.workunit.client.0.smithi138.stdout: "index_pool": ".index-pool" 2024-09-14T11:17:36.374 INFO:tasks.workunit.client.0.smithi138.stdout: } 2024-09-14T11:17:36.374 INFO:tasks.workunit.client.0.smithi138.stdout: }, 2024-09-14T11:17:36.374 INFO:tasks.workunit.client.0.smithi138.stdout: "key": { 2024-09-14T11:17:36.374 INFO:tasks.workunit.client.0.smithi138.stdout: "name": "myobj", 2024-09-14T11:17:36.374 INFO:tasks.workunit.client.0.smithi138.stdout: "instance": "inst", 2024-09-14T11:17:36.374 INFO:tasks.workunit.client.0.smithi138.stdout: "ns": "ns" 2024-09-14T11:17:36.374 INFO:tasks.workunit.client.0.smithi138.stdout: } 2024-09-14T11:17:36.375 INFO:tasks.workunit.client.0.smithi138.stdout: } 2024-09-14T11:17:36.375 INFO:tasks.workunit.client.0.smithi138.stdout:} 2024-09-14T11:17:36.375 INFO:tasks.workunit.client.0.smithi138.stdout:raw2=.data-pool:marker__ns:inst_myobj 2024-09-14T11:17:36.375 INFO:tasks.workunit.client.0.smithi138.stdout:{ 2024-09-14T11:17:36.375 INFO:tasks.workunit.client.0.smithi138.stdout: "raw_obj": { 2024-09-14T11:17:36.375 INFO:tasks.workunit.client.0.smithi138.stdout: "pool": ".data-pool", 2024-09-14T11:17:36.375 INFO:tasks.workunit.client.0.smithi138.stdout: "oid": "marker___myobj", 2024-09-14T11:17:36.375 INFO:tasks.workunit.client.0.smithi138.stdout: "loc": "marker__myobj" 2024-09-14T11:17:36.375 INFO:tasks.workunit.client.0.smithi138.stdout: } 2024-09-14T11:17:36.375 INFO:tasks.workunit.client.0.smithi138.stdout:} 2024-09-14T11:17:36.375 INFO:tasks.workunit.client.0.smithi138.stdout:{ 2024-09-14T11:17:36.375 INFO:tasks.workunit.client.0.smithi138.stdout: "new_obj": { 2024-09-14T11:17:36.376 INFO:tasks.workunit.client.0.smithi138.stdout: "bucket": { 2024-09-14T11:17:36.376 INFO:tasks.workunit.client.0.smithi138.stdout: "name": "ebtest", 2024-09-14T11:17:36.376 INFO:tasks.workunit.client.0.smithi138.stdout: "marker": "marker", 2024-09-14T11:17:36.376 INFO:tasks.workunit.client.0.smithi138.stdout: "bucket_id": "bucket-id", 2024-09-14T11:17:36.376 INFO:tasks.workunit.client.0.smithi138.stdout: "tenant": "", 2024-09-14T11:17:36.376 INFO:tasks.workunit.client.0.smithi138.stdout: "explicit_placement": { 2024-09-14T11:17:36.376 INFO:tasks.workunit.client.0.smithi138.stdout: "data_pool": ".data-pool", 2024-09-14T11:17:36.376 INFO:tasks.workunit.client.0.smithi138.stdout: "data_extra_pool": "", 2024-09-14T11:17:36.376 INFO:tasks.workunit.client.0.smithi138.stdout: "index_pool": ".index-pool" 2024-09-14T11:17:36.376 INFO:tasks.workunit.client.0.smithi138.stdout: } 2024-09-14T11:17:36.376 INFO:tasks.workunit.client.0.smithi138.stdout: }, 2024-09-14T11:17:36.376 INFO:tasks.workunit.client.0.smithi138.stdout: "key": { 2024-09-14T11:17:36.376 INFO:tasks.workunit.client.0.smithi138.stdout: "name": "_myobj", 2024-09-14T11:17:36.377 INFO:tasks.workunit.client.0.smithi138.stdout: "instance": "", 2024-09-14T11:17:36.377 INFO:tasks.workunit.client.0.smithi138.stdout: "ns": "" 2024-09-14T11:17:36.377 INFO:tasks.workunit.client.0.smithi138.stdout: } 2024-09-14T11:17:36.377 INFO:tasks.workunit.client.0.smithi138.stdout: } 2024-09-14T11:17:36.377 INFO:tasks.workunit.client.0.smithi138.stdout:} 2024-09-14T11:17:36.377 INFO:tasks.workunit.client.0.smithi138.stdout:raw=.data-pool:marker___myobj 2024-09-14T11:17:36.377 INFO:tasks.workunit.client.0.smithi138.stdout:{ 2024-09-14T11:17:36.377 INFO:tasks.workunit.client.0.smithi138.stdout: "raw_obj2": { 2024-09-14T11:17:36.377 INFO:tasks.workunit.client.0.smithi138.stdout: "pool": ".data-pool", 2024-09-14T11:17:36.377 INFO:tasks.workunit.client.0.smithi138.stdout: "oid": "marker___myobj", 2024-09-14T11:17:36.377 INFO:tasks.workunit.client.0.smithi138.stdout: "loc": "marker__myobj" 2024-09-14T11:17:36.377 INFO:tasks.workunit.client.0.smithi138.stdout: } 2024-09-14T11:17:36.378 INFO:tasks.workunit.client.0.smithi138.stdout:} 2024-09-14T11:17:36.378 INFO:tasks.workunit.client.0.smithi138.stdout:{ 2024-09-14T11:17:36.378 INFO:tasks.workunit.client.0.smithi138.stdout: "new_obj2": { 2024-09-14T11:17:36.378 INFO:tasks.workunit.client.0.smithi138.stdout: "bucket": { 2024-09-14T11:17:36.378 INFO:tasks.workunit.client.0.smithi138.stdout: "name": "ebtest", 2024-09-14T11:17:36.378 INFO:tasks.workunit.client.0.smithi138.stdout: "marker": "marker", 2024-09-14T11:17:36.378 INFO:tasks.workunit.client.0.smithi138.stdout: "bucket_id": "bucket-id", 2024-09-14T11:17:36.378 INFO:tasks.workunit.client.0.smithi138.stdout: "tenant": "", 2024-09-14T11:17:36.378 INFO:tasks.workunit.client.0.smithi138.stdout: "explicit_placement": { 2024-09-14T11:17:36.378 INFO:tasks.workunit.client.0.smithi138.stdout: "data_pool": ".data-pool", 2024-09-14T11:17:36.378 INFO:tasks.workunit.client.0.smithi138.stdout: "data_extra_pool": "", 2024-09-14T11:17:36.378 INFO:tasks.workunit.client.0.smithi138.stdout: "index_pool": ".index-pool" 2024-09-14T11:17:36.378 INFO:tasks.workunit.client.0.smithi138.stdout: } 2024-09-14T11:17:36.378 INFO:tasks.workunit.client.0.smithi138.stdout: }, 2024-09-14T11:17:36.378 INFO:tasks.workunit.client.0.smithi138.stdout: "key": { 2024-09-14T11:17:36.378 INFO:tasks.workunit.client.0.smithi138.stdout: "name": "_myobj", 2024-09-14T11:17:36.379 INFO:tasks.workunit.client.0.smithi138.stdout: "instance": "", 2024-09-14T11:17:36.379 INFO:tasks.workunit.client.0.smithi138.stdout: "ns": "" 2024-09-14T11:17:36.379 INFO:tasks.workunit.client.0.smithi138.stdout: } 2024-09-14T11:17:36.379 INFO:tasks.workunit.client.0.smithi138.stdout: } 2024-09-14T11:17:36.379 INFO:tasks.workunit.client.0.smithi138.stdout:} 2024-09-14T11:17:36.379 INFO:tasks.workunit.client.0.smithi138.stdout:raw2=.data-pool:marker___myobj 2024-09-14T11:17:36.379 INFO:tasks.workunit.client.0.smithi138.stdout:{ 2024-09-14T11:17:36.379 INFO:tasks.workunit.client.0.smithi138.stdout: "raw_obj": { 2024-09-14T11:17:36.379 INFO:tasks.workunit.client.0.smithi138.stdout: "pool": ".data-pool", 2024-09-14T11:17:36.379 INFO:tasks.workunit.client.0.smithi138.stdout: "oid": "marker__ns__myobj", 2024-09-14T11:17:36.379 INFO:tasks.workunit.client.0.smithi138.stdout: "loc": "" 2024-09-14T11:17:36.379 INFO:tasks.workunit.client.0.smithi138.stdout: } 2024-09-14T11:17:36.379 INFO:tasks.workunit.client.0.smithi138.stdout:} 2024-09-14T11:17:36.379 INFO:tasks.workunit.client.0.smithi138.stdout:{ 2024-09-14T11:17:36.379 INFO:tasks.workunit.client.0.smithi138.stdout: "new_obj": { 2024-09-14T11:17:36.379 INFO:tasks.workunit.client.0.smithi138.stdout: "bucket": { 2024-09-14T11:17:36.380 INFO:tasks.workunit.client.0.smithi138.stdout: "name": "ebtest", 2024-09-14T11:17:36.380 INFO:tasks.workunit.client.0.smithi138.stdout: "marker": "marker", 2024-09-14T11:17:36.380 INFO:tasks.workunit.client.0.smithi138.stdout: "bucket_id": "bucket-id", 2024-09-14T11:17:36.380 INFO:tasks.workunit.client.0.smithi138.stdout: "tenant": "", 2024-09-14T11:17:36.380 INFO:tasks.workunit.client.0.smithi138.stdout: "explicit_placement": { 2024-09-14T11:17:36.380 INFO:tasks.workunit.client.0.smithi138.stdout: "data_pool": ".data-pool", 2024-09-14T11:17:36.380 INFO:tasks.workunit.client.0.smithi138.stdout: "data_extra_pool": "", 2024-09-14T11:17:36.380 INFO:tasks.workunit.client.0.smithi138.stdout: "index_pool": ".index-pool" 2024-09-14T11:17:36.380 INFO:tasks.workunit.client.0.smithi138.stdout: } 2024-09-14T11:17:36.380 INFO:tasks.workunit.client.0.smithi138.stdout: }, 2024-09-14T11:17:36.380 INFO:tasks.workunit.client.0.smithi138.stdout: "key": { 2024-09-14T11:17:36.380 INFO:tasks.workunit.client.0.smithi138.stdout: "name": "_myobj", 2024-09-14T11:17:36.381 INFO:tasks.workunit.client.0.smithi138.stdout: "instance": "", 2024-09-14T11:17:36.381 INFO:tasks.workunit.client.0.smithi138.stdout: "ns": "ns" 2024-09-14T11:17:36.381 INFO:tasks.workunit.client.0.smithi138.stdout: } 2024-09-14T11:17:36.381 INFO:tasks.workunit.client.0.smithi138.stdout: } 2024-09-14T11:17:36.381 INFO:tasks.workunit.client.0.smithi138.stdout:} 2024-09-14T11:17:36.381 INFO:tasks.workunit.client.0.smithi138.stdout:raw=.data-pool:marker__ns__myobj 2024-09-14T11:17:36.381 INFO:tasks.workunit.client.0.smithi138.stdout:{ 2024-09-14T11:17:36.381 INFO:tasks.workunit.client.0.smithi138.stdout: "raw_obj2": { 2024-09-14T11:17:36.381 INFO:tasks.workunit.client.0.smithi138.stdout: "pool": ".data-pool", 2024-09-14T11:17:36.381 INFO:tasks.workunit.client.0.smithi138.stdout: "oid": "marker__ns__myobj", 2024-09-14T11:17:36.381 INFO:tasks.workunit.client.0.smithi138.stdout: "loc": "" 2024-09-14T11:17:36.381 INFO:tasks.workunit.client.0.smithi138.stdout: } 2024-09-14T11:17:36.381 INFO:tasks.workunit.client.0.smithi138.stdout:} 2024-09-14T11:17:36.381 INFO:tasks.workunit.client.0.smithi138.stdout:{ 2024-09-14T11:17:36.382 INFO:tasks.workunit.client.0.smithi138.stdout: "new_obj2": { 2024-09-14T11:17:36.382 INFO:tasks.workunit.client.0.smithi138.stdout: "bucket": { 2024-09-14T11:17:36.382 INFO:tasks.workunit.client.0.smithi138.stdout: "name": "ebtest", 2024-09-14T11:17:36.382 INFO:tasks.workunit.client.0.smithi138.stdout: "marker": "marker", 2024-09-14T11:17:36.382 INFO:tasks.workunit.client.0.smithi138.stdout: "bucket_id": "bucket-id", 2024-09-14T11:17:36.382 INFO:tasks.workunit.client.0.smithi138.stdout: "tenant": "", 2024-09-14T11:17:36.382 INFO:tasks.workunit.client.0.smithi138.stdout: "explicit_placement": { 2024-09-14T11:17:36.382 INFO:tasks.workunit.client.0.smithi138.stdout: "data_pool": ".data-pool", 2024-09-14T11:17:36.382 INFO:tasks.workunit.client.0.smithi138.stdout: "data_extra_pool": "", 2024-09-14T11:17:36.382 INFO:tasks.workunit.client.0.smithi138.stdout: "index_pool": ".index-pool" 2024-09-14T11:17:36.382 INFO:tasks.workunit.client.0.smithi138.stdout: } 2024-09-14T11:17:36.382 INFO:tasks.workunit.client.0.smithi138.stdout: }, 2024-09-14T11:17:36.383 INFO:tasks.workunit.client.0.smithi138.stdout: "key": { 2024-09-14T11:17:36.383 INFO:tasks.workunit.client.0.smithi138.stdout: "name": "_myobj", 2024-09-14T11:17:36.383 INFO:tasks.workunit.client.0.smithi138.stdout: "instance": "", 2024-09-14T11:17:36.383 INFO:tasks.workunit.client.0.smithi138.stdout: "ns": "ns" 2024-09-14T11:17:36.383 INFO:tasks.workunit.client.0.smithi138.stdout: } 2024-09-14T11:17:36.383 INFO:tasks.workunit.client.0.smithi138.stdout: } 2024-09-14T11:17:36.383 INFO:tasks.workunit.client.0.smithi138.stdout:} 2024-09-14T11:17:36.383 INFO:tasks.workunit.client.0.smithi138.stdout:raw2=.data-pool:marker__ns__myobj 2024-09-14T11:17:36.383 INFO:tasks.workunit.client.0.smithi138.stdout:{ 2024-09-14T11:17:36.383 INFO:tasks.workunit.client.0.smithi138.stdout: "raw_obj": { 2024-09-14T11:17:36.383 INFO:tasks.workunit.client.0.smithi138.stdout: "pool": ".data-pool", 2024-09-14T11:17:36.383 INFO:tasks.workunit.client.0.smithi138.stdout: "oid": "marker__:inst__myobj", 2024-09-14T11:17:36.384 INFO:tasks.workunit.client.0.smithi138.stdout: "loc": "marker__myobj" 2024-09-14T11:17:36.384 INFO:tasks.workunit.client.0.smithi138.stdout: } 2024-09-14T11:17:36.384 INFO:tasks.workunit.client.0.smithi138.stdout:} 2024-09-14T11:17:36.384 INFO:tasks.workunit.client.0.smithi138.stdout:{ 2024-09-14T11:17:36.384 INFO:tasks.workunit.client.0.smithi138.stdout: "new_obj": { 2024-09-14T11:17:36.384 INFO:tasks.workunit.client.0.smithi138.stdout: "bucket": { 2024-09-14T11:17:36.384 INFO:tasks.workunit.client.0.smithi138.stdout: "name": "ebtest", 2024-09-14T11:17:36.384 INFO:tasks.workunit.client.0.smithi138.stdout: "marker": "marker", 2024-09-14T11:17:36.384 INFO:tasks.workunit.client.0.smithi138.stdout: "bucket_id": "bucket-id", 2024-09-14T11:17:36.384 INFO:tasks.workunit.client.0.smithi138.stdout: "tenant": "", 2024-09-14T11:17:36.384 INFO:tasks.workunit.client.0.smithi138.stdout: "explicit_placement": { 2024-09-14T11:17:36.384 INFO:tasks.workunit.client.0.smithi138.stdout: "data_pool": ".data-pool", 2024-09-14T11:17:36.384 INFO:tasks.workunit.client.0.smithi138.stdout: "data_extra_pool": "", 2024-09-14T11:17:36.385 INFO:tasks.workunit.client.0.smithi138.stdout: "index_pool": ".index-pool" 2024-09-14T11:17:36.385 INFO:tasks.workunit.client.0.smithi138.stdout: } 2024-09-14T11:17:36.385 INFO:tasks.workunit.client.0.smithi138.stdout: }, 2024-09-14T11:17:36.385 INFO:tasks.workunit.client.0.smithi138.stdout: "key": { 2024-09-14T11:17:36.385 INFO:tasks.workunit.client.0.smithi138.stdout: "name": "_myobj", 2024-09-14T11:17:36.385 INFO:tasks.workunit.client.0.smithi138.stdout: "instance": "inst", 2024-09-14T11:17:36.385 INFO:tasks.workunit.client.0.smithi138.stdout: "ns": "" 2024-09-14T11:17:36.385 INFO:tasks.workunit.client.0.smithi138.stdout: } 2024-09-14T11:17:36.385 INFO:tasks.workunit.client.0.smithi138.stdout: } 2024-09-14T11:17:36.385 INFO:tasks.workunit.client.0.smithi138.stdout:} 2024-09-14T11:17:36.385 INFO:tasks.workunit.client.0.smithi138.stdout:raw=.data-pool:marker__:inst__myobj 2024-09-14T11:17:36.385 INFO:tasks.workunit.client.0.smithi138.stdout:{ 2024-09-14T11:17:36.385 INFO:tasks.workunit.client.0.smithi138.stdout: "raw_obj2": { 2024-09-14T11:17:36.385 INFO:tasks.workunit.client.0.smithi138.stdout: "pool": ".data-pool", 2024-09-14T11:17:36.385 INFO:tasks.workunit.client.0.smithi138.stdout: "oid": "marker__:inst__myobj", 2024-09-14T11:17:36.385 INFO:tasks.workunit.client.0.smithi138.stdout: "loc": "marker__myobj" 2024-09-14T11:17:36.386 INFO:tasks.workunit.client.0.smithi138.stdout: } 2024-09-14T11:17:36.386 INFO:tasks.workunit.client.0.smithi138.stdout:} 2024-09-14T11:17:36.386 INFO:tasks.workunit.client.0.smithi138.stdout:{ 2024-09-14T11:17:36.386 INFO:tasks.workunit.client.0.smithi138.stdout: "new_obj2": { 2024-09-14T11:17:36.386 INFO:tasks.workunit.client.0.smithi138.stdout: "bucket": { 2024-09-14T11:17:36.386 INFO:tasks.workunit.client.0.smithi138.stdout: "name": "ebtest", 2024-09-14T11:17:36.386 INFO:tasks.workunit.client.0.smithi138.stdout: "marker": "marker", 2024-09-14T11:17:36.386 INFO:tasks.workunit.client.0.smithi138.stdout: "bucket_id": "bucket-id", 2024-09-14T11:17:36.386 INFO:tasks.workunit.client.0.smithi138.stdout: "tenant": "", 2024-09-14T11:17:36.386 INFO:tasks.workunit.client.0.smithi138.stdout: "explicit_placement": { 2024-09-14T11:17:36.386 INFO:tasks.workunit.client.0.smithi138.stdout: "data_pool": ".data-pool", 2024-09-14T11:17:36.386 INFO:tasks.workunit.client.0.smithi138.stdout: "data_extra_pool": "", 2024-09-14T11:17:36.386 INFO:tasks.workunit.client.0.smithi138.stdout: "index_pool": ".index-pool" 2024-09-14T11:17:36.386 INFO:tasks.workunit.client.0.smithi138.stdout: } 2024-09-14T11:17:36.387 INFO:tasks.workunit.client.0.smithi138.stdout: }, 2024-09-14T11:17:36.387 INFO:tasks.workunit.client.0.smithi138.stdout: "key": { 2024-09-14T11:17:36.387 INFO:tasks.workunit.client.0.smithi138.stdout: "name": "_myobj", 2024-09-14T11:17:36.387 INFO:tasks.workunit.client.0.smithi138.stdout: "instance": "inst", 2024-09-14T11:17:36.387 INFO:tasks.workunit.client.0.smithi138.stdout: "ns": "" 2024-09-14T11:17:36.387 INFO:tasks.workunit.client.0.smithi138.stdout: } 2024-09-14T11:17:36.387 INFO:tasks.workunit.client.0.smithi138.stdout: } 2024-09-14T11:17:36.387 INFO:tasks.workunit.client.0.smithi138.stdout:} 2024-09-14T11:17:36.387 INFO:tasks.workunit.client.0.smithi138.stdout:raw2=.data-pool:marker__:inst__myobj 2024-09-14T11:17:36.387 INFO:tasks.workunit.client.0.smithi138.stdout:{ 2024-09-14T11:17:36.387 INFO:tasks.workunit.client.0.smithi138.stdout: "raw_obj": { 2024-09-14T11:17:36.387 INFO:tasks.workunit.client.0.smithi138.stdout: "pool": ".data-pool", 2024-09-14T11:17:36.387 INFO:tasks.workunit.client.0.smithi138.stdout: "oid": "marker__ns:inst__myobj", 2024-09-14T11:17:36.387 INFO:tasks.workunit.client.0.smithi138.stdout: "loc": "" 2024-09-14T11:17:36.387 INFO:tasks.workunit.client.0.smithi138.stdout: } 2024-09-14T11:17:36.388 INFO:tasks.workunit.client.0.smithi138.stdout:} 2024-09-14T11:17:36.388 INFO:tasks.workunit.client.0.smithi138.stdout:{ 2024-09-14T11:17:36.388 INFO:tasks.workunit.client.0.smithi138.stdout: "new_obj": { 2024-09-14T11:17:36.388 INFO:tasks.workunit.client.0.smithi138.stdout: "bucket": { 2024-09-14T11:17:36.388 INFO:tasks.workunit.client.0.smithi138.stdout: "name": "ebtest", 2024-09-14T11:17:36.388 INFO:tasks.workunit.client.0.smithi138.stdout: "marker": "marker", 2024-09-14T11:17:36.388 INFO:tasks.workunit.client.0.smithi138.stdout: "bucket_id": "bucket-id", 2024-09-14T11:17:36.388 INFO:tasks.workunit.client.0.smithi138.stdout: "tenant": "", 2024-09-14T11:17:36.388 INFO:tasks.workunit.client.0.smithi138.stdout: "explicit_placement": { 2024-09-14T11:17:36.388 INFO:tasks.workunit.client.0.smithi138.stdout: "data_pool": ".data-pool", 2024-09-14T11:17:36.388 INFO:tasks.workunit.client.0.smithi138.stdout: "data_extra_pool": "", 2024-09-14T11:17:36.388 INFO:tasks.workunit.client.0.smithi138.stdout: "index_pool": ".index-pool" 2024-09-14T11:17:36.388 INFO:tasks.workunit.client.0.smithi138.stdout: } 2024-09-14T11:17:36.388 INFO:tasks.workunit.client.0.smithi138.stdout: }, 2024-09-14T11:17:36.388 INFO:tasks.workunit.client.0.smithi138.stdout: "key": { 2024-09-14T11:17:36.389 INFO:tasks.workunit.client.0.smithi138.stdout: "name": "_myobj", 2024-09-14T11:17:36.389 INFO:tasks.workunit.client.0.smithi138.stdout: "instance": "inst", 2024-09-14T11:17:36.389 INFO:tasks.workunit.client.0.smithi138.stdout: "ns": "ns" 2024-09-14T11:17:36.389 INFO:tasks.workunit.client.0.smithi138.stdout: } 2024-09-14T11:17:36.389 INFO:tasks.workunit.client.0.smithi138.stdout: } 2024-09-14T11:17:36.389 INFO:tasks.workunit.client.0.smithi138.stdout:} 2024-09-14T11:17:36.389 INFO:tasks.workunit.client.0.smithi138.stdout:raw=.data-pool:marker__ns:inst__myobj 2024-09-14T11:17:36.389 INFO:tasks.workunit.client.0.smithi138.stdout:{ 2024-09-14T11:17:36.389 INFO:tasks.workunit.client.0.smithi138.stdout: "raw_obj2": { 2024-09-14T11:17:36.389 INFO:tasks.workunit.client.0.smithi138.stdout: "pool": ".data-pool", 2024-09-14T11:17:36.389 INFO:tasks.workunit.client.0.smithi138.stdout: "oid": "marker__ns:inst__myobj", 2024-09-14T11:17:36.389 INFO:tasks.workunit.client.0.smithi138.stdout: "loc": "" 2024-09-14T11:17:36.389 INFO:tasks.workunit.client.0.smithi138.stdout: } 2024-09-14T11:17:36.389 INFO:tasks.workunit.client.0.smithi138.stdout:} 2024-09-14T11:17:36.389 INFO:tasks.workunit.client.0.smithi138.stdout:{ 2024-09-14T11:17:36.389 INFO:tasks.workunit.client.0.smithi138.stdout: "new_obj2": { 2024-09-14T11:17:36.389 INFO:tasks.workunit.client.0.smithi138.stdout: "bucket": { 2024-09-14T11:17:36.390 INFO:tasks.workunit.client.0.smithi138.stdout: "name": "ebtest", 2024-09-14T11:17:36.390 INFO:tasks.workunit.client.0.smithi138.stdout: "marker": "marker", 2024-09-14T11:17:36.390 INFO:tasks.workunit.client.0.smithi138.stdout: "bucket_id": "bucket-id", 2024-09-14T11:17:36.390 INFO:tasks.workunit.client.0.smithi138.stdout: "tenant": "", 2024-09-14T11:17:36.390 INFO:tasks.workunit.client.0.smithi138.stdout: "explicit_placement": { 2024-09-14T11:17:36.390 INFO:tasks.workunit.client.0.smithi138.stdout: "data_pool": ".data-pool", 2024-09-14T11:17:36.390 INFO:tasks.workunit.client.0.smithi138.stdout: "data_extra_pool": "", 2024-09-14T11:17:36.390 INFO:tasks.workunit.client.0.smithi138.stdout: "index_pool": ".index-pool" 2024-09-14T11:17:36.390 INFO:tasks.workunit.client.0.smithi138.stdout: } 2024-09-14T11:17:36.390 INFO:tasks.workunit.client.0.smithi138.stdout: }, 2024-09-14T11:17:36.390 INFO:tasks.workunit.client.0.smithi138.stdout: "key": { 2024-09-14T11:17:36.390 INFO:tasks.workunit.client.0.smithi138.stdout: "name": "_myobj", 2024-09-14T11:17:36.390 INFO:tasks.workunit.client.0.smithi138.stdout: "instance": "inst", 2024-09-14T11:17:36.390 INFO:tasks.workunit.client.0.smithi138.stdout: "ns": "ns" 2024-09-14T11:17:36.390 INFO:tasks.workunit.client.0.smithi138.stdout: } 2024-09-14T11:17:36.391 INFO:tasks.workunit.client.0.smithi138.stdout: } 2024-09-14T11:17:36.391 INFO:tasks.workunit.client.0.smithi138.stdout:} 2024-09-14T11:17:36.391 INFO:tasks.workunit.client.0.smithi138.stdout:raw2=.data-pool:marker__ns:inst__myobj 2024-09-14T11:17:36.391 INFO:tasks.workunit.client.0.smithi138.stdout:{ 2024-09-14T11:17:36.391 INFO:tasks.workunit.client.0.smithi138.stdout: "raw_obj": { 2024-09-14T11:17:36.391 INFO:tasks.workunit.client.0.smithi138.stdout: "pool": ".data-pool", 2024-09-14T11:17:36.391 INFO:tasks.workunit.client.0.smithi138.stdout: "oid": "marker___myobj_", 2024-09-14T11:17:36.391 INFO:tasks.workunit.client.0.smithi138.stdout: "loc": "marker__myobj_" 2024-09-14T11:17:36.391 INFO:tasks.workunit.client.0.smithi138.stdout: } 2024-09-14T11:17:36.391 INFO:tasks.workunit.client.0.smithi138.stdout:} 2024-09-14T11:17:36.391 INFO:tasks.workunit.client.0.smithi138.stdout:{ 2024-09-14T11:17:36.391 INFO:tasks.workunit.client.0.smithi138.stdout: "new_obj": { 2024-09-14T11:17:36.391 INFO:tasks.workunit.client.0.smithi138.stdout: "bucket": { 2024-09-14T11:17:36.391 INFO:tasks.workunit.client.0.smithi138.stdout: "name": "ebtest", 2024-09-14T11:17:36.392 INFO:tasks.workunit.client.0.smithi138.stdout: "marker": "marker", 2024-09-14T11:17:36.392 INFO:tasks.workunit.client.0.smithi138.stdout: "bucket_id": "bucket-id", 2024-09-14T11:17:36.392 INFO:tasks.workunit.client.0.smithi138.stdout: "tenant": "", 2024-09-14T11:17:36.392 INFO:tasks.workunit.client.0.smithi138.stdout: "explicit_placement": { 2024-09-14T11:17:36.392 INFO:tasks.workunit.client.0.smithi138.stdout: "data_pool": ".data-pool", 2024-09-14T11:17:36.392 INFO:tasks.workunit.client.0.smithi138.stdout: "data_extra_pool": "", 2024-09-14T11:17:36.392 INFO:tasks.workunit.client.0.smithi138.stdout: "index_pool": ".index-pool" 2024-09-14T11:17:36.392 INFO:tasks.workunit.client.0.smithi138.stdout: } 2024-09-14T11:17:36.392 INFO:tasks.workunit.client.0.smithi138.stdout: }, 2024-09-14T11:17:36.392 INFO:tasks.workunit.client.0.smithi138.stdout: "key": { 2024-09-14T11:17:36.392 INFO:tasks.workunit.client.0.smithi138.stdout: "name": "_myobj_", 2024-09-14T11:17:36.392 INFO:tasks.workunit.client.0.smithi138.stdout: "instance": "", 2024-09-14T11:17:36.392 INFO:tasks.workunit.client.0.smithi138.stdout: "ns": "" 2024-09-14T11:17:36.392 INFO:tasks.workunit.client.0.smithi138.stdout: } 2024-09-14T11:17:36.392 INFO:tasks.workunit.client.0.smithi138.stdout: } 2024-09-14T11:17:36.393 INFO:tasks.workunit.client.0.smithi138.stdout:} 2024-09-14T11:17:36.393 INFO:tasks.workunit.client.0.smithi138.stdout:raw=.data-pool:marker___myobj_ 2024-09-14T11:17:36.393 INFO:tasks.workunit.client.0.smithi138.stdout:{ 2024-09-14T11:17:36.393 INFO:tasks.workunit.client.0.smithi138.stdout: "raw_obj2": { 2024-09-14T11:17:36.393 INFO:tasks.workunit.client.0.smithi138.stdout: "pool": ".data-pool", 2024-09-14T11:17:36.393 INFO:tasks.workunit.client.0.smithi138.stdout: "oid": "marker___myobj_", 2024-09-14T11:17:36.393 INFO:tasks.workunit.client.0.smithi138.stdout: "loc": "marker__myobj_" 2024-09-14T11:17:36.393 INFO:tasks.workunit.client.0.smithi138.stdout: } 2024-09-14T11:17:36.393 INFO:tasks.workunit.client.0.smithi138.stdout:} 2024-09-14T11:17:36.393 INFO:tasks.workunit.client.0.smithi138.stdout:{ 2024-09-14T11:17:36.393 INFO:tasks.workunit.client.0.smithi138.stdout: "new_obj2": { 2024-09-14T11:17:36.394 INFO:tasks.workunit.client.0.smithi138.stdout: "bucket": { 2024-09-14T11:17:36.394 INFO:tasks.workunit.client.0.smithi138.stdout: "name": "ebtest", 2024-09-14T11:17:36.394 INFO:tasks.workunit.client.0.smithi138.stdout: "marker": "marker", 2024-09-14T11:17:36.394 INFO:tasks.workunit.client.0.smithi138.stdout: "bucket_id": "bucket-id", 2024-09-14T11:17:36.394 INFO:tasks.workunit.client.0.smithi138.stdout: "tenant": "", 2024-09-14T11:17:36.394 INFO:tasks.workunit.client.0.smithi138.stdout: "explicit_placement": { 2024-09-14T11:17:36.394 INFO:tasks.workunit.client.0.smithi138.stdout: "data_pool": ".data-pool", 2024-09-14T11:17:36.394 INFO:tasks.workunit.client.0.smithi138.stdout: "data_extra_pool": "", 2024-09-14T11:17:36.394 INFO:tasks.workunit.client.0.smithi138.stdout: "index_pool": ".index-pool" 2024-09-14T11:17:36.394 INFO:tasks.workunit.client.0.smithi138.stdout: } 2024-09-14T11:17:36.394 INFO:tasks.workunit.client.0.smithi138.stdout: }, 2024-09-14T11:17:36.394 INFO:tasks.workunit.client.0.smithi138.stdout: "key": { 2024-09-14T11:17:36.394 INFO:tasks.workunit.client.0.smithi138.stdout: "name": "_myobj_", 2024-09-14T11:17:36.394 INFO:tasks.workunit.client.0.smithi138.stdout: "instance": "", 2024-09-14T11:17:36.394 INFO:tasks.workunit.client.0.smithi138.stdout: "ns": "" 2024-09-14T11:17:36.395 INFO:tasks.workunit.client.0.smithi138.stdout: } 2024-09-14T11:17:36.395 INFO:tasks.workunit.client.0.smithi138.stdout: } 2024-09-14T11:17:36.395 INFO:tasks.workunit.client.0.smithi138.stdout:} 2024-09-14T11:17:36.395 INFO:tasks.workunit.client.0.smithi138.stdout:raw2=.data-pool:marker___myobj_ 2024-09-14T11:17:36.395 INFO:tasks.workunit.client.0.smithi138.stdout:{ 2024-09-14T11:17:36.395 INFO:tasks.workunit.client.0.smithi138.stdout: "raw_obj": { 2024-09-14T11:17:36.395 INFO:tasks.workunit.client.0.smithi138.stdout: "pool": ".data-pool", 2024-09-14T11:17:36.395 INFO:tasks.workunit.client.0.smithi138.stdout: "oid": "marker__ns__myobj_", 2024-09-14T11:17:36.395 INFO:tasks.workunit.client.0.smithi138.stdout: "loc": "" 2024-09-14T11:17:36.395 INFO:tasks.workunit.client.0.smithi138.stdout: } 2024-09-14T11:17:36.395 INFO:tasks.workunit.client.0.smithi138.stdout:} 2024-09-14T11:17:36.395 INFO:tasks.workunit.client.0.smithi138.stdout:{ 2024-09-14T11:17:36.395 INFO:tasks.workunit.client.0.smithi138.stdout: "new_obj": { 2024-09-14T11:17:36.395 INFO:tasks.workunit.client.0.smithi138.stdout: "bucket": { 2024-09-14T11:17:36.395 INFO:tasks.workunit.client.0.smithi138.stdout: "name": "ebtest", 2024-09-14T11:17:36.396 INFO:tasks.workunit.client.0.smithi138.stdout: "marker": "marker", 2024-09-14T11:17:36.396 INFO:tasks.workunit.client.0.smithi138.stdout: "bucket_id": "bucket-id", 2024-09-14T11:17:36.396 INFO:tasks.workunit.client.0.smithi138.stdout: "tenant": "", 2024-09-14T11:17:36.396 INFO:tasks.workunit.client.0.smithi138.stdout: "explicit_placement": { 2024-09-14T11:17:36.396 INFO:tasks.workunit.client.0.smithi138.stdout: "data_pool": ".data-pool", 2024-09-14T11:17:36.396 INFO:tasks.workunit.client.0.smithi138.stdout: "data_extra_pool": "", 2024-09-14T11:17:36.396 INFO:tasks.workunit.client.0.smithi138.stdout: "index_pool": ".index-pool" 2024-09-14T11:17:36.396 INFO:tasks.workunit.client.0.smithi138.stdout: } 2024-09-14T11:17:36.396 INFO:tasks.workunit.client.0.smithi138.stdout: }, 2024-09-14T11:17:36.396 INFO:tasks.workunit.client.0.smithi138.stdout: "key": { 2024-09-14T11:17:36.396 INFO:tasks.workunit.client.0.smithi138.stdout: "name": "_myobj_", 2024-09-14T11:17:36.396 INFO:tasks.workunit.client.0.smithi138.stdout: "instance": "", 2024-09-14T11:17:36.396 INFO:tasks.workunit.client.0.smithi138.stdout: "ns": "ns" 2024-09-14T11:17:36.396 INFO:tasks.workunit.client.0.smithi138.stdout: } 2024-09-14T11:17:36.396 INFO:tasks.workunit.client.0.smithi138.stdout: } 2024-09-14T11:17:36.396 INFO:tasks.workunit.client.0.smithi138.stdout:} 2024-09-14T11:17:36.397 INFO:tasks.workunit.client.0.smithi138.stdout:raw=.data-pool:marker__ns__myobj_ 2024-09-14T11:17:36.397 INFO:tasks.workunit.client.0.smithi138.stdout:{ 2024-09-14T11:17:36.397 INFO:tasks.workunit.client.0.smithi138.stdout: "raw_obj2": { 2024-09-14T11:17:36.397 INFO:tasks.workunit.client.0.smithi138.stdout: "pool": ".data-pool", 2024-09-14T11:17:36.397 INFO:tasks.workunit.client.0.smithi138.stdout: "oid": "marker__ns__myobj_", 2024-09-14T11:17:36.397 INFO:tasks.workunit.client.0.smithi138.stdout: "loc": "" 2024-09-14T11:17:36.397 INFO:tasks.workunit.client.0.smithi138.stdout: } 2024-09-14T11:17:36.397 INFO:tasks.workunit.client.0.smithi138.stdout:} 2024-09-14T11:17:36.397 INFO:tasks.workunit.client.0.smithi138.stdout:{ 2024-09-14T11:17:36.397 INFO:tasks.workunit.client.0.smithi138.stdout: "new_obj2": { 2024-09-14T11:17:36.397 INFO:tasks.workunit.client.0.smithi138.stdout: "bucket": { 2024-09-14T11:17:36.397 INFO:tasks.workunit.client.0.smithi138.stdout: "name": "ebtest", 2024-09-14T11:17:36.397 INFO:tasks.workunit.client.0.smithi138.stdout: "marker": "marker", 2024-09-14T11:17:36.398 INFO:tasks.workunit.client.0.smithi138.stdout: "bucket_id": "bucket-id", 2024-09-14T11:17:36.398 INFO:tasks.workunit.client.0.smithi138.stdout: "tenant": "", 2024-09-14T11:17:36.398 INFO:tasks.workunit.client.0.smithi138.stdout: "explicit_placement": { 2024-09-14T11:17:36.398 INFO:tasks.workunit.client.0.smithi138.stdout: "data_pool": ".data-pool", 2024-09-14T11:17:36.398 INFO:tasks.workunit.client.0.smithi138.stdout: "data_extra_pool": "", 2024-09-14T11:17:36.398 INFO:tasks.workunit.client.0.smithi138.stdout: "index_pool": ".index-pool" 2024-09-14T11:17:36.398 INFO:tasks.workunit.client.0.smithi138.stdout: } 2024-09-14T11:17:36.398 INFO:tasks.workunit.client.0.smithi138.stdout: }, 2024-09-14T11:17:36.398 INFO:tasks.workunit.client.0.smithi138.stdout: "key": { 2024-09-14T11:17:36.398 INFO:tasks.workunit.client.0.smithi138.stdout: "name": "_myobj_", 2024-09-14T11:17:36.398 INFO:tasks.workunit.client.0.smithi138.stdout: "instance": "", 2024-09-14T11:17:36.398 INFO:tasks.workunit.client.0.smithi138.stdout: "ns": "ns" 2024-09-14T11:17:36.398 INFO:tasks.workunit.client.0.smithi138.stdout: } 2024-09-14T11:17:36.398 INFO:tasks.workunit.client.0.smithi138.stdout: } 2024-09-14T11:17:36.398 INFO:tasks.workunit.client.0.smithi138.stdout:} 2024-09-14T11:17:36.399 INFO:tasks.workunit.client.0.smithi138.stdout:raw2=.data-pool:marker__ns__myobj_ 2024-09-14T11:17:36.399 INFO:tasks.workunit.client.0.smithi138.stdout:{ 2024-09-14T11:17:36.399 INFO:tasks.workunit.client.0.smithi138.stdout: "raw_obj": { 2024-09-14T11:17:36.399 INFO:tasks.workunit.client.0.smithi138.stdout: "pool": ".data-pool", 2024-09-14T11:17:36.399 INFO:tasks.workunit.client.0.smithi138.stdout: "oid": "marker__:inst__myobj_", 2024-09-14T11:17:36.399 INFO:tasks.workunit.client.0.smithi138.stdout: "loc": "marker__myobj_" 2024-09-14T11:17:36.399 INFO:tasks.workunit.client.0.smithi138.stdout: } 2024-09-14T11:17:36.399 INFO:tasks.workunit.client.0.smithi138.stdout:} 2024-09-14T11:17:36.399 INFO:tasks.workunit.client.0.smithi138.stdout:{ 2024-09-14T11:17:36.399 INFO:tasks.workunit.client.0.smithi138.stdout: "new_obj": { 2024-09-14T11:17:36.399 INFO:tasks.workunit.client.0.smithi138.stdout: "bucket": { 2024-09-14T11:17:36.399 INFO:tasks.workunit.client.0.smithi138.stdout: "name": "ebtest", 2024-09-14T11:17:36.399 INFO:tasks.workunit.client.0.smithi138.stdout: "marker": "marker", 2024-09-14T11:17:36.399 INFO:tasks.workunit.client.0.smithi138.stdout: "bucket_id": "bucket-id", 2024-09-14T11:17:36.399 INFO:tasks.workunit.client.0.smithi138.stdout: "tenant": "", 2024-09-14T11:17:36.399 INFO:tasks.workunit.client.0.smithi138.stdout: "explicit_placement": { 2024-09-14T11:17:36.400 INFO:tasks.workunit.client.0.smithi138.stdout: "data_pool": ".data-pool", 2024-09-14T11:17:36.400 INFO:tasks.workunit.client.0.smithi138.stdout: "data_extra_pool": "", 2024-09-14T11:17:36.400 INFO:tasks.workunit.client.0.smithi138.stdout: "index_pool": ".index-pool" 2024-09-14T11:17:36.400 INFO:tasks.workunit.client.0.smithi138.stdout: } 2024-09-14T11:17:36.400 INFO:tasks.workunit.client.0.smithi138.stdout: }, 2024-09-14T11:17:36.400 INFO:tasks.workunit.client.0.smithi138.stdout: "key": { 2024-09-14T11:17:36.400 INFO:tasks.workunit.client.0.smithi138.stdout: "name": "_myobj_", 2024-09-14T11:17:36.400 INFO:tasks.workunit.client.0.smithi138.stdout: "instance": "inst", 2024-09-14T11:17:36.400 INFO:tasks.workunit.client.0.smithi138.stdout: "ns": "" 2024-09-14T11:17:36.400 INFO:tasks.workunit.client.0.smithi138.stdout: } 2024-09-14T11:17:36.400 INFO:tasks.workunit.client.0.smithi138.stdout: } 2024-09-14T11:17:36.400 INFO:tasks.workunit.client.0.smithi138.stdout:} 2024-09-14T11:17:36.400 INFO:tasks.workunit.client.0.smithi138.stdout:raw=.data-pool:marker__:inst__myobj_ 2024-09-14T11:17:36.400 INFO:tasks.workunit.client.0.smithi138.stdout:{ 2024-09-14T11:17:36.401 INFO:tasks.workunit.client.0.smithi138.stdout: "raw_obj2": { 2024-09-14T11:17:36.401 INFO:tasks.workunit.client.0.smithi138.stdout: "pool": ".data-pool", 2024-09-14T11:17:36.401 INFO:tasks.workunit.client.0.smithi138.stdout: "oid": "marker__:inst__myobj_", 2024-09-14T11:17:36.401 INFO:tasks.workunit.client.0.smithi138.stdout: "loc": "marker__myobj_" 2024-09-14T11:17:36.401 INFO:tasks.workunit.client.0.smithi138.stdout: } 2024-09-14T11:17:36.401 INFO:tasks.workunit.client.0.smithi138.stdout:} 2024-09-14T11:17:36.401 INFO:tasks.workunit.client.0.smithi138.stdout:{ 2024-09-14T11:17:36.401 INFO:tasks.workunit.client.0.smithi138.stdout: "new_obj2": { 2024-09-14T11:17:36.401 INFO:tasks.workunit.client.0.smithi138.stdout: "bucket": { 2024-09-14T11:17:36.401 INFO:tasks.workunit.client.0.smithi138.stdout: "name": "ebtest", 2024-09-14T11:17:36.401 INFO:tasks.workunit.client.0.smithi138.stdout: "marker": "marker", 2024-09-14T11:17:36.402 INFO:tasks.workunit.client.0.smithi138.stdout: "bucket_id": "bucket-id", 2024-09-14T11:17:36.402 INFO:tasks.workunit.client.0.smithi138.stdout: "tenant": "", 2024-09-14T11:17:36.402 INFO:tasks.workunit.client.0.smithi138.stdout: "explicit_placement": { 2024-09-14T11:17:36.402 INFO:tasks.workunit.client.0.smithi138.stdout: "data_pool": ".data-pool", 2024-09-14T11:17:36.402 INFO:tasks.workunit.client.0.smithi138.stdout: "data_extra_pool": "", 2024-09-14T11:17:36.402 INFO:tasks.workunit.client.0.smithi138.stdout: "index_pool": ".index-pool" 2024-09-14T11:17:36.402 INFO:tasks.workunit.client.0.smithi138.stdout: } 2024-09-14T11:17:36.402 INFO:tasks.workunit.client.0.smithi138.stdout: }, 2024-09-14T11:17:36.402 INFO:tasks.workunit.client.0.smithi138.stdout: "key": { 2024-09-14T11:17:36.402 INFO:tasks.workunit.client.0.smithi138.stdout: "name": "_myobj_", 2024-09-14T11:17:36.402 INFO:tasks.workunit.client.0.smithi138.stdout: "instance": "inst", 2024-09-14T11:17:36.402 INFO:tasks.workunit.client.0.smithi138.stdout: "ns": "" 2024-09-14T11:17:36.403 INFO:tasks.workunit.client.0.smithi138.stdout: } 2024-09-14T11:17:36.403 INFO:tasks.workunit.client.0.smithi138.stdout: } 2024-09-14T11:17:36.403 INFO:tasks.workunit.client.0.smithi138.stdout:} 2024-09-14T11:17:36.403 INFO:tasks.workunit.client.0.smithi138.stdout:raw2=.data-pool:marker__:inst__myobj_ 2024-09-14T11:17:36.403 INFO:tasks.workunit.client.0.smithi138.stdout:{ 2024-09-14T11:17:36.403 INFO:tasks.workunit.client.0.smithi138.stdout: "raw_obj": { 2024-09-14T11:17:36.403 INFO:tasks.workunit.client.0.smithi138.stdout: "pool": ".data-pool", 2024-09-14T11:17:36.403 INFO:tasks.workunit.client.0.smithi138.stdout: "oid": "marker__ns:inst__myobj_", 2024-09-14T11:17:36.403 INFO:tasks.workunit.client.0.smithi138.stdout: "loc": "" 2024-09-14T11:17:36.403 INFO:tasks.workunit.client.0.smithi138.stdout: } 2024-09-14T11:17:36.403 INFO:tasks.workunit.client.0.smithi138.stdout:} 2024-09-14T11:17:36.403 INFO:tasks.workunit.client.0.smithi138.stdout:{ 2024-09-14T11:17:36.403 INFO:tasks.workunit.client.0.smithi138.stdout: "new_obj": { 2024-09-14T11:17:36.403 INFO:tasks.workunit.client.0.smithi138.stdout: "bucket": { 2024-09-14T11:17:36.404 INFO:tasks.workunit.client.0.smithi138.stdout: "name": "ebtest", 2024-09-14T11:17:36.404 INFO:tasks.workunit.client.0.smithi138.stdout: "marker": "marker", 2024-09-14T11:17:36.404 INFO:tasks.workunit.client.0.smithi138.stdout: "bucket_id": "bucket-id", 2024-09-14T11:17:36.404 INFO:tasks.workunit.client.0.smithi138.stdout: "tenant": "", 2024-09-14T11:17:36.404 INFO:tasks.workunit.client.0.smithi138.stdout: "explicit_placement": { 2024-09-14T11:17:36.404 INFO:tasks.workunit.client.0.smithi138.stdout: "data_pool": ".data-pool", 2024-09-14T11:17:36.404 INFO:tasks.workunit.client.0.smithi138.stdout: "data_extra_pool": "", 2024-09-14T11:17:36.404 INFO:tasks.workunit.client.0.smithi138.stdout: "index_pool": ".index-pool" 2024-09-14T11:17:36.404 INFO:tasks.workunit.client.0.smithi138.stdout: } 2024-09-14T11:17:36.404 INFO:tasks.workunit.client.0.smithi138.stdout: }, 2024-09-14T11:17:36.404 INFO:tasks.workunit.client.0.smithi138.stdout: "key": { 2024-09-14T11:17:36.404 INFO:tasks.workunit.client.0.smithi138.stdout: "name": "_myobj_", 2024-09-14T11:17:36.404 INFO:tasks.workunit.client.0.smithi138.stdout: "instance": "inst", 2024-09-14T11:17:36.404 INFO:tasks.workunit.client.0.smithi138.stdout: "ns": "ns" 2024-09-14T11:17:36.404 INFO:tasks.workunit.client.0.smithi138.stdout: } 2024-09-14T11:17:36.405 INFO:tasks.workunit.client.0.smithi138.stdout: } 2024-09-14T11:17:36.405 INFO:tasks.workunit.client.0.smithi138.stdout:} 2024-09-14T11:17:36.405 INFO:tasks.workunit.client.0.smithi138.stdout:raw=.data-pool:marker__ns:inst__myobj_ 2024-09-14T11:17:36.405 INFO:tasks.workunit.client.0.smithi138.stdout:{ 2024-09-14T11:17:36.405 INFO:tasks.workunit.client.0.smithi138.stdout: "raw_obj2": { 2024-09-14T11:17:36.405 INFO:tasks.workunit.client.0.smithi138.stdout: "pool": ".data-pool", 2024-09-14T11:17:36.405 INFO:tasks.workunit.client.0.smithi138.stdout: "oid": "marker__ns:inst__myobj_", 2024-09-14T11:17:36.405 INFO:tasks.workunit.client.0.smithi138.stdout: "loc": "" 2024-09-14T11:17:36.405 INFO:tasks.workunit.client.0.smithi138.stdout: } 2024-09-14T11:17:36.405 INFO:tasks.workunit.client.0.smithi138.stdout:} 2024-09-14T11:17:36.405 INFO:tasks.workunit.client.0.smithi138.stdout:{ 2024-09-14T11:17:36.405 INFO:tasks.workunit.client.0.smithi138.stdout: "new_obj2": { 2024-09-14T11:17:36.405 INFO:tasks.workunit.client.0.smithi138.stdout: "bucket": { 2024-09-14T11:17:36.405 INFO:tasks.workunit.client.0.smithi138.stdout: "name": "ebtest", 2024-09-14T11:17:36.406 INFO:tasks.workunit.client.0.smithi138.stdout: "marker": "marker", 2024-09-14T11:17:36.406 INFO:tasks.workunit.client.0.smithi138.stdout: "bucket_id": "bucket-id", 2024-09-14T11:17:36.406 INFO:tasks.workunit.client.0.smithi138.stdout: "tenant": "", 2024-09-14T11:17:36.406 INFO:tasks.workunit.client.0.smithi138.stdout: "explicit_placement": { 2024-09-14T11:17:36.406 INFO:tasks.workunit.client.0.smithi138.stdout: "data_pool": ".data-pool", 2024-09-14T11:17:36.406 INFO:tasks.workunit.client.0.smithi138.stdout: "data_extra_pool": "", 2024-09-14T11:17:36.406 INFO:tasks.workunit.client.0.smithi138.stdout: "index_pool": ".index-pool" 2024-09-14T11:17:36.406 INFO:tasks.workunit.client.0.smithi138.stdout: } 2024-09-14T11:17:36.406 INFO:tasks.workunit.client.0.smithi138.stdout: }, 2024-09-14T11:17:36.406 INFO:tasks.workunit.client.0.smithi138.stdout: "key": { 2024-09-14T11:17:36.406 INFO:tasks.workunit.client.0.smithi138.stdout: "name": "_myobj_", 2024-09-14T11:17:36.406 INFO:tasks.workunit.client.0.smithi138.stdout: "instance": "inst", 2024-09-14T11:17:36.406 INFO:tasks.workunit.client.0.smithi138.stdout: "ns": "ns" 2024-09-14T11:17:36.406 INFO:tasks.workunit.client.0.smithi138.stdout: } 2024-09-14T11:17:36.406 INFO:tasks.workunit.client.0.smithi138.stdout: } 2024-09-14T11:17:36.407 INFO:tasks.workunit.client.0.smithi138.stdout:} 2024-09-14T11:17:36.407 INFO:tasks.workunit.client.0.smithi138.stdout:raw2=.data-pool:marker__ns:inst__myobj_ 2024-09-14T11:17:36.407 INFO:tasks.workunit.client.0.smithi138.stdout:[ OK ] TestRGWObj.old_to_raw (0 ms) 2024-09-14T11:17:36.407 INFO:tasks.workunit.client.0.smithi138.stdout:[----------] 4 tests from TestRGWObj (1 ms total) 2024-09-14T11:17:36.407 INFO:tasks.workunit.client.0.smithi138.stdout: 2024-09-14T11:17:36.407 INFO:tasks.workunit.client.0.smithi138.stdout:[----------] Global test environment tear-down 2024-09-14T11:17:36.407 INFO:tasks.workunit.client.0.smithi138.stdout:[==========] 4 tests from 1 test suite ran. (1 ms total) 2024-09-14T11:17:36.407 INFO:tasks.workunit.client.0.smithi138.stdout:[ PASSED ] 4 tests. 2024-09-14T11:17:36.407 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-09-14T11:17:36.407 DEBUG:teuthology.orchestra.run.smithi138:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-09-14T11:17:36.422 INFO:tasks.workunit:Running workunits matching rgw/test_librgw_file.sh on client.0... 2024-09-14T11:17:36.423 INFO:tasks.workunit:Running workunit rgw/test_librgw_file.sh... 2024-09-14T11:17:36.423 DEBUG:teuthology.orchestra.run.smithi138:workunit test rgw/test_librgw_file.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=1c941a66c1b420259b8fc5ac19e792dbbf60aded TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/test_librgw_file.sh 2024-09-14T11:17:36.523 INFO:tasks.workunit.client.0.smithi138.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:17:36.524 INFO:tasks.workunit.client.0.smithi138.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:17:36.583 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:17:36.586+0000 7fa585ea19c0 20 rados->read ofs=0 len=0 2024-09-14T11:17:36.584 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:17:36.586+0000 7fa585ea19c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:17:36.585 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:17:36.586+0000 7fa585ea19c0 20 realm 2024-09-14T11:17:36.585 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:17:36.586+0000 7fa585ea19c0 20 rados->read ofs=0 len=0 2024-09-14T11:17:36.585 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:17:36.586+0000 7fa585ea19c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:17:36.585 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:17:36.586+0000 7fa585ea19c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:17:36.585 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:17:36.586+0000 7fa585ea19c0 20 rados->read ofs=0 len=0 2024-09-14T11:17:36.585 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:17:36.586+0000 7fa585ea19c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:17:36.585 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:17:36.586+0000 7fa585ea19c0 20 rados->read ofs=0 len=0 2024-09-14T11:17:36.586 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:17:36.586+0000 7fa585ea19c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:17:36.587 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:17:36.590+0000 7fa585ea19c0 20 rados->read ofs=0 len=0 2024-09-14T11:17:36.587 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:17:36.590+0000 7fa585ea19c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:17:36.587 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:17:36.590+0000 7fa585ea19c0 20 searching for the correct realm 2024-09-14T11:17:36.799 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:17:36.802+0000 7fa5841a8640 0 -- 172.21.15.138:0/3791060481 >> [v2:172.21.15.154:6824/416768175,v1:172.21.15.154:6825/416768175] conn(0x7fa57c054b60 msgr2=0x7fa57c00f430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:17:37.016 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:17:37.018+0000 7fa5831a6640 0 -- 172.21.15.138:0/3791060481 >> [v2:172.21.15.138:6816/326481658,v1:172.21.15.138:6817/326481658] conn(0x7fa57c04b900 msgr2=0x7fa57c0633f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:17:37.234 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:17:37.234+0000 7fa585ea19c0 20 RGWRados::pool_iterate: got zone_info.d9e72d30-c60b-4d0d-9267-fdc36392d5ad 2024-09-14T11:17:37.235 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:17:37.234+0000 7fa585ea19c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:17:37.235 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:17:37.234+0000 7fa585ea19c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:17:37.235 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:17:37.234+0000 7fa585ea19c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:17:37.235 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:17:37.234+0000 7fa585ea19c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:17:37.235 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:17:37.234+0000 7fa585ea19c0 20 RGWRados::pool_iterate: got zonegroup_info.65ab941b-da8c-4160-94fb-3672b069d44f 2024-09-14T11:17:37.235 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:17:37.238+0000 7fa585ea19c0 20 rados->read ofs=0 len=0 2024-09-14T11:17:37.236 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:17:37.238+0000 7fa585ea19c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:17:37.236 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:17:37.238+0000 7fa585ea19c0 20 rados->read ofs=0 len=0 2024-09-14T11:17:37.236 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:17:37.238+0000 7fa585ea19c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:17:37.236 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:17:37.238+0000 7fa585ea19c0 20 rados->read ofs=0 len=0 2024-09-14T11:17:37.237 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:17:37.238+0000 7fa585ea19c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:17:37.237 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:17:37.238+0000 7fa585ea19c0 20 zone default found 2024-09-14T11:17:37.237 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:17:37.238+0000 7fa585ea19c0 4 Realm: () 2024-09-14T11:17:37.237 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:17:37.238+0000 7fa585ea19c0 4 ZoneGroup: default (65ab941b-da8c-4160-94fb-3672b069d44f) 2024-09-14T11:17:37.237 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:17:37.238+0000 7fa585ea19c0 4 Zone: default (d9e72d30-c60b-4d0d-9267-fdc36392d5ad) 2024-09-14T11:17:37.237 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:17:37.238+0000 7fa585ea19c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:17:37.238 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:17:37.238+0000 7fa585ea19c0 20 zonegroup default 2024-09-14T11:17:37.238 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:17:37.238+0000 7fa585ea19c0 20 rados->read ofs=0 len=0 2024-09-14T11:17:37.238 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:17:37.238+0000 7fa585ea19c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:17:37.238 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:17:37.238+0000 7fa585ea19c0 20 rados->read ofs=0 len=0 2024-09-14T11:17:37.238 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:17:37.242+0000 7fa585ea19c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:17:37.238 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:17:37.242+0000 7fa585ea19c0 20 rados->read ofs=0 len=0 2024-09-14T11:17:37.239 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:17:37.242+0000 7fa585ea19c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:17:37.240 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:17:37.242+0000 7fa585ea19c0 20 started sync module instance, tier type = 2024-09-14T11:17:37.240 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:17:37.242+0000 7fa585ea19c0 20 started zone id=d9e72d30-c60b-4d0d-9267-fdc36392d5ad (name=default) with tier type = 2024-09-14T11:17:37.264 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:17:37.266+0000 7fa585ea19c0 20 add_watcher() i=0 2024-09-14T11:17:37.264 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:17:37.266+0000 7fa585ea19c0 20 add_watcher() i=1 2024-09-14T11:17:37.264 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:17:37.266+0000 7fa585ea19c0 20 add_watcher() i=2 2024-09-14T11:17:37.264 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:17:37.266+0000 7fa585ea19c0 20 add_watcher() i=3 2024-09-14T11:17:37.265 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:17:37.266+0000 7fa585ea19c0 20 add_watcher() i=4 2024-09-14T11:17:37.265 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:17:37.266+0000 7fa585ea19c0 20 add_watcher() i=5 2024-09-14T11:17:37.265 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:17:37.266+0000 7fa585ea19c0 20 add_watcher() i=6 2024-09-14T11:17:37.266 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:17:37.270+0000 7fa585ea19c0 20 add_watcher() i=7 2024-09-14T11:17:37.267 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:17:37.270+0000 7fa585ea19c0 2 all 8 watchers are set, enabling cache 2024-09-14T11:17:37.271 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:17:37.274+0000 7fa439fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:17:37.272 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:17:37.274+0000 7fa585ea19c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:17:37.272 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:17:37.274+0000 7fa585ea19c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:17:37.272 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:17:37.274+0000 7fa585ea19c0 5 note: GC not initialized 2024-09-14T11:17:37.273 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:17:37.274+0000 7fa438fe1640 20 reqs_thread_entry: start 2024-09-14T11:17:37.273 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:17:37.274+0000 7fa585ea19c0 20 init_complete bucket index max shards: 11 2024-09-14T11:17:37.273 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:17:37.274+0000 7fa585ea19c0 20 Filter name: none 2024-09-14T11:17:37.273 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:17:37.274+0000 7fa3b27fc640 20 reqs_thread_entry: start 2024-09-14T11:17:37.274 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:17:37.274+0000 7fa585ea19c0 10 cache get: name=default.rgw.meta+users.uid+ceph-test-librgw-file : miss 2024-09-14T11:17:37.274 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:17:37.274+0000 7fa585ea19c0 20 rados->read ofs=0 len=0 2024-09-14T11:17:37.274 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:17:37.274+0000 7fa585ea19c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:17:37.275 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:17:37.274+0000 7fa585ea19c0 10 cache put: name=default.rgw.meta+users.uid+ceph-test-librgw-file info.flags=0x0 2024-09-14T11:17:37.275 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:17:37.274+0000 7fa585ea19c0 10 adding default.rgw.meta+users.uid+ceph-test-librgw-file to cache LRU end 2024-09-14T11:17:37.275 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:17:37.274+0000 7fa585ea19c0 10 cache get: name=default.rgw.meta+users.email+librgw@example.com : miss 2024-09-14T11:17:37.275 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:17:37.274+0000 7fa585ea19c0 20 rados->read ofs=0 len=0 2024-09-14T11:17:37.275 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:17:37.278+0000 7fa585ea19c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:17:37.275 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:17:37.278+0000 7fa585ea19c0 10 cache put: name=default.rgw.meta+users.email+librgw@example.com info.flags=0x0 2024-09-14T11:17:37.275 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:17:37.278+0000 7fa585ea19c0 10 adding default.rgw.meta+users.email+librgw@example.com to cache LRU end 2024-09-14T11:17:37.275 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:17:37.278+0000 7fa585ea19c0 10 cache get: name=default.rgw.meta+users.keys+PlXg8WsnSwIkHqq8qX2SpxgUVc4= : miss 2024-09-14T11:17:37.275 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:17:37.278+0000 7fa585ea19c0 20 rados->read ofs=0 len=0 2024-09-14T11:17:37.277 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:17:37.278+0000 7fa585ea19c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:17:37.277 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:17:37.278+0000 7fa585ea19c0 10 cache put: name=default.rgw.meta+users.keys+PlXg8WsnSwIkHqq8qX2SpxgUVc4= info.flags=0x0 2024-09-14T11:17:37.277 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:17:37.278+0000 7fa585ea19c0 10 adding default.rgw.meta+users.keys+PlXg8WsnSwIkHqq8qX2SpxgUVc4= to cache LRU end 2024-09-14T11:17:37.277 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:17:37.278+0000 7fa585ea19c0 10 cache get: name=default.rgw.meta+users.keys+PlXg8WsnSwIkHqq8qX2SpxgUVc4= : hit (negative entry) 2024-09-14T11:17:37.277 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:17:37.278+0000 7fa585ea19c0 10 cache get: name=default.rgw.meta+users.keys+PlXg8WsnSwIkHqq8qX2SpxgUVc4= : hit (negative entry) 2024-09-14T11:17:37.279 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:17:37.282+0000 7fa585ea19c0 10 cache put: name=default.rgw.meta+users.uid+ceph-test-librgw-file info.flags=0x17 2024-09-14T11:17:37.279 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:17:37.282+0000 7fa585ea19c0 10 moving default.rgw.meta+users.uid+ceph-test-librgw-file to cache LRU end 2024-09-14T11:17:37.279 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:17:37.282+0000 7fa585ea19c0 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:users.uid:ceph-test-librgw-file, ofs0, ns] 2024-09-14T11:17:37.280 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:17:37.282+0000 7fa462ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1086626725889 cookie 94641248831920 notifier 5454 bl.length()=697 2024-09-14T11:17:37.280 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:17:37.282+0000 7fa462ffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+ceph-test-librgw-file info.flags=0x17 2024-09-14T11:17:37.280 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:17:37.282+0000 7fa462ffd640 10 rgw watcher librados: moving default.rgw.meta+users.uid+ceph-test-librgw-file to cache LRU end 2024-09-14T11:17:37.284 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:17:37.286+0000 7fa585ea19c0 10 cache put: name=default.rgw.meta+users.email+librgw@example.com info.flags=0x7 2024-09-14T11:17:37.285 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:17:37.286+0000 7fa585ea19c0 10 moving default.rgw.meta+users.email+librgw@example.com to cache LRU end 2024-09-14T11:17:37.285 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:17:37.286+0000 7fa585ea19c0 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:users.email:librgw@example.com, ofs0, ns] 2024-09-14T11:17:37.285 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:17:37.286+0000 7fa462ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1086626725891 cookie 94641248824128 notifier 5454 bl.length()=194 2024-09-14T11:17:37.285 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:17:37.286+0000 7fa462ffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.email+librgw@example.com info.flags=0x7 2024-09-14T11:17:37.285 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:17:37.286+0000 7fa462ffd640 10 rgw watcher librados: moving default.rgw.meta+users.email+librgw@example.com to cache LRU end 2024-09-14T11:17:37.292 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:17:37.294+0000 7fa585ea19c0 10 cache put: name=default.rgw.meta+users.keys+PlXg8WsnSwIkHqq8qX2SpxgUVc4= info.flags=0x7 2024-09-14T11:17:37.292 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:17:37.294+0000 7fa585ea19c0 10 moving default.rgw.meta+users.keys+PlXg8WsnSwIkHqq8qX2SpxgUVc4= to cache LRU end 2024-09-14T11:17:37.292 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:17:37.294+0000 7fa585ea19c0 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 0, obj: default.rgw.meta:users.keys:PlXg8WsnSwIkHqq8qX2SpxgUVc4=, ofs0, ns] 2024-09-14T11:17:37.292 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:17:37.294+0000 7fa4627fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1086626725890 cookie 94641248835248 notifier 5454 bl.length()=203 2024-09-14T11:17:37.292 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:17:37.294+0000 7fa4627fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.keys+PlXg8WsnSwIkHqq8qX2SpxgUVc4= info.flags=0x7 2024-09-14T11:17:37.292 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:17:37.294+0000 7fa4627fc640 10 rgw watcher librados: moving default.rgw.meta+users.keys+PlXg8WsnSwIkHqq8qX2SpxgUVc4= to cache LRU end 2024-09-14T11:17:37.294 INFO:tasks.workunit.client.0.smithi138.stdout:{ 2024-09-14T11:17:37.294 INFO:tasks.workunit.client.0.smithi138.stdout: "user_id": "ceph-test-librgw-file", 2024-09-14T11:17:37.294 INFO:tasks.workunit.client.0.smithi138.stdout: "display_name": "librgw test user", 2024-09-14T11:17:37.294 INFO:tasks.workunit.client.0.smithi138.stdout: "email": "librgw@example.com", 2024-09-14T11:17:37.295 INFO:tasks.workunit.client.0.smithi138.stdout: "suspended": 0, 2024-09-14T11:17:37.295 INFO:tasks.workunit.client.0.smithi138.stdout: "max_buckets": 1000, 2024-09-14T11:17:37.295 INFO:tasks.workunit.client.0.smithi138.stdout: "subusers": [], 2024-09-14T11:17:37.295 INFO:tasks.workunit.client.0.smithi138.stdout: "keys": [ 2024-09-14T11:17:37.295 INFO:tasks.workunit.client.0.smithi138.stdout: { 2024-09-14T11:17:37.295 INFO:tasks.workunit.client.0.smithi138.stdout: "user": "ceph-test-librgw-file", 2024-09-14T11:17:37.295 INFO:tasks.workunit.client.0.smithi138.stdout: "access_key": "PlXg8WsnSwIkHqq8qX2SpxgUVc4=", 2024-09-14T11:17:37.295 INFO:tasks.workunit.client.0.smithi138.stdout: "secret_key": "ipeVRaFMYbfEuopX/B3961ftRZoHZs5X9uJEzMkTl7H2qbmDqU3ecQ==", 2024-09-14T11:17:37.295 INFO:tasks.workunit.client.0.smithi138.stdout: "active": true, 2024-09-14T11:17:37.295 INFO:tasks.workunit.client.0.smithi138.stdout: "create_date": "2024-09-14T11:17:37.281664Z" 2024-09-14T11:17:37.295 INFO:tasks.workunit.client.0.smithi138.stdout: } 2024-09-14T11:17:37.295 INFO:tasks.workunit.client.0.smithi138.stdout: ], 2024-09-14T11:17:37.296 INFO:tasks.workunit.client.0.smithi138.stdout: "swift_keys": [], 2024-09-14T11:17:37.296 INFO:tasks.workunit.client.0.smithi138.stdout: "caps": [], 2024-09-14T11:17:37.296 INFO:tasks.workunit.client.0.smithi138.stdout: "op_mask": "read, write, delete", 2024-09-14T11:17:37.296 INFO:tasks.workunit.client.0.smithi138.stdout: "default_placement": "", 2024-09-14T11:17:37.296 INFO:tasks.workunit.client.0.smithi138.stdout: "default_storage_class": "", 2024-09-14T11:17:37.296 INFO:tasks.workunit.client.0.smithi138.stdout: "placement_tags": [], 2024-09-14T11:17:37.296 INFO:tasks.workunit.client.0.smithi138.stdout: "bucket_quota": { 2024-09-14T11:17:37.296 INFO:tasks.workunit.client.0.smithi138.stdout: "enabled": false, 2024-09-14T11:17:37.296 INFO:tasks.workunit.client.0.smithi138.stdout: "check_on_raw": false, 2024-09-14T11:17:37.296 INFO:tasks.workunit.client.0.smithi138.stdout: "max_size": -1, 2024-09-14T11:17:37.296 INFO:tasks.workunit.client.0.smithi138.stdout: "max_size_kb": 0, 2024-09-14T11:17:37.296 INFO:tasks.workunit.client.0.smithi138.stdout: "max_objects": -1 2024-09-14T11:17:37.296 INFO:tasks.workunit.client.0.smithi138.stdout: }, 2024-09-14T11:17:37.296 INFO:tasks.workunit.client.0.smithi138.stdout: "user_quota": { 2024-09-14T11:17:37.297 INFO:tasks.workunit.client.0.smithi138.stdout: "enabled": false, 2024-09-14T11:17:37.297 INFO:tasks.workunit.client.0.smithi138.stdout: "check_on_raw": false, 2024-09-14T11:17:37.297 INFO:tasks.workunit.client.0.smithi138.stdout: "max_size": -1, 2024-09-14T11:17:37.297 INFO:tasks.workunit.client.0.smithi138.stdout: "max_size_kb": 0, 2024-09-14T11:17:37.297 INFO:tasks.workunit.client.0.smithi138.stdout: "max_objects": -1 2024-09-14T11:17:37.297 INFO:tasks.workunit.client.0.smithi138.stdout: }, 2024-09-14T11:17:37.297 INFO:tasks.workunit.client.0.smithi138.stdout: "temp_url_keys": [], 2024-09-14T11:17:37.297 INFO:tasks.workunit.client.0.smithi138.stdout: "type": "rgw", 2024-09-14T11:17:37.297 INFO:tasks.workunit.client.0.smithi138.stdout: "mfa_ids": [], 2024-09-14T11:17:37.297 INFO:tasks.workunit.client.0.smithi138.stdout: "account_id": "", 2024-09-14T11:17:37.297 INFO:tasks.workunit.client.0.smithi138.stdout: "path": "/", 2024-09-14T11:17:37.297 INFO:tasks.workunit.client.0.smithi138.stdout: "create_date": "2024-09-14T11:17:37.281639Z", 2024-09-14T11:17:37.297 INFO:tasks.workunit.client.0.smithi138.stdout: "tags": [], 2024-09-14T11:17:37.297 INFO:tasks.workunit.client.0.smithi138.stdout: "group_ids": [] 2024-09-14T11:17:37.297 INFO:tasks.workunit.client.0.smithi138.stdout:} 2024-09-14T11:17:37.297 INFO:tasks.workunit.client.0.smithi138.stdout: 2024-09-14T11:17:37.298 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:17:37.298+0000 7fa439fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:17:37.301 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:17:37.302+0000 7fa585ea19c0 20 remove_watcher() i=0 2024-09-14T11:17:37.301 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:17:37.302+0000 7fa585ea19c0 2 removed watcher, disabling cache 2024-09-14T11:17:37.304 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:17:37.306+0000 7fa585ea19c0 20 remove_watcher() i=1 2024-09-14T11:17:37.306 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:17:37.306+0000 7fa585ea19c0 20 remove_watcher() i=2 2024-09-14T11:17:37.308 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:17:37.310+0000 7fa585ea19c0 20 remove_watcher() i=3 2024-09-14T11:17:37.310 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:17:37.310+0000 7fa585ea19c0 20 remove_watcher() i=4 2024-09-14T11:17:37.312 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:17:37.314+0000 7fa585ea19c0 20 remove_watcher() i=5 2024-09-14T11:17:37.313 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:17:37.314+0000 7fa585ea19c0 20 remove_watcher() i=6 2024-09-14T11:17:37.315 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:17:37.318+0000 7fa585ea19c0 20 remove_watcher() i=7 2024-09-14T11:17:37.330 INFO:tasks.workunit.client.0.smithi138.stdout:phase 1.1 2024-09-14T11:17:37.351 INFO:tasks.workunit.client.0.smithi138.stdout:[==========] Running 24 tests from 1 test suite. 2024-09-14T11:17:37.351 INFO:tasks.workunit.client.0.smithi138.stdout:[----------] Global test environment set-up. 2024-09-14T11:17:37.351 INFO:tasks.workunit.client.0.smithi138.stdout:[----------] 24 tests from LibRGW 2024-09-14T11:17:37.351 INFO:tasks.workunit.client.0.smithi138.stdout:[ RUN ] LibRGW.INIT 2024-09-14T11:17:37.364 INFO:tasks.workunit.client.0.smithi138.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:17:37.364 INFO:tasks.workunit.client.0.smithi138.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:17:37.946 INFO:tasks.workunit.client.0.smithi138.stdout:[ OK ] LibRGW.INIT (596 ms) 2024-09-14T11:17:37.947 INFO:tasks.workunit.client.0.smithi138.stdout:[ RUN ] LibRGW.MOUNT_NOROOT 2024-09-14T11:17:37.949 INFO:tasks.workunit.client.0.smithi138.stdout:[ OK ] LibRGW.MOUNT_NOROOT (2 ms) 2024-09-14T11:17:37.949 INFO:tasks.workunit.client.0.smithi138.stdout:[ RUN ] LibRGW.MOUNT 2024-09-14T11:17:37.949 INFO:tasks.workunit.client.0.smithi138.stdout:[ OK ] LibRGW.MOUNT (0 ms) 2024-09-14T11:17:37.949 INFO:tasks.workunit.client.0.smithi138.stdout:[ RUN ] LibRGW.SETUP_HIER1 2024-09-14T11:17:37.970 INFO:tasks.workunit.client.0.smithi138.stdout:creating: nfsroot:foo/bar/baz/quux 2024-09-14T11:17:37.978 INFO:tasks.workunit.client.0.smithi138.stdout:creating: nfsroot:foo/f1 2024-09-14T11:17:37.984 INFO:tasks.workunit.client.0.smithi138.stdout:creating: nfsroot:foo/f2 2024-09-14T11:17:37.990 INFO:tasks.workunit.client.0.smithi138.stdout:creating: nfsroot:foo/bar/f1 2024-09-14T11:17:37.996 INFO:tasks.workunit.client.0.smithi138.stdout:creating: nfsroot:foo/bar/d1/ 2024-09-14T11:17:38.001 INFO:tasks.workunit.client.0.smithi138.stdout:creating: nfsroot:foo/bar/baz/hungry 2024-09-14T11:17:38.007 INFO:tasks.workunit.client.0.smithi138.stdout:creating: nfsroot:foo/bar/baz/hungry/ 2024-09-14T11:17:38.013 INFO:tasks.workunit.client.0.smithi138.stdout:creating: nfsroot:foo/bar/baz/momma 2024-09-14T11:17:38.019 INFO:tasks.workunit.client.0.smithi138.stdout:creating: nfsroot:foo/bar/baz/bear/ 2024-09-14T11:17:38.027 INFO:tasks.workunit.client.0.smithi138.stdout:creating: nfsroot:foo/bar/baz/sasquatch 2024-09-14T11:17:38.033 INFO:tasks.workunit.client.0.smithi138.stdout:creating: nfsroot:foo/bar/baz/sasquatch/ 2024-09-14T11:17:38.039 INFO:tasks.workunit.client.0.smithi138.stdout:creating: nfsroot:foo/bar/baz/frobozz 2024-09-14T11:17:38.045 INFO:tasks.workunit.client.0.smithi138.stdout:[ OK ] LibRGW.SETUP_HIER1 (96 ms) 2024-09-14T11:17:38.045 INFO:tasks.workunit.client.0.smithi138.stdout:[ RUN ] LibRGW.SETUP_DIRS1 2024-09-14T11:17:38.260 INFO:tasks.workunit.client.0.smithi138.stdout:[ OK ] LibRGW.SETUP_DIRS1 (215 ms) 2024-09-14T11:17:38.260 INFO:tasks.workunit.client.0.smithi138.stdout:[ RUN ] LibRGW.SETATTR 2024-09-14T11:17:38.260 INFO:tasks.workunit.client.0.smithi138.stdout:[ OK ] LibRGW.SETATTR (0 ms) 2024-09-14T11:17:38.261 INFO:tasks.workunit.client.0.smithi138.stdout:[ RUN ] LibRGW.RGW_CREATE_DIRS1 2024-09-14T11:17:38.298 INFO:tasks.workunit.client.0.smithi138.stdout:[ OK ] LibRGW.RGW_CREATE_DIRS1 (39 ms) 2024-09-14T11:17:38.298 INFO:tasks.workunit.client.0.smithi138.stdout:[ RUN ] LibRGW.RGW_SETUP_RENAME1 2024-09-14T11:17:38.397 INFO:tasks.workunit.client.0.smithi138.stdout:[ OK ] LibRGW.RGW_SETUP_RENAME1 (98 ms) 2024-09-14T11:17:38.397 INFO:tasks.workunit.client.0.smithi138.stdout:[ RUN ] LibRGW.RGW_INTRABUCKET_RENAME1 2024-09-14T11:17:38.397 INFO:tasks.workunit.client.0.smithi138.stdout:rename file rfile_0 to rfile_r0 (bucket brename0) 2024-09-14T11:17:38.411 INFO:tasks.workunit.client.0.smithi138.stdout:[ OK ] LibRGW.RGW_INTRABUCKET_RENAME1 (14 ms) 2024-09-14T11:17:38.411 INFO:tasks.workunit.client.0.smithi138.stdout:[ RUN ] LibRGW.RGW_CROSSBUCKET_RENAME1 2024-09-14T11:17:38.411 INFO:tasks.workunit.client.0.smithi138.stdout:rename file rfile_1 (bucket brename0) to rfile_rhilldog (bucket brename1) 2024-09-14T11:17:38.425 INFO:tasks.workunit.client.0.smithi138.stdout:[ OK ] LibRGW.RGW_CROSSBUCKET_RENAME1 (14 ms) 2024-09-14T11:17:38.425 INFO:tasks.workunit.client.0.smithi138.stdout:[ RUN ] LibRGW.GETATTR_DIRS1 2024-09-14T11:17:38.425 INFO:tasks.workunit.client.0.smithi138.stdout:scanning objects in /bdirs1/dir_0 2024-09-14T11:17:38.425 INFO:tasks.workunit.client.0.smithi138.stdout: /bdirs1/dir_0/sdir_0 (sdir_0): DIR mode: 17139 nlinks: 1 2024-09-14T11:17:38.425 INFO:tasks.workunit.client.0.smithi138.stdout: /bdirs1/dir_0/sfile_0 (sfile_0): FILE mode: 33412 size: 16 2024-09-14T11:17:38.425 INFO:tasks.workunit.client.0.smithi138.stdout: /bdirs1/dir_0/sdir_1 (sdir_1): DIR mode: 17139 nlinks: 1 2024-09-14T11:17:38.425 INFO:tasks.workunit.client.0.smithi138.stdout: /bdirs1/dir_0/sfile_1 (sfile_1): FILE mode: 33412 size: 16 2024-09-14T11:17:38.425 INFO:tasks.workunit.client.0.smithi138.stdout:scanning objects in /bdirs1/dir_1 2024-09-14T11:17:38.425 INFO:tasks.workunit.client.0.smithi138.stdout: /bdirs1/dir_1/sdir_0 (sdir_0): DIR mode: 17139 nlinks: 1 2024-09-14T11:17:38.425 INFO:tasks.workunit.client.0.smithi138.stdout: /bdirs1/dir_1/sfile_0 (sfile_0): FILE mode: 33412 size: 16 2024-09-14T11:17:38.426 INFO:tasks.workunit.client.0.smithi138.stdout: /bdirs1/dir_1/sdir_1 (sdir_1): DIR mode: 17139 nlinks: 1 2024-09-14T11:17:38.426 INFO:tasks.workunit.client.0.smithi138.stdout: /bdirs1/dir_1/sfile_1 (sfile_1): FILE mode: 33412 size: 16 2024-09-14T11:17:38.426 INFO:tasks.workunit.client.0.smithi138.stdout:scanning objects in /bdirs1/dir_2 2024-09-14T11:17:38.426 INFO:tasks.workunit.client.0.smithi138.stdout: /bdirs1/dir_2/sdir_0 (sdir_0): DIR mode: 17139 nlinks: 1 2024-09-14T11:17:38.426 INFO:tasks.workunit.client.0.smithi138.stdout: /bdirs1/dir_2/sfile_0 (sfile_0): FILE mode: 33412 size: 16 2024-09-14T11:17:38.426 INFO:tasks.workunit.client.0.smithi138.stdout: /bdirs1/dir_2/sdir_1 (sdir_1): DIR mode: 17139 nlinks: 1 2024-09-14T11:17:38.426 INFO:tasks.workunit.client.0.smithi138.stdout: /bdirs1/dir_2/sfile_1 (sfile_1): FILE mode: 33412 size: 16 2024-09-14T11:17:38.426 INFO:tasks.workunit.client.0.smithi138.stdout:[ OK ] LibRGW.GETATTR_DIRS1 (0 ms) 2024-09-14T11:17:38.426 INFO:tasks.workunit.client.0.smithi138.stdout:[ RUN ] LibRGW.READ_DIRS1 2024-09-14T11:17:38.426 INFO:tasks.workunit.client.0.smithi138.stdout:read back objects in /bdirs1/dir_0 2024-09-14T11:17:38.426 INFO:tasks.workunit.client.0.smithi138.stdout:reading 0,256 dir_0/sfile_0 2024-09-14T11:17:38.428 INFO:tasks.workunit.client.0.smithi138.stdout: read back from sfile_0 : "data for sfile_0" 2024-09-14T11:17:38.428 INFO:tasks.workunit.client.0.smithi138.stdout:reading 0,256 dir_0/sfile_1 2024-09-14T11:17:38.431 INFO:tasks.workunit.client.0.smithi138.stdout: read back from sfile_1 : "data for sfile_1" 2024-09-14T11:17:38.431 INFO:tasks.workunit.client.0.smithi138.stdout:read back objects in /bdirs1/dir_1 2024-09-14T11:17:38.431 INFO:tasks.workunit.client.0.smithi138.stdout:reading 0,256 dir_1/sfile_0 2024-09-14T11:17:38.434 INFO:tasks.workunit.client.0.smithi138.stdout: read back from sfile_0 : "data for sfile_0" 2024-09-14T11:17:38.435 INFO:tasks.workunit.client.0.smithi138.stdout:reading 0,256 dir_1/sfile_1 2024-09-14T11:17:38.438 INFO:tasks.workunit.client.0.smithi138.stdout: read back from sfile_1 : "data for sfile_1" 2024-09-14T11:17:38.438 INFO:tasks.workunit.client.0.smithi138.stdout:read back objects in /bdirs1/dir_2 2024-09-14T11:17:38.438 INFO:tasks.workunit.client.0.smithi138.stdout:reading 0,256 dir_2/sfile_0 2024-09-14T11:17:38.441 INFO:tasks.workunit.client.0.smithi138.stdout: read back from sfile_0 : "data for sfile_0" 2024-09-14T11:17:38.441 INFO:tasks.workunit.client.0.smithi138.stdout:reading 0,256 dir_2/sfile_1 2024-09-14T11:17:38.445 INFO:tasks.workunit.client.0.smithi138.stdout: read back from sfile_1 : "data for sfile_1" 2024-09-14T11:17:38.445 INFO:tasks.workunit.client.0.smithi138.stdout:[ OK ] LibRGW.READ_DIRS1 (20 ms) 2024-09-14T11:17:38.445 INFO:tasks.workunit.client.0.smithi138.stdout:[ RUN ] LibRGW.READF_SETUP1 2024-09-14T11:17:38.645 INFO:tasks.workunit.client.0.smithi138.stdout:[ OK ] LibRGW.READF_SETUP1 (200 ms) 2024-09-14T11:17:38.645 INFO:tasks.workunit.client.0.smithi138.stdout:[ RUN ] LibRGW.READF_DIRS1 2024-09-14T11:17:38.646 INFO:tasks.workunit.client.0.smithi138.stdout:[ OK ] LibRGW.READF_DIRS1 (0 ms) 2024-09-14T11:17:38.646 INFO:tasks.workunit.client.0.smithi138.stdout:[ RUN ] LibRGW.WRITEF_DIRS1 2024-09-14T11:17:38.646 INFO:tasks.workunit.client.0.smithi138.stdout:[ OK ] LibRGW.WRITEF_DIRS1 (0 ms) 2024-09-14T11:17:38.646 INFO:tasks.workunit.client.0.smithi138.stdout:[ RUN ] LibRGW.RELEASE_DIRS1 2024-09-14T11:17:38.646 INFO:tasks.workunit.client.0.smithi138.stdout:release sdir_0 type: DIR refs: 2 2024-09-14T11:17:38.646 INFO:tasks.workunit.client.0.smithi138.stdout:release sfile_0 type: FILE refs: 2 2024-09-14T11:17:38.646 INFO:tasks.workunit.client.0.smithi138.stdout:release sdir_1 type: DIR refs: 2 2024-09-14T11:17:38.646 INFO:tasks.workunit.client.0.smithi138.stdout:release sfile_1 type: FILE refs: 2 2024-09-14T11:17:38.646 INFO:tasks.workunit.client.0.smithi138.stdout:release sdir_0 type: DIR refs: 2 2024-09-14T11:17:38.646 INFO:tasks.workunit.client.0.smithi138.stdout:release sfile_0 type: FILE refs: 2 2024-09-14T11:17:38.646 INFO:tasks.workunit.client.0.smithi138.stdout:release sdir_1 type: DIR refs: 2 2024-09-14T11:17:38.646 INFO:tasks.workunit.client.0.smithi138.stdout:release sfile_1 type: FILE refs: 2 2024-09-14T11:17:38.646 INFO:tasks.workunit.client.0.smithi138.stdout:release sdir_0 type: DIR refs: 2 2024-09-14T11:17:38.646 INFO:tasks.workunit.client.0.smithi138.stdout:release sfile_0 type: FILE refs: 2 2024-09-14T11:17:38.646 INFO:tasks.workunit.client.0.smithi138.stdout:release sdir_1 type: DIR refs: 2 2024-09-14T11:17:38.647 INFO:tasks.workunit.client.0.smithi138.stdout:release sfile_1 type: FILE refs: 2 2024-09-14T11:17:38.647 INFO:tasks.workunit.client.0.smithi138.stdout:[ OK ] LibRGW.RELEASE_DIRS1 (0 ms) 2024-09-14T11:17:38.647 INFO:tasks.workunit.client.0.smithi138.stdout:[ RUN ] LibRGW.HIER1 2024-09-14T11:17:38.661 INFO:tasks.workunit.client.0.smithi138.stdout:/nfsroot/foo/f2 (f2): FILE 2024-09-14T11:17:38.662 INFO:tasks.workunit.client.0.smithi138.stdout:/nfsroot/foo/f1 (f1): FILE 2024-09-14T11:17:38.668 INFO:tasks.workunit.client.0.smithi138.stdout:/nfsroot/foo/bar/f1 (f1): FILE 2024-09-14T11:17:38.671 INFO:tasks.workunit.client.0.smithi138.stdout:/nfsroot/foo/bar/d1 (d1): DIR 2024-09-14T11:17:38.677 INFO:tasks.workunit.client.0.smithi138.stdout:/nfsroot/foo/bar/baz/sasquatch (sasquatch): FILE 2024-09-14T11:17:38.678 INFO:tasks.workunit.client.0.smithi138.stdout:/nfsroot/foo/bar/baz/sasquatch (sasquatch): FILE 2024-09-14T11:17:38.678 INFO:tasks.workunit.client.0.smithi138.stdout:/nfsroot/foo/bar/baz/quux (quux): FILE 2024-09-14T11:17:38.679 INFO:tasks.workunit.client.0.smithi138.stdout:/nfsroot/foo/bar/baz/momma (momma): FILE 2024-09-14T11:17:38.680 INFO:tasks.workunit.client.0.smithi138.stdout:/nfsroot/foo/bar/baz/hungry (hungry): FILE 2024-09-14T11:17:38.681 INFO:tasks.workunit.client.0.smithi138.stdout:/nfsroot/foo/bar/baz/hungry (hungry): FILE 2024-09-14T11:17:38.682 INFO:tasks.workunit.client.0.smithi138.stdout:/nfsroot/foo/bar/baz/frobozz (frobozz): FILE 2024-09-14T11:17:38.686 INFO:tasks.workunit.client.0.smithi138.stdout:/nfsroot/foo/bar/baz/bear (bear): DIR 2024-09-14T11:17:38.686 INFO:tasks.workunit.client.0.smithi138.stdout:/nfsroot/foo/bar/baz (baz): DIR 2024-09-14T11:17:38.686 INFO:tasks.workunit.client.0.smithi138.stdout:/nfsroot/foo/bar (bar): DIR 2024-09-14T11:17:38.686 INFO:tasks.workunit.client.0.smithi138.stdout:/nfsroot/foo (foo): DIR 2024-09-14T11:17:38.686 INFO:tasks.workunit.client.0.smithi138.stdout:/nfsroot (nfsroot): DIR 2024-09-14T11:17:38.686 INFO:tasks.workunit.client.0.smithi138.stdout:[ OK ] LibRGW.HIER1 (41 ms) 2024-09-14T11:17:38.686 INFO:tasks.workunit.client.0.smithi138.stdout:[ RUN ] LibRGW.MARKER1_SETUP_BUCKET 2024-09-14T11:17:38.686 INFO:tasks.workunit.client.0.smithi138.stdout:[ OK ] LibRGW.MARKER1_SETUP_BUCKET (0 ms) 2024-09-14T11:17:38.686 INFO:tasks.workunit.client.0.smithi138.stdout:[ RUN ] LibRGW.MARKER1_SETUP_OBJECTS 2024-09-14T11:17:38.686 INFO:tasks.workunit.client.0.smithi138.stdout:[ OK ] LibRGW.MARKER1_SETUP_OBJECTS (0 ms) 2024-09-14T11:17:38.686 INFO:tasks.workunit.client.0.smithi138.stdout:[ RUN ] LibRGW.MARKER1_READDIR 2024-09-14T11:17:38.686 INFO:tasks.workunit.client.0.smithi138.stdout:[ OK ] LibRGW.MARKER1_READDIR (0 ms) 2024-09-14T11:17:38.686 INFO:tasks.workunit.client.0.smithi138.stdout:[ RUN ] LibRGW.MARKER1_OBJ_CLEANUP 2024-09-14T11:17:38.687 INFO:tasks.workunit.client.0.smithi138.stdout:[ OK ] LibRGW.MARKER1_OBJ_CLEANUP (0 ms) 2024-09-14T11:17:38.687 INFO:tasks.workunit.client.0.smithi138.stdout:[ RUN ] LibRGW.CLEANUP 2024-09-14T11:17:38.687 INFO:tasks.workunit.client.0.smithi138.stdout:[ OK ] LibRGW.CLEANUP (0 ms) 2024-09-14T11:17:38.687 INFO:tasks.workunit.client.0.smithi138.stdout:[ RUN ] LibRGW.UMOUNT 2024-09-14T11:17:38.687 INFO:tasks.workunit.client.0.smithi138.stdout:[ OK ] LibRGW.UMOUNT (0 ms) 2024-09-14T11:17:38.687 INFO:tasks.workunit.client.0.smithi138.stdout:[ RUN ] LibRGW.SHUTDOWN 2024-09-14T11:17:38.687 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:17:38.686+0000 7fc3513e5a80 -1 shutting down 2024-09-14T11:17:38.689 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:17:38.690+0000 7fc22b137640 -1 received signal: User defined signal 1, si_code : -6, si_value (int): 0, si_value (ptr): 0, si_errno: 0, si_pid : 55981, si_uid : 1000, si_addr0x3e80000daad, si_status0 2024-09-14T11:18:08.171 INFO:tasks.workunit.client.0.smithi138.stdout:[ OK ] LibRGW.SHUTDOWN (29485 ms) 2024-09-14T11:18:08.171 INFO:tasks.workunit.client.0.smithi138.stdout:[----------] 24 tests from LibRGW (30820 ms total) 2024-09-14T11:18:08.171 INFO:tasks.workunit.client.0.smithi138.stdout: 2024-09-14T11:18:08.171 INFO:tasks.workunit.client.0.smithi138.stdout:[----------] Global test environment tear-down 2024-09-14T11:18:08.171 INFO:tasks.workunit.client.0.smithi138.stdout:[==========] 24 tests from 1 test suite ran. (30820 ms total) 2024-09-14T11:18:08.171 INFO:tasks.workunit.client.0.smithi138.stdout:[ PASSED ] 24 tests. 2024-09-14T11:18:08.185 INFO:tasks.workunit.client.0.smithi138.stdout:phase 1.2 2024-09-14T11:18:08.207 INFO:tasks.workunit.client.0.smithi138.stdout:[==========] Running 24 tests from 1 test suite. 2024-09-14T11:18:08.208 INFO:tasks.workunit.client.0.smithi138.stdout:[----------] Global test environment set-up. 2024-09-14T11:18:08.208 INFO:tasks.workunit.client.0.smithi138.stdout:[----------] 24 tests from LibRGW 2024-09-14T11:18:08.208 INFO:tasks.workunit.client.0.smithi138.stdout:[ RUN ] LibRGW.INIT 2024-09-14T11:18:08.218 INFO:tasks.workunit.client.0.smithi138.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:18:08.218 INFO:tasks.workunit.client.0.smithi138.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:18:08.771 INFO:tasks.workunit.client.0.smithi138.stdout:[ OK ] LibRGW.INIT (563 ms) 2024-09-14T11:18:08.771 INFO:tasks.workunit.client.0.smithi138.stdout:[ RUN ] LibRGW.MOUNT_NOROOT 2024-09-14T11:18:08.773 INFO:tasks.workunit.client.0.smithi138.stdout:[ OK ] LibRGW.MOUNT_NOROOT (2 ms) 2024-09-14T11:18:08.773 INFO:tasks.workunit.client.0.smithi138.stdout:[ RUN ] LibRGW.MOUNT 2024-09-14T11:18:08.773 INFO:tasks.workunit.client.0.smithi138.stdout:[ OK ] LibRGW.MOUNT (0 ms) 2024-09-14T11:18:08.774 INFO:tasks.workunit.client.0.smithi138.stdout:[ RUN ] LibRGW.SETUP_HIER1 2024-09-14T11:18:08.774 INFO:tasks.workunit.client.0.smithi138.stdout:[ OK ] LibRGW.SETUP_HIER1 (0 ms) 2024-09-14T11:18:08.774 INFO:tasks.workunit.client.0.smithi138.stdout:[ RUN ] LibRGW.SETUP_DIRS1 2024-09-14T11:18:08.774 INFO:tasks.workunit.client.0.smithi138.stdout:[ OK ] LibRGW.SETUP_DIRS1 (0 ms) 2024-09-14T11:18:08.774 INFO:tasks.workunit.client.0.smithi138.stdout:[ RUN ] LibRGW.SETATTR 2024-09-14T11:18:08.774 INFO:tasks.workunit.client.0.smithi138.stdout:[ OK ] LibRGW.SETATTR (0 ms) 2024-09-14T11:18:08.774 INFO:tasks.workunit.client.0.smithi138.stdout:[ RUN ] LibRGW.RGW_CREATE_DIRS1 2024-09-14T11:18:08.774 INFO:tasks.workunit.client.0.smithi138.stdout:[ OK ] LibRGW.RGW_CREATE_DIRS1 (0 ms) 2024-09-14T11:18:08.774 INFO:tasks.workunit.client.0.smithi138.stdout:[ RUN ] LibRGW.RGW_SETUP_RENAME1 2024-09-14T11:18:08.774 INFO:tasks.workunit.client.0.smithi138.stdout:[ OK ] LibRGW.RGW_SETUP_RENAME1 (0 ms) 2024-09-14T11:18:08.774 INFO:tasks.workunit.client.0.smithi138.stdout:[ RUN ] LibRGW.RGW_INTRABUCKET_RENAME1 2024-09-14T11:18:08.774 INFO:tasks.workunit.client.0.smithi138.stdout:[ OK ] LibRGW.RGW_INTRABUCKET_RENAME1 (0 ms) 2024-09-14T11:18:08.774 INFO:tasks.workunit.client.0.smithi138.stdout:[ RUN ] LibRGW.RGW_CROSSBUCKET_RENAME1 2024-09-14T11:18:08.774 INFO:tasks.workunit.client.0.smithi138.stdout:[ OK ] LibRGW.RGW_CROSSBUCKET_RENAME1 (0 ms) 2024-09-14T11:18:08.775 INFO:tasks.workunit.client.0.smithi138.stdout:[ RUN ] LibRGW.GETATTR_DIRS1 2024-09-14T11:18:08.775 INFO:tasks.workunit.client.0.smithi138.stdout:[ OK ] LibRGW.GETATTR_DIRS1 (0 ms) 2024-09-14T11:18:08.775 INFO:tasks.workunit.client.0.smithi138.stdout:[ RUN ] LibRGW.READ_DIRS1 2024-09-14T11:18:08.775 INFO:tasks.workunit.client.0.smithi138.stdout:[ OK ] LibRGW.READ_DIRS1 (0 ms) 2024-09-14T11:18:08.775 INFO:tasks.workunit.client.0.smithi138.stdout:[ RUN ] LibRGW.READF_SETUP1 2024-09-14T11:18:08.775 INFO:tasks.workunit.client.0.smithi138.stdout:[ OK ] LibRGW.READF_SETUP1 (0 ms) 2024-09-14T11:18:08.775 INFO:tasks.workunit.client.0.smithi138.stdout:[ RUN ] LibRGW.READF_DIRS1 2024-09-14T11:18:08.775 INFO:tasks.workunit.client.0.smithi138.stdout:[ OK ] LibRGW.READF_DIRS1 (0 ms) 2024-09-14T11:18:08.775 INFO:tasks.workunit.client.0.smithi138.stdout:[ RUN ] LibRGW.WRITEF_DIRS1 2024-09-14T11:18:08.775 INFO:tasks.workunit.client.0.smithi138.stdout:[ OK ] LibRGW.WRITEF_DIRS1 (0 ms) 2024-09-14T11:18:08.775 INFO:tasks.workunit.client.0.smithi138.stdout:[ RUN ] LibRGW.RELEASE_DIRS1 2024-09-14T11:18:08.775 INFO:tasks.workunit.client.0.smithi138.stdout:[ OK ] LibRGW.RELEASE_DIRS1 (0 ms) 2024-09-14T11:18:08.775 INFO:tasks.workunit.client.0.smithi138.stdout:[ RUN ] LibRGW.HIER1 2024-09-14T11:18:08.775 INFO:tasks.workunit.client.0.smithi138.stdout:[ OK ] LibRGW.HIER1 (0 ms) 2024-09-14T11:18:08.775 INFO:tasks.workunit.client.0.smithi138.stdout:[ RUN ] LibRGW.MARKER1_SETUP_BUCKET 2024-09-14T11:18:08.776 INFO:tasks.workunit.client.0.smithi138.stdout:[ OK ] LibRGW.MARKER1_SETUP_BUCKET (0 ms) 2024-09-14T11:18:08.776 INFO:tasks.workunit.client.0.smithi138.stdout:[ RUN ] LibRGW.MARKER1_SETUP_OBJECTS 2024-09-14T11:18:08.776 INFO:tasks.workunit.client.0.smithi138.stdout:[ OK ] LibRGW.MARKER1_SETUP_OBJECTS (0 ms) 2024-09-14T11:18:08.776 INFO:tasks.workunit.client.0.smithi138.stdout:[ RUN ] LibRGW.MARKER1_READDIR 2024-09-14T11:18:08.776 INFO:tasks.workunit.client.0.smithi138.stdout:[ OK ] LibRGW.MARKER1_READDIR (0 ms) 2024-09-14T11:18:08.776 INFO:tasks.workunit.client.0.smithi138.stdout:[ RUN ] LibRGW.MARKER1_OBJ_CLEANUP 2024-09-14T11:18:08.776 INFO:tasks.workunit.client.0.smithi138.stdout:[ OK ] LibRGW.MARKER1_OBJ_CLEANUP (0 ms) 2024-09-14T11:18:08.776 INFO:tasks.workunit.client.0.smithi138.stdout:[ RUN ] LibRGW.CLEANUP 2024-09-14T11:18:08.776 INFO:tasks.workunit.client.0.smithi138.stdout:[ OK ] LibRGW.CLEANUP (0 ms) 2024-09-14T11:18:08.776 INFO:tasks.workunit.client.0.smithi138.stdout:[ RUN ] LibRGW.UMOUNT 2024-09-14T11:18:08.776 INFO:tasks.workunit.client.0.smithi138.stdout:[ OK ] LibRGW.UMOUNT (0 ms) 2024-09-14T11:18:08.776 INFO:tasks.workunit.client.0.smithi138.stdout:[ RUN ] LibRGW.SHUTDOWN 2024-09-14T11:18:08.777 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:18:08.774+0000 7f7bc8fd6a80 -1 shutting down 2024-09-14T11:18:08.777 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:18:08.778+0000 7f7aa2d28640 -1 received signal: User defined signal 1, si_code : -6, si_value (int): 0, si_value (ptr): 0, si_errno: 0, si_pid : 56628, si_uid : 1000, si_addr0x3e80000dd34, si_status0 2024-09-14T11:18:38.840 INFO:tasks.workunit.client.0.smithi138.stdout:[ OK ] LibRGW.SHUTDOWN (30067 ms) 2024-09-14T11:18:38.840 INFO:tasks.workunit.client.0.smithi138.stdout:[----------] 24 tests from LibRGW (30632 ms total) 2024-09-14T11:18:38.840 INFO:tasks.workunit.client.0.smithi138.stdout: 2024-09-14T11:18:38.840 INFO:tasks.workunit.client.0.smithi138.stdout:[----------] Global test environment tear-down 2024-09-14T11:18:38.840 INFO:tasks.workunit.client.0.smithi138.stdout:[==========] 24 tests from 1 test suite ran. (30632 ms total) 2024-09-14T11:18:38.840 INFO:tasks.workunit.client.0.smithi138.stdout:[ PASSED ] 24 tests. 2024-09-14T11:18:38.851 INFO:tasks.workunit.client.0.smithi138.stdout:phase 1.3 2024-09-14T11:18:38.876 INFO:tasks.workunit.client.0.smithi138.stdout:[==========] Running 24 tests from 1 test suite. 2024-09-14T11:18:38.876 INFO:tasks.workunit.client.0.smithi138.stdout:[----------] Global test environment set-up. 2024-09-14T11:18:38.876 INFO:tasks.workunit.client.0.smithi138.stdout:[----------] 24 tests from LibRGW 2024-09-14T11:18:38.876 INFO:tasks.workunit.client.0.smithi138.stdout:[ RUN ] LibRGW.INIT 2024-09-14T11:18:38.889 INFO:tasks.workunit.client.0.smithi138.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:18:38.889 INFO:tasks.workunit.client.0.smithi138.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:18:39.450 INFO:tasks.workunit.client.0.smithi138.stdout:[ OK ] LibRGW.INIT (574 ms) 2024-09-14T11:18:39.451 INFO:tasks.workunit.client.0.smithi138.stdout:[ RUN ] LibRGW.MOUNT_NOROOT 2024-09-14T11:18:39.452 INFO:tasks.workunit.client.0.smithi138.stdout:[ OK ] LibRGW.MOUNT_NOROOT (2 ms) 2024-09-14T11:18:39.452 INFO:tasks.workunit.client.0.smithi138.stdout:[ RUN ] LibRGW.MOUNT 2024-09-14T11:18:39.452 INFO:tasks.workunit.client.0.smithi138.stdout:[ OK ] LibRGW.MOUNT (0 ms) 2024-09-14T11:18:39.452 INFO:tasks.workunit.client.0.smithi138.stdout:[ RUN ] LibRGW.SETUP_HIER1 2024-09-14T11:18:39.460 INFO:tasks.workunit.client.0.smithi138.stdout:[ OK ] LibRGW.SETUP_HIER1 (9 ms) 2024-09-14T11:18:39.461 INFO:tasks.workunit.client.0.smithi138.stdout:[ RUN ] LibRGW.SETUP_DIRS1 2024-09-14T11:18:39.578 INFO:tasks.workunit.client.0.smithi138.stdout:[ OK ] LibRGW.SETUP_DIRS1 (117 ms) 2024-09-14T11:18:39.578 INFO:tasks.workunit.client.0.smithi138.stdout:[ RUN ] LibRGW.SETATTR 2024-09-14T11:18:39.578 INFO:tasks.workunit.client.0.smithi138.stdout:[ OK ] LibRGW.SETATTR (0 ms) 2024-09-14T11:18:39.578 INFO:tasks.workunit.client.0.smithi138.stdout:[ RUN ] LibRGW.RGW_CREATE_DIRS1 2024-09-14T11:18:39.578 INFO:tasks.workunit.client.0.smithi138.stdout:[ OK ] LibRGW.RGW_CREATE_DIRS1 (0 ms) 2024-09-14T11:18:39.578 INFO:tasks.workunit.client.0.smithi138.stdout:[ RUN ] LibRGW.RGW_SETUP_RENAME1 2024-09-14T11:18:39.578 INFO:tasks.workunit.client.0.smithi138.stdout:[ OK ] LibRGW.RGW_SETUP_RENAME1 (0 ms) 2024-09-14T11:18:39.578 INFO:tasks.workunit.client.0.smithi138.stdout:[ RUN ] LibRGW.RGW_INTRABUCKET_RENAME1 2024-09-14T11:18:39.578 INFO:tasks.workunit.client.0.smithi138.stdout:[ OK ] LibRGW.RGW_INTRABUCKET_RENAME1 (0 ms) 2024-09-14T11:18:39.578 INFO:tasks.workunit.client.0.smithi138.stdout:[ RUN ] LibRGW.RGW_CROSSBUCKET_RENAME1 2024-09-14T11:18:39.578 INFO:tasks.workunit.client.0.smithi138.stdout:[ OK ] LibRGW.RGW_CROSSBUCKET_RENAME1 (0 ms) 2024-09-14T11:18:39.579 INFO:tasks.workunit.client.0.smithi138.stdout:[ RUN ] LibRGW.GETATTR_DIRS1 2024-09-14T11:18:39.579 INFO:tasks.workunit.client.0.smithi138.stdout:scanning objects in /bdirs1/dir_0 2024-09-14T11:18:39.579 INFO:tasks.workunit.client.0.smithi138.stdout: /bdirs1/dir_0/sdir_0 (sdir_0): DIR mode: 17139 nlinks: 1 2024-09-14T11:18:39.579 INFO:tasks.workunit.client.0.smithi138.stdout: /bdirs1/dir_0/sfile_0 (sfile_0): FILE mode: 33412 size: 16 2024-09-14T11:18:39.579 INFO:tasks.workunit.client.0.smithi138.stdout: /bdirs1/dir_0/sdir_1 (sdir_1): DIR mode: 17139 nlinks: 1 2024-09-14T11:18:39.579 INFO:tasks.workunit.client.0.smithi138.stdout: /bdirs1/dir_0/sfile_1 (sfile_1): FILE mode: 33412 size: 16 2024-09-14T11:18:39.579 INFO:tasks.workunit.client.0.smithi138.stdout:scanning objects in /bdirs1/dir_1 2024-09-14T11:18:39.579 INFO:tasks.workunit.client.0.smithi138.stdout: /bdirs1/dir_1/sdir_0 (sdir_0): DIR mode: 17139 nlinks: 1 2024-09-14T11:18:39.579 INFO:tasks.workunit.client.0.smithi138.stdout: /bdirs1/dir_1/sfile_0 (sfile_0): FILE mode: 33412 size: 16 2024-09-14T11:18:39.579 INFO:tasks.workunit.client.0.smithi138.stdout: /bdirs1/dir_1/sdir_1 (sdir_1): DIR mode: 17139 nlinks: 1 2024-09-14T11:18:39.579 INFO:tasks.workunit.client.0.smithi138.stdout: /bdirs1/dir_1/sfile_1 (sfile_1): FILE mode: 33412 size: 16 2024-09-14T11:18:39.579 INFO:tasks.workunit.client.0.smithi138.stdout:scanning objects in /bdirs1/dir_2 2024-09-14T11:18:39.579 INFO:tasks.workunit.client.0.smithi138.stdout: /bdirs1/dir_2/sdir_0 (sdir_0): DIR mode: 17139 nlinks: 1 2024-09-14T11:18:39.579 INFO:tasks.workunit.client.0.smithi138.stdout: /bdirs1/dir_2/sfile_0 (sfile_0): FILE mode: 33412 size: 16 2024-09-14T11:18:39.579 INFO:tasks.workunit.client.0.smithi138.stdout: /bdirs1/dir_2/sdir_1 (sdir_1): DIR mode: 17139 nlinks: 1 2024-09-14T11:18:39.580 INFO:tasks.workunit.client.0.smithi138.stdout: /bdirs1/dir_2/sfile_1 (sfile_1): FILE mode: 33412 size: 16 2024-09-14T11:18:39.580 INFO:tasks.workunit.client.0.smithi138.stdout:[ OK ] LibRGW.GETATTR_DIRS1 (0 ms) 2024-09-14T11:18:39.580 INFO:tasks.workunit.client.0.smithi138.stdout:[ RUN ] LibRGW.READ_DIRS1 2024-09-14T11:18:39.580 INFO:tasks.workunit.client.0.smithi138.stdout:read back objects in /bdirs1/dir_0 2024-09-14T11:18:39.580 INFO:tasks.workunit.client.0.smithi138.stdout:reading 0,256 dir_0/sfile_0 2024-09-14T11:18:39.581 INFO:tasks.workunit.client.0.smithi138.stdout: read back from sfile_0 : "data for sfile_0" 2024-09-14T11:18:39.581 INFO:tasks.workunit.client.0.smithi138.stdout:reading 0,256 dir_0/sfile_1 2024-09-14T11:18:39.584 INFO:tasks.workunit.client.0.smithi138.stdout: read back from sfile_1 : "data for sfile_1" 2024-09-14T11:18:39.584 INFO:tasks.workunit.client.0.smithi138.stdout:read back objects in /bdirs1/dir_1 2024-09-14T11:18:39.584 INFO:tasks.workunit.client.0.smithi138.stdout:reading 0,256 dir_1/sfile_0 2024-09-14T11:18:39.587 INFO:tasks.workunit.client.0.smithi138.stdout: read back from sfile_0 : "data for sfile_0" 2024-09-14T11:18:39.587 INFO:tasks.workunit.client.0.smithi138.stdout:reading 0,256 dir_1/sfile_1 2024-09-14T11:18:39.590 INFO:tasks.workunit.client.0.smithi138.stdout: read back from sfile_1 : "data for sfile_1" 2024-09-14T11:18:39.590 INFO:tasks.workunit.client.0.smithi138.stdout:read back objects in /bdirs1/dir_2 2024-09-14T11:18:39.590 INFO:tasks.workunit.client.0.smithi138.stdout:reading 0,256 dir_2/sfile_0 2024-09-14T11:18:39.594 INFO:tasks.workunit.client.0.smithi138.stdout: read back from sfile_0 : "data for sfile_0" 2024-09-14T11:18:39.594 INFO:tasks.workunit.client.0.smithi138.stdout:reading 0,256 dir_2/sfile_1 2024-09-14T11:18:39.597 INFO:tasks.workunit.client.0.smithi138.stdout: read back from sfile_1 : "data for sfile_1" 2024-09-14T11:18:39.597 INFO:tasks.workunit.client.0.smithi138.stdout:[ OK ] LibRGW.READ_DIRS1 (18 ms) 2024-09-14T11:18:39.597 INFO:tasks.workunit.client.0.smithi138.stdout:[ RUN ] LibRGW.READF_SETUP1 2024-09-14T11:18:39.597 INFO:tasks.workunit.client.0.smithi138.stdout:[ OK ] LibRGW.READF_SETUP1 (0 ms) 2024-09-14T11:18:39.597 INFO:tasks.workunit.client.0.smithi138.stdout:[ RUN ] LibRGW.READF_DIRS1 2024-09-14T11:18:39.597 INFO:tasks.workunit.client.0.smithi138.stdout:[ OK ] LibRGW.READF_DIRS1 (0 ms) 2024-09-14T11:18:39.597 INFO:tasks.workunit.client.0.smithi138.stdout:[ RUN ] LibRGW.WRITEF_DIRS1 2024-09-14T11:18:39.597 INFO:tasks.workunit.client.0.smithi138.stdout:[ OK ] LibRGW.WRITEF_DIRS1 (0 ms) 2024-09-14T11:18:39.597 INFO:tasks.workunit.client.0.smithi138.stdout:[ RUN ] LibRGW.RELEASE_DIRS1 2024-09-14T11:18:39.597 INFO:tasks.workunit.client.0.smithi138.stdout:release sdir_0 type: DIR refs: 2 2024-09-14T11:18:39.597 INFO:tasks.workunit.client.0.smithi138.stdout:release sfile_0 type: FILE refs: 2 2024-09-14T11:18:39.597 INFO:tasks.workunit.client.0.smithi138.stdout:release sdir_1 type: DIR refs: 2 2024-09-14T11:18:39.598 INFO:tasks.workunit.client.0.smithi138.stdout:release sfile_1 type: FILE refs: 2 2024-09-14T11:18:39.598 INFO:tasks.workunit.client.0.smithi138.stdout:release sdir_0 type: DIR refs: 2 2024-09-14T11:18:39.598 INFO:tasks.workunit.client.0.smithi138.stdout:release sfile_0 type: FILE refs: 2 2024-09-14T11:18:39.598 INFO:tasks.workunit.client.0.smithi138.stdout:release sdir_1 type: DIR refs: 2 2024-09-14T11:18:39.598 INFO:tasks.workunit.client.0.smithi138.stdout:release sfile_1 type: FILE refs: 2 2024-09-14T11:18:39.598 INFO:tasks.workunit.client.0.smithi138.stdout:release sdir_0 type: DIR refs: 2 2024-09-14T11:18:39.598 INFO:tasks.workunit.client.0.smithi138.stdout:release sfile_0 type: FILE refs: 2 2024-09-14T11:18:39.598 INFO:tasks.workunit.client.0.smithi138.stdout:release sdir_1 type: DIR refs: 2 2024-09-14T11:18:39.598 INFO:tasks.workunit.client.0.smithi138.stdout:release sfile_1 type: FILE refs: 2 2024-09-14T11:18:39.598 INFO:tasks.workunit.client.0.smithi138.stdout:[ OK ] LibRGW.RELEASE_DIRS1 (0 ms) 2024-09-14T11:18:39.598 INFO:tasks.workunit.client.0.smithi138.stdout:[ RUN ] LibRGW.HIER1 2024-09-14T11:18:39.614 INFO:tasks.workunit.client.0.smithi138.stdout:/nfsroot/foo/f2 (f2): FILE 2024-09-14T11:18:39.615 INFO:tasks.workunit.client.0.smithi138.stdout:/nfsroot/foo/f1 (f1): FILE 2024-09-14T11:18:39.623 INFO:tasks.workunit.client.0.smithi138.stdout:/nfsroot/foo/bar/f1 (f1): FILE 2024-09-14T11:18:39.626 INFO:tasks.workunit.client.0.smithi138.stdout:/nfsroot/foo/bar/d1 (d1): DIR 2024-09-14T11:18:39.634 INFO:tasks.workunit.client.0.smithi138.stdout:/nfsroot/foo/bar/baz/sasquatch (sasquatch): FILE 2024-09-14T11:18:39.635 INFO:tasks.workunit.client.0.smithi138.stdout:/nfsroot/foo/bar/baz/sasquatch (sasquatch): FILE 2024-09-14T11:18:39.636 INFO:tasks.workunit.client.0.smithi138.stdout:/nfsroot/foo/bar/baz/quux (quux): FILE 2024-09-14T11:18:39.637 INFO:tasks.workunit.client.0.smithi138.stdout:/nfsroot/foo/bar/baz/momma (momma): FILE 2024-09-14T11:18:39.638 INFO:tasks.workunit.client.0.smithi138.stdout:/nfsroot/foo/bar/baz/hungry (hungry): FILE 2024-09-14T11:18:39.639 INFO:tasks.workunit.client.0.smithi138.stdout:/nfsroot/foo/bar/baz/hungry (hungry): FILE 2024-09-14T11:18:39.641 INFO:tasks.workunit.client.0.smithi138.stdout:/nfsroot/foo/bar/baz/frobozz (frobozz): FILE 2024-09-14T11:18:39.645 INFO:tasks.workunit.client.0.smithi138.stdout:/nfsroot/foo/bar/baz/bear (bear): DIR 2024-09-14T11:18:39.645 INFO:tasks.workunit.client.0.smithi138.stdout:/nfsroot/foo/bar/baz (baz): DIR 2024-09-14T11:18:39.646 INFO:tasks.workunit.client.0.smithi138.stdout:/nfsroot/foo/bar (bar): DIR 2024-09-14T11:18:39.646 INFO:tasks.workunit.client.0.smithi138.stdout:/nfsroot/foo (foo): DIR 2024-09-14T11:18:39.646 INFO:tasks.workunit.client.0.smithi138.stdout:/nfsroot (nfsroot): DIR 2024-09-14T11:18:39.646 INFO:tasks.workunit.client.0.smithi138.stdout:[ OK ] LibRGW.HIER1 (49 ms) 2024-09-14T11:18:39.646 INFO:tasks.workunit.client.0.smithi138.stdout:[ RUN ] LibRGW.MARKER1_SETUP_BUCKET 2024-09-14T11:18:39.646 INFO:tasks.workunit.client.0.smithi138.stdout:[ OK ] LibRGW.MARKER1_SETUP_BUCKET (0 ms) 2024-09-14T11:18:39.646 INFO:tasks.workunit.client.0.smithi138.stdout:[ RUN ] LibRGW.MARKER1_SETUP_OBJECTS 2024-09-14T11:18:39.646 INFO:tasks.workunit.client.0.smithi138.stdout:[ OK ] LibRGW.MARKER1_SETUP_OBJECTS (0 ms) 2024-09-14T11:18:39.646 INFO:tasks.workunit.client.0.smithi138.stdout:[ RUN ] LibRGW.MARKER1_READDIR 2024-09-14T11:18:39.646 INFO:tasks.workunit.client.0.smithi138.stdout:[ OK ] LibRGW.MARKER1_READDIR (0 ms) 2024-09-14T11:18:39.646 INFO:tasks.workunit.client.0.smithi138.stdout:[ RUN ] LibRGW.MARKER1_OBJ_CLEANUP 2024-09-14T11:18:39.646 INFO:tasks.workunit.client.0.smithi138.stdout:[ OK ] LibRGW.MARKER1_OBJ_CLEANUP (0 ms) 2024-09-14T11:18:39.646 INFO:tasks.workunit.client.0.smithi138.stdout:[ RUN ] LibRGW.CLEANUP 2024-09-14T11:18:39.646 INFO:tasks.workunit.client.0.smithi138.stdout:[ OK ] LibRGW.CLEANUP (0 ms) 2024-09-14T11:18:39.647 INFO:tasks.workunit.client.0.smithi138.stdout:[ RUN ] LibRGW.UMOUNT 2024-09-14T11:18:39.647 INFO:tasks.workunit.client.0.smithi138.stdout:[ OK ] LibRGW.UMOUNT (0 ms) 2024-09-14T11:18:39.647 INFO:tasks.workunit.client.0.smithi138.stdout:[ RUN ] LibRGW.SHUTDOWN 2024-09-14T11:18:39.647 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:18:39.646+0000 7faabababa80 -1 shutting down 2024-09-14T11:18:39.648 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:18:39.650+0000 7fa9948fd640 -1 received signal: User defined signal 1, si_code : -6, si_value (int): 0, si_value (ptr): 0, si_errno: 0, si_pid : 57273, si_uid : 1000, si_addr0x3e80000dfb9, si_status0 2024-09-14T11:19:09.547 INFO:tasks.workunit.client.0.smithi138.stdout:[ OK ] LibRGW.SHUTDOWN (29902 ms) 2024-09-14T11:19:09.548 INFO:tasks.workunit.client.0.smithi138.stdout:[----------] 24 tests from LibRGW (30671 ms total) 2024-09-14T11:19:09.548 INFO:tasks.workunit.client.0.smithi138.stdout: 2024-09-14T11:19:09.548 INFO:tasks.workunit.client.0.smithi138.stdout:[----------] Global test environment tear-down 2024-09-14T11:19:09.548 INFO:tasks.workunit.client.0.smithi138.stdout:[==========] 24 tests from 1 test suite ran. (30671 ms total) 2024-09-14T11:19:09.548 INFO:tasks.workunit.client.0.smithi138.stdout:[ PASSED ] 24 tests. 2024-09-14T11:19:09.561 INFO:tasks.workunit.client.0.smithi138.stdout:phase 2.1 2024-09-14T11:19:09.585 INFO:tasks.workunit.client.0.smithi138.stdout:[==========] Running 9 tests from 1 test suite. 2024-09-14T11:19:09.585 INFO:tasks.workunit.client.0.smithi138.stdout:[----------] Global test environment set-up. 2024-09-14T11:19:09.585 INFO:tasks.workunit.client.0.smithi138.stdout:[----------] 9 tests from LibRGW 2024-09-14T11:19:09.585 INFO:tasks.workunit.client.0.smithi138.stdout:[ RUN ] LibRGW.INIT 2024-09-14T11:19:09.596 INFO:tasks.workunit.client.0.smithi138.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:19:09.597 INFO:tasks.workunit.client.0.smithi138.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:19:10.340 INFO:tasks.workunit.client.0.smithi138.stdout:[ OK ] LibRGW.INIT (756 ms) 2024-09-14T11:19:10.340 INFO:tasks.workunit.client.0.smithi138.stdout:[ RUN ] LibRGW.MOUNT 2024-09-14T11:19:10.342 INFO:tasks.workunit.client.0.smithi138.stdout:[ OK ] LibRGW.MOUNT (1 ms) 2024-09-14T11:19:10.342 INFO:tasks.workunit.client.0.smithi138.stdout:[ RUN ] LibRGW.CREATE_BUCKET 2024-09-14T11:19:10.362 INFO:tasks.workunit.client.0.smithi138.stdout:[ OK ] LibRGW.CREATE_BUCKET (21 ms) 2024-09-14T11:19:10.363 INFO:tasks.workunit.client.0.smithi138.stdout:[ RUN ] LibRGW.DELETE_BUCKET 2024-09-14T11:19:10.363 INFO:tasks.workunit.client.0.smithi138.stdout:[ OK ] LibRGW.DELETE_BUCKET (0 ms) 2024-09-14T11:19:10.363 INFO:tasks.workunit.client.0.smithi138.stdout:[ RUN ] LibRGW.CREATE_BUCKET_MULTI 2024-09-14T11:19:10.378 INFO:tasks.workunit.client.0.smithi138.stdout:created: sorrydave0 2024-09-14T11:19:10.400 INFO:tasks.workunit.client.0.smithi138.stdout:created: sorrydave1 2024-09-14T11:19:10.417 INFO:tasks.workunit.client.0.smithi138.stdout:created: sorrydave2 2024-09-14T11:19:10.434 INFO:tasks.workunit.client.0.smithi138.stdout:created: sorrydave3 2024-09-14T11:19:10.453 INFO:tasks.workunit.client.0.smithi138.stdout:created: sorrydave4 2024-09-14T11:19:10.469 INFO:tasks.workunit.client.0.smithi138.stdout:created: sorrydave5 2024-09-14T11:19:10.489 INFO:tasks.workunit.client.0.smithi138.stdout:created: sorrydave6 2024-09-14T11:19:10.510 INFO:tasks.workunit.client.0.smithi138.stdout:created: sorrydave7 2024-09-14T11:19:10.529 INFO:tasks.workunit.client.0.smithi138.stdout:created: sorrydave8 2024-09-14T11:19:10.549 INFO:tasks.workunit.client.0.smithi138.stdout:created: sorrydave9 2024-09-14T11:19:10.549 INFO:tasks.workunit.client.0.smithi138.stdout:[ OK ] LibRGW.CREATE_BUCKET_MULTI (187 ms) 2024-09-14T11:19:10.549 INFO:tasks.workunit.client.0.smithi138.stdout:[ RUN ] LibRGW.DELETE_BUCKET_MULTI 2024-09-14T11:19:11.356 INFO:tasks.workunit.client.0.smithi138.stdout:[ OK ] LibRGW.DELETE_BUCKET_MULTI (807 ms) 2024-09-14T11:19:11.357 INFO:tasks.workunit.client.0.smithi138.stdout:[ RUN ] LibRGW.CLEANUP 2024-09-14T11:19:11.357 INFO:tasks.workunit.client.0.smithi138.stdout:[ OK ] LibRGW.CLEANUP (0 ms) 2024-09-14T11:19:11.357 INFO:tasks.workunit.client.0.smithi138.stdout:[ RUN ] LibRGW.UMOUNT 2024-09-14T11:19:11.357 INFO:tasks.workunit.client.0.smithi138.stdout:[ OK ] LibRGW.UMOUNT (0 ms) 2024-09-14T11:19:11.357 INFO:tasks.workunit.client.0.smithi138.stdout:[ RUN ] LibRGW.SHUTDOWN 2024-09-14T11:19:11.357 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:19:11.357+0000 7f1f3ea11a80 -1 shutting down 2024-09-14T11:19:11.360 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:19:11.361+0000 7f1e18763640 -1 received signal: User defined signal 1, si_code : -6, si_value (int): 0, si_value (ptr): 0, si_errno: 0, si_pid : 57918, si_uid : 1000, si_addr0x3e80000e23e, si_status0 2024-09-14T11:19:40.540 INFO:tasks.workunit.client.0.smithi138.stdout:[ OK ] LibRGW.SHUTDOWN (29183 ms) 2024-09-14T11:19:40.540 INFO:tasks.workunit.client.0.smithi138.stdout:[----------] 9 tests from LibRGW (30955 ms total) 2024-09-14T11:19:40.540 INFO:tasks.workunit.client.0.smithi138.stdout: 2024-09-14T11:19:40.540 INFO:tasks.workunit.client.0.smithi138.stdout:[----------] Global test environment tear-down 2024-09-14T11:19:40.540 INFO:tasks.workunit.client.0.smithi138.stdout:[==========] 9 tests from 1 test suite ran. (30955 ms total) 2024-09-14T11:19:40.540 INFO:tasks.workunit.client.0.smithi138.stdout:[ PASSED ] 9 tests. 2024-09-14T11:19:40.551 INFO:tasks.workunit.client.0.smithi138.stdout:phase 2.2 2024-09-14T11:19:40.574 INFO:tasks.workunit.client.0.smithi138.stdout:[==========] Running 9 tests from 1 test suite. 2024-09-14T11:19:40.574 INFO:tasks.workunit.client.0.smithi138.stdout:[----------] Global test environment set-up. 2024-09-14T11:19:40.574 INFO:tasks.workunit.client.0.smithi138.stdout:[----------] 9 tests from LibRGW 2024-09-14T11:19:40.574 INFO:tasks.workunit.client.0.smithi138.stdout:[ RUN ] LibRGW.INIT 2024-09-14T11:19:40.585 INFO:tasks.workunit.client.0.smithi138.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:19:40.585 INFO:tasks.workunit.client.0.smithi138.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:19:41.386 INFO:tasks.workunit.client.0.smithi138.stdout:[ OK ] LibRGW.INIT (813 ms) 2024-09-14T11:19:41.387 INFO:tasks.workunit.client.0.smithi138.stdout:[ RUN ] LibRGW.MOUNT 2024-09-14T11:19:41.388 INFO:tasks.workunit.client.0.smithi138.stdout:[ OK ] LibRGW.MOUNT (2 ms) 2024-09-14T11:19:41.388 INFO:tasks.workunit.client.0.smithi138.stdout:[ RUN ] LibRGW.CREATE_BUCKET 2024-09-14T11:19:41.388 INFO:tasks.workunit.client.0.smithi138.stdout:[ OK ] LibRGW.CREATE_BUCKET (0 ms) 2024-09-14T11:19:41.388 INFO:tasks.workunit.client.0.smithi138.stdout:[ RUN ] LibRGW.DELETE_BUCKET 2024-09-14T11:19:41.452 INFO:tasks.workunit.client.0.smithi138.stdout:[ OK ] LibRGW.DELETE_BUCKET (64 ms) 2024-09-14T11:19:41.452 INFO:tasks.workunit.client.0.smithi138.stdout:[ RUN ] LibRGW.CREATE_BUCKET_MULTI 2024-09-14T11:19:41.477 INFO:tasks.workunit.client.0.smithi138.stdout:created: sorrydave0 2024-09-14T11:19:41.502 INFO:tasks.workunit.client.0.smithi138.stdout:created: sorrydave1 2024-09-14T11:19:41.526 INFO:tasks.workunit.client.0.smithi138.stdout:created: sorrydave2 2024-09-14T11:19:41.551 INFO:tasks.workunit.client.0.smithi138.stdout:created: sorrydave3 2024-09-14T11:19:41.577 INFO:tasks.workunit.client.0.smithi138.stdout:created: sorrydave4 2024-09-14T11:19:41.602 INFO:tasks.workunit.client.0.smithi138.stdout:created: sorrydave5 2024-09-14T11:19:41.628 INFO:tasks.workunit.client.0.smithi138.stdout:created: sorrydave6 2024-09-14T11:19:41.652 INFO:tasks.workunit.client.0.smithi138.stdout:created: sorrydave7 2024-09-14T11:19:41.676 INFO:tasks.workunit.client.0.smithi138.stdout:created: sorrydave8 2024-09-14T11:19:41.700 INFO:tasks.workunit.client.0.smithi138.stdout:created: sorrydave9 2024-09-14T11:19:41.701 INFO:tasks.workunit.client.0.smithi138.stdout:[ OK ] LibRGW.CREATE_BUCKET_MULTI (248 ms) 2024-09-14T11:19:41.701 INFO:tasks.workunit.client.0.smithi138.stdout:[ RUN ] LibRGW.DELETE_BUCKET_MULTI 2024-09-14T11:19:42.520 INFO:tasks.workunit.client.0.smithi138.stdout:[ OK ] LibRGW.DELETE_BUCKET_MULTI (819 ms) 2024-09-14T11:19:42.520 INFO:tasks.workunit.client.0.smithi138.stdout:[ RUN ] LibRGW.CLEANUP 2024-09-14T11:19:42.520 INFO:tasks.workunit.client.0.smithi138.stdout:[ OK ] LibRGW.CLEANUP (0 ms) 2024-09-14T11:19:42.520 INFO:tasks.workunit.client.0.smithi138.stdout:[ RUN ] LibRGW.UMOUNT 2024-09-14T11:19:42.521 INFO:tasks.workunit.client.0.smithi138.stdout:[ OK ] LibRGW.UMOUNT (0 ms) 2024-09-14T11:19:42.521 INFO:tasks.workunit.client.0.smithi138.stdout:[ RUN ] LibRGW.SHUTDOWN 2024-09-14T11:19:42.521 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:19:42.521+0000 7fad0fdf8a80 -1 shutting down 2024-09-14T11:19:42.523 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:19:42.525+0000 7fabe9b4a640 -1 received signal: User defined signal 1, si_code : -6, si_value (int): 0, si_value (ptr): 0, si_errno: 0, si_pid : 58563, si_uid : 1000, si_addr0x3e80000e4c3, si_status0 2024-09-14T11:20:11.565 INFO:tasks.workunit.client.0.smithi138.stdout:[ OK ] LibRGW.SHUTDOWN (29046 ms) 2024-09-14T11:20:11.565 INFO:tasks.workunit.client.0.smithi138.stdout:[----------] 9 tests from LibRGW (30992 ms total) 2024-09-14T11:20:11.566 INFO:tasks.workunit.client.0.smithi138.stdout: 2024-09-14T11:20:11.566 INFO:tasks.workunit.client.0.smithi138.stdout:[----------] Global test environment tear-down 2024-09-14T11:20:11.566 INFO:tasks.workunit.client.0.smithi138.stdout:[==========] 9 tests from 1 test suite ran. (30992 ms total) 2024-09-14T11:20:11.566 INFO:tasks.workunit.client.0.smithi138.stdout:[ PASSED ] 9 tests. 2024-09-14T11:20:11.580 INFO:tasks.workunit.client.0.smithi138.stdout:phase 3.1 2024-09-14T11:20:11.922 INFO:tasks.workunit.client.0.smithi138.stdout:[==========] Running 13 tests from 1 test suite. 2024-09-14T11:20:11.922 INFO:tasks.workunit.client.0.smithi138.stdout:[----------] Global test environment set-up. 2024-09-14T11:20:11.923 INFO:tasks.workunit.client.0.smithi138.stdout:[----------] 13 tests from LibRGW 2024-09-14T11:20:11.923 INFO:tasks.workunit.client.0.smithi138.stdout:[ RUN ] LibRGW.INIT 2024-09-14T11:20:11.932 INFO:tasks.workunit.client.0.smithi138.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:20:11.933 INFO:tasks.workunit.client.0.smithi138.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:20:12.481 INFO:tasks.workunit.client.0.smithi138.stdout:[ OK ] LibRGW.INIT (558 ms) 2024-09-14T11:20:12.481 INFO:tasks.workunit.client.0.smithi138.stdout:[ RUN ] LibRGW.MOUNT 2024-09-14T11:20:12.482 INFO:tasks.workunit.client.0.smithi138.stdout:[ OK ] LibRGW.MOUNT (2 ms) 2024-09-14T11:20:12.482 INFO:tasks.workunit.client.0.smithi138.stdout:[ RUN ] LibRGW.CREATE_BUCKET 2024-09-14T11:20:12.501 INFO:tasks.workunit.client.0.smithi138.stdout:[ OK ] LibRGW.CREATE_BUCKET (19 ms) 2024-09-14T11:20:12.501 INFO:tasks.workunit.client.0.smithi138.stdout:[ RUN ] LibRGW.LOOKUP_BUCKET 2024-09-14T11:20:12.508 INFO:tasks.workunit.client.0.smithi138.stdout:[ OK ] LibRGW.LOOKUP_BUCKET (7 ms) 2024-09-14T11:20:12.508 INFO:tasks.workunit.client.0.smithi138.stdout:[ RUN ] LibRGW.LOOKUP_OBJECT 2024-09-14T11:20:12.512 INFO:tasks.workunit.client.0.smithi138.stdout:[ OK ] LibRGW.LOOKUP_OBJECT (4 ms) 2024-09-14T11:20:12.512 INFO:tasks.workunit.client.0.smithi138.stdout:[ RUN ] LibRGW.LARGE1 2024-09-14T11:20:12.628 INFO:tasks.workunit.client.0.smithi138.stdout:[ OK ] LibRGW.LARGE1 (115 ms) 2024-09-14T11:20:12.628 INFO:tasks.workunit.client.0.smithi138.stdout:[ RUN ] LibRGW.LARGE2 2024-09-14T11:20:12.722 INFO:tasks.workunit.client.0.smithi138.stdout:[ OK ] LibRGW.LARGE2 (95 ms) 2024-09-14T11:20:12.722 INFO:tasks.workunit.client.0.smithi138.stdout:[ RUN ] LibRGW.STAT_OBJECT 2024-09-14T11:20:12.723 INFO:tasks.workunit.client.0.smithi138.stdout:[ OK ] LibRGW.STAT_OBJECT (0 ms) 2024-09-14T11:20:12.723 INFO:tasks.workunit.client.0.smithi138.stdout:[ RUN ] LibRGW.DELETE_OBJECT 2024-09-14T11:20:12.723 INFO:tasks.workunit.client.0.smithi138.stdout:[ OK ] LibRGW.DELETE_OBJECT (0 ms) 2024-09-14T11:20:12.723 INFO:tasks.workunit.client.0.smithi138.stdout:[ RUN ] LibRGW.DELETE_BUCKET 2024-09-14T11:20:12.723 INFO:tasks.workunit.client.0.smithi138.stdout:[ OK ] LibRGW.DELETE_BUCKET (0 ms) 2024-09-14T11:20:12.723 INFO:tasks.workunit.client.0.smithi138.stdout:[ RUN ] LibRGW.CLEANUP 2024-09-14T11:20:12.723 INFO:tasks.workunit.client.0.smithi138.stdout:[ OK ] LibRGW.CLEANUP (0 ms) 2024-09-14T11:20:12.723 INFO:tasks.workunit.client.0.smithi138.stdout:[ RUN ] LibRGW.UMOUNT 2024-09-14T11:20:12.723 INFO:tasks.workunit.client.0.smithi138.stdout:[ OK ] LibRGW.UMOUNT (0 ms) 2024-09-14T11:20:12.723 INFO:tasks.workunit.client.0.smithi138.stdout:[ RUN ] LibRGW.SHUTDOWN 2024-09-14T11:20:12.723 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:20:12.725+0000 7f4a2db9ca80 -1 shutting down 2024-09-14T11:20:12.726 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:20:12.729+0000 7f49078ee640 -1 received signal: User defined signal 1, si_code : -6, si_value (int): 0, si_value (ptr): 0, si_errno: 0, si_pid : 59208, si_uid : 1000, si_addr0x3e80000e748, si_status0 2024-09-14T11:20:42.756 INFO:tasks.workunit.client.0.smithi138.stdout:[ OK ] LibRGW.SHUTDOWN (30034 ms) 2024-09-14T11:20:42.757 INFO:tasks.workunit.client.0.smithi138.stdout:[----------] 13 tests from LibRGW (30834 ms total) 2024-09-14T11:20:42.757 INFO:tasks.workunit.client.0.smithi138.stdout: 2024-09-14T11:20:42.757 INFO:tasks.workunit.client.0.smithi138.stdout:[----------] Global test environment tear-down 2024-09-14T11:20:42.757 INFO:tasks.workunit.client.0.smithi138.stdout:[==========] 13 tests from 1 test suite ran. (30834 ms total) 2024-09-14T11:20:42.757 INFO:tasks.workunit.client.0.smithi138.stdout:[ PASSED ] 13 tests. 2024-09-14T11:20:42.774 INFO:tasks.workunit.client.0.smithi138.stdout:phase 3.2 2024-09-14T11:20:43.119 INFO:tasks.workunit.client.0.smithi138.stdout:[==========] Running 13 tests from 1 test suite. 2024-09-14T11:20:43.119 INFO:tasks.workunit.client.0.smithi138.stdout:[----------] Global test environment set-up. 2024-09-14T11:20:43.119 INFO:tasks.workunit.client.0.smithi138.stdout:[----------] 13 tests from LibRGW 2024-09-14T11:20:43.119 INFO:tasks.workunit.client.0.smithi138.stdout:[ RUN ] LibRGW.INIT 2024-09-14T11:20:43.128 INFO:tasks.workunit.client.0.smithi138.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:20:43.128 INFO:tasks.workunit.client.0.smithi138.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:20:43.701 INFO:tasks.workunit.client.0.smithi138.stdout:[ OK ] LibRGW.INIT (582 ms) 2024-09-14T11:20:43.702 INFO:tasks.workunit.client.0.smithi138.stdout:[ RUN ] LibRGW.MOUNT 2024-09-14T11:20:43.703 INFO:tasks.workunit.client.0.smithi138.stdout:[ OK ] LibRGW.MOUNT (2 ms) 2024-09-14T11:20:43.703 INFO:tasks.workunit.client.0.smithi138.stdout:[ RUN ] LibRGW.CREATE_BUCKET 2024-09-14T11:20:43.703 INFO:tasks.workunit.client.0.smithi138.stdout:[ OK ] LibRGW.CREATE_BUCKET (0 ms) 2024-09-14T11:20:43.703 INFO:tasks.workunit.client.0.smithi138.stdout:[ RUN ] LibRGW.LOOKUP_BUCKET 2024-09-14T11:20:43.712 INFO:tasks.workunit.client.0.smithi138.stdout:[ OK ] LibRGW.LOOKUP_BUCKET (9 ms) 2024-09-14T11:20:43.712 INFO:tasks.workunit.client.0.smithi138.stdout:[ RUN ] LibRGW.LOOKUP_OBJECT 2024-09-14T11:20:43.719 INFO:tasks.workunit.client.0.smithi138.stdout:[ OK ] LibRGW.LOOKUP_OBJECT (7 ms) 2024-09-14T11:20:43.719 INFO:tasks.workunit.client.0.smithi138.stdout:[ RUN ] LibRGW.LARGE1 2024-09-14T11:20:43.818 INFO:tasks.workunit.client.0.smithi138.stdout:[ OK ] LibRGW.LARGE1 (99 ms) 2024-09-14T11:20:43.818 INFO:tasks.workunit.client.0.smithi138.stdout:[ RUN ] LibRGW.LARGE2 2024-09-14T11:20:43.818 INFO:tasks.workunit.client.0.smithi138.stdout:[ OK ] LibRGW.LARGE2 (0 ms) 2024-09-14T11:20:43.818 INFO:tasks.workunit.client.0.smithi138.stdout:[ RUN ] LibRGW.STAT_OBJECT 2024-09-14T11:20:43.818 INFO:tasks.workunit.client.0.smithi138.stdout:[ OK ] LibRGW.STAT_OBJECT (0 ms) 2024-09-14T11:20:43.818 INFO:tasks.workunit.client.0.smithi138.stdout:[ RUN ] LibRGW.DELETE_OBJECT 2024-09-14T11:20:43.831 INFO:tasks.workunit.client.0.smithi138.stdout:[ OK ] LibRGW.DELETE_OBJECT (13 ms) 2024-09-14T11:20:43.831 INFO:tasks.workunit.client.0.smithi138.stdout:[ RUN ] LibRGW.DELETE_BUCKET 2024-09-14T11:20:43.906 INFO:tasks.workunit.client.0.smithi138.stdout:[ OK ] LibRGW.DELETE_BUCKET (75 ms) 2024-09-14T11:20:43.906 INFO:tasks.workunit.client.0.smithi138.stdout:[ RUN ] LibRGW.CLEANUP 2024-09-14T11:20:43.906 INFO:tasks.workunit.client.0.smithi138.stdout:[ OK ] LibRGW.CLEANUP (0 ms) 2024-09-14T11:20:43.906 INFO:tasks.workunit.client.0.smithi138.stdout:[ RUN ] LibRGW.UMOUNT 2024-09-14T11:20:43.906 INFO:tasks.workunit.client.0.smithi138.stdout:[ OK ] LibRGW.UMOUNT (0 ms) 2024-09-14T11:20:43.906 INFO:tasks.workunit.client.0.smithi138.stdout:[ RUN ] LibRGW.SHUTDOWN 2024-09-14T11:20:43.906 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:20:43.912+0000 7fe936ee5a80 -1 shutting down 2024-09-14T11:20:43.909 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:20:43.916+0000 7fe810c37640 -1 received signal: User defined signal 1, si_code : -6, si_value (int): 0, si_value (ptr): 0, si_errno: 0, si_pid : 59853, si_uid : 1000, si_addr0x3e80000e9cd, si_status0 2024-09-14T11:21:13.745 INFO:tasks.workunit.client.0.smithi138.stdout:[ OK ] LibRGW.SHUTDOWN (29838 ms) 2024-09-14T11:21:13.745 INFO:tasks.workunit.client.0.smithi138.stdout:[----------] 13 tests from LibRGW (30625 ms total) 2024-09-14T11:21:13.745 INFO:tasks.workunit.client.0.smithi138.stdout: 2024-09-14T11:21:13.745 INFO:tasks.workunit.client.0.smithi138.stdout:[----------] Global test environment tear-down 2024-09-14T11:21:13.745 INFO:tasks.workunit.client.0.smithi138.stdout:[==========] 13 tests from 1 test suite ran. (30625 ms total) 2024-09-14T11:21:13.745 INFO:tasks.workunit.client.0.smithi138.stdout:[ PASSED ] 13 tests. 2024-09-14T11:21:13.762 INFO:tasks.workunit.client.0.smithi138.stdout:phase 4.1 2024-09-14T11:21:13.785 INFO:tasks.workunit.client.0.smithi138.stdout:[==========] Running 11 tests from 1 test suite. 2024-09-14T11:21:13.785 INFO:tasks.workunit.client.0.smithi138.stdout:[----------] Global test environment set-up. 2024-09-14T11:21:13.785 INFO:tasks.workunit.client.0.smithi138.stdout:[----------] 11 tests from LibRGW 2024-09-14T11:21:13.785 INFO:tasks.workunit.client.0.smithi138.stdout:[ RUN ] LibRGW.TVAR 2024-09-14T11:21:13.785 INFO:tasks.workunit.client.0.smithi138.stdout:read i1: 64001 2024-09-14T11:21:13.785 INFO:tasks.workunit.client.0.smithi138.stdout:read s1: blunderbuss 2024-09-14T11:21:13.786 INFO:tasks.workunit.client.0.smithi138.stdout:read s3: [ OK ] LibRGW.TVAR (0 ms) 2024-09-14T11:21:13.786 INFO:tasks.workunit.client.0.smithi138.stdout:[ RUN ] LibRGW.INIT 2024-09-14T11:21:13.799 INFO:tasks.workunit.client.0.smithi138.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:21:13.799 INFO:tasks.workunit.client.0.smithi138.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:21:14.202 INFO:tasks.workunit.client.0.smithi138.stdout:[ OK ] LibRGW.INIT (417 ms) 2024-09-14T11:21:14.202 INFO:tasks.workunit.client.0.smithi138.stdout:[ RUN ] LibRGW.MOUNT 2024-09-14T11:21:14.203 INFO:tasks.workunit.client.0.smithi138.stdout:[ OK ] LibRGW.MOUNT (2 ms) 2024-09-14T11:21:14.203 INFO:tasks.workunit.client.0.smithi138.stdout:[ RUN ] LibRGW.MARKER1_SETUP_BUCKET 2024-09-14T11:21:14.242 INFO:tasks.workunit.client.0.smithi138.stdout:[ OK ] LibRGW.MARKER1_SETUP_BUCKET (38 ms) 2024-09-14T11:21:14.242 INFO:tasks.workunit.client.0.smithi138.stdout:[ RUN ] LibRGW.MARKER1_SETUP_OBJECTS 2024-09-14T11:21:15.424 INFO:tasks.workunit.client.0.smithi138.stdout:created: dmarker:f_0 2024-09-14T11:21:15.425 INFO:tasks.workunit.client.0.smithi138.stdout:created: dmarker:f_1 2024-09-14T11:21:15.425 INFO:tasks.workunit.client.0.smithi138.stdout:created: dmarker:f_2 2024-09-14T11:21:15.425 INFO:tasks.workunit.client.0.smithi138.stdout:created: dmarker:f_3 2024-09-14T11:21:15.425 INFO:tasks.workunit.client.0.smithi138.stdout:created: dmarker:f_4 2024-09-14T11:21:15.425 INFO:tasks.workunit.client.0.smithi138.stdout:created: dmarker:f_5 2024-09-14T11:21:15.425 INFO:tasks.workunit.client.0.smithi138.stdout:created: dmarker:f_6 2024-09-14T11:21:15.425 INFO:tasks.workunit.client.0.smithi138.stdout:created: dmarker:f_7 2024-09-14T11:21:15.425 INFO:tasks.workunit.client.0.smithi138.stdout:created: dmarker:f_8 2024-09-14T11:21:15.425 INFO:tasks.workunit.client.0.smithi138.stdout:created: dmarker:f_9 2024-09-14T11:21:15.425 INFO:tasks.workunit.client.0.smithi138.stdout:created: dmarker:f_10 2024-09-14T11:21:15.425 INFO:tasks.workunit.client.0.smithi138.stdout:created: dmarker:f_11 2024-09-14T11:21:15.426 INFO:tasks.workunit.client.0.smithi138.stdout:created: dmarker:f_12 2024-09-14T11:21:15.426 INFO:tasks.workunit.client.0.smithi138.stdout:created: dmarker:f_13 2024-09-14T11:21:15.426 INFO:tasks.workunit.client.0.smithi138.stdout:created: dmarker:f_14 2024-09-14T11:21:15.426 INFO:tasks.workunit.client.0.smithi138.stdout:created: dmarker:f_15 2024-09-14T11:21:15.426 INFO:tasks.workunit.client.0.smithi138.stdout:created: dmarker:f_16 2024-09-14T11:21:15.426 INFO:tasks.workunit.client.0.smithi138.stdout:created: dmarker:f_17 2024-09-14T11:21:15.426 INFO:tasks.workunit.client.0.smithi138.stdout:created: dmarker:f_18 2024-09-14T11:21:15.426 INFO:tasks.workunit.client.0.smithi138.stdout:created: dmarker:f_19 2024-09-14T11:21:15.426 INFO:tasks.workunit.client.0.smithi138.stdout:created: dmarker:f_20 2024-09-14T11:21:15.426 INFO:tasks.workunit.client.0.smithi138.stdout:created: dmarker:f_21 2024-09-14T11:21:15.426 INFO:tasks.workunit.client.0.smithi138.stdout:created: dmarker:f_22 2024-09-14T11:21:15.427 INFO:tasks.workunit.client.0.smithi138.stdout:created: dmarker:f_23 2024-09-14T11:21:15.427 INFO:tasks.workunit.client.0.smithi138.stdout:created: dmarker:f_24 2024-09-14T11:21:15.427 INFO:tasks.workunit.client.0.smithi138.stdout:created: dmarker:f_25 2024-09-14T11:21:15.427 INFO:tasks.workunit.client.0.smithi138.stdout:created: dmarker:f_26 2024-09-14T11:21:15.427 INFO:tasks.workunit.client.0.smithi138.stdout:created: dmarker:f_27 2024-09-14T11:21:15.427 INFO:tasks.workunit.client.0.smithi138.stdout:created: dmarker:f_28 2024-09-14T11:21:15.427 INFO:tasks.workunit.client.0.smithi138.stdout:created: dmarker:f_29 2024-09-14T11:21:15.427 INFO:tasks.workunit.client.0.smithi138.stdout:created: dmarker:f_30 2024-09-14T11:21:15.427 INFO:tasks.workunit.client.0.smithi138.stdout:created: dmarker:f_31 2024-09-14T11:21:15.427 INFO:tasks.workunit.client.0.smithi138.stdout:created: dmarker:f_32 2024-09-14T11:21:15.427 INFO:tasks.workunit.client.0.smithi138.stdout:created: dmarker:f_33 2024-09-14T11:21:15.427 INFO:tasks.workunit.client.0.smithi138.stdout:created: dmarker:f_34 2024-09-14T11:21:15.427 INFO:tasks.workunit.client.0.smithi138.stdout:created: dmarker:f_35 2024-09-14T11:21:15.427 INFO:tasks.workunit.client.0.smithi138.stdout:created: dmarker:f_36 2024-09-14T11:21:15.428 INFO:tasks.workunit.client.0.smithi138.stdout:created: dmarker:f_37 2024-09-14T11:21:15.428 INFO:tasks.workunit.client.0.smithi138.stdout:created: dmarker:f_38 2024-09-14T11:21:15.428 INFO:tasks.workunit.client.0.smithi138.stdout:created: dmarker:f_39 2024-09-14T11:21:15.428 INFO:tasks.workunit.client.0.smithi138.stdout:created: dmarker:f_40 2024-09-14T11:21:15.428 INFO:tasks.workunit.client.0.smithi138.stdout:created: dmarker:f_41 2024-09-14T11:21:15.428 INFO:tasks.workunit.client.0.smithi138.stdout:created: dmarker:f_42 2024-09-14T11:21:15.428 INFO:tasks.workunit.client.0.smithi138.stdout:created: dmarker:f_43 2024-09-14T11:21:15.428 INFO:tasks.workunit.client.0.smithi138.stdout:created: dmarker:f_44 2024-09-14T11:21:15.428 INFO:tasks.workunit.client.0.smithi138.stdout:created: dmarker:f_45 2024-09-14T11:21:15.428 INFO:tasks.workunit.client.0.smithi138.stdout:created: dmarker:f_46 2024-09-14T11:21:15.428 INFO:tasks.workunit.client.0.smithi138.stdout:created: dmarker:f_47 2024-09-14T11:21:15.428 INFO:tasks.workunit.client.0.smithi138.stdout:created: dmarker:f_48 2024-09-14T11:21:15.428 INFO:tasks.workunit.client.0.smithi138.stdout:created: dmarker:f_49 2024-09-14T11:21:15.428 INFO:tasks.workunit.client.0.smithi138.stdout:created: dmarker:f_50 2024-09-14T11:21:15.429 INFO:tasks.workunit.client.0.smithi138.stdout:created: dmarker:f_51 2024-09-14T11:21:15.429 INFO:tasks.workunit.client.0.smithi138.stdout:created: dmarker:f_52 2024-09-14T11:21:15.429 INFO:tasks.workunit.client.0.smithi138.stdout:created: dmarker:f_53 2024-09-14T11:21:15.429 INFO:tasks.workunit.client.0.smithi138.stdout:created: dmarker:f_54 2024-09-14T11:21:15.429 INFO:tasks.workunit.client.0.smithi138.stdout:created: dmarker:f_55 2024-09-14T11:21:15.429 INFO:tasks.workunit.client.0.smithi138.stdout:created: dmarker:f_56 2024-09-14T11:21:15.429 INFO:tasks.workunit.client.0.smithi138.stdout:created: dmarker:f_57 2024-09-14T11:21:15.429 INFO:tasks.workunit.client.0.smithi138.stdout:created: dmarker:f_58 2024-09-14T11:21:15.429 INFO:tasks.workunit.client.0.smithi138.stdout:created: dmarker:f_59 2024-09-14T11:21:15.429 INFO:tasks.workunit.client.0.smithi138.stdout:created: dmarker:f_60 2024-09-14T11:21:15.429 INFO:tasks.workunit.client.0.smithi138.stdout:created: dmarker:f_61 2024-09-14T11:21:15.429 INFO:tasks.workunit.client.0.smithi138.stdout:created: dmarker:f_62 2024-09-14T11:21:15.429 INFO:tasks.workunit.client.0.smithi138.stdout:created: dmarker:f_63 2024-09-14T11:21:15.429 INFO:tasks.workunit.client.0.smithi138.stdout:created: dmarker:f_64 2024-09-14T11:21:15.430 INFO:tasks.workunit.client.0.smithi138.stdout:created: dmarker:f_65 2024-09-14T11:21:15.430 INFO:tasks.workunit.client.0.smithi138.stdout:created: dmarker:f_66 2024-09-14T11:21:15.430 INFO:tasks.workunit.client.0.smithi138.stdout:created: dmarker:f_67 2024-09-14T11:21:15.430 INFO:tasks.workunit.client.0.smithi138.stdout:created: dmarker:f_68 2024-09-14T11:21:15.430 INFO:tasks.workunit.client.0.smithi138.stdout:created: dmarker:f_69 2024-09-14T11:21:15.430 INFO:tasks.workunit.client.0.smithi138.stdout:created: dmarker:f_70 2024-09-14T11:21:15.430 INFO:tasks.workunit.client.0.smithi138.stdout:created: dmarker:f_71 2024-09-14T11:21:15.430 INFO:tasks.workunit.client.0.smithi138.stdout:created: dmarker:f_72 2024-09-14T11:21:15.430 INFO:tasks.workunit.client.0.smithi138.stdout:created: dmarker:f_73 2024-09-14T11:21:15.430 INFO:tasks.workunit.client.0.smithi138.stdout:created: dmarker:f_74 2024-09-14T11:21:15.430 INFO:tasks.workunit.client.0.smithi138.stdout:created: dmarker:f_75 2024-09-14T11:21:15.430 INFO:tasks.workunit.client.0.smithi138.stdout:created: dmarker:f_76 2024-09-14T11:21:15.430 INFO:tasks.workunit.client.0.smithi138.stdout:created: dmarker:f_77 2024-09-14T11:21:15.430 INFO:tasks.workunit.client.0.smithi138.stdout:created: dmarker:f_78 2024-09-14T11:21:15.430 INFO:tasks.workunit.client.0.smithi138.stdout:created: dmarker:f_79 2024-09-14T11:21:15.431 INFO:tasks.workunit.client.0.smithi138.stdout:created: dmarker:f_80 2024-09-14T11:21:15.431 INFO:tasks.workunit.client.0.smithi138.stdout:created: dmarker:f_81 2024-09-14T11:21:15.431 INFO:tasks.workunit.client.0.smithi138.stdout:created: dmarker:f_82 2024-09-14T11:21:15.431 INFO:tasks.workunit.client.0.smithi138.stdout:created: dmarker:f_83 2024-09-14T11:21:15.431 INFO:tasks.workunit.client.0.smithi138.stdout:created: dmarker:f_84 2024-09-14T11:21:15.431 INFO:tasks.workunit.client.0.smithi138.stdout:created: dmarker:f_85 2024-09-14T11:21:15.431 INFO:tasks.workunit.client.0.smithi138.stdout:created: dmarker:f_86 2024-09-14T11:21:15.431 INFO:tasks.workunit.client.0.smithi138.stdout:created: dmarker:f_87 2024-09-14T11:21:15.431 INFO:tasks.workunit.client.0.smithi138.stdout:created: dmarker:f_88 2024-09-14T11:21:15.431 INFO:tasks.workunit.client.0.smithi138.stdout:created: dmarker:f_89 2024-09-14T11:21:15.431 INFO:tasks.workunit.client.0.smithi138.stdout:created: dmarker:f_90 2024-09-14T11:21:15.431 INFO:tasks.workunit.client.0.smithi138.stdout:created: dmarker:f_91 2024-09-14T11:21:15.431 INFO:tasks.workunit.client.0.smithi138.stdout:created: dmarker:f_92 2024-09-14T11:21:15.431 INFO:tasks.workunit.client.0.smithi138.stdout:created: dmarker:f_93 2024-09-14T11:21:15.432 INFO:tasks.workunit.client.0.smithi138.stdout:created: dmarker:f_94 2024-09-14T11:21:15.432 INFO:tasks.workunit.client.0.smithi138.stdout:created: dmarker:f_95 2024-09-14T11:21:15.432 INFO:tasks.workunit.client.0.smithi138.stdout:created: dmarker:f_96 2024-09-14T11:21:15.432 INFO:tasks.workunit.client.0.smithi138.stdout:created: dmarker:f_97 2024-09-14T11:21:15.432 INFO:tasks.workunit.client.0.smithi138.stdout:created: dmarker:f_98 2024-09-14T11:21:15.432 INFO:tasks.workunit.client.0.smithi138.stdout:created: dmarker:f_99 2024-09-14T11:21:15.432 INFO:tasks.workunit.client.0.smithi138.stdout:[ OK ] LibRGW.MARKER1_SETUP_OBJECTS (1182 ms) 2024-09-14T11:21:15.432 INFO:tasks.workunit.client.0.smithi138.stdout:[ RUN ] LibRGW.MARKER1_READDIR 2024-09-14T11:21:15.433 INFO:tasks.workunit.client.0.smithi138.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=. flags=4 2024-09-14T11:21:15.433 INFO:tasks.workunit.client.0.smithi138.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=.. flags=4 2024-09-14T11:21:15.433 INFO:tasks.workunit.client.0.smithi138.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_0 flags=8 2024-09-14T11:21:15.433 INFO:tasks.workunit.client.0.smithi138.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_1 flags=8 2024-09-14T11:21:15.433 INFO:tasks.workunit.client.0.smithi138.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_10 flags=8 2024-09-14T11:21:15.433 INFO:tasks.workunit.client.0.smithi138.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_11 flags=8 2024-09-14T11:21:15.433 INFO:tasks.workunit.client.0.smithi138.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_12 flags=8 2024-09-14T11:21:15.433 INFO:tasks.workunit.client.0.smithi138.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_13 flags=8 2024-09-14T11:21:15.433 INFO:tasks.workunit.client.0.smithi138.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_14 flags=8 2024-09-14T11:21:15.433 INFO:tasks.workunit.client.0.smithi138.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_15 flags=8 2024-09-14T11:21:15.433 INFO:tasks.workunit.client.0.smithi138.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_16 flags=8 2024-09-14T11:21:15.433 INFO:tasks.workunit.client.0.smithi138.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_17 flags=8 2024-09-14T11:21:15.434 INFO:tasks.workunit.client.0.smithi138.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_18 flags=8 2024-09-14T11:21:15.434 INFO:tasks.workunit.client.0.smithi138.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_19 flags=8 2024-09-14T11:21:15.434 INFO:tasks.workunit.client.0.smithi138.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_2 flags=8 2024-09-14T11:21:15.434 INFO:tasks.workunit.client.0.smithi138.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_20 flags=8 2024-09-14T11:21:15.434 INFO:tasks.workunit.client.0.smithi138.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_21 flags=8 2024-09-14T11:21:15.434 INFO:tasks.workunit.client.0.smithi138.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_22 flags=8 2024-09-14T11:21:15.434 INFO:tasks.workunit.client.0.smithi138.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_23 flags=8 2024-09-14T11:21:15.434 INFO:tasks.workunit.client.0.smithi138.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_24 flags=8 2024-09-14T11:21:15.434 INFO:tasks.workunit.client.0.smithi138.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_25 flags=8 2024-09-14T11:21:15.434 INFO:tasks.workunit.client.0.smithi138.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_26 flags=8 2024-09-14T11:21:15.434 INFO:tasks.workunit.client.0.smithi138.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_27 flags=8 2024-09-14T11:21:15.434 INFO:tasks.workunit.client.0.smithi138.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_28 flags=8 2024-09-14T11:21:15.434 INFO:tasks.workunit.client.0.smithi138.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_29 flags=8 2024-09-14T11:21:15.434 INFO:tasks.workunit.client.0.smithi138.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_3 flags=8 2024-09-14T11:21:15.435 INFO:tasks.workunit.client.0.smithi138.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_30 flags=8 2024-09-14T11:21:15.435 INFO:tasks.workunit.client.0.smithi138.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_31 flags=8 2024-09-14T11:21:15.435 INFO:tasks.workunit.client.0.smithi138.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_32 flags=8 2024-09-14T11:21:15.435 INFO:tasks.workunit.client.0.smithi138.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_33 flags=8 2024-09-14T11:21:15.435 INFO:tasks.workunit.client.0.smithi138.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_34 flags=8 2024-09-14T11:21:15.435 INFO:tasks.workunit.client.0.smithi138.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_35 flags=8 2024-09-14T11:21:15.435 INFO:tasks.workunit.client.0.smithi138.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_36 flags=8 2024-09-14T11:21:15.435 INFO:tasks.workunit.client.0.smithi138.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_37 flags=8 2024-09-14T11:21:15.435 INFO:tasks.workunit.client.0.smithi138.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_38 flags=8 2024-09-14T11:21:15.435 INFO:tasks.workunit.client.0.smithi138.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_39 flags=8 2024-09-14T11:21:15.435 INFO:tasks.workunit.client.0.smithi138.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_4 flags=8 2024-09-14T11:21:15.435 INFO:tasks.workunit.client.0.smithi138.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_40 flags=8 2024-09-14T11:21:15.435 INFO:tasks.workunit.client.0.smithi138.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_41 flags=8 2024-09-14T11:21:15.435 INFO:tasks.workunit.client.0.smithi138.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_42 flags=8 2024-09-14T11:21:15.436 INFO:tasks.workunit.client.0.smithi138.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_43 flags=8 2024-09-14T11:21:15.436 INFO:tasks.workunit.client.0.smithi138.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_44 flags=8 2024-09-14T11:21:15.436 INFO:tasks.workunit.client.0.smithi138.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_45 flags=8 2024-09-14T11:21:15.436 INFO:tasks.workunit.client.0.smithi138.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_46 flags=8 2024-09-14T11:21:15.436 INFO:tasks.workunit.client.0.smithi138.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_47 flags=8 2024-09-14T11:21:15.436 INFO:tasks.workunit.client.0.smithi138.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_48 flags=8 2024-09-14T11:21:15.436 INFO:tasks.workunit.client.0.smithi138.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_49 flags=8 2024-09-14T11:21:15.436 INFO:tasks.workunit.client.0.smithi138.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_5 flags=8 2024-09-14T11:21:15.436 INFO:tasks.workunit.client.0.smithi138.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_50 flags=8 2024-09-14T11:21:15.436 INFO:tasks.workunit.client.0.smithi138.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_51 flags=8 2024-09-14T11:21:15.436 INFO:tasks.workunit.client.0.smithi138.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_52 flags=8 2024-09-14T11:21:15.436 INFO:tasks.workunit.client.0.smithi138.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_53 flags=8 2024-09-14T11:21:15.437 INFO:tasks.workunit.client.0.smithi138.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_54 flags=8 2024-09-14T11:21:15.437 INFO:tasks.workunit.client.0.smithi138.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_55 flags=8 2024-09-14T11:21:15.437 INFO:tasks.workunit.client.0.smithi138.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_56 flags=8 2024-09-14T11:21:15.437 INFO:tasks.workunit.client.0.smithi138.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_57 flags=8 2024-09-14T11:21:15.437 INFO:tasks.workunit.client.0.smithi138.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_58 flags=8 2024-09-14T11:21:15.437 INFO:tasks.workunit.client.0.smithi138.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_59 flags=8 2024-09-14T11:21:15.437 INFO:tasks.workunit.client.0.smithi138.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_6 flags=8 2024-09-14T11:21:15.437 INFO:tasks.workunit.client.0.smithi138.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_60 flags=8 2024-09-14T11:21:15.437 INFO:tasks.workunit.client.0.smithi138.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_61 flags=8 2024-09-14T11:21:15.437 INFO:tasks.workunit.client.0.smithi138.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_62 flags=8 2024-09-14T11:21:15.437 INFO:tasks.workunit.client.0.smithi138.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_63 flags=8 2024-09-14T11:21:15.437 INFO:tasks.workunit.client.0.smithi138.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_64 flags=8 2024-09-14T11:21:15.437 INFO:tasks.workunit.client.0.smithi138.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_65 flags=8 2024-09-14T11:21:15.438 INFO:tasks.workunit.client.0.smithi138.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_66 flags=8 2024-09-14T11:21:15.438 INFO:tasks.workunit.client.0.smithi138.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_67 flags=8 2024-09-14T11:21:15.438 INFO:tasks.workunit.client.0.smithi138.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_68 flags=8 2024-09-14T11:21:15.438 INFO:tasks.workunit.client.0.smithi138.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_69 flags=8 2024-09-14T11:21:15.438 INFO:tasks.workunit.client.0.smithi138.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_7 flags=8 2024-09-14T11:21:15.438 INFO:tasks.workunit.client.0.smithi138.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_70 flags=8 2024-09-14T11:21:15.438 INFO:tasks.workunit.client.0.smithi138.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_71 flags=8 2024-09-14T11:21:15.438 INFO:tasks.workunit.client.0.smithi138.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_72 flags=8 2024-09-14T11:21:15.438 INFO:tasks.workunit.client.0.smithi138.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_73 flags=8 2024-09-14T11:21:15.438 INFO:tasks.workunit.client.0.smithi138.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_74 flags=8 2024-09-14T11:21:15.438 INFO:tasks.workunit.client.0.smithi138.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_75 flags=8 2024-09-14T11:21:15.438 INFO:tasks.workunit.client.0.smithi138.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_76 flags=8 2024-09-14T11:21:15.438 INFO:tasks.workunit.client.0.smithi138.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_77 flags=8 2024-09-14T11:21:15.438 INFO:tasks.workunit.client.0.smithi138.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_78 flags=8 2024-09-14T11:21:15.439 INFO:tasks.workunit.client.0.smithi138.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_79 flags=8 2024-09-14T11:21:15.439 INFO:tasks.workunit.client.0.smithi138.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_8 flags=8 2024-09-14T11:21:15.439 INFO:tasks.workunit.client.0.smithi138.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_80 flags=8 2024-09-14T11:21:15.439 INFO:tasks.workunit.client.0.smithi138.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_81 flags=8 2024-09-14T11:21:15.439 INFO:tasks.workunit.client.0.smithi138.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_82 flags=8 2024-09-14T11:21:15.439 INFO:tasks.workunit.client.0.smithi138.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_83 flags=8 2024-09-14T11:21:15.439 INFO:tasks.workunit.client.0.smithi138.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_84 flags=8 2024-09-14T11:21:15.439 INFO:tasks.workunit.client.0.smithi138.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_85 flags=8 2024-09-14T11:21:15.439 INFO:tasks.workunit.client.0.smithi138.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_86 flags=8 2024-09-14T11:21:15.439 INFO:tasks.workunit.client.0.smithi138.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_87 flags=8 2024-09-14T11:21:15.439 INFO:tasks.workunit.client.0.smithi138.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_88 flags=8 2024-09-14T11:21:15.439 INFO:tasks.workunit.client.0.smithi138.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_89 flags=8 2024-09-14T11:21:15.439 INFO:tasks.workunit.client.0.smithi138.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_9 flags=8 2024-09-14T11:21:15.439 INFO:tasks.workunit.client.0.smithi138.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_90 flags=8 2024-09-14T11:21:15.439 INFO:tasks.workunit.client.0.smithi138.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_91 flags=8 2024-09-14T11:21:15.440 INFO:tasks.workunit.client.0.smithi138.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_92 flags=8 2024-09-14T11:21:15.440 INFO:tasks.workunit.client.0.smithi138.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_93 flags=8 2024-09-14T11:21:15.440 INFO:tasks.workunit.client.0.smithi138.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_94 flags=8 2024-09-14T11:21:15.440 INFO:tasks.workunit.client.0.smithi138.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_95 flags=8 2024-09-14T11:21:15.440 INFO:tasks.workunit.client.0.smithi138.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_96 flags=8 2024-09-14T11:21:15.440 INFO:tasks.workunit.client.0.smithi138.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_97 flags=8 2024-09-14T11:21:15.440 INFO:tasks.workunit.client.0.smithi138.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_98 flags=8 2024-09-14T11:21:15.440 INFO:tasks.workunit.client.0.smithi138.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_99 flags=8 2024-09-14T11:21:15.440 INFO:tasks.workunit.client.0.smithi138.stdout:[ OK ] LibRGW.MARKER1_READDIR (7 ms) 2024-09-14T11:21:15.440 INFO:tasks.workunit.client.0.smithi138.stdout:[ RUN ] LibRGW.MARKER2_READDIR 2024-09-14T11:21:15.441 INFO:tasks.workunit.client.0.smithi138.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_0 flags=8 2024-09-14T11:21:15.441 INFO:tasks.workunit.client.0.smithi138.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_1 flags=8 2024-09-14T11:21:15.441 INFO:tasks.workunit.client.0.smithi138.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_10 flags=8 2024-09-14T11:21:15.441 INFO:tasks.workunit.client.0.smithi138.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_11 flags=8 2024-09-14T11:21:15.441 INFO:tasks.workunit.client.0.smithi138.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_12 flags=8 2024-09-14T11:21:15.441 INFO:tasks.workunit.client.0.smithi138.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_13 flags=8 2024-09-14T11:21:15.441 INFO:tasks.workunit.client.0.smithi138.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_14 flags=8 2024-09-14T11:21:15.442 INFO:tasks.workunit.client.0.smithi138.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_15 flags=8 2024-09-14T11:21:15.442 INFO:tasks.workunit.client.0.smithi138.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_16 flags=8 2024-09-14T11:21:15.442 INFO:tasks.workunit.client.0.smithi138.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_17 flags=8 2024-09-14T11:21:15.442 INFO:tasks.workunit.client.0.smithi138.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_18 flags=8 2024-09-14T11:21:15.442 INFO:tasks.workunit.client.0.smithi138.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_19 flags=8 2024-09-14T11:21:15.442 INFO:tasks.workunit.client.0.smithi138.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_2 flags=8 2024-09-14T11:21:15.442 INFO:tasks.workunit.client.0.smithi138.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_20 flags=8 2024-09-14T11:21:15.442 INFO:tasks.workunit.client.0.smithi138.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_21 flags=8 2024-09-14T11:21:15.442 INFO:tasks.workunit.client.0.smithi138.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_22 flags=8 2024-09-14T11:21:15.442 INFO:tasks.workunit.client.0.smithi138.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_23 flags=8 2024-09-14T11:21:15.442 INFO:tasks.workunit.client.0.smithi138.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_24 flags=8 2024-09-14T11:21:15.442 INFO:tasks.workunit.client.0.smithi138.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_25 flags=8 2024-09-14T11:21:15.442 INFO:tasks.workunit.client.0.smithi138.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_26 flags=8 2024-09-14T11:21:15.442 INFO:tasks.workunit.client.0.smithi138.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_27 flags=8 2024-09-14T11:21:15.442 INFO:tasks.workunit.client.0.smithi138.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_28 flags=8 2024-09-14T11:21:15.443 INFO:tasks.workunit.client.0.smithi138.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_29 flags=8 2024-09-14T11:21:15.443 INFO:tasks.workunit.client.0.smithi138.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_3 flags=8 2024-09-14T11:21:15.443 INFO:tasks.workunit.client.0.smithi138.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_30 flags=8 2024-09-14T11:21:15.443 INFO:tasks.workunit.client.0.smithi138.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_31 flags=8 2024-09-14T11:21:15.443 INFO:tasks.workunit.client.0.smithi138.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_32 flags=8 2024-09-14T11:21:15.443 INFO:tasks.workunit.client.0.smithi138.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_33 flags=8 2024-09-14T11:21:15.443 INFO:tasks.workunit.client.0.smithi138.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_34 flags=8 2024-09-14T11:21:15.443 INFO:tasks.workunit.client.0.smithi138.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_35 flags=8 2024-09-14T11:21:15.443 INFO:tasks.workunit.client.0.smithi138.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_36 flags=8 2024-09-14T11:21:15.443 INFO:tasks.workunit.client.0.smithi138.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_37 flags=8 2024-09-14T11:21:15.443 INFO:tasks.workunit.client.0.smithi138.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_38 flags=8 2024-09-14T11:21:15.443 INFO:tasks.workunit.client.0.smithi138.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_39 flags=8 2024-09-14T11:21:15.443 INFO:tasks.workunit.client.0.smithi138.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_4 flags=8 2024-09-14T11:21:15.443 INFO:tasks.workunit.client.0.smithi138.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_40 flags=8 2024-09-14T11:21:15.444 INFO:tasks.workunit.client.0.smithi138.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_41 flags=8 2024-09-14T11:21:15.444 INFO:tasks.workunit.client.0.smithi138.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_42 flags=8 2024-09-14T11:21:15.444 INFO:tasks.workunit.client.0.smithi138.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_43 flags=8 2024-09-14T11:21:15.444 INFO:tasks.workunit.client.0.smithi138.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_44 flags=8 2024-09-14T11:21:15.444 INFO:tasks.workunit.client.0.smithi138.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_45 flags=8 2024-09-14T11:21:15.444 INFO:tasks.workunit.client.0.smithi138.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_46 flags=8 2024-09-14T11:21:15.444 INFO:tasks.workunit.client.0.smithi138.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_47 flags=8 2024-09-14T11:21:15.444 INFO:tasks.workunit.client.0.smithi138.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_48 flags=8 2024-09-14T11:21:15.444 INFO:tasks.workunit.client.0.smithi138.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_49 flags=8 2024-09-14T11:21:15.444 INFO:tasks.workunit.client.0.smithi138.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_5 flags=8 2024-09-14T11:21:15.444 INFO:tasks.workunit.client.0.smithi138.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_50 flags=8 2024-09-14T11:21:15.444 INFO:tasks.workunit.client.0.smithi138.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_51 flags=8 2024-09-14T11:21:15.444 INFO:tasks.workunit.client.0.smithi138.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_52 flags=8 2024-09-14T11:21:15.444 INFO:tasks.workunit.client.0.smithi138.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_53 flags=8 2024-09-14T11:21:15.445 INFO:tasks.workunit.client.0.smithi138.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_54 flags=8 2024-09-14T11:21:15.445 INFO:tasks.workunit.client.0.smithi138.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_55 flags=8 2024-09-14T11:21:15.445 INFO:tasks.workunit.client.0.smithi138.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_56 flags=8 2024-09-14T11:21:15.445 INFO:tasks.workunit.client.0.smithi138.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_57 flags=8 2024-09-14T11:21:15.445 INFO:tasks.workunit.client.0.smithi138.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_58 flags=8 2024-09-14T11:21:15.445 INFO:tasks.workunit.client.0.smithi138.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_59 flags=8 2024-09-14T11:21:15.445 INFO:tasks.workunit.client.0.smithi138.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_6 flags=8 2024-09-14T11:21:15.445 INFO:tasks.workunit.client.0.smithi138.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_60 flags=8 2024-09-14T11:21:15.445 INFO:tasks.workunit.client.0.smithi138.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_61 flags=8 2024-09-14T11:21:15.445 INFO:tasks.workunit.client.0.smithi138.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_62 flags=8 2024-09-14T11:21:15.445 INFO:tasks.workunit.client.0.smithi138.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_63 flags=8 2024-09-14T11:21:15.445 INFO:tasks.workunit.client.0.smithi138.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_64 flags=8 2024-09-14T11:21:15.445 INFO:tasks.workunit.client.0.smithi138.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_65 flags=8 2024-09-14T11:21:15.445 INFO:tasks.workunit.client.0.smithi138.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_66 flags=8 2024-09-14T11:21:15.446 INFO:tasks.workunit.client.0.smithi138.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_67 flags=8 2024-09-14T11:21:15.446 INFO:tasks.workunit.client.0.smithi138.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_68 flags=8 2024-09-14T11:21:15.446 INFO:tasks.workunit.client.0.smithi138.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_69 flags=8 2024-09-14T11:21:15.446 INFO:tasks.workunit.client.0.smithi138.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_7 flags=8 2024-09-14T11:21:15.446 INFO:tasks.workunit.client.0.smithi138.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_70 flags=8 2024-09-14T11:21:15.446 INFO:tasks.workunit.client.0.smithi138.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_71 flags=8 2024-09-14T11:21:15.446 INFO:tasks.workunit.client.0.smithi138.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_72 flags=8 2024-09-14T11:21:15.446 INFO:tasks.workunit.client.0.smithi138.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_73 flags=8 2024-09-14T11:21:15.446 INFO:tasks.workunit.client.0.smithi138.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_74 flags=8 2024-09-14T11:21:15.446 INFO:tasks.workunit.client.0.smithi138.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_75 flags=8 2024-09-14T11:21:15.446 INFO:tasks.workunit.client.0.smithi138.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_76 flags=8 2024-09-14T11:21:15.446 INFO:tasks.workunit.client.0.smithi138.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_77 flags=8 2024-09-14T11:21:15.446 INFO:tasks.workunit.client.0.smithi138.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_78 flags=8 2024-09-14T11:21:15.446 INFO:tasks.workunit.client.0.smithi138.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_79 flags=8 2024-09-14T11:21:15.446 INFO:tasks.workunit.client.0.smithi138.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_8 flags=8 2024-09-14T11:21:15.446 INFO:tasks.workunit.client.0.smithi138.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_80 flags=8 2024-09-14T11:21:15.447 INFO:tasks.workunit.client.0.smithi138.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_81 flags=8 2024-09-14T11:21:15.447 INFO:tasks.workunit.client.0.smithi138.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_82 flags=8 2024-09-14T11:21:15.447 INFO:tasks.workunit.client.0.smithi138.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_83 flags=8 2024-09-14T11:21:15.447 INFO:tasks.workunit.client.0.smithi138.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_84 flags=8 2024-09-14T11:21:15.447 INFO:tasks.workunit.client.0.smithi138.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_85 flags=8 2024-09-14T11:21:15.447 INFO:tasks.workunit.client.0.smithi138.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_86 flags=8 2024-09-14T11:21:15.447 INFO:tasks.workunit.client.0.smithi138.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_87 flags=8 2024-09-14T11:21:15.447 INFO:tasks.workunit.client.0.smithi138.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_88 flags=8 2024-09-14T11:21:15.447 INFO:tasks.workunit.client.0.smithi138.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_89 flags=8 2024-09-14T11:21:15.447 INFO:tasks.workunit.client.0.smithi138.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_9 flags=8 2024-09-14T11:21:15.447 INFO:tasks.workunit.client.0.smithi138.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_90 flags=8 2024-09-14T11:21:15.447 INFO:tasks.workunit.client.0.smithi138.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_91 flags=8 2024-09-14T11:21:15.447 INFO:tasks.workunit.client.0.smithi138.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_92 flags=8 2024-09-14T11:21:15.447 INFO:tasks.workunit.client.0.smithi138.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_93 flags=8 2024-09-14T11:21:15.448 INFO:tasks.workunit.client.0.smithi138.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_94 flags=8 2024-09-14T11:21:15.448 INFO:tasks.workunit.client.0.smithi138.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_95 flags=8 2024-09-14T11:21:15.448 INFO:tasks.workunit.client.0.smithi138.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_96 flags=8 2024-09-14T11:21:15.448 INFO:tasks.workunit.client.0.smithi138.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_97 flags=8 2024-09-14T11:21:15.448 INFO:tasks.workunit.client.0.smithi138.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_98 flags=8 2024-09-14T11:21:15.448 INFO:tasks.workunit.client.0.smithi138.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_99 flags=8 2024-09-14T11:21:15.448 INFO:tasks.workunit.client.0.smithi138.stdout:[ OK ] LibRGW.MARKER2_READDIR (6 ms) 2024-09-14T11:21:15.448 INFO:tasks.workunit.client.0.smithi138.stdout:[ RUN ] LibRGW.MARKER1_OBJ_CLEANUP 2024-09-14T11:21:15.448 INFO:tasks.workunit.client.0.smithi138.stdout:[ OK ] LibRGW.MARKER1_OBJ_CLEANUP (0 ms) 2024-09-14T11:21:15.448 INFO:tasks.workunit.client.0.smithi138.stdout:[ RUN ] LibRGW.CLEANUP 2024-09-14T11:21:15.448 INFO:tasks.workunit.client.0.smithi138.stdout:[ OK ] LibRGW.CLEANUP (0 ms) 2024-09-14T11:21:15.448 INFO:tasks.workunit.client.0.smithi138.stdout:[ RUN ] LibRGW.UMOUNT 2024-09-14T11:21:15.448 INFO:tasks.workunit.client.0.smithi138.stdout:[ OK ] LibRGW.UMOUNT (0 ms) 2024-09-14T11:21:15.448 INFO:tasks.workunit.client.0.smithi138.stdout:[ RUN ] LibRGW.SHUTDOWN 2024-09-14T11:21:15.449 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:21:15.444+0000 7fb79973da80 -1 shutting down 2024-09-14T11:21:15.449 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:21:15.448+0000 7fb67348f640 -1 received signal: User defined signal 1, si_code : -6, si_value (int): 0, si_value (ptr): 0, si_errno: 0, si_pid : 60499, si_uid : 1000, si_addr0x3e80000ec53, si_status0 2024-09-14T11:21:44.362 INFO:tasks.workunit.client.0.smithi138.stdout:[ OK ] LibRGW.SHUTDOWN (28924 ms) 2024-09-14T11:21:44.363 INFO:tasks.workunit.client.0.smithi138.stdout:[----------] 11 tests from LibRGW (30577 ms total) 2024-09-14T11:21:44.363 INFO:tasks.workunit.client.0.smithi138.stdout: 2024-09-14T11:21:44.363 INFO:tasks.workunit.client.0.smithi138.stdout:[----------] Global test environment tear-down 2024-09-14T11:21:44.363 INFO:tasks.workunit.client.0.smithi138.stdout:[==========] 11 tests from 1 test suite ran. (30577 ms total) 2024-09-14T11:21:44.363 INFO:tasks.workunit.client.0.smithi138.stdout:[ PASSED ] 11 tests. 2024-09-14T11:21:44.377 INFO:tasks.workunit.client.0.smithi138.stdout:phase 4.2 2024-09-14T11:21:44.400 INFO:tasks.workunit.client.0.smithi138.stdout:[==========] Running 11 tests from 1 test suite. 2024-09-14T11:21:44.400 INFO:tasks.workunit.client.0.smithi138.stdout:[----------] Global test environment set-up. 2024-09-14T11:21:44.401 INFO:tasks.workunit.client.0.smithi138.stdout:[----------] 11 tests from LibRGW 2024-09-14T11:21:44.401 INFO:tasks.workunit.client.0.smithi138.stdout:[ RUN ] LibRGW.TVAR 2024-09-14T11:21:44.401 INFO:tasks.workunit.client.0.smithi138.stdout:read i1: 64001 2024-09-14T11:21:44.401 INFO:tasks.workunit.client.0.smithi138.stdout:read s1: blunderbuss 2024-09-14T11:21:44.401 INFO:tasks.workunit.client.0.smithi138.stdout:read s3: [ OK ] LibRGW.TVAR (0 ms) 2024-09-14T11:21:44.401 INFO:tasks.workunit.client.0.smithi138.stdout:[ RUN ] LibRGW.INIT 2024-09-14T11:21:44.410 INFO:tasks.workunit.client.0.smithi138.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:21:44.410 INFO:tasks.workunit.client.0.smithi138.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:21:45.159 INFO:tasks.workunit.client.0.smithi138.stdout:[ OK ] LibRGW.INIT (758 ms) 2024-09-14T11:21:45.159 INFO:tasks.workunit.client.0.smithi138.stdout:[ RUN ] LibRGW.MOUNT 2024-09-14T11:21:45.160 INFO:tasks.workunit.client.0.smithi138.stdout:[ OK ] LibRGW.MOUNT (2 ms) 2024-09-14T11:21:45.160 INFO:tasks.workunit.client.0.smithi138.stdout:[ RUN ] LibRGW.MARKER1_SETUP_BUCKET 2024-09-14T11:21:45.181 INFO:tasks.workunit.client.0.smithi138.stdout:[ OK ] LibRGW.MARKER1_SETUP_BUCKET (21 ms) 2024-09-14T11:21:45.181 INFO:tasks.workunit.client.0.smithi138.stdout:[ RUN ] LibRGW.MARKER1_SETUP_OBJECTS 2024-09-14T11:21:45.181 INFO:tasks.workunit.client.0.smithi138.stdout:[ OK ] LibRGW.MARKER1_SETUP_OBJECTS (0 ms) 2024-09-14T11:21:45.182 INFO:tasks.workunit.client.0.smithi138.stdout:[ RUN ] LibRGW.MARKER1_READDIR 2024-09-14T11:21:45.182 INFO:tasks.workunit.client.0.smithi138.stdout:[ OK ] LibRGW.MARKER1_READDIR (0 ms) 2024-09-14T11:21:45.182 INFO:tasks.workunit.client.0.smithi138.stdout:[ RUN ] LibRGW.MARKER2_READDIR 2024-09-14T11:21:45.189 INFO:tasks.workunit.client.0.smithi138.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_0 flags=8 2024-09-14T11:21:45.189 INFO:tasks.workunit.client.0.smithi138.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_1 flags=8 2024-09-14T11:21:45.189 INFO:tasks.workunit.client.0.smithi138.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_10 flags=8 2024-09-14T11:21:45.189 INFO:tasks.workunit.client.0.smithi138.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_11 flags=8 2024-09-14T11:21:45.189 INFO:tasks.workunit.client.0.smithi138.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_12 flags=8 2024-09-14T11:21:45.189 INFO:tasks.workunit.client.0.smithi138.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_13 flags=8 2024-09-14T11:21:45.189 INFO:tasks.workunit.client.0.smithi138.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_14 flags=8 2024-09-14T11:21:45.189 INFO:tasks.workunit.client.0.smithi138.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_15 flags=8 2024-09-14T11:21:45.189 INFO:tasks.workunit.client.0.smithi138.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_16 flags=8 2024-09-14T11:21:45.189 INFO:tasks.workunit.client.0.smithi138.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_17 flags=8 2024-09-14T11:21:45.190 INFO:tasks.workunit.client.0.smithi138.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_18 flags=8 2024-09-14T11:21:45.190 INFO:tasks.workunit.client.0.smithi138.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_19 flags=8 2024-09-14T11:21:45.190 INFO:tasks.workunit.client.0.smithi138.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_2 flags=8 2024-09-14T11:21:45.190 INFO:tasks.workunit.client.0.smithi138.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_20 flags=8 2024-09-14T11:21:45.190 INFO:tasks.workunit.client.0.smithi138.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_21 flags=8 2024-09-14T11:21:45.190 INFO:tasks.workunit.client.0.smithi138.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_22 flags=8 2024-09-14T11:21:45.190 INFO:tasks.workunit.client.0.smithi138.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_23 flags=8 2024-09-14T11:21:45.190 INFO:tasks.workunit.client.0.smithi138.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_24 flags=8 2024-09-14T11:21:45.190 INFO:tasks.workunit.client.0.smithi138.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_25 flags=8 2024-09-14T11:21:45.190 INFO:tasks.workunit.client.0.smithi138.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_26 flags=8 2024-09-14T11:21:45.190 INFO:tasks.workunit.client.0.smithi138.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_27 flags=8 2024-09-14T11:21:45.190 INFO:tasks.workunit.client.0.smithi138.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_28 flags=8 2024-09-14T11:21:45.191 INFO:tasks.workunit.client.0.smithi138.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_29 flags=8 2024-09-14T11:21:45.191 INFO:tasks.workunit.client.0.smithi138.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_3 flags=8 2024-09-14T11:21:45.191 INFO:tasks.workunit.client.0.smithi138.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_30 flags=8 2024-09-14T11:21:45.191 INFO:tasks.workunit.client.0.smithi138.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_31 flags=8 2024-09-14T11:21:45.191 INFO:tasks.workunit.client.0.smithi138.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_32 flags=8 2024-09-14T11:21:45.191 INFO:tasks.workunit.client.0.smithi138.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_33 flags=8 2024-09-14T11:21:45.191 INFO:tasks.workunit.client.0.smithi138.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_34 flags=8 2024-09-14T11:21:45.191 INFO:tasks.workunit.client.0.smithi138.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_35 flags=8 2024-09-14T11:21:45.191 INFO:tasks.workunit.client.0.smithi138.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_36 flags=8 2024-09-14T11:21:45.191 INFO:tasks.workunit.client.0.smithi138.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_37 flags=8 2024-09-14T11:21:45.191 INFO:tasks.workunit.client.0.smithi138.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_38 flags=8 2024-09-14T11:21:45.192 INFO:tasks.workunit.client.0.smithi138.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_39 flags=8 2024-09-14T11:21:45.192 INFO:tasks.workunit.client.0.smithi138.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_4 flags=8 2024-09-14T11:21:45.192 INFO:tasks.workunit.client.0.smithi138.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_40 flags=8 2024-09-14T11:21:45.192 INFO:tasks.workunit.client.0.smithi138.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_41 flags=8 2024-09-14T11:21:45.192 INFO:tasks.workunit.client.0.smithi138.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_42 flags=8 2024-09-14T11:21:45.192 INFO:tasks.workunit.client.0.smithi138.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_43 flags=8 2024-09-14T11:21:45.192 INFO:tasks.workunit.client.0.smithi138.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_44 flags=8 2024-09-14T11:21:45.192 INFO:tasks.workunit.client.0.smithi138.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_45 flags=8 2024-09-14T11:21:45.192 INFO:tasks.workunit.client.0.smithi138.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_46 flags=8 2024-09-14T11:21:45.192 INFO:tasks.workunit.client.0.smithi138.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_47 flags=8 2024-09-14T11:21:45.193 INFO:tasks.workunit.client.0.smithi138.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_48 flags=8 2024-09-14T11:21:45.193 INFO:tasks.workunit.client.0.smithi138.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_49 flags=8 2024-09-14T11:21:45.193 INFO:tasks.workunit.client.0.smithi138.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_5 flags=8 2024-09-14T11:21:45.193 INFO:tasks.workunit.client.0.smithi138.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_50 flags=8 2024-09-14T11:21:45.193 INFO:tasks.workunit.client.0.smithi138.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_51 flags=8 2024-09-14T11:21:45.193 INFO:tasks.workunit.client.0.smithi138.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_52 flags=8 2024-09-14T11:21:45.193 INFO:tasks.workunit.client.0.smithi138.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_53 flags=8 2024-09-14T11:21:45.193 INFO:tasks.workunit.client.0.smithi138.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_54 flags=8 2024-09-14T11:21:45.193 INFO:tasks.workunit.client.0.smithi138.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_55 flags=8 2024-09-14T11:21:45.193 INFO:tasks.workunit.client.0.smithi138.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_56 flags=8 2024-09-14T11:21:45.193 INFO:tasks.workunit.client.0.smithi138.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_57 flags=8 2024-09-14T11:21:45.194 INFO:tasks.workunit.client.0.smithi138.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_58 flags=8 2024-09-14T11:21:45.194 INFO:tasks.workunit.client.0.smithi138.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_59 flags=8 2024-09-14T11:21:45.194 INFO:tasks.workunit.client.0.smithi138.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_6 flags=8 2024-09-14T11:21:45.194 INFO:tasks.workunit.client.0.smithi138.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_60 flags=8 2024-09-14T11:21:45.194 INFO:tasks.workunit.client.0.smithi138.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_61 flags=8 2024-09-14T11:21:45.194 INFO:tasks.workunit.client.0.smithi138.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_62 flags=8 2024-09-14T11:21:45.194 INFO:tasks.workunit.client.0.smithi138.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_63 flags=8 2024-09-14T11:21:45.194 INFO:tasks.workunit.client.0.smithi138.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_64 flags=8 2024-09-14T11:21:45.194 INFO:tasks.workunit.client.0.smithi138.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_65 flags=8 2024-09-14T11:21:45.194 INFO:tasks.workunit.client.0.smithi138.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_66 flags=8 2024-09-14T11:21:45.194 INFO:tasks.workunit.client.0.smithi138.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_67 flags=8 2024-09-14T11:21:45.194 INFO:tasks.workunit.client.0.smithi138.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_68 flags=8 2024-09-14T11:21:45.195 INFO:tasks.workunit.client.0.smithi138.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_69 flags=8 2024-09-14T11:21:45.195 INFO:tasks.workunit.client.0.smithi138.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_7 flags=8 2024-09-14T11:21:45.195 INFO:tasks.workunit.client.0.smithi138.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_70 flags=8 2024-09-14T11:21:45.195 INFO:tasks.workunit.client.0.smithi138.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_71 flags=8 2024-09-14T11:21:45.195 INFO:tasks.workunit.client.0.smithi138.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_72 flags=8 2024-09-14T11:21:45.195 INFO:tasks.workunit.client.0.smithi138.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_73 flags=8 2024-09-14T11:21:45.195 INFO:tasks.workunit.client.0.smithi138.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_74 flags=8 2024-09-14T11:21:45.195 INFO:tasks.workunit.client.0.smithi138.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_75 flags=8 2024-09-14T11:21:45.195 INFO:tasks.workunit.client.0.smithi138.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_76 flags=8 2024-09-14T11:21:45.195 INFO:tasks.workunit.client.0.smithi138.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_77 flags=8 2024-09-14T11:21:45.196 INFO:tasks.workunit.client.0.smithi138.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_78 flags=8 2024-09-14T11:21:45.196 INFO:tasks.workunit.client.0.smithi138.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_79 flags=8 2024-09-14T11:21:45.196 INFO:tasks.workunit.client.0.smithi138.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_8 flags=8 2024-09-14T11:21:45.196 INFO:tasks.workunit.client.0.smithi138.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_80 flags=8 2024-09-14T11:21:45.196 INFO:tasks.workunit.client.0.smithi138.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_81 flags=8 2024-09-14T11:21:45.196 INFO:tasks.workunit.client.0.smithi138.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_82 flags=8 2024-09-14T11:21:45.196 INFO:tasks.workunit.client.0.smithi138.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_83 flags=8 2024-09-14T11:21:45.196 INFO:tasks.workunit.client.0.smithi138.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_84 flags=8 2024-09-14T11:21:45.196 INFO:tasks.workunit.client.0.smithi138.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_85 flags=8 2024-09-14T11:21:45.196 INFO:tasks.workunit.client.0.smithi138.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_86 flags=8 2024-09-14T11:21:45.196 INFO:tasks.workunit.client.0.smithi138.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_87 flags=8 2024-09-14T11:21:45.197 INFO:tasks.workunit.client.0.smithi138.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_88 flags=8 2024-09-14T11:21:45.197 INFO:tasks.workunit.client.0.smithi138.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_89 flags=8 2024-09-14T11:21:45.197 INFO:tasks.workunit.client.0.smithi138.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_9 flags=8 2024-09-14T11:21:45.197 INFO:tasks.workunit.client.0.smithi138.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_90 flags=8 2024-09-14T11:21:45.197 INFO:tasks.workunit.client.0.smithi138.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_91 flags=8 2024-09-14T11:21:45.197 INFO:tasks.workunit.client.0.smithi138.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_92 flags=8 2024-09-14T11:21:45.197 INFO:tasks.workunit.client.0.smithi138.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_93 flags=8 2024-09-14T11:21:45.197 INFO:tasks.workunit.client.0.smithi138.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_94 flags=8 2024-09-14T11:21:45.197 INFO:tasks.workunit.client.0.smithi138.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_95 flags=8 2024-09-14T11:21:45.197 INFO:tasks.workunit.client.0.smithi138.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_96 flags=8 2024-09-14T11:21:45.197 INFO:tasks.workunit.client.0.smithi138.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_97 flags=8 2024-09-14T11:21:45.197 INFO:tasks.workunit.client.0.smithi138.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_98 flags=8 2024-09-14T11:21:45.197 INFO:tasks.workunit.client.0.smithi138.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_99 flags=8 2024-09-14T11:21:45.198 INFO:tasks.workunit.client.0.smithi138.stdout:[ OK ] LibRGW.MARKER2_READDIR (7 ms) 2024-09-14T11:21:45.198 INFO:tasks.workunit.client.0.smithi138.stdout:[ RUN ] LibRGW.MARKER1_OBJ_CLEANUP 2024-09-14T11:21:45.198 INFO:tasks.workunit.client.0.smithi138.stdout:[ OK ] LibRGW.MARKER1_OBJ_CLEANUP (0 ms) 2024-09-14T11:21:45.198 INFO:tasks.workunit.client.0.smithi138.stdout:[ RUN ] LibRGW.CLEANUP 2024-09-14T11:21:45.198 INFO:tasks.workunit.client.0.smithi138.stdout:[ OK ] LibRGW.CLEANUP (0 ms) 2024-09-14T11:21:45.198 INFO:tasks.workunit.client.0.smithi138.stdout:[ RUN ] LibRGW.UMOUNT 2024-09-14T11:21:45.198 INFO:tasks.workunit.client.0.smithi138.stdout:[ OK ] LibRGW.UMOUNT (0 ms) 2024-09-14T11:21:45.198 INFO:tasks.workunit.client.0.smithi138.stdout:[ RUN ] LibRGW.SHUTDOWN 2024-09-14T11:21:45.198 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:21:45.195+0000 7feeef50aa80 -1 shutting down 2024-09-14T11:21:45.199 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:21:45.195+0000 7fedc925c640 -1 received signal: User defined signal 1, si_code : -6, si_value (int): 0, si_value (ptr): 0, si_errno: 0, si_pid : 61146, si_uid : 1000, si_addr0x3e80000eeda, si_status0 2024-09-14T11:22:15.386 INFO:tasks.workunit.client.0.smithi138.stdout:[ OK ] LibRGW.SHUTDOWN (30198 ms) 2024-09-14T11:22:15.386 INFO:tasks.workunit.client.0.smithi138.stdout:[----------] 11 tests from LibRGW (30986 ms total) 2024-09-14T11:22:15.386 INFO:tasks.workunit.client.0.smithi138.stdout: 2024-09-14T11:22:15.386 INFO:tasks.workunit.client.0.smithi138.stdout:[----------] Global test environment tear-down 2024-09-14T11:22:15.386 INFO:tasks.workunit.client.0.smithi138.stdout:[==========] 11 tests from 1 test suite ran. (30986 ms total) 2024-09-14T11:22:15.387 INFO:tasks.workunit.client.0.smithi138.stdout:[ PASSED ] 11 tests. 2024-09-14T11:22:15.400 INFO:tasks.workunit.client.0.smithi138.stdout:phase 5.1 2024-09-14T11:22:15.434 INFO:tasks.workunit.client.0.smithi138.stdout:[==========] Running 19 tests from 1 test suite. 2024-09-14T11:22:15.435 INFO:tasks.workunit.client.0.smithi138.stdout:[----------] Global test environment set-up. 2024-09-14T11:22:15.435 INFO:tasks.workunit.client.0.smithi138.stdout:[----------] 19 tests from LibRGW 2024-09-14T11:22:15.435 INFO:tasks.workunit.client.0.smithi138.stdout:[ RUN ] LibRGW.INIT 2024-09-14T11:22:15.446 INFO:tasks.workunit.client.0.smithi138.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:22:15.446 INFO:tasks.workunit.client.0.smithi138.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:22:16.175 INFO:tasks.workunit.client.0.smithi138.stdout:[ OK ] LibRGW.INIT (741 ms) 2024-09-14T11:22:16.175 INFO:tasks.workunit.client.0.smithi138.stdout:[ RUN ] LibRGW.MOUNT 2024-09-14T11:22:16.177 INFO:tasks.workunit.client.0.smithi138.stdout:[ OK ] LibRGW.MOUNT (1 ms) 2024-09-14T11:22:16.177 INFO:tasks.workunit.client.0.smithi138.stdout:[ RUN ] LibRGW.CREATE_BUCKET 2024-09-14T11:22:16.193 INFO:tasks.workunit.client.0.smithi138.stdout:[ OK ] LibRGW.CREATE_BUCKET (17 ms) 2024-09-14T11:22:16.193 INFO:tasks.workunit.client.0.smithi138.stdout:[ RUN ] LibRGW.LOOKUP_BUCKET 2024-09-14T11:22:16.199 INFO:tasks.workunit.client.0.smithi138.stdout:[ OK ] LibRGW.LOOKUP_BUCKET (6 ms) 2024-09-14T11:22:16.199 INFO:tasks.workunit.client.0.smithi138.stdout:[ RUN ] LibRGW.LIST_OBJECTS 2024-09-14T11:22:16.199 INFO:tasks.workunit.client.0.smithi138.stdout:[ OK ] LibRGW.LIST_OBJECTS (0 ms) 2024-09-14T11:22:16.199 INFO:tasks.workunit.client.0.smithi138.stdout:[ RUN ] LibRGW.LOOKUP_OBJECT 2024-09-14T11:22:16.202 INFO:tasks.workunit.client.0.smithi138.stdout:[ OK ] LibRGW.LOOKUP_OBJECT (3 ms) 2024-09-14T11:22:16.202 INFO:tasks.workunit.client.0.smithi138.stdout:[ RUN ] LibRGW.OBJ_OPEN 2024-09-14T11:22:16.202 INFO:tasks.workunit.client.0.smithi138.stdout:[ OK ] LibRGW.OBJ_OPEN (0 ms) 2024-09-14T11:22:16.202 INFO:tasks.workunit.client.0.smithi138.stdout:[ RUN ] LibRGW.PUT_OBJECT 2024-09-14T11:22:16.206 INFO:tasks.workunit.client.0.smithi138.stdout:[ OK ] LibRGW.PUT_OBJECT (4 ms) 2024-09-14T11:22:16.206 INFO:tasks.workunit.client.0.smithi138.stdout:[ RUN ] LibRGW.GET_OBJECT 2024-09-14T11:22:16.210 INFO:tasks.workunit.client.0.smithi138.stdout:[ OK ] LibRGW.GET_OBJECT (4 ms) 2024-09-14T11:22:16.210 INFO:tasks.workunit.client.0.smithi138.stdout:[ RUN ] LibRGW.STAT_OBJECT 2024-09-14T11:22:16.210 INFO:tasks.workunit.client.0.smithi138.stdout:[ OK ] LibRGW.STAT_OBJECT (0 ms) 2024-09-14T11:22:16.210 INFO:tasks.workunit.client.0.smithi138.stdout:[ RUN ] LibRGW.WRITE_READ_VERIFY 2024-09-14T11:22:16.210 INFO:tasks.workunit.client.0.smithi138.stdout:[ OK ] LibRGW.WRITE_READ_VERIFY (0 ms) 2024-09-14T11:22:16.210 INFO:tasks.workunit.client.0.smithi138.stdout:[ RUN ] LibRGW.WRITEV 2024-09-14T11:22:16.211 INFO:tasks.workunit.client.0.smithi138.stdout:[ OK ] LibRGW.WRITEV (0 ms) 2024-09-14T11:22:16.211 INFO:tasks.workunit.client.0.smithi138.stdout:[ RUN ] LibRGW.READV 2024-09-14T11:22:16.211 INFO:tasks.workunit.client.0.smithi138.stdout:[ OK ] LibRGW.READV (0 ms) 2024-09-14T11:22:16.211 INFO:tasks.workunit.client.0.smithi138.stdout:[ RUN ] LibRGW.READV_AFTER_WRITEV 2024-09-14T11:22:16.211 INFO:tasks.workunit.client.0.smithi138.stdout:[ OK ] LibRGW.READV_AFTER_WRITEV (0 ms) 2024-09-14T11:22:16.211 INFO:tasks.workunit.client.0.smithi138.stdout:[ RUN ] LibRGW.DELETE_OBJECT 2024-09-14T11:22:16.211 INFO:tasks.workunit.client.0.smithi138.stdout:[ OK ] LibRGW.DELETE_OBJECT (0 ms) 2024-09-14T11:22:16.211 INFO:tasks.workunit.client.0.smithi138.stdout:[ RUN ] LibRGW.DELETE_BUCKET 2024-09-14T11:22:16.211 INFO:tasks.workunit.client.0.smithi138.stdout:[ OK ] LibRGW.DELETE_BUCKET (0 ms) 2024-09-14T11:22:16.211 INFO:tasks.workunit.client.0.smithi138.stdout:[ RUN ] LibRGW.CLEANUP 2024-09-14T11:22:16.211 INFO:tasks.workunit.client.0.smithi138.stdout:[ OK ] LibRGW.CLEANUP (0 ms) 2024-09-14T11:22:16.211 INFO:tasks.workunit.client.0.smithi138.stdout:[ RUN ] LibRGW.UMOUNT 2024-09-14T11:22:16.211 INFO:tasks.workunit.client.0.smithi138.stdout:[ OK ] LibRGW.UMOUNT (0 ms) 2024-09-14T11:22:16.211 INFO:tasks.workunit.client.0.smithi138.stdout:[ RUN ] LibRGW.SHUTDOWN 2024-09-14T11:22:16.212 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:22:16.215+0000 7f07713dea80 -1 shutting down 2024-09-14T11:22:16.212 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:22:16.219+0000 7f064b130640 -1 received signal: User defined signal 1, si_code : -6, si_value (int): 0, si_value (ptr): 0, si_errno: 0, si_pid : 61791, si_uid : 1000, si_addr0x3e80000f15f, si_status0 2024-09-14T11:22:46.275 INFO:tasks.workunit.client.0.smithi138.stdout:[ OK ] LibRGW.SHUTDOWN (30064 ms) 2024-09-14T11:22:46.275 INFO:tasks.workunit.client.0.smithi138.stdout:[----------] 19 tests from LibRGW (30840 ms total) 2024-09-14T11:22:46.275 INFO:tasks.workunit.client.0.smithi138.stdout: 2024-09-14T11:22:46.275 INFO:tasks.workunit.client.0.smithi138.stdout:[----------] Global test environment tear-down 2024-09-14T11:22:46.276 INFO:tasks.workunit.client.0.smithi138.stdout:[==========] 19 tests from 1 test suite ran. (30840 ms total) 2024-09-14T11:22:46.276 INFO:tasks.workunit.client.0.smithi138.stdout:[ PASSED ] 19 tests. 2024-09-14T11:22:46.289 INFO:tasks.workunit.client.0.smithi138.stdout:phase 5.2 2024-09-14T11:22:46.324 INFO:tasks.workunit.client.0.smithi138.stdout:[==========] Running 19 tests from 1 test suite. 2024-09-14T11:22:46.324 INFO:tasks.workunit.client.0.smithi138.stdout:[----------] Global test environment set-up. 2024-09-14T11:22:46.324 INFO:tasks.workunit.client.0.smithi138.stdout:[----------] 19 tests from LibRGW 2024-09-14T11:22:46.324 INFO:tasks.workunit.client.0.smithi138.stdout:[ RUN ] LibRGW.INIT 2024-09-14T11:22:46.332 INFO:tasks.workunit.client.0.smithi138.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:22:46.332 INFO:tasks.workunit.client.0.smithi138.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:22:46.858 INFO:tasks.workunit.client.0.smithi138.stdout:[ OK ] LibRGW.INIT (535 ms) 2024-09-14T11:22:46.858 INFO:tasks.workunit.client.0.smithi138.stdout:[ RUN ] LibRGW.MOUNT 2024-09-14T11:22:46.860 INFO:tasks.workunit.client.0.smithi138.stdout:[ OK ] LibRGW.MOUNT (1 ms) 2024-09-14T11:22:46.860 INFO:tasks.workunit.client.0.smithi138.stdout:[ RUN ] LibRGW.CREATE_BUCKET 2024-09-14T11:22:46.860 INFO:tasks.workunit.client.0.smithi138.stdout:[ OK ] LibRGW.CREATE_BUCKET (0 ms) 2024-09-14T11:22:46.860 INFO:tasks.workunit.client.0.smithi138.stdout:[ RUN ] LibRGW.LOOKUP_BUCKET 2024-09-14T11:22:46.870 INFO:tasks.workunit.client.0.smithi138.stdout:[ OK ] LibRGW.LOOKUP_BUCKET (10 ms) 2024-09-14T11:22:46.870 INFO:tasks.workunit.client.0.smithi138.stdout:[ RUN ] LibRGW.LIST_OBJECTS 2024-09-14T11:22:46.870 INFO:tasks.workunit.client.0.smithi138.stdout:[ OK ] LibRGW.LIST_OBJECTS (0 ms) 2024-09-14T11:22:46.870 INFO:tasks.workunit.client.0.smithi138.stdout:[ RUN ] LibRGW.LOOKUP_OBJECT 2024-09-14T11:22:46.870 INFO:tasks.workunit.client.0.smithi138.stdout:[ OK ] LibRGW.LOOKUP_OBJECT (0 ms) 2024-09-14T11:22:46.870 INFO:tasks.workunit.client.0.smithi138.stdout:[ RUN ] LibRGW.OBJ_OPEN 2024-09-14T11:22:46.870 INFO:tasks.workunit.client.0.smithi138.stdout:[ OK ] LibRGW.OBJ_OPEN (0 ms) 2024-09-14T11:22:46.870 INFO:tasks.workunit.client.0.smithi138.stdout:[ RUN ] LibRGW.PUT_OBJECT 2024-09-14T11:22:46.870 INFO:tasks.workunit.client.0.smithi138.stdout:[ OK ] LibRGW.PUT_OBJECT (0 ms) 2024-09-14T11:22:46.870 INFO:tasks.workunit.client.0.smithi138.stdout:[ RUN ] LibRGW.GET_OBJECT 2024-09-14T11:22:46.870 INFO:tasks.workunit.client.0.smithi138.stdout:[ OK ] LibRGW.GET_OBJECT (0 ms) 2024-09-14T11:22:46.870 INFO:tasks.workunit.client.0.smithi138.stdout:[ RUN ] LibRGW.STAT_OBJECT 2024-09-14T11:22:46.871 INFO:tasks.workunit.client.0.smithi138.stdout:[ OK ] LibRGW.STAT_OBJECT (0 ms) 2024-09-14T11:22:46.871 INFO:tasks.workunit.client.0.smithi138.stdout:[ RUN ] LibRGW.WRITE_READ_VERIFY 2024-09-14T11:22:46.871 INFO:tasks.workunit.client.0.smithi138.stdout:[ OK ] LibRGW.WRITE_READ_VERIFY (0 ms) 2024-09-14T11:22:46.871 INFO:tasks.workunit.client.0.smithi138.stdout:[ RUN ] LibRGW.WRITEV 2024-09-14T11:22:46.871 INFO:tasks.workunit.client.0.smithi138.stdout:[ OK ] LibRGW.WRITEV (0 ms) 2024-09-14T11:22:46.871 INFO:tasks.workunit.client.0.smithi138.stdout:[ RUN ] LibRGW.READV 2024-09-14T11:22:46.871 INFO:tasks.workunit.client.0.smithi138.stdout:[ OK ] LibRGW.READV (0 ms) 2024-09-14T11:22:46.871 INFO:tasks.workunit.client.0.smithi138.stdout:[ RUN ] LibRGW.READV_AFTER_WRITEV 2024-09-14T11:22:46.871 INFO:tasks.workunit.client.0.smithi138.stdout:[ OK ] LibRGW.READV_AFTER_WRITEV (0 ms) 2024-09-14T11:22:46.871 INFO:tasks.workunit.client.0.smithi138.stdout:[ RUN ] LibRGW.DELETE_OBJECT 2024-09-14T11:22:46.874 INFO:tasks.workunit.client.0.smithi138.stdout:[ OK ] LibRGW.DELETE_OBJECT (5 ms) 2024-09-14T11:22:46.874 INFO:tasks.workunit.client.0.smithi138.stdout:[ RUN ] LibRGW.DELETE_BUCKET 2024-09-14T11:22:46.926 INFO:tasks.workunit.client.0.smithi138.stdout:[ OK ] LibRGW.DELETE_BUCKET (52 ms) 2024-09-14T11:22:46.926 INFO:tasks.workunit.client.0.smithi138.stdout:[ RUN ] LibRGW.CLEANUP 2024-09-14T11:22:46.926 INFO:tasks.workunit.client.0.smithi138.stdout:[ OK ] LibRGW.CLEANUP (0 ms) 2024-09-14T11:22:46.926 INFO:tasks.workunit.client.0.smithi138.stdout:[ RUN ] LibRGW.UMOUNT 2024-09-14T11:22:46.926 INFO:tasks.workunit.client.0.smithi138.stdout:[ OK ] LibRGW.UMOUNT (0 ms) 2024-09-14T11:22:46.926 INFO:tasks.workunit.client.0.smithi138.stdout:[ RUN ] LibRGW.SHUTDOWN 2024-09-14T11:22:46.927 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:22:46.930+0000 7f6550376a80 -1 shutting down 2024-09-14T11:22:46.929 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:22:46.934+0000 7f642a0c8640 -1 received signal: User defined signal 1, si_code : -6, si_value (int): 0, si_value (ptr): 0, si_errno: 0, si_pid : 62436, si_uid : 1000, si_addr0x3e80000f3e4, si_status0 2024-09-14T11:23:16.973 INFO:tasks.workunit.client.0.smithi138.stdout:[ OK ] LibRGW.SHUTDOWN (30046 ms) 2024-09-14T11:23:16.973 INFO:tasks.workunit.client.0.smithi138.stdout:[----------] 19 tests from LibRGW (30649 ms total) 2024-09-14T11:23:16.973 INFO:tasks.workunit.client.0.smithi138.stdout: 2024-09-14T11:23:16.973 INFO:tasks.workunit.client.0.smithi138.stdout:[----------] Global test environment tear-down 2024-09-14T11:23:16.973 INFO:tasks.workunit.client.0.smithi138.stdout:[==========] 19 tests from 1 test suite ran. (30649 ms total) 2024-09-14T11:23:16.973 INFO:tasks.workunit.client.0.smithi138.stdout:[ PASSED ] 19 tests. 2024-09-14T11:23:16.986 INFO:tasks.workunit.client.0.smithi138.stdout:phase 6.1 2024-09-14T11:23:17.009 INFO:tasks.workunit.client.0.smithi138.stdout:[==========] Running 10 tests from 1 test suite. 2024-09-14T11:23:17.009 INFO:tasks.workunit.client.0.smithi138.stdout:[----------] Global test environment set-up. 2024-09-14T11:23:17.009 INFO:tasks.workunit.client.0.smithi138.stdout:[----------] 10 tests from LibRGW 2024-09-14T11:23:17.009 INFO:tasks.workunit.client.0.smithi138.stdout:[ RUN ] LibRGW.INIT 2024-09-14T11:23:17.018 INFO:tasks.workunit.client.0.smithi138.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:23:17.018 INFO:tasks.workunit.client.0.smithi138.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:23:17.778 INFO:tasks.workunit.client.0.smithi138.stdout:[ OK ] LibRGW.INIT (770 ms) 2024-09-14T11:23:17.779 INFO:tasks.workunit.client.0.smithi138.stdout:[ RUN ] LibRGW.MOUNT 2024-09-14T11:23:17.780 INFO:tasks.workunit.client.0.smithi138.stdout:[ OK ] LibRGW.MOUNT (2 ms) 2024-09-14T11:23:17.780 INFO:tasks.workunit.client.0.smithi138.stdout:[ RUN ] LibRGW.CREATE_BUCKETS 2024-09-14T11:23:17.819 INFO:tasks.workunit.client.0.smithi138.stdout:[ OK ] LibRGW.CREATE_BUCKETS (39 ms) 2024-09-14T11:23:17.819 INFO:tasks.workunit.client.0.smithi138.stdout:[ RUN ] LibRGW.LOOKUP_BUCKETS 2024-09-14T11:23:17.836 INFO:tasks.workunit.client.0.smithi138.stdout:[ OK ] LibRGW.LOOKUP_BUCKETS (16 ms) 2024-09-14T11:23:17.836 INFO:tasks.workunit.client.0.smithi138.stdout:[ RUN ] LibRGW.TOPDIR_RENAME 2024-09-14T11:23:17.868 INFO:tasks.workunit.client.0.smithi138.stdout:[ OK ] LibRGW.TOPDIR_RENAME (33 ms) 2024-09-14T11:23:17.869 INFO:tasks.workunit.client.0.smithi138.stdout:[ RUN ] LibRGW.SUBDIR_RENAME 2024-09-14T11:23:17.912 INFO:tasks.workunit.client.0.smithi138.stdout:[ OK ] LibRGW.SUBDIR_RENAME (43 ms) 2024-09-14T11:23:17.912 INFO:tasks.workunit.client.0.smithi138.stdout:[ RUN ] LibRGW.CROSS_BUCKET_RENAME 2024-09-14T11:23:17.953 INFO:tasks.workunit.client.0.smithi138.stdout:[ OK ] LibRGW.CROSS_BUCKET_RENAME (41 ms) 2024-09-14T11:23:17.953 INFO:tasks.workunit.client.0.smithi138.stdout:[ RUN ] LibRGW.CLEANUP 2024-09-14T11:23:17.953 INFO:tasks.workunit.client.0.smithi138.stdout:[ OK ] LibRGW.CLEANUP (0 ms) 2024-09-14T11:23:17.953 INFO:tasks.workunit.client.0.smithi138.stdout:[ RUN ] LibRGW.UMOUNT 2024-09-14T11:23:17.953 INFO:tasks.workunit.client.0.smithi138.stdout:[ OK ] LibRGW.UMOUNT (0 ms) 2024-09-14T11:23:17.953 INFO:tasks.workunit.client.0.smithi138.stdout:[ RUN ] LibRGW.SHUTDOWN 2024-09-14T11:23:17.953 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:23:17.957+0000 7f3ab79a9a80 -1 shutting down 2024-09-14T11:23:17.955 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:23:17.957+0000 7f39916fb640 -1 received signal: User defined signal 1, si_code : -6, si_value (int): 0, si_value (ptr): 0, si_errno: 0, si_pid : 63082, si_uid : 1000, si_addr0x3e80000f66a, si_status0 2024-09-14T11:23:48.023 INFO:tasks.workunit.client.0.smithi138.stdout:[ OK ] LibRGW.SHUTDOWN (30070 ms) 2024-09-14T11:23:48.023 INFO:tasks.workunit.client.0.smithi138.stdout:[----------] 10 tests from LibRGW (31014 ms total) 2024-09-14T11:23:48.023 INFO:tasks.workunit.client.0.smithi138.stdout: 2024-09-14T11:23:48.024 INFO:tasks.workunit.client.0.smithi138.stdout:[----------] Global test environment tear-down 2024-09-14T11:23:48.024 INFO:tasks.workunit.client.0.smithi138.stdout:[==========] 10 tests from 1 test suite ran. (31014 ms total) 2024-09-14T11:23:48.024 INFO:tasks.workunit.client.0.smithi138.stdout:[ PASSED ] 10 tests. 2024-09-14T11:23:48.038 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-09-14T11:23:48.038 DEBUG:teuthology.orchestra.run.smithi138:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-09-14T11:23:48.054 INFO:tasks.workunit:Running workunits matching rgw/test_awssdkv4_sig.sh on client.0... 2024-09-14T11:23:48.055 INFO:tasks.workunit:Running workunit rgw/test_awssdkv4_sig.sh... 2024-09-14T11:23:48.056 DEBUG:teuthology.orchestra.run.smithi138:workunit test rgw/test_awssdkv4_sig.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=1c941a66c1b420259b8fc5ac19e792dbbf60aded TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/test_awssdkv4_sig.sh 2024-09-14T11:23:48.105 INFO:tasks.workunit.client.0.smithi138.stderr:+ [ -z ] 2024-09-14T11:23:48.105 INFO:tasks.workunit.client.0.smithi138.stderr:+ export AWS_ACCESS_KEY_ID=lNCnR47C2g+ZidCWBAUuwfSAA7Q= 2024-09-14T11:23:48.105 INFO:tasks.workunit.client.0.smithi138.stderr:+ export AWS_SECRET_ACCESS_KEY=tYuA2Y+Uu1ow2l9Xe59tWKVml3gMuVfyhUjjJwfwEI0vFFONIcqf4g== 2024-09-14T11:23:48.105 INFO:tasks.workunit.client.0.smithi138.stderr:+ radosgw-admin user create --uid ceph-test-maven --access-key lNCnR47C2g+ZidCWBAUuwfSAA7Q= --secret tYuA2Y+Uu1ow2l9Xe59tWKVml3gMuVfyhUjjJwfwEI0vFFONIcqf4g== --display-name maven test user --email sigv4@example.com 2024-09-14T11:23:48.147 INFO:tasks.workunit.client.0.smithi138.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:23:48.147 INFO:tasks.workunit.client.0.smithi138.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:23:48.194 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:23:48.197+0000 7f5abf1a69c0 20 rados->read ofs=0 len=0 2024-09-14T11:23:48.196 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:23:48.197+0000 7f5abf1a69c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:23:48.196 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:23:48.197+0000 7f5abf1a69c0 20 realm 2024-09-14T11:23:48.196 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:23:48.197+0000 7f5abf1a69c0 20 rados->read ofs=0 len=0 2024-09-14T11:23:48.196 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:23:48.197+0000 7f5abf1a69c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:23:48.196 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:23:48.197+0000 7f5abf1a69c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:23:48.197 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:23:48.197+0000 7f5abf1a69c0 20 rados->read ofs=0 len=0 2024-09-14T11:23:48.197 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:23:48.201+0000 7f5abf1a69c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:23:48.197 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:23:48.201+0000 7f5abf1a69c0 20 rados->read ofs=0 len=0 2024-09-14T11:23:48.198 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:23:48.201+0000 7f5abf1a69c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:23:48.198 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:23:48.201+0000 7f5abf1a69c0 20 rados->read ofs=0 len=0 2024-09-14T11:23:48.199 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:23:48.201+0000 7f5abf1a69c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:23:48.199 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:23:48.201+0000 7f5abf1a69c0 20 searching for the correct realm 2024-09-14T11:23:48.202 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:23:48.205+0000 7f5abd4ad640 0 -- 172.21.15.138:0/2518748239 >> [v2:172.21.15.154:6824/416768175,v1:172.21.15.154:6825/416768175] conn(0x7f5ab8033bf0 msgr2=0x7f5ab8028430 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:23:48.417 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:23:48.421+0000 7f5ab7fff640 0 -- 172.21.15.138:0/2518748239 >> [v2:172.21.15.138:6816/326481658,v1:172.21.15.138:6817/326481658] conn(0x7f5ab80278e0 msgr2=0x7f5ab800e3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:23:48.635 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:23:48.637+0000 7f5abf1a69c0 20 RGWRados::pool_iterate: got zone_info.d9e72d30-c60b-4d0d-9267-fdc36392d5ad 2024-09-14T11:23:48.635 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:23:48.637+0000 7f5abf1a69c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:23:48.635 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:23:48.637+0000 7f5abf1a69c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:23:48.635 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:23:48.637+0000 7f5abf1a69c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:23:48.636 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:23:48.637+0000 7f5abf1a69c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:23:48.636 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:23:48.637+0000 7f5abf1a69c0 20 RGWRados::pool_iterate: got zonegroup_info.65ab941b-da8c-4160-94fb-3672b069d44f 2024-09-14T11:23:48.636 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:23:48.637+0000 7f5abf1a69c0 20 rados->read ofs=0 len=0 2024-09-14T11:23:48.636 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:23:48.637+0000 7f5abf1a69c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:23:48.636 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:23:48.637+0000 7f5abf1a69c0 20 rados->read ofs=0 len=0 2024-09-14T11:23:48.637 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:23:48.641+0000 7f5abf1a69c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:23:48.637 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:23:48.641+0000 7f5abf1a69c0 20 rados->read ofs=0 len=0 2024-09-14T11:23:48.637 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:23:48.641+0000 7f5abf1a69c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:23:48.637 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:23:48.641+0000 7f5abf1a69c0 20 zone default found 2024-09-14T11:23:48.637 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:23:48.641+0000 7f5abf1a69c0 4 Realm: () 2024-09-14T11:23:48.638 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:23:48.641+0000 7f5abf1a69c0 4 ZoneGroup: default (65ab941b-da8c-4160-94fb-3672b069d44f) 2024-09-14T11:23:48.638 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:23:48.641+0000 7f5abf1a69c0 4 Zone: default (d9e72d30-c60b-4d0d-9267-fdc36392d5ad) 2024-09-14T11:23:48.638 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:23:48.641+0000 7f5abf1a69c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:23:48.638 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:23:48.641+0000 7f5abf1a69c0 20 zonegroup default 2024-09-14T11:23:48.638 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:23:48.641+0000 7f5abf1a69c0 20 rados->read ofs=0 len=0 2024-09-14T11:23:48.639 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:23:48.641+0000 7f5abf1a69c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:23:48.639 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:23:48.641+0000 7f5abf1a69c0 20 rados->read ofs=0 len=0 2024-09-14T11:23:48.639 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:23:48.641+0000 7f5abf1a69c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:23:48.639 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:23:48.641+0000 7f5abf1a69c0 20 rados->read ofs=0 len=0 2024-09-14T11:23:48.639 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:23:48.641+0000 7f5abf1a69c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:23:48.640 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:23:48.641+0000 7f5abf1a69c0 20 started sync module instance, tier type = 2024-09-14T11:23:48.640 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:23:48.641+0000 7f5abf1a69c0 20 started zone id=d9e72d30-c60b-4d0d-9267-fdc36392d5ad (name=default) with tier type = 2024-09-14T11:23:48.663 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:23:48.665+0000 7f5abf1a69c0 20 add_watcher() i=0 2024-09-14T11:23:48.663 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:23:48.665+0000 7f5abf1a69c0 20 add_watcher() i=1 2024-09-14T11:23:48.663 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:23:48.665+0000 7f5abf1a69c0 20 add_watcher() i=2 2024-09-14T11:23:48.663 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:23:48.665+0000 7f5abf1a69c0 20 add_watcher() i=3 2024-09-14T11:23:48.663 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:23:48.665+0000 7f5abf1a69c0 20 add_watcher() i=4 2024-09-14T11:23:48.664 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:23:48.665+0000 7f5abf1a69c0 20 add_watcher() i=5 2024-09-14T11:23:48.664 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:23:48.665+0000 7f5abf1a69c0 20 add_watcher() i=6 2024-09-14T11:23:48.665 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:23:48.669+0000 7f5abf1a69c0 20 add_watcher() i=7 2024-09-14T11:23:48.665 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:23:48.669+0000 7f5abf1a69c0 2 all 8 watchers are set, enabling cache 2024-09-14T11:23:48.670 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:23:48.673+0000 7f59737e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:23:48.671 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:23:48.673+0000 7f5abf1a69c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:23:48.671 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:23:48.673+0000 7f5abf1a69c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:23:48.671 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:23:48.673+0000 7f5abf1a69c0 5 note: GC not initialized 2024-09-14T11:23:48.672 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:23:48.673+0000 7f59727e4640 20 reqs_thread_entry: start 2024-09-14T11:23:48.672 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:23:48.673+0000 7f5abf1a69c0 20 init_complete bucket index max shards: 11 2024-09-14T11:23:48.672 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:23:48.673+0000 7f5abf1a69c0 20 Filter name: none 2024-09-14T11:23:48.673 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:23:48.677+0000 7f596b7fe640 20 reqs_thread_entry: start 2024-09-14T11:23:48.673 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:23:48.677+0000 7f5abf1a69c0 10 cache get: name=default.rgw.meta+users.uid+ceph-test-maven : miss 2024-09-14T11:23:48.673 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:23:48.677+0000 7f5abf1a69c0 20 rados->read ofs=0 len=0 2024-09-14T11:23:48.674 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:23:48.677+0000 7f5abf1a69c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:23:48.674 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:23:48.677+0000 7f5abf1a69c0 10 cache put: name=default.rgw.meta+users.uid+ceph-test-maven info.flags=0x0 2024-09-14T11:23:48.674 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:23:48.677+0000 7f5abf1a69c0 10 adding default.rgw.meta+users.uid+ceph-test-maven to cache LRU end 2024-09-14T11:23:48.674 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:23:48.677+0000 7f5abf1a69c0 10 cache get: name=default.rgw.meta+users.email+sigv4@example.com : miss 2024-09-14T11:23:48.674 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:23:48.677+0000 7f5abf1a69c0 20 rados->read ofs=0 len=0 2024-09-14T11:23:48.674 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:23:48.677+0000 7f5abf1a69c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:23:48.674 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:23:48.677+0000 7f5abf1a69c0 10 cache put: name=default.rgw.meta+users.email+sigv4@example.com info.flags=0x0 2024-09-14T11:23:48.674 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:23:48.677+0000 7f5abf1a69c0 10 adding default.rgw.meta+users.email+sigv4@example.com to cache LRU end 2024-09-14T11:23:48.674 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:23:48.677+0000 7f5abf1a69c0 10 cache get: name=default.rgw.meta+users.keys+lNCnR47C2g+ZidCWBAUuwfSAA7Q= : miss 2024-09-14T11:23:48.674 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:23:48.677+0000 7f5abf1a69c0 20 rados->read ofs=0 len=0 2024-09-14T11:23:48.674 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:23:48.677+0000 7f5abf1a69c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:23:48.675 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:23:48.677+0000 7f5abf1a69c0 10 cache put: name=default.rgw.meta+users.keys+lNCnR47C2g+ZidCWBAUuwfSAA7Q= info.flags=0x0 2024-09-14T11:23:48.675 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:23:48.677+0000 7f5abf1a69c0 10 adding default.rgw.meta+users.keys+lNCnR47C2g+ZidCWBAUuwfSAA7Q= to cache LRU end 2024-09-14T11:23:48.675 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:23:48.677+0000 7f5abf1a69c0 10 cache get: name=default.rgw.meta+users.keys+lNCnR47C2g+ZidCWBAUuwfSAA7Q= : hit (negative entry) 2024-09-14T11:23:48.675 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:23:48.677+0000 7f5abf1a69c0 10 cache get: name=default.rgw.meta+users.keys+lNCnR47C2g+ZidCWBAUuwfSAA7Q= : hit (negative entry) 2024-09-14T11:23:48.675 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:23:48.677+0000 7f5abf1a69c0 10 cache put: name=default.rgw.meta+users.uid+ceph-test-maven info.flags=0x17 2024-09-14T11:23:48.676 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:23:48.677+0000 7f5abf1a69c0 10 moving default.rgw.meta+users.uid+ceph-test-maven to cache LRU end 2024-09-14T11:23:48.676 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:23:48.677+0000 7f5abf1a69c0 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 0, obj: default.rgw.meta:users.uid:ceph-test-maven, ofs0, ns] 2024-09-14T11:23:48.676 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:23:48.681+0000 7f5993fff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1086626725939 cookie 94351789457120 notifier 5399 bl.length()=677 2024-09-14T11:23:48.676 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:23:48.681+0000 7f5993fff640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+ceph-test-maven info.flags=0x17 2024-09-14T11:23:48.676 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:23:48.681+0000 7f5993fff640 10 rgw watcher librados: moving default.rgw.meta+users.uid+ceph-test-maven to cache LRU end 2024-09-14T11:23:48.681 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:23:48.685+0000 7f5abf1a69c0 10 cache put: name=default.rgw.meta+users.email+sigv4@example.com info.flags=0x7 2024-09-14T11:23:48.681 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:23:48.685+0000 7f5abf1a69c0 10 moving default.rgw.meta+users.email+sigv4@example.com to cache LRU end 2024-09-14T11:23:48.681 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:23:48.685+0000 7f5abf1a69c0 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:users.email:sigv4@example.com, ofs0, ns] 2024-09-14T11:23:48.681 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:23:48.685+0000 7f59937fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1086626725895 cookie 94351789442960 notifier 5399 bl.length()=187 2024-09-14T11:23:48.681 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:23:48.685+0000 7f59937fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.email+sigv4@example.com info.flags=0x7 2024-09-14T11:23:48.681 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:23:48.685+0000 7f59937fe640 10 rgw watcher librados: moving default.rgw.meta+users.email+sigv4@example.com to cache LRU end 2024-09-14T11:23:48.687 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:23:48.689+0000 7f5abf1a69c0 10 cache put: name=default.rgw.meta+users.keys+lNCnR47C2g+ZidCWBAUuwfSAA7Q= info.flags=0x7 2024-09-14T11:23:48.687 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:23:48.689+0000 7f5abf1a69c0 10 moving default.rgw.meta+users.keys+lNCnR47C2g+ZidCWBAUuwfSAA7Q= to cache LRU end 2024-09-14T11:23:48.687 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:23:48.689+0000 7f5abf1a69c0 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:users.keys:lNCnR47C2g+ZidCWBAUuwfSAA7Q=, ofs0, ns] 2024-09-14T11:23:48.687 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:23:48.689+0000 7f5993fff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1086626725896 cookie 94351789442960 notifier 5399 bl.length()=197 2024-09-14T11:23:48.687 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:23:48.689+0000 7f5993fff640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.keys+lNCnR47C2g+ZidCWBAUuwfSAA7Q= info.flags=0x7 2024-09-14T11:23:48.688 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:23:48.689+0000 7f5993fff640 10 rgw watcher librados: moving default.rgw.meta+users.keys+lNCnR47C2g+ZidCWBAUuwfSAA7Q= to cache LRU end 2024-09-14T11:23:48.690 INFO:tasks.workunit.client.0.smithi138.stdout:{ 2024-09-14T11:23:48.690 INFO:tasks.workunit.client.0.smithi138.stdout: "user_id": "ceph-test-maven", 2024-09-14T11:23:48.690 INFO:tasks.workunit.client.0.smithi138.stdout: "display_name": "maven test user", 2024-09-14T11:23:48.690 INFO:tasks.workunit.client.0.smithi138.stdout: "email": "sigv4@example.com", 2024-09-14T11:23:48.690 INFO:tasks.workunit.client.0.smithi138.stdout: "suspended": 0, 2024-09-14T11:23:48.690 INFO:tasks.workunit.client.0.smithi138.stdout: "max_buckets": 1000, 2024-09-14T11:23:48.690 INFO:tasks.workunit.client.0.smithi138.stdout: "subusers": [], 2024-09-14T11:23:48.690 INFO:tasks.workunit.client.0.smithi138.stdout: "keys": [ 2024-09-14T11:23:48.690 INFO:tasks.workunit.client.0.smithi138.stdout: { 2024-09-14T11:23:48.690 INFO:tasks.workunit.client.0.smithi138.stdout: "user": "ceph-test-maven", 2024-09-14T11:23:48.690 INFO:tasks.workunit.client.0.smithi138.stdout: "access_key": "lNCnR47C2g+ZidCWBAUuwfSAA7Q=", 2024-09-14T11:23:48.691 INFO:tasks.workunit.client.0.smithi138.stdout: "secret_key": "tYuA2Y+Uu1ow2l9Xe59tWKVml3gMuVfyhUjjJwfwEI0vFFONIcqf4g==", 2024-09-14T11:23:48.691 INFO:tasks.workunit.client.0.smithi138.stdout: "active": true, 2024-09-14T11:23:48.691 INFO:tasks.workunit.client.0.smithi138.stdout: "create_date": "2024-09-14T11:23:48.682669Z" 2024-09-14T11:23:48.691 INFO:tasks.workunit.client.0.smithi138.stdout: } 2024-09-14T11:23:48.691 INFO:tasks.workunit.client.0.smithi138.stdout: ], 2024-09-14T11:23:48.691 INFO:tasks.workunit.client.0.smithi138.stdout: "swift_keys": [], 2024-09-14T11:23:48.691 INFO:tasks.workunit.client.0.smithi138.stdout: "caps": [], 2024-09-14T11:23:48.691 INFO:tasks.workunit.client.0.smithi138.stdout: "op_mask": "read, write, delete", 2024-09-14T11:23:48.691 INFO:tasks.workunit.client.0.smithi138.stdout: "default_placement": "", 2024-09-14T11:23:48.691 INFO:tasks.workunit.client.0.smithi138.stdout: "default_storage_class": "", 2024-09-14T11:23:48.691 INFO:tasks.workunit.client.0.smithi138.stdout: "placement_tags": [], 2024-09-14T11:23:48.692 INFO:tasks.workunit.client.0.smithi138.stdout: "bucket_quota": { 2024-09-14T11:23:48.692 INFO:tasks.workunit.client.0.smithi138.stdout: "enabled": false, 2024-09-14T11:23:48.692 INFO:tasks.workunit.client.0.smithi138.stdout: "check_on_raw": false, 2024-09-14T11:23:48.692 INFO:tasks.workunit.client.0.smithi138.stdout: "max_size": -1, 2024-09-14T11:23:48.692 INFO:tasks.workunit.client.0.smithi138.stdout: "max_size_kb": 0, 2024-09-14T11:23:48.692 INFO:tasks.workunit.client.0.smithi138.stdout: "max_objects": -1 2024-09-14T11:23:48.692 INFO:tasks.workunit.client.0.smithi138.stdout: }, 2024-09-14T11:23:48.692 INFO:tasks.workunit.client.0.smithi138.stdout: "user_quota": { 2024-09-14T11:23:48.692 INFO:tasks.workunit.client.0.smithi138.stdout: "enabled": false, 2024-09-14T11:23:48.692 INFO:tasks.workunit.client.0.smithi138.stdout: "check_on_raw": false, 2024-09-14T11:23:48.692 INFO:tasks.workunit.client.0.smithi138.stdout: "max_size": -1, 2024-09-14T11:23:48.692 INFO:tasks.workunit.client.0.smithi138.stdout: "max_size_kb": 0, 2024-09-14T11:23:48.692 INFO:tasks.workunit.client.0.smithi138.stdout: "max_objects": -1 2024-09-14T11:23:48.692 INFO:tasks.workunit.client.0.smithi138.stdout: }, 2024-09-14T11:23:48.693 INFO:tasks.workunit.client.0.smithi138.stdout: "temp_url_keys": [], 2024-09-14T11:23:48.693 INFO:tasks.workunit.client.0.smithi138.stdout: "type": "rgw", 2024-09-14T11:23:48.693 INFO:tasks.workunit.client.0.smithi138.stdout: "mfa_ids": [], 2024-09-14T11:23:48.693 INFO:tasks.workunit.client.0.smithi138.stdout: "account_id": "", 2024-09-14T11:23:48.693 INFO:tasks.workunit.client.0.smithi138.stdout: "path": "/", 2024-09-14T11:23:48.693 INFO:tasks.workunit.client.0.smithi138.stdout: "create_date": "2024-09-14T11:23:48.682623Z", 2024-09-14T11:23:48.693 INFO:tasks.workunit.client.0.smithi138.stdout: "tags": [], 2024-09-14T11:23:48.693 INFO:tasks.workunit.client.0.smithi138.stdout: "group_ids": [] 2024-09-14T11:23:48.693 INFO:tasks.workunit.client.0.smithi138.stdout:} 2024-09-14T11:23:48.693 INFO:tasks.workunit.client.0.smithi138.stdout: 2024-09-14T11:23:48.694 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:23:48.693+0000 7f59737e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:23:48.697 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:23:48.701+0000 7f5abf1a69c0 20 remove_watcher() i=0 2024-09-14T11:23:48.697 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:23:48.701+0000 7f5abf1a69c0 2 removed watcher, disabling cache 2024-09-14T11:23:48.699 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:23:48.701+0000 7f5abf1a69c0 20 remove_watcher() i=1 2024-09-14T11:23:48.701 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:23:48.705+0000 7f5abf1a69c0 20 remove_watcher() i=2 2024-09-14T11:23:48.703 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:23:48.705+0000 7f5abf1a69c0 20 remove_watcher() i=3 2024-09-14T11:23:48.706 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:23:48.709+0000 7f5abf1a69c0 20 remove_watcher() i=4 2024-09-14T11:23:48.707 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:23:48.709+0000 7f5abf1a69c0 20 remove_watcher() i=5 2024-09-14T11:23:48.709 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:23:48.713+0000 7f5abf1a69c0 20 remove_watcher() i=6 2024-09-14T11:23:48.711 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:23:48.713+0000 7f5abf1a69c0 20 remove_watcher() i=7 2024-09-14T11:23:48.726 INFO:tasks.workunit.client.0.smithi138.stderr:+ [ -z ] 2024-09-14T11:23:48.726 INFO:tasks.workunit.client.0.smithi138.stderr:+ [ -z /home/ubuntu/cephtest ] 2024-09-14T11:23:48.726 INFO:tasks.workunit.client.0.smithi138.stderr:+ cat /home/ubuntu/cephtest/url_file 2024-09-14T11:23:48.727 INFO:tasks.workunit.client.0.smithi138.stderr:+ export RGW_HTTP_ENDPOINT_URL=https://smithi138.front.sepia.ceph.com:443 2024-09-14T11:23:48.727 INFO:tasks.workunit.client.0.smithi138.stderr:+ [ -z /home/ubuntu/cephtest/clone.client.0 ] 2024-09-14T11:23:48.727 INFO:tasks.workunit.client.0.smithi138.stderr:+ cd /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/jcksum 2024-09-14T11:23:48.727 INFO:tasks.workunit.client.0.smithi138.stderr:+ ./mvnw clean package 2024-09-14T11:23:48.734 INFO:tasks.workunit.client.0.smithi138.stdout:Warning: JAVA_HOME environment variable is not set. 2024-09-14T11:23:51.673 INFO:tasks.workunit.client.0.smithi138.stdout:[INFO] Scanning for projects... 2024-09-14T11:23:51.809 INFO:tasks.workunit.client.0.smithi138.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/junit-bom/5.10.1/junit-bom-5.10.1.pom 2024-09-14T11:23:51.911 INFO:tasks.workunit.client.0.smithi138.stdout:Progress (1): 1.4/5.6 kB Progress (1): 2.8/5.6 kB Progress (1): 4.1/5.6 kB Progress (1): 5.5/5.6 kB Progress (1): 5.6 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/junit-bom/5.10.1/junit-bom-5.10.1.pom (5.6 kB at 54 kB/s) 2024-09-14T11:23:51.931 INFO:tasks.workunit.client.0.smithi138.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/bom/2.20.43/bom-2.20.43.pom 2024-09-14T11:23:51.971 INFO:tasks.workunit.client.0.smithi138.stdout:Progress (1): 1.4/83 kB Progress (1): 2.8/83 kB Progress (1): 4.1/83 kB Progress (1): 5.5/83 kB Progress (1): 6.9/83 kB Progress (1): 8.3/83 kB Progress (1): 9.7/83 kB Progress (1): 11/83 kB Progress (1): 12/83 kB Progress (1): 14/83 kB Progress (1): 15/83 kB Progress (1): 16/83 kB Progress (1): 33/83 kB Progress (1): 49/83 kB Progress (1): 66/83 kB Progress (1): 82/83 kB Progress (1): 83 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/bom/2.20.43/bom-2.20.43.pom (83 kB at 2.0 MB/s) 2024-09-14T11:23:51.981 INFO:tasks.workunit.client.0.smithi138.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/aws-sdk-java-pom/2.20.43/aws-sdk-java-pom-2.20.43.pom 2024-09-14T11:23:52.000 INFO:tasks.workunit.client.0.smithi138.stdout:Progress (1): 16/77 kB Progress (1): 33/77 kB Progress (1): 49/77 kB Progress (1): 64/77 kB Progress (1): 77 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/aws-sdk-java-pom/2.20.43/aws-sdk-java-pom-2.20.43.pom (77 kB at 4.0 MB/s) 2024-09-14T11:23:52.030 INFO:tasks.workunit.client.0.smithi138.stdout:[INFO] 2024-09-14T11:23:52.030 INFO:tasks.workunit.client.0.smithi138.stdout:[INFO] ---------------------------< io.ceph:jcksum >--------------------------- 2024-09-14T11:23:52.030 INFO:tasks.workunit.client.0.smithi138.stdout:[INFO] Building jcksum 1.0 2024-09-14T11:23:52.030 INFO:tasks.workunit.client.0.smithi138.stdout:[INFO] from pom.xml 2024-09-14T11:23:52.030 INFO:tasks.workunit.client.0.smithi138.stdout:[INFO] --------------------------------[ jar ]--------------------------------- 2024-09-14T11:23:52.034 INFO:tasks.workunit.client.0.smithi138.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-clean-plugin/3.2.0/maven-clean-plugin-3.2.0.pom 2024-09-14T11:23:52.050 INFO:tasks.workunit.client.0.smithi138.stdout:Progress (1): 5.3 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-clean-plugin/3.2.0/maven-clean-plugin-3.2.0.pom (5.3 kB at 332 kB/s) 2024-09-14T11:23:52.057 INFO:tasks.workunit.client.0.smithi138.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-plugins/35/maven-plugins-35.pom 2024-09-14T11:23:52.073 INFO:tasks.workunit.client.0.smithi138.stdout:Progress (1): 9.9 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-plugins/35/maven-plugins-35.pom (9.9 kB at 619 kB/s) 2024-09-14T11:23:52.077 INFO:tasks.workunit.client.0.smithi138.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-parent/35/maven-parent-35.pom 2024-09-14T11:23:52.093 INFO:tasks.workunit.client.0.smithi138.stdout:Progress (1): 16/45 kB Progress (1): 33/45 kB Progress (1): 45 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-parent/35/maven-parent-35.pom (45 kB at 2.8 MB/s) 2024-09-14T11:23:52.102 INFO:tasks.workunit.client.0.smithi138.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/apache/25/apache-25.pom 2024-09-14T11:23:52.118 INFO:tasks.workunit.client.0.smithi138.stdout:Progress (1): 16/21 kB Progress (1): 21 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/apache/25/apache-25.pom (21 kB at 1.3 MB/s) 2024-09-14T11:23:52.137 INFO:tasks.workunit.client.0.smithi138.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-clean-plugin/3.2.0/maven-clean-plugin-3.2.0.jar 2024-09-14T11:23:52.154 INFO:tasks.workunit.client.0.smithi138.stdout:Progress (1): 16/36 kB Progress (1): 33/36 kB Progress (1): 36 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-clean-plugin/3.2.0/maven-clean-plugin-3.2.0.jar (36 kB at 2.0 MB/s) 2024-09-14T11:23:52.162 INFO:tasks.workunit.client.0.smithi138.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-resources-plugin/3.3.1/maven-resources-plugin-3.3.1.pom 2024-09-14T11:23:52.177 INFO:tasks.workunit.client.0.smithi138.stdout:Progress (1): 8.2 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-resources-plugin/3.3.1/maven-resources-plugin-3.3.1.pom (8.2 kB at 544 kB/s) 2024-09-14T11:23:52.180 INFO:tasks.workunit.client.0.smithi138.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-plugins/39/maven-plugins-39.pom 2024-09-14T11:23:52.195 INFO:tasks.workunit.client.0.smithi138.stdout:Progress (1): 8.1 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-plugins/39/maven-plugins-39.pom (8.1 kB at 539 kB/s) 2024-09-14T11:23:52.198 INFO:tasks.workunit.client.0.smithi138.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-parent/39/maven-parent-39.pom 2024-09-14T11:23:52.215 INFO:tasks.workunit.client.0.smithi138.stdout:Progress (1): 15/48 kB Progress (1): 31/48 kB Progress (1): 48/48 kB Progress (1): 48 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-parent/39/maven-parent-39.pom (48 kB at 3.0 MB/s) 2024-09-14T11:23:52.219 INFO:tasks.workunit.client.0.smithi138.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/apache/29/apache-29.pom 2024-09-14T11:23:52.234 INFO:tasks.workunit.client.0.smithi138.stdout:Progress (1): 16/21 kB Progress (1): 21 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/apache/29/apache-29.pom (21 kB at 1.4 MB/s) 2024-09-14T11:23:52.241 INFO:tasks.workunit.client.0.smithi138.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-resources-plugin/3.3.1/maven-resources-plugin-3.3.1.jar 2024-09-14T11:23:52.257 INFO:tasks.workunit.client.0.smithi138.stdout:Progress (1): 1.9/31 kB Progress (1): 18/31 kB Progress (1): 31 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-resources-plugin/3.3.1/maven-resources-plugin-3.3.1.jar (31 kB at 1.9 MB/s) 2024-09-14T11:23:52.263 INFO:tasks.workunit.client.0.smithi138.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-compiler-plugin/3.11.0/maven-compiler-plugin-3.11.0.pom 2024-09-14T11:23:52.279 INFO:tasks.workunit.client.0.smithi138.stdout:Progress (1): 9.8 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-compiler-plugin/3.11.0/maven-compiler-plugin-3.11.0.pom (9.8 kB at 613 kB/s) 2024-09-14T11:23:52.289 INFO:tasks.workunit.client.0.smithi138.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-compiler-plugin/3.11.0/maven-compiler-plugin-3.11.0.jar 2024-09-14T11:23:52.307 INFO:tasks.workunit.client.0.smithi138.stdout:Progress (1): 16/66 kB Progress (1): 33/66 kB Progress (1): 49/66 kB Progress (1): 66/66 kB Progress (1): 66 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-compiler-plugin/3.11.0/maven-compiler-plugin-3.11.0.jar (66 kB at 3.6 MB/s) 2024-09-14T11:23:52.317 INFO:tasks.workunit.client.0.smithi138.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-surefire-plugin/3.2.3/maven-surefire-plugin-3.2.3.pom 2024-09-14T11:23:52.333 INFO:tasks.workunit.client.0.smithi138.stdout:Progress (1): 5.3 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-surefire-plugin/3.2.3/maven-surefire-plugin-3.2.3.pom (5.3 kB at 332 kB/s) 2024-09-14T11:23:52.337 INFO:tasks.workunit.client.0.smithi138.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire/3.2.3/surefire-3.2.3.pom 2024-09-14T11:23:52.353 INFO:tasks.workunit.client.0.smithi138.stdout:Progress (1): 16/22 kB Progress (1): 22 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire/3.2.3/surefire-3.2.3.pom (22 kB at 1.3 MB/s) 2024-09-14T11:23:52.358 INFO:tasks.workunit.client.0.smithi138.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-parent/41/maven-parent-41.pom 2024-09-14T11:23:52.375 INFO:tasks.workunit.client.0.smithi138.stdout:Progress (1): 16/50 kB Progress (1): 32/50 kB Progress (1): 49/50 kB Progress (1): 50 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-parent/41/maven-parent-41.pom (50 kB at 3.1 MB/s) 2024-09-14T11:23:52.381 INFO:tasks.workunit.client.0.smithi138.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/apache/31/apache-31.pom 2024-09-14T11:23:52.396 INFO:tasks.workunit.client.0.smithi138.stdout:Progress (1): 16/24 kB Progress (1): 24 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/apache/31/apache-31.pom (24 kB at 1.5 MB/s) 2024-09-14T11:23:52.406 INFO:tasks.workunit.client.0.smithi138.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/junit-bom/5.9.3/junit-bom-5.9.3.pom 2024-09-14T11:23:52.421 INFO:tasks.workunit.client.0.smithi138.stdout:Progress (1): 5.6 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/junit-bom/5.9.3/junit-bom-5.9.3.pom (5.6 kB at 352 kB/s) 2024-09-14T11:23:52.427 INFO:tasks.workunit.client.0.smithi138.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-surefire-plugin/3.2.3/maven-surefire-plugin-3.2.3.jar 2024-09-14T11:23:52.444 INFO:tasks.workunit.client.0.smithi138.stdout:Progress (1): 16/45 kB Progress (1): 33/45 kB Progress (1): 45 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-surefire-plugin/3.2.3/maven-surefire-plugin-3.2.3.jar (45 kB at 2.5 MB/s) 2024-09-14T11:23:52.454 INFO:tasks.workunit.client.0.smithi138.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-jar-plugin/3.3.0/maven-jar-plugin-3.3.0.pom 2024-09-14T11:23:52.470 INFO:tasks.workunit.client.0.smithi138.stdout:Progress (1): 6.8 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-jar-plugin/3.3.0/maven-jar-plugin-3.3.0.pom (6.8 kB at 423 kB/s) 2024-09-14T11:23:52.474 INFO:tasks.workunit.client.0.smithi138.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-plugins/37/maven-plugins-37.pom 2024-09-14T11:23:52.490 INFO:tasks.workunit.client.0.smithi138.stdout:Progress (1): 9.9 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-plugins/37/maven-plugins-37.pom (9.9 kB at 582 kB/s) 2024-09-14T11:23:52.494 INFO:tasks.workunit.client.0.smithi138.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-parent/37/maven-parent-37.pom 2024-09-14T11:23:52.510 INFO:tasks.workunit.client.0.smithi138.stdout:Progress (1): 16/46 kB Progress (1): 33/46 kB Progress (1): 46 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-parent/37/maven-parent-37.pom (46 kB at 2.7 MB/s) 2024-09-14T11:23:52.515 INFO:tasks.workunit.client.0.smithi138.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/apache/27/apache-27.pom 2024-09-14T11:23:52.531 INFO:tasks.workunit.client.0.smithi138.stdout:Progress (1): 16/20 kB Progress (1): 20 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/apache/27/apache-27.pom (20 kB at 1.2 MB/s) 2024-09-14T11:23:52.545 INFO:tasks.workunit.client.0.smithi138.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-jar-plugin/3.3.0/maven-jar-plugin-3.3.0.jar 2024-09-14T11:23:52.564 INFO:tasks.workunit.client.0.smithi138.stdout:Progress (1): 16/27 kB Progress (1): 27 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-jar-plugin/3.3.0/maven-jar-plugin-3.3.0.jar (27 kB at 1.4 MB/s) 2024-09-14T11:23:52.605 INFO:tasks.workunit.client.0.smithi138.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/s3/2.20.43/s3-2.20.43.pom 2024-09-14T11:23:52.623 INFO:tasks.workunit.client.0.smithi138.stdout:Progress (1): 6.1 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/s3/2.20.43/s3-2.20.43.pom (6.1 kB at 338 kB/s) 2024-09-14T11:23:52.629 INFO:tasks.workunit.client.0.smithi138.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/services/2.20.43/services-2.20.43.pom 2024-09-14T11:23:52.647 INFO:tasks.workunit.client.0.smithi138.stdout:Progress (1): 16/21 kB Progress (1): 21 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/services/2.20.43/services-2.20.43.pom (21 kB at 1.1 MB/s) 2024-09-14T11:23:52.658 INFO:tasks.workunit.client.0.smithi138.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/bom-internal/2.20.43/bom-internal-2.20.43.pom 2024-09-14T11:23:52.675 INFO:tasks.workunit.client.0.smithi138.stdout:Progress (1): 16/20 kB Progress (1): 20 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/bom-internal/2.20.43/bom-internal-2.20.43.pom (20 kB at 1.1 MB/s) 2024-09-14T11:23:52.688 INFO:tasks.workunit.client.0.smithi138.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/aws-xml-protocol/2.20.43/aws-xml-protocol-2.20.43.pom 2024-09-14T11:23:52.706 INFO:tasks.workunit.client.0.smithi138.stdout:Progress (1): 4.0 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/aws-xml-protocol/2.20.43/aws-xml-protocol-2.20.43.pom (4.0 kB at 222 kB/s) 2024-09-14T11:23:52.710 INFO:tasks.workunit.client.0.smithi138.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/protocols/2.20.43/protocols-2.20.43.pom 2024-09-14T11:23:52.729 INFO:tasks.workunit.client.0.smithi138.stdout:Progress (1): 1.6 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/protocols/2.20.43/protocols-2.20.43.pom (1.6 kB at 82 kB/s) 2024-09-14T11:23:52.732 INFO:tasks.workunit.client.0.smithi138.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/core/2.20.43/core-2.20.43.pom 2024-09-14T11:23:52.747 INFO:tasks.workunit.client.0.smithi138.stdout:Progress (1): 2.2 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/core/2.20.43/core-2.20.43.pom (2.2 kB at 139 kB/s) 2024-09-14T11:23:52.754 INFO:tasks.workunit.client.0.smithi138.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/aws-query-protocol/2.20.43/aws-query-protocol-2.20.43.pom 2024-09-14T11:23:52.770 INFO:tasks.workunit.client.0.smithi138.stdout:Progress (1): 3.6 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/aws-query-protocol/2.20.43/aws-query-protocol-2.20.43.pom (3.6 kB at 227 kB/s) 2024-09-14T11:23:52.777 INFO:tasks.workunit.client.0.smithi138.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/protocol-core/2.20.43/protocol-core-2.20.43.pom 2024-09-14T11:23:52.792 INFO:tasks.workunit.client.0.smithi138.stdout:Progress (1): 3.2 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/protocol-core/2.20.43/protocol-core-2.20.43.pom (3.2 kB at 215 kB/s) 2024-09-14T11:23:52.797 INFO:tasks.workunit.client.0.smithi138.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/sdk-core/2.20.43/sdk-core-2.20.43.pom 2024-09-14T11:23:52.811 INFO:tasks.workunit.client.0.smithi138.stdout:Progress (1): 11 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/sdk-core/2.20.43/sdk-core-2.20.43.pom (11 kB at 731 kB/s) 2024-09-14T11:23:52.818 INFO:tasks.workunit.client.0.smithi138.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/annotations/2.20.43/annotations-2.20.43.pom 2024-09-14T11:23:52.834 INFO:tasks.workunit.client.0.smithi138.stdout:Progress (1): 1.7 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/annotations/2.20.43/annotations-2.20.43.pom (1.7 kB at 105 kB/s) 2024-09-14T11:23:52.840 INFO:tasks.workunit.client.0.smithi138.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/http-client-spi/2.20.43/http-client-spi-2.20.43.pom 2024-09-14T11:23:52.855 INFO:tasks.workunit.client.0.smithi138.stdout:Progress (1): 3.8 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/http-client-spi/2.20.43/http-client-spi-2.20.43.pom (3.8 kB at 239 kB/s) 2024-09-14T11:23:52.862 INFO:tasks.workunit.client.0.smithi138.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/utils/2.20.43/utils-2.20.43.pom 2024-09-14T11:23:52.878 INFO:tasks.workunit.client.0.smithi138.stdout:Progress (1): 4.9 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/utils/2.20.43/utils-2.20.43.pom (4.9 kB at 307 kB/s) 2024-09-14T11:23:52.883 INFO:tasks.workunit.client.0.smithi138.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/reactivestreams/reactive-streams/1.0.3/reactive-streams-1.0.3.pom 2024-09-14T11:23:52.898 INFO:tasks.workunit.client.0.smithi138.stdout:Progress (1): 1.2 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/reactivestreams/reactive-streams/1.0.3/reactive-streams-1.0.3.pom (1.2 kB at 77 kB/s) 2024-09-14T11:23:52.902 INFO:tasks.workunit.client.0.smithi138.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/slf4j/slf4j-api/1.7.30/slf4j-api-1.7.30.pom 2024-09-14T11:23:52.917 INFO:tasks.workunit.client.0.smithi138.stdout:Progress (1): 3.8 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/slf4j/slf4j-api/1.7.30/slf4j-api-1.7.30.pom (3.8 kB at 256 kB/s) 2024-09-14T11:23:52.920 INFO:tasks.workunit.client.0.smithi138.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/slf4j/slf4j-parent/1.7.30/slf4j-parent-1.7.30.pom 2024-09-14T11:23:52.934 INFO:tasks.workunit.client.0.smithi138.stdout:Progress (1): 14 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/slf4j/slf4j-parent/1.7.30/slf4j-parent-1.7.30.pom (14 kB at 920 kB/s) 2024-09-14T11:23:52.937 INFO:tasks.workunit.client.0.smithi138.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/metrics-spi/2.20.43/metrics-spi-2.20.43.pom 2024-09-14T11:23:52.952 INFO:tasks.workunit.client.0.smithi138.stdout:Progress (1): 3.7 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/metrics-spi/2.20.43/metrics-spi-2.20.43.pom (3.7 kB at 245 kB/s) 2024-09-14T11:23:52.956 INFO:tasks.workunit.client.0.smithi138.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/endpoints-spi/2.20.43/endpoints-spi-2.20.43.pom 2024-09-14T11:23:52.971 INFO:tasks.workunit.client.0.smithi138.stdout:Progress (1): 2.5 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/endpoints-spi/2.20.43/endpoints-spi-2.20.43.pom (2.5 kB at 163 kB/s) 2024-09-14T11:23:52.977 INFO:tasks.workunit.client.0.smithi138.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/profiles/2.20.43/profiles-2.20.43.pom 2024-09-14T11:23:52.992 INFO:tasks.workunit.client.0.smithi138.stdout:Progress (1): 2.9 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/profiles/2.20.43/profiles-2.20.43.pom (2.9 kB at 194 kB/s) 2024-09-14T11:23:53.000 INFO:tasks.workunit.client.0.smithi138.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/aws-core/2.20.43/aws-core-2.20.43.pom 2024-09-14T11:23:53.015 INFO:tasks.workunit.client.0.smithi138.stdout:Progress (1): 7.4 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/aws-core/2.20.43/aws-core-2.20.43.pom (7.4 kB at 463 kB/s) 2024-09-14T11:23:53.021 INFO:tasks.workunit.client.0.smithi138.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/regions/2.20.43/regions-2.20.43.pom 2024-09-14T11:23:53.037 INFO:tasks.workunit.client.0.smithi138.stdout:Progress (1): 5.5 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/regions/2.20.43/regions-2.20.43.pom (5.5 kB at 341 kB/s) 2024-09-14T11:23:53.043 INFO:tasks.workunit.client.0.smithi138.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/json-utils/2.20.43/json-utils-2.20.43.pom 2024-09-14T11:23:53.061 INFO:tasks.workunit.client.0.smithi138.stdout:Progress (1): 3.5 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/json-utils/2.20.43/json-utils-2.20.43.pom (3.5 kB at 194 kB/s) 2024-09-14T11:23:53.067 INFO:tasks.workunit.client.0.smithi138.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/third-party-jackson-core/2.20.43/third-party-jackson-core-2.20.43.pom 2024-09-14T11:23:53.083 INFO:tasks.workunit.client.0.smithi138.stdout:Progress (1): 4.4 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/third-party-jackson-core/2.20.43/third-party-jackson-core-2.20.43.pom (4.4 kB at 293 kB/s) 2024-09-14T11:23:53.086 INFO:tasks.workunit.client.0.smithi138.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/third-party/2.20.43/third-party-2.20.43.pom 2024-09-14T11:23:53.102 INFO:tasks.workunit.client.0.smithi138.stdout:Progress (1): 2.4 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/third-party/2.20.43/third-party-2.20.43.pom (2.4 kB at 161 kB/s) 2024-09-14T11:23:53.107 INFO:tasks.workunit.client.0.smithi138.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/auth/2.20.43/auth-2.20.43.pom 2024-09-14T11:23:53.123 INFO:tasks.workunit.client.0.smithi138.stdout:Progress (1): 6.4 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/auth/2.20.43/auth-2.20.43.pom (6.4 kB at 429 kB/s) 2024-09-14T11:23:53.131 INFO:tasks.workunit.client.0.smithi138.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/eventstream/eventstream/1.0.1/eventstream-1.0.1.pom 2024-09-14T11:23:53.146 INFO:tasks.workunit.client.0.smithi138.stdout:Progress (1): 6.1 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/eventstream/eventstream/1.0.1/eventstream-1.0.1.pom (6.1 kB at 379 kB/s) 2024-09-14T11:23:53.154 INFO:tasks.workunit.client.0.smithi138.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/arns/2.20.43/arns-2.20.43.pom 2024-09-14T11:23:53.170 INFO:tasks.workunit.client.0.smithi138.stdout:Progress (1): 3.0 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/arns/2.20.43/arns-2.20.43.pom (3.0 kB at 175 kB/s) 2024-09-14T11:23:53.177 INFO:tasks.workunit.client.0.smithi138.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/crt-core/2.20.43/crt-core-2.20.43.pom 2024-09-14T11:23:53.194 INFO:tasks.workunit.client.0.smithi138.stdout:Progress (1): 3.5 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/crt-core/2.20.43/crt-core-2.20.43.pom (3.5 kB at 217 kB/s) 2024-09-14T11:23:53.202 INFO:tasks.workunit.client.0.smithi138.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/apache-client/2.20.43/apache-client-2.20.43.pom 2024-09-14T11:23:53.218 INFO:tasks.workunit.client.0.smithi138.stdout:Progress (1): 4.1 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/apache-client/2.20.43/apache-client-2.20.43.pom (4.1 kB at 255 kB/s) 2024-09-14T11:23:53.222 INFO:tasks.workunit.client.0.smithi138.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/http-clients/2.20.43/http-clients-2.20.43.pom 2024-09-14T11:23:53.238 INFO:tasks.workunit.client.0.smithi138.stdout:Progress (1): 1.8 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/http-clients/2.20.43/http-clients-2.20.43.pom (1.8 kB at 111 kB/s) 2024-09-14T11:23:53.248 INFO:tasks.workunit.client.0.smithi138.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/httpcomponents/httpclient/4.5.13/httpclient-4.5.13.pom 2024-09-14T11:23:53.264 INFO:tasks.workunit.client.0.smithi138.stdout:Progress (1): 6.6 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/httpcomponents/httpclient/4.5.13/httpclient-4.5.13.pom (6.6 kB at 389 kB/s) 2024-09-14T11:23:53.268 INFO:tasks.workunit.client.0.smithi138.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/httpcomponents/httpcomponents-client/4.5.13/httpcomponents-client-4.5.13.pom 2024-09-14T11:23:53.285 INFO:tasks.workunit.client.0.smithi138.stdout:Progress (1): 16 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/httpcomponents/httpcomponents-client/4.5.13/httpcomponents-client-4.5.13.pom (16 kB at 1.0 MB/s) 2024-09-14T11:23:53.289 INFO:tasks.workunit.client.0.smithi138.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/httpcomponents/httpcomponents-parent/11/httpcomponents-parent-11.pom 2024-09-14T11:23:53.308 INFO:tasks.workunit.client.0.smithi138.stdout:Progress (1): 16/35 kB Progress (1): 33/35 kB Progress (1): 35 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/httpcomponents/httpcomponents-parent/11/httpcomponents-parent-11.pom (35 kB at 1.9 MB/s) 2024-09-14T11:23:53.314 INFO:tasks.workunit.client.0.smithi138.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/apache/21/apache-21.pom 2024-09-14T11:23:53.330 INFO:tasks.workunit.client.0.smithi138.stdout:Progress (1): 16/17 kB Progress (1): 17 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/apache/21/apache-21.pom (17 kB at 1.1 MB/s) 2024-09-14T11:23:53.338 INFO:tasks.workunit.client.0.smithi138.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/httpcomponents/httpcore/4.4.13/httpcore-4.4.13.pom 2024-09-14T11:23:53.354 INFO:tasks.workunit.client.0.smithi138.stdout:Progress (1): 5.0 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/httpcomponents/httpcore/4.4.13/httpcore-4.4.13.pom (5.0 kB at 310 kB/s) 2024-09-14T11:23:53.358 INFO:tasks.workunit.client.0.smithi138.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/httpcomponents/httpcomponents-core/4.4.13/httpcomponents-core-4.4.13.pom 2024-09-14T11:23:53.374 INFO:tasks.workunit.client.0.smithi138.stdout:Progress (1): 13 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/httpcomponents/httpcomponents-core/4.4.13/httpcomponents-core-4.4.13.pom (13 kB at 823 kB/s) 2024-09-14T11:23:53.383 INFO:tasks.workunit.client.0.smithi138.stdout:Downloading from central: https://repo.maven.apache.org/maven2/commons-codec/commons-codec/1.11/commons-codec-1.11.pom 2024-09-14T11:23:53.399 INFO:tasks.workunit.client.0.smithi138.stdout:Progress (1): 14 kB Downloaded from central: https://repo.maven.apache.org/maven2/commons-codec/commons-codec/1.11/commons-codec-1.11.pom (14 kB at 873 kB/s) 2024-09-14T11:23:53.405 INFO:tasks.workunit.client.0.smithi138.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/commons/commons-parent/42/commons-parent-42.pom 2024-09-14T11:23:53.425 INFO:tasks.workunit.client.0.smithi138.stdout:Progress (1): 16/68 kB Progress (1): 32/68 kB Progress (1): 49/68 kB Progress (1): 65/68 kB Progress (1): 68 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/commons/commons-parent/42/commons-parent-42.pom (68 kB at 3.4 MB/s) 2024-09-14T11:23:53.451 INFO:tasks.workunit.client.0.smithi138.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/apache/18/apache-18.pom 2024-09-14T11:23:53.470 INFO:tasks.workunit.client.0.smithi138.stdout:Progress (1): 16 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/apache/18/apache-18.pom (16 kB at 870 kB/s) 2024-09-14T11:23:53.480 INFO:tasks.workunit.client.0.smithi138.stdout:Downloading from central: https://repo.maven.apache.org/maven2/commons-codec/commons-codec/1.15/commons-codec-1.15.pom 2024-09-14T11:23:53.496 INFO:tasks.workunit.client.0.smithi138.stdout:Progress (1): 15 kB Downloaded from central: https://repo.maven.apache.org/maven2/commons-codec/commons-codec/1.15/commons-codec-1.15.pom (15 kB at 908 kB/s) 2024-09-14T11:23:53.501 INFO:tasks.workunit.client.0.smithi138.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/commons/commons-parent/52/commons-parent-52.pom 2024-09-14T11:23:53.520 INFO:tasks.workunit.client.0.smithi138.stdout:Progress (1): 16/79 kB Progress (1): 33/79 kB Progress (1): 49/79 kB Progress (1): 66/79 kB Progress (1): 79 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/commons/commons-parent/52/commons-parent-52.pom (79 kB at 4.2 MB/s) 2024-09-14T11:23:53.531 INFO:tasks.workunit.client.0.smithi138.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/apache/23/apache-23.pom 2024-09-14T11:23:53.547 INFO:tasks.workunit.client.0.smithi138.stdout:Progress (1): 16/18 kB Progress (1): 18 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/apache/23/apache-23.pom (18 kB at 1.1 MB/s) 2024-09-14T11:23:53.556 INFO:tasks.workunit.client.0.smithi138.stdout:Downloading from central: https://repo.maven.apache.org/maven2/commons-io/commons-io/2.15.1/commons-io-2.15.1.pom 2024-09-14T11:23:53.573 INFO:tasks.workunit.client.0.smithi138.stdout:Progress (1): 16/20 kB Progress (1): 20 kB Downloaded from central: https://repo.maven.apache.org/maven2/commons-io/commons-io/2.15.1/commons-io-2.15.1.pom (20 kB at 1.1 MB/s) 2024-09-14T11:23:53.579 INFO:tasks.workunit.client.0.smithi138.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/commons/commons-parent/65/commons-parent-65.pom 2024-09-14T11:23:53.600 INFO:tasks.workunit.client.0.smithi138.stdout:Progress (1): 15/78 kB Progress (1): 31/78 kB Progress (1): 48/78 kB Progress (1): 64/78 kB Progress (1): 78 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/commons/commons-parent/65/commons-parent-65.pom (78 kB at 3.7 MB/s) 2024-09-14T11:23:53.613 INFO:tasks.workunit.client.0.smithi138.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/slf4j/slf4j-api/1.7.28/slf4j-api-1.7.28.pom 2024-09-14T11:23:53.629 INFO:tasks.workunit.client.0.smithi138.stdout:Progress (1): 3.8 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/slf4j/slf4j-api/1.7.28/slf4j-api-1.7.28.pom (3.8 kB at 240 kB/s) 2024-09-14T11:23:53.633 INFO:tasks.workunit.client.0.smithi138.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/slf4j/slf4j-parent/1.7.28/slf4j-parent-1.7.28.pom 2024-09-14T11:23:53.649 INFO:tasks.workunit.client.0.smithi138.stdout:Progress (1): 14 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/slf4j/slf4j-parent/1.7.28/slf4j-parent-1.7.28.pom (14 kB at 812 kB/s) 2024-09-14T11:23:53.655 INFO:tasks.workunit.client.0.smithi138.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/jupiter/junit-jupiter/5.10.1/junit-jupiter-5.10.1.pom 2024-09-14T11:23:53.671 INFO:tasks.workunit.client.0.smithi138.stdout:Progress (1): 3.2 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/jupiter/junit-jupiter/5.10.1/junit-jupiter-5.10.1.pom (3.2 kB at 200 kB/s) 2024-09-14T11:23:53.677 INFO:tasks.workunit.client.0.smithi138.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/jupiter/junit-jupiter-api/5.10.1/junit-jupiter-api-5.10.1.pom 2024-09-14T11:23:53.692 INFO:tasks.workunit.client.0.smithi138.stdout:Progress (1): 3.2 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/jupiter/junit-jupiter-api/5.10.1/junit-jupiter-api-5.10.1.pom (3.2 kB at 199 kB/s) 2024-09-14T11:23:53.697 INFO:tasks.workunit.client.0.smithi138.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/opentest4j/opentest4j/1.3.0/opentest4j-1.3.0.pom 2024-09-14T11:23:53.713 INFO:tasks.workunit.client.0.smithi138.stdout:Progress (1): 2.0 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/opentest4j/opentest4j/1.3.0/opentest4j-1.3.0.pom (2.0 kB at 127 kB/s) 2024-09-14T11:23:53.717 INFO:tasks.workunit.client.0.smithi138.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-commons/1.10.1/junit-platform-commons-1.10.1.pom 2024-09-14T11:23:53.733 INFO:tasks.workunit.client.0.smithi138.stdout:Progress (1): 2.8 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-commons/1.10.1/junit-platform-commons-1.10.1.pom (2.8 kB at 177 kB/s) 2024-09-14T11:23:53.738 INFO:tasks.workunit.client.0.smithi138.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apiguardian/apiguardian-api/1.1.2/apiguardian-api-1.1.2.pom 2024-09-14T11:23:53.754 INFO:tasks.workunit.client.0.smithi138.stdout:Progress (1): 1.5 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apiguardian/apiguardian-api/1.1.2/apiguardian-api-1.1.2.pom (1.5 kB at 95 kB/s) 2024-09-14T11:23:53.758 INFO:tasks.workunit.client.0.smithi138.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/jupiter/junit-jupiter-params/5.10.1/junit-jupiter-params-5.10.1.pom 2024-09-14T11:23:53.774 INFO:tasks.workunit.client.0.smithi138.stdout:Progress (1): 3.0 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/jupiter/junit-jupiter-params/5.10.1/junit-jupiter-params-5.10.1.pom (3.0 kB at 201 kB/s) 2024-09-14T11:23:53.779 INFO:tasks.workunit.client.0.smithi138.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/jupiter/junit-jupiter-engine/5.10.1/junit-jupiter-engine-5.10.1.pom 2024-09-14T11:23:53.795 INFO:tasks.workunit.client.0.smithi138.stdout:Progress (1): 3.2 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/jupiter/junit-jupiter-engine/5.10.1/junit-jupiter-engine-5.10.1.pom (3.2 kB at 188 kB/s) 2024-09-14T11:23:53.800 INFO:tasks.workunit.client.0.smithi138.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-engine/1.10.1/junit-platform-engine-1.10.1.pom 2024-09-14T11:23:53.816 INFO:tasks.workunit.client.0.smithi138.stdout:Progress (1): 3.2 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-engine/1.10.1/junit-platform-engine-1.10.1.pom (3.2 kB at 200 kB/s) 2024-09-14T11:23:53.823 INFO:tasks.workunit.client.0.smithi138.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/slf4j/slf4j-simple/1.7.28/slf4j-simple-1.7.28.pom 2024-09-14T11:23:53.839 INFO:tasks.workunit.client.0.smithi138.stdout:Progress (1): 1.0 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/slf4j/slf4j-simple/1.7.28/slf4j-simple-1.7.28.pom (1.0 kB at 64 kB/s) 2024-09-14T11:23:53.847 INFO:tasks.workunit.client.0.smithi138.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/slf4j/jcl-over-slf4j/1.7.28/jcl-over-slf4j-1.7.28.pom 2024-09-14T11:23:53.865 INFO:tasks.workunit.client.0.smithi138.stdout:Progress (1): 964 B Downloaded from central: https://repo.maven.apache.org/maven2/org/slf4j/jcl-over-slf4j/1.7.28/jcl-over-slf4j-1.7.28.pom (964 B at 54 kB/s) 2024-09-14T11:23:53.871 INFO:tasks.workunit.client.0.smithi138.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-suite/1.10.1/junit-platform-suite-1.10.1.pom 2024-09-14T11:23:53.887 INFO:tasks.workunit.client.0.smithi138.stdout:Progress (1): 3.1 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-suite/1.10.1/junit-platform-suite-1.10.1.pom (3.1 kB at 191 kB/s) 2024-09-14T11:23:53.892 INFO:tasks.workunit.client.0.smithi138.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-suite-api/1.10.1/junit-platform-suite-api-1.10.1.pom 2024-09-14T11:23:53.908 INFO:tasks.workunit.client.0.smithi138.stdout:Progress (1): 3.0 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-suite-api/1.10.1/junit-platform-suite-api-1.10.1.pom (3.0 kB at 178 kB/s) 2024-09-14T11:23:53.913 INFO:tasks.workunit.client.0.smithi138.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-suite-engine/1.10.1/junit-platform-suite-engine-1.10.1.pom 2024-09-14T11:23:53.929 INFO:tasks.workunit.client.0.smithi138.stdout:Progress (1): 3.4 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-suite-engine/1.10.1/junit-platform-suite-engine-1.10.1.pom (3.4 kB at 215 kB/s) 2024-09-14T11:23:53.934 INFO:tasks.workunit.client.0.smithi138.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-suite-commons/1.10.1/junit-platform-suite-commons-1.10.1.pom 2024-09-14T11:23:53.951 INFO:tasks.workunit.client.0.smithi138.stdout:Progress (1): 3.4 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-suite-commons/1.10.1/junit-platform-suite-commons-1.10.1.pom (3.4 kB at 202 kB/s) 2024-09-14T11:23:53.956 INFO:tasks.workunit.client.0.smithi138.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-launcher/1.10.1/junit-platform-launcher-1.10.1.pom 2024-09-14T11:23:53.972 INFO:tasks.workunit.client.0.smithi138.stdout:Progress (1): 3.0 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-launcher/1.10.1/junit-platform-launcher-1.10.1.pom (3.0 kB at 189 kB/s) 2024-09-14T11:23:54.035 INFO:tasks.workunit.client.0.smithi138.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/s3/2.20.43/s3-2.20.43.jar 2024-09-14T11:23:54.146 INFO:tasks.workunit.client.0.smithi138.stdout:Progress (1): 0/3.3 MB Progress (1): 0/3.3 MB Progress (1): 0/3.3 MB Progress (1): 0.1/3.3 MB Progress (1): 0.1/3.3 MB Progress (1): 0.1/3.3 MB Progress (1): 0.1/3.3 MB Progress (1): 0.1/3.3 MB Progress (1): 0.1/3.3 MB Progress (1): 0.2/3.3 MB Progress (1): 0.2/3.3 MB Progress (1): 0.2/3.3 MB Progress (1): 0.2/3.3 MB Progress (1): 0.2/3.3 MB Progress (1): 0.2/3.3 MB Progress (1): 0.3/3.3 MB Progress (1): 0.3/3.3 MB Progress (1): 0.3/3.3 MB Progress (1): 0.3/3.3 MB Progress (1): 0.3/3.3 MB Progress (1): 0.3/3.3 MB Progress (1): 0.4/3.3 MB Progress (1): 0.4/3.3 MB Progress (1): 0.4/3.3 MB Progress (1): 0.4/3.3 MB Progress (1): 0.4/3.3 MB Progress (1): 0.4/3.3 MB Progress (1): 0.5/3.3 MB Progress (1): 0.5/3.3 MB Progress (1): 0.5/3.3 MB Progress (1): 0.5/3.3 MB Progress (1): 0.5/3.3 MB Progress (1): 0.5/3.3 MB Progress (1): 0.6/3.3 MB Progress (1): 0.6/3.3 MB Progress (1): 0.6/3.3 MB Progress (1): 0.6/3.3 MB Progress (1): 0.6/3.3 MB Progress (1): 0.6/3.3 MB Progress (1): 0.7/3.3 MB Progress (1): 0.7/3.3 MB Progress (1): 0.7/3.3 MB Progress (1): 0.7/3.3 MB Progress (1): 0.7/3.3 MB Progress (1): 0.7/3.3 MB Progress (1): 0.7/3.3 MB Progress (1): 0.8/3.3 MB Progress (1): 0.8/3.3 MB Progress (1): 0.8/3.3 MB Progress (1): 0.8/3.3 MB Progress (1): 0.8/3.3 MB Progress (1): 0.8/3.3 MB Progress (1): 0.9/3.3 MB Progress (1): 0.9/3.3 MB Progress (1): 0.9/3.3 MB Progress (1): 0.9/3.3 MB Progress (1): 0.9/3.3 MB Progress (1): 0.9/3.3 MB Progress (1): 1.0/3.3 MB Progress (1): 1.0/3.3 MB Progress (1): 1.0/3.3 MB Progress (1): 1.0/3.3 MB Progress (1): 1.0/3.3 MB Progress (1): 1.0/3.3 MB Progress (1): 1.1/3.3 MB Progress (1): 1.1/3.3 MB Progress (1): 1.1/3.3 MB Progress (1): 1.1/3.3 MB Progress (1): 1.1/3.3 MB Progress (1): 1.1/3.3 MB Progress (1): 1.2/3.3 MB Progress (1): 1.2/3.3 MB Progress (1): 1.2/3.3 MB Progress (1): 1.2/3.3 MB Progress (1): 1.2/3.3 MB Progress (1): 1.2/3.3 MB Progress (1): 1.3/3.3 MB Progress (1): 1.3/3.3 MB Progress (1): 1.3/3.3 MB Progress (1): 1.3/3.3 MB Progress (1): 1.3/3.3 MB Progress (1): 1.3/3.3 MB Progress (1): 1.4/3.3 MB Progress (1): 1.4/3.3 MB Progress (1): 1.4/3.3 MB Progress (1): 1.4/3.3 MB Progress (1): 1.4/3.3 MB Progress (1): 1.4/3.3 MB Progress (1): 1.5/3.3 MB Progress (1): 1.5/3.3 MB Progress (1): 1.5/3.3 MB Progress (1): 1.5/3.3 MB Progress (1): 1.5/3.3 MB Progress (1): 1.5/3.3 MB Progress (1): 1.6/3.3 MB Progress (1): 1.6/3.3 MB Progress (1): 1.6/3.3 MB Progress (1): 1.6/3.3 MB Progress (1): 1.6/3.3 MB Progress (1): 1.6/3.3 MB Progress (1): 1.7/3.3 MB Progress (1): 1.7/3.3 MB Progress (1): 1.7/3.3 MB Progress (1): 1.7/3.3 MB Progress (1): 1.7/3.3 MB Progress (1): 1.7/3.3 MB Progress (1): 1.7/3.3 MB Progress (1): 1.8/3.3 MB Progress (1): 1.8/3.3 MB Progress (1): 1.8/3.3 MB Progress (1): 1.8/3.3 MB Progress (1): 1.8/3.3 MB Progress (1): 1.8/3.3 MB Progress (1): 1.9/3.3 MB Progress (1): 1.9/3.3 MB Progress (1): 1.9/3.3 MB Progress (1): 1.9/3.3 MB Progress (1): 1.9/3.3 MB Progress (1): 1.9/3.3 MB Progress (1): 2.0/3.3 MB Progress (1): 2.0/3.3 MB Progress (1): 2.0/3.3 MB Progress (1): 2.0/3.3 MB Progress (1): 2.0/3.3 MB Progress (1): 2.0/3.3 MB Progress (1): 2.1/3.3 MB Progress (1): 2.1/3.3 MB Progress (1): 2.1/3.3 MB Progress (1): 2.1/3.3 MB Progress (1): 2.1/3.3 MB Progress (1): 2.1/3.3 MB Progress (1): 2.2/3.3 MB Progress (1): 2.2/3.3 MB Progress (1): 2.2/3.3 MB Progress (1): 2.2/3.3 MB Progress (1): 2.2/3.3 MB Progress (1): 2.2/3.3 MB Progress (1): 2.3/3.3 MB Progress (1): 2.3/3.3 MB Progress (1): 2.3/3.3 MB Progress (1): 2.3/3.3 MB Progress (1): 2.3/3.3 MB Progress (1): 2.3/3.3 MB Progress (1): 2.4/3.3 MB Progress (1): 2.4/3.3 MB Progress (1): 2.4/3.3 MB Progress (1): 2.4/3.3 MB Progress (1): 2.4/3.3 MB Progress (1): 2.4/3.3 MB Progress (1): 2.5/3.3 MB Progress (1): 2.5/3.3 MB Progress (1): 2.5/3.3 MB Progress (1): 2.5/3.3 MB Progress (1): 2.5/3.3 MB Progress (1): 2.5/3.3 MB Progress (1): 2.6/3.3 MB Progress (1): 2.6/3.3 MB Progress (1): 2.6/3.3 MB Progress (1): 2.6/3.3 MB Progress (1): 2.6/3.3 MB Progress (1): 2.6/3.3 MB Progress (1): 2.7/3.3 MB Progress (1): 2.7/3.3 MB Progress (1): 2.7/3.3 MB Progress (1): 2.7/3.3 MB Progress (1): 2.7/3.3 MB Progress (1): 2.7/3.3 MB Progress (1): 2.7/3.3 MB Progress (1): 2.8/3.3 MB Progress (1): 2.8/3.3 MB Progress (1): 2.8/3.3 MB Progress (1): 2.8/3.3 MB Progress (1): 2.8/3.3 MB Progress (1): 2.8/3.3 MB Progress (1): 2.9/3.3 MB Progress (1): 2.9/3.3 MB Progress (1): 2.9/3.3 MB Progress (1): 2.9/3.3 MB Progress (1): 2.9/3.3 MB Progress (1): 2.9/3.3 MB Progress (1): 3.0/3.3 MB Progress (1): 3.0/3.3 MB Progress (1): 3.0/3.3 MB Progress (1): 3.0/3.3 MB Progress (1): 3.0/3.3 MB Progress (1): 3.0/3.3 MB Progress (1): 3.1/3.3 MB Progress (1): 3.1/3.3 MB Progress (1): 3.1/3.3 MB Progress (1): 3.1/3.3 MB Progress (1): 3.1/3.3 MB Progress (1): 3.1/3.3 MB Progress (1): 3.2/3.3 MB Progress (1): 3.2/3.3 MB Progress (1): 3.2/3.3 MB Progress (1): 3.2/3.3 MB Progress (1): 3.2/3.3 MB Progress (1): 3.2/3.3 MB Progress (1): 3.3/3.3 MB Progress (1): 3.3/3.3 MB Progress (1): 3.3 MB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/s3/2.20.43/s3-2.20.43.jar (3.3 MB at 30 MB/s) 2024-09-14T11:23:54.148 INFO:tasks.workunit.client.0.smithi138.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/aws-xml-protocol/2.20.43/aws-xml-protocol-2.20.43.jar 2024-09-14T11:23:54.149 INFO:tasks.workunit.client.0.smithi138.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/aws-query-protocol/2.20.43/aws-query-protocol-2.20.43.jar 2024-09-14T11:23:54.149 INFO:tasks.workunit.client.0.smithi138.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/protocol-core/2.20.43/protocol-core-2.20.43.jar 2024-09-14T11:23:54.149 INFO:tasks.workunit.client.0.smithi138.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/arns/2.20.43/arns-2.20.43.jar 2024-09-14T11:23:54.149 INFO:tasks.workunit.client.0.smithi138.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/profiles/2.20.43/profiles-2.20.43.jar 2024-09-14T11:23:54.173 INFO:tasks.workunit.client.0.smithi138.stdout:Progress (1): 16 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/arns/2.20.43/arns-2.20.43.jar (16 kB at 632 kB/s) 2024-09-14T11:23:54.173 INFO:tasks.workunit.client.0.smithi138.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/crt-core/2.20.43/crt-core-2.20.43.jar 2024-09-14T11:23:54.187 INFO:tasks.workunit.client.0.smithi138.stdout:Progress (1): 16 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/crt-core/2.20.43/crt-core-2.20.43.jar (16 kB at 422 kB/s) 2024-09-14T11:23:54.188 INFO:tasks.workunit.client.0.smithi138.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/sdk-core/2.20.43/sdk-core-2.20.43.jar 2024-09-14T11:23:54.203 INFO:tasks.workunit.client.0.smithi138.stdout:Progress (1): 1.4/35 kB Progress (1): 2.8/35 kB Progress (1): 4.1/35 kB Progress (2): 4.1/35 kB | 1.4/49 kB Progress (2): 5.5/35 kB | 1.4/49 kB Progress (2): 5.5/35 kB | 2.8/49 kB Progress (2): 6.9/35 kB | 2.8/49 kB Progress (2): 6.9/35 kB | 4.1/49 kB Progress (2): 8.3/35 kB | 4.1/49 kB Progress (2): 8.3/35 kB | 5.5/49 kB Progress (2): 9.7/35 kB | 5.5/49 kB Progress (2): 9.7/35 kB | 6.9/49 kB Progress (2): 11/35 kB | 6.9/49 kB Progress (2): 11/35 kB | 8.3/49 kB Progress (2): 12/35 kB | 8.3/49 kB Progress (2): 12/35 kB | 9.7/49 kB Progress (2): 14/35 kB | 9.7/49 kB Progress (2): 14/35 kB | 11/49 kB Progress (2): 15/35 kB | 11/49 kB Progress (2): 15/35 kB | 12/49 kB Progress (2): 16/35 kB | 12/49 kB Progress (2): 16/35 kB | 14/49 kB Progress (2): 18/35 kB | 14/49 kB Progress (2): 18/35 kB | 15/49 kB Progress (2): 19/35 kB | 15/49 kB Progress (2): 19/35 kB | 16/49 kB Progress (2): 21/35 kB | 16/49 kB Progress (2): 21/35 kB | 18/49 kB Progress (2): 22/35 kB | 18/49 kB Progress (2): 22/35 kB | 19/49 kB Progress (2): 23/35 kB | 19/49 kB Progress (2): 23/35 kB | 21/49 kB Progress (2): 23/35 kB | 22/49 kB Progress (2): 25/35 kB | 22/49 kB Progress (2): 25/35 kB | 23/49 kB Progress (2): 26/35 kB | 23/49 kB Progress (2): 27/35 kB | 23/49 kB Progress (2): 27/35 kB | 25/49 kB Progress (2): 29/35 kB | 25/49 kB Progress (2): 29/35 kB | 26/49 kB Progress (2): 30/35 kB | 26/49 kB Progress (3): 30/35 kB | 26/49 kB | 16/782 kB Progress (3): 32/35 kB | 26/49 kB | 16/782 kB Progress (3): 32/35 kB | 27/49 kB | 16/782 kB Progress (3): 32/35 kB | 29/49 kB | 16/782 kB Progress (3): 32/35 kB | 29/49 kB | 33/782 kB Progress (3): 32/35 kB | 30/49 kB | 33/782 kB Progress (3): 33/35 kB | 30/49 kB | 33/782 kB Progress (3): 33/35 kB | 32/49 kB | 33/782 kB Progress (3): 34/35 kB | 32/49 kB | 33/782 kB Progress (3): 34/35 kB | 32/49 kB | 49/782 kB Progress (3): 35 kB | 32/49 kB | 49/782 kB Progress (3): 35 kB | 33/49 kB | 49/782 kB Progress (3): 35 kB | 33/49 kB | 66/782 kB Progress (3): 35 kB | 34/49 kB | 66/782 kB Progress (3): 35 kB | 36/49 kB | 66/782 kB Progress (3): 35 kB | 36/49 kB | 82/782 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/protocol-core/2.20.43/protocol-core-2.20.43.jar (35 kB at 628 kB/s) 2024-09-14T11:23:54.203 INFO:tasks.workunit.client.0.smithi138.stdout:Progress (2): 37/49 kB | 82/782 kB Downloading from central: https://repo.maven.apache.org/maven2/org/reactivestreams/reactive-streams/1.0.3/reactive-streams-1.0.3.jar 2024-09-14T11:23:54.211 INFO:tasks.workunit.client.0.smithi138.stdout:Progress (2): 38/49 kB | 82/782 kB Progress (2): 38/49 kB | 98/782 kB Progress (2): 38/49 kB | 115/782 kB Progress (2): 38/49 kB | 131/782 kB Progress (2): 38/49 kB | 147/782 kB Progress (2): 38/49 kB | 164/782 kB Progress (2): 38/49 kB | 180/782 kB Progress (2): 38/49 kB | 197/782 kB Progress (2): 38/49 kB | 213/782 kB Progress (2): 38/49 kB | 229/782 kB Progress (2): 38/49 kB | 246/782 kB Progress (2): 38/49 kB | 262/782 kB Progress (2): 38/49 kB | 278/782 kB Progress (2): 38/49 kB | 295/782 kB Progress (2): 38/49 kB | 311/782 kB Progress (2): 38/49 kB | 328/782 kB Progress (2): 38/49 kB | 344/782 kB Progress (2): 38/49 kB | 360/782 kB Progress (2): 38/49 kB | 377/782 kB Progress (2): 38/49 kB | 393/782 kB Progress (2): 38/49 kB | 410/782 kB Progress (2): 38/49 kB | 426/782 kB Progress (2): 38/49 kB | 442/782 kB Progress (2): 38/49 kB | 459/782 kB Progress (2): 40/49 kB | 459/782 kB Progress (2): 40/49 kB | 475/782 kB Progress (2): 41/49 kB | 475/782 kB Progress (2): 43/49 kB | 475/782 kB Progress (2): 43/49 kB | 491/782 kB Progress (2): 44/49 kB | 491/782 kB Progress (2): 45/49 kB | 491/782 kB Progress (2): 45/49 kB | 508/782 kB Progress (2): 47/49 kB | 508/782 kB Progress (2): 48/49 kB | 508/782 kB Progress (2): 49 kB | 508/782 kB Progress (2): 49 kB | 524/782 kB Progress (2): 49 kB | 541/782 kB Progress (2): 49 kB | 557/782 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/profiles/2.20.43/profiles-2.20.43.jar (49 kB at 794 kB/s) 2024-09-14T11:23:54.211 INFO:tasks.workunit.client.0.smithi138.stdout:Progress (1): 573/782 kB Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/auth/2.20.43/auth-2.20.43.jar 2024-09-14T11:23:54.215 INFO:tasks.workunit.client.0.smithi138.stdout:Progress (1): 590/782 kB Progress (1): 606/782 kB Progress (1): 623/782 kB Progress (1): 639/782 kB Progress (1): 655/782 kB Progress (1): 672/782 kB Progress (2): 672/782 kB | 1.4/71 kB Progress (2): 688/782 kB | 1.4/71 kB Progress (2): 688/782 kB | 2.8/71 kB Progress (2): 688/782 kB | 4.1/71 kB Progress (2): 688/782 kB | 5.5/71 kB Progress (2): 704/782 kB | 5.5/71 kB Progress (2): 704/782 kB | 6.9/71 kB Progress (2): 704/782 kB | 8.3/71 kB Progress (2): 704/782 kB | 9.7/71 kB Progress (3): 704/782 kB | 9.7/71 kB | 1.4/98 kB Progress (3): 721/782 kB | 9.7/71 kB | 1.4/98 kB Progress (3): 721/782 kB | 11/71 kB | 1.4/98 kB Progress (3): 721/782 kB | 11/71 kB | 2.8/98 kB Progress (3): 721/782 kB | 12/71 kB | 2.8/98 kB Progress (3): 721/782 kB | 12/71 kB | 4.1/98 kB Progress (3): 721/782 kB | 14/71 kB | 4.1/98 kB Progress (3): 737/782 kB | 14/71 kB | 4.1/98 kB Progress (3): 737/782 kB | 14/71 kB | 5.5/98 kB Progress (3): 737/782 kB | 15/71 kB | 5.5/98 kB Progress (3): 737/782 kB | 15/71 kB | 6.9/98 kB Progress (3): 754/782 kB | 15/71 kB | 6.9/98 kB Progress (3): 754/782 kB | 15/71 kB | 8.3/98 kB Progress (3): 754/782 kB | 15/71 kB | 9.7/98 kB Progress (3): 754/782 kB | 15/71 kB | 11/98 kB Progress (3): 770/782 kB | 15/71 kB | 11/98 kB Progress (3): 770/782 kB | 15/71 kB | 12/98 kB Progress (3): 770/782 kB | 15/71 kB | 14/98 kB Progress (3): 770/782 kB | 15/71 kB | 15/98 kB Progress (3): 782 kB | 15/71 kB | 15/98 kB Progress (3): 782 kB | 15/71 kB | 16/98 kB Progress (3): 782 kB | 15/71 kB | 18/98 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/sdk-core/2.20.43/sdk-core-2.20.43.jar (782 kB at 12 MB/s) 2024-09-14T11:23:54.215 INFO:tasks.workunit.client.0.smithi138.stdout:Progress (2): 15/71 kB | 19/98 kB Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/eventstream/eventstream/1.0.1/eventstream-1.0.1.jar 2024-09-14T11:23:54.218 INFO:tasks.workunit.client.0.smithi138.stdout:Progress (2): 15/71 kB | 21/98 kB Progress (2): 15/71 kB | 22/98 kB Progress (2): 31/71 kB | 22/98 kB Progress (2): 31/71 kB | 23/98 kB Progress (2): 31/71 kB | 25/98 kB Progress (2): 31/71 kB | 26/98 kB Progress (3): 31/71 kB | 26/98 kB | 1.4/11 kB Progress (3): 31/71 kB | 26/98 kB | 1.7/11 kB Progress (3): 31/71 kB | 27/98 kB | 1.7/11 kB Progress (3): 31/71 kB | 27/98 kB | 3.1/11 kB Progress (3): 31/71 kB | 29/98 kB | 3.1/11 kB Progress (3): 31/71 kB | 29/98 kB | 4.5/11 kB Progress (3): 31/71 kB | 30/98 kB | 4.5/11 kB Progress (3): 31/71 kB | 30/98 kB | 5.8/11 kB Progress (3): 31/71 kB | 32/98 kB | 5.8/11 kB Progress (3): 31/71 kB | 32/98 kB | 7.2/11 kB Progress (3): 31/71 kB | 32/98 kB | 8.6/11 kB Progress (3): 31/71 kB | 32/98 kB | 10.0/11 kB Progress (3): 31/71 kB | 32/98 kB | 11/11 kB Progress (3): 31/71 kB | 32/98 kB | 11 kB Progress (3): 31/71 kB | 33/98 kB | 11 kB Progress (3): 31/71 kB | 34/98 kB | 11 kB Progress (3): 31/71 kB | 36/98 kB | 11 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/reactivestreams/reactive-streams/1.0.3/reactive-streams-1.0.3.jar (11 kB at 167 kB/s) 2024-09-14T11:23:54.218 INFO:tasks.workunit.client.0.smithi138.stdout:Progress (2): 31/71 kB | 37/98 kB Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/http-client-spi/2.20.43/http-client-spi-2.20.43.jar 2024-09-14T11:23:54.227 INFO:tasks.workunit.client.0.smithi138.stdout:Progress (2): 31/71 kB | 38/98 kB Progress (2): 31/71 kB | 40/98 kB Progress (2): 31/71 kB | 41/98 kB Progress (2): 48/71 kB | 41/98 kB Progress (2): 48/71 kB | 43/98 kB Progress (2): 48/71 kB | 44/98 kB Progress (2): 48/71 kB | 45/98 kB Progress (2): 48/71 kB | 47/98 kB Progress (2): 48/71 kB | 48/98 kB Progress (2): 48/71 kB | 49/98 kB Progress (2): 48/71 kB | 51/98 kB Progress (3): 48/71 kB | 51/98 kB | 16/205 kB Progress (3): 48/71 kB | 52/98 kB | 16/205 kB Progress (3): 48/71 kB | 53/98 kB | 16/205 kB Progress (3): 48/71 kB | 55/98 kB | 16/205 kB Progress (3): 48/71 kB | 56/98 kB | 16/205 kB Progress (3): 48/71 kB | 57/98 kB | 16/205 kB Progress (3): 48/71 kB | 59/98 kB | 16/205 kB Progress (3): 48/71 kB | 59/98 kB | 33/205 kB Progress (3): 64/71 kB | 59/98 kB | 33/205 kB Progress (3): 71 kB | 59/98 kB | 33/205 kB Progress (3): 71 kB | 60/98 kB | 33/205 kB Progress (3): 71 kB | 62/98 kB | 33/205 kB Progress (3): 71 kB | 63/98 kB | 33/205 kB Progress (3): 71 kB | 63/98 kB | 49/205 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/aws-query-protocol/2.20.43/aws-query-protocol-2.20.43.jar (71 kB at 882 kB/s) 2024-09-14T11:23:54.227 INFO:tasks.workunit.client.0.smithi138.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/regions/2.20.43/regions-2.20.43.jar 2024-09-14T11:23:54.229 INFO:tasks.workunit.client.0.smithi138.stdout:Progress (2): 63/98 kB | 65/205 kB Progress (2): 79/98 kB | 65/205 kB Progress (3): 79/98 kB | 65/205 kB | 16/30 kB Progress (3): 79/98 kB | 65/205 kB | 30 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/eventstream/eventstream/1.0.1/eventstream-1.0.1.jar (30 kB at 377 kB/s) 2024-09-14T11:23:54.229 INFO:tasks.workunit.client.0.smithi138.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/annotations/2.20.43/annotations-2.20.43.jar 2024-09-14T11:23:54.237 INFO:tasks.workunit.client.0.smithi138.stdout:Progress (2): 95/98 kB | 65/205 kB Progress (3): 95/98 kB | 65/205 kB | 1.4/81 kB Progress (3): 95/98 kB | 65/205 kB | 2.8/81 kB Progress (3): 95/98 kB | 65/205 kB | 4.1/81 kB Progress (3): 95/98 kB | 65/205 kB | 5.5/81 kB Progress (3): 95/98 kB | 65/205 kB | 6.9/81 kB Progress (3): 95/98 kB | 65/205 kB | 8.3/81 kB Progress (3): 95/98 kB | 65/205 kB | 9.7/81 kB Progress (3): 95/98 kB | 65/205 kB | 11/81 kB Progress (3): 95/98 kB | 65/205 kB | 12/81 kB Progress (3): 95/98 kB | 65/205 kB | 14/81 kB Progress (3): 95/98 kB | 65/205 kB | 15/81 kB Progress (3): 95/98 kB | 65/205 kB | 16/81 kB Progress (3): 95/98 kB | 65/205 kB | 33/81 kB Progress (3): 95/98 kB | 65/205 kB | 49/81 kB Progress (3): 98 kB | 65/205 kB | 49/81 kB Progress (3): 98 kB | 81/205 kB | 49/81 kB Progress (3): 98 kB | 98/205 kB | 49/81 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/aws-xml-protocol/2.20.43/aws-xml-protocol-2.20.43.jar (98 kB at 1.1 MB/s) 2024-09-14T11:23:54.237 INFO:tasks.workunit.client.0.smithi138.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/utils/2.20.43/utils-2.20.43.jar 2024-09-14T11:23:54.242 INFO:tasks.workunit.client.0.smithi138.stdout:Progress (2): 114/205 kB | 49/81 kB Progress (2): 131/205 kB | 49/81 kB Progress (2): 147/205 kB | 49/81 kB Progress (2): 163/205 kB | 49/81 kB Progress (2): 180/205 kB | 49/81 kB Progress (2): 196/205 kB | 49/81 kB Progress (3): 196/205 kB | 49/81 kB | 16/798 kB Progress (3): 205 kB | 49/81 kB | 16/798 kB Progress (3): 205 kB | 49/81 kB | 33/798 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/auth/2.20.43/auth-2.20.43.jar (205 kB at 2.2 MB/s) 2024-09-14T11:23:54.242 INFO:tasks.workunit.client.0.smithi138.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/aws-core/2.20.43/aws-core-2.20.43.jar 2024-09-14T11:23:54.244 INFO:tasks.workunit.client.0.smithi138.stdout:Progress (2): 49/81 kB | 49/798 kB Progress (2): 66/81 kB | 49/798 kB Progress (3): 66/81 kB | 49/798 kB | 13 kB Progress (3): 66/81 kB | 62/798 kB | 13 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/annotations/2.20.43/annotations-2.20.43.jar (13 kB at 147 kB/s) 2024-09-14T11:23:54.244 INFO:tasks.workunit.client.0.smithi138.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/metrics-spi/2.20.43/metrics-spi-2.20.43.jar 2024-09-14T11:23:54.245 INFO:tasks.workunit.client.0.smithi138.stdout:Progress (2): 81 kB | 62/798 kB Progress (2): 81 kB | 78/798 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/http-client-spi/2.20.43/http-client-spi-2.20.43.jar (81 kB at 893 kB/s) 2024-09-14T11:23:54.245 INFO:tasks.workunit.client.0.smithi138.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/json-utils/2.20.43/json-utils-2.20.43.jar 2024-09-14T11:23:54.259 INFO:tasks.workunit.client.0.smithi138.stdout:Progress (1): 95/798 kB Progress (1): 111/798 kB Progress (2): 111/798 kB | 16/182 kB Progress (2): 111/798 kB | 33/182 kB Progress (2): 111/798 kB | 49/182 kB Progress (2): 111/798 kB | 62/182 kB Progress (2): 128/798 kB | 62/182 kB Progress (2): 128/798 kB | 78/182 kB Progress (2): 128/798 kB | 94/182 kB Progress (2): 144/798 kB | 94/182 kB Progress (2): 160/798 kB | 94/182 kB Progress (2): 160/798 kB | 111/182 kB Progress (2): 177/798 kB | 111/182 kB Progress (2): 193/798 kB | 111/182 kB Progress (2): 193/798 kB | 127/182 kB Progress (2): 209/798 kB | 127/182 kB Progress (2): 226/798 kB | 127/182 kB Progress (2): 242/798 kB | 127/182 kB Progress (3): 242/798 kB | 127/182 kB | 16/151 kB Progress (4): 242/798 kB | 127/182 kB | 16/151 kB | 16/27 kB Progress (4): 259/798 kB | 127/182 kB | 16/151 kB | 16/27 kB Progress (4): 259/798 kB | 127/182 kB | 33/151 kB | 16/27 kB Progress (4): 259/798 kB | 127/182 kB | 33/151 kB | 27 kB Progress (4): 275/798 kB | 127/182 kB | 33/151 kB | 27 kB Progress (4): 275/798 kB | 127/182 kB | 49/151 kB | 27 kB Progress (5): 275/798 kB | 127/182 kB | 49/151 kB | 27 kB | 15/30 kB Progress (5): 291/798 kB | 127/182 kB | 49/151 kB | 27 kB | 15/30 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/metrics-spi/2.20.43/metrics-spi-2.20.43.jar (27 kB at 262 kB/s) 2024-09-14T11:23:54.259 INFO:tasks.workunit.client.0.smithi138.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/third-party-jackson-core/2.20.43/third-party-jackson-core-2.20.43.jar 2024-09-14T11:23:54.260 INFO:tasks.workunit.client.0.smithi138.stdout:Progress (4): 291/798 kB | 127/182 kB | 62/151 kB | 15/30 kB Progress (4): 291/798 kB | 127/182 kB | 62/151 kB | 30 kB Progress (4): 308/798 kB | 127/182 kB | 62/151 kB | 30 kB Progress (4): 308/798 kB | 127/182 kB | 79/151 kB | 30 kB Progress (4): 324/798 kB | 127/182 kB | 79/151 kB | 30 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/json-utils/2.20.43/json-utils-2.20.43.jar (30 kB at 286 kB/s) 2024-09-14T11:23:54.260 INFO:tasks.workunit.client.0.smithi138.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/endpoints-spi/2.20.43/endpoints-spi-2.20.43.jar 2024-09-14T11:23:54.262 INFO:tasks.workunit.client.0.smithi138.stdout:Progress (3): 324/798 kB | 127/182 kB | 95/151 kB Progress (3): 341/798 kB | 127/182 kB | 95/151 kB Progress (3): 341/798 kB | 127/182 kB | 111/151 kB Progress (3): 341/798 kB | 127/182 kB | 128/151 kB Progress (3): 341/798 kB | 127/182 kB | 144/151 kB Progress (3): 341/798 kB | 127/182 kB | 151 kB Progress (3): 341/798 kB | 143/182 kB | 151 kB Progress (3): 341/798 kB | 160/182 kB | 151 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/aws-core/2.20.43/aws-core-2.20.43.jar (151 kB at 1.4 MB/s) 2024-09-14T11:23:54.262 INFO:tasks.workunit.client.0.smithi138.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/apache-client/2.20.43/apache-client-2.20.43.jar 2024-09-14T11:23:54.263 INFO:tasks.workunit.client.0.smithi138.stdout:Progress (2): 341/798 kB | 176/182 kB Progress (2): 341/798 kB | 182 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/utils/2.20.43/utils-2.20.43.jar (182 kB at 1.7 MB/s) 2024-09-14T11:23:54.263 INFO:tasks.workunit.client.0.smithi138.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/httpcomponents/httpclient/4.5.13/httpclient-4.5.13.jar 2024-09-14T11:23:54.273 INFO:tasks.workunit.client.0.smithi138.stdout:Progress (1): 357/798 kB Progress (1): 373/798 kB Progress (1): 390/798 kB Progress (1): 406/798 kB Progress (1): 422/798 kB Progress (1): 439/798 kB Progress (1): 455/798 kB Progress (1): 472/798 kB Progress (1): 488/798 kB Progress (1): 504/798 kB Progress (1): 521/798 kB Progress (1): 537/798 kB Progress (1): 554/798 kB Progress (1): 570/798 kB Progress (1): 586/798 kB Progress (1): 603/798 kB Progress (1): 619/798 kB Progress (1): 635/798 kB Progress (1): 652/798 kB Progress (1): 668/798 kB Progress (1): 685/798 kB Progress (1): 701/798 kB Progress (1): 717/798 kB Progress (1): 734/798 kB Progress (2): 734/798 kB | 13 kB Progress (3): 734/798 kB | 13 kB | 16/385 kB Progress (3): 734/798 kB | 13 kB | 33/385 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/endpoints-spi/2.20.43/endpoints-spi-2.20.43.jar (13 kB at 111 kB/s) 2024-09-14T11:23:54.274 INFO:tasks.workunit.client.0.smithi138.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/httpcomponents/httpcore/4.4.13/httpcore-4.4.13.jar 2024-09-14T11:23:54.279 INFO:tasks.workunit.client.0.smithi138.stdout:Progress (2): 734/798 kB | 49/385 kB Progress (2): 734/798 kB | 65/385 kB Progress (2): 734/798 kB | 82/385 kB Progress (2): 734/798 kB | 98/385 kB Progress (2): 734/798 kB | 114/385 kB Progress (2): 734/798 kB | 131/385 kB Progress (2): 734/798 kB | 147/385 kB Progress (2): 734/798 kB | 164/385 kB Progress (2): 750/798 kB | 164/385 kB Progress (2): 750/798 kB | 180/385 kB Progress (2): 766/798 kB | 180/385 kB Progress (2): 766/798 kB | 196/385 kB Progress (2): 783/798 kB | 196/385 kB Progress (3): 783/798 kB | 196/385 kB | 16/75 kB Progress (3): 798 kB | 196/385 kB | 16/75 kB Progress (3): 798 kB | 213/385 kB | 16/75 kB Progress (4): 798 kB | 213/385 kB | 16/75 kB | 16/780 kB Progress (4): 798 kB | 229/385 kB | 16/75 kB | 16/780 kB Progress (4): 798 kB | 229/385 kB | 33/75 kB | 16/780 kB Progress (4): 798 kB | 229/385 kB | 33/75 kB | 33/780 kB Progress (4): 798 kB | 245/385 kB | 33/75 kB | 33/780 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/regions/2.20.43/regions-2.20.43.jar (798 kB at 6.4 MB/s) 2024-09-14T11:23:54.279 INFO:tasks.workunit.client.0.smithi138.stdout:Downloading from central: https://repo.maven.apache.org/maven2/commons-io/commons-io/2.15.1/commons-io-2.15.1.jar 2024-09-14T11:23:54.279 INFO:tasks.workunit.client.0.smithi138.stdout:Progress (3): 245/385 kB | 33/75 kB | 49/780 kB Progress (3): 245/385 kB | 49/75 kB | 49/780 kB Progress (3): 262/385 kB | 49/75 kB | 49/780 kB Progress (3): 262/385 kB | 49/75 kB | 62/780 kB Progress (3): 278/385 kB | 49/75 kB | 62/780 kB Progress (3): 278/385 kB | 49/75 kB | 78/780 kB Progress (3): 278/385 kB | 66/75 kB | 78/780 kB Progress (3): 295/385 kB | 66/75 kB | 78/780 kB Progress (3): 295/385 kB | 66/75 kB | 94/780 kB Progress (3): 295/385 kB | 75 kB | 94/780 kB Progress (3): 311/385 kB | 75 kB | 94/780 kB Progress (3): 311/385 kB | 75 kB | 111/780 kB Progress (3): 327/385 kB | 75 kB | 111/780 kB Progress (3): 327/385 kB | 75 kB | 127/780 kB Progress (3): 344/385 kB | 75 kB | 127/780 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/apache-client/2.20.43/apache-client-2.20.43.jar (75 kB at 596 kB/s) 2024-09-14T11:23:54.279 INFO:tasks.workunit.client.0.smithi138.stdout:Downloading from central: https://repo.maven.apache.org/maven2/commons-codec/commons-codec/1.15/commons-codec-1.15.jar 2024-09-14T11:23:54.280 INFO:tasks.workunit.client.0.smithi138.stdout:Progress (2): 360/385 kB | 127/780 kB Progress (2): 360/385 kB | 144/780 kB Progress (2): 376/385 kB | 144/780 kB Progress (2): 385 kB | 144/780 kB Progress (2): 385 kB | 160/780 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/third-party-jackson-core/2.20.43/third-party-jackson-core-2.20.43.jar (385 kB at 3.1 MB/s) 2024-09-14T11:23:54.280 INFO:tasks.workunit.client.0.smithi138.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/slf4j/slf4j-api/1.7.28/slf4j-api-1.7.28.jar 2024-09-14T11:23:54.311 INFO:tasks.workunit.client.0.smithi138.stdout:Progress (1): 176/780 kB Progress (1): 193/780 kB Progress (1): 209/780 kB Progress (1): 225/780 kB Progress (1): 242/780 kB Progress (1): 258/780 kB Progress (1): 275/780 kB Progress (1): 291/780 kB Progress (1): 307/780 kB Progress (2): 307/780 kB | 16/329 kB Progress (2): 307/780 kB | 33/329 kB Progress (2): 324/780 kB | 33/329 kB Progress (2): 340/780 kB | 33/329 kB Progress (2): 340/780 kB | 49/329 kB Progress (2): 356/780 kB | 49/329 kB Progress (2): 373/780 kB | 49/329 kB Progress (2): 389/780 kB | 49/329 kB Progress (2): 406/780 kB | 49/329 kB Progress (2): 406/780 kB | 66/329 kB Progress (2): 422/780 kB | 66/329 kB Progress (2): 438/780 kB | 66/329 kB Progress (2): 455/780 kB | 66/329 kB Progress (2): 471/780 kB | 66/329 kB Progress (2): 471/780 kB | 82/329 kB Progress (2): 488/780 kB | 82/329 kB Progress (2): 488/780 kB | 98/329 kB Progress (2): 504/780 kB | 98/329 kB Progress (2): 520/780 kB | 98/329 kB Progress (2): 537/780 kB | 98/329 kB Progress (2): 553/780 kB | 98/329 kB Progress (2): 569/780 kB | 98/329 kB Progress (2): 569/780 kB | 115/329 kB Progress (2): 586/780 kB | 115/329 kB Progress (3): 586/780 kB | 115/329 kB | 16/501 kB Progress (3): 602/780 kB | 115/329 kB | 16/501 kB Progress (3): 619/780 kB | 115/329 kB | 16/501 kB Progress (3): 635/780 kB | 115/329 kB | 16/501 kB Progress (3): 635/780 kB | 115/329 kB | 33/501 kB Progress (3): 651/780 kB | 115/329 kB | 33/501 kB Progress (4): 651/780 kB | 115/329 kB | 33/501 kB | 15/354 kB Progress (4): 651/780 kB | 115/329 kB | 49/501 kB | 15/354 kB Progress (4): 668/780 kB | 115/329 kB | 49/501 kB | 15/354 kB Progress (4): 668/780 kB | 115/329 kB | 49/501 kB | 31/354 kB Progress (5): 668/780 kB | 115/329 kB | 49/501 kB | 31/354 kB | 16/41 kB Progress (5): 668/780 kB | 115/329 kB | 66/501 kB | 31/354 kB | 16/41 kB Progress (5): 684/780 kB | 115/329 kB | 66/501 kB | 31/354 kB | 16/41 kB Progress (5): 684/780 kB | 115/329 kB | 66/501 kB | 48/354 kB | 16/41 kB Progress (5): 684/780 kB | 115/329 kB | 66/501 kB | 48/354 kB | 31/41 kB Progress (5): 684/780 kB | 115/329 kB | 82/501 kB | 48/354 kB | 31/41 kB Progress (5): 701/780 kB | 115/329 kB | 82/501 kB | 48/354 kB | 31/41 kB Progress (5): 701/780 kB | 115/329 kB | 82/501 kB | 64/354 kB | 31/41 kB Progress (5): 701/780 kB | 131/329 kB | 82/501 kB | 64/354 kB | 31/41 kB Progress (5): 717/780 kB | 131/329 kB | 82/501 kB | 64/354 kB | 31/41 kB Progress (5): 717/780 kB | 147/329 kB | 82/501 kB | 64/354 kB | 31/41 kB Progress (5): 733/780 kB | 147/329 kB | 82/501 kB | 64/354 kB | 31/41 kB Progress (5): 750/780 kB | 147/329 kB | 82/501 kB | 64/354 kB | 31/41 kB Progress (5): 766/780 kB | 147/329 kB | 82/501 kB | 64/354 kB | 31/41 kB Progress (5): 780 kB | 147/329 kB | 82/501 kB | 64/354 kB | 31/41 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/httpcomponents/httpclient/4.5.13/httpclient-4.5.13.jar (780 kB at 5.0 MB/s) 2024-09-14T11:23:54.311 INFO:tasks.workunit.client.0.smithi138.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/jupiter/junit-jupiter/5.10.1/junit-jupiter-5.10.1.jar 2024-09-14T11:23:54.314 INFO:tasks.workunit.client.0.smithi138.stdout:Progress (4): 147/329 kB | 82/501 kB | 64/354 kB | 41 kB Progress (4): 164/329 kB | 82/501 kB | 64/354 kB | 41 kB Progress (4): 164/329 kB | 82/501 kB | 81/354 kB | 41 kB Progress (4): 164/329 kB | 98/501 kB | 81/354 kB | 41 kB Progress (4): 180/329 kB | 98/501 kB | 81/354 kB | 41 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/slf4j/slf4j-api/1.7.28/slf4j-api-1.7.28.jar (41 kB at 260 kB/s) 2024-09-14T11:23:54.314 INFO:tasks.workunit.client.0.smithi138.stdout:Progress (3): 180/329 kB | 98/501 kB | 94/354 kB Downloading from central: https://repo.maven.apache.org/maven2/org/junit/jupiter/junit-jupiter-params/5.10.1/junit-jupiter-params-5.10.1.jar 2024-09-14T11:23:54.317 INFO:tasks.workunit.client.0.smithi138.stdout:Progress (3): 180/329 kB | 115/501 kB | 94/354 kB Progress (3): 197/329 kB | 115/501 kB | 94/354 kB Progress (3): 197/329 kB | 115/501 kB | 111/354 kB Progress (3): 197/329 kB | 131/501 kB | 111/354 kB Progress (3): 213/329 kB | 131/501 kB | 111/354 kB Progress (3): 213/329 kB | 131/501 kB | 127/354 kB Progress (3): 213/329 kB | 147/501 kB | 127/354 kB Progress (3): 229/329 kB | 147/501 kB | 127/354 kB Progress (3): 229/329 kB | 147/501 kB | 143/354 kB Progress (3): 229/329 kB | 164/501 kB | 143/354 kB Progress (3): 229/329 kB | 164/501 kB | 160/354 kB Progress (3): 246/329 kB | 164/501 kB | 160/354 kB Progress (3): 246/329 kB | 164/501 kB | 176/354 kB Progress (3): 246/329 kB | 180/501 kB | 176/354 kB Progress (3): 262/329 kB | 180/501 kB | 176/354 kB Progress (3): 262/329 kB | 180/501 kB | 193/354 kB Progress (3): 262/329 kB | 197/501 kB | 193/354 kB Progress (3): 262/329 kB | 197/501 kB | 209/354 kB Progress (3): 279/329 kB | 197/501 kB | 209/354 kB Progress (3): 279/329 kB | 197/501 kB | 225/354 kB Progress (3): 279/329 kB | 213/501 kB | 225/354 kB Progress (3): 295/329 kB | 213/501 kB | 225/354 kB Progress (3): 295/329 kB | 213/501 kB | 242/354 kB Progress (3): 295/329 kB | 229/501 kB | 242/354 kB Progress (3): 295/329 kB | 229/501 kB | 258/354 kB Progress (3): 311/329 kB | 229/501 kB | 258/354 kB Progress (3): 311/329 kB | 229/501 kB | 274/354 kB Progress (3): 311/329 kB | 246/501 kB | 274/354 kB Progress (3): 328/329 kB | 246/501 kB | 274/354 kB Progress (3): 328/329 kB | 246/501 kB | 291/354 kB Progress (3): 329 kB | 246/501 kB | 291/354 kB Progress (3): 329 kB | 262/501 kB | 291/354 kB Progress (3): 329 kB | 262/501 kB | 307/354 kB Progress (3): 329 kB | 262/501 kB | 324/354 kB Progress (3): 329 kB | 279/501 kB | 324/354 kB Progress (3): 329 kB | 279/501 kB | 340/354 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/httpcomponents/httpcore/4.4.13/httpcore-4.4.13.jar (329 kB at 2.0 MB/s) 2024-09-14T11:23:54.317 INFO:tasks.workunit.client.0.smithi138.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/jupiter/junit-jupiter-api/5.10.1/junit-jupiter-api-5.10.1.jar 2024-09-14T11:23:54.317 INFO:tasks.workunit.client.0.smithi138.stdout:Progress (2): 295/501 kB | 340/354 kB Progress (2): 295/501 kB | 354 kB Progress (2): 311/501 kB | 354 kB Downloaded from central: https://repo.maven.apache.org/maven2/commons-codec/commons-codec/1.15/commons-codec-1.15.jar (354 kB at 2.2 MB/s) 2024-09-14T11:23:54.318 INFO:tasks.workunit.client.0.smithi138.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/opentest4j/opentest4j/1.3.0/opentest4j-1.3.0.jar 2024-09-14T11:23:54.322 INFO:tasks.workunit.client.0.smithi138.stdout:Progress (1): 328/501 kB Progress (1): 344/501 kB Progress (1): 360/501 kB Progress (1): 377/501 kB Progress (1): 393/501 kB Progress (1): 410/501 kB Progress (1): 426/501 kB Progress (1): 442/501 kB Progress (1): 459/501 kB Progress (1): 475/501 kB Progress (1): 492/501 kB Progress (1): 501 kB Downloaded from central: https://repo.maven.apache.org/maven2/commons-io/commons-io/2.15.1/commons-io-2.15.1.jar (501 kB at 3.0 MB/s) 2024-09-14T11:23:54.322 INFO:tasks.workunit.client.0.smithi138.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-commons/1.10.1/junit-platform-commons-1.10.1.jar 2024-09-14T11:23:54.326 INFO:tasks.workunit.client.0.smithi138.stdout:Progress (1): 6.4 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/jupiter/junit-jupiter/5.10.1/junit-jupiter-5.10.1.jar (6.4 kB at 37 kB/s) 2024-09-14T11:23:54.326 INFO:tasks.workunit.client.0.smithi138.stdout:Progress (1): 16/586 kB Downloading from central: https://repo.maven.apache.org/maven2/org/apiguardian/apiguardian-api/1.1.2/apiguardian-api-1.1.2.jar 2024-09-14T11:23:54.332 INFO:tasks.workunit.client.0.smithi138.stdout:Progress (1): 33/586 kB Progress (1): 49/586 kB Progress (1): 62/586 kB Progress (1): 78/586 kB Progress (1): 95/586 kB Progress (1): 111/586 kB Progress (1): 127/586 kB Progress (1): 144/586 kB Progress (1): 160/586 kB Progress (1): 176/586 kB Progress (1): 193/586 kB Progress (1): 209/586 kB Progress (1): 226/586 kB Progress (1): 242/586 kB Progress (1): 258/586 kB Progress (1): 275/586 kB Progress (2): 275/586 kB | 16/211 kB Progress (2): 291/586 kB | 16/211 kB Progress (2): 291/586 kB | 33/211 kB Progress (2): 308/586 kB | 33/211 kB Progress (2): 308/586 kB | 49/211 kB Progress (2): 324/586 kB | 49/211 kB Progress (2): 324/586 kB | 66/211 kB Progress (2): 324/586 kB | 81/211 kB Progress (2): 340/586 kB | 81/211 kB Progress (3): 340/586 kB | 81/211 kB | 14 kB Progress (3): 340/586 kB | 98/211 kB | 14 kB Progress (3): 357/586 kB | 98/211 kB | 14 kB Progress (3): 357/586 kB | 114/211 kB | 14 kB Progress (3): 373/586 kB | 114/211 kB | 14 kB Progress (3): 373/586 kB | 131/211 kB | 14 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/opentest4j/opentest4j/1.3.0/opentest4j-1.3.0.jar (14 kB at 81 kB/s) 2024-09-14T11:23:54.332 INFO:tasks.workunit.client.0.smithi138.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/jupiter/junit-jupiter-engine/5.10.1/junit-jupiter-engine-5.10.1.jar 2024-09-14T11:23:54.334 INFO:tasks.workunit.client.0.smithi138.stdout:Progress (2): 389/586 kB | 131/211 kB Progress (2): 389/586 kB | 147/211 kB Progress (2): 406/586 kB | 147/211 kB Progress (2): 406/586 kB | 163/211 kB Progress (2): 406/586 kB | 180/211 kB Progress (2): 422/586 kB | 180/211 kB Progress (2): 422/586 kB | 196/211 kB Progress (2): 439/586 kB | 196/211 kB Progress (2): 439/586 kB | 211 kB Progress (2): 455/586 kB | 211 kB Progress (2): 471/586 kB | 211 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/jupiter/junit-jupiter-api/5.10.1/junit-jupiter-api-5.10.1.jar (211 kB at 1.2 MB/s) 2024-09-14T11:23:54.334 INFO:tasks.workunit.client.0.smithi138.stdout:Progress (1): 488/586 kB Downloading from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-engine/1.10.1/junit-platform-engine-1.10.1.jar 2024-09-14T11:23:54.336 INFO:tasks.workunit.client.0.smithi138.stdout:Progress (1): 504/586 kB Progress (1): 521/586 kB Progress (1): 537/586 kB Progress (1): 553/586 kB Progress (1): 570/586 kB Progress (1): 586 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/jupiter/junit-jupiter-params/5.10.1/junit-jupiter-params-5.10.1.jar (586 kB at 3.2 MB/s) 2024-09-14T11:23:54.336 INFO:tasks.workunit.client.0.smithi138.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/slf4j/slf4j-simple/1.7.28/slf4j-simple-1.7.28.jar 2024-09-14T11:23:54.339 INFO:tasks.workunit.client.0.smithi138.stdout:Progress (1): 16/106 kB Progress (1): 33/106 kB Progress (1): 49/106 kB Progress (1): 66/106 kB Progress (1): 82/106 kB Progress (1): 98/106 kB Progress (1): 106 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-commons/1.10.1/junit-platform-commons-1.10.1.jar (106 kB at 578 kB/s) 2024-09-14T11:23:54.340 INFO:tasks.workunit.client.0.smithi138.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/slf4j/jcl-over-slf4j/1.7.28/jcl-over-slf4j-1.7.28.jar 2024-09-14T11:23:54.341 INFO:tasks.workunit.client.0.smithi138.stdout:Progress (1): 6.8 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apiguardian/apiguardian-api/1.1.2/apiguardian-api-1.1.2.jar (6.8 kB at 37 kB/s) 2024-09-14T11:23:54.341 INFO:tasks.workunit.client.0.smithi138.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-suite/1.10.1/junit-platform-suite-1.10.1.jar 2024-09-14T11:23:54.351 INFO:tasks.workunit.client.0.smithi138.stdout:Progress (1): 16/245 kB Progress (1): 33/245 kB Progress (1): 49/245 kB Progress (1): 63/245 kB Progress (1): 79/245 kB Progress (1): 95/245 kB Progress (1): 112/245 kB Progress (1): 128/245 kB Progress (2): 128/245 kB | 16/205 kB Progress (2): 145/245 kB | 16/205 kB Progress (2): 145/245 kB | 33/205 kB Progress (2): 161/245 kB | 33/205 kB Progress (2): 161/245 kB | 49/205 kB Progress (2): 177/245 kB | 49/205 kB Progress (2): 177/245 kB | 65/205 kB Progress (2): 194/245 kB | 65/205 kB Progress (2): 194/245 kB | 81/205 kB Progress (3): 194/245 kB | 81/205 kB | 15 kB Progress (3): 210/245 kB | 81/205 kB | 15 kB Progress (3): 210/245 kB | 98/205 kB | 15 kB Progress (3): 226/245 kB | 98/205 kB | 15 kB Progress (3): 226/245 kB | 114/205 kB | 15 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/slf4j/slf4j-simple/1.7.28/slf4j-simple-1.7.28.jar (15 kB at 78 kB/s) 2024-09-14T11:23:54.352 INFO:tasks.workunit.client.0.smithi138.stdout:Progress (2): 243/245 kB | 114/205 kB Downloading from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-suite-api/1.10.1/junit-platform-suite-api-1.10.1.jar 2024-09-14T11:23:54.352 INFO:tasks.workunit.client.0.smithi138.stdout:Progress (2): 245 kB | 114/205 kB Progress (2): 245 kB | 130/205 kB Progress (2): 245 kB | 147/205 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/jupiter/junit-jupiter-engine/5.10.1/junit-jupiter-engine-5.10.1.jar (245 kB at 1.2 MB/s) 2024-09-14T11:23:54.352 INFO:tasks.workunit.client.0.smithi138.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-suite-engine/1.10.1/junit-platform-suite-engine-1.10.1.jar 2024-09-14T11:23:54.353 INFO:tasks.workunit.client.0.smithi138.stdout:Progress (1): 163/205 kB Progress (1): 180/205 kB Progress (1): 196/205 kB Progress (1): 205 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-engine/1.10.1/junit-platform-engine-1.10.1.jar (205 kB at 1.0 MB/s) 2024-09-14T11:23:54.353 INFO:tasks.workunit.client.0.smithi138.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-suite-commons/1.10.1/junit-platform-suite-commons-1.10.1.jar 2024-09-14T11:23:54.354 INFO:tasks.workunit.client.0.smithi138.stdout:Progress (1): 16/16 kB Progress (1): 16 kB Progress (2): 16 kB | 6.4 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/slf4j/jcl-over-slf4j/1.7.28/jcl-over-slf4j-1.7.28.jar (16 kB at 83 kB/s) 2024-09-14T11:23:54.355 INFO:tasks.workunit.client.0.smithi138.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-launcher/1.10.1/junit-platform-launcher-1.10.1.jar 2024-09-14T11:23:54.355 INFO:tasks.workunit.client.0.smithi138.stdout:Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-suite/1.10.1/junit-platform-suite-1.10.1.jar (6.4 kB at 32 kB/s) 2024-09-14T11:23:54.366 INFO:tasks.workunit.client.0.smithi138.stdout:Progress (1): 16/24 kB Progress (2): 16/24 kB | 16/23 kB Progress (2): 24 kB | 16/23 kB Progress (2): 24 kB | 23 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-suite-engine/1.10.1/junit-platform-suite-engine-1.10.1.jar (24 kB at 115 kB/s) 2024-09-14T11:23:54.366 INFO:tasks.workunit.client.0.smithi138.stdout:Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-suite-api/1.10.1/junit-platform-suite-api-1.10.1.jar (23 kB at 107 kB/s) 2024-09-14T11:23:54.367 INFO:tasks.workunit.client.0.smithi138.stdout:Progress (1): 2.7/17 kB Progress (1): 11/17 kB Progress (1): 17 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-suite-commons/1.10.1/junit-platform-suite-commons-1.10.1.jar (17 kB at 82 kB/s) 2024-09-14T11:23:54.373 INFO:tasks.workunit.client.0.smithi138.stdout:Progress (1): 16/184 kB Progress (1): 33/184 kB Progress (1): 49/184 kB Progress (1): 66/184 kB Progress (1): 82/184 kB Progress (1): 98/184 kB Progress (1): 114/184 kB Progress (1): 130/184 kB Progress (1): 147/184 kB Progress (1): 163/184 kB Progress (1): 180/184 kB Progress (1): 184 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-launcher/1.10.1/junit-platform-launcher-1.10.1.jar (184 kB at 843 kB/s) 2024-09-14T11:23:54.400 INFO:tasks.workunit.client.0.smithi138.stdout:[INFO] 2024-09-14T11:23:54.400 INFO:tasks.workunit.client.0.smithi138.stdout:[INFO] --- clean:3.2.0:clean (default-clean) @ jcksum --- 2024-09-14T11:23:54.409 INFO:tasks.workunit.client.0.smithi138.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/maven-shared-utils/3.3.4/maven-shared-utils-3.3.4.pom 2024-09-14T11:23:54.425 INFO:tasks.workunit.client.0.smithi138.stdout:Progress (1): 5.8 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/maven-shared-utils/3.3.4/maven-shared-utils-3.3.4.pom (5.8 kB at 364 kB/s) 2024-09-14T11:23:54.428 INFO:tasks.workunit.client.0.smithi138.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/maven-shared-components/34/maven-shared-components-34.pom 2024-09-14T11:23:54.443 INFO:tasks.workunit.client.0.smithi138.stdout:Progress (1): 5.1 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/maven-shared-components/34/maven-shared-components-34.pom (5.1 kB at 340 kB/s) 2024-09-14T11:23:54.446 INFO:tasks.workunit.client.0.smithi138.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-parent/34/maven-parent-34.pom 2024-09-14T11:23:54.460 INFO:tasks.workunit.client.0.smithi138.stdout:Progress (1): 16/43 kB Progress (1): 33/43 kB Progress (1): 43 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-parent/34/maven-parent-34.pom (43 kB at 2.9 MB/s) 2024-09-14T11:23:54.466 INFO:tasks.workunit.client.0.smithi138.stdout:Downloading from central: https://repo.maven.apache.org/maven2/commons-io/commons-io/2.6/commons-io-2.6.pom 2024-09-14T11:23:54.481 INFO:tasks.workunit.client.0.smithi138.stdout:Progress (1): 14 kB Downloaded from central: https://repo.maven.apache.org/maven2/commons-io/commons-io/2.6/commons-io-2.6.pom (14 kB at 1.0 MB/s) 2024-09-14T11:23:54.487 INFO:tasks.workunit.client.0.smithi138.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/maven-shared-utils/3.3.4/maven-shared-utils-3.3.4.jar 2024-09-14T11:23:54.504 INFO:tasks.workunit.client.0.smithi138.stdout:Progress (1): 16/153 kB Progress (1): 33/153 kB Progress (1): 49/153 kB Progress (1): 66/153 kB Progress (1): 82/153 kB Progress (1): 98/153 kB Progress (1): 115/153 kB Progress (1): 131/153 kB Progress (1): 147/153 kB Progress (1): 153 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/maven-shared-utils/3.3.4/maven-shared-utils-3.3.4.jar (153 kB at 9.0 MB/s) 2024-09-14T11:23:54.505 INFO:tasks.workunit.client.0.smithi138.stdout:Downloading from central: https://repo.maven.apache.org/maven2/commons-io/commons-io/2.6/commons-io-2.6.jar 2024-09-14T11:23:54.525 INFO:tasks.workunit.client.0.smithi138.stdout:Progress (1): 16/215 kB Progress (1): 33/215 kB Progress (1): 49/215 kB Progress (1): 66/215 kB Progress (1): 82/215 kB Progress (1): 96/215 kB Progress (1): 112/215 kB Progress (1): 129/215 kB Progress (1): 145/215 kB Progress (1): 161/215 kB Progress (1): 178/215 kB Progress (1): 194/215 kB Progress (1): 211/215 kB Progress (1): 215 kB Downloaded from central: https://repo.maven.apache.org/maven2/commons-io/commons-io/2.6/commons-io-2.6.jar (215 kB at 10 MB/s) 2024-09-14T11:23:54.603 INFO:tasks.workunit.client.0.smithi138.stdout:[INFO] 2024-09-14T11:23:54.603 INFO:tasks.workunit.client.0.smithi138.stdout:[INFO] --- resources:3.3.1:resources (default-resources) @ jcksum --- 2024-09-14T11:23:54.607 INFO:tasks.workunit.client.0.smithi138.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-interpolation/1.26/plexus-interpolation-1.26.pom 2024-09-14T11:23:54.622 INFO:tasks.workunit.client.0.smithi138.stdout:Progress (1): 2.7 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-interpolation/1.26/plexus-interpolation-1.26.pom (2.7 kB at 190 kB/s) 2024-09-14T11:23:54.624 INFO:tasks.workunit.client.0.smithi138.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus/5.1/plexus-5.1.pom 2024-09-14T11:23:54.639 INFO:tasks.workunit.client.0.smithi138.stdout:Progress (1): 16/23 kB Progress (1): 23 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus/5.1/plexus-5.1.pom (23 kB at 1.5 MB/s) 2024-09-14T11:23:54.642 INFO:tasks.workunit.client.0.smithi138.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-utils/3.5.1/plexus-utils-3.5.1.pom 2024-09-14T11:23:54.656 INFO:tasks.workunit.client.0.smithi138.stdout:Progress (1): 8.8 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-utils/3.5.1/plexus-utils-3.5.1.pom (8.8 kB at 626 kB/s) 2024-09-14T11:23:54.659 INFO:tasks.workunit.client.0.smithi138.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus/10/plexus-10.pom 2024-09-14T11:23:54.673 INFO:tasks.workunit.client.0.smithi138.stdout:Progress (1): 16/25 kB Progress (1): 25 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus/10/plexus-10.pom (25 kB at 1.8 MB/s) 2024-09-14T11:23:54.677 INFO:tasks.workunit.client.0.smithi138.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/maven-filtering/3.3.1/maven-filtering-3.3.1.pom 2024-09-14T11:23:54.691 INFO:tasks.workunit.client.0.smithi138.stdout:Progress (1): 6.0 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/maven-filtering/3.3.1/maven-filtering-3.3.1.pom (6.0 kB at 402 kB/s) 2024-09-14T11:23:54.693 INFO:tasks.workunit.client.0.smithi138.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/maven-shared-components/39/maven-shared-components-39.pom 2024-09-14T11:23:54.708 INFO:tasks.workunit.client.0.smithi138.stdout:Progress (1): 3.2 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/maven-shared-components/39/maven-shared-components-39.pom (3.2 kB at 215 kB/s) 2024-09-14T11:23:54.712 INFO:tasks.workunit.client.0.smithi138.stdout:Downloading from central: https://repo.maven.apache.org/maven2/javax/inject/javax.inject/1/javax.inject-1.pom 2024-09-14T11:23:54.728 INFO:tasks.workunit.client.0.smithi138.stdout:Progress (1): 612 B Downloaded from central: https://repo.maven.apache.org/maven2/javax/inject/javax.inject/1/javax.inject-1.pom (612 B at 41 kB/s) 2024-09-14T11:23:54.730 INFO:tasks.workunit.client.0.smithi138.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/slf4j/slf4j-api/1.7.36/slf4j-api-1.7.36.pom 2024-09-14T11:23:54.744 INFO:tasks.workunit.client.0.smithi138.stdout:Progress (1): 2.7 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/slf4j/slf4j-api/1.7.36/slf4j-api-1.7.36.pom (2.7 kB at 196 kB/s) 2024-09-14T11:23:54.746 INFO:tasks.workunit.client.0.smithi138.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/slf4j/slf4j-parent/1.7.36/slf4j-parent-1.7.36.pom 2024-09-14T11:23:54.761 INFO:tasks.workunit.client.0.smithi138.stdout:Progress (1): 14 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/slf4j/slf4j-parent/1.7.36/slf4j-parent-1.7.36.pom (14 kB at 1.0 MB/s) 2024-09-14T11:23:54.764 INFO:tasks.workunit.client.0.smithi138.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/sonatype/plexus/plexus-build-api/0.0.7/plexus-build-api-0.0.7.pom 2024-09-14T11:23:54.779 INFO:tasks.workunit.client.0.smithi138.stdout:Progress (1): 3.2 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/sonatype/plexus/plexus-build-api/0.0.7/plexus-build-api-0.0.7.pom (3.2 kB at 214 kB/s) 2024-09-14T11:23:54.781 INFO:tasks.workunit.client.0.smithi138.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/sonatype/spice/spice-parent/15/spice-parent-15.pom 2024-09-14T11:23:54.796 INFO:tasks.workunit.client.0.smithi138.stdout:Progress (1): 8.4 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/sonatype/spice/spice-parent/15/spice-parent-15.pom (8.4 kB at 557 kB/s) 2024-09-14T11:23:54.798 INFO:tasks.workunit.client.0.smithi138.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/sonatype/forge/forge-parent/5/forge-parent-5.pom 2024-09-14T11:23:54.813 INFO:tasks.workunit.client.0.smithi138.stdout:Progress (1): 8.4 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/sonatype/forge/forge-parent/5/forge-parent-5.pom (8.4 kB at 597 kB/s) 2024-09-14T11:23:54.816 INFO:tasks.workunit.client.0.smithi138.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-utils/3.5.0/plexus-utils-3.5.0.pom 2024-09-14T11:23:54.831 INFO:tasks.workunit.client.0.smithi138.stdout:Progress (1): 8.0 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-utils/3.5.0/plexus-utils-3.5.0.pom (8.0 kB at 534 kB/s) 2024-09-14T11:23:54.835 INFO:tasks.workunit.client.0.smithi138.stdout:Downloading from central: https://repo.maven.apache.org/maven2/commons-io/commons-io/2.11.0/commons-io-2.11.0.pom 2024-09-14T11:23:54.850 INFO:tasks.workunit.client.0.smithi138.stdout:Progress (1): 16/20 kB Progress (1): 20 kB Downloaded from central: https://repo.maven.apache.org/maven2/commons-io/commons-io/2.11.0/commons-io-2.11.0.pom (20 kB at 1.3 MB/s) 2024-09-14T11:23:54.856 INFO:tasks.workunit.client.0.smithi138.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/junit-bom/5.7.2/junit-bom-5.7.2.pom 2024-09-14T11:23:54.870 INFO:tasks.workunit.client.0.smithi138.stdout:Progress (1): 5.1 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/junit-bom/5.7.2/junit-bom-5.7.2.pom (5.1 kB at 364 kB/s) 2024-09-14T11:23:54.873 INFO:tasks.workunit.client.0.smithi138.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/commons/commons-lang3/3.12.0/commons-lang3-3.12.0.pom 2024-09-14T11:23:54.887 INFO:tasks.workunit.client.0.smithi138.stdout:Progress (1): 16/31 kB Progress (1): 31 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/commons/commons-lang3/3.12.0/commons-lang3-3.12.0.pom (31 kB at 2.0 MB/s) 2024-09-14T11:23:54.893 INFO:tasks.workunit.client.0.smithi138.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/junit-bom/5.7.1/junit-bom-5.7.1.pom 2024-09-14T11:23:54.906 INFO:tasks.workunit.client.0.smithi138.stdout:Progress (1): 5.1 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/junit-bom/5.7.1/junit-bom-5.7.1.pom (5.1 kB at 364 kB/s) 2024-09-14T11:23:54.911 INFO:tasks.workunit.client.0.smithi138.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-interpolation/1.26/plexus-interpolation-1.26.jar 2024-09-14T11:23:54.927 INFO:tasks.workunit.client.0.smithi138.stdout:Progress (1): 16/85 kB Progress (1): 33/85 kB Progress (1): 49/85 kB Progress (1): 66/85 kB Progress (1): 82/85 kB Progress (1): 85 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-interpolation/1.26/plexus-interpolation-1.26.jar (85 kB at 5.3 MB/s) 2024-09-14T11:23:54.928 INFO:tasks.workunit.client.0.smithi138.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-utils/3.5.1/plexus-utils-3.5.1.jar 2024-09-14T11:23:54.928 INFO:tasks.workunit.client.0.smithi138.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/maven-filtering/3.3.1/maven-filtering-3.3.1.jar 2024-09-14T11:23:54.928 INFO:tasks.workunit.client.0.smithi138.stdout:Downloading from central: https://repo.maven.apache.org/maven2/javax/inject/javax.inject/1/javax.inject-1.jar 2024-09-14T11:23:54.929 INFO:tasks.workunit.client.0.smithi138.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/slf4j/slf4j-api/1.7.36/slf4j-api-1.7.36.jar 2024-09-14T11:23:54.929 INFO:tasks.workunit.client.0.smithi138.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/sonatype/plexus/plexus-build-api/0.0.7/plexus-build-api-0.0.7.jar 2024-09-14T11:23:54.944 INFO:tasks.workunit.client.0.smithi138.stdout:Progress (1): 2.5 kB Progress (2): 2.5 kB | 8.5 kB Progress (3): 2.5 kB | 8.5 kB | 16/269 kB Progress (4): 2.5 kB | 8.5 kB | 16/269 kB | 16/55 kB Progress (4): 2.5 kB | 8.5 kB | 33/269 kB | 16/55 kB Downloaded from central: https://repo.maven.apache.org/maven2/javax/inject/javax.inject/1/javax.inject-1.jar (2.5 kB at 166 kB/s) 2024-09-14T11:23:54.944 INFO:tasks.workunit.client.0.smithi138.stdout:Downloaded from central: https://repo.maven.apache.org/maven2/org/sonatype/plexus/plexus-build-api/0.0.7/plexus-build-api-0.0.7.jar (8.5 kB at 565 kB/s) 2024-09-14T11:23:54.944 INFO:tasks.workunit.client.0.smithi138.stdout:Downloading from central: https://repo.maven.apache.org/maven2/commons-io/commons-io/2.11.0/commons-io-2.11.0.jar 2024-09-14T11:23:54.944 INFO:tasks.workunit.client.0.smithi138.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/commons/commons-lang3/3.12.0/commons-lang3-3.12.0.jar 2024-09-14T11:23:54.944 INFO:tasks.workunit.client.0.smithi138.stdout:Progress (2): 33/269 kB | 33/55 kB Progress (3): 33/269 kB | 33/55 kB | 16/41 kB Progress (3): 49/269 kB | 33/55 kB | 16/41 kB Progress (3): 49/269 kB | 49/55 kB | 16/41 kB Progress (3): 49/269 kB | 55 kB | 16/41 kB Progress (3): 49/269 kB | 55 kB | 33/41 kB Progress (3): 63/269 kB | 55 kB | 33/41 kB Progress (3): 63/269 kB | 55 kB | 41 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/maven-filtering/3.3.1/maven-filtering-3.3.1.jar (55 kB at 3.2 MB/s) 2024-09-14T11:23:54.945 INFO:tasks.workunit.client.0.smithi138.stdout:Progress (2): 80/269 kB | 41 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/slf4j/slf4j-api/1.7.36/slf4j-api-1.7.36.jar (41 kB at 2.6 MB/s) 2024-09-14T11:23:54.949 INFO:tasks.workunit.client.0.smithi138.stdout:Progress (1): 96/269 kB Progress (1): 112/269 kB Progress (1): 129/269 kB Progress (1): 145/269 kB Progress (1): 162/269 kB Progress (1): 178/269 kB Progress (1): 194/269 kB Progress (1): 211/269 kB Progress (1): 227/269 kB Progress (1): 243/269 kB Progress (1): 260/269 kB Progress (1): 269 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-utils/3.5.1/plexus-utils-3.5.1.jar (269 kB at 12 MB/s) 2024-09-14T11:23:54.965 INFO:tasks.workunit.client.0.smithi138.stdout:Progress (1): 16/327 kB Progress (1): 33/327 kB Progress (1): 49/327 kB Progress (1): 63/327 kB Progress (2): 63/327 kB | 16/587 kB Progress (2): 79/327 kB | 16/587 kB Progress (2): 79/327 kB | 33/587 kB Progress (2): 96/327 kB | 33/587 kB Progress (2): 96/327 kB | 49/587 kB Progress (2): 112/327 kB | 49/587 kB Progress (2): 112/327 kB | 66/587 kB Progress (2): 128/327 kB | 66/587 kB Progress (2): 128/327 kB | 82/587 kB Progress (2): 145/327 kB | 82/587 kB Progress (2): 161/327 kB | 82/587 kB Progress (2): 161/327 kB | 98/587 kB Progress (2): 178/327 kB | 98/587 kB Progress (2): 178/327 kB | 115/587 kB Progress (2): 194/327 kB | 115/587 kB Progress (2): 194/327 kB | 131/587 kB Progress (2): 210/327 kB | 131/587 kB Progress (2): 210/327 kB | 147/587 kB Progress (2): 227/327 kB | 147/587 kB Progress (2): 227/327 kB | 164/587 kB Progress (2): 243/327 kB | 164/587 kB Progress (2): 243/327 kB | 180/587 kB Progress (2): 260/327 kB | 180/587 kB Progress (2): 260/327 kB | 197/587 kB Progress (2): 276/327 kB | 197/587 kB Progress (2): 276/327 kB | 213/587 kB Progress (2): 292/327 kB | 213/587 kB Progress (2): 292/327 kB | 229/587 kB Progress (2): 309/327 kB | 229/587 kB Progress (2): 309/327 kB | 246/587 kB Progress (2): 325/327 kB | 246/587 kB Progress (2): 327 kB | 246/587 kB Progress (2): 327 kB | 256/587 kB Progress (2): 327 kB | 272/587 kB Downloaded from central: https://repo.maven.apache.org/maven2/commons-io/commons-io/2.11.0/commons-io-2.11.0.jar (327 kB at 9.1 MB/s) 2024-09-14T11:23:54.970 INFO:tasks.workunit.client.0.smithi138.stdout:Progress (1): 289/587 kB Progress (1): 305/587 kB Progress (1): 321/587 kB Progress (1): 338/587 kB Progress (1): 354/587 kB Progress (1): 370/587 kB Progress (1): 387/587 kB Progress (1): 403/587 kB Progress (1): 420/587 kB Progress (1): 436/587 kB Progress (1): 452/587 kB Progress (1): 469/587 kB Progress (1): 485/587 kB Progress (1): 502/587 kB Progress (1): 518/587 kB Progress (1): 534/587 kB Progress (1): 551/587 kB Progress (1): 567/587 kB Progress (1): 583/587 kB Progress (1): 587 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/commons/commons-lang3/3.12.0/commons-lang3-3.12.0.jar (587 kB at 14 MB/s) 2024-09-14T11:23:55.027 INFO:tasks.workunit.client.0.smithi138.stdout:[INFO] skip non existing resourceDirectory /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/jcksum/src/main/resources 2024-09-14T11:23:55.027 INFO:tasks.workunit.client.0.smithi138.stdout:[INFO] 2024-09-14T11:23:55.027 INFO:tasks.workunit.client.0.smithi138.stdout:[INFO] --- compiler:3.11.0:compile (default-compile) @ jcksum --- 2024-09-14T11:23:55.034 INFO:tasks.workunit.client.0.smithi138.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/maven-shared-incremental/1.1/maven-shared-incremental-1.1.pom 2024-09-14T11:23:55.049 INFO:tasks.workunit.client.0.smithi138.stdout:Progress (1): 4.7 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/maven-shared-incremental/1.1/maven-shared-incremental-1.1.pom (4.7 kB at 339 kB/s) 2024-09-14T11:23:55.051 INFO:tasks.workunit.client.0.smithi138.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/maven-shared-components/19/maven-shared-components-19.pom 2024-09-14T11:23:55.065 INFO:tasks.workunit.client.0.smithi138.stdout:Progress (1): 6.4 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/maven-shared-components/19/maven-shared-components-19.pom (6.4 kB at 454 kB/s) 2024-09-14T11:23:55.068 INFO:tasks.workunit.client.0.smithi138.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-parent/23/maven-parent-23.pom 2024-09-14T11:23:55.083 INFO:tasks.workunit.client.0.smithi138.stdout:Progress (1): 16/33 kB Progress (1): 33 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-parent/23/maven-parent-23.pom (33 kB at 2.3 MB/s) 2024-09-14T11:23:55.085 INFO:tasks.workunit.client.0.smithi138.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/apache/13/apache-13.pom 2024-09-14T11:23:55.099 INFO:tasks.workunit.client.0.smithi138.stdout:Progress (1): 14 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/apache/13/apache-13.pom (14 kB at 998 kB/s) 2024-09-14T11:23:55.103 INFO:tasks.workunit.client.0.smithi138.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-component-annotations/1.5.5/plexus-component-annotations-1.5.5.pom 2024-09-14T11:23:55.117 INFO:tasks.workunit.client.0.smithi138.stdout:Progress (1): 815 B Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-component-annotations/1.5.5/plexus-component-annotations-1.5.5.pom (815 B at 58 kB/s) 2024-09-14T11:23:55.119 INFO:tasks.workunit.client.0.smithi138.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-containers/1.5.5/plexus-containers-1.5.5.pom 2024-09-14T11:23:55.133 INFO:tasks.workunit.client.0.smithi138.stdout:Progress (1): 4.2 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-containers/1.5.5/plexus-containers-1.5.5.pom (4.2 kB at 303 kB/s) 2024-09-14T11:23:55.135 INFO:tasks.workunit.client.0.smithi138.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus/2.0.7/plexus-2.0.7.pom 2024-09-14T11:23:55.149 INFO:tasks.workunit.client.0.smithi138.stdout:Progress (1): 16/17 kB Progress (1): 17 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus/2.0.7/plexus-2.0.7.pom (17 kB at 1.2 MB/s) 2024-09-14T11:23:55.152 INFO:tasks.workunit.client.0.smithi138.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-java/1.1.2/plexus-java-1.1.2.pom 2024-09-14T11:23:55.167 INFO:tasks.workunit.client.0.smithi138.stdout:Progress (1): 5.0 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-java/1.1.2/plexus-java-1.1.2.pom (5.0 kB at 331 kB/s) 2024-09-14T11:23:55.169 INFO:tasks.workunit.client.0.smithi138.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-languages/1.1.2/plexus-languages-1.1.2.pom 2024-09-14T11:23:55.183 INFO:tasks.workunit.client.0.smithi138.stdout:Progress (1): 4.1 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-languages/1.1.2/plexus-languages-1.1.2.pom (4.1 kB at 296 kB/s) 2024-09-14T11:23:55.187 INFO:tasks.workunit.client.0.smithi138.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/ow2/asm/asm/9.4/asm-9.4.pom 2024-09-14T11:23:55.201 INFO:tasks.workunit.client.0.smithi138.stdout:Progress (1): 2.4 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/ow2/asm/asm/9.4/asm-9.4.pom (2.4 kB at 169 kB/s) 2024-09-14T11:23:55.203 INFO:tasks.workunit.client.0.smithi138.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/ow2/ow2/1.5.1/ow2-1.5.1.pom 2024-09-14T11:23:55.217 INFO:tasks.workunit.client.0.smithi138.stdout:Progress (1): 11 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/ow2/ow2/1.5.1/ow2-1.5.1.pom (11 kB at 806 kB/s) 2024-09-14T11:23:55.220 INFO:tasks.workunit.client.0.smithi138.stdout:Downloading from central: https://repo.maven.apache.org/maven2/com/thoughtworks/qdox/qdox/2.0.3/qdox-2.0.3.pom 2024-09-14T11:23:55.236 INFO:tasks.workunit.client.0.smithi138.stdout:Progress (1): 16/17 kB Progress (1): 17 kB Downloaded from central: https://repo.maven.apache.org/maven2/com/thoughtworks/qdox/qdox/2.0.3/qdox-2.0.3.pom (17 kB at 1.1 MB/s) 2024-09-14T11:23:55.238 INFO:tasks.workunit.client.0.smithi138.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/sonatype/oss/oss-parent/9/oss-parent-9.pom 2024-09-14T11:23:55.252 INFO:tasks.workunit.client.0.smithi138.stdout:Progress (1): 6.6 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/sonatype/oss/oss-parent/9/oss-parent-9.pom (6.6 kB at 469 kB/s) 2024-09-14T11:23:55.255 INFO:tasks.workunit.client.0.smithi138.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-compiler-api/2.13.0/plexus-compiler-api-2.13.0.pom 2024-09-14T11:23:55.270 INFO:tasks.workunit.client.0.smithi138.stdout:Progress (1): 1.1 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-compiler-api/2.13.0/plexus-compiler-api-2.13.0.pom (1.1 kB at 70 kB/s) 2024-09-14T11:23:55.273 INFO:tasks.workunit.client.0.smithi138.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-compiler/2.13.0/plexus-compiler-2.13.0.pom 2024-09-14T11:23:55.288 INFO:tasks.workunit.client.0.smithi138.stdout:Progress (1): 8.4 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-compiler/2.13.0/plexus-compiler-2.13.0.pom (8.4 kB at 524 kB/s) 2024-09-14T11:23:55.290 INFO:tasks.workunit.client.0.smithi138.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-components/10.0/plexus-components-10.0.pom 2024-09-14T11:23:55.305 INFO:tasks.workunit.client.0.smithi138.stdout:Progress (1): 2.7 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-components/10.0/plexus-components-10.0.pom (2.7 kB at 191 kB/s) 2024-09-14T11:23:55.310 INFO:tasks.workunit.client.0.smithi138.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/junit-bom/5.9.1/junit-bom-5.9.1.pom 2024-09-14T11:23:55.325 INFO:tasks.workunit.client.0.smithi138.stdout:Progress (1): 5.6 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/junit-bom/5.9.1/junit-bom-5.9.1.pom (5.6 kB at 375 kB/s) 2024-09-14T11:23:55.330 INFO:tasks.workunit.client.0.smithi138.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-compiler-manager/2.13.0/plexus-compiler-manager-2.13.0.pom 2024-09-14T11:23:55.345 INFO:tasks.workunit.client.0.smithi138.stdout:Progress (1): 1.1 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-compiler-manager/2.13.0/plexus-compiler-manager-2.13.0.pom (1.1 kB at 71 kB/s) 2024-09-14T11:23:55.351 INFO:tasks.workunit.client.0.smithi138.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-component-annotations/2.1.1/plexus-component-annotations-2.1.1.pom 2024-09-14T11:23:55.366 INFO:tasks.workunit.client.0.smithi138.stdout:Progress (1): 770 B Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-component-annotations/2.1.1/plexus-component-annotations-2.1.1.pom (770 B at 51 kB/s) 2024-09-14T11:23:55.369 INFO:tasks.workunit.client.0.smithi138.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-containers/2.1.1/plexus-containers-2.1.1.pom 2024-09-14T11:23:55.385 INFO:tasks.workunit.client.0.smithi138.stdout:Progress (1): 6.0 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-containers/2.1.1/plexus-containers-2.1.1.pom (6.0 kB at 402 kB/s) 2024-09-14T11:23:55.388 INFO:tasks.workunit.client.0.smithi138.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus/6.5/plexus-6.5.pom 2024-09-14T11:23:55.404 INFO:tasks.workunit.client.0.smithi138.stdout:Progress (1): 16/26 kB Progress (1): 26 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus/6.5/plexus-6.5.pom (26 kB at 1.6 MB/s) 2024-09-14T11:23:55.410 INFO:tasks.workunit.client.0.smithi138.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-compiler-javac/2.13.0/plexus-compiler-javac-2.13.0.pom 2024-09-14T11:23:55.425 INFO:tasks.workunit.client.0.smithi138.stdout:Progress (1): 1.2 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-compiler-javac/2.13.0/plexus-compiler-javac-2.13.0.pom (1.2 kB at 75 kB/s) 2024-09-14T11:23:55.428 INFO:tasks.workunit.client.0.smithi138.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-compilers/2.13.0/plexus-compilers-2.13.0.pom 2024-09-14T11:23:55.444 INFO:tasks.workunit.client.0.smithi138.stdout:Progress (1): 1.3 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-compilers/2.13.0/plexus-compilers-2.13.0.pom (1.3 kB at 88 kB/s) 2024-09-14T11:23:55.457 INFO:tasks.workunit.client.0.smithi138.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/maven-shared-incremental/1.1/maven-shared-incremental-1.1.jar 2024-09-14T11:23:55.472 INFO:tasks.workunit.client.0.smithi138.stdout:Progress (1): 14 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/maven-shared-incremental/1.1/maven-shared-incremental-1.1.jar (14 kB at 903 kB/s) 2024-09-14T11:23:55.472 INFO:tasks.workunit.client.0.smithi138.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-component-annotations/1.5.5/plexus-component-annotations-1.5.5.jar 2024-09-14T11:23:55.473 INFO:tasks.workunit.client.0.smithi138.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-java/1.1.2/plexus-java-1.1.2.jar 2024-09-14T11:23:55.473 INFO:tasks.workunit.client.0.smithi138.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/ow2/asm/asm/9.4/asm-9.4.jar 2024-09-14T11:23:55.474 INFO:tasks.workunit.client.0.smithi138.stdout:Downloading from central: https://repo.maven.apache.org/maven2/com/thoughtworks/qdox/qdox/2.0.3/qdox-2.0.3.jar 2024-09-14T11:23:55.474 INFO:tasks.workunit.client.0.smithi138.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-compiler-api/2.13.0/plexus-compiler-api-2.13.0.jar 2024-09-14T11:23:55.490 INFO:tasks.workunit.client.0.smithi138.stdout:Progress (1): 16/55 kB Progress (2): 16/55 kB | 4.2 kB Progress (3): 16/55 kB | 4.2 kB | 16/334 kB Progress (3): 33/55 kB | 4.2 kB | 16/334 kB Progress (4): 33/55 kB | 4.2 kB | 16/334 kB | 16/122 kB Progress (4): 49/55 kB | 4.2 kB | 16/334 kB | 16/122 kB Progress (5): 49/55 kB | 4.2 kB | 16/334 kB | 16/122 kB | 16/27 kB Progress (5): 55 kB | 4.2 kB | 16/334 kB | 16/122 kB | 16/27 kB Progress (5): 55 kB | 4.2 kB | 16/334 kB | 32/122 kB | 16/27 kB Progress (5): 55 kB | 4.2 kB | 33/334 kB | 32/122 kB | 16/27 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-component-annotations/1.5.5/plexus-component-annotations-1.5.5.jar (4.2 kB at 248 kB/s) 2024-09-14T11:23:55.490 INFO:tasks.workunit.client.0.smithi138.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-utils/3.5.0/plexus-utils-3.5.0.jar 2024-09-14T11:23:55.490 INFO:tasks.workunit.client.0.smithi138.stdout:Progress (4): 55 kB | 33/334 kB | 32/122 kB | 27 kB Progress (4): 55 kB | 33/334 kB | 49/122 kB | 27 kB Progress (4): 55 kB | 49/334 kB | 49/122 kB | 27 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-java/1.1.2/plexus-java-1.1.2.jar (55 kB at 3.2 MB/s) 2024-09-14T11:23:55.490 INFO:tasks.workunit.client.0.smithi138.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-compiler-manager/2.13.0/plexus-compiler-manager-2.13.0.jar 2024-09-14T11:23:55.490 INFO:tasks.workunit.client.0.smithi138.stdout:Progress (3): 49/334 kB | 65/122 kB | 27 kB Progress (3): 62/334 kB | 65/122 kB | 27 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-compiler-api/2.13.0/plexus-compiler-api-2.13.0.jar (27 kB at 1.7 MB/s) 2024-09-14T11:23:55.490 INFO:tasks.workunit.client.0.smithi138.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-compiler-javac/2.13.0/plexus-compiler-javac-2.13.0.jar 2024-09-14T11:23:55.492 INFO:tasks.workunit.client.0.smithi138.stdout:Progress (2): 62/334 kB | 81/122 kB Progress (2): 79/334 kB | 81/122 kB Progress (2): 79/334 kB | 98/122 kB Progress (2): 95/334 kB | 98/122 kB Progress (2): 95/334 kB | 114/122 kB Progress (2): 111/334 kB | 114/122 kB Progress (2): 111/334 kB | 122 kB Progress (2): 128/334 kB | 122 kB Progress (2): 144/334 kB | 122 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/ow2/asm/asm/9.4/asm-9.4.jar (122 kB at 6.1 MB/s) 2024-09-14T11:23:55.497 INFO:tasks.workunit.client.0.smithi138.stdout:Progress (1): 161/334 kB Progress (1): 177/334 kB Progress (1): 193/334 kB Progress (1): 210/334 kB Progress (1): 226/334 kB Progress (1): 242/334 kB Progress (1): 259/334 kB Progress (1): 275/334 kB Progress (1): 292/334 kB Progress (1): 308/334 kB Progress (1): 324/334 kB Progress (1): 334 kB Downloaded from central: https://repo.maven.apache.org/maven2/com/thoughtworks/qdox/qdox/2.0.3/qdox-2.0.3.jar (334 kB at 14 MB/s) 2024-09-14T11:23:55.503 INFO:tasks.workunit.client.0.smithi138.stdout:Progress (1): 15/267 kB Progress (2): 15/267 kB | 4.7 kB Progress (2): 31/267 kB | 4.7 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-compiler-manager/2.13.0/plexus-compiler-manager-2.13.0.jar (4.7 kB at 155 kB/s) 2024-09-14T11:23:55.505 INFO:tasks.workunit.client.0.smithi138.stdout:Progress (1): 48/267 kB Progress (2): 48/267 kB | 16/23 kB Progress (2): 64/267 kB | 16/23 kB Progress (2): 64/267 kB | 23 kB Progress (2): 80/267 kB | 23 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-compiler-javac/2.13.0/plexus-compiler-javac-2.13.0.jar (23 kB at 735 kB/s) 2024-09-14T11:23:55.510 INFO:tasks.workunit.client.0.smithi138.stdout:Progress (1): 96/267 kB Progress (1): 112/267 kB Progress (1): 129/267 kB Progress (1): 145/267 kB Progress (1): 162/267 kB Progress (1): 178/267 kB Progress (1): 194/267 kB Progress (1): 211/267 kB Progress (1): 227/267 kB Progress (1): 244/267 kB Progress (1): 260/267 kB Progress (1): 267 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-utils/3.5.0/plexus-utils-3.5.0.jar (267 kB at 7.4 MB/s) 2024-09-14T11:23:55.722 INFO:tasks.workunit.client.0.smithi138.stdout:[INFO] Changes detected - recompiling the module! :source 2024-09-14T11:23:55.725 INFO:tasks.workunit.client.0.smithi138.stdout:[INFO] Compiling 1 source file with javac [debug target 1.9] to target/classes 2024-09-14T11:23:56.969 INFO:tasks.workunit.client.0.smithi138.stdout:[WARNING] bootstrap class path not set in conjunction with -source 9 2024-09-14T11:23:56.969 INFO:tasks.workunit.client.0.smithi138.stdout:[INFO] 2024-09-14T11:23:56.969 INFO:tasks.workunit.client.0.smithi138.stdout:[INFO] --- resources:3.3.1:testResources (default-testResources) @ jcksum --- 2024-09-14T11:23:56.972 INFO:tasks.workunit.client.0.smithi138.stdout:[INFO] skip non existing resourceDirectory /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/jcksum/src/test/resources 2024-09-14T11:23:56.972 INFO:tasks.workunit.client.0.smithi138.stdout:[INFO] 2024-09-14T11:23:56.972 INFO:tasks.workunit.client.0.smithi138.stdout:[INFO] --- compiler:3.11.0:testCompile (default-testCompile) @ jcksum --- 2024-09-14T11:23:56.977 INFO:tasks.workunit.client.0.smithi138.stdout:[INFO] Changes detected - recompiling the module! :dependency 2024-09-14T11:23:56.977 INFO:tasks.workunit.client.0.smithi138.stdout:[INFO] Compiling 1 source file with javac [debug target 1.9] to target/test-classes 2024-09-14T11:23:57.174 INFO:tasks.workunit.client.0.smithi138.stdout:[WARNING] bootstrap class path not set in conjunction with -source 9 2024-09-14T11:23:57.174 INFO:tasks.workunit.client.0.smithi138.stdout:[INFO] 2024-09-14T11:23:57.174 INFO:tasks.workunit.client.0.smithi138.stdout:[INFO] --- surefire:3.2.3:test (default-test) @ jcksum --- 2024-09-14T11:23:57.179 INFO:tasks.workunit.client.0.smithi138.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/maven-surefire-common/3.2.3/maven-surefire-common-3.2.3.pom 2024-09-14T11:23:57.194 INFO:tasks.workunit.client.0.smithi138.stdout:Progress (1): 6.2 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/maven-surefire-common/3.2.3/maven-surefire-common-3.2.3.pom (6.2 kB at 446 kB/s) 2024-09-14T11:23:57.197 INFO:tasks.workunit.client.0.smithi138.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-api/3.2.3/surefire-api-3.2.3.pom 2024-09-14T11:23:57.212 INFO:tasks.workunit.client.0.smithi138.stdout:Progress (1): 3.5 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-api/3.2.3/surefire-api-3.2.3.pom (3.5 kB at 252 kB/s) 2024-09-14T11:23:57.215 INFO:tasks.workunit.client.0.smithi138.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-logger-api/3.2.3/surefire-logger-api-3.2.3.pom 2024-09-14T11:23:57.229 INFO:tasks.workunit.client.0.smithi138.stdout:Progress (1): 3.3 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-logger-api/3.2.3/surefire-logger-api-3.2.3.pom (3.3 kB at 233 kB/s) 2024-09-14T11:23:57.233 INFO:tasks.workunit.client.0.smithi138.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-shared-utils/3.2.3/surefire-shared-utils-3.2.3.pom 2024-09-14T11:23:57.247 INFO:tasks.workunit.client.0.smithi138.stdout:Progress (1): 4.1 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-shared-utils/3.2.3/surefire-shared-utils-3.2.3.pom (4.1 kB at 290 kB/s) 2024-09-14T11:23:57.250 INFO:tasks.workunit.client.0.smithi138.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-extensions-api/3.2.3/surefire-extensions-api-3.2.3.pom 2024-09-14T11:23:57.265 INFO:tasks.workunit.client.0.smithi138.stdout:Progress (1): 3.3 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-extensions-api/3.2.3/surefire-extensions-api-3.2.3.pom (3.3 kB at 220 kB/s) 2024-09-14T11:23:57.268 INFO:tasks.workunit.client.0.smithi138.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-booter/3.2.3/surefire-booter-3.2.3.pom 2024-09-14T11:23:57.282 INFO:tasks.workunit.client.0.smithi138.stdout:Progress (1): 4.5 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-booter/3.2.3/surefire-booter-3.2.3.pom (4.5 kB at 318 kB/s) 2024-09-14T11:23:57.286 INFO:tasks.workunit.client.0.smithi138.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-extensions-spi/3.2.3/surefire-extensions-spi-3.2.3.pom 2024-09-14T11:23:57.299 INFO:tasks.workunit.client.0.smithi138.stdout:Progress (1): 1.8 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-extensions-spi/3.2.3/surefire-extensions-spi-3.2.3.pom (1.8 kB at 126 kB/s) 2024-09-14T11:23:57.303 INFO:tasks.workunit.client.0.smithi138.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/eclipse/aether/aether-util/1.0.0.v20140518/aether-util-1.0.0.v20140518.pom 2024-09-14T11:23:57.317 INFO:tasks.workunit.client.0.smithi138.stdout:Progress (1): 2.2 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/eclipse/aether/aether-util/1.0.0.v20140518/aether-util-1.0.0.v20140518.pom (2.2 kB at 157 kB/s) 2024-09-14T11:23:57.319 INFO:tasks.workunit.client.0.smithi138.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/eclipse/aether/aether/1.0.0.v20140518/aether-1.0.0.v20140518.pom 2024-09-14T11:23:57.333 INFO:tasks.workunit.client.0.smithi138.stdout:Progress (1): 16/30 kB Progress (1): 30 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/eclipse/aether/aether/1.0.0.v20140518/aether-1.0.0.v20140518.pom (30 kB at 2.2 MB/s) 2024-09-14T11:23:57.336 INFO:tasks.workunit.client.0.smithi138.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/eclipse/aether/aether-api/1.0.0.v20140518/aether-api-1.0.0.v20140518.pom 2024-09-14T11:23:57.350 INFO:tasks.workunit.client.0.smithi138.stdout:Progress (1): 1.9 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/eclipse/aether/aether-api/1.0.0.v20140518/aether-api-1.0.0.v20140518.pom (1.9 kB at 135 kB/s) 2024-09-14T11:23:57.353 INFO:tasks.workunit.client.0.smithi138.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/maven-common-artifact-filters/3.1.1/maven-common-artifact-filters-3.1.1.pom 2024-09-14T11:23:57.367 INFO:tasks.workunit.client.0.smithi138.stdout:Progress (1): 5.8 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/maven-common-artifact-filters/3.1.1/maven-common-artifact-filters-3.1.1.pom (5.8 kB at 414 kB/s) 2024-09-14T11:23:57.370 INFO:tasks.workunit.client.0.smithi138.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-artifact/3.2.5/maven-artifact-3.2.5.pom 2024-09-14T11:23:57.384 INFO:tasks.workunit.client.0.smithi138.stdout:Progress (1): 2.3 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-artifact/3.2.5/maven-artifact-3.2.5.pom (2.3 kB at 168 kB/s) 2024-09-14T11:23:57.386 INFO:tasks.workunit.client.0.smithi138.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven/3.2.5/maven-3.2.5.pom 2024-09-14T11:23:57.400 INFO:tasks.workunit.client.0.smithi138.stdout:Progress (1): 16/22 kB Progress (1): 22 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven/3.2.5/maven-3.2.5.pom (22 kB at 1.6 MB/s) 2024-09-14T11:23:57.402 INFO:tasks.workunit.client.0.smithi138.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-parent/25/maven-parent-25.pom 2024-09-14T11:23:57.416 INFO:tasks.workunit.client.0.smithi138.stdout:Progress (1): 16/37 kB Progress (1): 33/37 kB Progress (1): 37 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-parent/25/maven-parent-25.pom (37 kB at 2.7 MB/s) 2024-09-14T11:23:57.419 INFO:tasks.workunit.client.0.smithi138.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/apache/15/apache-15.pom 2024-09-14T11:23:57.432 INFO:tasks.workunit.client.0.smithi138.stdout:Progress (1): 15 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/apache/15/apache-15.pom (15 kB at 1.1 MB/s) 2024-09-14T11:23:57.435 INFO:tasks.workunit.client.0.smithi138.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-utils/4.0.0/plexus-utils-4.0.0.pom 2024-09-14T11:23:57.449 INFO:tasks.workunit.client.0.smithi138.stdout:Progress (1): 8.7 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-utils/4.0.0/plexus-utils-4.0.0.pom (8.7 kB at 618 kB/s) 2024-09-14T11:23:57.451 INFO:tasks.workunit.client.0.smithi138.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus/13/plexus-13.pom 2024-09-14T11:23:57.465 INFO:tasks.workunit.client.0.smithi138.stdout:Progress (1): 16/27 kB Progress (1): 27 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus/13/plexus-13.pom (27 kB at 2.0 MB/s) 2024-09-14T11:23:57.468 INFO:tasks.workunit.client.0.smithi138.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-core/3.2.5/maven-core-3.2.5.pom 2024-09-14T11:23:57.482 INFO:tasks.workunit.client.0.smithi138.stdout:Progress (1): 8.1 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-core/3.2.5/maven-core-3.2.5.pom (8.1 kB at 576 kB/s) 2024-09-14T11:23:57.485 INFO:tasks.workunit.client.0.smithi138.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-settings/3.2.5/maven-settings-3.2.5.pom 2024-09-14T11:23:57.499 INFO:tasks.workunit.client.0.smithi138.stdout:Progress (1): 2.2 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-settings/3.2.5/maven-settings-3.2.5.pom (2.2 kB at 155 kB/s) 2024-09-14T11:23:57.502 INFO:tasks.workunit.client.0.smithi138.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-settings-builder/3.2.5/maven-settings-builder-3.2.5.pom 2024-09-14T11:23:57.516 INFO:tasks.workunit.client.0.smithi138.stdout:Progress (1): 2.6 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-settings-builder/3.2.5/maven-settings-builder-3.2.5.pom (2.6 kB at 185 kB/s) 2024-09-14T11:23:57.520 INFO:tasks.workunit.client.0.smithi138.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-interpolation/1.21/plexus-interpolation-1.21.pom 2024-09-14T11:23:57.534 INFO:tasks.workunit.client.0.smithi138.stdout:Progress (1): 1.5 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-interpolation/1.21/plexus-interpolation-1.21.pom (1.5 kB at 110 kB/s) 2024-09-14T11:23:57.535 INFO:tasks.workunit.client.0.smithi138.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-components/1.3.1/plexus-components-1.3.1.pom 2024-09-14T11:23:57.549 INFO:tasks.workunit.client.0.smithi138.stdout:Progress (1): 3.1 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-components/1.3.1/plexus-components-1.3.1.pom (3.1 kB at 219 kB/s) 2024-09-14T11:23:57.551 INFO:tasks.workunit.client.0.smithi138.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus/3.3.1/plexus-3.3.1.pom 2024-09-14T11:23:57.565 INFO:tasks.workunit.client.0.smithi138.stdout:Progress (1): 16/20 kB Progress (1): 20 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus/3.3.1/plexus-3.3.1.pom (20 kB at 1.6 MB/s) 2024-09-14T11:23:57.566 INFO:tasks.workunit.client.0.smithi138.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/sonatype/spice/spice-parent/17/spice-parent-17.pom 2024-09-14T11:23:57.580 INFO:tasks.workunit.client.0.smithi138.stdout:Progress (1): 6.8 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/sonatype/spice/spice-parent/17/spice-parent-17.pom (6.8 kB at 483 kB/s) 2024-09-14T11:23:57.582 INFO:tasks.workunit.client.0.smithi138.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/sonatype/forge/forge-parent/10/forge-parent-10.pom 2024-09-14T11:23:57.596 INFO:tasks.workunit.client.0.smithi138.stdout:Progress (1): 14 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/sonatype/forge/forge-parent/10/forge-parent-10.pom (14 kB at 969 kB/s) 2024-09-14T11:23:57.599 INFO:tasks.workunit.client.0.smithi138.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/sonatype/plexus/plexus-sec-dispatcher/1.3/plexus-sec-dispatcher-1.3.pom 2024-09-14T11:23:57.612 INFO:tasks.workunit.client.0.smithi138.stdout:Progress (1): 3.0 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/sonatype/plexus/plexus-sec-dispatcher/1.3/plexus-sec-dispatcher-1.3.pom (3.0 kB at 212 kB/s) 2024-09-14T11:23:57.614 INFO:tasks.workunit.client.0.smithi138.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/sonatype/spice/spice-parent/12/spice-parent-12.pom 2024-09-14T11:23:57.628 INFO:tasks.workunit.client.0.smithi138.stdout:Progress (1): 6.8 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/sonatype/spice/spice-parent/12/spice-parent-12.pom (6.8 kB at 486 kB/s) 2024-09-14T11:23:57.630 INFO:tasks.workunit.client.0.smithi138.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/sonatype/forge/forge-parent/4/forge-parent-4.pom 2024-09-14T11:23:57.643 INFO:tasks.workunit.client.0.smithi138.stdout:Progress (1): 0.4/8.4 kB Progress (1): 8.4 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/sonatype/forge/forge-parent/4/forge-parent-4.pom (8.4 kB at 646 kB/s) 2024-09-14T11:23:57.646 INFO:tasks.workunit.client.0.smithi138.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/sonatype/plexus/plexus-cipher/1.4/plexus-cipher-1.4.pom 2024-09-14T11:23:57.659 INFO:tasks.workunit.client.0.smithi138.stdout:Progress (1): 2.1 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/sonatype/plexus/plexus-cipher/1.4/plexus-cipher-1.4.pom (2.1 kB at 148 kB/s) 2024-09-14T11:23:57.662 INFO:tasks.workunit.client.0.smithi138.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-repository-metadata/3.2.5/maven-repository-metadata-3.2.5.pom 2024-09-14T11:23:57.675 INFO:tasks.workunit.client.0.smithi138.stdout:Progress (1): 2.2 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-repository-metadata/3.2.5/maven-repository-metadata-3.2.5.pom (2.2 kB at 159 kB/s) 2024-09-14T11:23:57.679 INFO:tasks.workunit.client.0.smithi138.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-plugin-api/3.2.5/maven-plugin-api-3.2.5.pom 2024-09-14T11:23:57.693 INFO:tasks.workunit.client.0.smithi138.stdout:Progress (1): 3.0 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-plugin-api/3.2.5/maven-plugin-api-3.2.5.pom (3.0 kB at 202 kB/s) 2024-09-14T11:23:57.696 INFO:tasks.workunit.client.0.smithi138.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/eclipse/sisu/org.eclipse.sisu.plexus/0.9.0.M2/org.eclipse.sisu.plexus-0.9.0.M2.pom 2024-09-14T11:23:57.710 INFO:tasks.workunit.client.0.smithi138.stdout:Progress (1): 15 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/eclipse/sisu/org.eclipse.sisu.plexus/0.9.0.M2/org.eclipse.sisu.plexus-0.9.0.M2.pom (15 kB at 1.1 MB/s) 2024-09-14T11:23:57.712 INFO:tasks.workunit.client.0.smithi138.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/eclipse/sisu/sisu-plexus/0.9.0.M2/sisu-plexus-0.9.0.M2.pom 2024-09-14T11:23:57.726 INFO:tasks.workunit.client.0.smithi138.stdout:Progress (1): 15 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/eclipse/sisu/sisu-plexus/0.9.0.M2/sisu-plexus-0.9.0.M2.pom (15 kB at 1.0 MB/s) 2024-09-14T11:23:57.729 INFO:tasks.workunit.client.0.smithi138.stdout:Downloading from central: https://repo.maven.apache.org/maven2/javax/annotation/javax.annotation-api/1.2/javax.annotation-api-1.2.pom 2024-09-14T11:23:57.756 INFO:tasks.workunit.client.0.smithi138.stdout:Progress (1): 13 kB Downloaded from central: https://repo.maven.apache.org/maven2/javax/annotation/javax.annotation-api/1.2/javax.annotation-api-1.2.pom (13 kB at 497 kB/s) 2024-09-14T11:23:57.758 INFO:tasks.workunit.client.0.smithi138.stdout:Downloading from central: https://repo.maven.apache.org/maven2/net/java/jvnet-parent/3/jvnet-parent-3.pom 2024-09-14T11:23:57.771 INFO:tasks.workunit.client.0.smithi138.stdout:Progress (1): 4.8 kB Downloaded from central: https://repo.maven.apache.org/maven2/net/java/jvnet-parent/3/jvnet-parent-3.pom (4.8 kB at 342 kB/s) 2024-09-14T11:23:57.773 INFO:tasks.workunit.client.0.smithi138.stdout:Downloading from central: https://repo.maven.apache.org/maven2/javax/enterprise/cdi-api/1.2/cdi-api-1.2.pom 2024-09-14T11:23:57.787 INFO:tasks.workunit.client.0.smithi138.stdout:Progress (1): 6.3 kB Downloaded from central: https://repo.maven.apache.org/maven2/javax/enterprise/cdi-api/1.2/cdi-api-1.2.pom (6.3 kB at 448 kB/s) 2024-09-14T11:23:57.789 INFO:tasks.workunit.client.0.smithi138.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/jboss/weld/weld-parent/26/weld-parent-26.pom 2024-09-14T11:23:57.804 INFO:tasks.workunit.client.0.smithi138.stdout:Progress (1): 16/32 kB Progress (1): 32 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/jboss/weld/weld-parent/26/weld-parent-26.pom (32 kB at 2.2 MB/s) 2024-09-14T11:23:57.807 INFO:tasks.workunit.client.0.smithi138.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/eclipse/sisu/org.eclipse.sisu.inject/0.9.0.M2/org.eclipse.sisu.inject-0.9.0.M2.pom 2024-09-14T11:23:57.821 INFO:tasks.workunit.client.0.smithi138.stdout:Progress (1): 16/17 kB Progress (1): 17 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/eclipse/sisu/org.eclipse.sisu.inject/0.9.0.M2/org.eclipse.sisu.inject-0.9.0.M2.pom (17 kB at 1.2 MB/s) 2024-09-14T11:23:57.823 INFO:tasks.workunit.client.0.smithi138.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/eclipse/sisu/sisu-inject/0.9.0.M2/sisu-inject-0.9.0.M2.pom 2024-09-14T11:23:57.840 INFO:tasks.workunit.client.0.smithi138.stdout:Progress (1): 15 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/eclipse/sisu/sisu-inject/0.9.0.M2/sisu-inject-0.9.0.M2.pom (15 kB at 1.1 MB/s) 2024-09-14T11:23:57.840 INFO:tasks.workunit.client.0.smithi138.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-component-annotations/2.1.0/plexus-component-annotations-2.1.0.pom 2024-09-14T11:23:57.854 INFO:tasks.workunit.client.0.smithi138.stdout:Progress (1): 750 B Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-component-annotations/2.1.0/plexus-component-annotations-2.1.0.pom (750 B at 54 kB/s) 2024-09-14T11:23:57.855 INFO:tasks.workunit.client.0.smithi138.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-containers/2.1.0/plexus-containers-2.1.0.pom 2024-09-14T11:23:57.869 INFO:tasks.workunit.client.0.smithi138.stdout:Progress (1): 4.8 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-containers/2.1.0/plexus-containers-2.1.0.pom (4.8 kB at 343 kB/s) 2024-09-14T11:23:57.872 INFO:tasks.workunit.client.0.smithi138.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-classworlds/2.6.0/plexus-classworlds-2.6.0.pom 2024-09-14T11:23:57.885 INFO:tasks.workunit.client.0.smithi138.stdout:Progress (1): 7.9 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-classworlds/2.6.0/plexus-classworlds-2.6.0.pom (7.9 kB at 609 kB/s) 2024-09-14T11:23:57.887 INFO:tasks.workunit.client.0.smithi138.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-model-builder/3.2.5/maven-model-builder-3.2.5.pom 2024-09-14T11:23:57.901 INFO:tasks.workunit.client.0.smithi138.stdout:Progress (1): 3.0 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-model-builder/3.2.5/maven-model-builder-3.2.5.pom (3.0 kB at 214 kB/s) 2024-09-14T11:23:57.904 INFO:tasks.workunit.client.0.smithi138.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-aether-provider/3.2.5/maven-aether-provider-3.2.5.pom 2024-09-14T11:23:57.918 INFO:tasks.workunit.client.0.smithi138.stdout:Progress (1): 4.2 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-aether-provider/3.2.5/maven-aether-provider-3.2.5.pom (4.2 kB at 304 kB/s) 2024-09-14T11:23:57.921 INFO:tasks.workunit.client.0.smithi138.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/eclipse/aether/aether-spi/1.0.0.v20140518/aether-spi-1.0.0.v20140518.pom 2024-09-14T11:23:57.935 INFO:tasks.workunit.client.0.smithi138.stdout:Progress (1): 2.1 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/eclipse/aether/aether-spi/1.0.0.v20140518/aether-spi-1.0.0.v20140518.pom (2.1 kB at 147 kB/s) 2024-09-14T11:23:57.938 INFO:tasks.workunit.client.0.smithi138.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/eclipse/aether/aether-impl/1.0.0.v20140518/aether-impl-1.0.0.v20140518.pom 2024-09-14T11:23:57.952 INFO:tasks.workunit.client.0.smithi138.stdout:Progress (1): 3.5 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/eclipse/aether/aether-impl/1.0.0.v20140518/aether-impl-1.0.0.v20140518.pom (3.5 kB at 248 kB/s) 2024-09-14T11:23:57.955 INFO:tasks.workunit.client.0.smithi138.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/sonatype/sisu/sisu-guice/3.2.3/sisu-guice-3.2.3.pom 2024-09-14T11:23:57.969 INFO:tasks.workunit.client.0.smithi138.stdout:Progress (1): 11 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/sonatype/sisu/sisu-guice/3.2.3/sisu-guice-3.2.3.pom (11 kB at 781 kB/s) 2024-09-14T11:23:57.970 INFO:tasks.workunit.client.0.smithi138.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/sonatype/sisu/inject/guice-parent/3.2.3/guice-parent-3.2.3.pom 2024-09-14T11:23:57.983 INFO:tasks.workunit.client.0.smithi138.stdout:Progress (1): 13 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/sonatype/sisu/inject/guice-parent/3.2.3/guice-parent-3.2.3.pom (13 kB at 1.0 MB/s) 2024-09-14T11:23:57.985 INFO:tasks.workunit.client.0.smithi138.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/sonatype/forge/forge-parent/38/forge-parent-38.pom 2024-09-14T11:23:57.999 INFO:tasks.workunit.client.0.smithi138.stdout:Progress (1): 16/19 kB Progress (1): 19 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/sonatype/forge/forge-parent/38/forge-parent-38.pom (19 kB at 1.4 MB/s) 2024-09-14T11:23:58.001 INFO:tasks.workunit.client.0.smithi138.stdout:Downloading from central: https://repo.maven.apache.org/maven2/aopalliance/aopalliance/1.0/aopalliance-1.0.pom 2024-09-14T11:23:58.014 INFO:tasks.workunit.client.0.smithi138.stdout:Progress (1): 363 B Downloaded from central: https://repo.maven.apache.org/maven2/aopalliance/aopalliance/1.0/aopalliance-1.0.pom (363 B at 28 kB/s) 2024-09-14T11:23:58.016 INFO:tasks.workunit.client.0.smithi138.stdout:Downloading from central: https://repo.maven.apache.org/maven2/com/google/guava/guava/16.0.1/guava-16.0.1.pom 2024-09-14T11:23:58.030 INFO:tasks.workunit.client.0.smithi138.stdout:Progress (1): 6.1 kB Downloaded from central: https://repo.maven.apache.org/maven2/com/google/guava/guava/16.0.1/guava-16.0.1.pom (6.1 kB at 469 kB/s) 2024-09-14T11:23:58.031 INFO:tasks.workunit.client.0.smithi138.stdout:Downloading from central: https://repo.maven.apache.org/maven2/com/google/guava/guava-parent/16.0.1/guava-parent-16.0.1.pom 2024-09-14T11:23:58.045 INFO:tasks.workunit.client.0.smithi138.stdout:Progress (1): 7.3 kB Downloaded from central: https://repo.maven.apache.org/maven2/com/google/guava/guava-parent/16.0.1/guava-parent-16.0.1.pom (7.3 kB at 524 kB/s) 2024-09-14T11:23:58.046 INFO:tasks.workunit.client.0.smithi138.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/sonatype/oss/oss-parent/7/oss-parent-7.pom 2024-09-14T11:23:58.064 INFO:tasks.workunit.client.0.smithi138.stdout:Progress (1): 4.8 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/sonatype/oss/oss-parent/7/oss-parent-7.pom (4.8 kB at 268 kB/s) 2024-09-14T11:23:58.066 INFO:tasks.workunit.client.0.smithi138.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-classworlds/2.5.2/plexus-classworlds-2.5.2.pom 2024-09-14T11:23:58.080 INFO:tasks.workunit.client.0.smithi138.stdout:Progress (1): 7.3 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-classworlds/2.5.2/plexus-classworlds-2.5.2.pom (7.3 kB at 562 kB/s) 2024-09-14T11:23:58.082 INFO:tasks.workunit.client.0.smithi138.stdout:Downloading from central: https://repo.maven.apache.org/maven2/commons-io/commons-io/2.15.0/commons-io-2.15.0.pom 2024-09-14T11:23:58.097 INFO:tasks.workunit.client.0.smithi138.stdout:Progress (1): 16/22 kB Progress (1): 22 kB Downloaded from central: https://repo.maven.apache.org/maven2/commons-io/commons-io/2.15.0/commons-io-2.15.0.pom (22 kB at 1.5 MB/s) 2024-09-14T11:23:58.098 INFO:tasks.workunit.client.0.smithi138.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/commons/commons-parent/64/commons-parent-64.pom 2024-09-14T11:23:58.113 INFO:tasks.workunit.client.0.smithi138.stdout:Progress (1): 16/78 kB Progress (1): 32/78 kB Progress (1): 49/78 kB Progress (1): 65/78 kB Progress (1): 78 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/commons/commons-parent/64/commons-parent-64.pom (78 kB at 5.2 MB/s) 2024-09-14T11:23:58.116 INFO:tasks.workunit.client.0.smithi138.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/apache/30/apache-30.pom 2024-09-14T11:23:58.129 INFO:tasks.workunit.client.0.smithi138.stdout:Progress (1): 16/23 kB Progress (1): 23 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/apache/30/apache-30.pom (23 kB at 1.7 MB/s) 2024-09-14T11:23:58.132 INFO:tasks.workunit.client.0.smithi138.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/junit-bom/5.10.0/junit-bom-5.10.0.pom 2024-09-14T11:23:58.146 INFO:tasks.workunit.client.0.smithi138.stdout:Progress (1): 5.6 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/junit-bom/5.10.0/junit-bom-5.10.0.pom (5.6 kB at 404 kB/s) 2024-09-14T11:23:58.149 INFO:tasks.workunit.client.0.smithi138.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-java/1.2.0/plexus-java-1.2.0.pom 2024-09-14T11:23:58.162 INFO:tasks.workunit.client.0.smithi138.stdout:Progress (1): 4.3 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-java/1.2.0/plexus-java-1.2.0.pom (4.3 kB at 305 kB/s) 2024-09-14T11:23:58.164 INFO:tasks.workunit.client.0.smithi138.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-languages/1.2.0/plexus-languages-1.2.0.pom 2024-09-14T11:23:58.177 INFO:tasks.workunit.client.0.smithi138.stdout:Progress (1): 3.2 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-languages/1.2.0/plexus-languages-1.2.0.pom (3.2 kB at 228 kB/s) 2024-09-14T11:23:58.179 INFO:tasks.workunit.client.0.smithi138.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus/15/plexus-15.pom 2024-09-14T11:23:58.192 INFO:tasks.workunit.client.0.smithi138.stdout:Progress (1): 16/28 kB Progress (1): 28 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus/15/plexus-15.pom (28 kB at 2.0 MB/s) 2024-09-14T11:23:58.195 INFO:tasks.workunit.client.0.smithi138.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/ow2/asm/asm/9.6/asm-9.6.pom 2024-09-14T11:23:58.208 INFO:tasks.workunit.client.0.smithi138.stdout:Progress (1): 2.4 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/ow2/asm/asm/9.6/asm-9.6.pom (2.4 kB at 182 kB/s) 2024-09-14T11:23:58.213 INFO:tasks.workunit.client.0.smithi138.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/maven-surefire-common/3.2.3/maven-surefire-common-3.2.3.jar 2024-09-14T11:23:58.231 INFO:tasks.workunit.client.0.smithi138.stdout:Progress (1): 16/308 kB Progress (1): 33/308 kB Progress (1): 49/308 kB Progress (1): 65/308 kB Progress (1): 82/308 kB Progress (1): 98/308 kB Progress (1): 114/308 kB Progress (1): 118/308 kB Progress (1): 131/308 kB Progress (1): 147/308 kB Progress (1): 163/308 kB Progress (1): 180/308 kB Progress (1): 196/308 kB Progress (1): 213/308 kB Progress (1): 229/308 kB Progress (1): 245/308 kB Progress (1): 262/308 kB Progress (1): 278/308 kB Progress (1): 294/308 kB Progress (1): 308 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/maven-surefire-common/3.2.3/maven-surefire-common-3.2.3.jar (308 kB at 17 MB/s) 2024-09-14T11:23:58.231 INFO:tasks.workunit.client.0.smithi138.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-api/3.2.3/surefire-api-3.2.3.jar 2024-09-14T11:23:58.231 INFO:tasks.workunit.client.0.smithi138.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-logger-api/3.2.3/surefire-logger-api-3.2.3.jar 2024-09-14T11:23:58.232 INFO:tasks.workunit.client.0.smithi138.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-extensions-api/3.2.3/surefire-extensions-api-3.2.3.jar 2024-09-14T11:23:58.232 INFO:tasks.workunit.client.0.smithi138.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-booter/3.2.3/surefire-booter-3.2.3.jar 2024-09-14T11:23:58.232 INFO:tasks.workunit.client.0.smithi138.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-extensions-spi/3.2.3/surefire-extensions-spi-3.2.3.jar 2024-09-14T11:23:58.249 INFO:tasks.workunit.client.0.smithi138.stdout:Progress (1): 16/118 kB Progress (1): 33/118 kB Progress (1): 49/118 kB Progress (1): 62/118 kB Progress (2): 62/118 kB | 14 kB Progress (2): 78/118 kB | 14 kB Progress (3): 78/118 kB | 14 kB | 16/26 kB Progress (4): 78/118 kB | 14 kB | 16/26 kB | 16/171 kB Progress (4): 95/118 kB | 14 kB | 16/26 kB | 16/171 kB Progress (5): 95/118 kB | 14 kB | 16/26 kB | 16/171 kB | 8.2 kB Progress (5): 95/118 kB | 14 kB | 26 kB | 16/171 kB | 8.2 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-logger-api/3.2.3/surefire-logger-api-3.2.3.jar (14 kB at 849 kB/s) 2024-09-14T11:23:58.249 INFO:tasks.workunit.client.0.smithi138.stdout:Progress (4): 95/118 kB | 26 kB | 33/171 kB | 8.2 kB Progress (4): 111/118 kB | 26 kB | 33/171 kB | 8.2 kB Downloading from central: https://repo.maven.apache.org/maven2/org/eclipse/aether/aether-util/1.0.0.v20140518/aether-util-1.0.0.v20140518.jar 2024-09-14T11:23:58.249 INFO:tasks.workunit.client.0.smithi138.stdout:Progress (4): 118 kB | 26 kB | 33/171 kB | 8.2 kB Progress (4): 118 kB | 26 kB | 49/171 kB | 8.2 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-extensions-api/3.2.3/surefire-extensions-api-3.2.3.jar (26 kB at 1.5 MB/s) 2024-09-14T11:23:58.249 INFO:tasks.workunit.client.0.smithi138.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/eclipse/aether/aether-api/1.0.0.v20140518/aether-api-1.0.0.v20140518.jar 2024-09-14T11:23:58.250 INFO:tasks.workunit.client.0.smithi138.stdout:Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-extensions-spi/3.2.3/surefire-extensions-spi-3.2.3.jar (8.2 kB at 481 kB/s) 2024-09-14T11:23:58.250 INFO:tasks.workunit.client.0.smithi138.stdout:Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-booter/3.2.3/surefire-booter-3.2.3.jar (118 kB at 6.9 MB/s) 2024-09-14T11:23:58.250 INFO:tasks.workunit.client.0.smithi138.stdout:Progress (1): 64/171 kB Downloading from central: https://repo.maven.apache.org/maven2/commons-io/commons-io/2.15.0/commons-io-2.15.0.jar 2024-09-14T11:23:58.250 INFO:tasks.workunit.client.0.smithi138.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/maven-common-artifact-filters/3.1.1/maven-common-artifact-filters-3.1.1.jar 2024-09-14T11:23:58.252 INFO:tasks.workunit.client.0.smithi138.stdout:Progress (1): 81/171 kB Progress (1): 97/171 kB Progress (1): 113/171 kB Progress (1): 130/171 kB Progress (1): 146/171 kB Progress (1): 163/171 kB Progress (1): 171 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-api/3.2.3/surefire-api-3.2.3.jar (171 kB at 8.1 MB/s) 2024-09-14T11:23:58.252 INFO:tasks.workunit.client.0.smithi138.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-java/1.2.0/plexus-java-1.2.0.jar 2024-09-14T11:23:58.266 INFO:tasks.workunit.client.0.smithi138.stdout:Progress (1): 16/146 kB Progress (1): 33/146 kB Progress (2): 33/146 kB | 16/136 kB Progress (2): 49/146 kB | 16/136 kB Progress (2): 66/146 kB | 16/136 kB Progress (3): 66/146 kB | 16/136 kB | 16/61 kB Progress (3): 66/146 kB | 33/136 kB | 16/61 kB Progress (3): 82/146 kB | 33/136 kB | 16/61 kB Progress (3): 98/146 kB | 33/136 kB | 16/61 kB Progress (4): 98/146 kB | 33/136 kB | 16/61 kB | 16/501 kB Progress (4): 98/146 kB | 49/136 kB | 16/61 kB | 16/501 kB Progress (4): 98/146 kB | 49/136 kB | 33/61 kB | 16/501 kB Progress (4): 115/146 kB | 49/136 kB | 33/61 kB | 16/501 kB Progress (4): 131/146 kB | 49/136 kB | 33/61 kB | 16/501 kB Progress (4): 131/146 kB | 49/136 kB | 33/61 kB | 33/501 kB Progress (4): 131/146 kB | 66/136 kB | 33/61 kB | 33/501 kB Progress (4): 131/146 kB | 66/136 kB | 49/61 kB | 33/501 kB Progress (4): 146 kB | 66/136 kB | 49/61 kB | 33/501 kB Progress (4): 146 kB | 66/136 kB | 49/61 kB | 49/501 kB Progress (4): 146 kB | 66/136 kB | 61 kB | 49/501 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/eclipse/aether/aether-util/1.0.0.v20140518/aether-util-1.0.0.v20140518.jar (146 kB at 4.7 MB/s) 2024-09-14T11:23:58.266 INFO:tasks.workunit.client.0.smithi138.stdout:Progress (3): 82/136 kB | 61 kB | 49/501 kB Downloading from central: https://repo.maven.apache.org/maven2/org/ow2/asm/asm/9.6/asm-9.6.jar 2024-09-14T11:23:58.266 INFO:tasks.workunit.client.0.smithi138.stdout:Progress (3): 82/136 kB | 61 kB | 66/501 kB Progress (3): 98/136 kB | 61 kB | 66/501 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/maven-common-artifact-filters/3.1.1/maven-common-artifact-filters-3.1.1.jar (61 kB at 2.0 MB/s) 2024-09-14T11:23:58.266 INFO:tasks.workunit.client.0.smithi138.stdout:Progress (2): 98/136 kB | 82/501 kB Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-shared-utils/3.2.3/surefire-shared-utils-3.2.3.jar 2024-09-14T11:23:58.267 INFO:tasks.workunit.client.0.smithi138.stdout:Progress (2): 115/136 kB | 82/501 kB Progress (2): 115/136 kB | 98/501 kB Progress (3): 115/136 kB | 98/501 kB | 16/58 kB Progress (3): 115/136 kB | 115/501 kB | 16/58 kB Progress (3): 131/136 kB | 115/501 kB | 16/58 kB Progress (3): 136 kB | 115/501 kB | 16/58 kB Progress (3): 136 kB | 131/501 kB | 16/58 kB Progress (3): 136 kB | 131/501 kB | 33/58 kB Progress (3): 136 kB | 147/501 kB | 33/58 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/eclipse/aether/aether-api/1.0.0.v20140518/aether-api-1.0.0.v20140518.jar (136 kB at 4.1 MB/s) 2024-09-14T11:23:58.268 INFO:tasks.workunit.client.0.smithi138.stdout:Progress (2): 147/501 kB | 49/58 kB Progress (2): 164/501 kB | 49/58 kB Progress (2): 164/501 kB | 58 kB Progress (2): 180/501 kB | 58 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-java/1.2.0/plexus-java-1.2.0.jar (58 kB at 1.7 MB/s) 2024-09-14T11:23:58.274 INFO:tasks.workunit.client.0.smithi138.stdout:Progress (1): 197/501 kB Progress (1): 213/501 kB Progress (1): 229/501 kB Progress (1): 246/501 kB Progress (1): 262/501 kB Progress (1): 279/501 kB Progress (1): 295/501 kB Progress (1): 311/501 kB Progress (1): 328/501 kB Progress (1): 344/501 kB Progress (1): 360/501 kB Progress (1): 377/501 kB Progress (1): 393/501 kB Progress (1): 410/501 kB Progress (1): 426/501 kB Progress (1): 442/501 kB Progress (1): 459/501 kB Progress (1): 475/501 kB Progress (1): 492/501 kB Progress (1): 501 kB Downloaded from central: https://repo.maven.apache.org/maven2/commons-io/commons-io/2.15.0/commons-io-2.15.0.jar (501 kB at 13 MB/s) 2024-09-14T11:23:58.284 INFO:tasks.workunit.client.0.smithi138.stdout:Progress (1): 0/2.4 MB Progress (1): 0/2.4 MB Progress (1): 0/2.4 MB Progress (1): 0.1/2.4 MB Progress (1): 0.1/2.4 MB Progress (1): 0.1/2.4 MB Progress (2): 0.1/2.4 MB | 16/124 kB Progress (2): 0.1/2.4 MB | 16/124 kB Progress (2): 0.1/2.4 MB | 32/124 kB Progress (2): 0.1/2.4 MB | 32/124 kB Progress (2): 0.1/2.4 MB | 49/124 kB Progress (2): 0.1/2.4 MB | 49/124 kB Progress (2): 0.1/2.4 MB | 65/124 kB Progress (2): 0.1/2.4 MB | 81/124 kB Progress (2): 0.2/2.4 MB | 81/124 kB Progress (2): 0.2/2.4 MB | 98/124 kB Progress (2): 0.2/2.4 MB | 98/124 kB Progress (2): 0.2/2.4 MB | 114/124 kB Progress (2): 0.2/2.4 MB | 124 kB Progress (2): 0.2/2.4 MB | 124 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/ow2/asm/asm/9.6/asm-9.6.jar (124 kB at 2.5 MB/s) 2024-09-14T11:23:58.327 INFO:tasks.workunit.client.0.smithi138.stdout:Progress (1): 0.2/2.4 MB Progress (1): 0.2/2.4 MB Progress (1): 0.2/2.4 MB Progress (1): 0.3/2.4 MB Progress (1): 0.3/2.4 MB Progress (1): 0.3/2.4 MB Progress (1): 0.3/2.4 MB Progress (1): 0.3/2.4 MB Progress (1): 0.3/2.4 MB Progress (1): 0.4/2.4 MB Progress (1): 0.4/2.4 MB Progress (1): 0.4/2.4 MB Progress (1): 0.4/2.4 MB Progress (1): 0.4/2.4 MB Progress (1): 0.4/2.4 MB Progress (1): 0.5/2.4 MB Progress (1): 0.5/2.4 MB Progress (1): 0.5/2.4 MB Progress (1): 0.5/2.4 MB Progress (1): 0.5/2.4 MB Progress (1): 0.5/2.4 MB Progress (1): 0.6/2.4 MB Progress (1): 0.6/2.4 MB Progress (1): 0.6/2.4 MB Progress (1): 0.6/2.4 MB Progress (1): 0.6/2.4 MB Progress (1): 0.6/2.4 MB Progress (1): 0.7/2.4 MB Progress (1): 0.7/2.4 MB Progress (1): 0.7/2.4 MB Progress (1): 0.7/2.4 MB Progress (1): 0.7/2.4 MB Progress (1): 0.7/2.4 MB Progress (1): 0.8/2.4 MB Progress (1): 0.8/2.4 MB Progress (1): 0.8/2.4 MB Progress (1): 0.8/2.4 MB Progress (1): 0.8/2.4 MB Progress (1): 0.8/2.4 MB Progress (1): 0.8/2.4 MB Progress (1): 0.9/2.4 MB Progress (1): 0.9/2.4 MB Progress (1): 0.9/2.4 MB Progress (1): 0.9/2.4 MB Progress (1): 0.9/2.4 MB Progress (1): 0.9/2.4 MB Progress (1): 1.0/2.4 MB Progress (1): 1.0/2.4 MB Progress (1): 1.0/2.4 MB Progress (1): 1.0/2.4 MB Progress (1): 1.0/2.4 MB Progress (1): 1.0/2.4 MB Progress (1): 1.1/2.4 MB Progress (1): 1.1/2.4 MB Progress (1): 1.1/2.4 MB Progress (1): 1.1/2.4 MB Progress (1): 1.1/2.4 MB Progress (1): 1.1/2.4 MB Progress (1): 1.2/2.4 MB Progress (1): 1.2/2.4 MB Progress (1): 1.2/2.4 MB Progress (1): 1.2/2.4 MB Progress (1): 1.2/2.4 MB Progress (1): 1.2/2.4 MB Progress (1): 1.3/2.4 MB Progress (1): 1.3/2.4 MB Progress (1): 1.3/2.4 MB Progress (1): 1.3/2.4 MB Progress (1): 1.3/2.4 MB Progress (1): 1.3/2.4 MB Progress (1): 1.4/2.4 MB Progress (1): 1.4/2.4 MB Progress (1): 1.4/2.4 MB Progress (1): 1.4/2.4 MB Progress (1): 1.4/2.4 MB Progress (1): 1.4/2.4 MB Progress (1): 1.5/2.4 MB Progress (1): 1.5/2.4 MB Progress (1): 1.5/2.4 MB Progress (1): 1.5/2.4 MB Progress (1): 1.5/2.4 MB Progress (1): 1.5/2.4 MB Progress (1): 1.6/2.4 MB Progress (1): 1.6/2.4 MB Progress (1): 1.6/2.4 MB Progress (1): 1.6/2.4 MB Progress (1): 1.6/2.4 MB Progress (1): 1.6/2.4 MB Progress (1): 1.7/2.4 MB Progress (1): 1.7/2.4 MB Progress (1): 1.7/2.4 MB Progress (1): 1.7/2.4 MB Progress (1): 1.7/2.4 MB Progress (1): 1.7/2.4 MB Progress (1): 1.8/2.4 MB Progress (1): 1.8/2.4 MB Progress (1): 1.8/2.4 MB Progress (1): 1.8/2.4 MB Progress (1): 1.8/2.4 MB Progress (1): 1.8/2.4 MB Progress (1): 1.8/2.4 MB Progress (1): 1.9/2.4 MB Progress (1): 1.9/2.4 MB Progress (1): 1.9/2.4 MB Progress (1): 1.9/2.4 MB Progress (1): 1.9/2.4 MB Progress (1): 1.9/2.4 MB Progress (1): 2.0/2.4 MB Progress (1): 2.0/2.4 MB Progress (1): 2.0/2.4 MB Progress (1): 2.0/2.4 MB Progress (1): 2.0/2.4 MB Progress (1): 2.0/2.4 MB Progress (1): 2.1/2.4 MB Progress (1): 2.1/2.4 MB Progress (1): 2.1/2.4 MB Progress (1): 2.1/2.4 MB Progress (1): 2.1/2.4 MB Progress (1): 2.1/2.4 MB Progress (1): 2.2/2.4 MB Progress (1): 2.2/2.4 MB Progress (1): 2.2/2.4 MB Progress (1): 2.2/2.4 MB Progress (1): 2.2/2.4 MB Progress (1): 2.2/2.4 MB Progress (1): 2.3/2.4 MB Progress (1): 2.3/2.4 MB Progress (1): 2.3/2.4 MB Progress (1): 2.3/2.4 MB Progress (1): 2.3/2.4 MB Progress (1): 2.3/2.4 MB Progress (1): 2.4/2.4 MB Progress (1): 2.4/2.4 MB Progress (1): 2.4/2.4 MB Progress (1): 2.4/2.4 MB Progress (1): 2.4/2.4 MB Progress (1): 2.4 MB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-shared-utils/3.2.3/surefire-shared-utils-3.2.3.jar (2.4 MB at 26 MB/s) 2024-09-14T11:23:58.414 INFO:tasks.workunit.client.0.smithi138.stdout:[INFO] 2024-09-14T11:23:58.414 INFO:tasks.workunit.client.0.smithi138.stdout:[INFO] --- jar:3.3.0:jar (default-jar) @ jcksum --- 2024-09-14T11:23:58.417 INFO:tasks.workunit.client.0.smithi138.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/file-management/3.1.0/file-management-3.1.0.pom 2024-09-14T11:23:58.431 INFO:tasks.workunit.client.0.smithi138.stdout:Progress (1): 4.5 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/file-management/3.1.0/file-management-3.1.0.pom (4.5 kB at 320 kB/s) 2024-09-14T11:23:58.433 INFO:tasks.workunit.client.0.smithi138.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/maven-shared-components/36/maven-shared-components-36.pom 2024-09-14T11:23:58.447 INFO:tasks.workunit.client.0.smithi138.stdout:Progress (1): 4.9 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/maven-shared-components/36/maven-shared-components-36.pom (4.9 kB at 350 kB/s) 2024-09-14T11:23:58.449 INFO:tasks.workunit.client.0.smithi138.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-parent/36/maven-parent-36.pom 2024-09-14T11:23:58.464 INFO:tasks.workunit.client.0.smithi138.stdout:Progress (1): 16/45 kB Progress (1): 33/45 kB Progress (1): 45 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-parent/36/maven-parent-36.pom (45 kB at 3.0 MB/s) 2024-09-14T11:23:58.466 INFO:tasks.workunit.client.0.smithi138.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/apache/26/apache-26.pom 2024-09-14T11:23:58.481 INFO:tasks.workunit.client.0.smithi138.stdout:Progress (1): 16/21 kB Progress (1): 21 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/apache/26/apache-26.pom (21 kB at 1.4 MB/s) 2024-09-14T11:23:58.484 INFO:tasks.workunit.client.0.smithi138.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-utils/3.3.0/plexus-utils-3.3.0.pom 2024-09-14T11:23:58.498 INFO:tasks.workunit.client.0.smithi138.stdout:Progress (1): 5.2 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-utils/3.3.0/plexus-utils-3.3.0.pom (5.2 kB at 370 kB/s) 2024-09-14T11:23:58.500 INFO:tasks.workunit.client.0.smithi138.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-archiver/3.6.0/maven-archiver-3.6.0.pom 2024-09-14T11:23:58.514 INFO:tasks.workunit.client.0.smithi138.stdout:Progress (1): 3.9 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-archiver/3.6.0/maven-archiver-3.6.0.pom (3.9 kB at 280 kB/s) 2024-09-14T11:23:58.517 INFO:tasks.workunit.client.0.smithi138.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-io/3.4.0/plexus-io-3.4.0.pom 2024-09-14T11:23:58.531 INFO:tasks.workunit.client.0.smithi138.stdout:Progress (1): 6.0 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-io/3.4.0/plexus-io-3.4.0.pom (6.0 kB at 430 kB/s) 2024-09-14T11:23:58.534 INFO:tasks.workunit.client.0.smithi138.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-archiver/4.4.0/plexus-archiver-4.4.0.pom 2024-09-14T11:23:58.548 INFO:tasks.workunit.client.0.smithi138.stdout:Progress (1): 6.3 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-archiver/4.4.0/plexus-archiver-4.4.0.pom (6.3 kB at 447 kB/s) 2024-09-14T11:23:58.550 INFO:tasks.workunit.client.0.smithi138.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/commons/commons-compress/1.21/commons-compress-1.21.pom 2024-09-14T11:23:58.564 INFO:tasks.workunit.client.0.smithi138.stdout:Progress (1): 16/20 kB Progress (1): 20 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/commons/commons-compress/1.21/commons-compress-1.21.pom (20 kB at 1.4 MB/s) 2024-09-14T11:23:58.568 INFO:tasks.workunit.client.0.smithi138.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/iq80/snappy/snappy/0.4/snappy-0.4.pom 2024-09-14T11:23:58.583 INFO:tasks.workunit.client.0.smithi138.stdout:Progress (1): 15 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/iq80/snappy/snappy/0.4/snappy-0.4.pom (15 kB at 1.0 MB/s) 2024-09-14T11:23:58.585 INFO:tasks.workunit.client.0.smithi138.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/tukaani/xz/1.9/xz-1.9.pom 2024-09-14T11:23:58.599 INFO:tasks.workunit.client.0.smithi138.stdout:Progress (1): 2.0 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/tukaani/xz/1.9/xz-1.9.pom (2.0 kB at 146 kB/s) 2024-09-14T11:23:58.601 INFO:tasks.workunit.client.0.smithi138.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-utils/3.4.2/plexus-utils-3.4.2.pom 2024-09-14T11:23:58.616 INFO:tasks.workunit.client.0.smithi138.stdout:Progress (1): 8.2 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-utils/3.4.2/plexus-utils-3.4.2.pom (8.2 kB at 587 kB/s) 2024-09-14T11:23:58.617 INFO:tasks.workunit.client.0.smithi138.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus/8/plexus-8.pom 2024-09-14T11:23:58.632 INFO:tasks.workunit.client.0.smithi138.stdout:Progress (1): 16/25 kB Progress (1): 25 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus/8/plexus-8.pom (25 kB at 1.7 MB/s) 2024-09-14T11:23:58.637 INFO:tasks.workunit.client.0.smithi138.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/file-management/3.1.0/file-management-3.1.0.jar 2024-09-14T11:23:58.652 INFO:tasks.workunit.client.0.smithi138.stdout:Progress (1): 16/36 kB Progress (1): 33/36 kB Progress (1): 36 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/file-management/3.1.0/file-management-3.1.0.jar (36 kB at 2.4 MB/s) 2024-09-14T11:23:58.653 INFO:tasks.workunit.client.0.smithi138.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-archiver/3.6.0/maven-archiver-3.6.0.jar 2024-09-14T11:23:58.653 INFO:tasks.workunit.client.0.smithi138.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-io/3.4.0/plexus-io-3.4.0.jar 2024-09-14T11:23:58.654 INFO:tasks.workunit.client.0.smithi138.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-archiver/4.4.0/plexus-archiver-4.4.0.jar 2024-09-14T11:23:58.654 INFO:tasks.workunit.client.0.smithi138.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/iq80/snappy/snappy/0.4/snappy-0.4.jar 2024-09-14T11:23:58.654 INFO:tasks.workunit.client.0.smithi138.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/commons/commons-compress/1.21/commons-compress-1.21.jar 2024-09-14T11:23:58.670 INFO:tasks.workunit.client.0.smithi138.stdout:Progress (1): 16/79 kB Progress (2): 16/79 kB | 16/26 kB Progress (2): 33/79 kB | 16/26 kB Progress (3): 33/79 kB | 16/26 kB | 16/58 kB Progress (3): 33/79 kB | 26 kB | 16/58 kB Progress (3): 49/79 kB | 26 kB | 16/58 kB Progress (3): 49/79 kB | 26 kB | 33/58 kB Progress (4): 49/79 kB | 26 kB | 33/58 kB | 0/1.0 MB Progress (5): 49/79 kB | 26 kB | 33/58 kB | 0/1.0 MB | 15/211 kB Progress (5): 66/79 kB | 26 kB | 33/58 kB | 0/1.0 MB | 15/211 kB Progress (5): 66/79 kB | 26 kB | 49/58 kB | 0/1.0 MB | 15/211 kB Progress (5): 66/79 kB | 26 kB | 49/58 kB | 0/1.0 MB | 15/211 kB Progress (5): 79 kB | 26 kB | 49/58 kB | 0/1.0 MB | 15/211 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-archiver/3.6.0/maven-archiver-3.6.0.jar (26 kB at 1.6 MB/s) 2024-09-14T11:23:58.670 INFO:tasks.workunit.client.0.smithi138.stdout:Progress (4): 79 kB | 58 kB | 0/1.0 MB | 15/211 kB Downloading from central: https://repo.maven.apache.org/maven2/org/tukaani/xz/1.9/xz-1.9.jar 2024-09-14T11:23:58.670 INFO:tasks.workunit.client.0.smithi138.stdout:Progress (4): 79 kB | 58 kB | 0/1.0 MB | 15/211 kB Progress (4): 79 kB | 58 kB | 0/1.0 MB | 31/211 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-io/3.4.0/plexus-io-3.4.0.jar (79 kB at 5.0 MB/s) 2024-09-14T11:23:58.670 INFO:tasks.workunit.client.0.smithi138.stdout:Progress (3): 58 kB | 0.1/1.0 MB | 31/211 kB Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-utils/3.4.2/plexus-utils-3.4.2.jar 2024-09-14T11:23:58.670 INFO:tasks.workunit.client.0.smithi138.stdout:Downloaded from central: https://repo.maven.apache.org/maven2/org/iq80/snappy/snappy/0.4/snappy-0.4.jar (58 kB at 3.6 MB/s) 2024-09-14T11:23:58.673 INFO:tasks.workunit.client.0.smithi138.stdout:Progress (2): 0.1/1.0 MB | 48/211 kB Progress (2): 0.1/1.0 MB | 48/211 kB Progress (2): 0.1/1.0 MB | 48/211 kB Progress (2): 0.1/1.0 MB | 64/211 kB Progress (2): 0.1/1.0 MB | 64/211 kB Progress (2): 0.1/1.0 MB | 81/211 kB Progress (2): 0.1/1.0 MB | 81/211 kB Progress (2): 0.1/1.0 MB | 97/211 kB Progress (2): 0.1/1.0 MB | 97/211 kB Progress (2): 0.1/1.0 MB | 112/211 kB Progress (2): 0.2/1.0 MB | 112/211 kB Progress (2): 0.2/1.0 MB | 112/211 kB Progress (2): 0.2/1.0 MB | 128/211 kB Progress (2): 0.2/1.0 MB | 128/211 kB Progress (2): 0.2/1.0 MB | 145/211 kB Progress (2): 0.2/1.0 MB | 145/211 kB Progress (2): 0.2/1.0 MB | 161/211 kB Progress (2): 0.2/1.0 MB | 161/211 kB Progress (2): 0.2/1.0 MB | 161/211 kB Progress (2): 0.2/1.0 MB | 177/211 kB Progress (2): 0.3/1.0 MB | 177/211 kB Progress (2): 0.3/1.0 MB | 194/211 kB Progress (2): 0.3/1.0 MB | 194/211 kB Progress (2): 0.3/1.0 MB | 210/211 kB Progress (2): 0.3/1.0 MB | 211 kB Progress (2): 0.3/1.0 MB | 211 kB Progress (2): 0.3/1.0 MB | 211 kB Progress (2): 0.3/1.0 MB | 211 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-archiver/4.4.0/plexus-archiver-4.4.0.jar (211 kB at 10 MB/s) 2024-09-14T11:23:58.684 INFO:tasks.workunit.client.0.smithi138.stdout:Progress (1): 0.3/1.0 MB Progress (1): 0.4/1.0 MB Progress (1): 0.4/1.0 MB Progress (1): 0.4/1.0 MB Progress (1): 0.4/1.0 MB Progress (1): 0.4/1.0 MB Progress (1): 0.4/1.0 MB Progress (1): 0.5/1.0 MB Progress (1): 0.5/1.0 MB Progress (1): 0.5/1.0 MB Progress (1): 0.5/1.0 MB Progress (1): 0.5/1.0 MB Progress (1): 0.5/1.0 MB Progress (1): 0.6/1.0 MB Progress (1): 0.6/1.0 MB Progress (1): 0.6/1.0 MB Progress (1): 0.6/1.0 MB Progress (1): 0.6/1.0 MB Progress (1): 0.6/1.0 MB Progress (1): 0.7/1.0 MB Progress (1): 0.7/1.0 MB Progress (1): 0.7/1.0 MB Progress (1): 0.7/1.0 MB Progress (1): 0.7/1.0 MB Progress (1): 0.7/1.0 MB Progress (1): 0.8/1.0 MB Progress (1): 0.8/1.0 MB Progress (1): 0.8/1.0 MB Progress (1): 0.8/1.0 MB Progress (1): 0.8/1.0 MB Progress (1): 0.8/1.0 MB Progress (1): 0.8/1.0 MB Progress (1): 0.9/1.0 MB Progress (1): 0.9/1.0 MB Progress (1): 0.9/1.0 MB Progress (1): 0.9/1.0 MB Progress (1): 0.9/1.0 MB Progress (2): 0.9/1.0 MB | 16/267 kB Progress (3): 0.9/1.0 MB | 16/267 kB | 15/116 kB Progress (3): 0.9/1.0 MB | 16/267 kB | 15/116 kB Progress (3): 0.9/1.0 MB | 33/267 kB | 15/116 kB Progress (3): 0.9/1.0 MB | 33/267 kB | 31/116 kB Progress (3): 1.0/1.0 MB | 33/267 kB | 31/116 kB Progress (3): 1.0/1.0 MB | 49/267 kB | 31/116 kB Progress (3): 1.0/1.0 MB | 49/267 kB | 31/116 kB Progress (3): 1.0/1.0 MB | 63/267 kB | 31/116 kB Progress (3): 1.0/1.0 MB | 63/267 kB | 48/116 kB Progress (3): 1.0/1.0 MB | 63/267 kB | 48/116 kB Progress (3): 1.0/1.0 MB | 79/267 kB | 48/116 kB Progress (3): 1.0/1.0 MB | 79/267 kB | 48/116 kB Progress (3): 1.0 MB | 79/267 kB | 48/116 kB Progress (3): 1.0 MB | 96/267 kB | 48/116 kB Progress (3): 1.0 MB | 96/267 kB | 64/116 kB Progress (3): 1.0 MB | 112/267 kB | 64/116 kB Progress (3): 1.0 MB | 128/267 kB | 64/116 kB Progress (3): 1.0 MB | 128/267 kB | 78/116 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/commons/commons-compress/1.21/commons-compress-1.21.jar (1.0 MB at 33 MB/s) 2024-09-14T11:23:58.686 INFO:tasks.workunit.client.0.smithi138.stdout:Progress (2): 145/267 kB | 78/116 kB Progress (2): 161/267 kB | 78/116 kB Progress (2): 161/267 kB | 95/116 kB Progress (2): 178/267 kB | 95/116 kB Progress (2): 194/267 kB | 95/116 kB Progress (2): 194/267 kB | 111/116 kB Progress (2): 210/267 kB | 111/116 kB Progress (2): 210/267 kB | 116 kB Progress (2): 227/267 kB | 116 kB Progress (2): 243/267 kB | 116 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/tukaani/xz/1.9/xz-1.9.jar (116 kB at 3.5 MB/s) 2024-09-14T11:23:58.687 INFO:tasks.workunit.client.0.smithi138.stdout:Progress (1): 260/267 kB Progress (1): 267 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-utils/3.4.2/plexus-utils-3.4.2.jar (267 kB at 7.9 MB/s) 2024-09-14T11:23:58.873 INFO:tasks.workunit.client.0.smithi138.stdout:[INFO] Building jar: /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/jcksum/target/jcksum-1.0.jar 2024-09-14T11:23:58.913 INFO:tasks.workunit.client.0.smithi138.stdout:[INFO] ------------------------------------------------------------------------ 2024-09-14T11:23:58.914 INFO:tasks.workunit.client.0.smithi138.stdout:[INFO] BUILD SUCCESS 2024-09-14T11:23:58.914 INFO:tasks.workunit.client.0.smithi138.stdout:[INFO] ------------------------------------------------------------------------ 2024-09-14T11:23:58.915 INFO:tasks.workunit.client.0.smithi138.stdout:[INFO] Total time: 7.280 s 2024-09-14T11:23:58.915 INFO:tasks.workunit.client.0.smithi138.stdout:[INFO] Finished at: 2024-09-14T11:23:58Z 2024-09-14T11:23:58.915 INFO:tasks.workunit.client.0.smithi138.stdout:[INFO] ------------------------------------------------------------------------ 2024-09-14T11:23:58.947 INFO:tasks.workunit.client.0.smithi138.stderr:+ ./mvnw test -Dtest=PutObjects 2024-09-14T11:23:58.952 INFO:tasks.workunit.client.0.smithi138.stdout:Warning: JAVA_HOME environment variable is not set. 2024-09-14T11:24:00.205 INFO:tasks.workunit.client.0.smithi138.stdout:[INFO] Scanning for projects... 2024-09-14T11:24:00.286 INFO:tasks.workunit.client.0.smithi138.stdout:[INFO] 2024-09-14T11:24:00.287 INFO:tasks.workunit.client.0.smithi138.stdout:[INFO] ---------------------------< io.ceph:jcksum >--------------------------- 2024-09-14T11:24:00.287 INFO:tasks.workunit.client.0.smithi138.stdout:[INFO] Building jcksum 1.0 2024-09-14T11:24:00.287 INFO:tasks.workunit.client.0.smithi138.stdout:[INFO] from pom.xml 2024-09-14T11:24:00.287 INFO:tasks.workunit.client.0.smithi138.stdout:[INFO] --------------------------------[ jar ]--------------------------------- 2024-09-14T11:24:00.595 INFO:tasks.workunit.client.0.smithi138.stdout:[INFO] 2024-09-14T11:24:00.596 INFO:tasks.workunit.client.0.smithi138.stdout:[INFO] --- resources:3.3.1:resources (default-resources) @ jcksum --- 2024-09-14T11:24:00.730 INFO:tasks.workunit.client.0.smithi138.stdout:[INFO] skip non existing resourceDirectory /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/jcksum/src/main/resources 2024-09-14T11:24:00.731 INFO:tasks.workunit.client.0.smithi138.stdout:[INFO] 2024-09-14T11:24:00.731 INFO:tasks.workunit.client.0.smithi138.stdout:[INFO] --- compiler:3.11.0:compile (default-compile) @ jcksum --- 2024-09-14T11:24:00.825 INFO:tasks.workunit.client.0.smithi138.stdout:[INFO] Nothing to compile - all classes are up to date 2024-09-14T11:24:00.826 INFO:tasks.workunit.client.0.smithi138.stdout:[INFO] 2024-09-14T11:24:00.826 INFO:tasks.workunit.client.0.smithi138.stdout:[INFO] --- resources:3.3.1:testResources (default-testResources) @ jcksum --- 2024-09-14T11:24:00.828 INFO:tasks.workunit.client.0.smithi138.stdout:[INFO] skip non existing resourceDirectory /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/jcksum/src/test/resources 2024-09-14T11:24:00.828 INFO:tasks.workunit.client.0.smithi138.stdout:[INFO] 2024-09-14T11:24:00.828 INFO:tasks.workunit.client.0.smithi138.stdout:[INFO] --- compiler:3.11.0:testCompile (default-testCompile) @ jcksum --- 2024-09-14T11:24:00.833 INFO:tasks.workunit.client.0.smithi138.stdout:[INFO] Nothing to compile - all classes are up to date 2024-09-14T11:24:00.833 INFO:tasks.workunit.client.0.smithi138.stdout:[INFO] 2024-09-14T11:24:00.833 INFO:tasks.workunit.client.0.smithi138.stdout:[INFO] --- surefire:3.2.3:test (default-test) @ jcksum --- 2024-09-14T11:24:01.070 INFO:tasks.workunit.client.0.smithi138.stdout:[INFO] Using auto detected provider org.apache.maven.surefire.junitplatform.JUnitPlatformProvider 2024-09-14T11:24:01.317 INFO:tasks.workunit.client.0.smithi138.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-junit-platform/3.2.3/surefire-junit-platform-3.2.3.pom 2024-09-14T11:24:01.502 INFO:tasks.workunit.client.0.smithi138.stdout:Progress (1): 1.4/4.7 kB Progress (1): 2.8/4.7 kB Progress (1): 4.1/4.7 kB Progress (1): 4.7 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-junit-platform/3.2.3/surefire-junit-platform-3.2.3.pom (4.7 kB at 25 kB/s) 2024-09-14T11:24:01.510 INFO:tasks.workunit.client.0.smithi138.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-providers/3.2.3/surefire-providers-3.2.3.pom 2024-09-14T11:24:01.528 INFO:tasks.workunit.client.0.smithi138.stdout:Progress (1): 1.4/2.6 kB Progress (1): 2.6 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-providers/3.2.3/surefire-providers-3.2.3.pom (2.6 kB at 154 kB/s) 2024-09-14T11:24:01.533 INFO:tasks.workunit.client.0.smithi138.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/common-java5/3.2.3/common-java5-3.2.3.pom 2024-09-14T11:24:01.549 INFO:tasks.workunit.client.0.smithi138.stdout:Progress (1): 1.4/2.8 kB Progress (1): 2.8/2.8 kB Progress (1): 2.8 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/common-java5/3.2.3/common-java5-3.2.3.pom (2.8 kB at 166 kB/s) 2024-09-14T11:24:01.553 INFO:tasks.workunit.client.0.smithi138.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-launcher/1.9.3/junit-platform-launcher-1.9.3.pom 2024-09-14T11:24:01.570 INFO:tasks.workunit.client.0.smithi138.stdout:Progress (1): 1.4/3.0 kB Progress (1): 2.8/3.0 kB Progress (1): 3.0 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-launcher/1.9.3/junit-platform-launcher-1.9.3.pom (3.0 kB at 189 kB/s) 2024-09-14T11:24:01.572 INFO:tasks.workunit.client.0.smithi138.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-engine/1.9.3/junit-platform-engine-1.9.3.pom 2024-09-14T11:24:01.588 INFO:tasks.workunit.client.0.smithi138.stdout:Progress (1): 1.4/3.2 kB Progress (1): 2.8/3.2 kB Progress (1): 3.2 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-engine/1.9.3/junit-platform-engine-1.9.3.pom (3.2 kB at 213 kB/s) 2024-09-14T11:24:01.590 INFO:tasks.workunit.client.0.smithi138.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/opentest4j/opentest4j/1.2.0/opentest4j-1.2.0.pom 2024-09-14T11:24:01.605 INFO:tasks.workunit.client.0.smithi138.stdout:Progress (1): 1.4/1.7 kB Progress (1): 1.7 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/opentest4j/opentest4j/1.2.0/opentest4j-1.2.0.pom (1.7 kB at 112 kB/s) 2024-09-14T11:24:01.607 INFO:tasks.workunit.client.0.smithi138.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-commons/1.9.3/junit-platform-commons-1.9.3.pom 2024-09-14T11:24:01.623 INFO:tasks.workunit.client.0.smithi138.stdout:Progress (1): 1.4/2.8 kB Progress (1): 2.8/2.8 kB Progress (1): 2.8 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-commons/1.9.3/junit-platform-commons-1.9.3.pom (2.8 kB at 177 kB/s) 2024-09-14T11:24:01.628 INFO:tasks.workunit.client.0.smithi138.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-junit-platform/3.2.3/surefire-junit-platform-3.2.3.jar 2024-09-14T11:24:01.649 INFO:tasks.workunit.client.0.smithi138.stdout:Progress (1): 1.4/27 kB Progress (1): 2.8/27 kB Progress (1): 4.1/27 kB Progress (1): 5.5/27 kB Progress (1): 6.9/27 kB Progress (1): 8.3/27 kB Progress (1): 9.7/27 kB Progress (1): 11/27 kB Progress (1): 12/27 kB Progress (1): 14/27 kB Progress (1): 15/27 kB Progress (1): 16/27 kB Progress (1): 18/27 kB Progress (1): 19/27 kB Progress (1): 21/27 kB Progress (1): 22/27 kB Progress (1): 23/27 kB Progress (1): 25/27 kB Progress (1): 26/27 kB Progress (1): 27 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-junit-platform/3.2.3/surefire-junit-platform-3.2.3.jar (27 kB at 1.3 MB/s) 2024-09-14T11:24:01.651 INFO:tasks.workunit.client.0.smithi138.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/common-java5/3.2.3/common-java5-3.2.3.jar 2024-09-14T11:24:01.651 INFO:tasks.workunit.client.0.smithi138.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-launcher/1.9.3/junit-platform-launcher-1.9.3.jar 2024-09-14T11:24:01.652 INFO:tasks.workunit.client.0.smithi138.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-engine/1.9.3/junit-platform-engine-1.9.3.jar 2024-09-14T11:24:01.652 INFO:tasks.workunit.client.0.smithi138.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/opentest4j/opentest4j/1.2.0/opentest4j-1.2.0.jar 2024-09-14T11:24:01.655 INFO:tasks.workunit.client.0.smithi138.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-commons/1.9.3/junit-platform-commons-1.9.3.jar 2024-09-14T11:24:01.675 INFO:tasks.workunit.client.0.smithi138.stdout:Progress (1): 16/18 kB Progress (1): 18 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/common-java5/3.2.3/common-java5-3.2.3.jar (18 kB at 675 kB/s) 2024-09-14T11:24:01.712 INFO:tasks.workunit.client.0.smithi138.stdout:Progress (1): 1.4/103 kB Progress (2): 1.4/103 kB | 1.4/7.7 kB Progress (3): 1.4/103 kB | 1.4/7.7 kB | 1.4/189 kB Progress (3): 1.4/103 kB | 2.8/7.7 kB | 1.4/189 kB Progress (4): 1.4/103 kB | 2.8/7.7 kB | 1.4/189 kB | 1.4/169 kB Progress (4): 1.4/103 kB | 4.1/7.7 kB | 1.4/189 kB | 1.4/169 kB Progress (4): 1.4/103 kB | 4.1/7.7 kB | 2.8/189 kB | 1.4/169 kB Progress (4): 2.8/103 kB | 4.1/7.7 kB | 2.8/189 kB | 1.4/169 kB Progress (4): 2.8/103 kB | 4.1/7.7 kB | 4.1/189 kB | 1.4/169 kB Progress (4): 2.8/103 kB | 5.5/7.7 kB | 4.1/189 kB | 1.4/169 kB Progress (4): 2.8/103 kB | 5.5/7.7 kB | 4.1/189 kB | 2.8/169 kB Progress (4): 2.8/103 kB | 6.9/7.7 kB | 4.1/189 kB | 2.8/169 kB Progress (4): 2.8/103 kB | 6.9/7.7 kB | 5.5/189 kB | 2.8/169 kB Progress (4): 4.1/103 kB | 6.9/7.7 kB | 5.5/189 kB | 2.8/169 kB Progress (4): 4.1/103 kB | 6.9/7.7 kB | 6.9/189 kB | 2.8/169 kB Progress (4): 4.1/103 kB | 7.7 kB | 6.9/189 kB | 2.8/169 kB Progress (4): 4.1/103 kB | 7.7 kB | 6.9/189 kB | 4.1/169 kB Progress (4): 4.1/103 kB | 7.7 kB | 8.3/189 kB | 4.1/169 kB Progress (4): 5.5/103 kB | 7.7 kB | 8.3/189 kB | 4.1/169 kB Progress (4): 5.5/103 kB | 7.7 kB | 9.7/189 kB | 4.1/169 kB Progress (4): 5.5/103 kB | 7.7 kB | 9.7/189 kB | 5.5/169 kB Progress (4): 5.5/103 kB | 7.7 kB | 11/189 kB | 5.5/169 kB Progress (4): 6.9/103 kB | 7.7 kB | 11/189 kB | 5.5/169 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/opentest4j/opentest4j/1.2.0/opentest4j-1.2.0.jar (7.7 kB at 125 kB/s) 2024-09-14T11:24:01.749 INFO:tasks.workunit.client.0.smithi138.stdout:Progress (3): 8.3/103 kB | 11/189 kB | 5.5/169 kB Progress (3): 8.3/103 kB | 12/189 kB | 5.5/169 kB Progress (3): 8.3/103 kB | 12/189 kB | 6.9/169 kB Progress (3): 8.3/103 kB | 14/189 kB | 6.9/169 kB Progress (3): 9.7/103 kB | 14/189 kB | 6.9/169 kB Progress (3): 9.7/103 kB | 15/189 kB | 6.9/169 kB Progress (3): 9.7/103 kB | 15/189 kB | 8.3/169 kB Progress (3): 9.7/103 kB | 16/189 kB | 8.3/169 kB Progress (3): 11/103 kB | 16/189 kB | 8.3/169 kB Progress (3): 11/103 kB | 18/189 kB | 8.3/169 kB Progress (3): 11/103 kB | 18/189 kB | 9.7/169 kB Progress (3): 11/103 kB | 19/189 kB | 9.7/169 kB Progress (3): 12/103 kB | 19/189 kB | 9.7/169 kB Progress (3): 12/103 kB | 21/189 kB | 9.7/169 kB Progress (3): 12/103 kB | 21/189 kB | 11/169 kB Progress (3): 12/103 kB | 22/189 kB | 11/169 kB Progress (3): 14/103 kB | 22/189 kB | 11/169 kB Progress (3): 14/103 kB | 23/189 kB | 11/169 kB Progress (3): 14/103 kB | 23/189 kB | 12/169 kB Progress (3): 15/103 kB | 23/189 kB | 12/169 kB Progress (3): 15/103 kB | 23/189 kB | 14/169 kB Progress (3): 15/103 kB | 25/189 kB | 14/169 kB Progress (3): 15/103 kB | 25/189 kB | 15/169 kB Progress (3): 16/103 kB | 25/189 kB | 15/169 kB Progress (3): 16/103 kB | 25/189 kB | 16/169 kB Progress (3): 16/103 kB | 26/189 kB | 16/169 kB Progress (3): 16/103 kB | 26/189 kB | 18/169 kB Progress (3): 18/103 kB | 26/189 kB | 18/169 kB Progress (3): 18/103 kB | 26/189 kB | 19/169 kB Progress (3): 18/103 kB | 27/189 kB | 19/169 kB Progress (3): 18/103 kB | 27/189 kB | 21/169 kB Progress (3): 19/103 kB | 27/189 kB | 21/169 kB Progress (3): 19/103 kB | 27/189 kB | 22/169 kB Progress (3): 19/103 kB | 29/189 kB | 22/169 kB Progress (3): 19/103 kB | 29/189 kB | 23/169 kB Progress (3): 21/103 kB | 29/189 kB | 23/169 kB Progress (3): 21/103 kB | 29/189 kB | 25/169 kB Progress (3): 21/103 kB | 30/189 kB | 25/169 kB Progress (3): 21/103 kB | 30/189 kB | 26/169 kB Progress (3): 22/103 kB | 30/189 kB | 26/169 kB Progress (3): 22/103 kB | 30/189 kB | 27/169 kB Progress (3): 22/103 kB | 32/189 kB | 27/169 kB Progress (3): 22/103 kB | 32/189 kB | 29/169 kB Progress (3): 23/103 kB | 32/189 kB | 29/169 kB Progress (3): 23/103 kB | 32/189 kB | 30/169 kB Progress (3): 23/103 kB | 33/189 kB | 30/169 kB Progress (3): 23/103 kB | 33/189 kB | 32/169 kB Progress (3): 25/103 kB | 33/189 kB | 32/169 kB Progress (3): 25/103 kB | 33/189 kB | 33/169 kB Progress (3): 25/103 kB | 34/189 kB | 33/169 kB Progress (3): 25/103 kB | 34/189 kB | 34/169 kB Progress (3): 26/103 kB | 34/189 kB | 34/169 kB Progress (3): 26/103 kB | 34/189 kB | 36/169 kB Progress (3): 26/103 kB | 36/189 kB | 36/169 kB Progress (3): 26/103 kB | 36/189 kB | 37/169 kB Progress (3): 27/103 kB | 36/189 kB | 37/169 kB Progress (3): 27/103 kB | 36/189 kB | 38/169 kB Progress (3): 27/103 kB | 37/189 kB | 38/169 kB Progress (3): 27/103 kB | 37/189 kB | 40/169 kB Progress (3): 29/103 kB | 37/189 kB | 40/169 kB Progress (3): 29/103 kB | 37/189 kB | 41/169 kB Progress (3): 29/103 kB | 38/189 kB | 41/169 kB Progress (3): 29/103 kB | 38/189 kB | 42/169 kB Progress (3): 30/103 kB | 38/189 kB | 42/169 kB Progress (3): 30/103 kB | 38/189 kB | 44/169 kB Progress (3): 30/103 kB | 40/189 kB | 44/169 kB Progress (3): 30/103 kB | 40/189 kB | 45/169 kB Progress (3): 31/103 kB | 40/189 kB | 45/169 kB Progress (3): 31/103 kB | 40/189 kB | 47/169 kB Progress (3): 31/103 kB | 41/189 kB | 47/169 kB Progress (3): 31/103 kB | 41/189 kB | 48/169 kB Progress (3): 33/103 kB | 41/189 kB | 48/169 kB Progress (3): 33/103 kB | 41/189 kB | 49/169 kB Progress (3): 33/103 kB | 43/189 kB | 49/169 kB Progress (3): 33/103 kB | 43/189 kB | 51/169 kB Progress (3): 34/103 kB | 43/189 kB | 51/169 kB Progress (3): 34/103 kB | 43/189 kB | 52/169 kB Progress (3): 34/103 kB | 44/189 kB | 52/169 kB Progress (3): 34/103 kB | 44/189 kB | 53/169 kB Progress (3): 36/103 kB | 44/189 kB | 53/169 kB Progress (3): 36/103 kB | 44/189 kB | 55/169 kB Progress (3): 36/103 kB | 45/189 kB | 55/169 kB Progress (3): 36/103 kB | 45/189 kB | 56/169 kB Progress (3): 37/103 kB | 45/189 kB | 56/169 kB Progress (3): 37/103 kB | 45/189 kB | 58/169 kB Progress (3): 37/103 kB | 47/189 kB | 58/169 kB Progress (3): 37/103 kB | 47/189 kB | 59/169 kB Progress (3): 38/103 kB | 47/189 kB | 59/169 kB Progress (3): 38/103 kB | 47/189 kB | 60/169 kB Progress (3): 38/103 kB | 48/189 kB | 60/169 kB Progress (3): 38/103 kB | 48/189 kB | 61/169 kB Progress (3): 40/103 kB | 48/189 kB | 61/169 kB Progress (3): 40/103 kB | 49/189 kB | 61/169 kB Progress (3): 41/103 kB | 49/189 kB | 61/169 kB Progress (3): 42/103 kB | 49/189 kB | 61/169 kB Progress (3): 42/103 kB | 49/189 kB | 78/169 kB Progress (3): 44/103 kB | 49/189 kB | 78/169 kB Progress (3): 44/103 kB | 66/189 kB | 78/169 kB Progress (3): 45/103 kB | 66/189 kB | 78/169 kB Progress (3): 45/103 kB | 66/189 kB | 94/169 kB Progress (3): 47/103 kB | 66/189 kB | 94/169 kB Progress (3): 48/103 kB | 66/189 kB | 94/169 kB Progress (3): 48/103 kB | 79/189 kB | 94/169 kB Progress (3): 49/103 kB | 79/189 kB | 94/169 kB Progress (3): 51/103 kB | 79/189 kB | 94/169 kB Progress (3): 51/103 kB | 79/189 kB | 111/169 kB Progress (3): 52/103 kB | 79/189 kB | 111/169 kB Progress (3): 53/103 kB | 79/189 kB | 111/169 kB Progress (3): 55/103 kB | 79/189 kB | 111/169 kB Progress (3): 55/103 kB | 96/189 kB | 111/169 kB Progress (3): 56/103 kB | 96/189 kB | 111/169 kB Progress (3): 56/103 kB | 96/189 kB | 127/169 kB Progress (3): 58/103 kB | 96/189 kB | 127/169 kB Progress (3): 58/103 kB | 112/189 kB | 127/169 kB Progress (3): 58/103 kB | 112/189 kB | 143/169 kB Progress (3): 59/103 kB | 112/189 kB | 143/169 kB Progress (3): 60/103 kB | 112/189 kB | 143/169 kB Progress (3): 60/103 kB | 128/189 kB | 143/169 kB Progress (3): 62/103 kB | 128/189 kB | 143/169 kB Progress (3): 63/103 kB | 128/189 kB | 143/169 kB Progress (3): 63/103 kB | 145/189 kB | 143/169 kB Progress (3): 64/103 kB | 145/189 kB | 143/169 kB Progress (3): 81/103 kB | 145/189 kB | 143/169 kB Progress (3): 97/103 kB | 145/189 kB | 143/169 kB Progress (3): 97/103 kB | 161/189 kB | 143/169 kB Progress (3): 97/103 kB | 161/189 kB | 160/169 kB Progress (3): 103 kB | 161/189 kB | 160/169 kB Progress (3): 103 kB | 161/189 kB | 169 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-launcher/1.9.3/junit-platform-launcher-1.9.3.jar (169 kB at 1.7 MB/s) 2024-09-14T11:24:01.750 INFO:tasks.workunit.client.0.smithi138.stdout:Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-commons/1.9.3/junit-platform-commons-1.9.3.jar (103 kB at 1.1 MB/s) 2024-09-14T11:24:01.758 INFO:tasks.workunit.client.0.smithi138.stdout:Progress (1): 178/189 kB Progress (1): 189 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-engine/1.9.3/junit-platform-engine-1.9.3.jar (189 kB at 1.8 MB/s) 2024-09-14T11:24:01.773 INFO:tasks.workunit.client.0.smithi138.stdout:[INFO] 2024-09-14T11:24:01.773 INFO:tasks.workunit.client.0.smithi138.stdout:[INFO] ------------------------------------------------------- 2024-09-14T11:24:01.773 INFO:tasks.workunit.client.0.smithi138.stdout:[INFO] T E S T S 2024-09-14T11:24:01.773 INFO:tasks.workunit.client.0.smithi138.stdout:[INFO] ------------------------------------------------------- 2024-09-14T11:24:02.354 INFO:tasks.workunit.client.0.smithi138.stdout:[INFO] Running io.ceph.jcksum.PutObjects 2024-09-14T11:24:02.408 INFO:tasks.workunit.client.0.smithi138.stdout:PutObjects.java: starting test run: 2024-09-14T11:24:02.408 INFO:tasks.workunit.client.0.smithi138.stdout: AccessKey=lNCnR47C2g+ZidCWBAUuwfSAA7Q= 2024-09-14T11:24:02.408 INFO:tasks.workunit.client.0.smithi138.stdout: SecretKey=tYuA2Y+Uu1ow2l9Xe59tWKVml3gMuVfyhUjjJwfwEI0vFFONIcqf4g== 2024-09-14T11:24:02.408 INFO:tasks.workunit.client.0.smithi138.stdout: EndpointUrl=https://smithi138.front.sepia.ceph.com:443 2024-09-14T11:24:02.504 INFO:tasks.workunit.client.0.smithi138.stderr:[main] WARN software.amazon.awssdk.http.apache.ApacheHttpClient - SSL Certificate verification is disabled. This is not a safe setting and should only be used for testing. 2024-09-14T11:24:02.604 INFO:tasks.workunit.client.0.smithi138.stdout:DEBUG: Environment Variables Read 2024-09-14T11:24:02.905 INFO:tasks.workunit.client.0.smithi138.stdout:DEBUG: S3 Client Initialized 2024-09-14T11:24:02.905 INFO:tasks.workunit.client.0.smithi138.stdout:DEBUG: Generating File 2024-09-14T11:24:02.905 INFO:tasks.workunit.client.0.smithi138.stdout:DEBUG: File Generated 2024-09-14T11:24:02.905 INFO:tasks.workunit.client.0.smithi138.stdout:DEBUG: Generating File 2024-09-14T11:24:02.905 INFO:tasks.workunit.client.0.smithi138.stdout:DEBUG: File Generated 2024-09-14T11:24:02.905 INFO:tasks.workunit.client.0.smithi138.stdout:DEBUG: Generating File 2024-09-14T11:24:03.005 INFO:tasks.workunit.client.0.smithi138.stdout:DEBUG: File Generated 2024-09-14T11:24:03.005 INFO:tasks.workunit.client.0.smithi138.stdout:DEBUG: Generating File 2024-09-14T11:24:03.006 INFO:tasks.workunit.client.0.smithi138.stdout:DEBUG: File Generated 2024-09-14T11:24:03.006 INFO:tasks.workunit.client.0.smithi138.stdout:DEBUG: Generating File 2024-09-14T11:24:03.006 INFO:tasks.workunit.client.0.smithi138.stdout:DEBUG: File Generated 2024-09-14T11:24:03.006 INFO:tasks.workunit.client.0.smithi138.stdout:DEBUG: Generating File 2024-09-14T11:24:03.006 INFO:tasks.workunit.client.0.smithi138.stdout:DEBUG: File Generated 2024-09-14T11:24:03.006 INFO:tasks.workunit.client.0.smithi138.stdout:DEBUG: Generated Big Files 2024-09-14T11:24:03.608 INFO:tasks.workunit.client.0.smithi138.stdout:HeadBucketResponse() 2024-09-14T11:24:03.609 INFO:tasks.workunit.client.0.smithi138.stdout:sheik is ready 2024-09-14T11:24:03.609 INFO:tasks.workunit.client.0.smithi138.stdout:DEBUG: Test Bucket Created 2024-09-14T11:24:03.708 INFO:tasks.workunit.client.0.smithi138.stdout:putObjectFromFileNoCksum called with file-0b 2024-09-14T11:24:04.009 INFO:tasks.workunit.client.0.smithi138.stdout:putObjectFromFileNoCksum called with file-8b 2024-09-14T11:24:04.310 INFO:tasks.workunit.client.0.smithi138.stdout:putObjectFromFileNoCksum called with file-200b 2024-09-14T11:24:04.511 INFO:tasks.workunit.client.0.smithi138.stdout:putObjectFromFileNoCksum called with file-21983b 2024-09-14T11:24:04.811 INFO:tasks.workunit.client.0.smithi138.stdout:putObjectFromFileNoCksum called with file-5519b 2024-09-14T11:24:05.212 INFO:tasks.workunit.client.0.smithi138.stdout:putObjectFromFileNoCksum called with file-204329b 2024-09-14T11:24:05.613 INFO:tasks.workunit.client.0.smithi138.stdout:putObjectFromFileNoCksum called with file-256k 2024-09-14T11:24:06.215 INFO:tasks.workunit.client.0.smithi138.stdout:putObjectFromFileNoCksum called with file-1m 2024-09-14T11:24:07.417 INFO:tasks.workunit.client.0.smithi138.stdout:putObjectFromFileNoCksum called with file-1038757b 2024-09-14T11:24:08.319 INFO:tasks.workunit.client.0.smithi138.stdout:mpuObjectFromFileNoCksum called with file-5m 2024-09-14T11:24:14.734 INFO:tasks.workunit.client.0.smithi138.stdout:mpuObjectFromFileNoCksum called with file-10m 2024-09-14T11:24:21.661 INFO:tasks.workunit.client.0.smithi138.stdout:mpuObjectFromFileNoCksum called with file-100m 2024-09-14T11:25:27.921 INFO:tasks.workunit.client.0.smithi138.stdout:arg: file-0b 2024-09-14T11:25:27.921 INFO:tasks.workunit.client.0.smithi138.stdout:arg: file-8b 2024-09-14T11:25:27.923 INFO:tasks.workunit.client.0.smithi138.stdout:arg: file-200b 2024-09-14T11:25:27.924 INFO:tasks.workunit.client.0.smithi138.stdout:arg: file-21983b 2024-09-14T11:25:27.925 INFO:tasks.workunit.client.0.smithi138.stdout:arg: file-5519b 2024-09-14T11:25:27.926 INFO:tasks.workunit.client.0.smithi138.stdout:arg: file-204329b 2024-09-14T11:25:27.927 INFO:tasks.workunit.client.0.smithi138.stdout:arg: file-256k 2024-09-14T11:25:27.928 INFO:tasks.workunit.client.0.smithi138.stdout:arg: file-1m 2024-09-14T11:25:27.929 INFO:tasks.workunit.client.0.smithi138.stdout:arg: file-1038757b 2024-09-14T11:25:27.959 INFO:tasks.workunit.client.0.smithi138.stdout:putObjectFromFileCksum called with file-0b 2024-09-14T11:25:28.159 INFO:tasks.workunit.client.0.smithi138.stdout:PutObjectResponse 2024-09-14T11:25:28.259 INFO:tasks.workunit.client.0.smithi138.stdout:putObjectFromFileCksum called with file-8b 2024-09-14T11:25:28.359 INFO:tasks.workunit.client.0.smithi138.stdout:PutObjectResponse 2024-09-14T11:25:28.460 INFO:tasks.workunit.client.0.smithi138.stdout:putObjectFromFileCksum called with file-200b 2024-09-14T11:25:28.660 INFO:tasks.workunit.client.0.smithi138.stdout:PutObjectResponse 2024-09-14T11:25:28.760 INFO:tasks.workunit.client.0.smithi138.stdout:putObjectFromFileCksum called with file-21983b 2024-09-14T11:25:28.960 INFO:tasks.workunit.client.0.smithi138.stdout:PutObjectResponse 2024-09-14T11:25:29.061 INFO:tasks.workunit.client.0.smithi138.stdout:putObjectFromFileCksum called with file-5519b 2024-09-14T11:25:29.160 INFO:tasks.workunit.client.0.smithi138.stdout:PutObjectResponse 2024-09-14T11:25:29.361 INFO:tasks.workunit.client.0.smithi138.stdout:putObjectFromFileCksum called with file-204329b 2024-09-14T11:25:29.561 INFO:tasks.workunit.client.0.smithi138.stdout:PutObjectResponse 2024-09-14T11:25:29.761 INFO:tasks.workunit.client.0.smithi138.stdout:putObjectFromFileCksum called with file-256k 2024-09-14T11:25:30.164 INFO:tasks.workunit.client.0.smithi138.stdout:PutObjectResponse 2024-09-14T11:25:30.362 INFO:tasks.workunit.client.0.smithi138.stdout:putObjectFromFileCksum called with file-1m 2024-09-14T11:25:31.163 INFO:tasks.workunit.client.0.smithi138.stdout:PutObjectResponse 2024-09-14T11:25:31.464 INFO:tasks.workunit.client.0.smithi138.stdout:putObjectFromFileCksum called with file-1038757b 2024-09-14T11:25:32.465 INFO:tasks.workunit.client.0.smithi138.stdout:PutObjectResponse 2024-09-14T11:25:32.765 INFO:tasks.workunit.client.0.smithi138.stdout:mpuObjectFromFileCksum called with file-5m 2024-09-14T11:25:37.572 INFO:tasks.workunit.client.0.smithi138.stdout:mpuObjectFromFileCksum called with file-10m 2024-09-14T11:25:46.983 INFO:tasks.workunit.client.0.smithi138.stdout:mpuObjectFromFileCksum called with file-100m 2024-09-14T11:27:13.266 INFO:tasks.workunit.client.0.smithi138.stdout:[INFO] Tests run: 33, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 190.9 s -- in io.ceph.jcksum.PutObjects 2024-09-14T11:27:13.303 INFO:tasks.workunit.client.0.smithi138.stdout:[INFO] 2024-09-14T11:27:13.303 INFO:tasks.workunit.client.0.smithi138.stdout:[INFO] Results: 2024-09-14T11:27:13.303 INFO:tasks.workunit.client.0.smithi138.stdout:[INFO] 2024-09-14T11:27:13.303 INFO:tasks.workunit.client.0.smithi138.stdout:[INFO] Tests run: 33, Failures: 0, Errors: 0, Skipped: 0 2024-09-14T11:27:13.304 INFO:tasks.workunit.client.0.smithi138.stdout:[INFO] 2024-09-14T11:27:13.306 INFO:tasks.workunit.client.0.smithi138.stdout:[INFO] ------------------------------------------------------------------------ 2024-09-14T11:27:13.306 INFO:tasks.workunit.client.0.smithi138.stdout:[INFO] BUILD SUCCESS 2024-09-14T11:27:13.306 INFO:tasks.workunit.client.0.smithi138.stdout:[INFO] ------------------------------------------------------------------------ 2024-09-14T11:27:13.307 INFO:tasks.workunit.client.0.smithi138.stdout:[INFO] Total time: 03:13 min 2024-09-14T11:27:13.307 INFO:tasks.workunit.client.0.smithi138.stdout:[INFO] Finished at: 2024-09-14T11:27:13Z 2024-09-14T11:27:13.307 INFO:tasks.workunit.client.0.smithi138.stdout:[INFO] ------------------------------------------------------------------------ 2024-09-14T11:27:13.336 INFO:tasks.workunit.client.0.smithi138.stderr:+ exit 2024-09-14T11:27:13.337 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-09-14T11:27:13.337 DEBUG:teuthology.orchestra.run.smithi138:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-09-14T11:27:13.395 INFO:tasks.workunit:Stopping ['cls/test_cls_lock.sh', 'cls/test_cls_log.sh', 'cls/test_cls_refcount.sh', 'cls/test_cls_rgw.sh', 'cls/test_cls_rgw_gc.sh', 'cls/test_cls_rgw_stats.sh', 'cls/test_cls_cmpomap.sh', 'cls/test_cls_2pc_queue.sh', 'cls/test_cls_user.sh', 'rgw/test_rgw_gc_log.sh', 'rgw/test_rgw_obj.sh', 'rgw/test_librgw_file.sh', 'rgw/test_awssdkv4_sig.sh'] on client.0... 2024-09-14T11:27:13.396 DEBUG:teuthology.orchestra.run.smithi138:> sudo rm -rf -- /home/ubuntu/cephtest/workunits.list.client.0 /home/ubuntu/cephtest/clone.client.0 2024-09-14T11:27:13.773 DEBUG:teuthology.parallel:result is None 2024-09-14T11:27:13.774 DEBUG:teuthology.orchestra.run.smithi138:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0 2024-09-14T11:27:13.786 INFO:tasks.workunit:Deleted dir /home/ubuntu/cephtest/mnt.0/client.0 2024-09-14T11:27:13.786 DEBUG:teuthology.orchestra.run.smithi138:> rmdir -- /home/ubuntu/cephtest/mnt.0 2024-09-14T11:27:13.831 INFO:tasks.workunit:Deleted artificial mount point /home/ubuntu/cephtest/mnt.0/client.0 2024-09-14T11:27:13.831 INFO:teuthology.run_tasks:Running task workunit... 2024-09-14T11:27:13.844 INFO:tasks.workunit:Pulling workunits from ref 1c941a66c1b420259b8fc5ac19e792dbbf60aded 2024-09-14T11:27:13.844 INFO:tasks.workunit:Making a separate scratch dir for every client... 2024-09-14T11:27:13.844 DEBUG:teuthology.orchestra.run.smithi138:> stat -- /home/ubuntu/cephtest/mnt.0 2024-09-14T11:27:13.879 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-14T11:27:13.879 INFO:teuthology.orchestra.run.smithi138.stderr:stat: cannot statx '/home/ubuntu/cephtest/mnt.0': No such file or directory 2024-09-14T11:27:13.880 DEBUG:teuthology.orchestra.run.smithi138:> mkdir -- /home/ubuntu/cephtest/mnt.0 2024-09-14T11:27:13.927 INFO:tasks.workunit:Created dir /home/ubuntu/cephtest/mnt.0 2024-09-14T11:27:13.927 DEBUG:teuthology.orchestra.run.smithi138:> cd -- /home/ubuntu/cephtest/mnt.0 && mkdir -- client.0 2024-09-14T11:27:13.975 INFO:tasks.workunit:timeout=3h 2024-09-14T11:27:13.975 INFO:tasks.workunit:cleanup=True 2024-09-14T11:27:13.975 DEBUG:teuthology.orchestra.run.smithi138:> rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone https://git.ceph.com/ceph.git /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 && git checkout 1c941a66c1b420259b8fc5ac19e792dbbf60aded 2024-09-14T11:27:14.025 INFO:tasks.workunit.client.0.smithi138.stderr:Cloning into '/home/ubuntu/cephtest/clone.client.0'... 2024-09-14T11:28:08.780 INFO:tasks.workunit.client.0.smithi138.stderr:Updating files: 95% (12260/12889) Updating files: 96% (12374/12889) Updating files: 97% (12503/12889) Updating files: 98% (12632/12889) Updating files: 99% (12761/12889) Updating files: 100% (12889/12889) Updating files: 100% (12889/12889), done. 2024-09-14T11:28:09.366 INFO:tasks.workunit.client.0.smithi138.stderr:Note: switching to '1c941a66c1b420259b8fc5ac19e792dbbf60aded'. 2024-09-14T11:28:09.366 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-14T11:28:09.366 INFO:tasks.workunit.client.0.smithi138.stderr:You are in 'detached HEAD' state. You can look around, make experimental 2024-09-14T11:28:09.366 INFO:tasks.workunit.client.0.smithi138.stderr:changes and commit them, and you can discard any commits you make in this 2024-09-14T11:28:09.366 INFO:tasks.workunit.client.0.smithi138.stderr:state without impacting any branches by switching back to a branch. 2024-09-14T11:28:09.366 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-14T11:28:09.366 INFO:tasks.workunit.client.0.smithi138.stderr:If you want to create a new branch to retain commits you create, you may 2024-09-14T11:28:09.366 INFO:tasks.workunit.client.0.smithi138.stderr:do so (now or later) by using -c with the switch command. Example: 2024-09-14T11:28:09.366 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-14T11:28:09.367 INFO:tasks.workunit.client.0.smithi138.stderr: git switch -c 2024-09-14T11:28:09.367 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-14T11:28:09.367 INFO:tasks.workunit.client.0.smithi138.stderr:Or undo this operation with: 2024-09-14T11:28:09.367 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-14T11:28:09.367 INFO:tasks.workunit.client.0.smithi138.stderr: git switch - 2024-09-14T11:28:09.367 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-14T11:28:09.367 INFO:tasks.workunit.client.0.smithi138.stderr:Turn off this advice by setting config variable advice.detachedHead to false 2024-09-14T11:28:09.367 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-14T11:28:09.367 INFO:tasks.workunit.client.0.smithi138.stderr:HEAD is now at 1c941a66c1b Merge pull request #54777 from cbodley/wip-rgw-meta-handlers 2024-09-14T11:28:09.368 DEBUG:teuthology.orchestra.run.smithi138:> cd -- /home/ubuntu/cephtest/clone.client.0/qa/workunits && if test -e Makefile ; then make ; fi && find -executable -type f -printf '%P\0' >/home/ubuntu/cephtest/workunits.list.client.0 2024-09-14T11:28:09.416 INFO:tasks.workunit.client.0.smithi138.stdout:for d in direct_io fs ; do ( cd $d ; make all ) ; done 2024-09-14T11:28:09.420 INFO:tasks.workunit.client.0.smithi138.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-09-14T11:28:09.420 INFO:tasks.workunit.client.0.smithi138.stdout:cc -Wall -Wextra -D_GNU_SOURCE direct_io_test.c -o direct_io_test 2024-09-14T11:28:09.481 INFO:tasks.workunit.client.0.smithi138.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_sync_io.c -o test_sync_io 2024-09-14T11:28:09.534 INFO:tasks.workunit.client.0.smithi138.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_short_dio_read.c -o test_short_dio_read 2024-09-14T11:28:09.579 INFO:tasks.workunit.client.0.smithi138.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-09-14T11:28:09.581 INFO:tasks.workunit.client.0.smithi138.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-09-14T11:28:09.581 INFO:tasks.workunit.client.0.smithi138.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_o_trunc.c -o test_o_trunc 2024-09-14T11:28:09.619 INFO:tasks.workunit.client.0.smithi138.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-09-14T11:28:09.623 DEBUG:teuthology.orchestra.run.smithi138:> set -ex 2024-09-14T11:28:09.623 DEBUG:teuthology.orchestra.run.smithi138:> dd if=/home/ubuntu/cephtest/workunits.list.client.0 of=/dev/stdout 2024-09-14T11:28:09.672 INFO:tasks.workunit:Running workunits matching rgw/test_rgw_s3_mp_reupload.sh on client.0... 2024-09-14T11:28:09.673 INFO:tasks.workunit:Running workunit rgw/test_rgw_s3_mp_reupload.sh... 2024-09-14T11:28:09.673 DEBUG:teuthology.orchestra.run.smithi138:workunit test rgw/test_rgw_s3_mp_reupload.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=1c941a66c1b420259b8fc5ac19e792dbbf60aded TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/test_rgw_s3_mp_reupload.sh 2024-09-14T11:28:09.726 INFO:tasks.workunit.client.0.smithi138.stdout:INFO: fully qualified domain name: smithi138.front.sepia.ceph.com 2024-09-14T11:28:09.726 INFO:tasks.workunit.client.0.smithi138.stdout:== TESTING *ABORTING* MULTIPART UPLOAD WITH RE-UPLOADS == 2024-09-14T11:28:09.726 INFO:tasks.workunit.client.0.smithi138.stdout:== TESTING NON-VERSIONED BUCKET == 2024-09-14T11:28:13.018 INFO:tasks.workunit.client.0.smithi138.stdout:Requirement already satisfied: pip in /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages (22.0.2) 2024-09-14T11:28:13.224 INFO:tasks.workunit.client.0.smithi138.stdout:Collecting pip 2024-09-14T11:28:13.230 INFO:tasks.workunit.client.0.smithi138.stdout: Using cached pip-24.2-py3-none-any.whl (1.8 MB) 2024-09-14T11:28:13.264 INFO:tasks.workunit.client.0.smithi138.stdout:Installing collected packages: pip 2024-09-14T11:28:13.264 INFO:tasks.workunit.client.0.smithi138.stdout: Attempting uninstall: pip 2024-09-14T11:28:13.265 INFO:tasks.workunit.client.0.smithi138.stdout: Found existing installation: pip 22.0.2 2024-09-14T11:28:13.525 INFO:tasks.workunit.client.0.smithi138.stdout: Uninstalling pip-22.0.2: 2024-09-14T11:28:13.531 INFO:tasks.workunit.client.0.smithi138.stdout: Successfully uninstalled pip-22.0.2 2024-09-14T11:28:14.578 INFO:tasks.workunit.client.0.smithi138.stdout:Successfully installed pip-24.2 2024-09-14T11:28:15.635 INFO:tasks.workunit.client.0.smithi138.stdout:Collecting boto3 2024-09-14T11:28:15.636 INFO:tasks.workunit.client.0.smithi138.stdout: Using cached boto3-1.35.19-py3-none-any.whl.metadata (6.6 kB) 2024-09-14T11:28:16.185 INFO:tasks.workunit.client.0.smithi138.stdout:Collecting botocore<1.36.0,>=1.35.19 (from boto3) 2024-09-14T11:28:16.186 INFO:tasks.workunit.client.0.smithi138.stdout: Using cached botocore-1.35.19-py3-none-any.whl.metadata (5.7 kB) 2024-09-14T11:28:16.240 INFO:tasks.workunit.client.0.smithi138.stdout:Collecting jmespath<2.0.0,>=0.7.1 (from boto3) 2024-09-14T11:28:16.241 INFO:tasks.workunit.client.0.smithi138.stdout: Using cached jmespath-1.0.1-py3-none-any.whl.metadata (7.6 kB) 2024-09-14T11:28:16.297 INFO:tasks.workunit.client.0.smithi138.stdout:Collecting s3transfer<0.11.0,>=0.10.0 (from boto3) 2024-09-14T11:28:16.298 INFO:tasks.workunit.client.0.smithi138.stdout: Using cached s3transfer-0.10.2-py3-none-any.whl.metadata (1.7 kB) 2024-09-14T11:28:16.361 INFO:tasks.workunit.client.0.smithi138.stdout:Collecting python-dateutil<3.0.0,>=2.1 (from botocore<1.36.0,>=1.35.19->boto3) 2024-09-14T11:28:16.363 INFO:tasks.workunit.client.0.smithi138.stdout: Using cached python_dateutil-2.9.0.post0-py2.py3-none-any.whl.metadata (8.4 kB) 2024-09-14T11:28:16.457 INFO:tasks.workunit.client.0.smithi138.stdout:Collecting urllib3!=2.2.0,<3,>=1.25.4 (from botocore<1.36.0,>=1.35.19->boto3) 2024-09-14T11:28:16.458 INFO:tasks.workunit.client.0.smithi138.stdout: Using cached urllib3-2.2.3-py3-none-any.whl.metadata (6.5 kB) 2024-09-14T11:28:16.611 INFO:tasks.workunit.client.0.smithi138.stdout:Collecting six>=1.5 (from python-dateutil<3.0.0,>=2.1->botocore<1.36.0,>=1.35.19->boto3) 2024-09-14T11:28:16.612 INFO:tasks.workunit.client.0.smithi138.stdout: Using cached six-1.16.0-py2.py3-none-any.whl.metadata (1.8 kB) 2024-09-14T11:28:16.616 INFO:tasks.workunit.client.0.smithi138.stdout:Using cached boto3-1.35.19-py3-none-any.whl (139 kB) 2024-09-14T11:28:16.617 INFO:tasks.workunit.client.0.smithi138.stdout:Using cached botocore-1.35.19-py3-none-any.whl (12.5 MB) 2024-09-14T11:28:16.628 INFO:tasks.workunit.client.0.smithi138.stdout:Using cached jmespath-1.0.1-py3-none-any.whl (20 kB) 2024-09-14T11:28:16.629 INFO:tasks.workunit.client.0.smithi138.stdout:Using cached s3transfer-0.10.2-py3-none-any.whl (82 kB) 2024-09-14T11:28:16.630 INFO:tasks.workunit.client.0.smithi138.stdout:Using cached python_dateutil-2.9.0.post0-py2.py3-none-any.whl (229 kB) 2024-09-14T11:28:16.632 INFO:tasks.workunit.client.0.smithi138.stdout:Using cached urllib3-2.2.3-py3-none-any.whl (126 kB) 2024-09-14T11:28:16.633 INFO:tasks.workunit.client.0.smithi138.stdout:Using cached six-1.16.0-py2.py3-none-any.whl (11 kB) 2024-09-14T11:28:16.706 INFO:tasks.workunit.client.0.smithi138.stdout:Installing collected packages: urllib3, six, jmespath, python-dateutil, botocore, s3transfer, boto3 2024-09-14T11:28:17.861 INFO:tasks.workunit.client.0.smithi138.stdout:Successfully installed boto3-1.35.19 botocore-1.35.19 jmespath-1.0.1 python-dateutil-2.9.0.post0 s3transfer-0.10.2 six-1.16.0 urllib3-2.2.3 2024-09-14T11:28:18.222 INFO:tasks.workunit.client.0.smithi138.stdout:INFO: creating user 2024-09-14T11:28:18.581 INFO:tasks.workunit.client.0.smithi138.stdout:{ 2024-09-14T11:28:18.581 INFO:tasks.workunit.client.0.smithi138.stdout: "user_id": "testid", 2024-09-14T11:28:18.581 INFO:tasks.workunit.client.0.smithi138.stdout: "display_name": "M. Tester", 2024-09-14T11:28:18.581 INFO:tasks.workunit.client.0.smithi138.stdout: "email": "tester@ceph.com", 2024-09-14T11:28:18.582 INFO:tasks.workunit.client.0.smithi138.stdout: "suspended": 0, 2024-09-14T11:28:18.582 INFO:tasks.workunit.client.0.smithi138.stdout: "max_buckets": 1000, 2024-09-14T11:28:18.582 INFO:tasks.workunit.client.0.smithi138.stdout: "subusers": [], 2024-09-14T11:28:18.582 INFO:tasks.workunit.client.0.smithi138.stdout: "keys": [ 2024-09-14T11:28:18.582 INFO:tasks.workunit.client.0.smithi138.stdout: { 2024-09-14T11:28:18.582 INFO:tasks.workunit.client.0.smithi138.stdout: "user": "testid", 2024-09-14T11:28:18.582 INFO:tasks.workunit.client.0.smithi138.stdout: "access_key": "0555b35654ad1656d804", 2024-09-14T11:28:18.582 INFO:tasks.workunit.client.0.smithi138.stdout: "secret_key": "h7GhxuBLTrlhVUyxSPUKUV8r/2EI4ngqJxD7iBdBYLhwluN30JaT3Q==", 2024-09-14T11:28:18.582 INFO:tasks.workunit.client.0.smithi138.stdout: "active": true, 2024-09-14T11:28:18.582 INFO:tasks.workunit.client.0.smithi138.stdout: "create_date": "2024-09-14T11:28:18.575565Z" 2024-09-14T11:28:18.582 INFO:tasks.workunit.client.0.smithi138.stdout: } 2024-09-14T11:28:18.582 INFO:tasks.workunit.client.0.smithi138.stdout: ], 2024-09-14T11:28:18.583 INFO:tasks.workunit.client.0.smithi138.stdout: "swift_keys": [], 2024-09-14T11:28:18.583 INFO:tasks.workunit.client.0.smithi138.stdout: "caps": [], 2024-09-14T11:28:18.583 INFO:tasks.workunit.client.0.smithi138.stdout: "op_mask": "read, write, delete", 2024-09-14T11:28:18.583 INFO:tasks.workunit.client.0.smithi138.stdout: "default_placement": "", 2024-09-14T11:28:18.583 INFO:tasks.workunit.client.0.smithi138.stdout: "default_storage_class": "", 2024-09-14T11:28:18.583 INFO:tasks.workunit.client.0.smithi138.stdout: "placement_tags": [], 2024-09-14T11:28:18.583 INFO:tasks.workunit.client.0.smithi138.stdout: "bucket_quota": { 2024-09-14T11:28:18.583 INFO:tasks.workunit.client.0.smithi138.stdout: "enabled": false, 2024-09-14T11:28:18.583 INFO:tasks.workunit.client.0.smithi138.stdout: "check_on_raw": false, 2024-09-14T11:28:18.583 INFO:tasks.workunit.client.0.smithi138.stdout: "max_size": -1, 2024-09-14T11:28:18.583 INFO:tasks.workunit.client.0.smithi138.stdout: "max_size_kb": 0, 2024-09-14T11:28:18.583 INFO:tasks.workunit.client.0.smithi138.stdout: "max_objects": -1 2024-09-14T11:28:18.583 INFO:tasks.workunit.client.0.smithi138.stdout: }, 2024-09-14T11:28:18.583 INFO:tasks.workunit.client.0.smithi138.stdout: "user_quota": { 2024-09-14T11:28:18.583 INFO:tasks.workunit.client.0.smithi138.stdout: "enabled": false, 2024-09-14T11:28:18.584 INFO:tasks.workunit.client.0.smithi138.stdout: "check_on_raw": false, 2024-09-14T11:28:18.584 INFO:tasks.workunit.client.0.smithi138.stdout: "max_size": -1, 2024-09-14T11:28:18.584 INFO:tasks.workunit.client.0.smithi138.stdout: "max_size_kb": 0, 2024-09-14T11:28:18.584 INFO:tasks.workunit.client.0.smithi138.stdout: "max_objects": -1 2024-09-14T11:28:18.584 INFO:tasks.workunit.client.0.smithi138.stdout: }, 2024-09-14T11:28:18.584 INFO:tasks.workunit.client.0.smithi138.stdout: "temp_url_keys": [], 2024-09-14T11:28:18.584 INFO:tasks.workunit.client.0.smithi138.stdout: "type": "rgw", 2024-09-14T11:28:18.584 INFO:tasks.workunit.client.0.smithi138.stdout: "mfa_ids": [], 2024-09-14T11:28:18.584 INFO:tasks.workunit.client.0.smithi138.stdout: "account_id": "", 2024-09-14T11:28:18.584 INFO:tasks.workunit.client.0.smithi138.stdout: "path": "/", 2024-09-14T11:28:18.584 INFO:tasks.workunit.client.0.smithi138.stdout: "create_date": "2024-09-14T11:28:18.575518Z", 2024-09-14T11:28:18.584 INFO:tasks.workunit.client.0.smithi138.stdout: "tags": [], 2024-09-14T11:28:18.584 INFO:tasks.workunit.client.0.smithi138.stdout: "group_ids": [] 2024-09-14T11:28:18.584 INFO:tasks.workunit.client.0.smithi138.stdout:} 2024-09-14T11:28:18.584 INFO:tasks.workunit.client.0.smithi138.stdout: 2024-09-14T11:28:27.094 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'smithi138.front.sepia.ceph.com'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:28:27.095 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-14T11:28:27.260 INFO:tasks.workunit.client.0.smithi138.stderr:5+0 records in 2024-09-14T11:28:27.261 INFO:tasks.workunit.client.0.smithi138.stderr:5+0 records out 2024-09-14T11:28:27.261 INFO:tasks.workunit.client.0.smithi138.stderr:5242880 bytes (5.2 MB, 5.0 MiB) copied, 0.0231712 s, 226 MB/s 2024-09-14T11:28:27.266 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'smithi138.front.sepia.ceph.com'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:28:27.266 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-14T11:28:27.388 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'smithi138.front.sepia.ceph.com'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:28:27.388 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-14T11:28:29.603 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'smithi138.front.sepia.ceph.com'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:28:29.603 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-14T11:28:32.034 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'smithi138.front.sepia.ceph.com'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:28:32.034 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-14T11:28:34.496 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'smithi138.front.sepia.ceph.com'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:28:34.496 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-14T11:28:36.768 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'smithi138.front.sepia.ceph.com'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:28:36.769 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-14T11:28:39.026 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'smithi138.front.sepia.ceph.com'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:28:39.026 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-14T11:28:41.479 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'smithi138.front.sepia.ceph.com'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:28:41.480 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-14T11:28:43.825 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'smithi138.front.sepia.ceph.com'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:28:43.825 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-14T11:28:46.227 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'smithi138.front.sepia.ceph.com'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:28:46.227 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-14T11:28:48.584 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'smithi138.front.sepia.ceph.com'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:28:48.585 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-14T11:28:51.019 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'smithi138.front.sepia.ceph.com'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:28:51.019 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-14T11:28:53.343 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'smithi138.front.sepia.ceph.com'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:28:53.343 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-14T11:28:55.742 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'smithi138.front.sepia.ceph.com'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:28:55.742 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-14T11:28:58.137 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'smithi138.front.sepia.ceph.com'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:28:58.137 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-14T11:28:58.352 INFO:tasks.workunit.client.0.smithi138.stdout:bucket nams is reupload-bkt-110007 2024-09-14T11:28:58.352 INFO:tasks.workunit.client.0.smithi138.stdout:endpoint is https://smithi138.front.sepia.ceph.com:443 2024-09-14T11:28:58.353 INFO:tasks.workunit.client.0.smithi138.stdout:start UploadId=2~C20pVWScQCkXOXoHdjutQc-uJvVed0v 2024-09-14T11:28:58.353 INFO:tasks.workunit.client.0.smithi138.stdout:phase 1 uploaded part {'ETag': '"a4acc15cc102aece11932bd2046875e1"', 'PartNumber': 1} 2024-09-14T11:28:58.353 INFO:tasks.workunit.client.0.smithi138.stdout:phase 1 uploaded part {'ETag': '"a4acc15cc102aece11932bd2046875e1"', 'PartNumber': 2} 2024-09-14T11:28:58.353 INFO:tasks.workunit.client.0.smithi138.stdout:phase 2 uploaded part {'ETag': '"a4acc15cc102aece11932bd2046875e1"', 'PartNumber': 1} 2024-09-14T11:28:58.353 INFO:tasks.workunit.client.0.smithi138.stdout:phase 2 uploaded part {'ETag': '"a4acc15cc102aece11932bd2046875e1"', 'PartNumber': 1} 2024-09-14T11:28:58.353 INFO:tasks.workunit.client.0.smithi138.stdout:phase 2 uploaded part {'ETag': '"a4acc15cc102aece11932bd2046875e1"', 'PartNumber': 1} 2024-09-14T11:28:58.353 INFO:tasks.workunit.client.0.smithi138.stdout:phase 2 uploaded part {'ETag': '"a4acc15cc102aece11932bd2046875e1"', 'PartNumber': 1} 2024-09-14T11:28:58.353 INFO:tasks.workunit.client.0.smithi138.stdout:phase 2 uploaded part {'ETag': '"a4acc15cc102aece11932bd2046875e1"', 'PartNumber': 1} 2024-09-14T11:28:58.353 INFO:tasks.workunit.client.0.smithi138.stdout:phase 2 uploaded part {'ETag': '"a4acc15cc102aece11932bd2046875e1"', 'PartNumber': 1} 2024-09-14T11:28:58.353 INFO:tasks.workunit.client.0.smithi138.stdout:phase 2 uploaded part {'ETag': '"a4acc15cc102aece11932bd2046875e1"', 'PartNumber': 1} 2024-09-14T11:28:58.353 INFO:tasks.workunit.client.0.smithi138.stdout:phase 2 uploaded part {'ETag': '"a4acc15cc102aece11932bd2046875e1"', 'PartNumber': 1} 2024-09-14T11:28:58.353 INFO:tasks.workunit.client.0.smithi138.stdout:phase 2 uploaded part {'ETag': '"a4acc15cc102aece11932bd2046875e1"', 'PartNumber': 1} 2024-09-14T11:28:58.353 INFO:tasks.workunit.client.0.smithi138.stdout:phase 2 uploaded part {'ETag': '"a4acc15cc102aece11932bd2046875e1"', 'PartNumber': 1} 2024-09-14T11:28:58.353 INFO:tasks.workunit.client.0.smithi138.stdout:phase 2 uploaded part {'ETag': '"a4acc15cc102aece11932bd2046875e1"', 'PartNumber': 1} 2024-09-14T11:28:58.353 INFO:tasks.workunit.client.0.smithi138.stdout:aborting multipart upload, parts=[{'ETag': '"a4acc15cc102aece11932bd2046875e1"', 'PartNumber': 1}, {'ETag': '"a4acc15cc102aece11932bd2046875e1"', 'PartNumber': 2}] 2024-09-14T11:29:00.467 INFO:tasks.workunit.client.0.smithi138.stdout:radosgw-admin bucket radoslist: 2024-09-14T11:29:00.553 INFO:tasks.workunit.client.0.smithi138.stdout:rados ls: 2024-09-14T11:29:00.565 INFO:tasks.workunit.client.0.smithi138.stdout:== PASSED == 2024-09-14T11:29:00.565 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-09-14T11:29:00.566 DEBUG:teuthology.orchestra.run.smithi138:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-09-14T11:29:00.618 INFO:tasks.workunit:Stopping ['rgw/test_rgw_s3_mp_reupload.sh'] on client.0... 2024-09-14T11:29:00.618 DEBUG:teuthology.orchestra.run.smithi138:> sudo rm -rf -- /home/ubuntu/cephtest/workunits.list.client.0 /home/ubuntu/cephtest/clone.client.0 2024-09-14T11:29:01.068 DEBUG:teuthology.parallel:result is None 2024-09-14T11:29:01.068 DEBUG:teuthology.orchestra.run.smithi138:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0 2024-09-14T11:29:01.081 INFO:tasks.workunit:Deleted dir /home/ubuntu/cephtest/mnt.0/client.0 2024-09-14T11:29:01.081 DEBUG:teuthology.orchestra.run.smithi138:> rmdir -- /home/ubuntu/cephtest/mnt.0 2024-09-14T11:29:01.128 INFO:tasks.workunit:Deleted artificial mount point /home/ubuntu/cephtest/mnt.0/client.0 2024-09-14T11:29:01.128 INFO:teuthology.run_tasks:Running task ragweed... 2024-09-14T11:29:01.142 DEBUG:tasks.ragweed:ragweed config is {'client.0': {'default-branch': 'ceph-master', 'rgw_server': 'client.0', 'stages': 'prepare,check'}} 2024-09-14T11:29:01.143 INFO:tasks.ragweed:Downloading ragweed... 2024-09-14T11:29:01.143 INFO:tasks.ragweed:Using branch 'main' for ragweed 2024-09-14T11:29:01.143 DEBUG:teuthology.orchestra.run.smithi138:> git clone -b main https://git.ceph.com/ragweed.git /home/ubuntu/cephtest/ragweed.client.0 2024-09-14T11:29:01.176 INFO:teuthology.orchestra.run.smithi138.stderr:Cloning into '/home/ubuntu/cephtest/ragweed.client.0'... 2024-09-14T11:29:01.229 INFO:teuthology.orchestra.run.smithi138.stderr:fatal: Remote branch main not found in upstream origin 2024-09-14T11:29:01.230 DEBUG:teuthology.orchestra.run:got remote process result: 128 2024-09-14T11:29:01.231 INFO:tasks.ragweed:Using branch 'ceph-master' for ragweed 2024-09-14T11:29:01.232 DEBUG:teuthology.orchestra.run.smithi138:> git clone -b ceph-master https://git.ceph.com/ragweed.git /home/ubuntu/cephtest/ragweed.client.0 2024-09-14T11:29:01.280 INFO:teuthology.orchestra.run.smithi138.stderr:Cloning into '/home/ubuntu/cephtest/ragweed.client.0'... 2024-09-14T11:29:01.464 INFO:tasks.ragweed:Creating rgw users... 2024-09-14T11:29:01.464 DEBUG:tasks.ragweed:Creating user ragweed.client.0 on client.0 2024-09-14T11:29:01.465 DEBUG:teuthology.orchestra.run.smithi138:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 user create --uid ragweed.client.0 --display-name 'Mr. ragweed.client.0' --access-key CRAKLKDJXWHCXCUXWDHO --secret fw0X0ho+9dfllK6zo72T6lJ2J9qw9zteMgJJgWJzM0uK7ajlELud8w== --email ragweed.client.0+test@test.test --system false 2024-09-14T11:29:01.554 INFO:teuthology.orchestra.run.smithi138.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:29:01.554 INFO:teuthology.orchestra.run.smithi138.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:29:01.807 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:29:01.810+0000 7f58fb8aa9c0 20 rados->read ofs=0 len=0 2024-09-14T11:29:01.809 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:29:01.814+0000 7f58fb8aa9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:29:01.810 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:29:01.814+0000 7f58fb8aa9c0 20 realm 2024-09-14T11:29:01.810 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:29:01.814+0000 7f58fb8aa9c0 20 rados->read ofs=0 len=0 2024-09-14T11:29:01.810 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:29:01.814+0000 7f58fb8aa9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:29:01.810 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:29:01.814+0000 7f58fb8aa9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:29:01.810 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:29:01.814+0000 7f58fb8aa9c0 20 rados->read ofs=0 len=0 2024-09-14T11:29:01.810 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:29:01.814+0000 7f58fb8aa9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:29:01.810 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:29:01.814+0000 7f58fb8aa9c0 20 rados->read ofs=0 len=0 2024-09-14T11:29:01.812 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:29:01.814+0000 7f58fb8aa9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:29:01.812 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:29:01.814+0000 7f58fb8aa9c0 20 rados->read ofs=0 len=0 2024-09-14T11:29:01.813 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:29:01.818+0000 7f58fb8aa9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:29:01.813 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:29:01.818+0000 7f58fb8aa9c0 20 searching for the correct realm 2024-09-14T11:29:01.814 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:29:01.818+0000 7f58f8baf640 0 -- 172.21.15.138:0/2796545477 >> [v2:172.21.15.154:6808/1468088432,v1:172.21.15.154:6809/1468088432] conn(0x7f58ec04c040 msgr2=0x7f58ec04c4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:29:02.028 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:29:02.034+0000 7f58f9bb1640 0 -- 172.21.15.138:0/2796545477 >> [v2:172.21.15.138:6824/2633984942,v1:172.21.15.138:6825/2633984942] conn(0x5633e6e90360 msgr2=0x5633e6e92770 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:29:02.046 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:29:02.050+0000 7f58fb8aa9c0 20 RGWRados::pool_iterate: got zone_info.d9e72d30-c60b-4d0d-9267-fdc36392d5ad 2024-09-14T11:29:02.046 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:29:02.050+0000 7f58fb8aa9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:29:02.046 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:29:02.050+0000 7f58fb8aa9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:29:02.046 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:29:02.050+0000 7f58fb8aa9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:29:02.046 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:29:02.050+0000 7f58fb8aa9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:29:02.046 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:29:02.050+0000 7f58fb8aa9c0 20 RGWRados::pool_iterate: got zonegroup_info.65ab941b-da8c-4160-94fb-3672b069d44f 2024-09-14T11:29:02.046 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:29:02.050+0000 7f58fb8aa9c0 20 rados->read ofs=0 len=0 2024-09-14T11:29:02.047 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:29:02.050+0000 7f58fb8aa9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:29:02.047 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:29:02.050+0000 7f58fb8aa9c0 20 rados->read ofs=0 len=0 2024-09-14T11:29:02.048 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:29:02.050+0000 7f58fb8aa9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:29:02.048 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:29:02.050+0000 7f58fb8aa9c0 20 rados->read ofs=0 len=0 2024-09-14T11:29:02.049 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:29:02.054+0000 7f58fb8aa9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:29:02.049 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:29:02.054+0000 7f58fb8aa9c0 20 zone default found 2024-09-14T11:29:02.049 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:29:02.054+0000 7f58fb8aa9c0 4 Realm: () 2024-09-14T11:29:02.049 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:29:02.054+0000 7f58fb8aa9c0 4 ZoneGroup: default (65ab941b-da8c-4160-94fb-3672b069d44f) 2024-09-14T11:29:02.049 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:29:02.054+0000 7f58fb8aa9c0 4 Zone: default (d9e72d30-c60b-4d0d-9267-fdc36392d5ad) 2024-09-14T11:29:02.049 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:29:02.054+0000 7f58fb8aa9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:29:02.050 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:29:02.054+0000 7f58fb8aa9c0 20 zonegroup default 2024-09-14T11:29:02.050 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:29:02.054+0000 7f58fb8aa9c0 20 rados->read ofs=0 len=0 2024-09-14T11:29:02.050 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:29:02.054+0000 7f58fb8aa9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:29:02.050 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:29:02.054+0000 7f58fb8aa9c0 20 rados->read ofs=0 len=0 2024-09-14T11:29:02.050 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:29:02.054+0000 7f58fb8aa9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:29:02.050 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:29:02.054+0000 7f58fb8aa9c0 20 rados->read ofs=0 len=0 2024-09-14T11:29:02.051 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:29:02.054+0000 7f58fb8aa9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:29:02.051 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:29:02.054+0000 7f58fb8aa9c0 20 started sync module instance, tier type = 2024-09-14T11:29:02.051 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:29:02.054+0000 7f58fb8aa9c0 20 started zone id=d9e72d30-c60b-4d0d-9267-fdc36392d5ad (name=default) with tier type = 2024-09-14T11:29:02.074 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:29:02.078+0000 7f58fb8aa9c0 20 add_watcher() i=0 2024-09-14T11:29:02.074 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:29:02.078+0000 7f58fb8aa9c0 20 add_watcher() i=1 2024-09-14T11:29:02.074 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:29:02.078+0000 7f58fb8aa9c0 20 add_watcher() i=2 2024-09-14T11:29:02.074 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:29:02.078+0000 7f58fb8aa9c0 20 add_watcher() i=3 2024-09-14T11:29:02.074 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:29:02.078+0000 7f58fb8aa9c0 20 add_watcher() i=4 2024-09-14T11:29:02.074 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:29:02.078+0000 7f58fb8aa9c0 20 add_watcher() i=5 2024-09-14T11:29:02.074 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:29:02.078+0000 7f58fb8aa9c0 20 add_watcher() i=6 2024-09-14T11:29:02.076 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:29:02.082+0000 7f58fb8aa9c0 20 add_watcher() i=7 2024-09-14T11:29:02.077 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:29:02.082+0000 7f58fb8aa9c0 2 all 8 watchers are set, enabling cache 2024-09-14T11:29:02.081 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:29:02.086+0000 7f57af7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:29:02.081 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:29:02.086+0000 7f58fb8aa9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:29:02.081 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:29:02.086+0000 7f58fb8aa9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:29:02.081 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:29:02.086+0000 7f58fb8aa9c0 5 note: GC not initialized 2024-09-14T11:29:02.082 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:29:02.086+0000 7f57ae7e4640 20 reqs_thread_entry: start 2024-09-14T11:29:02.082 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:29:02.086+0000 7f58fb8aa9c0 20 init_complete bucket index max shards: 11 2024-09-14T11:29:02.083 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:29:02.086+0000 7f58fb8aa9c0 20 Filter name: none 2024-09-14T11:29:02.083 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:29:02.086+0000 7f571ffff640 20 reqs_thread_entry: start 2024-09-14T11:29:02.083 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:29:02.086+0000 7f58fb8aa9c0 10 cache get: name=default.rgw.meta+users.uid+ragweed.client.0 : miss 2024-09-14T11:29:02.083 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:29:02.086+0000 7f58fb8aa9c0 20 rados->read ofs=0 len=0 2024-09-14T11:29:02.084 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:29:02.086+0000 7f58fb8aa9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:29:02.084 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:29:02.086+0000 7f58fb8aa9c0 10 cache put: name=default.rgw.meta+users.uid+ragweed.client.0 info.flags=0x0 2024-09-14T11:29:02.084 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:29:02.086+0000 7f58fb8aa9c0 10 adding default.rgw.meta+users.uid+ragweed.client.0 to cache LRU end 2024-09-14T11:29:02.084 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:29:02.086+0000 7f58fb8aa9c0 10 cache get: name=default.rgw.meta+users.email+ragweed.client.0+test@test.test : miss 2024-09-14T11:29:02.084 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:29:02.086+0000 7f58fb8aa9c0 20 rados->read ofs=0 len=0 2024-09-14T11:29:02.085 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:29:02.090+0000 7f58fb8aa9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:29:02.085 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:29:02.090+0000 7f58fb8aa9c0 10 cache put: name=default.rgw.meta+users.email+ragweed.client.0+test@test.test info.flags=0x0 2024-09-14T11:29:02.085 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:29:02.090+0000 7f58fb8aa9c0 10 adding default.rgw.meta+users.email+ragweed.client.0+test@test.test to cache LRU end 2024-09-14T11:29:02.085 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:29:02.090+0000 7f58fb8aa9c0 10 cache get: name=default.rgw.meta+users.keys+CRAKLKDJXWHCXCUXWDHO : miss 2024-09-14T11:29:02.085 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:29:02.090+0000 7f58fb8aa9c0 20 rados->read ofs=0 len=0 2024-09-14T11:29:02.086 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:29:02.090+0000 7f58fb8aa9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:29:02.086 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:29:02.090+0000 7f58fb8aa9c0 10 cache put: name=default.rgw.meta+users.keys+CRAKLKDJXWHCXCUXWDHO info.flags=0x0 2024-09-14T11:29:02.086 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:29:02.090+0000 7f58fb8aa9c0 10 adding default.rgw.meta+users.keys+CRAKLKDJXWHCXCUXWDHO to cache LRU end 2024-09-14T11:29:02.086 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:29:02.090+0000 7f58fb8aa9c0 10 cache get: name=default.rgw.meta+users.keys+CRAKLKDJXWHCXCUXWDHO : hit (negative entry) 2024-09-14T11:29:02.086 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:29:02.090+0000 7f58fb8aa9c0 10 cache get: name=default.rgw.meta+users.keys+CRAKLKDJXWHCXCUXWDHO : hit (negative entry) 2024-09-14T11:29:02.088 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:29:02.094+0000 7f58fb8aa9c0 10 cache put: name=default.rgw.meta+users.uid+ragweed.client.0 info.flags=0x17 2024-09-14T11:29:02.089 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:29:02.094+0000 7f58fb8aa9c0 10 moving default.rgw.meta+users.uid+ragweed.client.0 to cache LRU end 2024-09-14T11:29:02.089 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:29:02.094+0000 7f58fb8aa9c0 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.uid:ragweed.client.0, ofs0, ns] 2024-09-14T11:29:02.089 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:29:02.094+0000 7f57dcff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1099511627798 cookie 94780917388368 notifier 5826 bl.length()=675 2024-09-14T11:29:02.089 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:29:02.094+0000 7f57dcff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+ragweed.client.0 info.flags=0x17 2024-09-14T11:29:02.089 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:29:02.094+0000 7f57dcff9640 10 rgw watcher librados: moving default.rgw.meta+users.uid+ragweed.client.0 to cache LRU end 2024-09-14T11:29:02.095 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:29:02.098+0000 7f58fb8aa9c0 10 cache put: name=default.rgw.meta+users.email+ragweed.client.0+test@test.test info.flags=0x7 2024-09-14T11:29:02.095 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:29:02.098+0000 7f58fb8aa9c0 10 moving default.rgw.meta+users.email+ragweed.client.0+test@test.test to cache LRU end 2024-09-14T11:29:02.095 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:29:02.098+0000 7f58fb8aa9c0 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:users.email:ragweed.client.0+test@test.test, ofs0, ns] 2024-09-14T11:29:02.095 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:29:02.098+0000 7f57dcff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1099511627785 cookie 94780917387312 notifier 5826 bl.length()=202 2024-09-14T11:29:02.095 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:29:02.098+0000 7f57dcff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.email+ragweed.client.0+test@test.test info.flags=0x7 2024-09-14T11:29:02.096 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:29:02.098+0000 7f57dcff9640 10 rgw watcher librados: moving default.rgw.meta+users.email+ragweed.client.0+test@test.test to cache LRU end 2024-09-14T11:29:02.100 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:29:02.106+0000 7f58fb8aa9c0 10 cache put: name=default.rgw.meta+users.keys+CRAKLKDJXWHCXCUXWDHO info.flags=0x7 2024-09-14T11:29:02.100 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:29:02.106+0000 7f58fb8aa9c0 10 moving default.rgw.meta+users.keys+CRAKLKDJXWHCXCUXWDHO to cache LRU end 2024-09-14T11:29:02.100 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:29:02.106+0000 7f58fb8aa9c0 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:users.keys:CRAKLKDJXWHCXCUXWDHO, ofs0, ns] 2024-09-14T11:29:02.101 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:29:02.106+0000 7f57dcff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1099511627786 cookie 94780917387312 notifier 5826 bl.length()=190 2024-09-14T11:29:02.101 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:29:02.106+0000 7f57dcff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.keys+CRAKLKDJXWHCXCUXWDHO info.flags=0x7 2024-09-14T11:29:02.101 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:29:02.106+0000 7f57dcff9640 10 rgw watcher librados: moving default.rgw.meta+users.keys+CRAKLKDJXWHCXCUXWDHO to cache LRU end 2024-09-14T11:29:02.103 INFO:teuthology.orchestra.run.smithi138.stdout:{ 2024-09-14T11:29:02.103 INFO:teuthology.orchestra.run.smithi138.stdout: "user_id": "ragweed.client.0", 2024-09-14T11:29:02.103 INFO:teuthology.orchestra.run.smithi138.stdout: "display_name": "Mr. ragweed.client.0", 2024-09-14T11:29:02.103 INFO:teuthology.orchestra.run.smithi138.stdout: "email": "ragweed.client.0+test@test.test", 2024-09-14T11:29:02.103 INFO:teuthology.orchestra.run.smithi138.stdout: "suspended": 0, 2024-09-14T11:29:02.103 INFO:teuthology.orchestra.run.smithi138.stdout: "max_buckets": 1000, 2024-09-14T11:29:02.103 INFO:teuthology.orchestra.run.smithi138.stdout: "subusers": [], 2024-09-14T11:29:02.103 INFO:teuthology.orchestra.run.smithi138.stdout: "keys": [ 2024-09-14T11:29:02.104 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-09-14T11:29:02.104 INFO:teuthology.orchestra.run.smithi138.stdout: "user": "ragweed.client.0", 2024-09-14T11:29:02.104 INFO:teuthology.orchestra.run.smithi138.stdout: "access_key": "CRAKLKDJXWHCXCUXWDHO", 2024-09-14T11:29:02.104 INFO:teuthology.orchestra.run.smithi138.stdout: "secret_key": "fw0X0ho+9dfllK6zo72T6lJ2J9qw9zteMgJJgWJzM0uK7ajlELud8w==", 2024-09-14T11:29:02.104 INFO:teuthology.orchestra.run.smithi138.stdout: "active": true, 2024-09-14T11:29:02.104 INFO:teuthology.orchestra.run.smithi138.stdout: "create_date": "2024-09-14T11:29:02.094357Z" 2024-09-14T11:29:02.104 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-09-14T11:29:02.104 INFO:teuthology.orchestra.run.smithi138.stdout: ], 2024-09-14T11:29:02.104 INFO:teuthology.orchestra.run.smithi138.stdout: "swift_keys": [], 2024-09-14T11:29:02.104 INFO:teuthology.orchestra.run.smithi138.stdout: "caps": [], 2024-09-14T11:29:02.104 INFO:teuthology.orchestra.run.smithi138.stdout: "op_mask": "read, write, delete", 2024-09-14T11:29:02.104 INFO:teuthology.orchestra.run.smithi138.stdout: "default_placement": "", 2024-09-14T11:29:02.105 INFO:teuthology.orchestra.run.smithi138.stdout: "default_storage_class": "", 2024-09-14T11:29:02.105 INFO:teuthology.orchestra.run.smithi138.stdout: "placement_tags": [], 2024-09-14T11:29:02.105 INFO:teuthology.orchestra.run.smithi138.stdout: "bucket_quota": { 2024-09-14T11:29:02.105 INFO:teuthology.orchestra.run.smithi138.stdout: "enabled": false, 2024-09-14T11:29:02.105 INFO:teuthology.orchestra.run.smithi138.stdout: "check_on_raw": false, 2024-09-14T11:29:02.105 INFO:teuthology.orchestra.run.smithi138.stdout: "max_size": -1, 2024-09-14T11:29:02.105 INFO:teuthology.orchestra.run.smithi138.stdout: "max_size_kb": 0, 2024-09-14T11:29:02.105 INFO:teuthology.orchestra.run.smithi138.stdout: "max_objects": -1 2024-09-14T11:29:02.105 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-09-14T11:29:02.105 INFO:teuthology.orchestra.run.smithi138.stdout: "user_quota": { 2024-09-14T11:29:02.105 INFO:teuthology.orchestra.run.smithi138.stdout: "enabled": false, 2024-09-14T11:29:02.105 INFO:teuthology.orchestra.run.smithi138.stdout: "check_on_raw": false, 2024-09-14T11:29:02.105 INFO:teuthology.orchestra.run.smithi138.stdout: "max_size": -1, 2024-09-14T11:29:02.105 INFO:teuthology.orchestra.run.smithi138.stdout: "max_size_kb": 0, 2024-09-14T11:29:02.106 INFO:teuthology.orchestra.run.smithi138.stdout: "max_objects": -1 2024-09-14T11:29:02.106 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-09-14T11:29:02.106 INFO:teuthology.orchestra.run.smithi138.stdout: "temp_url_keys": [], 2024-09-14T11:29:02.106 INFO:teuthology.orchestra.run.smithi138.stdout: "type": "rgw", 2024-09-14T11:29:02.106 INFO:teuthology.orchestra.run.smithi138.stdout: "mfa_ids": [], 2024-09-14T11:29:02.106 INFO:teuthology.orchestra.run.smithi138.stdout: "account_id": "", 2024-09-14T11:29:02.106 INFO:teuthology.orchestra.run.smithi138.stdout: "path": "/", 2024-09-14T11:29:02.106 INFO:teuthology.orchestra.run.smithi138.stdout: "create_date": "2024-09-14T11:29:02.094301Z", 2024-09-14T11:29:02.106 INFO:teuthology.orchestra.run.smithi138.stdout: "tags": [], 2024-09-14T11:29:02.106 INFO:teuthology.orchestra.run.smithi138.stdout: "group_ids": [] 2024-09-14T11:29:02.106 INFO:teuthology.orchestra.run.smithi138.stdout:} 2024-09-14T11:29:02.106 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-09-14T11:29:02.107 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:29:02.110+0000 7f57af7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:29:02.110 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:29:02.114+0000 7f58fb8aa9c0 20 remove_watcher() i=0 2024-09-14T11:29:02.110 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:29:02.114+0000 7f58fb8aa9c0 2 removed watcher, disabling cache 2024-09-14T11:29:02.112 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:29:02.118+0000 7f58fb8aa9c0 20 remove_watcher() i=1 2024-09-14T11:29:02.115 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:29:02.118+0000 7f58fb8aa9c0 20 remove_watcher() i=2 2024-09-14T11:29:02.117 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:29:02.122+0000 7f58fb8aa9c0 20 remove_watcher() i=3 2024-09-14T11:29:02.119 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:29:02.122+0000 7f58fb8aa9c0 20 remove_watcher() i=4 2024-09-14T11:29:02.121 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:29:02.126+0000 7f58fb8aa9c0 20 remove_watcher() i=5 2024-09-14T11:29:02.122 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:29:02.126+0000 7f58fb8aa9c0 20 remove_watcher() i=6 2024-09-14T11:29:02.124 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:29:02.130+0000 7f58fb8aa9c0 20 remove_watcher() i=7 2024-09-14T11:29:02.141 DEBUG:tasks.ragweed:Creating user sysuser.client.0 on client.0 2024-09-14T11:29:02.141 DEBUG:teuthology.orchestra.run.smithi138:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 user create --uid sysuser.client.0 --display-name 'Mr. sysuser.client.0' --access-key JEMMYZYQUNNOMBGMSWMH --secret EK4RTlZnQFkr8igPfsvE2joRBndVVFqAmsgZFOA6tV0Vhe57r/HUiQ== --email sysuser.client.0+test@test.test --system true 2024-09-14T11:29:02.183 INFO:teuthology.orchestra.run.smithi138.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:29:02.184 INFO:teuthology.orchestra.run.smithi138.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:29:02.225 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:29:02.230+0000 7fbae44bc9c0 20 rados->read ofs=0 len=0 2024-09-14T11:29:02.227 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:29:02.230+0000 7fbae44bc9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:29:02.227 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:29:02.230+0000 7fbae44bc9c0 20 realm 2024-09-14T11:29:02.227 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:29:02.230+0000 7fbae44bc9c0 20 rados->read ofs=0 len=0 2024-09-14T11:29:02.227 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:29:02.230+0000 7fbae44bc9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:29:02.227 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:29:02.230+0000 7fbae44bc9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:29:02.227 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:29:02.230+0000 7fbae44bc9c0 20 rados->read ofs=0 len=0 2024-09-14T11:29:02.227 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:29:02.230+0000 7fbae44bc9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:29:02.227 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:29:02.230+0000 7fbae44bc9c0 20 rados->read ofs=0 len=0 2024-09-14T11:29:02.229 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:29:02.234+0000 7fbae44bc9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:29:02.229 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:29:02.234+0000 7fbae44bc9c0 20 rados->read ofs=0 len=0 2024-09-14T11:29:02.230 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:29:02.234+0000 7fbae44bc9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:29:02.230 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:29:02.234+0000 7fbae44bc9c0 20 searching for the correct realm 2024-09-14T11:29:02.231 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:29:02.234+0000 7fbae17c1640 0 -- 172.21.15.138:0/1460173765 >> [v2:172.21.15.154:6808/1468088432,v1:172.21.15.154:6809/1468088432] conn(0x7fbad4101300 msgr2=0x7fbad40f6ad0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-14T11:29:02.444 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:29:02.446+0000 7fbae27c3640 0 -- 172.21.15.138:0/1460173765 >> [v2:172.21.15.138:6824/2633984942,v1:172.21.15.138:6825/2633984942] conn(0x556645689cc0 msgr2=0x55664568c0b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:29:02.461 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:29:02.466+0000 7fbae44bc9c0 20 RGWRados::pool_iterate: got zone_info.d9e72d30-c60b-4d0d-9267-fdc36392d5ad 2024-09-14T11:29:02.461 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:29:02.466+0000 7fbae44bc9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:29:02.461 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:29:02.466+0000 7fbae44bc9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:29:02.461 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:29:02.466+0000 7fbae44bc9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:29:02.461 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:29:02.466+0000 7fbae44bc9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:29:02.461 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:29:02.466+0000 7fbae44bc9c0 20 RGWRados::pool_iterate: got zonegroup_info.65ab941b-da8c-4160-94fb-3672b069d44f 2024-09-14T11:29:02.461 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:29:02.466+0000 7fbae44bc9c0 20 rados->read ofs=0 len=0 2024-09-14T11:29:02.461 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:29:02.466+0000 7fbae44bc9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:29:02.462 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:29:02.466+0000 7fbae44bc9c0 20 rados->read ofs=0 len=0 2024-09-14T11:29:02.462 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:29:02.466+0000 7fbae44bc9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:29:02.462 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:29:02.466+0000 7fbae44bc9c0 20 rados->read ofs=0 len=0 2024-09-14T11:29:02.463 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:29:02.466+0000 7fbae44bc9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:29:02.463 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:29:02.466+0000 7fbae44bc9c0 20 zone default found 2024-09-14T11:29:02.463 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:29:02.466+0000 7fbae44bc9c0 4 Realm: () 2024-09-14T11:29:02.463 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:29:02.466+0000 7fbae44bc9c0 4 ZoneGroup: default (65ab941b-da8c-4160-94fb-3672b069d44f) 2024-09-14T11:29:02.463 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:29:02.466+0000 7fbae44bc9c0 4 Zone: default (d9e72d30-c60b-4d0d-9267-fdc36392d5ad) 2024-09-14T11:29:02.463 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:29:02.466+0000 7fbae44bc9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:29:02.463 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:29:02.466+0000 7fbae44bc9c0 20 zonegroup default 2024-09-14T11:29:02.463 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:29:02.466+0000 7fbae44bc9c0 20 rados->read ofs=0 len=0 2024-09-14T11:29:02.464 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:29:02.466+0000 7fbae44bc9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:29:02.464 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:29:02.466+0000 7fbae44bc9c0 20 rados->read ofs=0 len=0 2024-09-14T11:29:02.464 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:29:02.470+0000 7fbae44bc9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:29:02.464 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:29:02.470+0000 7fbae44bc9c0 20 rados->read ofs=0 len=0 2024-09-14T11:29:02.465 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:29:02.470+0000 7fbae44bc9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:29:02.465 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:29:02.470+0000 7fbae44bc9c0 20 started sync module instance, tier type = 2024-09-14T11:29:02.465 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:29:02.470+0000 7fbae44bc9c0 20 started zone id=d9e72d30-c60b-4d0d-9267-fdc36392d5ad (name=default) with tier type = 2024-09-14T11:29:02.487 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:29:02.490+0000 7fbae44bc9c0 20 add_watcher() i=0 2024-09-14T11:29:02.487 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:29:02.490+0000 7fbae44bc9c0 20 add_watcher() i=1 2024-09-14T11:29:02.487 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:29:02.490+0000 7fbae44bc9c0 20 add_watcher() i=2 2024-09-14T11:29:02.487 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:29:02.490+0000 7fbae44bc9c0 20 add_watcher() i=3 2024-09-14T11:29:02.488 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:29:02.490+0000 7fbae44bc9c0 20 add_watcher() i=4 2024-09-14T11:29:02.488 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:29:02.490+0000 7fbae44bc9c0 20 add_watcher() i=5 2024-09-14T11:29:02.488 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:29:02.490+0000 7fbae44bc9c0 20 add_watcher() i=6 2024-09-14T11:29:02.489 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:29:02.494+0000 7fbae44bc9c0 20 add_watcher() i=7 2024-09-14T11:29:02.489 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:29:02.494+0000 7fbae44bc9c0 2 all 8 watchers are set, enabling cache 2024-09-14T11:29:02.494 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:29:02.498+0000 7fb9937fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:29:02.494 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:29:02.498+0000 7fbae44bc9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:29:02.494 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:29:02.498+0000 7fbae44bc9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:29:02.494 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:29:02.498+0000 7fbae44bc9c0 5 note: GC not initialized 2024-09-14T11:29:02.495 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:29:02.498+0000 7fb9927fc640 20 reqs_thread_entry: start 2024-09-14T11:29:02.495 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:29:02.498+0000 7fbae44bc9c0 20 init_complete bucket index max shards: 11 2024-09-14T11:29:02.495 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:29:02.498+0000 7fbae44bc9c0 20 Filter name: none 2024-09-14T11:29:02.496 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:29:02.498+0000 7fb903fff640 20 reqs_thread_entry: start 2024-09-14T11:29:02.496 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:29:02.498+0000 7fbae44bc9c0 10 cache get: name=default.rgw.meta+users.uid+sysuser.client.0 : miss 2024-09-14T11:29:02.496 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:29:02.498+0000 7fbae44bc9c0 20 rados->read ofs=0 len=0 2024-09-14T11:29:02.497 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:29:02.502+0000 7fbae44bc9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:29:02.497 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:29:02.502+0000 7fbae44bc9c0 10 cache put: name=default.rgw.meta+users.uid+sysuser.client.0 info.flags=0x0 2024-09-14T11:29:02.497 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:29:02.502+0000 7fbae44bc9c0 10 adding default.rgw.meta+users.uid+sysuser.client.0 to cache LRU end 2024-09-14T11:29:02.497 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:29:02.502+0000 7fbae44bc9c0 10 cache get: name=default.rgw.meta+users.email+sysuser.client.0+test@test.test : miss 2024-09-14T11:29:02.497 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:29:02.502+0000 7fbae44bc9c0 20 rados->read ofs=0 len=0 2024-09-14T11:29:02.497 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:29:02.502+0000 7fbae44bc9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:29:02.497 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:29:02.502+0000 7fbae44bc9c0 10 cache put: name=default.rgw.meta+users.email+sysuser.client.0+test@test.test info.flags=0x0 2024-09-14T11:29:02.497 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:29:02.502+0000 7fbae44bc9c0 10 adding default.rgw.meta+users.email+sysuser.client.0+test@test.test to cache LRU end 2024-09-14T11:29:02.497 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:29:02.502+0000 7fbae44bc9c0 10 cache get: name=default.rgw.meta+users.keys+JEMMYZYQUNNOMBGMSWMH : miss 2024-09-14T11:29:02.497 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:29:02.502+0000 7fbae44bc9c0 20 rados->read ofs=0 len=0 2024-09-14T11:29:02.498 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:29:02.502+0000 7fbae44bc9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:29:02.498 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:29:02.502+0000 7fbae44bc9c0 10 cache put: name=default.rgw.meta+users.keys+JEMMYZYQUNNOMBGMSWMH info.flags=0x0 2024-09-14T11:29:02.498 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:29:02.502+0000 7fbae44bc9c0 10 adding default.rgw.meta+users.keys+JEMMYZYQUNNOMBGMSWMH to cache LRU end 2024-09-14T11:29:02.498 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:29:02.502+0000 7fbae44bc9c0 10 cache get: name=default.rgw.meta+users.keys+JEMMYZYQUNNOMBGMSWMH : hit (negative entry) 2024-09-14T11:29:02.498 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:29:02.502+0000 7fbae44bc9c0 10 cache get: name=default.rgw.meta+users.keys+JEMMYZYQUNNOMBGMSWMH : hit (negative entry) 2024-09-14T11:29:02.500 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:29:02.506+0000 7fbae44bc9c0 10 cache put: name=default.rgw.meta+users.uid+sysuser.client.0 info.flags=0x17 2024-09-14T11:29:02.500 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:29:02.506+0000 7fbae44bc9c0 10 moving default.rgw.meta+users.uid+sysuser.client.0 to cache LRU end 2024-09-14T11:29:02.500 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:29:02.506+0000 7fbae44bc9c0 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:users.uid:sysuser.client.0, ofs0, ns] 2024-09-14T11:29:02.501 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:29:02.506+0000 7fb9c4ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1099511627787 cookie 93897739513488 notifier 5844 bl.length()=675 2024-09-14T11:29:02.501 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:29:02.506+0000 7fb9c4ff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+sysuser.client.0 info.flags=0x17 2024-09-14T11:29:02.501 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:29:02.506+0000 7fb9c4ff9640 10 rgw watcher librados: moving default.rgw.meta+users.uid+sysuser.client.0 to cache LRU end 2024-09-14T11:29:02.506 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:29:02.510+0000 7fbae44bc9c0 10 cache put: name=default.rgw.meta+users.email+sysuser.client.0+test@test.test info.flags=0x7 2024-09-14T11:29:02.506 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:29:02.510+0000 7fbae44bc9c0 10 moving default.rgw.meta+users.email+sysuser.client.0+test@test.test to cache LRU end 2024-09-14T11:29:02.506 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:29:02.510+0000 7fbae44bc9c0 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.email:sysuser.client.0+test@test.test, ofs0, ns] 2024-09-14T11:29:02.507 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:29:02.510+0000 7fb9c4ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1099511627799 cookie 93897739551136 notifier 5844 bl.length()=202 2024-09-14T11:29:02.507 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:29:02.510+0000 7fb9c4ff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.email+sysuser.client.0+test@test.test info.flags=0x7 2024-09-14T11:29:02.507 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:29:02.510+0000 7fb9c4ff9640 10 rgw watcher librados: moving default.rgw.meta+users.email+sysuser.client.0+test@test.test to cache LRU end 2024-09-14T11:29:02.511 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:29:02.514+0000 7fbae44bc9c0 10 cache put: name=default.rgw.meta+users.keys+JEMMYZYQUNNOMBGMSWMH info.flags=0x7 2024-09-14T11:29:02.511 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:29:02.514+0000 7fbae44bc9c0 10 moving default.rgw.meta+users.keys+JEMMYZYQUNNOMBGMSWMH to cache LRU end 2024-09-14T11:29:02.511 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:29:02.514+0000 7fbae44bc9c0 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:users.keys:JEMMYZYQUNNOMBGMSWMH, ofs0, ns] 2024-09-14T11:29:02.512 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:29:02.518+0000 7fb9c4ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1099511627788 cookie 93897739513488 notifier 5844 bl.length()=190 2024-09-14T11:29:02.512 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:29:02.518+0000 7fb9c4ff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.keys+JEMMYZYQUNNOMBGMSWMH info.flags=0x7 2024-09-14T11:29:02.512 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:29:02.518+0000 7fb9c4ff9640 10 rgw watcher librados: moving default.rgw.meta+users.keys+JEMMYZYQUNNOMBGMSWMH to cache LRU end 2024-09-14T11:29:02.514 INFO:teuthology.orchestra.run.smithi138.stdout:{ 2024-09-14T11:29:02.514 INFO:teuthology.orchestra.run.smithi138.stdout: "user_id": "sysuser.client.0", 2024-09-14T11:29:02.515 INFO:teuthology.orchestra.run.smithi138.stdout: "display_name": "Mr. sysuser.client.0", 2024-09-14T11:29:02.515 INFO:teuthology.orchestra.run.smithi138.stdout: "email": "sysuser.client.0+test@test.test", 2024-09-14T11:29:02.515 INFO:teuthology.orchestra.run.smithi138.stdout: "suspended": 0, 2024-09-14T11:29:02.515 INFO:teuthology.orchestra.run.smithi138.stdout: "max_buckets": 1000, 2024-09-14T11:29:02.515 INFO:teuthology.orchestra.run.smithi138.stdout: "subusers": [], 2024-09-14T11:29:02.515 INFO:teuthology.orchestra.run.smithi138.stdout: "keys": [ 2024-09-14T11:29:02.515 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-09-14T11:29:02.515 INFO:teuthology.orchestra.run.smithi138.stdout: "user": "sysuser.client.0", 2024-09-14T11:29:02.515 INFO:teuthology.orchestra.run.smithi138.stdout: "access_key": "JEMMYZYQUNNOMBGMSWMH", 2024-09-14T11:29:02.515 INFO:teuthology.orchestra.run.smithi138.stdout: "secret_key": "EK4RTlZnQFkr8igPfsvE2joRBndVVFqAmsgZFOA6tV0Vhe57r/HUiQ==", 2024-09-14T11:29:02.515 INFO:teuthology.orchestra.run.smithi138.stdout: "active": true, 2024-09-14T11:29:02.515 INFO:teuthology.orchestra.run.smithi138.stdout: "create_date": "2024-09-14T11:29:02.506363Z" 2024-09-14T11:29:02.516 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-09-14T11:29:02.516 INFO:teuthology.orchestra.run.smithi138.stdout: ], 2024-09-14T11:29:02.516 INFO:teuthology.orchestra.run.smithi138.stdout: "swift_keys": [], 2024-09-14T11:29:02.516 INFO:teuthology.orchestra.run.smithi138.stdout: "caps": [], 2024-09-14T11:29:02.516 INFO:teuthology.orchestra.run.smithi138.stdout: "op_mask": "read, write, delete", 2024-09-14T11:29:02.516 INFO:teuthology.orchestra.run.smithi138.stdout: "system": true, 2024-09-14T11:29:02.516 INFO:teuthology.orchestra.run.smithi138.stdout: "default_placement": "", 2024-09-14T11:29:02.516 INFO:teuthology.orchestra.run.smithi138.stdout: "default_storage_class": "", 2024-09-14T11:29:02.516 INFO:teuthology.orchestra.run.smithi138.stdout: "placement_tags": [], 2024-09-14T11:29:02.516 INFO:teuthology.orchestra.run.smithi138.stdout: "bucket_quota": { 2024-09-14T11:29:02.516 INFO:teuthology.orchestra.run.smithi138.stdout: "enabled": false, 2024-09-14T11:29:02.516 INFO:teuthology.orchestra.run.smithi138.stdout: "check_on_raw": false, 2024-09-14T11:29:02.516 INFO:teuthology.orchestra.run.smithi138.stdout: "max_size": -1, 2024-09-14T11:29:02.517 INFO:teuthology.orchestra.run.smithi138.stdout: "max_size_kb": 0, 2024-09-14T11:29:02.517 INFO:teuthology.orchestra.run.smithi138.stdout: "max_objects": -1 2024-09-14T11:29:02.517 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-09-14T11:29:02.517 INFO:teuthology.orchestra.run.smithi138.stdout: "user_quota": { 2024-09-14T11:29:02.517 INFO:teuthology.orchestra.run.smithi138.stdout: "enabled": false, 2024-09-14T11:29:02.517 INFO:teuthology.orchestra.run.smithi138.stdout: "check_on_raw": false, 2024-09-14T11:29:02.517 INFO:teuthology.orchestra.run.smithi138.stdout: "max_size": -1, 2024-09-14T11:29:02.517 INFO:teuthology.orchestra.run.smithi138.stdout: "max_size_kb": 0, 2024-09-14T11:29:02.517 INFO:teuthology.orchestra.run.smithi138.stdout: "max_objects": -1 2024-09-14T11:29:02.517 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-09-14T11:29:02.517 INFO:teuthology.orchestra.run.smithi138.stdout: "temp_url_keys": [], 2024-09-14T11:29:02.517 INFO:teuthology.orchestra.run.smithi138.stdout: "type": "rgw", 2024-09-14T11:29:02.517 INFO:teuthology.orchestra.run.smithi138.stdout: "mfa_ids": [], 2024-09-14T11:29:02.517 INFO:teuthology.orchestra.run.smithi138.stdout: "account_id": "", 2024-09-14T11:29:02.518 INFO:teuthology.orchestra.run.smithi138.stdout: "path": "/", 2024-09-14T11:29:02.518 INFO:teuthology.orchestra.run.smithi138.stdout: "create_date": "2024-09-14T11:29:02.506331Z", 2024-09-14T11:29:02.518 INFO:teuthology.orchestra.run.smithi138.stdout: "tags": [], 2024-09-14T11:29:02.518 INFO:teuthology.orchestra.run.smithi138.stdout: "group_ids": [] 2024-09-14T11:29:02.518 INFO:teuthology.orchestra.run.smithi138.stdout:} 2024-09-14T11:29:02.518 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-09-14T11:29:02.518 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:29:02.518+0000 7fb9937fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:29:02.521 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:29:02.526+0000 7fbae44bc9c0 20 remove_watcher() i=0 2024-09-14T11:29:02.521 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:29:02.526+0000 7fbae44bc9c0 2 removed watcher, disabling cache 2024-09-14T11:29:02.524 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:29:02.526+0000 7fbae44bc9c0 20 remove_watcher() i=1 2024-09-14T11:29:02.526 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:29:02.530+0000 7fbae44bc9c0 20 remove_watcher() i=2 2024-09-14T11:29:02.528 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:29:02.534+0000 7fbae44bc9c0 20 remove_watcher() i=3 2024-09-14T11:29:02.531 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:29:02.534+0000 7fbae44bc9c0 20 remove_watcher() i=4 2024-09-14T11:29:02.533 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:29:02.538+0000 7fbae44bc9c0 20 remove_watcher() i=5 2024-09-14T11:29:02.534 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:29:02.538+0000 7fbae44bc9c0 20 remove_watcher() i=6 2024-09-14T11:29:02.536 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:29:02.542+0000 7fbae44bc9c0 20 remove_watcher() i=7 2024-09-14T11:29:02.551 INFO:tasks.ragweed:Configuring ragweed... 2024-09-14T11:29:02.551 DEBUG:teuthology.orchestra.run.smithi138:> set -ex 2024-09-14T11:29:02.551 DEBUG:teuthology.orchestra.run.smithi138:> dd of=/home/ubuntu/cephtest/archive/ragweed.client.0.conf 2024-09-14T11:29:02.597 INFO:tasks.ragweed:Configuring boto... 2024-09-14T11:29:02.597 DEBUG:teuthology.orchestra.run.smithi138:> set -ex 2024-09-14T11:29:02.597 DEBUG:teuthology.orchestra.run.smithi138:> dd of=/home/ubuntu/cephtest/boto.cfg 2024-09-14T11:29:02.644 DEBUG:teuthology.orchestra.run.smithi138:ragweed tests against rgw> source /home/ubuntu/cephtest/tox-venv/bin/activate && cd /home/ubuntu/cephtest/ragweed.client.0 && RAGWEED_CONF=/home/ubuntu/cephtest/archive/ragweed.client.0.conf RAGWEED_STAGES=prepare,check BOTO_CONFIG=/home/ubuntu/cephtest/boto.cfg tox --sitepackages -- -v -m 'not fails_on_rgw' 2024-09-14T11:29:02.957 INFO:teuthology.orchestra.run.smithi138.stdout:GLOB sdist-make: /home/ubuntu/cephtest/ragweed.client.0/setup.py 2024-09-14T11:29:03.150 INFO:teuthology.orchestra.run.smithi138.stdout:py create: /home/ubuntu/cephtest/ragweed.client.0/.tox/py 2024-09-14T11:29:03.719 INFO:teuthology.orchestra.run.smithi138.stdout:py installdeps: -rrequirements.txt 2024-09-14T11:29:06.453 INFO:teuthology.orchestra.run.smithi138.stdout:py inst: /home/ubuntu/cephtest/ragweed.client.0/.tox/.tmp/package/1/ragweed-0.0.1.zip 2024-09-14T11:29:10.814 INFO:teuthology.orchestra.run.smithi138.stdout:py installed: appdirs==1.4.4,asyncssh==2.5.0,attrs==21.2.0,Babel==2.8.0,bcrypt==3.2.0,beautifulsoup4==4.10.0,beniget==0.4.1,blinker==1.4,boto==2.49.0,Brotli==1.0.9,cachetools==5.0.0,ceph==1.0.0,ceph-volume==1.0.0,cephfs==2.0.0,certifi==2020.6.20,chardet==4.0.0,cheroot==8.5.2+ds1,CherryPy==18.6.1,command-not-found==0.3,configobj==5.0.6,cryptography==3.4.8,cycler==0.11.0,dbus-python==1.2.18,decorator==4.4.2,distlib==0.3.4,distro==1.7.0,distro-info===1.1build1,docopt==0.6.2,execnet==1.9.0,filelock==3.6.0,fonttools==4.29.1,fs==2.4.12,gast==0.5.2,gevent==21.8.0,google-auth==1.5.1,greenlet==1.1.2,html5lib==1.1,httplib2==0.20.2,idna==3.3,importlib-metadata==4.6.4,iniconfig==1.1.1,isodate==0.6.1,jaraco.classes==3.2.1,jaraco.collections==3.4.0,jaraco.functools==3.4.0,jaraco.text==3.6.0,jeepney==0.7.1,Jinja2==3.0.3,joblib==0.17.0,keyring==23.5.0,kiwisolver==1.3.2,kubernetes==12.0.1,language-selector==0.1,launchpadlib==1.10.16,lazr.restfulclient==0.14.4,lazr.uri==1.0.6,logutils==0.3.3,lxml==4.8.0,lz4==3.1.3+dfsg,Mako==1.1.3,MarkupSafe==2.0.1,matplotlib==3.5.1,more-itertools==8.10.0,mpmath==0.0.0,munch==4.0.0,natsort==8.0.2,netifaces==0.11.0,nose==1.3.7,numpy==1.21.5,oauthlib==3.2.0,olefile==0.46,packaging==21.3,Paste==3.5.0,PasteDeploy==2.1.1,PasteScript==2.0.2,pecan==1.3.3,Pillow==9.0.1,platformdirs==2.5.1,pluggy==0.13.0,ply==3.11,portend==3.0.0,prettytable==2.5.0,psutil==5.9.0,py==1.10.0,pyasn1==0.4.8,pyasn1-modules==0.2.1,Pygments==2.11.2,PyGObject==3.42.1,pyinotify==0.9.6,PyJWT==2.3.0,pymacaroons==0.13.0,PyNaCl==1.5.0,pyOpenSSL==21.0.0,pyparsing==2.4.7,pytest==6.2.5,python-apt==2.3.0+ubuntu2.1,python-dateutil==2.8.1,python-magic==0.4.24,pythran==0.10.0,pytz==2022.1,PyYAML==5.4.1,rados==2.0.0,ragweed @ file:///home/ubuntu/cephtest/ragweed.client.0/.tox/.tmp/package/1/ragweed-0.0.1.zip#sha256=d3b490ae1774ea1c891521b0563087b7ce12b2471d07686f7e8be153c801c4f7,rbd==2.0.0,registries-conf-ctl @ git+https://github.com/sebastian-philipp/registries-conf-ctl@0e9bf2dc202aa9be9b0bf8e8265aac3f2308f9db,remoto==1.2.1,repoze.lru==0.7,requests==2.25.1,requests-oauthlib==1.3.0,rgw==2.0.0,Routes==2.5.1,rsa==4.8,s3cmd==2.2.0,scikit-learn==0.23.2,scipy==1.8.0,SecretStorage==3.3.1,simplegeneric==0.8.1,simplejson==3.17.6,six==1.16.0,soupsieve==2.3.1,ssh-import-id==5.11,sympy==1.9,Tempita==0.5.2,tempora==4.1.2,threadpoolctl==3.1.0,toml==0.10.2,ubuntu-advantage-tools==27.12,ufoLib2==0.13.1,ufw==0.36.1,unattended-upgrades==0.1,unicodedata2==14.0.0,urllib3==1.26.5,virtualenv==20.13.0+ds,wadllib==1.3.6,waitress==1.4.4,wcwidth==0.2.5,webencodings==0.5.1,WebOb==1.8.6,websocket-client==1.2.3,WebTest==2.0.35,Werkzeug==2.0.2,zc.lockfile==2.0,zipp==1.0.0,zope.event==4.4,zope.interface==5.4.0 2024-09-14T11:29:10.815 INFO:teuthology.orchestra.run.smithi138.stdout:py run-test-pre: PYTHONHASHSEED='2703569855' 2024-09-14T11:29:10.815 INFO:teuthology.orchestra.run.smithi138.stdout:py run-test: commands[0] | python -m pytest -v -m 'not fails_on_rgw' 2024-09-14T11:29:10.961 INFO:teuthology.orchestra.run.smithi138.stdout:============================= test session starts ============================== 2024-09-14T11:29:10.961 INFO:teuthology.orchestra.run.smithi138.stdout:platform linux -- Python 3.10.6, pytest-6.2.5, py-1.10.0, pluggy-0.13.0 -- /home/ubuntu/cephtest/ragweed.client.0/.tox/py/bin/python 2024-09-14T11:29:10.961 INFO:teuthology.orchestra.run.smithi138.stdout:cachedir: .tox/py/.pytest_cache 2024-09-14T11:29:10.961 INFO:teuthology.orchestra.run.smithi138.stdout:rootdir: /home/ubuntu/cephtest/ragweed.client.0, configfile: pytest.ini 2024-09-14T11:29:11.101 INFO:teuthology.orchestra.run.smithi138.stdout:collecting ... collected 9 items 2024-09-14T11:29:11.101 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-09-14T11:29:22.486 INFO:teuthology.orchestra.run.smithi138.stdout:ragweed/tests/tests.py::r_test_small_obj_data::test PASSED [ 11%] 2024-09-14T11:29:34.262 INFO:teuthology.orchestra.run.smithi138.stdout:ragweed/tests/tests.py::r_test_multipart_simple::test PASSED [ 22%] 2024-09-14T11:29:43.953 INFO:teuthology.orchestra.run.smithi138.stdout:ragweed/tests/tests.py::r_test_multipart_index_versioning::test PASSED [ 33%] 2024-09-14T11:29:56.232 INFO:teuthology.orchestra.run.smithi138.stdout:ragweed/tests/tests.py::r_test_multipart_defer_complete::test PASSED [ 44%] 2024-09-14T11:30:08.781 INFO:teuthology.orchestra.run.smithi138.stdout:ragweed/tests/tests.py::r_test_multipart_defer_update_complete::test PASSED [ 55%] 2024-09-14T11:30:33.730 INFO:teuthology.orchestra.run.smithi138.stdout:ragweed/tests/tests.py::r_test_obj_storage_class::test PASSED [ 66%] 2024-09-14T11:30:58.495 INFO:teuthology.orchestra.run.smithi138.stdout:ragweed/tests/tests.py::r_test_obj_storage_class_multipart::test PASSED [ 77%] 2024-09-14T11:31:21.347 INFO:teuthology.orchestra.run.smithi138.stdout:ragweed/tests/tests.py::r_test_obj_storage_class_copy::test PASSED [ 88%] 2024-09-14T11:32:04.533 INFO:teuthology.orchestra.run.smithi138.stdout:ragweed/tests/tests.py::r_test_obj_storage_class_multipart_copy::test PASSED [100%] 2024-09-14T11:32:04.533 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-09-14T11:32:04.533 INFO:teuthology.orchestra.run.smithi138.stdout:=============================== warnings summary =============================== 2024-09-14T11:32:04.534 INFO:teuthology.orchestra.run.smithi138.stdout:.tox/py/lib/python3.10/site-packages/boto/plugin.py:40 2024-09-14T11:32:04.534 INFO:teuthology.orchestra.run.smithi138.stdout: /home/ubuntu/cephtest/ragweed.client.0/.tox/py/lib/python3.10/site-packages/boto/plugin.py:40: DeprecationWarning: the imp module is deprecated in favour of importlib and slated for removal in Python 3.12; see the module's documentation for alternative uses 2024-09-14T11:32:04.534 INFO:teuthology.orchestra.run.smithi138.stdout: import imp 2024-09-14T11:32:04.534 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-09-14T11:32:04.534 INFO:teuthology.orchestra.run.smithi138.stdout:-- Docs: https://docs.pytest.org/en/stable/warnings.html 2024-09-14T11:32:04.534 INFO:teuthology.orchestra.run.smithi138.stdout:=================== 9 passed, 1 warning in 173.57s (0:02:53) =================== 2024-09-14T11:32:04.586 INFO:teuthology.orchestra.run.smithi138.stdout:___________________________________ summary ____________________________________ 2024-09-14T11:32:04.586 INFO:teuthology.orchestra.run.smithi138.stdout: py: commands succeeded 2024-09-14T11:32:04.586 INFO:teuthology.orchestra.run.smithi138.stdout: congratulations :) 2024-09-14T11:32:04.607 INFO:tasks.ragweed:Cleaning up boto... 2024-09-14T11:32:04.608 DEBUG:teuthology.orchestra.run.smithi138:> rm -f /home/ubuntu/cephtest/boto.cfg 2024-09-14T11:32:04.613 DEBUG:teuthology.orchestra.run.smithi138:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 user rm --uid ragweed.client.0 --purge-data 2024-09-14T11:32:04.687 INFO:teuthology.orchestra.run.smithi138.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:32:04.687 INFO:teuthology.orchestra.run.smithi138.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:32:04.727 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:04.729+0000 7f45669169c0 20 rados->read ofs=0 len=0 2024-09-14T11:32:04.729 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:04.729+0000 7f45669169c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:32:04.729 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:04.729+0000 7f45669169c0 20 realm 2024-09-14T11:32:04.729 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:04.729+0000 7f45669169c0 20 rados->read ofs=0 len=0 2024-09-14T11:32:04.729 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:04.729+0000 7f45669169c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:32:04.729 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:04.729+0000 7f45669169c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:32:04.730 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:04.729+0000 7f45669169c0 20 rados->read ofs=0 len=0 2024-09-14T11:32:04.730 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:04.729+0000 7f45669169c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:32:04.730 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:04.729+0000 7f45669169c0 20 rados->read ofs=0 len=0 2024-09-14T11:32:04.730 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:04.733+0000 7f45669169c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:32:04.730 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:04.733+0000 7f45669169c0 20 rados->read ofs=0 len=0 2024-09-14T11:32:04.731 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:04.733+0000 7f45669169c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:32:04.732 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:04.733+0000 7f45669169c0 20 searching for the correct realm 2024-09-14T11:32:04.733 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:04.733+0000 7f4563c1b640 0 -- 172.21.15.138:0/2077410448 >> [v2:172.21.15.154:6808/1468088432,v1:172.21.15.154:6809/1468088432] conn(0x7f455c080040 msgr2=0x7f455c062cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:32:04.946 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:04.949+0000 7f4564c1d640 0 -- 172.21.15.138:0/2077410448 >> [v2:172.21.15.138:6824/2633984942,v1:172.21.15.138:6825/2633984942] conn(0x55e2432b6d10 msgr2=0x55e2432b9100 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:32:04.964 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:04.965+0000 7f45669169c0 20 RGWRados::pool_iterate: got zone_info.d9e72d30-c60b-4d0d-9267-fdc36392d5ad 2024-09-14T11:32:04.964 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:04.965+0000 7f45669169c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:32:04.964 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:04.965+0000 7f45669169c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:32:04.965 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:04.965+0000 7f45669169c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:32:04.965 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:04.965+0000 7f45669169c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:32:04.965 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:04.965+0000 7f45669169c0 20 RGWRados::pool_iterate: got zonegroup_info.65ab941b-da8c-4160-94fb-3672b069d44f 2024-09-14T11:32:04.965 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:04.965+0000 7f45669169c0 20 rados->read ofs=0 len=0 2024-09-14T11:32:04.965 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:04.965+0000 7f45669169c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:32:04.965 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:04.965+0000 7f45669169c0 20 rados->read ofs=0 len=0 2024-09-14T11:32:04.966 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:04.965+0000 7f45669169c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:32:04.966 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:04.965+0000 7f45669169c0 20 rados->read ofs=0 len=0 2024-09-14T11:32:04.966 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:04.969+0000 7f45669169c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:32:04.967 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:04.969+0000 7f45669169c0 20 zone default found 2024-09-14T11:32:04.967 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:04.969+0000 7f45669169c0 4 Realm: () 2024-09-14T11:32:04.967 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:04.969+0000 7f45669169c0 4 ZoneGroup: default (65ab941b-da8c-4160-94fb-3672b069d44f) 2024-09-14T11:32:04.967 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:04.969+0000 7f45669169c0 4 Zone: default (d9e72d30-c60b-4d0d-9267-fdc36392d5ad) 2024-09-14T11:32:04.967 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:04.969+0000 7f45669169c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:32:04.967 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:04.969+0000 7f45669169c0 20 zonegroup default 2024-09-14T11:32:04.967 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:04.969+0000 7f45669169c0 20 rados->read ofs=0 len=0 2024-09-14T11:32:04.968 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:04.969+0000 7f45669169c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:32:04.968 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:04.969+0000 7f45669169c0 20 rados->read ofs=0 len=0 2024-09-14T11:32:04.968 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:04.969+0000 7f45669169c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:32:04.968 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:04.969+0000 7f45669169c0 20 rados->read ofs=0 len=0 2024-09-14T11:32:04.969 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:04.969+0000 7f45669169c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:32:04.969 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:04.969+0000 7f45669169c0 20 started sync module instance, tier type = 2024-09-14T11:32:04.970 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:04.969+0000 7f45669169c0 20 started zone id=d9e72d30-c60b-4d0d-9267-fdc36392d5ad (name=default) with tier type = 2024-09-14T11:32:04.992 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:04.993+0000 7f45669169c0 20 add_watcher() i=0 2024-09-14T11:32:04.992 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:04.993+0000 7f45669169c0 20 add_watcher() i=1 2024-09-14T11:32:04.992 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:04.993+0000 7f45669169c0 20 add_watcher() i=2 2024-09-14T11:32:04.993 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:04.993+0000 7f45669169c0 20 add_watcher() i=3 2024-09-14T11:32:04.993 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:04.993+0000 7f45669169c0 20 add_watcher() i=4 2024-09-14T11:32:04.993 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:04.993+0000 7f45669169c0 20 add_watcher() i=5 2024-09-14T11:32:04.993 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:04.993+0000 7f45669169c0 20 add_watcher() i=6 2024-09-14T11:32:04.994 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:04.997+0000 7f45669169c0 20 add_watcher() i=7 2024-09-14T11:32:04.995 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:04.997+0000 7f45669169c0 2 all 8 watchers are set, enabling cache 2024-09-14T11:32:04.999 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:05.001+0000 7f441afdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:32:04.999 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:05.001+0000 7f45669169c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:32:04.999 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:05.001+0000 7f45669169c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:32:05.091 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:05.093+0000 7f4419fdb640 20 reqs_thread_entry: start 2024-09-14T11:32:05.091 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:05.093+0000 7f45669169c0 20 init_complete bucket index max shards: 11 2024-09-14T11:32:05.091 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:05.093+0000 7f45669169c0 20 Filter name: none 2024-09-14T11:32:05.091 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:05.093+0000 7f438b7fe640 20 reqs_thread_entry: start 2024-09-14T11:32:05.091 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:05.093+0000 7f45669169c0 10 cache get: name=default.rgw.meta+users.uid+ragweed.client.0 : miss 2024-09-14T11:32:05.091 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:05.093+0000 7f45669169c0 20 rados->read ofs=0 len=0 2024-09-14T11:32:05.092 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:05.093+0000 7f45669169c0 20 rados_obj.operate() r=0 bl.length=486 2024-09-14T11:32:05.092 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:05.093+0000 7f45669169c0 10 cache put: name=default.rgw.meta+users.uid+ragweed.client.0 info.flags=0x13 2024-09-14T11:32:05.092 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:05.093+0000 7f45669169c0 10 adding default.rgw.meta+users.uid+ragweed.client.0 to cache LRU end 2024-09-14T11:32:05.092 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:05.093+0000 7f45669169c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:32:05.093 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:05.093+0000 7f45669169c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.test-client.0-conf:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.4 : miss 2024-09-14T11:32:05.093 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:05.093+0000 7f45669169c0 20 rados->read ofs=0 len=0 2024-09-14T11:32:05.094 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:05.097+0000 7f45669169c0 20 rados_obj.operate() r=0 bl.length=426 2024-09-14T11:32:05.094 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:05.097+0000 7f45669169c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.test-client.0-conf:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.4 info.flags=0x17 2024-09-14T11:32:05.095 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:05.097+0000 7f45669169c0 10 adding default.rgw.meta+root+.bucket.meta.test-client.0-conf:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.4 to cache LRU end 2024-09-14T11:32:05.095 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:05.097+0000 7f45669169c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:32:05.095 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:05.097+0000 7f45669169c0 10 updating xattr: name=user.rgw.acl bl.length()=209 2024-09-14T11:32:05.095 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:05.097+0000 7f45669169c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.test-client.0-conf:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.4 2024-09-14T11:32:05.096 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:05.097+0000 7f45669169c0 10 cls_bucket_list_unordered: got tests/r_test_obj_storage_class_multipart_copy 2024-09-14T11:32:05.097 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:05.097+0000 7f45669169c0 10 cls_bucket_list_unordered: got tests/r_test_multipart_index_versioning 2024-09-14T11:32:05.097 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:05.097+0000 7f45669169c0 10 cls_bucket_list_unordered: got tests/r_test_obj_storage_class_copy 2024-09-14T11:32:05.098 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:05.101+0000 7f45669169c0 10 cls_bucket_list_unordered: got tests/r_test_multipart_defer_update_complete 2024-09-14T11:32:05.099 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:05.101+0000 7f45669169c0 10 cls_bucket_list_unordered: got tests/r_test_multipart_defer_complete 2024-09-14T11:32:05.099 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:05.101+0000 7f45669169c0 10 cls_bucket_list_unordered: got tests/r_test_obj_storage_class 2024-09-14T11:32:05.099 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:05.101+0000 7f45669169c0 10 cls_bucket_list_unordered: got tests/r_test_multipart_simple 2024-09-14T11:32:05.100 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:05.101+0000 7f45669169c0 10 cls_bucket_list_unordered: got tests/r_test_obj_storage_class_multipart 2024-09-14T11:32:05.101 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:05.101+0000 7f45669169c0 10 cls_bucket_list_unordered: got tests/r_test_small_obj_data 2024-09-14T11:32:05.102 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:05.105+0000 7f45669169c0 20 get_obj_state: octx=0x7f45540d9040 obj=test-client.0-conf:tests/r_test_obj_storage_class_multipart_copy state=0x55e24336c218 s->prefetch_data=0 2024-09-14T11:32:05.102 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:05.105+0000 7f45669169c0 10 manifest: total_size = 5083 2024-09-14T11:32:05.103 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:05.105+0000 7f45669169c0 20 get_obj_state: setting s->obj_tag to d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.8856592291142852857 2024-09-14T11:32:05.103 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:05.105+0000 7f45669169c0 20 get_obj_state: octx=0x7f45540d9040 obj=test-client.0-conf:tests/r_test_obj_storage_class_multipart_copy state=0x55e24336c218 s->prefetch_data=0 2024-09-14T11:32:05.103 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:05.105+0000 7f45669169c0 20 prepare_atomic_modification: state is not atomic. state=0x55e24336c218 2024-09-14T11:32:05.103 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:05.105+0000 7f45669169c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.4.1 2024-09-14T11:32:05.108 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:05.109+0000 7f45669169c0 20 get_obj_state: octx=0x7f45540d9040 obj=test-client.0-conf:tests/r_test_multipart_index_versioning state=0x55e24336c218 s->prefetch_data=0 2024-09-14T11:32:05.108 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:05.109+0000 7f45669169c0 10 manifest: total_size = 4888 2024-09-14T11:32:05.109 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:05.109+0000 7f45669169c0 20 get_obj_state: setting s->obj_tag to d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.12239326715563905452 2024-09-14T11:32:05.109 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:05.109+0000 7f45669169c0 20 get_obj_state: octx=0x7f45540d9040 obj=test-client.0-conf:tests/r_test_multipart_index_versioning state=0x55e24336c218 s->prefetch_data=0 2024-09-14T11:32:05.109 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:05.109+0000 7f45669169c0 20 prepare_atomic_modification: state is not atomic. state=0x55e24336c218 2024-09-14T11:32:05.109 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:05.109+0000 7f45669169c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.4.2 2024-09-14T11:32:05.110 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:05.113+0000 7f443b7fe640 20 handle_completion(): completion ok for obj=tests/r_test_obj_storage_class_multipart_copy 2024-09-14T11:32:05.114 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:05.117+0000 7f45669169c0 20 get_obj_state: octx=0x7f45540d9040 obj=test-client.0-conf:tests/r_test_obj_storage_class_copy state=0x55e24336c218 s->prefetch_data=0 2024-09-14T11:32:05.116 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:05.117+0000 7f45669169c0 10 manifest: total_size = 5042 2024-09-14T11:32:05.116 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:05.117+0000 7f45669169c0 20 get_obj_state: setting s->obj_tag to d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.15868994030818826611 2024-09-14T11:32:05.116 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:05.117+0000 7f45669169c0 20 get_obj_state: octx=0x7f45540d9040 obj=test-client.0-conf:tests/r_test_obj_storage_class_copy state=0x55e24336c218 s->prefetch_data=0 2024-09-14T11:32:05.116 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:05.117+0000 7f45669169c0 20 prepare_atomic_modification: state is not atomic. state=0x55e24336c218 2024-09-14T11:32:05.116 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:05.117+0000 7f45669169c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.4.2 2024-09-14T11:32:05.117 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:05.117+0000 7f443affd640 20 handle_completion(): completion ok for obj=tests/r_test_multipart_index_versioning 2024-09-14T11:32:05.122 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:05.125+0000 7f45669169c0 20 get_obj_state: octx=0x7f45540d9040 obj=test-client.0-conf:tests/r_test_multipart_defer_update_complete state=0x55e24336c218 s->prefetch_data=0 2024-09-14T11:32:05.123 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:05.125+0000 7f45669169c0 10 manifest: total_size = 7552 2024-09-14T11:32:05.123 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:05.125+0000 7f45669169c0 20 get_obj_state: setting s->obj_tag to d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.17236308086875280082 2024-09-14T11:32:05.123 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:05.125+0000 7f45669169c0 20 get_obj_state: octx=0x7f45540d9040 obj=test-client.0-conf:tests/r_test_multipart_defer_update_complete state=0x55e24336c218 s->prefetch_data=0 2024-09-14T11:32:05.123 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:05.125+0000 7f45669169c0 20 prepare_atomic_modification: state is not atomic. state=0x55e24336c218 2024-09-14T11:32:05.123 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:05.125+0000 7f45669169c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.4.3 2024-09-14T11:32:05.124 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:05.125+0000 7f443b7fe640 20 handle_completion(): completion ok for obj=tests/r_test_obj_storage_class_copy 2024-09-14T11:32:05.128 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:05.129+0000 7f45669169c0 20 get_obj_state: octx=0x7f45540d9040 obj=test-client.0-conf:tests/r_test_multipart_defer_complete state=0x55e24336c218 s->prefetch_data=0 2024-09-14T11:32:05.129 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:05.129+0000 7f45669169c0 10 manifest: total_size = 5203 2024-09-14T11:32:05.129 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:05.129+0000 7f45669169c0 20 get_obj_state: setting s->obj_tag to d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.6668154597370887434 2024-09-14T11:32:05.129 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:05.129+0000 7f45669169c0 20 get_obj_state: octx=0x7f45540d9040 obj=test-client.0-conf:tests/r_test_multipart_defer_complete state=0x55e24336c218 s->prefetch_data=0 2024-09-14T11:32:05.129 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:05.129+0000 7f45669169c0 20 prepare_atomic_modification: state is not atomic. state=0x55e24336c218 2024-09-14T11:32:05.129 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:05.129+0000 7f45669169c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.4.4 2024-09-14T11:32:05.131 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:05.133+0000 7f443affd640 20 handle_completion(): completion ok for obj=tests/r_test_multipart_defer_update_complete 2024-09-14T11:32:05.133 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:05.133+0000 7f45669169c0 20 get_obj_state: octx=0x7f45540d9040 obj=test-client.0-conf:tests/r_test_obj_storage_class state=0x55e24336c218 s->prefetch_data=0 2024-09-14T11:32:05.134 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:05.137+0000 7f45669169c0 10 manifest: total_size = 4982 2024-09-14T11:32:05.134 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:05.137+0000 7f45669169c0 20 get_obj_state: setting s->obj_tag to d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.5690382187646847868 2024-09-14T11:32:05.134 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:05.137+0000 7f45669169c0 20 get_obj_state: octx=0x7f45540d9040 obj=test-client.0-conf:tests/r_test_obj_storage_class state=0x55e24336c218 s->prefetch_data=0 2024-09-14T11:32:05.135 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:05.137+0000 7f45669169c0 20 prepare_atomic_modification: state is not atomic. state=0x55e24336c218 2024-09-14T11:32:05.135 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:05.137+0000 7f45669169c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.4.4 2024-09-14T11:32:05.135 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:05.137+0000 7f443b7fe640 20 handle_completion(): completion ok for obj=tests/r_test_multipart_defer_complete 2024-09-14T11:32:05.139 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:05.141+0000 7f45669169c0 20 get_obj_state: octx=0x55e2432f6bd0 obj=test-client.0-conf:tests/r_test_multipart_simple state=0x55e24336c218 s->prefetch_data=0 2024-09-14T11:32:05.140 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:05.141+0000 7f45669169c0 10 manifest: total_size = 7420 2024-09-14T11:32:05.140 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:05.141+0000 7f45669169c0 20 get_obj_state: setting s->obj_tag to d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.18240192364781546547 2024-09-14T11:32:05.140 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:05.141+0000 7f45669169c0 20 get_obj_state: octx=0x55e2432f6bd0 obj=test-client.0-conf:tests/r_test_multipart_simple state=0x55e24336c218 s->prefetch_data=0 2024-09-14T11:32:05.140 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:05.141+0000 7f45669169c0 20 prepare_atomic_modification: state is not atomic. state=0x55e24336c218 2024-09-14T11:32:05.140 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:05.141+0000 7f45669169c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.4.5 2024-09-14T11:32:05.141 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:05.141+0000 7f443affd640 20 handle_completion(): completion ok for obj=tests/r_test_obj_storage_class 2024-09-14T11:32:05.145 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:05.145+0000 7f45669169c0 20 get_obj_state: octx=0x55e2432f6bd0 obj=test-client.0-conf:tests/r_test_obj_storage_class_multipart state=0x55e24336c218 s->prefetch_data=0 2024-09-14T11:32:05.146 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:05.149+0000 7f45669169c0 10 manifest: total_size = 14230 2024-09-14T11:32:05.146 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:05.149+0000 7f45669169c0 20 get_obj_state: setting s->obj_tag to d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.2457372068200735494 2024-09-14T11:32:05.146 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:05.149+0000 7f45669169c0 20 get_obj_state: octx=0x55e2432f6bd0 obj=test-client.0-conf:tests/r_test_obj_storage_class_multipart state=0x55e24336c218 s->prefetch_data=0 2024-09-14T11:32:05.146 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:05.149+0000 7f45669169c0 20 prepare_atomic_modification: state is not atomic. state=0x55e24336c218 2024-09-14T11:32:05.146 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:05.149+0000 7f45669169c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.4.7 2024-09-14T11:32:05.147 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:05.149+0000 7f443b7fe640 20 handle_completion(): completion ok for obj=tests/r_test_multipart_simple 2024-09-14T11:32:05.151 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:05.153+0000 7f45669169c0 20 get_obj_state: octx=0x55e2432f6bd0 obj=test-client.0-conf:tests/r_test_small_obj_data state=0x55e24336c218 s->prefetch_data=0 2024-09-14T11:32:05.153 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:05.153+0000 7f45669169c0 10 manifest: total_size = 5363 2024-09-14T11:32:05.153 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:05.153+0000 7f45669169c0 20 get_obj_state: setting s->obj_tag to d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.9602176896039319576 2024-09-14T11:32:05.153 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:05.153+0000 7f45669169c0 20 get_obj_state: octx=0x55e2432f6bd0 obj=test-client.0-conf:tests/r_test_small_obj_data state=0x55e24336c218 s->prefetch_data=0 2024-09-14T11:32:05.154 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:05.153+0000 7f45669169c0 20 prepare_atomic_modification: state is not atomic. state=0x55e24336c218 2024-09-14T11:32:05.154 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:05.153+0000 7f45669169c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.4.8 2024-09-14T11:32:05.154 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:05.153+0000 7f443affd640 20 handle_completion(): completion ok for obj=tests/r_test_obj_storage_class_multipart 2024-09-14T11:32:05.160 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:05.161+0000 7f45669169c0 20 list_objects_ordered: starting attempt 1 2024-09-14T11:32:05.160 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:05.161+0000 7f45669169c0 10 cls_bucket_list_ordered: request from each of 11 shard(s) for 112 entries to get 1001 total entries 2024-09-14T11:32:05.163 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:05.165+0000 7f443affd640 20 handle_completion(): completion ok for obj=tests/r_test_small_obj_data 2024-09-14T11:32:05.164 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:05.165+0000 7f45669169c0 20 cls_bucket_list_ordered: returning, count=0, is_truncated=0 2024-09-14T11:32:05.164 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:05.165+0000 7f45669169c0 20 cls_bucket_list_ordered: returning, last_entry NOT SET 2024-09-14T11:32:05.164 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:05.165+0000 7f45669169c0 10 list_objects_ordered: end of outer loop, truncated=0, count=0, attempt=1 2024-09-14T11:32:05.164 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:05.165+0000 7f45669169c0 10 list_objects_ordered: exiting attempt loop because we reached end (0) or we're returning half the requested entries (0 of 1000) 2024-09-14T11:32:05.164 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:05.165+0000 7f45669169c0 20 abort_multiparts INFO: aborting and cleaning up multipart upload(s); bucket=":test-client.0-conf[d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.4])"; uploads.size()=0; is_truncated=0 2024-09-14T11:32:05.167 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:05.169+0000 7f45669169c0 10 cache get: name=default.rgw.meta+root+test-client.0-conf : miss 2024-09-14T11:32:05.167 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:05.169+0000 7f45669169c0 20 rados->read ofs=0 len=0 2024-09-14T11:32:05.168 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:05.169+0000 7f45669169c0 20 rados_obj.operate() r=0 bl.length=204 2024-09-14T11:32:05.168 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:05.169+0000 7f45669169c0 10 cache put: name=default.rgw.meta+root+test-client.0-conf info.flags=0x11 2024-09-14T11:32:05.169 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:05.169+0000 7f45669169c0 10 adding default.rgw.meta+root+test-client.0-conf to cache LRU end 2024-09-14T11:32:05.171 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:05.173+0000 7f45669169c0 10 removing default.rgw.meta+root+test-client.0-conf from cache 2024-09-14T11:32:05.171 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:05.173+0000 7f45669169c0 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 1, obj: default.rgw.meta:root:test-client.0-conf, ofs0, ns] 2024-09-14T11:32:05.172 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:05.173+0000 7f443affd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366172 cookie 94430277896064 notifier 5874 bl.length()=162 2024-09-14T11:32:05.177 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:05.177+0000 7f45669169c0 10 removing default.rgw.meta+root+.bucket.meta.test-client.0-conf:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.4 from cache 2024-09-14T11:32:05.177 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:05.177+0000 7f45669169c0 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 1, obj: default.rgw.meta:root:.bucket.meta.test-client.0-conf:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.4, ofs0, ns] 2024-09-14T11:32:05.178 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:05.181+0000 7f443affd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366162 cookie 94430277938736 notifier 5874 bl.length()=219 2024-09-14T11:32:05.185 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:05.185+0000 7f45669169c0 10 cache get: name=default.rgw.log++pubsub..bucket.test-client.0-conf/d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.4 : miss 2024-09-14T11:32:05.185 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:05.185+0000 7f45669169c0 20 rados->read ofs=0 len=0 2024-09-14T11:32:05.186 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:05.189+0000 7f45669169c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:32:05.186 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:05.189+0000 7f45669169c0 10 cache put: name=default.rgw.log++pubsub..bucket.test-client.0-conf/d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.4 info.flags=0x0 2024-09-14T11:32:05.186 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:05.189+0000 7f45669169c0 10 adding default.rgw.log++pubsub..bucket.test-client.0-conf/d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.4 to cache LRU end 2024-09-14T11:32:05.190 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:05.193+0000 7f45669169c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-defer-complete.1:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.11 : miss 2024-09-14T11:32:05.190 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:05.193+0000 7f45669169c0 20 rados->read ofs=0 len=0 2024-09-14T11:32:05.190 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:05.193+0000 7f45669169c0 20 rados_obj.operate() r=0 bl.length=457 2024-09-14T11:32:05.191 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:05.193+0000 7f45669169c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-defer-complete.1:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.11 info.flags=0x17 2024-09-14T11:32:05.191 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:05.193+0000 7f45669169c0 10 adding default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-defer-complete.1:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.11 to cache LRU end 2024-09-14T11:32:05.191 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:05.193+0000 7f45669169c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:32:05.191 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:05.193+0000 7f45669169c0 10 updating xattr: name=user.rgw.acl bl.length()=209 2024-09-14T11:32:05.191 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:05.193+0000 7f45669169c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-defer-complete.1:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.11 2024-09-14T11:32:05.199 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:05.201+0000 7f45669169c0 10 cls_bucket_list_unordered: got foo 2024-09-14T11:32:05.199 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:05.201+0000 7f45669169c0 20 get_obj_state: octx=0x55e2432f5f30 obj=test-client.0-r-test-multipart-defer-complete.1:foo state=0x55e2432f4398 s->prefetch_data=0 2024-09-14T11:32:05.200 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:05.201+0000 7f45669169c0 10 manifest: total_size = 74198 2024-09-14T11:32:05.200 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:05.201+0000 7f45669169c0 20 get_obj_state: setting s->obj_tag to d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.8257164539846096105 2024-09-14T11:32:05.200 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:05.201+0000 7f45669169c0 20 get_obj_state: octx=0x55e2432f5f30 obj=test-client.0-r-test-multipart-defer-complete.1:foo state=0x55e2432f4398 s->prefetch_data=0 2024-09-14T11:32:05.200 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:05.201+0000 7f45669169c0 20 prepare_atomic_modification: state is not atomic. state=0x55e2432f4398 2024-09-14T11:32:05.200 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:05.201+0000 7f45669169c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.11.10 2024-09-14T11:32:05.206 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:05.205+0000 7f45669169c0 20 RGWObjManifest::operator++(): rule->part_size=20613 rules.size()=2 2024-09-14T11:32:05.206 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:05.205+0000 7f45669169c0 20 RGWObjManifest::operator++(): stripe_ofs=4194304 part_ofs=0 rule->part_size=20613 2024-09-14T11:32:05.206 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:05.205+0000 7f45669169c0 20 RGWObjManifest::operator++(): result: ofs=20613 stripe_ofs=20613 part_ofs=20613 rule->part_size=20613 2024-09-14T11:32:05.206 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:05.205+0000 7f45669169c0 20 RGWObjManifest::operator++(): rule->part_size=20613 rules.size()=2 2024-09-14T11:32:05.206 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:05.205+0000 7f45669169c0 20 RGWObjManifest::operator++(): stripe_ofs=4214917 part_ofs=20613 rule->part_size=20613 2024-09-14T11:32:05.206 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:05.205+0000 7f45669169c0 20 RGWObjManifest::operator++(): result: ofs=41226 stripe_ofs=41226 part_ofs=41226 rule->part_size=20613 2024-09-14T11:32:05.206 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:05.205+0000 7f45669169c0 20 RGWObjManifest::operator++(): rule->part_size=20613 rules.size()=2 2024-09-14T11:32:05.207 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:05.205+0000 7f45669169c0 20 RGWObjManifest::operator++(): stripe_ofs=4235530 part_ofs=41226 rule->part_size=20613 2024-09-14T11:32:05.207 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:05.205+0000 7f45669169c0 20 RGWObjManifest::operator++(): result: ofs=61839 stripe_ofs=61839 part_ofs=61839 rule->part_size=12359 2024-09-14T11:32:05.207 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:05.205+0000 7f45669169c0 20 RGWObjManifest::operator++(): rule->part_size=12359 rules.size()=2 2024-09-14T11:32:05.207 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:05.205+0000 7f45669169c0 20 RGWObjManifest::operator++(): stripe_ofs=4256143 part_ofs=61839 rule->part_size=12359 2024-09-14T11:32:05.207 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:05.205+0000 7f45669169c0 20 RGWObjManifest::operator++(): result: ofs=74198 stripe_ofs=74198 part_ofs=74198 rule->part_size=12359 2024-09-14T11:32:05.207 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:05.205+0000 7f45669169c0 20 garbage collection: RGWGC::send_split_chain - tag is: d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.8257164539846096105 2024-09-14T11:32:05.207 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:05.205+0000 7f45669169c0 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-14T11:32:05.207 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:05.205+0000 7f45669169c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.11__multipart_foo.2~_SH76nfC0BLqVZctyBelg_j6CWd4ZOS.1 2024-09-14T11:32:05.207 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:05.205+0000 7f45669169c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 346 2024-09-14T11:32:05.207 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:05.205+0000 7f45669169c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.11__multipart_foo.2~_SH76nfC0BLqVZctyBelg_j6CWd4ZOS.2 2024-09-14T11:32:05.208 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:05.205+0000 7f45669169c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 592 2024-09-14T11:32:05.208 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:05.205+0000 7f45669169c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.11__multipart_foo.2~_SH76nfC0BLqVZctyBelg_j6CWd4ZOS.3 2024-09-14T11:32:05.208 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:05.205+0000 7f45669169c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 838 2024-09-14T11:32:05.208 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:05.205+0000 7f45669169c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.11__multipart_foo.2~_SH76nfC0BLqVZctyBelg_j6CWd4ZOS.4 2024-09-14T11:32:05.208 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:05.205+0000 7f45669169c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 1084 2024-09-14T11:32:05.208 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:05.205+0000 7f45669169c0 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-14T11:32:05.208 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:05.205+0000 7f45669169c0 20 garbage collection: RGWGC::send_chain - on object name: gc.1tag is: d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.8257164539846096105 2024-09-14T11:32:05.209 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:05.209+0000 7f443b7fe640 20 handle_completion(): completion ok for obj=foo 2024-09-14T11:32:05.209 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:05.209+0000 7f45669169c0 20 list_objects_ordered: starting attempt 1 2024-09-14T11:32:05.209 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:05.209+0000 7f45669169c0 10 cls_bucket_list_ordered: request from each of 11 shard(s) for 112 entries to get 1001 total entries 2024-09-14T11:32:05.210 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:05.213+0000 7f45669169c0 20 cls_bucket_list_ordered: returning, count=0, is_truncated=0 2024-09-14T11:32:05.210 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:05.213+0000 7f45669169c0 20 cls_bucket_list_ordered: returning, last_entry NOT SET 2024-09-14T11:32:05.210 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:05.213+0000 7f45669169c0 10 list_objects_ordered: end of outer loop, truncated=0, count=0, attempt=1 2024-09-14T11:32:05.210 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:05.213+0000 7f45669169c0 10 list_objects_ordered: exiting attempt loop because we reached end (0) or we're returning half the requested entries (0 of 1000) 2024-09-14T11:32:05.210 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:05.213+0000 7f45669169c0 20 abort_multiparts INFO: aborting and cleaning up multipart upload(s); bucket=":test-client.0-r-test-multipart-defer-complete.1[d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.11])"; uploads.size()=0; is_truncated=0 2024-09-14T11:32:05.213 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:05.213+0000 7f45669169c0 10 cache get: name=default.rgw.meta+root+test-client.0-r-test-multipart-defer-complete.1 : miss 2024-09-14T11:32:05.213 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:05.213+0000 7f45669169c0 20 rados->read ofs=0 len=0 2024-09-14T11:32:05.214 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:05.217+0000 7f45669169c0 20 rados_obj.operate() r=0 bl.length=235 2024-09-14T11:32:05.214 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:05.217+0000 7f45669169c0 10 cache put: name=default.rgw.meta+root+test-client.0-r-test-multipart-defer-complete.1 info.flags=0x11 2024-09-14T11:32:05.214 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:05.217+0000 7f45669169c0 10 adding default.rgw.meta+root+test-client.0-r-test-multipart-defer-complete.1 to cache LRU end 2024-09-14T11:32:05.217 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:05.217+0000 7f45669169c0 10 removing default.rgw.meta+root+test-client.0-r-test-multipart-defer-complete.1 from cache 2024-09-14T11:32:05.217 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:05.217+0000 7f45669169c0 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 1, obj: default.rgw.meta:root:test-client.0-r-test-multipart-defer-complete.1, ofs0, ns] 2024-09-14T11:32:05.218 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:05.221+0000 7f443b7fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366204 cookie 94430277921952 notifier 5874 bl.length()=191 2024-09-14T11:32:05.223 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:05.225+0000 7f45669169c0 10 removing default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-defer-complete.1:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.11 from cache 2024-09-14T11:32:05.223 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:05.225+0000 7f45669169c0 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 1, obj: default.rgw.meta:root:.bucket.meta.test-client.0-r-test-multipart-defer-complete.1:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.11, ofs0, ns] 2024-09-14T11:32:05.224 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:05.225+0000 7f443b7fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366173 cookie 94430277933520 notifier 5874 bl.length()=249 2024-09-14T11:32:05.232 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:05.233+0000 7f45669169c0 10 cache get: name=default.rgw.log++pubsub..bucket.test-client.0-r-test-multipart-defer-complete.1/d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.11 : miss 2024-09-14T11:32:05.232 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:05.233+0000 7f45669169c0 20 rados->read ofs=0 len=0 2024-09-14T11:32:05.233 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:05.233+0000 7f45669169c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:32:05.233 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:05.233+0000 7f45669169c0 10 cache put: name=default.rgw.log++pubsub..bucket.test-client.0-r-test-multipart-defer-complete.1/d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.11 info.flags=0x0 2024-09-14T11:32:05.233 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:05.233+0000 7f45669169c0 10 adding default.rgw.log++pubsub..bucket.test-client.0-r-test-multipart-defer-complete.1/d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.11 to cache LRU end 2024-09-14T11:32:05.237 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:05.237+0000 7f45669169c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-defer-update-complete.1:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.12 : miss 2024-09-14T11:32:05.237 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:05.237+0000 7f45669169c0 20 rados->read ofs=0 len=0 2024-09-14T11:32:05.238 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:05.241+0000 7f45669169c0 20 rados_obj.operate() r=0 bl.length=464 2024-09-14T11:32:05.238 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:05.241+0000 7f45669169c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-defer-update-complete.1:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.12 info.flags=0x17 2024-09-14T11:32:05.238 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:05.241+0000 7f45669169c0 10 adding default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-defer-update-complete.1:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.12 to cache LRU end 2024-09-14T11:32:05.238 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:05.241+0000 7f45669169c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:32:05.239 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:05.241+0000 7f45669169c0 10 updating xattr: name=user.rgw.acl bl.length()=209 2024-09-14T11:32:05.239 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:05.241+0000 7f45669169c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-defer-update-complete.1:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.12 2024-09-14T11:32:05.248 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:05.249+0000 7f45669169c0 10 cls_bucket_list_unordered: got foo 2024-09-14T11:32:05.248 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:05.249+0000 7f45669169c0 20 get_obj_state: octx=0x55e2432f5cd0 obj=test-client.0-r-test-multipart-defer-update-complete.1:foo state=0x55e2432efaf8 s->prefetch_data=0 2024-09-14T11:32:05.249 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:05.249+0000 7f45669169c0 10 manifest: total_size = 886297 2024-09-14T11:32:05.249 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:05.249+0000 7f45669169c0 20 get_obj_state: setting s->obj_tag to d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.13110476449350126498 2024-09-14T11:32:05.249 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:05.249+0000 7f45669169c0 20 get_obj_state: octx=0x55e2432f5cd0 obj=test-client.0-r-test-multipart-defer-update-complete.1:foo state=0x55e2432efaf8 s->prefetch_data=0 2024-09-14T11:32:05.249 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:05.249+0000 7f45669169c0 20 prepare_atomic_modification: state is not atomic. state=0x55e2432efaf8 2024-09-14T11:32:05.249 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:05.249+0000 7f45669169c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.12.10 2024-09-14T11:32:05.254 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:05.257+0000 7f45669169c0 20 RGWObjManifest::operator++(): rule->part_size=246247 rules.size()=2 2024-09-14T11:32:05.255 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:05.257+0000 7f45669169c0 20 RGWObjManifest::operator++(): stripe_ofs=4194304 part_ofs=0 rule->part_size=246247 2024-09-14T11:32:05.255 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:05.257+0000 7f45669169c0 20 RGWObjManifest::operator++(): result: ofs=246247 stripe_ofs=246247 part_ofs=246247 rule->part_size=246247 2024-09-14T11:32:05.255 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:05.257+0000 7f45669169c0 20 RGWObjManifest::operator++(): rule->part_size=246247 rules.size()=2 2024-09-14T11:32:05.255 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:05.257+0000 7f45669169c0 20 RGWObjManifest::operator++(): stripe_ofs=4440551 part_ofs=246247 rule->part_size=246247 2024-09-14T11:32:05.255 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:05.257+0000 7f45669169c0 20 RGWObjManifest::operator++(): result: ofs=492494 stripe_ofs=492494 part_ofs=492494 rule->part_size=246247 2024-09-14T11:32:05.255 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:05.257+0000 7f45669169c0 20 RGWObjManifest::operator++(): rule->part_size=246247 rules.size()=2 2024-09-14T11:32:05.255 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:05.257+0000 7f45669169c0 20 RGWObjManifest::operator++(): stripe_ofs=4686798 part_ofs=492494 rule->part_size=246247 2024-09-14T11:32:05.255 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:05.257+0000 7f45669169c0 20 RGWObjManifest::operator++(): result: ofs=738741 stripe_ofs=738741 part_ofs=738741 rule->part_size=147556 2024-09-14T11:32:05.255 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:05.257+0000 7f45669169c0 20 RGWObjManifest::operator++(): rule->part_size=147556 rules.size()=2 2024-09-14T11:32:05.255 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:05.257+0000 7f45669169c0 20 RGWObjManifest::operator++(): stripe_ofs=4933045 part_ofs=738741 rule->part_size=147556 2024-09-14T11:32:05.255 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:05.257+0000 7f45669169c0 20 RGWObjManifest::operator++(): result: ofs=886297 stripe_ofs=886297 part_ofs=886297 rule->part_size=147556 2024-09-14T11:32:05.256 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:05.257+0000 7f45669169c0 20 garbage collection: RGWGC::send_split_chain - tag is: d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.13110476449350126498 2024-09-14T11:32:05.256 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:05.257+0000 7f45669169c0 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-14T11:32:05.256 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:05.257+0000 7f45669169c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.12__multipart_foo.2~4dVDGM3u1KgnsS33Ww3jPh32wuEAh-b.1 2024-09-14T11:32:05.256 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:05.257+0000 7f45669169c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 347 2024-09-14T11:32:05.256 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:05.257+0000 7f45669169c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.12__multipart_foo.2~4dVDGM3u1KgnsS33Ww3jPh32wuEAh-b.2 2024-09-14T11:32:05.256 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:05.257+0000 7f45669169c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 593 2024-09-14T11:32:05.256 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:05.257+0000 7f45669169c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.12__multipart_foo.2~4dVDGM3u1KgnsS33Ww3jPh32wuEAh-b.3 2024-09-14T11:32:05.256 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:05.257+0000 7f45669169c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 839 2024-09-14T11:32:05.256 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:05.257+0000 7f45669169c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.12__multipart_foo.2~4dVDGM3u1KgnsS33Ww3jPh32wuEAh-b.4 2024-09-14T11:32:05.256 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:05.257+0000 7f45669169c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 1085 2024-09-14T11:32:05.257 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:05.257+0000 7f45669169c0 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-14T11:32:05.257 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:05.257+0000 7f45669169c0 20 garbage collection: RGWGC::send_chain - on object name: gc.30tag is: d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.13110476449350126498 2024-09-14T11:32:05.257 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:05.257+0000 7f443b7fe640 20 handle_completion(): completion ok for obj=foo 2024-09-14T11:32:05.258 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:05.257+0000 7f45669169c0 20 list_objects_ordered: starting attempt 1 2024-09-14T11:32:05.258 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:05.257+0000 7f45669169c0 10 cls_bucket_list_ordered: request from each of 11 shard(s) for 112 entries to get 1001 total entries 2024-09-14T11:32:05.260 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:05.261+0000 7f45669169c0 20 cls_bucket_list_ordered: returning, count=0, is_truncated=0 2024-09-14T11:32:05.260 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:05.261+0000 7f45669169c0 20 cls_bucket_list_ordered: returning, last_entry NOT SET 2024-09-14T11:32:05.260 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:05.261+0000 7f45669169c0 10 list_objects_ordered: end of outer loop, truncated=0, count=0, attempt=1 2024-09-14T11:32:05.260 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:05.261+0000 7f45669169c0 10 list_objects_ordered: exiting attempt loop because we reached end (0) or we're returning half the requested entries (0 of 1000) 2024-09-14T11:32:05.260 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:05.261+0000 7f45669169c0 20 abort_multiparts INFO: aborting and cleaning up multipart upload(s); bucket=":test-client.0-r-test-multipart-defer-update-complete.1[d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.12])"; uploads.size()=0; is_truncated=0 2024-09-14T11:32:05.263 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:05.265+0000 7f45669169c0 10 cache get: name=default.rgw.meta+root+test-client.0-r-test-multipart-defer-update-complete.1 : miss 2024-09-14T11:32:05.263 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:05.265+0000 7f45669169c0 20 rados->read ofs=0 len=0 2024-09-14T11:32:05.264 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:05.265+0000 7f45669169c0 20 rados_obj.operate() r=0 bl.length=242 2024-09-14T11:32:05.264 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:05.265+0000 7f45669169c0 10 cache put: name=default.rgw.meta+root+test-client.0-r-test-multipart-defer-update-complete.1 info.flags=0x11 2024-09-14T11:32:05.264 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:05.265+0000 7f45669169c0 10 adding default.rgw.meta+root+test-client.0-r-test-multipart-defer-update-complete.1 to cache LRU end 2024-09-14T11:32:05.267 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:05.269+0000 7f45669169c0 10 removing default.rgw.meta+root+test-client.0-r-test-multipart-defer-update-complete.1 from cache 2024-09-14T11:32:05.267 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:05.269+0000 7f45669169c0 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 1, obj: default.rgw.meta:root:test-client.0-r-test-multipart-defer-update-complete.1, ofs0, ns] 2024-09-14T11:32:05.268 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:05.269+0000 7f443b7fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366163 cookie 94430277893856 notifier 5874 bl.length()=198 2024-09-14T11:32:05.273 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:05.273+0000 7f45669169c0 10 removing default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-defer-update-complete.1:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.12 from cache 2024-09-14T11:32:05.273 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:05.273+0000 7f45669169c0 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 1, obj: default.rgw.meta:root:.bucket.meta.test-client.0-r-test-multipart-defer-update-complete.1:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.12, ofs0, ns] 2024-09-14T11:32:05.273 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:05.277+0000 7f443b7fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366205 cookie 94430277921952 notifier 5874 bl.length()=256 2024-09-14T11:32:05.281 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:05.281+0000 7f45669169c0 10 cache get: name=default.rgw.log++pubsub..bucket.test-client.0-r-test-multipart-defer-update-complete.1/d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.12 : miss 2024-09-14T11:32:05.281 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:05.281+0000 7f45669169c0 20 rados->read ofs=0 len=0 2024-09-14T11:32:05.282 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:05.281+0000 7f45669169c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:32:05.282 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:05.281+0000 7f45669169c0 10 cache put: name=default.rgw.log++pubsub..bucket.test-client.0-r-test-multipart-defer-update-complete.1/d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.12 info.flags=0x0 2024-09-14T11:32:05.282 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:05.281+0000 7f45669169c0 10 adding default.rgw.log++pubsub..bucket.test-client.0-r-test-multipart-defer-update-complete.1/d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.12 to cache LRU end 2024-09-14T11:32:05.285 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:05.285+0000 7f45669169c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-index-versioning.1:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.10 : miss 2024-09-14T11:32:05.285 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:05.285+0000 7f45669169c0 20 rados->read ofs=0 len=0 2024-09-14T11:32:05.286 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:05.289+0000 7f45669169c0 20 rados_obj.operate() r=0 bl.length=459 2024-09-14T11:32:05.286 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:05.289+0000 7f45669169c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-index-versioning.1:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.10 info.flags=0x17 2024-09-14T11:32:05.286 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:05.289+0000 7f45669169c0 10 adding default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-index-versioning.1:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.10 to cache LRU end 2024-09-14T11:32:05.286 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:05.289+0000 7f45669169c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:32:05.287 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:05.289+0000 7f45669169c0 10 updating xattr: name=user.rgw.acl bl.length()=209 2024-09-14T11:32:05.287 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:05.289+0000 7f45669169c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-index-versioning.1:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.10 2024-09-14T11:32:05.294 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:05.297+0000 7f45669169c0 10 cls_bucket_list_unordered: got foo[1w57KoAzFEAfutyZs-rqj5NzquMEJG5] 2024-09-14T11:32:05.294 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:05.297+0000 7f45669169c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.10.10 2024-09-14T11:32:05.294 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:05.297+0000 7f45669169c0 20 get_obj_state: octx=0x55e2432f69b0 obj=test-client.0-r-test-multipart-index-versioning.1:foo state=0x55e2432efa48 s->prefetch_data=0 2024-09-14T11:32:05.295 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:05.297+0000 7f45669169c0 20 get_obj_state: setting s->obj_tag to k7v69yppmj2o9156kjqinrsf90p95che 2024-09-14T11:32:05.295 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:05.297+0000 7f45669169c0 20 get_obj_state_impl: setting s->olh_tag to 0ogqqlnl7tbbpmdvfs83l5q1avipgdhq 2024-09-14T11:32:05.295 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:05.297+0000 7f45669169c0 20 bucket_index_guard_olh_op(): olh_state.olh_tag=0ogqqlnl7tbbpmdvfs83l5q1avipgdhq 2024-09-14T11:32:05.298 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:05.301+0000 7f45669169c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.10.10 2024-09-14T11:32:05.301 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:05.301+0000 7f45669169c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.10.10 2024-09-14T11:32:05.302 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:05.305+0000 7f45669169c0 20 olh_log_entry: epoch=3 op=2 key=foo[] 2024-09-14T11:32:05.302 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:05.305+0000 7f45669169c0 20 olh_log_entry: epoch=3 op=3 key=foo[1w57KoAzFEAfutyZs-rqj5NzquMEJG5] 2024-09-14T11:32:05.302 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:05.305+0000 7f45669169c0 20 get_obj_state: octx=0x55e2432f69b0 obj=test-client.0-r-test-multipart-index-versioning.1:_:1w57KoAzFEAfutyZs-rqj5NzquMEJG5_foo state=0x55e2432f7758 s->prefetch_data=0 2024-09-14T11:32:05.304 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:05.305+0000 7f45669169c0 10 manifest: total_size = 886297 2024-09-14T11:32:05.304 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:05.305+0000 7f45669169c0 20 get_obj_state: setting s->obj_tag to d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.5546280612240818718 2024-09-14T11:32:05.304 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:05.305+0000 7f45669169c0 20 get_obj_state: octx=0x55e2432f69b0 obj=test-client.0-r-test-multipart-index-versioning.1:_:1w57KoAzFEAfutyZs-rqj5NzquMEJG5_foo state=0x55e2432f7758 s->prefetch_data=0 2024-09-14T11:32:05.304 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:05.305+0000 7f45669169c0 20 prepare_atomic_modification: state is not atomic. state=0x55e2432f7758 2024-09-14T11:32:05.304 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:05.305+0000 7f45669169c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.10.10 2024-09-14T11:32:05.310 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:05.313+0000 7f45669169c0 20 RGWObjManifest::operator++(): rule->part_size=246247 rules.size()=2 2024-09-14T11:32:05.310 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:05.313+0000 7f45669169c0 20 RGWObjManifest::operator++(): stripe_ofs=4194304 part_ofs=0 rule->part_size=246247 2024-09-14T11:32:05.310 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:05.313+0000 7f45669169c0 20 RGWObjManifest::operator++(): result: ofs=246247 stripe_ofs=246247 part_ofs=246247 rule->part_size=246247 2024-09-14T11:32:05.310 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:05.313+0000 7f45669169c0 20 RGWObjManifest::operator++(): rule->part_size=246247 rules.size()=2 2024-09-14T11:32:05.310 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:05.313+0000 7f45669169c0 20 RGWObjManifest::operator++(): stripe_ofs=4440551 part_ofs=246247 rule->part_size=246247 2024-09-14T11:32:05.311 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:05.313+0000 7f45669169c0 20 RGWObjManifest::operator++(): result: ofs=492494 stripe_ofs=492494 part_ofs=492494 rule->part_size=246247 2024-09-14T11:32:05.311 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:05.313+0000 7f45669169c0 20 RGWObjManifest::operator++(): rule->part_size=246247 rules.size()=2 2024-09-14T11:32:05.311 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:05.313+0000 7f45669169c0 20 RGWObjManifest::operator++(): stripe_ofs=4686798 part_ofs=492494 rule->part_size=246247 2024-09-14T11:32:05.311 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:05.313+0000 7f45669169c0 20 RGWObjManifest::operator++(): result: ofs=738741 stripe_ofs=738741 part_ofs=738741 rule->part_size=147556 2024-09-14T11:32:05.311 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:05.313+0000 7f45669169c0 20 RGWObjManifest::operator++(): rule->part_size=147556 rules.size()=2 2024-09-14T11:32:05.311 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:05.313+0000 7f45669169c0 20 RGWObjManifest::operator++(): stripe_ofs=4933045 part_ofs=738741 rule->part_size=147556 2024-09-14T11:32:05.311 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:05.313+0000 7f45669169c0 20 RGWObjManifest::operator++(): result: ofs=886297 stripe_ofs=886297 part_ofs=886297 rule->part_size=147556 2024-09-14T11:32:05.311 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:05.313+0000 7f45669169c0 20 garbage collection: RGWGC::send_split_chain - tag is: d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.5546280612240818718 2024-09-14T11:32:05.311 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:05.313+0000 7f45669169c0 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-14T11:32:05.311 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:05.313+0000 7f45669169c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.10__multipart_foo.2~hxXP3APPkpJDyLpiMGWUkxR-84eHuei.1 2024-09-14T11:32:05.312 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:05.313+0000 7f45669169c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 346 2024-09-14T11:32:05.312 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:05.313+0000 7f45669169c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.10__multipart_foo.2~hxXP3APPkpJDyLpiMGWUkxR-84eHuei.2 2024-09-14T11:32:05.312 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:05.313+0000 7f45669169c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 592 2024-09-14T11:32:05.312 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:05.313+0000 7f45669169c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.10__multipart_foo.2~hxXP3APPkpJDyLpiMGWUkxR-84eHuei.3 2024-09-14T11:32:05.312 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:05.313+0000 7f45669169c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 838 2024-09-14T11:32:05.312 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:05.313+0000 7f45669169c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.10__multipart_foo.2~hxXP3APPkpJDyLpiMGWUkxR-84eHuei.4 2024-09-14T11:32:05.312 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:05.313+0000 7f45669169c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 1084 2024-09-14T11:32:05.312 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:05.313+0000 7f45669169c0 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-14T11:32:05.312 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:05.313+0000 7f45669169c0 20 garbage collection: RGWGC::send_chain - on object name: gc.2tag is: d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.5546280612240818718 2024-09-14T11:32:05.313 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:05.313+0000 7f443affd640 20 handle_completion(): completion ok for obj=foo[1w57KoAzFEAfutyZs-rqj5NzquMEJG5] 2024-09-14T11:32:05.315 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:05.317+0000 7f45669169c0 20 get_obj_state: octx=0x55e2432f69b0 obj=test-client.0-r-test-multipart-index-versioning.1:foo state=0x55e2432efa48 s->prefetch_data=0 2024-09-14T11:32:05.318 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:05.321+0000 7f45669169c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.10.10 2024-09-14T11:32:05.321 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:05.321+0000 7f45669169c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.10.10 2024-09-14T11:32:05.321 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:05.321+0000 7f45669169c0 20 list_objects_ordered: starting attempt 1 2024-09-14T11:32:05.321 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:05.321+0000 7f45669169c0 10 cls_bucket_list_ordered: request from each of 11 shard(s) for 112 entries to get 1001 total entries 2024-09-14T11:32:05.323 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:05.325+0000 7f45669169c0 20 cls_bucket_list_ordered: returning, count=0, is_truncated=0 2024-09-14T11:32:05.323 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:05.325+0000 7f45669169c0 20 cls_bucket_list_ordered: returning, last_entry NOT SET 2024-09-14T11:32:05.324 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:05.325+0000 7f45669169c0 10 list_objects_ordered: end of outer loop, truncated=0, count=0, attempt=1 2024-09-14T11:32:05.324 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:05.325+0000 7f45669169c0 10 list_objects_ordered: exiting attempt loop because we reached end (0) or we're returning half the requested entries (0 of 1000) 2024-09-14T11:32:05.324 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:05.325+0000 7f45669169c0 20 abort_multiparts INFO: aborting and cleaning up multipart upload(s); bucket=":test-client.0-r-test-multipart-index-versioning.1[d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.10])"; uploads.size()=0; is_truncated=0 2024-09-14T11:32:05.327 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:05.329+0000 7f45669169c0 10 cache get: name=default.rgw.meta+root+test-client.0-r-test-multipart-index-versioning.1 : miss 2024-09-14T11:32:05.327 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:05.329+0000 7f45669169c0 20 rados->read ofs=0 len=0 2024-09-14T11:32:05.328 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:05.329+0000 7f45669169c0 20 rados_obj.operate() r=0 bl.length=237 2024-09-14T11:32:05.328 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:05.329+0000 7f45669169c0 10 cache put: name=default.rgw.meta+root+test-client.0-r-test-multipart-index-versioning.1 info.flags=0x11 2024-09-14T11:32:05.328 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:05.329+0000 7f45669169c0 10 adding default.rgw.meta+root+test-client.0-r-test-multipart-index-versioning.1 to cache LRU end 2024-09-14T11:32:05.330 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:05.333+0000 7f45669169c0 10 removing default.rgw.meta+root+test-client.0-r-test-multipart-index-versioning.1 from cache 2024-09-14T11:32:05.330 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:05.333+0000 7f45669169c0 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 1, obj: default.rgw.meta:root:test-client.0-r-test-multipart-index-versioning.1, ofs0, ns] 2024-09-14T11:32:05.331 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:05.333+0000 7f443affd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366164 cookie 94430277893856 notifier 5874 bl.length()=193 2024-09-14T11:32:05.338 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:05.341+0000 7f45669169c0 10 removing default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-index-versioning.1:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.10 from cache 2024-09-14T11:32:05.338 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:05.341+0000 7f45669169c0 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 1, obj: default.rgw.meta:root:.bucket.meta.test-client.0-r-test-multipart-index-versioning.1:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.10, ofs0, ns] 2024-09-14T11:32:05.338 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:05.341+0000 7f443b7fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366200 cookie 94430277934704 notifier 5874 bl.length()=251 2024-09-14T11:32:05.347 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:05.349+0000 7f45669169c0 10 cache get: name=default.rgw.log++pubsub..bucket.test-client.0-r-test-multipart-index-versioning.1/d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.10 : miss 2024-09-14T11:32:05.347 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:05.349+0000 7f45669169c0 20 rados->read ofs=0 len=0 2024-09-14T11:32:05.348 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:05.349+0000 7f45669169c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:32:05.348 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:05.349+0000 7f45669169c0 10 cache put: name=default.rgw.log++pubsub..bucket.test-client.0-r-test-multipart-index-versioning.1/d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.10 info.flags=0x0 2024-09-14T11:32:05.348 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:05.349+0000 7f45669169c0 10 adding default.rgw.log++pubsub..bucket.test-client.0-r-test-multipart-index-versioning.1/d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.10 to cache LRU end 2024-09-14T11:32:05.353 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:05.353+0000 7f45669169c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-simple.1:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.9 : miss 2024-09-14T11:32:05.353 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:05.353+0000 7f45669169c0 20 rados->read ofs=0 len=0 2024-09-14T11:32:05.354 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:05.357+0000 7f45669169c0 20 rados_obj.operate() r=0 bl.length=447 2024-09-14T11:32:05.354 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:05.357+0000 7f45669169c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-simple.1:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.9 info.flags=0x17 2024-09-14T11:32:05.355 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:05.357+0000 7f45669169c0 10 adding default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-simple.1:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.9 to cache LRU end 2024-09-14T11:32:05.355 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:05.357+0000 7f45669169c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:32:05.355 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:05.357+0000 7f45669169c0 10 updating xattr: name=user.rgw.acl bl.length()=209 2024-09-14T11:32:05.355 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:05.357+0000 7f45669169c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-simple.1:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.9 2024-09-14T11:32:05.364 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:05.365+0000 7f45669169c0 10 cls_bucket_list_unordered: got foo 2024-09-14T11:32:05.364 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:05.365+0000 7f45669169c0 20 get_obj_state: octx=0x55e2432f2160 obj=test-client.0-r-test-multipart-simple.1:foo state=0x55e2432f9528 s->prefetch_data=0 2024-09-14T11:32:05.365 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:05.365+0000 7f45669169c0 10 manifest: total_size = 1667 2024-09-14T11:32:05.366 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:05.365+0000 7f45669169c0 20 get_obj_state: setting s->obj_tag to d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.15326086721908118623 2024-09-14T11:32:05.366 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:05.365+0000 7f45669169c0 20 get_obj_state: octx=0x55e2432f2160 obj=test-client.0-r-test-multipart-simple.1:foo state=0x55e2432f9528 s->prefetch_data=0 2024-09-14T11:32:05.366 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:05.365+0000 7f45669169c0 20 prepare_atomic_modification: state is not atomic. state=0x55e2432f9528 2024-09-14T11:32:05.366 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:05.365+0000 7f45669169c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.9.10 2024-09-14T11:32:05.373 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:05.373+0000 7f45669169c0 20 RGWObjManifest::operator++(): rule->part_size=516 rules.size()=2 2024-09-14T11:32:05.373 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:05.373+0000 7f45669169c0 20 RGWObjManifest::operator++(): stripe_ofs=4194304 part_ofs=0 rule->part_size=516 2024-09-14T11:32:05.373 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:05.373+0000 7f45669169c0 20 RGWObjManifest::operator++(): result: ofs=516 stripe_ofs=516 part_ofs=516 rule->part_size=516 2024-09-14T11:32:05.373 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:05.373+0000 7f45669169c0 20 RGWObjManifest::operator++(): rule->part_size=516 rules.size()=2 2024-09-14T11:32:05.373 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:05.373+0000 7f45669169c0 20 RGWObjManifest::operator++(): stripe_ofs=4194820 part_ofs=516 rule->part_size=516 2024-09-14T11:32:05.374 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:05.373+0000 7f45669169c0 20 RGWObjManifest::operator++(): result: ofs=1032 stripe_ofs=1032 part_ofs=1032 rule->part_size=516 2024-09-14T11:32:05.374 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:05.373+0000 7f45669169c0 20 RGWObjManifest::operator++(): rule->part_size=516 rules.size()=2 2024-09-14T11:32:05.374 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:05.373+0000 7f45669169c0 20 RGWObjManifest::operator++(): stripe_ofs=4195336 part_ofs=1032 rule->part_size=516 2024-09-14T11:32:05.374 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:05.373+0000 7f45669169c0 20 RGWObjManifest::operator++(): result: ofs=1548 stripe_ofs=1548 part_ofs=1548 rule->part_size=119 2024-09-14T11:32:05.374 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:05.373+0000 7f45669169c0 20 RGWObjManifest::operator++(): rule->part_size=119 rules.size()=2 2024-09-14T11:32:05.374 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:05.373+0000 7f45669169c0 20 RGWObjManifest::operator++(): stripe_ofs=4195852 part_ofs=1548 rule->part_size=119 2024-09-14T11:32:05.374 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:05.373+0000 7f45669169c0 20 RGWObjManifest::operator++(): result: ofs=1667 stripe_ofs=1667 part_ofs=1667 rule->part_size=119 2024-09-14T11:32:05.374 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:05.373+0000 7f45669169c0 20 garbage collection: RGWGC::send_split_chain - tag is: d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.15326086721908118623 2024-09-14T11:32:05.374 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:05.373+0000 7f45669169c0 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-14T11:32:05.374 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:05.373+0000 7f45669169c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.9__multipart_foo.2~ZrfKU_tie4o4fTMusfwdbfW2krsD8OK.1 2024-09-14T11:32:05.375 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:05.373+0000 7f45669169c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 345 2024-09-14T11:32:05.375 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:05.373+0000 7f45669169c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.9__multipart_foo.2~ZrfKU_tie4o4fTMusfwdbfW2krsD8OK.2 2024-09-14T11:32:05.375 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:05.373+0000 7f45669169c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 589 2024-09-14T11:32:05.375 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:05.373+0000 7f45669169c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.9__multipart_foo.2~ZrfKU_tie4o4fTMusfwdbfW2krsD8OK.3 2024-09-14T11:32:05.375 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:05.373+0000 7f45669169c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 833 2024-09-14T11:32:05.375 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:05.373+0000 7f45669169c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.9__multipart_foo.2~ZrfKU_tie4o4fTMusfwdbfW2krsD8OK.4 2024-09-14T11:32:05.375 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:05.373+0000 7f45669169c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 1077 2024-09-14T11:32:05.375 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:05.373+0000 7f45669169c0 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-14T11:32:05.375 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:05.373+0000 7f45669169c0 20 garbage collection: RGWGC::send_chain - on object name: gc.22tag is: d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.15326086721908118623 2024-09-14T11:32:05.376 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:05.377+0000 7f45669169c0 20 list_objects_ordered: starting attempt 1 2024-09-14T11:32:05.376 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:05.377+0000 7f45669169c0 10 cls_bucket_list_ordered: request from each of 11 shard(s) for 112 entries to get 1001 total entries 2024-09-14T11:32:05.376 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:05.377+0000 7f443affd640 20 handle_completion(): completion ok for obj=foo 2024-09-14T11:32:05.377 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:05.377+0000 7f45669169c0 20 cls_bucket_list_ordered: returning, count=0, is_truncated=0 2024-09-14T11:32:05.377 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:05.377+0000 7f45669169c0 20 cls_bucket_list_ordered: returning, last_entry NOT SET 2024-09-14T11:32:05.377 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:05.377+0000 7f45669169c0 10 list_objects_ordered: end of outer loop, truncated=0, count=0, attempt=1 2024-09-14T11:32:05.378 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:05.377+0000 7f45669169c0 10 list_objects_ordered: exiting attempt loop because we reached end (0) or we're returning half the requested entries (0 of 1000) 2024-09-14T11:32:05.378 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:05.377+0000 7f45669169c0 20 abort_multiparts INFO: aborting and cleaning up multipart upload(s); bucket=":test-client.0-r-test-multipart-simple.1[d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.9])"; uploads.size()=0; is_truncated=0 2024-09-14T11:32:05.381 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:05.381+0000 7f45669169c0 10 cache get: name=default.rgw.meta+root+test-client.0-r-test-multipart-simple.1 : miss 2024-09-14T11:32:05.381 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:05.381+0000 7f45669169c0 20 rados->read ofs=0 len=0 2024-09-14T11:32:05.382 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:05.385+0000 7f45669169c0 20 rados_obj.operate() r=0 bl.length=225 2024-09-14T11:32:05.383 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:05.385+0000 7f45669169c0 10 cache put: name=default.rgw.meta+root+test-client.0-r-test-multipart-simple.1 info.flags=0x11 2024-09-14T11:32:05.383 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:05.385+0000 7f45669169c0 10 adding default.rgw.meta+root+test-client.0-r-test-multipart-simple.1 to cache LRU end 2024-09-14T11:32:05.385 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:05.385+0000 7f45669169c0 10 removing default.rgw.meta+root+test-client.0-r-test-multipart-simple.1 from cache 2024-09-14T11:32:05.385 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:05.385+0000 7f45669169c0 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 1, obj: default.rgw.meta:root:test-client.0-r-test-multipart-simple.1, ofs0, ns] 2024-09-14T11:32:05.386 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:05.389+0000 7f443b7fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366174 cookie 94430277933520 notifier 5874 bl.length()=183 2024-09-14T11:32:05.397 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:05.397+0000 7f45669169c0 10 removing default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-simple.1:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.9 from cache 2024-09-14T11:32:05.397 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:05.397+0000 7f45669169c0 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 1, obj: default.rgw.meta:root:.bucket.meta.test-client.0-r-test-multipart-simple.1:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.9, ofs0, ns] 2024-09-14T11:32:05.397 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:05.401+0000 7f443affd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366175 cookie 94430277933520 notifier 5874 bl.length()=240 2024-09-14T11:32:05.406 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:05.409+0000 7f45669169c0 10 cache get: name=default.rgw.log++pubsub..bucket.test-client.0-r-test-multipart-simple.1/d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.9 : miss 2024-09-14T11:32:05.406 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:05.409+0000 7f45669169c0 20 rados->read ofs=0 len=0 2024-09-14T11:32:05.407 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:05.409+0000 7f45669169c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:32:05.407 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:05.409+0000 7f45669169c0 10 cache put: name=default.rgw.log++pubsub..bucket.test-client.0-r-test-multipart-simple.1/d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.9 info.flags=0x0 2024-09-14T11:32:05.407 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:05.409+0000 7f45669169c0 10 adding default.rgw.log++pubsub..bucket.test-client.0-r-test-multipart-simple.1/d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.9 to cache LRU end 2024-09-14T11:32:05.411 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:05.413+0000 7f45669169c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class-copy.1:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.15 : miss 2024-09-14T11:32:05.411 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:05.413+0000 7f45669169c0 20 rados->read ofs=0 len=0 2024-09-14T11:32:05.413 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:05.413+0000 7f45669169c0 20 rados_obj.operate() r=0 bl.length=455 2024-09-14T11:32:05.413 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:05.413+0000 7f45669169c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class-copy.1:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.15 info.flags=0x17 2024-09-14T11:32:05.413 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:05.413+0000 7f45669169c0 10 adding default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class-copy.1:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.15 to cache LRU end 2024-09-14T11:32:05.413 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:05.413+0000 7f45669169c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:32:05.413 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:05.413+0000 7f45669169c0 10 updating xattr: name=user.rgw.acl bl.length()=209 2024-09-14T11:32:05.413 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:05.413+0000 7f45669169c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class-copy.1:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.15 2024-09-14T11:32:05.414 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:05.413+0000 7f45669169c0 10 cls_bucket_list_unordered: got foo-STANDARD-LUKEWARM 2024-09-14T11:32:05.415 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:05.417+0000 7f45669169c0 10 cls_bucket_list_unordered: got foo-LUKEWARM-STANDARD 2024-09-14T11:32:05.416 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:05.417+0000 7f45669169c0 10 cls_bucket_list_unordered: got foo-FROZEN 2024-09-14T11:32:05.418 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:05.421+0000 7f45669169c0 10 cls_bucket_list_unordered: got foo-FROZEN-LUKEWARM 2024-09-14T11:32:05.418 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:05.421+0000 7f45669169c0 10 cls_bucket_list_unordered: got foo-LUKEWARM-FROZEN 2024-09-14T11:32:05.418 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:05.421+0000 7f45669169c0 10 cls_bucket_list_unordered: got foo-STANDARD 2024-09-14T11:32:05.420 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:05.421+0000 7f45669169c0 10 cls_bucket_list_unordered: got foo-FROZEN-STANDARD 2024-09-14T11:32:05.420 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:05.421+0000 7f45669169c0 10 cls_bucket_list_unordered: got foo-LUKEWARM 2024-09-14T11:32:05.420 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:05.421+0000 7f45669169c0 10 cls_bucket_list_unordered: got foo-STANDARD-STANDARD 2024-09-14T11:32:05.421 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:05.421+0000 7f45669169c0 10 cls_bucket_list_unordered: got foo-LUKEWARM-LUKEWARM 2024-09-14T11:32:05.421 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:05.421+0000 7f45669169c0 10 cls_bucket_list_unordered: got foo-STANDARD-FROZEN 2024-09-14T11:32:05.422 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:05.425+0000 7f45669169c0 10 cls_bucket_list_unordered: got foo-FROZEN-FROZEN 2024-09-14T11:32:05.424 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:05.425+0000 7f45669169c0 20 get_obj_state: octx=0x55e2432f9fd0 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-STANDARD-LUKEWARM state=0x55e243301478 s->prefetch_data=0 2024-09-14T11:32:05.425 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:05.425+0000 7f45669169c0 10 manifest: total_size = 22651 2024-09-14T11:32:05.425 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:05.425+0000 7f45669169c0 20 get_obj_state: setting s->obj_tag to _PzMEvAfXaB-Z0ozvULi7dzkmJnNffDL 2024-09-14T11:32:05.425 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:05.425+0000 7f45669169c0 20 get_obj_state: octx=0x55e2432f9fd0 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-STANDARD-LUKEWARM state=0x55e243301478 s->prefetch_data=0 2024-09-14T11:32:05.425 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:05.425+0000 7f45669169c0 20 prepare_atomic_modification: state is not atomic. state=0x55e243301478 2024-09-14T11:32:05.425 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:05.425+0000 7f45669169c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.15.0 2024-09-14T11:32:05.431 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:05.433+0000 7f45669169c0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-14T11:32:05.431 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:05.433+0000 7f45669169c0 20 RGWObjManifest::operator++(): result: ofs=22651 stripe_ofs=22651 part_ofs=0 rule->part_size=0 2024-09-14T11:32:05.431 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:05.433+0000 7f45669169c0 20 garbage collection: RGWGC::send_split_chain - tag is: _PzMEvAfXaB-Z0ozvULi7dzkmJnNffDL 2024-09-14T11:32:05.431 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:05.433+0000 7f45669169c0 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-14T11:32:05.432 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:05.433+0000 7f45669169c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.15__shadow_.SQ-5na3U6zOsm3iPqR-dQaIbo9eBYo__0 2024-09-14T11:32:05.432 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:05.433+0000 7f45669169c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 310 2024-09-14T11:32:05.432 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:05.433+0000 7f45669169c0 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-14T11:32:05.432 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:05.433+0000 7f45669169c0 20 garbage collection: RGWGC::send_chain - on object name: gc.11tag is: _PzMEvAfXaB-Z0ozvULi7dzkmJnNffDL 2024-09-14T11:32:05.435 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:05.437+0000 7f443affd640 20 handle_completion(): completion ok for obj=foo-STANDARD-LUKEWARM 2024-09-14T11:32:05.435 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:05.437+0000 7f45669169c0 20 get_obj_state: octx=0x55e2432f9f50 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-LUKEWARM-STANDARD state=0x55e243301478 s->prefetch_data=0 2024-09-14T11:32:05.435 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:05.437+0000 7f45669169c0 10 manifest: total_size = 5242880 2024-09-14T11:32:05.435 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:05.437+0000 7f45669169c0 20 get_obj_state: setting s->obj_tag to __dLDhDrgFsWo7ZgUk9emBnKClNEEcyp 2024-09-14T11:32:05.436 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:05.437+0000 7f45669169c0 20 get_obj_state: octx=0x55e2432f9f50 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-LUKEWARM-STANDARD state=0x55e243301478 s->prefetch_data=0 2024-09-14T11:32:05.436 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:05.437+0000 7f45669169c0 20 prepare_atomic_modification: state is not atomic. state=0x55e243301478 2024-09-14T11:32:05.436 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:05.437+0000 7f45669169c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.15.2 2024-09-14T11:32:05.442 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:05.445+0000 7f45669169c0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-14T11:32:05.442 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:05.445+0000 7f45669169c0 20 RGWObjManifest::operator++(): result: ofs=5242880 stripe_ofs=5242880 part_ofs=0 rule->part_size=0 2024-09-14T11:32:05.442 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:05.445+0000 7f45669169c0 20 garbage collection: RGWGC::send_split_chain - tag is: __dLDhDrgFsWo7ZgUk9emBnKClNEEcyp 2024-09-14T11:32:05.442 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:05.445+0000 7f45669169c0 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-14T11:32:05.442 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:05.445+0000 7f45669169c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.15__shadow_.nvPx7fC7ILNKQdusLbhMLFmNY1Qy6js_1 2024-09-14T11:32:05.443 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:05.445+0000 7f45669169c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 301 2024-09-14T11:32:05.443 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:05.445+0000 7f45669169c0 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-14T11:32:05.443 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:05.445+0000 7f45669169c0 20 garbage collection: RGWGC::send_chain - on object name: gc.5tag is: __dLDhDrgFsWo7ZgUk9emBnKClNEEcyp 2024-09-14T11:32:05.446 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:05.449+0000 7f443b7fe640 20 handle_completion(): completion ok for obj=foo-LUKEWARM-STANDARD 2024-09-14T11:32:05.446 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:05.449+0000 7f45669169c0 20 get_obj_state: octx=0x7f455c085f80 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-FROZEN state=0x55e243301478 s->prefetch_data=0 2024-09-14T11:32:05.447 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:05.449+0000 7f45669169c0 10 manifest: total_size = 5242880 2024-09-14T11:32:05.447 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:05.449+0000 7f45669169c0 20 get_obj_state: setting s->obj_tag to d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.9377879263429093203 2024-09-14T11:32:05.447 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:05.449+0000 7f45669169c0 20 get_obj_state: octx=0x7f455c085f80 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-FROZEN state=0x55e243301478 s->prefetch_data=0 2024-09-14T11:32:05.447 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:05.449+0000 7f45669169c0 20 prepare_atomic_modification: state is not atomic. state=0x55e243301478 2024-09-14T11:32:05.447 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:05.449+0000 7f45669169c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.15.3 2024-09-14T11:32:05.453 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:05.453+0000 7f45669169c0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-14T11:32:05.453 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:05.453+0000 7f45669169c0 20 RGWObjManifest::operator++(): result: ofs=4194304 stripe_ofs=4194304 part_ofs=0 rule->part_size=0 2024-09-14T11:32:05.453 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:05.453+0000 7f45669169c0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-14T11:32:05.453 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:05.453+0000 7f45669169c0 20 RGWObjManifest::operator++(): result: ofs=5242880 stripe_ofs=5242880 part_ofs=0 rule->part_size=0 2024-09-14T11:32:05.453 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:05.453+0000 7f45669169c0 20 garbage collection: RGWGC::send_split_chain - tag is: d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.9377879263429093203 2024-09-14T11:32:05.453 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:05.453+0000 7f45669169c0 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-14T11:32:05.453 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:05.453+0000 7f45669169c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.15__shadow_.czFV8GJIao5PhukAtzYwoL8Gui5OUKe_0 2024-09-14T11:32:05.454 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:05.453+0000 7f45669169c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 337 2024-09-14T11:32:05.454 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:05.453+0000 7f45669169c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.15__shadow_.czFV8GJIao5PhukAtzYwoL8Gui5OUKe_1 2024-09-14T11:32:05.454 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:05.453+0000 7f45669169c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 574 2024-09-14T11:32:05.454 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:05.453+0000 7f45669169c0 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-14T11:32:05.454 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:05.453+0000 7f45669169c0 20 garbage collection: RGWGC::send_chain - on object name: gc.2tag is: d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.9377879263429093203 2024-09-14T11:32:05.456 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:05.457+0000 7f45669169c0 20 get_obj_state: octx=0x7f455800f550 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-FROZEN-LUKEWARM state=0x55e243301478 s->prefetch_data=0 2024-09-14T11:32:05.456 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:05.457+0000 7f443affd640 20 handle_completion(): completion ok for obj=foo-FROZEN 2024-09-14T11:32:05.457 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:05.457+0000 7f45669169c0 10 manifest: total_size = 5242880 2024-09-14T11:32:05.457 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:05.457+0000 7f45669169c0 20 get_obj_state: setting s->obj_tag to _0XYeYc-pj73iGLs0k3jog2Jq7mlUGsH 2024-09-14T11:32:05.457 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:05.457+0000 7f45669169c0 20 get_obj_state: octx=0x7f455800f550 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-FROZEN-LUKEWARM state=0x55e243301478 s->prefetch_data=0 2024-09-14T11:32:05.457 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:05.457+0000 7f45669169c0 20 prepare_atomic_modification: state is not atomic. state=0x55e243301478 2024-09-14T11:32:05.457 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:05.457+0000 7f45669169c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.15.5 2024-09-14T11:32:05.463 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:05.465+0000 7f45669169c0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-14T11:32:05.463 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:05.465+0000 7f45669169c0 20 RGWObjManifest::operator++(): result: ofs=4194304 stripe_ofs=4194304 part_ofs=0 rule->part_size=0 2024-09-14T11:32:05.463 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:05.465+0000 7f45669169c0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-14T11:32:05.463 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:05.465+0000 7f45669169c0 20 RGWObjManifest::operator++(): result: ofs=5242880 stripe_ofs=5242880 part_ofs=0 rule->part_size=0 2024-09-14T11:32:05.463 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:05.465+0000 7f45669169c0 20 garbage collection: RGWGC::send_split_chain - tag is: _0XYeYc-pj73iGLs0k3jog2Jq7mlUGsH 2024-09-14T11:32:05.463 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:05.465+0000 7f45669169c0 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-14T11:32:05.463 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:05.465+0000 7f45669169c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.15__shadow_.Y62WBlZnIe4dOsazYGyZZczkQ5PNYez_0 2024-09-14T11:32:05.463 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:05.465+0000 7f45669169c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 310 2024-09-14T11:32:05.464 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:05.465+0000 7f45669169c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.15__shadow_.Y62WBlZnIe4dOsazYGyZZczkQ5PNYez_1 2024-09-14T11:32:05.464 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:05.465+0000 7f45669169c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 549 2024-09-14T11:32:05.464 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:05.465+0000 7f45669169c0 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-14T11:32:05.464 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:05.465+0000 7f45669169c0 20 garbage collection: RGWGC::send_chain - on object name: gc.7tag is: _0XYeYc-pj73iGLs0k3jog2Jq7mlUGsH 2024-09-14T11:32:05.466 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:05.469+0000 7f443b7fe640 20 handle_completion(): completion ok for obj=foo-FROZEN-LUKEWARM 2024-09-14T11:32:05.466 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:05.469+0000 7f45669169c0 20 get_obj_state: octx=0x7f455c008dc0 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-LUKEWARM-FROZEN state=0x55e243301478 s->prefetch_data=0 2024-09-14T11:32:05.467 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:05.469+0000 7f45669169c0 10 manifest: total_size = 5242880 2024-09-14T11:32:05.467 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:05.469+0000 7f45669169c0 20 get_obj_state: setting s->obj_tag to _viD9dxe6cG9KwLNeFVgmZHFEj6p-inj 2024-09-14T11:32:05.467 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:05.469+0000 7f45669169c0 20 get_obj_state: octx=0x7f455c008dc0 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-LUKEWARM-FROZEN state=0x55e243301478 s->prefetch_data=0 2024-09-14T11:32:05.468 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:05.469+0000 7f45669169c0 20 prepare_atomic_modification: state is not atomic. state=0x55e243301478 2024-09-14T11:32:05.468 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:05.469+0000 7f45669169c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.15.5 2024-09-14T11:32:05.474 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:05.477+0000 7f45669169c0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-14T11:32:05.474 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:05.477+0000 7f45669169c0 20 RGWObjManifest::operator++(): result: ofs=4194304 stripe_ofs=4194304 part_ofs=0 rule->part_size=0 2024-09-14T11:32:05.474 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:05.477+0000 7f45669169c0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-14T11:32:05.474 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:05.477+0000 7f45669169c0 20 RGWObjManifest::operator++(): result: ofs=5242880 stripe_ofs=5242880 part_ofs=0 rule->part_size=0 2024-09-14T11:32:05.475 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:05.477+0000 7f45669169c0 20 garbage collection: RGWGC::send_split_chain - tag is: _viD9dxe6cG9KwLNeFVgmZHFEj6p-inj 2024-09-14T11:32:05.475 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:05.477+0000 7f45669169c0 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-14T11:32:05.475 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:05.477+0000 7f45669169c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.15__shadow_.rUv-j407_YxEa1VdsJIBD76IFGVMaRU_0 2024-09-14T11:32:05.475 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:05.477+0000 7f45669169c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 308 2024-09-14T11:32:05.475 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:05.477+0000 7f45669169c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.15__shadow_.rUv-j407_YxEa1VdsJIBD76IFGVMaRU_1 2024-09-14T11:32:05.475 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:05.477+0000 7f45669169c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 545 2024-09-14T11:32:05.475 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:05.477+0000 7f45669169c0 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-14T11:32:05.475 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:05.477+0000 7f45669169c0 20 garbage collection: RGWGC::send_chain - on object name: gc.29tag is: _viD9dxe6cG9KwLNeFVgmZHFEj6p-inj 2024-09-14T11:32:05.478 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:05.481+0000 7f443affd640 20 handle_completion(): completion ok for obj=foo-LUKEWARM-FROZEN 2024-09-14T11:32:05.478 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:05.481+0000 7f45669169c0 20 get_obj_state: octx=0x55e2432f3140 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-STANDARD state=0x55e243301478 s->prefetch_data=0 2024-09-14T11:32:05.479 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:05.481+0000 7f45669169c0 10 manifest: total_size = 22651 2024-09-14T11:32:05.479 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:05.481+0000 7f45669169c0 20 get_obj_state: setting s->obj_tag to d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.10213306138932628897 2024-09-14T11:32:05.479 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:05.481+0000 7f45669169c0 20 get_obj_state: octx=0x55e2432f3140 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-STANDARD state=0x55e243301478 s->prefetch_data=0 2024-09-14T11:32:05.479 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:05.481+0000 7f45669169c0 20 prepare_atomic_modification: state is not atomic. state=0x55e243301478 2024-09-14T11:32:05.479 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:05.481+0000 7f45669169c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.15.5 2024-09-14T11:32:05.486 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:05.489+0000 7f45669169c0 20 get_obj_state: octx=0x55e2432f5eb0 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-FROZEN-STANDARD state=0x55e243301478 s->prefetch_data=0 2024-09-14T11:32:05.487 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:05.489+0000 7f45669169c0 10 manifest: total_size = 5242880 2024-09-14T11:32:05.487 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:05.489+0000 7f45669169c0 20 get_obj_state: setting s->obj_tag to _0dIBN0DJ8oV1Fl36FTpYRxqFDCuhAp9 2024-09-14T11:32:05.487 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:05.489+0000 7f45669169c0 20 get_obj_state: octx=0x55e2432f5eb0 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-FROZEN-STANDARD state=0x55e243301478 s->prefetch_data=0 2024-09-14T11:32:05.487 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:05.489+0000 7f45669169c0 20 prepare_atomic_modification: state is not atomic. state=0x55e243301478 2024-09-14T11:32:05.488 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:05.489+0000 7f45669169c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.15.7 2024-09-14T11:32:05.489 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:05.493+0000 7f443b7fe640 20 handle_completion(): completion ok for obj=foo-STANDARD 2024-09-14T11:32:05.495 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:05.497+0000 7f45669169c0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-14T11:32:05.495 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:05.497+0000 7f45669169c0 20 RGWObjManifest::operator++(): result: ofs=5242880 stripe_ofs=5242880 part_ofs=0 rule->part_size=0 2024-09-14T11:32:05.495 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:05.497+0000 7f45669169c0 20 garbage collection: RGWGC::send_split_chain - tag is: _0dIBN0DJ8oV1Fl36FTpYRxqFDCuhAp9 2024-09-14T11:32:05.495 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:05.497+0000 7f45669169c0 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-14T11:32:05.495 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:05.497+0000 7f45669169c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.15__shadow_.8Sp_E5_mWwDyvaOHZQbi4GlGoQ6brPL_1 2024-09-14T11:32:05.495 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:05.497+0000 7f45669169c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 301 2024-09-14T11:32:05.495 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:05.497+0000 7f45669169c0 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-14T11:32:05.495 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:05.497+0000 7f45669169c0 20 garbage collection: RGWGC::send_chain - on object name: gc.13tag is: _0dIBN0DJ8oV1Fl36FTpYRxqFDCuhAp9 2024-09-14T11:32:05.498 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:05.500+0000 7f443affd640 20 handle_completion(): completion ok for obj=foo-FROZEN-STANDARD 2024-09-14T11:32:05.498 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:05.500+0000 7f45669169c0 20 get_obj_state: octx=0x7f455c085f80 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-LUKEWARM state=0x55e243301478 s->prefetch_data=0 2024-09-14T11:32:05.499 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:05.500+0000 7f45669169c0 10 manifest: total_size = 5242880 2024-09-14T11:32:05.499 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:05.500+0000 7f45669169c0 20 get_obj_state: setting s->obj_tag to d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.2124295278352644901 2024-09-14T11:32:05.499 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:05.500+0000 7f45669169c0 20 get_obj_state: octx=0x7f455c085f80 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-LUKEWARM state=0x55e243301478 s->prefetch_data=0 2024-09-14T11:32:05.499 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:05.500+0000 7f45669169c0 20 prepare_atomic_modification: state is not atomic. state=0x55e243301478 2024-09-14T11:32:05.500 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:05.500+0000 7f45669169c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.15.7 2024-09-14T11:32:05.506 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:05.508+0000 7f45669169c0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-14T11:32:05.506 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:05.508+0000 7f45669169c0 20 RGWObjManifest::operator++(): result: ofs=4194304 stripe_ofs=4194304 part_ofs=0 rule->part_size=0 2024-09-14T11:32:05.506 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:05.508+0000 7f45669169c0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-14T11:32:05.507 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:05.508+0000 7f45669169c0 20 RGWObjManifest::operator++(): result: ofs=5242880 stripe_ofs=5242880 part_ofs=0 rule->part_size=0 2024-09-14T11:32:05.507 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:05.508+0000 7f45669169c0 20 garbage collection: RGWGC::send_split_chain - tag is: d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.2124295278352644901 2024-09-14T11:32:05.507 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:05.508+0000 7f45669169c0 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-14T11:32:05.507 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:05.508+0000 7f45669169c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.15__shadow_.IouNIhFT_69g4e7E8oqCum2yFqK0-2h_0 2024-09-14T11:32:05.507 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:05.508+0000 7f45669169c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 339 2024-09-14T11:32:05.507 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:05.508+0000 7f45669169c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.15__shadow_.IouNIhFT_69g4e7E8oqCum2yFqK0-2h_1 2024-09-14T11:32:05.507 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:05.508+0000 7f45669169c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 578 2024-09-14T11:32:05.507 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:05.508+0000 7f45669169c0 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-14T11:32:05.507 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:05.508+0000 7f45669169c0 20 garbage collection: RGWGC::send_chain - on object name: gc.24tag is: d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.2124295278352644901 2024-09-14T11:32:05.510 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:05.512+0000 7f443b7fe640 20 handle_completion(): completion ok for obj=foo-LUKEWARM 2024-09-14T11:32:05.510 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:05.512+0000 7f45669169c0 20 get_obj_state: octx=0x55e2432f9dc0 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-STANDARD-STANDARD state=0x55e243301478 s->prefetch_data=0 2024-09-14T11:32:05.511 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:05.512+0000 7f45669169c0 10 manifest: total_size = 22651 2024-09-14T11:32:05.511 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:05.512+0000 7f45669169c0 20 get_obj_state: setting s->obj_tag to _-U3nqXAKqS1Qs4Mze_Al8LO3o9YTbp0 2024-09-14T11:32:05.511 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:05.512+0000 7f45669169c0 20 get_obj_state: octx=0x55e2432f9dc0 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-STANDARD-STANDARD state=0x55e243301478 s->prefetch_data=0 2024-09-14T11:32:05.511 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:05.512+0000 7f45669169c0 20 prepare_atomic_modification: state is not atomic. state=0x55e243301478 2024-09-14T11:32:05.512 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:05.512+0000 7f45669169c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.15.7 2024-09-14T11:32:05.517 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:05.520+0000 7f45669169c0 20 get_obj_state: octx=0x7f455c097990 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-LUKEWARM-LUKEWARM state=0x55e243301478 s->prefetch_data=0 2024-09-14T11:32:05.519 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:05.520+0000 7f45669169c0 10 manifest: total_size = 5242880 2024-09-14T11:32:05.519 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:05.520+0000 7f45669169c0 20 get_obj_state: setting s->obj_tag to d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.14065569718826300884 2024-09-14T11:32:05.519 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:05.520+0000 7f45669169c0 20 get_obj_state: octx=0x7f455c097990 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-LUKEWARM-LUKEWARM state=0x55e243301478 s->prefetch_data=0 2024-09-14T11:32:05.519 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:05.520+0000 7f45669169c0 20 prepare_atomic_modification: state is not atomic. state=0x55e243301478 2024-09-14T11:32:05.519 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:05.520+0000 7f45669169c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.15.8 2024-09-14T11:32:05.521 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:05.520+0000 7f443affd640 20 handle_completion(): completion ok for obj=foo-STANDARD-STANDARD 2024-09-14T11:32:05.525 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:05.524+0000 7f45669169c0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-14T11:32:05.526 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:05.524+0000 7f45669169c0 20 RGWObjManifest::operator++(): result: ofs=4194304 stripe_ofs=4194304 part_ofs=0 rule->part_size=0 2024-09-14T11:32:05.526 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:05.524+0000 7f45669169c0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-14T11:32:05.526 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:05.524+0000 7f45669169c0 20 RGWObjManifest::operator++(): result: ofs=5242880 stripe_ofs=5242880 part_ofs=0 rule->part_size=0 2024-09-14T11:32:05.526 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:05.524+0000 7f45669169c0 20 garbage collection: RGWGC::send_split_chain - tag is: d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.14065569718826300884 2024-09-14T11:32:05.526 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:05.524+0000 7f45669169c0 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-14T11:32:05.526 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:05.524+0000 7f45669169c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.15__shadow_.IouNIhFT_69g4e7E8oqCum2yFqK0-2h_0 2024-09-14T11:32:05.526 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:05.524+0000 7f45669169c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 340 2024-09-14T11:32:05.526 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:05.524+0000 7f45669169c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.15__shadow_.IouNIhFT_69g4e7E8oqCum2yFqK0-2h_1 2024-09-14T11:32:05.526 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:05.524+0000 7f45669169c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 579 2024-09-14T11:32:05.526 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:05.524+0000 7f45669169c0 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-14T11:32:05.526 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:05.528+0000 7f45669169c0 20 garbage collection: RGWGC::send_chain - on object name: gc.0tag is: d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.14065569718826300884 2024-09-14T11:32:05.529 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:05.528+0000 7f443b7fe640 20 handle_completion(): completion ok for obj=foo-LUKEWARM-LUKEWARM 2024-09-14T11:32:05.529 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:05.528+0000 7f45669169c0 20 get_obj_state: octx=0x7f455c085f80 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-STANDARD-FROZEN state=0x55e243301478 s->prefetch_data=0 2024-09-14T11:32:05.531 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:05.532+0000 7f45669169c0 10 manifest: total_size = 22651 2024-09-14T11:32:05.531 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:05.532+0000 7f45669169c0 20 get_obj_state: setting s->obj_tag to _VV5oprrI58RodPHmnKb3M8TbPGCNUOl 2024-09-14T11:32:05.531 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:05.532+0000 7f45669169c0 20 get_obj_state: octx=0x7f455c085f80 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-STANDARD-FROZEN state=0x55e243301478 s->prefetch_data=0 2024-09-14T11:32:05.531 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:05.532+0000 7f45669169c0 20 prepare_atomic_modification: state is not atomic. state=0x55e243301478 2024-09-14T11:32:05.531 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:05.532+0000 7f45669169c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.15.8 2024-09-14T11:32:05.538 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:05.540+0000 7f45669169c0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-14T11:32:05.538 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:05.540+0000 7f45669169c0 20 RGWObjManifest::operator++(): result: ofs=22651 stripe_ofs=22651 part_ofs=0 rule->part_size=0 2024-09-14T11:32:05.538 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:05.540+0000 7f45669169c0 20 garbage collection: RGWGC::send_split_chain - tag is: _VV5oprrI58RodPHmnKb3M8TbPGCNUOl 2024-09-14T11:32:05.538 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:05.540+0000 7f45669169c0 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-14T11:32:05.539 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:05.540+0000 7f45669169c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.15__shadow_.t6q27vNf47a4Wwk2lYF7Wcyf3Q46kT6_0 2024-09-14T11:32:05.539 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:05.540+0000 7f45669169c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 308 2024-09-14T11:32:05.539 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:05.540+0000 7f45669169c0 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-14T11:32:05.539 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:05.540+0000 7f45669169c0 20 garbage collection: RGWGC::send_chain - on object name: gc.21tag is: _VV5oprrI58RodPHmnKb3M8TbPGCNUOl 2024-09-14T11:32:05.541 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:05.540+0000 7f443affd640 20 handle_completion(): completion ok for obj=foo-STANDARD-FROZEN 2024-09-14T11:32:05.542 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:05.544+0000 7f45669169c0 20 get_obj_state: octx=0x55e2432eda40 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-FROZEN-FROZEN state=0x55e243301478 s->prefetch_data=0 2024-09-14T11:32:05.543 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:05.544+0000 7f45669169c0 10 manifest: total_size = 5242880 2024-09-14T11:32:05.543 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:05.544+0000 7f45669169c0 20 get_obj_state: setting s->obj_tag to d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.11200633701597865269 2024-09-14T11:32:05.543 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:05.544+0000 7f45669169c0 20 get_obj_state: octx=0x55e2432eda40 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-FROZEN-FROZEN state=0x55e243301478 s->prefetch_data=0 2024-09-14T11:32:05.543 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:05.544+0000 7f45669169c0 20 prepare_atomic_modification: state is not atomic. state=0x55e243301478 2024-09-14T11:32:05.543 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:05.544+0000 7f45669169c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.15.9 2024-09-14T11:32:05.550 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:05.552+0000 7f45669169c0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-14T11:32:05.550 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:05.552+0000 7f45669169c0 20 RGWObjManifest::operator++(): result: ofs=4194304 stripe_ofs=4194304 part_ofs=0 rule->part_size=0 2024-09-14T11:32:05.550 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:05.552+0000 7f45669169c0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-14T11:32:05.550 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:05.552+0000 7f45669169c0 20 RGWObjManifest::operator++(): result: ofs=5242880 stripe_ofs=5242880 part_ofs=0 rule->part_size=0 2024-09-14T11:32:05.550 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:05.552+0000 7f45669169c0 20 garbage collection: RGWGC::send_split_chain - tag is: d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.11200633701597865269 2024-09-14T11:32:05.550 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:05.552+0000 7f45669169c0 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-14T11:32:05.550 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:05.552+0000 7f45669169c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.15__shadow_.czFV8GJIao5PhukAtzYwoL8Gui5OUKe_0 2024-09-14T11:32:05.551 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:05.552+0000 7f45669169c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 338 2024-09-14T11:32:05.551 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:05.552+0000 7f45669169c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.15__shadow_.czFV8GJIao5PhukAtzYwoL8Gui5OUKe_1 2024-09-14T11:32:05.551 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:05.552+0000 7f45669169c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 575 2024-09-14T11:32:05.551 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:05.552+0000 7f45669169c0 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-14T11:32:05.551 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:05.552+0000 7f45669169c0 20 garbage collection: RGWGC::send_chain - on object name: gc.26tag is: d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.11200633701597865269 2024-09-14T11:32:05.554 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:05.556+0000 7f45669169c0 20 list_objects_ordered: starting attempt 1 2024-09-14T11:32:05.554 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:05.556+0000 7f45669169c0 10 cls_bucket_list_ordered: request from each of 11 shard(s) for 112 entries to get 1001 total entries 2024-09-14T11:32:05.555 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:05.556+0000 7f443b7fe640 20 handle_completion(): completion ok for obj=foo-FROZEN-FROZEN 2024-09-14T11:32:05.557 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:05.556+0000 7f45669169c0 20 cls_bucket_list_ordered: returning, count=0, is_truncated=0 2024-09-14T11:32:05.557 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:05.556+0000 7f45669169c0 20 cls_bucket_list_ordered: returning, last_entry NOT SET 2024-09-14T11:32:05.557 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:05.556+0000 7f45669169c0 10 list_objects_ordered: end of outer loop, truncated=0, count=0, attempt=1 2024-09-14T11:32:05.557 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:05.556+0000 7f45669169c0 10 list_objects_ordered: exiting attempt loop because we reached end (0) or we're returning half the requested entries (0 of 1000) 2024-09-14T11:32:05.557 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:05.556+0000 7f45669169c0 20 abort_multiparts INFO: aborting and cleaning up multipart upload(s); bucket=":test-client.0-r-test-obj-storage-class-copy.1[d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.15])"; uploads.size()=0; is_truncated=0 2024-09-14T11:32:05.562 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:05.564+0000 7f45669169c0 10 cache get: name=default.rgw.meta+root+test-client.0-r-test-obj-storage-class-copy.1 : miss 2024-09-14T11:32:05.562 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:05.564+0000 7f45669169c0 20 rados->read ofs=0 len=0 2024-09-14T11:32:05.563 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:05.564+0000 7f45669169c0 20 rados_obj.operate() r=0 bl.length=233 2024-09-14T11:32:05.563 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:05.564+0000 7f45669169c0 10 cache put: name=default.rgw.meta+root+test-client.0-r-test-obj-storage-class-copy.1 info.flags=0x11 2024-09-14T11:32:05.563 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:05.564+0000 7f45669169c0 10 adding default.rgw.meta+root+test-client.0-r-test-obj-storage-class-copy.1 to cache LRU end 2024-09-14T11:32:05.566 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:05.568+0000 7f45669169c0 10 removing default.rgw.meta+root+test-client.0-r-test-obj-storage-class-copy.1 from cache 2024-09-14T11:32:05.566 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:05.568+0000 7f45669169c0 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 1, obj: default.rgw.meta:root:test-client.0-r-test-obj-storage-class-copy.1, ofs0, ns] 2024-09-14T11:32:05.566 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:05.568+0000 7f443affd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366165 cookie 94430277893856 notifier 5874 bl.length()=189 2024-09-14T11:32:05.573 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:05.572+0000 7f45669169c0 10 removing default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class-copy.1:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.15 from cache 2024-09-14T11:32:05.573 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:05.572+0000 7f45669169c0 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 1, obj: default.rgw.meta:root:.bucket.meta.test-client.0-r-test-obj-storage-class-copy.1:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.15, ofs0, ns] 2024-09-14T11:32:05.574 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:05.576+0000 7f443affd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366201 cookie 94430277934704 notifier 5874 bl.length()=247 2024-09-14T11:32:05.584 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:05.584+0000 7f45669169c0 10 cache get: name=default.rgw.log++pubsub..bucket.test-client.0-r-test-obj-storage-class-copy.1/d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.15 : miss 2024-09-14T11:32:05.584 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:05.584+0000 7f45669169c0 20 rados->read ofs=0 len=0 2024-09-14T11:32:05.585 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:05.584+0000 7f45669169c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:32:05.585 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:05.584+0000 7f45669169c0 10 cache put: name=default.rgw.log++pubsub..bucket.test-client.0-r-test-obj-storage-class-copy.1/d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.15 info.flags=0x0 2024-09-14T11:32:05.585 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:05.584+0000 7f45669169c0 10 adding default.rgw.log++pubsub..bucket.test-client.0-r-test-obj-storage-class-copy.1/d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.15 to cache LRU end 2024-09-14T11:32:05.590 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:05.592+0000 7f45669169c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class-multipart-copy.1:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.16 : miss 2024-09-14T11:32:05.590 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:05.592+0000 7f45669169c0 20 rados->read ofs=0 len=0 2024-09-14T11:32:05.592 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:05.592+0000 7f45669169c0 20 rados_obj.operate() r=0 bl.length=465 2024-09-14T11:32:05.592 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:05.592+0000 7f45669169c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class-multipart-copy.1:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.16 info.flags=0x17 2024-09-14T11:32:05.592 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:05.592+0000 7f45669169c0 10 adding default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class-multipart-copy.1:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.16 to cache LRU end 2024-09-14T11:32:05.592 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:05.592+0000 7f45669169c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:32:05.592 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:05.592+0000 7f45669169c0 10 updating xattr: name=user.rgw.acl bl.length()=209 2024-09-14T11:32:05.592 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:05.592+0000 7f45669169c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class-multipart-copy.1:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.16 2024-09-14T11:32:05.593 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:05.592+0000 7f45669169c0 10 cls_bucket_list_unordered: got foo-STANDARD-LUKEWARM 2024-09-14T11:32:05.594 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:05.596+0000 7f45669169c0 10 cls_bucket_list_unordered: got foo-LUKEWARM-STANDARD 2024-09-14T11:32:05.596 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:05.596+0000 7f45669169c0 10 cls_bucket_list_unordered: got foo-FROZEN 2024-09-14T11:32:05.598 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:05.600+0000 7f45669169c0 10 cls_bucket_list_unordered: got foo-FROZEN-LUKEWARM 2024-09-14T11:32:05.598 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:05.600+0000 7f45669169c0 10 cls_bucket_list_unordered: got foo-LUKEWARM-FROZEN 2024-09-14T11:32:05.598 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:05.600+0000 7f45669169c0 10 cls_bucket_list_unordered: got foo-STANDARD 2024-09-14T11:32:05.600 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:05.600+0000 7f45669169c0 10 cls_bucket_list_unordered: got foo-FROZEN-STANDARD 2024-09-14T11:32:05.600 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:05.600+0000 7f45669169c0 10 cls_bucket_list_unordered: got foo-LUKEWARM 2024-09-14T11:32:05.600 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:05.600+0000 7f45669169c0 10 cls_bucket_list_unordered: got foo-STANDARD-STANDARD 2024-09-14T11:32:05.601 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:05.600+0000 7f45669169c0 10 cls_bucket_list_unordered: got foo-LUKEWARM-LUKEWARM 2024-09-14T11:32:05.601 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:05.600+0000 7f45669169c0 10 cls_bucket_list_unordered: got foo-STANDARD-FROZEN 2024-09-14T11:32:05.602 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:05.604+0000 7f45669169c0 10 cls_bucket_list_unordered: got foo-FROZEN-FROZEN 2024-09-14T11:32:05.603 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:05.604+0000 7f45669169c0 20 get_obj_state: octx=0x7f455c097b00 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-STANDARD-LUKEWARM state=0x55e243304a38 s->prefetch_data=0 2024-09-14T11:32:05.604 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:05.604+0000 7f45669169c0 10 manifest: total_size = 45360 2024-09-14T11:32:05.604 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:05.604+0000 7f45669169c0 20 get_obj_state: setting s->obj_tag to _TRSLHVOwxjPvWni6sS2SxNXHdQhAkW2 2024-09-14T11:32:05.604 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:05.604+0000 7f45669169c0 20 get_obj_state: octx=0x7f455c097b00 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-STANDARD-LUKEWARM state=0x55e243304a38 s->prefetch_data=0 2024-09-14T11:32:05.604 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:05.604+0000 7f45669169c0 20 prepare_atomic_modification: state is not atomic. state=0x55e243304a38 2024-09-14T11:32:05.605 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:05.604+0000 7f45669169c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.16.0 2024-09-14T11:32:05.611 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:05.612+0000 7f45669169c0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-14T11:32:05.611 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:05.612+0000 7f45669169c0 20 RGWObjManifest::operator++(): result: ofs=45360 stripe_ofs=45360 part_ofs=0 rule->part_size=0 2024-09-14T11:32:05.611 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:05.612+0000 7f45669169c0 20 garbage collection: RGWGC::send_split_chain - tag is: _TRSLHVOwxjPvWni6sS2SxNXHdQhAkW2 2024-09-14T11:32:05.611 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:05.612+0000 7f45669169c0 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-14T11:32:05.611 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:05.612+0000 7f45669169c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.16__shadow_.GXU7BPamtOoGyr42xyRjpS_kU8QEUm7_0 2024-09-14T11:32:05.611 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:05.612+0000 7f45669169c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 310 2024-09-14T11:32:05.611 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:05.612+0000 7f45669169c0 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-14T11:32:05.611 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:05.612+0000 7f45669169c0 20 garbage collection: RGWGC::send_chain - on object name: gc.21tag is: _TRSLHVOwxjPvWni6sS2SxNXHdQhAkW2 2024-09-14T11:32:05.614 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:05.616+0000 7f45669169c0 20 get_obj_state: octx=0x55e2432f3140 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-LUKEWARM-STANDARD state=0x55e243304a38 s->prefetch_data=0 2024-09-14T11:32:05.614 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:05.616+0000 7f443affd640 20 handle_completion(): completion ok for obj=foo-STANDARD-LUKEWARM 2024-09-14T11:32:05.615 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:05.616+0000 7f45669169c0 10 manifest: total_size = 11534336 2024-09-14T11:32:05.615 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:05.616+0000 7f45669169c0 20 get_obj_state: setting s->obj_tag to _Z15nhGlba6BoBntEjvtlAfnSMoTyNRh 2024-09-14T11:32:05.615 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:05.616+0000 7f45669169c0 20 get_obj_state: octx=0x55e2432f3140 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-LUKEWARM-STANDARD state=0x55e243304a38 s->prefetch_data=0 2024-09-14T11:32:05.615 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:05.616+0000 7f45669169c0 20 prepare_atomic_modification: state is not atomic. state=0x55e243304a38 2024-09-14T11:32:05.615 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:05.616+0000 7f45669169c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.16.2 2024-09-14T11:32:05.621 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:05.620+0000 7f45669169c0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-14T11:32:05.622 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:05.620+0000 7f45669169c0 20 RGWObjManifest::operator++(): result: ofs=8388608 stripe_ofs=8388608 part_ofs=0 rule->part_size=0 2024-09-14T11:32:05.622 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:05.620+0000 7f45669169c0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-14T11:32:05.622 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:05.620+0000 7f45669169c0 20 RGWObjManifest::operator++(): result: ofs=11534336 stripe_ofs=11534336 part_ofs=0 rule->part_size=0 2024-09-14T11:32:05.622 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:05.620+0000 7f45669169c0 20 garbage collection: RGWGC::send_split_chain - tag is: _Z15nhGlba6BoBntEjvtlAfnSMoTyNRh 2024-09-14T11:32:05.622 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:05.620+0000 7f45669169c0 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-14T11:32:05.622 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:05.620+0000 7f45669169c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.16__shadow_.9LXGF8eFC4rBgtAVqAyiH_tpMZBbhmA_1 2024-09-14T11:32:05.622 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:05.620+0000 7f45669169c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 301 2024-09-14T11:32:05.622 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:05.620+0000 7f45669169c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.16__shadow_.9LXGF8eFC4rBgtAVqAyiH_tpMZBbhmA_2 2024-09-14T11:32:05.622 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:05.620+0000 7f45669169c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 531 2024-09-14T11:32:05.622 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:05.620+0000 7f45669169c0 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-14T11:32:05.622 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:05.620+0000 7f45669169c0 20 garbage collection: RGWGC::send_chain - on object name: gc.16tag is: _Z15nhGlba6BoBntEjvtlAfnSMoTyNRh 2024-09-14T11:32:05.624 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:05.624+0000 7f443b7fe640 20 handle_completion(): completion ok for obj=foo-LUKEWARM-STANDARD 2024-09-14T11:32:05.625 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:05.628+0000 7f45669169c0 20 get_obj_state: octx=0x7f455c0633a0 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-FROZEN state=0x55e243304a38 s->prefetch_data=0 2024-09-14T11:32:05.627 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:05.628+0000 7f45669169c0 10 manifest: total_size = 11534336 2024-09-14T11:32:05.627 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:05.628+0000 7f45669169c0 20 get_obj_state: setting s->obj_tag to d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.11913213709187695776 2024-09-14T11:32:05.627 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:05.628+0000 7f45669169c0 20 get_obj_state: octx=0x7f455c0633a0 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-FROZEN state=0x55e243304a38 s->prefetch_data=0 2024-09-14T11:32:05.627 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:05.628+0000 7f45669169c0 20 prepare_atomic_modification: state is not atomic. state=0x55e243304a38 2024-09-14T11:32:05.627 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:05.628+0000 7f45669169c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.16.3 2024-09-14T11:32:05.633 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:05.632+0000 7f45669169c0 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2024-09-14T11:32:05.633 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:05.632+0000 7f45669169c0 20 RGWObjManifest::operator++(): stripe_ofs=4194304 part_ofs=0 rule->part_size=5242880 2024-09-14T11:32:05.634 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:05.632+0000 7f45669169c0 20 RGWObjManifest::operator++(): result: ofs=4194304 stripe_ofs=4194304 part_ofs=0 rule->part_size=5242880 2024-09-14T11:32:05.634 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:05.632+0000 7f45669169c0 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2024-09-14T11:32:05.634 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:05.632+0000 7f45669169c0 20 RGWObjManifest::operator++(): stripe_ofs=8388608 part_ofs=0 rule->part_size=5242880 2024-09-14T11:32:05.634 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:05.632+0000 7f45669169c0 20 RGWObjManifest::operator++(): result: ofs=5242880 stripe_ofs=5242880 part_ofs=5242880 rule->part_size=5242880 2024-09-14T11:32:05.634 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:05.632+0000 7f45669169c0 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2024-09-14T11:32:05.634 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:05.632+0000 7f45669169c0 20 RGWObjManifest::operator++(): stripe_ofs=9437184 part_ofs=5242880 rule->part_size=5242880 2024-09-14T11:32:05.634 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:05.632+0000 7f45669169c0 20 RGWObjManifest::operator++(): result: ofs=9437184 stripe_ofs=9437184 part_ofs=5242880 rule->part_size=5242880 2024-09-14T11:32:05.634 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:05.632+0000 7f45669169c0 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2024-09-14T11:32:05.634 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:05.632+0000 7f45669169c0 20 RGWObjManifest::operator++(): stripe_ofs=13631488 part_ofs=5242880 rule->part_size=5242880 2024-09-14T11:32:05.634 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:05.632+0000 7f45669169c0 20 RGWObjManifest::operator++(): result: ofs=10485760 stripe_ofs=10485760 part_ofs=10485760 rule->part_size=1048576 2024-09-14T11:32:05.634 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:05.632+0000 7f45669169c0 20 RGWObjManifest::operator++(): rule->part_size=1048576 rules.size()=2 2024-09-14T11:32:05.635 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:05.632+0000 7f45669169c0 20 RGWObjManifest::operator++(): stripe_ofs=14680064 part_ofs=10485760 rule->part_size=1048576 2024-09-14T11:32:05.635 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:05.632+0000 7f45669169c0 20 RGWObjManifest::operator++(): result: ofs=11534336 stripe_ofs=11534336 part_ofs=11534336 rule->part_size=1048576 2024-09-14T11:32:05.635 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:05.632+0000 7f45669169c0 20 garbage collection: RGWGC::send_split_chain - tag is: d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.11913213709187695776 2024-09-14T11:32:05.635 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:05.632+0000 7f45669169c0 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-14T11:32:05.635 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:05.632+0000 7f45669169c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.16__multipart_foo-FROZEN.2~SoLpOsEgNVUd6LOC83yZzuLMoUbW0AA.1 2024-09-14T11:32:05.635 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:05.632+0000 7f45669169c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 368 2024-09-14T11:32:05.635 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:05.632+0000 7f45669169c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.16__shadow_foo-FROZEN.2~SoLpOsEgNVUd6LOC83yZzuLMoUbW0AA.1_1 2024-09-14T11:32:05.635 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:05.632+0000 7f45669169c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 633 2024-09-14T11:32:05.635 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:05.632+0000 7f45669169c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.16__multipart_foo-FROZEN.2~SoLpOsEgNVUd6LOC83yZzuLMoUbW0AA.2 2024-09-14T11:32:05.635 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:05.632+0000 7f45669169c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 900 2024-09-14T11:32:05.635 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:05.632+0000 7f45669169c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.16__shadow_foo-FROZEN.2~SoLpOsEgNVUd6LOC83yZzuLMoUbW0AA.2_1 2024-09-14T11:32:05.635 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:05.632+0000 7f45669169c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 1165 2024-09-14T11:32:05.635 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:05.632+0000 7f45669169c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.16__multipart_foo-FROZEN.2~SoLpOsEgNVUd6LOC83yZzuLMoUbW0AA.3 2024-09-14T11:32:05.636 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:05.632+0000 7f45669169c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 1432 2024-09-14T11:32:05.636 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:05.632+0000 7f45669169c0 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-14T11:32:05.636 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:05.632+0000 7f45669169c0 20 garbage collection: RGWGC::send_chain - on object name: gc.20tag is: d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.11913213709187695776 2024-09-14T11:32:05.637 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:05.636+0000 7f443affd640 20 handle_completion(): completion ok for obj=foo-FROZEN 2024-09-14T11:32:05.637 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:05.636+0000 7f45669169c0 20 get_obj_state: octx=0x7f455c008dc0 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-FROZEN-LUKEWARM state=0x55e243304a38 s->prefetch_data=0 2024-09-14T11:32:05.638 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:05.640+0000 7f45669169c0 10 manifest: total_size = 11534336 2024-09-14T11:32:05.638 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:05.640+0000 7f45669169c0 20 get_obj_state: setting s->obj_tag to _bMOaMZ2WAKVh-YAFQSTcfPiIn2c0eGI 2024-09-14T11:32:05.638 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:05.640+0000 7f45669169c0 20 get_obj_state: octx=0x7f455c008dc0 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-FROZEN-LUKEWARM state=0x55e243304a38 s->prefetch_data=0 2024-09-14T11:32:05.639 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:05.640+0000 7f45669169c0 20 prepare_atomic_modification: state is not atomic. state=0x55e243304a38 2024-09-14T11:32:05.639 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:05.640+0000 7f45669169c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.16.5 2024-09-14T11:32:05.645 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:05.644+0000 7f45669169c0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-14T11:32:05.645 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:05.644+0000 7f45669169c0 20 RGWObjManifest::operator++(): result: ofs=4194304 stripe_ofs=4194304 part_ofs=0 rule->part_size=0 2024-09-14T11:32:05.645 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:05.644+0000 7f45669169c0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-14T11:32:05.645 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:05.644+0000 7f45669169c0 20 RGWObjManifest::operator++(): result: ofs=8388608 stripe_ofs=8388608 part_ofs=0 rule->part_size=0 2024-09-14T11:32:05.645 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:05.644+0000 7f45669169c0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-14T11:32:05.645 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:05.644+0000 7f45669169c0 20 RGWObjManifest::operator++(): result: ofs=11534336 stripe_ofs=11534336 part_ofs=0 rule->part_size=0 2024-09-14T11:32:05.645 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:05.644+0000 7f45669169c0 20 garbage collection: RGWGC::send_split_chain - tag is: _bMOaMZ2WAKVh-YAFQSTcfPiIn2c0eGI 2024-09-14T11:32:05.646 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:05.644+0000 7f45669169c0 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-14T11:32:05.646 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:05.644+0000 7f45669169c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.16__shadow_.k0Sxb_xgDon1NP4g21LQ5xY4MpFdunV_0 2024-09-14T11:32:05.646 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:05.644+0000 7f45669169c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 310 2024-09-14T11:32:05.646 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:05.644+0000 7f45669169c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.16__shadow_.k0Sxb_xgDon1NP4g21LQ5xY4MpFdunV_1 2024-09-14T11:32:05.646 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:05.644+0000 7f45669169c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 549 2024-09-14T11:32:05.646 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:05.644+0000 7f45669169c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.16__shadow_.k0Sxb_xgDon1NP4g21LQ5xY4MpFdunV_2 2024-09-14T11:32:05.646 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:05.644+0000 7f45669169c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 788 2024-09-14T11:32:05.646 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:05.644+0000 7f45669169c0 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-14T11:32:05.646 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:05.644+0000 7f45669169c0 20 garbage collection: RGWGC::send_chain - on object name: gc.11tag is: _bMOaMZ2WAKVh-YAFQSTcfPiIn2c0eGI 2024-09-14T11:32:05.648 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:05.648+0000 7f443b7fe640 20 handle_completion(): completion ok for obj=foo-FROZEN-LUKEWARM 2024-09-14T11:32:05.649 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:05.648+0000 7f45669169c0 20 get_obj_state: octx=0x7f455c063580 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-LUKEWARM-FROZEN state=0x55e243304a38 s->prefetch_data=0 2024-09-14T11:32:05.650 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:05.652+0000 7f45669169c0 10 manifest: total_size = 11534336 2024-09-14T11:32:05.650 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:05.652+0000 7f45669169c0 20 get_obj_state: setting s->obj_tag to _kaUOgclcxx79SXY_b85-vj5mh09AH-A 2024-09-14T11:32:05.650 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:05.652+0000 7f45669169c0 20 get_obj_state: octx=0x7f455c063580 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-LUKEWARM-FROZEN state=0x55e243304a38 s->prefetch_data=0 2024-09-14T11:32:05.650 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:05.652+0000 7f45669169c0 20 prepare_atomic_modification: state is not atomic. state=0x55e243304a38 2024-09-14T11:32:05.650 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:05.652+0000 7f45669169c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.16.5 2024-09-14T11:32:05.656 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:05.656+0000 7f45669169c0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-14T11:32:05.656 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:05.656+0000 7f45669169c0 20 RGWObjManifest::operator++(): result: ofs=4194304 stripe_ofs=4194304 part_ofs=0 rule->part_size=0 2024-09-14T11:32:05.656 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:05.656+0000 7f45669169c0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-14T11:32:05.656 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:05.656+0000 7f45669169c0 20 RGWObjManifest::operator++(): result: ofs=8388608 stripe_ofs=8388608 part_ofs=0 rule->part_size=0 2024-09-14T11:32:05.657 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:05.656+0000 7f45669169c0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-14T11:32:05.657 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:05.656+0000 7f45669169c0 20 RGWObjManifest::operator++(): result: ofs=11534336 stripe_ofs=11534336 part_ofs=0 rule->part_size=0 2024-09-14T11:32:05.657 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:05.656+0000 7f45669169c0 20 garbage collection: RGWGC::send_split_chain - tag is: _kaUOgclcxx79SXY_b85-vj5mh09AH-A 2024-09-14T11:32:05.657 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:05.656+0000 7f45669169c0 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-14T11:32:05.657 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:05.656+0000 7f45669169c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.16__shadow_.jyLdNCelA6Y5fG1DXxM1x0n-xXAZLr0_0 2024-09-14T11:32:05.657 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:05.656+0000 7f45669169c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 308 2024-09-14T11:32:05.657 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:05.656+0000 7f45669169c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.16__shadow_.jyLdNCelA6Y5fG1DXxM1x0n-xXAZLr0_1 2024-09-14T11:32:05.657 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:05.656+0000 7f45669169c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 545 2024-09-14T11:32:05.657 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:05.656+0000 7f45669169c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.16__shadow_.jyLdNCelA6Y5fG1DXxM1x0n-xXAZLr0_2 2024-09-14T11:32:05.657 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:05.656+0000 7f45669169c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 782 2024-09-14T11:32:05.657 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:05.656+0000 7f45669169c0 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-14T11:32:05.657 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:05.656+0000 7f45669169c0 20 garbage collection: RGWGC::send_chain - on object name: gc.28tag is: _kaUOgclcxx79SXY_b85-vj5mh09AH-A 2024-09-14T11:32:05.659 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:05.660+0000 7f45669169c0 20 get_obj_state: octx=0x7f455c008dc0 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-STANDARD state=0x55e243304a38 s->prefetch_data=0 2024-09-14T11:32:05.660 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:05.660+0000 7f443affd640 20 handle_completion(): completion ok for obj=foo-LUKEWARM-FROZEN 2024-09-14T11:32:05.661 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:05.660+0000 7f45669169c0 10 manifest: total_size = 45360 2024-09-14T11:32:05.661 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:05.660+0000 7f45669169c0 20 get_obj_state: setting s->obj_tag to d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.1288807688716285185 2024-09-14T11:32:05.661 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:05.660+0000 7f45669169c0 20 get_obj_state: octx=0x7f455c008dc0 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-STANDARD state=0x55e243304a38 s->prefetch_data=0 2024-09-14T11:32:05.661 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:05.660+0000 7f45669169c0 20 prepare_atomic_modification: state is not atomic. state=0x55e243304a38 2024-09-14T11:32:05.661 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:05.660+0000 7f45669169c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.16.5 2024-09-14T11:32:05.667 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:05.668+0000 7f45669169c0 20 RGWObjManifest::operator++(): rule->part_size=20613 rules.size()=2 2024-09-14T11:32:05.667 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:05.668+0000 7f45669169c0 20 RGWObjManifest::operator++(): stripe_ofs=4194304 part_ofs=0 rule->part_size=20613 2024-09-14T11:32:05.667 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:05.668+0000 7f45669169c0 20 RGWObjManifest::operator++(): result: ofs=20613 stripe_ofs=20613 part_ofs=20613 rule->part_size=20613 2024-09-14T11:32:05.667 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:05.668+0000 7f45669169c0 20 RGWObjManifest::operator++(): rule->part_size=20613 rules.size()=2 2024-09-14T11:32:05.668 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:05.668+0000 7f45669169c0 20 RGWObjManifest::operator++(): stripe_ofs=4214917 part_ofs=20613 rule->part_size=20613 2024-09-14T11:32:05.668 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:05.668+0000 7f45669169c0 20 RGWObjManifest::operator++(): result: ofs=41226 stripe_ofs=41226 part_ofs=41226 rule->part_size=4134 2024-09-14T11:32:05.668 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:05.668+0000 7f45669169c0 20 RGWObjManifest::operator++(): rule->part_size=4134 rules.size()=2 2024-09-14T11:32:05.668 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:05.668+0000 7f45669169c0 20 RGWObjManifest::operator++(): stripe_ofs=4235530 part_ofs=41226 rule->part_size=4134 2024-09-14T11:32:05.668 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:05.668+0000 7f45669169c0 20 RGWObjManifest::operator++(): result: ofs=45360 stripe_ofs=45360 part_ofs=45360 rule->part_size=4134 2024-09-14T11:32:05.668 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:05.668+0000 7f45669169c0 20 garbage collection: RGWGC::send_split_chain - tag is: d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.1288807688716285185 2024-09-14T11:32:05.668 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:05.668+0000 7f45669169c0 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-14T11:32:05.668 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:05.668+0000 7f45669169c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.16__multipart_foo-STANDARD.2~fZQRTBOvoJi2GPy-KSPcRakKMfGaKPH.1 2024-09-14T11:32:05.668 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:05.668+0000 7f45669169c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 364 2024-09-14T11:32:05.668 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:05.668+0000 7f45669169c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.16__multipart_foo-STANDARD.2~fZQRTBOvoJi2GPy-KSPcRakKMfGaKPH.2 2024-09-14T11:32:05.668 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:05.668+0000 7f45669169c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 628 2024-09-14T11:32:05.668 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:05.668+0000 7f45669169c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.16__multipart_foo-STANDARD.2~fZQRTBOvoJi2GPy-KSPcRakKMfGaKPH.3 2024-09-14T11:32:05.668 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:05.668+0000 7f45669169c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 892 2024-09-14T11:32:05.669 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:05.668+0000 7f45669169c0 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-14T11:32:05.669 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:05.668+0000 7f45669169c0 20 garbage collection: RGWGC::send_chain - on object name: gc.26tag is: d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.1288807688716285185 2024-09-14T11:32:05.670 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:05.672+0000 7f45669169c0 20 get_obj_state: octx=0x7f455c07e260 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-FROZEN-STANDARD state=0x55e243304a38 s->prefetch_data=0 2024-09-14T11:32:05.671 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:05.672+0000 7f443b7fe640 20 handle_completion(): completion ok for obj=foo-STANDARD 2024-09-14T11:32:05.671 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:05.672+0000 7f45669169c0 10 manifest: total_size = 11534336 2024-09-14T11:32:05.672 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:05.672+0000 7f45669169c0 20 get_obj_state: setting s->obj_tag to _BKbzjxi6fWtUFrnSZkgaSvXrqX3Fxgb 2024-09-14T11:32:05.672 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:05.672+0000 7f45669169c0 20 get_obj_state: octx=0x7f455c07e260 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-FROZEN-STANDARD state=0x55e243304a38 s->prefetch_data=0 2024-09-14T11:32:05.672 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:05.672+0000 7f45669169c0 20 prepare_atomic_modification: state is not atomic. state=0x55e243304a38 2024-09-14T11:32:05.672 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:05.672+0000 7f45669169c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.16.7 2024-09-14T11:32:05.679 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:05.680+0000 7f45669169c0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-14T11:32:05.679 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:05.680+0000 7f45669169c0 20 RGWObjManifest::operator++(): result: ofs=8388608 stripe_ofs=8388608 part_ofs=0 rule->part_size=0 2024-09-14T11:32:05.679 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:05.680+0000 7f45669169c0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-14T11:32:05.679 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:05.680+0000 7f45669169c0 20 RGWObjManifest::operator++(): result: ofs=11534336 stripe_ofs=11534336 part_ofs=0 rule->part_size=0 2024-09-14T11:32:05.679 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:05.680+0000 7f45669169c0 20 garbage collection: RGWGC::send_split_chain - tag is: _BKbzjxi6fWtUFrnSZkgaSvXrqX3Fxgb 2024-09-14T11:32:05.679 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:05.680+0000 7f45669169c0 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-14T11:32:05.679 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:05.680+0000 7f45669169c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.16__shadow_.hKkKEs8AcnuHUFUgGGtZyUbjpLOAuFb_1 2024-09-14T11:32:05.679 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:05.680+0000 7f45669169c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 301 2024-09-14T11:32:05.679 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:05.680+0000 7f45669169c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.16__shadow_.hKkKEs8AcnuHUFUgGGtZyUbjpLOAuFb_2 2024-09-14T11:32:05.679 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:05.680+0000 7f45669169c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 531 2024-09-14T11:32:05.679 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:05.680+0000 7f45669169c0 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-14T11:32:05.680 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:05.680+0000 7f45669169c0 20 garbage collection: RGWGC::send_chain - on object name: gc.24tag is: _BKbzjxi6fWtUFrnSZkgaSvXrqX3Fxgb 2024-09-14T11:32:05.682 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:05.684+0000 7f443affd640 20 handle_completion(): completion ok for obj=foo-FROZEN-STANDARD 2024-09-14T11:32:05.683 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:05.684+0000 7f45669169c0 20 get_obj_state: octx=0x7f4558074d90 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-LUKEWARM state=0x55e243304a38 s->prefetch_data=0 2024-09-14T11:32:05.683 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:05.684+0000 7f45669169c0 10 manifest: total_size = 11534336 2024-09-14T11:32:05.684 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:05.684+0000 7f45669169c0 20 get_obj_state: setting s->obj_tag to d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.5211587471816669591 2024-09-14T11:32:05.684 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:05.684+0000 7f45669169c0 20 get_obj_state: octx=0x7f4558074d90 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-LUKEWARM state=0x55e243304a38 s->prefetch_data=0 2024-09-14T11:32:05.684 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:05.684+0000 7f45669169c0 20 prepare_atomic_modification: state is not atomic. state=0x55e243304a38 2024-09-14T11:32:05.684 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:05.684+0000 7f45669169c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.16.7 2024-09-14T11:32:05.690 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:05.692+0000 7f45669169c0 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2024-09-14T11:32:05.691 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:05.692+0000 7f45669169c0 20 RGWObjManifest::operator++(): stripe_ofs=4194304 part_ofs=0 rule->part_size=5242880 2024-09-14T11:32:05.691 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:05.692+0000 7f45669169c0 20 RGWObjManifest::operator++(): result: ofs=4194304 stripe_ofs=4194304 part_ofs=0 rule->part_size=5242880 2024-09-14T11:32:05.691 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:05.692+0000 7f45669169c0 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2024-09-14T11:32:05.691 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:05.692+0000 7f45669169c0 20 RGWObjManifest::operator++(): stripe_ofs=8388608 part_ofs=0 rule->part_size=5242880 2024-09-14T11:32:05.691 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:05.692+0000 7f45669169c0 20 RGWObjManifest::operator++(): result: ofs=5242880 stripe_ofs=5242880 part_ofs=5242880 rule->part_size=5242880 2024-09-14T11:32:05.691 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:05.692+0000 7f45669169c0 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2024-09-14T11:32:05.691 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:05.692+0000 7f45669169c0 20 RGWObjManifest::operator++(): stripe_ofs=9437184 part_ofs=5242880 rule->part_size=5242880 2024-09-14T11:32:05.691 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:05.692+0000 7f45669169c0 20 RGWObjManifest::operator++(): result: ofs=9437184 stripe_ofs=9437184 part_ofs=5242880 rule->part_size=5242880 2024-09-14T11:32:05.691 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:05.692+0000 7f45669169c0 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2024-09-14T11:32:05.691 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:05.692+0000 7f45669169c0 20 RGWObjManifest::operator++(): stripe_ofs=13631488 part_ofs=5242880 rule->part_size=5242880 2024-09-14T11:32:05.691 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:05.692+0000 7f45669169c0 20 RGWObjManifest::operator++(): result: ofs=10485760 stripe_ofs=10485760 part_ofs=10485760 rule->part_size=1048576 2024-09-14T11:32:05.691 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:05.692+0000 7f45669169c0 20 RGWObjManifest::operator++(): rule->part_size=1048576 rules.size()=2 2024-09-14T11:32:05.692 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:05.692+0000 7f45669169c0 20 RGWObjManifest::operator++(): stripe_ofs=14680064 part_ofs=10485760 rule->part_size=1048576 2024-09-14T11:32:05.692 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:05.692+0000 7f45669169c0 20 RGWObjManifest::operator++(): result: ofs=11534336 stripe_ofs=11534336 part_ofs=11534336 rule->part_size=1048576 2024-09-14T11:32:05.692 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:05.692+0000 7f45669169c0 20 garbage collection: RGWGC::send_split_chain - tag is: d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.5211587471816669591 2024-09-14T11:32:05.692 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:05.692+0000 7f45669169c0 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-14T11:32:05.692 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:05.692+0000 7f45669169c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.16__multipart_foo-LUKEWARM.2~LvMwfRJXLK90wupfJ7HhQNqA4LPctM_.1 2024-09-14T11:32:05.692 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:05.692+0000 7f45669169c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 373 2024-09-14T11:32:05.692 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:05.692+0000 7f45669169c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.16__shadow_foo-LUKEWARM.2~LvMwfRJXLK90wupfJ7HhQNqA4LPctM_.1_1 2024-09-14T11:32:05.692 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:05.692+0000 7f45669169c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 644 2024-09-14T11:32:05.692 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:05.692+0000 7f45669169c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.16__multipart_foo-LUKEWARM.2~LvMwfRJXLK90wupfJ7HhQNqA4LPctM_.2 2024-09-14T11:32:05.692 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:05.692+0000 7f45669169c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 917 2024-09-14T11:32:05.692 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:05.692+0000 7f45669169c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.16__shadow_foo-LUKEWARM.2~LvMwfRJXLK90wupfJ7HhQNqA4LPctM_.2_1 2024-09-14T11:32:05.692 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:05.692+0000 7f45669169c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 1188 2024-09-14T11:32:05.692 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:05.692+0000 7f45669169c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.16__multipart_foo-LUKEWARM.2~LvMwfRJXLK90wupfJ7HhQNqA4LPctM_.3 2024-09-14T11:32:05.693 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:05.692+0000 7f45669169c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 1461 2024-09-14T11:32:05.693 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:05.692+0000 7f45669169c0 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-14T11:32:05.693 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:05.692+0000 7f45669169c0 20 garbage collection: RGWGC::send_chain - on object name: gc.15tag is: d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.5211587471816669591 2024-09-14T11:32:05.693 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:05.692+0000 7f443b7fe640 20 handle_completion(): completion ok for obj=foo-LUKEWARM 2024-09-14T11:32:05.694 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:05.696+0000 7f45669169c0 20 get_obj_state: octx=0x55e2430e2980 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-STANDARD-STANDARD state=0x55e243304a38 s->prefetch_data=0 2024-09-14T11:32:05.695 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:05.696+0000 7f45669169c0 10 manifest: total_size = 45360 2024-09-14T11:32:05.695 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:05.696+0000 7f45669169c0 20 get_obj_state: setting s->obj_tag to d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.11085027627534491181 2024-09-14T11:32:05.696 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:05.696+0000 7f45669169c0 20 get_obj_state: octx=0x55e2430e2980 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-STANDARD-STANDARD state=0x55e243304a38 s->prefetch_data=0 2024-09-14T11:32:05.696 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:05.696+0000 7f45669169c0 20 prepare_atomic_modification: state is not atomic. state=0x55e243304a38 2024-09-14T11:32:05.696 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:05.696+0000 7f45669169c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.16.7 2024-09-14T11:32:05.702 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:05.704+0000 7f45669169c0 20 RGWObjManifest::operator++(): rule->part_size=20613 rules.size()=2 2024-09-14T11:32:05.702 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:05.704+0000 7f45669169c0 20 RGWObjManifest::operator++(): stripe_ofs=4194304 part_ofs=0 rule->part_size=20613 2024-09-14T11:32:05.702 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:05.704+0000 7f45669169c0 20 RGWObjManifest::operator++(): result: ofs=20613 stripe_ofs=20613 part_ofs=20613 rule->part_size=20613 2024-09-14T11:32:05.702 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:05.704+0000 7f45669169c0 20 RGWObjManifest::operator++(): rule->part_size=20613 rules.size()=2 2024-09-14T11:32:05.702 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:05.704+0000 7f45669169c0 20 RGWObjManifest::operator++(): stripe_ofs=4214917 part_ofs=20613 rule->part_size=20613 2024-09-14T11:32:05.702 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:05.704+0000 7f45669169c0 20 RGWObjManifest::operator++(): result: ofs=41226 stripe_ofs=41226 part_ofs=41226 rule->part_size=4134 2024-09-14T11:32:05.702 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:05.704+0000 7f45669169c0 20 RGWObjManifest::operator++(): rule->part_size=4134 rules.size()=2 2024-09-14T11:32:05.702 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:05.704+0000 7f45669169c0 20 RGWObjManifest::operator++(): stripe_ofs=4235530 part_ofs=41226 rule->part_size=4134 2024-09-14T11:32:05.703 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:05.704+0000 7f45669169c0 20 RGWObjManifest::operator++(): result: ofs=45360 stripe_ofs=45360 part_ofs=45360 rule->part_size=4134 2024-09-14T11:32:05.703 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:05.704+0000 7f45669169c0 20 garbage collection: RGWGC::send_split_chain - tag is: d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.11085027627534491181 2024-09-14T11:32:05.703 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:05.704+0000 7f45669169c0 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-14T11:32:05.703 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:05.704+0000 7f45669169c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.16__multipart_foo-STANDARD.2~fZQRTBOvoJi2GPy-KSPcRakKMfGaKPH.1 2024-09-14T11:32:05.703 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:05.704+0000 7f45669169c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 365 2024-09-14T11:32:05.703 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:05.704+0000 7f45669169c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.16__multipart_foo-STANDARD.2~fZQRTBOvoJi2GPy-KSPcRakKMfGaKPH.2 2024-09-14T11:32:05.703 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:05.704+0000 7f45669169c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 629 2024-09-14T11:32:05.703 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:05.704+0000 7f45669169c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.16__multipart_foo-STANDARD.2~fZQRTBOvoJi2GPy-KSPcRakKMfGaKPH.3 2024-09-14T11:32:05.703 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:05.704+0000 7f45669169c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 893 2024-09-14T11:32:05.703 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:05.704+0000 7f45669169c0 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-14T11:32:05.703 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:05.704+0000 7f45669169c0 20 garbage collection: RGWGC::send_chain - on object name: gc.26tag is: d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.11085027627534491181 2024-09-14T11:32:05.705 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:05.704+0000 7f443affd640 20 handle_completion(): completion ok for obj=foo-STANDARD-STANDARD 2024-09-14T11:32:05.705 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:05.704+0000 7f45669169c0 20 get_obj_state: octx=0x7f455c0633a0 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-LUKEWARM-LUKEWARM state=0x55e243304a38 s->prefetch_data=0 2024-09-14T11:32:05.706 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:05.708+0000 7f45669169c0 10 manifest: total_size = 11534336 2024-09-14T11:32:05.706 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:05.708+0000 7f45669169c0 20 get_obj_state: setting s->obj_tag to d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.8836751873761430593 2024-09-14T11:32:05.706 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:05.708+0000 7f45669169c0 20 get_obj_state: octx=0x7f455c0633a0 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-LUKEWARM-LUKEWARM state=0x55e243304a38 s->prefetch_data=0 2024-09-14T11:32:05.706 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:05.708+0000 7f45669169c0 20 prepare_atomic_modification: state is not atomic. state=0x55e243304a38 2024-09-14T11:32:05.707 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:05.708+0000 7f45669169c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.16.8 2024-09-14T11:32:05.713 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:05.712+0000 7f45669169c0 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2024-09-14T11:32:05.713 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:05.712+0000 7f45669169c0 20 RGWObjManifest::operator++(): stripe_ofs=4194304 part_ofs=0 rule->part_size=5242880 2024-09-14T11:32:05.713 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:05.712+0000 7f45669169c0 20 RGWObjManifest::operator++(): result: ofs=4194304 stripe_ofs=4194304 part_ofs=0 rule->part_size=5242880 2024-09-14T11:32:05.713 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:05.712+0000 7f45669169c0 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2024-09-14T11:32:05.713 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:05.712+0000 7f45669169c0 20 RGWObjManifest::operator++(): stripe_ofs=8388608 part_ofs=0 rule->part_size=5242880 2024-09-14T11:32:05.713 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:05.712+0000 7f45669169c0 20 RGWObjManifest::operator++(): result: ofs=5242880 stripe_ofs=5242880 part_ofs=5242880 rule->part_size=5242880 2024-09-14T11:32:05.714 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:05.712+0000 7f45669169c0 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2024-09-14T11:32:05.714 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:05.712+0000 7f45669169c0 20 RGWObjManifest::operator++(): stripe_ofs=9437184 part_ofs=5242880 rule->part_size=5242880 2024-09-14T11:32:05.714 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:05.712+0000 7f45669169c0 20 RGWObjManifest::operator++(): result: ofs=9437184 stripe_ofs=9437184 part_ofs=5242880 rule->part_size=5242880 2024-09-14T11:32:05.714 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:05.712+0000 7f45669169c0 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2024-09-14T11:32:05.714 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:05.712+0000 7f45669169c0 20 RGWObjManifest::operator++(): stripe_ofs=13631488 part_ofs=5242880 rule->part_size=5242880 2024-09-14T11:32:05.714 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:05.712+0000 7f45669169c0 20 RGWObjManifest::operator++(): result: ofs=10485760 stripe_ofs=10485760 part_ofs=10485760 rule->part_size=1048576 2024-09-14T11:32:05.714 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:05.712+0000 7f45669169c0 20 RGWObjManifest::operator++(): rule->part_size=1048576 rules.size()=2 2024-09-14T11:32:05.714 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:05.712+0000 7f45669169c0 20 RGWObjManifest::operator++(): stripe_ofs=14680064 part_ofs=10485760 rule->part_size=1048576 2024-09-14T11:32:05.714 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:05.712+0000 7f45669169c0 20 RGWObjManifest::operator++(): result: ofs=11534336 stripe_ofs=11534336 part_ofs=11534336 rule->part_size=1048576 2024-09-14T11:32:05.714 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:05.712+0000 7f45669169c0 20 garbage collection: RGWGC::send_split_chain - tag is: d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.8836751873761430593 2024-09-14T11:32:05.714 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:05.712+0000 7f45669169c0 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-14T11:32:05.714 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:05.712+0000 7f45669169c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.16__multipart_foo-LUKEWARM.2~LvMwfRJXLK90wupfJ7HhQNqA4LPctM_.1 2024-09-14T11:32:05.715 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:05.712+0000 7f45669169c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 373 2024-09-14T11:32:05.715 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:05.712+0000 7f45669169c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.16__shadow_foo-LUKEWARM.2~LvMwfRJXLK90wupfJ7HhQNqA4LPctM_.1_1 2024-09-14T11:32:05.715 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:05.712+0000 7f45669169c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 644 2024-09-14T11:32:05.715 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:05.712+0000 7f45669169c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.16__multipart_foo-LUKEWARM.2~LvMwfRJXLK90wupfJ7HhQNqA4LPctM_.2 2024-09-14T11:32:05.715 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:05.712+0000 7f45669169c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 917 2024-09-14T11:32:05.715 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:05.712+0000 7f45669169c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.16__shadow_foo-LUKEWARM.2~LvMwfRJXLK90wupfJ7HhQNqA4LPctM_.2_1 2024-09-14T11:32:05.715 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:05.712+0000 7f45669169c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 1188 2024-09-14T11:32:05.715 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:05.712+0000 7f45669169c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.16__multipart_foo-LUKEWARM.2~LvMwfRJXLK90wupfJ7HhQNqA4LPctM_.3 2024-09-14T11:32:05.715 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:05.712+0000 7f45669169c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 1461 2024-09-14T11:32:05.715 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:05.712+0000 7f45669169c0 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-14T11:32:05.715 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:05.712+0000 7f45669169c0 20 garbage collection: RGWGC::send_chain - on object name: gc.30tag is: d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.8836751873761430593 2024-09-14T11:32:05.716 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:05.716+0000 7f443b7fe640 20 handle_completion(): completion ok for obj=foo-LUKEWARM-LUKEWARM 2024-09-14T11:32:05.717 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:05.716+0000 7f45669169c0 20 get_obj_state: octx=0x7f455c06db20 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-STANDARD-FROZEN state=0x55e243304a38 s->prefetch_data=0 2024-09-14T11:32:05.718 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:05.720+0000 7f45669169c0 10 manifest: total_size = 45360 2024-09-14T11:32:05.718 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:05.720+0000 7f45669169c0 20 get_obj_state: setting s->obj_tag to _HfaNZJ74hLvyvytb4PiNa4Z5z9eegon 2024-09-14T11:32:05.718 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:05.720+0000 7f45669169c0 20 get_obj_state: octx=0x7f455c06db20 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-STANDARD-FROZEN state=0x55e243304a38 s->prefetch_data=0 2024-09-14T11:32:05.719 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:05.720+0000 7f45669169c0 20 prepare_atomic_modification: state is not atomic. state=0x55e243304a38 2024-09-14T11:32:05.719 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:05.720+0000 7f45669169c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.16.8 2024-09-14T11:32:05.725 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:05.724+0000 7f45669169c0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-14T11:32:05.725 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:05.724+0000 7f45669169c0 20 RGWObjManifest::operator++(): result: ofs=45360 stripe_ofs=45360 part_ofs=0 rule->part_size=0 2024-09-14T11:32:05.725 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:05.724+0000 7f45669169c0 20 garbage collection: RGWGC::send_split_chain - tag is: _HfaNZJ74hLvyvytb4PiNa4Z5z9eegon 2024-09-14T11:32:05.725 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:05.724+0000 7f45669169c0 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-14T11:32:05.725 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:05.724+0000 7f45669169c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.16__shadow_.wvZTqCcbOhnlIHlWQVeUFe_NM92uHcY_0 2024-09-14T11:32:05.725 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:05.724+0000 7f45669169c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 308 2024-09-14T11:32:05.725 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:05.724+0000 7f45669169c0 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-14T11:32:05.725 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:05.724+0000 7f45669169c0 20 garbage collection: RGWGC::send_chain - on object name: gc.12tag is: _HfaNZJ74hLvyvytb4PiNa4Z5z9eegon 2024-09-14T11:32:05.728 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:05.728+0000 7f443affd640 20 handle_completion(): completion ok for obj=foo-STANDARD-FROZEN 2024-09-14T11:32:05.728 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:05.728+0000 7f45669169c0 20 get_obj_state: octx=0x7f455c0633a0 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-FROZEN-FROZEN state=0x55e243304a38 s->prefetch_data=0 2024-09-14T11:32:05.730 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:05.732+0000 7f45669169c0 10 manifest: total_size = 11534336 2024-09-14T11:32:05.730 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:05.732+0000 7f45669169c0 20 get_obj_state: setting s->obj_tag to d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.14334832967916961540 2024-09-14T11:32:05.730 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:05.732+0000 7f45669169c0 20 get_obj_state: octx=0x7f455c0633a0 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-FROZEN-FROZEN state=0x55e243304a38 s->prefetch_data=0 2024-09-14T11:32:05.730 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:05.732+0000 7f45669169c0 20 prepare_atomic_modification: state is not atomic. state=0x55e243304a38 2024-09-14T11:32:05.730 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:05.732+0000 7f45669169c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.16.9 2024-09-14T11:32:05.737 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:05.736+0000 7f45669169c0 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2024-09-14T11:32:05.737 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:05.736+0000 7f45669169c0 20 RGWObjManifest::operator++(): stripe_ofs=4194304 part_ofs=0 rule->part_size=5242880 2024-09-14T11:32:05.737 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:05.736+0000 7f45669169c0 20 RGWObjManifest::operator++(): result: ofs=4194304 stripe_ofs=4194304 part_ofs=0 rule->part_size=5242880 2024-09-14T11:32:05.738 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:05.736+0000 7f45669169c0 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2024-09-14T11:32:05.738 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:05.736+0000 7f45669169c0 20 RGWObjManifest::operator++(): stripe_ofs=8388608 part_ofs=0 rule->part_size=5242880 2024-09-14T11:32:05.738 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:05.736+0000 7f45669169c0 20 RGWObjManifest::operator++(): result: ofs=5242880 stripe_ofs=5242880 part_ofs=5242880 rule->part_size=5242880 2024-09-14T11:32:05.738 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:05.736+0000 7f45669169c0 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2024-09-14T11:32:05.738 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:05.736+0000 7f45669169c0 20 RGWObjManifest::operator++(): stripe_ofs=9437184 part_ofs=5242880 rule->part_size=5242880 2024-09-14T11:32:05.738 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:05.736+0000 7f45669169c0 20 RGWObjManifest::operator++(): result: ofs=9437184 stripe_ofs=9437184 part_ofs=5242880 rule->part_size=5242880 2024-09-14T11:32:05.738 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:05.736+0000 7f45669169c0 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2024-09-14T11:32:05.738 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:05.736+0000 7f45669169c0 20 RGWObjManifest::operator++(): stripe_ofs=13631488 part_ofs=5242880 rule->part_size=5242880 2024-09-14T11:32:05.738 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:05.736+0000 7f45669169c0 20 RGWObjManifest::operator++(): result: ofs=10485760 stripe_ofs=10485760 part_ofs=10485760 rule->part_size=1048576 2024-09-14T11:32:05.738 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:05.736+0000 7f45669169c0 20 RGWObjManifest::operator++(): rule->part_size=1048576 rules.size()=2 2024-09-14T11:32:05.738 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:05.736+0000 7f45669169c0 20 RGWObjManifest::operator++(): stripe_ofs=14680064 part_ofs=10485760 rule->part_size=1048576 2024-09-14T11:32:05.738 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:05.736+0000 7f45669169c0 20 RGWObjManifest::operator++(): result: ofs=11534336 stripe_ofs=11534336 part_ofs=11534336 rule->part_size=1048576 2024-09-14T11:32:05.738 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:05.736+0000 7f45669169c0 20 garbage collection: RGWGC::send_split_chain - tag is: d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.14334832967916961540 2024-09-14T11:32:05.739 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:05.736+0000 7f45669169c0 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-14T11:32:05.739 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:05.736+0000 7f45669169c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.16__multipart_foo-FROZEN.2~SoLpOsEgNVUd6LOC83yZzuLMoUbW0AA.1 2024-09-14T11:32:05.739 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:05.736+0000 7f45669169c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 368 2024-09-14T11:32:05.739 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:05.736+0000 7f45669169c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.16__shadow_foo-FROZEN.2~SoLpOsEgNVUd6LOC83yZzuLMoUbW0AA.1_1 2024-09-14T11:32:05.739 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:05.736+0000 7f45669169c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 633 2024-09-14T11:32:05.739 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:05.736+0000 7f45669169c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.16__multipart_foo-FROZEN.2~SoLpOsEgNVUd6LOC83yZzuLMoUbW0AA.2 2024-09-14T11:32:05.739 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:05.736+0000 7f45669169c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 900 2024-09-14T11:32:05.739 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:05.736+0000 7f45669169c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.16__shadow_foo-FROZEN.2~SoLpOsEgNVUd6LOC83yZzuLMoUbW0AA.2_1 2024-09-14T11:32:05.739 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:05.736+0000 7f45669169c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 1165 2024-09-14T11:32:05.739 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:05.736+0000 7f45669169c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.16__multipart_foo-FROZEN.2~SoLpOsEgNVUd6LOC83yZzuLMoUbW0AA.3 2024-09-14T11:32:05.739 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:05.736+0000 7f45669169c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 1432 2024-09-14T11:32:05.739 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:05.736+0000 7f45669169c0 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-14T11:32:05.739 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:05.736+0000 7f45669169c0 20 garbage collection: RGWGC::send_chain - on object name: gc.27tag is: d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.14334832967916961540 2024-09-14T11:32:05.740 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:05.740+0000 7f443b7fe640 20 handle_completion(): completion ok for obj=foo-FROZEN-FROZEN 2024-09-14T11:32:05.742 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:05.744+0000 7f45669169c0 20 list_objects_ordered: starting attempt 1 2024-09-14T11:32:05.742 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:05.744+0000 7f45669169c0 10 cls_bucket_list_ordered: request from each of 11 shard(s) for 112 entries to get 1001 total entries 2024-09-14T11:32:05.744 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:05.744+0000 7f45669169c0 20 cls_bucket_list_ordered: returning, count=0, is_truncated=0 2024-09-14T11:32:05.744 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:05.744+0000 7f45669169c0 20 cls_bucket_list_ordered: returning, last_entry NOT SET 2024-09-14T11:32:05.744 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:05.744+0000 7f45669169c0 10 list_objects_ordered: end of outer loop, truncated=0, count=0, attempt=1 2024-09-14T11:32:05.744 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:05.744+0000 7f45669169c0 10 list_objects_ordered: exiting attempt loop because we reached end (0) or we're returning half the requested entries (0 of 1000) 2024-09-14T11:32:05.744 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:05.744+0000 7f45669169c0 20 abort_multiparts INFO: aborting and cleaning up multipart upload(s); bucket=":test-client.0-r-test-obj-storage-class-multipart-copy.1[d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.16])"; uploads.size()=0; is_truncated=0 2024-09-14T11:32:05.749 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:05.748+0000 7f45669169c0 10 cache get: name=default.rgw.meta+root+test-client.0-r-test-obj-storage-class-multipart-copy.1 : miss 2024-09-14T11:32:05.749 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:05.748+0000 7f45669169c0 20 rados->read ofs=0 len=0 2024-09-14T11:32:05.750 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:05.752+0000 7f45669169c0 20 rados_obj.operate() r=0 bl.length=243 2024-09-14T11:32:05.750 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:05.752+0000 7f45669169c0 10 cache put: name=default.rgw.meta+root+test-client.0-r-test-obj-storage-class-multipart-copy.1 info.flags=0x11 2024-09-14T11:32:05.750 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:05.752+0000 7f45669169c0 10 adding default.rgw.meta+root+test-client.0-r-test-obj-storage-class-multipart-copy.1 to cache LRU end 2024-09-14T11:32:05.753 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:05.752+0000 7f45669169c0 10 removing default.rgw.meta+root+test-client.0-r-test-obj-storage-class-multipart-copy.1 from cache 2024-09-14T11:32:05.753 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:05.752+0000 7f45669169c0 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 1, obj: default.rgw.meta:root:test-client.0-r-test-obj-storage-class-multipart-copy.1, ofs0, ns] 2024-09-14T11:32:05.754 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:05.756+0000 7f443b7fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366156 cookie 94430277928784 notifier 5874 bl.length()=199 2024-09-14T11:32:05.760 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:05.760+0000 7f45669169c0 10 removing default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class-multipart-copy.1:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.16 from cache 2024-09-14T11:32:05.760 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:05.760+0000 7f45669169c0 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 1, obj: default.rgw.meta:root:.bucket.meta.test-client.0-r-test-obj-storage-class-multipart-copy.1:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.16, ofs0, ns] 2024-09-14T11:32:05.761 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:05.760+0000 7f443affd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366166 cookie 94430277893856 notifier 5874 bl.length()=257 2024-09-14T11:32:05.770 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:05.772+0000 7f45669169c0 10 cache get: name=default.rgw.log++pubsub..bucket.test-client.0-r-test-obj-storage-class-multipart-copy.1/d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.16 : miss 2024-09-14T11:32:05.770 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:05.772+0000 7f45669169c0 20 rados->read ofs=0 len=0 2024-09-14T11:32:05.771 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:05.772+0000 7f45669169c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:32:05.771 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:05.772+0000 7f45669169c0 10 cache put: name=default.rgw.log++pubsub..bucket.test-client.0-r-test-obj-storage-class-multipart-copy.1/d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.16 info.flags=0x0 2024-09-14T11:32:05.771 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:05.772+0000 7f45669169c0 10 adding default.rgw.log++pubsub..bucket.test-client.0-r-test-obj-storage-class-multipart-copy.1/d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.16 to cache LRU end 2024-09-14T11:32:05.776 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:05.776+0000 7f45669169c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class-multipart.1:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.14 : miss 2024-09-14T11:32:05.777 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:05.776+0000 7f45669169c0 20 rados->read ofs=0 len=0 2024-09-14T11:32:05.778 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:05.780+0000 7f45669169c0 20 rados_obj.operate() r=0 bl.length=460 2024-09-14T11:32:05.778 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:05.780+0000 7f45669169c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class-multipart.1:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.14 info.flags=0x17 2024-09-14T11:32:05.778 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:05.780+0000 7f45669169c0 10 adding default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class-multipart.1:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.14 to cache LRU end 2024-09-14T11:32:05.778 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:05.780+0000 7f45669169c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:32:05.778 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:05.780+0000 7f45669169c0 10 updating xattr: name=user.rgw.acl bl.length()=209 2024-09-14T11:32:05.778 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:05.780+0000 7f45669169c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class-multipart.1:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.14 2024-09-14T11:32:05.782 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:05.784+0000 7f45669169c0 10 cls_bucket_list_unordered: got foo-FROZEN 2024-09-14T11:32:05.784 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:05.784+0000 7f45669169c0 10 cls_bucket_list_unordered: got foo-STANDARD 2024-09-14T11:32:05.785 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:05.784+0000 7f45669169c0 10 cls_bucket_list_unordered: got foo-LUKEWARM 2024-09-14T11:32:05.788 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:05.788+0000 7f45669169c0 20 get_obj_state: octx=0x55e2432ef6a0 obj=test-client.0-r-test-obj-storage-class-multipart.1:foo-FROZEN state=0x55e2433110b8 s->prefetch_data=0 2024-09-14T11:32:05.789 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:05.788+0000 7f45669169c0 10 manifest: total_size = 11534336 2024-09-14T11:32:05.789 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:05.788+0000 7f45669169c0 20 get_obj_state: setting s->obj_tag to d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.916882130335952568 2024-09-14T11:32:05.789 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:05.788+0000 7f45669169c0 20 get_obj_state: octx=0x55e2432ef6a0 obj=test-client.0-r-test-obj-storage-class-multipart.1:foo-FROZEN state=0x55e2433110b8 s->prefetch_data=0 2024-09-14T11:32:05.789 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:05.788+0000 7f45669169c0 20 prepare_atomic_modification: state is not atomic. state=0x55e2433110b8 2024-09-14T11:32:05.789 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:05.788+0000 7f45669169c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.14.3 2024-09-14T11:32:05.796 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:05.796+0000 7f45669169c0 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2024-09-14T11:32:05.796 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:05.796+0000 7f45669169c0 20 RGWObjManifest::operator++(): stripe_ofs=4194304 part_ofs=0 rule->part_size=5242880 2024-09-14T11:32:05.796 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:05.796+0000 7f45669169c0 20 RGWObjManifest::operator++(): result: ofs=4194304 stripe_ofs=4194304 part_ofs=0 rule->part_size=5242880 2024-09-14T11:32:05.796 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:05.796+0000 7f45669169c0 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2024-09-14T11:32:05.796 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:05.796+0000 7f45669169c0 20 RGWObjManifest::operator++(): stripe_ofs=8388608 part_ofs=0 rule->part_size=5242880 2024-09-14T11:32:05.797 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:05.796+0000 7f45669169c0 20 RGWObjManifest::operator++(): result: ofs=5242880 stripe_ofs=5242880 part_ofs=5242880 rule->part_size=5242880 2024-09-14T11:32:05.797 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:05.796+0000 7f45669169c0 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2024-09-14T11:32:05.797 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:05.796+0000 7f45669169c0 20 RGWObjManifest::operator++(): stripe_ofs=9437184 part_ofs=5242880 rule->part_size=5242880 2024-09-14T11:32:05.797 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:05.796+0000 7f45669169c0 20 RGWObjManifest::operator++(): result: ofs=9437184 stripe_ofs=9437184 part_ofs=5242880 rule->part_size=5242880 2024-09-14T11:32:05.797 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:05.796+0000 7f45669169c0 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2024-09-14T11:32:05.797 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:05.796+0000 7f45669169c0 20 RGWObjManifest::operator++(): stripe_ofs=13631488 part_ofs=5242880 rule->part_size=5242880 2024-09-14T11:32:05.797 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:05.796+0000 7f45669169c0 20 RGWObjManifest::operator++(): result: ofs=10485760 stripe_ofs=10485760 part_ofs=10485760 rule->part_size=1048576 2024-09-14T11:32:05.797 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:05.796+0000 7f45669169c0 20 RGWObjManifest::operator++(): rule->part_size=1048576 rules.size()=2 2024-09-14T11:32:05.797 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:05.796+0000 7f45669169c0 20 RGWObjManifest::operator++(): stripe_ofs=14680064 part_ofs=10485760 rule->part_size=1048576 2024-09-14T11:32:05.797 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:05.796+0000 7f45669169c0 20 RGWObjManifest::operator++(): result: ofs=11534336 stripe_ofs=11534336 part_ofs=11534336 rule->part_size=1048576 2024-09-14T11:32:05.797 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:05.796+0000 7f45669169c0 20 garbage collection: RGWGC::send_split_chain - tag is: d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.916882130335952568 2024-09-14T11:32:05.797 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:05.796+0000 7f45669169c0 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-14T11:32:05.797 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:05.796+0000 7f45669169c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.14__multipart_foo-FROZEN.2~ltfDeJgWMr51pdmYKEkw1SuEYqzFW0v.1 2024-09-14T11:32:05.798 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:05.796+0000 7f45669169c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 366 2024-09-14T11:32:05.798 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:05.796+0000 7f45669169c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.14__shadow_foo-FROZEN.2~ltfDeJgWMr51pdmYKEkw1SuEYqzFW0v.1_1 2024-09-14T11:32:05.798 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:05.796+0000 7f45669169c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 631 2024-09-14T11:32:05.798 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:05.796+0000 7f45669169c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.14__multipart_foo-FROZEN.2~ltfDeJgWMr51pdmYKEkw1SuEYqzFW0v.2 2024-09-14T11:32:05.798 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:05.796+0000 7f45669169c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 898 2024-09-14T11:32:05.798 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:05.796+0000 7f45669169c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.14__shadow_foo-FROZEN.2~ltfDeJgWMr51pdmYKEkw1SuEYqzFW0v.2_1 2024-09-14T11:32:05.798 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:05.796+0000 7f45669169c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 1163 2024-09-14T11:32:05.798 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:05.796+0000 7f45669169c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.14__multipart_foo-FROZEN.2~ltfDeJgWMr51pdmYKEkw1SuEYqzFW0v.3 2024-09-14T11:32:05.798 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:05.796+0000 7f45669169c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 1430 2024-09-14T11:32:05.798 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:05.796+0000 7f45669169c0 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-14T11:32:05.798 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:05.796+0000 7f45669169c0 20 garbage collection: RGWGC::send_chain - on object name: gc.5tag is: d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.916882130335952568 2024-09-14T11:32:05.799 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:05.800+0000 7f443affd640 20 handle_completion(): completion ok for obj=foo-FROZEN 2024-09-14T11:32:05.800 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:05.800+0000 7f45669169c0 20 get_obj_state: octx=0x55e2432f0960 obj=test-client.0-r-test-obj-storage-class-multipart.1:foo-STANDARD state=0x55e2433110b8 s->prefetch_data=0 2024-09-14T11:32:05.801 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:05.800+0000 7f45669169c0 10 manifest: total_size = 16380 2024-09-14T11:32:05.801 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:05.800+0000 7f45669169c0 20 get_obj_state: setting s->obj_tag to d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.8743947693219366037 2024-09-14T11:32:05.801 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:05.800+0000 7f45669169c0 20 get_obj_state: octx=0x55e2432f0960 obj=test-client.0-r-test-obj-storage-class-multipart.1:foo-STANDARD state=0x55e2433110b8 s->prefetch_data=0 2024-09-14T11:32:05.801 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:05.800+0000 7f45669169c0 20 prepare_atomic_modification: state is not atomic. state=0x55e2433110b8 2024-09-14T11:32:05.801 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:05.800+0000 7f45669169c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.14.5 2024-09-14T11:32:05.809 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:05.808+0000 7f45669169c0 20 RGWObjManifest::operator++(): rule->part_size=7672 rules.size()=3 2024-09-14T11:32:05.809 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:05.808+0000 7f45669169c0 20 RGWObjManifest::operator++(): stripe_ofs=4194304 part_ofs=0 rule->part_size=7672 2024-09-14T11:32:05.809 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:05.808+0000 7f45669169c0 20 RGWObjManifest::operator++(): result: ofs=7672 stripe_ofs=7672 part_ofs=7672 rule->part_size=7673 2024-09-14T11:32:05.809 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:05.808+0000 7f45669169c0 20 RGWObjManifest::operator++(): rule->part_size=7673 rules.size()=3 2024-09-14T11:32:05.809 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:05.808+0000 7f45669169c0 20 RGWObjManifest::operator++(): stripe_ofs=4201976 part_ofs=7672 rule->part_size=7673 2024-09-14T11:32:05.809 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:05.808+0000 7f45669169c0 20 RGWObjManifest::operator++(): result: ofs=15345 stripe_ofs=15345 part_ofs=15345 rule->part_size=1035 2024-09-14T11:32:05.809 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:05.808+0000 7f45669169c0 20 RGWObjManifest::operator++(): rule->part_size=1035 rules.size()=3 2024-09-14T11:32:05.809 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:05.808+0000 7f45669169c0 20 RGWObjManifest::operator++(): stripe_ofs=4209649 part_ofs=15345 rule->part_size=1035 2024-09-14T11:32:05.809 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:05.808+0000 7f45669169c0 20 RGWObjManifest::operator++(): result: ofs=16380 stripe_ofs=16380 part_ofs=16380 rule->part_size=1035 2024-09-14T11:32:05.809 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:05.808+0000 7f45669169c0 20 garbage collection: RGWGC::send_split_chain - tag is: d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.8743947693219366037 2024-09-14T11:32:05.809 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:05.808+0000 7f45669169c0 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-14T11:32:05.809 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:05.808+0000 7f45669169c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.14__multipart_foo-STANDARD.2~6c-KYIVqby5C83_JoX-1kVye5RRg4lx.1 2024-09-14T11:32:05.810 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:05.808+0000 7f45669169c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 364 2024-09-14T11:32:05.810 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:05.808+0000 7f45669169c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.14__multipart_foo-STANDARD.2~6c-KYIVqby5C83_JoX-1kVye5RRg4lx.2 2024-09-14T11:32:05.810 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:05.808+0000 7f45669169c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 628 2024-09-14T11:32:05.810 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:05.808+0000 7f45669169c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.14__multipart_foo-STANDARD.2~6c-KYIVqby5C83_JoX-1kVye5RRg4lx.3 2024-09-14T11:32:05.810 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:05.808+0000 7f45669169c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 892 2024-09-14T11:32:05.810 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:05.808+0000 7f45669169c0 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-14T11:32:05.810 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:05.808+0000 7f45669169c0 20 garbage collection: RGWGC::send_chain - on object name: gc.28tag is: d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.8743947693219366037 2024-09-14T11:32:05.812 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:05.812+0000 7f443b7fe640 20 handle_completion(): completion ok for obj=foo-STANDARD 2024-09-14T11:32:05.812 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:05.812+0000 7f45669169c0 20 get_obj_state: octx=0x7f455805d600 obj=test-client.0-r-test-obj-storage-class-multipart.1:foo-LUKEWARM state=0x55e2433110b8 s->prefetch_data=0 2024-09-14T11:32:05.814 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:05.812+0000 7f45669169c0 10 manifest: total_size = 11534336 2024-09-14T11:32:05.814 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:05.812+0000 7f45669169c0 20 get_obj_state: setting s->obj_tag to d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.16950907896604654502 2024-09-14T11:32:05.814 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:05.812+0000 7f45669169c0 20 get_obj_state: octx=0x7f455805d600 obj=test-client.0-r-test-obj-storage-class-multipart.1:foo-LUKEWARM state=0x55e2433110b8 s->prefetch_data=0 2024-09-14T11:32:05.814 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:05.812+0000 7f45669169c0 20 prepare_atomic_modification: state is not atomic. state=0x55e2433110b8 2024-09-14T11:32:05.814 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:05.812+0000 7f45669169c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.14.7 2024-09-14T11:32:05.821 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:05.820+0000 7f45669169c0 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2024-09-14T11:32:05.821 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:05.820+0000 7f45669169c0 20 RGWObjManifest::operator++(): stripe_ofs=4194304 part_ofs=0 rule->part_size=5242880 2024-09-14T11:32:05.821 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:05.820+0000 7f45669169c0 20 RGWObjManifest::operator++(): result: ofs=4194304 stripe_ofs=4194304 part_ofs=0 rule->part_size=5242880 2024-09-14T11:32:05.821 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:05.820+0000 7f45669169c0 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2024-09-14T11:32:05.821 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:05.820+0000 7f45669169c0 20 RGWObjManifest::operator++(): stripe_ofs=8388608 part_ofs=0 rule->part_size=5242880 2024-09-14T11:32:05.821 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:05.820+0000 7f45669169c0 20 RGWObjManifest::operator++(): result: ofs=5242880 stripe_ofs=5242880 part_ofs=5242880 rule->part_size=5242880 2024-09-14T11:32:05.821 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:05.820+0000 7f45669169c0 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2024-09-14T11:32:05.821 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:05.820+0000 7f45669169c0 20 RGWObjManifest::operator++(): stripe_ofs=9437184 part_ofs=5242880 rule->part_size=5242880 2024-09-14T11:32:05.821 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:05.820+0000 7f45669169c0 20 RGWObjManifest::operator++(): result: ofs=9437184 stripe_ofs=9437184 part_ofs=5242880 rule->part_size=5242880 2024-09-14T11:32:05.821 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:05.820+0000 7f45669169c0 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2024-09-14T11:32:05.821 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:05.820+0000 7f45669169c0 20 RGWObjManifest::operator++(): stripe_ofs=13631488 part_ofs=5242880 rule->part_size=5242880 2024-09-14T11:32:05.822 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:05.820+0000 7f45669169c0 20 RGWObjManifest::operator++(): result: ofs=10485760 stripe_ofs=10485760 part_ofs=10485760 rule->part_size=1048576 2024-09-14T11:32:05.822 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:05.820+0000 7f45669169c0 20 RGWObjManifest::operator++(): rule->part_size=1048576 rules.size()=2 2024-09-14T11:32:05.822 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:05.820+0000 7f45669169c0 20 RGWObjManifest::operator++(): stripe_ofs=14680064 part_ofs=10485760 rule->part_size=1048576 2024-09-14T11:32:05.822 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:05.820+0000 7f45669169c0 20 RGWObjManifest::operator++(): result: ofs=11534336 stripe_ofs=11534336 part_ofs=11534336 rule->part_size=1048576 2024-09-14T11:32:05.822 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:05.820+0000 7f45669169c0 20 garbage collection: RGWGC::send_split_chain - tag is: d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.16950907896604654502 2024-09-14T11:32:05.822 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:05.820+0000 7f45669169c0 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-14T11:32:05.822 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:05.820+0000 7f45669169c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.14__multipart_foo-LUKEWARM.2~D3lXIzvsi9XIEl9vMQOxPIhNZUw6QEv.1 2024-09-14T11:32:05.822 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:05.820+0000 7f45669169c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 374 2024-09-14T11:32:05.822 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:05.820+0000 7f45669169c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.14__shadow_foo-LUKEWARM.2~D3lXIzvsi9XIEl9vMQOxPIhNZUw6QEv.1_1 2024-09-14T11:32:05.822 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:05.820+0000 7f45669169c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 645 2024-09-14T11:32:05.822 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:05.820+0000 7f45669169c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.14__multipart_foo-LUKEWARM.2~D3lXIzvsi9XIEl9vMQOxPIhNZUw6QEv.2 2024-09-14T11:32:05.822 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:05.820+0000 7f45669169c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 918 2024-09-14T11:32:05.822 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:05.820+0000 7f45669169c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.14__shadow_foo-LUKEWARM.2~D3lXIzvsi9XIEl9vMQOxPIhNZUw6QEv.2_1 2024-09-14T11:32:05.822 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:05.820+0000 7f45669169c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 1189 2024-09-14T11:32:05.823 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:05.820+0000 7f45669169c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.14__multipart_foo-LUKEWARM.2~D3lXIzvsi9XIEl9vMQOxPIhNZUw6QEv.3 2024-09-14T11:32:05.823 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:05.820+0000 7f45669169c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 1462 2024-09-14T11:32:05.823 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:05.820+0000 7f45669169c0 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-14T11:32:05.823 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:05.820+0000 7f45669169c0 20 garbage collection: RGWGC::send_chain - on object name: gc.19tag is: d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.16950907896604654502 2024-09-14T11:32:05.824 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:05.824+0000 7f443affd640 20 handle_completion(): completion ok for obj=foo-LUKEWARM 2024-09-14T11:32:05.824 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:05.824+0000 7f45669169c0 20 list_objects_ordered: starting attempt 1 2024-09-14T11:32:05.824 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:05.824+0000 7f45669169c0 10 cls_bucket_list_ordered: request from each of 11 shard(s) for 112 entries to get 1001 total entries 2024-09-14T11:32:05.827 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:05.828+0000 7f45669169c0 20 cls_bucket_list_ordered: returning, count=0, is_truncated=0 2024-09-14T11:32:05.827 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:05.828+0000 7f45669169c0 20 cls_bucket_list_ordered: returning, last_entry NOT SET 2024-09-14T11:32:05.827 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:05.828+0000 7f45669169c0 10 list_objects_ordered: end of outer loop, truncated=0, count=0, attempt=1 2024-09-14T11:32:05.827 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:05.828+0000 7f45669169c0 10 list_objects_ordered: exiting attempt loop because we reached end (0) or we're returning half the requested entries (0 of 1000) 2024-09-14T11:32:05.827 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:05.828+0000 7f45669169c0 20 abort_multiparts INFO: aborting and cleaning up multipart upload(s); bucket=":test-client.0-r-test-obj-storage-class-multipart.1[d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.14])"; uploads.size()=0; is_truncated=0 2024-09-14T11:32:05.832 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:05.832+0000 7f45669169c0 10 cache get: name=default.rgw.meta+root+test-client.0-r-test-obj-storage-class-multipart.1 : miss 2024-09-14T11:32:05.832 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:05.832+0000 7f45669169c0 20 rados->read ofs=0 len=0 2024-09-14T11:32:05.833 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:05.832+0000 7f45669169c0 20 rados_obj.operate() r=0 bl.length=238 2024-09-14T11:32:05.833 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:05.832+0000 7f45669169c0 10 cache put: name=default.rgw.meta+root+test-client.0-r-test-obj-storage-class-multipart.1 info.flags=0x11 2024-09-14T11:32:05.833 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:05.832+0000 7f45669169c0 10 adding default.rgw.meta+root+test-client.0-r-test-obj-storage-class-multipart.1 to cache LRU end 2024-09-14T11:32:05.836 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:05.836+0000 7f45669169c0 10 removing default.rgw.meta+root+test-client.0-r-test-obj-storage-class-multipart.1 from cache 2024-09-14T11:32:05.836 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:05.836+0000 7f45669169c0 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 1, obj: default.rgw.meta:root:test-client.0-r-test-obj-storage-class-multipart.1, ofs0, ns] 2024-09-14T11:32:05.837 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:05.836+0000 7f443affd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366163 cookie 94430277937680 notifier 5874 bl.length()=194 2024-09-14T11:32:05.844 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:05.844+0000 7f45669169c0 10 removing default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class-multipart.1:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.14 from cache 2024-09-14T11:32:05.845 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:05.844+0000 7f45669169c0 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 1, obj: default.rgw.meta:root:.bucket.meta.test-client.0-r-test-obj-storage-class-multipart.1:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.14, ofs0, ns] 2024-09-14T11:32:05.845 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:05.844+0000 7f443affd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366167 cookie 94430277893856 notifier 5874 bl.length()=252 2024-09-14T11:32:05.857 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:05.856+0000 7f45669169c0 10 cache get: name=default.rgw.log++pubsub..bucket.test-client.0-r-test-obj-storage-class-multipart.1/d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.14 : miss 2024-09-14T11:32:05.857 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:05.856+0000 7f45669169c0 20 rados->read ofs=0 len=0 2024-09-14T11:32:05.857 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:05.860+0000 7f45669169c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:32:05.857 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:05.860+0000 7f45669169c0 10 cache put: name=default.rgw.log++pubsub..bucket.test-client.0-r-test-obj-storage-class-multipart.1/d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.14 info.flags=0x0 2024-09-14T11:32:05.858 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:05.860+0000 7f45669169c0 10 adding default.rgw.log++pubsub..bucket.test-client.0-r-test-obj-storage-class-multipart.1/d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.14 to cache LRU end 2024-09-14T11:32:05.863 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:05.864+0000 7f45669169c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class.1:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.13 : miss 2024-09-14T11:32:05.863 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:05.864+0000 7f45669169c0 20 rados->read ofs=0 len=0 2024-09-14T11:32:05.864 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:05.864+0000 7f45669169c0 20 rados_obj.operate() r=0 bl.length=450 2024-09-14T11:32:05.864 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:05.864+0000 7f45669169c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class.1:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.13 info.flags=0x17 2024-09-14T11:32:05.864 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:05.864+0000 7f45669169c0 10 adding default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class.1:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.13 to cache LRU end 2024-09-14T11:32:05.865 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:05.864+0000 7f45669169c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:32:05.865 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:05.864+0000 7f45669169c0 10 updating xattr: name=user.rgw.acl bl.length()=209 2024-09-14T11:32:05.865 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:05.864+0000 7f45669169c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class.1:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.13 2024-09-14T11:32:05.868 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:05.868+0000 7f45669169c0 10 cls_bucket_list_unordered: got foo-FROZEN 2024-09-14T11:32:05.870 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:05.872+0000 7f45669169c0 10 cls_bucket_list_unordered: got foo-STANDARD 2024-09-14T11:32:05.872 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:05.872+0000 7f45669169c0 10 cls_bucket_list_unordered: got foo-LUKEWARM 2024-09-14T11:32:05.876 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:05.876+0000 7f45669169c0 20 get_obj_state: octx=0x55e2432f1310 obj=test-client.0-r-test-obj-storage-class.1:foo-FROZEN state=0x55e2433100a8 s->prefetch_data=0 2024-09-14T11:32:05.877 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:05.876+0000 7f45669169c0 10 manifest: total_size = 10485760 2024-09-14T11:32:05.877 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:05.876+0000 7f45669169c0 20 get_obj_state: setting s->obj_tag to d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.1856814068088010347 2024-09-14T11:32:05.877 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:05.876+0000 7f45669169c0 20 get_obj_state: octx=0x55e2432f1310 obj=test-client.0-r-test-obj-storage-class.1:foo-FROZEN state=0x55e2433100a8 s->prefetch_data=0 2024-09-14T11:32:05.877 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:05.876+0000 7f45669169c0 20 prepare_atomic_modification: state is not atomic. state=0x55e2433100a8 2024-09-14T11:32:05.877 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:05.876+0000 7f45669169c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.13.3 2024-09-14T11:32:05.884 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:05.884+0000 7f45669169c0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-14T11:32:05.884 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:05.884+0000 7f45669169c0 20 RGWObjManifest::operator++(): result: ofs=4194304 stripe_ofs=4194304 part_ofs=0 rule->part_size=0 2024-09-14T11:32:05.884 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:05.884+0000 7f45669169c0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-14T11:32:05.884 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:05.884+0000 7f45669169c0 20 RGWObjManifest::operator++(): result: ofs=8388608 stripe_ofs=8388608 part_ofs=0 rule->part_size=0 2024-09-14T11:32:05.884 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:05.884+0000 7f45669169c0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-14T11:32:05.884 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:05.884+0000 7f45669169c0 20 RGWObjManifest::operator++(): result: ofs=10485760 stripe_ofs=10485760 part_ofs=0 rule->part_size=0 2024-09-14T11:32:05.884 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:05.884+0000 7f45669169c0 20 garbage collection: RGWGC::send_split_chain - tag is: d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.1856814068088010347 2024-09-14T11:32:05.884 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:05.884+0000 7f45669169c0 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-14T11:32:05.884 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:05.884+0000 7f45669169c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.13__shadow_.eUaxoM6pljMkuIIpWyyY3O1A4AfBqzo_0 2024-09-14T11:32:05.884 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:05.884+0000 7f45669169c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 337 2024-09-14T11:32:05.884 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:05.884+0000 7f45669169c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.13__shadow_.eUaxoM6pljMkuIIpWyyY3O1A4AfBqzo_1 2024-09-14T11:32:05.885 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:05.884+0000 7f45669169c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 574 2024-09-14T11:32:05.885 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:05.884+0000 7f45669169c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.13__shadow_.eUaxoM6pljMkuIIpWyyY3O1A4AfBqzo_2 2024-09-14T11:32:05.885 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:05.884+0000 7f45669169c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 811 2024-09-14T11:32:05.885 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:05.884+0000 7f45669169c0 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-14T11:32:05.885 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:05.884+0000 7f45669169c0 20 garbage collection: RGWGC::send_chain - on object name: gc.5tag is: d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.1856814068088010347 2024-09-14T11:32:05.887 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:05.888+0000 7f443b7fe640 20 handle_completion(): completion ok for obj=foo-FROZEN 2024-09-14T11:32:05.887 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:05.888+0000 7f45669169c0 20 get_obj_state: octx=0x7f455805f500 obj=test-client.0-r-test-obj-storage-class.1:foo-STANDARD state=0x55e2433100a8 s->prefetch_data=0 2024-09-14T11:32:05.888 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:05.888+0000 7f45669169c0 10 manifest: total_size = 53502 2024-09-14T11:32:05.888 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:05.888+0000 7f45669169c0 20 get_obj_state: setting s->obj_tag to d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.5656055288411231019 2024-09-14T11:32:05.888 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:05.888+0000 7f45669169c0 20 get_obj_state: octx=0x7f455805f500 obj=test-client.0-r-test-obj-storage-class.1:foo-STANDARD state=0x55e2433100a8 s->prefetch_data=0 2024-09-14T11:32:05.888 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:05.888+0000 7f45669169c0 20 prepare_atomic_modification: state is not atomic. state=0x55e2433100a8 2024-09-14T11:32:05.888 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:05.888+0000 7f45669169c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.13.5 2024-09-14T11:32:05.894 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:05.896+0000 7f45669169c0 20 get_obj_state: octx=0x7f455c097b00 obj=test-client.0-r-test-obj-storage-class.1:foo-LUKEWARM state=0x55e2433100a8 s->prefetch_data=0 2024-09-14T11:32:05.895 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:05.896+0000 7f45669169c0 10 manifest: total_size = 10485760 2024-09-14T11:32:05.896 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:05.896+0000 7f45669169c0 20 get_obj_state: setting s->obj_tag to d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.12174749783492909916 2024-09-14T11:32:05.896 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:05.896+0000 7f45669169c0 20 get_obj_state: octx=0x7f455c097b00 obj=test-client.0-r-test-obj-storage-class.1:foo-LUKEWARM state=0x55e2433100a8 s->prefetch_data=0 2024-09-14T11:32:05.896 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:05.896+0000 7f45669169c0 20 prepare_atomic_modification: state is not atomic. state=0x55e2433100a8 2024-09-14T11:32:05.896 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:05.896+0000 7f45669169c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.13.7 2024-09-14T11:32:05.898 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:05.900+0000 7f443affd640 20 handle_completion(): completion ok for obj=foo-STANDARD 2024-09-14T11:32:05.902 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:05.904+0000 7f45669169c0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-14T11:32:05.902 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:05.904+0000 7f45669169c0 20 RGWObjManifest::operator++(): result: ofs=4194304 stripe_ofs=4194304 part_ofs=0 rule->part_size=0 2024-09-14T11:32:05.902 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:05.904+0000 7f45669169c0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-14T11:32:05.902 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:05.904+0000 7f45669169c0 20 RGWObjManifest::operator++(): result: ofs=8388608 stripe_ofs=8388608 part_ofs=0 rule->part_size=0 2024-09-14T11:32:05.903 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:05.904+0000 7f45669169c0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-14T11:32:05.903 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:05.904+0000 7f45669169c0 20 RGWObjManifest::operator++(): result: ofs=10485760 stripe_ofs=10485760 part_ofs=0 rule->part_size=0 2024-09-14T11:32:05.903 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:05.904+0000 7f45669169c0 20 garbage collection: RGWGC::send_split_chain - tag is: d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.12174749783492909916 2024-09-14T11:32:05.903 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:05.904+0000 7f45669169c0 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-14T11:32:05.903 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:05.904+0000 7f45669169c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.13__shadow_.IX-ntoTwzLNCH3WGpGAr4_hjLbKGG1n_0 2024-09-14T11:32:05.903 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:05.904+0000 7f45669169c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 340 2024-09-14T11:32:05.903 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:05.904+0000 7f45669169c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.13__shadow_.IX-ntoTwzLNCH3WGpGAr4_hjLbKGG1n_1 2024-09-14T11:32:05.903 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:05.904+0000 7f45669169c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 579 2024-09-14T11:32:05.903 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:05.904+0000 7f45669169c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.13__shadow_.IX-ntoTwzLNCH3WGpGAr4_hjLbKGG1n_2 2024-09-14T11:32:05.903 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:05.904+0000 7f45669169c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 818 2024-09-14T11:32:05.903 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:05.904+0000 7f45669169c0 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-14T11:32:05.903 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:05.904+0000 7f45669169c0 20 garbage collection: RGWGC::send_chain - on object name: gc.16tag is: d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.12174749783492909916 2024-09-14T11:32:05.905 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:05.904+0000 7f443b7fe640 20 handle_completion(): completion ok for obj=foo-LUKEWARM 2024-09-14T11:32:05.906 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:05.908+0000 7f45669169c0 20 list_objects_ordered: starting attempt 1 2024-09-14T11:32:05.906 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:05.908+0000 7f45669169c0 10 cls_bucket_list_ordered: request from each of 11 shard(s) for 112 entries to get 1001 total entries 2024-09-14T11:32:05.908 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:05.908+0000 7f45669169c0 20 cls_bucket_list_ordered: returning, count=0, is_truncated=0 2024-09-14T11:32:05.908 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:05.908+0000 7f45669169c0 20 cls_bucket_list_ordered: returning, last_entry NOT SET 2024-09-14T11:32:05.908 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:05.908+0000 7f45669169c0 10 list_objects_ordered: end of outer loop, truncated=0, count=0, attempt=1 2024-09-14T11:32:05.908 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:05.908+0000 7f45669169c0 10 list_objects_ordered: exiting attempt loop because we reached end (0) or we're returning half the requested entries (0 of 1000) 2024-09-14T11:32:05.908 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:05.908+0000 7f45669169c0 20 abort_multiparts INFO: aborting and cleaning up multipart upload(s); bucket=":test-client.0-r-test-obj-storage-class.1[d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.13])"; uploads.size()=0; is_truncated=0 2024-09-14T11:32:05.912 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:05.912+0000 7f45669169c0 10 cache get: name=default.rgw.meta+root+test-client.0-r-test-obj-storage-class.1 : miss 2024-09-14T11:32:05.913 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:05.912+0000 7f45669169c0 20 rados->read ofs=0 len=0 2024-09-14T11:32:05.913 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:05.912+0000 7f45669169c0 20 rados_obj.operate() r=0 bl.length=228 2024-09-14T11:32:05.913 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:05.912+0000 7f45669169c0 10 cache put: name=default.rgw.meta+root+test-client.0-r-test-obj-storage-class.1 info.flags=0x11 2024-09-14T11:32:05.913 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:05.912+0000 7f45669169c0 10 adding default.rgw.meta+root+test-client.0-r-test-obj-storage-class.1 to cache LRU end 2024-09-14T11:32:05.916 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:05.916+0000 7f45669169c0 10 removing default.rgw.meta+root+test-client.0-r-test-obj-storage-class.1 from cache 2024-09-14T11:32:05.916 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:05.916+0000 7f45669169c0 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 1, obj: default.rgw.meta:root:test-client.0-r-test-obj-storage-class.1, ofs0, ns] 2024-09-14T11:32:05.917 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:05.916+0000 7f443b7fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366168 cookie 94430277893856 notifier 5874 bl.length()=184 2024-09-14T11:32:05.923 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:05.924+0000 7f45669169c0 10 removing default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class.1:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.13 from cache 2024-09-14T11:32:05.923 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:05.924+0000 7f45669169c0 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 1, obj: default.rgw.meta:root:.bucket.meta.test-client.0-r-test-obj-storage-class.1:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.13, ofs0, ns] 2024-09-14T11:32:05.924 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:05.924+0000 7f443b7fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366206 cookie 94430277921952 notifier 5874 bl.length()=242 2024-09-14T11:32:05.933 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:05.932+0000 7f45669169c0 10 cache get: name=default.rgw.log++pubsub..bucket.test-client.0-r-test-obj-storage-class.1/d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.13 : miss 2024-09-14T11:32:05.933 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:05.932+0000 7f45669169c0 20 rados->read ofs=0 len=0 2024-09-14T11:32:05.934 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:05.936+0000 7f45669169c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:32:05.934 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:05.936+0000 7f45669169c0 10 cache put: name=default.rgw.log++pubsub..bucket.test-client.0-r-test-obj-storage-class.1/d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.13 info.flags=0x0 2024-09-14T11:32:05.934 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:05.936+0000 7f45669169c0 10 adding default.rgw.log++pubsub..bucket.test-client.0-r-test-obj-storage-class.1/d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.13 to cache LRU end 2024-09-14T11:32:05.940 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:05.940+0000 7f45669169c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-small-obj-data.1:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.6 : miss 2024-09-14T11:32:05.940 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:05.940+0000 7f45669169c0 20 rados->read ofs=0 len=0 2024-09-14T11:32:05.941 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:05.940+0000 7f45669169c0 20 rados_obj.operate() r=0 bl.length=445 2024-09-14T11:32:05.941 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:05.940+0000 7f45669169c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-small-obj-data.1:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.6 info.flags=0x17 2024-09-14T11:32:05.941 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:05.940+0000 7f45669169c0 10 adding default.rgw.meta+root+.bucket.meta.test-client.0-r-test-small-obj-data.1:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.6 to cache LRU end 2024-09-14T11:32:05.941 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:05.940+0000 7f45669169c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:32:05.941 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:05.940+0000 7f45669169c0 10 updating xattr: name=user.rgw.acl bl.length()=209 2024-09-14T11:32:05.941 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:05.940+0000 7f45669169c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-small-obj-data.1:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.6 2024-09-14T11:32:05.944 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:05.944+0000 7f45669169c0 10 cls_bucket_list_unordered: got ___ 2024-09-14T11:32:05.945 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:05.944+0000 7f45669169c0 10 cls_bucket_list_unordered: got __ _ 2024-09-14T11:32:05.948 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:05.948+0000 7f45669169c0 10 cls_bucket_list_unordered: got __ 2024-09-14T11:32:05.950 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:05.952+0000 7f45669169c0 10 cls_bucket_list_unordered: got obj 2024-09-14T11:32:05.952 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:05.952+0000 7f45669169c0 20 get_obj_state: octx=0x55e2432f6d20 obj=test-client.0-r-test-small-obj-data.1:___ state=0x55e24330fd28 s->prefetch_data=0 2024-09-14T11:32:05.953 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:05.952+0000 7f45669169c0 10 manifest: total_size = 0 2024-09-14T11:32:05.953 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:05.952+0000 7f45669169c0 20 get_obj_state: setting s->obj_tag to d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.14316520937345542477 2024-09-14T11:32:05.953 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:05.952+0000 7f45669169c0 20 get_obj_state: octx=0x55e2432f6d20 obj=test-client.0-r-test-small-obj-data.1:___ state=0x55e24330fd28 s->prefetch_data=0 2024-09-14T11:32:05.954 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:05.952+0000 7f45669169c0 20 prepare_atomic_modification: state is not atomic. state=0x55e24330fd28 2024-09-14T11:32:05.954 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:05.952+0000 7f45669169c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.6.2 2024-09-14T11:32:05.960 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:05.960+0000 7f45669169c0 20 get_obj_state: octx=0x55e2432eda40 obj=test-client.0-r-test-small-obj-data.1:__ _ state=0x55e24330fd28 s->prefetch_data=0 2024-09-14T11:32:05.961 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:05.960+0000 7f45669169c0 10 manifest: total_size = 0 2024-09-14T11:32:05.961 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:05.960+0000 7f45669169c0 20 get_obj_state: setting s->obj_tag to d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.3571773011601482067 2024-09-14T11:32:05.961 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:05.960+0000 7f45669169c0 20 get_obj_state: octx=0x55e2432eda40 obj=test-client.0-r-test-small-obj-data.1:__ _ state=0x55e24330fd28 s->prefetch_data=0 2024-09-14T11:32:05.961 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:05.960+0000 7f45669169c0 20 prepare_atomic_modification: state is not atomic. state=0x55e24330fd28 2024-09-14T11:32:05.962 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:05.960+0000 7f45669169c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.6.3 2024-09-14T11:32:05.963 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:05.964+0000 7f443b7fe640 20 handle_completion(): completion ok for obj=___ 2024-09-14T11:32:05.968 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:05.968+0000 7f45669169c0 20 get_obj_state: octx=0x7f4554004f40 obj=test-client.0-r-test-small-obj-data.1:__ state=0x55e24330fd28 s->prefetch_data=0 2024-09-14T11:32:05.970 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:05.972+0000 7f45669169c0 10 manifest: total_size = 0 2024-09-14T11:32:05.970 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:05.972+0000 7f45669169c0 20 get_obj_state: setting s->obj_tag to d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.11145413965876258581 2024-09-14T11:32:05.970 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:05.972+0000 7f45669169c0 20 get_obj_state: octx=0x7f4554004f40 obj=test-client.0-r-test-small-obj-data.1:__ state=0x55e24330fd28 s->prefetch_data=0 2024-09-14T11:32:05.970 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:05.972+0000 7f45669169c0 20 prepare_atomic_modification: state is not atomic. state=0x55e24330fd28 2024-09-14T11:32:05.970 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:05.972+0000 7f45669169c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.6.6 2024-09-14T11:32:05.972 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:05.972+0000 7f443affd640 20 handle_completion(): completion ok for obj=__ _ 2024-09-14T11:32:05.977 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:05.976+0000 7f45669169c0 20 get_obj_state: octx=0x7f455c097b00 obj=test-client.0-r-test-small-obj-data.1:obj state=0x55e24330fd28 s->prefetch_data=0 2024-09-14T11:32:05.978 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:05.980+0000 7f45669169c0 10 manifest: total_size = 0 2024-09-14T11:32:05.978 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:05.980+0000 7f45669169c0 20 get_obj_state: setting s->obj_tag to d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.5795907731373166900 2024-09-14T11:32:05.978 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:05.980+0000 7f45669169c0 20 get_obj_state: octx=0x7f455c097b00 obj=test-client.0-r-test-small-obj-data.1:obj state=0x55e24330fd28 s->prefetch_data=0 2024-09-14T11:32:05.978 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:05.980+0000 7f45669169c0 20 prepare_atomic_modification: state is not atomic. state=0x55e24330fd28 2024-09-14T11:32:05.978 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:05.980+0000 7f45669169c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.6.8 2024-09-14T11:32:05.980 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:05.980+0000 7f443b7fe640 20 handle_completion(): completion ok for obj=__ 2024-09-14T11:32:05.985 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:05.984+0000 7f45669169c0 20 list_objects_ordered: starting attempt 1 2024-09-14T11:32:05.985 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:05.984+0000 7f45669169c0 10 cls_bucket_list_ordered: request from each of 11 shard(s) for 112 entries to get 1001 total entries 2024-09-14T11:32:05.989 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:05.988+0000 7f443affd640 20 handle_completion(): completion ok for obj=obj 2024-09-14T11:32:05.990 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:05.992+0000 7f45669169c0 20 cls_bucket_list_ordered: returning, count=0, is_truncated=0 2024-09-14T11:32:05.990 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:05.992+0000 7f45669169c0 20 cls_bucket_list_ordered: returning, last_entry NOT SET 2024-09-14T11:32:05.990 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:05.992+0000 7f45669169c0 10 list_objects_ordered: end of outer loop, truncated=0, count=0, attempt=1 2024-09-14T11:32:05.990 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:05.992+0000 7f45669169c0 10 list_objects_ordered: exiting attempt loop because we reached end (0) or we're returning half the requested entries (0 of 1000) 2024-09-14T11:32:05.990 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:05.992+0000 7f45669169c0 20 abort_multiparts INFO: aborting and cleaning up multipart upload(s); bucket=":test-client.0-r-test-small-obj-data.1[d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.6])"; uploads.size()=0; is_truncated=0 2024-09-14T11:32:05.994 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:05.996+0000 7f45669169c0 10 cache get: name=default.rgw.meta+root+test-client.0-r-test-small-obj-data.1 : miss 2024-09-14T11:32:05.994 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:05.996+0000 7f45669169c0 20 rados->read ofs=0 len=0 2024-09-14T11:32:05.995 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:05.996+0000 7f45669169c0 20 rados_obj.operate() r=0 bl.length=223 2024-09-14T11:32:05.995 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:05.996+0000 7f45669169c0 10 cache put: name=default.rgw.meta+root+test-client.0-r-test-small-obj-data.1 info.flags=0x11 2024-09-14T11:32:05.995 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:05.996+0000 7f45669169c0 10 adding default.rgw.meta+root+test-client.0-r-test-small-obj-data.1 to cache LRU end 2024-09-14T11:32:05.999 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:06.000+0000 7f45669169c0 10 removing default.rgw.meta+root+test-client.0-r-test-small-obj-data.1 from cache 2024-09-14T11:32:05.999 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:06.000+0000 7f45669169c0 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 1, obj: default.rgw.meta:root:test-client.0-r-test-small-obj-data.1, ofs0, ns] 2024-09-14T11:32:06.000 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:06.000+0000 7f443b7fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366207 cookie 94430277921952 notifier 5874 bl.length()=181 2024-09-14T11:32:06.007 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:06.008+0000 7f45669169c0 10 removing default.rgw.meta+root+.bucket.meta.test-client.0-r-test-small-obj-data.1:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.6 from cache 2024-09-14T11:32:06.007 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:06.008+0000 7f45669169c0 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 1, obj: default.rgw.meta:root:.bucket.meta.test-client.0-r-test-small-obj-data.1:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.6, ofs0, ns] 2024-09-14T11:32:06.008 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:06.008+0000 7f443b7fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366208 cookie 94430277921952 notifier 5874 bl.length()=238 2024-09-14T11:32:06.017 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:06.016+0000 7f45669169c0 10 cache get: name=default.rgw.log++pubsub..bucket.test-client.0-r-test-small-obj-data.1/d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.6 : miss 2024-09-14T11:32:06.017 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:06.016+0000 7f45669169c0 20 rados->read ofs=0 len=0 2024-09-14T11:32:06.017 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:06.020+0000 7f45669169c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:32:06.017 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:06.020+0000 7f45669169c0 10 cache put: name=default.rgw.log++pubsub..bucket.test-client.0-r-test-small-obj-data.1/d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.6 info.flags=0x0 2024-09-14T11:32:06.018 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:06.020+0000 7f45669169c0 10 adding default.rgw.log++pubsub..bucket.test-client.0-r-test-small-obj-data.1/d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.6 to cache LRU end 2024-09-14T11:32:06.023 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:06.024+0000 7f45669169c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-small-obj-data.2:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.7 : miss 2024-09-14T11:32:06.023 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:06.024+0000 7f45669169c0 20 rados->read ofs=0 len=0 2024-09-14T11:32:06.025 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:06.024+0000 7f45669169c0 20 rados_obj.operate() r=0 bl.length=445 2024-09-14T11:32:06.025 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:06.024+0000 7f45669169c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-small-obj-data.2:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.7 info.flags=0x17 2024-09-14T11:32:06.025 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:06.024+0000 7f45669169c0 10 adding default.rgw.meta+root+.bucket.meta.test-client.0-r-test-small-obj-data.2:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.7 to cache LRU end 2024-09-14T11:32:06.025 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:06.024+0000 7f45669169c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:32:06.025 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:06.024+0000 7f45669169c0 10 updating xattr: name=user.rgw.acl bl.length()=209 2024-09-14T11:32:06.025 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:06.024+0000 7f45669169c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-small-obj-data.2:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.7 2024-09-14T11:32:06.028 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:06.028+0000 7f45669169c0 10 cls_bucket_list_unordered: got ___ 2024-09-14T11:32:06.029 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:06.028+0000 7f45669169c0 10 cls_bucket_list_unordered: got __ _ 2024-09-14T11:32:06.032 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:06.032+0000 7f45669169c0 10 cls_bucket_list_unordered: got __ 2024-09-14T11:32:06.034 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:06.036+0000 7f45669169c0 10 cls_bucket_list_unordered: got obj 2024-09-14T11:32:06.036 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:06.036+0000 7f45669169c0 20 get_obj_state: octx=0x7f455c008dc0 obj=test-client.0-r-test-small-obj-data.2:___ state=0x55e243306b28 s->prefetch_data=0 2024-09-14T11:32:06.039 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:06.040+0000 7f45669169c0 10 manifest: total_size = 524288 2024-09-14T11:32:06.040 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:06.040+0000 7f45669169c0 20 get_obj_state: setting s->obj_tag to d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.13447299830766252506 2024-09-14T11:32:06.040 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:06.040+0000 7f45669169c0 20 get_obj_state: octx=0x7f455c008dc0 obj=test-client.0-r-test-small-obj-data.2:___ state=0x55e243306b28 s->prefetch_data=0 2024-09-14T11:32:06.040 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:06.040+0000 7f45669169c0 20 prepare_atomic_modification: state is not atomic. state=0x55e243306b28 2024-09-14T11:32:06.040 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:06.040+0000 7f45669169c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.7.2 2024-09-14T11:32:06.044 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:06.044+0000 7f45669169c0 20 get_obj_state: octx=0x7f455c008dc0 obj=test-client.0-r-test-small-obj-data.2:__ _ state=0x55e243310d38 s->prefetch_data=0 2024-09-14T11:32:06.045 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:06.044+0000 7f45669169c0 10 manifest: total_size = 527 2024-09-14T11:32:06.045 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:06.044+0000 7f45669169c0 20 get_obj_state: setting s->obj_tag to d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.1225429308860699774 2024-09-14T11:32:06.045 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:06.044+0000 7f45669169c0 20 get_obj_state: octx=0x7f455c008dc0 obj=test-client.0-r-test-small-obj-data.2:__ _ state=0x55e243310d38 s->prefetch_data=0 2024-09-14T11:32:06.046 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:06.044+0000 7f45669169c0 20 prepare_atomic_modification: state is not atomic. state=0x55e243310d38 2024-09-14T11:32:06.046 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:06.044+0000 7f45669169c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.7.3 2024-09-14T11:32:06.047 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:06.048+0000 7f443b7fe640 20 handle_completion(): completion ok for obj=___ 2024-09-14T11:32:06.051 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:06.052+0000 7f45669169c0 20 get_obj_state: octx=0x55e2432f9f50 obj=test-client.0-r-test-small-obj-data.2:__ state=0x55e243310d38 s->prefetch_data=0 2024-09-14T11:32:06.053 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:06.052+0000 7f45669169c0 10 manifest: total_size = 2078 2024-09-14T11:32:06.053 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:06.052+0000 7f45669169c0 20 get_obj_state: setting s->obj_tag to d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.5208143194624905251 2024-09-14T11:32:06.053 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:06.052+0000 7f45669169c0 20 get_obj_state: octx=0x55e2432f9f50 obj=test-client.0-r-test-small-obj-data.2:__ state=0x55e243310d38 s->prefetch_data=0 2024-09-14T11:32:06.053 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:06.052+0000 7f45669169c0 20 prepare_atomic_modification: state is not atomic. state=0x55e243310d38 2024-09-14T11:32:06.053 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:06.052+0000 7f45669169c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.7.6 2024-09-14T11:32:06.054 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:06.056+0000 7f443affd640 20 handle_completion(): completion ok for obj=__ _ 2024-09-14T11:32:06.060 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:06.060+0000 7f45669169c0 20 get_obj_state: octx=0x7f4558059740 obj=test-client.0-r-test-small-obj-data.2:obj state=0x55e243310d38 s->prefetch_data=0 2024-09-14T11:32:06.061 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:06.060+0000 7f45669169c0 10 manifest: total_size = 38 2024-09-14T11:32:06.061 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:06.060+0000 7f45669169c0 20 get_obj_state: setting s->obj_tag to d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.13293222890267885775 2024-09-14T11:32:06.061 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:06.060+0000 7f45669169c0 20 get_obj_state: octx=0x7f4558059740 obj=test-client.0-r-test-small-obj-data.2:obj state=0x55e243310d38 s->prefetch_data=0 2024-09-14T11:32:06.061 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:06.060+0000 7f45669169c0 20 prepare_atomic_modification: state is not atomic. state=0x55e243310d38 2024-09-14T11:32:06.062 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:06.060+0000 7f45669169c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.7.8 2024-09-14T11:32:06.064 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:06.064+0000 7f443b7fe640 20 handle_completion(): completion ok for obj=__ 2024-09-14T11:32:06.067 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:06.068+0000 7f45669169c0 20 list_objects_ordered: starting attempt 1 2024-09-14T11:32:06.068 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:06.068+0000 7f45669169c0 10 cls_bucket_list_ordered: request from each of 11 shard(s) for 112 entries to get 1001 total entries 2024-09-14T11:32:06.071 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:06.072+0000 7f443b7fe640 20 handle_completion(): completion ok for obj=obj 2024-09-14T11:32:06.072 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:06.072+0000 7f45669169c0 20 cls_bucket_list_ordered: returning, count=0, is_truncated=0 2024-09-14T11:32:06.072 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:06.072+0000 7f45669169c0 20 cls_bucket_list_ordered: returning, last_entry NOT SET 2024-09-14T11:32:06.072 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:06.072+0000 7f45669169c0 10 list_objects_ordered: end of outer loop, truncated=0, count=0, attempt=1 2024-09-14T11:32:06.072 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:06.072+0000 7f45669169c0 10 list_objects_ordered: exiting attempt loop because we reached end (0) or we're returning half the requested entries (0 of 1000) 2024-09-14T11:32:06.072 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:06.072+0000 7f45669169c0 20 abort_multiparts INFO: aborting and cleaning up multipart upload(s); bucket=":test-client.0-r-test-small-obj-data.2[d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.7])"; uploads.size()=0; is_truncated=0 2024-09-14T11:32:06.076 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:06.076+0000 7f45669169c0 10 cache get: name=default.rgw.meta+root+test-client.0-r-test-small-obj-data.2 : miss 2024-09-14T11:32:06.077 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:06.076+0000 7f45669169c0 20 rados->read ofs=0 len=0 2024-09-14T11:32:06.077 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:06.080+0000 7f45669169c0 20 rados_obj.operate() r=0 bl.length=223 2024-09-14T11:32:06.078 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:06.080+0000 7f45669169c0 10 cache put: name=default.rgw.meta+root+test-client.0-r-test-small-obj-data.2 info.flags=0x11 2024-09-14T11:32:06.078 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:06.080+0000 7f45669169c0 10 adding default.rgw.meta+root+test-client.0-r-test-small-obj-data.2 to cache LRU end 2024-09-14T11:32:06.080 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:06.080+0000 7f45669169c0 10 removing default.rgw.meta+root+test-client.0-r-test-small-obj-data.2 from cache 2024-09-14T11:32:06.080 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:06.080+0000 7f45669169c0 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 1, obj: default.rgw.meta:root:test-client.0-r-test-small-obj-data.2, ofs0, ns] 2024-09-14T11:32:06.081 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:06.080+0000 7f443b7fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366209 cookie 94430277921952 notifier 5874 bl.length()=181 2024-09-14T11:32:06.088 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:06.088+0000 7f45669169c0 10 removing default.rgw.meta+root+.bucket.meta.test-client.0-r-test-small-obj-data.2:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.7 from cache 2024-09-14T11:32:06.088 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:06.088+0000 7f45669169c0 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 1, obj: default.rgw.meta:root:.bucket.meta.test-client.0-r-test-small-obj-data.2:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.7, ofs0, ns] 2024-09-14T11:32:06.089 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:06.088+0000 7f443affd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366210 cookie 94430277921952 notifier 5874 bl.length()=238 2024-09-14T11:32:06.098 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:06.100+0000 7f45669169c0 10 cache get: name=default.rgw.log++pubsub..bucket.test-client.0-r-test-small-obj-data.2/d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.7 : miss 2024-09-14T11:32:06.098 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:06.100+0000 7f45669169c0 20 rados->read ofs=0 len=0 2024-09-14T11:32:06.099 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:06.100+0000 7f45669169c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:32:06.099 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:06.100+0000 7f45669169c0 10 cache put: name=default.rgw.log++pubsub..bucket.test-client.0-r-test-small-obj-data.2/d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.7 info.flags=0x0 2024-09-14T11:32:06.099 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:06.100+0000 7f45669169c0 10 adding default.rgw.log++pubsub..bucket.test-client.0-r-test-small-obj-data.2/d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.7 to cache LRU end 2024-09-14T11:32:06.104 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:06.104+0000 7f45669169c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-small-obj-data.3:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.8 : miss 2024-09-14T11:32:06.104 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:06.104+0000 7f45669169c0 20 rados->read ofs=0 len=0 2024-09-14T11:32:06.105 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:06.104+0000 7f45669169c0 20 rados_obj.operate() r=0 bl.length=445 2024-09-14T11:32:06.105 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:06.104+0000 7f45669169c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-small-obj-data.3:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.8 info.flags=0x17 2024-09-14T11:32:06.105 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:06.104+0000 7f45669169c0 10 adding default.rgw.meta+root+.bucket.meta.test-client.0-r-test-small-obj-data.3:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.8 to cache LRU end 2024-09-14T11:32:06.105 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:06.104+0000 7f45669169c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:32:06.105 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:06.104+0000 7f45669169c0 10 updating xattr: name=user.rgw.acl bl.length()=209 2024-09-14T11:32:06.105 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:06.104+0000 7f45669169c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-small-obj-data.3:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.8 2024-09-14T11:32:06.108 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:06.108+0000 7f45669169c0 10 cls_bucket_list_unordered: got ___ 2024-09-14T11:32:06.109 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:06.108+0000 7f45669169c0 10 cls_bucket_list_unordered: got __ _ 2024-09-14T11:32:06.112 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:06.112+0000 7f45669169c0 10 cls_bucket_list_unordered: got __ 2024-09-14T11:32:06.114 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:06.116+0000 7f45669169c0 10 cls_bucket_list_unordered: got obj 2024-09-14T11:32:06.115 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:06.116+0000 7f45669169c0 20 get_obj_state: octx=0x7f455805db40 obj=test-client.0-r-test-small-obj-data.3:___ state=0x55e24330fd28 s->prefetch_data=0 2024-09-14T11:32:06.116 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:06.116+0000 7f45669169c0 10 manifest: total_size = 1048576 2024-09-14T11:32:06.116 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:06.116+0000 7f45669169c0 20 get_obj_state: setting s->obj_tag to d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.15792615802067708525 2024-09-14T11:32:06.116 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:06.116+0000 7f45669169c0 20 get_obj_state: octx=0x7f455805db40 obj=test-client.0-r-test-small-obj-data.3:___ state=0x55e24330fd28 s->prefetch_data=0 2024-09-14T11:32:06.116 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:06.116+0000 7f45669169c0 20 prepare_atomic_modification: state is not atomic. state=0x55e24330fd28 2024-09-14T11:32:06.117 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:06.116+0000 7f45669169c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.8.2 2024-09-14T11:32:06.122 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:06.124+0000 7f45669169c0 20 get_obj_state: octx=0x55e24325f6a0 obj=test-client.0-r-test-small-obj-data.3:__ _ state=0x55e24330fd28 s->prefetch_data=0 2024-09-14T11:32:06.123 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:06.124+0000 7f45669169c0 10 manifest: total_size = 1035 2024-09-14T11:32:06.123 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:06.124+0000 7f45669169c0 20 get_obj_state: setting s->obj_tag to d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.13320734355362914947 2024-09-14T11:32:06.123 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:06.124+0000 7f45669169c0 20 get_obj_state: octx=0x55e24325f6a0 obj=test-client.0-r-test-small-obj-data.3:__ _ state=0x55e24330fd28 s->prefetch_data=0 2024-09-14T11:32:06.123 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:06.124+0000 7f45669169c0 20 prepare_atomic_modification: state is not atomic. state=0x55e24330fd28 2024-09-14T11:32:06.124 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:06.124+0000 7f45669169c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.8.3 2024-09-14T11:32:06.124 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:06.124+0000 7f443affd640 20 handle_completion(): completion ok for obj=___ 2024-09-14T11:32:06.130 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:06.132+0000 7f45669169c0 20 get_obj_state: octx=0x7f455805f500 obj=test-client.0-r-test-small-obj-data.3:__ state=0x55e24330fd28 s->prefetch_data=0 2024-09-14T11:32:06.131 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:06.132+0000 7f45669169c0 10 manifest: total_size = 1035 2024-09-14T11:32:06.131 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:06.132+0000 7f45669169c0 20 get_obj_state: setting s->obj_tag to d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.13019397579262104790 2024-09-14T11:32:06.131 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:06.132+0000 7f45669169c0 20 get_obj_state: octx=0x7f455805f500 obj=test-client.0-r-test-small-obj-data.3:__ state=0x55e24330fd28 s->prefetch_data=0 2024-09-14T11:32:06.131 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:06.132+0000 7f45669169c0 20 prepare_atomic_modification: state is not atomic. state=0x55e24330fd28 2024-09-14T11:32:06.131 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:06.132+0000 7f45669169c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.8.6 2024-09-14T11:32:06.133 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:06.132+0000 7f443b7fe640 20 handle_completion(): completion ok for obj=__ _ 2024-09-14T11:32:06.137 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:06.136+0000 7f45669169c0 20 get_obj_state: octx=0x7f455805db40 obj=test-client.0-r-test-small-obj-data.3:obj state=0x55e24330fd28 s->prefetch_data=0 2024-09-14T11:32:06.139 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:06.140+0000 7f45669169c0 10 manifest: total_size = 49187 2024-09-14T11:32:06.139 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:06.140+0000 7f45669169c0 20 get_obj_state: setting s->obj_tag to d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.16020671500340907498 2024-09-14T11:32:06.139 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:06.140+0000 7f45669169c0 20 get_obj_state: octx=0x7f455805db40 obj=test-client.0-r-test-small-obj-data.3:obj state=0x55e24330fd28 s->prefetch_data=0 2024-09-14T11:32:06.139 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:06.140+0000 7f45669169c0 20 prepare_atomic_modification: state is not atomic. state=0x55e24330fd28 2024-09-14T11:32:06.139 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:06.140+0000 7f45669169c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.8.8 2024-09-14T11:32:06.140 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:06.140+0000 7f443affd640 20 handle_completion(): completion ok for obj=__ 2024-09-14T11:32:06.144 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:06.144+0000 7f45669169c0 20 list_objects_ordered: starting attempt 1 2024-09-14T11:32:06.144 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:06.144+0000 7f45669169c0 10 cls_bucket_list_ordered: request from each of 11 shard(s) for 112 entries to get 1001 total entries 2024-09-14T11:32:06.147 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:06.148+0000 7f443affd640 20 handle_completion(): completion ok for obj=obj 2024-09-14T11:32:06.148 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:06.148+0000 7f45669169c0 20 cls_bucket_list_ordered: returning, count=0, is_truncated=0 2024-09-14T11:32:06.148 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:06.148+0000 7f45669169c0 20 cls_bucket_list_ordered: returning, last_entry NOT SET 2024-09-14T11:32:06.148 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:06.148+0000 7f45669169c0 10 list_objects_ordered: end of outer loop, truncated=0, count=0, attempt=1 2024-09-14T11:32:06.148 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:06.148+0000 7f45669169c0 10 list_objects_ordered: exiting attempt loop because we reached end (0) or we're returning half the requested entries (0 of 1000) 2024-09-14T11:32:06.148 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:06.148+0000 7f45669169c0 20 abort_multiparts INFO: aborting and cleaning up multipart upload(s); bucket=":test-client.0-r-test-small-obj-data.3[d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.8])"; uploads.size()=0; is_truncated=0 2024-09-14T11:32:06.153 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:06.152+0000 7f45669169c0 10 cache get: name=default.rgw.meta+root+test-client.0-r-test-small-obj-data.3 : miss 2024-09-14T11:32:06.153 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:06.152+0000 7f45669169c0 20 rados->read ofs=0 len=0 2024-09-14T11:32:06.154 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:06.156+0000 7f45669169c0 20 rados_obj.operate() r=0 bl.length=223 2024-09-14T11:32:06.154 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:06.156+0000 7f45669169c0 10 cache put: name=default.rgw.meta+root+test-client.0-r-test-small-obj-data.3 info.flags=0x11 2024-09-14T11:32:06.154 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:06.156+0000 7f45669169c0 10 adding default.rgw.meta+root+test-client.0-r-test-small-obj-data.3 to cache LRU end 2024-09-14T11:32:06.156 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:06.156+0000 7f45669169c0 10 removing default.rgw.meta+root+test-client.0-r-test-small-obj-data.3 from cache 2024-09-14T11:32:06.156 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:06.156+0000 7f45669169c0 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 1, obj: default.rgw.meta:root:test-client.0-r-test-small-obj-data.3, ofs0, ns] 2024-09-14T11:32:06.157 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:06.156+0000 7f443affd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366211 cookie 94430277921952 notifier 5874 bl.length()=181 2024-09-14T11:32:06.163 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:06.164+0000 7f45669169c0 10 removing default.rgw.meta+root+.bucket.meta.test-client.0-r-test-small-obj-data.3:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.8 from cache 2024-09-14T11:32:06.163 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:06.164+0000 7f45669169c0 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 1, obj: default.rgw.meta:root:.bucket.meta.test-client.0-r-test-small-obj-data.3:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.8, ofs0, ns] 2024-09-14T11:32:06.164 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:06.164+0000 7f443b7fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366212 cookie 94430277921952 notifier 5874 bl.length()=238 2024-09-14T11:32:06.173 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:06.176+0000 7f45669169c0 10 cache get: name=default.rgw.log++pubsub..bucket.test-client.0-r-test-small-obj-data.3/d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.8 : miss 2024-09-14T11:32:06.174 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:06.176+0000 7f45669169c0 20 rados->read ofs=0 len=0 2024-09-14T11:32:06.174 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:06.176+0000 7f45669169c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:32:06.174 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:06.176+0000 7f45669169c0 10 cache put: name=default.rgw.log++pubsub..bucket.test-client.0-r-test-small-obj-data.3/d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.8 info.flags=0x0 2024-09-14T11:32:06.174 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:06.176+0000 7f45669169c0 10 adding default.rgw.log++pubsub..bucket.test-client.0-r-test-small-obj-data.3/d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.8 to cache LRU end 2024-09-14T11:32:06.179 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:06.180+0000 7f45669169c0 10 removing key index: CRAKLKDJXWHCXCUXWDHO 2024-09-14T11:32:06.182 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:06.184+0000 7f45669169c0 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 1, obj: default.rgw.meta:users.keys:CRAKLKDJXWHCXCUXWDHO, ofs0, ns] 2024-09-14T11:32:06.183 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:06.184+0000 7f443affd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366169 cookie 94430277893856 notifier 5874 bl.length()=170 2024-09-14T11:32:06.186 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:06.188+0000 7f45669169c0 10 removing email index: ragweed.client.0+test@test.test 2024-09-14T11:32:06.189 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:06.188+0000 7f45669169c0 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 1, obj: default.rgw.meta:users.email:ragweed.client.0+test@test.test, ofs0, ns] 2024-09-14T11:32:06.189 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:06.192+0000 7f443affd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366170 cookie 94430277893856 notifier 5874 bl.length()=182 2024-09-14T11:32:06.193 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:06.192+0000 7f45669169c0 10 removing user buckets index 2024-09-14T11:32:06.195 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:06.196+0000 7f45669169c0 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 1, obj: default.rgw.meta:users.uid:ragweed.client.0.buckets, ofs0, ns] 2024-09-14T11:32:06.196 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:06.196+0000 7f443b7fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366164 cookie 94430277937680 notifier 5874 bl.length()=173 2024-09-14T11:32:06.198 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:06.200+0000 7f45669169c0 10 removing user index: ragweed.client.0 2024-09-14T11:32:06.201 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:06.200+0000 7f45669169c0 10 removing default.rgw.meta+users.uid+ragweed.client.0 from cache 2024-09-14T11:32:06.201 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:06.200+0000 7f45669169c0 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 1, obj: default.rgw.meta:users.uid:ragweed.client.0, ofs0, ns] 2024-09-14T11:32:06.202 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:06.204+0000 7f443b7fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366176 cookie 94430277933520 notifier 5874 bl.length()=165 2024-09-14T11:32:06.212 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:06.212+0000 7f441afdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:32:06.217 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:06.216+0000 7f45669169c0 20 remove_watcher() i=0 2024-09-14T11:32:06.217 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:06.216+0000 7f45669169c0 2 removed watcher, disabling cache 2024-09-14T11:32:06.220 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:06.220+0000 7f45669169c0 20 remove_watcher() i=1 2024-09-14T11:32:06.222 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:06.224+0000 7f45669169c0 20 remove_watcher() i=2 2024-09-14T11:32:06.224 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:06.224+0000 7f45669169c0 20 remove_watcher() i=3 2024-09-14T11:32:06.226 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:06.228+0000 7f45669169c0 20 remove_watcher() i=4 2024-09-14T11:32:06.228 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:06.228+0000 7f45669169c0 20 remove_watcher() i=5 2024-09-14T11:32:06.230 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:06.232+0000 7f45669169c0 20 remove_watcher() i=6 2024-09-14T11:32:06.232 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:06.232+0000 7f45669169c0 20 remove_watcher() i=7 2024-09-14T11:32:06.250 DEBUG:teuthology.orchestra.run.smithi138:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 user rm --uid sysuser.client.0 --purge-data 2024-09-14T11:32:06.329 INFO:teuthology.orchestra.run.smithi138.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:32:06.330 INFO:teuthology.orchestra.run.smithi138.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:32:06.555 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:06.556+0000 7fa9b2153640 0 --2- 172.21.15.138:0/1404311452 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x55ded3d2ef30 0x55ded3ea6d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request get_initial_auth_request returned -2 2024-09-14T11:32:06.580 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:06.580+0000 7fa9b4e4e9c0 20 rados->read ofs=0 len=0 2024-09-14T11:32:06.582 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:06.584+0000 7fa9b4e4e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:32:06.582 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:06.584+0000 7fa9b4e4e9c0 20 realm 2024-09-14T11:32:06.582 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:06.584+0000 7fa9b4e4e9c0 20 rados->read ofs=0 len=0 2024-09-14T11:32:06.582 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:06.584+0000 7fa9b4e4e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:32:06.582 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:06.584+0000 7fa9b4e4e9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:32:06.582 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:06.584+0000 7fa9b4e4e9c0 20 rados->read ofs=0 len=0 2024-09-14T11:32:06.582 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:06.584+0000 7fa9b4e4e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:32:06.583 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:06.584+0000 7fa9b4e4e9c0 20 rados->read ofs=0 len=0 2024-09-14T11:32:06.584 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:06.584+0000 7fa9b4e4e9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:32:06.584 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:06.584+0000 7fa9b4e4e9c0 20 rados->read ofs=0 len=0 2024-09-14T11:32:06.585 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:06.584+0000 7fa9b4e4e9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:32:06.585 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:06.584+0000 7fa9b4e4e9c0 20 searching for the correct realm 2024-09-14T11:32:06.587 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:06.588+0000 7fa9b2153640 0 -- 172.21.15.138:0/1148524272 >> [v2:172.21.15.154:6808/1468088432,v1:172.21.15.154:6809/1468088432] conn(0x7fa9a4083020 msgr2=0x7fa9a405d630 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:32:06.798 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:06.800+0000 7fa9b3155640 0 -- 172.21.15.138:0/1148524272 >> [v2:172.21.15.138:6824/2633984942,v1:172.21.15.138:6825/2633984942] conn(0x55ded3f068d0 msgr2=0x55ded3f08cc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:32:06.816 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:06.816+0000 7fa9b4e4e9c0 20 RGWRados::pool_iterate: got zone_info.d9e72d30-c60b-4d0d-9267-fdc36392d5ad 2024-09-14T11:32:06.816 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:06.816+0000 7fa9b4e4e9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:32:06.816 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:06.816+0000 7fa9b4e4e9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:32:06.816 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:06.816+0000 7fa9b4e4e9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:32:06.816 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:06.816+0000 7fa9b4e4e9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:32:06.816 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:06.816+0000 7fa9b4e4e9c0 20 RGWRados::pool_iterate: got zonegroup_info.65ab941b-da8c-4160-94fb-3672b069d44f 2024-09-14T11:32:06.816 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:06.816+0000 7fa9b4e4e9c0 20 rados->read ofs=0 len=0 2024-09-14T11:32:06.817 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:06.816+0000 7fa9b4e4e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:32:06.817 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:06.816+0000 7fa9b4e4e9c0 20 rados->read ofs=0 len=0 2024-09-14T11:32:06.817 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:06.816+0000 7fa9b4e4e9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:32:06.817 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:06.816+0000 7fa9b4e4e9c0 20 rados->read ofs=0 len=0 2024-09-14T11:32:06.818 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:06.820+0000 7fa9b4e4e9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:32:06.818 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:06.820+0000 7fa9b4e4e9c0 20 zone default found 2024-09-14T11:32:06.818 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:06.820+0000 7fa9b4e4e9c0 4 Realm: () 2024-09-14T11:32:06.818 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:06.820+0000 7fa9b4e4e9c0 4 ZoneGroup: default (65ab941b-da8c-4160-94fb-3672b069d44f) 2024-09-14T11:32:06.819 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:06.820+0000 7fa9b4e4e9c0 4 Zone: default (d9e72d30-c60b-4d0d-9267-fdc36392d5ad) 2024-09-14T11:32:06.819 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:06.820+0000 7fa9b4e4e9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:32:06.819 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:06.820+0000 7fa9b4e4e9c0 20 zonegroup default 2024-09-14T11:32:06.819 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:06.820+0000 7fa9b4e4e9c0 20 rados->read ofs=0 len=0 2024-09-14T11:32:06.819 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:06.820+0000 7fa9b4e4e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:32:06.819 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:06.820+0000 7fa9b4e4e9c0 20 rados->read ofs=0 len=0 2024-09-14T11:32:06.820 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:06.820+0000 7fa9b4e4e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:32:06.820 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:06.820+0000 7fa9b4e4e9c0 20 rados->read ofs=0 len=0 2024-09-14T11:32:06.821 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:06.820+0000 7fa9b4e4e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:32:06.821 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:06.820+0000 7fa9b4e4e9c0 20 started sync module instance, tier type = 2024-09-14T11:32:06.821 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:06.820+0000 7fa9b4e4e9c0 20 started zone id=d9e72d30-c60b-4d0d-9267-fdc36392d5ad (name=default) with tier type = 2024-09-14T11:32:06.844 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:06.844+0000 7fa9b4e4e9c0 20 add_watcher() i=0 2024-09-14T11:32:06.844 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:06.844+0000 7fa9b4e4e9c0 20 add_watcher() i=1 2024-09-14T11:32:06.844 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:06.844+0000 7fa9b4e4e9c0 20 add_watcher() i=2 2024-09-14T11:32:06.844 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:06.844+0000 7fa9b4e4e9c0 20 add_watcher() i=3 2024-09-14T11:32:06.845 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:06.844+0000 7fa9b4e4e9c0 20 add_watcher() i=4 2024-09-14T11:32:06.845 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:06.844+0000 7fa9b4e4e9c0 20 add_watcher() i=5 2024-09-14T11:32:06.845 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:06.844+0000 7fa9b4e4e9c0 20 add_watcher() i=6 2024-09-14T11:32:06.846 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:06.848+0000 7fa9b4e4e9c0 20 add_watcher() i=7 2024-09-14T11:32:06.846 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:06.848+0000 7fa9b4e4e9c0 2 all 8 watchers are set, enabling cache 2024-09-14T11:32:06.850 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:06.852+0000 7fa869fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:32:06.850 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:06.852+0000 7fa9b4e4e9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:32:06.850 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:06.852+0000 7fa9b4e4e9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:32:06.938 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:06.940+0000 7fa868fe1640 20 reqs_thread_entry: start 2024-09-14T11:32:06.939 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:06.940+0000 7fa9b4e4e9c0 20 init_complete bucket index max shards: 11 2024-09-14T11:32:06.939 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:06.940+0000 7fa9b4e4e9c0 20 Filter name: none 2024-09-14T11:32:06.939 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:06.940+0000 7fa861ffb640 20 reqs_thread_entry: start 2024-09-14T11:32:06.939 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:06.940+0000 7fa9b4e4e9c0 10 cache get: name=default.rgw.meta+users.uid+sysuser.client.0 : miss 2024-09-14T11:32:06.939 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:06.940+0000 7fa9b4e4e9c0 20 rados->read ofs=0 len=0 2024-09-14T11:32:06.940 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:06.940+0000 7fa9b4e4e9c0 20 rados_obj.operate() r=0 bl.length=486 2024-09-14T11:32:06.940 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:06.940+0000 7fa9b4e4e9c0 10 cache put: name=default.rgw.meta+users.uid+sysuser.client.0 info.flags=0x13 2024-09-14T11:32:06.940 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:06.940+0000 7fa9b4e4e9c0 10 adding default.rgw.meta+users.uid+sysuser.client.0 to cache LRU end 2024-09-14T11:32:06.941 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:06.940+0000 7fa9b4e4e9c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:32:06.941 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:06.940+0000 7fa9b4e4e9c0 10 removing key index: JEMMYZYQUNNOMBGMSWMH 2024-09-14T11:32:06.942 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:06.944+0000 7fa9b4e4e9c0 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 1, obj: default.rgw.meta:users.keys:JEMMYZYQUNNOMBGMSWMH, ofs0, ns] 2024-09-14T11:32:06.943 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:06.944+0000 7fa8967fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366171 cookie 94415526856768 notifier 5892 bl.length()=170 2024-09-14T11:32:06.945 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:06.948+0000 7fa9b4e4e9c0 10 removing email index: sysuser.client.0+test@test.test 2024-09-14T11:32:06.948 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:06.948+0000 7fa9b4e4e9c0 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 1, obj: default.rgw.meta:users.email:sysuser.client.0+test@test.test, ofs0, ns] 2024-09-14T11:32:06.949 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:06.948+0000 7fa8967fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366177 cookie 94415526889744 notifier 5892 bl.length()=182 2024-09-14T11:32:06.951 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:06.952+0000 7fa9b4e4e9c0 10 removing user buckets index 2024-09-14T11:32:06.953 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:06.952+0000 7fa9b4e4e9c0 10 removing user index: sysuser.client.0 2024-09-14T11:32:06.956 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:06.956+0000 7fa9b4e4e9c0 10 removing default.rgw.meta+users.uid+sysuser.client.0 from cache 2024-09-14T11:32:06.956 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:06.956+0000 7fa9b4e4e9c0 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 1, obj: default.rgw.meta:users.uid:sysuser.client.0, ofs0, ns] 2024-09-14T11:32:06.957 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:06.956+0000 7fa895ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366172 cookie 94415526856768 notifier 5892 bl.length()=165 2024-09-14T11:32:06.960 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:06.960+0000 7fa869fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:32:06.965 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:06.964+0000 7fa9b4e4e9c0 20 remove_watcher() i=0 2024-09-14T11:32:06.965 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:06.964+0000 7fa9b4e4e9c0 2 removed watcher, disabling cache 2024-09-14T11:32:06.967 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:06.968+0000 7fa9b4e4e9c0 20 remove_watcher() i=1 2024-09-14T11:32:06.970 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:06.972+0000 7fa9b4e4e9c0 20 remove_watcher() i=2 2024-09-14T11:32:06.972 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:06.972+0000 7fa9b4e4e9c0 20 remove_watcher() i=3 2024-09-14T11:32:06.974 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:06.976+0000 7fa9b4e4e9c0 20 remove_watcher() i=4 2024-09-14T11:32:06.976 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:06.976+0000 7fa9b4e4e9c0 20 remove_watcher() i=5 2024-09-14T11:32:06.977 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:06.976+0000 7fa9b4e4e9c0 20 remove_watcher() i=6 2024-09-14T11:32:06.979 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:32:06.980+0000 7fa9b4e4e9c0 20 remove_watcher() i=7 2024-09-14T11:32:06.996 INFO:tasks.ragweed:Removing ragweed... 2024-09-14T11:32:06.996 DEBUG:teuthology.orchestra.run.smithi138:> rm -rf /home/ubuntu/cephtest/ragweed.client.0 2024-09-14T11:32:07.087 INFO:teuthology.run_tasks:Running task workunit... 2024-09-14T11:32:07.101 INFO:tasks.workunit:Pulling workunits from ref 1c941a66c1b420259b8fc5ac19e792dbbf60aded 2024-09-14T11:32:07.102 INFO:tasks.workunit:Making a separate scratch dir for every client... 2024-09-14T11:32:07.102 DEBUG:teuthology.orchestra.run.smithi138:> stat -- /home/ubuntu/cephtest/mnt.0 2024-09-14T11:32:07.107 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-14T11:32:07.107 INFO:teuthology.orchestra.run.smithi138.stderr:stat: cannot statx '/home/ubuntu/cephtest/mnt.0': No such file or directory 2024-09-14T11:32:07.108 DEBUG:teuthology.orchestra.run.smithi138:> mkdir -- /home/ubuntu/cephtest/mnt.0 2024-09-14T11:32:07.154 INFO:tasks.workunit:Created dir /home/ubuntu/cephtest/mnt.0 2024-09-14T11:32:07.155 DEBUG:teuthology.orchestra.run.smithi138:> cd -- /home/ubuntu/cephtest/mnt.0 && mkdir -- client.0 2024-09-14T11:32:07.202 INFO:tasks.workunit:timeout=3h 2024-09-14T11:32:07.202 INFO:tasks.workunit:cleanup=True 2024-09-14T11:32:07.203 DEBUG:teuthology.orchestra.run.smithi138:> rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone https://git.ceph.com/ceph.git /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 && git checkout 1c941a66c1b420259b8fc5ac19e792dbbf60aded 2024-09-14T11:32:07.251 INFO:tasks.workunit.client.0.smithi138.stderr:Cloning into '/home/ubuntu/cephtest/clone.client.0'... 2024-09-14T11:33:02.538 INFO:tasks.workunit.client.0.smithi138.stderr:Note: switching to '1c941a66c1b420259b8fc5ac19e792dbbf60aded'. 2024-09-14T11:33:02.538 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-14T11:33:02.538 INFO:tasks.workunit.client.0.smithi138.stderr:You are in 'detached HEAD' state. You can look around, make experimental 2024-09-14T11:33:02.539 INFO:tasks.workunit.client.0.smithi138.stderr:changes and commit them, and you can discard any commits you make in this 2024-09-14T11:33:02.539 INFO:tasks.workunit.client.0.smithi138.stderr:state without impacting any branches by switching back to a branch. 2024-09-14T11:33:02.539 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-14T11:33:02.539 INFO:tasks.workunit.client.0.smithi138.stderr:If you want to create a new branch to retain commits you create, you may 2024-09-14T11:33:02.539 INFO:tasks.workunit.client.0.smithi138.stderr:do so (now or later) by using -c with the switch command. Example: 2024-09-14T11:33:02.539 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-14T11:33:02.539 INFO:tasks.workunit.client.0.smithi138.stderr: git switch -c 2024-09-14T11:33:02.539 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-14T11:33:02.539 INFO:tasks.workunit.client.0.smithi138.stderr:Or undo this operation with: 2024-09-14T11:33:02.539 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-14T11:33:02.539 INFO:tasks.workunit.client.0.smithi138.stderr: git switch - 2024-09-14T11:33:02.539 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-14T11:33:02.539 INFO:tasks.workunit.client.0.smithi138.stderr:Turn off this advice by setting config variable advice.detachedHead to false 2024-09-14T11:33:02.539 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-14T11:33:02.540 INFO:tasks.workunit.client.0.smithi138.stderr:HEAD is now at 1c941a66c1b Merge pull request #54777 from cbodley/wip-rgw-meta-handlers 2024-09-14T11:33:02.541 DEBUG:teuthology.orchestra.run.smithi138:> cd -- /home/ubuntu/cephtest/clone.client.0/qa/workunits && if test -e Makefile ; then make ; fi && find -executable -type f -printf '%P\0' >/home/ubuntu/cephtest/workunits.list.client.0 2024-09-14T11:33:02.587 INFO:tasks.workunit.client.0.smithi138.stdout:for d in direct_io fs ; do ( cd $d ; make all ) ; done 2024-09-14T11:33:02.590 INFO:tasks.workunit.client.0.smithi138.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-09-14T11:33:02.590 INFO:tasks.workunit.client.0.smithi138.stdout:cc -Wall -Wextra -D_GNU_SOURCE direct_io_test.c -o direct_io_test 2024-09-14T11:33:02.641 INFO:tasks.workunit.client.0.smithi138.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_sync_io.c -o test_sync_io 2024-09-14T11:33:02.691 INFO:tasks.workunit.client.0.smithi138.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_short_dio_read.c -o test_short_dio_read 2024-09-14T11:33:02.735 INFO:tasks.workunit.client.0.smithi138.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-09-14T11:33:02.736 INFO:tasks.workunit.client.0.smithi138.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-09-14T11:33:02.736 INFO:tasks.workunit.client.0.smithi138.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_o_trunc.c -o test_o_trunc 2024-09-14T11:33:02.777 INFO:tasks.workunit.client.0.smithi138.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-09-14T11:33:02.780 DEBUG:teuthology.orchestra.run.smithi138:> set -ex 2024-09-14T11:33:02.780 DEBUG:teuthology.orchestra.run.smithi138:> dd if=/home/ubuntu/cephtest/workunits.list.client.0 of=/dev/stdout 2024-09-14T11:33:02.826 INFO:tasks.workunit:Running workunits matching rgw/run-reshard.sh on client.0... 2024-09-14T11:33:02.828 INFO:tasks.workunit:Running workunit rgw/run-reshard.sh... 2024-09-14T11:33:02.828 DEBUG:teuthology.orchestra.run.smithi138:workunit test rgw/run-reshard.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=1c941a66c1b420259b8fc5ac19e792dbbf60aded TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/run-reshard.sh 2024-09-14T11:33:02.883 INFO:tasks.workunit.client.0.smithi138.stderr:+ ulimit -c 0 2024-09-14T11:33:02.884 INFO:tasks.workunit.client.0.smithi138.stderr:++ dirname /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/run-reshard.sh 2024-09-14T11:33:02.884 INFO:tasks.workunit.client.0.smithi138.stderr:+ mydir=/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw 2024-09-14T11:33:02.884 INFO:tasks.workunit.client.0.smithi138.stderr:+ python3 -m venv /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw 2024-09-14T11:33:05.710 INFO:tasks.workunit.client.0.smithi138.stderr:+ source /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/bin/activate 2024-09-14T11:33:05.710 INFO:tasks.workunit.client.0.smithi138.stderr:++ deactivate nondestructive 2024-09-14T11:33:05.710 INFO:tasks.workunit.client.0.smithi138.stderr:++ '[' -n '' ']' 2024-09-14T11:33:05.710 INFO:tasks.workunit.client.0.smithi138.stderr:++ '[' -n '' ']' 2024-09-14T11:33:05.710 INFO:tasks.workunit.client.0.smithi138.stderr:++ '[' -n /usr/bin/bash -o -n '' ']' 2024-09-14T11:33:05.711 INFO:tasks.workunit.client.0.smithi138.stderr:++ hash -r 2024-09-14T11:33:05.711 INFO:tasks.workunit.client.0.smithi138.stderr:++ '[' -n '' ']' 2024-09-14T11:33:05.711 INFO:tasks.workunit.client.0.smithi138.stderr:++ unset VIRTUAL_ENV 2024-09-14T11:33:05.711 INFO:tasks.workunit.client.0.smithi138.stderr:++ unset VIRTUAL_ENV_PROMPT 2024-09-14T11:33:05.711 INFO:tasks.workunit.client.0.smithi138.stderr:++ '[' '!' nondestructive = nondestructive ']' 2024-09-14T11:33:05.711 INFO:tasks.workunit.client.0.smithi138.stderr:++ VIRTUAL_ENV=/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw 2024-09-14T11:33:05.711 INFO:tasks.workunit.client.0.smithi138.stderr:++ export VIRTUAL_ENV 2024-09-14T11:33:05.711 INFO:tasks.workunit.client.0.smithi138.stderr:++ _OLD_VIRTUAL_PATH=/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/usr/games:/usr/local/games:/snap/bin:/usr/sbin 2024-09-14T11:33:05.711 INFO:tasks.workunit.client.0.smithi138.stderr:++ PATH=/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/usr/games:/usr/local/games:/snap/bin:/usr/sbin 2024-09-14T11:33:05.711 INFO:tasks.workunit.client.0.smithi138.stderr:++ export PATH 2024-09-14T11:33:05.711 INFO:tasks.workunit.client.0.smithi138.stderr:++ '[' -n '' ']' 2024-09-14T11:33:05.711 INFO:tasks.workunit.client.0.smithi138.stderr:++ '[' -z '' ']' 2024-09-14T11:33:05.711 INFO:tasks.workunit.client.0.smithi138.stderr:++ _OLD_VIRTUAL_PS1= 2024-09-14T11:33:05.712 INFO:tasks.workunit.client.0.smithi138.stderr:++ PS1='(rgw) ' 2024-09-14T11:33:05.712 INFO:tasks.workunit.client.0.smithi138.stderr:++ export PS1 2024-09-14T11:33:05.712 INFO:tasks.workunit.client.0.smithi138.stderr:++ VIRTUAL_ENV_PROMPT='(rgw) ' 2024-09-14T11:33:05.712 INFO:tasks.workunit.client.0.smithi138.stderr:++ export VIRTUAL_ENV_PROMPT 2024-09-14T11:33:05.712 INFO:tasks.workunit.client.0.smithi138.stderr:++ '[' -n /usr/bin/bash -o -n '' ']' 2024-09-14T11:33:05.712 INFO:tasks.workunit.client.0.smithi138.stderr:++ hash -r 2024-09-14T11:33:05.712 INFO:tasks.workunit.client.0.smithi138.stderr:+ pip install pip --upgrade 2024-09-14T11:33:06.103 INFO:tasks.workunit.client.0.smithi138.stdout:Requirement already satisfied: pip in /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages (22.0.2) 2024-09-14T11:33:06.316 INFO:tasks.workunit.client.0.smithi138.stdout:Collecting pip 2024-09-14T11:33:06.322 INFO:tasks.workunit.client.0.smithi138.stdout: Using cached pip-24.2-py3-none-any.whl (1.8 MB) 2024-09-14T11:33:06.356 INFO:tasks.workunit.client.0.smithi138.stdout:Installing collected packages: pip 2024-09-14T11:33:06.356 INFO:tasks.workunit.client.0.smithi138.stdout: Attempting uninstall: pip 2024-09-14T11:33:06.356 INFO:tasks.workunit.client.0.smithi138.stdout: Found existing installation: pip 22.0.2 2024-09-14T11:33:06.620 INFO:tasks.workunit.client.0.smithi138.stdout: Uninstalling pip-22.0.2: 2024-09-14T11:33:06.626 INFO:tasks.workunit.client.0.smithi138.stdout: Successfully uninstalled pip-22.0.2 2024-09-14T11:33:07.353 INFO:tasks.workunit.client.0.smithi138.stdout:Successfully installed pip-24.2 2024-09-14T11:33:07.414 INFO:tasks.workunit.client.0.smithi138.stderr:+ pip install boto3 2024-09-14T11:33:08.349 INFO:tasks.workunit.client.0.smithi138.stdout:Collecting boto3 2024-09-14T11:33:08.350 INFO:tasks.workunit.client.0.smithi138.stdout: Using cached boto3-1.35.19-py3-none-any.whl.metadata (6.6 kB) 2024-09-14T11:33:08.845 INFO:tasks.workunit.client.0.smithi138.stdout:Collecting botocore<1.36.0,>=1.35.19 (from boto3) 2024-09-14T11:33:08.846 INFO:tasks.workunit.client.0.smithi138.stdout: Using cached botocore-1.35.19-py3-none-any.whl.metadata (5.7 kB) 2024-09-14T11:33:08.903 INFO:tasks.workunit.client.0.smithi138.stdout:Collecting jmespath<2.0.0,>=0.7.1 (from boto3) 2024-09-14T11:33:08.904 INFO:tasks.workunit.client.0.smithi138.stdout: Using cached jmespath-1.0.1-py3-none-any.whl.metadata (7.6 kB) 2024-09-14T11:33:08.949 INFO:tasks.workunit.client.0.smithi138.stdout:Collecting s3transfer<0.11.0,>=0.10.0 (from boto3) 2024-09-14T11:33:08.950 INFO:tasks.workunit.client.0.smithi138.stdout: Using cached s3transfer-0.10.2-py3-none-any.whl.metadata (1.7 kB) 2024-09-14T11:33:09.004 INFO:tasks.workunit.client.0.smithi138.stdout:Collecting python-dateutil<3.0.0,>=2.1 (from botocore<1.36.0,>=1.35.19->boto3) 2024-09-14T11:33:09.006 INFO:tasks.workunit.client.0.smithi138.stdout: Using cached python_dateutil-2.9.0.post0-py2.py3-none-any.whl.metadata (8.4 kB) 2024-09-14T11:33:09.123 INFO:tasks.workunit.client.0.smithi138.stdout:Collecting urllib3!=2.2.0,<3,>=1.25.4 (from botocore<1.36.0,>=1.35.19->boto3) 2024-09-14T11:33:09.124 INFO:tasks.workunit.client.0.smithi138.stdout: Using cached urllib3-2.2.3-py3-none-any.whl.metadata (6.5 kB) 2024-09-14T11:33:09.266 INFO:tasks.workunit.client.0.smithi138.stdout:Collecting six>=1.5 (from python-dateutil<3.0.0,>=2.1->botocore<1.36.0,>=1.35.19->boto3) 2024-09-14T11:33:09.267 INFO:tasks.workunit.client.0.smithi138.stdout: Using cached six-1.16.0-py2.py3-none-any.whl.metadata (1.8 kB) 2024-09-14T11:33:09.271 INFO:tasks.workunit.client.0.smithi138.stdout:Using cached boto3-1.35.19-py3-none-any.whl (139 kB) 2024-09-14T11:33:09.272 INFO:tasks.workunit.client.0.smithi138.stdout:Using cached botocore-1.35.19-py3-none-any.whl (12.5 MB) 2024-09-14T11:33:09.283 INFO:tasks.workunit.client.0.smithi138.stdout:Using cached jmespath-1.0.1-py3-none-any.whl (20 kB) 2024-09-14T11:33:09.284 INFO:tasks.workunit.client.0.smithi138.stdout:Using cached s3transfer-0.10.2-py3-none-any.whl (82 kB) 2024-09-14T11:33:09.285 INFO:tasks.workunit.client.0.smithi138.stdout:Using cached python_dateutil-2.9.0.post0-py2.py3-none-any.whl (229 kB) 2024-09-14T11:33:09.287 INFO:tasks.workunit.client.0.smithi138.stdout:Using cached urllib3-2.2.3-py3-none-any.whl (126 kB) 2024-09-14T11:33:09.288 INFO:tasks.workunit.client.0.smithi138.stdout:Using cached six-1.16.0-py2.py3-none-any.whl (11 kB) 2024-09-14T11:33:09.359 INFO:tasks.workunit.client.0.smithi138.stdout:Installing collected packages: urllib3, six, jmespath, python-dateutil, botocore, s3transfer, boto3 2024-09-14T11:33:10.630 INFO:tasks.workunit.client.0.smithi138.stdout:Successfully installed boto3-1.35.19 botocore-1.35.19 jmespath-1.0.1 python-dateutil-2.9.0.post0 s3transfer-0.10.2 six-1.16.0 urllib3-2.2.3 2024-09-14T11:33:10.846 INFO:tasks.workunit.client.0.smithi138.stderr:+ /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/bin/python3 /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/test_rgw_reshard.py 2024-09-14T11:33:10.992 INFO:tasks.workunit.client.0.smithi138.stderr:radosgw-admin user create --uid tester --display-name "Testing" --access-key NX5QOQKC6BH2IDN8HC7A --secret LnEsqNNqZIpkzauboDcLXLcYaWwLQ3Kop0zAnKIn 2024-09-14T11:33:11.030 INFO:tasks.workunit.client.0.smithi138.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:33:11.030 INFO:tasks.workunit.client.0.smithi138.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:33:11.073 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:11.075+0000 7f15e4b359c0 20 rados->read ofs=0 len=0 2024-09-14T11:33:11.074 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:11.079+0000 7f15e4b359c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:33:11.075 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:11.079+0000 7f15e4b359c0 20 realm 2024-09-14T11:33:11.075 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:11.079+0000 7f15e4b359c0 20 rados->read ofs=0 len=0 2024-09-14T11:33:11.075 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:11.079+0000 7f15e4b359c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:33:11.075 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:11.079+0000 7f15e4b359c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:33:11.075 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:11.079+0000 7f15e4b359c0 20 rados->read ofs=0 len=0 2024-09-14T11:33:11.075 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:11.079+0000 7f15e4b359c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:33:11.075 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:11.079+0000 7f15e4b359c0 20 rados->read ofs=0 len=0 2024-09-14T11:33:11.076 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:11.079+0000 7f15e4b359c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:33:11.076 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:11.079+0000 7f15e4b359c0 20 rados->read ofs=0 len=0 2024-09-14T11:33:11.077 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:11.079+0000 7f15e4b359c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:33:11.077 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:11.079+0000 7f15e4b359c0 20 searching for the correct realm 2024-09-14T11:33:11.082 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:11.087+0000 7f15e263b640 0 -- 172.21.15.138:0/2515054838 >> [v2:172.21.15.138:6808/3258321916,v1:172.21.15.138:6809/3258321916] conn(0x5597b20c3040 msgr2=0x5597b20c5500 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-14T11:33:11.089 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:11.091+0000 7f15e2e3c640 0 -- 172.21.15.138:0/2515054838 >> [v2:172.21.15.154:6824/416768175,v1:172.21.15.154:6825/416768175] conn(0x7f15dc044b00 msgr2=0x7f15dc03c940 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:33:11.097 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:11.099+0000 7f15e4b359c0 20 RGWRados::pool_iterate: got zone_info.d9e72d30-c60b-4d0d-9267-fdc36392d5ad 2024-09-14T11:33:11.097 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:11.099+0000 7f15e4b359c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:33:11.097 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:11.099+0000 7f15e4b359c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:33:11.097 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:11.099+0000 7f15e4b359c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:33:11.097 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:11.099+0000 7f15e4b359c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:33:11.097 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:11.099+0000 7f15e4b359c0 20 RGWRados::pool_iterate: got zonegroup_info.65ab941b-da8c-4160-94fb-3672b069d44f 2024-09-14T11:33:11.098 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:11.099+0000 7f15e4b359c0 20 rados->read ofs=0 len=0 2024-09-14T11:33:11.098 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:11.099+0000 7f15e4b359c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:33:11.098 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:11.099+0000 7f15e4b359c0 20 rados->read ofs=0 len=0 2024-09-14T11:33:11.098 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:11.103+0000 7f15e4b359c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:33:11.098 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:11.103+0000 7f15e4b359c0 20 rados->read ofs=0 len=0 2024-09-14T11:33:11.099 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:11.103+0000 7f15e4b359c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:33:11.099 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:11.103+0000 7f15e4b359c0 20 zone default found 2024-09-14T11:33:11.099 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:11.103+0000 7f15e4b359c0 4 Realm: () 2024-09-14T11:33:11.099 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:11.103+0000 7f15e4b359c0 4 ZoneGroup: default (65ab941b-da8c-4160-94fb-3672b069d44f) 2024-09-14T11:33:11.099 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:11.103+0000 7f15e4b359c0 4 Zone: default (d9e72d30-c60b-4d0d-9267-fdc36392d5ad) 2024-09-14T11:33:11.099 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:11.103+0000 7f15e4b359c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:33:11.099 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:11.103+0000 7f15e4b359c0 20 zonegroup default 2024-09-14T11:33:11.099 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:11.103+0000 7f15e4b359c0 20 rados->read ofs=0 len=0 2024-09-14T11:33:11.100 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:11.103+0000 7f15e4b359c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:33:11.100 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:11.103+0000 7f15e4b359c0 20 rados->read ofs=0 len=0 2024-09-14T11:33:11.100 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:11.103+0000 7f15e4b359c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:33:11.100 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:11.103+0000 7f15e4b359c0 20 rados->read ofs=0 len=0 2024-09-14T11:33:11.101 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:11.103+0000 7f15e4b359c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:33:11.101 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:11.103+0000 7f15e4b359c0 20 started sync module instance, tier type = 2024-09-14T11:33:11.101 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:11.103+0000 7f15e4b359c0 20 started zone id=d9e72d30-c60b-4d0d-9267-fdc36392d5ad (name=default) with tier type = 2024-09-14T11:33:11.116 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:11.119+0000 7f15e4b359c0 20 add_watcher() i=0 2024-09-14T11:33:11.116 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:11.119+0000 7f15e4b359c0 20 add_watcher() i=1 2024-09-14T11:33:11.116 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:11.119+0000 7f15e4b359c0 20 add_watcher() i=2 2024-09-14T11:33:11.117 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:11.119+0000 7f15e4b359c0 20 add_watcher() i=3 2024-09-14T11:33:11.117 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:11.119+0000 7f15e4b359c0 20 add_watcher() i=4 2024-09-14T11:33:11.117 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:11.119+0000 7f15e4b359c0 20 add_watcher() i=5 2024-09-14T11:33:11.117 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:11.119+0000 7f15e4b359c0 20 add_watcher() i=6 2024-09-14T11:33:11.118 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:11.119+0000 7f15e4b359c0 20 add_watcher() i=7 2024-09-14T11:33:11.118 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:11.119+0000 7f15e4b359c0 2 all 8 watchers are set, enabling cache 2024-09-14T11:33:11.120 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:11.123+0000 7f1498fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:33:11.121 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:11.123+0000 7f15e4b359c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:33:11.121 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:11.123+0000 7f15e4b359c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:33:11.121 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:11.123+0000 7f15e4b359c0 5 note: GC not initialized 2024-09-14T11:33:11.122 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:11.123+0000 7f14137fe640 20 reqs_thread_entry: start 2024-09-14T11:33:11.122 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:11.123+0000 7f15e4b359c0 20 init_complete bucket index max shards: 11 2024-09-14T11:33:11.122 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:11.127+0000 7f15e4b359c0 20 Filter name: none 2024-09-14T11:33:11.122 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:11.127+0000 7f14117fa640 20 reqs_thread_entry: start 2024-09-14T11:33:11.122 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:11.127+0000 7f15e4b359c0 10 cache get: name=default.rgw.meta+users.uid+tester : miss 2024-09-14T11:33:11.122 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:11.127+0000 7f15e4b359c0 20 rados->read ofs=0 len=0 2024-09-14T11:33:11.123 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:11.127+0000 7f15e4b359c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:33:11.123 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:11.127+0000 7f15e4b359c0 10 cache put: name=default.rgw.meta+users.uid+tester info.flags=0x0 2024-09-14T11:33:11.123 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:11.127+0000 7f15e4b359c0 10 adding default.rgw.meta+users.uid+tester to cache LRU end 2024-09-14T11:33:11.124 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:11.127+0000 7f15e4b359c0 10 cache get: name=default.rgw.meta+users.keys+NX5QOQKC6BH2IDN8HC7A : miss 2024-09-14T11:33:11.124 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:11.127+0000 7f15e4b359c0 20 rados->read ofs=0 len=0 2024-09-14T11:33:11.124 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:11.127+0000 7f15e4b359c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:33:11.124 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:11.127+0000 7f15e4b359c0 10 cache put: name=default.rgw.meta+users.keys+NX5QOQKC6BH2IDN8HC7A info.flags=0x0 2024-09-14T11:33:11.124 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:11.127+0000 7f15e4b359c0 10 adding default.rgw.meta+users.keys+NX5QOQKC6BH2IDN8HC7A to cache LRU end 2024-09-14T11:33:11.124 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:11.127+0000 7f15e4b359c0 10 cache get: name=default.rgw.meta+users.keys+NX5QOQKC6BH2IDN8HC7A : hit (negative entry) 2024-09-14T11:33:11.124 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:11.127+0000 7f15e4b359c0 10 cache get: name=default.rgw.meta+users.keys+NX5QOQKC6BH2IDN8HC7A : hit (negative entry) 2024-09-14T11:33:11.125 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:11.127+0000 7f15e4b359c0 10 cache put: name=default.rgw.meta+users.uid+tester info.flags=0x17 2024-09-14T11:33:11.126 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:11.127+0000 7f15e4b359c0 10 moving default.rgw.meta+users.uid+tester to cache LRU end 2024-09-14T11:33:11.126 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:11.127+0000 7f15e4b359c0 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:users.uid:tester, ofs0, ns] 2024-09-14T11:33:11.126 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:11.131+0000 7f14c5ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366165 cookie 94110015581232 notifier 5910 bl.length()=569 2024-09-14T11:33:11.126 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:11.131+0000 7f14c5ffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+tester info.flags=0x17 2024-09-14T11:33:11.126 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:11.131+0000 7f14c5ffb640 10 rgw watcher librados: moving default.rgw.meta+users.uid+tester to cache LRU end 2024-09-14T11:33:11.129 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:11.131+0000 7f15e4b359c0 10 cache put: name=default.rgw.meta+users.keys+NX5QOQKC6BH2IDN8HC7A info.flags=0x7 2024-09-14T11:33:11.129 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:11.131+0000 7f15e4b359c0 10 moving default.rgw.meta+users.keys+NX5QOQKC6BH2IDN8HC7A to cache LRU end 2024-09-14T11:33:11.129 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:11.131+0000 7f15e4b359c0 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:users.keys:NX5QOQKC6BH2IDN8HC7A, ofs0, ns] 2024-09-14T11:33:11.130 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:11.131+0000 7f14c5ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366166 cookie 94110015582432 notifier 5910 bl.length()=180 2024-09-14T11:33:11.130 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:11.131+0000 7f14c5ffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.keys+NX5QOQKC6BH2IDN8HC7A info.flags=0x7 2024-09-14T11:33:11.130 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:11.131+0000 7f14c5ffb640 10 rgw watcher librados: moving default.rgw.meta+users.keys+NX5QOQKC6BH2IDN8HC7A to cache LRU end 2024-09-14T11:33:11.132 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:11.135+0000 7f1498fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:33:11.137 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:11.139+0000 7f15e4b359c0 20 remove_watcher() i=0 2024-09-14T11:33:11.138 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:11.139+0000 7f15e4b359c0 2 removed watcher, disabling cache 2024-09-14T11:33:11.140 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:11.143+0000 7f15e4b359c0 20 remove_watcher() i=1 2024-09-14T11:33:11.142 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:11.147+0000 7f15e4b359c0 20 remove_watcher() i=2 2024-09-14T11:33:11.144 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:11.147+0000 7f15e4b359c0 20 remove_watcher() i=3 2024-09-14T11:33:11.146 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:11.151+0000 7f15e4b359c0 20 remove_watcher() i=4 2024-09-14T11:33:11.147 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:11.151+0000 7f15e4b359c0 20 remove_watcher() i=5 2024-09-14T11:33:11.149 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:11.151+0000 7f15e4b359c0 20 remove_watcher() i=6 2024-09-14T11:33:11.150 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:11.155+0000 7f15e4b359c0 20 remove_watcher() i=7 2024-09-14T11:33:30.769 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:33:30.769 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-14T11:33:30.847 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:33:30.847 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-14T11:33:30.981 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:33:30.981 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-14T11:33:31.115 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:33:31.115 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-14T11:33:31.197 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:33:31.198 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-14T11:33:31.299 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:33:31.299 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-14T11:33:31.383 INFO:tasks.workunit.client.0.smithi138.stderr:TEST: reshard add 2024-09-14T11:33:31.383 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-14T11:33:31.384 INFO:tasks.workunit.client.0.smithi138.stderr:radosgw-admin bucket stats --bucket a-bucket 2024-09-14T11:33:31.416 INFO:tasks.workunit.client.0.smithi138.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:33:31.417 INFO:tasks.workunit.client.0.smithi138.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:33:31.463 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:31.466+0000 7f1fe490b9c0 20 rados->read ofs=0 len=0 2024-09-14T11:33:31.465 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:31.466+0000 7f1fe490b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:33:31.465 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:31.466+0000 7f1fe490b9c0 20 realm 2024-09-14T11:33:31.465 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:31.466+0000 7f1fe490b9c0 20 rados->read ofs=0 len=0 2024-09-14T11:33:31.465 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:31.466+0000 7f1fe490b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:33:31.465 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:31.466+0000 7f1fe490b9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:33:31.465 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:31.466+0000 7f1fe490b9c0 20 rados->read ofs=0 len=0 2024-09-14T11:33:31.465 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:31.466+0000 7f1fe490b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:33:31.466 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:31.466+0000 7f1fe490b9c0 20 rados->read ofs=0 len=0 2024-09-14T11:33:31.466 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:31.470+0000 7f1fe490b9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:33:31.467 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:31.470+0000 7f1fe490b9c0 20 rados->read ofs=0 len=0 2024-09-14T11:33:31.467 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:31.470+0000 7f1fe490b9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:33:31.467 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:31.470+0000 7f1fe490b9c0 20 searching for the correct realm 2024-09-14T11:33:31.472 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:31.474+0000 7f1fe1c10640 0 -- 172.21.15.138:0/3716894817 >> [v2:172.21.15.154:6808/1468088432,v1:172.21.15.154:6809/1468088432] conn(0x7f1fd411b020 msgr2=0x7f1fd40cf490 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:33:31.478 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:31.482+0000 7f1fe1c10640 0 -- 172.21.15.138:0/3716894817 >> [v2:172.21.15.138:6816/326481658,v1:172.21.15.138:6817/326481658] conn(0x7f1fdc03e3f0 msgr2=0x7f1fdc03e870 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:33:31.698 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:31.698+0000 7f1fe490b9c0 20 RGWRados::pool_iterate: got zone_info.d9e72d30-c60b-4d0d-9267-fdc36392d5ad 2024-09-14T11:33:31.698 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:31.698+0000 7f1fe490b9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:33:31.698 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:31.698+0000 7f1fe490b9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:33:31.698 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:31.698+0000 7f1fe490b9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:33:31.698 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:31.698+0000 7f1fe490b9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:33:31.698 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:31.698+0000 7f1fe490b9c0 20 RGWRados::pool_iterate: got zonegroup_info.65ab941b-da8c-4160-94fb-3672b069d44f 2024-09-14T11:33:31.698 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:31.698+0000 7f1fe490b9c0 20 rados->read ofs=0 len=0 2024-09-14T11:33:31.699 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:31.702+0000 7f1fe490b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:33:31.699 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:31.702+0000 7f1fe490b9c0 20 rados->read ofs=0 len=0 2024-09-14T11:33:31.700 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:31.702+0000 7f1fe490b9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:33:31.700 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:31.702+0000 7f1fe490b9c0 20 rados->read ofs=0 len=0 2024-09-14T11:33:31.701 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:31.702+0000 7f1fe490b9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:33:31.701 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:31.702+0000 7f1fe490b9c0 20 zone default found 2024-09-14T11:33:31.701 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:31.702+0000 7f1fe490b9c0 4 Realm: () 2024-09-14T11:33:31.701 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:31.702+0000 7f1fe490b9c0 4 ZoneGroup: default (65ab941b-da8c-4160-94fb-3672b069d44f) 2024-09-14T11:33:31.701 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:31.702+0000 7f1fe490b9c0 4 Zone: default (d9e72d30-c60b-4d0d-9267-fdc36392d5ad) 2024-09-14T11:33:31.701 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:31.702+0000 7f1fe490b9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:33:31.701 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:31.702+0000 7f1fe490b9c0 20 zonegroup default 2024-09-14T11:33:31.701 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:31.702+0000 7f1fe490b9c0 20 rados->read ofs=0 len=0 2024-09-14T11:33:31.701 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:31.702+0000 7f1fe490b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:33:31.701 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:31.702+0000 7f1fe490b9c0 20 rados->read ofs=0 len=0 2024-09-14T11:33:31.702 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:31.706+0000 7f1fe490b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:33:31.702 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:31.706+0000 7f1fe490b9c0 20 rados->read ofs=0 len=0 2024-09-14T11:33:31.703 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:31.706+0000 7f1fe490b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:33:31.703 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:31.706+0000 7f1fe490b9c0 20 started sync module instance, tier type = 2024-09-14T11:33:31.703 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:31.706+0000 7f1fe490b9c0 20 started zone id=d9e72d30-c60b-4d0d-9267-fdc36392d5ad (name=default) with tier type = 2024-09-14T11:33:31.724 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:31.726+0000 7f1fe490b9c0 20 add_watcher() i=0 2024-09-14T11:33:31.724 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:31.726+0000 7f1fe490b9c0 20 add_watcher() i=1 2024-09-14T11:33:31.724 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:31.726+0000 7f1fe490b9c0 20 add_watcher() i=2 2024-09-14T11:33:31.724 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:31.726+0000 7f1fe490b9c0 20 add_watcher() i=3 2024-09-14T11:33:31.724 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:31.726+0000 7f1fe490b9c0 20 add_watcher() i=4 2024-09-14T11:33:31.725 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:31.726+0000 7f1fe490b9c0 20 add_watcher() i=5 2024-09-14T11:33:31.725 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:31.726+0000 7f1fe490b9c0 20 add_watcher() i=6 2024-09-14T11:33:31.726 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:31.730+0000 7f1fe490b9c0 20 add_watcher() i=7 2024-09-14T11:33:31.726 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:31.730+0000 7f1fe490b9c0 2 all 8 watchers are set, enabling cache 2024-09-14T11:33:31.730 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:31.730+0000 7f1e98fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:33:31.731 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:31.734+0000 7f1fe490b9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:33:31.731 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:31.734+0000 7f1fe490b9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:33:31.731 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:31.734+0000 7f1fe490b9c0 5 note: GC not initialized 2024-09-14T11:33:31.732 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:31.734+0000 7f1e137fe640 20 reqs_thread_entry: start 2024-09-14T11:33:31.732 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:31.734+0000 7f1fe490b9c0 20 init_complete bucket index max shards: 11 2024-09-14T11:33:31.732 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:31.734+0000 7f1fe490b9c0 20 Filter name: none 2024-09-14T11:33:31.732 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:31.734+0000 7f1e117fa640 20 reqs_thread_entry: start 2024-09-14T11:33:31.732 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:31.734+0000 7f1fe490b9c0 20 rados->read ofs=0 len=0 2024-09-14T11:33:31.733 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:31.734+0000 7f1fe490b9c0 20 rados_obj.operate() r=0 bl.length=176 2024-09-14T11:33:31.733 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:31.734+0000 7f1fe490b9c0 20 rados->read ofs=0 len=0 2024-09-14T11:33:31.734 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:31.738+0000 7f1fe490b9c0 20 rados_obj.operate() r=0 bl.length=398 2024-09-14T11:33:31.734 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:31.738+0000 7f1fe490b9c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:33:31.735 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:31.738+0000 7f1fe490b9c0 20 rados->read ofs=0 len=0 2024-09-14T11:33:31.735 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:31.738+0000 7f1fe490b9c0 20 rados_obj.operate() r=0 bl.length=176 2024-09-14T11:33:31.735 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:31.738+0000 7f1fe490b9c0 20 rados->read ofs=0 len=0 2024-09-14T11:33:31.736 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:31.738+0000 7f1fe490b9c0 20 rados_obj.operate() r=0 bl.length=398 2024-09-14T11:33:31.736 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:31.738+0000 7f1fe490b9c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:33:31.739 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:31.742+0000 7f1e98fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:33:31.744 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:31.746+0000 7f1fe490b9c0 20 remove_watcher() i=0 2024-09-14T11:33:31.744 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:31.746+0000 7f1fe490b9c0 2 removed watcher, disabling cache 2024-09-14T11:33:31.746 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:31.750+0000 7f1fe490b9c0 20 remove_watcher() i=1 2024-09-14T11:33:31.748 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:31.750+0000 7f1fe490b9c0 20 remove_watcher() i=2 2024-09-14T11:33:31.751 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:31.754+0000 7f1fe490b9c0 20 remove_watcher() i=3 2024-09-14T11:33:31.753 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:31.754+0000 7f1fe490b9c0 20 remove_watcher() i=4 2024-09-14T11:33:31.755 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:31.758+0000 7f1fe490b9c0 20 remove_watcher() i=5 2024-09-14T11:33:31.756 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:31.758+0000 7f1fe490b9c0 20 remove_watcher() i=6 2024-09-14T11:33:31.758 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:31.758+0000 7f1fe490b9c0 20 remove_watcher() i=7 2024-09-14T11:33:31.773 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-14T11:33:31.773 INFO:tasks.workunit.client.0.smithi138.stderr:BUCKET_STATS: 2024-09-14T11:33:31.773 INFO:tasks.workunit.client.0.smithi138.stderr:bucket: a-bucket id: d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.17 num_objects: 0 size_kb: 0 num_shards: 11 2024-09-14T11:33:31.773 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-14T11:33:31.774 INFO:tasks.workunit.client.0.smithi138.stderr:radosgw-admin reshard add --bucket a-bucket --num-shards 12 2024-09-14T11:33:31.803 INFO:tasks.workunit.client.0.smithi138.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:33:31.803 INFO:tasks.workunit.client.0.smithi138.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:33:31.849 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:31.850+0000 7fac939fa9c0 20 rados->read ofs=0 len=0 2024-09-14T11:33:31.851 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:31.854+0000 7fac939fa9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:33:31.851 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:31.854+0000 7fac939fa9c0 20 realm 2024-09-14T11:33:31.851 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:31.854+0000 7fac939fa9c0 20 rados->read ofs=0 len=0 2024-09-14T11:33:31.851 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:31.854+0000 7fac939fa9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:33:31.851 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:31.854+0000 7fac939fa9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:33:31.851 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:31.854+0000 7fac939fa9c0 20 rados->read ofs=0 len=0 2024-09-14T11:33:31.851 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:31.854+0000 7fac939fa9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:33:31.851 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:31.854+0000 7fac939fa9c0 20 rados->read ofs=0 len=0 2024-09-14T11:33:31.853 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:31.854+0000 7fac939fa9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:33:31.853 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:31.854+0000 7fac939fa9c0 20 rados->read ofs=0 len=0 2024-09-14T11:33:31.853 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:31.854+0000 7fac939fa9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:33:31.853 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:31.854+0000 7fac939fa9c0 20 searching for the correct realm 2024-09-14T11:33:31.858 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:31.862+0000 7fac91500640 0 -- 172.21.15.138:0/1724932531 >> [v2:172.21.15.138:6808/3258321916,v1:172.21.15.138:6809/3258321916] conn(0x55ec761df2c0 msgr2=0x55ec761e1780 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:33:31.864 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:31.866+0000 7fac90cff640 0 -- 172.21.15.138:0/1724932531 >> [v2:172.21.15.138:6816/326481658,v1:172.21.15.138:6817/326481658] conn(0x7fac8c017070 msgr2=0x7fac8c06ef70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-14T11:33:31.872 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:31.874+0000 7fac939fa9c0 20 RGWRados::pool_iterate: got zone_info.d9e72d30-c60b-4d0d-9267-fdc36392d5ad 2024-09-14T11:33:31.872 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:31.874+0000 7fac939fa9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:33:31.873 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:31.874+0000 7fac939fa9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:33:31.873 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:31.874+0000 7fac939fa9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:33:31.873 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:31.874+0000 7fac939fa9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:33:31.873 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:31.874+0000 7fac939fa9c0 20 RGWRados::pool_iterate: got zonegroup_info.65ab941b-da8c-4160-94fb-3672b069d44f 2024-09-14T11:33:31.873 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:31.874+0000 7fac939fa9c0 20 rados->read ofs=0 len=0 2024-09-14T11:33:31.873 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:31.874+0000 7fac939fa9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:33:31.873 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:31.874+0000 7fac939fa9c0 20 rados->read ofs=0 len=0 2024-09-14T11:33:31.874 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:31.874+0000 7fac939fa9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:33:31.874 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:31.874+0000 7fac939fa9c0 20 rados->read ofs=0 len=0 2024-09-14T11:33:31.874 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:31.878+0000 7fac939fa9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:33:31.874 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:31.878+0000 7fac939fa9c0 20 zone default found 2024-09-14T11:33:31.875 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:31.878+0000 7fac939fa9c0 4 Realm: () 2024-09-14T11:33:31.875 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:31.878+0000 7fac939fa9c0 4 ZoneGroup: default (65ab941b-da8c-4160-94fb-3672b069d44f) 2024-09-14T11:33:31.875 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:31.878+0000 7fac939fa9c0 4 Zone: default (d9e72d30-c60b-4d0d-9267-fdc36392d5ad) 2024-09-14T11:33:31.875 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:31.878+0000 7fac939fa9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:33:31.875 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:31.878+0000 7fac939fa9c0 20 zonegroup default 2024-09-14T11:33:31.875 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:31.878+0000 7fac939fa9c0 20 rados->read ofs=0 len=0 2024-09-14T11:33:31.875 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:31.878+0000 7fac939fa9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:33:31.875 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:31.878+0000 7fac939fa9c0 20 rados->read ofs=0 len=0 2024-09-14T11:33:31.876 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:31.878+0000 7fac939fa9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:33:31.876 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:31.878+0000 7fac939fa9c0 20 rados->read ofs=0 len=0 2024-09-14T11:33:31.876 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:31.878+0000 7fac939fa9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:33:31.877 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:31.878+0000 7fac939fa9c0 20 started sync module instance, tier type = 2024-09-14T11:33:31.877 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:31.878+0000 7fac939fa9c0 20 started zone id=d9e72d30-c60b-4d0d-9267-fdc36392d5ad (name=default) with tier type = 2024-09-14T11:33:31.892 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:31.894+0000 7fac939fa9c0 20 add_watcher() i=0 2024-09-14T11:33:31.892 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:31.894+0000 7fac939fa9c0 20 add_watcher() i=1 2024-09-14T11:33:31.892 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:31.894+0000 7fac939fa9c0 20 add_watcher() i=2 2024-09-14T11:33:31.892 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:31.894+0000 7fac939fa9c0 20 add_watcher() i=3 2024-09-14T11:33:31.892 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:31.894+0000 7fac939fa9c0 20 add_watcher() i=4 2024-09-14T11:33:31.893 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:31.894+0000 7fac939fa9c0 20 add_watcher() i=5 2024-09-14T11:33:31.893 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:31.894+0000 7fac939fa9c0 20 add_watcher() i=6 2024-09-14T11:33:31.893 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:31.894+0000 7fac939fa9c0 20 add_watcher() i=7 2024-09-14T11:33:31.893 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:31.894+0000 7fac939fa9c0 2 all 8 watchers are set, enabling cache 2024-09-14T11:33:31.896 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:31.898+0000 7fab47fe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:33:31.896 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:31.898+0000 7fac939fa9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:33:31.896 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:31.898+0000 7fac939fa9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:33:31.897 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:31.898+0000 7fac939fa9c0 5 note: GC not initialized 2024-09-14T11:33:31.897 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:31.898+0000 7fab46fe5640 20 reqs_thread_entry: start 2024-09-14T11:33:31.897 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:31.898+0000 7fac939fa9c0 20 init_complete bucket index max shards: 11 2024-09-14T11:33:31.897 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:31.898+0000 7fac939fa9c0 20 Filter name: none 2024-09-14T11:33:31.898 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:31.898+0000 7fab44fe1640 20 reqs_thread_entry: start 2024-09-14T11:33:31.898 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:31.898+0000 7fac939fa9c0 10 cache get: name=default.rgw.meta+root+a-bucket : miss 2024-09-14T11:33:31.898 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:31.898+0000 7fac939fa9c0 20 rados->read ofs=0 len=0 2024-09-14T11:33:31.898 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:31.898+0000 7fac939fa9c0 20 rados_obj.operate() r=0 bl.length=176 2024-09-14T11:33:31.898 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:31.898+0000 7fac939fa9c0 10 cache put: name=default.rgw.meta+root+a-bucket info.flags=0x11 2024-09-14T11:33:31.898 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:31.898+0000 7fac939fa9c0 10 adding default.rgw.meta+root+a-bucket to cache LRU end 2024-09-14T11:33:31.898 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:31.898+0000 7fac939fa9c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.17 : miss 2024-09-14T11:33:31.898 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:31.898+0000 7fac939fa9c0 20 rados->read ofs=0 len=0 2024-09-14T11:33:31.899 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:31.902+0000 7fac939fa9c0 20 rados_obj.operate() r=0 bl.length=398 2024-09-14T11:33:31.899 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:31.902+0000 7fac939fa9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.17 info.flags=0x17 2024-09-14T11:33:31.899 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:31.902+0000 7fac939fa9c0 10 adding default.rgw.meta+root+.bucket.meta.a-bucket:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.17 to cache LRU end 2024-09-14T11:33:31.899 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:31.902+0000 7fac939fa9c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:33:31.899 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:31.902+0000 7fac939fa9c0 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-14T11:33:31.899 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:31.902+0000 7fac939fa9c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.17 2024-09-14T11:33:31.901 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:31.902+0000 7fab47fe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:33:31.908 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:31.910+0000 7fac939fa9c0 20 remove_watcher() i=0 2024-09-14T11:33:31.909 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:31.910+0000 7fac939fa9c0 2 removed watcher, disabling cache 2024-09-14T11:33:31.911 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:31.914+0000 7fac939fa9c0 20 remove_watcher() i=1 2024-09-14T11:33:31.914 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:31.918+0000 7fac939fa9c0 20 remove_watcher() i=2 2024-09-14T11:33:31.916 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:31.918+0000 7fac939fa9c0 20 remove_watcher() i=3 2024-09-14T11:33:31.918 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:31.922+0000 7fac939fa9c0 20 remove_watcher() i=4 2024-09-14T11:33:31.919 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:31.922+0000 7fac939fa9c0 20 remove_watcher() i=5 2024-09-14T11:33:31.920 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:31.922+0000 7fac939fa9c0 20 remove_watcher() i=6 2024-09-14T11:33:31.922 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:31.922+0000 7fac939fa9c0 20 remove_watcher() i=7 2024-09-14T11:33:31.936 INFO:tasks.workunit.client.0.smithi138.stderr:radosgw-admin reshard list 2024-09-14T11:33:31.960 INFO:tasks.workunit.client.0.smithi138.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:33:31.960 INFO:tasks.workunit.client.0.smithi138.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:33:32.005 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:32.006+0000 7f667e69f9c0 20 rados->read ofs=0 len=0 2024-09-14T11:33:32.007 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:32.010+0000 7f667e69f9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:33:32.007 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:32.010+0000 7f667e69f9c0 20 realm 2024-09-14T11:33:32.007 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:32.010+0000 7f667e69f9c0 20 rados->read ofs=0 len=0 2024-09-14T11:33:32.007 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:32.010+0000 7f667e69f9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:33:32.007 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:32.010+0000 7f667e69f9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:33:32.007 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:32.010+0000 7f667e69f9c0 20 rados->read ofs=0 len=0 2024-09-14T11:33:32.007 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:32.010+0000 7f667e69f9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:33:32.008 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:32.010+0000 7f667e69f9c0 20 rados->read ofs=0 len=0 2024-09-14T11:33:32.009 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:32.010+0000 7f667e69f9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:33:32.009 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:32.010+0000 7f667e69f9c0 20 rados->read ofs=0 len=0 2024-09-14T11:33:32.010 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:32.010+0000 7f667e69f9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:33:32.010 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:32.010+0000 7f667e69f9c0 20 searching for the correct realm 2024-09-14T11:33:32.012 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:32.014+0000 7f667b9a4640 0 -- 172.21.15.138:0/3278502166 >> [v2:172.21.15.154:6808/1468088432,v1:172.21.15.154:6809/1468088432] conn(0x7f666c0c1060 msgr2=0x7f666c0f6610 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:33:32.018 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:32.022+0000 7f667c9a6640 0 -- 172.21.15.138:0/3278502166 >> [v2:172.21.15.138:6824/2633984942,v1:172.21.15.138:6825/2633984942] conn(0x557b0d2d4780 msgr2=0x557b0d2d6b70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:33:32.029 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:32.030+0000 7f667e69f9c0 20 RGWRados::pool_iterate: got zone_info.d9e72d30-c60b-4d0d-9267-fdc36392d5ad 2024-09-14T11:33:32.029 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:32.030+0000 7f667e69f9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:33:32.029 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:32.030+0000 7f667e69f9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:33:32.029 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:32.030+0000 7f667e69f9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:33:32.029 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:32.030+0000 7f667e69f9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:33:32.029 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:32.030+0000 7f667e69f9c0 20 RGWRados::pool_iterate: got zonegroup_info.65ab941b-da8c-4160-94fb-3672b069d44f 2024-09-14T11:33:32.029 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:32.030+0000 7f667e69f9c0 20 rados->read ofs=0 len=0 2024-09-14T11:33:32.029 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:32.030+0000 7f667e69f9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:33:32.029 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:32.030+0000 7f667e69f9c0 20 rados->read ofs=0 len=0 2024-09-14T11:33:32.030 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:32.030+0000 7f667e69f9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:33:32.030 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:32.030+0000 7f667e69f9c0 20 rados->read ofs=0 len=0 2024-09-14T11:33:32.030 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:32.034+0000 7f667e69f9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:33:32.031 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:32.034+0000 7f667e69f9c0 20 zone default found 2024-09-14T11:33:32.031 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:32.034+0000 7f667e69f9c0 4 Realm: () 2024-09-14T11:33:32.031 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:32.034+0000 7f667e69f9c0 4 ZoneGroup: default (65ab941b-da8c-4160-94fb-3672b069d44f) 2024-09-14T11:33:32.031 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:32.034+0000 7f667e69f9c0 4 Zone: default (d9e72d30-c60b-4d0d-9267-fdc36392d5ad) 2024-09-14T11:33:32.031 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:32.034+0000 7f667e69f9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:33:32.031 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:32.034+0000 7f667e69f9c0 20 zonegroup default 2024-09-14T11:33:32.031 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:32.034+0000 7f667e69f9c0 20 rados->read ofs=0 len=0 2024-09-14T11:33:32.032 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:32.034+0000 7f667e69f9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:33:32.032 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:32.034+0000 7f667e69f9c0 20 rados->read ofs=0 len=0 2024-09-14T11:33:32.032 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:32.034+0000 7f667e69f9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:33:32.032 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:32.034+0000 7f667e69f9c0 20 rados->read ofs=0 len=0 2024-09-14T11:33:32.032 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:32.034+0000 7f667e69f9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:33:32.032 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:32.034+0000 7f667e69f9c0 20 started sync module instance, tier type = 2024-09-14T11:33:32.032 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:32.034+0000 7f667e69f9c0 20 started zone id=d9e72d30-c60b-4d0d-9267-fdc36392d5ad (name=default) with tier type = 2024-09-14T11:33:32.047 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:32.050+0000 7f667e69f9c0 20 add_watcher() i=0 2024-09-14T11:33:32.047 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:32.050+0000 7f667e69f9c0 20 add_watcher() i=1 2024-09-14T11:33:32.047 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:32.050+0000 7f667e69f9c0 20 add_watcher() i=2 2024-09-14T11:33:32.047 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:32.050+0000 7f667e69f9c0 20 add_watcher() i=3 2024-09-14T11:33:32.047 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:32.050+0000 7f667e69f9c0 20 add_watcher() i=4 2024-09-14T11:33:32.047 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:32.050+0000 7f667e69f9c0 20 add_watcher() i=5 2024-09-14T11:33:32.047 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:32.050+0000 7f667e69f9c0 20 add_watcher() i=6 2024-09-14T11:33:32.048 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:32.050+0000 7f667e69f9c0 20 add_watcher() i=7 2024-09-14T11:33:32.048 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:32.050+0000 7f667e69f9c0 2 all 8 watchers are set, enabling cache 2024-09-14T11:33:32.050 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:32.054+0000 7f6532fdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:33:32.051 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:32.054+0000 7f667e69f9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:33:32.051 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:32.054+0000 7f667e69f9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:33:32.052 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:32.054+0000 7f667e69f9c0 5 note: GC not initialized 2024-09-14T11:33:32.052 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:32.054+0000 7f6531fdb640 20 reqs_thread_entry: start 2024-09-14T11:33:32.052 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:32.054+0000 7f667e69f9c0 20 init_complete bucket index max shards: 11 2024-09-14T11:33:32.052 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:32.054+0000 7f667e69f9c0 20 Filter name: none 2024-09-14T11:33:32.052 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:32.054+0000 7f64a37fe640 20 reqs_thread_entry: start 2024-09-14T11:33:32.061 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:32.062+0000 7f6532fdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:33:32.066 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:32.070+0000 7f667e69f9c0 20 remove_watcher() i=0 2024-09-14T11:33:32.066 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:32.070+0000 7f667e69f9c0 2 removed watcher, disabling cache 2024-09-14T11:33:32.068 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:32.070+0000 7f667e69f9c0 20 remove_watcher() i=1 2024-09-14T11:33:32.070 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:32.074+0000 7f667e69f9c0 20 remove_watcher() i=2 2024-09-14T11:33:32.072 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:32.074+0000 7f667e69f9c0 20 remove_watcher() i=3 2024-09-14T11:33:32.074 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:32.078+0000 7f667e69f9c0 20 remove_watcher() i=4 2024-09-14T11:33:32.076 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:32.078+0000 7f667e69f9c0 20 remove_watcher() i=5 2024-09-14T11:33:32.077 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:32.078+0000 7f667e69f9c0 20 remove_watcher() i=6 2024-09-14T11:33:32.078 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:32.082+0000 7f667e69f9c0 20 remove_watcher() i=7 2024-09-14T11:33:32.093 INFO:tasks.workunit.client.0.smithi138.stderr:bucket name a-bucket 2024-09-14T11:33:32.093 INFO:tasks.workunit.client.0.smithi138.stderr:TEST: reshard process 2024-09-14T11:33:32.093 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-14T11:33:32.093 INFO:tasks.workunit.client.0.smithi138.stderr:radosgw-admin reshard process 2024-09-14T11:33:32.117 INFO:tasks.workunit.client.0.smithi138.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:33:32.117 INFO:tasks.workunit.client.0.smithi138.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:33:32.161 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:32.162+0000 7f9f1c49a9c0 20 rados->read ofs=0 len=0 2024-09-14T11:33:32.163 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:32.166+0000 7f9f1c49a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:33:32.163 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:32.166+0000 7f9f1c49a9c0 20 realm 2024-09-14T11:33:32.163 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:32.166+0000 7f9f1c49a9c0 20 rados->read ofs=0 len=0 2024-09-14T11:33:32.163 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:32.166+0000 7f9f1c49a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:33:32.163 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:32.166+0000 7f9f1c49a9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:33:32.163 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:32.166+0000 7f9f1c49a9c0 20 rados->read ofs=0 len=0 2024-09-14T11:33:32.164 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:32.166+0000 7f9f1c49a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:33:32.164 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:32.166+0000 7f9f1c49a9c0 20 rados->read ofs=0 len=0 2024-09-14T11:33:32.165 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:32.166+0000 7f9f1c49a9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:33:32.165 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:32.166+0000 7f9f1c49a9c0 20 rados->read ofs=0 len=0 2024-09-14T11:33:32.166 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:32.166+0000 7f9f1c49a9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:33:32.166 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:32.166+0000 7f9f1c49a9c0 20 searching for the correct realm 2024-09-14T11:33:32.170 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:32.174+0000 7f9f19fa0640 0 -- 172.21.15.138:0/3667830053 >> [v2:172.21.15.138:6808/3258321916,v1:172.21.15.138:6809/3258321916] conn(0x5603ca8bb920 msgr2=0x5603ca8bdde0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:33:32.176 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:32.178+0000 7f9f1179f640 0 -- 172.21.15.138:0/3667830053 >> [v2:172.21.15.138:6816/326481658,v1:172.21.15.138:6817/326481658] conn(0x7f9f1406cd00 msgr2=0x7f9f140763b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:33:32.183 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:32.186+0000 7f9f1c49a9c0 20 RGWRados::pool_iterate: got zone_info.d9e72d30-c60b-4d0d-9267-fdc36392d5ad 2024-09-14T11:33:32.183 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:32.186+0000 7f9f1c49a9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:33:32.183 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:32.186+0000 7f9f1c49a9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:33:32.183 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:32.186+0000 7f9f1c49a9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:33:32.183 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:32.186+0000 7f9f1c49a9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:33:32.184 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:32.186+0000 7f9f1c49a9c0 20 RGWRados::pool_iterate: got zonegroup_info.65ab941b-da8c-4160-94fb-3672b069d44f 2024-09-14T11:33:32.184 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:32.186+0000 7f9f1c49a9c0 20 rados->read ofs=0 len=0 2024-09-14T11:33:32.184 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:32.186+0000 7f9f1c49a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:33:32.184 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:32.186+0000 7f9f1c49a9c0 20 rados->read ofs=0 len=0 2024-09-14T11:33:32.185 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:32.186+0000 7f9f1c49a9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:33:32.185 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:32.186+0000 7f9f1c49a9c0 20 rados->read ofs=0 len=0 2024-09-14T11:33:32.185 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:32.186+0000 7f9f1c49a9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:33:32.185 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:32.186+0000 7f9f1c49a9c0 20 zone default found 2024-09-14T11:33:32.185 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:32.186+0000 7f9f1c49a9c0 4 Realm: () 2024-09-14T11:33:32.185 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:32.186+0000 7f9f1c49a9c0 4 ZoneGroup: default (65ab941b-da8c-4160-94fb-3672b069d44f) 2024-09-14T11:33:32.185 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:32.186+0000 7f9f1c49a9c0 4 Zone: default (d9e72d30-c60b-4d0d-9267-fdc36392d5ad) 2024-09-14T11:33:32.185 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:32.186+0000 7f9f1c49a9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:33:32.185 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:32.186+0000 7f9f1c49a9c0 20 zonegroup default 2024-09-14T11:33:32.185 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:32.186+0000 7f9f1c49a9c0 20 rados->read ofs=0 len=0 2024-09-14T11:33:32.185 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:32.186+0000 7f9f1c49a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:33:32.186 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:32.186+0000 7f9f1c49a9c0 20 rados->read ofs=0 len=0 2024-09-14T11:33:32.186 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:32.186+0000 7f9f1c49a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:33:32.186 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:32.186+0000 7f9f1c49a9c0 20 rados->read ofs=0 len=0 2024-09-14T11:33:32.186 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:32.186+0000 7f9f1c49a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:33:32.186 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:32.186+0000 7f9f1c49a9c0 20 started sync module instance, tier type = 2024-09-14T11:33:32.186 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:32.190+0000 7f9f1c49a9c0 20 started zone id=d9e72d30-c60b-4d0d-9267-fdc36392d5ad (name=default) with tier type = 2024-09-14T11:33:32.201 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:32.202+0000 7f9f1c49a9c0 20 add_watcher() i=0 2024-09-14T11:33:32.201 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:32.202+0000 7f9f1c49a9c0 20 add_watcher() i=1 2024-09-14T11:33:32.201 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:32.202+0000 7f9f1c49a9c0 20 add_watcher() i=2 2024-09-14T11:33:32.201 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:32.202+0000 7f9f1c49a9c0 20 add_watcher() i=3 2024-09-14T11:33:32.201 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:32.202+0000 7f9f1c49a9c0 20 add_watcher() i=4 2024-09-14T11:33:32.201 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:32.202+0000 7f9f1c49a9c0 20 add_watcher() i=5 2024-09-14T11:33:32.202 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:32.202+0000 7f9f1c49a9c0 20 add_watcher() i=6 2024-09-14T11:33:32.202 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:32.206+0000 7f9f1c49a9c0 20 add_watcher() i=7 2024-09-14T11:33:32.202 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:32.206+0000 7f9f1c49a9c0 2 all 8 watchers are set, enabling cache 2024-09-14T11:33:32.205 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:32.206+0000 7f9dcb7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:33:32.205 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:32.206+0000 7f9f1c49a9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:33:32.206 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:32.206+0000 7f9f1c49a9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:33:32.206 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:32.206+0000 7f9f1c49a9c0 5 note: GC not initialized 2024-09-14T11:33:32.206 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:32.210+0000 7f9dca7fc640 20 reqs_thread_entry: start 2024-09-14T11:33:32.206 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:32.210+0000 7f9f1c49a9c0 20 init_complete bucket index max shards: 11 2024-09-14T11:33:32.207 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:32.210+0000 7f9f1c49a9c0 20 Filter name: none 2024-09-14T11:33:32.207 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:32.210+0000 7f9d3bfff640 20 reqs_thread_entry: start 2024-09-14T11:33:32.207 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:32.210+0000 7f9f1c49a9c0 20 processing logshard = reshard.0000000000 2024-09-14T11:33:32.212 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:32.214+0000 7f9f1c49a9c0 20 finish processing logshard = reshard.0000000000 , ret = 0 2024-09-14T11:33:32.212 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:32.214+0000 7f9f1c49a9c0 20 processing logshard = reshard.0000000001 2024-09-14T11:33:32.216 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:32.218+0000 7f9f1c49a9c0 20 finish processing logshard = reshard.0000000001 , ret = 0 2024-09-14T11:33:32.216 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:32.218+0000 7f9f1c49a9c0 20 processing logshard = reshard.0000000002 2024-09-14T11:33:32.221 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:32.222+0000 7f9f1c49a9c0 20 finish processing logshard = reshard.0000000002 , ret = 0 2024-09-14T11:33:32.221 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:32.222+0000 7f9f1c49a9c0 20 processing logshard = reshard.0000000003 2024-09-14T11:33:32.226 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:32.226+0000 7f9f1c49a9c0 20 finish processing logshard = reshard.0000000003 , ret = 0 2024-09-14T11:33:32.226 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:32.226+0000 7f9f1c49a9c0 20 processing logshard = reshard.0000000004 2024-09-14T11:33:32.232 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:32.234+0000 7f9f1c49a9c0 20 finish processing logshard = reshard.0000000004 , ret = 0 2024-09-14T11:33:32.232 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:32.234+0000 7f9f1c49a9c0 20 processing logshard = reshard.0000000005 2024-09-14T11:33:32.237 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:32.238+0000 7f9f1c49a9c0 20 finish processing logshard = reshard.0000000005 , ret = 0 2024-09-14T11:33:32.237 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:32.238+0000 7f9f1c49a9c0 20 processing logshard = reshard.0000000006 2024-09-14T11:33:32.240 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:32.242+0000 7f9f1c49a9c0 20 process_entry resharding a-bucket 2024-09-14T11:33:32.240 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:32.242+0000 7f9f1c49a9c0 10 cache get: name=default.rgw.meta+root+a-bucket : miss 2024-09-14T11:33:32.240 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:32.242+0000 7f9f1c49a9c0 20 rados->read ofs=0 len=0 2024-09-14T11:33:32.241 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:32.242+0000 7f9f1c49a9c0 20 rados_obj.operate() r=0 bl.length=176 2024-09-14T11:33:32.241 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:32.242+0000 7f9f1c49a9c0 10 cache put: name=default.rgw.meta+root+a-bucket info.flags=0x1 2024-09-14T11:33:32.241 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:32.242+0000 7f9f1c49a9c0 10 adding default.rgw.meta+root+a-bucket to cache LRU end 2024-09-14T11:33:32.241 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:32.242+0000 7f9f1c49a9c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.17 : miss 2024-09-14T11:33:32.241 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:32.242+0000 7f9f1c49a9c0 20 rados->read ofs=0 len=0 2024-09-14T11:33:32.242 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:32.242+0000 7f9f1c49a9c0 20 rados_obj.operate() r=0 bl.length=398 2024-09-14T11:33:32.242 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:32.242+0000 7f9f1c49a9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.17 info.flags=0x17 2024-09-14T11:33:32.242 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:32.242+0000 7f9f1c49a9c0 10 adding default.rgw.meta+root+.bucket.meta.a-bucket:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.17 to cache LRU end 2024-09-14T11:33:32.242 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:32.242+0000 7f9f1c49a9c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:33:32.242 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:32.242+0000 7f9f1c49a9c0 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-14T11:33:32.242 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:32.242+0000 7f9f1c49a9c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.17 2024-09-14T11:33:32.254 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:32.254+0000 7f9f1c49a9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.17 info.flags=0x17 2024-09-14T11:33:32.254 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:32.254+0000 7f9f1c49a9c0 10 moving default.rgw.meta+root+.bucket.meta.a-bucket:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.17 to cache LRU end 2024-09-14T11:33:32.254 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:32.254+0000 7f9f1c49a9c0 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-14T11:33:32.254 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:32.254+0000 7f9f1c49a9c0 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.a-bucket:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.17, ofs0, ns] 2024-09-14T11:33:32.255 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:32.258+0000 7f9dfcff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366180 cookie 94574283068256 notifier 5985 bl.length()=827 2024-09-14T11:33:32.255 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:32.258+0000 7f9dfcff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.17 info.flags=0x17 2024-09-14T11:33:32.255 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:32.258+0000 7f9dfcff9640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.a-bucket:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.17 to cache LRU end 2024-09-14T11:33:32.255 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:32.258+0000 7f9dfcff9640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=143 2024-09-14T11:33:32.258 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:32.258+0000 7f9f1c49a9c0 20 handle_bi_update(): bucket=:a-bucket[d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.17]): orig_sources= new_sources= 2024-09-14T11:33:32.258 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:32.258+0000 7f9f1c49a9c0 20 handle_bi_update(): bucket=:a-bucket[d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.17]): potential sources added=[] removed=[] 2024-09-14T11:33:32.258 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:32.258+0000 7f9f1c49a9c0 20 handle_bi_update(): bucket=:a-bucket[d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.17]): orig_dests= new_dests= 2024-09-14T11:33:32.258 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:32.258+0000 7f9f1c49a9c0 20 handle_bi_update(): bucket=:a-bucket[d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.17]): potential dests added=[] removed=[] 2024-09-14T11:33:32.270 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:32.270+0000 7f9f1c49a9c0 10 bucket_obj is .dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.17.1.0 2024-09-14T11:33:32.270 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:32.270+0000 7f9f1c49a9c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.17.1.0 2024-09-14T11:33:32.270 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:32.270+0000 7f9f1c49a9c0 10 bucket_obj is .dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.17.1.1 2024-09-14T11:33:32.270 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:32.270+0000 7f9f1c49a9c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.17.1.1 2024-09-14T11:33:32.270 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:32.270+0000 7f9f1c49a9c0 10 bucket_obj is .dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.17.1.2 2024-09-14T11:33:32.270 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:32.270+0000 7f9f1c49a9c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.17.1.2 2024-09-14T11:33:32.270 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:32.270+0000 7f9f1c49a9c0 10 bucket_obj is .dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.17.1.3 2024-09-14T11:33:32.270 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:32.270+0000 7f9f1c49a9c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.17.1.3 2024-09-14T11:33:32.270 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:32.270+0000 7f9f1c49a9c0 10 bucket_obj is .dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.17.1.4 2024-09-14T11:33:32.270 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:32.270+0000 7f9f1c49a9c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.17.1.4 2024-09-14T11:33:32.271 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:32.270+0000 7f9f1c49a9c0 10 bucket_obj is .dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.17.1.5 2024-09-14T11:33:32.271 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:32.270+0000 7f9f1c49a9c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.17.1.5 2024-09-14T11:33:32.271 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:32.270+0000 7f9f1c49a9c0 10 bucket_obj is .dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.17.1.6 2024-09-14T11:33:32.271 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:32.270+0000 7f9f1c49a9c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.17.1.6 2024-09-14T11:33:32.271 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:32.270+0000 7f9f1c49a9c0 10 bucket_obj is .dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.17.1.7 2024-09-14T11:33:32.271 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:32.270+0000 7f9f1c49a9c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.17.1.7 2024-09-14T11:33:32.271 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:32.270+0000 7f9f1c49a9c0 10 bucket_obj is .dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.17.1.8 2024-09-14T11:33:32.271 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:32.270+0000 7f9f1c49a9c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.17.1.8 2024-09-14T11:33:32.271 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:32.270+0000 7f9f1c49a9c0 10 bucket_obj is .dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.17.1.9 2024-09-14T11:33:32.271 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:32.270+0000 7f9f1c49a9c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.17.1.9 2024-09-14T11:33:32.271 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:32.270+0000 7f9f1c49a9c0 10 bucket_obj is .dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.17.1.10 2024-09-14T11:33:32.271 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:32.270+0000 7f9f1c49a9c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.17.1.10 2024-09-14T11:33:32.271 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:32.270+0000 7f9f1c49a9c0 10 bucket_obj is .dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.17.1.11 2024-09-14T11:33:32.271 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:32.270+0000 7f9f1c49a9c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.17.1.11 2024-09-14T11:33:32.271 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:32.270+0000 7f9f1c49a9c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.17.0 2024-09-14T11:33:32.272 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:32.274+0000 7f9f1c49a9c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.17.1 2024-09-14T11:33:32.272 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:32.274+0000 7f9f1c49a9c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.17.2 2024-09-14T11:33:32.273 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:32.274+0000 7f9f1c49a9c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.17.3 2024-09-14T11:33:32.274 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:32.274+0000 7f9f1c49a9c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.17.4 2024-09-14T11:33:32.274 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:32.278+0000 7f9f1c49a9c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.17.5 2024-09-14T11:33:32.275 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:32.278+0000 7f9f1c49a9c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.17.6 2024-09-14T11:33:32.276 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:32.278+0000 7f9f1c49a9c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.17.7 2024-09-14T11:33:32.276 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:32.278+0000 7f9f1c49a9c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.17.8 2024-09-14T11:33:32.277 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:32.278+0000 7f9f1c49a9c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.17.9 2024-09-14T11:33:32.278 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:32.282+0000 7f9f1c49a9c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.17.10 2024-09-14T11:33:32.280 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:32.282+0000 7f9f1c49a9c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.17 : hit (requested=0x17, cached=0x17) 2024-09-14T11:33:32.280 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:32.282+0000 7f9f1c49a9c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.17 2024-09-14T11:33:32.283 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:32.286+0000 7f9f1c49a9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.17 info.flags=0x17 2024-09-14T11:33:32.283 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:32.286+0000 7f9f1c49a9c0 10 moving default.rgw.meta+root+.bucket.meta.a-bucket:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.17 to cache LRU end 2024-09-14T11:33:32.283 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:32.286+0000 7f9f1c49a9c0 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-14T11:33:32.283 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:32.286+0000 7f9f1c49a9c0 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.a-bucket:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.17, ofs0, ns] 2024-09-14T11:33:32.283 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:32.286+0000 7f9dfcff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366181 cookie 94574283068256 notifier 5985 bl.length()=827 2024-09-14T11:33:32.284 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:32.286+0000 7f9dfcff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.17 info.flags=0x17 2024-09-14T11:33:32.284 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:32.286+0000 7f9dfcff9640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.a-bucket:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.17 to cache LRU end 2024-09-14T11:33:32.284 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:32.286+0000 7f9dfcff9640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=143 2024-09-14T11:33:32.286 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:32.286+0000 7f9f1c49a9c0 20 handle_bi_update(): bucket=:a-bucket[d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.17]): orig_sources= new_sources= 2024-09-14T11:33:32.286 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:32.286+0000 7f9f1c49a9c0 20 handle_bi_update(): bucket=:a-bucket[d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.17]): potential sources added=[] removed=[] 2024-09-14T11:33:32.286 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:32.286+0000 7f9f1c49a9c0 20 handle_bi_update(): bucket=:a-bucket[d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.17]): orig_dests= new_dests= 2024-09-14T11:33:32.286 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:32.286+0000 7f9f1c49a9c0 20 handle_bi_update(): bucket=:a-bucket[d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.17]): potential dests added=[] removed=[] 2024-09-14T11:33:32.291 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:32.294+0000 7f9f1c49a9c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.17.0 2024-09-14T11:33:32.292 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:32.294+0000 7f9f1c49a9c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.17.1 2024-09-14T11:33:32.293 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:32.294+0000 7f9f1c49a9c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.17.2 2024-09-14T11:33:32.294 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:32.294+0000 7f9f1c49a9c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.17.3 2024-09-14T11:33:32.295 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:32.298+0000 7f9f1c49a9c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.17.4 2024-09-14T11:33:32.295 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:32.298+0000 7f9f1c49a9c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.17.5 2024-09-14T11:33:32.296 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:32.298+0000 7f9f1c49a9c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.17.6 2024-09-14T11:33:32.296 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:32.298+0000 7f9f1c49a9c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.17.7 2024-09-14T11:33:32.297 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:32.298+0000 7f9f1c49a9c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.17.8 2024-09-14T11:33:32.298 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:32.298+0000 7f9f1c49a9c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.17.9 2024-09-14T11:33:32.298 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:32.302+0000 7f9f1c49a9c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.17.10 2024-09-14T11:33:32.299 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:32.302+0000 7f9f1c49a9c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.17 : hit (requested=0x17, cached=0x17) 2024-09-14T11:33:32.300 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:32.302+0000 7f9f1c49a9c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.17 2024-09-14T11:33:32.302 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:32.302+0000 7f9f1c49a9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.17 info.flags=0x17 2024-09-14T11:33:32.302 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:32.302+0000 7f9f1c49a9c0 10 moving default.rgw.meta+root+.bucket.meta.a-bucket:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.17 to cache LRU end 2024-09-14T11:33:32.302 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:32.302+0000 7f9f1c49a9c0 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-14T11:33:32.302 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:32.302+0000 7f9f1c49a9c0 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.a-bucket:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.17, ofs0, ns] 2024-09-14T11:33:32.302 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:32.306+0000 7f9dfcff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366182 cookie 94574283068256 notifier 5985 bl.length()=795 2024-09-14T11:33:32.302 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:32.306+0000 7f9dfcff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.17 info.flags=0x17 2024-09-14T11:33:32.302 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:32.306+0000 7f9dfcff9640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.a-bucket:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.17 to cache LRU end 2024-09-14T11:33:32.303 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:32.306+0000 7f9dfcff9640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=143 2024-09-14T11:33:32.305 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:32.306+0000 7f9f1c49a9c0 20 handle_bi_update(): bucket=:a-bucket[d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.17]): orig_sources= new_sources= 2024-09-14T11:33:32.305 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:32.306+0000 7f9f1c49a9c0 20 handle_bi_update(): bucket=:a-bucket[d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.17]): potential sources added=[] removed=[] 2024-09-14T11:33:32.305 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:32.306+0000 7f9f1c49a9c0 20 handle_bi_update(): bucket=:a-bucket[d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.17]): orig_dests= new_dests= 2024-09-14T11:33:32.305 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:32.306+0000 7f9f1c49a9c0 20 handle_bi_update(): bucket=:a-bucket[d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.17]): potential dests added=[] removed=[] 2024-09-14T11:33:32.310 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:32.314+0000 7f9f1c49a9c0 1 execute INFO: reshard of bucket "a-bucket" from 11 shards to 12 shards completed successfully 2024-09-14T11:33:32.312 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:32.314+0000 7f9f1c49a9c0 20 process_entry removing reshard queue entry for bucket a-bucket 2024-09-14T11:33:32.317 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:32.318+0000 7f9f1c49a9c0 20 finish processing logshard = reshard.0000000006 , ret = 0 2024-09-14T11:33:32.317 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:32.318+0000 7f9f1c49a9c0 20 processing logshard = reshard.0000000007 2024-09-14T11:33:32.321 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:32.322+0000 7f9f1c49a9c0 20 finish processing logshard = reshard.0000000007 , ret = 0 2024-09-14T11:33:32.321 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:32.322+0000 7f9f1c49a9c0 20 processing logshard = reshard.0000000008 2024-09-14T11:33:32.326 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:32.330+0000 7f9f1c49a9c0 20 finish processing logshard = reshard.0000000008 , ret = 0 2024-09-14T11:33:32.326 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:32.330+0000 7f9f1c49a9c0 20 processing logshard = reshard.0000000009 2024-09-14T11:33:32.334 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:32.334+0000 7f9f1c49a9c0 20 finish processing logshard = reshard.0000000009 , ret = 0 2024-09-14T11:33:32.334 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:32.334+0000 7f9f1c49a9c0 20 processing logshard = reshard.0000000010 2024-09-14T11:33:32.337 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:32.338+0000 7f9f1c49a9c0 20 finish processing logshard = reshard.0000000010 , ret = 0 2024-09-14T11:33:32.337 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:32.338+0000 7f9f1c49a9c0 20 processing logshard = reshard.0000000011 2024-09-14T11:33:32.341 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:32.342+0000 7f9f1c49a9c0 20 finish processing logshard = reshard.0000000011 , ret = 0 2024-09-14T11:33:32.341 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:32.342+0000 7f9f1c49a9c0 20 processing logshard = reshard.0000000012 2024-09-14T11:33:32.348 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:32.350+0000 7f9f1c49a9c0 20 finish processing logshard = reshard.0000000012 , ret = 0 2024-09-14T11:33:32.348 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:32.350+0000 7f9f1c49a9c0 20 processing logshard = reshard.0000000013 2024-09-14T11:33:32.353 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:32.354+0000 7f9f1c49a9c0 20 finish processing logshard = reshard.0000000013 , ret = 0 2024-09-14T11:33:32.353 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:32.354+0000 7f9f1c49a9c0 20 processing logshard = reshard.0000000014 2024-09-14T11:33:32.356 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:32.358+0000 7f9f1c49a9c0 20 finish processing logshard = reshard.0000000014 , ret = 0 2024-09-14T11:33:32.356 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:32.358+0000 7f9f1c49a9c0 20 processing logshard = reshard.0000000015 2024-09-14T11:33:32.362 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:32.366+0000 7f9f1c49a9c0 20 finish processing logshard = reshard.0000000015 , ret = 0 2024-09-14T11:33:32.363 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:32.366+0000 7f9dcb7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:33:32.369 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:32.370+0000 7f9f1c49a9c0 20 remove_watcher() i=0 2024-09-14T11:33:32.369 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:32.370+0000 7f9f1c49a9c0 2 removed watcher, disabling cache 2024-09-14T11:33:32.371 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:32.374+0000 7f9f1c49a9c0 20 remove_watcher() i=1 2024-09-14T11:33:32.373 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:32.374+0000 7f9f1c49a9c0 20 remove_watcher() i=2 2024-09-14T11:33:32.375 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:32.378+0000 7f9f1c49a9c0 20 remove_watcher() i=3 2024-09-14T11:33:32.377 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:32.378+0000 7f9f1c49a9c0 20 remove_watcher() i=4 2024-09-14T11:33:32.379 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:32.382+0000 7f9f1c49a9c0 20 remove_watcher() i=5 2024-09-14T11:33:32.381 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:32.382+0000 7f9f1c49a9c0 20 remove_watcher() i=6 2024-09-14T11:33:32.382 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:32.386+0000 7f9f1c49a9c0 20 remove_watcher() i=7 2024-09-14T11:33:37.405 INFO:tasks.workunit.client.0.smithi138.stderr:radosgw-admin bucket stats --bucket a-bucket 2024-09-14T11:33:37.438 INFO:tasks.workunit.client.0.smithi138.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:33:37.438 INFO:tasks.workunit.client.0.smithi138.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:33:37.484 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:37.486+0000 7f325e7f49c0 20 rados->read ofs=0 len=0 2024-09-14T11:33:37.486 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:37.486+0000 7f325e7f49c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:33:37.486 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:37.486+0000 7f325e7f49c0 20 realm 2024-09-14T11:33:37.486 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:37.486+0000 7f325e7f49c0 20 rados->read ofs=0 len=0 2024-09-14T11:33:37.486 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:37.486+0000 7f325e7f49c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:33:37.486 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:37.486+0000 7f325e7f49c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:33:37.486 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:37.486+0000 7f325e7f49c0 20 rados->read ofs=0 len=0 2024-09-14T11:33:37.486 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:37.486+0000 7f325e7f49c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:33:37.486 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:37.486+0000 7f325e7f49c0 20 rados->read ofs=0 len=0 2024-09-14T11:33:37.488 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:37.490+0000 7f325e7f49c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:33:37.488 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:37.490+0000 7f325e7f49c0 20 rados->read ofs=0 len=0 2024-09-14T11:33:37.488 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:37.490+0000 7f325e7f49c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:33:37.489 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:37.490+0000 7f325e7f49c0 20 searching for the correct realm 2024-09-14T11:33:37.492 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:37.494+0000 7f325cafb640 0 -- 172.21.15.138:0/3088090499 >> [v2:172.21.15.154:6824/416768175,v1:172.21.15.154:6825/416768175] conn(0x7f324c0d1070 msgr2=0x7f324c0e1980 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:33:37.501 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:37.502+0000 7f325baf9640 0 -- 172.21.15.138:0/3088090499 >> [v2:172.21.15.138:6816/326481658,v1:172.21.15.138:6817/326481658] conn(0x7f324c0f3940 msgr2=0x7f324c0d2400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:33:37.718 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:37.718+0000 7f325e7f49c0 20 RGWRados::pool_iterate: got zone_info.d9e72d30-c60b-4d0d-9267-fdc36392d5ad 2024-09-14T11:33:37.718 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:37.718+0000 7f325e7f49c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:33:37.718 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:37.718+0000 7f325e7f49c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:33:37.718 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:37.718+0000 7f325e7f49c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:33:37.718 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:37.718+0000 7f325e7f49c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:33:37.718 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:37.718+0000 7f325e7f49c0 20 RGWRados::pool_iterate: got zonegroup_info.65ab941b-da8c-4160-94fb-3672b069d44f 2024-09-14T11:33:37.718 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:37.718+0000 7f325e7f49c0 20 rados->read ofs=0 len=0 2024-09-14T11:33:37.719 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:37.718+0000 7f325e7f49c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:33:37.719 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:37.718+0000 7f325e7f49c0 20 rados->read ofs=0 len=0 2024-09-14T11:33:37.719 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:37.722+0000 7f325e7f49c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:33:37.719 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:37.722+0000 7f325e7f49c0 20 rados->read ofs=0 len=0 2024-09-14T11:33:37.720 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:37.722+0000 7f325e7f49c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:33:37.720 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:37.722+0000 7f325e7f49c0 20 zone default found 2024-09-14T11:33:37.720 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:37.722+0000 7f325e7f49c0 4 Realm: () 2024-09-14T11:33:37.720 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:37.722+0000 7f325e7f49c0 4 ZoneGroup: default (65ab941b-da8c-4160-94fb-3672b069d44f) 2024-09-14T11:33:37.720 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:37.722+0000 7f325e7f49c0 4 Zone: default (d9e72d30-c60b-4d0d-9267-fdc36392d5ad) 2024-09-14T11:33:37.721 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:37.722+0000 7f325e7f49c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:33:37.721 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:37.722+0000 7f325e7f49c0 20 zonegroup default 2024-09-14T11:33:37.721 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:37.722+0000 7f325e7f49c0 20 rados->read ofs=0 len=0 2024-09-14T11:33:37.721 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:37.722+0000 7f325e7f49c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:33:37.721 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:37.722+0000 7f325e7f49c0 20 rados->read ofs=0 len=0 2024-09-14T11:33:37.721 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:37.722+0000 7f325e7f49c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:33:37.722 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:37.722+0000 7f325e7f49c0 20 rados->read ofs=0 len=0 2024-09-14T11:33:37.722 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:37.726+0000 7f325e7f49c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:33:37.722 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:37.726+0000 7f325e7f49c0 20 started sync module instance, tier type = 2024-09-14T11:33:37.722 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:37.726+0000 7f325e7f49c0 20 started zone id=d9e72d30-c60b-4d0d-9267-fdc36392d5ad (name=default) with tier type = 2024-09-14T11:33:37.747 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:37.750+0000 7f325e7f49c0 20 add_watcher() i=0 2024-09-14T11:33:37.747 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:37.750+0000 7f325e7f49c0 20 add_watcher() i=1 2024-09-14T11:33:37.747 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:37.750+0000 7f325e7f49c0 20 add_watcher() i=2 2024-09-14T11:33:37.747 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:37.750+0000 7f325e7f49c0 20 add_watcher() i=3 2024-09-14T11:33:37.747 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:37.750+0000 7f325e7f49c0 20 add_watcher() i=4 2024-09-14T11:33:37.747 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:37.750+0000 7f325e7f49c0 20 add_watcher() i=5 2024-09-14T11:33:37.747 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:37.750+0000 7f325e7f49c0 20 add_watcher() i=6 2024-09-14T11:33:37.749 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:37.750+0000 7f325e7f49c0 20 add_watcher() i=7 2024-09-14T11:33:37.749 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:37.750+0000 7f325e7f49c0 2 all 8 watchers are set, enabling cache 2024-09-14T11:33:37.753 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:37.754+0000 7f3112fdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:33:37.754 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:37.754+0000 7f325e7f49c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:33:37.754 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:37.754+0000 7f325e7f49c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:33:37.754 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:37.754+0000 7f325e7f49c0 5 note: GC not initialized 2024-09-14T11:33:37.755 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:37.758+0000 7f3111fdb640 20 reqs_thread_entry: start 2024-09-14T11:33:37.755 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:37.758+0000 7f325e7f49c0 20 init_complete bucket index max shards: 11 2024-09-14T11:33:37.755 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:37.758+0000 7f325e7f49c0 20 Filter name: none 2024-09-14T11:33:37.755 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:37.758+0000 7f30837fe640 20 reqs_thread_entry: start 2024-09-14T11:33:37.755 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:37.758+0000 7f325e7f49c0 20 rados->read ofs=0 len=0 2024-09-14T11:33:37.756 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:37.758+0000 7f325e7f49c0 20 rados_obj.operate() r=0 bl.length=176 2024-09-14T11:33:37.756 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:37.758+0000 7f325e7f49c0 20 rados->read ofs=0 len=0 2024-09-14T11:33:37.757 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:37.758+0000 7f325e7f49c0 20 rados_obj.operate() r=0 bl.length=398 2024-09-14T11:33:37.757 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:37.758+0000 7f325e7f49c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:33:37.757 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:37.758+0000 7f325e7f49c0 20 rados->read ofs=0 len=0 2024-09-14T11:33:37.759 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:37.762+0000 7f325e7f49c0 20 rados_obj.operate() r=0 bl.length=176 2024-09-14T11:33:37.759 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:37.762+0000 7f325e7f49c0 20 rados->read ofs=0 len=0 2024-09-14T11:33:37.759 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:37.762+0000 7f325e7f49c0 20 rados_obj.operate() r=0 bl.length=398 2024-09-14T11:33:37.759 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:37.762+0000 7f325e7f49c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:33:37.762 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:37.766+0000 7f3112fdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:33:37.767 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:37.770+0000 7f325e7f49c0 20 remove_watcher() i=0 2024-09-14T11:33:37.767 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:37.770+0000 7f325e7f49c0 2 removed watcher, disabling cache 2024-09-14T11:33:37.770 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:37.770+0000 7f325e7f49c0 20 remove_watcher() i=1 2024-09-14T11:33:37.772 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:37.774+0000 7f325e7f49c0 20 remove_watcher() i=2 2024-09-14T11:33:37.774 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:37.774+0000 7f325e7f49c0 20 remove_watcher() i=3 2024-09-14T11:33:37.776 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:37.778+0000 7f325e7f49c0 20 remove_watcher() i=4 2024-09-14T11:33:37.777 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:37.778+0000 7f325e7f49c0 20 remove_watcher() i=5 2024-09-14T11:33:37.779 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:37.782+0000 7f325e7f49c0 20 remove_watcher() i=6 2024-09-14T11:33:37.781 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:37.782+0000 7f325e7f49c0 20 remove_watcher() i=7 2024-09-14T11:33:37.796 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-14T11:33:37.796 INFO:tasks.workunit.client.0.smithi138.stderr:BUCKET_STATS: 2024-09-14T11:33:37.796 INFO:tasks.workunit.client.0.smithi138.stderr:bucket: a-bucket id: d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.17 num_objects: 0 size_kb: 0 num_shards: 12 2024-09-14T11:33:37.796 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-14T11:33:37.796 INFO:tasks.workunit.client.0.smithi138.stderr:TEST: reshard add non empty bucket 2024-09-14T11:33:37.796 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-14T11:33:37.802 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:33:37.802 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-14T11:33:37.859 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:33:37.859 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-14T11:33:37.940 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:33:37.940 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-14T11:33:38.031 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:33:38.031 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-14T11:33:38.119 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:33:38.119 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-14T11:33:38.202 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:33:38.202 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-14T11:33:38.293 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:33:38.293 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-14T11:33:38.383 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:33:38.384 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-14T11:33:38.459 INFO:tasks.workunit.client.0.smithi138.stderr:radosgw-admin bucket stats --bucket a-bucket 2024-09-14T11:33:38.489 INFO:tasks.workunit.client.0.smithi138.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:33:38.489 INFO:tasks.workunit.client.0.smithi138.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:33:38.536 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:38.538+0000 7fbd0551f9c0 20 rados->read ofs=0 len=0 2024-09-14T11:33:38.538 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:38.538+0000 7fbd0551f9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:33:38.538 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:38.538+0000 7fbd0551f9c0 20 realm 2024-09-14T11:33:38.538 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:38.538+0000 7fbd0551f9c0 20 rados->read ofs=0 len=0 2024-09-14T11:33:38.538 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:38.542+0000 7fbd0551f9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:33:38.538 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:38.542+0000 7fbd0551f9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:33:38.538 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:38.542+0000 7fbd0551f9c0 20 rados->read ofs=0 len=0 2024-09-14T11:33:38.539 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:38.542+0000 7fbd0551f9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:33:38.539 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:38.542+0000 7fbd0551f9c0 20 rados->read ofs=0 len=0 2024-09-14T11:33:38.540 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:38.542+0000 7fbd0551f9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:33:38.540 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:38.542+0000 7fbd0551f9c0 20 rados->read ofs=0 len=0 2024-09-14T11:33:38.541 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:38.542+0000 7fbd0551f9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:33:38.541 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:38.542+0000 7fbd0551f9c0 20 searching for the correct realm 2024-09-14T11:33:38.544 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:38.546+0000 7fbd03826640 0 -- 172.21.15.138:0/73209461 >> [v2:172.21.15.154:6824/416768175,v1:172.21.15.154:6825/416768175] conn(0x7fbcfc0f7530 msgr2=0x7fbcfc101730 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:33:38.758 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:38.762+0000 7fbd02824640 0 -- 172.21.15.138:0/73209461 >> [v2:172.21.15.138:6816/326481658,v1:172.21.15.138:6817/326481658] conn(0x7fbcfc0f91f0 msgr2=0x7fbcfc12c670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-14T11:33:38.977 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:38.978+0000 7fbd0551f9c0 20 RGWRados::pool_iterate: got zone_info.d9e72d30-c60b-4d0d-9267-fdc36392d5ad 2024-09-14T11:33:38.977 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:38.978+0000 7fbd0551f9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:33:38.977 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:38.978+0000 7fbd0551f9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:33:38.977 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:38.978+0000 7fbd0551f9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:33:38.977 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:38.978+0000 7fbd0551f9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:33:38.977 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:38.978+0000 7fbd0551f9c0 20 RGWRados::pool_iterate: got zonegroup_info.65ab941b-da8c-4160-94fb-3672b069d44f 2024-09-14T11:33:38.977 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:38.978+0000 7fbd0551f9c0 20 rados->read ofs=0 len=0 2024-09-14T11:33:38.978 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:38.978+0000 7fbd0551f9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:33:38.978 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:38.978+0000 7fbd0551f9c0 20 rados->read ofs=0 len=0 2024-09-14T11:33:38.979 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:38.982+0000 7fbd0551f9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:33:38.979 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:38.982+0000 7fbd0551f9c0 20 rados->read ofs=0 len=0 2024-09-14T11:33:38.980 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:38.982+0000 7fbd0551f9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:33:38.980 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:38.982+0000 7fbd0551f9c0 20 zone default found 2024-09-14T11:33:38.980 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:38.982+0000 7fbd0551f9c0 4 Realm: () 2024-09-14T11:33:38.980 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:38.982+0000 7fbd0551f9c0 4 ZoneGroup: default (65ab941b-da8c-4160-94fb-3672b069d44f) 2024-09-14T11:33:38.980 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:38.982+0000 7fbd0551f9c0 4 Zone: default (d9e72d30-c60b-4d0d-9267-fdc36392d5ad) 2024-09-14T11:33:38.980 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:38.982+0000 7fbd0551f9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:33:38.980 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:38.982+0000 7fbd0551f9c0 20 zonegroup default 2024-09-14T11:33:38.980 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:38.982+0000 7fbd0551f9c0 20 rados->read ofs=0 len=0 2024-09-14T11:33:38.981 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:38.982+0000 7fbd0551f9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:33:38.981 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:38.982+0000 7fbd0551f9c0 20 rados->read ofs=0 len=0 2024-09-14T11:33:38.981 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:38.982+0000 7fbd0551f9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:33:38.981 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:38.982+0000 7fbd0551f9c0 20 rados->read ofs=0 len=0 2024-09-14T11:33:38.982 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:38.986+0000 7fbd0551f9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:33:38.982 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:38.986+0000 7fbd0551f9c0 20 started sync module instance, tier type = 2024-09-14T11:33:38.982 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:38.986+0000 7fbd0551f9c0 20 started zone id=d9e72d30-c60b-4d0d-9267-fdc36392d5ad (name=default) with tier type = 2024-09-14T11:33:39.006 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:39.010+0000 7fbd0551f9c0 20 add_watcher() i=0 2024-09-14T11:33:39.006 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:39.010+0000 7fbd0551f9c0 20 add_watcher() i=1 2024-09-14T11:33:39.006 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:39.010+0000 7fbd0551f9c0 20 add_watcher() i=2 2024-09-14T11:33:39.006 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:39.010+0000 7fbd0551f9c0 20 add_watcher() i=3 2024-09-14T11:33:39.006 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:39.010+0000 7fbd0551f9c0 20 add_watcher() i=4 2024-09-14T11:33:39.007 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:39.010+0000 7fbd0551f9c0 20 add_watcher() i=5 2024-09-14T11:33:39.007 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:39.010+0000 7fbd0551f9c0 20 add_watcher() i=6 2024-09-14T11:33:39.009 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:39.010+0000 7fbd0551f9c0 20 add_watcher() i=7 2024-09-14T11:33:39.009 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:39.010+0000 7fbd0551f9c0 2 all 8 watchers are set, enabling cache 2024-09-14T11:33:39.013 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:39.014+0000 7fbbb9fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:33:39.014 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:39.014+0000 7fbd0551f9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:33:39.014 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:39.014+0000 7fbd0551f9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:33:39.014 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:39.014+0000 7fbd0551f9c0 5 note: GC not initialized 2024-09-14T11:33:39.014 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:39.018+0000 7fbbb8fe1640 20 reqs_thread_entry: start 2024-09-14T11:33:39.014 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:39.018+0000 7fbd0551f9c0 20 init_complete bucket index max shards: 11 2024-09-14T11:33:39.015 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:39.018+0000 7fbd0551f9c0 20 Filter name: none 2024-09-14T11:33:39.015 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:39.018+0000 7fbb327fc640 20 reqs_thread_entry: start 2024-09-14T11:33:39.015 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:39.018+0000 7fbd0551f9c0 20 rados->read ofs=0 len=0 2024-09-14T11:33:39.016 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:39.018+0000 7fbd0551f9c0 20 rados_obj.operate() r=0 bl.length=176 2024-09-14T11:33:39.016 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:39.018+0000 7fbd0551f9c0 20 rados->read ofs=0 len=0 2024-09-14T11:33:39.017 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:39.018+0000 7fbd0551f9c0 20 rados_obj.operate() r=0 bl.length=398 2024-09-14T11:33:39.017 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:39.018+0000 7fbd0551f9c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:33:39.017 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:39.018+0000 7fbd0551f9c0 20 rados->read ofs=0 len=0 2024-09-14T11:33:39.018 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:39.018+0000 7fbd0551f9c0 20 rados_obj.operate() r=0 bl.length=176 2024-09-14T11:33:39.018 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:39.018+0000 7fbd0551f9c0 20 rados->read ofs=0 len=0 2024-09-14T11:33:39.018 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:39.022+0000 7fbd0551f9c0 20 rados_obj.operate() r=0 bl.length=398 2024-09-14T11:33:39.018 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:39.022+0000 7fbd0551f9c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:33:39.022 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:39.026+0000 7fbbb9fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:33:39.028 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:39.030+0000 7fbd0551f9c0 20 remove_watcher() i=0 2024-09-14T11:33:39.028 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:39.030+0000 7fbd0551f9c0 2 removed watcher, disabling cache 2024-09-14T11:33:39.030 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:39.030+0000 7fbd0551f9c0 20 remove_watcher() i=1 2024-09-14T11:33:39.032 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:39.034+0000 7fbd0551f9c0 20 remove_watcher() i=2 2024-09-14T11:33:39.034 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:39.038+0000 7fbd0551f9c0 20 remove_watcher() i=3 2024-09-14T11:33:39.036 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:39.038+0000 7fbd0551f9c0 20 remove_watcher() i=4 2024-09-14T11:33:39.039 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:39.042+0000 7fbd0551f9c0 20 remove_watcher() i=5 2024-09-14T11:33:39.040 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:39.042+0000 7fbd0551f9c0 20 remove_watcher() i=6 2024-09-14T11:33:39.042 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:39.042+0000 7fbd0551f9c0 20 remove_watcher() i=7 2024-09-14T11:33:39.063 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-14T11:33:39.063 INFO:tasks.workunit.client.0.smithi138.stderr:BUCKET_STATS: 2024-09-14T11:33:39.063 INFO:tasks.workunit.client.0.smithi138.stderr:bucket: a-bucket id: d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.17 num_objects: 8 size_kb: 1 num_shards: 12 2024-09-14T11:33:39.063 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-14T11:33:39.063 INFO:tasks.workunit.client.0.smithi138.stderr:radosgw-admin reshard add --bucket a-bucket --num-shards 13 2024-09-14T11:33:39.098 INFO:tasks.workunit.client.0.smithi138.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:33:39.098 INFO:tasks.workunit.client.0.smithi138.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:33:39.145 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:39.146+0000 7f43094f29c0 20 rados->read ofs=0 len=0 2024-09-14T11:33:39.146 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:39.150+0000 7f43094f29c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:33:39.146 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:39.150+0000 7f43094f29c0 20 realm 2024-09-14T11:33:39.146 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:39.150+0000 7f43094f29c0 20 rados->read ofs=0 len=0 2024-09-14T11:33:39.146 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:39.150+0000 7f43094f29c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:33:39.147 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:39.150+0000 7f43094f29c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:33:39.147 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:39.150+0000 7f43094f29c0 20 rados->read ofs=0 len=0 2024-09-14T11:33:39.147 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:39.150+0000 7f43094f29c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:33:39.147 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:39.150+0000 7f43094f29c0 20 rados->read ofs=0 len=0 2024-09-14T11:33:39.148 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:39.150+0000 7f43094f29c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:33:39.148 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:39.150+0000 7f43094f29c0 20 rados->read ofs=0 len=0 2024-09-14T11:33:39.149 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:39.150+0000 7f43094f29c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:33:39.149 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:39.150+0000 7f43094f29c0 20 searching for the correct realm 2024-09-14T11:33:39.152 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:39.154+0000 7f43077f9640 0 -- 172.21.15.138:0/326619787 >> [v2:172.21.15.154:6824/416768175,v1:172.21.15.154:6825/416768175] conn(0x7f4300015030 msgr2=0x7f430006f450 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:33:39.367 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:39.370+0000 7f43067f7640 0 -- 172.21.15.138:0/326619787 >> [v2:172.21.15.138:6816/326481658,v1:172.21.15.138:6817/326481658] conn(0x7f4300020bb0 msgr2=0x7f430009c9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-14T11:33:39.585 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:39.586+0000 7f43094f29c0 20 RGWRados::pool_iterate: got zone_info.d9e72d30-c60b-4d0d-9267-fdc36392d5ad 2024-09-14T11:33:39.585 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:39.586+0000 7f43094f29c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:33:39.585 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:39.586+0000 7f43094f29c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:33:39.585 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:39.586+0000 7f43094f29c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:33:39.585 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:39.586+0000 7f43094f29c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:33:39.585 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:39.586+0000 7f43094f29c0 20 RGWRados::pool_iterate: got zonegroup_info.65ab941b-da8c-4160-94fb-3672b069d44f 2024-09-14T11:33:39.585 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:39.586+0000 7f43094f29c0 20 rados->read ofs=0 len=0 2024-09-14T11:33:39.586 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:39.586+0000 7f43094f29c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:33:39.586 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:39.586+0000 7f43094f29c0 20 rados->read ofs=0 len=0 2024-09-14T11:33:39.586 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:39.590+0000 7f43094f29c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:33:39.586 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:39.590+0000 7f43094f29c0 20 rados->read ofs=0 len=0 2024-09-14T11:33:39.587 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:39.590+0000 7f43094f29c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:33:39.588 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:39.590+0000 7f43094f29c0 20 zone default found 2024-09-14T11:33:39.588 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:39.590+0000 7f43094f29c0 4 Realm: () 2024-09-14T11:33:39.588 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:39.590+0000 7f43094f29c0 4 ZoneGroup: default (65ab941b-da8c-4160-94fb-3672b069d44f) 2024-09-14T11:33:39.588 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:39.590+0000 7f43094f29c0 4 Zone: default (d9e72d30-c60b-4d0d-9267-fdc36392d5ad) 2024-09-14T11:33:39.588 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:39.590+0000 7f43094f29c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:33:39.588 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:39.590+0000 7f43094f29c0 20 zonegroup default 2024-09-14T11:33:39.588 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:39.590+0000 7f43094f29c0 20 rados->read ofs=0 len=0 2024-09-14T11:33:39.589 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:39.590+0000 7f43094f29c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:33:39.589 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:39.590+0000 7f43094f29c0 20 rados->read ofs=0 len=0 2024-09-14T11:33:39.589 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:39.590+0000 7f43094f29c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:33:39.589 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:39.590+0000 7f43094f29c0 20 rados->read ofs=0 len=0 2024-09-14T11:33:39.590 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:39.590+0000 7f43094f29c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:33:39.590 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:39.590+0000 7f43094f29c0 20 started sync module instance, tier type = 2024-09-14T11:33:39.590 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:39.590+0000 7f43094f29c0 20 started zone id=d9e72d30-c60b-4d0d-9267-fdc36392d5ad (name=default) with tier type = 2024-09-14T11:33:39.615 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:39.618+0000 7f43094f29c0 20 add_watcher() i=0 2024-09-14T11:33:39.615 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:39.618+0000 7f43094f29c0 20 add_watcher() i=1 2024-09-14T11:33:39.615 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:39.618+0000 7f43094f29c0 20 add_watcher() i=2 2024-09-14T11:33:39.615 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:39.618+0000 7f43094f29c0 20 add_watcher() i=3 2024-09-14T11:33:39.615 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:39.618+0000 7f43094f29c0 20 add_watcher() i=4 2024-09-14T11:33:39.615 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:39.618+0000 7f43094f29c0 20 add_watcher() i=5 2024-09-14T11:33:39.615 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:39.618+0000 7f43094f29c0 20 add_watcher() i=6 2024-09-14T11:33:39.617 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:39.618+0000 7f43094f29c0 20 add_watcher() i=7 2024-09-14T11:33:39.617 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:39.618+0000 7f43094f29c0 2 all 8 watchers are set, enabling cache 2024-09-14T11:33:39.621 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:39.622+0000 7f41bd7e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:33:39.622 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:39.626+0000 7f43094f29c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:33:39.622 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:39.626+0000 7f43094f29c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:33:39.622 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:39.626+0000 7f43094f29c0 5 note: GC not initialized 2024-09-14T11:33:39.623 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:39.626+0000 7f4137fff640 20 reqs_thread_entry: start 2024-09-14T11:33:39.623 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:39.626+0000 7f43094f29c0 20 init_complete bucket index max shards: 11 2024-09-14T11:33:39.623 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:39.626+0000 7f43094f29c0 20 Filter name: none 2024-09-14T11:33:39.623 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:39.626+0000 7f4135ffb640 20 reqs_thread_entry: start 2024-09-14T11:33:39.623 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:39.626+0000 7f43094f29c0 10 cache get: name=default.rgw.meta+root+a-bucket : miss 2024-09-14T11:33:39.624 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:39.626+0000 7f43094f29c0 20 rados->read ofs=0 len=0 2024-09-14T11:33:39.625 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:39.626+0000 7f43094f29c0 20 rados_obj.operate() r=0 bl.length=176 2024-09-14T11:33:39.625 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:39.626+0000 7f43094f29c0 10 cache put: name=default.rgw.meta+root+a-bucket info.flags=0x11 2024-09-14T11:33:39.625 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:39.626+0000 7f43094f29c0 10 adding default.rgw.meta+root+a-bucket to cache LRU end 2024-09-14T11:33:39.625 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:39.626+0000 7f43094f29c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.17 : miss 2024-09-14T11:33:39.625 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:39.626+0000 7f43094f29c0 20 rados->read ofs=0 len=0 2024-09-14T11:33:39.626 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:39.626+0000 7f43094f29c0 20 rados_obj.operate() r=0 bl.length=398 2024-09-14T11:33:39.626 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:39.626+0000 7f43094f29c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.17 info.flags=0x17 2024-09-14T11:33:39.626 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:39.626+0000 7f43094f29c0 10 adding default.rgw.meta+root+.bucket.meta.a-bucket:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.17 to cache LRU end 2024-09-14T11:33:39.626 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:39.626+0000 7f43094f29c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:33:39.626 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:39.626+0000 7f43094f29c0 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-14T11:33:39.626 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:39.626+0000 7f43094f29c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.17 2024-09-14T11:33:39.629 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:39.630+0000 7f41bd7e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:33:39.634 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:39.638+0000 7f43094f29c0 20 remove_watcher() i=0 2024-09-14T11:33:39.634 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:39.638+0000 7f43094f29c0 2 removed watcher, disabling cache 2024-09-14T11:33:39.637 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:39.638+0000 7f43094f29c0 20 remove_watcher() i=1 2024-09-14T11:33:39.639 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:39.642+0000 7f43094f29c0 20 remove_watcher() i=2 2024-09-14T11:33:39.641 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:39.642+0000 7f43094f29c0 20 remove_watcher() i=3 2024-09-14T11:33:39.643 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:39.646+0000 7f43094f29c0 20 remove_watcher() i=4 2024-09-14T11:33:39.645 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:39.646+0000 7f43094f29c0 20 remove_watcher() i=5 2024-09-14T11:33:39.646 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:39.650+0000 7f43094f29c0 20 remove_watcher() i=6 2024-09-14T11:33:39.648 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:39.650+0000 7f43094f29c0 20 remove_watcher() i=7 2024-09-14T11:33:39.668 INFO:tasks.workunit.client.0.smithi138.stderr:radosgw-admin reshard list 2024-09-14T11:33:39.697 INFO:tasks.workunit.client.0.smithi138.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:33:39.697 INFO:tasks.workunit.client.0.smithi138.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:33:39.743 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:39.746+0000 7f6f40fd89c0 20 rados->read ofs=0 len=0 2024-09-14T11:33:39.745 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:39.746+0000 7f6f40fd89c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:33:39.745 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:39.746+0000 7f6f40fd89c0 20 realm 2024-09-14T11:33:39.745 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:39.746+0000 7f6f40fd89c0 20 rados->read ofs=0 len=0 2024-09-14T11:33:39.745 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:39.746+0000 7f6f40fd89c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:33:39.745 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:39.746+0000 7f6f40fd89c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:33:39.745 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:39.746+0000 7f6f40fd89c0 20 rados->read ofs=0 len=0 2024-09-14T11:33:39.745 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:39.746+0000 7f6f40fd89c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:33:39.745 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:39.746+0000 7f6f40fd89c0 20 rados->read ofs=0 len=0 2024-09-14T11:33:39.747 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:39.750+0000 7f6f40fd89c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:33:39.747 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:39.750+0000 7f6f40fd89c0 20 rados->read ofs=0 len=0 2024-09-14T11:33:39.747 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:39.750+0000 7f6f40fd89c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:33:39.747 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:39.750+0000 7f6f40fd89c0 20 searching for the correct realm 2024-09-14T11:33:39.751 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:39.754+0000 7f6f3f2df640 0 -- 172.21.15.138:0/1680203143 >> [v2:172.21.15.154:6824/416768175,v1:172.21.15.154:6825/416768175] conn(0x7f6f38017070 msgr2=0x7f6f3806a150 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:33:39.967 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:39.970+0000 7f6f3e2dd640 0 -- 172.21.15.138:0/1680203143 >> [v2:172.21.15.138:6816/326481658,v1:172.21.15.138:6817/326481658] conn(0x7f6f3807bbb0 msgr2=0x7f6f3809a940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-14T11:33:40.186 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:40.186+0000 7f6f40fd89c0 20 RGWRados::pool_iterate: got zone_info.d9e72d30-c60b-4d0d-9267-fdc36392d5ad 2024-09-14T11:33:40.186 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:40.186+0000 7f6f40fd89c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:33:40.186 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:40.186+0000 7f6f40fd89c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:33:40.186 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:40.186+0000 7f6f40fd89c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:33:40.186 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:40.186+0000 7f6f40fd89c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:33:40.186 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:40.186+0000 7f6f40fd89c0 20 RGWRados::pool_iterate: got zonegroup_info.65ab941b-da8c-4160-94fb-3672b069d44f 2024-09-14T11:33:40.186 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:40.186+0000 7f6f40fd89c0 20 rados->read ofs=0 len=0 2024-09-14T11:33:40.187 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:40.190+0000 7f6f40fd89c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:33:40.187 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:40.190+0000 7f6f40fd89c0 20 rados->read ofs=0 len=0 2024-09-14T11:33:40.187 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:40.190+0000 7f6f40fd89c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:33:40.187 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:40.190+0000 7f6f40fd89c0 20 rados->read ofs=0 len=0 2024-09-14T11:33:40.188 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:40.190+0000 7f6f40fd89c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:33:40.189 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:40.190+0000 7f6f40fd89c0 20 zone default found 2024-09-14T11:33:40.189 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:40.190+0000 7f6f40fd89c0 4 Realm: () 2024-09-14T11:33:40.189 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:40.190+0000 7f6f40fd89c0 4 ZoneGroup: default (65ab941b-da8c-4160-94fb-3672b069d44f) 2024-09-14T11:33:40.189 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:40.190+0000 7f6f40fd89c0 4 Zone: default (d9e72d30-c60b-4d0d-9267-fdc36392d5ad) 2024-09-14T11:33:40.189 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:40.190+0000 7f6f40fd89c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:33:40.189 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:40.190+0000 7f6f40fd89c0 20 zonegroup default 2024-09-14T11:33:40.189 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:40.190+0000 7f6f40fd89c0 20 rados->read ofs=0 len=0 2024-09-14T11:33:40.190 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:40.190+0000 7f6f40fd89c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:33:40.190 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:40.190+0000 7f6f40fd89c0 20 rados->read ofs=0 len=0 2024-09-14T11:33:40.190 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:40.190+0000 7f6f40fd89c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:33:40.190 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:40.194+0000 7f6f40fd89c0 20 rados->read ofs=0 len=0 2024-09-14T11:33:40.191 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:40.194+0000 7f6f40fd89c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:33:40.191 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:40.194+0000 7f6f40fd89c0 20 started sync module instance, tier type = 2024-09-14T11:33:40.191 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:40.194+0000 7f6f40fd89c0 20 started zone id=d9e72d30-c60b-4d0d-9267-fdc36392d5ad (name=default) with tier type = 2024-09-14T11:33:40.215 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:40.218+0000 7f6f40fd89c0 20 add_watcher() i=0 2024-09-14T11:33:40.216 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:40.218+0000 7f6f40fd89c0 20 add_watcher() i=1 2024-09-14T11:33:40.216 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:40.218+0000 7f6f40fd89c0 20 add_watcher() i=2 2024-09-14T11:33:40.216 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:40.218+0000 7f6f40fd89c0 20 add_watcher() i=3 2024-09-14T11:33:40.216 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:40.218+0000 7f6f40fd89c0 20 add_watcher() i=4 2024-09-14T11:33:40.216 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:40.218+0000 7f6f40fd89c0 20 add_watcher() i=5 2024-09-14T11:33:40.216 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:40.218+0000 7f6f40fd89c0 20 add_watcher() i=6 2024-09-14T11:33:40.218 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:40.218+0000 7f6f40fd89c0 20 add_watcher() i=7 2024-09-14T11:33:40.218 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:40.218+0000 7f6f40fd89c0 2 all 8 watchers are set, enabling cache 2024-09-14T11:33:40.222 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:40.222+0000 7f6df57e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:33:40.223 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:40.226+0000 7f6f40fd89c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:33:40.223 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:40.226+0000 7f6f40fd89c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:33:40.223 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:40.226+0000 7f6f40fd89c0 5 note: GC not initialized 2024-09-14T11:33:40.224 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:40.226+0000 7f6d6ffff640 20 reqs_thread_entry: start 2024-09-14T11:33:40.224 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:40.226+0000 7f6f40fd89c0 20 init_complete bucket index max shards: 11 2024-09-14T11:33:40.224 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:40.226+0000 7f6f40fd89c0 20 Filter name: none 2024-09-14T11:33:40.224 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:40.226+0000 7f6d6dffb640 20 reqs_thread_entry: start 2024-09-14T11:33:40.236 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:40.238+0000 7f6df57e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:33:40.241 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:40.242+0000 7f6f40fd89c0 20 remove_watcher() i=0 2024-09-14T11:33:40.241 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:40.242+0000 7f6f40fd89c0 2 removed watcher, disabling cache 2024-09-14T11:33:40.243 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:40.246+0000 7f6f40fd89c0 20 remove_watcher() i=1 2024-09-14T11:33:40.246 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:40.246+0000 7f6f40fd89c0 20 remove_watcher() i=2 2024-09-14T11:33:40.248 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:40.250+0000 7f6f40fd89c0 20 remove_watcher() i=3 2024-09-14T11:33:40.250 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:40.254+0000 7f6f40fd89c0 20 remove_watcher() i=4 2024-09-14T11:33:40.252 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:40.254+0000 7f6f40fd89c0 20 remove_watcher() i=5 2024-09-14T11:33:40.254 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:40.258+0000 7f6f40fd89c0 20 remove_watcher() i=6 2024-09-14T11:33:40.255 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:40.258+0000 7f6f40fd89c0 20 remove_watcher() i=7 2024-09-14T11:33:40.274 INFO:tasks.workunit.client.0.smithi138.stderr:bucket name a-bucket 2024-09-14T11:33:40.274 INFO:tasks.workunit.client.0.smithi138.stderr:TEST: reshard process non empty bucket 2024-09-14T11:33:40.274 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-14T11:33:40.274 INFO:tasks.workunit.client.0.smithi138.stderr:radosgw-admin reshard process 2024-09-14T11:33:40.302 INFO:tasks.workunit.client.0.smithi138.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:33:40.303 INFO:tasks.workunit.client.0.smithi138.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:33:40.347 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:40.350+0000 7fa1de4eb9c0 20 rados->read ofs=0 len=0 2024-09-14T11:33:40.349 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:40.350+0000 7fa1de4eb9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:33:40.349 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:40.350+0000 7fa1de4eb9c0 20 realm 2024-09-14T11:33:40.349 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:40.350+0000 7fa1de4eb9c0 20 rados->read ofs=0 len=0 2024-09-14T11:33:40.349 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:40.350+0000 7fa1de4eb9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:33:40.349 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:40.350+0000 7fa1de4eb9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:33:40.349 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:40.350+0000 7fa1de4eb9c0 20 rados->read ofs=0 len=0 2024-09-14T11:33:40.350 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:40.350+0000 7fa1de4eb9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:33:40.350 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:40.350+0000 7fa1de4eb9c0 20 rados->read ofs=0 len=0 2024-09-14T11:33:40.351 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:40.354+0000 7fa1de4eb9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:33:40.351 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:40.354+0000 7fa1de4eb9c0 20 rados->read ofs=0 len=0 2024-09-14T11:33:40.352 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:40.354+0000 7fa1de4eb9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:33:40.352 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:40.354+0000 7fa1de4eb9c0 20 searching for the correct realm 2024-09-14T11:33:40.355 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:40.358+0000 7fa1dc7f2640 0 -- 172.21.15.138:0/445318617 >> [v2:172.21.15.154:6824/416768175,v1:172.21.15.154:6825/416768175] conn(0x7fa1d40d9060 msgr2=0x7fa1d40ae400 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:33:40.571 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:40.574+0000 7fa1db7f0640 0 -- 172.21.15.138:0/445318617 >> [v2:172.21.15.138:6816/326481658,v1:172.21.15.138:6817/326481658] conn(0x7fa1d4133bc0 msgr2=0x7fa1d4106fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:33:40.790 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:40.790+0000 7fa1de4eb9c0 20 RGWRados::pool_iterate: got zone_info.d9e72d30-c60b-4d0d-9267-fdc36392d5ad 2024-09-14T11:33:40.790 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:40.790+0000 7fa1de4eb9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:33:40.790 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:40.790+0000 7fa1de4eb9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:33:40.790 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:40.790+0000 7fa1de4eb9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:33:40.790 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:40.790+0000 7fa1de4eb9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:33:40.790 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:40.790+0000 7fa1de4eb9c0 20 RGWRados::pool_iterate: got zonegroup_info.65ab941b-da8c-4160-94fb-3672b069d44f 2024-09-14T11:33:40.790 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:40.790+0000 7fa1de4eb9c0 20 rados->read ofs=0 len=0 2024-09-14T11:33:40.791 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:40.794+0000 7fa1de4eb9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:33:40.791 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:40.794+0000 7fa1de4eb9c0 20 rados->read ofs=0 len=0 2024-09-14T11:33:40.791 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:40.794+0000 7fa1de4eb9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:33:40.791 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:40.794+0000 7fa1de4eb9c0 20 rados->read ofs=0 len=0 2024-09-14T11:33:40.792 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:40.794+0000 7fa1de4eb9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:33:40.792 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:40.794+0000 7fa1de4eb9c0 20 zone default found 2024-09-14T11:33:40.792 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:40.794+0000 7fa1de4eb9c0 4 Realm: () 2024-09-14T11:33:40.792 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:40.794+0000 7fa1de4eb9c0 4 ZoneGroup: default (65ab941b-da8c-4160-94fb-3672b069d44f) 2024-09-14T11:33:40.792 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:40.794+0000 7fa1de4eb9c0 4 Zone: default (d9e72d30-c60b-4d0d-9267-fdc36392d5ad) 2024-09-14T11:33:40.793 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:40.794+0000 7fa1de4eb9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:33:40.793 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:40.794+0000 7fa1de4eb9c0 20 zonegroup default 2024-09-14T11:33:40.793 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:40.794+0000 7fa1de4eb9c0 20 rados->read ofs=0 len=0 2024-09-14T11:33:40.793 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:40.794+0000 7fa1de4eb9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:33:40.793 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:40.794+0000 7fa1de4eb9c0 20 rados->read ofs=0 len=0 2024-09-14T11:33:40.794 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:40.798+0000 7fa1de4eb9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:33:40.794 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:40.798+0000 7fa1de4eb9c0 20 rados->read ofs=0 len=0 2024-09-14T11:33:40.795 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:40.798+0000 7fa1de4eb9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:33:40.795 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:40.798+0000 7fa1de4eb9c0 20 started sync module instance, tier type = 2024-09-14T11:33:40.795 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:40.798+0000 7fa1de4eb9c0 20 started zone id=d9e72d30-c60b-4d0d-9267-fdc36392d5ad (name=default) with tier type = 2024-09-14T11:33:40.816 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:40.818+0000 7fa1de4eb9c0 20 add_watcher() i=0 2024-09-14T11:33:40.816 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:40.818+0000 7fa1de4eb9c0 20 add_watcher() i=1 2024-09-14T11:33:40.816 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:40.818+0000 7fa1de4eb9c0 20 add_watcher() i=2 2024-09-14T11:33:40.816 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:40.818+0000 7fa1de4eb9c0 20 add_watcher() i=3 2024-09-14T11:33:40.816 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:40.818+0000 7fa1de4eb9c0 20 add_watcher() i=4 2024-09-14T11:33:40.816 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:40.818+0000 7fa1de4eb9c0 20 add_watcher() i=5 2024-09-14T11:33:40.816 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:40.818+0000 7fa1de4eb9c0 20 add_watcher() i=6 2024-09-14T11:33:40.818 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:40.822+0000 7fa1de4eb9c0 20 add_watcher() i=7 2024-09-14T11:33:40.818 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:40.822+0000 7fa1de4eb9c0 2 all 8 watchers are set, enabling cache 2024-09-14T11:33:40.822 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:40.822+0000 7fa091fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:33:40.822 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:40.826+0000 7fa1de4eb9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:33:40.822 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:40.826+0000 7fa1de4eb9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:33:40.822 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:40.826+0000 7fa1de4eb9c0 5 note: GC not initialized 2024-09-14T11:33:40.823 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:40.826+0000 7fa090fe1640 20 reqs_thread_entry: start 2024-09-14T11:33:40.823 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:40.826+0000 7fa1de4eb9c0 20 init_complete bucket index max shards: 11 2024-09-14T11:33:40.823 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:40.826+0000 7fa1de4eb9c0 20 Filter name: none 2024-09-14T11:33:40.823 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:40.826+0000 7fa00a7fc640 20 reqs_thread_entry: start 2024-09-14T11:33:40.823 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:40.826+0000 7fa1de4eb9c0 20 processing logshard = reshard.0000000000 2024-09-14T11:33:40.829 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:40.830+0000 7fa1de4eb9c0 20 finish processing logshard = reshard.0000000000 , ret = 0 2024-09-14T11:33:40.829 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:40.830+0000 7fa1de4eb9c0 20 processing logshard = reshard.0000000001 2024-09-14T11:33:40.833 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:40.834+0000 7fa1de4eb9c0 20 finish processing logshard = reshard.0000000001 , ret = 0 2024-09-14T11:33:40.833 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:40.834+0000 7fa1de4eb9c0 20 processing logshard = reshard.0000000002 2024-09-14T11:33:40.838 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:40.842+0000 7fa1de4eb9c0 20 finish processing logshard = reshard.0000000002 , ret = 0 2024-09-14T11:33:40.838 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:40.842+0000 7fa1de4eb9c0 20 processing logshard = reshard.0000000003 2024-09-14T11:33:40.843 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:40.846+0000 7fa1de4eb9c0 20 finish processing logshard = reshard.0000000003 , ret = 0 2024-09-14T11:33:40.843 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:40.846+0000 7fa1de4eb9c0 20 processing logshard = reshard.0000000004 2024-09-14T11:33:40.849 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:40.850+0000 7fa1de4eb9c0 20 finish processing logshard = reshard.0000000004 , ret = 0 2024-09-14T11:33:40.849 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:40.850+0000 7fa1de4eb9c0 20 processing logshard = reshard.0000000005 2024-09-14T11:33:40.854 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:40.858+0000 7fa1de4eb9c0 20 finish processing logshard = reshard.0000000005 , ret = 0 2024-09-14T11:33:40.854 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:40.858+0000 7fa1de4eb9c0 20 processing logshard = reshard.0000000006 2024-09-14T11:33:40.857 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:40.858+0000 7fa1de4eb9c0 20 process_entry resharding a-bucket 2024-09-14T11:33:40.857 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:40.858+0000 7fa1de4eb9c0 10 cache get: name=default.rgw.meta+root+a-bucket : miss 2024-09-14T11:33:40.858 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:40.858+0000 7fa1de4eb9c0 20 rados->read ofs=0 len=0 2024-09-14T11:33:40.858 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:40.862+0000 7fa1de4eb9c0 20 rados_obj.operate() r=0 bl.length=176 2024-09-14T11:33:40.858 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:40.862+0000 7fa1de4eb9c0 10 cache put: name=default.rgw.meta+root+a-bucket info.flags=0x1 2024-09-14T11:33:40.858 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:40.862+0000 7fa1de4eb9c0 10 adding default.rgw.meta+root+a-bucket to cache LRU end 2024-09-14T11:33:40.858 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:40.862+0000 7fa1de4eb9c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.17 : miss 2024-09-14T11:33:40.859 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:40.862+0000 7fa1de4eb9c0 20 rados->read ofs=0 len=0 2024-09-14T11:33:40.859 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:40.862+0000 7fa1de4eb9c0 20 rados_obj.operate() r=0 bl.length=398 2024-09-14T11:33:40.859 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:40.862+0000 7fa1de4eb9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.17 info.flags=0x17 2024-09-14T11:33:40.859 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:40.862+0000 7fa1de4eb9c0 10 adding default.rgw.meta+root+.bucket.meta.a-bucket:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.17 to cache LRU end 2024-09-14T11:33:40.859 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:40.862+0000 7fa1de4eb9c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:33:40.859 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:40.862+0000 7fa1de4eb9c0 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-14T11:33:40.860 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:40.862+0000 7fa1de4eb9c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.17 2024-09-14T11:33:40.872 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:40.874+0000 7fa1de4eb9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.17 info.flags=0x17 2024-09-14T11:33:40.872 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:40.874+0000 7fa1de4eb9c0 10 moving default.rgw.meta+root+.bucket.meta.a-bucket:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.17 to cache LRU end 2024-09-14T11:33:40.872 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:40.874+0000 7fa1de4eb9c0 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-14T11:33:40.872 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:40.874+0000 7fa1de4eb9c0 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.a-bucket:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.17, ofs0, ns] 2024-09-14T11:33:40.873 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:40.874+0000 7fa0baffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366183 cookie 94045009582512 notifier 6084 bl.length()=827 2024-09-14T11:33:40.873 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:40.874+0000 7fa0baffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.17 info.flags=0x17 2024-09-14T11:33:40.873 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:40.874+0000 7fa0baffd640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.a-bucket:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.17 to cache LRU end 2024-09-14T11:33:40.873 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:40.874+0000 7fa0baffd640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=143 2024-09-14T11:33:40.875 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:40.878+0000 7fa1de4eb9c0 20 handle_bi_update(): bucket=:a-bucket[d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.17]): orig_sources= new_sources= 2024-09-14T11:33:40.875 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:40.878+0000 7fa1de4eb9c0 20 handle_bi_update(): bucket=:a-bucket[d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.17]): potential sources added=[] removed=[] 2024-09-14T11:33:40.876 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:40.878+0000 7fa1de4eb9c0 20 handle_bi_update(): bucket=:a-bucket[d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.17]): orig_dests= new_dests= 2024-09-14T11:33:40.876 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:40.878+0000 7fa1de4eb9c0 20 handle_bi_update(): bucket=:a-bucket[d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.17]): potential dests added=[] removed=[] 2024-09-14T11:33:40.886 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:40.890+0000 7fa1de4eb9c0 10 bucket_obj is .dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.17.2.0 2024-09-14T11:33:40.887 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:40.890+0000 7fa1de4eb9c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.17.2.0 2024-09-14T11:33:40.887 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:40.890+0000 7fa1de4eb9c0 10 bucket_obj is .dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.17.2.1 2024-09-14T11:33:40.887 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:40.890+0000 7fa1de4eb9c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.17.2.1 2024-09-14T11:33:40.887 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:40.890+0000 7fa1de4eb9c0 10 bucket_obj is .dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.17.2.2 2024-09-14T11:33:40.887 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:40.890+0000 7fa1de4eb9c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.17.2.2 2024-09-14T11:33:40.887 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:40.890+0000 7fa1de4eb9c0 10 bucket_obj is .dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.17.2.3 2024-09-14T11:33:40.887 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:40.890+0000 7fa1de4eb9c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.17.2.3 2024-09-14T11:33:40.887 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:40.890+0000 7fa1de4eb9c0 10 bucket_obj is .dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.17.2.4 2024-09-14T11:33:40.887 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:40.890+0000 7fa1de4eb9c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.17.2.4 2024-09-14T11:33:40.887 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:40.890+0000 7fa1de4eb9c0 10 bucket_obj is .dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.17.2.5 2024-09-14T11:33:40.887 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:40.890+0000 7fa1de4eb9c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.17.2.5 2024-09-14T11:33:40.887 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:40.890+0000 7fa1de4eb9c0 10 bucket_obj is .dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.17.2.6 2024-09-14T11:33:40.887 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:40.890+0000 7fa1de4eb9c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.17.2.6 2024-09-14T11:33:40.888 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:40.890+0000 7fa1de4eb9c0 10 bucket_obj is .dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.17.2.7 2024-09-14T11:33:40.888 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:40.890+0000 7fa1de4eb9c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.17.2.7 2024-09-14T11:33:40.888 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:40.890+0000 7fa1de4eb9c0 10 bucket_obj is .dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.17.2.8 2024-09-14T11:33:40.888 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:40.890+0000 7fa1de4eb9c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.17.2.8 2024-09-14T11:33:40.888 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:40.890+0000 7fa1de4eb9c0 10 bucket_obj is .dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.17.2.9 2024-09-14T11:33:40.888 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:40.890+0000 7fa1de4eb9c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.17.2.9 2024-09-14T11:33:40.888 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:40.890+0000 7fa1de4eb9c0 10 bucket_obj is .dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.17.2.10 2024-09-14T11:33:40.888 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:40.890+0000 7fa1de4eb9c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.17.2.10 2024-09-14T11:33:40.888 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:40.890+0000 7fa1de4eb9c0 10 bucket_obj is .dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.17.2.11 2024-09-14T11:33:40.888 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:40.890+0000 7fa1de4eb9c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.17.2.11 2024-09-14T11:33:40.888 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:40.890+0000 7fa1de4eb9c0 10 bucket_obj is .dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.17.2.12 2024-09-14T11:33:40.888 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:40.890+0000 7fa1de4eb9c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.17.2.12 2024-09-14T11:33:40.888 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:40.890+0000 7fa1de4eb9c0 10 bucket_obj is .dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.17.1.0 2024-09-14T11:33:40.889 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:40.890+0000 7fa1de4eb9c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.17.1.0 2024-09-14T11:33:40.889 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:40.890+0000 7fa1de4eb9c0 10 bucket_obj is .dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.17.1.1 2024-09-14T11:33:40.889 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:40.890+0000 7fa1de4eb9c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.17.1.1 2024-09-14T11:33:40.889 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:40.890+0000 7fa1de4eb9c0 10 bucket_obj is .dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.17.1.2 2024-09-14T11:33:40.889 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:40.890+0000 7fa1de4eb9c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.17.1.2 2024-09-14T11:33:40.889 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:40.890+0000 7fa1de4eb9c0 10 bucket_obj is .dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.17.1.3 2024-09-14T11:33:40.889 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:40.890+0000 7fa1de4eb9c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.17.1.3 2024-09-14T11:33:40.890 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:40.894+0000 7fa1de4eb9c0 10 bucket_obj is .dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.17.1.4 2024-09-14T11:33:40.890 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:40.894+0000 7fa1de4eb9c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.17.1.4 2024-09-14T11:33:40.892 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:40.894+0000 7fa1de4eb9c0 10 bucket_obj is .dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.17.1.5 2024-09-14T11:33:40.892 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:40.894+0000 7fa1de4eb9c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.17.1.5 2024-09-14T11:33:40.893 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:40.894+0000 7fa1de4eb9c0 10 bucket_obj is .dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.17.1.6 2024-09-14T11:33:40.893 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:40.894+0000 7fa1de4eb9c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.17.1.6 2024-09-14T11:33:40.894 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:40.894+0000 7fa1de4eb9c0 10 bucket_obj is .dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.17.1.7 2024-09-14T11:33:40.894 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:40.894+0000 7fa1de4eb9c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.17.1.7 2024-09-14T11:33:40.895 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:40.898+0000 7fa1de4eb9c0 10 bucket_obj is .dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.17.1.8 2024-09-14T11:33:40.895 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:40.898+0000 7fa1de4eb9c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.17.1.8 2024-09-14T11:33:40.896 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:40.898+0000 7fa1de4eb9c0 10 bucket_obj is .dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.17.1.9 2024-09-14T11:33:40.896 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:40.898+0000 7fa1de4eb9c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.17.1.9 2024-09-14T11:33:40.898 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:40.898+0000 7fa1de4eb9c0 10 bucket_obj is .dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.17.1.10 2024-09-14T11:33:40.898 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:40.898+0000 7fa1de4eb9c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.17.1.10 2024-09-14T11:33:40.898 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:40.902+0000 7fa1de4eb9c0 10 bucket_obj is .dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.17.1.11 2024-09-14T11:33:40.898 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:40.902+0000 7fa1de4eb9c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.17.1.11 2024-09-14T11:33:40.905 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:40.906+0000 7fa1de4eb9c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.17 : hit (requested=0x17, cached=0x17) 2024-09-14T11:33:40.905 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:40.906+0000 7fa1de4eb9c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.17 2024-09-14T11:33:40.907 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:40.910+0000 7fa1de4eb9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.17 info.flags=0x17 2024-09-14T11:33:40.907 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:40.910+0000 7fa1de4eb9c0 10 moving default.rgw.meta+root+.bucket.meta.a-bucket:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.17 to cache LRU end 2024-09-14T11:33:40.907 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:40.910+0000 7fa1de4eb9c0 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-14T11:33:40.907 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:40.910+0000 7fa1de4eb9c0 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.a-bucket:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.17, ofs0, ns] 2024-09-14T11:33:40.908 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:40.910+0000 7fa0ba7fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366184 cookie 94045009582512 notifier 6084 bl.length()=827 2024-09-14T11:33:40.908 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:40.910+0000 7fa0ba7fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.17 info.flags=0x17 2024-09-14T11:33:40.908 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:40.910+0000 7fa0ba7fc640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.a-bucket:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.17 to cache LRU end 2024-09-14T11:33:40.908 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:40.910+0000 7fa0ba7fc640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=143 2024-09-14T11:33:40.910 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:40.914+0000 7fa1de4eb9c0 20 handle_bi_update(): bucket=:a-bucket[d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.17]): orig_sources= new_sources= 2024-09-14T11:33:40.910 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:40.914+0000 7fa1de4eb9c0 20 handle_bi_update(): bucket=:a-bucket[d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.17]): potential sources added=[] removed=[] 2024-09-14T11:33:40.910 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:40.914+0000 7fa1de4eb9c0 20 handle_bi_update(): bucket=:a-bucket[d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.17]): orig_dests= new_dests= 2024-09-14T11:33:40.910 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:40.914+0000 7fa1de4eb9c0 20 handle_bi_update(): bucket=:a-bucket[d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.17]): potential dests added=[] removed=[] 2024-09-14T11:33:40.916 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:40.918+0000 7fa1de4eb9c0 10 bucket_obj is .dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.17.1.0 2024-09-14T11:33:40.916 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:40.918+0000 7fa1de4eb9c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.17.1.0 2024-09-14T11:33:40.917 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:40.918+0000 7fa1de4eb9c0 10 bucket_obj is .dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.17.1.1 2024-09-14T11:33:40.917 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:40.918+0000 7fa1de4eb9c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.17.1.1 2024-09-14T11:33:40.917 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:40.918+0000 7fa1de4eb9c0 10 bucket_obj is .dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.17.1.2 2024-09-14T11:33:40.917 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:40.918+0000 7fa1de4eb9c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.17.1.2 2024-09-14T11:33:40.918 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:40.922+0000 7fa1de4eb9c0 10 bucket_obj is .dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.17.1.3 2024-09-14T11:33:40.918 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:40.922+0000 7fa1de4eb9c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.17.1.3 2024-09-14T11:33:40.919 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:40.922+0000 7fa1de4eb9c0 10 bucket_obj is .dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.17.1.4 2024-09-14T11:33:40.919 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:40.922+0000 7fa1de4eb9c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.17.1.4 2024-09-14T11:33:40.920 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:40.922+0000 7fa1de4eb9c0 10 bucket_obj is .dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.17.1.5 2024-09-14T11:33:40.920 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:40.922+0000 7fa1de4eb9c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.17.1.5 2024-09-14T11:33:40.920 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:40.922+0000 7fa1de4eb9c0 10 bucket_obj is .dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.17.1.6 2024-09-14T11:33:40.920 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:40.922+0000 7fa1de4eb9c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.17.1.6 2024-09-14T11:33:40.921 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:40.922+0000 7fa1de4eb9c0 10 bucket_obj is .dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.17.1.7 2024-09-14T11:33:40.921 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:40.922+0000 7fa1de4eb9c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.17.1.7 2024-09-14T11:33:40.922 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:40.926+0000 7fa1de4eb9c0 10 bucket_obj is .dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.17.1.8 2024-09-14T11:33:40.922 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:40.926+0000 7fa1de4eb9c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.17.1.8 2024-09-14T11:33:40.923 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:40.926+0000 7fa1de4eb9c0 10 bucket_obj is .dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.17.1.9 2024-09-14T11:33:40.923 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:40.926+0000 7fa1de4eb9c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.17.1.9 2024-09-14T11:33:40.924 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:40.926+0000 7fa1de4eb9c0 10 bucket_obj is .dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.17.1.10 2024-09-14T11:33:40.924 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:40.926+0000 7fa1de4eb9c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.17.1.10 2024-09-14T11:33:40.924 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:40.926+0000 7fa1de4eb9c0 10 bucket_obj is .dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.17.1.11 2024-09-14T11:33:40.924 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:40.926+0000 7fa1de4eb9c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.17.1.11 2024-09-14T11:33:40.925 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:40.926+0000 7fa1de4eb9c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.17 : hit (requested=0x17, cached=0x17) 2024-09-14T11:33:40.925 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:40.926+0000 7fa1de4eb9c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.17 2024-09-14T11:33:40.929 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:40.930+0000 7fa1de4eb9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.17 info.flags=0x17 2024-09-14T11:33:40.929 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:40.930+0000 7fa1de4eb9c0 10 moving default.rgw.meta+root+.bucket.meta.a-bucket:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.17 to cache LRU end 2024-09-14T11:33:40.929 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:40.930+0000 7fa1de4eb9c0 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-14T11:33:40.929 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:40.930+0000 7fa1de4eb9c0 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.a-bucket:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.17, ofs0, ns] 2024-09-14T11:33:40.930 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:40.930+0000 7fa0baffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366185 cookie 94045009582512 notifier 6084 bl.length()=795 2024-09-14T11:33:40.930 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:40.930+0000 7fa0baffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.17 info.flags=0x17 2024-09-14T11:33:40.930 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:40.930+0000 7fa0baffd640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.a-bucket:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.17 to cache LRU end 2024-09-14T11:33:40.930 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:40.930+0000 7fa0baffd640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=143 2024-09-14T11:33:40.932 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:40.934+0000 7fa1de4eb9c0 20 handle_bi_update(): bucket=:a-bucket[d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.17]): orig_sources= new_sources= 2024-09-14T11:33:40.932 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:40.934+0000 7fa1de4eb9c0 20 handle_bi_update(): bucket=:a-bucket[d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.17]): potential sources added=[] removed=[] 2024-09-14T11:33:40.932 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:40.934+0000 7fa1de4eb9c0 20 handle_bi_update(): bucket=:a-bucket[d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.17]): orig_dests= new_dests= 2024-09-14T11:33:40.933 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:40.934+0000 7fa1de4eb9c0 20 handle_bi_update(): bucket=:a-bucket[d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.17]): potential dests added=[] removed=[] 2024-09-14T11:33:40.938 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:40.942+0000 7fa1de4eb9c0 1 execute INFO: reshard of bucket "a-bucket" from 12 shards to 13 shards completed successfully 2024-09-14T11:33:40.940 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:40.942+0000 7fa1de4eb9c0 20 process_entry removing reshard queue entry for bucket a-bucket 2024-09-14T11:33:40.945 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:40.946+0000 7fa1de4eb9c0 20 finish processing logshard = reshard.0000000006 , ret = 0 2024-09-14T11:33:40.945 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:40.946+0000 7fa1de4eb9c0 20 processing logshard = reshard.0000000007 2024-09-14T11:33:40.950 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:40.954+0000 7fa1de4eb9c0 20 finish processing logshard = reshard.0000000007 , ret = 0 2024-09-14T11:33:40.950 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:40.954+0000 7fa1de4eb9c0 20 processing logshard = reshard.0000000008 2024-09-14T11:33:40.955 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:40.958+0000 7fa1de4eb9c0 20 finish processing logshard = reshard.0000000008 , ret = 0 2024-09-14T11:33:40.956 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:40.958+0000 7fa1de4eb9c0 20 processing logshard = reshard.0000000009 2024-09-14T11:33:40.962 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:40.962+0000 7fa1de4eb9c0 20 finish processing logshard = reshard.0000000009 , ret = 0 2024-09-14T11:33:40.962 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:40.962+0000 7fa1de4eb9c0 20 processing logshard = reshard.0000000010 2024-09-14T11:33:40.966 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:40.966+0000 7fa1de4eb9c0 20 finish processing logshard = reshard.0000000010 , ret = 0 2024-09-14T11:33:40.966 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:40.966+0000 7fa1de4eb9c0 20 processing logshard = reshard.0000000011 2024-09-14T11:33:40.972 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:40.974+0000 7fa1de4eb9c0 20 finish processing logshard = reshard.0000000011 , ret = 0 2024-09-14T11:33:40.972 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:40.974+0000 7fa1de4eb9c0 20 processing logshard = reshard.0000000012 2024-09-14T11:33:40.981 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:40.982+0000 7fa1de4eb9c0 20 finish processing logshard = reshard.0000000012 , ret = 0 2024-09-14T11:33:40.981 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:40.982+0000 7fa1de4eb9c0 20 processing logshard = reshard.0000000013 2024-09-14T11:33:40.988 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:40.990+0000 7fa1de4eb9c0 20 finish processing logshard = reshard.0000000013 , ret = 0 2024-09-14T11:33:40.988 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:40.990+0000 7fa1de4eb9c0 20 processing logshard = reshard.0000000014 2024-09-14T11:33:40.993 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:40.994+0000 7fa1de4eb9c0 20 finish processing logshard = reshard.0000000014 , ret = 0 2024-09-14T11:33:40.993 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:40.994+0000 7fa1de4eb9c0 20 processing logshard = reshard.0000000015 2024-09-14T11:33:41.000 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:41.002+0000 7fa1de4eb9c0 20 finish processing logshard = reshard.0000000015 , ret = 0 2024-09-14T11:33:41.001 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:41.002+0000 7fa091fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:33:41.007 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:41.010+0000 7fa1de4eb9c0 20 remove_watcher() i=0 2024-09-14T11:33:41.007 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:41.010+0000 7fa1de4eb9c0 2 removed watcher, disabling cache 2024-09-14T11:33:41.009 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:41.010+0000 7fa1de4eb9c0 20 remove_watcher() i=1 2024-09-14T11:33:41.012 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:41.014+0000 7fa1de4eb9c0 20 remove_watcher() i=2 2024-09-14T11:33:41.015 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:41.018+0000 7fa1de4eb9c0 20 remove_watcher() i=3 2024-09-14T11:33:41.018 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:41.018+0000 7fa1de4eb9c0 20 remove_watcher() i=4 2024-09-14T11:33:41.020 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:41.022+0000 7fa1de4eb9c0 20 remove_watcher() i=5 2024-09-14T11:33:41.022 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:41.026+0000 7fa1de4eb9c0 20 remove_watcher() i=6 2024-09-14T11:33:41.024 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:41.026+0000 7fa1de4eb9c0 20 remove_watcher() i=7 2024-09-14T11:33:41.040 INFO:tasks.workunit.client.0.smithi138.stderr:radosgw-admin bucket stats --bucket a-bucket 2024-09-14T11:33:41.071 INFO:tasks.workunit.client.0.smithi138.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:33:41.071 INFO:tasks.workunit.client.0.smithi138.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:33:41.116 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:41.118+0000 7fd385eb99c0 20 rados->read ofs=0 len=0 2024-09-14T11:33:41.117 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:41.118+0000 7fd385eb99c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:33:41.118 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:41.118+0000 7fd385eb99c0 20 realm 2024-09-14T11:33:41.118 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:41.118+0000 7fd385eb99c0 20 rados->read ofs=0 len=0 2024-09-14T11:33:41.118 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:41.122+0000 7fd385eb99c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:33:41.118 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:41.122+0000 7fd385eb99c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:33:41.118 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:41.122+0000 7fd385eb99c0 20 rados->read ofs=0 len=0 2024-09-14T11:33:41.119 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:41.122+0000 7fd385eb99c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:33:41.119 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:41.122+0000 7fd385eb99c0 20 rados->read ofs=0 len=0 2024-09-14T11:33:41.120 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:41.122+0000 7fd385eb99c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:33:41.120 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:41.122+0000 7fd385eb99c0 20 rados->read ofs=0 len=0 2024-09-14T11:33:41.121 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:41.122+0000 7fd385eb99c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:33:41.121 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:41.122+0000 7fd385eb99c0 20 searching for the correct realm 2024-09-14T11:33:41.125 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:41.126+0000 7fd3841c0640 0 -- 172.21.15.138:0/4241803806 >> [v2:172.21.15.154:6824/416768175,v1:172.21.15.154:6825/416768175] conn(0x7fd37c026040 msgr2=0x7fd37c04f940 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:33:41.132 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:41.134+0000 7fd3831be640 0 -- 172.21.15.138:0/4241803806 >> [v2:172.21.15.138:6816/326481658,v1:172.21.15.138:6817/326481658] conn(0x7fd37c00e070 msgr2=0x7fd37c026420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-14T11:33:41.350 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:41.350+0000 7fd385eb99c0 20 RGWRados::pool_iterate: got zone_info.d9e72d30-c60b-4d0d-9267-fdc36392d5ad 2024-09-14T11:33:41.350 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:41.350+0000 7fd385eb99c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:33:41.350 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:41.350+0000 7fd385eb99c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:33:41.350 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:41.350+0000 7fd385eb99c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:33:41.350 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:41.350+0000 7fd385eb99c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:33:41.350 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:41.350+0000 7fd385eb99c0 20 RGWRados::pool_iterate: got zonegroup_info.65ab941b-da8c-4160-94fb-3672b069d44f 2024-09-14T11:33:41.350 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:41.350+0000 7fd385eb99c0 20 rados->read ofs=0 len=0 2024-09-14T11:33:41.351 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:41.350+0000 7fd385eb99c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:33:41.351 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:41.350+0000 7fd385eb99c0 20 rados->read ofs=0 len=0 2024-09-14T11:33:41.351 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:41.354+0000 7fd385eb99c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:33:41.351 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:41.354+0000 7fd385eb99c0 20 rados->read ofs=0 len=0 2024-09-14T11:33:41.352 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:41.354+0000 7fd385eb99c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:33:41.352 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:41.354+0000 7fd385eb99c0 20 zone default found 2024-09-14T11:33:41.352 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:41.354+0000 7fd385eb99c0 4 Realm: () 2024-09-14T11:33:41.352 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:41.354+0000 7fd385eb99c0 4 ZoneGroup: default (65ab941b-da8c-4160-94fb-3672b069d44f) 2024-09-14T11:33:41.352 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:41.354+0000 7fd385eb99c0 4 Zone: default (d9e72d30-c60b-4d0d-9267-fdc36392d5ad) 2024-09-14T11:33:41.352 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:41.354+0000 7fd385eb99c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:33:41.352 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:41.354+0000 7fd385eb99c0 20 zonegroup default 2024-09-14T11:33:41.353 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:41.354+0000 7fd385eb99c0 20 rados->read ofs=0 len=0 2024-09-14T11:33:41.353 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:41.354+0000 7fd385eb99c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:33:41.353 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:41.354+0000 7fd385eb99c0 20 rados->read ofs=0 len=0 2024-09-14T11:33:41.354 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:41.354+0000 7fd385eb99c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:33:41.354 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:41.354+0000 7fd385eb99c0 20 rados->read ofs=0 len=0 2024-09-14T11:33:41.354 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:41.358+0000 7fd385eb99c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:33:41.354 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:41.358+0000 7fd385eb99c0 20 started sync module instance, tier type = 2024-09-14T11:33:41.354 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:41.358+0000 7fd385eb99c0 20 started zone id=d9e72d30-c60b-4d0d-9267-fdc36392d5ad (name=default) with tier type = 2024-09-14T11:33:41.379 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:41.382+0000 7fd385eb99c0 20 add_watcher() i=0 2024-09-14T11:33:41.379 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:41.382+0000 7fd385eb99c0 20 add_watcher() i=1 2024-09-14T11:33:41.379 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:41.382+0000 7fd385eb99c0 20 add_watcher() i=2 2024-09-14T11:33:41.379 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:41.382+0000 7fd385eb99c0 20 add_watcher() i=3 2024-09-14T11:33:41.379 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:41.382+0000 7fd385eb99c0 20 add_watcher() i=4 2024-09-14T11:33:41.379 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:41.382+0000 7fd385eb99c0 20 add_watcher() i=5 2024-09-14T11:33:41.380 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:41.382+0000 7fd385eb99c0 20 add_watcher() i=6 2024-09-14T11:33:41.382 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:41.382+0000 7fd385eb99c0 20 add_watcher() i=7 2024-09-14T11:33:41.382 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:41.382+0000 7fd385eb99c0 2 all 8 watchers are set, enabling cache 2024-09-14T11:33:41.386 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:41.386+0000 7fd239fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:33:41.387 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:41.390+0000 7fd385eb99c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:33:41.387 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:41.390+0000 7fd385eb99c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:33:41.387 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:41.390+0000 7fd385eb99c0 5 note: GC not initialized 2024-09-14T11:33:41.387 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:41.390+0000 7fd238fe1640 20 reqs_thread_entry: start 2024-09-14T11:33:41.388 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:41.390+0000 7fd385eb99c0 20 init_complete bucket index max shards: 11 2024-09-14T11:33:41.388 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:41.390+0000 7fd385eb99c0 20 Filter name: none 2024-09-14T11:33:41.388 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:41.390+0000 7fd1b27fc640 20 reqs_thread_entry: start 2024-09-14T11:33:41.388 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:41.390+0000 7fd385eb99c0 20 rados->read ofs=0 len=0 2024-09-14T11:33:41.389 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:41.390+0000 7fd385eb99c0 20 rados_obj.operate() r=0 bl.length=176 2024-09-14T11:33:41.390 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:41.390+0000 7fd385eb99c0 20 rados->read ofs=0 len=0 2024-09-14T11:33:41.390 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:41.394+0000 7fd385eb99c0 20 rados_obj.operate() r=0 bl.length=398 2024-09-14T11:33:41.390 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:41.394+0000 7fd385eb99c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:33:41.390 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:41.394+0000 7fd385eb99c0 20 rados->read ofs=0 len=0 2024-09-14T11:33:41.391 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:41.394+0000 7fd385eb99c0 20 rados_obj.operate() r=0 bl.length=176 2024-09-14T11:33:41.391 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:41.394+0000 7fd385eb99c0 20 rados->read ofs=0 len=0 2024-09-14T11:33:41.392 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:41.394+0000 7fd385eb99c0 20 rados_obj.operate() r=0 bl.length=398 2024-09-14T11:33:41.392 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:41.394+0000 7fd385eb99c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:33:41.396 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:41.398+0000 7fd239fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:33:41.401 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:41.402+0000 7fd385eb99c0 20 remove_watcher() i=0 2024-09-14T11:33:41.401 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:41.402+0000 7fd385eb99c0 2 removed watcher, disabling cache 2024-09-14T11:33:41.404 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:41.406+0000 7fd385eb99c0 20 remove_watcher() i=1 2024-09-14T11:33:41.409 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:41.410+0000 7fd385eb99c0 20 remove_watcher() i=2 2024-09-14T11:33:41.409 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:41.410+0000 7fd385eb99c0 20 remove_watcher() i=3 2024-09-14T11:33:41.410 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:41.414+0000 7fd385eb99c0 20 remove_watcher() i=4 2024-09-14T11:33:41.412 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:41.414+0000 7fd385eb99c0 20 remove_watcher() i=5 2024-09-14T11:33:41.414 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:41.418+0000 7fd385eb99c0 20 remove_watcher() i=6 2024-09-14T11:33:41.416 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:41.418+0000 7fd385eb99c0 20 remove_watcher() i=7 2024-09-14T11:33:41.433 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-14T11:33:41.434 INFO:tasks.workunit.client.0.smithi138.stderr:BUCKET_STATS: 2024-09-14T11:33:41.434 INFO:tasks.workunit.client.0.smithi138.stderr:bucket: a-bucket id: d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.17 num_objects: 8 size_kb: 1 num_shards: 13 2024-09-14T11:33:41.434 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-14T11:33:41.434 INFO:tasks.workunit.client.0.smithi138.stderr:TEST: reshard bucket with EIO injected at init_index 2024-09-14T11:33:41.434 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-14T11:33:41.435 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:33:41.436 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-14T11:33:41.522 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:33:41.522 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-14T11:33:41.619 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:33:41.619 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-14T11:33:41.722 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:33:41.722 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-14T11:33:41.783 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:33:41.783 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-14T11:33:41.888 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:33:41.888 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-14T11:33:41.963 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:33:41.964 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-14T11:33:42.055 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:33:42.055 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-14T11:33:42.139 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:33:42.139 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-14T11:33:42.218 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:33:42.218 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-14T11:33:42.310 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:33:42.310 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-14T11:33:42.401 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:33:42.401 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-14T11:33:42.486 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:33:42.486 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-14T11:33:42.552 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:33:42.552 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-14T11:33:42.648 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:33:42.648 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-14T11:33:42.746 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:33:42.746 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-14T11:33:42.841 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:33:42.842 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-14T11:33:42.938 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:33:42.938 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-14T11:33:43.023 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:33:43.023 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-14T11:33:43.107 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:33:43.107 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-14T11:33:43.200 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:33:43.200 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-14T11:33:43.269 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:33:43.269 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-14T11:33:43.358 INFO:tasks.workunit.client.0.smithi138.stderr:radosgw-admin bucket stats --bucket error-at-init-index 2024-09-14T11:33:43.393 INFO:tasks.workunit.client.0.smithi138.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:33:43.393 INFO:tasks.workunit.client.0.smithi138.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:33:43.438 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:43.442+0000 7fb6d9fc89c0 20 rados->read ofs=0 len=0 2024-09-14T11:33:43.440 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:43.442+0000 7fb6d9fc89c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:33:43.441 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:43.442+0000 7fb6d9fc89c0 20 realm 2024-09-14T11:33:43.441 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:43.442+0000 7fb6d9fc89c0 20 rados->read ofs=0 len=0 2024-09-14T11:33:43.441 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:43.442+0000 7fb6d9fc89c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:33:43.441 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:43.442+0000 7fb6d9fc89c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:33:43.441 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:43.442+0000 7fb6d9fc89c0 20 rados->read ofs=0 len=0 2024-09-14T11:33:43.441 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:43.442+0000 7fb6d9fc89c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:33:43.441 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:43.442+0000 7fb6d9fc89c0 20 rados->read ofs=0 len=0 2024-09-14T11:33:43.442 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:43.446+0000 7fb6d9fc89c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:33:43.442 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:43.446+0000 7fb6d9fc89c0 20 rados->read ofs=0 len=0 2024-09-14T11:33:43.443 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:43.446+0000 7fb6d9fc89c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:33:43.443 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:43.446+0000 7fb6d9fc89c0 20 searching for the correct realm 2024-09-14T11:33:43.447 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:43.450+0000 7fb6d82cf640 0 -- 172.21.15.138:0/3740806572 >> [v2:172.21.15.154:6824/416768175,v1:172.21.15.154:6825/416768175] conn(0x7fb6d0008050 msgr2=0x7fb6d006c800 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:33:43.454 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:43.454+0000 7fb6d72cd640 0 -- 172.21.15.138:0/3740806572 >> [v2:172.21.15.138:6816/326481658,v1:172.21.15.138:6817/326481658] conn(0x7fb6d006f080 msgr2=0x7fb6d006d950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:33:43.669 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:43.670+0000 7fb6d9fc89c0 20 RGWRados::pool_iterate: got zone_info.d9e72d30-c60b-4d0d-9267-fdc36392d5ad 2024-09-14T11:33:43.670 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:43.670+0000 7fb6d9fc89c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:33:43.670 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:43.670+0000 7fb6d9fc89c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:33:43.670 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:43.670+0000 7fb6d9fc89c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:33:43.670 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:43.670+0000 7fb6d9fc89c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:33:43.670 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:43.670+0000 7fb6d9fc89c0 20 RGWRados::pool_iterate: got zonegroup_info.65ab941b-da8c-4160-94fb-3672b069d44f 2024-09-14T11:33:43.670 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:43.670+0000 7fb6d9fc89c0 20 rados->read ofs=0 len=0 2024-09-14T11:33:43.671 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:43.670+0000 7fb6d9fc89c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:33:43.671 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:43.670+0000 7fb6d9fc89c0 20 rados->read ofs=0 len=0 2024-09-14T11:33:43.671 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:43.674+0000 7fb6d9fc89c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:33:43.671 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:43.674+0000 7fb6d9fc89c0 20 rados->read ofs=0 len=0 2024-09-14T11:33:43.672 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:43.674+0000 7fb6d9fc89c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:33:43.672 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:43.674+0000 7fb6d9fc89c0 20 zone default found 2024-09-14T11:33:43.672 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:43.674+0000 7fb6d9fc89c0 4 Realm: () 2024-09-14T11:33:43.672 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:43.674+0000 7fb6d9fc89c0 4 ZoneGroup: default (65ab941b-da8c-4160-94fb-3672b069d44f) 2024-09-14T11:33:43.672 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:43.674+0000 7fb6d9fc89c0 4 Zone: default (d9e72d30-c60b-4d0d-9267-fdc36392d5ad) 2024-09-14T11:33:43.672 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:43.674+0000 7fb6d9fc89c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:33:43.672 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:43.674+0000 7fb6d9fc89c0 20 zonegroup default 2024-09-14T11:33:43.673 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:43.674+0000 7fb6d9fc89c0 20 rados->read ofs=0 len=0 2024-09-14T11:33:43.673 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:43.674+0000 7fb6d9fc89c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:33:43.673 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:43.674+0000 7fb6d9fc89c0 20 rados->read ofs=0 len=0 2024-09-14T11:33:43.673 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:43.674+0000 7fb6d9fc89c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:33:43.674 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:43.674+0000 7fb6d9fc89c0 20 rados->read ofs=0 len=0 2024-09-14T11:33:43.674 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:43.678+0000 7fb6d9fc89c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:33:43.674 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:43.678+0000 7fb6d9fc89c0 20 started sync module instance, tier type = 2024-09-14T11:33:43.675 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:43.678+0000 7fb6d9fc89c0 20 started zone id=d9e72d30-c60b-4d0d-9267-fdc36392d5ad (name=default) with tier type = 2024-09-14T11:33:43.698 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:43.702+0000 7fb6d9fc89c0 20 add_watcher() i=0 2024-09-14T11:33:43.698 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:43.702+0000 7fb6d9fc89c0 20 add_watcher() i=1 2024-09-14T11:33:43.698 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:43.702+0000 7fb6d9fc89c0 20 add_watcher() i=2 2024-09-14T11:33:43.699 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:43.702+0000 7fb6d9fc89c0 20 add_watcher() i=3 2024-09-14T11:33:43.699 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:43.702+0000 7fb6d9fc89c0 20 add_watcher() i=4 2024-09-14T11:33:43.699 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:43.702+0000 7fb6d9fc89c0 20 add_watcher() i=5 2024-09-14T11:33:43.699 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:43.702+0000 7fb6d9fc89c0 20 add_watcher() i=6 2024-09-14T11:33:43.700 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:43.702+0000 7fb6d9fc89c0 20 add_watcher() i=7 2024-09-14T11:33:43.700 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:43.702+0000 7fb6d9fc89c0 2 all 8 watchers are set, enabling cache 2024-09-14T11:33:43.704 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:43.706+0000 7fb58dfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:33:43.705 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:43.706+0000 7fb6d9fc89c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:33:43.705 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:43.706+0000 7fb6d9fc89c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:33:43.705 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:43.706+0000 7fb6d9fc89c0 5 note: GC not initialized 2024-09-14T11:33:43.706 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:43.706+0000 7fb58cfe1640 20 reqs_thread_entry: start 2024-09-14T11:33:43.706 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:43.706+0000 7fb6d9fc89c0 20 init_complete bucket index max shards: 11 2024-09-14T11:33:43.706 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:43.706+0000 7fb6d9fc89c0 20 Filter name: none 2024-09-14T11:33:43.706 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:43.706+0000 7fb5067fc640 20 reqs_thread_entry: start 2024-09-14T11:33:43.706 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:43.706+0000 7fb6d9fc89c0 20 rados->read ofs=0 len=0 2024-09-14T11:33:43.707 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:43.710+0000 7fb6d9fc89c0 20 rados_obj.operate() r=0 bl.length=187 2024-09-14T11:33:43.708 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:43.710+0000 7fb6d9fc89c0 20 rados->read ofs=0 len=0 2024-09-14T11:33:43.709 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:43.710+0000 7fb6d9fc89c0 20 rados_obj.operate() r=0 bl.length=409 2024-09-14T11:33:43.709 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:43.710+0000 7fb6d9fc89c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:33:43.709 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:43.710+0000 7fb6d9fc89c0 20 rados->read ofs=0 len=0 2024-09-14T11:33:43.709 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:43.710+0000 7fb6d9fc89c0 20 rados_obj.operate() r=0 bl.length=187 2024-09-14T11:33:43.709 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:43.710+0000 7fb6d9fc89c0 20 rados->read ofs=0 len=0 2024-09-14T11:33:43.710 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:43.714+0000 7fb6d9fc89c0 20 rados_obj.operate() r=0 bl.length=409 2024-09-14T11:33:43.710 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:43.714+0000 7fb6d9fc89c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:33:43.713 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:43.714+0000 7fb58dfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:33:43.718 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:43.722+0000 7fb6d9fc89c0 20 remove_watcher() i=0 2024-09-14T11:33:43.718 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:43.722+0000 7fb6d9fc89c0 2 removed watcher, disabling cache 2024-09-14T11:33:43.720 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:43.722+0000 7fb6d9fc89c0 20 remove_watcher() i=1 2024-09-14T11:33:43.723 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:43.726+0000 7fb6d9fc89c0 20 remove_watcher() i=2 2024-09-14T11:33:43.725 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:43.726+0000 7fb6d9fc89c0 20 remove_watcher() i=3 2024-09-14T11:33:43.727 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:43.730+0000 7fb6d9fc89c0 20 remove_watcher() i=4 2024-09-14T11:33:43.728 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:43.730+0000 7fb6d9fc89c0 20 remove_watcher() i=5 2024-09-14T11:33:43.730 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:43.730+0000 7fb6d9fc89c0 20 remove_watcher() i=6 2024-09-14T11:33:43.731 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:43.734+0000 7fb6d9fc89c0 20 remove_watcher() i=7 2024-09-14T11:33:43.746 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-14T11:33:43.746 INFO:tasks.workunit.client.0.smithi138.stderr:BUCKET_STATS: 2024-09-14T11:33:43.747 INFO:tasks.workunit.client.0.smithi138.stderr:bucket: error-at-init-index id: d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.19 num_objects: 20 size_kb: 1 num_shards: 11 2024-09-14T11:33:43.747 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-14T11:33:43.747 INFO:tasks.workunit.client.0.smithi138.stderr:radosgw-admin bucket reshard --bucket error-at-init-index --num-shards 12 --rgw-reshard-bucket-lock-duration 30 --inject-error-at init_index 2024-09-14T11:33:43.783 INFO:tasks.workunit.client.0.smithi138.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:33:43.783 INFO:tasks.workunit.client.0.smithi138.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:33:44.039 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:44.042+0000 7f749f9ad9c0 20 rados->read ofs=0 len=0 2024-09-14T11:33:44.041 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:44.042+0000 7f749f9ad9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:33:44.041 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:44.042+0000 7f749f9ad9c0 20 realm 2024-09-14T11:33:44.041 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:44.042+0000 7f749f9ad9c0 20 rados->read ofs=0 len=0 2024-09-14T11:33:44.042 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:44.042+0000 7f749f9ad9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:33:44.042 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:44.042+0000 7f749f9ad9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:33:44.042 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:44.042+0000 7f749f9ad9c0 20 rados->read ofs=0 len=0 2024-09-14T11:33:44.042 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:44.042+0000 7f749f9ad9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:33:44.042 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:44.042+0000 7f749f9ad9c0 20 rados->read ofs=0 len=0 2024-09-14T11:33:44.043 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:44.046+0000 7f749f9ad9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:33:44.043 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:44.046+0000 7f749f9ad9c0 20 rados->read ofs=0 len=0 2024-09-14T11:33:44.044 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:44.046+0000 7f749f9ad9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:33:44.044 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:44.046+0000 7f749f9ad9c0 20 searching for the correct realm 2024-09-14T11:33:44.047 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:44.050+0000 7f749dcb4640 0 -- 172.21.15.138:0/4177856166 >> [v2:172.21.15.138:6824/2633984942,v1:172.21.15.138:6825/2633984942] conn(0x559ad154d330 msgr2=0x559ad154f740 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:33:44.054 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:44.058+0000 7f749dcb4640 0 -- 172.21.15.138:0/4177856166 >> [v2:172.21.15.138:6824/2633984942,v1:172.21.15.138:6825/2633984942] conn(0x7f7368082050 msgr2=0x7f7368084480 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:33:44.065 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:44.066+0000 7f749f9ad9c0 20 RGWRados::pool_iterate: got zone_info.d9e72d30-c60b-4d0d-9267-fdc36392d5ad 2024-09-14T11:33:44.065 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:44.066+0000 7f749f9ad9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:33:44.065 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:44.066+0000 7f749f9ad9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:33:44.065 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:44.066+0000 7f749f9ad9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:33:44.065 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:44.066+0000 7f749f9ad9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:33:44.065 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:44.066+0000 7f749f9ad9c0 20 RGWRados::pool_iterate: got zonegroup_info.65ab941b-da8c-4160-94fb-3672b069d44f 2024-09-14T11:33:44.065 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:44.066+0000 7f749f9ad9c0 20 rados->read ofs=0 len=0 2024-09-14T11:33:44.065 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:44.066+0000 7f749f9ad9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:33:44.065 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:44.066+0000 7f749f9ad9c0 20 rados->read ofs=0 len=0 2024-09-14T11:33:44.066 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:44.066+0000 7f749f9ad9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:33:44.066 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:44.066+0000 7f749f9ad9c0 20 rados->read ofs=0 len=0 2024-09-14T11:33:44.067 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:44.070+0000 7f749f9ad9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:33:44.067 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:44.070+0000 7f749f9ad9c0 20 zone default found 2024-09-14T11:33:44.067 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:44.070+0000 7f749f9ad9c0 4 Realm: () 2024-09-14T11:33:44.067 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:44.070+0000 7f749f9ad9c0 4 ZoneGroup: default (65ab941b-da8c-4160-94fb-3672b069d44f) 2024-09-14T11:33:44.067 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:44.070+0000 7f749f9ad9c0 4 Zone: default (d9e72d30-c60b-4d0d-9267-fdc36392d5ad) 2024-09-14T11:33:44.067 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:44.070+0000 7f749f9ad9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:33:44.067 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:44.070+0000 7f749f9ad9c0 20 zonegroup default 2024-09-14T11:33:44.067 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:44.070+0000 7f749f9ad9c0 20 rados->read ofs=0 len=0 2024-09-14T11:33:44.067 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:44.070+0000 7f749f9ad9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:33:44.067 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:44.070+0000 7f749f9ad9c0 20 rados->read ofs=0 len=0 2024-09-14T11:33:44.068 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:44.070+0000 7f749f9ad9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:33:44.068 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:44.070+0000 7f749f9ad9c0 20 rados->read ofs=0 len=0 2024-09-14T11:33:44.068 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:44.070+0000 7f749f9ad9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:33:44.068 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:44.070+0000 7f749f9ad9c0 20 started sync module instance, tier type = 2024-09-14T11:33:44.068 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:44.070+0000 7f749f9ad9c0 20 started zone id=d9e72d30-c60b-4d0d-9267-fdc36392d5ad (name=default) with tier type = 2024-09-14T11:33:44.084 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:44.086+0000 7f749f9ad9c0 20 add_watcher() i=0 2024-09-14T11:33:44.084 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:44.086+0000 7f749f9ad9c0 20 add_watcher() i=1 2024-09-14T11:33:44.085 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:44.086+0000 7f749f9ad9c0 20 add_watcher() i=2 2024-09-14T11:33:44.085 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:44.086+0000 7f749f9ad9c0 20 add_watcher() i=3 2024-09-14T11:33:44.085 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:44.086+0000 7f749f9ad9c0 20 add_watcher() i=4 2024-09-14T11:33:44.085 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:44.086+0000 7f749f9ad9c0 20 add_watcher() i=5 2024-09-14T11:33:44.085 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:44.086+0000 7f749f9ad9c0 20 add_watcher() i=6 2024-09-14T11:33:44.085 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:44.086+0000 7f749f9ad9c0 20 add_watcher() i=7 2024-09-14T11:33:44.085 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:44.086+0000 7f749f9ad9c0 2 all 8 watchers are set, enabling cache 2024-09-14T11:33:44.088 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:44.090+0000 7f73537e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:33:44.088 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:44.090+0000 7f749f9ad9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:33:44.089 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:44.090+0000 7f749f9ad9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:33:44.089 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:44.090+0000 7f749f9ad9c0 5 note: GC not initialized 2024-09-14T11:33:44.089 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:44.090+0000 7f73527e4640 20 reqs_thread_entry: start 2024-09-14T11:33:44.090 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:44.090+0000 7f749f9ad9c0 20 init_complete bucket index max shards: 11 2024-09-14T11:33:44.090 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:44.090+0000 7f749f9ad9c0 20 Filter name: none 2024-09-14T11:33:44.090 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:44.090+0000 7f72c3fff640 20 reqs_thread_entry: start 2024-09-14T11:33:44.090 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:44.090+0000 7f749f9ad9c0 10 cache get: name=default.rgw.meta+root+error-at-init-index : miss 2024-09-14T11:33:44.090 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:44.090+0000 7f749f9ad9c0 20 rados->read ofs=0 len=0 2024-09-14T11:33:44.091 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:44.094+0000 7f749f9ad9c0 20 rados_obj.operate() r=0 bl.length=187 2024-09-14T11:33:44.091 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:44.094+0000 7f749f9ad9c0 10 cache put: name=default.rgw.meta+root+error-at-init-index info.flags=0x11 2024-09-14T11:33:44.091 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:44.094+0000 7f749f9ad9c0 10 adding default.rgw.meta+root+error-at-init-index to cache LRU end 2024-09-14T11:33:44.091 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:44.094+0000 7f749f9ad9c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-init-index:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.19 : miss 2024-09-14T11:33:44.091 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:44.094+0000 7f749f9ad9c0 20 rados->read ofs=0 len=0 2024-09-14T11:33:44.091 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:44.094+0000 7f749f9ad9c0 20 rados_obj.operate() r=0 bl.length=409 2024-09-14T11:33:44.091 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:44.094+0000 7f749f9ad9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-init-index:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.19 info.flags=0x17 2024-09-14T11:33:44.091 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:44.094+0000 7f749f9ad9c0 10 adding default.rgw.meta+root+.bucket.meta.error-at-init-index:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.19 to cache LRU end 2024-09-14T11:33:44.091 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:44.094+0000 7f749f9ad9c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:33:44.091 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:44.094+0000 7f749f9ad9c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:33:44.091 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:44.094+0000 7f749f9ad9c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-init-index:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.19 2024-09-14T11:33:44.093 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:44.094+0000 7f749f9ad9c0 -1 Injecting error=-5 at location=init_index 2024-09-14T11:33:44.093 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:44.094+0000 7f749f9ad9c0 0 ERROR: init_target_index failed to initialize target index shard objects: (5) Input/output error 2024-09-14T11:33:44.096 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:44.098+0000 7f73537e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:33:44.101 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:44.102+0000 7f749f9ad9c0 20 remove_watcher() i=0 2024-09-14T11:33:44.101 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:44.102+0000 7f749f9ad9c0 2 removed watcher, disabling cache 2024-09-14T11:33:44.103 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:44.106+0000 7f749f9ad9c0 20 remove_watcher() i=1 2024-09-14T11:33:44.105 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:44.106+0000 7f749f9ad9c0 20 remove_watcher() i=2 2024-09-14T11:33:44.107 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:44.110+0000 7f749f9ad9c0 20 remove_watcher() i=3 2024-09-14T11:33:44.109 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:44.110+0000 7f749f9ad9c0 20 remove_watcher() i=4 2024-09-14T11:33:44.111 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:44.114+0000 7f749f9ad9c0 20 remove_watcher() i=5 2024-09-14T11:33:44.112 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:44.114+0000 7f749f9ad9c0 20 remove_watcher() i=6 2024-09-14T11:33:44.113 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:44.114+0000 7f749f9ad9c0 20 remove_watcher() i=7 2024-09-14T11:33:44.127 INFO:tasks.workunit.client.0.smithi138.stderr:radosgw-admin bucket stats --bucket error-at-init-index 2024-09-14T11:33:44.156 INFO:tasks.workunit.client.0.smithi138.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:33:44.156 INFO:tasks.workunit.client.0.smithi138.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:33:44.200 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:44.202+0000 7fa7edb799c0 20 rados->read ofs=0 len=0 2024-09-14T11:33:44.202 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:44.202+0000 7fa7edb799c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:33:44.202 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:44.202+0000 7fa7edb799c0 20 realm 2024-09-14T11:33:44.202 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:44.202+0000 7fa7edb799c0 20 rados->read ofs=0 len=0 2024-09-14T11:33:44.202 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:44.202+0000 7fa7edb799c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:33:44.202 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:44.202+0000 7fa7edb799c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:33:44.202 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:44.202+0000 7fa7edb799c0 20 rados->read ofs=0 len=0 2024-09-14T11:33:44.202 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:44.202+0000 7fa7edb799c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:33:44.202 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:44.202+0000 7fa7edb799c0 20 rados->read ofs=0 len=0 2024-09-14T11:33:44.203 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:44.206+0000 7fa7edb799c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:33:44.204 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:44.206+0000 7fa7edb799c0 20 rados->read ofs=0 len=0 2024-09-14T11:33:44.204 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:44.206+0000 7fa7edb799c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:33:44.204 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:44.206+0000 7fa7edb799c0 20 searching for the correct realm 2024-09-14T11:33:44.209 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:44.210+0000 7fa7eb67f640 0 -- 172.21.15.138:0/1189456552 >> [v2:172.21.15.138:6808/3258321916,v1:172.21.15.138:6809/3258321916] conn(0x556bfcb3a000 msgr2=0x556bfcb3c4c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:33:44.215 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:44.218+0000 7fa7eae7e640 0 -- 172.21.15.138:0/1189456552 >> [v2:172.21.15.138:6816/326481658,v1:172.21.15.138:6817/326481658] conn(0x7fa7e4061210 msgr2=0x7fa7e406e610 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:33:44.223 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:44.226+0000 7fa7edb799c0 20 RGWRados::pool_iterate: got zone_info.d9e72d30-c60b-4d0d-9267-fdc36392d5ad 2024-09-14T11:33:44.224 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:44.226+0000 7fa7edb799c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:33:44.224 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:44.226+0000 7fa7edb799c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:33:44.224 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:44.226+0000 7fa7edb799c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:33:44.224 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:44.226+0000 7fa7edb799c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:33:44.224 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:44.226+0000 7fa7edb799c0 20 RGWRados::pool_iterate: got zonegroup_info.65ab941b-da8c-4160-94fb-3672b069d44f 2024-09-14T11:33:44.224 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:44.226+0000 7fa7edb799c0 20 rados->read ofs=0 len=0 2024-09-14T11:33:44.224 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:44.226+0000 7fa7edb799c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:33:44.224 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:44.226+0000 7fa7edb799c0 20 rados->read ofs=0 len=0 2024-09-14T11:33:44.224 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:44.226+0000 7fa7edb799c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:33:44.225 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:44.226+0000 7fa7edb799c0 20 rados->read ofs=0 len=0 2024-09-14T11:33:44.225 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:44.226+0000 7fa7edb799c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:33:44.225 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:44.226+0000 7fa7edb799c0 20 zone default found 2024-09-14T11:33:44.226 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:44.226+0000 7fa7edb799c0 4 Realm: () 2024-09-14T11:33:44.226 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:44.226+0000 7fa7edb799c0 4 ZoneGroup: default (65ab941b-da8c-4160-94fb-3672b069d44f) 2024-09-14T11:33:44.226 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:44.226+0000 7fa7edb799c0 4 Zone: default (d9e72d30-c60b-4d0d-9267-fdc36392d5ad) 2024-09-14T11:33:44.226 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:44.226+0000 7fa7edb799c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:33:44.226 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:44.226+0000 7fa7edb799c0 20 zonegroup default 2024-09-14T11:33:44.226 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:44.226+0000 7fa7edb799c0 20 rados->read ofs=0 len=0 2024-09-14T11:33:44.226 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:44.226+0000 7fa7edb799c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:33:44.226 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:44.226+0000 7fa7edb799c0 20 rados->read ofs=0 len=0 2024-09-14T11:33:44.227 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:44.226+0000 7fa7edb799c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:33:44.227 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:44.226+0000 7fa7edb799c0 20 rados->read ofs=0 len=0 2024-09-14T11:33:44.227 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:44.230+0000 7fa7edb799c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:33:44.227 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:44.230+0000 7fa7edb799c0 20 started sync module instance, tier type = 2024-09-14T11:33:44.227 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:44.230+0000 7fa7edb799c0 20 started zone id=d9e72d30-c60b-4d0d-9267-fdc36392d5ad (name=default) with tier type = 2024-09-14T11:33:44.242 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:44.246+0000 7fa7edb799c0 20 add_watcher() i=0 2024-09-14T11:33:44.243 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:44.246+0000 7fa7edb799c0 20 add_watcher() i=1 2024-09-14T11:33:44.243 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:44.246+0000 7fa7edb799c0 20 add_watcher() i=2 2024-09-14T11:33:44.243 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:44.246+0000 7fa7edb799c0 20 add_watcher() i=3 2024-09-14T11:33:44.243 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:44.246+0000 7fa7edb799c0 20 add_watcher() i=4 2024-09-14T11:33:44.243 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:44.246+0000 7fa7edb799c0 20 add_watcher() i=5 2024-09-14T11:33:44.243 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:44.246+0000 7fa7edb799c0 20 add_watcher() i=6 2024-09-14T11:33:44.243 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:44.246+0000 7fa7edb799c0 20 add_watcher() i=7 2024-09-14T11:33:44.244 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:44.246+0000 7fa7edb799c0 2 all 8 watchers are set, enabling cache 2024-09-14T11:33:44.246 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:44.250+0000 7fa6a1fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:33:44.247 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:44.250+0000 7fa7edb799c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:33:44.247 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:44.250+0000 7fa7edb799c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:33:44.247 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:44.250+0000 7fa7edb799c0 5 note: GC not initialized 2024-09-14T11:33:44.248 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:44.250+0000 7fa6a0fe1640 20 reqs_thread_entry: start 2024-09-14T11:33:44.248 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:44.250+0000 7fa7edb799c0 20 init_complete bucket index max shards: 11 2024-09-14T11:33:44.248 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:44.250+0000 7fa7edb799c0 20 Filter name: none 2024-09-14T11:33:44.248 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:44.250+0000 7fa61a7fc640 20 reqs_thread_entry: start 2024-09-14T11:33:44.248 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:44.250+0000 7fa7edb799c0 20 rados->read ofs=0 len=0 2024-09-14T11:33:44.249 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:44.250+0000 7fa7edb799c0 20 rados_obj.operate() r=0 bl.length=187 2024-09-14T11:33:44.249 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:44.250+0000 7fa7edb799c0 20 rados->read ofs=0 len=0 2024-09-14T11:33:44.249 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:44.250+0000 7fa7edb799c0 20 rados_obj.operate() r=0 bl.length=409 2024-09-14T11:33:44.249 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:44.250+0000 7fa7edb799c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:33:44.250 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:44.250+0000 7fa7edb799c0 20 rados->read ofs=0 len=0 2024-09-14T11:33:44.251 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:44.254+0000 7fa7edb799c0 20 rados_obj.operate() r=0 bl.length=187 2024-09-14T11:33:44.251 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:44.254+0000 7fa7edb799c0 20 rados->read ofs=0 len=0 2024-09-14T11:33:44.251 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:44.254+0000 7fa7edb799c0 20 rados_obj.operate() r=0 bl.length=409 2024-09-14T11:33:44.251 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:44.254+0000 7fa7edb799c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:33:44.254 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:44.254+0000 7fa6a1fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:33:44.258 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:44.262+0000 7fa7edb799c0 20 remove_watcher() i=0 2024-09-14T11:33:44.258 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:44.262+0000 7fa7edb799c0 2 removed watcher, disabling cache 2024-09-14T11:33:44.260 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:44.262+0000 7fa7edb799c0 20 remove_watcher() i=1 2024-09-14T11:33:44.263 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:44.266+0000 7fa7edb799c0 20 remove_watcher() i=2 2024-09-14T11:33:44.265 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:44.266+0000 7fa7edb799c0 20 remove_watcher() i=3 2024-09-14T11:33:44.267 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:44.270+0000 7fa7edb799c0 20 remove_watcher() i=4 2024-09-14T11:33:44.268 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:44.270+0000 7fa7edb799c0 20 remove_watcher() i=5 2024-09-14T11:33:44.269 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:44.270+0000 7fa7edb799c0 20 remove_watcher() i=6 2024-09-14T11:33:44.271 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:44.274+0000 7fa7edb799c0 20 remove_watcher() i=7 2024-09-14T11:33:44.285 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-14T11:33:44.285 INFO:tasks.workunit.client.0.smithi138.stderr:BUCKET_STATS: 2024-09-14T11:33:44.285 INFO:tasks.workunit.client.0.smithi138.stderr:bucket: error-at-init-index id: d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.19 num_objects: 20 size_kb: 1 num_shards: 11 2024-09-14T11:33:44.285 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-14T11:33:44.286 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:33:44.287 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-14T11:33:44.324 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:33:44.324 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-14T11:33:44.400 INFO:tasks.workunit.client.0.smithi138.stderr:radosgw-admin bucket reshard --bucket error-at-init-index --num-shards 12 --rgw-reshard-bucket-lock-duration 30 2024-09-14T11:33:44.435 INFO:tasks.workunit.client.0.smithi138.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:33:44.436 INFO:tasks.workunit.client.0.smithi138.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:33:44.481 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:44.482+0000 7f8e7b3169c0 20 rados->read ofs=0 len=0 2024-09-14T11:33:44.483 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:44.486+0000 7f8e7b3169c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:33:44.483 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:44.486+0000 7f8e7b3169c0 20 realm 2024-09-14T11:33:44.483 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:44.486+0000 7f8e7b3169c0 20 rados->read ofs=0 len=0 2024-09-14T11:33:44.483 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:44.486+0000 7f8e7b3169c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:33:44.483 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:44.486+0000 7f8e7b3169c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:33:44.483 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:44.486+0000 7f8e7b3169c0 20 rados->read ofs=0 len=0 2024-09-14T11:33:44.483 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:44.486+0000 7f8e7b3169c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:33:44.483 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:44.486+0000 7f8e7b3169c0 20 rados->read ofs=0 len=0 2024-09-14T11:33:44.485 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:44.486+0000 7f8e7b3169c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:33:44.485 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:44.486+0000 7f8e7b3169c0 20 rados->read ofs=0 len=0 2024-09-14T11:33:44.486 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:44.486+0000 7f8e7b3169c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:33:44.486 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:44.486+0000 7f8e7b3169c0 20 searching for the correct realm 2024-09-14T11:33:44.487 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:44.490+0000 7f8e7861b640 0 -- 172.21.15.138:0/3093581423 >> [v2:172.21.15.154:6808/1468088432,v1:172.21.15.154:6809/1468088432] conn(0x7f8e68015030 msgr2=0x7f8e68064250 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:33:44.702 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:44.702+0000 7f8e7961d640 0 -- 172.21.15.138:0/3093581423 >> [v2:172.21.15.138:6824/2633984942,v1:172.21.15.138:6825/2633984942] conn(0x5564ad6b6840 msgr2=0x5564ad6b8c30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:33:44.719 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:44.722+0000 7f8e7b3169c0 20 RGWRados::pool_iterate: got zone_info.d9e72d30-c60b-4d0d-9267-fdc36392d5ad 2024-09-14T11:33:44.719 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:44.722+0000 7f8e7b3169c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:33:44.719 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:44.722+0000 7f8e7b3169c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:33:44.719 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:44.722+0000 7f8e7b3169c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:33:44.719 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:44.722+0000 7f8e7b3169c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:33:44.719 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:44.722+0000 7f8e7b3169c0 20 RGWRados::pool_iterate: got zonegroup_info.65ab941b-da8c-4160-94fb-3672b069d44f 2024-09-14T11:33:44.719 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:44.722+0000 7f8e7b3169c0 20 rados->read ofs=0 len=0 2024-09-14T11:33:44.720 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:44.722+0000 7f8e7b3169c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:33:44.720 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:44.722+0000 7f8e7b3169c0 20 rados->read ofs=0 len=0 2024-09-14T11:33:44.721 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:44.722+0000 7f8e7b3169c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:33:44.721 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:44.722+0000 7f8e7b3169c0 20 rados->read ofs=0 len=0 2024-09-14T11:33:44.722 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:44.722+0000 7f8e7b3169c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:33:44.722 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:44.722+0000 7f8e7b3169c0 20 zone default found 2024-09-14T11:33:44.722 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:44.722+0000 7f8e7b3169c0 4 Realm: () 2024-09-14T11:33:44.722 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:44.722+0000 7f8e7b3169c0 4 ZoneGroup: default (65ab941b-da8c-4160-94fb-3672b069d44f) 2024-09-14T11:33:44.722 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:44.722+0000 7f8e7b3169c0 4 Zone: default (d9e72d30-c60b-4d0d-9267-fdc36392d5ad) 2024-09-14T11:33:44.722 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:44.722+0000 7f8e7b3169c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:33:44.722 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:44.722+0000 7f8e7b3169c0 20 zonegroup default 2024-09-14T11:33:44.722 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:44.722+0000 7f8e7b3169c0 20 rados->read ofs=0 len=0 2024-09-14T11:33:44.723 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:44.726+0000 7f8e7b3169c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:33:44.723 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:44.726+0000 7f8e7b3169c0 20 rados->read ofs=0 len=0 2024-09-14T11:33:44.723 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:44.726+0000 7f8e7b3169c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:33:44.723 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:44.726+0000 7f8e7b3169c0 20 rados->read ofs=0 len=0 2024-09-14T11:33:44.724 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:44.726+0000 7f8e7b3169c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:33:44.724 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:44.726+0000 7f8e7b3169c0 20 started sync module instance, tier type = 2024-09-14T11:33:44.724 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:44.726+0000 7f8e7b3169c0 20 started zone id=d9e72d30-c60b-4d0d-9267-fdc36392d5ad (name=default) with tier type = 2024-09-14T11:33:44.747 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:44.750+0000 7f8e7b3169c0 20 add_watcher() i=0 2024-09-14T11:33:44.747 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:44.750+0000 7f8e7b3169c0 20 add_watcher() i=1 2024-09-14T11:33:44.747 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:44.750+0000 7f8e7b3169c0 20 add_watcher() i=2 2024-09-14T11:33:44.747 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:44.750+0000 7f8e7b3169c0 20 add_watcher() i=3 2024-09-14T11:33:44.747 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:44.750+0000 7f8e7b3169c0 20 add_watcher() i=4 2024-09-14T11:33:44.747 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:44.750+0000 7f8e7b3169c0 20 add_watcher() i=5 2024-09-14T11:33:44.747 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:44.750+0000 7f8e7b3169c0 20 add_watcher() i=6 2024-09-14T11:33:44.749 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:44.750+0000 7f8e7b3169c0 20 add_watcher() i=7 2024-09-14T11:33:44.749 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:44.750+0000 7f8e7b3169c0 2 all 8 watchers are set, enabling cache 2024-09-14T11:33:44.753 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:44.754+0000 7f8d2efe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:33:44.754 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:44.754+0000 7f8e7b3169c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:33:44.754 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:44.754+0000 7f8e7b3169c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:33:44.754 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:44.754+0000 7f8e7b3169c0 5 note: GC not initialized 2024-09-14T11:33:44.755 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:44.758+0000 7f8d2dfe3640 20 reqs_thread_entry: start 2024-09-14T11:33:44.755 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:44.758+0000 7f8e7b3169c0 20 init_complete bucket index max shards: 11 2024-09-14T11:33:44.755 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:44.758+0000 7f8e7b3169c0 20 Filter name: none 2024-09-14T11:33:44.755 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:44.758+0000 7f8c9f7fe640 20 reqs_thread_entry: start 2024-09-14T11:33:44.755 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:44.758+0000 7f8e7b3169c0 10 cache get: name=default.rgw.meta+root+error-at-init-index : miss 2024-09-14T11:33:44.755 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:44.758+0000 7f8e7b3169c0 20 rados->read ofs=0 len=0 2024-09-14T11:33:44.756 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:44.758+0000 7f8e7b3169c0 20 rados_obj.operate() r=0 bl.length=187 2024-09-14T11:33:44.757 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:44.758+0000 7f8e7b3169c0 10 cache put: name=default.rgw.meta+root+error-at-init-index info.flags=0x11 2024-09-14T11:33:44.757 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:44.758+0000 7f8e7b3169c0 10 adding default.rgw.meta+root+error-at-init-index to cache LRU end 2024-09-14T11:33:44.757 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:44.758+0000 7f8e7b3169c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-init-index:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.19 : miss 2024-09-14T11:33:44.757 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:44.758+0000 7f8e7b3169c0 20 rados->read ofs=0 len=0 2024-09-14T11:33:44.757 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:44.758+0000 7f8e7b3169c0 20 rados_obj.operate() r=0 bl.length=409 2024-09-14T11:33:44.758 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:44.758+0000 7f8e7b3169c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-init-index:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.19 info.flags=0x17 2024-09-14T11:33:44.758 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:44.758+0000 7f8e7b3169c0 10 adding default.rgw.meta+root+.bucket.meta.error-at-init-index:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.19 to cache LRU end 2024-09-14T11:33:44.758 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:44.758+0000 7f8e7b3169c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:33:44.758 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:44.758+0000 7f8e7b3169c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:33:44.758 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:44.758+0000 7f8e7b3169c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-init-index:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.19 2024-09-14T11:33:44.769 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:44.770+0000 7f8e7b3169c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-init-index:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.19 info.flags=0x17 2024-09-14T11:33:44.769 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:44.770+0000 7f8e7b3169c0 10 moving default.rgw.meta+root+.bucket.meta.error-at-init-index:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.19 to cache LRU end 2024-09-14T11:33:44.769 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:44.770+0000 7f8e7b3169c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:33:44.769 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:44.770+0000 7f8e7b3169c0 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-init-index:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.19, ofs0, ns] 2024-09-14T11:33:44.769 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:44.770+0000 7f8d4ffff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366170 cookie 93890894626608 notifier 5804 bl.length()=911 2024-09-14T11:33:44.769 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:44.770+0000 7f8d4ffff640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-init-index:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.19 info.flags=0x17 2024-09-14T11:33:44.769 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:44.770+0000 7f8d4ffff640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-init-index:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.19 to cache LRU end 2024-09-14T11:33:44.769 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:44.770+0000 7f8d4ffff640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:33:44.771 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:44.774+0000 7f8e7b3169c0 20 handle_bi_update(): bucket=:error-at-init-index[d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.19]): orig_sources= new_sources= 2024-09-14T11:33:44.772 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:44.774+0000 7f8e7b3169c0 20 handle_bi_update(): bucket=:error-at-init-index[d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.19]): potential sources added=[] removed=[] 2024-09-14T11:33:44.772 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:44.774+0000 7f8e7b3169c0 20 handle_bi_update(): bucket=:error-at-init-index[d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.19]): orig_dests= new_dests= 2024-09-14T11:33:44.772 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:44.774+0000 7f8e7b3169c0 20 handle_bi_update(): bucket=:error-at-init-index[d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.19]): potential dests added=[] removed=[] 2024-09-14T11:33:44.782 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:44.782+0000 7f8e7b3169c0 10 bucket_obj is .dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.19.1.0 2024-09-14T11:33:44.782 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:44.782+0000 7f8e7b3169c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.19.1.0 2024-09-14T11:33:44.782 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:44.782+0000 7f8e7b3169c0 10 bucket_obj is .dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.19.1.1 2024-09-14T11:33:44.782 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:44.782+0000 7f8e7b3169c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.19.1.1 2024-09-14T11:33:44.783 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:44.782+0000 7f8e7b3169c0 10 bucket_obj is .dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.19.1.2 2024-09-14T11:33:44.783 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:44.782+0000 7f8e7b3169c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.19.1.2 2024-09-14T11:33:44.783 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:44.782+0000 7f8e7b3169c0 10 bucket_obj is .dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.19.1.3 2024-09-14T11:33:44.783 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:44.782+0000 7f8e7b3169c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.19.1.3 2024-09-14T11:33:44.783 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:44.782+0000 7f8e7b3169c0 10 bucket_obj is .dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.19.1.4 2024-09-14T11:33:44.783 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:44.782+0000 7f8e7b3169c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.19.1.4 2024-09-14T11:33:44.783 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:44.782+0000 7f8e7b3169c0 10 bucket_obj is .dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.19.1.5 2024-09-14T11:33:44.783 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:44.782+0000 7f8e7b3169c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.19.1.5 2024-09-14T11:33:44.783 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:44.782+0000 7f8e7b3169c0 10 bucket_obj is .dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.19.1.6 2024-09-14T11:33:44.783 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:44.782+0000 7f8e7b3169c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.19.1.6 2024-09-14T11:33:44.783 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:44.782+0000 7f8e7b3169c0 10 bucket_obj is .dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.19.1.7 2024-09-14T11:33:44.783 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:44.782+0000 7f8e7b3169c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.19.1.7 2024-09-14T11:33:44.783 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:44.782+0000 7f8e7b3169c0 10 bucket_obj is .dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.19.1.8 2024-09-14T11:33:44.783 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:44.782+0000 7f8e7b3169c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.19.1.8 2024-09-14T11:33:44.783 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:44.782+0000 7f8e7b3169c0 10 bucket_obj is .dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.19.1.9 2024-09-14T11:33:44.784 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:44.782+0000 7f8e7b3169c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.19.1.9 2024-09-14T11:33:44.784 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:44.782+0000 7f8e7b3169c0 10 bucket_obj is .dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.19.1.10 2024-09-14T11:33:44.784 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:44.782+0000 7f8e7b3169c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.19.1.10 2024-09-14T11:33:44.784 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:44.782+0000 7f8e7b3169c0 10 bucket_obj is .dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.19.1.11 2024-09-14T11:33:44.784 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:44.782+0000 7f8e7b3169c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.19.1.11 2024-09-14T11:33:44.784 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:44.786+0000 7f8e7b3169c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.19.0 2024-09-14T11:33:44.784 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:44.786+0000 7f8e7b3169c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.19.1 2024-09-14T11:33:44.784 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:44.786+0000 7f8e7b3169c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.19.2 2024-09-14T11:33:44.786 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:44.790+0000 7f8e7b3169c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.19.3 2024-09-14T11:33:44.787 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:44.790+0000 7f8e7b3169c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.19.4 2024-09-14T11:33:44.788 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:44.790+0000 7f8e7b3169c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.19.5 2024-09-14T11:33:44.789 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:44.790+0000 7f8e7b3169c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.19.6 2024-09-14T11:33:44.790 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:44.794+0000 7f8e7b3169c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.19.7 2024-09-14T11:33:44.791 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:44.794+0000 7f8e7b3169c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.19.8 2024-09-14T11:33:44.792 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:44.794+0000 7f8e7b3169c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.19.9 2024-09-14T11:33:44.794 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:44.794+0000 7f8e7b3169c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.19.10 2024-09-14T11:33:44.800 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:44.802+0000 7f8e7b3169c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-init-index:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.19 : hit (requested=0x17, cached=0x17) 2024-09-14T11:33:44.800 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:44.802+0000 7f8e7b3169c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-init-index:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.19 2024-09-14T11:33:44.802 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:44.806+0000 7f8e7b3169c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-init-index:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.19 info.flags=0x17 2024-09-14T11:33:44.802 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:44.806+0000 7f8e7b3169c0 10 moving default.rgw.meta+root+.bucket.meta.error-at-init-index:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.19 to cache LRU end 2024-09-14T11:33:44.802 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:44.806+0000 7f8e7b3169c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:33:44.803 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:44.806+0000 7f8e7b3169c0 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-init-index:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.19, ofs0, ns] 2024-09-14T11:33:44.803 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:44.806+0000 7f8d4ffff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366171 cookie 93890894626608 notifier 5804 bl.length()=911 2024-09-14T11:33:44.803 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:44.806+0000 7f8d4ffff640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-init-index:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.19 info.flags=0x17 2024-09-14T11:33:44.803 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:44.806+0000 7f8d4ffff640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-init-index:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.19 to cache LRU end 2024-09-14T11:33:44.803 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:44.806+0000 7f8d4ffff640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:33:44.806 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:44.806+0000 7f8e7b3169c0 20 handle_bi_update(): bucket=:error-at-init-index[d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.19]): orig_sources= new_sources= 2024-09-14T11:33:44.806 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:44.806+0000 7f8e7b3169c0 20 handle_bi_update(): bucket=:error-at-init-index[d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.19]): potential sources added=[] removed=[] 2024-09-14T11:33:44.806 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:44.806+0000 7f8e7b3169c0 20 handle_bi_update(): bucket=:error-at-init-index[d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.19]): orig_dests= new_dests= 2024-09-14T11:33:44.806 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:44.806+0000 7f8e7b3169c0 20 handle_bi_update(): bucket=:error-at-init-index[d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.19]): potential dests added=[] removed=[] 2024-09-14T11:33:44.811 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:44.814+0000 7f8e7b3169c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.19.0 2024-09-14T11:33:44.811 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:44.814+0000 7f8e7b3169c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.19.1 2024-09-14T11:33:44.812 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:44.814+0000 7f8e7b3169c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.19.2 2024-09-14T11:33:44.813 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:44.814+0000 7f8e7b3169c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.19.3 2024-09-14T11:33:44.814 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:44.818+0000 7f8e7b3169c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.19.4 2024-09-14T11:33:44.815 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:44.818+0000 7f8e7b3169c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.19.5 2024-09-14T11:33:44.815 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:44.818+0000 7f8e7b3169c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.19.6 2024-09-14T11:33:44.816 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:44.818+0000 7f8e7b3169c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.19.7 2024-09-14T11:33:44.816 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:44.818+0000 7f8e7b3169c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.19.8 2024-09-14T11:33:44.817 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:44.818+0000 7f8e7b3169c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.19.9 2024-09-14T11:33:44.818 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:44.822+0000 7f8e7b3169c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.19.10 2024-09-14T11:33:44.818 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:44.822+0000 7f8e7b3169c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-init-index:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.19 : hit (requested=0x17, cached=0x17) 2024-09-14T11:33:44.819 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:44.822+0000 7f8e7b3169c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-init-index:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.19 2024-09-14T11:33:44.820 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:44.822+0000 7f8e7b3169c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-init-index:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.19 info.flags=0x17 2024-09-14T11:33:44.820 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:44.822+0000 7f8e7b3169c0 10 moving default.rgw.meta+root+.bucket.meta.error-at-init-index:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.19 to cache LRU end 2024-09-14T11:33:44.820 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:44.822+0000 7f8e7b3169c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:33:44.821 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:44.822+0000 7f8e7b3169c0 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-init-index:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.19, ofs0, ns] 2024-09-14T11:33:44.821 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:44.822+0000 7f8d4f7fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366172 cookie 93890894626608 notifier 5804 bl.length()=879 2024-09-14T11:33:44.821 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:44.822+0000 7f8d4f7fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-init-index:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.19 info.flags=0x17 2024-09-14T11:33:44.821 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:44.822+0000 7f8d4f7fe640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-init-index:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.19 to cache LRU end 2024-09-14T11:33:44.821 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:44.822+0000 7f8d4f7fe640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:33:44.823 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:44.826+0000 7f8e7b3169c0 20 handle_bi_update(): bucket=:error-at-init-index[d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.19]): orig_sources= new_sources= 2024-09-14T11:33:44.823 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:44.826+0000 7f8e7b3169c0 20 handle_bi_update(): bucket=:error-at-init-index[d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.19]): potential sources added=[] removed=[] 2024-09-14T11:33:44.823 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:44.826+0000 7f8e7b3169c0 20 handle_bi_update(): bucket=:error-at-init-index[d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.19]): orig_dests= new_dests= 2024-09-14T11:33:44.823 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:44.826+0000 7f8e7b3169c0 20 handle_bi_update(): bucket=:error-at-init-index[d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.19]): potential dests added=[] removed=[] 2024-09-14T11:33:44.828 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:44.830+0000 7f8e7b3169c0 1 execute INFO: reshard of bucket "error-at-init-index" from 11 shards to 12 shards completed successfully 2024-09-14T11:33:44.831 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:44.834+0000 7f8d2efe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:33:44.836 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:44.838+0000 7f8e7b3169c0 20 remove_watcher() i=0 2024-09-14T11:33:44.836 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:44.838+0000 7f8e7b3169c0 2 removed watcher, disabling cache 2024-09-14T11:33:44.838 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:44.842+0000 7f8e7b3169c0 20 remove_watcher() i=1 2024-09-14T11:33:44.841 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:44.842+0000 7f8e7b3169c0 20 remove_watcher() i=2 2024-09-14T11:33:44.843 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:44.846+0000 7f8e7b3169c0 20 remove_watcher() i=3 2024-09-14T11:33:44.849 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:44.846+0000 7f8e7b3169c0 20 remove_watcher() i=4 2024-09-14T11:33:44.849 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:44.850+0000 7f8e7b3169c0 20 remove_watcher() i=5 2024-09-14T11:33:44.849 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:44.850+0000 7f8e7b3169c0 20 remove_watcher() i=6 2024-09-14T11:33:44.849 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:44.850+0000 7f8e7b3169c0 20 remove_watcher() i=7 2024-09-14T11:33:44.869 INFO:tasks.workunit.client.0.smithi138.stderr:radosgw-admin bucket stats --bucket error-at-init-index 2024-09-14T11:33:44.899 INFO:tasks.workunit.client.0.smithi138.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:33:44.900 INFO:tasks.workunit.client.0.smithi138.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:33:44.945 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:44.946+0000 7f0124ed49c0 20 rados->read ofs=0 len=0 2024-09-14T11:33:44.947 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:44.950+0000 7f0124ed49c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:33:44.947 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:44.950+0000 7f0124ed49c0 20 realm 2024-09-14T11:33:44.947 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:44.950+0000 7f0124ed49c0 20 rados->read ofs=0 len=0 2024-09-14T11:33:44.947 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:44.950+0000 7f0124ed49c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:33:44.947 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:44.950+0000 7f0124ed49c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:33:44.947 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:44.950+0000 7f0124ed49c0 20 rados->read ofs=0 len=0 2024-09-14T11:33:44.947 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:44.950+0000 7f0124ed49c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:33:44.947 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:44.950+0000 7f0124ed49c0 20 rados->read ofs=0 len=0 2024-09-14T11:33:44.949 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:44.950+0000 7f0124ed49c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:33:44.949 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:44.950+0000 7f0124ed49c0 20 rados->read ofs=0 len=0 2024-09-14T11:33:44.949 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:44.950+0000 7f0124ed49c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:33:44.950 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:44.950+0000 7f0124ed49c0 20 searching for the correct realm 2024-09-14T11:33:44.954 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:44.954+0000 7f01231db640 0 -- 172.21.15.138:0/3381166124 >> [v2:172.21.15.154:6824/416768175,v1:172.21.15.154:6825/416768175] conn(0x7f011c017020 msgr2=0x7f011c0641a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:33:44.960 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:44.962+0000 7f01221d9640 0 -- 172.21.15.138:0/3381166124 >> [v2:172.21.15.138:6816/326481658,v1:172.21.15.138:6817/326481658] conn(0x7f011c06e920 msgr2=0x7f011c066750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:33:45.177 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:45.178+0000 7f0124ed49c0 20 RGWRados::pool_iterate: got zone_info.d9e72d30-c60b-4d0d-9267-fdc36392d5ad 2024-09-14T11:33:45.177 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:45.178+0000 7f0124ed49c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:33:45.177 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:45.178+0000 7f0124ed49c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:33:45.177 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:45.178+0000 7f0124ed49c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:33:45.178 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:45.178+0000 7f0124ed49c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:33:45.178 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:45.178+0000 7f0124ed49c0 20 RGWRados::pool_iterate: got zonegroup_info.65ab941b-da8c-4160-94fb-3672b069d44f 2024-09-14T11:33:45.178 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:45.178+0000 7f0124ed49c0 20 rados->read ofs=0 len=0 2024-09-14T11:33:45.178 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:45.178+0000 7f0124ed49c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:33:45.178 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:45.178+0000 7f0124ed49c0 20 rados->read ofs=0 len=0 2024-09-14T11:33:45.178 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:45.182+0000 7f0124ed49c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:33:45.179 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:45.182+0000 7f0124ed49c0 20 rados->read ofs=0 len=0 2024-09-14T11:33:45.179 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:45.182+0000 7f0124ed49c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:33:45.179 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:45.182+0000 7f0124ed49c0 20 zone default found 2024-09-14T11:33:45.180 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:45.182+0000 7f0124ed49c0 4 Realm: () 2024-09-14T11:33:45.180 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:45.182+0000 7f0124ed49c0 4 ZoneGroup: default (65ab941b-da8c-4160-94fb-3672b069d44f) 2024-09-14T11:33:45.180 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:45.182+0000 7f0124ed49c0 4 Zone: default (d9e72d30-c60b-4d0d-9267-fdc36392d5ad) 2024-09-14T11:33:45.180 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:45.182+0000 7f0124ed49c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:33:45.180 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:45.182+0000 7f0124ed49c0 20 zonegroup default 2024-09-14T11:33:45.180 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:45.182+0000 7f0124ed49c0 20 rados->read ofs=0 len=0 2024-09-14T11:33:45.180 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:45.182+0000 7f0124ed49c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:33:45.181 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:45.182+0000 7f0124ed49c0 20 rados->read ofs=0 len=0 2024-09-14T11:33:45.181 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:45.182+0000 7f0124ed49c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:33:45.181 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:45.182+0000 7f0124ed49c0 20 rados->read ofs=0 len=0 2024-09-14T11:33:45.182 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:45.186+0000 7f0124ed49c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:33:45.182 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:45.186+0000 7f0124ed49c0 20 started sync module instance, tier type = 2024-09-14T11:33:45.182 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:45.186+0000 7f0124ed49c0 20 started zone id=d9e72d30-c60b-4d0d-9267-fdc36392d5ad (name=default) with tier type = 2024-09-14T11:33:45.207 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:45.210+0000 7f0124ed49c0 20 add_watcher() i=0 2024-09-14T11:33:45.207 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:45.210+0000 7f0124ed49c0 20 add_watcher() i=1 2024-09-14T11:33:45.207 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:45.210+0000 7f0124ed49c0 20 add_watcher() i=2 2024-09-14T11:33:45.207 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:45.210+0000 7f0124ed49c0 20 add_watcher() i=3 2024-09-14T11:33:45.207 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:45.210+0000 7f0124ed49c0 20 add_watcher() i=4 2024-09-14T11:33:45.207 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:45.210+0000 7f0124ed49c0 20 add_watcher() i=5 2024-09-14T11:33:45.207 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:45.210+0000 7f0124ed49c0 20 add_watcher() i=6 2024-09-14T11:33:45.209 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:45.210+0000 7f0124ed49c0 20 add_watcher() i=7 2024-09-14T11:33:45.209 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:45.210+0000 7f0124ed49c0 2 all 8 watchers are set, enabling cache 2024-09-14T11:33:45.214 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:45.214+0000 7effd97e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:33:45.215 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:45.218+0000 7f0124ed49c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:33:45.215 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:45.218+0000 7f0124ed49c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:33:45.215 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:45.218+0000 7f0124ed49c0 5 note: GC not initialized 2024-09-14T11:33:45.215 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:45.218+0000 7eff53fff640 20 reqs_thread_entry: start 2024-09-14T11:33:45.215 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:45.218+0000 7f0124ed49c0 20 init_complete bucket index max shards: 11 2024-09-14T11:33:45.216 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:45.218+0000 7f0124ed49c0 20 Filter name: none 2024-09-14T11:33:45.216 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:45.218+0000 7eff51ffb640 20 reqs_thread_entry: start 2024-09-14T11:33:45.216 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:45.218+0000 7f0124ed49c0 20 rados->read ofs=0 len=0 2024-09-14T11:33:45.217 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:45.218+0000 7f0124ed49c0 20 rados_obj.operate() r=0 bl.length=187 2024-09-14T11:33:45.217 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:45.218+0000 7f0124ed49c0 20 rados->read ofs=0 len=0 2024-09-14T11:33:45.218 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:45.222+0000 7f0124ed49c0 20 rados_obj.operate() r=0 bl.length=409 2024-09-14T11:33:45.218 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:45.222+0000 7f0124ed49c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:33:45.219 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:45.222+0000 7f0124ed49c0 20 rados->read ofs=0 len=0 2024-09-14T11:33:45.219 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:45.222+0000 7f0124ed49c0 20 rados_obj.operate() r=0 bl.length=187 2024-09-14T11:33:45.219 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:45.222+0000 7f0124ed49c0 20 rados->read ofs=0 len=0 2024-09-14T11:33:45.220 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:45.222+0000 7f0124ed49c0 20 rados_obj.operate() r=0 bl.length=409 2024-09-14T11:33:45.220 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:45.222+0000 7f0124ed49c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:33:45.223 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:45.226+0000 7effd97e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:33:45.229 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:45.230+0000 7f0124ed49c0 20 remove_watcher() i=0 2024-09-14T11:33:45.229 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:45.230+0000 7f0124ed49c0 2 removed watcher, disabling cache 2024-09-14T11:33:45.231 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:45.234+0000 7f0124ed49c0 20 remove_watcher() i=1 2024-09-14T11:33:45.233 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:45.234+0000 7f0124ed49c0 20 remove_watcher() i=2 2024-09-14T11:33:45.236 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:45.238+0000 7f0124ed49c0 20 remove_watcher() i=3 2024-09-14T11:33:45.238 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:45.238+0000 7f0124ed49c0 20 remove_watcher() i=4 2024-09-14T11:33:45.239 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:45.242+0000 7f0124ed49c0 20 remove_watcher() i=5 2024-09-14T11:33:45.241 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:45.242+0000 7f0124ed49c0 20 remove_watcher() i=6 2024-09-14T11:33:45.242 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:45.246+0000 7f0124ed49c0 20 remove_watcher() i=7 2024-09-14T11:33:45.257 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-14T11:33:45.257 INFO:tasks.workunit.client.0.smithi138.stderr:BUCKET_STATS: 2024-09-14T11:33:45.257 INFO:tasks.workunit.client.0.smithi138.stderr:bucket: error-at-init-index id: d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.19 num_objects: 19 size_kb: 1 num_shards: 12 2024-09-14T11:33:45.257 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-14T11:33:45.258 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:33:45.259 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-14T11:33:45.284 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:33:45.284 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-14T11:33:45.760 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:33:45.760 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-14T11:33:46.130 INFO:tasks.workunit.client.0.smithi138.stderr:TEST: reshard bucket with EOPNOTSUPP injected at init_index 2024-09-14T11:33:46.130 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-14T11:33:46.132 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:33:46.132 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-14T11:33:46.272 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:33:46.272 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-14T11:33:46.361 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:33:46.361 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-14T11:33:46.451 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:33:46.451 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-14T11:33:46.544 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:33:46.544 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-14T11:33:46.630 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:33:46.630 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-14T11:33:46.718 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:33:46.718 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-14T11:33:46.814 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:33:46.815 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-14T11:33:46.912 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:33:46.913 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-14T11:33:47.010 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:33:47.010 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-14T11:33:47.101 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:33:47.101 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-14T11:33:47.186 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:33:47.186 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-14T11:33:47.275 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:33:47.275 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-14T11:33:47.366 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:33:47.366 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-14T11:33:47.456 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:33:47.456 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-14T11:33:47.551 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:33:47.551 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-14T11:33:47.643 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:33:47.644 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-14T11:33:47.737 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:33:47.738 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-14T11:33:47.824 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:33:47.824 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-14T11:33:47.913 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:33:47.914 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-14T11:33:48.008 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:33:48.009 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-14T11:33:48.100 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:33:48.100 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-14T11:33:48.193 INFO:tasks.workunit.client.0.smithi138.stderr:radosgw-admin bucket stats --bucket error-at-init-index 2024-09-14T11:33:48.225 INFO:tasks.workunit.client.0.smithi138.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:33:48.225 INFO:tasks.workunit.client.0.smithi138.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:33:48.271 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:48.274+0000 7f0b6ec059c0 20 rados->read ofs=0 len=0 2024-09-14T11:33:48.273 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:48.274+0000 7f0b6ec059c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:33:48.273 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:48.274+0000 7f0b6ec059c0 20 realm 2024-09-14T11:33:48.273 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:48.274+0000 7f0b6ec059c0 20 rados->read ofs=0 len=0 2024-09-14T11:33:48.273 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:48.274+0000 7f0b6ec059c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:33:48.273 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:48.274+0000 7f0b6ec059c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:33:48.273 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:48.274+0000 7f0b6ec059c0 20 rados->read ofs=0 len=0 2024-09-14T11:33:48.274 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:48.274+0000 7f0b6ec059c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:33:48.274 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:48.274+0000 7f0b6ec059c0 20 rados->read ofs=0 len=0 2024-09-14T11:33:48.275 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:48.278+0000 7f0b6ec059c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:33:48.275 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:48.278+0000 7f0b6ec059c0 20 rados->read ofs=0 len=0 2024-09-14T11:33:48.276 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:48.278+0000 7f0b6ec059c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:33:48.276 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:48.278+0000 7f0b6ec059c0 20 searching for the correct realm 2024-09-14T11:33:48.281 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:48.282+0000 7f0b6c70b640 0 -- 172.21.15.138:0/2468610710 >> [v2:172.21.15.138:6808/3258321916,v1:172.21.15.138:6809/3258321916] conn(0x55e627379ac0 msgr2=0x55e62737bf80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:33:48.287 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:48.290+0000 7f0b6bf0a640 0 -- 172.21.15.138:0/2468610710 >> [v2:172.21.15.138:6816/326481658,v1:172.21.15.138:6817/326481658] conn(0x7f0b640e7970 msgr2=0x7f0b640e43e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:33:48.295 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:48.298+0000 7f0b6ec059c0 20 RGWRados::pool_iterate: got zone_info.d9e72d30-c60b-4d0d-9267-fdc36392d5ad 2024-09-14T11:33:48.295 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:48.298+0000 7f0b6ec059c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:33:48.296 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:48.298+0000 7f0b6ec059c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:33:48.296 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:48.298+0000 7f0b6ec059c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:33:48.296 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:48.298+0000 7f0b6ec059c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:33:48.296 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:48.298+0000 7f0b6ec059c0 20 RGWRados::pool_iterate: got zonegroup_info.65ab941b-da8c-4160-94fb-3672b069d44f 2024-09-14T11:33:48.296 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:48.298+0000 7f0b6ec059c0 20 rados->read ofs=0 len=0 2024-09-14T11:33:48.296 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:48.298+0000 7f0b6ec059c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:33:48.296 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:48.298+0000 7f0b6ec059c0 20 rados->read ofs=0 len=0 2024-09-14T11:33:48.296 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:48.298+0000 7f0b6ec059c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:33:48.296 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:48.298+0000 7f0b6ec059c0 20 rados->read ofs=0 len=0 2024-09-14T11:33:48.298 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:48.298+0000 7f0b6ec059c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:33:48.298 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:48.298+0000 7f0b6ec059c0 20 zone default found 2024-09-14T11:33:48.298 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:48.298+0000 7f0b6ec059c0 4 Realm: () 2024-09-14T11:33:48.298 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:48.298+0000 7f0b6ec059c0 4 ZoneGroup: default (65ab941b-da8c-4160-94fb-3672b069d44f) 2024-09-14T11:33:48.299 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:48.298+0000 7f0b6ec059c0 4 Zone: default (d9e72d30-c60b-4d0d-9267-fdc36392d5ad) 2024-09-14T11:33:48.299 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:48.298+0000 7f0b6ec059c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:33:48.299 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:48.298+0000 7f0b6ec059c0 20 zonegroup default 2024-09-14T11:33:48.299 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:48.298+0000 7f0b6ec059c0 20 rados->read ofs=0 len=0 2024-09-14T11:33:48.299 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:48.302+0000 7f0b6ec059c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:33:48.299 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:48.302+0000 7f0b6ec059c0 20 rados->read ofs=0 len=0 2024-09-14T11:33:48.299 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:48.302+0000 7f0b6ec059c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:33:48.299 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:48.302+0000 7f0b6ec059c0 20 rados->read ofs=0 len=0 2024-09-14T11:33:48.299 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:48.302+0000 7f0b6ec059c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:33:48.300 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:48.302+0000 7f0b6ec059c0 20 started sync module instance, tier type = 2024-09-14T11:33:48.300 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:48.302+0000 7f0b6ec059c0 20 started zone id=d9e72d30-c60b-4d0d-9267-fdc36392d5ad (name=default) with tier type = 2024-09-14T11:33:48.316 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:48.318+0000 7f0b6ec059c0 20 add_watcher() i=0 2024-09-14T11:33:48.316 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:48.318+0000 7f0b6ec059c0 20 add_watcher() i=1 2024-09-14T11:33:48.316 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:48.318+0000 7f0b6ec059c0 20 add_watcher() i=2 2024-09-14T11:33:48.316 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:48.318+0000 7f0b6ec059c0 20 add_watcher() i=3 2024-09-14T11:33:48.317 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:48.318+0000 7f0b6ec059c0 20 add_watcher() i=4 2024-09-14T11:33:48.317 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:48.318+0000 7f0b6ec059c0 20 add_watcher() i=5 2024-09-14T11:33:48.317 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:48.318+0000 7f0b6ec059c0 20 add_watcher() i=6 2024-09-14T11:33:48.317 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:48.318+0000 7f0b6ec059c0 20 add_watcher() i=7 2024-09-14T11:33:48.317 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:48.318+0000 7f0b6ec059c0 2 all 8 watchers are set, enabling cache 2024-09-14T11:33:48.320 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:48.322+0000 7f0a22fdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:33:48.321 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:48.322+0000 7f0b6ec059c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:33:48.321 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:48.322+0000 7f0b6ec059c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:33:48.321 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:48.322+0000 7f0b6ec059c0 5 note: GC not initialized 2024-09-14T11:33:48.321 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:48.322+0000 7f0a21fdb640 20 reqs_thread_entry: start 2024-09-14T11:33:48.321 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:48.322+0000 7f0b6ec059c0 20 init_complete bucket index max shards: 11 2024-09-14T11:33:48.321 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:48.322+0000 7f0b6ec059c0 20 Filter name: none 2024-09-14T11:33:48.321 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:48.322+0000 7f09937fe640 20 reqs_thread_entry: start 2024-09-14T11:33:48.321 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:48.322+0000 7f0b6ec059c0 20 rados->read ofs=0 len=0 2024-09-14T11:33:48.322 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:48.322+0000 7f0b6ec059c0 20 rados_obj.operate() r=0 bl.length=187 2024-09-14T11:33:48.322 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:48.322+0000 7f0b6ec059c0 20 rados->read ofs=0 len=0 2024-09-14T11:33:48.323 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:48.326+0000 7f0b6ec059c0 20 rados_obj.operate() r=0 bl.length=409 2024-09-14T11:33:48.323 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:48.326+0000 7f0b6ec059c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:33:48.323 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:48.326+0000 7f0b6ec059c0 20 rados->read ofs=0 len=0 2024-09-14T11:33:48.323 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:48.326+0000 7f0b6ec059c0 20 rados_obj.operate() r=0 bl.length=187 2024-09-14T11:33:48.324 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:48.326+0000 7f0b6ec059c0 20 rados->read ofs=0 len=0 2024-09-14T11:33:48.324 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:48.326+0000 7f0b6ec059c0 20 rados_obj.operate() r=0 bl.length=409 2024-09-14T11:33:48.324 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:48.326+0000 7f0b6ec059c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:33:48.326 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:48.330+0000 7f0a22fdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:33:48.332 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:48.334+0000 7f0b6ec059c0 20 remove_watcher() i=0 2024-09-14T11:33:48.332 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:48.334+0000 7f0b6ec059c0 2 removed watcher, disabling cache 2024-09-14T11:33:48.334 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:48.334+0000 7f0b6ec059c0 20 remove_watcher() i=1 2024-09-14T11:33:48.336 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:48.338+0000 7f0b6ec059c0 20 remove_watcher() i=2 2024-09-14T11:33:48.338 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:48.342+0000 7f0b6ec059c0 20 remove_watcher() i=3 2024-09-14T11:33:48.340 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:48.342+0000 7f0b6ec059c0 20 remove_watcher() i=4 2024-09-14T11:33:48.342 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:48.342+0000 7f0b6ec059c0 20 remove_watcher() i=5 2024-09-14T11:33:48.343 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:48.346+0000 7f0b6ec059c0 20 remove_watcher() i=6 2024-09-14T11:33:48.345 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:48.346+0000 7f0b6ec059c0 20 remove_watcher() i=7 2024-09-14T11:33:48.359 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-14T11:33:48.359 INFO:tasks.workunit.client.0.smithi138.stderr:BUCKET_STATS: 2024-09-14T11:33:48.359 INFO:tasks.workunit.client.0.smithi138.stderr:bucket: error-at-init-index id: d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.20 num_objects: 20 size_kb: 1 num_shards: 11 2024-09-14T11:33:48.359 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-14T11:33:48.359 INFO:tasks.workunit.client.0.smithi138.stderr:radosgw-admin bucket reshard --bucket error-at-init-index --num-shards 12 --rgw-reshard-bucket-lock-duration 30 --inject-error-at init_index --inject-error-code 95 2024-09-14T11:33:48.394 INFO:tasks.workunit.client.0.smithi138.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:33:48.394 INFO:tasks.workunit.client.0.smithi138.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:33:48.437 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:48.438+0000 7f4591cd99c0 20 rados->read ofs=0 len=0 2024-09-14T11:33:48.438 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:48.442+0000 7f4591cd99c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:33:48.439 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:48.442+0000 7f4591cd99c0 20 realm 2024-09-14T11:33:48.439 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:48.442+0000 7f4591cd99c0 20 rados->read ofs=0 len=0 2024-09-14T11:33:48.439 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:48.442+0000 7f4591cd99c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:33:48.439 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:48.442+0000 7f4591cd99c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:33:48.439 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:48.442+0000 7f4591cd99c0 20 rados->read ofs=0 len=0 2024-09-14T11:33:48.440 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:48.442+0000 7f4591cd99c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:33:48.440 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:48.442+0000 7f4591cd99c0 20 rados->read ofs=0 len=0 2024-09-14T11:33:48.441 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:48.442+0000 7f4591cd99c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:33:48.441 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:48.442+0000 7f4591cd99c0 20 rados->read ofs=0 len=0 2024-09-14T11:33:48.442 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:48.446+0000 7f4591cd99c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:33:48.442 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:48.446+0000 7f4591cd99c0 20 searching for the correct realm 2024-09-14T11:33:48.445 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:48.446+0000 7f458ffe0640 0 -- 172.21.15.138:0/3187884922 >> [v2:172.21.15.154:6824/416768175,v1:172.21.15.154:6825/416768175] conn(0x7f4588083040 msgr2=0x7f45880866c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:33:48.659 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:48.662+0000 7f458efde640 0 -- 172.21.15.138:0/3187884922 >> [v2:172.21.15.138:6816/326481658,v1:172.21.15.138:6817/326481658] conn(0x7f458807fda0 msgr2=0x7f4588070a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:33:48.878 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:48.878+0000 7f4591cd99c0 20 RGWRados::pool_iterate: got zone_info.d9e72d30-c60b-4d0d-9267-fdc36392d5ad 2024-09-14T11:33:48.878 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:48.878+0000 7f4591cd99c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:33:48.878 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:48.878+0000 7f4591cd99c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:33:48.879 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:48.878+0000 7f4591cd99c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:33:48.879 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:48.878+0000 7f4591cd99c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:33:48.879 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:48.878+0000 7f4591cd99c0 20 RGWRados::pool_iterate: got zonegroup_info.65ab941b-da8c-4160-94fb-3672b069d44f 2024-09-14T11:33:48.879 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:48.878+0000 7f4591cd99c0 20 rados->read ofs=0 len=0 2024-09-14T11:33:48.879 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:48.882+0000 7f4591cd99c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:33:48.879 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:48.882+0000 7f4591cd99c0 20 rados->read ofs=0 len=0 2024-09-14T11:33:48.879 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:48.882+0000 7f4591cd99c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:33:48.879 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:48.882+0000 7f4591cd99c0 20 rados->read ofs=0 len=0 2024-09-14T11:33:48.880 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:48.882+0000 7f4591cd99c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:33:48.881 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:48.882+0000 7f4591cd99c0 20 zone default found 2024-09-14T11:33:48.881 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:48.882+0000 7f4591cd99c0 4 Realm: () 2024-09-14T11:33:48.881 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:48.882+0000 7f4591cd99c0 4 ZoneGroup: default (65ab941b-da8c-4160-94fb-3672b069d44f) 2024-09-14T11:33:48.881 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:48.882+0000 7f4591cd99c0 4 Zone: default (d9e72d30-c60b-4d0d-9267-fdc36392d5ad) 2024-09-14T11:33:48.881 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:48.882+0000 7f4591cd99c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:33:48.881 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:48.882+0000 7f4591cd99c0 20 zonegroup default 2024-09-14T11:33:48.881 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:48.882+0000 7f4591cd99c0 20 rados->read ofs=0 len=0 2024-09-14T11:33:48.881 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:48.882+0000 7f4591cd99c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:33:48.881 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:48.882+0000 7f4591cd99c0 20 rados->read ofs=0 len=0 2024-09-14T11:33:48.881 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:48.882+0000 7f4591cd99c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:33:48.882 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:48.882+0000 7f4591cd99c0 20 rados->read ofs=0 len=0 2024-09-14T11:33:48.882 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:48.886+0000 7f4591cd99c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:33:48.882 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:48.886+0000 7f4591cd99c0 20 started sync module instance, tier type = 2024-09-14T11:33:48.882 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:48.886+0000 7f4591cd99c0 20 started zone id=d9e72d30-c60b-4d0d-9267-fdc36392d5ad (name=default) with tier type = 2024-09-14T11:33:48.906 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:48.906+0000 7f4591cd99c0 20 add_watcher() i=0 2024-09-14T11:33:48.906 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:48.906+0000 7f4591cd99c0 20 add_watcher() i=1 2024-09-14T11:33:48.906 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:48.906+0000 7f4591cd99c0 20 add_watcher() i=2 2024-09-14T11:33:48.906 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:48.906+0000 7f4591cd99c0 20 add_watcher() i=3 2024-09-14T11:33:48.906 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:48.906+0000 7f4591cd99c0 20 add_watcher() i=4 2024-09-14T11:33:48.906 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:48.906+0000 7f4591cd99c0 20 add_watcher() i=5 2024-09-14T11:33:48.906 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:48.906+0000 7f4591cd99c0 20 add_watcher() i=6 2024-09-14T11:33:48.907 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:48.910+0000 7f4591cd99c0 20 add_watcher() i=7 2024-09-14T11:33:48.908 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:48.910+0000 7f4591cd99c0 2 all 8 watchers are set, enabling cache 2024-09-14T11:33:48.911 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:48.914+0000 7f4445fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:33:48.912 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:48.914+0000 7f4591cd99c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:33:48.912 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:48.914+0000 7f4591cd99c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:33:48.912 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:48.914+0000 7f4591cd99c0 5 note: GC not initialized 2024-09-14T11:33:48.913 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:48.914+0000 7f4444fe1640 20 reqs_thread_entry: start 2024-09-14T11:33:48.913 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:48.914+0000 7f4591cd99c0 20 init_complete bucket index max shards: 11 2024-09-14T11:33:48.913 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:48.914+0000 7f4591cd99c0 20 Filter name: none 2024-09-14T11:33:48.913 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:48.914+0000 7f43be7fc640 20 reqs_thread_entry: start 2024-09-14T11:33:48.913 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:48.914+0000 7f4591cd99c0 10 cache get: name=default.rgw.meta+root+error-at-init-index : miss 2024-09-14T11:33:48.913 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:48.914+0000 7f4591cd99c0 20 rados->read ofs=0 len=0 2024-09-14T11:33:48.914 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:48.914+0000 7f4591cd99c0 20 rados_obj.operate() r=0 bl.length=187 2024-09-14T11:33:48.914 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:48.914+0000 7f4591cd99c0 10 cache put: name=default.rgw.meta+root+error-at-init-index info.flags=0x11 2024-09-14T11:33:48.914 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:48.914+0000 7f4591cd99c0 10 adding default.rgw.meta+root+error-at-init-index to cache LRU end 2024-09-14T11:33:48.914 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:48.914+0000 7f4591cd99c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-init-index:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.20 : miss 2024-09-14T11:33:48.914 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:48.914+0000 7f4591cd99c0 20 rados->read ofs=0 len=0 2024-09-14T11:33:48.915 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:48.918+0000 7f4591cd99c0 20 rados_obj.operate() r=0 bl.length=409 2024-09-14T11:33:48.915 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:48.918+0000 7f4591cd99c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-init-index:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.20 info.flags=0x17 2024-09-14T11:33:48.915 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:48.918+0000 7f4591cd99c0 10 adding default.rgw.meta+root+.bucket.meta.error-at-init-index:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.20 to cache LRU end 2024-09-14T11:33:48.915 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:48.918+0000 7f4591cd99c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:33:48.915 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:48.918+0000 7f4591cd99c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:33:48.915 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:48.918+0000 7f4591cd99c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-init-index:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.20 2024-09-14T11:33:48.917 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:48.918+0000 7f4591cd99c0 -1 Injecting error=-95 at location=init_index 2024-09-14T11:33:48.917 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:48.918+0000 7f4591cd99c0 0 WARNING: init_index() does not supported logrecord, falling back to block reshard mode. 2024-09-14T11:33:48.925 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:48.926+0000 7f4591cd99c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-init-index:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.20 info.flags=0x17 2024-09-14T11:33:48.925 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:48.926+0000 7f4591cd99c0 10 moving default.rgw.meta+root+.bucket.meta.error-at-init-index:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.20 to cache LRU end 2024-09-14T11:33:48.925 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:48.926+0000 7f4591cd99c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:33:48.925 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:48.926+0000 7f4591cd99c0 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-init-index:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.20, ofs0, ns] 2024-09-14T11:33:48.925 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:48.926+0000 7f4472ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366175 cookie 94019407584192 notifier 5855 bl.length()=911 2024-09-14T11:33:48.926 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:48.926+0000 7f4472ffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-init-index:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.20 info.flags=0x17 2024-09-14T11:33:48.926 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:48.926+0000 7f4472ffd640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-init-index:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.20 to cache LRU end 2024-09-14T11:33:48.926 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:48.926+0000 7f4472ffd640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:33:48.928 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:48.930+0000 7f4591cd99c0 20 handle_bi_update(): bucket=:error-at-init-index[d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.20]): orig_sources= new_sources= 2024-09-14T11:33:48.928 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:48.930+0000 7f4591cd99c0 20 handle_bi_update(): bucket=:error-at-init-index[d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.20]): potential sources added=[] removed=[] 2024-09-14T11:33:48.928 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:48.930+0000 7f4591cd99c0 20 handle_bi_update(): bucket=:error-at-init-index[d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.20]): orig_dests= new_dests= 2024-09-14T11:33:48.928 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:48.930+0000 7f4591cd99c0 20 handle_bi_update(): bucket=:error-at-init-index[d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.20]): potential dests added=[] removed=[] 2024-09-14T11:33:48.934 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:48.938+0000 7f4591cd99c0 10 bucket_obj is .dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.20.1.0 2024-09-14T11:33:48.934 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:48.938+0000 7f4591cd99c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.20.1.0 2024-09-14T11:33:48.934 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:48.938+0000 7f4591cd99c0 10 bucket_obj is .dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.20.1.1 2024-09-14T11:33:48.934 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:48.938+0000 7f4591cd99c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.20.1.1 2024-09-14T11:33:48.935 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:48.938+0000 7f4591cd99c0 10 bucket_obj is .dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.20.1.2 2024-09-14T11:33:48.935 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:48.938+0000 7f4591cd99c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.20.1.2 2024-09-14T11:33:48.935 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:48.938+0000 7f4591cd99c0 10 bucket_obj is .dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.20.1.3 2024-09-14T11:33:48.935 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:48.938+0000 7f4591cd99c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.20.1.3 2024-09-14T11:33:48.935 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:48.938+0000 7f4591cd99c0 10 bucket_obj is .dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.20.1.4 2024-09-14T11:33:48.935 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:48.938+0000 7f4591cd99c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.20.1.4 2024-09-14T11:33:48.935 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:48.938+0000 7f4591cd99c0 10 bucket_obj is .dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.20.1.5 2024-09-14T11:33:48.935 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:48.938+0000 7f4591cd99c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.20.1.5 2024-09-14T11:33:48.935 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:48.938+0000 7f4591cd99c0 10 bucket_obj is .dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.20.1.6 2024-09-14T11:33:48.935 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:48.938+0000 7f4591cd99c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.20.1.6 2024-09-14T11:33:48.935 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:48.938+0000 7f4591cd99c0 10 bucket_obj is .dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.20.1.7 2024-09-14T11:33:48.935 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:48.938+0000 7f4591cd99c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.20.1.7 2024-09-14T11:33:48.935 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:48.938+0000 7f4591cd99c0 10 bucket_obj is .dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.20.1.8 2024-09-14T11:33:48.935 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:48.938+0000 7f4591cd99c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.20.1.8 2024-09-14T11:33:48.936 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:48.938+0000 7f4591cd99c0 10 bucket_obj is .dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.20.1.9 2024-09-14T11:33:48.936 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:48.938+0000 7f4591cd99c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.20.1.9 2024-09-14T11:33:48.936 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:48.938+0000 7f4591cd99c0 10 bucket_obj is .dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.20.1.10 2024-09-14T11:33:48.936 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:48.938+0000 7f4591cd99c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.20.1.10 2024-09-14T11:33:48.936 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:48.938+0000 7f4591cd99c0 10 bucket_obj is .dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.20.1.11 2024-09-14T11:33:48.936 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:48.938+0000 7f4591cd99c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.20.1.11 2024-09-14T11:33:48.936 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:48.938+0000 7f4591cd99c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.20.0 2024-09-14T11:33:48.936 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:48.938+0000 7f4591cd99c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.20.1 2024-09-14T11:33:48.936 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:48.938+0000 7f4591cd99c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.20.2 2024-09-14T11:33:48.938 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:48.938+0000 7f4591cd99c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.20.3 2024-09-14T11:33:48.938 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:48.942+0000 7f4591cd99c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.20.4 2024-09-14T11:33:48.939 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:48.942+0000 7f4591cd99c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.20.5 2024-09-14T11:33:48.941 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:48.942+0000 7f4591cd99c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.20.6 2024-09-14T11:33:48.942 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:48.946+0000 7f4591cd99c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.20.7 2024-09-14T11:33:48.943 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:48.946+0000 7f4591cd99c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.20.8 2024-09-14T11:33:48.944 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:48.946+0000 7f4591cd99c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.20.9 2024-09-14T11:33:48.945 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:48.946+0000 7f4591cd99c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.20.10 2024-09-14T11:33:48.952 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:48.954+0000 7f4591cd99c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-init-index:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.20 : hit (requested=0x17, cached=0x17) 2024-09-14T11:33:48.952 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:48.954+0000 7f4591cd99c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-init-index:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.20 2024-09-14T11:33:48.954 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:48.958+0000 7f4591cd99c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-init-index:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.20 info.flags=0x17 2024-09-14T11:33:48.954 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:48.958+0000 7f4591cd99c0 10 moving default.rgw.meta+root+.bucket.meta.error-at-init-index:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.20 to cache LRU end 2024-09-14T11:33:48.954 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:48.958+0000 7f4591cd99c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:33:48.954 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:48.958+0000 7f4591cd99c0 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-init-index:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.20, ofs0, ns] 2024-09-14T11:33:48.955 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:48.958+0000 7f4472ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366176 cookie 94019407584192 notifier 5855 bl.length()=879 2024-09-14T11:33:48.955 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:48.958+0000 7f4472ffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-init-index:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.20 info.flags=0x17 2024-09-14T11:33:48.955 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:48.958+0000 7f4472ffd640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-init-index:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.20 to cache LRU end 2024-09-14T11:33:48.955 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:48.958+0000 7f4472ffd640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:33:48.957 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:48.958+0000 7f4591cd99c0 20 handle_bi_update(): bucket=:error-at-init-index[d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.20]): orig_sources= new_sources= 2024-09-14T11:33:48.957 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:48.958+0000 7f4591cd99c0 20 handle_bi_update(): bucket=:error-at-init-index[d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.20]): potential sources added=[] removed=[] 2024-09-14T11:33:48.957 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:48.958+0000 7f4591cd99c0 20 handle_bi_update(): bucket=:error-at-init-index[d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.20]): orig_dests= new_dests= 2024-09-14T11:33:48.957 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:48.958+0000 7f4591cd99c0 20 handle_bi_update(): bucket=:error-at-init-index[d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.20]): potential dests added=[] removed=[] 2024-09-14T11:33:48.962 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:48.962+0000 7f4591cd99c0 1 execute INFO: reshard of bucket "error-at-init-index" from 11 shards to 12 shards completed successfully 2024-09-14T11:33:48.965 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:48.966+0000 7f4445fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:33:48.970 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:48.970+0000 7f4591cd99c0 20 remove_watcher() i=0 2024-09-14T11:33:48.970 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:48.970+0000 7f4591cd99c0 2 removed watcher, disabling cache 2024-09-14T11:33:48.972 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:48.974+0000 7f4591cd99c0 20 remove_watcher() i=1 2024-09-14T11:33:48.974 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:48.978+0000 7f4591cd99c0 20 remove_watcher() i=2 2024-09-14T11:33:48.976 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:48.978+0000 7f4591cd99c0 20 remove_watcher() i=3 2024-09-14T11:33:48.978 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:48.982+0000 7f4591cd99c0 20 remove_watcher() i=4 2024-09-14T11:33:48.980 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:48.982+0000 7f4591cd99c0 20 remove_watcher() i=5 2024-09-14T11:33:48.981 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:48.982+0000 7f4591cd99c0 20 remove_watcher() i=6 2024-09-14T11:33:48.982 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:48.986+0000 7f4591cd99c0 20 remove_watcher() i=7 2024-09-14T11:33:48.998 INFO:tasks.workunit.client.0.smithi138.stderr:radosgw-admin bucket stats --bucket error-at-init-index 2024-09-14T11:33:49.027 INFO:tasks.workunit.client.0.smithi138.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:33:49.027 INFO:tasks.workunit.client.0.smithi138.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:33:49.071 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:49.074+0000 7f205cd0a9c0 20 rados->read ofs=0 len=0 2024-09-14T11:33:49.074 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:49.074+0000 7f205cd0a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:33:49.074 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:49.074+0000 7f205cd0a9c0 20 realm 2024-09-14T11:33:49.074 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:49.074+0000 7f205cd0a9c0 20 rados->read ofs=0 len=0 2024-09-14T11:33:49.074 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:49.074+0000 7f205cd0a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:33:49.074 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:49.074+0000 7f205cd0a9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:33:49.074 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:49.074+0000 7f205cd0a9c0 20 rados->read ofs=0 len=0 2024-09-14T11:33:49.074 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:49.074+0000 7f205cd0a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:33:49.074 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:49.074+0000 7f205cd0a9c0 20 rados->read ofs=0 len=0 2024-09-14T11:33:49.075 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:49.078+0000 7f205cd0a9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:33:49.075 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:49.078+0000 7f205cd0a9c0 20 rados->read ofs=0 len=0 2024-09-14T11:33:49.076 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:49.078+0000 7f205cd0a9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:33:49.076 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:49.078+0000 7f205cd0a9c0 20 searching for the correct realm 2024-09-14T11:33:49.082 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:49.086+0000 7f205a810640 0 -- 172.21.15.138:0/425815689 >> [v2:172.21.15.138:6800/1799335858,v1:172.21.15.138:6801/1799335858] conn(0x564b06788e80 msgr2=0x564b0678b270 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:33:49.089 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:49.090+0000 7f205b011640 0 -- 172.21.15.138:0/425815689 >> [v2:172.21.15.154:6824/416768175,v1:172.21.15.154:6825/416768175] conn(0x7f2054107030 msgr2=0x7f2054113ab0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:33:49.096 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:49.098+0000 7f205cd0a9c0 20 RGWRados::pool_iterate: got zone_info.d9e72d30-c60b-4d0d-9267-fdc36392d5ad 2024-09-14T11:33:49.096 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:49.098+0000 7f205cd0a9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:33:49.096 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:49.098+0000 7f205cd0a9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:33:49.096 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:49.098+0000 7f205cd0a9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:33:49.096 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:49.098+0000 7f205cd0a9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:33:49.096 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:49.098+0000 7f205cd0a9c0 20 RGWRados::pool_iterate: got zonegroup_info.65ab941b-da8c-4160-94fb-3672b069d44f 2024-09-14T11:33:49.096 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:49.098+0000 7f205cd0a9c0 20 rados->read ofs=0 len=0 2024-09-14T11:33:49.097 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:49.098+0000 7f205cd0a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:33:49.097 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:49.098+0000 7f205cd0a9c0 20 rados->read ofs=0 len=0 2024-09-14T11:33:49.097 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:49.098+0000 7f205cd0a9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:33:49.097 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:49.098+0000 7f205cd0a9c0 20 rados->read ofs=0 len=0 2024-09-14T11:33:49.098 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:49.098+0000 7f205cd0a9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:33:49.098 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:49.098+0000 7f205cd0a9c0 20 zone default found 2024-09-14T11:33:49.098 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:49.098+0000 7f205cd0a9c0 4 Realm: () 2024-09-14T11:33:49.098 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:49.098+0000 7f205cd0a9c0 4 ZoneGroup: default (65ab941b-da8c-4160-94fb-3672b069d44f) 2024-09-14T11:33:49.098 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:49.098+0000 7f205cd0a9c0 4 Zone: default (d9e72d30-c60b-4d0d-9267-fdc36392d5ad) 2024-09-14T11:33:49.098 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:49.098+0000 7f205cd0a9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:33:49.098 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:49.098+0000 7f205cd0a9c0 20 zonegroup default 2024-09-14T11:33:49.098 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:49.098+0000 7f205cd0a9c0 20 rados->read ofs=0 len=0 2024-09-14T11:33:49.098 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:49.098+0000 7f205cd0a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:33:49.098 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:49.098+0000 7f205cd0a9c0 20 rados->read ofs=0 len=0 2024-09-14T11:33:49.099 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:49.102+0000 7f205cd0a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:33:49.099 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:49.102+0000 7f205cd0a9c0 20 rados->read ofs=0 len=0 2024-09-14T11:33:49.099 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:49.102+0000 7f205cd0a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:33:49.099 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:49.102+0000 7f205cd0a9c0 20 started sync module instance, tier type = 2024-09-14T11:33:49.099 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:49.102+0000 7f205cd0a9c0 20 started zone id=d9e72d30-c60b-4d0d-9267-fdc36392d5ad (name=default) with tier type = 2024-09-14T11:33:49.116 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:49.118+0000 7f205cd0a9c0 20 add_watcher() i=0 2024-09-14T11:33:49.116 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:49.118+0000 7f205cd0a9c0 20 add_watcher() i=1 2024-09-14T11:33:49.117 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:49.118+0000 7f205cd0a9c0 20 add_watcher() i=2 2024-09-14T11:33:49.117 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:49.118+0000 7f205cd0a9c0 20 add_watcher() i=3 2024-09-14T11:33:49.117 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:49.118+0000 7f205cd0a9c0 20 add_watcher() i=4 2024-09-14T11:33:49.117 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:49.118+0000 7f205cd0a9c0 20 add_watcher() i=5 2024-09-14T11:33:49.117 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:49.118+0000 7f205cd0a9c0 20 add_watcher() i=6 2024-09-14T11:33:49.117 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:49.118+0000 7f205cd0a9c0 20 add_watcher() i=7 2024-09-14T11:33:49.117 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:49.118+0000 7f205cd0a9c0 2 all 8 watchers are set, enabling cache 2024-09-14T11:33:49.120 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:49.122+0000 7f1f117e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:33:49.120 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:49.122+0000 7f205cd0a9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:33:49.120 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:49.122+0000 7f205cd0a9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:33:49.120 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:49.122+0000 7f205cd0a9c0 5 note: GC not initialized 2024-09-14T11:33:49.121 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:49.122+0000 7f1e8bfff640 20 reqs_thread_entry: start 2024-09-14T11:33:49.121 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:49.122+0000 7f205cd0a9c0 20 init_complete bucket index max shards: 11 2024-09-14T11:33:49.121 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:49.122+0000 7f205cd0a9c0 20 Filter name: none 2024-09-14T11:33:49.121 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:49.122+0000 7f1e89ffb640 20 reqs_thread_entry: start 2024-09-14T11:33:49.121 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:49.122+0000 7f205cd0a9c0 20 rados->read ofs=0 len=0 2024-09-14T11:33:49.122 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:49.122+0000 7f205cd0a9c0 20 rados_obj.operate() r=0 bl.length=187 2024-09-14T11:33:49.122 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:49.122+0000 7f205cd0a9c0 20 rados->read ofs=0 len=0 2024-09-14T11:33:49.123 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:49.126+0000 7f205cd0a9c0 20 rados_obj.operate() r=0 bl.length=409 2024-09-14T11:33:49.123 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:49.126+0000 7f205cd0a9c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:33:49.123 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:49.126+0000 7f205cd0a9c0 20 rados->read ofs=0 len=0 2024-09-14T11:33:49.124 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:49.126+0000 7f205cd0a9c0 20 rados_obj.operate() r=0 bl.length=187 2024-09-14T11:33:49.124 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:49.126+0000 7f205cd0a9c0 20 rados->read ofs=0 len=0 2024-09-14T11:33:49.124 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:49.126+0000 7f205cd0a9c0 20 rados_obj.operate() r=0 bl.length=409 2024-09-14T11:33:49.124 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:49.126+0000 7f205cd0a9c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:33:49.127 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:49.130+0000 7f1f117e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:33:49.132 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:49.134+0000 7f205cd0a9c0 20 remove_watcher() i=0 2024-09-14T11:33:49.132 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:49.134+0000 7f205cd0a9c0 2 removed watcher, disabling cache 2024-09-14T11:33:49.136 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:49.138+0000 7f205cd0a9c0 20 remove_watcher() i=1 2024-09-14T11:33:49.138 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:49.138+0000 7f205cd0a9c0 20 remove_watcher() i=2 2024-09-14T11:33:49.140 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:49.142+0000 7f205cd0a9c0 20 remove_watcher() i=3 2024-09-14T11:33:49.142 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:49.146+0000 7f205cd0a9c0 20 remove_watcher() i=4 2024-09-14T11:33:49.143 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:49.146+0000 7f205cd0a9c0 20 remove_watcher() i=5 2024-09-14T11:33:49.145 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:49.146+0000 7f205cd0a9c0 20 remove_watcher() i=6 2024-09-14T11:33:49.145 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:49.146+0000 7f205cd0a9c0 20 remove_watcher() i=7 2024-09-14T11:33:49.159 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-14T11:33:49.159 INFO:tasks.workunit.client.0.smithi138.stderr:BUCKET_STATS: 2024-09-14T11:33:49.159 INFO:tasks.workunit.client.0.smithi138.stderr:bucket: error-at-init-index id: d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.20 num_objects: 20 size_kb: 1 num_shards: 12 2024-09-14T11:33:49.159 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-14T11:33:49.160 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:33:49.161 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-14T11:33:49.183 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:33:49.183 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-14T11:33:49.649 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:33:49.649 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-14T11:33:50.007 INFO:tasks.workunit.client.0.smithi138.stderr:TEST: reshard bucket with abort at init_index 2024-09-14T11:33:50.007 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-14T11:33:50.010 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:33:50.010 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-14T11:33:50.138 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:33:50.139 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-14T11:33:50.230 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:33:50.230 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-14T11:33:50.332 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:33:50.332 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-14T11:33:50.423 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:33:50.423 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-14T11:33:50.521 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:33:50.521 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-14T11:33:50.617 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:33:50.617 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-14T11:33:50.723 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:33:50.723 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-14T11:33:50.810 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:33:50.810 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-14T11:33:50.898 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:33:50.898 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-14T11:33:50.995 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:33:50.995 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-14T11:33:51.088 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:33:51.088 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-14T11:33:51.181 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:33:51.181 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-14T11:33:51.266 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:33:51.266 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-14T11:33:51.361 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:33:51.361 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-14T11:33:51.461 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:33:51.461 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-14T11:33:51.551 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:33:51.552 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-14T11:33:51.647 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:33:51.647 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-14T11:33:51.744 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:33:51.744 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-14T11:33:51.838 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:33:51.838 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-14T11:33:51.932 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:33:51.932 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-14T11:33:52.028 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:33:52.028 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-14T11:33:52.122 INFO:tasks.workunit.client.0.smithi138.stderr:radosgw-admin bucket stats --bucket abort-at-init-indext 2024-09-14T11:33:52.155 INFO:tasks.workunit.client.0.smithi138.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:33:52.155 INFO:tasks.workunit.client.0.smithi138.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:33:52.201 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:52.202+0000 7effebc979c0 20 rados->read ofs=0 len=0 2024-09-14T11:33:52.204 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:52.206+0000 7effebc979c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:33:52.204 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:52.206+0000 7effebc979c0 20 realm 2024-09-14T11:33:52.204 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:52.206+0000 7effebc979c0 20 rados->read ofs=0 len=0 2024-09-14T11:33:52.204 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:52.206+0000 7effebc979c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:33:52.204 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:52.206+0000 7effebc979c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:33:52.204 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:52.206+0000 7effebc979c0 20 rados->read ofs=0 len=0 2024-09-14T11:33:52.204 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:52.206+0000 7effebc979c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:33:52.204 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:52.206+0000 7effebc979c0 20 rados->read ofs=0 len=0 2024-09-14T11:33:52.206 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:52.206+0000 7effebc979c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:33:52.206 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:52.206+0000 7effebc979c0 20 rados->read ofs=0 len=0 2024-09-14T11:33:52.206 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:52.210+0000 7effebc979c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:33:52.206 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:52.210+0000 7effebc979c0 20 searching for the correct realm 2024-09-14T11:33:52.210 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:52.210+0000 7effe9f9e640 0 -- 172.21.15.138:0/3226155253 >> [v2:172.21.15.154:6824/416768175,v1:172.21.15.154:6825/416768175] conn(0x7effdc076b90 msgr2=0x7effdc07d6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:33:52.424 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:52.425+0000 7effe8f9c640 0 -- 172.21.15.138:0/3226155253 >> [v2:172.21.15.138:6816/326481658,v1:172.21.15.138:6817/326481658] conn(0x7effdc06d580 msgr2=0x7effdc0659e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:33:52.641 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:52.641+0000 7effebc979c0 20 RGWRados::pool_iterate: got zone_info.d9e72d30-c60b-4d0d-9267-fdc36392d5ad 2024-09-14T11:33:52.641 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:52.641+0000 7effebc979c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:33:52.641 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:52.641+0000 7effebc979c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:33:52.641 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:52.641+0000 7effebc979c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:33:52.641 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:52.641+0000 7effebc979c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:33:52.641 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:52.641+0000 7effebc979c0 20 RGWRados::pool_iterate: got zonegroup_info.65ab941b-da8c-4160-94fb-3672b069d44f 2024-09-14T11:33:52.641 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:52.641+0000 7effebc979c0 20 rados->read ofs=0 len=0 2024-09-14T11:33:52.642 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:52.641+0000 7effebc979c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:33:52.642 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:52.641+0000 7effebc979c0 20 rados->read ofs=0 len=0 2024-09-14T11:33:52.642 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:52.641+0000 7effebc979c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:33:52.642 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:52.641+0000 7effebc979c0 20 rados->read ofs=0 len=0 2024-09-14T11:33:52.643 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:52.645+0000 7effebc979c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:33:52.643 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:52.645+0000 7effebc979c0 20 zone default found 2024-09-14T11:33:52.643 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:52.645+0000 7effebc979c0 4 Realm: () 2024-09-14T11:33:52.643 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:52.645+0000 7effebc979c0 4 ZoneGroup: default (65ab941b-da8c-4160-94fb-3672b069d44f) 2024-09-14T11:33:52.643 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:52.645+0000 7effebc979c0 4 Zone: default (d9e72d30-c60b-4d0d-9267-fdc36392d5ad) 2024-09-14T11:33:52.643 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:52.645+0000 7effebc979c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:33:52.643 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:52.645+0000 7effebc979c0 20 zonegroup default 2024-09-14T11:33:52.643 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:52.645+0000 7effebc979c0 20 rados->read ofs=0 len=0 2024-09-14T11:33:52.644 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:52.645+0000 7effebc979c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:33:52.644 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:52.645+0000 7effebc979c0 20 rados->read ofs=0 len=0 2024-09-14T11:33:52.644 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:52.645+0000 7effebc979c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:33:52.644 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:52.645+0000 7effebc979c0 20 rados->read ofs=0 len=0 2024-09-14T11:33:52.645 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:52.645+0000 7effebc979c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:33:52.645 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:52.645+0000 7effebc979c0 20 started sync module instance, tier type = 2024-09-14T11:33:52.645 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:52.645+0000 7effebc979c0 20 started zone id=d9e72d30-c60b-4d0d-9267-fdc36392d5ad (name=default) with tier type = 2024-09-14T11:33:52.673 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:52.673+0000 7effebc979c0 20 add_watcher() i=0 2024-09-14T11:33:52.673 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:52.673+0000 7effebc979c0 20 add_watcher() i=1 2024-09-14T11:33:52.673 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:52.673+0000 7effebc979c0 20 add_watcher() i=2 2024-09-14T11:33:52.673 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:52.673+0000 7effebc979c0 20 add_watcher() i=3 2024-09-14T11:33:52.673 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:52.673+0000 7effebc979c0 20 add_watcher() i=4 2024-09-14T11:33:52.673 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:52.673+0000 7effebc979c0 20 add_watcher() i=5 2024-09-14T11:33:52.673 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:52.673+0000 7effebc979c0 20 add_watcher() i=6 2024-09-14T11:33:52.675 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:52.677+0000 7effebc979c0 20 add_watcher() i=7 2024-09-14T11:33:52.675 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:52.677+0000 7effebc979c0 2 all 8 watchers are set, enabling cache 2024-09-14T11:33:52.679 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:52.681+0000 7efe9ffe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:33:52.680 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:52.681+0000 7effebc979c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:33:52.680 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:52.681+0000 7effebc979c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:33:52.680 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:52.681+0000 7effebc979c0 5 note: GC not initialized 2024-09-14T11:33:52.681 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:52.681+0000 7efe9efe5640 20 reqs_thread_entry: start 2024-09-14T11:33:52.681 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:52.681+0000 7effebc979c0 20 init_complete bucket index max shards: 11 2024-09-14T11:33:52.681 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:52.681+0000 7effebc979c0 20 Filter name: none 2024-09-14T11:33:52.681 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:52.681+0000 7efe9cfe1640 20 reqs_thread_entry: start 2024-09-14T11:33:52.681 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:52.681+0000 7effebc979c0 20 rados->read ofs=0 len=0 2024-09-14T11:33:52.682 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:52.681+0000 7effebc979c0 20 rados_obj.operate() r=0 bl.length=188 2024-09-14T11:33:52.682 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:52.681+0000 7effebc979c0 20 rados->read ofs=0 len=0 2024-09-14T11:33:52.683 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:52.685+0000 7effebc979c0 20 rados_obj.operate() r=0 bl.length=410 2024-09-14T11:33:52.683 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:52.685+0000 7effebc979c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:33:52.683 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:52.685+0000 7effebc979c0 20 rados->read ofs=0 len=0 2024-09-14T11:33:52.683 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:52.685+0000 7effebc979c0 20 rados_obj.operate() r=0 bl.length=188 2024-09-14T11:33:52.683 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:52.685+0000 7effebc979c0 20 rados->read ofs=0 len=0 2024-09-14T11:33:52.684 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:52.685+0000 7effebc979c0 20 rados_obj.operate() r=0 bl.length=410 2024-09-14T11:33:52.684 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:52.685+0000 7effebc979c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:33:52.687 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:52.689+0000 7efe9ffe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:33:52.691 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:52.693+0000 7effebc979c0 20 remove_watcher() i=0 2024-09-14T11:33:52.691 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:52.693+0000 7effebc979c0 2 removed watcher, disabling cache 2024-09-14T11:33:52.694 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:52.693+0000 7effebc979c0 20 remove_watcher() i=1 2024-09-14T11:33:52.696 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:52.697+0000 7effebc979c0 20 remove_watcher() i=2 2024-09-14T11:33:52.697 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:52.697+0000 7effebc979c0 20 remove_watcher() i=3 2024-09-14T11:33:52.700 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:52.701+0000 7effebc979c0 20 remove_watcher() i=4 2024-09-14T11:33:52.701 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:52.701+0000 7effebc979c0 20 remove_watcher() i=5 2024-09-14T11:33:52.703 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:52.705+0000 7effebc979c0 20 remove_watcher() i=6 2024-09-14T11:33:52.704 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:52.705+0000 7effebc979c0 20 remove_watcher() i=7 2024-09-14T11:33:52.719 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-14T11:33:52.720 INFO:tasks.workunit.client.0.smithi138.stderr:BUCKET_STATS: 2024-09-14T11:33:52.720 INFO:tasks.workunit.client.0.smithi138.stderr:bucket: abort-at-init-indext id: d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.21 num_objects: 20 size_kb: 1 num_shards: 11 2024-09-14T11:33:52.720 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-14T11:33:52.720 INFO:tasks.workunit.client.0.smithi138.stderr:radosgw-admin bucket reshard --bucket abort-at-init-indext --num-shards 12 --rgw-reshard-bucket-lock-duration 30 --inject-abort-at init_index 2024-09-14T11:33:52.753 INFO:tasks.workunit.client.0.smithi138.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:33:52.753 INFO:tasks.workunit.client.0.smithi138.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:33:52.798 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:52.797+0000 7f02ef3bc9c0 20 rados->read ofs=0 len=0 2024-09-14T11:33:52.799 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:52.801+0000 7f02ef3bc9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:33:52.800 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:52.801+0000 7f02ef3bc9c0 20 realm 2024-09-14T11:33:52.800 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:52.801+0000 7f02ef3bc9c0 20 rados->read ofs=0 len=0 2024-09-14T11:33:52.800 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:52.801+0000 7f02ef3bc9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:33:52.800 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:52.801+0000 7f02ef3bc9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:33:52.800 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:52.801+0000 7f02ef3bc9c0 20 rados->read ofs=0 len=0 2024-09-14T11:33:52.800 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:52.801+0000 7f02ef3bc9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:33:52.800 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:52.801+0000 7f02ef3bc9c0 20 rados->read ofs=0 len=0 2024-09-14T11:33:52.802 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:52.801+0000 7f02ef3bc9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:33:52.802 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:52.801+0000 7f02ef3bc9c0 20 rados->read ofs=0 len=0 2024-09-14T11:33:52.802 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:52.805+0000 7f02ef3bc9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:33:52.802 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:52.805+0000 7f02ef3bc9c0 20 searching for the correct realm 2024-09-14T11:33:52.806 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:52.809+0000 7f02ed6c3640 0 -- 172.21.15.138:0/2461216839 >> [v2:172.21.15.154:6824/416768175,v1:172.21.15.154:6825/416768175] conn(0x7f02e4064cb0 msgr2=0x7f02e4063720 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:33:52.812 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:52.813+0000 7f02ec6c1640 0 -- 172.21.15.138:0/2461216839 >> [v2:172.21.15.138:6816/326481658,v1:172.21.15.138:6817/326481658] conn(0x7f02e407a9d0 msgr2=0x7f02e4087850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-14T11:33:53.028 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:53.029+0000 7f02ef3bc9c0 20 RGWRados::pool_iterate: got zone_info.d9e72d30-c60b-4d0d-9267-fdc36392d5ad 2024-09-14T11:33:53.028 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:53.029+0000 7f02ef3bc9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:33:53.028 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:53.029+0000 7f02ef3bc9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:33:53.028 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:53.029+0000 7f02ef3bc9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:33:53.028 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:53.029+0000 7f02ef3bc9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:33:53.028 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:53.029+0000 7f02ef3bc9c0 20 RGWRados::pool_iterate: got zonegroup_info.65ab941b-da8c-4160-94fb-3672b069d44f 2024-09-14T11:33:53.028 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:53.029+0000 7f02ef3bc9c0 20 rados->read ofs=0 len=0 2024-09-14T11:33:53.029 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:53.029+0000 7f02ef3bc9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:33:53.029 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:53.029+0000 7f02ef3bc9c0 20 rados->read ofs=0 len=0 2024-09-14T11:33:53.029 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:53.029+0000 7f02ef3bc9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:33:53.029 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:53.029+0000 7f02ef3bc9c0 20 rados->read ofs=0 len=0 2024-09-14T11:33:53.030 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:53.029+0000 7f02ef3bc9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:33:53.030 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:53.029+0000 7f02ef3bc9c0 20 zone default found 2024-09-14T11:33:53.030 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:53.029+0000 7f02ef3bc9c0 4 Realm: () 2024-09-14T11:33:53.031 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:53.029+0000 7f02ef3bc9c0 4 ZoneGroup: default (65ab941b-da8c-4160-94fb-3672b069d44f) 2024-09-14T11:33:53.031 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:53.029+0000 7f02ef3bc9c0 4 Zone: default (d9e72d30-c60b-4d0d-9267-fdc36392d5ad) 2024-09-14T11:33:53.031 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:53.029+0000 7f02ef3bc9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:33:53.031 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:53.029+0000 7f02ef3bc9c0 20 zonegroup default 2024-09-14T11:33:53.031 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:53.029+0000 7f02ef3bc9c0 20 rados->read ofs=0 len=0 2024-09-14T11:33:53.032 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:53.033+0000 7f02ef3bc9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:33:53.032 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:53.033+0000 7f02ef3bc9c0 20 rados->read ofs=0 len=0 2024-09-14T11:33:53.032 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:53.033+0000 7f02ef3bc9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:33:53.032 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:53.033+0000 7f02ef3bc9c0 20 rados->read ofs=0 len=0 2024-09-14T11:33:53.032 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:53.033+0000 7f02ef3bc9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:33:53.033 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:53.033+0000 7f02ef3bc9c0 20 started sync module instance, tier type = 2024-09-14T11:33:53.033 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:53.033+0000 7f02ef3bc9c0 20 started zone id=d9e72d30-c60b-4d0d-9267-fdc36392d5ad (name=default) with tier type = 2024-09-14T11:33:53.057 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:53.057+0000 7f02ef3bc9c0 20 add_watcher() i=0 2024-09-14T11:33:53.057 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:53.057+0000 7f02ef3bc9c0 20 add_watcher() i=1 2024-09-14T11:33:53.057 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:53.057+0000 7f02ef3bc9c0 20 add_watcher() i=2 2024-09-14T11:33:53.057 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:53.057+0000 7f02ef3bc9c0 20 add_watcher() i=3 2024-09-14T11:33:53.057 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:53.057+0000 7f02ef3bc9c0 20 add_watcher() i=4 2024-09-14T11:33:53.057 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:53.057+0000 7f02ef3bc9c0 20 add_watcher() i=5 2024-09-14T11:33:53.057 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:53.057+0000 7f02ef3bc9c0 20 add_watcher() i=6 2024-09-14T11:33:53.059 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:53.061+0000 7f02ef3bc9c0 20 add_watcher() i=7 2024-09-14T11:33:53.059 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:53.061+0000 7f02ef3bc9c0 2 all 8 watchers are set, enabling cache 2024-09-14T11:33:53.063 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:53.065+0000 7f01a2fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:33:53.064 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:53.065+0000 7f02ef3bc9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:33:53.065 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:53.065+0000 7f02ef3bc9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:33:53.065 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:53.065+0000 7f02ef3bc9c0 5 note: GC not initialized 2024-09-14T11:33:53.065 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:53.065+0000 7f01a1fe3640 20 reqs_thread_entry: start 2024-09-14T11:33:53.065 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:53.065+0000 7f02ef3bc9c0 20 init_complete bucket index max shards: 11 2024-09-14T11:33:53.066 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:53.065+0000 7f02ef3bc9c0 20 Filter name: none 2024-09-14T11:33:53.066 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:53.065+0000 7f01137fe640 20 reqs_thread_entry: start 2024-09-14T11:33:53.066 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:53.065+0000 7f02ef3bc9c0 10 cache get: name=default.rgw.meta+root+abort-at-init-indext : miss 2024-09-14T11:33:53.066 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:53.065+0000 7f02ef3bc9c0 20 rados->read ofs=0 len=0 2024-09-14T11:33:53.067 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:53.069+0000 7f02ef3bc9c0 20 rados_obj.operate() r=0 bl.length=188 2024-09-14T11:33:53.067 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:53.069+0000 7f02ef3bc9c0 10 cache put: name=default.rgw.meta+root+abort-at-init-indext info.flags=0x11 2024-09-14T11:33:53.067 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:53.069+0000 7f02ef3bc9c0 10 adding default.rgw.meta+root+abort-at-init-indext to cache LRU end 2024-09-14T11:33:53.067 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:53.069+0000 7f02ef3bc9c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-init-indext:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.21 : miss 2024-09-14T11:33:53.067 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:53.069+0000 7f02ef3bc9c0 20 rados->read ofs=0 len=0 2024-09-14T11:33:53.068 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:53.069+0000 7f02ef3bc9c0 20 rados_obj.operate() r=0 bl.length=410 2024-09-14T11:33:53.068 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:53.069+0000 7f02ef3bc9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-init-indext:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.21 info.flags=0x17 2024-09-14T11:33:53.068 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:53.069+0000 7f02ef3bc9c0 10 adding default.rgw.meta+root+.bucket.meta.abort-at-init-indext:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.21 to cache LRU end 2024-09-14T11:33:53.068 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:53.069+0000 7f02ef3bc9c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:33:53.068 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:53.069+0000 7f02ef3bc9c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:33:53.068 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:53.069+0000 7f02ef3bc9c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-init-indext:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.21 2024-09-14T11:33:53.070 INFO:tasks.workunit.client.0.smithi138.stderr:./src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f02ef3bc9c0 time 2024-09-14T11:33:53.076609+0000 2024-09-14T11:33:53.070 INFO:tasks.workunit.client.0.smithi138.stderr:./src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-14T11:33:53.073 INFO:tasks.workunit.client.0.smithi138.stderr: ceph version 19.3.0-4907-ga2782315 (a2782315255a3e7d5f6cdc9eb35785187ff6ddf8) squid (dev) 2024-09-14T11:33:53.073 INFO:tasks.workunit.client.0.smithi138.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x121) [0x7f02f2c962eb] 2024-09-14T11:33:53.073 INFO:tasks.workunit.client.0.smithi138.stderr: 2: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7f02f2c9649f] 2024-09-14T11:33:53.073 INFO:tasks.workunit.client.0.smithi138.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55cd732f8c01] 2024-09-14T11:33:53.073 INFO:tasks.workunit.client.0.smithi138.stderr: 4: radosgw-admin(+0x14226e2) [0x55cd73d566e2] 2024-09-14T11:33:53.074 INFO:tasks.workunit.client.0.smithi138.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x55cd7330decd] 2024-09-14T11:33:53.074 INFO:tasks.workunit.client.0.smithi138.stderr: 6: main() 2024-09-14T11:33:53.074 INFO:tasks.workunit.client.0.smithi138.stderr: 7: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7f02f1afcd90] 2024-09-14T11:33:53.074 INFO:tasks.workunit.client.0.smithi138.stderr: 8: __libc_start_main() 2024-09-14T11:33:53.074 INFO:tasks.workunit.client.0.smithi138.stderr: 9: _start() 2024-09-14T11:33:53.074 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:53.073+0000 7f02ef3bc9c0 -1 ./src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f02ef3bc9c0 time 2024-09-14T11:33:53.076609+0000 2024-09-14T11:33:53.074 INFO:tasks.workunit.client.0.smithi138.stderr:./src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-14T11:33:53.074 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-14T11:33:53.074 INFO:tasks.workunit.client.0.smithi138.stderr: ceph version 19.3.0-4907-ga2782315 (a2782315255a3e7d5f6cdc9eb35785187ff6ddf8) squid (dev) 2024-09-14T11:33:53.074 INFO:tasks.workunit.client.0.smithi138.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x121) [0x7f02f2c962eb] 2024-09-14T11:33:53.074 INFO:tasks.workunit.client.0.smithi138.stderr: 2: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7f02f2c9649f] 2024-09-14T11:33:53.074 INFO:tasks.workunit.client.0.smithi138.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55cd732f8c01] 2024-09-14T11:33:53.074 INFO:tasks.workunit.client.0.smithi138.stderr: 4: radosgw-admin(+0x14226e2) [0x55cd73d566e2] 2024-09-14T11:33:53.074 INFO:tasks.workunit.client.0.smithi138.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x55cd7330decd] 2024-09-14T11:33:53.075 INFO:tasks.workunit.client.0.smithi138.stderr: 6: main() 2024-09-14T11:33:53.075 INFO:tasks.workunit.client.0.smithi138.stderr: 7: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7f02f1afcd90] 2024-09-14T11:33:53.075 INFO:tasks.workunit.client.0.smithi138.stderr: 8: __libc_start_main() 2024-09-14T11:33:53.075 INFO:tasks.workunit.client.0.smithi138.stderr: 9: _start() 2024-09-14T11:33:53.075 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-14T11:33:53.075 INFO:tasks.workunit.client.0.smithi138.stderr:*** Caught signal (Aborted) ** 2024-09-14T11:33:53.075 INFO:tasks.workunit.client.0.smithi138.stderr: in thread 7f02ef3bc9c0 thread_name:radosgw-admin 2024-09-14T11:33:53.077 INFO:tasks.workunit.client.0.smithi138.stderr: ceph version 19.3.0-4907-ga2782315 (a2782315255a3e7d5f6cdc9eb35785187ff6ddf8) squid (dev) 2024-09-14T11:33:53.077 INFO:tasks.workunit.client.0.smithi138.stderr: 1: /lib/x86_64-linux-gnu/libc.so.6(+0x42520) [0x7f02f1b15520] 2024-09-14T11:33:53.077 INFO:tasks.workunit.client.0.smithi138.stderr: 2: pthread_kill() 2024-09-14T11:33:53.077 INFO:tasks.workunit.client.0.smithi138.stderr: 3: raise() 2024-09-14T11:33:53.077 INFO:tasks.workunit.client.0.smithi138.stderr: 4: abort() 2024-09-14T11:33:53.077 INFO:tasks.workunit.client.0.smithi138.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x17b) [0x7f02f2c96345] 2024-09-14T11:33:53.078 INFO:tasks.workunit.client.0.smithi138.stderr: 6: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7f02f2c9649f] 2024-09-14T11:33:53.078 INFO:tasks.workunit.client.0.smithi138.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55cd732f8c01] 2024-09-14T11:33:53.078 INFO:tasks.workunit.client.0.smithi138.stderr: 8: radosgw-admin(+0x14226e2) [0x55cd73d566e2] 2024-09-14T11:33:53.078 INFO:tasks.workunit.client.0.smithi138.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x55cd7330decd] 2024-09-14T11:33:53.078 INFO:tasks.workunit.client.0.smithi138.stderr: 10: main() 2024-09-14T11:33:53.078 INFO:tasks.workunit.client.0.smithi138.stderr: 11: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7f02f1afcd90] 2024-09-14T11:33:53.078 INFO:tasks.workunit.client.0.smithi138.stderr: 12: __libc_start_main() 2024-09-14T11:33:53.078 INFO:tasks.workunit.client.0.smithi138.stderr: 13: _start() 2024-09-14T11:33:53.078 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:53.077+0000 7f02ef3bc9c0 -1 *** Caught signal (Aborted) ** 2024-09-14T11:33:53.078 INFO:tasks.workunit.client.0.smithi138.stderr: in thread 7f02ef3bc9c0 thread_name:radosgw-admin 2024-09-14T11:33:53.078 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-14T11:33:53.078 INFO:tasks.workunit.client.0.smithi138.stderr: ceph version 19.3.0-4907-ga2782315 (a2782315255a3e7d5f6cdc9eb35785187ff6ddf8) squid (dev) 2024-09-14T11:33:53.078 INFO:tasks.workunit.client.0.smithi138.stderr: 1: /lib/x86_64-linux-gnu/libc.so.6(+0x42520) [0x7f02f1b15520] 2024-09-14T11:33:53.079 INFO:tasks.workunit.client.0.smithi138.stderr: 2: pthread_kill() 2024-09-14T11:33:53.079 INFO:tasks.workunit.client.0.smithi138.stderr: 3: raise() 2024-09-14T11:33:53.079 INFO:tasks.workunit.client.0.smithi138.stderr: 4: abort() 2024-09-14T11:33:53.079 INFO:tasks.workunit.client.0.smithi138.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x17b) [0x7f02f2c96345] 2024-09-14T11:33:53.079 INFO:tasks.workunit.client.0.smithi138.stderr: 6: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7f02f2c9649f] 2024-09-14T11:33:53.079 INFO:tasks.workunit.client.0.smithi138.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55cd732f8c01] 2024-09-14T11:33:53.079 INFO:tasks.workunit.client.0.smithi138.stderr: 8: radosgw-admin(+0x14226e2) [0x55cd73d566e2] 2024-09-14T11:33:53.079 INFO:tasks.workunit.client.0.smithi138.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x55cd7330decd] 2024-09-14T11:33:53.079 INFO:tasks.workunit.client.0.smithi138.stderr: 10: main() 2024-09-14T11:33:53.079 INFO:tasks.workunit.client.0.smithi138.stderr: 11: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7f02f1afcd90] 2024-09-14T11:33:53.079 INFO:tasks.workunit.client.0.smithi138.stderr: 12: __libc_start_main() 2024-09-14T11:33:53.079 INFO:tasks.workunit.client.0.smithi138.stderr: 13: _start() 2024-09-14T11:33:53.080 INFO:tasks.workunit.client.0.smithi138.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-14T11:33:53.080 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-14T11:33:53.080 INFO:tasks.workunit.client.0.smithi138.stderr:--- begin dump of recent events --- 2024-09-14T11:33:53.100 INFO:tasks.workunit.client.0.smithi138.stderr: -499> 2024-09-14T11:33:52.777+0000 7f02ef3bc9c0 10 monclient(hunting): authenticate will time out at 2568.740010s 2024-09-14T11:33:53.101 INFO:tasks.workunit.client.0.smithi138.stderr: -498> 2024-09-14T11:33:52.777+0000 7f02ec6c1640 10 monclient(hunting): get_auth_request con 0x55cd75bf2120 auth_method 0 2024-09-14T11:33:53.101 INFO:tasks.workunit.client.0.smithi138.stderr: -497> 2024-09-14T11:33:52.777+0000 7f02ec6c1640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:33:53.101 INFO:tasks.workunit.client.0.smithi138.stderr: -496> 2024-09-14T11:33:52.777+0000 7f02ec6c1640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:33:53.101 INFO:tasks.workunit.client.0.smithi138.stderr: -495> 2024-09-14T11:33:52.777+0000 7f02ec6c1640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:33:53.101 INFO:tasks.workunit.client.0.smithi138.stderr: -494> 2024-09-14T11:33:52.777+0000 7f02ecec2640 10 monclient(hunting): get_auth_request con 0x55cd75b3a740 auth_method 0 2024-09-14T11:33:53.101 INFO:tasks.workunit.client.0.smithi138.stderr: -493> 2024-09-14T11:33:52.777+0000 7f02ecec2640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:33:53.101 INFO:tasks.workunit.client.0.smithi138.stderr: -492> 2024-09-14T11:33:52.777+0000 7f02ecec2640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:33:53.101 INFO:tasks.workunit.client.0.smithi138.stderr: -491> 2024-09-14T11:33:52.777+0000 7f02ecec2640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:33:53.101 INFO:tasks.workunit.client.0.smithi138.stderr: -490> 2024-09-14T11:33:52.777+0000 7f02ecec2640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:33:53.102 INFO:tasks.workunit.client.0.smithi138.stderr: -489> 2024-09-14T11:33:52.777+0000 7f02ecec2640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:33:53.102 INFO:tasks.workunit.client.0.smithi138.stderr: -488> 2024-09-14T11:33:52.777+0000 7f02ecec2640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:33:53.102 INFO:tasks.workunit.client.0.smithi138.stderr: -487> 2024-09-14T11:33:52.777+0000 7f02ec6c1640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:33:53.102 INFO:tasks.workunit.client.0.smithi138.stderr: -486> 2024-09-14T11:33:52.777+0000 7f02ec6c1640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:33:53.102 INFO:tasks.workunit.client.0.smithi138.stderr: -485> 2024-09-14T11:33:52.777+0000 7f02ec6c1640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:33:53.102 INFO:tasks.workunit.client.0.smithi138.stderr: -484> 2024-09-14T11:33:52.777+0000 7f02ecec2640 10 monclient(hunting): handle_auth_done global_id 5894 payload 274 2024-09-14T11:33:53.102 INFO:tasks.workunit.client.0.smithi138.stderr: -483> 2024-09-14T11:33:52.777+0000 7f02ecec2640 10 monclient: _finish_hunting 0 2024-09-14T11:33:53.102 INFO:tasks.workunit.client.0.smithi138.stderr: -482> 2024-09-14T11:33:52.777+0000 7f02ecec2640 1 monclient: found mon.noname-c 2024-09-14T11:33:53.102 INFO:tasks.workunit.client.0.smithi138.stderr: -481> 2024-09-14T11:33:52.777+0000 7f02ecec2640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.138:3301/0 2024-09-14T11:33:53.102 INFO:tasks.workunit.client.0.smithi138.stderr: -480> 2024-09-14T11:33:52.777+0000 7f01dae0d640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:33:53.102 INFO:tasks.workunit.client.0.smithi138.stderr: -479> 2024-09-14T11:33:52.777+0000 7f01dae0d640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-14T11:33:53.102 INFO:tasks.workunit.client.0.smithi138.stderr: -478> 2024-09-14T11:33:52.777+0000 7f01dae0d640 10 monclient: dump: 2024-09-14T11:33:53.103 INFO:tasks.workunit.client.0.smithi138.stderr:epoch 1 2024-09-14T11:33:53.103 INFO:tasks.workunit.client.0.smithi138.stderr:fsid 3f225f43-83a6-4aeb-b798-1f04bb49d597 2024-09-14T11:33:53.103 INFO:tasks.workunit.client.0.smithi138.stderr:last_changed 2024-09-14T11:07:09.252780+0000 2024-09-14T11:33:53.103 INFO:tasks.workunit.client.0.smithi138.stderr:created 2024-09-14T11:07:09.252780+0000 2024-09-14T11:33:53.103 INFO:tasks.workunit.client.0.smithi138.stderr:min_mon_release 19 (squid) 2024-09-14T11:33:53.103 INFO:tasks.workunit.client.0.smithi138.stderr:election_strategy: 1 2024-09-14T11:33:53.103 INFO:tasks.workunit.client.0.smithi138.stderr:0: [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] mon.a 2024-09-14T11:33:53.103 INFO:tasks.workunit.client.0.smithi138.stderr:1: [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] mon.b 2024-09-14T11:33:53.103 INFO:tasks.workunit.client.0.smithi138.stderr:2: [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] mon.c 2024-09-14T11:33:53.103 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-14T11:33:53.103 INFO:tasks.workunit.client.0.smithi138.stderr: -477> 2024-09-14T11:33:52.777+0000 7f01dae0d640 10 monclient: _finish_auth 0 2024-09-14T11:33:53.103 INFO:tasks.workunit.client.0.smithi138.stderr: -476> 2024-09-14T11:33:52.777+0000 7f01dae0d640 10 monclient: _check_auth_tickets 2024-09-14T11:33:53.103 INFO:tasks.workunit.client.0.smithi138.stderr: -475> 2024-09-14T11:33:52.777+0000 7f01dae0d640 10 monclient: handle_config config(0 keys) 2024-09-14T11:33:53.103 INFO:tasks.workunit.client.0.smithi138.stderr: -474> 2024-09-14T11:33:52.777+0000 7f01dae0d640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:33:53.103 INFO:tasks.workunit.client.0.smithi138.stderr: -473> 2024-09-14T11:33:52.777+0000 7f01dae0d640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-14T11:33:53.104 INFO:tasks.workunit.client.0.smithi138.stderr: -472> 2024-09-14T11:33:52.777+0000 7f01dae0d640 10 monclient: dump: 2024-09-14T11:33:53.104 INFO:tasks.workunit.client.0.smithi138.stderr:epoch 1 2024-09-14T11:33:53.104 INFO:tasks.workunit.client.0.smithi138.stderr:fsid 3f225f43-83a6-4aeb-b798-1f04bb49d597 2024-09-14T11:33:53.104 INFO:tasks.workunit.client.0.smithi138.stderr:last_changed 2024-09-14T11:07:09.252780+0000 2024-09-14T11:33:53.104 INFO:tasks.workunit.client.0.smithi138.stderr:created 2024-09-14T11:07:09.252780+0000 2024-09-14T11:33:53.104 INFO:tasks.workunit.client.0.smithi138.stderr:min_mon_release 19 (squid) 2024-09-14T11:33:53.104 INFO:tasks.workunit.client.0.smithi138.stderr:election_strategy: 1 2024-09-14T11:33:53.104 INFO:tasks.workunit.client.0.smithi138.stderr:0: [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] mon.a 2024-09-14T11:33:53.104 INFO:tasks.workunit.client.0.smithi138.stderr:1: [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] mon.b 2024-09-14T11:33:53.104 INFO:tasks.workunit.client.0.smithi138.stderr:2: [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] mon.c 2024-09-14T11:33:53.104 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-14T11:33:53.104 INFO:tasks.workunit.client.0.smithi138.stderr: -471> 2024-09-14T11:33:52.777+0000 7f02ef3bc9c0 5 monclient: authenticate success, global_id 5894 2024-09-14T11:33:53.104 INFO:tasks.workunit.client.0.smithi138.stderr: -470> 2024-09-14T11:33:52.777+0000 7f02ef3bc9c0 10 monclient: get_monmap_and_config success 2024-09-14T11:33:53.105 INFO:tasks.workunit.client.0.smithi138.stderr: -469> 2024-09-14T11:33:52.777+0000 7f02ef3bc9c0 4 set_mon_vals no callback set 2024-09-14T11:33:53.105 INFO:tasks.workunit.client.0.smithi138.stderr: -468> 2024-09-14T11:33:52.777+0000 7f02ef3bc9c0 10 monclient: shutdown 2024-09-14T11:33:53.105 INFO:tasks.workunit.client.0.smithi138.stderr: -467> 2024-09-14T11:33:52.777+0000 7f02ef3bc9c0 5 asok(0x55cd75aa1d90) unregister_commands rotate-key 2024-09-14T11:33:53.105 INFO:tasks.workunit.client.0.smithi138.stderr: -466> 2024-09-14T11:33:52.777+0000 7f02ef3bc9c0 10 monclient: build_initial_monmap 2024-09-14T11:33:53.105 INFO:tasks.workunit.client.0.smithi138.stderr: -465> 2024-09-14T11:33:52.777+0000 7f02ef3bc9c0 1 build_initial for_mkfs: 0 2024-09-14T11:33:53.105 INFO:tasks.workunit.client.0.smithi138.stderr: -464> 2024-09-14T11:33:52.777+0000 7f02ef3bc9c0 10 monclient: monmap: 2024-09-14T11:33:53.105 INFO:tasks.workunit.client.0.smithi138.stderr:epoch 0 2024-09-14T11:33:53.105 INFO:tasks.workunit.client.0.smithi138.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-14T11:33:53.105 INFO:tasks.workunit.client.0.smithi138.stderr:last_changed 0.000000 2024-09-14T11:33:53.105 INFO:tasks.workunit.client.0.smithi138.stderr:created 0.000000 2024-09-14T11:33:53.105 INFO:tasks.workunit.client.0.smithi138.stderr:min_mon_release 0 (unknown) 2024-09-14T11:33:53.105 INFO:tasks.workunit.client.0.smithi138.stderr:election_strategy: 1 2024-09-14T11:33:53.105 INFO:tasks.workunit.client.0.smithi138.stderr:0: [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] mon.noname-a 2024-09-14T11:33:53.105 INFO:tasks.workunit.client.0.smithi138.stderr:1: [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] mon.noname-b 2024-09-14T11:33:53.105 INFO:tasks.workunit.client.0.smithi138.stderr:2: [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] mon.noname-c 2024-09-14T11:33:53.106 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-14T11:33:53.106 INFO:tasks.workunit.client.0.smithi138.stderr: -463> 2024-09-14T11:33:52.777+0000 7f02ef3bc9c0 5 AuthRegistry(0x55cd75cdbeb0) adding auth protocol: cephx 2024-09-14T11:33:53.106 INFO:tasks.workunit.client.0.smithi138.stderr: -462> 2024-09-14T11:33:52.777+0000 7f02ef3bc9c0 5 AuthRegistry(0x55cd75cdbeb0) adding auth protocol: cephx 2024-09-14T11:33:53.106 INFO:tasks.workunit.client.0.smithi138.stderr: -461> 2024-09-14T11:33:52.777+0000 7f02ef3bc9c0 5 AuthRegistry(0x55cd75cdbeb0) adding auth protocol: cephx 2024-09-14T11:33:53.106 INFO:tasks.workunit.client.0.smithi138.stderr: -460> 2024-09-14T11:33:52.777+0000 7f02ef3bc9c0 5 AuthRegistry(0x55cd75cdbeb0) adding con mode: secure 2024-09-14T11:33:53.106 INFO:tasks.workunit.client.0.smithi138.stderr: -459> 2024-09-14T11:33:52.777+0000 7f02ef3bc9c0 5 AuthRegistry(0x55cd75cdbeb0) adding con mode: crc 2024-09-14T11:33:53.106 INFO:tasks.workunit.client.0.smithi138.stderr: -458> 2024-09-14T11:33:52.777+0000 7f02ef3bc9c0 5 AuthRegistry(0x55cd75cdbeb0) adding con mode: secure 2024-09-14T11:33:53.106 INFO:tasks.workunit.client.0.smithi138.stderr: -457> 2024-09-14T11:33:52.777+0000 7f02ef3bc9c0 5 AuthRegistry(0x55cd75cdbeb0) adding con mode: crc 2024-09-14T11:33:53.106 INFO:tasks.workunit.client.0.smithi138.stderr: -456> 2024-09-14T11:33:52.777+0000 7f02ef3bc9c0 5 AuthRegistry(0x55cd75cdbeb0) adding con mode: secure 2024-09-14T11:33:53.106 INFO:tasks.workunit.client.0.smithi138.stderr: -455> 2024-09-14T11:33:52.777+0000 7f02ef3bc9c0 5 AuthRegistry(0x55cd75cdbeb0) adding con mode: crc 2024-09-14T11:33:53.106 INFO:tasks.workunit.client.0.smithi138.stderr: -454> 2024-09-14T11:33:52.777+0000 7f02ef3bc9c0 5 AuthRegistry(0x55cd75cdbeb0) adding con mode: crc 2024-09-14T11:33:53.106 INFO:tasks.workunit.client.0.smithi138.stderr: -453> 2024-09-14T11:33:52.777+0000 7f02ef3bc9c0 5 AuthRegistry(0x55cd75cdbeb0) adding con mode: secure 2024-09-14T11:33:53.106 INFO:tasks.workunit.client.0.smithi138.stderr: -452> 2024-09-14T11:33:52.777+0000 7f02ef3bc9c0 5 AuthRegistry(0x55cd75cdbeb0) adding con mode: crc 2024-09-14T11:33:53.106 INFO:tasks.workunit.client.0.smithi138.stderr: -451> 2024-09-14T11:33:52.777+0000 7f02ef3bc9c0 5 AuthRegistry(0x55cd75cdbeb0) adding con mode: secure 2024-09-14T11:33:53.106 INFO:tasks.workunit.client.0.smithi138.stderr: -450> 2024-09-14T11:33:52.777+0000 7f02ef3bc9c0 5 AuthRegistry(0x55cd75cdbeb0) adding con mode: crc 2024-09-14T11:33:53.107 INFO:tasks.workunit.client.0.smithi138.stderr: -449> 2024-09-14T11:33:52.777+0000 7f02ef3bc9c0 5 AuthRegistry(0x55cd75cdbeb0) adding con mode: secure 2024-09-14T11:33:53.107 INFO:tasks.workunit.client.0.smithi138.stderr: -448> 2024-09-14T11:33:52.777+0000 7f02ef3bc9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:33:53.107 INFO:tasks.workunit.client.0.smithi138.stderr: -447> 2024-09-14T11:33:52.777+0000 7f02ef3bc9c0 1 librados: starting msgr at 2024-09-14T11:33:53.107 INFO:tasks.workunit.client.0.smithi138.stderr: -446> 2024-09-14T11:33:52.777+0000 7f02ef3bc9c0 1 librados: starting objecter 2024-09-14T11:33:53.107 INFO:tasks.workunit.client.0.smithi138.stderr: -445> 2024-09-14T11:33:52.777+0000 7f02ef3bc9c0 5 asok(0x55cd75aa1d90) register_command objecter_requests hook 0x55cd75ce7220 2024-09-14T11:33:53.107 INFO:tasks.workunit.client.0.smithi138.stderr: -444> 2024-09-14T11:33:52.777+0000 7f02ef3bc9c0 1 librados: setting wanted keys 2024-09-14T11:33:53.107 INFO:tasks.workunit.client.0.smithi138.stderr: -443> 2024-09-14T11:33:52.777+0000 7f02ef3bc9c0 1 librados: calling monclient init 2024-09-14T11:33:53.107 INFO:tasks.workunit.client.0.smithi138.stderr: -442> 2024-09-14T11:33:52.777+0000 7f02ef3bc9c0 10 monclient: init 2024-09-14T11:33:53.107 INFO:tasks.workunit.client.0.smithi138.stderr: -441> 2024-09-14T11:33:52.777+0000 7f02ef3bc9c0 5 AuthRegistry(0x55cd75cace80) adding auth protocol: cephx 2024-09-14T11:33:53.107 INFO:tasks.workunit.client.0.smithi138.stderr: -440> 2024-09-14T11:33:52.777+0000 7f02ef3bc9c0 5 AuthRegistry(0x55cd75cace80) adding auth protocol: cephx 2024-09-14T11:33:53.107 INFO:tasks.workunit.client.0.smithi138.stderr: -439> 2024-09-14T11:33:52.777+0000 7f02ef3bc9c0 5 AuthRegistry(0x55cd75cace80) adding auth protocol: cephx 2024-09-14T11:33:53.107 INFO:tasks.workunit.client.0.smithi138.stderr: -438> 2024-09-14T11:33:52.777+0000 7f02ef3bc9c0 5 AuthRegistry(0x55cd75cace80) adding con mode: secure 2024-09-14T11:33:53.107 INFO:tasks.workunit.client.0.smithi138.stderr: -437> 2024-09-14T11:33:52.777+0000 7f02ef3bc9c0 5 AuthRegistry(0x55cd75cace80) adding con mode: crc 2024-09-14T11:33:53.107 INFO:tasks.workunit.client.0.smithi138.stderr: -436> 2024-09-14T11:33:52.777+0000 7f02ef3bc9c0 5 AuthRegistry(0x55cd75cace80) adding con mode: secure 2024-09-14T11:33:53.107 INFO:tasks.workunit.client.0.smithi138.stderr: -435> 2024-09-14T11:33:52.777+0000 7f02ef3bc9c0 5 AuthRegistry(0x55cd75cace80) adding con mode: crc 2024-09-14T11:33:53.107 INFO:tasks.workunit.client.0.smithi138.stderr: -434> 2024-09-14T11:33:52.777+0000 7f02ef3bc9c0 5 AuthRegistry(0x55cd75cace80) adding con mode: secure 2024-09-14T11:33:53.108 INFO:tasks.workunit.client.0.smithi138.stderr: -433> 2024-09-14T11:33:52.777+0000 7f02ef3bc9c0 5 AuthRegistry(0x55cd75cace80) adding con mode: crc 2024-09-14T11:33:53.108 INFO:tasks.workunit.client.0.smithi138.stderr: -432> 2024-09-14T11:33:52.777+0000 7f02ef3bc9c0 5 AuthRegistry(0x55cd75cace80) adding con mode: crc 2024-09-14T11:33:53.108 INFO:tasks.workunit.client.0.smithi138.stderr: -431> 2024-09-14T11:33:52.777+0000 7f02ef3bc9c0 5 AuthRegistry(0x55cd75cace80) adding con mode: secure 2024-09-14T11:33:53.108 INFO:tasks.workunit.client.0.smithi138.stderr: -430> 2024-09-14T11:33:52.777+0000 7f02ef3bc9c0 5 AuthRegistry(0x55cd75cace80) adding con mode: crc 2024-09-14T11:33:53.108 INFO:tasks.workunit.client.0.smithi138.stderr: -429> 2024-09-14T11:33:52.777+0000 7f02ef3bc9c0 5 AuthRegistry(0x55cd75cace80) adding con mode: secure 2024-09-14T11:33:53.108 INFO:tasks.workunit.client.0.smithi138.stderr: -428> 2024-09-14T11:33:52.777+0000 7f02ef3bc9c0 5 AuthRegistry(0x55cd75cace80) adding con mode: crc 2024-09-14T11:33:53.108 INFO:tasks.workunit.client.0.smithi138.stderr: -427> 2024-09-14T11:33:52.777+0000 7f02ef3bc9c0 5 AuthRegistry(0x55cd75cace80) adding con mode: secure 2024-09-14T11:33:53.108 INFO:tasks.workunit.client.0.smithi138.stderr: -426> 2024-09-14T11:33:52.777+0000 7f02ef3bc9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:33:53.108 INFO:tasks.workunit.client.0.smithi138.stderr: -425> 2024-09-14T11:33:52.777+0000 7f02ef3bc9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:33:53.108 INFO:tasks.workunit.client.0.smithi138.stderr: -424> 2024-09-14T11:33:52.777+0000 7f02ef3bc9c0 5 asok(0x55cd75aa1d90) register_command rotate-key hook 0x55cd75cacfc8 2024-09-14T11:33:53.108 INFO:tasks.workunit.client.0.smithi138.stderr: -423> 2024-09-14T11:33:52.777+0000 7f02ef3bc9c0 10 monclient: _reopen_session rank -1 2024-09-14T11:33:53.108 INFO:tasks.workunit.client.0.smithi138.stderr: -422> 2024-09-14T11:33:52.777+0000 7f02ef3bc9c0 10 monclient: _add_conns ranks=[1,2,0] 2024-09-14T11:33:53.108 INFO:tasks.workunit.client.0.smithi138.stderr: -421> 2024-09-14T11:33:52.777+0000 7f02ef3bc9c0 10 monclient(hunting): picked mon.noname-b con 0x55cd75b3a740 addr [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] 2024-09-14T11:33:53.108 INFO:tasks.workunit.client.0.smithi138.stderr: -420> 2024-09-14T11:33:52.777+0000 7f02ef3bc9c0 10 monclient(hunting): picked mon.noname-c con 0x55cd75bf2120 addr [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] 2024-09-14T11:33:53.109 INFO:tasks.workunit.client.0.smithi138.stderr: -419> 2024-09-14T11:33:52.777+0000 7f02ef3bc9c0 10 monclient(hunting): picked mon.noname-a con 0x55cd75bf5b40 addr [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] 2024-09-14T11:33:53.109 INFO:tasks.workunit.client.0.smithi138.stderr: -418> 2024-09-14T11:33:52.777+0000 7f02ef3bc9c0 10 monclient(hunting): start opening mon connection 2024-09-14T11:33:53.109 INFO:tasks.workunit.client.0.smithi138.stderr: -417> 2024-09-14T11:33:52.777+0000 7f02ef3bc9c0 10 monclient(hunting): start opening mon connection 2024-09-14T11:33:53.109 INFO:tasks.workunit.client.0.smithi138.stderr: -416> 2024-09-14T11:33:52.777+0000 7f02ef3bc9c0 10 monclient(hunting): start opening mon connection 2024-09-14T11:33:53.109 INFO:tasks.workunit.client.0.smithi138.stderr: -415> 2024-09-14T11:33:52.777+0000 7f02ef3bc9c0 10 monclient(hunting): _renew_subs 2024-09-14T11:33:53.109 INFO:tasks.workunit.client.0.smithi138.stderr: -414> 2024-09-14T11:33:52.777+0000 7f02ef3bc9c0 10 monclient(hunting): authenticate will time out at 2568.742961s 2024-09-14T11:33:53.109 INFO:tasks.workunit.client.0.smithi138.stderr: -413> 2024-09-14T11:33:52.777+0000 7f02ec6c1640 10 monclient(hunting): get_auth_request con 0x55cd75bf2120 auth_method 0 2024-09-14T11:33:53.109 INFO:tasks.workunit.client.0.smithi138.stderr: -412> 2024-09-14T11:33:52.777+0000 7f02ec6c1640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:33:53.109 INFO:tasks.workunit.client.0.smithi138.stderr: -411> 2024-09-14T11:33:52.777+0000 7f02ec6c1640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:33:53.109 INFO:tasks.workunit.client.0.smithi138.stderr: -410> 2024-09-14T11:33:52.777+0000 7f02ec6c1640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:33:53.109 INFO:tasks.workunit.client.0.smithi138.stderr: -409> 2024-09-14T11:33:52.777+0000 7f02ed6c3640 10 monclient(hunting): get_auth_request con 0x55cd75bf5b40 auth_method 0 2024-09-14T11:33:53.109 INFO:tasks.workunit.client.0.smithi138.stderr: -408> 2024-09-14T11:33:52.777+0000 7f02ed6c3640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:33:53.110 INFO:tasks.workunit.client.0.smithi138.stderr: -407> 2024-09-14T11:33:52.777+0000 7f02ed6c3640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:33:53.110 INFO:tasks.workunit.client.0.smithi138.stderr: -406> 2024-09-14T11:33:52.777+0000 7f02ed6c3640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:33:53.110 INFO:tasks.workunit.client.0.smithi138.stderr: -405> 2024-09-14T11:33:52.777+0000 7f02ec6c1640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:33:53.110 INFO:tasks.workunit.client.0.smithi138.stderr: -404> 2024-09-14T11:33:52.777+0000 7f02ec6c1640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:33:53.110 INFO:tasks.workunit.client.0.smithi138.stderr: -403> 2024-09-14T11:33:52.777+0000 7f02ec6c1640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:33:53.110 INFO:tasks.workunit.client.0.smithi138.stderr: -402> 2024-09-14T11:33:52.777+0000 7f02ed6c3640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:33:53.110 INFO:tasks.workunit.client.0.smithi138.stderr: -401> 2024-09-14T11:33:52.777+0000 7f02ed6c3640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:33:53.110 INFO:tasks.workunit.client.0.smithi138.stderr: -400> 2024-09-14T11:33:52.777+0000 7f02ed6c3640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:33:53.110 INFO:tasks.workunit.client.0.smithi138.stderr: -399> 2024-09-14T11:33:52.777+0000 7f02ec6c1640 10 monclient(hunting): handle_auth_done global_id 5897 payload 824 2024-09-14T11:33:53.110 INFO:tasks.workunit.client.0.smithi138.stderr: -398> 2024-09-14T11:33:52.777+0000 7f02ec6c1640 10 monclient: _finish_hunting 0 2024-09-14T11:33:53.110 INFO:tasks.workunit.client.0.smithi138.stderr: -397> 2024-09-14T11:33:52.777+0000 7f02ec6c1640 1 monclient: found mon.noname-c 2024-09-14T11:33:53.111 INFO:tasks.workunit.client.0.smithi138.stderr: -396> 2024-09-14T11:33:52.777+0000 7f02ec6c1640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.138:3301/0 2024-09-14T11:33:53.111 INFO:tasks.workunit.client.0.smithi138.stderr: -395> 2024-09-14T11:33:52.777+0000 7f01d960a640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:33:53.111 INFO:tasks.workunit.client.0.smithi138.stderr: -394> 2024-09-14T11:33:52.777+0000 7f01d960a640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-14T11:33:53.111 INFO:tasks.workunit.client.0.smithi138.stderr: -393> 2024-09-14T11:33:52.777+0000 7f01d960a640 10 monclient: dump: 2024-09-14T11:33:53.111 INFO:tasks.workunit.client.0.smithi138.stderr:epoch 1 2024-09-14T11:33:53.111 INFO:tasks.workunit.client.0.smithi138.stderr:fsid 3f225f43-83a6-4aeb-b798-1f04bb49d597 2024-09-14T11:33:53.111 INFO:tasks.workunit.client.0.smithi138.stderr:last_changed 2024-09-14T11:07:09.252780+0000 2024-09-14T11:33:53.111 INFO:tasks.workunit.client.0.smithi138.stderr:created 2024-09-14T11:07:09.252780+0000 2024-09-14T11:33:53.111 INFO:tasks.workunit.client.0.smithi138.stderr:min_mon_release 19 (squid) 2024-09-14T11:33:53.111 INFO:tasks.workunit.client.0.smithi138.stderr:election_strategy: 1 2024-09-14T11:33:53.111 INFO:tasks.workunit.client.0.smithi138.stderr:0: [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] mon.a 2024-09-14T11:33:53.111 INFO:tasks.workunit.client.0.smithi138.stderr:1: [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] mon.b 2024-09-14T11:33:53.111 INFO:tasks.workunit.client.0.smithi138.stderr:2: [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] mon.c 2024-09-14T11:33:53.111 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-14T11:33:53.111 INFO:tasks.workunit.client.0.smithi138.stderr: -392> 2024-09-14T11:33:52.777+0000 7f01d960a640 10 monclient: _finish_auth 0 2024-09-14T11:33:53.112 INFO:tasks.workunit.client.0.smithi138.stderr: -391> 2024-09-14T11:33:52.777+0000 7f01d960a640 10 monclient: _check_auth_tickets 2024-09-14T11:33:53.112 INFO:tasks.workunit.client.0.smithi138.stderr: -390> 2024-09-14T11:33:52.777+0000 7f01d960a640 10 monclient: handle_config config(0 keys) 2024-09-14T11:33:53.112 INFO:tasks.workunit.client.0.smithi138.stderr: -389> 2024-09-14T11:33:52.777+0000 7f01d960a640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:33:53.112 INFO:tasks.workunit.client.0.smithi138.stderr: -388> 2024-09-14T11:33:52.777+0000 7f01d960a640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-14T11:33:53.112 INFO:tasks.workunit.client.0.smithi138.stderr: -387> 2024-09-14T11:33:52.777+0000 7f01d960a640 10 monclient: dump: 2024-09-14T11:33:53.112 INFO:tasks.workunit.client.0.smithi138.stderr:epoch 1 2024-09-14T11:33:53.112 INFO:tasks.workunit.client.0.smithi138.stderr:fsid 3f225f43-83a6-4aeb-b798-1f04bb49d597 2024-09-14T11:33:53.112 INFO:tasks.workunit.client.0.smithi138.stderr:last_changed 2024-09-14T11:07:09.252780+0000 2024-09-14T11:33:53.112 INFO:tasks.workunit.client.0.smithi138.stderr:created 2024-09-14T11:07:09.252780+0000 2024-09-14T11:33:53.112 INFO:tasks.workunit.client.0.smithi138.stderr:min_mon_release 19 (squid) 2024-09-14T11:33:53.112 INFO:tasks.workunit.client.0.smithi138.stderr:election_strategy: 1 2024-09-14T11:33:53.112 INFO:tasks.workunit.client.0.smithi138.stderr:0: [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] mon.a 2024-09-14T11:33:53.112 INFO:tasks.workunit.client.0.smithi138.stderr:1: [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] mon.b 2024-09-14T11:33:53.113 INFO:tasks.workunit.client.0.smithi138.stderr:2: [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] mon.c 2024-09-14T11:33:53.113 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-14T11:33:53.113 INFO:tasks.workunit.client.0.smithi138.stderr: -386> 2024-09-14T11:33:52.777+0000 7f01dae0d640 4 set_mon_vals no callback set 2024-09-14T11:33:53.113 INFO:tasks.workunit.client.0.smithi138.stderr: -385> 2024-09-14T11:33:52.781+0000 7f02ef3bc9c0 5 monclient: authenticate success, global_id 5897 2024-09-14T11:33:53.113 INFO:tasks.workunit.client.0.smithi138.stderr: -384> 2024-09-14T11:33:52.781+0000 7f02ef3bc9c0 10 monclient: _renew_subs 2024-09-14T11:33:53.113 INFO:tasks.workunit.client.0.smithi138.stderr: -383> 2024-09-14T11:33:52.781+0000 7f02ef3bc9c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.138:3301/0 2024-09-14T11:33:53.113 INFO:tasks.workunit.client.0.smithi138.stderr: -382> 2024-09-14T11:33:52.781+0000 7f02ef3bc9c0 10 monclient: _renew_subs 2024-09-14T11:33:53.113 INFO:tasks.workunit.client.0.smithi138.stderr: -381> 2024-09-14T11:33:52.781+0000 7f02ef3bc9c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.138:3301/0 2024-09-14T11:33:53.113 INFO:tasks.workunit.client.0.smithi138.stderr: -380> 2024-09-14T11:33:52.781+0000 7f02ef3bc9c0 1 librados: init done 2024-09-14T11:33:53.113 INFO:tasks.workunit.client.0.smithi138.stderr: -379> 2024-09-14T11:33:52.781+0000 7f01d960a640 4 mgrc handle_mgr_map Got map version 5 2024-09-14T11:33:53.113 INFO:tasks.workunit.client.0.smithi138.stderr: -378> 2024-09-14T11:33:52.781+0000 7f01d960a640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.138:6832/3778043143,v1:172.21.15.138:6833/3778043143] 2024-09-14T11:33:53.113 INFO:tasks.workunit.client.0.smithi138.stderr: -377> 2024-09-14T11:33:52.781+0000 7f01d960a640 4 mgrc reconnect Starting new session with [v2:172.21.15.138:6832/3778043143,v1:172.21.15.138:6833/3778043143] 2024-09-14T11:33:53.113 INFO:tasks.workunit.client.0.smithi138.stderr: -376> 2024-09-14T11:33:52.781+0000 7f02ecec2640 10 monclient: get_auth_request con 0x7f01d40718d0 auth_method 0 2024-09-14T11:33:53.113 INFO:tasks.workunit.client.0.smithi138.stderr: -375> 2024-09-14T11:33:52.781+0000 7f02ed6c3640 10 monclient: get_auth_request con 0x55cd75cd43b0 auth_method 0 2024-09-14T11:33:53.114 INFO:tasks.workunit.client.0.smithi138.stderr: -374> 2024-09-14T11:33:52.781+0000 7f02ecec2640 10 monclient: get_auth_request con 0x55cd75cf7e90 auth_method 0 2024-09-14T11:33:53.114 INFO:tasks.workunit.client.0.smithi138.stderr: -373> 2024-09-14T11:33:52.785+0000 7f02ec6c1640 10 monclient: get_auth_request con 0x55cd75cfc310 auth_method 0 2024-09-14T11:33:53.114 INFO:tasks.workunit.client.0.smithi138.stderr: -372> 2024-09-14T11:33:52.785+0000 7f02ed6c3640 10 monclient: get_auth_request con 0x55cd75cfb740 auth_method 0 2024-09-14T11:33:53.114 INFO:tasks.workunit.client.0.smithi138.stderr: -371> 2024-09-14T11:33:52.789+0000 7f02ef3bc9c0 10 monclient: build_initial_monmap 2024-09-14T11:33:53.114 INFO:tasks.workunit.client.0.smithi138.stderr: -370> 2024-09-14T11:33:52.789+0000 7f02ef3bc9c0 1 build_initial for_mkfs: 0 2024-09-14T11:33:53.114 INFO:tasks.workunit.client.0.smithi138.stderr: -369> 2024-09-14T11:33:52.789+0000 7f02ef3bc9c0 10 monclient: monmap: 2024-09-14T11:33:53.114 INFO:tasks.workunit.client.0.smithi138.stderr:epoch 0 2024-09-14T11:33:53.114 INFO:tasks.workunit.client.0.smithi138.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-14T11:33:53.114 INFO:tasks.workunit.client.0.smithi138.stderr:last_changed 0.000000 2024-09-14T11:33:53.114 INFO:tasks.workunit.client.0.smithi138.stderr:created 0.000000 2024-09-14T11:33:53.114 INFO:tasks.workunit.client.0.smithi138.stderr:min_mon_release 0 (unknown) 2024-09-14T11:33:53.114 INFO:tasks.workunit.client.0.smithi138.stderr:election_strategy: 1 2024-09-14T11:33:53.114 INFO:tasks.workunit.client.0.smithi138.stderr:0: [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] mon.noname-a 2024-09-14T11:33:53.114 INFO:tasks.workunit.client.0.smithi138.stderr:1: [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] mon.noname-b 2024-09-14T11:33:53.114 INFO:tasks.workunit.client.0.smithi138.stderr:2: [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] mon.noname-c 2024-09-14T11:33:53.115 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-14T11:33:53.115 INFO:tasks.workunit.client.0.smithi138.stderr: -368> 2024-09-14T11:33:52.789+0000 7f02ef3bc9c0 5 AuthRegistry(0x55cd75d04420) adding auth protocol: cephx 2024-09-14T11:33:53.115 INFO:tasks.workunit.client.0.smithi138.stderr: -367> 2024-09-14T11:33:52.789+0000 7f02ef3bc9c0 5 AuthRegistry(0x55cd75d04420) adding auth protocol: cephx 2024-09-14T11:33:53.115 INFO:tasks.workunit.client.0.smithi138.stderr: -366> 2024-09-14T11:33:52.789+0000 7f02ef3bc9c0 5 AuthRegistry(0x55cd75d04420) adding auth protocol: cephx 2024-09-14T11:33:53.115 INFO:tasks.workunit.client.0.smithi138.stderr: -365> 2024-09-14T11:33:52.789+0000 7f02ef3bc9c0 5 AuthRegistry(0x55cd75d04420) adding con mode: secure 2024-09-14T11:33:53.115 INFO:tasks.workunit.client.0.smithi138.stderr: -364> 2024-09-14T11:33:52.789+0000 7f02ef3bc9c0 5 AuthRegistry(0x55cd75d04420) adding con mode: crc 2024-09-14T11:33:53.115 INFO:tasks.workunit.client.0.smithi138.stderr: -363> 2024-09-14T11:33:52.789+0000 7f02ef3bc9c0 5 AuthRegistry(0x55cd75d04420) adding con mode: secure 2024-09-14T11:33:53.115 INFO:tasks.workunit.client.0.smithi138.stderr: -362> 2024-09-14T11:33:52.789+0000 7f02ef3bc9c0 5 AuthRegistry(0x55cd75d04420) adding con mode: crc 2024-09-14T11:33:53.115 INFO:tasks.workunit.client.0.smithi138.stderr: -361> 2024-09-14T11:33:52.789+0000 7f02ef3bc9c0 5 AuthRegistry(0x55cd75d04420) adding con mode: secure 2024-09-14T11:33:53.115 INFO:tasks.workunit.client.0.smithi138.stderr: -360> 2024-09-14T11:33:52.789+0000 7f02ef3bc9c0 5 AuthRegistry(0x55cd75d04420) adding con mode: crc 2024-09-14T11:33:53.115 INFO:tasks.workunit.client.0.smithi138.stderr: -359> 2024-09-14T11:33:52.789+0000 7f02ef3bc9c0 5 AuthRegistry(0x55cd75d04420) adding con mode: crc 2024-09-14T11:33:53.115 INFO:tasks.workunit.client.0.smithi138.stderr: -358> 2024-09-14T11:33:52.789+0000 7f02ef3bc9c0 5 AuthRegistry(0x55cd75d04420) adding con mode: secure 2024-09-14T11:33:53.115 INFO:tasks.workunit.client.0.smithi138.stderr: -357> 2024-09-14T11:33:52.789+0000 7f02ef3bc9c0 5 AuthRegistry(0x55cd75d04420) adding con mode: crc 2024-09-14T11:33:53.115 INFO:tasks.workunit.client.0.smithi138.stderr: -356> 2024-09-14T11:33:52.789+0000 7f02ef3bc9c0 5 AuthRegistry(0x55cd75d04420) adding con mode: secure 2024-09-14T11:33:53.116 INFO:tasks.workunit.client.0.smithi138.stderr: -355> 2024-09-14T11:33:52.789+0000 7f02ef3bc9c0 5 AuthRegistry(0x55cd75d04420) adding con mode: crc 2024-09-14T11:33:53.116 INFO:tasks.workunit.client.0.smithi138.stderr: -354> 2024-09-14T11:33:52.789+0000 7f02ef3bc9c0 5 AuthRegistry(0x55cd75d04420) adding con mode: secure 2024-09-14T11:33:53.116 INFO:tasks.workunit.client.0.smithi138.stderr: -353> 2024-09-14T11:33:52.789+0000 7f02ef3bc9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:33:53.116 INFO:tasks.workunit.client.0.smithi138.stderr: -352> 2024-09-14T11:33:52.789+0000 7f02ef3bc9c0 5 asok(0x55cd75aa1d90) register_command objecter_requests cmddesc objecter_requests hook 0x55cd75d07e10 EEXIST 2024-09-14T11:33:53.116 INFO:tasks.workunit.client.0.smithi138.stderr: -351> 2024-09-14T11:33:52.789+0000 7f02ef3bc9c0 10 monclient: init 2024-09-14T11:33:53.116 INFO:tasks.workunit.client.0.smithi138.stderr: -350> 2024-09-14T11:33:52.789+0000 7f02ef3bc9c0 5 AuthRegistry(0x55cd75d033a8) adding auth protocol: cephx 2024-09-14T11:33:53.116 INFO:tasks.workunit.client.0.smithi138.stderr: -349> 2024-09-14T11:33:52.789+0000 7f02ef3bc9c0 5 AuthRegistry(0x55cd75d033a8) adding auth protocol: cephx 2024-09-14T11:33:53.116 INFO:tasks.workunit.client.0.smithi138.stderr: -348> 2024-09-14T11:33:52.789+0000 7f02ef3bc9c0 5 AuthRegistry(0x55cd75d033a8) adding auth protocol: cephx 2024-09-14T11:33:53.116 INFO:tasks.workunit.client.0.smithi138.stderr: -347> 2024-09-14T11:33:52.789+0000 7f02ef3bc9c0 5 AuthRegistry(0x55cd75d033a8) adding con mode: secure 2024-09-14T11:33:53.116 INFO:tasks.workunit.client.0.smithi138.stderr: -346> 2024-09-14T11:33:52.789+0000 7f02ef3bc9c0 5 AuthRegistry(0x55cd75d033a8) adding con mode: crc 2024-09-14T11:33:53.116 INFO:tasks.workunit.client.0.smithi138.stderr: -345> 2024-09-14T11:33:52.789+0000 7f02ef3bc9c0 5 AuthRegistry(0x55cd75d033a8) adding con mode: secure 2024-09-14T11:33:53.116 INFO:tasks.workunit.client.0.smithi138.stderr: -344> 2024-09-14T11:33:52.789+0000 7f02ef3bc9c0 5 AuthRegistry(0x55cd75d033a8) adding con mode: crc 2024-09-14T11:33:53.116 INFO:tasks.workunit.client.0.smithi138.stderr: -343> 2024-09-14T11:33:52.789+0000 7f02ef3bc9c0 5 AuthRegistry(0x55cd75d033a8) adding con mode: secure 2024-09-14T11:33:53.116 INFO:tasks.workunit.client.0.smithi138.stderr: -342> 2024-09-14T11:33:52.789+0000 7f02ef3bc9c0 5 AuthRegistry(0x55cd75d033a8) adding con mode: crc 2024-09-14T11:33:53.116 INFO:tasks.workunit.client.0.smithi138.stderr: -341> 2024-09-14T11:33:52.789+0000 7f02ef3bc9c0 5 AuthRegistry(0x55cd75d033a8) adding con mode: crc 2024-09-14T11:33:53.117 INFO:tasks.workunit.client.0.smithi138.stderr: -340> 2024-09-14T11:33:52.789+0000 7f02ef3bc9c0 5 AuthRegistry(0x55cd75d033a8) adding con mode: secure 2024-09-14T11:33:53.117 INFO:tasks.workunit.client.0.smithi138.stderr: -339> 2024-09-14T11:33:52.789+0000 7f02ef3bc9c0 5 AuthRegistry(0x55cd75d033a8) adding con mode: crc 2024-09-14T11:33:53.117 INFO:tasks.workunit.client.0.smithi138.stderr: -338> 2024-09-14T11:33:52.789+0000 7f02ef3bc9c0 5 AuthRegistry(0x55cd75d033a8) adding con mode: secure 2024-09-14T11:33:53.117 INFO:tasks.workunit.client.0.smithi138.stderr: -337> 2024-09-14T11:33:52.789+0000 7f02ef3bc9c0 5 AuthRegistry(0x55cd75d033a8) adding con mode: crc 2024-09-14T11:33:53.117 INFO:tasks.workunit.client.0.smithi138.stderr: -336> 2024-09-14T11:33:52.789+0000 7f02ef3bc9c0 5 AuthRegistry(0x55cd75d033a8) adding con mode: secure 2024-09-14T11:33:53.117 INFO:tasks.workunit.client.0.smithi138.stderr: -335> 2024-09-14T11:33:52.789+0000 7f02ef3bc9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:33:53.117 INFO:tasks.workunit.client.0.smithi138.stderr: -334> 2024-09-14T11:33:52.789+0000 7f02ef3bc9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:33:53.117 INFO:tasks.workunit.client.0.smithi138.stderr: -333> 2024-09-14T11:33:52.789+0000 7f02ef3bc9c0 5 asok(0x55cd75aa1d90) register_command rotate-key cmddesc rotate-key hook 0x55cd75d034f0 EEXIST 2024-09-14T11:33:53.117 INFO:tasks.workunit.client.0.smithi138.stderr: -332> 2024-09-14T11:33:52.789+0000 7f02ef3bc9c0 10 monclient: _reopen_session rank -1 2024-09-14T11:33:53.117 INFO:tasks.workunit.client.0.smithi138.stderr: -331> 2024-09-14T11:33:52.789+0000 7f02ef3bc9c0 10 monclient: _add_conns ranks=[1,0,2] 2024-09-14T11:33:53.117 INFO:tasks.workunit.client.0.smithi138.stderr: -330> 2024-09-14T11:33:52.789+0000 7f02ef3bc9c0 10 monclient(hunting): picked mon.noname-b con 0x55cd75d2bfc0 addr [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] 2024-09-14T11:33:53.117 INFO:tasks.workunit.client.0.smithi138.stderr: -329> 2024-09-14T11:33:52.789+0000 7f02ef3bc9c0 10 monclient(hunting): picked mon.noname-a con 0x55cd75d2b8f0 addr [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] 2024-09-14T11:33:53.117 INFO:tasks.workunit.client.0.smithi138.stderr: -328> 2024-09-14T11:33:52.789+0000 7f02ef3bc9c0 10 monclient(hunting): picked mon.noname-c con 0x55cd75d2a2d0 addr [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] 2024-09-14T11:33:53.117 INFO:tasks.workunit.client.0.smithi138.stderr: -327> 2024-09-14T11:33:52.789+0000 7f02ef3bc9c0 10 monclient(hunting): start opening mon connection 2024-09-14T11:33:53.118 INFO:tasks.workunit.client.0.smithi138.stderr: -326> 2024-09-14T11:33:52.789+0000 7f02ef3bc9c0 10 monclient(hunting): start opening mon connection 2024-09-14T11:33:53.118 INFO:tasks.workunit.client.0.smithi138.stderr: -325> 2024-09-14T11:33:52.789+0000 7f02ef3bc9c0 10 monclient(hunting): start opening mon connection 2024-09-14T11:33:53.118 INFO:tasks.workunit.client.0.smithi138.stderr: -324> 2024-09-14T11:33:52.789+0000 7f02ef3bc9c0 10 monclient(hunting): _renew_subs 2024-09-14T11:33:53.118 INFO:tasks.workunit.client.0.smithi138.stderr: -323> 2024-09-14T11:33:52.789+0000 7f02ef3bc9c0 10 monclient(hunting): authenticate will time out at 2568.754083s 2024-09-14T11:33:53.118 INFO:tasks.workunit.client.0.smithi138.stderr: -322> 2024-09-14T11:33:52.789+0000 7f02ed6c3640 10 monclient(hunting): get_auth_request con 0x55cd75d2b8f0 auth_method 0 2024-09-14T11:33:53.118 INFO:tasks.workunit.client.0.smithi138.stderr: -321> 2024-09-14T11:33:52.789+0000 7f02ed6c3640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:33:53.118 INFO:tasks.workunit.client.0.smithi138.stderr: -320> 2024-09-14T11:33:52.789+0000 7f02ed6c3640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:33:53.118 INFO:tasks.workunit.client.0.smithi138.stderr: -319> 2024-09-14T11:33:52.789+0000 7f02ed6c3640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:33:53.118 INFO:tasks.workunit.client.0.smithi138.stderr: -318> 2024-09-14T11:33:52.789+0000 7f02ecec2640 10 monclient(hunting): get_auth_request con 0x55cd75d2a2d0 auth_method 0 2024-09-14T11:33:53.118 INFO:tasks.workunit.client.0.smithi138.stderr: -317> 2024-09-14T11:33:52.789+0000 7f02ecec2640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:33:53.118 INFO:tasks.workunit.client.0.smithi138.stderr: -316> 2024-09-14T11:33:52.789+0000 7f02ecec2640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:33:53.118 INFO:tasks.workunit.client.0.smithi138.stderr: -315> 2024-09-14T11:33:52.789+0000 7f02ecec2640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:33:53.118 INFO:tasks.workunit.client.0.smithi138.stderr: -314> 2024-09-14T11:33:52.789+0000 7f02ed6c3640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:33:53.118 INFO:tasks.workunit.client.0.smithi138.stderr: -313> 2024-09-14T11:33:52.789+0000 7f02ed6c3640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:33:53.119 INFO:tasks.workunit.client.0.smithi138.stderr: -312> 2024-09-14T11:33:52.789+0000 7f02ed6c3640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:33:53.119 INFO:tasks.workunit.client.0.smithi138.stderr: -311> 2024-09-14T11:33:52.789+0000 7f02ecec2640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:33:53.119 INFO:tasks.workunit.client.0.smithi138.stderr: -310> 2024-09-14T11:33:52.789+0000 7f02ecec2640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:33:53.119 INFO:tasks.workunit.client.0.smithi138.stderr: -309> 2024-09-14T11:33:52.789+0000 7f02ecec2640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:33:53.119 INFO:tasks.workunit.client.0.smithi138.stderr: -308> 2024-09-14T11:33:52.789+0000 7f02ec6c1640 10 monclient(hunting): get_auth_request con 0x55cd75d2bfc0 auth_method 0 2024-09-14T11:33:53.119 INFO:tasks.workunit.client.0.smithi138.stderr: -307> 2024-09-14T11:33:52.789+0000 7f02ec6c1640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:33:53.119 INFO:tasks.workunit.client.0.smithi138.stderr: -306> 2024-09-14T11:33:52.789+0000 7f02ec6c1640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:33:53.119 INFO:tasks.workunit.client.0.smithi138.stderr: -305> 2024-09-14T11:33:52.789+0000 7f02ec6c1640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:33:53.119 INFO:tasks.workunit.client.0.smithi138.stderr: -304> 2024-09-14T11:33:52.789+0000 7f02ecec2640 10 monclient(hunting): handle_auth_done global_id 5900 payload 824 2024-09-14T11:33:53.119 INFO:tasks.workunit.client.0.smithi138.stderr: -303> 2024-09-14T11:33:52.789+0000 7f02ecec2640 10 monclient: _finish_hunting 0 2024-09-14T11:33:53.119 INFO:tasks.workunit.client.0.smithi138.stderr: -302> 2024-09-14T11:33:52.789+0000 7f02ecec2640 1 monclient: found mon.noname-c 2024-09-14T11:33:53.119 INFO:tasks.workunit.client.0.smithi138.stderr: -301> 2024-09-14T11:33:52.789+0000 7f02ecec2640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.138:3301/0 2024-09-14T11:33:53.119 INFO:tasks.workunit.client.0.smithi138.stderr: -300> 2024-09-14T11:33:52.789+0000 7f01d27fc640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:33:53.119 INFO:tasks.workunit.client.0.smithi138.stderr: -299> 2024-09-14T11:33:52.789+0000 7f01d27fc640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-14T11:33:53.120 INFO:tasks.workunit.client.0.smithi138.stderr: -298> 2024-09-14T11:33:52.789+0000 7f01d27fc640 10 monclient: dump: 2024-09-14T11:33:53.120 INFO:tasks.workunit.client.0.smithi138.stderr:epoch 1 2024-09-14T11:33:53.120 INFO:tasks.workunit.client.0.smithi138.stderr:fsid 3f225f43-83a6-4aeb-b798-1f04bb49d597 2024-09-14T11:33:53.120 INFO:tasks.workunit.client.0.smithi138.stderr:last_changed 2024-09-14T11:07:09.252780+0000 2024-09-14T11:33:53.120 INFO:tasks.workunit.client.0.smithi138.stderr:created 2024-09-14T11:07:09.252780+0000 2024-09-14T11:33:53.120 INFO:tasks.workunit.client.0.smithi138.stderr:min_mon_release 19 (squid) 2024-09-14T11:33:53.120 INFO:tasks.workunit.client.0.smithi138.stderr:election_strategy: 1 2024-09-14T11:33:53.120 INFO:tasks.workunit.client.0.smithi138.stderr:0: [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] mon.a 2024-09-14T11:33:53.120 INFO:tasks.workunit.client.0.smithi138.stderr:1: [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] mon.b 2024-09-14T11:33:53.120 INFO:tasks.workunit.client.0.smithi138.stderr:2: [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] mon.c 2024-09-14T11:33:53.120 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-14T11:33:53.120 INFO:tasks.workunit.client.0.smithi138.stderr: -297> 2024-09-14T11:33:52.789+0000 7f01d27fc640 10 monclient: _finish_auth 0 2024-09-14T11:33:53.120 INFO:tasks.workunit.client.0.smithi138.stderr: -296> 2024-09-14T11:33:52.789+0000 7f01d27fc640 10 monclient: _check_auth_tickets 2024-09-14T11:33:53.120 INFO:tasks.workunit.client.0.smithi138.stderr: -295> 2024-09-14T11:33:52.789+0000 7f01d27fc640 10 monclient: handle_config config(0 keys) 2024-09-14T11:33:53.120 INFO:tasks.workunit.client.0.smithi138.stderr: -294> 2024-09-14T11:33:52.789+0000 7f01d27fc640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:33:53.120 INFO:tasks.workunit.client.0.smithi138.stderr: -293> 2024-09-14T11:33:52.789+0000 7f01d27fc640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-14T11:33:53.121 INFO:tasks.workunit.client.0.smithi138.stderr: -292> 2024-09-14T11:33:52.789+0000 7f01d27fc640 10 monclient: dump: 2024-09-14T11:33:53.121 INFO:tasks.workunit.client.0.smithi138.stderr:epoch 1 2024-09-14T11:33:53.121 INFO:tasks.workunit.client.0.smithi138.stderr:fsid 3f225f43-83a6-4aeb-b798-1f04bb49d597 2024-09-14T11:33:53.121 INFO:tasks.workunit.client.0.smithi138.stderr:last_changed 2024-09-14T11:07:09.252780+0000 2024-09-14T11:33:53.121 INFO:tasks.workunit.client.0.smithi138.stderr:created 2024-09-14T11:07:09.252780+0000 2024-09-14T11:33:53.121 INFO:tasks.workunit.client.0.smithi138.stderr:min_mon_release 19 (squid) 2024-09-14T11:33:53.121 INFO:tasks.workunit.client.0.smithi138.stderr:election_strategy: 1 2024-09-14T11:33:53.121 INFO:tasks.workunit.client.0.smithi138.stderr:0: [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] mon.a 2024-09-14T11:33:53.121 INFO:tasks.workunit.client.0.smithi138.stderr:1: [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] mon.b 2024-09-14T11:33:53.121 INFO:tasks.workunit.client.0.smithi138.stderr:2: [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] mon.c 2024-09-14T11:33:53.121 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-14T11:33:53.121 INFO:tasks.workunit.client.0.smithi138.stderr: -291> 2024-09-14T11:33:52.789+0000 7f02ef3bc9c0 5 monclient: authenticate success, global_id 5900 2024-09-14T11:33:53.121 INFO:tasks.workunit.client.0.smithi138.stderr: -290> 2024-09-14T11:33:52.789+0000 7f02edec4640 4 set_mon_vals no callback set 2024-09-14T11:33:53.121 INFO:tasks.workunit.client.0.smithi138.stderr: -289> 2024-09-14T11:33:52.789+0000 7f02ef3bc9c0 10 monclient: _renew_subs 2024-09-14T11:33:53.122 INFO:tasks.workunit.client.0.smithi138.stderr: -288> 2024-09-14T11:33:52.789+0000 7f02ef3bc9c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.138:3301/0 2024-09-14T11:33:53.122 INFO:tasks.workunit.client.0.smithi138.stderr: -287> 2024-09-14T11:33:52.789+0000 7f02ef3bc9c0 10 monclient: _renew_subs 2024-09-14T11:33:53.122 INFO:tasks.workunit.client.0.smithi138.stderr: -286> 2024-09-14T11:33:52.789+0000 7f02ef3bc9c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.138:3301/0 2024-09-14T11:33:53.122 INFO:tasks.workunit.client.0.smithi138.stderr: -285> 2024-09-14T11:33:52.793+0000 7f01d27fc640 4 mgrc handle_mgr_map Got map version 5 2024-09-14T11:33:53.122 INFO:tasks.workunit.client.0.smithi138.stderr: -284> 2024-09-14T11:33:52.793+0000 7f01d27fc640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.138:6832/3778043143,v1:172.21.15.138:6833/3778043143] 2024-09-14T11:33:53.122 INFO:tasks.workunit.client.0.smithi138.stderr: -283> 2024-09-14T11:33:52.793+0000 7f01d27fc640 4 mgrc reconnect Starting new session with [v2:172.21.15.138:6832/3778043143,v1:172.21.15.138:6833/3778043143] 2024-09-14T11:33:53.122 INFO:tasks.workunit.client.0.smithi138.stderr: -282> 2024-09-14T11:33:52.793+0000 7f02ec6c1640 10 monclient: get_auth_request con 0x7f01c40717e0 auth_method 0 2024-09-14T11:33:53.122 INFO:tasks.workunit.client.0.smithi138.stderr: -281> 2024-09-14T11:33:52.793+0000 7f02ef3bc9c0 10 monclient: get_monmap_and_config 2024-09-14T11:33:53.122 INFO:tasks.workunit.client.0.smithi138.stderr: -280> 2024-09-14T11:33:52.793+0000 7f02ef3bc9c0 10 monclient: build_initial_monmap 2024-09-14T11:33:53.122 INFO:tasks.workunit.client.0.smithi138.stderr: -279> 2024-09-14T11:33:52.793+0000 7f02ef3bc9c0 1 build_initial for_mkfs: 0 2024-09-14T11:33:53.122 INFO:tasks.workunit.client.0.smithi138.stderr: -278> 2024-09-14T11:33:52.793+0000 7f02ef3bc9c0 10 monclient: monmap: 2024-09-14T11:33:53.122 INFO:tasks.workunit.client.0.smithi138.stderr:epoch 0 2024-09-14T11:33:53.122 INFO:tasks.workunit.client.0.smithi138.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-14T11:33:53.122 INFO:tasks.workunit.client.0.smithi138.stderr:last_changed 0.000000 2024-09-14T11:33:53.123 INFO:tasks.workunit.client.0.smithi138.stderr:created 0.000000 2024-09-14T11:33:53.123 INFO:tasks.workunit.client.0.smithi138.stderr:min_mon_release 0 (unknown) 2024-09-14T11:33:53.123 INFO:tasks.workunit.client.0.smithi138.stderr:election_strategy: 1 2024-09-14T11:33:53.123 INFO:tasks.workunit.client.0.smithi138.stderr:0: [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] mon.noname-a 2024-09-14T11:33:53.123 INFO:tasks.workunit.client.0.smithi138.stderr:1: [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] mon.noname-b 2024-09-14T11:33:53.123 INFO:tasks.workunit.client.0.smithi138.stderr:2: [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] mon.noname-c 2024-09-14T11:33:53.123 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-14T11:33:53.123 INFO:tasks.workunit.client.0.smithi138.stderr: -277> 2024-09-14T11:33:52.793+0000 7f02ef3bc9c0 5 AuthRegistry(0x55cd75d4b900) adding auth protocol: cephx 2024-09-14T11:33:53.123 INFO:tasks.workunit.client.0.smithi138.stderr: -276> 2024-09-14T11:33:52.793+0000 7f02ef3bc9c0 5 AuthRegistry(0x55cd75d4b900) adding auth protocol: cephx 2024-09-14T11:33:53.123 INFO:tasks.workunit.client.0.smithi138.stderr: -275> 2024-09-14T11:33:52.793+0000 7f02ef3bc9c0 5 AuthRegistry(0x55cd75d4b900) adding auth protocol: cephx 2024-09-14T11:33:53.123 INFO:tasks.workunit.client.0.smithi138.stderr: -274> 2024-09-14T11:33:52.793+0000 7f02ef3bc9c0 5 AuthRegistry(0x55cd75d4b900) adding con mode: secure 2024-09-14T11:33:53.123 INFO:tasks.workunit.client.0.smithi138.stderr: -273> 2024-09-14T11:33:52.793+0000 7f02ef3bc9c0 5 AuthRegistry(0x55cd75d4b900) adding con mode: crc 2024-09-14T11:33:53.123 INFO:tasks.workunit.client.0.smithi138.stderr: -272> 2024-09-14T11:33:52.793+0000 7f02ef3bc9c0 5 AuthRegistry(0x55cd75d4b900) adding con mode: secure 2024-09-14T11:33:53.123 INFO:tasks.workunit.client.0.smithi138.stderr: -271> 2024-09-14T11:33:52.793+0000 7f02ef3bc9c0 5 AuthRegistry(0x55cd75d4b900) adding con mode: crc 2024-09-14T11:33:53.124 INFO:tasks.workunit.client.0.smithi138.stderr: -270> 2024-09-14T11:33:52.793+0000 7f02ef3bc9c0 5 AuthRegistry(0x55cd75d4b900) adding con mode: secure 2024-09-14T11:33:53.124 INFO:tasks.workunit.client.0.smithi138.stderr: -269> 2024-09-14T11:33:52.793+0000 7f02ef3bc9c0 5 AuthRegistry(0x55cd75d4b900) adding con mode: crc 2024-09-14T11:33:53.124 INFO:tasks.workunit.client.0.smithi138.stderr: -268> 2024-09-14T11:33:52.793+0000 7f02ef3bc9c0 5 AuthRegistry(0x55cd75d4b900) adding con mode: crc 2024-09-14T11:33:53.124 INFO:tasks.workunit.client.0.smithi138.stderr: -267> 2024-09-14T11:33:52.793+0000 7f02ef3bc9c0 5 AuthRegistry(0x55cd75d4b900) adding con mode: secure 2024-09-14T11:33:53.124 INFO:tasks.workunit.client.0.smithi138.stderr: -266> 2024-09-14T11:33:52.793+0000 7f02ef3bc9c0 5 AuthRegistry(0x55cd75d4b900) adding con mode: crc 2024-09-14T11:33:53.124 INFO:tasks.workunit.client.0.smithi138.stderr: -265> 2024-09-14T11:33:52.793+0000 7f02ef3bc9c0 5 AuthRegistry(0x55cd75d4b900) adding con mode: secure 2024-09-14T11:33:53.124 INFO:tasks.workunit.client.0.smithi138.stderr: -264> 2024-09-14T11:33:52.793+0000 7f02ef3bc9c0 5 AuthRegistry(0x55cd75d4b900) adding con mode: crc 2024-09-14T11:33:53.124 INFO:tasks.workunit.client.0.smithi138.stderr: -263> 2024-09-14T11:33:52.793+0000 7f02ef3bc9c0 5 AuthRegistry(0x55cd75d4b900) adding con mode: secure 2024-09-14T11:33:53.124 INFO:tasks.workunit.client.0.smithi138.stderr: -262> 2024-09-14T11:33:52.793+0000 7f02ef3bc9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:33:53.124 INFO:tasks.workunit.client.0.smithi138.stderr: -261> 2024-09-14T11:33:52.793+0000 7f02ef3bc9c0 10 monclient: init 2024-09-14T11:33:53.124 INFO:tasks.workunit.client.0.smithi138.stderr: -260> 2024-09-14T11:33:52.793+0000 7f02ef3bc9c0 5 AuthRegistry(0x7ffd2b80a160) adding auth protocol: cephx 2024-09-14T11:33:53.124 INFO:tasks.workunit.client.0.smithi138.stderr: -259> 2024-09-14T11:33:52.793+0000 7f02ef3bc9c0 5 AuthRegistry(0x7ffd2b80a160) adding auth protocol: cephx 2024-09-14T11:33:53.124 INFO:tasks.workunit.client.0.smithi138.stderr: -258> 2024-09-14T11:33:52.793+0000 7f02ef3bc9c0 5 AuthRegistry(0x7ffd2b80a160) adding auth protocol: cephx 2024-09-14T11:33:53.124 INFO:tasks.workunit.client.0.smithi138.stderr: -257> 2024-09-14T11:33:52.793+0000 7f02ef3bc9c0 5 AuthRegistry(0x7ffd2b80a160) adding con mode: secure 2024-09-14T11:33:53.125 INFO:tasks.workunit.client.0.smithi138.stderr: -256> 2024-09-14T11:33:52.793+0000 7f02ef3bc9c0 5 AuthRegistry(0x7ffd2b80a160) adding con mode: crc 2024-09-14T11:33:53.125 INFO:tasks.workunit.client.0.smithi138.stderr: -255> 2024-09-14T11:33:52.793+0000 7f02ef3bc9c0 5 AuthRegistry(0x7ffd2b80a160) adding con mode: secure 2024-09-14T11:33:53.125 INFO:tasks.workunit.client.0.smithi138.stderr: -254> 2024-09-14T11:33:52.793+0000 7f02ef3bc9c0 5 AuthRegistry(0x7ffd2b80a160) adding con mode: crc 2024-09-14T11:33:53.125 INFO:tasks.workunit.client.0.smithi138.stderr: -253> 2024-09-14T11:33:52.793+0000 7f02ef3bc9c0 5 AuthRegistry(0x7ffd2b80a160) adding con mode: secure 2024-09-14T11:33:53.125 INFO:tasks.workunit.client.0.smithi138.stderr: -252> 2024-09-14T11:33:52.793+0000 7f02ef3bc9c0 5 AuthRegistry(0x7ffd2b80a160) adding con mode: crc 2024-09-14T11:33:53.125 INFO:tasks.workunit.client.0.smithi138.stderr: -251> 2024-09-14T11:33:52.793+0000 7f02ef3bc9c0 5 AuthRegistry(0x7ffd2b80a160) adding con mode: crc 2024-09-14T11:33:53.125 INFO:tasks.workunit.client.0.smithi138.stderr: -250> 2024-09-14T11:33:52.793+0000 7f02ef3bc9c0 5 AuthRegistry(0x7ffd2b80a160) adding con mode: secure 2024-09-14T11:33:53.125 INFO:tasks.workunit.client.0.smithi138.stderr: -249> 2024-09-14T11:33:52.793+0000 7f02ef3bc9c0 5 AuthRegistry(0x7ffd2b80a160) adding con mode: crc 2024-09-14T11:33:53.125 INFO:tasks.workunit.client.0.smithi138.stderr: -248> 2024-09-14T11:33:52.793+0000 7f02ef3bc9c0 5 AuthRegistry(0x7ffd2b80a160) adding con mode: secure 2024-09-14T11:33:53.125 INFO:tasks.workunit.client.0.smithi138.stderr: -247> 2024-09-14T11:33:52.793+0000 7f02ef3bc9c0 5 AuthRegistry(0x7ffd2b80a160) adding con mode: crc 2024-09-14T11:33:53.125 INFO:tasks.workunit.client.0.smithi138.stderr: -246> 2024-09-14T11:33:52.793+0000 7f02ef3bc9c0 5 AuthRegistry(0x7ffd2b80a160) adding con mode: secure 2024-09-14T11:33:53.125 INFO:tasks.workunit.client.0.smithi138.stderr: -245> 2024-09-14T11:33:52.793+0000 7f02ef3bc9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:33:53.125 INFO:tasks.workunit.client.0.smithi138.stderr: -244> 2024-09-14T11:33:52.793+0000 7f02ef3bc9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:33:53.125 INFO:tasks.workunit.client.0.smithi138.stderr: -243> 2024-09-14T11:33:52.793+0000 7f02ef3bc9c0 5 asok(0x55cd75aa1d90) register_command rotate-key cmddesc rotate-key hook 0x7ffd2b80a2a8 EEXIST 2024-09-14T11:33:53.125 INFO:tasks.workunit.client.0.smithi138.stderr: -242> 2024-09-14T11:33:52.793+0000 7f02ef3bc9c0 10 monclient: _reopen_session rank -1 2024-09-14T11:33:53.126 INFO:tasks.workunit.client.0.smithi138.stderr: -241> 2024-09-14T11:33:52.793+0000 7f02ef3bc9c0 10 monclient: _add_conns ranks=[1,2,0] 2024-09-14T11:33:53.126 INFO:tasks.workunit.client.0.smithi138.stderr: -240> 2024-09-14T11:33:52.793+0000 7f02ef3bc9c0 10 monclient(hunting): picked mon.noname-b con 0x55cd75d7fe20 addr [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] 2024-09-14T11:33:53.126 INFO:tasks.workunit.client.0.smithi138.stderr: -239> 2024-09-14T11:33:52.793+0000 7f02ef3bc9c0 10 monclient(hunting): picked mon.noname-c con 0x55cd75d4f840 addr [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] 2024-09-14T11:33:53.126 INFO:tasks.workunit.client.0.smithi138.stderr: -238> 2024-09-14T11:33:52.793+0000 7f02ef3bc9c0 10 monclient(hunting): picked mon.noname-a con 0x55cd75d7b5f0 addr [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] 2024-09-14T11:33:53.126 INFO:tasks.workunit.client.0.smithi138.stderr: -237> 2024-09-14T11:33:52.793+0000 7f02ef3bc9c0 10 monclient(hunting): start opening mon connection 2024-09-14T11:33:53.126 INFO:tasks.workunit.client.0.smithi138.stderr: -236> 2024-09-14T11:33:52.793+0000 7f02ef3bc9c0 10 monclient(hunting): start opening mon connection 2024-09-14T11:33:53.126 INFO:tasks.workunit.client.0.smithi138.stderr: -235> 2024-09-14T11:33:52.793+0000 7f02ef3bc9c0 10 monclient(hunting): start opening mon connection 2024-09-14T11:33:53.126 INFO:tasks.workunit.client.0.smithi138.stderr: -234> 2024-09-14T11:33:52.793+0000 7f02ef3bc9c0 10 monclient(hunting): _renew_subs 2024-09-14T11:33:53.126 INFO:tasks.workunit.client.0.smithi138.stderr: -233> 2024-09-14T11:33:52.793+0000 7f02ef3bc9c0 10 monclient(hunting): authenticate will time out at 2568.758501s 2024-09-14T11:33:53.126 INFO:tasks.workunit.client.0.smithi138.stderr: -232> 2024-09-14T11:33:52.793+0000 7f02ecec2640 10 monclient(hunting): get_auth_request con 0x55cd75d7b5f0 auth_method 0 2024-09-14T11:33:53.126 INFO:tasks.workunit.client.0.smithi138.stderr: -231> 2024-09-14T11:33:52.793+0000 7f02ecec2640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:33:53.126 INFO:tasks.workunit.client.0.smithi138.stderr: -230> 2024-09-14T11:33:52.793+0000 7f02ecec2640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:33:53.126 INFO:tasks.workunit.client.0.smithi138.stderr: -229> 2024-09-14T11:33:52.793+0000 7f02ecec2640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:33:53.126 INFO:tasks.workunit.client.0.smithi138.stderr: -228> 2024-09-14T11:33:52.793+0000 7f02ed6c3640 10 monclient(hunting): get_auth_request con 0x55cd75d4f840 auth_method 0 2024-09-14T11:33:53.126 INFO:tasks.workunit.client.0.smithi138.stderr: -227> 2024-09-14T11:33:52.793+0000 7f02ed6c3640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:33:53.126 INFO:tasks.workunit.client.0.smithi138.stderr: -226> 2024-09-14T11:33:52.793+0000 7f02ed6c3640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:33:53.127 INFO:tasks.workunit.client.0.smithi138.stderr: -225> 2024-09-14T11:33:52.793+0000 7f02ed6c3640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:33:53.127 INFO:tasks.workunit.client.0.smithi138.stderr: -224> 2024-09-14T11:33:52.793+0000 7f02ecec2640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:33:53.127 INFO:tasks.workunit.client.0.smithi138.stderr: -223> 2024-09-14T11:33:52.793+0000 7f02ecec2640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:33:53.127 INFO:tasks.workunit.client.0.smithi138.stderr: -222> 2024-09-14T11:33:52.793+0000 7f02ecec2640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:33:53.127 INFO:tasks.workunit.client.0.smithi138.stderr: -221> 2024-09-14T11:33:52.793+0000 7f02ed6c3640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:33:53.127 INFO:tasks.workunit.client.0.smithi138.stderr: -220> 2024-09-14T11:33:52.793+0000 7f02ed6c3640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:33:53.127 INFO:tasks.workunit.client.0.smithi138.stderr: -219> 2024-09-14T11:33:52.793+0000 7f02ed6c3640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:33:53.127 INFO:tasks.workunit.client.0.smithi138.stderr: -218> 2024-09-14T11:33:52.793+0000 7f02ecec2640 10 monclient(hunting): handle_auth_done global_id 6279 payload 274 2024-09-14T11:33:53.127 INFO:tasks.workunit.client.0.smithi138.stderr: -217> 2024-09-14T11:33:52.793+0000 7f02ecec2640 10 monclient: _finish_hunting 0 2024-09-14T11:33:53.127 INFO:tasks.workunit.client.0.smithi138.stderr: -216> 2024-09-14T11:33:52.793+0000 7f02ecec2640 1 monclient: found mon.noname-a 2024-09-14T11:33:53.127 INFO:tasks.workunit.client.0.smithi138.stderr: -215> 2024-09-14T11:33:52.793+0000 7f02ecec2640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.138:3300/0 2024-09-14T11:33:53.127 INFO:tasks.workunit.client.0.smithi138.stderr: -214> 2024-09-14T11:33:52.793+0000 7f01c3fff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:33:53.128 INFO:tasks.workunit.client.0.smithi138.stderr: -213> 2024-09-14T11:33:52.793+0000 7f01c3fff640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-14T11:33:53.128 INFO:tasks.workunit.client.0.smithi138.stderr: -212> 2024-09-14T11:33:52.793+0000 7f01c3fff640 10 monclient: dump: 2024-09-14T11:33:53.128 INFO:tasks.workunit.client.0.smithi138.stderr:epoch 1 2024-09-14T11:33:53.128 INFO:tasks.workunit.client.0.smithi138.stderr:fsid 3f225f43-83a6-4aeb-b798-1f04bb49d597 2024-09-14T11:33:53.128 INFO:tasks.workunit.client.0.smithi138.stderr:last_changed 2024-09-14T11:07:09.252780+0000 2024-09-14T11:33:53.128 INFO:tasks.workunit.client.0.smithi138.stderr:created 2024-09-14T11:07:09.252780+0000 2024-09-14T11:33:53.128 INFO:tasks.workunit.client.0.smithi138.stderr:min_mon_release 19 (squid) 2024-09-14T11:33:53.128 INFO:tasks.workunit.client.0.smithi138.stderr:election_strategy: 1 2024-09-14T11:33:53.128 INFO:tasks.workunit.client.0.smithi138.stderr:0: [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] mon.a 2024-09-14T11:33:53.128 INFO:tasks.workunit.client.0.smithi138.stderr:1: [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] mon.b 2024-09-14T11:33:53.128 INFO:tasks.workunit.client.0.smithi138.stderr:2: [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] mon.c 2024-09-14T11:33:53.128 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-14T11:33:53.128 INFO:tasks.workunit.client.0.smithi138.stderr: -211> 2024-09-14T11:33:52.793+0000 7f01c3fff640 10 monclient: _finish_auth 0 2024-09-14T11:33:53.128 INFO:tasks.workunit.client.0.smithi138.stderr: -210> 2024-09-14T11:33:52.793+0000 7f01c3fff640 10 monclient: _check_auth_tickets 2024-09-14T11:33:53.128 INFO:tasks.workunit.client.0.smithi138.stderr: -209> 2024-09-14T11:33:52.793+0000 7f01c3fff640 10 monclient: handle_config config(0 keys) 2024-09-14T11:33:53.129 INFO:tasks.workunit.client.0.smithi138.stderr: -208> 2024-09-14T11:33:52.793+0000 7f01c3fff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:33:53.129 INFO:tasks.workunit.client.0.smithi138.stderr: -207> 2024-09-14T11:33:52.793+0000 7f01c3fff640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-14T11:33:53.129 INFO:tasks.workunit.client.0.smithi138.stderr: -206> 2024-09-14T11:33:52.793+0000 7f01c3fff640 10 monclient: dump: 2024-09-14T11:33:53.129 INFO:tasks.workunit.client.0.smithi138.stderr:epoch 1 2024-09-14T11:33:53.129 INFO:tasks.workunit.client.0.smithi138.stderr:fsid 3f225f43-83a6-4aeb-b798-1f04bb49d597 2024-09-14T11:33:53.129 INFO:tasks.workunit.client.0.smithi138.stderr:last_changed 2024-09-14T11:07:09.252780+0000 2024-09-14T11:33:53.129 INFO:tasks.workunit.client.0.smithi138.stderr:created 2024-09-14T11:07:09.252780+0000 2024-09-14T11:33:53.129 INFO:tasks.workunit.client.0.smithi138.stderr:min_mon_release 19 (squid) 2024-09-14T11:33:53.129 INFO:tasks.workunit.client.0.smithi138.stderr:election_strategy: 1 2024-09-14T11:33:53.129 INFO:tasks.workunit.client.0.smithi138.stderr:0: [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] mon.a 2024-09-14T11:33:53.129 INFO:tasks.workunit.client.0.smithi138.stderr:1: [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] mon.b 2024-09-14T11:33:53.129 INFO:tasks.workunit.client.0.smithi138.stderr:2: [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] mon.c 2024-09-14T11:33:53.129 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-14T11:33:53.129 INFO:tasks.workunit.client.0.smithi138.stderr: -205> 2024-09-14T11:33:52.793+0000 7f02ef3bc9c0 5 monclient: authenticate success, global_id 6279 2024-09-14T11:33:53.130 INFO:tasks.workunit.client.0.smithi138.stderr: -204> 2024-09-14T11:33:52.793+0000 7f02ef3bc9c0 10 monclient: get_monmap_and_config success 2024-09-14T11:33:53.130 INFO:tasks.workunit.client.0.smithi138.stderr: -203> 2024-09-14T11:33:52.793+0000 7f02ef3bc9c0 4 set_mon_vals no callback set 2024-09-14T11:33:53.130 INFO:tasks.workunit.client.0.smithi138.stderr: -202> 2024-09-14T11:33:52.793+0000 7f02ef3bc9c0 10 monclient: shutdown 2024-09-14T11:33:53.130 INFO:tasks.workunit.client.0.smithi138.stderr: -201> 2024-09-14T11:33:52.797+0000 7f02ef3bc9c0 10 monclient: build_initial_monmap 2024-09-14T11:33:53.130 INFO:tasks.workunit.client.0.smithi138.stderr: -200> 2024-09-14T11:33:52.797+0000 7f02ef3bc9c0 1 build_initial for_mkfs: 0 2024-09-14T11:33:53.130 INFO:tasks.workunit.client.0.smithi138.stderr: -199> 2024-09-14T11:33:52.797+0000 7f02ef3bc9c0 10 monclient: monmap: 2024-09-14T11:33:53.130 INFO:tasks.workunit.client.0.smithi138.stderr:epoch 0 2024-09-14T11:33:53.130 INFO:tasks.workunit.client.0.smithi138.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-14T11:33:53.130 INFO:tasks.workunit.client.0.smithi138.stderr:last_changed 0.000000 2024-09-14T11:33:53.130 INFO:tasks.workunit.client.0.smithi138.stderr:created 0.000000 2024-09-14T11:33:53.130 INFO:tasks.workunit.client.0.smithi138.stderr:min_mon_release 0 (unknown) 2024-09-14T11:33:53.130 INFO:tasks.workunit.client.0.smithi138.stderr:election_strategy: 1 2024-09-14T11:33:53.130 INFO:tasks.workunit.client.0.smithi138.stderr:0: [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] mon.noname-a 2024-09-14T11:33:53.131 INFO:tasks.workunit.client.0.smithi138.stderr:1: [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] mon.noname-b 2024-09-14T11:33:53.131 INFO:tasks.workunit.client.0.smithi138.stderr:2: [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] mon.noname-c 2024-09-14T11:33:53.131 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-14T11:33:53.131 INFO:tasks.workunit.client.0.smithi138.stderr: -198> 2024-09-14T11:33:52.797+0000 7f02ef3bc9c0 5 AuthRegistry(0x55cd75d70840) adding auth protocol: cephx 2024-09-14T11:33:53.131 INFO:tasks.workunit.client.0.smithi138.stderr: -197> 2024-09-14T11:33:52.797+0000 7f02ef3bc9c0 5 AuthRegistry(0x55cd75d70840) adding auth protocol: cephx 2024-09-14T11:33:53.131 INFO:tasks.workunit.client.0.smithi138.stderr: -196> 2024-09-14T11:33:52.797+0000 7f02ef3bc9c0 5 AuthRegistry(0x55cd75d70840) adding auth protocol: cephx 2024-09-14T11:33:53.131 INFO:tasks.workunit.client.0.smithi138.stderr: -195> 2024-09-14T11:33:52.797+0000 7f02ef3bc9c0 5 AuthRegistry(0x55cd75d70840) adding con mode: secure 2024-09-14T11:33:53.131 INFO:tasks.workunit.client.0.smithi138.stderr: -194> 2024-09-14T11:33:52.797+0000 7f02ef3bc9c0 5 AuthRegistry(0x55cd75d70840) adding con mode: crc 2024-09-14T11:33:53.131 INFO:tasks.workunit.client.0.smithi138.stderr: -193> 2024-09-14T11:33:52.797+0000 7f02ef3bc9c0 5 AuthRegistry(0x55cd75d70840) adding con mode: secure 2024-09-14T11:33:53.131 INFO:tasks.workunit.client.0.smithi138.stderr: -192> 2024-09-14T11:33:52.797+0000 7f02ef3bc9c0 5 AuthRegistry(0x55cd75d70840) adding con mode: crc 2024-09-14T11:33:53.132 INFO:tasks.workunit.client.0.smithi138.stderr: -191> 2024-09-14T11:33:52.797+0000 7f02ef3bc9c0 5 AuthRegistry(0x55cd75d70840) adding con mode: secure 2024-09-14T11:33:53.132 INFO:tasks.workunit.client.0.smithi138.stderr: -190> 2024-09-14T11:33:52.797+0000 7f02ef3bc9c0 5 AuthRegistry(0x55cd75d70840) adding con mode: crc 2024-09-14T11:33:53.132 INFO:tasks.workunit.client.0.smithi138.stderr: -189> 2024-09-14T11:33:52.797+0000 7f02ef3bc9c0 5 AuthRegistry(0x55cd75d70840) adding con mode: crc 2024-09-14T11:33:53.132 INFO:tasks.workunit.client.0.smithi138.stderr: -188> 2024-09-14T11:33:52.797+0000 7f02ef3bc9c0 5 AuthRegistry(0x55cd75d70840) adding con mode: secure 2024-09-14T11:33:53.132 INFO:tasks.workunit.client.0.smithi138.stderr: -187> 2024-09-14T11:33:52.797+0000 7f02ef3bc9c0 5 AuthRegistry(0x55cd75d70840) adding con mode: crc 2024-09-14T11:33:53.132 INFO:tasks.workunit.client.0.smithi138.stderr: -186> 2024-09-14T11:33:52.797+0000 7f02ef3bc9c0 5 AuthRegistry(0x55cd75d70840) adding con mode: secure 2024-09-14T11:33:53.132 INFO:tasks.workunit.client.0.smithi138.stderr: -185> 2024-09-14T11:33:52.797+0000 7f02ef3bc9c0 5 AuthRegistry(0x55cd75d70840) adding con mode: crc 2024-09-14T11:33:53.132 INFO:tasks.workunit.client.0.smithi138.stderr: -184> 2024-09-14T11:33:52.797+0000 7f02ef3bc9c0 5 AuthRegistry(0x55cd75d70840) adding con mode: secure 2024-09-14T11:33:53.132 INFO:tasks.workunit.client.0.smithi138.stderr: -183> 2024-09-14T11:33:52.797+0000 7f02ef3bc9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:33:53.132 INFO:tasks.workunit.client.0.smithi138.stderr: -182> 2024-09-14T11:33:52.797+0000 7f02ef3bc9c0 1 librados: starting msgr at 2024-09-14T11:33:53.132 INFO:tasks.workunit.client.0.smithi138.stderr: -181> 2024-09-14T11:33:52.797+0000 7f02ef3bc9c0 1 librados: starting objecter 2024-09-14T11:33:53.132 INFO:tasks.workunit.client.0.smithi138.stderr: -180> 2024-09-14T11:33:52.797+0000 7f02ef3bc9c0 5 asok(0x55cd75aa1d90) register_command objecter_requests cmddesc objecter_requests hook 0x55cd75d31b00 EEXIST 2024-09-14T11:33:53.132 INFO:tasks.workunit.client.0.smithi138.stderr: -179> 2024-09-14T11:33:52.797+0000 7f02ef3bc9c0 1 librados: setting wanted keys 2024-09-14T11:33:53.132 INFO:tasks.workunit.client.0.smithi138.stderr: -178> 2024-09-14T11:33:52.797+0000 7f02ef3bc9c0 1 librados: calling monclient init 2024-09-14T11:33:53.133 INFO:tasks.workunit.client.0.smithi138.stderr: -177> 2024-09-14T11:33:52.797+0000 7f02ef3bc9c0 10 monclient: init 2024-09-14T11:33:53.133 INFO:tasks.workunit.client.0.smithi138.stderr: -176> 2024-09-14T11:33:52.797+0000 7f02ef3bc9c0 5 AuthRegistry(0x55cd75d2dde0) adding auth protocol: cephx 2024-09-14T11:33:53.133 INFO:tasks.workunit.client.0.smithi138.stderr: -175> 2024-09-14T11:33:52.797+0000 7f02ef3bc9c0 5 AuthRegistry(0x55cd75d2dde0) adding auth protocol: cephx 2024-09-14T11:33:53.133 INFO:tasks.workunit.client.0.smithi138.stderr: -174> 2024-09-14T11:33:52.797+0000 7f02ef3bc9c0 5 AuthRegistry(0x55cd75d2dde0) adding auth protocol: cephx 2024-09-14T11:33:53.133 INFO:tasks.workunit.client.0.smithi138.stderr: -173> 2024-09-14T11:33:52.797+0000 7f02ef3bc9c0 5 AuthRegistry(0x55cd75d2dde0) adding con mode: secure 2024-09-14T11:33:53.133 INFO:tasks.workunit.client.0.smithi138.stderr: -172> 2024-09-14T11:33:52.797+0000 7f02ef3bc9c0 5 AuthRegistry(0x55cd75d2dde0) adding con mode: crc 2024-09-14T11:33:53.133 INFO:tasks.workunit.client.0.smithi138.stderr: -171> 2024-09-14T11:33:52.797+0000 7f02ef3bc9c0 5 AuthRegistry(0x55cd75d2dde0) adding con mode: secure 2024-09-14T11:33:53.133 INFO:tasks.workunit.client.0.smithi138.stderr: -170> 2024-09-14T11:33:52.797+0000 7f02ef3bc9c0 5 AuthRegistry(0x55cd75d2dde0) adding con mode: crc 2024-09-14T11:33:53.133 INFO:tasks.workunit.client.0.smithi138.stderr: -169> 2024-09-14T11:33:52.797+0000 7f02ef3bc9c0 5 AuthRegistry(0x55cd75d2dde0) adding con mode: secure 2024-09-14T11:33:53.133 INFO:tasks.workunit.client.0.smithi138.stderr: -168> 2024-09-14T11:33:52.797+0000 7f02ef3bc9c0 5 AuthRegistry(0x55cd75d2dde0) adding con mode: crc 2024-09-14T11:33:53.133 INFO:tasks.workunit.client.0.smithi138.stderr: -167> 2024-09-14T11:33:52.797+0000 7f02ef3bc9c0 5 AuthRegistry(0x55cd75d2dde0) adding con mode: crc 2024-09-14T11:33:53.133 INFO:tasks.workunit.client.0.smithi138.stderr: -166> 2024-09-14T11:33:52.797+0000 7f02ef3bc9c0 5 AuthRegistry(0x55cd75d2dde0) adding con mode: secure 2024-09-14T11:33:53.133 INFO:tasks.workunit.client.0.smithi138.stderr: -165> 2024-09-14T11:33:52.797+0000 7f02ef3bc9c0 5 AuthRegistry(0x55cd75d2dde0) adding con mode: crc 2024-09-14T11:33:53.133 INFO:tasks.workunit.client.0.smithi138.stderr: -164> 2024-09-14T11:33:52.797+0000 7f02ef3bc9c0 5 AuthRegistry(0x55cd75d2dde0) adding con mode: secure 2024-09-14T11:33:53.134 INFO:tasks.workunit.client.0.smithi138.stderr: -163> 2024-09-14T11:33:52.797+0000 7f02ef3bc9c0 5 AuthRegistry(0x55cd75d2dde0) adding con mode: crc 2024-09-14T11:33:53.134 INFO:tasks.workunit.client.0.smithi138.stderr: -162> 2024-09-14T11:33:52.797+0000 7f02ef3bc9c0 5 AuthRegistry(0x55cd75d2dde0) adding con mode: secure 2024-09-14T11:33:53.134 INFO:tasks.workunit.client.0.smithi138.stderr: -161> 2024-09-14T11:33:52.797+0000 7f02ef3bc9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:33:53.134 INFO:tasks.workunit.client.0.smithi138.stderr: -160> 2024-09-14T11:33:52.797+0000 7f02ef3bc9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:33:53.134 INFO:tasks.workunit.client.0.smithi138.stderr: -159> 2024-09-14T11:33:52.797+0000 7f02ef3bc9c0 5 asok(0x55cd75aa1d90) register_command rotate-key cmddesc rotate-key hook 0x55cd75d2df28 EEXIST 2024-09-14T11:33:53.134 INFO:tasks.workunit.client.0.smithi138.stderr: -158> 2024-09-14T11:33:52.797+0000 7f02ef3bc9c0 10 monclient: _reopen_session rank -1 2024-09-14T11:33:53.134 INFO:tasks.workunit.client.0.smithi138.stderr: -157> 2024-09-14T11:33:52.797+0000 7f02ef3bc9c0 10 monclient: _add_conns ranks=[1,2,0] 2024-09-14T11:33:53.134 INFO:tasks.workunit.client.0.smithi138.stderr: -156> 2024-09-14T11:33:52.797+0000 7f02ef3bc9c0 10 monclient(hunting): picked mon.noname-b con 0x55cd75d4f840 addr [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] 2024-09-14T11:33:53.134 INFO:tasks.workunit.client.0.smithi138.stderr: -155> 2024-09-14T11:33:52.797+0000 7f02ef3bc9c0 10 monclient(hunting): picked mon.noname-c con 0x55cd75d7b5f0 addr [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] 2024-09-14T11:33:53.134 INFO:tasks.workunit.client.0.smithi138.stderr: -154> 2024-09-14T11:33:52.797+0000 7f02ef3bc9c0 10 monclient(hunting): picked mon.noname-a con 0x55cd75d7fe20 addr [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] 2024-09-14T11:33:53.134 INFO:tasks.workunit.client.0.smithi138.stderr: -153> 2024-09-14T11:33:52.797+0000 7f02ef3bc9c0 10 monclient(hunting): start opening mon connection 2024-09-14T11:33:53.134 INFO:tasks.workunit.client.0.smithi138.stderr: -152> 2024-09-14T11:33:52.797+0000 7f02ef3bc9c0 10 monclient(hunting): start opening mon connection 2024-09-14T11:33:53.134 INFO:tasks.workunit.client.0.smithi138.stderr: -151> 2024-09-14T11:33:52.797+0000 7f02ef3bc9c0 10 monclient(hunting): start opening mon connection 2024-09-14T11:33:53.134 INFO:tasks.workunit.client.0.smithi138.stderr: -150> 2024-09-14T11:33:52.797+0000 7f02ef3bc9c0 10 monclient(hunting): _renew_subs 2024-09-14T11:33:53.134 INFO:tasks.workunit.client.0.smithi138.stderr: -149> 2024-09-14T11:33:52.797+0000 7f02ef3bc9c0 10 monclient(hunting): authenticate will time out at 2568.761097s 2024-09-14T11:33:53.135 INFO:tasks.workunit.client.0.smithi138.stderr: -148> 2024-09-14T11:33:52.797+0000 7f02ed6c3640 10 monclient(hunting): get_auth_request con 0x55cd75d7b5f0 auth_method 0 2024-09-14T11:33:53.135 INFO:tasks.workunit.client.0.smithi138.stderr: -147> 2024-09-14T11:33:52.797+0000 7f02ed6c3640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:33:53.135 INFO:tasks.workunit.client.0.smithi138.stderr: -146> 2024-09-14T11:33:52.797+0000 7f02ed6c3640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:33:53.135 INFO:tasks.workunit.client.0.smithi138.stderr: -145> 2024-09-14T11:33:52.797+0000 7f02ed6c3640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:33:53.135 INFO:tasks.workunit.client.0.smithi138.stderr: -144> 2024-09-14T11:33:52.797+0000 7f02ecec2640 10 monclient(hunting): get_auth_request con 0x55cd75d7fe20 auth_method 0 2024-09-14T11:33:53.135 INFO:tasks.workunit.client.0.smithi138.stderr: -143> 2024-09-14T11:33:52.797+0000 7f02ecec2640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:33:53.135 INFO:tasks.workunit.client.0.smithi138.stderr: -142> 2024-09-14T11:33:52.797+0000 7f02ecec2640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:33:53.135 INFO:tasks.workunit.client.0.smithi138.stderr: -141> 2024-09-14T11:33:52.797+0000 7f02ecec2640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:33:53.135 INFO:tasks.workunit.client.0.smithi138.stderr: -140> 2024-09-14T11:33:52.797+0000 7f02ed6c3640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:33:53.135 INFO:tasks.workunit.client.0.smithi138.stderr: -139> 2024-09-14T11:33:52.797+0000 7f02ed6c3640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:33:53.135 INFO:tasks.workunit.client.0.smithi138.stderr: -138> 2024-09-14T11:33:52.797+0000 7f02ed6c3640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:33:53.135 INFO:tasks.workunit.client.0.smithi138.stderr: -137> 2024-09-14T11:33:52.797+0000 7f02ecec2640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:33:53.135 INFO:tasks.workunit.client.0.smithi138.stderr: -136> 2024-09-14T11:33:52.797+0000 7f02ecec2640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:33:53.135 INFO:tasks.workunit.client.0.smithi138.stderr: -135> 2024-09-14T11:33:52.797+0000 7f02ecec2640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:33:53.135 INFO:tasks.workunit.client.0.smithi138.stderr: -134> 2024-09-14T11:33:52.797+0000 7f02ed6c3640 10 monclient(hunting): handle_auth_done global_id 5906 payload 824 2024-09-14T11:33:53.135 INFO:tasks.workunit.client.0.smithi138.stderr: -133> 2024-09-14T11:33:52.797+0000 7f02ed6c3640 10 monclient: _finish_hunting 0 2024-09-14T11:33:53.136 INFO:tasks.workunit.client.0.smithi138.stderr: -132> 2024-09-14T11:33:52.797+0000 7f02ed6c3640 1 monclient: found mon.noname-c 2024-09-14T11:33:53.136 INFO:tasks.workunit.client.0.smithi138.stderr: -131> 2024-09-14T11:33:52.797+0000 7f02ed6c3640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.138:3301/0 2024-09-14T11:33:53.136 INFO:tasks.workunit.client.0.smithi138.stderr: -130> 2024-09-14T11:33:52.797+0000 7f01c27fc640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:33:53.136 INFO:tasks.workunit.client.0.smithi138.stderr: -129> 2024-09-14T11:33:52.797+0000 7f01c27fc640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-14T11:33:53.136 INFO:tasks.workunit.client.0.smithi138.stderr: -128> 2024-09-14T11:33:52.797+0000 7f01c27fc640 10 monclient: dump: 2024-09-14T11:33:53.136 INFO:tasks.workunit.client.0.smithi138.stderr:epoch 1 2024-09-14T11:33:53.136 INFO:tasks.workunit.client.0.smithi138.stderr:fsid 3f225f43-83a6-4aeb-b798-1f04bb49d597 2024-09-14T11:33:53.136 INFO:tasks.workunit.client.0.smithi138.stderr:last_changed 2024-09-14T11:07:09.252780+0000 2024-09-14T11:33:53.136 INFO:tasks.workunit.client.0.smithi138.stderr:created 2024-09-14T11:07:09.252780+0000 2024-09-14T11:33:53.136 INFO:tasks.workunit.client.0.smithi138.stderr:min_mon_release 19 (squid) 2024-09-14T11:33:53.136 INFO:tasks.workunit.client.0.smithi138.stderr:election_strategy: 1 2024-09-14T11:33:53.136 INFO:tasks.workunit.client.0.smithi138.stderr:0: [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] mon.a 2024-09-14T11:33:53.136 INFO:tasks.workunit.client.0.smithi138.stderr:1: [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] mon.b 2024-09-14T11:33:53.136 INFO:tasks.workunit.client.0.smithi138.stderr:2: [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] mon.c 2024-09-14T11:33:53.136 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-14T11:33:53.137 INFO:tasks.workunit.client.0.smithi138.stderr: -127> 2024-09-14T11:33:52.797+0000 7f01c27fc640 10 monclient: _finish_auth 0 2024-09-14T11:33:53.137 INFO:tasks.workunit.client.0.smithi138.stderr: -126> 2024-09-14T11:33:52.797+0000 7f01c27fc640 10 monclient: _check_auth_tickets 2024-09-14T11:33:53.137 INFO:tasks.workunit.client.0.smithi138.stderr: -125> 2024-09-14T11:33:52.797+0000 7f02ef3bc9c0 5 monclient: authenticate success, global_id 5906 2024-09-14T11:33:53.137 INFO:tasks.workunit.client.0.smithi138.stderr: -124> 2024-09-14T11:33:52.797+0000 7f02ef3bc9c0 10 monclient: _renew_subs 2024-09-14T11:33:53.137 INFO:tasks.workunit.client.0.smithi138.stderr: -123> 2024-09-14T11:33:52.797+0000 7f02ef3bc9c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.138:3301/0 2024-09-14T11:33:53.137 INFO:tasks.workunit.client.0.smithi138.stderr: -122> 2024-09-14T11:33:52.797+0000 7f01c27fc640 10 monclient: handle_config config(0 keys) 2024-09-14T11:33:53.137 INFO:tasks.workunit.client.0.smithi138.stderr: -121> 2024-09-14T11:33:52.797+0000 7f01c27fc640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:33:53.137 INFO:tasks.workunit.client.0.smithi138.stderr: -120> 2024-09-14T11:33:52.797+0000 7f01c27fc640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-14T11:33:53.137 INFO:tasks.workunit.client.0.smithi138.stderr: -119> 2024-09-14T11:33:52.797+0000 7f01c27fc640 10 monclient: dump: 2024-09-14T11:33:53.137 INFO:tasks.workunit.client.0.smithi138.stderr:epoch 1 2024-09-14T11:33:53.137 INFO:tasks.workunit.client.0.smithi138.stderr:fsid 3f225f43-83a6-4aeb-b798-1f04bb49d597 2024-09-14T11:33:53.137 INFO:tasks.workunit.client.0.smithi138.stderr:last_changed 2024-09-14T11:07:09.252780+0000 2024-09-14T11:33:53.137 INFO:tasks.workunit.client.0.smithi138.stderr:created 2024-09-14T11:07:09.252780+0000 2024-09-14T11:33:53.138 INFO:tasks.workunit.client.0.smithi138.stderr:min_mon_release 19 (squid) 2024-09-14T11:33:53.138 INFO:tasks.workunit.client.0.smithi138.stderr:election_strategy: 1 2024-09-14T11:33:53.138 INFO:tasks.workunit.client.0.smithi138.stderr:0: [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] mon.a 2024-09-14T11:33:53.138 INFO:tasks.workunit.client.0.smithi138.stderr:1: [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] mon.b 2024-09-14T11:33:53.138 INFO:tasks.workunit.client.0.smithi138.stderr:2: [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] mon.c 2024-09-14T11:33:53.138 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-14T11:33:53.138 INFO:tasks.workunit.client.0.smithi138.stderr: -118> 2024-09-14T11:33:52.797+0000 7f01c3fff640 4 set_mon_vals no callback set 2024-09-14T11:33:53.138 INFO:tasks.workunit.client.0.smithi138.stderr: -117> 2024-09-14T11:33:52.797+0000 7f02ef3bc9c0 10 monclient: _renew_subs 2024-09-14T11:33:53.138 INFO:tasks.workunit.client.0.smithi138.stderr: -116> 2024-09-14T11:33:52.797+0000 7f02ef3bc9c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.138:3301/0 2024-09-14T11:33:53.138 INFO:tasks.workunit.client.0.smithi138.stderr: -115> 2024-09-14T11:33:52.797+0000 7f02ef3bc9c0 1 librados: init done 2024-09-14T11:33:53.138 INFO:tasks.workunit.client.0.smithi138.stderr: -114> 2024-09-14T11:33:52.797+0000 7f02ef3bc9c0 5 asok(0x55cd75aa1d90) register_command cr dump hook 0x55cd75d72d98 2024-09-14T11:33:53.138 INFO:tasks.workunit.client.0.smithi138.stderr: -113> 2024-09-14T11:33:52.797+0000 7f02ef3bc9c0 20 rados->read ofs=0 len=0 2024-09-14T11:33:53.139 INFO:tasks.workunit.client.0.smithi138.stderr: -112> 2024-09-14T11:33:52.801+0000 7f01c27fc640 4 mgrc handle_mgr_map Got map version 5 2024-09-14T11:33:53.139 INFO:tasks.workunit.client.0.smithi138.stderr: -111> 2024-09-14T11:33:52.801+0000 7f01c27fc640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.138:6832/3778043143,v1:172.21.15.138:6833/3778043143] 2024-09-14T11:33:53.139 INFO:tasks.workunit.client.0.smithi138.stderr: -110> 2024-09-14T11:33:52.801+0000 7f01c27fc640 4 mgrc reconnect Starting new session with [v2:172.21.15.138:6832/3778043143,v1:172.21.15.138:6833/3778043143] 2024-09-14T11:33:53.139 INFO:tasks.workunit.client.0.smithi138.stderr: -109> 2024-09-14T11:33:52.801+0000 7f02ec6c1640 10 monclient: get_auth_request con 0x7f01b80718d0 auth_method 0 2024-09-14T11:33:53.139 INFO:tasks.workunit.client.0.smithi138.stderr: -108> 2024-09-14T11:33:52.801+0000 7f02ecec2640 10 monclient: get_auth_request con 0x55cd75d9a140 auth_method 0 2024-09-14T11:33:53.139 INFO:tasks.workunit.client.0.smithi138.stderr: -107> 2024-09-14T11:33:52.801+0000 7f02ef3bc9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:33:53.139 INFO:tasks.workunit.client.0.smithi138.stderr: -106> 2024-09-14T11:33:52.801+0000 7f02ef3bc9c0 20 realm 2024-09-14T11:33:53.139 INFO:tasks.workunit.client.0.smithi138.stderr: -105> 2024-09-14T11:33:52.801+0000 7f02ef3bc9c0 20 rados->read ofs=0 len=0 2024-09-14T11:33:53.139 INFO:tasks.workunit.client.0.smithi138.stderr: -104> 2024-09-14T11:33:52.801+0000 7f02ef3bc9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:33:53.139 INFO:tasks.workunit.client.0.smithi138.stderr: -103> 2024-09-14T11:33:52.801+0000 7f02ef3bc9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:33:53.139 INFO:tasks.workunit.client.0.smithi138.stderr: -102> 2024-09-14T11:33:52.801+0000 7f02ef3bc9c0 20 rados->read ofs=0 len=0 2024-09-14T11:33:53.140 INFO:tasks.workunit.client.0.smithi138.stderr: -101> 2024-09-14T11:33:52.801+0000 7f02ef3bc9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:33:53.140 INFO:tasks.workunit.client.0.smithi138.stderr: -100> 2024-09-14T11:33:52.801+0000 7f02ef3bc9c0 20 rados->read ofs=0 len=0 2024-09-14T11:33:53.140 INFO:tasks.workunit.client.0.smithi138.stderr: -99> 2024-09-14T11:33:52.801+0000 7f02ec6c1640 10 monclient: get_auth_request con 0x55cd75d9e2a0 auth_method 0 2024-09-14T11:33:53.140 INFO:tasks.workunit.client.0.smithi138.stderr: -98> 2024-09-14T11:33:52.801+0000 7f02ef3bc9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:33:53.140 INFO:tasks.workunit.client.0.smithi138.stderr: -97> 2024-09-14T11:33:52.801+0000 7f02ef3bc9c0 20 rados->read ofs=0 len=0 2024-09-14T11:33:53.140 INFO:tasks.workunit.client.0.smithi138.stderr: -96> 2024-09-14T11:33:52.801+0000 7f02ed6c3640 10 monclient: get_auth_request con 0x55cd75da1b00 auth_method 0 2024-09-14T11:33:53.140 INFO:tasks.workunit.client.0.smithi138.stderr: -95> 2024-09-14T11:33:52.805+0000 7f02ef3bc9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:33:53.140 INFO:tasks.workunit.client.0.smithi138.stderr: -94> 2024-09-14T11:33:52.805+0000 7f02ef3bc9c0 20 searching for the correct realm 2024-09-14T11:33:53.140 INFO:tasks.workunit.client.0.smithi138.stderr: -93> 2024-09-14T11:33:52.805+0000 7f02ecec2640 10 monclient: get_auth_request con 0x55cd75da6880 auth_method 0 2024-09-14T11:33:53.140 INFO:tasks.workunit.client.0.smithi138.stderr: -92> 2024-09-14T11:33:52.805+0000 7f02ec6c1640 10 monclient: get_auth_request con 0x7f02dc027040 auth_method 0 2024-09-14T11:33:53.140 INFO:tasks.workunit.client.0.smithi138.stderr: -91> 2024-09-14T11:33:52.805+0000 7f02ed6c3640 10 monclient: get_auth_request con 0x7f02e4064cb0 auth_method 0 2024-09-14T11:33:53.140 INFO:tasks.workunit.client.0.smithi138.stderr: -90> 2024-09-14T11:33:52.809+0000 7f02ed6c3640 0 -- 172.21.15.138:0/2461216839 >> [v2:172.21.15.154:6824/416768175,v1:172.21.15.154:6825/416768175] conn(0x7f02e4064cb0 msgr2=0x7f02e4063720 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:33:53.140 INFO:tasks.workunit.client.0.smithi138.stderr: -89> 2024-09-14T11:33:52.809+0000 7f01c27fc640 1 client.5906.objecter ms_handle_reset 0x7f02e4064cb0 session 0x7f02e4016040 osd.4 2024-09-14T11:33:53.140 INFO:tasks.workunit.client.0.smithi138.stderr: -88> 2024-09-14T11:33:52.809+0000 7f01c27fc640 10 monclient: _renew_subs 2024-09-14T11:33:53.140 INFO:tasks.workunit.client.0.smithi138.stderr: -87> 2024-09-14T11:33:52.809+0000 7f01c27fc640 10 monclient: _send_mon_message to mon.c at v2:172.21.15.138:3301/0 2024-09-14T11:33:53.141 INFO:tasks.workunit.client.0.smithi138.stderr: -86> 2024-09-14T11:33:52.809+0000 7f02ed6c3640 10 monclient: get_auth_request con 0x7f01b8082000 auth_method 0 2024-09-14T11:33:53.141 INFO:tasks.workunit.client.0.smithi138.stderr: -85> 2024-09-14T11:33:52.809+0000 7f02ecec2640 10 monclient: get_auth_request con 0x7f02e406df50 auth_method 0 2024-09-14T11:33:53.141 INFO:tasks.workunit.client.0.smithi138.stderr: -84> 2024-09-14T11:33:52.813+0000 7f02ec6c1640 10 monclient: get_auth_request con 0x7f02e407a9d0 auth_method 0 2024-09-14T11:33:53.141 INFO:tasks.workunit.client.0.smithi138.stderr: -83> 2024-09-14T11:33:52.813+0000 7f02ec6c1640 0 -- 172.21.15.138:0/2461216839 >> [v2:172.21.15.138:6816/326481658,v1:172.21.15.138:6817/326481658] conn(0x7f02e407a9d0 msgr2=0x7f02e4087850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-14T11:33:53.141 INFO:tasks.workunit.client.0.smithi138.stderr: -82> 2024-09-14T11:33:53.017+0000 7f02ec6c1640 10 monclient: get_auth_request con 0x7f02e407a9d0 auth_method 0 2024-09-14T11:33:53.141 INFO:tasks.workunit.client.0.smithi138.stderr: -81> 2024-09-14T11:33:53.029+0000 7f02ef3bc9c0 20 RGWRados::pool_iterate: got zone_info.d9e72d30-c60b-4d0d-9267-fdc36392d5ad 2024-09-14T11:33:53.141 INFO:tasks.workunit.client.0.smithi138.stderr: -80> 2024-09-14T11:33:53.029+0000 7f02ef3bc9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:33:53.141 INFO:tasks.workunit.client.0.smithi138.stderr: -79> 2024-09-14T11:33:53.029+0000 7f02ef3bc9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:33:53.141 INFO:tasks.workunit.client.0.smithi138.stderr: -78> 2024-09-14T11:33:53.029+0000 7f02ef3bc9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:33:53.141 INFO:tasks.workunit.client.0.smithi138.stderr: -77> 2024-09-14T11:33:53.029+0000 7f02ef3bc9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:33:53.141 INFO:tasks.workunit.client.0.smithi138.stderr: -76> 2024-09-14T11:33:53.029+0000 7f02ef3bc9c0 20 RGWRados::pool_iterate: got zonegroup_info.65ab941b-da8c-4160-94fb-3672b069d44f 2024-09-14T11:33:53.141 INFO:tasks.workunit.client.0.smithi138.stderr: -75> 2024-09-14T11:33:53.029+0000 7f02ef3bc9c0 20 rados->read ofs=0 len=0 2024-09-14T11:33:53.141 INFO:tasks.workunit.client.0.smithi138.stderr: -74> 2024-09-14T11:33:53.029+0000 7f02ef3bc9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:33:53.141 INFO:tasks.workunit.client.0.smithi138.stderr: -73> 2024-09-14T11:33:53.029+0000 7f02ef3bc9c0 20 rados->read ofs=0 len=0 2024-09-14T11:33:53.142 INFO:tasks.workunit.client.0.smithi138.stderr: -72> 2024-09-14T11:33:53.029+0000 7f02ef3bc9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:33:53.142 INFO:tasks.workunit.client.0.smithi138.stderr: -71> 2024-09-14T11:33:53.029+0000 7f02ef3bc9c0 20 rados->read ofs=0 len=0 2024-09-14T11:33:53.142 INFO:tasks.workunit.client.0.smithi138.stderr: -70> 2024-09-14T11:33:53.029+0000 7f02ef3bc9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:33:53.142 INFO:tasks.workunit.client.0.smithi138.stderr: -69> 2024-09-14T11:33:53.029+0000 7f02ef3bc9c0 20 zone default found 2024-09-14T11:33:53.142 INFO:tasks.workunit.client.0.smithi138.stderr: -68> 2024-09-14T11:33:53.029+0000 7f02ef3bc9c0 4 Realm: () 2024-09-14T11:33:53.142 INFO:tasks.workunit.client.0.smithi138.stderr: -67> 2024-09-14T11:33:53.029+0000 7f02ef3bc9c0 4 ZoneGroup: default (65ab941b-da8c-4160-94fb-3672b069d44f) 2024-09-14T11:33:53.142 INFO:tasks.workunit.client.0.smithi138.stderr: -66> 2024-09-14T11:33:53.029+0000 7f02ef3bc9c0 4 Zone: default (d9e72d30-c60b-4d0d-9267-fdc36392d5ad) 2024-09-14T11:33:53.142 INFO:tasks.workunit.client.0.smithi138.stderr: -65> 2024-09-14T11:33:53.029+0000 7f02ef3bc9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:33:53.142 INFO:tasks.workunit.client.0.smithi138.stderr: -64> 2024-09-14T11:33:53.029+0000 7f02ef3bc9c0 20 zonegroup default 2024-09-14T11:33:53.142 INFO:tasks.workunit.client.0.smithi138.stderr: -63> 2024-09-14T11:33:53.029+0000 7f02ef3bc9c0 20 rados->read ofs=0 len=0 2024-09-14T11:33:53.142 INFO:tasks.workunit.client.0.smithi138.stderr: -62> 2024-09-14T11:33:53.033+0000 7f02ef3bc9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:33:53.143 INFO:tasks.workunit.client.0.smithi138.stderr: -61> 2024-09-14T11:33:53.033+0000 7f02ef3bc9c0 20 rados->read ofs=0 len=0 2024-09-14T11:33:53.143 INFO:tasks.workunit.client.0.smithi138.stderr: -60> 2024-09-14T11:33:53.033+0000 7f02ef3bc9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:33:53.143 INFO:tasks.workunit.client.0.smithi138.stderr: -59> 2024-09-14T11:33:53.033+0000 7f02ef3bc9c0 20 rados->read ofs=0 len=0 2024-09-14T11:33:53.143 INFO:tasks.workunit.client.0.smithi138.stderr: -58> 2024-09-14T11:33:53.033+0000 7f02ef3bc9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:33:53.143 INFO:tasks.workunit.client.0.smithi138.stderr: -57> 2024-09-14T11:33:53.033+0000 7f02ef3bc9c0 20 started sync module instance, tier type = 2024-09-14T11:33:53.143 INFO:tasks.workunit.client.0.smithi138.stderr: -56> 2024-09-14T11:33:53.033+0000 7f02ef3bc9c0 20 started zone id=d9e72d30-c60b-4d0d-9267-fdc36392d5ad (name=default) with tier type = 2024-09-14T11:33:53.143 INFO:tasks.workunit.client.0.smithi138.stderr: -55> 2024-09-14T11:33:53.057+0000 7f02ef3bc9c0 20 add_watcher() i=0 2024-09-14T11:33:53.143 INFO:tasks.workunit.client.0.smithi138.stderr: -54> 2024-09-14T11:33:53.057+0000 7f02ef3bc9c0 20 add_watcher() i=1 2024-09-14T11:33:53.143 INFO:tasks.workunit.client.0.smithi138.stderr: -53> 2024-09-14T11:33:53.057+0000 7f02ef3bc9c0 20 add_watcher() i=2 2024-09-14T11:33:53.143 INFO:tasks.workunit.client.0.smithi138.stderr: -52> 2024-09-14T11:33:53.057+0000 7f02ef3bc9c0 20 add_watcher() i=3 2024-09-14T11:33:53.143 INFO:tasks.workunit.client.0.smithi138.stderr: -51> 2024-09-14T11:33:53.057+0000 7f02ef3bc9c0 20 add_watcher() i=4 2024-09-14T11:33:53.143 INFO:tasks.workunit.client.0.smithi138.stderr: -50> 2024-09-14T11:33:53.057+0000 7f02ef3bc9c0 20 add_watcher() i=5 2024-09-14T11:33:53.143 INFO:tasks.workunit.client.0.smithi138.stderr: -49> 2024-09-14T11:33:53.057+0000 7f02ef3bc9c0 20 add_watcher() i=6 2024-09-14T11:33:53.143 INFO:tasks.workunit.client.0.smithi138.stderr: -48> 2024-09-14T11:33:53.061+0000 7f02ef3bc9c0 20 add_watcher() i=7 2024-09-14T11:33:53.143 INFO:tasks.workunit.client.0.smithi138.stderr: -47> 2024-09-14T11:33:53.061+0000 7f02ef3bc9c0 2 all 8 watchers are set, enabling cache 2024-09-14T11:33:53.144 INFO:tasks.workunit.client.0.smithi138.stderr: -46> 2024-09-14T11:33:53.065+0000 7f02ef3bc9c0 5 AuthRegistry(0x7ffd2b80a640) adding auth protocol: cephx 2024-09-14T11:33:53.144 INFO:tasks.workunit.client.0.smithi138.stderr: -45> 2024-09-14T11:33:53.065+0000 7f02ef3bc9c0 5 AuthRegistry(0x7ffd2b80a640) adding auth protocol: cephx 2024-09-14T11:33:53.144 INFO:tasks.workunit.client.0.smithi138.stderr: -44> 2024-09-14T11:33:53.065+0000 7f02ef3bc9c0 5 AuthRegistry(0x7ffd2b80a640) adding auth protocol: cephx 2024-09-14T11:33:53.144 INFO:tasks.workunit.client.0.smithi138.stderr: -43> 2024-09-14T11:33:53.065+0000 7f02ef3bc9c0 5 AuthRegistry(0x7ffd2b80a640) adding con mode: secure 2024-09-14T11:33:53.144 INFO:tasks.workunit.client.0.smithi138.stderr: -42> 2024-09-14T11:33:53.065+0000 7f02ef3bc9c0 5 AuthRegistry(0x7ffd2b80a640) adding con mode: crc 2024-09-14T11:33:53.144 INFO:tasks.workunit.client.0.smithi138.stderr: -41> 2024-09-14T11:33:53.065+0000 7f02ef3bc9c0 5 AuthRegistry(0x7ffd2b80a640) adding con mode: secure 2024-09-14T11:33:53.144 INFO:tasks.workunit.client.0.smithi138.stderr: -40> 2024-09-14T11:33:53.065+0000 7f02ef3bc9c0 5 AuthRegistry(0x7ffd2b80a640) adding con mode: crc 2024-09-14T11:33:53.144 INFO:tasks.workunit.client.0.smithi138.stderr: -39> 2024-09-14T11:33:53.065+0000 7f02ef3bc9c0 5 AuthRegistry(0x7ffd2b80a640) adding con mode: secure 2024-09-14T11:33:53.144 INFO:tasks.workunit.client.0.smithi138.stderr: -38> 2024-09-14T11:33:53.065+0000 7f02ef3bc9c0 5 AuthRegistry(0x7ffd2b80a640) adding con mode: crc 2024-09-14T11:33:53.144 INFO:tasks.workunit.client.0.smithi138.stderr: -37> 2024-09-14T11:33:53.065+0000 7f02ef3bc9c0 5 AuthRegistry(0x7ffd2b80a640) adding con mode: crc 2024-09-14T11:33:53.144 INFO:tasks.workunit.client.0.smithi138.stderr: -36> 2024-09-14T11:33:53.065+0000 7f02ef3bc9c0 5 AuthRegistry(0x7ffd2b80a640) adding con mode: secure 2024-09-14T11:33:53.144 INFO:tasks.workunit.client.0.smithi138.stderr: -35> 2024-09-14T11:33:53.065+0000 7f02ef3bc9c0 5 AuthRegistry(0x7ffd2b80a640) adding con mode: crc 2024-09-14T11:33:53.144 INFO:tasks.workunit.client.0.smithi138.stderr: -34> 2024-09-14T11:33:53.065+0000 7f02ef3bc9c0 5 AuthRegistry(0x7ffd2b80a640) adding con mode: secure 2024-09-14T11:33:53.144 INFO:tasks.workunit.client.0.smithi138.stderr: -33> 2024-09-14T11:33:53.065+0000 7f02ef3bc9c0 5 AuthRegistry(0x7ffd2b80a640) adding con mode: crc 2024-09-14T11:33:53.145 INFO:tasks.workunit.client.0.smithi138.stderr: -32> 2024-09-14T11:33:53.065+0000 7f02ef3bc9c0 5 AuthRegistry(0x7ffd2b80a640) adding con mode: secure 2024-09-14T11:33:53.145 INFO:tasks.workunit.client.0.smithi138.stderr: -31> 2024-09-14T11:33:53.065+0000 7f01a2fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:33:53.145 INFO:tasks.workunit.client.0.smithi138.stderr: -30> 2024-09-14T11:33:53.065+0000 7f02ef3bc9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:33:53.145 INFO:tasks.workunit.client.0.smithi138.stderr: -29> 2024-09-14T11:33:53.065+0000 7f02ef3bc9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:33:53.145 INFO:tasks.workunit.client.0.smithi138.stderr: -28> 2024-09-14T11:33:53.065+0000 7f02ef3bc9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:33:53.145 INFO:tasks.workunit.client.0.smithi138.stderr: -27> 2024-09-14T11:33:53.065+0000 7f02ef3bc9c0 5 asok(0x55cd75aa1d90) register_command cache list hook 0x55cd75d74670 2024-09-14T11:33:53.145 INFO:tasks.workunit.client.0.smithi138.stderr: -26> 2024-09-14T11:33:53.065+0000 7f02ef3bc9c0 5 asok(0x55cd75aa1d90) register_command cache inspect hook 0x55cd75d74670 2024-09-14T11:33:53.145 INFO:tasks.workunit.client.0.smithi138.stderr: -25> 2024-09-14T11:33:53.065+0000 7f02ef3bc9c0 5 asok(0x55cd75aa1d90) register_command cache erase hook 0x55cd75d74670 2024-09-14T11:33:53.145 INFO:tasks.workunit.client.0.smithi138.stderr: -24> 2024-09-14T11:33:53.065+0000 7f02ef3bc9c0 5 asok(0x55cd75aa1d90) register_command cache zap hook 0x55cd75d74670 2024-09-14T11:33:53.145 INFO:tasks.workunit.client.0.smithi138.stderr: -23> 2024-09-14T11:33:53.065+0000 7f02ef3bc9c0 5 note: GC not initialized 2024-09-14T11:33:53.145 INFO:tasks.workunit.client.0.smithi138.stderr: -22> 2024-09-14T11:33:53.065+0000 7f01a1fe3640 20 reqs_thread_entry: start 2024-09-14T11:33:53.146 INFO:tasks.workunit.client.0.smithi138.stderr: -21> 2024-09-14T11:33:53.065+0000 7f02ef3bc9c0 5 asok(0x55cd75aa1d90) register_command sync trace show hook 0x7f02dc02b030 2024-09-14T11:33:53.146 INFO:tasks.workunit.client.0.smithi138.stderr: -20> 2024-09-14T11:33:53.065+0000 7f02ef3bc9c0 5 asok(0x55cd75aa1d90) register_command sync trace history hook 0x7f02dc02b030 2024-09-14T11:33:53.146 INFO:tasks.workunit.client.0.smithi138.stderr: -19> 2024-09-14T11:33:53.065+0000 7f02ef3bc9c0 5 asok(0x55cd75aa1d90) register_command sync trace active hook 0x7f02dc02b030 2024-09-14T11:33:53.146 INFO:tasks.workunit.client.0.smithi138.stderr: -18> 2024-09-14T11:33:53.065+0000 7f02ef3bc9c0 5 asok(0x55cd75aa1d90) register_command sync trace active_short hook 0x7f02dc02b030 2024-09-14T11:33:53.146 INFO:tasks.workunit.client.0.smithi138.stderr: -17> 2024-09-14T11:33:53.065+0000 7f02ef3bc9c0 20 init_complete bucket index max shards: 11 2024-09-14T11:33:53.146 INFO:tasks.workunit.client.0.smithi138.stderr: -16> 2024-09-14T11:33:53.065+0000 7f02ef3bc9c0 20 Filter name: none 2024-09-14T11:33:53.146 INFO:tasks.workunit.client.0.smithi138.stderr: -15> 2024-09-14T11:33:53.065+0000 7f01137fe640 20 reqs_thread_entry: start 2024-09-14T11:33:53.146 INFO:tasks.workunit.client.0.smithi138.stderr: -14> 2024-09-14T11:33:53.065+0000 7f02ef3bc9c0 10 cache get: name=default.rgw.meta+root+abort-at-init-indext : miss 2024-09-14T11:33:53.146 INFO:tasks.workunit.client.0.smithi138.stderr: -13> 2024-09-14T11:33:53.065+0000 7f02ef3bc9c0 20 rados->read ofs=0 len=0 2024-09-14T11:33:53.146 INFO:tasks.workunit.client.0.smithi138.stderr: -12> 2024-09-14T11:33:53.069+0000 7f02ef3bc9c0 20 rados_obj.operate() r=0 bl.length=188 2024-09-14T11:33:53.146 INFO:tasks.workunit.client.0.smithi138.stderr: -11> 2024-09-14T11:33:53.069+0000 7f02ef3bc9c0 10 cache put: name=default.rgw.meta+root+abort-at-init-indext info.flags=0x11 2024-09-14T11:33:53.146 INFO:tasks.workunit.client.0.smithi138.stderr: -10> 2024-09-14T11:33:53.069+0000 7f02ef3bc9c0 10 adding default.rgw.meta+root+abort-at-init-indext to cache LRU end 2024-09-14T11:33:53.146 INFO:tasks.workunit.client.0.smithi138.stderr: -9> 2024-09-14T11:33:53.069+0000 7f02ef3bc9c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-init-indext:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.21 : miss 2024-09-14T11:33:53.146 INFO:tasks.workunit.client.0.smithi138.stderr: -8> 2024-09-14T11:33:53.069+0000 7f02ef3bc9c0 20 rados->read ofs=0 len=0 2024-09-14T11:33:53.146 INFO:tasks.workunit.client.0.smithi138.stderr: -7> 2024-09-14T11:33:53.069+0000 7f02ef3bc9c0 20 rados_obj.operate() r=0 bl.length=410 2024-09-14T11:33:53.146 INFO:tasks.workunit.client.0.smithi138.stderr: -6> 2024-09-14T11:33:53.069+0000 7f02ef3bc9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-init-indext:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.21 info.flags=0x17 2024-09-14T11:33:53.147 INFO:tasks.workunit.client.0.smithi138.stderr: -5> 2024-09-14T11:33:53.069+0000 7f02ef3bc9c0 10 adding default.rgw.meta+root+.bucket.meta.abort-at-init-indext:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.21 to cache LRU end 2024-09-14T11:33:53.147 INFO:tasks.workunit.client.0.smithi138.stderr: -4> 2024-09-14T11:33:53.069+0000 7f02ef3bc9c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:33:53.147 INFO:tasks.workunit.client.0.smithi138.stderr: -3> 2024-09-14T11:33:53.069+0000 7f02ef3bc9c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:33:53.147 INFO:tasks.workunit.client.0.smithi138.stderr: -2> 2024-09-14T11:33:53.069+0000 7f02ef3bc9c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-init-indext:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.21 2024-09-14T11:33:53.147 INFO:tasks.workunit.client.0.smithi138.stderr: -1> 2024-09-14T11:33:53.073+0000 7f02ef3bc9c0 -1 ./src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f02ef3bc9c0 time 2024-09-14T11:33:53.076609+0000 2024-09-14T11:33:53.147 INFO:tasks.workunit.client.0.smithi138.stderr:./src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-14T11:33:53.147 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-14T11:33:53.147 INFO:tasks.workunit.client.0.smithi138.stderr: ceph version 19.3.0-4907-ga2782315 (a2782315255a3e7d5f6cdc9eb35785187ff6ddf8) squid (dev) 2024-09-14T11:33:53.147 INFO:tasks.workunit.client.0.smithi138.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x121) [0x7f02f2c962eb] 2024-09-14T11:33:53.147 INFO:tasks.workunit.client.0.smithi138.stderr: 2: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7f02f2c9649f] 2024-09-14T11:33:53.147 INFO:tasks.workunit.client.0.smithi138.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55cd732f8c01] 2024-09-14T11:33:53.147 INFO:tasks.workunit.client.0.smithi138.stderr: 4: radosgw-admin(+0x14226e2) [0x55cd73d566e2] 2024-09-14T11:33:53.147 INFO:tasks.workunit.client.0.smithi138.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x55cd7330decd] 2024-09-14T11:33:53.147 INFO:tasks.workunit.client.0.smithi138.stderr: 6: main() 2024-09-14T11:33:53.148 INFO:tasks.workunit.client.0.smithi138.stderr: 7: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7f02f1afcd90] 2024-09-14T11:33:53.148 INFO:tasks.workunit.client.0.smithi138.stderr: 8: __libc_start_main() 2024-09-14T11:33:53.148 INFO:tasks.workunit.client.0.smithi138.stderr: 9: _start() 2024-09-14T11:33:53.148 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-14T11:33:53.148 INFO:tasks.workunit.client.0.smithi138.stderr: 0> 2024-09-14T11:33:53.077+0000 7f02ef3bc9c0 -1 *** Caught signal (Aborted) ** 2024-09-14T11:33:53.148 INFO:tasks.workunit.client.0.smithi138.stderr: in thread 7f02ef3bc9c0 thread_name:radosgw-admin 2024-09-14T11:33:53.148 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-14T11:33:53.148 INFO:tasks.workunit.client.0.smithi138.stderr: ceph version 19.3.0-4907-ga2782315 (a2782315255a3e7d5f6cdc9eb35785187ff6ddf8) squid (dev) 2024-09-14T11:33:53.148 INFO:tasks.workunit.client.0.smithi138.stderr: 1: /lib/x86_64-linux-gnu/libc.so.6(+0x42520) [0x7f02f1b15520] 2024-09-14T11:33:53.148 INFO:tasks.workunit.client.0.smithi138.stderr: 2: pthread_kill() 2024-09-14T11:33:53.148 INFO:tasks.workunit.client.0.smithi138.stderr: 3: raise() 2024-09-14T11:33:53.148 INFO:tasks.workunit.client.0.smithi138.stderr: 4: abort() 2024-09-14T11:33:53.149 INFO:tasks.workunit.client.0.smithi138.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x17b) [0x7f02f2c96345] 2024-09-14T11:33:53.149 INFO:tasks.workunit.client.0.smithi138.stderr: 6: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7f02f2c9649f] 2024-09-14T11:33:53.149 INFO:tasks.workunit.client.0.smithi138.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55cd732f8c01] 2024-09-14T11:33:53.149 INFO:tasks.workunit.client.0.smithi138.stderr: 8: radosgw-admin(+0x14226e2) [0x55cd73d566e2] 2024-09-14T11:33:53.149 INFO:tasks.workunit.client.0.smithi138.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x55cd7330decd] 2024-09-14T11:33:53.149 INFO:tasks.workunit.client.0.smithi138.stderr: 10: main() 2024-09-14T11:33:53.149 INFO:tasks.workunit.client.0.smithi138.stderr: 11: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7f02f1afcd90] 2024-09-14T11:33:53.149 INFO:tasks.workunit.client.0.smithi138.stderr: 12: __libc_start_main() 2024-09-14T11:33:53.149 INFO:tasks.workunit.client.0.smithi138.stderr: 13: _start() 2024-09-14T11:33:53.149 INFO:tasks.workunit.client.0.smithi138.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-14T11:33:53.149 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-14T11:33:53.149 INFO:tasks.workunit.client.0.smithi138.stderr:--- logging levels --- 2024-09-14T11:33:53.149 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 none 2024-09-14T11:33:53.150 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 1 lockdep 2024-09-14T11:33:53.150 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 1 context 2024-09-14T11:33:53.150 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 1 crush 2024-09-14T11:33:53.150 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 mds 2024-09-14T11:33:53.150 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 mds_balancer 2024-09-14T11:33:53.150 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 mds_locker 2024-09-14T11:33:53.150 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 mds_log 2024-09-14T11:33:53.150 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 mds_log_expire 2024-09-14T11:33:53.150 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 mds_migrator 2024-09-14T11:33:53.150 INFO:tasks.workunit.client.0.smithi138.stderr: 3/ 5 mds_quiesce 2024-09-14T11:33:53.150 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 1 buffer 2024-09-14T11:33:53.150 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 1 timer 2024-09-14T11:33:53.150 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 1 filer 2024-09-14T11:33:53.150 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 1 striper 2024-09-14T11:33:53.150 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 1 objecter 2024-09-14T11:33:53.150 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 rados 2024-09-14T11:33:53.151 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 rbd 2024-09-14T11:33:53.151 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 rbd_mirror 2024-09-14T11:33:53.151 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 rbd_replay 2024-09-14T11:33:53.151 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 rbd_pwl 2024-09-14T11:33:53.151 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 journaler 2024-09-14T11:33:53.151 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 objectcacher 2024-09-14T11:33:53.151 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 immutable_obj_cache 2024-09-14T11:33:53.151 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 client 2024-09-14T11:33:53.151 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 osd 2024-09-14T11:33:53.151 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 optracker 2024-09-14T11:33:53.151 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 objclass 2024-09-14T11:33:53.151 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 3 filestore 2024-09-14T11:33:53.151 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 3 journal 2024-09-14T11:33:53.151 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 0 ms 2024-09-14T11:33:53.151 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 mon 2024-09-14T11:33:53.152 INFO:tasks.workunit.client.0.smithi138.stderr: 0/10 monc 2024-09-14T11:33:53.152 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 paxos 2024-09-14T11:33:53.152 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 tp 2024-09-14T11:33:53.152 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 auth 2024-09-14T11:33:53.152 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 crypto 2024-09-14T11:33:53.152 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 1 finisher 2024-09-14T11:33:53.152 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 1 reserver 2024-09-14T11:33:53.152 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 heartbeatmap 2024-09-14T11:33:53.152 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 perfcounter 2024-09-14T11:33:53.152 INFO:tasks.workunit.client.0.smithi138.stderr: 20/20 rgw 2024-09-14T11:33:53.152 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 rgw_sync 2024-09-14T11:33:53.152 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 rgw_datacache 2024-09-14T11:33:53.152 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 rgw_access 2024-09-14T11:33:53.152 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 rgw_dbstore 2024-09-14T11:33:53.153 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 rgw_flight 2024-09-14T11:33:53.153 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 rgw_lifecycle 2024-09-14T11:33:53.153 INFO:tasks.workunit.client.0.smithi138.stderr: 20/20 rgw_notification 2024-09-14T11:33:53.153 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 javaclient 2024-09-14T11:33:53.153 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 asok 2024-09-14T11:33:53.153 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 1 throttle 2024-09-14T11:33:53.153 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 0 refs 2024-09-14T11:33:53.153 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 compressor 2024-09-14T11:33:53.153 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 bluestore 2024-09-14T11:33:53.153 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 bluefs 2024-09-14T11:33:53.153 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 3 bdev 2024-09-14T11:33:53.153 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 kstore 2024-09-14T11:33:53.153 INFO:tasks.workunit.client.0.smithi138.stderr: 4/ 5 rocksdb 2024-09-14T11:33:53.153 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 fuse 2024-09-14T11:33:53.154 INFO:tasks.workunit.client.0.smithi138.stderr: 2/ 5 mgr 2024-09-14T11:33:53.154 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 mgrc 2024-09-14T11:33:53.154 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 dpdk 2024-09-14T11:33:53.154 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 eventtrace 2024-09-14T11:33:53.154 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 prioritycache 2024-09-14T11:33:53.154 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 test 2024-09-14T11:33:53.154 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 cephfs_mirror 2024-09-14T11:33:53.154 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 cephsqlite 2024-09-14T11:33:53.154 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 crimson_interrupt 2024-09-14T11:33:53.154 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 seastore 2024-09-14T11:33:53.154 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 seastore_onode 2024-09-14T11:33:53.154 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 seastore_odata 2024-09-14T11:33:53.154 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 seastore_omap 2024-09-14T11:33:53.154 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 seastore_tm 2024-09-14T11:33:53.154 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 seastore_t 2024-09-14T11:33:53.154 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 seastore_cleaner 2024-09-14T11:33:53.155 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 seastore_epm 2024-09-14T11:33:53.155 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 seastore_lba 2024-09-14T11:33:53.155 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 seastore_fixedkv_tree 2024-09-14T11:33:53.155 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 seastore_cache 2024-09-14T11:33:53.155 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 seastore_journal 2024-09-14T11:33:53.155 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 seastore_device 2024-09-14T11:33:53.155 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 seastore_backref 2024-09-14T11:33:53.155 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 alienstore 2024-09-14T11:33:53.155 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 mclock 2024-09-14T11:33:53.155 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 cyanstore 2024-09-14T11:33:53.155 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 ceph_exporter 2024-09-14T11:33:53.155 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 memstore 2024-09-14T11:33:53.155 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 trace 2024-09-14T11:33:53.155 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 ceph_dedup 2024-09-14T11:33:53.155 INFO:tasks.workunit.client.0.smithi138.stderr: -2/-2 (syslog threshold) 2024-09-14T11:33:53.156 INFO:tasks.workunit.client.0.smithi138.stderr: 99/99 (stderr threshold) 2024-09-14T11:33:53.156 INFO:tasks.workunit.client.0.smithi138.stderr:--- pthread ID / name mapping for recent threads --- 2024-09-14T11:33:53.156 INFO:tasks.workunit.client.0.smithi138.stderr: 7f01137fe640 / http_manager 2024-09-14T11:33:53.156 INFO:tasks.workunit.client.0.smithi138.stderr: 7f01a1fe3640 / http_manager 2024-09-14T11:33:53.156 INFO:tasks.workunit.client.0.smithi138.stderr: 7f01a2fe5640 / rgw_dt_lg_renew 2024-09-14T11:33:53.156 INFO:tasks.workunit.client.0.smithi138.stderr: 7f01c27fc640 / ms_dispatch 2024-09-14T11:33:53.156 INFO:tasks.workunit.client.0.smithi138.stderr: 7f01c3fff640 / io_context_pool 2024-09-14T11:33:53.156 INFO:tasks.workunit.client.0.smithi138.stderr: 7f01d27fc640 / ms_dispatch 2024-09-14T11:33:53.156 INFO:tasks.workunit.client.0.smithi138.stderr: 7f01d960a640 / ms_dispatch 2024-09-14T11:33:53.156 INFO:tasks.workunit.client.0.smithi138.stderr: 7f01dae0d640 / io_context_pool 2024-09-14T11:33:53.156 INFO:tasks.workunit.client.0.smithi138.stderr: 7f02ec6c1640 / msgr-worker-2 2024-09-14T11:33:53.157 INFO:tasks.workunit.client.0.smithi138.stderr: 7f02ecec2640 / msgr-worker-1 2024-09-14T11:33:53.157 INFO:tasks.workunit.client.0.smithi138.stderr: 7f02ed6c3640 / msgr-worker-0 2024-09-14T11:33:53.157 INFO:tasks.workunit.client.0.smithi138.stderr: 7f02edec4640 / io_context_pool 2024-09-14T11:33:53.157 INFO:tasks.workunit.client.0.smithi138.stderr: 7f02ef3bc9c0 / radosgw-admin 2024-09-14T11:33:53.157 INFO:tasks.workunit.client.0.smithi138.stderr: max_recent 500 2024-09-14T11:33:53.157 INFO:tasks.workunit.client.0.smithi138.stderr: max_new 1000 2024-09-14T11:33:53.157 INFO:tasks.workunit.client.0.smithi138.stderr: log_file /var/log/ceph/ceph-client.admin.81968.log 2024-09-14T11:33:53.157 INFO:tasks.workunit.client.0.smithi138.stderr:--- end dump of recent events --- 2024-09-14T11:33:53.157 INFO:tasks.workunit.client.0.smithi138.stderr:--- begin dump of recent events --- 2024-09-14T11:33:53.157 INFO:tasks.workunit.client.0.smithi138.stderr: -499> 2024-09-14T11:33:52.777+0000 7f02ef3bc9c0 10 monclient(hunting): authenticate will time out at 2568.740010s 2024-09-14T11:33:53.157 INFO:tasks.workunit.client.0.smithi138.stderr: -498> 2024-09-14T11:33:52.777+0000 7f02ec6c1640 10 monclient(hunting): get_auth_request con 0x55cd75bf2120 auth_method 0 2024-09-14T11:33:53.157 INFO:tasks.workunit.client.0.smithi138.stderr: -497> 2024-09-14T11:33:52.777+0000 7f02ec6c1640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:33:53.157 INFO:tasks.workunit.client.0.smithi138.stderr: -496> 2024-09-14T11:33:52.777+0000 7f02ec6c1640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:33:53.157 INFO:tasks.workunit.client.0.smithi138.stderr: -495> 2024-09-14T11:33:52.777+0000 7f02ec6c1640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:33:53.158 INFO:tasks.workunit.client.0.smithi138.stderr: -494> 2024-09-14T11:33:52.777+0000 7f02ecec2640 10 monclient(hunting): get_auth_request con 0x55cd75b3a740 auth_method 0 2024-09-14T11:33:53.158 INFO:tasks.workunit.client.0.smithi138.stderr: -493> 2024-09-14T11:33:52.777+0000 7f02ecec2640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:33:53.158 INFO:tasks.workunit.client.0.smithi138.stderr: -492> 2024-09-14T11:33:52.777+0000 7f02ecec2640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:33:53.158 INFO:tasks.workunit.client.0.smithi138.stderr: -491> 2024-09-14T11:33:52.777+0000 7f02ecec2640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:33:53.158 INFO:tasks.workunit.client.0.smithi138.stderr: -490> 2024-09-14T11:33:52.777+0000 7f02ecec2640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:33:53.158 INFO:tasks.workunit.client.0.smithi138.stderr: -489> 2024-09-14T11:33:52.777+0000 7f02ecec2640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:33:53.158 INFO:tasks.workunit.client.0.smithi138.stderr: -488> 2024-09-14T11:33:52.777+0000 7f02ecec2640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:33:53.158 INFO:tasks.workunit.client.0.smithi138.stderr: -487> 2024-09-14T11:33:52.777+0000 7f02ec6c1640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:33:53.158 INFO:tasks.workunit.client.0.smithi138.stderr: -486> 2024-09-14T11:33:52.777+0000 7f02ec6c1640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:33:53.158 INFO:tasks.workunit.client.0.smithi138.stderr: -485> 2024-09-14T11:33:52.777+0000 7f02ec6c1640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:33:53.158 INFO:tasks.workunit.client.0.smithi138.stderr: -484> 2024-09-14T11:33:52.777+0000 7f02ecec2640 10 monclient(hunting): handle_auth_done global_id 5894 payload 274 2024-09-14T11:33:53.158 INFO:tasks.workunit.client.0.smithi138.stderr: -483> 2024-09-14T11:33:52.777+0000 7f02ecec2640 10 monclient: _finish_hunting 0 2024-09-14T11:33:53.158 INFO:tasks.workunit.client.0.smithi138.stderr: -482> 2024-09-14T11:33:52.777+0000 7f02ecec2640 1 monclient: found mon.noname-c 2024-09-14T11:33:53.158 INFO:tasks.workunit.client.0.smithi138.stderr: -481> 2024-09-14T11:33:52.777+0000 7f02ecec2640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.138:3301/0 2024-09-14T11:33:53.158 INFO:tasks.workunit.client.0.smithi138.stderr: -480> 2024-09-14T11:33:52.777+0000 7f01dae0d640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:33:53.159 INFO:tasks.workunit.client.0.smithi138.stderr: -479> 2024-09-14T11:33:52.777+0000 7f01dae0d640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-14T11:33:53.159 INFO:tasks.workunit.client.0.smithi138.stderr: -478> 2024-09-14T11:33:52.777+0000 7f01dae0d640 10 monclient: dump: 2024-09-14T11:33:53.159 INFO:tasks.workunit.client.0.smithi138.stderr:epoch 1 2024-09-14T11:33:53.159 INFO:tasks.workunit.client.0.smithi138.stderr:fsid 3f225f43-83a6-4aeb-b798-1f04bb49d597 2024-09-14T11:33:53.159 INFO:tasks.workunit.client.0.smithi138.stderr:last_changed 2024-09-14T11:07:09.252780+0000 2024-09-14T11:33:53.159 INFO:tasks.workunit.client.0.smithi138.stderr:created 2024-09-14T11:07:09.252780+0000 2024-09-14T11:33:53.159 INFO:tasks.workunit.client.0.smithi138.stderr:min_mon_release 19 (squid) 2024-09-14T11:33:53.159 INFO:tasks.workunit.client.0.smithi138.stderr:election_strategy: 1 2024-09-14T11:33:53.159 INFO:tasks.workunit.client.0.smithi138.stderr:0: [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] mon.a 2024-09-14T11:33:53.159 INFO:tasks.workunit.client.0.smithi138.stderr:1: [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] mon.b 2024-09-14T11:33:53.159 INFO:tasks.workunit.client.0.smithi138.stderr:2: [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] mon.c 2024-09-14T11:33:53.159 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-14T11:33:53.159 INFO:tasks.workunit.client.0.smithi138.stderr: -477> 2024-09-14T11:33:52.777+0000 7f01dae0d640 10 monclient: _finish_auth 0 2024-09-14T11:33:53.160 INFO:tasks.workunit.client.0.smithi138.stderr: -476> 2024-09-14T11:33:52.777+0000 7f01dae0d640 10 monclient: _check_auth_tickets 2024-09-14T11:33:53.160 INFO:tasks.workunit.client.0.smithi138.stderr: -475> 2024-09-14T11:33:52.777+0000 7f01dae0d640 10 monclient: handle_config config(0 keys) 2024-09-14T11:33:53.160 INFO:tasks.workunit.client.0.smithi138.stderr: -474> 2024-09-14T11:33:52.777+0000 7f01dae0d640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:33:53.160 INFO:tasks.workunit.client.0.smithi138.stderr: -473> 2024-09-14T11:33:52.777+0000 7f01dae0d640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-14T11:33:53.160 INFO:tasks.workunit.client.0.smithi138.stderr: -472> 2024-09-14T11:33:52.777+0000 7f01dae0d640 10 monclient: dump: 2024-09-14T11:33:53.160 INFO:tasks.workunit.client.0.smithi138.stderr:epoch 1 2024-09-14T11:33:53.160 INFO:tasks.workunit.client.0.smithi138.stderr:fsid 3f225f43-83a6-4aeb-b798-1f04bb49d597 2024-09-14T11:33:53.160 INFO:tasks.workunit.client.0.smithi138.stderr:last_changed 2024-09-14T11:07:09.252780+0000 2024-09-14T11:33:53.160 INFO:tasks.workunit.client.0.smithi138.stderr:created 2024-09-14T11:07:09.252780+0000 2024-09-14T11:33:53.160 INFO:tasks.workunit.client.0.smithi138.stderr:min_mon_release 19 (squid) 2024-09-14T11:33:53.160 INFO:tasks.workunit.client.0.smithi138.stderr:election_strategy: 1 2024-09-14T11:33:53.160 INFO:tasks.workunit.client.0.smithi138.stderr:0: [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] mon.a 2024-09-14T11:33:53.160 INFO:tasks.workunit.client.0.smithi138.stderr:1: [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] mon.b 2024-09-14T11:33:53.160 INFO:tasks.workunit.client.0.smithi138.stderr:2: [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] mon.c 2024-09-14T11:33:53.160 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-14T11:33:53.161 INFO:tasks.workunit.client.0.smithi138.stderr: -471> 2024-09-14T11:33:52.777+0000 7f02ef3bc9c0 5 monclient: authenticate success, global_id 5894 2024-09-14T11:33:53.161 INFO:tasks.workunit.client.0.smithi138.stderr: -470> 2024-09-14T11:33:52.777+0000 7f02ef3bc9c0 10 monclient: get_monmap_and_config success 2024-09-14T11:33:53.161 INFO:tasks.workunit.client.0.smithi138.stderr: -469> 2024-09-14T11:33:52.777+0000 7f02ef3bc9c0 4 set_mon_vals no callback set 2024-09-14T11:33:53.161 INFO:tasks.workunit.client.0.smithi138.stderr: -468> 2024-09-14T11:33:52.777+0000 7f02ef3bc9c0 10 monclient: shutdown 2024-09-14T11:33:53.161 INFO:tasks.workunit.client.0.smithi138.stderr: -467> 2024-09-14T11:33:52.777+0000 7f02ef3bc9c0 5 asok(0x55cd75aa1d90) unregister_commands rotate-key 2024-09-14T11:33:53.161 INFO:tasks.workunit.client.0.smithi138.stderr: -466> 2024-09-14T11:33:52.777+0000 7f02ef3bc9c0 10 monclient: build_initial_monmap 2024-09-14T11:33:53.161 INFO:tasks.workunit.client.0.smithi138.stderr: -465> 2024-09-14T11:33:52.777+0000 7f02ef3bc9c0 1 build_initial for_mkfs: 0 2024-09-14T11:33:53.161 INFO:tasks.workunit.client.0.smithi138.stderr: -464> 2024-09-14T11:33:52.777+0000 7f02ef3bc9c0 10 monclient: monmap: 2024-09-14T11:33:53.161 INFO:tasks.workunit.client.0.smithi138.stderr:epoch 0 2024-09-14T11:33:53.161 INFO:tasks.workunit.client.0.smithi138.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-14T11:33:53.161 INFO:tasks.workunit.client.0.smithi138.stderr:last_changed 0.000000 2024-09-14T11:33:53.161 INFO:tasks.workunit.client.0.smithi138.stderr:created 0.000000 2024-09-14T11:33:53.161 INFO:tasks.workunit.client.0.smithi138.stderr:min_mon_release 0 (unknown) 2024-09-14T11:33:53.161 INFO:tasks.workunit.client.0.smithi138.stderr:election_strategy: 1 2024-09-14T11:33:53.162 INFO:tasks.workunit.client.0.smithi138.stderr:0: [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] mon.noname-a 2024-09-14T11:33:53.162 INFO:tasks.workunit.client.0.smithi138.stderr:1: [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] mon.noname-b 2024-09-14T11:33:53.162 INFO:tasks.workunit.client.0.smithi138.stderr:2: [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] mon.noname-c 2024-09-14T11:33:53.162 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-14T11:33:53.162 INFO:tasks.workunit.client.0.smithi138.stderr: -463> 2024-09-14T11:33:52.777+0000 7f02ef3bc9c0 5 AuthRegistry(0x55cd75cdbeb0) adding auth protocol: cephx 2024-09-14T11:33:53.162 INFO:tasks.workunit.client.0.smithi138.stderr: -462> 2024-09-14T11:33:52.777+0000 7f02ef3bc9c0 5 AuthRegistry(0x55cd75cdbeb0) adding auth protocol: cephx 2024-09-14T11:33:53.162 INFO:tasks.workunit.client.0.smithi138.stderr: -461> 2024-09-14T11:33:52.777+0000 7f02ef3bc9c0 5 AuthRegistry(0x55cd75cdbeb0) adding auth protocol: cephx 2024-09-14T11:33:53.162 INFO:tasks.workunit.client.0.smithi138.stderr: -460> 2024-09-14T11:33:52.777+0000 7f02ef3bc9c0 5 AuthRegistry(0x55cd75cdbeb0) adding con mode: secure 2024-09-14T11:33:53.162 INFO:tasks.workunit.client.0.smithi138.stderr: -459> 2024-09-14T11:33:52.777+0000 7f02ef3bc9c0 5 AuthRegistry(0x55cd75cdbeb0) adding con mode: crc 2024-09-14T11:33:53.162 INFO:tasks.workunit.client.0.smithi138.stderr: -458> 2024-09-14T11:33:52.777+0000 7f02ef3bc9c0 5 AuthRegistry(0x55cd75cdbeb0) adding con mode: secure 2024-09-14T11:33:53.162 INFO:tasks.workunit.client.0.smithi138.stderr: -457> 2024-09-14T11:33:52.777+0000 7f02ef3bc9c0 5 AuthRegistry(0x55cd75cdbeb0) adding con mode: crc 2024-09-14T11:33:53.162 INFO:tasks.workunit.client.0.smithi138.stderr: -456> 2024-09-14T11:33:52.777+0000 7f02ef3bc9c0 5 AuthRegistry(0x55cd75cdbeb0) adding con mode: secure 2024-09-14T11:33:53.162 INFO:tasks.workunit.client.0.smithi138.stderr: -455> 2024-09-14T11:33:52.777+0000 7f02ef3bc9c0 5 AuthRegistry(0x55cd75cdbeb0) adding con mode: crc 2024-09-14T11:33:53.162 INFO:tasks.workunit.client.0.smithi138.stderr: -454> 2024-09-14T11:33:52.777+0000 7f02ef3bc9c0 5 AuthRegistry(0x55cd75cdbeb0) adding con mode: crc 2024-09-14T11:33:53.163 INFO:tasks.workunit.client.0.smithi138.stderr: -453> 2024-09-14T11:33:52.777+0000 7f02ef3bc9c0 5 AuthRegistry(0x55cd75cdbeb0) adding con mode: secure 2024-09-14T11:33:53.163 INFO:tasks.workunit.client.0.smithi138.stderr: -452> 2024-09-14T11:33:52.777+0000 7f02ef3bc9c0 5 AuthRegistry(0x55cd75cdbeb0) adding con mode: crc 2024-09-14T11:33:53.163 INFO:tasks.workunit.client.0.smithi138.stderr: -451> 2024-09-14T11:33:52.777+0000 7f02ef3bc9c0 5 AuthRegistry(0x55cd75cdbeb0) adding con mode: secure 2024-09-14T11:33:53.163 INFO:tasks.workunit.client.0.smithi138.stderr: -450> 2024-09-14T11:33:52.777+0000 7f02ef3bc9c0 5 AuthRegistry(0x55cd75cdbeb0) adding con mode: crc 2024-09-14T11:33:53.163 INFO:tasks.workunit.client.0.smithi138.stderr: -449> 2024-09-14T11:33:52.777+0000 7f02ef3bc9c0 5 AuthRegistry(0x55cd75cdbeb0) adding con mode: secure 2024-09-14T11:33:53.163 INFO:tasks.workunit.client.0.smithi138.stderr: -448> 2024-09-14T11:33:52.777+0000 7f02ef3bc9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:33:53.163 INFO:tasks.workunit.client.0.smithi138.stderr: -447> 2024-09-14T11:33:52.777+0000 7f02ef3bc9c0 1 librados: starting msgr at 2024-09-14T11:33:53.163 INFO:tasks.workunit.client.0.smithi138.stderr: -446> 2024-09-14T11:33:52.777+0000 7f02ef3bc9c0 1 librados: starting objecter 2024-09-14T11:33:53.163 INFO:tasks.workunit.client.0.smithi138.stderr: -445> 2024-09-14T11:33:52.777+0000 7f02ef3bc9c0 5 asok(0x55cd75aa1d90) register_command objecter_requests hook 0x55cd75ce7220 2024-09-14T11:33:53.163 INFO:tasks.workunit.client.0.smithi138.stderr: -444> 2024-09-14T11:33:52.777+0000 7f02ef3bc9c0 1 librados: setting wanted keys 2024-09-14T11:33:53.163 INFO:tasks.workunit.client.0.smithi138.stderr: -443> 2024-09-14T11:33:52.777+0000 7f02ef3bc9c0 1 librados: calling monclient init 2024-09-14T11:33:53.163 INFO:tasks.workunit.client.0.smithi138.stderr: -442> 2024-09-14T11:33:52.777+0000 7f02ef3bc9c0 10 monclient: init 2024-09-14T11:33:53.163 INFO:tasks.workunit.client.0.smithi138.stderr: -441> 2024-09-14T11:33:52.777+0000 7f02ef3bc9c0 5 AuthRegistry(0x55cd75cace80) adding auth protocol: cephx 2024-09-14T11:33:53.163 INFO:tasks.workunit.client.0.smithi138.stderr: -440> 2024-09-14T11:33:52.777+0000 7f02ef3bc9c0 5 AuthRegistry(0x55cd75cace80) adding auth protocol: cephx 2024-09-14T11:33:53.164 INFO:tasks.workunit.client.0.smithi138.stderr: -439> 2024-09-14T11:33:52.777+0000 7f02ef3bc9c0 5 AuthRegistry(0x55cd75cace80) adding auth protocol: cephx 2024-09-14T11:33:53.164 INFO:tasks.workunit.client.0.smithi138.stderr: -438> 2024-09-14T11:33:52.777+0000 7f02ef3bc9c0 5 AuthRegistry(0x55cd75cace80) adding con mode: secure 2024-09-14T11:33:53.164 INFO:tasks.workunit.client.0.smithi138.stderr: -437> 2024-09-14T11:33:52.777+0000 7f02ef3bc9c0 5 AuthRegistry(0x55cd75cace80) adding con mode: crc 2024-09-14T11:33:53.164 INFO:tasks.workunit.client.0.smithi138.stderr: -436> 2024-09-14T11:33:52.777+0000 7f02ef3bc9c0 5 AuthRegistry(0x55cd75cace80) adding con mode: secure 2024-09-14T11:33:53.164 INFO:tasks.workunit.client.0.smithi138.stderr: -435> 2024-09-14T11:33:52.777+0000 7f02ef3bc9c0 5 AuthRegistry(0x55cd75cace80) adding con mode: crc 2024-09-14T11:33:53.164 INFO:tasks.workunit.client.0.smithi138.stderr: -434> 2024-09-14T11:33:52.777+0000 7f02ef3bc9c0 5 AuthRegistry(0x55cd75cace80) adding con mode: secure 2024-09-14T11:33:53.164 INFO:tasks.workunit.client.0.smithi138.stderr: -433> 2024-09-14T11:33:52.777+0000 7f02ef3bc9c0 5 AuthRegistry(0x55cd75cace80) adding con mode: crc 2024-09-14T11:33:53.164 INFO:tasks.workunit.client.0.smithi138.stderr: -432> 2024-09-14T11:33:52.777+0000 7f02ef3bc9c0 5 AuthRegistry(0x55cd75cace80) adding con mode: crc 2024-09-14T11:33:53.164 INFO:tasks.workunit.client.0.smithi138.stderr: -431> 2024-09-14T11:33:52.777+0000 7f02ef3bc9c0 5 AuthRegistry(0x55cd75cace80) adding con mode: secure 2024-09-14T11:33:53.164 INFO:tasks.workunit.client.0.smithi138.stderr: -430> 2024-09-14T11:33:52.777+0000 7f02ef3bc9c0 5 AuthRegistry(0x55cd75cace80) adding con mode: crc 2024-09-14T11:33:53.164 INFO:tasks.workunit.client.0.smithi138.stderr: -429> 2024-09-14T11:33:52.777+0000 7f02ef3bc9c0 5 AuthRegistry(0x55cd75cace80) adding con mode: secure 2024-09-14T11:33:53.164 INFO:tasks.workunit.client.0.smithi138.stderr: -428> 2024-09-14T11:33:52.777+0000 7f02ef3bc9c0 5 AuthRegistry(0x55cd75cace80) adding con mode: crc 2024-09-14T11:33:53.165 INFO:tasks.workunit.client.0.smithi138.stderr: -427> 2024-09-14T11:33:52.777+0000 7f02ef3bc9c0 5 AuthRegistry(0x55cd75cace80) adding con mode: secure 2024-09-14T11:33:53.165 INFO:tasks.workunit.client.0.smithi138.stderr: -426> 2024-09-14T11:33:52.777+0000 7f02ef3bc9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:33:53.165 INFO:tasks.workunit.client.0.smithi138.stderr: -425> 2024-09-14T11:33:52.777+0000 7f02ef3bc9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:33:53.165 INFO:tasks.workunit.client.0.smithi138.stderr: -424> 2024-09-14T11:33:52.777+0000 7f02ef3bc9c0 5 asok(0x55cd75aa1d90) register_command rotate-key hook 0x55cd75cacfc8 2024-09-14T11:33:53.165 INFO:tasks.workunit.client.0.smithi138.stderr: -423> 2024-09-14T11:33:52.777+0000 7f02ef3bc9c0 10 monclient: _reopen_session rank -1 2024-09-14T11:33:53.165 INFO:tasks.workunit.client.0.smithi138.stderr: -422> 2024-09-14T11:33:52.777+0000 7f02ef3bc9c0 10 monclient: _add_conns ranks=[1,2,0] 2024-09-14T11:33:53.165 INFO:tasks.workunit.client.0.smithi138.stderr: -421> 2024-09-14T11:33:52.777+0000 7f02ef3bc9c0 10 monclient(hunting): picked mon.noname-b con 0x55cd75b3a740 addr [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] 2024-09-14T11:33:53.165 INFO:tasks.workunit.client.0.smithi138.stderr: -420> 2024-09-14T11:33:52.777+0000 7f02ef3bc9c0 10 monclient(hunting): picked mon.noname-c con 0x55cd75bf2120 addr [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] 2024-09-14T11:33:53.165 INFO:tasks.workunit.client.0.smithi138.stderr: -419> 2024-09-14T11:33:52.777+0000 7f02ef3bc9c0 10 monclient(hunting): picked mon.noname-a con 0x55cd75bf5b40 addr [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] 2024-09-14T11:33:53.165 INFO:tasks.workunit.client.0.smithi138.stderr: -418> 2024-09-14T11:33:52.777+0000 7f02ef3bc9c0 10 monclient(hunting): start opening mon connection 2024-09-14T11:33:53.165 INFO:tasks.workunit.client.0.smithi138.stderr: -417> 2024-09-14T11:33:52.777+0000 7f02ef3bc9c0 10 monclient(hunting): start opening mon connection 2024-09-14T11:33:53.165 INFO:tasks.workunit.client.0.smithi138.stderr: -416> 2024-09-14T11:33:52.777+0000 7f02ef3bc9c0 10 monclient(hunting): start opening mon connection 2024-09-14T11:33:53.165 INFO:tasks.workunit.client.0.smithi138.stderr: -415> 2024-09-14T11:33:52.777+0000 7f02ef3bc9c0 10 monclient(hunting): _renew_subs 2024-09-14T11:33:53.165 INFO:tasks.workunit.client.0.smithi138.stderr: -414> 2024-09-14T11:33:52.777+0000 7f02ef3bc9c0 10 monclient(hunting): authenticate will time out at 2568.742961s 2024-09-14T11:33:53.166 INFO:tasks.workunit.client.0.smithi138.stderr: -413> 2024-09-14T11:33:52.777+0000 7f02ec6c1640 10 monclient(hunting): get_auth_request con 0x55cd75bf2120 auth_method 0 2024-09-14T11:33:53.166 INFO:tasks.workunit.client.0.smithi138.stderr: -412> 2024-09-14T11:33:52.777+0000 7f02ec6c1640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:33:53.166 INFO:tasks.workunit.client.0.smithi138.stderr: -411> 2024-09-14T11:33:52.777+0000 7f02ec6c1640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:33:53.166 INFO:tasks.workunit.client.0.smithi138.stderr: -410> 2024-09-14T11:33:52.777+0000 7f02ec6c1640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:33:53.166 INFO:tasks.workunit.client.0.smithi138.stderr: -409> 2024-09-14T11:33:52.777+0000 7f02ed6c3640 10 monclient(hunting): get_auth_request con 0x55cd75bf5b40 auth_method 0 2024-09-14T11:33:53.166 INFO:tasks.workunit.client.0.smithi138.stderr: -408> 2024-09-14T11:33:52.777+0000 7f02ed6c3640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:33:53.166 INFO:tasks.workunit.client.0.smithi138.stderr: -407> 2024-09-14T11:33:52.777+0000 7f02ed6c3640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:33:53.166 INFO:tasks.workunit.client.0.smithi138.stderr: -406> 2024-09-14T11:33:52.777+0000 7f02ed6c3640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:33:53.166 INFO:tasks.workunit.client.0.smithi138.stderr: -405> 2024-09-14T11:33:52.777+0000 7f02ec6c1640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:33:53.166 INFO:tasks.workunit.client.0.smithi138.stderr: -404> 2024-09-14T11:33:52.777+0000 7f02ec6c1640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:33:53.166 INFO:tasks.workunit.client.0.smithi138.stderr: -403> 2024-09-14T11:33:52.777+0000 7f02ec6c1640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:33:53.166 INFO:tasks.workunit.client.0.smithi138.stderr: -402> 2024-09-14T11:33:52.777+0000 7f02ed6c3640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:33:53.166 INFO:tasks.workunit.client.0.smithi138.stderr: -401> 2024-09-14T11:33:52.777+0000 7f02ed6c3640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:33:53.166 INFO:tasks.workunit.client.0.smithi138.stderr: -400> 2024-09-14T11:33:52.777+0000 7f02ed6c3640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:33:53.167 INFO:tasks.workunit.client.0.smithi138.stderr: -399> 2024-09-14T11:33:52.777+0000 7f02ec6c1640 10 monclient(hunting): handle_auth_done global_id 5897 payload 824 2024-09-14T11:33:53.167 INFO:tasks.workunit.client.0.smithi138.stderr: -398> 2024-09-14T11:33:52.777+0000 7f02ec6c1640 10 monclient: _finish_hunting 0 2024-09-14T11:33:53.167 INFO:tasks.workunit.client.0.smithi138.stderr: -397> 2024-09-14T11:33:52.777+0000 7f02ec6c1640 1 monclient: found mon.noname-c 2024-09-14T11:33:53.167 INFO:tasks.workunit.client.0.smithi138.stderr: -396> 2024-09-14T11:33:52.777+0000 7f02ec6c1640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.138:3301/0 2024-09-14T11:33:53.167 INFO:tasks.workunit.client.0.smithi138.stderr: -395> 2024-09-14T11:33:52.777+0000 7f01d960a640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:33:53.167 INFO:tasks.workunit.client.0.smithi138.stderr: -394> 2024-09-14T11:33:52.777+0000 7f01d960a640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-14T11:33:53.167 INFO:tasks.workunit.client.0.smithi138.stderr: -393> 2024-09-14T11:33:52.777+0000 7f01d960a640 10 monclient: dump: 2024-09-14T11:33:53.167 INFO:tasks.workunit.client.0.smithi138.stderr:epoch 1 2024-09-14T11:33:53.167 INFO:tasks.workunit.client.0.smithi138.stderr:fsid 3f225f43-83a6-4aeb-b798-1f04bb49d597 2024-09-14T11:33:53.167 INFO:tasks.workunit.client.0.smithi138.stderr:last_changed 2024-09-14T11:07:09.252780+0000 2024-09-14T11:33:53.167 INFO:tasks.workunit.client.0.smithi138.stderr:created 2024-09-14T11:07:09.252780+0000 2024-09-14T11:33:53.167 INFO:tasks.workunit.client.0.smithi138.stderr:min_mon_release 19 (squid) 2024-09-14T11:33:53.168 INFO:tasks.workunit.client.0.smithi138.stderr:election_strategy: 1 2024-09-14T11:33:53.168 INFO:tasks.workunit.client.0.smithi138.stderr:0: [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] mon.a 2024-09-14T11:33:53.168 INFO:tasks.workunit.client.0.smithi138.stderr:1: [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] mon.b 2024-09-14T11:33:53.168 INFO:tasks.workunit.client.0.smithi138.stderr:2: [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] mon.c 2024-09-14T11:33:53.168 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-14T11:33:53.168 INFO:tasks.workunit.client.0.smithi138.stderr: -392> 2024-09-14T11:33:52.777+0000 7f01d960a640 10 monclient: _finish_auth 0 2024-09-14T11:33:53.168 INFO:tasks.workunit.client.0.smithi138.stderr: -391> 2024-09-14T11:33:52.777+0000 7f01d960a640 10 monclient: _check_auth_tickets 2024-09-14T11:33:53.168 INFO:tasks.workunit.client.0.smithi138.stderr: -390> 2024-09-14T11:33:52.777+0000 7f01d960a640 10 monclient: handle_config config(0 keys) 2024-09-14T11:33:53.168 INFO:tasks.workunit.client.0.smithi138.stderr: -389> 2024-09-14T11:33:52.777+0000 7f01d960a640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:33:53.168 INFO:tasks.workunit.client.0.smithi138.stderr: -388> 2024-09-14T11:33:52.777+0000 7f01d960a640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-14T11:33:53.168 INFO:tasks.workunit.client.0.smithi138.stderr: -387> 2024-09-14T11:33:52.777+0000 7f01d960a640 10 monclient: dump: 2024-09-14T11:33:53.168 INFO:tasks.workunit.client.0.smithi138.stderr:epoch 1 2024-09-14T11:33:53.168 INFO:tasks.workunit.client.0.smithi138.stderr:fsid 3f225f43-83a6-4aeb-b798-1f04bb49d597 2024-09-14T11:33:53.168 INFO:tasks.workunit.client.0.smithi138.stderr:last_changed 2024-09-14T11:07:09.252780+0000 2024-09-14T11:33:53.168 INFO:tasks.workunit.client.0.smithi138.stderr:created 2024-09-14T11:07:09.252780+0000 2024-09-14T11:33:53.169 INFO:tasks.workunit.client.0.smithi138.stderr:min_mon_release 19 (squid) 2024-09-14T11:33:53.169 INFO:tasks.workunit.client.0.smithi138.stderr:election_strategy: 1 2024-09-14T11:33:53.169 INFO:tasks.workunit.client.0.smithi138.stderr:0: [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] mon.a 2024-09-14T11:33:53.169 INFO:tasks.workunit.client.0.smithi138.stderr:1: [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] mon.b 2024-09-14T11:33:53.169 INFO:tasks.workunit.client.0.smithi138.stderr:2: [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] mon.c 2024-09-14T11:33:53.169 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-14T11:33:53.169 INFO:tasks.workunit.client.0.smithi138.stderr: -386> 2024-09-14T11:33:52.777+0000 7f01dae0d640 4 set_mon_vals no callback set 2024-09-14T11:33:53.169 INFO:tasks.workunit.client.0.smithi138.stderr: -385> 2024-09-14T11:33:52.781+0000 7f02ef3bc9c0 5 monclient: authenticate success, global_id 5897 2024-09-14T11:33:53.169 INFO:tasks.workunit.client.0.smithi138.stderr: -384> 2024-09-14T11:33:52.781+0000 7f02ef3bc9c0 10 monclient: _renew_subs 2024-09-14T11:33:53.169 INFO:tasks.workunit.client.0.smithi138.stderr: -383> 2024-09-14T11:33:52.781+0000 7f02ef3bc9c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.138:3301/0 2024-09-14T11:33:53.169 INFO:tasks.workunit.client.0.smithi138.stderr: -382> 2024-09-14T11:33:52.781+0000 7f02ef3bc9c0 10 monclient: _renew_subs 2024-09-14T11:33:53.169 INFO:tasks.workunit.client.0.smithi138.stderr: -381> 2024-09-14T11:33:52.781+0000 7f02ef3bc9c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.138:3301/0 2024-09-14T11:33:53.169 INFO:tasks.workunit.client.0.smithi138.stderr: -380> 2024-09-14T11:33:52.781+0000 7f02ef3bc9c0 1 librados: init done 2024-09-14T11:33:53.169 INFO:tasks.workunit.client.0.smithi138.stderr: -379> 2024-09-14T11:33:52.781+0000 7f01d960a640 4 mgrc handle_mgr_map Got map version 5 2024-09-14T11:33:53.169 INFO:tasks.workunit.client.0.smithi138.stderr: -378> 2024-09-14T11:33:52.781+0000 7f01d960a640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.138:6832/3778043143,v1:172.21.15.138:6833/3778043143] 2024-09-14T11:33:53.170 INFO:tasks.workunit.client.0.smithi138.stderr: -377> 2024-09-14T11:33:52.781+0000 7f01d960a640 4 mgrc reconnect Starting new session with [v2:172.21.15.138:6832/3778043143,v1:172.21.15.138:6833/3778043143] 2024-09-14T11:33:53.170 INFO:tasks.workunit.client.0.smithi138.stderr: -376> 2024-09-14T11:33:52.781+0000 7f02ecec2640 10 monclient: get_auth_request con 0x7f01d40718d0 auth_method 0 2024-09-14T11:33:53.170 INFO:tasks.workunit.client.0.smithi138.stderr: -375> 2024-09-14T11:33:52.781+0000 7f02ed6c3640 10 monclient: get_auth_request con 0x55cd75cd43b0 auth_method 0 2024-09-14T11:33:53.170 INFO:tasks.workunit.client.0.smithi138.stderr: -374> 2024-09-14T11:33:52.781+0000 7f02ecec2640 10 monclient: get_auth_request con 0x55cd75cf7e90 auth_method 0 2024-09-14T11:33:53.170 INFO:tasks.workunit.client.0.smithi138.stderr: -373> 2024-09-14T11:33:52.785+0000 7f02ec6c1640 10 monclient: get_auth_request con 0x55cd75cfc310 auth_method 0 2024-09-14T11:33:53.170 INFO:tasks.workunit.client.0.smithi138.stderr: -372> 2024-09-14T11:33:52.785+0000 7f02ed6c3640 10 monclient: get_auth_request con 0x55cd75cfb740 auth_method 0 2024-09-14T11:33:53.170 INFO:tasks.workunit.client.0.smithi138.stderr: -371> 2024-09-14T11:33:52.789+0000 7f02ef3bc9c0 10 monclient: build_initial_monmap 2024-09-14T11:33:53.170 INFO:tasks.workunit.client.0.smithi138.stderr: -370> 2024-09-14T11:33:52.789+0000 7f02ef3bc9c0 1 build_initial for_mkfs: 0 2024-09-14T11:33:53.170 INFO:tasks.workunit.client.0.smithi138.stderr: -369> 2024-09-14T11:33:52.789+0000 7f02ef3bc9c0 10 monclient: monmap: 2024-09-14T11:33:53.170 INFO:tasks.workunit.client.0.smithi138.stderr:epoch 0 2024-09-14T11:33:53.170 INFO:tasks.workunit.client.0.smithi138.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-14T11:33:53.170 INFO:tasks.workunit.client.0.smithi138.stderr:last_changed 0.000000 2024-09-14T11:33:53.170 INFO:tasks.workunit.client.0.smithi138.stderr:created 0.000000 2024-09-14T11:33:53.170 INFO:tasks.workunit.client.0.smithi138.stderr:min_mon_release 0 (unknown) 2024-09-14T11:33:53.170 INFO:tasks.workunit.client.0.smithi138.stderr:election_strategy: 1 2024-09-14T11:33:53.171 INFO:tasks.workunit.client.0.smithi138.stderr:0: [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] mon.noname-a 2024-09-14T11:33:53.171 INFO:tasks.workunit.client.0.smithi138.stderr:1: [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] mon.noname-b 2024-09-14T11:33:53.171 INFO:tasks.workunit.client.0.smithi138.stderr:2: [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] mon.noname-c 2024-09-14T11:33:53.171 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-14T11:33:53.171 INFO:tasks.workunit.client.0.smithi138.stderr: -368> 2024-09-14T11:33:52.789+0000 7f02ef3bc9c0 5 AuthRegistry(0x55cd75d04420) adding auth protocol: cephx 2024-09-14T11:33:53.171 INFO:tasks.workunit.client.0.smithi138.stderr: -367> 2024-09-14T11:33:52.789+0000 7f02ef3bc9c0 5 AuthRegistry(0x55cd75d04420) adding auth protocol: cephx 2024-09-14T11:33:53.171 INFO:tasks.workunit.client.0.smithi138.stderr: -366> 2024-09-14T11:33:52.789+0000 7f02ef3bc9c0 5 AuthRegistry(0x55cd75d04420) adding auth protocol: cephx 2024-09-14T11:33:53.171 INFO:tasks.workunit.client.0.smithi138.stderr: -365> 2024-09-14T11:33:52.789+0000 7f02ef3bc9c0 5 AuthRegistry(0x55cd75d04420) adding con mode: secure 2024-09-14T11:33:53.171 INFO:tasks.workunit.client.0.smithi138.stderr: -364> 2024-09-14T11:33:52.789+0000 7f02ef3bc9c0 5 AuthRegistry(0x55cd75d04420) adding con mode: crc 2024-09-14T11:33:53.171 INFO:tasks.workunit.client.0.smithi138.stderr: -363> 2024-09-14T11:33:52.789+0000 7f02ef3bc9c0 5 AuthRegistry(0x55cd75d04420) adding con mode: secure 2024-09-14T11:33:53.171 INFO:tasks.workunit.client.0.smithi138.stderr: -362> 2024-09-14T11:33:52.789+0000 7f02ef3bc9c0 5 AuthRegistry(0x55cd75d04420) adding con mode: crc 2024-09-14T11:33:53.171 INFO:tasks.workunit.client.0.smithi138.stderr: -361> 2024-09-14T11:33:52.789+0000 7f02ef3bc9c0 5 AuthRegistry(0x55cd75d04420) adding con mode: secure 2024-09-14T11:33:53.171 INFO:tasks.workunit.client.0.smithi138.stderr: -360> 2024-09-14T11:33:52.789+0000 7f02ef3bc9c0 5 AuthRegistry(0x55cd75d04420) adding con mode: crc 2024-09-14T11:33:53.171 INFO:tasks.workunit.client.0.smithi138.stderr: -359> 2024-09-14T11:33:52.789+0000 7f02ef3bc9c0 5 AuthRegistry(0x55cd75d04420) adding con mode: crc 2024-09-14T11:33:53.171 INFO:tasks.workunit.client.0.smithi138.stderr: -358> 2024-09-14T11:33:52.789+0000 7f02ef3bc9c0 5 AuthRegistry(0x55cd75d04420) adding con mode: secure 2024-09-14T11:33:53.172 INFO:tasks.workunit.client.0.smithi138.stderr: -357> 2024-09-14T11:33:52.789+0000 7f02ef3bc9c0 5 AuthRegistry(0x55cd75d04420) adding con mode: crc 2024-09-14T11:33:53.172 INFO:tasks.workunit.client.0.smithi138.stderr: -356> 2024-09-14T11:33:52.789+0000 7f02ef3bc9c0 5 AuthRegistry(0x55cd75d04420) adding con mode: secure 2024-09-14T11:33:53.172 INFO:tasks.workunit.client.0.smithi138.stderr: -355> 2024-09-14T11:33:52.789+0000 7f02ef3bc9c0 5 AuthRegistry(0x55cd75d04420) adding con mode: crc 2024-09-14T11:33:53.172 INFO:tasks.workunit.client.0.smithi138.stderr: -354> 2024-09-14T11:33:52.789+0000 7f02ef3bc9c0 5 AuthRegistry(0x55cd75d04420) adding con mode: secure 2024-09-14T11:33:53.172 INFO:tasks.workunit.client.0.smithi138.stderr: -353> 2024-09-14T11:33:52.789+0000 7f02ef3bc9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:33:53.172 INFO:tasks.workunit.client.0.smithi138.stderr: -352> 2024-09-14T11:33:52.789+0000 7f02ef3bc9c0 5 asok(0x55cd75aa1d90) register_command objecter_requests cmddesc objecter_requests hook 0x55cd75d07e10 EEXIST 2024-09-14T11:33:53.172 INFO:tasks.workunit.client.0.smithi138.stderr: -351> 2024-09-14T11:33:52.789+0000 7f02ef3bc9c0 10 monclient: init 2024-09-14T11:33:53.172 INFO:tasks.workunit.client.0.smithi138.stderr: -350> 2024-09-14T11:33:52.789+0000 7f02ef3bc9c0 5 AuthRegistry(0x55cd75d033a8) adding auth protocol: cephx 2024-09-14T11:33:53.172 INFO:tasks.workunit.client.0.smithi138.stderr: -349> 2024-09-14T11:33:52.789+0000 7f02ef3bc9c0 5 AuthRegistry(0x55cd75d033a8) adding auth protocol: cephx 2024-09-14T11:33:53.172 INFO:tasks.workunit.client.0.smithi138.stderr: -348> 2024-09-14T11:33:52.789+0000 7f02ef3bc9c0 5 AuthRegistry(0x55cd75d033a8) adding auth protocol: cephx 2024-09-14T11:33:53.172 INFO:tasks.workunit.client.0.smithi138.stderr: -347> 2024-09-14T11:33:52.789+0000 7f02ef3bc9c0 5 AuthRegistry(0x55cd75d033a8) adding con mode: secure 2024-09-14T11:33:53.172 INFO:tasks.workunit.client.0.smithi138.stderr: -346> 2024-09-14T11:33:52.789+0000 7f02ef3bc9c0 5 AuthRegistry(0x55cd75d033a8) adding con mode: crc 2024-09-14T11:33:53.172 INFO:tasks.workunit.client.0.smithi138.stderr: -345> 2024-09-14T11:33:52.789+0000 7f02ef3bc9c0 5 AuthRegistry(0x55cd75d033a8) adding con mode: secure 2024-09-14T11:33:53.173 INFO:tasks.workunit.client.0.smithi138.stderr: -344> 2024-09-14T11:33:52.789+0000 7f02ef3bc9c0 5 AuthRegistry(0x55cd75d033a8) adding con mode: crc 2024-09-14T11:33:53.173 INFO:tasks.workunit.client.0.smithi138.stderr: -343> 2024-09-14T11:33:52.789+0000 7f02ef3bc9c0 5 AuthRegistry(0x55cd75d033a8) adding con mode: secure 2024-09-14T11:33:53.173 INFO:tasks.workunit.client.0.smithi138.stderr: -342> 2024-09-14T11:33:52.789+0000 7f02ef3bc9c0 5 AuthRegistry(0x55cd75d033a8) adding con mode: crc 2024-09-14T11:33:53.173 INFO:tasks.workunit.client.0.smithi138.stderr: -341> 2024-09-14T11:33:52.789+0000 7f02ef3bc9c0 5 AuthRegistry(0x55cd75d033a8) adding con mode: crc 2024-09-14T11:33:53.173 INFO:tasks.workunit.client.0.smithi138.stderr: -340> 2024-09-14T11:33:52.789+0000 7f02ef3bc9c0 5 AuthRegistry(0x55cd75d033a8) adding con mode: secure 2024-09-14T11:33:53.173 INFO:tasks.workunit.client.0.smithi138.stderr: -339> 2024-09-14T11:33:52.789+0000 7f02ef3bc9c0 5 AuthRegistry(0x55cd75d033a8) adding con mode: crc 2024-09-14T11:33:53.173 INFO:tasks.workunit.client.0.smithi138.stderr: -338> 2024-09-14T11:33:52.789+0000 7f02ef3bc9c0 5 AuthRegistry(0x55cd75d033a8) adding con mode: secure 2024-09-14T11:33:53.173 INFO:tasks.workunit.client.0.smithi138.stderr: -337> 2024-09-14T11:33:52.789+0000 7f02ef3bc9c0 5 AuthRegistry(0x55cd75d033a8) adding con mode: crc 2024-09-14T11:33:53.173 INFO:tasks.workunit.client.0.smithi138.stderr: -336> 2024-09-14T11:33:52.789+0000 7f02ef3bc9c0 5 AuthRegistry(0x55cd75d033a8) adding con mode: secure 2024-09-14T11:33:53.173 INFO:tasks.workunit.client.0.smithi138.stderr: -335> 2024-09-14T11:33:52.789+0000 7f02ef3bc9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:33:53.173 INFO:tasks.workunit.client.0.smithi138.stderr: -334> 2024-09-14T11:33:52.789+0000 7f02ef3bc9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:33:53.173 INFO:tasks.workunit.client.0.smithi138.stderr: -333> 2024-09-14T11:33:52.789+0000 7f02ef3bc9c0 5 asok(0x55cd75aa1d90) register_command rotate-key cmddesc rotate-key hook 0x55cd75d034f0 EEXIST 2024-09-14T11:33:53.173 INFO:tasks.workunit.client.0.smithi138.stderr: -332> 2024-09-14T11:33:52.789+0000 7f02ef3bc9c0 10 monclient: _reopen_session rank -1 2024-09-14T11:33:53.173 INFO:tasks.workunit.client.0.smithi138.stderr: -331> 2024-09-14T11:33:52.789+0000 7f02ef3bc9c0 10 monclient: _add_conns ranks=[1,0,2] 2024-09-14T11:33:53.173 INFO:tasks.workunit.client.0.smithi138.stderr: -330> 2024-09-14T11:33:52.789+0000 7f02ef3bc9c0 10 monclient(hunting): picked mon.noname-b con 0x55cd75d2bfc0 addr [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] 2024-09-14T11:33:53.174 INFO:tasks.workunit.client.0.smithi138.stderr: -329> 2024-09-14T11:33:52.789+0000 7f02ef3bc9c0 10 monclient(hunting): picked mon.noname-a con 0x55cd75d2b8f0 addr [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] 2024-09-14T11:33:53.174 INFO:tasks.workunit.client.0.smithi138.stderr: -328> 2024-09-14T11:33:52.789+0000 7f02ef3bc9c0 10 monclient(hunting): picked mon.noname-c con 0x55cd75d2a2d0 addr [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] 2024-09-14T11:33:53.174 INFO:tasks.workunit.client.0.smithi138.stderr: -327> 2024-09-14T11:33:52.789+0000 7f02ef3bc9c0 10 monclient(hunting): start opening mon connection 2024-09-14T11:33:53.174 INFO:tasks.workunit.client.0.smithi138.stderr: -326> 2024-09-14T11:33:52.789+0000 7f02ef3bc9c0 10 monclient(hunting): start opening mon connection 2024-09-14T11:33:53.174 INFO:tasks.workunit.client.0.smithi138.stderr: -325> 2024-09-14T11:33:52.789+0000 7f02ef3bc9c0 10 monclient(hunting): start opening mon connection 2024-09-14T11:33:53.174 INFO:tasks.workunit.client.0.smithi138.stderr: -324> 2024-09-14T11:33:52.789+0000 7f02ef3bc9c0 10 monclient(hunting): _renew_subs 2024-09-14T11:33:53.174 INFO:tasks.workunit.client.0.smithi138.stderr: -323> 2024-09-14T11:33:52.789+0000 7f02ef3bc9c0 10 monclient(hunting): authenticate will time out at 2568.754083s 2024-09-14T11:33:53.174 INFO:tasks.workunit.client.0.smithi138.stderr: -322> 2024-09-14T11:33:52.789+0000 7f02ed6c3640 10 monclient(hunting): get_auth_request con 0x55cd75d2b8f0 auth_method 0 2024-09-14T11:33:53.174 INFO:tasks.workunit.client.0.smithi138.stderr: -321> 2024-09-14T11:33:52.789+0000 7f02ed6c3640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:33:53.174 INFO:tasks.workunit.client.0.smithi138.stderr: -320> 2024-09-14T11:33:52.789+0000 7f02ed6c3640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:33:53.174 INFO:tasks.workunit.client.0.smithi138.stderr: -319> 2024-09-14T11:33:52.789+0000 7f02ed6c3640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:33:53.174 INFO:tasks.workunit.client.0.smithi138.stderr: -318> 2024-09-14T11:33:52.789+0000 7f02ecec2640 10 monclient(hunting): get_auth_request con 0x55cd75d2a2d0 auth_method 0 2024-09-14T11:33:53.174 INFO:tasks.workunit.client.0.smithi138.stderr: -317> 2024-09-14T11:33:52.789+0000 7f02ecec2640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:33:53.174 INFO:tasks.workunit.client.0.smithi138.stderr: -316> 2024-09-14T11:33:52.789+0000 7f02ecec2640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:33:53.175 INFO:tasks.workunit.client.0.smithi138.stderr: -315> 2024-09-14T11:33:52.789+0000 7f02ecec2640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:33:53.175 INFO:tasks.workunit.client.0.smithi138.stderr: -314> 2024-09-14T11:33:52.789+0000 7f02ed6c3640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:33:53.175 INFO:tasks.workunit.client.0.smithi138.stderr: -313> 2024-09-14T11:33:52.789+0000 7f02ed6c3640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:33:53.175 INFO:tasks.workunit.client.0.smithi138.stderr: -312> 2024-09-14T11:33:52.789+0000 7f02ed6c3640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:33:53.175 INFO:tasks.workunit.client.0.smithi138.stderr: -311> 2024-09-14T11:33:52.789+0000 7f02ecec2640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:33:53.175 INFO:tasks.workunit.client.0.smithi138.stderr: -310> 2024-09-14T11:33:52.789+0000 7f02ecec2640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:33:53.175 INFO:tasks.workunit.client.0.smithi138.stderr: -309> 2024-09-14T11:33:52.789+0000 7f02ecec2640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:33:53.175 INFO:tasks.workunit.client.0.smithi138.stderr: -308> 2024-09-14T11:33:52.789+0000 7f02ec6c1640 10 monclient(hunting): get_auth_request con 0x55cd75d2bfc0 auth_method 0 2024-09-14T11:33:53.175 INFO:tasks.workunit.client.0.smithi138.stderr: -307> 2024-09-14T11:33:52.789+0000 7f02ec6c1640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:33:53.175 INFO:tasks.workunit.client.0.smithi138.stderr: -306> 2024-09-14T11:33:52.789+0000 7f02ec6c1640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:33:53.175 INFO:tasks.workunit.client.0.smithi138.stderr: -305> 2024-09-14T11:33:52.789+0000 7f02ec6c1640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:33:53.175 INFO:tasks.workunit.client.0.smithi138.stderr: -304> 2024-09-14T11:33:52.789+0000 7f02ecec2640 10 monclient(hunting): handle_auth_done global_id 5900 payload 824 2024-09-14T11:33:53.175 INFO:tasks.workunit.client.0.smithi138.stderr: -303> 2024-09-14T11:33:52.789+0000 7f02ecec2640 10 monclient: _finish_hunting 0 2024-09-14T11:33:53.175 INFO:tasks.workunit.client.0.smithi138.stderr: -302> 2024-09-14T11:33:52.789+0000 7f02ecec2640 1 monclient: found mon.noname-c 2024-09-14T11:33:53.176 INFO:tasks.workunit.client.0.smithi138.stderr: -301> 2024-09-14T11:33:52.789+0000 7f02ecec2640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.138:3301/0 2024-09-14T11:33:53.176 INFO:tasks.workunit.client.0.smithi138.stderr: -300> 2024-09-14T11:33:52.789+0000 7f01d27fc640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:33:53.176 INFO:tasks.workunit.client.0.smithi138.stderr: -299> 2024-09-14T11:33:52.789+0000 7f01d27fc640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-14T11:33:53.176 INFO:tasks.workunit.client.0.smithi138.stderr: -298> 2024-09-14T11:33:52.789+0000 7f01d27fc640 10 monclient: dump: 2024-09-14T11:33:53.176 INFO:tasks.workunit.client.0.smithi138.stderr:epoch 1 2024-09-14T11:33:53.176 INFO:tasks.workunit.client.0.smithi138.stderr:fsid 3f225f43-83a6-4aeb-b798-1f04bb49d597 2024-09-14T11:33:53.176 INFO:tasks.workunit.client.0.smithi138.stderr:last_changed 2024-09-14T11:07:09.252780+0000 2024-09-14T11:33:53.176 INFO:tasks.workunit.client.0.smithi138.stderr:created 2024-09-14T11:07:09.252780+0000 2024-09-14T11:33:53.176 INFO:tasks.workunit.client.0.smithi138.stderr:min_mon_release 19 (squid) 2024-09-14T11:33:53.176 INFO:tasks.workunit.client.0.smithi138.stderr:election_strategy: 1 2024-09-14T11:33:53.176 INFO:tasks.workunit.client.0.smithi138.stderr:0: [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] mon.a 2024-09-14T11:33:53.176 INFO:tasks.workunit.client.0.smithi138.stderr:1: [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] mon.b 2024-09-14T11:33:53.176 INFO:tasks.workunit.client.0.smithi138.stderr:2: [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] mon.c 2024-09-14T11:33:53.177 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-14T11:33:53.177 INFO:tasks.workunit.client.0.smithi138.stderr: -297> 2024-09-14T11:33:52.789+0000 7f01d27fc640 10 monclient: _finish_auth 0 2024-09-14T11:33:53.177 INFO:tasks.workunit.client.0.smithi138.stderr: -296> 2024-09-14T11:33:52.789+0000 7f01d27fc640 10 monclient: _check_auth_tickets 2024-09-14T11:33:53.177 INFO:tasks.workunit.client.0.smithi138.stderr: -295> 2024-09-14T11:33:52.789+0000 7f01d27fc640 10 monclient: handle_config config(0 keys) 2024-09-14T11:33:53.177 INFO:tasks.workunit.client.0.smithi138.stderr: -294> 2024-09-14T11:33:52.789+0000 7f01d27fc640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:33:53.177 INFO:tasks.workunit.client.0.smithi138.stderr: -293> 2024-09-14T11:33:52.789+0000 7f01d27fc640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-14T11:33:53.177 INFO:tasks.workunit.client.0.smithi138.stderr: -292> 2024-09-14T11:33:52.789+0000 7f01d27fc640 10 monclient: dump: 2024-09-14T11:33:53.177 INFO:tasks.workunit.client.0.smithi138.stderr:epoch 1 2024-09-14T11:33:53.177 INFO:tasks.workunit.client.0.smithi138.stderr:fsid 3f225f43-83a6-4aeb-b798-1f04bb49d597 2024-09-14T11:33:53.177 INFO:tasks.workunit.client.0.smithi138.stderr:last_changed 2024-09-14T11:07:09.252780+0000 2024-09-14T11:33:53.177 INFO:tasks.workunit.client.0.smithi138.stderr:created 2024-09-14T11:07:09.252780+0000 2024-09-14T11:33:53.177 INFO:tasks.workunit.client.0.smithi138.stderr:min_mon_release 19 (squid) 2024-09-14T11:33:53.177 INFO:tasks.workunit.client.0.smithi138.stderr:election_strategy: 1 2024-09-14T11:33:53.177 INFO:tasks.workunit.client.0.smithi138.stderr:0: [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] mon.a 2024-09-14T11:33:53.177 INFO:tasks.workunit.client.0.smithi138.stderr:1: [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] mon.b 2024-09-14T11:33:53.177 INFO:tasks.workunit.client.0.smithi138.stderr:2: [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] mon.c 2024-09-14T11:33:53.178 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-14T11:33:53.178 INFO:tasks.workunit.client.0.smithi138.stderr: -291> 2024-09-14T11:33:52.789+0000 7f02ef3bc9c0 5 monclient: authenticate success, global_id 5900 2024-09-14T11:33:53.178 INFO:tasks.workunit.client.0.smithi138.stderr: -290> 2024-09-14T11:33:52.789+0000 7f02edec4640 4 set_mon_vals no callback set 2024-09-14T11:33:53.178 INFO:tasks.workunit.client.0.smithi138.stderr: -289> 2024-09-14T11:33:52.789+0000 7f02ef3bc9c0 10 monclient: _renew_subs 2024-09-14T11:33:53.178 INFO:tasks.workunit.client.0.smithi138.stderr: -288> 2024-09-14T11:33:52.789+0000 7f02ef3bc9c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.138:3301/0 2024-09-14T11:33:53.178 INFO:tasks.workunit.client.0.smithi138.stderr: -287> 2024-09-14T11:33:52.789+0000 7f02ef3bc9c0 10 monclient: _renew_subs 2024-09-14T11:33:53.178 INFO:tasks.workunit.client.0.smithi138.stderr: -286> 2024-09-14T11:33:52.789+0000 7f02ef3bc9c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.138:3301/0 2024-09-14T11:33:53.178 INFO:tasks.workunit.client.0.smithi138.stderr: -285> 2024-09-14T11:33:52.793+0000 7f01d27fc640 4 mgrc handle_mgr_map Got map version 5 2024-09-14T11:33:53.178 INFO:tasks.workunit.client.0.smithi138.stderr: -284> 2024-09-14T11:33:52.793+0000 7f01d27fc640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.138:6832/3778043143,v1:172.21.15.138:6833/3778043143] 2024-09-14T11:33:53.178 INFO:tasks.workunit.client.0.smithi138.stderr: -283> 2024-09-14T11:33:52.793+0000 7f01d27fc640 4 mgrc reconnect Starting new session with [v2:172.21.15.138:6832/3778043143,v1:172.21.15.138:6833/3778043143] 2024-09-14T11:33:53.178 INFO:tasks.workunit.client.0.smithi138.stderr: -282> 2024-09-14T11:33:52.793+0000 7f02ec6c1640 10 monclient: get_auth_request con 0x7f01c40717e0 auth_method 0 2024-09-14T11:33:53.178 INFO:tasks.workunit.client.0.smithi138.stderr: -281> 2024-09-14T11:33:52.793+0000 7f02ef3bc9c0 10 monclient: get_monmap_and_config 2024-09-14T11:33:53.178 INFO:tasks.workunit.client.0.smithi138.stderr: -280> 2024-09-14T11:33:52.793+0000 7f02ef3bc9c0 10 monclient: build_initial_monmap 2024-09-14T11:33:53.178 INFO:tasks.workunit.client.0.smithi138.stderr: -279> 2024-09-14T11:33:52.793+0000 7f02ef3bc9c0 1 build_initial for_mkfs: 0 2024-09-14T11:33:53.178 INFO:tasks.workunit.client.0.smithi138.stderr: -278> 2024-09-14T11:33:52.793+0000 7f02ef3bc9c0 10 monclient: monmap: 2024-09-14T11:33:53.179 INFO:tasks.workunit.client.0.smithi138.stderr:epoch 0 2024-09-14T11:33:53.179 INFO:tasks.workunit.client.0.smithi138.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-14T11:33:53.179 INFO:tasks.workunit.client.0.smithi138.stderr:last_changed 0.000000 2024-09-14T11:33:53.179 INFO:tasks.workunit.client.0.smithi138.stderr:created 0.000000 2024-09-14T11:33:53.179 INFO:tasks.workunit.client.0.smithi138.stderr:min_mon_release 0 (unknown) 2024-09-14T11:33:53.179 INFO:tasks.workunit.client.0.smithi138.stderr:election_strategy: 1 2024-09-14T11:33:53.179 INFO:tasks.workunit.client.0.smithi138.stderr:0: [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] mon.noname-a 2024-09-14T11:33:53.179 INFO:tasks.workunit.client.0.smithi138.stderr:1: [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] mon.noname-b 2024-09-14T11:33:53.179 INFO:tasks.workunit.client.0.smithi138.stderr:2: [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] mon.noname-c 2024-09-14T11:33:53.179 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-14T11:33:53.179 INFO:tasks.workunit.client.0.smithi138.stderr: -277> 2024-09-14T11:33:52.793+0000 7f02ef3bc9c0 5 AuthRegistry(0x55cd75d4b900) adding auth protocol: cephx 2024-09-14T11:33:53.179 INFO:tasks.workunit.client.0.smithi138.stderr: -276> 2024-09-14T11:33:52.793+0000 7f02ef3bc9c0 5 AuthRegistry(0x55cd75d4b900) adding auth protocol: cephx 2024-09-14T11:33:53.179 INFO:tasks.workunit.client.0.smithi138.stderr: -275> 2024-09-14T11:33:52.793+0000 7f02ef3bc9c0 5 AuthRegistry(0x55cd75d4b900) adding auth protocol: cephx 2024-09-14T11:33:53.179 INFO:tasks.workunit.client.0.smithi138.stderr: -274> 2024-09-14T11:33:52.793+0000 7f02ef3bc9c0 5 AuthRegistry(0x55cd75d4b900) adding con mode: secure 2024-09-14T11:33:53.180 INFO:tasks.workunit.client.0.smithi138.stderr: -273> 2024-09-14T11:33:52.793+0000 7f02ef3bc9c0 5 AuthRegistry(0x55cd75d4b900) adding con mode: crc 2024-09-14T11:33:53.180 INFO:tasks.workunit.client.0.smithi138.stderr: -272> 2024-09-14T11:33:52.793+0000 7f02ef3bc9c0 5 AuthRegistry(0x55cd75d4b900) adding con mode: secure 2024-09-14T11:33:53.180 INFO:tasks.workunit.client.0.smithi138.stderr: -271> 2024-09-14T11:33:52.793+0000 7f02ef3bc9c0 5 AuthRegistry(0x55cd75d4b900) adding con mode: crc 2024-09-14T11:33:53.180 INFO:tasks.workunit.client.0.smithi138.stderr: -270> 2024-09-14T11:33:52.793+0000 7f02ef3bc9c0 5 AuthRegistry(0x55cd75d4b900) adding con mode: secure 2024-09-14T11:33:53.180 INFO:tasks.workunit.client.0.smithi138.stderr: -269> 2024-09-14T11:33:52.793+0000 7f02ef3bc9c0 5 AuthRegistry(0x55cd75d4b900) adding con mode: crc 2024-09-14T11:33:53.180 INFO:tasks.workunit.client.0.smithi138.stderr: -268> 2024-09-14T11:33:52.793+0000 7f02ef3bc9c0 5 AuthRegistry(0x55cd75d4b900) adding con mode: crc 2024-09-14T11:33:53.180 INFO:tasks.workunit.client.0.smithi138.stderr: -267> 2024-09-14T11:33:52.793+0000 7f02ef3bc9c0 5 AuthRegistry(0x55cd75d4b900) adding con mode: secure 2024-09-14T11:33:53.180 INFO:tasks.workunit.client.0.smithi138.stderr: -266> 2024-09-14T11:33:52.793+0000 7f02ef3bc9c0 5 AuthRegistry(0x55cd75d4b900) adding con mode: crc 2024-09-14T11:33:53.180 INFO:tasks.workunit.client.0.smithi138.stderr: -265> 2024-09-14T11:33:52.793+0000 7f02ef3bc9c0 5 AuthRegistry(0x55cd75d4b900) adding con mode: secure 2024-09-14T11:33:53.180 INFO:tasks.workunit.client.0.smithi138.stderr: -264> 2024-09-14T11:33:52.793+0000 7f02ef3bc9c0 5 AuthRegistry(0x55cd75d4b900) adding con mode: crc 2024-09-14T11:33:53.180 INFO:tasks.workunit.client.0.smithi138.stderr: -263> 2024-09-14T11:33:52.793+0000 7f02ef3bc9c0 5 AuthRegistry(0x55cd75d4b900) adding con mode: secure 2024-09-14T11:33:53.180 INFO:tasks.workunit.client.0.smithi138.stderr: -262> 2024-09-14T11:33:52.793+0000 7f02ef3bc9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:33:53.180 INFO:tasks.workunit.client.0.smithi138.stderr: -261> 2024-09-14T11:33:52.793+0000 7f02ef3bc9c0 10 monclient: init 2024-09-14T11:33:53.180 INFO:tasks.workunit.client.0.smithi138.stderr: -260> 2024-09-14T11:33:52.793+0000 7f02ef3bc9c0 5 AuthRegistry(0x7ffd2b80a160) adding auth protocol: cephx 2024-09-14T11:33:53.181 INFO:tasks.workunit.client.0.smithi138.stderr: -259> 2024-09-14T11:33:52.793+0000 7f02ef3bc9c0 5 AuthRegistry(0x7ffd2b80a160) adding auth protocol: cephx 2024-09-14T11:33:53.181 INFO:tasks.workunit.client.0.smithi138.stderr: -258> 2024-09-14T11:33:52.793+0000 7f02ef3bc9c0 5 AuthRegistry(0x7ffd2b80a160) adding auth protocol: cephx 2024-09-14T11:33:53.181 INFO:tasks.workunit.client.0.smithi138.stderr: -257> 2024-09-14T11:33:52.793+0000 7f02ef3bc9c0 5 AuthRegistry(0x7ffd2b80a160) adding con mode: secure 2024-09-14T11:33:53.181 INFO:tasks.workunit.client.0.smithi138.stderr: -256> 2024-09-14T11:33:52.793+0000 7f02ef3bc9c0 5 AuthRegistry(0x7ffd2b80a160) adding con mode: crc 2024-09-14T11:33:53.181 INFO:tasks.workunit.client.0.smithi138.stderr: -255> 2024-09-14T11:33:52.793+0000 7f02ef3bc9c0 5 AuthRegistry(0x7ffd2b80a160) adding con mode: secure 2024-09-14T11:33:53.181 INFO:tasks.workunit.client.0.smithi138.stderr: -254> 2024-09-14T11:33:52.793+0000 7f02ef3bc9c0 5 AuthRegistry(0x7ffd2b80a160) adding con mode: crc 2024-09-14T11:33:53.181 INFO:tasks.workunit.client.0.smithi138.stderr: -253> 2024-09-14T11:33:52.793+0000 7f02ef3bc9c0 5 AuthRegistry(0x7ffd2b80a160) adding con mode: secure 2024-09-14T11:33:53.181 INFO:tasks.workunit.client.0.smithi138.stderr: -252> 2024-09-14T11:33:52.793+0000 7f02ef3bc9c0 5 AuthRegistry(0x7ffd2b80a160) adding con mode: crc 2024-09-14T11:33:53.181 INFO:tasks.workunit.client.0.smithi138.stderr: -251> 2024-09-14T11:33:52.793+0000 7f02ef3bc9c0 5 AuthRegistry(0x7ffd2b80a160) adding con mode: crc 2024-09-14T11:33:53.181 INFO:tasks.workunit.client.0.smithi138.stderr: -250> 2024-09-14T11:33:52.793+0000 7f02ef3bc9c0 5 AuthRegistry(0x7ffd2b80a160) adding con mode: secure 2024-09-14T11:33:53.181 INFO:tasks.workunit.client.0.smithi138.stderr: -249> 2024-09-14T11:33:52.793+0000 7f02ef3bc9c0 5 AuthRegistry(0x7ffd2b80a160) adding con mode: crc 2024-09-14T11:33:53.181 INFO:tasks.workunit.client.0.smithi138.stderr: -248> 2024-09-14T11:33:52.793+0000 7f02ef3bc9c0 5 AuthRegistry(0x7ffd2b80a160) adding con mode: secure 2024-09-14T11:33:53.181 INFO:tasks.workunit.client.0.smithi138.stderr: -247> 2024-09-14T11:33:52.793+0000 7f02ef3bc9c0 5 AuthRegistry(0x7ffd2b80a160) adding con mode: crc 2024-09-14T11:33:53.181 INFO:tasks.workunit.client.0.smithi138.stderr: -246> 2024-09-14T11:33:52.793+0000 7f02ef3bc9c0 5 AuthRegistry(0x7ffd2b80a160) adding con mode: secure 2024-09-14T11:33:53.182 INFO:tasks.workunit.client.0.smithi138.stderr: -245> 2024-09-14T11:33:52.793+0000 7f02ef3bc9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:33:53.182 INFO:tasks.workunit.client.0.smithi138.stderr: -244> 2024-09-14T11:33:52.793+0000 7f02ef3bc9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:33:53.182 INFO:tasks.workunit.client.0.smithi138.stderr: -243> 2024-09-14T11:33:52.793+0000 7f02ef3bc9c0 5 asok(0x55cd75aa1d90) register_command rotate-key cmddesc rotate-key hook 0x7ffd2b80a2a8 EEXIST 2024-09-14T11:33:53.182 INFO:tasks.workunit.client.0.smithi138.stderr: -242> 2024-09-14T11:33:52.793+0000 7f02ef3bc9c0 10 monclient: _reopen_session rank -1 2024-09-14T11:33:53.182 INFO:tasks.workunit.client.0.smithi138.stderr: -241> 2024-09-14T11:33:52.793+0000 7f02ef3bc9c0 10 monclient: _add_conns ranks=[1,2,0] 2024-09-14T11:33:53.182 INFO:tasks.workunit.client.0.smithi138.stderr: -240> 2024-09-14T11:33:52.793+0000 7f02ef3bc9c0 10 monclient(hunting): picked mon.noname-b con 0x55cd75d7fe20 addr [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] 2024-09-14T11:33:53.182 INFO:tasks.workunit.client.0.smithi138.stderr: -239> 2024-09-14T11:33:52.793+0000 7f02ef3bc9c0 10 monclient(hunting): picked mon.noname-c con 0x55cd75d4f840 addr [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] 2024-09-14T11:33:53.182 INFO:tasks.workunit.client.0.smithi138.stderr: -238> 2024-09-14T11:33:52.793+0000 7f02ef3bc9c0 10 monclient(hunting): picked mon.noname-a con 0x55cd75d7b5f0 addr [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] 2024-09-14T11:33:53.182 INFO:tasks.workunit.client.0.smithi138.stderr: -237> 2024-09-14T11:33:52.793+0000 7f02ef3bc9c0 10 monclient(hunting): start opening mon connection 2024-09-14T11:33:53.182 INFO:tasks.workunit.client.0.smithi138.stderr: -236> 2024-09-14T11:33:52.793+0000 7f02ef3bc9c0 10 monclient(hunting): start opening mon connection 2024-09-14T11:33:53.182 INFO:tasks.workunit.client.0.smithi138.stderr: -235> 2024-09-14T11:33:52.793+0000 7f02ef3bc9c0 10 monclient(hunting): start opening mon connection 2024-09-14T11:33:53.182 INFO:tasks.workunit.client.0.smithi138.stderr: -234> 2024-09-14T11:33:52.793+0000 7f02ef3bc9c0 10 monclient(hunting): _renew_subs 2024-09-14T11:33:53.182 INFO:tasks.workunit.client.0.smithi138.stderr: -233> 2024-09-14T11:33:52.793+0000 7f02ef3bc9c0 10 monclient(hunting): authenticate will time out at 2568.758501s 2024-09-14T11:33:53.182 INFO:tasks.workunit.client.0.smithi138.stderr: -232> 2024-09-14T11:33:52.793+0000 7f02ecec2640 10 monclient(hunting): get_auth_request con 0x55cd75d7b5f0 auth_method 0 2024-09-14T11:33:53.183 INFO:tasks.workunit.client.0.smithi138.stderr: -231> 2024-09-14T11:33:52.793+0000 7f02ecec2640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:33:53.183 INFO:tasks.workunit.client.0.smithi138.stderr: -230> 2024-09-14T11:33:52.793+0000 7f02ecec2640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:33:53.183 INFO:tasks.workunit.client.0.smithi138.stderr: -229> 2024-09-14T11:33:52.793+0000 7f02ecec2640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:33:53.183 INFO:tasks.workunit.client.0.smithi138.stderr: -228> 2024-09-14T11:33:52.793+0000 7f02ed6c3640 10 monclient(hunting): get_auth_request con 0x55cd75d4f840 auth_method 0 2024-09-14T11:33:53.183 INFO:tasks.workunit.client.0.smithi138.stderr: -227> 2024-09-14T11:33:52.793+0000 7f02ed6c3640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:33:53.183 INFO:tasks.workunit.client.0.smithi138.stderr: -226> 2024-09-14T11:33:52.793+0000 7f02ed6c3640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:33:53.183 INFO:tasks.workunit.client.0.smithi138.stderr: -225> 2024-09-14T11:33:52.793+0000 7f02ed6c3640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:33:53.183 INFO:tasks.workunit.client.0.smithi138.stderr: -224> 2024-09-14T11:33:52.793+0000 7f02ecec2640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:33:53.183 INFO:tasks.workunit.client.0.smithi138.stderr: -223> 2024-09-14T11:33:52.793+0000 7f02ecec2640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:33:53.183 INFO:tasks.workunit.client.0.smithi138.stderr: -222> 2024-09-14T11:33:52.793+0000 7f02ecec2640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:33:53.183 INFO:tasks.workunit.client.0.smithi138.stderr: -221> 2024-09-14T11:33:52.793+0000 7f02ed6c3640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:33:53.183 INFO:tasks.workunit.client.0.smithi138.stderr: -220> 2024-09-14T11:33:52.793+0000 7f02ed6c3640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:33:53.183 INFO:tasks.workunit.client.0.smithi138.stderr: -219> 2024-09-14T11:33:52.793+0000 7f02ed6c3640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:33:53.183 INFO:tasks.workunit.client.0.smithi138.stderr: -218> 2024-09-14T11:33:52.793+0000 7f02ecec2640 10 monclient(hunting): handle_auth_done global_id 6279 payload 274 2024-09-14T11:33:53.184 INFO:tasks.workunit.client.0.smithi138.stderr: -217> 2024-09-14T11:33:52.793+0000 7f02ecec2640 10 monclient: _finish_hunting 0 2024-09-14T11:33:53.184 INFO:tasks.workunit.client.0.smithi138.stderr: -216> 2024-09-14T11:33:52.793+0000 7f02ecec2640 1 monclient: found mon.noname-a 2024-09-14T11:33:53.184 INFO:tasks.workunit.client.0.smithi138.stderr: -215> 2024-09-14T11:33:52.793+0000 7f02ecec2640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.138:3300/0 2024-09-14T11:33:53.184 INFO:tasks.workunit.client.0.smithi138.stderr: -214> 2024-09-14T11:33:52.793+0000 7f01c3fff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:33:53.184 INFO:tasks.workunit.client.0.smithi138.stderr: -213> 2024-09-14T11:33:52.793+0000 7f01c3fff640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-14T11:33:53.184 INFO:tasks.workunit.client.0.smithi138.stderr: -212> 2024-09-14T11:33:52.793+0000 7f01c3fff640 10 monclient: dump: 2024-09-14T11:33:53.184 INFO:tasks.workunit.client.0.smithi138.stderr:epoch 1 2024-09-14T11:33:53.184 INFO:tasks.workunit.client.0.smithi138.stderr:fsid 3f225f43-83a6-4aeb-b798-1f04bb49d597 2024-09-14T11:33:53.184 INFO:tasks.workunit.client.0.smithi138.stderr:last_changed 2024-09-14T11:07:09.252780+0000 2024-09-14T11:33:53.184 INFO:tasks.workunit.client.0.smithi138.stderr:created 2024-09-14T11:07:09.252780+0000 2024-09-14T11:33:53.184 INFO:tasks.workunit.client.0.smithi138.stderr:min_mon_release 19 (squid) 2024-09-14T11:33:53.184 INFO:tasks.workunit.client.0.smithi138.stderr:election_strategy: 1 2024-09-14T11:33:53.185 INFO:tasks.workunit.client.0.smithi138.stderr:0: [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] mon.a 2024-09-14T11:33:53.185 INFO:tasks.workunit.client.0.smithi138.stderr:1: [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] mon.b 2024-09-14T11:33:53.185 INFO:tasks.workunit.client.0.smithi138.stderr:2: [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] mon.c 2024-09-14T11:33:53.185 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-14T11:33:53.185 INFO:tasks.workunit.client.0.smithi138.stderr: -211> 2024-09-14T11:33:52.793+0000 7f01c3fff640 10 monclient: _finish_auth 0 2024-09-14T11:33:53.185 INFO:tasks.workunit.client.0.smithi138.stderr: -210> 2024-09-14T11:33:52.793+0000 7f01c3fff640 10 monclient: _check_auth_tickets 2024-09-14T11:33:53.185 INFO:tasks.workunit.client.0.smithi138.stderr: -209> 2024-09-14T11:33:52.793+0000 7f01c3fff640 10 monclient: handle_config config(0 keys) 2024-09-14T11:33:53.185 INFO:tasks.workunit.client.0.smithi138.stderr: -208> 2024-09-14T11:33:52.793+0000 7f01c3fff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:33:53.185 INFO:tasks.workunit.client.0.smithi138.stderr: -207> 2024-09-14T11:33:52.793+0000 7f01c3fff640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-14T11:33:53.185 INFO:tasks.workunit.client.0.smithi138.stderr: -206> 2024-09-14T11:33:52.793+0000 7f01c3fff640 10 monclient: dump: 2024-09-14T11:33:53.185 INFO:tasks.workunit.client.0.smithi138.stderr:epoch 1 2024-09-14T11:33:53.185 INFO:tasks.workunit.client.0.smithi138.stderr:fsid 3f225f43-83a6-4aeb-b798-1f04bb49d597 2024-09-14T11:33:53.185 INFO:tasks.workunit.client.0.smithi138.stderr:last_changed 2024-09-14T11:07:09.252780+0000 2024-09-14T11:33:53.186 INFO:tasks.workunit.client.0.smithi138.stderr:created 2024-09-14T11:07:09.252780+0000 2024-09-14T11:33:53.186 INFO:tasks.workunit.client.0.smithi138.stderr:min_mon_release 19 (squid) 2024-09-14T11:33:53.186 INFO:tasks.workunit.client.0.smithi138.stderr:election_strategy: 1 2024-09-14T11:33:53.186 INFO:tasks.workunit.client.0.smithi138.stderr:0: [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] mon.a 2024-09-14T11:33:53.186 INFO:tasks.workunit.client.0.smithi138.stderr:1: [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] mon.b 2024-09-14T11:33:53.186 INFO:tasks.workunit.client.0.smithi138.stderr:2: [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] mon.c 2024-09-14T11:33:53.186 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-14T11:33:53.186 INFO:tasks.workunit.client.0.smithi138.stderr: -205> 2024-09-14T11:33:52.793+0000 7f02ef3bc9c0 5 monclient: authenticate success, global_id 6279 2024-09-14T11:33:53.186 INFO:tasks.workunit.client.0.smithi138.stderr: -204> 2024-09-14T11:33:52.793+0000 7f02ef3bc9c0 10 monclient: get_monmap_and_config success 2024-09-14T11:33:53.186 INFO:tasks.workunit.client.0.smithi138.stderr: -203> 2024-09-14T11:33:52.793+0000 7f02ef3bc9c0 4 set_mon_vals no callback set 2024-09-14T11:33:53.186 INFO:tasks.workunit.client.0.smithi138.stderr: -202> 2024-09-14T11:33:52.793+0000 7f02ef3bc9c0 10 monclient: shutdown 2024-09-14T11:33:53.186 INFO:tasks.workunit.client.0.smithi138.stderr: -201> 2024-09-14T11:33:52.797+0000 7f02ef3bc9c0 10 monclient: build_initial_monmap 2024-09-14T11:33:53.186 INFO:tasks.workunit.client.0.smithi138.stderr: -200> 2024-09-14T11:33:52.797+0000 7f02ef3bc9c0 1 build_initial for_mkfs: 0 2024-09-14T11:33:53.186 INFO:tasks.workunit.client.0.smithi138.stderr: -199> 2024-09-14T11:33:52.797+0000 7f02ef3bc9c0 10 monclient: monmap: 2024-09-14T11:33:53.186 INFO:tasks.workunit.client.0.smithi138.stderr:epoch 0 2024-09-14T11:33:53.187 INFO:tasks.workunit.client.0.smithi138.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-14T11:33:53.187 INFO:tasks.workunit.client.0.smithi138.stderr:last_changed 0.000000 2024-09-14T11:33:53.187 INFO:tasks.workunit.client.0.smithi138.stderr:created 0.000000 2024-09-14T11:33:53.187 INFO:tasks.workunit.client.0.smithi138.stderr:min_mon_release 0 (unknown) 2024-09-14T11:33:53.187 INFO:tasks.workunit.client.0.smithi138.stderr:election_strategy: 1 2024-09-14T11:33:53.187 INFO:tasks.workunit.client.0.smithi138.stderr:0: [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] mon.noname-a 2024-09-14T11:33:53.187 INFO:tasks.workunit.client.0.smithi138.stderr:1: [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] mon.noname-b 2024-09-14T11:33:53.187 INFO:tasks.workunit.client.0.smithi138.stderr:2: [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] mon.noname-c 2024-09-14T11:33:53.187 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-14T11:33:53.187 INFO:tasks.workunit.client.0.smithi138.stderr: -198> 2024-09-14T11:33:52.797+0000 7f02ef3bc9c0 5 AuthRegistry(0x55cd75d70840) adding auth protocol: cephx 2024-09-14T11:33:53.187 INFO:tasks.workunit.client.0.smithi138.stderr: -197> 2024-09-14T11:33:52.797+0000 7f02ef3bc9c0 5 AuthRegistry(0x55cd75d70840) adding auth protocol: cephx 2024-09-14T11:33:53.187 INFO:tasks.workunit.client.0.smithi138.stderr: -196> 2024-09-14T11:33:52.797+0000 7f02ef3bc9c0 5 AuthRegistry(0x55cd75d70840) adding auth protocol: cephx 2024-09-14T11:33:53.187 INFO:tasks.workunit.client.0.smithi138.stderr: -195> 2024-09-14T11:33:52.797+0000 7f02ef3bc9c0 5 AuthRegistry(0x55cd75d70840) adding con mode: secure 2024-09-14T11:33:53.187 INFO:tasks.workunit.client.0.smithi138.stderr: -194> 2024-09-14T11:33:52.797+0000 7f02ef3bc9c0 5 AuthRegistry(0x55cd75d70840) adding con mode: crc 2024-09-14T11:33:53.188 INFO:tasks.workunit.client.0.smithi138.stderr: -193> 2024-09-14T11:33:52.797+0000 7f02ef3bc9c0 5 AuthRegistry(0x55cd75d70840) adding con mode: secure 2024-09-14T11:33:53.188 INFO:tasks.workunit.client.0.smithi138.stderr: -192> 2024-09-14T11:33:52.797+0000 7f02ef3bc9c0 5 AuthRegistry(0x55cd75d70840) adding con mode: crc 2024-09-14T11:33:53.188 INFO:tasks.workunit.client.0.smithi138.stderr: -191> 2024-09-14T11:33:52.797+0000 7f02ef3bc9c0 5 AuthRegistry(0x55cd75d70840) adding con mode: secure 2024-09-14T11:33:53.188 INFO:tasks.workunit.client.0.smithi138.stderr: -190> 2024-09-14T11:33:52.797+0000 7f02ef3bc9c0 5 AuthRegistry(0x55cd75d70840) adding con mode: crc 2024-09-14T11:33:53.188 INFO:tasks.workunit.client.0.smithi138.stderr: -189> 2024-09-14T11:33:52.797+0000 7f02ef3bc9c0 5 AuthRegistry(0x55cd75d70840) adding con mode: crc 2024-09-14T11:33:53.188 INFO:tasks.workunit.client.0.smithi138.stderr: -188> 2024-09-14T11:33:52.797+0000 7f02ef3bc9c0 5 AuthRegistry(0x55cd75d70840) adding con mode: secure 2024-09-14T11:33:53.188 INFO:tasks.workunit.client.0.smithi138.stderr: -187> 2024-09-14T11:33:52.797+0000 7f02ef3bc9c0 5 AuthRegistry(0x55cd75d70840) adding con mode: crc 2024-09-14T11:33:53.188 INFO:tasks.workunit.client.0.smithi138.stderr: -186> 2024-09-14T11:33:52.797+0000 7f02ef3bc9c0 5 AuthRegistry(0x55cd75d70840) adding con mode: secure 2024-09-14T11:33:53.188 INFO:tasks.workunit.client.0.smithi138.stderr: -185> 2024-09-14T11:33:52.797+0000 7f02ef3bc9c0 5 AuthRegistry(0x55cd75d70840) adding con mode: crc 2024-09-14T11:33:53.188 INFO:tasks.workunit.client.0.smithi138.stderr: -184> 2024-09-14T11:33:52.797+0000 7f02ef3bc9c0 5 AuthRegistry(0x55cd75d70840) adding con mode: secure 2024-09-14T11:33:53.188 INFO:tasks.workunit.client.0.smithi138.stderr: -183> 2024-09-14T11:33:52.797+0000 7f02ef3bc9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:33:53.188 INFO:tasks.workunit.client.0.smithi138.stderr: -182> 2024-09-14T11:33:52.797+0000 7f02ef3bc9c0 1 librados: starting msgr at 2024-09-14T11:33:53.188 INFO:tasks.workunit.client.0.smithi138.stderr: -181> 2024-09-14T11:33:52.797+0000 7f02ef3bc9c0 1 librados: starting objecter 2024-09-14T11:33:53.188 INFO:tasks.workunit.client.0.smithi138.stderr: -180> 2024-09-14T11:33:52.797+0000 7f02ef3bc9c0 5 asok(0x55cd75aa1d90) register_command objecter_requests cmddesc objecter_requests hook 0x55cd75d31b00 EEXIST 2024-09-14T11:33:53.188 INFO:tasks.workunit.client.0.smithi138.stderr: -179> 2024-09-14T11:33:52.797+0000 7f02ef3bc9c0 1 librados: setting wanted keys 2024-09-14T11:33:53.189 INFO:tasks.workunit.client.0.smithi138.stderr: -178> 2024-09-14T11:33:52.797+0000 7f02ef3bc9c0 1 librados: calling monclient init 2024-09-14T11:33:53.189 INFO:tasks.workunit.client.0.smithi138.stderr: -177> 2024-09-14T11:33:52.797+0000 7f02ef3bc9c0 10 monclient: init 2024-09-14T11:33:53.189 INFO:tasks.workunit.client.0.smithi138.stderr: -176> 2024-09-14T11:33:52.797+0000 7f02ef3bc9c0 5 AuthRegistry(0x55cd75d2dde0) adding auth protocol: cephx 2024-09-14T11:33:53.189 INFO:tasks.workunit.client.0.smithi138.stderr: -175> 2024-09-14T11:33:52.797+0000 7f02ef3bc9c0 5 AuthRegistry(0x55cd75d2dde0) adding auth protocol: cephx 2024-09-14T11:33:53.189 INFO:tasks.workunit.client.0.smithi138.stderr: -174> 2024-09-14T11:33:52.797+0000 7f02ef3bc9c0 5 AuthRegistry(0x55cd75d2dde0) adding auth protocol: cephx 2024-09-14T11:33:53.189 INFO:tasks.workunit.client.0.smithi138.stderr: -173> 2024-09-14T11:33:52.797+0000 7f02ef3bc9c0 5 AuthRegistry(0x55cd75d2dde0) adding con mode: secure 2024-09-14T11:33:53.189 INFO:tasks.workunit.client.0.smithi138.stderr: -172> 2024-09-14T11:33:52.797+0000 7f02ef3bc9c0 5 AuthRegistry(0x55cd75d2dde0) adding con mode: crc 2024-09-14T11:33:53.189 INFO:tasks.workunit.client.0.smithi138.stderr: -171> 2024-09-14T11:33:52.797+0000 7f02ef3bc9c0 5 AuthRegistry(0x55cd75d2dde0) adding con mode: secure 2024-09-14T11:33:53.189 INFO:tasks.workunit.client.0.smithi138.stderr: -170> 2024-09-14T11:33:52.797+0000 7f02ef3bc9c0 5 AuthRegistry(0x55cd75d2dde0) adding con mode: crc 2024-09-14T11:33:53.189 INFO:tasks.workunit.client.0.smithi138.stderr: -169> 2024-09-14T11:33:52.797+0000 7f02ef3bc9c0 5 AuthRegistry(0x55cd75d2dde0) adding con mode: secure 2024-09-14T11:33:53.189 INFO:tasks.workunit.client.0.smithi138.stderr: -168> 2024-09-14T11:33:52.797+0000 7f02ef3bc9c0 5 AuthRegistry(0x55cd75d2dde0) adding con mode: crc 2024-09-14T11:33:53.189 INFO:tasks.workunit.client.0.smithi138.stderr: -167> 2024-09-14T11:33:52.797+0000 7f02ef3bc9c0 5 AuthRegistry(0x55cd75d2dde0) adding con mode: crc 2024-09-14T11:33:53.189 INFO:tasks.workunit.client.0.smithi138.stderr: -166> 2024-09-14T11:33:52.797+0000 7f02ef3bc9c0 5 AuthRegistry(0x55cd75d2dde0) adding con mode: secure 2024-09-14T11:33:53.189 INFO:tasks.workunit.client.0.smithi138.stderr: -165> 2024-09-14T11:33:52.797+0000 7f02ef3bc9c0 5 AuthRegistry(0x55cd75d2dde0) adding con mode: crc 2024-09-14T11:33:53.189 INFO:tasks.workunit.client.0.smithi138.stderr: -164> 2024-09-14T11:33:52.797+0000 7f02ef3bc9c0 5 AuthRegistry(0x55cd75d2dde0) adding con mode: secure 2024-09-14T11:33:53.190 INFO:tasks.workunit.client.0.smithi138.stderr: -163> 2024-09-14T11:33:52.797+0000 7f02ef3bc9c0 5 AuthRegistry(0x55cd75d2dde0) adding con mode: crc 2024-09-14T11:33:53.190 INFO:tasks.workunit.client.0.smithi138.stderr: -162> 2024-09-14T11:33:52.797+0000 7f02ef3bc9c0 5 AuthRegistry(0x55cd75d2dde0) adding con mode: secure 2024-09-14T11:33:53.190 INFO:tasks.workunit.client.0.smithi138.stderr: -161> 2024-09-14T11:33:52.797+0000 7f02ef3bc9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:33:53.190 INFO:tasks.workunit.client.0.smithi138.stderr: -160> 2024-09-14T11:33:52.797+0000 7f02ef3bc9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:33:53.190 INFO:tasks.workunit.client.0.smithi138.stderr: -159> 2024-09-14T11:33:52.797+0000 7f02ef3bc9c0 5 asok(0x55cd75aa1d90) register_command rotate-key cmddesc rotate-key hook 0x55cd75d2df28 EEXIST 2024-09-14T11:33:53.190 INFO:tasks.workunit.client.0.smithi138.stderr: -158> 2024-09-14T11:33:52.797+0000 7f02ef3bc9c0 10 monclient: _reopen_session rank -1 2024-09-14T11:33:53.190 INFO:tasks.workunit.client.0.smithi138.stderr: -157> 2024-09-14T11:33:52.797+0000 7f02ef3bc9c0 10 monclient: _add_conns ranks=[1,2,0] 2024-09-14T11:33:53.190 INFO:tasks.workunit.client.0.smithi138.stderr: -156> 2024-09-14T11:33:52.797+0000 7f02ef3bc9c0 10 monclient(hunting): picked mon.noname-b con 0x55cd75d4f840 addr [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] 2024-09-14T11:33:53.190 INFO:tasks.workunit.client.0.smithi138.stderr: -155> 2024-09-14T11:33:52.797+0000 7f02ef3bc9c0 10 monclient(hunting): picked mon.noname-c con 0x55cd75d7b5f0 addr [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] 2024-09-14T11:33:53.190 INFO:tasks.workunit.client.0.smithi138.stderr: -154> 2024-09-14T11:33:52.797+0000 7f02ef3bc9c0 10 monclient(hunting): picked mon.noname-a con 0x55cd75d7fe20 addr [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] 2024-09-14T11:33:53.190 INFO:tasks.workunit.client.0.smithi138.stderr: -153> 2024-09-14T11:33:52.797+0000 7f02ef3bc9c0 10 monclient(hunting): start opening mon connection 2024-09-14T11:33:53.190 INFO:tasks.workunit.client.0.smithi138.stderr: -152> 2024-09-14T11:33:52.797+0000 7f02ef3bc9c0 10 monclient(hunting): start opening mon connection 2024-09-14T11:33:53.190 INFO:tasks.workunit.client.0.smithi138.stderr: -151> 2024-09-14T11:33:52.797+0000 7f02ef3bc9c0 10 monclient(hunting): start opening mon connection 2024-09-14T11:33:53.190 INFO:tasks.workunit.client.0.smithi138.stderr: -150> 2024-09-14T11:33:52.797+0000 7f02ef3bc9c0 10 monclient(hunting): _renew_subs 2024-09-14T11:33:53.191 INFO:tasks.workunit.client.0.smithi138.stderr: -149> 2024-09-14T11:33:52.797+0000 7f02ef3bc9c0 10 monclient(hunting): authenticate will time out at 2568.761097s 2024-09-14T11:33:53.191 INFO:tasks.workunit.client.0.smithi138.stderr: -148> 2024-09-14T11:33:52.797+0000 7f02ed6c3640 10 monclient(hunting): get_auth_request con 0x55cd75d7b5f0 auth_method 0 2024-09-14T11:33:53.191 INFO:tasks.workunit.client.0.smithi138.stderr: -147> 2024-09-14T11:33:52.797+0000 7f02ed6c3640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:33:53.191 INFO:tasks.workunit.client.0.smithi138.stderr: -146> 2024-09-14T11:33:52.797+0000 7f02ed6c3640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:33:53.191 INFO:tasks.workunit.client.0.smithi138.stderr: -145> 2024-09-14T11:33:52.797+0000 7f02ed6c3640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:33:53.191 INFO:tasks.workunit.client.0.smithi138.stderr: -144> 2024-09-14T11:33:52.797+0000 7f02ecec2640 10 monclient(hunting): get_auth_request con 0x55cd75d7fe20 auth_method 0 2024-09-14T11:33:53.191 INFO:tasks.workunit.client.0.smithi138.stderr: -143> 2024-09-14T11:33:52.797+0000 7f02ecec2640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:33:53.191 INFO:tasks.workunit.client.0.smithi138.stderr: -142> 2024-09-14T11:33:52.797+0000 7f02ecec2640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:33:53.191 INFO:tasks.workunit.client.0.smithi138.stderr: -141> 2024-09-14T11:33:52.797+0000 7f02ecec2640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:33:53.191 INFO:tasks.workunit.client.0.smithi138.stderr: -140> 2024-09-14T11:33:52.797+0000 7f02ed6c3640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:33:53.191 INFO:tasks.workunit.client.0.smithi138.stderr: -139> 2024-09-14T11:33:52.797+0000 7f02ed6c3640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:33:53.191 INFO:tasks.workunit.client.0.smithi138.stderr: -138> 2024-09-14T11:33:52.797+0000 7f02ed6c3640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:33:53.191 INFO:tasks.workunit.client.0.smithi138.stderr: -137> 2024-09-14T11:33:52.797+0000 7f02ecec2640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:33:53.191 INFO:tasks.workunit.client.0.smithi138.stderr: -136> 2024-09-14T11:33:52.797+0000 7f02ecec2640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:33:53.192 INFO:tasks.workunit.client.0.smithi138.stderr: -135> 2024-09-14T11:33:52.797+0000 7f02ecec2640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:33:53.192 INFO:tasks.workunit.client.0.smithi138.stderr: -134> 2024-09-14T11:33:52.797+0000 7f02ed6c3640 10 monclient(hunting): handle_auth_done global_id 5906 payload 824 2024-09-14T11:33:53.192 INFO:tasks.workunit.client.0.smithi138.stderr: -133> 2024-09-14T11:33:52.797+0000 7f02ed6c3640 10 monclient: _finish_hunting 0 2024-09-14T11:33:53.192 INFO:tasks.workunit.client.0.smithi138.stderr: -132> 2024-09-14T11:33:52.797+0000 7f02ed6c3640 1 monclient: found mon.noname-c 2024-09-14T11:33:53.192 INFO:tasks.workunit.client.0.smithi138.stderr: -131> 2024-09-14T11:33:52.797+0000 7f02ed6c3640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.138:3301/0 2024-09-14T11:33:53.192 INFO:tasks.workunit.client.0.smithi138.stderr: -130> 2024-09-14T11:33:52.797+0000 7f01c27fc640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:33:53.192 INFO:tasks.workunit.client.0.smithi138.stderr: -129> 2024-09-14T11:33:52.797+0000 7f01c27fc640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-14T11:33:53.192 INFO:tasks.workunit.client.0.smithi138.stderr: -128> 2024-09-14T11:33:52.797+0000 7f01c27fc640 10 monclient: dump: 2024-09-14T11:33:53.192 INFO:tasks.workunit.client.0.smithi138.stderr:epoch 1 2024-09-14T11:33:53.192 INFO:tasks.workunit.client.0.smithi138.stderr:fsid 3f225f43-83a6-4aeb-b798-1f04bb49d597 2024-09-14T11:33:53.192 INFO:tasks.workunit.client.0.smithi138.stderr:last_changed 2024-09-14T11:07:09.252780+0000 2024-09-14T11:33:53.192 INFO:tasks.workunit.client.0.smithi138.stderr:created 2024-09-14T11:07:09.252780+0000 2024-09-14T11:33:53.193 INFO:tasks.workunit.client.0.smithi138.stderr:min_mon_release 19 (squid) 2024-09-14T11:33:53.193 INFO:tasks.workunit.client.0.smithi138.stderr:election_strategy: 1 2024-09-14T11:33:53.193 INFO:tasks.workunit.client.0.smithi138.stderr:0: [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] mon.a 2024-09-14T11:33:53.193 INFO:tasks.workunit.client.0.smithi138.stderr:1: [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] mon.b 2024-09-14T11:33:53.193 INFO:tasks.workunit.client.0.smithi138.stderr:2: [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] mon.c 2024-09-14T11:33:53.193 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-14T11:33:53.193 INFO:tasks.workunit.client.0.smithi138.stderr: -127> 2024-09-14T11:33:52.797+0000 7f01c27fc640 10 monclient: _finish_auth 0 2024-09-14T11:33:53.193 INFO:tasks.workunit.client.0.smithi138.stderr: -126> 2024-09-14T11:33:52.797+0000 7f01c27fc640 10 monclient: _check_auth_tickets 2024-09-14T11:33:53.193 INFO:tasks.workunit.client.0.smithi138.stderr: -125> 2024-09-14T11:33:52.797+0000 7f02ef3bc9c0 5 monclient: authenticate success, global_id 5906 2024-09-14T11:33:53.193 INFO:tasks.workunit.client.0.smithi138.stderr: -124> 2024-09-14T11:33:52.797+0000 7f02ef3bc9c0 10 monclient: _renew_subs 2024-09-14T11:33:53.193 INFO:tasks.workunit.client.0.smithi138.stderr: -123> 2024-09-14T11:33:52.797+0000 7f02ef3bc9c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.138:3301/0 2024-09-14T11:33:53.193 INFO:tasks.workunit.client.0.smithi138.stderr: -122> 2024-09-14T11:33:52.797+0000 7f01c27fc640 10 monclient: handle_config config(0 keys) 2024-09-14T11:33:53.193 INFO:tasks.workunit.client.0.smithi138.stderr: -121> 2024-09-14T11:33:52.797+0000 7f01c27fc640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:33:53.194 INFO:tasks.workunit.client.0.smithi138.stderr: -120> 2024-09-14T11:33:52.797+0000 7f01c27fc640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-14T11:33:53.194 INFO:tasks.workunit.client.0.smithi138.stderr: -119> 2024-09-14T11:33:52.797+0000 7f01c27fc640 10 monclient: dump: 2024-09-14T11:33:53.194 INFO:tasks.workunit.client.0.smithi138.stderr:epoch 1 2024-09-14T11:33:53.194 INFO:tasks.workunit.client.0.smithi138.stderr:fsid 3f225f43-83a6-4aeb-b798-1f04bb49d597 2024-09-14T11:33:53.194 INFO:tasks.workunit.client.0.smithi138.stderr:last_changed 2024-09-14T11:07:09.252780+0000 2024-09-14T11:33:53.194 INFO:tasks.workunit.client.0.smithi138.stderr:created 2024-09-14T11:07:09.252780+0000 2024-09-14T11:33:53.194 INFO:tasks.workunit.client.0.smithi138.stderr:min_mon_release 19 (squid) 2024-09-14T11:33:53.194 INFO:tasks.workunit.client.0.smithi138.stderr:election_strategy: 1 2024-09-14T11:33:53.194 INFO:tasks.workunit.client.0.smithi138.stderr:0: [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] mon.a 2024-09-14T11:33:53.194 INFO:tasks.workunit.client.0.smithi138.stderr:1: [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] mon.b 2024-09-14T11:33:53.194 INFO:tasks.workunit.client.0.smithi138.stderr:2: [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] mon.c 2024-09-14T11:33:53.194 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-14T11:33:53.194 INFO:tasks.workunit.client.0.smithi138.stderr: -118> 2024-09-14T11:33:52.797+0000 7f01c3fff640 4 set_mon_vals no callback set 2024-09-14T11:33:53.194 INFO:tasks.workunit.client.0.smithi138.stderr: -117> 2024-09-14T11:33:52.797+0000 7f02ef3bc9c0 10 monclient: _renew_subs 2024-09-14T11:33:53.194 INFO:tasks.workunit.client.0.smithi138.stderr: -116> 2024-09-14T11:33:52.797+0000 7f02ef3bc9c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.138:3301/0 2024-09-14T11:33:53.195 INFO:tasks.workunit.client.0.smithi138.stderr: -115> 2024-09-14T11:33:52.797+0000 7f02ef3bc9c0 1 librados: init done 2024-09-14T11:33:53.195 INFO:tasks.workunit.client.0.smithi138.stderr: -114> 2024-09-14T11:33:52.797+0000 7f02ef3bc9c0 5 asok(0x55cd75aa1d90) register_command cr dump hook 0x55cd75d72d98 2024-09-14T11:33:53.195 INFO:tasks.workunit.client.0.smithi138.stderr: -113> 2024-09-14T11:33:52.797+0000 7f02ef3bc9c0 20 rados->read ofs=0 len=0 2024-09-14T11:33:53.195 INFO:tasks.workunit.client.0.smithi138.stderr: -112> 2024-09-14T11:33:52.801+0000 7f01c27fc640 4 mgrc handle_mgr_map Got map version 5 2024-09-14T11:33:53.195 INFO:tasks.workunit.client.0.smithi138.stderr: -111> 2024-09-14T11:33:52.801+0000 7f01c27fc640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.138:6832/3778043143,v1:172.21.15.138:6833/3778043143] 2024-09-14T11:33:53.195 INFO:tasks.workunit.client.0.smithi138.stderr: -110> 2024-09-14T11:33:52.801+0000 7f01c27fc640 4 mgrc reconnect Starting new session with [v2:172.21.15.138:6832/3778043143,v1:172.21.15.138:6833/3778043143] 2024-09-14T11:33:53.195 INFO:tasks.workunit.client.0.smithi138.stderr: -109> 2024-09-14T11:33:52.801+0000 7f02ec6c1640 10 monclient: get_auth_request con 0x7f01b80718d0 auth_method 0 2024-09-14T11:33:53.195 INFO:tasks.workunit.client.0.smithi138.stderr: -108> 2024-09-14T11:33:52.801+0000 7f02ecec2640 10 monclient: get_auth_request con 0x55cd75d9a140 auth_method 0 2024-09-14T11:33:53.195 INFO:tasks.workunit.client.0.smithi138.stderr: -107> 2024-09-14T11:33:52.801+0000 7f02ef3bc9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:33:53.195 INFO:tasks.workunit.client.0.smithi138.stderr: -106> 2024-09-14T11:33:52.801+0000 7f02ef3bc9c0 20 realm 2024-09-14T11:33:53.195 INFO:tasks.workunit.client.0.smithi138.stderr: -105> 2024-09-14T11:33:52.801+0000 7f02ef3bc9c0 20 rados->read ofs=0 len=0 2024-09-14T11:33:53.195 INFO:tasks.workunit.client.0.smithi138.stderr: -104> 2024-09-14T11:33:52.801+0000 7f02ef3bc9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:33:53.195 INFO:tasks.workunit.client.0.smithi138.stderr: -103> 2024-09-14T11:33:52.801+0000 7f02ef3bc9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:33:53.195 INFO:tasks.workunit.client.0.smithi138.stderr: -102> 2024-09-14T11:33:52.801+0000 7f02ef3bc9c0 20 rados->read ofs=0 len=0 2024-09-14T11:33:53.196 INFO:tasks.workunit.client.0.smithi138.stderr: -101> 2024-09-14T11:33:52.801+0000 7f02ef3bc9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:33:53.196 INFO:tasks.workunit.client.0.smithi138.stderr: -100> 2024-09-14T11:33:52.801+0000 7f02ef3bc9c0 20 rados->read ofs=0 len=0 2024-09-14T11:33:53.196 INFO:tasks.workunit.client.0.smithi138.stderr: -99> 2024-09-14T11:33:52.801+0000 7f02ec6c1640 10 monclient: get_auth_request con 0x55cd75d9e2a0 auth_method 0 2024-09-14T11:33:53.196 INFO:tasks.workunit.client.0.smithi138.stderr: -98> 2024-09-14T11:33:52.801+0000 7f02ef3bc9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:33:53.196 INFO:tasks.workunit.client.0.smithi138.stderr: -97> 2024-09-14T11:33:52.801+0000 7f02ef3bc9c0 20 rados->read ofs=0 len=0 2024-09-14T11:33:53.196 INFO:tasks.workunit.client.0.smithi138.stderr: -96> 2024-09-14T11:33:52.801+0000 7f02ed6c3640 10 monclient: get_auth_request con 0x55cd75da1b00 auth_method 0 2024-09-14T11:33:53.196 INFO:tasks.workunit.client.0.smithi138.stderr: -95> 2024-09-14T11:33:52.805+0000 7f02ef3bc9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:33:53.196 INFO:tasks.workunit.client.0.smithi138.stderr: -94> 2024-09-14T11:33:52.805+0000 7f02ef3bc9c0 20 searching for the correct realm 2024-09-14T11:33:53.196 INFO:tasks.workunit.client.0.smithi138.stderr: -93> 2024-09-14T11:33:52.805+0000 7f02ecec2640 10 monclient: get_auth_request con 0x55cd75da6880 auth_method 0 2024-09-14T11:33:53.196 INFO:tasks.workunit.client.0.smithi138.stderr: -92> 2024-09-14T11:33:52.805+0000 7f02ec6c1640 10 monclient: get_auth_request con 0x7f02dc027040 auth_method 0 2024-09-14T11:33:53.196 INFO:tasks.workunit.client.0.smithi138.stderr: -91> 2024-09-14T11:33:52.805+0000 7f02ed6c3640 10 monclient: get_auth_request con 0x7f02e4064cb0 auth_method 0 2024-09-14T11:33:53.196 INFO:tasks.workunit.client.0.smithi138.stderr: -90> 2024-09-14T11:33:52.809+0000 7f02ed6c3640 0 -- 172.21.15.138:0/2461216839 >> [v2:172.21.15.154:6824/416768175,v1:172.21.15.154:6825/416768175] conn(0x7f02e4064cb0 msgr2=0x7f02e4063720 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:33:53.196 INFO:tasks.workunit.client.0.smithi138.stderr: -89> 2024-09-14T11:33:52.809+0000 7f01c27fc640 1 client.5906.objecter ms_handle_reset 0x7f02e4064cb0 session 0x7f02e4016040 osd.4 2024-09-14T11:33:53.197 INFO:tasks.workunit.client.0.smithi138.stderr: -88> 2024-09-14T11:33:52.809+0000 7f01c27fc640 10 monclient: _renew_subs 2024-09-14T11:33:53.197 INFO:tasks.workunit.client.0.smithi138.stderr: -87> 2024-09-14T11:33:52.809+0000 7f01c27fc640 10 monclient: _send_mon_message to mon.c at v2:172.21.15.138:3301/0 2024-09-14T11:33:53.197 INFO:tasks.workunit.client.0.smithi138.stderr: -86> 2024-09-14T11:33:52.809+0000 7f02ed6c3640 10 monclient: get_auth_request con 0x7f01b8082000 auth_method 0 2024-09-14T11:33:53.197 INFO:tasks.workunit.client.0.smithi138.stderr: -85> 2024-09-14T11:33:52.809+0000 7f02ecec2640 10 monclient: get_auth_request con 0x7f02e406df50 auth_method 0 2024-09-14T11:33:53.197 INFO:tasks.workunit.client.0.smithi138.stderr: -84> 2024-09-14T11:33:52.813+0000 7f02ec6c1640 10 monclient: get_auth_request con 0x7f02e407a9d0 auth_method 0 2024-09-14T11:33:53.197 INFO:tasks.workunit.client.0.smithi138.stderr: -83> 2024-09-14T11:33:52.813+0000 7f02ec6c1640 0 -- 172.21.15.138:0/2461216839 >> [v2:172.21.15.138:6816/326481658,v1:172.21.15.138:6817/326481658] conn(0x7f02e407a9d0 msgr2=0x7f02e4087850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-14T11:33:53.197 INFO:tasks.workunit.client.0.smithi138.stderr: -82> 2024-09-14T11:33:53.017+0000 7f02ec6c1640 10 monclient: get_auth_request con 0x7f02e407a9d0 auth_method 0 2024-09-14T11:33:53.197 INFO:tasks.workunit.client.0.smithi138.stderr: -81> 2024-09-14T11:33:53.029+0000 7f02ef3bc9c0 20 RGWRados::pool_iterate: got zone_info.d9e72d30-c60b-4d0d-9267-fdc36392d5ad 2024-09-14T11:33:53.197 INFO:tasks.workunit.client.0.smithi138.stderr: -80> 2024-09-14T11:33:53.029+0000 7f02ef3bc9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:33:53.197 INFO:tasks.workunit.client.0.smithi138.stderr: -79> 2024-09-14T11:33:53.029+0000 7f02ef3bc9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:33:53.197 INFO:tasks.workunit.client.0.smithi138.stderr: -78> 2024-09-14T11:33:53.029+0000 7f02ef3bc9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:33:53.198 INFO:tasks.workunit.client.0.smithi138.stderr: -77> 2024-09-14T11:33:53.029+0000 7f02ef3bc9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:33:53.198 INFO:tasks.workunit.client.0.smithi138.stderr: -76> 2024-09-14T11:33:53.029+0000 7f02ef3bc9c0 20 RGWRados::pool_iterate: got zonegroup_info.65ab941b-da8c-4160-94fb-3672b069d44f 2024-09-14T11:33:53.198 INFO:tasks.workunit.client.0.smithi138.stderr: -75> 2024-09-14T11:33:53.029+0000 7f02ef3bc9c0 20 rados->read ofs=0 len=0 2024-09-14T11:33:53.198 INFO:tasks.workunit.client.0.smithi138.stderr: -74> 2024-09-14T11:33:53.029+0000 7f02ef3bc9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:33:53.198 INFO:tasks.workunit.client.0.smithi138.stderr: -73> 2024-09-14T11:33:53.029+0000 7f02ef3bc9c0 20 rados->read ofs=0 len=0 2024-09-14T11:33:53.198 INFO:tasks.workunit.client.0.smithi138.stderr: -72> 2024-09-14T11:33:53.029+0000 7f02ef3bc9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:33:53.198 INFO:tasks.workunit.client.0.smithi138.stderr: -71> 2024-09-14T11:33:53.029+0000 7f02ef3bc9c0 20 rados->read ofs=0 len=0 2024-09-14T11:33:53.198 INFO:tasks.workunit.client.0.smithi138.stderr: -70> 2024-09-14T11:33:53.029+0000 7f02ef3bc9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:33:53.198 INFO:tasks.workunit.client.0.smithi138.stderr: -69> 2024-09-14T11:33:53.029+0000 7f02ef3bc9c0 20 zone default found 2024-09-14T11:33:53.198 INFO:tasks.workunit.client.0.smithi138.stderr: -68> 2024-09-14T11:33:53.029+0000 7f02ef3bc9c0 4 Realm: () 2024-09-14T11:33:53.198 INFO:tasks.workunit.client.0.smithi138.stderr: -67> 2024-09-14T11:33:53.029+0000 7f02ef3bc9c0 4 ZoneGroup: default (65ab941b-da8c-4160-94fb-3672b069d44f) 2024-09-14T11:33:53.198 INFO:tasks.workunit.client.0.smithi138.stderr: -66> 2024-09-14T11:33:53.029+0000 7f02ef3bc9c0 4 Zone: default (d9e72d30-c60b-4d0d-9267-fdc36392d5ad) 2024-09-14T11:33:53.198 INFO:tasks.workunit.client.0.smithi138.stderr: -65> 2024-09-14T11:33:53.029+0000 7f02ef3bc9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:33:53.198 INFO:tasks.workunit.client.0.smithi138.stderr: -64> 2024-09-14T11:33:53.029+0000 7f02ef3bc9c0 20 zonegroup default 2024-09-14T11:33:53.198 INFO:tasks.workunit.client.0.smithi138.stderr: -63> 2024-09-14T11:33:53.029+0000 7f02ef3bc9c0 20 rados->read ofs=0 len=0 2024-09-14T11:33:53.199 INFO:tasks.workunit.client.0.smithi138.stderr: -62> 2024-09-14T11:33:53.033+0000 7f02ef3bc9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:33:53.199 INFO:tasks.workunit.client.0.smithi138.stderr: -61> 2024-09-14T11:33:53.033+0000 7f02ef3bc9c0 20 rados->read ofs=0 len=0 2024-09-14T11:33:53.199 INFO:tasks.workunit.client.0.smithi138.stderr: -60> 2024-09-14T11:33:53.033+0000 7f02ef3bc9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:33:53.199 INFO:tasks.workunit.client.0.smithi138.stderr: -59> 2024-09-14T11:33:53.033+0000 7f02ef3bc9c0 20 rados->read ofs=0 len=0 2024-09-14T11:33:53.199 INFO:tasks.workunit.client.0.smithi138.stderr: -58> 2024-09-14T11:33:53.033+0000 7f02ef3bc9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:33:53.199 INFO:tasks.workunit.client.0.smithi138.stderr: -57> 2024-09-14T11:33:53.033+0000 7f02ef3bc9c0 20 started sync module instance, tier type = 2024-09-14T11:33:53.199 INFO:tasks.workunit.client.0.smithi138.stderr: -56> 2024-09-14T11:33:53.033+0000 7f02ef3bc9c0 20 started zone id=d9e72d30-c60b-4d0d-9267-fdc36392d5ad (name=default) with tier type = 2024-09-14T11:33:53.199 INFO:tasks.workunit.client.0.smithi138.stderr: -55> 2024-09-14T11:33:53.057+0000 7f02ef3bc9c0 20 add_watcher() i=0 2024-09-14T11:33:53.199 INFO:tasks.workunit.client.0.smithi138.stderr: -54> 2024-09-14T11:33:53.057+0000 7f02ef3bc9c0 20 add_watcher() i=1 2024-09-14T11:33:53.199 INFO:tasks.workunit.client.0.smithi138.stderr: -53> 2024-09-14T11:33:53.057+0000 7f02ef3bc9c0 20 add_watcher() i=2 2024-09-14T11:33:53.199 INFO:tasks.workunit.client.0.smithi138.stderr: -52> 2024-09-14T11:33:53.057+0000 7f02ef3bc9c0 20 add_watcher() i=3 2024-09-14T11:33:53.199 INFO:tasks.workunit.client.0.smithi138.stderr: -51> 2024-09-14T11:33:53.057+0000 7f02ef3bc9c0 20 add_watcher() i=4 2024-09-14T11:33:53.199 INFO:tasks.workunit.client.0.smithi138.stderr: -50> 2024-09-14T11:33:53.057+0000 7f02ef3bc9c0 20 add_watcher() i=5 2024-09-14T11:33:53.199 INFO:tasks.workunit.client.0.smithi138.stderr: -49> 2024-09-14T11:33:53.057+0000 7f02ef3bc9c0 20 add_watcher() i=6 2024-09-14T11:33:53.199 INFO:tasks.workunit.client.0.smithi138.stderr: -48> 2024-09-14T11:33:53.061+0000 7f02ef3bc9c0 20 add_watcher() i=7 2024-09-14T11:33:53.200 INFO:tasks.workunit.client.0.smithi138.stderr: -47> 2024-09-14T11:33:53.061+0000 7f02ef3bc9c0 2 all 8 watchers are set, enabling cache 2024-09-14T11:33:53.200 INFO:tasks.workunit.client.0.smithi138.stderr: -46> 2024-09-14T11:33:53.065+0000 7f02ef3bc9c0 5 AuthRegistry(0x7ffd2b80a640) adding auth protocol: cephx 2024-09-14T11:33:53.200 INFO:tasks.workunit.client.0.smithi138.stderr: -45> 2024-09-14T11:33:53.065+0000 7f02ef3bc9c0 5 AuthRegistry(0x7ffd2b80a640) adding auth protocol: cephx 2024-09-14T11:33:53.200 INFO:tasks.workunit.client.0.smithi138.stderr: -44> 2024-09-14T11:33:53.065+0000 7f02ef3bc9c0 5 AuthRegistry(0x7ffd2b80a640) adding auth protocol: cephx 2024-09-14T11:33:53.200 INFO:tasks.workunit.client.0.smithi138.stderr: -43> 2024-09-14T11:33:53.065+0000 7f02ef3bc9c0 5 AuthRegistry(0x7ffd2b80a640) adding con mode: secure 2024-09-14T11:33:53.200 INFO:tasks.workunit.client.0.smithi138.stderr: -42> 2024-09-14T11:33:53.065+0000 7f02ef3bc9c0 5 AuthRegistry(0x7ffd2b80a640) adding con mode: crc 2024-09-14T11:33:53.200 INFO:tasks.workunit.client.0.smithi138.stderr: -41> 2024-09-14T11:33:53.065+0000 7f02ef3bc9c0 5 AuthRegistry(0x7ffd2b80a640) adding con mode: secure 2024-09-14T11:33:53.200 INFO:tasks.workunit.client.0.smithi138.stderr: -40> 2024-09-14T11:33:53.065+0000 7f02ef3bc9c0 5 AuthRegistry(0x7ffd2b80a640) adding con mode: crc 2024-09-14T11:33:53.200 INFO:tasks.workunit.client.0.smithi138.stderr: -39> 2024-09-14T11:33:53.065+0000 7f02ef3bc9c0 5 AuthRegistry(0x7ffd2b80a640) adding con mode: secure 2024-09-14T11:33:53.200 INFO:tasks.workunit.client.0.smithi138.stderr: -38> 2024-09-14T11:33:53.065+0000 7f02ef3bc9c0 5 AuthRegistry(0x7ffd2b80a640) adding con mode: crc 2024-09-14T11:33:53.200 INFO:tasks.workunit.client.0.smithi138.stderr: -37> 2024-09-14T11:33:53.065+0000 7f02ef3bc9c0 5 AuthRegistry(0x7ffd2b80a640) adding con mode: crc 2024-09-14T11:33:53.200 INFO:tasks.workunit.client.0.smithi138.stderr: -36> 2024-09-14T11:33:53.065+0000 7f02ef3bc9c0 5 AuthRegistry(0x7ffd2b80a640) adding con mode: secure 2024-09-14T11:33:53.200 INFO:tasks.workunit.client.0.smithi138.stderr: -35> 2024-09-14T11:33:53.065+0000 7f02ef3bc9c0 5 AuthRegistry(0x7ffd2b80a640) adding con mode: crc 2024-09-14T11:33:53.200 INFO:tasks.workunit.client.0.smithi138.stderr: -34> 2024-09-14T11:33:53.065+0000 7f02ef3bc9c0 5 AuthRegistry(0x7ffd2b80a640) adding con mode: secure 2024-09-14T11:33:53.201 INFO:tasks.workunit.client.0.smithi138.stderr: -33> 2024-09-14T11:33:53.065+0000 7f02ef3bc9c0 5 AuthRegistry(0x7ffd2b80a640) adding con mode: crc 2024-09-14T11:33:53.201 INFO:tasks.workunit.client.0.smithi138.stderr: -32> 2024-09-14T11:33:53.065+0000 7f02ef3bc9c0 5 AuthRegistry(0x7ffd2b80a640) adding con mode: secure 2024-09-14T11:33:53.201 INFO:tasks.workunit.client.0.smithi138.stderr: -31> 2024-09-14T11:33:53.065+0000 7f01a2fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:33:53.201 INFO:tasks.workunit.client.0.smithi138.stderr: -30> 2024-09-14T11:33:53.065+0000 7f02ef3bc9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:33:53.201 INFO:tasks.workunit.client.0.smithi138.stderr: -29> 2024-09-14T11:33:53.065+0000 7f02ef3bc9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:33:53.201 INFO:tasks.workunit.client.0.smithi138.stderr: -28> 2024-09-14T11:33:53.065+0000 7f02ef3bc9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:33:53.201 INFO:tasks.workunit.client.0.smithi138.stderr: -27> 2024-09-14T11:33:53.065+0000 7f02ef3bc9c0 5 asok(0x55cd75aa1d90) register_command cache list hook 0x55cd75d74670 2024-09-14T11:33:53.201 INFO:tasks.workunit.client.0.smithi138.stderr: -26> 2024-09-14T11:33:53.065+0000 7f02ef3bc9c0 5 asok(0x55cd75aa1d90) register_command cache inspect hook 0x55cd75d74670 2024-09-14T11:33:53.201 INFO:tasks.workunit.client.0.smithi138.stderr: -25> 2024-09-14T11:33:53.065+0000 7f02ef3bc9c0 5 asok(0x55cd75aa1d90) register_command cache erase hook 0x55cd75d74670 2024-09-14T11:33:53.201 INFO:tasks.workunit.client.0.smithi138.stderr: -24> 2024-09-14T11:33:53.065+0000 7f02ef3bc9c0 5 asok(0x55cd75aa1d90) register_command cache zap hook 0x55cd75d74670 2024-09-14T11:33:53.201 INFO:tasks.workunit.client.0.smithi138.stderr: -23> 2024-09-14T11:33:53.065+0000 7f02ef3bc9c0 5 note: GC not initialized 2024-09-14T11:33:53.201 INFO:tasks.workunit.client.0.smithi138.stderr: -22> 2024-09-14T11:33:53.065+0000 7f01a1fe3640 20 reqs_thread_entry: start 2024-09-14T11:33:53.202 INFO:tasks.workunit.client.0.smithi138.stderr: -21> 2024-09-14T11:33:53.065+0000 7f02ef3bc9c0 5 asok(0x55cd75aa1d90) register_command sync trace show hook 0x7f02dc02b030 2024-09-14T11:33:53.202 INFO:tasks.workunit.client.0.smithi138.stderr: -20> 2024-09-14T11:33:53.065+0000 7f02ef3bc9c0 5 asok(0x55cd75aa1d90) register_command sync trace history hook 0x7f02dc02b030 2024-09-14T11:33:53.202 INFO:tasks.workunit.client.0.smithi138.stderr: -19> 2024-09-14T11:33:53.065+0000 7f02ef3bc9c0 5 asok(0x55cd75aa1d90) register_command sync trace active hook 0x7f02dc02b030 2024-09-14T11:33:53.202 INFO:tasks.workunit.client.0.smithi138.stderr: -18> 2024-09-14T11:33:53.065+0000 7f02ef3bc9c0 5 asok(0x55cd75aa1d90) register_command sync trace active_short hook 0x7f02dc02b030 2024-09-14T11:33:53.202 INFO:tasks.workunit.client.0.smithi138.stderr: -17> 2024-09-14T11:33:53.065+0000 7f02ef3bc9c0 20 init_complete bucket index max shards: 11 2024-09-14T11:33:53.202 INFO:tasks.workunit.client.0.smithi138.stderr: -16> 2024-09-14T11:33:53.065+0000 7f02ef3bc9c0 20 Filter name: none 2024-09-14T11:33:53.202 INFO:tasks.workunit.client.0.smithi138.stderr: -15> 2024-09-14T11:33:53.065+0000 7f01137fe640 20 reqs_thread_entry: start 2024-09-14T11:33:53.202 INFO:tasks.workunit.client.0.smithi138.stderr: -14> 2024-09-14T11:33:53.065+0000 7f02ef3bc9c0 10 cache get: name=default.rgw.meta+root+abort-at-init-indext : miss 2024-09-14T11:33:53.202 INFO:tasks.workunit.client.0.smithi138.stderr: -13> 2024-09-14T11:33:53.065+0000 7f02ef3bc9c0 20 rados->read ofs=0 len=0 2024-09-14T11:33:53.202 INFO:tasks.workunit.client.0.smithi138.stderr: -12> 2024-09-14T11:33:53.069+0000 7f02ef3bc9c0 20 rados_obj.operate() r=0 bl.length=188 2024-09-14T11:33:53.202 INFO:tasks.workunit.client.0.smithi138.stderr: -11> 2024-09-14T11:33:53.069+0000 7f02ef3bc9c0 10 cache put: name=default.rgw.meta+root+abort-at-init-indext info.flags=0x11 2024-09-14T11:33:53.203 INFO:tasks.workunit.client.0.smithi138.stderr: -10> 2024-09-14T11:33:53.069+0000 7f02ef3bc9c0 10 adding default.rgw.meta+root+abort-at-init-indext to cache LRU end 2024-09-14T11:33:53.203 INFO:tasks.workunit.client.0.smithi138.stderr: -9> 2024-09-14T11:33:53.069+0000 7f02ef3bc9c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-init-indext:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.21 : miss 2024-09-14T11:33:53.203 INFO:tasks.workunit.client.0.smithi138.stderr: -8> 2024-09-14T11:33:53.069+0000 7f02ef3bc9c0 20 rados->read ofs=0 len=0 2024-09-14T11:33:53.203 INFO:tasks.workunit.client.0.smithi138.stderr: -7> 2024-09-14T11:33:53.069+0000 7f02ef3bc9c0 20 rados_obj.operate() r=0 bl.length=410 2024-09-14T11:33:53.203 INFO:tasks.workunit.client.0.smithi138.stderr: -6> 2024-09-14T11:33:53.069+0000 7f02ef3bc9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-init-indext:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.21 info.flags=0x17 2024-09-14T11:33:53.203 INFO:tasks.workunit.client.0.smithi138.stderr: -5> 2024-09-14T11:33:53.069+0000 7f02ef3bc9c0 10 adding default.rgw.meta+root+.bucket.meta.abort-at-init-indext:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.21 to cache LRU end 2024-09-14T11:33:53.203 INFO:tasks.workunit.client.0.smithi138.stderr: -4> 2024-09-14T11:33:53.069+0000 7f02ef3bc9c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:33:53.203 INFO:tasks.workunit.client.0.smithi138.stderr: -3> 2024-09-14T11:33:53.069+0000 7f02ef3bc9c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:33:53.203 INFO:tasks.workunit.client.0.smithi138.stderr: -2> 2024-09-14T11:33:53.069+0000 7f02ef3bc9c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-init-indext:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.21 2024-09-14T11:33:53.203 INFO:tasks.workunit.client.0.smithi138.stderr: -1> 2024-09-14T11:33:53.073+0000 7f02ef3bc9c0 -1 ./src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f02ef3bc9c0 time 2024-09-14T11:33:53.076609+0000 2024-09-14T11:33:53.203 INFO:tasks.workunit.client.0.smithi138.stderr:./src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-14T11:33:53.203 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-14T11:33:53.203 INFO:tasks.workunit.client.0.smithi138.stderr: ceph version 19.3.0-4907-ga2782315 (a2782315255a3e7d5f6cdc9eb35785187ff6ddf8) squid (dev) 2024-09-14T11:33:53.203 INFO:tasks.workunit.client.0.smithi138.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x121) [0x7f02f2c962eb] 2024-09-14T11:33:53.203 INFO:tasks.workunit.client.0.smithi138.stderr: 2: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7f02f2c9649f] 2024-09-14T11:33:53.204 INFO:tasks.workunit.client.0.smithi138.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55cd732f8c01] 2024-09-14T11:33:53.204 INFO:tasks.workunit.client.0.smithi138.stderr: 4: radosgw-admin(+0x14226e2) [0x55cd73d566e2] 2024-09-14T11:33:53.204 INFO:tasks.workunit.client.0.smithi138.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x55cd7330decd] 2024-09-14T11:33:53.204 INFO:tasks.workunit.client.0.smithi138.stderr: 6: main() 2024-09-14T11:33:53.204 INFO:tasks.workunit.client.0.smithi138.stderr: 7: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7f02f1afcd90] 2024-09-14T11:33:53.204 INFO:tasks.workunit.client.0.smithi138.stderr: 8: __libc_start_main() 2024-09-14T11:33:53.204 INFO:tasks.workunit.client.0.smithi138.stderr: 9: _start() 2024-09-14T11:33:53.204 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-14T11:33:53.204 INFO:tasks.workunit.client.0.smithi138.stderr: 0> 2024-09-14T11:33:53.077+0000 7f02ef3bc9c0 -1 *** Caught signal (Aborted) ** 2024-09-14T11:33:53.204 INFO:tasks.workunit.client.0.smithi138.stderr: in thread 7f02ef3bc9c0 thread_name:radosgw-admin 2024-09-14T11:33:53.204 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-14T11:33:53.204 INFO:tasks.workunit.client.0.smithi138.stderr: ceph version 19.3.0-4907-ga2782315 (a2782315255a3e7d5f6cdc9eb35785187ff6ddf8) squid (dev) 2024-09-14T11:33:53.204 INFO:tasks.workunit.client.0.smithi138.stderr: 1: /lib/x86_64-linux-gnu/libc.so.6(+0x42520) [0x7f02f1b15520] 2024-09-14T11:33:53.204 INFO:tasks.workunit.client.0.smithi138.stderr: 2: pthread_kill() 2024-09-14T11:33:53.205 INFO:tasks.workunit.client.0.smithi138.stderr: 3: raise() 2024-09-14T11:33:53.205 INFO:tasks.workunit.client.0.smithi138.stderr: 4: abort() 2024-09-14T11:33:53.205 INFO:tasks.workunit.client.0.smithi138.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x17b) [0x7f02f2c96345] 2024-09-14T11:33:53.205 INFO:tasks.workunit.client.0.smithi138.stderr: 6: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7f02f2c9649f] 2024-09-14T11:33:53.205 INFO:tasks.workunit.client.0.smithi138.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55cd732f8c01] 2024-09-14T11:33:53.205 INFO:tasks.workunit.client.0.smithi138.stderr: 8: radosgw-admin(+0x14226e2) [0x55cd73d566e2] 2024-09-14T11:33:53.205 INFO:tasks.workunit.client.0.smithi138.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x55cd7330decd] 2024-09-14T11:33:53.205 INFO:tasks.workunit.client.0.smithi138.stderr: 10: main() 2024-09-14T11:33:53.205 INFO:tasks.workunit.client.0.smithi138.stderr: 11: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7f02f1afcd90] 2024-09-14T11:33:53.205 INFO:tasks.workunit.client.0.smithi138.stderr: 12: __libc_start_main() 2024-09-14T11:33:53.205 INFO:tasks.workunit.client.0.smithi138.stderr: 13: _start() 2024-09-14T11:33:53.205 INFO:tasks.workunit.client.0.smithi138.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-14T11:33:53.205 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-14T11:33:53.205 INFO:tasks.workunit.client.0.smithi138.stderr:--- logging levels --- 2024-09-14T11:33:53.206 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 none 2024-09-14T11:33:53.206 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 1 lockdep 2024-09-14T11:33:53.206 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 1 context 2024-09-14T11:33:53.206 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 1 crush 2024-09-14T11:33:53.206 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 mds 2024-09-14T11:33:53.206 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 mds_balancer 2024-09-14T11:33:53.206 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 mds_locker 2024-09-14T11:33:53.206 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 mds_log 2024-09-14T11:33:53.206 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 mds_log_expire 2024-09-14T11:33:53.206 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 mds_migrator 2024-09-14T11:33:53.206 INFO:tasks.workunit.client.0.smithi138.stderr: 3/ 5 mds_quiesce 2024-09-14T11:33:53.206 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 1 buffer 2024-09-14T11:33:53.206 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 1 timer 2024-09-14T11:33:53.206 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 1 filer 2024-09-14T11:33:53.206 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 1 striper 2024-09-14T11:33:53.207 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 1 objecter 2024-09-14T11:33:53.207 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 rados 2024-09-14T11:33:53.207 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 rbd 2024-09-14T11:33:53.207 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 rbd_mirror 2024-09-14T11:33:53.207 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 rbd_replay 2024-09-14T11:33:53.207 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 rbd_pwl 2024-09-14T11:33:53.207 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 journaler 2024-09-14T11:33:53.207 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 objectcacher 2024-09-14T11:33:53.207 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 immutable_obj_cache 2024-09-14T11:33:53.207 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 client 2024-09-14T11:33:53.207 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 osd 2024-09-14T11:33:53.207 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 optracker 2024-09-14T11:33:53.207 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 objclass 2024-09-14T11:33:53.207 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 3 filestore 2024-09-14T11:33:53.208 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 3 journal 2024-09-14T11:33:53.208 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 0 ms 2024-09-14T11:33:53.208 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 mon 2024-09-14T11:33:53.208 INFO:tasks.workunit.client.0.smithi138.stderr: 0/10 monc 2024-09-14T11:33:53.208 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 paxos 2024-09-14T11:33:53.208 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 tp 2024-09-14T11:33:53.208 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 auth 2024-09-14T11:33:53.208 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 crypto 2024-09-14T11:33:53.208 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 1 finisher 2024-09-14T11:33:53.208 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 1 reserver 2024-09-14T11:33:53.208 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 heartbeatmap 2024-09-14T11:33:53.208 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 perfcounter 2024-09-14T11:33:53.208 INFO:tasks.workunit.client.0.smithi138.stderr: 20/20 rgw 2024-09-14T11:33:53.208 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 rgw_sync 2024-09-14T11:33:53.208 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 rgw_datacache 2024-09-14T11:33:53.209 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 rgw_access 2024-09-14T11:33:53.209 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 rgw_dbstore 2024-09-14T11:33:53.209 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 rgw_flight 2024-09-14T11:33:53.209 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 rgw_lifecycle 2024-09-14T11:33:53.209 INFO:tasks.workunit.client.0.smithi138.stderr: 20/20 rgw_notification 2024-09-14T11:33:53.209 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 javaclient 2024-09-14T11:33:53.209 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 asok 2024-09-14T11:33:53.209 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 1 throttle 2024-09-14T11:33:53.209 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 0 refs 2024-09-14T11:33:53.209 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 compressor 2024-09-14T11:33:53.209 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 bluestore 2024-09-14T11:33:53.209 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 bluefs 2024-09-14T11:33:53.209 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 3 bdev 2024-09-14T11:33:53.209 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 kstore 2024-09-14T11:33:53.210 INFO:tasks.workunit.client.0.smithi138.stderr: 4/ 5 rocksdb 2024-09-14T11:33:53.210 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 fuse 2024-09-14T11:33:53.210 INFO:tasks.workunit.client.0.smithi138.stderr: 2/ 5 mgr 2024-09-14T11:33:53.210 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 mgrc 2024-09-14T11:33:53.210 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 dpdk 2024-09-14T11:33:53.210 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 eventtrace 2024-09-14T11:33:53.210 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 prioritycache 2024-09-14T11:33:53.210 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 test 2024-09-14T11:33:53.210 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 cephfs_mirror 2024-09-14T11:33:53.210 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 cephsqlite 2024-09-14T11:33:53.210 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 crimson_interrupt 2024-09-14T11:33:53.210 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 seastore 2024-09-14T11:33:53.210 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 seastore_onode 2024-09-14T11:33:53.210 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 seastore_odata 2024-09-14T11:33:53.210 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 seastore_omap 2024-09-14T11:33:53.211 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 seastore_tm 2024-09-14T11:33:53.211 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 seastore_t 2024-09-14T11:33:53.211 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 seastore_cleaner 2024-09-14T11:33:53.211 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 seastore_epm 2024-09-14T11:33:53.211 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 seastore_lba 2024-09-14T11:33:53.211 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 seastore_fixedkv_tree 2024-09-14T11:33:53.211 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 seastore_cache 2024-09-14T11:33:53.211 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 seastore_journal 2024-09-14T11:33:53.211 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 seastore_device 2024-09-14T11:33:53.211 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 seastore_backref 2024-09-14T11:33:53.211 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 alienstore 2024-09-14T11:33:53.212 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 mclock 2024-09-14T11:33:53.212 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 cyanstore 2024-09-14T11:33:53.212 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 ceph_exporter 2024-09-14T11:33:53.212 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 memstore 2024-09-14T11:33:53.212 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 trace 2024-09-14T11:33:53.212 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 ceph_dedup 2024-09-14T11:33:53.212 INFO:tasks.workunit.client.0.smithi138.stderr: -2/-2 (syslog threshold) 2024-09-14T11:33:53.212 INFO:tasks.workunit.client.0.smithi138.stderr: 99/99 (stderr threshold) 2024-09-14T11:33:53.212 INFO:tasks.workunit.client.0.smithi138.stderr:--- pthread ID / name mapping for recent threads --- 2024-09-14T11:33:53.212 INFO:tasks.workunit.client.0.smithi138.stderr: 7f01137fe640 / http_manager 2024-09-14T11:33:53.212 INFO:tasks.workunit.client.0.smithi138.stderr: 7f01a1fe3640 / http_manager 2024-09-14T11:33:53.212 INFO:tasks.workunit.client.0.smithi138.stderr: 7f01a2fe5640 / rgw_dt_lg_renew 2024-09-14T11:33:53.212 INFO:tasks.workunit.client.0.smithi138.stderr: 7f01c27fc640 / ms_dispatch 2024-09-14T11:33:53.212 INFO:tasks.workunit.client.0.smithi138.stderr: 7f01c3fff640 / io_context_pool 2024-09-14T11:33:53.213 INFO:tasks.workunit.client.0.smithi138.stderr: 7f01d27fc640 / ms_dispatch 2024-09-14T11:33:53.213 INFO:tasks.workunit.client.0.smithi138.stderr: 7f01d960a640 / ms_dispatch 2024-09-14T11:33:53.213 INFO:tasks.workunit.client.0.smithi138.stderr: 7f01dae0d640 / io_context_pool 2024-09-14T11:33:53.213 INFO:tasks.workunit.client.0.smithi138.stderr: 7f02ec6c1640 / msgr-worker-2 2024-09-14T11:33:53.213 INFO:tasks.workunit.client.0.smithi138.stderr: 7f02ecec2640 / msgr-worker-1 2024-09-14T11:33:53.213 INFO:tasks.workunit.client.0.smithi138.stderr: 7f02ed6c3640 / msgr-worker-0 2024-09-14T11:33:53.213 INFO:tasks.workunit.client.0.smithi138.stderr: 7f02edec4640 / io_context_pool 2024-09-14T11:33:53.213 INFO:tasks.workunit.client.0.smithi138.stderr: 7f02ef3bc9c0 / radosgw-admin 2024-09-14T11:33:53.213 INFO:tasks.workunit.client.0.smithi138.stderr: max_recent 500 2024-09-14T11:33:53.213 INFO:tasks.workunit.client.0.smithi138.stderr: max_new 1000 2024-09-14T11:33:53.213 INFO:tasks.workunit.client.0.smithi138.stderr: log_file /var/lib/ceph/crash/2024-09-14T11:33:53.083636Z_17fd9758-e524-4794-8dd2-f5d2613956c5/log 2024-09-14T11:33:53.213 INFO:tasks.workunit.client.0.smithi138.stderr:--- end dump of recent events --- 2024-09-14T11:33:53.213 INFO:tasks.workunit.client.0.smithi138.stderr:Aborted 2024-09-14T11:33:53.214 INFO:tasks.workunit.client.0.smithi138.stderr:radosgw-admin bucket stats --bucket abort-at-init-indext 2024-09-14T11:33:53.215 INFO:tasks.workunit.client.0.smithi138.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:33:53.215 INFO:tasks.workunit.client.0.smithi138.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:33:53.215 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:53.173+0000 7ff4b06f89c0 20 rados->read ofs=0 len=0 2024-09-14T11:33:53.215 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:53.173+0000 7ff4b06f89c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:33:53.215 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:53.173+0000 7ff4b06f89c0 20 realm 2024-09-14T11:33:53.215 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:53.173+0000 7ff4b06f89c0 20 rados->read ofs=0 len=0 2024-09-14T11:33:53.215 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:53.177+0000 7ff4b06f89c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:33:53.215 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:53.177+0000 7ff4b06f89c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:33:53.215 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:53.177+0000 7ff4b06f89c0 20 rados->read ofs=0 len=0 2024-09-14T11:33:53.216 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:53.177+0000 7ff4b06f89c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:33:53.216 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:53.177+0000 7ff4b06f89c0 20 rados->read ofs=0 len=0 2024-09-14T11:33:53.216 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:53.177+0000 7ff4b06f89c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:33:53.216 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:53.177+0000 7ff4b06f89c0 20 rados->read ofs=0 len=0 2024-09-14T11:33:53.216 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:53.177+0000 7ff4b06f89c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:33:53.216 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:53.177+0000 7ff4b06f89c0 20 searching for the correct realm 2024-09-14T11:33:53.216 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:53.181+0000 7ff4ad9fd640 0 -- 172.21.15.138:0/1005113831 >> [v2:172.21.15.154:6808/1468088432,v1:172.21.15.154:6809/1468088432] conn(0x7ff4a0033070 msgr2=0x7ff4a00660b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:33:53.216 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:53.189+0000 7ff4ad9fd640 0 -- 172.21.15.138:0/1005113831 >> [v2:172.21.15.138:6816/326481658,v1:172.21.15.138:6817/326481658] conn(0x7ff4a804d3f0 msgr2=0x7ff4a804d870 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:33:53.405 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:53.405+0000 7ff4b06f89c0 20 RGWRados::pool_iterate: got zone_info.d9e72d30-c60b-4d0d-9267-fdc36392d5ad 2024-09-14T11:33:53.405 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:53.405+0000 7ff4b06f89c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:33:53.405 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:53.405+0000 7ff4b06f89c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:33:53.406 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:53.405+0000 7ff4b06f89c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:33:53.406 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:53.405+0000 7ff4b06f89c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:33:53.406 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:53.405+0000 7ff4b06f89c0 20 RGWRados::pool_iterate: got zonegroup_info.65ab941b-da8c-4160-94fb-3672b069d44f 2024-09-14T11:33:53.406 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:53.405+0000 7ff4b06f89c0 20 rados->read ofs=0 len=0 2024-09-14T11:33:53.406 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:53.405+0000 7ff4b06f89c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:33:53.406 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:53.405+0000 7ff4b06f89c0 20 rados->read ofs=0 len=0 2024-09-14T11:33:53.406 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:53.409+0000 7ff4b06f89c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:33:53.407 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:53.409+0000 7ff4b06f89c0 20 rados->read ofs=0 len=0 2024-09-14T11:33:53.407 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:53.409+0000 7ff4b06f89c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:33:53.407 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:53.409+0000 7ff4b06f89c0 20 zone default found 2024-09-14T11:33:53.407 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:53.409+0000 7ff4b06f89c0 4 Realm: () 2024-09-14T11:33:53.407 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:53.409+0000 7ff4b06f89c0 4 ZoneGroup: default (65ab941b-da8c-4160-94fb-3672b069d44f) 2024-09-14T11:33:53.407 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:53.409+0000 7ff4b06f89c0 4 Zone: default (d9e72d30-c60b-4d0d-9267-fdc36392d5ad) 2024-09-14T11:33:53.408 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:53.409+0000 7ff4b06f89c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:33:53.408 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:53.409+0000 7ff4b06f89c0 20 zonegroup default 2024-09-14T11:33:53.408 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:53.409+0000 7ff4b06f89c0 20 rados->read ofs=0 len=0 2024-09-14T11:33:53.408 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:53.409+0000 7ff4b06f89c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:33:53.408 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:53.409+0000 7ff4b06f89c0 20 rados->read ofs=0 len=0 2024-09-14T11:33:53.409 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:53.409+0000 7ff4b06f89c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:33:53.409 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:53.409+0000 7ff4b06f89c0 20 rados->read ofs=0 len=0 2024-09-14T11:33:53.409 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:53.409+0000 7ff4b06f89c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:33:53.409 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:53.409+0000 7ff4b06f89c0 20 started sync module instance, tier type = 2024-09-14T11:33:53.409 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:53.409+0000 7ff4b06f89c0 20 started zone id=d9e72d30-c60b-4d0d-9267-fdc36392d5ad (name=default) with tier type = 2024-09-14T11:33:53.433 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:53.433+0000 7ff4b06f89c0 20 add_watcher() i=0 2024-09-14T11:33:53.433 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:53.433+0000 7ff4b06f89c0 20 add_watcher() i=1 2024-09-14T11:33:53.433 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:53.433+0000 7ff4b06f89c0 20 add_watcher() i=2 2024-09-14T11:33:53.433 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:53.433+0000 7ff4b06f89c0 20 add_watcher() i=3 2024-09-14T11:33:53.434 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:53.433+0000 7ff4b06f89c0 20 add_watcher() i=4 2024-09-14T11:33:53.434 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:53.433+0000 7ff4b06f89c0 20 add_watcher() i=5 2024-09-14T11:33:53.434 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:53.433+0000 7ff4b06f89c0 20 add_watcher() i=6 2024-09-14T11:33:53.435 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:53.437+0000 7ff4b06f89c0 20 add_watcher() i=7 2024-09-14T11:33:53.436 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:53.437+0000 7ff4b06f89c0 2 all 8 watchers are set, enabling cache 2024-09-14T11:33:53.440 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:53.441+0000 7ff364fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:33:53.441 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:53.441+0000 7ff4b06f89c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:33:53.441 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:53.441+0000 7ff4b06f89c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:33:53.441 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:53.441+0000 7ff4b06f89c0 5 note: GC not initialized 2024-09-14T11:33:53.442 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:53.441+0000 7ff2df7fe640 20 reqs_thread_entry: start 2024-09-14T11:33:53.442 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:53.441+0000 7ff4b06f89c0 20 init_complete bucket index max shards: 11 2024-09-14T11:33:53.442 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:53.441+0000 7ff4b06f89c0 20 Filter name: none 2024-09-14T11:33:53.442 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:53.445+0000 7ff2dd7fa640 20 reqs_thread_entry: start 2024-09-14T11:33:53.443 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:53.445+0000 7ff4b06f89c0 20 rados->read ofs=0 len=0 2024-09-14T11:33:53.443 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:53.445+0000 7ff4b06f89c0 20 rados_obj.operate() r=0 bl.length=188 2024-09-14T11:33:53.443 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:53.445+0000 7ff4b06f89c0 20 rados->read ofs=0 len=0 2024-09-14T11:33:53.444 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:53.445+0000 7ff4b06f89c0 20 rados_obj.operate() r=0 bl.length=410 2024-09-14T11:33:53.444 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:53.445+0000 7ff4b06f89c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:33:53.444 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:53.445+0000 7ff4b06f89c0 20 rados->read ofs=0 len=0 2024-09-14T11:33:53.444 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:53.445+0000 7ff4b06f89c0 20 rados_obj.operate() r=0 bl.length=188 2024-09-14T11:33:53.444 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:53.445+0000 7ff4b06f89c0 20 rados->read ofs=0 len=0 2024-09-14T11:33:53.445 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:53.445+0000 7ff4b06f89c0 20 rados_obj.operate() r=0 bl.length=410 2024-09-14T11:33:53.445 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:53.445+0000 7ff4b06f89c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:33:53.448 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:53.449+0000 7ff364fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:33:53.453 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:53.453+0000 7ff4b06f89c0 20 remove_watcher() i=0 2024-09-14T11:33:53.453 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:53.453+0000 7ff4b06f89c0 2 removed watcher, disabling cache 2024-09-14T11:33:53.455 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:53.457+0000 7ff4b06f89c0 20 remove_watcher() i=1 2024-09-14T11:33:53.457 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:53.457+0000 7ff4b06f89c0 20 remove_watcher() i=2 2024-09-14T11:33:53.460 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:53.461+0000 7ff4b06f89c0 20 remove_watcher() i=3 2024-09-14T11:33:53.463 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:53.465+0000 7ff4b06f89c0 20 remove_watcher() i=4 2024-09-14T11:33:53.464 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:53.465+0000 7ff4b06f89c0 20 remove_watcher() i=5 2024-09-14T11:33:53.465 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:53.465+0000 7ff4b06f89c0 20 remove_watcher() i=6 2024-09-14T11:33:53.467 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:53.469+0000 7ff4b06f89c0 20 remove_watcher() i=7 2024-09-14T11:33:53.482 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-14T11:33:53.482 INFO:tasks.workunit.client.0.smithi138.stderr:BUCKET_STATS: 2024-09-14T11:33:53.482 INFO:tasks.workunit.client.0.smithi138.stderr:bucket: abort-at-init-indext id: d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.21 num_objects: 20 size_kb: 1 num_shards: 11 2024-09-14T11:33:53.482 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-14T11:33:53.483 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:33:53.483 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-14T11:33:53.527 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:33:53.527 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-14T11:33:53.588 INFO:tasks.workunit.client.0.smithi138.stderr:radosgw-admin bucket reshard --bucket abort-at-init-indext --num-shards 12 --rgw-reshard-bucket-lock-duration 30 2024-09-14T11:33:53.624 INFO:tasks.workunit.client.0.smithi138.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:33:53.624 INFO:tasks.workunit.client.0.smithi138.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:33:53.669 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:53.669+0000 7f4350dd89c0 20 rados->read ofs=0 len=0 2024-09-14T11:33:53.670 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:53.673+0000 7f4350dd89c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:33:53.671 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:53.673+0000 7f4350dd89c0 20 realm 2024-09-14T11:33:53.671 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:53.673+0000 7f4350dd89c0 20 rados->read ofs=0 len=0 2024-09-14T11:33:53.671 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:53.673+0000 7f4350dd89c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:33:53.671 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:53.673+0000 7f4350dd89c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:33:53.671 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:53.673+0000 7f4350dd89c0 20 rados->read ofs=0 len=0 2024-09-14T11:33:53.671 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:53.673+0000 7f4350dd89c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:33:53.671 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:53.673+0000 7f4350dd89c0 20 rados->read ofs=0 len=0 2024-09-14T11:33:53.672 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:53.673+0000 7f4350dd89c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:33:53.673 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:53.673+0000 7f4350dd89c0 20 rados->read ofs=0 len=0 2024-09-14T11:33:53.673 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:53.673+0000 7f4350dd89c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:33:53.673 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:53.673+0000 7f4350dd89c0 20 searching for the correct realm 2024-09-14T11:33:53.675 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:53.677+0000 7f434e0dd640 0 -- 172.21.15.138:0/2350080323 >> [v2:172.21.15.154:6808/1468088432,v1:172.21.15.154:6809/1468088432] conn(0x7f43400bc050 msgr2=0x7f43400c8440 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:33:53.681 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:53.681+0000 7f434f0df640 0 -- 172.21.15.138:0/2350080323 >> [v2:172.21.15.138:6824/2633984942,v1:172.21.15.138:6825/2633984942] conn(0x55974e7d0a50 msgr2=0x55974e7d2e40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:33:53.692 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:53.693+0000 7f4350dd89c0 20 RGWRados::pool_iterate: got zone_info.d9e72d30-c60b-4d0d-9267-fdc36392d5ad 2024-09-14T11:33:53.692 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:53.693+0000 7f4350dd89c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:33:53.692 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:53.693+0000 7f4350dd89c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:33:53.692 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:53.693+0000 7f4350dd89c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:33:53.692 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:53.693+0000 7f4350dd89c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:33:53.692 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:53.693+0000 7f4350dd89c0 20 RGWRados::pool_iterate: got zonegroup_info.65ab941b-da8c-4160-94fb-3672b069d44f 2024-09-14T11:33:53.692 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:53.693+0000 7f4350dd89c0 20 rados->read ofs=0 len=0 2024-09-14T11:33:53.693 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:53.693+0000 7f4350dd89c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:33:53.693 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:53.693+0000 7f4350dd89c0 20 rados->read ofs=0 len=0 2024-09-14T11:33:53.693 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:53.693+0000 7f4350dd89c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:33:53.693 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:53.693+0000 7f4350dd89c0 20 rados->read ofs=0 len=0 2024-09-14T11:33:53.694 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:53.693+0000 7f4350dd89c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:33:53.694 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:53.693+0000 7f4350dd89c0 20 zone default found 2024-09-14T11:33:53.694 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:53.693+0000 7f4350dd89c0 4 Realm: () 2024-09-14T11:33:53.694 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:53.693+0000 7f4350dd89c0 4 ZoneGroup: default (65ab941b-da8c-4160-94fb-3672b069d44f) 2024-09-14T11:33:53.694 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:53.693+0000 7f4350dd89c0 4 Zone: default (d9e72d30-c60b-4d0d-9267-fdc36392d5ad) 2024-09-14T11:33:53.695 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:53.693+0000 7f4350dd89c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:33:53.695 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:53.693+0000 7f4350dd89c0 20 zonegroup default 2024-09-14T11:33:53.695 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:53.693+0000 7f4350dd89c0 20 rados->read ofs=0 len=0 2024-09-14T11:33:53.695 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:53.693+0000 7f4350dd89c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:33:53.695 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:53.693+0000 7f4350dd89c0 20 rados->read ofs=0 len=0 2024-09-14T11:33:53.695 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:53.697+0000 7f4350dd89c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:33:53.696 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:53.697+0000 7f4350dd89c0 20 rados->read ofs=0 len=0 2024-09-14T11:33:53.696 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:53.697+0000 7f4350dd89c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:33:53.696 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:53.697+0000 7f4350dd89c0 20 started sync module instance, tier type = 2024-09-14T11:33:53.696 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:53.697+0000 7f4350dd89c0 20 started zone id=d9e72d30-c60b-4d0d-9267-fdc36392d5ad (name=default) with tier type = 2024-09-14T11:33:53.711 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:53.713+0000 7f4350dd89c0 20 add_watcher() i=0 2024-09-14T11:33:53.711 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:53.713+0000 7f4350dd89c0 20 add_watcher() i=1 2024-09-14T11:33:53.711 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:53.713+0000 7f4350dd89c0 20 add_watcher() i=2 2024-09-14T11:33:53.711 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:53.713+0000 7f4350dd89c0 20 add_watcher() i=3 2024-09-14T11:33:53.711 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:53.713+0000 7f4350dd89c0 20 add_watcher() i=4 2024-09-14T11:33:53.711 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:53.713+0000 7f4350dd89c0 20 add_watcher() i=5 2024-09-14T11:33:53.711 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:53.713+0000 7f4350dd89c0 20 add_watcher() i=6 2024-09-14T11:33:53.712 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:53.713+0000 7f4350dd89c0 20 add_watcher() i=7 2024-09-14T11:33:53.712 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:53.713+0000 7f4350dd89c0 2 all 8 watchers are set, enabling cache 2024-09-14T11:33:53.714 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:53.717+0000 7f42057e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:33:53.715 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:53.717+0000 7f4350dd89c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:33:53.715 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:53.717+0000 7f4350dd89c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:33:53.715 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:53.717+0000 7f4350dd89c0 5 note: GC not initialized 2024-09-14T11:33:53.715 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:53.717+0000 7f417ffff640 20 reqs_thread_entry: start 2024-09-14T11:33:53.715 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:53.717+0000 7f4350dd89c0 20 init_complete bucket index max shards: 11 2024-09-14T11:33:53.716 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:53.717+0000 7f4350dd89c0 20 Filter name: none 2024-09-14T11:33:53.716 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:53.717+0000 7f417dffb640 20 reqs_thread_entry: start 2024-09-14T11:33:53.716 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:53.717+0000 7f4350dd89c0 10 cache get: name=default.rgw.meta+root+abort-at-init-indext : miss 2024-09-14T11:33:53.716 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:53.717+0000 7f4350dd89c0 20 rados->read ofs=0 len=0 2024-09-14T11:33:53.717 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:53.717+0000 7f4350dd89c0 20 rados_obj.operate() r=0 bl.length=188 2024-09-14T11:33:53.717 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:53.717+0000 7f4350dd89c0 10 cache put: name=default.rgw.meta+root+abort-at-init-indext info.flags=0x11 2024-09-14T11:33:53.717 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:53.717+0000 7f4350dd89c0 10 adding default.rgw.meta+root+abort-at-init-indext to cache LRU end 2024-09-14T11:33:53.717 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:53.717+0000 7f4350dd89c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-init-indext:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.21 : miss 2024-09-14T11:33:53.717 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:53.717+0000 7f4350dd89c0 20 rados->read ofs=0 len=0 2024-09-14T11:33:53.717 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:53.717+0000 7f4350dd89c0 20 rados_obj.operate() r=0 bl.length=410 2024-09-14T11:33:53.717 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:53.717+0000 7f4350dd89c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-init-indext:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.21 info.flags=0x17 2024-09-14T11:33:53.717 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:53.717+0000 7f4350dd89c0 10 adding default.rgw.meta+root+.bucket.meta.abort-at-init-indext:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.21 to cache LRU end 2024-09-14T11:33:53.717 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:53.717+0000 7f4350dd89c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:33:53.717 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:53.717+0000 7f4350dd89c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:33:53.718 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:53.717+0000 7f4350dd89c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-init-indext:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.21 2024-09-14T11:33:53.718 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:53.721+0000 7f4350dd89c0 0 INFO: RGWReshardLock::lock found lock on abort-at-init-indext:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.21 to be held by another RGW process; skipping for now 2024-09-14T11:33:53.719 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:53.721+0000 7f42057e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:33:53.724 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:53.725+0000 7f4350dd89c0 20 remove_watcher() i=0 2024-09-14T11:33:53.724 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:53.725+0000 7f4350dd89c0 2 removed watcher, disabling cache 2024-09-14T11:33:53.726 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:53.729+0000 7f4350dd89c0 20 remove_watcher() i=1 2024-09-14T11:33:53.728 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:53.729+0000 7f4350dd89c0 20 remove_watcher() i=2 2024-09-14T11:33:53.730 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:53.733+0000 7f4350dd89c0 20 remove_watcher() i=3 2024-09-14T11:33:53.732 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:53.733+0000 7f4350dd89c0 20 remove_watcher() i=4 2024-09-14T11:33:53.733 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:53.733+0000 7f4350dd89c0 20 remove_watcher() i=5 2024-09-14T11:33:53.734 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:53.737+0000 7f4350dd89c0 20 remove_watcher() i=6 2024-09-14T11:33:53.735 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:33:53.737+0000 7f4350dd89c0 20 remove_watcher() i=7 2024-09-14T11:33:53.749 INFO:tasks.workunit.client.0.smithi138.stderr:waiting 30 seconds for reshard lock to expire... 2024-09-14T11:34:23.777 INFO:tasks.workunit.client.0.smithi138.stderr:radosgw-admin bucket reshard --bucket abort-at-init-indext --num-shards 12 --rgw-reshard-bucket-lock-duration 30 2024-09-14T11:34:23.813 INFO:tasks.workunit.client.0.smithi138.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:34:23.813 INFO:tasks.workunit.client.0.smithi138.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:34:23.860 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:23.861+0000 7f3b557149c0 20 rados->read ofs=0 len=0 2024-09-14T11:34:23.862 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:23.861+0000 7f3b557149c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:34:23.862 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:23.861+0000 7f3b557149c0 20 realm 2024-09-14T11:34:23.862 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:23.861+0000 7f3b557149c0 20 rados->read ofs=0 len=0 2024-09-14T11:34:23.862 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:23.861+0000 7f3b557149c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:34:23.862 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:23.861+0000 7f3b557149c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:34:23.862 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:23.861+0000 7f3b557149c0 20 rados->read ofs=0 len=0 2024-09-14T11:34:23.862 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:23.861+0000 7f3b557149c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:34:23.862 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:23.861+0000 7f3b557149c0 20 rados->read ofs=0 len=0 2024-09-14T11:34:23.863 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:23.865+0000 7f3b557149c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:34:23.863 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:23.865+0000 7f3b557149c0 20 rados->read ofs=0 len=0 2024-09-14T11:34:23.864 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:23.865+0000 7f3b557149c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:34:23.865 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:23.865+0000 7f3b557149c0 20 searching for the correct realm 2024-09-14T11:34:23.866 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:23.869+0000 7f3b52a19640 0 -- 172.21.15.138:0/136789752 >> [v2:172.21.15.154:6808/1468088432,v1:172.21.15.154:6809/1468088432] conn(0x7f3b4401a040 msgr2=0x7f3b44043430 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-14T11:34:24.082 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:24.081+0000 7f3b53a1b640 0 -- 172.21.15.138:0/136789752 >> [v2:172.21.15.138:6824/2633984942,v1:172.21.15.138:6825/2633984942] conn(0x55d4bd989590 msgr2=0x55d4bd98b980 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:34:24.100 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:24.101+0000 7f3b557149c0 20 RGWRados::pool_iterate: got zone_info.d9e72d30-c60b-4d0d-9267-fdc36392d5ad 2024-09-14T11:34:24.100 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:24.101+0000 7f3b557149c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:34:24.100 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:24.101+0000 7f3b557149c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:34:24.100 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:24.101+0000 7f3b557149c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:34:24.100 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:24.101+0000 7f3b557149c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:34:24.100 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:24.101+0000 7f3b557149c0 20 RGWRados::pool_iterate: got zonegroup_info.65ab941b-da8c-4160-94fb-3672b069d44f 2024-09-14T11:34:24.100 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:24.101+0000 7f3b557149c0 20 rados->read ofs=0 len=0 2024-09-14T11:34:24.101 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:24.101+0000 7f3b557149c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:34:24.101 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:24.101+0000 7f3b557149c0 20 rados->read ofs=0 len=0 2024-09-14T11:34:24.101 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:24.101+0000 7f3b557149c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:34:24.101 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:24.101+0000 7f3b557149c0 20 rados->read ofs=0 len=0 2024-09-14T11:34:24.102 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:24.105+0000 7f3b557149c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:34:24.103 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:24.105+0000 7f3b557149c0 20 zone default found 2024-09-14T11:34:24.103 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:24.105+0000 7f3b557149c0 4 Realm: () 2024-09-14T11:34:24.103 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:24.105+0000 7f3b557149c0 4 ZoneGroup: default (65ab941b-da8c-4160-94fb-3672b069d44f) 2024-09-14T11:34:24.103 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:24.105+0000 7f3b557149c0 4 Zone: default (d9e72d30-c60b-4d0d-9267-fdc36392d5ad) 2024-09-14T11:34:24.103 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:24.105+0000 7f3b557149c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:34:24.103 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:24.105+0000 7f3b557149c0 20 zonegroup default 2024-09-14T11:34:24.103 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:24.105+0000 7f3b557149c0 20 rados->read ofs=0 len=0 2024-09-14T11:34:24.103 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:24.105+0000 7f3b557149c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:34:24.103 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:24.105+0000 7f3b557149c0 20 rados->read ofs=0 len=0 2024-09-14T11:34:24.104 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:24.105+0000 7f3b557149c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:34:24.104 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:24.105+0000 7f3b557149c0 20 rados->read ofs=0 len=0 2024-09-14T11:34:24.104 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:24.105+0000 7f3b557149c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:34:24.105 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:24.105+0000 7f3b557149c0 20 started sync module instance, tier type = 2024-09-14T11:34:24.105 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:24.105+0000 7f3b557149c0 20 started zone id=d9e72d30-c60b-4d0d-9267-fdc36392d5ad (name=default) with tier type = 2024-09-14T11:34:24.126 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:24.125+0000 7f3b557149c0 20 add_watcher() i=0 2024-09-14T11:34:24.126 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:24.125+0000 7f3b557149c0 20 add_watcher() i=1 2024-09-14T11:34:24.126 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:24.125+0000 7f3b557149c0 20 add_watcher() i=2 2024-09-14T11:34:24.126 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:24.125+0000 7f3b557149c0 20 add_watcher() i=3 2024-09-14T11:34:24.126 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:24.125+0000 7f3b557149c0 20 add_watcher() i=4 2024-09-14T11:34:24.126 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:24.125+0000 7f3b557149c0 20 add_watcher() i=5 2024-09-14T11:34:24.126 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:24.125+0000 7f3b557149c0 20 add_watcher() i=6 2024-09-14T11:34:24.128 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:24.129+0000 7f3b557149c0 20 add_watcher() i=7 2024-09-14T11:34:24.128 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:24.129+0000 7f3b557149c0 2 all 8 watchers are set, enabling cache 2024-09-14T11:34:24.131 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:24.133+0000 7f3a09fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:34:24.132 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:24.133+0000 7f3b557149c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:34:24.132 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:24.133+0000 7f3b557149c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:34:24.133 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:24.133+0000 7f3b557149c0 5 note: GC not initialized 2024-09-14T11:34:24.133 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:24.133+0000 7f3a08fe1640 20 reqs_thread_entry: start 2024-09-14T11:34:24.133 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:24.133+0000 7f3b557149c0 20 init_complete bucket index max shards: 11 2024-09-14T11:34:24.134 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:24.133+0000 7f3b557149c0 20 Filter name: none 2024-09-14T11:34:24.134 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:24.133+0000 7f39827fc640 20 reqs_thread_entry: start 2024-09-14T11:34:24.134 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:24.133+0000 7f3b557149c0 10 cache get: name=default.rgw.meta+root+abort-at-init-indext : miss 2024-09-14T11:34:24.134 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:24.133+0000 7f3b557149c0 20 rados->read ofs=0 len=0 2024-09-14T11:34:24.135 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:24.137+0000 7f3b557149c0 20 rados_obj.operate() r=0 bl.length=188 2024-09-14T11:34:24.136 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:24.137+0000 7f3b557149c0 10 cache put: name=default.rgw.meta+root+abort-at-init-indext info.flags=0x11 2024-09-14T11:34:24.136 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:24.137+0000 7f3b557149c0 10 adding default.rgw.meta+root+abort-at-init-indext to cache LRU end 2024-09-14T11:34:24.136 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:24.137+0000 7f3b557149c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-init-indext:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.21 : miss 2024-09-14T11:34:24.136 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:24.137+0000 7f3b557149c0 20 rados->read ofs=0 len=0 2024-09-14T11:34:24.136 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:24.137+0000 7f3b557149c0 20 rados_obj.operate() r=0 bl.length=410 2024-09-14T11:34:24.136 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:24.137+0000 7f3b557149c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-init-indext:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.21 info.flags=0x17 2024-09-14T11:34:24.136 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:24.137+0000 7f3b557149c0 10 adding default.rgw.meta+root+.bucket.meta.abort-at-init-indext:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.21 to cache LRU end 2024-09-14T11:34:24.136 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:24.137+0000 7f3b557149c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:34:24.136 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:24.137+0000 7f3b557149c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:34:24.136 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:24.137+0000 7f3b557149c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-init-indext:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.21 2024-09-14T11:34:24.145 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:24.145+0000 7f3b557149c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-init-indext:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.21 info.flags=0x17 2024-09-14T11:34:24.145 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:24.145+0000 7f3b557149c0 10 moving default.rgw.meta+root+.bucket.meta.abort-at-init-indext:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.21 to cache LRU end 2024-09-14T11:34:24.145 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:24.145+0000 7f3b557149c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:34:24.145 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:24.145+0000 7f3b557149c0 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-init-indext:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.21, ofs0, ns] 2024-09-14T11:34:24.146 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:24.145+0000 7f3a367fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366179 cookie 94372202372032 notifier 5954 bl.length()=913 2024-09-14T11:34:24.146 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:24.145+0000 7f3a367fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-init-indext:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.21 info.flags=0x17 2024-09-14T11:34:24.146 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:24.145+0000 7f3a367fc640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-init-indext:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.21 to cache LRU end 2024-09-14T11:34:24.146 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:24.145+0000 7f3a367fc640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:34:24.148 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:24.149+0000 7f3b557149c0 20 handle_bi_update(): bucket=:abort-at-init-indext[d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.21]): orig_sources= new_sources= 2024-09-14T11:34:24.149 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:24.149+0000 7f3b557149c0 20 handle_bi_update(): bucket=:abort-at-init-indext[d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.21]): potential sources added=[] removed=[] 2024-09-14T11:34:24.149 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:24.149+0000 7f3b557149c0 20 handle_bi_update(): bucket=:abort-at-init-indext[d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.21]): orig_dests= new_dests= 2024-09-14T11:34:24.149 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:24.149+0000 7f3b557149c0 20 handle_bi_update(): bucket=:abort-at-init-indext[d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.21]): potential dests added=[] removed=[] 2024-09-14T11:34:24.159 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:24.161+0000 7f3b557149c0 10 bucket_obj is .dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.21.1.0 2024-09-14T11:34:24.159 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:24.161+0000 7f3b557149c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.21.1.0 2024-09-14T11:34:24.159 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:24.161+0000 7f3b557149c0 10 bucket_obj is .dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.21.1.1 2024-09-14T11:34:24.159 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:24.161+0000 7f3b557149c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.21.1.1 2024-09-14T11:34:24.159 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:24.161+0000 7f3b557149c0 10 bucket_obj is .dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.21.1.2 2024-09-14T11:34:24.159 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:24.161+0000 7f3b557149c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.21.1.2 2024-09-14T11:34:24.160 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:24.161+0000 7f3b557149c0 10 bucket_obj is .dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.21.1.3 2024-09-14T11:34:24.160 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:24.161+0000 7f3b557149c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.21.1.3 2024-09-14T11:34:24.160 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:24.161+0000 7f3b557149c0 10 bucket_obj is .dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.21.1.4 2024-09-14T11:34:24.160 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:24.161+0000 7f3b557149c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.21.1.4 2024-09-14T11:34:24.160 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:24.161+0000 7f3b557149c0 10 bucket_obj is .dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.21.1.5 2024-09-14T11:34:24.160 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:24.161+0000 7f3b557149c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.21.1.5 2024-09-14T11:34:24.160 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:24.161+0000 7f3b557149c0 10 bucket_obj is .dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.21.1.6 2024-09-14T11:34:24.160 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:24.161+0000 7f3b557149c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.21.1.6 2024-09-14T11:34:24.160 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:24.161+0000 7f3b557149c0 10 bucket_obj is .dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.21.1.7 2024-09-14T11:34:24.160 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:24.161+0000 7f3b557149c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.21.1.7 2024-09-14T11:34:24.160 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:24.161+0000 7f3b557149c0 10 bucket_obj is .dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.21.1.8 2024-09-14T11:34:24.160 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:24.161+0000 7f3b557149c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.21.1.8 2024-09-14T11:34:24.160 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:24.161+0000 7f3b557149c0 10 bucket_obj is .dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.21.1.9 2024-09-14T11:34:24.160 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:24.161+0000 7f3b557149c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.21.1.9 2024-09-14T11:34:24.160 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:24.161+0000 7f3b557149c0 10 bucket_obj is .dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.21.1.10 2024-09-14T11:34:24.161 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:24.161+0000 7f3b557149c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.21.1.10 2024-09-14T11:34:24.161 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:24.161+0000 7f3b557149c0 10 bucket_obj is .dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.21.1.11 2024-09-14T11:34:24.161 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:24.161+0000 7f3b557149c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.21.1.11 2024-09-14T11:34:24.161 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:24.161+0000 7f3b557149c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.21.0 2024-09-14T11:34:24.161 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:24.161+0000 7f3b557149c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.21.1 2024-09-14T11:34:24.161 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:24.161+0000 7f3b557149c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.21.2 2024-09-14T11:34:24.162 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:24.161+0000 7f3b557149c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.21.3 2024-09-14T11:34:24.162 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:24.165+0000 7f3b557149c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.21.4 2024-09-14T11:34:24.163 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:24.165+0000 7f3b557149c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.21.5 2024-09-14T11:34:24.163 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:24.165+0000 7f3b557149c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.21.6 2024-09-14T11:34:24.164 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:24.165+0000 7f3b557149c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.21.7 2024-09-14T11:34:24.166 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:24.165+0000 7f3b557149c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.21.8 2024-09-14T11:34:24.167 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:24.169+0000 7f3b557149c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.21.9 2024-09-14T11:34:24.168 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:24.169+0000 7f3b557149c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.21.10 2024-09-14T11:34:24.175 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:24.177+0000 7f3b557149c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-init-indext:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.21 : hit (requested=0x17, cached=0x17) 2024-09-14T11:34:24.175 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:24.177+0000 7f3b557149c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-init-indext:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.21 2024-09-14T11:34:24.176 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:24.177+0000 7f3b557149c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-init-indext:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.21 info.flags=0x17 2024-09-14T11:34:24.177 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:24.177+0000 7f3b557149c0 10 moving default.rgw.meta+root+.bucket.meta.abort-at-init-indext:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.21 to cache LRU end 2024-09-14T11:34:24.177 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:24.177+0000 7f3b557149c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:34:24.177 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:24.177+0000 7f3b557149c0 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-init-indext:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.21, ofs0, ns] 2024-09-14T11:34:24.177 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:24.177+0000 7f3a36ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366180 cookie 94372202372032 notifier 5954 bl.length()=913 2024-09-14T11:34:24.177 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:24.177+0000 7f3a36ffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-init-indext:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.21 info.flags=0x17 2024-09-14T11:34:24.177 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:24.177+0000 7f3a36ffd640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-init-indext:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.21 to cache LRU end 2024-09-14T11:34:24.177 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:24.177+0000 7f3a36ffd640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:34:24.179 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:24.181+0000 7f3b557149c0 20 handle_bi_update(): bucket=:abort-at-init-indext[d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.21]): orig_sources= new_sources= 2024-09-14T11:34:24.179 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:24.181+0000 7f3b557149c0 20 handle_bi_update(): bucket=:abort-at-init-indext[d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.21]): potential sources added=[] removed=[] 2024-09-14T11:34:24.179 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:24.181+0000 7f3b557149c0 20 handle_bi_update(): bucket=:abort-at-init-indext[d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.21]): orig_dests= new_dests= 2024-09-14T11:34:24.179 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:24.181+0000 7f3b557149c0 20 handle_bi_update(): bucket=:abort-at-init-indext[d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.21]): potential dests added=[] removed=[] 2024-09-14T11:34:24.185 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:24.185+0000 7f3b557149c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.21.0 2024-09-14T11:34:24.186 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:24.185+0000 7f3b557149c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.21.1 2024-09-14T11:34:24.186 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:24.185+0000 7f3b557149c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.21.2 2024-09-14T11:34:24.187 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:24.189+0000 7f3b557149c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.21.3 2024-09-14T11:34:24.187 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:24.189+0000 7f3b557149c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.21.4 2024-09-14T11:34:24.188 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:24.189+0000 7f3b557149c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.21.5 2024-09-14T11:34:24.188 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:24.189+0000 7f3b557149c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.21.6 2024-09-14T11:34:24.189 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:24.189+0000 7f3b557149c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.21.7 2024-09-14T11:34:24.190 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:24.193+0000 7f3b557149c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.21.8 2024-09-14T11:34:24.191 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:24.193+0000 7f3b557149c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.21.9 2024-09-14T11:34:24.192 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:24.193+0000 7f3b557149c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.21.10 2024-09-14T11:34:24.192 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:24.193+0000 7f3b557149c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-init-indext:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.21 : hit (requested=0x17, cached=0x17) 2024-09-14T11:34:24.193 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:24.193+0000 7f3b557149c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-init-indext:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.21 2024-09-14T11:34:24.194 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:24.197+0000 7f3b557149c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-init-indext:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.21 info.flags=0x17 2024-09-14T11:34:24.195 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:24.197+0000 7f3b557149c0 10 moving default.rgw.meta+root+.bucket.meta.abort-at-init-indext:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.21 to cache LRU end 2024-09-14T11:34:24.195 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:24.197+0000 7f3b557149c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:34:24.195 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:24.197+0000 7f3b557149c0 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-init-indext:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.21, ofs0, ns] 2024-09-14T11:34:24.195 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:24.197+0000 7f3a36ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366181 cookie 94372202372032 notifier 5954 bl.length()=881 2024-09-14T11:34:24.195 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:24.197+0000 7f3a36ffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-init-indext:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.21 info.flags=0x17 2024-09-14T11:34:24.195 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:24.197+0000 7f3a36ffd640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-init-indext:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.21 to cache LRU end 2024-09-14T11:34:24.195 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:24.197+0000 7f3a36ffd640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:34:24.197 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:24.197+0000 7f3b557149c0 20 handle_bi_update(): bucket=:abort-at-init-indext[d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.21]): orig_sources= new_sources= 2024-09-14T11:34:24.197 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:24.197+0000 7f3b557149c0 20 handle_bi_update(): bucket=:abort-at-init-indext[d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.21]): potential sources added=[] removed=[] 2024-09-14T11:34:24.198 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:24.197+0000 7f3b557149c0 20 handle_bi_update(): bucket=:abort-at-init-indext[d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.21]): orig_dests= new_dests= 2024-09-14T11:34:24.198 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:24.197+0000 7f3b557149c0 20 handle_bi_update(): bucket=:abort-at-init-indext[d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.21]): potential dests added=[] removed=[] 2024-09-14T11:34:24.203 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:24.205+0000 7f3b557149c0 1 execute INFO: reshard of bucket "abort-at-init-indext" from 11 shards to 12 shards completed successfully 2024-09-14T11:34:24.206 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:24.209+0000 7f3a09fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:34:24.211 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:24.213+0000 7f3b557149c0 20 remove_watcher() i=0 2024-09-14T11:34:24.211 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:24.213+0000 7f3b557149c0 2 removed watcher, disabling cache 2024-09-14T11:34:24.213 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:24.213+0000 7f3b557149c0 20 remove_watcher() i=1 2024-09-14T11:34:24.215 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:24.217+0000 7f3b557149c0 20 remove_watcher() i=2 2024-09-14T11:34:24.217 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:24.217+0000 7f3b557149c0 20 remove_watcher() i=3 2024-09-14T11:34:24.219 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:24.221+0000 7f3b557149c0 20 remove_watcher() i=4 2024-09-14T11:34:24.221 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:24.221+0000 7f3b557149c0 20 remove_watcher() i=5 2024-09-14T11:34:24.222 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:24.225+0000 7f3b557149c0 20 remove_watcher() i=6 2024-09-14T11:34:24.224 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:24.225+0000 7f3b557149c0 20 remove_watcher() i=7 2024-09-14T11:34:24.239 INFO:tasks.workunit.client.0.smithi138.stderr:radosgw-admin bucket stats --bucket abort-at-init-indext 2024-09-14T11:34:24.270 INFO:tasks.workunit.client.0.smithi138.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:34:24.270 INFO:tasks.workunit.client.0.smithi138.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:34:24.314 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:24.317+0000 7f3ae2e889c0 20 rados->read ofs=0 len=0 2024-09-14T11:34:24.316 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:24.317+0000 7f3ae2e889c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:34:24.317 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:24.317+0000 7f3ae2e889c0 20 realm 2024-09-14T11:34:24.317 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:24.317+0000 7f3ae2e889c0 20 rados->read ofs=0 len=0 2024-09-14T11:34:24.317 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:24.317+0000 7f3ae2e889c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:34:24.317 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:24.317+0000 7f3ae2e889c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:34:24.317 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:24.317+0000 7f3ae2e889c0 20 rados->read ofs=0 len=0 2024-09-14T11:34:24.317 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:24.317+0000 7f3ae2e889c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:34:24.317 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:24.317+0000 7f3ae2e889c0 20 rados->read ofs=0 len=0 2024-09-14T11:34:24.318 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:24.321+0000 7f3ae2e889c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:34:24.318 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:24.321+0000 7f3ae2e889c0 20 rados->read ofs=0 len=0 2024-09-14T11:34:24.319 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:24.321+0000 7f3ae2e889c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:34:24.319 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:24.321+0000 7f3ae2e889c0 20 searching for the correct realm 2024-09-14T11:34:24.323 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:24.325+0000 7f3ae118f640 0 -- 172.21.15.138:0/3223237611 >> [v2:172.21.15.154:6824/416768175,v1:172.21.15.154:6825/416768175] conn(0x7f3ad807f040 msgr2=0x7f3ad805cbc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:34:24.330 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:24.329+0000 7f3ae018d640 0 -- 172.21.15.138:0/3223237611 >> [v2:172.21.15.138:6816/326481658,v1:172.21.15.138:6817/326481658] conn(0x7f3ad804b130 msgr2=0x7f3ad8066d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:34:24.544 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:24.545+0000 7f3ae2e889c0 20 RGWRados::pool_iterate: got zone_info.d9e72d30-c60b-4d0d-9267-fdc36392d5ad 2024-09-14T11:34:24.544 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:24.545+0000 7f3ae2e889c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:34:24.545 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:24.545+0000 7f3ae2e889c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:34:24.545 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:24.545+0000 7f3ae2e889c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:34:24.545 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:24.545+0000 7f3ae2e889c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:34:24.545 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:24.545+0000 7f3ae2e889c0 20 RGWRados::pool_iterate: got zonegroup_info.65ab941b-da8c-4160-94fb-3672b069d44f 2024-09-14T11:34:24.545 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:24.545+0000 7f3ae2e889c0 20 rados->read ofs=0 len=0 2024-09-14T11:34:24.545 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:24.545+0000 7f3ae2e889c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:34:24.545 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:24.545+0000 7f3ae2e889c0 20 rados->read ofs=0 len=0 2024-09-14T11:34:24.545 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:24.545+0000 7f3ae2e889c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:34:24.545 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:24.545+0000 7f3ae2e889c0 20 rados->read ofs=0 len=0 2024-09-14T11:34:24.546 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:24.549+0000 7f3ae2e889c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:34:24.546 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:24.549+0000 7f3ae2e889c0 20 zone default found 2024-09-14T11:34:24.547 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:24.549+0000 7f3ae2e889c0 4 Realm: () 2024-09-14T11:34:24.547 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:24.549+0000 7f3ae2e889c0 4 ZoneGroup: default (65ab941b-da8c-4160-94fb-3672b069d44f) 2024-09-14T11:34:24.547 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:24.549+0000 7f3ae2e889c0 4 Zone: default (d9e72d30-c60b-4d0d-9267-fdc36392d5ad) 2024-09-14T11:34:24.547 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:24.549+0000 7f3ae2e889c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:34:24.547 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:24.549+0000 7f3ae2e889c0 20 zonegroup default 2024-09-14T11:34:24.547 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:24.549+0000 7f3ae2e889c0 20 rados->read ofs=0 len=0 2024-09-14T11:34:24.547 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:24.549+0000 7f3ae2e889c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:34:24.547 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:24.549+0000 7f3ae2e889c0 20 rados->read ofs=0 len=0 2024-09-14T11:34:24.548 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:24.549+0000 7f3ae2e889c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:34:24.548 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:24.549+0000 7f3ae2e889c0 20 rados->read ofs=0 len=0 2024-09-14T11:34:24.549 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:24.549+0000 7f3ae2e889c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:34:24.549 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:24.549+0000 7f3ae2e889c0 20 started sync module instance, tier type = 2024-09-14T11:34:24.549 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:24.549+0000 7f3ae2e889c0 20 started zone id=d9e72d30-c60b-4d0d-9267-fdc36392d5ad (name=default) with tier type = 2024-09-14T11:34:24.573 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:24.573+0000 7f3ae2e889c0 20 add_watcher() i=0 2024-09-14T11:34:24.573 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:24.573+0000 7f3ae2e889c0 20 add_watcher() i=1 2024-09-14T11:34:24.573 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:24.573+0000 7f3ae2e889c0 20 add_watcher() i=2 2024-09-14T11:34:24.573 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:24.573+0000 7f3ae2e889c0 20 add_watcher() i=3 2024-09-14T11:34:24.574 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:24.573+0000 7f3ae2e889c0 20 add_watcher() i=4 2024-09-14T11:34:24.574 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:24.573+0000 7f3ae2e889c0 20 add_watcher() i=5 2024-09-14T11:34:24.574 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:24.573+0000 7f3ae2e889c0 20 add_watcher() i=6 2024-09-14T11:34:24.576 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:24.577+0000 7f3ae2e889c0 20 add_watcher() i=7 2024-09-14T11:34:24.576 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:24.577+0000 7f3ae2e889c0 2 all 8 watchers are set, enabling cache 2024-09-14T11:34:24.580 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:24.581+0000 7f3996fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:34:24.581 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:24.581+0000 7f3ae2e889c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:34:24.581 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:24.581+0000 7f3ae2e889c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:34:24.581 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:24.581+0000 7f3ae2e889c0 5 note: GC not initialized 2024-09-14T11:34:24.581 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:24.581+0000 7f3995fe3640 20 reqs_thread_entry: start 2024-09-14T11:34:24.581 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:24.581+0000 7f3ae2e889c0 20 init_complete bucket index max shards: 11 2024-09-14T11:34:24.582 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:24.581+0000 7f3ae2e889c0 20 Filter name: none 2024-09-14T11:34:24.582 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:24.581+0000 7f39077fe640 20 reqs_thread_entry: start 2024-09-14T11:34:24.582 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:24.585+0000 7f3ae2e889c0 20 rados->read ofs=0 len=0 2024-09-14T11:34:24.582 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:24.585+0000 7f3ae2e889c0 20 rados_obj.operate() r=0 bl.length=188 2024-09-14T11:34:24.583 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:24.585+0000 7f3ae2e889c0 20 rados->read ofs=0 len=0 2024-09-14T11:34:24.584 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:24.585+0000 7f3ae2e889c0 20 rados_obj.operate() r=0 bl.length=410 2024-09-14T11:34:24.584 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:24.585+0000 7f3ae2e889c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:34:24.584 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:24.585+0000 7f3ae2e889c0 20 rados->read ofs=0 len=0 2024-09-14T11:34:24.584 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:24.585+0000 7f3ae2e889c0 20 rados_obj.operate() r=0 bl.length=188 2024-09-14T11:34:24.584 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:24.585+0000 7f3ae2e889c0 20 rados->read ofs=0 len=0 2024-09-14T11:34:24.585 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:24.585+0000 7f3ae2e889c0 20 rados_obj.operate() r=0 bl.length=410 2024-09-14T11:34:24.585 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:24.585+0000 7f3ae2e889c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:34:24.588 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:24.589+0000 7f3996fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:34:24.592 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:24.593+0000 7f3ae2e889c0 20 remove_watcher() i=0 2024-09-14T11:34:24.592 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:24.593+0000 7f3ae2e889c0 2 removed watcher, disabling cache 2024-09-14T11:34:24.594 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:24.593+0000 7f3ae2e889c0 20 remove_watcher() i=1 2024-09-14T11:34:24.597 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:24.597+0000 7f3ae2e889c0 20 remove_watcher() i=2 2024-09-14T11:34:24.599 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:24.601+0000 7f3ae2e889c0 20 remove_watcher() i=3 2024-09-14T11:34:24.602 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:24.601+0000 7f3ae2e889c0 20 remove_watcher() i=4 2024-09-14T11:34:24.603 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:24.605+0000 7f3ae2e889c0 20 remove_watcher() i=5 2024-09-14T11:34:24.605 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:24.605+0000 7f3ae2e889c0 20 remove_watcher() i=6 2024-09-14T11:34:24.606 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:24.605+0000 7f3ae2e889c0 20 remove_watcher() i=7 2024-09-14T11:34:24.621 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-14T11:34:24.621 INFO:tasks.workunit.client.0.smithi138.stderr:BUCKET_STATS: 2024-09-14T11:34:24.621 INFO:tasks.workunit.client.0.smithi138.stderr:bucket: abort-at-init-indext id: d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.21 num_objects: 19 size_kb: 1 num_shards: 12 2024-09-14T11:34:24.621 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-14T11:34:24.622 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:34:24.622 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-14T11:34:24.658 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:34:24.658 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-14T11:34:25.141 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:34:25.141 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-14T11:34:25.523 INFO:tasks.workunit.client.0.smithi138.stderr:TEST: reshard bucket with EIO injected at set_target_layout 2024-09-14T11:34:25.524 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-14T11:34:25.526 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:34:25.526 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-14T11:34:25.667 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:34:25.667 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-14T11:34:25.760 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:34:25.761 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-14T11:34:25.864 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:34:25.864 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-14T11:34:25.956 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:34:25.956 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-14T11:34:26.036 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:34:26.036 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-14T11:34:26.130 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:34:26.130 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-14T11:34:26.219 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:34:26.220 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-14T11:34:26.312 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:34:26.312 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-14T11:34:26.403 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:34:26.403 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-14T11:34:26.495 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:34:26.495 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-14T11:34:26.565 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:34:26.565 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-14T11:34:26.657 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:34:26.657 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-14T11:34:26.735 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:34:26.735 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-14T11:34:26.819 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:34:26.819 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-14T11:34:26.912 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:34:26.912 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-14T11:34:27.007 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:34:27.007 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-14T11:34:27.110 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:34:27.110 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-14T11:34:27.194 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:34:27.194 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-14T11:34:27.271 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:34:27.271 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-14T11:34:27.365 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:34:27.366 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-14T11:34:27.459 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:34:27.460 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-14T11:34:27.547 INFO:tasks.workunit.client.0.smithi138.stderr:radosgw-admin bucket stats --bucket error-at-set-target-layout 2024-09-14T11:34:27.580 INFO:tasks.workunit.client.0.smithi138.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:34:27.581 INFO:tasks.workunit.client.0.smithi138.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:34:27.820 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:27.821+0000 7f9139927640 0 --2- 172.21.15.138:0/2717196217 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x55799d5c8e50 0x55799d5c92d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request get_initial_auth_request returned -2 2024-09-14T11:34:27.836 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:27.837+0000 7f913be219c0 20 rados->read ofs=0 len=0 2024-09-14T11:34:27.838 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:27.837+0000 7f913be219c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:34:27.838 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:27.837+0000 7f913be219c0 20 realm 2024-09-14T11:34:27.838 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:27.837+0000 7f913be219c0 20 rados->read ofs=0 len=0 2024-09-14T11:34:27.839 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:27.841+0000 7f913be219c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:34:27.839 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:27.841+0000 7f913be219c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:34:27.839 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:27.841+0000 7f913be219c0 20 rados->read ofs=0 len=0 2024-09-14T11:34:27.839 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:27.841+0000 7f913be219c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:34:27.839 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:27.841+0000 7f913be219c0 20 rados->read ofs=0 len=0 2024-09-14T11:34:27.840 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:27.841+0000 7f913be219c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:34:27.841 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:27.841+0000 7f913be219c0 20 rados->read ofs=0 len=0 2024-09-14T11:34:27.841 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:27.841+0000 7f913be219c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:34:27.842 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:27.841+0000 7f913be219c0 20 searching for the correct realm 2024-09-14T11:34:27.843 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:27.845+0000 7f9139126640 0 -- 172.21.15.138:0/505455185 >> [v2:172.21.15.154:6808/1468088432,v1:172.21.15.154:6809/1468088432] conn(0x7f912c042600 msgr2=0x7f912c041fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:34:28.058 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:28.061+0000 7f913a128640 0 -- 172.21.15.138:0/505455185 >> [v2:172.21.15.138:6824/2633984942,v1:172.21.15.138:6825/2633984942] conn(0x55799d6385e0 msgr2=0x55799d63a9d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:34:28.075 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:28.077+0000 7f913be219c0 20 RGWRados::pool_iterate: got zone_info.d9e72d30-c60b-4d0d-9267-fdc36392d5ad 2024-09-14T11:34:28.075 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:28.077+0000 7f913be219c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:34:28.075 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:28.077+0000 7f913be219c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:34:28.075 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:28.077+0000 7f913be219c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:34:28.075 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:28.077+0000 7f913be219c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:34:28.075 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:28.077+0000 7f913be219c0 20 RGWRados::pool_iterate: got zonegroup_info.65ab941b-da8c-4160-94fb-3672b069d44f 2024-09-14T11:34:28.075 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:28.077+0000 7f913be219c0 20 rados->read ofs=0 len=0 2024-09-14T11:34:28.076 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:28.077+0000 7f913be219c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:34:28.076 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:28.077+0000 7f913be219c0 20 rados->read ofs=0 len=0 2024-09-14T11:34:28.076 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:28.077+0000 7f913be219c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:34:28.077 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:28.077+0000 7f913be219c0 20 rados->read ofs=0 len=0 2024-09-14T11:34:28.078 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:28.077+0000 7f913be219c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:34:28.078 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:28.077+0000 7f913be219c0 20 zone default found 2024-09-14T11:34:28.078 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:28.077+0000 7f913be219c0 4 Realm: () 2024-09-14T11:34:28.078 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:28.077+0000 7f913be219c0 4 ZoneGroup: default (65ab941b-da8c-4160-94fb-3672b069d44f) 2024-09-14T11:34:28.078 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:28.077+0000 7f913be219c0 4 Zone: default (d9e72d30-c60b-4d0d-9267-fdc36392d5ad) 2024-09-14T11:34:28.078 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:28.077+0000 7f913be219c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:34:28.078 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:28.077+0000 7f913be219c0 20 zonegroup default 2024-09-14T11:34:28.078 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:28.077+0000 7f913be219c0 20 rados->read ofs=0 len=0 2024-09-14T11:34:28.079 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:28.077+0000 7f913be219c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:34:28.079 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:28.081+0000 7f913be219c0 20 rados->read ofs=0 len=0 2024-09-14T11:34:28.079 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:28.081+0000 7f913be219c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:34:28.079 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:28.081+0000 7f913be219c0 20 rados->read ofs=0 len=0 2024-09-14T11:34:28.080 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:28.081+0000 7f913be219c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:34:28.080 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:28.081+0000 7f913be219c0 20 started sync module instance, tier type = 2024-09-14T11:34:28.080 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:28.081+0000 7f913be219c0 20 started zone id=d9e72d30-c60b-4d0d-9267-fdc36392d5ad (name=default) with tier type = 2024-09-14T11:34:28.103 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:28.105+0000 7f913be219c0 20 add_watcher() i=0 2024-09-14T11:34:28.103 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:28.105+0000 7f913be219c0 20 add_watcher() i=1 2024-09-14T11:34:28.103 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:28.105+0000 7f913be219c0 20 add_watcher() i=2 2024-09-14T11:34:28.103 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:28.105+0000 7f913be219c0 20 add_watcher() i=3 2024-09-14T11:34:28.103 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:28.105+0000 7f913be219c0 20 add_watcher() i=4 2024-09-14T11:34:28.103 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:28.105+0000 7f913be219c0 20 add_watcher() i=5 2024-09-14T11:34:28.103 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:28.105+0000 7f913be219c0 20 add_watcher() i=6 2024-09-14T11:34:28.105 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:28.105+0000 7f913be219c0 20 add_watcher() i=7 2024-09-14T11:34:28.105 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:28.105+0000 7f913be219c0 2 all 8 watchers are set, enabling cache 2024-09-14T11:34:28.109 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:28.109+0000 7f8feb7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:34:28.110 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:28.109+0000 7f913be219c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:34:28.110 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:28.109+0000 7f913be219c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:34:28.110 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:28.109+0000 7f913be219c0 5 note: GC not initialized 2024-09-14T11:34:28.111 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:28.113+0000 7f8fea7fc640 20 reqs_thread_entry: start 2024-09-14T11:34:28.111 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:28.113+0000 7f913be219c0 20 init_complete bucket index max shards: 11 2024-09-14T11:34:28.111 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:28.113+0000 7f913be219c0 20 Filter name: none 2024-09-14T11:34:28.112 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:28.113+0000 7f8f5bfff640 20 reqs_thread_entry: start 2024-09-14T11:34:28.112 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:28.113+0000 7f913be219c0 20 rados->read ofs=0 len=0 2024-09-14T11:34:28.112 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:28.113+0000 7f913be219c0 20 rados_obj.operate() r=0 bl.length=194 2024-09-14T11:34:28.112 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:28.113+0000 7f913be219c0 20 rados->read ofs=0 len=0 2024-09-14T11:34:28.113 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:28.113+0000 7f913be219c0 20 rados_obj.operate() r=0 bl.length=416 2024-09-14T11:34:28.113 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:28.113+0000 7f913be219c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:34:28.113 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:28.113+0000 7f913be219c0 20 rados->read ofs=0 len=0 2024-09-14T11:34:28.114 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:28.113+0000 7f913be219c0 20 rados_obj.operate() r=0 bl.length=194 2024-09-14T11:34:28.114 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:28.113+0000 7f913be219c0 20 rados->read ofs=0 len=0 2024-09-14T11:34:28.114 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:28.117+0000 7f913be219c0 20 rados_obj.operate() r=0 bl.length=416 2024-09-14T11:34:28.115 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:28.117+0000 7f913be219c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:34:28.117 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:28.117+0000 7f8feb7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:34:28.122 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:28.125+0000 7f913be219c0 20 remove_watcher() i=0 2024-09-14T11:34:28.123 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:28.125+0000 7f913be219c0 2 removed watcher, disabling cache 2024-09-14T11:34:28.125 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:28.125+0000 7f913be219c0 20 remove_watcher() i=1 2024-09-14T11:34:28.127 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:28.129+0000 7f913be219c0 20 remove_watcher() i=2 2024-09-14T11:34:28.130 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:28.129+0000 7f913be219c0 20 remove_watcher() i=3 2024-09-14T11:34:28.132 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:28.133+0000 7f913be219c0 20 remove_watcher() i=4 2024-09-14T11:34:28.133 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:28.133+0000 7f913be219c0 20 remove_watcher() i=5 2024-09-14T11:34:28.134 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:28.137+0000 7f913be219c0 20 remove_watcher() i=6 2024-09-14T11:34:28.136 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:28.137+0000 7f913be219c0 20 remove_watcher() i=7 2024-09-14T11:34:28.152 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-14T11:34:28.152 INFO:tasks.workunit.client.0.smithi138.stderr:BUCKET_STATS: 2024-09-14T11:34:28.152 INFO:tasks.workunit.client.0.smithi138.stderr:bucket: error-at-set-target-layout id: d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.22 num_objects: 20 size_kb: 1 num_shards: 11 2024-09-14T11:34:28.152 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-14T11:34:28.153 INFO:tasks.workunit.client.0.smithi138.stderr:radosgw-admin bucket reshard --bucket error-at-set-target-layout --num-shards 12 --rgw-reshard-bucket-lock-duration 30 --inject-error-at set_target_layout 2024-09-14T11:34:28.189 INFO:tasks.workunit.client.0.smithi138.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:34:28.189 INFO:tasks.workunit.client.0.smithi138.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:34:28.234 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:28.233+0000 7fb36eb4b9c0 20 rados->read ofs=0 len=0 2024-09-14T11:34:28.235 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:28.237+0000 7fb36eb4b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:34:28.235 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:28.237+0000 7fb36eb4b9c0 20 realm 2024-09-14T11:34:28.235 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:28.237+0000 7fb36eb4b9c0 20 rados->read ofs=0 len=0 2024-09-14T11:34:28.236 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:28.237+0000 7fb36eb4b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:34:28.236 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:28.237+0000 7fb36eb4b9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:34:28.236 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:28.237+0000 7fb36eb4b9c0 20 rados->read ofs=0 len=0 2024-09-14T11:34:28.236 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:28.237+0000 7fb36eb4b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:34:28.236 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:28.237+0000 7fb36eb4b9c0 20 rados->read ofs=0 len=0 2024-09-14T11:34:28.237 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:28.237+0000 7fb36eb4b9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:34:28.237 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:28.237+0000 7fb36eb4b9c0 20 rados->read ofs=0 len=0 2024-09-14T11:34:28.238 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:28.241+0000 7fb36eb4b9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:34:28.238 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:28.241+0000 7fb36eb4b9c0 20 searching for the correct realm 2024-09-14T11:34:28.242 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:28.241+0000 7fb36ce52640 0 -- 172.21.15.138:0/2281947724 >> [v2:172.21.15.154:6824/416768175,v1:172.21.15.154:6825/416768175] conn(0x7fb36411a040 msgr2=0x7fb3640fcfe0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:34:28.456 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:28.457+0000 7fb36be50640 0 -- 172.21.15.138:0/2281947724 >> [v2:172.21.15.138:6816/326481658,v1:172.21.15.138:6817/326481658] conn(0x7fb3640fe570 msgr2=0x7fb3640ffaa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-14T11:34:28.673 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:28.673+0000 7fb36eb4b9c0 20 RGWRados::pool_iterate: got zone_info.d9e72d30-c60b-4d0d-9267-fdc36392d5ad 2024-09-14T11:34:28.673 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:28.673+0000 7fb36eb4b9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:34:28.674 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:28.673+0000 7fb36eb4b9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:34:28.674 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:28.673+0000 7fb36eb4b9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:34:28.674 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:28.673+0000 7fb36eb4b9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:34:28.674 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:28.673+0000 7fb36eb4b9c0 20 RGWRados::pool_iterate: got zonegroup_info.65ab941b-da8c-4160-94fb-3672b069d44f 2024-09-14T11:34:28.674 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:28.673+0000 7fb36eb4b9c0 20 rados->read ofs=0 len=0 2024-09-14T11:34:28.674 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:28.673+0000 7fb36eb4b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:34:28.674 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:28.673+0000 7fb36eb4b9c0 20 rados->read ofs=0 len=0 2024-09-14T11:34:28.675 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:28.677+0000 7fb36eb4b9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:34:28.675 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:28.677+0000 7fb36eb4b9c0 20 rados->read ofs=0 len=0 2024-09-14T11:34:28.676 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:28.677+0000 7fb36eb4b9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:34:28.676 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:28.677+0000 7fb36eb4b9c0 20 zone default found 2024-09-14T11:34:28.676 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:28.677+0000 7fb36eb4b9c0 4 Realm: () 2024-09-14T11:34:28.676 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:28.677+0000 7fb36eb4b9c0 4 ZoneGroup: default (65ab941b-da8c-4160-94fb-3672b069d44f) 2024-09-14T11:34:28.676 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:28.677+0000 7fb36eb4b9c0 4 Zone: default (d9e72d30-c60b-4d0d-9267-fdc36392d5ad) 2024-09-14T11:34:28.676 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:28.677+0000 7fb36eb4b9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:34:28.676 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:28.677+0000 7fb36eb4b9c0 20 zonegroup default 2024-09-14T11:34:28.676 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:28.677+0000 7fb36eb4b9c0 20 rados->read ofs=0 len=0 2024-09-14T11:34:28.677 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:28.677+0000 7fb36eb4b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:34:28.677 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:28.677+0000 7fb36eb4b9c0 20 rados->read ofs=0 len=0 2024-09-14T11:34:28.677 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:28.677+0000 7fb36eb4b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:34:28.678 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:28.677+0000 7fb36eb4b9c0 20 rados->read ofs=0 len=0 2024-09-14T11:34:28.678 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:28.681+0000 7fb36eb4b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:34:28.678 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:28.681+0000 7fb36eb4b9c0 20 started sync module instance, tier type = 2024-09-14T11:34:28.678 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:28.681+0000 7fb36eb4b9c0 20 started zone id=d9e72d30-c60b-4d0d-9267-fdc36392d5ad (name=default) with tier type = 2024-09-14T11:34:28.703 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:28.705+0000 7fb36eb4b9c0 20 add_watcher() i=0 2024-09-14T11:34:28.703 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:28.705+0000 7fb36eb4b9c0 20 add_watcher() i=1 2024-09-14T11:34:28.703 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:28.705+0000 7fb36eb4b9c0 20 add_watcher() i=2 2024-09-14T11:34:28.703 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:28.705+0000 7fb36eb4b9c0 20 add_watcher() i=3 2024-09-14T11:34:28.703 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:28.705+0000 7fb36eb4b9c0 20 add_watcher() i=4 2024-09-14T11:34:28.703 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:28.705+0000 7fb36eb4b9c0 20 add_watcher() i=5 2024-09-14T11:34:28.703 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:28.705+0000 7fb36eb4b9c0 20 add_watcher() i=6 2024-09-14T11:34:28.705 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:28.705+0000 7fb36eb4b9c0 20 add_watcher() i=7 2024-09-14T11:34:28.705 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:28.705+0000 7fb36eb4b9c0 2 all 8 watchers are set, enabling cache 2024-09-14T11:34:28.709 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:28.709+0000 7fb222fdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:34:28.710 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:28.709+0000 7fb36eb4b9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:34:28.710 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:28.709+0000 7fb36eb4b9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:34:28.710 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:28.713+0000 7fb36eb4b9c0 5 note: GC not initialized 2024-09-14T11:34:28.711 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:28.713+0000 7fb221fdb640 20 reqs_thread_entry: start 2024-09-14T11:34:28.711 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:28.713+0000 7fb36eb4b9c0 20 init_complete bucket index max shards: 11 2024-09-14T11:34:28.711 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:28.713+0000 7fb36eb4b9c0 20 Filter name: none 2024-09-14T11:34:28.711 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:28.713+0000 7fb1937fe640 20 reqs_thread_entry: start 2024-09-14T11:34:28.712 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:28.713+0000 7fb36eb4b9c0 10 cache get: name=default.rgw.meta+root+error-at-set-target-layout : miss 2024-09-14T11:34:28.712 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:28.713+0000 7fb36eb4b9c0 20 rados->read ofs=0 len=0 2024-09-14T11:34:28.712 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:28.713+0000 7fb36eb4b9c0 20 rados_obj.operate() r=0 bl.length=194 2024-09-14T11:34:28.713 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:28.713+0000 7fb36eb4b9c0 10 cache put: name=default.rgw.meta+root+error-at-set-target-layout info.flags=0x11 2024-09-14T11:34:28.713 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:28.713+0000 7fb36eb4b9c0 10 adding default.rgw.meta+root+error-at-set-target-layout to cache LRU end 2024-09-14T11:34:28.713 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:28.713+0000 7fb36eb4b9c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.22 : miss 2024-09-14T11:34:28.713 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:28.713+0000 7fb36eb4b9c0 20 rados->read ofs=0 len=0 2024-09-14T11:34:28.713 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:28.713+0000 7fb36eb4b9c0 20 rados_obj.operate() r=0 bl.length=416 2024-09-14T11:34:28.713 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:28.713+0000 7fb36eb4b9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.22 info.flags=0x17 2024-09-14T11:34:28.714 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:28.713+0000 7fb36eb4b9c0 10 adding default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.22 to cache LRU end 2024-09-14T11:34:28.714 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:28.713+0000 7fb36eb4b9c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:34:28.714 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:28.713+0000 7fb36eb4b9c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:34:28.714 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:28.713+0000 7fb36eb4b9c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.22 2024-09-14T11:34:28.723 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:28.725+0000 7fb36eb4b9c0 -1 Injecting error=-5 at location=set_target_layout 2024-09-14T11:34:28.723 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:28.725+0000 7fb36eb4b9c0 0 ERROR: init_target_layout failed to write target index layout to bucket info: (5) Input/output error 2024-09-14T11:34:28.732 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:28.733+0000 7fb222fdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:34:28.738 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:28.737+0000 7fb36eb4b9c0 20 remove_watcher() i=0 2024-09-14T11:34:28.738 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:28.737+0000 7fb36eb4b9c0 2 removed watcher, disabling cache 2024-09-14T11:34:28.739 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:28.741+0000 7fb36eb4b9c0 20 remove_watcher() i=1 2024-09-14T11:34:28.742 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:28.741+0000 7fb36eb4b9c0 20 remove_watcher() i=2 2024-09-14T11:34:28.744 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:28.745+0000 7fb36eb4b9c0 20 remove_watcher() i=3 2024-09-14T11:34:28.746 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:28.749+0000 7fb36eb4b9c0 20 remove_watcher() i=4 2024-09-14T11:34:28.748 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:28.749+0000 7fb36eb4b9c0 20 remove_watcher() i=5 2024-09-14T11:34:28.749 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:28.749+0000 7fb36eb4b9c0 20 remove_watcher() i=6 2024-09-14T11:34:28.751 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:28.753+0000 7fb36eb4b9c0 20 remove_watcher() i=7 2024-09-14T11:34:28.774 INFO:tasks.workunit.client.0.smithi138.stderr:radosgw-admin bucket stats --bucket error-at-set-target-layout 2024-09-14T11:34:28.806 INFO:tasks.workunit.client.0.smithi138.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:34:28.806 INFO:tasks.workunit.client.0.smithi138.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:34:28.852 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:28.853+0000 7f3d4510c9c0 20 rados->read ofs=0 len=0 2024-09-14T11:34:28.854 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:28.853+0000 7f3d4510c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:34:28.854 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:28.853+0000 7f3d4510c9c0 20 realm 2024-09-14T11:34:28.854 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:28.853+0000 7f3d4510c9c0 20 rados->read ofs=0 len=0 2024-09-14T11:34:28.854 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:28.853+0000 7f3d4510c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:34:28.854 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:28.853+0000 7f3d4510c9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:34:28.854 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:28.853+0000 7f3d4510c9c0 20 rados->read ofs=0 len=0 2024-09-14T11:34:28.854 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:28.853+0000 7f3d4510c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:34:28.854 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:28.853+0000 7f3d4510c9c0 20 rados->read ofs=0 len=0 2024-09-14T11:34:28.856 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:28.857+0000 7f3d4510c9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:34:28.856 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:28.857+0000 7f3d4510c9c0 20 rados->read ofs=0 len=0 2024-09-14T11:34:28.857 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:28.857+0000 7f3d4510c9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:34:28.857 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:28.857+0000 7f3d4510c9c0 20 searching for the correct realm 2024-09-14T11:34:28.861 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:28.861+0000 7f3d43413640 0 -- 172.21.15.138:0/3277335931 >> [v2:172.21.15.154:6824/416768175,v1:172.21.15.154:6825/416768175] conn(0x7f3d3c017070 msgr2=0x7f3d3c002d90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:34:28.867 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:28.869+0000 7f3d42411640 0 -- 172.21.15.138:0/3277335931 >> [v2:172.21.15.138:6816/326481658,v1:172.21.15.138:6817/326481658] conn(0x7f3d3c06f270 msgr2=0x7f3d3c0781e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:34:29.086 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:29.085+0000 7f3d4510c9c0 20 RGWRados::pool_iterate: got zone_info.d9e72d30-c60b-4d0d-9267-fdc36392d5ad 2024-09-14T11:34:29.086 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:29.085+0000 7f3d4510c9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:34:29.086 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:29.085+0000 7f3d4510c9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:34:29.086 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:29.085+0000 7f3d4510c9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:34:29.086 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:29.085+0000 7f3d4510c9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:34:29.086 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:29.085+0000 7f3d4510c9c0 20 RGWRados::pool_iterate: got zonegroup_info.65ab941b-da8c-4160-94fb-3672b069d44f 2024-09-14T11:34:29.087 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:29.085+0000 7f3d4510c9c0 20 rados->read ofs=0 len=0 2024-09-14T11:34:29.087 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:29.089+0000 7f3d4510c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:34:29.087 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:29.089+0000 7f3d4510c9c0 20 rados->read ofs=0 len=0 2024-09-14T11:34:29.088 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:29.089+0000 7f3d4510c9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:34:29.088 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:29.089+0000 7f3d4510c9c0 20 rados->read ofs=0 len=0 2024-09-14T11:34:29.088 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:29.089+0000 7f3d4510c9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:34:29.089 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:29.089+0000 7f3d4510c9c0 20 zone default found 2024-09-14T11:34:29.089 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:29.089+0000 7f3d4510c9c0 4 Realm: () 2024-09-14T11:34:29.089 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:29.089+0000 7f3d4510c9c0 4 ZoneGroup: default (65ab941b-da8c-4160-94fb-3672b069d44f) 2024-09-14T11:34:29.089 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:29.089+0000 7f3d4510c9c0 4 Zone: default (d9e72d30-c60b-4d0d-9267-fdc36392d5ad) 2024-09-14T11:34:29.089 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:29.089+0000 7f3d4510c9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:34:29.089 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:29.089+0000 7f3d4510c9c0 20 zonegroup default 2024-09-14T11:34:29.089 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:29.089+0000 7f3d4510c9c0 20 rados->read ofs=0 len=0 2024-09-14T11:34:29.090 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:29.089+0000 7f3d4510c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:34:29.090 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:29.089+0000 7f3d4510c9c0 20 rados->read ofs=0 len=0 2024-09-14T11:34:29.090 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:29.093+0000 7f3d4510c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:34:29.090 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:29.093+0000 7f3d4510c9c0 20 rados->read ofs=0 len=0 2024-09-14T11:34:29.091 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:29.093+0000 7f3d4510c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:34:29.091 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:29.093+0000 7f3d4510c9c0 20 started sync module instance, tier type = 2024-09-14T11:34:29.091 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:29.093+0000 7f3d4510c9c0 20 started zone id=d9e72d30-c60b-4d0d-9267-fdc36392d5ad (name=default) with tier type = 2024-09-14T11:34:29.115 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:29.117+0000 7f3d4510c9c0 20 add_watcher() i=0 2024-09-14T11:34:29.116 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:29.117+0000 7f3d4510c9c0 20 add_watcher() i=1 2024-09-14T11:34:29.116 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:29.117+0000 7f3d4510c9c0 20 add_watcher() i=2 2024-09-14T11:34:29.116 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:29.117+0000 7f3d4510c9c0 20 add_watcher() i=3 2024-09-14T11:34:29.116 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:29.117+0000 7f3d4510c9c0 20 add_watcher() i=4 2024-09-14T11:34:29.116 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:29.117+0000 7f3d4510c9c0 20 add_watcher() i=5 2024-09-14T11:34:29.116 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:29.117+0000 7f3d4510c9c0 20 add_watcher() i=6 2024-09-14T11:34:29.117 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:29.117+0000 7f3d4510c9c0 20 add_watcher() i=7 2024-09-14T11:34:29.118 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:29.117+0000 7f3d4510c9c0 2 all 8 watchers are set, enabling cache 2024-09-14T11:34:29.122 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:29.125+0000 7f3bf97e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:34:29.123 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:29.125+0000 7f3d4510c9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:34:29.123 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:29.125+0000 7f3d4510c9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:34:29.123 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:29.125+0000 7f3d4510c9c0 5 note: GC not initialized 2024-09-14T11:34:29.124 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:29.125+0000 7f3b73fff640 20 reqs_thread_entry: start 2024-09-14T11:34:29.124 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:29.125+0000 7f3d4510c9c0 20 init_complete bucket index max shards: 11 2024-09-14T11:34:29.124 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:29.125+0000 7f3d4510c9c0 20 Filter name: none 2024-09-14T11:34:29.124 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:29.125+0000 7f3b71ffb640 20 reqs_thread_entry: start 2024-09-14T11:34:29.124 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:29.125+0000 7f3d4510c9c0 20 rados->read ofs=0 len=0 2024-09-14T11:34:29.125 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:29.125+0000 7f3d4510c9c0 20 rados_obj.operate() r=0 bl.length=194 2024-09-14T11:34:29.125 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:29.125+0000 7f3d4510c9c0 20 rados->read ofs=0 len=0 2024-09-14T11:34:29.126 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:29.125+0000 7f3d4510c9c0 20 rados_obj.operate() r=0 bl.length=416 2024-09-14T11:34:29.126 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:29.129+0000 7f3d4510c9c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:34:29.126 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:29.129+0000 7f3d4510c9c0 20 rados->read ofs=0 len=0 2024-09-14T11:34:29.127 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:29.129+0000 7f3d4510c9c0 20 rados_obj.operate() r=0 bl.length=194 2024-09-14T11:34:29.127 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:29.129+0000 7f3d4510c9c0 20 rados->read ofs=0 len=0 2024-09-14T11:34:29.128 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:29.129+0000 7f3d4510c9c0 20 rados_obj.operate() r=0 bl.length=416 2024-09-14T11:34:29.128 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:29.129+0000 7f3d4510c9c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:34:29.131 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:29.133+0000 7f3bf97e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:34:29.136 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:29.137+0000 7f3d4510c9c0 20 remove_watcher() i=0 2024-09-14T11:34:29.136 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:29.137+0000 7f3d4510c9c0 2 removed watcher, disabling cache 2024-09-14T11:34:29.138 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:29.141+0000 7f3d4510c9c0 20 remove_watcher() i=1 2024-09-14T11:34:29.140 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:29.141+0000 7f3d4510c9c0 20 remove_watcher() i=2 2024-09-14T11:34:29.142 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:29.145+0000 7f3d4510c9c0 20 remove_watcher() i=3 2024-09-14T11:34:29.145 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:29.145+0000 7f3d4510c9c0 20 remove_watcher() i=4 2024-09-14T11:34:29.147 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:29.149+0000 7f3d4510c9c0 20 remove_watcher() i=5 2024-09-14T11:34:29.148 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:29.149+0000 7f3d4510c9c0 20 remove_watcher() i=6 2024-09-14T11:34:29.150 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:29.149+0000 7f3d4510c9c0 20 remove_watcher() i=7 2024-09-14T11:34:29.166 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-14T11:34:29.166 INFO:tasks.workunit.client.0.smithi138.stderr:BUCKET_STATS: 2024-09-14T11:34:29.166 INFO:tasks.workunit.client.0.smithi138.stderr:bucket: error-at-set-target-layout id: d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.22 num_objects: 20 size_kb: 1 num_shards: 11 2024-09-14T11:34:29.166 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-14T11:34:29.167 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:34:29.168 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-14T11:34:29.206 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:34:29.206 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-14T11:34:29.275 INFO:tasks.workunit.client.0.smithi138.stderr:radosgw-admin bucket reshard --bucket error-at-set-target-layout --num-shards 12 --rgw-reshard-bucket-lock-duration 30 2024-09-14T11:34:29.312 INFO:tasks.workunit.client.0.smithi138.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:34:29.312 INFO:tasks.workunit.client.0.smithi138.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:34:29.358 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:29.361+0000 7f370fadf9c0 20 rados->read ofs=0 len=0 2024-09-14T11:34:29.360 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:29.361+0000 7f370fadf9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:34:29.360 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:29.361+0000 7f370fadf9c0 20 realm 2024-09-14T11:34:29.360 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:29.361+0000 7f370fadf9c0 20 rados->read ofs=0 len=0 2024-09-14T11:34:29.361 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:29.361+0000 7f370fadf9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:34:29.361 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:29.361+0000 7f370fadf9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:34:29.361 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:29.361+0000 7f370fadf9c0 20 rados->read ofs=0 len=0 2024-09-14T11:34:29.361 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:29.361+0000 7f370fadf9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:34:29.361 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:29.361+0000 7f370fadf9c0 20 rados->read ofs=0 len=0 2024-09-14T11:34:29.362 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:29.365+0000 7f370fadf9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:34:29.362 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:29.365+0000 7f370fadf9c0 20 rados->read ofs=0 len=0 2024-09-14T11:34:29.363 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:29.365+0000 7f370fadf9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:34:29.363 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:29.365+0000 7f370fadf9c0 20 searching for the correct realm 2024-09-14T11:34:29.368 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:29.369+0000 7f370cde4640 0 -- 172.21.15.138:0/1492424358 >> [v2:172.21.15.154:6808/1468088432,v1:172.21.15.154:6809/1468088432] conn(0x7f370000ac20 msgr2=0x7f370009b3e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:34:29.373 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:29.373+0000 7f370cde4640 0 -- 172.21.15.138:0/1492424358 >> [v2:172.21.15.138:6816/326481658,v1:172.21.15.138:6817/326481658] conn(0x7f3708008040 msgr2=0x7f3708073750 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:34:29.590 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:29.589+0000 7f370fadf9c0 20 RGWRados::pool_iterate: got zone_info.d9e72d30-c60b-4d0d-9267-fdc36392d5ad 2024-09-14T11:34:29.590 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:29.589+0000 7f370fadf9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:34:29.591 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:29.589+0000 7f370fadf9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:34:29.591 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:29.589+0000 7f370fadf9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:34:29.591 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:29.589+0000 7f370fadf9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:34:29.591 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:29.589+0000 7f370fadf9c0 20 RGWRados::pool_iterate: got zonegroup_info.65ab941b-da8c-4160-94fb-3672b069d44f 2024-09-14T11:34:29.591 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:29.593+0000 7f370fadf9c0 20 rados->read ofs=0 len=0 2024-09-14T11:34:29.591 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:29.593+0000 7f370fadf9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:34:29.591 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:29.593+0000 7f370fadf9c0 20 rados->read ofs=0 len=0 2024-09-14T11:34:29.592 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:29.593+0000 7f370fadf9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:34:29.592 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:29.593+0000 7f370fadf9c0 20 rados->read ofs=0 len=0 2024-09-14T11:34:29.593 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:29.593+0000 7f370fadf9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:34:29.593 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:29.593+0000 7f370fadf9c0 20 zone default found 2024-09-14T11:34:29.593 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:29.593+0000 7f370fadf9c0 4 Realm: () 2024-09-14T11:34:29.593 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:29.593+0000 7f370fadf9c0 4 ZoneGroup: default (65ab941b-da8c-4160-94fb-3672b069d44f) 2024-09-14T11:34:29.593 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:29.593+0000 7f370fadf9c0 4 Zone: default (d9e72d30-c60b-4d0d-9267-fdc36392d5ad) 2024-09-14T11:34:29.593 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:29.593+0000 7f370fadf9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:34:29.593 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:29.593+0000 7f370fadf9c0 20 zonegroup default 2024-09-14T11:34:29.593 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:29.593+0000 7f370fadf9c0 20 rados->read ofs=0 len=0 2024-09-14T11:34:29.594 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:29.593+0000 7f370fadf9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:34:29.594 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:29.593+0000 7f370fadf9c0 20 rados->read ofs=0 len=0 2024-09-14T11:34:29.594 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:29.597+0000 7f370fadf9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:34:29.594 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:29.597+0000 7f370fadf9c0 20 rados->read ofs=0 len=0 2024-09-14T11:34:29.595 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:29.597+0000 7f370fadf9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:34:29.595 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:29.597+0000 7f370fadf9c0 20 started sync module instance, tier type = 2024-09-14T11:34:29.595 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:29.597+0000 7f370fadf9c0 20 started zone id=d9e72d30-c60b-4d0d-9267-fdc36392d5ad (name=default) with tier type = 2024-09-14T11:34:29.618 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:29.617+0000 7f370fadf9c0 20 add_watcher() i=0 2024-09-14T11:34:29.618 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:29.617+0000 7f370fadf9c0 20 add_watcher() i=1 2024-09-14T11:34:29.618 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:29.617+0000 7f370fadf9c0 20 add_watcher() i=2 2024-09-14T11:34:29.618 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:29.617+0000 7f370fadf9c0 20 add_watcher() i=3 2024-09-14T11:34:29.618 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:29.617+0000 7f370fadf9c0 20 add_watcher() i=4 2024-09-14T11:34:29.618 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:29.617+0000 7f370fadf9c0 20 add_watcher() i=5 2024-09-14T11:34:29.618 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:29.617+0000 7f370fadf9c0 20 add_watcher() i=6 2024-09-14T11:34:29.620 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:29.621+0000 7f370fadf9c0 20 add_watcher() i=7 2024-09-14T11:34:29.620 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:29.621+0000 7f370fadf9c0 2 all 8 watchers are set, enabling cache 2024-09-14T11:34:29.624 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:29.625+0000 7f35c37e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:34:29.625 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:29.625+0000 7f370fadf9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:34:29.625 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:29.625+0000 7f370fadf9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:34:29.625 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:29.625+0000 7f370fadf9c0 5 note: GC not initialized 2024-09-14T11:34:29.626 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:29.625+0000 7f35c27e4640 20 reqs_thread_entry: start 2024-09-14T11:34:29.626 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:29.625+0000 7f370fadf9c0 20 init_complete bucket index max shards: 11 2024-09-14T11:34:29.626 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:29.625+0000 7f370fadf9c0 20 Filter name: none 2024-09-14T11:34:29.626 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:29.625+0000 7f3533fff640 20 reqs_thread_entry: start 2024-09-14T11:34:29.626 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:29.629+0000 7f370fadf9c0 10 cache get: name=default.rgw.meta+root+error-at-set-target-layout : miss 2024-09-14T11:34:29.626 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:29.629+0000 7f370fadf9c0 20 rados->read ofs=0 len=0 2024-09-14T11:34:29.627 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:29.629+0000 7f370fadf9c0 20 rados_obj.operate() r=0 bl.length=194 2024-09-14T11:34:29.627 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:29.629+0000 7f370fadf9c0 10 cache put: name=default.rgw.meta+root+error-at-set-target-layout info.flags=0x11 2024-09-14T11:34:29.627 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:29.629+0000 7f370fadf9c0 10 adding default.rgw.meta+root+error-at-set-target-layout to cache LRU end 2024-09-14T11:34:29.627 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:29.629+0000 7f370fadf9c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.22 : miss 2024-09-14T11:34:29.627 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:29.629+0000 7f370fadf9c0 20 rados->read ofs=0 len=0 2024-09-14T11:34:29.628 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:29.629+0000 7f370fadf9c0 20 rados_obj.operate() r=0 bl.length=416 2024-09-14T11:34:29.628 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:29.629+0000 7f370fadf9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.22 info.flags=0x17 2024-09-14T11:34:29.628 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:29.629+0000 7f370fadf9c0 10 adding default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.22 to cache LRU end 2024-09-14T11:34:29.628 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:29.629+0000 7f370fadf9c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:34:29.628 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:29.629+0000 7f370fadf9c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:34:29.628 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:29.629+0000 7f370fadf9c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.22 2024-09-14T11:34:29.641 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:29.641+0000 7f370fadf9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.22 info.flags=0x17 2024-09-14T11:34:29.641 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:29.641+0000 7f370fadf9c0 10 moving default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.22 to cache LRU end 2024-09-14T11:34:29.641 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:29.641+0000 7f370fadf9c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:34:29.641 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:29.641+0000 7f370fadf9c0 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-set-target-layout:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.22, ofs0, ns] 2024-09-14T11:34:29.642 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:29.641+0000 7f35f0ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366187 cookie 94246963798576 notifier 6035 bl.length()=925 2024-09-14T11:34:29.642 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:29.641+0000 7f35f0ff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.22 info.flags=0x17 2024-09-14T11:34:29.642 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:29.641+0000 7f35f0ff9640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.22 to cache LRU end 2024-09-14T11:34:29.642 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:29.641+0000 7f35f0ff9640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:34:29.645 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:29.645+0000 7f370fadf9c0 20 handle_bi_update(): bucket=:error-at-set-target-layout[d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.22]): orig_sources= new_sources= 2024-09-14T11:34:29.646 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:29.645+0000 7f370fadf9c0 20 handle_bi_update(): bucket=:error-at-set-target-layout[d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.22]): potential sources added=[] removed=[] 2024-09-14T11:34:29.646 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:29.645+0000 7f370fadf9c0 20 handle_bi_update(): bucket=:error-at-set-target-layout[d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.22]): orig_dests= new_dests= 2024-09-14T11:34:29.646 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:29.645+0000 7f370fadf9c0 20 handle_bi_update(): bucket=:error-at-set-target-layout[d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.22]): potential dests added=[] removed=[] 2024-09-14T11:34:29.654 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:29.657+0000 7f370fadf9c0 10 bucket_obj is .dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.22.1.0 2024-09-14T11:34:29.654 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:29.657+0000 7f370fadf9c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.22.1.0 2024-09-14T11:34:29.655 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:29.657+0000 7f370fadf9c0 10 bucket_obj is .dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.22.1.1 2024-09-14T11:34:29.655 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:29.657+0000 7f370fadf9c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.22.1.1 2024-09-14T11:34:29.655 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:29.657+0000 7f370fadf9c0 10 bucket_obj is .dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.22.1.2 2024-09-14T11:34:29.655 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:29.657+0000 7f370fadf9c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.22.1.2 2024-09-14T11:34:29.655 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:29.657+0000 7f370fadf9c0 10 bucket_obj is .dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.22.1.3 2024-09-14T11:34:29.655 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:29.657+0000 7f370fadf9c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.22.1.3 2024-09-14T11:34:29.655 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:29.657+0000 7f370fadf9c0 10 bucket_obj is .dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.22.1.4 2024-09-14T11:34:29.655 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:29.657+0000 7f370fadf9c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.22.1.4 2024-09-14T11:34:29.655 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:29.657+0000 7f370fadf9c0 10 bucket_obj is .dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.22.1.5 2024-09-14T11:34:29.655 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:29.657+0000 7f370fadf9c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.22.1.5 2024-09-14T11:34:29.655 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:29.657+0000 7f370fadf9c0 10 bucket_obj is .dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.22.1.6 2024-09-14T11:34:29.655 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:29.657+0000 7f370fadf9c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.22.1.6 2024-09-14T11:34:29.655 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:29.657+0000 7f370fadf9c0 10 bucket_obj is .dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.22.1.7 2024-09-14T11:34:29.655 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:29.657+0000 7f370fadf9c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.22.1.7 2024-09-14T11:34:29.656 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:29.657+0000 7f370fadf9c0 10 bucket_obj is .dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.22.1.8 2024-09-14T11:34:29.656 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:29.657+0000 7f370fadf9c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.22.1.8 2024-09-14T11:34:29.656 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:29.657+0000 7f370fadf9c0 10 bucket_obj is .dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.22.1.9 2024-09-14T11:34:29.656 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:29.657+0000 7f370fadf9c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.22.1.9 2024-09-14T11:34:29.656 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:29.657+0000 7f370fadf9c0 10 bucket_obj is .dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.22.1.10 2024-09-14T11:34:29.656 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:29.657+0000 7f370fadf9c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.22.1.10 2024-09-14T11:34:29.656 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:29.657+0000 7f370fadf9c0 10 bucket_obj is .dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.22.1.11 2024-09-14T11:34:29.656 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:29.657+0000 7f370fadf9c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.22.1.11 2024-09-14T11:34:29.656 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:29.657+0000 7f370fadf9c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.22.0 2024-09-14T11:34:29.657 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:29.657+0000 7f370fadf9c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.22.1 2024-09-14T11:34:29.657 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:29.657+0000 7f370fadf9c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.22.2 2024-09-14T11:34:29.657 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:29.657+0000 7f370fadf9c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.22.3 2024-09-14T11:34:29.657 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:29.657+0000 7f370fadf9c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.22.4 2024-09-14T11:34:29.658 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:29.657+0000 7f370fadf9c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.22.5 2024-09-14T11:34:29.659 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:29.661+0000 7f370fadf9c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.22.6 2024-09-14T11:34:29.659 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:29.661+0000 7f370fadf9c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.22.7 2024-09-14T11:34:29.661 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:29.661+0000 7f370fadf9c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.22.8 2024-09-14T11:34:29.662 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:29.661+0000 7f370fadf9c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.22.9 2024-09-14T11:34:29.663 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:29.665+0000 7f370fadf9c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.22.10 2024-09-14T11:34:29.669 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:29.669+0000 7f370fadf9c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.22 : hit (requested=0x17, cached=0x17) 2024-09-14T11:34:29.670 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:29.669+0000 7f370fadf9c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.22 2024-09-14T11:34:29.672 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:29.673+0000 7f370fadf9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.22 info.flags=0x17 2024-09-14T11:34:29.672 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:29.673+0000 7f370fadf9c0 10 moving default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.22 to cache LRU end 2024-09-14T11:34:29.672 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:29.673+0000 7f370fadf9c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:34:29.672 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:29.673+0000 7f370fadf9c0 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-set-target-layout:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.22, ofs0, ns] 2024-09-14T11:34:29.672 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:29.673+0000 7f35f0ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366188 cookie 94246963798576 notifier 6035 bl.length()=925 2024-09-14T11:34:29.672 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:29.673+0000 7f35f0ff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.22 info.flags=0x17 2024-09-14T11:34:29.672 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:29.673+0000 7f35f0ff9640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.22 to cache LRU end 2024-09-14T11:34:29.673 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:29.673+0000 7f35f0ff9640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:34:29.676 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:29.677+0000 7f370fadf9c0 20 handle_bi_update(): bucket=:error-at-set-target-layout[d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.22]): orig_sources= new_sources= 2024-09-14T11:34:29.676 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:29.677+0000 7f370fadf9c0 20 handle_bi_update(): bucket=:error-at-set-target-layout[d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.22]): potential sources added=[] removed=[] 2024-09-14T11:34:29.676 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:29.677+0000 7f370fadf9c0 20 handle_bi_update(): bucket=:error-at-set-target-layout[d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.22]): orig_dests= new_dests= 2024-09-14T11:34:29.676 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:29.677+0000 7f370fadf9c0 20 handle_bi_update(): bucket=:error-at-set-target-layout[d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.22]): potential dests added=[] removed=[] 2024-09-14T11:34:29.681 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:29.681+0000 7f370fadf9c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.22.0 2024-09-14T11:34:29.681 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:29.681+0000 7f370fadf9c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.22.1 2024-09-14T11:34:29.681 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:29.681+0000 7f370fadf9c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.22.2 2024-09-14T11:34:29.682 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:29.685+0000 7f370fadf9c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.22.3 2024-09-14T11:34:29.683 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:29.685+0000 7f370fadf9c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.22.4 2024-09-14T11:34:29.683 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:29.685+0000 7f370fadf9c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.22.5 2024-09-14T11:34:29.684 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:29.685+0000 7f370fadf9c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.22.6 2024-09-14T11:34:29.684 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:29.685+0000 7f370fadf9c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.22.7 2024-09-14T11:34:29.685 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:29.685+0000 7f370fadf9c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.22.8 2024-09-14T11:34:29.686 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:29.685+0000 7f370fadf9c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.22.9 2024-09-14T11:34:29.687 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:29.689+0000 7f370fadf9c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.22.10 2024-09-14T11:34:29.687 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:29.689+0000 7f370fadf9c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.22 : hit (requested=0x17, cached=0x17) 2024-09-14T11:34:29.687 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:29.689+0000 7f370fadf9c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.22 2024-09-14T11:34:29.689 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:29.689+0000 7f370fadf9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.22 info.flags=0x17 2024-09-14T11:34:29.689 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:29.689+0000 7f370fadf9c0 10 moving default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.22 to cache LRU end 2024-09-14T11:34:29.689 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:29.689+0000 7f370fadf9c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:34:29.689 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:29.689+0000 7f370fadf9c0 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-set-target-layout:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.22, ofs0, ns] 2024-09-14T11:34:29.690 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:29.689+0000 7f35dffff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366189 cookie 94246963798576 notifier 6035 bl.length()=893 2024-09-14T11:34:29.690 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:29.689+0000 7f35dffff640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.22 info.flags=0x17 2024-09-14T11:34:29.690 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:29.689+0000 7f35dffff640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.22 to cache LRU end 2024-09-14T11:34:29.690 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:29.689+0000 7f35dffff640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:34:29.693 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:29.693+0000 7f370fadf9c0 20 handle_bi_update(): bucket=:error-at-set-target-layout[d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.22]): orig_sources= new_sources= 2024-09-14T11:34:29.693 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:29.693+0000 7f370fadf9c0 20 handle_bi_update(): bucket=:error-at-set-target-layout[d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.22]): potential sources added=[] removed=[] 2024-09-14T11:34:29.693 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:29.693+0000 7f370fadf9c0 20 handle_bi_update(): bucket=:error-at-set-target-layout[d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.22]): orig_dests= new_dests= 2024-09-14T11:34:29.693 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:29.693+0000 7f370fadf9c0 20 handle_bi_update(): bucket=:error-at-set-target-layout[d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.22]): potential dests added=[] removed=[] 2024-09-14T11:34:29.697 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:29.697+0000 7f370fadf9c0 1 execute INFO: reshard of bucket "error-at-set-target-layout" from 11 shards to 12 shards completed successfully 2024-09-14T11:34:29.701 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:29.701+0000 7f35c37e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:34:29.705 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:29.705+0000 7f370fadf9c0 20 remove_watcher() i=0 2024-09-14T11:34:29.705 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:29.705+0000 7f370fadf9c0 2 removed watcher, disabling cache 2024-09-14T11:34:29.707 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:29.709+0000 7f370fadf9c0 20 remove_watcher() i=1 2024-09-14T11:34:29.709 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:29.709+0000 7f370fadf9c0 20 remove_watcher() i=2 2024-09-14T11:34:29.711 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:29.713+0000 7f370fadf9c0 20 remove_watcher() i=3 2024-09-14T11:34:29.714 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:29.713+0000 7f370fadf9c0 20 remove_watcher() i=4 2024-09-14T11:34:29.715 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:29.717+0000 7f370fadf9c0 20 remove_watcher() i=5 2024-09-14T11:34:29.716 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:29.717+0000 7f370fadf9c0 20 remove_watcher() i=6 2024-09-14T11:34:29.718 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:29.717+0000 7f370fadf9c0 20 remove_watcher() i=7 2024-09-14T11:34:29.735 INFO:tasks.workunit.client.0.smithi138.stderr:radosgw-admin bucket stats --bucket error-at-set-target-layout 2024-09-14T11:34:29.765 INFO:tasks.workunit.client.0.smithi138.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:34:29.765 INFO:tasks.workunit.client.0.smithi138.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:34:29.811 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:29.813+0000 7fa3b6a1a9c0 20 rados->read ofs=0 len=0 2024-09-14T11:34:29.813 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:29.813+0000 7fa3b6a1a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:34:29.813 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:29.813+0000 7fa3b6a1a9c0 20 realm 2024-09-14T11:34:29.813 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:29.813+0000 7fa3b6a1a9c0 20 rados->read ofs=0 len=0 2024-09-14T11:34:29.814 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:29.813+0000 7fa3b6a1a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:34:29.814 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:29.813+0000 7fa3b6a1a9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:34:29.814 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:29.813+0000 7fa3b6a1a9c0 20 rados->read ofs=0 len=0 2024-09-14T11:34:29.814 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:29.813+0000 7fa3b6a1a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:34:29.814 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:29.813+0000 7fa3b6a1a9c0 20 rados->read ofs=0 len=0 2024-09-14T11:34:29.815 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:29.817+0000 7fa3b6a1a9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:34:29.815 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:29.817+0000 7fa3b6a1a9c0 20 rados->read ofs=0 len=0 2024-09-14T11:34:29.816 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:29.817+0000 7fa3b6a1a9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:34:29.816 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:29.817+0000 7fa3b6a1a9c0 20 searching for the correct realm 2024-09-14T11:34:29.817 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:29.817+0000 7fa3b3d1f640 0 -- 172.21.15.138:0/3944370127 >> [v2:172.21.15.154:6808/1468088432,v1:172.21.15.154:6809/1468088432] conn(0x7fa39c002350 msgr2=0x7fa3a405cb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:34:30.030 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:30.029+0000 7fa3b4d21640 0 -- 172.21.15.138:0/3944370127 >> [v2:172.21.15.138:6824/2633984942,v1:172.21.15.138:6825/2633984942] conn(0x55e1302ee2d0 msgr2=0x55e1302f06c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:34:30.048 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:30.049+0000 7fa3b6a1a9c0 20 RGWRados::pool_iterate: got zone_info.d9e72d30-c60b-4d0d-9267-fdc36392d5ad 2024-09-14T11:34:30.048 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:30.049+0000 7fa3b6a1a9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:34:30.049 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:30.049+0000 7fa3b6a1a9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:34:30.049 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:30.049+0000 7fa3b6a1a9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:34:30.049 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:30.049+0000 7fa3b6a1a9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:34:30.049 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:30.049+0000 7fa3b6a1a9c0 20 RGWRados::pool_iterate: got zonegroup_info.65ab941b-da8c-4160-94fb-3672b069d44f 2024-09-14T11:34:30.049 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:30.049+0000 7fa3b6a1a9c0 20 rados->read ofs=0 len=0 2024-09-14T11:34:30.049 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:30.049+0000 7fa3b6a1a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:34:30.049 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:30.049+0000 7fa3b6a1a9c0 20 rados->read ofs=0 len=0 2024-09-14T11:34:30.050 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:30.049+0000 7fa3b6a1a9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:34:30.050 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:30.049+0000 7fa3b6a1a9c0 20 rados->read ofs=0 len=0 2024-09-14T11:34:30.051 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:30.053+0000 7fa3b6a1a9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:34:30.051 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:30.053+0000 7fa3b6a1a9c0 20 zone default found 2024-09-14T11:34:30.051 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:30.053+0000 7fa3b6a1a9c0 4 Realm: () 2024-09-14T11:34:30.051 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:30.053+0000 7fa3b6a1a9c0 4 ZoneGroup: default (65ab941b-da8c-4160-94fb-3672b069d44f) 2024-09-14T11:34:30.051 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:30.053+0000 7fa3b6a1a9c0 4 Zone: default (d9e72d30-c60b-4d0d-9267-fdc36392d5ad) 2024-09-14T11:34:30.051 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:30.053+0000 7fa3b6a1a9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:34:30.051 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:30.053+0000 7fa3b6a1a9c0 20 zonegroup default 2024-09-14T11:34:30.051 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:30.053+0000 7fa3b6a1a9c0 20 rados->read ofs=0 len=0 2024-09-14T11:34:30.052 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:30.053+0000 7fa3b6a1a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:34:30.052 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:30.053+0000 7fa3b6a1a9c0 20 rados->read ofs=0 len=0 2024-09-14T11:34:30.052 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:30.053+0000 7fa3b6a1a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:34:30.052 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:30.053+0000 7fa3b6a1a9c0 20 rados->read ofs=0 len=0 2024-09-14T11:34:30.053 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:30.053+0000 7fa3b6a1a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:34:30.053 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:30.053+0000 7fa3b6a1a9c0 20 started sync module instance, tier type = 2024-09-14T11:34:30.053 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:30.053+0000 7fa3b6a1a9c0 20 started zone id=d9e72d30-c60b-4d0d-9267-fdc36392d5ad (name=default) with tier type = 2024-09-14T11:34:30.074 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:30.073+0000 7fa3b6a1a9c0 20 add_watcher() i=0 2024-09-14T11:34:30.074 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:30.073+0000 7fa3b6a1a9c0 20 add_watcher() i=1 2024-09-14T11:34:30.074 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:30.073+0000 7fa3b6a1a9c0 20 add_watcher() i=2 2024-09-14T11:34:30.074 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:30.073+0000 7fa3b6a1a9c0 20 add_watcher() i=3 2024-09-14T11:34:30.074 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:30.073+0000 7fa3b6a1a9c0 20 add_watcher() i=4 2024-09-14T11:34:30.074 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:30.073+0000 7fa3b6a1a9c0 20 add_watcher() i=5 2024-09-14T11:34:30.074 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:30.073+0000 7fa3b6a1a9c0 20 add_watcher() i=6 2024-09-14T11:34:30.075 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:30.077+0000 7fa3b6a1a9c0 20 add_watcher() i=7 2024-09-14T11:34:30.076 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:30.077+0000 7fa3b6a1a9c0 2 all 8 watchers are set, enabling cache 2024-09-14T11:34:30.080 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:30.081+0000 7fa26afdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:34:30.080 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:30.081+0000 7fa3b6a1a9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:34:30.080 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:30.081+0000 7fa3b6a1a9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:34:30.080 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:30.081+0000 7fa3b6a1a9c0 5 note: GC not initialized 2024-09-14T11:34:30.081 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:30.081+0000 7fa269fdb640 20 reqs_thread_entry: start 2024-09-14T11:34:30.081 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:30.081+0000 7fa3b6a1a9c0 20 init_complete bucket index max shards: 11 2024-09-14T11:34:30.081 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:30.081+0000 7fa3b6a1a9c0 20 Filter name: none 2024-09-14T11:34:30.081 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:30.081+0000 7fa1db7fe640 20 reqs_thread_entry: start 2024-09-14T11:34:30.081 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:30.081+0000 7fa3b6a1a9c0 20 rados->read ofs=0 len=0 2024-09-14T11:34:30.082 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:30.081+0000 7fa3b6a1a9c0 20 rados_obj.operate() r=0 bl.length=194 2024-09-14T11:34:30.082 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:30.081+0000 7fa3b6a1a9c0 20 rados->read ofs=0 len=0 2024-09-14T11:34:30.082 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:30.085+0000 7fa3b6a1a9c0 20 rados_obj.operate() r=0 bl.length=416 2024-09-14T11:34:30.082 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:30.085+0000 7fa3b6a1a9c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:34:30.083 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:30.085+0000 7fa3b6a1a9c0 20 rados->read ofs=0 len=0 2024-09-14T11:34:30.083 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:30.085+0000 7fa3b6a1a9c0 20 rados_obj.operate() r=0 bl.length=194 2024-09-14T11:34:30.083 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:30.085+0000 7fa3b6a1a9c0 20 rados->read ofs=0 len=0 2024-09-14T11:34:30.084 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:30.085+0000 7fa3b6a1a9c0 20 rados_obj.operate() r=0 bl.length=416 2024-09-14T11:34:30.084 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:30.085+0000 7fa3b6a1a9c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:34:30.087 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:30.089+0000 7fa26afdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:34:30.092 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:30.093+0000 7fa3b6a1a9c0 20 remove_watcher() i=0 2024-09-14T11:34:30.092 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:30.093+0000 7fa3b6a1a9c0 2 removed watcher, disabling cache 2024-09-14T11:34:30.094 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:30.097+0000 7fa3b6a1a9c0 20 remove_watcher() i=1 2024-09-14T11:34:30.096 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:30.097+0000 7fa3b6a1a9c0 20 remove_watcher() i=2 2024-09-14T11:34:30.099 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:30.101+0000 7fa3b6a1a9c0 20 remove_watcher() i=3 2024-09-14T11:34:30.101 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:30.101+0000 7fa3b6a1a9c0 20 remove_watcher() i=4 2024-09-14T11:34:30.102 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:30.105+0000 7fa3b6a1a9c0 20 remove_watcher() i=5 2024-09-14T11:34:30.104 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:30.105+0000 7fa3b6a1a9c0 20 remove_watcher() i=6 2024-09-14T11:34:30.105 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:30.105+0000 7fa3b6a1a9c0 20 remove_watcher() i=7 2024-09-14T11:34:30.120 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-14T11:34:30.120 INFO:tasks.workunit.client.0.smithi138.stderr:BUCKET_STATS: 2024-09-14T11:34:30.121 INFO:tasks.workunit.client.0.smithi138.stderr:bucket: error-at-set-target-layout id: d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.22 num_objects: 19 size_kb: 1 num_shards: 12 2024-09-14T11:34:30.121 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-14T11:34:30.122 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:34:30.122 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-14T11:34:30.156 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:34:30.157 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-14T11:34:30.700 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:34:30.701 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-14T11:34:31.097 INFO:tasks.workunit.client.0.smithi138.stderr:TEST: reshard bucket with ECANCELED injected at set_target_layout 2024-09-14T11:34:31.098 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-14T11:34:31.100 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:34:31.100 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-14T11:34:31.239 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:34:31.239 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-14T11:34:31.329 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:34:31.330 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-14T11:34:31.420 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:34:31.420 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-14T11:34:31.512 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:34:31.512 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-14T11:34:31.609 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:34:31.609 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-14T11:34:31.697 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:34:31.697 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-14T11:34:31.776 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:34:31.777 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-14T11:34:31.873 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:34:31.873 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-14T11:34:31.949 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:34:31.949 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-14T11:34:32.048 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:34:32.048 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-14T11:34:32.140 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:34:32.140 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-14T11:34:32.233 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:34:32.233 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-14T11:34:32.325 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:34:32.325 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-14T11:34:32.416 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:34:32.416 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-14T11:34:32.512 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:34:32.512 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-14T11:34:32.603 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:34:32.603 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-14T11:34:32.697 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:34:32.697 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-14T11:34:32.792 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:34:32.793 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-14T11:34:32.877 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:34:32.878 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-14T11:34:32.976 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:34:32.976 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-14T11:34:33.077 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:34:33.077 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-14T11:34:33.165 INFO:tasks.workunit.client.0.smithi138.stderr:radosgw-admin bucket stats --bucket error-at-set-target-layout 2024-09-14T11:34:33.199 INFO:tasks.workunit.client.0.smithi138.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:34:33.199 INFO:tasks.workunit.client.0.smithi138.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:34:33.245 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:33.245+0000 7fb0860ab9c0 20 rados->read ofs=0 len=0 2024-09-14T11:34:33.247 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:33.249+0000 7fb0860ab9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:34:33.247 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:33.249+0000 7fb0860ab9c0 20 realm 2024-09-14T11:34:33.247 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:33.249+0000 7fb0860ab9c0 20 rados->read ofs=0 len=0 2024-09-14T11:34:33.247 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:33.249+0000 7fb0860ab9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:34:33.247 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:33.249+0000 7fb0860ab9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:34:33.247 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:33.249+0000 7fb0860ab9c0 20 rados->read ofs=0 len=0 2024-09-14T11:34:33.247 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:33.249+0000 7fb0860ab9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:34:33.247 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:33.249+0000 7fb0860ab9c0 20 rados->read ofs=0 len=0 2024-09-14T11:34:33.248 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:33.249+0000 7fb0860ab9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:34:33.249 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:33.249+0000 7fb0860ab9c0 20 rados->read ofs=0 len=0 2024-09-14T11:34:33.453 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:33.452+0000 7fb0860ab9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:34:33.454 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:33.452+0000 7fb0860ab9c0 20 searching for the correct realm 2024-09-14T11:34:33.458 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:33.460+0000 7fb0843b2640 0 -- 172.21.15.138:0/1084263125 >> [v2:172.21.15.154:6824/416768175,v1:172.21.15.154:6825/416768175] conn(0x7fb07403da70 msgr2=0x7fb07403a410 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-14T11:34:33.676 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:33.676+0000 7fb0833b0640 0 -- 172.21.15.138:0/1084263125 >> [v2:172.21.15.138:6816/326481658,v1:172.21.15.138:6817/326481658] conn(0x7fb074023910 msgr2=0x7fb07404c3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-14T11:34:33.894 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:33.892+0000 7fb0860ab9c0 20 RGWRados::pool_iterate: got zone_info.d9e72d30-c60b-4d0d-9267-fdc36392d5ad 2024-09-14T11:34:33.894 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:33.892+0000 7fb0860ab9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:34:33.894 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:33.892+0000 7fb0860ab9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:34:33.894 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:33.892+0000 7fb0860ab9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:34:33.894 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:33.892+0000 7fb0860ab9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:34:33.894 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:33.892+0000 7fb0860ab9c0 20 RGWRados::pool_iterate: got zonegroup_info.65ab941b-da8c-4160-94fb-3672b069d44f 2024-09-14T11:34:33.895 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:33.892+0000 7fb0860ab9c0 20 rados->read ofs=0 len=0 2024-09-14T11:34:33.895 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:33.892+0000 7fb0860ab9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:34:33.895 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:33.892+0000 7fb0860ab9c0 20 rados->read ofs=0 len=0 2024-09-14T11:34:33.895 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:33.896+0000 7fb0860ab9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:34:33.895 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:33.896+0000 7fb0860ab9c0 20 rados->read ofs=0 len=0 2024-09-14T11:34:33.896 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:33.896+0000 7fb0860ab9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:34:33.896 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:33.896+0000 7fb0860ab9c0 20 zone default found 2024-09-14T11:34:33.896 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:33.896+0000 7fb0860ab9c0 4 Realm: () 2024-09-14T11:34:33.896 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:33.896+0000 7fb0860ab9c0 4 ZoneGroup: default (65ab941b-da8c-4160-94fb-3672b069d44f) 2024-09-14T11:34:33.897 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:33.896+0000 7fb0860ab9c0 4 Zone: default (d9e72d30-c60b-4d0d-9267-fdc36392d5ad) 2024-09-14T11:34:33.897 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:33.896+0000 7fb0860ab9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:34:33.897 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:33.896+0000 7fb0860ab9c0 20 zonegroup default 2024-09-14T11:34:33.897 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:33.896+0000 7fb0860ab9c0 20 rados->read ofs=0 len=0 2024-09-14T11:34:33.897 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:33.896+0000 7fb0860ab9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:34:33.897 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:33.896+0000 7fb0860ab9c0 20 rados->read ofs=0 len=0 2024-09-14T11:34:33.898 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:33.896+0000 7fb0860ab9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:34:33.898 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:33.896+0000 7fb0860ab9c0 20 rados->read ofs=0 len=0 2024-09-14T11:34:33.898 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:33.900+0000 7fb0860ab9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:34:33.898 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:33.900+0000 7fb0860ab9c0 20 started sync module instance, tier type = 2024-09-14T11:34:33.899 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:33.900+0000 7fb0860ab9c0 20 started zone id=d9e72d30-c60b-4d0d-9267-fdc36392d5ad (name=default) with tier type = 2024-09-14T11:34:33.921 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:33.920+0000 7fb0860ab9c0 20 add_watcher() i=0 2024-09-14T11:34:33.921 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:33.920+0000 7fb0860ab9c0 20 add_watcher() i=1 2024-09-14T11:34:33.921 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:33.920+0000 7fb0860ab9c0 20 add_watcher() i=2 2024-09-14T11:34:33.921 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:33.920+0000 7fb0860ab9c0 20 add_watcher() i=3 2024-09-14T11:34:33.921 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:33.920+0000 7fb0860ab9c0 20 add_watcher() i=4 2024-09-14T11:34:33.921 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:33.920+0000 7fb0860ab9c0 20 add_watcher() i=5 2024-09-14T11:34:33.921 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:33.920+0000 7fb0860ab9c0 20 add_watcher() i=6 2024-09-14T11:34:33.923 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:33.924+0000 7fb0860ab9c0 20 add_watcher() i=7 2024-09-14T11:34:33.923 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:33.924+0000 7fb0860ab9c0 2 all 8 watchers are set, enabling cache 2024-09-14T11:34:33.927 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:33.928+0000 7faf39fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:34:33.928 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:33.928+0000 7fb0860ab9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:34:33.928 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:33.928+0000 7fb0860ab9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:34:33.929 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:33.928+0000 7fb0860ab9c0 5 note: GC not initialized 2024-09-14T11:34:33.929 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:33.928+0000 7faf38fe1640 20 reqs_thread_entry: start 2024-09-14T11:34:33.929 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:33.928+0000 7fb0860ab9c0 20 init_complete bucket index max shards: 11 2024-09-14T11:34:33.929 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:33.928+0000 7fb0860ab9c0 20 Filter name: none 2024-09-14T11:34:33.930 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:33.928+0000 7faeb27fc640 20 reqs_thread_entry: start 2024-09-14T11:34:33.930 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:33.928+0000 7fb0860ab9c0 20 rados->read ofs=0 len=0 2024-09-14T11:34:33.931 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:33.932+0000 7fb0860ab9c0 20 rados_obj.operate() r=0 bl.length=194 2024-09-14T11:34:33.931 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:33.932+0000 7fb0860ab9c0 20 rados->read ofs=0 len=0 2024-09-14T11:34:33.932 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:33.932+0000 7fb0860ab9c0 20 rados_obj.operate() r=0 bl.length=416 2024-09-14T11:34:33.932 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:33.932+0000 7fb0860ab9c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:34:33.932 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:33.932+0000 7fb0860ab9c0 20 rados->read ofs=0 len=0 2024-09-14T11:34:33.933 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:33.932+0000 7fb0860ab9c0 20 rados_obj.operate() r=0 bl.length=194 2024-09-14T11:34:33.933 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:33.932+0000 7fb0860ab9c0 20 rados->read ofs=0 len=0 2024-09-14T11:34:33.934 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:33.932+0000 7fb0860ab9c0 20 rados_obj.operate() r=0 bl.length=416 2024-09-14T11:34:33.934 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:33.932+0000 7fb0860ab9c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:34:33.938 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:33.936+0000 7faf39fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:34:33.943 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:33.944+0000 7fb0860ab9c0 20 remove_watcher() i=0 2024-09-14T11:34:33.943 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:33.944+0000 7fb0860ab9c0 2 removed watcher, disabling cache 2024-09-14T11:34:33.945 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:33.944+0000 7fb0860ab9c0 20 remove_watcher() i=1 2024-09-14T11:34:33.947 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:33.948+0000 7fb0860ab9c0 20 remove_watcher() i=2 2024-09-14T11:34:33.950 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:33.948+0000 7fb0860ab9c0 20 remove_watcher() i=3 2024-09-14T11:34:33.952 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:33.952+0000 7fb0860ab9c0 20 remove_watcher() i=4 2024-09-14T11:34:33.954 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:33.956+0000 7fb0860ab9c0 20 remove_watcher() i=5 2024-09-14T11:34:33.956 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:33.956+0000 7fb0860ab9c0 20 remove_watcher() i=6 2024-09-14T11:34:33.958 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:33.956+0000 7fb0860ab9c0 20 remove_watcher() i=7 2024-09-14T11:34:33.973 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-14T11:34:33.974 INFO:tasks.workunit.client.0.smithi138.stderr:BUCKET_STATS: 2024-09-14T11:34:33.974 INFO:tasks.workunit.client.0.smithi138.stderr:bucket: error-at-set-target-layout id: d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.23 num_objects: 20 size_kb: 1 num_shards: 11 2024-09-14T11:34:33.974 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-14T11:34:33.974 INFO:tasks.workunit.client.0.smithi138.stderr:radosgw-admin bucket reshard --bucket error-at-set-target-layout --num-shards 12 --rgw-reshard-bucket-lock-duration 30 --inject-error-at set_target_layout --inject-error-code 125 2024-09-14T11:34:34.014 INFO:tasks.workunit.client.0.smithi138.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:34:34.014 INFO:tasks.workunit.client.0.smithi138.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:34:34.061 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:34.060+0000 7f59f8c689c0 20 rados->read ofs=0 len=0 2024-09-14T11:34:34.063 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:34.064+0000 7f59f8c689c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:34:34.063 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:34.064+0000 7f59f8c689c0 20 realm 2024-09-14T11:34:34.063 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:34.064+0000 7f59f8c689c0 20 rados->read ofs=0 len=0 2024-09-14T11:34:34.063 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:34.064+0000 7f59f8c689c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:34:34.063 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:34.064+0000 7f59f8c689c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:34:34.063 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:34.064+0000 7f59f8c689c0 20 rados->read ofs=0 len=0 2024-09-14T11:34:34.063 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:34.064+0000 7f59f8c689c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:34:34.063 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:34.064+0000 7f59f8c689c0 20 rados->read ofs=0 len=0 2024-09-14T11:34:34.065 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:34.064+0000 7f59f8c689c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:34:34.065 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:34.064+0000 7f59f8c689c0 20 rados->read ofs=0 len=0 2024-09-14T11:34:34.065 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:34.064+0000 7f59f8c689c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:34:34.065 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:34.064+0000 7f59f8c689c0 20 searching for the correct realm 2024-09-14T11:34:34.069 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:34.068+0000 7f59f6f6f640 0 -- 172.21.15.138:0/3790821717 >> [v2:172.21.15.154:6824/416768175,v1:172.21.15.154:6825/416768175] conn(0x7f59f00664c0 msgr2=0x7f59f005bc90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:34:34.284 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:34.284+0000 7f59f5f6d640 0 -- 172.21.15.138:0/3790821717 >> [v2:172.21.15.138:6816/326481658,v1:172.21.15.138:6817/326481658] conn(0x7f59f0082130 msgr2=0x7f59f0058390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:34:34.502 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:34.500+0000 7f59f8c689c0 20 RGWRados::pool_iterate: got zone_info.d9e72d30-c60b-4d0d-9267-fdc36392d5ad 2024-09-14T11:34:34.502 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:34.500+0000 7f59f8c689c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:34:34.502 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:34.500+0000 7f59f8c689c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:34:34.502 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:34.500+0000 7f59f8c689c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:34:34.502 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:34.500+0000 7f59f8c689c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:34:34.502 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:34.500+0000 7f59f8c689c0 20 RGWRados::pool_iterate: got zonegroup_info.65ab941b-da8c-4160-94fb-3672b069d44f 2024-09-14T11:34:34.502 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:34.500+0000 7f59f8c689c0 20 rados->read ofs=0 len=0 2024-09-14T11:34:34.503 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:34.504+0000 7f59f8c689c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:34:34.503 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:34.504+0000 7f59f8c689c0 20 rados->read ofs=0 len=0 2024-09-14T11:34:34.503 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:34.504+0000 7f59f8c689c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:34:34.503 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:34.504+0000 7f59f8c689c0 20 rados->read ofs=0 len=0 2024-09-14T11:34:34.504 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:34.504+0000 7f59f8c689c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:34:34.504 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:34.504+0000 7f59f8c689c0 20 zone default found 2024-09-14T11:34:34.505 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:34.504+0000 7f59f8c689c0 4 Realm: () 2024-09-14T11:34:34.505 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:34.504+0000 7f59f8c689c0 4 ZoneGroup: default (65ab941b-da8c-4160-94fb-3672b069d44f) 2024-09-14T11:34:34.505 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:34.504+0000 7f59f8c689c0 4 Zone: default (d9e72d30-c60b-4d0d-9267-fdc36392d5ad) 2024-09-14T11:34:34.505 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:34.504+0000 7f59f8c689c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:34:34.505 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:34.504+0000 7f59f8c689c0 20 zonegroup default 2024-09-14T11:34:34.505 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:34.504+0000 7f59f8c689c0 20 rados->read ofs=0 len=0 2024-09-14T11:34:34.505 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:34.504+0000 7f59f8c689c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:34:34.505 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:34.504+0000 7f59f8c689c0 20 rados->read ofs=0 len=0 2024-09-14T11:34:34.506 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:34.504+0000 7f59f8c689c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:34:34.506 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:34.504+0000 7f59f8c689c0 20 rados->read ofs=0 len=0 2024-09-14T11:34:34.506 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:34.508+0000 7f59f8c689c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:34:34.506 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:34.508+0000 7f59f8c689c0 20 started sync module instance, tier type = 2024-09-14T11:34:34.506 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:34.508+0000 7f59f8c689c0 20 started zone id=d9e72d30-c60b-4d0d-9267-fdc36392d5ad (name=default) with tier type = 2024-09-14T11:34:34.529 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:34.528+0000 7f59f8c689c0 20 add_watcher() i=0 2024-09-14T11:34:34.529 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:34.528+0000 7f59f8c689c0 20 add_watcher() i=1 2024-09-14T11:34:34.529 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:34.528+0000 7f59f8c689c0 20 add_watcher() i=2 2024-09-14T11:34:34.529 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:34.528+0000 7f59f8c689c0 20 add_watcher() i=3 2024-09-14T11:34:34.529 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:34.528+0000 7f59f8c689c0 20 add_watcher() i=4 2024-09-14T11:34:34.529 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:34.528+0000 7f59f8c689c0 20 add_watcher() i=5 2024-09-14T11:34:34.529 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:34.528+0000 7f59f8c689c0 20 add_watcher() i=6 2024-09-14T11:34:34.532 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:34.532+0000 7f59f8c689c0 20 add_watcher() i=7 2024-09-14T11:34:34.532 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:34.532+0000 7f59f8c689c0 2 all 8 watchers are set, enabling cache 2024-09-14T11:34:34.535 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:34.536+0000 7f58acfe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:34:34.536 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:34.536+0000 7f59f8c689c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:34:34.536 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:34.536+0000 7f59f8c689c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:34:34.536 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:34.536+0000 7f59f8c689c0 5 note: GC not initialized 2024-09-14T11:34:34.537 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:34.536+0000 7f58277fe640 20 reqs_thread_entry: start 2024-09-14T11:34:34.537 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:34.536+0000 7f59f8c689c0 20 init_complete bucket index max shards: 11 2024-09-14T11:34:34.538 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:34.536+0000 7f59f8c689c0 20 Filter name: none 2024-09-14T11:34:34.538 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:34.536+0000 7f58257fa640 20 reqs_thread_entry: start 2024-09-14T11:34:34.538 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:34.536+0000 7f59f8c689c0 10 cache get: name=default.rgw.meta+root+error-at-set-target-layout : miss 2024-09-14T11:34:34.538 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:34.536+0000 7f59f8c689c0 20 rados->read ofs=0 len=0 2024-09-14T11:34:34.538 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:34.536+0000 7f59f8c689c0 20 rados_obj.operate() r=0 bl.length=194 2024-09-14T11:34:34.538 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:34.540+0000 7f59f8c689c0 10 cache put: name=default.rgw.meta+root+error-at-set-target-layout info.flags=0x11 2024-09-14T11:34:34.538 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:34.540+0000 7f59f8c689c0 10 adding default.rgw.meta+root+error-at-set-target-layout to cache LRU end 2024-09-14T11:34:34.539 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:34.540+0000 7f59f8c689c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.23 : miss 2024-09-14T11:34:34.539 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:34.540+0000 7f59f8c689c0 20 rados->read ofs=0 len=0 2024-09-14T11:34:34.539 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:34.540+0000 7f59f8c689c0 20 rados_obj.operate() r=0 bl.length=416 2024-09-14T11:34:34.539 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:34.540+0000 7f59f8c689c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.23 info.flags=0x17 2024-09-14T11:34:34.540 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:34.540+0000 7f59f8c689c0 10 adding default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.23 to cache LRU end 2024-09-14T11:34:34.540 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:34.540+0000 7f59f8c689c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:34:34.540 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:34.540+0000 7f59f8c689c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:34:34.540 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:34.540+0000 7f59f8c689c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.23 2024-09-14T11:34:34.548 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:34.548+0000 7f59f8c689c0 -1 Injecting error=-125 at location=set_target_layout 2024-09-14T11:34:34.551 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:34.552+0000 7f59f8c689c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.23 info.flags=0x17 2024-09-14T11:34:34.551 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:34.552+0000 7f59f8c689c0 10 moving default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.23 to cache LRU end 2024-09-14T11:34:34.551 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:34.552+0000 7f59f8c689c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:34:34.551 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:34.552+0000 7f59f8c689c0 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-set-target-layout:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.23, ofs0, ns] 2024-09-14T11:34:34.552 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:34.552+0000 7f58d9ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366192 cookie 94206996612832 notifier 6086 bl.length()=925 2024-09-14T11:34:34.552 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:34.552+0000 7f58d9ffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.23 info.flags=0x17 2024-09-14T11:34:34.552 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:34.552+0000 7f58d9ffb640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.23 to cache LRU end 2024-09-14T11:34:34.552 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:34.552+0000 7f58d9ffb640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:34:34.554 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:34.552+0000 7f59f8c689c0 20 handle_bi_update(): bucket=:error-at-set-target-layout[d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.23]): orig_sources= new_sources= 2024-09-14T11:34:34.554 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:34.552+0000 7f59f8c689c0 20 handle_bi_update(): bucket=:error-at-set-target-layout[d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.23]): potential sources added=[] removed=[] 2024-09-14T11:34:34.554 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:34.552+0000 7f59f8c689c0 20 handle_bi_update(): bucket=:error-at-set-target-layout[d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.23]): orig_dests= new_dests= 2024-09-14T11:34:34.554 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:34.552+0000 7f59f8c689c0 20 handle_bi_update(): bucket=:error-at-set-target-layout[d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.23]): potential dests added=[] removed=[] 2024-09-14T11:34:34.564 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:34.564+0000 7f59f8c689c0 10 bucket_obj is .dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.23.1.0 2024-09-14T11:34:34.564 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:34.564+0000 7f59f8c689c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.23.1.0 2024-09-14T11:34:34.564 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:34.564+0000 7f59f8c689c0 10 bucket_obj is .dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.23.1.1 2024-09-14T11:34:34.564 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:34.564+0000 7f59f8c689c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.23.1.1 2024-09-14T11:34:34.564 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:34.564+0000 7f59f8c689c0 10 bucket_obj is .dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.23.1.2 2024-09-14T11:34:34.564 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:34.564+0000 7f59f8c689c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.23.1.2 2024-09-14T11:34:34.564 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:34.564+0000 7f59f8c689c0 10 bucket_obj is .dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.23.1.3 2024-09-14T11:34:34.564 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:34.564+0000 7f59f8c689c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.23.1.3 2024-09-14T11:34:34.564 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:34.564+0000 7f59f8c689c0 10 bucket_obj is .dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.23.1.4 2024-09-14T11:34:34.564 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:34.564+0000 7f59f8c689c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.23.1.4 2024-09-14T11:34:34.564 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:34.564+0000 7f59f8c689c0 10 bucket_obj is .dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.23.1.5 2024-09-14T11:34:34.564 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:34.564+0000 7f59f8c689c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.23.1.5 2024-09-14T11:34:34.564 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:34.564+0000 7f59f8c689c0 10 bucket_obj is .dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.23.1.6 2024-09-14T11:34:34.565 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:34.564+0000 7f59f8c689c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.23.1.6 2024-09-14T11:34:34.565 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:34.564+0000 7f59f8c689c0 10 bucket_obj is .dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.23.1.7 2024-09-14T11:34:34.565 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:34.564+0000 7f59f8c689c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.23.1.7 2024-09-14T11:34:34.565 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:34.564+0000 7f59f8c689c0 10 bucket_obj is .dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.23.1.8 2024-09-14T11:34:34.565 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:34.564+0000 7f59f8c689c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.23.1.8 2024-09-14T11:34:34.565 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:34.564+0000 7f59f8c689c0 10 bucket_obj is .dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.23.1.9 2024-09-14T11:34:34.565 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:34.564+0000 7f59f8c689c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.23.1.9 2024-09-14T11:34:34.565 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:34.564+0000 7f59f8c689c0 10 bucket_obj is .dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.23.1.10 2024-09-14T11:34:34.565 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:34.564+0000 7f59f8c689c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.23.1.10 2024-09-14T11:34:34.565 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:34.564+0000 7f59f8c689c0 10 bucket_obj is .dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.23.1.11 2024-09-14T11:34:34.565 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:34.564+0000 7f59f8c689c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.23.1.11 2024-09-14T11:34:34.565 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:34.564+0000 7f59f8c689c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.23.0 2024-09-14T11:34:34.566 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:34.564+0000 7f59f8c689c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.23.1 2024-09-14T11:34:34.566 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:34.564+0000 7f59f8c689c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.23.2 2024-09-14T11:34:34.566 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:34.564+0000 7f59f8c689c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.23.3 2024-09-14T11:34:34.566 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:34.568+0000 7f59f8c689c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.23.4 2024-09-14T11:34:34.567 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:34.568+0000 7f59f8c689c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.23.5 2024-09-14T11:34:34.568 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:34.568+0000 7f59f8c689c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.23.6 2024-09-14T11:34:34.568 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:34.568+0000 7f59f8c689c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.23.7 2024-09-14T11:34:34.569 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:34.568+0000 7f59f8c689c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.23.8 2024-09-14T11:34:34.570 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:34.572+0000 7f59f8c689c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.23.9 2024-09-14T11:34:34.571 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:34.572+0000 7f59f8c689c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.23.10 2024-09-14T11:34:34.578 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:34.576+0000 7f59f8c689c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.23 : hit (requested=0x17, cached=0x17) 2024-09-14T11:34:34.578 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:34.580+0000 7f59f8c689c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.23 2024-09-14T11:34:34.581 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:34.580+0000 7f59f8c689c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.23 info.flags=0x17 2024-09-14T11:34:34.581 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:34.580+0000 7f59f8c689c0 10 moving default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.23 to cache LRU end 2024-09-14T11:34:34.581 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:34.580+0000 7f59f8c689c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:34:34.581 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:34.580+0000 7f59f8c689c0 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-set-target-layout:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.23, ofs0, ns] 2024-09-14T11:34:34.582 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:34.580+0000 7f58d9ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366193 cookie 94206996612832 notifier 6086 bl.length()=925 2024-09-14T11:34:34.582 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:34.580+0000 7f58d9ffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.23 info.flags=0x17 2024-09-14T11:34:34.582 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:34.580+0000 7f58d9ffb640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.23 to cache LRU end 2024-09-14T11:34:34.582 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:34.580+0000 7f58d9ffb640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:34:34.585 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:34.584+0000 7f59f8c689c0 20 handle_bi_update(): bucket=:error-at-set-target-layout[d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.23]): orig_sources= new_sources= 2024-09-14T11:34:34.585 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:34.584+0000 7f59f8c689c0 20 handle_bi_update(): bucket=:error-at-set-target-layout[d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.23]): potential sources added=[] removed=[] 2024-09-14T11:34:34.585 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:34.584+0000 7f59f8c689c0 20 handle_bi_update(): bucket=:error-at-set-target-layout[d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.23]): orig_dests= new_dests= 2024-09-14T11:34:34.585 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:34.584+0000 7f59f8c689c0 20 handle_bi_update(): bucket=:error-at-set-target-layout[d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.23]): potential dests added=[] removed=[] 2024-09-14T11:34:34.589 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:34.588+0000 7f59f8c689c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.23.0 2024-09-14T11:34:34.590 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:34.588+0000 7f59f8c689c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.23.1 2024-09-14T11:34:34.590 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:34.592+0000 7f59f8c689c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.23.2 2024-09-14T11:34:34.591 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:34.592+0000 7f59f8c689c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.23.3 2024-09-14T11:34:34.592 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:34.592+0000 7f59f8c689c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.23.4 2024-09-14T11:34:34.592 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:34.592+0000 7f59f8c689c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.23.5 2024-09-14T11:34:34.592 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:34.592+0000 7f59f8c689c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.23.6 2024-09-14T11:34:34.593 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:34.592+0000 7f59f8c689c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.23.7 2024-09-14T11:34:34.593 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:34.592+0000 7f59f8c689c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.23.8 2024-09-14T11:34:34.594 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:34.596+0000 7f59f8c689c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.23.9 2024-09-14T11:34:34.595 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:34.596+0000 7f59f8c689c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.23.10 2024-09-14T11:34:34.595 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:34.596+0000 7f59f8c689c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.23 : hit (requested=0x17, cached=0x17) 2024-09-14T11:34:34.596 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:34.596+0000 7f59f8c689c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.23 2024-09-14T11:34:34.599 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:34.600+0000 7f59f8c689c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.23 info.flags=0x17 2024-09-14T11:34:34.599 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:34.600+0000 7f59f8c689c0 10 moving default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.23 to cache LRU end 2024-09-14T11:34:34.599 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:34.600+0000 7f59f8c689c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:34:34.599 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:34.600+0000 7f59f8c689c0 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-set-target-layout:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.23, ofs0, ns] 2024-09-14T11:34:34.599 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:34.600+0000 7f58d97fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366194 cookie 94206996612832 notifier 6086 bl.length()=893 2024-09-14T11:34:34.600 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:34.600+0000 7f58d97fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.23 info.flags=0x17 2024-09-14T11:34:34.600 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:34.600+0000 7f58d97fa640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.23 to cache LRU end 2024-09-14T11:34:34.600 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:34.600+0000 7f58d97fa640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:34:34.602 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:34.600+0000 7f59f8c689c0 20 handle_bi_update(): bucket=:error-at-set-target-layout[d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.23]): orig_sources= new_sources= 2024-09-14T11:34:34.602 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:34.600+0000 7f59f8c689c0 20 handle_bi_update(): bucket=:error-at-set-target-layout[d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.23]): potential sources added=[] removed=[] 2024-09-14T11:34:34.602 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:34.600+0000 7f59f8c689c0 20 handle_bi_update(): bucket=:error-at-set-target-layout[d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.23]): orig_dests= new_dests= 2024-09-14T11:34:34.602 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:34.600+0000 7f59f8c689c0 20 handle_bi_update(): bucket=:error-at-set-target-layout[d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.23]): potential dests added=[] removed=[] 2024-09-14T11:34:34.608 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:34.608+0000 7f59f8c689c0 1 execute INFO: reshard of bucket "error-at-set-target-layout" from 11 shards to 12 shards completed successfully 2024-09-14T11:34:34.612 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:34.612+0000 7f58acfe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:34:34.617 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:34.616+0000 7f59f8c689c0 20 remove_watcher() i=0 2024-09-14T11:34:34.617 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:34.616+0000 7f59f8c689c0 2 removed watcher, disabling cache 2024-09-14T11:34:34.619 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:34.620+0000 7f59f8c689c0 20 remove_watcher() i=1 2024-09-14T11:34:34.621 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:34.620+0000 7f59f8c689c0 20 remove_watcher() i=2 2024-09-14T11:34:34.623 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:34.624+0000 7f59f8c689c0 20 remove_watcher() i=3 2024-09-14T11:34:34.625 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:34.624+0000 7f59f8c689c0 20 remove_watcher() i=4 2024-09-14T11:34:34.627 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:34.628+0000 7f59f8c689c0 20 remove_watcher() i=5 2024-09-14T11:34:34.628 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:34.628+0000 7f59f8c689c0 20 remove_watcher() i=6 2024-09-14T11:34:34.630 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:34.628+0000 7f59f8c689c0 20 remove_watcher() i=7 2024-09-14T11:34:34.647 INFO:tasks.workunit.client.0.smithi138.stderr:radosgw-admin bucket stats --bucket error-at-set-target-layout 2024-09-14T11:34:34.677 INFO:tasks.workunit.client.0.smithi138.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:34:34.678 INFO:tasks.workunit.client.0.smithi138.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:34:34.721 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:34.720+0000 7fc380f309c0 20 rados->read ofs=0 len=0 2024-09-14T11:34:34.724 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:34.724+0000 7fc380f309c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:34:34.724 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:34.724+0000 7fc380f309c0 20 realm 2024-09-14T11:34:34.724 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:34.724+0000 7fc380f309c0 20 rados->read ofs=0 len=0 2024-09-14T11:34:34.724 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:34.724+0000 7fc380f309c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:34:34.724 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:34.724+0000 7fc380f309c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:34:34.724 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:34.724+0000 7fc380f309c0 20 rados->read ofs=0 len=0 2024-09-14T11:34:34.724 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:34.724+0000 7fc380f309c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:34:34.724 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:34.724+0000 7fc380f309c0 20 rados->read ofs=0 len=0 2024-09-14T11:34:34.725 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:34.724+0000 7fc380f309c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:34:34.725 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:34.724+0000 7fc380f309c0 20 rados->read ofs=0 len=0 2024-09-14T11:34:34.726 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:34.728+0000 7fc380f309c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:34:34.727 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:34.728+0000 7fc380f309c0 20 searching for the correct realm 2024-09-14T11:34:34.731 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:34.732+0000 7fc37e235640 0 -- 172.21.15.138:0/2712563051 >> [v2:172.21.15.154:6808/1468088432,v1:172.21.15.154:6809/1468088432] conn(0x7fc370010c20 msgr2=0x7fc370001960 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:34:34.737 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:34.736+0000 7fc37e235640 0 -- 172.21.15.138:0/2712563051 >> [v2:172.21.15.138:6816/326481658,v1:172.21.15.138:6817/326481658] conn(0x7fc3780f5970 msgr2=0x7fc3780f23e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:34:34.954 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:34.952+0000 7fc380f309c0 20 RGWRados::pool_iterate: got zone_info.d9e72d30-c60b-4d0d-9267-fdc36392d5ad 2024-09-14T11:34:34.954 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:34.952+0000 7fc380f309c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:34:34.954 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:34.952+0000 7fc380f309c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:34:34.954 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:34.952+0000 7fc380f309c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:34:34.954 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:34.952+0000 7fc380f309c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:34:34.954 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:34.952+0000 7fc380f309c0 20 RGWRados::pool_iterate: got zonegroup_info.65ab941b-da8c-4160-94fb-3672b069d44f 2024-09-14T11:34:34.954 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:34.952+0000 7fc380f309c0 20 rados->read ofs=0 len=0 2024-09-14T11:34:34.955 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:34.956+0000 7fc380f309c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:34:34.955 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:34.956+0000 7fc380f309c0 20 rados->read ofs=0 len=0 2024-09-14T11:34:34.956 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:34.956+0000 7fc380f309c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:34:34.956 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:34.956+0000 7fc380f309c0 20 rados->read ofs=0 len=0 2024-09-14T11:34:34.957 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:34.956+0000 7fc380f309c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:34:34.957 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:34.956+0000 7fc380f309c0 20 zone default found 2024-09-14T11:34:34.957 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:34.956+0000 7fc380f309c0 4 Realm: () 2024-09-14T11:34:34.957 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:34.956+0000 7fc380f309c0 4 ZoneGroup: default (65ab941b-da8c-4160-94fb-3672b069d44f) 2024-09-14T11:34:34.957 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:34.956+0000 7fc380f309c0 4 Zone: default (d9e72d30-c60b-4d0d-9267-fdc36392d5ad) 2024-09-14T11:34:34.957 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:34.956+0000 7fc380f309c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:34:34.957 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:34.956+0000 7fc380f309c0 20 zonegroup default 2024-09-14T11:34:34.957 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:34.956+0000 7fc380f309c0 20 rados->read ofs=0 len=0 2024-09-14T11:34:34.958 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:34.956+0000 7fc380f309c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:34:34.958 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:34.956+0000 7fc380f309c0 20 rados->read ofs=0 len=0 2024-09-14T11:34:34.958 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:34.960+0000 7fc380f309c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:34:34.959 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:34.960+0000 7fc380f309c0 20 rados->read ofs=0 len=0 2024-09-14T11:34:34.960 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:34.960+0000 7fc380f309c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:34:34.960 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:34.960+0000 7fc380f309c0 20 started sync module instance, tier type = 2024-09-14T11:34:34.960 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:34.960+0000 7fc380f309c0 20 started zone id=d9e72d30-c60b-4d0d-9267-fdc36392d5ad (name=default) with tier type = 2024-09-14T11:34:34.983 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:34.984+0000 7fc380f309c0 20 add_watcher() i=0 2024-09-14T11:34:34.983 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:34.984+0000 7fc380f309c0 20 add_watcher() i=1 2024-09-14T11:34:34.983 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:34.984+0000 7fc380f309c0 20 add_watcher() i=2 2024-09-14T11:34:34.983 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:34.984+0000 7fc380f309c0 20 add_watcher() i=3 2024-09-14T11:34:34.983 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:34.984+0000 7fc380f309c0 20 add_watcher() i=4 2024-09-14T11:34:34.983 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:34.984+0000 7fc380f309c0 20 add_watcher() i=5 2024-09-14T11:34:34.983 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:34.984+0000 7fc380f309c0 20 add_watcher() i=6 2024-09-14T11:34:34.985 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:34.984+0000 7fc380f309c0 20 add_watcher() i=7 2024-09-14T11:34:34.985 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:34.984+0000 7fc380f309c0 2 all 8 watchers are set, enabling cache 2024-09-14T11:34:34.989 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:34.988+0000 7fc2357e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:34:34.990 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:34.988+0000 7fc380f309c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:34:34.990 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:34.988+0000 7fc380f309c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:34:34.990 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:34.992+0000 7fc380f309c0 5 note: GC not initialized 2024-09-14T11:34:34.991 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:34.992+0000 7fc1affff640 20 reqs_thread_entry: start 2024-09-14T11:34:34.991 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:34.992+0000 7fc380f309c0 20 init_complete bucket index max shards: 11 2024-09-14T11:34:34.991 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:34.992+0000 7fc380f309c0 20 Filter name: none 2024-09-14T11:34:34.991 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:34.992+0000 7fc1adffb640 20 reqs_thread_entry: start 2024-09-14T11:34:34.991 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:34.992+0000 7fc380f309c0 20 rados->read ofs=0 len=0 2024-09-14T11:34:34.992 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:34.992+0000 7fc380f309c0 20 rados_obj.operate() r=0 bl.length=194 2024-09-14T11:34:34.992 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:34.992+0000 7fc380f309c0 20 rados->read ofs=0 len=0 2024-09-14T11:34:34.994 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:34.992+0000 7fc380f309c0 20 rados_obj.operate() r=0 bl.length=416 2024-09-14T11:34:34.994 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:34.992+0000 7fc380f309c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:34:34.994 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:34.992+0000 7fc380f309c0 20 rados->read ofs=0 len=0 2024-09-14T11:34:34.994 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:34.992+0000 7fc380f309c0 20 rados_obj.operate() r=0 bl.length=194 2024-09-14T11:34:34.994 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:34.992+0000 7fc380f309c0 20 rados->read ofs=0 len=0 2024-09-14T11:34:34.995 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:34.996+0000 7fc380f309c0 20 rados_obj.operate() r=0 bl.length=416 2024-09-14T11:34:34.995 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:34.996+0000 7fc380f309c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:34:34.998 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:35.000+0000 7fc2357e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:34:35.003 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:35.004+0000 7fc380f309c0 20 remove_watcher() i=0 2024-09-14T11:34:35.003 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:35.004+0000 7fc380f309c0 2 removed watcher, disabling cache 2024-09-14T11:34:35.005 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:35.004+0000 7fc380f309c0 20 remove_watcher() i=1 2024-09-14T11:34:35.007 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:35.008+0000 7fc380f309c0 20 remove_watcher() i=2 2024-09-14T11:34:35.009 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:35.008+0000 7fc380f309c0 20 remove_watcher() i=3 2024-09-14T11:34:35.011 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:35.012+0000 7fc380f309c0 20 remove_watcher() i=4 2024-09-14T11:34:35.013 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:35.012+0000 7fc380f309c0 20 remove_watcher() i=5 2024-09-14T11:34:35.014 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:35.016+0000 7fc380f309c0 20 remove_watcher() i=6 2024-09-14T11:34:35.016 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:35.016+0000 7fc380f309c0 20 remove_watcher() i=7 2024-09-14T11:34:35.032 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-14T11:34:35.032 INFO:tasks.workunit.client.0.smithi138.stderr:BUCKET_STATS: 2024-09-14T11:34:35.032 INFO:tasks.workunit.client.0.smithi138.stderr:bucket: error-at-set-target-layout id: d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.23 num_objects: 20 size_kb: 1 num_shards: 12 2024-09-14T11:34:35.032 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-14T11:34:35.034 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:34:35.034 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-14T11:34:35.058 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:34:35.059 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-14T11:34:35.514 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:34:35.514 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-14T11:34:35.925 INFO:tasks.workunit.client.0.smithi138.stderr:TEST: reshard bucket with abort at set_target_layout 2024-09-14T11:34:35.925 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-14T11:34:35.928 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:34:35.928 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-14T11:34:36.066 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:34:36.066 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-14T11:34:36.158 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:34:36.159 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-14T11:34:36.259 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:34:36.259 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-14T11:34:36.356 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:34:36.356 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-14T11:34:36.443 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:34:36.443 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-14T11:34:36.539 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:34:36.540 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-14T11:34:36.633 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:34:36.634 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-14T11:34:36.729 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:34:36.729 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-14T11:34:36.826 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:34:36.826 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-14T11:34:36.921 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:34:36.921 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-14T11:34:37.011 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:34:37.012 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-14T11:34:37.102 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:34:37.102 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-14T11:34:37.200 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:34:37.200 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-14T11:34:37.295 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:34:37.295 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-14T11:34:37.390 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:34:37.390 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-14T11:34:37.486 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:34:37.486 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-14T11:34:37.577 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:34:37.577 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-14T11:34:37.669 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:34:37.669 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-14T11:34:37.765 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:34:37.765 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-14T11:34:37.861 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:34:37.861 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-14T11:34:37.958 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:34:37.958 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-14T11:34:38.050 INFO:tasks.workunit.client.0.smithi138.stderr:radosgw-admin bucket stats --bucket abort-at-set-target-layout 2024-09-14T11:34:38.085 INFO:tasks.workunit.client.0.smithi138.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:34:38.085 INFO:tasks.workunit.client.0.smithi138.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:34:38.131 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:38.136+0000 7fa0808ad9c0 20 rados->read ofs=0 len=0 2024-09-14T11:34:38.133 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:38.136+0000 7fa0808ad9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:34:38.133 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:38.136+0000 7fa0808ad9c0 20 realm 2024-09-14T11:34:38.133 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:38.136+0000 7fa0808ad9c0 20 rados->read ofs=0 len=0 2024-09-14T11:34:38.133 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:38.136+0000 7fa0808ad9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:34:38.133 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:38.136+0000 7fa0808ad9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:34:38.134 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:38.136+0000 7fa0808ad9c0 20 rados->read ofs=0 len=0 2024-09-14T11:34:38.134 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:38.136+0000 7fa0808ad9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:34:38.134 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:38.136+0000 7fa0808ad9c0 20 rados->read ofs=0 len=0 2024-09-14T11:34:38.135 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:38.140+0000 7fa0808ad9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:34:38.135 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:38.140+0000 7fa0808ad9c0 20 rados->read ofs=0 len=0 2024-09-14T11:34:38.136 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:38.140+0000 7fa0808ad9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:34:38.136 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:38.140+0000 7fa0808ad9c0 20 searching for the correct realm 2024-09-14T11:34:38.137 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:38.140+0000 7fa07dbb2640 0 -- 172.21.15.138:0/173627010 >> [v2:172.21.15.154:6808/1468088432,v1:172.21.15.154:6809/1468088432] conn(0x7fa074008050 msgr2=0x7fa074024410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-14T11:34:38.350 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:38.356+0000 7fa07ebb4640 0 -- 172.21.15.138:0/173627010 >> [v2:172.21.15.138:6824/2633984942,v1:172.21.15.138:6825/2633984942] conn(0x564fcdda1580 msgr2=0x564fcdda3970 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:34:38.368 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:38.372+0000 7fa0808ad9c0 20 RGWRados::pool_iterate: got zone_info.d9e72d30-c60b-4d0d-9267-fdc36392d5ad 2024-09-14T11:34:38.368 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:38.372+0000 7fa0808ad9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:34:38.368 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:38.372+0000 7fa0808ad9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:34:38.368 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:38.372+0000 7fa0808ad9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:34:38.368 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:38.372+0000 7fa0808ad9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:34:38.369 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:38.372+0000 7fa0808ad9c0 20 RGWRados::pool_iterate: got zonegroup_info.65ab941b-da8c-4160-94fb-3672b069d44f 2024-09-14T11:34:38.369 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:38.372+0000 7fa0808ad9c0 20 rados->read ofs=0 len=0 2024-09-14T11:34:38.369 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:38.372+0000 7fa0808ad9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:34:38.369 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:38.372+0000 7fa0808ad9c0 20 rados->read ofs=0 len=0 2024-09-14T11:34:38.369 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:38.372+0000 7fa0808ad9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:34:38.370 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:38.372+0000 7fa0808ad9c0 20 rados->read ofs=0 len=0 2024-09-14T11:34:38.371 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:38.376+0000 7fa0808ad9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:34:38.371 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:38.376+0000 7fa0808ad9c0 20 zone default found 2024-09-14T11:34:38.371 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:38.376+0000 7fa0808ad9c0 4 Realm: () 2024-09-14T11:34:38.371 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:38.376+0000 7fa0808ad9c0 4 ZoneGroup: default (65ab941b-da8c-4160-94fb-3672b069d44f) 2024-09-14T11:34:38.371 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:38.376+0000 7fa0808ad9c0 4 Zone: default (d9e72d30-c60b-4d0d-9267-fdc36392d5ad) 2024-09-14T11:34:38.371 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:38.376+0000 7fa0808ad9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:34:38.371 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:38.376+0000 7fa0808ad9c0 20 zonegroup default 2024-09-14T11:34:38.371 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:38.376+0000 7fa0808ad9c0 20 rados->read ofs=0 len=0 2024-09-14T11:34:38.372 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:38.376+0000 7fa0808ad9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:34:38.372 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:38.376+0000 7fa0808ad9c0 20 rados->read ofs=0 len=0 2024-09-14T11:34:38.373 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:38.376+0000 7fa0808ad9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:34:38.373 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:38.376+0000 7fa0808ad9c0 20 rados->read ofs=0 len=0 2024-09-14T11:34:38.373 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:38.376+0000 7fa0808ad9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:34:38.373 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:38.376+0000 7fa0808ad9c0 20 started sync module instance, tier type = 2024-09-14T11:34:38.373 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:38.376+0000 7fa0808ad9c0 20 started zone id=d9e72d30-c60b-4d0d-9267-fdc36392d5ad (name=default) with tier type = 2024-09-14T11:34:38.396 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:38.400+0000 7fa0808ad9c0 20 add_watcher() i=0 2024-09-14T11:34:38.396 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:38.400+0000 7fa0808ad9c0 20 add_watcher() i=1 2024-09-14T11:34:38.396 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:38.400+0000 7fa0808ad9c0 20 add_watcher() i=2 2024-09-14T11:34:38.396 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:38.400+0000 7fa0808ad9c0 20 add_watcher() i=3 2024-09-14T11:34:38.396 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:38.400+0000 7fa0808ad9c0 20 add_watcher() i=4 2024-09-14T11:34:38.396 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:38.400+0000 7fa0808ad9c0 20 add_watcher() i=5 2024-09-14T11:34:38.397 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:38.400+0000 7fa0808ad9c0 20 add_watcher() i=6 2024-09-14T11:34:38.398 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:38.400+0000 7fa0808ad9c0 20 add_watcher() i=7 2024-09-14T11:34:38.398 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:38.400+0000 7fa0808ad9c0 2 all 8 watchers are set, enabling cache 2024-09-14T11:34:38.401 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:38.404+0000 7f9f34fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:34:38.402 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:38.404+0000 7fa0808ad9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:34:38.402 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:38.404+0000 7fa0808ad9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:34:38.402 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:38.404+0000 7fa0808ad9c0 5 note: GC not initialized 2024-09-14T11:34:38.403 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:38.408+0000 7f9eaf7fe640 20 reqs_thread_entry: start 2024-09-14T11:34:38.403 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:38.408+0000 7fa0808ad9c0 20 init_complete bucket index max shards: 11 2024-09-14T11:34:38.403 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:38.408+0000 7fa0808ad9c0 20 Filter name: none 2024-09-14T11:34:38.403 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:38.408+0000 7f9ead7fa640 20 reqs_thread_entry: start 2024-09-14T11:34:38.403 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:38.408+0000 7fa0808ad9c0 20 rados->read ofs=0 len=0 2024-09-14T11:34:38.404 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:38.408+0000 7fa0808ad9c0 20 rados_obj.operate() r=0 bl.length=194 2024-09-14T11:34:38.404 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:38.408+0000 7fa0808ad9c0 20 rados->read ofs=0 len=0 2024-09-14T11:34:38.405 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:38.408+0000 7fa0808ad9c0 20 rados_obj.operate() r=0 bl.length=416 2024-09-14T11:34:38.405 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:38.408+0000 7fa0808ad9c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:34:38.405 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:38.408+0000 7fa0808ad9c0 20 rados->read ofs=0 len=0 2024-09-14T11:34:38.406 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:38.408+0000 7fa0808ad9c0 20 rados_obj.operate() r=0 bl.length=194 2024-09-14T11:34:38.406 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:38.408+0000 7fa0808ad9c0 20 rados->read ofs=0 len=0 2024-09-14T11:34:38.406 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:38.412+0000 7fa0808ad9c0 20 rados_obj.operate() r=0 bl.length=416 2024-09-14T11:34:38.406 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:38.412+0000 7fa0808ad9c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:34:38.409 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:38.412+0000 7f9f34fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:34:38.414 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:38.416+0000 7fa0808ad9c0 20 remove_watcher() i=0 2024-09-14T11:34:38.414 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:38.416+0000 7fa0808ad9c0 2 removed watcher, disabling cache 2024-09-14T11:34:38.416 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:38.420+0000 7fa0808ad9c0 20 remove_watcher() i=1 2024-09-14T11:34:38.419 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:38.424+0000 7fa0808ad9c0 20 remove_watcher() i=2 2024-09-14T11:34:38.421 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:38.424+0000 7fa0808ad9c0 20 remove_watcher() i=3 2024-09-14T11:34:38.423 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:38.428+0000 7fa0808ad9c0 20 remove_watcher() i=4 2024-09-14T11:34:38.425 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:38.428+0000 7fa0808ad9c0 20 remove_watcher() i=5 2024-09-14T11:34:38.426 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:38.432+0000 7fa0808ad9c0 20 remove_watcher() i=6 2024-09-14T11:34:38.427 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:38.432+0000 7fa0808ad9c0 20 remove_watcher() i=7 2024-09-14T11:34:38.442 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-14T11:34:38.442 INFO:tasks.workunit.client.0.smithi138.stderr:BUCKET_STATS: 2024-09-14T11:34:38.442 INFO:tasks.workunit.client.0.smithi138.stderr:bucket: abort-at-set-target-layout id: d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.24 num_objects: 20 size_kb: 1 num_shards: 11 2024-09-14T11:34:38.442 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-14T11:34:38.443 INFO:tasks.workunit.client.0.smithi138.stderr:radosgw-admin bucket reshard --bucket abort-at-set-target-layout --num-shards 12 --rgw-reshard-bucket-lock-duration 30 --inject-abort-at set_target_layout 2024-09-14T11:34:38.475 INFO:tasks.workunit.client.0.smithi138.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:34:38.475 INFO:tasks.workunit.client.0.smithi138.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:34:38.520 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:38.524+0000 7f7a57c5f9c0 20 rados->read ofs=0 len=0 2024-09-14T11:34:38.522 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:38.524+0000 7f7a57c5f9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:34:38.522 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:38.524+0000 7f7a57c5f9c0 20 realm 2024-09-14T11:34:38.522 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:38.524+0000 7f7a57c5f9c0 20 rados->read ofs=0 len=0 2024-09-14T11:34:38.522 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:38.524+0000 7f7a57c5f9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:34:38.523 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:38.524+0000 7f7a57c5f9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:34:38.523 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:38.524+0000 7f7a57c5f9c0 20 rados->read ofs=0 len=0 2024-09-14T11:34:38.523 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:38.528+0000 7f7a57c5f9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:34:38.523 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:38.528+0000 7f7a57c5f9c0 20 rados->read ofs=0 len=0 2024-09-14T11:34:38.524 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:38.528+0000 7f7a57c5f9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:34:38.524 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:38.528+0000 7f7a57c5f9c0 20 rados->read ofs=0 len=0 2024-09-14T11:34:38.525 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:38.528+0000 7f7a57c5f9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:34:38.525 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:38.528+0000 7f7a57c5f9c0 20 searching for the correct realm 2024-09-14T11:34:38.528 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:38.532+0000 7f7a55f66640 0 -- 172.21.15.138:0/3375493065 >> [v2:172.21.15.154:6824/416768175,v1:172.21.15.154:6825/416768175] conn(0x7f7a50066090 msgr2=0x7f7a5006ca00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-14T11:34:38.744 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:38.748+0000 7f7a54f64640 0 -- 172.21.15.138:0/3375493065 >> [v2:172.21.15.138:6816/326481658,v1:172.21.15.138:6817/326481658] conn(0x7f7a50065090 msgr2=0x7f7a5006a0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:34:38.962 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:38.968+0000 7f7a57c5f9c0 20 RGWRados::pool_iterate: got zone_info.d9e72d30-c60b-4d0d-9267-fdc36392d5ad 2024-09-14T11:34:38.963 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:38.968+0000 7f7a57c5f9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:34:38.963 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:38.968+0000 7f7a57c5f9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:34:38.963 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:38.968+0000 7f7a57c5f9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:34:38.963 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:38.968+0000 7f7a57c5f9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:34:38.963 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:38.968+0000 7f7a57c5f9c0 20 RGWRados::pool_iterate: got zonegroup_info.65ab941b-da8c-4160-94fb-3672b069d44f 2024-09-14T11:34:38.963 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:38.968+0000 7f7a57c5f9c0 20 rados->read ofs=0 len=0 2024-09-14T11:34:38.963 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:38.968+0000 7f7a57c5f9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:34:38.963 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:38.968+0000 7f7a57c5f9c0 20 rados->read ofs=0 len=0 2024-09-14T11:34:38.964 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:38.968+0000 7f7a57c5f9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:34:38.964 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:38.968+0000 7f7a57c5f9c0 20 rados->read ofs=0 len=0 2024-09-14T11:34:38.965 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:38.968+0000 7f7a57c5f9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:34:38.965 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:38.968+0000 7f7a57c5f9c0 20 zone default found 2024-09-14T11:34:38.965 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:38.968+0000 7f7a57c5f9c0 4 Realm: () 2024-09-14T11:34:38.965 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:38.968+0000 7f7a57c5f9c0 4 ZoneGroup: default (65ab941b-da8c-4160-94fb-3672b069d44f) 2024-09-14T11:34:38.965 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:38.968+0000 7f7a57c5f9c0 4 Zone: default (d9e72d30-c60b-4d0d-9267-fdc36392d5ad) 2024-09-14T11:34:38.966 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:38.968+0000 7f7a57c5f9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:34:38.966 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:38.968+0000 7f7a57c5f9c0 20 zonegroup default 2024-09-14T11:34:38.966 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:38.968+0000 7f7a57c5f9c0 20 rados->read ofs=0 len=0 2024-09-14T11:34:38.966 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:38.968+0000 7f7a57c5f9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:34:38.966 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:38.968+0000 7f7a57c5f9c0 20 rados->read ofs=0 len=0 2024-09-14T11:34:38.967 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:38.972+0000 7f7a57c5f9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:34:38.967 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:38.972+0000 7f7a57c5f9c0 20 rados->read ofs=0 len=0 2024-09-14T11:34:38.967 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:38.972+0000 7f7a57c5f9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:34:38.967 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:38.972+0000 7f7a57c5f9c0 20 started sync module instance, tier type = 2024-09-14T11:34:38.968 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:38.972+0000 7f7a57c5f9c0 20 started zone id=d9e72d30-c60b-4d0d-9267-fdc36392d5ad (name=default) with tier type = 2024-09-14T11:34:38.993 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:38.996+0000 7f7a57c5f9c0 20 add_watcher() i=0 2024-09-14T11:34:38.993 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:38.996+0000 7f7a57c5f9c0 20 add_watcher() i=1 2024-09-14T11:34:38.993 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:38.996+0000 7f7a57c5f9c0 20 add_watcher() i=2 2024-09-14T11:34:38.993 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:38.996+0000 7f7a57c5f9c0 20 add_watcher() i=3 2024-09-14T11:34:38.993 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:38.996+0000 7f7a57c5f9c0 20 add_watcher() i=4 2024-09-14T11:34:38.993 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:38.996+0000 7f7a57c5f9c0 20 add_watcher() i=5 2024-09-14T11:34:38.993 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:38.996+0000 7f7a57c5f9c0 20 add_watcher() i=6 2024-09-14T11:34:38.995 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:39.000+0000 7f7a57c5f9c0 20 add_watcher() i=7 2024-09-14T11:34:38.996 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:39.000+0000 7f7a57c5f9c0 2 all 8 watchers are set, enabling cache 2024-09-14T11:34:38.999 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:39.004+0000 7f790bfe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:34:39.000 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:39.004+0000 7f7a57c5f9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:34:39.001 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:39.004+0000 7f7a57c5f9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:34:39.001 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:39.004+0000 7f7a57c5f9c0 5 note: GC not initialized 2024-09-14T11:34:39.001 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:39.004+0000 7f790afe5640 20 reqs_thread_entry: start 2024-09-14T11:34:39.001 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:39.004+0000 7f7a57c5f9c0 20 init_complete bucket index max shards: 11 2024-09-14T11:34:39.002 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:39.004+0000 7f7a57c5f9c0 20 Filter name: none 2024-09-14T11:34:39.002 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:39.004+0000 7f7908fe1640 20 reqs_thread_entry: start 2024-09-14T11:34:39.002 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:39.004+0000 7f7a57c5f9c0 10 cache get: name=default.rgw.meta+root+abort-at-set-target-layout : miss 2024-09-14T11:34:39.002 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:39.004+0000 7f7a57c5f9c0 20 rados->read ofs=0 len=0 2024-09-14T11:34:39.003 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:39.008+0000 7f7a57c5f9c0 20 rados_obj.operate() r=0 bl.length=194 2024-09-14T11:34:39.003 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:39.008+0000 7f7a57c5f9c0 10 cache put: name=default.rgw.meta+root+abort-at-set-target-layout info.flags=0x11 2024-09-14T11:34:39.003 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:39.008+0000 7f7a57c5f9c0 10 adding default.rgw.meta+root+abort-at-set-target-layout to cache LRU end 2024-09-14T11:34:39.003 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:39.008+0000 7f7a57c5f9c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.24 : miss 2024-09-14T11:34:39.003 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:39.008+0000 7f7a57c5f9c0 20 rados->read ofs=0 len=0 2024-09-14T11:34:39.004 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:39.008+0000 7f7a57c5f9c0 20 rados_obj.operate() r=0 bl.length=416 2024-09-14T11:34:39.004 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:39.008+0000 7f7a57c5f9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.24 info.flags=0x17 2024-09-14T11:34:39.004 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:39.008+0000 7f7a57c5f9c0 10 adding default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.24 to cache LRU end 2024-09-14T11:34:39.004 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:39.008+0000 7f7a57c5f9c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:34:39.004 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:39.008+0000 7f7a57c5f9c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:34:39.004 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:39.008+0000 7f7a57c5f9c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.24 2024-09-14T11:34:39.012 INFO:tasks.workunit.client.0.smithi138.stderr:./src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f7a57c5f9c0 time 2024-09-14T11:34:39.019185+0000 2024-09-14T11:34:39.013 INFO:tasks.workunit.client.0.smithi138.stderr:./src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-14T11:34:39.014 INFO:tasks.workunit.client.0.smithi138.stderr: ceph version 19.3.0-4907-ga2782315 (a2782315255a3e7d5f6cdc9eb35785187ff6ddf8) squid (dev) 2024-09-14T11:34:39.014 INFO:tasks.workunit.client.0.smithi138.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x121) [0x7f7a5b5392eb] 2024-09-14T11:34:39.014 INFO:tasks.workunit.client.0.smithi138.stderr: 2: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7f7a5b53949f] 2024-09-14T11:34:39.014 INFO:tasks.workunit.client.0.smithi138.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x56200d1bfc01] 2024-09-14T11:34:39.014 INFO:tasks.workunit.client.0.smithi138.stderr: 4: radosgw-admin(+0x1422828) [0x56200dc1d828] 2024-09-14T11:34:39.014 INFO:tasks.workunit.client.0.smithi138.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x56200d1d4ecd] 2024-09-14T11:34:39.014 INFO:tasks.workunit.client.0.smithi138.stderr: 6: main() 2024-09-14T11:34:39.014 INFO:tasks.workunit.client.0.smithi138.stderr: 7: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7f7a5a39fd90] 2024-09-14T11:34:39.014 INFO:tasks.workunit.client.0.smithi138.stderr: 8: __libc_start_main() 2024-09-14T11:34:39.014 INFO:tasks.workunit.client.0.smithi138.stderr: 9: _start() 2024-09-14T11:34:39.015 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:39.016+0000 7f7a57c5f9c0 -1 ./src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f7a57c5f9c0 time 2024-09-14T11:34:39.019185+0000 2024-09-14T11:34:39.015 INFO:tasks.workunit.client.0.smithi138.stderr:./src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-14T11:34:39.015 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-14T11:34:39.015 INFO:tasks.workunit.client.0.smithi138.stderr: ceph version 19.3.0-4907-ga2782315 (a2782315255a3e7d5f6cdc9eb35785187ff6ddf8) squid (dev) 2024-09-14T11:34:39.015 INFO:tasks.workunit.client.0.smithi138.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x121) [0x7f7a5b5392eb] 2024-09-14T11:34:39.015 INFO:tasks.workunit.client.0.smithi138.stderr: 2: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7f7a5b53949f] 2024-09-14T11:34:39.015 INFO:tasks.workunit.client.0.smithi138.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x56200d1bfc01] 2024-09-14T11:34:39.015 INFO:tasks.workunit.client.0.smithi138.stderr: 4: radosgw-admin(+0x1422828) [0x56200dc1d828] 2024-09-14T11:34:39.015 INFO:tasks.workunit.client.0.smithi138.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x56200d1d4ecd] 2024-09-14T11:34:39.015 INFO:tasks.workunit.client.0.smithi138.stderr: 6: main() 2024-09-14T11:34:39.015 INFO:tasks.workunit.client.0.smithi138.stderr: 7: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7f7a5a39fd90] 2024-09-14T11:34:39.015 INFO:tasks.workunit.client.0.smithi138.stderr: 8: __libc_start_main() 2024-09-14T11:34:39.015 INFO:tasks.workunit.client.0.smithi138.stderr: 9: _start() 2024-09-14T11:34:39.016 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-14T11:34:39.016 INFO:tasks.workunit.client.0.smithi138.stderr:*** Caught signal (Aborted) ** 2024-09-14T11:34:39.016 INFO:tasks.workunit.client.0.smithi138.stderr: in thread 7f7a57c5f9c0 thread_name:radosgw-admin 2024-09-14T11:34:39.031 INFO:tasks.workunit.client.0.smithi138.stderr: ceph version 19.3.0-4907-ga2782315 (a2782315255a3e7d5f6cdc9eb35785187ff6ddf8) squid (dev) 2024-09-14T11:34:39.031 INFO:tasks.workunit.client.0.smithi138.stderr: 1: /lib/x86_64-linux-gnu/libc.so.6(+0x42520) [0x7f7a5a3b8520] 2024-09-14T11:34:39.032 INFO:tasks.workunit.client.0.smithi138.stderr: 2: pthread_kill() 2024-09-14T11:34:39.032 INFO:tasks.workunit.client.0.smithi138.stderr: 3: raise() 2024-09-14T11:34:39.032 INFO:tasks.workunit.client.0.smithi138.stderr: 4: abort() 2024-09-14T11:34:39.032 INFO:tasks.workunit.client.0.smithi138.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x17b) [0x7f7a5b539345] 2024-09-14T11:34:39.032 INFO:tasks.workunit.client.0.smithi138.stderr: 6: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7f7a5b53949f] 2024-09-14T11:34:39.032 INFO:tasks.workunit.client.0.smithi138.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x56200d1bfc01] 2024-09-14T11:34:39.032 INFO:tasks.workunit.client.0.smithi138.stderr: 8: radosgw-admin(+0x1422828) [0x56200dc1d828] 2024-09-14T11:34:39.032 INFO:tasks.workunit.client.0.smithi138.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x56200d1d4ecd] 2024-09-14T11:34:39.032 INFO:tasks.workunit.client.0.smithi138.stderr: 10: main() 2024-09-14T11:34:39.032 INFO:tasks.workunit.client.0.smithi138.stderr: 11: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7f7a5a39fd90] 2024-09-14T11:34:39.032 INFO:tasks.workunit.client.0.smithi138.stderr: 12: __libc_start_main() 2024-09-14T11:34:39.032 INFO:tasks.workunit.client.0.smithi138.stderr: 13: _start() 2024-09-14T11:34:39.033 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:39.020+0000 7f7a57c5f9c0 -1 *** Caught signal (Aborted) ** 2024-09-14T11:34:39.033 INFO:tasks.workunit.client.0.smithi138.stderr: in thread 7f7a57c5f9c0 thread_name:radosgw-admin 2024-09-14T11:34:39.033 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-14T11:34:39.033 INFO:tasks.workunit.client.0.smithi138.stderr: ceph version 19.3.0-4907-ga2782315 (a2782315255a3e7d5f6cdc9eb35785187ff6ddf8) squid (dev) 2024-09-14T11:34:39.033 INFO:tasks.workunit.client.0.smithi138.stderr: 1: /lib/x86_64-linux-gnu/libc.so.6(+0x42520) [0x7f7a5a3b8520] 2024-09-14T11:34:39.033 INFO:tasks.workunit.client.0.smithi138.stderr: 2: pthread_kill() 2024-09-14T11:34:39.033 INFO:tasks.workunit.client.0.smithi138.stderr: 3: raise() 2024-09-14T11:34:39.033 INFO:tasks.workunit.client.0.smithi138.stderr: 4: abort() 2024-09-14T11:34:39.033 INFO:tasks.workunit.client.0.smithi138.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x17b) [0x7f7a5b539345] 2024-09-14T11:34:39.033 INFO:tasks.workunit.client.0.smithi138.stderr: 6: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7f7a5b53949f] 2024-09-14T11:34:39.033 INFO:tasks.workunit.client.0.smithi138.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x56200d1bfc01] 2024-09-14T11:34:39.033 INFO:tasks.workunit.client.0.smithi138.stderr: 8: radosgw-admin(+0x1422828) [0x56200dc1d828] 2024-09-14T11:34:39.033 INFO:tasks.workunit.client.0.smithi138.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x56200d1d4ecd] 2024-09-14T11:34:39.033 INFO:tasks.workunit.client.0.smithi138.stderr: 10: main() 2024-09-14T11:34:39.034 INFO:tasks.workunit.client.0.smithi138.stderr: 11: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7f7a5a39fd90] 2024-09-14T11:34:39.034 INFO:tasks.workunit.client.0.smithi138.stderr: 12: __libc_start_main() 2024-09-14T11:34:39.034 INFO:tasks.workunit.client.0.smithi138.stderr: 13: _start() 2024-09-14T11:34:39.034 INFO:tasks.workunit.client.0.smithi138.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-14T11:34:39.034 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-14T11:34:39.034 INFO:tasks.workunit.client.0.smithi138.stderr:--- begin dump of recent events --- 2024-09-14T11:34:39.034 INFO:tasks.workunit.client.0.smithi138.stderr: -499> 2024-09-14T11:34:38.500+0000 7f7a55f66640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:34:39.034 INFO:tasks.workunit.client.0.smithi138.stderr: -498> 2024-09-14T11:34:38.500+0000 7f7a55f66640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:34:39.034 INFO:tasks.workunit.client.0.smithi138.stderr: -497> 2024-09-14T11:34:38.500+0000 7f7a55f66640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:34:39.034 INFO:tasks.workunit.client.0.smithi138.stderr: -496> 2024-09-14T11:34:38.500+0000 7f7a55765640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:34:39.034 INFO:tasks.workunit.client.0.smithi138.stderr: -495> 2024-09-14T11:34:38.500+0000 7f7a55765640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:34:39.034 INFO:tasks.workunit.client.0.smithi138.stderr: -494> 2024-09-14T11:34:38.500+0000 7f7a55765640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:34:39.034 INFO:tasks.workunit.client.0.smithi138.stderr: -493> 2024-09-14T11:34:38.500+0000 7f7a55f66640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:34:39.034 INFO:tasks.workunit.client.0.smithi138.stderr: -492> 2024-09-14T11:34:38.500+0000 7f7a55f66640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:34:39.034 INFO:tasks.workunit.client.0.smithi138.stderr: -491> 2024-09-14T11:34:38.500+0000 7f7a55f66640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:34:39.035 INFO:tasks.workunit.client.0.smithi138.stderr: -490> 2024-09-14T11:34:38.500+0000 7f7a54f64640 10 monclient(hunting): get_auth_request con 0x5620101c1bf0 auth_method 0 2024-09-14T11:34:39.035 INFO:tasks.workunit.client.0.smithi138.stderr: -489> 2024-09-14T11:34:38.500+0000 7f7a54f64640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:34:39.035 INFO:tasks.workunit.client.0.smithi138.stderr: -488> 2024-09-14T11:34:38.500+0000 7f7a54f64640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:34:39.035 INFO:tasks.workunit.client.0.smithi138.stderr: -487> 2024-09-14T11:34:38.500+0000 7f7a54f64640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:34:39.035 INFO:tasks.workunit.client.0.smithi138.stderr: -486> 2024-09-14T11:34:38.500+0000 7f7a55f66640 10 monclient(hunting): handle_auth_done global_id 6122 payload 274 2024-09-14T11:34:39.035 INFO:tasks.workunit.client.0.smithi138.stderr: -485> 2024-09-14T11:34:38.500+0000 7f7a55f66640 10 monclient: _finish_hunting 0 2024-09-14T11:34:39.035 INFO:tasks.workunit.client.0.smithi138.stderr: -484> 2024-09-14T11:34:38.500+0000 7f7a55f66640 1 monclient: found mon.noname-c 2024-09-14T11:34:39.035 INFO:tasks.workunit.client.0.smithi138.stderr: -483> 2024-09-14T11:34:38.500+0000 7f7a55f66640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.138:3301/0 2024-09-14T11:34:39.035 INFO:tasks.workunit.client.0.smithi138.stderr: -482> 2024-09-14T11:34:38.500+0000 7f7943606640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:34:39.035 INFO:tasks.workunit.client.0.smithi138.stderr: -481> 2024-09-14T11:34:38.500+0000 7f7943606640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-14T11:34:39.035 INFO:tasks.workunit.client.0.smithi138.stderr: -480> 2024-09-14T11:34:38.500+0000 7f7943606640 10 monclient: dump: 2024-09-14T11:34:39.035 INFO:tasks.workunit.client.0.smithi138.stderr:epoch 1 2024-09-14T11:34:39.035 INFO:tasks.workunit.client.0.smithi138.stderr:fsid 3f225f43-83a6-4aeb-b798-1f04bb49d597 2024-09-14T11:34:39.035 INFO:tasks.workunit.client.0.smithi138.stderr:last_changed 2024-09-14T11:07:09.252780+0000 2024-09-14T11:34:39.035 INFO:tasks.workunit.client.0.smithi138.stderr:created 2024-09-14T11:07:09.252780+0000 2024-09-14T11:34:39.036 INFO:tasks.workunit.client.0.smithi138.stderr:min_mon_release 19 (squid) 2024-09-14T11:34:39.036 INFO:tasks.workunit.client.0.smithi138.stderr:election_strategy: 1 2024-09-14T11:34:39.036 INFO:tasks.workunit.client.0.smithi138.stderr:0: [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] mon.a 2024-09-14T11:34:39.036 INFO:tasks.workunit.client.0.smithi138.stderr:1: [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] mon.b 2024-09-14T11:34:39.036 INFO:tasks.workunit.client.0.smithi138.stderr:2: [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] mon.c 2024-09-14T11:34:39.036 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-14T11:34:39.036 INFO:tasks.workunit.client.0.smithi138.stderr: -479> 2024-09-14T11:34:38.500+0000 7f7943606640 10 monclient: _finish_auth 0 2024-09-14T11:34:39.036 INFO:tasks.workunit.client.0.smithi138.stderr: -478> 2024-09-14T11:34:38.500+0000 7f7943606640 10 monclient: _check_auth_tickets 2024-09-14T11:34:39.036 INFO:tasks.workunit.client.0.smithi138.stderr: -477> 2024-09-14T11:34:38.500+0000 7f7943606640 10 monclient: handle_config config(0 keys) 2024-09-14T11:34:39.036 INFO:tasks.workunit.client.0.smithi138.stderr: -476> 2024-09-14T11:34:38.500+0000 7f7943606640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:34:39.036 INFO:tasks.workunit.client.0.smithi138.stderr: -475> 2024-09-14T11:34:38.500+0000 7f7943606640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-14T11:34:39.036 INFO:tasks.workunit.client.0.smithi138.stderr: -474> 2024-09-14T11:34:38.500+0000 7f7943606640 10 monclient: dump: 2024-09-14T11:34:39.036 INFO:tasks.workunit.client.0.smithi138.stderr:epoch 1 2024-09-14T11:34:39.037 INFO:tasks.workunit.client.0.smithi138.stderr:fsid 3f225f43-83a6-4aeb-b798-1f04bb49d597 2024-09-14T11:34:39.037 INFO:tasks.workunit.client.0.smithi138.stderr:last_changed 2024-09-14T11:07:09.252780+0000 2024-09-14T11:34:39.037 INFO:tasks.workunit.client.0.smithi138.stderr:created 2024-09-14T11:07:09.252780+0000 2024-09-14T11:34:39.037 INFO:tasks.workunit.client.0.smithi138.stderr:min_mon_release 19 (squid) 2024-09-14T11:34:39.037 INFO:tasks.workunit.client.0.smithi138.stderr:election_strategy: 1 2024-09-14T11:34:39.037 INFO:tasks.workunit.client.0.smithi138.stderr:0: [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] mon.a 2024-09-14T11:34:39.037 INFO:tasks.workunit.client.0.smithi138.stderr:1: [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] mon.b 2024-09-14T11:34:39.037 INFO:tasks.workunit.client.0.smithi138.stderr:2: [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] mon.c 2024-09-14T11:34:39.037 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-14T11:34:39.037 INFO:tasks.workunit.client.0.smithi138.stderr: -473> 2024-09-14T11:34:38.500+0000 7f7a57c5f9c0 5 monclient: authenticate success, global_id 6122 2024-09-14T11:34:39.037 INFO:tasks.workunit.client.0.smithi138.stderr: -472> 2024-09-14T11:34:38.500+0000 7f7a57c5f9c0 10 monclient: get_monmap_and_config success 2024-09-14T11:34:39.037 INFO:tasks.workunit.client.0.smithi138.stderr: -471> 2024-09-14T11:34:38.500+0000 7f7a57c5f9c0 4 set_mon_vals no callback set 2024-09-14T11:34:39.037 INFO:tasks.workunit.client.0.smithi138.stderr: -470> 2024-09-14T11:34:38.504+0000 7f7a57c5f9c0 10 monclient: shutdown 2024-09-14T11:34:39.037 INFO:tasks.workunit.client.0.smithi138.stderr: -469> 2024-09-14T11:34:38.504+0000 7f7a57c5f9c0 5 asok(0x562010106d90) unregister_commands rotate-key 2024-09-14T11:34:39.038 INFO:tasks.workunit.client.0.smithi138.stderr: -468> 2024-09-14T11:34:38.504+0000 7f7a57c5f9c0 10 monclient: build_initial_monmap 2024-09-14T11:34:39.038 INFO:tasks.workunit.client.0.smithi138.stderr: -467> 2024-09-14T11:34:38.504+0000 7f7a57c5f9c0 1 build_initial for_mkfs: 0 2024-09-14T11:34:39.038 INFO:tasks.workunit.client.0.smithi138.stderr: -466> 2024-09-14T11:34:38.504+0000 7f7a57c5f9c0 10 monclient: monmap: 2024-09-14T11:34:39.038 INFO:tasks.workunit.client.0.smithi138.stderr:epoch 0 2024-09-14T11:34:39.038 INFO:tasks.workunit.client.0.smithi138.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-14T11:34:39.038 INFO:tasks.workunit.client.0.smithi138.stderr:last_changed 0.000000 2024-09-14T11:34:39.038 INFO:tasks.workunit.client.0.smithi138.stderr:created 0.000000 2024-09-14T11:34:39.038 INFO:tasks.workunit.client.0.smithi138.stderr:min_mon_release 0 (unknown) 2024-09-14T11:34:39.038 INFO:tasks.workunit.client.0.smithi138.stderr:election_strategy: 1 2024-09-14T11:34:39.038 INFO:tasks.workunit.client.0.smithi138.stderr:0: [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] mon.noname-a 2024-09-14T11:34:39.038 INFO:tasks.workunit.client.0.smithi138.stderr:1: [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] mon.noname-b 2024-09-14T11:34:39.038 INFO:tasks.workunit.client.0.smithi138.stderr:2: [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] mon.noname-c 2024-09-14T11:34:39.038 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-14T11:34:39.038 INFO:tasks.workunit.client.0.smithi138.stderr: -465> 2024-09-14T11:34:38.504+0000 7f7a57c5f9c0 5 AuthRegistry(0x562010342fc0) adding auth protocol: cephx 2024-09-14T11:34:39.038 INFO:tasks.workunit.client.0.smithi138.stderr: -464> 2024-09-14T11:34:38.504+0000 7f7a57c5f9c0 5 AuthRegistry(0x562010342fc0) adding auth protocol: cephx 2024-09-14T11:34:39.038 INFO:tasks.workunit.client.0.smithi138.stderr: -463> 2024-09-14T11:34:38.504+0000 7f7a57c5f9c0 5 AuthRegistry(0x562010342fc0) adding auth protocol: cephx 2024-09-14T11:34:39.039 INFO:tasks.workunit.client.0.smithi138.stderr: -462> 2024-09-14T11:34:38.504+0000 7f7a57c5f9c0 5 AuthRegistry(0x562010342fc0) adding con mode: secure 2024-09-14T11:34:39.039 INFO:tasks.workunit.client.0.smithi138.stderr: -461> 2024-09-14T11:34:38.504+0000 7f7a57c5f9c0 5 AuthRegistry(0x562010342fc0) adding con mode: crc 2024-09-14T11:34:39.039 INFO:tasks.workunit.client.0.smithi138.stderr: -460> 2024-09-14T11:34:38.504+0000 7f7a57c5f9c0 5 AuthRegistry(0x562010342fc0) adding con mode: secure 2024-09-14T11:34:39.039 INFO:tasks.workunit.client.0.smithi138.stderr: -459> 2024-09-14T11:34:38.504+0000 7f7a57c5f9c0 5 AuthRegistry(0x562010342fc0) adding con mode: crc 2024-09-14T11:34:39.039 INFO:tasks.workunit.client.0.smithi138.stderr: -458> 2024-09-14T11:34:38.504+0000 7f7a57c5f9c0 5 AuthRegistry(0x562010342fc0) adding con mode: secure 2024-09-14T11:34:39.039 INFO:tasks.workunit.client.0.smithi138.stderr: -457> 2024-09-14T11:34:38.504+0000 7f7a57c5f9c0 5 AuthRegistry(0x562010342fc0) adding con mode: crc 2024-09-14T11:34:39.039 INFO:tasks.workunit.client.0.smithi138.stderr: -456> 2024-09-14T11:34:38.504+0000 7f7a57c5f9c0 5 AuthRegistry(0x562010342fc0) adding con mode: crc 2024-09-14T11:34:39.039 INFO:tasks.workunit.client.0.smithi138.stderr: -455> 2024-09-14T11:34:38.504+0000 7f7a57c5f9c0 5 AuthRegistry(0x562010342fc0) adding con mode: secure 2024-09-14T11:34:39.039 INFO:tasks.workunit.client.0.smithi138.stderr: -454> 2024-09-14T11:34:38.504+0000 7f7a57c5f9c0 5 AuthRegistry(0x562010342fc0) adding con mode: crc 2024-09-14T11:34:39.039 INFO:tasks.workunit.client.0.smithi138.stderr: -453> 2024-09-14T11:34:38.504+0000 7f7a57c5f9c0 5 AuthRegistry(0x562010342fc0) adding con mode: secure 2024-09-14T11:34:39.039 INFO:tasks.workunit.client.0.smithi138.stderr: -452> 2024-09-14T11:34:38.504+0000 7f7a57c5f9c0 5 AuthRegistry(0x562010342fc0) adding con mode: crc 2024-09-14T11:34:39.039 INFO:tasks.workunit.client.0.smithi138.stderr: -451> 2024-09-14T11:34:38.504+0000 7f7a57c5f9c0 5 AuthRegistry(0x562010342fc0) adding con mode: secure 2024-09-14T11:34:39.039 INFO:tasks.workunit.client.0.smithi138.stderr: -450> 2024-09-14T11:34:38.504+0000 7f7a57c5f9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:34:39.039 INFO:tasks.workunit.client.0.smithi138.stderr: -449> 2024-09-14T11:34:38.504+0000 7f7a57c5f9c0 1 librados: starting msgr at 2024-09-14T11:34:39.040 INFO:tasks.workunit.client.0.smithi138.stderr: -448> 2024-09-14T11:34:38.504+0000 7f7a57c5f9c0 1 librados: starting objecter 2024-09-14T11:34:39.040 INFO:tasks.workunit.client.0.smithi138.stderr: -447> 2024-09-14T11:34:38.504+0000 7f7a57c5f9c0 5 asok(0x562010106d90) register_command objecter_requests hook 0x562010344200 2024-09-14T11:34:39.040 INFO:tasks.workunit.client.0.smithi138.stderr: -446> 2024-09-14T11:34:38.504+0000 7f7a57c5f9c0 1 librados: setting wanted keys 2024-09-14T11:34:39.040 INFO:tasks.workunit.client.0.smithi138.stderr: -445> 2024-09-14T11:34:38.504+0000 7f7a57c5f9c0 1 librados: calling monclient init 2024-09-14T11:34:39.040 INFO:tasks.workunit.client.0.smithi138.stderr: -444> 2024-09-14T11:34:38.504+0000 7f7a57c5f9c0 10 monclient: init 2024-09-14T11:34:39.040 INFO:tasks.workunit.client.0.smithi138.stderr: -443> 2024-09-14T11:34:38.504+0000 7f7a57c5f9c0 5 AuthRegistry(0x562010314110) adding auth protocol: cephx 2024-09-14T11:34:39.040 INFO:tasks.workunit.client.0.smithi138.stderr: -442> 2024-09-14T11:34:38.504+0000 7f7a57c5f9c0 5 AuthRegistry(0x562010314110) adding auth protocol: cephx 2024-09-14T11:34:39.040 INFO:tasks.workunit.client.0.smithi138.stderr: -441> 2024-09-14T11:34:38.504+0000 7f7a57c5f9c0 5 AuthRegistry(0x562010314110) adding auth protocol: cephx 2024-09-14T11:34:39.040 INFO:tasks.workunit.client.0.smithi138.stderr: -440> 2024-09-14T11:34:38.504+0000 7f7a57c5f9c0 5 AuthRegistry(0x562010314110) adding con mode: secure 2024-09-14T11:34:39.040 INFO:tasks.workunit.client.0.smithi138.stderr: -439> 2024-09-14T11:34:38.504+0000 7f7a57c5f9c0 5 AuthRegistry(0x562010314110) adding con mode: crc 2024-09-14T11:34:39.040 INFO:tasks.workunit.client.0.smithi138.stderr: -438> 2024-09-14T11:34:38.504+0000 7f7a57c5f9c0 5 AuthRegistry(0x562010314110) adding con mode: secure 2024-09-14T11:34:39.040 INFO:tasks.workunit.client.0.smithi138.stderr: -437> 2024-09-14T11:34:38.504+0000 7f7a57c5f9c0 5 AuthRegistry(0x562010314110) adding con mode: crc 2024-09-14T11:34:39.040 INFO:tasks.workunit.client.0.smithi138.stderr: -436> 2024-09-14T11:34:38.504+0000 7f7a57c5f9c0 5 AuthRegistry(0x562010314110) adding con mode: secure 2024-09-14T11:34:39.040 INFO:tasks.workunit.client.0.smithi138.stderr: -435> 2024-09-14T11:34:38.504+0000 7f7a57c5f9c0 5 AuthRegistry(0x562010314110) adding con mode: crc 2024-09-14T11:34:39.041 INFO:tasks.workunit.client.0.smithi138.stderr: -434> 2024-09-14T11:34:38.504+0000 7f7a57c5f9c0 5 AuthRegistry(0x562010314110) adding con mode: crc 2024-09-14T11:34:39.041 INFO:tasks.workunit.client.0.smithi138.stderr: -433> 2024-09-14T11:34:38.504+0000 7f7a57c5f9c0 5 AuthRegistry(0x562010314110) adding con mode: secure 2024-09-14T11:34:39.041 INFO:tasks.workunit.client.0.smithi138.stderr: -432> 2024-09-14T11:34:38.504+0000 7f7a57c5f9c0 5 AuthRegistry(0x562010314110) adding con mode: crc 2024-09-14T11:34:39.041 INFO:tasks.workunit.client.0.smithi138.stderr: -431> 2024-09-14T11:34:38.504+0000 7f7a57c5f9c0 5 AuthRegistry(0x562010314110) adding con mode: secure 2024-09-14T11:34:39.041 INFO:tasks.workunit.client.0.smithi138.stderr: -430> 2024-09-14T11:34:38.504+0000 7f7a57c5f9c0 5 AuthRegistry(0x562010314110) adding con mode: crc 2024-09-14T11:34:39.041 INFO:tasks.workunit.client.0.smithi138.stderr: -429> 2024-09-14T11:34:38.504+0000 7f7a57c5f9c0 5 AuthRegistry(0x562010314110) adding con mode: secure 2024-09-14T11:34:39.041 INFO:tasks.workunit.client.0.smithi138.stderr: -428> 2024-09-14T11:34:38.504+0000 7f7a57c5f9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:34:39.041 INFO:tasks.workunit.client.0.smithi138.stderr: -427> 2024-09-14T11:34:38.504+0000 7f7a57c5f9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:34:39.041 INFO:tasks.workunit.client.0.smithi138.stderr: -426> 2024-09-14T11:34:38.504+0000 7f7a57c5f9c0 5 asok(0x562010106d90) register_command rotate-key hook 0x562010314258 2024-09-14T11:34:39.041 INFO:tasks.workunit.client.0.smithi138.stderr: -425> 2024-09-14T11:34:38.504+0000 7f7a57c5f9c0 10 monclient: _reopen_session rank -1 2024-09-14T11:34:39.041 INFO:tasks.workunit.client.0.smithi138.stderr: -424> 2024-09-14T11:34:38.504+0000 7f7a57c5f9c0 10 monclient: _add_conns ranks=[0,2,1] 2024-09-14T11:34:39.041 INFO:tasks.workunit.client.0.smithi138.stderr: -423> 2024-09-14T11:34:38.504+0000 7f7a57c5f9c0 10 monclient(hunting): picked mon.noname-a con 0x56201019f740 addr [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] 2024-09-14T11:34:39.041 INFO:tasks.workunit.client.0.smithi138.stderr: -422> 2024-09-14T11:34:38.504+0000 7f7a57c5f9c0 10 monclient(hunting): picked mon.noname-c con 0x5620101c1bf0 addr [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] 2024-09-14T11:34:39.041 INFO:tasks.workunit.client.0.smithi138.stderr: -421> 2024-09-14T11:34:38.504+0000 7f7a57c5f9c0 10 monclient(hunting): picked mon.noname-b con 0x562010259ad0 addr [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] 2024-09-14T11:34:39.042 INFO:tasks.workunit.client.0.smithi138.stderr: -420> 2024-09-14T11:34:38.504+0000 7f7a57c5f9c0 10 monclient(hunting): start opening mon connection 2024-09-14T11:34:39.042 INFO:tasks.workunit.client.0.smithi138.stderr: -419> 2024-09-14T11:34:38.504+0000 7f7a57c5f9c0 10 monclient(hunting): start opening mon connection 2024-09-14T11:34:39.042 INFO:tasks.workunit.client.0.smithi138.stderr: -418> 2024-09-14T11:34:38.504+0000 7f7a57c5f9c0 10 monclient(hunting): start opening mon connection 2024-09-14T11:34:39.042 INFO:tasks.workunit.client.0.smithi138.stderr: -417> 2024-09-14T11:34:38.504+0000 7f7a57c5f9c0 10 monclient(hunting): _renew_subs 2024-09-14T11:34:39.042 INFO:tasks.workunit.client.0.smithi138.stderr: -416> 2024-09-14T11:34:38.504+0000 7f7a57c5f9c0 10 monclient(hunting): authenticate will time out at 2614.465625s 2024-09-14T11:34:39.042 INFO:tasks.workunit.client.0.smithi138.stderr: -415> 2024-09-14T11:34:38.504+0000 7f7a54f64640 10 monclient(hunting): get_auth_request con 0x5620101c1bf0 auth_method 0 2024-09-14T11:34:39.042 INFO:tasks.workunit.client.0.smithi138.stderr: -414> 2024-09-14T11:34:38.504+0000 7f7a54f64640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:34:39.042 INFO:tasks.workunit.client.0.smithi138.stderr: -413> 2024-09-14T11:34:38.504+0000 7f7a54f64640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:34:39.042 INFO:tasks.workunit.client.0.smithi138.stderr: -412> 2024-09-14T11:34:38.504+0000 7f7a54f64640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:34:39.042 INFO:tasks.workunit.client.0.smithi138.stderr: -411> 2024-09-14T11:34:38.504+0000 7f7a55765640 10 monclient(hunting): get_auth_request con 0x56201019f740 auth_method 0 2024-09-14T11:34:39.042 INFO:tasks.workunit.client.0.smithi138.stderr: -410> 2024-09-14T11:34:38.504+0000 7f7a55765640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:34:39.042 INFO:tasks.workunit.client.0.smithi138.stderr: -409> 2024-09-14T11:34:38.504+0000 7f7a55765640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:34:39.042 INFO:tasks.workunit.client.0.smithi138.stderr: -408> 2024-09-14T11:34:38.504+0000 7f7a55765640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:34:39.042 INFO:tasks.workunit.client.0.smithi138.stderr: -407> 2024-09-14T11:34:38.504+0000 7f7a55765640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:34:39.043 INFO:tasks.workunit.client.0.smithi138.stderr: -406> 2024-09-14T11:34:38.504+0000 7f7a55765640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:34:39.043 INFO:tasks.workunit.client.0.smithi138.stderr: -405> 2024-09-14T11:34:38.504+0000 7f7a55765640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:34:39.043 INFO:tasks.workunit.client.0.smithi138.stderr: -404> 2024-09-14T11:34:38.504+0000 7f7a54f64640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:34:39.043 INFO:tasks.workunit.client.0.smithi138.stderr: -403> 2024-09-14T11:34:38.504+0000 7f7a54f64640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:34:39.043 INFO:tasks.workunit.client.0.smithi138.stderr: -402> 2024-09-14T11:34:38.504+0000 7f7a54f64640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:34:39.043 INFO:tasks.workunit.client.0.smithi138.stderr: -401> 2024-09-14T11:34:38.504+0000 7f7a55f66640 10 monclient(hunting): get_auth_request con 0x562010259ad0 auth_method 0 2024-09-14T11:34:39.043 INFO:tasks.workunit.client.0.smithi138.stderr: -400> 2024-09-14T11:34:38.504+0000 7f7a55f66640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:34:39.043 INFO:tasks.workunit.client.0.smithi138.stderr: -399> 2024-09-14T11:34:38.504+0000 7f7a55f66640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:34:39.043 INFO:tasks.workunit.client.0.smithi138.stderr: -398> 2024-09-14T11:34:38.504+0000 7f7a55f66640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:34:39.043 INFO:tasks.workunit.client.0.smithi138.stderr: -397> 2024-09-14T11:34:38.504+0000 7f7a54f64640 10 monclient(hunting): handle_auth_done global_id 6125 payload 824 2024-09-14T11:34:39.043 INFO:tasks.workunit.client.0.smithi138.stderr: -396> 2024-09-14T11:34:38.504+0000 7f7a54f64640 10 monclient: _finish_hunting 0 2024-09-14T11:34:39.043 INFO:tasks.workunit.client.0.smithi138.stderr: -395> 2024-09-14T11:34:38.504+0000 7f7a54f64640 1 monclient: found mon.noname-c 2024-09-14T11:34:39.043 INFO:tasks.workunit.client.0.smithi138.stderr: -394> 2024-09-14T11:34:38.504+0000 7f7a54f64640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.138:3301/0 2024-09-14T11:34:39.043 INFO:tasks.workunit.client.0.smithi138.stderr: -393> 2024-09-14T11:34:38.504+0000 7f7941e03640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:34:39.043 INFO:tasks.workunit.client.0.smithi138.stderr: -392> 2024-09-14T11:34:38.504+0000 7f7941e03640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-14T11:34:39.043 INFO:tasks.workunit.client.0.smithi138.stderr: -391> 2024-09-14T11:34:38.504+0000 7f7941e03640 10 monclient: dump: 2024-09-14T11:34:39.044 INFO:tasks.workunit.client.0.smithi138.stderr:epoch 1 2024-09-14T11:34:39.044 INFO:tasks.workunit.client.0.smithi138.stderr:fsid 3f225f43-83a6-4aeb-b798-1f04bb49d597 2024-09-14T11:34:39.044 INFO:tasks.workunit.client.0.smithi138.stderr:last_changed 2024-09-14T11:07:09.252780+0000 2024-09-14T11:34:39.044 INFO:tasks.workunit.client.0.smithi138.stderr:created 2024-09-14T11:07:09.252780+0000 2024-09-14T11:34:39.044 INFO:tasks.workunit.client.0.smithi138.stderr:min_mon_release 19 (squid) 2024-09-14T11:34:39.044 INFO:tasks.workunit.client.0.smithi138.stderr:election_strategy: 1 2024-09-14T11:34:39.044 INFO:tasks.workunit.client.0.smithi138.stderr:0: [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] mon.a 2024-09-14T11:34:39.044 INFO:tasks.workunit.client.0.smithi138.stderr:1: [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] mon.b 2024-09-14T11:34:39.044 INFO:tasks.workunit.client.0.smithi138.stderr:2: [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] mon.c 2024-09-14T11:34:39.044 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-14T11:34:39.044 INFO:tasks.workunit.client.0.smithi138.stderr: -390> 2024-09-14T11:34:38.504+0000 7f7941e03640 10 monclient: _finish_auth 0 2024-09-14T11:34:39.044 INFO:tasks.workunit.client.0.smithi138.stderr: -389> 2024-09-14T11:34:38.504+0000 7f7941e03640 10 monclient: _check_auth_tickets 2024-09-14T11:34:39.044 INFO:tasks.workunit.client.0.smithi138.stderr: -388> 2024-09-14T11:34:38.504+0000 7f7941e03640 10 monclient: handle_config config(0 keys) 2024-09-14T11:34:39.044 INFO:tasks.workunit.client.0.smithi138.stderr: -387> 2024-09-14T11:34:38.504+0000 7f7941e03640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:34:39.044 INFO:tasks.workunit.client.0.smithi138.stderr: -386> 2024-09-14T11:34:38.504+0000 7f7941e03640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-14T11:34:39.045 INFO:tasks.workunit.client.0.smithi138.stderr: -385> 2024-09-14T11:34:38.504+0000 7f7941e03640 10 monclient: dump: 2024-09-14T11:34:39.045 INFO:tasks.workunit.client.0.smithi138.stderr:epoch 1 2024-09-14T11:34:39.045 INFO:tasks.workunit.client.0.smithi138.stderr:fsid 3f225f43-83a6-4aeb-b798-1f04bb49d597 2024-09-14T11:34:39.045 INFO:tasks.workunit.client.0.smithi138.stderr:last_changed 2024-09-14T11:07:09.252780+0000 2024-09-14T11:34:39.045 INFO:tasks.workunit.client.0.smithi138.stderr:created 2024-09-14T11:07:09.252780+0000 2024-09-14T11:34:39.045 INFO:tasks.workunit.client.0.smithi138.stderr:min_mon_release 19 (squid) 2024-09-14T11:34:39.045 INFO:tasks.workunit.client.0.smithi138.stderr:election_strategy: 1 2024-09-14T11:34:39.045 INFO:tasks.workunit.client.0.smithi138.stderr:0: [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] mon.a 2024-09-14T11:34:39.045 INFO:tasks.workunit.client.0.smithi138.stderr:1: [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] mon.b 2024-09-14T11:34:39.045 INFO:tasks.workunit.client.0.smithi138.stderr:2: [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] mon.c 2024-09-14T11:34:39.045 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-14T11:34:39.045 INFO:tasks.workunit.client.0.smithi138.stderr: -384> 2024-09-14T11:34:38.504+0000 7f7943606640 4 set_mon_vals no callback set 2024-09-14T11:34:39.045 INFO:tasks.workunit.client.0.smithi138.stderr: -383> 2024-09-14T11:34:38.504+0000 7f7a57c5f9c0 5 monclient: authenticate success, global_id 6125 2024-09-14T11:34:39.045 INFO:tasks.workunit.client.0.smithi138.stderr: -382> 2024-09-14T11:34:38.504+0000 7f7a57c5f9c0 10 monclient: _renew_subs 2024-09-14T11:34:39.045 INFO:tasks.workunit.client.0.smithi138.stderr: -381> 2024-09-14T11:34:38.504+0000 7f7a57c5f9c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.138:3301/0 2024-09-14T11:34:39.046 INFO:tasks.workunit.client.0.smithi138.stderr: -380> 2024-09-14T11:34:38.504+0000 7f7a57c5f9c0 10 monclient: _renew_subs 2024-09-14T11:34:39.046 INFO:tasks.workunit.client.0.smithi138.stderr: -379> 2024-09-14T11:34:38.504+0000 7f7a57c5f9c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.138:3301/0 2024-09-14T11:34:39.046 INFO:tasks.workunit.client.0.smithi138.stderr: -378> 2024-09-14T11:34:38.504+0000 7f7a57c5f9c0 1 librados: init done 2024-09-14T11:34:39.046 INFO:tasks.workunit.client.0.smithi138.stderr: -377> 2024-09-14T11:34:38.508+0000 7f7941e03640 4 mgrc handle_mgr_map Got map version 5 2024-09-14T11:34:39.046 INFO:tasks.workunit.client.0.smithi138.stderr: -376> 2024-09-14T11:34:38.508+0000 7f7941e03640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.138:6832/3778043143,v1:172.21.15.138:6833/3778043143] 2024-09-14T11:34:39.046 INFO:tasks.workunit.client.0.smithi138.stderr: -375> 2024-09-14T11:34:38.508+0000 7f7941e03640 4 mgrc reconnect Starting new session with [v2:172.21.15.138:6832/3778043143,v1:172.21.15.138:6833/3778043143] 2024-09-14T11:34:39.046 INFO:tasks.workunit.client.0.smithi138.stderr: -374> 2024-09-14T11:34:38.508+0000 7f7a55765640 10 monclient: get_auth_request con 0x7f793c0718a0 auth_method 0 2024-09-14T11:34:39.046 INFO:tasks.workunit.client.0.smithi138.stderr: -373> 2024-09-14T11:34:38.508+0000 7f7a55f66640 10 monclient: get_auth_request con 0x562010355770 auth_method 0 2024-09-14T11:34:39.046 INFO:tasks.workunit.client.0.smithi138.stderr: -372> 2024-09-14T11:34:38.508+0000 7f7a55765640 10 monclient: get_auth_request con 0x56201035ef40 auth_method 0 2024-09-14T11:34:39.046 INFO:tasks.workunit.client.0.smithi138.stderr: -371> 2024-09-14T11:34:38.512+0000 7f7a54f64640 10 monclient: get_auth_request con 0x5620103632e0 auth_method 0 2024-09-14T11:34:39.046 INFO:tasks.workunit.client.0.smithi138.stderr: -370> 2024-09-14T11:34:38.512+0000 7f7a55f66640 10 monclient: get_auth_request con 0x5620103677c0 auth_method 0 2024-09-14T11:34:39.046 INFO:tasks.workunit.client.0.smithi138.stderr: -369> 2024-09-14T11:34:38.512+0000 7f7a57c5f9c0 10 monclient: build_initial_monmap 2024-09-14T11:34:39.046 INFO:tasks.workunit.client.0.smithi138.stderr: -368> 2024-09-14T11:34:38.512+0000 7f7a57c5f9c0 1 build_initial for_mkfs: 0 2024-09-14T11:34:39.046 INFO:tasks.workunit.client.0.smithi138.stderr: -367> 2024-09-14T11:34:38.512+0000 7f7a57c5f9c0 10 monclient: monmap: 2024-09-14T11:34:39.046 INFO:tasks.workunit.client.0.smithi138.stderr:epoch 0 2024-09-14T11:34:39.047 INFO:tasks.workunit.client.0.smithi138.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-14T11:34:39.047 INFO:tasks.workunit.client.0.smithi138.stderr:last_changed 0.000000 2024-09-14T11:34:39.047 INFO:tasks.workunit.client.0.smithi138.stderr:created 0.000000 2024-09-14T11:34:39.047 INFO:tasks.workunit.client.0.smithi138.stderr:min_mon_release 0 (unknown) 2024-09-14T11:34:39.047 INFO:tasks.workunit.client.0.smithi138.stderr:election_strategy: 1 2024-09-14T11:34:39.047 INFO:tasks.workunit.client.0.smithi138.stderr:0: [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] mon.noname-a 2024-09-14T11:34:39.047 INFO:tasks.workunit.client.0.smithi138.stderr:1: [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] mon.noname-b 2024-09-14T11:34:39.047 INFO:tasks.workunit.client.0.smithi138.stderr:2: [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] mon.noname-c 2024-09-14T11:34:39.047 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-14T11:34:39.047 INFO:tasks.workunit.client.0.smithi138.stderr: -366> 2024-09-14T11:34:38.512+0000 7f7a57c5f9c0 5 AuthRegistry(0x56201036b580) adding auth protocol: cephx 2024-09-14T11:34:39.047 INFO:tasks.workunit.client.0.smithi138.stderr: -365> 2024-09-14T11:34:38.512+0000 7f7a57c5f9c0 5 AuthRegistry(0x56201036b580) adding auth protocol: cephx 2024-09-14T11:34:39.047 INFO:tasks.workunit.client.0.smithi138.stderr: -364> 2024-09-14T11:34:38.512+0000 7f7a57c5f9c0 5 AuthRegistry(0x56201036b580) adding auth protocol: cephx 2024-09-14T11:34:39.047 INFO:tasks.workunit.client.0.smithi138.stderr: -363> 2024-09-14T11:34:38.512+0000 7f7a57c5f9c0 5 AuthRegistry(0x56201036b580) adding con mode: secure 2024-09-14T11:34:39.047 INFO:tasks.workunit.client.0.smithi138.stderr: -362> 2024-09-14T11:34:38.512+0000 7f7a57c5f9c0 5 AuthRegistry(0x56201036b580) adding con mode: crc 2024-09-14T11:34:39.047 INFO:tasks.workunit.client.0.smithi138.stderr: -361> 2024-09-14T11:34:38.512+0000 7f7a57c5f9c0 5 AuthRegistry(0x56201036b580) adding con mode: secure 2024-09-14T11:34:39.048 INFO:tasks.workunit.client.0.smithi138.stderr: -360> 2024-09-14T11:34:38.512+0000 7f7a57c5f9c0 5 AuthRegistry(0x56201036b580) adding con mode: crc 2024-09-14T11:34:39.048 INFO:tasks.workunit.client.0.smithi138.stderr: -359> 2024-09-14T11:34:38.512+0000 7f7a57c5f9c0 5 AuthRegistry(0x56201036b580) adding con mode: secure 2024-09-14T11:34:39.048 INFO:tasks.workunit.client.0.smithi138.stderr: -358> 2024-09-14T11:34:38.512+0000 7f7a57c5f9c0 5 AuthRegistry(0x56201036b580) adding con mode: crc 2024-09-14T11:34:39.048 INFO:tasks.workunit.client.0.smithi138.stderr: -357> 2024-09-14T11:34:38.512+0000 7f7a57c5f9c0 5 AuthRegistry(0x56201036b580) adding con mode: crc 2024-09-14T11:34:39.048 INFO:tasks.workunit.client.0.smithi138.stderr: -356> 2024-09-14T11:34:38.512+0000 7f7a57c5f9c0 5 AuthRegistry(0x56201036b580) adding con mode: secure 2024-09-14T11:34:39.048 INFO:tasks.workunit.client.0.smithi138.stderr: -355> 2024-09-14T11:34:38.512+0000 7f7a57c5f9c0 5 AuthRegistry(0x56201036b580) adding con mode: crc 2024-09-14T11:34:39.048 INFO:tasks.workunit.client.0.smithi138.stderr: -354> 2024-09-14T11:34:38.512+0000 7f7a57c5f9c0 5 AuthRegistry(0x56201036b580) adding con mode: secure 2024-09-14T11:34:39.048 INFO:tasks.workunit.client.0.smithi138.stderr: -353> 2024-09-14T11:34:38.512+0000 7f7a57c5f9c0 5 AuthRegistry(0x56201036b580) adding con mode: crc 2024-09-14T11:34:39.048 INFO:tasks.workunit.client.0.smithi138.stderr: -352> 2024-09-14T11:34:38.512+0000 7f7a57c5f9c0 5 AuthRegistry(0x56201036b580) adding con mode: secure 2024-09-14T11:34:39.048 INFO:tasks.workunit.client.0.smithi138.stderr: -351> 2024-09-14T11:34:38.512+0000 7f7a57c5f9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:34:39.048 INFO:tasks.workunit.client.0.smithi138.stderr: -350> 2024-09-14T11:34:38.512+0000 7f7a57c5f9c0 5 asok(0x562010106d90) register_command objecter_requests cmddesc objecter_requests hook 0x56201036edf0 EEXIST 2024-09-14T11:34:39.048 INFO:tasks.workunit.client.0.smithi138.stderr: -349> 2024-09-14T11:34:38.512+0000 7f7a57c5f9c0 10 monclient: init 2024-09-14T11:34:39.048 INFO:tasks.workunit.client.0.smithi138.stderr: -348> 2024-09-14T11:34:38.512+0000 7f7a57c5f9c0 5 AuthRegistry(0x56201036a508) adding auth protocol: cephx 2024-09-14T11:34:39.048 INFO:tasks.workunit.client.0.smithi138.stderr: -347> 2024-09-14T11:34:38.512+0000 7f7a57c5f9c0 5 AuthRegistry(0x56201036a508) adding auth protocol: cephx 2024-09-14T11:34:39.049 INFO:tasks.workunit.client.0.smithi138.stderr: -346> 2024-09-14T11:34:38.512+0000 7f7a57c5f9c0 5 AuthRegistry(0x56201036a508) adding auth protocol: cephx 2024-09-14T11:34:39.049 INFO:tasks.workunit.client.0.smithi138.stderr: -345> 2024-09-14T11:34:38.512+0000 7f7a57c5f9c0 5 AuthRegistry(0x56201036a508) adding con mode: secure 2024-09-14T11:34:39.049 INFO:tasks.workunit.client.0.smithi138.stderr: -344> 2024-09-14T11:34:38.512+0000 7f7a57c5f9c0 5 AuthRegistry(0x56201036a508) adding con mode: crc 2024-09-14T11:34:39.049 INFO:tasks.workunit.client.0.smithi138.stderr: -343> 2024-09-14T11:34:38.512+0000 7f7a57c5f9c0 5 AuthRegistry(0x56201036a508) adding con mode: secure 2024-09-14T11:34:39.049 INFO:tasks.workunit.client.0.smithi138.stderr: -342> 2024-09-14T11:34:38.512+0000 7f7a57c5f9c0 5 AuthRegistry(0x56201036a508) adding con mode: crc 2024-09-14T11:34:39.049 INFO:tasks.workunit.client.0.smithi138.stderr: -341> 2024-09-14T11:34:38.512+0000 7f7a57c5f9c0 5 AuthRegistry(0x56201036a508) adding con mode: secure 2024-09-14T11:34:39.049 INFO:tasks.workunit.client.0.smithi138.stderr: -340> 2024-09-14T11:34:38.512+0000 7f7a57c5f9c0 5 AuthRegistry(0x56201036a508) adding con mode: crc 2024-09-14T11:34:39.049 INFO:tasks.workunit.client.0.smithi138.stderr: -339> 2024-09-14T11:34:38.512+0000 7f7a57c5f9c0 5 AuthRegistry(0x56201036a508) adding con mode: crc 2024-09-14T11:34:39.049 INFO:tasks.workunit.client.0.smithi138.stderr: -338> 2024-09-14T11:34:38.512+0000 7f7a57c5f9c0 5 AuthRegistry(0x56201036a508) adding con mode: secure 2024-09-14T11:34:39.049 INFO:tasks.workunit.client.0.smithi138.stderr: -337> 2024-09-14T11:34:38.512+0000 7f7a57c5f9c0 5 AuthRegistry(0x56201036a508) adding con mode: crc 2024-09-14T11:34:39.049 INFO:tasks.workunit.client.0.smithi138.stderr: -336> 2024-09-14T11:34:38.512+0000 7f7a57c5f9c0 5 AuthRegistry(0x56201036a508) adding con mode: secure 2024-09-14T11:34:39.049 INFO:tasks.workunit.client.0.smithi138.stderr: -335> 2024-09-14T11:34:38.512+0000 7f7a57c5f9c0 5 AuthRegistry(0x56201036a508) adding con mode: crc 2024-09-14T11:34:39.049 INFO:tasks.workunit.client.0.smithi138.stderr: -334> 2024-09-14T11:34:38.512+0000 7f7a57c5f9c0 5 AuthRegistry(0x56201036a508) adding con mode: secure 2024-09-14T11:34:39.049 INFO:tasks.workunit.client.0.smithi138.stderr: -333> 2024-09-14T11:34:38.516+0000 7f7a57c5f9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:34:39.050 INFO:tasks.workunit.client.0.smithi138.stderr: -332> 2024-09-14T11:34:38.516+0000 7f7a57c5f9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:34:39.050 INFO:tasks.workunit.client.0.smithi138.stderr: -331> 2024-09-14T11:34:38.516+0000 7f7a57c5f9c0 5 asok(0x562010106d90) register_command rotate-key cmddesc rotate-key hook 0x56201036a650 EEXIST 2024-09-14T11:34:39.050 INFO:tasks.workunit.client.0.smithi138.stderr: -330> 2024-09-14T11:34:38.516+0000 7f7a57c5f9c0 10 monclient: _reopen_session rank -1 2024-09-14T11:34:39.050 INFO:tasks.workunit.client.0.smithi138.stderr: -329> 2024-09-14T11:34:38.516+0000 7f7a57c5f9c0 10 monclient: _add_conns ranks=[2,1,0] 2024-09-14T11:34:39.050 INFO:tasks.workunit.client.0.smithi138.stderr: -328> 2024-09-14T11:34:38.516+0000 7f7a57c5f9c0 10 monclient(hunting): picked mon.noname-c con 0x562010392fa0 addr [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] 2024-09-14T11:34:39.050 INFO:tasks.workunit.client.0.smithi138.stderr: -327> 2024-09-14T11:34:38.516+0000 7f7a57c5f9c0 10 monclient(hunting): picked mon.noname-b con 0x5620103928d0 addr [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] 2024-09-14T11:34:39.050 INFO:tasks.workunit.client.0.smithi138.stderr: -326> 2024-09-14T11:34:38.516+0000 7f7a57c5f9c0 10 monclient(hunting): picked mon.noname-a con 0x5620103912b0 addr [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] 2024-09-14T11:34:39.050 INFO:tasks.workunit.client.0.smithi138.stderr: -325> 2024-09-14T11:34:38.516+0000 7f7a57c5f9c0 10 monclient(hunting): start opening mon connection 2024-09-14T11:34:39.050 INFO:tasks.workunit.client.0.smithi138.stderr: -324> 2024-09-14T11:34:38.516+0000 7f7a57c5f9c0 10 monclient(hunting): start opening mon connection 2024-09-14T11:34:39.050 INFO:tasks.workunit.client.0.smithi138.stderr: -323> 2024-09-14T11:34:38.516+0000 7f7a57c5f9c0 10 monclient(hunting): start opening mon connection 2024-09-14T11:34:39.050 INFO:tasks.workunit.client.0.smithi138.stderr: -322> 2024-09-14T11:34:38.516+0000 7f7a57c5f9c0 10 monclient(hunting): _renew_subs 2024-09-14T11:34:39.050 INFO:tasks.workunit.client.0.smithi138.stderr: -321> 2024-09-14T11:34:38.516+0000 7f7a57c5f9c0 10 monclient(hunting): authenticate will time out at 2614.476512s 2024-09-14T11:34:39.050 INFO:tasks.workunit.client.0.smithi138.stderr: -320> 2024-09-14T11:34:38.516+0000 7f7a55765640 10 monclient(hunting): get_auth_request con 0x5620103912b0 auth_method 0 2024-09-14T11:34:39.050 INFO:tasks.workunit.client.0.smithi138.stderr: -319> 2024-09-14T11:34:38.516+0000 7f7a55765640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:34:39.050 INFO:tasks.workunit.client.0.smithi138.stderr: -318> 2024-09-14T11:34:38.516+0000 7f7a55765640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:34:39.050 INFO:tasks.workunit.client.0.smithi138.stderr: -317> 2024-09-14T11:34:38.516+0000 7f7a55765640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:34:39.051 INFO:tasks.workunit.client.0.smithi138.stderr: -316> 2024-09-14T11:34:38.516+0000 7f7a54f64640 10 monclient(hunting): get_auth_request con 0x562010392fa0 auth_method 0 2024-09-14T11:34:39.051 INFO:tasks.workunit.client.0.smithi138.stderr: -315> 2024-09-14T11:34:38.516+0000 7f7a54f64640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:34:39.051 INFO:tasks.workunit.client.0.smithi138.stderr: -314> 2024-09-14T11:34:38.516+0000 7f7a54f64640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:34:39.051 INFO:tasks.workunit.client.0.smithi138.stderr: -313> 2024-09-14T11:34:38.516+0000 7f7a54f64640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:34:39.051 INFO:tasks.workunit.client.0.smithi138.stderr: -312> 2024-09-14T11:34:38.516+0000 7f7a55765640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:34:39.051 INFO:tasks.workunit.client.0.smithi138.stderr: -311> 2024-09-14T11:34:38.516+0000 7f7a55765640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:34:39.051 INFO:tasks.workunit.client.0.smithi138.stderr: -310> 2024-09-14T11:34:38.516+0000 7f7a55765640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:34:39.051 INFO:tasks.workunit.client.0.smithi138.stderr: -309> 2024-09-14T11:34:38.516+0000 7f7a54f64640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:34:39.051 INFO:tasks.workunit.client.0.smithi138.stderr: -308> 2024-09-14T11:34:38.516+0000 7f7a54f64640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:34:39.051 INFO:tasks.workunit.client.0.smithi138.stderr: -307> 2024-09-14T11:34:38.516+0000 7f7a54f64640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:34:39.051 INFO:tasks.workunit.client.0.smithi138.stderr: -306> 2024-09-14T11:34:38.516+0000 7f7a55f66640 10 monclient(hunting): get_auth_request con 0x5620103928d0 auth_method 0 2024-09-14T11:34:39.051 INFO:tasks.workunit.client.0.smithi138.stderr: -305> 2024-09-14T11:34:38.516+0000 7f7a55f66640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:34:39.051 INFO:tasks.workunit.client.0.smithi138.stderr: -304> 2024-09-14T11:34:38.516+0000 7f7a55f66640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:34:39.051 INFO:tasks.workunit.client.0.smithi138.stderr: -303> 2024-09-14T11:34:38.516+0000 7f7a55f66640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:34:39.051 INFO:tasks.workunit.client.0.smithi138.stderr: -302> 2024-09-14T11:34:38.516+0000 7f7a55765640 10 monclient(hunting): handle_auth_done global_id 6534 payload 824 2024-09-14T11:34:39.052 INFO:tasks.workunit.client.0.smithi138.stderr: -301> 2024-09-14T11:34:38.516+0000 7f7a55765640 10 monclient: _finish_hunting 0 2024-09-14T11:34:39.052 INFO:tasks.workunit.client.0.smithi138.stderr: -300> 2024-09-14T11:34:38.516+0000 7f7a55765640 1 monclient: found mon.noname-a 2024-09-14T11:34:39.052 INFO:tasks.workunit.client.0.smithi138.stderr: -299> 2024-09-14T11:34:38.516+0000 7f7a55765640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.138:3300/0 2024-09-14T11:34:39.052 INFO:tasks.workunit.client.0.smithi138.stderr: -298> 2024-09-14T11:34:38.516+0000 7f793affd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:34:39.052 INFO:tasks.workunit.client.0.smithi138.stderr: -297> 2024-09-14T11:34:38.516+0000 7f793affd640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-14T11:34:39.052 INFO:tasks.workunit.client.0.smithi138.stderr: -296> 2024-09-14T11:34:38.516+0000 7f793affd640 10 monclient: dump: 2024-09-14T11:34:39.052 INFO:tasks.workunit.client.0.smithi138.stderr:epoch 1 2024-09-14T11:34:39.052 INFO:tasks.workunit.client.0.smithi138.stderr:fsid 3f225f43-83a6-4aeb-b798-1f04bb49d597 2024-09-14T11:34:39.052 INFO:tasks.workunit.client.0.smithi138.stderr:last_changed 2024-09-14T11:07:09.252780+0000 2024-09-14T11:34:39.052 INFO:tasks.workunit.client.0.smithi138.stderr:created 2024-09-14T11:07:09.252780+0000 2024-09-14T11:34:39.052 INFO:tasks.workunit.client.0.smithi138.stderr:min_mon_release 19 (squid) 2024-09-14T11:34:39.052 INFO:tasks.workunit.client.0.smithi138.stderr:election_strategy: 1 2024-09-14T11:34:39.052 INFO:tasks.workunit.client.0.smithi138.stderr:0: [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] mon.a 2024-09-14T11:34:39.052 INFO:tasks.workunit.client.0.smithi138.stderr:1: [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] mon.b 2024-09-14T11:34:39.053 INFO:tasks.workunit.client.0.smithi138.stderr:2: [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] mon.c 2024-09-14T11:34:39.053 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-14T11:34:39.053 INFO:tasks.workunit.client.0.smithi138.stderr: -295> 2024-09-14T11:34:38.516+0000 7f793affd640 10 monclient: _finish_auth 0 2024-09-14T11:34:39.053 INFO:tasks.workunit.client.0.smithi138.stderr: -294> 2024-09-14T11:34:38.516+0000 7f793affd640 10 monclient: _check_auth_tickets 2024-09-14T11:34:39.053 INFO:tasks.workunit.client.0.smithi138.stderr: -293> 2024-09-14T11:34:38.516+0000 7f793affd640 10 monclient: handle_config config(0 keys) 2024-09-14T11:34:39.053 INFO:tasks.workunit.client.0.smithi138.stderr: -292> 2024-09-14T11:34:38.516+0000 7f793affd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:34:39.053 INFO:tasks.workunit.client.0.smithi138.stderr: -291> 2024-09-14T11:34:38.516+0000 7f793affd640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-14T11:34:39.053 INFO:tasks.workunit.client.0.smithi138.stderr: -290> 2024-09-14T11:34:38.516+0000 7f793affd640 10 monclient: dump: 2024-09-14T11:34:39.053 INFO:tasks.workunit.client.0.smithi138.stderr:epoch 1 2024-09-14T11:34:39.053 INFO:tasks.workunit.client.0.smithi138.stderr:fsid 3f225f43-83a6-4aeb-b798-1f04bb49d597 2024-09-14T11:34:39.053 INFO:tasks.workunit.client.0.smithi138.stderr:last_changed 2024-09-14T11:07:09.252780+0000 2024-09-14T11:34:39.053 INFO:tasks.workunit.client.0.smithi138.stderr:created 2024-09-14T11:07:09.252780+0000 2024-09-14T11:34:39.053 INFO:tasks.workunit.client.0.smithi138.stderr:min_mon_release 19 (squid) 2024-09-14T11:34:39.053 INFO:tasks.workunit.client.0.smithi138.stderr:election_strategy: 1 2024-09-14T11:34:39.054 INFO:tasks.workunit.client.0.smithi138.stderr:0: [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] mon.a 2024-09-14T11:34:39.054 INFO:tasks.workunit.client.0.smithi138.stderr:1: [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] mon.b 2024-09-14T11:34:39.054 INFO:tasks.workunit.client.0.smithi138.stderr:2: [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] mon.c 2024-09-14T11:34:39.054 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-14T11:34:39.054 INFO:tasks.workunit.client.0.smithi138.stderr: -289> 2024-09-14T11:34:38.516+0000 7f7a57c5f9c0 5 monclient: authenticate success, global_id 6534 2024-09-14T11:34:39.054 INFO:tasks.workunit.client.0.smithi138.stderr: -288> 2024-09-14T11:34:38.516+0000 7f7a56767640 4 set_mon_vals no callback set 2024-09-14T11:34:39.054 INFO:tasks.workunit.client.0.smithi138.stderr: -287> 2024-09-14T11:34:38.516+0000 7f7a57c5f9c0 10 monclient: _renew_subs 2024-09-14T11:34:39.054 INFO:tasks.workunit.client.0.smithi138.stderr: -286> 2024-09-14T11:34:38.516+0000 7f7a57c5f9c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.138:3300/0 2024-09-14T11:34:39.054 INFO:tasks.workunit.client.0.smithi138.stderr: -285> 2024-09-14T11:34:38.516+0000 7f7a57c5f9c0 10 monclient: _renew_subs 2024-09-14T11:34:39.054 INFO:tasks.workunit.client.0.smithi138.stderr: -284> 2024-09-14T11:34:38.516+0000 7f7a57c5f9c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.138:3300/0 2024-09-14T11:34:39.054 INFO:tasks.workunit.client.0.smithi138.stderr: -283> 2024-09-14T11:34:38.516+0000 7f793affd640 4 mgrc handle_mgr_map Got map version 5 2024-09-14T11:34:39.054 INFO:tasks.workunit.client.0.smithi138.stderr: -282> 2024-09-14T11:34:38.516+0000 7f793affd640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.138:6832/3778043143,v1:172.21.15.138:6833/3778043143] 2024-09-14T11:34:39.054 INFO:tasks.workunit.client.0.smithi138.stderr: -281> 2024-09-14T11:34:38.516+0000 7f793affd640 4 mgrc reconnect Starting new session with [v2:172.21.15.138:6832/3778043143,v1:172.21.15.138:6833/3778043143] 2024-09-14T11:34:39.054 INFO:tasks.workunit.client.0.smithi138.stderr: -280> 2024-09-14T11:34:38.516+0000 7f7a54f64640 10 monclient: get_auth_request con 0x7f79300717e0 auth_method 0 2024-09-14T11:34:39.055 INFO:tasks.workunit.client.0.smithi138.stderr: -279> 2024-09-14T11:34:38.516+0000 7f7a57c5f9c0 10 monclient: get_monmap_and_config 2024-09-14T11:34:39.055 INFO:tasks.workunit.client.0.smithi138.stderr: -278> 2024-09-14T11:34:38.516+0000 7f7a57c5f9c0 10 monclient: build_initial_monmap 2024-09-14T11:34:39.055 INFO:tasks.workunit.client.0.smithi138.stderr: -277> 2024-09-14T11:34:38.516+0000 7f7a57c5f9c0 1 build_initial for_mkfs: 0 2024-09-14T11:34:39.055 INFO:tasks.workunit.client.0.smithi138.stderr: -276> 2024-09-14T11:34:38.516+0000 7f7a57c5f9c0 10 monclient: monmap: 2024-09-14T11:34:39.055 INFO:tasks.workunit.client.0.smithi138.stderr:epoch 0 2024-09-14T11:34:39.055 INFO:tasks.workunit.client.0.smithi138.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-14T11:34:39.055 INFO:tasks.workunit.client.0.smithi138.stderr:last_changed 0.000000 2024-09-14T11:34:39.055 INFO:tasks.workunit.client.0.smithi138.stderr:created 0.000000 2024-09-14T11:34:39.055 INFO:tasks.workunit.client.0.smithi138.stderr:min_mon_release 0 (unknown) 2024-09-14T11:34:39.055 INFO:tasks.workunit.client.0.smithi138.stderr:election_strategy: 1 2024-09-14T11:34:39.055 INFO:tasks.workunit.client.0.smithi138.stderr:0: [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] mon.noname-a 2024-09-14T11:34:39.055 INFO:tasks.workunit.client.0.smithi138.stderr:1: [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] mon.noname-b 2024-09-14T11:34:39.055 INFO:tasks.workunit.client.0.smithi138.stderr:2: [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] mon.noname-c 2024-09-14T11:34:39.055 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-14T11:34:39.056 INFO:tasks.workunit.client.0.smithi138.stderr: -275> 2024-09-14T11:34:38.516+0000 7f7a57c5f9c0 5 AuthRegistry(0x5620103b2840) adding auth protocol: cephx 2024-09-14T11:34:39.056 INFO:tasks.workunit.client.0.smithi138.stderr: -274> 2024-09-14T11:34:38.516+0000 7f7a57c5f9c0 5 AuthRegistry(0x5620103b2840) adding auth protocol: cephx 2024-09-14T11:34:39.056 INFO:tasks.workunit.client.0.smithi138.stderr: -273> 2024-09-14T11:34:38.516+0000 7f7a57c5f9c0 5 AuthRegistry(0x5620103b2840) adding auth protocol: cephx 2024-09-14T11:34:39.056 INFO:tasks.workunit.client.0.smithi138.stderr: -272> 2024-09-14T11:34:38.516+0000 7f7a57c5f9c0 5 AuthRegistry(0x5620103b2840) adding con mode: secure 2024-09-14T11:34:39.056 INFO:tasks.workunit.client.0.smithi138.stderr: -271> 2024-09-14T11:34:38.516+0000 7f7a57c5f9c0 5 AuthRegistry(0x5620103b2840) adding con mode: crc 2024-09-14T11:34:39.056 INFO:tasks.workunit.client.0.smithi138.stderr: -270> 2024-09-14T11:34:38.516+0000 7f7a57c5f9c0 5 AuthRegistry(0x5620103b2840) adding con mode: secure 2024-09-14T11:34:39.056 INFO:tasks.workunit.client.0.smithi138.stderr: -269> 2024-09-14T11:34:38.516+0000 7f7a57c5f9c0 5 AuthRegistry(0x5620103b2840) adding con mode: crc 2024-09-14T11:34:39.056 INFO:tasks.workunit.client.0.smithi138.stderr: -268> 2024-09-14T11:34:38.516+0000 7f7a57c5f9c0 5 AuthRegistry(0x5620103b2840) adding con mode: secure 2024-09-14T11:34:39.056 INFO:tasks.workunit.client.0.smithi138.stderr: -267> 2024-09-14T11:34:38.516+0000 7f7a57c5f9c0 5 AuthRegistry(0x5620103b2840) adding con mode: crc 2024-09-14T11:34:39.056 INFO:tasks.workunit.client.0.smithi138.stderr: -266> 2024-09-14T11:34:38.516+0000 7f7a57c5f9c0 5 AuthRegistry(0x5620103b2840) adding con mode: crc 2024-09-14T11:34:39.056 INFO:tasks.workunit.client.0.smithi138.stderr: -265> 2024-09-14T11:34:38.516+0000 7f7a57c5f9c0 5 AuthRegistry(0x5620103b2840) adding con mode: secure 2024-09-14T11:34:39.056 INFO:tasks.workunit.client.0.smithi138.stderr: -264> 2024-09-14T11:34:38.516+0000 7f7a57c5f9c0 5 AuthRegistry(0x5620103b2840) adding con mode: crc 2024-09-14T11:34:39.056 INFO:tasks.workunit.client.0.smithi138.stderr: -263> 2024-09-14T11:34:38.516+0000 7f7a57c5f9c0 5 AuthRegistry(0x5620103b2840) adding con mode: secure 2024-09-14T11:34:39.056 INFO:tasks.workunit.client.0.smithi138.stderr: -262> 2024-09-14T11:34:38.516+0000 7f7a57c5f9c0 5 AuthRegistry(0x5620103b2840) adding con mode: crc 2024-09-14T11:34:39.056 INFO:tasks.workunit.client.0.smithi138.stderr: -261> 2024-09-14T11:34:38.516+0000 7f7a57c5f9c0 5 AuthRegistry(0x5620103b2840) adding con mode: secure 2024-09-14T11:34:39.057 INFO:tasks.workunit.client.0.smithi138.stderr: -260> 2024-09-14T11:34:38.520+0000 7f7a57c5f9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:34:39.057 INFO:tasks.workunit.client.0.smithi138.stderr: -259> 2024-09-14T11:34:38.520+0000 7f7a57c5f9c0 10 monclient: init 2024-09-14T11:34:39.057 INFO:tasks.workunit.client.0.smithi138.stderr: -258> 2024-09-14T11:34:38.520+0000 7f7a57c5f9c0 5 AuthRegistry(0x7fff1a3a2720) adding auth protocol: cephx 2024-09-14T11:34:39.057 INFO:tasks.workunit.client.0.smithi138.stderr: -257> 2024-09-14T11:34:38.520+0000 7f7a57c5f9c0 5 AuthRegistry(0x7fff1a3a2720) adding auth protocol: cephx 2024-09-14T11:34:39.057 INFO:tasks.workunit.client.0.smithi138.stderr: -256> 2024-09-14T11:34:38.520+0000 7f7a57c5f9c0 5 AuthRegistry(0x7fff1a3a2720) adding auth protocol: cephx 2024-09-14T11:34:39.057 INFO:tasks.workunit.client.0.smithi138.stderr: -255> 2024-09-14T11:34:38.520+0000 7f7a57c5f9c0 5 AuthRegistry(0x7fff1a3a2720) adding con mode: secure 2024-09-14T11:34:39.057 INFO:tasks.workunit.client.0.smithi138.stderr: -254> 2024-09-14T11:34:38.520+0000 7f7a57c5f9c0 5 AuthRegistry(0x7fff1a3a2720) adding con mode: crc 2024-09-14T11:34:39.057 INFO:tasks.workunit.client.0.smithi138.stderr: -253> 2024-09-14T11:34:38.520+0000 7f7a57c5f9c0 5 AuthRegistry(0x7fff1a3a2720) adding con mode: secure 2024-09-14T11:34:39.057 INFO:tasks.workunit.client.0.smithi138.stderr: -252> 2024-09-14T11:34:38.520+0000 7f7a57c5f9c0 5 AuthRegistry(0x7fff1a3a2720) adding con mode: crc 2024-09-14T11:34:39.057 INFO:tasks.workunit.client.0.smithi138.stderr: -251> 2024-09-14T11:34:38.520+0000 7f7a57c5f9c0 5 AuthRegistry(0x7fff1a3a2720) adding con mode: secure 2024-09-14T11:34:39.057 INFO:tasks.workunit.client.0.smithi138.stderr: -250> 2024-09-14T11:34:38.520+0000 7f7a57c5f9c0 5 AuthRegistry(0x7fff1a3a2720) adding con mode: crc 2024-09-14T11:34:39.057 INFO:tasks.workunit.client.0.smithi138.stderr: -249> 2024-09-14T11:34:38.520+0000 7f7a57c5f9c0 5 AuthRegistry(0x7fff1a3a2720) adding con mode: crc 2024-09-14T11:34:39.057 INFO:tasks.workunit.client.0.smithi138.stderr: -248> 2024-09-14T11:34:38.520+0000 7f7a57c5f9c0 5 AuthRegistry(0x7fff1a3a2720) adding con mode: secure 2024-09-14T11:34:39.058 INFO:tasks.workunit.client.0.smithi138.stderr: -247> 2024-09-14T11:34:38.520+0000 7f7a57c5f9c0 5 AuthRegistry(0x7fff1a3a2720) adding con mode: crc 2024-09-14T11:34:39.058 INFO:tasks.workunit.client.0.smithi138.stderr: -246> 2024-09-14T11:34:38.520+0000 7f7a57c5f9c0 5 AuthRegistry(0x7fff1a3a2720) adding con mode: secure 2024-09-14T11:34:39.058 INFO:tasks.workunit.client.0.smithi138.stderr: -245> 2024-09-14T11:34:38.520+0000 7f7a57c5f9c0 5 AuthRegistry(0x7fff1a3a2720) adding con mode: crc 2024-09-14T11:34:39.058 INFO:tasks.workunit.client.0.smithi138.stderr: -244> 2024-09-14T11:34:38.520+0000 7f7a57c5f9c0 5 AuthRegistry(0x7fff1a3a2720) adding con mode: secure 2024-09-14T11:34:39.058 INFO:tasks.workunit.client.0.smithi138.stderr: -243> 2024-09-14T11:34:38.520+0000 7f7a57c5f9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:34:39.058 INFO:tasks.workunit.client.0.smithi138.stderr: -242> 2024-09-14T11:34:38.520+0000 7f7a57c5f9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:34:39.058 INFO:tasks.workunit.client.0.smithi138.stderr: -241> 2024-09-14T11:34:38.520+0000 7f7a57c5f9c0 5 asok(0x562010106d90) register_command rotate-key cmddesc rotate-key hook 0x7fff1a3a2868 EEXIST 2024-09-14T11:34:39.058 INFO:tasks.workunit.client.0.smithi138.stderr: -240> 2024-09-14T11:34:38.520+0000 7f7a57c5f9c0 10 monclient: _reopen_session rank -1 2024-09-14T11:34:39.058 INFO:tasks.workunit.client.0.smithi138.stderr: -239> 2024-09-14T11:34:38.520+0000 7f7a57c5f9c0 10 monclient: _add_conns ranks=[2,1,0] 2024-09-14T11:34:39.058 INFO:tasks.workunit.client.0.smithi138.stderr: -238> 2024-09-14T11:34:38.520+0000 7f7a57c5f9c0 10 monclient(hunting): picked mon.noname-c con 0x5620103e0e30 addr [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] 2024-09-14T11:34:39.058 INFO:tasks.workunit.client.0.smithi138.stderr: -237> 2024-09-14T11:34:38.520+0000 7f7a57c5f9c0 10 monclient(hunting): picked mon.noname-b con 0x5620103e1210 addr [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] 2024-09-14T11:34:39.058 INFO:tasks.workunit.client.0.smithi138.stderr: -236> 2024-09-14T11:34:38.520+0000 7f7a57c5f9c0 10 monclient(hunting): picked mon.noname-a con 0x5620103e26d0 addr [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] 2024-09-14T11:34:39.058 INFO:tasks.workunit.client.0.smithi138.stderr: -235> 2024-09-14T11:34:38.520+0000 7f7a57c5f9c0 10 monclient(hunting): start opening mon connection 2024-09-14T11:34:39.058 INFO:tasks.workunit.client.0.smithi138.stderr: -234> 2024-09-14T11:34:38.520+0000 7f7a57c5f9c0 10 monclient(hunting): start opening mon connection 2024-09-14T11:34:39.059 INFO:tasks.workunit.client.0.smithi138.stderr: -233> 2024-09-14T11:34:38.520+0000 7f7a57c5f9c0 10 monclient(hunting): start opening mon connection 2024-09-14T11:34:39.059 INFO:tasks.workunit.client.0.smithi138.stderr: -232> 2024-09-14T11:34:38.520+0000 7f7a57c5f9c0 10 monclient(hunting): _renew_subs 2024-09-14T11:34:39.059 INFO:tasks.workunit.client.0.smithi138.stderr: -231> 2024-09-14T11:34:38.520+0000 7f7a57c5f9c0 10 monclient(hunting): authenticate will time out at 2614.480961s 2024-09-14T11:34:39.059 INFO:tasks.workunit.client.0.smithi138.stderr: -230> 2024-09-14T11:34:38.520+0000 7f7a54f64640 10 monclient(hunting): get_auth_request con 0x5620103e0e30 auth_method 0 2024-09-14T11:34:39.059 INFO:tasks.workunit.client.0.smithi138.stderr: -229> 2024-09-14T11:34:38.520+0000 7f7a54f64640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:34:39.059 INFO:tasks.workunit.client.0.smithi138.stderr: -228> 2024-09-14T11:34:38.520+0000 7f7a54f64640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:34:39.059 INFO:tasks.workunit.client.0.smithi138.stderr: -227> 2024-09-14T11:34:38.520+0000 7f7a54f64640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:34:39.059 INFO:tasks.workunit.client.0.smithi138.stderr: -226> 2024-09-14T11:34:38.520+0000 7f7a55765640 10 monclient(hunting): get_auth_request con 0x5620103e26d0 auth_method 0 2024-09-14T11:34:39.059 INFO:tasks.workunit.client.0.smithi138.stderr: -225> 2024-09-14T11:34:38.520+0000 7f7a55765640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:34:39.059 INFO:tasks.workunit.client.0.smithi138.stderr: -224> 2024-09-14T11:34:38.520+0000 7f7a55765640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:34:39.059 INFO:tasks.workunit.client.0.smithi138.stderr: -223> 2024-09-14T11:34:38.520+0000 7f7a55765640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:34:39.059 INFO:tasks.workunit.client.0.smithi138.stderr: -222> 2024-09-14T11:34:38.520+0000 7f7a54f64640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:34:39.059 INFO:tasks.workunit.client.0.smithi138.stderr: -221> 2024-09-14T11:34:38.520+0000 7f7a54f64640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:34:39.059 INFO:tasks.workunit.client.0.smithi138.stderr: -220> 2024-09-14T11:34:38.520+0000 7f7a54f64640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:34:39.060 INFO:tasks.workunit.client.0.smithi138.stderr: -219> 2024-09-14T11:34:38.520+0000 7f7a55765640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:34:39.060 INFO:tasks.workunit.client.0.smithi138.stderr: -218> 2024-09-14T11:34:38.520+0000 7f7a55765640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:34:39.060 INFO:tasks.workunit.client.0.smithi138.stderr: -217> 2024-09-14T11:34:38.520+0000 7f7a55765640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:34:39.060 INFO:tasks.workunit.client.0.smithi138.stderr: -216> 2024-09-14T11:34:38.520+0000 7f7a54f64640 10 monclient(hunting): handle_auth_done global_id 6131 payload 274 2024-09-14T11:34:39.060 INFO:tasks.workunit.client.0.smithi138.stderr: -215> 2024-09-14T11:34:38.520+0000 7f7a54f64640 10 monclient: _finish_hunting 0 2024-09-14T11:34:39.060 INFO:tasks.workunit.client.0.smithi138.stderr: -214> 2024-09-14T11:34:38.520+0000 7f7a54f64640 1 monclient: found mon.noname-c 2024-09-14T11:34:39.060 INFO:tasks.workunit.client.0.smithi138.stderr: -213> 2024-09-14T11:34:38.520+0000 7f7a54f64640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.138:3301/0 2024-09-14T11:34:39.060 INFO:tasks.workunit.client.0.smithi138.stderr: -212> 2024-09-14T11:34:38.520+0000 7f7a55f66640 10 monclient: get_auth_request con 0x5620103e1210 auth_method 0 2024-09-14T11:34:39.060 INFO:tasks.workunit.client.0.smithi138.stderr: -211> 2024-09-14T11:34:38.520+0000 7f7938ff9640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:34:39.060 INFO:tasks.workunit.client.0.smithi138.stderr: -210> 2024-09-14T11:34:38.520+0000 7f7938ff9640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-14T11:34:39.060 INFO:tasks.workunit.client.0.smithi138.stderr: -209> 2024-09-14T11:34:38.520+0000 7f7938ff9640 10 monclient: dump: 2024-09-14T11:34:39.060 INFO:tasks.workunit.client.0.smithi138.stderr:epoch 1 2024-09-14T11:34:39.060 INFO:tasks.workunit.client.0.smithi138.stderr:fsid 3f225f43-83a6-4aeb-b798-1f04bb49d597 2024-09-14T11:34:39.061 INFO:tasks.workunit.client.0.smithi138.stderr:last_changed 2024-09-14T11:07:09.252780+0000 2024-09-14T11:34:39.061 INFO:tasks.workunit.client.0.smithi138.stderr:created 2024-09-14T11:07:09.252780+0000 2024-09-14T11:34:39.061 INFO:tasks.workunit.client.0.smithi138.stderr:min_mon_release 19 (squid) 2024-09-14T11:34:39.061 INFO:tasks.workunit.client.0.smithi138.stderr:election_strategy: 1 2024-09-14T11:34:39.061 INFO:tasks.workunit.client.0.smithi138.stderr:0: [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] mon.a 2024-09-14T11:34:39.061 INFO:tasks.workunit.client.0.smithi138.stderr:1: [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] mon.b 2024-09-14T11:34:39.061 INFO:tasks.workunit.client.0.smithi138.stderr:2: [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] mon.c 2024-09-14T11:34:39.061 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-14T11:34:39.061 INFO:tasks.workunit.client.0.smithi138.stderr: -208> 2024-09-14T11:34:38.520+0000 7f7938ff9640 10 monclient: _finish_auth 0 2024-09-14T11:34:39.061 INFO:tasks.workunit.client.0.smithi138.stderr: -207> 2024-09-14T11:34:38.520+0000 7f7938ff9640 10 monclient: _check_auth_tickets 2024-09-14T11:34:39.061 INFO:tasks.workunit.client.0.smithi138.stderr: -206> 2024-09-14T11:34:38.520+0000 7f7938ff9640 10 monclient: handle_config config(0 keys) 2024-09-14T11:34:39.061 INFO:tasks.workunit.client.0.smithi138.stderr: -205> 2024-09-14T11:34:38.520+0000 7f7938ff9640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:34:39.061 INFO:tasks.workunit.client.0.smithi138.stderr: -204> 2024-09-14T11:34:38.520+0000 7f7938ff9640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-14T11:34:39.061 INFO:tasks.workunit.client.0.smithi138.stderr: -203> 2024-09-14T11:34:38.520+0000 7f7938ff9640 10 monclient: dump: 2024-09-14T11:34:39.061 INFO:tasks.workunit.client.0.smithi138.stderr:epoch 1 2024-09-14T11:34:39.062 INFO:tasks.workunit.client.0.smithi138.stderr:fsid 3f225f43-83a6-4aeb-b798-1f04bb49d597 2024-09-14T11:34:39.062 INFO:tasks.workunit.client.0.smithi138.stderr:last_changed 2024-09-14T11:07:09.252780+0000 2024-09-14T11:34:39.062 INFO:tasks.workunit.client.0.smithi138.stderr:created 2024-09-14T11:07:09.252780+0000 2024-09-14T11:34:39.062 INFO:tasks.workunit.client.0.smithi138.stderr:min_mon_release 19 (squid) 2024-09-14T11:34:39.062 INFO:tasks.workunit.client.0.smithi138.stderr:election_strategy: 1 2024-09-14T11:34:39.062 INFO:tasks.workunit.client.0.smithi138.stderr:0: [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] mon.a 2024-09-14T11:34:39.062 INFO:tasks.workunit.client.0.smithi138.stderr:1: [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] mon.b 2024-09-14T11:34:39.062 INFO:tasks.workunit.client.0.smithi138.stderr:2: [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] mon.c 2024-09-14T11:34:39.062 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-14T11:34:39.062 INFO:tasks.workunit.client.0.smithi138.stderr: -202> 2024-09-14T11:34:38.520+0000 7f7a57c5f9c0 5 monclient: authenticate success, global_id 6131 2024-09-14T11:34:39.062 INFO:tasks.workunit.client.0.smithi138.stderr: -201> 2024-09-14T11:34:38.520+0000 7f7a57c5f9c0 10 monclient: get_monmap_and_config success 2024-09-14T11:34:39.062 INFO:tasks.workunit.client.0.smithi138.stderr: -200> 2024-09-14T11:34:38.520+0000 7f7a57c5f9c0 4 set_mon_vals no callback set 2024-09-14T11:34:39.062 INFO:tasks.workunit.client.0.smithi138.stderr: -199> 2024-09-14T11:34:38.520+0000 7f7a57c5f9c0 10 monclient: shutdown 2024-09-14T11:34:39.063 INFO:tasks.workunit.client.0.smithi138.stderr: -198> 2024-09-14T11:34:38.520+0000 7f7a57c5f9c0 10 monclient: build_initial_monmap 2024-09-14T11:34:39.063 INFO:tasks.workunit.client.0.smithi138.stderr: -197> 2024-09-14T11:34:38.520+0000 7f7a57c5f9c0 1 build_initial for_mkfs: 0 2024-09-14T11:34:39.063 INFO:tasks.workunit.client.0.smithi138.stderr: -196> 2024-09-14T11:34:38.520+0000 7f7a57c5f9c0 10 monclient: monmap: 2024-09-14T11:34:39.063 INFO:tasks.workunit.client.0.smithi138.stderr:epoch 0 2024-09-14T11:34:39.063 INFO:tasks.workunit.client.0.smithi138.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-14T11:34:39.063 INFO:tasks.workunit.client.0.smithi138.stderr:last_changed 0.000000 2024-09-14T11:34:39.063 INFO:tasks.workunit.client.0.smithi138.stderr:created 0.000000 2024-09-14T11:34:39.063 INFO:tasks.workunit.client.0.smithi138.stderr:min_mon_release 0 (unknown) 2024-09-14T11:34:39.063 INFO:tasks.workunit.client.0.smithi138.stderr:election_strategy: 1 2024-09-14T11:34:39.063 INFO:tasks.workunit.client.0.smithi138.stderr:0: [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] mon.noname-a 2024-09-14T11:34:39.063 INFO:tasks.workunit.client.0.smithi138.stderr:1: [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] mon.noname-b 2024-09-14T11:34:39.063 INFO:tasks.workunit.client.0.smithi138.stderr:2: [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] mon.noname-c 2024-09-14T11:34:39.063 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-14T11:34:39.063 INFO:tasks.workunit.client.0.smithi138.stderr: -195> 2024-09-14T11:34:38.520+0000 7f7a57c5f9c0 5 AuthRegistry(0x5620103b27f0) adding auth protocol: cephx 2024-09-14T11:34:39.064 INFO:tasks.workunit.client.0.smithi138.stderr: -194> 2024-09-14T11:34:38.520+0000 7f7a57c5f9c0 5 AuthRegistry(0x5620103b27f0) adding auth protocol: cephx 2024-09-14T11:34:39.064 INFO:tasks.workunit.client.0.smithi138.stderr: -193> 2024-09-14T11:34:38.520+0000 7f7a57c5f9c0 5 AuthRegistry(0x5620103b27f0) adding auth protocol: cephx 2024-09-14T11:34:39.064 INFO:tasks.workunit.client.0.smithi138.stderr: -192> 2024-09-14T11:34:38.520+0000 7f7a57c5f9c0 5 AuthRegistry(0x5620103b27f0) adding con mode: secure 2024-09-14T11:34:39.064 INFO:tasks.workunit.client.0.smithi138.stderr: -191> 2024-09-14T11:34:38.520+0000 7f7a57c5f9c0 5 AuthRegistry(0x5620103b27f0) adding con mode: crc 2024-09-14T11:34:39.064 INFO:tasks.workunit.client.0.smithi138.stderr: -190> 2024-09-14T11:34:38.520+0000 7f7a57c5f9c0 5 AuthRegistry(0x5620103b27f0) adding con mode: secure 2024-09-14T11:34:39.064 INFO:tasks.workunit.client.0.smithi138.stderr: -189> 2024-09-14T11:34:38.520+0000 7f7a57c5f9c0 5 AuthRegistry(0x5620103b27f0) adding con mode: crc 2024-09-14T11:34:39.064 INFO:tasks.workunit.client.0.smithi138.stderr: -188> 2024-09-14T11:34:38.520+0000 7f7a57c5f9c0 5 AuthRegistry(0x5620103b27f0) adding con mode: secure 2024-09-14T11:34:39.064 INFO:tasks.workunit.client.0.smithi138.stderr: -187> 2024-09-14T11:34:38.520+0000 7f7a57c5f9c0 5 AuthRegistry(0x5620103b27f0) adding con mode: crc 2024-09-14T11:34:39.064 INFO:tasks.workunit.client.0.smithi138.stderr: -186> 2024-09-14T11:34:38.520+0000 7f7a57c5f9c0 5 AuthRegistry(0x5620103b27f0) adding con mode: crc 2024-09-14T11:34:39.064 INFO:tasks.workunit.client.0.smithi138.stderr: -185> 2024-09-14T11:34:38.520+0000 7f7a57c5f9c0 5 AuthRegistry(0x5620103b27f0) adding con mode: secure 2024-09-14T11:34:39.064 INFO:tasks.workunit.client.0.smithi138.stderr: -184> 2024-09-14T11:34:38.520+0000 7f7a57c5f9c0 5 AuthRegistry(0x5620103b27f0) adding con mode: crc 2024-09-14T11:34:39.064 INFO:tasks.workunit.client.0.smithi138.stderr: -183> 2024-09-14T11:34:38.520+0000 7f7a57c5f9c0 5 AuthRegistry(0x5620103b27f0) adding con mode: secure 2024-09-14T11:34:39.064 INFO:tasks.workunit.client.0.smithi138.stderr: -182> 2024-09-14T11:34:38.520+0000 7f7a57c5f9c0 5 AuthRegistry(0x5620103b27f0) adding con mode: crc 2024-09-14T11:34:39.065 INFO:tasks.workunit.client.0.smithi138.stderr: -181> 2024-09-14T11:34:38.520+0000 7f7a57c5f9c0 5 AuthRegistry(0x5620103b27f0) adding con mode: secure 2024-09-14T11:34:39.065 INFO:tasks.workunit.client.0.smithi138.stderr: -180> 2024-09-14T11:34:38.520+0000 7f7a57c5f9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:34:39.065 INFO:tasks.workunit.client.0.smithi138.stderr: -179> 2024-09-14T11:34:38.520+0000 7f7a57c5f9c0 1 librados: starting msgr at 2024-09-14T11:34:39.065 INFO:tasks.workunit.client.0.smithi138.stderr: -178> 2024-09-14T11:34:38.520+0000 7f7a57c5f9c0 1 librados: starting objecter 2024-09-14T11:34:39.065 INFO:tasks.workunit.client.0.smithi138.stderr: -177> 2024-09-14T11:34:38.520+0000 7f7a57c5f9c0 5 asok(0x562010106d90) register_command objecter_requests cmddesc objecter_requests hook 0x562010390f20 EEXIST 2024-09-14T11:34:39.065 INFO:tasks.workunit.client.0.smithi138.stderr: -176> 2024-09-14T11:34:38.520+0000 7f7a57c5f9c0 1 librados: setting wanted keys 2024-09-14T11:34:39.065 INFO:tasks.workunit.client.0.smithi138.stderr: -175> 2024-09-14T11:34:38.520+0000 7f7a57c5f9c0 1 librados: calling monclient init 2024-09-14T11:34:39.065 INFO:tasks.workunit.client.0.smithi138.stderr: -174> 2024-09-14T11:34:38.520+0000 7f7a57c5f9c0 10 monclient: init 2024-09-14T11:34:39.065 INFO:tasks.workunit.client.0.smithi138.stderr: -173> 2024-09-14T11:34:38.520+0000 7f7a57c5f9c0 5 AuthRegistry(0x562010394dc0) adding auth protocol: cephx 2024-09-14T11:34:39.065 INFO:tasks.workunit.client.0.smithi138.stderr: -172> 2024-09-14T11:34:38.520+0000 7f7a57c5f9c0 5 AuthRegistry(0x562010394dc0) adding auth protocol: cephx 2024-09-14T11:34:39.065 INFO:tasks.workunit.client.0.smithi138.stderr: -171> 2024-09-14T11:34:38.520+0000 7f7a57c5f9c0 5 AuthRegistry(0x562010394dc0) adding auth protocol: cephx 2024-09-14T11:34:39.065 INFO:tasks.workunit.client.0.smithi138.stderr: -170> 2024-09-14T11:34:38.520+0000 7f7a57c5f9c0 5 AuthRegistry(0x562010394dc0) adding con mode: secure 2024-09-14T11:34:39.065 INFO:tasks.workunit.client.0.smithi138.stderr: -169> 2024-09-14T11:34:38.520+0000 7f7a57c5f9c0 5 AuthRegistry(0x562010394dc0) adding con mode: crc 2024-09-14T11:34:39.065 INFO:tasks.workunit.client.0.smithi138.stderr: -168> 2024-09-14T11:34:38.520+0000 7f7a57c5f9c0 5 AuthRegistry(0x562010394dc0) adding con mode: secure 2024-09-14T11:34:39.066 INFO:tasks.workunit.client.0.smithi138.stderr: -167> 2024-09-14T11:34:38.520+0000 7f7a57c5f9c0 5 AuthRegistry(0x562010394dc0) adding con mode: crc 2024-09-14T11:34:39.066 INFO:tasks.workunit.client.0.smithi138.stderr: -166> 2024-09-14T11:34:38.520+0000 7f7a57c5f9c0 5 AuthRegistry(0x562010394dc0) adding con mode: secure 2024-09-14T11:34:39.066 INFO:tasks.workunit.client.0.smithi138.stderr: -165> 2024-09-14T11:34:38.520+0000 7f7a57c5f9c0 5 AuthRegistry(0x562010394dc0) adding con mode: crc 2024-09-14T11:34:39.066 INFO:tasks.workunit.client.0.smithi138.stderr: -164> 2024-09-14T11:34:38.520+0000 7f7a57c5f9c0 5 AuthRegistry(0x562010394dc0) adding con mode: crc 2024-09-14T11:34:39.066 INFO:tasks.workunit.client.0.smithi138.stderr: -163> 2024-09-14T11:34:38.520+0000 7f7a57c5f9c0 5 AuthRegistry(0x562010394dc0) adding con mode: secure 2024-09-14T11:34:39.066 INFO:tasks.workunit.client.0.smithi138.stderr: -162> 2024-09-14T11:34:38.520+0000 7f7a57c5f9c0 5 AuthRegistry(0x562010394dc0) adding con mode: crc 2024-09-14T11:34:39.066 INFO:tasks.workunit.client.0.smithi138.stderr: -161> 2024-09-14T11:34:38.520+0000 7f7a57c5f9c0 5 AuthRegistry(0x562010394dc0) adding con mode: secure 2024-09-14T11:34:39.066 INFO:tasks.workunit.client.0.smithi138.stderr: -160> 2024-09-14T11:34:38.520+0000 7f7a57c5f9c0 5 AuthRegistry(0x562010394dc0) adding con mode: crc 2024-09-14T11:34:39.066 INFO:tasks.workunit.client.0.smithi138.stderr: -159> 2024-09-14T11:34:38.520+0000 7f7a57c5f9c0 5 AuthRegistry(0x562010394dc0) adding con mode: secure 2024-09-14T11:34:39.066 INFO:tasks.workunit.client.0.smithi138.stderr: -158> 2024-09-14T11:34:38.520+0000 7f7a57c5f9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:34:39.066 INFO:tasks.workunit.client.0.smithi138.stderr: -157> 2024-09-14T11:34:38.520+0000 7f7a57c5f9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:34:39.066 INFO:tasks.workunit.client.0.smithi138.stderr: -156> 2024-09-14T11:34:38.520+0000 7f7a57c5f9c0 5 asok(0x562010106d90) register_command rotate-key cmddesc rotate-key hook 0x562010394f08 EEXIST 2024-09-14T11:34:39.066 INFO:tasks.workunit.client.0.smithi138.stderr: -155> 2024-09-14T11:34:38.520+0000 7f7a57c5f9c0 10 monclient: _reopen_session rank -1 2024-09-14T11:34:39.067 INFO:tasks.workunit.client.0.smithi138.stderr: -154> 2024-09-14T11:34:38.520+0000 7f7a57c5f9c0 10 monclient: _add_conns ranks=[0,2,1] 2024-09-14T11:34:39.067 INFO:tasks.workunit.client.0.smithi138.stderr: -153> 2024-09-14T11:34:38.520+0000 7f7a57c5f9c0 10 monclient(hunting): picked mon.noname-a con 0x5620103e0e30 addr [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] 2024-09-14T11:34:39.067 INFO:tasks.workunit.client.0.smithi138.stderr: -152> 2024-09-14T11:34:38.520+0000 7f7a57c5f9c0 10 monclient(hunting): picked mon.noname-c con 0x5620103e26d0 addr [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] 2024-09-14T11:34:39.067 INFO:tasks.workunit.client.0.smithi138.stderr: -151> 2024-09-14T11:34:38.520+0000 7f7a57c5f9c0 10 monclient(hunting): picked mon.noname-b con 0x5620103e0180 addr [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] 2024-09-14T11:34:39.067 INFO:tasks.workunit.client.0.smithi138.stderr: -150> 2024-09-14T11:34:38.520+0000 7f7a57c5f9c0 10 monclient(hunting): start opening mon connection 2024-09-14T11:34:39.067 INFO:tasks.workunit.client.0.smithi138.stderr: -149> 2024-09-14T11:34:38.520+0000 7f7a57c5f9c0 10 monclient(hunting): start opening mon connection 2024-09-14T11:34:39.067 INFO:tasks.workunit.client.0.smithi138.stderr: -148> 2024-09-14T11:34:38.520+0000 7f7a57c5f9c0 10 monclient(hunting): start opening mon connection 2024-09-14T11:34:39.067 INFO:tasks.workunit.client.0.smithi138.stderr: -147> 2024-09-14T11:34:38.520+0000 7f7a57c5f9c0 10 monclient(hunting): _renew_subs 2024-09-14T11:34:39.067 INFO:tasks.workunit.client.0.smithi138.stderr: -146> 2024-09-14T11:34:38.520+0000 7f7a57c5f9c0 10 monclient(hunting): authenticate will time out at 2614.483506s 2024-09-14T11:34:39.067 INFO:tasks.workunit.client.0.smithi138.stderr: -145> 2024-09-14T11:34:38.520+0000 7f7a54f64640 10 monclient(hunting): get_auth_request con 0x5620103e0e30 auth_method 0 2024-09-14T11:34:39.067 INFO:tasks.workunit.client.0.smithi138.stderr: -144> 2024-09-14T11:34:38.520+0000 7f7a54f64640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:34:39.067 INFO:tasks.workunit.client.0.smithi138.stderr: -143> 2024-09-14T11:34:38.520+0000 7f7a54f64640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:34:39.067 INFO:tasks.workunit.client.0.smithi138.stderr: -142> 2024-09-14T11:34:38.520+0000 7f7a54f64640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:34:39.067 INFO:tasks.workunit.client.0.smithi138.stderr: -141> 2024-09-14T11:34:38.520+0000 7f7a55f66640 10 monclient(hunting): get_auth_request con 0x5620103e26d0 auth_method 0 2024-09-14T11:34:39.068 INFO:tasks.workunit.client.0.smithi138.stderr: -140> 2024-09-14T11:34:38.520+0000 7f7a55f66640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:34:39.068 INFO:tasks.workunit.client.0.smithi138.stderr: -139> 2024-09-14T11:34:38.520+0000 7f7a55f66640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:34:39.068 INFO:tasks.workunit.client.0.smithi138.stderr: -138> 2024-09-14T11:34:38.520+0000 7f7a55f66640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:34:39.068 INFO:tasks.workunit.client.0.smithi138.stderr: -137> 2024-09-14T11:34:38.520+0000 7f7a54f64640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:34:39.068 INFO:tasks.workunit.client.0.smithi138.stderr: -136> 2024-09-14T11:34:38.520+0000 7f7a54f64640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:34:39.068 INFO:tasks.workunit.client.0.smithi138.stderr: -135> 2024-09-14T11:34:38.520+0000 7f7a54f64640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:34:39.068 INFO:tasks.workunit.client.0.smithi138.stderr: -134> 2024-09-14T11:34:38.520+0000 7f7a55f66640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:34:39.068 INFO:tasks.workunit.client.0.smithi138.stderr: -133> 2024-09-14T11:34:38.520+0000 7f7a55f66640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:34:39.068 INFO:tasks.workunit.client.0.smithi138.stderr: -132> 2024-09-14T11:34:38.520+0000 7f7a55f66640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:34:39.068 INFO:tasks.workunit.client.0.smithi138.stderr: -131> 2024-09-14T11:34:38.520+0000 7f7a55f66640 10 monclient(hunting): handle_auth_done global_id 6134 payload 824 2024-09-14T11:34:39.068 INFO:tasks.workunit.client.0.smithi138.stderr: -130> 2024-09-14T11:34:38.520+0000 7f7a55f66640 10 monclient: _finish_hunting 0 2024-09-14T11:34:39.068 INFO:tasks.workunit.client.0.smithi138.stderr: -129> 2024-09-14T11:34:38.520+0000 7f7a55f66640 1 monclient: found mon.noname-c 2024-09-14T11:34:39.068 INFO:tasks.workunit.client.0.smithi138.stderr: -128> 2024-09-14T11:34:38.520+0000 7f7a55f66640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.138:3301/0 2024-09-14T11:34:39.068 INFO:tasks.workunit.client.0.smithi138.stderr: -127> 2024-09-14T11:34:38.524+0000 7f7926ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:34:39.068 INFO:tasks.workunit.client.0.smithi138.stderr: -126> 2024-09-14T11:34:38.524+0000 7f7926ffd640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-14T11:34:39.069 INFO:tasks.workunit.client.0.smithi138.stderr: -125> 2024-09-14T11:34:38.524+0000 7f7926ffd640 10 monclient: dump: 2024-09-14T11:34:39.069 INFO:tasks.workunit.client.0.smithi138.stderr:epoch 1 2024-09-14T11:34:39.069 INFO:tasks.workunit.client.0.smithi138.stderr:fsid 3f225f43-83a6-4aeb-b798-1f04bb49d597 2024-09-14T11:34:39.069 INFO:tasks.workunit.client.0.smithi138.stderr:last_changed 2024-09-14T11:07:09.252780+0000 2024-09-14T11:34:39.069 INFO:tasks.workunit.client.0.smithi138.stderr:created 2024-09-14T11:07:09.252780+0000 2024-09-14T11:34:39.069 INFO:tasks.workunit.client.0.smithi138.stderr:min_mon_release 19 (squid) 2024-09-14T11:34:39.069 INFO:tasks.workunit.client.0.smithi138.stderr:election_strategy: 1 2024-09-14T11:34:39.069 INFO:tasks.workunit.client.0.smithi138.stderr:0: [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] mon.a 2024-09-14T11:34:39.069 INFO:tasks.workunit.client.0.smithi138.stderr:1: [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] mon.b 2024-09-14T11:34:39.069 INFO:tasks.workunit.client.0.smithi138.stderr:2: [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] mon.c 2024-09-14T11:34:39.069 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-14T11:34:39.069 INFO:tasks.workunit.client.0.smithi138.stderr: -124> 2024-09-14T11:34:38.524+0000 7f7926ffd640 10 monclient: _finish_auth 0 2024-09-14T11:34:39.069 INFO:tasks.workunit.client.0.smithi138.stderr: -123> 2024-09-14T11:34:38.524+0000 7f7926ffd640 10 monclient: _check_auth_tickets 2024-09-14T11:34:39.069 INFO:tasks.workunit.client.0.smithi138.stderr: -122> 2024-09-14T11:34:38.524+0000 7f7926ffd640 10 monclient: handle_config config(0 keys) 2024-09-14T11:34:39.069 INFO:tasks.workunit.client.0.smithi138.stderr: -121> 2024-09-14T11:34:38.524+0000 7f7926ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:34:39.069 INFO:tasks.workunit.client.0.smithi138.stderr: -120> 2024-09-14T11:34:38.524+0000 7f7926ffd640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-14T11:34:39.070 INFO:tasks.workunit.client.0.smithi138.stderr: -119> 2024-09-14T11:34:38.524+0000 7f7926ffd640 10 monclient: dump: 2024-09-14T11:34:39.070 INFO:tasks.workunit.client.0.smithi138.stderr:epoch 1 2024-09-14T11:34:39.070 INFO:tasks.workunit.client.0.smithi138.stderr:fsid 3f225f43-83a6-4aeb-b798-1f04bb49d597 2024-09-14T11:34:39.070 INFO:tasks.workunit.client.0.smithi138.stderr:last_changed 2024-09-14T11:07:09.252780+0000 2024-09-14T11:34:39.070 INFO:tasks.workunit.client.0.smithi138.stderr:created 2024-09-14T11:07:09.252780+0000 2024-09-14T11:34:39.070 INFO:tasks.workunit.client.0.smithi138.stderr:min_mon_release 19 (squid) 2024-09-14T11:34:39.070 INFO:tasks.workunit.client.0.smithi138.stderr:election_strategy: 1 2024-09-14T11:34:39.070 INFO:tasks.workunit.client.0.smithi138.stderr:0: [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] mon.a 2024-09-14T11:34:39.070 INFO:tasks.workunit.client.0.smithi138.stderr:1: [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] mon.b 2024-09-14T11:34:39.070 INFO:tasks.workunit.client.0.smithi138.stderr:2: [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] mon.c 2024-09-14T11:34:39.070 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-14T11:34:39.070 INFO:tasks.workunit.client.0.smithi138.stderr: -118> 2024-09-14T11:34:38.524+0000 7f7a57c5f9c0 5 monclient: authenticate success, global_id 6134 2024-09-14T11:34:39.070 INFO:tasks.workunit.client.0.smithi138.stderr: -117> 2024-09-14T11:34:38.524+0000 7f7a57c5f9c0 10 monclient: _renew_subs 2024-09-14T11:34:39.070 INFO:tasks.workunit.client.0.smithi138.stderr: -116> 2024-09-14T11:34:38.524+0000 7f7938ff9640 4 set_mon_vals no callback set 2024-09-14T11:34:39.070 INFO:tasks.workunit.client.0.smithi138.stderr: -115> 2024-09-14T11:34:38.524+0000 7f7a57c5f9c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.138:3301/0 2024-09-14T11:34:39.070 INFO:tasks.workunit.client.0.smithi138.stderr: -114> 2024-09-14T11:34:38.524+0000 7f7a57c5f9c0 10 monclient: _renew_subs 2024-09-14T11:34:39.071 INFO:tasks.workunit.client.0.smithi138.stderr: -113> 2024-09-14T11:34:38.524+0000 7f7a57c5f9c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.138:3301/0 2024-09-14T11:34:39.071 INFO:tasks.workunit.client.0.smithi138.stderr: -112> 2024-09-14T11:34:38.524+0000 7f7a57c5f9c0 1 librados: init done 2024-09-14T11:34:39.071 INFO:tasks.workunit.client.0.smithi138.stderr: -111> 2024-09-14T11:34:38.524+0000 7f7a57c5f9c0 5 asok(0x562010106d90) register_command cr dump hook 0x5620103d47c8 2024-09-14T11:34:39.071 INFO:tasks.workunit.client.0.smithi138.stderr: -110> 2024-09-14T11:34:38.524+0000 7f7a57c5f9c0 20 rados->read ofs=0 len=0 2024-09-14T11:34:39.071 INFO:tasks.workunit.client.0.smithi138.stderr: -109> 2024-09-14T11:34:38.524+0000 7f7926ffd640 4 mgrc handle_mgr_map Got map version 5 2024-09-14T11:34:39.071 INFO:tasks.workunit.client.0.smithi138.stderr: -108> 2024-09-14T11:34:38.524+0000 7f7926ffd640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.138:6832/3778043143,v1:172.21.15.138:6833/3778043143] 2024-09-14T11:34:39.071 INFO:tasks.workunit.client.0.smithi138.stderr: -107> 2024-09-14T11:34:38.524+0000 7f7926ffd640 4 mgrc reconnect Starting new session with [v2:172.21.15.138:6832/3778043143,v1:172.21.15.138:6833/3778043143] 2024-09-14T11:34:39.071 INFO:tasks.workunit.client.0.smithi138.stderr: -106> 2024-09-14T11:34:38.524+0000 7f7a54f64640 10 monclient: get_auth_request con 0x7f79200718a0 auth_method 0 2024-09-14T11:34:39.071 INFO:tasks.workunit.client.0.smithi138.stderr: -105> 2024-09-14T11:34:38.524+0000 7f7a55765640 10 monclient: get_auth_request con 0x562010400bc0 auth_method 0 2024-09-14T11:34:39.071 INFO:tasks.workunit.client.0.smithi138.stderr: -104> 2024-09-14T11:34:38.524+0000 7f7a57c5f9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:34:39.071 INFO:tasks.workunit.client.0.smithi138.stderr: -103> 2024-09-14T11:34:38.524+0000 7f7a57c5f9c0 20 realm 2024-09-14T11:34:39.071 INFO:tasks.workunit.client.0.smithi138.stderr: -102> 2024-09-14T11:34:38.524+0000 7f7a57c5f9c0 20 rados->read ofs=0 len=0 2024-09-14T11:34:39.071 INFO:tasks.workunit.client.0.smithi138.stderr: -101> 2024-09-14T11:34:38.524+0000 7f7a57c5f9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:34:39.072 INFO:tasks.workunit.client.0.smithi138.stderr: -100> 2024-09-14T11:34:38.524+0000 7f7a57c5f9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:34:39.072 INFO:tasks.workunit.client.0.smithi138.stderr: -99> 2024-09-14T11:34:38.524+0000 7f7a57c5f9c0 20 rados->read ofs=0 len=0 2024-09-14T11:34:39.072 INFO:tasks.workunit.client.0.smithi138.stderr: -98> 2024-09-14T11:34:38.528+0000 7f7a57c5f9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:34:39.072 INFO:tasks.workunit.client.0.smithi138.stderr: -97> 2024-09-14T11:34:38.528+0000 7f7a57c5f9c0 20 rados->read ofs=0 len=0 2024-09-14T11:34:39.072 INFO:tasks.workunit.client.0.smithi138.stderr: -96> 2024-09-14T11:34:38.528+0000 7f7a54f64640 10 monclient: get_auth_request con 0x562010404dd0 auth_method 0 2024-09-14T11:34:39.072 INFO:tasks.workunit.client.0.smithi138.stderr: -95> 2024-09-14T11:34:38.528+0000 7f7a57c5f9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:34:39.072 INFO:tasks.workunit.client.0.smithi138.stderr: -94> 2024-09-14T11:34:38.528+0000 7f7a57c5f9c0 20 rados->read ofs=0 len=0 2024-09-14T11:34:39.072 INFO:tasks.workunit.client.0.smithi138.stderr: -93> 2024-09-14T11:34:38.528+0000 7f7a55f66640 10 monclient: get_auth_request con 0x562010408630 auth_method 0 2024-09-14T11:34:39.072 INFO:tasks.workunit.client.0.smithi138.stderr: -92> 2024-09-14T11:34:38.528+0000 7f7a57c5f9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:34:39.072 INFO:tasks.workunit.client.0.smithi138.stderr: -91> 2024-09-14T11:34:38.528+0000 7f7a57c5f9c0 20 searching for the correct realm 2024-09-14T11:34:39.072 INFO:tasks.workunit.client.0.smithi138.stderr: -90> 2024-09-14T11:34:38.528+0000 7f7a55765640 10 monclient: get_auth_request con 0x56201040d3b0 auth_method 0 2024-09-14T11:34:39.072 INFO:tasks.workunit.client.0.smithi138.stderr: -89> 2024-09-14T11:34:38.528+0000 7f7a54f64640 10 monclient: get_auth_request con 0x7f7a48034060 auth_method 0 2024-09-14T11:34:39.072 INFO:tasks.workunit.client.0.smithi138.stderr: -88> 2024-09-14T11:34:38.532+0000 7f7a55f66640 10 monclient: get_auth_request con 0x7f7a50066090 auth_method 0 2024-09-14T11:34:39.072 INFO:tasks.workunit.client.0.smithi138.stderr: -87> 2024-09-14T11:34:38.532+0000 7f7a55f66640 0 -- 172.21.15.138:0/3375493065 >> [v2:172.21.15.154:6824/416768175,v1:172.21.15.154:6825/416768175] conn(0x7f7a50066090 msgr2=0x7f7a5006ca00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-14T11:34:39.072 INFO:tasks.workunit.client.0.smithi138.stderr: -86> 2024-09-14T11:34:38.736+0000 7f7a55f66640 10 monclient: get_auth_request con 0x7f7a50066090 auth_method 0 2024-09-14T11:34:39.073 INFO:tasks.workunit.client.0.smithi138.stderr: -85> 2024-09-14T11:34:38.740+0000 7f7a55765640 10 monclient: get_auth_request con 0x7f7a5006f280 auth_method 0 2024-09-14T11:34:39.073 INFO:tasks.workunit.client.0.smithi138.stderr: -84> 2024-09-14T11:34:38.748+0000 7f7a54f64640 10 monclient: get_auth_request con 0x7f7a50065090 auth_method 0 2024-09-14T11:34:39.073 INFO:tasks.workunit.client.0.smithi138.stderr: -83> 2024-09-14T11:34:38.748+0000 7f7a54f64640 0 -- 172.21.15.138:0/3375493065 >> [v2:172.21.15.138:6816/326481658,v1:172.21.15.138:6817/326481658] conn(0x7f7a50065090 msgr2=0x7f7a5006a0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:34:39.073 INFO:tasks.workunit.client.0.smithi138.stderr: -82> 2024-09-14T11:34:38.952+0000 7f7a54f64640 10 monclient: get_auth_request con 0x7f7a50065090 auth_method 0 2024-09-14T11:34:39.073 INFO:tasks.workunit.client.0.smithi138.stderr: -81> 2024-09-14T11:34:38.968+0000 7f7a57c5f9c0 20 RGWRados::pool_iterate: got zone_info.d9e72d30-c60b-4d0d-9267-fdc36392d5ad 2024-09-14T11:34:39.073 INFO:tasks.workunit.client.0.smithi138.stderr: -80> 2024-09-14T11:34:38.968+0000 7f7a57c5f9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:34:39.073 INFO:tasks.workunit.client.0.smithi138.stderr: -79> 2024-09-14T11:34:38.968+0000 7f7a57c5f9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:34:39.073 INFO:tasks.workunit.client.0.smithi138.stderr: -78> 2024-09-14T11:34:38.968+0000 7f7a57c5f9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:34:39.073 INFO:tasks.workunit.client.0.smithi138.stderr: -77> 2024-09-14T11:34:38.968+0000 7f7a57c5f9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:34:39.073 INFO:tasks.workunit.client.0.smithi138.stderr: -76> 2024-09-14T11:34:38.968+0000 7f7a57c5f9c0 20 RGWRados::pool_iterate: got zonegroup_info.65ab941b-da8c-4160-94fb-3672b069d44f 2024-09-14T11:34:39.073 INFO:tasks.workunit.client.0.smithi138.stderr: -75> 2024-09-14T11:34:38.968+0000 7f7a57c5f9c0 20 rados->read ofs=0 len=0 2024-09-14T11:34:39.073 INFO:tasks.workunit.client.0.smithi138.stderr: -74> 2024-09-14T11:34:38.968+0000 7f7a57c5f9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:34:39.073 INFO:tasks.workunit.client.0.smithi138.stderr: -73> 2024-09-14T11:34:38.968+0000 7f7a57c5f9c0 20 rados->read ofs=0 len=0 2024-09-14T11:34:39.074 INFO:tasks.workunit.client.0.smithi138.stderr: -72> 2024-09-14T11:34:38.968+0000 7f7a57c5f9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:34:39.074 INFO:tasks.workunit.client.0.smithi138.stderr: -71> 2024-09-14T11:34:38.968+0000 7f7a57c5f9c0 20 rados->read ofs=0 len=0 2024-09-14T11:34:39.074 INFO:tasks.workunit.client.0.smithi138.stderr: -70> 2024-09-14T11:34:38.968+0000 7f7a57c5f9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:34:39.074 INFO:tasks.workunit.client.0.smithi138.stderr: -69> 2024-09-14T11:34:38.968+0000 7f7a57c5f9c0 20 zone default found 2024-09-14T11:34:39.074 INFO:tasks.workunit.client.0.smithi138.stderr: -68> 2024-09-14T11:34:38.968+0000 7f7a57c5f9c0 4 Realm: () 2024-09-14T11:34:39.074 INFO:tasks.workunit.client.0.smithi138.stderr: -67> 2024-09-14T11:34:38.968+0000 7f7a57c5f9c0 4 ZoneGroup: default (65ab941b-da8c-4160-94fb-3672b069d44f) 2024-09-14T11:34:39.074 INFO:tasks.workunit.client.0.smithi138.stderr: -66> 2024-09-14T11:34:38.968+0000 7f7a57c5f9c0 4 Zone: default (d9e72d30-c60b-4d0d-9267-fdc36392d5ad) 2024-09-14T11:34:39.074 INFO:tasks.workunit.client.0.smithi138.stderr: -65> 2024-09-14T11:34:38.968+0000 7f7a57c5f9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:34:39.074 INFO:tasks.workunit.client.0.smithi138.stderr: -64> 2024-09-14T11:34:38.968+0000 7f7a57c5f9c0 20 zonegroup default 2024-09-14T11:34:39.074 INFO:tasks.workunit.client.0.smithi138.stderr: -63> 2024-09-14T11:34:38.968+0000 7f7a57c5f9c0 20 rados->read ofs=0 len=0 2024-09-14T11:34:39.074 INFO:tasks.workunit.client.0.smithi138.stderr: -62> 2024-09-14T11:34:38.968+0000 7f7a57c5f9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:34:39.074 INFO:tasks.workunit.client.0.smithi138.stderr: -61> 2024-09-14T11:34:38.968+0000 7f7a57c5f9c0 20 rados->read ofs=0 len=0 2024-09-14T11:34:39.074 INFO:tasks.workunit.client.0.smithi138.stderr: -60> 2024-09-14T11:34:38.972+0000 7f7a57c5f9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:34:39.074 INFO:tasks.workunit.client.0.smithi138.stderr: -59> 2024-09-14T11:34:38.972+0000 7f7a57c5f9c0 20 rados->read ofs=0 len=0 2024-09-14T11:34:39.075 INFO:tasks.workunit.client.0.smithi138.stderr: -58> 2024-09-14T11:34:38.972+0000 7f7a57c5f9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:34:39.075 INFO:tasks.workunit.client.0.smithi138.stderr: -57> 2024-09-14T11:34:38.972+0000 7f7a57c5f9c0 20 started sync module instance, tier type = 2024-09-14T11:34:39.075 INFO:tasks.workunit.client.0.smithi138.stderr: -56> 2024-09-14T11:34:38.972+0000 7f7a57c5f9c0 20 started zone id=d9e72d30-c60b-4d0d-9267-fdc36392d5ad (name=default) with tier type = 2024-09-14T11:34:39.075 INFO:tasks.workunit.client.0.smithi138.stderr: -55> 2024-09-14T11:34:38.996+0000 7f7a57c5f9c0 20 add_watcher() i=0 2024-09-14T11:34:39.075 INFO:tasks.workunit.client.0.smithi138.stderr: -54> 2024-09-14T11:34:38.996+0000 7f7a57c5f9c0 20 add_watcher() i=1 2024-09-14T11:34:39.075 INFO:tasks.workunit.client.0.smithi138.stderr: -53> 2024-09-14T11:34:38.996+0000 7f7a57c5f9c0 20 add_watcher() i=2 2024-09-14T11:34:39.075 INFO:tasks.workunit.client.0.smithi138.stderr: -52> 2024-09-14T11:34:38.996+0000 7f7a57c5f9c0 20 add_watcher() i=3 2024-09-14T11:34:39.075 INFO:tasks.workunit.client.0.smithi138.stderr: -51> 2024-09-14T11:34:38.996+0000 7f7a57c5f9c0 20 add_watcher() i=4 2024-09-14T11:34:39.075 INFO:tasks.workunit.client.0.smithi138.stderr: -50> 2024-09-14T11:34:38.996+0000 7f7a57c5f9c0 20 add_watcher() i=5 2024-09-14T11:34:39.075 INFO:tasks.workunit.client.0.smithi138.stderr: -49> 2024-09-14T11:34:38.996+0000 7f7a57c5f9c0 20 add_watcher() i=6 2024-09-14T11:34:39.075 INFO:tasks.workunit.client.0.smithi138.stderr: -48> 2024-09-14T11:34:39.000+0000 7f7a57c5f9c0 20 add_watcher() i=7 2024-09-14T11:34:39.075 INFO:tasks.workunit.client.0.smithi138.stderr: -47> 2024-09-14T11:34:39.000+0000 7f7a57c5f9c0 2 all 8 watchers are set, enabling cache 2024-09-14T11:34:39.075 INFO:tasks.workunit.client.0.smithi138.stderr: -46> 2024-09-14T11:34:39.004+0000 7f7a57c5f9c0 5 AuthRegistry(0x7fff1a3a2c00) adding auth protocol: cephx 2024-09-14T11:34:39.075 INFO:tasks.workunit.client.0.smithi138.stderr: -45> 2024-09-14T11:34:39.004+0000 7f7a57c5f9c0 5 AuthRegistry(0x7fff1a3a2c00) adding auth protocol: cephx 2024-09-14T11:34:39.075 INFO:tasks.workunit.client.0.smithi138.stderr: -44> 2024-09-14T11:34:39.004+0000 7f7a57c5f9c0 5 AuthRegistry(0x7fff1a3a2c00) adding auth protocol: cephx 2024-09-14T11:34:39.076 INFO:tasks.workunit.client.0.smithi138.stderr: -43> 2024-09-14T11:34:39.004+0000 7f7a57c5f9c0 5 AuthRegistry(0x7fff1a3a2c00) adding con mode: secure 2024-09-14T11:34:39.076 INFO:tasks.workunit.client.0.smithi138.stderr: -42> 2024-09-14T11:34:39.004+0000 7f7a57c5f9c0 5 AuthRegistry(0x7fff1a3a2c00) adding con mode: crc 2024-09-14T11:34:39.076 INFO:tasks.workunit.client.0.smithi138.stderr: -41> 2024-09-14T11:34:39.004+0000 7f7a57c5f9c0 5 AuthRegistry(0x7fff1a3a2c00) adding con mode: secure 2024-09-14T11:34:39.076 INFO:tasks.workunit.client.0.smithi138.stderr: -40> 2024-09-14T11:34:39.004+0000 7f7a57c5f9c0 5 AuthRegistry(0x7fff1a3a2c00) adding con mode: crc 2024-09-14T11:34:39.076 INFO:tasks.workunit.client.0.smithi138.stderr: -39> 2024-09-14T11:34:39.004+0000 7f7a57c5f9c0 5 AuthRegistry(0x7fff1a3a2c00) adding con mode: secure 2024-09-14T11:34:39.076 INFO:tasks.workunit.client.0.smithi138.stderr: -38> 2024-09-14T11:34:39.004+0000 7f7a57c5f9c0 5 AuthRegistry(0x7fff1a3a2c00) adding con mode: crc 2024-09-14T11:34:39.076 INFO:tasks.workunit.client.0.smithi138.stderr: -37> 2024-09-14T11:34:39.004+0000 7f7a57c5f9c0 5 AuthRegistry(0x7fff1a3a2c00) adding con mode: crc 2024-09-14T11:34:39.076 INFO:tasks.workunit.client.0.smithi138.stderr: -36> 2024-09-14T11:34:39.004+0000 7f7a57c5f9c0 5 AuthRegistry(0x7fff1a3a2c00) adding con mode: secure 2024-09-14T11:34:39.076 INFO:tasks.workunit.client.0.smithi138.stderr: -35> 2024-09-14T11:34:39.004+0000 7f790bfe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:34:39.076 INFO:tasks.workunit.client.0.smithi138.stderr: -34> 2024-09-14T11:34:39.004+0000 7f7a57c5f9c0 5 AuthRegistry(0x7fff1a3a2c00) adding con mode: crc 2024-09-14T11:34:39.076 INFO:tasks.workunit.client.0.smithi138.stderr: -33> 2024-09-14T11:34:39.004+0000 7f7a57c5f9c0 5 AuthRegistry(0x7fff1a3a2c00) adding con mode: secure 2024-09-14T11:34:39.076 INFO:tasks.workunit.client.0.smithi138.stderr: -32> 2024-09-14T11:34:39.004+0000 7f7a57c5f9c0 5 AuthRegistry(0x7fff1a3a2c00) adding con mode: crc 2024-09-14T11:34:39.076 INFO:tasks.workunit.client.0.smithi138.stderr: -31> 2024-09-14T11:34:39.004+0000 7f7a57c5f9c0 5 AuthRegistry(0x7fff1a3a2c00) adding con mode: secure 2024-09-14T11:34:39.076 INFO:tasks.workunit.client.0.smithi138.stderr: -30> 2024-09-14T11:34:39.004+0000 7f7a57c5f9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:34:39.076 INFO:tasks.workunit.client.0.smithi138.stderr: -29> 2024-09-14T11:34:39.004+0000 7f7a57c5f9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:34:39.077 INFO:tasks.workunit.client.0.smithi138.stderr: -28> 2024-09-14T11:34:39.004+0000 7f7a57c5f9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:34:39.077 INFO:tasks.workunit.client.0.smithi138.stderr: -27> 2024-09-14T11:34:39.004+0000 7f7a57c5f9c0 5 asok(0x562010106d90) register_command cache list hook 0x5620103d43d0 2024-09-14T11:34:39.077 INFO:tasks.workunit.client.0.smithi138.stderr: -26> 2024-09-14T11:34:39.004+0000 7f7a57c5f9c0 5 asok(0x562010106d90) register_command cache inspect hook 0x5620103d43d0 2024-09-14T11:34:39.077 INFO:tasks.workunit.client.0.smithi138.stderr: -25> 2024-09-14T11:34:39.004+0000 7f7a57c5f9c0 5 asok(0x562010106d90) register_command cache erase hook 0x5620103d43d0 2024-09-14T11:34:39.077 INFO:tasks.workunit.client.0.smithi138.stderr: -24> 2024-09-14T11:34:39.004+0000 7f7a57c5f9c0 5 asok(0x562010106d90) register_command cache zap hook 0x5620103d43d0 2024-09-14T11:34:39.077 INFO:tasks.workunit.client.0.smithi138.stderr: -23> 2024-09-14T11:34:39.004+0000 7f7a57c5f9c0 5 note: GC not initialized 2024-09-14T11:34:39.077 INFO:tasks.workunit.client.0.smithi138.stderr: -22> 2024-09-14T11:34:39.004+0000 7f790afe5640 20 reqs_thread_entry: start 2024-09-14T11:34:39.077 INFO:tasks.workunit.client.0.smithi138.stderr: -21> 2024-09-14T11:34:39.004+0000 7f7a57c5f9c0 5 asok(0x562010106d90) register_command sync trace show hook 0x7f7a48002530 2024-09-14T11:34:39.077 INFO:tasks.workunit.client.0.smithi138.stderr: -20> 2024-09-14T11:34:39.004+0000 7f7a57c5f9c0 5 asok(0x562010106d90) register_command sync trace history hook 0x7f7a48002530 2024-09-14T11:34:39.077 INFO:tasks.workunit.client.0.smithi138.stderr: -19> 2024-09-14T11:34:39.004+0000 7f7a57c5f9c0 5 asok(0x562010106d90) register_command sync trace active hook 0x7f7a48002530 2024-09-14T11:34:39.077 INFO:tasks.workunit.client.0.smithi138.stderr: -18> 2024-09-14T11:34:39.004+0000 7f7a57c5f9c0 5 asok(0x562010106d90) register_command sync trace active_short hook 0x7f7a48002530 2024-09-14T11:34:39.077 INFO:tasks.workunit.client.0.smithi138.stderr: -17> 2024-09-14T11:34:39.004+0000 7f7a57c5f9c0 20 init_complete bucket index max shards: 11 2024-09-14T11:34:39.077 INFO:tasks.workunit.client.0.smithi138.stderr: -16> 2024-09-14T11:34:39.004+0000 7f7a57c5f9c0 20 Filter name: none 2024-09-14T11:34:39.077 INFO:tasks.workunit.client.0.smithi138.stderr: -15> 2024-09-14T11:34:39.004+0000 7f7908fe1640 20 reqs_thread_entry: start 2024-09-14T11:34:39.078 INFO:tasks.workunit.client.0.smithi138.stderr: -14> 2024-09-14T11:34:39.004+0000 7f7a57c5f9c0 10 cache get: name=default.rgw.meta+root+abort-at-set-target-layout : miss 2024-09-14T11:34:39.078 INFO:tasks.workunit.client.0.smithi138.stderr: -13> 2024-09-14T11:34:39.004+0000 7f7a57c5f9c0 20 rados->read ofs=0 len=0 2024-09-14T11:34:39.078 INFO:tasks.workunit.client.0.smithi138.stderr: -12> 2024-09-14T11:34:39.008+0000 7f7a57c5f9c0 20 rados_obj.operate() r=0 bl.length=194 2024-09-14T11:34:39.078 INFO:tasks.workunit.client.0.smithi138.stderr: -11> 2024-09-14T11:34:39.008+0000 7f7a57c5f9c0 10 cache put: name=default.rgw.meta+root+abort-at-set-target-layout info.flags=0x11 2024-09-14T11:34:39.078 INFO:tasks.workunit.client.0.smithi138.stderr: -10> 2024-09-14T11:34:39.008+0000 7f7a57c5f9c0 10 adding default.rgw.meta+root+abort-at-set-target-layout to cache LRU end 2024-09-14T11:34:39.078 INFO:tasks.workunit.client.0.smithi138.stderr: -9> 2024-09-14T11:34:39.008+0000 7f7a57c5f9c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.24 : miss 2024-09-14T11:34:39.078 INFO:tasks.workunit.client.0.smithi138.stderr: -8> 2024-09-14T11:34:39.008+0000 7f7a57c5f9c0 20 rados->read ofs=0 len=0 2024-09-14T11:34:39.078 INFO:tasks.workunit.client.0.smithi138.stderr: -7> 2024-09-14T11:34:39.008+0000 7f7a57c5f9c0 20 rados_obj.operate() r=0 bl.length=416 2024-09-14T11:34:39.078 INFO:tasks.workunit.client.0.smithi138.stderr: -6> 2024-09-14T11:34:39.008+0000 7f7a57c5f9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.24 info.flags=0x17 2024-09-14T11:34:39.078 INFO:tasks.workunit.client.0.smithi138.stderr: -5> 2024-09-14T11:34:39.008+0000 7f7a57c5f9c0 10 adding default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.24 to cache LRU end 2024-09-14T11:34:39.078 INFO:tasks.workunit.client.0.smithi138.stderr: -4> 2024-09-14T11:34:39.008+0000 7f7a57c5f9c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:34:39.078 INFO:tasks.workunit.client.0.smithi138.stderr: -3> 2024-09-14T11:34:39.008+0000 7f7a57c5f9c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:34:39.078 INFO:tasks.workunit.client.0.smithi138.stderr: -2> 2024-09-14T11:34:39.008+0000 7f7a57c5f9c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.24 2024-09-14T11:34:39.078 INFO:tasks.workunit.client.0.smithi138.stderr: -1> 2024-09-14T11:34:39.016+0000 7f7a57c5f9c0 -1 ./src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f7a57c5f9c0 time 2024-09-14T11:34:39.019185+0000 2024-09-14T11:34:39.079 INFO:tasks.workunit.client.0.smithi138.stderr:./src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-14T11:34:39.079 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-14T11:34:39.079 INFO:tasks.workunit.client.0.smithi138.stderr: ceph version 19.3.0-4907-ga2782315 (a2782315255a3e7d5f6cdc9eb35785187ff6ddf8) squid (dev) 2024-09-14T11:34:39.079 INFO:tasks.workunit.client.0.smithi138.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x121) [0x7f7a5b5392eb] 2024-09-14T11:34:39.079 INFO:tasks.workunit.client.0.smithi138.stderr: 2: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7f7a5b53949f] 2024-09-14T11:34:39.079 INFO:tasks.workunit.client.0.smithi138.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x56200d1bfc01] 2024-09-14T11:34:39.079 INFO:tasks.workunit.client.0.smithi138.stderr: 4: radosgw-admin(+0x1422828) [0x56200dc1d828] 2024-09-14T11:34:39.079 INFO:tasks.workunit.client.0.smithi138.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x56200d1d4ecd] 2024-09-14T11:34:39.079 INFO:tasks.workunit.client.0.smithi138.stderr: 6: main() 2024-09-14T11:34:39.079 INFO:tasks.workunit.client.0.smithi138.stderr: 7: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7f7a5a39fd90] 2024-09-14T11:34:39.079 INFO:tasks.workunit.client.0.smithi138.stderr: 8: __libc_start_main() 2024-09-14T11:34:39.079 INFO:tasks.workunit.client.0.smithi138.stderr: 9: _start() 2024-09-14T11:34:39.079 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-14T11:34:39.079 INFO:tasks.workunit.client.0.smithi138.stderr: 0> 2024-09-14T11:34:39.020+0000 7f7a57c5f9c0 -1 *** Caught signal (Aborted) ** 2024-09-14T11:34:39.079 INFO:tasks.workunit.client.0.smithi138.stderr: in thread 7f7a57c5f9c0 thread_name:radosgw-admin 2024-09-14T11:34:39.080 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-14T11:34:39.080 INFO:tasks.workunit.client.0.smithi138.stderr: ceph version 19.3.0-4907-ga2782315 (a2782315255a3e7d5f6cdc9eb35785187ff6ddf8) squid (dev) 2024-09-14T11:34:39.080 INFO:tasks.workunit.client.0.smithi138.stderr: 1: /lib/x86_64-linux-gnu/libc.so.6(+0x42520) [0x7f7a5a3b8520] 2024-09-14T11:34:39.080 INFO:tasks.workunit.client.0.smithi138.stderr: 2: pthread_kill() 2024-09-14T11:34:39.080 INFO:tasks.workunit.client.0.smithi138.stderr: 3: raise() 2024-09-14T11:34:39.080 INFO:tasks.workunit.client.0.smithi138.stderr: 4: abort() 2024-09-14T11:34:39.080 INFO:tasks.workunit.client.0.smithi138.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x17b) [0x7f7a5b539345] 2024-09-14T11:34:39.080 INFO:tasks.workunit.client.0.smithi138.stderr: 6: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7f7a5b53949f] 2024-09-14T11:34:39.080 INFO:tasks.workunit.client.0.smithi138.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x56200d1bfc01] 2024-09-14T11:34:39.080 INFO:tasks.workunit.client.0.smithi138.stderr: 8: radosgw-admin(+0x1422828) [0x56200dc1d828] 2024-09-14T11:34:39.080 INFO:tasks.workunit.client.0.smithi138.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x56200d1d4ecd] 2024-09-14T11:34:39.080 INFO:tasks.workunit.client.0.smithi138.stderr: 10: main() 2024-09-14T11:34:39.080 INFO:tasks.workunit.client.0.smithi138.stderr: 11: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7f7a5a39fd90] 2024-09-14T11:34:39.080 INFO:tasks.workunit.client.0.smithi138.stderr: 12: __libc_start_main() 2024-09-14T11:34:39.080 INFO:tasks.workunit.client.0.smithi138.stderr: 13: _start() 2024-09-14T11:34:39.081 INFO:tasks.workunit.client.0.smithi138.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-14T11:34:39.081 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-14T11:34:39.081 INFO:tasks.workunit.client.0.smithi138.stderr:--- logging levels --- 2024-09-14T11:34:39.081 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 none 2024-09-14T11:34:39.081 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 1 lockdep 2024-09-14T11:34:39.081 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 1 context 2024-09-14T11:34:39.081 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 1 crush 2024-09-14T11:34:39.081 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 mds 2024-09-14T11:34:39.081 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 mds_balancer 2024-09-14T11:34:39.081 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 mds_locker 2024-09-14T11:34:39.081 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 mds_log 2024-09-14T11:34:39.081 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 mds_log_expire 2024-09-14T11:34:39.081 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 mds_migrator 2024-09-14T11:34:39.081 INFO:tasks.workunit.client.0.smithi138.stderr: 3/ 5 mds_quiesce 2024-09-14T11:34:39.081 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 1 buffer 2024-09-14T11:34:39.082 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 1 timer 2024-09-14T11:34:39.082 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 1 filer 2024-09-14T11:34:39.082 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 1 striper 2024-09-14T11:34:39.082 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 1 objecter 2024-09-14T11:34:39.082 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 rados 2024-09-14T11:34:39.082 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 rbd 2024-09-14T11:34:39.082 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 rbd_mirror 2024-09-14T11:34:39.082 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 rbd_replay 2024-09-14T11:34:39.082 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 rbd_pwl 2024-09-14T11:34:39.082 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 journaler 2024-09-14T11:34:39.082 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 objectcacher 2024-09-14T11:34:39.082 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 immutable_obj_cache 2024-09-14T11:34:39.082 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 client 2024-09-14T11:34:39.082 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 osd 2024-09-14T11:34:39.082 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 optracker 2024-09-14T11:34:39.082 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 objclass 2024-09-14T11:34:39.083 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 3 filestore 2024-09-14T11:34:39.083 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 3 journal 2024-09-14T11:34:39.083 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 0 ms 2024-09-14T11:34:39.083 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 mon 2024-09-14T11:34:39.083 INFO:tasks.workunit.client.0.smithi138.stderr: 0/10 monc 2024-09-14T11:34:39.083 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 paxos 2024-09-14T11:34:39.083 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 tp 2024-09-14T11:34:39.083 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 auth 2024-09-14T11:34:39.083 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 crypto 2024-09-14T11:34:39.083 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 1 finisher 2024-09-14T11:34:39.083 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 1 reserver 2024-09-14T11:34:39.083 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 heartbeatmap 2024-09-14T11:34:39.083 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 perfcounter 2024-09-14T11:34:39.083 INFO:tasks.workunit.client.0.smithi138.stderr: 20/20 rgw 2024-09-14T11:34:39.083 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 rgw_sync 2024-09-14T11:34:39.084 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 rgw_datacache 2024-09-14T11:34:39.084 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 rgw_access 2024-09-14T11:34:39.084 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 rgw_dbstore 2024-09-14T11:34:39.084 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 rgw_flight 2024-09-14T11:34:39.084 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 rgw_lifecycle 2024-09-14T11:34:39.084 INFO:tasks.workunit.client.0.smithi138.stderr: 20/20 rgw_notification 2024-09-14T11:34:39.084 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 javaclient 2024-09-14T11:34:39.084 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 asok 2024-09-14T11:34:39.084 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 1 throttle 2024-09-14T11:34:39.084 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 0 refs 2024-09-14T11:34:39.084 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 compressor 2024-09-14T11:34:39.084 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 bluestore 2024-09-14T11:34:39.084 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 bluefs 2024-09-14T11:34:39.084 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 3 bdev 2024-09-14T11:34:39.085 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 kstore 2024-09-14T11:34:39.085 INFO:tasks.workunit.client.0.smithi138.stderr: 4/ 5 rocksdb 2024-09-14T11:34:39.085 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 fuse 2024-09-14T11:34:39.085 INFO:tasks.workunit.client.0.smithi138.stderr: 2/ 5 mgr 2024-09-14T11:34:39.085 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 mgrc 2024-09-14T11:34:39.085 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 dpdk 2024-09-14T11:34:39.085 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 eventtrace 2024-09-14T11:34:39.085 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 prioritycache 2024-09-14T11:34:39.085 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 test 2024-09-14T11:34:39.085 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 cephfs_mirror 2024-09-14T11:34:39.085 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 cephsqlite 2024-09-14T11:34:39.085 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 crimson_interrupt 2024-09-14T11:34:39.085 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 seastore 2024-09-14T11:34:39.085 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 seastore_onode 2024-09-14T11:34:39.085 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 seastore_odata 2024-09-14T11:34:39.086 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 seastore_omap 2024-09-14T11:34:39.086 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 seastore_tm 2024-09-14T11:34:39.086 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 seastore_t 2024-09-14T11:34:39.086 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 seastore_cleaner 2024-09-14T11:34:39.086 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 seastore_epm 2024-09-14T11:34:39.086 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 seastore_lba 2024-09-14T11:34:39.086 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 seastore_fixedkv_tree 2024-09-14T11:34:39.086 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 seastore_cache 2024-09-14T11:34:39.086 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 seastore_journal 2024-09-14T11:34:39.086 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 seastore_device 2024-09-14T11:34:39.086 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 seastore_backref 2024-09-14T11:34:39.086 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 alienstore 2024-09-14T11:34:39.086 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 mclock 2024-09-14T11:34:39.086 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 cyanstore 2024-09-14T11:34:39.087 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 ceph_exporter 2024-09-14T11:34:39.087 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 memstore 2024-09-14T11:34:39.087 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 trace 2024-09-14T11:34:39.087 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 ceph_dedup 2024-09-14T11:34:39.087 INFO:tasks.workunit.client.0.smithi138.stderr: -2/-2 (syslog threshold) 2024-09-14T11:34:39.087 INFO:tasks.workunit.client.0.smithi138.stderr: 99/99 (stderr threshold) 2024-09-14T11:34:39.087 INFO:tasks.workunit.client.0.smithi138.stderr:--- pthread ID / name mapping for recent threads --- 2024-09-14T11:34:39.087 INFO:tasks.workunit.client.0.smithi138.stderr: 7f7908fe1640 / http_manager 2024-09-14T11:34:39.087 INFO:tasks.workunit.client.0.smithi138.stderr: 7f790afe5640 / http_manager 2024-09-14T11:34:39.087 INFO:tasks.workunit.client.0.smithi138.stderr: 7f790bfe7640 / rgw_dt_lg_renew 2024-09-14T11:34:39.087 INFO:tasks.workunit.client.0.smithi138.stderr: 7f7926ffd640 / ms_dispatch 2024-09-14T11:34:39.087 INFO:tasks.workunit.client.0.smithi138.stderr: 7f7938ff9640 / io_context_pool 2024-09-14T11:34:39.087 INFO:tasks.workunit.client.0.smithi138.stderr: 7f793affd640 / ms_dispatch 2024-09-14T11:34:39.087 INFO:tasks.workunit.client.0.smithi138.stderr: 7f7941e03640 / ms_dispatch 2024-09-14T11:34:39.087 INFO:tasks.workunit.client.0.smithi138.stderr: 7f7943606640 / io_context_pool 2024-09-14T11:34:39.088 INFO:tasks.workunit.client.0.smithi138.stderr: 7f7a54f64640 / msgr-worker-2 2024-09-14T11:34:39.088 INFO:tasks.workunit.client.0.smithi138.stderr: 7f7a55765640 / msgr-worker-1 2024-09-14T11:34:39.088 INFO:tasks.workunit.client.0.smithi138.stderr: 7f7a55f66640 / msgr-worker-0 2024-09-14T11:34:39.088 INFO:tasks.workunit.client.0.smithi138.stderr: 7f7a56767640 / io_context_pool 2024-09-14T11:34:39.088 INFO:tasks.workunit.client.0.smithi138.stderr: 7f7a57c5f9c0 / radosgw-admin 2024-09-14T11:34:39.088 INFO:tasks.workunit.client.0.smithi138.stderr: max_recent 500 2024-09-14T11:34:39.088 INFO:tasks.workunit.client.0.smithi138.stderr: max_new 1000 2024-09-14T11:34:39.088 INFO:tasks.workunit.client.0.smithi138.stderr: log_file /var/log/ceph/ceph-client.admin.90230.log 2024-09-14T11:34:39.088 INFO:tasks.workunit.client.0.smithi138.stderr:--- end dump of recent events --- 2024-09-14T11:34:39.088 INFO:tasks.workunit.client.0.smithi138.stderr:--- begin dump of recent events --- 2024-09-14T11:34:39.088 INFO:tasks.workunit.client.0.smithi138.stderr: -499> 2024-09-14T11:34:38.500+0000 7f7a55f66640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:34:39.088 INFO:tasks.workunit.client.0.smithi138.stderr: -498> 2024-09-14T11:34:38.500+0000 7f7a55f66640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:34:39.088 INFO:tasks.workunit.client.0.smithi138.stderr: -497> 2024-09-14T11:34:38.500+0000 7f7a55f66640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:34:39.088 INFO:tasks.workunit.client.0.smithi138.stderr: -496> 2024-09-14T11:34:38.500+0000 7f7a55765640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:34:39.088 INFO:tasks.workunit.client.0.smithi138.stderr: -495> 2024-09-14T11:34:38.500+0000 7f7a55765640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:34:39.089 INFO:tasks.workunit.client.0.smithi138.stderr: -494> 2024-09-14T11:34:38.500+0000 7f7a55765640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:34:39.089 INFO:tasks.workunit.client.0.smithi138.stderr: -493> 2024-09-14T11:34:38.500+0000 7f7a55f66640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:34:39.089 INFO:tasks.workunit.client.0.smithi138.stderr: -492> 2024-09-14T11:34:38.500+0000 7f7a55f66640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:34:39.089 INFO:tasks.workunit.client.0.smithi138.stderr: -491> 2024-09-14T11:34:38.500+0000 7f7a55f66640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:34:39.089 INFO:tasks.workunit.client.0.smithi138.stderr: -490> 2024-09-14T11:34:38.500+0000 7f7a54f64640 10 monclient(hunting): get_auth_request con 0x5620101c1bf0 auth_method 0 2024-09-14T11:34:39.089 INFO:tasks.workunit.client.0.smithi138.stderr: -489> 2024-09-14T11:34:38.500+0000 7f7a54f64640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:34:39.089 INFO:tasks.workunit.client.0.smithi138.stderr: -488> 2024-09-14T11:34:38.500+0000 7f7a54f64640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:34:39.089 INFO:tasks.workunit.client.0.smithi138.stderr: -487> 2024-09-14T11:34:38.500+0000 7f7a54f64640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:34:39.089 INFO:tasks.workunit.client.0.smithi138.stderr: -486> 2024-09-14T11:34:38.500+0000 7f7a55f66640 10 monclient(hunting): handle_auth_done global_id 6122 payload 274 2024-09-14T11:34:39.089 INFO:tasks.workunit.client.0.smithi138.stderr: -485> 2024-09-14T11:34:38.500+0000 7f7a55f66640 10 monclient: _finish_hunting 0 2024-09-14T11:34:39.089 INFO:tasks.workunit.client.0.smithi138.stderr: -484> 2024-09-14T11:34:38.500+0000 7f7a55f66640 1 monclient: found mon.noname-c 2024-09-14T11:34:39.090 INFO:tasks.workunit.client.0.smithi138.stderr: -483> 2024-09-14T11:34:38.500+0000 7f7a55f66640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.138:3301/0 2024-09-14T11:34:39.090 INFO:tasks.workunit.client.0.smithi138.stderr: -482> 2024-09-14T11:34:38.500+0000 7f7943606640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:34:39.090 INFO:tasks.workunit.client.0.smithi138.stderr: -481> 2024-09-14T11:34:38.500+0000 7f7943606640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-14T11:34:39.090 INFO:tasks.workunit.client.0.smithi138.stderr: -480> 2024-09-14T11:34:38.500+0000 7f7943606640 10 monclient: dump: 2024-09-14T11:34:39.090 INFO:tasks.workunit.client.0.smithi138.stderr:epoch 1 2024-09-14T11:34:39.090 INFO:tasks.workunit.client.0.smithi138.stderr:fsid 3f225f43-83a6-4aeb-b798-1f04bb49d597 2024-09-14T11:34:39.090 INFO:tasks.workunit.client.0.smithi138.stderr:last_changed 2024-09-14T11:07:09.252780+0000 2024-09-14T11:34:39.090 INFO:tasks.workunit.client.0.smithi138.stderr:created 2024-09-14T11:07:09.252780+0000 2024-09-14T11:34:39.090 INFO:tasks.workunit.client.0.smithi138.stderr:min_mon_release 19 (squid) 2024-09-14T11:34:39.090 INFO:tasks.workunit.client.0.smithi138.stderr:election_strategy: 1 2024-09-14T11:34:39.090 INFO:tasks.workunit.client.0.smithi138.stderr:0: [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] mon.a 2024-09-14T11:34:39.090 INFO:tasks.workunit.client.0.smithi138.stderr:1: [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] mon.b 2024-09-14T11:34:39.090 INFO:tasks.workunit.client.0.smithi138.stderr:2: [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] mon.c 2024-09-14T11:34:39.091 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-14T11:34:39.091 INFO:tasks.workunit.client.0.smithi138.stderr: -479> 2024-09-14T11:34:38.500+0000 7f7943606640 10 monclient: _finish_auth 0 2024-09-14T11:34:39.091 INFO:tasks.workunit.client.0.smithi138.stderr: -478> 2024-09-14T11:34:38.500+0000 7f7943606640 10 monclient: _check_auth_tickets 2024-09-14T11:34:39.091 INFO:tasks.workunit.client.0.smithi138.stderr: -477> 2024-09-14T11:34:38.500+0000 7f7943606640 10 monclient: handle_config config(0 keys) 2024-09-14T11:34:39.091 INFO:tasks.workunit.client.0.smithi138.stderr: -476> 2024-09-14T11:34:38.500+0000 7f7943606640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:34:39.091 INFO:tasks.workunit.client.0.smithi138.stderr: -475> 2024-09-14T11:34:38.500+0000 7f7943606640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-14T11:34:39.091 INFO:tasks.workunit.client.0.smithi138.stderr: -474> 2024-09-14T11:34:38.500+0000 7f7943606640 10 monclient: dump: 2024-09-14T11:34:39.091 INFO:tasks.workunit.client.0.smithi138.stderr:epoch 1 2024-09-14T11:34:39.091 INFO:tasks.workunit.client.0.smithi138.stderr:fsid 3f225f43-83a6-4aeb-b798-1f04bb49d597 2024-09-14T11:34:39.091 INFO:tasks.workunit.client.0.smithi138.stderr:last_changed 2024-09-14T11:07:09.252780+0000 2024-09-14T11:34:39.091 INFO:tasks.workunit.client.0.smithi138.stderr:created 2024-09-14T11:07:09.252780+0000 2024-09-14T11:34:39.091 INFO:tasks.workunit.client.0.smithi138.stderr:min_mon_release 19 (squid) 2024-09-14T11:34:39.091 INFO:tasks.workunit.client.0.smithi138.stderr:election_strategy: 1 2024-09-14T11:34:39.091 INFO:tasks.workunit.client.0.smithi138.stderr:0: [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] mon.a 2024-09-14T11:34:39.091 INFO:tasks.workunit.client.0.smithi138.stderr:1: [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] mon.b 2024-09-14T11:34:39.092 INFO:tasks.workunit.client.0.smithi138.stderr:2: [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] mon.c 2024-09-14T11:34:39.092 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-14T11:34:39.092 INFO:tasks.workunit.client.0.smithi138.stderr: -473> 2024-09-14T11:34:38.500+0000 7f7a57c5f9c0 5 monclient: authenticate success, global_id 6122 2024-09-14T11:34:39.092 INFO:tasks.workunit.client.0.smithi138.stderr: -472> 2024-09-14T11:34:38.500+0000 7f7a57c5f9c0 10 monclient: get_monmap_and_config success 2024-09-14T11:34:39.092 INFO:tasks.workunit.client.0.smithi138.stderr: -471> 2024-09-14T11:34:38.500+0000 7f7a57c5f9c0 4 set_mon_vals no callback set 2024-09-14T11:34:39.092 INFO:tasks.workunit.client.0.smithi138.stderr: -470> 2024-09-14T11:34:38.504+0000 7f7a57c5f9c0 10 monclient: shutdown 2024-09-14T11:34:39.092 INFO:tasks.workunit.client.0.smithi138.stderr: -469> 2024-09-14T11:34:38.504+0000 7f7a57c5f9c0 5 asok(0x562010106d90) unregister_commands rotate-key 2024-09-14T11:34:39.092 INFO:tasks.workunit.client.0.smithi138.stderr: -468> 2024-09-14T11:34:38.504+0000 7f7a57c5f9c0 10 monclient: build_initial_monmap 2024-09-14T11:34:39.092 INFO:tasks.workunit.client.0.smithi138.stderr: -467> 2024-09-14T11:34:38.504+0000 7f7a57c5f9c0 1 build_initial for_mkfs: 0 2024-09-14T11:34:39.092 INFO:tasks.workunit.client.0.smithi138.stderr: -466> 2024-09-14T11:34:38.504+0000 7f7a57c5f9c0 10 monclient: monmap: 2024-09-14T11:34:39.092 INFO:tasks.workunit.client.0.smithi138.stderr:epoch 0 2024-09-14T11:34:39.092 INFO:tasks.workunit.client.0.smithi138.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-14T11:34:39.092 INFO:tasks.workunit.client.0.smithi138.stderr:last_changed 0.000000 2024-09-14T11:34:39.092 INFO:tasks.workunit.client.0.smithi138.stderr:created 0.000000 2024-09-14T11:34:39.093 INFO:tasks.workunit.client.0.smithi138.stderr:min_mon_release 0 (unknown) 2024-09-14T11:34:39.093 INFO:tasks.workunit.client.0.smithi138.stderr:election_strategy: 1 2024-09-14T11:34:39.093 INFO:tasks.workunit.client.0.smithi138.stderr:0: [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] mon.noname-a 2024-09-14T11:34:39.093 INFO:tasks.workunit.client.0.smithi138.stderr:1: [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] mon.noname-b 2024-09-14T11:34:39.093 INFO:tasks.workunit.client.0.smithi138.stderr:2: [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] mon.noname-c 2024-09-14T11:34:39.093 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-14T11:34:39.093 INFO:tasks.workunit.client.0.smithi138.stderr: -465> 2024-09-14T11:34:38.504+0000 7f7a57c5f9c0 5 AuthRegistry(0x562010342fc0) adding auth protocol: cephx 2024-09-14T11:34:39.093 INFO:tasks.workunit.client.0.smithi138.stderr: -464> 2024-09-14T11:34:38.504+0000 7f7a57c5f9c0 5 AuthRegistry(0x562010342fc0) adding auth protocol: cephx 2024-09-14T11:34:39.093 INFO:tasks.workunit.client.0.smithi138.stderr: -463> 2024-09-14T11:34:38.504+0000 7f7a57c5f9c0 5 AuthRegistry(0x562010342fc0) adding auth protocol: cephx 2024-09-14T11:34:39.093 INFO:tasks.workunit.client.0.smithi138.stderr: -462> 2024-09-14T11:34:38.504+0000 7f7a57c5f9c0 5 AuthRegistry(0x562010342fc0) adding con mode: secure 2024-09-14T11:34:39.093 INFO:tasks.workunit.client.0.smithi138.stderr: -461> 2024-09-14T11:34:38.504+0000 7f7a57c5f9c0 5 AuthRegistry(0x562010342fc0) adding con mode: crc 2024-09-14T11:34:39.093 INFO:tasks.workunit.client.0.smithi138.stderr: -460> 2024-09-14T11:34:38.504+0000 7f7a57c5f9c0 5 AuthRegistry(0x562010342fc0) adding con mode: secure 2024-09-14T11:34:39.093 INFO:tasks.workunit.client.0.smithi138.stderr: -459> 2024-09-14T11:34:38.504+0000 7f7a57c5f9c0 5 AuthRegistry(0x562010342fc0) adding con mode: crc 2024-09-14T11:34:39.093 INFO:tasks.workunit.client.0.smithi138.stderr: -458> 2024-09-14T11:34:38.504+0000 7f7a57c5f9c0 5 AuthRegistry(0x562010342fc0) adding con mode: secure 2024-09-14T11:34:39.093 INFO:tasks.workunit.client.0.smithi138.stderr: -457> 2024-09-14T11:34:38.504+0000 7f7a57c5f9c0 5 AuthRegistry(0x562010342fc0) adding con mode: crc 2024-09-14T11:34:39.093 INFO:tasks.workunit.client.0.smithi138.stderr: -456> 2024-09-14T11:34:38.504+0000 7f7a57c5f9c0 5 AuthRegistry(0x562010342fc0) adding con mode: crc 2024-09-14T11:34:39.094 INFO:tasks.workunit.client.0.smithi138.stderr: -455> 2024-09-14T11:34:38.504+0000 7f7a57c5f9c0 5 AuthRegistry(0x562010342fc0) adding con mode: secure 2024-09-14T11:34:39.094 INFO:tasks.workunit.client.0.smithi138.stderr: -454> 2024-09-14T11:34:38.504+0000 7f7a57c5f9c0 5 AuthRegistry(0x562010342fc0) adding con mode: crc 2024-09-14T11:34:39.094 INFO:tasks.workunit.client.0.smithi138.stderr: -453> 2024-09-14T11:34:38.504+0000 7f7a57c5f9c0 5 AuthRegistry(0x562010342fc0) adding con mode: secure 2024-09-14T11:34:39.094 INFO:tasks.workunit.client.0.smithi138.stderr: -452> 2024-09-14T11:34:38.504+0000 7f7a57c5f9c0 5 AuthRegistry(0x562010342fc0) adding con mode: crc 2024-09-14T11:34:39.094 INFO:tasks.workunit.client.0.smithi138.stderr: -451> 2024-09-14T11:34:38.504+0000 7f7a57c5f9c0 5 AuthRegistry(0x562010342fc0) adding con mode: secure 2024-09-14T11:34:39.094 INFO:tasks.workunit.client.0.smithi138.stderr: -450> 2024-09-14T11:34:38.504+0000 7f7a57c5f9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:34:39.094 INFO:tasks.workunit.client.0.smithi138.stderr: -449> 2024-09-14T11:34:38.504+0000 7f7a57c5f9c0 1 librados: starting msgr at 2024-09-14T11:34:39.094 INFO:tasks.workunit.client.0.smithi138.stderr: -448> 2024-09-14T11:34:38.504+0000 7f7a57c5f9c0 1 librados: starting objecter 2024-09-14T11:34:39.094 INFO:tasks.workunit.client.0.smithi138.stderr: -447> 2024-09-14T11:34:38.504+0000 7f7a57c5f9c0 5 asok(0x562010106d90) register_command objecter_requests hook 0x562010344200 2024-09-14T11:34:39.094 INFO:tasks.workunit.client.0.smithi138.stderr: -446> 2024-09-14T11:34:38.504+0000 7f7a57c5f9c0 1 librados: setting wanted keys 2024-09-14T11:34:39.094 INFO:tasks.workunit.client.0.smithi138.stderr: -445> 2024-09-14T11:34:38.504+0000 7f7a57c5f9c0 1 librados: calling monclient init 2024-09-14T11:34:39.094 INFO:tasks.workunit.client.0.smithi138.stderr: -444> 2024-09-14T11:34:38.504+0000 7f7a57c5f9c0 10 monclient: init 2024-09-14T11:34:39.094 INFO:tasks.workunit.client.0.smithi138.stderr: -443> 2024-09-14T11:34:38.504+0000 7f7a57c5f9c0 5 AuthRegistry(0x562010314110) adding auth protocol: cephx 2024-09-14T11:34:39.094 INFO:tasks.workunit.client.0.smithi138.stderr: -442> 2024-09-14T11:34:38.504+0000 7f7a57c5f9c0 5 AuthRegistry(0x562010314110) adding auth protocol: cephx 2024-09-14T11:34:39.095 INFO:tasks.workunit.client.0.smithi138.stderr: -441> 2024-09-14T11:34:38.504+0000 7f7a57c5f9c0 5 AuthRegistry(0x562010314110) adding auth protocol: cephx 2024-09-14T11:34:39.095 INFO:tasks.workunit.client.0.smithi138.stderr: -440> 2024-09-14T11:34:38.504+0000 7f7a57c5f9c0 5 AuthRegistry(0x562010314110) adding con mode: secure 2024-09-14T11:34:39.095 INFO:tasks.workunit.client.0.smithi138.stderr: -439> 2024-09-14T11:34:38.504+0000 7f7a57c5f9c0 5 AuthRegistry(0x562010314110) adding con mode: crc 2024-09-14T11:34:39.095 INFO:tasks.workunit.client.0.smithi138.stderr: -438> 2024-09-14T11:34:38.504+0000 7f7a57c5f9c0 5 AuthRegistry(0x562010314110) adding con mode: secure 2024-09-14T11:34:39.095 INFO:tasks.workunit.client.0.smithi138.stderr: -437> 2024-09-14T11:34:38.504+0000 7f7a57c5f9c0 5 AuthRegistry(0x562010314110) adding con mode: crc 2024-09-14T11:34:39.095 INFO:tasks.workunit.client.0.smithi138.stderr: -436> 2024-09-14T11:34:38.504+0000 7f7a57c5f9c0 5 AuthRegistry(0x562010314110) adding con mode: secure 2024-09-14T11:34:39.095 INFO:tasks.workunit.client.0.smithi138.stderr: -435> 2024-09-14T11:34:38.504+0000 7f7a57c5f9c0 5 AuthRegistry(0x562010314110) adding con mode: crc 2024-09-14T11:34:39.095 INFO:tasks.workunit.client.0.smithi138.stderr: -434> 2024-09-14T11:34:38.504+0000 7f7a57c5f9c0 5 AuthRegistry(0x562010314110) adding con mode: crc 2024-09-14T11:34:39.095 INFO:tasks.workunit.client.0.smithi138.stderr: -433> 2024-09-14T11:34:38.504+0000 7f7a57c5f9c0 5 AuthRegistry(0x562010314110) adding con mode: secure 2024-09-14T11:34:39.095 INFO:tasks.workunit.client.0.smithi138.stderr: -432> 2024-09-14T11:34:38.504+0000 7f7a57c5f9c0 5 AuthRegistry(0x562010314110) adding con mode: crc 2024-09-14T11:34:39.095 INFO:tasks.workunit.client.0.smithi138.stderr: -431> 2024-09-14T11:34:38.504+0000 7f7a57c5f9c0 5 AuthRegistry(0x562010314110) adding con mode: secure 2024-09-14T11:34:39.095 INFO:tasks.workunit.client.0.smithi138.stderr: -430> 2024-09-14T11:34:38.504+0000 7f7a57c5f9c0 5 AuthRegistry(0x562010314110) adding con mode: crc 2024-09-14T11:34:39.095 INFO:tasks.workunit.client.0.smithi138.stderr: -429> 2024-09-14T11:34:38.504+0000 7f7a57c5f9c0 5 AuthRegistry(0x562010314110) adding con mode: secure 2024-09-14T11:34:39.096 INFO:tasks.workunit.client.0.smithi138.stderr: -428> 2024-09-14T11:34:38.504+0000 7f7a57c5f9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:34:39.096 INFO:tasks.workunit.client.0.smithi138.stderr: -427> 2024-09-14T11:34:38.504+0000 7f7a57c5f9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:34:39.096 INFO:tasks.workunit.client.0.smithi138.stderr: -426> 2024-09-14T11:34:38.504+0000 7f7a57c5f9c0 5 asok(0x562010106d90) register_command rotate-key hook 0x562010314258 2024-09-14T11:34:39.096 INFO:tasks.workunit.client.0.smithi138.stderr: -425> 2024-09-14T11:34:38.504+0000 7f7a57c5f9c0 10 monclient: _reopen_session rank -1 2024-09-14T11:34:39.096 INFO:tasks.workunit.client.0.smithi138.stderr: -424> 2024-09-14T11:34:38.504+0000 7f7a57c5f9c0 10 monclient: _add_conns ranks=[0,2,1] 2024-09-14T11:34:39.096 INFO:tasks.workunit.client.0.smithi138.stderr: -423> 2024-09-14T11:34:38.504+0000 7f7a57c5f9c0 10 monclient(hunting): picked mon.noname-a con 0x56201019f740 addr [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] 2024-09-14T11:34:39.096 INFO:tasks.workunit.client.0.smithi138.stderr: -422> 2024-09-14T11:34:38.504+0000 7f7a57c5f9c0 10 monclient(hunting): picked mon.noname-c con 0x5620101c1bf0 addr [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] 2024-09-14T11:34:39.096 INFO:tasks.workunit.client.0.smithi138.stderr: -421> 2024-09-14T11:34:38.504+0000 7f7a57c5f9c0 10 monclient(hunting): picked mon.noname-b con 0x562010259ad0 addr [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] 2024-09-14T11:34:39.096 INFO:tasks.workunit.client.0.smithi138.stderr: -420> 2024-09-14T11:34:38.504+0000 7f7a57c5f9c0 10 monclient(hunting): start opening mon connection 2024-09-14T11:34:39.096 INFO:tasks.workunit.client.0.smithi138.stderr: -419> 2024-09-14T11:34:38.504+0000 7f7a57c5f9c0 10 monclient(hunting): start opening mon connection 2024-09-14T11:34:39.096 INFO:tasks.workunit.client.0.smithi138.stderr: -418> 2024-09-14T11:34:38.504+0000 7f7a57c5f9c0 10 monclient(hunting): start opening mon connection 2024-09-14T11:34:39.096 INFO:tasks.workunit.client.0.smithi138.stderr: -417> 2024-09-14T11:34:38.504+0000 7f7a57c5f9c0 10 monclient(hunting): _renew_subs 2024-09-14T11:34:39.096 INFO:tasks.workunit.client.0.smithi138.stderr: -416> 2024-09-14T11:34:38.504+0000 7f7a57c5f9c0 10 monclient(hunting): authenticate will time out at 2614.465625s 2024-09-14T11:34:39.096 INFO:tasks.workunit.client.0.smithi138.stderr: -415> 2024-09-14T11:34:38.504+0000 7f7a54f64640 10 monclient(hunting): get_auth_request con 0x5620101c1bf0 auth_method 0 2024-09-14T11:34:39.097 INFO:tasks.workunit.client.0.smithi138.stderr: -414> 2024-09-14T11:34:38.504+0000 7f7a54f64640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:34:39.097 INFO:tasks.workunit.client.0.smithi138.stderr: -413> 2024-09-14T11:34:38.504+0000 7f7a54f64640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:34:39.097 INFO:tasks.workunit.client.0.smithi138.stderr: -412> 2024-09-14T11:34:38.504+0000 7f7a54f64640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:34:39.097 INFO:tasks.workunit.client.0.smithi138.stderr: -411> 2024-09-14T11:34:38.504+0000 7f7a55765640 10 monclient(hunting): get_auth_request con 0x56201019f740 auth_method 0 2024-09-14T11:34:39.097 INFO:tasks.workunit.client.0.smithi138.stderr: -410> 2024-09-14T11:34:38.504+0000 7f7a55765640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:34:39.097 INFO:tasks.workunit.client.0.smithi138.stderr: -409> 2024-09-14T11:34:38.504+0000 7f7a55765640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:34:39.097 INFO:tasks.workunit.client.0.smithi138.stderr: -408> 2024-09-14T11:34:38.504+0000 7f7a55765640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:34:39.097 INFO:tasks.workunit.client.0.smithi138.stderr: -407> 2024-09-14T11:34:38.504+0000 7f7a55765640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:34:39.097 INFO:tasks.workunit.client.0.smithi138.stderr: -406> 2024-09-14T11:34:38.504+0000 7f7a55765640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:34:39.097 INFO:tasks.workunit.client.0.smithi138.stderr: -405> 2024-09-14T11:34:38.504+0000 7f7a55765640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:34:39.097 INFO:tasks.workunit.client.0.smithi138.stderr: -404> 2024-09-14T11:34:38.504+0000 7f7a54f64640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:34:39.097 INFO:tasks.workunit.client.0.smithi138.stderr: -403> 2024-09-14T11:34:38.504+0000 7f7a54f64640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:34:39.097 INFO:tasks.workunit.client.0.smithi138.stderr: -402> 2024-09-14T11:34:38.504+0000 7f7a54f64640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:34:39.097 INFO:tasks.workunit.client.0.smithi138.stderr: -401> 2024-09-14T11:34:38.504+0000 7f7a55f66640 10 monclient(hunting): get_auth_request con 0x562010259ad0 auth_method 0 2024-09-14T11:34:39.098 INFO:tasks.workunit.client.0.smithi138.stderr: -400> 2024-09-14T11:34:38.504+0000 7f7a55f66640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:34:39.098 INFO:tasks.workunit.client.0.smithi138.stderr: -399> 2024-09-14T11:34:38.504+0000 7f7a55f66640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:34:39.098 INFO:tasks.workunit.client.0.smithi138.stderr: -398> 2024-09-14T11:34:38.504+0000 7f7a55f66640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:34:39.098 INFO:tasks.workunit.client.0.smithi138.stderr: -397> 2024-09-14T11:34:38.504+0000 7f7a54f64640 10 monclient(hunting): handle_auth_done global_id 6125 payload 824 2024-09-14T11:34:39.098 INFO:tasks.workunit.client.0.smithi138.stderr: -396> 2024-09-14T11:34:38.504+0000 7f7a54f64640 10 monclient: _finish_hunting 0 2024-09-14T11:34:39.098 INFO:tasks.workunit.client.0.smithi138.stderr: -395> 2024-09-14T11:34:38.504+0000 7f7a54f64640 1 monclient: found mon.noname-c 2024-09-14T11:34:39.098 INFO:tasks.workunit.client.0.smithi138.stderr: -394> 2024-09-14T11:34:38.504+0000 7f7a54f64640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.138:3301/0 2024-09-14T11:34:39.098 INFO:tasks.workunit.client.0.smithi138.stderr: -393> 2024-09-14T11:34:38.504+0000 7f7941e03640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:34:39.098 INFO:tasks.workunit.client.0.smithi138.stderr: -392> 2024-09-14T11:34:38.504+0000 7f7941e03640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-14T11:34:39.098 INFO:tasks.workunit.client.0.smithi138.stderr: -391> 2024-09-14T11:34:38.504+0000 7f7941e03640 10 monclient: dump: 2024-09-14T11:34:39.098 INFO:tasks.workunit.client.0.smithi138.stderr:epoch 1 2024-09-14T11:34:39.098 INFO:tasks.workunit.client.0.smithi138.stderr:fsid 3f225f43-83a6-4aeb-b798-1f04bb49d597 2024-09-14T11:34:39.098 INFO:tasks.workunit.client.0.smithi138.stderr:last_changed 2024-09-14T11:07:09.252780+0000 2024-09-14T11:34:39.099 INFO:tasks.workunit.client.0.smithi138.stderr:created 2024-09-14T11:07:09.252780+0000 2024-09-14T11:34:39.099 INFO:tasks.workunit.client.0.smithi138.stderr:min_mon_release 19 (squid) 2024-09-14T11:34:39.099 INFO:tasks.workunit.client.0.smithi138.stderr:election_strategy: 1 2024-09-14T11:34:39.099 INFO:tasks.workunit.client.0.smithi138.stderr:0: [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] mon.a 2024-09-14T11:34:39.099 INFO:tasks.workunit.client.0.smithi138.stderr:1: [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] mon.b 2024-09-14T11:34:39.099 INFO:tasks.workunit.client.0.smithi138.stderr:2: [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] mon.c 2024-09-14T11:34:39.099 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-14T11:34:39.099 INFO:tasks.workunit.client.0.smithi138.stderr: -390> 2024-09-14T11:34:38.504+0000 7f7941e03640 10 monclient: _finish_auth 0 2024-09-14T11:34:39.099 INFO:tasks.workunit.client.0.smithi138.stderr: -389> 2024-09-14T11:34:38.504+0000 7f7941e03640 10 monclient: _check_auth_tickets 2024-09-14T11:34:39.099 INFO:tasks.workunit.client.0.smithi138.stderr: -388> 2024-09-14T11:34:38.504+0000 7f7941e03640 10 monclient: handle_config config(0 keys) 2024-09-14T11:34:39.099 INFO:tasks.workunit.client.0.smithi138.stderr: -387> 2024-09-14T11:34:38.504+0000 7f7941e03640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:34:39.099 INFO:tasks.workunit.client.0.smithi138.stderr: -386> 2024-09-14T11:34:38.504+0000 7f7941e03640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-14T11:34:39.099 INFO:tasks.workunit.client.0.smithi138.stderr: -385> 2024-09-14T11:34:38.504+0000 7f7941e03640 10 monclient: dump: 2024-09-14T11:34:39.099 INFO:tasks.workunit.client.0.smithi138.stderr:epoch 1 2024-09-14T11:34:39.100 INFO:tasks.workunit.client.0.smithi138.stderr:fsid 3f225f43-83a6-4aeb-b798-1f04bb49d597 2024-09-14T11:34:39.100 INFO:tasks.workunit.client.0.smithi138.stderr:last_changed 2024-09-14T11:07:09.252780+0000 2024-09-14T11:34:39.100 INFO:tasks.workunit.client.0.smithi138.stderr:created 2024-09-14T11:07:09.252780+0000 2024-09-14T11:34:39.100 INFO:tasks.workunit.client.0.smithi138.stderr:min_mon_release 19 (squid) 2024-09-14T11:34:39.100 INFO:tasks.workunit.client.0.smithi138.stderr:election_strategy: 1 2024-09-14T11:34:39.100 INFO:tasks.workunit.client.0.smithi138.stderr:0: [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] mon.a 2024-09-14T11:34:39.100 INFO:tasks.workunit.client.0.smithi138.stderr:1: [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] mon.b 2024-09-14T11:34:39.100 INFO:tasks.workunit.client.0.smithi138.stderr:2: [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] mon.c 2024-09-14T11:34:39.100 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-14T11:34:39.100 INFO:tasks.workunit.client.0.smithi138.stderr: -384> 2024-09-14T11:34:38.504+0000 7f7943606640 4 set_mon_vals no callback set 2024-09-14T11:34:39.100 INFO:tasks.workunit.client.0.smithi138.stderr: -383> 2024-09-14T11:34:38.504+0000 7f7a57c5f9c0 5 monclient: authenticate success, global_id 6125 2024-09-14T11:34:39.100 INFO:tasks.workunit.client.0.smithi138.stderr: -382> 2024-09-14T11:34:38.504+0000 7f7a57c5f9c0 10 monclient: _renew_subs 2024-09-14T11:34:39.100 INFO:tasks.workunit.client.0.smithi138.stderr: -381> 2024-09-14T11:34:38.504+0000 7f7a57c5f9c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.138:3301/0 2024-09-14T11:34:39.100 INFO:tasks.workunit.client.0.smithi138.stderr: -380> 2024-09-14T11:34:38.504+0000 7f7a57c5f9c0 10 monclient: _renew_subs 2024-09-14T11:34:39.101 INFO:tasks.workunit.client.0.smithi138.stderr: -379> 2024-09-14T11:34:38.504+0000 7f7a57c5f9c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.138:3301/0 2024-09-14T11:34:39.101 INFO:tasks.workunit.client.0.smithi138.stderr: -378> 2024-09-14T11:34:38.504+0000 7f7a57c5f9c0 1 librados: init done 2024-09-14T11:34:39.101 INFO:tasks.workunit.client.0.smithi138.stderr: -377> 2024-09-14T11:34:38.508+0000 7f7941e03640 4 mgrc handle_mgr_map Got map version 5 2024-09-14T11:34:39.101 INFO:tasks.workunit.client.0.smithi138.stderr: -376> 2024-09-14T11:34:38.508+0000 7f7941e03640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.138:6832/3778043143,v1:172.21.15.138:6833/3778043143] 2024-09-14T11:34:39.101 INFO:tasks.workunit.client.0.smithi138.stderr: -375> 2024-09-14T11:34:38.508+0000 7f7941e03640 4 mgrc reconnect Starting new session with [v2:172.21.15.138:6832/3778043143,v1:172.21.15.138:6833/3778043143] 2024-09-14T11:34:39.101 INFO:tasks.workunit.client.0.smithi138.stderr: -374> 2024-09-14T11:34:38.508+0000 7f7a55765640 10 monclient: get_auth_request con 0x7f793c0718a0 auth_method 0 2024-09-14T11:34:39.101 INFO:tasks.workunit.client.0.smithi138.stderr: -373> 2024-09-14T11:34:38.508+0000 7f7a55f66640 10 monclient: get_auth_request con 0x562010355770 auth_method 0 2024-09-14T11:34:39.101 INFO:tasks.workunit.client.0.smithi138.stderr: -372> 2024-09-14T11:34:38.508+0000 7f7a55765640 10 monclient: get_auth_request con 0x56201035ef40 auth_method 0 2024-09-14T11:34:39.101 INFO:tasks.workunit.client.0.smithi138.stderr: -371> 2024-09-14T11:34:38.512+0000 7f7a54f64640 10 monclient: get_auth_request con 0x5620103632e0 auth_method 0 2024-09-14T11:34:39.101 INFO:tasks.workunit.client.0.smithi138.stderr: -370> 2024-09-14T11:34:38.512+0000 7f7a55f66640 10 monclient: get_auth_request con 0x5620103677c0 auth_method 0 2024-09-14T11:34:39.101 INFO:tasks.workunit.client.0.smithi138.stderr: -369> 2024-09-14T11:34:38.512+0000 7f7a57c5f9c0 10 monclient: build_initial_monmap 2024-09-14T11:34:39.101 INFO:tasks.workunit.client.0.smithi138.stderr: -368> 2024-09-14T11:34:38.512+0000 7f7a57c5f9c0 1 build_initial for_mkfs: 0 2024-09-14T11:34:39.101 INFO:tasks.workunit.client.0.smithi138.stderr: -367> 2024-09-14T11:34:38.512+0000 7f7a57c5f9c0 10 monclient: monmap: 2024-09-14T11:34:39.101 INFO:tasks.workunit.client.0.smithi138.stderr:epoch 0 2024-09-14T11:34:39.102 INFO:tasks.workunit.client.0.smithi138.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-14T11:34:39.102 INFO:tasks.workunit.client.0.smithi138.stderr:last_changed 0.000000 2024-09-14T11:34:39.102 INFO:tasks.workunit.client.0.smithi138.stderr:created 0.000000 2024-09-14T11:34:39.102 INFO:tasks.workunit.client.0.smithi138.stderr:min_mon_release 0 (unknown) 2024-09-14T11:34:39.102 INFO:tasks.workunit.client.0.smithi138.stderr:election_strategy: 1 2024-09-14T11:34:39.102 INFO:tasks.workunit.client.0.smithi138.stderr:0: [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] mon.noname-a 2024-09-14T11:34:39.102 INFO:tasks.workunit.client.0.smithi138.stderr:1: [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] mon.noname-b 2024-09-14T11:34:39.102 INFO:tasks.workunit.client.0.smithi138.stderr:2: [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] mon.noname-c 2024-09-14T11:34:39.102 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-14T11:34:39.102 INFO:tasks.workunit.client.0.smithi138.stderr: -366> 2024-09-14T11:34:38.512+0000 7f7a57c5f9c0 5 AuthRegistry(0x56201036b580) adding auth protocol: cephx 2024-09-14T11:34:39.102 INFO:tasks.workunit.client.0.smithi138.stderr: -365> 2024-09-14T11:34:38.512+0000 7f7a57c5f9c0 5 AuthRegistry(0x56201036b580) adding auth protocol: cephx 2024-09-14T11:34:39.103 INFO:tasks.workunit.client.0.smithi138.stderr: -364> 2024-09-14T11:34:38.512+0000 7f7a57c5f9c0 5 AuthRegistry(0x56201036b580) adding auth protocol: cephx 2024-09-14T11:34:39.103 INFO:tasks.workunit.client.0.smithi138.stderr: -363> 2024-09-14T11:34:38.512+0000 7f7a57c5f9c0 5 AuthRegistry(0x56201036b580) adding con mode: secure 2024-09-14T11:34:39.103 INFO:tasks.workunit.client.0.smithi138.stderr: -362> 2024-09-14T11:34:38.512+0000 7f7a57c5f9c0 5 AuthRegistry(0x56201036b580) adding con mode: crc 2024-09-14T11:34:39.103 INFO:tasks.workunit.client.0.smithi138.stderr: -361> 2024-09-14T11:34:38.512+0000 7f7a57c5f9c0 5 AuthRegistry(0x56201036b580) adding con mode: secure 2024-09-14T11:34:39.103 INFO:tasks.workunit.client.0.smithi138.stderr: -360> 2024-09-14T11:34:38.512+0000 7f7a57c5f9c0 5 AuthRegistry(0x56201036b580) adding con mode: crc 2024-09-14T11:34:39.103 INFO:tasks.workunit.client.0.smithi138.stderr: -359> 2024-09-14T11:34:38.512+0000 7f7a57c5f9c0 5 AuthRegistry(0x56201036b580) adding con mode: secure 2024-09-14T11:34:39.103 INFO:tasks.workunit.client.0.smithi138.stderr: -358> 2024-09-14T11:34:38.512+0000 7f7a57c5f9c0 5 AuthRegistry(0x56201036b580) adding con mode: crc 2024-09-14T11:34:39.103 INFO:tasks.workunit.client.0.smithi138.stderr: -357> 2024-09-14T11:34:38.512+0000 7f7a57c5f9c0 5 AuthRegistry(0x56201036b580) adding con mode: crc 2024-09-14T11:34:39.103 INFO:tasks.workunit.client.0.smithi138.stderr: -356> 2024-09-14T11:34:38.512+0000 7f7a57c5f9c0 5 AuthRegistry(0x56201036b580) adding con mode: secure 2024-09-14T11:34:39.103 INFO:tasks.workunit.client.0.smithi138.stderr: -355> 2024-09-14T11:34:38.512+0000 7f7a57c5f9c0 5 AuthRegistry(0x56201036b580) adding con mode: crc 2024-09-14T11:34:39.103 INFO:tasks.workunit.client.0.smithi138.stderr: -354> 2024-09-14T11:34:38.512+0000 7f7a57c5f9c0 5 AuthRegistry(0x56201036b580) adding con mode: secure 2024-09-14T11:34:39.103 INFO:tasks.workunit.client.0.smithi138.stderr: -353> 2024-09-14T11:34:38.512+0000 7f7a57c5f9c0 5 AuthRegistry(0x56201036b580) adding con mode: crc 2024-09-14T11:34:39.103 INFO:tasks.workunit.client.0.smithi138.stderr: -352> 2024-09-14T11:34:38.512+0000 7f7a57c5f9c0 5 AuthRegistry(0x56201036b580) adding con mode: secure 2024-09-14T11:34:39.103 INFO:tasks.workunit.client.0.smithi138.stderr: -351> 2024-09-14T11:34:38.512+0000 7f7a57c5f9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:34:39.103 INFO:tasks.workunit.client.0.smithi138.stderr: -350> 2024-09-14T11:34:38.512+0000 7f7a57c5f9c0 5 asok(0x562010106d90) register_command objecter_requests cmddesc objecter_requests hook 0x56201036edf0 EEXIST 2024-09-14T11:34:39.104 INFO:tasks.workunit.client.0.smithi138.stderr: -349> 2024-09-14T11:34:38.512+0000 7f7a57c5f9c0 10 monclient: init 2024-09-14T11:34:39.104 INFO:tasks.workunit.client.0.smithi138.stderr: -348> 2024-09-14T11:34:38.512+0000 7f7a57c5f9c0 5 AuthRegistry(0x56201036a508) adding auth protocol: cephx 2024-09-14T11:34:39.104 INFO:tasks.workunit.client.0.smithi138.stderr: -347> 2024-09-14T11:34:38.512+0000 7f7a57c5f9c0 5 AuthRegistry(0x56201036a508) adding auth protocol: cephx 2024-09-14T11:34:39.104 INFO:tasks.workunit.client.0.smithi138.stderr: -346> 2024-09-14T11:34:38.512+0000 7f7a57c5f9c0 5 AuthRegistry(0x56201036a508) adding auth protocol: cephx 2024-09-14T11:34:39.104 INFO:tasks.workunit.client.0.smithi138.stderr: -345> 2024-09-14T11:34:38.512+0000 7f7a57c5f9c0 5 AuthRegistry(0x56201036a508) adding con mode: secure 2024-09-14T11:34:39.104 INFO:tasks.workunit.client.0.smithi138.stderr: -344> 2024-09-14T11:34:38.512+0000 7f7a57c5f9c0 5 AuthRegistry(0x56201036a508) adding con mode: crc 2024-09-14T11:34:39.104 INFO:tasks.workunit.client.0.smithi138.stderr: -343> 2024-09-14T11:34:38.512+0000 7f7a57c5f9c0 5 AuthRegistry(0x56201036a508) adding con mode: secure 2024-09-14T11:34:39.104 INFO:tasks.workunit.client.0.smithi138.stderr: -342> 2024-09-14T11:34:38.512+0000 7f7a57c5f9c0 5 AuthRegistry(0x56201036a508) adding con mode: crc 2024-09-14T11:34:39.104 INFO:tasks.workunit.client.0.smithi138.stderr: -341> 2024-09-14T11:34:38.512+0000 7f7a57c5f9c0 5 AuthRegistry(0x56201036a508) adding con mode: secure 2024-09-14T11:34:39.104 INFO:tasks.workunit.client.0.smithi138.stderr: -340> 2024-09-14T11:34:38.512+0000 7f7a57c5f9c0 5 AuthRegistry(0x56201036a508) adding con mode: crc 2024-09-14T11:34:39.104 INFO:tasks.workunit.client.0.smithi138.stderr: -339> 2024-09-14T11:34:38.512+0000 7f7a57c5f9c0 5 AuthRegistry(0x56201036a508) adding con mode: crc 2024-09-14T11:34:39.104 INFO:tasks.workunit.client.0.smithi138.stderr: -338> 2024-09-14T11:34:38.512+0000 7f7a57c5f9c0 5 AuthRegistry(0x56201036a508) adding con mode: secure 2024-09-14T11:34:39.104 INFO:tasks.workunit.client.0.smithi138.stderr: -337> 2024-09-14T11:34:38.512+0000 7f7a57c5f9c0 5 AuthRegistry(0x56201036a508) adding con mode: crc 2024-09-14T11:34:39.104 INFO:tasks.workunit.client.0.smithi138.stderr: -336> 2024-09-14T11:34:38.512+0000 7f7a57c5f9c0 5 AuthRegistry(0x56201036a508) adding con mode: secure 2024-09-14T11:34:39.105 INFO:tasks.workunit.client.0.smithi138.stderr: -335> 2024-09-14T11:34:38.512+0000 7f7a57c5f9c0 5 AuthRegistry(0x56201036a508) adding con mode: crc 2024-09-14T11:34:39.105 INFO:tasks.workunit.client.0.smithi138.stderr: -334> 2024-09-14T11:34:38.512+0000 7f7a57c5f9c0 5 AuthRegistry(0x56201036a508) adding con mode: secure 2024-09-14T11:34:39.105 INFO:tasks.workunit.client.0.smithi138.stderr: -333> 2024-09-14T11:34:38.516+0000 7f7a57c5f9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:34:39.105 INFO:tasks.workunit.client.0.smithi138.stderr: -332> 2024-09-14T11:34:38.516+0000 7f7a57c5f9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:34:39.105 INFO:tasks.workunit.client.0.smithi138.stderr: -331> 2024-09-14T11:34:38.516+0000 7f7a57c5f9c0 5 asok(0x562010106d90) register_command rotate-key cmddesc rotate-key hook 0x56201036a650 EEXIST 2024-09-14T11:34:39.105 INFO:tasks.workunit.client.0.smithi138.stderr: -330> 2024-09-14T11:34:38.516+0000 7f7a57c5f9c0 10 monclient: _reopen_session rank -1 2024-09-14T11:34:39.105 INFO:tasks.workunit.client.0.smithi138.stderr: -329> 2024-09-14T11:34:38.516+0000 7f7a57c5f9c0 10 monclient: _add_conns ranks=[2,1,0] 2024-09-14T11:34:39.105 INFO:tasks.workunit.client.0.smithi138.stderr: -328> 2024-09-14T11:34:38.516+0000 7f7a57c5f9c0 10 monclient(hunting): picked mon.noname-c con 0x562010392fa0 addr [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] 2024-09-14T11:34:39.105 INFO:tasks.workunit.client.0.smithi138.stderr: -327> 2024-09-14T11:34:38.516+0000 7f7a57c5f9c0 10 monclient(hunting): picked mon.noname-b con 0x5620103928d0 addr [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] 2024-09-14T11:34:39.105 INFO:tasks.workunit.client.0.smithi138.stderr: -326> 2024-09-14T11:34:38.516+0000 7f7a57c5f9c0 10 monclient(hunting): picked mon.noname-a con 0x5620103912b0 addr [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] 2024-09-14T11:34:39.105 INFO:tasks.workunit.client.0.smithi138.stderr: -325> 2024-09-14T11:34:38.516+0000 7f7a57c5f9c0 10 monclient(hunting): start opening mon connection 2024-09-14T11:34:39.105 INFO:tasks.workunit.client.0.smithi138.stderr: -324> 2024-09-14T11:34:38.516+0000 7f7a57c5f9c0 10 monclient(hunting): start opening mon connection 2024-09-14T11:34:39.105 INFO:tasks.workunit.client.0.smithi138.stderr: -323> 2024-09-14T11:34:38.516+0000 7f7a57c5f9c0 10 monclient(hunting): start opening mon connection 2024-09-14T11:34:39.105 INFO:tasks.workunit.client.0.smithi138.stderr: -322> 2024-09-14T11:34:38.516+0000 7f7a57c5f9c0 10 monclient(hunting): _renew_subs 2024-09-14T11:34:39.106 INFO:tasks.workunit.client.0.smithi138.stderr: -321> 2024-09-14T11:34:38.516+0000 7f7a57c5f9c0 10 monclient(hunting): authenticate will time out at 2614.476512s 2024-09-14T11:34:39.106 INFO:tasks.workunit.client.0.smithi138.stderr: -320> 2024-09-14T11:34:38.516+0000 7f7a55765640 10 monclient(hunting): get_auth_request con 0x5620103912b0 auth_method 0 2024-09-14T11:34:39.106 INFO:tasks.workunit.client.0.smithi138.stderr: -319> 2024-09-14T11:34:38.516+0000 7f7a55765640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:34:39.106 INFO:tasks.workunit.client.0.smithi138.stderr: -318> 2024-09-14T11:34:38.516+0000 7f7a55765640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:34:39.106 INFO:tasks.workunit.client.0.smithi138.stderr: -317> 2024-09-14T11:34:38.516+0000 7f7a55765640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:34:39.106 INFO:tasks.workunit.client.0.smithi138.stderr: -316> 2024-09-14T11:34:38.516+0000 7f7a54f64640 10 monclient(hunting): get_auth_request con 0x562010392fa0 auth_method 0 2024-09-14T11:34:39.106 INFO:tasks.workunit.client.0.smithi138.stderr: -315> 2024-09-14T11:34:38.516+0000 7f7a54f64640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:34:39.106 INFO:tasks.workunit.client.0.smithi138.stderr: -314> 2024-09-14T11:34:38.516+0000 7f7a54f64640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:34:39.106 INFO:tasks.workunit.client.0.smithi138.stderr: -313> 2024-09-14T11:34:38.516+0000 7f7a54f64640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:34:39.106 INFO:tasks.workunit.client.0.smithi138.stderr: -312> 2024-09-14T11:34:38.516+0000 7f7a55765640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:34:39.106 INFO:tasks.workunit.client.0.smithi138.stderr: -311> 2024-09-14T11:34:38.516+0000 7f7a55765640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:34:39.106 INFO:tasks.workunit.client.0.smithi138.stderr: -310> 2024-09-14T11:34:38.516+0000 7f7a55765640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:34:39.106 INFO:tasks.workunit.client.0.smithi138.stderr: -309> 2024-09-14T11:34:38.516+0000 7f7a54f64640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:34:39.106 INFO:tasks.workunit.client.0.smithi138.stderr: -308> 2024-09-14T11:34:38.516+0000 7f7a54f64640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:34:39.107 INFO:tasks.workunit.client.0.smithi138.stderr: -307> 2024-09-14T11:34:38.516+0000 7f7a54f64640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:34:39.107 INFO:tasks.workunit.client.0.smithi138.stderr: -306> 2024-09-14T11:34:38.516+0000 7f7a55f66640 10 monclient(hunting): get_auth_request con 0x5620103928d0 auth_method 0 2024-09-14T11:34:39.107 INFO:tasks.workunit.client.0.smithi138.stderr: -305> 2024-09-14T11:34:38.516+0000 7f7a55f66640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:34:39.107 INFO:tasks.workunit.client.0.smithi138.stderr: -304> 2024-09-14T11:34:38.516+0000 7f7a55f66640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:34:39.107 INFO:tasks.workunit.client.0.smithi138.stderr: -303> 2024-09-14T11:34:38.516+0000 7f7a55f66640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:34:39.107 INFO:tasks.workunit.client.0.smithi138.stderr: -302> 2024-09-14T11:34:38.516+0000 7f7a55765640 10 monclient(hunting): handle_auth_done global_id 6534 payload 824 2024-09-14T11:34:39.107 INFO:tasks.workunit.client.0.smithi138.stderr: -301> 2024-09-14T11:34:38.516+0000 7f7a55765640 10 monclient: _finish_hunting 0 2024-09-14T11:34:39.107 INFO:tasks.workunit.client.0.smithi138.stderr: -300> 2024-09-14T11:34:38.516+0000 7f7a55765640 1 monclient: found mon.noname-a 2024-09-14T11:34:39.107 INFO:tasks.workunit.client.0.smithi138.stderr: -299> 2024-09-14T11:34:38.516+0000 7f7a55765640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.138:3300/0 2024-09-14T11:34:39.107 INFO:tasks.workunit.client.0.smithi138.stderr: -298> 2024-09-14T11:34:38.516+0000 7f793affd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:34:39.107 INFO:tasks.workunit.client.0.smithi138.stderr: -297> 2024-09-14T11:34:38.516+0000 7f793affd640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-14T11:34:39.107 INFO:tasks.workunit.client.0.smithi138.stderr: -296> 2024-09-14T11:34:38.516+0000 7f793affd640 10 monclient: dump: 2024-09-14T11:34:39.107 INFO:tasks.workunit.client.0.smithi138.stderr:epoch 1 2024-09-14T11:34:39.107 INFO:tasks.workunit.client.0.smithi138.stderr:fsid 3f225f43-83a6-4aeb-b798-1f04bb49d597 2024-09-14T11:34:39.107 INFO:tasks.workunit.client.0.smithi138.stderr:last_changed 2024-09-14T11:07:09.252780+0000 2024-09-14T11:34:39.108 INFO:tasks.workunit.client.0.smithi138.stderr:created 2024-09-14T11:07:09.252780+0000 2024-09-14T11:34:39.108 INFO:tasks.workunit.client.0.smithi138.stderr:min_mon_release 19 (squid) 2024-09-14T11:34:39.108 INFO:tasks.workunit.client.0.smithi138.stderr:election_strategy: 1 2024-09-14T11:34:39.108 INFO:tasks.workunit.client.0.smithi138.stderr:0: [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] mon.a 2024-09-14T11:34:39.108 INFO:tasks.workunit.client.0.smithi138.stderr:1: [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] mon.b 2024-09-14T11:34:39.108 INFO:tasks.workunit.client.0.smithi138.stderr:2: [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] mon.c 2024-09-14T11:34:39.108 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-14T11:34:39.108 INFO:tasks.workunit.client.0.smithi138.stderr: -295> 2024-09-14T11:34:38.516+0000 7f793affd640 10 monclient: _finish_auth 0 2024-09-14T11:34:39.108 INFO:tasks.workunit.client.0.smithi138.stderr: -294> 2024-09-14T11:34:38.516+0000 7f793affd640 10 monclient: _check_auth_tickets 2024-09-14T11:34:39.108 INFO:tasks.workunit.client.0.smithi138.stderr: -293> 2024-09-14T11:34:38.516+0000 7f793affd640 10 monclient: handle_config config(0 keys) 2024-09-14T11:34:39.108 INFO:tasks.workunit.client.0.smithi138.stderr: -292> 2024-09-14T11:34:38.516+0000 7f793affd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:34:39.108 INFO:tasks.workunit.client.0.smithi138.stderr: -291> 2024-09-14T11:34:38.516+0000 7f793affd640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-14T11:34:39.108 INFO:tasks.workunit.client.0.smithi138.stderr: -290> 2024-09-14T11:34:38.516+0000 7f793affd640 10 monclient: dump: 2024-09-14T11:34:39.109 INFO:tasks.workunit.client.0.smithi138.stderr:epoch 1 2024-09-14T11:34:39.109 INFO:tasks.workunit.client.0.smithi138.stderr:fsid 3f225f43-83a6-4aeb-b798-1f04bb49d597 2024-09-14T11:34:39.109 INFO:tasks.workunit.client.0.smithi138.stderr:last_changed 2024-09-14T11:07:09.252780+0000 2024-09-14T11:34:39.109 INFO:tasks.workunit.client.0.smithi138.stderr:created 2024-09-14T11:07:09.252780+0000 2024-09-14T11:34:39.109 INFO:tasks.workunit.client.0.smithi138.stderr:min_mon_release 19 (squid) 2024-09-14T11:34:39.109 INFO:tasks.workunit.client.0.smithi138.stderr:election_strategy: 1 2024-09-14T11:34:39.109 INFO:tasks.workunit.client.0.smithi138.stderr:0: [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] mon.a 2024-09-14T11:34:39.109 INFO:tasks.workunit.client.0.smithi138.stderr:1: [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] mon.b 2024-09-14T11:34:39.109 INFO:tasks.workunit.client.0.smithi138.stderr:2: [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] mon.c 2024-09-14T11:34:39.109 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-14T11:34:39.109 INFO:tasks.workunit.client.0.smithi138.stderr: -289> 2024-09-14T11:34:38.516+0000 7f7a57c5f9c0 5 monclient: authenticate success, global_id 6534 2024-09-14T11:34:39.109 INFO:tasks.workunit.client.0.smithi138.stderr: -288> 2024-09-14T11:34:38.516+0000 7f7a56767640 4 set_mon_vals no callback set 2024-09-14T11:34:39.109 INFO:tasks.workunit.client.0.smithi138.stderr: -287> 2024-09-14T11:34:38.516+0000 7f7a57c5f9c0 10 monclient: _renew_subs 2024-09-14T11:34:39.109 INFO:tasks.workunit.client.0.smithi138.stderr: -286> 2024-09-14T11:34:38.516+0000 7f7a57c5f9c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.138:3300/0 2024-09-14T11:34:39.110 INFO:tasks.workunit.client.0.smithi138.stderr: -285> 2024-09-14T11:34:38.516+0000 7f7a57c5f9c0 10 monclient: _renew_subs 2024-09-14T11:34:39.110 INFO:tasks.workunit.client.0.smithi138.stderr: -284> 2024-09-14T11:34:38.516+0000 7f7a57c5f9c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.138:3300/0 2024-09-14T11:34:39.110 INFO:tasks.workunit.client.0.smithi138.stderr: -283> 2024-09-14T11:34:38.516+0000 7f793affd640 4 mgrc handle_mgr_map Got map version 5 2024-09-14T11:34:39.110 INFO:tasks.workunit.client.0.smithi138.stderr: -282> 2024-09-14T11:34:38.516+0000 7f793affd640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.138:6832/3778043143,v1:172.21.15.138:6833/3778043143] 2024-09-14T11:34:39.110 INFO:tasks.workunit.client.0.smithi138.stderr: -281> 2024-09-14T11:34:38.516+0000 7f793affd640 4 mgrc reconnect Starting new session with [v2:172.21.15.138:6832/3778043143,v1:172.21.15.138:6833/3778043143] 2024-09-14T11:34:39.110 INFO:tasks.workunit.client.0.smithi138.stderr: -280> 2024-09-14T11:34:38.516+0000 7f7a54f64640 10 monclient: get_auth_request con 0x7f79300717e0 auth_method 0 2024-09-14T11:34:39.110 INFO:tasks.workunit.client.0.smithi138.stderr: -279> 2024-09-14T11:34:38.516+0000 7f7a57c5f9c0 10 monclient: get_monmap_and_config 2024-09-14T11:34:39.110 INFO:tasks.workunit.client.0.smithi138.stderr: -278> 2024-09-14T11:34:38.516+0000 7f7a57c5f9c0 10 monclient: build_initial_monmap 2024-09-14T11:34:39.110 INFO:tasks.workunit.client.0.smithi138.stderr: -277> 2024-09-14T11:34:38.516+0000 7f7a57c5f9c0 1 build_initial for_mkfs: 0 2024-09-14T11:34:39.110 INFO:tasks.workunit.client.0.smithi138.stderr: -276> 2024-09-14T11:34:38.516+0000 7f7a57c5f9c0 10 monclient: monmap: 2024-09-14T11:34:39.110 INFO:tasks.workunit.client.0.smithi138.stderr:epoch 0 2024-09-14T11:34:39.110 INFO:tasks.workunit.client.0.smithi138.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-14T11:34:39.110 INFO:tasks.workunit.client.0.smithi138.stderr:last_changed 0.000000 2024-09-14T11:34:39.110 INFO:tasks.workunit.client.0.smithi138.stderr:created 0.000000 2024-09-14T11:34:39.110 INFO:tasks.workunit.client.0.smithi138.stderr:min_mon_release 0 (unknown) 2024-09-14T11:34:39.111 INFO:tasks.workunit.client.0.smithi138.stderr:election_strategy: 1 2024-09-14T11:34:39.111 INFO:tasks.workunit.client.0.smithi138.stderr:0: [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] mon.noname-a 2024-09-14T11:34:39.111 INFO:tasks.workunit.client.0.smithi138.stderr:1: [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] mon.noname-b 2024-09-14T11:34:39.111 INFO:tasks.workunit.client.0.smithi138.stderr:2: [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] mon.noname-c 2024-09-14T11:34:39.111 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-14T11:34:39.111 INFO:tasks.workunit.client.0.smithi138.stderr: -275> 2024-09-14T11:34:38.516+0000 7f7a57c5f9c0 5 AuthRegistry(0x5620103b2840) adding auth protocol: cephx 2024-09-14T11:34:39.111 INFO:tasks.workunit.client.0.smithi138.stderr: -274> 2024-09-14T11:34:38.516+0000 7f7a57c5f9c0 5 AuthRegistry(0x5620103b2840) adding auth protocol: cephx 2024-09-14T11:34:39.111 INFO:tasks.workunit.client.0.smithi138.stderr: -273> 2024-09-14T11:34:38.516+0000 7f7a57c5f9c0 5 AuthRegistry(0x5620103b2840) adding auth protocol: cephx 2024-09-14T11:34:39.111 INFO:tasks.workunit.client.0.smithi138.stderr: -272> 2024-09-14T11:34:38.516+0000 7f7a57c5f9c0 5 AuthRegistry(0x5620103b2840) adding con mode: secure 2024-09-14T11:34:39.111 INFO:tasks.workunit.client.0.smithi138.stderr: -271> 2024-09-14T11:34:38.516+0000 7f7a57c5f9c0 5 AuthRegistry(0x5620103b2840) adding con mode: crc 2024-09-14T11:34:39.111 INFO:tasks.workunit.client.0.smithi138.stderr: -270> 2024-09-14T11:34:38.516+0000 7f7a57c5f9c0 5 AuthRegistry(0x5620103b2840) adding con mode: secure 2024-09-14T11:34:39.111 INFO:tasks.workunit.client.0.smithi138.stderr: -269> 2024-09-14T11:34:38.516+0000 7f7a57c5f9c0 5 AuthRegistry(0x5620103b2840) adding con mode: crc 2024-09-14T11:34:39.111 INFO:tasks.workunit.client.0.smithi138.stderr: -268> 2024-09-14T11:34:38.516+0000 7f7a57c5f9c0 5 AuthRegistry(0x5620103b2840) adding con mode: secure 2024-09-14T11:34:39.111 INFO:tasks.workunit.client.0.smithi138.stderr: -267> 2024-09-14T11:34:38.516+0000 7f7a57c5f9c0 5 AuthRegistry(0x5620103b2840) adding con mode: crc 2024-09-14T11:34:39.112 INFO:tasks.workunit.client.0.smithi138.stderr: -266> 2024-09-14T11:34:38.516+0000 7f7a57c5f9c0 5 AuthRegistry(0x5620103b2840) adding con mode: crc 2024-09-14T11:34:39.112 INFO:tasks.workunit.client.0.smithi138.stderr: -265> 2024-09-14T11:34:38.516+0000 7f7a57c5f9c0 5 AuthRegistry(0x5620103b2840) adding con mode: secure 2024-09-14T11:34:39.112 INFO:tasks.workunit.client.0.smithi138.stderr: -264> 2024-09-14T11:34:38.516+0000 7f7a57c5f9c0 5 AuthRegistry(0x5620103b2840) adding con mode: crc 2024-09-14T11:34:39.112 INFO:tasks.workunit.client.0.smithi138.stderr: -263> 2024-09-14T11:34:38.516+0000 7f7a57c5f9c0 5 AuthRegistry(0x5620103b2840) adding con mode: secure 2024-09-14T11:34:39.112 INFO:tasks.workunit.client.0.smithi138.stderr: -262> 2024-09-14T11:34:38.516+0000 7f7a57c5f9c0 5 AuthRegistry(0x5620103b2840) adding con mode: crc 2024-09-14T11:34:39.112 INFO:tasks.workunit.client.0.smithi138.stderr: -261> 2024-09-14T11:34:38.516+0000 7f7a57c5f9c0 5 AuthRegistry(0x5620103b2840) adding con mode: secure 2024-09-14T11:34:39.112 INFO:tasks.workunit.client.0.smithi138.stderr: -260> 2024-09-14T11:34:38.520+0000 7f7a57c5f9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:34:39.112 INFO:tasks.workunit.client.0.smithi138.stderr: -259> 2024-09-14T11:34:38.520+0000 7f7a57c5f9c0 10 monclient: init 2024-09-14T11:34:39.112 INFO:tasks.workunit.client.0.smithi138.stderr: -258> 2024-09-14T11:34:38.520+0000 7f7a57c5f9c0 5 AuthRegistry(0x7fff1a3a2720) adding auth protocol: cephx 2024-09-14T11:34:39.112 INFO:tasks.workunit.client.0.smithi138.stderr: -257> 2024-09-14T11:34:38.520+0000 7f7a57c5f9c0 5 AuthRegistry(0x7fff1a3a2720) adding auth protocol: cephx 2024-09-14T11:34:39.112 INFO:tasks.workunit.client.0.smithi138.stderr: -256> 2024-09-14T11:34:38.520+0000 7f7a57c5f9c0 5 AuthRegistry(0x7fff1a3a2720) adding auth protocol: cephx 2024-09-14T11:34:39.112 INFO:tasks.workunit.client.0.smithi138.stderr: -255> 2024-09-14T11:34:38.520+0000 7f7a57c5f9c0 5 AuthRegistry(0x7fff1a3a2720) adding con mode: secure 2024-09-14T11:34:39.112 INFO:tasks.workunit.client.0.smithi138.stderr: -254> 2024-09-14T11:34:38.520+0000 7f7a57c5f9c0 5 AuthRegistry(0x7fff1a3a2720) adding con mode: crc 2024-09-14T11:34:39.112 INFO:tasks.workunit.client.0.smithi138.stderr: -253> 2024-09-14T11:34:38.520+0000 7f7a57c5f9c0 5 AuthRegistry(0x7fff1a3a2720) adding con mode: secure 2024-09-14T11:34:39.113 INFO:tasks.workunit.client.0.smithi138.stderr: -252> 2024-09-14T11:34:38.520+0000 7f7a57c5f9c0 5 AuthRegistry(0x7fff1a3a2720) adding con mode: crc 2024-09-14T11:34:39.113 INFO:tasks.workunit.client.0.smithi138.stderr: -251> 2024-09-14T11:34:38.520+0000 7f7a57c5f9c0 5 AuthRegistry(0x7fff1a3a2720) adding con mode: secure 2024-09-14T11:34:39.113 INFO:tasks.workunit.client.0.smithi138.stderr: -250> 2024-09-14T11:34:38.520+0000 7f7a57c5f9c0 5 AuthRegistry(0x7fff1a3a2720) adding con mode: crc 2024-09-14T11:34:39.113 INFO:tasks.workunit.client.0.smithi138.stderr: -249> 2024-09-14T11:34:38.520+0000 7f7a57c5f9c0 5 AuthRegistry(0x7fff1a3a2720) adding con mode: crc 2024-09-14T11:34:39.113 INFO:tasks.workunit.client.0.smithi138.stderr: -248> 2024-09-14T11:34:38.520+0000 7f7a57c5f9c0 5 AuthRegistry(0x7fff1a3a2720) adding con mode: secure 2024-09-14T11:34:39.113 INFO:tasks.workunit.client.0.smithi138.stderr: -247> 2024-09-14T11:34:38.520+0000 7f7a57c5f9c0 5 AuthRegistry(0x7fff1a3a2720) adding con mode: crc 2024-09-14T11:34:39.113 INFO:tasks.workunit.client.0.smithi138.stderr: -246> 2024-09-14T11:34:38.520+0000 7f7a57c5f9c0 5 AuthRegistry(0x7fff1a3a2720) adding con mode: secure 2024-09-14T11:34:39.113 INFO:tasks.workunit.client.0.smithi138.stderr: -245> 2024-09-14T11:34:38.520+0000 7f7a57c5f9c0 5 AuthRegistry(0x7fff1a3a2720) adding con mode: crc 2024-09-14T11:34:39.113 INFO:tasks.workunit.client.0.smithi138.stderr: -244> 2024-09-14T11:34:38.520+0000 7f7a57c5f9c0 5 AuthRegistry(0x7fff1a3a2720) adding con mode: secure 2024-09-14T11:34:39.113 INFO:tasks.workunit.client.0.smithi138.stderr: -243> 2024-09-14T11:34:38.520+0000 7f7a57c5f9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:34:39.113 INFO:tasks.workunit.client.0.smithi138.stderr: -242> 2024-09-14T11:34:38.520+0000 7f7a57c5f9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:34:39.113 INFO:tasks.workunit.client.0.smithi138.stderr: -241> 2024-09-14T11:34:38.520+0000 7f7a57c5f9c0 5 asok(0x562010106d90) register_command rotate-key cmddesc rotate-key hook 0x7fff1a3a2868 EEXIST 2024-09-14T11:34:39.113 INFO:tasks.workunit.client.0.smithi138.stderr: -240> 2024-09-14T11:34:38.520+0000 7f7a57c5f9c0 10 monclient: _reopen_session rank -1 2024-09-14T11:34:39.113 INFO:tasks.workunit.client.0.smithi138.stderr: -239> 2024-09-14T11:34:38.520+0000 7f7a57c5f9c0 10 monclient: _add_conns ranks=[2,1,0] 2024-09-14T11:34:39.114 INFO:tasks.workunit.client.0.smithi138.stderr: -238> 2024-09-14T11:34:38.520+0000 7f7a57c5f9c0 10 monclient(hunting): picked mon.noname-c con 0x5620103e0e30 addr [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] 2024-09-14T11:34:39.114 INFO:tasks.workunit.client.0.smithi138.stderr: -237> 2024-09-14T11:34:38.520+0000 7f7a57c5f9c0 10 monclient(hunting): picked mon.noname-b con 0x5620103e1210 addr [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] 2024-09-14T11:34:39.114 INFO:tasks.workunit.client.0.smithi138.stderr: -236> 2024-09-14T11:34:38.520+0000 7f7a57c5f9c0 10 monclient(hunting): picked mon.noname-a con 0x5620103e26d0 addr [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] 2024-09-14T11:34:39.114 INFO:tasks.workunit.client.0.smithi138.stderr: -235> 2024-09-14T11:34:38.520+0000 7f7a57c5f9c0 10 monclient(hunting): start opening mon connection 2024-09-14T11:34:39.114 INFO:tasks.workunit.client.0.smithi138.stderr: -234> 2024-09-14T11:34:38.520+0000 7f7a57c5f9c0 10 monclient(hunting): start opening mon connection 2024-09-14T11:34:39.114 INFO:tasks.workunit.client.0.smithi138.stderr: -233> 2024-09-14T11:34:38.520+0000 7f7a57c5f9c0 10 monclient(hunting): start opening mon connection 2024-09-14T11:34:39.114 INFO:tasks.workunit.client.0.smithi138.stderr: -232> 2024-09-14T11:34:38.520+0000 7f7a57c5f9c0 10 monclient(hunting): _renew_subs 2024-09-14T11:34:39.114 INFO:tasks.workunit.client.0.smithi138.stderr: -231> 2024-09-14T11:34:38.520+0000 7f7a57c5f9c0 10 monclient(hunting): authenticate will time out at 2614.480961s 2024-09-14T11:34:39.114 INFO:tasks.workunit.client.0.smithi138.stderr: -230> 2024-09-14T11:34:38.520+0000 7f7a54f64640 10 monclient(hunting): get_auth_request con 0x5620103e0e30 auth_method 0 2024-09-14T11:34:39.114 INFO:tasks.workunit.client.0.smithi138.stderr: -229> 2024-09-14T11:34:38.520+0000 7f7a54f64640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:34:39.114 INFO:tasks.workunit.client.0.smithi138.stderr: -228> 2024-09-14T11:34:38.520+0000 7f7a54f64640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:34:39.114 INFO:tasks.workunit.client.0.smithi138.stderr: -227> 2024-09-14T11:34:38.520+0000 7f7a54f64640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:34:39.114 INFO:tasks.workunit.client.0.smithi138.stderr: -226> 2024-09-14T11:34:38.520+0000 7f7a55765640 10 monclient(hunting): get_auth_request con 0x5620103e26d0 auth_method 0 2024-09-14T11:34:39.115 INFO:tasks.workunit.client.0.smithi138.stderr: -225> 2024-09-14T11:34:38.520+0000 7f7a55765640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:34:39.115 INFO:tasks.workunit.client.0.smithi138.stderr: -224> 2024-09-14T11:34:38.520+0000 7f7a55765640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:34:39.115 INFO:tasks.workunit.client.0.smithi138.stderr: -223> 2024-09-14T11:34:38.520+0000 7f7a55765640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:34:39.115 INFO:tasks.workunit.client.0.smithi138.stderr: -222> 2024-09-14T11:34:38.520+0000 7f7a54f64640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:34:39.115 INFO:tasks.workunit.client.0.smithi138.stderr: -221> 2024-09-14T11:34:38.520+0000 7f7a54f64640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:34:39.115 INFO:tasks.workunit.client.0.smithi138.stderr: -220> 2024-09-14T11:34:38.520+0000 7f7a54f64640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:34:39.115 INFO:tasks.workunit.client.0.smithi138.stderr: -219> 2024-09-14T11:34:38.520+0000 7f7a55765640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:34:39.115 INFO:tasks.workunit.client.0.smithi138.stderr: -218> 2024-09-14T11:34:38.520+0000 7f7a55765640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:34:39.115 INFO:tasks.workunit.client.0.smithi138.stderr: -217> 2024-09-14T11:34:38.520+0000 7f7a55765640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:34:39.115 INFO:tasks.workunit.client.0.smithi138.stderr: -216> 2024-09-14T11:34:38.520+0000 7f7a54f64640 10 monclient(hunting): handle_auth_done global_id 6131 payload 274 2024-09-14T11:34:39.115 INFO:tasks.workunit.client.0.smithi138.stderr: -215> 2024-09-14T11:34:38.520+0000 7f7a54f64640 10 monclient: _finish_hunting 0 2024-09-14T11:34:39.115 INFO:tasks.workunit.client.0.smithi138.stderr: -214> 2024-09-14T11:34:38.520+0000 7f7a54f64640 1 monclient: found mon.noname-c 2024-09-14T11:34:39.115 INFO:tasks.workunit.client.0.smithi138.stderr: -213> 2024-09-14T11:34:38.520+0000 7f7a54f64640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.138:3301/0 2024-09-14T11:34:39.116 INFO:tasks.workunit.client.0.smithi138.stderr: -212> 2024-09-14T11:34:38.520+0000 7f7a55f66640 10 monclient: get_auth_request con 0x5620103e1210 auth_method 0 2024-09-14T11:34:39.116 INFO:tasks.workunit.client.0.smithi138.stderr: -211> 2024-09-14T11:34:38.520+0000 7f7938ff9640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:34:39.116 INFO:tasks.workunit.client.0.smithi138.stderr: -210> 2024-09-14T11:34:38.520+0000 7f7938ff9640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-14T11:34:39.116 INFO:tasks.workunit.client.0.smithi138.stderr: -209> 2024-09-14T11:34:38.520+0000 7f7938ff9640 10 monclient: dump: 2024-09-14T11:34:39.116 INFO:tasks.workunit.client.0.smithi138.stderr:epoch 1 2024-09-14T11:34:39.116 INFO:tasks.workunit.client.0.smithi138.stderr:fsid 3f225f43-83a6-4aeb-b798-1f04bb49d597 2024-09-14T11:34:39.116 INFO:tasks.workunit.client.0.smithi138.stderr:last_changed 2024-09-14T11:07:09.252780+0000 2024-09-14T11:34:39.116 INFO:tasks.workunit.client.0.smithi138.stderr:created 2024-09-14T11:07:09.252780+0000 2024-09-14T11:34:39.116 INFO:tasks.workunit.client.0.smithi138.stderr:min_mon_release 19 (squid) 2024-09-14T11:34:39.116 INFO:tasks.workunit.client.0.smithi138.stderr:election_strategy: 1 2024-09-14T11:34:39.116 INFO:tasks.workunit.client.0.smithi138.stderr:0: [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] mon.a 2024-09-14T11:34:39.116 INFO:tasks.workunit.client.0.smithi138.stderr:1: [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] mon.b 2024-09-14T11:34:39.116 INFO:tasks.workunit.client.0.smithi138.stderr:2: [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] mon.c 2024-09-14T11:34:39.117 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-14T11:34:39.117 INFO:tasks.workunit.client.0.smithi138.stderr: -208> 2024-09-14T11:34:38.520+0000 7f7938ff9640 10 monclient: _finish_auth 0 2024-09-14T11:34:39.117 INFO:tasks.workunit.client.0.smithi138.stderr: -207> 2024-09-14T11:34:38.520+0000 7f7938ff9640 10 monclient: _check_auth_tickets 2024-09-14T11:34:39.117 INFO:tasks.workunit.client.0.smithi138.stderr: -206> 2024-09-14T11:34:38.520+0000 7f7938ff9640 10 monclient: handle_config config(0 keys) 2024-09-14T11:34:39.117 INFO:tasks.workunit.client.0.smithi138.stderr: -205> 2024-09-14T11:34:38.520+0000 7f7938ff9640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:34:39.117 INFO:tasks.workunit.client.0.smithi138.stderr: -204> 2024-09-14T11:34:38.520+0000 7f7938ff9640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-14T11:34:39.117 INFO:tasks.workunit.client.0.smithi138.stderr: -203> 2024-09-14T11:34:38.520+0000 7f7938ff9640 10 monclient: dump: 2024-09-14T11:34:39.117 INFO:tasks.workunit.client.0.smithi138.stderr:epoch 1 2024-09-14T11:34:39.117 INFO:tasks.workunit.client.0.smithi138.stderr:fsid 3f225f43-83a6-4aeb-b798-1f04bb49d597 2024-09-14T11:34:39.117 INFO:tasks.workunit.client.0.smithi138.stderr:last_changed 2024-09-14T11:07:09.252780+0000 2024-09-14T11:34:39.117 INFO:tasks.workunit.client.0.smithi138.stderr:created 2024-09-14T11:07:09.252780+0000 2024-09-14T11:34:39.117 INFO:tasks.workunit.client.0.smithi138.stderr:min_mon_release 19 (squid) 2024-09-14T11:34:39.117 INFO:tasks.workunit.client.0.smithi138.stderr:election_strategy: 1 2024-09-14T11:34:39.117 INFO:tasks.workunit.client.0.smithi138.stderr:0: [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] mon.a 2024-09-14T11:34:39.117 INFO:tasks.workunit.client.0.smithi138.stderr:1: [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] mon.b 2024-09-14T11:34:39.118 INFO:tasks.workunit.client.0.smithi138.stderr:2: [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] mon.c 2024-09-14T11:34:39.118 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-14T11:34:39.118 INFO:tasks.workunit.client.0.smithi138.stderr: -202> 2024-09-14T11:34:38.520+0000 7f7a57c5f9c0 5 monclient: authenticate success, global_id 6131 2024-09-14T11:34:39.118 INFO:tasks.workunit.client.0.smithi138.stderr: -201> 2024-09-14T11:34:38.520+0000 7f7a57c5f9c0 10 monclient: get_monmap_and_config success 2024-09-14T11:34:39.118 INFO:tasks.workunit.client.0.smithi138.stderr: -200> 2024-09-14T11:34:38.520+0000 7f7a57c5f9c0 4 set_mon_vals no callback set 2024-09-14T11:34:39.118 INFO:tasks.workunit.client.0.smithi138.stderr: -199> 2024-09-14T11:34:38.520+0000 7f7a57c5f9c0 10 monclient: shutdown 2024-09-14T11:34:39.118 INFO:tasks.workunit.client.0.smithi138.stderr: -198> 2024-09-14T11:34:38.520+0000 7f7a57c5f9c0 10 monclient: build_initial_monmap 2024-09-14T11:34:39.118 INFO:tasks.workunit.client.0.smithi138.stderr: -197> 2024-09-14T11:34:38.520+0000 7f7a57c5f9c0 1 build_initial for_mkfs: 0 2024-09-14T11:34:39.118 INFO:tasks.workunit.client.0.smithi138.stderr: -196> 2024-09-14T11:34:38.520+0000 7f7a57c5f9c0 10 monclient: monmap: 2024-09-14T11:34:39.118 INFO:tasks.workunit.client.0.smithi138.stderr:epoch 0 2024-09-14T11:34:39.118 INFO:tasks.workunit.client.0.smithi138.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-14T11:34:39.118 INFO:tasks.workunit.client.0.smithi138.stderr:last_changed 0.000000 2024-09-14T11:34:39.118 INFO:tasks.workunit.client.0.smithi138.stderr:created 0.000000 2024-09-14T11:34:39.118 INFO:tasks.workunit.client.0.smithi138.stderr:min_mon_release 0 (unknown) 2024-09-14T11:34:39.118 INFO:tasks.workunit.client.0.smithi138.stderr:election_strategy: 1 2024-09-14T11:34:39.119 INFO:tasks.workunit.client.0.smithi138.stderr:0: [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] mon.noname-a 2024-09-14T11:34:39.119 INFO:tasks.workunit.client.0.smithi138.stderr:1: [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] mon.noname-b 2024-09-14T11:34:39.119 INFO:tasks.workunit.client.0.smithi138.stderr:2: [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] mon.noname-c 2024-09-14T11:34:39.119 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-14T11:34:39.119 INFO:tasks.workunit.client.0.smithi138.stderr: -195> 2024-09-14T11:34:38.520+0000 7f7a57c5f9c0 5 AuthRegistry(0x5620103b27f0) adding auth protocol: cephx 2024-09-14T11:34:39.119 INFO:tasks.workunit.client.0.smithi138.stderr: -194> 2024-09-14T11:34:38.520+0000 7f7a57c5f9c0 5 AuthRegistry(0x5620103b27f0) adding auth protocol: cephx 2024-09-14T11:34:39.119 INFO:tasks.workunit.client.0.smithi138.stderr: -193> 2024-09-14T11:34:38.520+0000 7f7a57c5f9c0 5 AuthRegistry(0x5620103b27f0) adding auth protocol: cephx 2024-09-14T11:34:39.119 INFO:tasks.workunit.client.0.smithi138.stderr: -192> 2024-09-14T11:34:38.520+0000 7f7a57c5f9c0 5 AuthRegistry(0x5620103b27f0) adding con mode: secure 2024-09-14T11:34:39.119 INFO:tasks.workunit.client.0.smithi138.stderr: -191> 2024-09-14T11:34:38.520+0000 7f7a57c5f9c0 5 AuthRegistry(0x5620103b27f0) adding con mode: crc 2024-09-14T11:34:39.119 INFO:tasks.workunit.client.0.smithi138.stderr: -190> 2024-09-14T11:34:38.520+0000 7f7a57c5f9c0 5 AuthRegistry(0x5620103b27f0) adding con mode: secure 2024-09-14T11:34:39.119 INFO:tasks.workunit.client.0.smithi138.stderr: -189> 2024-09-14T11:34:38.520+0000 7f7a57c5f9c0 5 AuthRegistry(0x5620103b27f0) adding con mode: crc 2024-09-14T11:34:39.119 INFO:tasks.workunit.client.0.smithi138.stderr: -188> 2024-09-14T11:34:38.520+0000 7f7a57c5f9c0 5 AuthRegistry(0x5620103b27f0) adding con mode: secure 2024-09-14T11:34:39.119 INFO:tasks.workunit.client.0.smithi138.stderr: -187> 2024-09-14T11:34:38.520+0000 7f7a57c5f9c0 5 AuthRegistry(0x5620103b27f0) adding con mode: crc 2024-09-14T11:34:39.119 INFO:tasks.workunit.client.0.smithi138.stderr: -186> 2024-09-14T11:34:38.520+0000 7f7a57c5f9c0 5 AuthRegistry(0x5620103b27f0) adding con mode: crc 2024-09-14T11:34:39.120 INFO:tasks.workunit.client.0.smithi138.stderr: -185> 2024-09-14T11:34:38.520+0000 7f7a57c5f9c0 5 AuthRegistry(0x5620103b27f0) adding con mode: secure 2024-09-14T11:34:39.120 INFO:tasks.workunit.client.0.smithi138.stderr: -184> 2024-09-14T11:34:38.520+0000 7f7a57c5f9c0 5 AuthRegistry(0x5620103b27f0) adding con mode: crc 2024-09-14T11:34:39.120 INFO:tasks.workunit.client.0.smithi138.stderr: -183> 2024-09-14T11:34:38.520+0000 7f7a57c5f9c0 5 AuthRegistry(0x5620103b27f0) adding con mode: secure 2024-09-14T11:34:39.120 INFO:tasks.workunit.client.0.smithi138.stderr: -182> 2024-09-14T11:34:38.520+0000 7f7a57c5f9c0 5 AuthRegistry(0x5620103b27f0) adding con mode: crc 2024-09-14T11:34:39.120 INFO:tasks.workunit.client.0.smithi138.stderr: -181> 2024-09-14T11:34:38.520+0000 7f7a57c5f9c0 5 AuthRegistry(0x5620103b27f0) adding con mode: secure 2024-09-14T11:34:39.120 INFO:tasks.workunit.client.0.smithi138.stderr: -180> 2024-09-14T11:34:38.520+0000 7f7a57c5f9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:34:39.120 INFO:tasks.workunit.client.0.smithi138.stderr: -179> 2024-09-14T11:34:38.520+0000 7f7a57c5f9c0 1 librados: starting msgr at 2024-09-14T11:34:39.120 INFO:tasks.workunit.client.0.smithi138.stderr: -178> 2024-09-14T11:34:38.520+0000 7f7a57c5f9c0 1 librados: starting objecter 2024-09-14T11:34:39.120 INFO:tasks.workunit.client.0.smithi138.stderr: -177> 2024-09-14T11:34:38.520+0000 7f7a57c5f9c0 5 asok(0x562010106d90) register_command objecter_requests cmddesc objecter_requests hook 0x562010390f20 EEXIST 2024-09-14T11:34:39.120 INFO:tasks.workunit.client.0.smithi138.stderr: -176> 2024-09-14T11:34:38.520+0000 7f7a57c5f9c0 1 librados: setting wanted keys 2024-09-14T11:34:39.120 INFO:tasks.workunit.client.0.smithi138.stderr: -175> 2024-09-14T11:34:38.520+0000 7f7a57c5f9c0 1 librados: calling monclient init 2024-09-14T11:34:39.120 INFO:tasks.workunit.client.0.smithi138.stderr: -174> 2024-09-14T11:34:38.520+0000 7f7a57c5f9c0 10 monclient: init 2024-09-14T11:34:39.120 INFO:tasks.workunit.client.0.smithi138.stderr: -173> 2024-09-14T11:34:38.520+0000 7f7a57c5f9c0 5 AuthRegistry(0x562010394dc0) adding auth protocol: cephx 2024-09-14T11:34:39.120 INFO:tasks.workunit.client.0.smithi138.stderr: -172> 2024-09-14T11:34:38.520+0000 7f7a57c5f9c0 5 AuthRegistry(0x562010394dc0) adding auth protocol: cephx 2024-09-14T11:34:39.121 INFO:tasks.workunit.client.0.smithi138.stderr: -171> 2024-09-14T11:34:38.520+0000 7f7a57c5f9c0 5 AuthRegistry(0x562010394dc0) adding auth protocol: cephx 2024-09-14T11:34:39.121 INFO:tasks.workunit.client.0.smithi138.stderr: -170> 2024-09-14T11:34:38.520+0000 7f7a57c5f9c0 5 AuthRegistry(0x562010394dc0) adding con mode: secure 2024-09-14T11:34:39.121 INFO:tasks.workunit.client.0.smithi138.stderr: -169> 2024-09-14T11:34:38.520+0000 7f7a57c5f9c0 5 AuthRegistry(0x562010394dc0) adding con mode: crc 2024-09-14T11:34:39.121 INFO:tasks.workunit.client.0.smithi138.stderr: -168> 2024-09-14T11:34:38.520+0000 7f7a57c5f9c0 5 AuthRegistry(0x562010394dc0) adding con mode: secure 2024-09-14T11:34:39.121 INFO:tasks.workunit.client.0.smithi138.stderr: -167> 2024-09-14T11:34:38.520+0000 7f7a57c5f9c0 5 AuthRegistry(0x562010394dc0) adding con mode: crc 2024-09-14T11:34:39.121 INFO:tasks.workunit.client.0.smithi138.stderr: -166> 2024-09-14T11:34:38.520+0000 7f7a57c5f9c0 5 AuthRegistry(0x562010394dc0) adding con mode: secure 2024-09-14T11:34:39.121 INFO:tasks.workunit.client.0.smithi138.stderr: -165> 2024-09-14T11:34:38.520+0000 7f7a57c5f9c0 5 AuthRegistry(0x562010394dc0) adding con mode: crc 2024-09-14T11:34:39.121 INFO:tasks.workunit.client.0.smithi138.stderr: -164> 2024-09-14T11:34:38.520+0000 7f7a57c5f9c0 5 AuthRegistry(0x562010394dc0) adding con mode: crc 2024-09-14T11:34:39.121 INFO:tasks.workunit.client.0.smithi138.stderr: -163> 2024-09-14T11:34:38.520+0000 7f7a57c5f9c0 5 AuthRegistry(0x562010394dc0) adding con mode: secure 2024-09-14T11:34:39.121 INFO:tasks.workunit.client.0.smithi138.stderr: -162> 2024-09-14T11:34:38.520+0000 7f7a57c5f9c0 5 AuthRegistry(0x562010394dc0) adding con mode: crc 2024-09-14T11:34:39.121 INFO:tasks.workunit.client.0.smithi138.stderr: -161> 2024-09-14T11:34:38.520+0000 7f7a57c5f9c0 5 AuthRegistry(0x562010394dc0) adding con mode: secure 2024-09-14T11:34:39.121 INFO:tasks.workunit.client.0.smithi138.stderr: -160> 2024-09-14T11:34:38.520+0000 7f7a57c5f9c0 5 AuthRegistry(0x562010394dc0) adding con mode: crc 2024-09-14T11:34:39.121 INFO:tasks.workunit.client.0.smithi138.stderr: -159> 2024-09-14T11:34:38.520+0000 7f7a57c5f9c0 5 AuthRegistry(0x562010394dc0) adding con mode: secure 2024-09-14T11:34:39.121 INFO:tasks.workunit.client.0.smithi138.stderr: -158> 2024-09-14T11:34:38.520+0000 7f7a57c5f9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:34:39.122 INFO:tasks.workunit.client.0.smithi138.stderr: -157> 2024-09-14T11:34:38.520+0000 7f7a57c5f9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:34:39.122 INFO:tasks.workunit.client.0.smithi138.stderr: -156> 2024-09-14T11:34:38.520+0000 7f7a57c5f9c0 5 asok(0x562010106d90) register_command rotate-key cmddesc rotate-key hook 0x562010394f08 EEXIST 2024-09-14T11:34:39.122 INFO:tasks.workunit.client.0.smithi138.stderr: -155> 2024-09-14T11:34:38.520+0000 7f7a57c5f9c0 10 monclient: _reopen_session rank -1 2024-09-14T11:34:39.122 INFO:tasks.workunit.client.0.smithi138.stderr: -154> 2024-09-14T11:34:38.520+0000 7f7a57c5f9c0 10 monclient: _add_conns ranks=[0,2,1] 2024-09-14T11:34:39.122 INFO:tasks.workunit.client.0.smithi138.stderr: -153> 2024-09-14T11:34:38.520+0000 7f7a57c5f9c0 10 monclient(hunting): picked mon.noname-a con 0x5620103e0e30 addr [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] 2024-09-14T11:34:39.122 INFO:tasks.workunit.client.0.smithi138.stderr: -152> 2024-09-14T11:34:38.520+0000 7f7a57c5f9c0 10 monclient(hunting): picked mon.noname-c con 0x5620103e26d0 addr [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] 2024-09-14T11:34:39.122 INFO:tasks.workunit.client.0.smithi138.stderr: -151> 2024-09-14T11:34:38.520+0000 7f7a57c5f9c0 10 monclient(hunting): picked mon.noname-b con 0x5620103e0180 addr [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] 2024-09-14T11:34:39.122 INFO:tasks.workunit.client.0.smithi138.stderr: -150> 2024-09-14T11:34:38.520+0000 7f7a57c5f9c0 10 monclient(hunting): start opening mon connection 2024-09-14T11:34:39.122 INFO:tasks.workunit.client.0.smithi138.stderr: -149> 2024-09-14T11:34:38.520+0000 7f7a57c5f9c0 10 monclient(hunting): start opening mon connection 2024-09-14T11:34:39.122 INFO:tasks.workunit.client.0.smithi138.stderr: -148> 2024-09-14T11:34:38.520+0000 7f7a57c5f9c0 10 monclient(hunting): start opening mon connection 2024-09-14T11:34:39.122 INFO:tasks.workunit.client.0.smithi138.stderr: -147> 2024-09-14T11:34:38.520+0000 7f7a57c5f9c0 10 monclient(hunting): _renew_subs 2024-09-14T11:34:39.122 INFO:tasks.workunit.client.0.smithi138.stderr: -146> 2024-09-14T11:34:38.520+0000 7f7a57c5f9c0 10 monclient(hunting): authenticate will time out at 2614.483506s 2024-09-14T11:34:39.122 INFO:tasks.workunit.client.0.smithi138.stderr: -145> 2024-09-14T11:34:38.520+0000 7f7a54f64640 10 monclient(hunting): get_auth_request con 0x5620103e0e30 auth_method 0 2024-09-14T11:34:39.122 INFO:tasks.workunit.client.0.smithi138.stderr: -144> 2024-09-14T11:34:38.520+0000 7f7a54f64640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:34:39.122 INFO:tasks.workunit.client.0.smithi138.stderr: -143> 2024-09-14T11:34:38.520+0000 7f7a54f64640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:34:39.123 INFO:tasks.workunit.client.0.smithi138.stderr: -142> 2024-09-14T11:34:38.520+0000 7f7a54f64640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:34:39.123 INFO:tasks.workunit.client.0.smithi138.stderr: -141> 2024-09-14T11:34:38.520+0000 7f7a55f66640 10 monclient(hunting): get_auth_request con 0x5620103e26d0 auth_method 0 2024-09-14T11:34:39.123 INFO:tasks.workunit.client.0.smithi138.stderr: -140> 2024-09-14T11:34:38.520+0000 7f7a55f66640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:34:39.123 INFO:tasks.workunit.client.0.smithi138.stderr: -139> 2024-09-14T11:34:38.520+0000 7f7a55f66640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:34:39.123 INFO:tasks.workunit.client.0.smithi138.stderr: -138> 2024-09-14T11:34:38.520+0000 7f7a55f66640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:34:39.123 INFO:tasks.workunit.client.0.smithi138.stderr: -137> 2024-09-14T11:34:38.520+0000 7f7a54f64640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:34:39.123 INFO:tasks.workunit.client.0.smithi138.stderr: -136> 2024-09-14T11:34:38.520+0000 7f7a54f64640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:34:39.123 INFO:tasks.workunit.client.0.smithi138.stderr: -135> 2024-09-14T11:34:38.520+0000 7f7a54f64640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:34:39.123 INFO:tasks.workunit.client.0.smithi138.stderr: -134> 2024-09-14T11:34:38.520+0000 7f7a55f66640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:34:39.123 INFO:tasks.workunit.client.0.smithi138.stderr: -133> 2024-09-14T11:34:38.520+0000 7f7a55f66640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:34:39.123 INFO:tasks.workunit.client.0.smithi138.stderr: -132> 2024-09-14T11:34:38.520+0000 7f7a55f66640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:34:39.123 INFO:tasks.workunit.client.0.smithi138.stderr: -131> 2024-09-14T11:34:38.520+0000 7f7a55f66640 10 monclient(hunting): handle_auth_done global_id 6134 payload 824 2024-09-14T11:34:39.123 INFO:tasks.workunit.client.0.smithi138.stderr: -130> 2024-09-14T11:34:38.520+0000 7f7a55f66640 10 monclient: _finish_hunting 0 2024-09-14T11:34:39.123 INFO:tasks.workunit.client.0.smithi138.stderr: -129> 2024-09-14T11:34:38.520+0000 7f7a55f66640 1 monclient: found mon.noname-c 2024-09-14T11:34:39.123 INFO:tasks.workunit.client.0.smithi138.stderr: -128> 2024-09-14T11:34:38.520+0000 7f7a55f66640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.138:3301/0 2024-09-14T11:34:39.124 INFO:tasks.workunit.client.0.smithi138.stderr: -127> 2024-09-14T11:34:38.524+0000 7f7926ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:34:39.124 INFO:tasks.workunit.client.0.smithi138.stderr: -126> 2024-09-14T11:34:38.524+0000 7f7926ffd640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-14T11:34:39.124 INFO:tasks.workunit.client.0.smithi138.stderr: -125> 2024-09-14T11:34:38.524+0000 7f7926ffd640 10 monclient: dump: 2024-09-14T11:34:39.124 INFO:tasks.workunit.client.0.smithi138.stderr:epoch 1 2024-09-14T11:34:39.124 INFO:tasks.workunit.client.0.smithi138.stderr:fsid 3f225f43-83a6-4aeb-b798-1f04bb49d597 2024-09-14T11:34:39.124 INFO:tasks.workunit.client.0.smithi138.stderr:last_changed 2024-09-14T11:07:09.252780+0000 2024-09-14T11:34:39.124 INFO:tasks.workunit.client.0.smithi138.stderr:created 2024-09-14T11:07:09.252780+0000 2024-09-14T11:34:39.124 INFO:tasks.workunit.client.0.smithi138.stderr:min_mon_release 19 (squid) 2024-09-14T11:34:39.124 INFO:tasks.workunit.client.0.smithi138.stderr:election_strategy: 1 2024-09-14T11:34:39.124 INFO:tasks.workunit.client.0.smithi138.stderr:0: [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] mon.a 2024-09-14T11:34:39.124 INFO:tasks.workunit.client.0.smithi138.stderr:1: [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] mon.b 2024-09-14T11:34:39.124 INFO:tasks.workunit.client.0.smithi138.stderr:2: [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] mon.c 2024-09-14T11:34:39.124 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-14T11:34:39.124 INFO:tasks.workunit.client.0.smithi138.stderr: -124> 2024-09-14T11:34:38.524+0000 7f7926ffd640 10 monclient: _finish_auth 0 2024-09-14T11:34:39.124 INFO:tasks.workunit.client.0.smithi138.stderr: -123> 2024-09-14T11:34:38.524+0000 7f7926ffd640 10 monclient: _check_auth_tickets 2024-09-14T11:34:39.125 INFO:tasks.workunit.client.0.smithi138.stderr: -122> 2024-09-14T11:34:38.524+0000 7f7926ffd640 10 monclient: handle_config config(0 keys) 2024-09-14T11:34:39.125 INFO:tasks.workunit.client.0.smithi138.stderr: -121> 2024-09-14T11:34:38.524+0000 7f7926ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:34:39.125 INFO:tasks.workunit.client.0.smithi138.stderr: -120> 2024-09-14T11:34:38.524+0000 7f7926ffd640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-14T11:34:39.125 INFO:tasks.workunit.client.0.smithi138.stderr: -119> 2024-09-14T11:34:38.524+0000 7f7926ffd640 10 monclient: dump: 2024-09-14T11:34:39.125 INFO:tasks.workunit.client.0.smithi138.stderr:epoch 1 2024-09-14T11:34:39.125 INFO:tasks.workunit.client.0.smithi138.stderr:fsid 3f225f43-83a6-4aeb-b798-1f04bb49d597 2024-09-14T11:34:39.125 INFO:tasks.workunit.client.0.smithi138.stderr:last_changed 2024-09-14T11:07:09.252780+0000 2024-09-14T11:34:39.125 INFO:tasks.workunit.client.0.smithi138.stderr:created 2024-09-14T11:07:09.252780+0000 2024-09-14T11:34:39.125 INFO:tasks.workunit.client.0.smithi138.stderr:min_mon_release 19 (squid) 2024-09-14T11:34:39.125 INFO:tasks.workunit.client.0.smithi138.stderr:election_strategy: 1 2024-09-14T11:34:39.125 INFO:tasks.workunit.client.0.smithi138.stderr:0: [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] mon.a 2024-09-14T11:34:39.125 INFO:tasks.workunit.client.0.smithi138.stderr:1: [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] mon.b 2024-09-14T11:34:39.126 INFO:tasks.workunit.client.0.smithi138.stderr:2: [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] mon.c 2024-09-14T11:34:39.126 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-14T11:34:39.126 INFO:tasks.workunit.client.0.smithi138.stderr: -118> 2024-09-14T11:34:38.524+0000 7f7a57c5f9c0 5 monclient: authenticate success, global_id 6134 2024-09-14T11:34:39.126 INFO:tasks.workunit.client.0.smithi138.stderr: -117> 2024-09-14T11:34:38.524+0000 7f7a57c5f9c0 10 monclient: _renew_subs 2024-09-14T11:34:39.126 INFO:tasks.workunit.client.0.smithi138.stderr: -116> 2024-09-14T11:34:38.524+0000 7f7938ff9640 4 set_mon_vals no callback set 2024-09-14T11:34:39.126 INFO:tasks.workunit.client.0.smithi138.stderr: -115> 2024-09-14T11:34:38.524+0000 7f7a57c5f9c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.138:3301/0 2024-09-14T11:34:39.126 INFO:tasks.workunit.client.0.smithi138.stderr: -114> 2024-09-14T11:34:38.524+0000 7f7a57c5f9c0 10 monclient: _renew_subs 2024-09-14T11:34:39.126 INFO:tasks.workunit.client.0.smithi138.stderr: -113> 2024-09-14T11:34:38.524+0000 7f7a57c5f9c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.138:3301/0 2024-09-14T11:34:39.126 INFO:tasks.workunit.client.0.smithi138.stderr: -112> 2024-09-14T11:34:38.524+0000 7f7a57c5f9c0 1 librados: init done 2024-09-14T11:34:39.126 INFO:tasks.workunit.client.0.smithi138.stderr: -111> 2024-09-14T11:34:38.524+0000 7f7a57c5f9c0 5 asok(0x562010106d90) register_command cr dump hook 0x5620103d47c8 2024-09-14T11:34:39.126 INFO:tasks.workunit.client.0.smithi138.stderr: -110> 2024-09-14T11:34:38.524+0000 7f7a57c5f9c0 20 rados->read ofs=0 len=0 2024-09-14T11:34:39.126 INFO:tasks.workunit.client.0.smithi138.stderr: -109> 2024-09-14T11:34:38.524+0000 7f7926ffd640 4 mgrc handle_mgr_map Got map version 5 2024-09-14T11:34:39.126 INFO:tasks.workunit.client.0.smithi138.stderr: -108> 2024-09-14T11:34:38.524+0000 7f7926ffd640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.138:6832/3778043143,v1:172.21.15.138:6833/3778043143] 2024-09-14T11:34:39.127 INFO:tasks.workunit.client.0.smithi138.stderr: -107> 2024-09-14T11:34:38.524+0000 7f7926ffd640 4 mgrc reconnect Starting new session with [v2:172.21.15.138:6832/3778043143,v1:172.21.15.138:6833/3778043143] 2024-09-14T11:34:39.127 INFO:tasks.workunit.client.0.smithi138.stderr: -106> 2024-09-14T11:34:38.524+0000 7f7a54f64640 10 monclient: get_auth_request con 0x7f79200718a0 auth_method 0 2024-09-14T11:34:39.127 INFO:tasks.workunit.client.0.smithi138.stderr: -105> 2024-09-14T11:34:38.524+0000 7f7a55765640 10 monclient: get_auth_request con 0x562010400bc0 auth_method 0 2024-09-14T11:34:39.127 INFO:tasks.workunit.client.0.smithi138.stderr: -104> 2024-09-14T11:34:38.524+0000 7f7a57c5f9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:34:39.127 INFO:tasks.workunit.client.0.smithi138.stderr: -103> 2024-09-14T11:34:38.524+0000 7f7a57c5f9c0 20 realm 2024-09-14T11:34:39.127 INFO:tasks.workunit.client.0.smithi138.stderr: -102> 2024-09-14T11:34:38.524+0000 7f7a57c5f9c0 20 rados->read ofs=0 len=0 2024-09-14T11:34:39.127 INFO:tasks.workunit.client.0.smithi138.stderr: -101> 2024-09-14T11:34:38.524+0000 7f7a57c5f9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:34:39.127 INFO:tasks.workunit.client.0.smithi138.stderr: -100> 2024-09-14T11:34:38.524+0000 7f7a57c5f9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:34:39.127 INFO:tasks.workunit.client.0.smithi138.stderr: -99> 2024-09-14T11:34:38.524+0000 7f7a57c5f9c0 20 rados->read ofs=0 len=0 2024-09-14T11:34:39.127 INFO:tasks.workunit.client.0.smithi138.stderr: -98> 2024-09-14T11:34:38.528+0000 7f7a57c5f9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:34:39.127 INFO:tasks.workunit.client.0.smithi138.stderr: -97> 2024-09-14T11:34:38.528+0000 7f7a57c5f9c0 20 rados->read ofs=0 len=0 2024-09-14T11:34:39.127 INFO:tasks.workunit.client.0.smithi138.stderr: -96> 2024-09-14T11:34:38.528+0000 7f7a54f64640 10 monclient: get_auth_request con 0x562010404dd0 auth_method 0 2024-09-14T11:34:39.127 INFO:tasks.workunit.client.0.smithi138.stderr: -95> 2024-09-14T11:34:38.528+0000 7f7a57c5f9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:34:39.127 INFO:tasks.workunit.client.0.smithi138.stderr: -94> 2024-09-14T11:34:38.528+0000 7f7a57c5f9c0 20 rados->read ofs=0 len=0 2024-09-14T11:34:39.128 INFO:tasks.workunit.client.0.smithi138.stderr: -93> 2024-09-14T11:34:38.528+0000 7f7a55f66640 10 monclient: get_auth_request con 0x562010408630 auth_method 0 2024-09-14T11:34:39.128 INFO:tasks.workunit.client.0.smithi138.stderr: -92> 2024-09-14T11:34:38.528+0000 7f7a57c5f9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:34:39.128 INFO:tasks.workunit.client.0.smithi138.stderr: -91> 2024-09-14T11:34:38.528+0000 7f7a57c5f9c0 20 searching for the correct realm 2024-09-14T11:34:39.128 INFO:tasks.workunit.client.0.smithi138.stderr: -90> 2024-09-14T11:34:38.528+0000 7f7a55765640 10 monclient: get_auth_request con 0x56201040d3b0 auth_method 0 2024-09-14T11:34:39.128 INFO:tasks.workunit.client.0.smithi138.stderr: -89> 2024-09-14T11:34:38.528+0000 7f7a54f64640 10 monclient: get_auth_request con 0x7f7a48034060 auth_method 0 2024-09-14T11:34:39.128 INFO:tasks.workunit.client.0.smithi138.stderr: -88> 2024-09-14T11:34:38.532+0000 7f7a55f66640 10 monclient: get_auth_request con 0x7f7a50066090 auth_method 0 2024-09-14T11:34:39.128 INFO:tasks.workunit.client.0.smithi138.stderr: -87> 2024-09-14T11:34:38.532+0000 7f7a55f66640 0 -- 172.21.15.138:0/3375493065 >> [v2:172.21.15.154:6824/416768175,v1:172.21.15.154:6825/416768175] conn(0x7f7a50066090 msgr2=0x7f7a5006ca00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-14T11:34:39.128 INFO:tasks.workunit.client.0.smithi138.stderr: -86> 2024-09-14T11:34:38.736+0000 7f7a55f66640 10 monclient: get_auth_request con 0x7f7a50066090 auth_method 0 2024-09-14T11:34:39.128 INFO:tasks.workunit.client.0.smithi138.stderr: -85> 2024-09-14T11:34:38.740+0000 7f7a55765640 10 monclient: get_auth_request con 0x7f7a5006f280 auth_method 0 2024-09-14T11:34:39.128 INFO:tasks.workunit.client.0.smithi138.stderr: -84> 2024-09-14T11:34:38.748+0000 7f7a54f64640 10 monclient: get_auth_request con 0x7f7a50065090 auth_method 0 2024-09-14T11:34:39.128 INFO:tasks.workunit.client.0.smithi138.stderr: -83> 2024-09-14T11:34:38.748+0000 7f7a54f64640 0 -- 172.21.15.138:0/3375493065 >> [v2:172.21.15.138:6816/326481658,v1:172.21.15.138:6817/326481658] conn(0x7f7a50065090 msgr2=0x7f7a5006a0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:34:39.128 INFO:tasks.workunit.client.0.smithi138.stderr: -82> 2024-09-14T11:34:38.952+0000 7f7a54f64640 10 monclient: get_auth_request con 0x7f7a50065090 auth_method 0 2024-09-14T11:34:39.128 INFO:tasks.workunit.client.0.smithi138.stderr: -81> 2024-09-14T11:34:38.968+0000 7f7a57c5f9c0 20 RGWRados::pool_iterate: got zone_info.d9e72d30-c60b-4d0d-9267-fdc36392d5ad 2024-09-14T11:34:39.129 INFO:tasks.workunit.client.0.smithi138.stderr: -80> 2024-09-14T11:34:38.968+0000 7f7a57c5f9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:34:39.129 INFO:tasks.workunit.client.0.smithi138.stderr: -79> 2024-09-14T11:34:38.968+0000 7f7a57c5f9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:34:39.129 INFO:tasks.workunit.client.0.smithi138.stderr: -78> 2024-09-14T11:34:38.968+0000 7f7a57c5f9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:34:39.129 INFO:tasks.workunit.client.0.smithi138.stderr: -77> 2024-09-14T11:34:38.968+0000 7f7a57c5f9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:34:39.129 INFO:tasks.workunit.client.0.smithi138.stderr: -76> 2024-09-14T11:34:38.968+0000 7f7a57c5f9c0 20 RGWRados::pool_iterate: got zonegroup_info.65ab941b-da8c-4160-94fb-3672b069d44f 2024-09-14T11:34:39.129 INFO:tasks.workunit.client.0.smithi138.stderr: -75> 2024-09-14T11:34:38.968+0000 7f7a57c5f9c0 20 rados->read ofs=0 len=0 2024-09-14T11:34:39.129 INFO:tasks.workunit.client.0.smithi138.stderr: -74> 2024-09-14T11:34:38.968+0000 7f7a57c5f9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:34:39.129 INFO:tasks.workunit.client.0.smithi138.stderr: -73> 2024-09-14T11:34:38.968+0000 7f7a57c5f9c0 20 rados->read ofs=0 len=0 2024-09-14T11:34:39.129 INFO:tasks.workunit.client.0.smithi138.stderr: -72> 2024-09-14T11:34:38.968+0000 7f7a57c5f9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:34:39.129 INFO:tasks.workunit.client.0.smithi138.stderr: -71> 2024-09-14T11:34:38.968+0000 7f7a57c5f9c0 20 rados->read ofs=0 len=0 2024-09-14T11:34:39.129 INFO:tasks.workunit.client.0.smithi138.stderr: -70> 2024-09-14T11:34:38.968+0000 7f7a57c5f9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:34:39.129 INFO:tasks.workunit.client.0.smithi138.stderr: -69> 2024-09-14T11:34:38.968+0000 7f7a57c5f9c0 20 zone default found 2024-09-14T11:34:39.129 INFO:tasks.workunit.client.0.smithi138.stderr: -68> 2024-09-14T11:34:38.968+0000 7f7a57c5f9c0 4 Realm: () 2024-09-14T11:34:39.130 INFO:tasks.workunit.client.0.smithi138.stderr: -67> 2024-09-14T11:34:38.968+0000 7f7a57c5f9c0 4 ZoneGroup: default (65ab941b-da8c-4160-94fb-3672b069d44f) 2024-09-14T11:34:39.130 INFO:tasks.workunit.client.0.smithi138.stderr: -66> 2024-09-14T11:34:38.968+0000 7f7a57c5f9c0 4 Zone: default (d9e72d30-c60b-4d0d-9267-fdc36392d5ad) 2024-09-14T11:34:39.130 INFO:tasks.workunit.client.0.smithi138.stderr: -65> 2024-09-14T11:34:38.968+0000 7f7a57c5f9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:34:39.130 INFO:tasks.workunit.client.0.smithi138.stderr: -64> 2024-09-14T11:34:38.968+0000 7f7a57c5f9c0 20 zonegroup default 2024-09-14T11:34:39.130 INFO:tasks.workunit.client.0.smithi138.stderr: -63> 2024-09-14T11:34:38.968+0000 7f7a57c5f9c0 20 rados->read ofs=0 len=0 2024-09-14T11:34:39.130 INFO:tasks.workunit.client.0.smithi138.stderr: -62> 2024-09-14T11:34:38.968+0000 7f7a57c5f9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:34:39.130 INFO:tasks.workunit.client.0.smithi138.stderr: -61> 2024-09-14T11:34:38.968+0000 7f7a57c5f9c0 20 rados->read ofs=0 len=0 2024-09-14T11:34:39.130 INFO:tasks.workunit.client.0.smithi138.stderr: -60> 2024-09-14T11:34:38.972+0000 7f7a57c5f9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:34:39.130 INFO:tasks.workunit.client.0.smithi138.stderr: -59> 2024-09-14T11:34:38.972+0000 7f7a57c5f9c0 20 rados->read ofs=0 len=0 2024-09-14T11:34:39.130 INFO:tasks.workunit.client.0.smithi138.stderr: -58> 2024-09-14T11:34:38.972+0000 7f7a57c5f9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:34:39.130 INFO:tasks.workunit.client.0.smithi138.stderr: -57> 2024-09-14T11:34:38.972+0000 7f7a57c5f9c0 20 started sync module instance, tier type = 2024-09-14T11:34:39.130 INFO:tasks.workunit.client.0.smithi138.stderr: -56> 2024-09-14T11:34:38.972+0000 7f7a57c5f9c0 20 started zone id=d9e72d30-c60b-4d0d-9267-fdc36392d5ad (name=default) with tier type = 2024-09-14T11:34:39.130 INFO:tasks.workunit.client.0.smithi138.stderr: -55> 2024-09-14T11:34:38.996+0000 7f7a57c5f9c0 20 add_watcher() i=0 2024-09-14T11:34:39.130 INFO:tasks.workunit.client.0.smithi138.stderr: -54> 2024-09-14T11:34:38.996+0000 7f7a57c5f9c0 20 add_watcher() i=1 2024-09-14T11:34:39.131 INFO:tasks.workunit.client.0.smithi138.stderr: -53> 2024-09-14T11:34:38.996+0000 7f7a57c5f9c0 20 add_watcher() i=2 2024-09-14T11:34:39.131 INFO:tasks.workunit.client.0.smithi138.stderr: -52> 2024-09-14T11:34:38.996+0000 7f7a57c5f9c0 20 add_watcher() i=3 2024-09-14T11:34:39.131 INFO:tasks.workunit.client.0.smithi138.stderr: -51> 2024-09-14T11:34:38.996+0000 7f7a57c5f9c0 20 add_watcher() i=4 2024-09-14T11:34:39.131 INFO:tasks.workunit.client.0.smithi138.stderr: -50> 2024-09-14T11:34:38.996+0000 7f7a57c5f9c0 20 add_watcher() i=5 2024-09-14T11:34:39.131 INFO:tasks.workunit.client.0.smithi138.stderr: -49> 2024-09-14T11:34:38.996+0000 7f7a57c5f9c0 20 add_watcher() i=6 2024-09-14T11:34:39.131 INFO:tasks.workunit.client.0.smithi138.stderr: -48> 2024-09-14T11:34:39.000+0000 7f7a57c5f9c0 20 add_watcher() i=7 2024-09-14T11:34:39.131 INFO:tasks.workunit.client.0.smithi138.stderr: -47> 2024-09-14T11:34:39.000+0000 7f7a57c5f9c0 2 all 8 watchers are set, enabling cache 2024-09-14T11:34:39.131 INFO:tasks.workunit.client.0.smithi138.stderr: -46> 2024-09-14T11:34:39.004+0000 7f7a57c5f9c0 5 AuthRegistry(0x7fff1a3a2c00) adding auth protocol: cephx 2024-09-14T11:34:39.131 INFO:tasks.workunit.client.0.smithi138.stderr: -45> 2024-09-14T11:34:39.004+0000 7f7a57c5f9c0 5 AuthRegistry(0x7fff1a3a2c00) adding auth protocol: cephx 2024-09-14T11:34:39.131 INFO:tasks.workunit.client.0.smithi138.stderr: -44> 2024-09-14T11:34:39.004+0000 7f7a57c5f9c0 5 AuthRegistry(0x7fff1a3a2c00) adding auth protocol: cephx 2024-09-14T11:34:39.131 INFO:tasks.workunit.client.0.smithi138.stderr: -43> 2024-09-14T11:34:39.004+0000 7f7a57c5f9c0 5 AuthRegistry(0x7fff1a3a2c00) adding con mode: secure 2024-09-14T11:34:39.131 INFO:tasks.workunit.client.0.smithi138.stderr: -42> 2024-09-14T11:34:39.004+0000 7f7a57c5f9c0 5 AuthRegistry(0x7fff1a3a2c00) adding con mode: crc 2024-09-14T11:34:39.131 INFO:tasks.workunit.client.0.smithi138.stderr: -41> 2024-09-14T11:34:39.004+0000 7f7a57c5f9c0 5 AuthRegistry(0x7fff1a3a2c00) adding con mode: secure 2024-09-14T11:34:39.131 INFO:tasks.workunit.client.0.smithi138.stderr: -40> 2024-09-14T11:34:39.004+0000 7f7a57c5f9c0 5 AuthRegistry(0x7fff1a3a2c00) adding con mode: crc 2024-09-14T11:34:39.132 INFO:tasks.workunit.client.0.smithi138.stderr: -39> 2024-09-14T11:34:39.004+0000 7f7a57c5f9c0 5 AuthRegistry(0x7fff1a3a2c00) adding con mode: secure 2024-09-14T11:34:39.132 INFO:tasks.workunit.client.0.smithi138.stderr: -38> 2024-09-14T11:34:39.004+0000 7f7a57c5f9c0 5 AuthRegistry(0x7fff1a3a2c00) adding con mode: crc 2024-09-14T11:34:39.132 INFO:tasks.workunit.client.0.smithi138.stderr: -37> 2024-09-14T11:34:39.004+0000 7f7a57c5f9c0 5 AuthRegistry(0x7fff1a3a2c00) adding con mode: crc 2024-09-14T11:34:39.132 INFO:tasks.workunit.client.0.smithi138.stderr: -36> 2024-09-14T11:34:39.004+0000 7f7a57c5f9c0 5 AuthRegistry(0x7fff1a3a2c00) adding con mode: secure 2024-09-14T11:34:39.132 INFO:tasks.workunit.client.0.smithi138.stderr: -35> 2024-09-14T11:34:39.004+0000 7f790bfe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:34:39.132 INFO:tasks.workunit.client.0.smithi138.stderr: -34> 2024-09-14T11:34:39.004+0000 7f7a57c5f9c0 5 AuthRegistry(0x7fff1a3a2c00) adding con mode: crc 2024-09-14T11:34:39.132 INFO:tasks.workunit.client.0.smithi138.stderr: -33> 2024-09-14T11:34:39.004+0000 7f7a57c5f9c0 5 AuthRegistry(0x7fff1a3a2c00) adding con mode: secure 2024-09-14T11:34:39.132 INFO:tasks.workunit.client.0.smithi138.stderr: -32> 2024-09-14T11:34:39.004+0000 7f7a57c5f9c0 5 AuthRegistry(0x7fff1a3a2c00) adding con mode: crc 2024-09-14T11:34:39.132 INFO:tasks.workunit.client.0.smithi138.stderr: -31> 2024-09-14T11:34:39.004+0000 7f7a57c5f9c0 5 AuthRegistry(0x7fff1a3a2c00) adding con mode: secure 2024-09-14T11:34:39.132 INFO:tasks.workunit.client.0.smithi138.stderr: -30> 2024-09-14T11:34:39.004+0000 7f7a57c5f9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:34:39.132 INFO:tasks.workunit.client.0.smithi138.stderr: -29> 2024-09-14T11:34:39.004+0000 7f7a57c5f9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:34:39.132 INFO:tasks.workunit.client.0.smithi138.stderr: -28> 2024-09-14T11:34:39.004+0000 7f7a57c5f9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:34:39.132 INFO:tasks.workunit.client.0.smithi138.stderr: -27> 2024-09-14T11:34:39.004+0000 7f7a57c5f9c0 5 asok(0x562010106d90) register_command cache list hook 0x5620103d43d0 2024-09-14T11:34:39.133 INFO:tasks.workunit.client.0.smithi138.stderr: -26> 2024-09-14T11:34:39.004+0000 7f7a57c5f9c0 5 asok(0x562010106d90) register_command cache inspect hook 0x5620103d43d0 2024-09-14T11:34:39.133 INFO:tasks.workunit.client.0.smithi138.stderr: -25> 2024-09-14T11:34:39.004+0000 7f7a57c5f9c0 5 asok(0x562010106d90) register_command cache erase hook 0x5620103d43d0 2024-09-14T11:34:39.133 INFO:tasks.workunit.client.0.smithi138.stderr: -24> 2024-09-14T11:34:39.004+0000 7f7a57c5f9c0 5 asok(0x562010106d90) register_command cache zap hook 0x5620103d43d0 2024-09-14T11:34:39.133 INFO:tasks.workunit.client.0.smithi138.stderr: -23> 2024-09-14T11:34:39.004+0000 7f7a57c5f9c0 5 note: GC not initialized 2024-09-14T11:34:39.133 INFO:tasks.workunit.client.0.smithi138.stderr: -22> 2024-09-14T11:34:39.004+0000 7f790afe5640 20 reqs_thread_entry: start 2024-09-14T11:34:39.133 INFO:tasks.workunit.client.0.smithi138.stderr: -21> 2024-09-14T11:34:39.004+0000 7f7a57c5f9c0 5 asok(0x562010106d90) register_command sync trace show hook 0x7f7a48002530 2024-09-14T11:34:39.133 INFO:tasks.workunit.client.0.smithi138.stderr: -20> 2024-09-14T11:34:39.004+0000 7f7a57c5f9c0 5 asok(0x562010106d90) register_command sync trace history hook 0x7f7a48002530 2024-09-14T11:34:39.133 INFO:tasks.workunit.client.0.smithi138.stderr: -19> 2024-09-14T11:34:39.004+0000 7f7a57c5f9c0 5 asok(0x562010106d90) register_command sync trace active hook 0x7f7a48002530 2024-09-14T11:34:39.133 INFO:tasks.workunit.client.0.smithi138.stderr: -18> 2024-09-14T11:34:39.004+0000 7f7a57c5f9c0 5 asok(0x562010106d90) register_command sync trace active_short hook 0x7f7a48002530 2024-09-14T11:34:39.133 INFO:tasks.workunit.client.0.smithi138.stderr: -17> 2024-09-14T11:34:39.004+0000 7f7a57c5f9c0 20 init_complete bucket index max shards: 11 2024-09-14T11:34:39.133 INFO:tasks.workunit.client.0.smithi138.stderr: -16> 2024-09-14T11:34:39.004+0000 7f7a57c5f9c0 20 Filter name: none 2024-09-14T11:34:39.133 INFO:tasks.workunit.client.0.smithi138.stderr: -15> 2024-09-14T11:34:39.004+0000 7f7908fe1640 20 reqs_thread_entry: start 2024-09-14T11:34:39.133 INFO:tasks.workunit.client.0.smithi138.stderr: -14> 2024-09-14T11:34:39.004+0000 7f7a57c5f9c0 10 cache get: name=default.rgw.meta+root+abort-at-set-target-layout : miss 2024-09-14T11:34:39.133 INFO:tasks.workunit.client.0.smithi138.stderr: -13> 2024-09-14T11:34:39.004+0000 7f7a57c5f9c0 20 rados->read ofs=0 len=0 2024-09-14T11:34:39.134 INFO:tasks.workunit.client.0.smithi138.stderr: -12> 2024-09-14T11:34:39.008+0000 7f7a57c5f9c0 20 rados_obj.operate() r=0 bl.length=194 2024-09-14T11:34:39.134 INFO:tasks.workunit.client.0.smithi138.stderr: -11> 2024-09-14T11:34:39.008+0000 7f7a57c5f9c0 10 cache put: name=default.rgw.meta+root+abort-at-set-target-layout info.flags=0x11 2024-09-14T11:34:39.134 INFO:tasks.workunit.client.0.smithi138.stderr: -10> 2024-09-14T11:34:39.008+0000 7f7a57c5f9c0 10 adding default.rgw.meta+root+abort-at-set-target-layout to cache LRU end 2024-09-14T11:34:39.134 INFO:tasks.workunit.client.0.smithi138.stderr: -9> 2024-09-14T11:34:39.008+0000 7f7a57c5f9c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.24 : miss 2024-09-14T11:34:39.134 INFO:tasks.workunit.client.0.smithi138.stderr: -8> 2024-09-14T11:34:39.008+0000 7f7a57c5f9c0 20 rados->read ofs=0 len=0 2024-09-14T11:34:39.134 INFO:tasks.workunit.client.0.smithi138.stderr: -7> 2024-09-14T11:34:39.008+0000 7f7a57c5f9c0 20 rados_obj.operate() r=0 bl.length=416 2024-09-14T11:34:39.134 INFO:tasks.workunit.client.0.smithi138.stderr: -6> 2024-09-14T11:34:39.008+0000 7f7a57c5f9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.24 info.flags=0x17 2024-09-14T11:34:39.134 INFO:tasks.workunit.client.0.smithi138.stderr: -5> 2024-09-14T11:34:39.008+0000 7f7a57c5f9c0 10 adding default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.24 to cache LRU end 2024-09-14T11:34:39.134 INFO:tasks.workunit.client.0.smithi138.stderr: -4> 2024-09-14T11:34:39.008+0000 7f7a57c5f9c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:34:39.134 INFO:tasks.workunit.client.0.smithi138.stderr: -3> 2024-09-14T11:34:39.008+0000 7f7a57c5f9c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:34:39.134 INFO:tasks.workunit.client.0.smithi138.stderr: -2> 2024-09-14T11:34:39.008+0000 7f7a57c5f9c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.24 2024-09-14T11:34:39.134 INFO:tasks.workunit.client.0.smithi138.stderr: -1> 2024-09-14T11:34:39.016+0000 7f7a57c5f9c0 -1 ./src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f7a57c5f9c0 time 2024-09-14T11:34:39.019185+0000 2024-09-14T11:34:39.134 INFO:tasks.workunit.client.0.smithi138.stderr:./src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-14T11:34:39.134 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-14T11:34:39.135 INFO:tasks.workunit.client.0.smithi138.stderr: ceph version 19.3.0-4907-ga2782315 (a2782315255a3e7d5f6cdc9eb35785187ff6ddf8) squid (dev) 2024-09-14T11:34:39.135 INFO:tasks.workunit.client.0.smithi138.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x121) [0x7f7a5b5392eb] 2024-09-14T11:34:39.135 INFO:tasks.workunit.client.0.smithi138.stderr: 2: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7f7a5b53949f] 2024-09-14T11:34:39.135 INFO:tasks.workunit.client.0.smithi138.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x56200d1bfc01] 2024-09-14T11:34:39.135 INFO:tasks.workunit.client.0.smithi138.stderr: 4: radosgw-admin(+0x1422828) [0x56200dc1d828] 2024-09-14T11:34:39.135 INFO:tasks.workunit.client.0.smithi138.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x56200d1d4ecd] 2024-09-14T11:34:39.135 INFO:tasks.workunit.client.0.smithi138.stderr: 6: main() 2024-09-14T11:34:39.135 INFO:tasks.workunit.client.0.smithi138.stderr: 7: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7f7a5a39fd90] 2024-09-14T11:34:39.135 INFO:tasks.workunit.client.0.smithi138.stderr: 8: __libc_start_main() 2024-09-14T11:34:39.135 INFO:tasks.workunit.client.0.smithi138.stderr: 9: _start() 2024-09-14T11:34:39.135 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-14T11:34:39.135 INFO:tasks.workunit.client.0.smithi138.stderr: 0> 2024-09-14T11:34:39.020+0000 7f7a57c5f9c0 -1 *** Caught signal (Aborted) ** 2024-09-14T11:34:39.135 INFO:tasks.workunit.client.0.smithi138.stderr: in thread 7f7a57c5f9c0 thread_name:radosgw-admin 2024-09-14T11:34:39.135 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-14T11:34:39.135 INFO:tasks.workunit.client.0.smithi138.stderr: ceph version 19.3.0-4907-ga2782315 (a2782315255a3e7d5f6cdc9eb35785187ff6ddf8) squid (dev) 2024-09-14T11:34:39.136 INFO:tasks.workunit.client.0.smithi138.stderr: 1: /lib/x86_64-linux-gnu/libc.so.6(+0x42520) [0x7f7a5a3b8520] 2024-09-14T11:34:39.136 INFO:tasks.workunit.client.0.smithi138.stderr: 2: pthread_kill() 2024-09-14T11:34:39.136 INFO:tasks.workunit.client.0.smithi138.stderr: 3: raise() 2024-09-14T11:34:39.136 INFO:tasks.workunit.client.0.smithi138.stderr: 4: abort() 2024-09-14T11:34:39.136 INFO:tasks.workunit.client.0.smithi138.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x17b) [0x7f7a5b539345] 2024-09-14T11:34:39.136 INFO:tasks.workunit.client.0.smithi138.stderr: 6: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7f7a5b53949f] 2024-09-14T11:34:39.136 INFO:tasks.workunit.client.0.smithi138.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x56200d1bfc01] 2024-09-14T11:34:39.136 INFO:tasks.workunit.client.0.smithi138.stderr: 8: radosgw-admin(+0x1422828) [0x56200dc1d828] 2024-09-14T11:34:39.136 INFO:tasks.workunit.client.0.smithi138.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x56200d1d4ecd] 2024-09-14T11:34:39.136 INFO:tasks.workunit.client.0.smithi138.stderr: 10: main() 2024-09-14T11:34:39.136 INFO:tasks.workunit.client.0.smithi138.stderr: 11: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7f7a5a39fd90] 2024-09-14T11:34:39.136 INFO:tasks.workunit.client.0.smithi138.stderr: 12: __libc_start_main() 2024-09-14T11:34:39.136 INFO:tasks.workunit.client.0.smithi138.stderr: 13: _start() 2024-09-14T11:34:39.136 INFO:tasks.workunit.client.0.smithi138.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-14T11:34:39.137 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-14T11:34:39.137 INFO:tasks.workunit.client.0.smithi138.stderr:--- logging levels --- 2024-09-14T11:34:39.137 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 none 2024-09-14T11:34:39.137 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 1 lockdep 2024-09-14T11:34:39.137 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 1 context 2024-09-14T11:34:39.137 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 1 crush 2024-09-14T11:34:39.137 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 mds 2024-09-14T11:34:39.137 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 mds_balancer 2024-09-14T11:34:39.137 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 mds_locker 2024-09-14T11:34:39.137 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 mds_log 2024-09-14T11:34:39.137 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 mds_log_expire 2024-09-14T11:34:39.137 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 mds_migrator 2024-09-14T11:34:39.137 INFO:tasks.workunit.client.0.smithi138.stderr: 3/ 5 mds_quiesce 2024-09-14T11:34:39.137 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 1 buffer 2024-09-14T11:34:39.138 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 1 timer 2024-09-14T11:34:39.138 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 1 filer 2024-09-14T11:34:39.138 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 1 striper 2024-09-14T11:34:39.138 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 1 objecter 2024-09-14T11:34:39.138 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 rados 2024-09-14T11:34:39.138 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 rbd 2024-09-14T11:34:39.138 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 rbd_mirror 2024-09-14T11:34:39.138 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 rbd_replay 2024-09-14T11:34:39.138 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 rbd_pwl 2024-09-14T11:34:39.138 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 journaler 2024-09-14T11:34:39.138 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 objectcacher 2024-09-14T11:34:39.138 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 immutable_obj_cache 2024-09-14T11:34:39.138 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 client 2024-09-14T11:34:39.138 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 osd 2024-09-14T11:34:39.139 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 optracker 2024-09-14T11:34:39.139 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 objclass 2024-09-14T11:34:39.139 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 3 filestore 2024-09-14T11:34:39.139 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 3 journal 2024-09-14T11:34:39.139 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 0 ms 2024-09-14T11:34:39.139 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 mon 2024-09-14T11:34:39.139 INFO:tasks.workunit.client.0.smithi138.stderr: 0/10 monc 2024-09-14T11:34:39.139 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 paxos 2024-09-14T11:34:39.139 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 tp 2024-09-14T11:34:39.139 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 auth 2024-09-14T11:34:39.139 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 crypto 2024-09-14T11:34:39.139 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 1 finisher 2024-09-14T11:34:39.139 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 1 reserver 2024-09-14T11:34:39.139 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 heartbeatmap 2024-09-14T11:34:39.139 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 perfcounter 2024-09-14T11:34:39.140 INFO:tasks.workunit.client.0.smithi138.stderr: 20/20 rgw 2024-09-14T11:34:39.140 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 rgw_sync 2024-09-14T11:34:39.140 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 rgw_datacache 2024-09-14T11:34:39.140 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 rgw_access 2024-09-14T11:34:39.140 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 rgw_dbstore 2024-09-14T11:34:39.140 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 rgw_flight 2024-09-14T11:34:39.140 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 rgw_lifecycle 2024-09-14T11:34:39.140 INFO:tasks.workunit.client.0.smithi138.stderr: 20/20 rgw_notification 2024-09-14T11:34:39.140 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 javaclient 2024-09-14T11:34:39.140 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 asok 2024-09-14T11:34:39.140 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 1 throttle 2024-09-14T11:34:39.140 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 0 refs 2024-09-14T11:34:39.140 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 compressor 2024-09-14T11:34:39.140 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 bluestore 2024-09-14T11:34:39.141 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 bluefs 2024-09-14T11:34:39.141 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 3 bdev 2024-09-14T11:34:39.141 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 kstore 2024-09-14T11:34:39.141 INFO:tasks.workunit.client.0.smithi138.stderr: 4/ 5 rocksdb 2024-09-14T11:34:39.141 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 fuse 2024-09-14T11:34:39.141 INFO:tasks.workunit.client.0.smithi138.stderr: 2/ 5 mgr 2024-09-14T11:34:39.141 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 mgrc 2024-09-14T11:34:39.141 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 dpdk 2024-09-14T11:34:39.141 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 eventtrace 2024-09-14T11:34:39.141 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 prioritycache 2024-09-14T11:34:39.141 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 test 2024-09-14T11:34:39.141 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 cephfs_mirror 2024-09-14T11:34:39.141 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 cephsqlite 2024-09-14T11:34:39.141 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 crimson_interrupt 2024-09-14T11:34:39.142 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 seastore 2024-09-14T11:34:39.142 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 seastore_onode 2024-09-14T11:34:39.142 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 seastore_odata 2024-09-14T11:34:39.142 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 seastore_omap 2024-09-14T11:34:39.142 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 seastore_tm 2024-09-14T11:34:39.142 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 seastore_t 2024-09-14T11:34:39.142 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 seastore_cleaner 2024-09-14T11:34:39.142 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 seastore_epm 2024-09-14T11:34:39.142 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 seastore_lba 2024-09-14T11:34:39.142 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 seastore_fixedkv_tree 2024-09-14T11:34:39.142 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 seastore_cache 2024-09-14T11:34:39.142 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 seastore_journal 2024-09-14T11:34:39.142 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 seastore_device 2024-09-14T11:34:39.142 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 seastore_backref 2024-09-14T11:34:39.142 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 alienstore 2024-09-14T11:34:39.142 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 mclock 2024-09-14T11:34:39.143 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 cyanstore 2024-09-14T11:34:39.143 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 ceph_exporter 2024-09-14T11:34:39.143 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 memstore 2024-09-14T11:34:39.143 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 trace 2024-09-14T11:34:39.143 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 ceph_dedup 2024-09-14T11:34:39.143 INFO:tasks.workunit.client.0.smithi138.stderr: -2/-2 (syslog threshold) 2024-09-14T11:34:39.143 INFO:tasks.workunit.client.0.smithi138.stderr: 99/99 (stderr threshold) 2024-09-14T11:34:39.143 INFO:tasks.workunit.client.0.smithi138.stderr:--- pthread ID / name mapping for recent threads --- 2024-09-14T11:34:39.143 INFO:tasks.workunit.client.0.smithi138.stderr: 7f7908fe1640 / http_manager 2024-09-14T11:34:39.143 INFO:tasks.workunit.client.0.smithi138.stderr: 7f790afe5640 / http_manager 2024-09-14T11:34:39.143 INFO:tasks.workunit.client.0.smithi138.stderr: 7f790bfe7640 / rgw_dt_lg_renew 2024-09-14T11:34:39.143 INFO:tasks.workunit.client.0.smithi138.stderr: 7f7926ffd640 / ms_dispatch 2024-09-14T11:34:39.143 INFO:tasks.workunit.client.0.smithi138.stderr: 7f7938ff9640 / io_context_pool 2024-09-14T11:34:39.143 INFO:tasks.workunit.client.0.smithi138.stderr: 7f793affd640 / ms_dispatch 2024-09-14T11:34:39.143 INFO:tasks.workunit.client.0.smithi138.stderr: 7f7941e03640 / ms_dispatch 2024-09-14T11:34:39.143 INFO:tasks.workunit.client.0.smithi138.stderr: 7f7943606640 / io_context_pool 2024-09-14T11:34:39.144 INFO:tasks.workunit.client.0.smithi138.stderr: 7f7a54f64640 / msgr-worker-2 2024-09-14T11:34:39.144 INFO:tasks.workunit.client.0.smithi138.stderr: 7f7a55765640 / msgr-worker-1 2024-09-14T11:34:39.144 INFO:tasks.workunit.client.0.smithi138.stderr: 7f7a55f66640 / msgr-worker-0 2024-09-14T11:34:39.144 INFO:tasks.workunit.client.0.smithi138.stderr: 7f7a56767640 / io_context_pool 2024-09-14T11:34:39.144 INFO:tasks.workunit.client.0.smithi138.stderr: 7f7a57c5f9c0 / radosgw-admin 2024-09-14T11:34:39.144 INFO:tasks.workunit.client.0.smithi138.stderr: max_recent 500 2024-09-14T11:34:39.144 INFO:tasks.workunit.client.0.smithi138.stderr: max_new 1000 2024-09-14T11:34:39.144 INFO:tasks.workunit.client.0.smithi138.stderr: log_file /var/lib/ceph/crash/2024-09-14T11:34:39.021669Z_4c3236ed-df99-4444-aad5-5809a1c9bc90/log 2024-09-14T11:34:39.144 INFO:tasks.workunit.client.0.smithi138.stderr:--- end dump of recent events --- 2024-09-14T11:34:39.144 INFO:tasks.workunit.client.0.smithi138.stderr:Aborted 2024-09-14T11:34:39.144 INFO:tasks.workunit.client.0.smithi138.stderr:radosgw-admin bucket stats --bucket abort-at-set-target-layout 2024-09-14T11:34:39.146 INFO:tasks.workunit.client.0.smithi138.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:34:39.146 INFO:tasks.workunit.client.0.smithi138.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:34:39.146 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:39.100+0000 7f60d148f9c0 20 rados->read ofs=0 len=0 2024-09-14T11:34:39.146 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:39.104+0000 7f60d148f9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:34:39.146 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:39.104+0000 7f60d148f9c0 20 realm 2024-09-14T11:34:39.146 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:39.104+0000 7f60d148f9c0 20 rados->read ofs=0 len=0 2024-09-14T11:34:39.146 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:39.104+0000 7f60d148f9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:34:39.146 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:39.104+0000 7f60d148f9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:34:39.146 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:39.104+0000 7f60d148f9c0 20 rados->read ofs=0 len=0 2024-09-14T11:34:39.146 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:39.104+0000 7f60d148f9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:34:39.146 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:39.104+0000 7f60d148f9c0 20 rados->read ofs=0 len=0 2024-09-14T11:34:39.146 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:39.104+0000 7f60d148f9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:34:39.146 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:39.104+0000 7f60d148f9c0 20 rados->read ofs=0 len=0 2024-09-14T11:34:39.147 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:39.108+0000 7f60d148f9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:34:39.147 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:39.108+0000 7f60d148f9c0 20 searching for the correct realm 2024-09-14T11:34:39.147 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:39.112+0000 7f60cf796640 0 -- 172.21.15.138:0/1587119383 >> [v2:172.21.15.154:6824/416768175,v1:172.21.15.154:6825/416768175] conn(0x7f60c007e020 msgr2=0x7f60c008bb20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:34:39.147 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:39.120+0000 7f60ce794640 0 -- 172.21.15.138:0/1587119383 >> [v2:172.21.15.138:6816/326481658,v1:172.21.15.138:6817/326481658] conn(0x7f60c0056c50 msgr2=0x7f60c0052f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-14T11:34:39.334 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:39.340+0000 7f60d148f9c0 20 RGWRados::pool_iterate: got zone_info.d9e72d30-c60b-4d0d-9267-fdc36392d5ad 2024-09-14T11:34:39.335 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:39.340+0000 7f60d148f9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:34:39.335 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:39.340+0000 7f60d148f9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:34:39.335 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:39.340+0000 7f60d148f9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:34:39.335 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:39.340+0000 7f60d148f9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:34:39.335 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:39.340+0000 7f60d148f9c0 20 RGWRados::pool_iterate: got zonegroup_info.65ab941b-da8c-4160-94fb-3672b069d44f 2024-09-14T11:34:39.335 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:39.340+0000 7f60d148f9c0 20 rados->read ofs=0 len=0 2024-09-14T11:34:39.335 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:39.340+0000 7f60d148f9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:34:39.335 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:39.340+0000 7f60d148f9c0 20 rados->read ofs=0 len=0 2024-09-14T11:34:39.336 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:39.340+0000 7f60d148f9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:34:39.336 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:39.340+0000 7f60d148f9c0 20 rados->read ofs=0 len=0 2024-09-14T11:34:39.337 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:39.340+0000 7f60d148f9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:34:39.338 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:39.340+0000 7f60d148f9c0 20 zone default found 2024-09-14T11:34:39.338 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:39.340+0000 7f60d148f9c0 4 Realm: () 2024-09-14T11:34:39.338 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:39.340+0000 7f60d148f9c0 4 ZoneGroup: default (65ab941b-da8c-4160-94fb-3672b069d44f) 2024-09-14T11:34:39.338 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:39.340+0000 7f60d148f9c0 4 Zone: default (d9e72d30-c60b-4d0d-9267-fdc36392d5ad) 2024-09-14T11:34:39.338 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:39.340+0000 7f60d148f9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:34:39.338 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:39.340+0000 7f60d148f9c0 20 zonegroup default 2024-09-14T11:34:39.338 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:39.340+0000 7f60d148f9c0 20 rados->read ofs=0 len=0 2024-09-14T11:34:39.338 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:39.340+0000 7f60d148f9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:34:39.338 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:39.340+0000 7f60d148f9c0 20 rados->read ofs=0 len=0 2024-09-14T11:34:39.339 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:39.344+0000 7f60d148f9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:34:39.339 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:39.344+0000 7f60d148f9c0 20 rados->read ofs=0 len=0 2024-09-14T11:34:39.340 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:39.344+0000 7f60d148f9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:34:39.340 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:39.344+0000 7f60d148f9c0 20 started sync module instance, tier type = 2024-09-14T11:34:39.340 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:39.344+0000 7f60d148f9c0 20 started zone id=d9e72d30-c60b-4d0d-9267-fdc36392d5ad (name=default) with tier type = 2024-09-14T11:34:39.364 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:39.368+0000 7f60d148f9c0 20 add_watcher() i=0 2024-09-14T11:34:39.364 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:39.368+0000 7f60d148f9c0 20 add_watcher() i=1 2024-09-14T11:34:39.364 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:39.368+0000 7f60d148f9c0 20 add_watcher() i=2 2024-09-14T11:34:39.365 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:39.368+0000 7f60d148f9c0 20 add_watcher() i=3 2024-09-14T11:34:39.365 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:39.368+0000 7f60d148f9c0 20 add_watcher() i=4 2024-09-14T11:34:39.365 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:39.368+0000 7f60d148f9c0 20 add_watcher() i=5 2024-09-14T11:34:39.365 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:39.368+0000 7f60d148f9c0 20 add_watcher() i=6 2024-09-14T11:34:39.366 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:39.372+0000 7f60d148f9c0 20 add_watcher() i=7 2024-09-14T11:34:39.367 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:39.372+0000 7f60d148f9c0 2 all 8 watchers are set, enabling cache 2024-09-14T11:34:39.370 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:39.376+0000 7f5f857e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:34:39.371 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:39.376+0000 7f60d148f9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:34:39.371 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:39.376+0000 7f60d148f9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:34:39.372 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:39.376+0000 7f60d148f9c0 5 note: GC not initialized 2024-09-14T11:34:39.372 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:39.376+0000 7f5efffff640 20 reqs_thread_entry: start 2024-09-14T11:34:39.372 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:39.376+0000 7f60d148f9c0 20 init_complete bucket index max shards: 11 2024-09-14T11:34:39.372 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:39.376+0000 7f60d148f9c0 20 Filter name: none 2024-09-14T11:34:39.373 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:39.376+0000 7f5efdffb640 20 reqs_thread_entry: start 2024-09-14T11:34:39.373 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:39.376+0000 7f60d148f9c0 20 rados->read ofs=0 len=0 2024-09-14T11:34:39.374 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:39.376+0000 7f60d148f9c0 20 rados_obj.operate() r=0 bl.length=194 2024-09-14T11:34:39.374 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:39.376+0000 7f60d148f9c0 20 rados->read ofs=0 len=0 2024-09-14T11:34:39.375 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:39.380+0000 7f60d148f9c0 20 rados_obj.operate() r=0 bl.length=416 2024-09-14T11:34:39.375 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:39.380+0000 7f60d148f9c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:34:39.375 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:39.380+0000 7f60d148f9c0 20 rados->read ofs=0 len=0 2024-09-14T11:34:39.376 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:39.380+0000 7f60d148f9c0 20 rados_obj.operate() r=0 bl.length=194 2024-09-14T11:34:39.376 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:39.380+0000 7f60d148f9c0 20 rados->read ofs=0 len=0 2024-09-14T11:34:39.377 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:39.380+0000 7f60d148f9c0 20 rados_obj.operate() r=0 bl.length=416 2024-09-14T11:34:39.377 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:39.380+0000 7f60d148f9c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:34:39.380 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:39.384+0000 7f5f857e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:34:39.386 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:39.392+0000 7f60d148f9c0 20 remove_watcher() i=0 2024-09-14T11:34:39.386 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:39.392+0000 7f60d148f9c0 2 removed watcher, disabling cache 2024-09-14T11:34:39.388 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:39.392+0000 7f60d148f9c0 20 remove_watcher() i=1 2024-09-14T11:34:39.390 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:39.396+0000 7f60d148f9c0 20 remove_watcher() i=2 2024-09-14T11:34:39.392 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:39.396+0000 7f60d148f9c0 20 remove_watcher() i=3 2024-09-14T11:34:39.394 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:39.400+0000 7f60d148f9c0 20 remove_watcher() i=4 2024-09-14T11:34:39.397 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:39.400+0000 7f60d148f9c0 20 remove_watcher() i=5 2024-09-14T11:34:39.398 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:39.400+0000 7f60d148f9c0 20 remove_watcher() i=6 2024-09-14T11:34:39.399 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:39.404+0000 7f60d148f9c0 20 remove_watcher() i=7 2024-09-14T11:34:39.414 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-14T11:34:39.414 INFO:tasks.workunit.client.0.smithi138.stderr:BUCKET_STATS: 2024-09-14T11:34:39.414 INFO:tasks.workunit.client.0.smithi138.stderr:bucket: abort-at-set-target-layout id: d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.24 num_objects: 20 size_kb: 1 num_shards: 11 2024-09-14T11:34:39.414 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-14T11:34:39.415 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:34:39.415 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-14T11:34:39.452 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:34:39.452 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-14T11:34:39.512 INFO:tasks.workunit.client.0.smithi138.stderr:radosgw-admin bucket reshard --bucket abort-at-set-target-layout --num-shards 12 --rgw-reshard-bucket-lock-duration 30 2024-09-14T11:34:39.547 INFO:tasks.workunit.client.0.smithi138.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:34:39.547 INFO:tasks.workunit.client.0.smithi138.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:34:39.590 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:39.596+0000 7ff18cce69c0 20 rados->read ofs=0 len=0 2024-09-14T11:34:39.592 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:39.596+0000 7ff18cce69c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:34:39.592 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:39.596+0000 7ff18cce69c0 20 realm 2024-09-14T11:34:39.592 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:39.596+0000 7ff18cce69c0 20 rados->read ofs=0 len=0 2024-09-14T11:34:39.592 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:39.596+0000 7ff18cce69c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:34:39.592 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:39.596+0000 7ff18cce69c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:34:39.593 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:39.596+0000 7ff18cce69c0 20 rados->read ofs=0 len=0 2024-09-14T11:34:39.593 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:39.596+0000 7ff18cce69c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:34:39.593 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:39.596+0000 7ff18cce69c0 20 rados->read ofs=0 len=0 2024-09-14T11:34:39.594 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:39.596+0000 7ff18cce69c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:34:39.594 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:39.596+0000 7ff18cce69c0 20 rados->read ofs=0 len=0 2024-09-14T11:34:39.595 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:39.600+0000 7ff18cce69c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:34:39.595 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:39.600+0000 7ff18cce69c0 20 searching for the correct realm 2024-09-14T11:34:39.599 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:39.604+0000 7ff18afed640 0 -- 172.21.15.138:0/962171835 >> [v2:172.21.15.154:6824/416768175,v1:172.21.15.154:6825/416768175] conn(0x7ff184018040 msgr2=0x7ff1840353f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:34:39.605 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:39.608+0000 7ff189feb640 0 -- 172.21.15.138:0/962171835 >> [v2:172.21.15.138:6816/326481658,v1:172.21.15.138:6817/326481658] conn(0x7ff18404a400 msgr2=0x7ff18404a880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-14T11:34:39.822 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:39.824+0000 7ff18cce69c0 20 RGWRados::pool_iterate: got zone_info.d9e72d30-c60b-4d0d-9267-fdc36392d5ad 2024-09-14T11:34:39.822 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:39.824+0000 7ff18cce69c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:34:39.822 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:39.824+0000 7ff18cce69c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:34:39.822 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:39.824+0000 7ff18cce69c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:34:39.822 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:39.824+0000 7ff18cce69c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:34:39.822 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:39.824+0000 7ff18cce69c0 20 RGWRados::pool_iterate: got zonegroup_info.65ab941b-da8c-4160-94fb-3672b069d44f 2024-09-14T11:34:39.822 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:39.824+0000 7ff18cce69c0 20 rados->read ofs=0 len=0 2024-09-14T11:34:39.823 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:39.828+0000 7ff18cce69c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:34:39.823 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:39.828+0000 7ff18cce69c0 20 rados->read ofs=0 len=0 2024-09-14T11:34:39.823 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:39.828+0000 7ff18cce69c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:34:39.823 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:39.828+0000 7ff18cce69c0 20 rados->read ofs=0 len=0 2024-09-14T11:34:39.824 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:39.828+0000 7ff18cce69c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:34:39.825 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:39.828+0000 7ff18cce69c0 20 zone default found 2024-09-14T11:34:39.825 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:39.828+0000 7ff18cce69c0 4 Realm: () 2024-09-14T11:34:39.825 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:39.828+0000 7ff18cce69c0 4 ZoneGroup: default (65ab941b-da8c-4160-94fb-3672b069d44f) 2024-09-14T11:34:39.825 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:39.828+0000 7ff18cce69c0 4 Zone: default (d9e72d30-c60b-4d0d-9267-fdc36392d5ad) 2024-09-14T11:34:39.825 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:39.828+0000 7ff18cce69c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:34:39.825 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:39.828+0000 7ff18cce69c0 20 zonegroup default 2024-09-14T11:34:39.825 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:39.828+0000 7ff18cce69c0 20 rados->read ofs=0 len=0 2024-09-14T11:34:39.825 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:39.828+0000 7ff18cce69c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:34:39.825 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:39.828+0000 7ff18cce69c0 20 rados->read ofs=0 len=0 2024-09-14T11:34:39.826 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:39.828+0000 7ff18cce69c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:34:39.826 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:39.828+0000 7ff18cce69c0 20 rados->read ofs=0 len=0 2024-09-14T11:34:39.826 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:39.832+0000 7ff18cce69c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:34:39.827 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:39.832+0000 7ff18cce69c0 20 started sync module instance, tier type = 2024-09-14T11:34:39.827 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:39.832+0000 7ff18cce69c0 20 started zone id=d9e72d30-c60b-4d0d-9267-fdc36392d5ad (name=default) with tier type = 2024-09-14T11:34:39.849 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:39.852+0000 7ff18cce69c0 20 add_watcher() i=0 2024-09-14T11:34:39.849 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:39.852+0000 7ff18cce69c0 20 add_watcher() i=1 2024-09-14T11:34:39.849 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:39.852+0000 7ff18cce69c0 20 add_watcher() i=2 2024-09-14T11:34:39.849 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:39.852+0000 7ff18cce69c0 20 add_watcher() i=3 2024-09-14T11:34:39.849 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:39.852+0000 7ff18cce69c0 20 add_watcher() i=4 2024-09-14T11:34:39.849 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:39.852+0000 7ff18cce69c0 20 add_watcher() i=5 2024-09-14T11:34:39.849 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:39.852+0000 7ff18cce69c0 20 add_watcher() i=6 2024-09-14T11:34:39.852 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:39.856+0000 7ff18cce69c0 20 add_watcher() i=7 2024-09-14T11:34:39.852 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:39.856+0000 7ff18cce69c0 2 all 8 watchers are set, enabling cache 2024-09-14T11:34:39.855 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:39.860+0000 7ff040fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:34:39.856 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:39.860+0000 7ff18cce69c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:34:39.856 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:39.860+0000 7ff18cce69c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:34:39.856 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:39.860+0000 7ff18cce69c0 5 note: GC not initialized 2024-09-14T11:34:39.857 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:39.860+0000 7fefbb7fe640 20 reqs_thread_entry: start 2024-09-14T11:34:39.857 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:39.860+0000 7ff18cce69c0 20 init_complete bucket index max shards: 11 2024-09-14T11:34:39.857 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:39.860+0000 7ff18cce69c0 20 Filter name: none 2024-09-14T11:34:39.857 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:39.860+0000 7fefb97fa640 20 reqs_thread_entry: start 2024-09-14T11:34:39.857 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:39.860+0000 7ff18cce69c0 10 cache get: name=default.rgw.meta+root+abort-at-set-target-layout : miss 2024-09-14T11:34:39.857 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:39.860+0000 7ff18cce69c0 20 rados->read ofs=0 len=0 2024-09-14T11:34:39.858 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:39.860+0000 7ff18cce69c0 20 rados_obj.operate() r=0 bl.length=194 2024-09-14T11:34:39.858 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:39.860+0000 7ff18cce69c0 10 cache put: name=default.rgw.meta+root+abort-at-set-target-layout info.flags=0x11 2024-09-14T11:34:39.858 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:39.860+0000 7ff18cce69c0 10 adding default.rgw.meta+root+abort-at-set-target-layout to cache LRU end 2024-09-14T11:34:39.858 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:39.860+0000 7ff18cce69c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.24 : miss 2024-09-14T11:34:39.858 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:39.860+0000 7ff18cce69c0 20 rados->read ofs=0 len=0 2024-09-14T11:34:39.859 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:39.864+0000 7ff18cce69c0 20 rados_obj.operate() r=0 bl.length=416 2024-09-14T11:34:39.859 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:39.864+0000 7ff18cce69c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.24 info.flags=0x17 2024-09-14T11:34:39.859 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:39.864+0000 7ff18cce69c0 10 adding default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.24 to cache LRU end 2024-09-14T11:34:39.859 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:39.864+0000 7ff18cce69c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:34:39.859 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:39.864+0000 7ff18cce69c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:34:39.859 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:39.864+0000 7ff18cce69c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.24 2024-09-14T11:34:39.862 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:39.864+0000 7ff18cce69c0 0 INFO: RGWReshardLock::lock found lock on abort-at-set-target-layout:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.24 to be held by another RGW process; skipping for now 2024-09-14T11:34:39.863 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:39.868+0000 7ff040fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:34:39.869 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:39.872+0000 7ff18cce69c0 20 remove_watcher() i=0 2024-09-14T11:34:39.869 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:39.872+0000 7ff18cce69c0 2 removed watcher, disabling cache 2024-09-14T11:34:39.872 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:39.876+0000 7ff18cce69c0 20 remove_watcher() i=1 2024-09-14T11:34:39.873 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:39.876+0000 7ff18cce69c0 20 remove_watcher() i=2 2024-09-14T11:34:39.875 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:39.880+0000 7ff18cce69c0 20 remove_watcher() i=3 2024-09-14T11:34:39.877 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:39.880+0000 7ff18cce69c0 20 remove_watcher() i=4 2024-09-14T11:34:39.878 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:39.884+0000 7ff18cce69c0 20 remove_watcher() i=5 2024-09-14T11:34:39.880 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:39.884+0000 7ff18cce69c0 20 remove_watcher() i=6 2024-09-14T11:34:39.881 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:34:39.884+0000 7ff18cce69c0 20 remove_watcher() i=7 2024-09-14T11:34:39.897 INFO:tasks.workunit.client.0.smithi138.stderr:waiting 30 seconds for reshard lock to expire... 2024-09-14T11:35:09.907 INFO:tasks.workunit.client.0.smithi138.stderr:radosgw-admin bucket reshard --bucket abort-at-set-target-layout --num-shards 12 --rgw-reshard-bucket-lock-duration 30 2024-09-14T11:35:09.944 INFO:tasks.workunit.client.0.smithi138.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:35:09.944 INFO:tasks.workunit.client.0.smithi138.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:35:09.989 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:09.992+0000 7fab5eb029c0 20 rados->read ofs=0 len=0 2024-09-14T11:35:09.991 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:09.996+0000 7fab5eb029c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:35:09.992 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:09.996+0000 7fab5eb029c0 20 realm 2024-09-14T11:35:09.992 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:09.996+0000 7fab5eb029c0 20 rados->read ofs=0 len=0 2024-09-14T11:35:09.992 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:09.996+0000 7fab5eb029c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:35:09.992 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:09.996+0000 7fab5eb029c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:35:09.992 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:09.996+0000 7fab5eb029c0 20 rados->read ofs=0 len=0 2024-09-14T11:35:09.992 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:09.996+0000 7fab5eb029c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:35:09.992 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:09.996+0000 7fab5eb029c0 20 rados->read ofs=0 len=0 2024-09-14T11:35:09.993 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:09.996+0000 7fab5eb029c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:35:09.993 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:09.996+0000 7fab5eb029c0 20 rados->read ofs=0 len=0 2024-09-14T11:35:09.994 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:09.996+0000 7fab5eb029c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:35:09.994 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:09.996+0000 7fab5eb029c0 20 searching for the correct realm 2024-09-14T11:35:09.997 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:10.000+0000 7fab5ce09640 0 -- 172.21.15.138:0/4226603718 >> [v2:172.21.15.154:6824/416768175,v1:172.21.15.154:6825/416768175] conn(0x7fab54018040 msgr2=0x7fab54061ce0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:35:10.004 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:10.008+0000 7fab53fff640 0 -- 172.21.15.138:0/4226603718 >> [v2:172.21.15.138:6816/326481658,v1:172.21.15.138:6817/326481658] conn(0x7fab54001800 msgr2=0x7fab540613e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-14T11:35:10.222 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:10.224+0000 7fab5eb029c0 20 RGWRados::pool_iterate: got zone_info.d9e72d30-c60b-4d0d-9267-fdc36392d5ad 2024-09-14T11:35:10.222 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:10.224+0000 7fab5eb029c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:35:10.222 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:10.224+0000 7fab5eb029c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:35:10.222 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:10.224+0000 7fab5eb029c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:35:10.222 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:10.224+0000 7fab5eb029c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:35:10.222 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:10.224+0000 7fab5eb029c0 20 RGWRados::pool_iterate: got zonegroup_info.65ab941b-da8c-4160-94fb-3672b069d44f 2024-09-14T11:35:10.222 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:10.224+0000 7fab5eb029c0 20 rados->read ofs=0 len=0 2024-09-14T11:35:10.223 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:10.224+0000 7fab5eb029c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:35:10.223 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:10.224+0000 7fab5eb029c0 20 rados->read ofs=0 len=0 2024-09-14T11:35:10.223 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:10.228+0000 7fab5eb029c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:35:10.223 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:10.228+0000 7fab5eb029c0 20 rados->read ofs=0 len=0 2024-09-14T11:35:10.224 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:10.228+0000 7fab5eb029c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:35:10.224 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:10.228+0000 7fab5eb029c0 20 zone default found 2024-09-14T11:35:10.224 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:10.228+0000 7fab5eb029c0 4 Realm: () 2024-09-14T11:35:10.224 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:10.228+0000 7fab5eb029c0 4 ZoneGroup: default (65ab941b-da8c-4160-94fb-3672b069d44f) 2024-09-14T11:35:10.225 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:10.228+0000 7fab5eb029c0 4 Zone: default (d9e72d30-c60b-4d0d-9267-fdc36392d5ad) 2024-09-14T11:35:10.225 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:10.228+0000 7fab5eb029c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:35:10.225 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:10.228+0000 7fab5eb029c0 20 zonegroup default 2024-09-14T11:35:10.225 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:10.228+0000 7fab5eb029c0 20 rados->read ofs=0 len=0 2024-09-14T11:35:10.225 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:10.228+0000 7fab5eb029c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:35:10.225 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:10.228+0000 7fab5eb029c0 20 rados->read ofs=0 len=0 2024-09-14T11:35:10.226 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:10.228+0000 7fab5eb029c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:35:10.226 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:10.228+0000 7fab5eb029c0 20 rados->read ofs=0 len=0 2024-09-14T11:35:10.227 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:10.232+0000 7fab5eb029c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:35:10.227 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:10.232+0000 7fab5eb029c0 20 started sync module instance, tier type = 2024-09-14T11:35:10.227 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:10.232+0000 7fab5eb029c0 20 started zone id=d9e72d30-c60b-4d0d-9267-fdc36392d5ad (name=default) with tier type = 2024-09-14T11:35:10.250 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:10.252+0000 7fab5eb029c0 20 add_watcher() i=0 2024-09-14T11:35:10.250 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:10.252+0000 7fab5eb029c0 20 add_watcher() i=1 2024-09-14T11:35:10.250 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:10.252+0000 7fab5eb029c0 20 add_watcher() i=2 2024-09-14T11:35:10.250 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:10.252+0000 7fab5eb029c0 20 add_watcher() i=3 2024-09-14T11:35:10.250 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:10.252+0000 7fab5eb029c0 20 add_watcher() i=4 2024-09-14T11:35:10.250 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:10.252+0000 7fab5eb029c0 20 add_watcher() i=5 2024-09-14T11:35:10.250 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:10.252+0000 7fab5eb029c0 20 add_watcher() i=6 2024-09-14T11:35:10.253 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:10.256+0000 7fab5eb029c0 20 add_watcher() i=7 2024-09-14T11:35:10.253 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:10.256+0000 7fab5eb029c0 2 all 8 watchers are set, enabling cache 2024-09-14T11:35:10.257 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:10.260+0000 7faa12fdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:35:10.258 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:10.260+0000 7fab5eb029c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:35:10.258 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:10.260+0000 7fab5eb029c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:35:10.258 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:10.260+0000 7fab5eb029c0 5 note: GC not initialized 2024-09-14T11:35:10.259 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:10.264+0000 7faa11fdb640 20 reqs_thread_entry: start 2024-09-14T11:35:10.259 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:10.264+0000 7fab5eb029c0 20 init_complete bucket index max shards: 11 2024-09-14T11:35:10.259 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:10.264+0000 7fab5eb029c0 20 Filter name: none 2024-09-14T11:35:10.259 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:10.264+0000 7fa9837fe640 20 reqs_thread_entry: start 2024-09-14T11:35:10.259 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:10.264+0000 7fab5eb029c0 10 cache get: name=default.rgw.meta+root+abort-at-set-target-layout : miss 2024-09-14T11:35:10.259 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:10.264+0000 7fab5eb029c0 20 rados->read ofs=0 len=0 2024-09-14T11:35:10.260 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:10.264+0000 7fab5eb029c0 20 rados_obj.operate() r=0 bl.length=194 2024-09-14T11:35:10.260 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:10.264+0000 7fab5eb029c0 10 cache put: name=default.rgw.meta+root+abort-at-set-target-layout info.flags=0x11 2024-09-14T11:35:10.261 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:10.264+0000 7fab5eb029c0 10 adding default.rgw.meta+root+abort-at-set-target-layout to cache LRU end 2024-09-14T11:35:10.261 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:10.264+0000 7fab5eb029c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.24 : miss 2024-09-14T11:35:10.261 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:10.264+0000 7fab5eb029c0 20 rados->read ofs=0 len=0 2024-09-14T11:35:10.261 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:10.264+0000 7fab5eb029c0 20 rados_obj.operate() r=0 bl.length=416 2024-09-14T11:35:10.261 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:10.264+0000 7fab5eb029c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.24 info.flags=0x17 2024-09-14T11:35:10.262 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:10.264+0000 7fab5eb029c0 10 adding default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.24 to cache LRU end 2024-09-14T11:35:10.262 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:10.264+0000 7fab5eb029c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:35:10.262 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:10.264+0000 7fab5eb029c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:35:10.262 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:10.264+0000 7fab5eb029c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.24 2024-09-14T11:35:10.272 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:10.276+0000 7fab5eb029c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.24 info.flags=0x17 2024-09-14T11:35:10.272 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:10.276+0000 7fab5eb029c0 10 moving default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.24 to cache LRU end 2024-09-14T11:35:10.272 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:10.276+0000 7fab5eb029c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:35:10.272 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:10.276+0000 7fab5eb029c0 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-set-target-layout:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.24, ofs0, ns] 2024-09-14T11:35:10.272 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:10.276+0000 7faa337fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366216 cookie 94273331676480 notifier 6185 bl.length()=925 2024-09-14T11:35:10.273 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:10.276+0000 7faa337fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.24 info.flags=0x17 2024-09-14T11:35:10.273 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:10.276+0000 7faa337fe640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.24 to cache LRU end 2024-09-14T11:35:10.273 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:10.276+0000 7faa337fe640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:35:10.275 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:10.280+0000 7fab5eb029c0 20 handle_bi_update(): bucket=:abort-at-set-target-layout[d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.24]): orig_sources= new_sources= 2024-09-14T11:35:10.275 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:10.280+0000 7fab5eb029c0 20 handle_bi_update(): bucket=:abort-at-set-target-layout[d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.24]): potential sources added=[] removed=[] 2024-09-14T11:35:10.275 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:10.280+0000 7fab5eb029c0 20 handle_bi_update(): bucket=:abort-at-set-target-layout[d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.24]): orig_dests= new_dests= 2024-09-14T11:35:10.275 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:10.280+0000 7fab5eb029c0 20 handle_bi_update(): bucket=:abort-at-set-target-layout[d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.24]): potential dests added=[] removed=[] 2024-09-14T11:35:10.286 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:10.288+0000 7fab5eb029c0 10 bucket_obj is .dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.24.1.0 2024-09-14T11:35:10.286 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:10.288+0000 7fab5eb029c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.24.1.0 2024-09-14T11:35:10.286 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:10.288+0000 7fab5eb029c0 10 bucket_obj is .dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.24.1.1 2024-09-14T11:35:10.286 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:10.288+0000 7fab5eb029c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.24.1.1 2024-09-14T11:35:10.286 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:10.288+0000 7fab5eb029c0 10 bucket_obj is .dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.24.1.2 2024-09-14T11:35:10.286 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:10.288+0000 7fab5eb029c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.24.1.2 2024-09-14T11:35:10.286 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:10.288+0000 7fab5eb029c0 10 bucket_obj is .dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.24.1.3 2024-09-14T11:35:10.286 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:10.288+0000 7fab5eb029c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.24.1.3 2024-09-14T11:35:10.286 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:10.288+0000 7fab5eb029c0 10 bucket_obj is .dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.24.1.4 2024-09-14T11:35:10.287 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:10.288+0000 7fab5eb029c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.24.1.4 2024-09-14T11:35:10.287 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:10.288+0000 7fab5eb029c0 10 bucket_obj is .dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.24.1.5 2024-09-14T11:35:10.287 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:10.288+0000 7fab5eb029c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.24.1.5 2024-09-14T11:35:10.287 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:10.288+0000 7fab5eb029c0 10 bucket_obj is .dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.24.1.6 2024-09-14T11:35:10.287 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:10.288+0000 7fab5eb029c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.24.1.6 2024-09-14T11:35:10.287 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:10.288+0000 7fab5eb029c0 10 bucket_obj is .dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.24.1.7 2024-09-14T11:35:10.287 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:10.288+0000 7fab5eb029c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.24.1.7 2024-09-14T11:35:10.287 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:10.288+0000 7fab5eb029c0 10 bucket_obj is .dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.24.1.8 2024-09-14T11:35:10.287 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:10.288+0000 7fab5eb029c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.24.1.8 2024-09-14T11:35:10.287 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:10.288+0000 7fab5eb029c0 10 bucket_obj is .dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.24.1.9 2024-09-14T11:35:10.287 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:10.288+0000 7fab5eb029c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.24.1.9 2024-09-14T11:35:10.287 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:10.288+0000 7fab5eb029c0 10 bucket_obj is .dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.24.1.10 2024-09-14T11:35:10.287 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:10.288+0000 7fab5eb029c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.24.1.10 2024-09-14T11:35:10.287 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:10.288+0000 7fab5eb029c0 10 bucket_obj is .dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.24.1.11 2024-09-14T11:35:10.288 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:10.288+0000 7fab5eb029c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.24.1.11 2024-09-14T11:35:10.288 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:10.288+0000 7fab5eb029c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.24.0 2024-09-14T11:35:10.288 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:10.292+0000 7fab5eb029c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.24.1 2024-09-14T11:35:10.288 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:10.292+0000 7fab5eb029c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.24.2 2024-09-14T11:35:10.289 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:10.292+0000 7fab5eb029c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.24.3 2024-09-14T11:35:10.290 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:10.292+0000 7fab5eb029c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.24.4 2024-09-14T11:35:10.290 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:10.296+0000 7fab5eb029c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.24.5 2024-09-14T11:35:10.291 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:10.296+0000 7fab5eb029c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.24.6 2024-09-14T11:35:10.292 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:10.296+0000 7fab5eb029c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.24.7 2024-09-14T11:35:10.293 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:10.296+0000 7fab5eb029c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.24.8 2024-09-14T11:35:10.293 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:10.296+0000 7fab5eb029c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.24.9 2024-09-14T11:35:10.295 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:10.300+0000 7fab5eb029c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.24.10 2024-09-14T11:35:10.300 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:10.304+0000 7fab5eb029c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.24 : hit (requested=0x17, cached=0x17) 2024-09-14T11:35:10.301 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:10.304+0000 7fab5eb029c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.24 2024-09-14T11:35:10.303 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:10.308+0000 7fab5eb029c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.24 info.flags=0x17 2024-09-14T11:35:10.303 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:10.308+0000 7fab5eb029c0 10 moving default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.24 to cache LRU end 2024-09-14T11:35:10.303 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:10.308+0000 7fab5eb029c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:35:10.303 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:10.308+0000 7fab5eb029c0 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-set-target-layout:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.24, ofs0, ns] 2024-09-14T11:35:10.304 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:10.308+0000 7faa32ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366217 cookie 94273331676480 notifier 6185 bl.length()=925 2024-09-14T11:35:10.304 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:10.308+0000 7faa32ffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.24 info.flags=0x17 2024-09-14T11:35:10.304 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:10.308+0000 7faa32ffd640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.24 to cache LRU end 2024-09-14T11:35:10.304 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:10.308+0000 7faa32ffd640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:35:10.307 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:10.312+0000 7fab5eb029c0 20 handle_bi_update(): bucket=:abort-at-set-target-layout[d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.24]): orig_sources= new_sources= 2024-09-14T11:35:10.307 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:10.312+0000 7fab5eb029c0 20 handle_bi_update(): bucket=:abort-at-set-target-layout[d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.24]): potential sources added=[] removed=[] 2024-09-14T11:35:10.307 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:10.312+0000 7fab5eb029c0 20 handle_bi_update(): bucket=:abort-at-set-target-layout[d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.24]): orig_dests= new_dests= 2024-09-14T11:35:10.307 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:10.312+0000 7fab5eb029c0 20 handle_bi_update(): bucket=:abort-at-set-target-layout[d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.24]): potential dests added=[] removed=[] 2024-09-14T11:35:10.312 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:10.316+0000 7fab5eb029c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.24.0 2024-09-14T11:35:10.313 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:10.316+0000 7fab5eb029c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.24.1 2024-09-14T11:35:10.313 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:10.316+0000 7fab5eb029c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.24.2 2024-09-14T11:35:10.314 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:10.316+0000 7fab5eb029c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.24.3 2024-09-14T11:35:10.315 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:10.320+0000 7fab5eb029c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.24.4 2024-09-14T11:35:10.315 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:10.320+0000 7fab5eb029c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.24.5 2024-09-14T11:35:10.316 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:10.320+0000 7fab5eb029c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.24.6 2024-09-14T11:35:10.317 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:10.320+0000 7fab5eb029c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.24.7 2024-09-14T11:35:10.318 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:10.320+0000 7fab5eb029c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.24.8 2024-09-14T11:35:10.318 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:10.324+0000 7fab5eb029c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.24.9 2024-09-14T11:35:10.319 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:10.324+0000 7fab5eb029c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.24.10 2024-09-14T11:35:10.320 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:10.324+0000 7fab5eb029c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.24 : hit (requested=0x17, cached=0x17) 2024-09-14T11:35:10.320 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:10.324+0000 7fab5eb029c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.24 2024-09-14T11:35:10.323 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:10.328+0000 7fab5eb029c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.24 info.flags=0x17 2024-09-14T11:35:10.323 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:10.328+0000 7fab5eb029c0 10 moving default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.24 to cache LRU end 2024-09-14T11:35:10.323 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:10.328+0000 7fab5eb029c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:35:10.323 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:10.328+0000 7fab5eb029c0 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-set-target-layout:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.24, ofs0, ns] 2024-09-14T11:35:10.323 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:10.328+0000 7faa337fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366218 cookie 94273331676480 notifier 6185 bl.length()=893 2024-09-14T11:35:10.324 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:10.328+0000 7faa337fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.24 info.flags=0x17 2024-09-14T11:35:10.324 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:10.328+0000 7faa337fe640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.24 to cache LRU end 2024-09-14T11:35:10.324 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:10.328+0000 7faa337fe640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:35:10.326 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:10.328+0000 7fab5eb029c0 20 handle_bi_update(): bucket=:abort-at-set-target-layout[d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.24]): orig_sources= new_sources= 2024-09-14T11:35:10.326 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:10.328+0000 7fab5eb029c0 20 handle_bi_update(): bucket=:abort-at-set-target-layout[d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.24]): potential sources added=[] removed=[] 2024-09-14T11:35:10.326 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:10.328+0000 7fab5eb029c0 20 handle_bi_update(): bucket=:abort-at-set-target-layout[d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.24]): orig_dests= new_dests= 2024-09-14T11:35:10.326 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:10.328+0000 7fab5eb029c0 20 handle_bi_update(): bucket=:abort-at-set-target-layout[d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.24]): potential dests added=[] removed=[] 2024-09-14T11:35:10.331 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:10.336+0000 7fab5eb029c0 1 execute INFO: reshard of bucket "abort-at-set-target-layout" from 11 shards to 12 shards completed successfully 2024-09-14T11:35:10.335 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:10.340+0000 7faa12fdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:35:10.340 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:10.344+0000 7fab5eb029c0 20 remove_watcher() i=0 2024-09-14T11:35:10.341 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:10.344+0000 7fab5eb029c0 2 removed watcher, disabling cache 2024-09-14T11:35:10.343 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:10.348+0000 7fab5eb029c0 20 remove_watcher() i=1 2024-09-14T11:35:10.345 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:10.348+0000 7fab5eb029c0 20 remove_watcher() i=2 2024-09-14T11:35:10.348 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:10.352+0000 7fab5eb029c0 20 remove_watcher() i=3 2024-09-14T11:35:10.350 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:10.356+0000 7fab5eb029c0 20 remove_watcher() i=4 2024-09-14T11:35:10.352 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:10.356+0000 7fab5eb029c0 20 remove_watcher() i=5 2024-09-14T11:35:10.353 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:10.356+0000 7fab5eb029c0 20 remove_watcher() i=6 2024-09-14T11:35:10.355 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:10.360+0000 7fab5eb029c0 20 remove_watcher() i=7 2024-09-14T11:35:10.372 INFO:tasks.workunit.client.0.smithi138.stderr:radosgw-admin bucket stats --bucket abort-at-set-target-layout 2024-09-14T11:35:10.402 INFO:tasks.workunit.client.0.smithi138.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:35:10.402 INFO:tasks.workunit.client.0.smithi138.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:35:10.446 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:10.452+0000 7fa134da89c0 20 rados->read ofs=0 len=0 2024-09-14T11:35:10.449 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:10.452+0000 7fa134da89c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:35:10.449 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:10.452+0000 7fa134da89c0 20 realm 2024-09-14T11:35:10.449 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:10.452+0000 7fa134da89c0 20 rados->read ofs=0 len=0 2024-09-14T11:35:10.449 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:10.452+0000 7fa134da89c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:35:10.449 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:10.452+0000 7fa134da89c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:35:10.449 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:10.452+0000 7fa134da89c0 20 rados->read ofs=0 len=0 2024-09-14T11:35:10.449 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:10.452+0000 7fa134da89c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:35:10.449 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:10.452+0000 7fa134da89c0 20 rados->read ofs=0 len=0 2024-09-14T11:35:10.451 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:10.456+0000 7fa134da89c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:35:10.451 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:10.456+0000 7fa134da89c0 20 rados->read ofs=0 len=0 2024-09-14T11:35:10.451 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:10.456+0000 7fa134da89c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:35:10.452 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:10.456+0000 7fa134da89c0 20 searching for the correct realm 2024-09-14T11:35:10.456 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:10.460+0000 7fa1320ad640 0 -- 172.21.15.138:0/857352569 >> [v2:172.21.15.154:6808/1468088432,v1:172.21.15.154:6809/1468088432] conn(0x7fa1240e6120 msgr2=0x7fa1240e19a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:35:10.462 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:10.468+0000 7fa1320ad640 0 -- 172.21.15.138:0/857352569 >> [v2:172.21.15.138:6816/326481658,v1:172.21.15.138:6817/326481658] conn(0x7fa12c0253f0 msgr2=0x7fa12c025870 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:35:10.682 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:10.684+0000 7fa134da89c0 20 RGWRados::pool_iterate: got zone_info.d9e72d30-c60b-4d0d-9267-fdc36392d5ad 2024-09-14T11:35:10.682 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:10.684+0000 7fa134da89c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:35:10.682 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:10.684+0000 7fa134da89c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:35:10.682 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:10.684+0000 7fa134da89c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:35:10.682 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:10.684+0000 7fa134da89c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:35:10.682 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:10.684+0000 7fa134da89c0 20 RGWRados::pool_iterate: got zonegroup_info.65ab941b-da8c-4160-94fb-3672b069d44f 2024-09-14T11:35:10.682 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:10.684+0000 7fa134da89c0 20 rados->read ofs=0 len=0 2024-09-14T11:35:10.683 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:10.688+0000 7fa134da89c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:35:10.683 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:10.688+0000 7fa134da89c0 20 rados->read ofs=0 len=0 2024-09-14T11:35:10.684 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:10.688+0000 7fa134da89c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:35:10.684 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:10.688+0000 7fa134da89c0 20 rados->read ofs=0 len=0 2024-09-14T11:35:10.685 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:10.688+0000 7fa134da89c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:35:10.685 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:10.688+0000 7fa134da89c0 20 zone default found 2024-09-14T11:35:10.685 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:10.688+0000 7fa134da89c0 4 Realm: () 2024-09-14T11:35:10.685 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:10.688+0000 7fa134da89c0 4 ZoneGroup: default (65ab941b-da8c-4160-94fb-3672b069d44f) 2024-09-14T11:35:10.685 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:10.688+0000 7fa134da89c0 4 Zone: default (d9e72d30-c60b-4d0d-9267-fdc36392d5ad) 2024-09-14T11:35:10.685 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:10.688+0000 7fa134da89c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:35:10.685 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:10.688+0000 7fa134da89c0 20 zonegroup default 2024-09-14T11:35:10.685 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:10.688+0000 7fa134da89c0 20 rados->read ofs=0 len=0 2024-09-14T11:35:10.686 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:10.688+0000 7fa134da89c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:35:10.686 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:10.688+0000 7fa134da89c0 20 rados->read ofs=0 len=0 2024-09-14T11:35:10.686 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:10.692+0000 7fa134da89c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:35:10.686 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:10.692+0000 7fa134da89c0 20 rados->read ofs=0 len=0 2024-09-14T11:35:10.687 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:10.692+0000 7fa134da89c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:35:10.687 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:10.692+0000 7fa134da89c0 20 started sync module instance, tier type = 2024-09-14T11:35:10.687 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:10.692+0000 7fa134da89c0 20 started zone id=d9e72d30-c60b-4d0d-9267-fdc36392d5ad (name=default) with tier type = 2024-09-14T11:35:10.710 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:10.716+0000 7fa134da89c0 20 add_watcher() i=0 2024-09-14T11:35:10.710 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:10.716+0000 7fa134da89c0 20 add_watcher() i=1 2024-09-14T11:35:10.710 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:10.716+0000 7fa134da89c0 20 add_watcher() i=2 2024-09-14T11:35:10.710 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:10.716+0000 7fa134da89c0 20 add_watcher() i=3 2024-09-14T11:35:10.711 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:10.716+0000 7fa134da89c0 20 add_watcher() i=4 2024-09-14T11:35:10.711 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:10.716+0000 7fa134da89c0 20 add_watcher() i=5 2024-09-14T11:35:10.711 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:10.716+0000 7fa134da89c0 20 add_watcher() i=6 2024-09-14T11:35:10.713 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:10.716+0000 7fa134da89c0 20 add_watcher() i=7 2024-09-14T11:35:10.713 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:10.716+0000 7fa134da89c0 2 all 8 watchers are set, enabling cache 2024-09-14T11:35:10.717 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:10.720+0000 7f9fe97e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:35:10.718 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:10.720+0000 7fa134da89c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:35:10.718 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:10.720+0000 7fa134da89c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:35:10.718 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:10.720+0000 7fa134da89c0 5 note: GC not initialized 2024-09-14T11:35:10.719 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:10.724+0000 7f9f63fff640 20 reqs_thread_entry: start 2024-09-14T11:35:10.719 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:10.724+0000 7fa134da89c0 20 init_complete bucket index max shards: 11 2024-09-14T11:35:10.719 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:10.724+0000 7fa134da89c0 20 Filter name: none 2024-09-14T11:35:10.719 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:10.724+0000 7f9f61ffb640 20 reqs_thread_entry: start 2024-09-14T11:35:10.719 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:10.724+0000 7fa134da89c0 20 rados->read ofs=0 len=0 2024-09-14T11:35:10.720 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:10.724+0000 7fa134da89c0 20 rados_obj.operate() r=0 bl.length=194 2024-09-14T11:35:10.720 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:10.724+0000 7fa134da89c0 20 rados->read ofs=0 len=0 2024-09-14T11:35:10.721 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:10.724+0000 7fa134da89c0 20 rados_obj.operate() r=0 bl.length=416 2024-09-14T11:35:10.721 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:10.724+0000 7fa134da89c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:35:10.721 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:10.724+0000 7fa134da89c0 20 rados->read ofs=0 len=0 2024-09-14T11:35:10.722 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:10.724+0000 7fa134da89c0 20 rados_obj.operate() r=0 bl.length=194 2024-09-14T11:35:10.722 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:10.724+0000 7fa134da89c0 20 rados->read ofs=0 len=0 2024-09-14T11:35:10.723 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:10.728+0000 7fa134da89c0 20 rados_obj.operate() r=0 bl.length=416 2024-09-14T11:35:10.723 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:10.728+0000 7fa134da89c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:35:10.725 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:10.728+0000 7f9fe97e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:35:10.730 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:10.732+0000 7fa134da89c0 20 remove_watcher() i=0 2024-09-14T11:35:10.730 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:10.732+0000 7fa134da89c0 2 removed watcher, disabling cache 2024-09-14T11:35:10.732 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:10.736+0000 7fa134da89c0 20 remove_watcher() i=1 2024-09-14T11:35:10.734 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:10.736+0000 7fa134da89c0 20 remove_watcher() i=2 2024-09-14T11:35:10.736 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:10.740+0000 7fa134da89c0 20 remove_watcher() i=3 2024-09-14T11:35:10.738 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:10.744+0000 7fa134da89c0 20 remove_watcher() i=4 2024-09-14T11:35:10.740 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:10.744+0000 7fa134da89c0 20 remove_watcher() i=5 2024-09-14T11:35:10.741 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:10.744+0000 7fa134da89c0 20 remove_watcher() i=6 2024-09-14T11:35:10.743 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:10.748+0000 7fa134da89c0 20 remove_watcher() i=7 2024-09-14T11:35:10.757 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-14T11:35:10.757 INFO:tasks.workunit.client.0.smithi138.stderr:BUCKET_STATS: 2024-09-14T11:35:10.757 INFO:tasks.workunit.client.0.smithi138.stderr:bucket: abort-at-set-target-layout id: d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.24 num_objects: 19 size_kb: 1 num_shards: 12 2024-09-14T11:35:10.757 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-14T11:35:10.759 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:35:10.759 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-14T11:35:10.784 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:35:10.785 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-14T11:35:11.270 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:35:11.270 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-14T11:35:11.652 INFO:tasks.workunit.client.0.smithi138.stderr:TEST: reshard bucket with EIO injected at trim_reshard_log_entries 2024-09-14T11:35:11.652 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-14T11:35:11.655 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:35:11.655 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-14T11:35:11.803 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:35:11.803 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-14T11:35:11.883 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:35:11.883 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-14T11:35:11.988 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:35:11.988 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-14T11:35:12.081 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:35:12.081 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-14T11:35:12.173 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:35:12.173 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-14T11:35:12.265 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:35:12.266 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-14T11:35:12.352 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:35:12.352 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-14T11:35:12.437 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:35:12.437 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-14T11:35:12.531 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:35:12.532 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-14T11:35:12.624 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:35:12.624 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-14T11:35:12.720 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:35:12.720 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-14T11:35:12.804 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:35:12.804 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-14T11:35:12.951 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:35:12.951 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-14T11:35:13.041 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:35:13.041 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-14T11:35:13.135 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:35:13.135 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-14T11:35:13.225 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:35:13.225 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-14T11:35:13.321 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:35:13.321 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-14T11:35:13.414 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:35:13.414 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-14T11:35:13.511 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:35:13.511 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-14T11:35:13.589 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:35:13.590 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-14T11:35:13.687 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:35:13.688 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-14T11:35:13.779 INFO:tasks.workunit.client.0.smithi138.stderr:radosgw-admin bucket stats --bucket error-at-trim-reshard-log-entries 2024-09-14T11:35:13.812 INFO:tasks.workunit.client.0.smithi138.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:35:13.812 INFO:tasks.workunit.client.0.smithi138.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:35:13.862 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:13.864+0000 7fa49236b9c0 20 rados->read ofs=0 len=0 2024-09-14T11:35:13.864 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:13.868+0000 7fa49236b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:35:13.864 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:13.868+0000 7fa49236b9c0 20 realm 2024-09-14T11:35:13.864 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:13.868+0000 7fa49236b9c0 20 rados->read ofs=0 len=0 2024-09-14T11:35:13.865 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:13.868+0000 7fa49236b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:35:13.865 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:13.868+0000 7fa49236b9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:35:13.865 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:13.868+0000 7fa49236b9c0 20 rados->read ofs=0 len=0 2024-09-14T11:35:13.865 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:13.868+0000 7fa49236b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:35:13.865 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:13.868+0000 7fa49236b9c0 20 rados->read ofs=0 len=0 2024-09-14T11:35:13.866 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:13.868+0000 7fa49236b9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:35:13.866 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:13.868+0000 7fa49236b9c0 20 rados->read ofs=0 len=0 2024-09-14T11:35:13.867 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:13.872+0000 7fa49236b9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:35:13.867 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:13.872+0000 7fa49236b9c0 20 searching for the correct realm 2024-09-14T11:35:13.868 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:13.872+0000 7fa48f670640 0 -- 172.21.15.138:0/4169793370 >> [v2:172.21.15.154:6808/1468088432,v1:172.21.15.154:6809/1468088432] conn(0x7fa4800b9030 msgr2=0x7fa4801074f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:35:14.082 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:14.084+0000 7fa490672640 0 -- 172.21.15.138:0/4169793370 >> [v2:172.21.15.138:6824/2633984942,v1:172.21.15.138:6825/2633984942] conn(0x564de88cfde0 msgr2=0x564de88d21d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:35:14.099 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:14.104+0000 7fa49236b9c0 20 RGWRados::pool_iterate: got zone_info.d9e72d30-c60b-4d0d-9267-fdc36392d5ad 2024-09-14T11:35:14.099 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:14.104+0000 7fa49236b9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:35:14.099 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:14.104+0000 7fa49236b9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:35:14.099 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:14.104+0000 7fa49236b9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:35:14.099 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:14.104+0000 7fa49236b9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:35:14.099 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:14.104+0000 7fa49236b9c0 20 RGWRados::pool_iterate: got zonegroup_info.65ab941b-da8c-4160-94fb-3672b069d44f 2024-09-14T11:35:14.099 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:14.104+0000 7fa49236b9c0 20 rados->read ofs=0 len=0 2024-09-14T11:35:14.100 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:14.104+0000 7fa49236b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:35:14.100 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:14.104+0000 7fa49236b9c0 20 rados->read ofs=0 len=0 2024-09-14T11:35:14.100 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:14.104+0000 7fa49236b9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:35:14.100 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:14.104+0000 7fa49236b9c0 20 rados->read ofs=0 len=0 2024-09-14T11:35:14.101 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:14.104+0000 7fa49236b9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:35:14.101 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:14.104+0000 7fa49236b9c0 20 zone default found 2024-09-14T11:35:14.102 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:14.104+0000 7fa49236b9c0 4 Realm: () 2024-09-14T11:35:14.102 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:14.104+0000 7fa49236b9c0 4 ZoneGroup: default (65ab941b-da8c-4160-94fb-3672b069d44f) 2024-09-14T11:35:14.102 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:14.104+0000 7fa49236b9c0 4 Zone: default (d9e72d30-c60b-4d0d-9267-fdc36392d5ad) 2024-09-14T11:35:14.102 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:14.104+0000 7fa49236b9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:35:14.102 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:14.104+0000 7fa49236b9c0 20 zonegroup default 2024-09-14T11:35:14.102 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:14.104+0000 7fa49236b9c0 20 rados->read ofs=0 len=0 2024-09-14T11:35:14.102 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:14.104+0000 7fa49236b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:35:14.102 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:14.104+0000 7fa49236b9c0 20 rados->read ofs=0 len=0 2024-09-14T11:35:14.103 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:14.108+0000 7fa49236b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:35:14.103 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:14.108+0000 7fa49236b9c0 20 rados->read ofs=0 len=0 2024-09-14T11:35:14.104 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:14.108+0000 7fa49236b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:35:14.104 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:14.108+0000 7fa49236b9c0 20 started sync module instance, tier type = 2024-09-14T11:35:14.104 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:14.108+0000 7fa49236b9c0 20 started zone id=d9e72d30-c60b-4d0d-9267-fdc36392d5ad (name=default) with tier type = 2024-09-14T11:35:14.128 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:14.132+0000 7fa49236b9c0 20 add_watcher() i=0 2024-09-14T11:35:14.128 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:14.132+0000 7fa49236b9c0 20 add_watcher() i=1 2024-09-14T11:35:14.128 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:14.132+0000 7fa49236b9c0 20 add_watcher() i=2 2024-09-14T11:35:14.128 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:14.132+0000 7fa49236b9c0 20 add_watcher() i=3 2024-09-14T11:35:14.128 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:14.132+0000 7fa49236b9c0 20 add_watcher() i=4 2024-09-14T11:35:14.128 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:14.132+0000 7fa49236b9c0 20 add_watcher() i=5 2024-09-14T11:35:14.128 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:14.132+0000 7fa49236b9c0 20 add_watcher() i=6 2024-09-14T11:35:14.130 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:14.136+0000 7fa49236b9c0 20 add_watcher() i=7 2024-09-14T11:35:14.130 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:14.136+0000 7fa49236b9c0 2 all 8 watchers are set, enabling cache 2024-09-14T11:35:14.134 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:14.136+0000 7fa345fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:35:14.135 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:14.140+0000 7fa49236b9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:35:14.135 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:14.140+0000 7fa49236b9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:35:14.135 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:14.140+0000 7fa49236b9c0 5 note: GC not initialized 2024-09-14T11:35:14.136 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:14.140+0000 7fa344fe1640 20 reqs_thread_entry: start 2024-09-14T11:35:14.136 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:14.140+0000 7fa49236b9c0 20 init_complete bucket index max shards: 11 2024-09-14T11:35:14.136 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:14.140+0000 7fa49236b9c0 20 Filter name: none 2024-09-14T11:35:14.136 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:14.140+0000 7fa2be7fc640 20 reqs_thread_entry: start 2024-09-14T11:35:14.136 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:14.140+0000 7fa49236b9c0 20 rados->read ofs=0 len=0 2024-09-14T11:35:14.137 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:14.140+0000 7fa49236b9c0 20 rados_obj.operate() r=0 bl.length=201 2024-09-14T11:35:14.138 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:14.140+0000 7fa49236b9c0 20 rados->read ofs=0 len=0 2024-09-14T11:35:14.139 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:14.144+0000 7fa49236b9c0 20 rados_obj.operate() r=0 bl.length=423 2024-09-14T11:35:14.139 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:14.144+0000 7fa49236b9c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:35:14.139 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:14.144+0000 7fa49236b9c0 20 rados->read ofs=0 len=0 2024-09-14T11:35:14.140 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:14.144+0000 7fa49236b9c0 20 rados_obj.operate() r=0 bl.length=201 2024-09-14T11:35:14.140 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:14.144+0000 7fa49236b9c0 20 rados->read ofs=0 len=0 2024-09-14T11:35:14.141 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:14.144+0000 7fa49236b9c0 20 rados_obj.operate() r=0 bl.length=423 2024-09-14T11:35:14.141 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:14.144+0000 7fa49236b9c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:35:14.144 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:14.148+0000 7fa345fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:35:14.149 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:14.152+0000 7fa49236b9c0 20 remove_watcher() i=0 2024-09-14T11:35:14.149 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:14.152+0000 7fa49236b9c0 2 removed watcher, disabling cache 2024-09-14T11:35:14.151 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:14.156+0000 7fa49236b9c0 20 remove_watcher() i=1 2024-09-14T11:35:14.153 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:14.156+0000 7fa49236b9c0 20 remove_watcher() i=2 2024-09-14T11:35:14.156 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:14.160+0000 7fa49236b9c0 20 remove_watcher() i=3 2024-09-14T11:35:14.158 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:14.164+0000 7fa49236b9c0 20 remove_watcher() i=4 2024-09-14T11:35:14.160 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:14.164+0000 7fa49236b9c0 20 remove_watcher() i=5 2024-09-14T11:35:14.161 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:14.164+0000 7fa49236b9c0 20 remove_watcher() i=6 2024-09-14T11:35:14.163 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:14.168+0000 7fa49236b9c0 20 remove_watcher() i=7 2024-09-14T11:35:14.179 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-14T11:35:14.179 INFO:tasks.workunit.client.0.smithi138.stderr:BUCKET_STATS: 2024-09-14T11:35:14.179 INFO:tasks.workunit.client.0.smithi138.stderr:bucket: error-at-trim-reshard-log-entries id: d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.25 num_objects: 20 size_kb: 1 num_shards: 11 2024-09-14T11:35:14.179 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-14T11:35:14.179 INFO:tasks.workunit.client.0.smithi138.stderr:radosgw-admin bucket reshard --bucket error-at-trim-reshard-log-entries --num-shards 12 --rgw-reshard-bucket-lock-duration 30 --inject-error-at trim_reshard_log_entries 2024-09-14T11:35:14.213 INFO:tasks.workunit.client.0.smithi138.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:35:14.213 INFO:tasks.workunit.client.0.smithi138.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:35:14.259 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:14.264+0000 7f7d24da19c0 20 rados->read ofs=0 len=0 2024-09-14T11:35:14.261 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:14.264+0000 7f7d24da19c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:35:14.261 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:14.264+0000 7f7d24da19c0 20 realm 2024-09-14T11:35:14.261 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:14.264+0000 7f7d24da19c0 20 rados->read ofs=0 len=0 2024-09-14T11:35:14.261 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:14.264+0000 7f7d24da19c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:35:14.261 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:14.264+0000 7f7d24da19c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:35:14.261 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:14.264+0000 7f7d24da19c0 20 rados->read ofs=0 len=0 2024-09-14T11:35:14.261 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:14.264+0000 7f7d24da19c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:35:14.261 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:14.264+0000 7f7d24da19c0 20 rados->read ofs=0 len=0 2024-09-14T11:35:14.263 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:14.268+0000 7f7d24da19c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:35:14.263 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:14.268+0000 7f7d24da19c0 20 rados->read ofs=0 len=0 2024-09-14T11:35:14.263 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:14.268+0000 7f7d24da19c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:35:14.264 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:14.268+0000 7f7d24da19c0 20 searching for the correct realm 2024-09-14T11:35:14.267 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:14.272+0000 7f7d230a8640 0 -- 172.21.15.138:0/2546156942 >> [v2:172.21.15.154:6824/416768175,v1:172.21.15.154:6825/416768175] conn(0x7f7d1c06a0e0 msgr2=0x7f7d1c06c1c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:35:14.483 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:14.488+0000 7f7d220a6640 0 -- 172.21.15.138:0/2546156942 >> [v2:172.21.15.138:6816/326481658,v1:172.21.15.138:6817/326481658] conn(0x7f7d1c09c030 msgr2=0x7f7d1c0993a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:35:14.702 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:14.704+0000 7f7d24da19c0 20 RGWRados::pool_iterate: got zone_info.d9e72d30-c60b-4d0d-9267-fdc36392d5ad 2024-09-14T11:35:14.702 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:14.704+0000 7f7d24da19c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:35:14.702 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:14.704+0000 7f7d24da19c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:35:14.702 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:14.704+0000 7f7d24da19c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:35:14.702 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:14.704+0000 7f7d24da19c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:35:14.702 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:14.704+0000 7f7d24da19c0 20 RGWRados::pool_iterate: got zonegroup_info.65ab941b-da8c-4160-94fb-3672b069d44f 2024-09-14T11:35:14.702 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:14.704+0000 7f7d24da19c0 20 rados->read ofs=0 len=0 2024-09-14T11:35:14.702 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:14.704+0000 7f7d24da19c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:35:14.702 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:14.704+0000 7f7d24da19c0 20 rados->read ofs=0 len=0 2024-09-14T11:35:14.703 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:14.708+0000 7f7d24da19c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:35:14.703 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:14.708+0000 7f7d24da19c0 20 rados->read ofs=0 len=0 2024-09-14T11:35:14.704 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:14.708+0000 7f7d24da19c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:35:14.704 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:14.708+0000 7f7d24da19c0 20 zone default found 2024-09-14T11:35:14.704 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:14.708+0000 7f7d24da19c0 4 Realm: () 2024-09-14T11:35:14.704 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:14.708+0000 7f7d24da19c0 4 ZoneGroup: default (65ab941b-da8c-4160-94fb-3672b069d44f) 2024-09-14T11:35:14.704 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:14.708+0000 7f7d24da19c0 4 Zone: default (d9e72d30-c60b-4d0d-9267-fdc36392d5ad) 2024-09-14T11:35:14.704 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:14.708+0000 7f7d24da19c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:35:14.704 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:14.708+0000 7f7d24da19c0 20 zonegroup default 2024-09-14T11:35:14.704 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:14.708+0000 7f7d24da19c0 20 rados->read ofs=0 len=0 2024-09-14T11:35:14.705 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:14.708+0000 7f7d24da19c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:35:14.705 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:14.708+0000 7f7d24da19c0 20 rados->read ofs=0 len=0 2024-09-14T11:35:14.705 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:14.708+0000 7f7d24da19c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:35:14.705 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:14.708+0000 7f7d24da19c0 20 rados->read ofs=0 len=0 2024-09-14T11:35:14.706 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:14.712+0000 7f7d24da19c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:35:14.706 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:14.712+0000 7f7d24da19c0 20 started sync module instance, tier type = 2024-09-14T11:35:14.707 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:14.712+0000 7f7d24da19c0 20 started zone id=d9e72d30-c60b-4d0d-9267-fdc36392d5ad (name=default) with tier type = 2024-09-14T11:35:14.727 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:14.732+0000 7f7d24da19c0 20 add_watcher() i=0 2024-09-14T11:35:14.727 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:14.732+0000 7f7d24da19c0 20 add_watcher() i=1 2024-09-14T11:35:14.727 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:14.732+0000 7f7d24da19c0 20 add_watcher() i=2 2024-09-14T11:35:14.727 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:14.732+0000 7f7d24da19c0 20 add_watcher() i=3 2024-09-14T11:35:14.727 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:14.732+0000 7f7d24da19c0 20 add_watcher() i=4 2024-09-14T11:35:14.727 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:14.732+0000 7f7d24da19c0 20 add_watcher() i=5 2024-09-14T11:35:14.727 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:14.732+0000 7f7d24da19c0 20 add_watcher() i=6 2024-09-14T11:35:14.729 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:14.732+0000 7f7d24da19c0 20 add_watcher() i=7 2024-09-14T11:35:14.729 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:14.732+0000 7f7d24da19c0 2 all 8 watchers are set, enabling cache 2024-09-14T11:35:14.733 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:14.736+0000 7f7bd97e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:35:14.734 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:14.736+0000 7f7d24da19c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:35:14.734 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:14.736+0000 7f7d24da19c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:35:14.734 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:14.736+0000 7f7d24da19c0 5 note: GC not initialized 2024-09-14T11:35:14.735 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:14.740+0000 7f7b53fff640 20 reqs_thread_entry: start 2024-09-14T11:35:14.735 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:14.740+0000 7f7d24da19c0 20 init_complete bucket index max shards: 11 2024-09-14T11:35:14.735 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:14.740+0000 7f7d24da19c0 20 Filter name: none 2024-09-14T11:35:14.735 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:14.740+0000 7f7b51ffb640 20 reqs_thread_entry: start 2024-09-14T11:35:14.736 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:14.740+0000 7f7d24da19c0 10 cache get: name=default.rgw.meta+root+error-at-trim-reshard-log-entries : miss 2024-09-14T11:35:14.736 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:14.740+0000 7f7d24da19c0 20 rados->read ofs=0 len=0 2024-09-14T11:35:14.737 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:14.740+0000 7f7d24da19c0 20 rados_obj.operate() r=0 bl.length=201 2024-09-14T11:35:14.737 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:14.740+0000 7f7d24da19c0 10 cache put: name=default.rgw.meta+root+error-at-trim-reshard-log-entries info.flags=0x11 2024-09-14T11:35:14.737 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:14.740+0000 7f7d24da19c0 10 adding default.rgw.meta+root+error-at-trim-reshard-log-entries to cache LRU end 2024-09-14T11:35:14.737 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:14.740+0000 7f7d24da19c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.25 : miss 2024-09-14T11:35:14.737 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:14.740+0000 7f7d24da19c0 20 rados->read ofs=0 len=0 2024-09-14T11:35:14.738 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:14.740+0000 7f7d24da19c0 20 rados_obj.operate() r=0 bl.length=423 2024-09-14T11:35:14.738 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:14.740+0000 7f7d24da19c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.25 info.flags=0x17 2024-09-14T11:35:14.738 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:14.740+0000 7f7d24da19c0 10 adding default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.25 to cache LRU end 2024-09-14T11:35:14.738 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:14.740+0000 7f7d24da19c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:35:14.738 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:14.740+0000 7f7d24da19c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:35:14.738 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:14.740+0000 7f7d24da19c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.25 2024-09-14T11:35:14.748 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:14.752+0000 7f7d24da19c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.25 info.flags=0x17 2024-09-14T11:35:14.748 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:14.752+0000 7f7d24da19c0 10 moving default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.25 to cache LRU end 2024-09-14T11:35:14.748 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:14.752+0000 7f7d24da19c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:35:14.748 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:14.752+0000 7f7d24da19c0 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-trim-reshard-log-entries:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.25, ofs0, ns] 2024-09-14T11:35:14.749 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:14.752+0000 7f7c067fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366176 cookie 94264380167552 notifier 6233 bl.length()=939 2024-09-14T11:35:14.749 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:14.752+0000 7f7c067fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.25 info.flags=0x17 2024-09-14T11:35:14.749 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:14.752+0000 7f7c067fc640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.25 to cache LRU end 2024-09-14T11:35:14.770 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:14.752+0000 7f7c067fc640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:35:14.771 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:14.756+0000 7f7d24da19c0 20 handle_bi_update(): bucket=:error-at-trim-reshard-log-entries[d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.25]): orig_sources= new_sources= 2024-09-14T11:35:14.771 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:14.756+0000 7f7d24da19c0 20 handle_bi_update(): bucket=:error-at-trim-reshard-log-entries[d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.25]): potential sources added=[] removed=[] 2024-09-14T11:35:14.771 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:14.756+0000 7f7d24da19c0 20 handle_bi_update(): bucket=:error-at-trim-reshard-log-entries[d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.25]): orig_dests= new_dests= 2024-09-14T11:35:14.771 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:14.756+0000 7f7d24da19c0 20 handle_bi_update(): bucket=:error-at-trim-reshard-log-entries[d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.25]): potential dests added=[] removed=[] 2024-09-14T11:35:14.771 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:14.756+0000 7f7d24da19c0 -1 Injecting error=-5 at location=trim_reshard_log_entries 2024-09-14T11:35:14.771 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:14.756+0000 7f7d24da19c0 0 ERROR: init_reshard failed to trim reshard log entries: (5) Input/output error 2024-09-14T11:35:14.771 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:14.760+0000 7f7bd97e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:35:14.771 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:14.764+0000 7f7d24da19c0 20 remove_watcher() i=0 2024-09-14T11:35:14.771 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:14.764+0000 7f7d24da19c0 2 removed watcher, disabling cache 2024-09-14T11:35:14.771 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:14.768+0000 7f7d24da19c0 20 remove_watcher() i=1 2024-09-14T11:35:14.772 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:14.768+0000 7f7d24da19c0 20 remove_watcher() i=2 2024-09-14T11:35:14.772 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:14.772+0000 7f7d24da19c0 20 remove_watcher() i=3 2024-09-14T11:35:14.772 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:14.776+0000 7f7d24da19c0 20 remove_watcher() i=4 2024-09-14T11:35:14.772 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:14.776+0000 7f7d24da19c0 20 remove_watcher() i=5 2024-09-14T11:35:14.773 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:14.776+0000 7f7d24da19c0 20 remove_watcher() i=6 2024-09-14T11:35:14.775 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:14.780+0000 7f7d24da19c0 20 remove_watcher() i=7 2024-09-14T11:35:14.791 INFO:tasks.workunit.client.0.smithi138.stderr:radosgw-admin bucket stats --bucket error-at-trim-reshard-log-entries 2024-09-14T11:35:14.819 INFO:tasks.workunit.client.0.smithi138.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:35:14.819 INFO:tasks.workunit.client.0.smithi138.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:35:14.863 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:14.868+0000 7fdc36cc79c0 20 rados->read ofs=0 len=0 2024-09-14T11:35:14.865 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:14.868+0000 7fdc36cc79c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:35:14.865 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:14.868+0000 7fdc36cc79c0 20 realm 2024-09-14T11:35:14.865 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:14.868+0000 7fdc36cc79c0 20 rados->read ofs=0 len=0 2024-09-14T11:35:14.865 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:14.868+0000 7fdc36cc79c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:35:14.865 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:14.868+0000 7fdc36cc79c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:35:14.865 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:14.868+0000 7fdc36cc79c0 20 rados->read ofs=0 len=0 2024-09-14T11:35:14.865 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:14.868+0000 7fdc36cc79c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:35:14.865 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:14.868+0000 7fdc36cc79c0 20 rados->read ofs=0 len=0 2024-09-14T11:35:14.866 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:14.872+0000 7fdc36cc79c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:35:14.867 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:14.872+0000 7fdc36cc79c0 20 rados->read ofs=0 len=0 2024-09-14T11:35:14.867 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:14.872+0000 7fdc36cc79c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:35:14.867 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:14.872+0000 7fdc36cc79c0 20 searching for the correct realm 2024-09-14T11:35:14.871 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:14.876+0000 7fdc34fce640 0 -- 172.21.15.138:0/170496329 >> [v2:172.21.15.154:6824/416768175,v1:172.21.15.154:6825/416768175] conn(0x7fdc2c02f070 msgr2=0x7fdc2c08b0b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:35:14.878 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:14.880+0000 7fdc33fcc640 0 -- 172.21.15.138:0/170496329 >> [v2:172.21.15.138:6816/326481658,v1:172.21.15.138:6817/326481658] conn(0x7fdc2c06f3c0 msgr2=0x7fdc2c06ed90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-14T11:35:15.097 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:15.096+0000 7fdc36cc79c0 20 RGWRados::pool_iterate: got zone_info.d9e72d30-c60b-4d0d-9267-fdc36392d5ad 2024-09-14T11:35:15.097 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:15.096+0000 7fdc36cc79c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:35:15.097 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:15.096+0000 7fdc36cc79c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:35:15.097 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:15.096+0000 7fdc36cc79c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:35:15.097 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:15.096+0000 7fdc36cc79c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:35:15.097 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:15.096+0000 7fdc36cc79c0 20 RGWRados::pool_iterate: got zonegroup_info.65ab941b-da8c-4160-94fb-3672b069d44f 2024-09-14T11:35:15.097 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:15.096+0000 7fdc36cc79c0 20 rados->read ofs=0 len=0 2024-09-14T11:35:15.097 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:15.096+0000 7fdc36cc79c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:35:15.098 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:15.096+0000 7fdc36cc79c0 20 rados->read ofs=0 len=0 2024-09-14T11:35:15.098 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:15.100+0000 7fdc36cc79c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:35:15.098 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:15.100+0000 7fdc36cc79c0 20 rados->read ofs=0 len=0 2024-09-14T11:35:15.098 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:15.100+0000 7fdc36cc79c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:35:15.098 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:15.100+0000 7fdc36cc79c0 20 zone default found 2024-09-14T11:35:15.098 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:15.100+0000 7fdc36cc79c0 4 Realm: () 2024-09-14T11:35:15.098 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:15.100+0000 7fdc36cc79c0 4 ZoneGroup: default (65ab941b-da8c-4160-94fb-3672b069d44f) 2024-09-14T11:35:15.098 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:15.100+0000 7fdc36cc79c0 4 Zone: default (d9e72d30-c60b-4d0d-9267-fdc36392d5ad) 2024-09-14T11:35:15.098 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:15.100+0000 7fdc36cc79c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:35:15.098 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:15.100+0000 7fdc36cc79c0 20 zonegroup default 2024-09-14T11:35:15.098 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:15.100+0000 7fdc36cc79c0 20 rados->read ofs=0 len=0 2024-09-14T11:35:15.098 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:15.100+0000 7fdc36cc79c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:35:15.098 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:15.100+0000 7fdc36cc79c0 20 rados->read ofs=0 len=0 2024-09-14T11:35:15.099 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:15.100+0000 7fdc36cc79c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:35:15.099 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:15.100+0000 7fdc36cc79c0 20 rados->read ofs=0 len=0 2024-09-14T11:35:15.099 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:15.104+0000 7fdc36cc79c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:35:15.099 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:15.104+0000 7fdc36cc79c0 20 started sync module instance, tier type = 2024-09-14T11:35:15.099 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:15.104+0000 7fdc36cc79c0 20 started zone id=d9e72d30-c60b-4d0d-9267-fdc36392d5ad (name=default) with tier type = 2024-09-14T11:35:15.122 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:15.128+0000 7fdc36cc79c0 20 add_watcher() i=0 2024-09-14T11:35:15.123 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:15.128+0000 7fdc36cc79c0 20 add_watcher() i=1 2024-09-14T11:35:15.123 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:15.128+0000 7fdc36cc79c0 20 add_watcher() i=2 2024-09-14T11:35:15.123 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:15.128+0000 7fdc36cc79c0 20 add_watcher() i=3 2024-09-14T11:35:15.123 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:15.128+0000 7fdc36cc79c0 20 add_watcher() i=4 2024-09-14T11:35:15.123 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:15.128+0000 7fdc36cc79c0 20 add_watcher() i=5 2024-09-14T11:35:15.123 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:15.128+0000 7fdc36cc79c0 20 add_watcher() i=6 2024-09-14T11:35:15.125 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:15.128+0000 7fdc36cc79c0 20 add_watcher() i=7 2024-09-14T11:35:15.125 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:15.128+0000 7fdc36cc79c0 2 all 8 watchers are set, enabling cache 2024-09-14T11:35:15.129 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:15.132+0000 7fdaeafdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:35:15.130 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:15.132+0000 7fdc36cc79c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:35:15.130 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:15.132+0000 7fdc36cc79c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:35:15.130 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:15.132+0000 7fdc36cc79c0 5 note: GC not initialized 2024-09-14T11:35:15.131 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:15.136+0000 7fdae9fdb640 20 reqs_thread_entry: start 2024-09-14T11:35:15.131 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:15.136+0000 7fdc36cc79c0 20 init_complete bucket index max shards: 11 2024-09-14T11:35:15.131 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:15.136+0000 7fdc36cc79c0 20 Filter name: none 2024-09-14T11:35:15.131 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:15.136+0000 7fda5b7fe640 20 reqs_thread_entry: start 2024-09-14T11:35:15.131 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:15.136+0000 7fdc36cc79c0 20 rados->read ofs=0 len=0 2024-09-14T11:35:15.133 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:15.136+0000 7fdc36cc79c0 20 rados_obj.operate() r=0 bl.length=201 2024-09-14T11:35:15.133 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:15.136+0000 7fdc36cc79c0 20 rados->read ofs=0 len=0 2024-09-14T11:35:15.134 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:15.136+0000 7fdc36cc79c0 20 rados_obj.operate() r=0 bl.length=455 2024-09-14T11:35:15.134 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:15.136+0000 7fdc36cc79c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:35:15.134 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:15.136+0000 7fdc36cc79c0 20 rados->read ofs=0 len=0 2024-09-14T11:35:15.135 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:15.140+0000 7fdc36cc79c0 20 rados_obj.operate() r=0 bl.length=201 2024-09-14T11:35:15.135 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:15.140+0000 7fdc36cc79c0 20 rados->read ofs=0 len=0 2024-09-14T11:35:15.136 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:15.140+0000 7fdc36cc79c0 20 rados_obj.operate() r=0 bl.length=455 2024-09-14T11:35:15.136 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:15.140+0000 7fdc36cc79c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:35:15.139 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:15.144+0000 7fdaeafdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:35:15.144 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:15.148+0000 7fdc36cc79c0 20 remove_watcher() i=0 2024-09-14T11:35:15.144 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:15.148+0000 7fdc36cc79c0 2 removed watcher, disabling cache 2024-09-14T11:35:15.147 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:15.152+0000 7fdc36cc79c0 20 remove_watcher() i=1 2024-09-14T11:35:15.149 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:15.152+0000 7fdc36cc79c0 20 remove_watcher() i=2 2024-09-14T11:35:15.151 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:15.156+0000 7fdc36cc79c0 20 remove_watcher() i=3 2024-09-14T11:35:15.154 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:15.160+0000 7fdc36cc79c0 20 remove_watcher() i=4 2024-09-14T11:35:15.156 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:15.160+0000 7fdc36cc79c0 20 remove_watcher() i=5 2024-09-14T11:35:15.157 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:15.160+0000 7fdc36cc79c0 20 remove_watcher() i=6 2024-09-14T11:35:15.159 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:15.164+0000 7fdc36cc79c0 20 remove_watcher() i=7 2024-09-14T11:35:15.174 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-14T11:35:15.174 INFO:tasks.workunit.client.0.smithi138.stderr:BUCKET_STATS: 2024-09-14T11:35:15.174 INFO:tasks.workunit.client.0.smithi138.stderr:bucket: error-at-trim-reshard-log-entries id: d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.25 num_objects: 20 size_kb: 1 num_shards: 11 2024-09-14T11:35:15.174 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-14T11:35:15.175 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:35:15.175 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-14T11:35:15.221 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:35:15.221 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-14T11:35:15.284 INFO:tasks.workunit.client.0.smithi138.stderr:radosgw-admin bucket reshard --bucket error-at-trim-reshard-log-entries --num-shards 12 --rgw-reshard-bucket-lock-duration 30 2024-09-14T11:35:15.320 INFO:tasks.workunit.client.0.smithi138.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:35:15.320 INFO:tasks.workunit.client.0.smithi138.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:35:15.364 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:15.368+0000 7f26e4a209c0 20 rados->read ofs=0 len=0 2024-09-14T11:35:15.366 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:15.368+0000 7f26e4a209c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:35:15.366 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:15.368+0000 7f26e4a209c0 20 realm 2024-09-14T11:35:15.366 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:15.368+0000 7f26e4a209c0 20 rados->read ofs=0 len=0 2024-09-14T11:35:15.366 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:15.368+0000 7f26e4a209c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:35:15.366 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:15.368+0000 7f26e4a209c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:35:15.366 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:15.368+0000 7f26e4a209c0 20 rados->read ofs=0 len=0 2024-09-14T11:35:15.366 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:15.368+0000 7f26e4a209c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:35:15.366 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:15.368+0000 7f26e4a209c0 20 rados->read ofs=0 len=0 2024-09-14T11:35:15.368 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:15.372+0000 7f26e4a209c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:35:15.368 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:15.372+0000 7f26e4a209c0 20 rados->read ofs=0 len=0 2024-09-14T11:35:15.369 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:15.372+0000 7f26e4a209c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:35:15.369 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:15.372+0000 7f26e4a209c0 20 searching for the correct realm 2024-09-14T11:35:15.372 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:15.376+0000 7f26e2d27640 0 -- 172.21.15.138:0/3597110627 >> [v2:172.21.15.154:6824/416768175,v1:172.21.15.154:6825/416768175] conn(0x7f26dc018070 msgr2=0x7f26dc05c5f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:35:15.380 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:15.384+0000 7f26e1d25640 0 -- 172.21.15.138:0/3597110627 >> [v2:172.21.15.138:6816/326481658,v1:172.21.15.138:6817/326481658] conn(0x7f26dc0645f0 msgr2=0x7f26dc07d1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:35:15.598 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:15.599+0000 7f26e4a209c0 20 RGWRados::pool_iterate: got zone_info.d9e72d30-c60b-4d0d-9267-fdc36392d5ad 2024-09-14T11:35:15.598 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:15.599+0000 7f26e4a209c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:35:15.598 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:15.599+0000 7f26e4a209c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:35:15.598 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:15.599+0000 7f26e4a209c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:35:15.598 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:15.599+0000 7f26e4a209c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:35:15.598 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:15.599+0000 7f26e4a209c0 20 RGWRados::pool_iterate: got zonegroup_info.65ab941b-da8c-4160-94fb-3672b069d44f 2024-09-14T11:35:15.598 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:15.599+0000 7f26e4a209c0 20 rados->read ofs=0 len=0 2024-09-14T11:35:15.599 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:15.599+0000 7f26e4a209c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:35:15.599 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:15.599+0000 7f26e4a209c0 20 rados->read ofs=0 len=0 2024-09-14T11:35:15.599 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:15.603+0000 7f26e4a209c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:35:15.599 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:15.603+0000 7f26e4a209c0 20 rados->read ofs=0 len=0 2024-09-14T11:35:15.601 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:15.603+0000 7f26e4a209c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:35:15.601 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:15.603+0000 7f26e4a209c0 20 zone default found 2024-09-14T11:35:15.601 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:15.603+0000 7f26e4a209c0 4 Realm: () 2024-09-14T11:35:15.601 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:15.603+0000 7f26e4a209c0 4 ZoneGroup: default (65ab941b-da8c-4160-94fb-3672b069d44f) 2024-09-14T11:35:15.601 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:15.603+0000 7f26e4a209c0 4 Zone: default (d9e72d30-c60b-4d0d-9267-fdc36392d5ad) 2024-09-14T11:35:15.601 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:15.603+0000 7f26e4a209c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:35:15.601 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:15.603+0000 7f26e4a209c0 20 zonegroup default 2024-09-14T11:35:15.602 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:15.603+0000 7f26e4a209c0 20 rados->read ofs=0 len=0 2024-09-14T11:35:15.602 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:15.603+0000 7f26e4a209c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:35:15.602 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:15.603+0000 7f26e4a209c0 20 rados->read ofs=0 len=0 2024-09-14T11:35:15.602 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:15.607+0000 7f26e4a209c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:35:15.602 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:15.607+0000 7f26e4a209c0 20 rados->read ofs=0 len=0 2024-09-14T11:35:15.603 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:15.607+0000 7f26e4a209c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:35:15.603 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:15.607+0000 7f26e4a209c0 20 started sync module instance, tier type = 2024-09-14T11:35:15.603 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:15.607+0000 7f26e4a209c0 20 started zone id=d9e72d30-c60b-4d0d-9267-fdc36392d5ad (name=default) with tier type = 2024-09-14T11:35:15.628 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:15.631+0000 7f26e4a209c0 20 add_watcher() i=0 2024-09-14T11:35:15.628 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:15.631+0000 7f26e4a209c0 20 add_watcher() i=1 2024-09-14T11:35:15.628 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:15.631+0000 7f26e4a209c0 20 add_watcher() i=2 2024-09-14T11:35:15.628 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:15.631+0000 7f26e4a209c0 20 add_watcher() i=3 2024-09-14T11:35:15.628 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:15.631+0000 7f26e4a209c0 20 add_watcher() i=4 2024-09-14T11:35:15.629 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:15.631+0000 7f26e4a209c0 20 add_watcher() i=5 2024-09-14T11:35:15.629 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:15.631+0000 7f26e4a209c0 20 add_watcher() i=6 2024-09-14T11:35:15.631 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:15.635+0000 7f26e4a209c0 20 add_watcher() i=7 2024-09-14T11:35:15.631 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:15.635+0000 7f26e4a209c0 2 all 8 watchers are set, enabling cache 2024-09-14T11:35:15.635 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:15.639+0000 7f2598fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:35:15.636 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:15.639+0000 7f26e4a209c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:35:15.636 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:15.639+0000 7f26e4a209c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:35:15.636 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:15.639+0000 7f26e4a209c0 5 note: GC not initialized 2024-09-14T11:35:15.636 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:15.639+0000 7f25137fe640 20 reqs_thread_entry: start 2024-09-14T11:35:15.636 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:15.639+0000 7f26e4a209c0 20 init_complete bucket index max shards: 11 2024-09-14T11:35:15.637 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:15.639+0000 7f26e4a209c0 20 Filter name: none 2024-09-14T11:35:15.637 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:15.639+0000 7f25117fa640 20 reqs_thread_entry: start 2024-09-14T11:35:15.637 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:15.639+0000 7f26e4a209c0 10 cache get: name=default.rgw.meta+root+error-at-trim-reshard-log-entries : miss 2024-09-14T11:35:15.637 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:15.639+0000 7f26e4a209c0 20 rados->read ofs=0 len=0 2024-09-14T11:35:15.638 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:15.639+0000 7f26e4a209c0 20 rados_obj.operate() r=0 bl.length=201 2024-09-14T11:35:15.639 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:15.639+0000 7f26e4a209c0 10 cache put: name=default.rgw.meta+root+error-at-trim-reshard-log-entries info.flags=0x11 2024-09-14T11:35:15.639 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:15.639+0000 7f26e4a209c0 10 adding default.rgw.meta+root+error-at-trim-reshard-log-entries to cache LRU end 2024-09-14T11:35:15.639 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:15.639+0000 7f26e4a209c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.25 : miss 2024-09-14T11:35:15.639 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:15.639+0000 7f26e4a209c0 20 rados->read ofs=0 len=0 2024-09-14T11:35:15.640 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:15.643+0000 7f26e4a209c0 20 rados_obj.operate() r=0 bl.length=455 2024-09-14T11:35:15.640 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:15.643+0000 7f26e4a209c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.25 info.flags=0x17 2024-09-14T11:35:15.640 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:15.643+0000 7f26e4a209c0 10 adding default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.25 to cache LRU end 2024-09-14T11:35:15.640 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:15.643+0000 7f26e4a209c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:35:15.640 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:15.643+0000 7f26e4a209c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:35:15.640 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:15.643+0000 7f26e4a209c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.25 2024-09-14T11:35:15.643 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:15.647+0000 7f26e4a209c0 10 init_target_layout removing existing target index objects from a previous reshard attempt 2024-09-14T11:35:15.658 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:15.663+0000 7f26e4a209c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.25 info.flags=0x17 2024-09-14T11:35:15.658 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:15.663+0000 7f26e4a209c0 10 moving default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.25 to cache LRU end 2024-09-14T11:35:15.659 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:15.663+0000 7f26e4a209c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:35:15.659 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:15.663+0000 7f26e4a209c0 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-trim-reshard-log-entries:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.25, ofs0, ns] 2024-09-14T11:35:15.659 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:15.663+0000 7f25c5ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366177 cookie 94215328632896 notifier 6693 bl.length()=939 2024-09-14T11:35:15.659 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:15.663+0000 7f25c5ffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.25 info.flags=0x17 2024-09-14T11:35:15.659 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:15.663+0000 7f25c5ffb640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.25 to cache LRU end 2024-09-14T11:35:15.659 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:15.663+0000 7f25c5ffb640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:35:15.661 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:15.663+0000 7f26e4a209c0 20 handle_bi_update(): bucket=:error-at-trim-reshard-log-entries[d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.25]): orig_sources= new_sources= 2024-09-14T11:35:15.662 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:15.663+0000 7f26e4a209c0 20 handle_bi_update(): bucket=:error-at-trim-reshard-log-entries[d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.25]): potential sources added=[] removed=[] 2024-09-14T11:35:15.662 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:15.663+0000 7f26e4a209c0 20 handle_bi_update(): bucket=:error-at-trim-reshard-log-entries[d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.25]): orig_dests= new_dests= 2024-09-14T11:35:15.662 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:15.663+0000 7f26e4a209c0 20 handle_bi_update(): bucket=:error-at-trim-reshard-log-entries[d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.25]): potential dests added=[] removed=[] 2024-09-14T11:35:15.671 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:15.675+0000 7f26e4a209c0 10 bucket_obj is .dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.25.2.0 2024-09-14T11:35:15.671 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:15.675+0000 7f26e4a209c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.25.2.0 2024-09-14T11:35:15.671 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:15.675+0000 7f26e4a209c0 10 bucket_obj is .dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.25.2.1 2024-09-14T11:35:15.671 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:15.675+0000 7f26e4a209c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.25.2.1 2024-09-14T11:35:15.671 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:15.675+0000 7f26e4a209c0 10 bucket_obj is .dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.25.2.2 2024-09-14T11:35:15.671 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:15.675+0000 7f26e4a209c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.25.2.2 2024-09-14T11:35:15.672 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:15.675+0000 7f26e4a209c0 10 bucket_obj is .dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.25.2.3 2024-09-14T11:35:15.672 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:15.675+0000 7f26e4a209c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.25.2.3 2024-09-14T11:35:15.672 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:15.675+0000 7f26e4a209c0 10 bucket_obj is .dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.25.2.4 2024-09-14T11:35:15.672 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:15.675+0000 7f26e4a209c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.25.2.4 2024-09-14T11:35:15.672 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:15.675+0000 7f26e4a209c0 10 bucket_obj is .dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.25.2.5 2024-09-14T11:35:15.672 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:15.675+0000 7f26e4a209c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.25.2.5 2024-09-14T11:35:15.672 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:15.675+0000 7f26e4a209c0 10 bucket_obj is .dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.25.2.6 2024-09-14T11:35:15.672 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:15.675+0000 7f26e4a209c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.25.2.6 2024-09-14T11:35:15.672 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:15.675+0000 7f26e4a209c0 10 bucket_obj is .dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.25.2.7 2024-09-14T11:35:15.672 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:15.675+0000 7f26e4a209c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.25.2.7 2024-09-14T11:35:15.672 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:15.675+0000 7f26e4a209c0 10 bucket_obj is .dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.25.2.8 2024-09-14T11:35:15.672 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:15.675+0000 7f26e4a209c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.25.2.8 2024-09-14T11:35:15.673 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:15.675+0000 7f26e4a209c0 10 bucket_obj is .dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.25.2.9 2024-09-14T11:35:15.673 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:15.675+0000 7f26e4a209c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.25.2.9 2024-09-14T11:35:15.673 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:15.675+0000 7f26e4a209c0 10 bucket_obj is .dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.25.2.10 2024-09-14T11:35:15.673 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:15.675+0000 7f26e4a209c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.25.2.10 2024-09-14T11:35:15.673 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:15.675+0000 7f26e4a209c0 10 bucket_obj is .dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.25.2.11 2024-09-14T11:35:15.673 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:15.675+0000 7f26e4a209c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.25.2.11 2024-09-14T11:35:15.673 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:15.675+0000 7f26e4a209c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.25.0 2024-09-14T11:35:15.674 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:15.675+0000 7f26e4a209c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.25.1 2024-09-14T11:35:15.674 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:15.675+0000 7f26e4a209c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.25.2 2024-09-14T11:35:15.674 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:15.675+0000 7f26e4a209c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.25.3 2024-09-14T11:35:15.674 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:15.679+0000 7f26e4a209c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.25.4 2024-09-14T11:35:15.675 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:15.679+0000 7f26e4a209c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.25.5 2024-09-14T11:35:15.675 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:15.679+0000 7f26e4a209c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.25.6 2024-09-14T11:35:15.676 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:15.679+0000 7f26e4a209c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.25.7 2024-09-14T11:35:15.677 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:15.679+0000 7f26e4a209c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.25.8 2024-09-14T11:35:15.678 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:15.683+0000 7f26e4a209c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.25.9 2024-09-14T11:35:15.679 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:15.683+0000 7f26e4a209c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.25.10 2024-09-14T11:35:15.687 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:15.691+0000 7f26e4a209c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.25 : hit (requested=0x17, cached=0x17) 2024-09-14T11:35:15.688 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:15.691+0000 7f26e4a209c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.25 2024-09-14T11:35:15.690 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:15.691+0000 7f26e4a209c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.25 info.flags=0x17 2024-09-14T11:35:15.690 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:15.691+0000 7f26e4a209c0 10 moving default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.25 to cache LRU end 2024-09-14T11:35:15.690 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:15.691+0000 7f26e4a209c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:35:15.690 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:15.691+0000 7f26e4a209c0 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-trim-reshard-log-entries:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.25, ofs0, ns] 2024-09-14T11:35:15.690 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:15.695+0000 7f25c57fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366178 cookie 94215328632896 notifier 6693 bl.length()=939 2024-09-14T11:35:15.691 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:15.695+0000 7f25c57fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.25 info.flags=0x17 2024-09-14T11:35:15.691 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:15.695+0000 7f25c57fa640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.25 to cache LRU end 2024-09-14T11:35:15.691 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:15.695+0000 7f25c57fa640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:35:15.693 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:15.695+0000 7f26e4a209c0 20 handle_bi_update(): bucket=:error-at-trim-reshard-log-entries[d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.25]): orig_sources= new_sources= 2024-09-14T11:35:15.693 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:15.695+0000 7f26e4a209c0 20 handle_bi_update(): bucket=:error-at-trim-reshard-log-entries[d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.25]): potential sources added=[] removed=[] 2024-09-14T11:35:15.693 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:15.695+0000 7f26e4a209c0 20 handle_bi_update(): bucket=:error-at-trim-reshard-log-entries[d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.25]): orig_dests= new_dests= 2024-09-14T11:35:15.693 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:15.695+0000 7f26e4a209c0 20 handle_bi_update(): bucket=:error-at-trim-reshard-log-entries[d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.25]): potential dests added=[] removed=[] 2024-09-14T11:35:15.698 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:15.699+0000 7f26e4a209c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.25.0 2024-09-14T11:35:15.698 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:15.699+0000 7f26e4a209c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.25.1 2024-09-14T11:35:15.699 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:15.703+0000 7f26e4a209c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.25.2 2024-09-14T11:35:15.700 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:15.703+0000 7f26e4a209c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.25.3 2024-09-14T11:35:15.700 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:15.703+0000 7f26e4a209c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.25.4 2024-09-14T11:35:15.701 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:15.703+0000 7f26e4a209c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.25.5 2024-09-14T11:35:15.701 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:15.703+0000 7f26e4a209c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.25.6 2024-09-14T11:35:15.702 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:15.703+0000 7f26e4a209c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.25.7 2024-09-14T11:35:15.702 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:15.707+0000 7f26e4a209c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.25.8 2024-09-14T11:35:15.703 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:15.707+0000 7f26e4a209c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.25.9 2024-09-14T11:35:15.704 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:15.707+0000 7f26e4a209c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.25.10 2024-09-14T11:35:15.705 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:15.707+0000 7f26e4a209c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.25 : hit (requested=0x17, cached=0x17) 2024-09-14T11:35:15.705 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:15.707+0000 7f26e4a209c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.25 2024-09-14T11:35:15.708 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:15.711+0000 7f26e4a209c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.25 info.flags=0x17 2024-09-14T11:35:15.708 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:15.711+0000 7f26e4a209c0 10 moving default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.25 to cache LRU end 2024-09-14T11:35:15.708 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:15.711+0000 7f26e4a209c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:35:15.708 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:15.711+0000 7f26e4a209c0 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-trim-reshard-log-entries:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.25, ofs0, ns] 2024-09-14T11:35:15.708 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:15.711+0000 7f25c57fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366179 cookie 94215328632896 notifier 6693 bl.length()=907 2024-09-14T11:35:15.709 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:15.711+0000 7f25c57fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.25 info.flags=0x17 2024-09-14T11:35:15.709 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:15.711+0000 7f25c57fa640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.25 to cache LRU end 2024-09-14T11:35:15.709 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:15.711+0000 7f25c57fa640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:35:15.710 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:15.715+0000 7f26e4a209c0 20 handle_bi_update(): bucket=:error-at-trim-reshard-log-entries[d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.25]): orig_sources= new_sources= 2024-09-14T11:35:15.711 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:15.715+0000 7f26e4a209c0 20 handle_bi_update(): bucket=:error-at-trim-reshard-log-entries[d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.25]): potential sources added=[] removed=[] 2024-09-14T11:35:15.711 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:15.715+0000 7f26e4a209c0 20 handle_bi_update(): bucket=:error-at-trim-reshard-log-entries[d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.25]): orig_dests= new_dests= 2024-09-14T11:35:15.711 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:15.715+0000 7f26e4a209c0 20 handle_bi_update(): bucket=:error-at-trim-reshard-log-entries[d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.25]): potential dests added=[] removed=[] 2024-09-14T11:35:15.715 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:15.719+0000 7f26e4a209c0 1 execute INFO: reshard of bucket "error-at-trim-reshard-log-entries" from 11 shards to 12 shards completed successfully 2024-09-14T11:35:15.719 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:15.723+0000 7f2598fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:35:15.723 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:15.727+0000 7f26e4a209c0 20 remove_watcher() i=0 2024-09-14T11:35:15.723 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:15.727+0000 7f26e4a209c0 2 removed watcher, disabling cache 2024-09-14T11:35:15.726 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:15.727+0000 7f26e4a209c0 20 remove_watcher() i=1 2024-09-14T11:35:15.728 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:15.731+0000 7f26e4a209c0 20 remove_watcher() i=2 2024-09-14T11:35:15.730 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:15.731+0000 7f26e4a209c0 20 remove_watcher() i=3 2024-09-14T11:35:15.732 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:15.735+0000 7f26e4a209c0 20 remove_watcher() i=4 2024-09-14T11:35:15.734 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:15.735+0000 7f26e4a209c0 20 remove_watcher() i=5 2024-09-14T11:35:15.735 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:15.739+0000 7f26e4a209c0 20 remove_watcher() i=6 2024-09-14T11:35:15.736 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:15.739+0000 7f26e4a209c0 20 remove_watcher() i=7 2024-09-14T11:35:15.751 INFO:tasks.workunit.client.0.smithi138.stderr:radosgw-admin bucket stats --bucket error-at-trim-reshard-log-entries 2024-09-14T11:35:15.779 INFO:tasks.workunit.client.0.smithi138.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:35:15.779 INFO:tasks.workunit.client.0.smithi138.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:35:15.822 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:15.827+0000 7fb7165d69c0 20 rados->read ofs=0 len=0 2024-09-14T11:35:15.825 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:15.827+0000 7fb7165d69c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:35:15.825 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:15.827+0000 7fb7165d69c0 20 realm 2024-09-14T11:35:15.825 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:15.827+0000 7fb7165d69c0 20 rados->read ofs=0 len=0 2024-09-14T11:35:15.825 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:15.827+0000 7fb7165d69c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:35:15.825 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:15.827+0000 7fb7165d69c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:35:15.825 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:15.827+0000 7fb7165d69c0 20 rados->read ofs=0 len=0 2024-09-14T11:35:15.825 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:15.827+0000 7fb7165d69c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:35:15.826 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:15.827+0000 7fb7165d69c0 20 rados->read ofs=0 len=0 2024-09-14T11:35:15.827 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:15.831+0000 7fb7165d69c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:35:15.827 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:15.831+0000 7fb7165d69c0 20 rados->read ofs=0 len=0 2024-09-14T11:35:15.828 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:15.831+0000 7fb7165d69c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:35:15.828 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:15.831+0000 7fb7165d69c0 20 searching for the correct realm 2024-09-14T11:35:15.831 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:15.835+0000 7fb7148dd640 0 -- 172.21.15.138:0/3045055521 >> [v2:172.21.15.154:6824/416768175,v1:172.21.15.154:6825/416768175] conn(0x7fb70c023040 msgr2=0x7fb70c064ec0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:35:15.839 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:15.843+0000 7fb7138db640 0 -- 172.21.15.138:0/3045055521 >> [v2:172.21.15.138:6816/326481658,v1:172.21.15.138:6817/326481658] conn(0x7fb70c06f640 msgr2=0x7fb70c087210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-14T11:35:16.059 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:16.063+0000 7fb7165d69c0 20 RGWRados::pool_iterate: got zone_info.d9e72d30-c60b-4d0d-9267-fdc36392d5ad 2024-09-14T11:35:16.059 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:16.063+0000 7fb7165d69c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:35:16.059 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:16.063+0000 7fb7165d69c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:35:16.059 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:16.063+0000 7fb7165d69c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:35:16.059 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:16.063+0000 7fb7165d69c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:35:16.059 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:16.063+0000 7fb7165d69c0 20 RGWRados::pool_iterate: got zonegroup_info.65ab941b-da8c-4160-94fb-3672b069d44f 2024-09-14T11:35:16.059 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:16.063+0000 7fb7165d69c0 20 rados->read ofs=0 len=0 2024-09-14T11:35:16.059 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:16.063+0000 7fb7165d69c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:35:16.060 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:16.063+0000 7fb7165d69c0 20 rados->read ofs=0 len=0 2024-09-14T11:35:16.060 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:16.063+0000 7fb7165d69c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:35:16.060 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:16.063+0000 7fb7165d69c0 20 rados->read ofs=0 len=0 2024-09-14T11:35:16.061 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:16.063+0000 7fb7165d69c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:35:16.061 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:16.063+0000 7fb7165d69c0 20 zone default found 2024-09-14T11:35:16.061 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:16.063+0000 7fb7165d69c0 4 Realm: () 2024-09-14T11:35:16.061 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:16.063+0000 7fb7165d69c0 4 ZoneGroup: default (65ab941b-da8c-4160-94fb-3672b069d44f) 2024-09-14T11:35:16.061 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:16.063+0000 7fb7165d69c0 4 Zone: default (d9e72d30-c60b-4d0d-9267-fdc36392d5ad) 2024-09-14T11:35:16.062 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:16.063+0000 7fb7165d69c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:35:16.062 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:16.063+0000 7fb7165d69c0 20 zonegroup default 2024-09-14T11:35:16.062 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:16.063+0000 7fb7165d69c0 20 rados->read ofs=0 len=0 2024-09-14T11:35:16.062 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:16.063+0000 7fb7165d69c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:35:16.062 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:16.063+0000 7fb7165d69c0 20 rados->read ofs=0 len=0 2024-09-14T11:35:16.063 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:16.067+0000 7fb7165d69c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:35:16.063 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:16.067+0000 7fb7165d69c0 20 rados->read ofs=0 len=0 2024-09-14T11:35:16.063 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:16.067+0000 7fb7165d69c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:35:16.063 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:16.067+0000 7fb7165d69c0 20 started sync module instance, tier type = 2024-09-14T11:35:16.063 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:16.067+0000 7fb7165d69c0 20 started zone id=d9e72d30-c60b-4d0d-9267-fdc36392d5ad (name=default) with tier type = 2024-09-14T11:35:16.087 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:16.091+0000 7fb7165d69c0 20 add_watcher() i=0 2024-09-14T11:35:16.087 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:16.091+0000 7fb7165d69c0 20 add_watcher() i=1 2024-09-14T11:35:16.087 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:16.091+0000 7fb7165d69c0 20 add_watcher() i=2 2024-09-14T11:35:16.087 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:16.091+0000 7fb7165d69c0 20 add_watcher() i=3 2024-09-14T11:35:16.087 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:16.091+0000 7fb7165d69c0 20 add_watcher() i=4 2024-09-14T11:35:16.087 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:16.091+0000 7fb7165d69c0 20 add_watcher() i=5 2024-09-14T11:35:16.087 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:16.091+0000 7fb7165d69c0 20 add_watcher() i=6 2024-09-14T11:35:16.092 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:16.095+0000 7fb7165d69c0 20 add_watcher() i=7 2024-09-14T11:35:16.092 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:16.095+0000 7fb7165d69c0 2 all 8 watchers are set, enabling cache 2024-09-14T11:35:16.096 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:16.099+0000 7fb5ca7e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:35:16.097 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:16.099+0000 7fb7165d69c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:35:16.097 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:16.099+0000 7fb7165d69c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:35:16.097 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:16.099+0000 7fb7165d69c0 5 note: GC not initialized 2024-09-14T11:35:16.098 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:16.099+0000 7fb5c97e2640 20 reqs_thread_entry: start 2024-09-14T11:35:16.098 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:16.099+0000 7fb7165d69c0 20 init_complete bucket index max shards: 11 2024-09-14T11:35:16.098 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:16.099+0000 7fb7165d69c0 20 Filter name: none 2024-09-14T11:35:16.098 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:16.103+0000 7fb53affd640 20 reqs_thread_entry: start 2024-09-14T11:35:16.099 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:16.103+0000 7fb7165d69c0 20 rados->read ofs=0 len=0 2024-09-14T11:35:16.100 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:16.103+0000 7fb7165d69c0 20 rados_obj.operate() r=0 bl.length=201 2024-09-14T11:35:16.100 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:16.103+0000 7fb7165d69c0 20 rados->read ofs=0 len=0 2024-09-14T11:35:16.101 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:16.103+0000 7fb7165d69c0 20 rados_obj.operate() r=0 bl.length=423 2024-09-14T11:35:16.101 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:16.103+0000 7fb7165d69c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:35:16.101 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:16.103+0000 7fb7165d69c0 20 rados->read ofs=0 len=0 2024-09-14T11:35:16.102 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:16.103+0000 7fb7165d69c0 20 rados_obj.operate() r=0 bl.length=201 2024-09-14T11:35:16.102 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:16.103+0000 7fb7165d69c0 20 rados->read ofs=0 len=0 2024-09-14T11:35:16.103 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:16.107+0000 7fb7165d69c0 20 rados_obj.operate() r=0 bl.length=423 2024-09-14T11:35:16.103 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:16.107+0000 7fb7165d69c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:35:16.107 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:16.111+0000 7fb5ca7e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:35:16.112 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:16.115+0000 7fb7165d69c0 20 remove_watcher() i=0 2024-09-14T11:35:16.112 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:16.115+0000 7fb7165d69c0 2 removed watcher, disabling cache 2024-09-14T11:35:16.117 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:16.115+0000 7fb7165d69c0 20 remove_watcher() i=1 2024-09-14T11:35:16.117 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:16.119+0000 7fb7165d69c0 20 remove_watcher() i=2 2024-09-14T11:35:16.119 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:16.123+0000 7fb7165d69c0 20 remove_watcher() i=3 2024-09-14T11:35:16.121 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:16.123+0000 7fb7165d69c0 20 remove_watcher() i=4 2024-09-14T11:35:16.123 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:16.127+0000 7fb7165d69c0 20 remove_watcher() i=5 2024-09-14T11:35:16.125 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:16.127+0000 7fb7165d69c0 20 remove_watcher() i=6 2024-09-14T11:35:16.126 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:16.131+0000 7fb7165d69c0 20 remove_watcher() i=7 2024-09-14T11:35:16.144 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-14T11:35:16.144 INFO:tasks.workunit.client.0.smithi138.stderr:BUCKET_STATS: 2024-09-14T11:35:16.144 INFO:tasks.workunit.client.0.smithi138.stderr:bucket: error-at-trim-reshard-log-entries id: d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.25 num_objects: 19 size_kb: 1 num_shards: 12 2024-09-14T11:35:16.144 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-14T11:35:16.145 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:35:16.145 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-14T11:35:16.171 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:35:16.171 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-14T11:35:16.622 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:35:16.622 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-14T11:35:17.007 INFO:tasks.workunit.client.0.smithi138.stderr:TEST: reshard bucket with EOPNOTSUPP injected at trim_reshard_log_entries 2024-09-14T11:35:17.007 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-14T11:35:17.009 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:35:17.009 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-14T11:35:17.148 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:35:17.148 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-14T11:35:17.238 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:35:17.238 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-14T11:35:17.332 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:35:17.332 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-14T11:35:17.425 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:35:17.425 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-14T11:35:17.514 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:35:17.514 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-14T11:35:17.615 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:35:17.615 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-14T11:35:17.697 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:35:17.698 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-14T11:35:17.788 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:35:17.789 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-14T11:35:17.890 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:35:17.890 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-14T11:35:17.987 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:35:17.987 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-14T11:35:18.083 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:35:18.083 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-14T11:35:18.175 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:35:18.175 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-14T11:35:18.265 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:35:18.266 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-14T11:35:18.358 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:35:18.358 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-14T11:35:18.448 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:35:18.448 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-14T11:35:18.539 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:35:18.539 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-14T11:35:18.634 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:35:18.634 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-14T11:35:18.719 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:35:18.719 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-14T11:35:18.814 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:35:18.814 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-14T11:35:18.914 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:35:18.914 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-14T11:35:19.007 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:35:19.007 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-14T11:35:19.093 INFO:tasks.workunit.client.0.smithi138.stderr:radosgw-admin bucket stats --bucket error-at-trim-reshard-log-entries 2024-09-14T11:35:19.126 INFO:tasks.workunit.client.0.smithi138.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:35:19.127 INFO:tasks.workunit.client.0.smithi138.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:35:19.174 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:19.175+0000 7f15828b19c0 20 rados->read ofs=0 len=0 2024-09-14T11:35:19.176 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:19.179+0000 7f15828b19c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:35:19.176 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:19.179+0000 7f15828b19c0 20 realm 2024-09-14T11:35:19.176 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:19.179+0000 7f15828b19c0 20 rados->read ofs=0 len=0 2024-09-14T11:35:19.177 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:19.179+0000 7f15828b19c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:35:19.177 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:19.179+0000 7f15828b19c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:35:19.177 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:19.179+0000 7f15828b19c0 20 rados->read ofs=0 len=0 2024-09-14T11:35:19.177 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:19.179+0000 7f15828b19c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:35:19.177 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:19.179+0000 7f15828b19c0 20 rados->read ofs=0 len=0 2024-09-14T11:35:19.178 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:19.179+0000 7f15828b19c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:35:19.178 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:19.179+0000 7f15828b19c0 20 rados->read ofs=0 len=0 2024-09-14T11:35:19.179 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:19.183+0000 7f15828b19c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:35:19.179 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:19.183+0000 7f15828b19c0 20 searching for the correct realm 2024-09-14T11:35:19.184 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:19.187+0000 7f157fbb6640 0 -- 172.21.15.138:0/1555095521 >> [v2:172.21.15.154:6808/1468088432,v1:172.21.15.154:6809/1468088432] conn(0x7f15701025b0 msgr2=0x7f15700f7d80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:35:19.190 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:19.191+0000 7f157fbb6640 0 -- 172.21.15.138:0/1555095521 >> [v2:172.21.15.138:6816/326481658,v1:172.21.15.138:6817/326481658] conn(0x7f15780a0120 msgr2=0x7f1578071560 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:35:19.405 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:19.407+0000 7f15828b19c0 20 RGWRados::pool_iterate: got zone_info.d9e72d30-c60b-4d0d-9267-fdc36392d5ad 2024-09-14T11:35:19.405 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:19.407+0000 7f15828b19c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:35:19.405 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:19.407+0000 7f15828b19c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:35:19.405 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:19.407+0000 7f15828b19c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:35:19.405 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:19.407+0000 7f15828b19c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:35:19.405 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:19.407+0000 7f15828b19c0 20 RGWRados::pool_iterate: got zonegroup_info.65ab941b-da8c-4160-94fb-3672b069d44f 2024-09-14T11:35:19.406 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:19.407+0000 7f15828b19c0 20 rados->read ofs=0 len=0 2024-09-14T11:35:19.406 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:19.407+0000 7f15828b19c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:35:19.406 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:19.407+0000 7f15828b19c0 20 rados->read ofs=0 len=0 2024-09-14T11:35:19.406 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:19.407+0000 7f15828b19c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:35:19.406 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:19.407+0000 7f15828b19c0 20 rados->read ofs=0 len=0 2024-09-14T11:35:19.407 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:19.411+0000 7f15828b19c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:35:19.407 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:19.411+0000 7f15828b19c0 20 zone default found 2024-09-14T11:35:19.407 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:19.411+0000 7f15828b19c0 4 Realm: () 2024-09-14T11:35:19.407 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:19.411+0000 7f15828b19c0 4 ZoneGroup: default (65ab941b-da8c-4160-94fb-3672b069d44f) 2024-09-14T11:35:19.407 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:19.411+0000 7f15828b19c0 4 Zone: default (d9e72d30-c60b-4d0d-9267-fdc36392d5ad) 2024-09-14T11:35:19.407 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:19.411+0000 7f15828b19c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:35:19.408 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:19.411+0000 7f15828b19c0 20 zonegroup default 2024-09-14T11:35:19.408 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:19.411+0000 7f15828b19c0 20 rados->read ofs=0 len=0 2024-09-14T11:35:19.408 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:19.411+0000 7f15828b19c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:35:19.409 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:19.411+0000 7f15828b19c0 20 rados->read ofs=0 len=0 2024-09-14T11:35:19.409 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:19.411+0000 7f15828b19c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:35:19.409 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:19.411+0000 7f15828b19c0 20 rados->read ofs=0 len=0 2024-09-14T11:35:19.409 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:19.411+0000 7f15828b19c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:35:19.410 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:19.411+0000 7f15828b19c0 20 started sync module instance, tier type = 2024-09-14T11:35:19.410 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:19.411+0000 7f15828b19c0 20 started zone id=d9e72d30-c60b-4d0d-9267-fdc36392d5ad (name=default) with tier type = 2024-09-14T11:35:19.433 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:19.435+0000 7f15828b19c0 20 add_watcher() i=0 2024-09-14T11:35:19.433 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:19.435+0000 7f15828b19c0 20 add_watcher() i=1 2024-09-14T11:35:19.433 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:19.435+0000 7f15828b19c0 20 add_watcher() i=2 2024-09-14T11:35:19.433 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:19.435+0000 7f15828b19c0 20 add_watcher() i=3 2024-09-14T11:35:19.433 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:19.435+0000 7f15828b19c0 20 add_watcher() i=4 2024-09-14T11:35:19.433 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:19.435+0000 7f15828b19c0 20 add_watcher() i=5 2024-09-14T11:35:19.433 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:19.435+0000 7f15828b19c0 20 add_watcher() i=6 2024-09-14T11:35:19.435 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:19.439+0000 7f15828b19c0 20 add_watcher() i=7 2024-09-14T11:35:19.435 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:19.439+0000 7f15828b19c0 2 all 8 watchers are set, enabling cache 2024-09-14T11:35:19.439 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:19.443+0000 7f14367e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:35:19.440 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:19.443+0000 7f15828b19c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:35:19.440 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:19.443+0000 7f15828b19c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:35:19.440 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:19.443+0000 7f15828b19c0 5 note: GC not initialized 2024-09-14T11:35:19.441 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:19.443+0000 7f14357e2640 20 reqs_thread_entry: start 2024-09-14T11:35:19.441 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:19.443+0000 7f15828b19c0 20 init_complete bucket index max shards: 11 2024-09-14T11:35:19.441 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:19.443+0000 7f15828b19c0 20 Filter name: none 2024-09-14T11:35:19.441 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:19.443+0000 7f13a6ffd640 20 reqs_thread_entry: start 2024-09-14T11:35:19.441 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:19.443+0000 7f15828b19c0 20 rados->read ofs=0 len=0 2024-09-14T11:35:19.442 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:19.443+0000 7f15828b19c0 20 rados_obj.operate() r=0 bl.length=201 2024-09-14T11:35:19.442 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:19.443+0000 7f15828b19c0 20 rados->read ofs=0 len=0 2024-09-14T11:35:19.444 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:19.447+0000 7f15828b19c0 20 rados_obj.operate() r=0 bl.length=423 2024-09-14T11:35:19.444 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:19.447+0000 7f15828b19c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:35:19.444 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:19.447+0000 7f15828b19c0 20 rados->read ofs=0 len=0 2024-09-14T11:35:19.445 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:19.447+0000 7f15828b19c0 20 rados_obj.operate() r=0 bl.length=201 2024-09-14T11:35:19.445 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:19.447+0000 7f15828b19c0 20 rados->read ofs=0 len=0 2024-09-14T11:35:19.446 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:19.447+0000 7f15828b19c0 20 rados_obj.operate() r=0 bl.length=423 2024-09-14T11:35:19.446 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:19.447+0000 7f15828b19c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:35:19.449 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:19.451+0000 7f14367e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:35:19.453 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:19.455+0000 7f15828b19c0 20 remove_watcher() i=0 2024-09-14T11:35:19.454 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:19.455+0000 7f15828b19c0 2 removed watcher, disabling cache 2024-09-14T11:35:19.456 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:19.459+0000 7f15828b19c0 20 remove_watcher() i=1 2024-09-14T11:35:19.458 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:19.459+0000 7f15828b19c0 20 remove_watcher() i=2 2024-09-14T11:35:19.460 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:19.463+0000 7f15828b19c0 20 remove_watcher() i=3 2024-09-14T11:35:19.462 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:19.463+0000 7f15828b19c0 20 remove_watcher() i=4 2024-09-14T11:35:19.464 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:19.467+0000 7f15828b19c0 20 remove_watcher() i=5 2024-09-14T11:35:19.465 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:19.467+0000 7f15828b19c0 20 remove_watcher() i=6 2024-09-14T11:35:19.466 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:19.467+0000 7f15828b19c0 20 remove_watcher() i=7 2024-09-14T11:35:19.483 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-14T11:35:19.483 INFO:tasks.workunit.client.0.smithi138.stderr:BUCKET_STATS: 2024-09-14T11:35:19.484 INFO:tasks.workunit.client.0.smithi138.stderr:bucket: error-at-trim-reshard-log-entries id: d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.26 num_objects: 20 size_kb: 1 num_shards: 11 2024-09-14T11:35:19.484 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-14T11:35:19.484 INFO:tasks.workunit.client.0.smithi138.stderr:radosgw-admin bucket reshard --bucket error-at-trim-reshard-log-entries --num-shards 12 --rgw-reshard-bucket-lock-duration 30 --inject-error-at trim_reshard_log_entries --inject-error-code 95 2024-09-14T11:35:19.519 INFO:tasks.workunit.client.0.smithi138.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:35:19.519 INFO:tasks.workunit.client.0.smithi138.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:35:19.565 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:19.567+0000 7f5f8b9539c0 20 rados->read ofs=0 len=0 2024-09-14T11:35:19.567 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:19.567+0000 7f5f8b9539c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:35:19.567 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:19.567+0000 7f5f8b9539c0 20 realm 2024-09-14T11:35:19.567 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:19.567+0000 7f5f8b9539c0 20 rados->read ofs=0 len=0 2024-09-14T11:35:19.567 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:19.571+0000 7f5f8b9539c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:35:19.567 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:19.571+0000 7f5f8b9539c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:35:19.567 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:19.571+0000 7f5f8b9539c0 20 rados->read ofs=0 len=0 2024-09-14T11:35:19.567 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:19.571+0000 7f5f8b9539c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:35:19.568 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:19.571+0000 7f5f8b9539c0 20 rados->read ofs=0 len=0 2024-09-14T11:35:19.569 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:19.571+0000 7f5f8b9539c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:35:19.569 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:19.571+0000 7f5f8b9539c0 20 rados->read ofs=0 len=0 2024-09-14T11:35:19.570 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:19.571+0000 7f5f8b9539c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:35:19.570 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:19.571+0000 7f5f8b9539c0 20 searching for the correct realm 2024-09-14T11:35:19.571 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:19.575+0000 7f5f88c58640 0 -- 172.21.15.138:0/2983118191 >> [v2:172.21.15.154:6808/1468088432,v1:172.21.15.154:6809/1468088432] conn(0x7f5f7c034040 msgr2=0x7f5f7c034930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:35:19.786 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:19.787+0000 7f5f89459640 0 -- 172.21.15.138:0/2983118191 >> [v2:172.21.15.154:6816/1950550278,v1:172.21.15.154:6817/1950550278] conn(0x7f5f84043040 msgr2=0x7f5f84046450 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-14T11:35:20.010 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:20.011+0000 7f5f8b9539c0 20 RGWRados::pool_iterate: got zone_info.d9e72d30-c60b-4d0d-9267-fdc36392d5ad 2024-09-14T11:35:20.010 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:20.011+0000 7f5f8b9539c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:35:20.010 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:20.011+0000 7f5f8b9539c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:35:20.010 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:20.011+0000 7f5f8b9539c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:35:20.010 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:20.011+0000 7f5f8b9539c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:35:20.010 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:20.011+0000 7f5f8b9539c0 20 RGWRados::pool_iterate: got zonegroup_info.65ab941b-da8c-4160-94fb-3672b069d44f 2024-09-14T11:35:20.010 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:20.011+0000 7f5f8b9539c0 20 rados->read ofs=0 len=0 2024-09-14T11:35:20.011 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:20.011+0000 7f5f8b9539c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:35:20.011 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:20.011+0000 7f5f8b9539c0 20 rados->read ofs=0 len=0 2024-09-14T11:35:20.011 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:20.015+0000 7f5f8b9539c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:35:20.012 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:20.015+0000 7f5f8b9539c0 20 rados->read ofs=0 len=0 2024-09-14T11:35:20.012 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:20.015+0000 7f5f8b9539c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:35:20.012 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:20.015+0000 7f5f8b9539c0 20 zone default found 2024-09-14T11:35:20.013 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:20.015+0000 7f5f8b9539c0 4 Realm: () 2024-09-14T11:35:20.013 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:20.015+0000 7f5f8b9539c0 4 ZoneGroup: default (65ab941b-da8c-4160-94fb-3672b069d44f) 2024-09-14T11:35:20.013 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:20.015+0000 7f5f8b9539c0 4 Zone: default (d9e72d30-c60b-4d0d-9267-fdc36392d5ad) 2024-09-14T11:35:20.013 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:20.015+0000 7f5f8b9539c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:35:20.013 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:20.015+0000 7f5f8b9539c0 20 zonegroup default 2024-09-14T11:35:20.013 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:20.015+0000 7f5f8b9539c0 20 rados->read ofs=0 len=0 2024-09-14T11:35:20.013 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:20.015+0000 7f5f8b9539c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:35:20.013 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:20.015+0000 7f5f8b9539c0 20 rados->read ofs=0 len=0 2024-09-14T11:35:20.014 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:20.015+0000 7f5f8b9539c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:35:20.014 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:20.015+0000 7f5f8b9539c0 20 rados->read ofs=0 len=0 2024-09-14T11:35:20.014 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:20.015+0000 7f5f8b9539c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:35:20.014 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:20.015+0000 7f5f8b9539c0 20 started sync module instance, tier type = 2024-09-14T11:35:20.014 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:20.015+0000 7f5f8b9539c0 20 started zone id=d9e72d30-c60b-4d0d-9267-fdc36392d5ad (name=default) with tier type = 2024-09-14T11:35:20.038 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:20.039+0000 7f5f8b9539c0 20 add_watcher() i=0 2024-09-14T11:35:20.038 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:20.039+0000 7f5f8b9539c0 20 add_watcher() i=1 2024-09-14T11:35:20.038 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:20.039+0000 7f5f8b9539c0 20 add_watcher() i=2 2024-09-14T11:35:20.038 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:20.039+0000 7f5f8b9539c0 20 add_watcher() i=3 2024-09-14T11:35:20.038 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:20.039+0000 7f5f8b9539c0 20 add_watcher() i=4 2024-09-14T11:35:20.038 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:20.039+0000 7f5f8b9539c0 20 add_watcher() i=5 2024-09-14T11:35:20.038 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:20.039+0000 7f5f8b9539c0 20 add_watcher() i=6 2024-09-14T11:35:20.040 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:20.043+0000 7f5f8b9539c0 20 add_watcher() i=7 2024-09-14T11:35:20.040 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:20.043+0000 7f5f8b9539c0 2 all 8 watchers are set, enabling cache 2024-09-14T11:35:20.044 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:20.047+0000 7f5e3f7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:35:20.045 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:20.047+0000 7f5f8b9539c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:35:20.045 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:20.047+0000 7f5f8b9539c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:35:20.045 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:20.047+0000 7f5f8b9539c0 5 note: GC not initialized 2024-09-14T11:35:20.046 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:20.047+0000 7f5e3e7e4640 20 reqs_thread_entry: start 2024-09-14T11:35:20.046 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:20.047+0000 7f5f8b9539c0 20 init_complete bucket index max shards: 11 2024-09-14T11:35:20.046 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:20.047+0000 7f5f8b9539c0 20 Filter name: none 2024-09-14T11:35:20.047 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:20.047+0000 7f5daffff640 20 reqs_thread_entry: start 2024-09-14T11:35:20.047 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:20.047+0000 7f5f8b9539c0 10 cache get: name=default.rgw.meta+root+error-at-trim-reshard-log-entries : miss 2024-09-14T11:35:20.047 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:20.047+0000 7f5f8b9539c0 20 rados->read ofs=0 len=0 2024-09-14T11:35:20.047 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:20.051+0000 7f5f8b9539c0 20 rados_obj.operate() r=0 bl.length=201 2024-09-14T11:35:20.047 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:20.051+0000 7f5f8b9539c0 10 cache put: name=default.rgw.meta+root+error-at-trim-reshard-log-entries info.flags=0x11 2024-09-14T11:35:20.048 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:20.051+0000 7f5f8b9539c0 10 adding default.rgw.meta+root+error-at-trim-reshard-log-entries to cache LRU end 2024-09-14T11:35:20.048 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:20.051+0000 7f5f8b9539c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.26 : miss 2024-09-14T11:35:20.048 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:20.051+0000 7f5f8b9539c0 20 rados->read ofs=0 len=0 2024-09-14T11:35:20.049 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:20.051+0000 7f5f8b9539c0 20 rados_obj.operate() r=0 bl.length=423 2024-09-14T11:35:20.049 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:20.051+0000 7f5f8b9539c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.26 info.flags=0x17 2024-09-14T11:35:20.050 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:20.051+0000 7f5f8b9539c0 10 adding default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.26 to cache LRU end 2024-09-14T11:35:20.050 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:20.051+0000 7f5f8b9539c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:35:20.050 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:20.051+0000 7f5f8b9539c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:35:20.050 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:20.051+0000 7f5f8b9539c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.26 2024-09-14T11:35:20.059 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:20.063+0000 7f5f8b9539c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.26 info.flags=0x17 2024-09-14T11:35:20.060 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:20.063+0000 7f5f8b9539c0 10 moving default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.26 to cache LRU end 2024-09-14T11:35:20.060 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:20.063+0000 7f5f8b9539c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:35:20.060 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:20.063+0000 7f5f8b9539c0 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-trim-reshard-log-entries:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.26, ofs0, ns] 2024-09-14T11:35:20.060 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:20.063+0000 7f5e6cff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366182 cookie 93887954875776 notifier 6747 bl.length()=939 2024-09-14T11:35:20.061 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:20.063+0000 7f5e6cff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.26 info.flags=0x17 2024-09-14T11:35:20.061 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:20.063+0000 7f5e6cff9640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.26 to cache LRU end 2024-09-14T11:35:20.061 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:20.063+0000 7f5e6cff9640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:35:20.064 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:20.067+0000 7f5f8b9539c0 20 handle_bi_update(): bucket=:error-at-trim-reshard-log-entries[d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.26]): orig_sources= new_sources= 2024-09-14T11:35:20.064 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:20.067+0000 7f5f8b9539c0 20 handle_bi_update(): bucket=:error-at-trim-reshard-log-entries[d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.26]): potential sources added=[] removed=[] 2024-09-14T11:35:20.064 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:20.067+0000 7f5f8b9539c0 20 handle_bi_update(): bucket=:error-at-trim-reshard-log-entries[d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.26]): orig_dests= new_dests= 2024-09-14T11:35:20.064 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:20.067+0000 7f5f8b9539c0 20 handle_bi_update(): bucket=:error-at-trim-reshard-log-entries[d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.26]): potential dests added=[] removed=[] 2024-09-14T11:35:20.064 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:20.067+0000 7f5f8b9539c0 -1 Injecting error=-95 at location=trim_reshard_log_entries 2024-09-14T11:35:20.064 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:20.067+0000 7f5f8b9539c0 0 WARNING: trim_reshard_log_entries() does not supported logrecord, falling back to block reshard mode. 2024-09-14T11:35:20.070 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:20.071+0000 7f5f8b9539c0 10 bucket_obj is .dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.26.1.0 2024-09-14T11:35:20.070 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:20.071+0000 7f5f8b9539c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.26.1.0 2024-09-14T11:35:20.070 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:20.071+0000 7f5f8b9539c0 10 bucket_obj is .dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.26.1.1 2024-09-14T11:35:20.070 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:20.071+0000 7f5f8b9539c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.26.1.1 2024-09-14T11:35:20.070 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:20.071+0000 7f5f8b9539c0 10 bucket_obj is .dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.26.1.2 2024-09-14T11:35:20.070 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:20.071+0000 7f5f8b9539c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.26.1.2 2024-09-14T11:35:20.071 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:20.071+0000 7f5f8b9539c0 10 bucket_obj is .dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.26.1.3 2024-09-14T11:35:20.071 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:20.071+0000 7f5f8b9539c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.26.1.3 2024-09-14T11:35:20.071 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:20.071+0000 7f5f8b9539c0 10 bucket_obj is .dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.26.1.4 2024-09-14T11:35:20.071 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:20.071+0000 7f5f8b9539c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.26.1.4 2024-09-14T11:35:20.071 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:20.071+0000 7f5f8b9539c0 10 bucket_obj is .dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.26.1.5 2024-09-14T11:35:20.071 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:20.071+0000 7f5f8b9539c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.26.1.5 2024-09-14T11:35:20.071 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:20.071+0000 7f5f8b9539c0 10 bucket_obj is .dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.26.1.6 2024-09-14T11:35:20.071 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:20.071+0000 7f5f8b9539c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.26.1.6 2024-09-14T11:35:20.071 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:20.071+0000 7f5f8b9539c0 10 bucket_obj is .dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.26.1.7 2024-09-14T11:35:20.071 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:20.071+0000 7f5f8b9539c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.26.1.7 2024-09-14T11:35:20.071 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:20.071+0000 7f5f8b9539c0 10 bucket_obj is .dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.26.1.8 2024-09-14T11:35:20.071 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:20.071+0000 7f5f8b9539c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.26.1.8 2024-09-14T11:35:20.072 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:20.071+0000 7f5f8b9539c0 10 bucket_obj is .dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.26.1.9 2024-09-14T11:35:20.072 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:20.071+0000 7f5f8b9539c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.26.1.9 2024-09-14T11:35:20.072 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:20.071+0000 7f5f8b9539c0 10 bucket_obj is .dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.26.1.10 2024-09-14T11:35:20.072 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:20.071+0000 7f5f8b9539c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.26.1.10 2024-09-14T11:35:20.072 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:20.071+0000 7f5f8b9539c0 10 bucket_obj is .dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.26.1.11 2024-09-14T11:35:20.072 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:20.071+0000 7f5f8b9539c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.26.1.11 2024-09-14T11:35:20.072 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:20.071+0000 7f5f8b9539c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.26.0 2024-09-14T11:35:20.072 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:20.071+0000 7f5f8b9539c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.26.1 2024-09-14T11:35:20.073 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:20.075+0000 7f5f8b9539c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.26.2 2024-09-14T11:35:20.073 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:20.075+0000 7f5f8b9539c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.26.3 2024-09-14T11:35:20.073 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:20.075+0000 7f5f8b9539c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.26.4 2024-09-14T11:35:20.074 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:20.075+0000 7f5f8b9539c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.26.5 2024-09-14T11:35:20.076 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:20.079+0000 7f5f8b9539c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.26.6 2024-09-14T11:35:20.077 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:20.079+0000 7f5f8b9539c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.26.7 2024-09-14T11:35:20.078 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:20.079+0000 7f5f8b9539c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.26.8 2024-09-14T11:35:20.079 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:20.083+0000 7f5f8b9539c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.26.9 2024-09-14T11:35:20.080 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:20.083+0000 7f5f8b9539c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.26.10 2024-09-14T11:35:20.087 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:20.091+0000 7f5f8b9539c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.26 : hit (requested=0x17, cached=0x17) 2024-09-14T11:35:20.087 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:20.091+0000 7f5f8b9539c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.26 2024-09-14T11:35:20.090 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:20.091+0000 7f5f8b9539c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.26 info.flags=0x17 2024-09-14T11:35:20.090 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:20.091+0000 7f5f8b9539c0 10 moving default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.26 to cache LRU end 2024-09-14T11:35:20.090 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:20.091+0000 7f5f8b9539c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:35:20.090 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:20.091+0000 7f5f8b9539c0 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-trim-reshard-log-entries:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.26, ofs0, ns] 2024-09-14T11:35:20.090 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:20.091+0000 7f5e6cff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366183 cookie 93887954875776 notifier 6747 bl.length()=907 2024-09-14T11:35:20.090 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:20.091+0000 7f5e6cff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.26 info.flags=0x17 2024-09-14T11:35:20.091 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:20.091+0000 7f5e6cff9640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.26 to cache LRU end 2024-09-14T11:35:20.091 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:20.091+0000 7f5e6cff9640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:35:20.094 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:20.095+0000 7f5f8b9539c0 20 handle_bi_update(): bucket=:error-at-trim-reshard-log-entries[d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.26]): orig_sources= new_sources= 2024-09-14T11:35:20.094 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:20.095+0000 7f5f8b9539c0 20 handle_bi_update(): bucket=:error-at-trim-reshard-log-entries[d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.26]): potential sources added=[] removed=[] 2024-09-14T11:35:20.094 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:20.095+0000 7f5f8b9539c0 20 handle_bi_update(): bucket=:error-at-trim-reshard-log-entries[d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.26]): orig_dests= new_dests= 2024-09-14T11:35:20.095 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:20.095+0000 7f5f8b9539c0 20 handle_bi_update(): bucket=:error-at-trim-reshard-log-entries[d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.26]): potential dests added=[] removed=[] 2024-09-14T11:35:20.101 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:20.103+0000 7f5f8b9539c0 1 execute INFO: reshard of bucket "error-at-trim-reshard-log-entries" from 11 shards to 12 shards completed successfully 2024-09-14T11:35:20.104 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:20.107+0000 7f5e3f7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:35:20.109 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:20.111+0000 7f5f8b9539c0 20 remove_watcher() i=0 2024-09-14T11:35:20.109 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:20.111+0000 7f5f8b9539c0 2 removed watcher, disabling cache 2024-09-14T11:35:20.111 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:20.115+0000 7f5f8b9539c0 20 remove_watcher() i=1 2024-09-14T11:35:20.113 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:20.115+0000 7f5f8b9539c0 20 remove_watcher() i=2 2024-09-14T11:35:20.115 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:20.119+0000 7f5f8b9539c0 20 remove_watcher() i=3 2024-09-14T11:35:20.117 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:20.119+0000 7f5f8b9539c0 20 remove_watcher() i=4 2024-09-14T11:35:20.118 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:20.119+0000 7f5f8b9539c0 20 remove_watcher() i=5 2024-09-14T11:35:20.120 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:20.123+0000 7f5f8b9539c0 20 remove_watcher() i=6 2024-09-14T11:35:20.121 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:20.123+0000 7f5f8b9539c0 20 remove_watcher() i=7 2024-09-14T11:35:20.138 INFO:tasks.workunit.client.0.smithi138.stderr:radosgw-admin bucket stats --bucket error-at-trim-reshard-log-entries 2024-09-14T11:35:20.165 INFO:tasks.workunit.client.0.smithi138.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:35:20.165 INFO:tasks.workunit.client.0.smithi138.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:35:20.209 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:20.211+0000 7f646396b9c0 20 rados->read ofs=0 len=0 2024-09-14T11:35:20.212 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:20.215+0000 7f646396b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:35:20.212 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:20.215+0000 7f646396b9c0 20 realm 2024-09-14T11:35:20.212 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:20.215+0000 7f646396b9c0 20 rados->read ofs=0 len=0 2024-09-14T11:35:20.212 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:20.215+0000 7f646396b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:35:20.212 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:20.215+0000 7f646396b9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:35:20.212 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:20.215+0000 7f646396b9c0 20 rados->read ofs=0 len=0 2024-09-14T11:35:20.212 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:20.215+0000 7f646396b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:35:20.213 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:20.215+0000 7f646396b9c0 20 rados->read ofs=0 len=0 2024-09-14T11:35:20.213 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:20.215+0000 7f646396b9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:35:20.213 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:20.215+0000 7f646396b9c0 20 rados->read ofs=0 len=0 2024-09-14T11:35:20.214 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:20.215+0000 7f646396b9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:35:20.214 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:20.215+0000 7f646396b9c0 20 searching for the correct realm 2024-09-14T11:35:20.219 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:20.223+0000 7f6461471640 0 -- 172.21.15.138:0/1310078406 >> [v2:172.21.15.138:6808/3258321916,v1:172.21.15.138:6809/3258321916] conn(0x55f34906e280 msgr2=0x55f349070740 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:35:20.225 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:20.227+0000 7f6460c70640 0 -- 172.21.15.138:0/1310078406 >> [v2:172.21.15.138:6816/326481658,v1:172.21.15.138:6817/326481658] conn(0x7f645c06fb40 msgr2=0x7f645c064ac0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:35:20.234 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:20.235+0000 7f646396b9c0 20 RGWRados::pool_iterate: got zone_info.d9e72d30-c60b-4d0d-9267-fdc36392d5ad 2024-09-14T11:35:20.234 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:20.235+0000 7f646396b9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:35:20.234 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:20.235+0000 7f646396b9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:35:20.234 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:20.235+0000 7f646396b9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:35:20.234 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:20.235+0000 7f646396b9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:35:20.234 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:20.235+0000 7f646396b9c0 20 RGWRados::pool_iterate: got zonegroup_info.65ab941b-da8c-4160-94fb-3672b069d44f 2024-09-14T11:35:20.235 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:20.235+0000 7f646396b9c0 20 rados->read ofs=0 len=0 2024-09-14T11:35:20.235 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:20.235+0000 7f646396b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:35:20.235 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:20.235+0000 7f646396b9c0 20 rados->read ofs=0 len=0 2024-09-14T11:35:20.236 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:20.239+0000 7f646396b9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:35:20.236 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:20.239+0000 7f646396b9c0 20 rados->read ofs=0 len=0 2024-09-14T11:35:20.236 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:20.239+0000 7f646396b9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:35:20.236 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:20.239+0000 7f646396b9c0 20 zone default found 2024-09-14T11:35:20.236 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:20.239+0000 7f646396b9c0 4 Realm: () 2024-09-14T11:35:20.236 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:20.239+0000 7f646396b9c0 4 ZoneGroup: default (65ab941b-da8c-4160-94fb-3672b069d44f) 2024-09-14T11:35:20.236 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:20.239+0000 7f646396b9c0 4 Zone: default (d9e72d30-c60b-4d0d-9267-fdc36392d5ad) 2024-09-14T11:35:20.236 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:20.239+0000 7f646396b9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:35:20.237 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:20.239+0000 7f646396b9c0 20 zonegroup default 2024-09-14T11:35:20.237 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:20.239+0000 7f646396b9c0 20 rados->read ofs=0 len=0 2024-09-14T11:35:20.237 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:20.239+0000 7f646396b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:35:20.237 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:20.239+0000 7f646396b9c0 20 rados->read ofs=0 len=0 2024-09-14T11:35:20.238 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:20.239+0000 7f646396b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:35:20.238 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:20.239+0000 7f646396b9c0 20 rados->read ofs=0 len=0 2024-09-14T11:35:20.238 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:20.239+0000 7f646396b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:35:20.238 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:20.239+0000 7f646396b9c0 20 started sync module instance, tier type = 2024-09-14T11:35:20.238 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:20.239+0000 7f646396b9c0 20 started zone id=d9e72d30-c60b-4d0d-9267-fdc36392d5ad (name=default) with tier type = 2024-09-14T11:35:20.253 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:20.255+0000 7f646396b9c0 20 add_watcher() i=0 2024-09-14T11:35:20.253 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:20.255+0000 7f646396b9c0 20 add_watcher() i=1 2024-09-14T11:35:20.254 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:20.255+0000 7f646396b9c0 20 add_watcher() i=2 2024-09-14T11:35:20.254 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:20.255+0000 7f646396b9c0 20 add_watcher() i=3 2024-09-14T11:35:20.254 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:20.255+0000 7f646396b9c0 20 add_watcher() i=4 2024-09-14T11:35:20.254 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:20.255+0000 7f646396b9c0 20 add_watcher() i=5 2024-09-14T11:35:20.254 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:20.255+0000 7f646396b9c0 20 add_watcher() i=6 2024-09-14T11:35:20.254 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:20.259+0000 7f646396b9c0 20 add_watcher() i=7 2024-09-14T11:35:20.254 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:20.259+0000 7f646396b9c0 2 all 8 watchers are set, enabling cache 2024-09-14T11:35:20.258 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:20.259+0000 7f63177e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:35:20.258 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:20.259+0000 7f646396b9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:35:20.258 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:20.259+0000 7f646396b9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:35:20.258 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:20.259+0000 7f646396b9c0 5 note: GC not initialized 2024-09-14T11:35:20.258 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:20.259+0000 7f63167e4640 20 reqs_thread_entry: start 2024-09-14T11:35:20.259 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:20.259+0000 7f646396b9c0 20 init_complete bucket index max shards: 11 2024-09-14T11:35:20.259 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:20.259+0000 7f646396b9c0 20 Filter name: none 2024-09-14T11:35:20.259 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:20.259+0000 7f6287fff640 20 reqs_thread_entry: start 2024-09-14T11:35:20.259 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:20.259+0000 7f646396b9c0 20 rados->read ofs=0 len=0 2024-09-14T11:35:20.259 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:20.263+0000 7f646396b9c0 20 rados_obj.operate() r=0 bl.length=201 2024-09-14T11:35:20.260 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:20.263+0000 7f646396b9c0 20 rados->read ofs=0 len=0 2024-09-14T11:35:20.261 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:20.263+0000 7f646396b9c0 20 rados_obj.operate() r=0 bl.length=423 2024-09-14T11:35:20.261 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:20.263+0000 7f646396b9c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:35:20.261 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:20.263+0000 7f646396b9c0 20 rados->read ofs=0 len=0 2024-09-14T11:35:20.262 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:20.263+0000 7f646396b9c0 20 rados_obj.operate() r=0 bl.length=201 2024-09-14T11:35:20.262 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:20.263+0000 7f646396b9c0 20 rados->read ofs=0 len=0 2024-09-14T11:35:20.263 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:20.267+0000 7f646396b9c0 20 rados_obj.operate() r=0 bl.length=423 2024-09-14T11:35:20.263 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:20.267+0000 7f646396b9c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:35:20.265 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:20.267+0000 7f63177e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:35:20.270 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:20.271+0000 7f646396b9c0 20 remove_watcher() i=0 2024-09-14T11:35:20.270 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:20.271+0000 7f646396b9c0 2 removed watcher, disabling cache 2024-09-14T11:35:20.272 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:20.275+0000 7f646396b9c0 20 remove_watcher() i=1 2024-09-14T11:35:20.274 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:20.279+0000 7f646396b9c0 20 remove_watcher() i=2 2024-09-14T11:35:20.276 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:20.279+0000 7f646396b9c0 20 remove_watcher() i=3 2024-09-14T11:35:20.279 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:20.283+0000 7f646396b9c0 20 remove_watcher() i=4 2024-09-14T11:35:20.280 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:20.283+0000 7f646396b9c0 20 remove_watcher() i=5 2024-09-14T11:35:20.281 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:20.283+0000 7f646396b9c0 20 remove_watcher() i=6 2024-09-14T11:35:20.282 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:20.283+0000 7f646396b9c0 20 remove_watcher() i=7 2024-09-14T11:35:20.296 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-14T11:35:20.296 INFO:tasks.workunit.client.0.smithi138.stderr:BUCKET_STATS: 2024-09-14T11:35:20.296 INFO:tasks.workunit.client.0.smithi138.stderr:bucket: error-at-trim-reshard-log-entries id: d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.26 num_objects: 20 size_kb: 1 num_shards: 12 2024-09-14T11:35:20.296 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-14T11:35:20.297 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:35:20.297 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-14T11:35:20.320 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:35:20.320 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-14T11:35:20.824 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:35:20.824 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-14T11:35:21.224 INFO:tasks.workunit.client.0.smithi138.stderr:TEST: reshard bucket with abort at trim_reshard_log_entries 2024-09-14T11:35:21.224 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-14T11:35:21.229 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:35:21.229 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-14T11:35:21.368 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:35:21.368 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-14T11:35:21.459 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:35:21.459 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-14T11:35:21.565 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:35:21.565 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-14T11:35:21.658 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:35:21.658 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-14T11:35:21.744 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:35:21.744 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-14T11:35:21.840 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:35:21.840 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-14T11:35:21.935 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:35:21.935 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-14T11:35:22.028 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:35:22.028 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-14T11:35:22.117 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:35:22.117 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-14T11:35:22.216 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:35:22.216 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-14T11:35:22.305 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:35:22.305 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-14T11:35:22.407 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:35:22.407 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-14T11:35:22.501 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:35:22.501 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-14T11:35:22.597 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:35:22.597 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-14T11:35:22.692 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:35:22.692 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-14T11:35:22.788 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:35:22.788 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-14T11:35:22.882 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:35:22.883 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-14T11:35:22.973 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:35:22.973 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-14T11:35:23.067 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:35:23.068 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-14T11:35:23.148 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:35:23.148 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-14T11:35:23.245 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:35:23.245 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-14T11:35:23.336 INFO:tasks.workunit.client.0.smithi138.stderr:radosgw-admin bucket stats --bucket abort-at-trim-reshard-log-entries 2024-09-14T11:35:23.369 INFO:tasks.workunit.client.0.smithi138.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:35:23.369 INFO:tasks.workunit.client.0.smithi138.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:35:23.414 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:23.415+0000 7f87c83649c0 20 rados->read ofs=0 len=0 2024-09-14T11:35:23.416 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:23.419+0000 7f87c83649c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:35:23.416 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:23.419+0000 7f87c83649c0 20 realm 2024-09-14T11:35:23.416 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:23.419+0000 7f87c83649c0 20 rados->read ofs=0 len=0 2024-09-14T11:35:23.416 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:23.419+0000 7f87c83649c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:35:23.416 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:23.419+0000 7f87c83649c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:35:23.416 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:23.419+0000 7f87c83649c0 20 rados->read ofs=0 len=0 2024-09-14T11:35:23.417 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:23.419+0000 7f87c83649c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:35:23.417 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:23.419+0000 7f87c83649c0 20 rados->read ofs=0 len=0 2024-09-14T11:35:23.418 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:23.419+0000 7f87c83649c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:35:23.418 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:23.419+0000 7f87c83649c0 20 rados->read ofs=0 len=0 2024-09-14T11:35:23.419 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:23.423+0000 7f87c83649c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:35:23.419 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:23.423+0000 7f87c83649c0 20 searching for the correct realm 2024-09-14T11:35:23.422 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:23.423+0000 7f87c666b640 0 -- 172.21.15.138:0/3244898727 >> [v2:172.21.15.154:6824/416768175,v1:172.21.15.154:6825/416768175] conn(0x7f87b8008040 msgr2=0x7f87b803a400 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-14T11:35:23.430 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:23.431+0000 7f87c5669640 0 -- 172.21.15.138:0/3244898727 >> [v2:172.21.15.138:6816/326481658,v1:172.21.15.138:6817/326481658] conn(0x7f87b8049920 msgr2=0x7f87b802c3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-14T11:35:23.648 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:23.651+0000 7f87c83649c0 20 RGWRados::pool_iterate: got zone_info.d9e72d30-c60b-4d0d-9267-fdc36392d5ad 2024-09-14T11:35:23.648 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:23.651+0000 7f87c83649c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:35:23.648 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:23.651+0000 7f87c83649c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:35:23.648 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:23.651+0000 7f87c83649c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:35:23.648 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:23.651+0000 7f87c83649c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:35:23.648 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:23.651+0000 7f87c83649c0 20 RGWRados::pool_iterate: got zonegroup_info.65ab941b-da8c-4160-94fb-3672b069d44f 2024-09-14T11:35:23.649 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:23.651+0000 7f87c83649c0 20 rados->read ofs=0 len=0 2024-09-14T11:35:23.649 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:23.651+0000 7f87c83649c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:35:23.649 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:23.651+0000 7f87c83649c0 20 rados->read ofs=0 len=0 2024-09-14T11:35:23.650 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:23.651+0000 7f87c83649c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:35:23.650 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:23.651+0000 7f87c83649c0 20 rados->read ofs=0 len=0 2024-09-14T11:35:23.651 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:23.655+0000 7f87c83649c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:35:23.651 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:23.655+0000 7f87c83649c0 20 zone default found 2024-09-14T11:35:23.651 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:23.655+0000 7f87c83649c0 4 Realm: () 2024-09-14T11:35:23.651 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:23.655+0000 7f87c83649c0 4 ZoneGroup: default (65ab941b-da8c-4160-94fb-3672b069d44f) 2024-09-14T11:35:23.651 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:23.655+0000 7f87c83649c0 4 Zone: default (d9e72d30-c60b-4d0d-9267-fdc36392d5ad) 2024-09-14T11:35:23.651 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:23.655+0000 7f87c83649c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:35:23.651 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:23.655+0000 7f87c83649c0 20 zonegroup default 2024-09-14T11:35:23.651 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:23.655+0000 7f87c83649c0 20 rados->read ofs=0 len=0 2024-09-14T11:35:23.652 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:23.655+0000 7f87c83649c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:35:23.652 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:23.655+0000 7f87c83649c0 20 rados->read ofs=0 len=0 2024-09-14T11:35:23.653 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:23.655+0000 7f87c83649c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:35:23.653 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:23.655+0000 7f87c83649c0 20 rados->read ofs=0 len=0 2024-09-14T11:35:23.653 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:23.655+0000 7f87c83649c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:35:23.653 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:23.655+0000 7f87c83649c0 20 started sync module instance, tier type = 2024-09-14T11:35:23.653 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:23.655+0000 7f87c83649c0 20 started zone id=d9e72d30-c60b-4d0d-9267-fdc36392d5ad (name=default) with tier type = 2024-09-14T11:35:23.677 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:23.679+0000 7f87c83649c0 20 add_watcher() i=0 2024-09-14T11:35:23.677 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:23.679+0000 7f87c83649c0 20 add_watcher() i=1 2024-09-14T11:35:23.677 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:23.679+0000 7f87c83649c0 20 add_watcher() i=2 2024-09-14T11:35:23.677 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:23.679+0000 7f87c83649c0 20 add_watcher() i=3 2024-09-14T11:35:23.678 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:23.679+0000 7f87c83649c0 20 add_watcher() i=4 2024-09-14T11:35:23.678 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:23.679+0000 7f87c83649c0 20 add_watcher() i=5 2024-09-14T11:35:23.678 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:23.679+0000 7f87c83649c0 20 add_watcher() i=6 2024-09-14T11:35:23.679 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:23.683+0000 7f87c83649c0 20 add_watcher() i=7 2024-09-14T11:35:23.680 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:23.683+0000 7f87c83649c0 2 all 8 watchers are set, enabling cache 2024-09-14T11:35:23.684 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:23.687+0000 7f86777fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:35:23.685 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:23.687+0000 7f87c83649c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:35:23.685 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:23.687+0000 7f87c83649c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:35:23.685 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:23.687+0000 7f87c83649c0 5 note: GC not initialized 2024-09-14T11:35:23.686 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:23.687+0000 7f86767fc640 20 reqs_thread_entry: start 2024-09-14T11:35:23.686 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:23.687+0000 7f87c83649c0 20 init_complete bucket index max shards: 11 2024-09-14T11:35:23.686 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:23.687+0000 7f87c83649c0 20 Filter name: none 2024-09-14T11:35:23.686 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:23.687+0000 7f85e7fff640 20 reqs_thread_entry: start 2024-09-14T11:35:23.686 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:23.687+0000 7f87c83649c0 20 rados->read ofs=0 len=0 2024-09-14T11:35:23.687 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:23.691+0000 7f87c83649c0 20 rados_obj.operate() r=0 bl.length=201 2024-09-14T11:35:23.688 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:23.691+0000 7f87c83649c0 20 rados->read ofs=0 len=0 2024-09-14T11:35:23.688 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:23.691+0000 7f87c83649c0 20 rados_obj.operate() r=0 bl.length=423 2024-09-14T11:35:23.688 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:23.691+0000 7f87c83649c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:35:23.688 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:23.691+0000 7f87c83649c0 20 rados->read ofs=0 len=0 2024-09-14T11:35:23.689 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:23.691+0000 7f87c83649c0 20 rados_obj.operate() r=0 bl.length=201 2024-09-14T11:35:23.689 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:23.691+0000 7f87c83649c0 20 rados->read ofs=0 len=0 2024-09-14T11:35:23.690 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:23.691+0000 7f87c83649c0 20 rados_obj.operate() r=0 bl.length=423 2024-09-14T11:35:23.690 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:23.691+0000 7f87c83649c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:35:23.694 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:23.699+0000 7f86777fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:35:23.699 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:23.703+0000 7f87c83649c0 20 remove_watcher() i=0 2024-09-14T11:35:23.699 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:23.703+0000 7f87c83649c0 2 removed watcher, disabling cache 2024-09-14T11:35:23.701 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:23.703+0000 7f87c83649c0 20 remove_watcher() i=1 2024-09-14T11:35:23.703 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:23.707+0000 7f87c83649c0 20 remove_watcher() i=2 2024-09-14T11:35:23.706 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:23.707+0000 7f87c83649c0 20 remove_watcher() i=3 2024-09-14T11:35:23.708 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:23.711+0000 7f87c83649c0 20 remove_watcher() i=4 2024-09-14T11:35:23.710 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:23.711+0000 7f87c83649c0 20 remove_watcher() i=5 2024-09-14T11:35:23.711 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:23.715+0000 7f87c83649c0 20 remove_watcher() i=6 2024-09-14T11:35:23.712 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:23.715+0000 7f87c83649c0 20 remove_watcher() i=7 2024-09-14T11:35:23.727 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-14T11:35:23.727 INFO:tasks.workunit.client.0.smithi138.stderr:BUCKET_STATS: 2024-09-14T11:35:23.727 INFO:tasks.workunit.client.0.smithi138.stderr:bucket: abort-at-trim-reshard-log-entries id: d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.27 num_objects: 20 size_kb: 1 num_shards: 11 2024-09-14T11:35:23.728 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-14T11:35:23.728 INFO:tasks.workunit.client.0.smithi138.stderr:radosgw-admin bucket reshard --bucket abort-at-trim-reshard-log-entries --num-shards 12 --rgw-reshard-bucket-lock-duration 30 --inject-abort-at trim_reshard_log_entries 2024-09-14T11:35:23.764 INFO:tasks.workunit.client.0.smithi138.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:35:23.764 INFO:tasks.workunit.client.0.smithi138.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:35:23.807 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:23.811+0000 7fd66db0c9c0 20 rados->read ofs=0 len=0 2024-09-14T11:35:23.810 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:23.811+0000 7fd66db0c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:35:23.810 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:23.811+0000 7fd66db0c9c0 20 realm 2024-09-14T11:35:23.810 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:23.811+0000 7fd66db0c9c0 20 rados->read ofs=0 len=0 2024-09-14T11:35:23.810 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:23.811+0000 7fd66db0c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:35:23.810 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:23.811+0000 7fd66db0c9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:35:23.810 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:23.811+0000 7fd66db0c9c0 20 rados->read ofs=0 len=0 2024-09-14T11:35:23.810 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:23.811+0000 7fd66db0c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:35:23.810 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:23.811+0000 7fd66db0c9c0 20 rados->read ofs=0 len=0 2024-09-14T11:35:23.812 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:23.815+0000 7fd66db0c9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:35:23.812 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:23.815+0000 7fd66db0c9c0 20 rados->read ofs=0 len=0 2024-09-14T11:35:23.812 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:23.815+0000 7fd66db0c9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:35:23.812 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:23.815+0000 7fd66db0c9c0 20 searching for the correct realm 2024-09-14T11:35:23.816 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:23.819+0000 7fd66be13640 0 -- 172.21.15.138:0/3136175301 >> [v2:172.21.15.154:6824/416768175,v1:172.21.15.154:6825/416768175] conn(0x7fd664064900 msgr2=0x7fd664063370 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:35:24.032 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:24.035+0000 7fd66ae11640 0 -- 172.21.15.138:0/3136175301 >> [v2:172.21.15.138:6816/326481658,v1:172.21.15.138:6817/326481658] conn(0x7fd66406dba0 msgr2=0x7fd66407e900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:35:24.250 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:24.251+0000 7fd66db0c9c0 20 RGWRados::pool_iterate: got zone_info.d9e72d30-c60b-4d0d-9267-fdc36392d5ad 2024-09-14T11:35:24.250 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:24.251+0000 7fd66db0c9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:35:24.250 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:24.251+0000 7fd66db0c9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:35:24.250 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:24.251+0000 7fd66db0c9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:35:24.250 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:24.251+0000 7fd66db0c9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:35:24.250 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:24.251+0000 7fd66db0c9c0 20 RGWRados::pool_iterate: got zonegroup_info.65ab941b-da8c-4160-94fb-3672b069d44f 2024-09-14T11:35:24.250 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:24.251+0000 7fd66db0c9c0 20 rados->read ofs=0 len=0 2024-09-14T11:35:24.251 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:24.251+0000 7fd66db0c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:35:24.251 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:24.251+0000 7fd66db0c9c0 20 rados->read ofs=0 len=0 2024-09-14T11:35:24.251 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:24.255+0000 7fd66db0c9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:35:24.251 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:24.255+0000 7fd66db0c9c0 20 rados->read ofs=0 len=0 2024-09-14T11:35:24.252 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:24.255+0000 7fd66db0c9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:35:24.252 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:24.255+0000 7fd66db0c9c0 20 zone default found 2024-09-14T11:35:24.252 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:24.255+0000 7fd66db0c9c0 4 Realm: () 2024-09-14T11:35:24.252 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:24.255+0000 7fd66db0c9c0 4 ZoneGroup: default (65ab941b-da8c-4160-94fb-3672b069d44f) 2024-09-14T11:35:24.253 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:24.255+0000 7fd66db0c9c0 4 Zone: default (d9e72d30-c60b-4d0d-9267-fdc36392d5ad) 2024-09-14T11:35:24.253 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:24.255+0000 7fd66db0c9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:35:24.253 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:24.255+0000 7fd66db0c9c0 20 zonegroup default 2024-09-14T11:35:24.253 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:24.255+0000 7fd66db0c9c0 20 rados->read ofs=0 len=0 2024-09-14T11:35:24.253 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:24.255+0000 7fd66db0c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:35:24.253 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:24.255+0000 7fd66db0c9c0 20 rados->read ofs=0 len=0 2024-09-14T11:35:24.254 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:24.255+0000 7fd66db0c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:35:24.254 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:24.255+0000 7fd66db0c9c0 20 rados->read ofs=0 len=0 2024-09-14T11:35:24.255 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:24.259+0000 7fd66db0c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:35:24.255 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:24.259+0000 7fd66db0c9c0 20 started sync module instance, tier type = 2024-09-14T11:35:24.255 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:24.259+0000 7fd66db0c9c0 20 started zone id=d9e72d30-c60b-4d0d-9267-fdc36392d5ad (name=default) with tier type = 2024-09-14T11:35:24.280 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:24.283+0000 7fd66db0c9c0 20 add_watcher() i=0 2024-09-14T11:35:24.280 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:24.283+0000 7fd66db0c9c0 20 add_watcher() i=1 2024-09-14T11:35:24.280 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:24.283+0000 7fd66db0c9c0 20 add_watcher() i=2 2024-09-14T11:35:24.280 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:24.283+0000 7fd66db0c9c0 20 add_watcher() i=3 2024-09-14T11:35:24.280 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:24.283+0000 7fd66db0c9c0 20 add_watcher() i=4 2024-09-14T11:35:24.280 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:24.283+0000 7fd66db0c9c0 20 add_watcher() i=5 2024-09-14T11:35:24.280 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:24.283+0000 7fd66db0c9c0 20 add_watcher() i=6 2024-09-14T11:35:24.282 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:24.283+0000 7fd66db0c9c0 20 add_watcher() i=7 2024-09-14T11:35:24.282 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:24.283+0000 7fd66db0c9c0 2 all 8 watchers are set, enabling cache 2024-09-14T11:35:24.286 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:24.287+0000 7fd521fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:35:24.287 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:24.291+0000 7fd66db0c9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:35:24.287 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:24.291+0000 7fd66db0c9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:35:24.287 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:24.291+0000 7fd66db0c9c0 5 note: GC not initialized 2024-09-14T11:35:24.288 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:24.291+0000 7fd520fe1640 20 reqs_thread_entry: start 2024-09-14T11:35:24.288 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:24.291+0000 7fd66db0c9c0 20 init_complete bucket index max shards: 11 2024-09-14T11:35:24.288 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:24.291+0000 7fd66db0c9c0 20 Filter name: none 2024-09-14T11:35:24.288 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:24.291+0000 7fd49a7fc640 20 reqs_thread_entry: start 2024-09-14T11:35:24.288 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:24.291+0000 7fd66db0c9c0 10 cache get: name=default.rgw.meta+root+abort-at-trim-reshard-log-entries : miss 2024-09-14T11:35:24.288 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:24.291+0000 7fd66db0c9c0 20 rados->read ofs=0 len=0 2024-09-14T11:35:24.290 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:24.291+0000 7fd66db0c9c0 20 rados_obj.operate() r=0 bl.length=201 2024-09-14T11:35:24.290 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:24.291+0000 7fd66db0c9c0 10 cache put: name=default.rgw.meta+root+abort-at-trim-reshard-log-entries info.flags=0x11 2024-09-14T11:35:24.290 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:24.291+0000 7fd66db0c9c0 10 adding default.rgw.meta+root+abort-at-trim-reshard-log-entries to cache LRU end 2024-09-14T11:35:24.290 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:24.291+0000 7fd66db0c9c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.27 : miss 2024-09-14T11:35:24.290 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:24.291+0000 7fd66db0c9c0 20 rados->read ofs=0 len=0 2024-09-14T11:35:24.291 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:24.295+0000 7fd66db0c9c0 20 rados_obj.operate() r=0 bl.length=423 2024-09-14T11:35:24.291 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:24.295+0000 7fd66db0c9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.27 info.flags=0x17 2024-09-14T11:35:24.291 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:24.295+0000 7fd66db0c9c0 10 adding default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.27 to cache LRU end 2024-09-14T11:35:24.291 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:24.295+0000 7fd66db0c9c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:35:24.291 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:24.295+0000 7fd66db0c9c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:35:24.291 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:24.295+0000 7fd66db0c9c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.27 2024-09-14T11:35:24.301 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:24.303+0000 7fd66db0c9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.27 info.flags=0x17 2024-09-14T11:35:24.301 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:24.303+0000 7fd66db0c9c0 10 moving default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.27 to cache LRU end 2024-09-14T11:35:24.301 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:24.303+0000 7fd66db0c9c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:35:24.301 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:24.303+0000 7fd66db0c9c0 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-trim-reshard-log-entries:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.27, ofs0, ns] 2024-09-14T11:35:24.302 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:24.303+0000 7fd54effd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366221 cookie 94485764207776 notifier 6801 bl.length()=939 2024-09-14T11:35:24.302 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:24.303+0000 7fd54effd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.27 info.flags=0x17 2024-09-14T11:35:24.302 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:24.303+0000 7fd54effd640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.27 to cache LRU end 2024-09-14T11:35:24.302 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:24.303+0000 7fd54effd640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:35:24.304 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:24.307+0000 7fd66db0c9c0 20 handle_bi_update(): bucket=:abort-at-trim-reshard-log-entries[d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.27]): orig_sources= new_sources= 2024-09-14T11:35:24.305 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:24.307+0000 7fd66db0c9c0 20 handle_bi_update(): bucket=:abort-at-trim-reshard-log-entries[d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.27]): potential sources added=[] removed=[] 2024-09-14T11:35:24.305 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:24.307+0000 7fd66db0c9c0 20 handle_bi_update(): bucket=:abort-at-trim-reshard-log-entries[d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.27]): orig_dests= new_dests= 2024-09-14T11:35:24.305 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:24.307+0000 7fd66db0c9c0 20 handle_bi_update(): bucket=:abort-at-trim-reshard-log-entries[d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.27]): potential dests added=[] removed=[] 2024-09-14T11:35:24.305 INFO:tasks.workunit.client.0.smithi138.stderr:./src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7fd66db0c9c0 time 2024-09-14T11:35:24.310908+0000 2024-09-14T11:35:24.305 INFO:tasks.workunit.client.0.smithi138.stderr:./src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-14T11:35:24.306 INFO:tasks.workunit.client.0.smithi138.stderr: ceph version 19.3.0-4907-ga2782315 (a2782315255a3e7d5f6cdc9eb35785187ff6ddf8) squid (dev) 2024-09-14T11:35:24.306 INFO:tasks.workunit.client.0.smithi138.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x121) [0x7fd6713e62eb] 2024-09-14T11:35:24.306 INFO:tasks.workunit.client.0.smithi138.stderr: 2: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7fd6713e649f] 2024-09-14T11:35:24.306 INFO:tasks.workunit.client.0.smithi138.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55ef2c6fcc01] 2024-09-14T11:35:24.306 INFO:tasks.workunit.client.0.smithi138.stderr: 4: radosgw-admin(+0x14231ee) [0x55ef2d15b1ee] 2024-09-14T11:35:24.306 INFO:tasks.workunit.client.0.smithi138.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x55ef2c711ecd] 2024-09-14T11:35:24.307 INFO:tasks.workunit.client.0.smithi138.stderr: 6: main() 2024-09-14T11:35:24.307 INFO:tasks.workunit.client.0.smithi138.stderr: 7: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7fd67024cd90] 2024-09-14T11:35:24.307 INFO:tasks.workunit.client.0.smithi138.stderr: 8: __libc_start_main() 2024-09-14T11:35:24.307 INFO:tasks.workunit.client.0.smithi138.stderr: 9: _start() 2024-09-14T11:35:24.307 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:24.307+0000 7fd66db0c9c0 -1 ./src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7fd66db0c9c0 time 2024-09-14T11:35:24.310908+0000 2024-09-14T11:35:24.307 INFO:tasks.workunit.client.0.smithi138.stderr:./src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-14T11:35:24.307 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-14T11:35:24.307 INFO:tasks.workunit.client.0.smithi138.stderr: ceph version 19.3.0-4907-ga2782315 (a2782315255a3e7d5f6cdc9eb35785187ff6ddf8) squid (dev) 2024-09-14T11:35:24.307 INFO:tasks.workunit.client.0.smithi138.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x121) [0x7fd6713e62eb] 2024-09-14T11:35:24.307 INFO:tasks.workunit.client.0.smithi138.stderr: 2: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7fd6713e649f] 2024-09-14T11:35:24.307 INFO:tasks.workunit.client.0.smithi138.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55ef2c6fcc01] 2024-09-14T11:35:24.307 INFO:tasks.workunit.client.0.smithi138.stderr: 4: radosgw-admin(+0x14231ee) [0x55ef2d15b1ee] 2024-09-14T11:35:24.307 INFO:tasks.workunit.client.0.smithi138.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x55ef2c711ecd] 2024-09-14T11:35:24.308 INFO:tasks.workunit.client.0.smithi138.stderr: 6: main() 2024-09-14T11:35:24.308 INFO:tasks.workunit.client.0.smithi138.stderr: 7: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7fd67024cd90] 2024-09-14T11:35:24.308 INFO:tasks.workunit.client.0.smithi138.stderr: 8: __libc_start_main() 2024-09-14T11:35:24.308 INFO:tasks.workunit.client.0.smithi138.stderr: 9: _start() 2024-09-14T11:35:24.308 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-14T11:35:24.308 INFO:tasks.workunit.client.0.smithi138.stderr:*** Caught signal (Aborted) ** 2024-09-14T11:35:24.308 INFO:tasks.workunit.client.0.smithi138.stderr: in thread 7fd66db0c9c0 thread_name:radosgw-admin 2024-09-14T11:35:24.318 INFO:tasks.workunit.client.0.smithi138.stderr: ceph version 19.3.0-4907-ga2782315 (a2782315255a3e7d5f6cdc9eb35785187ff6ddf8) squid (dev) 2024-09-14T11:35:24.318 INFO:tasks.workunit.client.0.smithi138.stderr: 1: /lib/x86_64-linux-gnu/libc.so.6(+0x42520) [0x7fd670265520] 2024-09-14T11:35:24.318 INFO:tasks.workunit.client.0.smithi138.stderr: 2: pthread_kill() 2024-09-14T11:35:24.318 INFO:tasks.workunit.client.0.smithi138.stderr: 3: raise() 2024-09-14T11:35:24.318 INFO:tasks.workunit.client.0.smithi138.stderr: 4: abort() 2024-09-14T11:35:24.318 INFO:tasks.workunit.client.0.smithi138.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x17b) [0x7fd6713e6345] 2024-09-14T11:35:24.318 INFO:tasks.workunit.client.0.smithi138.stderr: 6: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7fd6713e649f] 2024-09-14T11:35:24.319 INFO:tasks.workunit.client.0.smithi138.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55ef2c6fcc01] 2024-09-14T11:35:24.319 INFO:tasks.workunit.client.0.smithi138.stderr: 8: radosgw-admin(+0x14231ee) [0x55ef2d15b1ee] 2024-09-14T11:35:24.319 INFO:tasks.workunit.client.0.smithi138.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x55ef2c711ecd] 2024-09-14T11:35:24.319 INFO:tasks.workunit.client.0.smithi138.stderr: 10: main() 2024-09-14T11:35:24.319 INFO:tasks.workunit.client.0.smithi138.stderr: 11: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7fd67024cd90] 2024-09-14T11:35:24.319 INFO:tasks.workunit.client.0.smithi138.stderr: 12: __libc_start_main() 2024-09-14T11:35:24.319 INFO:tasks.workunit.client.0.smithi138.stderr: 13: _start() 2024-09-14T11:35:24.319 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:24.311+0000 7fd66db0c9c0 -1 *** Caught signal (Aborted) ** 2024-09-14T11:35:24.319 INFO:tasks.workunit.client.0.smithi138.stderr: in thread 7fd66db0c9c0 thread_name:radosgw-admin 2024-09-14T11:35:24.319 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-14T11:35:24.319 INFO:tasks.workunit.client.0.smithi138.stderr: ceph version 19.3.0-4907-ga2782315 (a2782315255a3e7d5f6cdc9eb35785187ff6ddf8) squid (dev) 2024-09-14T11:35:24.319 INFO:tasks.workunit.client.0.smithi138.stderr: 1: /lib/x86_64-linux-gnu/libc.so.6(+0x42520) [0x7fd670265520] 2024-09-14T11:35:24.319 INFO:tasks.workunit.client.0.smithi138.stderr: 2: pthread_kill() 2024-09-14T11:35:24.319 INFO:tasks.workunit.client.0.smithi138.stderr: 3: raise() 2024-09-14T11:35:24.319 INFO:tasks.workunit.client.0.smithi138.stderr: 4: abort() 2024-09-14T11:35:24.320 INFO:tasks.workunit.client.0.smithi138.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x17b) [0x7fd6713e6345] 2024-09-14T11:35:24.320 INFO:tasks.workunit.client.0.smithi138.stderr: 6: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7fd6713e649f] 2024-09-14T11:35:24.320 INFO:tasks.workunit.client.0.smithi138.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55ef2c6fcc01] 2024-09-14T11:35:24.320 INFO:tasks.workunit.client.0.smithi138.stderr: 8: radosgw-admin(+0x14231ee) [0x55ef2d15b1ee] 2024-09-14T11:35:24.320 INFO:tasks.workunit.client.0.smithi138.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x55ef2c711ecd] 2024-09-14T11:35:24.320 INFO:tasks.workunit.client.0.smithi138.stderr: 10: main() 2024-09-14T11:35:24.320 INFO:tasks.workunit.client.0.smithi138.stderr: 11: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7fd67024cd90] 2024-09-14T11:35:24.320 INFO:tasks.workunit.client.0.smithi138.stderr: 12: __libc_start_main() 2024-09-14T11:35:24.320 INFO:tasks.workunit.client.0.smithi138.stderr: 13: _start() 2024-09-14T11:35:24.320 INFO:tasks.workunit.client.0.smithi138.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-14T11:35:24.320 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-14T11:35:24.320 INFO:tasks.workunit.client.0.smithi138.stderr:--- begin dump of recent events --- 2024-09-14T11:35:24.320 INFO:tasks.workunit.client.0.smithi138.stderr: -499> 2024-09-14T11:35:23.787+0000 7fd66b612640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:35:24.321 INFO:tasks.workunit.client.0.smithi138.stderr: -498> 2024-09-14T11:35:23.787+0000 7fd66be13640 10 monclient(hunting): get_auth_request con 0x55ef2e4e3440 auth_method 0 2024-09-14T11:35:24.321 INFO:tasks.workunit.client.0.smithi138.stderr: -497> 2024-09-14T11:35:23.787+0000 7fd66be13640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:35:24.321 INFO:tasks.workunit.client.0.smithi138.stderr: -496> 2024-09-14T11:35:23.787+0000 7fd66be13640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:35:24.321 INFO:tasks.workunit.client.0.smithi138.stderr: -495> 2024-09-14T11:35:23.787+0000 7fd66be13640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:35:24.321 INFO:tasks.workunit.client.0.smithi138.stderr: -494> 2024-09-14T11:35:23.787+0000 7fd66ae11640 10 monclient(hunting): handle_auth_done global_id 6789 payload 274 2024-09-14T11:35:24.321 INFO:tasks.workunit.client.0.smithi138.stderr: -493> 2024-09-14T11:35:23.787+0000 7fd66ae11640 10 monclient: _finish_hunting 0 2024-09-14T11:35:24.321 INFO:tasks.workunit.client.0.smithi138.stderr: -492> 2024-09-14T11:35:23.787+0000 7fd66ae11640 1 monclient: found mon.noname-a 2024-09-14T11:35:24.321 INFO:tasks.workunit.client.0.smithi138.stderr: -491> 2024-09-14T11:35:23.787+0000 7fd66ae11640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.138:3300/0 2024-09-14T11:35:24.321 INFO:tasks.workunit.client.0.smithi138.stderr: -490> 2024-09-14T11:35:23.787+0000 7fd55960a640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:35:24.321 INFO:tasks.workunit.client.0.smithi138.stderr: -489> 2024-09-14T11:35:23.787+0000 7fd55960a640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-14T11:35:24.321 INFO:tasks.workunit.client.0.smithi138.stderr: -488> 2024-09-14T11:35:23.787+0000 7fd55960a640 10 monclient: dump: 2024-09-14T11:35:24.321 INFO:tasks.workunit.client.0.smithi138.stderr:epoch 1 2024-09-14T11:35:24.321 INFO:tasks.workunit.client.0.smithi138.stderr:fsid 3f225f43-83a6-4aeb-b798-1f04bb49d597 2024-09-14T11:35:24.321 INFO:tasks.workunit.client.0.smithi138.stderr:last_changed 2024-09-14T11:07:09.252780+0000 2024-09-14T11:35:24.322 INFO:tasks.workunit.client.0.smithi138.stderr:created 2024-09-14T11:07:09.252780+0000 2024-09-14T11:35:24.322 INFO:tasks.workunit.client.0.smithi138.stderr:min_mon_release 19 (squid) 2024-09-14T11:35:24.322 INFO:tasks.workunit.client.0.smithi138.stderr:election_strategy: 1 2024-09-14T11:35:24.322 INFO:tasks.workunit.client.0.smithi138.stderr:0: [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] mon.a 2024-09-14T11:35:24.322 INFO:tasks.workunit.client.0.smithi138.stderr:1: [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] mon.b 2024-09-14T11:35:24.322 INFO:tasks.workunit.client.0.smithi138.stderr:2: [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] mon.c 2024-09-14T11:35:24.322 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-14T11:35:24.322 INFO:tasks.workunit.client.0.smithi138.stderr: -487> 2024-09-14T11:35:23.787+0000 7fd55960a640 10 monclient: _finish_auth 0 2024-09-14T11:35:24.322 INFO:tasks.workunit.client.0.smithi138.stderr: -486> 2024-09-14T11:35:23.787+0000 7fd55960a640 10 monclient: _check_auth_tickets 2024-09-14T11:35:24.322 INFO:tasks.workunit.client.0.smithi138.stderr: -485> 2024-09-14T11:35:23.787+0000 7fd55960a640 10 monclient: handle_config config(0 keys) 2024-09-14T11:35:24.322 INFO:tasks.workunit.client.0.smithi138.stderr: -484> 2024-09-14T11:35:23.787+0000 7fd55960a640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:35:24.322 INFO:tasks.workunit.client.0.smithi138.stderr: -483> 2024-09-14T11:35:23.787+0000 7fd55960a640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-14T11:35:24.322 INFO:tasks.workunit.client.0.smithi138.stderr: -482> 2024-09-14T11:35:23.787+0000 7fd55960a640 10 monclient: dump: 2024-09-14T11:35:24.322 INFO:tasks.workunit.client.0.smithi138.stderr:epoch 1 2024-09-14T11:35:24.322 INFO:tasks.workunit.client.0.smithi138.stderr:fsid 3f225f43-83a6-4aeb-b798-1f04bb49d597 2024-09-14T11:35:24.323 INFO:tasks.workunit.client.0.smithi138.stderr:last_changed 2024-09-14T11:07:09.252780+0000 2024-09-14T11:35:24.323 INFO:tasks.workunit.client.0.smithi138.stderr:created 2024-09-14T11:07:09.252780+0000 2024-09-14T11:35:24.323 INFO:tasks.workunit.client.0.smithi138.stderr:min_mon_release 19 (squid) 2024-09-14T11:35:24.323 INFO:tasks.workunit.client.0.smithi138.stderr:election_strategy: 1 2024-09-14T11:35:24.323 INFO:tasks.workunit.client.0.smithi138.stderr:0: [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] mon.a 2024-09-14T11:35:24.323 INFO:tasks.workunit.client.0.smithi138.stderr:1: [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] mon.b 2024-09-14T11:35:24.323 INFO:tasks.workunit.client.0.smithi138.stderr:2: [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] mon.c 2024-09-14T11:35:24.323 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-14T11:35:24.323 INFO:tasks.workunit.client.0.smithi138.stderr: -481> 2024-09-14T11:35:23.787+0000 7fd66db0c9c0 5 monclient: authenticate success, global_id 6789 2024-09-14T11:35:24.323 INFO:tasks.workunit.client.0.smithi138.stderr: -480> 2024-09-14T11:35:23.787+0000 7fd66db0c9c0 10 monclient: get_monmap_and_config success 2024-09-14T11:35:24.323 INFO:tasks.workunit.client.0.smithi138.stderr: -479> 2024-09-14T11:35:23.787+0000 7fd66db0c9c0 4 set_mon_vals no callback set 2024-09-14T11:35:24.323 INFO:tasks.workunit.client.0.smithi138.stderr: -478> 2024-09-14T11:35:23.791+0000 7fd66db0c9c0 10 monclient: shutdown 2024-09-14T11:35:24.323 INFO:tasks.workunit.client.0.smithi138.stderr: -477> 2024-09-14T11:35:23.791+0000 7fd66db0c9c0 5 asok(0x55ef2e38dd90) unregister_commands rotate-key 2024-09-14T11:35:24.323 INFO:tasks.workunit.client.0.smithi138.stderr: -476> 2024-09-14T11:35:23.791+0000 7fd66db0c9c0 10 monclient: build_initial_monmap 2024-09-14T11:35:24.323 INFO:tasks.workunit.client.0.smithi138.stderr: -475> 2024-09-14T11:35:23.791+0000 7fd66db0c9c0 1 build_initial for_mkfs: 0 2024-09-14T11:35:24.324 INFO:tasks.workunit.client.0.smithi138.stderr: -474> 2024-09-14T11:35:23.791+0000 7fd66db0c9c0 10 monclient: monmap: 2024-09-14T11:35:24.324 INFO:tasks.workunit.client.0.smithi138.stderr:epoch 0 2024-09-14T11:35:24.324 INFO:tasks.workunit.client.0.smithi138.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-14T11:35:24.324 INFO:tasks.workunit.client.0.smithi138.stderr:last_changed 0.000000 2024-09-14T11:35:24.324 INFO:tasks.workunit.client.0.smithi138.stderr:created 0.000000 2024-09-14T11:35:24.324 INFO:tasks.workunit.client.0.smithi138.stderr:min_mon_release 0 (unknown) 2024-09-14T11:35:24.324 INFO:tasks.workunit.client.0.smithi138.stderr:election_strategy: 1 2024-09-14T11:35:24.324 INFO:tasks.workunit.client.0.smithi138.stderr:0: [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] mon.noname-a 2024-09-14T11:35:24.324 INFO:tasks.workunit.client.0.smithi138.stderr:1: [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] mon.noname-b 2024-09-14T11:35:24.325 INFO:tasks.workunit.client.0.smithi138.stderr:2: [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] mon.noname-c 2024-09-14T11:35:24.325 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-14T11:35:24.325 INFO:tasks.workunit.client.0.smithi138.stderr: -473> 2024-09-14T11:35:23.791+0000 7fd66db0c9c0 5 AuthRegistry(0x55ef2e5c9980) adding auth protocol: cephx 2024-09-14T11:35:24.325 INFO:tasks.workunit.client.0.smithi138.stderr: -472> 2024-09-14T11:35:23.791+0000 7fd66db0c9c0 5 AuthRegistry(0x55ef2e5c9980) adding auth protocol: cephx 2024-09-14T11:35:24.325 INFO:tasks.workunit.client.0.smithi138.stderr: -471> 2024-09-14T11:35:23.791+0000 7fd66db0c9c0 5 AuthRegistry(0x55ef2e5c9980) adding auth protocol: cephx 2024-09-14T11:35:24.325 INFO:tasks.workunit.client.0.smithi138.stderr: -470> 2024-09-14T11:35:23.791+0000 7fd66db0c9c0 5 AuthRegistry(0x55ef2e5c9980) adding con mode: secure 2024-09-14T11:35:24.325 INFO:tasks.workunit.client.0.smithi138.stderr: -469> 2024-09-14T11:35:23.791+0000 7fd66db0c9c0 5 AuthRegistry(0x55ef2e5c9980) adding con mode: crc 2024-09-14T11:35:24.325 INFO:tasks.workunit.client.0.smithi138.stderr: -468> 2024-09-14T11:35:23.791+0000 7fd66db0c9c0 5 AuthRegistry(0x55ef2e5c9980) adding con mode: secure 2024-09-14T11:35:24.325 INFO:tasks.workunit.client.0.smithi138.stderr: -467> 2024-09-14T11:35:23.791+0000 7fd66db0c9c0 5 AuthRegistry(0x55ef2e5c9980) adding con mode: crc 2024-09-14T11:35:24.325 INFO:tasks.workunit.client.0.smithi138.stderr: -466> 2024-09-14T11:35:23.791+0000 7fd66db0c9c0 5 AuthRegistry(0x55ef2e5c9980) adding con mode: secure 2024-09-14T11:35:24.325 INFO:tasks.workunit.client.0.smithi138.stderr: -465> 2024-09-14T11:35:23.791+0000 7fd66db0c9c0 5 AuthRegistry(0x55ef2e5c9980) adding con mode: crc 2024-09-14T11:35:24.325 INFO:tasks.workunit.client.0.smithi138.stderr: -464> 2024-09-14T11:35:23.791+0000 7fd66db0c9c0 5 AuthRegistry(0x55ef2e5c9980) adding con mode: crc 2024-09-14T11:35:24.325 INFO:tasks.workunit.client.0.smithi138.stderr: -463> 2024-09-14T11:35:23.791+0000 7fd66db0c9c0 5 AuthRegistry(0x55ef2e5c9980) adding con mode: secure 2024-09-14T11:35:24.325 INFO:tasks.workunit.client.0.smithi138.stderr: -462> 2024-09-14T11:35:23.791+0000 7fd66db0c9c0 5 AuthRegistry(0x55ef2e5c9980) adding con mode: crc 2024-09-14T11:35:24.326 INFO:tasks.workunit.client.0.smithi138.stderr: -461> 2024-09-14T11:35:23.791+0000 7fd66db0c9c0 5 AuthRegistry(0x55ef2e5c9980) adding con mode: secure 2024-09-14T11:35:24.326 INFO:tasks.workunit.client.0.smithi138.stderr: -460> 2024-09-14T11:35:23.791+0000 7fd66db0c9c0 5 AuthRegistry(0x55ef2e5c9980) adding con mode: crc 2024-09-14T11:35:24.326 INFO:tasks.workunit.client.0.smithi138.stderr: -459> 2024-09-14T11:35:23.791+0000 7fd66db0c9c0 5 AuthRegistry(0x55ef2e5c9980) adding con mode: secure 2024-09-14T11:35:24.326 INFO:tasks.workunit.client.0.smithi138.stderr: -458> 2024-09-14T11:35:23.791+0000 7fd66db0c9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:35:24.326 INFO:tasks.workunit.client.0.smithi138.stderr: -457> 2024-09-14T11:35:23.791+0000 7fd66db0c9c0 1 librados: starting msgr at 2024-09-14T11:35:24.326 INFO:tasks.workunit.client.0.smithi138.stderr: -456> 2024-09-14T11:35:23.791+0000 7fd66db0c9c0 1 librados: starting objecter 2024-09-14T11:35:24.326 INFO:tasks.workunit.client.0.smithi138.stderr: -455> 2024-09-14T11:35:23.791+0000 7fd66db0c9c0 5 asok(0x55ef2e38dd90) register_command objecter_requests hook 0x55ef2e59be70 2024-09-14T11:35:24.326 INFO:tasks.workunit.client.0.smithi138.stderr: -454> 2024-09-14T11:35:23.791+0000 7fd66db0c9c0 1 librados: setting wanted keys 2024-09-14T11:35:24.326 INFO:tasks.workunit.client.0.smithi138.stderr: -453> 2024-09-14T11:35:23.791+0000 7fd66db0c9c0 1 librados: calling monclient init 2024-09-14T11:35:24.326 INFO:tasks.workunit.client.0.smithi138.stderr: -452> 2024-09-14T11:35:23.791+0000 7fd66db0c9c0 10 monclient: init 2024-09-14T11:35:24.326 INFO:tasks.workunit.client.0.smithi138.stderr: -451> 2024-09-14T11:35:23.791+0000 7fd66db0c9c0 5 AuthRegistry(0x55ef2e598fa0) adding auth protocol: cephx 2024-09-14T11:35:24.326 INFO:tasks.workunit.client.0.smithi138.stderr: -450> 2024-09-14T11:35:23.791+0000 7fd66db0c9c0 5 AuthRegistry(0x55ef2e598fa0) adding auth protocol: cephx 2024-09-14T11:35:24.326 INFO:tasks.workunit.client.0.smithi138.stderr: -449> 2024-09-14T11:35:23.791+0000 7fd66db0c9c0 5 AuthRegistry(0x55ef2e598fa0) adding auth protocol: cephx 2024-09-14T11:35:24.326 INFO:tasks.workunit.client.0.smithi138.stderr: -448> 2024-09-14T11:35:23.791+0000 7fd66db0c9c0 5 AuthRegistry(0x55ef2e598fa0) adding con mode: secure 2024-09-14T11:35:24.327 INFO:tasks.workunit.client.0.smithi138.stderr: -447> 2024-09-14T11:35:23.791+0000 7fd66db0c9c0 5 AuthRegistry(0x55ef2e598fa0) adding con mode: crc 2024-09-14T11:35:24.327 INFO:tasks.workunit.client.0.smithi138.stderr: -446> 2024-09-14T11:35:23.791+0000 7fd66db0c9c0 5 AuthRegistry(0x55ef2e598fa0) adding con mode: secure 2024-09-14T11:35:24.327 INFO:tasks.workunit.client.0.smithi138.stderr: -445> 2024-09-14T11:35:23.791+0000 7fd66db0c9c0 5 AuthRegistry(0x55ef2e598fa0) adding con mode: crc 2024-09-14T11:35:24.327 INFO:tasks.workunit.client.0.smithi138.stderr: -444> 2024-09-14T11:35:23.791+0000 7fd66db0c9c0 5 AuthRegistry(0x55ef2e598fa0) adding con mode: secure 2024-09-14T11:35:24.327 INFO:tasks.workunit.client.0.smithi138.stderr: -443> 2024-09-14T11:35:23.791+0000 7fd66db0c9c0 5 AuthRegistry(0x55ef2e598fa0) adding con mode: crc 2024-09-14T11:35:24.327 INFO:tasks.workunit.client.0.smithi138.stderr: -442> 2024-09-14T11:35:23.791+0000 7fd66db0c9c0 5 AuthRegistry(0x55ef2e598fa0) adding con mode: crc 2024-09-14T11:35:24.327 INFO:tasks.workunit.client.0.smithi138.stderr: -441> 2024-09-14T11:35:23.791+0000 7fd66db0c9c0 5 AuthRegistry(0x55ef2e598fa0) adding con mode: secure 2024-09-14T11:35:24.327 INFO:tasks.workunit.client.0.smithi138.stderr: -440> 2024-09-14T11:35:23.791+0000 7fd66db0c9c0 5 AuthRegistry(0x55ef2e598fa0) adding con mode: crc 2024-09-14T11:35:24.327 INFO:tasks.workunit.client.0.smithi138.stderr: -439> 2024-09-14T11:35:23.791+0000 7fd66db0c9c0 5 AuthRegistry(0x55ef2e598fa0) adding con mode: secure 2024-09-14T11:35:24.327 INFO:tasks.workunit.client.0.smithi138.stderr: -438> 2024-09-14T11:35:23.791+0000 7fd66db0c9c0 5 AuthRegistry(0x55ef2e598fa0) adding con mode: crc 2024-09-14T11:35:24.327 INFO:tasks.workunit.client.0.smithi138.stderr: -437> 2024-09-14T11:35:23.791+0000 7fd66db0c9c0 5 AuthRegistry(0x55ef2e598fa0) adding con mode: secure 2024-09-14T11:35:24.327 INFO:tasks.workunit.client.0.smithi138.stderr: -436> 2024-09-14T11:35:23.791+0000 7fd66db0c9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:35:24.327 INFO:tasks.workunit.client.0.smithi138.stderr: -435> 2024-09-14T11:35:23.791+0000 7fd66db0c9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:35:24.327 INFO:tasks.workunit.client.0.smithi138.stderr: -434> 2024-09-14T11:35:23.791+0000 7fd66db0c9c0 5 asok(0x55ef2e38dd90) register_command rotate-key hook 0x55ef2e5990e8 2024-09-14T11:35:24.327 INFO:tasks.workunit.client.0.smithi138.stderr: -433> 2024-09-14T11:35:23.791+0000 7fd66db0c9c0 10 monclient: _reopen_session rank -1 2024-09-14T11:35:24.328 INFO:tasks.workunit.client.0.smithi138.stderr: -432> 2024-09-14T11:35:23.791+0000 7fd66db0c9c0 10 monclient: _add_conns ranks=[2,1,0] 2024-09-14T11:35:24.328 INFO:tasks.workunit.client.0.smithi138.stderr: -431> 2024-09-14T11:35:23.791+0000 7fd66db0c9c0 10 monclient(hunting): picked mon.noname-c con 0x55ef2e426740 addr [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] 2024-09-14T11:35:24.328 INFO:tasks.workunit.client.0.smithi138.stderr: -430> 2024-09-14T11:35:23.791+0000 7fd66db0c9c0 10 monclient(hunting): picked mon.noname-b con 0x55ef2e4e2af0 addr [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] 2024-09-14T11:35:24.328 INFO:tasks.workunit.client.0.smithi138.stderr: -429> 2024-09-14T11:35:23.791+0000 7fd66db0c9c0 10 monclient(hunting): picked mon.noname-a con 0x55ef2e4e3440 addr [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] 2024-09-14T11:35:24.328 INFO:tasks.workunit.client.0.smithi138.stderr: -428> 2024-09-14T11:35:23.791+0000 7fd66db0c9c0 10 monclient(hunting): start opening mon connection 2024-09-14T11:35:24.328 INFO:tasks.workunit.client.0.smithi138.stderr: -427> 2024-09-14T11:35:23.791+0000 7fd66db0c9c0 10 monclient(hunting): start opening mon connection 2024-09-14T11:35:24.328 INFO:tasks.workunit.client.0.smithi138.stderr: -426> 2024-09-14T11:35:23.791+0000 7fd66db0c9c0 10 monclient(hunting): start opening mon connection 2024-09-14T11:35:24.328 INFO:tasks.workunit.client.0.smithi138.stderr: -425> 2024-09-14T11:35:23.791+0000 7fd66db0c9c0 10 monclient(hunting): _renew_subs 2024-09-14T11:35:24.328 INFO:tasks.workunit.client.0.smithi138.stderr: -424> 2024-09-14T11:35:23.791+0000 7fd66db0c9c0 10 monclient(hunting): authenticate will time out at 2659.753875s 2024-09-14T11:35:24.328 INFO:tasks.workunit.client.0.smithi138.stderr: -423> 2024-09-14T11:35:23.791+0000 7fd66b612640 10 monclient(hunting): get_auth_request con 0x55ef2e426740 auth_method 0 2024-09-14T11:35:24.328 INFO:tasks.workunit.client.0.smithi138.stderr: -422> 2024-09-14T11:35:23.791+0000 7fd66b612640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:35:24.328 INFO:tasks.workunit.client.0.smithi138.stderr: -421> 2024-09-14T11:35:23.791+0000 7fd66b612640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:35:24.328 INFO:tasks.workunit.client.0.smithi138.stderr: -420> 2024-09-14T11:35:23.791+0000 7fd66b612640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:35:24.328 INFO:tasks.workunit.client.0.smithi138.stderr: -419> 2024-09-14T11:35:23.791+0000 7fd66be13640 10 monclient(hunting): get_auth_request con 0x55ef2e4e3440 auth_method 0 2024-09-14T11:35:24.329 INFO:tasks.workunit.client.0.smithi138.stderr: -418> 2024-09-14T11:35:23.791+0000 7fd66be13640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:35:24.329 INFO:tasks.workunit.client.0.smithi138.stderr: -417> 2024-09-14T11:35:23.791+0000 7fd66be13640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:35:24.329 INFO:tasks.workunit.client.0.smithi138.stderr: -416> 2024-09-14T11:35:23.791+0000 7fd66be13640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:35:24.329 INFO:tasks.workunit.client.0.smithi138.stderr: -415> 2024-09-14T11:35:23.791+0000 7fd66b612640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:35:24.329 INFO:tasks.workunit.client.0.smithi138.stderr: -414> 2024-09-14T11:35:23.791+0000 7fd66b612640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:35:24.329 INFO:tasks.workunit.client.0.smithi138.stderr: -413> 2024-09-14T11:35:23.791+0000 7fd66b612640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:35:24.329 INFO:tasks.workunit.client.0.smithi138.stderr: -412> 2024-09-14T11:35:23.791+0000 7fd66be13640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:35:24.329 INFO:tasks.workunit.client.0.smithi138.stderr: -411> 2024-09-14T11:35:23.791+0000 7fd66be13640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:35:24.329 INFO:tasks.workunit.client.0.smithi138.stderr: -410> 2024-09-14T11:35:23.791+0000 7fd66be13640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:35:24.329 INFO:tasks.workunit.client.0.smithi138.stderr: -409> 2024-09-14T11:35:23.791+0000 7fd66b612640 10 monclient(hunting): handle_auth_done global_id 6356 payload 824 2024-09-14T11:35:24.329 INFO:tasks.workunit.client.0.smithi138.stderr: -408> 2024-09-14T11:35:23.791+0000 7fd66b612640 10 monclient: _finish_hunting 0 2024-09-14T11:35:24.329 INFO:tasks.workunit.client.0.smithi138.stderr: -407> 2024-09-14T11:35:23.791+0000 7fd66b612640 1 monclient: found mon.noname-c 2024-09-14T11:35:24.329 INFO:tasks.workunit.client.0.smithi138.stderr: -406> 2024-09-14T11:35:23.791+0000 7fd66b612640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.138:3301/0 2024-09-14T11:35:24.329 INFO:tasks.workunit.client.0.smithi138.stderr: -405> 2024-09-14T11:35:23.791+0000 7fd557e07640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:35:24.330 INFO:tasks.workunit.client.0.smithi138.stderr: -404> 2024-09-14T11:35:23.791+0000 7fd557e07640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-14T11:35:24.330 INFO:tasks.workunit.client.0.smithi138.stderr: -403> 2024-09-14T11:35:23.791+0000 7fd557e07640 10 monclient: dump: 2024-09-14T11:35:24.330 INFO:tasks.workunit.client.0.smithi138.stderr:epoch 1 2024-09-14T11:35:24.330 INFO:tasks.workunit.client.0.smithi138.stderr:fsid 3f225f43-83a6-4aeb-b798-1f04bb49d597 2024-09-14T11:35:24.330 INFO:tasks.workunit.client.0.smithi138.stderr:last_changed 2024-09-14T11:07:09.252780+0000 2024-09-14T11:35:24.330 INFO:tasks.workunit.client.0.smithi138.stderr:created 2024-09-14T11:07:09.252780+0000 2024-09-14T11:35:24.330 INFO:tasks.workunit.client.0.smithi138.stderr:min_mon_release 19 (squid) 2024-09-14T11:35:24.330 INFO:tasks.workunit.client.0.smithi138.stderr:election_strategy: 1 2024-09-14T11:35:24.330 INFO:tasks.workunit.client.0.smithi138.stderr:0: [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] mon.a 2024-09-14T11:35:24.330 INFO:tasks.workunit.client.0.smithi138.stderr:1: [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] mon.b 2024-09-14T11:35:24.330 INFO:tasks.workunit.client.0.smithi138.stderr:2: [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] mon.c 2024-09-14T11:35:24.330 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-14T11:35:24.330 INFO:tasks.workunit.client.0.smithi138.stderr: -402> 2024-09-14T11:35:23.791+0000 7fd557e07640 10 monclient: _finish_auth 0 2024-09-14T11:35:24.330 INFO:tasks.workunit.client.0.smithi138.stderr: -401> 2024-09-14T11:35:23.791+0000 7fd557e07640 10 monclient: _check_auth_tickets 2024-09-14T11:35:24.330 INFO:tasks.workunit.client.0.smithi138.stderr: -400> 2024-09-14T11:35:23.791+0000 7fd66db0c9c0 5 monclient: authenticate success, global_id 6356 2024-09-14T11:35:24.330 INFO:tasks.workunit.client.0.smithi138.stderr: -399> 2024-09-14T11:35:23.791+0000 7fd66db0c9c0 10 monclient: _renew_subs 2024-09-14T11:35:24.331 INFO:tasks.workunit.client.0.smithi138.stderr: -398> 2024-09-14T11:35:23.791+0000 7fd66db0c9c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.138:3301/0 2024-09-14T11:35:24.331 INFO:tasks.workunit.client.0.smithi138.stderr: -397> 2024-09-14T11:35:23.791+0000 7fd557e07640 10 monclient: handle_config config(0 keys) 2024-09-14T11:35:24.331 INFO:tasks.workunit.client.0.smithi138.stderr: -396> 2024-09-14T11:35:23.791+0000 7fd557e07640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:35:24.331 INFO:tasks.workunit.client.0.smithi138.stderr: -395> 2024-09-14T11:35:23.791+0000 7fd557e07640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-14T11:35:24.331 INFO:tasks.workunit.client.0.smithi138.stderr: -394> 2024-09-14T11:35:23.791+0000 7fd557e07640 10 monclient: dump: 2024-09-14T11:35:24.331 INFO:tasks.workunit.client.0.smithi138.stderr:epoch 1 2024-09-14T11:35:24.331 INFO:tasks.workunit.client.0.smithi138.stderr:fsid 3f225f43-83a6-4aeb-b798-1f04bb49d597 2024-09-14T11:35:24.331 INFO:tasks.workunit.client.0.smithi138.stderr:last_changed 2024-09-14T11:07:09.252780+0000 2024-09-14T11:35:24.331 INFO:tasks.workunit.client.0.smithi138.stderr:created 2024-09-14T11:07:09.252780+0000 2024-09-14T11:35:24.331 INFO:tasks.workunit.client.0.smithi138.stderr:min_mon_release 19 (squid) 2024-09-14T11:35:24.331 INFO:tasks.workunit.client.0.smithi138.stderr:election_strategy: 1 2024-09-14T11:35:24.331 INFO:tasks.workunit.client.0.smithi138.stderr:0: [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] mon.a 2024-09-14T11:35:24.331 INFO:tasks.workunit.client.0.smithi138.stderr:1: [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] mon.b 2024-09-14T11:35:24.332 INFO:tasks.workunit.client.0.smithi138.stderr:2: [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] mon.c 2024-09-14T11:35:24.332 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-14T11:35:24.332 INFO:tasks.workunit.client.0.smithi138.stderr: -393> 2024-09-14T11:35:23.791+0000 7fd55960a640 4 set_mon_vals no callback set 2024-09-14T11:35:24.332 INFO:tasks.workunit.client.0.smithi138.stderr: -392> 2024-09-14T11:35:23.791+0000 7fd66db0c9c0 10 monclient: _renew_subs 2024-09-14T11:35:24.332 INFO:tasks.workunit.client.0.smithi138.stderr: -391> 2024-09-14T11:35:23.791+0000 7fd66db0c9c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.138:3301/0 2024-09-14T11:35:24.332 INFO:tasks.workunit.client.0.smithi138.stderr: -390> 2024-09-14T11:35:23.791+0000 7fd66db0c9c0 1 librados: init done 2024-09-14T11:35:24.332 INFO:tasks.workunit.client.0.smithi138.stderr: -389> 2024-09-14T11:35:23.795+0000 7fd557e07640 4 mgrc handle_mgr_map Got map version 5 2024-09-14T11:35:24.332 INFO:tasks.workunit.client.0.smithi138.stderr: -388> 2024-09-14T11:35:23.795+0000 7fd557e07640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.138:6832/3778043143,v1:172.21.15.138:6833/3778043143] 2024-09-14T11:35:24.332 INFO:tasks.workunit.client.0.smithi138.stderr: -387> 2024-09-14T11:35:23.795+0000 7fd557e07640 4 mgrc reconnect Starting new session with [v2:172.21.15.138:6832/3778043143,v1:172.21.15.138:6833/3778043143] 2024-09-14T11:35:24.332 INFO:tasks.workunit.client.0.smithi138.stderr: -386> 2024-09-14T11:35:23.795+0000 7fd66ae11640 10 monclient: get_auth_request con 0x7fd5500718a0 auth_method 0 2024-09-14T11:35:24.332 INFO:tasks.workunit.client.0.smithi138.stderr: -385> 2024-09-14T11:35:23.795+0000 7fd66be13640 10 monclient: get_auth_request con 0x55ef2e5c3700 auth_method 0 2024-09-14T11:35:24.332 INFO:tasks.workunit.client.0.smithi138.stderr: -384> 2024-09-14T11:35:23.795+0000 7fd66b612640 10 monclient: get_auth_request con 0x55ef2e5e4010 auth_method 0 2024-09-14T11:35:24.332 INFO:tasks.workunit.client.0.smithi138.stderr: -383> 2024-09-14T11:35:23.795+0000 7fd66ae11640 10 monclient: get_auth_request con 0x55ef2e5e8200 auth_method 0 2024-09-14T11:35:24.332 INFO:tasks.workunit.client.0.smithi138.stderr: -382> 2024-09-14T11:35:23.799+0000 7fd66be13640 10 monclient: get_auth_request con 0x55ef2e5e7840 auth_method 0 2024-09-14T11:35:24.333 INFO:tasks.workunit.client.0.smithi138.stderr: -381> 2024-09-14T11:35:23.799+0000 7fd66db0c9c0 10 monclient: build_initial_monmap 2024-09-14T11:35:24.333 INFO:tasks.workunit.client.0.smithi138.stderr: -380> 2024-09-14T11:35:23.799+0000 7fd66db0c9c0 1 build_initial for_mkfs: 0 2024-09-14T11:35:24.333 INFO:tasks.workunit.client.0.smithi138.stderr: -379> 2024-09-14T11:35:23.799+0000 7fd66db0c9c0 10 monclient: monmap: 2024-09-14T11:35:24.333 INFO:tasks.workunit.client.0.smithi138.stderr:epoch 0 2024-09-14T11:35:24.333 INFO:tasks.workunit.client.0.smithi138.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-14T11:35:24.333 INFO:tasks.workunit.client.0.smithi138.stderr:last_changed 0.000000 2024-09-14T11:35:24.333 INFO:tasks.workunit.client.0.smithi138.stderr:created 0.000000 2024-09-14T11:35:24.333 INFO:tasks.workunit.client.0.smithi138.stderr:min_mon_release 0 (unknown) 2024-09-14T11:35:24.333 INFO:tasks.workunit.client.0.smithi138.stderr:election_strategy: 1 2024-09-14T11:35:24.333 INFO:tasks.workunit.client.0.smithi138.stderr:0: [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] mon.noname-a 2024-09-14T11:35:24.333 INFO:tasks.workunit.client.0.smithi138.stderr:1: [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] mon.noname-b 2024-09-14T11:35:24.333 INFO:tasks.workunit.client.0.smithi138.stderr:2: [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] mon.noname-c 2024-09-14T11:35:24.333 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-14T11:35:24.334 INFO:tasks.workunit.client.0.smithi138.stderr: -378> 2024-09-14T11:35:23.799+0000 7fd66db0c9c0 5 AuthRegistry(0x55ef2e5f0270) adding auth protocol: cephx 2024-09-14T11:35:24.334 INFO:tasks.workunit.client.0.smithi138.stderr: -377> 2024-09-14T11:35:23.799+0000 7fd66db0c9c0 5 AuthRegistry(0x55ef2e5f0270) adding auth protocol: cephx 2024-09-14T11:35:24.334 INFO:tasks.workunit.client.0.smithi138.stderr: -376> 2024-09-14T11:35:23.799+0000 7fd66db0c9c0 5 AuthRegistry(0x55ef2e5f0270) adding auth protocol: cephx 2024-09-14T11:35:24.334 INFO:tasks.workunit.client.0.smithi138.stderr: -375> 2024-09-14T11:35:23.799+0000 7fd66db0c9c0 5 AuthRegistry(0x55ef2e5f0270) adding con mode: secure 2024-09-14T11:35:24.334 INFO:tasks.workunit.client.0.smithi138.stderr: -374> 2024-09-14T11:35:23.799+0000 7fd66db0c9c0 5 AuthRegistry(0x55ef2e5f0270) adding con mode: crc 2024-09-14T11:35:24.334 INFO:tasks.workunit.client.0.smithi138.stderr: -373> 2024-09-14T11:35:23.799+0000 7fd66db0c9c0 5 AuthRegistry(0x55ef2e5f0270) adding con mode: secure 2024-09-14T11:35:24.334 INFO:tasks.workunit.client.0.smithi138.stderr: -372> 2024-09-14T11:35:23.799+0000 7fd66db0c9c0 5 AuthRegistry(0x55ef2e5f0270) adding con mode: crc 2024-09-14T11:35:24.334 INFO:tasks.workunit.client.0.smithi138.stderr: -371> 2024-09-14T11:35:23.799+0000 7fd66db0c9c0 5 AuthRegistry(0x55ef2e5f0270) adding con mode: secure 2024-09-14T11:35:24.334 INFO:tasks.workunit.client.0.smithi138.stderr: -370> 2024-09-14T11:35:23.799+0000 7fd66db0c9c0 5 AuthRegistry(0x55ef2e5f0270) adding con mode: crc 2024-09-14T11:35:24.335 INFO:tasks.workunit.client.0.smithi138.stderr: -369> 2024-09-14T11:35:23.799+0000 7fd66db0c9c0 5 AuthRegistry(0x55ef2e5f0270) adding con mode: crc 2024-09-14T11:35:24.335 INFO:tasks.workunit.client.0.smithi138.stderr: -368> 2024-09-14T11:35:23.799+0000 7fd66db0c9c0 5 AuthRegistry(0x55ef2e5f0270) adding con mode: secure 2024-09-14T11:35:24.335 INFO:tasks.workunit.client.0.smithi138.stderr: -367> 2024-09-14T11:35:23.799+0000 7fd66db0c9c0 5 AuthRegistry(0x55ef2e5f0270) adding con mode: crc 2024-09-14T11:35:24.335 INFO:tasks.workunit.client.0.smithi138.stderr: -366> 2024-09-14T11:35:23.799+0000 7fd66db0c9c0 5 AuthRegistry(0x55ef2e5f0270) adding con mode: secure 2024-09-14T11:35:24.335 INFO:tasks.workunit.client.0.smithi138.stderr: -365> 2024-09-14T11:35:23.799+0000 7fd66db0c9c0 5 AuthRegistry(0x55ef2e5f0270) adding con mode: crc 2024-09-14T11:35:24.335 INFO:tasks.workunit.client.0.smithi138.stderr: -364> 2024-09-14T11:35:23.799+0000 7fd66db0c9c0 5 AuthRegistry(0x55ef2e5f0270) adding con mode: secure 2024-09-14T11:35:24.335 INFO:tasks.workunit.client.0.smithi138.stderr: -363> 2024-09-14T11:35:23.799+0000 7fd66db0c9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:35:24.335 INFO:tasks.workunit.client.0.smithi138.stderr: -362> 2024-09-14T11:35:23.799+0000 7fd66db0c9c0 5 asok(0x55ef2e38dd90) register_command objecter_requests cmddesc objecter_requests hook 0x55ef2e5f3c60 EEXIST 2024-09-14T11:35:24.335 INFO:tasks.workunit.client.0.smithi138.stderr: -361> 2024-09-14T11:35:23.799+0000 7fd66db0c9c0 10 monclient: init 2024-09-14T11:35:24.335 INFO:tasks.workunit.client.0.smithi138.stderr: -360> 2024-09-14T11:35:23.799+0000 7fd66db0c9c0 5 AuthRegistry(0x55ef2e5ef168) adding auth protocol: cephx 2024-09-14T11:35:24.336 INFO:tasks.workunit.client.0.smithi138.stderr: -359> 2024-09-14T11:35:23.799+0000 7fd66db0c9c0 5 AuthRegistry(0x55ef2e5ef168) adding auth protocol: cephx 2024-09-14T11:35:24.336 INFO:tasks.workunit.client.0.smithi138.stderr: -358> 2024-09-14T11:35:23.799+0000 7fd66db0c9c0 5 AuthRegistry(0x55ef2e5ef168) adding auth protocol: cephx 2024-09-14T11:35:24.336 INFO:tasks.workunit.client.0.smithi138.stderr: -357> 2024-09-14T11:35:23.799+0000 7fd66db0c9c0 5 AuthRegistry(0x55ef2e5ef168) adding con mode: secure 2024-09-14T11:35:24.336 INFO:tasks.workunit.client.0.smithi138.stderr: -356> 2024-09-14T11:35:23.799+0000 7fd66db0c9c0 5 AuthRegistry(0x55ef2e5ef168) adding con mode: crc 2024-09-14T11:35:24.336 INFO:tasks.workunit.client.0.smithi138.stderr: -355> 2024-09-14T11:35:23.799+0000 7fd66db0c9c0 5 AuthRegistry(0x55ef2e5ef168) adding con mode: secure 2024-09-14T11:35:24.337 INFO:tasks.workunit.client.0.smithi138.stderr: -354> 2024-09-14T11:35:23.799+0000 7fd66db0c9c0 5 AuthRegistry(0x55ef2e5ef168) adding con mode: crc 2024-09-14T11:35:24.337 INFO:tasks.workunit.client.0.smithi138.stderr: -353> 2024-09-14T11:35:23.799+0000 7fd66db0c9c0 5 AuthRegistry(0x55ef2e5ef168) adding con mode: secure 2024-09-14T11:35:24.337 INFO:tasks.workunit.client.0.smithi138.stderr: -352> 2024-09-14T11:35:23.799+0000 7fd66db0c9c0 5 AuthRegistry(0x55ef2e5ef168) adding con mode: crc 2024-09-14T11:35:24.337 INFO:tasks.workunit.client.0.smithi138.stderr: -351> 2024-09-14T11:35:23.799+0000 7fd66db0c9c0 5 AuthRegistry(0x55ef2e5ef168) adding con mode: crc 2024-09-14T11:35:24.337 INFO:tasks.workunit.client.0.smithi138.stderr: -350> 2024-09-14T11:35:23.799+0000 7fd66db0c9c0 5 AuthRegistry(0x55ef2e5ef168) adding con mode: secure 2024-09-14T11:35:24.337 INFO:tasks.workunit.client.0.smithi138.stderr: -349> 2024-09-14T11:35:23.799+0000 7fd66db0c9c0 5 AuthRegistry(0x55ef2e5ef168) adding con mode: crc 2024-09-14T11:35:24.338 INFO:tasks.workunit.client.0.smithi138.stderr: -348> 2024-09-14T11:35:23.799+0000 7fd66db0c9c0 5 AuthRegistry(0x55ef2e5ef168) adding con mode: secure 2024-09-14T11:35:24.338 INFO:tasks.workunit.client.0.smithi138.stderr: -347> 2024-09-14T11:35:23.799+0000 7fd66db0c9c0 5 AuthRegistry(0x55ef2e5ef168) adding con mode: crc 2024-09-14T11:35:24.338 INFO:tasks.workunit.client.0.smithi138.stderr: -346> 2024-09-14T11:35:23.799+0000 7fd66db0c9c0 5 AuthRegistry(0x55ef2e5ef168) adding con mode: secure 2024-09-14T11:35:24.338 INFO:tasks.workunit.client.0.smithi138.stderr: -345> 2024-09-14T11:35:23.799+0000 7fd66db0c9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:35:24.338 INFO:tasks.workunit.client.0.smithi138.stderr: -344> 2024-09-14T11:35:23.799+0000 7fd66db0c9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:35:24.339 INFO:tasks.workunit.client.0.smithi138.stderr: -343> 2024-09-14T11:35:23.799+0000 7fd66db0c9c0 5 asok(0x55ef2e38dd90) register_command rotate-key cmddesc rotate-key hook 0x55ef2e5ef2b0 EEXIST 2024-09-14T11:35:24.339 INFO:tasks.workunit.client.0.smithi138.stderr: -342> 2024-09-14T11:35:23.799+0000 7fd66db0c9c0 10 monclient: _reopen_session rank -1 2024-09-14T11:35:24.339 INFO:tasks.workunit.client.0.smithi138.stderr: -341> 2024-09-14T11:35:23.799+0000 7fd66db0c9c0 10 monclient: _add_conns ranks=[2,1,0] 2024-09-14T11:35:24.339 INFO:tasks.workunit.client.0.smithi138.stderr: -340> 2024-09-14T11:35:23.799+0000 7fd66db0c9c0 10 monclient(hunting): picked mon.noname-c con 0x55ef2e617e10 addr [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] 2024-09-14T11:35:24.339 INFO:tasks.workunit.client.0.smithi138.stderr: -339> 2024-09-14T11:35:23.799+0000 7fd66db0c9c0 10 monclient(hunting): picked mon.noname-b con 0x55ef2e617740 addr [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] 2024-09-14T11:35:24.339 INFO:tasks.workunit.client.0.smithi138.stderr: -338> 2024-09-14T11:35:23.799+0000 7fd66db0c9c0 10 monclient(hunting): picked mon.noname-a con 0x55ef2e616120 addr [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] 2024-09-14T11:35:24.339 INFO:tasks.workunit.client.0.smithi138.stderr: -337> 2024-09-14T11:35:23.799+0000 7fd66db0c9c0 10 monclient(hunting): start opening mon connection 2024-09-14T11:35:24.340 INFO:tasks.workunit.client.0.smithi138.stderr: -336> 2024-09-14T11:35:23.799+0000 7fd66db0c9c0 10 monclient(hunting): start opening mon connection 2024-09-14T11:35:24.340 INFO:tasks.workunit.client.0.smithi138.stderr: -335> 2024-09-14T11:35:23.799+0000 7fd66db0c9c0 10 monclient(hunting): start opening mon connection 2024-09-14T11:35:24.340 INFO:tasks.workunit.client.0.smithi138.stderr: -334> 2024-09-14T11:35:23.799+0000 7fd66db0c9c0 10 monclient(hunting): _renew_subs 2024-09-14T11:35:24.340 INFO:tasks.workunit.client.0.smithi138.stderr: -333> 2024-09-14T11:35:23.799+0000 7fd66db0c9c0 10 monclient(hunting): authenticate will time out at 2659.763985s 2024-09-14T11:35:24.340 INFO:tasks.workunit.client.0.smithi138.stderr: -332> 2024-09-14T11:35:23.803+0000 7fd66b612640 10 monclient(hunting): get_auth_request con 0x55ef2e616120 auth_method 0 2024-09-14T11:35:24.340 INFO:tasks.workunit.client.0.smithi138.stderr: -331> 2024-09-14T11:35:23.803+0000 7fd66b612640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:35:24.340 INFO:tasks.workunit.client.0.smithi138.stderr: -330> 2024-09-14T11:35:23.803+0000 7fd66b612640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:35:24.340 INFO:tasks.workunit.client.0.smithi138.stderr: -329> 2024-09-14T11:35:23.803+0000 7fd66b612640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:35:24.340 INFO:tasks.workunit.client.0.smithi138.stderr: -328> 2024-09-14T11:35:23.803+0000 7fd66ae11640 10 monclient(hunting): get_auth_request con 0x55ef2e617e10 auth_method 0 2024-09-14T11:35:24.340 INFO:tasks.workunit.client.0.smithi138.stderr: -327> 2024-09-14T11:35:23.803+0000 7fd66ae11640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:35:24.341 INFO:tasks.workunit.client.0.smithi138.stderr: -326> 2024-09-14T11:35:23.803+0000 7fd66ae11640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:35:24.341 INFO:tasks.workunit.client.0.smithi138.stderr: -325> 2024-09-14T11:35:23.803+0000 7fd66ae11640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:35:24.341 INFO:tasks.workunit.client.0.smithi138.stderr: -324> 2024-09-14T11:35:23.803+0000 7fd66b612640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:35:24.341 INFO:tasks.workunit.client.0.smithi138.stderr: -323> 2024-09-14T11:35:23.803+0000 7fd66b612640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:35:24.341 INFO:tasks.workunit.client.0.smithi138.stderr: -322> 2024-09-14T11:35:23.803+0000 7fd66b612640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:35:24.341 INFO:tasks.workunit.client.0.smithi138.stderr: -321> 2024-09-14T11:35:23.803+0000 7fd66ae11640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:35:24.341 INFO:tasks.workunit.client.0.smithi138.stderr: -320> 2024-09-14T11:35:23.803+0000 7fd66ae11640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:35:24.341 INFO:tasks.workunit.client.0.smithi138.stderr: -319> 2024-09-14T11:35:23.803+0000 7fd66ae11640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:35:24.342 INFO:tasks.workunit.client.0.smithi138.stderr: -318> 2024-09-14T11:35:23.803+0000 7fd66be13640 10 monclient(hunting): get_auth_request con 0x55ef2e617740 auth_method 0 2024-09-14T11:35:24.342 INFO:tasks.workunit.client.0.smithi138.stderr: -317> 2024-09-14T11:35:23.803+0000 7fd66be13640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:35:24.342 INFO:tasks.workunit.client.0.smithi138.stderr: -316> 2024-09-14T11:35:23.803+0000 7fd66be13640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:35:24.342 INFO:tasks.workunit.client.0.smithi138.stderr: -315> 2024-09-14T11:35:23.803+0000 7fd66be13640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:35:24.342 INFO:tasks.workunit.client.0.smithi138.stderr: -314> 2024-09-14T11:35:23.803+0000 7fd66b612640 10 monclient(hunting): handle_auth_done global_id 6795 payload 824 2024-09-14T11:35:24.342 INFO:tasks.workunit.client.0.smithi138.stderr: -313> 2024-09-14T11:35:23.803+0000 7fd66b612640 10 monclient: _finish_hunting 0 2024-09-14T11:35:24.342 INFO:tasks.workunit.client.0.smithi138.stderr: -312> 2024-09-14T11:35:23.803+0000 7fd66b612640 1 monclient: found mon.noname-a 2024-09-14T11:35:24.342 INFO:tasks.workunit.client.0.smithi138.stderr: -311> 2024-09-14T11:35:23.803+0000 7fd66b612640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.138:3300/0 2024-09-14T11:35:24.342 INFO:tasks.workunit.client.0.smithi138.stderr: -310> 2024-09-14T11:35:23.803+0000 7fd555602640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:35:24.342 INFO:tasks.workunit.client.0.smithi138.stderr: -309> 2024-09-14T11:35:23.803+0000 7fd555602640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-14T11:35:24.342 INFO:tasks.workunit.client.0.smithi138.stderr: -308> 2024-09-14T11:35:23.803+0000 7fd555602640 10 monclient: dump: 2024-09-14T11:35:24.342 INFO:tasks.workunit.client.0.smithi138.stderr:epoch 1 2024-09-14T11:35:24.342 INFO:tasks.workunit.client.0.smithi138.stderr:fsid 3f225f43-83a6-4aeb-b798-1f04bb49d597 2024-09-14T11:35:24.342 INFO:tasks.workunit.client.0.smithi138.stderr:last_changed 2024-09-14T11:07:09.252780+0000 2024-09-14T11:35:24.343 INFO:tasks.workunit.client.0.smithi138.stderr:created 2024-09-14T11:07:09.252780+0000 2024-09-14T11:35:24.343 INFO:tasks.workunit.client.0.smithi138.stderr:min_mon_release 19 (squid) 2024-09-14T11:35:24.343 INFO:tasks.workunit.client.0.smithi138.stderr:election_strategy: 1 2024-09-14T11:35:24.343 INFO:tasks.workunit.client.0.smithi138.stderr:0: [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] mon.a 2024-09-14T11:35:24.343 INFO:tasks.workunit.client.0.smithi138.stderr:1: [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] mon.b 2024-09-14T11:35:24.343 INFO:tasks.workunit.client.0.smithi138.stderr:2: [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] mon.c 2024-09-14T11:35:24.343 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-14T11:35:24.343 INFO:tasks.workunit.client.0.smithi138.stderr: -307> 2024-09-14T11:35:23.803+0000 7fd555602640 10 monclient: _finish_auth 0 2024-09-14T11:35:24.343 INFO:tasks.workunit.client.0.smithi138.stderr: -306> 2024-09-14T11:35:23.803+0000 7fd555602640 10 monclient: _check_auth_tickets 2024-09-14T11:35:24.343 INFO:tasks.workunit.client.0.smithi138.stderr: -305> 2024-09-14T11:35:23.803+0000 7fd555602640 10 monclient: handle_config config(0 keys) 2024-09-14T11:35:24.343 INFO:tasks.workunit.client.0.smithi138.stderr: -304> 2024-09-14T11:35:23.803+0000 7fd555602640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:35:24.343 INFO:tasks.workunit.client.0.smithi138.stderr: -303> 2024-09-14T11:35:23.803+0000 7fd555602640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-14T11:35:24.343 INFO:tasks.workunit.client.0.smithi138.stderr: -302> 2024-09-14T11:35:23.803+0000 7fd555602640 10 monclient: dump: 2024-09-14T11:35:24.343 INFO:tasks.workunit.client.0.smithi138.stderr:epoch 1 2024-09-14T11:35:24.344 INFO:tasks.workunit.client.0.smithi138.stderr:fsid 3f225f43-83a6-4aeb-b798-1f04bb49d597 2024-09-14T11:35:24.344 INFO:tasks.workunit.client.0.smithi138.stderr:last_changed 2024-09-14T11:07:09.252780+0000 2024-09-14T11:35:24.344 INFO:tasks.workunit.client.0.smithi138.stderr:created 2024-09-14T11:07:09.252780+0000 2024-09-14T11:35:24.344 INFO:tasks.workunit.client.0.smithi138.stderr:min_mon_release 19 (squid) 2024-09-14T11:35:24.344 INFO:tasks.workunit.client.0.smithi138.stderr:election_strategy: 1 2024-09-14T11:35:24.344 INFO:tasks.workunit.client.0.smithi138.stderr:0: [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] mon.a 2024-09-14T11:35:24.344 INFO:tasks.workunit.client.0.smithi138.stderr:1: [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] mon.b 2024-09-14T11:35:24.344 INFO:tasks.workunit.client.0.smithi138.stderr:2: [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] mon.c 2024-09-14T11:35:24.344 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-14T11:35:24.344 INFO:tasks.workunit.client.0.smithi138.stderr: -301> 2024-09-14T11:35:23.803+0000 7fd66db0c9c0 5 monclient: authenticate success, global_id 6795 2024-09-14T11:35:24.344 INFO:tasks.workunit.client.0.smithi138.stderr: -300> 2024-09-14T11:35:23.803+0000 7fd66db0c9c0 10 monclient: _renew_subs 2024-09-14T11:35:24.344 INFO:tasks.workunit.client.0.smithi138.stderr: -299> 2024-09-14T11:35:23.803+0000 7fd66c614640 4 set_mon_vals no callback set 2024-09-14T11:35:24.345 INFO:tasks.workunit.client.0.smithi138.stderr: -298> 2024-09-14T11:35:23.803+0000 7fd66db0c9c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.138:3300/0 2024-09-14T11:35:24.345 INFO:tasks.workunit.client.0.smithi138.stderr: -297> 2024-09-14T11:35:23.803+0000 7fd66db0c9c0 10 monclient: _renew_subs 2024-09-14T11:35:24.345 INFO:tasks.workunit.client.0.smithi138.stderr: -296> 2024-09-14T11:35:23.803+0000 7fd66db0c9c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.138:3300/0 2024-09-14T11:35:24.345 INFO:tasks.workunit.client.0.smithi138.stderr: -295> 2024-09-14T11:35:23.803+0000 7fd555602640 4 mgrc handle_mgr_map Got map version 5 2024-09-14T11:35:24.345 INFO:tasks.workunit.client.0.smithi138.stderr: -294> 2024-09-14T11:35:23.803+0000 7fd555602640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.138:6832/3778043143,v1:172.21.15.138:6833/3778043143] 2024-09-14T11:35:24.345 INFO:tasks.workunit.client.0.smithi138.stderr: -293> 2024-09-14T11:35:23.803+0000 7fd555602640 4 mgrc reconnect Starting new session with [v2:172.21.15.138:6832/3778043143,v1:172.21.15.138:6833/3778043143] 2024-09-14T11:35:24.345 INFO:tasks.workunit.client.0.smithi138.stderr: -292> 2024-09-14T11:35:23.803+0000 7fd66ae11640 10 monclient: get_auth_request con 0x7fd5440717e0 auth_method 0 2024-09-14T11:35:24.345 INFO:tasks.workunit.client.0.smithi138.stderr: -291> 2024-09-14T11:35:23.803+0000 7fd66db0c9c0 10 monclient: get_monmap_and_config 2024-09-14T11:35:24.345 INFO:tasks.workunit.client.0.smithi138.stderr: -290> 2024-09-14T11:35:23.803+0000 7fd66db0c9c0 10 monclient: build_initial_monmap 2024-09-14T11:35:24.346 INFO:tasks.workunit.client.0.smithi138.stderr: -289> 2024-09-14T11:35:23.803+0000 7fd66db0c9c0 1 build_initial for_mkfs: 0 2024-09-14T11:35:24.346 INFO:tasks.workunit.client.0.smithi138.stderr: -288> 2024-09-14T11:35:23.803+0000 7fd66db0c9c0 10 monclient: monmap: 2024-09-14T11:35:24.346 INFO:tasks.workunit.client.0.smithi138.stderr:epoch 0 2024-09-14T11:35:24.346 INFO:tasks.workunit.client.0.smithi138.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-14T11:35:24.346 INFO:tasks.workunit.client.0.smithi138.stderr:last_changed 0.000000 2024-09-14T11:35:24.346 INFO:tasks.workunit.client.0.smithi138.stderr:created 0.000000 2024-09-14T11:35:24.346 INFO:tasks.workunit.client.0.smithi138.stderr:min_mon_release 0 (unknown) 2024-09-14T11:35:24.346 INFO:tasks.workunit.client.0.smithi138.stderr:election_strategy: 1 2024-09-14T11:35:24.346 INFO:tasks.workunit.client.0.smithi138.stderr:0: [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] mon.noname-a 2024-09-14T11:35:24.346 INFO:tasks.workunit.client.0.smithi138.stderr:1: [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] mon.noname-b 2024-09-14T11:35:24.346 INFO:tasks.workunit.client.0.smithi138.stderr:2: [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] mon.noname-c 2024-09-14T11:35:24.346 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-14T11:35:24.346 INFO:tasks.workunit.client.0.smithi138.stderr: -287> 2024-09-14T11:35:23.803+0000 7fd66db0c9c0 5 AuthRegistry(0x55ef2e637790) adding auth protocol: cephx 2024-09-14T11:35:24.346 INFO:tasks.workunit.client.0.smithi138.stderr: -286> 2024-09-14T11:35:23.803+0000 7fd66db0c9c0 5 AuthRegistry(0x55ef2e637790) adding auth protocol: cephx 2024-09-14T11:35:24.346 INFO:tasks.workunit.client.0.smithi138.stderr: -285> 2024-09-14T11:35:23.803+0000 7fd66db0c9c0 5 AuthRegistry(0x55ef2e637790) adding auth protocol: cephx 2024-09-14T11:35:24.346 INFO:tasks.workunit.client.0.smithi138.stderr: -284> 2024-09-14T11:35:23.803+0000 7fd66db0c9c0 5 AuthRegistry(0x55ef2e637790) adding con mode: secure 2024-09-14T11:35:24.347 INFO:tasks.workunit.client.0.smithi138.stderr: -283> 2024-09-14T11:35:23.803+0000 7fd66db0c9c0 5 AuthRegistry(0x55ef2e637790) adding con mode: crc 2024-09-14T11:35:24.347 INFO:tasks.workunit.client.0.smithi138.stderr: -282> 2024-09-14T11:35:23.803+0000 7fd66db0c9c0 5 AuthRegistry(0x55ef2e637790) adding con mode: secure 2024-09-14T11:35:24.347 INFO:tasks.workunit.client.0.smithi138.stderr: -281> 2024-09-14T11:35:23.803+0000 7fd66db0c9c0 5 AuthRegistry(0x55ef2e637790) adding con mode: crc 2024-09-14T11:35:24.347 INFO:tasks.workunit.client.0.smithi138.stderr: -280> 2024-09-14T11:35:23.803+0000 7fd66db0c9c0 5 AuthRegistry(0x55ef2e637790) adding con mode: secure 2024-09-14T11:35:24.347 INFO:tasks.workunit.client.0.smithi138.stderr: -279> 2024-09-14T11:35:23.803+0000 7fd66db0c9c0 5 AuthRegistry(0x55ef2e637790) adding con mode: crc 2024-09-14T11:35:24.347 INFO:tasks.workunit.client.0.smithi138.stderr: -278> 2024-09-14T11:35:23.803+0000 7fd66db0c9c0 5 AuthRegistry(0x55ef2e637790) adding con mode: crc 2024-09-14T11:35:24.347 INFO:tasks.workunit.client.0.smithi138.stderr: -277> 2024-09-14T11:35:23.803+0000 7fd66db0c9c0 5 AuthRegistry(0x55ef2e637790) adding con mode: secure 2024-09-14T11:35:24.347 INFO:tasks.workunit.client.0.smithi138.stderr: -276> 2024-09-14T11:35:23.803+0000 7fd66db0c9c0 5 AuthRegistry(0x55ef2e637790) adding con mode: crc 2024-09-14T11:35:24.347 INFO:tasks.workunit.client.0.smithi138.stderr: -275> 2024-09-14T11:35:23.803+0000 7fd66db0c9c0 5 AuthRegistry(0x55ef2e637790) adding con mode: secure 2024-09-14T11:35:24.347 INFO:tasks.workunit.client.0.smithi138.stderr: -274> 2024-09-14T11:35:23.803+0000 7fd66db0c9c0 5 AuthRegistry(0x55ef2e637790) adding con mode: crc 2024-09-14T11:35:24.347 INFO:tasks.workunit.client.0.smithi138.stderr: -273> 2024-09-14T11:35:23.803+0000 7fd66db0c9c0 5 AuthRegistry(0x55ef2e637790) adding con mode: secure 2024-09-14T11:35:24.347 INFO:tasks.workunit.client.0.smithi138.stderr: -272> 2024-09-14T11:35:23.803+0000 7fd66db0c9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:35:24.347 INFO:tasks.workunit.client.0.smithi138.stderr: -271> 2024-09-14T11:35:23.803+0000 7fd66db0c9c0 10 monclient: init 2024-09-14T11:35:24.347 INFO:tasks.workunit.client.0.smithi138.stderr: -270> 2024-09-14T11:35:23.803+0000 7fd66db0c9c0 5 AuthRegistry(0x7ffc065df340) adding auth protocol: cephx 2024-09-14T11:35:24.348 INFO:tasks.workunit.client.0.smithi138.stderr: -269> 2024-09-14T11:35:23.803+0000 7fd66db0c9c0 5 AuthRegistry(0x7ffc065df340) adding auth protocol: cephx 2024-09-14T11:35:24.348 INFO:tasks.workunit.client.0.smithi138.stderr: -268> 2024-09-14T11:35:23.803+0000 7fd66db0c9c0 5 AuthRegistry(0x7ffc065df340) adding auth protocol: cephx 2024-09-14T11:35:24.348 INFO:tasks.workunit.client.0.smithi138.stderr: -267> 2024-09-14T11:35:23.803+0000 7fd66db0c9c0 5 AuthRegistry(0x7ffc065df340) adding con mode: secure 2024-09-14T11:35:24.348 INFO:tasks.workunit.client.0.smithi138.stderr: -266> 2024-09-14T11:35:23.803+0000 7fd66db0c9c0 5 AuthRegistry(0x7ffc065df340) adding con mode: crc 2024-09-14T11:35:24.348 INFO:tasks.workunit.client.0.smithi138.stderr: -265> 2024-09-14T11:35:23.803+0000 7fd66db0c9c0 5 AuthRegistry(0x7ffc065df340) adding con mode: secure 2024-09-14T11:35:24.348 INFO:tasks.workunit.client.0.smithi138.stderr: -264> 2024-09-14T11:35:23.803+0000 7fd66db0c9c0 5 AuthRegistry(0x7ffc065df340) adding con mode: crc 2024-09-14T11:35:24.348 INFO:tasks.workunit.client.0.smithi138.stderr: -263> 2024-09-14T11:35:23.803+0000 7fd66db0c9c0 5 AuthRegistry(0x7ffc065df340) adding con mode: secure 2024-09-14T11:35:24.348 INFO:tasks.workunit.client.0.smithi138.stderr: -262> 2024-09-14T11:35:23.803+0000 7fd66db0c9c0 5 AuthRegistry(0x7ffc065df340) adding con mode: crc 2024-09-14T11:35:24.348 INFO:tasks.workunit.client.0.smithi138.stderr: -261> 2024-09-14T11:35:23.803+0000 7fd66db0c9c0 5 AuthRegistry(0x7ffc065df340) adding con mode: crc 2024-09-14T11:35:24.348 INFO:tasks.workunit.client.0.smithi138.stderr: -260> 2024-09-14T11:35:23.803+0000 7fd66db0c9c0 5 AuthRegistry(0x7ffc065df340) adding con mode: secure 2024-09-14T11:35:24.349 INFO:tasks.workunit.client.0.smithi138.stderr: -259> 2024-09-14T11:35:23.803+0000 7fd66db0c9c0 5 AuthRegistry(0x7ffc065df340) adding con mode: crc 2024-09-14T11:35:24.349 INFO:tasks.workunit.client.0.smithi138.stderr: -258> 2024-09-14T11:35:23.803+0000 7fd66db0c9c0 5 AuthRegistry(0x7ffc065df340) adding con mode: secure 2024-09-14T11:35:24.349 INFO:tasks.workunit.client.0.smithi138.stderr: -257> 2024-09-14T11:35:23.803+0000 7fd66db0c9c0 5 AuthRegistry(0x7ffc065df340) adding con mode: crc 2024-09-14T11:35:24.349 INFO:tasks.workunit.client.0.smithi138.stderr: -256> 2024-09-14T11:35:23.803+0000 7fd66db0c9c0 5 AuthRegistry(0x7ffc065df340) adding con mode: secure 2024-09-14T11:35:24.349 INFO:tasks.workunit.client.0.smithi138.stderr: -255> 2024-09-14T11:35:23.803+0000 7fd66db0c9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:35:24.350 INFO:tasks.workunit.client.0.smithi138.stderr: -254> 2024-09-14T11:35:23.803+0000 7fd66db0c9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:35:24.350 INFO:tasks.workunit.client.0.smithi138.stderr: -253> 2024-09-14T11:35:23.807+0000 7fd66db0c9c0 5 asok(0x55ef2e38dd90) register_command rotate-key cmddesc rotate-key hook 0x7ffc065df488 EEXIST 2024-09-14T11:35:24.350 INFO:tasks.workunit.client.0.smithi138.stderr: -252> 2024-09-14T11:35:23.807+0000 7fd66db0c9c0 10 monclient: _reopen_session rank -1 2024-09-14T11:35:24.350 INFO:tasks.workunit.client.0.smithi138.stderr: -251> 2024-09-14T11:35:23.807+0000 7fd66db0c9c0 10 monclient: _add_conns ranks=[1,2,0] 2024-09-14T11:35:24.350 INFO:tasks.workunit.client.0.smithi138.stderr: -250> 2024-09-14T11:35:23.807+0000 7fd66db0c9c0 10 monclient(hunting): picked mon.noname-b con 0x55ef2e66bdc0 addr [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] 2024-09-14T11:35:24.351 INFO:tasks.workunit.client.0.smithi138.stderr: -249> 2024-09-14T11:35:23.807+0000 7fd66db0c9c0 10 monclient(hunting): picked mon.noname-c con 0x55ef2e63b7e0 addr [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] 2024-09-14T11:35:24.351 INFO:tasks.workunit.client.0.smithi138.stderr: -248> 2024-09-14T11:35:23.807+0000 7fd66db0c9c0 10 monclient(hunting): picked mon.noname-a con 0x55ef2e667590 addr [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] 2024-09-14T11:35:24.351 INFO:tasks.workunit.client.0.smithi138.stderr: -247> 2024-09-14T11:35:23.807+0000 7fd66db0c9c0 10 monclient(hunting): start opening mon connection 2024-09-14T11:35:24.351 INFO:tasks.workunit.client.0.smithi138.stderr: -246> 2024-09-14T11:35:23.807+0000 7fd66db0c9c0 10 monclient(hunting): start opening mon connection 2024-09-14T11:35:24.351 INFO:tasks.workunit.client.0.smithi138.stderr: -245> 2024-09-14T11:35:23.807+0000 7fd66db0c9c0 10 monclient(hunting): start opening mon connection 2024-09-14T11:35:24.351 INFO:tasks.workunit.client.0.smithi138.stderr: -244> 2024-09-14T11:35:23.807+0000 7fd66db0c9c0 10 monclient(hunting): _renew_subs 2024-09-14T11:35:24.352 INFO:tasks.workunit.client.0.smithi138.stderr: -243> 2024-09-14T11:35:23.807+0000 7fd66db0c9c0 10 monclient(hunting): authenticate will time out at 2659.768138s 2024-09-14T11:35:24.352 INFO:tasks.workunit.client.0.smithi138.stderr: -242> 2024-09-14T11:35:23.807+0000 7fd66b612640 10 monclient(hunting): get_auth_request con 0x55ef2e667590 auth_method 0 2024-09-14T11:35:24.352 INFO:tasks.workunit.client.0.smithi138.stderr: -241> 2024-09-14T11:35:23.807+0000 7fd66b612640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:35:24.352 INFO:tasks.workunit.client.0.smithi138.stderr: -240> 2024-09-14T11:35:23.807+0000 7fd66b612640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:35:24.352 INFO:tasks.workunit.client.0.smithi138.stderr: -239> 2024-09-14T11:35:23.807+0000 7fd66b612640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:35:24.353 INFO:tasks.workunit.client.0.smithi138.stderr: -238> 2024-09-14T11:35:23.807+0000 7fd66be13640 10 monclient(hunting): get_auth_request con 0x55ef2e63b7e0 auth_method 0 2024-09-14T11:35:24.353 INFO:tasks.workunit.client.0.smithi138.stderr: -237> 2024-09-14T11:35:23.807+0000 7fd66be13640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:35:24.353 INFO:tasks.workunit.client.0.smithi138.stderr: -236> 2024-09-14T11:35:23.807+0000 7fd66be13640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:35:24.353 INFO:tasks.workunit.client.0.smithi138.stderr: -235> 2024-09-14T11:35:23.807+0000 7fd66be13640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:35:24.353 INFO:tasks.workunit.client.0.smithi138.stderr: -234> 2024-09-14T11:35:23.807+0000 7fd66b612640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:35:24.353 INFO:tasks.workunit.client.0.smithi138.stderr: -233> 2024-09-14T11:35:23.807+0000 7fd66b612640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:35:24.354 INFO:tasks.workunit.client.0.smithi138.stderr: -232> 2024-09-14T11:35:23.807+0000 7fd66b612640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:35:24.354 INFO:tasks.workunit.client.0.smithi138.stderr: -231> 2024-09-14T11:35:23.807+0000 7fd66be13640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:35:24.354 INFO:tasks.workunit.client.0.smithi138.stderr: -230> 2024-09-14T11:35:23.807+0000 7fd66be13640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:35:24.354 INFO:tasks.workunit.client.0.smithi138.stderr: -229> 2024-09-14T11:35:23.807+0000 7fd66be13640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:35:24.354 INFO:tasks.workunit.client.0.smithi138.stderr: -228> 2024-09-14T11:35:23.807+0000 7fd66b612640 10 monclient(hunting): handle_auth_done global_id 6798 payload 274 2024-09-14T11:35:24.354 INFO:tasks.workunit.client.0.smithi138.stderr: -227> 2024-09-14T11:35:23.807+0000 7fd66b612640 10 monclient: _finish_hunting 0 2024-09-14T11:35:24.355 INFO:tasks.workunit.client.0.smithi138.stderr: -226> 2024-09-14T11:35:23.807+0000 7fd66b612640 1 monclient: found mon.noname-a 2024-09-14T11:35:24.355 INFO:tasks.workunit.client.0.smithi138.stderr: -225> 2024-09-14T11:35:23.807+0000 7fd66b612640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.138:3300/0 2024-09-14T11:35:24.355 INFO:tasks.workunit.client.0.smithi138.stderr: -224> 2024-09-14T11:35:23.807+0000 7fd54effd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:35:24.355 INFO:tasks.workunit.client.0.smithi138.stderr: -223> 2024-09-14T11:35:23.807+0000 7fd54effd640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-14T11:35:24.355 INFO:tasks.workunit.client.0.smithi138.stderr: -222> 2024-09-14T11:35:23.807+0000 7fd54effd640 10 monclient: dump: 2024-09-14T11:35:24.355 INFO:tasks.workunit.client.0.smithi138.stderr:epoch 1 2024-09-14T11:35:24.356 INFO:tasks.workunit.client.0.smithi138.stderr:fsid 3f225f43-83a6-4aeb-b798-1f04bb49d597 2024-09-14T11:35:24.356 INFO:tasks.workunit.client.0.smithi138.stderr:last_changed 2024-09-14T11:07:09.252780+0000 2024-09-14T11:35:24.356 INFO:tasks.workunit.client.0.smithi138.stderr:created 2024-09-14T11:07:09.252780+0000 2024-09-14T11:35:24.356 INFO:tasks.workunit.client.0.smithi138.stderr:min_mon_release 19 (squid) 2024-09-14T11:35:24.356 INFO:tasks.workunit.client.0.smithi138.stderr:election_strategy: 1 2024-09-14T11:35:24.356 INFO:tasks.workunit.client.0.smithi138.stderr:0: [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] mon.a 2024-09-14T11:35:24.356 INFO:tasks.workunit.client.0.smithi138.stderr:1: [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] mon.b 2024-09-14T11:35:24.356 INFO:tasks.workunit.client.0.smithi138.stderr:2: [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] mon.c 2024-09-14T11:35:24.356 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-14T11:35:24.356 INFO:tasks.workunit.client.0.smithi138.stderr: -221> 2024-09-14T11:35:23.807+0000 7fd54effd640 10 monclient: _finish_auth 0 2024-09-14T11:35:24.356 INFO:tasks.workunit.client.0.smithi138.stderr: -220> 2024-09-14T11:35:23.807+0000 7fd54effd640 10 monclient: _check_auth_tickets 2024-09-14T11:35:24.357 INFO:tasks.workunit.client.0.smithi138.stderr: -219> 2024-09-14T11:35:23.807+0000 7fd54effd640 10 monclient: handle_config config(0 keys) 2024-09-14T11:35:24.357 INFO:tasks.workunit.client.0.smithi138.stderr: -218> 2024-09-14T11:35:23.807+0000 7fd54effd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:35:24.357 INFO:tasks.workunit.client.0.smithi138.stderr: -217> 2024-09-14T11:35:23.807+0000 7fd54effd640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-14T11:35:24.357 INFO:tasks.workunit.client.0.smithi138.stderr: -216> 2024-09-14T11:35:23.807+0000 7fd54effd640 10 monclient: dump: 2024-09-14T11:35:24.357 INFO:tasks.workunit.client.0.smithi138.stderr:epoch 1 2024-09-14T11:35:24.357 INFO:tasks.workunit.client.0.smithi138.stderr:fsid 3f225f43-83a6-4aeb-b798-1f04bb49d597 2024-09-14T11:35:24.357 INFO:tasks.workunit.client.0.smithi138.stderr:last_changed 2024-09-14T11:07:09.252780+0000 2024-09-14T11:35:24.357 INFO:tasks.workunit.client.0.smithi138.stderr:created 2024-09-14T11:07:09.252780+0000 2024-09-14T11:35:24.357 INFO:tasks.workunit.client.0.smithi138.stderr:min_mon_release 19 (squid) 2024-09-14T11:35:24.357 INFO:tasks.workunit.client.0.smithi138.stderr:election_strategy: 1 2024-09-14T11:35:24.357 INFO:tasks.workunit.client.0.smithi138.stderr:0: [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] mon.a 2024-09-14T11:35:24.357 INFO:tasks.workunit.client.0.smithi138.stderr:1: [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] mon.b 2024-09-14T11:35:24.357 INFO:tasks.workunit.client.0.smithi138.stderr:2: [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] mon.c 2024-09-14T11:35:24.358 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-14T11:35:24.358 INFO:tasks.workunit.client.0.smithi138.stderr: -215> 2024-09-14T11:35:23.807+0000 7fd66db0c9c0 5 monclient: authenticate success, global_id 6798 2024-09-14T11:35:24.358 INFO:tasks.workunit.client.0.smithi138.stderr: -214> 2024-09-14T11:35:23.807+0000 7fd66db0c9c0 10 monclient: get_monmap_and_config success 2024-09-14T11:35:24.358 INFO:tasks.workunit.client.0.smithi138.stderr: -213> 2024-09-14T11:35:23.807+0000 7fd66db0c9c0 4 set_mon_vals no callback set 2024-09-14T11:35:24.358 INFO:tasks.workunit.client.0.smithi138.stderr: -212> 2024-09-14T11:35:23.807+0000 7fd66db0c9c0 10 monclient: shutdown 2024-09-14T11:35:24.358 INFO:tasks.workunit.client.0.smithi138.stderr: -211> 2024-09-14T11:35:23.807+0000 7fd66db0c9c0 10 monclient: build_initial_monmap 2024-09-14T11:35:24.358 INFO:tasks.workunit.client.0.smithi138.stderr: -210> 2024-09-14T11:35:23.807+0000 7fd66db0c9c0 1 build_initial for_mkfs: 0 2024-09-14T11:35:24.358 INFO:tasks.workunit.client.0.smithi138.stderr: -209> 2024-09-14T11:35:23.807+0000 7fd66db0c9c0 10 monclient: monmap: 2024-09-14T11:35:24.358 INFO:tasks.workunit.client.0.smithi138.stderr:epoch 0 2024-09-14T11:35:24.358 INFO:tasks.workunit.client.0.smithi138.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-14T11:35:24.358 INFO:tasks.workunit.client.0.smithi138.stderr:last_changed 0.000000 2024-09-14T11:35:24.358 INFO:tasks.workunit.client.0.smithi138.stderr:created 0.000000 2024-09-14T11:35:24.358 INFO:tasks.workunit.client.0.smithi138.stderr:min_mon_release 0 (unknown) 2024-09-14T11:35:24.358 INFO:tasks.workunit.client.0.smithi138.stderr:election_strategy: 1 2024-09-14T11:35:24.358 INFO:tasks.workunit.client.0.smithi138.stderr:0: [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] mon.noname-a 2024-09-14T11:35:24.358 INFO:tasks.workunit.client.0.smithi138.stderr:1: [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] mon.noname-b 2024-09-14T11:35:24.359 INFO:tasks.workunit.client.0.smithi138.stderr:2: [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] mon.noname-c 2024-09-14T11:35:24.359 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-14T11:35:24.359 INFO:tasks.workunit.client.0.smithi138.stderr: -208> 2024-09-14T11:35:23.807+0000 7fd66db0c9c0 5 AuthRegistry(0x55ef2e65c7e0) adding auth protocol: cephx 2024-09-14T11:35:24.359 INFO:tasks.workunit.client.0.smithi138.stderr: -207> 2024-09-14T11:35:23.807+0000 7fd66db0c9c0 5 AuthRegistry(0x55ef2e65c7e0) adding auth protocol: cephx 2024-09-14T11:35:24.359 INFO:tasks.workunit.client.0.smithi138.stderr: -206> 2024-09-14T11:35:23.807+0000 7fd66db0c9c0 5 AuthRegistry(0x55ef2e65c7e0) adding auth protocol: cephx 2024-09-14T11:35:24.359 INFO:tasks.workunit.client.0.smithi138.stderr: -205> 2024-09-14T11:35:23.807+0000 7fd66db0c9c0 5 AuthRegistry(0x55ef2e65c7e0) adding con mode: secure 2024-09-14T11:35:24.359 INFO:tasks.workunit.client.0.smithi138.stderr: -204> 2024-09-14T11:35:23.807+0000 7fd66db0c9c0 5 AuthRegistry(0x55ef2e65c7e0) adding con mode: crc 2024-09-14T11:35:24.359 INFO:tasks.workunit.client.0.smithi138.stderr: -203> 2024-09-14T11:35:23.807+0000 7fd66db0c9c0 5 AuthRegistry(0x55ef2e65c7e0) adding con mode: secure 2024-09-14T11:35:24.359 INFO:tasks.workunit.client.0.smithi138.stderr: -202> 2024-09-14T11:35:23.807+0000 7fd66db0c9c0 5 AuthRegistry(0x55ef2e65c7e0) adding con mode: crc 2024-09-14T11:35:24.359 INFO:tasks.workunit.client.0.smithi138.stderr: -201> 2024-09-14T11:35:23.807+0000 7fd66db0c9c0 5 AuthRegistry(0x55ef2e65c7e0) adding con mode: secure 2024-09-14T11:35:24.359 INFO:tasks.workunit.client.0.smithi138.stderr: -200> 2024-09-14T11:35:23.807+0000 7fd66db0c9c0 5 AuthRegistry(0x55ef2e65c7e0) adding con mode: crc 2024-09-14T11:35:24.359 INFO:tasks.workunit.client.0.smithi138.stderr: -199> 2024-09-14T11:35:23.807+0000 7fd66db0c9c0 5 AuthRegistry(0x55ef2e65c7e0) adding con mode: crc 2024-09-14T11:35:24.359 INFO:tasks.workunit.client.0.smithi138.stderr: -198> 2024-09-14T11:35:23.807+0000 7fd66db0c9c0 5 AuthRegistry(0x55ef2e65c7e0) adding con mode: secure 2024-09-14T11:35:24.359 INFO:tasks.workunit.client.0.smithi138.stderr: -197> 2024-09-14T11:35:23.807+0000 7fd66db0c9c0 5 AuthRegistry(0x55ef2e65c7e0) adding con mode: crc 2024-09-14T11:35:24.359 INFO:tasks.workunit.client.0.smithi138.stderr: -196> 2024-09-14T11:35:23.807+0000 7fd66db0c9c0 5 AuthRegistry(0x55ef2e65c7e0) adding con mode: secure 2024-09-14T11:35:24.360 INFO:tasks.workunit.client.0.smithi138.stderr: -195> 2024-09-14T11:35:23.807+0000 7fd66db0c9c0 5 AuthRegistry(0x55ef2e65c7e0) adding con mode: crc 2024-09-14T11:35:24.360 INFO:tasks.workunit.client.0.smithi138.stderr: -194> 2024-09-14T11:35:23.807+0000 7fd66db0c9c0 5 AuthRegistry(0x55ef2e65c7e0) adding con mode: secure 2024-09-14T11:35:24.360 INFO:tasks.workunit.client.0.smithi138.stderr: -193> 2024-09-14T11:35:23.807+0000 7fd66db0c9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:35:24.360 INFO:tasks.workunit.client.0.smithi138.stderr: -192> 2024-09-14T11:35:23.807+0000 7fd66db0c9c0 1 librados: starting msgr at 2024-09-14T11:35:24.360 INFO:tasks.workunit.client.0.smithi138.stderr: -191> 2024-09-14T11:35:23.807+0000 7fd66db0c9c0 1 librados: starting objecter 2024-09-14T11:35:24.360 INFO:tasks.workunit.client.0.smithi138.stderr: -190> 2024-09-14T11:35:23.807+0000 7fd66db0c9c0 5 asok(0x55ef2e38dd90) register_command objecter_requests cmddesc objecter_requests hook 0x55ef2e667290 EEXIST 2024-09-14T11:35:24.360 INFO:tasks.workunit.client.0.smithi138.stderr: -189> 2024-09-14T11:35:23.807+0000 7fd66db0c9c0 1 librados: setting wanted keys 2024-09-14T11:35:24.360 INFO:tasks.workunit.client.0.smithi138.stderr: -188> 2024-09-14T11:35:23.807+0000 7fd66db0c9c0 1 librados: calling monclient init 2024-09-14T11:35:24.361 INFO:tasks.workunit.client.0.smithi138.stderr: -187> 2024-09-14T11:35:23.807+0000 7fd66db0c9c0 10 monclient: init 2024-09-14T11:35:24.361 INFO:tasks.workunit.client.0.smithi138.stderr: -186> 2024-09-14T11:35:23.807+0000 7fd66db0c9c0 5 AuthRegistry(0x55ef2e619c30) adding auth protocol: cephx 2024-09-14T11:35:24.361 INFO:tasks.workunit.client.0.smithi138.stderr: -185> 2024-09-14T11:35:23.807+0000 7fd66db0c9c0 5 AuthRegistry(0x55ef2e619c30) adding auth protocol: cephx 2024-09-14T11:35:24.361 INFO:tasks.workunit.client.0.smithi138.stderr: -184> 2024-09-14T11:35:23.807+0000 7fd66db0c9c0 5 AuthRegistry(0x55ef2e619c30) adding auth protocol: cephx 2024-09-14T11:35:24.361 INFO:tasks.workunit.client.0.smithi138.stderr: -183> 2024-09-14T11:35:23.807+0000 7fd66db0c9c0 5 AuthRegistry(0x55ef2e619c30) adding con mode: secure 2024-09-14T11:35:24.361 INFO:tasks.workunit.client.0.smithi138.stderr: -182> 2024-09-14T11:35:23.807+0000 7fd66db0c9c0 5 AuthRegistry(0x55ef2e619c30) adding con mode: crc 2024-09-14T11:35:24.362 INFO:tasks.workunit.client.0.smithi138.stderr: -181> 2024-09-14T11:35:23.807+0000 7fd66db0c9c0 5 AuthRegistry(0x55ef2e619c30) adding con mode: secure 2024-09-14T11:35:24.362 INFO:tasks.workunit.client.0.smithi138.stderr: -180> 2024-09-14T11:35:23.807+0000 7fd66db0c9c0 5 AuthRegistry(0x55ef2e619c30) adding con mode: crc 2024-09-14T11:35:24.362 INFO:tasks.workunit.client.0.smithi138.stderr: -179> 2024-09-14T11:35:23.807+0000 7fd66db0c9c0 5 AuthRegistry(0x55ef2e619c30) adding con mode: secure 2024-09-14T11:35:24.362 INFO:tasks.workunit.client.0.smithi138.stderr: -178> 2024-09-14T11:35:23.807+0000 7fd66db0c9c0 5 AuthRegistry(0x55ef2e619c30) adding con mode: crc 2024-09-14T11:35:24.362 INFO:tasks.workunit.client.0.smithi138.stderr: -177> 2024-09-14T11:35:23.807+0000 7fd66db0c9c0 5 AuthRegistry(0x55ef2e619c30) adding con mode: crc 2024-09-14T11:35:24.362 INFO:tasks.workunit.client.0.smithi138.stderr: -176> 2024-09-14T11:35:23.807+0000 7fd66db0c9c0 5 AuthRegistry(0x55ef2e619c30) adding con mode: secure 2024-09-14T11:35:24.363 INFO:tasks.workunit.client.0.smithi138.stderr: -175> 2024-09-14T11:35:23.807+0000 7fd66db0c9c0 5 AuthRegistry(0x55ef2e619c30) adding con mode: crc 2024-09-14T11:35:24.363 INFO:tasks.workunit.client.0.smithi138.stderr: -174> 2024-09-14T11:35:23.807+0000 7fd66db0c9c0 5 AuthRegistry(0x55ef2e619c30) adding con mode: secure 2024-09-14T11:35:24.363 INFO:tasks.workunit.client.0.smithi138.stderr: -173> 2024-09-14T11:35:23.807+0000 7fd66db0c9c0 5 AuthRegistry(0x55ef2e619c30) adding con mode: crc 2024-09-14T11:35:24.363 INFO:tasks.workunit.client.0.smithi138.stderr: -172> 2024-09-14T11:35:23.807+0000 7fd66db0c9c0 5 AuthRegistry(0x55ef2e619c30) adding con mode: secure 2024-09-14T11:35:24.363 INFO:tasks.workunit.client.0.smithi138.stderr: -171> 2024-09-14T11:35:23.807+0000 7fd66db0c9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:35:24.364 INFO:tasks.workunit.client.0.smithi138.stderr: -170> 2024-09-14T11:35:23.807+0000 7fd66db0c9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:35:24.364 INFO:tasks.workunit.client.0.smithi138.stderr: -169> 2024-09-14T11:35:23.807+0000 7fd66db0c9c0 5 asok(0x55ef2e38dd90) register_command rotate-key cmddesc rotate-key hook 0x55ef2e619d78 EEXIST 2024-09-14T11:35:24.364 INFO:tasks.workunit.client.0.smithi138.stderr: -168> 2024-09-14T11:35:23.807+0000 7fd66db0c9c0 10 monclient: _reopen_session rank -1 2024-09-14T11:35:24.364 INFO:tasks.workunit.client.0.smithi138.stderr: -167> 2024-09-14T11:35:23.807+0000 7fd66db0c9c0 10 monclient: _add_conns ranks=[2,0,1] 2024-09-14T11:35:24.364 INFO:tasks.workunit.client.0.smithi138.stderr: -166> 2024-09-14T11:35:23.807+0000 7fd66db0c9c0 10 monclient(hunting): picked mon.noname-c con 0x55ef2e63b7e0 addr [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] 2024-09-14T11:35:24.364 INFO:tasks.workunit.client.0.smithi138.stderr: -165> 2024-09-14T11:35:23.807+0000 7fd66db0c9c0 10 monclient(hunting): picked mon.noname-a con 0x55ef2e667590 addr [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] 2024-09-14T11:35:24.364 INFO:tasks.workunit.client.0.smithi138.stderr: -164> 2024-09-14T11:35:23.807+0000 7fd66db0c9c0 10 monclient(hunting): picked mon.noname-b con 0x55ef2e66bdc0 addr [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] 2024-09-14T11:35:24.364 INFO:tasks.workunit.client.0.smithi138.stderr: -163> 2024-09-14T11:35:23.807+0000 7fd66db0c9c0 10 monclient(hunting): start opening mon connection 2024-09-14T11:35:24.364 INFO:tasks.workunit.client.0.smithi138.stderr: -162> 2024-09-14T11:35:23.807+0000 7fd66db0c9c0 10 monclient(hunting): start opening mon connection 2024-09-14T11:35:24.364 INFO:tasks.workunit.client.0.smithi138.stderr: -161> 2024-09-14T11:35:23.807+0000 7fd66db0c9c0 10 monclient(hunting): start opening mon connection 2024-09-14T11:35:24.364 INFO:tasks.workunit.client.0.smithi138.stderr: -160> 2024-09-14T11:35:23.807+0000 7fd66db0c9c0 10 monclient(hunting): _renew_subs 2024-09-14T11:35:24.365 INFO:tasks.workunit.client.0.smithi138.stderr: -159> 2024-09-14T11:35:23.807+0000 7fd66db0c9c0 10 monclient(hunting): authenticate will time out at 2659.770636s 2024-09-14T11:35:24.365 INFO:tasks.workunit.client.0.smithi138.stderr: -158> 2024-09-14T11:35:23.807+0000 7fd66be13640 10 monclient(hunting): get_auth_request con 0x55ef2e667590 auth_method 0 2024-09-14T11:35:24.365 INFO:tasks.workunit.client.0.smithi138.stderr: -157> 2024-09-14T11:35:23.807+0000 7fd66be13640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:35:24.365 INFO:tasks.workunit.client.0.smithi138.stderr: -156> 2024-09-14T11:35:23.807+0000 7fd66be13640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:35:24.365 INFO:tasks.workunit.client.0.smithi138.stderr: -155> 2024-09-14T11:35:23.807+0000 7fd66be13640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:35:24.365 INFO:tasks.workunit.client.0.smithi138.stderr: -154> 2024-09-14T11:35:23.807+0000 7fd66ae11640 10 monclient(hunting): get_auth_request con 0x55ef2e63b7e0 auth_method 0 2024-09-14T11:35:24.365 INFO:tasks.workunit.client.0.smithi138.stderr: -153> 2024-09-14T11:35:23.807+0000 7fd66ae11640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:35:24.365 INFO:tasks.workunit.client.0.smithi138.stderr: -152> 2024-09-14T11:35:23.807+0000 7fd66ae11640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:35:24.365 INFO:tasks.workunit.client.0.smithi138.stderr: -151> 2024-09-14T11:35:23.807+0000 7fd66ae11640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:35:24.365 INFO:tasks.workunit.client.0.smithi138.stderr: -150> 2024-09-14T11:35:23.807+0000 7fd66be13640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:35:24.365 INFO:tasks.workunit.client.0.smithi138.stderr: -149> 2024-09-14T11:35:23.807+0000 7fd66be13640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:35:24.365 INFO:tasks.workunit.client.0.smithi138.stderr: -148> 2024-09-14T11:35:23.807+0000 7fd66be13640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:35:24.365 INFO:tasks.workunit.client.0.smithi138.stderr: -147> 2024-09-14T11:35:23.807+0000 7fd66ae11640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:35:24.365 INFO:tasks.workunit.client.0.smithi138.stderr: -146> 2024-09-14T11:35:23.807+0000 7fd66ae11640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:35:24.365 INFO:tasks.workunit.client.0.smithi138.stderr: -145> 2024-09-14T11:35:23.807+0000 7fd66ae11640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:35:24.365 INFO:tasks.workunit.client.0.smithi138.stderr: -144> 2024-09-14T11:35:23.807+0000 7fd66be13640 10 monclient(hunting): handle_auth_done global_id 6801 payload 824 2024-09-14T11:35:24.366 INFO:tasks.workunit.client.0.smithi138.stderr: -143> 2024-09-14T11:35:23.807+0000 7fd66be13640 10 monclient: _finish_hunting 0 2024-09-14T11:35:24.366 INFO:tasks.workunit.client.0.smithi138.stderr: -142> 2024-09-14T11:35:23.807+0000 7fd66be13640 1 monclient: found mon.noname-a 2024-09-14T11:35:24.366 INFO:tasks.workunit.client.0.smithi138.stderr: -141> 2024-09-14T11:35:23.807+0000 7fd66be13640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.138:3300/0 2024-09-14T11:35:24.366 INFO:tasks.workunit.client.0.smithi138.stderr: -140> 2024-09-14T11:35:23.807+0000 7fd66b612640 10 monclient: get_auth_request con 0x55ef2e66bdc0 auth_method 0 2024-09-14T11:35:24.366 INFO:tasks.workunit.client.0.smithi138.stderr: -139> 2024-09-14T11:35:23.807+0000 7fd54d7fa640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:35:24.366 INFO:tasks.workunit.client.0.smithi138.stderr: -138> 2024-09-14T11:35:23.807+0000 7fd54d7fa640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-14T11:35:24.366 INFO:tasks.workunit.client.0.smithi138.stderr: -137> 2024-09-14T11:35:23.807+0000 7fd54d7fa640 10 monclient: dump: 2024-09-14T11:35:24.366 INFO:tasks.workunit.client.0.smithi138.stderr:epoch 1 2024-09-14T11:35:24.366 INFO:tasks.workunit.client.0.smithi138.stderr:fsid 3f225f43-83a6-4aeb-b798-1f04bb49d597 2024-09-14T11:35:24.366 INFO:tasks.workunit.client.0.smithi138.stderr:last_changed 2024-09-14T11:07:09.252780+0000 2024-09-14T11:35:24.366 INFO:tasks.workunit.client.0.smithi138.stderr:created 2024-09-14T11:07:09.252780+0000 2024-09-14T11:35:24.366 INFO:tasks.workunit.client.0.smithi138.stderr:min_mon_release 19 (squid) 2024-09-14T11:35:24.366 INFO:tasks.workunit.client.0.smithi138.stderr:election_strategy: 1 2024-09-14T11:35:24.366 INFO:tasks.workunit.client.0.smithi138.stderr:0: [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] mon.a 2024-09-14T11:35:24.366 INFO:tasks.workunit.client.0.smithi138.stderr:1: [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] mon.b 2024-09-14T11:35:24.367 INFO:tasks.workunit.client.0.smithi138.stderr:2: [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] mon.c 2024-09-14T11:35:24.367 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-14T11:35:24.367 INFO:tasks.workunit.client.0.smithi138.stderr: -136> 2024-09-14T11:35:23.807+0000 7fd54d7fa640 10 monclient: _finish_auth 0 2024-09-14T11:35:24.367 INFO:tasks.workunit.client.0.smithi138.stderr: -135> 2024-09-14T11:35:23.807+0000 7fd54d7fa640 10 monclient: _check_auth_tickets 2024-09-14T11:35:24.367 INFO:tasks.workunit.client.0.smithi138.stderr: -134> 2024-09-14T11:35:23.807+0000 7fd54d7fa640 10 monclient: handle_config config(0 keys) 2024-09-14T11:35:24.367 INFO:tasks.workunit.client.0.smithi138.stderr: -133> 2024-09-14T11:35:23.807+0000 7fd54d7fa640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:35:24.367 INFO:tasks.workunit.client.0.smithi138.stderr: -132> 2024-09-14T11:35:23.807+0000 7fd54d7fa640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-14T11:35:24.367 INFO:tasks.workunit.client.0.smithi138.stderr: -131> 2024-09-14T11:35:23.807+0000 7fd54d7fa640 10 monclient: dump: 2024-09-14T11:35:24.367 INFO:tasks.workunit.client.0.smithi138.stderr:epoch 1 2024-09-14T11:35:24.367 INFO:tasks.workunit.client.0.smithi138.stderr:fsid 3f225f43-83a6-4aeb-b798-1f04bb49d597 2024-09-14T11:35:24.367 INFO:tasks.workunit.client.0.smithi138.stderr:last_changed 2024-09-14T11:07:09.252780+0000 2024-09-14T11:35:24.367 INFO:tasks.workunit.client.0.smithi138.stderr:created 2024-09-14T11:07:09.252780+0000 2024-09-14T11:35:24.367 INFO:tasks.workunit.client.0.smithi138.stderr:min_mon_release 19 (squid) 2024-09-14T11:35:24.367 INFO:tasks.workunit.client.0.smithi138.stderr:election_strategy: 1 2024-09-14T11:35:24.367 INFO:tasks.workunit.client.0.smithi138.stderr:0: [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] mon.a 2024-09-14T11:35:24.368 INFO:tasks.workunit.client.0.smithi138.stderr:1: [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] mon.b 2024-09-14T11:35:24.368 INFO:tasks.workunit.client.0.smithi138.stderr:2: [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] mon.c 2024-09-14T11:35:24.368 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-14T11:35:24.368 INFO:tasks.workunit.client.0.smithi138.stderr: -130> 2024-09-14T11:35:23.807+0000 7fd66db0c9c0 5 monclient: authenticate success, global_id 6801 2024-09-14T11:35:24.368 INFO:tasks.workunit.client.0.smithi138.stderr: -129> 2024-09-14T11:35:23.807+0000 7fd54effd640 4 set_mon_vals no callback set 2024-09-14T11:35:24.368 INFO:tasks.workunit.client.0.smithi138.stderr: -128> 2024-09-14T11:35:23.807+0000 7fd66db0c9c0 10 monclient: _renew_subs 2024-09-14T11:35:24.368 INFO:tasks.workunit.client.0.smithi138.stderr: -127> 2024-09-14T11:35:23.807+0000 7fd66db0c9c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.138:3300/0 2024-09-14T11:35:24.368 INFO:tasks.workunit.client.0.smithi138.stderr: -126> 2024-09-14T11:35:23.807+0000 7fd66db0c9c0 10 monclient: _renew_subs 2024-09-14T11:35:24.368 INFO:tasks.workunit.client.0.smithi138.stderr: -125> 2024-09-14T11:35:23.807+0000 7fd66db0c9c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.138:3300/0 2024-09-14T11:35:24.368 INFO:tasks.workunit.client.0.smithi138.stderr: -124> 2024-09-14T11:35:23.807+0000 7fd66db0c9c0 1 librados: init done 2024-09-14T11:35:24.368 INFO:tasks.workunit.client.0.smithi138.stderr: -123> 2024-09-14T11:35:23.807+0000 7fd66db0c9c0 5 asok(0x55ef2e38dd90) register_command cr dump hook 0x55ef2e66adb8 2024-09-14T11:35:24.368 INFO:tasks.workunit.client.0.smithi138.stderr: -122> 2024-09-14T11:35:23.811+0000 7fd66db0c9c0 20 rados->read ofs=0 len=0 2024-09-14T11:35:24.368 INFO:tasks.workunit.client.0.smithi138.stderr: -121> 2024-09-14T11:35:23.811+0000 7fd54d7fa640 4 mgrc handle_mgr_map Got map version 5 2024-09-14T11:35:24.368 INFO:tasks.workunit.client.0.smithi138.stderr: -120> 2024-09-14T11:35:23.811+0000 7fd54d7fa640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.138:6832/3778043143,v1:172.21.15.138:6833/3778043143] 2024-09-14T11:35:24.369 INFO:tasks.workunit.client.0.smithi138.stderr: -119> 2024-09-14T11:35:23.811+0000 7fd54d7fa640 4 mgrc reconnect Starting new session with [v2:172.21.15.138:6832/3778043143,v1:172.21.15.138:6833/3778043143] 2024-09-14T11:35:24.369 INFO:tasks.workunit.client.0.smithi138.stderr: -118> 2024-09-14T11:35:23.811+0000 7fd66ae11640 10 monclient: get_auth_request con 0x7fd5340718a0 auth_method 0 2024-09-14T11:35:24.369 INFO:tasks.workunit.client.0.smithi138.stderr: -117> 2024-09-14T11:35:23.811+0000 7fd66b612640 10 monclient: get_auth_request con 0x55ef2e685750 auth_method 0 2024-09-14T11:35:24.369 INFO:tasks.workunit.client.0.smithi138.stderr: -116> 2024-09-14T11:35:23.811+0000 7fd66db0c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:35:24.369 INFO:tasks.workunit.client.0.smithi138.stderr: -115> 2024-09-14T11:35:23.811+0000 7fd66db0c9c0 20 realm 2024-09-14T11:35:24.369 INFO:tasks.workunit.client.0.smithi138.stderr: -114> 2024-09-14T11:35:23.811+0000 7fd66db0c9c0 20 rados->read ofs=0 len=0 2024-09-14T11:35:24.369 INFO:tasks.workunit.client.0.smithi138.stderr: -113> 2024-09-14T11:35:23.811+0000 7fd66db0c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:35:24.369 INFO:tasks.workunit.client.0.smithi138.stderr: -112> 2024-09-14T11:35:23.811+0000 7fd66db0c9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:35:24.369 INFO:tasks.workunit.client.0.smithi138.stderr: -111> 2024-09-14T11:35:23.811+0000 7fd66db0c9c0 20 rados->read ofs=0 len=0 2024-09-14T11:35:24.369 INFO:tasks.workunit.client.0.smithi138.stderr: -110> 2024-09-14T11:35:23.811+0000 7fd66db0c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:35:24.369 INFO:tasks.workunit.client.0.smithi138.stderr: -109> 2024-09-14T11:35:23.811+0000 7fd66db0c9c0 20 rados->read ofs=0 len=0 2024-09-14T11:35:24.369 INFO:tasks.workunit.client.0.smithi138.stderr: -108> 2024-09-14T11:35:23.815+0000 7fd66ae11640 10 monclient: get_auth_request con 0x55ef2e689a60 auth_method 0 2024-09-14T11:35:24.369 INFO:tasks.workunit.client.0.smithi138.stderr: -107> 2024-09-14T11:35:23.815+0000 7fd66db0c9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:35:24.369 INFO:tasks.workunit.client.0.smithi138.stderr: -106> 2024-09-14T11:35:23.815+0000 7fd66db0c9c0 20 rados->read ofs=0 len=0 2024-09-14T11:35:24.369 INFO:tasks.workunit.client.0.smithi138.stderr: -105> 2024-09-14T11:35:23.815+0000 7fd66be13640 10 monclient: get_auth_request con 0x55ef2e68d180 auth_method 0 2024-09-14T11:35:24.370 INFO:tasks.workunit.client.0.smithi138.stderr: -104> 2024-09-14T11:35:23.815+0000 7fd66db0c9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:35:24.370 INFO:tasks.workunit.client.0.smithi138.stderr: -103> 2024-09-14T11:35:23.815+0000 7fd66db0c9c0 20 searching for the correct realm 2024-09-14T11:35:24.370 INFO:tasks.workunit.client.0.smithi138.stderr: -102> 2024-09-14T11:35:23.815+0000 7fd66b612640 10 monclient: get_auth_request con 0x55ef2e691f40 auth_method 0 2024-09-14T11:35:24.370 INFO:tasks.workunit.client.0.smithi138.stderr: -101> 2024-09-14T11:35:23.815+0000 7fd66ae11640 10 monclient: get_auth_request con 0x7fd65c04a070 auth_method 0 2024-09-14T11:35:24.370 INFO:tasks.workunit.client.0.smithi138.stderr: -100> 2024-09-14T11:35:23.819+0000 7fd66be13640 10 monclient: get_auth_request con 0x7fd664064900 auth_method 0 2024-09-14T11:35:24.370 INFO:tasks.workunit.client.0.smithi138.stderr: -99> 2024-09-14T11:35:23.819+0000 7fd66be13640 0 -- 172.21.15.138:0/3136175301 >> [v2:172.21.15.154:6824/416768175,v1:172.21.15.154:6825/416768175] conn(0x7fd664064900 msgr2=0x7fd664063370 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:35:24.370 INFO:tasks.workunit.client.0.smithi138.stderr: -98> 2024-09-14T11:35:24.023+0000 7fd66be13640 10 monclient: get_auth_request con 0x7fd664064900 auth_method 0 2024-09-14T11:35:24.370 INFO:tasks.workunit.client.0.smithi138.stderr: -97> 2024-09-14T11:35:24.027+0000 7fd66b612640 10 monclient: get_auth_request con 0x7fd664077040 auth_method 0 2024-09-14T11:35:24.370 INFO:tasks.workunit.client.0.smithi138.stderr: -96> 2024-09-14T11:35:24.035+0000 7fd66ae11640 10 monclient: get_auth_request con 0x7fd66406dba0 auth_method 0 2024-09-14T11:35:24.370 INFO:tasks.workunit.client.0.smithi138.stderr: -95> 2024-09-14T11:35:24.035+0000 7fd66ae11640 0 -- 172.21.15.138:0/3136175301 >> [v2:172.21.15.138:6816/326481658,v1:172.21.15.138:6817/326481658] conn(0x7fd66406dba0 msgr2=0x7fd66407e900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:35:24.370 INFO:tasks.workunit.client.0.smithi138.stderr: -94> 2024-09-14T11:35:24.239+0000 7fd66ae11640 10 monclient: get_auth_request con 0x7fd66406dba0 auth_method 0 2024-09-14T11:35:24.370 INFO:tasks.workunit.client.0.smithi138.stderr: -93> 2024-09-14T11:35:24.251+0000 7fd66db0c9c0 20 RGWRados::pool_iterate: got zone_info.d9e72d30-c60b-4d0d-9267-fdc36392d5ad 2024-09-14T11:35:24.370 INFO:tasks.workunit.client.0.smithi138.stderr: -92> 2024-09-14T11:35:24.251+0000 7fd66db0c9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:35:24.370 INFO:tasks.workunit.client.0.smithi138.stderr: -91> 2024-09-14T11:35:24.251+0000 7fd66db0c9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:35:24.370 INFO:tasks.workunit.client.0.smithi138.stderr: -90> 2024-09-14T11:35:24.251+0000 7fd66db0c9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:35:24.370 INFO:tasks.workunit.client.0.smithi138.stderr: -89> 2024-09-14T11:35:24.251+0000 7fd66db0c9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:35:24.371 INFO:tasks.workunit.client.0.smithi138.stderr: -88> 2024-09-14T11:35:24.251+0000 7fd66db0c9c0 20 RGWRados::pool_iterate: got zonegroup_info.65ab941b-da8c-4160-94fb-3672b069d44f 2024-09-14T11:35:24.371 INFO:tasks.workunit.client.0.smithi138.stderr: -87> 2024-09-14T11:35:24.251+0000 7fd66db0c9c0 20 rados->read ofs=0 len=0 2024-09-14T11:35:24.371 INFO:tasks.workunit.client.0.smithi138.stderr: -86> 2024-09-14T11:35:24.251+0000 7fd66db0c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:35:24.371 INFO:tasks.workunit.client.0.smithi138.stderr: -85> 2024-09-14T11:35:24.251+0000 7fd66db0c9c0 20 rados->read ofs=0 len=0 2024-09-14T11:35:24.371 INFO:tasks.workunit.client.0.smithi138.stderr: -84> 2024-09-14T11:35:24.255+0000 7fd66db0c9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:35:24.371 INFO:tasks.workunit.client.0.smithi138.stderr: -83> 2024-09-14T11:35:24.255+0000 7fd66db0c9c0 20 rados->read ofs=0 len=0 2024-09-14T11:35:24.371 INFO:tasks.workunit.client.0.smithi138.stderr: -82> 2024-09-14T11:35:24.255+0000 7fd66db0c9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:35:24.371 INFO:tasks.workunit.client.0.smithi138.stderr: -81> 2024-09-14T11:35:24.255+0000 7fd66db0c9c0 20 zone default found 2024-09-14T11:35:24.371 INFO:tasks.workunit.client.0.smithi138.stderr: -80> 2024-09-14T11:35:24.255+0000 7fd66db0c9c0 4 Realm: () 2024-09-14T11:35:24.371 INFO:tasks.workunit.client.0.smithi138.stderr: -79> 2024-09-14T11:35:24.255+0000 7fd66db0c9c0 4 ZoneGroup: default (65ab941b-da8c-4160-94fb-3672b069d44f) 2024-09-14T11:35:24.371 INFO:tasks.workunit.client.0.smithi138.stderr: -78> 2024-09-14T11:35:24.255+0000 7fd66db0c9c0 4 Zone: default (d9e72d30-c60b-4d0d-9267-fdc36392d5ad) 2024-09-14T11:35:24.371 INFO:tasks.workunit.client.0.smithi138.stderr: -77> 2024-09-14T11:35:24.255+0000 7fd66db0c9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:35:24.371 INFO:tasks.workunit.client.0.smithi138.stderr: -76> 2024-09-14T11:35:24.255+0000 7fd66db0c9c0 20 zonegroup default 2024-09-14T11:35:24.372 INFO:tasks.workunit.client.0.smithi138.stderr: -75> 2024-09-14T11:35:24.255+0000 7fd66db0c9c0 20 rados->read ofs=0 len=0 2024-09-14T11:35:24.372 INFO:tasks.workunit.client.0.smithi138.stderr: -74> 2024-09-14T11:35:24.255+0000 7fd66db0c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:35:24.372 INFO:tasks.workunit.client.0.smithi138.stderr: -73> 2024-09-14T11:35:24.255+0000 7fd66db0c9c0 20 rados->read ofs=0 len=0 2024-09-14T11:35:24.372 INFO:tasks.workunit.client.0.smithi138.stderr: -72> 2024-09-14T11:35:24.255+0000 7fd66db0c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:35:24.372 INFO:tasks.workunit.client.0.smithi138.stderr: -71> 2024-09-14T11:35:24.255+0000 7fd66db0c9c0 20 rados->read ofs=0 len=0 2024-09-14T11:35:24.372 INFO:tasks.workunit.client.0.smithi138.stderr: -70> 2024-09-14T11:35:24.259+0000 7fd66db0c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:35:24.372 INFO:tasks.workunit.client.0.smithi138.stderr: -69> 2024-09-14T11:35:24.259+0000 7fd66db0c9c0 20 started sync module instance, tier type = 2024-09-14T11:35:24.372 INFO:tasks.workunit.client.0.smithi138.stderr: -68> 2024-09-14T11:35:24.259+0000 7fd66db0c9c0 20 started zone id=d9e72d30-c60b-4d0d-9267-fdc36392d5ad (name=default) with tier type = 2024-09-14T11:35:24.372 INFO:tasks.workunit.client.0.smithi138.stderr: -67> 2024-09-14T11:35:24.283+0000 7fd66db0c9c0 20 add_watcher() i=0 2024-09-14T11:35:24.372 INFO:tasks.workunit.client.0.smithi138.stderr: -66> 2024-09-14T11:35:24.283+0000 7fd66db0c9c0 20 add_watcher() i=1 2024-09-14T11:35:24.372 INFO:tasks.workunit.client.0.smithi138.stderr: -65> 2024-09-14T11:35:24.283+0000 7fd66db0c9c0 20 add_watcher() i=2 2024-09-14T11:35:24.372 INFO:tasks.workunit.client.0.smithi138.stderr: -64> 2024-09-14T11:35:24.283+0000 7fd66db0c9c0 20 add_watcher() i=3 2024-09-14T11:35:24.373 INFO:tasks.workunit.client.0.smithi138.stderr: -63> 2024-09-14T11:35:24.283+0000 7fd66db0c9c0 20 add_watcher() i=4 2024-09-14T11:35:24.373 INFO:tasks.workunit.client.0.smithi138.stderr: -62> 2024-09-14T11:35:24.283+0000 7fd66db0c9c0 20 add_watcher() i=5 2024-09-14T11:35:24.373 INFO:tasks.workunit.client.0.smithi138.stderr: -61> 2024-09-14T11:35:24.283+0000 7fd66db0c9c0 20 add_watcher() i=6 2024-09-14T11:35:24.373 INFO:tasks.workunit.client.0.smithi138.stderr: -60> 2024-09-14T11:35:24.283+0000 7fd66db0c9c0 20 add_watcher() i=7 2024-09-14T11:35:24.373 INFO:tasks.workunit.client.0.smithi138.stderr: -59> 2024-09-14T11:35:24.283+0000 7fd66db0c9c0 2 all 8 watchers are set, enabling cache 2024-09-14T11:35:24.373 INFO:tasks.workunit.client.0.smithi138.stderr: -58> 2024-09-14T11:35:24.287+0000 7fd66db0c9c0 5 AuthRegistry(0x7ffc065df820) adding auth protocol: cephx 2024-09-14T11:35:24.373 INFO:tasks.workunit.client.0.smithi138.stderr: -57> 2024-09-14T11:35:24.287+0000 7fd66db0c9c0 5 AuthRegistry(0x7ffc065df820) adding auth protocol: cephx 2024-09-14T11:35:24.373 INFO:tasks.workunit.client.0.smithi138.stderr: -56> 2024-09-14T11:35:24.287+0000 7fd66db0c9c0 5 AuthRegistry(0x7ffc065df820) adding auth protocol: cephx 2024-09-14T11:35:24.373 INFO:tasks.workunit.client.0.smithi138.stderr: -55> 2024-09-14T11:35:24.287+0000 7fd66db0c9c0 5 AuthRegistry(0x7ffc065df820) adding con mode: secure 2024-09-14T11:35:24.373 INFO:tasks.workunit.client.0.smithi138.stderr: -54> 2024-09-14T11:35:24.287+0000 7fd66db0c9c0 5 AuthRegistry(0x7ffc065df820) adding con mode: crc 2024-09-14T11:35:24.373 INFO:tasks.workunit.client.0.smithi138.stderr: -53> 2024-09-14T11:35:24.287+0000 7fd66db0c9c0 5 AuthRegistry(0x7ffc065df820) adding con mode: secure 2024-09-14T11:35:24.373 INFO:tasks.workunit.client.0.smithi138.stderr: -52> 2024-09-14T11:35:24.287+0000 7fd66db0c9c0 5 AuthRegistry(0x7ffc065df820) adding con mode: crc 2024-09-14T11:35:24.373 INFO:tasks.workunit.client.0.smithi138.stderr: -51> 2024-09-14T11:35:24.287+0000 7fd66db0c9c0 5 AuthRegistry(0x7ffc065df820) adding con mode: secure 2024-09-14T11:35:24.373 INFO:tasks.workunit.client.0.smithi138.stderr: -50> 2024-09-14T11:35:24.287+0000 7fd66db0c9c0 5 AuthRegistry(0x7ffc065df820) adding con mode: crc 2024-09-14T11:35:24.373 INFO:tasks.workunit.client.0.smithi138.stderr: -49> 2024-09-14T11:35:24.287+0000 7fd66db0c9c0 5 AuthRegistry(0x7ffc065df820) adding con mode: crc 2024-09-14T11:35:24.374 INFO:tasks.workunit.client.0.smithi138.stderr: -48> 2024-09-14T11:35:24.287+0000 7fd66db0c9c0 5 AuthRegistry(0x7ffc065df820) adding con mode: secure 2024-09-14T11:35:24.374 INFO:tasks.workunit.client.0.smithi138.stderr: -47> 2024-09-14T11:35:24.287+0000 7fd66db0c9c0 5 AuthRegistry(0x7ffc065df820) adding con mode: crc 2024-09-14T11:35:24.374 INFO:tasks.workunit.client.0.smithi138.stderr: -46> 2024-09-14T11:35:24.287+0000 7fd66db0c9c0 5 AuthRegistry(0x7ffc065df820) adding con mode: secure 2024-09-14T11:35:24.374 INFO:tasks.workunit.client.0.smithi138.stderr: -45> 2024-09-14T11:35:24.287+0000 7fd66db0c9c0 5 AuthRegistry(0x7ffc065df820) adding con mode: crc 2024-09-14T11:35:24.374 INFO:tasks.workunit.client.0.smithi138.stderr: -44> 2024-09-14T11:35:24.287+0000 7fd66db0c9c0 5 AuthRegistry(0x7ffc065df820) adding con mode: secure 2024-09-14T11:35:24.374 INFO:tasks.workunit.client.0.smithi138.stderr: -43> 2024-09-14T11:35:24.287+0000 7fd521fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:35:24.374 INFO:tasks.workunit.client.0.smithi138.stderr: -42> 2024-09-14T11:35:24.291+0000 7fd66db0c9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:35:24.374 INFO:tasks.workunit.client.0.smithi138.stderr: -41> 2024-09-14T11:35:24.291+0000 7fd66db0c9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:35:24.374 INFO:tasks.workunit.client.0.smithi138.stderr: -40> 2024-09-14T11:35:24.291+0000 7fd66db0c9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:35:24.374 INFO:tasks.workunit.client.0.smithi138.stderr: -39> 2024-09-14T11:35:24.291+0000 7fd66db0c9c0 5 asok(0x55ef2e38dd90) register_command cache list hook 0x55ef2e63a6f0 2024-09-14T11:35:24.374 INFO:tasks.workunit.client.0.smithi138.stderr: -38> 2024-09-14T11:35:24.291+0000 7fd66db0c9c0 5 asok(0x55ef2e38dd90) register_command cache inspect hook 0x55ef2e63a6f0 2024-09-14T11:35:24.374 INFO:tasks.workunit.client.0.smithi138.stderr: -37> 2024-09-14T11:35:24.291+0000 7fd66db0c9c0 5 asok(0x55ef2e38dd90) register_command cache erase hook 0x55ef2e63a6f0 2024-09-14T11:35:24.374 INFO:tasks.workunit.client.0.smithi138.stderr: -36> 2024-09-14T11:35:24.291+0000 7fd66db0c9c0 5 asok(0x55ef2e38dd90) register_command cache zap hook 0x55ef2e63a6f0 2024-09-14T11:35:24.374 INFO:tasks.workunit.client.0.smithi138.stderr: -35> 2024-09-14T11:35:24.291+0000 7fd66db0c9c0 5 note: GC not initialized 2024-09-14T11:35:24.374 INFO:tasks.workunit.client.0.smithi138.stderr: -34> 2024-09-14T11:35:24.291+0000 7fd520fe1640 20 reqs_thread_entry: start 2024-09-14T11:35:24.374 INFO:tasks.workunit.client.0.smithi138.stderr: -33> 2024-09-14T11:35:24.291+0000 7fd66db0c9c0 5 asok(0x55ef2e38dd90) register_command sync trace show hook 0x7fd66400c040 2024-09-14T11:35:24.375 INFO:tasks.workunit.client.0.smithi138.stderr: -32> 2024-09-14T11:35:24.291+0000 7fd66db0c9c0 5 asok(0x55ef2e38dd90) register_command sync trace history hook 0x7fd66400c040 2024-09-14T11:35:24.375 INFO:tasks.workunit.client.0.smithi138.stderr: -31> 2024-09-14T11:35:24.291+0000 7fd66db0c9c0 5 asok(0x55ef2e38dd90) register_command sync trace active hook 0x7fd66400c040 2024-09-14T11:35:24.375 INFO:tasks.workunit.client.0.smithi138.stderr: -30> 2024-09-14T11:35:24.291+0000 7fd66db0c9c0 5 asok(0x55ef2e38dd90) register_command sync trace active_short hook 0x7fd66400c040 2024-09-14T11:35:24.375 INFO:tasks.workunit.client.0.smithi138.stderr: -29> 2024-09-14T11:35:24.291+0000 7fd66db0c9c0 20 init_complete bucket index max shards: 11 2024-09-14T11:35:24.375 INFO:tasks.workunit.client.0.smithi138.stderr: -28> 2024-09-14T11:35:24.291+0000 7fd66db0c9c0 20 Filter name: none 2024-09-14T11:35:24.375 INFO:tasks.workunit.client.0.smithi138.stderr: -27> 2024-09-14T11:35:24.291+0000 7fd49a7fc640 20 reqs_thread_entry: start 2024-09-14T11:35:24.375 INFO:tasks.workunit.client.0.smithi138.stderr: -26> 2024-09-14T11:35:24.291+0000 7fd66db0c9c0 10 cache get: name=default.rgw.meta+root+abort-at-trim-reshard-log-entries : miss 2024-09-14T11:35:24.375 INFO:tasks.workunit.client.0.smithi138.stderr: -25> 2024-09-14T11:35:24.291+0000 7fd66db0c9c0 20 rados->read ofs=0 len=0 2024-09-14T11:35:24.375 INFO:tasks.workunit.client.0.smithi138.stderr: -24> 2024-09-14T11:35:24.291+0000 7fd66db0c9c0 20 rados_obj.operate() r=0 bl.length=201 2024-09-14T11:35:24.375 INFO:tasks.workunit.client.0.smithi138.stderr: -23> 2024-09-14T11:35:24.291+0000 7fd66db0c9c0 10 cache put: name=default.rgw.meta+root+abort-at-trim-reshard-log-entries info.flags=0x11 2024-09-14T11:35:24.375 INFO:tasks.workunit.client.0.smithi138.stderr: -22> 2024-09-14T11:35:24.291+0000 7fd66db0c9c0 10 adding default.rgw.meta+root+abort-at-trim-reshard-log-entries to cache LRU end 2024-09-14T11:35:24.375 INFO:tasks.workunit.client.0.smithi138.stderr: -21> 2024-09-14T11:35:24.291+0000 7fd66db0c9c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.27 : miss 2024-09-14T11:35:24.375 INFO:tasks.workunit.client.0.smithi138.stderr: -20> 2024-09-14T11:35:24.291+0000 7fd66db0c9c0 20 rados->read ofs=0 len=0 2024-09-14T11:35:24.375 INFO:tasks.workunit.client.0.smithi138.stderr: -19> 2024-09-14T11:35:24.295+0000 7fd66db0c9c0 20 rados_obj.operate() r=0 bl.length=423 2024-09-14T11:35:24.375 INFO:tasks.workunit.client.0.smithi138.stderr: -18> 2024-09-14T11:35:24.295+0000 7fd66db0c9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.27 info.flags=0x17 2024-09-14T11:35:24.376 INFO:tasks.workunit.client.0.smithi138.stderr: -17> 2024-09-14T11:35:24.295+0000 7fd66db0c9c0 10 adding default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.27 to cache LRU end 2024-09-14T11:35:24.376 INFO:tasks.workunit.client.0.smithi138.stderr: -16> 2024-09-14T11:35:24.295+0000 7fd66db0c9c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:35:24.376 INFO:tasks.workunit.client.0.smithi138.stderr: -15> 2024-09-14T11:35:24.295+0000 7fd66db0c9c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:35:24.376 INFO:tasks.workunit.client.0.smithi138.stderr: -14> 2024-09-14T11:35:24.295+0000 7fd66db0c9c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.27 2024-09-14T11:35:24.376 INFO:tasks.workunit.client.0.smithi138.stderr: -13> 2024-09-14T11:35:24.303+0000 7fd66db0c9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.27 info.flags=0x17 2024-09-14T11:35:24.376 INFO:tasks.workunit.client.0.smithi138.stderr: -12> 2024-09-14T11:35:24.303+0000 7fd66db0c9c0 10 moving default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.27 to cache LRU end 2024-09-14T11:35:24.376 INFO:tasks.workunit.client.0.smithi138.stderr: -11> 2024-09-14T11:35:24.303+0000 7fd66db0c9c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:35:24.376 INFO:tasks.workunit.client.0.smithi138.stderr: -10> 2024-09-14T11:35:24.303+0000 7fd66db0c9c0 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-trim-reshard-log-entries:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.27, ofs0, ns] 2024-09-14T11:35:24.376 INFO:tasks.workunit.client.0.smithi138.stderr: -9> 2024-09-14T11:35:24.303+0000 7fd54effd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366221 cookie 94485764207776 notifier 6801 bl.length()=939 2024-09-14T11:35:24.376 INFO:tasks.workunit.client.0.smithi138.stderr: -8> 2024-09-14T11:35:24.303+0000 7fd54effd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.27 info.flags=0x17 2024-09-14T11:35:24.376 INFO:tasks.workunit.client.0.smithi138.stderr: -7> 2024-09-14T11:35:24.303+0000 7fd54effd640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.27 to cache LRU end 2024-09-14T11:35:24.376 INFO:tasks.workunit.client.0.smithi138.stderr: -6> 2024-09-14T11:35:24.303+0000 7fd54effd640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:35:24.376 INFO:tasks.workunit.client.0.smithi138.stderr: -5> 2024-09-14T11:35:24.307+0000 7fd66db0c9c0 20 handle_bi_update(): bucket=:abort-at-trim-reshard-log-entries[d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.27]): orig_sources= new_sources= 2024-09-14T11:35:24.376 INFO:tasks.workunit.client.0.smithi138.stderr: -4> 2024-09-14T11:35:24.307+0000 7fd66db0c9c0 20 handle_bi_update(): bucket=:abort-at-trim-reshard-log-entries[d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.27]): potential sources added=[] removed=[] 2024-09-14T11:35:24.376 INFO:tasks.workunit.client.0.smithi138.stderr: -3> 2024-09-14T11:35:24.307+0000 7fd66db0c9c0 20 handle_bi_update(): bucket=:abort-at-trim-reshard-log-entries[d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.27]): orig_dests= new_dests= 2024-09-14T11:35:24.377 INFO:tasks.workunit.client.0.smithi138.stderr: -2> 2024-09-14T11:35:24.307+0000 7fd66db0c9c0 20 handle_bi_update(): bucket=:abort-at-trim-reshard-log-entries[d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.27]): potential dests added=[] removed=[] 2024-09-14T11:35:24.377 INFO:tasks.workunit.client.0.smithi138.stderr: -1> 2024-09-14T11:35:24.307+0000 7fd66db0c9c0 -1 ./src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7fd66db0c9c0 time 2024-09-14T11:35:24.310908+0000 2024-09-14T11:35:24.377 INFO:tasks.workunit.client.0.smithi138.stderr:./src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-14T11:35:24.377 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-14T11:35:24.377 INFO:tasks.workunit.client.0.smithi138.stderr: ceph version 19.3.0-4907-ga2782315 (a2782315255a3e7d5f6cdc9eb35785187ff6ddf8) squid (dev) 2024-09-14T11:35:24.377 INFO:tasks.workunit.client.0.smithi138.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x121) [0x7fd6713e62eb] 2024-09-14T11:35:24.377 INFO:tasks.workunit.client.0.smithi138.stderr: 2: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7fd6713e649f] 2024-09-14T11:35:24.377 INFO:tasks.workunit.client.0.smithi138.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55ef2c6fcc01] 2024-09-14T11:35:24.377 INFO:tasks.workunit.client.0.smithi138.stderr: 4: radosgw-admin(+0x14231ee) [0x55ef2d15b1ee] 2024-09-14T11:35:24.377 INFO:tasks.workunit.client.0.smithi138.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x55ef2c711ecd] 2024-09-14T11:35:24.377 INFO:tasks.workunit.client.0.smithi138.stderr: 6: main() 2024-09-14T11:35:24.377 INFO:tasks.workunit.client.0.smithi138.stderr: 7: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7fd67024cd90] 2024-09-14T11:35:24.378 INFO:tasks.workunit.client.0.smithi138.stderr: 8: __libc_start_main() 2024-09-14T11:35:24.378 INFO:tasks.workunit.client.0.smithi138.stderr: 9: _start() 2024-09-14T11:35:24.378 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-14T11:35:24.378 INFO:tasks.workunit.client.0.smithi138.stderr: 0> 2024-09-14T11:35:24.311+0000 7fd66db0c9c0 -1 *** Caught signal (Aborted) ** 2024-09-14T11:35:24.378 INFO:tasks.workunit.client.0.smithi138.stderr: in thread 7fd66db0c9c0 thread_name:radosgw-admin 2024-09-14T11:35:24.378 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-14T11:35:24.378 INFO:tasks.workunit.client.0.smithi138.stderr: ceph version 19.3.0-4907-ga2782315 (a2782315255a3e7d5f6cdc9eb35785187ff6ddf8) squid (dev) 2024-09-14T11:35:24.378 INFO:tasks.workunit.client.0.smithi138.stderr: 1: /lib/x86_64-linux-gnu/libc.so.6(+0x42520) [0x7fd670265520] 2024-09-14T11:35:24.378 INFO:tasks.workunit.client.0.smithi138.stderr: 2: pthread_kill() 2024-09-14T11:35:24.378 INFO:tasks.workunit.client.0.smithi138.stderr: 3: raise() 2024-09-14T11:35:24.378 INFO:tasks.workunit.client.0.smithi138.stderr: 4: abort() 2024-09-14T11:35:24.378 INFO:tasks.workunit.client.0.smithi138.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x17b) [0x7fd6713e6345] 2024-09-14T11:35:24.378 INFO:tasks.workunit.client.0.smithi138.stderr: 6: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7fd6713e649f] 2024-09-14T11:35:24.378 INFO:tasks.workunit.client.0.smithi138.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55ef2c6fcc01] 2024-09-14T11:35:24.378 INFO:tasks.workunit.client.0.smithi138.stderr: 8: radosgw-admin(+0x14231ee) [0x55ef2d15b1ee] 2024-09-14T11:35:24.379 INFO:tasks.workunit.client.0.smithi138.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x55ef2c711ecd] 2024-09-14T11:35:24.379 INFO:tasks.workunit.client.0.smithi138.stderr: 10: main() 2024-09-14T11:35:24.379 INFO:tasks.workunit.client.0.smithi138.stderr: 11: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7fd67024cd90] 2024-09-14T11:35:24.379 INFO:tasks.workunit.client.0.smithi138.stderr: 12: __libc_start_main() 2024-09-14T11:35:24.379 INFO:tasks.workunit.client.0.smithi138.stderr: 13: _start() 2024-09-14T11:35:24.379 INFO:tasks.workunit.client.0.smithi138.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-14T11:35:24.379 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-14T11:35:24.379 INFO:tasks.workunit.client.0.smithi138.stderr:--- logging levels --- 2024-09-14T11:35:24.379 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 none 2024-09-14T11:35:24.379 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 1 lockdep 2024-09-14T11:35:24.379 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 1 context 2024-09-14T11:35:24.379 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 1 crush 2024-09-14T11:35:24.379 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 mds 2024-09-14T11:35:24.380 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 mds_balancer 2024-09-14T11:35:24.380 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 mds_locker 2024-09-14T11:35:24.380 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 mds_log 2024-09-14T11:35:24.380 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 mds_log_expire 2024-09-14T11:35:24.380 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 mds_migrator 2024-09-14T11:35:24.380 INFO:tasks.workunit.client.0.smithi138.stderr: 3/ 5 mds_quiesce 2024-09-14T11:35:24.380 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 1 buffer 2024-09-14T11:35:24.380 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 1 timer 2024-09-14T11:35:24.380 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 1 filer 2024-09-14T11:35:24.380 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 1 striper 2024-09-14T11:35:24.380 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 1 objecter 2024-09-14T11:35:24.380 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 rados 2024-09-14T11:35:24.380 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 rbd 2024-09-14T11:35:24.380 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 rbd_mirror 2024-09-14T11:35:24.380 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 rbd_replay 2024-09-14T11:35:24.381 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 rbd_pwl 2024-09-14T11:35:24.381 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 journaler 2024-09-14T11:35:24.381 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 objectcacher 2024-09-14T11:35:24.381 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 immutable_obj_cache 2024-09-14T11:35:24.381 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 client 2024-09-14T11:35:24.381 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 osd 2024-09-14T11:35:24.381 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 optracker 2024-09-14T11:35:24.381 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 objclass 2024-09-14T11:35:24.381 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 3 filestore 2024-09-14T11:35:24.381 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 3 journal 2024-09-14T11:35:24.381 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 0 ms 2024-09-14T11:35:24.381 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 mon 2024-09-14T11:35:24.381 INFO:tasks.workunit.client.0.smithi138.stderr: 0/10 monc 2024-09-14T11:35:24.381 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 paxos 2024-09-14T11:35:24.381 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 tp 2024-09-14T11:35:24.381 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 auth 2024-09-14T11:35:24.382 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 crypto 2024-09-14T11:35:24.382 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 1 finisher 2024-09-14T11:35:24.382 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 1 reserver 2024-09-14T11:35:24.382 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 heartbeatmap 2024-09-14T11:35:24.382 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 perfcounter 2024-09-14T11:35:24.382 INFO:tasks.workunit.client.0.smithi138.stderr: 20/20 rgw 2024-09-14T11:35:24.382 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 rgw_sync 2024-09-14T11:35:24.382 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 rgw_datacache 2024-09-14T11:35:24.382 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 rgw_access 2024-09-14T11:35:24.382 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 rgw_dbstore 2024-09-14T11:35:24.382 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 rgw_flight 2024-09-14T11:35:24.382 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 rgw_lifecycle 2024-09-14T11:35:24.383 INFO:tasks.workunit.client.0.smithi138.stderr: 20/20 rgw_notification 2024-09-14T11:35:24.383 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 javaclient 2024-09-14T11:35:24.383 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 asok 2024-09-14T11:35:24.383 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 1 throttle 2024-09-14T11:35:24.383 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 0 refs 2024-09-14T11:35:24.383 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 compressor 2024-09-14T11:35:24.383 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 bluestore 2024-09-14T11:35:24.383 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 bluefs 2024-09-14T11:35:24.383 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 3 bdev 2024-09-14T11:35:24.383 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 kstore 2024-09-14T11:35:24.383 INFO:tasks.workunit.client.0.smithi138.stderr: 4/ 5 rocksdb 2024-09-14T11:35:24.383 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 fuse 2024-09-14T11:35:24.383 INFO:tasks.workunit.client.0.smithi138.stderr: 2/ 5 mgr 2024-09-14T11:35:24.383 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 mgrc 2024-09-14T11:35:24.383 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 dpdk 2024-09-14T11:35:24.384 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 eventtrace 2024-09-14T11:35:24.384 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 prioritycache 2024-09-14T11:35:24.384 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 test 2024-09-14T11:35:24.384 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 cephfs_mirror 2024-09-14T11:35:24.384 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 cephsqlite 2024-09-14T11:35:24.384 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 crimson_interrupt 2024-09-14T11:35:24.384 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 seastore 2024-09-14T11:35:24.384 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 seastore_onode 2024-09-14T11:35:24.384 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 seastore_odata 2024-09-14T11:35:24.384 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 seastore_omap 2024-09-14T11:35:24.384 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 seastore_tm 2024-09-14T11:35:24.384 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 seastore_t 2024-09-14T11:35:24.384 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 seastore_cleaner 2024-09-14T11:35:24.384 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 seastore_epm 2024-09-14T11:35:24.384 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 seastore_lba 2024-09-14T11:35:24.385 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 seastore_fixedkv_tree 2024-09-14T11:35:24.385 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 seastore_cache 2024-09-14T11:35:24.385 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 seastore_journal 2024-09-14T11:35:24.385 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 seastore_device 2024-09-14T11:35:24.385 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 seastore_backref 2024-09-14T11:35:24.385 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 alienstore 2024-09-14T11:35:24.385 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 mclock 2024-09-14T11:35:24.385 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 cyanstore 2024-09-14T11:35:24.385 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 ceph_exporter 2024-09-14T11:35:24.385 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 memstore 2024-09-14T11:35:24.385 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 trace 2024-09-14T11:35:24.385 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 ceph_dedup 2024-09-14T11:35:24.385 INFO:tasks.workunit.client.0.smithi138.stderr: -2/-2 (syslog threshold) 2024-09-14T11:35:24.385 INFO:tasks.workunit.client.0.smithi138.stderr: 99/99 (stderr threshold) 2024-09-14T11:35:24.385 INFO:tasks.workunit.client.0.smithi138.stderr:--- pthread ID / name mapping for recent threads --- 2024-09-14T11:35:24.386 INFO:tasks.workunit.client.0.smithi138.stderr: 7fd49a7fc640 / http_manager 2024-09-14T11:35:24.386 INFO:tasks.workunit.client.0.smithi138.stderr: 7fd520fe1640 / http_manager 2024-09-14T11:35:24.386 INFO:tasks.workunit.client.0.smithi138.stderr: 7fd521fe3640 / rgw_dt_lg_renew 2024-09-14T11:35:24.386 INFO:tasks.workunit.client.0.smithi138.stderr: 7fd54d7fa640 / ms_dispatch 2024-09-14T11:35:24.386 INFO:tasks.workunit.client.0.smithi138.stderr: 7fd54effd640 / io_context_pool 2024-09-14T11:35:24.386 INFO:tasks.workunit.client.0.smithi138.stderr: 7fd555602640 / ms_dispatch 2024-09-14T11:35:24.386 INFO:tasks.workunit.client.0.smithi138.stderr: 7fd557e07640 / ms_dispatch 2024-09-14T11:35:24.386 INFO:tasks.workunit.client.0.smithi138.stderr: 7fd55960a640 / io_context_pool 2024-09-14T11:35:24.386 INFO:tasks.workunit.client.0.smithi138.stderr: 7fd66ae11640 / msgr-worker-2 2024-09-14T11:35:24.386 INFO:tasks.workunit.client.0.smithi138.stderr: 7fd66b612640 / msgr-worker-1 2024-09-14T11:35:24.386 INFO:tasks.workunit.client.0.smithi138.stderr: 7fd66be13640 / msgr-worker-0 2024-09-14T11:35:24.387 INFO:tasks.workunit.client.0.smithi138.stderr: 7fd66c614640 / io_context_pool 2024-09-14T11:35:24.387 INFO:tasks.workunit.client.0.smithi138.stderr: 7fd66db0c9c0 / radosgw-admin 2024-09-14T11:35:24.387 INFO:tasks.workunit.client.0.smithi138.stderr: max_recent 500 2024-09-14T11:35:24.387 INFO:tasks.workunit.client.0.smithi138.stderr: max_new 1000 2024-09-14T11:35:24.387 INFO:tasks.workunit.client.0.smithi138.stderr: log_file /var/log/ceph/ceph-client.admin.98493.log 2024-09-14T11:35:24.387 INFO:tasks.workunit.client.0.smithi138.stderr:--- end dump of recent events --- 2024-09-14T11:35:24.387 INFO:tasks.workunit.client.0.smithi138.stderr:--- begin dump of recent events --- 2024-09-14T11:35:24.387 INFO:tasks.workunit.client.0.smithi138.stderr: -499> 2024-09-14T11:35:23.787+0000 7fd66b612640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:35:24.387 INFO:tasks.workunit.client.0.smithi138.stderr: -498> 2024-09-14T11:35:23.787+0000 7fd66be13640 10 monclient(hunting): get_auth_request con 0x55ef2e4e3440 auth_method 0 2024-09-14T11:35:24.387 INFO:tasks.workunit.client.0.smithi138.stderr: -497> 2024-09-14T11:35:23.787+0000 7fd66be13640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:35:24.387 INFO:tasks.workunit.client.0.smithi138.stderr: -496> 2024-09-14T11:35:23.787+0000 7fd66be13640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:35:24.387 INFO:tasks.workunit.client.0.smithi138.stderr: -495> 2024-09-14T11:35:23.787+0000 7fd66be13640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:35:24.387 INFO:tasks.workunit.client.0.smithi138.stderr: -494> 2024-09-14T11:35:23.787+0000 7fd66ae11640 10 monclient(hunting): handle_auth_done global_id 6789 payload 274 2024-09-14T11:35:24.387 INFO:tasks.workunit.client.0.smithi138.stderr: -493> 2024-09-14T11:35:23.787+0000 7fd66ae11640 10 monclient: _finish_hunting 0 2024-09-14T11:35:24.387 INFO:tasks.workunit.client.0.smithi138.stderr: -492> 2024-09-14T11:35:23.787+0000 7fd66ae11640 1 monclient: found mon.noname-a 2024-09-14T11:35:24.387 INFO:tasks.workunit.client.0.smithi138.stderr: -491> 2024-09-14T11:35:23.787+0000 7fd66ae11640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.138:3300/0 2024-09-14T11:35:24.388 INFO:tasks.workunit.client.0.smithi138.stderr: -490> 2024-09-14T11:35:23.787+0000 7fd55960a640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:35:24.388 INFO:tasks.workunit.client.0.smithi138.stderr: -489> 2024-09-14T11:35:23.787+0000 7fd55960a640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-14T11:35:24.388 INFO:tasks.workunit.client.0.smithi138.stderr: -488> 2024-09-14T11:35:23.787+0000 7fd55960a640 10 monclient: dump: 2024-09-14T11:35:24.388 INFO:tasks.workunit.client.0.smithi138.stderr:epoch 1 2024-09-14T11:35:24.388 INFO:tasks.workunit.client.0.smithi138.stderr:fsid 3f225f43-83a6-4aeb-b798-1f04bb49d597 2024-09-14T11:35:24.388 INFO:tasks.workunit.client.0.smithi138.stderr:last_changed 2024-09-14T11:07:09.252780+0000 2024-09-14T11:35:24.388 INFO:tasks.workunit.client.0.smithi138.stderr:created 2024-09-14T11:07:09.252780+0000 2024-09-14T11:35:24.388 INFO:tasks.workunit.client.0.smithi138.stderr:min_mon_release 19 (squid) 2024-09-14T11:35:24.388 INFO:tasks.workunit.client.0.smithi138.stderr:election_strategy: 1 2024-09-14T11:35:24.388 INFO:tasks.workunit.client.0.smithi138.stderr:0: [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] mon.a 2024-09-14T11:35:24.388 INFO:tasks.workunit.client.0.smithi138.stderr:1: [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] mon.b 2024-09-14T11:35:24.388 INFO:tasks.workunit.client.0.smithi138.stderr:2: [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] mon.c 2024-09-14T11:35:24.388 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-14T11:35:24.388 INFO:tasks.workunit.client.0.smithi138.stderr: -487> 2024-09-14T11:35:23.787+0000 7fd55960a640 10 monclient: _finish_auth 0 2024-09-14T11:35:24.388 INFO:tasks.workunit.client.0.smithi138.stderr: -486> 2024-09-14T11:35:23.787+0000 7fd55960a640 10 monclient: _check_auth_tickets 2024-09-14T11:35:24.389 INFO:tasks.workunit.client.0.smithi138.stderr: -485> 2024-09-14T11:35:23.787+0000 7fd55960a640 10 monclient: handle_config config(0 keys) 2024-09-14T11:35:24.389 INFO:tasks.workunit.client.0.smithi138.stderr: -484> 2024-09-14T11:35:23.787+0000 7fd55960a640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:35:24.389 INFO:tasks.workunit.client.0.smithi138.stderr: -483> 2024-09-14T11:35:23.787+0000 7fd55960a640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-14T11:35:24.389 INFO:tasks.workunit.client.0.smithi138.stderr: -482> 2024-09-14T11:35:23.787+0000 7fd55960a640 10 monclient: dump: 2024-09-14T11:35:24.389 INFO:tasks.workunit.client.0.smithi138.stderr:epoch 1 2024-09-14T11:35:24.389 INFO:tasks.workunit.client.0.smithi138.stderr:fsid 3f225f43-83a6-4aeb-b798-1f04bb49d597 2024-09-14T11:35:24.389 INFO:tasks.workunit.client.0.smithi138.stderr:last_changed 2024-09-14T11:07:09.252780+0000 2024-09-14T11:35:24.389 INFO:tasks.workunit.client.0.smithi138.stderr:created 2024-09-14T11:07:09.252780+0000 2024-09-14T11:35:24.389 INFO:tasks.workunit.client.0.smithi138.stderr:min_mon_release 19 (squid) 2024-09-14T11:35:24.389 INFO:tasks.workunit.client.0.smithi138.stderr:election_strategy: 1 2024-09-14T11:35:24.389 INFO:tasks.workunit.client.0.smithi138.stderr:0: [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] mon.a 2024-09-14T11:35:24.389 INFO:tasks.workunit.client.0.smithi138.stderr:1: [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] mon.b 2024-09-14T11:35:24.389 INFO:tasks.workunit.client.0.smithi138.stderr:2: [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] mon.c 2024-09-14T11:35:24.389 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-14T11:35:24.389 INFO:tasks.workunit.client.0.smithi138.stderr: -481> 2024-09-14T11:35:23.787+0000 7fd66db0c9c0 5 monclient: authenticate success, global_id 6789 2024-09-14T11:35:24.390 INFO:tasks.workunit.client.0.smithi138.stderr: -480> 2024-09-14T11:35:23.787+0000 7fd66db0c9c0 10 monclient: get_monmap_and_config success 2024-09-14T11:35:24.390 INFO:tasks.workunit.client.0.smithi138.stderr: -479> 2024-09-14T11:35:23.787+0000 7fd66db0c9c0 4 set_mon_vals no callback set 2024-09-14T11:35:24.390 INFO:tasks.workunit.client.0.smithi138.stderr: -478> 2024-09-14T11:35:23.791+0000 7fd66db0c9c0 10 monclient: shutdown 2024-09-14T11:35:24.390 INFO:tasks.workunit.client.0.smithi138.stderr: -477> 2024-09-14T11:35:23.791+0000 7fd66db0c9c0 5 asok(0x55ef2e38dd90) unregister_commands rotate-key 2024-09-14T11:35:24.390 INFO:tasks.workunit.client.0.smithi138.stderr: -476> 2024-09-14T11:35:23.791+0000 7fd66db0c9c0 10 monclient: build_initial_monmap 2024-09-14T11:35:24.390 INFO:tasks.workunit.client.0.smithi138.stderr: -475> 2024-09-14T11:35:23.791+0000 7fd66db0c9c0 1 build_initial for_mkfs: 0 2024-09-14T11:35:24.390 INFO:tasks.workunit.client.0.smithi138.stderr: -474> 2024-09-14T11:35:23.791+0000 7fd66db0c9c0 10 monclient: monmap: 2024-09-14T11:35:24.390 INFO:tasks.workunit.client.0.smithi138.stderr:epoch 0 2024-09-14T11:35:24.390 INFO:tasks.workunit.client.0.smithi138.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-14T11:35:24.390 INFO:tasks.workunit.client.0.smithi138.stderr:last_changed 0.000000 2024-09-14T11:35:24.390 INFO:tasks.workunit.client.0.smithi138.stderr:created 0.000000 2024-09-14T11:35:24.390 INFO:tasks.workunit.client.0.smithi138.stderr:min_mon_release 0 (unknown) 2024-09-14T11:35:24.390 INFO:tasks.workunit.client.0.smithi138.stderr:election_strategy: 1 2024-09-14T11:35:24.390 INFO:tasks.workunit.client.0.smithi138.stderr:0: [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] mon.noname-a 2024-09-14T11:35:24.390 INFO:tasks.workunit.client.0.smithi138.stderr:1: [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] mon.noname-b 2024-09-14T11:35:24.391 INFO:tasks.workunit.client.0.smithi138.stderr:2: [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] mon.noname-c 2024-09-14T11:35:24.391 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-14T11:35:24.391 INFO:tasks.workunit.client.0.smithi138.stderr: -473> 2024-09-14T11:35:23.791+0000 7fd66db0c9c0 5 AuthRegistry(0x55ef2e5c9980) adding auth protocol: cephx 2024-09-14T11:35:24.391 INFO:tasks.workunit.client.0.smithi138.stderr: -472> 2024-09-14T11:35:23.791+0000 7fd66db0c9c0 5 AuthRegistry(0x55ef2e5c9980) adding auth protocol: cephx 2024-09-14T11:35:24.391 INFO:tasks.workunit.client.0.smithi138.stderr: -471> 2024-09-14T11:35:23.791+0000 7fd66db0c9c0 5 AuthRegistry(0x55ef2e5c9980) adding auth protocol: cephx 2024-09-14T11:35:24.391 INFO:tasks.workunit.client.0.smithi138.stderr: -470> 2024-09-14T11:35:23.791+0000 7fd66db0c9c0 5 AuthRegistry(0x55ef2e5c9980) adding con mode: secure 2024-09-14T11:35:24.391 INFO:tasks.workunit.client.0.smithi138.stderr: -469> 2024-09-14T11:35:23.791+0000 7fd66db0c9c0 5 AuthRegistry(0x55ef2e5c9980) adding con mode: crc 2024-09-14T11:35:24.391 INFO:tasks.workunit.client.0.smithi138.stderr: -468> 2024-09-14T11:35:23.791+0000 7fd66db0c9c0 5 AuthRegistry(0x55ef2e5c9980) adding con mode: secure 2024-09-14T11:35:24.391 INFO:tasks.workunit.client.0.smithi138.stderr: -467> 2024-09-14T11:35:23.791+0000 7fd66db0c9c0 5 AuthRegistry(0x55ef2e5c9980) adding con mode: crc 2024-09-14T11:35:24.391 INFO:tasks.workunit.client.0.smithi138.stderr: -466> 2024-09-14T11:35:23.791+0000 7fd66db0c9c0 5 AuthRegistry(0x55ef2e5c9980) adding con mode: secure 2024-09-14T11:35:24.391 INFO:tasks.workunit.client.0.smithi138.stderr: -465> 2024-09-14T11:35:23.791+0000 7fd66db0c9c0 5 AuthRegistry(0x55ef2e5c9980) adding con mode: crc 2024-09-14T11:35:24.391 INFO:tasks.workunit.client.0.smithi138.stderr: -464> 2024-09-14T11:35:23.791+0000 7fd66db0c9c0 5 AuthRegistry(0x55ef2e5c9980) adding con mode: crc 2024-09-14T11:35:24.391 INFO:tasks.workunit.client.0.smithi138.stderr: -463> 2024-09-14T11:35:23.791+0000 7fd66db0c9c0 5 AuthRegistry(0x55ef2e5c9980) adding con mode: secure 2024-09-14T11:35:24.391 INFO:tasks.workunit.client.0.smithi138.stderr: -462> 2024-09-14T11:35:23.791+0000 7fd66db0c9c0 5 AuthRegistry(0x55ef2e5c9980) adding con mode: crc 2024-09-14T11:35:24.391 INFO:tasks.workunit.client.0.smithi138.stderr: -461> 2024-09-14T11:35:23.791+0000 7fd66db0c9c0 5 AuthRegistry(0x55ef2e5c9980) adding con mode: secure 2024-09-14T11:35:24.392 INFO:tasks.workunit.client.0.smithi138.stderr: -460> 2024-09-14T11:35:23.791+0000 7fd66db0c9c0 5 AuthRegistry(0x55ef2e5c9980) adding con mode: crc 2024-09-14T11:35:24.392 INFO:tasks.workunit.client.0.smithi138.stderr: -459> 2024-09-14T11:35:23.791+0000 7fd66db0c9c0 5 AuthRegistry(0x55ef2e5c9980) adding con mode: secure 2024-09-14T11:35:24.392 INFO:tasks.workunit.client.0.smithi138.stderr: -458> 2024-09-14T11:35:23.791+0000 7fd66db0c9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:35:24.392 INFO:tasks.workunit.client.0.smithi138.stderr: -457> 2024-09-14T11:35:23.791+0000 7fd66db0c9c0 1 librados: starting msgr at 2024-09-14T11:35:24.392 INFO:tasks.workunit.client.0.smithi138.stderr: -456> 2024-09-14T11:35:23.791+0000 7fd66db0c9c0 1 librados: starting objecter 2024-09-14T11:35:24.392 INFO:tasks.workunit.client.0.smithi138.stderr: -455> 2024-09-14T11:35:23.791+0000 7fd66db0c9c0 5 asok(0x55ef2e38dd90) register_command objecter_requests hook 0x55ef2e59be70 2024-09-14T11:35:24.392 INFO:tasks.workunit.client.0.smithi138.stderr: -454> 2024-09-14T11:35:23.791+0000 7fd66db0c9c0 1 librados: setting wanted keys 2024-09-14T11:35:24.392 INFO:tasks.workunit.client.0.smithi138.stderr: -453> 2024-09-14T11:35:23.791+0000 7fd66db0c9c0 1 librados: calling monclient init 2024-09-14T11:35:24.392 INFO:tasks.workunit.client.0.smithi138.stderr: -452> 2024-09-14T11:35:23.791+0000 7fd66db0c9c0 10 monclient: init 2024-09-14T11:35:24.392 INFO:tasks.workunit.client.0.smithi138.stderr: -451> 2024-09-14T11:35:23.791+0000 7fd66db0c9c0 5 AuthRegistry(0x55ef2e598fa0) adding auth protocol: cephx 2024-09-14T11:35:24.392 INFO:tasks.workunit.client.0.smithi138.stderr: -450> 2024-09-14T11:35:23.791+0000 7fd66db0c9c0 5 AuthRegistry(0x55ef2e598fa0) adding auth protocol: cephx 2024-09-14T11:35:24.392 INFO:tasks.workunit.client.0.smithi138.stderr: -449> 2024-09-14T11:35:23.791+0000 7fd66db0c9c0 5 AuthRegistry(0x55ef2e598fa0) adding auth protocol: cephx 2024-09-14T11:35:24.392 INFO:tasks.workunit.client.0.smithi138.stderr: -448> 2024-09-14T11:35:23.791+0000 7fd66db0c9c0 5 AuthRegistry(0x55ef2e598fa0) adding con mode: secure 2024-09-14T11:35:24.392 INFO:tasks.workunit.client.0.smithi138.stderr: -447> 2024-09-14T11:35:23.791+0000 7fd66db0c9c0 5 AuthRegistry(0x55ef2e598fa0) adding con mode: crc 2024-09-14T11:35:24.393 INFO:tasks.workunit.client.0.smithi138.stderr: -446> 2024-09-14T11:35:23.791+0000 7fd66db0c9c0 5 AuthRegistry(0x55ef2e598fa0) adding con mode: secure 2024-09-14T11:35:24.393 INFO:tasks.workunit.client.0.smithi138.stderr: -445> 2024-09-14T11:35:23.791+0000 7fd66db0c9c0 5 AuthRegistry(0x55ef2e598fa0) adding con mode: crc 2024-09-14T11:35:24.393 INFO:tasks.workunit.client.0.smithi138.stderr: -444> 2024-09-14T11:35:23.791+0000 7fd66db0c9c0 5 AuthRegistry(0x55ef2e598fa0) adding con mode: secure 2024-09-14T11:35:24.393 INFO:tasks.workunit.client.0.smithi138.stderr: -443> 2024-09-14T11:35:23.791+0000 7fd66db0c9c0 5 AuthRegistry(0x55ef2e598fa0) adding con mode: crc 2024-09-14T11:35:24.393 INFO:tasks.workunit.client.0.smithi138.stderr: -442> 2024-09-14T11:35:23.791+0000 7fd66db0c9c0 5 AuthRegistry(0x55ef2e598fa0) adding con mode: crc 2024-09-14T11:35:24.393 INFO:tasks.workunit.client.0.smithi138.stderr: -441> 2024-09-14T11:35:23.791+0000 7fd66db0c9c0 5 AuthRegistry(0x55ef2e598fa0) adding con mode: secure 2024-09-14T11:35:24.393 INFO:tasks.workunit.client.0.smithi138.stderr: -440> 2024-09-14T11:35:23.791+0000 7fd66db0c9c0 5 AuthRegistry(0x55ef2e598fa0) adding con mode: crc 2024-09-14T11:35:24.393 INFO:tasks.workunit.client.0.smithi138.stderr: -439> 2024-09-14T11:35:23.791+0000 7fd66db0c9c0 5 AuthRegistry(0x55ef2e598fa0) adding con mode: secure 2024-09-14T11:35:24.393 INFO:tasks.workunit.client.0.smithi138.stderr: -438> 2024-09-14T11:35:23.791+0000 7fd66db0c9c0 5 AuthRegistry(0x55ef2e598fa0) adding con mode: crc 2024-09-14T11:35:24.393 INFO:tasks.workunit.client.0.smithi138.stderr: -437> 2024-09-14T11:35:23.791+0000 7fd66db0c9c0 5 AuthRegistry(0x55ef2e598fa0) adding con mode: secure 2024-09-14T11:35:24.393 INFO:tasks.workunit.client.0.smithi138.stderr: -436> 2024-09-14T11:35:23.791+0000 7fd66db0c9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:35:24.393 INFO:tasks.workunit.client.0.smithi138.stderr: -435> 2024-09-14T11:35:23.791+0000 7fd66db0c9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:35:24.393 INFO:tasks.workunit.client.0.smithi138.stderr: -434> 2024-09-14T11:35:23.791+0000 7fd66db0c9c0 5 asok(0x55ef2e38dd90) register_command rotate-key hook 0x55ef2e5990e8 2024-09-14T11:35:24.393 INFO:tasks.workunit.client.0.smithi138.stderr: -433> 2024-09-14T11:35:23.791+0000 7fd66db0c9c0 10 monclient: _reopen_session rank -1 2024-09-14T11:35:24.393 INFO:tasks.workunit.client.0.smithi138.stderr: -432> 2024-09-14T11:35:23.791+0000 7fd66db0c9c0 10 monclient: _add_conns ranks=[2,1,0] 2024-09-14T11:35:24.394 INFO:tasks.workunit.client.0.smithi138.stderr: -431> 2024-09-14T11:35:23.791+0000 7fd66db0c9c0 10 monclient(hunting): picked mon.noname-c con 0x55ef2e426740 addr [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] 2024-09-14T11:35:24.394 INFO:tasks.workunit.client.0.smithi138.stderr: -430> 2024-09-14T11:35:23.791+0000 7fd66db0c9c0 10 monclient(hunting): picked mon.noname-b con 0x55ef2e4e2af0 addr [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] 2024-09-14T11:35:24.394 INFO:tasks.workunit.client.0.smithi138.stderr: -429> 2024-09-14T11:35:23.791+0000 7fd66db0c9c0 10 monclient(hunting): picked mon.noname-a con 0x55ef2e4e3440 addr [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] 2024-09-14T11:35:24.394 INFO:tasks.workunit.client.0.smithi138.stderr: -428> 2024-09-14T11:35:23.791+0000 7fd66db0c9c0 10 monclient(hunting): start opening mon connection 2024-09-14T11:35:24.394 INFO:tasks.workunit.client.0.smithi138.stderr: -427> 2024-09-14T11:35:23.791+0000 7fd66db0c9c0 10 monclient(hunting): start opening mon connection 2024-09-14T11:35:24.394 INFO:tasks.workunit.client.0.smithi138.stderr: -426> 2024-09-14T11:35:23.791+0000 7fd66db0c9c0 10 monclient(hunting): start opening mon connection 2024-09-14T11:35:24.394 INFO:tasks.workunit.client.0.smithi138.stderr: -425> 2024-09-14T11:35:23.791+0000 7fd66db0c9c0 10 monclient(hunting): _renew_subs 2024-09-14T11:35:24.394 INFO:tasks.workunit.client.0.smithi138.stderr: -424> 2024-09-14T11:35:23.791+0000 7fd66db0c9c0 10 monclient(hunting): authenticate will time out at 2659.753875s 2024-09-14T11:35:24.394 INFO:tasks.workunit.client.0.smithi138.stderr: -423> 2024-09-14T11:35:23.791+0000 7fd66b612640 10 monclient(hunting): get_auth_request con 0x55ef2e426740 auth_method 0 2024-09-14T11:35:24.394 INFO:tasks.workunit.client.0.smithi138.stderr: -422> 2024-09-14T11:35:23.791+0000 7fd66b612640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:35:24.394 INFO:tasks.workunit.client.0.smithi138.stderr: -421> 2024-09-14T11:35:23.791+0000 7fd66b612640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:35:24.394 INFO:tasks.workunit.client.0.smithi138.stderr: -420> 2024-09-14T11:35:23.791+0000 7fd66b612640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:35:24.394 INFO:tasks.workunit.client.0.smithi138.stderr: -419> 2024-09-14T11:35:23.791+0000 7fd66be13640 10 monclient(hunting): get_auth_request con 0x55ef2e4e3440 auth_method 0 2024-09-14T11:35:24.394 INFO:tasks.workunit.client.0.smithi138.stderr: -418> 2024-09-14T11:35:23.791+0000 7fd66be13640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:35:24.394 INFO:tasks.workunit.client.0.smithi138.stderr: -417> 2024-09-14T11:35:23.791+0000 7fd66be13640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:35:24.395 INFO:tasks.workunit.client.0.smithi138.stderr: -416> 2024-09-14T11:35:23.791+0000 7fd66be13640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:35:24.395 INFO:tasks.workunit.client.0.smithi138.stderr: -415> 2024-09-14T11:35:23.791+0000 7fd66b612640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:35:24.395 INFO:tasks.workunit.client.0.smithi138.stderr: -414> 2024-09-14T11:35:23.791+0000 7fd66b612640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:35:24.395 INFO:tasks.workunit.client.0.smithi138.stderr: -413> 2024-09-14T11:35:23.791+0000 7fd66b612640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:35:24.395 INFO:tasks.workunit.client.0.smithi138.stderr: -412> 2024-09-14T11:35:23.791+0000 7fd66be13640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:35:24.395 INFO:tasks.workunit.client.0.smithi138.stderr: -411> 2024-09-14T11:35:23.791+0000 7fd66be13640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:35:24.395 INFO:tasks.workunit.client.0.smithi138.stderr: -410> 2024-09-14T11:35:23.791+0000 7fd66be13640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:35:24.395 INFO:tasks.workunit.client.0.smithi138.stderr: -409> 2024-09-14T11:35:23.791+0000 7fd66b612640 10 monclient(hunting): handle_auth_done global_id 6356 payload 824 2024-09-14T11:35:24.395 INFO:tasks.workunit.client.0.smithi138.stderr: -408> 2024-09-14T11:35:23.791+0000 7fd66b612640 10 monclient: _finish_hunting 0 2024-09-14T11:35:24.395 INFO:tasks.workunit.client.0.smithi138.stderr: -407> 2024-09-14T11:35:23.791+0000 7fd66b612640 1 monclient: found mon.noname-c 2024-09-14T11:35:24.395 INFO:tasks.workunit.client.0.smithi138.stderr: -406> 2024-09-14T11:35:23.791+0000 7fd66b612640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.138:3301/0 2024-09-14T11:35:24.395 INFO:tasks.workunit.client.0.smithi138.stderr: -405> 2024-09-14T11:35:23.791+0000 7fd557e07640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:35:24.395 INFO:tasks.workunit.client.0.smithi138.stderr: -404> 2024-09-14T11:35:23.791+0000 7fd557e07640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-14T11:35:24.396 INFO:tasks.workunit.client.0.smithi138.stderr: -403> 2024-09-14T11:35:23.791+0000 7fd557e07640 10 monclient: dump: 2024-09-14T11:35:24.396 INFO:tasks.workunit.client.0.smithi138.stderr:epoch 1 2024-09-14T11:35:24.396 INFO:tasks.workunit.client.0.smithi138.stderr:fsid 3f225f43-83a6-4aeb-b798-1f04bb49d597 2024-09-14T11:35:24.396 INFO:tasks.workunit.client.0.smithi138.stderr:last_changed 2024-09-14T11:07:09.252780+0000 2024-09-14T11:35:24.396 INFO:tasks.workunit.client.0.smithi138.stderr:created 2024-09-14T11:07:09.252780+0000 2024-09-14T11:35:24.396 INFO:tasks.workunit.client.0.smithi138.stderr:min_mon_release 19 (squid) 2024-09-14T11:35:24.396 INFO:tasks.workunit.client.0.smithi138.stderr:election_strategy: 1 2024-09-14T11:35:24.396 INFO:tasks.workunit.client.0.smithi138.stderr:0: [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] mon.a 2024-09-14T11:35:24.396 INFO:tasks.workunit.client.0.smithi138.stderr:1: [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] mon.b 2024-09-14T11:35:24.396 INFO:tasks.workunit.client.0.smithi138.stderr:2: [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] mon.c 2024-09-14T11:35:24.396 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-14T11:35:24.396 INFO:tasks.workunit.client.0.smithi138.stderr: -402> 2024-09-14T11:35:23.791+0000 7fd557e07640 10 monclient: _finish_auth 0 2024-09-14T11:35:24.396 INFO:tasks.workunit.client.0.smithi138.stderr: -401> 2024-09-14T11:35:23.791+0000 7fd557e07640 10 monclient: _check_auth_tickets 2024-09-14T11:35:24.397 INFO:tasks.workunit.client.0.smithi138.stderr: -400> 2024-09-14T11:35:23.791+0000 7fd66db0c9c0 5 monclient: authenticate success, global_id 6356 2024-09-14T11:35:24.397 INFO:tasks.workunit.client.0.smithi138.stderr: -399> 2024-09-14T11:35:23.791+0000 7fd66db0c9c0 10 monclient: _renew_subs 2024-09-14T11:35:24.397 INFO:tasks.workunit.client.0.smithi138.stderr: -398> 2024-09-14T11:35:23.791+0000 7fd66db0c9c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.138:3301/0 2024-09-14T11:35:24.397 INFO:tasks.workunit.client.0.smithi138.stderr: -397> 2024-09-14T11:35:23.791+0000 7fd557e07640 10 monclient: handle_config config(0 keys) 2024-09-14T11:35:24.397 INFO:tasks.workunit.client.0.smithi138.stderr: -396> 2024-09-14T11:35:23.791+0000 7fd557e07640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:35:24.397 INFO:tasks.workunit.client.0.smithi138.stderr: -395> 2024-09-14T11:35:23.791+0000 7fd557e07640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-14T11:35:24.397 INFO:tasks.workunit.client.0.smithi138.stderr: -394> 2024-09-14T11:35:23.791+0000 7fd557e07640 10 monclient: dump: 2024-09-14T11:35:24.397 INFO:tasks.workunit.client.0.smithi138.stderr:epoch 1 2024-09-14T11:35:24.397 INFO:tasks.workunit.client.0.smithi138.stderr:fsid 3f225f43-83a6-4aeb-b798-1f04bb49d597 2024-09-14T11:35:24.397 INFO:tasks.workunit.client.0.smithi138.stderr:last_changed 2024-09-14T11:07:09.252780+0000 2024-09-14T11:35:24.397 INFO:tasks.workunit.client.0.smithi138.stderr:created 2024-09-14T11:07:09.252780+0000 2024-09-14T11:35:24.397 INFO:tasks.workunit.client.0.smithi138.stderr:min_mon_release 19 (squid) 2024-09-14T11:35:24.397 INFO:tasks.workunit.client.0.smithi138.stderr:election_strategy: 1 2024-09-14T11:35:24.397 INFO:tasks.workunit.client.0.smithi138.stderr:0: [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] mon.a 2024-09-14T11:35:24.397 INFO:tasks.workunit.client.0.smithi138.stderr:1: [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] mon.b 2024-09-14T11:35:24.398 INFO:tasks.workunit.client.0.smithi138.stderr:2: [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] mon.c 2024-09-14T11:35:24.398 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-14T11:35:24.398 INFO:tasks.workunit.client.0.smithi138.stderr: -393> 2024-09-14T11:35:23.791+0000 7fd55960a640 4 set_mon_vals no callback set 2024-09-14T11:35:24.398 INFO:tasks.workunit.client.0.smithi138.stderr: -392> 2024-09-14T11:35:23.791+0000 7fd66db0c9c0 10 monclient: _renew_subs 2024-09-14T11:35:24.398 INFO:tasks.workunit.client.0.smithi138.stderr: -391> 2024-09-14T11:35:23.791+0000 7fd66db0c9c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.138:3301/0 2024-09-14T11:35:24.398 INFO:tasks.workunit.client.0.smithi138.stderr: -390> 2024-09-14T11:35:23.791+0000 7fd66db0c9c0 1 librados: init done 2024-09-14T11:35:24.398 INFO:tasks.workunit.client.0.smithi138.stderr: -389> 2024-09-14T11:35:23.795+0000 7fd557e07640 4 mgrc handle_mgr_map Got map version 5 2024-09-14T11:35:24.398 INFO:tasks.workunit.client.0.smithi138.stderr: -388> 2024-09-14T11:35:23.795+0000 7fd557e07640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.138:6832/3778043143,v1:172.21.15.138:6833/3778043143] 2024-09-14T11:35:24.398 INFO:tasks.workunit.client.0.smithi138.stderr: -387> 2024-09-14T11:35:23.795+0000 7fd557e07640 4 mgrc reconnect Starting new session with [v2:172.21.15.138:6832/3778043143,v1:172.21.15.138:6833/3778043143] 2024-09-14T11:35:24.398 INFO:tasks.workunit.client.0.smithi138.stderr: -386> 2024-09-14T11:35:23.795+0000 7fd66ae11640 10 monclient: get_auth_request con 0x7fd5500718a0 auth_method 0 2024-09-14T11:35:24.398 INFO:tasks.workunit.client.0.smithi138.stderr: -385> 2024-09-14T11:35:23.795+0000 7fd66be13640 10 monclient: get_auth_request con 0x55ef2e5c3700 auth_method 0 2024-09-14T11:35:24.398 INFO:tasks.workunit.client.0.smithi138.stderr: -384> 2024-09-14T11:35:23.795+0000 7fd66b612640 10 monclient: get_auth_request con 0x55ef2e5e4010 auth_method 0 2024-09-14T11:35:24.398 INFO:tasks.workunit.client.0.smithi138.stderr: -383> 2024-09-14T11:35:23.795+0000 7fd66ae11640 10 monclient: get_auth_request con 0x55ef2e5e8200 auth_method 0 2024-09-14T11:35:24.398 INFO:tasks.workunit.client.0.smithi138.stderr: -382> 2024-09-14T11:35:23.799+0000 7fd66be13640 10 monclient: get_auth_request con 0x55ef2e5e7840 auth_method 0 2024-09-14T11:35:24.399 INFO:tasks.workunit.client.0.smithi138.stderr: -381> 2024-09-14T11:35:23.799+0000 7fd66db0c9c0 10 monclient: build_initial_monmap 2024-09-14T11:35:24.399 INFO:tasks.workunit.client.0.smithi138.stderr: -380> 2024-09-14T11:35:23.799+0000 7fd66db0c9c0 1 build_initial for_mkfs: 0 2024-09-14T11:35:24.399 INFO:tasks.workunit.client.0.smithi138.stderr: -379> 2024-09-14T11:35:23.799+0000 7fd66db0c9c0 10 monclient: monmap: 2024-09-14T11:35:24.399 INFO:tasks.workunit.client.0.smithi138.stderr:epoch 0 2024-09-14T11:35:24.399 INFO:tasks.workunit.client.0.smithi138.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-14T11:35:24.399 INFO:tasks.workunit.client.0.smithi138.stderr:last_changed 0.000000 2024-09-14T11:35:24.399 INFO:tasks.workunit.client.0.smithi138.stderr:created 0.000000 2024-09-14T11:35:24.399 INFO:tasks.workunit.client.0.smithi138.stderr:min_mon_release 0 (unknown) 2024-09-14T11:35:24.399 INFO:tasks.workunit.client.0.smithi138.stderr:election_strategy: 1 2024-09-14T11:35:24.399 INFO:tasks.workunit.client.0.smithi138.stderr:0: [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] mon.noname-a 2024-09-14T11:35:24.400 INFO:tasks.workunit.client.0.smithi138.stderr:1: [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] mon.noname-b 2024-09-14T11:35:24.400 INFO:tasks.workunit.client.0.smithi138.stderr:2: [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] mon.noname-c 2024-09-14T11:35:24.400 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-14T11:35:24.400 INFO:tasks.workunit.client.0.smithi138.stderr: -378> 2024-09-14T11:35:23.799+0000 7fd66db0c9c0 5 AuthRegistry(0x55ef2e5f0270) adding auth protocol: cephx 2024-09-14T11:35:24.400 INFO:tasks.workunit.client.0.smithi138.stderr: -377> 2024-09-14T11:35:23.799+0000 7fd66db0c9c0 5 AuthRegistry(0x55ef2e5f0270) adding auth protocol: cephx 2024-09-14T11:35:24.401 INFO:tasks.workunit.client.0.smithi138.stderr: -376> 2024-09-14T11:35:23.799+0000 7fd66db0c9c0 5 AuthRegistry(0x55ef2e5f0270) adding auth protocol: cephx 2024-09-14T11:35:24.401 INFO:tasks.workunit.client.0.smithi138.stderr: -375> 2024-09-14T11:35:23.799+0000 7fd66db0c9c0 5 AuthRegistry(0x55ef2e5f0270) adding con mode: secure 2024-09-14T11:35:24.401 INFO:tasks.workunit.client.0.smithi138.stderr: -374> 2024-09-14T11:35:23.799+0000 7fd66db0c9c0 5 AuthRegistry(0x55ef2e5f0270) adding con mode: crc 2024-09-14T11:35:24.401 INFO:tasks.workunit.client.0.smithi138.stderr: -373> 2024-09-14T11:35:23.799+0000 7fd66db0c9c0 5 AuthRegistry(0x55ef2e5f0270) adding con mode: secure 2024-09-14T11:35:24.401 INFO:tasks.workunit.client.0.smithi138.stderr: -372> 2024-09-14T11:35:23.799+0000 7fd66db0c9c0 5 AuthRegistry(0x55ef2e5f0270) adding con mode: crc 2024-09-14T11:35:24.401 INFO:tasks.workunit.client.0.smithi138.stderr: -371> 2024-09-14T11:35:23.799+0000 7fd66db0c9c0 5 AuthRegistry(0x55ef2e5f0270) adding con mode: secure 2024-09-14T11:35:24.401 INFO:tasks.workunit.client.0.smithi138.stderr: -370> 2024-09-14T11:35:23.799+0000 7fd66db0c9c0 5 AuthRegistry(0x55ef2e5f0270) adding con mode: crc 2024-09-14T11:35:24.401 INFO:tasks.workunit.client.0.smithi138.stderr: -369> 2024-09-14T11:35:23.799+0000 7fd66db0c9c0 5 AuthRegistry(0x55ef2e5f0270) adding con mode: crc 2024-09-14T11:35:24.401 INFO:tasks.workunit.client.0.smithi138.stderr: -368> 2024-09-14T11:35:23.799+0000 7fd66db0c9c0 5 AuthRegistry(0x55ef2e5f0270) adding con mode: secure 2024-09-14T11:35:24.401 INFO:tasks.workunit.client.0.smithi138.stderr: -367> 2024-09-14T11:35:23.799+0000 7fd66db0c9c0 5 AuthRegistry(0x55ef2e5f0270) adding con mode: crc 2024-09-14T11:35:24.402 INFO:tasks.workunit.client.0.smithi138.stderr: -366> 2024-09-14T11:35:23.799+0000 7fd66db0c9c0 5 AuthRegistry(0x55ef2e5f0270) adding con mode: secure 2024-09-14T11:35:24.402 INFO:tasks.workunit.client.0.smithi138.stderr: -365> 2024-09-14T11:35:23.799+0000 7fd66db0c9c0 5 AuthRegistry(0x55ef2e5f0270) adding con mode: crc 2024-09-14T11:35:24.402 INFO:tasks.workunit.client.0.smithi138.stderr: -364> 2024-09-14T11:35:23.799+0000 7fd66db0c9c0 5 AuthRegistry(0x55ef2e5f0270) adding con mode: secure 2024-09-14T11:35:24.402 INFO:tasks.workunit.client.0.smithi138.stderr: -363> 2024-09-14T11:35:23.799+0000 7fd66db0c9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:35:24.402 INFO:tasks.workunit.client.0.smithi138.stderr: -362> 2024-09-14T11:35:23.799+0000 7fd66db0c9c0 5 asok(0x55ef2e38dd90) register_command objecter_requests cmddesc objecter_requests hook 0x55ef2e5f3c60 EEXIST 2024-09-14T11:35:24.402 INFO:tasks.workunit.client.0.smithi138.stderr: -361> 2024-09-14T11:35:23.799+0000 7fd66db0c9c0 10 monclient: init 2024-09-14T11:35:24.402 INFO:tasks.workunit.client.0.smithi138.stderr: -360> 2024-09-14T11:35:23.799+0000 7fd66db0c9c0 5 AuthRegistry(0x55ef2e5ef168) adding auth protocol: cephx 2024-09-14T11:35:24.402 INFO:tasks.workunit.client.0.smithi138.stderr: -359> 2024-09-14T11:35:23.799+0000 7fd66db0c9c0 5 AuthRegistry(0x55ef2e5ef168) adding auth protocol: cephx 2024-09-14T11:35:24.402 INFO:tasks.workunit.client.0.smithi138.stderr: -358> 2024-09-14T11:35:23.799+0000 7fd66db0c9c0 5 AuthRegistry(0x55ef2e5ef168) adding auth protocol: cephx 2024-09-14T11:35:24.402 INFO:tasks.workunit.client.0.smithi138.stderr: -357> 2024-09-14T11:35:23.799+0000 7fd66db0c9c0 5 AuthRegistry(0x55ef2e5ef168) adding con mode: secure 2024-09-14T11:35:24.402 INFO:tasks.workunit.client.0.smithi138.stderr: -356> 2024-09-14T11:35:23.799+0000 7fd66db0c9c0 5 AuthRegistry(0x55ef2e5ef168) adding con mode: crc 2024-09-14T11:35:24.402 INFO:tasks.workunit.client.0.smithi138.stderr: -355> 2024-09-14T11:35:23.799+0000 7fd66db0c9c0 5 AuthRegistry(0x55ef2e5ef168) adding con mode: secure 2024-09-14T11:35:24.402 INFO:tasks.workunit.client.0.smithi138.stderr: -354> 2024-09-14T11:35:23.799+0000 7fd66db0c9c0 5 AuthRegistry(0x55ef2e5ef168) adding con mode: crc 2024-09-14T11:35:24.403 INFO:tasks.workunit.client.0.smithi138.stderr: -353> 2024-09-14T11:35:23.799+0000 7fd66db0c9c0 5 AuthRegistry(0x55ef2e5ef168) adding con mode: secure 2024-09-14T11:35:24.403 INFO:tasks.workunit.client.0.smithi138.stderr: -352> 2024-09-14T11:35:23.799+0000 7fd66db0c9c0 5 AuthRegistry(0x55ef2e5ef168) adding con mode: crc 2024-09-14T11:35:24.403 INFO:tasks.workunit.client.0.smithi138.stderr: -351> 2024-09-14T11:35:23.799+0000 7fd66db0c9c0 5 AuthRegistry(0x55ef2e5ef168) adding con mode: crc 2024-09-14T11:35:24.403 INFO:tasks.workunit.client.0.smithi138.stderr: -350> 2024-09-14T11:35:23.799+0000 7fd66db0c9c0 5 AuthRegistry(0x55ef2e5ef168) adding con mode: secure 2024-09-14T11:35:24.403 INFO:tasks.workunit.client.0.smithi138.stderr: -349> 2024-09-14T11:35:23.799+0000 7fd66db0c9c0 5 AuthRegistry(0x55ef2e5ef168) adding con mode: crc 2024-09-14T11:35:24.403 INFO:tasks.workunit.client.0.smithi138.stderr: -348> 2024-09-14T11:35:23.799+0000 7fd66db0c9c0 5 AuthRegistry(0x55ef2e5ef168) adding con mode: secure 2024-09-14T11:35:24.403 INFO:tasks.workunit.client.0.smithi138.stderr: -347> 2024-09-14T11:35:23.799+0000 7fd66db0c9c0 5 AuthRegistry(0x55ef2e5ef168) adding con mode: crc 2024-09-14T11:35:24.403 INFO:tasks.workunit.client.0.smithi138.stderr: -346> 2024-09-14T11:35:23.799+0000 7fd66db0c9c0 5 AuthRegistry(0x55ef2e5ef168) adding con mode: secure 2024-09-14T11:35:24.403 INFO:tasks.workunit.client.0.smithi138.stderr: -345> 2024-09-14T11:35:23.799+0000 7fd66db0c9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:35:24.403 INFO:tasks.workunit.client.0.smithi138.stderr: -344> 2024-09-14T11:35:23.799+0000 7fd66db0c9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:35:24.403 INFO:tasks.workunit.client.0.smithi138.stderr: -343> 2024-09-14T11:35:23.799+0000 7fd66db0c9c0 5 asok(0x55ef2e38dd90) register_command rotate-key cmddesc rotate-key hook 0x55ef2e5ef2b0 EEXIST 2024-09-14T11:35:24.403 INFO:tasks.workunit.client.0.smithi138.stderr: -342> 2024-09-14T11:35:23.799+0000 7fd66db0c9c0 10 monclient: _reopen_session rank -1 2024-09-14T11:35:24.403 INFO:tasks.workunit.client.0.smithi138.stderr: -341> 2024-09-14T11:35:23.799+0000 7fd66db0c9c0 10 monclient: _add_conns ranks=[2,1,0] 2024-09-14T11:35:24.403 INFO:tasks.workunit.client.0.smithi138.stderr: -340> 2024-09-14T11:35:23.799+0000 7fd66db0c9c0 10 monclient(hunting): picked mon.noname-c con 0x55ef2e617e10 addr [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] 2024-09-14T11:35:24.403 INFO:tasks.workunit.client.0.smithi138.stderr: -339> 2024-09-14T11:35:23.799+0000 7fd66db0c9c0 10 monclient(hunting): picked mon.noname-b con 0x55ef2e617740 addr [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] 2024-09-14T11:35:24.404 INFO:tasks.workunit.client.0.smithi138.stderr: -338> 2024-09-14T11:35:23.799+0000 7fd66db0c9c0 10 monclient(hunting): picked mon.noname-a con 0x55ef2e616120 addr [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] 2024-09-14T11:35:24.404 INFO:tasks.workunit.client.0.smithi138.stderr: -337> 2024-09-14T11:35:23.799+0000 7fd66db0c9c0 10 monclient(hunting): start opening mon connection 2024-09-14T11:35:24.404 INFO:tasks.workunit.client.0.smithi138.stderr: -336> 2024-09-14T11:35:23.799+0000 7fd66db0c9c0 10 monclient(hunting): start opening mon connection 2024-09-14T11:35:24.404 INFO:tasks.workunit.client.0.smithi138.stderr: -335> 2024-09-14T11:35:23.799+0000 7fd66db0c9c0 10 monclient(hunting): start opening mon connection 2024-09-14T11:35:24.404 INFO:tasks.workunit.client.0.smithi138.stderr: -334> 2024-09-14T11:35:23.799+0000 7fd66db0c9c0 10 monclient(hunting): _renew_subs 2024-09-14T11:35:24.404 INFO:tasks.workunit.client.0.smithi138.stderr: -333> 2024-09-14T11:35:23.799+0000 7fd66db0c9c0 10 monclient(hunting): authenticate will time out at 2659.763985s 2024-09-14T11:35:24.404 INFO:tasks.workunit.client.0.smithi138.stderr: -332> 2024-09-14T11:35:23.803+0000 7fd66b612640 10 monclient(hunting): get_auth_request con 0x55ef2e616120 auth_method 0 2024-09-14T11:35:24.404 INFO:tasks.workunit.client.0.smithi138.stderr: -331> 2024-09-14T11:35:23.803+0000 7fd66b612640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:35:24.404 INFO:tasks.workunit.client.0.smithi138.stderr: -330> 2024-09-14T11:35:23.803+0000 7fd66b612640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:35:24.404 INFO:tasks.workunit.client.0.smithi138.stderr: -329> 2024-09-14T11:35:23.803+0000 7fd66b612640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:35:24.404 INFO:tasks.workunit.client.0.smithi138.stderr: -328> 2024-09-14T11:35:23.803+0000 7fd66ae11640 10 monclient(hunting): get_auth_request con 0x55ef2e617e10 auth_method 0 2024-09-14T11:35:24.404 INFO:tasks.workunit.client.0.smithi138.stderr: -327> 2024-09-14T11:35:23.803+0000 7fd66ae11640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:35:24.404 INFO:tasks.workunit.client.0.smithi138.stderr: -326> 2024-09-14T11:35:23.803+0000 7fd66ae11640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:35:24.405 INFO:tasks.workunit.client.0.smithi138.stderr: -325> 2024-09-14T11:35:23.803+0000 7fd66ae11640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:35:24.405 INFO:tasks.workunit.client.0.smithi138.stderr: -324> 2024-09-14T11:35:23.803+0000 7fd66b612640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:35:24.405 INFO:tasks.workunit.client.0.smithi138.stderr: -323> 2024-09-14T11:35:23.803+0000 7fd66b612640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:35:24.405 INFO:tasks.workunit.client.0.smithi138.stderr: -322> 2024-09-14T11:35:23.803+0000 7fd66b612640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:35:24.405 INFO:tasks.workunit.client.0.smithi138.stderr: -321> 2024-09-14T11:35:23.803+0000 7fd66ae11640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:35:24.405 INFO:tasks.workunit.client.0.smithi138.stderr: -320> 2024-09-14T11:35:23.803+0000 7fd66ae11640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:35:24.405 INFO:tasks.workunit.client.0.smithi138.stderr: -319> 2024-09-14T11:35:23.803+0000 7fd66ae11640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:35:24.405 INFO:tasks.workunit.client.0.smithi138.stderr: -318> 2024-09-14T11:35:23.803+0000 7fd66be13640 10 monclient(hunting): get_auth_request con 0x55ef2e617740 auth_method 0 2024-09-14T11:35:24.405 INFO:tasks.workunit.client.0.smithi138.stderr: -317> 2024-09-14T11:35:23.803+0000 7fd66be13640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:35:24.405 INFO:tasks.workunit.client.0.smithi138.stderr: -316> 2024-09-14T11:35:23.803+0000 7fd66be13640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:35:24.405 INFO:tasks.workunit.client.0.smithi138.stderr: -315> 2024-09-14T11:35:23.803+0000 7fd66be13640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:35:24.405 INFO:tasks.workunit.client.0.smithi138.stderr: -314> 2024-09-14T11:35:23.803+0000 7fd66b612640 10 monclient(hunting): handle_auth_done global_id 6795 payload 824 2024-09-14T11:35:24.406 INFO:tasks.workunit.client.0.smithi138.stderr: -313> 2024-09-14T11:35:23.803+0000 7fd66b612640 10 monclient: _finish_hunting 0 2024-09-14T11:35:24.406 INFO:tasks.workunit.client.0.smithi138.stderr: -312> 2024-09-14T11:35:23.803+0000 7fd66b612640 1 monclient: found mon.noname-a 2024-09-14T11:35:24.406 INFO:tasks.workunit.client.0.smithi138.stderr: -311> 2024-09-14T11:35:23.803+0000 7fd66b612640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.138:3300/0 2024-09-14T11:35:24.406 INFO:tasks.workunit.client.0.smithi138.stderr: -310> 2024-09-14T11:35:23.803+0000 7fd555602640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:35:24.406 INFO:tasks.workunit.client.0.smithi138.stderr: -309> 2024-09-14T11:35:23.803+0000 7fd555602640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-14T11:35:24.406 INFO:tasks.workunit.client.0.smithi138.stderr: -308> 2024-09-14T11:35:23.803+0000 7fd555602640 10 monclient: dump: 2024-09-14T11:35:24.406 INFO:tasks.workunit.client.0.smithi138.stderr:epoch 1 2024-09-14T11:35:24.406 INFO:tasks.workunit.client.0.smithi138.stderr:fsid 3f225f43-83a6-4aeb-b798-1f04bb49d597 2024-09-14T11:35:24.406 INFO:tasks.workunit.client.0.smithi138.stderr:last_changed 2024-09-14T11:07:09.252780+0000 2024-09-14T11:35:24.406 INFO:tasks.workunit.client.0.smithi138.stderr:created 2024-09-14T11:07:09.252780+0000 2024-09-14T11:35:24.406 INFO:tasks.workunit.client.0.smithi138.stderr:min_mon_release 19 (squid) 2024-09-14T11:35:24.407 INFO:tasks.workunit.client.0.smithi138.stderr:election_strategy: 1 2024-09-14T11:35:24.407 INFO:tasks.workunit.client.0.smithi138.stderr:0: [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] mon.a 2024-09-14T11:35:24.407 INFO:tasks.workunit.client.0.smithi138.stderr:1: [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] mon.b 2024-09-14T11:35:24.407 INFO:tasks.workunit.client.0.smithi138.stderr:2: [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] mon.c 2024-09-14T11:35:24.407 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-14T11:35:24.407 INFO:tasks.workunit.client.0.smithi138.stderr: -307> 2024-09-14T11:35:23.803+0000 7fd555602640 10 monclient: _finish_auth 0 2024-09-14T11:35:24.407 INFO:tasks.workunit.client.0.smithi138.stderr: -306> 2024-09-14T11:35:23.803+0000 7fd555602640 10 monclient: _check_auth_tickets 2024-09-14T11:35:24.407 INFO:tasks.workunit.client.0.smithi138.stderr: -305> 2024-09-14T11:35:23.803+0000 7fd555602640 10 monclient: handle_config config(0 keys) 2024-09-14T11:35:24.407 INFO:tasks.workunit.client.0.smithi138.stderr: -304> 2024-09-14T11:35:23.803+0000 7fd555602640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:35:24.407 INFO:tasks.workunit.client.0.smithi138.stderr: -303> 2024-09-14T11:35:23.803+0000 7fd555602640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-14T11:35:24.407 INFO:tasks.workunit.client.0.smithi138.stderr: -302> 2024-09-14T11:35:23.803+0000 7fd555602640 10 monclient: dump: 2024-09-14T11:35:24.407 INFO:tasks.workunit.client.0.smithi138.stderr:epoch 1 2024-09-14T11:35:24.407 INFO:tasks.workunit.client.0.smithi138.stderr:fsid 3f225f43-83a6-4aeb-b798-1f04bb49d597 2024-09-14T11:35:24.407 INFO:tasks.workunit.client.0.smithi138.stderr:last_changed 2024-09-14T11:07:09.252780+0000 2024-09-14T11:35:24.408 INFO:tasks.workunit.client.0.smithi138.stderr:created 2024-09-14T11:07:09.252780+0000 2024-09-14T11:35:24.408 INFO:tasks.workunit.client.0.smithi138.stderr:min_mon_release 19 (squid) 2024-09-14T11:35:24.408 INFO:tasks.workunit.client.0.smithi138.stderr:election_strategy: 1 2024-09-14T11:35:24.408 INFO:tasks.workunit.client.0.smithi138.stderr:0: [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] mon.a 2024-09-14T11:35:24.408 INFO:tasks.workunit.client.0.smithi138.stderr:1: [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] mon.b 2024-09-14T11:35:24.408 INFO:tasks.workunit.client.0.smithi138.stderr:2: [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] mon.c 2024-09-14T11:35:24.408 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-14T11:35:24.408 INFO:tasks.workunit.client.0.smithi138.stderr: -301> 2024-09-14T11:35:23.803+0000 7fd66db0c9c0 5 monclient: authenticate success, global_id 6795 2024-09-14T11:35:24.408 INFO:tasks.workunit.client.0.smithi138.stderr: -300> 2024-09-14T11:35:23.803+0000 7fd66db0c9c0 10 monclient: _renew_subs 2024-09-14T11:35:24.408 INFO:tasks.workunit.client.0.smithi138.stderr: -299> 2024-09-14T11:35:23.803+0000 7fd66c614640 4 set_mon_vals no callback set 2024-09-14T11:35:24.408 INFO:tasks.workunit.client.0.smithi138.stderr: -298> 2024-09-14T11:35:23.803+0000 7fd66db0c9c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.138:3300/0 2024-09-14T11:35:24.408 INFO:tasks.workunit.client.0.smithi138.stderr: -297> 2024-09-14T11:35:23.803+0000 7fd66db0c9c0 10 monclient: _renew_subs 2024-09-14T11:35:24.408 INFO:tasks.workunit.client.0.smithi138.stderr: -296> 2024-09-14T11:35:23.803+0000 7fd66db0c9c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.138:3300/0 2024-09-14T11:35:24.408 INFO:tasks.workunit.client.0.smithi138.stderr: -295> 2024-09-14T11:35:23.803+0000 7fd555602640 4 mgrc handle_mgr_map Got map version 5 2024-09-14T11:35:24.409 INFO:tasks.workunit.client.0.smithi138.stderr: -294> 2024-09-14T11:35:23.803+0000 7fd555602640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.138:6832/3778043143,v1:172.21.15.138:6833/3778043143] 2024-09-14T11:35:24.409 INFO:tasks.workunit.client.0.smithi138.stderr: -293> 2024-09-14T11:35:23.803+0000 7fd555602640 4 mgrc reconnect Starting new session with [v2:172.21.15.138:6832/3778043143,v1:172.21.15.138:6833/3778043143] 2024-09-14T11:35:24.409 INFO:tasks.workunit.client.0.smithi138.stderr: -292> 2024-09-14T11:35:23.803+0000 7fd66ae11640 10 monclient: get_auth_request con 0x7fd5440717e0 auth_method 0 2024-09-14T11:35:24.409 INFO:tasks.workunit.client.0.smithi138.stderr: -291> 2024-09-14T11:35:23.803+0000 7fd66db0c9c0 10 monclient: get_monmap_and_config 2024-09-14T11:35:24.409 INFO:tasks.workunit.client.0.smithi138.stderr: -290> 2024-09-14T11:35:23.803+0000 7fd66db0c9c0 10 monclient: build_initial_monmap 2024-09-14T11:35:24.409 INFO:tasks.workunit.client.0.smithi138.stderr: -289> 2024-09-14T11:35:23.803+0000 7fd66db0c9c0 1 build_initial for_mkfs: 0 2024-09-14T11:35:24.409 INFO:tasks.workunit.client.0.smithi138.stderr: -288> 2024-09-14T11:35:23.803+0000 7fd66db0c9c0 10 monclient: monmap: 2024-09-14T11:35:24.409 INFO:tasks.workunit.client.0.smithi138.stderr:epoch 0 2024-09-14T11:35:24.409 INFO:tasks.workunit.client.0.smithi138.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-14T11:35:24.409 INFO:tasks.workunit.client.0.smithi138.stderr:last_changed 0.000000 2024-09-14T11:35:24.410 INFO:tasks.workunit.client.0.smithi138.stderr:created 0.000000 2024-09-14T11:35:24.410 INFO:tasks.workunit.client.0.smithi138.stderr:min_mon_release 0 (unknown) 2024-09-14T11:35:24.410 INFO:tasks.workunit.client.0.smithi138.stderr:election_strategy: 1 2024-09-14T11:35:24.410 INFO:tasks.workunit.client.0.smithi138.stderr:0: [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] mon.noname-a 2024-09-14T11:35:24.410 INFO:tasks.workunit.client.0.smithi138.stderr:1: [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] mon.noname-b 2024-09-14T11:35:24.410 INFO:tasks.workunit.client.0.smithi138.stderr:2: [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] mon.noname-c 2024-09-14T11:35:24.410 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-14T11:35:24.410 INFO:tasks.workunit.client.0.smithi138.stderr: -287> 2024-09-14T11:35:23.803+0000 7fd66db0c9c0 5 AuthRegistry(0x55ef2e637790) adding auth protocol: cephx 2024-09-14T11:35:24.410 INFO:tasks.workunit.client.0.smithi138.stderr: -286> 2024-09-14T11:35:23.803+0000 7fd66db0c9c0 5 AuthRegistry(0x55ef2e637790) adding auth protocol: cephx 2024-09-14T11:35:24.410 INFO:tasks.workunit.client.0.smithi138.stderr: -285> 2024-09-14T11:35:23.803+0000 7fd66db0c9c0 5 AuthRegistry(0x55ef2e637790) adding auth protocol: cephx 2024-09-14T11:35:24.410 INFO:tasks.workunit.client.0.smithi138.stderr: -284> 2024-09-14T11:35:23.803+0000 7fd66db0c9c0 5 AuthRegistry(0x55ef2e637790) adding con mode: secure 2024-09-14T11:35:24.410 INFO:tasks.workunit.client.0.smithi138.stderr: -283> 2024-09-14T11:35:23.803+0000 7fd66db0c9c0 5 AuthRegistry(0x55ef2e637790) adding con mode: crc 2024-09-14T11:35:24.410 INFO:tasks.workunit.client.0.smithi138.stderr: -282> 2024-09-14T11:35:23.803+0000 7fd66db0c9c0 5 AuthRegistry(0x55ef2e637790) adding con mode: secure 2024-09-14T11:35:24.410 INFO:tasks.workunit.client.0.smithi138.stderr: -281> 2024-09-14T11:35:23.803+0000 7fd66db0c9c0 5 AuthRegistry(0x55ef2e637790) adding con mode: crc 2024-09-14T11:35:24.411 INFO:tasks.workunit.client.0.smithi138.stderr: -280> 2024-09-14T11:35:23.803+0000 7fd66db0c9c0 5 AuthRegistry(0x55ef2e637790) adding con mode: secure 2024-09-14T11:35:24.411 INFO:tasks.workunit.client.0.smithi138.stderr: -279> 2024-09-14T11:35:23.803+0000 7fd66db0c9c0 5 AuthRegistry(0x55ef2e637790) adding con mode: crc 2024-09-14T11:35:24.411 INFO:tasks.workunit.client.0.smithi138.stderr: -278> 2024-09-14T11:35:23.803+0000 7fd66db0c9c0 5 AuthRegistry(0x55ef2e637790) adding con mode: crc 2024-09-14T11:35:24.411 INFO:tasks.workunit.client.0.smithi138.stderr: -277> 2024-09-14T11:35:23.803+0000 7fd66db0c9c0 5 AuthRegistry(0x55ef2e637790) adding con mode: secure 2024-09-14T11:35:24.411 INFO:tasks.workunit.client.0.smithi138.stderr: -276> 2024-09-14T11:35:23.803+0000 7fd66db0c9c0 5 AuthRegistry(0x55ef2e637790) adding con mode: crc 2024-09-14T11:35:24.411 INFO:tasks.workunit.client.0.smithi138.stderr: -275> 2024-09-14T11:35:23.803+0000 7fd66db0c9c0 5 AuthRegistry(0x55ef2e637790) adding con mode: secure 2024-09-14T11:35:24.411 INFO:tasks.workunit.client.0.smithi138.stderr: -274> 2024-09-14T11:35:23.803+0000 7fd66db0c9c0 5 AuthRegistry(0x55ef2e637790) adding con mode: crc 2024-09-14T11:35:24.411 INFO:tasks.workunit.client.0.smithi138.stderr: -273> 2024-09-14T11:35:23.803+0000 7fd66db0c9c0 5 AuthRegistry(0x55ef2e637790) adding con mode: secure 2024-09-14T11:35:24.411 INFO:tasks.workunit.client.0.smithi138.stderr: -272> 2024-09-14T11:35:23.803+0000 7fd66db0c9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:35:24.411 INFO:tasks.workunit.client.0.smithi138.stderr: -271> 2024-09-14T11:35:23.803+0000 7fd66db0c9c0 10 monclient: init 2024-09-14T11:35:24.411 INFO:tasks.workunit.client.0.smithi138.stderr: -270> 2024-09-14T11:35:23.803+0000 7fd66db0c9c0 5 AuthRegistry(0x7ffc065df340) adding auth protocol: cephx 2024-09-14T11:35:24.411 INFO:tasks.workunit.client.0.smithi138.stderr: -269> 2024-09-14T11:35:23.803+0000 7fd66db0c9c0 5 AuthRegistry(0x7ffc065df340) adding auth protocol: cephx 2024-09-14T11:35:24.412 INFO:tasks.workunit.client.0.smithi138.stderr: -268> 2024-09-14T11:35:23.803+0000 7fd66db0c9c0 5 AuthRegistry(0x7ffc065df340) adding auth protocol: cephx 2024-09-14T11:35:24.412 INFO:tasks.workunit.client.0.smithi138.stderr: -267> 2024-09-14T11:35:23.803+0000 7fd66db0c9c0 5 AuthRegistry(0x7ffc065df340) adding con mode: secure 2024-09-14T11:35:24.412 INFO:tasks.workunit.client.0.smithi138.stderr: -266> 2024-09-14T11:35:23.803+0000 7fd66db0c9c0 5 AuthRegistry(0x7ffc065df340) adding con mode: crc 2024-09-14T11:35:24.412 INFO:tasks.workunit.client.0.smithi138.stderr: -265> 2024-09-14T11:35:23.803+0000 7fd66db0c9c0 5 AuthRegistry(0x7ffc065df340) adding con mode: secure 2024-09-14T11:35:24.412 INFO:tasks.workunit.client.0.smithi138.stderr: -264> 2024-09-14T11:35:23.803+0000 7fd66db0c9c0 5 AuthRegistry(0x7ffc065df340) adding con mode: crc 2024-09-14T11:35:24.412 INFO:tasks.workunit.client.0.smithi138.stderr: -263> 2024-09-14T11:35:23.803+0000 7fd66db0c9c0 5 AuthRegistry(0x7ffc065df340) adding con mode: secure 2024-09-14T11:35:24.412 INFO:tasks.workunit.client.0.smithi138.stderr: -262> 2024-09-14T11:35:23.803+0000 7fd66db0c9c0 5 AuthRegistry(0x7ffc065df340) adding con mode: crc 2024-09-14T11:35:24.412 INFO:tasks.workunit.client.0.smithi138.stderr: -261> 2024-09-14T11:35:23.803+0000 7fd66db0c9c0 5 AuthRegistry(0x7ffc065df340) adding con mode: crc 2024-09-14T11:35:24.412 INFO:tasks.workunit.client.0.smithi138.stderr: -260> 2024-09-14T11:35:23.803+0000 7fd66db0c9c0 5 AuthRegistry(0x7ffc065df340) adding con mode: secure 2024-09-14T11:35:24.412 INFO:tasks.workunit.client.0.smithi138.stderr: -259> 2024-09-14T11:35:23.803+0000 7fd66db0c9c0 5 AuthRegistry(0x7ffc065df340) adding con mode: crc 2024-09-14T11:35:24.412 INFO:tasks.workunit.client.0.smithi138.stderr: -258> 2024-09-14T11:35:23.803+0000 7fd66db0c9c0 5 AuthRegistry(0x7ffc065df340) adding con mode: secure 2024-09-14T11:35:24.412 INFO:tasks.workunit.client.0.smithi138.stderr: -257> 2024-09-14T11:35:23.803+0000 7fd66db0c9c0 5 AuthRegistry(0x7ffc065df340) adding con mode: crc 2024-09-14T11:35:24.412 INFO:tasks.workunit.client.0.smithi138.stderr: -256> 2024-09-14T11:35:23.803+0000 7fd66db0c9c0 5 AuthRegistry(0x7ffc065df340) adding con mode: secure 2024-09-14T11:35:24.412 INFO:tasks.workunit.client.0.smithi138.stderr: -255> 2024-09-14T11:35:23.803+0000 7fd66db0c9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:35:24.412 INFO:tasks.workunit.client.0.smithi138.stderr: -254> 2024-09-14T11:35:23.803+0000 7fd66db0c9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:35:24.413 INFO:tasks.workunit.client.0.smithi138.stderr: -253> 2024-09-14T11:35:23.807+0000 7fd66db0c9c0 5 asok(0x55ef2e38dd90) register_command rotate-key cmddesc rotate-key hook 0x7ffc065df488 EEXIST 2024-09-14T11:35:24.413 INFO:tasks.workunit.client.0.smithi138.stderr: -252> 2024-09-14T11:35:23.807+0000 7fd66db0c9c0 10 monclient: _reopen_session rank -1 2024-09-14T11:35:24.413 INFO:tasks.workunit.client.0.smithi138.stderr: -251> 2024-09-14T11:35:23.807+0000 7fd66db0c9c0 10 monclient: _add_conns ranks=[1,2,0] 2024-09-14T11:35:24.413 INFO:tasks.workunit.client.0.smithi138.stderr: -250> 2024-09-14T11:35:23.807+0000 7fd66db0c9c0 10 monclient(hunting): picked mon.noname-b con 0x55ef2e66bdc0 addr [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] 2024-09-14T11:35:24.413 INFO:tasks.workunit.client.0.smithi138.stderr: -249> 2024-09-14T11:35:23.807+0000 7fd66db0c9c0 10 monclient(hunting): picked mon.noname-c con 0x55ef2e63b7e0 addr [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] 2024-09-14T11:35:24.413 INFO:tasks.workunit.client.0.smithi138.stderr: -248> 2024-09-14T11:35:23.807+0000 7fd66db0c9c0 10 monclient(hunting): picked mon.noname-a con 0x55ef2e667590 addr [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] 2024-09-14T11:35:24.413 INFO:tasks.workunit.client.0.smithi138.stderr: -247> 2024-09-14T11:35:23.807+0000 7fd66db0c9c0 10 monclient(hunting): start opening mon connection 2024-09-14T11:35:24.413 INFO:tasks.workunit.client.0.smithi138.stderr: -246> 2024-09-14T11:35:23.807+0000 7fd66db0c9c0 10 monclient(hunting): start opening mon connection 2024-09-14T11:35:24.413 INFO:tasks.workunit.client.0.smithi138.stderr: -245> 2024-09-14T11:35:23.807+0000 7fd66db0c9c0 10 monclient(hunting): start opening mon connection 2024-09-14T11:35:24.413 INFO:tasks.workunit.client.0.smithi138.stderr: -244> 2024-09-14T11:35:23.807+0000 7fd66db0c9c0 10 monclient(hunting): _renew_subs 2024-09-14T11:35:24.413 INFO:tasks.workunit.client.0.smithi138.stderr: -243> 2024-09-14T11:35:23.807+0000 7fd66db0c9c0 10 monclient(hunting): authenticate will time out at 2659.768138s 2024-09-14T11:35:24.413 INFO:tasks.workunit.client.0.smithi138.stderr: -242> 2024-09-14T11:35:23.807+0000 7fd66b612640 10 monclient(hunting): get_auth_request con 0x55ef2e667590 auth_method 0 2024-09-14T11:35:24.413 INFO:tasks.workunit.client.0.smithi138.stderr: -241> 2024-09-14T11:35:23.807+0000 7fd66b612640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:35:24.413 INFO:tasks.workunit.client.0.smithi138.stderr: -240> 2024-09-14T11:35:23.807+0000 7fd66b612640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:35:24.413 INFO:tasks.workunit.client.0.smithi138.stderr: -239> 2024-09-14T11:35:23.807+0000 7fd66b612640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:35:24.414 INFO:tasks.workunit.client.0.smithi138.stderr: -238> 2024-09-14T11:35:23.807+0000 7fd66be13640 10 monclient(hunting): get_auth_request con 0x55ef2e63b7e0 auth_method 0 2024-09-14T11:35:24.414 INFO:tasks.workunit.client.0.smithi138.stderr: -237> 2024-09-14T11:35:23.807+0000 7fd66be13640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:35:24.414 INFO:tasks.workunit.client.0.smithi138.stderr: -236> 2024-09-14T11:35:23.807+0000 7fd66be13640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:35:24.414 INFO:tasks.workunit.client.0.smithi138.stderr: -235> 2024-09-14T11:35:23.807+0000 7fd66be13640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:35:24.414 INFO:tasks.workunit.client.0.smithi138.stderr: -234> 2024-09-14T11:35:23.807+0000 7fd66b612640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:35:24.414 INFO:tasks.workunit.client.0.smithi138.stderr: -233> 2024-09-14T11:35:23.807+0000 7fd66b612640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:35:24.414 INFO:tasks.workunit.client.0.smithi138.stderr: -232> 2024-09-14T11:35:23.807+0000 7fd66b612640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:35:24.414 INFO:tasks.workunit.client.0.smithi138.stderr: -231> 2024-09-14T11:35:23.807+0000 7fd66be13640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:35:24.414 INFO:tasks.workunit.client.0.smithi138.stderr: -230> 2024-09-14T11:35:23.807+0000 7fd66be13640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:35:24.414 INFO:tasks.workunit.client.0.smithi138.stderr: -229> 2024-09-14T11:35:23.807+0000 7fd66be13640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:35:24.414 INFO:tasks.workunit.client.0.smithi138.stderr: -228> 2024-09-14T11:35:23.807+0000 7fd66b612640 10 monclient(hunting): handle_auth_done global_id 6798 payload 274 2024-09-14T11:35:24.414 INFO:tasks.workunit.client.0.smithi138.stderr: -227> 2024-09-14T11:35:23.807+0000 7fd66b612640 10 monclient: _finish_hunting 0 2024-09-14T11:35:24.414 INFO:tasks.workunit.client.0.smithi138.stderr: -226> 2024-09-14T11:35:23.807+0000 7fd66b612640 1 monclient: found mon.noname-a 2024-09-14T11:35:24.415 INFO:tasks.workunit.client.0.smithi138.stderr: -225> 2024-09-14T11:35:23.807+0000 7fd66b612640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.138:3300/0 2024-09-14T11:35:24.415 INFO:tasks.workunit.client.0.smithi138.stderr: -224> 2024-09-14T11:35:23.807+0000 7fd54effd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:35:24.415 INFO:tasks.workunit.client.0.smithi138.stderr: -223> 2024-09-14T11:35:23.807+0000 7fd54effd640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-14T11:35:24.415 INFO:tasks.workunit.client.0.smithi138.stderr: -222> 2024-09-14T11:35:23.807+0000 7fd54effd640 10 monclient: dump: 2024-09-14T11:35:24.415 INFO:tasks.workunit.client.0.smithi138.stderr:epoch 1 2024-09-14T11:35:24.415 INFO:tasks.workunit.client.0.smithi138.stderr:fsid 3f225f43-83a6-4aeb-b798-1f04bb49d597 2024-09-14T11:35:24.415 INFO:tasks.workunit.client.0.smithi138.stderr:last_changed 2024-09-14T11:07:09.252780+0000 2024-09-14T11:35:24.415 INFO:tasks.workunit.client.0.smithi138.stderr:created 2024-09-14T11:07:09.252780+0000 2024-09-14T11:35:24.415 INFO:tasks.workunit.client.0.smithi138.stderr:min_mon_release 19 (squid) 2024-09-14T11:35:24.415 INFO:tasks.workunit.client.0.smithi138.stderr:election_strategy: 1 2024-09-14T11:35:24.415 INFO:tasks.workunit.client.0.smithi138.stderr:0: [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] mon.a 2024-09-14T11:35:24.415 INFO:tasks.workunit.client.0.smithi138.stderr:1: [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] mon.b 2024-09-14T11:35:24.416 INFO:tasks.workunit.client.0.smithi138.stderr:2: [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] mon.c 2024-09-14T11:35:24.416 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-14T11:35:24.416 INFO:tasks.workunit.client.0.smithi138.stderr: -221> 2024-09-14T11:35:23.807+0000 7fd54effd640 10 monclient: _finish_auth 0 2024-09-14T11:35:24.416 INFO:tasks.workunit.client.0.smithi138.stderr: -220> 2024-09-14T11:35:23.807+0000 7fd54effd640 10 monclient: _check_auth_tickets 2024-09-14T11:35:24.416 INFO:tasks.workunit.client.0.smithi138.stderr: -219> 2024-09-14T11:35:23.807+0000 7fd54effd640 10 monclient: handle_config config(0 keys) 2024-09-14T11:35:24.416 INFO:tasks.workunit.client.0.smithi138.stderr: -218> 2024-09-14T11:35:23.807+0000 7fd54effd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:35:24.416 INFO:tasks.workunit.client.0.smithi138.stderr: -217> 2024-09-14T11:35:23.807+0000 7fd54effd640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-14T11:35:24.416 INFO:tasks.workunit.client.0.smithi138.stderr: -216> 2024-09-14T11:35:23.807+0000 7fd54effd640 10 monclient: dump: 2024-09-14T11:35:24.416 INFO:tasks.workunit.client.0.smithi138.stderr:epoch 1 2024-09-14T11:35:24.416 INFO:tasks.workunit.client.0.smithi138.stderr:fsid 3f225f43-83a6-4aeb-b798-1f04bb49d597 2024-09-14T11:35:24.416 INFO:tasks.workunit.client.0.smithi138.stderr:last_changed 2024-09-14T11:07:09.252780+0000 2024-09-14T11:35:24.416 INFO:tasks.workunit.client.0.smithi138.stderr:created 2024-09-14T11:07:09.252780+0000 2024-09-14T11:35:24.417 INFO:tasks.workunit.client.0.smithi138.stderr:min_mon_release 19 (squid) 2024-09-14T11:35:24.417 INFO:tasks.workunit.client.0.smithi138.stderr:election_strategy: 1 2024-09-14T11:35:24.417 INFO:tasks.workunit.client.0.smithi138.stderr:0: [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] mon.a 2024-09-14T11:35:24.417 INFO:tasks.workunit.client.0.smithi138.stderr:1: [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] mon.b 2024-09-14T11:35:24.417 INFO:tasks.workunit.client.0.smithi138.stderr:2: [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] mon.c 2024-09-14T11:35:24.417 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-14T11:35:24.417 INFO:tasks.workunit.client.0.smithi138.stderr: -215> 2024-09-14T11:35:23.807+0000 7fd66db0c9c0 5 monclient: authenticate success, global_id 6798 2024-09-14T11:35:24.417 INFO:tasks.workunit.client.0.smithi138.stderr: -214> 2024-09-14T11:35:23.807+0000 7fd66db0c9c0 10 monclient: get_monmap_and_config success 2024-09-14T11:35:24.417 INFO:tasks.workunit.client.0.smithi138.stderr: -213> 2024-09-14T11:35:23.807+0000 7fd66db0c9c0 4 set_mon_vals no callback set 2024-09-14T11:35:24.417 INFO:tasks.workunit.client.0.smithi138.stderr: -212> 2024-09-14T11:35:23.807+0000 7fd66db0c9c0 10 monclient: shutdown 2024-09-14T11:35:24.417 INFO:tasks.workunit.client.0.smithi138.stderr: -211> 2024-09-14T11:35:23.807+0000 7fd66db0c9c0 10 monclient: build_initial_monmap 2024-09-14T11:35:24.417 INFO:tasks.workunit.client.0.smithi138.stderr: -210> 2024-09-14T11:35:23.807+0000 7fd66db0c9c0 1 build_initial for_mkfs: 0 2024-09-14T11:35:24.417 INFO:tasks.workunit.client.0.smithi138.stderr: -209> 2024-09-14T11:35:23.807+0000 7fd66db0c9c0 10 monclient: monmap: 2024-09-14T11:35:24.417 INFO:tasks.workunit.client.0.smithi138.stderr:epoch 0 2024-09-14T11:35:24.418 INFO:tasks.workunit.client.0.smithi138.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-14T11:35:24.418 INFO:tasks.workunit.client.0.smithi138.stderr:last_changed 0.000000 2024-09-14T11:35:24.418 INFO:tasks.workunit.client.0.smithi138.stderr:created 0.000000 2024-09-14T11:35:24.418 INFO:tasks.workunit.client.0.smithi138.stderr:min_mon_release 0 (unknown) 2024-09-14T11:35:24.418 INFO:tasks.workunit.client.0.smithi138.stderr:election_strategy: 1 2024-09-14T11:35:24.418 INFO:tasks.workunit.client.0.smithi138.stderr:0: [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] mon.noname-a 2024-09-14T11:35:24.418 INFO:tasks.workunit.client.0.smithi138.stderr:1: [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] mon.noname-b 2024-09-14T11:35:24.418 INFO:tasks.workunit.client.0.smithi138.stderr:2: [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] mon.noname-c 2024-09-14T11:35:24.418 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-14T11:35:24.418 INFO:tasks.workunit.client.0.smithi138.stderr: -208> 2024-09-14T11:35:23.807+0000 7fd66db0c9c0 5 AuthRegistry(0x55ef2e65c7e0) adding auth protocol: cephx 2024-09-14T11:35:24.418 INFO:tasks.workunit.client.0.smithi138.stderr: -207> 2024-09-14T11:35:23.807+0000 7fd66db0c9c0 5 AuthRegistry(0x55ef2e65c7e0) adding auth protocol: cephx 2024-09-14T11:35:24.418 INFO:tasks.workunit.client.0.smithi138.stderr: -206> 2024-09-14T11:35:23.807+0000 7fd66db0c9c0 5 AuthRegistry(0x55ef2e65c7e0) adding auth protocol: cephx 2024-09-14T11:35:24.419 INFO:tasks.workunit.client.0.smithi138.stderr: -205> 2024-09-14T11:35:23.807+0000 7fd66db0c9c0 5 AuthRegistry(0x55ef2e65c7e0) adding con mode: secure 2024-09-14T11:35:24.419 INFO:tasks.workunit.client.0.smithi138.stderr: -204> 2024-09-14T11:35:23.807+0000 7fd66db0c9c0 5 AuthRegistry(0x55ef2e65c7e0) adding con mode: crc 2024-09-14T11:35:24.419 INFO:tasks.workunit.client.0.smithi138.stderr: -203> 2024-09-14T11:35:23.807+0000 7fd66db0c9c0 5 AuthRegistry(0x55ef2e65c7e0) adding con mode: secure 2024-09-14T11:35:24.419 INFO:tasks.workunit.client.0.smithi138.stderr: -202> 2024-09-14T11:35:23.807+0000 7fd66db0c9c0 5 AuthRegistry(0x55ef2e65c7e0) adding con mode: crc 2024-09-14T11:35:24.419 INFO:tasks.workunit.client.0.smithi138.stderr: -201> 2024-09-14T11:35:23.807+0000 7fd66db0c9c0 5 AuthRegistry(0x55ef2e65c7e0) adding con mode: secure 2024-09-14T11:35:24.419 INFO:tasks.workunit.client.0.smithi138.stderr: -200> 2024-09-14T11:35:23.807+0000 7fd66db0c9c0 5 AuthRegistry(0x55ef2e65c7e0) adding con mode: crc 2024-09-14T11:35:24.419 INFO:tasks.workunit.client.0.smithi138.stderr: -199> 2024-09-14T11:35:23.807+0000 7fd66db0c9c0 5 AuthRegistry(0x55ef2e65c7e0) adding con mode: crc 2024-09-14T11:35:24.419 INFO:tasks.workunit.client.0.smithi138.stderr: -198> 2024-09-14T11:35:23.807+0000 7fd66db0c9c0 5 AuthRegistry(0x55ef2e65c7e0) adding con mode: secure 2024-09-14T11:35:24.419 INFO:tasks.workunit.client.0.smithi138.stderr: -197> 2024-09-14T11:35:23.807+0000 7fd66db0c9c0 5 AuthRegistry(0x55ef2e65c7e0) adding con mode: crc 2024-09-14T11:35:24.419 INFO:tasks.workunit.client.0.smithi138.stderr: -196> 2024-09-14T11:35:23.807+0000 7fd66db0c9c0 5 AuthRegistry(0x55ef2e65c7e0) adding con mode: secure 2024-09-14T11:35:24.419 INFO:tasks.workunit.client.0.smithi138.stderr: -195> 2024-09-14T11:35:23.807+0000 7fd66db0c9c0 5 AuthRegistry(0x55ef2e65c7e0) adding con mode: crc 2024-09-14T11:35:24.419 INFO:tasks.workunit.client.0.smithi138.stderr: -194> 2024-09-14T11:35:23.807+0000 7fd66db0c9c0 5 AuthRegistry(0x55ef2e65c7e0) adding con mode: secure 2024-09-14T11:35:24.419 INFO:tasks.workunit.client.0.smithi138.stderr: -193> 2024-09-14T11:35:23.807+0000 7fd66db0c9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:35:24.419 INFO:tasks.workunit.client.0.smithi138.stderr: -192> 2024-09-14T11:35:23.807+0000 7fd66db0c9c0 1 librados: starting msgr at 2024-09-14T11:35:24.420 INFO:tasks.workunit.client.0.smithi138.stderr: -191> 2024-09-14T11:35:23.807+0000 7fd66db0c9c0 1 librados: starting objecter 2024-09-14T11:35:24.420 INFO:tasks.workunit.client.0.smithi138.stderr: -190> 2024-09-14T11:35:23.807+0000 7fd66db0c9c0 5 asok(0x55ef2e38dd90) register_command objecter_requests cmddesc objecter_requests hook 0x55ef2e667290 EEXIST 2024-09-14T11:35:24.420 INFO:tasks.workunit.client.0.smithi138.stderr: -189> 2024-09-14T11:35:23.807+0000 7fd66db0c9c0 1 librados: setting wanted keys 2024-09-14T11:35:24.420 INFO:tasks.workunit.client.0.smithi138.stderr: -188> 2024-09-14T11:35:23.807+0000 7fd66db0c9c0 1 librados: calling monclient init 2024-09-14T11:35:24.420 INFO:tasks.workunit.client.0.smithi138.stderr: -187> 2024-09-14T11:35:23.807+0000 7fd66db0c9c0 10 monclient: init 2024-09-14T11:35:24.420 INFO:tasks.workunit.client.0.smithi138.stderr: -186> 2024-09-14T11:35:23.807+0000 7fd66db0c9c0 5 AuthRegistry(0x55ef2e619c30) adding auth protocol: cephx 2024-09-14T11:35:24.420 INFO:tasks.workunit.client.0.smithi138.stderr: -185> 2024-09-14T11:35:23.807+0000 7fd66db0c9c0 5 AuthRegistry(0x55ef2e619c30) adding auth protocol: cephx 2024-09-14T11:35:24.420 INFO:tasks.workunit.client.0.smithi138.stderr: -184> 2024-09-14T11:35:23.807+0000 7fd66db0c9c0 5 AuthRegistry(0x55ef2e619c30) adding auth protocol: cephx 2024-09-14T11:35:24.420 INFO:tasks.workunit.client.0.smithi138.stderr: -183> 2024-09-14T11:35:23.807+0000 7fd66db0c9c0 5 AuthRegistry(0x55ef2e619c30) adding con mode: secure 2024-09-14T11:35:24.420 INFO:tasks.workunit.client.0.smithi138.stderr: -182> 2024-09-14T11:35:23.807+0000 7fd66db0c9c0 5 AuthRegistry(0x55ef2e619c30) adding con mode: crc 2024-09-14T11:35:24.420 INFO:tasks.workunit.client.0.smithi138.stderr: -181> 2024-09-14T11:35:23.807+0000 7fd66db0c9c0 5 AuthRegistry(0x55ef2e619c30) adding con mode: secure 2024-09-14T11:35:24.421 INFO:tasks.workunit.client.0.smithi138.stderr: -180> 2024-09-14T11:35:23.807+0000 7fd66db0c9c0 5 AuthRegistry(0x55ef2e619c30) adding con mode: crc 2024-09-14T11:35:24.421 INFO:tasks.workunit.client.0.smithi138.stderr: -179> 2024-09-14T11:35:23.807+0000 7fd66db0c9c0 5 AuthRegistry(0x55ef2e619c30) adding con mode: secure 2024-09-14T11:35:24.421 INFO:tasks.workunit.client.0.smithi138.stderr: -178> 2024-09-14T11:35:23.807+0000 7fd66db0c9c0 5 AuthRegistry(0x55ef2e619c30) adding con mode: crc 2024-09-14T11:35:24.421 INFO:tasks.workunit.client.0.smithi138.stderr: -177> 2024-09-14T11:35:23.807+0000 7fd66db0c9c0 5 AuthRegistry(0x55ef2e619c30) adding con mode: crc 2024-09-14T11:35:24.421 INFO:tasks.workunit.client.0.smithi138.stderr: -176> 2024-09-14T11:35:23.807+0000 7fd66db0c9c0 5 AuthRegistry(0x55ef2e619c30) adding con mode: secure 2024-09-14T11:35:24.421 INFO:tasks.workunit.client.0.smithi138.stderr: -175> 2024-09-14T11:35:23.807+0000 7fd66db0c9c0 5 AuthRegistry(0x55ef2e619c30) adding con mode: crc 2024-09-14T11:35:24.421 INFO:tasks.workunit.client.0.smithi138.stderr: -174> 2024-09-14T11:35:23.807+0000 7fd66db0c9c0 5 AuthRegistry(0x55ef2e619c30) adding con mode: secure 2024-09-14T11:35:24.421 INFO:tasks.workunit.client.0.smithi138.stderr: -173> 2024-09-14T11:35:23.807+0000 7fd66db0c9c0 5 AuthRegistry(0x55ef2e619c30) adding con mode: crc 2024-09-14T11:35:24.421 INFO:tasks.workunit.client.0.smithi138.stderr: -172> 2024-09-14T11:35:23.807+0000 7fd66db0c9c0 5 AuthRegistry(0x55ef2e619c30) adding con mode: secure 2024-09-14T11:35:24.421 INFO:tasks.workunit.client.0.smithi138.stderr: -171> 2024-09-14T11:35:23.807+0000 7fd66db0c9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:35:24.421 INFO:tasks.workunit.client.0.smithi138.stderr: -170> 2024-09-14T11:35:23.807+0000 7fd66db0c9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:35:24.421 INFO:tasks.workunit.client.0.smithi138.stderr: -169> 2024-09-14T11:35:23.807+0000 7fd66db0c9c0 5 asok(0x55ef2e38dd90) register_command rotate-key cmddesc rotate-key hook 0x55ef2e619d78 EEXIST 2024-09-14T11:35:24.421 INFO:tasks.workunit.client.0.smithi138.stderr: -168> 2024-09-14T11:35:23.807+0000 7fd66db0c9c0 10 monclient: _reopen_session rank -1 2024-09-14T11:35:24.421 INFO:tasks.workunit.client.0.smithi138.stderr: -167> 2024-09-14T11:35:23.807+0000 7fd66db0c9c0 10 monclient: _add_conns ranks=[2,0,1] 2024-09-14T11:35:24.422 INFO:tasks.workunit.client.0.smithi138.stderr: -166> 2024-09-14T11:35:23.807+0000 7fd66db0c9c0 10 monclient(hunting): picked mon.noname-c con 0x55ef2e63b7e0 addr [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] 2024-09-14T11:35:24.422 INFO:tasks.workunit.client.0.smithi138.stderr: -165> 2024-09-14T11:35:23.807+0000 7fd66db0c9c0 10 monclient(hunting): picked mon.noname-a con 0x55ef2e667590 addr [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] 2024-09-14T11:35:24.422 INFO:tasks.workunit.client.0.smithi138.stderr: -164> 2024-09-14T11:35:23.807+0000 7fd66db0c9c0 10 monclient(hunting): picked mon.noname-b con 0x55ef2e66bdc0 addr [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] 2024-09-14T11:35:24.422 INFO:tasks.workunit.client.0.smithi138.stderr: -163> 2024-09-14T11:35:23.807+0000 7fd66db0c9c0 10 monclient(hunting): start opening mon connection 2024-09-14T11:35:24.422 INFO:tasks.workunit.client.0.smithi138.stderr: -162> 2024-09-14T11:35:23.807+0000 7fd66db0c9c0 10 monclient(hunting): start opening mon connection 2024-09-14T11:35:24.422 INFO:tasks.workunit.client.0.smithi138.stderr: -161> 2024-09-14T11:35:23.807+0000 7fd66db0c9c0 10 monclient(hunting): start opening mon connection 2024-09-14T11:35:24.422 INFO:tasks.workunit.client.0.smithi138.stderr: -160> 2024-09-14T11:35:23.807+0000 7fd66db0c9c0 10 monclient(hunting): _renew_subs 2024-09-14T11:35:24.422 INFO:tasks.workunit.client.0.smithi138.stderr: -159> 2024-09-14T11:35:23.807+0000 7fd66db0c9c0 10 monclient(hunting): authenticate will time out at 2659.770636s 2024-09-14T11:35:24.422 INFO:tasks.workunit.client.0.smithi138.stderr: -158> 2024-09-14T11:35:23.807+0000 7fd66be13640 10 monclient(hunting): get_auth_request con 0x55ef2e667590 auth_method 0 2024-09-14T11:35:24.422 INFO:tasks.workunit.client.0.smithi138.stderr: -157> 2024-09-14T11:35:23.807+0000 7fd66be13640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:35:24.422 INFO:tasks.workunit.client.0.smithi138.stderr: -156> 2024-09-14T11:35:23.807+0000 7fd66be13640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:35:24.422 INFO:tasks.workunit.client.0.smithi138.stderr: -155> 2024-09-14T11:35:23.807+0000 7fd66be13640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:35:24.422 INFO:tasks.workunit.client.0.smithi138.stderr: -154> 2024-09-14T11:35:23.807+0000 7fd66ae11640 10 monclient(hunting): get_auth_request con 0x55ef2e63b7e0 auth_method 0 2024-09-14T11:35:24.422 INFO:tasks.workunit.client.0.smithi138.stderr: -153> 2024-09-14T11:35:23.807+0000 7fd66ae11640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:35:24.423 INFO:tasks.workunit.client.0.smithi138.stderr: -152> 2024-09-14T11:35:23.807+0000 7fd66ae11640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:35:24.423 INFO:tasks.workunit.client.0.smithi138.stderr: -151> 2024-09-14T11:35:23.807+0000 7fd66ae11640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:35:24.423 INFO:tasks.workunit.client.0.smithi138.stderr: -150> 2024-09-14T11:35:23.807+0000 7fd66be13640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:35:24.423 INFO:tasks.workunit.client.0.smithi138.stderr: -149> 2024-09-14T11:35:23.807+0000 7fd66be13640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:35:24.423 INFO:tasks.workunit.client.0.smithi138.stderr: -148> 2024-09-14T11:35:23.807+0000 7fd66be13640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:35:24.423 INFO:tasks.workunit.client.0.smithi138.stderr: -147> 2024-09-14T11:35:23.807+0000 7fd66ae11640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:35:24.423 INFO:tasks.workunit.client.0.smithi138.stderr: -146> 2024-09-14T11:35:23.807+0000 7fd66ae11640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:35:24.423 INFO:tasks.workunit.client.0.smithi138.stderr: -145> 2024-09-14T11:35:23.807+0000 7fd66ae11640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:35:24.423 INFO:tasks.workunit.client.0.smithi138.stderr: -144> 2024-09-14T11:35:23.807+0000 7fd66be13640 10 monclient(hunting): handle_auth_done global_id 6801 payload 824 2024-09-14T11:35:24.423 INFO:tasks.workunit.client.0.smithi138.stderr: -143> 2024-09-14T11:35:23.807+0000 7fd66be13640 10 monclient: _finish_hunting 0 2024-09-14T11:35:24.423 INFO:tasks.workunit.client.0.smithi138.stderr: -142> 2024-09-14T11:35:23.807+0000 7fd66be13640 1 monclient: found mon.noname-a 2024-09-14T11:35:24.423 INFO:tasks.workunit.client.0.smithi138.stderr: -141> 2024-09-14T11:35:23.807+0000 7fd66be13640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.138:3300/0 2024-09-14T11:35:24.423 INFO:tasks.workunit.client.0.smithi138.stderr: -140> 2024-09-14T11:35:23.807+0000 7fd66b612640 10 monclient: get_auth_request con 0x55ef2e66bdc0 auth_method 0 2024-09-14T11:35:24.423 INFO:tasks.workunit.client.0.smithi138.stderr: -139> 2024-09-14T11:35:23.807+0000 7fd54d7fa640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:35:24.424 INFO:tasks.workunit.client.0.smithi138.stderr: -138> 2024-09-14T11:35:23.807+0000 7fd54d7fa640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-14T11:35:24.424 INFO:tasks.workunit.client.0.smithi138.stderr: -137> 2024-09-14T11:35:23.807+0000 7fd54d7fa640 10 monclient: dump: 2024-09-14T11:35:24.424 INFO:tasks.workunit.client.0.smithi138.stderr:epoch 1 2024-09-14T11:35:24.424 INFO:tasks.workunit.client.0.smithi138.stderr:fsid 3f225f43-83a6-4aeb-b798-1f04bb49d597 2024-09-14T11:35:24.424 INFO:tasks.workunit.client.0.smithi138.stderr:last_changed 2024-09-14T11:07:09.252780+0000 2024-09-14T11:35:24.424 INFO:tasks.workunit.client.0.smithi138.stderr:created 2024-09-14T11:07:09.252780+0000 2024-09-14T11:35:24.424 INFO:tasks.workunit.client.0.smithi138.stderr:min_mon_release 19 (squid) 2024-09-14T11:35:24.424 INFO:tasks.workunit.client.0.smithi138.stderr:election_strategy: 1 2024-09-14T11:35:24.424 INFO:tasks.workunit.client.0.smithi138.stderr:0: [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] mon.a 2024-09-14T11:35:24.424 INFO:tasks.workunit.client.0.smithi138.stderr:1: [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] mon.b 2024-09-14T11:35:24.424 INFO:tasks.workunit.client.0.smithi138.stderr:2: [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] mon.c 2024-09-14T11:35:24.425 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-14T11:35:24.425 INFO:tasks.workunit.client.0.smithi138.stderr: -136> 2024-09-14T11:35:23.807+0000 7fd54d7fa640 10 monclient: _finish_auth 0 2024-09-14T11:35:24.425 INFO:tasks.workunit.client.0.smithi138.stderr: -135> 2024-09-14T11:35:23.807+0000 7fd54d7fa640 10 monclient: _check_auth_tickets 2024-09-14T11:35:24.425 INFO:tasks.workunit.client.0.smithi138.stderr: -134> 2024-09-14T11:35:23.807+0000 7fd54d7fa640 10 monclient: handle_config config(0 keys) 2024-09-14T11:35:24.425 INFO:tasks.workunit.client.0.smithi138.stderr: -133> 2024-09-14T11:35:23.807+0000 7fd54d7fa640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:35:24.425 INFO:tasks.workunit.client.0.smithi138.stderr: -132> 2024-09-14T11:35:23.807+0000 7fd54d7fa640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-14T11:35:24.425 INFO:tasks.workunit.client.0.smithi138.stderr: -131> 2024-09-14T11:35:23.807+0000 7fd54d7fa640 10 monclient: dump: 2024-09-14T11:35:24.425 INFO:tasks.workunit.client.0.smithi138.stderr:epoch 1 2024-09-14T11:35:24.425 INFO:tasks.workunit.client.0.smithi138.stderr:fsid 3f225f43-83a6-4aeb-b798-1f04bb49d597 2024-09-14T11:35:24.425 INFO:tasks.workunit.client.0.smithi138.stderr:last_changed 2024-09-14T11:07:09.252780+0000 2024-09-14T11:35:24.426 INFO:tasks.workunit.client.0.smithi138.stderr:created 2024-09-14T11:07:09.252780+0000 2024-09-14T11:35:24.426 INFO:tasks.workunit.client.0.smithi138.stderr:min_mon_release 19 (squid) 2024-09-14T11:35:24.426 INFO:tasks.workunit.client.0.smithi138.stderr:election_strategy: 1 2024-09-14T11:35:24.426 INFO:tasks.workunit.client.0.smithi138.stderr:0: [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] mon.a 2024-09-14T11:35:24.426 INFO:tasks.workunit.client.0.smithi138.stderr:1: [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] mon.b 2024-09-14T11:35:24.426 INFO:tasks.workunit.client.0.smithi138.stderr:2: [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] mon.c 2024-09-14T11:35:24.426 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-14T11:35:24.426 INFO:tasks.workunit.client.0.smithi138.stderr: -130> 2024-09-14T11:35:23.807+0000 7fd66db0c9c0 5 monclient: authenticate success, global_id 6801 2024-09-14T11:35:24.426 INFO:tasks.workunit.client.0.smithi138.stderr: -129> 2024-09-14T11:35:23.807+0000 7fd54effd640 4 set_mon_vals no callback set 2024-09-14T11:35:24.426 INFO:tasks.workunit.client.0.smithi138.stderr: -128> 2024-09-14T11:35:23.807+0000 7fd66db0c9c0 10 monclient: _renew_subs 2024-09-14T11:35:24.426 INFO:tasks.workunit.client.0.smithi138.stderr: -127> 2024-09-14T11:35:23.807+0000 7fd66db0c9c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.138:3300/0 2024-09-14T11:35:24.426 INFO:tasks.workunit.client.0.smithi138.stderr: -126> 2024-09-14T11:35:23.807+0000 7fd66db0c9c0 10 monclient: _renew_subs 2024-09-14T11:35:24.426 INFO:tasks.workunit.client.0.smithi138.stderr: -125> 2024-09-14T11:35:23.807+0000 7fd66db0c9c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.138:3300/0 2024-09-14T11:35:24.426 INFO:tasks.workunit.client.0.smithi138.stderr: -124> 2024-09-14T11:35:23.807+0000 7fd66db0c9c0 1 librados: init done 2024-09-14T11:35:24.427 INFO:tasks.workunit.client.0.smithi138.stderr: -123> 2024-09-14T11:35:23.807+0000 7fd66db0c9c0 5 asok(0x55ef2e38dd90) register_command cr dump hook 0x55ef2e66adb8 2024-09-14T11:35:24.427 INFO:tasks.workunit.client.0.smithi138.stderr: -122> 2024-09-14T11:35:23.811+0000 7fd66db0c9c0 20 rados->read ofs=0 len=0 2024-09-14T11:35:24.427 INFO:tasks.workunit.client.0.smithi138.stderr: -121> 2024-09-14T11:35:23.811+0000 7fd54d7fa640 4 mgrc handle_mgr_map Got map version 5 2024-09-14T11:35:24.427 INFO:tasks.workunit.client.0.smithi138.stderr: -120> 2024-09-14T11:35:23.811+0000 7fd54d7fa640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.138:6832/3778043143,v1:172.21.15.138:6833/3778043143] 2024-09-14T11:35:24.427 INFO:tasks.workunit.client.0.smithi138.stderr: -119> 2024-09-14T11:35:23.811+0000 7fd54d7fa640 4 mgrc reconnect Starting new session with [v2:172.21.15.138:6832/3778043143,v1:172.21.15.138:6833/3778043143] 2024-09-14T11:35:24.427 INFO:tasks.workunit.client.0.smithi138.stderr: -118> 2024-09-14T11:35:23.811+0000 7fd66ae11640 10 monclient: get_auth_request con 0x7fd5340718a0 auth_method 0 2024-09-14T11:35:24.427 INFO:tasks.workunit.client.0.smithi138.stderr: -117> 2024-09-14T11:35:23.811+0000 7fd66b612640 10 monclient: get_auth_request con 0x55ef2e685750 auth_method 0 2024-09-14T11:35:24.427 INFO:tasks.workunit.client.0.smithi138.stderr: -116> 2024-09-14T11:35:23.811+0000 7fd66db0c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:35:24.427 INFO:tasks.workunit.client.0.smithi138.stderr: -115> 2024-09-14T11:35:23.811+0000 7fd66db0c9c0 20 realm 2024-09-14T11:35:24.427 INFO:tasks.workunit.client.0.smithi138.stderr: -114> 2024-09-14T11:35:23.811+0000 7fd66db0c9c0 20 rados->read ofs=0 len=0 2024-09-14T11:35:24.427 INFO:tasks.workunit.client.0.smithi138.stderr: -113> 2024-09-14T11:35:23.811+0000 7fd66db0c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:35:24.427 INFO:tasks.workunit.client.0.smithi138.stderr: -112> 2024-09-14T11:35:23.811+0000 7fd66db0c9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:35:24.427 INFO:tasks.workunit.client.0.smithi138.stderr: -111> 2024-09-14T11:35:23.811+0000 7fd66db0c9c0 20 rados->read ofs=0 len=0 2024-09-14T11:35:24.427 INFO:tasks.workunit.client.0.smithi138.stderr: -110> 2024-09-14T11:35:23.811+0000 7fd66db0c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:35:24.428 INFO:tasks.workunit.client.0.smithi138.stderr: -109> 2024-09-14T11:35:23.811+0000 7fd66db0c9c0 20 rados->read ofs=0 len=0 2024-09-14T11:35:24.428 INFO:tasks.workunit.client.0.smithi138.stderr: -108> 2024-09-14T11:35:23.815+0000 7fd66ae11640 10 monclient: get_auth_request con 0x55ef2e689a60 auth_method 0 2024-09-14T11:35:24.428 INFO:tasks.workunit.client.0.smithi138.stderr: -107> 2024-09-14T11:35:23.815+0000 7fd66db0c9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:35:24.428 INFO:tasks.workunit.client.0.smithi138.stderr: -106> 2024-09-14T11:35:23.815+0000 7fd66db0c9c0 20 rados->read ofs=0 len=0 2024-09-14T11:35:24.428 INFO:tasks.workunit.client.0.smithi138.stderr: -105> 2024-09-14T11:35:23.815+0000 7fd66be13640 10 monclient: get_auth_request con 0x55ef2e68d180 auth_method 0 2024-09-14T11:35:24.428 INFO:tasks.workunit.client.0.smithi138.stderr: -104> 2024-09-14T11:35:23.815+0000 7fd66db0c9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:35:24.428 INFO:tasks.workunit.client.0.smithi138.stderr: -103> 2024-09-14T11:35:23.815+0000 7fd66db0c9c0 20 searching for the correct realm 2024-09-14T11:35:24.428 INFO:tasks.workunit.client.0.smithi138.stderr: -102> 2024-09-14T11:35:23.815+0000 7fd66b612640 10 monclient: get_auth_request con 0x55ef2e691f40 auth_method 0 2024-09-14T11:35:24.428 INFO:tasks.workunit.client.0.smithi138.stderr: -101> 2024-09-14T11:35:23.815+0000 7fd66ae11640 10 monclient: get_auth_request con 0x7fd65c04a070 auth_method 0 2024-09-14T11:35:24.428 INFO:tasks.workunit.client.0.smithi138.stderr: -100> 2024-09-14T11:35:23.819+0000 7fd66be13640 10 monclient: get_auth_request con 0x7fd664064900 auth_method 0 2024-09-14T11:35:24.428 INFO:tasks.workunit.client.0.smithi138.stderr: -99> 2024-09-14T11:35:23.819+0000 7fd66be13640 0 -- 172.21.15.138:0/3136175301 >> [v2:172.21.15.154:6824/416768175,v1:172.21.15.154:6825/416768175] conn(0x7fd664064900 msgr2=0x7fd664063370 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:35:24.428 INFO:tasks.workunit.client.0.smithi138.stderr: -98> 2024-09-14T11:35:24.023+0000 7fd66be13640 10 monclient: get_auth_request con 0x7fd664064900 auth_method 0 2024-09-14T11:35:24.428 INFO:tasks.workunit.client.0.smithi138.stderr: -97> 2024-09-14T11:35:24.027+0000 7fd66b612640 10 monclient: get_auth_request con 0x7fd664077040 auth_method 0 2024-09-14T11:35:24.429 INFO:tasks.workunit.client.0.smithi138.stderr: -96> 2024-09-14T11:35:24.035+0000 7fd66ae11640 10 monclient: get_auth_request con 0x7fd66406dba0 auth_method 0 2024-09-14T11:35:24.429 INFO:tasks.workunit.client.0.smithi138.stderr: -95> 2024-09-14T11:35:24.035+0000 7fd66ae11640 0 -- 172.21.15.138:0/3136175301 >> [v2:172.21.15.138:6816/326481658,v1:172.21.15.138:6817/326481658] conn(0x7fd66406dba0 msgr2=0x7fd66407e900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:35:24.429 INFO:tasks.workunit.client.0.smithi138.stderr: -94> 2024-09-14T11:35:24.239+0000 7fd66ae11640 10 monclient: get_auth_request con 0x7fd66406dba0 auth_method 0 2024-09-14T11:35:24.429 INFO:tasks.workunit.client.0.smithi138.stderr: -93> 2024-09-14T11:35:24.251+0000 7fd66db0c9c0 20 RGWRados::pool_iterate: got zone_info.d9e72d30-c60b-4d0d-9267-fdc36392d5ad 2024-09-14T11:35:24.429 INFO:tasks.workunit.client.0.smithi138.stderr: -92> 2024-09-14T11:35:24.251+0000 7fd66db0c9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:35:24.429 INFO:tasks.workunit.client.0.smithi138.stderr: -91> 2024-09-14T11:35:24.251+0000 7fd66db0c9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:35:24.429 INFO:tasks.workunit.client.0.smithi138.stderr: -90> 2024-09-14T11:35:24.251+0000 7fd66db0c9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:35:24.429 INFO:tasks.workunit.client.0.smithi138.stderr: -89> 2024-09-14T11:35:24.251+0000 7fd66db0c9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:35:24.429 INFO:tasks.workunit.client.0.smithi138.stderr: -88> 2024-09-14T11:35:24.251+0000 7fd66db0c9c0 20 RGWRados::pool_iterate: got zonegroup_info.65ab941b-da8c-4160-94fb-3672b069d44f 2024-09-14T11:35:24.429 INFO:tasks.workunit.client.0.smithi138.stderr: -87> 2024-09-14T11:35:24.251+0000 7fd66db0c9c0 20 rados->read ofs=0 len=0 2024-09-14T11:35:24.429 INFO:tasks.workunit.client.0.smithi138.stderr: -86> 2024-09-14T11:35:24.251+0000 7fd66db0c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:35:24.429 INFO:tasks.workunit.client.0.smithi138.stderr: -85> 2024-09-14T11:35:24.251+0000 7fd66db0c9c0 20 rados->read ofs=0 len=0 2024-09-14T11:35:24.429 INFO:tasks.workunit.client.0.smithi138.stderr: -84> 2024-09-14T11:35:24.255+0000 7fd66db0c9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:35:24.429 INFO:tasks.workunit.client.0.smithi138.stderr: -83> 2024-09-14T11:35:24.255+0000 7fd66db0c9c0 20 rados->read ofs=0 len=0 2024-09-14T11:35:24.430 INFO:tasks.workunit.client.0.smithi138.stderr: -82> 2024-09-14T11:35:24.255+0000 7fd66db0c9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:35:24.430 INFO:tasks.workunit.client.0.smithi138.stderr: -81> 2024-09-14T11:35:24.255+0000 7fd66db0c9c0 20 zone default found 2024-09-14T11:35:24.430 INFO:tasks.workunit.client.0.smithi138.stderr: -80> 2024-09-14T11:35:24.255+0000 7fd66db0c9c0 4 Realm: () 2024-09-14T11:35:24.430 INFO:tasks.workunit.client.0.smithi138.stderr: -79> 2024-09-14T11:35:24.255+0000 7fd66db0c9c0 4 ZoneGroup: default (65ab941b-da8c-4160-94fb-3672b069d44f) 2024-09-14T11:35:24.430 INFO:tasks.workunit.client.0.smithi138.stderr: -78> 2024-09-14T11:35:24.255+0000 7fd66db0c9c0 4 Zone: default (d9e72d30-c60b-4d0d-9267-fdc36392d5ad) 2024-09-14T11:35:24.430 INFO:tasks.workunit.client.0.smithi138.stderr: -77> 2024-09-14T11:35:24.255+0000 7fd66db0c9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:35:24.430 INFO:tasks.workunit.client.0.smithi138.stderr: -76> 2024-09-14T11:35:24.255+0000 7fd66db0c9c0 20 zonegroup default 2024-09-14T11:35:24.430 INFO:tasks.workunit.client.0.smithi138.stderr: -75> 2024-09-14T11:35:24.255+0000 7fd66db0c9c0 20 rados->read ofs=0 len=0 2024-09-14T11:35:24.430 INFO:tasks.workunit.client.0.smithi138.stderr: -74> 2024-09-14T11:35:24.255+0000 7fd66db0c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:35:24.430 INFO:tasks.workunit.client.0.smithi138.stderr: -73> 2024-09-14T11:35:24.255+0000 7fd66db0c9c0 20 rados->read ofs=0 len=0 2024-09-14T11:35:24.430 INFO:tasks.workunit.client.0.smithi138.stderr: -72> 2024-09-14T11:35:24.255+0000 7fd66db0c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:35:24.430 INFO:tasks.workunit.client.0.smithi138.stderr: -71> 2024-09-14T11:35:24.255+0000 7fd66db0c9c0 20 rados->read ofs=0 len=0 2024-09-14T11:35:24.430 INFO:tasks.workunit.client.0.smithi138.stderr: -70> 2024-09-14T11:35:24.259+0000 7fd66db0c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:35:24.430 INFO:tasks.workunit.client.0.smithi138.stderr: -69> 2024-09-14T11:35:24.259+0000 7fd66db0c9c0 20 started sync module instance, tier type = 2024-09-14T11:35:24.430 INFO:tasks.workunit.client.0.smithi138.stderr: -68> 2024-09-14T11:35:24.259+0000 7fd66db0c9c0 20 started zone id=d9e72d30-c60b-4d0d-9267-fdc36392d5ad (name=default) with tier type = 2024-09-14T11:35:24.431 INFO:tasks.workunit.client.0.smithi138.stderr: -67> 2024-09-14T11:35:24.283+0000 7fd66db0c9c0 20 add_watcher() i=0 2024-09-14T11:35:24.431 INFO:tasks.workunit.client.0.smithi138.stderr: -66> 2024-09-14T11:35:24.283+0000 7fd66db0c9c0 20 add_watcher() i=1 2024-09-14T11:35:24.431 INFO:tasks.workunit.client.0.smithi138.stderr: -65> 2024-09-14T11:35:24.283+0000 7fd66db0c9c0 20 add_watcher() i=2 2024-09-14T11:35:24.431 INFO:tasks.workunit.client.0.smithi138.stderr: -64> 2024-09-14T11:35:24.283+0000 7fd66db0c9c0 20 add_watcher() i=3 2024-09-14T11:35:24.431 INFO:tasks.workunit.client.0.smithi138.stderr: -63> 2024-09-14T11:35:24.283+0000 7fd66db0c9c0 20 add_watcher() i=4 2024-09-14T11:35:24.431 INFO:tasks.workunit.client.0.smithi138.stderr: -62> 2024-09-14T11:35:24.283+0000 7fd66db0c9c0 20 add_watcher() i=5 2024-09-14T11:35:24.431 INFO:tasks.workunit.client.0.smithi138.stderr: -61> 2024-09-14T11:35:24.283+0000 7fd66db0c9c0 20 add_watcher() i=6 2024-09-14T11:35:24.431 INFO:tasks.workunit.client.0.smithi138.stderr: -60> 2024-09-14T11:35:24.283+0000 7fd66db0c9c0 20 add_watcher() i=7 2024-09-14T11:35:24.431 INFO:tasks.workunit.client.0.smithi138.stderr: -59> 2024-09-14T11:35:24.283+0000 7fd66db0c9c0 2 all 8 watchers are set, enabling cache 2024-09-14T11:35:24.431 INFO:tasks.workunit.client.0.smithi138.stderr: -58> 2024-09-14T11:35:24.287+0000 7fd66db0c9c0 5 AuthRegistry(0x7ffc065df820) adding auth protocol: cephx 2024-09-14T11:35:24.431 INFO:tasks.workunit.client.0.smithi138.stderr: -57> 2024-09-14T11:35:24.287+0000 7fd66db0c9c0 5 AuthRegistry(0x7ffc065df820) adding auth protocol: cephx 2024-09-14T11:35:24.432 INFO:tasks.workunit.client.0.smithi138.stderr: -56> 2024-09-14T11:35:24.287+0000 7fd66db0c9c0 5 AuthRegistry(0x7ffc065df820) adding auth protocol: cephx 2024-09-14T11:35:24.432 INFO:tasks.workunit.client.0.smithi138.stderr: -55> 2024-09-14T11:35:24.287+0000 7fd66db0c9c0 5 AuthRegistry(0x7ffc065df820) adding con mode: secure 2024-09-14T11:35:24.432 INFO:tasks.workunit.client.0.smithi138.stderr: -54> 2024-09-14T11:35:24.287+0000 7fd66db0c9c0 5 AuthRegistry(0x7ffc065df820) adding con mode: crc 2024-09-14T11:35:24.432 INFO:tasks.workunit.client.0.smithi138.stderr: -53> 2024-09-14T11:35:24.287+0000 7fd66db0c9c0 5 AuthRegistry(0x7ffc065df820) adding con mode: secure 2024-09-14T11:35:24.432 INFO:tasks.workunit.client.0.smithi138.stderr: -52> 2024-09-14T11:35:24.287+0000 7fd66db0c9c0 5 AuthRegistry(0x7ffc065df820) adding con mode: crc 2024-09-14T11:35:24.432 INFO:tasks.workunit.client.0.smithi138.stderr: -51> 2024-09-14T11:35:24.287+0000 7fd66db0c9c0 5 AuthRegistry(0x7ffc065df820) adding con mode: secure 2024-09-14T11:35:24.432 INFO:tasks.workunit.client.0.smithi138.stderr: -50> 2024-09-14T11:35:24.287+0000 7fd66db0c9c0 5 AuthRegistry(0x7ffc065df820) adding con mode: crc 2024-09-14T11:35:24.432 INFO:tasks.workunit.client.0.smithi138.stderr: -49> 2024-09-14T11:35:24.287+0000 7fd66db0c9c0 5 AuthRegistry(0x7ffc065df820) adding con mode: crc 2024-09-14T11:35:24.432 INFO:tasks.workunit.client.0.smithi138.stderr: -48> 2024-09-14T11:35:24.287+0000 7fd66db0c9c0 5 AuthRegistry(0x7ffc065df820) adding con mode: secure 2024-09-14T11:35:24.432 INFO:tasks.workunit.client.0.smithi138.stderr: -47> 2024-09-14T11:35:24.287+0000 7fd66db0c9c0 5 AuthRegistry(0x7ffc065df820) adding con mode: crc 2024-09-14T11:35:24.432 INFO:tasks.workunit.client.0.smithi138.stderr: -46> 2024-09-14T11:35:24.287+0000 7fd66db0c9c0 5 AuthRegistry(0x7ffc065df820) adding con mode: secure 2024-09-14T11:35:24.432 INFO:tasks.workunit.client.0.smithi138.stderr: -45> 2024-09-14T11:35:24.287+0000 7fd66db0c9c0 5 AuthRegistry(0x7ffc065df820) adding con mode: crc 2024-09-14T11:35:24.432 INFO:tasks.workunit.client.0.smithi138.stderr: -44> 2024-09-14T11:35:24.287+0000 7fd66db0c9c0 5 AuthRegistry(0x7ffc065df820) adding con mode: secure 2024-09-14T11:35:24.433 INFO:tasks.workunit.client.0.smithi138.stderr: -43> 2024-09-14T11:35:24.287+0000 7fd521fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:35:24.433 INFO:tasks.workunit.client.0.smithi138.stderr: -42> 2024-09-14T11:35:24.291+0000 7fd66db0c9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:35:24.433 INFO:tasks.workunit.client.0.smithi138.stderr: -41> 2024-09-14T11:35:24.291+0000 7fd66db0c9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:35:24.433 INFO:tasks.workunit.client.0.smithi138.stderr: -40> 2024-09-14T11:35:24.291+0000 7fd66db0c9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:35:24.433 INFO:tasks.workunit.client.0.smithi138.stderr: -39> 2024-09-14T11:35:24.291+0000 7fd66db0c9c0 5 asok(0x55ef2e38dd90) register_command cache list hook 0x55ef2e63a6f0 2024-09-14T11:35:24.433 INFO:tasks.workunit.client.0.smithi138.stderr: -38> 2024-09-14T11:35:24.291+0000 7fd66db0c9c0 5 asok(0x55ef2e38dd90) register_command cache inspect hook 0x55ef2e63a6f0 2024-09-14T11:35:24.433 INFO:tasks.workunit.client.0.smithi138.stderr: -37> 2024-09-14T11:35:24.291+0000 7fd66db0c9c0 5 asok(0x55ef2e38dd90) register_command cache erase hook 0x55ef2e63a6f0 2024-09-14T11:35:24.433 INFO:tasks.workunit.client.0.smithi138.stderr: -36> 2024-09-14T11:35:24.291+0000 7fd66db0c9c0 5 asok(0x55ef2e38dd90) register_command cache zap hook 0x55ef2e63a6f0 2024-09-14T11:35:24.433 INFO:tasks.workunit.client.0.smithi138.stderr: -35> 2024-09-14T11:35:24.291+0000 7fd66db0c9c0 5 note: GC not initialized 2024-09-14T11:35:24.433 INFO:tasks.workunit.client.0.smithi138.stderr: -34> 2024-09-14T11:35:24.291+0000 7fd520fe1640 20 reqs_thread_entry: start 2024-09-14T11:35:24.433 INFO:tasks.workunit.client.0.smithi138.stderr: -33> 2024-09-14T11:35:24.291+0000 7fd66db0c9c0 5 asok(0x55ef2e38dd90) register_command sync trace show hook 0x7fd66400c040 2024-09-14T11:35:24.433 INFO:tasks.workunit.client.0.smithi138.stderr: -32> 2024-09-14T11:35:24.291+0000 7fd66db0c9c0 5 asok(0x55ef2e38dd90) register_command sync trace history hook 0x7fd66400c040 2024-09-14T11:35:24.433 INFO:tasks.workunit.client.0.smithi138.stderr: -31> 2024-09-14T11:35:24.291+0000 7fd66db0c9c0 5 asok(0x55ef2e38dd90) register_command sync trace active hook 0x7fd66400c040 2024-09-14T11:35:24.433 INFO:tasks.workunit.client.0.smithi138.stderr: -30> 2024-09-14T11:35:24.291+0000 7fd66db0c9c0 5 asok(0x55ef2e38dd90) register_command sync trace active_short hook 0x7fd66400c040 2024-09-14T11:35:24.434 INFO:tasks.workunit.client.0.smithi138.stderr: -29> 2024-09-14T11:35:24.291+0000 7fd66db0c9c0 20 init_complete bucket index max shards: 11 2024-09-14T11:35:24.434 INFO:tasks.workunit.client.0.smithi138.stderr: -28> 2024-09-14T11:35:24.291+0000 7fd66db0c9c0 20 Filter name: none 2024-09-14T11:35:24.434 INFO:tasks.workunit.client.0.smithi138.stderr: -27> 2024-09-14T11:35:24.291+0000 7fd49a7fc640 20 reqs_thread_entry: start 2024-09-14T11:35:24.434 INFO:tasks.workunit.client.0.smithi138.stderr: -26> 2024-09-14T11:35:24.291+0000 7fd66db0c9c0 10 cache get: name=default.rgw.meta+root+abort-at-trim-reshard-log-entries : miss 2024-09-14T11:35:24.434 INFO:tasks.workunit.client.0.smithi138.stderr: -25> 2024-09-14T11:35:24.291+0000 7fd66db0c9c0 20 rados->read ofs=0 len=0 2024-09-14T11:35:24.434 INFO:tasks.workunit.client.0.smithi138.stderr: -24> 2024-09-14T11:35:24.291+0000 7fd66db0c9c0 20 rados_obj.operate() r=0 bl.length=201 2024-09-14T11:35:24.434 INFO:tasks.workunit.client.0.smithi138.stderr: -23> 2024-09-14T11:35:24.291+0000 7fd66db0c9c0 10 cache put: name=default.rgw.meta+root+abort-at-trim-reshard-log-entries info.flags=0x11 2024-09-14T11:35:24.434 INFO:tasks.workunit.client.0.smithi138.stderr: -22> 2024-09-14T11:35:24.291+0000 7fd66db0c9c0 10 adding default.rgw.meta+root+abort-at-trim-reshard-log-entries to cache LRU end 2024-09-14T11:35:24.434 INFO:tasks.workunit.client.0.smithi138.stderr: -21> 2024-09-14T11:35:24.291+0000 7fd66db0c9c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.27 : miss 2024-09-14T11:35:24.434 INFO:tasks.workunit.client.0.smithi138.stderr: -20> 2024-09-14T11:35:24.291+0000 7fd66db0c9c0 20 rados->read ofs=0 len=0 2024-09-14T11:35:24.434 INFO:tasks.workunit.client.0.smithi138.stderr: -19> 2024-09-14T11:35:24.295+0000 7fd66db0c9c0 20 rados_obj.operate() r=0 bl.length=423 2024-09-14T11:35:24.434 INFO:tasks.workunit.client.0.smithi138.stderr: -18> 2024-09-14T11:35:24.295+0000 7fd66db0c9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.27 info.flags=0x17 2024-09-14T11:35:24.434 INFO:tasks.workunit.client.0.smithi138.stderr: -17> 2024-09-14T11:35:24.295+0000 7fd66db0c9c0 10 adding default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.27 to cache LRU end 2024-09-14T11:35:24.434 INFO:tasks.workunit.client.0.smithi138.stderr: -16> 2024-09-14T11:35:24.295+0000 7fd66db0c9c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:35:24.435 INFO:tasks.workunit.client.0.smithi138.stderr: -15> 2024-09-14T11:35:24.295+0000 7fd66db0c9c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:35:24.435 INFO:tasks.workunit.client.0.smithi138.stderr: -14> 2024-09-14T11:35:24.295+0000 7fd66db0c9c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.27 2024-09-14T11:35:24.435 INFO:tasks.workunit.client.0.smithi138.stderr: -13> 2024-09-14T11:35:24.303+0000 7fd66db0c9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.27 info.flags=0x17 2024-09-14T11:35:24.435 INFO:tasks.workunit.client.0.smithi138.stderr: -12> 2024-09-14T11:35:24.303+0000 7fd66db0c9c0 10 moving default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.27 to cache LRU end 2024-09-14T11:35:24.435 INFO:tasks.workunit.client.0.smithi138.stderr: -11> 2024-09-14T11:35:24.303+0000 7fd66db0c9c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:35:24.435 INFO:tasks.workunit.client.0.smithi138.stderr: -10> 2024-09-14T11:35:24.303+0000 7fd66db0c9c0 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-trim-reshard-log-entries:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.27, ofs0, ns] 2024-09-14T11:35:24.435 INFO:tasks.workunit.client.0.smithi138.stderr: -9> 2024-09-14T11:35:24.303+0000 7fd54effd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366221 cookie 94485764207776 notifier 6801 bl.length()=939 2024-09-14T11:35:24.435 INFO:tasks.workunit.client.0.smithi138.stderr: -8> 2024-09-14T11:35:24.303+0000 7fd54effd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.27 info.flags=0x17 2024-09-14T11:35:24.435 INFO:tasks.workunit.client.0.smithi138.stderr: -7> 2024-09-14T11:35:24.303+0000 7fd54effd640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.27 to cache LRU end 2024-09-14T11:35:24.435 INFO:tasks.workunit.client.0.smithi138.stderr: -6> 2024-09-14T11:35:24.303+0000 7fd54effd640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:35:24.435 INFO:tasks.workunit.client.0.smithi138.stderr: -5> 2024-09-14T11:35:24.307+0000 7fd66db0c9c0 20 handle_bi_update(): bucket=:abort-at-trim-reshard-log-entries[d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.27]): orig_sources= new_sources= 2024-09-14T11:35:24.435 INFO:tasks.workunit.client.0.smithi138.stderr: -4> 2024-09-14T11:35:24.307+0000 7fd66db0c9c0 20 handle_bi_update(): bucket=:abort-at-trim-reshard-log-entries[d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.27]): potential sources added=[] removed=[] 2024-09-14T11:35:24.435 INFO:tasks.workunit.client.0.smithi138.stderr: -3> 2024-09-14T11:35:24.307+0000 7fd66db0c9c0 20 handle_bi_update(): bucket=:abort-at-trim-reshard-log-entries[d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.27]): orig_dests= new_dests= 2024-09-14T11:35:24.436 INFO:tasks.workunit.client.0.smithi138.stderr: -2> 2024-09-14T11:35:24.307+0000 7fd66db0c9c0 20 handle_bi_update(): bucket=:abort-at-trim-reshard-log-entries[d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.27]): potential dests added=[] removed=[] 2024-09-14T11:35:24.436 INFO:tasks.workunit.client.0.smithi138.stderr: -1> 2024-09-14T11:35:24.307+0000 7fd66db0c9c0 -1 ./src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7fd66db0c9c0 time 2024-09-14T11:35:24.310908+0000 2024-09-14T11:35:24.436 INFO:tasks.workunit.client.0.smithi138.stderr:./src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-14T11:35:24.436 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-14T11:35:24.436 INFO:tasks.workunit.client.0.smithi138.stderr: ceph version 19.3.0-4907-ga2782315 (a2782315255a3e7d5f6cdc9eb35785187ff6ddf8) squid (dev) 2024-09-14T11:35:24.436 INFO:tasks.workunit.client.0.smithi138.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x121) [0x7fd6713e62eb] 2024-09-14T11:35:24.436 INFO:tasks.workunit.client.0.smithi138.stderr: 2: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7fd6713e649f] 2024-09-14T11:35:24.436 INFO:tasks.workunit.client.0.smithi138.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55ef2c6fcc01] 2024-09-14T11:35:24.436 INFO:tasks.workunit.client.0.smithi138.stderr: 4: radosgw-admin(+0x14231ee) [0x55ef2d15b1ee] 2024-09-14T11:35:24.436 INFO:tasks.workunit.client.0.smithi138.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x55ef2c711ecd] 2024-09-14T11:35:24.436 INFO:tasks.workunit.client.0.smithi138.stderr: 6: main() 2024-09-14T11:35:24.436 INFO:tasks.workunit.client.0.smithi138.stderr: 7: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7fd67024cd90] 2024-09-14T11:35:24.437 INFO:tasks.workunit.client.0.smithi138.stderr: 8: __libc_start_main() 2024-09-14T11:35:24.437 INFO:tasks.workunit.client.0.smithi138.stderr: 9: _start() 2024-09-14T11:35:24.437 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-14T11:35:24.437 INFO:tasks.workunit.client.0.smithi138.stderr: 0> 2024-09-14T11:35:24.311+0000 7fd66db0c9c0 -1 *** Caught signal (Aborted) ** 2024-09-14T11:35:24.437 INFO:tasks.workunit.client.0.smithi138.stderr: in thread 7fd66db0c9c0 thread_name:radosgw-admin 2024-09-14T11:35:24.437 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-14T11:35:24.437 INFO:tasks.workunit.client.0.smithi138.stderr: ceph version 19.3.0-4907-ga2782315 (a2782315255a3e7d5f6cdc9eb35785187ff6ddf8) squid (dev) 2024-09-14T11:35:24.437 INFO:tasks.workunit.client.0.smithi138.stderr: 1: /lib/x86_64-linux-gnu/libc.so.6(+0x42520) [0x7fd670265520] 2024-09-14T11:35:24.437 INFO:tasks.workunit.client.0.smithi138.stderr: 2: pthread_kill() 2024-09-14T11:35:24.437 INFO:tasks.workunit.client.0.smithi138.stderr: 3: raise() 2024-09-14T11:35:24.437 INFO:tasks.workunit.client.0.smithi138.stderr: 4: abort() 2024-09-14T11:35:24.437 INFO:tasks.workunit.client.0.smithi138.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x17b) [0x7fd6713e6345] 2024-09-14T11:35:24.437 INFO:tasks.workunit.client.0.smithi138.stderr: 6: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7fd6713e649f] 2024-09-14T11:35:24.438 INFO:tasks.workunit.client.0.smithi138.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55ef2c6fcc01] 2024-09-14T11:35:24.438 INFO:tasks.workunit.client.0.smithi138.stderr: 8: radosgw-admin(+0x14231ee) [0x55ef2d15b1ee] 2024-09-14T11:35:24.438 INFO:tasks.workunit.client.0.smithi138.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x55ef2c711ecd] 2024-09-14T11:35:24.438 INFO:tasks.workunit.client.0.smithi138.stderr: 10: main() 2024-09-14T11:35:24.438 INFO:tasks.workunit.client.0.smithi138.stderr: 11: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7fd67024cd90] 2024-09-14T11:35:24.438 INFO:tasks.workunit.client.0.smithi138.stderr: 12: __libc_start_main() 2024-09-14T11:35:24.438 INFO:tasks.workunit.client.0.smithi138.stderr: 13: _start() 2024-09-14T11:35:24.438 INFO:tasks.workunit.client.0.smithi138.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-14T11:35:24.438 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-14T11:35:24.438 INFO:tasks.workunit.client.0.smithi138.stderr:--- logging levels --- 2024-09-14T11:35:24.438 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 none 2024-09-14T11:35:24.438 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 1 lockdep 2024-09-14T11:35:24.438 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 1 context 2024-09-14T11:35:24.439 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 1 crush 2024-09-14T11:35:24.439 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 mds 2024-09-14T11:35:24.439 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 mds_balancer 2024-09-14T11:35:24.439 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 mds_locker 2024-09-14T11:35:24.439 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 mds_log 2024-09-14T11:35:24.439 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 mds_log_expire 2024-09-14T11:35:24.439 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 mds_migrator 2024-09-14T11:35:24.439 INFO:tasks.workunit.client.0.smithi138.stderr: 3/ 5 mds_quiesce 2024-09-14T11:35:24.439 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 1 buffer 2024-09-14T11:35:24.439 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 1 timer 2024-09-14T11:35:24.439 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 1 filer 2024-09-14T11:35:24.439 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 1 striper 2024-09-14T11:35:24.440 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 1 objecter 2024-09-14T11:35:24.440 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 rados 2024-09-14T11:35:24.440 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 rbd 2024-09-14T11:35:24.440 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 rbd_mirror 2024-09-14T11:35:24.440 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 rbd_replay 2024-09-14T11:35:24.440 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 rbd_pwl 2024-09-14T11:35:24.440 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 journaler 2024-09-14T11:35:24.440 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 objectcacher 2024-09-14T11:35:24.440 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 immutable_obj_cache 2024-09-14T11:35:24.440 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 client 2024-09-14T11:35:24.441 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 osd 2024-09-14T11:35:24.441 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 optracker 2024-09-14T11:35:24.441 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 objclass 2024-09-14T11:35:24.441 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 3 filestore 2024-09-14T11:35:24.441 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 3 journal 2024-09-14T11:35:24.441 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 0 ms 2024-09-14T11:35:24.441 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 mon 2024-09-14T11:35:24.441 INFO:tasks.workunit.client.0.smithi138.stderr: 0/10 monc 2024-09-14T11:35:24.441 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 paxos 2024-09-14T11:35:24.441 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 tp 2024-09-14T11:35:24.441 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 auth 2024-09-14T11:35:24.441 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 crypto 2024-09-14T11:35:24.441 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 1 finisher 2024-09-14T11:35:24.441 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 1 reserver 2024-09-14T11:35:24.442 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 heartbeatmap 2024-09-14T11:35:24.442 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 perfcounter 2024-09-14T11:35:24.442 INFO:tasks.workunit.client.0.smithi138.stderr: 20/20 rgw 2024-09-14T11:35:24.442 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 rgw_sync 2024-09-14T11:35:24.442 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 rgw_datacache 2024-09-14T11:35:24.442 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 rgw_access 2024-09-14T11:35:24.442 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 rgw_dbstore 2024-09-14T11:35:24.442 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 rgw_flight 2024-09-14T11:35:24.442 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 rgw_lifecycle 2024-09-14T11:35:24.442 INFO:tasks.workunit.client.0.smithi138.stderr: 20/20 rgw_notification 2024-09-14T11:35:24.442 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 javaclient 2024-09-14T11:35:24.442 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 asok 2024-09-14T11:35:24.442 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 1 throttle 2024-09-14T11:35:24.442 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 0 refs 2024-09-14T11:35:24.442 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 compressor 2024-09-14T11:35:24.442 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 bluestore 2024-09-14T11:35:24.443 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 bluefs 2024-09-14T11:35:24.443 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 3 bdev 2024-09-14T11:35:24.443 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 kstore 2024-09-14T11:35:24.443 INFO:tasks.workunit.client.0.smithi138.stderr: 4/ 5 rocksdb 2024-09-14T11:35:24.443 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 fuse 2024-09-14T11:35:24.443 INFO:tasks.workunit.client.0.smithi138.stderr: 2/ 5 mgr 2024-09-14T11:35:24.443 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 mgrc 2024-09-14T11:35:24.443 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 dpdk 2024-09-14T11:35:24.443 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 eventtrace 2024-09-14T11:35:24.443 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 prioritycache 2024-09-14T11:35:24.443 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 test 2024-09-14T11:35:24.443 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 cephfs_mirror 2024-09-14T11:35:24.443 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 cephsqlite 2024-09-14T11:35:24.443 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 crimson_interrupt 2024-09-14T11:35:24.444 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 seastore 2024-09-14T11:35:24.444 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 seastore_onode 2024-09-14T11:35:24.444 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 seastore_odata 2024-09-14T11:35:24.444 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 seastore_omap 2024-09-14T11:35:24.444 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 seastore_tm 2024-09-14T11:35:24.444 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 seastore_t 2024-09-14T11:35:24.444 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 seastore_cleaner 2024-09-14T11:35:24.444 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 seastore_epm 2024-09-14T11:35:24.444 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 seastore_lba 2024-09-14T11:35:24.444 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 seastore_fixedkv_tree 2024-09-14T11:35:24.444 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 seastore_cache 2024-09-14T11:35:24.444 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 seastore_journal 2024-09-14T11:35:24.444 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 seastore_device 2024-09-14T11:35:24.444 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 seastore_backref 2024-09-14T11:35:24.445 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 alienstore 2024-09-14T11:35:24.445 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 mclock 2024-09-14T11:35:24.445 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 cyanstore 2024-09-14T11:35:24.445 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 ceph_exporter 2024-09-14T11:35:24.445 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 memstore 2024-09-14T11:35:24.445 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 trace 2024-09-14T11:35:24.445 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 ceph_dedup 2024-09-14T11:35:24.445 INFO:tasks.workunit.client.0.smithi138.stderr: -2/-2 (syslog threshold) 2024-09-14T11:35:24.445 INFO:tasks.workunit.client.0.smithi138.stderr: 99/99 (stderr threshold) 2024-09-14T11:35:24.445 INFO:tasks.workunit.client.0.smithi138.stderr:--- pthread ID / name mapping for recent threads --- 2024-09-14T11:35:24.445 INFO:tasks.workunit.client.0.smithi138.stderr: 7fd49a7fc640 / http_manager 2024-09-14T11:35:24.445 INFO:tasks.workunit.client.0.smithi138.stderr: 7fd520fe1640 / http_manager 2024-09-14T11:35:24.445 INFO:tasks.workunit.client.0.smithi138.stderr: 7fd521fe3640 / rgw_dt_lg_renew 2024-09-14T11:35:24.445 INFO:tasks.workunit.client.0.smithi138.stderr: 7fd54d7fa640 / ms_dispatch 2024-09-14T11:35:24.445 INFO:tasks.workunit.client.0.smithi138.stderr: 7fd54effd640 / io_context_pool 2024-09-14T11:35:24.446 INFO:tasks.workunit.client.0.smithi138.stderr: 7fd555602640 / ms_dispatch 2024-09-14T11:35:24.446 INFO:tasks.workunit.client.0.smithi138.stderr: 7fd557e07640 / ms_dispatch 2024-09-14T11:35:24.446 INFO:tasks.workunit.client.0.smithi138.stderr: 7fd55960a640 / io_context_pool 2024-09-14T11:35:24.446 INFO:tasks.workunit.client.0.smithi138.stderr: 7fd66ae11640 / msgr-worker-2 2024-09-14T11:35:24.446 INFO:tasks.workunit.client.0.smithi138.stderr: 7fd66b612640 / msgr-worker-1 2024-09-14T11:35:24.446 INFO:tasks.workunit.client.0.smithi138.stderr: 7fd66be13640 / msgr-worker-0 2024-09-14T11:35:24.446 INFO:tasks.workunit.client.0.smithi138.stderr: 7fd66c614640 / io_context_pool 2024-09-14T11:35:24.446 INFO:tasks.workunit.client.0.smithi138.stderr: 7fd66db0c9c0 / radosgw-admin 2024-09-14T11:35:24.446 INFO:tasks.workunit.client.0.smithi138.stderr: max_recent 500 2024-09-14T11:35:24.446 INFO:tasks.workunit.client.0.smithi138.stderr: max_new 1000 2024-09-14T11:35:24.446 INFO:tasks.workunit.client.0.smithi138.stderr: log_file /var/lib/ceph/crash/2024-09-14T11:35:24.313510Z_ae02c924-a253-44f2-8d86-73d1840338dc/log 2024-09-14T11:35:24.446 INFO:tasks.workunit.client.0.smithi138.stderr:--- end dump of recent events --- 2024-09-14T11:35:24.446 INFO:tasks.workunit.client.0.smithi138.stderr:Aborted 2024-09-14T11:35:24.446 INFO:tasks.workunit.client.0.smithi138.stderr:radosgw-admin bucket stats --bucket abort-at-trim-reshard-log-entries 2024-09-14T11:35:24.447 INFO:tasks.workunit.client.0.smithi138.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:35:24.447 INFO:tasks.workunit.client.0.smithi138.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:35:24.601 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:24.603+0000 7f3f70bcb9c0 20 rados->read ofs=0 len=0 2024-09-14T11:35:24.603 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:24.607+0000 7f3f70bcb9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:35:24.603 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:24.607+0000 7f3f70bcb9c0 20 realm 2024-09-14T11:35:24.603 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:24.607+0000 7f3f70bcb9c0 20 rados->read ofs=0 len=0 2024-09-14T11:35:24.603 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:24.607+0000 7f3f70bcb9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:35:24.604 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:24.607+0000 7f3f70bcb9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:35:24.604 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:24.607+0000 7f3f70bcb9c0 20 rados->read ofs=0 len=0 2024-09-14T11:35:24.604 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:24.607+0000 7f3f70bcb9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:35:24.604 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:24.607+0000 7f3f70bcb9c0 20 rados->read ofs=0 len=0 2024-09-14T11:35:24.605 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:24.607+0000 7f3f70bcb9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:35:24.605 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:24.607+0000 7f3f70bcb9c0 20 rados->read ofs=0 len=0 2024-09-14T11:35:24.606 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:24.607+0000 7f3f70bcb9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:35:24.606 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:24.607+0000 7f3f70bcb9c0 20 searching for the correct realm 2024-09-14T11:35:24.609 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:24.611+0000 7f3f6eed2640 0 -- 172.21.15.138:0/514254 >> [v2:172.21.15.154:6824/416768175,v1:172.21.15.154:6825/416768175] conn(0x7f3f68033b90 msgr2=0x7f3f68011960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-14T11:35:24.824 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:24.827+0000 7f3f6ded0640 0 -- 172.21.15.138:0/514254 >> [v2:172.21.15.138:6816/326481658,v1:172.21.15.138:6817/326481658] conn(0x7f3f6804c900 msgr2=0x7f3f6802a410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:35:25.041 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:25.043+0000 7f3f70bcb9c0 20 RGWRados::pool_iterate: got zone_info.d9e72d30-c60b-4d0d-9267-fdc36392d5ad 2024-09-14T11:35:25.041 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:25.043+0000 7f3f70bcb9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:35:25.041 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:25.043+0000 7f3f70bcb9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:35:25.041 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:25.043+0000 7f3f70bcb9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:35:25.041 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:25.043+0000 7f3f70bcb9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:35:25.041 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:25.043+0000 7f3f70bcb9c0 20 RGWRados::pool_iterate: got zonegroup_info.65ab941b-da8c-4160-94fb-3672b069d44f 2024-09-14T11:35:25.041 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:25.043+0000 7f3f70bcb9c0 20 rados->read ofs=0 len=0 2024-09-14T11:35:25.042 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:25.043+0000 7f3f70bcb9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:35:25.042 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:25.043+0000 7f3f70bcb9c0 20 rados->read ofs=0 len=0 2024-09-14T11:35:25.042 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:25.043+0000 7f3f70bcb9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:35:25.042 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:25.043+0000 7f3f70bcb9c0 20 rados->read ofs=0 len=0 2024-09-14T11:35:25.043 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:25.047+0000 7f3f70bcb9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:35:25.043 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:25.047+0000 7f3f70bcb9c0 20 zone default found 2024-09-14T11:35:25.044 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:25.047+0000 7f3f70bcb9c0 4 Realm: () 2024-09-14T11:35:25.044 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:25.047+0000 7f3f70bcb9c0 4 ZoneGroup: default (65ab941b-da8c-4160-94fb-3672b069d44f) 2024-09-14T11:35:25.044 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:25.047+0000 7f3f70bcb9c0 4 Zone: default (d9e72d30-c60b-4d0d-9267-fdc36392d5ad) 2024-09-14T11:35:25.044 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:25.047+0000 7f3f70bcb9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:35:25.044 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:25.047+0000 7f3f70bcb9c0 20 zonegroup default 2024-09-14T11:35:25.044 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:25.047+0000 7f3f70bcb9c0 20 rados->read ofs=0 len=0 2024-09-14T11:35:25.044 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:25.047+0000 7f3f70bcb9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:35:25.044 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:25.047+0000 7f3f70bcb9c0 20 rados->read ofs=0 len=0 2024-09-14T11:35:25.045 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:25.047+0000 7f3f70bcb9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:35:25.045 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:25.047+0000 7f3f70bcb9c0 20 rados->read ofs=0 len=0 2024-09-14T11:35:25.046 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:25.047+0000 7f3f70bcb9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:35:25.046 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:25.047+0000 7f3f70bcb9c0 20 started sync module instance, tier type = 2024-09-14T11:35:25.046 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:25.047+0000 7f3f70bcb9c0 20 started zone id=d9e72d30-c60b-4d0d-9267-fdc36392d5ad (name=default) with tier type = 2024-09-14T11:35:25.068 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:25.071+0000 7f3f70bcb9c0 20 add_watcher() i=0 2024-09-14T11:35:25.068 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:25.071+0000 7f3f70bcb9c0 20 add_watcher() i=1 2024-09-14T11:35:25.068 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:25.071+0000 7f3f70bcb9c0 20 add_watcher() i=2 2024-09-14T11:35:25.068 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:25.071+0000 7f3f70bcb9c0 20 add_watcher() i=3 2024-09-14T11:35:25.068 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:25.071+0000 7f3f70bcb9c0 20 add_watcher() i=4 2024-09-14T11:35:25.068 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:25.071+0000 7f3f70bcb9c0 20 add_watcher() i=5 2024-09-14T11:35:25.068 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:25.071+0000 7f3f70bcb9c0 20 add_watcher() i=6 2024-09-14T11:35:25.070 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:25.071+0000 7f3f70bcb9c0 20 add_watcher() i=7 2024-09-14T11:35:25.070 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:25.071+0000 7f3f70bcb9c0 2 all 8 watchers are set, enabling cache 2024-09-14T11:35:25.074 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:25.075+0000 7f3e24fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:35:25.074 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:25.079+0000 7f3f70bcb9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:35:25.075 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:25.079+0000 7f3f70bcb9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:35:25.075 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:25.079+0000 7f3f70bcb9c0 5 note: GC not initialized 2024-09-14T11:35:25.075 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:25.079+0000 7f3d9f7fe640 20 reqs_thread_entry: start 2024-09-14T11:35:25.076 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:25.079+0000 7f3f70bcb9c0 20 init_complete bucket index max shards: 11 2024-09-14T11:35:25.076 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:25.079+0000 7f3f70bcb9c0 20 Filter name: none 2024-09-14T11:35:25.076 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:25.079+0000 7f3d9d7fa640 20 reqs_thread_entry: start 2024-09-14T11:35:25.076 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:25.079+0000 7f3f70bcb9c0 20 rados->read ofs=0 len=0 2024-09-14T11:35:25.077 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:25.079+0000 7f3f70bcb9c0 20 rados_obj.operate() r=0 bl.length=201 2024-09-14T11:35:25.077 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:25.079+0000 7f3f70bcb9c0 20 rados->read ofs=0 len=0 2024-09-14T11:35:25.078 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:25.079+0000 7f3f70bcb9c0 20 rados_obj.operate() r=0 bl.length=455 2024-09-14T11:35:25.078 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:25.079+0000 7f3f70bcb9c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:35:25.078 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:25.079+0000 7f3f70bcb9c0 20 rados->read ofs=0 len=0 2024-09-14T11:35:25.079 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:25.083+0000 7f3f70bcb9c0 20 rados_obj.operate() r=0 bl.length=201 2024-09-14T11:35:25.079 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:25.083+0000 7f3f70bcb9c0 20 rados->read ofs=0 len=0 2024-09-14T11:35:25.079 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:25.083+0000 7f3f70bcb9c0 20 rados_obj.operate() r=0 bl.length=455 2024-09-14T11:35:25.079 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:25.083+0000 7f3f70bcb9c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:35:25.083 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:25.087+0000 7f3e24fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:35:25.087 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:25.091+0000 7f3f70bcb9c0 20 remove_watcher() i=0 2024-09-14T11:35:25.088 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:25.091+0000 7f3f70bcb9c0 2 removed watcher, disabling cache 2024-09-14T11:35:25.090 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:25.091+0000 7f3f70bcb9c0 20 remove_watcher() i=1 2024-09-14T11:35:25.092 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:25.095+0000 7f3f70bcb9c0 20 remove_watcher() i=2 2024-09-14T11:35:25.094 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:25.099+0000 7f3f70bcb9c0 20 remove_watcher() i=3 2024-09-14T11:35:25.097 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:25.099+0000 7f3f70bcb9c0 20 remove_watcher() i=4 2024-09-14T11:35:25.100 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:25.099+0000 7f3f70bcb9c0 20 remove_watcher() i=5 2024-09-14T11:35:25.100 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:25.103+0000 7f3f70bcb9c0 20 remove_watcher() i=6 2024-09-14T11:35:25.101 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:25.103+0000 7f3f70bcb9c0 20 remove_watcher() i=7 2024-09-14T11:35:25.119 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-14T11:35:25.119 INFO:tasks.workunit.client.0.smithi138.stderr:BUCKET_STATS: 2024-09-14T11:35:25.119 INFO:tasks.workunit.client.0.smithi138.stderr:bucket: abort-at-trim-reshard-log-entries id: d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.27 num_objects: 20 size_kb: 1 num_shards: 11 2024-09-14T11:35:25.119 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-14T11:35:25.120 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:35:25.120 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-14T11:35:25.159 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:35:25.159 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-14T11:35:25.224 INFO:tasks.workunit.client.0.smithi138.stderr:radosgw-admin bucket reshard --bucket abort-at-trim-reshard-log-entries --num-shards 12 --rgw-reshard-bucket-lock-duration 30 2024-09-14T11:35:25.262 INFO:tasks.workunit.client.0.smithi138.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:35:25.262 INFO:tasks.workunit.client.0.smithi138.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:35:25.306 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:25.307+0000 7fa0932109c0 20 rados->read ofs=0 len=0 2024-09-14T11:35:25.308 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:25.311+0000 7fa0932109c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:35:25.308 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:25.311+0000 7fa0932109c0 20 realm 2024-09-14T11:35:25.308 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:25.311+0000 7fa0932109c0 20 rados->read ofs=0 len=0 2024-09-14T11:35:25.308 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:25.311+0000 7fa0932109c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:35:25.308 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:25.311+0000 7fa0932109c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:35:25.308 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:25.311+0000 7fa0932109c0 20 rados->read ofs=0 len=0 2024-09-14T11:35:25.308 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:25.311+0000 7fa0932109c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:35:25.308 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:25.311+0000 7fa0932109c0 20 rados->read ofs=0 len=0 2024-09-14T11:35:25.309 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:25.311+0000 7fa0932109c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:35:25.310 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:25.311+0000 7fa0932109c0 20 rados->read ofs=0 len=0 2024-09-14T11:35:25.310 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:25.311+0000 7fa0932109c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:35:25.310 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:25.311+0000 7fa0932109c0 20 searching for the correct realm 2024-09-14T11:35:25.314 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:25.315+0000 7fa091517640 0 -- 172.21.15.138:0/2782126187 >> [v2:172.21.15.154:6824/416768175,v1:172.21.15.154:6825/416768175] conn(0x7fa0800e7040 msgr2=0x7fa0800e6920 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:35:25.528 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:25.531+0000 7fa090515640 0 -- 172.21.15.138:0/2782126187 >> [v2:172.21.15.138:6816/326481658,v1:172.21.15.138:6817/326481658] conn(0x7fa0800fa910 msgr2=0x7fa0800c43f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:35:25.746 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:25.747+0000 7fa0932109c0 20 RGWRados::pool_iterate: got zone_info.d9e72d30-c60b-4d0d-9267-fdc36392d5ad 2024-09-14T11:35:25.746 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:25.747+0000 7fa0932109c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:35:25.746 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:25.747+0000 7fa0932109c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:35:25.746 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:25.747+0000 7fa0932109c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:35:25.746 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:25.747+0000 7fa0932109c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:35:25.747 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:25.747+0000 7fa0932109c0 20 RGWRados::pool_iterate: got zonegroup_info.65ab941b-da8c-4160-94fb-3672b069d44f 2024-09-14T11:35:25.747 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:25.747+0000 7fa0932109c0 20 rados->read ofs=0 len=0 2024-09-14T11:35:25.747 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:25.747+0000 7fa0932109c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:35:25.747 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:25.747+0000 7fa0932109c0 20 rados->read ofs=0 len=0 2024-09-14T11:35:25.747 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:25.751+0000 7fa0932109c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:35:25.747 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:25.751+0000 7fa0932109c0 20 rados->read ofs=0 len=0 2024-09-14T11:35:25.748 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:25.751+0000 7fa0932109c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:35:25.748 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:25.751+0000 7fa0932109c0 20 zone default found 2024-09-14T11:35:25.748 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:25.751+0000 7fa0932109c0 4 Realm: () 2024-09-14T11:35:25.748 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:25.751+0000 7fa0932109c0 4 ZoneGroup: default (65ab941b-da8c-4160-94fb-3672b069d44f) 2024-09-14T11:35:25.749 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:25.751+0000 7fa0932109c0 4 Zone: default (d9e72d30-c60b-4d0d-9267-fdc36392d5ad) 2024-09-14T11:35:25.749 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:25.751+0000 7fa0932109c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:35:25.749 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:25.751+0000 7fa0932109c0 20 zonegroup default 2024-09-14T11:35:25.749 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:25.751+0000 7fa0932109c0 20 rados->read ofs=0 len=0 2024-09-14T11:35:25.749 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:25.751+0000 7fa0932109c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:35:25.749 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:25.751+0000 7fa0932109c0 20 rados->read ofs=0 len=0 2024-09-14T11:35:25.750 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:25.751+0000 7fa0932109c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:35:25.750 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:25.751+0000 7fa0932109c0 20 rados->read ofs=0 len=0 2024-09-14T11:35:25.751 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:25.755+0000 7fa0932109c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:35:25.751 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:25.755+0000 7fa0932109c0 20 started sync module instance, tier type = 2024-09-14T11:35:25.751 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:25.755+0000 7fa0932109c0 20 started zone id=d9e72d30-c60b-4d0d-9267-fdc36392d5ad (name=default) with tier type = 2024-09-14T11:35:25.778 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:25.779+0000 7fa0932109c0 20 add_watcher() i=0 2024-09-14T11:35:25.778 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:25.779+0000 7fa0932109c0 20 add_watcher() i=1 2024-09-14T11:35:25.779 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:25.779+0000 7fa0932109c0 20 add_watcher() i=2 2024-09-14T11:35:25.779 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:25.779+0000 7fa0932109c0 20 add_watcher() i=3 2024-09-14T11:35:25.779 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:25.779+0000 7fa0932109c0 20 add_watcher() i=4 2024-09-14T11:35:25.779 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:25.779+0000 7fa0932109c0 20 add_watcher() i=5 2024-09-14T11:35:25.779 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:25.779+0000 7fa0932109c0 20 add_watcher() i=6 2024-09-14T11:35:25.781 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:25.783+0000 7fa0932109c0 20 add_watcher() i=7 2024-09-14T11:35:25.781 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:25.783+0000 7fa0932109c0 2 all 8 watchers are set, enabling cache 2024-09-14T11:35:25.785 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:25.787+0000 7f9f477e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:35:25.786 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:25.787+0000 7fa0932109c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:35:25.786 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:25.787+0000 7fa0932109c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:35:25.786 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:25.787+0000 7fa0932109c0 5 note: GC not initialized 2024-09-14T11:35:25.787 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:25.791+0000 7f9f467e4640 20 reqs_thread_entry: start 2024-09-14T11:35:25.787 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:25.791+0000 7fa0932109c0 20 init_complete bucket index max shards: 11 2024-09-14T11:35:25.788 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:25.791+0000 7fa0932109c0 20 Filter name: none 2024-09-14T11:35:25.788 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:25.791+0000 7f9f3f7fe640 20 reqs_thread_entry: start 2024-09-14T11:35:25.788 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:25.791+0000 7fa0932109c0 10 cache get: name=default.rgw.meta+root+abort-at-trim-reshard-log-entries : miss 2024-09-14T11:35:25.788 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:25.791+0000 7fa0932109c0 20 rados->read ofs=0 len=0 2024-09-14T11:35:25.789 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:25.791+0000 7fa0932109c0 20 rados_obj.operate() r=0 bl.length=201 2024-09-14T11:35:25.790 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:25.791+0000 7fa0932109c0 10 cache put: name=default.rgw.meta+root+abort-at-trim-reshard-log-entries info.flags=0x11 2024-09-14T11:35:25.790 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:25.791+0000 7fa0932109c0 10 adding default.rgw.meta+root+abort-at-trim-reshard-log-entries to cache LRU end 2024-09-14T11:35:25.790 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:25.791+0000 7fa0932109c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.27 : miss 2024-09-14T11:35:25.790 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:25.791+0000 7fa0932109c0 20 rados->read ofs=0 len=0 2024-09-14T11:35:25.790 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:25.791+0000 7fa0932109c0 20 rados_obj.operate() r=0 bl.length=455 2024-09-14T11:35:25.790 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:25.791+0000 7fa0932109c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.27 info.flags=0x17 2024-09-14T11:35:25.790 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:25.791+0000 7fa0932109c0 10 adding default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.27 to cache LRU end 2024-09-14T11:35:25.790 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:25.791+0000 7fa0932109c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:35:25.790 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:25.791+0000 7fa0932109c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:35:25.790 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:25.791+0000 7fa0932109c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.27 2024-09-14T11:35:25.793 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:25.795+0000 7fa0932109c0 0 INFO: RGWReshardLock::lock found lock on abort-at-trim-reshard-log-entries:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.27 to be held by another RGW process; skipping for now 2024-09-14T11:35:25.794 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:25.795+0000 7f9f477e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:35:25.799 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:25.803+0000 7fa0932109c0 20 remove_watcher() i=0 2024-09-14T11:35:25.799 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:25.803+0000 7fa0932109c0 2 removed watcher, disabling cache 2024-09-14T11:35:25.801 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:25.803+0000 7fa0932109c0 20 remove_watcher() i=1 2024-09-14T11:35:25.804 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:25.807+0000 7fa0932109c0 20 remove_watcher() i=2 2024-09-14T11:35:25.806 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:25.807+0000 7fa0932109c0 20 remove_watcher() i=3 2024-09-14T11:35:25.809 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:25.811+0000 7fa0932109c0 20 remove_watcher() i=4 2024-09-14T11:35:25.810 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:25.811+0000 7fa0932109c0 20 remove_watcher() i=5 2024-09-14T11:35:25.813 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:25.815+0000 7fa0932109c0 20 remove_watcher() i=6 2024-09-14T11:35:25.815 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:25.819+0000 7fa0932109c0 20 remove_watcher() i=7 2024-09-14T11:35:25.838 INFO:tasks.workunit.client.0.smithi138.stderr:waiting 30 seconds for reshard lock to expire... 2024-09-14T11:35:55.868 INFO:tasks.workunit.client.0.smithi138.stderr:radosgw-admin bucket reshard --bucket abort-at-trim-reshard-log-entries --num-shards 12 --rgw-reshard-bucket-lock-duration 30 2024-09-14T11:35:55.905 INFO:tasks.workunit.client.0.smithi138.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:35:55.905 INFO:tasks.workunit.client.0.smithi138.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:35:55.952 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:55.954+0000 7fc3d5e7a9c0 20 rados->read ofs=0 len=0 2024-09-14T11:35:55.954 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:55.954+0000 7fc3d5e7a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:35:55.954 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:55.954+0000 7fc3d5e7a9c0 20 realm 2024-09-14T11:35:55.954 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:55.954+0000 7fc3d5e7a9c0 20 rados->read ofs=0 len=0 2024-09-14T11:35:55.954 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:55.954+0000 7fc3d5e7a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:35:55.954 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:55.954+0000 7fc3d5e7a9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:35:55.954 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:55.954+0000 7fc3d5e7a9c0 20 rados->read ofs=0 len=0 2024-09-14T11:35:55.954 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:55.954+0000 7fc3d5e7a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:35:55.954 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:55.954+0000 7fc3d5e7a9c0 20 rados->read ofs=0 len=0 2024-09-14T11:35:55.956 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:55.958+0000 7fc3d5e7a9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:35:55.956 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:55.958+0000 7fc3d5e7a9c0 20 rados->read ofs=0 len=0 2024-09-14T11:35:55.957 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:55.958+0000 7fc3d5e7a9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:35:55.957 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:55.958+0000 7fc3d5e7a9c0 20 searching for the correct realm 2024-09-14T11:35:55.960 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:55.962+0000 7fc3d4181640 0 -- 172.21.15.138:0/3282661717 >> [v2:172.21.15.154:6824/416768175,v1:172.21.15.154:6825/416768175] conn(0x7fc3cc008050 msgr2=0x7fc3cc065320 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-14T11:35:56.176 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:56.178+0000 7fc3d317f640 0 -- 172.21.15.138:0/3282661717 >> [v2:172.21.15.138:6816/326481658,v1:172.21.15.138:6817/326481658] conn(0x7fc3cc06fb50 msgr2=0x7fc3cc080970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-14T11:35:56.394 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:56.394+0000 7fc3d5e7a9c0 20 RGWRados::pool_iterate: got zone_info.d9e72d30-c60b-4d0d-9267-fdc36392d5ad 2024-09-14T11:35:56.394 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:56.394+0000 7fc3d5e7a9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:35:56.394 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:56.394+0000 7fc3d5e7a9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:35:56.394 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:56.394+0000 7fc3d5e7a9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:35:56.395 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:56.394+0000 7fc3d5e7a9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:35:56.395 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:56.394+0000 7fc3d5e7a9c0 20 RGWRados::pool_iterate: got zonegroup_info.65ab941b-da8c-4160-94fb-3672b069d44f 2024-09-14T11:35:56.395 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:56.394+0000 7fc3d5e7a9c0 20 rados->read ofs=0 len=0 2024-09-14T11:35:56.395 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:56.394+0000 7fc3d5e7a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:35:56.395 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:56.394+0000 7fc3d5e7a9c0 20 rados->read ofs=0 len=0 2024-09-14T11:35:56.395 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:56.398+0000 7fc3d5e7a9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:35:56.395 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:56.398+0000 7fc3d5e7a9c0 20 rados->read ofs=0 len=0 2024-09-14T11:35:56.396 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:56.398+0000 7fc3d5e7a9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:35:56.396 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:56.398+0000 7fc3d5e7a9c0 20 zone default found 2024-09-14T11:35:56.396 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:56.398+0000 7fc3d5e7a9c0 4 Realm: () 2024-09-14T11:35:56.396 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:56.398+0000 7fc3d5e7a9c0 4 ZoneGroup: default (65ab941b-da8c-4160-94fb-3672b069d44f) 2024-09-14T11:35:56.396 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:56.398+0000 7fc3d5e7a9c0 4 Zone: default (d9e72d30-c60b-4d0d-9267-fdc36392d5ad) 2024-09-14T11:35:56.396 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:56.398+0000 7fc3d5e7a9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:35:56.396 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:56.398+0000 7fc3d5e7a9c0 20 zonegroup default 2024-09-14T11:35:56.396 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:56.398+0000 7fc3d5e7a9c0 20 rados->read ofs=0 len=0 2024-09-14T11:35:56.397 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:56.398+0000 7fc3d5e7a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:35:56.397 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:56.398+0000 7fc3d5e7a9c0 20 rados->read ofs=0 len=0 2024-09-14T11:35:56.398 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:56.398+0000 7fc3d5e7a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:35:56.398 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:56.398+0000 7fc3d5e7a9c0 20 rados->read ofs=0 len=0 2024-09-14T11:35:56.399 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:56.398+0000 7fc3d5e7a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:35:56.399 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:56.398+0000 7fc3d5e7a9c0 20 started sync module instance, tier type = 2024-09-14T11:35:56.399 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:56.402+0000 7fc3d5e7a9c0 20 started zone id=d9e72d30-c60b-4d0d-9267-fdc36392d5ad (name=default) with tier type = 2024-09-14T11:35:56.428 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:56.430+0000 7fc3d5e7a9c0 20 add_watcher() i=0 2024-09-14T11:35:56.428 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:56.430+0000 7fc3d5e7a9c0 20 add_watcher() i=1 2024-09-14T11:35:56.428 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:56.430+0000 7fc3d5e7a9c0 20 add_watcher() i=2 2024-09-14T11:35:56.428 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:56.430+0000 7fc3d5e7a9c0 20 add_watcher() i=3 2024-09-14T11:35:56.428 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:56.430+0000 7fc3d5e7a9c0 20 add_watcher() i=4 2024-09-14T11:35:56.428 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:56.430+0000 7fc3d5e7a9c0 20 add_watcher() i=5 2024-09-14T11:35:56.429 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:56.430+0000 7fc3d5e7a9c0 20 add_watcher() i=6 2024-09-14T11:35:56.431 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:56.434+0000 7fc3d5e7a9c0 20 add_watcher() i=7 2024-09-14T11:35:56.431 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:56.434+0000 7fc3d5e7a9c0 2 all 8 watchers are set, enabling cache 2024-09-14T11:35:56.437 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:56.438+0000 7fc28a7e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:35:56.438 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:56.438+0000 7fc3d5e7a9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:35:56.438 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:56.438+0000 7fc3d5e7a9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:35:56.438 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:56.438+0000 7fc3d5e7a9c0 5 note: GC not initialized 2024-09-14T11:35:56.439 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:56.442+0000 7fc2897e2640 20 reqs_thread_entry: start 2024-09-14T11:35:56.439 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:56.442+0000 7fc3d5e7a9c0 20 init_complete bucket index max shards: 11 2024-09-14T11:35:56.439 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:56.442+0000 7fc3d5e7a9c0 20 Filter name: none 2024-09-14T11:35:56.440 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:56.442+0000 7fc2827fc640 20 reqs_thread_entry: start 2024-09-14T11:35:56.440 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:56.442+0000 7fc3d5e7a9c0 10 cache get: name=default.rgw.meta+root+abort-at-trim-reshard-log-entries : miss 2024-09-14T11:35:56.440 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:56.442+0000 7fc3d5e7a9c0 20 rados->read ofs=0 len=0 2024-09-14T11:35:56.441 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:56.442+0000 7fc3d5e7a9c0 20 rados_obj.operate() r=0 bl.length=201 2024-09-14T11:35:56.441 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:56.442+0000 7fc3d5e7a9c0 10 cache put: name=default.rgw.meta+root+abort-at-trim-reshard-log-entries info.flags=0x11 2024-09-14T11:35:56.441 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:56.442+0000 7fc3d5e7a9c0 10 adding default.rgw.meta+root+abort-at-trim-reshard-log-entries to cache LRU end 2024-09-14T11:35:56.441 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:56.442+0000 7fc3d5e7a9c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.27 : miss 2024-09-14T11:35:56.441 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:56.442+0000 7fc3d5e7a9c0 20 rados->read ofs=0 len=0 2024-09-14T11:35:56.442 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:56.442+0000 7fc3d5e7a9c0 20 rados_obj.operate() r=0 bl.length=455 2024-09-14T11:35:56.442 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:56.442+0000 7fc3d5e7a9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.27 info.flags=0x17 2024-09-14T11:35:56.442 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:56.442+0000 7fc3d5e7a9c0 10 adding default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.27 to cache LRU end 2024-09-14T11:35:56.442 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:56.442+0000 7fc3d5e7a9c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:35:56.442 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:56.442+0000 7fc3d5e7a9c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:35:56.442 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:56.442+0000 7fc3d5e7a9c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.27 2024-09-14T11:35:56.443 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:56.446+0000 7fc3d5e7a9c0 10 init_target_layout removing existing target index objects from a previous reshard attempt 2024-09-14T11:35:56.457 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:56.458+0000 7fc3d5e7a9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.27 info.flags=0x17 2024-09-14T11:35:56.457 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:56.458+0000 7fc3d5e7a9c0 10 moving default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.27 to cache LRU end 2024-09-14T11:35:56.457 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:56.458+0000 7fc3d5e7a9c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:35:56.457 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:56.458+0000 7fc3d5e7a9c0 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-trim-reshard-log-entries:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.27, ofs0, ns] 2024-09-14T11:35:56.458 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:56.458+0000 7fc2b27fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366222 cookie 94181669561472 notifier 6855 bl.length()=939 2024-09-14T11:35:56.458 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:56.458+0000 7fc2b27fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.27 info.flags=0x17 2024-09-14T11:35:56.458 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:56.458+0000 7fc2b27fc640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.27 to cache LRU end 2024-09-14T11:35:56.458 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:56.458+0000 7fc2b27fc640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:35:56.461 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:56.462+0000 7fc3d5e7a9c0 20 handle_bi_update(): bucket=:abort-at-trim-reshard-log-entries[d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.27]): orig_sources= new_sources= 2024-09-14T11:35:56.461 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:56.462+0000 7fc3d5e7a9c0 20 handle_bi_update(): bucket=:abort-at-trim-reshard-log-entries[d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.27]): potential sources added=[] removed=[] 2024-09-14T11:35:56.461 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:56.462+0000 7fc3d5e7a9c0 20 handle_bi_update(): bucket=:abort-at-trim-reshard-log-entries[d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.27]): orig_dests= new_dests= 2024-09-14T11:35:56.461 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:56.462+0000 7fc3d5e7a9c0 20 handle_bi_update(): bucket=:abort-at-trim-reshard-log-entries[d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.27]): potential dests added=[] removed=[] 2024-09-14T11:35:56.470 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:56.470+0000 7fc3d5e7a9c0 10 bucket_obj is .dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.27.2.0 2024-09-14T11:35:56.470 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:56.470+0000 7fc3d5e7a9c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.27.2.0 2024-09-14T11:35:56.470 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:56.470+0000 7fc3d5e7a9c0 10 bucket_obj is .dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.27.2.1 2024-09-14T11:35:56.470 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:56.470+0000 7fc3d5e7a9c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.27.2.1 2024-09-14T11:35:56.470 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:56.470+0000 7fc3d5e7a9c0 10 bucket_obj is .dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.27.2.2 2024-09-14T11:35:56.470 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:56.470+0000 7fc3d5e7a9c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.27.2.2 2024-09-14T11:35:56.470 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:56.470+0000 7fc3d5e7a9c0 10 bucket_obj is .dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.27.2.3 2024-09-14T11:35:56.470 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:56.470+0000 7fc3d5e7a9c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.27.2.3 2024-09-14T11:35:56.470 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:56.470+0000 7fc3d5e7a9c0 10 bucket_obj is .dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.27.2.4 2024-09-14T11:35:56.470 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:56.470+0000 7fc3d5e7a9c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.27.2.4 2024-09-14T11:35:56.470 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:56.470+0000 7fc3d5e7a9c0 10 bucket_obj is .dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.27.2.5 2024-09-14T11:35:56.470 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:56.470+0000 7fc3d5e7a9c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.27.2.5 2024-09-14T11:35:56.470 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:56.470+0000 7fc3d5e7a9c0 10 bucket_obj is .dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.27.2.6 2024-09-14T11:35:56.471 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:56.470+0000 7fc3d5e7a9c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.27.2.6 2024-09-14T11:35:56.471 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:56.470+0000 7fc3d5e7a9c0 10 bucket_obj is .dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.27.2.7 2024-09-14T11:35:56.471 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:56.470+0000 7fc3d5e7a9c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.27.2.7 2024-09-14T11:35:56.471 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:56.470+0000 7fc3d5e7a9c0 10 bucket_obj is .dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.27.2.8 2024-09-14T11:35:56.471 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:56.470+0000 7fc3d5e7a9c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.27.2.8 2024-09-14T11:35:56.471 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:56.470+0000 7fc3d5e7a9c0 10 bucket_obj is .dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.27.2.9 2024-09-14T11:35:56.471 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:56.470+0000 7fc3d5e7a9c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.27.2.9 2024-09-14T11:35:56.471 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:56.470+0000 7fc3d5e7a9c0 10 bucket_obj is .dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.27.2.10 2024-09-14T11:35:56.471 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:56.470+0000 7fc3d5e7a9c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.27.2.10 2024-09-14T11:35:56.471 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:56.470+0000 7fc3d5e7a9c0 10 bucket_obj is .dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.27.2.11 2024-09-14T11:35:56.471 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:56.470+0000 7fc3d5e7a9c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.27.2.11 2024-09-14T11:35:56.471 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:56.470+0000 7fc3d5e7a9c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.27.0 2024-09-14T11:35:56.471 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:56.470+0000 7fc3d5e7a9c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.27.1 2024-09-14T11:35:56.472 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:56.474+0000 7fc3d5e7a9c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.27.2 2024-09-14T11:35:56.472 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:56.474+0000 7fc3d5e7a9c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.27.3 2024-09-14T11:35:56.472 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:56.474+0000 7fc3d5e7a9c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.27.4 2024-09-14T11:35:56.473 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:56.474+0000 7fc3d5e7a9c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.27.5 2024-09-14T11:35:56.474 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:56.474+0000 7fc3d5e7a9c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.27.6 2024-09-14T11:35:56.474 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:56.478+0000 7fc3d5e7a9c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.27.7 2024-09-14T11:35:56.475 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:56.478+0000 7fc3d5e7a9c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.27.8 2024-09-14T11:35:56.476 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:56.478+0000 7fc3d5e7a9c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.27.9 2024-09-14T11:35:56.477 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:56.478+0000 7fc3d5e7a9c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.27.10 2024-09-14T11:35:56.482 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:56.482+0000 7fc3d5e7a9c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.27 : hit (requested=0x17, cached=0x17) 2024-09-14T11:35:56.482 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:56.482+0000 7fc3d5e7a9c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.27 2024-09-14T11:35:56.484 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:56.486+0000 7fc3d5e7a9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.27 info.flags=0x17 2024-09-14T11:35:56.484 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:56.486+0000 7fc3d5e7a9c0 10 moving default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.27 to cache LRU end 2024-09-14T11:35:56.484 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:56.486+0000 7fc3d5e7a9c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:35:56.484 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:56.486+0000 7fc3d5e7a9c0 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-trim-reshard-log-entries:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.27, ofs0, ns] 2024-09-14T11:35:56.485 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:56.486+0000 7fc2b27fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366223 cookie 94181669561472 notifier 6855 bl.length()=939 2024-09-14T11:35:56.485 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:56.486+0000 7fc2b27fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.27 info.flags=0x17 2024-09-14T11:35:56.485 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:56.486+0000 7fc2b27fc640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.27 to cache LRU end 2024-09-14T11:35:56.485 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:56.486+0000 7fc2b27fc640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:35:56.488 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:56.490+0000 7fc3d5e7a9c0 20 handle_bi_update(): bucket=:abort-at-trim-reshard-log-entries[d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.27]): orig_sources= new_sources= 2024-09-14T11:35:56.488 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:56.490+0000 7fc3d5e7a9c0 20 handle_bi_update(): bucket=:abort-at-trim-reshard-log-entries[d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.27]): potential sources added=[] removed=[] 2024-09-14T11:35:56.488 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:56.490+0000 7fc3d5e7a9c0 20 handle_bi_update(): bucket=:abort-at-trim-reshard-log-entries[d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.27]): orig_dests= new_dests= 2024-09-14T11:35:56.488 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:56.490+0000 7fc3d5e7a9c0 20 handle_bi_update(): bucket=:abort-at-trim-reshard-log-entries[d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.27]): potential dests added=[] removed=[] 2024-09-14T11:35:56.492 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:56.494+0000 7fc3d5e7a9c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.27.0 2024-09-14T11:35:56.492 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:56.494+0000 7fc3d5e7a9c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.27.1 2024-09-14T11:35:56.493 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:56.494+0000 7fc3d5e7a9c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.27.2 2024-09-14T11:35:56.494 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:56.494+0000 7fc3d5e7a9c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.27.3 2024-09-14T11:35:56.495 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:56.498+0000 7fc3d5e7a9c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.27.4 2024-09-14T11:35:56.495 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:56.498+0000 7fc3d5e7a9c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.27.5 2024-09-14T11:35:56.496 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:56.498+0000 7fc3d5e7a9c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.27.6 2024-09-14T11:35:56.496 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:56.498+0000 7fc3d5e7a9c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.27.7 2024-09-14T11:35:56.496 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:56.498+0000 7fc3d5e7a9c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.27.8 2024-09-14T11:35:56.497 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:56.498+0000 7fc3d5e7a9c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.27.9 2024-09-14T11:35:56.497 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:56.498+0000 7fc3d5e7a9c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.27.10 2024-09-14T11:35:56.498 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:56.498+0000 7fc3d5e7a9c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.27 : hit (requested=0x17, cached=0x17) 2024-09-14T11:35:56.498 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:56.498+0000 7fc3d5e7a9c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.27 2024-09-14T11:35:56.500 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:56.502+0000 7fc3d5e7a9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.27 info.flags=0x17 2024-09-14T11:35:56.500 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:56.502+0000 7fc3d5e7a9c0 10 moving default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.27 to cache LRU end 2024-09-14T11:35:56.500 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:56.502+0000 7fc3d5e7a9c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:35:56.500 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:56.502+0000 7fc3d5e7a9c0 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-trim-reshard-log-entries:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.27, ofs0, ns] 2024-09-14T11:35:56.501 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:56.502+0000 7fc2b2ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366224 cookie 94181669561472 notifier 6855 bl.length()=907 2024-09-14T11:35:56.501 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:56.502+0000 7fc2b2ffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.27 info.flags=0x17 2024-09-14T11:35:56.501 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:56.502+0000 7fc2b2ffd640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.27 to cache LRU end 2024-09-14T11:35:56.501 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:56.502+0000 7fc2b2ffd640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:35:56.504 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:56.506+0000 7fc3d5e7a9c0 20 handle_bi_update(): bucket=:abort-at-trim-reshard-log-entries[d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.27]): orig_sources= new_sources= 2024-09-14T11:35:56.504 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:56.506+0000 7fc3d5e7a9c0 20 handle_bi_update(): bucket=:abort-at-trim-reshard-log-entries[d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.27]): potential sources added=[] removed=[] 2024-09-14T11:35:56.504 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:56.506+0000 7fc3d5e7a9c0 20 handle_bi_update(): bucket=:abort-at-trim-reshard-log-entries[d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.27]): orig_dests= new_dests= 2024-09-14T11:35:56.504 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:56.506+0000 7fc3d5e7a9c0 20 handle_bi_update(): bucket=:abort-at-trim-reshard-log-entries[d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.27]): potential dests added=[] removed=[] 2024-09-14T11:35:56.508 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:56.510+0000 7fc3d5e7a9c0 1 execute INFO: reshard of bucket "abort-at-trim-reshard-log-entries" from 11 shards to 12 shards completed successfully 2024-09-14T11:35:56.511 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:56.514+0000 7fc28a7e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:35:56.517 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:56.518+0000 7fc3d5e7a9c0 20 remove_watcher() i=0 2024-09-14T11:35:56.517 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:56.518+0000 7fc3d5e7a9c0 2 removed watcher, disabling cache 2024-09-14T11:35:56.519 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:56.522+0000 7fc3d5e7a9c0 20 remove_watcher() i=1 2024-09-14T11:35:56.521 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:56.522+0000 7fc3d5e7a9c0 20 remove_watcher() i=2 2024-09-14T11:35:56.526 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:56.526+0000 7fc3d5e7a9c0 20 remove_watcher() i=3 2024-09-14T11:35:56.528 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:56.530+0000 7fc3d5e7a9c0 20 remove_watcher() i=4 2024-09-14T11:35:56.529 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:56.530+0000 7fc3d5e7a9c0 20 remove_watcher() i=5 2024-09-14T11:35:56.530 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:56.530+0000 7fc3d5e7a9c0 20 remove_watcher() i=6 2024-09-14T11:35:56.532 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:56.534+0000 7fc3d5e7a9c0 20 remove_watcher() i=7 2024-09-14T11:35:56.546 INFO:tasks.workunit.client.0.smithi138.stderr:radosgw-admin bucket stats --bucket abort-at-trim-reshard-log-entries 2024-09-14T11:35:56.577 INFO:tasks.workunit.client.0.smithi138.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:35:56.577 INFO:tasks.workunit.client.0.smithi138.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:35:56.621 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:56.622+0000 7fb2b84189c0 20 rados->read ofs=0 len=0 2024-09-14T11:35:56.623 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:56.626+0000 7fb2b84189c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:35:56.623 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:56.626+0000 7fb2b84189c0 20 realm 2024-09-14T11:35:56.624 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:56.626+0000 7fb2b84189c0 20 rados->read ofs=0 len=0 2024-09-14T11:35:56.624 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:56.626+0000 7fb2b84189c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:35:56.624 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:56.626+0000 7fb2b84189c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:35:56.624 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:56.626+0000 7fb2b84189c0 20 rados->read ofs=0 len=0 2024-09-14T11:35:56.624 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:56.626+0000 7fb2b84189c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:35:56.624 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:56.626+0000 7fb2b84189c0 20 rados->read ofs=0 len=0 2024-09-14T11:35:56.625 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:56.626+0000 7fb2b84189c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:35:56.625 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:56.626+0000 7fb2b84189c0 20 rados->read ofs=0 len=0 2024-09-14T11:35:56.626 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:56.626+0000 7fb2b84189c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:35:56.626 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:56.626+0000 7fb2b84189c0 20 searching for the correct realm 2024-09-14T11:35:56.629 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:56.630+0000 7fb2b671f640 0 -- 172.21.15.138:0/2423947813 >> [v2:172.21.15.154:6824/416768175,v1:172.21.15.154:6825/416768175] conn(0x7fb2b006ac20 msgr2=0x7fb2b0063d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:35:56.843 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:56.846+0000 7fb2b571d640 0 -- 172.21.15.138:0/2423947813 >> [v2:172.21.15.138:6816/326481658,v1:172.21.15.138:6817/326481658] conn(0x7fb2b008a1f0 msgr2=0x7fb2b0086110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-14T11:35:57.062 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:57.062+0000 7fb2b84189c0 20 RGWRados::pool_iterate: got zone_info.d9e72d30-c60b-4d0d-9267-fdc36392d5ad 2024-09-14T11:35:57.062 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:57.062+0000 7fb2b84189c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:35:57.062 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:57.062+0000 7fb2b84189c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:35:57.062 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:57.062+0000 7fb2b84189c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:35:57.062 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:57.062+0000 7fb2b84189c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:35:57.062 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:57.062+0000 7fb2b84189c0 20 RGWRados::pool_iterate: got zonegroup_info.65ab941b-da8c-4160-94fb-3672b069d44f 2024-09-14T11:35:57.062 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:57.062+0000 7fb2b84189c0 20 rados->read ofs=0 len=0 2024-09-14T11:35:57.062 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:57.062+0000 7fb2b84189c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:35:57.062 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:57.062+0000 7fb2b84189c0 20 rados->read ofs=0 len=0 2024-09-14T11:35:57.063 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:57.066+0000 7fb2b84189c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:35:57.063 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:57.066+0000 7fb2b84189c0 20 rados->read ofs=0 len=0 2024-09-14T11:35:57.064 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:57.066+0000 7fb2b84189c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:35:57.064 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:57.066+0000 7fb2b84189c0 20 zone default found 2024-09-14T11:35:57.064 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:57.066+0000 7fb2b84189c0 4 Realm: () 2024-09-14T11:35:57.065 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:57.066+0000 7fb2b84189c0 4 ZoneGroup: default (65ab941b-da8c-4160-94fb-3672b069d44f) 2024-09-14T11:35:57.065 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:57.066+0000 7fb2b84189c0 4 Zone: default (d9e72d30-c60b-4d0d-9267-fdc36392d5ad) 2024-09-14T11:35:57.065 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:57.066+0000 7fb2b84189c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:35:57.065 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:57.066+0000 7fb2b84189c0 20 zonegroup default 2024-09-14T11:35:57.065 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:57.066+0000 7fb2b84189c0 20 rados->read ofs=0 len=0 2024-09-14T11:35:57.065 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:57.066+0000 7fb2b84189c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:35:57.065 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:57.066+0000 7fb2b84189c0 20 rados->read ofs=0 len=0 2024-09-14T11:35:57.066 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:57.066+0000 7fb2b84189c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:35:57.066 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:57.066+0000 7fb2b84189c0 20 rados->read ofs=0 len=0 2024-09-14T11:35:57.067 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:57.066+0000 7fb2b84189c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:35:57.067 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:57.066+0000 7fb2b84189c0 20 started sync module instance, tier type = 2024-09-14T11:35:57.067 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:57.066+0000 7fb2b84189c0 20 started zone id=d9e72d30-c60b-4d0d-9267-fdc36392d5ad (name=default) with tier type = 2024-09-14T11:35:57.092 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:57.094+0000 7fb2b84189c0 20 add_watcher() i=0 2024-09-14T11:35:57.092 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:57.094+0000 7fb2b84189c0 20 add_watcher() i=1 2024-09-14T11:35:57.092 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:57.094+0000 7fb2b84189c0 20 add_watcher() i=2 2024-09-14T11:35:57.092 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:57.094+0000 7fb2b84189c0 20 add_watcher() i=3 2024-09-14T11:35:57.092 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:57.094+0000 7fb2b84189c0 20 add_watcher() i=4 2024-09-14T11:35:57.092 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:57.094+0000 7fb2b84189c0 20 add_watcher() i=5 2024-09-14T11:35:57.092 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:57.094+0000 7fb2b84189c0 20 add_watcher() i=6 2024-09-14T11:35:57.094 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:57.094+0000 7fb2b84189c0 20 add_watcher() i=7 2024-09-14T11:35:57.094 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:57.094+0000 7fb2b84189c0 2 all 8 watchers are set, enabling cache 2024-09-14T11:35:57.098 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:57.098+0000 7fb1677fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:35:57.099 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:57.102+0000 7fb2b84189c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:35:57.099 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:57.102+0000 7fb2b84189c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:35:57.099 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:57.102+0000 7fb2b84189c0 5 note: GC not initialized 2024-09-14T11:35:57.100 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:57.102+0000 7fb1667fc640 20 reqs_thread_entry: start 2024-09-14T11:35:57.100 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:57.102+0000 7fb2b84189c0 20 init_complete bucket index max shards: 11 2024-09-14T11:35:57.100 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:57.102+0000 7fb2b84189c0 20 Filter name: none 2024-09-14T11:35:57.100 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:57.102+0000 7fb0d7fff640 20 reqs_thread_entry: start 2024-09-14T11:35:57.100 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:57.102+0000 7fb2b84189c0 20 rados->read ofs=0 len=0 2024-09-14T11:35:57.101 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:57.102+0000 7fb2b84189c0 20 rados_obj.operate() r=0 bl.length=201 2024-09-14T11:35:57.102 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:57.102+0000 7fb2b84189c0 20 rados->read ofs=0 len=0 2024-09-14T11:35:57.102 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:57.102+0000 7fb2b84189c0 20 rados_obj.operate() r=0 bl.length=423 2024-09-14T11:35:57.102 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:57.102+0000 7fb2b84189c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:35:57.103 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:57.102+0000 7fb2b84189c0 20 rados->read ofs=0 len=0 2024-09-14T11:35:57.103 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:57.106+0000 7fb2b84189c0 20 rados_obj.operate() r=0 bl.length=201 2024-09-14T11:35:57.104 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:57.106+0000 7fb2b84189c0 20 rados->read ofs=0 len=0 2024-09-14T11:35:57.104 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:57.106+0000 7fb2b84189c0 20 rados_obj.operate() r=0 bl.length=423 2024-09-14T11:35:57.104 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:57.106+0000 7fb2b84189c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:35:57.107 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:57.110+0000 7fb1677fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:35:57.112 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:57.114+0000 7fb2b84189c0 20 remove_watcher() i=0 2024-09-14T11:35:57.112 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:57.114+0000 7fb2b84189c0 2 removed watcher, disabling cache 2024-09-14T11:35:57.114 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:57.114+0000 7fb2b84189c0 20 remove_watcher() i=1 2024-09-14T11:35:57.117 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:57.118+0000 7fb2b84189c0 20 remove_watcher() i=2 2024-09-14T11:35:57.119 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:57.122+0000 7fb2b84189c0 20 remove_watcher() i=3 2024-09-14T11:35:57.121 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:57.122+0000 7fb2b84189c0 20 remove_watcher() i=4 2024-09-14T11:35:57.122 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:57.122+0000 7fb2b84189c0 20 remove_watcher() i=5 2024-09-14T11:35:57.123 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:57.126+0000 7fb2b84189c0 20 remove_watcher() i=6 2024-09-14T11:35:57.125 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:35:57.126+0000 7fb2b84189c0 20 remove_watcher() i=7 2024-09-14T11:35:57.139 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-14T11:35:57.140 INFO:tasks.workunit.client.0.smithi138.stderr:BUCKET_STATS: 2024-09-14T11:35:57.140 INFO:tasks.workunit.client.0.smithi138.stderr:bucket: abort-at-trim-reshard-log-entries id: d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.27 num_objects: 19 size_kb: 1 num_shards: 12 2024-09-14T11:35:57.140 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-14T11:35:57.141 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:35:57.141 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-14T11:35:57.166 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:35:57.166 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-14T11:35:57.614 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:35:57.614 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-14T11:35:57.994 INFO:tasks.workunit.client.0.smithi138.stderr:TEST: reshard bucket with EIO injected at block_writes 2024-09-14T11:35:57.994 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-14T11:35:57.997 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:35:57.997 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-14T11:35:58.133 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:35:58.134 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-14T11:35:58.223 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:35:58.223 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-14T11:35:58.327 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:35:58.327 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-14T11:35:58.423 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:35:58.423 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-14T11:35:58.519 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:35:58.519 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-14T11:35:58.612 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:35:58.612 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-14T11:35:58.711 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:35:58.711 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-14T11:35:58.801 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:35:58.801 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-14T11:35:58.895 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:35:58.895 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-14T11:35:58.989 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:35:58.989 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-14T11:35:59.080 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:35:59.080 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-14T11:35:59.173 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:35:59.173 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-14T11:35:59.271 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:35:59.271 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-14T11:35:59.365 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:35:59.365 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-14T11:35:59.460 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:35:59.460 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-14T11:35:59.551 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:35:59.551 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-14T11:35:59.645 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:35:59.645 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-14T11:35:59.739 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:35:59.740 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-14T11:35:59.832 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:35:59.833 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-14T11:35:59.925 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:35:59.925 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-14T11:36:00.021 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:36:00.021 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-14T11:36:00.086 INFO:tasks.workunit.client.0.smithi138.stderr:radosgw-admin bucket stats --bucket error-at-block-writes 2024-09-14T11:36:00.122 INFO:tasks.workunit.client.0.smithi138.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:36:00.122 INFO:tasks.workunit.client.0.smithi138.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:36:00.167 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:00.170+0000 7feed9a1e9c0 20 rados->read ofs=0 len=0 2024-09-14T11:36:00.169 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:00.170+0000 7feed9a1e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:36:00.169 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:00.170+0000 7feed9a1e9c0 20 realm 2024-09-14T11:36:00.169 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:00.170+0000 7feed9a1e9c0 20 rados->read ofs=0 len=0 2024-09-14T11:36:00.169 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:00.170+0000 7feed9a1e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:36:00.169 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:00.170+0000 7feed9a1e9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:36:00.169 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:00.170+0000 7feed9a1e9c0 20 rados->read ofs=0 len=0 2024-09-14T11:36:00.170 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:00.170+0000 7feed9a1e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:36:00.170 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:00.170+0000 7feed9a1e9c0 20 rados->read ofs=0 len=0 2024-09-14T11:36:00.171 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:00.174+0000 7feed9a1e9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:36:00.171 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:00.174+0000 7feed9a1e9c0 20 rados->read ofs=0 len=0 2024-09-14T11:36:00.172 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:00.174+0000 7feed9a1e9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:36:00.172 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:00.174+0000 7feed9a1e9c0 20 searching for the correct realm 2024-09-14T11:36:00.175 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:00.178+0000 7feed7d25640 0 -- 172.21.15.138:0/3794752719 >> [v2:172.21.15.154:6824/416768175,v1:172.21.15.154:6825/416768175] conn(0x7feed00273d0 msgr2=0x7feed0027830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-14T11:36:00.392 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:00.394+0000 7feed6d23640 0 -- 172.21.15.138:0/3794752719 >> [v2:172.21.15.138:6816/326481658,v1:172.21.15.138:6817/326481658] conn(0x7feed00103e0 msgr2=0x7feed0010860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:36:00.611 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:00.610+0000 7feed9a1e9c0 20 RGWRados::pool_iterate: got zone_info.d9e72d30-c60b-4d0d-9267-fdc36392d5ad 2024-09-14T11:36:00.611 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:00.610+0000 7feed9a1e9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:36:00.611 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:00.610+0000 7feed9a1e9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:36:00.611 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:00.610+0000 7feed9a1e9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:36:00.611 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:00.610+0000 7feed9a1e9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:36:00.611 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:00.610+0000 7feed9a1e9c0 20 RGWRados::pool_iterate: got zonegroup_info.65ab941b-da8c-4160-94fb-3672b069d44f 2024-09-14T11:36:00.611 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:00.614+0000 7feed9a1e9c0 20 rados->read ofs=0 len=0 2024-09-14T11:36:00.612 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:00.614+0000 7feed9a1e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:36:00.612 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:00.614+0000 7feed9a1e9c0 20 rados->read ofs=0 len=0 2024-09-14T11:36:00.612 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:00.614+0000 7feed9a1e9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:36:00.612 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:00.614+0000 7feed9a1e9c0 20 rados->read ofs=0 len=0 2024-09-14T11:36:00.613 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:00.614+0000 7feed9a1e9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:36:00.613 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:00.614+0000 7feed9a1e9c0 20 zone default found 2024-09-14T11:36:00.613 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:00.614+0000 7feed9a1e9c0 4 Realm: () 2024-09-14T11:36:00.613 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:00.614+0000 7feed9a1e9c0 4 ZoneGroup: default (65ab941b-da8c-4160-94fb-3672b069d44f) 2024-09-14T11:36:00.613 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:00.614+0000 7feed9a1e9c0 4 Zone: default (d9e72d30-c60b-4d0d-9267-fdc36392d5ad) 2024-09-14T11:36:00.613 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:00.614+0000 7feed9a1e9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:36:00.613 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:00.614+0000 7feed9a1e9c0 20 zonegroup default 2024-09-14T11:36:00.614 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:00.614+0000 7feed9a1e9c0 20 rados->read ofs=0 len=0 2024-09-14T11:36:00.614 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:00.614+0000 7feed9a1e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:36:00.614 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:00.614+0000 7feed9a1e9c0 20 rados->read ofs=0 len=0 2024-09-14T11:36:00.614 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:00.614+0000 7feed9a1e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:36:00.614 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:00.614+0000 7feed9a1e9c0 20 rados->read ofs=0 len=0 2024-09-14T11:36:00.615 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:00.618+0000 7feed9a1e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:36:00.615 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:00.618+0000 7feed9a1e9c0 20 started sync module instance, tier type = 2024-09-14T11:36:00.615 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:00.618+0000 7feed9a1e9c0 20 started zone id=d9e72d30-c60b-4d0d-9267-fdc36392d5ad (name=default) with tier type = 2024-09-14T11:36:00.636 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:00.638+0000 7feed9a1e9c0 20 add_watcher() i=0 2024-09-14T11:36:00.636 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:00.638+0000 7feed9a1e9c0 20 add_watcher() i=1 2024-09-14T11:36:00.637 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:00.638+0000 7feed9a1e9c0 20 add_watcher() i=2 2024-09-14T11:36:00.637 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:00.638+0000 7feed9a1e9c0 20 add_watcher() i=3 2024-09-14T11:36:00.637 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:00.638+0000 7feed9a1e9c0 20 add_watcher() i=4 2024-09-14T11:36:00.637 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:00.638+0000 7feed9a1e9c0 20 add_watcher() i=5 2024-09-14T11:36:00.637 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:00.638+0000 7feed9a1e9c0 20 add_watcher() i=6 2024-09-14T11:36:00.638 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:00.638+0000 7feed9a1e9c0 20 add_watcher() i=7 2024-09-14T11:36:00.638 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:00.638+0000 7feed9a1e9c0 2 all 8 watchers are set, enabling cache 2024-09-14T11:36:00.642 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:00.642+0000 7fed8dfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:36:00.643 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:00.646+0000 7feed9a1e9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:36:00.643 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:00.646+0000 7feed9a1e9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:36:00.643 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:00.646+0000 7feed9a1e9c0 5 note: GC not initialized 2024-09-14T11:36:00.643 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:00.646+0000 7fed8cfe1640 20 reqs_thread_entry: start 2024-09-14T11:36:00.644 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:00.646+0000 7feed9a1e9c0 20 init_complete bucket index max shards: 11 2024-09-14T11:36:00.644 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:00.646+0000 7feed9a1e9c0 20 Filter name: none 2024-09-14T11:36:00.644 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:00.646+0000 7fed067fc640 20 reqs_thread_entry: start 2024-09-14T11:36:00.644 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:00.646+0000 7feed9a1e9c0 20 rados->read ofs=0 len=0 2024-09-14T11:36:00.645 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:00.646+0000 7feed9a1e9c0 20 rados_obj.operate() r=0 bl.length=189 2024-09-14T11:36:00.645 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:00.646+0000 7feed9a1e9c0 20 rados->read ofs=0 len=0 2024-09-14T11:36:00.647 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:00.646+0000 7feed9a1e9c0 20 rados_obj.operate() r=0 bl.length=411 2024-09-14T11:36:00.647 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:00.646+0000 7feed9a1e9c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:36:00.647 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:00.650+0000 7feed9a1e9c0 20 rados->read ofs=0 len=0 2024-09-14T11:36:00.648 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:00.650+0000 7feed9a1e9c0 20 rados_obj.operate() r=0 bl.length=189 2024-09-14T11:36:00.648 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:00.650+0000 7feed9a1e9c0 20 rados->read ofs=0 len=0 2024-09-14T11:36:00.649 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:00.650+0000 7feed9a1e9c0 20 rados_obj.operate() r=0 bl.length=411 2024-09-14T11:36:00.649 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:00.650+0000 7feed9a1e9c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:36:00.652 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:00.654+0000 7fed8dfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:36:00.656 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:00.658+0000 7feed9a1e9c0 20 remove_watcher() i=0 2024-09-14T11:36:00.656 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:00.658+0000 7feed9a1e9c0 2 removed watcher, disabling cache 2024-09-14T11:36:00.659 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:00.658+0000 7feed9a1e9c0 20 remove_watcher() i=1 2024-09-14T11:36:00.661 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:00.662+0000 7feed9a1e9c0 20 remove_watcher() i=2 2024-09-14T11:36:00.663 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:00.666+0000 7feed9a1e9c0 20 remove_watcher() i=3 2024-09-14T11:36:00.665 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:00.666+0000 7feed9a1e9c0 20 remove_watcher() i=4 2024-09-14T11:36:00.667 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:00.670+0000 7feed9a1e9c0 20 remove_watcher() i=5 2024-09-14T11:36:00.668 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:00.670+0000 7feed9a1e9c0 20 remove_watcher() i=6 2024-09-14T11:36:00.670 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:00.670+0000 7feed9a1e9c0 20 remove_watcher() i=7 2024-09-14T11:36:00.687 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-14T11:36:00.687 INFO:tasks.workunit.client.0.smithi138.stderr:BUCKET_STATS: 2024-09-14T11:36:00.687 INFO:tasks.workunit.client.0.smithi138.stderr:bucket: error-at-block-writes id: d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.28 num_objects: 20 size_kb: 1 num_shards: 11 2024-09-14T11:36:00.687 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-14T11:36:00.687 INFO:tasks.workunit.client.0.smithi138.stderr:radosgw-admin bucket reshard --bucket error-at-block-writes --num-shards 12 --rgw-reshard-bucket-lock-duration 30 --inject-error-at block_writes 2024-09-14T11:36:00.720 INFO:tasks.workunit.client.0.smithi138.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:36:00.720 INFO:tasks.workunit.client.0.smithi138.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:36:00.764 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:00.766+0000 7f045639c9c0 20 rados->read ofs=0 len=0 2024-09-14T11:36:00.766 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:00.766+0000 7f045639c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:36:00.766 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:00.766+0000 7f045639c9c0 20 realm 2024-09-14T11:36:00.766 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:00.766+0000 7f045639c9c0 20 rados->read ofs=0 len=0 2024-09-14T11:36:00.766 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:00.766+0000 7f045639c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:36:00.766 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:00.766+0000 7f045639c9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:36:00.766 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:00.766+0000 7f045639c9c0 20 rados->read ofs=0 len=0 2024-09-14T11:36:00.766 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:00.766+0000 7f045639c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:36:00.766 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:00.766+0000 7f045639c9c0 20 rados->read ofs=0 len=0 2024-09-14T11:36:00.768 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:00.770+0000 7f045639c9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:36:00.768 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:00.770+0000 7f045639c9c0 20 rados->read ofs=0 len=0 2024-09-14T11:36:00.769 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:00.770+0000 7f045639c9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:36:00.769 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:00.770+0000 7f045639c9c0 20 searching for the correct realm 2024-09-14T11:36:00.773 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:00.774+0000 7f0453ea2640 0 -- 172.21.15.138:0/98077584 >> [v2:172.21.15.138:6808/3258321916,v1:172.21.15.138:6809/3258321916] conn(0x55785706d530 msgr2=0x55785706f9f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-14T11:36:00.780 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:00.782+0000 7f04536a1640 0 -- 172.21.15.138:0/98077584 >> [v2:172.21.15.138:6816/326481658,v1:172.21.15.138:6817/326481658] conn(0x7f044c049970 msgr2=0x7f044c00e420 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:36:00.999 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:00.998+0000 7f045639c9c0 20 RGWRados::pool_iterate: got zone_info.d9e72d30-c60b-4d0d-9267-fdc36392d5ad 2024-09-14T11:36:00.999 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:00.998+0000 7f045639c9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:36:00.999 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:00.998+0000 7f045639c9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:36:00.999 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:00.998+0000 7f045639c9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:36:00.999 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:00.998+0000 7f045639c9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:36:00.999 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:00.998+0000 7f045639c9c0 20 RGWRados::pool_iterate: got zonegroup_info.65ab941b-da8c-4160-94fb-3672b069d44f 2024-09-14T11:36:00.999 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:00.998+0000 7f045639c9c0 20 rados->read ofs=0 len=0 2024-09-14T11:36:01.000 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:01.002+0000 7f045639c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:36:01.000 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:01.002+0000 7f045639c9c0 20 rados->read ofs=0 len=0 2024-09-14T11:36:01.000 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:01.002+0000 7f045639c9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:36:01.000 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:01.002+0000 7f045639c9c0 20 rados->read ofs=0 len=0 2024-09-14T11:36:01.001 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:01.002+0000 7f045639c9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:36:01.001 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:01.002+0000 7f045639c9c0 20 zone default found 2024-09-14T11:36:01.001 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:01.002+0000 7f045639c9c0 4 Realm: () 2024-09-14T11:36:01.002 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:01.002+0000 7f045639c9c0 4 ZoneGroup: default (65ab941b-da8c-4160-94fb-3672b069d44f) 2024-09-14T11:36:01.002 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:01.002+0000 7f045639c9c0 4 Zone: default (d9e72d30-c60b-4d0d-9267-fdc36392d5ad) 2024-09-14T11:36:01.002 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:01.002+0000 7f045639c9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:36:01.002 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:01.002+0000 7f045639c9c0 20 zonegroup default 2024-09-14T11:36:01.002 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:01.002+0000 7f045639c9c0 20 rados->read ofs=0 len=0 2024-09-14T11:36:01.002 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:01.002+0000 7f045639c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:36:01.002 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:01.002+0000 7f045639c9c0 20 rados->read ofs=0 len=0 2024-09-14T11:36:01.003 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:01.002+0000 7f045639c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:36:01.003 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:01.002+0000 7f045639c9c0 20 rados->read ofs=0 len=0 2024-09-14T11:36:01.003 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:01.006+0000 7f045639c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:36:01.003 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:01.006+0000 7f045639c9c0 20 started sync module instance, tier type = 2024-09-14T11:36:01.004 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:01.006+0000 7f045639c9c0 20 started zone id=d9e72d30-c60b-4d0d-9267-fdc36392d5ad (name=default) with tier type = 2024-09-14T11:36:01.025 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:01.026+0000 7f045639c9c0 20 add_watcher() i=0 2024-09-14T11:36:01.025 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:01.026+0000 7f045639c9c0 20 add_watcher() i=1 2024-09-14T11:36:01.025 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:01.026+0000 7f045639c9c0 20 add_watcher() i=2 2024-09-14T11:36:01.025 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:01.026+0000 7f045639c9c0 20 add_watcher() i=3 2024-09-14T11:36:01.025 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:01.026+0000 7f045639c9c0 20 add_watcher() i=4 2024-09-14T11:36:01.025 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:01.026+0000 7f045639c9c0 20 add_watcher() i=5 2024-09-14T11:36:01.025 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:01.026+0000 7f045639c9c0 20 add_watcher() i=6 2024-09-14T11:36:01.027 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:01.030+0000 7f045639c9c0 20 add_watcher() i=7 2024-09-14T11:36:01.027 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:01.030+0000 7f045639c9c0 2 all 8 watchers are set, enabling cache 2024-09-14T11:36:01.032 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:01.034+0000 7f0309fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:36:01.033 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:01.034+0000 7f045639c9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:36:01.033 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:01.034+0000 7f045639c9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:36:01.033 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:01.034+0000 7f045639c9c0 5 note: GC not initialized 2024-09-14T11:36:01.034 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:01.034+0000 7f0308fe1640 20 reqs_thread_entry: start 2024-09-14T11:36:01.034 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:01.034+0000 7f045639c9c0 20 init_complete bucket index max shards: 11 2024-09-14T11:36:01.034 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:01.034+0000 7f045639c9c0 20 Filter name: none 2024-09-14T11:36:01.035 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:01.034+0000 7f02827fc640 20 reqs_thread_entry: start 2024-09-14T11:36:01.035 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:01.034+0000 7f045639c9c0 10 cache get: name=default.rgw.meta+root+error-at-block-writes : miss 2024-09-14T11:36:01.035 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:01.034+0000 7f045639c9c0 20 rados->read ofs=0 len=0 2024-09-14T11:36:01.035 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:01.038+0000 7f045639c9c0 20 rados_obj.operate() r=0 bl.length=189 2024-09-14T11:36:01.035 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:01.038+0000 7f045639c9c0 10 cache put: name=default.rgw.meta+root+error-at-block-writes info.flags=0x11 2024-09-14T11:36:01.036 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:01.038+0000 7f045639c9c0 10 adding default.rgw.meta+root+error-at-block-writes to cache LRU end 2024-09-14T11:36:01.036 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:01.038+0000 7f045639c9c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-block-writes:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.28 : miss 2024-09-14T11:36:01.036 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:01.038+0000 7f045639c9c0 20 rados->read ofs=0 len=0 2024-09-14T11:36:01.036 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:01.038+0000 7f045639c9c0 20 rados_obj.operate() r=0 bl.length=411 2024-09-14T11:36:01.036 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:01.038+0000 7f045639c9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-block-writes:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.28 info.flags=0x17 2024-09-14T11:36:01.037 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:01.038+0000 7f045639c9c0 10 adding default.rgw.meta+root+.bucket.meta.error-at-block-writes:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.28 to cache LRU end 2024-09-14T11:36:01.037 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:01.038+0000 7f045639c9c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:36:01.037 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:01.038+0000 7f045639c9c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:36:01.037 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:01.038+0000 7f045639c9c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-block-writes:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.28 2024-09-14T11:36:01.046 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:01.046+0000 7f045639c9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-block-writes:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.28 info.flags=0x17 2024-09-14T11:36:01.046 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:01.046+0000 7f045639c9c0 10 moving default.rgw.meta+root+.bucket.meta.error-at-block-writes:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.28 to cache LRU end 2024-09-14T11:36:01.046 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:01.046+0000 7f045639c9c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:36:01.046 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:01.046+0000 7f045639c9c0 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-block-writes:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.28, ofs0, ns] 2024-09-14T11:36:01.046 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:01.046+0000 7f03327fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366186 cookie 93975344506896 notifier 6912 bl.length()=915 2024-09-14T11:36:01.046 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:01.046+0000 7f03327fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-block-writes:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.28 info.flags=0x17 2024-09-14T11:36:01.046 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:01.046+0000 7f03327fc640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-block-writes:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.28 to cache LRU end 2024-09-14T11:36:01.047 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:01.046+0000 7f03327fc640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:36:01.049 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:01.050+0000 7f045639c9c0 20 handle_bi_update(): bucket=:error-at-block-writes[d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.28]): orig_sources= new_sources= 2024-09-14T11:36:01.049 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:01.050+0000 7f045639c9c0 20 handle_bi_update(): bucket=:error-at-block-writes[d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.28]): potential sources added=[] removed=[] 2024-09-14T11:36:01.049 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:01.050+0000 7f045639c9c0 20 handle_bi_update(): bucket=:error-at-block-writes[d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.28]): orig_dests= new_dests= 2024-09-14T11:36:01.049 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:01.050+0000 7f045639c9c0 20 handle_bi_update(): bucket=:error-at-block-writes[d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.28]): potential dests added=[] removed=[] 2024-09-14T11:36:01.060 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:01.062+0000 7f045639c9c0 10 bucket_obj is .dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.28.1.0 2024-09-14T11:36:01.060 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:01.062+0000 7f045639c9c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.28.1.0 2024-09-14T11:36:01.060 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:01.062+0000 7f045639c9c0 10 bucket_obj is .dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.28.1.1 2024-09-14T11:36:01.060 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:01.062+0000 7f045639c9c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.28.1.1 2024-09-14T11:36:01.060 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:01.062+0000 7f045639c9c0 10 bucket_obj is .dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.28.1.2 2024-09-14T11:36:01.060 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:01.062+0000 7f045639c9c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.28.1.2 2024-09-14T11:36:01.060 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:01.062+0000 7f045639c9c0 10 bucket_obj is .dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.28.1.3 2024-09-14T11:36:01.060 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:01.062+0000 7f045639c9c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.28.1.3 2024-09-14T11:36:01.060 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:01.062+0000 7f045639c9c0 10 bucket_obj is .dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.28.1.4 2024-09-14T11:36:01.060 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:01.062+0000 7f045639c9c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.28.1.4 2024-09-14T11:36:01.060 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:01.062+0000 7f045639c9c0 10 bucket_obj is .dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.28.1.5 2024-09-14T11:36:01.061 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:01.062+0000 7f045639c9c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.28.1.5 2024-09-14T11:36:01.061 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:01.062+0000 7f045639c9c0 10 bucket_obj is .dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.28.1.6 2024-09-14T11:36:01.061 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:01.062+0000 7f045639c9c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.28.1.6 2024-09-14T11:36:01.061 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:01.062+0000 7f045639c9c0 10 bucket_obj is .dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.28.1.7 2024-09-14T11:36:01.061 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:01.062+0000 7f045639c9c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.28.1.7 2024-09-14T11:36:01.061 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:01.062+0000 7f045639c9c0 10 bucket_obj is .dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.28.1.8 2024-09-14T11:36:01.061 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:01.062+0000 7f045639c9c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.28.1.8 2024-09-14T11:36:01.061 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:01.062+0000 7f045639c9c0 10 bucket_obj is .dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.28.1.9 2024-09-14T11:36:01.061 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:01.062+0000 7f045639c9c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.28.1.9 2024-09-14T11:36:01.061 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:01.062+0000 7f045639c9c0 10 bucket_obj is .dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.28.1.10 2024-09-14T11:36:01.061 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:01.062+0000 7f045639c9c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.28.1.10 2024-09-14T11:36:01.061 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:01.062+0000 7f045639c9c0 10 bucket_obj is .dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.28.1.11 2024-09-14T11:36:01.061 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:01.062+0000 7f045639c9c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.28.1.11 2024-09-14T11:36:01.062 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:01.062+0000 7f045639c9c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.28.0 2024-09-14T11:36:01.062 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:01.062+0000 7f045639c9c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.28.1 2024-09-14T11:36:01.062 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:01.062+0000 7f045639c9c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.28.2 2024-09-14T11:36:01.062 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:01.062+0000 7f045639c9c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.28.3 2024-09-14T11:36:01.062 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:01.062+0000 7f045639c9c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.28.4 2024-09-14T11:36:01.063 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:01.066+0000 7f045639c9c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.28.5 2024-09-14T11:36:01.063 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:01.066+0000 7f045639c9c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.28.6 2024-09-14T11:36:01.064 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:01.066+0000 7f045639c9c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.28.7 2024-09-14T11:36:01.065 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:01.066+0000 7f045639c9c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.28.8 2024-09-14T11:36:01.065 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:01.066+0000 7f045639c9c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.28.9 2024-09-14T11:36:01.066 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:01.066+0000 7f045639c9c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.28.10 2024-09-14T11:36:01.074 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:01.074+0000 7f045639c9c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-block-writes:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.28 : hit (requested=0x17, cached=0x17) 2024-09-14T11:36:01.074 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:01.074+0000 7f045639c9c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-block-writes:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.28 2024-09-14T11:36:01.076 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:01.078+0000 7f045639c9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-block-writes:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.28 info.flags=0x17 2024-09-14T11:36:01.076 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:01.078+0000 7f045639c9c0 10 moving default.rgw.meta+root+.bucket.meta.error-at-block-writes:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.28 to cache LRU end 2024-09-14T11:36:01.076 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:01.078+0000 7f045639c9c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:36:01.076 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:01.078+0000 7f045639c9c0 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-block-writes:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.28, ofs0, ns] 2024-09-14T11:36:01.077 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:01.078+0000 7f03327fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366187 cookie 93975344506896 notifier 6912 bl.length()=915 2024-09-14T11:36:01.077 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:01.078+0000 7f03327fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-block-writes:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.28 info.flags=0x17 2024-09-14T11:36:01.077 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:01.078+0000 7f03327fc640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-block-writes:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.28 to cache LRU end 2024-09-14T11:36:01.077 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:01.078+0000 7f03327fc640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:36:01.079 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:01.082+0000 7f045639c9c0 20 handle_bi_update(): bucket=:error-at-block-writes[d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.28]): orig_sources= new_sources= 2024-09-14T11:36:01.079 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:01.082+0000 7f045639c9c0 20 handle_bi_update(): bucket=:error-at-block-writes[d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.28]): potential sources added=[] removed=[] 2024-09-14T11:36:01.080 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:01.082+0000 7f045639c9c0 20 handle_bi_update(): bucket=:error-at-block-writes[d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.28]): orig_dests= new_dests= 2024-09-14T11:36:01.080 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:01.082+0000 7f045639c9c0 20 handle_bi_update(): bucket=:error-at-block-writes[d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.28]): potential dests added=[] removed=[] 2024-09-14T11:36:01.080 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:01.082+0000 7f045639c9c0 -1 Injecting error=-5 at location=block_writes 2024-09-14T11:36:01.080 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:01.082+0000 7f045639c9c0 0 ERROR: change_reshard_state failed to pause writes to the current index: (5) Input/output error 2024-09-14T11:36:01.088 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:01.090+0000 7f045639c9c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-block-writes:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.28 : hit (requested=0x17, cached=0x17) 2024-09-14T11:36:01.089 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:01.090+0000 7f045639c9c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-block-writes:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.28 2024-09-14T11:36:01.091 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:01.090+0000 7f045639c9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-block-writes:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.28 info.flags=0x17 2024-09-14T11:36:01.091 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:01.090+0000 7f045639c9c0 10 moving default.rgw.meta+root+.bucket.meta.error-at-block-writes:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.28 to cache LRU end 2024-09-14T11:36:01.091 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:01.090+0000 7f045639c9c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:36:01.091 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:01.090+0000 7f045639c9c0 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-block-writes:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.28, ofs0, ns] 2024-09-14T11:36:01.091 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:01.094+0000 7f0332ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366188 cookie 93975344506896 notifier 6912 bl.length()=883 2024-09-14T11:36:01.091 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:01.094+0000 7f0332ffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-block-writes:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.28 info.flags=0x17 2024-09-14T11:36:01.091 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:01.094+0000 7f0332ffd640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-block-writes:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.28 to cache LRU end 2024-09-14T11:36:01.092 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:01.094+0000 7f0332ffd640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:36:01.094 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:01.094+0000 7f045639c9c0 20 handle_bi_update(): bucket=:error-at-block-writes[d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.28]): orig_sources= new_sources= 2024-09-14T11:36:01.094 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:01.094+0000 7f045639c9c0 20 handle_bi_update(): bucket=:error-at-block-writes[d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.28]): potential sources added=[] removed=[] 2024-09-14T11:36:01.094 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:01.094+0000 7f045639c9c0 20 handle_bi_update(): bucket=:error-at-block-writes[d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.28]): orig_dests= new_dests= 2024-09-14T11:36:01.094 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:01.094+0000 7f045639c9c0 20 handle_bi_update(): bucket=:error-at-block-writes[d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.28]): potential dests added=[] removed=[] 2024-09-14T11:36:01.099 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:01.102+0000 7f045639c9c0 1 execute INFO: reshard of bucket "error-at-block-writes" canceled due to errors 2024-09-14T11:36:01.102 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:01.102+0000 7f0309fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:36:01.107 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:01.110+0000 7f045639c9c0 20 remove_watcher() i=0 2024-09-14T11:36:01.107 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:01.110+0000 7f045639c9c0 2 removed watcher, disabling cache 2024-09-14T11:36:01.110 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:01.110+0000 7f045639c9c0 20 remove_watcher() i=1 2024-09-14T11:36:01.112 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:01.114+0000 7f045639c9c0 20 remove_watcher() i=2 2024-09-14T11:36:01.114 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:01.114+0000 7f045639c9c0 20 remove_watcher() i=3 2024-09-14T11:36:01.116 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:01.118+0000 7f045639c9c0 20 remove_watcher() i=4 2024-09-14T11:36:01.118 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:01.118+0000 7f045639c9c0 20 remove_watcher() i=5 2024-09-14T11:36:01.120 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:01.122+0000 7f045639c9c0 20 remove_watcher() i=6 2024-09-14T11:36:01.121 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:01.122+0000 7f045639c9c0 20 remove_watcher() i=7 2024-09-14T11:36:01.137 INFO:tasks.workunit.client.0.smithi138.stderr:radosgw-admin bucket stats --bucket error-at-block-writes 2024-09-14T11:36:01.167 INFO:tasks.workunit.client.0.smithi138.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:36:01.167 INFO:tasks.workunit.client.0.smithi138.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:36:01.211 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:01.214+0000 7f4115bbe9c0 20 rados->read ofs=0 len=0 2024-09-14T11:36:01.213 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:01.214+0000 7f4115bbe9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:36:01.214 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:01.214+0000 7f4115bbe9c0 20 realm 2024-09-14T11:36:01.214 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:01.214+0000 7f4115bbe9c0 20 rados->read ofs=0 len=0 2024-09-14T11:36:01.214 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:01.214+0000 7f4115bbe9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:36:01.214 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:01.214+0000 7f4115bbe9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:36:01.214 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:01.214+0000 7f4115bbe9c0 20 rados->read ofs=0 len=0 2024-09-14T11:36:01.214 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:01.214+0000 7f4115bbe9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:36:01.214 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:01.214+0000 7f4115bbe9c0 20 rados->read ofs=0 len=0 2024-09-14T11:36:01.215 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:01.218+0000 7f4115bbe9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:36:01.215 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:01.218+0000 7f4115bbe9c0 20 rados->read ofs=0 len=0 2024-09-14T11:36:01.216 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:01.218+0000 7f4115bbe9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:36:01.216 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:01.218+0000 7f4115bbe9c0 20 searching for the correct realm 2024-09-14T11:36:01.220 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:01.222+0000 7f4113ec5640 0 -- 172.21.15.138:0/555923701 >> [v2:172.21.15.154:6824/416768175,v1:172.21.15.154:6825/416768175] conn(0x7f4104026070 msgr2=0x7f4104096350 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:36:01.227 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:01.230+0000 7f4112ec3640 0 -- 172.21.15.138:0/555923701 >> [v2:172.21.15.138:6816/326481658,v1:172.21.15.138:6817/326481658] conn(0x7f41040898d0 msgr2=0x7f410400e000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-14T11:36:01.447 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:01.446+0000 7f4115bbe9c0 20 RGWRados::pool_iterate: got zone_info.d9e72d30-c60b-4d0d-9267-fdc36392d5ad 2024-09-14T11:36:01.447 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:01.446+0000 7f4115bbe9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:36:01.447 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:01.446+0000 7f4115bbe9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:36:01.447 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:01.446+0000 7f4115bbe9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:36:01.447 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:01.446+0000 7f4115bbe9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:36:01.447 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:01.446+0000 7f4115bbe9c0 20 RGWRados::pool_iterate: got zonegroup_info.65ab941b-da8c-4160-94fb-3672b069d44f 2024-09-14T11:36:01.447 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:01.446+0000 7f4115bbe9c0 20 rados->read ofs=0 len=0 2024-09-14T11:36:01.447 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:01.446+0000 7f4115bbe9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:36:01.447 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:01.446+0000 7f4115bbe9c0 20 rados->read ofs=0 len=0 2024-09-14T11:36:01.448 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:01.450+0000 7f4115bbe9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:36:01.448 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:01.450+0000 7f4115bbe9c0 20 rados->read ofs=0 len=0 2024-09-14T11:36:01.449 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:01.450+0000 7f4115bbe9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:36:01.452 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:01.450+0000 7f4115bbe9c0 20 zone default found 2024-09-14T11:36:01.452 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:01.450+0000 7f4115bbe9c0 4 Realm: () 2024-09-14T11:36:01.452 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:01.450+0000 7f4115bbe9c0 4 ZoneGroup: default (65ab941b-da8c-4160-94fb-3672b069d44f) 2024-09-14T11:36:01.452 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:01.450+0000 7f4115bbe9c0 4 Zone: default (d9e72d30-c60b-4d0d-9267-fdc36392d5ad) 2024-09-14T11:36:01.452 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:01.450+0000 7f4115bbe9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:36:01.452 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:01.450+0000 7f4115bbe9c0 20 zonegroup default 2024-09-14T11:36:01.452 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:01.450+0000 7f4115bbe9c0 20 rados->read ofs=0 len=0 2024-09-14T11:36:01.453 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:01.450+0000 7f4115bbe9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:36:01.453 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:01.450+0000 7f4115bbe9c0 20 rados->read ofs=0 len=0 2024-09-14T11:36:01.453 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:01.450+0000 7f4115bbe9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:36:01.453 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:01.450+0000 7f4115bbe9c0 20 rados->read ofs=0 len=0 2024-09-14T11:36:01.453 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:01.454+0000 7f4115bbe9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:36:01.453 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:01.454+0000 7f4115bbe9c0 20 started sync module instance, tier type = 2024-09-14T11:36:01.453 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:01.454+0000 7f4115bbe9c0 20 started zone id=d9e72d30-c60b-4d0d-9267-fdc36392d5ad (name=default) with tier type = 2024-09-14T11:36:01.475 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:01.478+0000 7f4115bbe9c0 20 add_watcher() i=0 2024-09-14T11:36:01.475 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:01.478+0000 7f4115bbe9c0 20 add_watcher() i=1 2024-09-14T11:36:01.475 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:01.478+0000 7f4115bbe9c0 20 add_watcher() i=2 2024-09-14T11:36:01.475 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:01.478+0000 7f4115bbe9c0 20 add_watcher() i=3 2024-09-14T11:36:01.476 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:01.478+0000 7f4115bbe9c0 20 add_watcher() i=4 2024-09-14T11:36:01.476 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:01.478+0000 7f4115bbe9c0 20 add_watcher() i=5 2024-09-14T11:36:01.476 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:01.478+0000 7f4115bbe9c0 20 add_watcher() i=6 2024-09-14T11:36:01.477 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:01.478+0000 7f4115bbe9c0 20 add_watcher() i=7 2024-09-14T11:36:01.477 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:01.478+0000 7f4115bbe9c0 2 all 8 watchers are set, enabling cache 2024-09-14T11:36:01.481 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:01.482+0000 7f3fc9fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:36:01.482 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:01.482+0000 7f4115bbe9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:36:01.482 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:01.482+0000 7f4115bbe9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:36:01.482 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:01.482+0000 7f4115bbe9c0 5 note: GC not initialized 2024-09-14T11:36:01.483 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:01.482+0000 7f3fc8fe1640 20 reqs_thread_entry: start 2024-09-14T11:36:01.483 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:01.482+0000 7f4115bbe9c0 20 init_complete bucket index max shards: 11 2024-09-14T11:36:01.483 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:01.486+0000 7f4115bbe9c0 20 Filter name: none 2024-09-14T11:36:01.483 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:01.486+0000 7f3f427fc640 20 reqs_thread_entry: start 2024-09-14T11:36:01.483 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:01.486+0000 7f4115bbe9c0 20 rados->read ofs=0 len=0 2024-09-14T11:36:01.484 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:01.486+0000 7f4115bbe9c0 20 rados_obj.operate() r=0 bl.length=189 2024-09-14T11:36:01.484 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:01.486+0000 7f4115bbe9c0 20 rados->read ofs=0 len=0 2024-09-14T11:36:01.485 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:01.486+0000 7f4115bbe9c0 20 rados_obj.operate() r=0 bl.length=411 2024-09-14T11:36:01.485 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:01.486+0000 7f4115bbe9c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:36:01.485 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:01.486+0000 7f4115bbe9c0 20 rados->read ofs=0 len=0 2024-09-14T11:36:01.487 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:01.486+0000 7f4115bbe9c0 20 rados_obj.operate() r=0 bl.length=189 2024-09-14T11:36:01.487 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:01.486+0000 7f4115bbe9c0 20 rados->read ofs=0 len=0 2024-09-14T11:36:01.487 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:01.490+0000 7f4115bbe9c0 20 rados_obj.operate() r=0 bl.length=411 2024-09-14T11:36:01.487 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:01.490+0000 7f4115bbe9c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:36:01.490 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:01.490+0000 7f3fc9fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:36:01.495 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:01.498+0000 7f4115bbe9c0 20 remove_watcher() i=0 2024-09-14T11:36:01.495 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:01.498+0000 7f4115bbe9c0 2 removed watcher, disabling cache 2024-09-14T11:36:01.497 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:01.498+0000 7f4115bbe9c0 20 remove_watcher() i=1 2024-09-14T11:36:01.500 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:01.502+0000 7f4115bbe9c0 20 remove_watcher() i=2 2024-09-14T11:36:01.502 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:01.502+0000 7f4115bbe9c0 20 remove_watcher() i=3 2024-09-14T11:36:01.504 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:01.506+0000 7f4115bbe9c0 20 remove_watcher() i=4 2024-09-14T11:36:01.506 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:01.506+0000 7f4115bbe9c0 20 remove_watcher() i=5 2024-09-14T11:36:01.508 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:01.510+0000 7f4115bbe9c0 20 remove_watcher() i=6 2024-09-14T11:36:01.509 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:01.510+0000 7f4115bbe9c0 20 remove_watcher() i=7 2024-09-14T11:36:01.530 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-14T11:36:01.530 INFO:tasks.workunit.client.0.smithi138.stderr:BUCKET_STATS: 2024-09-14T11:36:01.531 INFO:tasks.workunit.client.0.smithi138.stderr:bucket: error-at-block-writes id: d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.28 num_objects: 20 size_kb: 1 num_shards: 11 2024-09-14T11:36:01.531 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-14T11:36:01.532 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:36:01.532 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-14T11:36:01.579 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:36:01.579 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-14T11:36:01.661 INFO:tasks.workunit.client.0.smithi138.stderr:radosgw-admin bucket reshard --bucket error-at-block-writes --num-shards 12 --rgw-reshard-bucket-lock-duration 30 2024-09-14T11:36:01.698 INFO:tasks.workunit.client.0.smithi138.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:36:01.698 INFO:tasks.workunit.client.0.smithi138.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:36:01.743 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:01.746+0000 7f3ac688b9c0 20 rados->read ofs=0 len=0 2024-09-14T11:36:01.745 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:01.746+0000 7f3ac688b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:36:01.745 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:01.746+0000 7f3ac688b9c0 20 realm 2024-09-14T11:36:01.746 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:01.746+0000 7f3ac688b9c0 20 rados->read ofs=0 len=0 2024-09-14T11:36:01.746 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:01.746+0000 7f3ac688b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:36:01.746 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:01.746+0000 7f3ac688b9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:36:01.746 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:01.746+0000 7f3ac688b9c0 20 rados->read ofs=0 len=0 2024-09-14T11:36:01.746 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:01.746+0000 7f3ac688b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:36:01.746 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:01.746+0000 7f3ac688b9c0 20 rados->read ofs=0 len=0 2024-09-14T11:36:01.747 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:01.750+0000 7f3ac688b9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:36:01.747 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:01.750+0000 7f3ac688b9c0 20 rados->read ofs=0 len=0 2024-09-14T11:36:01.748 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:01.750+0000 7f3ac688b9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:36:01.748 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:01.750+0000 7f3ac688b9c0 20 searching for the correct realm 2024-09-14T11:36:01.752 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:01.754+0000 7f3ac4b92640 0 -- 172.21.15.138:0/3185752418 >> [v2:172.21.15.154:6824/416768175,v1:172.21.15.154:6825/416768175] conn(0x7f3abc004040 msgr2=0x7f3abc0e3920 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:36:01.969 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:01.970+0000 7f3ac3b90640 0 -- 172.21.15.138:0/3185752418 >> [v2:172.21.15.138:6816/326481658,v1:172.21.15.138:6817/326481658] conn(0x7f3abc0eac00 msgr2=0x7f3abc0b7900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-14T11:36:02.187 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:02.186+0000 7f3ac688b9c0 20 RGWRados::pool_iterate: got zone_info.d9e72d30-c60b-4d0d-9267-fdc36392d5ad 2024-09-14T11:36:02.187 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:02.186+0000 7f3ac688b9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:36:02.187 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:02.186+0000 7f3ac688b9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:36:02.187 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:02.186+0000 7f3ac688b9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:36:02.187 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:02.186+0000 7f3ac688b9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:36:02.187 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:02.186+0000 7f3ac688b9c0 20 RGWRados::pool_iterate: got zonegroup_info.65ab941b-da8c-4160-94fb-3672b069d44f 2024-09-14T11:36:02.188 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:02.186+0000 7f3ac688b9c0 20 rados->read ofs=0 len=0 2024-09-14T11:36:02.188 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:02.190+0000 7f3ac688b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:36:02.188 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:02.190+0000 7f3ac688b9c0 20 rados->read ofs=0 len=0 2024-09-14T11:36:02.189 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:02.190+0000 7f3ac688b9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:36:02.189 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:02.190+0000 7f3ac688b9c0 20 rados->read ofs=0 len=0 2024-09-14T11:36:02.190 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:02.190+0000 7f3ac688b9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:36:02.190 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:02.190+0000 7f3ac688b9c0 20 zone default found 2024-09-14T11:36:02.190 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:02.190+0000 7f3ac688b9c0 4 Realm: () 2024-09-14T11:36:02.190 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:02.190+0000 7f3ac688b9c0 4 ZoneGroup: default (65ab941b-da8c-4160-94fb-3672b069d44f) 2024-09-14T11:36:02.190 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:02.190+0000 7f3ac688b9c0 4 Zone: default (d9e72d30-c60b-4d0d-9267-fdc36392d5ad) 2024-09-14T11:36:02.190 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:02.190+0000 7f3ac688b9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:36:02.190 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:02.190+0000 7f3ac688b9c0 20 zonegroup default 2024-09-14T11:36:02.190 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:02.190+0000 7f3ac688b9c0 20 rados->read ofs=0 len=0 2024-09-14T11:36:02.191 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:02.190+0000 7f3ac688b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:36:02.191 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:02.190+0000 7f3ac688b9c0 20 rados->read ofs=0 len=0 2024-09-14T11:36:02.191 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:02.194+0000 7f3ac688b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:36:02.191 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:02.194+0000 7f3ac688b9c0 20 rados->read ofs=0 len=0 2024-09-14T11:36:02.192 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:02.194+0000 7f3ac688b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:36:02.192 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:02.194+0000 7f3ac688b9c0 20 started sync module instance, tier type = 2024-09-14T11:36:02.192 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:02.194+0000 7f3ac688b9c0 20 started zone id=d9e72d30-c60b-4d0d-9267-fdc36392d5ad (name=default) with tier type = 2024-09-14T11:36:02.216 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:02.218+0000 7f3ac688b9c0 20 add_watcher() i=0 2024-09-14T11:36:02.216 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:02.218+0000 7f3ac688b9c0 20 add_watcher() i=1 2024-09-14T11:36:02.217 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:02.218+0000 7f3ac688b9c0 20 add_watcher() i=2 2024-09-14T11:36:02.217 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:02.218+0000 7f3ac688b9c0 20 add_watcher() i=3 2024-09-14T11:36:02.217 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:02.218+0000 7f3ac688b9c0 20 add_watcher() i=4 2024-09-14T11:36:02.217 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:02.218+0000 7f3ac688b9c0 20 add_watcher() i=5 2024-09-14T11:36:02.217 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:02.218+0000 7f3ac688b9c0 20 add_watcher() i=6 2024-09-14T11:36:02.219 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:02.222+0000 7f3ac688b9c0 20 add_watcher() i=7 2024-09-14T11:36:02.219 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:02.222+0000 7f3ac688b9c0 2 all 8 watchers are set, enabling cache 2024-09-14T11:36:02.223 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:02.226+0000 7f397a7e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:36:02.224 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:02.226+0000 7f3ac688b9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:36:02.224 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:02.226+0000 7f3ac688b9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:36:02.224 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:02.226+0000 7f3ac688b9c0 5 note: GC not initialized 2024-09-14T11:36:02.225 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:02.226+0000 7f39797e2640 20 reqs_thread_entry: start 2024-09-14T11:36:02.225 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:02.226+0000 7f3ac688b9c0 20 init_complete bucket index max shards: 11 2024-09-14T11:36:02.225 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:02.226+0000 7f3ac688b9c0 20 Filter name: none 2024-09-14T11:36:02.225 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:02.226+0000 7f38eaffd640 20 reqs_thread_entry: start 2024-09-14T11:36:02.225 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:02.226+0000 7f3ac688b9c0 10 cache get: name=default.rgw.meta+root+error-at-block-writes : miss 2024-09-14T11:36:02.225 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:02.226+0000 7f3ac688b9c0 20 rados->read ofs=0 len=0 2024-09-14T11:36:02.226 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:02.226+0000 7f3ac688b9c0 20 rados_obj.operate() r=0 bl.length=189 2024-09-14T11:36:02.226 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:02.226+0000 7f3ac688b9c0 10 cache put: name=default.rgw.meta+root+error-at-block-writes info.flags=0x11 2024-09-14T11:36:02.226 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:02.226+0000 7f3ac688b9c0 10 adding default.rgw.meta+root+error-at-block-writes to cache LRU end 2024-09-14T11:36:02.226 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:02.226+0000 7f3ac688b9c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-block-writes:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.28 : miss 2024-09-14T11:36:02.226 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:02.226+0000 7f3ac688b9c0 20 rados->read ofs=0 len=0 2024-09-14T11:36:02.227 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:02.226+0000 7f3ac688b9c0 20 rados_obj.operate() r=0 bl.length=411 2024-09-14T11:36:02.227 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:02.226+0000 7f3ac688b9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-block-writes:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.28 info.flags=0x17 2024-09-14T11:36:02.227 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:02.226+0000 7f3ac688b9c0 10 adding default.rgw.meta+root+.bucket.meta.error-at-block-writes:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.28 to cache LRU end 2024-09-14T11:36:02.227 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:02.226+0000 7f3ac688b9c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:36:02.227 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:02.226+0000 7f3ac688b9c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:36:02.227 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:02.226+0000 7f3ac688b9c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-block-writes:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.28 2024-09-14T11:36:02.237 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:02.238+0000 7f3ac688b9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-block-writes:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.28 info.flags=0x17 2024-09-14T11:36:02.237 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:02.238+0000 7f3ac688b9c0 10 moving default.rgw.meta+root+.bucket.meta.error-at-block-writes:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.28 to cache LRU end 2024-09-14T11:36:02.238 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:02.238+0000 7f3ac688b9c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:36:02.238 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:02.238+0000 7f3ac688b9c0 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-block-writes:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.28, ofs0, ns] 2024-09-14T11:36:02.238 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:02.238+0000 7f39a2ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366189 cookie 94750389796064 notifier 6500 bl.length()=915 2024-09-14T11:36:02.238 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:02.238+0000 7f39a2ffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-block-writes:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.28 info.flags=0x17 2024-09-14T11:36:02.239 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:02.238+0000 7f39a2ffd640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-block-writes:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.28 to cache LRU end 2024-09-14T11:36:02.239 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:02.238+0000 7f39a2ffd640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:36:02.242 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:02.242+0000 7f3ac688b9c0 20 handle_bi_update(): bucket=:error-at-block-writes[d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.28]): orig_sources= new_sources= 2024-09-14T11:36:02.242 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:02.242+0000 7f3ac688b9c0 20 handle_bi_update(): bucket=:error-at-block-writes[d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.28]): potential sources added=[] removed=[] 2024-09-14T11:36:02.242 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:02.242+0000 7f3ac688b9c0 20 handle_bi_update(): bucket=:error-at-block-writes[d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.28]): orig_dests= new_dests= 2024-09-14T11:36:02.242 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:02.242+0000 7f3ac688b9c0 20 handle_bi_update(): bucket=:error-at-block-writes[d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.28]): potential dests added=[] removed=[] 2024-09-14T11:36:02.251 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:02.254+0000 7f3ac688b9c0 10 bucket_obj is .dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.28.1.0 2024-09-14T11:36:02.251 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:02.254+0000 7f3ac688b9c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.28.1.0 2024-09-14T11:36:02.251 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:02.254+0000 7f3ac688b9c0 10 bucket_obj is .dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.28.1.1 2024-09-14T11:36:02.251 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:02.254+0000 7f3ac688b9c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.28.1.1 2024-09-14T11:36:02.251 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:02.254+0000 7f3ac688b9c0 10 bucket_obj is .dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.28.1.2 2024-09-14T11:36:02.252 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:02.254+0000 7f3ac688b9c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.28.1.2 2024-09-14T11:36:02.252 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:02.254+0000 7f3ac688b9c0 10 bucket_obj is .dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.28.1.3 2024-09-14T11:36:02.252 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:02.254+0000 7f3ac688b9c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.28.1.3 2024-09-14T11:36:02.252 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:02.254+0000 7f3ac688b9c0 10 bucket_obj is .dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.28.1.4 2024-09-14T11:36:02.252 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:02.254+0000 7f3ac688b9c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.28.1.4 2024-09-14T11:36:02.252 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:02.254+0000 7f3ac688b9c0 10 bucket_obj is .dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.28.1.5 2024-09-14T11:36:02.252 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:02.254+0000 7f3ac688b9c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.28.1.5 2024-09-14T11:36:02.252 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:02.254+0000 7f3ac688b9c0 10 bucket_obj is .dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.28.1.6 2024-09-14T11:36:02.252 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:02.254+0000 7f3ac688b9c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.28.1.6 2024-09-14T11:36:02.252 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:02.254+0000 7f3ac688b9c0 10 bucket_obj is .dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.28.1.7 2024-09-14T11:36:02.252 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:02.254+0000 7f3ac688b9c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.28.1.7 2024-09-14T11:36:02.252 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:02.254+0000 7f3ac688b9c0 10 bucket_obj is .dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.28.1.8 2024-09-14T11:36:02.252 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:02.254+0000 7f3ac688b9c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.28.1.8 2024-09-14T11:36:02.252 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:02.254+0000 7f3ac688b9c0 10 bucket_obj is .dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.28.1.9 2024-09-14T11:36:02.253 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:02.254+0000 7f3ac688b9c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.28.1.9 2024-09-14T11:36:02.253 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:02.254+0000 7f3ac688b9c0 10 bucket_obj is .dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.28.1.10 2024-09-14T11:36:02.253 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:02.254+0000 7f3ac688b9c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.28.1.10 2024-09-14T11:36:02.253 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:02.254+0000 7f3ac688b9c0 10 bucket_obj is .dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.28.1.11 2024-09-14T11:36:02.253 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:02.254+0000 7f3ac688b9c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.28.1.11 2024-09-14T11:36:02.253 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:02.254+0000 7f3ac688b9c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.28.0 2024-09-14T11:36:02.253 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:02.254+0000 7f3ac688b9c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.28.1 2024-09-14T11:36:02.254 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:02.254+0000 7f3ac688b9c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.28.2 2024-09-14T11:36:02.254 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:02.254+0000 7f3ac688b9c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.28.3 2024-09-14T11:36:02.254 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:02.254+0000 7f3ac688b9c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.28.4 2024-09-14T11:36:02.255 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:02.258+0000 7f3ac688b9c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.28.5 2024-09-14T11:36:02.256 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:02.258+0000 7f3ac688b9c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.28.6 2024-09-14T11:36:02.257 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:02.258+0000 7f3ac688b9c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.28.7 2024-09-14T11:36:02.258 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:02.258+0000 7f3ac688b9c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.28.8 2024-09-14T11:36:02.258 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:02.258+0000 7f3ac688b9c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.28.9 2024-09-14T11:36:02.260 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:02.262+0000 7f3ac688b9c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.28.10 2024-09-14T11:36:02.266 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:02.266+0000 7f3ac688b9c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-block-writes:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.28 : hit (requested=0x17, cached=0x17) 2024-09-14T11:36:02.266 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:02.266+0000 7f3ac688b9c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-block-writes:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.28 2024-09-14T11:36:02.268 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:02.270+0000 7f3ac688b9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-block-writes:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.28 info.flags=0x17 2024-09-14T11:36:02.268 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:02.270+0000 7f3ac688b9c0 10 moving default.rgw.meta+root+.bucket.meta.error-at-block-writes:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.28 to cache LRU end 2024-09-14T11:36:02.268 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:02.270+0000 7f3ac688b9c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:36:02.268 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:02.270+0000 7f3ac688b9c0 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-block-writes:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.28, ofs0, ns] 2024-09-14T11:36:02.268 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:02.270+0000 7f39a37fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366190 cookie 94750389796064 notifier 6500 bl.length()=915 2024-09-14T11:36:02.268 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:02.270+0000 7f39a37fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-block-writes:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.28 info.flags=0x17 2024-09-14T11:36:02.269 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:02.270+0000 7f39a37fe640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-block-writes:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.28 to cache LRU end 2024-09-14T11:36:02.269 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:02.270+0000 7f39a37fe640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:36:02.271 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:02.274+0000 7f3ac688b9c0 20 handle_bi_update(): bucket=:error-at-block-writes[d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.28]): orig_sources= new_sources= 2024-09-14T11:36:02.272 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:02.274+0000 7f3ac688b9c0 20 handle_bi_update(): bucket=:error-at-block-writes[d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.28]): potential sources added=[] removed=[] 2024-09-14T11:36:02.272 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:02.274+0000 7f3ac688b9c0 20 handle_bi_update(): bucket=:error-at-block-writes[d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.28]): orig_dests= new_dests= 2024-09-14T11:36:02.272 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:02.274+0000 7f3ac688b9c0 20 handle_bi_update(): bucket=:error-at-block-writes[d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.28]): potential dests added=[] removed=[] 2024-09-14T11:36:02.278 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:02.278+0000 7f3ac688b9c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.28.0 2024-09-14T11:36:02.278 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:02.278+0000 7f3ac688b9c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.28.1 2024-09-14T11:36:02.279 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:02.278+0000 7f3ac688b9c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.28.2 2024-09-14T11:36:02.279 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:02.282+0000 7f3ac688b9c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.28.3 2024-09-14T11:36:02.280 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:02.282+0000 7f3ac688b9c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.28.4 2024-09-14T11:36:02.281 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:02.282+0000 7f3ac688b9c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.28.5 2024-09-14T11:36:02.281 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:02.282+0000 7f3ac688b9c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.28.6 2024-09-14T11:36:02.281 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:02.282+0000 7f3ac688b9c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.28.7 2024-09-14T11:36:02.282 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:02.282+0000 7f3ac688b9c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.28.8 2024-09-14T11:36:02.282 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:02.282+0000 7f3ac688b9c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.28.9 2024-09-14T11:36:02.283 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:02.286+0000 7f3ac688b9c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.28.10 2024-09-14T11:36:02.283 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:02.286+0000 7f3ac688b9c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-block-writes:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.28 : hit (requested=0x17, cached=0x17) 2024-09-14T11:36:02.284 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:02.286+0000 7f3ac688b9c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-block-writes:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.28 2024-09-14T11:36:02.285 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:02.286+0000 7f3ac688b9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-block-writes:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.28 info.flags=0x17 2024-09-14T11:36:02.286 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:02.286+0000 7f3ac688b9c0 10 moving default.rgw.meta+root+.bucket.meta.error-at-block-writes:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.28 to cache LRU end 2024-09-14T11:36:02.286 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:02.286+0000 7f3ac688b9c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:36:02.286 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:02.286+0000 7f3ac688b9c0 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-block-writes:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.28, ofs0, ns] 2024-09-14T11:36:02.286 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:02.286+0000 7f39a2ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366191 cookie 94750389796064 notifier 6500 bl.length()=883 2024-09-14T11:36:02.286 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:02.286+0000 7f39a2ffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-block-writes:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.28 info.flags=0x17 2024-09-14T11:36:02.286 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:02.286+0000 7f39a2ffd640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-block-writes:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.28 to cache LRU end 2024-09-14T11:36:02.287 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:02.286+0000 7f39a2ffd640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:36:02.289 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:02.290+0000 7f3ac688b9c0 20 handle_bi_update(): bucket=:error-at-block-writes[d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.28]): orig_sources= new_sources= 2024-09-14T11:36:02.289 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:02.290+0000 7f3ac688b9c0 20 handle_bi_update(): bucket=:error-at-block-writes[d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.28]): potential sources added=[] removed=[] 2024-09-14T11:36:02.289 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:02.290+0000 7f3ac688b9c0 20 handle_bi_update(): bucket=:error-at-block-writes[d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.28]): orig_dests= new_dests= 2024-09-14T11:36:02.289 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:02.290+0000 7f3ac688b9c0 20 handle_bi_update(): bucket=:error-at-block-writes[d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.28]): potential dests added=[] removed=[] 2024-09-14T11:36:02.293 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:02.294+0000 7f3ac688b9c0 1 execute INFO: reshard of bucket "error-at-block-writes" from 11 shards to 12 shards completed successfully 2024-09-14T11:36:02.296 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:02.298+0000 7f397a7e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:36:02.301 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:02.302+0000 7f3ac688b9c0 20 remove_watcher() i=0 2024-09-14T11:36:02.301 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:02.302+0000 7f3ac688b9c0 2 removed watcher, disabling cache 2024-09-14T11:36:02.304 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:02.306+0000 7f3ac688b9c0 20 remove_watcher() i=1 2024-09-14T11:36:02.306 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:02.306+0000 7f3ac688b9c0 20 remove_watcher() i=2 2024-09-14T11:36:02.308 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:02.310+0000 7f3ac688b9c0 20 remove_watcher() i=3 2024-09-14T11:36:02.311 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:02.310+0000 7f3ac688b9c0 20 remove_watcher() i=4 2024-09-14T11:36:02.312 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:02.314+0000 7f3ac688b9c0 20 remove_watcher() i=5 2024-09-14T11:36:02.314 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:02.314+0000 7f3ac688b9c0 20 remove_watcher() i=6 2024-09-14T11:36:02.315 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:02.318+0000 7f3ac688b9c0 20 remove_watcher() i=7 2024-09-14T11:36:02.330 INFO:tasks.workunit.client.0.smithi138.stderr:radosgw-admin bucket stats --bucket error-at-block-writes 2024-09-14T11:36:02.359 INFO:tasks.workunit.client.0.smithi138.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:36:02.359 INFO:tasks.workunit.client.0.smithi138.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:36:02.403 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:02.406+0000 7fcbcc9119c0 20 rados->read ofs=0 len=0 2024-09-14T11:36:02.405 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:02.406+0000 7fcbcc9119c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:36:02.405 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:02.406+0000 7fcbcc9119c0 20 realm 2024-09-14T11:36:02.405 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:02.406+0000 7fcbcc9119c0 20 rados->read ofs=0 len=0 2024-09-14T11:36:02.405 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:02.406+0000 7fcbcc9119c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:36:02.406 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:02.406+0000 7fcbcc9119c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:36:02.406 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:02.406+0000 7fcbcc9119c0 20 rados->read ofs=0 len=0 2024-09-14T11:36:02.406 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:02.406+0000 7fcbcc9119c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:36:02.406 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:02.406+0000 7fcbcc9119c0 20 rados->read ofs=0 len=0 2024-09-14T11:36:02.407 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:02.410+0000 7fcbcc9119c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:36:02.407 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:02.410+0000 7fcbcc9119c0 20 rados->read ofs=0 len=0 2024-09-14T11:36:02.408 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:02.410+0000 7fcbcc9119c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:36:02.408 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:02.410+0000 7fcbcc9119c0 20 searching for the correct realm 2024-09-14T11:36:02.412 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:02.414+0000 7fcbcac18640 0 -- 172.21.15.138:0/1418468179 >> [v2:172.21.15.154:6824/416768175,v1:172.21.15.154:6825/416768175] conn(0x7fcbc4030070 msgr2=0x7fcbc400b660 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-14T11:36:02.419 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:02.422+0000 7fcbc9c16640 0 -- 172.21.15.138:0/1418468179 >> [v2:172.21.15.138:6816/326481658,v1:172.21.15.138:6817/326481658] conn(0x7fcbc40a21c0 msgr2=0x7fcbc406a1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-14T11:36:02.638 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:02.638+0000 7fcbcc9119c0 20 RGWRados::pool_iterate: got zone_info.d9e72d30-c60b-4d0d-9267-fdc36392d5ad 2024-09-14T11:36:02.638 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:02.638+0000 7fcbcc9119c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:36:02.638 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:02.638+0000 7fcbcc9119c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:36:02.639 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:02.638+0000 7fcbcc9119c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:36:02.639 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:02.638+0000 7fcbcc9119c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:36:02.639 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:02.638+0000 7fcbcc9119c0 20 RGWRados::pool_iterate: got zonegroup_info.65ab941b-da8c-4160-94fb-3672b069d44f 2024-09-14T11:36:02.639 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:02.638+0000 7fcbcc9119c0 20 rados->read ofs=0 len=0 2024-09-14T11:36:02.639 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:02.642+0000 7fcbcc9119c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:36:02.639 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:02.642+0000 7fcbcc9119c0 20 rados->read ofs=0 len=0 2024-09-14T11:36:02.640 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:02.642+0000 7fcbcc9119c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:36:02.640 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:02.642+0000 7fcbcc9119c0 20 rados->read ofs=0 len=0 2024-09-14T11:36:02.641 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:02.642+0000 7fcbcc9119c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:36:02.641 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:02.642+0000 7fcbcc9119c0 20 zone default found 2024-09-14T11:36:02.641 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:02.642+0000 7fcbcc9119c0 4 Realm: () 2024-09-14T11:36:02.641 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:02.642+0000 7fcbcc9119c0 4 ZoneGroup: default (65ab941b-da8c-4160-94fb-3672b069d44f) 2024-09-14T11:36:02.641 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:02.642+0000 7fcbcc9119c0 4 Zone: default (d9e72d30-c60b-4d0d-9267-fdc36392d5ad) 2024-09-14T11:36:02.641 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:02.642+0000 7fcbcc9119c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:36:02.641 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:02.642+0000 7fcbcc9119c0 20 zonegroup default 2024-09-14T11:36:02.641 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:02.642+0000 7fcbcc9119c0 20 rados->read ofs=0 len=0 2024-09-14T11:36:02.642 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:02.642+0000 7fcbcc9119c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:36:02.642 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:02.642+0000 7fcbcc9119c0 20 rados->read ofs=0 len=0 2024-09-14T11:36:02.642 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:02.642+0000 7fcbcc9119c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:36:02.642 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:02.642+0000 7fcbcc9119c0 20 rados->read ofs=0 len=0 2024-09-14T11:36:02.643 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:02.646+0000 7fcbcc9119c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:36:02.643 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:02.646+0000 7fcbcc9119c0 20 started sync module instance, tier type = 2024-09-14T11:36:02.643 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:02.646+0000 7fcbcc9119c0 20 started zone id=d9e72d30-c60b-4d0d-9267-fdc36392d5ad (name=default) with tier type = 2024-09-14T11:36:02.666 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:02.666+0000 7fcbcc9119c0 20 add_watcher() i=0 2024-09-14T11:36:02.666 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:02.666+0000 7fcbcc9119c0 20 add_watcher() i=1 2024-09-14T11:36:02.666 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:02.666+0000 7fcbcc9119c0 20 add_watcher() i=2 2024-09-14T11:36:02.666 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:02.666+0000 7fcbcc9119c0 20 add_watcher() i=3 2024-09-14T11:36:02.667 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:02.666+0000 7fcbcc9119c0 20 add_watcher() i=4 2024-09-14T11:36:02.667 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:02.666+0000 7fcbcc9119c0 20 add_watcher() i=5 2024-09-14T11:36:02.667 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:02.666+0000 7fcbcc9119c0 20 add_watcher() i=6 2024-09-14T11:36:02.669 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:02.670+0000 7fcbcc9119c0 20 add_watcher() i=7 2024-09-14T11:36:02.669 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:02.670+0000 7fcbcc9119c0 2 all 8 watchers are set, enabling cache 2024-09-14T11:36:02.673 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:02.674+0000 7fca80fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:36:02.674 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:02.674+0000 7fcbcc9119c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:36:02.674 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:02.674+0000 7fcbcc9119c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:36:02.674 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:02.674+0000 7fcbcc9119c0 5 note: GC not initialized 2024-09-14T11:36:02.674 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:02.674+0000 7fc9fb7fe640 20 reqs_thread_entry: start 2024-09-14T11:36:02.675 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:02.674+0000 7fcbcc9119c0 20 init_complete bucket index max shards: 11 2024-09-14T11:36:02.675 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:02.674+0000 7fcbcc9119c0 20 Filter name: none 2024-09-14T11:36:02.675 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:02.678+0000 7fc9f97fa640 20 reqs_thread_entry: start 2024-09-14T11:36:02.675 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:02.678+0000 7fcbcc9119c0 20 rados->read ofs=0 len=0 2024-09-14T11:36:02.677 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:02.678+0000 7fcbcc9119c0 20 rados_obj.operate() r=0 bl.length=189 2024-09-14T11:36:02.677 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:02.678+0000 7fcbcc9119c0 20 rados->read ofs=0 len=0 2024-09-14T11:36:02.677 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:02.678+0000 7fcbcc9119c0 20 rados_obj.operate() r=0 bl.length=411 2024-09-14T11:36:02.677 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:02.678+0000 7fcbcc9119c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:36:02.677 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:02.678+0000 7fcbcc9119c0 20 rados->read ofs=0 len=0 2024-09-14T11:36:02.678 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:02.678+0000 7fcbcc9119c0 20 rados_obj.operate() r=0 bl.length=189 2024-09-14T11:36:02.678 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:02.678+0000 7fcbcc9119c0 20 rados->read ofs=0 len=0 2024-09-14T11:36:02.679 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:02.682+0000 7fcbcc9119c0 20 rados_obj.operate() r=0 bl.length=411 2024-09-14T11:36:02.679 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:02.682+0000 7fcbcc9119c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:36:02.682 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:02.682+0000 7fca80fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:36:02.687 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:02.690+0000 7fcbcc9119c0 20 remove_watcher() i=0 2024-09-14T11:36:02.688 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:02.690+0000 7fcbcc9119c0 2 removed watcher, disabling cache 2024-09-14T11:36:02.690 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:02.690+0000 7fcbcc9119c0 20 remove_watcher() i=1 2024-09-14T11:36:02.692 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:02.694+0000 7fcbcc9119c0 20 remove_watcher() i=2 2024-09-14T11:36:02.694 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:02.694+0000 7fcbcc9119c0 20 remove_watcher() i=3 2024-09-14T11:36:02.697 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:02.698+0000 7fcbcc9119c0 20 remove_watcher() i=4 2024-09-14T11:36:02.698 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:02.698+0000 7fcbcc9119c0 20 remove_watcher() i=5 2024-09-14T11:36:02.700 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:02.702+0000 7fcbcc9119c0 20 remove_watcher() i=6 2024-09-14T11:36:02.701 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:02.702+0000 7fcbcc9119c0 20 remove_watcher() i=7 2024-09-14T11:36:02.717 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-14T11:36:02.717 INFO:tasks.workunit.client.0.smithi138.stderr:BUCKET_STATS: 2024-09-14T11:36:02.717 INFO:tasks.workunit.client.0.smithi138.stderr:bucket: error-at-block-writes id: d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.28 num_objects: 19 size_kb: 1 num_shards: 12 2024-09-14T11:36:02.718 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-14T11:36:02.719 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:36:02.719 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-14T11:36:02.745 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:36:02.745 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-14T11:36:03.185 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:36:03.185 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-14T11:36:03.562 INFO:tasks.workunit.client.0.smithi138.stderr:TEST: reshard bucket with abort at block_writes 2024-09-14T11:36:03.563 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-14T11:36:03.568 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:36:03.568 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-14T11:36:03.707 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:36:03.707 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-14T11:36:03.795 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:36:03.795 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-14T11:36:03.898 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:36:03.898 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-14T11:36:03.991 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:36:03.991 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-14T11:36:04.075 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:36:04.075 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-14T11:36:04.160 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:36:04.161 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-14T11:36:04.243 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:36:04.243 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-14T11:36:04.338 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:36:04.338 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-14T11:36:04.430 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:36:04.430 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-14T11:36:04.527 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:36:04.527 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-14T11:36:04.616 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:36:04.616 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-14T11:36:04.708 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:36:04.708 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-14T11:36:04.795 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:36:04.795 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-14T11:36:04.890 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:36:04.890 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-14T11:36:04.988 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:36:04.988 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-14T11:36:05.080 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:36:05.081 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-14T11:36:05.176 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:36:05.176 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-14T11:36:05.267 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:36:05.267 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-14T11:36:05.358 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:36:05.358 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-14T11:36:05.444 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:36:05.444 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-14T11:36:05.539 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:36:05.539 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-14T11:36:05.633 INFO:tasks.workunit.client.0.smithi138.stderr:radosgw-admin bucket stats --bucket abort-at-block-writes 2024-09-14T11:36:05.666 INFO:tasks.workunit.client.0.smithi138.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:36:05.666 INFO:tasks.workunit.client.0.smithi138.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:36:05.711 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:05.714+0000 7fe6ca8c19c0 20 rados->read ofs=0 len=0 2024-09-14T11:36:05.713 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:05.714+0000 7fe6ca8c19c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:36:05.713 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:05.714+0000 7fe6ca8c19c0 20 realm 2024-09-14T11:36:05.714 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:05.714+0000 7fe6ca8c19c0 20 rados->read ofs=0 len=0 2024-09-14T11:36:05.714 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:05.714+0000 7fe6ca8c19c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:36:05.714 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:05.714+0000 7fe6ca8c19c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:36:05.714 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:05.714+0000 7fe6ca8c19c0 20 rados->read ofs=0 len=0 2024-09-14T11:36:05.714 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:05.714+0000 7fe6ca8c19c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:36:05.714 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:05.714+0000 7fe6ca8c19c0 20 rados->read ofs=0 len=0 2024-09-14T11:36:05.715 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:05.718+0000 7fe6ca8c19c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:36:05.715 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:05.718+0000 7fe6ca8c19c0 20 rados->read ofs=0 len=0 2024-09-14T11:36:05.716 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:05.718+0000 7fe6ca8c19c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:36:05.716 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:05.718+0000 7fe6ca8c19c0 20 searching for the correct realm 2024-09-14T11:36:05.719 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:05.722+0000 7fe6c8bc8640 0 -- 172.21.15.138:0/2704085519 >> [v2:172.21.15.154:6824/416768175,v1:172.21.15.154:6825/416768175] conn(0x7fe6c0078030 msgr2=0x7fe6c004e710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-14T11:36:05.936 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:05.938+0000 7fe6c7bc6640 0 -- 172.21.15.138:0/2704085519 >> [v2:172.21.15.138:6816/326481658,v1:172.21.15.138:6817/326481658] conn(0x7fe6c007e2b0 msgr2=0x7fe6c007e9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:36:06.154 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:06.154+0000 7fe6ca8c19c0 20 RGWRados::pool_iterate: got zone_info.d9e72d30-c60b-4d0d-9267-fdc36392d5ad 2024-09-14T11:36:06.155 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:06.154+0000 7fe6ca8c19c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:36:06.155 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:06.154+0000 7fe6ca8c19c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:36:06.155 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:06.154+0000 7fe6ca8c19c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:36:06.155 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:06.154+0000 7fe6ca8c19c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:36:06.155 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:06.154+0000 7fe6ca8c19c0 20 RGWRados::pool_iterate: got zonegroup_info.65ab941b-da8c-4160-94fb-3672b069d44f 2024-09-14T11:36:06.155 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:06.154+0000 7fe6ca8c19c0 20 rados->read ofs=0 len=0 2024-09-14T11:36:06.156 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:06.158+0000 7fe6ca8c19c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:36:06.156 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:06.158+0000 7fe6ca8c19c0 20 rados->read ofs=0 len=0 2024-09-14T11:36:06.156 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:06.158+0000 7fe6ca8c19c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:36:06.156 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:06.158+0000 7fe6ca8c19c0 20 rados->read ofs=0 len=0 2024-09-14T11:36:06.157 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:06.158+0000 7fe6ca8c19c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:36:06.157 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:06.158+0000 7fe6ca8c19c0 20 zone default found 2024-09-14T11:36:06.157 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:06.158+0000 7fe6ca8c19c0 4 Realm: () 2024-09-14T11:36:06.157 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:06.158+0000 7fe6ca8c19c0 4 ZoneGroup: default (65ab941b-da8c-4160-94fb-3672b069d44f) 2024-09-14T11:36:06.157 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:06.158+0000 7fe6ca8c19c0 4 Zone: default (d9e72d30-c60b-4d0d-9267-fdc36392d5ad) 2024-09-14T11:36:06.157 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:06.158+0000 7fe6ca8c19c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:36:06.157 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:06.158+0000 7fe6ca8c19c0 20 zonegroup default 2024-09-14T11:36:06.157 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:06.158+0000 7fe6ca8c19c0 20 rados->read ofs=0 len=0 2024-09-14T11:36:06.158 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:06.158+0000 7fe6ca8c19c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:36:06.158 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:06.158+0000 7fe6ca8c19c0 20 rados->read ofs=0 len=0 2024-09-14T11:36:06.158 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:06.158+0000 7fe6ca8c19c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:36:06.158 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:06.158+0000 7fe6ca8c19c0 20 rados->read ofs=0 len=0 2024-09-14T11:36:06.159 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:06.158+0000 7fe6ca8c19c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:36:06.159 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:06.162+0000 7fe6ca8c19c0 20 started sync module instance, tier type = 2024-09-14T11:36:06.159 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:06.162+0000 7fe6ca8c19c0 20 started zone id=d9e72d30-c60b-4d0d-9267-fdc36392d5ad (name=default) with tier type = 2024-09-14T11:36:06.181 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:06.182+0000 7fe6ca8c19c0 20 add_watcher() i=0 2024-09-14T11:36:06.181 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:06.182+0000 7fe6ca8c19c0 20 add_watcher() i=1 2024-09-14T11:36:06.181 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:06.182+0000 7fe6ca8c19c0 20 add_watcher() i=2 2024-09-14T11:36:06.181 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:06.182+0000 7fe6ca8c19c0 20 add_watcher() i=3 2024-09-14T11:36:06.181 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:06.182+0000 7fe6ca8c19c0 20 add_watcher() i=4 2024-09-14T11:36:06.181 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:06.182+0000 7fe6ca8c19c0 20 add_watcher() i=5 2024-09-14T11:36:06.182 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:06.182+0000 7fe6ca8c19c0 20 add_watcher() i=6 2024-09-14T11:36:06.183 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:06.186+0000 7fe6ca8c19c0 20 add_watcher() i=7 2024-09-14T11:36:06.183 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:06.186+0000 7fe6ca8c19c0 2 all 8 watchers are set, enabling cache 2024-09-14T11:36:06.187 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:06.190+0000 7fe57e7e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:36:06.188 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:06.190+0000 7fe6ca8c19c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:36:06.188 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:06.190+0000 7fe6ca8c19c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:36:06.188 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:06.190+0000 7fe6ca8c19c0 5 note: GC not initialized 2024-09-14T11:36:06.189 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:06.190+0000 7fe57d7e2640 20 reqs_thread_entry: start 2024-09-14T11:36:06.189 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:06.190+0000 7fe6ca8c19c0 20 init_complete bucket index max shards: 11 2024-09-14T11:36:06.189 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:06.190+0000 7fe6ca8c19c0 20 Filter name: none 2024-09-14T11:36:06.189 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:06.190+0000 7fe4eeffd640 20 reqs_thread_entry: start 2024-09-14T11:36:06.189 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:06.190+0000 7fe6ca8c19c0 20 rados->read ofs=0 len=0 2024-09-14T11:36:06.190 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:06.190+0000 7fe6ca8c19c0 20 rados_obj.operate() r=0 bl.length=189 2024-09-14T11:36:06.190 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:06.190+0000 7fe6ca8c19c0 20 rados->read ofs=0 len=0 2024-09-14T11:36:06.192 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:06.194+0000 7fe6ca8c19c0 20 rados_obj.operate() r=0 bl.length=411 2024-09-14T11:36:06.192 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:06.194+0000 7fe6ca8c19c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:36:06.192 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:06.194+0000 7fe6ca8c19c0 20 rados->read ofs=0 len=0 2024-09-14T11:36:06.192 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:06.194+0000 7fe6ca8c19c0 20 rados_obj.operate() r=0 bl.length=189 2024-09-14T11:36:06.193 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:06.194+0000 7fe6ca8c19c0 20 rados->read ofs=0 len=0 2024-09-14T11:36:06.193 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:06.194+0000 7fe6ca8c19c0 20 rados_obj.operate() r=0 bl.length=411 2024-09-14T11:36:06.194 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:06.194+0000 7fe6ca8c19c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:36:06.197 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:06.198+0000 7fe57e7e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:36:06.202 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:06.202+0000 7fe6ca8c19c0 20 remove_watcher() i=0 2024-09-14T11:36:06.202 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:06.202+0000 7fe6ca8c19c0 2 removed watcher, disabling cache 2024-09-14T11:36:06.205 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:06.206+0000 7fe6ca8c19c0 20 remove_watcher() i=1 2024-09-14T11:36:06.207 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:06.210+0000 7fe6ca8c19c0 20 remove_watcher() i=2 2024-09-14T11:36:06.209 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:06.210+0000 7fe6ca8c19c0 20 remove_watcher() i=3 2024-09-14T11:36:06.212 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:06.214+0000 7fe6ca8c19c0 20 remove_watcher() i=4 2024-09-14T11:36:06.214 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:06.214+0000 7fe6ca8c19c0 20 remove_watcher() i=5 2024-09-14T11:36:06.215 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:06.218+0000 7fe6ca8c19c0 20 remove_watcher() i=6 2024-09-14T11:36:06.217 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:06.218+0000 7fe6ca8c19c0 20 remove_watcher() i=7 2024-09-14T11:36:06.232 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-14T11:36:06.232 INFO:tasks.workunit.client.0.smithi138.stderr:BUCKET_STATS: 2024-09-14T11:36:06.232 INFO:tasks.workunit.client.0.smithi138.stderr:bucket: abort-at-block-writes id: d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.29 num_objects: 20 size_kb: 1 num_shards: 11 2024-09-14T11:36:06.232 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-14T11:36:06.232 INFO:tasks.workunit.client.0.smithi138.stderr:radosgw-admin bucket reshard --bucket abort-at-block-writes --num-shards 12 --rgw-reshard-bucket-lock-duration 30 --inject-abort-at block_writes 2024-09-14T11:36:06.267 INFO:tasks.workunit.client.0.smithi138.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:36:06.267 INFO:tasks.workunit.client.0.smithi138.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:36:06.314 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:06.314+0000 7f9b22f269c0 20 rados->read ofs=0 len=0 2024-09-14T11:36:06.315 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:06.318+0000 7f9b22f269c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:36:06.316 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:06.318+0000 7f9b22f269c0 20 realm 2024-09-14T11:36:06.316 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:06.318+0000 7f9b22f269c0 20 rados->read ofs=0 len=0 2024-09-14T11:36:06.316 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:06.318+0000 7f9b22f269c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:36:06.316 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:06.318+0000 7f9b22f269c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:36:06.316 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:06.318+0000 7f9b22f269c0 20 rados->read ofs=0 len=0 2024-09-14T11:36:06.316 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:06.318+0000 7f9b22f269c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:36:06.316 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:06.318+0000 7f9b22f269c0 20 rados->read ofs=0 len=0 2024-09-14T11:36:06.317 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:06.318+0000 7f9b22f269c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:36:06.317 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:06.318+0000 7f9b22f269c0 20 rados->read ofs=0 len=0 2024-09-14T11:36:06.318 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:06.318+0000 7f9b22f269c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:36:06.318 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:06.318+0000 7f9b22f269c0 20 searching for the correct realm 2024-09-14T11:36:06.319 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:06.322+0000 7f9b2022b640 0 -- 172.21.15.138:0/965841732 >> [v2:172.21.15.154:6808/1468088432,v1:172.21.15.154:6809/1468088432] conn(0x7f9b10058020 msgr2=0x7f9b1008b850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:36:06.534 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:06.534+0000 7f9b2122d640 0 -- 172.21.15.138:0/965841732 >> [v2:172.21.15.138:6824/2633984942,v1:172.21.15.138:6825/2633984942] conn(0x565006a48070 msgr2=0x565006a4a460 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:36:06.552 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:06.554+0000 7f9b22f269c0 20 RGWRados::pool_iterate: got zone_info.d9e72d30-c60b-4d0d-9267-fdc36392d5ad 2024-09-14T11:36:06.552 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:06.554+0000 7f9b22f269c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:36:06.552 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:06.554+0000 7f9b22f269c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:36:06.552 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:06.554+0000 7f9b22f269c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:36:06.552 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:06.554+0000 7f9b22f269c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:36:06.552 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:06.554+0000 7f9b22f269c0 20 RGWRados::pool_iterate: got zonegroup_info.65ab941b-da8c-4160-94fb-3672b069d44f 2024-09-14T11:36:06.552 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:06.554+0000 7f9b22f269c0 20 rados->read ofs=0 len=0 2024-09-14T11:36:06.553 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:06.554+0000 7f9b22f269c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:36:06.553 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:06.554+0000 7f9b22f269c0 20 rados->read ofs=0 len=0 2024-09-14T11:36:06.553 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:06.554+0000 7f9b22f269c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:36:06.553 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:06.554+0000 7f9b22f269c0 20 rados->read ofs=0 len=0 2024-09-14T11:36:06.554 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:06.554+0000 7f9b22f269c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:36:06.554 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:06.554+0000 7f9b22f269c0 20 zone default found 2024-09-14T11:36:06.554 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:06.554+0000 7f9b22f269c0 4 Realm: () 2024-09-14T11:36:06.555 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:06.554+0000 7f9b22f269c0 4 ZoneGroup: default (65ab941b-da8c-4160-94fb-3672b069d44f) 2024-09-14T11:36:06.555 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:06.554+0000 7f9b22f269c0 4 Zone: default (d9e72d30-c60b-4d0d-9267-fdc36392d5ad) 2024-09-14T11:36:06.555 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:06.554+0000 7f9b22f269c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:36:06.555 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:06.554+0000 7f9b22f269c0 20 zonegroup default 2024-09-14T11:36:06.555 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:06.554+0000 7f9b22f269c0 20 rados->read ofs=0 len=0 2024-09-14T11:36:06.555 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:06.558+0000 7f9b22f269c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:36:06.555 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:06.558+0000 7f9b22f269c0 20 rados->read ofs=0 len=0 2024-09-14T11:36:06.556 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:06.558+0000 7f9b22f269c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:36:06.556 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:06.558+0000 7f9b22f269c0 20 rados->read ofs=0 len=0 2024-09-14T11:36:06.556 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:06.558+0000 7f9b22f269c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:36:06.556 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:06.558+0000 7f9b22f269c0 20 started sync module instance, tier type = 2024-09-14T11:36:06.556 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:06.558+0000 7f9b22f269c0 20 started zone id=d9e72d30-c60b-4d0d-9267-fdc36392d5ad (name=default) with tier type = 2024-09-14T11:36:06.579 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:06.582+0000 7f9b22f269c0 20 add_watcher() i=0 2024-09-14T11:36:06.579 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:06.582+0000 7f9b22f269c0 20 add_watcher() i=1 2024-09-14T11:36:06.579 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:06.582+0000 7f9b22f269c0 20 add_watcher() i=2 2024-09-14T11:36:06.579 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:06.582+0000 7f9b22f269c0 20 add_watcher() i=3 2024-09-14T11:36:06.579 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:06.582+0000 7f9b22f269c0 20 add_watcher() i=4 2024-09-14T11:36:06.579 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:06.582+0000 7f9b22f269c0 20 add_watcher() i=5 2024-09-14T11:36:06.579 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:06.582+0000 7f9b22f269c0 20 add_watcher() i=6 2024-09-14T11:36:06.581 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:06.582+0000 7f9b22f269c0 20 add_watcher() i=7 2024-09-14T11:36:06.581 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:06.582+0000 7f9b22f269c0 2 all 8 watchers are set, enabling cache 2024-09-14T11:36:06.585 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:06.586+0000 7f99d2fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:36:06.586 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:06.586+0000 7f9b22f269c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:36:06.586 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:06.586+0000 7f9b22f269c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:36:06.586 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:06.586+0000 7f9b22f269c0 5 note: GC not initialized 2024-09-14T11:36:06.587 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:06.586+0000 7f99d1fe3640 20 reqs_thread_entry: start 2024-09-14T11:36:06.587 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:06.586+0000 7f9b22f269c0 20 init_complete bucket index max shards: 11 2024-09-14T11:36:06.587 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:06.586+0000 7f9b22f269c0 20 Filter name: none 2024-09-14T11:36:06.587 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:06.590+0000 7f99437fe640 20 reqs_thread_entry: start 2024-09-14T11:36:06.587 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:06.590+0000 7f9b22f269c0 10 cache get: name=default.rgw.meta+root+abort-at-block-writes : miss 2024-09-14T11:36:06.587 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:06.590+0000 7f9b22f269c0 20 rados->read ofs=0 len=0 2024-09-14T11:36:06.588 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:06.590+0000 7f9b22f269c0 20 rados_obj.operate() r=0 bl.length=189 2024-09-14T11:36:06.588 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:06.590+0000 7f9b22f269c0 10 cache put: name=default.rgw.meta+root+abort-at-block-writes info.flags=0x11 2024-09-14T11:36:06.588 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:06.590+0000 7f9b22f269c0 10 adding default.rgw.meta+root+abort-at-block-writes to cache LRU end 2024-09-14T11:36:06.588 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:06.590+0000 7f9b22f269c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.29 : miss 2024-09-14T11:36:06.588 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:06.590+0000 7f9b22f269c0 20 rados->read ofs=0 len=0 2024-09-14T11:36:06.589 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:06.590+0000 7f9b22f269c0 20 rados_obj.operate() r=0 bl.length=411 2024-09-14T11:36:06.589 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:06.590+0000 7f9b22f269c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.29 info.flags=0x17 2024-09-14T11:36:06.589 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:06.590+0000 7f9b22f269c0 10 adding default.rgw.meta+root+.bucket.meta.abort-at-block-writes:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.29 to cache LRU end 2024-09-14T11:36:06.589 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:06.590+0000 7f9b22f269c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:36:06.589 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:06.590+0000 7f9b22f269c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:36:06.589 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:06.590+0000 7f9b22f269c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.29 2024-09-14T11:36:06.601 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:06.602+0000 7f9b22f269c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.29 info.flags=0x17 2024-09-14T11:36:06.601 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:06.602+0000 7f9b22f269c0 10 moving default.rgw.meta+root+.bucket.meta.abort-at-block-writes:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.29 to cache LRU end 2024-09-14T11:36:06.601 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:06.602+0000 7f9b22f269c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:36:06.601 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:06.602+0000 7f9b22f269c0 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-block-writes:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.29, ofs0, ns] 2024-09-14T11:36:06.601 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:06.602+0000 7f99effff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366227 cookie 94901708849344 notifier 7011 bl.length()=915 2024-09-14T11:36:06.602 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:06.602+0000 7f99effff640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.29 info.flags=0x17 2024-09-14T11:36:06.602 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:06.602+0000 7f99effff640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-block-writes:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.29 to cache LRU end 2024-09-14T11:36:06.602 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:06.602+0000 7f99effff640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:36:06.604 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:06.606+0000 7f9b22f269c0 20 handle_bi_update(): bucket=:abort-at-block-writes[d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.29]): orig_sources= new_sources= 2024-09-14T11:36:06.604 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:06.606+0000 7f9b22f269c0 20 handle_bi_update(): bucket=:abort-at-block-writes[d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.29]): potential sources added=[] removed=[] 2024-09-14T11:36:06.604 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:06.606+0000 7f9b22f269c0 20 handle_bi_update(): bucket=:abort-at-block-writes[d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.29]): orig_dests= new_dests= 2024-09-14T11:36:06.604 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:06.606+0000 7f9b22f269c0 20 handle_bi_update(): bucket=:abort-at-block-writes[d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.29]): potential dests added=[] removed=[] 2024-09-14T11:36:06.618 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:06.618+0000 7f9b22f269c0 10 bucket_obj is .dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.29.1.0 2024-09-14T11:36:06.618 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:06.618+0000 7f9b22f269c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.29.1.0 2024-09-14T11:36:06.618 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:06.618+0000 7f9b22f269c0 10 bucket_obj is .dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.29.1.1 2024-09-14T11:36:06.618 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:06.618+0000 7f9b22f269c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.29.1.1 2024-09-14T11:36:06.618 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:06.618+0000 7f9b22f269c0 10 bucket_obj is .dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.29.1.2 2024-09-14T11:36:06.618 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:06.618+0000 7f9b22f269c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.29.1.2 2024-09-14T11:36:06.618 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:06.618+0000 7f9b22f269c0 10 bucket_obj is .dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.29.1.3 2024-09-14T11:36:06.618 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:06.618+0000 7f9b22f269c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.29.1.3 2024-09-14T11:36:06.618 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:06.618+0000 7f9b22f269c0 10 bucket_obj is .dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.29.1.4 2024-09-14T11:36:06.618 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:06.618+0000 7f9b22f269c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.29.1.4 2024-09-14T11:36:06.618 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:06.618+0000 7f9b22f269c0 10 bucket_obj is .dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.29.1.5 2024-09-14T11:36:06.618 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:06.618+0000 7f9b22f269c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.29.1.5 2024-09-14T11:36:06.618 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:06.618+0000 7f9b22f269c0 10 bucket_obj is .dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.29.1.6 2024-09-14T11:36:06.619 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:06.618+0000 7f9b22f269c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.29.1.6 2024-09-14T11:36:06.619 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:06.618+0000 7f9b22f269c0 10 bucket_obj is .dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.29.1.7 2024-09-14T11:36:06.619 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:06.618+0000 7f9b22f269c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.29.1.7 2024-09-14T11:36:06.619 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:06.618+0000 7f9b22f269c0 10 bucket_obj is .dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.29.1.8 2024-09-14T11:36:06.619 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:06.618+0000 7f9b22f269c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.29.1.8 2024-09-14T11:36:06.619 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:06.618+0000 7f9b22f269c0 10 bucket_obj is .dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.29.1.9 2024-09-14T11:36:06.619 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:06.618+0000 7f9b22f269c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.29.1.9 2024-09-14T11:36:06.619 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:06.618+0000 7f9b22f269c0 10 bucket_obj is .dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.29.1.10 2024-09-14T11:36:06.619 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:06.618+0000 7f9b22f269c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.29.1.10 2024-09-14T11:36:06.619 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:06.618+0000 7f9b22f269c0 10 bucket_obj is .dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.29.1.11 2024-09-14T11:36:06.619 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:06.618+0000 7f9b22f269c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.29.1.11 2024-09-14T11:36:06.619 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:06.618+0000 7f9b22f269c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.29.0 2024-09-14T11:36:06.620 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:06.618+0000 7f9b22f269c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.29.1 2024-09-14T11:36:06.620 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:06.622+0000 7f9b22f269c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.29.2 2024-09-14T11:36:06.622 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:06.622+0000 7f9b22f269c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.29.3 2024-09-14T11:36:06.623 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:06.626+0000 7f9b22f269c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.29.4 2024-09-14T11:36:06.625 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:06.626+0000 7f9b22f269c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.29.5 2024-09-14T11:36:06.626 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:06.626+0000 7f9b22f269c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.29.6 2024-09-14T11:36:06.627 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:06.630+0000 7f9b22f269c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.29.7 2024-09-14T11:36:06.628 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:06.630+0000 7f9b22f269c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.29.8 2024-09-14T11:36:06.629 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:06.630+0000 7f9b22f269c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.29.9 2024-09-14T11:36:06.629 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:06.630+0000 7f9b22f269c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.29.10 2024-09-14T11:36:06.636 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:06.638+0000 7f9b22f269c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.29 : hit (requested=0x17, cached=0x17) 2024-09-14T11:36:06.637 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:06.638+0000 7f9b22f269c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.29 2024-09-14T11:36:06.639 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:06.642+0000 7f9b22f269c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.29 info.flags=0x17 2024-09-14T11:36:06.640 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:06.642+0000 7f9b22f269c0 10 moving default.rgw.meta+root+.bucket.meta.abort-at-block-writes:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.29 to cache LRU end 2024-09-14T11:36:06.640 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:06.642+0000 7f9b22f269c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:36:06.640 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:06.642+0000 7f9b22f269c0 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-block-writes:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.29, ofs0, ns] 2024-09-14T11:36:06.640 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:06.642+0000 7f99effff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366228 cookie 94901708849344 notifier 7011 bl.length()=915 2024-09-14T11:36:06.641 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:06.642+0000 7f99effff640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.29 info.flags=0x17 2024-09-14T11:36:06.641 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:06.642+0000 7f99effff640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-block-writes:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.29 to cache LRU end 2024-09-14T11:36:06.641 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:06.642+0000 7f99effff640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:36:06.643 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:06.646+0000 7f9b22f269c0 20 handle_bi_update(): bucket=:abort-at-block-writes[d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.29]): orig_sources= new_sources= 2024-09-14T11:36:06.643 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:06.646+0000 7f9b22f269c0 20 handle_bi_update(): bucket=:abort-at-block-writes[d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.29]): potential sources added=[] removed=[] 2024-09-14T11:36:06.643 INFO:tasks.workunit.client.0.smithi138.stderr:./src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f9b22f269c0 time 2024-09-14T11:36:06.649119+0000 2024-09-14T11:36:06.643 INFO:tasks.workunit.client.0.smithi138.stderr:./src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-14T11:36:06.643 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:06.646+0000 7f9b22f269c0 20 handle_bi_update(): bucket=:abort-at-block-writes[d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.29]): orig_dests= new_dests= 2024-09-14T11:36:06.643 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:06.646+0000 7f9b22f269c0 20 handle_bi_update(): bucket=:abort-at-block-writes[d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.29]): potential dests added=[] removed=[] 2024-09-14T11:36:06.644 INFO:tasks.workunit.client.0.smithi138.stderr: ceph version 19.3.0-4907-ga2782315 (a2782315255a3e7d5f6cdc9eb35785187ff6ddf8) squid (dev) 2024-09-14T11:36:06.644 INFO:tasks.workunit.client.0.smithi138.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x121) [0x7f9b268002eb] 2024-09-14T11:36:06.644 INFO:tasks.workunit.client.0.smithi138.stderr: 2: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7f9b2680049f] 2024-09-14T11:36:06.645 INFO:tasks.workunit.client.0.smithi138.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x565003dd5c01] 2024-09-14T11:36:06.645 INFO:tasks.workunit.client.0.smithi138.stderr: 4: (RGWBucketReshard::do_reshard(rgw::bucket_index_layout_generation const&, rgw::bucket_index_layout_generation const&, int, bool, bool, std::ostream*, ceph::Formatter*, FaultInjector > >&, DoutPrefixProvider const*, optional_yield)+0x147b) [0x565003dea29b] 2024-09-14T11:36:06.645 INFO:tasks.workunit.client.0.smithi138.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0xac4) [0x565003deb884] 2024-09-14T11:36:06.645 INFO:tasks.workunit.client.0.smithi138.stderr: 6: main() 2024-09-14T11:36:06.645 INFO:tasks.workunit.client.0.smithi138.stderr: 7: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7f9b25666d90] 2024-09-14T11:36:06.645 INFO:tasks.workunit.client.0.smithi138.stderr: 8: __libc_start_main() 2024-09-14T11:36:06.645 INFO:tasks.workunit.client.0.smithi138.stderr: 9: _start() 2024-09-14T11:36:06.645 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:06.646+0000 7f9b22f269c0 -1 ./src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f9b22f269c0 time 2024-09-14T11:36:06.649119+0000 2024-09-14T11:36:06.645 INFO:tasks.workunit.client.0.smithi138.stderr:./src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-14T11:36:06.645 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-14T11:36:06.645 INFO:tasks.workunit.client.0.smithi138.stderr: ceph version 19.3.0-4907-ga2782315 (a2782315255a3e7d5f6cdc9eb35785187ff6ddf8) squid (dev) 2024-09-14T11:36:06.645 INFO:tasks.workunit.client.0.smithi138.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x121) [0x7f9b268002eb] 2024-09-14T11:36:06.645 INFO:tasks.workunit.client.0.smithi138.stderr: 2: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7f9b2680049f] 2024-09-14T11:36:06.645 INFO:tasks.workunit.client.0.smithi138.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x565003dd5c01] 2024-09-14T11:36:06.646 INFO:tasks.workunit.client.0.smithi138.stderr: 4: (RGWBucketReshard::do_reshard(rgw::bucket_index_layout_generation const&, rgw::bucket_index_layout_generation const&, int, bool, bool, std::ostream*, ceph::Formatter*, FaultInjector > >&, DoutPrefixProvider const*, optional_yield)+0x147b) [0x565003dea29b] 2024-09-14T11:36:06.646 INFO:tasks.workunit.client.0.smithi138.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0xac4) [0x565003deb884] 2024-09-14T11:36:06.646 INFO:tasks.workunit.client.0.smithi138.stderr: 6: main() 2024-09-14T11:36:06.646 INFO:tasks.workunit.client.0.smithi138.stderr: 7: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7f9b25666d90] 2024-09-14T11:36:06.646 INFO:tasks.workunit.client.0.smithi138.stderr: 8: __libc_start_main() 2024-09-14T11:36:06.646 INFO:tasks.workunit.client.0.smithi138.stderr: 9: _start() 2024-09-14T11:36:06.646 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-14T11:36:06.646 INFO:tasks.workunit.client.0.smithi138.stderr:*** Caught signal (Aborted) ** 2024-09-14T11:36:06.646 INFO:tasks.workunit.client.0.smithi138.stderr: in thread 7f9b22f269c0 thread_name:radosgw-admin 2024-09-14T11:36:06.651 INFO:tasks.workunit.client.0.smithi138.stderr: ceph version 19.3.0-4907-ga2782315 (a2782315255a3e7d5f6cdc9eb35785187ff6ddf8) squid (dev) 2024-09-14T11:36:06.651 INFO:tasks.workunit.client.0.smithi138.stderr: 1: /lib/x86_64-linux-gnu/libc.so.6(+0x42520) [0x7f9b2567f520] 2024-09-14T11:36:06.651 INFO:tasks.workunit.client.0.smithi138.stderr: 2: pthread_kill() 2024-09-14T11:36:06.651 INFO:tasks.workunit.client.0.smithi138.stderr: 3: raise() 2024-09-14T11:36:06.651 INFO:tasks.workunit.client.0.smithi138.stderr: 4: abort() 2024-09-14T11:36:06.651 INFO:tasks.workunit.client.0.smithi138.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x17b) [0x7f9b26800345] 2024-09-14T11:36:06.651 INFO:tasks.workunit.client.0.smithi138.stderr: 6: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7f9b2680049f] 2024-09-14T11:36:06.651 INFO:tasks.workunit.client.0.smithi138.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x565003dd5c01] 2024-09-14T11:36:06.651 INFO:tasks.workunit.client.0.smithi138.stderr: 8: (RGWBucketReshard::do_reshard(rgw::bucket_index_layout_generation const&, rgw::bucket_index_layout_generation const&, int, bool, bool, std::ostream*, ceph::Formatter*, FaultInjector > >&, DoutPrefixProvider const*, optional_yield)+0x147b) [0x565003dea29b] 2024-09-14T11:36:06.652 INFO:tasks.workunit.client.0.smithi138.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0xac4) [0x565003deb884] 2024-09-14T11:36:06.652 INFO:tasks.workunit.client.0.smithi138.stderr: 10: main() 2024-09-14T11:36:06.652 INFO:tasks.workunit.client.0.smithi138.stderr: 11: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7f9b25666d90] 2024-09-14T11:36:06.652 INFO:tasks.workunit.client.0.smithi138.stderr: 12: __libc_start_main() 2024-09-14T11:36:06.652 INFO:tasks.workunit.client.0.smithi138.stderr: 13: _start() 2024-09-14T11:36:06.652 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:06.646+0000 7f9b22f269c0 -1 *** Caught signal (Aborted) ** 2024-09-14T11:36:06.652 INFO:tasks.workunit.client.0.smithi138.stderr: in thread 7f9b22f269c0 thread_name:radosgw-admin 2024-09-14T11:36:06.652 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-14T11:36:06.652 INFO:tasks.workunit.client.0.smithi138.stderr: ceph version 19.3.0-4907-ga2782315 (a2782315255a3e7d5f6cdc9eb35785187ff6ddf8) squid (dev) 2024-09-14T11:36:06.652 INFO:tasks.workunit.client.0.smithi138.stderr: 1: /lib/x86_64-linux-gnu/libc.so.6(+0x42520) [0x7f9b2567f520] 2024-09-14T11:36:06.652 INFO:tasks.workunit.client.0.smithi138.stderr: 2: pthread_kill() 2024-09-14T11:36:06.652 INFO:tasks.workunit.client.0.smithi138.stderr: 3: raise() 2024-09-14T11:36:06.652 INFO:tasks.workunit.client.0.smithi138.stderr: 4: abort() 2024-09-14T11:36:06.653 INFO:tasks.workunit.client.0.smithi138.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x17b) [0x7f9b26800345] 2024-09-14T11:36:06.653 INFO:tasks.workunit.client.0.smithi138.stderr: 6: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7f9b2680049f] 2024-09-14T11:36:06.653 INFO:tasks.workunit.client.0.smithi138.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x565003dd5c01] 2024-09-14T11:36:06.653 INFO:tasks.workunit.client.0.smithi138.stderr: 8: (RGWBucketReshard::do_reshard(rgw::bucket_index_layout_generation const&, rgw::bucket_index_layout_generation const&, int, bool, bool, std::ostream*, ceph::Formatter*, FaultInjector > >&, DoutPrefixProvider const*, optional_yield)+0x147b) [0x565003dea29b] 2024-09-14T11:36:06.653 INFO:tasks.workunit.client.0.smithi138.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0xac4) [0x565003deb884] 2024-09-14T11:36:06.653 INFO:tasks.workunit.client.0.smithi138.stderr: 10: main() 2024-09-14T11:36:06.653 INFO:tasks.workunit.client.0.smithi138.stderr: 11: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7f9b25666d90] 2024-09-14T11:36:06.653 INFO:tasks.workunit.client.0.smithi138.stderr: 12: __libc_start_main() 2024-09-14T11:36:06.653 INFO:tasks.workunit.client.0.smithi138.stderr: 13: _start() 2024-09-14T11:36:06.653 INFO:tasks.workunit.client.0.smithi138.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-14T11:36:06.653 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-14T11:36:06.653 INFO:tasks.workunit.client.0.smithi138.stderr:--- begin dump of recent events --- 2024-09-14T11:36:06.653 INFO:tasks.workunit.client.0.smithi138.stderr: -499> 2024-09-14T11:36:06.294+0000 7f9b20a2c640 1 monclient: found mon.noname-c 2024-09-14T11:36:06.653 INFO:tasks.workunit.client.0.smithi138.stderr: -498> 2024-09-14T11:36:06.294+0000 7f9b20a2c640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.138:3301/0 2024-09-14T11:36:06.653 INFO:tasks.workunit.client.0.smithi138.stderr: -497> 2024-09-14T11:36:06.294+0000 7f9b2122d640 10 monclient: get_auth_request con 0x5650068a0ad0 auth_method 0 2024-09-14T11:36:06.654 INFO:tasks.workunit.client.0.smithi138.stderr: -496> 2024-09-14T11:36:06.294+0000 7f9a0d60a640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:36:06.654 INFO:tasks.workunit.client.0.smithi138.stderr: -495> 2024-09-14T11:36:06.294+0000 7f9a0d60a640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-14T11:36:06.654 INFO:tasks.workunit.client.0.smithi138.stderr: -494> 2024-09-14T11:36:06.294+0000 7f9a0d60a640 10 monclient: dump: 2024-09-14T11:36:06.654 INFO:tasks.workunit.client.0.smithi138.stderr:epoch 1 2024-09-14T11:36:06.654 INFO:tasks.workunit.client.0.smithi138.stderr:fsid 3f225f43-83a6-4aeb-b798-1f04bb49d597 2024-09-14T11:36:06.654 INFO:tasks.workunit.client.0.smithi138.stderr:last_changed 2024-09-14T11:07:09.252780+0000 2024-09-14T11:36:06.654 INFO:tasks.workunit.client.0.smithi138.stderr:created 2024-09-14T11:07:09.252780+0000 2024-09-14T11:36:06.654 INFO:tasks.workunit.client.0.smithi138.stderr:min_mon_release 19 (squid) 2024-09-14T11:36:06.654 INFO:tasks.workunit.client.0.smithi138.stderr:election_strategy: 1 2024-09-14T11:36:06.654 INFO:tasks.workunit.client.0.smithi138.stderr:0: [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] mon.a 2024-09-14T11:36:06.654 INFO:tasks.workunit.client.0.smithi138.stderr:1: [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] mon.b 2024-09-14T11:36:06.654 INFO:tasks.workunit.client.0.smithi138.stderr:2: [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] mon.c 2024-09-14T11:36:06.654 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-14T11:36:06.654 INFO:tasks.workunit.client.0.smithi138.stderr: -493> 2024-09-14T11:36:06.294+0000 7f9a0d60a640 10 monclient: _finish_auth 0 2024-09-14T11:36:06.655 INFO:tasks.workunit.client.0.smithi138.stderr: -492> 2024-09-14T11:36:06.294+0000 7f9a0d60a640 10 monclient: _check_auth_tickets 2024-09-14T11:36:06.655 INFO:tasks.workunit.client.0.smithi138.stderr: -491> 2024-09-14T11:36:06.294+0000 7f9a0d60a640 10 monclient: handle_config config(0 keys) 2024-09-14T11:36:06.655 INFO:tasks.workunit.client.0.smithi138.stderr: -490> 2024-09-14T11:36:06.294+0000 7f9a0d60a640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:36:06.655 INFO:tasks.workunit.client.0.smithi138.stderr: -489> 2024-09-14T11:36:06.294+0000 7f9a0d60a640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-14T11:36:06.655 INFO:tasks.workunit.client.0.smithi138.stderr: -488> 2024-09-14T11:36:06.294+0000 7f9a0d60a640 10 monclient: dump: 2024-09-14T11:36:06.655 INFO:tasks.workunit.client.0.smithi138.stderr:epoch 1 2024-09-14T11:36:06.655 INFO:tasks.workunit.client.0.smithi138.stderr:fsid 3f225f43-83a6-4aeb-b798-1f04bb49d597 2024-09-14T11:36:06.655 INFO:tasks.workunit.client.0.smithi138.stderr:last_changed 2024-09-14T11:07:09.252780+0000 2024-09-14T11:36:06.655 INFO:tasks.workunit.client.0.smithi138.stderr:created 2024-09-14T11:07:09.252780+0000 2024-09-14T11:36:06.655 INFO:tasks.workunit.client.0.smithi138.stderr:min_mon_release 19 (squid) 2024-09-14T11:36:06.655 INFO:tasks.workunit.client.0.smithi138.stderr:election_strategy: 1 2024-09-14T11:36:06.655 INFO:tasks.workunit.client.0.smithi138.stderr:0: [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] mon.a 2024-09-14T11:36:06.655 INFO:tasks.workunit.client.0.smithi138.stderr:1: [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] mon.b 2024-09-14T11:36:06.655 INFO:tasks.workunit.client.0.smithi138.stderr:2: [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] mon.c 2024-09-14T11:36:06.655 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-14T11:36:06.656 INFO:tasks.workunit.client.0.smithi138.stderr: -487> 2024-09-14T11:36:06.294+0000 7f9b22f269c0 5 monclient: authenticate success, global_id 6539 2024-09-14T11:36:06.656 INFO:tasks.workunit.client.0.smithi138.stderr: -486> 2024-09-14T11:36:06.294+0000 7f9b22f269c0 10 monclient: _renew_subs 2024-09-14T11:36:06.656 INFO:tasks.workunit.client.0.smithi138.stderr: -485> 2024-09-14T11:36:06.294+0000 7f9b22f269c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.138:3301/0 2024-09-14T11:36:06.656 INFO:tasks.workunit.client.0.smithi138.stderr: -484> 2024-09-14T11:36:06.294+0000 7f9a0ee0d640 4 set_mon_vals no callback set 2024-09-14T11:36:06.656 INFO:tasks.workunit.client.0.smithi138.stderr: -483> 2024-09-14T11:36:06.294+0000 7f9b22f269c0 10 monclient: _renew_subs 2024-09-14T11:36:06.656 INFO:tasks.workunit.client.0.smithi138.stderr: -482> 2024-09-14T11:36:06.294+0000 7f9b22f269c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.138:3301/0 2024-09-14T11:36:06.656 INFO:tasks.workunit.client.0.smithi138.stderr: -481> 2024-09-14T11:36:06.294+0000 7f9b22f269c0 1 librados: init done 2024-09-14T11:36:06.656 INFO:tasks.workunit.client.0.smithi138.stderr: -480> 2024-09-14T11:36:06.298+0000 7f9a0d60a640 4 mgrc handle_mgr_map Got map version 5 2024-09-14T11:36:06.656 INFO:tasks.workunit.client.0.smithi138.stderr: -479> 2024-09-14T11:36:06.298+0000 7f9a0d60a640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.138:6832/3778043143,v1:172.21.15.138:6833/3778043143] 2024-09-14T11:36:06.656 INFO:tasks.workunit.client.0.smithi138.stderr: -478> 2024-09-14T11:36:06.298+0000 7f9a0d60a640 4 mgrc reconnect Starting new session with [v2:172.21.15.138:6832/3778043143,v1:172.21.15.138:6833/3778043143] 2024-09-14T11:36:06.656 INFO:tasks.workunit.client.0.smithi138.stderr: -477> 2024-09-14T11:36:06.298+0000 7f9b2022b640 10 monclient: get_auth_request con 0x7f9a080718a0 auth_method 0 2024-09-14T11:36:06.656 INFO:tasks.workunit.client.0.smithi138.stderr: -476> 2024-09-14T11:36:06.298+0000 7f9b2122d640 10 monclient: get_auth_request con 0x565006995f30 auth_method 0 2024-09-14T11:36:06.656 INFO:tasks.workunit.client.0.smithi138.stderr: -475> 2024-09-14T11:36:06.298+0000 7f9b20a2c640 10 monclient: get_auth_request con 0x5650069a6010 auth_method 0 2024-09-14T11:36:06.656 INFO:tasks.workunit.client.0.smithi138.stderr: -474> 2024-09-14T11:36:06.298+0000 7f9b2022b640 10 monclient: get_auth_request con 0x5650069aa200 auth_method 0 2024-09-14T11:36:06.657 INFO:tasks.workunit.client.0.smithi138.stderr: -473> 2024-09-14T11:36:06.302+0000 7f9b2122d640 10 monclient: get_auth_request con 0x5650069a98c0 auth_method 0 2024-09-14T11:36:06.657 INFO:tasks.workunit.client.0.smithi138.stderr: -472> 2024-09-14T11:36:06.302+0000 7f9b22f269c0 10 monclient: build_initial_monmap 2024-09-14T11:36:06.657 INFO:tasks.workunit.client.0.smithi138.stderr: -471> 2024-09-14T11:36:06.302+0000 7f9b22f269c0 1 build_initial for_mkfs: 0 2024-09-14T11:36:06.657 INFO:tasks.workunit.client.0.smithi138.stderr: -470> 2024-09-14T11:36:06.302+0000 7f9b22f269c0 10 monclient: monmap: 2024-09-14T11:36:06.657 INFO:tasks.workunit.client.0.smithi138.stderr:epoch 0 2024-09-14T11:36:06.657 INFO:tasks.workunit.client.0.smithi138.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-14T11:36:06.657 INFO:tasks.workunit.client.0.smithi138.stderr:last_changed 0.000000 2024-09-14T11:36:06.657 INFO:tasks.workunit.client.0.smithi138.stderr:created 0.000000 2024-09-14T11:36:06.657 INFO:tasks.workunit.client.0.smithi138.stderr:min_mon_release 0 (unknown) 2024-09-14T11:36:06.657 INFO:tasks.workunit.client.0.smithi138.stderr:election_strategy: 1 2024-09-14T11:36:06.657 INFO:tasks.workunit.client.0.smithi138.stderr:0: [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] mon.noname-a 2024-09-14T11:36:06.657 INFO:tasks.workunit.client.0.smithi138.stderr:1: [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] mon.noname-b 2024-09-14T11:36:06.657 INFO:tasks.workunit.client.0.smithi138.stderr:2: [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] mon.noname-c 2024-09-14T11:36:06.657 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-14T11:36:06.657 INFO:tasks.workunit.client.0.smithi138.stderr: -469> 2024-09-14T11:36:06.302+0000 7f9b22f269c0 5 AuthRegistry(0x5650069b22b0) adding auth protocol: cephx 2024-09-14T11:36:06.657 INFO:tasks.workunit.client.0.smithi138.stderr: -468> 2024-09-14T11:36:06.302+0000 7f9b22f269c0 5 AuthRegistry(0x5650069b22b0) adding auth protocol: cephx 2024-09-14T11:36:06.658 INFO:tasks.workunit.client.0.smithi138.stderr: -467> 2024-09-14T11:36:06.302+0000 7f9b22f269c0 5 AuthRegistry(0x5650069b22b0) adding auth protocol: cephx 2024-09-14T11:36:06.658 INFO:tasks.workunit.client.0.smithi138.stderr: -466> 2024-09-14T11:36:06.302+0000 7f9b22f269c0 5 AuthRegistry(0x5650069b22b0) adding con mode: secure 2024-09-14T11:36:06.658 INFO:tasks.workunit.client.0.smithi138.stderr: -465> 2024-09-14T11:36:06.302+0000 7f9b22f269c0 5 AuthRegistry(0x5650069b22b0) adding con mode: crc 2024-09-14T11:36:06.658 INFO:tasks.workunit.client.0.smithi138.stderr: -464> 2024-09-14T11:36:06.302+0000 7f9b22f269c0 5 AuthRegistry(0x5650069b22b0) adding con mode: secure 2024-09-14T11:36:06.658 INFO:tasks.workunit.client.0.smithi138.stderr: -463> 2024-09-14T11:36:06.302+0000 7f9b22f269c0 5 AuthRegistry(0x5650069b22b0) adding con mode: crc 2024-09-14T11:36:06.658 INFO:tasks.workunit.client.0.smithi138.stderr: -462> 2024-09-14T11:36:06.302+0000 7f9b22f269c0 5 AuthRegistry(0x5650069b22b0) adding con mode: secure 2024-09-14T11:36:06.658 INFO:tasks.workunit.client.0.smithi138.stderr: -461> 2024-09-14T11:36:06.302+0000 7f9b22f269c0 5 AuthRegistry(0x5650069b22b0) adding con mode: crc 2024-09-14T11:36:06.658 INFO:tasks.workunit.client.0.smithi138.stderr: -460> 2024-09-14T11:36:06.302+0000 7f9b22f269c0 5 AuthRegistry(0x5650069b22b0) adding con mode: crc 2024-09-14T11:36:06.658 INFO:tasks.workunit.client.0.smithi138.stderr: -459> 2024-09-14T11:36:06.302+0000 7f9b22f269c0 5 AuthRegistry(0x5650069b22b0) adding con mode: secure 2024-09-14T11:36:06.658 INFO:tasks.workunit.client.0.smithi138.stderr: -458> 2024-09-14T11:36:06.302+0000 7f9b22f269c0 5 AuthRegistry(0x5650069b22b0) adding con mode: crc 2024-09-14T11:36:06.658 INFO:tasks.workunit.client.0.smithi138.stderr: -457> 2024-09-14T11:36:06.302+0000 7f9b22f269c0 5 AuthRegistry(0x5650069b22b0) adding con mode: secure 2024-09-14T11:36:06.658 INFO:tasks.workunit.client.0.smithi138.stderr: -456> 2024-09-14T11:36:06.302+0000 7f9b22f269c0 5 AuthRegistry(0x5650069b22b0) adding con mode: crc 2024-09-14T11:36:06.658 INFO:tasks.workunit.client.0.smithi138.stderr: -455> 2024-09-14T11:36:06.302+0000 7f9b22f269c0 5 AuthRegistry(0x5650069b22b0) adding con mode: secure 2024-09-14T11:36:06.658 INFO:tasks.workunit.client.0.smithi138.stderr: -454> 2024-09-14T11:36:06.302+0000 7f9b22f269c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:36:06.658 INFO:tasks.workunit.client.0.smithi138.stderr: -453> 2024-09-14T11:36:06.302+0000 7f9b22f269c0 5 asok(0x56500674dd90) register_command objecter_requests cmddesc objecter_requests hook 0x5650069b5ca0 EEXIST 2024-09-14T11:36:06.659 INFO:tasks.workunit.client.0.smithi138.stderr: -452> 2024-09-14T11:36:06.302+0000 7f9b22f269c0 10 monclient: init 2024-09-14T11:36:06.659 INFO:tasks.workunit.client.0.smithi138.stderr: -451> 2024-09-14T11:36:06.302+0000 7f9b22f269c0 5 AuthRegistry(0x5650069b11a8) adding auth protocol: cephx 2024-09-14T11:36:06.659 INFO:tasks.workunit.client.0.smithi138.stderr: -450> 2024-09-14T11:36:06.302+0000 7f9b22f269c0 5 AuthRegistry(0x5650069b11a8) adding auth protocol: cephx 2024-09-14T11:36:06.659 INFO:tasks.workunit.client.0.smithi138.stderr: -449> 2024-09-14T11:36:06.302+0000 7f9b22f269c0 5 AuthRegistry(0x5650069b11a8) adding auth protocol: cephx 2024-09-14T11:36:06.659 INFO:tasks.workunit.client.0.smithi138.stderr: -448> 2024-09-14T11:36:06.302+0000 7f9b22f269c0 5 AuthRegistry(0x5650069b11a8) adding con mode: secure 2024-09-14T11:36:06.659 INFO:tasks.workunit.client.0.smithi138.stderr: -447> 2024-09-14T11:36:06.302+0000 7f9b22f269c0 5 AuthRegistry(0x5650069b11a8) adding con mode: crc 2024-09-14T11:36:06.659 INFO:tasks.workunit.client.0.smithi138.stderr: -446> 2024-09-14T11:36:06.302+0000 7f9b22f269c0 5 AuthRegistry(0x5650069b11a8) adding con mode: secure 2024-09-14T11:36:06.659 INFO:tasks.workunit.client.0.smithi138.stderr: -445> 2024-09-14T11:36:06.302+0000 7f9b22f269c0 5 AuthRegistry(0x5650069b11a8) adding con mode: crc 2024-09-14T11:36:06.659 INFO:tasks.workunit.client.0.smithi138.stderr: -444> 2024-09-14T11:36:06.302+0000 7f9b22f269c0 5 AuthRegistry(0x5650069b11a8) adding con mode: secure 2024-09-14T11:36:06.659 INFO:tasks.workunit.client.0.smithi138.stderr: -443> 2024-09-14T11:36:06.302+0000 7f9b22f269c0 5 AuthRegistry(0x5650069b11a8) adding con mode: crc 2024-09-14T11:36:06.659 INFO:tasks.workunit.client.0.smithi138.stderr: -442> 2024-09-14T11:36:06.302+0000 7f9b22f269c0 5 AuthRegistry(0x5650069b11a8) adding con mode: crc 2024-09-14T11:36:06.659 INFO:tasks.workunit.client.0.smithi138.stderr: -441> 2024-09-14T11:36:06.302+0000 7f9b22f269c0 5 AuthRegistry(0x5650069b11a8) adding con mode: secure 2024-09-14T11:36:06.659 INFO:tasks.workunit.client.0.smithi138.stderr: -440> 2024-09-14T11:36:06.302+0000 7f9b22f269c0 5 AuthRegistry(0x5650069b11a8) adding con mode: crc 2024-09-14T11:36:06.659 INFO:tasks.workunit.client.0.smithi138.stderr: -439> 2024-09-14T11:36:06.302+0000 7f9b22f269c0 5 AuthRegistry(0x5650069b11a8) adding con mode: secure 2024-09-14T11:36:06.660 INFO:tasks.workunit.client.0.smithi138.stderr: -438> 2024-09-14T11:36:06.302+0000 7f9b22f269c0 5 AuthRegistry(0x5650069b11a8) adding con mode: crc 2024-09-14T11:36:06.660 INFO:tasks.workunit.client.0.smithi138.stderr: -437> 2024-09-14T11:36:06.302+0000 7f9b22f269c0 5 AuthRegistry(0x5650069b11a8) adding con mode: secure 2024-09-14T11:36:06.660 INFO:tasks.workunit.client.0.smithi138.stderr: -436> 2024-09-14T11:36:06.302+0000 7f9b22f269c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:36:06.660 INFO:tasks.workunit.client.0.smithi138.stderr: -435> 2024-09-14T11:36:06.302+0000 7f9b22f269c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:36:06.660 INFO:tasks.workunit.client.0.smithi138.stderr: -434> 2024-09-14T11:36:06.302+0000 7f9b22f269c0 5 asok(0x56500674dd90) register_command rotate-key cmddesc rotate-key hook 0x5650069b12f0 EEXIST 2024-09-14T11:36:06.660 INFO:tasks.workunit.client.0.smithi138.stderr: -433> 2024-09-14T11:36:06.302+0000 7f9b22f269c0 10 monclient: _reopen_session rank -1 2024-09-14T11:36:06.660 INFO:tasks.workunit.client.0.smithi138.stderr: -432> 2024-09-14T11:36:06.302+0000 7f9b22f269c0 10 monclient: _add_conns ranks=[2,1,0] 2024-09-14T11:36:06.660 INFO:tasks.workunit.client.0.smithi138.stderr: -431> 2024-09-14T11:36:06.302+0000 7f9b22f269c0 10 monclient(hunting): picked mon.noname-c con 0x5650069d9e50 addr [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] 2024-09-14T11:36:06.660 INFO:tasks.workunit.client.0.smithi138.stderr: -430> 2024-09-14T11:36:06.302+0000 7f9b22f269c0 10 monclient(hunting): picked mon.noname-b con 0x5650069d9780 addr [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] 2024-09-14T11:36:06.660 INFO:tasks.workunit.client.0.smithi138.stderr: -429> 2024-09-14T11:36:06.302+0000 7f9b22f269c0 10 monclient(hunting): picked mon.noname-a con 0x5650069d8160 addr [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] 2024-09-14T11:36:06.660 INFO:tasks.workunit.client.0.smithi138.stderr: -428> 2024-09-14T11:36:06.302+0000 7f9b22f269c0 10 monclient(hunting): start opening mon connection 2024-09-14T11:36:06.660 INFO:tasks.workunit.client.0.smithi138.stderr: -427> 2024-09-14T11:36:06.302+0000 7f9b22f269c0 10 monclient(hunting): start opening mon connection 2024-09-14T11:36:06.660 INFO:tasks.workunit.client.0.smithi138.stderr: -426> 2024-09-14T11:36:06.302+0000 7f9b22f269c0 10 monclient(hunting): start opening mon connection 2024-09-14T11:36:06.661 INFO:tasks.workunit.client.0.smithi138.stderr: -425> 2024-09-14T11:36:06.302+0000 7f9b22f269c0 10 monclient(hunting): _renew_subs 2024-09-14T11:36:06.661 INFO:tasks.workunit.client.0.smithi138.stderr: -424> 2024-09-14T11:36:06.302+0000 7f9b22f269c0 10 monclient(hunting): authenticate will time out at 2702.267471s 2024-09-14T11:36:06.661 INFO:tasks.workunit.client.0.smithi138.stderr: -423> 2024-09-14T11:36:06.302+0000 7f9b2022b640 10 monclient(hunting): get_auth_request con 0x5650069d9e50 auth_method 0 2024-09-14T11:36:06.661 INFO:tasks.workunit.client.0.smithi138.stderr: -422> 2024-09-14T11:36:06.302+0000 7f9b2022b640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:36:06.661 INFO:tasks.workunit.client.0.smithi138.stderr: -421> 2024-09-14T11:36:06.302+0000 7f9b2022b640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:36:06.661 INFO:tasks.workunit.client.0.smithi138.stderr: -420> 2024-09-14T11:36:06.302+0000 7f9b2022b640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:36:06.661 INFO:tasks.workunit.client.0.smithi138.stderr: -419> 2024-09-14T11:36:06.302+0000 7f9b20a2c640 10 monclient(hunting): get_auth_request con 0x5650069d8160 auth_method 0 2024-09-14T11:36:06.661 INFO:tasks.workunit.client.0.smithi138.stderr: -418> 2024-09-14T11:36:06.302+0000 7f9b20a2c640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:36:06.661 INFO:tasks.workunit.client.0.smithi138.stderr: -417> 2024-09-14T11:36:06.302+0000 7f9b20a2c640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:36:06.661 INFO:tasks.workunit.client.0.smithi138.stderr: -416> 2024-09-14T11:36:06.302+0000 7f9b20a2c640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:36:06.661 INFO:tasks.workunit.client.0.smithi138.stderr: -415> 2024-09-14T11:36:06.302+0000 7f9b20a2c640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:36:06.661 INFO:tasks.workunit.client.0.smithi138.stderr: -414> 2024-09-14T11:36:06.302+0000 7f9b20a2c640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:36:06.662 INFO:tasks.workunit.client.0.smithi138.stderr: -413> 2024-09-14T11:36:06.302+0000 7f9b20a2c640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:36:06.662 INFO:tasks.workunit.client.0.smithi138.stderr: -412> 2024-09-14T11:36:06.302+0000 7f9b2022b640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:36:06.662 INFO:tasks.workunit.client.0.smithi138.stderr: -411> 2024-09-14T11:36:06.302+0000 7f9b2022b640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:36:06.662 INFO:tasks.workunit.client.0.smithi138.stderr: -410> 2024-09-14T11:36:06.302+0000 7f9b2022b640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:36:06.662 INFO:tasks.workunit.client.0.smithi138.stderr: -409> 2024-09-14T11:36:06.302+0000 7f9b2122d640 10 monclient(hunting): get_auth_request con 0x5650069d9780 auth_method 0 2024-09-14T11:36:06.662 INFO:tasks.workunit.client.0.smithi138.stderr: -408> 2024-09-14T11:36:06.302+0000 7f9b2122d640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:36:06.662 INFO:tasks.workunit.client.0.smithi138.stderr: -407> 2024-09-14T11:36:06.302+0000 7f9b2122d640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:36:06.662 INFO:tasks.workunit.client.0.smithi138.stderr: -406> 2024-09-14T11:36:06.302+0000 7f9b2122d640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:36:06.662 INFO:tasks.workunit.client.0.smithi138.stderr: -405> 2024-09-14T11:36:06.302+0000 7f9b20a2c640 10 monclient(hunting): handle_auth_done global_id 7005 payload 824 2024-09-14T11:36:06.662 INFO:tasks.workunit.client.0.smithi138.stderr: -404> 2024-09-14T11:36:06.302+0000 7f9b20a2c640 10 monclient: _finish_hunting 0 2024-09-14T11:36:06.662 INFO:tasks.workunit.client.0.smithi138.stderr: -403> 2024-09-14T11:36:06.302+0000 7f9b20a2c640 1 monclient: found mon.noname-a 2024-09-14T11:36:06.662 INFO:tasks.workunit.client.0.smithi138.stderr: -402> 2024-09-14T11:36:06.302+0000 7f9b20a2c640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.138:3300/0 2024-09-14T11:36:06.662 INFO:tasks.workunit.client.0.smithi138.stderr: -401> 2024-09-14T11:36:06.306+0000 7f9a067fc640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:36:06.662 INFO:tasks.workunit.client.0.smithi138.stderr: -400> 2024-09-14T11:36:06.306+0000 7f9a067fc640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-14T11:36:06.663 INFO:tasks.workunit.client.0.smithi138.stderr: -399> 2024-09-14T11:36:06.306+0000 7f9a067fc640 10 monclient: dump: 2024-09-14T11:36:06.663 INFO:tasks.workunit.client.0.smithi138.stderr:epoch 1 2024-09-14T11:36:06.663 INFO:tasks.workunit.client.0.smithi138.stderr:fsid 3f225f43-83a6-4aeb-b798-1f04bb49d597 2024-09-14T11:36:06.663 INFO:tasks.workunit.client.0.smithi138.stderr:last_changed 2024-09-14T11:07:09.252780+0000 2024-09-14T11:36:06.663 INFO:tasks.workunit.client.0.smithi138.stderr:created 2024-09-14T11:07:09.252780+0000 2024-09-14T11:36:06.663 INFO:tasks.workunit.client.0.smithi138.stderr:min_mon_release 19 (squid) 2024-09-14T11:36:06.663 INFO:tasks.workunit.client.0.smithi138.stderr:election_strategy: 1 2024-09-14T11:36:06.663 INFO:tasks.workunit.client.0.smithi138.stderr:0: [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] mon.a 2024-09-14T11:36:06.663 INFO:tasks.workunit.client.0.smithi138.stderr:1: [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] mon.b 2024-09-14T11:36:06.663 INFO:tasks.workunit.client.0.smithi138.stderr:2: [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] mon.c 2024-09-14T11:36:06.663 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-14T11:36:06.663 INFO:tasks.workunit.client.0.smithi138.stderr: -398> 2024-09-14T11:36:06.306+0000 7f9a067fc640 10 monclient: _finish_auth 0 2024-09-14T11:36:06.663 INFO:tasks.workunit.client.0.smithi138.stderr: -397> 2024-09-14T11:36:06.306+0000 7f9a067fc640 10 monclient: _check_auth_tickets 2024-09-14T11:36:06.663 INFO:tasks.workunit.client.0.smithi138.stderr: -396> 2024-09-14T11:36:06.306+0000 7f9a067fc640 10 monclient: handle_config config(0 keys) 2024-09-14T11:36:06.664 INFO:tasks.workunit.client.0.smithi138.stderr: -395> 2024-09-14T11:36:06.306+0000 7f9a067fc640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:36:06.664 INFO:tasks.workunit.client.0.smithi138.stderr: -394> 2024-09-14T11:36:06.306+0000 7f9a067fc640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-14T11:36:06.664 INFO:tasks.workunit.client.0.smithi138.stderr: -393> 2024-09-14T11:36:06.306+0000 7f9a067fc640 10 monclient: dump: 2024-09-14T11:36:06.664 INFO:tasks.workunit.client.0.smithi138.stderr:epoch 1 2024-09-14T11:36:06.664 INFO:tasks.workunit.client.0.smithi138.stderr:fsid 3f225f43-83a6-4aeb-b798-1f04bb49d597 2024-09-14T11:36:06.664 INFO:tasks.workunit.client.0.smithi138.stderr:last_changed 2024-09-14T11:07:09.252780+0000 2024-09-14T11:36:06.664 INFO:tasks.workunit.client.0.smithi138.stderr:created 2024-09-14T11:07:09.252780+0000 2024-09-14T11:36:06.664 INFO:tasks.workunit.client.0.smithi138.stderr:min_mon_release 19 (squid) 2024-09-14T11:36:06.664 INFO:tasks.workunit.client.0.smithi138.stderr:election_strategy: 1 2024-09-14T11:36:06.664 INFO:tasks.workunit.client.0.smithi138.stderr:0: [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] mon.a 2024-09-14T11:36:06.664 INFO:tasks.workunit.client.0.smithi138.stderr:1: [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] mon.b 2024-09-14T11:36:06.664 INFO:tasks.workunit.client.0.smithi138.stderr:2: [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] mon.c 2024-09-14T11:36:06.664 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-14T11:36:06.664 INFO:tasks.workunit.client.0.smithi138.stderr: -392> 2024-09-14T11:36:06.306+0000 7f9b1fa2a640 4 set_mon_vals no callback set 2024-09-14T11:36:06.664 INFO:tasks.workunit.client.0.smithi138.stderr: -391> 2024-09-14T11:36:06.306+0000 7f9b22f269c0 5 monclient: authenticate success, global_id 7005 2024-09-14T11:36:06.665 INFO:tasks.workunit.client.0.smithi138.stderr: -390> 2024-09-14T11:36:06.306+0000 7f9b22f269c0 10 monclient: _renew_subs 2024-09-14T11:36:06.665 INFO:tasks.workunit.client.0.smithi138.stderr: -389> 2024-09-14T11:36:06.306+0000 7f9b22f269c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.138:3300/0 2024-09-14T11:36:06.665 INFO:tasks.workunit.client.0.smithi138.stderr: -388> 2024-09-14T11:36:06.306+0000 7f9b22f269c0 10 monclient: _renew_subs 2024-09-14T11:36:06.665 INFO:tasks.workunit.client.0.smithi138.stderr: -387> 2024-09-14T11:36:06.306+0000 7f9b22f269c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.138:3300/0 2024-09-14T11:36:06.665 INFO:tasks.workunit.client.0.smithi138.stderr: -386> 2024-09-14T11:36:06.306+0000 7f9a067fc640 10 monclient: ms_handle_reset current mon [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] 2024-09-14T11:36:06.665 INFO:tasks.workunit.client.0.smithi138.stderr: -385> 2024-09-14T11:36:06.306+0000 7f9a067fc640 10 monclient: _reopen_session rank -1 2024-09-14T11:36:06.665 INFO:tasks.workunit.client.0.smithi138.stderr: -384> 2024-09-14T11:36:06.306+0000 7f9a067fc640 10 monclient: _add_conns ranks=[1,0,2] 2024-09-14T11:36:06.665 INFO:tasks.workunit.client.0.smithi138.stderr: -383> 2024-09-14T11:36:06.306+0000 7f9a067fc640 10 monclient(hunting): picked mon.b con 0x7f99f8002160 addr [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] 2024-09-14T11:36:06.665 INFO:tasks.workunit.client.0.smithi138.stderr: -382> 2024-09-14T11:36:06.306+0000 7f9a067fc640 10 monclient(hunting): picked mon.a con 0x7f99f8004f20 addr [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] 2024-09-14T11:36:06.665 INFO:tasks.workunit.client.0.smithi138.stderr: -381> 2024-09-14T11:36:06.306+0000 7f9a067fc640 10 monclient(hunting): picked mon.c con 0x5650069d9e50 addr [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] 2024-09-14T11:36:06.665 INFO:tasks.workunit.client.0.smithi138.stderr: -380> 2024-09-14T11:36:06.306+0000 7f9a067fc640 10 monclient(hunting): start opening mon connection 2024-09-14T11:36:06.665 INFO:tasks.workunit.client.0.smithi138.stderr: -379> 2024-09-14T11:36:06.306+0000 7f9a067fc640 10 monclient(hunting): start opening mon connection 2024-09-14T11:36:06.665 INFO:tasks.workunit.client.0.smithi138.stderr: -378> 2024-09-14T11:36:06.306+0000 7f9a067fc640 10 monclient(hunting): start opening mon connection 2024-09-14T11:36:06.665 INFO:tasks.workunit.client.0.smithi138.stderr: -377> 2024-09-14T11:36:06.306+0000 7f9a067fc640 10 monclient(hunting): _renew_subs 2024-09-14T11:36:06.666 INFO:tasks.workunit.client.0.smithi138.stderr: -376> 2024-09-14T11:36:06.306+0000 7f9b2122d640 10 monclient(hunting): get_auth_request con 0x7f99f8004f20 auth_method 0 2024-09-14T11:36:06.666 INFO:tasks.workunit.client.0.smithi138.stderr: -375> 2024-09-14T11:36:06.306+0000 7f9b2122d640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:36:06.666 INFO:tasks.workunit.client.0.smithi138.stderr: -374> 2024-09-14T11:36:06.306+0000 7f9b2122d640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:36:06.666 INFO:tasks.workunit.client.0.smithi138.stderr: -373> 2024-09-14T11:36:06.306+0000 7f9b2122d640 10 monclient(hunting): _init_auth already have auth, reseting 2024-09-14T11:36:06.666 INFO:tasks.workunit.client.0.smithi138.stderr: -372> 2024-09-14T11:36:06.306+0000 7f9b20a2c640 10 monclient(hunting): get_auth_request con 0x5650069d9e50 auth_method 0 2024-09-14T11:36:06.666 INFO:tasks.workunit.client.0.smithi138.stderr: -371> 2024-09-14T11:36:06.306+0000 7f9b20a2c640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:36:06.666 INFO:tasks.workunit.client.0.smithi138.stderr: -370> 2024-09-14T11:36:06.306+0000 7f9b20a2c640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:36:06.666 INFO:tasks.workunit.client.0.smithi138.stderr: -369> 2024-09-14T11:36:06.306+0000 7f9b20a2c640 10 monclient(hunting): _init_auth already have auth, reseting 2024-09-14T11:36:06.666 INFO:tasks.workunit.client.0.smithi138.stderr: -368> 2024-09-14T11:36:06.306+0000 7f9b2122d640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:36:06.666 INFO:tasks.workunit.client.0.smithi138.stderr: -367> 2024-09-14T11:36:06.306+0000 7f9b2122d640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:36:06.666 INFO:tasks.workunit.client.0.smithi138.stderr: -366> 2024-09-14T11:36:06.306+0000 7f9b2122d640 10 monclient(hunting): handle_auth_reply_more responding with 132 bytes 2024-09-14T11:36:06.666 INFO:tasks.workunit.client.0.smithi138.stderr: -365> 2024-09-14T11:36:06.306+0000 7f9b20a2c640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:36:06.666 INFO:tasks.workunit.client.0.smithi138.stderr: -364> 2024-09-14T11:36:06.306+0000 7f9b20a2c640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:36:06.666 INFO:tasks.workunit.client.0.smithi138.stderr: -363> 2024-09-14T11:36:06.306+0000 7f9b20a2c640 10 monclient(hunting): handle_auth_reply_more responding with 132 bytes 2024-09-14T11:36:06.666 INFO:tasks.workunit.client.0.smithi138.stderr: -362> 2024-09-14T11:36:06.306+0000 7f9b2122d640 10 monclient(hunting): handle_auth_done global_id 7005 payload 293 2024-09-14T11:36:06.666 INFO:tasks.workunit.client.0.smithi138.stderr: -361> 2024-09-14T11:36:06.306+0000 7f9b2122d640 10 monclient: _finish_hunting 0 2024-09-14T11:36:06.667 INFO:tasks.workunit.client.0.smithi138.stderr: -360> 2024-09-14T11:36:06.306+0000 7f9b2122d640 1 monclient: found mon.a 2024-09-14T11:36:06.667 INFO:tasks.workunit.client.0.smithi138.stderr: -359> 2024-09-14T11:36:06.306+0000 7f9b2122d640 10 monclient: _send_mon_message to mon.a at v2:172.21.15.138:3300/0 2024-09-14T11:36:06.667 INFO:tasks.workunit.client.0.smithi138.stderr: -358> 2024-09-14T11:36:06.306+0000 7f9b2122d640 10 monclient: _finish_auth 0 2024-09-14T11:36:06.667 INFO:tasks.workunit.client.0.smithi138.stderr: -357> 2024-09-14T11:36:06.306+0000 7f9b2122d640 10 monclient: _check_auth_tickets 2024-09-14T11:36:06.667 INFO:tasks.workunit.client.0.smithi138.stderr: -356> 2024-09-14T11:36:06.306+0000 7f9b2022b640 10 monclient: get_auth_request con 0x7f99f8002160 auth_method 0 2024-09-14T11:36:06.667 INFO:tasks.workunit.client.0.smithi138.stderr: -355> 2024-09-14T11:36:06.306+0000 7f9a067fc640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:36:06.667 INFO:tasks.workunit.client.0.smithi138.stderr: -354> 2024-09-14T11:36:06.306+0000 7f9a067fc640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-14T11:36:06.667 INFO:tasks.workunit.client.0.smithi138.stderr: -353> 2024-09-14T11:36:06.306+0000 7f9a067fc640 10 monclient: dump: 2024-09-14T11:36:06.667 INFO:tasks.workunit.client.0.smithi138.stderr:epoch 1 2024-09-14T11:36:06.667 INFO:tasks.workunit.client.0.smithi138.stderr:fsid 3f225f43-83a6-4aeb-b798-1f04bb49d597 2024-09-14T11:36:06.667 INFO:tasks.workunit.client.0.smithi138.stderr:last_changed 2024-09-14T11:07:09.252780+0000 2024-09-14T11:36:06.667 INFO:tasks.workunit.client.0.smithi138.stderr:created 2024-09-14T11:07:09.252780+0000 2024-09-14T11:36:06.667 INFO:tasks.workunit.client.0.smithi138.stderr:min_mon_release 19 (squid) 2024-09-14T11:36:06.667 INFO:tasks.workunit.client.0.smithi138.stderr:election_strategy: 1 2024-09-14T11:36:06.667 INFO:tasks.workunit.client.0.smithi138.stderr:0: [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] mon.a 2024-09-14T11:36:06.667 INFO:tasks.workunit.client.0.smithi138.stderr:1: [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] mon.b 2024-09-14T11:36:06.668 INFO:tasks.workunit.client.0.smithi138.stderr:2: [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] mon.c 2024-09-14T11:36:06.668 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-14T11:36:06.668 INFO:tasks.workunit.client.0.smithi138.stderr: -352> 2024-09-14T11:36:06.306+0000 7f9a067fc640 10 monclient: handle_config config(0 keys) 2024-09-14T11:36:06.668 INFO:tasks.workunit.client.0.smithi138.stderr: -351> 2024-09-14T11:36:06.306+0000 7f9b21a2e640 4 set_mon_vals no callback set 2024-09-14T11:36:06.668 INFO:tasks.workunit.client.0.smithi138.stderr: -350> 2024-09-14T11:36:06.310+0000 7f9a067fc640 4 mgrc handle_mgr_map Got map version 5 2024-09-14T11:36:06.668 INFO:tasks.workunit.client.0.smithi138.stderr: -349> 2024-09-14T11:36:06.310+0000 7f9a067fc640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.138:6832/3778043143,v1:172.21.15.138:6833/3778043143] 2024-09-14T11:36:06.668 INFO:tasks.workunit.client.0.smithi138.stderr: -348> 2024-09-14T11:36:06.310+0000 7f9a067fc640 4 mgrc reconnect Starting new session with [v2:172.21.15.138:6832/3778043143,v1:172.21.15.138:6833/3778043143] 2024-09-14T11:36:06.668 INFO:tasks.workunit.client.0.smithi138.stderr: -347> 2024-09-14T11:36:06.310+0000 7f9b2022b640 10 monclient: get_auth_request con 0x5650069d8160 auth_method 0 2024-09-14T11:36:06.668 INFO:tasks.workunit.client.0.smithi138.stderr: -346> 2024-09-14T11:36:06.310+0000 7f9b22f269c0 10 monclient: get_monmap_and_config 2024-09-14T11:36:06.668 INFO:tasks.workunit.client.0.smithi138.stderr: -345> 2024-09-14T11:36:06.310+0000 7f9b22f269c0 10 monclient: build_initial_monmap 2024-09-14T11:36:06.668 INFO:tasks.workunit.client.0.smithi138.stderr: -344> 2024-09-14T11:36:06.310+0000 7f9b22f269c0 1 build_initial for_mkfs: 0 2024-09-14T11:36:06.668 INFO:tasks.workunit.client.0.smithi138.stderr: -343> 2024-09-14T11:36:06.310+0000 7f9b22f269c0 10 monclient: monmap: 2024-09-14T11:36:06.668 INFO:tasks.workunit.client.0.smithi138.stderr:epoch 0 2024-09-14T11:36:06.668 INFO:tasks.workunit.client.0.smithi138.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-14T11:36:06.669 INFO:tasks.workunit.client.0.smithi138.stderr:last_changed 0.000000 2024-09-14T11:36:06.669 INFO:tasks.workunit.client.0.smithi138.stderr:created 0.000000 2024-09-14T11:36:06.669 INFO:tasks.workunit.client.0.smithi138.stderr:min_mon_release 0 (unknown) 2024-09-14T11:36:06.669 INFO:tasks.workunit.client.0.smithi138.stderr:election_strategy: 1 2024-09-14T11:36:06.669 INFO:tasks.workunit.client.0.smithi138.stderr:0: [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] mon.noname-a 2024-09-14T11:36:06.669 INFO:tasks.workunit.client.0.smithi138.stderr:1: [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] mon.noname-b 2024-09-14T11:36:06.669 INFO:tasks.workunit.client.0.smithi138.stderr:2: [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] mon.noname-c 2024-09-14T11:36:06.669 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-14T11:36:06.669 INFO:tasks.workunit.client.0.smithi138.stderr: -342> 2024-09-14T11:36:06.310+0000 7f9b22f269c0 5 AuthRegistry(0x5650069f2a30) adding auth protocol: cephx 2024-09-14T11:36:06.669 INFO:tasks.workunit.client.0.smithi138.stderr: -341> 2024-09-14T11:36:06.310+0000 7f9b22f269c0 5 AuthRegistry(0x5650069f2a30) adding auth protocol: cephx 2024-09-14T11:36:06.669 INFO:tasks.workunit.client.0.smithi138.stderr: -340> 2024-09-14T11:36:06.310+0000 7f9b22f269c0 5 AuthRegistry(0x5650069f2a30) adding auth protocol: cephx 2024-09-14T11:36:06.669 INFO:tasks.workunit.client.0.smithi138.stderr: -339> 2024-09-14T11:36:06.310+0000 7f9b22f269c0 5 AuthRegistry(0x5650069f2a30) adding con mode: secure 2024-09-14T11:36:06.669 INFO:tasks.workunit.client.0.smithi138.stderr: -338> 2024-09-14T11:36:06.310+0000 7f9b22f269c0 5 AuthRegistry(0x5650069f2a30) adding con mode: crc 2024-09-14T11:36:06.669 INFO:tasks.workunit.client.0.smithi138.stderr: -337> 2024-09-14T11:36:06.310+0000 7f9b22f269c0 5 AuthRegistry(0x5650069f2a30) adding con mode: secure 2024-09-14T11:36:06.669 INFO:tasks.workunit.client.0.smithi138.stderr: -336> 2024-09-14T11:36:06.310+0000 7f9b22f269c0 5 AuthRegistry(0x5650069f2a30) adding con mode: crc 2024-09-14T11:36:06.669 INFO:tasks.workunit.client.0.smithi138.stderr: -335> 2024-09-14T11:36:06.310+0000 7f9b22f269c0 5 AuthRegistry(0x5650069f2a30) adding con mode: secure 2024-09-14T11:36:06.670 INFO:tasks.workunit.client.0.smithi138.stderr: -334> 2024-09-14T11:36:06.310+0000 7f9b22f269c0 5 AuthRegistry(0x5650069f2a30) adding con mode: crc 2024-09-14T11:36:06.670 INFO:tasks.workunit.client.0.smithi138.stderr: -333> 2024-09-14T11:36:06.310+0000 7f9b22f269c0 5 AuthRegistry(0x5650069f2a30) adding con mode: crc 2024-09-14T11:36:06.670 INFO:tasks.workunit.client.0.smithi138.stderr: -332> 2024-09-14T11:36:06.310+0000 7f9b22f269c0 5 AuthRegistry(0x5650069f2a30) adding con mode: secure 2024-09-14T11:36:06.670 INFO:tasks.workunit.client.0.smithi138.stderr: -331> 2024-09-14T11:36:06.310+0000 7f9b22f269c0 5 AuthRegistry(0x5650069f2a30) adding con mode: crc 2024-09-14T11:36:06.670 INFO:tasks.workunit.client.0.smithi138.stderr: -330> 2024-09-14T11:36:06.310+0000 7f9b22f269c0 5 AuthRegistry(0x5650069f2a30) adding con mode: secure 2024-09-14T11:36:06.670 INFO:tasks.workunit.client.0.smithi138.stderr: -329> 2024-09-14T11:36:06.310+0000 7f9b22f269c0 5 AuthRegistry(0x5650069f2a30) adding con mode: crc 2024-09-14T11:36:06.670 INFO:tasks.workunit.client.0.smithi138.stderr: -328> 2024-09-14T11:36:06.310+0000 7f9b22f269c0 5 AuthRegistry(0x5650069f2a30) adding con mode: secure 2024-09-14T11:36:06.670 INFO:tasks.workunit.client.0.smithi138.stderr: -327> 2024-09-14T11:36:06.310+0000 7f9b22f269c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:36:06.670 INFO:tasks.workunit.client.0.smithi138.stderr: -326> 2024-09-14T11:36:06.310+0000 7f9b22f269c0 10 monclient: init 2024-09-14T11:36:06.670 INFO:tasks.workunit.client.0.smithi138.stderr: -325> 2024-09-14T11:36:06.310+0000 7f9b22f269c0 5 AuthRegistry(0x7fffceb3e730) adding auth protocol: cephx 2024-09-14T11:36:06.670 INFO:tasks.workunit.client.0.smithi138.stderr: -324> 2024-09-14T11:36:06.310+0000 7f9b22f269c0 5 AuthRegistry(0x7fffceb3e730) adding auth protocol: cephx 2024-09-14T11:36:06.670 INFO:tasks.workunit.client.0.smithi138.stderr: -323> 2024-09-14T11:36:06.310+0000 7f9b22f269c0 5 AuthRegistry(0x7fffceb3e730) adding auth protocol: cephx 2024-09-14T11:36:06.670 INFO:tasks.workunit.client.0.smithi138.stderr: -322> 2024-09-14T11:36:06.310+0000 7f9b22f269c0 5 AuthRegistry(0x7fffceb3e730) adding con mode: secure 2024-09-14T11:36:06.670 INFO:tasks.workunit.client.0.smithi138.stderr: -321> 2024-09-14T11:36:06.310+0000 7f9b22f269c0 5 AuthRegistry(0x7fffceb3e730) adding con mode: crc 2024-09-14T11:36:06.671 INFO:tasks.workunit.client.0.smithi138.stderr: -320> 2024-09-14T11:36:06.310+0000 7f9b22f269c0 5 AuthRegistry(0x7fffceb3e730) adding con mode: secure 2024-09-14T11:36:06.671 INFO:tasks.workunit.client.0.smithi138.stderr: -319> 2024-09-14T11:36:06.310+0000 7f9b22f269c0 5 AuthRegistry(0x7fffceb3e730) adding con mode: crc 2024-09-14T11:36:06.671 INFO:tasks.workunit.client.0.smithi138.stderr: -318> 2024-09-14T11:36:06.310+0000 7f9b22f269c0 5 AuthRegistry(0x7fffceb3e730) adding con mode: secure 2024-09-14T11:36:06.671 INFO:tasks.workunit.client.0.smithi138.stderr: -317> 2024-09-14T11:36:06.310+0000 7f9b22f269c0 5 AuthRegistry(0x7fffceb3e730) adding con mode: crc 2024-09-14T11:36:06.671 INFO:tasks.workunit.client.0.smithi138.stderr: -316> 2024-09-14T11:36:06.310+0000 7f9b22f269c0 5 AuthRegistry(0x7fffceb3e730) adding con mode: crc 2024-09-14T11:36:06.671 INFO:tasks.workunit.client.0.smithi138.stderr: -315> 2024-09-14T11:36:06.310+0000 7f9b22f269c0 5 AuthRegistry(0x7fffceb3e730) adding con mode: secure 2024-09-14T11:36:06.671 INFO:tasks.workunit.client.0.smithi138.stderr: -314> 2024-09-14T11:36:06.310+0000 7f9b22f269c0 5 AuthRegistry(0x7fffceb3e730) adding con mode: crc 2024-09-14T11:36:06.671 INFO:tasks.workunit.client.0.smithi138.stderr: -313> 2024-09-14T11:36:06.310+0000 7f9b22f269c0 5 AuthRegistry(0x7fffceb3e730) adding con mode: secure 2024-09-14T11:36:06.671 INFO:tasks.workunit.client.0.smithi138.stderr: -312> 2024-09-14T11:36:06.310+0000 7f9b22f269c0 5 AuthRegistry(0x7fffceb3e730) adding con mode: crc 2024-09-14T11:36:06.671 INFO:tasks.workunit.client.0.smithi138.stderr: -311> 2024-09-14T11:36:06.310+0000 7f9b22f269c0 5 AuthRegistry(0x7fffceb3e730) adding con mode: secure 2024-09-14T11:36:06.671 INFO:tasks.workunit.client.0.smithi138.stderr: -310> 2024-09-14T11:36:06.310+0000 7f9b22f269c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:36:06.671 INFO:tasks.workunit.client.0.smithi138.stderr: -309> 2024-09-14T11:36:06.310+0000 7f9b22f269c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:36:06.671 INFO:tasks.workunit.client.0.smithi138.stderr: -308> 2024-09-14T11:36:06.310+0000 7f9b22f269c0 5 asok(0x56500674dd90) register_command rotate-key cmddesc rotate-key hook 0x7fffceb3e878 EEXIST 2024-09-14T11:36:06.671 INFO:tasks.workunit.client.0.smithi138.stderr: -307> 2024-09-14T11:36:06.310+0000 7f9b22f269c0 10 monclient: _reopen_session rank -1 2024-09-14T11:36:06.672 INFO:tasks.workunit.client.0.smithi138.stderr: -306> 2024-09-14T11:36:06.310+0000 7f9b22f269c0 10 monclient: _add_conns ranks=[0,2,1] 2024-09-14T11:36:06.672 INFO:tasks.workunit.client.0.smithi138.stderr: -305> 2024-09-14T11:36:06.310+0000 7f9b22f269c0 10 monclient(hunting): picked mon.noname-a con 0x565006a26b80 addr [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] 2024-09-14T11:36:06.672 INFO:tasks.workunit.client.0.smithi138.stderr: -304> 2024-09-14T11:36:06.310+0000 7f9b22f269c0 10 monclient(hunting): picked mon.noname-c con 0x565006a26f60 addr [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] 2024-09-14T11:36:06.672 INFO:tasks.workunit.client.0.smithi138.stderr: -303> 2024-09-14T11:36:06.310+0000 7f9b22f269c0 10 monclient(hunting): picked mon.noname-b con 0x5650069f7b40 addr [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] 2024-09-14T11:36:06.672 INFO:tasks.workunit.client.0.smithi138.stderr: -302> 2024-09-14T11:36:06.310+0000 7f9b22f269c0 10 monclient(hunting): start opening mon connection 2024-09-14T11:36:06.672 INFO:tasks.workunit.client.0.smithi138.stderr: -301> 2024-09-14T11:36:06.310+0000 7f9b22f269c0 10 monclient(hunting): start opening mon connection 2024-09-14T11:36:06.672 INFO:tasks.workunit.client.0.smithi138.stderr: -300> 2024-09-14T11:36:06.310+0000 7f9b22f269c0 10 monclient(hunting): start opening mon connection 2024-09-14T11:36:06.672 INFO:tasks.workunit.client.0.smithi138.stderr: -299> 2024-09-14T11:36:06.310+0000 7f9b22f269c0 10 monclient(hunting): _renew_subs 2024-09-14T11:36:06.672 INFO:tasks.workunit.client.0.smithi138.stderr: -298> 2024-09-14T11:36:06.310+0000 7f9b22f269c0 10 monclient(hunting): authenticate will time out at 2702.273801s 2024-09-14T11:36:06.672 INFO:tasks.workunit.client.0.smithi138.stderr: -297> 2024-09-14T11:36:06.310+0000 7f9b2022b640 10 monclient(hunting): get_auth_request con 0x565006a26b80 auth_method 0 2024-09-14T11:36:06.672 INFO:tasks.workunit.client.0.smithi138.stderr: -296> 2024-09-14T11:36:06.310+0000 7f9b2022b640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:36:06.672 INFO:tasks.workunit.client.0.smithi138.stderr: -295> 2024-09-14T11:36:06.310+0000 7f9b2022b640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:36:06.672 INFO:tasks.workunit.client.0.smithi138.stderr: -294> 2024-09-14T11:36:06.310+0000 7f9b2022b640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:36:06.672 INFO:tasks.workunit.client.0.smithi138.stderr: -293> 2024-09-14T11:36:06.310+0000 7f9b2122d640 10 monclient(hunting): get_auth_request con 0x565006a26f60 auth_method 0 2024-09-14T11:36:06.673 INFO:tasks.workunit.client.0.smithi138.stderr: -292> 2024-09-14T11:36:06.310+0000 7f9b2122d640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:36:06.673 INFO:tasks.workunit.client.0.smithi138.stderr: -291> 2024-09-14T11:36:06.310+0000 7f9b2122d640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:36:06.673 INFO:tasks.workunit.client.0.smithi138.stderr: -290> 2024-09-14T11:36:06.310+0000 7f9b2122d640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:36:06.673 INFO:tasks.workunit.client.0.smithi138.stderr: -289> 2024-09-14T11:36:06.310+0000 7f9b2022b640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:36:06.673 INFO:tasks.workunit.client.0.smithi138.stderr: -288> 2024-09-14T11:36:06.310+0000 7f9b2022b640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:36:06.673 INFO:tasks.workunit.client.0.smithi138.stderr: -287> 2024-09-14T11:36:06.310+0000 7f9b2022b640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:36:06.673 INFO:tasks.workunit.client.0.smithi138.stderr: -286> 2024-09-14T11:36:06.310+0000 7f9b2122d640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:36:06.673 INFO:tasks.workunit.client.0.smithi138.stderr: -285> 2024-09-14T11:36:06.310+0000 7f9b2122d640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:36:06.673 INFO:tasks.workunit.client.0.smithi138.stderr: -284> 2024-09-14T11:36:06.310+0000 7f9b2122d640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:36:06.673 INFO:tasks.workunit.client.0.smithi138.stderr: -283> 2024-09-14T11:36:06.310+0000 7f9b2022b640 10 monclient(hunting): handle_auth_done global_id 7008 payload 274 2024-09-14T11:36:06.673 INFO:tasks.workunit.client.0.smithi138.stderr: -282> 2024-09-14T11:36:06.310+0000 7f9b2022b640 10 monclient: _finish_hunting 0 2024-09-14T11:36:06.673 INFO:tasks.workunit.client.0.smithi138.stderr: -281> 2024-09-14T11:36:06.310+0000 7f9b2022b640 1 monclient: found mon.noname-a 2024-09-14T11:36:06.673 INFO:tasks.workunit.client.0.smithi138.stderr: -280> 2024-09-14T11:36:06.310+0000 7f9b2022b640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.138:3300/0 2024-09-14T11:36:06.673 INFO:tasks.workunit.client.0.smithi138.stderr: -279> 2024-09-14T11:36:06.310+0000 7f9b20a2c640 10 monclient: get_auth_request con 0x5650069f7b40 auth_method 0 2024-09-14T11:36:06.673 INFO:tasks.workunit.client.0.smithi138.stderr: -278> 2024-09-14T11:36:06.310+0000 7f99effff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:36:06.674 INFO:tasks.workunit.client.0.smithi138.stderr: -277> 2024-09-14T11:36:06.310+0000 7f99effff640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-14T11:36:06.674 INFO:tasks.workunit.client.0.smithi138.stderr: -276> 2024-09-14T11:36:06.310+0000 7f99effff640 10 monclient: dump: 2024-09-14T11:36:06.674 INFO:tasks.workunit.client.0.smithi138.stderr:epoch 1 2024-09-14T11:36:06.674 INFO:tasks.workunit.client.0.smithi138.stderr:fsid 3f225f43-83a6-4aeb-b798-1f04bb49d597 2024-09-14T11:36:06.674 INFO:tasks.workunit.client.0.smithi138.stderr:last_changed 2024-09-14T11:07:09.252780+0000 2024-09-14T11:36:06.674 INFO:tasks.workunit.client.0.smithi138.stderr:created 2024-09-14T11:07:09.252780+0000 2024-09-14T11:36:06.674 INFO:tasks.workunit.client.0.smithi138.stderr:min_mon_release 19 (squid) 2024-09-14T11:36:06.674 INFO:tasks.workunit.client.0.smithi138.stderr:election_strategy: 1 2024-09-14T11:36:06.674 INFO:tasks.workunit.client.0.smithi138.stderr:0: [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] mon.a 2024-09-14T11:36:06.674 INFO:tasks.workunit.client.0.smithi138.stderr:1: [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] mon.b 2024-09-14T11:36:06.674 INFO:tasks.workunit.client.0.smithi138.stderr:2: [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] mon.c 2024-09-14T11:36:06.674 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-14T11:36:06.674 INFO:tasks.workunit.client.0.smithi138.stderr: -275> 2024-09-14T11:36:06.310+0000 7f99effff640 10 monclient: _finish_auth 0 2024-09-14T11:36:06.674 INFO:tasks.workunit.client.0.smithi138.stderr: -274> 2024-09-14T11:36:06.310+0000 7f99effff640 10 monclient: _check_auth_tickets 2024-09-14T11:36:06.675 INFO:tasks.workunit.client.0.smithi138.stderr: -273> 2024-09-14T11:36:06.310+0000 7f99effff640 10 monclient: handle_config config(0 keys) 2024-09-14T11:36:06.675 INFO:tasks.workunit.client.0.smithi138.stderr: -272> 2024-09-14T11:36:06.310+0000 7f99effff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:36:06.675 INFO:tasks.workunit.client.0.smithi138.stderr: -271> 2024-09-14T11:36:06.310+0000 7f99effff640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-14T11:36:06.675 INFO:tasks.workunit.client.0.smithi138.stderr: -270> 2024-09-14T11:36:06.310+0000 7f99effff640 10 monclient: dump: 2024-09-14T11:36:06.675 INFO:tasks.workunit.client.0.smithi138.stderr:epoch 1 2024-09-14T11:36:06.675 INFO:tasks.workunit.client.0.smithi138.stderr:fsid 3f225f43-83a6-4aeb-b798-1f04bb49d597 2024-09-14T11:36:06.675 INFO:tasks.workunit.client.0.smithi138.stderr:last_changed 2024-09-14T11:07:09.252780+0000 2024-09-14T11:36:06.675 INFO:tasks.workunit.client.0.smithi138.stderr:created 2024-09-14T11:07:09.252780+0000 2024-09-14T11:36:06.675 INFO:tasks.workunit.client.0.smithi138.stderr:min_mon_release 19 (squid) 2024-09-14T11:36:06.675 INFO:tasks.workunit.client.0.smithi138.stderr:election_strategy: 1 2024-09-14T11:36:06.675 INFO:tasks.workunit.client.0.smithi138.stderr:0: [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] mon.a 2024-09-14T11:36:06.675 INFO:tasks.workunit.client.0.smithi138.stderr:1: [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] mon.b 2024-09-14T11:36:06.675 INFO:tasks.workunit.client.0.smithi138.stderr:2: [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] mon.c 2024-09-14T11:36:06.675 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-14T11:36:06.676 INFO:tasks.workunit.client.0.smithi138.stderr: -269> 2024-09-14T11:36:06.310+0000 7f9b22f269c0 5 monclient: authenticate success, global_id 7008 2024-09-14T11:36:06.676 INFO:tasks.workunit.client.0.smithi138.stderr: -268> 2024-09-14T11:36:06.310+0000 7f9b22f269c0 10 monclient: get_monmap_and_config success 2024-09-14T11:36:06.676 INFO:tasks.workunit.client.0.smithi138.stderr: -267> 2024-09-14T11:36:06.310+0000 7f9b22f269c0 4 set_mon_vals no callback set 2024-09-14T11:36:06.676 INFO:tasks.workunit.client.0.smithi138.stderr: -266> 2024-09-14T11:36:06.310+0000 7f9b22f269c0 10 monclient: shutdown 2024-09-14T11:36:06.676 INFO:tasks.workunit.client.0.smithi138.stderr: -265> 2024-09-14T11:36:06.310+0000 7f9b22f269c0 10 monclient: build_initial_monmap 2024-09-14T11:36:06.676 INFO:tasks.workunit.client.0.smithi138.stderr: -264> 2024-09-14T11:36:06.310+0000 7f9b22f269c0 1 build_initial for_mkfs: 0 2024-09-14T11:36:06.676 INFO:tasks.workunit.client.0.smithi138.stderr: -263> 2024-09-14T11:36:06.310+0000 7f9b22f269c0 10 monclient: monmap: 2024-09-14T11:36:06.676 INFO:tasks.workunit.client.0.smithi138.stderr:epoch 0 2024-09-14T11:36:06.676 INFO:tasks.workunit.client.0.smithi138.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-14T11:36:06.676 INFO:tasks.workunit.client.0.smithi138.stderr:last_changed 0.000000 2024-09-14T11:36:06.676 INFO:tasks.workunit.client.0.smithi138.stderr:created 0.000000 2024-09-14T11:36:06.676 INFO:tasks.workunit.client.0.smithi138.stderr:min_mon_release 0 (unknown) 2024-09-14T11:36:06.676 INFO:tasks.workunit.client.0.smithi138.stderr:election_strategy: 1 2024-09-14T11:36:06.676 INFO:tasks.workunit.client.0.smithi138.stderr:0: [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] mon.noname-a 2024-09-14T11:36:06.676 INFO:tasks.workunit.client.0.smithi138.stderr:1: [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] mon.noname-b 2024-09-14T11:36:06.677 INFO:tasks.workunit.client.0.smithi138.stderr:2: [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] mon.noname-c 2024-09-14T11:36:06.677 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-14T11:36:06.677 INFO:tasks.workunit.client.0.smithi138.stderr: -262> 2024-09-14T11:36:06.310+0000 7f9b22f269c0 5 AuthRegistry(0x5650069f6830) adding auth protocol: cephx 2024-09-14T11:36:06.677 INFO:tasks.workunit.client.0.smithi138.stderr: -261> 2024-09-14T11:36:06.310+0000 7f9b22f269c0 5 AuthRegistry(0x5650069f6830) adding auth protocol: cephx 2024-09-14T11:36:06.677 INFO:tasks.workunit.client.0.smithi138.stderr: -260> 2024-09-14T11:36:06.310+0000 7f9b22f269c0 5 AuthRegistry(0x5650069f6830) adding auth protocol: cephx 2024-09-14T11:36:06.677 INFO:tasks.workunit.client.0.smithi138.stderr: -259> 2024-09-14T11:36:06.310+0000 7f9b22f269c0 5 AuthRegistry(0x5650069f6830) adding con mode: secure 2024-09-14T11:36:06.677 INFO:tasks.workunit.client.0.smithi138.stderr: -258> 2024-09-14T11:36:06.310+0000 7f9b22f269c0 5 AuthRegistry(0x5650069f6830) adding con mode: crc 2024-09-14T11:36:06.677 INFO:tasks.workunit.client.0.smithi138.stderr: -257> 2024-09-14T11:36:06.310+0000 7f9b22f269c0 5 AuthRegistry(0x5650069f6830) adding con mode: secure 2024-09-14T11:36:06.677 INFO:tasks.workunit.client.0.smithi138.stderr: -256> 2024-09-14T11:36:06.310+0000 7f9b22f269c0 5 AuthRegistry(0x5650069f6830) adding con mode: crc 2024-09-14T11:36:06.677 INFO:tasks.workunit.client.0.smithi138.stderr: -255> 2024-09-14T11:36:06.310+0000 7f9b22f269c0 5 AuthRegistry(0x5650069f6830) adding con mode: secure 2024-09-14T11:36:06.677 INFO:tasks.workunit.client.0.smithi138.stderr: -254> 2024-09-14T11:36:06.310+0000 7f9b22f269c0 5 AuthRegistry(0x5650069f6830) adding con mode: crc 2024-09-14T11:36:06.677 INFO:tasks.workunit.client.0.smithi138.stderr: -253> 2024-09-14T11:36:06.310+0000 7f9b22f269c0 5 AuthRegistry(0x5650069f6830) adding con mode: crc 2024-09-14T11:36:06.677 INFO:tasks.workunit.client.0.smithi138.stderr: -252> 2024-09-14T11:36:06.310+0000 7f9b22f269c0 5 AuthRegistry(0x5650069f6830) adding con mode: secure 2024-09-14T11:36:06.677 INFO:tasks.workunit.client.0.smithi138.stderr: -251> 2024-09-14T11:36:06.310+0000 7f9b22f269c0 5 AuthRegistry(0x5650069f6830) adding con mode: crc 2024-09-14T11:36:06.678 INFO:tasks.workunit.client.0.smithi138.stderr: -250> 2024-09-14T11:36:06.310+0000 7f9b22f269c0 5 AuthRegistry(0x5650069f6830) adding con mode: secure 2024-09-14T11:36:06.678 INFO:tasks.workunit.client.0.smithi138.stderr: -249> 2024-09-14T11:36:06.310+0000 7f9b22f269c0 5 AuthRegistry(0x5650069f6830) adding con mode: crc 2024-09-14T11:36:06.678 INFO:tasks.workunit.client.0.smithi138.stderr: -248> 2024-09-14T11:36:06.310+0000 7f9b22f269c0 5 AuthRegistry(0x5650069f6830) adding con mode: secure 2024-09-14T11:36:06.678 INFO:tasks.workunit.client.0.smithi138.stderr: -247> 2024-09-14T11:36:06.310+0000 7f9b22f269c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:36:06.678 INFO:tasks.workunit.client.0.smithi138.stderr: -246> 2024-09-14T11:36:06.310+0000 7f9b22f269c0 1 librados: starting msgr at 2024-09-14T11:36:06.678 INFO:tasks.workunit.client.0.smithi138.stderr: -245> 2024-09-14T11:36:06.310+0000 7f9b22f269c0 1 librados: starting objecter 2024-09-14T11:36:06.678 INFO:tasks.workunit.client.0.smithi138.stderr: -244> 2024-09-14T11:36:06.310+0000 7f9b22f269c0 5 asok(0x56500674dd90) register_command objecter_requests cmddesc objecter_requests hook 0x5650069da400 EEXIST 2024-09-14T11:36:06.678 INFO:tasks.workunit.client.0.smithi138.stderr: -243> 2024-09-14T11:36:06.310+0000 7f9b22f269c0 1 librados: setting wanted keys 2024-09-14T11:36:06.678 INFO:tasks.workunit.client.0.smithi138.stderr: -242> 2024-09-14T11:36:06.310+0000 7f9b22f269c0 1 librados: calling monclient init 2024-09-14T11:36:06.678 INFO:tasks.workunit.client.0.smithi138.stderr: -241> 2024-09-14T11:36:06.310+0000 7f9b22f269c0 10 monclient: init 2024-09-14T11:36:06.678 INFO:tasks.workunit.client.0.smithi138.stderr: -240> 2024-09-14T11:36:06.310+0000 7f9b22f269c0 5 AuthRegistry(0x5650069dbc70) adding auth protocol: cephx 2024-09-14T11:36:06.678 INFO:tasks.workunit.client.0.smithi138.stderr: -239> 2024-09-14T11:36:06.310+0000 7f9b22f269c0 5 AuthRegistry(0x5650069dbc70) adding auth protocol: cephx 2024-09-14T11:36:06.678 INFO:tasks.workunit.client.0.smithi138.stderr: -238> 2024-09-14T11:36:06.310+0000 7f9b22f269c0 5 AuthRegistry(0x5650069dbc70) adding auth protocol: cephx 2024-09-14T11:36:06.679 INFO:tasks.workunit.client.0.smithi138.stderr: -237> 2024-09-14T11:36:06.310+0000 7f9b22f269c0 5 AuthRegistry(0x5650069dbc70) adding con mode: secure 2024-09-14T11:36:06.679 INFO:tasks.workunit.client.0.smithi138.stderr: -236> 2024-09-14T11:36:06.310+0000 7f9b22f269c0 5 AuthRegistry(0x5650069dbc70) adding con mode: crc 2024-09-14T11:36:06.679 INFO:tasks.workunit.client.0.smithi138.stderr: -235> 2024-09-14T11:36:06.310+0000 7f9b22f269c0 5 AuthRegistry(0x5650069dbc70) adding con mode: secure 2024-09-14T11:36:06.679 INFO:tasks.workunit.client.0.smithi138.stderr: -234> 2024-09-14T11:36:06.310+0000 7f9b22f269c0 5 AuthRegistry(0x5650069dbc70) adding con mode: crc 2024-09-14T11:36:06.679 INFO:tasks.workunit.client.0.smithi138.stderr: -233> 2024-09-14T11:36:06.310+0000 7f9b22f269c0 5 AuthRegistry(0x5650069dbc70) adding con mode: secure 2024-09-14T11:36:06.679 INFO:tasks.workunit.client.0.smithi138.stderr: -232> 2024-09-14T11:36:06.310+0000 7f9b22f269c0 5 AuthRegistry(0x5650069dbc70) adding con mode: crc 2024-09-14T11:36:06.679 INFO:tasks.workunit.client.0.smithi138.stderr: -231> 2024-09-14T11:36:06.310+0000 7f9b22f269c0 5 AuthRegistry(0x5650069dbc70) adding con mode: crc 2024-09-14T11:36:06.679 INFO:tasks.workunit.client.0.smithi138.stderr: -230> 2024-09-14T11:36:06.310+0000 7f9b22f269c0 5 AuthRegistry(0x5650069dbc70) adding con mode: secure 2024-09-14T11:36:06.679 INFO:tasks.workunit.client.0.smithi138.stderr: -229> 2024-09-14T11:36:06.310+0000 7f9b22f269c0 5 AuthRegistry(0x5650069dbc70) adding con mode: crc 2024-09-14T11:36:06.679 INFO:tasks.workunit.client.0.smithi138.stderr: -228> 2024-09-14T11:36:06.310+0000 7f9b22f269c0 5 AuthRegistry(0x5650069dbc70) adding con mode: secure 2024-09-14T11:36:06.679 INFO:tasks.workunit.client.0.smithi138.stderr: -227> 2024-09-14T11:36:06.310+0000 7f9b22f269c0 5 AuthRegistry(0x5650069dbc70) adding con mode: crc 2024-09-14T11:36:06.679 INFO:tasks.workunit.client.0.smithi138.stderr: -226> 2024-09-14T11:36:06.310+0000 7f9b22f269c0 5 AuthRegistry(0x5650069dbc70) adding con mode: secure 2024-09-14T11:36:06.679 INFO:tasks.workunit.client.0.smithi138.stderr: -225> 2024-09-14T11:36:06.314+0000 7f9b22f269c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:36:06.679 INFO:tasks.workunit.client.0.smithi138.stderr: -224> 2024-09-14T11:36:06.314+0000 7f9b22f269c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:36:06.680 INFO:tasks.workunit.client.0.smithi138.stderr: -223> 2024-09-14T11:36:06.314+0000 7f9b22f269c0 5 asok(0x56500674dd90) register_command rotate-key cmddesc rotate-key hook 0x5650069dbdb8 EEXIST 2024-09-14T11:36:06.680 INFO:tasks.workunit.client.0.smithi138.stderr: -222> 2024-09-14T11:36:06.314+0000 7f9b22f269c0 10 monclient: _reopen_session rank -1 2024-09-14T11:36:06.680 INFO:tasks.workunit.client.0.smithi138.stderr: -221> 2024-09-14T11:36:06.314+0000 7f9b22f269c0 10 monclient: _add_conns ranks=[1,2,0] 2024-09-14T11:36:06.680 INFO:tasks.workunit.client.0.smithi138.stderr: -220> 2024-09-14T11:36:06.314+0000 7f9b22f269c0 10 monclient(hunting): picked mon.noname-b con 0x5650069f7b40 addr [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] 2024-09-14T11:36:06.680 INFO:tasks.workunit.client.0.smithi138.stderr: -219> 2024-09-14T11:36:06.314+0000 7f9b22f269c0 10 monclient(hunting): picked mon.noname-c con 0x565006a26b80 addr [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] 2024-09-14T11:36:06.680 INFO:tasks.workunit.client.0.smithi138.stderr: -218> 2024-09-14T11:36:06.314+0000 7f9b22f269c0 10 monclient(hunting): picked mon.noname-a con 0x565006a24270 addr [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] 2024-09-14T11:36:06.680 INFO:tasks.workunit.client.0.smithi138.stderr: -217> 2024-09-14T11:36:06.314+0000 7f9b22f269c0 10 monclient(hunting): start opening mon connection 2024-09-14T11:36:06.680 INFO:tasks.workunit.client.0.smithi138.stderr: -216> 2024-09-14T11:36:06.314+0000 7f9b22f269c0 10 monclient(hunting): start opening mon connection 2024-09-14T11:36:06.680 INFO:tasks.workunit.client.0.smithi138.stderr: -215> 2024-09-14T11:36:06.314+0000 7f9b22f269c0 10 monclient(hunting): start opening mon connection 2024-09-14T11:36:06.680 INFO:tasks.workunit.client.0.smithi138.stderr: -214> 2024-09-14T11:36:06.314+0000 7f9b22f269c0 10 monclient(hunting): _renew_subs 2024-09-14T11:36:06.680 INFO:tasks.workunit.client.0.smithi138.stderr: -213> 2024-09-14T11:36:06.314+0000 7f9b22f269c0 10 monclient(hunting): authenticate will time out at 2702.276491s 2024-09-14T11:36:06.680 INFO:tasks.workunit.client.0.smithi138.stderr: -212> 2024-09-14T11:36:06.314+0000 7f9b20a2c640 10 monclient(hunting): get_auth_request con 0x565006a24270 auth_method 0 2024-09-14T11:36:06.680 INFO:tasks.workunit.client.0.smithi138.stderr: -211> 2024-09-14T11:36:06.314+0000 7f9b20a2c640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:36:06.680 INFO:tasks.workunit.client.0.smithi138.stderr: -210> 2024-09-14T11:36:06.314+0000 7f9b20a2c640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:36:06.681 INFO:tasks.workunit.client.0.smithi138.stderr: -209> 2024-09-14T11:36:06.314+0000 7f9b20a2c640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:36:06.681 INFO:tasks.workunit.client.0.smithi138.stderr: -208> 2024-09-14T11:36:06.314+0000 7f9b2122d640 10 monclient(hunting): get_auth_request con 0x565006a26b80 auth_method 0 2024-09-14T11:36:06.681 INFO:tasks.workunit.client.0.smithi138.stderr: -207> 2024-09-14T11:36:06.314+0000 7f9b2122d640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:36:06.681 INFO:tasks.workunit.client.0.smithi138.stderr: -206> 2024-09-14T11:36:06.314+0000 7f9b2122d640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:36:06.681 INFO:tasks.workunit.client.0.smithi138.stderr: -205> 2024-09-14T11:36:06.314+0000 7f9b2122d640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:36:06.681 INFO:tasks.workunit.client.0.smithi138.stderr: -204> 2024-09-14T11:36:06.314+0000 7f9b20a2c640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:36:06.681 INFO:tasks.workunit.client.0.smithi138.stderr: -203> 2024-09-14T11:36:06.314+0000 7f9b20a2c640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:36:06.681 INFO:tasks.workunit.client.0.smithi138.stderr: -202> 2024-09-14T11:36:06.314+0000 7f9b20a2c640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:36:06.681 INFO:tasks.workunit.client.0.smithi138.stderr: -201> 2024-09-14T11:36:06.314+0000 7f9b2122d640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:36:06.681 INFO:tasks.workunit.client.0.smithi138.stderr: -200> 2024-09-14T11:36:06.314+0000 7f9b2122d640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:36:06.681 INFO:tasks.workunit.client.0.smithi138.stderr: -199> 2024-09-14T11:36:06.314+0000 7f9b2122d640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:36:06.681 INFO:tasks.workunit.client.0.smithi138.stderr: -198> 2024-09-14T11:36:06.314+0000 7f9b2022b640 10 monclient(hunting): get_auth_request con 0x5650069f7b40 auth_method 0 2024-09-14T11:36:06.681 INFO:tasks.workunit.client.0.smithi138.stderr: -197> 2024-09-14T11:36:06.314+0000 7f9b2022b640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:36:06.681 INFO:tasks.workunit.client.0.smithi138.stderr: -196> 2024-09-14T11:36:06.314+0000 7f9b2022b640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:36:06.682 INFO:tasks.workunit.client.0.smithi138.stderr: -195> 2024-09-14T11:36:06.314+0000 7f9b2022b640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:36:06.682 INFO:tasks.workunit.client.0.smithi138.stderr: -194> 2024-09-14T11:36:06.314+0000 7f9b20a2c640 10 monclient(hunting): handle_auth_done global_id 7011 payload 824 2024-09-14T11:36:06.682 INFO:tasks.workunit.client.0.smithi138.stderr: -193> 2024-09-14T11:36:06.314+0000 7f9b20a2c640 10 monclient: _finish_hunting 0 2024-09-14T11:36:06.682 INFO:tasks.workunit.client.0.smithi138.stderr: -192> 2024-09-14T11:36:06.314+0000 7f9b20a2c640 1 monclient: found mon.noname-a 2024-09-14T11:36:06.682 INFO:tasks.workunit.client.0.smithi138.stderr: -191> 2024-09-14T11:36:06.314+0000 7f9b20a2c640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.138:3300/0 2024-09-14T11:36:06.682 INFO:tasks.workunit.client.0.smithi138.stderr: -190> 2024-09-14T11:36:06.314+0000 7f99ee7fc640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:36:06.682 INFO:tasks.workunit.client.0.smithi138.stderr: -189> 2024-09-14T11:36:06.314+0000 7f99ee7fc640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-14T11:36:06.682 INFO:tasks.workunit.client.0.smithi138.stderr: -188> 2024-09-14T11:36:06.314+0000 7f99ee7fc640 10 monclient: dump: 2024-09-14T11:36:06.682 INFO:tasks.workunit.client.0.smithi138.stderr:epoch 1 2024-09-14T11:36:06.682 INFO:tasks.workunit.client.0.smithi138.stderr:fsid 3f225f43-83a6-4aeb-b798-1f04bb49d597 2024-09-14T11:36:06.682 INFO:tasks.workunit.client.0.smithi138.stderr:last_changed 2024-09-14T11:07:09.252780+0000 2024-09-14T11:36:06.682 INFO:tasks.workunit.client.0.smithi138.stderr:created 2024-09-14T11:07:09.252780+0000 2024-09-14T11:36:06.682 INFO:tasks.workunit.client.0.smithi138.stderr:min_mon_release 19 (squid) 2024-09-14T11:36:06.682 INFO:tasks.workunit.client.0.smithi138.stderr:election_strategy: 1 2024-09-14T11:36:06.683 INFO:tasks.workunit.client.0.smithi138.stderr:0: [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] mon.a 2024-09-14T11:36:06.683 INFO:tasks.workunit.client.0.smithi138.stderr:1: [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] mon.b 2024-09-14T11:36:06.683 INFO:tasks.workunit.client.0.smithi138.stderr:2: [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] mon.c 2024-09-14T11:36:06.683 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-14T11:36:06.683 INFO:tasks.workunit.client.0.smithi138.stderr: -187> 2024-09-14T11:36:06.314+0000 7f99ee7fc640 10 monclient: _finish_auth 0 2024-09-14T11:36:06.683 INFO:tasks.workunit.client.0.smithi138.stderr: -186> 2024-09-14T11:36:06.314+0000 7f99ee7fc640 10 monclient: _check_auth_tickets 2024-09-14T11:36:06.683 INFO:tasks.workunit.client.0.smithi138.stderr: -185> 2024-09-14T11:36:06.314+0000 7f99ee7fc640 10 monclient: handle_config config(0 keys) 2024-09-14T11:36:06.683 INFO:tasks.workunit.client.0.smithi138.stderr: -184> 2024-09-14T11:36:06.314+0000 7f99ee7fc640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:36:06.683 INFO:tasks.workunit.client.0.smithi138.stderr: -183> 2024-09-14T11:36:06.314+0000 7f99ee7fc640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-14T11:36:06.683 INFO:tasks.workunit.client.0.smithi138.stderr: -182> 2024-09-14T11:36:06.314+0000 7f99ee7fc640 10 monclient: dump: 2024-09-14T11:36:06.683 INFO:tasks.workunit.client.0.smithi138.stderr:epoch 1 2024-09-14T11:36:06.683 INFO:tasks.workunit.client.0.smithi138.stderr:fsid 3f225f43-83a6-4aeb-b798-1f04bb49d597 2024-09-14T11:36:06.683 INFO:tasks.workunit.client.0.smithi138.stderr:last_changed 2024-09-14T11:07:09.252780+0000 2024-09-14T11:36:06.683 INFO:tasks.workunit.client.0.smithi138.stderr:created 2024-09-14T11:07:09.252780+0000 2024-09-14T11:36:06.684 INFO:tasks.workunit.client.0.smithi138.stderr:min_mon_release 19 (squid) 2024-09-14T11:36:06.684 INFO:tasks.workunit.client.0.smithi138.stderr:election_strategy: 1 2024-09-14T11:36:06.684 INFO:tasks.workunit.client.0.smithi138.stderr:0: [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] mon.a 2024-09-14T11:36:06.684 INFO:tasks.workunit.client.0.smithi138.stderr:1: [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] mon.b 2024-09-14T11:36:06.684 INFO:tasks.workunit.client.0.smithi138.stderr:2: [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] mon.c 2024-09-14T11:36:06.684 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-14T11:36:06.684 INFO:tasks.workunit.client.0.smithi138.stderr: -181> 2024-09-14T11:36:06.314+0000 7f99effff640 4 set_mon_vals no callback set 2024-09-14T11:36:06.684 INFO:tasks.workunit.client.0.smithi138.stderr: -180> 2024-09-14T11:36:06.314+0000 7f9b22f269c0 5 monclient: authenticate success, global_id 7011 2024-09-14T11:36:06.684 INFO:tasks.workunit.client.0.smithi138.stderr: -179> 2024-09-14T11:36:06.314+0000 7f9b22f269c0 10 monclient: _renew_subs 2024-09-14T11:36:06.684 INFO:tasks.workunit.client.0.smithi138.stderr: -178> 2024-09-14T11:36:06.314+0000 7f9b22f269c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.138:3300/0 2024-09-14T11:36:06.684 INFO:tasks.workunit.client.0.smithi138.stderr: -177> 2024-09-14T11:36:06.314+0000 7f9b22f269c0 10 monclient: _renew_subs 2024-09-14T11:36:06.684 INFO:tasks.workunit.client.0.smithi138.stderr: -176> 2024-09-14T11:36:06.314+0000 7f9b22f269c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.138:3300/0 2024-09-14T11:36:06.684 INFO:tasks.workunit.client.0.smithi138.stderr: -175> 2024-09-14T11:36:06.314+0000 7f9b22f269c0 1 librados: init done 2024-09-14T11:36:06.684 INFO:tasks.workunit.client.0.smithi138.stderr: -174> 2024-09-14T11:36:06.314+0000 7f9b22f269c0 5 asok(0x56500674dd90) register_command cr dump hook 0x565006a2acc8 2024-09-14T11:36:06.684 INFO:tasks.workunit.client.0.smithi138.stderr: -173> 2024-09-14T11:36:06.314+0000 7f9b22f269c0 20 rados->read ofs=0 len=0 2024-09-14T11:36:06.685 INFO:tasks.workunit.client.0.smithi138.stderr: -172> 2024-09-14T11:36:06.314+0000 7f99ee7fc640 4 mgrc handle_mgr_map Got map version 5 2024-09-14T11:36:06.685 INFO:tasks.workunit.client.0.smithi138.stderr: -171> 2024-09-14T11:36:06.314+0000 7f99ee7fc640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.138:6832/3778043143,v1:172.21.15.138:6833/3778043143] 2024-09-14T11:36:06.685 INFO:tasks.workunit.client.0.smithi138.stderr: -170> 2024-09-14T11:36:06.314+0000 7f99ee7fc640 4 mgrc reconnect Starting new session with [v2:172.21.15.138:6832/3778043143,v1:172.21.15.138:6833/3778043143] 2024-09-14T11:36:06.685 INFO:tasks.workunit.client.0.smithi138.stderr: -169> 2024-09-14T11:36:06.314+0000 7f9b2022b640 10 monclient: get_auth_request con 0x7f99e80718a0 auth_method 0 2024-09-14T11:36:06.685 INFO:tasks.workunit.client.0.smithi138.stderr: -168> 2024-09-14T11:36:06.314+0000 7f9b2122d640 10 monclient: get_auth_request con 0x565006a40590 auth_method 0 2024-09-14T11:36:06.685 INFO:tasks.workunit.client.0.smithi138.stderr: -167> 2024-09-14T11:36:06.318+0000 7f9b22f269c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:36:06.685 INFO:tasks.workunit.client.0.smithi138.stderr: -166> 2024-09-14T11:36:06.318+0000 7f9b22f269c0 20 realm 2024-09-14T11:36:06.685 INFO:tasks.workunit.client.0.smithi138.stderr: -165> 2024-09-14T11:36:06.318+0000 7f9b22f269c0 20 rados->read ofs=0 len=0 2024-09-14T11:36:06.685 INFO:tasks.workunit.client.0.smithi138.stderr: -164> 2024-09-14T11:36:06.318+0000 7f9b22f269c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:36:06.685 INFO:tasks.workunit.client.0.smithi138.stderr: -163> 2024-09-14T11:36:06.318+0000 7f9b22f269c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:36:06.685 INFO:tasks.workunit.client.0.smithi138.stderr: -162> 2024-09-14T11:36:06.318+0000 7f9b22f269c0 20 rados->read ofs=0 len=0 2024-09-14T11:36:06.685 INFO:tasks.workunit.client.0.smithi138.stderr: -161> 2024-09-14T11:36:06.318+0000 7f9b22f269c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:36:06.685 INFO:tasks.workunit.client.0.smithi138.stderr: -160> 2024-09-14T11:36:06.318+0000 7f9b22f269c0 20 rados->read ofs=0 len=0 2024-09-14T11:36:06.685 INFO:tasks.workunit.client.0.smithi138.stderr: -159> 2024-09-14T11:36:06.318+0000 7f9b2022b640 10 monclient: get_auth_request con 0x565006a44810 auth_method 0 2024-09-14T11:36:06.685 INFO:tasks.workunit.client.0.smithi138.stderr: -158> 2024-09-14T11:36:06.318+0000 7f9b22f269c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:36:06.686 INFO:tasks.workunit.client.0.smithi138.stderr: -157> 2024-09-14T11:36:06.318+0000 7f9b22f269c0 20 rados->read ofs=0 len=0 2024-09-14T11:36:06.686 INFO:tasks.workunit.client.0.smithi138.stderr: -156> 2024-09-14T11:36:06.318+0000 7f9b2122d640 10 monclient: get_auth_request con 0x565006a48070 auth_method 0 2024-09-14T11:36:06.686 INFO:tasks.workunit.client.0.smithi138.stderr: -155> 2024-09-14T11:36:06.318+0000 7f9b22f269c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:36:06.686 INFO:tasks.workunit.client.0.smithi138.stderr: -154> 2024-09-14T11:36:06.318+0000 7f9b22f269c0 20 searching for the correct realm 2024-09-14T11:36:06.686 INFO:tasks.workunit.client.0.smithi138.stderr: -153> 2024-09-14T11:36:06.318+0000 7f9b20a2c640 10 monclient: get_auth_request con 0x565006a4cda0 auth_method 0 2024-09-14T11:36:06.686 INFO:tasks.workunit.client.0.smithi138.stderr: -152> 2024-09-14T11:36:06.322+0000 7f9b2022b640 0 -- 172.21.15.138:0/965841732 >> [v2:172.21.15.154:6808/1468088432,v1:172.21.15.154:6809/1468088432] conn(0x7f9b10058020 msgr2=0x7f9b1008b850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:36:06.686 INFO:tasks.workunit.client.0.smithi138.stderr: -151> 2024-09-14T11:36:06.526+0000 7f9b2022b640 10 monclient: get_auth_request con 0x7f9b10058020 auth_method 0 2024-09-14T11:36:06.686 INFO:tasks.workunit.client.0.smithi138.stderr: -150> 2024-09-14T11:36:06.526+0000 7f9b2122d640 10 monclient: get_auth_request con 0x7f9b18017020 auth_method 0 2024-09-14T11:36:06.686 INFO:tasks.workunit.client.0.smithi138.stderr: -149> 2024-09-14T11:36:06.534+0000 7f9b20a2c640 10 monclient: get_auth_request con 0x7f9b18063ee0 auth_method 0 2024-09-14T11:36:06.686 INFO:tasks.workunit.client.0.smithi138.stderr: -148> 2024-09-14T11:36:06.534+0000 7f9b2122d640 0 -- 172.21.15.138:0/965841732 >> [v2:172.21.15.138:6824/2633984942,v1:172.21.15.138:6825/2633984942] conn(0x565006a48070 msgr2=0x565006a4a460 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:36:06.686 INFO:tasks.workunit.client.0.smithi138.stderr: -147> 2024-09-14T11:36:06.534+0000 7f99ee7fc640 1 client.7011.objecter ms_handle_reset 0x565006a48070 session 0x565006a43ba0 osd.2 2024-09-14T11:36:06.686 INFO:tasks.workunit.client.0.smithi138.stderr: -146> 2024-09-14T11:36:06.534+0000 7f99ee7fc640 10 monclient: _renew_subs 2024-09-14T11:36:06.687 INFO:tasks.workunit.client.0.smithi138.stderr: -145> 2024-09-14T11:36:06.534+0000 7f99ee7fc640 10 monclient: _send_mon_message to mon.a at v2:172.21.15.138:3300/0 2024-09-14T11:36:06.687 INFO:tasks.workunit.client.0.smithi138.stderr: -144> 2024-09-14T11:36:06.534+0000 7f9b2122d640 10 monclient: get_auth_request con 0x7f99e8081fd0 auth_method 0 2024-09-14T11:36:06.687 INFO:tasks.workunit.client.0.smithi138.stderr: -143> 2024-09-14T11:36:06.538+0000 7f9b2022b640 10 monclient: get_auth_request con 0x7f9b1806d0d0 auth_method 0 2024-09-14T11:36:06.687 INFO:tasks.workunit.client.0.smithi138.stderr: -142> 2024-09-14T11:36:06.554+0000 7f9b22f269c0 20 RGWRados::pool_iterate: got zone_info.d9e72d30-c60b-4d0d-9267-fdc36392d5ad 2024-09-14T11:36:06.687 INFO:tasks.workunit.client.0.smithi138.stderr: -141> 2024-09-14T11:36:06.554+0000 7f9b22f269c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:36:06.687 INFO:tasks.workunit.client.0.smithi138.stderr: -140> 2024-09-14T11:36:06.554+0000 7f9b22f269c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:36:06.687 INFO:tasks.workunit.client.0.smithi138.stderr: -139> 2024-09-14T11:36:06.554+0000 7f9b22f269c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:36:06.687 INFO:tasks.workunit.client.0.smithi138.stderr: -138> 2024-09-14T11:36:06.554+0000 7f9b22f269c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:36:06.687 INFO:tasks.workunit.client.0.smithi138.stderr: -137> 2024-09-14T11:36:06.554+0000 7f9b22f269c0 20 RGWRados::pool_iterate: got zonegroup_info.65ab941b-da8c-4160-94fb-3672b069d44f 2024-09-14T11:36:06.687 INFO:tasks.workunit.client.0.smithi138.stderr: -136> 2024-09-14T11:36:06.554+0000 7f9b22f269c0 20 rados->read ofs=0 len=0 2024-09-14T11:36:06.687 INFO:tasks.workunit.client.0.smithi138.stderr: -135> 2024-09-14T11:36:06.554+0000 7f9b22f269c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:36:06.687 INFO:tasks.workunit.client.0.smithi138.stderr: -134> 2024-09-14T11:36:06.554+0000 7f9b22f269c0 20 rados->read ofs=0 len=0 2024-09-14T11:36:06.687 INFO:tasks.workunit.client.0.smithi138.stderr: -133> 2024-09-14T11:36:06.554+0000 7f9b22f269c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:36:06.688 INFO:tasks.workunit.client.0.smithi138.stderr: -132> 2024-09-14T11:36:06.554+0000 7f9b22f269c0 20 rados->read ofs=0 len=0 2024-09-14T11:36:06.688 INFO:tasks.workunit.client.0.smithi138.stderr: -131> 2024-09-14T11:36:06.554+0000 7f9b22f269c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:36:06.688 INFO:tasks.workunit.client.0.smithi138.stderr: -130> 2024-09-14T11:36:06.554+0000 7f9b22f269c0 20 zone default found 2024-09-14T11:36:06.688 INFO:tasks.workunit.client.0.smithi138.stderr: -129> 2024-09-14T11:36:06.554+0000 7f9b22f269c0 4 Realm: () 2024-09-14T11:36:06.688 INFO:tasks.workunit.client.0.smithi138.stderr: -128> 2024-09-14T11:36:06.554+0000 7f9b22f269c0 4 ZoneGroup: default (65ab941b-da8c-4160-94fb-3672b069d44f) 2024-09-14T11:36:06.688 INFO:tasks.workunit.client.0.smithi138.stderr: -127> 2024-09-14T11:36:06.554+0000 7f9b22f269c0 4 Zone: default (d9e72d30-c60b-4d0d-9267-fdc36392d5ad) 2024-09-14T11:36:06.688 INFO:tasks.workunit.client.0.smithi138.stderr: -126> 2024-09-14T11:36:06.554+0000 7f9b22f269c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:36:06.688 INFO:tasks.workunit.client.0.smithi138.stderr: -125> 2024-09-14T11:36:06.554+0000 7f9b22f269c0 20 zonegroup default 2024-09-14T11:36:06.688 INFO:tasks.workunit.client.0.smithi138.stderr: -124> 2024-09-14T11:36:06.554+0000 7f9b22f269c0 20 rados->read ofs=0 len=0 2024-09-14T11:36:06.688 INFO:tasks.workunit.client.0.smithi138.stderr: -123> 2024-09-14T11:36:06.558+0000 7f9b22f269c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:36:06.688 INFO:tasks.workunit.client.0.smithi138.stderr: -122> 2024-09-14T11:36:06.558+0000 7f9b22f269c0 20 rados->read ofs=0 len=0 2024-09-14T11:36:06.688 INFO:tasks.workunit.client.0.smithi138.stderr: -121> 2024-09-14T11:36:06.558+0000 7f9b22f269c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:36:06.688 INFO:tasks.workunit.client.0.smithi138.stderr: -120> 2024-09-14T11:36:06.558+0000 7f9b22f269c0 20 rados->read ofs=0 len=0 2024-09-14T11:36:06.688 INFO:tasks.workunit.client.0.smithi138.stderr: -119> 2024-09-14T11:36:06.558+0000 7f9b22f269c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:36:06.689 INFO:tasks.workunit.client.0.smithi138.stderr: -118> 2024-09-14T11:36:06.558+0000 7f9b22f269c0 20 started sync module instance, tier type = 2024-09-14T11:36:06.689 INFO:tasks.workunit.client.0.smithi138.stderr: -117> 2024-09-14T11:36:06.558+0000 7f9b22f269c0 20 started zone id=d9e72d30-c60b-4d0d-9267-fdc36392d5ad (name=default) with tier type = 2024-09-14T11:36:06.689 INFO:tasks.workunit.client.0.smithi138.stderr: -116> 2024-09-14T11:36:06.582+0000 7f9b22f269c0 20 add_watcher() i=0 2024-09-14T11:36:06.689 INFO:tasks.workunit.client.0.smithi138.stderr: -115> 2024-09-14T11:36:06.582+0000 7f9b22f269c0 20 add_watcher() i=1 2024-09-14T11:36:06.689 INFO:tasks.workunit.client.0.smithi138.stderr: -114> 2024-09-14T11:36:06.582+0000 7f9b22f269c0 20 add_watcher() i=2 2024-09-14T11:36:06.689 INFO:tasks.workunit.client.0.smithi138.stderr: -113> 2024-09-14T11:36:06.582+0000 7f9b22f269c0 20 add_watcher() i=3 2024-09-14T11:36:06.689 INFO:tasks.workunit.client.0.smithi138.stderr: -112> 2024-09-14T11:36:06.582+0000 7f9b22f269c0 20 add_watcher() i=4 2024-09-14T11:36:06.689 INFO:tasks.workunit.client.0.smithi138.stderr: -111> 2024-09-14T11:36:06.582+0000 7f9b22f269c0 20 add_watcher() i=5 2024-09-14T11:36:06.689 INFO:tasks.workunit.client.0.smithi138.stderr: -110> 2024-09-14T11:36:06.582+0000 7f9b22f269c0 20 add_watcher() i=6 2024-09-14T11:36:06.689 INFO:tasks.workunit.client.0.smithi138.stderr: -109> 2024-09-14T11:36:06.582+0000 7f9b22f269c0 20 add_watcher() i=7 2024-09-14T11:36:06.689 INFO:tasks.workunit.client.0.smithi138.stderr: -108> 2024-09-14T11:36:06.582+0000 7f9b22f269c0 2 all 8 watchers are set, enabling cache 2024-09-14T11:36:06.689 INFO:tasks.workunit.client.0.smithi138.stderr: -107> 2024-09-14T11:36:06.586+0000 7f9b22f269c0 5 AuthRegistry(0x7fffceb3ec10) adding auth protocol: cephx 2024-09-14T11:36:06.689 INFO:tasks.workunit.client.0.smithi138.stderr: -106> 2024-09-14T11:36:06.586+0000 7f9b22f269c0 5 AuthRegistry(0x7fffceb3ec10) adding auth protocol: cephx 2024-09-14T11:36:06.690 INFO:tasks.workunit.client.0.smithi138.stderr: -105> 2024-09-14T11:36:06.586+0000 7f9b22f269c0 5 AuthRegistry(0x7fffceb3ec10) adding auth protocol: cephx 2024-09-14T11:36:06.690 INFO:tasks.workunit.client.0.smithi138.stderr: -104> 2024-09-14T11:36:06.586+0000 7f9b22f269c0 5 AuthRegistry(0x7fffceb3ec10) adding con mode: secure 2024-09-14T11:36:06.690 INFO:tasks.workunit.client.0.smithi138.stderr: -103> 2024-09-14T11:36:06.586+0000 7f9b22f269c0 5 AuthRegistry(0x7fffceb3ec10) adding con mode: crc 2024-09-14T11:36:06.690 INFO:tasks.workunit.client.0.smithi138.stderr: -102> 2024-09-14T11:36:06.586+0000 7f9b22f269c0 5 AuthRegistry(0x7fffceb3ec10) adding con mode: secure 2024-09-14T11:36:06.690 INFO:tasks.workunit.client.0.smithi138.stderr: -101> 2024-09-14T11:36:06.586+0000 7f9b22f269c0 5 AuthRegistry(0x7fffceb3ec10) adding con mode: crc 2024-09-14T11:36:06.690 INFO:tasks.workunit.client.0.smithi138.stderr: -100> 2024-09-14T11:36:06.586+0000 7f9b22f269c0 5 AuthRegistry(0x7fffceb3ec10) adding con mode: secure 2024-09-14T11:36:06.690 INFO:tasks.workunit.client.0.smithi138.stderr: -99> 2024-09-14T11:36:06.586+0000 7f9b22f269c0 5 AuthRegistry(0x7fffceb3ec10) adding con mode: crc 2024-09-14T11:36:06.690 INFO:tasks.workunit.client.0.smithi138.stderr: -98> 2024-09-14T11:36:06.586+0000 7f9b22f269c0 5 AuthRegistry(0x7fffceb3ec10) adding con mode: crc 2024-09-14T11:36:06.690 INFO:tasks.workunit.client.0.smithi138.stderr: -97> 2024-09-14T11:36:06.586+0000 7f9b22f269c0 5 AuthRegistry(0x7fffceb3ec10) adding con mode: secure 2024-09-14T11:36:06.690 INFO:tasks.workunit.client.0.smithi138.stderr: -96> 2024-09-14T11:36:06.586+0000 7f99d2fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:36:06.690 INFO:tasks.workunit.client.0.smithi138.stderr: -95> 2024-09-14T11:36:06.586+0000 7f9b22f269c0 5 AuthRegistry(0x7fffceb3ec10) adding con mode: crc 2024-09-14T11:36:06.690 INFO:tasks.workunit.client.0.smithi138.stderr: -94> 2024-09-14T11:36:06.586+0000 7f9b22f269c0 5 AuthRegistry(0x7fffceb3ec10) adding con mode: secure 2024-09-14T11:36:06.690 INFO:tasks.workunit.client.0.smithi138.stderr: -93> 2024-09-14T11:36:06.586+0000 7f9b22f269c0 5 AuthRegistry(0x7fffceb3ec10) adding con mode: crc 2024-09-14T11:36:06.691 INFO:tasks.workunit.client.0.smithi138.stderr: -92> 2024-09-14T11:36:06.586+0000 7f9b22f269c0 5 AuthRegistry(0x7fffceb3ec10) adding con mode: secure 2024-09-14T11:36:06.691 INFO:tasks.workunit.client.0.smithi138.stderr: -91> 2024-09-14T11:36:06.586+0000 7f9b22f269c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:36:06.691 INFO:tasks.workunit.client.0.smithi138.stderr: -90> 2024-09-14T11:36:06.586+0000 7f9b22f269c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:36:06.691 INFO:tasks.workunit.client.0.smithi138.stderr: -89> 2024-09-14T11:36:06.586+0000 7f9b22f269c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:36:06.691 INFO:tasks.workunit.client.0.smithi138.stderr: -88> 2024-09-14T11:36:06.586+0000 7f9b22f269c0 5 asok(0x56500674dd90) register_command cache list hook 0x5650069f56f0 2024-09-14T11:36:06.691 INFO:tasks.workunit.client.0.smithi138.stderr: -87> 2024-09-14T11:36:06.586+0000 7f9b22f269c0 5 asok(0x56500674dd90) register_command cache inspect hook 0x5650069f56f0 2024-09-14T11:36:06.691 INFO:tasks.workunit.client.0.smithi138.stderr: -86> 2024-09-14T11:36:06.586+0000 7f9b22f269c0 5 asok(0x56500674dd90) register_command cache erase hook 0x5650069f56f0 2024-09-14T11:36:06.691 INFO:tasks.workunit.client.0.smithi138.stderr: -85> 2024-09-14T11:36:06.586+0000 7f9b22f269c0 5 asok(0x56500674dd90) register_command cache zap hook 0x5650069f56f0 2024-09-14T11:36:06.691 INFO:tasks.workunit.client.0.smithi138.stderr: -84> 2024-09-14T11:36:06.586+0000 7f9b22f269c0 5 note: GC not initialized 2024-09-14T11:36:06.691 INFO:tasks.workunit.client.0.smithi138.stderr: -83> 2024-09-14T11:36:06.586+0000 7f99d1fe3640 20 reqs_thread_entry: start 2024-09-14T11:36:06.691 INFO:tasks.workunit.client.0.smithi138.stderr: -82> 2024-09-14T11:36:06.586+0000 7f9b22f269c0 5 asok(0x56500674dd90) register_command sync trace show hook 0x7f9b140c74b0 2024-09-14T11:36:06.691 INFO:tasks.workunit.client.0.smithi138.stderr: -81> 2024-09-14T11:36:06.586+0000 7f9b22f269c0 5 asok(0x56500674dd90) register_command sync trace history hook 0x7f9b140c74b0 2024-09-14T11:36:06.691 INFO:tasks.workunit.client.0.smithi138.stderr: -80> 2024-09-14T11:36:06.586+0000 7f9b22f269c0 5 asok(0x56500674dd90) register_command sync trace active hook 0x7f9b140c74b0 2024-09-14T11:36:06.691 INFO:tasks.workunit.client.0.smithi138.stderr: -79> 2024-09-14T11:36:06.586+0000 7f9b22f269c0 5 asok(0x56500674dd90) register_command sync trace active_short hook 0x7f9b140c74b0 2024-09-14T11:36:06.692 INFO:tasks.workunit.client.0.smithi138.stderr: -78> 2024-09-14T11:36:06.586+0000 7f9b22f269c0 20 init_complete bucket index max shards: 11 2024-09-14T11:36:06.692 INFO:tasks.workunit.client.0.smithi138.stderr: -77> 2024-09-14T11:36:06.586+0000 7f9b22f269c0 20 Filter name: none 2024-09-14T11:36:06.692 INFO:tasks.workunit.client.0.smithi138.stderr: -76> 2024-09-14T11:36:06.590+0000 7f99437fe640 20 reqs_thread_entry: start 2024-09-14T11:36:06.692 INFO:tasks.workunit.client.0.smithi138.stderr: -75> 2024-09-14T11:36:06.590+0000 7f9b22f269c0 10 cache get: name=default.rgw.meta+root+abort-at-block-writes : miss 2024-09-14T11:36:06.692 INFO:tasks.workunit.client.0.smithi138.stderr: -74> 2024-09-14T11:36:06.590+0000 7f9b22f269c0 20 rados->read ofs=0 len=0 2024-09-14T11:36:06.692 INFO:tasks.workunit.client.0.smithi138.stderr: -73> 2024-09-14T11:36:06.590+0000 7f9b22f269c0 20 rados_obj.operate() r=0 bl.length=189 2024-09-14T11:36:06.692 INFO:tasks.workunit.client.0.smithi138.stderr: -72> 2024-09-14T11:36:06.590+0000 7f9b22f269c0 10 cache put: name=default.rgw.meta+root+abort-at-block-writes info.flags=0x11 2024-09-14T11:36:06.692 INFO:tasks.workunit.client.0.smithi138.stderr: -71> 2024-09-14T11:36:06.590+0000 7f9b22f269c0 10 adding default.rgw.meta+root+abort-at-block-writes to cache LRU end 2024-09-14T11:36:06.692 INFO:tasks.workunit.client.0.smithi138.stderr: -70> 2024-09-14T11:36:06.590+0000 7f9b22f269c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.29 : miss 2024-09-14T11:36:06.692 INFO:tasks.workunit.client.0.smithi138.stderr: -69> 2024-09-14T11:36:06.590+0000 7f9b22f269c0 20 rados->read ofs=0 len=0 2024-09-14T11:36:06.692 INFO:tasks.workunit.client.0.smithi138.stderr: -68> 2024-09-14T11:36:06.590+0000 7f9b22f269c0 20 rados_obj.operate() r=0 bl.length=411 2024-09-14T11:36:06.692 INFO:tasks.workunit.client.0.smithi138.stderr: -67> 2024-09-14T11:36:06.590+0000 7f9b22f269c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.29 info.flags=0x17 2024-09-14T11:36:06.692 INFO:tasks.workunit.client.0.smithi138.stderr: -66> 2024-09-14T11:36:06.590+0000 7f9b22f269c0 10 adding default.rgw.meta+root+.bucket.meta.abort-at-block-writes:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.29 to cache LRU end 2024-09-14T11:36:06.692 INFO:tasks.workunit.client.0.smithi138.stderr: -65> 2024-09-14T11:36:06.590+0000 7f9b22f269c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:36:06.693 INFO:tasks.workunit.client.0.smithi138.stderr: -64> 2024-09-14T11:36:06.590+0000 7f9b22f269c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:36:06.693 INFO:tasks.workunit.client.0.smithi138.stderr: -63> 2024-09-14T11:36:06.590+0000 7f9b22f269c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.29 2024-09-14T11:36:06.693 INFO:tasks.workunit.client.0.smithi138.stderr: -62> 2024-09-14T11:36:06.602+0000 7f9b22f269c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.29 info.flags=0x17 2024-09-14T11:36:06.693 INFO:tasks.workunit.client.0.smithi138.stderr: -61> 2024-09-14T11:36:06.602+0000 7f9b22f269c0 10 moving default.rgw.meta+root+.bucket.meta.abort-at-block-writes:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.29 to cache LRU end 2024-09-14T11:36:06.693 INFO:tasks.workunit.client.0.smithi138.stderr: -60> 2024-09-14T11:36:06.602+0000 7f9b22f269c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:36:06.693 INFO:tasks.workunit.client.0.smithi138.stderr: -59> 2024-09-14T11:36:06.602+0000 7f9b22f269c0 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-block-writes:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.29, ofs0, ns] 2024-09-14T11:36:06.693 INFO:tasks.workunit.client.0.smithi138.stderr: -58> 2024-09-14T11:36:06.602+0000 7f99effff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366227 cookie 94901708849344 notifier 7011 bl.length()=915 2024-09-14T11:36:06.693 INFO:tasks.workunit.client.0.smithi138.stderr: -57> 2024-09-14T11:36:06.602+0000 7f99effff640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.29 info.flags=0x17 2024-09-14T11:36:06.693 INFO:tasks.workunit.client.0.smithi138.stderr: -56> 2024-09-14T11:36:06.602+0000 7f99effff640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-block-writes:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.29 to cache LRU end 2024-09-14T11:36:06.693 INFO:tasks.workunit.client.0.smithi138.stderr: -55> 2024-09-14T11:36:06.602+0000 7f99effff640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:36:06.693 INFO:tasks.workunit.client.0.smithi138.stderr: -54> 2024-09-14T11:36:06.606+0000 7f9b22f269c0 20 handle_bi_update(): bucket=:abort-at-block-writes[d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.29]): orig_sources= new_sources= 2024-09-14T11:36:06.693 INFO:tasks.workunit.client.0.smithi138.stderr: -53> 2024-09-14T11:36:06.606+0000 7f9b22f269c0 20 handle_bi_update(): bucket=:abort-at-block-writes[d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.29]): potential sources added=[] removed=[] 2024-09-14T11:36:06.693 INFO:tasks.workunit.client.0.smithi138.stderr: -52> 2024-09-14T11:36:06.606+0000 7f9b22f269c0 20 handle_bi_update(): bucket=:abort-at-block-writes[d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.29]): orig_dests= new_dests= 2024-09-14T11:36:06.694 INFO:tasks.workunit.client.0.smithi138.stderr: -51> 2024-09-14T11:36:06.606+0000 7f9b22f269c0 20 handle_bi_update(): bucket=:abort-at-block-writes[d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.29]): potential dests added=[] removed=[] 2024-09-14T11:36:06.694 INFO:tasks.workunit.client.0.smithi138.stderr: -50> 2024-09-14T11:36:06.618+0000 7f9b22f269c0 10 bucket_obj is .dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.29.1.0 2024-09-14T11:36:06.694 INFO:tasks.workunit.client.0.smithi138.stderr: -49> 2024-09-14T11:36:06.618+0000 7f9b22f269c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.29.1.0 2024-09-14T11:36:06.694 INFO:tasks.workunit.client.0.smithi138.stderr: -48> 2024-09-14T11:36:06.618+0000 7f9b22f269c0 10 bucket_obj is .dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.29.1.1 2024-09-14T11:36:06.694 INFO:tasks.workunit.client.0.smithi138.stderr: -47> 2024-09-14T11:36:06.618+0000 7f9b22f269c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.29.1.1 2024-09-14T11:36:06.694 INFO:tasks.workunit.client.0.smithi138.stderr: -46> 2024-09-14T11:36:06.618+0000 7f9b22f269c0 10 bucket_obj is .dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.29.1.2 2024-09-14T11:36:06.694 INFO:tasks.workunit.client.0.smithi138.stderr: -45> 2024-09-14T11:36:06.618+0000 7f9b22f269c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.29.1.2 2024-09-14T11:36:06.694 INFO:tasks.workunit.client.0.smithi138.stderr: -44> 2024-09-14T11:36:06.618+0000 7f9b22f269c0 10 bucket_obj is .dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.29.1.3 2024-09-14T11:36:06.694 INFO:tasks.workunit.client.0.smithi138.stderr: -43> 2024-09-14T11:36:06.618+0000 7f9b22f269c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.29.1.3 2024-09-14T11:36:06.694 INFO:tasks.workunit.client.0.smithi138.stderr: -42> 2024-09-14T11:36:06.618+0000 7f9b22f269c0 10 bucket_obj is .dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.29.1.4 2024-09-14T11:36:06.694 INFO:tasks.workunit.client.0.smithi138.stderr: -41> 2024-09-14T11:36:06.618+0000 7f9b22f269c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.29.1.4 2024-09-14T11:36:06.694 INFO:tasks.workunit.client.0.smithi138.stderr: -40> 2024-09-14T11:36:06.618+0000 7f9b22f269c0 10 bucket_obj is .dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.29.1.5 2024-09-14T11:36:06.694 INFO:tasks.workunit.client.0.smithi138.stderr: -39> 2024-09-14T11:36:06.618+0000 7f9b22f269c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.29.1.5 2024-09-14T11:36:06.694 INFO:tasks.workunit.client.0.smithi138.stderr: -38> 2024-09-14T11:36:06.618+0000 7f9b22f269c0 10 bucket_obj is .dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.29.1.6 2024-09-14T11:36:06.695 INFO:tasks.workunit.client.0.smithi138.stderr: -37> 2024-09-14T11:36:06.618+0000 7f9b22f269c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.29.1.6 2024-09-14T11:36:06.695 INFO:tasks.workunit.client.0.smithi138.stderr: -36> 2024-09-14T11:36:06.618+0000 7f9b22f269c0 10 bucket_obj is .dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.29.1.7 2024-09-14T11:36:06.695 INFO:tasks.workunit.client.0.smithi138.stderr: -35> 2024-09-14T11:36:06.618+0000 7f9b22f269c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.29.1.7 2024-09-14T11:36:06.695 INFO:tasks.workunit.client.0.smithi138.stderr: -34> 2024-09-14T11:36:06.618+0000 7f9b22f269c0 10 bucket_obj is .dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.29.1.8 2024-09-14T11:36:06.695 INFO:tasks.workunit.client.0.smithi138.stderr: -33> 2024-09-14T11:36:06.618+0000 7f9b22f269c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.29.1.8 2024-09-14T11:36:06.695 INFO:tasks.workunit.client.0.smithi138.stderr: -32> 2024-09-14T11:36:06.618+0000 7f9b22f269c0 10 bucket_obj is .dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.29.1.9 2024-09-14T11:36:06.695 INFO:tasks.workunit.client.0.smithi138.stderr: -31> 2024-09-14T11:36:06.618+0000 7f9b22f269c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.29.1.9 2024-09-14T11:36:06.695 INFO:tasks.workunit.client.0.smithi138.stderr: -30> 2024-09-14T11:36:06.618+0000 7f9b22f269c0 10 bucket_obj is .dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.29.1.10 2024-09-14T11:36:06.695 INFO:tasks.workunit.client.0.smithi138.stderr: -29> 2024-09-14T11:36:06.618+0000 7f9b22f269c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.29.1.10 2024-09-14T11:36:06.695 INFO:tasks.workunit.client.0.smithi138.stderr: -28> 2024-09-14T11:36:06.618+0000 7f9b22f269c0 10 bucket_obj is .dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.29.1.11 2024-09-14T11:36:06.695 INFO:tasks.workunit.client.0.smithi138.stderr: -27> 2024-09-14T11:36:06.618+0000 7f9b22f269c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.29.1.11 2024-09-14T11:36:06.695 INFO:tasks.workunit.client.0.smithi138.stderr: -26> 2024-09-14T11:36:06.618+0000 7f9b22f269c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.29.0 2024-09-14T11:36:06.695 INFO:tasks.workunit.client.0.smithi138.stderr: -25> 2024-09-14T11:36:06.618+0000 7f9b22f269c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.29.1 2024-09-14T11:36:06.695 INFO:tasks.workunit.client.0.smithi138.stderr: -24> 2024-09-14T11:36:06.622+0000 7f9b22f269c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.29.2 2024-09-14T11:36:06.695 INFO:tasks.workunit.client.0.smithi138.stderr: -23> 2024-09-14T11:36:06.622+0000 7f9b22f269c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.29.3 2024-09-14T11:36:06.696 INFO:tasks.workunit.client.0.smithi138.stderr: -22> 2024-09-14T11:36:06.626+0000 7f9b22f269c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.29.4 2024-09-14T11:36:06.696 INFO:tasks.workunit.client.0.smithi138.stderr: -21> 2024-09-14T11:36:06.626+0000 7f9b22f269c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.29.5 2024-09-14T11:36:06.696 INFO:tasks.workunit.client.0.smithi138.stderr: -20> 2024-09-14T11:36:06.626+0000 7f9b22f269c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.29.6 2024-09-14T11:36:06.696 INFO:tasks.workunit.client.0.smithi138.stderr: -19> 2024-09-14T11:36:06.630+0000 7f9b22f269c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.29.7 2024-09-14T11:36:06.696 INFO:tasks.workunit.client.0.smithi138.stderr: -18> 2024-09-14T11:36:06.630+0000 7f9b22f269c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.29.8 2024-09-14T11:36:06.696 INFO:tasks.workunit.client.0.smithi138.stderr: -17> 2024-09-14T11:36:06.630+0000 7f9b22f269c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.29.9 2024-09-14T11:36:06.696 INFO:tasks.workunit.client.0.smithi138.stderr: -16> 2024-09-14T11:36:06.630+0000 7f9b22f269c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.29.10 2024-09-14T11:36:06.696 INFO:tasks.workunit.client.0.smithi138.stderr: -15> 2024-09-14T11:36:06.638+0000 7f9b22f269c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.29 : hit (requested=0x17, cached=0x17) 2024-09-14T11:36:06.696 INFO:tasks.workunit.client.0.smithi138.stderr: -14> 2024-09-14T11:36:06.638+0000 7f9b22f269c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.29 2024-09-14T11:36:06.696 INFO:tasks.workunit.client.0.smithi138.stderr: -13> 2024-09-14T11:36:06.642+0000 7f9b22f269c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.29 info.flags=0x17 2024-09-14T11:36:06.696 INFO:tasks.workunit.client.0.smithi138.stderr: -12> 2024-09-14T11:36:06.642+0000 7f9b22f269c0 10 moving default.rgw.meta+root+.bucket.meta.abort-at-block-writes:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.29 to cache LRU end 2024-09-14T11:36:06.696 INFO:tasks.workunit.client.0.smithi138.stderr: -11> 2024-09-14T11:36:06.642+0000 7f9b22f269c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:36:06.696 INFO:tasks.workunit.client.0.smithi138.stderr: -10> 2024-09-14T11:36:06.642+0000 7f9b22f269c0 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-block-writes:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.29, ofs0, ns] 2024-09-14T11:36:06.697 INFO:tasks.workunit.client.0.smithi138.stderr: -9> 2024-09-14T11:36:06.642+0000 7f99effff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366228 cookie 94901708849344 notifier 7011 bl.length()=915 2024-09-14T11:36:06.697 INFO:tasks.workunit.client.0.smithi138.stderr: -8> 2024-09-14T11:36:06.642+0000 7f99effff640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.29 info.flags=0x17 2024-09-14T11:36:06.697 INFO:tasks.workunit.client.0.smithi138.stderr: -7> 2024-09-14T11:36:06.642+0000 7f99effff640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-block-writes:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.29 to cache LRU end 2024-09-14T11:36:06.697 INFO:tasks.workunit.client.0.smithi138.stderr: -6> 2024-09-14T11:36:06.642+0000 7f99effff640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:36:06.697 INFO:tasks.workunit.client.0.smithi138.stderr: -5> 2024-09-14T11:36:06.646+0000 7f9b22f269c0 20 handle_bi_update(): bucket=:abort-at-block-writes[d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.29]): orig_sources= new_sources= 2024-09-14T11:36:06.697 INFO:tasks.workunit.client.0.smithi138.stderr: -4> 2024-09-14T11:36:06.646+0000 7f9b22f269c0 20 handle_bi_update(): bucket=:abort-at-block-writes[d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.29]): potential sources added=[] removed=[] 2024-09-14T11:36:06.697 INFO:tasks.workunit.client.0.smithi138.stderr: -3> 2024-09-14T11:36:06.646+0000 7f9b22f269c0 20 handle_bi_update(): bucket=:abort-at-block-writes[d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.29]): orig_dests= new_dests= 2024-09-14T11:36:06.697 INFO:tasks.workunit.client.0.smithi138.stderr: -2> 2024-09-14T11:36:06.646+0000 7f9b22f269c0 20 handle_bi_update(): bucket=:abort-at-block-writes[d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.29]): potential dests added=[] removed=[] 2024-09-14T11:36:06.697 INFO:tasks.workunit.client.0.smithi138.stderr: -1> 2024-09-14T11:36:06.646+0000 7f9b22f269c0 -1 ./src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f9b22f269c0 time 2024-09-14T11:36:06.649119+0000 2024-09-14T11:36:06.697 INFO:tasks.workunit.client.0.smithi138.stderr:./src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-14T11:36:06.697 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-14T11:36:06.697 INFO:tasks.workunit.client.0.smithi138.stderr: ceph version 19.3.0-4907-ga2782315 (a2782315255a3e7d5f6cdc9eb35785187ff6ddf8) squid (dev) 2024-09-14T11:36:06.697 INFO:tasks.workunit.client.0.smithi138.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x121) [0x7f9b268002eb] 2024-09-14T11:36:06.697 INFO:tasks.workunit.client.0.smithi138.stderr: 2: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7f9b2680049f] 2024-09-14T11:36:06.698 INFO:tasks.workunit.client.0.smithi138.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x565003dd5c01] 2024-09-14T11:36:06.698 INFO:tasks.workunit.client.0.smithi138.stderr: 4: (RGWBucketReshard::do_reshard(rgw::bucket_index_layout_generation const&, rgw::bucket_index_layout_generation const&, int, bool, bool, std::ostream*, ceph::Formatter*, FaultInjector > >&, DoutPrefixProvider const*, optional_yield)+0x147b) [0x565003dea29b] 2024-09-14T11:36:06.698 INFO:tasks.workunit.client.0.smithi138.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0xac4) [0x565003deb884] 2024-09-14T11:36:06.698 INFO:tasks.workunit.client.0.smithi138.stderr: 6: main() 2024-09-14T11:36:06.698 INFO:tasks.workunit.client.0.smithi138.stderr: 7: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7f9b25666d90] 2024-09-14T11:36:06.698 INFO:tasks.workunit.client.0.smithi138.stderr: 8: __libc_start_main() 2024-09-14T11:36:06.698 INFO:tasks.workunit.client.0.smithi138.stderr: 9: _start() 2024-09-14T11:36:06.698 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-14T11:36:06.698 INFO:tasks.workunit.client.0.smithi138.stderr: 0> 2024-09-14T11:36:06.646+0000 7f9b22f269c0 -1 *** Caught signal (Aborted) ** 2024-09-14T11:36:06.698 INFO:tasks.workunit.client.0.smithi138.stderr: in thread 7f9b22f269c0 thread_name:radosgw-admin 2024-09-14T11:36:06.698 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-14T11:36:06.698 INFO:tasks.workunit.client.0.smithi138.stderr: ceph version 19.3.0-4907-ga2782315 (a2782315255a3e7d5f6cdc9eb35785187ff6ddf8) squid (dev) 2024-09-14T11:36:06.698 INFO:tasks.workunit.client.0.smithi138.stderr: 1: /lib/x86_64-linux-gnu/libc.so.6(+0x42520) [0x7f9b2567f520] 2024-09-14T11:36:06.698 INFO:tasks.workunit.client.0.smithi138.stderr: 2: pthread_kill() 2024-09-14T11:36:06.698 INFO:tasks.workunit.client.0.smithi138.stderr: 3: raise() 2024-09-14T11:36:06.699 INFO:tasks.workunit.client.0.smithi138.stderr: 4: abort() 2024-09-14T11:36:06.699 INFO:tasks.workunit.client.0.smithi138.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x17b) [0x7f9b26800345] 2024-09-14T11:36:06.699 INFO:tasks.workunit.client.0.smithi138.stderr: 6: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7f9b2680049f] 2024-09-14T11:36:06.699 INFO:tasks.workunit.client.0.smithi138.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x565003dd5c01] 2024-09-14T11:36:06.699 INFO:tasks.workunit.client.0.smithi138.stderr: 8: (RGWBucketReshard::do_reshard(rgw::bucket_index_layout_generation const&, rgw::bucket_index_layout_generation const&, int, bool, bool, std::ostream*, ceph::Formatter*, FaultInjector > >&, DoutPrefixProvider const*, optional_yield)+0x147b) [0x565003dea29b] 2024-09-14T11:36:06.699 INFO:tasks.workunit.client.0.smithi138.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0xac4) [0x565003deb884] 2024-09-14T11:36:06.699 INFO:tasks.workunit.client.0.smithi138.stderr: 10: main() 2024-09-14T11:36:06.699 INFO:tasks.workunit.client.0.smithi138.stderr: 11: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7f9b25666d90] 2024-09-14T11:36:06.699 INFO:tasks.workunit.client.0.smithi138.stderr: 12: __libc_start_main() 2024-09-14T11:36:06.699 INFO:tasks.workunit.client.0.smithi138.stderr: 13: _start() 2024-09-14T11:36:06.699 INFO:tasks.workunit.client.0.smithi138.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-14T11:36:06.699 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-14T11:36:06.699 INFO:tasks.workunit.client.0.smithi138.stderr:--- logging levels --- 2024-09-14T11:36:06.699 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 none 2024-09-14T11:36:06.699 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 1 lockdep 2024-09-14T11:36:06.700 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 1 context 2024-09-14T11:36:06.700 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 1 crush 2024-09-14T11:36:06.700 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 mds 2024-09-14T11:36:06.700 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 mds_balancer 2024-09-14T11:36:06.700 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 mds_locker 2024-09-14T11:36:06.700 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 mds_log 2024-09-14T11:36:06.700 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 mds_log_expire 2024-09-14T11:36:06.700 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 mds_migrator 2024-09-14T11:36:06.700 INFO:tasks.workunit.client.0.smithi138.stderr: 3/ 5 mds_quiesce 2024-09-14T11:36:06.700 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 1 buffer 2024-09-14T11:36:06.700 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 1 timer 2024-09-14T11:36:06.700 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 1 filer 2024-09-14T11:36:06.700 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 1 striper 2024-09-14T11:36:06.700 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 1 objecter 2024-09-14T11:36:06.701 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 rados 2024-09-14T11:36:06.701 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 rbd 2024-09-14T11:36:06.701 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 rbd_mirror 2024-09-14T11:36:06.701 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 rbd_replay 2024-09-14T11:36:06.701 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 rbd_pwl 2024-09-14T11:36:06.701 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 journaler 2024-09-14T11:36:06.701 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 objectcacher 2024-09-14T11:36:06.701 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 immutable_obj_cache 2024-09-14T11:36:06.701 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 client 2024-09-14T11:36:06.701 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 osd 2024-09-14T11:36:06.701 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 optracker 2024-09-14T11:36:06.701 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 objclass 2024-09-14T11:36:06.701 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 3 filestore 2024-09-14T11:36:06.701 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 3 journal 2024-09-14T11:36:06.702 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 0 ms 2024-09-14T11:36:06.702 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 mon 2024-09-14T11:36:06.702 INFO:tasks.workunit.client.0.smithi138.stderr: 0/10 monc 2024-09-14T11:36:06.702 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 paxos 2024-09-14T11:36:06.702 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 tp 2024-09-14T11:36:06.702 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 auth 2024-09-14T11:36:06.702 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 crypto 2024-09-14T11:36:06.702 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 1 finisher 2024-09-14T11:36:06.702 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 1 reserver 2024-09-14T11:36:06.702 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 heartbeatmap 2024-09-14T11:36:06.702 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 perfcounter 2024-09-14T11:36:06.702 INFO:tasks.workunit.client.0.smithi138.stderr: 20/20 rgw 2024-09-14T11:36:06.702 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 rgw_sync 2024-09-14T11:36:06.702 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 rgw_datacache 2024-09-14T11:36:06.703 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 rgw_access 2024-09-14T11:36:06.703 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 rgw_dbstore 2024-09-14T11:36:06.703 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 rgw_flight 2024-09-14T11:36:06.703 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 rgw_lifecycle 2024-09-14T11:36:06.703 INFO:tasks.workunit.client.0.smithi138.stderr: 20/20 rgw_notification 2024-09-14T11:36:06.703 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 javaclient 2024-09-14T11:36:06.703 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 asok 2024-09-14T11:36:06.703 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 1 throttle 2024-09-14T11:36:06.703 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 0 refs 2024-09-14T11:36:06.703 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 compressor 2024-09-14T11:36:06.703 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 bluestore 2024-09-14T11:36:06.703 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 bluefs 2024-09-14T11:36:06.703 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 3 bdev 2024-09-14T11:36:06.703 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 kstore 2024-09-14T11:36:06.704 INFO:tasks.workunit.client.0.smithi138.stderr: 4/ 5 rocksdb 2024-09-14T11:36:06.704 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 fuse 2024-09-14T11:36:06.704 INFO:tasks.workunit.client.0.smithi138.stderr: 2/ 5 mgr 2024-09-14T11:36:06.704 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 mgrc 2024-09-14T11:36:06.704 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 dpdk 2024-09-14T11:36:06.704 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 eventtrace 2024-09-14T11:36:06.704 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 prioritycache 2024-09-14T11:36:06.704 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 test 2024-09-14T11:36:06.704 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 cephfs_mirror 2024-09-14T11:36:06.704 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 cephsqlite 2024-09-14T11:36:06.704 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 crimson_interrupt 2024-09-14T11:36:06.704 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 seastore 2024-09-14T11:36:06.704 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 seastore_onode 2024-09-14T11:36:06.704 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 seastore_odata 2024-09-14T11:36:06.705 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 seastore_omap 2024-09-14T11:36:06.705 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 seastore_tm 2024-09-14T11:36:06.705 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 seastore_t 2024-09-14T11:36:06.705 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 seastore_cleaner 2024-09-14T11:36:06.705 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 seastore_epm 2024-09-14T11:36:06.705 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 seastore_lba 2024-09-14T11:36:06.705 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 seastore_fixedkv_tree 2024-09-14T11:36:06.705 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 seastore_cache 2024-09-14T11:36:06.705 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 seastore_journal 2024-09-14T11:36:06.705 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 seastore_device 2024-09-14T11:36:06.705 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 seastore_backref 2024-09-14T11:36:06.705 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 alienstore 2024-09-14T11:36:06.705 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 mclock 2024-09-14T11:36:06.705 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 cyanstore 2024-09-14T11:36:06.705 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 ceph_exporter 2024-09-14T11:36:06.706 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 memstore 2024-09-14T11:36:06.706 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 trace 2024-09-14T11:36:06.706 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 ceph_dedup 2024-09-14T11:36:06.706 INFO:tasks.workunit.client.0.smithi138.stderr: -2/-2 (syslog threshold) 2024-09-14T11:36:06.706 INFO:tasks.workunit.client.0.smithi138.stderr: 99/99 (stderr threshold) 2024-09-14T11:36:06.706 INFO:tasks.workunit.client.0.smithi138.stderr:--- pthread ID / name mapping for recent threads --- 2024-09-14T11:36:06.706 INFO:tasks.workunit.client.0.smithi138.stderr: 7f99437fe640 / http_manager 2024-09-14T11:36:06.706 INFO:tasks.workunit.client.0.smithi138.stderr: 7f99d1fe3640 / http_manager 2024-09-14T11:36:06.706 INFO:tasks.workunit.client.0.smithi138.stderr: 7f99d2fe5640 / rgw_dt_lg_renew 2024-09-14T11:36:06.706 INFO:tasks.workunit.client.0.smithi138.stderr: 7f99ee7fc640 / ms_dispatch 2024-09-14T11:36:06.706 INFO:tasks.workunit.client.0.smithi138.stderr: 7f99effff640 / io_context_pool 2024-09-14T11:36:06.706 INFO:tasks.workunit.client.0.smithi138.stderr: 7f9a067fc640 / ms_dispatch 2024-09-14T11:36:06.706 INFO:tasks.workunit.client.0.smithi138.stderr: 7f9a0d60a640 / ms_dispatch 2024-09-14T11:36:06.706 INFO:tasks.workunit.client.0.smithi138.stderr: 7f9a0ee0d640 / io_context_pool 2024-09-14T11:36:06.706 INFO:tasks.workunit.client.0.smithi138.stderr: 7f9b1fa2a640 / io_context_pool 2024-09-14T11:36:06.707 INFO:tasks.workunit.client.0.smithi138.stderr: 7f9b2022b640 / msgr-worker-2 2024-09-14T11:36:06.707 INFO:tasks.workunit.client.0.smithi138.stderr: 7f9b20a2c640 / msgr-worker-1 2024-09-14T11:36:06.707 INFO:tasks.workunit.client.0.smithi138.stderr: 7f9b2122d640 / msgr-worker-0 2024-09-14T11:36:06.707 INFO:tasks.workunit.client.0.smithi138.stderr: 7f9b21a2e640 / io_context_pool 2024-09-14T11:36:06.707 INFO:tasks.workunit.client.0.smithi138.stderr: 7f9b22f269c0 / radosgw-admin 2024-09-14T11:36:06.707 INFO:tasks.workunit.client.0.smithi138.stderr: max_recent 500 2024-09-14T11:36:06.707 INFO:tasks.workunit.client.0.smithi138.stderr: max_new 1000 2024-09-14T11:36:06.707 INFO:tasks.workunit.client.0.smithi138.stderr: log_file /var/log/ceph/ceph-client.admin.104983.log 2024-09-14T11:36:06.707 INFO:tasks.workunit.client.0.smithi138.stderr:--- end dump of recent events --- 2024-09-14T11:36:06.707 INFO:tasks.workunit.client.0.smithi138.stderr:--- begin dump of recent events --- 2024-09-14T11:36:06.707 INFO:tasks.workunit.client.0.smithi138.stderr: -499> 2024-09-14T11:36:06.294+0000 7f9b20a2c640 1 monclient: found mon.noname-c 2024-09-14T11:36:06.707 INFO:tasks.workunit.client.0.smithi138.stderr: -498> 2024-09-14T11:36:06.294+0000 7f9b20a2c640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.138:3301/0 2024-09-14T11:36:06.707 INFO:tasks.workunit.client.0.smithi138.stderr: -497> 2024-09-14T11:36:06.294+0000 7f9b2122d640 10 monclient: get_auth_request con 0x5650068a0ad0 auth_method 0 2024-09-14T11:36:06.708 INFO:tasks.workunit.client.0.smithi138.stderr: -496> 2024-09-14T11:36:06.294+0000 7f9a0d60a640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:36:06.708 INFO:tasks.workunit.client.0.smithi138.stderr: -495> 2024-09-14T11:36:06.294+0000 7f9a0d60a640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-14T11:36:06.708 INFO:tasks.workunit.client.0.smithi138.stderr: -494> 2024-09-14T11:36:06.294+0000 7f9a0d60a640 10 monclient: dump: 2024-09-14T11:36:06.708 INFO:tasks.workunit.client.0.smithi138.stderr:epoch 1 2024-09-14T11:36:06.708 INFO:tasks.workunit.client.0.smithi138.stderr:fsid 3f225f43-83a6-4aeb-b798-1f04bb49d597 2024-09-14T11:36:06.708 INFO:tasks.workunit.client.0.smithi138.stderr:last_changed 2024-09-14T11:07:09.252780+0000 2024-09-14T11:36:06.708 INFO:tasks.workunit.client.0.smithi138.stderr:created 2024-09-14T11:07:09.252780+0000 2024-09-14T11:36:06.708 INFO:tasks.workunit.client.0.smithi138.stderr:min_mon_release 19 (squid) 2024-09-14T11:36:06.708 INFO:tasks.workunit.client.0.smithi138.stderr:election_strategy: 1 2024-09-14T11:36:06.708 INFO:tasks.workunit.client.0.smithi138.stderr:0: [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] mon.a 2024-09-14T11:36:06.708 INFO:tasks.workunit.client.0.smithi138.stderr:1: [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] mon.b 2024-09-14T11:36:06.708 INFO:tasks.workunit.client.0.smithi138.stderr:2: [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] mon.c 2024-09-14T11:36:06.709 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-14T11:36:06.709 INFO:tasks.workunit.client.0.smithi138.stderr: -493> 2024-09-14T11:36:06.294+0000 7f9a0d60a640 10 monclient: _finish_auth 0 2024-09-14T11:36:06.709 INFO:tasks.workunit.client.0.smithi138.stderr: -492> 2024-09-14T11:36:06.294+0000 7f9a0d60a640 10 monclient: _check_auth_tickets 2024-09-14T11:36:06.709 INFO:tasks.workunit.client.0.smithi138.stderr: -491> 2024-09-14T11:36:06.294+0000 7f9a0d60a640 10 monclient: handle_config config(0 keys) 2024-09-14T11:36:06.709 INFO:tasks.workunit.client.0.smithi138.stderr: -490> 2024-09-14T11:36:06.294+0000 7f9a0d60a640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:36:06.709 INFO:tasks.workunit.client.0.smithi138.stderr: -489> 2024-09-14T11:36:06.294+0000 7f9a0d60a640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-14T11:36:06.709 INFO:tasks.workunit.client.0.smithi138.stderr: -488> 2024-09-14T11:36:06.294+0000 7f9a0d60a640 10 monclient: dump: 2024-09-14T11:36:06.709 INFO:tasks.workunit.client.0.smithi138.stderr:epoch 1 2024-09-14T11:36:06.709 INFO:tasks.workunit.client.0.smithi138.stderr:fsid 3f225f43-83a6-4aeb-b798-1f04bb49d597 2024-09-14T11:36:06.709 INFO:tasks.workunit.client.0.smithi138.stderr:last_changed 2024-09-14T11:07:09.252780+0000 2024-09-14T11:36:06.709 INFO:tasks.workunit.client.0.smithi138.stderr:created 2024-09-14T11:07:09.252780+0000 2024-09-14T11:36:06.709 INFO:tasks.workunit.client.0.smithi138.stderr:min_mon_release 19 (squid) 2024-09-14T11:36:06.709 INFO:tasks.workunit.client.0.smithi138.stderr:election_strategy: 1 2024-09-14T11:36:06.710 INFO:tasks.workunit.client.0.smithi138.stderr:0: [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] mon.a 2024-09-14T11:36:06.710 INFO:tasks.workunit.client.0.smithi138.stderr:1: [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] mon.b 2024-09-14T11:36:06.710 INFO:tasks.workunit.client.0.smithi138.stderr:2: [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] mon.c 2024-09-14T11:36:06.710 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-14T11:36:06.710 INFO:tasks.workunit.client.0.smithi138.stderr: -487> 2024-09-14T11:36:06.294+0000 7f9b22f269c0 5 monclient: authenticate success, global_id 6539 2024-09-14T11:36:06.710 INFO:tasks.workunit.client.0.smithi138.stderr: -486> 2024-09-14T11:36:06.294+0000 7f9b22f269c0 10 monclient: _renew_subs 2024-09-14T11:36:06.710 INFO:tasks.workunit.client.0.smithi138.stderr: -485> 2024-09-14T11:36:06.294+0000 7f9b22f269c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.138:3301/0 2024-09-14T11:36:06.710 INFO:tasks.workunit.client.0.smithi138.stderr: -484> 2024-09-14T11:36:06.294+0000 7f9a0ee0d640 4 set_mon_vals no callback set 2024-09-14T11:36:06.710 INFO:tasks.workunit.client.0.smithi138.stderr: -483> 2024-09-14T11:36:06.294+0000 7f9b22f269c0 10 monclient: _renew_subs 2024-09-14T11:36:06.710 INFO:tasks.workunit.client.0.smithi138.stderr: -482> 2024-09-14T11:36:06.294+0000 7f9b22f269c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.138:3301/0 2024-09-14T11:36:06.710 INFO:tasks.workunit.client.0.smithi138.stderr: -481> 2024-09-14T11:36:06.294+0000 7f9b22f269c0 1 librados: init done 2024-09-14T11:36:06.710 INFO:tasks.workunit.client.0.smithi138.stderr: -480> 2024-09-14T11:36:06.298+0000 7f9a0d60a640 4 mgrc handle_mgr_map Got map version 5 2024-09-14T11:36:06.710 INFO:tasks.workunit.client.0.smithi138.stderr: -479> 2024-09-14T11:36:06.298+0000 7f9a0d60a640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.138:6832/3778043143,v1:172.21.15.138:6833/3778043143] 2024-09-14T11:36:06.710 INFO:tasks.workunit.client.0.smithi138.stderr: -478> 2024-09-14T11:36:06.298+0000 7f9a0d60a640 4 mgrc reconnect Starting new session with [v2:172.21.15.138:6832/3778043143,v1:172.21.15.138:6833/3778043143] 2024-09-14T11:36:06.711 INFO:tasks.workunit.client.0.smithi138.stderr: -477> 2024-09-14T11:36:06.298+0000 7f9b2022b640 10 monclient: get_auth_request con 0x7f9a080718a0 auth_method 0 2024-09-14T11:36:06.711 INFO:tasks.workunit.client.0.smithi138.stderr: -476> 2024-09-14T11:36:06.298+0000 7f9b2122d640 10 monclient: get_auth_request con 0x565006995f30 auth_method 0 2024-09-14T11:36:06.711 INFO:tasks.workunit.client.0.smithi138.stderr: -475> 2024-09-14T11:36:06.298+0000 7f9b20a2c640 10 monclient: get_auth_request con 0x5650069a6010 auth_method 0 2024-09-14T11:36:06.711 INFO:tasks.workunit.client.0.smithi138.stderr: -474> 2024-09-14T11:36:06.298+0000 7f9b2022b640 10 monclient: get_auth_request con 0x5650069aa200 auth_method 0 2024-09-14T11:36:06.711 INFO:tasks.workunit.client.0.smithi138.stderr: -473> 2024-09-14T11:36:06.302+0000 7f9b2122d640 10 monclient: get_auth_request con 0x5650069a98c0 auth_method 0 2024-09-14T11:36:06.711 INFO:tasks.workunit.client.0.smithi138.stderr: -472> 2024-09-14T11:36:06.302+0000 7f9b22f269c0 10 monclient: build_initial_monmap 2024-09-14T11:36:06.711 INFO:tasks.workunit.client.0.smithi138.stderr: -471> 2024-09-14T11:36:06.302+0000 7f9b22f269c0 1 build_initial for_mkfs: 0 2024-09-14T11:36:06.711 INFO:tasks.workunit.client.0.smithi138.stderr: -470> 2024-09-14T11:36:06.302+0000 7f9b22f269c0 10 monclient: monmap: 2024-09-14T11:36:06.711 INFO:tasks.workunit.client.0.smithi138.stderr:epoch 0 2024-09-14T11:36:06.711 INFO:tasks.workunit.client.0.smithi138.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-14T11:36:06.711 INFO:tasks.workunit.client.0.smithi138.stderr:last_changed 0.000000 2024-09-14T11:36:06.711 INFO:tasks.workunit.client.0.smithi138.stderr:created 0.000000 2024-09-14T11:36:06.711 INFO:tasks.workunit.client.0.smithi138.stderr:min_mon_release 0 (unknown) 2024-09-14T11:36:06.711 INFO:tasks.workunit.client.0.smithi138.stderr:election_strategy: 1 2024-09-14T11:36:06.712 INFO:tasks.workunit.client.0.smithi138.stderr:0: [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] mon.noname-a 2024-09-14T11:36:06.712 INFO:tasks.workunit.client.0.smithi138.stderr:1: [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] mon.noname-b 2024-09-14T11:36:06.712 INFO:tasks.workunit.client.0.smithi138.stderr:2: [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] mon.noname-c 2024-09-14T11:36:06.712 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-14T11:36:06.712 INFO:tasks.workunit.client.0.smithi138.stderr: -469> 2024-09-14T11:36:06.302+0000 7f9b22f269c0 5 AuthRegistry(0x5650069b22b0) adding auth protocol: cephx 2024-09-14T11:36:06.712 INFO:tasks.workunit.client.0.smithi138.stderr: -468> 2024-09-14T11:36:06.302+0000 7f9b22f269c0 5 AuthRegistry(0x5650069b22b0) adding auth protocol: cephx 2024-09-14T11:36:06.712 INFO:tasks.workunit.client.0.smithi138.stderr: -467> 2024-09-14T11:36:06.302+0000 7f9b22f269c0 5 AuthRegistry(0x5650069b22b0) adding auth protocol: cephx 2024-09-14T11:36:06.712 INFO:tasks.workunit.client.0.smithi138.stderr: -466> 2024-09-14T11:36:06.302+0000 7f9b22f269c0 5 AuthRegistry(0x5650069b22b0) adding con mode: secure 2024-09-14T11:36:06.712 INFO:tasks.workunit.client.0.smithi138.stderr: -465> 2024-09-14T11:36:06.302+0000 7f9b22f269c0 5 AuthRegistry(0x5650069b22b0) adding con mode: crc 2024-09-14T11:36:06.712 INFO:tasks.workunit.client.0.smithi138.stderr: -464> 2024-09-14T11:36:06.302+0000 7f9b22f269c0 5 AuthRegistry(0x5650069b22b0) adding con mode: secure 2024-09-14T11:36:06.712 INFO:tasks.workunit.client.0.smithi138.stderr: -463> 2024-09-14T11:36:06.302+0000 7f9b22f269c0 5 AuthRegistry(0x5650069b22b0) adding con mode: crc 2024-09-14T11:36:06.712 INFO:tasks.workunit.client.0.smithi138.stderr: -462> 2024-09-14T11:36:06.302+0000 7f9b22f269c0 5 AuthRegistry(0x5650069b22b0) adding con mode: secure 2024-09-14T11:36:06.712 INFO:tasks.workunit.client.0.smithi138.stderr: -461> 2024-09-14T11:36:06.302+0000 7f9b22f269c0 5 AuthRegistry(0x5650069b22b0) adding con mode: crc 2024-09-14T11:36:06.713 INFO:tasks.workunit.client.0.smithi138.stderr: -460> 2024-09-14T11:36:06.302+0000 7f9b22f269c0 5 AuthRegistry(0x5650069b22b0) adding con mode: crc 2024-09-14T11:36:06.713 INFO:tasks.workunit.client.0.smithi138.stderr: -459> 2024-09-14T11:36:06.302+0000 7f9b22f269c0 5 AuthRegistry(0x5650069b22b0) adding con mode: secure 2024-09-14T11:36:06.713 INFO:tasks.workunit.client.0.smithi138.stderr: -458> 2024-09-14T11:36:06.302+0000 7f9b22f269c0 5 AuthRegistry(0x5650069b22b0) adding con mode: crc 2024-09-14T11:36:06.713 INFO:tasks.workunit.client.0.smithi138.stderr: -457> 2024-09-14T11:36:06.302+0000 7f9b22f269c0 5 AuthRegistry(0x5650069b22b0) adding con mode: secure 2024-09-14T11:36:06.713 INFO:tasks.workunit.client.0.smithi138.stderr: -456> 2024-09-14T11:36:06.302+0000 7f9b22f269c0 5 AuthRegistry(0x5650069b22b0) adding con mode: crc 2024-09-14T11:36:06.713 INFO:tasks.workunit.client.0.smithi138.stderr: -455> 2024-09-14T11:36:06.302+0000 7f9b22f269c0 5 AuthRegistry(0x5650069b22b0) adding con mode: secure 2024-09-14T11:36:06.713 INFO:tasks.workunit.client.0.smithi138.stderr: -454> 2024-09-14T11:36:06.302+0000 7f9b22f269c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:36:06.713 INFO:tasks.workunit.client.0.smithi138.stderr: -453> 2024-09-14T11:36:06.302+0000 7f9b22f269c0 5 asok(0x56500674dd90) register_command objecter_requests cmddesc objecter_requests hook 0x5650069b5ca0 EEXIST 2024-09-14T11:36:06.713 INFO:tasks.workunit.client.0.smithi138.stderr: -452> 2024-09-14T11:36:06.302+0000 7f9b22f269c0 10 monclient: init 2024-09-14T11:36:06.713 INFO:tasks.workunit.client.0.smithi138.stderr: -451> 2024-09-14T11:36:06.302+0000 7f9b22f269c0 5 AuthRegistry(0x5650069b11a8) adding auth protocol: cephx 2024-09-14T11:36:06.713 INFO:tasks.workunit.client.0.smithi138.stderr: -450> 2024-09-14T11:36:06.302+0000 7f9b22f269c0 5 AuthRegistry(0x5650069b11a8) adding auth protocol: cephx 2024-09-14T11:36:06.713 INFO:tasks.workunit.client.0.smithi138.stderr: -449> 2024-09-14T11:36:06.302+0000 7f9b22f269c0 5 AuthRegistry(0x5650069b11a8) adding auth protocol: cephx 2024-09-14T11:36:06.713 INFO:tasks.workunit.client.0.smithi138.stderr: -448> 2024-09-14T11:36:06.302+0000 7f9b22f269c0 5 AuthRegistry(0x5650069b11a8) adding con mode: secure 2024-09-14T11:36:06.713 INFO:tasks.workunit.client.0.smithi138.stderr: -447> 2024-09-14T11:36:06.302+0000 7f9b22f269c0 5 AuthRegistry(0x5650069b11a8) adding con mode: crc 2024-09-14T11:36:06.714 INFO:tasks.workunit.client.0.smithi138.stderr: -446> 2024-09-14T11:36:06.302+0000 7f9b22f269c0 5 AuthRegistry(0x5650069b11a8) adding con mode: secure 2024-09-14T11:36:06.714 INFO:tasks.workunit.client.0.smithi138.stderr: -445> 2024-09-14T11:36:06.302+0000 7f9b22f269c0 5 AuthRegistry(0x5650069b11a8) adding con mode: crc 2024-09-14T11:36:06.714 INFO:tasks.workunit.client.0.smithi138.stderr: -444> 2024-09-14T11:36:06.302+0000 7f9b22f269c0 5 AuthRegistry(0x5650069b11a8) adding con mode: secure 2024-09-14T11:36:06.714 INFO:tasks.workunit.client.0.smithi138.stderr: -443> 2024-09-14T11:36:06.302+0000 7f9b22f269c0 5 AuthRegistry(0x5650069b11a8) adding con mode: crc 2024-09-14T11:36:06.714 INFO:tasks.workunit.client.0.smithi138.stderr: -442> 2024-09-14T11:36:06.302+0000 7f9b22f269c0 5 AuthRegistry(0x5650069b11a8) adding con mode: crc 2024-09-14T11:36:06.714 INFO:tasks.workunit.client.0.smithi138.stderr: -441> 2024-09-14T11:36:06.302+0000 7f9b22f269c0 5 AuthRegistry(0x5650069b11a8) adding con mode: secure 2024-09-14T11:36:06.714 INFO:tasks.workunit.client.0.smithi138.stderr: -440> 2024-09-14T11:36:06.302+0000 7f9b22f269c0 5 AuthRegistry(0x5650069b11a8) adding con mode: crc 2024-09-14T11:36:06.714 INFO:tasks.workunit.client.0.smithi138.stderr: -439> 2024-09-14T11:36:06.302+0000 7f9b22f269c0 5 AuthRegistry(0x5650069b11a8) adding con mode: secure 2024-09-14T11:36:06.714 INFO:tasks.workunit.client.0.smithi138.stderr: -438> 2024-09-14T11:36:06.302+0000 7f9b22f269c0 5 AuthRegistry(0x5650069b11a8) adding con mode: crc 2024-09-14T11:36:06.714 INFO:tasks.workunit.client.0.smithi138.stderr: -437> 2024-09-14T11:36:06.302+0000 7f9b22f269c0 5 AuthRegistry(0x5650069b11a8) adding con mode: secure 2024-09-14T11:36:06.714 INFO:tasks.workunit.client.0.smithi138.stderr: -436> 2024-09-14T11:36:06.302+0000 7f9b22f269c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:36:06.714 INFO:tasks.workunit.client.0.smithi138.stderr: -435> 2024-09-14T11:36:06.302+0000 7f9b22f269c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:36:06.714 INFO:tasks.workunit.client.0.smithi138.stderr: -434> 2024-09-14T11:36:06.302+0000 7f9b22f269c0 5 asok(0x56500674dd90) register_command rotate-key cmddesc rotate-key hook 0x5650069b12f0 EEXIST 2024-09-14T11:36:06.714 INFO:tasks.workunit.client.0.smithi138.stderr: -433> 2024-09-14T11:36:06.302+0000 7f9b22f269c0 10 monclient: _reopen_session rank -1 2024-09-14T11:36:06.715 INFO:tasks.workunit.client.0.smithi138.stderr: -432> 2024-09-14T11:36:06.302+0000 7f9b22f269c0 10 monclient: _add_conns ranks=[2,1,0] 2024-09-14T11:36:06.715 INFO:tasks.workunit.client.0.smithi138.stderr: -431> 2024-09-14T11:36:06.302+0000 7f9b22f269c0 10 monclient(hunting): picked mon.noname-c con 0x5650069d9e50 addr [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] 2024-09-14T11:36:06.715 INFO:tasks.workunit.client.0.smithi138.stderr: -430> 2024-09-14T11:36:06.302+0000 7f9b22f269c0 10 monclient(hunting): picked mon.noname-b con 0x5650069d9780 addr [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] 2024-09-14T11:36:06.715 INFO:tasks.workunit.client.0.smithi138.stderr: -429> 2024-09-14T11:36:06.302+0000 7f9b22f269c0 10 monclient(hunting): picked mon.noname-a con 0x5650069d8160 addr [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] 2024-09-14T11:36:06.715 INFO:tasks.workunit.client.0.smithi138.stderr: -428> 2024-09-14T11:36:06.302+0000 7f9b22f269c0 10 monclient(hunting): start opening mon connection 2024-09-14T11:36:06.715 INFO:tasks.workunit.client.0.smithi138.stderr: -427> 2024-09-14T11:36:06.302+0000 7f9b22f269c0 10 monclient(hunting): start opening mon connection 2024-09-14T11:36:06.715 INFO:tasks.workunit.client.0.smithi138.stderr: -426> 2024-09-14T11:36:06.302+0000 7f9b22f269c0 10 monclient(hunting): start opening mon connection 2024-09-14T11:36:06.715 INFO:tasks.workunit.client.0.smithi138.stderr: -425> 2024-09-14T11:36:06.302+0000 7f9b22f269c0 10 monclient(hunting): _renew_subs 2024-09-14T11:36:06.715 INFO:tasks.workunit.client.0.smithi138.stderr: -424> 2024-09-14T11:36:06.302+0000 7f9b22f269c0 10 monclient(hunting): authenticate will time out at 2702.267471s 2024-09-14T11:36:06.715 INFO:tasks.workunit.client.0.smithi138.stderr: -423> 2024-09-14T11:36:06.302+0000 7f9b2022b640 10 monclient(hunting): get_auth_request con 0x5650069d9e50 auth_method 0 2024-09-14T11:36:06.715 INFO:tasks.workunit.client.0.smithi138.stderr: -422> 2024-09-14T11:36:06.302+0000 7f9b2022b640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:36:06.715 INFO:tasks.workunit.client.0.smithi138.stderr: -421> 2024-09-14T11:36:06.302+0000 7f9b2022b640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:36:06.715 INFO:tasks.workunit.client.0.smithi138.stderr: -420> 2024-09-14T11:36:06.302+0000 7f9b2022b640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:36:06.715 INFO:tasks.workunit.client.0.smithi138.stderr: -419> 2024-09-14T11:36:06.302+0000 7f9b20a2c640 10 monclient(hunting): get_auth_request con 0x5650069d8160 auth_method 0 2024-09-14T11:36:06.716 INFO:tasks.workunit.client.0.smithi138.stderr: -418> 2024-09-14T11:36:06.302+0000 7f9b20a2c640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:36:06.716 INFO:tasks.workunit.client.0.smithi138.stderr: -417> 2024-09-14T11:36:06.302+0000 7f9b20a2c640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:36:06.716 INFO:tasks.workunit.client.0.smithi138.stderr: -416> 2024-09-14T11:36:06.302+0000 7f9b20a2c640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:36:06.716 INFO:tasks.workunit.client.0.smithi138.stderr: -415> 2024-09-14T11:36:06.302+0000 7f9b20a2c640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:36:06.716 INFO:tasks.workunit.client.0.smithi138.stderr: -414> 2024-09-14T11:36:06.302+0000 7f9b20a2c640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:36:06.716 INFO:tasks.workunit.client.0.smithi138.stderr: -413> 2024-09-14T11:36:06.302+0000 7f9b20a2c640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:36:06.716 INFO:tasks.workunit.client.0.smithi138.stderr: -412> 2024-09-14T11:36:06.302+0000 7f9b2022b640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:36:06.716 INFO:tasks.workunit.client.0.smithi138.stderr: -411> 2024-09-14T11:36:06.302+0000 7f9b2022b640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:36:06.716 INFO:tasks.workunit.client.0.smithi138.stderr: -410> 2024-09-14T11:36:06.302+0000 7f9b2022b640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:36:06.716 INFO:tasks.workunit.client.0.smithi138.stderr: -409> 2024-09-14T11:36:06.302+0000 7f9b2122d640 10 monclient(hunting): get_auth_request con 0x5650069d9780 auth_method 0 2024-09-14T11:36:06.716 INFO:tasks.workunit.client.0.smithi138.stderr: -408> 2024-09-14T11:36:06.302+0000 7f9b2122d640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:36:06.716 INFO:tasks.workunit.client.0.smithi138.stderr: -407> 2024-09-14T11:36:06.302+0000 7f9b2122d640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:36:06.716 INFO:tasks.workunit.client.0.smithi138.stderr: -406> 2024-09-14T11:36:06.302+0000 7f9b2122d640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:36:06.716 INFO:tasks.workunit.client.0.smithi138.stderr: -405> 2024-09-14T11:36:06.302+0000 7f9b20a2c640 10 monclient(hunting): handle_auth_done global_id 7005 payload 824 2024-09-14T11:36:06.717 INFO:tasks.workunit.client.0.smithi138.stderr: -404> 2024-09-14T11:36:06.302+0000 7f9b20a2c640 10 monclient: _finish_hunting 0 2024-09-14T11:36:06.717 INFO:tasks.workunit.client.0.smithi138.stderr: -403> 2024-09-14T11:36:06.302+0000 7f9b20a2c640 1 monclient: found mon.noname-a 2024-09-14T11:36:06.717 INFO:tasks.workunit.client.0.smithi138.stderr: -402> 2024-09-14T11:36:06.302+0000 7f9b20a2c640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.138:3300/0 2024-09-14T11:36:06.717 INFO:tasks.workunit.client.0.smithi138.stderr: -401> 2024-09-14T11:36:06.306+0000 7f9a067fc640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:36:06.717 INFO:tasks.workunit.client.0.smithi138.stderr: -400> 2024-09-14T11:36:06.306+0000 7f9a067fc640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-14T11:36:06.717 INFO:tasks.workunit.client.0.smithi138.stderr: -399> 2024-09-14T11:36:06.306+0000 7f9a067fc640 10 monclient: dump: 2024-09-14T11:36:06.717 INFO:tasks.workunit.client.0.smithi138.stderr:epoch 1 2024-09-14T11:36:06.717 INFO:tasks.workunit.client.0.smithi138.stderr:fsid 3f225f43-83a6-4aeb-b798-1f04bb49d597 2024-09-14T11:36:06.717 INFO:tasks.workunit.client.0.smithi138.stderr:last_changed 2024-09-14T11:07:09.252780+0000 2024-09-14T11:36:06.717 INFO:tasks.workunit.client.0.smithi138.stderr:created 2024-09-14T11:07:09.252780+0000 2024-09-14T11:36:06.717 INFO:tasks.workunit.client.0.smithi138.stderr:min_mon_release 19 (squid) 2024-09-14T11:36:06.717 INFO:tasks.workunit.client.0.smithi138.stderr:election_strategy: 1 2024-09-14T11:36:06.717 INFO:tasks.workunit.client.0.smithi138.stderr:0: [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] mon.a 2024-09-14T11:36:06.717 INFO:tasks.workunit.client.0.smithi138.stderr:1: [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] mon.b 2024-09-14T11:36:06.718 INFO:tasks.workunit.client.0.smithi138.stderr:2: [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] mon.c 2024-09-14T11:36:06.718 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-14T11:36:06.718 INFO:tasks.workunit.client.0.smithi138.stderr: -398> 2024-09-14T11:36:06.306+0000 7f9a067fc640 10 monclient: _finish_auth 0 2024-09-14T11:36:06.718 INFO:tasks.workunit.client.0.smithi138.stderr: -397> 2024-09-14T11:36:06.306+0000 7f9a067fc640 10 monclient: _check_auth_tickets 2024-09-14T11:36:06.718 INFO:tasks.workunit.client.0.smithi138.stderr: -396> 2024-09-14T11:36:06.306+0000 7f9a067fc640 10 monclient: handle_config config(0 keys) 2024-09-14T11:36:06.718 INFO:tasks.workunit.client.0.smithi138.stderr: -395> 2024-09-14T11:36:06.306+0000 7f9a067fc640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:36:06.718 INFO:tasks.workunit.client.0.smithi138.stderr: -394> 2024-09-14T11:36:06.306+0000 7f9a067fc640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-14T11:36:06.718 INFO:tasks.workunit.client.0.smithi138.stderr: -393> 2024-09-14T11:36:06.306+0000 7f9a067fc640 10 monclient: dump: 2024-09-14T11:36:06.718 INFO:tasks.workunit.client.0.smithi138.stderr:epoch 1 2024-09-14T11:36:06.718 INFO:tasks.workunit.client.0.smithi138.stderr:fsid 3f225f43-83a6-4aeb-b798-1f04bb49d597 2024-09-14T11:36:06.718 INFO:tasks.workunit.client.0.smithi138.stderr:last_changed 2024-09-14T11:07:09.252780+0000 2024-09-14T11:36:06.718 INFO:tasks.workunit.client.0.smithi138.stderr:created 2024-09-14T11:07:09.252780+0000 2024-09-14T11:36:06.718 INFO:tasks.workunit.client.0.smithi138.stderr:min_mon_release 19 (squid) 2024-09-14T11:36:06.719 INFO:tasks.workunit.client.0.smithi138.stderr:election_strategy: 1 2024-09-14T11:36:06.719 INFO:tasks.workunit.client.0.smithi138.stderr:0: [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] mon.a 2024-09-14T11:36:06.719 INFO:tasks.workunit.client.0.smithi138.stderr:1: [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] mon.b 2024-09-14T11:36:06.719 INFO:tasks.workunit.client.0.smithi138.stderr:2: [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] mon.c 2024-09-14T11:36:06.719 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-14T11:36:06.719 INFO:tasks.workunit.client.0.smithi138.stderr: -392> 2024-09-14T11:36:06.306+0000 7f9b1fa2a640 4 set_mon_vals no callback set 2024-09-14T11:36:06.719 INFO:tasks.workunit.client.0.smithi138.stderr: -391> 2024-09-14T11:36:06.306+0000 7f9b22f269c0 5 monclient: authenticate success, global_id 7005 2024-09-14T11:36:06.719 INFO:tasks.workunit.client.0.smithi138.stderr: -390> 2024-09-14T11:36:06.306+0000 7f9b22f269c0 10 monclient: _renew_subs 2024-09-14T11:36:06.719 INFO:tasks.workunit.client.0.smithi138.stderr: -389> 2024-09-14T11:36:06.306+0000 7f9b22f269c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.138:3300/0 2024-09-14T11:36:06.719 INFO:tasks.workunit.client.0.smithi138.stderr: -388> 2024-09-14T11:36:06.306+0000 7f9b22f269c0 10 monclient: _renew_subs 2024-09-14T11:36:06.719 INFO:tasks.workunit.client.0.smithi138.stderr: -387> 2024-09-14T11:36:06.306+0000 7f9b22f269c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.138:3300/0 2024-09-14T11:36:06.719 INFO:tasks.workunit.client.0.smithi138.stderr: -386> 2024-09-14T11:36:06.306+0000 7f9a067fc640 10 monclient: ms_handle_reset current mon [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] 2024-09-14T11:36:06.719 INFO:tasks.workunit.client.0.smithi138.stderr: -385> 2024-09-14T11:36:06.306+0000 7f9a067fc640 10 monclient: _reopen_session rank -1 2024-09-14T11:36:06.719 INFO:tasks.workunit.client.0.smithi138.stderr: -384> 2024-09-14T11:36:06.306+0000 7f9a067fc640 10 monclient: _add_conns ranks=[1,0,2] 2024-09-14T11:36:06.719 INFO:tasks.workunit.client.0.smithi138.stderr: -383> 2024-09-14T11:36:06.306+0000 7f9a067fc640 10 monclient(hunting): picked mon.b con 0x7f99f8002160 addr [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] 2024-09-14T11:36:06.720 INFO:tasks.workunit.client.0.smithi138.stderr: -382> 2024-09-14T11:36:06.306+0000 7f9a067fc640 10 monclient(hunting): picked mon.a con 0x7f99f8004f20 addr [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] 2024-09-14T11:36:06.720 INFO:tasks.workunit.client.0.smithi138.stderr: -381> 2024-09-14T11:36:06.306+0000 7f9a067fc640 10 monclient(hunting): picked mon.c con 0x5650069d9e50 addr [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] 2024-09-14T11:36:06.720 INFO:tasks.workunit.client.0.smithi138.stderr: -380> 2024-09-14T11:36:06.306+0000 7f9a067fc640 10 monclient(hunting): start opening mon connection 2024-09-14T11:36:06.720 INFO:tasks.workunit.client.0.smithi138.stderr: -379> 2024-09-14T11:36:06.306+0000 7f9a067fc640 10 monclient(hunting): start opening mon connection 2024-09-14T11:36:06.720 INFO:tasks.workunit.client.0.smithi138.stderr: -378> 2024-09-14T11:36:06.306+0000 7f9a067fc640 10 monclient(hunting): start opening mon connection 2024-09-14T11:36:06.720 INFO:tasks.workunit.client.0.smithi138.stderr: -377> 2024-09-14T11:36:06.306+0000 7f9a067fc640 10 monclient(hunting): _renew_subs 2024-09-14T11:36:06.720 INFO:tasks.workunit.client.0.smithi138.stderr: -376> 2024-09-14T11:36:06.306+0000 7f9b2122d640 10 monclient(hunting): get_auth_request con 0x7f99f8004f20 auth_method 0 2024-09-14T11:36:06.720 INFO:tasks.workunit.client.0.smithi138.stderr: -375> 2024-09-14T11:36:06.306+0000 7f9b2122d640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:36:06.720 INFO:tasks.workunit.client.0.smithi138.stderr: -374> 2024-09-14T11:36:06.306+0000 7f9b2122d640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:36:06.720 INFO:tasks.workunit.client.0.smithi138.stderr: -373> 2024-09-14T11:36:06.306+0000 7f9b2122d640 10 monclient(hunting): _init_auth already have auth, reseting 2024-09-14T11:36:06.720 INFO:tasks.workunit.client.0.smithi138.stderr: -372> 2024-09-14T11:36:06.306+0000 7f9b20a2c640 10 monclient(hunting): get_auth_request con 0x5650069d9e50 auth_method 0 2024-09-14T11:36:06.720 INFO:tasks.workunit.client.0.smithi138.stderr: -371> 2024-09-14T11:36:06.306+0000 7f9b20a2c640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:36:06.720 INFO:tasks.workunit.client.0.smithi138.stderr: -370> 2024-09-14T11:36:06.306+0000 7f9b20a2c640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:36:06.720 INFO:tasks.workunit.client.0.smithi138.stderr: -369> 2024-09-14T11:36:06.306+0000 7f9b20a2c640 10 monclient(hunting): _init_auth already have auth, reseting 2024-09-14T11:36:06.720 INFO:tasks.workunit.client.0.smithi138.stderr: -368> 2024-09-14T11:36:06.306+0000 7f9b2122d640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:36:06.721 INFO:tasks.workunit.client.0.smithi138.stderr: -367> 2024-09-14T11:36:06.306+0000 7f9b2122d640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:36:06.721 INFO:tasks.workunit.client.0.smithi138.stderr: -366> 2024-09-14T11:36:06.306+0000 7f9b2122d640 10 monclient(hunting): handle_auth_reply_more responding with 132 bytes 2024-09-14T11:36:06.721 INFO:tasks.workunit.client.0.smithi138.stderr: -365> 2024-09-14T11:36:06.306+0000 7f9b20a2c640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:36:06.721 INFO:tasks.workunit.client.0.smithi138.stderr: -364> 2024-09-14T11:36:06.306+0000 7f9b20a2c640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:36:06.721 INFO:tasks.workunit.client.0.smithi138.stderr: -363> 2024-09-14T11:36:06.306+0000 7f9b20a2c640 10 monclient(hunting): handle_auth_reply_more responding with 132 bytes 2024-09-14T11:36:06.721 INFO:tasks.workunit.client.0.smithi138.stderr: -362> 2024-09-14T11:36:06.306+0000 7f9b2122d640 10 monclient(hunting): handle_auth_done global_id 7005 payload 293 2024-09-14T11:36:06.721 INFO:tasks.workunit.client.0.smithi138.stderr: -361> 2024-09-14T11:36:06.306+0000 7f9b2122d640 10 monclient: _finish_hunting 0 2024-09-14T11:36:06.721 INFO:tasks.workunit.client.0.smithi138.stderr: -360> 2024-09-14T11:36:06.306+0000 7f9b2122d640 1 monclient: found mon.a 2024-09-14T11:36:06.721 INFO:tasks.workunit.client.0.smithi138.stderr: -359> 2024-09-14T11:36:06.306+0000 7f9b2122d640 10 monclient: _send_mon_message to mon.a at v2:172.21.15.138:3300/0 2024-09-14T11:36:06.721 INFO:tasks.workunit.client.0.smithi138.stderr: -358> 2024-09-14T11:36:06.306+0000 7f9b2122d640 10 monclient: _finish_auth 0 2024-09-14T11:36:06.721 INFO:tasks.workunit.client.0.smithi138.stderr: -357> 2024-09-14T11:36:06.306+0000 7f9b2122d640 10 monclient: _check_auth_tickets 2024-09-14T11:36:06.721 INFO:tasks.workunit.client.0.smithi138.stderr: -356> 2024-09-14T11:36:06.306+0000 7f9b2022b640 10 monclient: get_auth_request con 0x7f99f8002160 auth_method 0 2024-09-14T11:36:06.721 INFO:tasks.workunit.client.0.smithi138.stderr: -355> 2024-09-14T11:36:06.306+0000 7f9a067fc640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:36:06.721 INFO:tasks.workunit.client.0.smithi138.stderr: -354> 2024-09-14T11:36:06.306+0000 7f9a067fc640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-14T11:36:06.721 INFO:tasks.workunit.client.0.smithi138.stderr: -353> 2024-09-14T11:36:06.306+0000 7f9a067fc640 10 monclient: dump: 2024-09-14T11:36:06.721 INFO:tasks.workunit.client.0.smithi138.stderr:epoch 1 2024-09-14T11:36:06.722 INFO:tasks.workunit.client.0.smithi138.stderr:fsid 3f225f43-83a6-4aeb-b798-1f04bb49d597 2024-09-14T11:36:06.722 INFO:tasks.workunit.client.0.smithi138.stderr:last_changed 2024-09-14T11:07:09.252780+0000 2024-09-14T11:36:06.722 INFO:tasks.workunit.client.0.smithi138.stderr:created 2024-09-14T11:07:09.252780+0000 2024-09-14T11:36:06.722 INFO:tasks.workunit.client.0.smithi138.stderr:min_mon_release 19 (squid) 2024-09-14T11:36:06.722 INFO:tasks.workunit.client.0.smithi138.stderr:election_strategy: 1 2024-09-14T11:36:06.722 INFO:tasks.workunit.client.0.smithi138.stderr:0: [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] mon.a 2024-09-14T11:36:06.722 INFO:tasks.workunit.client.0.smithi138.stderr:1: [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] mon.b 2024-09-14T11:36:06.722 INFO:tasks.workunit.client.0.smithi138.stderr:2: [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] mon.c 2024-09-14T11:36:06.722 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-14T11:36:06.722 INFO:tasks.workunit.client.0.smithi138.stderr: -352> 2024-09-14T11:36:06.306+0000 7f9a067fc640 10 monclient: handle_config config(0 keys) 2024-09-14T11:36:06.722 INFO:tasks.workunit.client.0.smithi138.stderr: -351> 2024-09-14T11:36:06.306+0000 7f9b21a2e640 4 set_mon_vals no callback set 2024-09-14T11:36:06.722 INFO:tasks.workunit.client.0.smithi138.stderr: -350> 2024-09-14T11:36:06.310+0000 7f9a067fc640 4 mgrc handle_mgr_map Got map version 5 2024-09-14T11:36:06.722 INFO:tasks.workunit.client.0.smithi138.stderr: -349> 2024-09-14T11:36:06.310+0000 7f9a067fc640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.138:6832/3778043143,v1:172.21.15.138:6833/3778043143] 2024-09-14T11:36:06.722 INFO:tasks.workunit.client.0.smithi138.stderr: -348> 2024-09-14T11:36:06.310+0000 7f9a067fc640 4 mgrc reconnect Starting new session with [v2:172.21.15.138:6832/3778043143,v1:172.21.15.138:6833/3778043143] 2024-09-14T11:36:06.722 INFO:tasks.workunit.client.0.smithi138.stderr: -347> 2024-09-14T11:36:06.310+0000 7f9b2022b640 10 monclient: get_auth_request con 0x5650069d8160 auth_method 0 2024-09-14T11:36:06.723 INFO:tasks.workunit.client.0.smithi138.stderr: -346> 2024-09-14T11:36:06.310+0000 7f9b22f269c0 10 monclient: get_monmap_and_config 2024-09-14T11:36:06.723 INFO:tasks.workunit.client.0.smithi138.stderr: -345> 2024-09-14T11:36:06.310+0000 7f9b22f269c0 10 monclient: build_initial_monmap 2024-09-14T11:36:06.723 INFO:tasks.workunit.client.0.smithi138.stderr: -344> 2024-09-14T11:36:06.310+0000 7f9b22f269c0 1 build_initial for_mkfs: 0 2024-09-14T11:36:06.723 INFO:tasks.workunit.client.0.smithi138.stderr: -343> 2024-09-14T11:36:06.310+0000 7f9b22f269c0 10 monclient: monmap: 2024-09-14T11:36:06.723 INFO:tasks.workunit.client.0.smithi138.stderr:epoch 0 2024-09-14T11:36:06.723 INFO:tasks.workunit.client.0.smithi138.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-14T11:36:06.723 INFO:tasks.workunit.client.0.smithi138.stderr:last_changed 0.000000 2024-09-14T11:36:06.723 INFO:tasks.workunit.client.0.smithi138.stderr:created 0.000000 2024-09-14T11:36:06.723 INFO:tasks.workunit.client.0.smithi138.stderr:min_mon_release 0 (unknown) 2024-09-14T11:36:06.723 INFO:tasks.workunit.client.0.smithi138.stderr:election_strategy: 1 2024-09-14T11:36:06.723 INFO:tasks.workunit.client.0.smithi138.stderr:0: [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] mon.noname-a 2024-09-14T11:36:06.723 INFO:tasks.workunit.client.0.smithi138.stderr:1: [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] mon.noname-b 2024-09-14T11:36:06.723 INFO:tasks.workunit.client.0.smithi138.stderr:2: [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] mon.noname-c 2024-09-14T11:36:06.723 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-14T11:36:06.723 INFO:tasks.workunit.client.0.smithi138.stderr: -342> 2024-09-14T11:36:06.310+0000 7f9b22f269c0 5 AuthRegistry(0x5650069f2a30) adding auth protocol: cephx 2024-09-14T11:36:06.723 INFO:tasks.workunit.client.0.smithi138.stderr: -341> 2024-09-14T11:36:06.310+0000 7f9b22f269c0 5 AuthRegistry(0x5650069f2a30) adding auth protocol: cephx 2024-09-14T11:36:06.724 INFO:tasks.workunit.client.0.smithi138.stderr: -340> 2024-09-14T11:36:06.310+0000 7f9b22f269c0 5 AuthRegistry(0x5650069f2a30) adding auth protocol: cephx 2024-09-14T11:36:06.724 INFO:tasks.workunit.client.0.smithi138.stderr: -339> 2024-09-14T11:36:06.310+0000 7f9b22f269c0 5 AuthRegistry(0x5650069f2a30) adding con mode: secure 2024-09-14T11:36:06.724 INFO:tasks.workunit.client.0.smithi138.stderr: -338> 2024-09-14T11:36:06.310+0000 7f9b22f269c0 5 AuthRegistry(0x5650069f2a30) adding con mode: crc 2024-09-14T11:36:06.724 INFO:tasks.workunit.client.0.smithi138.stderr: -337> 2024-09-14T11:36:06.310+0000 7f9b22f269c0 5 AuthRegistry(0x5650069f2a30) adding con mode: secure 2024-09-14T11:36:06.724 INFO:tasks.workunit.client.0.smithi138.stderr: -336> 2024-09-14T11:36:06.310+0000 7f9b22f269c0 5 AuthRegistry(0x5650069f2a30) adding con mode: crc 2024-09-14T11:36:06.724 INFO:tasks.workunit.client.0.smithi138.stderr: -335> 2024-09-14T11:36:06.310+0000 7f9b22f269c0 5 AuthRegistry(0x5650069f2a30) adding con mode: secure 2024-09-14T11:36:06.724 INFO:tasks.workunit.client.0.smithi138.stderr: -334> 2024-09-14T11:36:06.310+0000 7f9b22f269c0 5 AuthRegistry(0x5650069f2a30) adding con mode: crc 2024-09-14T11:36:06.724 INFO:tasks.workunit.client.0.smithi138.stderr: -333> 2024-09-14T11:36:06.310+0000 7f9b22f269c0 5 AuthRegistry(0x5650069f2a30) adding con mode: crc 2024-09-14T11:36:06.724 INFO:tasks.workunit.client.0.smithi138.stderr: -332> 2024-09-14T11:36:06.310+0000 7f9b22f269c0 5 AuthRegistry(0x5650069f2a30) adding con mode: secure 2024-09-14T11:36:06.724 INFO:tasks.workunit.client.0.smithi138.stderr: -331> 2024-09-14T11:36:06.310+0000 7f9b22f269c0 5 AuthRegistry(0x5650069f2a30) adding con mode: crc 2024-09-14T11:36:06.724 INFO:tasks.workunit.client.0.smithi138.stderr: -330> 2024-09-14T11:36:06.310+0000 7f9b22f269c0 5 AuthRegistry(0x5650069f2a30) adding con mode: secure 2024-09-14T11:36:06.724 INFO:tasks.workunit.client.0.smithi138.stderr: -329> 2024-09-14T11:36:06.310+0000 7f9b22f269c0 5 AuthRegistry(0x5650069f2a30) adding con mode: crc 2024-09-14T11:36:06.724 INFO:tasks.workunit.client.0.smithi138.stderr: -328> 2024-09-14T11:36:06.310+0000 7f9b22f269c0 5 AuthRegistry(0x5650069f2a30) adding con mode: secure 2024-09-14T11:36:06.724 INFO:tasks.workunit.client.0.smithi138.stderr: -327> 2024-09-14T11:36:06.310+0000 7f9b22f269c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:36:06.725 INFO:tasks.workunit.client.0.smithi138.stderr: -326> 2024-09-14T11:36:06.310+0000 7f9b22f269c0 10 monclient: init 2024-09-14T11:36:06.725 INFO:tasks.workunit.client.0.smithi138.stderr: -325> 2024-09-14T11:36:06.310+0000 7f9b22f269c0 5 AuthRegistry(0x7fffceb3e730) adding auth protocol: cephx 2024-09-14T11:36:06.725 INFO:tasks.workunit.client.0.smithi138.stderr: -324> 2024-09-14T11:36:06.310+0000 7f9b22f269c0 5 AuthRegistry(0x7fffceb3e730) adding auth protocol: cephx 2024-09-14T11:36:06.725 INFO:tasks.workunit.client.0.smithi138.stderr: -323> 2024-09-14T11:36:06.310+0000 7f9b22f269c0 5 AuthRegistry(0x7fffceb3e730) adding auth protocol: cephx 2024-09-14T11:36:06.725 INFO:tasks.workunit.client.0.smithi138.stderr: -322> 2024-09-14T11:36:06.310+0000 7f9b22f269c0 5 AuthRegistry(0x7fffceb3e730) adding con mode: secure 2024-09-14T11:36:06.725 INFO:tasks.workunit.client.0.smithi138.stderr: -321> 2024-09-14T11:36:06.310+0000 7f9b22f269c0 5 AuthRegistry(0x7fffceb3e730) adding con mode: crc 2024-09-14T11:36:06.725 INFO:tasks.workunit.client.0.smithi138.stderr: -320> 2024-09-14T11:36:06.310+0000 7f9b22f269c0 5 AuthRegistry(0x7fffceb3e730) adding con mode: secure 2024-09-14T11:36:06.725 INFO:tasks.workunit.client.0.smithi138.stderr: -319> 2024-09-14T11:36:06.310+0000 7f9b22f269c0 5 AuthRegistry(0x7fffceb3e730) adding con mode: crc 2024-09-14T11:36:06.725 INFO:tasks.workunit.client.0.smithi138.stderr: -318> 2024-09-14T11:36:06.310+0000 7f9b22f269c0 5 AuthRegistry(0x7fffceb3e730) adding con mode: secure 2024-09-14T11:36:06.725 INFO:tasks.workunit.client.0.smithi138.stderr: -317> 2024-09-14T11:36:06.310+0000 7f9b22f269c0 5 AuthRegistry(0x7fffceb3e730) adding con mode: crc 2024-09-14T11:36:06.725 INFO:tasks.workunit.client.0.smithi138.stderr: -316> 2024-09-14T11:36:06.310+0000 7f9b22f269c0 5 AuthRegistry(0x7fffceb3e730) adding con mode: crc 2024-09-14T11:36:06.725 INFO:tasks.workunit.client.0.smithi138.stderr: -315> 2024-09-14T11:36:06.310+0000 7f9b22f269c0 5 AuthRegistry(0x7fffceb3e730) adding con mode: secure 2024-09-14T11:36:06.725 INFO:tasks.workunit.client.0.smithi138.stderr: -314> 2024-09-14T11:36:06.310+0000 7f9b22f269c0 5 AuthRegistry(0x7fffceb3e730) adding con mode: crc 2024-09-14T11:36:06.725 INFO:tasks.workunit.client.0.smithi138.stderr: -313> 2024-09-14T11:36:06.310+0000 7f9b22f269c0 5 AuthRegistry(0x7fffceb3e730) adding con mode: secure 2024-09-14T11:36:06.726 INFO:tasks.workunit.client.0.smithi138.stderr: -312> 2024-09-14T11:36:06.310+0000 7f9b22f269c0 5 AuthRegistry(0x7fffceb3e730) adding con mode: crc 2024-09-14T11:36:06.726 INFO:tasks.workunit.client.0.smithi138.stderr: -311> 2024-09-14T11:36:06.310+0000 7f9b22f269c0 5 AuthRegistry(0x7fffceb3e730) adding con mode: secure 2024-09-14T11:36:06.726 INFO:tasks.workunit.client.0.smithi138.stderr: -310> 2024-09-14T11:36:06.310+0000 7f9b22f269c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:36:06.726 INFO:tasks.workunit.client.0.smithi138.stderr: -309> 2024-09-14T11:36:06.310+0000 7f9b22f269c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:36:06.726 INFO:tasks.workunit.client.0.smithi138.stderr: -308> 2024-09-14T11:36:06.310+0000 7f9b22f269c0 5 asok(0x56500674dd90) register_command rotate-key cmddesc rotate-key hook 0x7fffceb3e878 EEXIST 2024-09-14T11:36:06.726 INFO:tasks.workunit.client.0.smithi138.stderr: -307> 2024-09-14T11:36:06.310+0000 7f9b22f269c0 10 monclient: _reopen_session rank -1 2024-09-14T11:36:06.726 INFO:tasks.workunit.client.0.smithi138.stderr: -306> 2024-09-14T11:36:06.310+0000 7f9b22f269c0 10 monclient: _add_conns ranks=[0,2,1] 2024-09-14T11:36:06.726 INFO:tasks.workunit.client.0.smithi138.stderr: -305> 2024-09-14T11:36:06.310+0000 7f9b22f269c0 10 monclient(hunting): picked mon.noname-a con 0x565006a26b80 addr [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] 2024-09-14T11:36:06.726 INFO:tasks.workunit.client.0.smithi138.stderr: -304> 2024-09-14T11:36:06.310+0000 7f9b22f269c0 10 monclient(hunting): picked mon.noname-c con 0x565006a26f60 addr [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] 2024-09-14T11:36:06.726 INFO:tasks.workunit.client.0.smithi138.stderr: -303> 2024-09-14T11:36:06.310+0000 7f9b22f269c0 10 monclient(hunting): picked mon.noname-b con 0x5650069f7b40 addr [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] 2024-09-14T11:36:06.726 INFO:tasks.workunit.client.0.smithi138.stderr: -302> 2024-09-14T11:36:06.310+0000 7f9b22f269c0 10 monclient(hunting): start opening mon connection 2024-09-14T11:36:06.726 INFO:tasks.workunit.client.0.smithi138.stderr: -301> 2024-09-14T11:36:06.310+0000 7f9b22f269c0 10 monclient(hunting): start opening mon connection 2024-09-14T11:36:06.726 INFO:tasks.workunit.client.0.smithi138.stderr: -300> 2024-09-14T11:36:06.310+0000 7f9b22f269c0 10 monclient(hunting): start opening mon connection 2024-09-14T11:36:06.726 INFO:tasks.workunit.client.0.smithi138.stderr: -299> 2024-09-14T11:36:06.310+0000 7f9b22f269c0 10 monclient(hunting): _renew_subs 2024-09-14T11:36:06.727 INFO:tasks.workunit.client.0.smithi138.stderr: -298> 2024-09-14T11:36:06.310+0000 7f9b22f269c0 10 monclient(hunting): authenticate will time out at 2702.273801s 2024-09-14T11:36:06.727 INFO:tasks.workunit.client.0.smithi138.stderr: -297> 2024-09-14T11:36:06.310+0000 7f9b2022b640 10 monclient(hunting): get_auth_request con 0x565006a26b80 auth_method 0 2024-09-14T11:36:06.727 INFO:tasks.workunit.client.0.smithi138.stderr: -296> 2024-09-14T11:36:06.310+0000 7f9b2022b640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:36:06.727 INFO:tasks.workunit.client.0.smithi138.stderr: -295> 2024-09-14T11:36:06.310+0000 7f9b2022b640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:36:06.727 INFO:tasks.workunit.client.0.smithi138.stderr: -294> 2024-09-14T11:36:06.310+0000 7f9b2022b640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:36:06.727 INFO:tasks.workunit.client.0.smithi138.stderr: -293> 2024-09-14T11:36:06.310+0000 7f9b2122d640 10 monclient(hunting): get_auth_request con 0x565006a26f60 auth_method 0 2024-09-14T11:36:06.727 INFO:tasks.workunit.client.0.smithi138.stderr: -292> 2024-09-14T11:36:06.310+0000 7f9b2122d640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:36:06.727 INFO:tasks.workunit.client.0.smithi138.stderr: -291> 2024-09-14T11:36:06.310+0000 7f9b2122d640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:36:06.727 INFO:tasks.workunit.client.0.smithi138.stderr: -290> 2024-09-14T11:36:06.310+0000 7f9b2122d640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:36:06.727 INFO:tasks.workunit.client.0.smithi138.stderr: -289> 2024-09-14T11:36:06.310+0000 7f9b2022b640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:36:06.727 INFO:tasks.workunit.client.0.smithi138.stderr: -288> 2024-09-14T11:36:06.310+0000 7f9b2022b640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:36:06.727 INFO:tasks.workunit.client.0.smithi138.stderr: -287> 2024-09-14T11:36:06.310+0000 7f9b2022b640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:36:06.727 INFO:tasks.workunit.client.0.smithi138.stderr: -286> 2024-09-14T11:36:06.310+0000 7f9b2122d640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:36:06.727 INFO:tasks.workunit.client.0.smithi138.stderr: -285> 2024-09-14T11:36:06.310+0000 7f9b2122d640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:36:06.727 INFO:tasks.workunit.client.0.smithi138.stderr: -284> 2024-09-14T11:36:06.310+0000 7f9b2122d640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:36:06.728 INFO:tasks.workunit.client.0.smithi138.stderr: -283> 2024-09-14T11:36:06.310+0000 7f9b2022b640 10 monclient(hunting): handle_auth_done global_id 7008 payload 274 2024-09-14T11:36:06.728 INFO:tasks.workunit.client.0.smithi138.stderr: -282> 2024-09-14T11:36:06.310+0000 7f9b2022b640 10 monclient: _finish_hunting 0 2024-09-14T11:36:06.728 INFO:tasks.workunit.client.0.smithi138.stderr: -281> 2024-09-14T11:36:06.310+0000 7f9b2022b640 1 monclient: found mon.noname-a 2024-09-14T11:36:06.728 INFO:tasks.workunit.client.0.smithi138.stderr: -280> 2024-09-14T11:36:06.310+0000 7f9b2022b640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.138:3300/0 2024-09-14T11:36:06.728 INFO:tasks.workunit.client.0.smithi138.stderr: -279> 2024-09-14T11:36:06.310+0000 7f9b20a2c640 10 monclient: get_auth_request con 0x5650069f7b40 auth_method 0 2024-09-14T11:36:06.728 INFO:tasks.workunit.client.0.smithi138.stderr: -278> 2024-09-14T11:36:06.310+0000 7f99effff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:36:06.728 INFO:tasks.workunit.client.0.smithi138.stderr: -277> 2024-09-14T11:36:06.310+0000 7f99effff640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-14T11:36:06.728 INFO:tasks.workunit.client.0.smithi138.stderr: -276> 2024-09-14T11:36:06.310+0000 7f99effff640 10 monclient: dump: 2024-09-14T11:36:06.728 INFO:tasks.workunit.client.0.smithi138.stderr:epoch 1 2024-09-14T11:36:06.728 INFO:tasks.workunit.client.0.smithi138.stderr:fsid 3f225f43-83a6-4aeb-b798-1f04bb49d597 2024-09-14T11:36:06.728 INFO:tasks.workunit.client.0.smithi138.stderr:last_changed 2024-09-14T11:07:09.252780+0000 2024-09-14T11:36:06.728 INFO:tasks.workunit.client.0.smithi138.stderr:created 2024-09-14T11:07:09.252780+0000 2024-09-14T11:36:06.728 INFO:tasks.workunit.client.0.smithi138.stderr:min_mon_release 19 (squid) 2024-09-14T11:36:06.728 INFO:tasks.workunit.client.0.smithi138.stderr:election_strategy: 1 2024-09-14T11:36:06.728 INFO:tasks.workunit.client.0.smithi138.stderr:0: [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] mon.a 2024-09-14T11:36:06.729 INFO:tasks.workunit.client.0.smithi138.stderr:1: [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] mon.b 2024-09-14T11:36:06.729 INFO:tasks.workunit.client.0.smithi138.stderr:2: [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] mon.c 2024-09-14T11:36:06.729 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-14T11:36:06.729 INFO:tasks.workunit.client.0.smithi138.stderr: -275> 2024-09-14T11:36:06.310+0000 7f99effff640 10 monclient: _finish_auth 0 2024-09-14T11:36:06.729 INFO:tasks.workunit.client.0.smithi138.stderr: -274> 2024-09-14T11:36:06.310+0000 7f99effff640 10 monclient: _check_auth_tickets 2024-09-14T11:36:06.729 INFO:tasks.workunit.client.0.smithi138.stderr: -273> 2024-09-14T11:36:06.310+0000 7f99effff640 10 monclient: handle_config config(0 keys) 2024-09-14T11:36:06.729 INFO:tasks.workunit.client.0.smithi138.stderr: -272> 2024-09-14T11:36:06.310+0000 7f99effff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:36:06.729 INFO:tasks.workunit.client.0.smithi138.stderr: -271> 2024-09-14T11:36:06.310+0000 7f99effff640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-14T11:36:06.729 INFO:tasks.workunit.client.0.smithi138.stderr: -270> 2024-09-14T11:36:06.310+0000 7f99effff640 10 monclient: dump: 2024-09-14T11:36:06.729 INFO:tasks.workunit.client.0.smithi138.stderr:epoch 1 2024-09-14T11:36:06.729 INFO:tasks.workunit.client.0.smithi138.stderr:fsid 3f225f43-83a6-4aeb-b798-1f04bb49d597 2024-09-14T11:36:06.729 INFO:tasks.workunit.client.0.smithi138.stderr:last_changed 2024-09-14T11:07:09.252780+0000 2024-09-14T11:36:06.729 INFO:tasks.workunit.client.0.smithi138.stderr:created 2024-09-14T11:07:09.252780+0000 2024-09-14T11:36:06.729 INFO:tasks.workunit.client.0.smithi138.stderr:min_mon_release 19 (squid) 2024-09-14T11:36:06.729 INFO:tasks.workunit.client.0.smithi138.stderr:election_strategy: 1 2024-09-14T11:36:06.730 INFO:tasks.workunit.client.0.smithi138.stderr:0: [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] mon.a 2024-09-14T11:36:06.730 INFO:tasks.workunit.client.0.smithi138.stderr:1: [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] mon.b 2024-09-14T11:36:06.730 INFO:tasks.workunit.client.0.smithi138.stderr:2: [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] mon.c 2024-09-14T11:36:06.730 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-14T11:36:06.730 INFO:tasks.workunit.client.0.smithi138.stderr: -269> 2024-09-14T11:36:06.310+0000 7f9b22f269c0 5 monclient: authenticate success, global_id 7008 2024-09-14T11:36:06.730 INFO:tasks.workunit.client.0.smithi138.stderr: -268> 2024-09-14T11:36:06.310+0000 7f9b22f269c0 10 monclient: get_monmap_and_config success 2024-09-14T11:36:06.730 INFO:tasks.workunit.client.0.smithi138.stderr: -267> 2024-09-14T11:36:06.310+0000 7f9b22f269c0 4 set_mon_vals no callback set 2024-09-14T11:36:06.730 INFO:tasks.workunit.client.0.smithi138.stderr: -266> 2024-09-14T11:36:06.310+0000 7f9b22f269c0 10 monclient: shutdown 2024-09-14T11:36:06.730 INFO:tasks.workunit.client.0.smithi138.stderr: -265> 2024-09-14T11:36:06.310+0000 7f9b22f269c0 10 monclient: build_initial_monmap 2024-09-14T11:36:06.730 INFO:tasks.workunit.client.0.smithi138.stderr: -264> 2024-09-14T11:36:06.310+0000 7f9b22f269c0 1 build_initial for_mkfs: 0 2024-09-14T11:36:06.730 INFO:tasks.workunit.client.0.smithi138.stderr: -263> 2024-09-14T11:36:06.310+0000 7f9b22f269c0 10 monclient: monmap: 2024-09-14T11:36:06.730 INFO:tasks.workunit.client.0.smithi138.stderr:epoch 0 2024-09-14T11:36:06.730 INFO:tasks.workunit.client.0.smithi138.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-14T11:36:06.730 INFO:tasks.workunit.client.0.smithi138.stderr:last_changed 0.000000 2024-09-14T11:36:06.730 INFO:tasks.workunit.client.0.smithi138.stderr:created 0.000000 2024-09-14T11:36:06.730 INFO:tasks.workunit.client.0.smithi138.stderr:min_mon_release 0 (unknown) 2024-09-14T11:36:06.731 INFO:tasks.workunit.client.0.smithi138.stderr:election_strategy: 1 2024-09-14T11:36:06.731 INFO:tasks.workunit.client.0.smithi138.stderr:0: [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] mon.noname-a 2024-09-14T11:36:06.731 INFO:tasks.workunit.client.0.smithi138.stderr:1: [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] mon.noname-b 2024-09-14T11:36:06.731 INFO:tasks.workunit.client.0.smithi138.stderr:2: [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] mon.noname-c 2024-09-14T11:36:06.731 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-14T11:36:06.731 INFO:tasks.workunit.client.0.smithi138.stderr: -262> 2024-09-14T11:36:06.310+0000 7f9b22f269c0 5 AuthRegistry(0x5650069f6830) adding auth protocol: cephx 2024-09-14T11:36:06.731 INFO:tasks.workunit.client.0.smithi138.stderr: -261> 2024-09-14T11:36:06.310+0000 7f9b22f269c0 5 AuthRegistry(0x5650069f6830) adding auth protocol: cephx 2024-09-14T11:36:06.731 INFO:tasks.workunit.client.0.smithi138.stderr: -260> 2024-09-14T11:36:06.310+0000 7f9b22f269c0 5 AuthRegistry(0x5650069f6830) adding auth protocol: cephx 2024-09-14T11:36:06.731 INFO:tasks.workunit.client.0.smithi138.stderr: -259> 2024-09-14T11:36:06.310+0000 7f9b22f269c0 5 AuthRegistry(0x5650069f6830) adding con mode: secure 2024-09-14T11:36:06.731 INFO:tasks.workunit.client.0.smithi138.stderr: -258> 2024-09-14T11:36:06.310+0000 7f9b22f269c0 5 AuthRegistry(0x5650069f6830) adding con mode: crc 2024-09-14T11:36:06.731 INFO:tasks.workunit.client.0.smithi138.stderr: -257> 2024-09-14T11:36:06.310+0000 7f9b22f269c0 5 AuthRegistry(0x5650069f6830) adding con mode: secure 2024-09-14T11:36:06.731 INFO:tasks.workunit.client.0.smithi138.stderr: -256> 2024-09-14T11:36:06.310+0000 7f9b22f269c0 5 AuthRegistry(0x5650069f6830) adding con mode: crc 2024-09-14T11:36:06.731 INFO:tasks.workunit.client.0.smithi138.stderr: -255> 2024-09-14T11:36:06.310+0000 7f9b22f269c0 5 AuthRegistry(0x5650069f6830) adding con mode: secure 2024-09-14T11:36:06.731 INFO:tasks.workunit.client.0.smithi138.stderr: -254> 2024-09-14T11:36:06.310+0000 7f9b22f269c0 5 AuthRegistry(0x5650069f6830) adding con mode: crc 2024-09-14T11:36:06.731 INFO:tasks.workunit.client.0.smithi138.stderr: -253> 2024-09-14T11:36:06.310+0000 7f9b22f269c0 5 AuthRegistry(0x5650069f6830) adding con mode: crc 2024-09-14T11:36:06.732 INFO:tasks.workunit.client.0.smithi138.stderr: -252> 2024-09-14T11:36:06.310+0000 7f9b22f269c0 5 AuthRegistry(0x5650069f6830) adding con mode: secure 2024-09-14T11:36:06.732 INFO:tasks.workunit.client.0.smithi138.stderr: -251> 2024-09-14T11:36:06.310+0000 7f9b22f269c0 5 AuthRegistry(0x5650069f6830) adding con mode: crc 2024-09-14T11:36:06.732 INFO:tasks.workunit.client.0.smithi138.stderr: -250> 2024-09-14T11:36:06.310+0000 7f9b22f269c0 5 AuthRegistry(0x5650069f6830) adding con mode: secure 2024-09-14T11:36:06.732 INFO:tasks.workunit.client.0.smithi138.stderr: -249> 2024-09-14T11:36:06.310+0000 7f9b22f269c0 5 AuthRegistry(0x5650069f6830) adding con mode: crc 2024-09-14T11:36:06.732 INFO:tasks.workunit.client.0.smithi138.stderr: -248> 2024-09-14T11:36:06.310+0000 7f9b22f269c0 5 AuthRegistry(0x5650069f6830) adding con mode: secure 2024-09-14T11:36:06.732 INFO:tasks.workunit.client.0.smithi138.stderr: -247> 2024-09-14T11:36:06.310+0000 7f9b22f269c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:36:06.732 INFO:tasks.workunit.client.0.smithi138.stderr: -246> 2024-09-14T11:36:06.310+0000 7f9b22f269c0 1 librados: starting msgr at 2024-09-14T11:36:06.732 INFO:tasks.workunit.client.0.smithi138.stderr: -245> 2024-09-14T11:36:06.310+0000 7f9b22f269c0 1 librados: starting objecter 2024-09-14T11:36:06.732 INFO:tasks.workunit.client.0.smithi138.stderr: -244> 2024-09-14T11:36:06.310+0000 7f9b22f269c0 5 asok(0x56500674dd90) register_command objecter_requests cmddesc objecter_requests hook 0x5650069da400 EEXIST 2024-09-14T11:36:06.732 INFO:tasks.workunit.client.0.smithi138.stderr: -243> 2024-09-14T11:36:06.310+0000 7f9b22f269c0 1 librados: setting wanted keys 2024-09-14T11:36:06.732 INFO:tasks.workunit.client.0.smithi138.stderr: -242> 2024-09-14T11:36:06.310+0000 7f9b22f269c0 1 librados: calling monclient init 2024-09-14T11:36:06.732 INFO:tasks.workunit.client.0.smithi138.stderr: -241> 2024-09-14T11:36:06.310+0000 7f9b22f269c0 10 monclient: init 2024-09-14T11:36:06.732 INFO:tasks.workunit.client.0.smithi138.stderr: -240> 2024-09-14T11:36:06.310+0000 7f9b22f269c0 5 AuthRegistry(0x5650069dbc70) adding auth protocol: cephx 2024-09-14T11:36:06.732 INFO:tasks.workunit.client.0.smithi138.stderr: -239> 2024-09-14T11:36:06.310+0000 7f9b22f269c0 5 AuthRegistry(0x5650069dbc70) adding auth protocol: cephx 2024-09-14T11:36:06.733 INFO:tasks.workunit.client.0.smithi138.stderr: -238> 2024-09-14T11:36:06.310+0000 7f9b22f269c0 5 AuthRegistry(0x5650069dbc70) adding auth protocol: cephx 2024-09-14T11:36:06.733 INFO:tasks.workunit.client.0.smithi138.stderr: -237> 2024-09-14T11:36:06.310+0000 7f9b22f269c0 5 AuthRegistry(0x5650069dbc70) adding con mode: secure 2024-09-14T11:36:06.733 INFO:tasks.workunit.client.0.smithi138.stderr: -236> 2024-09-14T11:36:06.310+0000 7f9b22f269c0 5 AuthRegistry(0x5650069dbc70) adding con mode: crc 2024-09-14T11:36:06.733 INFO:tasks.workunit.client.0.smithi138.stderr: -235> 2024-09-14T11:36:06.310+0000 7f9b22f269c0 5 AuthRegistry(0x5650069dbc70) adding con mode: secure 2024-09-14T11:36:06.733 INFO:tasks.workunit.client.0.smithi138.stderr: -234> 2024-09-14T11:36:06.310+0000 7f9b22f269c0 5 AuthRegistry(0x5650069dbc70) adding con mode: crc 2024-09-14T11:36:06.733 INFO:tasks.workunit.client.0.smithi138.stderr: -233> 2024-09-14T11:36:06.310+0000 7f9b22f269c0 5 AuthRegistry(0x5650069dbc70) adding con mode: secure 2024-09-14T11:36:06.733 INFO:tasks.workunit.client.0.smithi138.stderr: -232> 2024-09-14T11:36:06.310+0000 7f9b22f269c0 5 AuthRegistry(0x5650069dbc70) adding con mode: crc 2024-09-14T11:36:06.733 INFO:tasks.workunit.client.0.smithi138.stderr: -231> 2024-09-14T11:36:06.310+0000 7f9b22f269c0 5 AuthRegistry(0x5650069dbc70) adding con mode: crc 2024-09-14T11:36:06.733 INFO:tasks.workunit.client.0.smithi138.stderr: -230> 2024-09-14T11:36:06.310+0000 7f9b22f269c0 5 AuthRegistry(0x5650069dbc70) adding con mode: secure 2024-09-14T11:36:06.733 INFO:tasks.workunit.client.0.smithi138.stderr: -229> 2024-09-14T11:36:06.310+0000 7f9b22f269c0 5 AuthRegistry(0x5650069dbc70) adding con mode: crc 2024-09-14T11:36:06.733 INFO:tasks.workunit.client.0.smithi138.stderr: -228> 2024-09-14T11:36:06.310+0000 7f9b22f269c0 5 AuthRegistry(0x5650069dbc70) adding con mode: secure 2024-09-14T11:36:06.733 INFO:tasks.workunit.client.0.smithi138.stderr: -227> 2024-09-14T11:36:06.310+0000 7f9b22f269c0 5 AuthRegistry(0x5650069dbc70) adding con mode: crc 2024-09-14T11:36:06.733 INFO:tasks.workunit.client.0.smithi138.stderr: -226> 2024-09-14T11:36:06.310+0000 7f9b22f269c0 5 AuthRegistry(0x5650069dbc70) adding con mode: secure 2024-09-14T11:36:06.733 INFO:tasks.workunit.client.0.smithi138.stderr: -225> 2024-09-14T11:36:06.314+0000 7f9b22f269c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:36:06.733 INFO:tasks.workunit.client.0.smithi138.stderr: -224> 2024-09-14T11:36:06.314+0000 7f9b22f269c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:36:06.734 INFO:tasks.workunit.client.0.smithi138.stderr: -223> 2024-09-14T11:36:06.314+0000 7f9b22f269c0 5 asok(0x56500674dd90) register_command rotate-key cmddesc rotate-key hook 0x5650069dbdb8 EEXIST 2024-09-14T11:36:06.734 INFO:tasks.workunit.client.0.smithi138.stderr: -222> 2024-09-14T11:36:06.314+0000 7f9b22f269c0 10 monclient: _reopen_session rank -1 2024-09-14T11:36:06.734 INFO:tasks.workunit.client.0.smithi138.stderr: -221> 2024-09-14T11:36:06.314+0000 7f9b22f269c0 10 monclient: _add_conns ranks=[1,2,0] 2024-09-14T11:36:06.734 INFO:tasks.workunit.client.0.smithi138.stderr: -220> 2024-09-14T11:36:06.314+0000 7f9b22f269c0 10 monclient(hunting): picked mon.noname-b con 0x5650069f7b40 addr [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] 2024-09-14T11:36:06.734 INFO:tasks.workunit.client.0.smithi138.stderr: -219> 2024-09-14T11:36:06.314+0000 7f9b22f269c0 10 monclient(hunting): picked mon.noname-c con 0x565006a26b80 addr [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] 2024-09-14T11:36:06.734 INFO:tasks.workunit.client.0.smithi138.stderr: -218> 2024-09-14T11:36:06.314+0000 7f9b22f269c0 10 monclient(hunting): picked mon.noname-a con 0x565006a24270 addr [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] 2024-09-14T11:36:06.734 INFO:tasks.workunit.client.0.smithi138.stderr: -217> 2024-09-14T11:36:06.314+0000 7f9b22f269c0 10 monclient(hunting): start opening mon connection 2024-09-14T11:36:06.734 INFO:tasks.workunit.client.0.smithi138.stderr: -216> 2024-09-14T11:36:06.314+0000 7f9b22f269c0 10 monclient(hunting): start opening mon connection 2024-09-14T11:36:06.734 INFO:tasks.workunit.client.0.smithi138.stderr: -215> 2024-09-14T11:36:06.314+0000 7f9b22f269c0 10 monclient(hunting): start opening mon connection 2024-09-14T11:36:06.734 INFO:tasks.workunit.client.0.smithi138.stderr: -214> 2024-09-14T11:36:06.314+0000 7f9b22f269c0 10 monclient(hunting): _renew_subs 2024-09-14T11:36:06.734 INFO:tasks.workunit.client.0.smithi138.stderr: -213> 2024-09-14T11:36:06.314+0000 7f9b22f269c0 10 monclient(hunting): authenticate will time out at 2702.276491s 2024-09-14T11:36:06.734 INFO:tasks.workunit.client.0.smithi138.stderr: -212> 2024-09-14T11:36:06.314+0000 7f9b20a2c640 10 monclient(hunting): get_auth_request con 0x565006a24270 auth_method 0 2024-09-14T11:36:06.734 INFO:tasks.workunit.client.0.smithi138.stderr: -211> 2024-09-14T11:36:06.314+0000 7f9b20a2c640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:36:06.735 INFO:tasks.workunit.client.0.smithi138.stderr: -210> 2024-09-14T11:36:06.314+0000 7f9b20a2c640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:36:06.735 INFO:tasks.workunit.client.0.smithi138.stderr: -209> 2024-09-14T11:36:06.314+0000 7f9b20a2c640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:36:06.735 INFO:tasks.workunit.client.0.smithi138.stderr: -208> 2024-09-14T11:36:06.314+0000 7f9b2122d640 10 monclient(hunting): get_auth_request con 0x565006a26b80 auth_method 0 2024-09-14T11:36:06.735 INFO:tasks.workunit.client.0.smithi138.stderr: -207> 2024-09-14T11:36:06.314+0000 7f9b2122d640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:36:06.735 INFO:tasks.workunit.client.0.smithi138.stderr: -206> 2024-09-14T11:36:06.314+0000 7f9b2122d640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:36:06.735 INFO:tasks.workunit.client.0.smithi138.stderr: -205> 2024-09-14T11:36:06.314+0000 7f9b2122d640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:36:06.735 INFO:tasks.workunit.client.0.smithi138.stderr: -204> 2024-09-14T11:36:06.314+0000 7f9b20a2c640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:36:06.735 INFO:tasks.workunit.client.0.smithi138.stderr: -203> 2024-09-14T11:36:06.314+0000 7f9b20a2c640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:36:06.735 INFO:tasks.workunit.client.0.smithi138.stderr: -202> 2024-09-14T11:36:06.314+0000 7f9b20a2c640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:36:06.735 INFO:tasks.workunit.client.0.smithi138.stderr: -201> 2024-09-14T11:36:06.314+0000 7f9b2122d640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:36:06.735 INFO:tasks.workunit.client.0.smithi138.stderr: -200> 2024-09-14T11:36:06.314+0000 7f9b2122d640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:36:06.735 INFO:tasks.workunit.client.0.smithi138.stderr: -199> 2024-09-14T11:36:06.314+0000 7f9b2122d640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:36:06.735 INFO:tasks.workunit.client.0.smithi138.stderr: -198> 2024-09-14T11:36:06.314+0000 7f9b2022b640 10 monclient(hunting): get_auth_request con 0x5650069f7b40 auth_method 0 2024-09-14T11:36:06.735 INFO:tasks.workunit.client.0.smithi138.stderr: -197> 2024-09-14T11:36:06.314+0000 7f9b2022b640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:36:06.735 INFO:tasks.workunit.client.0.smithi138.stderr: -196> 2024-09-14T11:36:06.314+0000 7f9b2022b640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:36:06.736 INFO:tasks.workunit.client.0.smithi138.stderr: -195> 2024-09-14T11:36:06.314+0000 7f9b2022b640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:36:06.736 INFO:tasks.workunit.client.0.smithi138.stderr: -194> 2024-09-14T11:36:06.314+0000 7f9b20a2c640 10 monclient(hunting): handle_auth_done global_id 7011 payload 824 2024-09-14T11:36:06.736 INFO:tasks.workunit.client.0.smithi138.stderr: -193> 2024-09-14T11:36:06.314+0000 7f9b20a2c640 10 monclient: _finish_hunting 0 2024-09-14T11:36:06.736 INFO:tasks.workunit.client.0.smithi138.stderr: -192> 2024-09-14T11:36:06.314+0000 7f9b20a2c640 1 monclient: found mon.noname-a 2024-09-14T11:36:06.736 INFO:tasks.workunit.client.0.smithi138.stderr: -191> 2024-09-14T11:36:06.314+0000 7f9b20a2c640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.138:3300/0 2024-09-14T11:36:06.736 INFO:tasks.workunit.client.0.smithi138.stderr: -190> 2024-09-14T11:36:06.314+0000 7f99ee7fc640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:36:06.736 INFO:tasks.workunit.client.0.smithi138.stderr: -189> 2024-09-14T11:36:06.314+0000 7f99ee7fc640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-14T11:36:06.736 INFO:tasks.workunit.client.0.smithi138.stderr: -188> 2024-09-14T11:36:06.314+0000 7f99ee7fc640 10 monclient: dump: 2024-09-14T11:36:06.736 INFO:tasks.workunit.client.0.smithi138.stderr:epoch 1 2024-09-14T11:36:06.736 INFO:tasks.workunit.client.0.smithi138.stderr:fsid 3f225f43-83a6-4aeb-b798-1f04bb49d597 2024-09-14T11:36:06.736 INFO:tasks.workunit.client.0.smithi138.stderr:last_changed 2024-09-14T11:07:09.252780+0000 2024-09-14T11:36:06.736 INFO:tasks.workunit.client.0.smithi138.stderr:created 2024-09-14T11:07:09.252780+0000 2024-09-14T11:36:06.736 INFO:tasks.workunit.client.0.smithi138.stderr:min_mon_release 19 (squid) 2024-09-14T11:36:06.736 INFO:tasks.workunit.client.0.smithi138.stderr:election_strategy: 1 2024-09-14T11:36:06.737 INFO:tasks.workunit.client.0.smithi138.stderr:0: [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] mon.a 2024-09-14T11:36:06.737 INFO:tasks.workunit.client.0.smithi138.stderr:1: [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] mon.b 2024-09-14T11:36:06.737 INFO:tasks.workunit.client.0.smithi138.stderr:2: [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] mon.c 2024-09-14T11:36:06.737 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-14T11:36:06.737 INFO:tasks.workunit.client.0.smithi138.stderr: -187> 2024-09-14T11:36:06.314+0000 7f99ee7fc640 10 monclient: _finish_auth 0 2024-09-14T11:36:06.737 INFO:tasks.workunit.client.0.smithi138.stderr: -186> 2024-09-14T11:36:06.314+0000 7f99ee7fc640 10 monclient: _check_auth_tickets 2024-09-14T11:36:06.737 INFO:tasks.workunit.client.0.smithi138.stderr: -185> 2024-09-14T11:36:06.314+0000 7f99ee7fc640 10 monclient: handle_config config(0 keys) 2024-09-14T11:36:06.737 INFO:tasks.workunit.client.0.smithi138.stderr: -184> 2024-09-14T11:36:06.314+0000 7f99ee7fc640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:36:06.737 INFO:tasks.workunit.client.0.smithi138.stderr: -183> 2024-09-14T11:36:06.314+0000 7f99ee7fc640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-14T11:36:06.737 INFO:tasks.workunit.client.0.smithi138.stderr: -182> 2024-09-14T11:36:06.314+0000 7f99ee7fc640 10 monclient: dump: 2024-09-14T11:36:06.737 INFO:tasks.workunit.client.0.smithi138.stderr:epoch 1 2024-09-14T11:36:06.737 INFO:tasks.workunit.client.0.smithi138.stderr:fsid 3f225f43-83a6-4aeb-b798-1f04bb49d597 2024-09-14T11:36:06.738 INFO:tasks.workunit.client.0.smithi138.stderr:last_changed 2024-09-14T11:07:09.252780+0000 2024-09-14T11:36:06.738 INFO:tasks.workunit.client.0.smithi138.stderr:created 2024-09-14T11:07:09.252780+0000 2024-09-14T11:36:06.738 INFO:tasks.workunit.client.0.smithi138.stderr:min_mon_release 19 (squid) 2024-09-14T11:36:06.738 INFO:tasks.workunit.client.0.smithi138.stderr:election_strategy: 1 2024-09-14T11:36:06.738 INFO:tasks.workunit.client.0.smithi138.stderr:0: [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] mon.a 2024-09-14T11:36:06.738 INFO:tasks.workunit.client.0.smithi138.stderr:1: [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] mon.b 2024-09-14T11:36:06.738 INFO:tasks.workunit.client.0.smithi138.stderr:2: [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] mon.c 2024-09-14T11:36:06.738 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-14T11:36:06.738 INFO:tasks.workunit.client.0.smithi138.stderr: -181> 2024-09-14T11:36:06.314+0000 7f99effff640 4 set_mon_vals no callback set 2024-09-14T11:36:06.738 INFO:tasks.workunit.client.0.smithi138.stderr: -180> 2024-09-14T11:36:06.314+0000 7f9b22f269c0 5 monclient: authenticate success, global_id 7011 2024-09-14T11:36:06.738 INFO:tasks.workunit.client.0.smithi138.stderr: -179> 2024-09-14T11:36:06.314+0000 7f9b22f269c0 10 monclient: _renew_subs 2024-09-14T11:36:06.738 INFO:tasks.workunit.client.0.smithi138.stderr: -178> 2024-09-14T11:36:06.314+0000 7f9b22f269c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.138:3300/0 2024-09-14T11:36:06.738 INFO:tasks.workunit.client.0.smithi138.stderr: -177> 2024-09-14T11:36:06.314+0000 7f9b22f269c0 10 monclient: _renew_subs 2024-09-14T11:36:06.738 INFO:tasks.workunit.client.0.smithi138.stderr: -176> 2024-09-14T11:36:06.314+0000 7f9b22f269c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.138:3300/0 2024-09-14T11:36:06.738 INFO:tasks.workunit.client.0.smithi138.stderr: -175> 2024-09-14T11:36:06.314+0000 7f9b22f269c0 1 librados: init done 2024-09-14T11:36:06.739 INFO:tasks.workunit.client.0.smithi138.stderr: -174> 2024-09-14T11:36:06.314+0000 7f9b22f269c0 5 asok(0x56500674dd90) register_command cr dump hook 0x565006a2acc8 2024-09-14T11:36:06.739 INFO:tasks.workunit.client.0.smithi138.stderr: -173> 2024-09-14T11:36:06.314+0000 7f9b22f269c0 20 rados->read ofs=0 len=0 2024-09-14T11:36:06.739 INFO:tasks.workunit.client.0.smithi138.stderr: -172> 2024-09-14T11:36:06.314+0000 7f99ee7fc640 4 mgrc handle_mgr_map Got map version 5 2024-09-14T11:36:06.739 INFO:tasks.workunit.client.0.smithi138.stderr: -171> 2024-09-14T11:36:06.314+0000 7f99ee7fc640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.138:6832/3778043143,v1:172.21.15.138:6833/3778043143] 2024-09-14T11:36:06.739 INFO:tasks.workunit.client.0.smithi138.stderr: -170> 2024-09-14T11:36:06.314+0000 7f99ee7fc640 4 mgrc reconnect Starting new session with [v2:172.21.15.138:6832/3778043143,v1:172.21.15.138:6833/3778043143] 2024-09-14T11:36:06.739 INFO:tasks.workunit.client.0.smithi138.stderr: -169> 2024-09-14T11:36:06.314+0000 7f9b2022b640 10 monclient: get_auth_request con 0x7f99e80718a0 auth_method 0 2024-09-14T11:36:06.739 INFO:tasks.workunit.client.0.smithi138.stderr: -168> 2024-09-14T11:36:06.314+0000 7f9b2122d640 10 monclient: get_auth_request con 0x565006a40590 auth_method 0 2024-09-14T11:36:06.739 INFO:tasks.workunit.client.0.smithi138.stderr: -167> 2024-09-14T11:36:06.318+0000 7f9b22f269c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:36:06.739 INFO:tasks.workunit.client.0.smithi138.stderr: -166> 2024-09-14T11:36:06.318+0000 7f9b22f269c0 20 realm 2024-09-14T11:36:06.739 INFO:tasks.workunit.client.0.smithi138.stderr: -165> 2024-09-14T11:36:06.318+0000 7f9b22f269c0 20 rados->read ofs=0 len=0 2024-09-14T11:36:06.739 INFO:tasks.workunit.client.0.smithi138.stderr: -164> 2024-09-14T11:36:06.318+0000 7f9b22f269c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:36:06.739 INFO:tasks.workunit.client.0.smithi138.stderr: -163> 2024-09-14T11:36:06.318+0000 7f9b22f269c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:36:06.739 INFO:tasks.workunit.client.0.smithi138.stderr: -162> 2024-09-14T11:36:06.318+0000 7f9b22f269c0 20 rados->read ofs=0 len=0 2024-09-14T11:36:06.739 INFO:tasks.workunit.client.0.smithi138.stderr: -161> 2024-09-14T11:36:06.318+0000 7f9b22f269c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:36:06.740 INFO:tasks.workunit.client.0.smithi138.stderr: -160> 2024-09-14T11:36:06.318+0000 7f9b22f269c0 20 rados->read ofs=0 len=0 2024-09-14T11:36:06.740 INFO:tasks.workunit.client.0.smithi138.stderr: -159> 2024-09-14T11:36:06.318+0000 7f9b2022b640 10 monclient: get_auth_request con 0x565006a44810 auth_method 0 2024-09-14T11:36:06.740 INFO:tasks.workunit.client.0.smithi138.stderr: -158> 2024-09-14T11:36:06.318+0000 7f9b22f269c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:36:06.740 INFO:tasks.workunit.client.0.smithi138.stderr: -157> 2024-09-14T11:36:06.318+0000 7f9b22f269c0 20 rados->read ofs=0 len=0 2024-09-14T11:36:06.740 INFO:tasks.workunit.client.0.smithi138.stderr: -156> 2024-09-14T11:36:06.318+0000 7f9b2122d640 10 monclient: get_auth_request con 0x565006a48070 auth_method 0 2024-09-14T11:36:06.740 INFO:tasks.workunit.client.0.smithi138.stderr: -155> 2024-09-14T11:36:06.318+0000 7f9b22f269c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:36:06.740 INFO:tasks.workunit.client.0.smithi138.stderr: -154> 2024-09-14T11:36:06.318+0000 7f9b22f269c0 20 searching for the correct realm 2024-09-14T11:36:06.740 INFO:tasks.workunit.client.0.smithi138.stderr: -153> 2024-09-14T11:36:06.318+0000 7f9b20a2c640 10 monclient: get_auth_request con 0x565006a4cda0 auth_method 0 2024-09-14T11:36:06.740 INFO:tasks.workunit.client.0.smithi138.stderr: -152> 2024-09-14T11:36:06.322+0000 7f9b2022b640 0 -- 172.21.15.138:0/965841732 >> [v2:172.21.15.154:6808/1468088432,v1:172.21.15.154:6809/1468088432] conn(0x7f9b10058020 msgr2=0x7f9b1008b850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:36:06.740 INFO:tasks.workunit.client.0.smithi138.stderr: -151> 2024-09-14T11:36:06.526+0000 7f9b2022b640 10 monclient: get_auth_request con 0x7f9b10058020 auth_method 0 2024-09-14T11:36:06.740 INFO:tasks.workunit.client.0.smithi138.stderr: -150> 2024-09-14T11:36:06.526+0000 7f9b2122d640 10 monclient: get_auth_request con 0x7f9b18017020 auth_method 0 2024-09-14T11:36:06.740 INFO:tasks.workunit.client.0.smithi138.stderr: -149> 2024-09-14T11:36:06.534+0000 7f9b20a2c640 10 monclient: get_auth_request con 0x7f9b18063ee0 auth_method 0 2024-09-14T11:36:06.740 INFO:tasks.workunit.client.0.smithi138.stderr: -148> 2024-09-14T11:36:06.534+0000 7f9b2122d640 0 -- 172.21.15.138:0/965841732 >> [v2:172.21.15.138:6824/2633984942,v1:172.21.15.138:6825/2633984942] conn(0x565006a48070 msgr2=0x565006a4a460 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:36:06.740 INFO:tasks.workunit.client.0.smithi138.stderr: -147> 2024-09-14T11:36:06.534+0000 7f99ee7fc640 1 client.7011.objecter ms_handle_reset 0x565006a48070 session 0x565006a43ba0 osd.2 2024-09-14T11:36:06.740 INFO:tasks.workunit.client.0.smithi138.stderr: -146> 2024-09-14T11:36:06.534+0000 7f99ee7fc640 10 monclient: _renew_subs 2024-09-14T11:36:06.741 INFO:tasks.workunit.client.0.smithi138.stderr: -145> 2024-09-14T11:36:06.534+0000 7f99ee7fc640 10 monclient: _send_mon_message to mon.a at v2:172.21.15.138:3300/0 2024-09-14T11:36:06.741 INFO:tasks.workunit.client.0.smithi138.stderr: -144> 2024-09-14T11:36:06.534+0000 7f9b2122d640 10 monclient: get_auth_request con 0x7f99e8081fd0 auth_method 0 2024-09-14T11:36:06.741 INFO:tasks.workunit.client.0.smithi138.stderr: -143> 2024-09-14T11:36:06.538+0000 7f9b2022b640 10 monclient: get_auth_request con 0x7f9b1806d0d0 auth_method 0 2024-09-14T11:36:06.741 INFO:tasks.workunit.client.0.smithi138.stderr: -142> 2024-09-14T11:36:06.554+0000 7f9b22f269c0 20 RGWRados::pool_iterate: got zone_info.d9e72d30-c60b-4d0d-9267-fdc36392d5ad 2024-09-14T11:36:06.741 INFO:tasks.workunit.client.0.smithi138.stderr: -141> 2024-09-14T11:36:06.554+0000 7f9b22f269c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:36:06.741 INFO:tasks.workunit.client.0.smithi138.stderr: -140> 2024-09-14T11:36:06.554+0000 7f9b22f269c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:36:06.741 INFO:tasks.workunit.client.0.smithi138.stderr: -139> 2024-09-14T11:36:06.554+0000 7f9b22f269c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:36:06.741 INFO:tasks.workunit.client.0.smithi138.stderr: -138> 2024-09-14T11:36:06.554+0000 7f9b22f269c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:36:06.741 INFO:tasks.workunit.client.0.smithi138.stderr: -137> 2024-09-14T11:36:06.554+0000 7f9b22f269c0 20 RGWRados::pool_iterate: got zonegroup_info.65ab941b-da8c-4160-94fb-3672b069d44f 2024-09-14T11:36:06.741 INFO:tasks.workunit.client.0.smithi138.stderr: -136> 2024-09-14T11:36:06.554+0000 7f9b22f269c0 20 rados->read ofs=0 len=0 2024-09-14T11:36:06.741 INFO:tasks.workunit.client.0.smithi138.stderr: -135> 2024-09-14T11:36:06.554+0000 7f9b22f269c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:36:06.741 INFO:tasks.workunit.client.0.smithi138.stderr: -134> 2024-09-14T11:36:06.554+0000 7f9b22f269c0 20 rados->read ofs=0 len=0 2024-09-14T11:36:06.741 INFO:tasks.workunit.client.0.smithi138.stderr: -133> 2024-09-14T11:36:06.554+0000 7f9b22f269c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:36:06.741 INFO:tasks.workunit.client.0.smithi138.stderr: -132> 2024-09-14T11:36:06.554+0000 7f9b22f269c0 20 rados->read ofs=0 len=0 2024-09-14T11:36:06.741 INFO:tasks.workunit.client.0.smithi138.stderr: -131> 2024-09-14T11:36:06.554+0000 7f9b22f269c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:36:06.742 INFO:tasks.workunit.client.0.smithi138.stderr: -130> 2024-09-14T11:36:06.554+0000 7f9b22f269c0 20 zone default found 2024-09-14T11:36:06.742 INFO:tasks.workunit.client.0.smithi138.stderr: -129> 2024-09-14T11:36:06.554+0000 7f9b22f269c0 4 Realm: () 2024-09-14T11:36:06.742 INFO:tasks.workunit.client.0.smithi138.stderr: -128> 2024-09-14T11:36:06.554+0000 7f9b22f269c0 4 ZoneGroup: default (65ab941b-da8c-4160-94fb-3672b069d44f) 2024-09-14T11:36:06.742 INFO:tasks.workunit.client.0.smithi138.stderr: -127> 2024-09-14T11:36:06.554+0000 7f9b22f269c0 4 Zone: default (d9e72d30-c60b-4d0d-9267-fdc36392d5ad) 2024-09-14T11:36:06.742 INFO:tasks.workunit.client.0.smithi138.stderr: -126> 2024-09-14T11:36:06.554+0000 7f9b22f269c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:36:06.742 INFO:tasks.workunit.client.0.smithi138.stderr: -125> 2024-09-14T11:36:06.554+0000 7f9b22f269c0 20 zonegroup default 2024-09-14T11:36:06.742 INFO:tasks.workunit.client.0.smithi138.stderr: -124> 2024-09-14T11:36:06.554+0000 7f9b22f269c0 20 rados->read ofs=0 len=0 2024-09-14T11:36:06.742 INFO:tasks.workunit.client.0.smithi138.stderr: -123> 2024-09-14T11:36:06.558+0000 7f9b22f269c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:36:06.742 INFO:tasks.workunit.client.0.smithi138.stderr: -122> 2024-09-14T11:36:06.558+0000 7f9b22f269c0 20 rados->read ofs=0 len=0 2024-09-14T11:36:06.742 INFO:tasks.workunit.client.0.smithi138.stderr: -121> 2024-09-14T11:36:06.558+0000 7f9b22f269c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:36:06.742 INFO:tasks.workunit.client.0.smithi138.stderr: -120> 2024-09-14T11:36:06.558+0000 7f9b22f269c0 20 rados->read ofs=0 len=0 2024-09-14T11:36:06.742 INFO:tasks.workunit.client.0.smithi138.stderr: -119> 2024-09-14T11:36:06.558+0000 7f9b22f269c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:36:06.742 INFO:tasks.workunit.client.0.smithi138.stderr: -118> 2024-09-14T11:36:06.558+0000 7f9b22f269c0 20 started sync module instance, tier type = 2024-09-14T11:36:06.742 INFO:tasks.workunit.client.0.smithi138.stderr: -117> 2024-09-14T11:36:06.558+0000 7f9b22f269c0 20 started zone id=d9e72d30-c60b-4d0d-9267-fdc36392d5ad (name=default) with tier type = 2024-09-14T11:36:06.742 INFO:tasks.workunit.client.0.smithi138.stderr: -116> 2024-09-14T11:36:06.582+0000 7f9b22f269c0 20 add_watcher() i=0 2024-09-14T11:36:06.743 INFO:tasks.workunit.client.0.smithi138.stderr: -115> 2024-09-14T11:36:06.582+0000 7f9b22f269c0 20 add_watcher() i=1 2024-09-14T11:36:06.743 INFO:tasks.workunit.client.0.smithi138.stderr: -114> 2024-09-14T11:36:06.582+0000 7f9b22f269c0 20 add_watcher() i=2 2024-09-14T11:36:06.743 INFO:tasks.workunit.client.0.smithi138.stderr: -113> 2024-09-14T11:36:06.582+0000 7f9b22f269c0 20 add_watcher() i=3 2024-09-14T11:36:06.743 INFO:tasks.workunit.client.0.smithi138.stderr: -112> 2024-09-14T11:36:06.582+0000 7f9b22f269c0 20 add_watcher() i=4 2024-09-14T11:36:06.743 INFO:tasks.workunit.client.0.smithi138.stderr: -111> 2024-09-14T11:36:06.582+0000 7f9b22f269c0 20 add_watcher() i=5 2024-09-14T11:36:06.743 INFO:tasks.workunit.client.0.smithi138.stderr: -110> 2024-09-14T11:36:06.582+0000 7f9b22f269c0 20 add_watcher() i=6 2024-09-14T11:36:06.743 INFO:tasks.workunit.client.0.smithi138.stderr: -109> 2024-09-14T11:36:06.582+0000 7f9b22f269c0 20 add_watcher() i=7 2024-09-14T11:36:06.743 INFO:tasks.workunit.client.0.smithi138.stderr: -108> 2024-09-14T11:36:06.582+0000 7f9b22f269c0 2 all 8 watchers are set, enabling cache 2024-09-14T11:36:06.743 INFO:tasks.workunit.client.0.smithi138.stderr: -107> 2024-09-14T11:36:06.586+0000 7f9b22f269c0 5 AuthRegistry(0x7fffceb3ec10) adding auth protocol: cephx 2024-09-14T11:36:06.743 INFO:tasks.workunit.client.0.smithi138.stderr: -106> 2024-09-14T11:36:06.586+0000 7f9b22f269c0 5 AuthRegistry(0x7fffceb3ec10) adding auth protocol: cephx 2024-09-14T11:36:06.743 INFO:tasks.workunit.client.0.smithi138.stderr: -105> 2024-09-14T11:36:06.586+0000 7f9b22f269c0 5 AuthRegistry(0x7fffceb3ec10) adding auth protocol: cephx 2024-09-14T11:36:06.743 INFO:tasks.workunit.client.0.smithi138.stderr: -104> 2024-09-14T11:36:06.586+0000 7f9b22f269c0 5 AuthRegistry(0x7fffceb3ec10) adding con mode: secure 2024-09-14T11:36:06.743 INFO:tasks.workunit.client.0.smithi138.stderr: -103> 2024-09-14T11:36:06.586+0000 7f9b22f269c0 5 AuthRegistry(0x7fffceb3ec10) adding con mode: crc 2024-09-14T11:36:06.743 INFO:tasks.workunit.client.0.smithi138.stderr: -102> 2024-09-14T11:36:06.586+0000 7f9b22f269c0 5 AuthRegistry(0x7fffceb3ec10) adding con mode: secure 2024-09-14T11:36:06.744 INFO:tasks.workunit.client.0.smithi138.stderr: -101> 2024-09-14T11:36:06.586+0000 7f9b22f269c0 5 AuthRegistry(0x7fffceb3ec10) adding con mode: crc 2024-09-14T11:36:06.744 INFO:tasks.workunit.client.0.smithi138.stderr: -100> 2024-09-14T11:36:06.586+0000 7f9b22f269c0 5 AuthRegistry(0x7fffceb3ec10) adding con mode: secure 2024-09-14T11:36:06.744 INFO:tasks.workunit.client.0.smithi138.stderr: -99> 2024-09-14T11:36:06.586+0000 7f9b22f269c0 5 AuthRegistry(0x7fffceb3ec10) adding con mode: crc 2024-09-14T11:36:06.744 INFO:tasks.workunit.client.0.smithi138.stderr: -98> 2024-09-14T11:36:06.586+0000 7f9b22f269c0 5 AuthRegistry(0x7fffceb3ec10) adding con mode: crc 2024-09-14T11:36:06.744 INFO:tasks.workunit.client.0.smithi138.stderr: -97> 2024-09-14T11:36:06.586+0000 7f9b22f269c0 5 AuthRegistry(0x7fffceb3ec10) adding con mode: secure 2024-09-14T11:36:06.744 INFO:tasks.workunit.client.0.smithi138.stderr: -96> 2024-09-14T11:36:06.586+0000 7f99d2fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:36:06.744 INFO:tasks.workunit.client.0.smithi138.stderr: -95> 2024-09-14T11:36:06.586+0000 7f9b22f269c0 5 AuthRegistry(0x7fffceb3ec10) adding con mode: crc 2024-09-14T11:36:06.744 INFO:tasks.workunit.client.0.smithi138.stderr: -94> 2024-09-14T11:36:06.586+0000 7f9b22f269c0 5 AuthRegistry(0x7fffceb3ec10) adding con mode: secure 2024-09-14T11:36:06.744 INFO:tasks.workunit.client.0.smithi138.stderr: -93> 2024-09-14T11:36:06.586+0000 7f9b22f269c0 5 AuthRegistry(0x7fffceb3ec10) adding con mode: crc 2024-09-14T11:36:06.744 INFO:tasks.workunit.client.0.smithi138.stderr: -92> 2024-09-14T11:36:06.586+0000 7f9b22f269c0 5 AuthRegistry(0x7fffceb3ec10) adding con mode: secure 2024-09-14T11:36:06.744 INFO:tasks.workunit.client.0.smithi138.stderr: -91> 2024-09-14T11:36:06.586+0000 7f9b22f269c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:36:06.744 INFO:tasks.workunit.client.0.smithi138.stderr: -90> 2024-09-14T11:36:06.586+0000 7f9b22f269c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:36:06.744 INFO:tasks.workunit.client.0.smithi138.stderr: -89> 2024-09-14T11:36:06.586+0000 7f9b22f269c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:36:06.744 INFO:tasks.workunit.client.0.smithi138.stderr: -88> 2024-09-14T11:36:06.586+0000 7f9b22f269c0 5 asok(0x56500674dd90) register_command cache list hook 0x5650069f56f0 2024-09-14T11:36:06.745 INFO:tasks.workunit.client.0.smithi138.stderr: -87> 2024-09-14T11:36:06.586+0000 7f9b22f269c0 5 asok(0x56500674dd90) register_command cache inspect hook 0x5650069f56f0 2024-09-14T11:36:06.745 INFO:tasks.workunit.client.0.smithi138.stderr: -86> 2024-09-14T11:36:06.586+0000 7f9b22f269c0 5 asok(0x56500674dd90) register_command cache erase hook 0x5650069f56f0 2024-09-14T11:36:06.745 INFO:tasks.workunit.client.0.smithi138.stderr: -85> 2024-09-14T11:36:06.586+0000 7f9b22f269c0 5 asok(0x56500674dd90) register_command cache zap hook 0x5650069f56f0 2024-09-14T11:36:06.745 INFO:tasks.workunit.client.0.smithi138.stderr: -84> 2024-09-14T11:36:06.586+0000 7f9b22f269c0 5 note: GC not initialized 2024-09-14T11:36:06.745 INFO:tasks.workunit.client.0.smithi138.stderr: -83> 2024-09-14T11:36:06.586+0000 7f99d1fe3640 20 reqs_thread_entry: start 2024-09-14T11:36:06.745 INFO:tasks.workunit.client.0.smithi138.stderr: -82> 2024-09-14T11:36:06.586+0000 7f9b22f269c0 5 asok(0x56500674dd90) register_command sync trace show hook 0x7f9b140c74b0 2024-09-14T11:36:06.745 INFO:tasks.workunit.client.0.smithi138.stderr: -81> 2024-09-14T11:36:06.586+0000 7f9b22f269c0 5 asok(0x56500674dd90) register_command sync trace history hook 0x7f9b140c74b0 2024-09-14T11:36:06.745 INFO:tasks.workunit.client.0.smithi138.stderr: -80> 2024-09-14T11:36:06.586+0000 7f9b22f269c0 5 asok(0x56500674dd90) register_command sync trace active hook 0x7f9b140c74b0 2024-09-14T11:36:06.745 INFO:tasks.workunit.client.0.smithi138.stderr: -79> 2024-09-14T11:36:06.586+0000 7f9b22f269c0 5 asok(0x56500674dd90) register_command sync trace active_short hook 0x7f9b140c74b0 2024-09-14T11:36:06.745 INFO:tasks.workunit.client.0.smithi138.stderr: -78> 2024-09-14T11:36:06.586+0000 7f9b22f269c0 20 init_complete bucket index max shards: 11 2024-09-14T11:36:06.745 INFO:tasks.workunit.client.0.smithi138.stderr: -77> 2024-09-14T11:36:06.586+0000 7f9b22f269c0 20 Filter name: none 2024-09-14T11:36:06.745 INFO:tasks.workunit.client.0.smithi138.stderr: -76> 2024-09-14T11:36:06.590+0000 7f99437fe640 20 reqs_thread_entry: start 2024-09-14T11:36:06.745 INFO:tasks.workunit.client.0.smithi138.stderr: -75> 2024-09-14T11:36:06.590+0000 7f9b22f269c0 10 cache get: name=default.rgw.meta+root+abort-at-block-writes : miss 2024-09-14T11:36:06.745 INFO:tasks.workunit.client.0.smithi138.stderr: -74> 2024-09-14T11:36:06.590+0000 7f9b22f269c0 20 rados->read ofs=0 len=0 2024-09-14T11:36:06.745 INFO:tasks.workunit.client.0.smithi138.stderr: -73> 2024-09-14T11:36:06.590+0000 7f9b22f269c0 20 rados_obj.operate() r=0 bl.length=189 2024-09-14T11:36:06.746 INFO:tasks.workunit.client.0.smithi138.stderr: -72> 2024-09-14T11:36:06.590+0000 7f9b22f269c0 10 cache put: name=default.rgw.meta+root+abort-at-block-writes info.flags=0x11 2024-09-14T11:36:06.746 INFO:tasks.workunit.client.0.smithi138.stderr: -71> 2024-09-14T11:36:06.590+0000 7f9b22f269c0 10 adding default.rgw.meta+root+abort-at-block-writes to cache LRU end 2024-09-14T11:36:06.746 INFO:tasks.workunit.client.0.smithi138.stderr: -70> 2024-09-14T11:36:06.590+0000 7f9b22f269c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.29 : miss 2024-09-14T11:36:06.746 INFO:tasks.workunit.client.0.smithi138.stderr: -69> 2024-09-14T11:36:06.590+0000 7f9b22f269c0 20 rados->read ofs=0 len=0 2024-09-14T11:36:06.746 INFO:tasks.workunit.client.0.smithi138.stderr: -68> 2024-09-14T11:36:06.590+0000 7f9b22f269c0 20 rados_obj.operate() r=0 bl.length=411 2024-09-14T11:36:06.746 INFO:tasks.workunit.client.0.smithi138.stderr: -67> 2024-09-14T11:36:06.590+0000 7f9b22f269c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.29 info.flags=0x17 2024-09-14T11:36:06.746 INFO:tasks.workunit.client.0.smithi138.stderr: -66> 2024-09-14T11:36:06.590+0000 7f9b22f269c0 10 adding default.rgw.meta+root+.bucket.meta.abort-at-block-writes:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.29 to cache LRU end 2024-09-14T11:36:06.746 INFO:tasks.workunit.client.0.smithi138.stderr: -65> 2024-09-14T11:36:06.590+0000 7f9b22f269c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:36:06.746 INFO:tasks.workunit.client.0.smithi138.stderr: -64> 2024-09-14T11:36:06.590+0000 7f9b22f269c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:36:06.746 INFO:tasks.workunit.client.0.smithi138.stderr: -63> 2024-09-14T11:36:06.590+0000 7f9b22f269c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.29 2024-09-14T11:36:06.746 INFO:tasks.workunit.client.0.smithi138.stderr: -62> 2024-09-14T11:36:06.602+0000 7f9b22f269c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.29 info.flags=0x17 2024-09-14T11:36:06.746 INFO:tasks.workunit.client.0.smithi138.stderr: -61> 2024-09-14T11:36:06.602+0000 7f9b22f269c0 10 moving default.rgw.meta+root+.bucket.meta.abort-at-block-writes:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.29 to cache LRU end 2024-09-14T11:36:06.746 INFO:tasks.workunit.client.0.smithi138.stderr: -60> 2024-09-14T11:36:06.602+0000 7f9b22f269c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:36:06.746 INFO:tasks.workunit.client.0.smithi138.stderr: -59> 2024-09-14T11:36:06.602+0000 7f9b22f269c0 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-block-writes:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.29, ofs0, ns] 2024-09-14T11:36:06.746 INFO:tasks.workunit.client.0.smithi138.stderr: -58> 2024-09-14T11:36:06.602+0000 7f99effff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366227 cookie 94901708849344 notifier 7011 bl.length()=915 2024-09-14T11:36:06.747 INFO:tasks.workunit.client.0.smithi138.stderr: -57> 2024-09-14T11:36:06.602+0000 7f99effff640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.29 info.flags=0x17 2024-09-14T11:36:06.747 INFO:tasks.workunit.client.0.smithi138.stderr: -56> 2024-09-14T11:36:06.602+0000 7f99effff640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-block-writes:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.29 to cache LRU end 2024-09-14T11:36:06.747 INFO:tasks.workunit.client.0.smithi138.stderr: -55> 2024-09-14T11:36:06.602+0000 7f99effff640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:36:06.747 INFO:tasks.workunit.client.0.smithi138.stderr: -54> 2024-09-14T11:36:06.606+0000 7f9b22f269c0 20 handle_bi_update(): bucket=:abort-at-block-writes[d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.29]): orig_sources= new_sources= 2024-09-14T11:36:06.747 INFO:tasks.workunit.client.0.smithi138.stderr: -53> 2024-09-14T11:36:06.606+0000 7f9b22f269c0 20 handle_bi_update(): bucket=:abort-at-block-writes[d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.29]): potential sources added=[] removed=[] 2024-09-14T11:36:06.747 INFO:tasks.workunit.client.0.smithi138.stderr: -52> 2024-09-14T11:36:06.606+0000 7f9b22f269c0 20 handle_bi_update(): bucket=:abort-at-block-writes[d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.29]): orig_dests= new_dests= 2024-09-14T11:36:06.747 INFO:tasks.workunit.client.0.smithi138.stderr: -51> 2024-09-14T11:36:06.606+0000 7f9b22f269c0 20 handle_bi_update(): bucket=:abort-at-block-writes[d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.29]): potential dests added=[] removed=[] 2024-09-14T11:36:06.747 INFO:tasks.workunit.client.0.smithi138.stderr: -50> 2024-09-14T11:36:06.618+0000 7f9b22f269c0 10 bucket_obj is .dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.29.1.0 2024-09-14T11:36:06.747 INFO:tasks.workunit.client.0.smithi138.stderr: -49> 2024-09-14T11:36:06.618+0000 7f9b22f269c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.29.1.0 2024-09-14T11:36:06.747 INFO:tasks.workunit.client.0.smithi138.stderr: -48> 2024-09-14T11:36:06.618+0000 7f9b22f269c0 10 bucket_obj is .dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.29.1.1 2024-09-14T11:36:06.747 INFO:tasks.workunit.client.0.smithi138.stderr: -47> 2024-09-14T11:36:06.618+0000 7f9b22f269c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.29.1.1 2024-09-14T11:36:06.747 INFO:tasks.workunit.client.0.smithi138.stderr: -46> 2024-09-14T11:36:06.618+0000 7f9b22f269c0 10 bucket_obj is .dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.29.1.2 2024-09-14T11:36:06.747 INFO:tasks.workunit.client.0.smithi138.stderr: -45> 2024-09-14T11:36:06.618+0000 7f9b22f269c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.29.1.2 2024-09-14T11:36:06.747 INFO:tasks.workunit.client.0.smithi138.stderr: -44> 2024-09-14T11:36:06.618+0000 7f9b22f269c0 10 bucket_obj is .dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.29.1.3 2024-09-14T11:36:06.748 INFO:tasks.workunit.client.0.smithi138.stderr: -43> 2024-09-14T11:36:06.618+0000 7f9b22f269c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.29.1.3 2024-09-14T11:36:06.748 INFO:tasks.workunit.client.0.smithi138.stderr: -42> 2024-09-14T11:36:06.618+0000 7f9b22f269c0 10 bucket_obj is .dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.29.1.4 2024-09-14T11:36:06.748 INFO:tasks.workunit.client.0.smithi138.stderr: -41> 2024-09-14T11:36:06.618+0000 7f9b22f269c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.29.1.4 2024-09-14T11:36:06.748 INFO:tasks.workunit.client.0.smithi138.stderr: -40> 2024-09-14T11:36:06.618+0000 7f9b22f269c0 10 bucket_obj is .dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.29.1.5 2024-09-14T11:36:06.748 INFO:tasks.workunit.client.0.smithi138.stderr: -39> 2024-09-14T11:36:06.618+0000 7f9b22f269c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.29.1.5 2024-09-14T11:36:06.748 INFO:tasks.workunit.client.0.smithi138.stderr: -38> 2024-09-14T11:36:06.618+0000 7f9b22f269c0 10 bucket_obj is .dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.29.1.6 2024-09-14T11:36:06.748 INFO:tasks.workunit.client.0.smithi138.stderr: -37> 2024-09-14T11:36:06.618+0000 7f9b22f269c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.29.1.6 2024-09-14T11:36:06.748 INFO:tasks.workunit.client.0.smithi138.stderr: -36> 2024-09-14T11:36:06.618+0000 7f9b22f269c0 10 bucket_obj is .dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.29.1.7 2024-09-14T11:36:06.748 INFO:tasks.workunit.client.0.smithi138.stderr: -35> 2024-09-14T11:36:06.618+0000 7f9b22f269c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.29.1.7 2024-09-14T11:36:06.748 INFO:tasks.workunit.client.0.smithi138.stderr: -34> 2024-09-14T11:36:06.618+0000 7f9b22f269c0 10 bucket_obj is .dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.29.1.8 2024-09-14T11:36:06.748 INFO:tasks.workunit.client.0.smithi138.stderr: -33> 2024-09-14T11:36:06.618+0000 7f9b22f269c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.29.1.8 2024-09-14T11:36:06.748 INFO:tasks.workunit.client.0.smithi138.stderr: -32> 2024-09-14T11:36:06.618+0000 7f9b22f269c0 10 bucket_obj is .dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.29.1.9 2024-09-14T11:36:06.748 INFO:tasks.workunit.client.0.smithi138.stderr: -31> 2024-09-14T11:36:06.618+0000 7f9b22f269c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.29.1.9 2024-09-14T11:36:06.748 INFO:tasks.workunit.client.0.smithi138.stderr: -30> 2024-09-14T11:36:06.618+0000 7f9b22f269c0 10 bucket_obj is .dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.29.1.10 2024-09-14T11:36:06.749 INFO:tasks.workunit.client.0.smithi138.stderr: -29> 2024-09-14T11:36:06.618+0000 7f9b22f269c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.29.1.10 2024-09-14T11:36:06.749 INFO:tasks.workunit.client.0.smithi138.stderr: -28> 2024-09-14T11:36:06.618+0000 7f9b22f269c0 10 bucket_obj is .dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.29.1.11 2024-09-14T11:36:06.749 INFO:tasks.workunit.client.0.smithi138.stderr: -27> 2024-09-14T11:36:06.618+0000 7f9b22f269c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.29.1.11 2024-09-14T11:36:06.749 INFO:tasks.workunit.client.0.smithi138.stderr: -26> 2024-09-14T11:36:06.618+0000 7f9b22f269c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.29.0 2024-09-14T11:36:06.749 INFO:tasks.workunit.client.0.smithi138.stderr: -25> 2024-09-14T11:36:06.618+0000 7f9b22f269c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.29.1 2024-09-14T11:36:06.749 INFO:tasks.workunit.client.0.smithi138.stderr: -24> 2024-09-14T11:36:06.622+0000 7f9b22f269c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.29.2 2024-09-14T11:36:06.749 INFO:tasks.workunit.client.0.smithi138.stderr: -23> 2024-09-14T11:36:06.622+0000 7f9b22f269c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.29.3 2024-09-14T11:36:06.749 INFO:tasks.workunit.client.0.smithi138.stderr: -22> 2024-09-14T11:36:06.626+0000 7f9b22f269c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.29.4 2024-09-14T11:36:06.749 INFO:tasks.workunit.client.0.smithi138.stderr: -21> 2024-09-14T11:36:06.626+0000 7f9b22f269c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.29.5 2024-09-14T11:36:06.749 INFO:tasks.workunit.client.0.smithi138.stderr: -20> 2024-09-14T11:36:06.626+0000 7f9b22f269c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.29.6 2024-09-14T11:36:06.749 INFO:tasks.workunit.client.0.smithi138.stderr: -19> 2024-09-14T11:36:06.630+0000 7f9b22f269c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.29.7 2024-09-14T11:36:06.749 INFO:tasks.workunit.client.0.smithi138.stderr: -18> 2024-09-14T11:36:06.630+0000 7f9b22f269c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.29.8 2024-09-14T11:36:06.749 INFO:tasks.workunit.client.0.smithi138.stderr: -17> 2024-09-14T11:36:06.630+0000 7f9b22f269c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.29.9 2024-09-14T11:36:06.749 INFO:tasks.workunit.client.0.smithi138.stderr: -16> 2024-09-14T11:36:06.630+0000 7f9b22f269c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.29.10 2024-09-14T11:36:06.749 INFO:tasks.workunit.client.0.smithi138.stderr: -15> 2024-09-14T11:36:06.638+0000 7f9b22f269c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.29 : hit (requested=0x17, cached=0x17) 2024-09-14T11:36:06.750 INFO:tasks.workunit.client.0.smithi138.stderr: -14> 2024-09-14T11:36:06.638+0000 7f9b22f269c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.29 2024-09-14T11:36:06.750 INFO:tasks.workunit.client.0.smithi138.stderr: -13> 2024-09-14T11:36:06.642+0000 7f9b22f269c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.29 info.flags=0x17 2024-09-14T11:36:06.750 INFO:tasks.workunit.client.0.smithi138.stderr: -12> 2024-09-14T11:36:06.642+0000 7f9b22f269c0 10 moving default.rgw.meta+root+.bucket.meta.abort-at-block-writes:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.29 to cache LRU end 2024-09-14T11:36:06.750 INFO:tasks.workunit.client.0.smithi138.stderr: -11> 2024-09-14T11:36:06.642+0000 7f9b22f269c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:36:06.750 INFO:tasks.workunit.client.0.smithi138.stderr: -10> 2024-09-14T11:36:06.642+0000 7f9b22f269c0 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-block-writes:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.29, ofs0, ns] 2024-09-14T11:36:06.750 INFO:tasks.workunit.client.0.smithi138.stderr: -9> 2024-09-14T11:36:06.642+0000 7f99effff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366228 cookie 94901708849344 notifier 7011 bl.length()=915 2024-09-14T11:36:06.750 INFO:tasks.workunit.client.0.smithi138.stderr: -8> 2024-09-14T11:36:06.642+0000 7f99effff640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.29 info.flags=0x17 2024-09-14T11:36:06.750 INFO:tasks.workunit.client.0.smithi138.stderr: -7> 2024-09-14T11:36:06.642+0000 7f99effff640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-block-writes:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.29 to cache LRU end 2024-09-14T11:36:06.750 INFO:tasks.workunit.client.0.smithi138.stderr: -6> 2024-09-14T11:36:06.642+0000 7f99effff640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:36:06.750 INFO:tasks.workunit.client.0.smithi138.stderr: -5> 2024-09-14T11:36:06.646+0000 7f9b22f269c0 20 handle_bi_update(): bucket=:abort-at-block-writes[d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.29]): orig_sources= new_sources= 2024-09-14T11:36:06.750 INFO:tasks.workunit.client.0.smithi138.stderr: -4> 2024-09-14T11:36:06.646+0000 7f9b22f269c0 20 handle_bi_update(): bucket=:abort-at-block-writes[d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.29]): potential sources added=[] removed=[] 2024-09-14T11:36:06.750 INFO:tasks.workunit.client.0.smithi138.stderr: -3> 2024-09-14T11:36:06.646+0000 7f9b22f269c0 20 handle_bi_update(): bucket=:abort-at-block-writes[d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.29]): orig_dests= new_dests= 2024-09-14T11:36:06.750 INFO:tasks.workunit.client.0.smithi138.stderr: -2> 2024-09-14T11:36:06.646+0000 7f9b22f269c0 20 handle_bi_update(): bucket=:abort-at-block-writes[d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.29]): potential dests added=[] removed=[] 2024-09-14T11:36:06.750 INFO:tasks.workunit.client.0.smithi138.stderr: -1> 2024-09-14T11:36:06.646+0000 7f9b22f269c0 -1 ./src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f9b22f269c0 time 2024-09-14T11:36:06.649119+0000 2024-09-14T11:36:06.751 INFO:tasks.workunit.client.0.smithi138.stderr:./src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-14T11:36:06.751 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-14T11:36:06.751 INFO:tasks.workunit.client.0.smithi138.stderr: ceph version 19.3.0-4907-ga2782315 (a2782315255a3e7d5f6cdc9eb35785187ff6ddf8) squid (dev) 2024-09-14T11:36:06.751 INFO:tasks.workunit.client.0.smithi138.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x121) [0x7f9b268002eb] 2024-09-14T11:36:06.751 INFO:tasks.workunit.client.0.smithi138.stderr: 2: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7f9b2680049f] 2024-09-14T11:36:06.751 INFO:tasks.workunit.client.0.smithi138.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x565003dd5c01] 2024-09-14T11:36:06.751 INFO:tasks.workunit.client.0.smithi138.stderr: 4: (RGWBucketReshard::do_reshard(rgw::bucket_index_layout_generation const&, rgw::bucket_index_layout_generation const&, int, bool, bool, std::ostream*, ceph::Formatter*, FaultInjector > >&, DoutPrefixProvider const*, optional_yield)+0x147b) [0x565003dea29b] 2024-09-14T11:36:06.751 INFO:tasks.workunit.client.0.smithi138.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0xac4) [0x565003deb884] 2024-09-14T11:36:06.751 INFO:tasks.workunit.client.0.smithi138.stderr: 6: main() 2024-09-14T11:36:06.751 INFO:tasks.workunit.client.0.smithi138.stderr: 7: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7f9b25666d90] 2024-09-14T11:36:06.751 INFO:tasks.workunit.client.0.smithi138.stderr: 8: __libc_start_main() 2024-09-14T11:36:06.751 INFO:tasks.workunit.client.0.smithi138.stderr: 9: _start() 2024-09-14T11:36:06.751 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-14T11:36:06.751 INFO:tasks.workunit.client.0.smithi138.stderr: 0> 2024-09-14T11:36:06.646+0000 7f9b22f269c0 -1 *** Caught signal (Aborted) ** 2024-09-14T11:36:06.751 INFO:tasks.workunit.client.0.smithi138.stderr: in thread 7f9b22f269c0 thread_name:radosgw-admin 2024-09-14T11:36:06.752 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-14T11:36:06.752 INFO:tasks.workunit.client.0.smithi138.stderr: ceph version 19.3.0-4907-ga2782315 (a2782315255a3e7d5f6cdc9eb35785187ff6ddf8) squid (dev) 2024-09-14T11:36:06.752 INFO:tasks.workunit.client.0.smithi138.stderr: 1: /lib/x86_64-linux-gnu/libc.so.6(+0x42520) [0x7f9b2567f520] 2024-09-14T11:36:06.752 INFO:tasks.workunit.client.0.smithi138.stderr: 2: pthread_kill() 2024-09-14T11:36:06.752 INFO:tasks.workunit.client.0.smithi138.stderr: 3: raise() 2024-09-14T11:36:06.752 INFO:tasks.workunit.client.0.smithi138.stderr: 4: abort() 2024-09-14T11:36:06.752 INFO:tasks.workunit.client.0.smithi138.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x17b) [0x7f9b26800345] 2024-09-14T11:36:06.752 INFO:tasks.workunit.client.0.smithi138.stderr: 6: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7f9b2680049f] 2024-09-14T11:36:06.752 INFO:tasks.workunit.client.0.smithi138.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x565003dd5c01] 2024-09-14T11:36:06.752 INFO:tasks.workunit.client.0.smithi138.stderr: 8: (RGWBucketReshard::do_reshard(rgw::bucket_index_layout_generation const&, rgw::bucket_index_layout_generation const&, int, bool, bool, std::ostream*, ceph::Formatter*, FaultInjector > >&, DoutPrefixProvider const*, optional_yield)+0x147b) [0x565003dea29b] 2024-09-14T11:36:06.752 INFO:tasks.workunit.client.0.smithi138.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0xac4) [0x565003deb884] 2024-09-14T11:36:06.752 INFO:tasks.workunit.client.0.smithi138.stderr: 10: main() 2024-09-14T11:36:06.752 INFO:tasks.workunit.client.0.smithi138.stderr: 11: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7f9b25666d90] 2024-09-14T11:36:06.752 INFO:tasks.workunit.client.0.smithi138.stderr: 12: __libc_start_main() 2024-09-14T11:36:06.753 INFO:tasks.workunit.client.0.smithi138.stderr: 13: _start() 2024-09-14T11:36:06.753 INFO:tasks.workunit.client.0.smithi138.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-14T11:36:06.753 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-14T11:36:06.753 INFO:tasks.workunit.client.0.smithi138.stderr:--- logging levels --- 2024-09-14T11:36:06.753 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 none 2024-09-14T11:36:06.753 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 1 lockdep 2024-09-14T11:36:06.753 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 1 context 2024-09-14T11:36:06.753 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 1 crush 2024-09-14T11:36:06.753 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 mds 2024-09-14T11:36:06.753 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 mds_balancer 2024-09-14T11:36:06.753 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 mds_locker 2024-09-14T11:36:06.753 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 mds_log 2024-09-14T11:36:06.753 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 mds_log_expire 2024-09-14T11:36:06.753 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 mds_migrator 2024-09-14T11:36:06.753 INFO:tasks.workunit.client.0.smithi138.stderr: 3/ 5 mds_quiesce 2024-09-14T11:36:06.754 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 1 buffer 2024-09-14T11:36:06.754 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 1 timer 2024-09-14T11:36:06.754 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 1 filer 2024-09-14T11:36:06.754 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 1 striper 2024-09-14T11:36:06.754 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 1 objecter 2024-09-14T11:36:06.754 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 rados 2024-09-14T11:36:06.754 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 rbd 2024-09-14T11:36:06.754 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 rbd_mirror 2024-09-14T11:36:06.754 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 rbd_replay 2024-09-14T11:36:06.754 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 rbd_pwl 2024-09-14T11:36:06.754 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 journaler 2024-09-14T11:36:06.754 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 objectcacher 2024-09-14T11:36:06.754 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 immutable_obj_cache 2024-09-14T11:36:06.754 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 client 2024-09-14T11:36:06.755 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 osd 2024-09-14T11:36:06.755 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 optracker 2024-09-14T11:36:06.755 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 objclass 2024-09-14T11:36:06.755 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 3 filestore 2024-09-14T11:36:06.755 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 3 journal 2024-09-14T11:36:06.755 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 0 ms 2024-09-14T11:36:06.755 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 mon 2024-09-14T11:36:06.755 INFO:tasks.workunit.client.0.smithi138.stderr: 0/10 monc 2024-09-14T11:36:06.755 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 paxos 2024-09-14T11:36:06.755 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 tp 2024-09-14T11:36:06.755 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 auth 2024-09-14T11:36:06.755 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 crypto 2024-09-14T11:36:06.755 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 1 finisher 2024-09-14T11:36:06.755 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 1 reserver 2024-09-14T11:36:06.755 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 heartbeatmap 2024-09-14T11:36:06.756 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 perfcounter 2024-09-14T11:36:06.756 INFO:tasks.workunit.client.0.smithi138.stderr: 20/20 rgw 2024-09-14T11:36:06.756 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 rgw_sync 2024-09-14T11:36:06.756 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 rgw_datacache 2024-09-14T11:36:06.756 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 rgw_access 2024-09-14T11:36:06.756 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 rgw_dbstore 2024-09-14T11:36:06.756 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 rgw_flight 2024-09-14T11:36:06.756 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 rgw_lifecycle 2024-09-14T11:36:06.756 INFO:tasks.workunit.client.0.smithi138.stderr: 20/20 rgw_notification 2024-09-14T11:36:06.756 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 javaclient 2024-09-14T11:36:06.756 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 asok 2024-09-14T11:36:06.756 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 1 throttle 2024-09-14T11:36:06.756 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 0 refs 2024-09-14T11:36:06.756 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 compressor 2024-09-14T11:36:06.756 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 bluestore 2024-09-14T11:36:06.756 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 bluefs 2024-09-14T11:36:06.757 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 3 bdev 2024-09-14T11:36:06.757 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 kstore 2024-09-14T11:36:06.757 INFO:tasks.workunit.client.0.smithi138.stderr: 4/ 5 rocksdb 2024-09-14T11:36:06.757 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 fuse 2024-09-14T11:36:06.757 INFO:tasks.workunit.client.0.smithi138.stderr: 2/ 5 mgr 2024-09-14T11:36:06.757 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 mgrc 2024-09-14T11:36:06.757 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 dpdk 2024-09-14T11:36:06.757 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 eventtrace 2024-09-14T11:36:06.757 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 prioritycache 2024-09-14T11:36:06.757 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 test 2024-09-14T11:36:06.757 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 cephfs_mirror 2024-09-14T11:36:06.757 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 cephsqlite 2024-09-14T11:36:06.757 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 crimson_interrupt 2024-09-14T11:36:06.757 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 seastore 2024-09-14T11:36:06.757 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 seastore_onode 2024-09-14T11:36:06.758 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 seastore_odata 2024-09-14T11:36:06.758 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 seastore_omap 2024-09-14T11:36:06.758 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 seastore_tm 2024-09-14T11:36:06.758 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 seastore_t 2024-09-14T11:36:06.758 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 seastore_cleaner 2024-09-14T11:36:06.758 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 seastore_epm 2024-09-14T11:36:06.758 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 seastore_lba 2024-09-14T11:36:06.758 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 seastore_fixedkv_tree 2024-09-14T11:36:06.758 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 seastore_cache 2024-09-14T11:36:06.758 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 seastore_journal 2024-09-14T11:36:06.758 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 seastore_device 2024-09-14T11:36:06.758 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 seastore_backref 2024-09-14T11:36:06.758 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 alienstore 2024-09-14T11:36:06.758 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 mclock 2024-09-14T11:36:06.758 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 cyanstore 2024-09-14T11:36:06.758 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 ceph_exporter 2024-09-14T11:36:06.758 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 memstore 2024-09-14T11:36:06.759 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 trace 2024-09-14T11:36:06.759 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 ceph_dedup 2024-09-14T11:36:06.759 INFO:tasks.workunit.client.0.smithi138.stderr: -2/-2 (syslog threshold) 2024-09-14T11:36:06.759 INFO:tasks.workunit.client.0.smithi138.stderr: 99/99 (stderr threshold) 2024-09-14T11:36:06.759 INFO:tasks.workunit.client.0.smithi138.stderr:--- pthread ID / name mapping for recent threads --- 2024-09-14T11:36:06.759 INFO:tasks.workunit.client.0.smithi138.stderr: 7f99437fe640 / http_manager 2024-09-14T11:36:06.759 INFO:tasks.workunit.client.0.smithi138.stderr: 7f99d1fe3640 / http_manager 2024-09-14T11:36:06.759 INFO:tasks.workunit.client.0.smithi138.stderr: 7f99d2fe5640 / rgw_dt_lg_renew 2024-09-14T11:36:06.759 INFO:tasks.workunit.client.0.smithi138.stderr: 7f99ee7fc640 / ms_dispatch 2024-09-14T11:36:06.759 INFO:tasks.workunit.client.0.smithi138.stderr: 7f99effff640 / io_context_pool 2024-09-14T11:36:06.759 INFO:tasks.workunit.client.0.smithi138.stderr: 7f9a067fc640 / ms_dispatch 2024-09-14T11:36:06.759 INFO:tasks.workunit.client.0.smithi138.stderr: 7f9a0d60a640 / ms_dispatch 2024-09-14T11:36:06.759 INFO:tasks.workunit.client.0.smithi138.stderr: 7f9a0ee0d640 / io_context_pool 2024-09-14T11:36:06.759 INFO:tasks.workunit.client.0.smithi138.stderr: 7f9b1fa2a640 / io_context_pool 2024-09-14T11:36:06.759 INFO:tasks.workunit.client.0.smithi138.stderr: 7f9b2022b640 / msgr-worker-2 2024-09-14T11:36:06.759 INFO:tasks.workunit.client.0.smithi138.stderr: 7f9b20a2c640 / msgr-worker-1 2024-09-14T11:36:06.760 INFO:tasks.workunit.client.0.smithi138.stderr: 7f9b2122d640 / msgr-worker-0 2024-09-14T11:36:06.760 INFO:tasks.workunit.client.0.smithi138.stderr: 7f9b21a2e640 / io_context_pool 2024-09-14T11:36:06.760 INFO:tasks.workunit.client.0.smithi138.stderr: 7f9b22f269c0 / radosgw-admin 2024-09-14T11:36:06.760 INFO:tasks.workunit.client.0.smithi138.stderr: max_recent 500 2024-09-14T11:36:06.760 INFO:tasks.workunit.client.0.smithi138.stderr: max_new 1000 2024-09-14T11:36:06.760 INFO:tasks.workunit.client.0.smithi138.stderr: log_file /var/lib/ceph/crash/2024-09-14T11:36:06.651635Z_711817ef-24ea-43fc-9891-c74cc26e7dd6/log 2024-09-14T11:36:06.760 INFO:tasks.workunit.client.0.smithi138.stderr:--- end dump of recent events --- 2024-09-14T11:36:06.761 INFO:tasks.workunit.client.0.smithi138.stderr:Aborted 2024-09-14T11:36:06.761 INFO:tasks.workunit.client.0.smithi138.stderr:radosgw-admin bucket stats --bucket abort-at-block-writes 2024-09-14T11:36:06.761 INFO:tasks.workunit.client.0.smithi138.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:36:06.761 INFO:tasks.workunit.client.0.smithi138.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:36:06.762 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:06.734+0000 7f9dc53c19c0 20 rados->read ofs=0 len=0 2024-09-14T11:36:06.762 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:06.734+0000 7f9dc53c19c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:36:06.762 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:06.734+0000 7f9dc53c19c0 20 realm 2024-09-14T11:36:06.762 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:06.734+0000 7f9dc53c19c0 20 rados->read ofs=0 len=0 2024-09-14T11:36:06.762 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:06.734+0000 7f9dc53c19c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:36:06.762 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:06.734+0000 7f9dc53c19c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:36:06.762 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:06.734+0000 7f9dc53c19c0 20 rados->read ofs=0 len=0 2024-09-14T11:36:06.762 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:06.734+0000 7f9dc53c19c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:36:06.762 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:06.734+0000 7f9dc53c19c0 20 rados->read ofs=0 len=0 2024-09-14T11:36:06.762 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:06.738+0000 7f9dc53c19c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:36:06.762 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:06.738+0000 7f9dc53c19c0 20 rados->read ofs=0 len=0 2024-09-14T11:36:06.762 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:06.738+0000 7f9dc53c19c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:36:06.762 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:06.738+0000 7f9dc53c19c0 20 searching for the correct realm 2024-09-14T11:36:06.762 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:06.738+0000 7f9dc26c6640 0 -- 172.21.15.138:0/2428558425 >> [v2:172.21.15.154:6808/1468088432,v1:172.21.15.154:6809/1468088432] conn(0x7f9db401c050 msgr2=0x7f9db401e950 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:36:07.153 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:07.154+0000 7f9dc2ec7640 0 -- 172.21.15.138:0/2428558425 >> [v2:172.21.15.154:6816/1950550278,v1:172.21.15.154:6817/1950550278] conn(0x560b14f19610 msgr2=0x7f9dbc003ed0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:36:07.577 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:07.578+0000 7f9dc53c19c0 20 RGWRados::pool_iterate: got zone_info.d9e72d30-c60b-4d0d-9267-fdc36392d5ad 2024-09-14T11:36:07.577 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:07.578+0000 7f9dc53c19c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:36:07.577 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:07.578+0000 7f9dc53c19c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:36:07.577 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:07.578+0000 7f9dc53c19c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:36:07.577 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:07.578+0000 7f9dc53c19c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:36:07.577 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:07.578+0000 7f9dc53c19c0 20 RGWRados::pool_iterate: got zonegroup_info.65ab941b-da8c-4160-94fb-3672b069d44f 2024-09-14T11:36:07.577 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:07.578+0000 7f9dc53c19c0 20 rados->read ofs=0 len=0 2024-09-14T11:36:07.578 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:07.578+0000 7f9dc53c19c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:36:07.578 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:07.578+0000 7f9dc53c19c0 20 rados->read ofs=0 len=0 2024-09-14T11:36:07.578 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:07.578+0000 7f9dc53c19c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:36:07.578 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:07.578+0000 7f9dc53c19c0 20 rados->read ofs=0 len=0 2024-09-14T11:36:07.579 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:07.578+0000 7f9dc53c19c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:36:07.579 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:07.578+0000 7f9dc53c19c0 20 zone default found 2024-09-14T11:36:07.579 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:07.578+0000 7f9dc53c19c0 4 Realm: () 2024-09-14T11:36:07.579 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:07.578+0000 7f9dc53c19c0 4 ZoneGroup: default (65ab941b-da8c-4160-94fb-3672b069d44f) 2024-09-14T11:36:07.579 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:07.578+0000 7f9dc53c19c0 4 Zone: default (d9e72d30-c60b-4d0d-9267-fdc36392d5ad) 2024-09-14T11:36:07.579 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:07.578+0000 7f9dc53c19c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:36:07.579 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:07.578+0000 7f9dc53c19c0 20 zonegroup default 2024-09-14T11:36:07.579 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:07.578+0000 7f9dc53c19c0 20 rados->read ofs=0 len=0 2024-09-14T11:36:07.580 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:07.582+0000 7f9dc53c19c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:36:07.580 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:07.582+0000 7f9dc53c19c0 20 rados->read ofs=0 len=0 2024-09-14T11:36:07.580 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:07.582+0000 7f9dc53c19c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:36:07.580 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:07.582+0000 7f9dc53c19c0 20 rados->read ofs=0 len=0 2024-09-14T11:36:07.581 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:07.582+0000 7f9dc53c19c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:36:07.581 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:07.582+0000 7f9dc53c19c0 20 started sync module instance, tier type = 2024-09-14T11:36:07.581 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:07.582+0000 7f9dc53c19c0 20 started zone id=d9e72d30-c60b-4d0d-9267-fdc36392d5ad (name=default) with tier type = 2024-09-14T11:36:07.603 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:07.606+0000 7f9dc53c19c0 20 add_watcher() i=0 2024-09-14T11:36:07.603 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:07.606+0000 7f9dc53c19c0 20 add_watcher() i=1 2024-09-14T11:36:07.603 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:07.606+0000 7f9dc53c19c0 20 add_watcher() i=2 2024-09-14T11:36:07.603 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:07.606+0000 7f9dc53c19c0 20 add_watcher() i=3 2024-09-14T11:36:07.604 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:07.606+0000 7f9dc53c19c0 20 add_watcher() i=4 2024-09-14T11:36:07.604 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:07.606+0000 7f9dc53c19c0 20 add_watcher() i=5 2024-09-14T11:36:07.604 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:07.606+0000 7f9dc53c19c0 20 add_watcher() i=6 2024-09-14T11:36:07.605 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:07.606+0000 7f9dc53c19c0 20 add_watcher() i=7 2024-09-14T11:36:07.605 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:07.606+0000 7f9dc53c19c0 2 all 8 watchers are set, enabling cache 2024-09-14T11:36:07.609 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:07.610+0000 7f9c797e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:36:07.609 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:07.610+0000 7f9dc53c19c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:36:07.609 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:07.610+0000 7f9dc53c19c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:36:07.609 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:07.610+0000 7f9dc53c19c0 5 note: GC not initialized 2024-09-14T11:36:07.610 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:07.610+0000 7f9bf3fff640 20 reqs_thread_entry: start 2024-09-14T11:36:07.610 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:07.610+0000 7f9dc53c19c0 20 init_complete bucket index max shards: 11 2024-09-14T11:36:07.610 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:07.610+0000 7f9dc53c19c0 20 Filter name: none 2024-09-14T11:36:07.610 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:07.610+0000 7f9dc53c19c0 20 rados->read ofs=0 len=0 2024-09-14T11:36:07.610 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:07.610+0000 7f9bf1ffb640 20 reqs_thread_entry: start 2024-09-14T11:36:07.611 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:07.610+0000 7f9dc53c19c0 20 rados_obj.operate() r=0 bl.length=189 2024-09-14T11:36:07.611 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:07.610+0000 7f9dc53c19c0 20 rados->read ofs=0 len=0 2024-09-14T11:36:07.612 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:07.614+0000 7f9dc53c19c0 20 rados_obj.operate() r=0 bl.length=443 2024-09-14T11:36:07.612 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:07.614+0000 7f9dc53c19c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:36:07.612 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:07.614+0000 7f9dc53c19c0 20 rados->read ofs=0 len=0 2024-09-14T11:36:07.612 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:07.614+0000 7f9dc53c19c0 20 rados_obj.operate() r=0 bl.length=189 2024-09-14T11:36:07.612 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:07.614+0000 7f9dc53c19c0 20 rados->read ofs=0 len=0 2024-09-14T11:36:07.613 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:07.614+0000 7f9dc53c19c0 20 rados_obj.operate() r=0 bl.length=443 2024-09-14T11:36:07.614 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:07.614+0000 7f9dc53c19c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:36:07.617 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:07.618+0000 7f9c797e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:36:07.622 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:07.622+0000 7f9dc53c19c0 20 remove_watcher() i=0 2024-09-14T11:36:07.622 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:07.622+0000 7f9dc53c19c0 2 removed watcher, disabling cache 2024-09-14T11:36:07.624 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:07.626+0000 7f9dc53c19c0 20 remove_watcher() i=1 2024-09-14T11:36:07.626 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:07.626+0000 7f9dc53c19c0 20 remove_watcher() i=2 2024-09-14T11:36:07.629 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:07.630+0000 7f9dc53c19c0 20 remove_watcher() i=3 2024-09-14T11:36:07.631 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:07.634+0000 7f9dc53c19c0 20 remove_watcher() i=4 2024-09-14T11:36:07.632 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:07.634+0000 7f9dc53c19c0 20 remove_watcher() i=5 2024-09-14T11:36:07.634 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:07.634+0000 7f9dc53c19c0 20 remove_watcher() i=6 2024-09-14T11:36:07.635 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:07.638+0000 7f9dc53c19c0 20 remove_watcher() i=7 2024-09-14T11:36:07.651 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-14T11:36:07.651 INFO:tasks.workunit.client.0.smithi138.stderr:BUCKET_STATS: 2024-09-14T11:36:07.651 INFO:tasks.workunit.client.0.smithi138.stderr:bucket: abort-at-block-writes id: d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.29 num_objects: 20 size_kb: 1 num_shards: 11 2024-09-14T11:36:07.651 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-14T11:36:07.652 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:36:07.652 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-14T11:36:07.702 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:36:07.702 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-14T11:36:07.796 INFO:tasks.workunit.client.0.smithi138.stderr:radosgw-admin bucket reshard --bucket abort-at-block-writes --num-shards 12 --rgw-reshard-bucket-lock-duration 30 2024-09-14T11:36:07.835 INFO:tasks.workunit.client.0.smithi138.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:36:07.835 INFO:tasks.workunit.client.0.smithi138.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:36:07.882 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:07.882+0000 7f33f59f59c0 20 rados->read ofs=0 len=0 2024-09-14T11:36:07.884 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:07.886+0000 7f33f59f59c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:36:07.884 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:07.886+0000 7f33f59f59c0 20 realm 2024-09-14T11:36:07.884 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:07.886+0000 7f33f59f59c0 20 rados->read ofs=0 len=0 2024-09-14T11:36:07.884 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:07.886+0000 7f33f59f59c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:36:07.884 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:07.886+0000 7f33f59f59c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:36:07.884 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:07.886+0000 7f33f59f59c0 20 rados->read ofs=0 len=0 2024-09-14T11:36:07.884 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:07.886+0000 7f33f59f59c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:36:07.884 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:07.886+0000 7f33f59f59c0 20 rados->read ofs=0 len=0 2024-09-14T11:36:07.885 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:07.886+0000 7f33f59f59c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:36:07.885 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:07.886+0000 7f33f59f59c0 20 rados->read ofs=0 len=0 2024-09-14T11:36:07.886 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:07.886+0000 7f33f59f59c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:36:07.886 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:07.886+0000 7f33f59f59c0 20 searching for the correct realm 2024-09-14T11:36:07.889 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:07.890+0000 7f33f3cfc640 0 -- 172.21.15.138:0/2591779759 >> [v2:172.21.15.154:6824/416768175,v1:172.21.15.154:6825/416768175] conn(0x7f33ec102550 msgr2=0x7f33ec0f7d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-14T11:36:08.104 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:08.106+0000 7f33f2cfa640 0 -- 172.21.15.138:0/2591779759 >> [v2:172.21.15.138:6816/326481658,v1:172.21.15.138:6817/326481658] conn(0x7f33ec0c3970 msgr2=0x7f33ec11a140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:36:08.321 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:08.322+0000 7f33f59f59c0 20 RGWRados::pool_iterate: got zone_info.d9e72d30-c60b-4d0d-9267-fdc36392d5ad 2024-09-14T11:36:08.321 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:08.322+0000 7f33f59f59c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:36:08.322 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:08.322+0000 7f33f59f59c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:36:08.322 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:08.322+0000 7f33f59f59c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:36:08.322 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:08.322+0000 7f33f59f59c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:36:08.322 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:08.322+0000 7f33f59f59c0 20 RGWRados::pool_iterate: got zonegroup_info.65ab941b-da8c-4160-94fb-3672b069d44f 2024-09-14T11:36:08.322 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:08.322+0000 7f33f59f59c0 20 rados->read ofs=0 len=0 2024-09-14T11:36:08.322 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:08.322+0000 7f33f59f59c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:36:08.322 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:08.322+0000 7f33f59f59c0 20 rados->read ofs=0 len=0 2024-09-14T11:36:08.322 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:08.322+0000 7f33f59f59c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:36:08.323 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:08.322+0000 7f33f59f59c0 20 rados->read ofs=0 len=0 2024-09-14T11:36:08.324 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:08.326+0000 7f33f59f59c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:36:08.324 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:08.326+0000 7f33f59f59c0 20 zone default found 2024-09-14T11:36:08.324 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:08.326+0000 7f33f59f59c0 4 Realm: () 2024-09-14T11:36:08.324 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:08.326+0000 7f33f59f59c0 4 ZoneGroup: default (65ab941b-da8c-4160-94fb-3672b069d44f) 2024-09-14T11:36:08.324 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:08.326+0000 7f33f59f59c0 4 Zone: default (d9e72d30-c60b-4d0d-9267-fdc36392d5ad) 2024-09-14T11:36:08.324 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:08.326+0000 7f33f59f59c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:36:08.324 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:08.326+0000 7f33f59f59c0 20 zonegroup default 2024-09-14T11:36:08.324 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:08.326+0000 7f33f59f59c0 20 rados->read ofs=0 len=0 2024-09-14T11:36:08.325 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:08.326+0000 7f33f59f59c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:36:08.325 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:08.326+0000 7f33f59f59c0 20 rados->read ofs=0 len=0 2024-09-14T11:36:08.325 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:08.326+0000 7f33f59f59c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:36:08.325 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:08.326+0000 7f33f59f59c0 20 rados->read ofs=0 len=0 2024-09-14T11:36:08.326 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:08.326+0000 7f33f59f59c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:36:08.326 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:08.326+0000 7f33f59f59c0 20 started sync module instance, tier type = 2024-09-14T11:36:08.326 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:08.326+0000 7f33f59f59c0 20 started zone id=d9e72d30-c60b-4d0d-9267-fdc36392d5ad (name=default) with tier type = 2024-09-14T11:36:08.350 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:08.350+0000 7f33f59f59c0 20 add_watcher() i=0 2024-09-14T11:36:08.350 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:08.350+0000 7f33f59f59c0 20 add_watcher() i=1 2024-09-14T11:36:08.350 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:08.350+0000 7f33f59f59c0 20 add_watcher() i=2 2024-09-14T11:36:08.350 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:08.350+0000 7f33f59f59c0 20 add_watcher() i=3 2024-09-14T11:36:08.350 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:08.350+0000 7f33f59f59c0 20 add_watcher() i=4 2024-09-14T11:36:08.350 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:08.350+0000 7f33f59f59c0 20 add_watcher() i=5 2024-09-14T11:36:08.350 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:08.350+0000 7f33f59f59c0 20 add_watcher() i=6 2024-09-14T11:36:08.352 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:08.354+0000 7f33f59f59c0 20 add_watcher() i=7 2024-09-14T11:36:08.352 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:08.354+0000 7f33f59f59c0 2 all 8 watchers are set, enabling cache 2024-09-14T11:36:08.356 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:08.358+0000 7f32aa7e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:36:08.357 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:08.358+0000 7f33f59f59c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:36:08.357 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:08.358+0000 7f33f59f59c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:36:08.358 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:08.358+0000 7f33f59f59c0 5 note: GC not initialized 2024-09-14T11:36:08.358 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:08.358+0000 7f32a97e2640 20 reqs_thread_entry: start 2024-09-14T11:36:08.358 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:08.358+0000 7f33f59f59c0 20 init_complete bucket index max shards: 11 2024-09-14T11:36:08.359 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:08.358+0000 7f33f59f59c0 20 Filter name: none 2024-09-14T11:36:08.359 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:08.358+0000 7f32a27fc640 20 reqs_thread_entry: start 2024-09-14T11:36:08.359 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:08.362+0000 7f33f59f59c0 10 cache get: name=default.rgw.meta+root+abort-at-block-writes : miss 2024-09-14T11:36:08.359 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:08.362+0000 7f33f59f59c0 20 rados->read ofs=0 len=0 2024-09-14T11:36:08.360 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:08.362+0000 7f33f59f59c0 20 rados_obj.operate() r=0 bl.length=189 2024-09-14T11:36:08.360 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:08.362+0000 7f33f59f59c0 10 cache put: name=default.rgw.meta+root+abort-at-block-writes info.flags=0x11 2024-09-14T11:36:08.360 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:08.362+0000 7f33f59f59c0 10 adding default.rgw.meta+root+abort-at-block-writes to cache LRU end 2024-09-14T11:36:08.360 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:08.362+0000 7f33f59f59c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.29 : miss 2024-09-14T11:36:08.360 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:08.362+0000 7f33f59f59c0 20 rados->read ofs=0 len=0 2024-09-14T11:36:08.361 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:08.362+0000 7f33f59f59c0 20 rados_obj.operate() r=0 bl.length=443 2024-09-14T11:36:08.361 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:08.362+0000 7f33f59f59c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.29 info.flags=0x17 2024-09-14T11:36:08.361 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:08.362+0000 7f33f59f59c0 10 adding default.rgw.meta+root+.bucket.meta.abort-at-block-writes:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.29 to cache LRU end 2024-09-14T11:36:08.361 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:08.362+0000 7f33f59f59c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:36:08.361 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:08.362+0000 7f33f59f59c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:36:08.361 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:08.362+0000 7f33f59f59c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.29 2024-09-14T11:36:08.364 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:08.366+0000 7f33f59f59c0 0 INFO: RGWReshardLock::lock found lock on abort-at-block-writes:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.29 to be held by another RGW process; skipping for now 2024-09-14T11:36:08.366 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:08.366+0000 7f32aa7e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:36:08.370 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:08.370+0000 7f33f59f59c0 20 remove_watcher() i=0 2024-09-14T11:36:08.370 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:08.370+0000 7f33f59f59c0 2 removed watcher, disabling cache 2024-09-14T11:36:08.372 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:08.374+0000 7f33f59f59c0 20 remove_watcher() i=1 2024-09-14T11:36:08.374 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:08.374+0000 7f33f59f59c0 20 remove_watcher() i=2 2024-09-14T11:36:08.377 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:08.378+0000 7f33f59f59c0 20 remove_watcher() i=3 2024-09-14T11:36:08.379 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:08.382+0000 7f33f59f59c0 20 remove_watcher() i=4 2024-09-14T11:36:08.381 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:08.382+0000 7f33f59f59c0 20 remove_watcher() i=5 2024-09-14T11:36:08.382 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:08.382+0000 7f33f59f59c0 20 remove_watcher() i=6 2024-09-14T11:36:08.384 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:08.386+0000 7f33f59f59c0 20 remove_watcher() i=7 2024-09-14T11:36:08.401 INFO:tasks.workunit.client.0.smithi138.stderr:waiting 30 seconds for reshard lock to expire... 2024-09-14T11:36:38.429 INFO:tasks.workunit.client.0.smithi138.stderr:radosgw-admin bucket reshard --bucket abort-at-block-writes --num-shards 12 --rgw-reshard-bucket-lock-duration 30 2024-09-14T11:36:38.465 INFO:tasks.workunit.client.0.smithi138.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:36:38.466 INFO:tasks.workunit.client.0.smithi138.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:36:38.512 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:38.513+0000 7fefd50889c0 20 rados->read ofs=0 len=0 2024-09-14T11:36:38.514 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:38.513+0000 7fefd50889c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:36:38.514 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:38.513+0000 7fefd50889c0 20 realm 2024-09-14T11:36:38.514 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:38.513+0000 7fefd50889c0 20 rados->read ofs=0 len=0 2024-09-14T11:36:38.514 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:38.513+0000 7fefd50889c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:36:38.514 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:38.513+0000 7fefd50889c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:36:38.514 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:38.513+0000 7fefd50889c0 20 rados->read ofs=0 len=0 2024-09-14T11:36:38.515 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:38.513+0000 7fefd50889c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:36:38.515 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:38.513+0000 7fefd50889c0 20 rados->read ofs=0 len=0 2024-09-14T11:36:38.516 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:38.517+0000 7fefd50889c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:36:38.516 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:38.517+0000 7fefd50889c0 20 rados->read ofs=0 len=0 2024-09-14T11:36:38.517 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:38.517+0000 7fefd50889c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:36:38.517 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:38.517+0000 7fefd50889c0 20 searching for the correct realm 2024-09-14T11:36:38.520 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:38.521+0000 7fefd338f640 0 -- 172.21.15.138:0/1666789431 >> [v2:172.21.15.154:6824/416768175,v1:172.21.15.154:6825/416768175] conn(0x7fefcc061040 msgr2=0x7fefcc05cb10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:36:38.528 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:38.529+0000 7fefd238d640 0 -- 172.21.15.138:0/1666789431 >> [v2:172.21.15.138:6816/326481658,v1:172.21.15.138:6817/326481658] conn(0x7fefcc067b90 msgr2=0x7fefcc00b8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:36:38.746 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:38.745+0000 7fefd50889c0 20 RGWRados::pool_iterate: got zone_info.d9e72d30-c60b-4d0d-9267-fdc36392d5ad 2024-09-14T11:36:38.747 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:38.745+0000 7fefd50889c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:36:38.747 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:38.745+0000 7fefd50889c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:36:38.747 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:38.745+0000 7fefd50889c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:36:38.747 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:38.745+0000 7fefd50889c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:36:38.747 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:38.745+0000 7fefd50889c0 20 RGWRados::pool_iterate: got zonegroup_info.65ab941b-da8c-4160-94fb-3672b069d44f 2024-09-14T11:36:38.747 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:38.745+0000 7fefd50889c0 20 rados->read ofs=0 len=0 2024-09-14T11:36:38.748 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:38.745+0000 7fefd50889c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:36:38.748 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:38.745+0000 7fefd50889c0 20 rados->read ofs=0 len=0 2024-09-14T11:36:38.748 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:38.749+0000 7fefd50889c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:36:38.748 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:38.749+0000 7fefd50889c0 20 rados->read ofs=0 len=0 2024-09-14T11:36:38.749 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:38.749+0000 7fefd50889c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:36:38.749 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:38.749+0000 7fefd50889c0 20 zone default found 2024-09-14T11:36:38.749 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:38.749+0000 7fefd50889c0 4 Realm: () 2024-09-14T11:36:38.749 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:38.749+0000 7fefd50889c0 4 ZoneGroup: default (65ab941b-da8c-4160-94fb-3672b069d44f) 2024-09-14T11:36:38.749 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:38.749+0000 7fefd50889c0 4 Zone: default (d9e72d30-c60b-4d0d-9267-fdc36392d5ad) 2024-09-14T11:36:38.749 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:38.749+0000 7fefd50889c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:36:38.749 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:38.749+0000 7fefd50889c0 20 zonegroup default 2024-09-14T11:36:38.749 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:38.749+0000 7fefd50889c0 20 rados->read ofs=0 len=0 2024-09-14T11:36:38.750 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:38.749+0000 7fefd50889c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:36:38.750 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:38.749+0000 7fefd50889c0 20 rados->read ofs=0 len=0 2024-09-14T11:36:38.750 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:38.749+0000 7fefd50889c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:36:38.750 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:38.749+0000 7fefd50889c0 20 rados->read ofs=0 len=0 2024-09-14T11:36:38.751 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:38.749+0000 7fefd50889c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:36:38.751 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:38.749+0000 7fefd50889c0 20 started sync module instance, tier type = 2024-09-14T11:36:38.751 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:38.749+0000 7fefd50889c0 20 started zone id=d9e72d30-c60b-4d0d-9267-fdc36392d5ad (name=default) with tier type = 2024-09-14T11:36:38.775 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:38.773+0000 7fefd50889c0 20 add_watcher() i=0 2024-09-14T11:36:38.775 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:38.773+0000 7fefd50889c0 20 add_watcher() i=1 2024-09-14T11:36:38.775 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:38.773+0000 7fefd50889c0 20 add_watcher() i=2 2024-09-14T11:36:38.775 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:38.773+0000 7fefd50889c0 20 add_watcher() i=3 2024-09-14T11:36:38.775 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:38.773+0000 7fefd50889c0 20 add_watcher() i=4 2024-09-14T11:36:38.775 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:38.773+0000 7fefd50889c0 20 add_watcher() i=5 2024-09-14T11:36:38.775 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:38.773+0000 7fefd50889c0 20 add_watcher() i=6 2024-09-14T11:36:38.777 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:38.777+0000 7fefd50889c0 20 add_watcher() i=7 2024-09-14T11:36:38.777 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:38.777+0000 7fefd50889c0 2 all 8 watchers are set, enabling cache 2024-09-14T11:36:38.781 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:38.781+0000 7fee897e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:36:38.782 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:38.781+0000 7fefd50889c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:36:38.783 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:38.781+0000 7fefd50889c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:36:38.783 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:38.781+0000 7fefd50889c0 5 note: GC not initialized 2024-09-14T11:36:38.783 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:38.781+0000 7fee03fff640 20 reqs_thread_entry: start 2024-09-14T11:36:38.783 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:38.785+0000 7fefd50889c0 20 init_complete bucket index max shards: 11 2024-09-14T11:36:38.783 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:38.785+0000 7fefd50889c0 20 Filter name: none 2024-09-14T11:36:38.784 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:38.785+0000 7fee01ffb640 20 reqs_thread_entry: start 2024-09-14T11:36:38.784 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:38.785+0000 7fefd50889c0 10 cache get: name=default.rgw.meta+root+abort-at-block-writes : miss 2024-09-14T11:36:38.784 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:38.785+0000 7fefd50889c0 20 rados->read ofs=0 len=0 2024-09-14T11:36:38.785 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:38.785+0000 7fefd50889c0 20 rados_obj.operate() r=0 bl.length=189 2024-09-14T11:36:38.785 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:38.785+0000 7fefd50889c0 10 cache put: name=default.rgw.meta+root+abort-at-block-writes info.flags=0x11 2024-09-14T11:36:38.785 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:38.785+0000 7fefd50889c0 10 adding default.rgw.meta+root+abort-at-block-writes to cache LRU end 2024-09-14T11:36:38.785 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:38.785+0000 7fefd50889c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.29 : miss 2024-09-14T11:36:38.785 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:38.785+0000 7fefd50889c0 20 rados->read ofs=0 len=0 2024-09-14T11:36:38.786 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:38.785+0000 7fefd50889c0 20 rados_obj.operate() r=0 bl.length=443 2024-09-14T11:36:38.786 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:38.785+0000 7fefd50889c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.29 info.flags=0x17 2024-09-14T11:36:38.786 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:38.785+0000 7fefd50889c0 10 adding default.rgw.meta+root+.bucket.meta.abort-at-block-writes:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.29 to cache LRU end 2024-09-14T11:36:38.786 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:38.785+0000 7fefd50889c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:36:38.786 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:38.785+0000 7fefd50889c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:36:38.786 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:38.785+0000 7fefd50889c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.29 2024-09-14T11:36:38.789 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:38.789+0000 7fefd50889c0 10 init_target_layout removing existing target index objects from a previous reshard attempt 2024-09-14T11:36:38.804 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:38.805+0000 7fefd50889c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.29 info.flags=0x17 2024-09-14T11:36:38.804 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:38.805+0000 7fefd50889c0 10 moving default.rgw.meta+root+.bucket.meta.abort-at-block-writes:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.29 to cache LRU end 2024-09-14T11:36:38.804 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:38.805+0000 7fefd50889c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:36:38.805 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:38.805+0000 7fefd50889c0 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-block-writes:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.29, ofs0, ns] 2024-09-14T11:36:38.805 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:38.805+0000 7feeb67fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366229 cookie 94892526771200 notifier 6599 bl.length()=915 2024-09-14T11:36:38.805 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:38.805+0000 7feeb67fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.29 info.flags=0x17 2024-09-14T11:36:38.805 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:38.805+0000 7feeb67fc640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-block-writes:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.29 to cache LRU end 2024-09-14T11:36:38.805 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:38.805+0000 7feeb67fc640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:36:38.807 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:38.809+0000 7fefd50889c0 20 handle_bi_update(): bucket=:abort-at-block-writes[d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.29]): orig_sources= new_sources= 2024-09-14T11:36:38.808 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:38.809+0000 7fefd50889c0 20 handle_bi_update(): bucket=:abort-at-block-writes[d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.29]): potential sources added=[] removed=[] 2024-09-14T11:36:38.808 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:38.809+0000 7fefd50889c0 20 handle_bi_update(): bucket=:abort-at-block-writes[d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.29]): orig_dests= new_dests= 2024-09-14T11:36:38.808 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:38.809+0000 7fefd50889c0 20 handle_bi_update(): bucket=:abort-at-block-writes[d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.29]): potential dests added=[] removed=[] 2024-09-14T11:36:38.821 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:38.821+0000 7fefd50889c0 10 bucket_obj is .dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.29.2.0 2024-09-14T11:36:38.821 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:38.821+0000 7fefd50889c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.29.2.0 2024-09-14T11:36:38.822 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:38.821+0000 7fefd50889c0 10 bucket_obj is .dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.29.2.1 2024-09-14T11:36:38.822 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:38.821+0000 7fefd50889c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.29.2.1 2024-09-14T11:36:38.822 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:38.821+0000 7fefd50889c0 10 bucket_obj is .dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.29.2.2 2024-09-14T11:36:38.822 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:38.821+0000 7fefd50889c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.29.2.2 2024-09-14T11:36:38.822 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:38.821+0000 7fefd50889c0 10 bucket_obj is .dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.29.2.3 2024-09-14T11:36:38.822 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:38.821+0000 7fefd50889c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.29.2.3 2024-09-14T11:36:38.822 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:38.821+0000 7fefd50889c0 10 bucket_obj is .dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.29.2.4 2024-09-14T11:36:38.822 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:38.821+0000 7fefd50889c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.29.2.4 2024-09-14T11:36:38.822 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:38.821+0000 7fefd50889c0 10 bucket_obj is .dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.29.2.5 2024-09-14T11:36:38.822 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:38.821+0000 7fefd50889c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.29.2.5 2024-09-14T11:36:38.822 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:38.821+0000 7fefd50889c0 10 bucket_obj is .dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.29.2.6 2024-09-14T11:36:38.822 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:38.821+0000 7fefd50889c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.29.2.6 2024-09-14T11:36:38.823 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:38.821+0000 7fefd50889c0 10 bucket_obj is .dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.29.2.7 2024-09-14T11:36:38.823 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:38.821+0000 7fefd50889c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.29.2.7 2024-09-14T11:36:38.823 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:38.821+0000 7fefd50889c0 10 bucket_obj is .dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.29.2.8 2024-09-14T11:36:38.823 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:38.821+0000 7fefd50889c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.29.2.8 2024-09-14T11:36:38.823 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:38.821+0000 7fefd50889c0 10 bucket_obj is .dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.29.2.9 2024-09-14T11:36:38.823 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:38.821+0000 7fefd50889c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.29.2.9 2024-09-14T11:36:38.823 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:38.821+0000 7fefd50889c0 10 bucket_obj is .dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.29.2.10 2024-09-14T11:36:38.823 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:38.821+0000 7fefd50889c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.29.2.10 2024-09-14T11:36:38.823 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:38.821+0000 7fefd50889c0 10 bucket_obj is .dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.29.2.11 2024-09-14T11:36:38.823 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:38.821+0000 7fefd50889c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.29.2.11 2024-09-14T11:36:38.823 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:38.821+0000 7fefd50889c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.29.0 2024-09-14T11:36:38.824 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:38.821+0000 7fefd50889c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.29.1 2024-09-14T11:36:38.824 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:38.825+0000 7fefd50889c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.29.2 2024-09-14T11:36:38.825 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:38.825+0000 7fefd50889c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.29.3 2024-09-14T11:36:38.826 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:38.825+0000 7fefd50889c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.29.4 2024-09-14T11:36:38.828 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:38.829+0000 7fefd50889c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.29.5 2024-09-14T11:36:38.829 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:38.829+0000 7fefd50889c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.29.6 2024-09-14T11:36:38.830 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:38.829+0000 7fefd50889c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.29.7 2024-09-14T11:36:38.831 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:38.833+0000 7fefd50889c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.29.8 2024-09-14T11:36:38.832 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:38.833+0000 7fefd50889c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.29.9 2024-09-14T11:36:38.833 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:38.833+0000 7fefd50889c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.29.10 2024-09-14T11:36:38.840 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:38.841+0000 7fefd50889c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.29 : hit (requested=0x17, cached=0x17) 2024-09-14T11:36:38.840 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:38.841+0000 7fefd50889c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.29 2024-09-14T11:36:38.843 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:38.845+0000 7fefd50889c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.29 info.flags=0x17 2024-09-14T11:36:38.844 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:38.845+0000 7fefd50889c0 10 moving default.rgw.meta+root+.bucket.meta.abort-at-block-writes:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.29 to cache LRU end 2024-09-14T11:36:38.844 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:38.845+0000 7fefd50889c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:36:38.844 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:38.845+0000 7fefd50889c0 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-block-writes:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.29, ofs0, ns] 2024-09-14T11:36:38.844 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:38.845+0000 7feeb5ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366230 cookie 94892526771200 notifier 6599 bl.length()=915 2024-09-14T11:36:38.845 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:38.845+0000 7feeb5ffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.29 info.flags=0x17 2024-09-14T11:36:38.845 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:38.845+0000 7feeb5ffb640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-block-writes:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.29 to cache LRU end 2024-09-14T11:36:38.845 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:38.845+0000 7feeb5ffb640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:36:38.847 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:38.849+0000 7fefd50889c0 20 handle_bi_update(): bucket=:abort-at-block-writes[d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.29]): orig_sources= new_sources= 2024-09-14T11:36:38.848 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:38.849+0000 7fefd50889c0 20 handle_bi_update(): bucket=:abort-at-block-writes[d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.29]): potential sources added=[] removed=[] 2024-09-14T11:36:38.848 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:38.849+0000 7fefd50889c0 20 handle_bi_update(): bucket=:abort-at-block-writes[d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.29]): orig_dests= new_dests= 2024-09-14T11:36:38.848 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:38.849+0000 7fefd50889c0 20 handle_bi_update(): bucket=:abort-at-block-writes[d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.29]): potential dests added=[] removed=[] 2024-09-14T11:36:38.853 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:38.853+0000 7fefd50889c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.29.0 2024-09-14T11:36:38.854 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:38.853+0000 7fefd50889c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.29.1 2024-09-14T11:36:38.855 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:38.853+0000 7fefd50889c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.29.2 2024-09-14T11:36:38.856 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:38.857+0000 7fefd50889c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.29.3 2024-09-14T11:36:38.856 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:38.857+0000 7fefd50889c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.29.4 2024-09-14T11:36:38.857 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:38.857+0000 7fefd50889c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.29.5 2024-09-14T11:36:38.858 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:38.857+0000 7fefd50889c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.29.6 2024-09-14T11:36:38.859 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:38.861+0000 7fefd50889c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.29.7 2024-09-14T11:36:38.860 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:38.861+0000 7fefd50889c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.29.8 2024-09-14T11:36:38.860 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:38.861+0000 7fefd50889c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.29.9 2024-09-14T11:36:38.861 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:38.861+0000 7fefd50889c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.29.10 2024-09-14T11:36:38.862 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:38.861+0000 7fefd50889c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.29 : hit (requested=0x17, cached=0x17) 2024-09-14T11:36:38.862 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:38.861+0000 7fefd50889c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.29 2024-09-14T11:36:38.865 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:38.865+0000 7fefd50889c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.29 info.flags=0x17 2024-09-14T11:36:38.865 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:38.865+0000 7fefd50889c0 10 moving default.rgw.meta+root+.bucket.meta.abort-at-block-writes:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.29 to cache LRU end 2024-09-14T11:36:38.866 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:38.865+0000 7fefd50889c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:36:38.866 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:38.865+0000 7fefd50889c0 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-block-writes:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.29, ofs0, ns] 2024-09-14T11:36:38.866 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:38.865+0000 7feeb67fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366231 cookie 94892526771200 notifier 6599 bl.length()=883 2024-09-14T11:36:38.866 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:38.865+0000 7feeb67fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.29 info.flags=0x17 2024-09-14T11:36:38.867 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:38.865+0000 7feeb67fc640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-block-writes:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.29 to cache LRU end 2024-09-14T11:36:38.867 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:38.865+0000 7feeb67fc640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:36:38.869 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:38.869+0000 7fefd50889c0 20 handle_bi_update(): bucket=:abort-at-block-writes[d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.29]): orig_sources= new_sources= 2024-09-14T11:36:38.869 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:38.869+0000 7fefd50889c0 20 handle_bi_update(): bucket=:abort-at-block-writes[d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.29]): potential sources added=[] removed=[] 2024-09-14T11:36:38.869 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:38.869+0000 7fefd50889c0 20 handle_bi_update(): bucket=:abort-at-block-writes[d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.29]): orig_dests= new_dests= 2024-09-14T11:36:38.869 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:38.869+0000 7fefd50889c0 20 handle_bi_update(): bucket=:abort-at-block-writes[d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.29]): potential dests added=[] removed=[] 2024-09-14T11:36:38.874 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:38.873+0000 7fefd50889c0 1 execute INFO: reshard of bucket "abort-at-block-writes" from 11 shards to 12 shards completed successfully 2024-09-14T11:36:38.879 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:38.877+0000 7fee897e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:36:38.884 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:38.885+0000 7fefd50889c0 20 remove_watcher() i=0 2024-09-14T11:36:38.884 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:38.885+0000 7fefd50889c0 2 removed watcher, disabling cache 2024-09-14T11:36:38.886 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:38.885+0000 7fefd50889c0 20 remove_watcher() i=1 2024-09-14T11:36:38.888 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:38.889+0000 7fefd50889c0 20 remove_watcher() i=2 2024-09-14T11:36:38.890 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:38.889+0000 7fefd50889c0 20 remove_watcher() i=3 2024-09-14T11:36:38.892 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:38.893+0000 7fefd50889c0 20 remove_watcher() i=4 2024-09-14T11:36:38.894 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:38.893+0000 7fefd50889c0 20 remove_watcher() i=5 2024-09-14T11:36:38.895 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:38.897+0000 7fefd50889c0 20 remove_watcher() i=6 2024-09-14T11:36:38.897 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:38.897+0000 7fefd50889c0 20 remove_watcher() i=7 2024-09-14T11:36:38.913 INFO:tasks.workunit.client.0.smithi138.stderr:radosgw-admin bucket stats --bucket abort-at-block-writes 2024-09-14T11:36:38.944 INFO:tasks.workunit.client.0.smithi138.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:36:38.944 INFO:tasks.workunit.client.0.smithi138.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:36:38.988 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:38.989+0000 7f662f6539c0 20 rados->read ofs=0 len=0 2024-09-14T11:36:38.990 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:38.989+0000 7f662f6539c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:36:38.990 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:38.989+0000 7f662f6539c0 20 realm 2024-09-14T11:36:38.990 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:38.989+0000 7f662f6539c0 20 rados->read ofs=0 len=0 2024-09-14T11:36:38.990 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:38.989+0000 7f662f6539c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:36:38.990 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:38.989+0000 7f662f6539c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:36:38.991 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:38.989+0000 7f662f6539c0 20 rados->read ofs=0 len=0 2024-09-14T11:36:38.991 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:38.989+0000 7f662f6539c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:36:38.991 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:38.989+0000 7f662f6539c0 20 rados->read ofs=0 len=0 2024-09-14T11:36:38.992 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:38.993+0000 7f662f6539c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:36:38.992 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:38.993+0000 7f662f6539c0 20 rados->read ofs=0 len=0 2024-09-14T11:36:38.993 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:38.993+0000 7f662f6539c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:36:38.993 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:38.993+0000 7f662f6539c0 20 searching for the correct realm 2024-09-14T11:36:38.997 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:38.997+0000 7f662d95a640 0 -- 172.21.15.138:0/501611855 >> [v2:172.21.15.154:6824/416768175,v1:172.21.15.154:6825/416768175] conn(0x7f6628018040 msgr2=0x7f6628032920 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:36:39.003 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:39.005+0000 7f662c958640 0 -- 172.21.15.138:0/501611855 >> [v2:172.21.15.138:6816/326481658,v1:172.21.15.138:6817/326481658] conn(0x7f6628047920 msgr2=0x7f6628026410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:36:39.223 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:39.221+0000 7f662f6539c0 20 RGWRados::pool_iterate: got zone_info.d9e72d30-c60b-4d0d-9267-fdc36392d5ad 2024-09-14T11:36:39.223 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:39.221+0000 7f662f6539c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:36:39.223 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:39.221+0000 7f662f6539c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:36:39.223 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:39.221+0000 7f662f6539c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:36:39.223 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:39.221+0000 7f662f6539c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:36:39.223 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:39.221+0000 7f662f6539c0 20 RGWRados::pool_iterate: got zonegroup_info.65ab941b-da8c-4160-94fb-3672b069d44f 2024-09-14T11:36:39.223 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:39.221+0000 7f662f6539c0 20 rados->read ofs=0 len=0 2024-09-14T11:36:39.224 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:39.225+0000 7f662f6539c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:36:39.224 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:39.225+0000 7f662f6539c0 20 rados->read ofs=0 len=0 2024-09-14T11:36:39.224 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:39.225+0000 7f662f6539c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:36:39.225 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:39.225+0000 7f662f6539c0 20 rados->read ofs=0 len=0 2024-09-14T11:36:39.226 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:39.225+0000 7f662f6539c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:36:39.226 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:39.225+0000 7f662f6539c0 20 zone default found 2024-09-14T11:36:39.226 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:39.225+0000 7f662f6539c0 4 Realm: () 2024-09-14T11:36:39.226 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:39.225+0000 7f662f6539c0 4 ZoneGroup: default (65ab941b-da8c-4160-94fb-3672b069d44f) 2024-09-14T11:36:39.226 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:39.225+0000 7f662f6539c0 4 Zone: default (d9e72d30-c60b-4d0d-9267-fdc36392d5ad) 2024-09-14T11:36:39.226 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:39.225+0000 7f662f6539c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:36:39.226 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:39.225+0000 7f662f6539c0 20 zonegroup default 2024-09-14T11:36:39.226 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:39.225+0000 7f662f6539c0 20 rados->read ofs=0 len=0 2024-09-14T11:36:39.227 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:39.225+0000 7f662f6539c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:36:39.227 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:39.225+0000 7f662f6539c0 20 rados->read ofs=0 len=0 2024-09-14T11:36:39.228 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:39.229+0000 7f662f6539c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:36:39.228 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:39.229+0000 7f662f6539c0 20 rados->read ofs=0 len=0 2024-09-14T11:36:39.228 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:39.229+0000 7f662f6539c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:36:39.228 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:39.229+0000 7f662f6539c0 20 started sync module instance, tier type = 2024-09-14T11:36:39.229 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:39.229+0000 7f662f6539c0 20 started zone id=d9e72d30-c60b-4d0d-9267-fdc36392d5ad (name=default) with tier type = 2024-09-14T11:36:39.253 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:39.253+0000 7f662f6539c0 20 add_watcher() i=0 2024-09-14T11:36:39.253 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:39.253+0000 7f662f6539c0 20 add_watcher() i=1 2024-09-14T11:36:39.254 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:39.253+0000 7f662f6539c0 20 add_watcher() i=2 2024-09-14T11:36:39.254 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:39.253+0000 7f662f6539c0 20 add_watcher() i=3 2024-09-14T11:36:39.254 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:39.253+0000 7f662f6539c0 20 add_watcher() i=4 2024-09-14T11:36:39.254 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:39.253+0000 7f662f6539c0 20 add_watcher() i=5 2024-09-14T11:36:39.254 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:39.253+0000 7f662f6539c0 20 add_watcher() i=6 2024-09-14T11:36:39.255 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:39.257+0000 7f662f6539c0 20 add_watcher() i=7 2024-09-14T11:36:39.256 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:39.257+0000 7f662f6539c0 2 all 8 watchers are set, enabling cache 2024-09-14T11:36:39.259 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:39.261+0000 7f64e37e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:36:39.260 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:39.261+0000 7f662f6539c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:36:39.261 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:39.261+0000 7f662f6539c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:36:39.261 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:39.261+0000 7f662f6539c0 5 note: GC not initialized 2024-09-14T11:36:39.261 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:39.261+0000 7f64e27e4640 20 reqs_thread_entry: start 2024-09-14T11:36:39.261 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:39.261+0000 7f662f6539c0 20 init_complete bucket index max shards: 11 2024-09-14T11:36:39.262 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:39.261+0000 7f662f6539c0 20 Filter name: none 2024-09-14T11:36:39.262 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:39.261+0000 7f6453fff640 20 reqs_thread_entry: start 2024-09-14T11:36:39.262 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:39.261+0000 7f662f6539c0 20 rados->read ofs=0 len=0 2024-09-14T11:36:39.262 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:39.261+0000 7f662f6539c0 20 rados_obj.operate() r=0 bl.length=189 2024-09-14T11:36:39.262 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:39.261+0000 7f662f6539c0 20 rados->read ofs=0 len=0 2024-09-14T11:36:39.264 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:39.265+0000 7f662f6539c0 20 rados_obj.operate() r=0 bl.length=411 2024-09-14T11:36:39.264 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:39.265+0000 7f662f6539c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:36:39.264 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:39.265+0000 7f662f6539c0 20 rados->read ofs=0 len=0 2024-09-14T11:36:39.265 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:39.265+0000 7f662f6539c0 20 rados_obj.operate() r=0 bl.length=189 2024-09-14T11:36:39.265 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:39.265+0000 7f662f6539c0 20 rados->read ofs=0 len=0 2024-09-14T11:36:39.265 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:39.265+0000 7f662f6539c0 20 rados_obj.operate() r=0 bl.length=411 2024-09-14T11:36:39.266 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:39.265+0000 7f662f6539c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:36:39.269 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:39.269+0000 7f64e37e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:36:39.273 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:39.273+0000 7f662f6539c0 20 remove_watcher() i=0 2024-09-14T11:36:39.274 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:39.273+0000 7f662f6539c0 2 removed watcher, disabling cache 2024-09-14T11:36:39.276 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:39.277+0000 7f662f6539c0 20 remove_watcher() i=1 2024-09-14T11:36:39.278 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:39.277+0000 7f662f6539c0 20 remove_watcher() i=2 2024-09-14T11:36:39.280 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:39.281+0000 7f662f6539c0 20 remove_watcher() i=3 2024-09-14T11:36:39.282 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:39.281+0000 7f662f6539c0 20 remove_watcher() i=4 2024-09-14T11:36:39.284 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:39.285+0000 7f662f6539c0 20 remove_watcher() i=5 2024-09-14T11:36:39.285 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:39.285+0000 7f662f6539c0 20 remove_watcher() i=6 2024-09-14T11:36:39.287 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:39.289+0000 7f662f6539c0 20 remove_watcher() i=7 2024-09-14T11:36:39.304 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-14T11:36:39.304 INFO:tasks.workunit.client.0.smithi138.stderr:BUCKET_STATS: 2024-09-14T11:36:39.304 INFO:tasks.workunit.client.0.smithi138.stderr:bucket: abort-at-block-writes id: d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.29 num_objects: 19 size_kb: 1 num_shards: 12 2024-09-14T11:36:39.304 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-14T11:36:39.306 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:36:39.306 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-14T11:36:39.329 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:36:39.329 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-14T11:36:39.725 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:36:39.725 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-14T11:36:40.117 INFO:tasks.workunit.client.0.smithi138.stderr:TEST: reshard bucket with EIO injected at commit_target_layout 2024-09-14T11:36:40.118 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-14T11:36:40.120 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:36:40.121 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-14T11:36:40.257 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:36:40.257 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-14T11:36:40.347 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:36:40.347 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-14T11:36:40.451 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:36:40.451 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-14T11:36:40.543 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:36:40.543 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-14T11:36:40.632 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:36:40.632 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-14T11:36:40.725 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:36:40.725 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-14T11:36:40.829 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:36:40.830 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-14T11:36:40.927 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:36:40.927 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-14T11:36:41.036 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:36:41.036 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-14T11:36:41.122 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:36:41.122 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-14T11:36:41.212 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:36:41.212 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-14T11:36:41.308 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:36:41.308 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-14T11:36:41.401 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:36:41.401 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-14T11:36:41.496 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:36:41.496 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-14T11:36:41.592 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:36:41.592 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-14T11:36:41.668 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:36:41.668 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-14T11:36:41.758 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:36:41.758 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-14T11:36:41.840 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:36:41.840 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-14T11:36:41.925 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:36:41.925 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-14T11:36:42.017 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:36:42.018 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-14T11:36:42.115 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:36:42.115 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-14T11:36:42.201 INFO:tasks.workunit.client.0.smithi138.stderr:radosgw-admin bucket stats --bucket error-at-commit-target-layout 2024-09-14T11:36:42.234 INFO:tasks.workunit.client.0.smithi138.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:36:42.234 INFO:tasks.workunit.client.0.smithi138.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:36:42.282 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:42.281+0000 7f61133b99c0 20 rados->read ofs=0 len=0 2024-09-14T11:36:42.284 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:42.285+0000 7f61133b99c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:36:42.284 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:42.285+0000 7f61133b99c0 20 realm 2024-09-14T11:36:42.284 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:42.285+0000 7f61133b99c0 20 rados->read ofs=0 len=0 2024-09-14T11:36:42.285 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:42.285+0000 7f61133b99c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:36:42.285 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:42.285+0000 7f61133b99c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:36:42.285 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:42.285+0000 7f61133b99c0 20 rados->read ofs=0 len=0 2024-09-14T11:36:42.285 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:42.285+0000 7f61133b99c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:36:42.285 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:42.285+0000 7f61133b99c0 20 rados->read ofs=0 len=0 2024-09-14T11:36:42.286 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:42.285+0000 7f61133b99c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:36:42.286 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:42.285+0000 7f61133b99c0 20 rados->read ofs=0 len=0 2024-09-14T11:36:42.287 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:42.285+0000 7f61133b99c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:36:42.287 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:42.285+0000 7f61133b99c0 20 searching for the correct realm 2024-09-14T11:36:42.290 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:42.289+0000 7f61116c0640 0 -- 172.21.15.138:0/2946861388 >> [v2:172.21.15.154:6824/416768175,v1:172.21.15.154:6825/416768175] conn(0x7f6100107ef0 msgr2=0x7f6100105670 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-14T11:36:42.505 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:42.505+0000 7f61106be640 0 -- 172.21.15.138:0/2946861388 >> [v2:172.21.15.138:6816/326481658,v1:172.21.15.138:6817/326481658] conn(0x7f6100107040 msgr2=0x7f61001067c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-14T11:36:42.722 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:42.721+0000 7f61133b99c0 20 RGWRados::pool_iterate: got zone_info.d9e72d30-c60b-4d0d-9267-fdc36392d5ad 2024-09-14T11:36:42.722 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:42.721+0000 7f61133b99c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:36:42.722 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:42.721+0000 7f61133b99c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:36:42.722 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:42.721+0000 7f61133b99c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:36:42.722 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:42.721+0000 7f61133b99c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:36:42.722 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:42.721+0000 7f61133b99c0 20 RGWRados::pool_iterate: got zonegroup_info.65ab941b-da8c-4160-94fb-3672b069d44f 2024-09-14T11:36:42.722 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:42.721+0000 7f61133b99c0 20 rados->read ofs=0 len=0 2024-09-14T11:36:42.722 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:42.721+0000 7f61133b99c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:36:42.723 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:42.721+0000 7f61133b99c0 20 rados->read ofs=0 len=0 2024-09-14T11:36:42.723 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:42.725+0000 7f61133b99c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:36:42.723 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:42.725+0000 7f61133b99c0 20 rados->read ofs=0 len=0 2024-09-14T11:36:42.724 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:42.725+0000 7f61133b99c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:36:42.724 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:42.725+0000 7f61133b99c0 20 zone default found 2024-09-14T11:36:42.724 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:42.725+0000 7f61133b99c0 4 Realm: () 2024-09-14T11:36:42.724 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:42.725+0000 7f61133b99c0 4 ZoneGroup: default (65ab941b-da8c-4160-94fb-3672b069d44f) 2024-09-14T11:36:42.724 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:42.725+0000 7f61133b99c0 4 Zone: default (d9e72d30-c60b-4d0d-9267-fdc36392d5ad) 2024-09-14T11:36:42.725 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:42.725+0000 7f61133b99c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:36:42.725 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:42.725+0000 7f61133b99c0 20 zonegroup default 2024-09-14T11:36:42.725 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:42.725+0000 7f61133b99c0 20 rados->read ofs=0 len=0 2024-09-14T11:36:42.725 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:42.725+0000 7f61133b99c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:36:42.725 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:42.725+0000 7f61133b99c0 20 rados->read ofs=0 len=0 2024-09-14T11:36:42.725 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:42.725+0000 7f61133b99c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:36:42.726 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:42.725+0000 7f61133b99c0 20 rados->read ofs=0 len=0 2024-09-14T11:36:42.726 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:42.725+0000 7f61133b99c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:36:42.726 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:42.725+0000 7f61133b99c0 20 started sync module instance, tier type = 2024-09-14T11:36:42.726 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:42.725+0000 7f61133b99c0 20 started zone id=d9e72d30-c60b-4d0d-9267-fdc36392d5ad (name=default) with tier type = 2024-09-14T11:36:42.750 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:42.749+0000 7f61133b99c0 20 add_watcher() i=0 2024-09-14T11:36:42.750 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:42.749+0000 7f61133b99c0 20 add_watcher() i=1 2024-09-14T11:36:42.750 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:42.749+0000 7f61133b99c0 20 add_watcher() i=2 2024-09-14T11:36:42.750 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:42.749+0000 7f61133b99c0 20 add_watcher() i=3 2024-09-14T11:36:42.750 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:42.749+0000 7f61133b99c0 20 add_watcher() i=4 2024-09-14T11:36:42.751 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:42.749+0000 7f61133b99c0 20 add_watcher() i=5 2024-09-14T11:36:42.751 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:42.749+0000 7f61133b99c0 20 add_watcher() i=6 2024-09-14T11:36:42.753 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:42.753+0000 7f61133b99c0 20 add_watcher() i=7 2024-09-14T11:36:42.753 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:42.753+0000 7f61133b99c0 2 all 8 watchers are set, enabling cache 2024-09-14T11:36:42.757 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:42.757+0000 7f5fc6fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:36:42.757 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:42.757+0000 7f61133b99c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:36:42.758 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:42.757+0000 7f61133b99c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:36:42.758 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:42.757+0000 7f61133b99c0 5 note: GC not initialized 2024-09-14T11:36:42.758 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:42.757+0000 7f5fc5fe3640 20 reqs_thread_entry: start 2024-09-14T11:36:42.758 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:42.757+0000 7f61133b99c0 20 init_complete bucket index max shards: 11 2024-09-14T11:36:42.759 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:42.757+0000 7f61133b99c0 20 Filter name: none 2024-09-14T11:36:42.759 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:42.757+0000 7f5f377fe640 20 reqs_thread_entry: start 2024-09-14T11:36:42.759 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:42.757+0000 7f61133b99c0 20 rados->read ofs=0 len=0 2024-09-14T11:36:42.760 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:42.761+0000 7f61133b99c0 20 rados_obj.operate() r=0 bl.length=197 2024-09-14T11:36:42.760 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:42.761+0000 7f61133b99c0 20 rados->read ofs=0 len=0 2024-09-14T11:36:42.761 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:42.761+0000 7f61133b99c0 20 rados_obj.operate() r=0 bl.length=419 2024-09-14T11:36:42.761 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:42.761+0000 7f61133b99c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:36:42.761 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:42.761+0000 7f61133b99c0 20 rados->read ofs=0 len=0 2024-09-14T11:36:42.762 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:42.761+0000 7f61133b99c0 20 rados_obj.operate() r=0 bl.length=197 2024-09-14T11:36:42.762 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:42.761+0000 7f61133b99c0 20 rados->read ofs=0 len=0 2024-09-14T11:36:42.763 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:42.765+0000 7f61133b99c0 20 rados_obj.operate() r=0 bl.length=419 2024-09-14T11:36:42.763 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:42.765+0000 7f61133b99c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:36:42.766 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:42.765+0000 7f5fc6fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:36:42.771 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:42.769+0000 7f61133b99c0 20 remove_watcher() i=0 2024-09-14T11:36:42.771 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:42.769+0000 7f61133b99c0 2 removed watcher, disabling cache 2024-09-14T11:36:42.773 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:42.773+0000 7f61133b99c0 20 remove_watcher() i=1 2024-09-14T11:36:42.775 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:42.773+0000 7f61133b99c0 20 remove_watcher() i=2 2024-09-14T11:36:42.777 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:42.777+0000 7f61133b99c0 20 remove_watcher() i=3 2024-09-14T11:36:42.779 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:42.781+0000 7f61133b99c0 20 remove_watcher() i=4 2024-09-14T11:36:42.780 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:42.781+0000 7f61133b99c0 20 remove_watcher() i=5 2024-09-14T11:36:42.782 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:42.781+0000 7f61133b99c0 20 remove_watcher() i=6 2024-09-14T11:36:42.783 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:42.785+0000 7f61133b99c0 20 remove_watcher() i=7 2024-09-14T11:36:42.798 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-14T11:36:42.798 INFO:tasks.workunit.client.0.smithi138.stderr:BUCKET_STATS: 2024-09-14T11:36:42.798 INFO:tasks.workunit.client.0.smithi138.stderr:bucket: error-at-commit-target-layout id: d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.30 num_objects: 20 size_kb: 1 num_shards: 11 2024-09-14T11:36:42.798 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-14T11:36:42.798 INFO:tasks.workunit.client.0.smithi138.stderr:radosgw-admin bucket reshard --bucket error-at-commit-target-layout --num-shards 12 --rgw-reshard-bucket-lock-duration 30 --inject-error-at commit_target_layout 2024-09-14T11:36:42.831 INFO:tasks.workunit.client.0.smithi138.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:36:42.831 INFO:tasks.workunit.client.0.smithi138.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:36:42.876 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:42.877+0000 7ff3ef32a9c0 20 rados->read ofs=0 len=0 2024-09-14T11:36:42.878 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:42.877+0000 7ff3ef32a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:36:42.878 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:42.877+0000 7ff3ef32a9c0 20 realm 2024-09-14T11:36:42.878 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:42.877+0000 7ff3ef32a9c0 20 rados->read ofs=0 len=0 2024-09-14T11:36:42.879 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:42.877+0000 7ff3ef32a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:36:42.879 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:42.877+0000 7ff3ef32a9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:36:42.879 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:42.877+0000 7ff3ef32a9c0 20 rados->read ofs=0 len=0 2024-09-14T11:36:42.879 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:42.877+0000 7ff3ef32a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:36:42.879 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:42.877+0000 7ff3ef32a9c0 20 rados->read ofs=0 len=0 2024-09-14T11:36:42.880 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:42.881+0000 7ff3ef32a9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:36:42.880 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:42.881+0000 7ff3ef32a9c0 20 rados->read ofs=0 len=0 2024-09-14T11:36:42.881 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:42.881+0000 7ff3ef32a9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:36:42.881 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:42.881+0000 7ff3ef32a9c0 20 searching for the correct realm 2024-09-14T11:36:42.885 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:42.885+0000 7ff3ed631640 0 -- 172.21.15.138:0/131888397 >> [v2:172.21.15.154:6824/416768175,v1:172.21.15.154:6825/416768175] conn(0x7ff3e4008050 msgr2=0x7ff3e4064a80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:36:42.891 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:42.893+0000 7ff3ec62f640 0 -- 172.21.15.138:0/131888397 >> [v2:172.21.15.138:6816/326481658,v1:172.21.15.138:6817/326481658] conn(0x7ff3e406f2b0 msgr2=0x7ff3e406f990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-14T11:36:43.111 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:43.109+0000 7ff3ef32a9c0 20 RGWRados::pool_iterate: got zone_info.d9e72d30-c60b-4d0d-9267-fdc36392d5ad 2024-09-14T11:36:43.111 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:43.109+0000 7ff3ef32a9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:36:43.111 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:43.109+0000 7ff3ef32a9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:36:43.111 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:43.109+0000 7ff3ef32a9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:36:43.111 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:43.109+0000 7ff3ef32a9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:36:43.111 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:43.109+0000 7ff3ef32a9c0 20 RGWRados::pool_iterate: got zonegroup_info.65ab941b-da8c-4160-94fb-3672b069d44f 2024-09-14T11:36:43.111 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:43.109+0000 7ff3ef32a9c0 20 rados->read ofs=0 len=0 2024-09-14T11:36:43.112 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:43.113+0000 7ff3ef32a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:36:43.112 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:43.113+0000 7ff3ef32a9c0 20 rados->read ofs=0 len=0 2024-09-14T11:36:43.113 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:43.113+0000 7ff3ef32a9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:36:43.113 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:43.113+0000 7ff3ef32a9c0 20 rados->read ofs=0 len=0 2024-09-14T11:36:43.114 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:43.113+0000 7ff3ef32a9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:36:43.114 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:43.113+0000 7ff3ef32a9c0 20 zone default found 2024-09-14T11:36:43.114 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:43.113+0000 7ff3ef32a9c0 4 Realm: () 2024-09-14T11:36:43.114 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:43.113+0000 7ff3ef32a9c0 4 ZoneGroup: default (65ab941b-da8c-4160-94fb-3672b069d44f) 2024-09-14T11:36:43.114 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:43.113+0000 7ff3ef32a9c0 4 Zone: default (d9e72d30-c60b-4d0d-9267-fdc36392d5ad) 2024-09-14T11:36:43.114 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:43.113+0000 7ff3ef32a9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:36:43.114 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:43.113+0000 7ff3ef32a9c0 20 zonegroup default 2024-09-14T11:36:43.114 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:43.113+0000 7ff3ef32a9c0 20 rados->read ofs=0 len=0 2024-09-14T11:36:43.114 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:43.113+0000 7ff3ef32a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:36:43.115 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:43.113+0000 7ff3ef32a9c0 20 rados->read ofs=0 len=0 2024-09-14T11:36:43.115 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:43.117+0000 7ff3ef32a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:36:43.115 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:43.117+0000 7ff3ef32a9c0 20 rados->read ofs=0 len=0 2024-09-14T11:36:43.116 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:43.117+0000 7ff3ef32a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:36:43.116 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:43.117+0000 7ff3ef32a9c0 20 started sync module instance, tier type = 2024-09-14T11:36:43.116 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:43.117+0000 7ff3ef32a9c0 20 started zone id=d9e72d30-c60b-4d0d-9267-fdc36392d5ad (name=default) with tier type = 2024-09-14T11:36:43.142 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:43.141+0000 7ff3ef32a9c0 20 add_watcher() i=0 2024-09-14T11:36:43.142 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:43.141+0000 7ff3ef32a9c0 20 add_watcher() i=1 2024-09-14T11:36:43.142 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:43.141+0000 7ff3ef32a9c0 20 add_watcher() i=2 2024-09-14T11:36:43.142 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:43.141+0000 7ff3ef32a9c0 20 add_watcher() i=3 2024-09-14T11:36:43.142 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:43.141+0000 7ff3ef32a9c0 20 add_watcher() i=4 2024-09-14T11:36:43.142 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:43.141+0000 7ff3ef32a9c0 20 add_watcher() i=5 2024-09-14T11:36:43.142 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:43.141+0000 7ff3ef32a9c0 20 add_watcher() i=6 2024-09-14T11:36:43.143 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:43.145+0000 7ff3ef32a9c0 20 add_watcher() i=7 2024-09-14T11:36:43.144 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:43.145+0000 7ff3ef32a9c0 2 all 8 watchers are set, enabling cache 2024-09-14T11:36:43.148 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:43.149+0000 7ff2a2fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:36:43.148 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:43.149+0000 7ff3ef32a9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:36:43.148 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:43.149+0000 7ff3ef32a9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:36:43.148 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:43.149+0000 7ff3ef32a9c0 5 note: GC not initialized 2024-09-14T11:36:43.149 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:43.149+0000 7ff2a1fe3640 20 reqs_thread_entry: start 2024-09-14T11:36:43.149 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:43.149+0000 7ff3ef32a9c0 20 init_complete bucket index max shards: 11 2024-09-14T11:36:43.149 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:43.149+0000 7ff3ef32a9c0 20 Filter name: none 2024-09-14T11:36:43.149 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:43.149+0000 7ff2137fe640 20 reqs_thread_entry: start 2024-09-14T11:36:43.149 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:43.149+0000 7ff3ef32a9c0 10 cache get: name=default.rgw.meta+root+error-at-commit-target-layout : miss 2024-09-14T11:36:43.150 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:43.149+0000 7ff3ef32a9c0 20 rados->read ofs=0 len=0 2024-09-14T11:36:43.151 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:43.149+0000 7ff3ef32a9c0 20 rados_obj.operate() r=0 bl.length=197 2024-09-14T11:36:43.151 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:43.149+0000 7ff3ef32a9c0 10 cache put: name=default.rgw.meta+root+error-at-commit-target-layout info.flags=0x11 2024-09-14T11:36:43.151 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:43.149+0000 7ff3ef32a9c0 10 adding default.rgw.meta+root+error-at-commit-target-layout to cache LRU end 2024-09-14T11:36:43.151 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:43.149+0000 7ff3ef32a9c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.30 : miss 2024-09-14T11:36:43.151 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:43.149+0000 7ff3ef32a9c0 20 rados->read ofs=0 len=0 2024-09-14T11:36:43.151 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:43.153+0000 7ff3ef32a9c0 20 rados_obj.operate() r=0 bl.length=419 2024-09-14T11:36:43.152 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:43.153+0000 7ff3ef32a9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.30 info.flags=0x17 2024-09-14T11:36:43.152 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:43.153+0000 7ff3ef32a9c0 10 adding default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.30 to cache LRU end 2024-09-14T11:36:43.152 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:43.153+0000 7ff3ef32a9c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:36:43.152 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:43.153+0000 7ff3ef32a9c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:36:43.152 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:43.153+0000 7ff3ef32a9c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.30 2024-09-14T11:36:43.162 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:43.161+0000 7ff3ef32a9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.30 info.flags=0x17 2024-09-14T11:36:43.162 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:43.161+0000 7ff3ef32a9c0 10 moving default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.30 to cache LRU end 2024-09-14T11:36:43.162 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:43.161+0000 7ff3ef32a9c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:36:43.162 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:43.161+0000 7ff3ef32a9c0 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-commit-target-layout:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.30, ofs0, ns] 2024-09-14T11:36:43.163 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:43.161+0000 7ff2c3fff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366184 cookie 94455525869584 notifier 6653 bl.length()=931 2024-09-14T11:36:43.163 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:43.161+0000 7ff2c3fff640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.30 info.flags=0x17 2024-09-14T11:36:43.163 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:43.161+0000 7ff2c3fff640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.30 to cache LRU end 2024-09-14T11:36:43.163 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:43.161+0000 7ff2c3fff640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:36:43.165 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:43.165+0000 7ff3ef32a9c0 20 handle_bi_update(): bucket=:error-at-commit-target-layout[d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.30]): orig_sources= new_sources= 2024-09-14T11:36:43.165 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:43.165+0000 7ff3ef32a9c0 20 handle_bi_update(): bucket=:error-at-commit-target-layout[d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.30]): potential sources added=[] removed=[] 2024-09-14T11:36:43.165 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:43.165+0000 7ff3ef32a9c0 20 handle_bi_update(): bucket=:error-at-commit-target-layout[d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.30]): orig_dests= new_dests= 2024-09-14T11:36:43.165 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:43.165+0000 7ff3ef32a9c0 20 handle_bi_update(): bucket=:error-at-commit-target-layout[d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.30]): potential dests added=[] removed=[] 2024-09-14T11:36:43.174 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:43.173+0000 7ff3ef32a9c0 10 bucket_obj is .dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.30.1.0 2024-09-14T11:36:43.174 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:43.173+0000 7ff3ef32a9c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.30.1.0 2024-09-14T11:36:43.174 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:43.173+0000 7ff3ef32a9c0 10 bucket_obj is .dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.30.1.1 2024-09-14T11:36:43.174 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:43.173+0000 7ff3ef32a9c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.30.1.1 2024-09-14T11:36:43.174 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:43.173+0000 7ff3ef32a9c0 10 bucket_obj is .dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.30.1.2 2024-09-14T11:36:43.175 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:43.173+0000 7ff3ef32a9c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.30.1.2 2024-09-14T11:36:43.175 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:43.173+0000 7ff3ef32a9c0 10 bucket_obj is .dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.30.1.3 2024-09-14T11:36:43.175 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:43.173+0000 7ff3ef32a9c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.30.1.3 2024-09-14T11:36:43.175 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:43.173+0000 7ff3ef32a9c0 10 bucket_obj is .dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.30.1.4 2024-09-14T11:36:43.175 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:43.173+0000 7ff3ef32a9c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.30.1.4 2024-09-14T11:36:43.175 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:43.173+0000 7ff3ef32a9c0 10 bucket_obj is .dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.30.1.5 2024-09-14T11:36:43.175 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:43.173+0000 7ff3ef32a9c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.30.1.5 2024-09-14T11:36:43.175 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:43.173+0000 7ff3ef32a9c0 10 bucket_obj is .dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.30.1.6 2024-09-14T11:36:43.175 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:43.173+0000 7ff3ef32a9c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.30.1.6 2024-09-14T11:36:43.175 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:43.173+0000 7ff3ef32a9c0 10 bucket_obj is .dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.30.1.7 2024-09-14T11:36:43.175 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:43.173+0000 7ff3ef32a9c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.30.1.7 2024-09-14T11:36:43.175 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:43.173+0000 7ff3ef32a9c0 10 bucket_obj is .dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.30.1.8 2024-09-14T11:36:43.175 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:43.173+0000 7ff3ef32a9c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.30.1.8 2024-09-14T11:36:43.175 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:43.173+0000 7ff3ef32a9c0 10 bucket_obj is .dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.30.1.9 2024-09-14T11:36:43.175 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:43.173+0000 7ff3ef32a9c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.30.1.9 2024-09-14T11:36:43.176 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:43.173+0000 7ff3ef32a9c0 10 bucket_obj is .dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.30.1.10 2024-09-14T11:36:43.176 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:43.173+0000 7ff3ef32a9c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.30.1.10 2024-09-14T11:36:43.176 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:43.173+0000 7ff3ef32a9c0 10 bucket_obj is .dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.30.1.11 2024-09-14T11:36:43.176 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:43.173+0000 7ff3ef32a9c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.30.1.11 2024-09-14T11:36:43.176 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:43.173+0000 7ff3ef32a9c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.30.0 2024-09-14T11:36:43.176 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:43.177+0000 7ff3ef32a9c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.30.1 2024-09-14T11:36:43.177 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:43.177+0000 7ff3ef32a9c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.30.2 2024-09-14T11:36:43.178 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:43.177+0000 7ff3ef32a9c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.30.3 2024-09-14T11:36:43.179 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:43.181+0000 7ff3ef32a9c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.30.4 2024-09-14T11:36:43.180 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:43.181+0000 7ff3ef32a9c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.30.5 2024-09-14T11:36:43.181 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:43.181+0000 7ff3ef32a9c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.30.6 2024-09-14T11:36:43.181 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:43.181+0000 7ff3ef32a9c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.30.7 2024-09-14T11:36:43.182 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:43.181+0000 7ff3ef32a9c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.30.8 2024-09-14T11:36:43.183 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:43.185+0000 7ff3ef32a9c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.30.9 2024-09-14T11:36:43.184 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:43.185+0000 7ff3ef32a9c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.30.10 2024-09-14T11:36:43.190 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:43.189+0000 7ff3ef32a9c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.30 : hit (requested=0x17, cached=0x17) 2024-09-14T11:36:43.190 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:43.189+0000 7ff3ef32a9c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.30 2024-09-14T11:36:43.193 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:43.193+0000 7ff3ef32a9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.30 info.flags=0x17 2024-09-14T11:36:43.193 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:43.193+0000 7ff3ef32a9c0 10 moving default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.30 to cache LRU end 2024-09-14T11:36:43.193 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:43.193+0000 7ff3ef32a9c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:36:43.193 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:43.193+0000 7ff3ef32a9c0 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-commit-target-layout:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.30, ofs0, ns] 2024-09-14T11:36:43.194 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:43.193+0000 7ff2c3fff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366185 cookie 94455525869584 notifier 6653 bl.length()=931 2024-09-14T11:36:43.194 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:43.193+0000 7ff2c3fff640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.30 info.flags=0x17 2024-09-14T11:36:43.194 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:43.193+0000 7ff2c3fff640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.30 to cache LRU end 2024-09-14T11:36:43.194 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:43.193+0000 7ff2c3fff640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:36:43.196 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:43.197+0000 7ff3ef32a9c0 20 handle_bi_update(): bucket=:error-at-commit-target-layout[d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.30]): orig_sources= new_sources= 2024-09-14T11:36:43.196 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:43.197+0000 7ff3ef32a9c0 20 handle_bi_update(): bucket=:error-at-commit-target-layout[d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.30]): potential sources added=[] removed=[] 2024-09-14T11:36:43.196 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:43.197+0000 7ff3ef32a9c0 20 handle_bi_update(): bucket=:error-at-commit-target-layout[d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.30]): orig_dests= new_dests= 2024-09-14T11:36:43.196 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:43.197+0000 7ff3ef32a9c0 20 handle_bi_update(): bucket=:error-at-commit-target-layout[d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.30]): potential dests added=[] removed=[] 2024-09-14T11:36:43.201 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:43.201+0000 7ff3ef32a9c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.30.0 2024-09-14T11:36:43.201 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:43.201+0000 7ff3ef32a9c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.30.1 2024-09-14T11:36:43.202 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:43.201+0000 7ff3ef32a9c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.30.2 2024-09-14T11:36:43.203 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:43.205+0000 7ff3ef32a9c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.30.3 2024-09-14T11:36:43.204 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:43.205+0000 7ff3ef32a9c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.30.4 2024-09-14T11:36:43.205 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:43.205+0000 7ff3ef32a9c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.30.5 2024-09-14T11:36:43.205 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:43.205+0000 7ff3ef32a9c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.30.6 2024-09-14T11:36:43.205 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:43.205+0000 7ff3ef32a9c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.30.7 2024-09-14T11:36:43.206 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:43.205+0000 7ff3ef32a9c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.30.8 2024-09-14T11:36:43.207 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:43.205+0000 7ff3ef32a9c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.30.9 2024-09-14T11:36:43.207 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:43.209+0000 7ff3ef32a9c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.30.10 2024-09-14T11:36:43.207 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:43.209+0000 7ff3ef32a9c0 -1 Injecting error=-5 at location=commit_target_layout 2024-09-14T11:36:43.208 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:43.209+0000 7ff3ef32a9c0 0 ERROR: commit_reshard failed to commit target index layout: (5) Input/output error 2024-09-14T11:36:43.216 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:43.217+0000 7ff2a2fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:36:43.220 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:43.221+0000 7ff3ef32a9c0 20 remove_watcher() i=0 2024-09-14T11:36:43.220 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:43.221+0000 7ff3ef32a9c0 2 removed watcher, disabling cache 2024-09-14T11:36:43.223 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:43.221+0000 7ff3ef32a9c0 20 remove_watcher() i=1 2024-09-14T11:36:43.225 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:43.225+0000 7ff3ef32a9c0 20 remove_watcher() i=2 2024-09-14T11:36:43.228 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:43.229+0000 7ff3ef32a9c0 20 remove_watcher() i=3 2024-09-14T11:36:43.230 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:43.229+0000 7ff3ef32a9c0 20 remove_watcher() i=4 2024-09-14T11:36:43.231 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:43.233+0000 7ff3ef32a9c0 20 remove_watcher() i=5 2024-09-14T11:36:43.233 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:43.233+0000 7ff3ef32a9c0 20 remove_watcher() i=6 2024-09-14T11:36:43.234 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:43.233+0000 7ff3ef32a9c0 20 remove_watcher() i=7 2024-09-14T11:36:43.250 INFO:tasks.workunit.client.0.smithi138.stderr:radosgw-admin bucket stats --bucket error-at-commit-target-layout 2024-09-14T11:36:43.278 INFO:tasks.workunit.client.0.smithi138.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:36:43.278 INFO:tasks.workunit.client.0.smithi138.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:36:43.323 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:43.321+0000 7f2f53a839c0 20 rados->read ofs=0 len=0 2024-09-14T11:36:43.325 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:43.325+0000 7f2f53a839c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:36:43.325 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:43.325+0000 7f2f53a839c0 20 realm 2024-09-14T11:36:43.325 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:43.325+0000 7f2f53a839c0 20 rados->read ofs=0 len=0 2024-09-14T11:36:43.325 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:43.325+0000 7f2f53a839c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:36:43.325 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:43.325+0000 7f2f53a839c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:36:43.325 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:43.325+0000 7f2f53a839c0 20 rados->read ofs=0 len=0 2024-09-14T11:36:43.325 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:43.325+0000 7f2f53a839c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:36:43.325 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:43.325+0000 7f2f53a839c0 20 rados->read ofs=0 len=0 2024-09-14T11:36:43.327 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:43.329+0000 7f2f53a839c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:36:43.327 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:43.329+0000 7f2f53a839c0 20 rados->read ofs=0 len=0 2024-09-14T11:36:43.328 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:43.329+0000 7f2f53a839c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:36:43.328 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:43.329+0000 7f2f53a839c0 20 searching for the correct realm 2024-09-14T11:36:43.331 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:43.333+0000 7f2f51d8a640 0 -- 172.21.15.138:0/2806895447 >> [v2:172.21.15.154:6824/416768175,v1:172.21.15.154:6825/416768175] conn(0x7f2f44067930 msgr2=0x7f2f44063190 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:36:43.549 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:43.549+0000 7f2f50d88640 0 -- 172.21.15.138:0/2806895447 >> [v2:172.21.15.138:6816/326481658,v1:172.21.15.138:6817/326481658] conn(0x7f2f4406dff0 msgr2=0x7f2f4406f5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:36:43.766 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:43.765+0000 7f2f53a839c0 20 RGWRados::pool_iterate: got zone_info.d9e72d30-c60b-4d0d-9267-fdc36392d5ad 2024-09-14T11:36:43.766 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:43.765+0000 7f2f53a839c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:36:43.766 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:43.765+0000 7f2f53a839c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:36:43.766 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:43.765+0000 7f2f53a839c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:36:43.767 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:43.765+0000 7f2f53a839c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:36:43.767 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:43.765+0000 7f2f53a839c0 20 RGWRados::pool_iterate: got zonegroup_info.65ab941b-da8c-4160-94fb-3672b069d44f 2024-09-14T11:36:43.767 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:43.765+0000 7f2f53a839c0 20 rados->read ofs=0 len=0 2024-09-14T11:36:43.767 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:43.765+0000 7f2f53a839c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:36:43.767 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:43.765+0000 7f2f53a839c0 20 rados->read ofs=0 len=0 2024-09-14T11:36:43.767 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:43.769+0000 7f2f53a839c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:36:43.767 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:43.769+0000 7f2f53a839c0 20 rados->read ofs=0 len=0 2024-09-14T11:36:43.769 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:43.769+0000 7f2f53a839c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:36:43.769 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:43.769+0000 7f2f53a839c0 20 zone default found 2024-09-14T11:36:43.769 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:43.769+0000 7f2f53a839c0 4 Realm: () 2024-09-14T11:36:43.769 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:43.769+0000 7f2f53a839c0 4 ZoneGroup: default (65ab941b-da8c-4160-94fb-3672b069d44f) 2024-09-14T11:36:43.769 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:43.769+0000 7f2f53a839c0 4 Zone: default (d9e72d30-c60b-4d0d-9267-fdc36392d5ad) 2024-09-14T11:36:43.769 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:43.769+0000 7f2f53a839c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:36:43.769 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:43.769+0000 7f2f53a839c0 20 zonegroup default 2024-09-14T11:36:43.769 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:43.769+0000 7f2f53a839c0 20 rados->read ofs=0 len=0 2024-09-14T11:36:43.770 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:43.769+0000 7f2f53a839c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:36:43.770 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:43.769+0000 7f2f53a839c0 20 rados->read ofs=0 len=0 2024-09-14T11:36:43.770 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:43.769+0000 7f2f53a839c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:36:43.770 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:43.769+0000 7f2f53a839c0 20 rados->read ofs=0 len=0 2024-09-14T11:36:43.771 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:43.773+0000 7f2f53a839c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:36:43.771 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:43.773+0000 7f2f53a839c0 20 started sync module instance, tier type = 2024-09-14T11:36:43.771 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:43.773+0000 7f2f53a839c0 20 started zone id=d9e72d30-c60b-4d0d-9267-fdc36392d5ad (name=default) with tier type = 2024-09-14T11:36:43.795 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:43.793+0000 7f2f53a839c0 20 add_watcher() i=0 2024-09-14T11:36:43.795 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:43.793+0000 7f2f53a839c0 20 add_watcher() i=1 2024-09-14T11:36:43.795 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:43.793+0000 7f2f53a839c0 20 add_watcher() i=2 2024-09-14T11:36:43.795 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:43.793+0000 7f2f53a839c0 20 add_watcher() i=3 2024-09-14T11:36:43.795 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:43.793+0000 7f2f53a839c0 20 add_watcher() i=4 2024-09-14T11:36:43.795 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:43.793+0000 7f2f53a839c0 20 add_watcher() i=5 2024-09-14T11:36:43.795 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:43.793+0000 7f2f53a839c0 20 add_watcher() i=6 2024-09-14T11:36:43.797 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:43.797+0000 7f2f53a839c0 20 add_watcher() i=7 2024-09-14T11:36:43.798 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:43.797+0000 7f2f53a839c0 2 all 8 watchers are set, enabling cache 2024-09-14T11:36:43.802 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:43.801+0000 7f2e077e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:36:43.803 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:43.801+0000 7f2f53a839c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:36:43.803 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:43.801+0000 7f2f53a839c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:36:43.803 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:43.805+0000 7f2f53a839c0 5 note: GC not initialized 2024-09-14T11:36:43.804 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:43.805+0000 7f2e067e4640 20 reqs_thread_entry: start 2024-09-14T11:36:43.804 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:43.805+0000 7f2f53a839c0 20 init_complete bucket index max shards: 11 2024-09-14T11:36:43.804 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:43.805+0000 7f2f53a839c0 20 Filter name: none 2024-09-14T11:36:43.804 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:43.805+0000 7f2d77fff640 20 reqs_thread_entry: start 2024-09-14T11:36:43.804 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:43.805+0000 7f2f53a839c0 20 rados->read ofs=0 len=0 2024-09-14T11:36:43.805 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:43.805+0000 7f2f53a839c0 20 rados_obj.operate() r=0 bl.length=197 2024-09-14T11:36:43.805 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:43.805+0000 7f2f53a839c0 20 rados->read ofs=0 len=0 2024-09-14T11:36:43.806 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:43.805+0000 7f2f53a839c0 20 rados_obj.operate() r=0 bl.length=451 2024-09-14T11:36:43.806 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:43.805+0000 7f2f53a839c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:36:43.806 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:43.805+0000 7f2f53a839c0 20 rados->read ofs=0 len=0 2024-09-14T11:36:43.807 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:43.809+0000 7f2f53a839c0 20 rados_obj.operate() r=0 bl.length=197 2024-09-14T11:36:43.807 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:43.809+0000 7f2f53a839c0 20 rados->read ofs=0 len=0 2024-09-14T11:36:43.808 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:43.809+0000 7f2f53a839c0 20 rados_obj.operate() r=0 bl.length=451 2024-09-14T11:36:43.808 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:43.809+0000 7f2f53a839c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:36:43.811 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:43.813+0000 7f2e077e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:36:43.816 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:43.817+0000 7f2f53a839c0 20 remove_watcher() i=0 2024-09-14T11:36:43.816 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:43.817+0000 7f2f53a839c0 2 removed watcher, disabling cache 2024-09-14T11:36:43.819 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:43.821+0000 7f2f53a839c0 20 remove_watcher() i=1 2024-09-14T11:36:43.822 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:43.821+0000 7f2f53a839c0 20 remove_watcher() i=2 2024-09-14T11:36:43.824 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:43.825+0000 7f2f53a839c0 20 remove_watcher() i=3 2024-09-14T11:36:43.826 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:43.825+0000 7f2f53a839c0 20 remove_watcher() i=4 2024-09-14T11:36:43.828 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:43.829+0000 7f2f53a839c0 20 remove_watcher() i=5 2024-09-14T11:36:43.830 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:43.829+0000 7f2f53a839c0 20 remove_watcher() i=6 2024-09-14T11:36:43.831 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:43.829+0000 7f2f53a839c0 20 remove_watcher() i=7 2024-09-14T11:36:43.857 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-14T11:36:43.857 INFO:tasks.workunit.client.0.smithi138.stderr:BUCKET_STATS: 2024-09-14T11:36:43.857 INFO:tasks.workunit.client.0.smithi138.stderr:bucket: error-at-commit-target-layout id: d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.30 num_objects: 20 size_kb: 1 num_shards: 11 2024-09-14T11:36:43.857 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-14T11:36:43.858 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:36:43.858 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-14T11:36:43.898 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:36:43.898 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-14T11:36:43.961 INFO:tasks.workunit.client.0.smithi138.stderr:radosgw-admin bucket reshard --bucket error-at-commit-target-layout --num-shards 12 --rgw-reshard-bucket-lock-duration 30 2024-09-14T11:36:43.997 INFO:tasks.workunit.client.0.smithi138.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:36:43.997 INFO:tasks.workunit.client.0.smithi138.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:36:44.042 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:44.041+0000 7ff77dc939c0 20 rados->read ofs=0 len=0 2024-09-14T11:36:44.044 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:44.045+0000 7ff77dc939c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:36:44.044 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:44.045+0000 7ff77dc939c0 20 realm 2024-09-14T11:36:44.044 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:44.045+0000 7ff77dc939c0 20 rados->read ofs=0 len=0 2024-09-14T11:36:44.044 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:44.045+0000 7ff77dc939c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:36:44.044 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:44.045+0000 7ff77dc939c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:36:44.044 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:44.045+0000 7ff77dc939c0 20 rados->read ofs=0 len=0 2024-09-14T11:36:44.044 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:44.045+0000 7ff77dc939c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:36:44.044 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:44.045+0000 7ff77dc939c0 20 rados->read ofs=0 len=0 2024-09-14T11:36:44.045 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:44.045+0000 7ff77dc939c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:36:44.045 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:44.045+0000 7ff77dc939c0 20 rados->read ofs=0 len=0 2024-09-14T11:36:44.046 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:44.045+0000 7ff77dc939c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:36:44.046 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:44.045+0000 7ff77dc939c0 20 searching for the correct realm 2024-09-14T11:36:44.050 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:44.049+0000 7ff77bf9a640 0 -- 172.21.15.138:0/3000511375 >> [v2:172.21.15.154:6824/416768175,v1:172.21.15.154:6825/416768175] conn(0x7ff77401fc00 msgr2=0x7ff774068420 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:36:44.265 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:44.265+0000 7ff77af98640 0 -- 172.21.15.138:0/3000511375 >> [v2:172.21.15.138:6816/326481658,v1:172.21.15.138:6817/326481658] conn(0x7ff774049080 msgr2=0x7ff774008670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:36:44.482 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:44.481+0000 7ff77dc939c0 20 RGWRados::pool_iterate: got zone_info.d9e72d30-c60b-4d0d-9267-fdc36392d5ad 2024-09-14T11:36:44.482 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:44.481+0000 7ff77dc939c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:36:44.482 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:44.481+0000 7ff77dc939c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:36:44.482 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:44.481+0000 7ff77dc939c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:36:44.482 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:44.481+0000 7ff77dc939c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:36:44.482 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:44.481+0000 7ff77dc939c0 20 RGWRados::pool_iterate: got zonegroup_info.65ab941b-da8c-4160-94fb-3672b069d44f 2024-09-14T11:36:44.482 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:44.481+0000 7ff77dc939c0 20 rados->read ofs=0 len=0 2024-09-14T11:36:44.483 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:44.481+0000 7ff77dc939c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:36:44.483 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:44.481+0000 7ff77dc939c0 20 rados->read ofs=0 len=0 2024-09-14T11:36:44.483 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:44.485+0000 7ff77dc939c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:36:44.483 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:44.485+0000 7ff77dc939c0 20 rados->read ofs=0 len=0 2024-09-14T11:36:44.485 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:44.485+0000 7ff77dc939c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:36:44.485 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:44.485+0000 7ff77dc939c0 20 zone default found 2024-09-14T11:36:44.485 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:44.485+0000 7ff77dc939c0 4 Realm: () 2024-09-14T11:36:44.485 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:44.485+0000 7ff77dc939c0 4 ZoneGroup: default (65ab941b-da8c-4160-94fb-3672b069d44f) 2024-09-14T11:36:44.485 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:44.485+0000 7ff77dc939c0 4 Zone: default (d9e72d30-c60b-4d0d-9267-fdc36392d5ad) 2024-09-14T11:36:44.485 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:44.485+0000 7ff77dc939c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:36:44.485 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:44.485+0000 7ff77dc939c0 20 zonegroup default 2024-09-14T11:36:44.485 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:44.485+0000 7ff77dc939c0 20 rados->read ofs=0 len=0 2024-09-14T11:36:44.485 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:44.485+0000 7ff77dc939c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:36:44.486 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:44.485+0000 7ff77dc939c0 20 rados->read ofs=0 len=0 2024-09-14T11:36:44.486 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:44.485+0000 7ff77dc939c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:36:44.486 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:44.485+0000 7ff77dc939c0 20 rados->read ofs=0 len=0 2024-09-14T11:36:44.487 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:44.485+0000 7ff77dc939c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:36:44.487 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:44.485+0000 7ff77dc939c0 20 started sync module instance, tier type = 2024-09-14T11:36:44.487 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:44.489+0000 7ff77dc939c0 20 started zone id=d9e72d30-c60b-4d0d-9267-fdc36392d5ad (name=default) with tier type = 2024-09-14T11:36:44.511 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:44.509+0000 7ff77dc939c0 20 add_watcher() i=0 2024-09-14T11:36:44.511 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:44.509+0000 7ff77dc939c0 20 add_watcher() i=1 2024-09-14T11:36:44.511 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:44.509+0000 7ff77dc939c0 20 add_watcher() i=2 2024-09-14T11:36:44.511 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:44.509+0000 7ff77dc939c0 20 add_watcher() i=3 2024-09-14T11:36:44.511 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:44.509+0000 7ff77dc939c0 20 add_watcher() i=4 2024-09-14T11:36:44.511 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:44.509+0000 7ff77dc939c0 20 add_watcher() i=5 2024-09-14T11:36:44.511 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:44.509+0000 7ff77dc939c0 20 add_watcher() i=6 2024-09-14T11:36:44.513 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:44.513+0000 7ff77dc939c0 20 add_watcher() i=7 2024-09-14T11:36:44.513 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:44.513+0000 7ff77dc939c0 2 all 8 watchers are set, enabling cache 2024-09-14T11:36:44.517 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:44.517+0000 7ff631fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:36:44.518 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:44.517+0000 7ff77dc939c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:36:44.518 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:44.517+0000 7ff77dc939c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:36:44.518 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:44.517+0000 7ff77dc939c0 5 note: GC not initialized 2024-09-14T11:36:44.519 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:44.517+0000 7ff630fe1640 20 reqs_thread_entry: start 2024-09-14T11:36:44.519 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:44.517+0000 7ff77dc939c0 20 init_complete bucket index max shards: 11 2024-09-14T11:36:44.519 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:44.521+0000 7ff77dc939c0 20 Filter name: none 2024-09-14T11:36:44.519 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:44.521+0000 7ff5aa7fc640 20 reqs_thread_entry: start 2024-09-14T11:36:44.520 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:44.521+0000 7ff77dc939c0 10 cache get: name=default.rgw.meta+root+error-at-commit-target-layout : miss 2024-09-14T11:36:44.520 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:44.521+0000 7ff77dc939c0 20 rados->read ofs=0 len=0 2024-09-14T11:36:44.521 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:44.521+0000 7ff77dc939c0 20 rados_obj.operate() r=0 bl.length=197 2024-09-14T11:36:44.521 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:44.521+0000 7ff77dc939c0 10 cache put: name=default.rgw.meta+root+error-at-commit-target-layout info.flags=0x11 2024-09-14T11:36:44.521 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:44.521+0000 7ff77dc939c0 10 adding default.rgw.meta+root+error-at-commit-target-layout to cache LRU end 2024-09-14T11:36:44.521 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:44.521+0000 7ff77dc939c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.30 : miss 2024-09-14T11:36:44.521 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:44.521+0000 7ff77dc939c0 20 rados->read ofs=0 len=0 2024-09-14T11:36:44.521 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:44.521+0000 7ff77dc939c0 20 rados_obj.operate() r=0 bl.length=451 2024-09-14T11:36:44.522 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:44.521+0000 7ff77dc939c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.30 info.flags=0x17 2024-09-14T11:36:44.522 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:44.521+0000 7ff77dc939c0 10 adding default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.30 to cache LRU end 2024-09-14T11:36:44.522 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:44.521+0000 7ff77dc939c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:36:44.522 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:44.521+0000 7ff77dc939c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:36:44.522 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:44.521+0000 7ff77dc939c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.30 2024-09-14T11:36:44.523 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:44.525+0000 7ff77dc939c0 10 init_target_layout removing existing target index objects from a previous reshard attempt 2024-09-14T11:36:44.536 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:44.537+0000 7ff77dc939c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.30 info.flags=0x17 2024-09-14T11:36:44.536 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:44.537+0000 7ff77dc939c0 10 moving default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.30 to cache LRU end 2024-09-14T11:36:44.536 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:44.537+0000 7ff77dc939c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:36:44.536 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:44.537+0000 7ff77dc939c0 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-commit-target-layout:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.30, ofs0, ns] 2024-09-14T11:36:44.536 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:44.537+0000 7ff65effd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366186 cookie 94639219643168 notifier 7158 bl.length()=931 2024-09-14T11:36:44.536 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:44.537+0000 7ff65effd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.30 info.flags=0x17 2024-09-14T11:36:44.536 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:44.537+0000 7ff65effd640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.30 to cache LRU end 2024-09-14T11:36:44.536 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:44.537+0000 7ff65effd640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:36:44.539 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:44.541+0000 7ff77dc939c0 20 handle_bi_update(): bucket=:error-at-commit-target-layout[d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.30]): orig_sources= new_sources= 2024-09-14T11:36:44.540 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:44.541+0000 7ff77dc939c0 20 handle_bi_update(): bucket=:error-at-commit-target-layout[d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.30]): potential sources added=[] removed=[] 2024-09-14T11:36:44.540 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:44.541+0000 7ff77dc939c0 20 handle_bi_update(): bucket=:error-at-commit-target-layout[d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.30]): orig_dests= new_dests= 2024-09-14T11:36:44.540 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:44.541+0000 7ff77dc939c0 20 handle_bi_update(): bucket=:error-at-commit-target-layout[d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.30]): potential dests added=[] removed=[] 2024-09-14T11:36:44.549 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:44.549+0000 7ff77dc939c0 10 bucket_obj is .dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.30.2.0 2024-09-14T11:36:44.549 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:44.549+0000 7ff77dc939c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.30.2.0 2024-09-14T11:36:44.549 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:44.549+0000 7ff77dc939c0 10 bucket_obj is .dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.30.2.1 2024-09-14T11:36:44.549 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:44.549+0000 7ff77dc939c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.30.2.1 2024-09-14T11:36:44.550 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:44.549+0000 7ff77dc939c0 10 bucket_obj is .dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.30.2.2 2024-09-14T11:36:44.550 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:44.549+0000 7ff77dc939c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.30.2.2 2024-09-14T11:36:44.550 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:44.549+0000 7ff77dc939c0 10 bucket_obj is .dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.30.2.3 2024-09-14T11:36:44.550 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:44.549+0000 7ff77dc939c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.30.2.3 2024-09-14T11:36:44.550 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:44.549+0000 7ff77dc939c0 10 bucket_obj is .dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.30.2.4 2024-09-14T11:36:44.550 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:44.549+0000 7ff77dc939c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.30.2.4 2024-09-14T11:36:44.550 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:44.549+0000 7ff77dc939c0 10 bucket_obj is .dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.30.2.5 2024-09-14T11:36:44.550 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:44.549+0000 7ff77dc939c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.30.2.5 2024-09-14T11:36:44.550 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:44.549+0000 7ff77dc939c0 10 bucket_obj is .dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.30.2.6 2024-09-14T11:36:44.550 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:44.549+0000 7ff77dc939c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.30.2.6 2024-09-14T11:36:44.550 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:44.549+0000 7ff77dc939c0 10 bucket_obj is .dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.30.2.7 2024-09-14T11:36:44.550 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:44.549+0000 7ff77dc939c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.30.2.7 2024-09-14T11:36:44.550 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:44.549+0000 7ff77dc939c0 10 bucket_obj is .dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.30.2.8 2024-09-14T11:36:44.550 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:44.549+0000 7ff77dc939c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.30.2.8 2024-09-14T11:36:44.550 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:44.549+0000 7ff77dc939c0 10 bucket_obj is .dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.30.2.9 2024-09-14T11:36:44.551 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:44.549+0000 7ff77dc939c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.30.2.9 2024-09-14T11:36:44.551 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:44.549+0000 7ff77dc939c0 10 bucket_obj is .dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.30.2.10 2024-09-14T11:36:44.551 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:44.549+0000 7ff77dc939c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.30.2.10 2024-09-14T11:36:44.551 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:44.549+0000 7ff77dc939c0 10 bucket_obj is .dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.30.2.11 2024-09-14T11:36:44.551 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:44.549+0000 7ff77dc939c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.30.2.11 2024-09-14T11:36:44.551 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:44.549+0000 7ff77dc939c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.30.0 2024-09-14T11:36:44.551 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:44.549+0000 7ff77dc939c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.30.1 2024-09-14T11:36:44.551 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:44.553+0000 7ff77dc939c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.30.2 2024-09-14T11:36:44.552 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:44.553+0000 7ff77dc939c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.30.3 2024-09-14T11:36:44.553 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:44.553+0000 7ff77dc939c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.30.4 2024-09-14T11:36:44.554 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:44.553+0000 7ff77dc939c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.30.5 2024-09-14T11:36:44.555 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:44.553+0000 7ff77dc939c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.30.6 2024-09-14T11:36:44.555 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:44.557+0000 7ff77dc939c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.30.7 2024-09-14T11:36:44.556 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:44.557+0000 7ff77dc939c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.30.8 2024-09-14T11:36:44.557 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:44.557+0000 7ff77dc939c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.30.9 2024-09-14T11:36:44.558 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:44.557+0000 7ff77dc939c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.30.10 2024-09-14T11:36:44.563 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:44.561+0000 7ff77dc939c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.30 : hit (requested=0x17, cached=0x17) 2024-09-14T11:36:44.563 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:44.561+0000 7ff77dc939c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.30 2024-09-14T11:36:44.565 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:44.565+0000 7ff77dc939c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.30 info.flags=0x17 2024-09-14T11:36:44.565 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:44.565+0000 7ff77dc939c0 10 moving default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.30 to cache LRU end 2024-09-14T11:36:44.565 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:44.565+0000 7ff77dc939c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:36:44.566 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:44.565+0000 7ff77dc939c0 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-commit-target-layout:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.30, ofs0, ns] 2024-09-14T11:36:44.566 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:44.565+0000 7ff65e7fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366187 cookie 94639219643168 notifier 7158 bl.length()=931 2024-09-14T11:36:44.566 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:44.565+0000 7ff65e7fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.30 info.flags=0x17 2024-09-14T11:36:44.566 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:44.565+0000 7ff65e7fc640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.30 to cache LRU end 2024-09-14T11:36:44.566 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:44.565+0000 7ff65e7fc640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:36:44.567 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:44.569+0000 7ff77dc939c0 20 handle_bi_update(): bucket=:error-at-commit-target-layout[d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.30]): orig_sources= new_sources= 2024-09-14T11:36:44.568 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:44.569+0000 7ff77dc939c0 20 handle_bi_update(): bucket=:error-at-commit-target-layout[d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.30]): potential sources added=[] removed=[] 2024-09-14T11:36:44.568 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:44.569+0000 7ff77dc939c0 20 handle_bi_update(): bucket=:error-at-commit-target-layout[d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.30]): orig_dests= new_dests= 2024-09-14T11:36:44.568 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:44.569+0000 7ff77dc939c0 20 handle_bi_update(): bucket=:error-at-commit-target-layout[d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.30]): potential dests added=[] removed=[] 2024-09-14T11:36:44.572 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:44.573+0000 7ff77dc939c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.30.0 2024-09-14T11:36:44.573 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:44.573+0000 7ff77dc939c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.30.1 2024-09-14T11:36:44.574 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:44.573+0000 7ff77dc939c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.30.2 2024-09-14T11:36:44.575 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:44.573+0000 7ff77dc939c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.30.3 2024-09-14T11:36:44.575 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:44.577+0000 7ff77dc939c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.30.4 2024-09-14T11:36:44.576 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:44.577+0000 7ff77dc939c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.30.5 2024-09-14T11:36:44.576 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:44.577+0000 7ff77dc939c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.30.6 2024-09-14T11:36:44.576 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:44.577+0000 7ff77dc939c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.30.7 2024-09-14T11:36:44.577 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:44.577+0000 7ff77dc939c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.30.8 2024-09-14T11:36:44.577 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:44.577+0000 7ff77dc939c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.30.9 2024-09-14T11:36:44.578 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:44.577+0000 7ff77dc939c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.30.10 2024-09-14T11:36:44.578 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:44.577+0000 7ff77dc939c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.30 : hit (requested=0x17, cached=0x17) 2024-09-14T11:36:44.578 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:44.577+0000 7ff77dc939c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.30 2024-09-14T11:36:44.581 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:44.581+0000 7ff77dc939c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.30 info.flags=0x17 2024-09-14T11:36:44.581 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:44.581+0000 7ff77dc939c0 10 moving default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.30 to cache LRU end 2024-09-14T11:36:44.581 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:44.581+0000 7ff77dc939c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:36:44.581 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:44.581+0000 7ff77dc939c0 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-commit-target-layout:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.30, ofs0, ns] 2024-09-14T11:36:44.581 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:44.581+0000 7ff65e7fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366188 cookie 94639219643168 notifier 7158 bl.length()=899 2024-09-14T11:36:44.581 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:44.581+0000 7ff65e7fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.30 info.flags=0x17 2024-09-14T11:36:44.581 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:44.581+0000 7ff65e7fc640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.30 to cache LRU end 2024-09-14T11:36:44.582 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:44.581+0000 7ff65e7fc640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:36:44.583 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:44.585+0000 7ff77dc939c0 20 handle_bi_update(): bucket=:error-at-commit-target-layout[d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.30]): orig_sources= new_sources= 2024-09-14T11:36:44.583 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:44.585+0000 7ff77dc939c0 20 handle_bi_update(): bucket=:error-at-commit-target-layout[d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.30]): potential sources added=[] removed=[] 2024-09-14T11:36:44.583 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:44.585+0000 7ff77dc939c0 20 handle_bi_update(): bucket=:error-at-commit-target-layout[d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.30]): orig_dests= new_dests= 2024-09-14T11:36:44.583 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:44.585+0000 7ff77dc939c0 20 handle_bi_update(): bucket=:error-at-commit-target-layout[d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.30]): potential dests added=[] removed=[] 2024-09-14T11:36:44.588 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:44.589+0000 7ff77dc939c0 1 execute INFO: reshard of bucket "error-at-commit-target-layout" from 11 shards to 12 shards completed successfully 2024-09-14T11:36:44.591 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:44.589+0000 7ff631fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:36:44.596 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:44.597+0000 7ff77dc939c0 20 remove_watcher() i=0 2024-09-14T11:36:44.596 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:44.597+0000 7ff77dc939c0 2 removed watcher, disabling cache 2024-09-14T11:36:44.598 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:44.597+0000 7ff77dc939c0 20 remove_watcher() i=1 2024-09-14T11:36:44.600 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:44.601+0000 7ff77dc939c0 20 remove_watcher() i=2 2024-09-14T11:36:44.602 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:44.601+0000 7ff77dc939c0 20 remove_watcher() i=3 2024-09-14T11:36:44.604 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:44.605+0000 7ff77dc939c0 20 remove_watcher() i=4 2024-09-14T11:36:44.606 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:44.605+0000 7ff77dc939c0 20 remove_watcher() i=5 2024-09-14T11:36:44.607 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:44.609+0000 7ff77dc939c0 20 remove_watcher() i=6 2024-09-14T11:36:44.609 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:44.609+0000 7ff77dc939c0 20 remove_watcher() i=7 2024-09-14T11:36:44.626 INFO:tasks.workunit.client.0.smithi138.stderr:radosgw-admin bucket stats --bucket error-at-commit-target-layout 2024-09-14T11:36:44.656 INFO:tasks.workunit.client.0.smithi138.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:36:44.656 INFO:tasks.workunit.client.0.smithi138.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:36:44.700 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:44.701+0000 7f0aba89c9c0 20 rados->read ofs=0 len=0 2024-09-14T11:36:44.702 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:44.701+0000 7f0aba89c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:36:44.702 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:44.701+0000 7f0aba89c9c0 20 realm 2024-09-14T11:36:44.702 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:44.701+0000 7f0aba89c9c0 20 rados->read ofs=0 len=0 2024-09-14T11:36:44.702 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:44.701+0000 7f0aba89c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:36:44.702 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:44.701+0000 7f0aba89c9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:36:44.703 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:44.701+0000 7f0aba89c9c0 20 rados->read ofs=0 len=0 2024-09-14T11:36:44.703 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:44.701+0000 7f0aba89c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:36:44.703 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:44.701+0000 7f0aba89c9c0 20 rados->read ofs=0 len=0 2024-09-14T11:36:44.704 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:44.705+0000 7f0aba89c9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:36:44.704 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:44.705+0000 7f0aba89c9c0 20 rados->read ofs=0 len=0 2024-09-14T11:36:44.705 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:44.705+0000 7f0aba89c9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:36:44.705 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:44.705+0000 7f0aba89c9c0 20 searching for the correct realm 2024-09-14T11:36:44.710 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:44.709+0000 7f0ab7ba1640 0 -- 172.21.15.138:0/3093662623 >> [v2:172.21.15.154:6808/1468088432,v1:172.21.15.154:6809/1468088432] conn(0x7f0aa800e040 msgr2=0x7f0aa80627b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:36:44.716 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:44.717+0000 7f0ab7ba1640 0 -- 172.21.15.138:0/3093662623 >> [v2:172.21.15.138:6816/326481658,v1:172.21.15.138:6817/326481658] conn(0x7f0ab0103810 msgr2=0x7f0ab00c9850 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:36:44.934 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:44.933+0000 7f0aba89c9c0 20 RGWRados::pool_iterate: got zone_info.d9e72d30-c60b-4d0d-9267-fdc36392d5ad 2024-09-14T11:36:44.935 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:44.933+0000 7f0aba89c9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:36:44.935 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:44.933+0000 7f0aba89c9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:36:44.935 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:44.933+0000 7f0aba89c9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:36:44.935 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:44.933+0000 7f0aba89c9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:36:44.935 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:44.933+0000 7f0aba89c9c0 20 RGWRados::pool_iterate: got zonegroup_info.65ab941b-da8c-4160-94fb-3672b069d44f 2024-09-14T11:36:44.935 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:44.933+0000 7f0aba89c9c0 20 rados->read ofs=0 len=0 2024-09-14T11:36:44.935 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:44.933+0000 7f0aba89c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:36:44.936 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:44.933+0000 7f0aba89c9c0 20 rados->read ofs=0 len=0 2024-09-14T11:36:44.936 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:44.937+0000 7f0aba89c9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:36:44.936 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:44.937+0000 7f0aba89c9c0 20 rados->read ofs=0 len=0 2024-09-14T11:36:44.937 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:44.937+0000 7f0aba89c9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:36:44.937 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:44.937+0000 7f0aba89c9c0 20 zone default found 2024-09-14T11:36:44.937 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:44.937+0000 7f0aba89c9c0 4 Realm: () 2024-09-14T11:36:44.937 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:44.937+0000 7f0aba89c9c0 4 ZoneGroup: default (65ab941b-da8c-4160-94fb-3672b069d44f) 2024-09-14T11:36:44.937 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:44.937+0000 7f0aba89c9c0 4 Zone: default (d9e72d30-c60b-4d0d-9267-fdc36392d5ad) 2024-09-14T11:36:44.937 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:44.937+0000 7f0aba89c9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:36:44.937 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:44.937+0000 7f0aba89c9c0 20 zonegroup default 2024-09-14T11:36:44.937 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:44.937+0000 7f0aba89c9c0 20 rados->read ofs=0 len=0 2024-09-14T11:36:44.938 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:44.937+0000 7f0aba89c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:36:44.938 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:44.937+0000 7f0aba89c9c0 20 rados->read ofs=0 len=0 2024-09-14T11:36:44.938 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:44.937+0000 7f0aba89c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:36:44.938 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:44.937+0000 7f0aba89c9c0 20 rados->read ofs=0 len=0 2024-09-14T11:36:44.939 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:44.937+0000 7f0aba89c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:36:44.939 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:44.937+0000 7f0aba89c9c0 20 started sync module instance, tier type = 2024-09-14T11:36:44.939 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:44.937+0000 7f0aba89c9c0 20 started zone id=d9e72d30-c60b-4d0d-9267-fdc36392d5ad (name=default) with tier type = 2024-09-14T11:36:44.962 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:44.961+0000 7f0aba89c9c0 20 add_watcher() i=0 2024-09-14T11:36:44.962 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:44.961+0000 7f0aba89c9c0 20 add_watcher() i=1 2024-09-14T11:36:44.962 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:44.961+0000 7f0aba89c9c0 20 add_watcher() i=2 2024-09-14T11:36:44.962 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:44.961+0000 7f0aba89c9c0 20 add_watcher() i=3 2024-09-14T11:36:44.962 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:44.961+0000 7f0aba89c9c0 20 add_watcher() i=4 2024-09-14T11:36:44.962 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:44.961+0000 7f0aba89c9c0 20 add_watcher() i=5 2024-09-14T11:36:44.962 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:44.961+0000 7f0aba89c9c0 20 add_watcher() i=6 2024-09-14T11:36:44.963 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:44.965+0000 7f0aba89c9c0 20 add_watcher() i=7 2024-09-14T11:36:44.963 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:44.965+0000 7f0aba89c9c0 2 all 8 watchers are set, enabling cache 2024-09-14T11:36:44.967 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:44.965+0000 7f096efe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:36:44.968 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:44.969+0000 7f0aba89c9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:36:44.968 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:44.969+0000 7f0aba89c9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:36:44.968 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:44.969+0000 7f0aba89c9c0 5 note: GC not initialized 2024-09-14T11:36:44.968 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:44.969+0000 7f096dfe3640 20 reqs_thread_entry: start 2024-09-14T11:36:44.969 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:44.969+0000 7f0aba89c9c0 20 init_complete bucket index max shards: 11 2024-09-14T11:36:44.969 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:44.969+0000 7f0aba89c9c0 20 Filter name: none 2024-09-14T11:36:44.969 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:44.969+0000 7f0966ffd640 20 reqs_thread_entry: start 2024-09-14T11:36:44.969 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:44.969+0000 7f0aba89c9c0 20 rados->read ofs=0 len=0 2024-09-14T11:36:44.970 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:44.969+0000 7f0aba89c9c0 20 rados_obj.operate() r=0 bl.length=197 2024-09-14T11:36:44.970 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:44.969+0000 7f0aba89c9c0 20 rados->read ofs=0 len=0 2024-09-14T11:36:44.971 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:44.969+0000 7f0aba89c9c0 20 rados_obj.operate() r=0 bl.length=419 2024-09-14T11:36:44.971 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:44.969+0000 7f0aba89c9c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:36:44.972 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:44.973+0000 7f0aba89c9c0 20 rados->read ofs=0 len=0 2024-09-14T11:36:44.972 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:44.973+0000 7f0aba89c9c0 20 rados_obj.operate() r=0 bl.length=197 2024-09-14T11:36:44.972 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:44.973+0000 7f0aba89c9c0 20 rados->read ofs=0 len=0 2024-09-14T11:36:44.973 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:44.973+0000 7f0aba89c9c0 20 rados_obj.operate() r=0 bl.length=419 2024-09-14T11:36:44.973 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:44.973+0000 7f0aba89c9c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:36:44.976 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:44.977+0000 7f096efe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:36:44.981 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:44.981+0000 7f0aba89c9c0 20 remove_watcher() i=0 2024-09-14T11:36:44.981 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:44.981+0000 7f0aba89c9c0 2 removed watcher, disabling cache 2024-09-14T11:36:44.983 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:44.981+0000 7f0aba89c9c0 20 remove_watcher() i=1 2024-09-14T11:36:44.985 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:44.985+0000 7f0aba89c9c0 20 remove_watcher() i=2 2024-09-14T11:36:44.987 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:44.989+0000 7f0aba89c9c0 20 remove_watcher() i=3 2024-09-14T11:36:44.989 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:44.989+0000 7f0aba89c9c0 20 remove_watcher() i=4 2024-09-14T11:36:44.990 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:44.989+0000 7f0aba89c9c0 20 remove_watcher() i=5 2024-09-14T11:36:44.992 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:44.993+0000 7f0aba89c9c0 20 remove_watcher() i=6 2024-09-14T11:36:44.993 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:44.993+0000 7f0aba89c9c0 20 remove_watcher() i=7 2024-09-14T11:36:45.010 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-14T11:36:45.010 INFO:tasks.workunit.client.0.smithi138.stderr:BUCKET_STATS: 2024-09-14T11:36:45.010 INFO:tasks.workunit.client.0.smithi138.stderr:bucket: error-at-commit-target-layout id: d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.30 num_objects: 19 size_kb: 1 num_shards: 12 2024-09-14T11:36:45.010 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-14T11:36:45.012 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:36:45.012 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-14T11:36:45.037 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:36:45.037 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-14T11:36:45.518 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:36:45.519 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-14T11:36:45.915 INFO:tasks.workunit.client.0.smithi138.stderr:TEST: reshard bucket with ECANCELED injected at commit_target_layout 2024-09-14T11:36:45.915 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-14T11:36:45.917 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:36:45.917 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-14T11:36:46.076 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:36:46.076 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-14T11:36:46.159 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:36:46.159 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-14T11:36:46.248 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:36:46.248 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-14T11:36:46.335 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:36:46.335 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-14T11:36:46.426 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:36:46.426 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-14T11:36:46.522 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:36:46.522 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-14T11:36:46.618 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:36:46.618 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-14T11:36:46.712 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:36:46.712 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-14T11:36:46.806 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:36:46.806 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-14T11:36:46.900 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:36:46.901 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-14T11:36:46.996 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:36:46.996 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-14T11:36:47.088 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:36:47.088 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-14T11:36:47.177 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:36:47.177 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-14T11:36:47.264 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:36:47.265 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-14T11:36:47.355 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:36:47.355 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-14T11:36:47.446 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:36:47.446 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-14T11:36:47.535 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:36:47.535 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-14T11:36:47.622 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:36:47.623 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-14T11:36:47.716 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:36:47.716 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-14T11:36:47.804 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:36:47.804 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-14T11:36:47.902 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:36:47.902 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-14T11:36:48.002 INFO:tasks.workunit.client.0.smithi138.stderr:radosgw-admin bucket stats --bucket error-at-commit-target-layout 2024-09-14T11:36:48.034 INFO:tasks.workunit.client.0.smithi138.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:36:48.034 INFO:tasks.workunit.client.0.smithi138.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:36:48.082 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:48.081+0000 7fd4b98ab9c0 20 rados->read ofs=0 len=0 2024-09-14T11:36:48.085 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:48.085+0000 7fd4b98ab9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:36:48.085 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:48.085+0000 7fd4b98ab9c0 20 realm 2024-09-14T11:36:48.085 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:48.085+0000 7fd4b98ab9c0 20 rados->read ofs=0 len=0 2024-09-14T11:36:48.085 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:48.085+0000 7fd4b98ab9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:36:48.085 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:48.085+0000 7fd4b98ab9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:36:48.085 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:48.085+0000 7fd4b98ab9c0 20 rados->read ofs=0 len=0 2024-09-14T11:36:48.085 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:48.085+0000 7fd4b98ab9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:36:48.085 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:48.085+0000 7fd4b98ab9c0 20 rados->read ofs=0 len=0 2024-09-14T11:36:48.087 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:48.085+0000 7fd4b98ab9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:36:48.087 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:48.085+0000 7fd4b98ab9c0 20 rados->read ofs=0 len=0 2024-09-14T11:36:48.088 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:48.089+0000 7fd4b98ab9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:36:48.088 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:48.089+0000 7fd4b98ab9c0 20 searching for the correct realm 2024-09-14T11:36:48.092 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:48.093+0000 7fd4b7bb2640 0 -- 172.21.15.138:0/1733376048 >> [v2:172.21.15.154:6824/416768175,v1:172.21.15.154:6825/416768175] conn(0x7fd4b0028420 msgr2=0x7fd4b0028840 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:36:48.098 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:48.097+0000 7fd4b6bb0640 0 -- 172.21.15.138:0/1733376048 >> [v2:172.21.15.138:6816/326481658,v1:172.21.15.138:6817/326481658] conn(0x7fd4b00268e0 msgr2=0x7fd4b000f3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-14T11:36:48.315 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:48.313+0000 7fd4b98ab9c0 20 RGWRados::pool_iterate: got zone_info.d9e72d30-c60b-4d0d-9267-fdc36392d5ad 2024-09-14T11:36:48.315 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:48.313+0000 7fd4b98ab9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:36:48.316 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:48.313+0000 7fd4b98ab9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:36:48.316 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:48.313+0000 7fd4b98ab9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:36:48.316 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:48.313+0000 7fd4b98ab9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:36:48.316 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:48.313+0000 7fd4b98ab9c0 20 RGWRados::pool_iterate: got zonegroup_info.65ab941b-da8c-4160-94fb-3672b069d44f 2024-09-14T11:36:48.316 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:48.313+0000 7fd4b98ab9c0 20 rados->read ofs=0 len=0 2024-09-14T11:36:48.316 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:48.317+0000 7fd4b98ab9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:36:48.316 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:48.317+0000 7fd4b98ab9c0 20 rados->read ofs=0 len=0 2024-09-14T11:36:48.317 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:48.317+0000 7fd4b98ab9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:36:48.317 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:48.317+0000 7fd4b98ab9c0 20 rados->read ofs=0 len=0 2024-09-14T11:36:48.318 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:48.317+0000 7fd4b98ab9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:36:48.318 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:48.317+0000 7fd4b98ab9c0 20 zone default found 2024-09-14T11:36:48.318 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:48.317+0000 7fd4b98ab9c0 4 Realm: () 2024-09-14T11:36:48.318 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:48.317+0000 7fd4b98ab9c0 4 ZoneGroup: default (65ab941b-da8c-4160-94fb-3672b069d44f) 2024-09-14T11:36:48.318 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:48.317+0000 7fd4b98ab9c0 4 Zone: default (d9e72d30-c60b-4d0d-9267-fdc36392d5ad) 2024-09-14T11:36:48.318 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:48.317+0000 7fd4b98ab9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:36:48.318 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:48.317+0000 7fd4b98ab9c0 20 zonegroup default 2024-09-14T11:36:48.318 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:48.317+0000 7fd4b98ab9c0 20 rados->read ofs=0 len=0 2024-09-14T11:36:48.319 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:48.317+0000 7fd4b98ab9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:36:48.319 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:48.317+0000 7fd4b98ab9c0 20 rados->read ofs=0 len=0 2024-09-14T11:36:48.319 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:48.321+0000 7fd4b98ab9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:36:48.319 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:48.321+0000 7fd4b98ab9c0 20 rados->read ofs=0 len=0 2024-09-14T11:36:48.320 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:48.321+0000 7fd4b98ab9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:36:48.320 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:48.321+0000 7fd4b98ab9c0 20 started sync module instance, tier type = 2024-09-14T11:36:48.320 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:48.321+0000 7fd4b98ab9c0 20 started zone id=d9e72d30-c60b-4d0d-9267-fdc36392d5ad (name=default) with tier type = 2024-09-14T11:36:48.343 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:48.341+0000 7fd4b98ab9c0 20 add_watcher() i=0 2024-09-14T11:36:48.343 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:48.341+0000 7fd4b98ab9c0 20 add_watcher() i=1 2024-09-14T11:36:48.343 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:48.341+0000 7fd4b98ab9c0 20 add_watcher() i=2 2024-09-14T11:36:48.343 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:48.341+0000 7fd4b98ab9c0 20 add_watcher() i=3 2024-09-14T11:36:48.343 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:48.341+0000 7fd4b98ab9c0 20 add_watcher() i=4 2024-09-14T11:36:48.343 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:48.341+0000 7fd4b98ab9c0 20 add_watcher() i=5 2024-09-14T11:36:48.344 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:48.345+0000 7fd4b98ab9c0 20 add_watcher() i=6 2024-09-14T11:36:48.345 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:48.345+0000 7fd4b98ab9c0 20 add_watcher() i=7 2024-09-14T11:36:48.346 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:48.345+0000 7fd4b98ab9c0 2 all 8 watchers are set, enabling cache 2024-09-14T11:36:48.350 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:48.349+0000 7fd36dfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:36:48.351 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:48.349+0000 7fd4b98ab9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:36:48.351 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:48.349+0000 7fd4b98ab9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:36:48.351 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:48.349+0000 7fd4b98ab9c0 5 note: GC not initialized 2024-09-14T11:36:48.352 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:48.349+0000 7fd36cfe1640 20 reqs_thread_entry: start 2024-09-14T11:36:48.352 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:48.353+0000 7fd4b98ab9c0 20 init_complete bucket index max shards: 11 2024-09-14T11:36:48.352 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:48.353+0000 7fd4b98ab9c0 20 Filter name: none 2024-09-14T11:36:48.352 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:48.353+0000 7fd2e67fc640 20 reqs_thread_entry: start 2024-09-14T11:36:48.352 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:48.353+0000 7fd4b98ab9c0 20 rados->read ofs=0 len=0 2024-09-14T11:36:48.353 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:48.353+0000 7fd4b98ab9c0 20 rados_obj.operate() r=0 bl.length=197 2024-09-14T11:36:48.353 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:48.353+0000 7fd4b98ab9c0 20 rados->read ofs=0 len=0 2024-09-14T11:36:48.355 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:48.353+0000 7fd4b98ab9c0 20 rados_obj.operate() r=0 bl.length=419 2024-09-14T11:36:48.355 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:48.353+0000 7fd4b98ab9c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:36:48.355 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:48.353+0000 7fd4b98ab9c0 20 rados->read ofs=0 len=0 2024-09-14T11:36:48.355 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:48.357+0000 7fd4b98ab9c0 20 rados_obj.operate() r=0 bl.length=197 2024-09-14T11:36:48.356 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:48.357+0000 7fd4b98ab9c0 20 rados->read ofs=0 len=0 2024-09-14T11:36:48.357 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:48.357+0000 7fd4b98ab9c0 20 rados_obj.operate() r=0 bl.length=419 2024-09-14T11:36:48.357 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:48.357+0000 7fd4b98ab9c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:36:48.360 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:48.361+0000 7fd36dfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:36:48.365 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:48.365+0000 7fd4b98ab9c0 20 remove_watcher() i=0 2024-09-14T11:36:48.365 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:48.365+0000 7fd4b98ab9c0 2 removed watcher, disabling cache 2024-09-14T11:36:48.368 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:48.369+0000 7fd4b98ab9c0 20 remove_watcher() i=1 2024-09-14T11:36:48.370 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:48.369+0000 7fd4b98ab9c0 20 remove_watcher() i=2 2024-09-14T11:36:48.372 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:48.373+0000 7fd4b98ab9c0 20 remove_watcher() i=3 2024-09-14T11:36:48.375 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:48.373+0000 7fd4b98ab9c0 20 remove_watcher() i=4 2024-09-14T11:36:48.376 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:48.377+0000 7fd4b98ab9c0 20 remove_watcher() i=5 2024-09-14T11:36:48.378 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:48.377+0000 7fd4b98ab9c0 20 remove_watcher() i=6 2024-09-14T11:36:48.379 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:48.381+0000 7fd4b98ab9c0 20 remove_watcher() i=7 2024-09-14T11:36:48.396 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-14T11:36:48.396 INFO:tasks.workunit.client.0.smithi138.stderr:BUCKET_STATS: 2024-09-14T11:36:48.396 INFO:tasks.workunit.client.0.smithi138.stderr:bucket: error-at-commit-target-layout id: d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.31 num_objects: 20 size_kb: 1 num_shards: 11 2024-09-14T11:36:48.396 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-14T11:36:48.397 INFO:tasks.workunit.client.0.smithi138.stderr:radosgw-admin bucket reshard --bucket error-at-commit-target-layout --num-shards 12 --rgw-reshard-bucket-lock-duration 30 --inject-error-at commit_target_layout --inject-error-code 125 2024-09-14T11:36:48.432 INFO:tasks.workunit.client.0.smithi138.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:36:48.432 INFO:tasks.workunit.client.0.smithi138.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:36:48.475 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:48.477+0000 7fa44f5699c0 20 rados->read ofs=0 len=0 2024-09-14T11:36:48.477 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:48.477+0000 7fa44f5699c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:36:48.477 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:48.477+0000 7fa44f5699c0 20 realm 2024-09-14T11:36:48.477 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:48.477+0000 7fa44f5699c0 20 rados->read ofs=0 len=0 2024-09-14T11:36:48.477 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:48.477+0000 7fa44f5699c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:36:48.478 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:48.477+0000 7fa44f5699c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:36:48.478 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:48.477+0000 7fa44f5699c0 20 rados->read ofs=0 len=0 2024-09-14T11:36:48.478 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:48.477+0000 7fa44f5699c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:36:48.478 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:48.477+0000 7fa44f5699c0 20 rados->read ofs=0 len=0 2024-09-14T11:36:48.479 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:48.477+0000 7fa44f5699c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:36:48.479 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:48.477+0000 7fa44f5699c0 20 rados->read ofs=0 len=0 2024-09-14T11:36:48.480 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:48.481+0000 7fa44f5699c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:36:48.480 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:48.481+0000 7fa44f5699c0 20 searching for the correct realm 2024-09-14T11:36:48.485 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:48.485+0000 7fa44d870640 0 -- 172.21.15.138:0/569191332 >> [v2:172.21.15.138:6800/1799335858,v1:172.21.15.138:6801/1799335858] conn(0x55a99dd3fb00 msgr2=0x55a99dd41fa0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:36:48.491 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:48.493+0000 7fa44d870640 0 -- 172.21.15.138:0/569191332 >> [v2:172.21.15.154:6824/416768175,v1:172.21.15.154:6825/416768175] conn(0x7fa4480ce030 msgr2=0x7fa4480d0440 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:36:48.498 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:48.497+0000 7fa44f5699c0 20 RGWRados::pool_iterate: got zone_info.d9e72d30-c60b-4d0d-9267-fdc36392d5ad 2024-09-14T11:36:48.499 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:48.497+0000 7fa44f5699c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:36:48.499 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:48.497+0000 7fa44f5699c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:36:48.499 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:48.497+0000 7fa44f5699c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:36:48.499 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:48.497+0000 7fa44f5699c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:36:48.499 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:48.497+0000 7fa44f5699c0 20 RGWRados::pool_iterate: got zonegroup_info.65ab941b-da8c-4160-94fb-3672b069d44f 2024-09-14T11:36:48.499 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:48.497+0000 7fa44f5699c0 20 rados->read ofs=0 len=0 2024-09-14T11:36:48.499 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:48.497+0000 7fa44f5699c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:36:48.499 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:48.497+0000 7fa44f5699c0 20 rados->read ofs=0 len=0 2024-09-14T11:36:48.499 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:48.501+0000 7fa44f5699c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:36:48.500 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:48.501+0000 7fa44f5699c0 20 rados->read ofs=0 len=0 2024-09-14T11:36:48.500 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:48.501+0000 7fa44f5699c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:36:48.500 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:48.501+0000 7fa44f5699c0 20 zone default found 2024-09-14T11:36:48.500 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:48.501+0000 7fa44f5699c0 4 Realm: () 2024-09-14T11:36:48.501 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:48.501+0000 7fa44f5699c0 4 ZoneGroup: default (65ab941b-da8c-4160-94fb-3672b069d44f) 2024-09-14T11:36:48.501 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:48.501+0000 7fa44f5699c0 4 Zone: default (d9e72d30-c60b-4d0d-9267-fdc36392d5ad) 2024-09-14T11:36:48.501 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:48.501+0000 7fa44f5699c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:36:48.501 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:48.501+0000 7fa44f5699c0 20 zonegroup default 2024-09-14T11:36:48.501 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:48.501+0000 7fa44f5699c0 20 rados->read ofs=0 len=0 2024-09-14T11:36:48.501 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:48.501+0000 7fa44f5699c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:36:48.501 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:48.501+0000 7fa44f5699c0 20 rados->read ofs=0 len=0 2024-09-14T11:36:48.502 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:48.501+0000 7fa44f5699c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:36:48.502 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:48.501+0000 7fa44f5699c0 20 rados->read ofs=0 len=0 2024-09-14T11:36:48.502 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:48.501+0000 7fa44f5699c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:36:48.502 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:48.501+0000 7fa44f5699c0 20 started sync module instance, tier type = 2024-09-14T11:36:48.502 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:48.501+0000 7fa44f5699c0 20 started zone id=d9e72d30-c60b-4d0d-9267-fdc36392d5ad (name=default) with tier type = 2024-09-14T11:36:48.517 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:48.517+0000 7fa44f5699c0 20 add_watcher() i=0 2024-09-14T11:36:48.517 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:48.517+0000 7fa44f5699c0 20 add_watcher() i=1 2024-09-14T11:36:48.518 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:48.517+0000 7fa44f5699c0 20 add_watcher() i=2 2024-09-14T11:36:48.518 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:48.517+0000 7fa44f5699c0 20 add_watcher() i=3 2024-09-14T11:36:48.518 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:48.517+0000 7fa44f5699c0 20 add_watcher() i=4 2024-09-14T11:36:48.518 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:48.517+0000 7fa44f5699c0 20 add_watcher() i=5 2024-09-14T11:36:48.518 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:48.517+0000 7fa44f5699c0 20 add_watcher() i=6 2024-09-14T11:36:48.518 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:48.517+0000 7fa44f5699c0 20 add_watcher() i=7 2024-09-14T11:36:48.518 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:48.517+0000 7fa44f5699c0 2 all 8 watchers are set, enabling cache 2024-09-14T11:36:48.521 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:48.521+0000 7fa3037e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:36:48.522 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:48.521+0000 7fa44f5699c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:36:48.522 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:48.521+0000 7fa44f5699c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:36:48.522 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:48.521+0000 7fa44f5699c0 5 note: GC not initialized 2024-09-14T11:36:48.522 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:48.521+0000 7fa3027e4640 20 reqs_thread_entry: start 2024-09-14T11:36:48.522 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:48.521+0000 7fa44f5699c0 20 init_complete bucket index max shards: 11 2024-09-14T11:36:48.522 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:48.521+0000 7fa44f5699c0 20 Filter name: none 2024-09-14T11:36:48.522 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:48.521+0000 7fa273fff640 20 reqs_thread_entry: start 2024-09-14T11:36:48.522 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:48.521+0000 7fa44f5699c0 10 cache get: name=default.rgw.meta+root+error-at-commit-target-layout : miss 2024-09-14T11:36:48.522 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:48.521+0000 7fa44f5699c0 20 rados->read ofs=0 len=0 2024-09-14T11:36:48.523 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:48.521+0000 7fa44f5699c0 20 rados_obj.operate() r=0 bl.length=197 2024-09-14T11:36:48.523 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:48.521+0000 7fa44f5699c0 10 cache put: name=default.rgw.meta+root+error-at-commit-target-layout info.flags=0x11 2024-09-14T11:36:48.523 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:48.521+0000 7fa44f5699c0 10 adding default.rgw.meta+root+error-at-commit-target-layout to cache LRU end 2024-09-14T11:36:48.523 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:48.521+0000 7fa44f5699c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.31 : miss 2024-09-14T11:36:48.523 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:48.521+0000 7fa44f5699c0 20 rados->read ofs=0 len=0 2024-09-14T11:36:48.524 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:48.525+0000 7fa44f5699c0 20 rados_obj.operate() r=0 bl.length=419 2024-09-14T11:36:48.524 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:48.525+0000 7fa44f5699c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.31 info.flags=0x17 2024-09-14T11:36:48.524 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:48.525+0000 7fa44f5699c0 10 adding default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.31 to cache LRU end 2024-09-14T11:36:48.524 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:48.525+0000 7fa44f5699c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:36:48.524 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:48.525+0000 7fa44f5699c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:36:48.524 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:48.525+0000 7fa44f5699c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.31 2024-09-14T11:36:48.539 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:48.537+0000 7fa44f5699c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.31 info.flags=0x17 2024-09-14T11:36:48.539 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:48.537+0000 7fa44f5699c0 10 moving default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.31 to cache LRU end 2024-09-14T11:36:48.539 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:48.537+0000 7fa44f5699c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:36:48.539 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:48.537+0000 7fa44f5699c0 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-commit-target-layout:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.31, ofs0, ns] 2024-09-14T11:36:48.539 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:48.541+0000 7fa31ffff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366191 cookie 94186985825568 notifier 6740 bl.length()=931 2024-09-14T11:36:48.539 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:48.541+0000 7fa31ffff640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.31 info.flags=0x17 2024-09-14T11:36:48.539 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:48.541+0000 7fa31ffff640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.31 to cache LRU end 2024-09-14T11:36:48.540 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:48.541+0000 7fa31ffff640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:36:48.541 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:48.541+0000 7fa44f5699c0 20 handle_bi_update(): bucket=:error-at-commit-target-layout[d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.31]): orig_sources= new_sources= 2024-09-14T11:36:48.541 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:48.541+0000 7fa44f5699c0 20 handle_bi_update(): bucket=:error-at-commit-target-layout[d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.31]): potential sources added=[] removed=[] 2024-09-14T11:36:48.541 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:48.541+0000 7fa44f5699c0 20 handle_bi_update(): bucket=:error-at-commit-target-layout[d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.31]): orig_dests= new_dests= 2024-09-14T11:36:48.541 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:48.541+0000 7fa44f5699c0 20 handle_bi_update(): bucket=:error-at-commit-target-layout[d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.31]): potential dests added=[] removed=[] 2024-09-14T11:36:48.554 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:48.553+0000 7fa44f5699c0 10 bucket_obj is .dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.31.1.0 2024-09-14T11:36:48.555 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:48.553+0000 7fa44f5699c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.31.1.0 2024-09-14T11:36:48.555 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:48.553+0000 7fa44f5699c0 10 bucket_obj is .dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.31.1.1 2024-09-14T11:36:48.555 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:48.553+0000 7fa44f5699c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.31.1.1 2024-09-14T11:36:48.555 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:48.553+0000 7fa44f5699c0 10 bucket_obj is .dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.31.1.2 2024-09-14T11:36:48.555 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:48.553+0000 7fa44f5699c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.31.1.2 2024-09-14T11:36:48.555 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:48.553+0000 7fa44f5699c0 10 bucket_obj is .dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.31.1.3 2024-09-14T11:36:48.555 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:48.553+0000 7fa44f5699c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.31.1.3 2024-09-14T11:36:48.555 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:48.553+0000 7fa44f5699c0 10 bucket_obj is .dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.31.1.4 2024-09-14T11:36:48.555 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:48.553+0000 7fa44f5699c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.31.1.4 2024-09-14T11:36:48.555 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:48.553+0000 7fa44f5699c0 10 bucket_obj is .dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.31.1.5 2024-09-14T11:36:48.555 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:48.553+0000 7fa44f5699c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.31.1.5 2024-09-14T11:36:48.555 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:48.553+0000 7fa44f5699c0 10 bucket_obj is .dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.31.1.6 2024-09-14T11:36:48.555 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:48.553+0000 7fa44f5699c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.31.1.6 2024-09-14T11:36:48.555 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:48.553+0000 7fa44f5699c0 10 bucket_obj is .dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.31.1.7 2024-09-14T11:36:48.556 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:48.553+0000 7fa44f5699c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.31.1.7 2024-09-14T11:36:48.556 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:48.553+0000 7fa44f5699c0 10 bucket_obj is .dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.31.1.8 2024-09-14T11:36:48.556 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:48.553+0000 7fa44f5699c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.31.1.8 2024-09-14T11:36:48.556 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:48.553+0000 7fa44f5699c0 10 bucket_obj is .dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.31.1.9 2024-09-14T11:36:48.556 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:48.553+0000 7fa44f5699c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.31.1.9 2024-09-14T11:36:48.556 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:48.553+0000 7fa44f5699c0 10 bucket_obj is .dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.31.1.10 2024-09-14T11:36:48.556 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:48.553+0000 7fa44f5699c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.31.1.10 2024-09-14T11:36:48.556 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:48.553+0000 7fa44f5699c0 10 bucket_obj is .dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.31.1.11 2024-09-14T11:36:48.556 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:48.553+0000 7fa44f5699c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.31.1.11 2024-09-14T11:36:48.556 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:48.553+0000 7fa44f5699c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.31.0 2024-09-14T11:36:48.557 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:48.557+0000 7fa44f5699c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.31.1 2024-09-14T11:36:48.557 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:48.557+0000 7fa44f5699c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.31.2 2024-09-14T11:36:48.557 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:48.557+0000 7fa44f5699c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.31.3 2024-09-14T11:36:48.558 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:48.557+0000 7fa44f5699c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.31.4 2024-09-14T11:36:48.559 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:48.561+0000 7fa44f5699c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.31.5 2024-09-14T11:36:48.560 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:48.561+0000 7fa44f5699c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.31.6 2024-09-14T11:36:48.561 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:48.561+0000 7fa44f5699c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.31.7 2024-09-14T11:36:48.562 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:48.561+0000 7fa44f5699c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.31.8 2024-09-14T11:36:48.563 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:48.561+0000 7fa44f5699c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.31.9 2024-09-14T11:36:48.563 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:48.565+0000 7fa44f5699c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.31.10 2024-09-14T11:36:48.571 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:48.569+0000 7fa44f5699c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.31 : hit (requested=0x17, cached=0x17) 2024-09-14T11:36:48.571 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:48.569+0000 7fa44f5699c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.31 2024-09-14T11:36:48.574 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:48.573+0000 7fa44f5699c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.31 info.flags=0x17 2024-09-14T11:36:48.574 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:48.573+0000 7fa44f5699c0 10 moving default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.31 to cache LRU end 2024-09-14T11:36:48.574 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:48.573+0000 7fa44f5699c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:36:48.574 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:48.573+0000 7fa44f5699c0 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-commit-target-layout:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.31, ofs0, ns] 2024-09-14T11:36:48.574 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:48.573+0000 7fa31ffff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366192 cookie 94186985825568 notifier 6740 bl.length()=931 2024-09-14T11:36:48.574 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:48.573+0000 7fa31ffff640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.31 info.flags=0x17 2024-09-14T11:36:48.574 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:48.573+0000 7fa31ffff640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.31 to cache LRU end 2024-09-14T11:36:48.574 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:48.573+0000 7fa31ffff640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:36:48.576 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:48.577+0000 7fa44f5699c0 20 handle_bi_update(): bucket=:error-at-commit-target-layout[d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.31]): orig_sources= new_sources= 2024-09-14T11:36:48.576 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:48.577+0000 7fa44f5699c0 20 handle_bi_update(): bucket=:error-at-commit-target-layout[d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.31]): potential sources added=[] removed=[] 2024-09-14T11:36:48.576 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:48.577+0000 7fa44f5699c0 20 handle_bi_update(): bucket=:error-at-commit-target-layout[d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.31]): orig_dests= new_dests= 2024-09-14T11:36:48.576 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:48.577+0000 7fa44f5699c0 20 handle_bi_update(): bucket=:error-at-commit-target-layout[d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.31]): potential dests added=[] removed=[] 2024-09-14T11:36:48.582 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:48.581+0000 7fa44f5699c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.31.0 2024-09-14T11:36:48.582 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:48.581+0000 7fa44f5699c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.31.1 2024-09-14T11:36:48.583 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:48.585+0000 7fa44f5699c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.31.2 2024-09-14T11:36:48.583 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:48.585+0000 7fa44f5699c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.31.3 2024-09-14T11:36:48.584 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:48.585+0000 7fa44f5699c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.31.4 2024-09-14T11:36:48.585 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:48.585+0000 7fa44f5699c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.31.5 2024-09-14T11:36:48.585 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:48.585+0000 7fa44f5699c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.31.6 2024-09-14T11:36:48.586 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:48.585+0000 7fa44f5699c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.31.7 2024-09-14T11:36:48.587 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:48.585+0000 7fa44f5699c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.31.8 2024-09-14T11:36:48.587 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:48.589+0000 7fa44f5699c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.31.9 2024-09-14T11:36:48.587 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:48.589+0000 7fa44f5699c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.31.10 2024-09-14T11:36:48.590 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:48.589+0000 7fa44f5699c0 -1 Injecting error=-125 at location=commit_target_layout 2024-09-14T11:36:48.590 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:48.589+0000 7fa44f5699c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.31 : hit (requested=0x17, cached=0x17) 2024-09-14T11:36:48.590 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:48.589+0000 7fa44f5699c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.31 2024-09-14T11:36:48.593 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:48.593+0000 7fa44f5699c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.31 info.flags=0x17 2024-09-14T11:36:48.593 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:48.593+0000 7fa44f5699c0 10 moving default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.31 to cache LRU end 2024-09-14T11:36:48.593 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:48.593+0000 7fa44f5699c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:36:48.593 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:48.593+0000 7fa44f5699c0 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-commit-target-layout:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.31, ofs0, ns] 2024-09-14T11:36:48.593 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:48.593+0000 7fa31ffff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366193 cookie 94186985825568 notifier 6740 bl.length()=899 2024-09-14T11:36:48.593 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:48.593+0000 7fa31ffff640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.31 info.flags=0x17 2024-09-14T11:36:48.593 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:48.593+0000 7fa31ffff640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.31 to cache LRU end 2024-09-14T11:36:48.593 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:48.593+0000 7fa31ffff640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:36:48.595 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:48.593+0000 7fa44f5699c0 20 handle_bi_update(): bucket=:error-at-commit-target-layout[d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.31]): orig_sources= new_sources= 2024-09-14T11:36:48.595 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:48.593+0000 7fa44f5699c0 20 handle_bi_update(): bucket=:error-at-commit-target-layout[d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.31]): potential sources added=[] removed=[] 2024-09-14T11:36:48.595 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:48.593+0000 7fa44f5699c0 20 handle_bi_update(): bucket=:error-at-commit-target-layout[d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.31]): orig_dests= new_dests= 2024-09-14T11:36:48.595 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:48.593+0000 7fa44f5699c0 20 handle_bi_update(): bucket=:error-at-commit-target-layout[d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.31]): potential dests added=[] removed=[] 2024-09-14T11:36:48.600 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:48.601+0000 7fa44f5699c0 1 execute INFO: reshard of bucket "error-at-commit-target-layout" from 11 shards to 12 shards completed successfully 2024-09-14T11:36:48.604 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:48.605+0000 7fa3037e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:36:48.609 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:48.609+0000 7fa44f5699c0 20 remove_watcher() i=0 2024-09-14T11:36:48.609 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:48.609+0000 7fa44f5699c0 2 removed watcher, disabling cache 2024-09-14T11:36:48.611 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:48.609+0000 7fa44f5699c0 20 remove_watcher() i=1 2024-09-14T11:36:48.613 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:48.613+0000 7fa44f5699c0 20 remove_watcher() i=2 2024-09-14T11:36:48.615 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:48.617+0000 7fa44f5699c0 20 remove_watcher() i=3 2024-09-14T11:36:48.618 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:48.617+0000 7fa44f5699c0 20 remove_watcher() i=4 2024-09-14T11:36:48.619 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:48.621+0000 7fa44f5699c0 20 remove_watcher() i=5 2024-09-14T11:36:48.620 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:48.621+0000 7fa44f5699c0 20 remove_watcher() i=6 2024-09-14T11:36:48.622 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:48.621+0000 7fa44f5699c0 20 remove_watcher() i=7 2024-09-14T11:36:48.636 INFO:tasks.workunit.client.0.smithi138.stderr:radosgw-admin bucket stats --bucket error-at-commit-target-layout 2024-09-14T11:36:48.663 INFO:tasks.workunit.client.0.smithi138.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:36:48.663 INFO:tasks.workunit.client.0.smithi138.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:36:48.708 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:48.709+0000 7fca48d5a9c0 20 rados->read ofs=0 len=0 2024-09-14T11:36:48.710 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:48.709+0000 7fca48d5a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:36:48.710 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:48.709+0000 7fca48d5a9c0 20 realm 2024-09-14T11:36:48.710 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:48.709+0000 7fca48d5a9c0 20 rados->read ofs=0 len=0 2024-09-14T11:36:48.710 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:48.709+0000 7fca48d5a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:36:48.710 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:48.709+0000 7fca48d5a9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:36:48.710 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:48.709+0000 7fca48d5a9c0 20 rados->read ofs=0 len=0 2024-09-14T11:36:48.710 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:48.709+0000 7fca48d5a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:36:48.710 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:48.709+0000 7fca48d5a9c0 20 rados->read ofs=0 len=0 2024-09-14T11:36:48.712 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:48.713+0000 7fca48d5a9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:36:48.712 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:48.713+0000 7fca48d5a9c0 20 rados->read ofs=0 len=0 2024-09-14T11:36:48.713 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:48.713+0000 7fca48d5a9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:36:48.713 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:48.713+0000 7fca48d5a9c0 20 searching for the correct realm 2024-09-14T11:36:48.718 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:48.717+0000 7fca46860640 0 -- 172.21.15.138:0/967865305 >> [v2:172.21.15.138:6808/3258321916,v1:172.21.15.138:6809/3258321916] conn(0x56272dea6160 msgr2=0x56272dea8620 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:36:48.724 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:48.725+0000 7fca4605f640 0 -- 172.21.15.138:0/967865305 >> [v2:172.21.15.138:6816/326481658,v1:172.21.15.138:6817/326481658] conn(0x7fca4006a870 msgr2=0x7fca40080aa0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:36:48.731 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:48.729+0000 7fca48d5a9c0 20 RGWRados::pool_iterate: got zone_info.d9e72d30-c60b-4d0d-9267-fdc36392d5ad 2024-09-14T11:36:48.731 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:48.729+0000 7fca48d5a9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:36:48.731 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:48.729+0000 7fca48d5a9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:36:48.731 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:48.729+0000 7fca48d5a9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:36:48.731 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:48.729+0000 7fca48d5a9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:36:48.731 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:48.729+0000 7fca48d5a9c0 20 RGWRados::pool_iterate: got zonegroup_info.65ab941b-da8c-4160-94fb-3672b069d44f 2024-09-14T11:36:48.731 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:48.729+0000 7fca48d5a9c0 20 rados->read ofs=0 len=0 2024-09-14T11:36:48.731 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:48.729+0000 7fca48d5a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:36:48.731 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:48.729+0000 7fca48d5a9c0 20 rados->read ofs=0 len=0 2024-09-14T11:36:48.732 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:48.733+0000 7fca48d5a9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:36:48.732 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:48.733+0000 7fca48d5a9c0 20 rados->read ofs=0 len=0 2024-09-14T11:36:48.733 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:48.733+0000 7fca48d5a9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:36:48.733 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:48.733+0000 7fca48d5a9c0 20 zone default found 2024-09-14T11:36:48.733 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:48.733+0000 7fca48d5a9c0 4 Realm: () 2024-09-14T11:36:48.733 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:48.733+0000 7fca48d5a9c0 4 ZoneGroup: default (65ab941b-da8c-4160-94fb-3672b069d44f) 2024-09-14T11:36:48.733 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:48.733+0000 7fca48d5a9c0 4 Zone: default (d9e72d30-c60b-4d0d-9267-fdc36392d5ad) 2024-09-14T11:36:48.733 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:48.733+0000 7fca48d5a9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:36:48.733 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:48.733+0000 7fca48d5a9c0 20 zonegroup default 2024-09-14T11:36:48.733 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:48.733+0000 7fca48d5a9c0 20 rados->read ofs=0 len=0 2024-09-14T11:36:48.733 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:48.733+0000 7fca48d5a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:36:48.733 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:48.733+0000 7fca48d5a9c0 20 rados->read ofs=0 len=0 2024-09-14T11:36:48.734 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:48.733+0000 7fca48d5a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:36:48.734 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:48.733+0000 7fca48d5a9c0 20 rados->read ofs=0 len=0 2024-09-14T11:36:48.734 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:48.733+0000 7fca48d5a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:36:48.734 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:48.733+0000 7fca48d5a9c0 20 started sync module instance, tier type = 2024-09-14T11:36:48.734 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:48.733+0000 7fca48d5a9c0 20 started zone id=d9e72d30-c60b-4d0d-9267-fdc36392d5ad (name=default) with tier type = 2024-09-14T11:36:48.749 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:48.749+0000 7fca48d5a9c0 20 add_watcher() i=0 2024-09-14T11:36:48.749 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:48.749+0000 7fca48d5a9c0 20 add_watcher() i=1 2024-09-14T11:36:48.749 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:48.749+0000 7fca48d5a9c0 20 add_watcher() i=2 2024-09-14T11:36:48.749 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:48.749+0000 7fca48d5a9c0 20 add_watcher() i=3 2024-09-14T11:36:48.749 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:48.749+0000 7fca48d5a9c0 20 add_watcher() i=4 2024-09-14T11:36:48.749 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:48.749+0000 7fca48d5a9c0 20 add_watcher() i=5 2024-09-14T11:36:48.749 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:48.749+0000 7fca48d5a9c0 20 add_watcher() i=6 2024-09-14T11:36:48.750 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:48.749+0000 7fca48d5a9c0 20 add_watcher() i=7 2024-09-14T11:36:48.750 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:48.749+0000 7fca48d5a9c0 2 all 8 watchers are set, enabling cache 2024-09-14T11:36:48.753 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:48.753+0000 7fc8fd7e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:36:48.754 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:48.753+0000 7fca48d5a9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:36:48.754 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:48.753+0000 7fca48d5a9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:36:48.754 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:48.753+0000 7fca48d5a9c0 5 note: GC not initialized 2024-09-14T11:36:48.754 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:48.753+0000 7fc877fff640 20 reqs_thread_entry: start 2024-09-14T11:36:48.754 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:48.753+0000 7fca48d5a9c0 20 init_complete bucket index max shards: 11 2024-09-14T11:36:48.754 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:48.753+0000 7fca48d5a9c0 20 Filter name: none 2024-09-14T11:36:48.754 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:48.753+0000 7fc875ffb640 20 reqs_thread_entry: start 2024-09-14T11:36:48.754 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:48.753+0000 7fca48d5a9c0 20 rados->read ofs=0 len=0 2024-09-14T11:36:48.755 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:48.753+0000 7fca48d5a9c0 20 rados_obj.operate() r=0 bl.length=197 2024-09-14T11:36:48.755 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:48.753+0000 7fca48d5a9c0 20 rados->read ofs=0 len=0 2024-09-14T11:36:48.756 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:48.757+0000 7fca48d5a9c0 20 rados_obj.operate() r=0 bl.length=419 2024-09-14T11:36:48.756 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:48.757+0000 7fca48d5a9c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:36:48.756 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:48.757+0000 7fca48d5a9c0 20 rados->read ofs=0 len=0 2024-09-14T11:36:48.757 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:48.757+0000 7fca48d5a9c0 20 rados_obj.operate() r=0 bl.length=197 2024-09-14T11:36:48.757 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:48.757+0000 7fca48d5a9c0 20 rados->read ofs=0 len=0 2024-09-14T11:36:48.758 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:48.757+0000 7fca48d5a9c0 20 rados_obj.operate() r=0 bl.length=419 2024-09-14T11:36:48.758 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:48.757+0000 7fca48d5a9c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:36:48.761 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:48.761+0000 7fc8fd7e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:36:48.766 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:48.765+0000 7fca48d5a9c0 20 remove_watcher() i=0 2024-09-14T11:36:48.766 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:48.765+0000 7fca48d5a9c0 2 removed watcher, disabling cache 2024-09-14T11:36:48.768 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:48.769+0000 7fca48d5a9c0 20 remove_watcher() i=1 2024-09-14T11:36:48.769 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:48.769+0000 7fca48d5a9c0 20 remove_watcher() i=2 2024-09-14T11:36:48.772 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:48.773+0000 7fca48d5a9c0 20 remove_watcher() i=3 2024-09-14T11:36:48.773 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:48.773+0000 7fca48d5a9c0 20 remove_watcher() i=4 2024-09-14T11:36:48.775 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:48.773+0000 7fca48d5a9c0 20 remove_watcher() i=5 2024-09-14T11:36:48.776 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:48.777+0000 7fca48d5a9c0 20 remove_watcher() i=6 2024-09-14T11:36:48.777 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:48.777+0000 7fca48d5a9c0 20 remove_watcher() i=7 2024-09-14T11:36:48.790 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-14T11:36:48.791 INFO:tasks.workunit.client.0.smithi138.stderr:BUCKET_STATS: 2024-09-14T11:36:48.791 INFO:tasks.workunit.client.0.smithi138.stderr:bucket: error-at-commit-target-layout id: d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.31 num_objects: 20 size_kb: 1 num_shards: 12 2024-09-14T11:36:48.791 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-14T11:36:48.792 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:36:48.792 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-14T11:36:48.815 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:36:48.815 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-14T11:36:49.237 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:36:49.237 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-14T11:36:49.624 INFO:tasks.workunit.client.0.smithi138.stderr:TEST: reshard bucket with abort at commit_target_layout 2024-09-14T11:36:49.624 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-14T11:36:49.627 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:36:49.627 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-14T11:36:49.764 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:36:49.764 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-14T11:36:49.852 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:36:49.852 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-14T11:36:49.950 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:36:49.951 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-14T11:36:50.048 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:36:50.048 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-14T11:36:50.127 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:36:50.127 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-14T11:36:50.184 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:36:50.184 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-14T11:36:50.280 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:36:50.280 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-14T11:36:50.375 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:36:50.375 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-14T11:36:50.465 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:36:50.466 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-14T11:36:50.563 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:36:50.563 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-14T11:36:50.660 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:36:50.660 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-14T11:36:50.754 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:36:50.755 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-14T11:36:50.855 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:36:50.855 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-14T11:36:50.949 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:36:50.949 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-14T11:36:51.056 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:36:51.056 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-14T11:36:51.153 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:36:51.153 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-14T11:36:51.242 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:36:51.242 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-14T11:36:51.332 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:36:51.332 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-14T11:36:51.418 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:36:51.418 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-14T11:36:51.516 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:36:51.516 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-14T11:36:51.617 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:36:51.617 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-14T11:36:51.708 INFO:tasks.workunit.client.0.smithi138.stderr:radosgw-admin bucket stats --bucket abort-at-commit-target-layout 2024-09-14T11:36:51.740 INFO:tasks.workunit.client.0.smithi138.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:36:51.740 INFO:tasks.workunit.client.0.smithi138.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:36:51.786 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:51.785+0000 7f8b58aa89c0 20 rados->read ofs=0 len=0 2024-09-14T11:36:51.788 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:51.789+0000 7f8b58aa89c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:36:51.789 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:51.789+0000 7f8b58aa89c0 20 realm 2024-09-14T11:36:51.789 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:51.789+0000 7f8b58aa89c0 20 rados->read ofs=0 len=0 2024-09-14T11:36:51.789 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:51.789+0000 7f8b58aa89c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:36:51.789 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:51.789+0000 7f8b58aa89c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:36:51.789 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:51.789+0000 7f8b58aa89c0 20 rados->read ofs=0 len=0 2024-09-14T11:36:51.789 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:51.789+0000 7f8b58aa89c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:36:51.789 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:51.789+0000 7f8b58aa89c0 20 rados->read ofs=0 len=0 2024-09-14T11:36:51.790 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:51.789+0000 7f8b58aa89c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:36:51.790 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:51.789+0000 7f8b58aa89c0 20 rados->read ofs=0 len=0 2024-09-14T11:36:51.791 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:51.789+0000 7f8b58aa89c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:36:51.791 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:51.789+0000 7f8b58aa89c0 20 searching for the correct realm 2024-09-14T11:36:51.794 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:51.793+0000 7f8b56daf640 0 -- 172.21.15.138:0/3293999051 >> [v2:172.21.15.154:6824/416768175,v1:172.21.15.154:6825/416768175] conn(0x7f8b5003c070 msgr2=0x7f8b50065750 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-14T11:36:52.009 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:52.009+0000 7f8b55dad640 0 -- 172.21.15.138:0/3293999051 >> [v2:172.21.15.138:6816/326481658,v1:172.21.15.138:6817/326481658] conn(0x7f8b5006f040 msgr2=0x7f8b5009a7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:36:52.227 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:52.225+0000 7f8b58aa89c0 20 RGWRados::pool_iterate: got zone_info.d9e72d30-c60b-4d0d-9267-fdc36392d5ad 2024-09-14T11:36:52.227 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:52.225+0000 7f8b58aa89c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:36:52.227 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:52.225+0000 7f8b58aa89c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:36:52.228 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:52.225+0000 7f8b58aa89c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:36:52.228 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:52.225+0000 7f8b58aa89c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:36:52.228 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:52.225+0000 7f8b58aa89c0 20 RGWRados::pool_iterate: got zonegroup_info.65ab941b-da8c-4160-94fb-3672b069d44f 2024-09-14T11:36:52.228 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:52.225+0000 7f8b58aa89c0 20 rados->read ofs=0 len=0 2024-09-14T11:36:52.229 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:52.229+0000 7f8b58aa89c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:36:52.229 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:52.229+0000 7f8b58aa89c0 20 rados->read ofs=0 len=0 2024-09-14T11:36:52.229 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:52.229+0000 7f8b58aa89c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:36:52.229 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:52.229+0000 7f8b58aa89c0 20 rados->read ofs=0 len=0 2024-09-14T11:36:52.230 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:52.229+0000 7f8b58aa89c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:36:52.230 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:52.229+0000 7f8b58aa89c0 20 zone default found 2024-09-14T11:36:52.230 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:52.229+0000 7f8b58aa89c0 4 Realm: () 2024-09-14T11:36:52.230 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:52.229+0000 7f8b58aa89c0 4 ZoneGroup: default (65ab941b-da8c-4160-94fb-3672b069d44f) 2024-09-14T11:36:52.230 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:52.229+0000 7f8b58aa89c0 4 Zone: default (d9e72d30-c60b-4d0d-9267-fdc36392d5ad) 2024-09-14T11:36:52.230 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:52.229+0000 7f8b58aa89c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:36:52.231 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:52.229+0000 7f8b58aa89c0 20 zonegroup default 2024-09-14T11:36:52.231 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:52.229+0000 7f8b58aa89c0 20 rados->read ofs=0 len=0 2024-09-14T11:36:52.231 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:52.229+0000 7f8b58aa89c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:36:52.231 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:52.229+0000 7f8b58aa89c0 20 rados->read ofs=0 len=0 2024-09-14T11:36:52.232 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:52.233+0000 7f8b58aa89c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:36:52.232 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:52.233+0000 7f8b58aa89c0 20 rados->read ofs=0 len=0 2024-09-14T11:36:52.232 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:52.233+0000 7f8b58aa89c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:36:52.232 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:52.233+0000 7f8b58aa89c0 20 started sync module instance, tier type = 2024-09-14T11:36:52.233 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:52.233+0000 7f8b58aa89c0 20 started zone id=d9e72d30-c60b-4d0d-9267-fdc36392d5ad (name=default) with tier type = 2024-09-14T11:36:52.256 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:52.257+0000 7f8b58aa89c0 20 add_watcher() i=0 2024-09-14T11:36:52.256 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:52.257+0000 7f8b58aa89c0 20 add_watcher() i=1 2024-09-14T11:36:52.257 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:52.257+0000 7f8b58aa89c0 20 add_watcher() i=2 2024-09-14T11:36:52.257 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:52.257+0000 7f8b58aa89c0 20 add_watcher() i=3 2024-09-14T11:36:52.257 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:52.257+0000 7f8b58aa89c0 20 add_watcher() i=4 2024-09-14T11:36:52.257 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:52.257+0000 7f8b58aa89c0 20 add_watcher() i=5 2024-09-14T11:36:52.257 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:52.257+0000 7f8b58aa89c0 20 add_watcher() i=6 2024-09-14T11:36:52.259 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:52.257+0000 7f8b58aa89c0 20 add_watcher() i=7 2024-09-14T11:36:52.259 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:52.257+0000 7f8b58aa89c0 2 all 8 watchers are set, enabling cache 2024-09-14T11:36:52.263 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:52.261+0000 7f8a0cfe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:36:52.264 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:52.265+0000 7f8b58aa89c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:36:52.264 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:52.265+0000 7f8b58aa89c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:36:52.264 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:52.265+0000 7f8b58aa89c0 5 note: GC not initialized 2024-09-14T11:36:52.265 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:52.265+0000 7f89877fe640 20 reqs_thread_entry: start 2024-09-14T11:36:52.265 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:52.265+0000 7f8b58aa89c0 20 init_complete bucket index max shards: 11 2024-09-14T11:36:52.265 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:52.265+0000 7f8b58aa89c0 20 Filter name: none 2024-09-14T11:36:52.266 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:52.265+0000 7f89857fa640 20 reqs_thread_entry: start 2024-09-14T11:36:52.266 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:52.265+0000 7f8b58aa89c0 20 rados->read ofs=0 len=0 2024-09-14T11:36:52.266 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:52.265+0000 7f8b58aa89c0 20 rados_obj.operate() r=0 bl.length=197 2024-09-14T11:36:52.266 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:52.265+0000 7f8b58aa89c0 20 rados->read ofs=0 len=0 2024-09-14T11:36:52.267 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:52.269+0000 7f8b58aa89c0 20 rados_obj.operate() r=0 bl.length=419 2024-09-14T11:36:52.268 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:52.269+0000 7f8b58aa89c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:36:52.268 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:52.269+0000 7f8b58aa89c0 20 rados->read ofs=0 len=0 2024-09-14T11:36:52.268 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:52.269+0000 7f8b58aa89c0 20 rados_obj.operate() r=0 bl.length=197 2024-09-14T11:36:52.268 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:52.269+0000 7f8b58aa89c0 20 rados->read ofs=0 len=0 2024-09-14T11:36:52.269 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:52.269+0000 7f8b58aa89c0 20 rados_obj.operate() r=0 bl.length=419 2024-09-14T11:36:52.269 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:52.269+0000 7f8b58aa89c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:36:52.272 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:52.273+0000 7f8a0cfe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:36:52.277 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:52.277+0000 7f8b58aa89c0 20 remove_watcher() i=0 2024-09-14T11:36:52.277 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:52.277+0000 7f8b58aa89c0 2 removed watcher, disabling cache 2024-09-14T11:36:52.280 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:52.281+0000 7f8b58aa89c0 20 remove_watcher() i=1 2024-09-14T11:36:52.283 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:52.281+0000 7f8b58aa89c0 20 remove_watcher() i=2 2024-09-14T11:36:52.285 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:52.285+0000 7f8b58aa89c0 20 remove_watcher() i=3 2024-09-14T11:36:52.288 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:52.289+0000 7f8b58aa89c0 20 remove_watcher() i=4 2024-09-14T11:36:52.290 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:52.289+0000 7f8b58aa89c0 20 remove_watcher() i=5 2024-09-14T11:36:52.291 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:52.293+0000 7f8b58aa89c0 20 remove_watcher() i=6 2024-09-14T11:36:52.293 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:52.293+0000 7f8b58aa89c0 20 remove_watcher() i=7 2024-09-14T11:36:52.314 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-14T11:36:52.314 INFO:tasks.workunit.client.0.smithi138.stderr:BUCKET_STATS: 2024-09-14T11:36:52.314 INFO:tasks.workunit.client.0.smithi138.stderr:bucket: abort-at-commit-target-layout id: d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.32 num_objects: 20 size_kb: 1 num_shards: 11 2024-09-14T11:36:52.314 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-14T11:36:52.314 INFO:tasks.workunit.client.0.smithi138.stderr:radosgw-admin bucket reshard --bucket abort-at-commit-target-layout --num-shards 12 --rgw-reshard-bucket-lock-duration 30 --inject-abort-at commit_target_layout 2024-09-14T11:36:52.347 INFO:tasks.workunit.client.0.smithi138.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:36:52.347 INFO:tasks.workunit.client.0.smithi138.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:36:52.390 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:52.389+0000 7f4882e199c0 20 rados->read ofs=0 len=0 2024-09-14T11:36:52.392 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:52.393+0000 7f4882e199c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:36:52.392 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:52.393+0000 7f4882e199c0 20 realm 2024-09-14T11:36:52.393 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:52.393+0000 7f4882e199c0 20 rados->read ofs=0 len=0 2024-09-14T11:36:52.393 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:52.393+0000 7f4882e199c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:36:52.393 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:52.393+0000 7f4882e199c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:36:52.393 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:52.393+0000 7f4882e199c0 20 rados->read ofs=0 len=0 2024-09-14T11:36:52.393 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:52.393+0000 7f4882e199c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:36:52.393 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:52.393+0000 7f4882e199c0 20 rados->read ofs=0 len=0 2024-09-14T11:36:52.394 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:52.393+0000 7f4882e199c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:36:52.394 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:52.393+0000 7f4882e199c0 20 rados->read ofs=0 len=0 2024-09-14T11:36:52.395 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:52.393+0000 7f4882e199c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:36:52.395 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:52.393+0000 7f4882e199c0 20 searching for the correct realm 2024-09-14T11:36:52.399 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:52.401+0000 7f487bfff640 0 -- 172.21.15.138:0/3095715856 >> [v2:172.21.15.154:6808/1468088432,v1:172.21.15.154:6809/1468088432] conn(0x7f4874136030 msgr2=0x7f4874121b40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:36:52.405 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:52.405+0000 7f487bfff640 0 -- 172.21.15.138:0/3095715856 >> [v2:172.21.15.138:6816/326481658,v1:172.21.15.138:6817/326481658] conn(0x7f487c04e400 msgr2=0x7f487c04e880 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:36:52.620 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:52.621+0000 7f4882e199c0 20 RGWRados::pool_iterate: got zone_info.d9e72d30-c60b-4d0d-9267-fdc36392d5ad 2024-09-14T11:36:52.621 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:52.621+0000 7f4882e199c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:36:52.621 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:52.621+0000 7f4882e199c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:36:52.621 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:52.621+0000 7f4882e199c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:36:52.621 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:52.621+0000 7f4882e199c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:36:52.621 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:52.621+0000 7f4882e199c0 20 RGWRados::pool_iterate: got zonegroup_info.65ab941b-da8c-4160-94fb-3672b069d44f 2024-09-14T11:36:52.621 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:52.621+0000 7f4882e199c0 20 rados->read ofs=0 len=0 2024-09-14T11:36:52.622 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:52.621+0000 7f4882e199c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:36:52.622 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:52.621+0000 7f4882e199c0 20 rados->read ofs=0 len=0 2024-09-14T11:36:52.622 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:52.621+0000 7f4882e199c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:36:52.622 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:52.621+0000 7f4882e199c0 20 rados->read ofs=0 len=0 2024-09-14T11:36:52.623 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:52.621+0000 7f4882e199c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:36:52.623 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:52.621+0000 7f4882e199c0 20 zone default found 2024-09-14T11:36:52.623 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:52.621+0000 7f4882e199c0 4 Realm: () 2024-09-14T11:36:52.623 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:52.621+0000 7f4882e199c0 4 ZoneGroup: default (65ab941b-da8c-4160-94fb-3672b069d44f) 2024-09-14T11:36:52.623 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:52.621+0000 7f4882e199c0 4 Zone: default (d9e72d30-c60b-4d0d-9267-fdc36392d5ad) 2024-09-14T11:36:52.623 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:52.621+0000 7f4882e199c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:36:52.623 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:52.621+0000 7f4882e199c0 20 zonegroup default 2024-09-14T11:36:52.624 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:52.621+0000 7f4882e199c0 20 rados->read ofs=0 len=0 2024-09-14T11:36:52.624 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:52.625+0000 7f4882e199c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:36:52.624 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:52.625+0000 7f4882e199c0 20 rados->read ofs=0 len=0 2024-09-14T11:36:52.625 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:52.625+0000 7f4882e199c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:36:52.625 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:52.625+0000 7f4882e199c0 20 rados->read ofs=0 len=0 2024-09-14T11:36:52.625 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:52.625+0000 7f4882e199c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:36:52.625 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:52.625+0000 7f4882e199c0 20 started sync module instance, tier type = 2024-09-14T11:36:52.626 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:52.625+0000 7f4882e199c0 20 started zone id=d9e72d30-c60b-4d0d-9267-fdc36392d5ad (name=default) with tier type = 2024-09-14T11:36:52.650 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:52.649+0000 7f4882e199c0 20 add_watcher() i=0 2024-09-14T11:36:52.650 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:52.649+0000 7f4882e199c0 20 add_watcher() i=1 2024-09-14T11:36:52.650 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:52.649+0000 7f4882e199c0 20 add_watcher() i=2 2024-09-14T11:36:52.650 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:52.649+0000 7f4882e199c0 20 add_watcher() i=3 2024-09-14T11:36:52.650 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:52.649+0000 7f4882e199c0 20 add_watcher() i=4 2024-09-14T11:36:52.650 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:52.649+0000 7f4882e199c0 20 add_watcher() i=5 2024-09-14T11:36:52.650 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:52.649+0000 7f4882e199c0 20 add_watcher() i=6 2024-09-14T11:36:52.652 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:52.653+0000 7f4882e199c0 20 add_watcher() i=7 2024-09-14T11:36:52.652 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:52.653+0000 7f4882e199c0 2 all 8 watchers are set, enabling cache 2024-09-14T11:36:52.656 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:52.657+0000 7f47377e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:36:52.657 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:52.657+0000 7f4882e199c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:36:52.657 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:52.657+0000 7f4882e199c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:36:52.657 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:52.657+0000 7f4882e199c0 5 note: GC not initialized 2024-09-14T11:36:52.658 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:52.657+0000 7f47367e4640 20 reqs_thread_entry: start 2024-09-14T11:36:52.658 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:52.657+0000 7f4882e199c0 20 init_complete bucket index max shards: 11 2024-09-14T11:36:52.658 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:52.657+0000 7f4882e199c0 20 Filter name: none 2024-09-14T11:36:52.658 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:52.657+0000 7f472f7fe640 20 reqs_thread_entry: start 2024-09-14T11:36:52.658 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:52.657+0000 7f4882e199c0 10 cache get: name=default.rgw.meta+root+abort-at-commit-target-layout : miss 2024-09-14T11:36:52.658 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:52.657+0000 7f4882e199c0 20 rados->read ofs=0 len=0 2024-09-14T11:36:52.659 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:52.657+0000 7f4882e199c0 20 rados_obj.operate() r=0 bl.length=197 2024-09-14T11:36:52.659 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:52.657+0000 7f4882e199c0 10 cache put: name=default.rgw.meta+root+abort-at-commit-target-layout info.flags=0x11 2024-09-14T11:36:52.659 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:52.657+0000 7f4882e199c0 10 adding default.rgw.meta+root+abort-at-commit-target-layout to cache LRU end 2024-09-14T11:36:52.659 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:52.657+0000 7f4882e199c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.32 : miss 2024-09-14T11:36:52.660 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:52.657+0000 7f4882e199c0 20 rados->read ofs=0 len=0 2024-09-14T11:36:52.660 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:52.661+0000 7f4882e199c0 20 rados_obj.operate() r=0 bl.length=419 2024-09-14T11:36:52.660 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:52.661+0000 7f4882e199c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.32 info.flags=0x17 2024-09-14T11:36:52.660 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:52.661+0000 7f4882e199c0 10 adding default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.32 to cache LRU end 2024-09-14T11:36:52.661 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:52.661+0000 7f4882e199c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:36:52.661 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:52.661+0000 7f4882e199c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:36:52.661 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:52.661+0000 7f4882e199c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.32 2024-09-14T11:36:52.671 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:52.669+0000 7f4882e199c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.32 info.flags=0x17 2024-09-14T11:36:52.671 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:52.669+0000 7f4882e199c0 10 moving default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.32 to cache LRU end 2024-09-14T11:36:52.671 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:52.669+0000 7f4882e199c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:36:52.671 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:52.669+0000 7f4882e199c0 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-commit-target-layout:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.32, ofs0, ns] 2024-09-14T11:36:52.672 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:52.673+0000 7f47577fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366205 cookie 94724738090224 notifier 7254 bl.length()=931 2024-09-14T11:36:52.672 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:52.673+0000 7f47577fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.32 info.flags=0x17 2024-09-14T11:36:52.672 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:52.673+0000 7f47577fe640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.32 to cache LRU end 2024-09-14T11:36:52.673 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:52.673+0000 7f47577fe640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:36:52.674 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:52.673+0000 7f4882e199c0 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.32]): orig_sources= new_sources= 2024-09-14T11:36:52.675 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:52.673+0000 7f4882e199c0 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.32]): potential sources added=[] removed=[] 2024-09-14T11:36:52.675 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:52.673+0000 7f4882e199c0 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.32]): orig_dests= new_dests= 2024-09-14T11:36:52.675 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:52.673+0000 7f4882e199c0 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.32]): potential dests added=[] removed=[] 2024-09-14T11:36:52.683 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:52.681+0000 7f4882e199c0 10 bucket_obj is .dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.32.1.0 2024-09-14T11:36:52.683 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:52.681+0000 7f4882e199c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.32.1.0 2024-09-14T11:36:52.684 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:52.681+0000 7f4882e199c0 10 bucket_obj is .dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.32.1.1 2024-09-14T11:36:52.684 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:52.681+0000 7f4882e199c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.32.1.1 2024-09-14T11:36:52.684 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:52.681+0000 7f4882e199c0 10 bucket_obj is .dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.32.1.2 2024-09-14T11:36:52.684 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:52.681+0000 7f4882e199c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.32.1.2 2024-09-14T11:36:52.684 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:52.681+0000 7f4882e199c0 10 bucket_obj is .dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.32.1.3 2024-09-14T11:36:52.684 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:52.681+0000 7f4882e199c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.32.1.3 2024-09-14T11:36:52.684 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:52.681+0000 7f4882e199c0 10 bucket_obj is .dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.32.1.4 2024-09-14T11:36:52.684 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:52.681+0000 7f4882e199c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.32.1.4 2024-09-14T11:36:52.684 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:52.681+0000 7f4882e199c0 10 bucket_obj is .dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.32.1.5 2024-09-14T11:36:52.685 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:52.681+0000 7f4882e199c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.32.1.5 2024-09-14T11:36:52.685 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:52.681+0000 7f4882e199c0 10 bucket_obj is .dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.32.1.6 2024-09-14T11:36:52.685 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:52.681+0000 7f4882e199c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.32.1.6 2024-09-14T11:36:52.685 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:52.681+0000 7f4882e199c0 10 bucket_obj is .dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.32.1.7 2024-09-14T11:36:52.685 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:52.681+0000 7f4882e199c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.32.1.7 2024-09-14T11:36:52.685 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:52.681+0000 7f4882e199c0 10 bucket_obj is .dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.32.1.8 2024-09-14T11:36:52.685 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:52.681+0000 7f4882e199c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.32.1.8 2024-09-14T11:36:52.685 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:52.681+0000 7f4882e199c0 10 bucket_obj is .dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.32.1.9 2024-09-14T11:36:52.685 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:52.681+0000 7f4882e199c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.32.1.9 2024-09-14T11:36:52.685 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:52.681+0000 7f4882e199c0 10 bucket_obj is .dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.32.1.10 2024-09-14T11:36:52.686 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:52.681+0000 7f4882e199c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.32.1.10 2024-09-14T11:36:52.686 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:52.681+0000 7f4882e199c0 10 bucket_obj is .dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.32.1.11 2024-09-14T11:36:52.686 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:52.681+0000 7f4882e199c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.32.1.11 2024-09-14T11:36:52.686 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:52.681+0000 7f4882e199c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.32.0 2024-09-14T11:36:52.687 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:52.685+0000 7f4882e199c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.32.1 2024-09-14T11:36:52.687 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:52.685+0000 7f4882e199c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.32.2 2024-09-14T11:36:52.687 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:52.685+0000 7f4882e199c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.32.3 2024-09-14T11:36:52.687 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:52.685+0000 7f4882e199c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.32.4 2024-09-14T11:36:52.688 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:52.689+0000 7f4882e199c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.32.5 2024-09-14T11:36:52.688 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:52.689+0000 7f4882e199c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.32.6 2024-09-14T11:36:52.689 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:52.689+0000 7f4882e199c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.32.7 2024-09-14T11:36:52.689 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:52.689+0000 7f4882e199c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.32.8 2024-09-14T11:36:52.690 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:52.689+0000 7f4882e199c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.32.9 2024-09-14T11:36:52.691 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:52.689+0000 7f4882e199c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.32.10 2024-09-14T11:36:52.699 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:52.701+0000 7f4882e199c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.32 : hit (requested=0x17, cached=0x17) 2024-09-14T11:36:52.699 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:52.701+0000 7f4882e199c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.32 2024-09-14T11:36:52.703 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:52.701+0000 7f4882e199c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.32 info.flags=0x17 2024-09-14T11:36:52.703 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:52.701+0000 7f4882e199c0 10 moving default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.32 to cache LRU end 2024-09-14T11:36:52.703 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:52.701+0000 7f4882e199c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:36:52.703 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:52.701+0000 7f4882e199c0 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-commit-target-layout:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.32, ofs0, ns] 2024-09-14T11:36:52.703 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:52.705+0000 7f4757fff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366206 cookie 94724738090224 notifier 7254 bl.length()=931 2024-09-14T11:36:52.704 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:52.705+0000 7f4757fff640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.32 info.flags=0x17 2024-09-14T11:36:52.704 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:52.705+0000 7f4757fff640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.32 to cache LRU end 2024-09-14T11:36:52.704 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:52.705+0000 7f4757fff640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:36:52.706 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:52.705+0000 7f4882e199c0 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.32]): orig_sources= new_sources= 2024-09-14T11:36:52.706 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:52.705+0000 7f4882e199c0 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.32]): potential sources added=[] removed=[] 2024-09-14T11:36:52.707 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:52.705+0000 7f4882e199c0 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.32]): orig_dests= new_dests= 2024-09-14T11:36:52.707 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:52.705+0000 7f4882e199c0 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.32]): potential dests added=[] removed=[] 2024-09-14T11:36:52.711 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:52.709+0000 7f4882e199c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.32.0 2024-09-14T11:36:52.711 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:52.709+0000 7f4882e199c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.32.1 2024-09-14T11:36:52.711 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:52.713+0000 7f4882e199c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.32.2 2024-09-14T11:36:52.713 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:52.713+0000 7f4882e199c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.32.3 2024-09-14T11:36:52.713 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:52.713+0000 7f4882e199c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.32.4 2024-09-14T11:36:52.713 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:52.713+0000 7f4882e199c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.32.5 2024-09-14T11:36:52.714 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:52.713+0000 7f4882e199c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.32.6 2024-09-14T11:36:52.714 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:52.713+0000 7f4882e199c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.32.7 2024-09-14T11:36:52.715 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:52.713+0000 7f4882e199c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.32.8 2024-09-14T11:36:52.715 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:52.717+0000 7f4882e199c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.32.9 2024-09-14T11:36:52.716 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:52.717+0000 7f4882e199c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.32.10 2024-09-14T11:36:52.717 INFO:tasks.workunit.client.0.smithi138.stderr:./src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f4882e199c0 time 2024-09-14T11:36:52.722713+0000 2024-09-14T11:36:52.717 INFO:tasks.workunit.client.0.smithi138.stderr:./src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-14T11:36:52.718 INFO:tasks.workunit.client.0.smithi138.stderr: ceph version 19.3.0-4907-ga2782315 (a2782315255a3e7d5f6cdc9eb35785187ff6ddf8) squid (dev) 2024-09-14T11:36:52.719 INFO:tasks.workunit.client.0.smithi138.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x121) [0x7f48866f32eb] 2024-09-14T11:36:52.719 INFO:tasks.workunit.client.0.smithi138.stderr: 2: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7f48866f349f] 2024-09-14T11:36:52.719 INFO:tasks.workunit.client.0.smithi138.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x5626d0323c01] 2024-09-14T11:36:52.719 INFO:tasks.workunit.client.0.smithi138.stderr: 4: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x3e7) [0x5626d03391a7] 2024-09-14T11:36:52.719 INFO:tasks.workunit.client.0.smithi138.stderr: 5: main() 2024-09-14T11:36:52.719 INFO:tasks.workunit.client.0.smithi138.stderr: 6: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7f4885559d90] 2024-09-14T11:36:52.719 INFO:tasks.workunit.client.0.smithi138.stderr: 7: __libc_start_main() 2024-09-14T11:36:52.719 INFO:tasks.workunit.client.0.smithi138.stderr: 8: _start() 2024-09-14T11:36:52.719 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:52.717+0000 7f4882e199c0 -1 ./src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f4882e199c0 time 2024-09-14T11:36:52.722713+0000 2024-09-14T11:36:52.720 INFO:tasks.workunit.client.0.smithi138.stderr:./src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-14T11:36:52.720 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-14T11:36:52.720 INFO:tasks.workunit.client.0.smithi138.stderr: ceph version 19.3.0-4907-ga2782315 (a2782315255a3e7d5f6cdc9eb35785187ff6ddf8) squid (dev) 2024-09-14T11:36:52.720 INFO:tasks.workunit.client.0.smithi138.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x121) [0x7f48866f32eb] 2024-09-14T11:36:52.720 INFO:tasks.workunit.client.0.smithi138.stderr: 2: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7f48866f349f] 2024-09-14T11:36:52.720 INFO:tasks.workunit.client.0.smithi138.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x5626d0323c01] 2024-09-14T11:36:52.720 INFO:tasks.workunit.client.0.smithi138.stderr: 4: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x3e7) [0x5626d03391a7] 2024-09-14T11:36:52.720 INFO:tasks.workunit.client.0.smithi138.stderr: 5: main() 2024-09-14T11:36:52.720 INFO:tasks.workunit.client.0.smithi138.stderr: 6: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7f4885559d90] 2024-09-14T11:36:52.720 INFO:tasks.workunit.client.0.smithi138.stderr: 7: __libc_start_main() 2024-09-14T11:36:52.721 INFO:tasks.workunit.client.0.smithi138.stderr: 8: _start() 2024-09-14T11:36:52.721 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-14T11:36:52.721 INFO:tasks.workunit.client.0.smithi138.stderr:*** Caught signal (Aborted) ** 2024-09-14T11:36:52.721 INFO:tasks.workunit.client.0.smithi138.stderr: in thread 7f4882e199c0 thread_name:radosgw-admin 2024-09-14T11:36:52.742 INFO:tasks.workunit.client.0.smithi138.stderr: ceph version 19.3.0-4907-ga2782315 (a2782315255a3e7d5f6cdc9eb35785187ff6ddf8) squid (dev) 2024-09-14T11:36:52.742 INFO:tasks.workunit.client.0.smithi138.stderr: 1: /lib/x86_64-linux-gnu/libc.so.6(+0x42520) [0x7f4885572520] 2024-09-14T11:36:52.742 INFO:tasks.workunit.client.0.smithi138.stderr: 2: pthread_kill() 2024-09-14T11:36:52.742 INFO:tasks.workunit.client.0.smithi138.stderr: 3: raise() 2024-09-14T11:36:52.742 INFO:tasks.workunit.client.0.smithi138.stderr: 4: abort() 2024-09-14T11:36:52.742 INFO:tasks.workunit.client.0.smithi138.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x17b) [0x7f48866f3345] 2024-09-14T11:36:52.742 INFO:tasks.workunit.client.0.smithi138.stderr: 6: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7f48866f349f] 2024-09-14T11:36:52.742 INFO:tasks.workunit.client.0.smithi138.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x5626d0323c01] 2024-09-14T11:36:52.743 INFO:tasks.workunit.client.0.smithi138.stderr: 8: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x3e7) [0x5626d03391a7] 2024-09-14T11:36:52.743 INFO:tasks.workunit.client.0.smithi138.stderr: 9: main() 2024-09-14T11:36:52.743 INFO:tasks.workunit.client.0.smithi138.stderr: 10: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7f4885559d90] 2024-09-14T11:36:52.743 INFO:tasks.workunit.client.0.smithi138.stderr: 11: __libc_start_main() 2024-09-14T11:36:52.743 INFO:tasks.workunit.client.0.smithi138.stderr: 12: _start() 2024-09-14T11:36:52.743 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:52.721+0000 7f4882e199c0 -1 *** Caught signal (Aborted) ** 2024-09-14T11:36:52.743 INFO:tasks.workunit.client.0.smithi138.stderr: in thread 7f4882e199c0 thread_name:radosgw-admin 2024-09-14T11:36:52.743 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-14T11:36:52.743 INFO:tasks.workunit.client.0.smithi138.stderr: ceph version 19.3.0-4907-ga2782315 (a2782315255a3e7d5f6cdc9eb35785187ff6ddf8) squid (dev) 2024-09-14T11:36:52.743 INFO:tasks.workunit.client.0.smithi138.stderr: 1: /lib/x86_64-linux-gnu/libc.so.6(+0x42520) [0x7f4885572520] 2024-09-14T11:36:52.743 INFO:tasks.workunit.client.0.smithi138.stderr: 2: pthread_kill() 2024-09-14T11:36:52.743 INFO:tasks.workunit.client.0.smithi138.stderr: 3: raise() 2024-09-14T11:36:52.744 INFO:tasks.workunit.client.0.smithi138.stderr: 4: abort() 2024-09-14T11:36:52.744 INFO:tasks.workunit.client.0.smithi138.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x17b) [0x7f48866f3345] 2024-09-14T11:36:52.744 INFO:tasks.workunit.client.0.smithi138.stderr: 6: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7f48866f349f] 2024-09-14T11:36:52.744 INFO:tasks.workunit.client.0.smithi138.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x5626d0323c01] 2024-09-14T11:36:52.744 INFO:tasks.workunit.client.0.smithi138.stderr: 8: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x3e7) [0x5626d03391a7] 2024-09-14T11:36:52.744 INFO:tasks.workunit.client.0.smithi138.stderr: 9: main() 2024-09-14T11:36:52.744 INFO:tasks.workunit.client.0.smithi138.stderr: 10: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7f4885559d90] 2024-09-14T11:36:52.744 INFO:tasks.workunit.client.0.smithi138.stderr: 11: __libc_start_main() 2024-09-14T11:36:52.744 INFO:tasks.workunit.client.0.smithi138.stderr: 12: _start() 2024-09-14T11:36:52.744 INFO:tasks.workunit.client.0.smithi138.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-14T11:36:52.745 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-14T11:36:52.745 INFO:tasks.workunit.client.0.smithi138.stderr:--- begin dump of recent events --- 2024-09-14T11:36:52.745 INFO:tasks.workunit.client.0.smithi138.stderr: -499> 2024-09-14T11:36:52.369+0000 7f4882e199c0 5 AuthRegistry(0x5626d24d94b0) adding con mode: crc 2024-09-14T11:36:52.745 INFO:tasks.workunit.client.0.smithi138.stderr: -498> 2024-09-14T11:36:52.369+0000 7f4882e199c0 5 AuthRegistry(0x5626d24d94b0) adding con mode: secure 2024-09-14T11:36:52.745 INFO:tasks.workunit.client.0.smithi138.stderr: -497> 2024-09-14T11:36:52.369+0000 7f4882e199c0 5 AuthRegistry(0x5626d24d94b0) adding con mode: crc 2024-09-14T11:36:52.745 INFO:tasks.workunit.client.0.smithi138.stderr: -496> 2024-09-14T11:36:52.369+0000 7f4882e199c0 5 AuthRegistry(0x5626d24d94b0) adding con mode: secure 2024-09-14T11:36:52.745 INFO:tasks.workunit.client.0.smithi138.stderr: -495> 2024-09-14T11:36:52.369+0000 7f4882e199c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:36:52.745 INFO:tasks.workunit.client.0.smithi138.stderr: -494> 2024-09-14T11:36:52.369+0000 7f4882e199c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:36:52.745 INFO:tasks.workunit.client.0.smithi138.stderr: -493> 2024-09-14T11:36:52.369+0000 7f4882e199c0 5 asok(0x5626d22cbd90) register_command rotate-key hook 0x5626d24d95f8 2024-09-14T11:36:52.745 INFO:tasks.workunit.client.0.smithi138.stderr: -492> 2024-09-14T11:36:52.369+0000 7f4882e199c0 10 monclient: _reopen_session rank -1 2024-09-14T11:36:52.746 INFO:tasks.workunit.client.0.smithi138.stderr: -491> 2024-09-14T11:36:52.369+0000 7f4882e199c0 10 monclient: _add_conns ranks=[0,1,2] 2024-09-14T11:36:52.746 INFO:tasks.workunit.client.0.smithi138.stderr: -490> 2024-09-14T11:36:52.369+0000 7f4882e199c0 10 monclient(hunting): picked mon.noname-a con 0x5626d23895b0 addr [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] 2024-09-14T11:36:52.746 INFO:tasks.workunit.client.0.smithi138.stderr: -489> 2024-09-14T11:36:52.369+0000 7f4882e199c0 10 monclient(hunting): picked mon.noname-b con 0x5626d2394880 addr [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] 2024-09-14T11:36:52.746 INFO:tasks.workunit.client.0.smithi138.stderr: -488> 2024-09-14T11:36:52.369+0000 7f4882e199c0 10 monclient(hunting): picked mon.noname-c con 0x5626d23956e0 addr [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] 2024-09-14T11:36:52.746 INFO:tasks.workunit.client.0.smithi138.stderr: -487> 2024-09-14T11:36:52.369+0000 7f4882e199c0 10 monclient(hunting): start opening mon connection 2024-09-14T11:36:52.746 INFO:tasks.workunit.client.0.smithi138.stderr: -486> 2024-09-14T11:36:52.369+0000 7f4882e199c0 10 monclient(hunting): start opening mon connection 2024-09-14T11:36:52.746 INFO:tasks.workunit.client.0.smithi138.stderr: -485> 2024-09-14T11:36:52.369+0000 7f4882e199c0 10 monclient(hunting): start opening mon connection 2024-09-14T11:36:52.746 INFO:tasks.workunit.client.0.smithi138.stderr: -484> 2024-09-14T11:36:52.369+0000 7f4882e199c0 10 monclient(hunting): _renew_subs 2024-09-14T11:36:52.746 INFO:tasks.workunit.client.0.smithi138.stderr: -483> 2024-09-14T11:36:52.369+0000 7f4882e199c0 10 monclient(hunting): authenticate will time out at 2748.335226s 2024-09-14T11:36:52.746 INFO:tasks.workunit.client.0.smithi138.stderr: -482> 2024-09-14T11:36:52.369+0000 7f488091f640 10 monclient(hunting): get_auth_request con 0x5626d23895b0 auth_method 0 2024-09-14T11:36:52.746 INFO:tasks.workunit.client.0.smithi138.stderr: -481> 2024-09-14T11:36:52.369+0000 7f488091f640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:36:52.747 INFO:tasks.workunit.client.0.smithi138.stderr: -480> 2024-09-14T11:36:52.369+0000 7f488091f640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:36:52.747 INFO:tasks.workunit.client.0.smithi138.stderr: -479> 2024-09-14T11:36:52.369+0000 7f488091f640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:36:52.747 INFO:tasks.workunit.client.0.smithi138.stderr: -478> 2024-09-14T11:36:52.369+0000 7f4881120640 10 monclient(hunting): get_auth_request con 0x5626d23956e0 auth_method 0 2024-09-14T11:36:52.747 INFO:tasks.workunit.client.0.smithi138.stderr: -477> 2024-09-14T11:36:52.369+0000 7f4881120640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:36:52.747 INFO:tasks.workunit.client.0.smithi138.stderr: -476> 2024-09-14T11:36:52.369+0000 7f4881120640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:36:52.747 INFO:tasks.workunit.client.0.smithi138.stderr: -475> 2024-09-14T11:36:52.369+0000 7f4881120640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:36:52.747 INFO:tasks.workunit.client.0.smithi138.stderr: -474> 2024-09-14T11:36:52.369+0000 7f488091f640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:36:52.747 INFO:tasks.workunit.client.0.smithi138.stderr: -473> 2024-09-14T11:36:52.369+0000 7f488091f640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:36:52.747 INFO:tasks.workunit.client.0.smithi138.stderr: -472> 2024-09-14T11:36:52.369+0000 7f488091f640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:36:52.747 INFO:tasks.workunit.client.0.smithi138.stderr: -471> 2024-09-14T11:36:52.369+0000 7f4881120640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:36:52.747 INFO:tasks.workunit.client.0.smithi138.stderr: -470> 2024-09-14T11:36:52.369+0000 7f4881120640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:36:52.747 INFO:tasks.workunit.client.0.smithi138.stderr: -469> 2024-09-14T11:36:52.369+0000 7f4881120640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:36:52.748 INFO:tasks.workunit.client.0.smithi138.stderr: -468> 2024-09-14T11:36:52.369+0000 7f488091f640 10 monclient(hunting): handle_auth_done global_id 7245 payload 824 2024-09-14T11:36:52.748 INFO:tasks.workunit.client.0.smithi138.stderr: -467> 2024-09-14T11:36:52.369+0000 7f488091f640 10 monclient: _finish_hunting 0 2024-09-14T11:36:52.748 INFO:tasks.workunit.client.0.smithi138.stderr: -466> 2024-09-14T11:36:52.369+0000 7f488091f640 1 monclient: found mon.noname-a 2024-09-14T11:36:52.748 INFO:tasks.workunit.client.0.smithi138.stderr: -465> 2024-09-14T11:36:52.369+0000 7f488091f640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.138:3300/0 2024-09-14T11:36:52.748 INFO:tasks.workunit.client.0.smithi138.stderr: -464> 2024-09-14T11:36:52.369+0000 7f476d602640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:36:52.748 INFO:tasks.workunit.client.0.smithi138.stderr: -463> 2024-09-14T11:36:52.369+0000 7f476d602640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-14T11:36:52.748 INFO:tasks.workunit.client.0.smithi138.stderr: -462> 2024-09-14T11:36:52.369+0000 7f476d602640 10 monclient: dump: 2024-09-14T11:36:52.748 INFO:tasks.workunit.client.0.smithi138.stderr:epoch 1 2024-09-14T11:36:52.748 INFO:tasks.workunit.client.0.smithi138.stderr:fsid 3f225f43-83a6-4aeb-b798-1f04bb49d597 2024-09-14T11:36:52.748 INFO:tasks.workunit.client.0.smithi138.stderr:last_changed 2024-09-14T11:07:09.252780+0000 2024-09-14T11:36:52.748 INFO:tasks.workunit.client.0.smithi138.stderr:created 2024-09-14T11:07:09.252780+0000 2024-09-14T11:36:52.749 INFO:tasks.workunit.client.0.smithi138.stderr:min_mon_release 19 (squid) 2024-09-14T11:36:52.749 INFO:tasks.workunit.client.0.smithi138.stderr:election_strategy: 1 2024-09-14T11:36:52.749 INFO:tasks.workunit.client.0.smithi138.stderr:0: [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] mon.a 2024-09-14T11:36:52.749 INFO:tasks.workunit.client.0.smithi138.stderr:1: [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] mon.b 2024-09-14T11:36:52.749 INFO:tasks.workunit.client.0.smithi138.stderr:2: [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] mon.c 2024-09-14T11:36:52.749 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-14T11:36:52.749 INFO:tasks.workunit.client.0.smithi138.stderr: -461> 2024-09-14T11:36:52.369+0000 7f476d602640 10 monclient: _finish_auth 0 2024-09-14T11:36:52.749 INFO:tasks.workunit.client.0.smithi138.stderr: -460> 2024-09-14T11:36:52.369+0000 7f476d602640 10 monclient: _check_auth_tickets 2024-09-14T11:36:52.749 INFO:tasks.workunit.client.0.smithi138.stderr: -459> 2024-09-14T11:36:52.373+0000 7f476d602640 10 monclient: handle_config config(0 keys) 2024-09-14T11:36:52.749 INFO:tasks.workunit.client.0.smithi138.stderr: -458> 2024-09-14T11:36:52.373+0000 7f476d602640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:36:52.749 INFO:tasks.workunit.client.0.smithi138.stderr: -457> 2024-09-14T11:36:52.373+0000 7f476d602640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-14T11:36:52.749 INFO:tasks.workunit.client.0.smithi138.stderr: -456> 2024-09-14T11:36:52.373+0000 7f476d602640 10 monclient: dump: 2024-09-14T11:36:52.750 INFO:tasks.workunit.client.0.smithi138.stderr:epoch 1 2024-09-14T11:36:52.750 INFO:tasks.workunit.client.0.smithi138.stderr:fsid 3f225f43-83a6-4aeb-b798-1f04bb49d597 2024-09-14T11:36:52.750 INFO:tasks.workunit.client.0.smithi138.stderr:last_changed 2024-09-14T11:07:09.252780+0000 2024-09-14T11:36:52.750 INFO:tasks.workunit.client.0.smithi138.stderr:created 2024-09-14T11:07:09.252780+0000 2024-09-14T11:36:52.750 INFO:tasks.workunit.client.0.smithi138.stderr:min_mon_release 19 (squid) 2024-09-14T11:36:52.750 INFO:tasks.workunit.client.0.smithi138.stderr:election_strategy: 1 2024-09-14T11:36:52.750 INFO:tasks.workunit.client.0.smithi138.stderr:0: [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] mon.a 2024-09-14T11:36:52.750 INFO:tasks.workunit.client.0.smithi138.stderr:1: [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] mon.b 2024-09-14T11:36:52.750 INFO:tasks.workunit.client.0.smithi138.stderr:2: [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] mon.c 2024-09-14T11:36:52.750 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-14T11:36:52.750 INFO:tasks.workunit.client.0.smithi138.stderr: -455> 2024-09-14T11:36:52.373+0000 7f4882e199c0 5 monclient: authenticate success, global_id 7245 2024-09-14T11:36:52.751 INFO:tasks.workunit.client.0.smithi138.stderr: -454> 2024-09-14T11:36:52.373+0000 7f476ee05640 4 set_mon_vals no callback set 2024-09-14T11:36:52.751 INFO:tasks.workunit.client.0.smithi138.stderr: -453> 2024-09-14T11:36:52.373+0000 7f4882e199c0 10 monclient: _renew_subs 2024-09-14T11:36:52.751 INFO:tasks.workunit.client.0.smithi138.stderr: -452> 2024-09-14T11:36:52.373+0000 7f4882e199c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.138:3300/0 2024-09-14T11:36:52.751 INFO:tasks.workunit.client.0.smithi138.stderr: -451> 2024-09-14T11:36:52.373+0000 7f4882e199c0 10 monclient: _renew_subs 2024-09-14T11:36:52.751 INFO:tasks.workunit.client.0.smithi138.stderr: -450> 2024-09-14T11:36:52.373+0000 7f4882e199c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.138:3300/0 2024-09-14T11:36:52.751 INFO:tasks.workunit.client.0.smithi138.stderr: -449> 2024-09-14T11:36:52.373+0000 7f4882e199c0 1 librados: init done 2024-09-14T11:36:52.751 INFO:tasks.workunit.client.0.smithi138.stderr: -448> 2024-09-14T11:36:52.373+0000 7f476d602640 4 mgrc handle_mgr_map Got map version 5 2024-09-14T11:36:52.751 INFO:tasks.workunit.client.0.smithi138.stderr: -447> 2024-09-14T11:36:52.373+0000 7f476d602640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.138:6832/3778043143,v1:172.21.15.138:6833/3778043143] 2024-09-14T11:36:52.751 INFO:tasks.workunit.client.0.smithi138.stderr: -446> 2024-09-14T11:36:52.373+0000 7f476d602640 4 mgrc reconnect Starting new session with [v2:172.21.15.138:6832/3778043143,v1:172.21.15.138:6833/3778043143] 2024-09-14T11:36:52.751 INFO:tasks.workunit.client.0.smithi138.stderr: -445> 2024-09-14T11:36:52.373+0000 7f487bfff640 10 monclient: get_auth_request con 0x7f4768071a40 auth_method 0 2024-09-14T11:36:52.751 INFO:tasks.workunit.client.0.smithi138.stderr: -444> 2024-09-14T11:36:52.373+0000 7f4881120640 10 monclient: get_auth_request con 0x5626d2500fe0 auth_method 0 2024-09-14T11:36:52.751 INFO:tasks.workunit.client.0.smithi138.stderr: -443> 2024-09-14T11:36:52.373+0000 7f488091f640 10 monclient: get_auth_request con 0x5626d2523ee0 auth_method 0 2024-09-14T11:36:52.752 INFO:tasks.workunit.client.0.smithi138.stderr: -442> 2024-09-14T11:36:52.377+0000 7f487bfff640 10 monclient: get_auth_request con 0x5626d25280d0 auth_method 0 2024-09-14T11:36:52.752 INFO:tasks.workunit.client.0.smithi138.stderr: -441> 2024-09-14T11:36:52.377+0000 7f4881120640 10 monclient: get_auth_request con 0x5626d2527760 auth_method 0 2024-09-14T11:36:52.752 INFO:tasks.workunit.client.0.smithi138.stderr: -440> 2024-09-14T11:36:52.381+0000 7f4882e199c0 10 monclient: build_initial_monmap 2024-09-14T11:36:52.752 INFO:tasks.workunit.client.0.smithi138.stderr: -439> 2024-09-14T11:36:52.381+0000 7f4882e199c0 1 build_initial for_mkfs: 0 2024-09-14T11:36:52.752 INFO:tasks.workunit.client.0.smithi138.stderr: -438> 2024-09-14T11:36:52.381+0000 7f4882e199c0 10 monclient: monmap: 2024-09-14T11:36:52.752 INFO:tasks.workunit.client.0.smithi138.stderr:epoch 0 2024-09-14T11:36:52.752 INFO:tasks.workunit.client.0.smithi138.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-14T11:36:52.752 INFO:tasks.workunit.client.0.smithi138.stderr:last_changed 0.000000 2024-09-14T11:36:52.752 INFO:tasks.workunit.client.0.smithi138.stderr:created 0.000000 2024-09-14T11:36:52.752 INFO:tasks.workunit.client.0.smithi138.stderr:min_mon_release 0 (unknown) 2024-09-14T11:36:52.752 INFO:tasks.workunit.client.0.smithi138.stderr:election_strategy: 1 2024-09-14T11:36:52.753 INFO:tasks.workunit.client.0.smithi138.stderr:0: [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] mon.noname-a 2024-09-14T11:36:52.753 INFO:tasks.workunit.client.0.smithi138.stderr:1: [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] mon.noname-b 2024-09-14T11:36:52.753 INFO:tasks.workunit.client.0.smithi138.stderr:2: [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] mon.noname-c 2024-09-14T11:36:52.753 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-14T11:36:52.753 INFO:tasks.workunit.client.0.smithi138.stderr: -437> 2024-09-14T11:36:52.381+0000 7f4882e199c0 5 AuthRegistry(0x5626d252ff90) adding auth protocol: cephx 2024-09-14T11:36:52.753 INFO:tasks.workunit.client.0.smithi138.stderr: -436> 2024-09-14T11:36:52.381+0000 7f4882e199c0 5 AuthRegistry(0x5626d252ff90) adding auth protocol: cephx 2024-09-14T11:36:52.753 INFO:tasks.workunit.client.0.smithi138.stderr: -435> 2024-09-14T11:36:52.381+0000 7f4882e199c0 5 AuthRegistry(0x5626d252ff90) adding auth protocol: cephx 2024-09-14T11:36:52.753 INFO:tasks.workunit.client.0.smithi138.stderr: -434> 2024-09-14T11:36:52.381+0000 7f4882e199c0 5 AuthRegistry(0x5626d252ff90) adding con mode: secure 2024-09-14T11:36:52.753 INFO:tasks.workunit.client.0.smithi138.stderr: -433> 2024-09-14T11:36:52.381+0000 7f4882e199c0 5 AuthRegistry(0x5626d252ff90) adding con mode: crc 2024-09-14T11:36:52.753 INFO:tasks.workunit.client.0.smithi138.stderr: -432> 2024-09-14T11:36:52.381+0000 7f4882e199c0 5 AuthRegistry(0x5626d252ff90) adding con mode: secure 2024-09-14T11:36:52.753 INFO:tasks.workunit.client.0.smithi138.stderr: -431> 2024-09-14T11:36:52.381+0000 7f4882e199c0 5 AuthRegistry(0x5626d252ff90) adding con mode: crc 2024-09-14T11:36:52.754 INFO:tasks.workunit.client.0.smithi138.stderr: -430> 2024-09-14T11:36:52.381+0000 7f4882e199c0 5 AuthRegistry(0x5626d252ff90) adding con mode: secure 2024-09-14T11:36:52.754 INFO:tasks.workunit.client.0.smithi138.stderr: -429> 2024-09-14T11:36:52.381+0000 7f4882e199c0 5 AuthRegistry(0x5626d252ff90) adding con mode: crc 2024-09-14T11:36:52.754 INFO:tasks.workunit.client.0.smithi138.stderr: -428> 2024-09-14T11:36:52.381+0000 7f4882e199c0 5 AuthRegistry(0x5626d252ff90) adding con mode: crc 2024-09-14T11:36:52.754 INFO:tasks.workunit.client.0.smithi138.stderr: -427> 2024-09-14T11:36:52.381+0000 7f4882e199c0 5 AuthRegistry(0x5626d252ff90) adding con mode: secure 2024-09-14T11:36:52.754 INFO:tasks.workunit.client.0.smithi138.stderr: -426> 2024-09-14T11:36:52.381+0000 7f4882e199c0 5 AuthRegistry(0x5626d252ff90) adding con mode: crc 2024-09-14T11:36:52.754 INFO:tasks.workunit.client.0.smithi138.stderr: -425> 2024-09-14T11:36:52.381+0000 7f4882e199c0 5 AuthRegistry(0x5626d252ff90) adding con mode: secure 2024-09-14T11:36:52.754 INFO:tasks.workunit.client.0.smithi138.stderr: -424> 2024-09-14T11:36:52.381+0000 7f4882e199c0 5 AuthRegistry(0x5626d252ff90) adding con mode: crc 2024-09-14T11:36:52.754 INFO:tasks.workunit.client.0.smithi138.stderr: -423> 2024-09-14T11:36:52.381+0000 7f4882e199c0 5 AuthRegistry(0x5626d252ff90) adding con mode: secure 2024-09-14T11:36:52.754 INFO:tasks.workunit.client.0.smithi138.stderr: -422> 2024-09-14T11:36:52.381+0000 7f4882e199c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:36:52.754 INFO:tasks.workunit.client.0.smithi138.stderr: -421> 2024-09-14T11:36:52.381+0000 7f4882e199c0 5 asok(0x5626d22cbd90) register_command objecter_requests cmddesc objecter_requests hook 0x5626d2533980 EEXIST 2024-09-14T11:36:52.754 INFO:tasks.workunit.client.0.smithi138.stderr: -420> 2024-09-14T11:36:52.381+0000 7f4882e199c0 10 monclient: init 2024-09-14T11:36:52.754 INFO:tasks.workunit.client.0.smithi138.stderr: -419> 2024-09-14T11:36:52.381+0000 7f4882e199c0 5 AuthRegistry(0x5626d252ee88) adding auth protocol: cephx 2024-09-14T11:36:52.755 INFO:tasks.workunit.client.0.smithi138.stderr: -418> 2024-09-14T11:36:52.381+0000 7f4882e199c0 5 AuthRegistry(0x5626d252ee88) adding auth protocol: cephx 2024-09-14T11:36:52.755 INFO:tasks.workunit.client.0.smithi138.stderr: -417> 2024-09-14T11:36:52.381+0000 7f4882e199c0 5 AuthRegistry(0x5626d252ee88) adding auth protocol: cephx 2024-09-14T11:36:52.755 INFO:tasks.workunit.client.0.smithi138.stderr: -416> 2024-09-14T11:36:52.381+0000 7f4882e199c0 5 AuthRegistry(0x5626d252ee88) adding con mode: secure 2024-09-14T11:36:52.755 INFO:tasks.workunit.client.0.smithi138.stderr: -415> 2024-09-14T11:36:52.381+0000 7f4882e199c0 5 AuthRegistry(0x5626d252ee88) adding con mode: crc 2024-09-14T11:36:52.755 INFO:tasks.workunit.client.0.smithi138.stderr: -414> 2024-09-14T11:36:52.381+0000 7f4882e199c0 5 AuthRegistry(0x5626d252ee88) adding con mode: secure 2024-09-14T11:36:52.755 INFO:tasks.workunit.client.0.smithi138.stderr: -413> 2024-09-14T11:36:52.381+0000 7f4882e199c0 5 AuthRegistry(0x5626d252ee88) adding con mode: crc 2024-09-14T11:36:52.755 INFO:tasks.workunit.client.0.smithi138.stderr: -412> 2024-09-14T11:36:52.381+0000 7f4882e199c0 5 AuthRegistry(0x5626d252ee88) adding con mode: secure 2024-09-14T11:36:52.755 INFO:tasks.workunit.client.0.smithi138.stderr: -411> 2024-09-14T11:36:52.381+0000 7f4882e199c0 5 AuthRegistry(0x5626d252ee88) adding con mode: crc 2024-09-14T11:36:52.755 INFO:tasks.workunit.client.0.smithi138.stderr: -410> 2024-09-14T11:36:52.381+0000 7f4882e199c0 5 AuthRegistry(0x5626d252ee88) adding con mode: crc 2024-09-14T11:36:52.755 INFO:tasks.workunit.client.0.smithi138.stderr: -409> 2024-09-14T11:36:52.381+0000 7f4882e199c0 5 AuthRegistry(0x5626d252ee88) adding con mode: secure 2024-09-14T11:36:52.755 INFO:tasks.workunit.client.0.smithi138.stderr: -408> 2024-09-14T11:36:52.381+0000 7f4882e199c0 5 AuthRegistry(0x5626d252ee88) adding con mode: crc 2024-09-14T11:36:52.756 INFO:tasks.workunit.client.0.smithi138.stderr: -407> 2024-09-14T11:36:52.381+0000 7f4882e199c0 5 AuthRegistry(0x5626d252ee88) adding con mode: secure 2024-09-14T11:36:52.756 INFO:tasks.workunit.client.0.smithi138.stderr: -406> 2024-09-14T11:36:52.381+0000 7f4882e199c0 5 AuthRegistry(0x5626d252ee88) adding con mode: crc 2024-09-14T11:36:52.756 INFO:tasks.workunit.client.0.smithi138.stderr: -405> 2024-09-14T11:36:52.381+0000 7f4882e199c0 5 AuthRegistry(0x5626d252ee88) adding con mode: secure 2024-09-14T11:36:52.756 INFO:tasks.workunit.client.0.smithi138.stderr: -404> 2024-09-14T11:36:52.381+0000 7f4882e199c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:36:52.756 INFO:tasks.workunit.client.0.smithi138.stderr: -403> 2024-09-14T11:36:52.381+0000 7f4882e199c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:36:52.756 INFO:tasks.workunit.client.0.smithi138.stderr: -402> 2024-09-14T11:36:52.381+0000 7f4882e199c0 5 asok(0x5626d22cbd90) register_command rotate-key cmddesc rotate-key hook 0x5626d252efd0 EEXIST 2024-09-14T11:36:52.756 INFO:tasks.workunit.client.0.smithi138.stderr: -401> 2024-09-14T11:36:52.381+0000 7f4882e199c0 10 monclient: _reopen_session rank -1 2024-09-14T11:36:52.756 INFO:tasks.workunit.client.0.smithi138.stderr: -400> 2024-09-14T11:36:52.381+0000 7f4882e199c0 10 monclient: _add_conns ranks=[1,2,0] 2024-09-14T11:36:52.756 INFO:tasks.workunit.client.0.smithi138.stderr: -399> 2024-09-14T11:36:52.381+0000 7f4882e199c0 10 monclient(hunting): picked mon.noname-b con 0x5626d2557b30 addr [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] 2024-09-14T11:36:52.756 INFO:tasks.workunit.client.0.smithi138.stderr: -398> 2024-09-14T11:36:52.381+0000 7f4882e199c0 10 monclient(hunting): picked mon.noname-c con 0x5626d2557460 addr [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] 2024-09-14T11:36:52.756 INFO:tasks.workunit.client.0.smithi138.stderr: -397> 2024-09-14T11:36:52.381+0000 7f4882e199c0 10 monclient(hunting): picked mon.noname-a con 0x5626d2555e40 addr [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] 2024-09-14T11:36:52.756 INFO:tasks.workunit.client.0.smithi138.stderr: -396> 2024-09-14T11:36:52.381+0000 7f4882e199c0 10 monclient(hunting): start opening mon connection 2024-09-14T11:36:52.757 INFO:tasks.workunit.client.0.smithi138.stderr: -395> 2024-09-14T11:36:52.381+0000 7f4882e199c0 10 monclient(hunting): start opening mon connection 2024-09-14T11:36:52.757 INFO:tasks.workunit.client.0.smithi138.stderr: -394> 2024-09-14T11:36:52.381+0000 7f4882e199c0 10 monclient(hunting): start opening mon connection 2024-09-14T11:36:52.757 INFO:tasks.workunit.client.0.smithi138.stderr: -393> 2024-09-14T11:36:52.381+0000 7f4882e199c0 10 monclient(hunting): _renew_subs 2024-09-14T11:36:52.757 INFO:tasks.workunit.client.0.smithi138.stderr: -392> 2024-09-14T11:36:52.381+0000 7f4882e199c0 10 monclient(hunting): authenticate will time out at 2748.345730s 2024-09-14T11:36:52.757 INFO:tasks.workunit.client.0.smithi138.stderr: -391> 2024-09-14T11:36:52.381+0000 7f488091f640 10 monclient(hunting): get_auth_request con 0x5626d2555e40 auth_method 0 2024-09-14T11:36:52.757 INFO:tasks.workunit.client.0.smithi138.stderr: -390> 2024-09-14T11:36:52.381+0000 7f488091f640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:36:52.757 INFO:tasks.workunit.client.0.smithi138.stderr: -389> 2024-09-14T11:36:52.381+0000 7f488091f640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:36:52.757 INFO:tasks.workunit.client.0.smithi138.stderr: -388> 2024-09-14T11:36:52.381+0000 7f488091f640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:36:52.757 INFO:tasks.workunit.client.0.smithi138.stderr: -387> 2024-09-14T11:36:52.381+0000 7f4881120640 10 monclient(hunting): get_auth_request con 0x5626d2557460 auth_method 0 2024-09-14T11:36:52.758 INFO:tasks.workunit.client.0.smithi138.stderr: -386> 2024-09-14T11:36:52.381+0000 7f4881120640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:36:52.758 INFO:tasks.workunit.client.0.smithi138.stderr: -385> 2024-09-14T11:36:52.381+0000 7f4881120640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:36:52.758 INFO:tasks.workunit.client.0.smithi138.stderr: -384> 2024-09-14T11:36:52.381+0000 7f4881120640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:36:52.758 INFO:tasks.workunit.client.0.smithi138.stderr: -383> 2024-09-14T11:36:52.381+0000 7f488091f640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:36:52.758 INFO:tasks.workunit.client.0.smithi138.stderr: -382> 2024-09-14T11:36:52.381+0000 7f488091f640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:36:52.758 INFO:tasks.workunit.client.0.smithi138.stderr: -381> 2024-09-14T11:36:52.381+0000 7f488091f640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:36:52.758 INFO:tasks.workunit.client.0.smithi138.stderr: -380> 2024-09-14T11:36:52.381+0000 7f4881120640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:36:52.758 INFO:tasks.workunit.client.0.smithi138.stderr: -379> 2024-09-14T11:36:52.381+0000 7f4881120640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:36:52.758 INFO:tasks.workunit.client.0.smithi138.stderr: -378> 2024-09-14T11:36:52.381+0000 7f4881120640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:36:52.758 INFO:tasks.workunit.client.0.smithi138.stderr: -377> 2024-09-14T11:36:52.381+0000 7f488091f640 10 monclient(hunting): handle_auth_done global_id 7248 payload 824 2024-09-14T11:36:52.758 INFO:tasks.workunit.client.0.smithi138.stderr: -376> 2024-09-14T11:36:52.381+0000 7f488091f640 10 monclient: _finish_hunting 0 2024-09-14T11:36:52.759 INFO:tasks.workunit.client.0.smithi138.stderr: -375> 2024-09-14T11:36:52.381+0000 7f488091f640 1 monclient: found mon.noname-a 2024-09-14T11:36:52.759 INFO:tasks.workunit.client.0.smithi138.stderr: -374> 2024-09-14T11:36:52.381+0000 7f488091f640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.138:3300/0 2024-09-14T11:36:52.759 INFO:tasks.workunit.client.0.smithi138.stderr: -373> 2024-09-14T11:36:52.381+0000 7f487bfff640 10 monclient: get_auth_request con 0x5626d2557b30 auth_method 0 2024-09-14T11:36:52.759 INFO:tasks.workunit.client.0.smithi138.stderr: -372> 2024-09-14T11:36:52.381+0000 7f47667fc640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:36:52.759 INFO:tasks.workunit.client.0.smithi138.stderr: -371> 2024-09-14T11:36:52.381+0000 7f47667fc640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-14T11:36:52.759 INFO:tasks.workunit.client.0.smithi138.stderr: -370> 2024-09-14T11:36:52.381+0000 7f47667fc640 10 monclient: dump: 2024-09-14T11:36:52.759 INFO:tasks.workunit.client.0.smithi138.stderr:epoch 1 2024-09-14T11:36:52.759 INFO:tasks.workunit.client.0.smithi138.stderr:fsid 3f225f43-83a6-4aeb-b798-1f04bb49d597 2024-09-14T11:36:52.759 INFO:tasks.workunit.client.0.smithi138.stderr:last_changed 2024-09-14T11:07:09.252780+0000 2024-09-14T11:36:52.759 INFO:tasks.workunit.client.0.smithi138.stderr:created 2024-09-14T11:07:09.252780+0000 2024-09-14T11:36:52.759 INFO:tasks.workunit.client.0.smithi138.stderr:min_mon_release 19 (squid) 2024-09-14T11:36:52.759 INFO:tasks.workunit.client.0.smithi138.stderr:election_strategy: 1 2024-09-14T11:36:52.760 INFO:tasks.workunit.client.0.smithi138.stderr:0: [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] mon.a 2024-09-14T11:36:52.760 INFO:tasks.workunit.client.0.smithi138.stderr:1: [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] mon.b 2024-09-14T11:36:52.760 INFO:tasks.workunit.client.0.smithi138.stderr:2: [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] mon.c 2024-09-14T11:36:52.760 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-14T11:36:52.760 INFO:tasks.workunit.client.0.smithi138.stderr: -369> 2024-09-14T11:36:52.381+0000 7f47667fc640 10 monclient: _finish_auth 0 2024-09-14T11:36:52.760 INFO:tasks.workunit.client.0.smithi138.stderr: -368> 2024-09-14T11:36:52.381+0000 7f47667fc640 10 monclient: _check_auth_tickets 2024-09-14T11:36:52.760 INFO:tasks.workunit.client.0.smithi138.stderr: -367> 2024-09-14T11:36:52.381+0000 7f4882e199c0 5 monclient: authenticate success, global_id 7248 2024-09-14T11:36:52.760 INFO:tasks.workunit.client.0.smithi138.stderr: -366> 2024-09-14T11:36:52.381+0000 7f47667fc640 10 monclient: handle_config config(0 keys) 2024-09-14T11:36:52.760 INFO:tasks.workunit.client.0.smithi138.stderr: -365> 2024-09-14T11:36:52.381+0000 7f47667fc640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:36:52.760 INFO:tasks.workunit.client.0.smithi138.stderr: -364> 2024-09-14T11:36:52.381+0000 7f47667fc640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-14T11:36:52.760 INFO:tasks.workunit.client.0.smithi138.stderr: -363> 2024-09-14T11:36:52.381+0000 7f47667fc640 10 monclient: dump: 2024-09-14T11:36:52.761 INFO:tasks.workunit.client.0.smithi138.stderr:epoch 1 2024-09-14T11:36:52.761 INFO:tasks.workunit.client.0.smithi138.stderr:fsid 3f225f43-83a6-4aeb-b798-1f04bb49d597 2024-09-14T11:36:52.761 INFO:tasks.workunit.client.0.smithi138.stderr:last_changed 2024-09-14T11:07:09.252780+0000 2024-09-14T11:36:52.761 INFO:tasks.workunit.client.0.smithi138.stderr:created 2024-09-14T11:07:09.252780+0000 2024-09-14T11:36:52.761 INFO:tasks.workunit.client.0.smithi138.stderr:min_mon_release 19 (squid) 2024-09-14T11:36:52.761 INFO:tasks.workunit.client.0.smithi138.stderr:election_strategy: 1 2024-09-14T11:36:52.761 INFO:tasks.workunit.client.0.smithi138.stderr:0: [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] mon.a 2024-09-14T11:36:52.761 INFO:tasks.workunit.client.0.smithi138.stderr:1: [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] mon.b 2024-09-14T11:36:52.761 INFO:tasks.workunit.client.0.smithi138.stderr:2: [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] mon.c 2024-09-14T11:36:52.761 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-14T11:36:52.761 INFO:tasks.workunit.client.0.smithi138.stderr: -362> 2024-09-14T11:36:52.381+0000 7f4882e199c0 10 monclient: _renew_subs 2024-09-14T11:36:52.761 INFO:tasks.workunit.client.0.smithi138.stderr: -361> 2024-09-14T11:36:52.381+0000 7f487b7fe640 4 set_mon_vals no callback set 2024-09-14T11:36:52.762 INFO:tasks.workunit.client.0.smithi138.stderr: -360> 2024-09-14T11:36:52.381+0000 7f4882e199c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.138:3300/0 2024-09-14T11:36:52.762 INFO:tasks.workunit.client.0.smithi138.stderr: -359> 2024-09-14T11:36:52.381+0000 7f4882e199c0 10 monclient: _renew_subs 2024-09-14T11:36:52.762 INFO:tasks.workunit.client.0.smithi138.stderr: -358> 2024-09-14T11:36:52.381+0000 7f4882e199c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.138:3300/0 2024-09-14T11:36:52.762 INFO:tasks.workunit.client.0.smithi138.stderr: -357> 2024-09-14T11:36:52.385+0000 7f47667fc640 4 mgrc handle_mgr_map Got map version 5 2024-09-14T11:36:52.762 INFO:tasks.workunit.client.0.smithi138.stderr: -356> 2024-09-14T11:36:52.385+0000 7f47667fc640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.138:6832/3778043143,v1:172.21.15.138:6833/3778043143] 2024-09-14T11:36:52.762 INFO:tasks.workunit.client.0.smithi138.stderr: -355> 2024-09-14T11:36:52.385+0000 7f47667fc640 4 mgrc reconnect Starting new session with [v2:172.21.15.138:6832/3778043143,v1:172.21.15.138:6833/3778043143] 2024-09-14T11:36:52.762 INFO:tasks.workunit.client.0.smithi138.stderr: -354> 2024-09-14T11:36:52.385+0000 7f487bfff640 10 monclient: get_auth_request con 0x7f47580717e0 auth_method 0 2024-09-14T11:36:52.762 INFO:tasks.workunit.client.0.smithi138.stderr: -353> 2024-09-14T11:36:52.385+0000 7f4882e199c0 10 monclient: get_monmap_and_config 2024-09-14T11:36:52.762 INFO:tasks.workunit.client.0.smithi138.stderr: -352> 2024-09-14T11:36:52.385+0000 7f4882e199c0 10 monclient: build_initial_monmap 2024-09-14T11:36:52.762 INFO:tasks.workunit.client.0.smithi138.stderr: -351> 2024-09-14T11:36:52.385+0000 7f4882e199c0 1 build_initial for_mkfs: 0 2024-09-14T11:36:52.762 INFO:tasks.workunit.client.0.smithi138.stderr: -350> 2024-09-14T11:36:52.385+0000 7f4882e199c0 10 monclient: monmap: 2024-09-14T11:36:52.762 INFO:tasks.workunit.client.0.smithi138.stderr:epoch 0 2024-09-14T11:36:52.763 INFO:tasks.workunit.client.0.smithi138.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-14T11:36:52.763 INFO:tasks.workunit.client.0.smithi138.stderr:last_changed 0.000000 2024-09-14T11:36:52.763 INFO:tasks.workunit.client.0.smithi138.stderr:created 0.000000 2024-09-14T11:36:52.763 INFO:tasks.workunit.client.0.smithi138.stderr:min_mon_release 0 (unknown) 2024-09-14T11:36:52.763 INFO:tasks.workunit.client.0.smithi138.stderr:election_strategy: 1 2024-09-14T11:36:52.763 INFO:tasks.workunit.client.0.smithi138.stderr:0: [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] mon.noname-a 2024-09-14T11:36:52.763 INFO:tasks.workunit.client.0.smithi138.stderr:1: [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] mon.noname-b 2024-09-14T11:36:52.763 INFO:tasks.workunit.client.0.smithi138.stderr:2: [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] mon.noname-c 2024-09-14T11:36:52.763 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-14T11:36:52.763 INFO:tasks.workunit.client.0.smithi138.stderr: -349> 2024-09-14T11:36:52.385+0000 7f4882e199c0 5 AuthRegistry(0x5626d2577040) adding auth protocol: cephx 2024-09-14T11:36:52.763 INFO:tasks.workunit.client.0.smithi138.stderr: -348> 2024-09-14T11:36:52.385+0000 7f4882e199c0 5 AuthRegistry(0x5626d2577040) adding auth protocol: cephx 2024-09-14T11:36:52.763 INFO:tasks.workunit.client.0.smithi138.stderr: -347> 2024-09-14T11:36:52.385+0000 7f4882e199c0 5 AuthRegistry(0x5626d2577040) adding auth protocol: cephx 2024-09-14T11:36:52.764 INFO:tasks.workunit.client.0.smithi138.stderr: -346> 2024-09-14T11:36:52.385+0000 7f4882e199c0 5 AuthRegistry(0x5626d2577040) adding con mode: secure 2024-09-14T11:36:52.764 INFO:tasks.workunit.client.0.smithi138.stderr: -345> 2024-09-14T11:36:52.385+0000 7f4882e199c0 5 AuthRegistry(0x5626d2577040) adding con mode: crc 2024-09-14T11:36:52.764 INFO:tasks.workunit.client.0.smithi138.stderr: -344> 2024-09-14T11:36:52.385+0000 7f4882e199c0 5 AuthRegistry(0x5626d2577040) adding con mode: secure 2024-09-14T11:36:52.764 INFO:tasks.workunit.client.0.smithi138.stderr: -343> 2024-09-14T11:36:52.385+0000 7f4882e199c0 5 AuthRegistry(0x5626d2577040) adding con mode: crc 2024-09-14T11:36:52.764 INFO:tasks.workunit.client.0.smithi138.stderr: -342> 2024-09-14T11:36:52.385+0000 7f4882e199c0 5 AuthRegistry(0x5626d2577040) adding con mode: secure 2024-09-14T11:36:52.764 INFO:tasks.workunit.client.0.smithi138.stderr: -341> 2024-09-14T11:36:52.385+0000 7f4882e199c0 5 AuthRegistry(0x5626d2577040) adding con mode: crc 2024-09-14T11:36:52.764 INFO:tasks.workunit.client.0.smithi138.stderr: -340> 2024-09-14T11:36:52.385+0000 7f4882e199c0 5 AuthRegistry(0x5626d2577040) adding con mode: crc 2024-09-14T11:36:52.764 INFO:tasks.workunit.client.0.smithi138.stderr: -339> 2024-09-14T11:36:52.385+0000 7f4882e199c0 5 AuthRegistry(0x5626d2577040) adding con mode: secure 2024-09-14T11:36:52.764 INFO:tasks.workunit.client.0.smithi138.stderr: -338> 2024-09-14T11:36:52.385+0000 7f4882e199c0 5 AuthRegistry(0x5626d2577040) adding con mode: crc 2024-09-14T11:36:52.764 INFO:tasks.workunit.client.0.smithi138.stderr: -337> 2024-09-14T11:36:52.385+0000 7f4882e199c0 5 AuthRegistry(0x5626d2577040) adding con mode: secure 2024-09-14T11:36:52.764 INFO:tasks.workunit.client.0.smithi138.stderr: -336> 2024-09-14T11:36:52.385+0000 7f4882e199c0 5 AuthRegistry(0x5626d2577040) adding con mode: crc 2024-09-14T11:36:52.764 INFO:tasks.workunit.client.0.smithi138.stderr: -335> 2024-09-14T11:36:52.385+0000 7f4882e199c0 5 AuthRegistry(0x5626d2577040) adding con mode: secure 2024-09-14T11:36:52.765 INFO:tasks.workunit.client.0.smithi138.stderr: -334> 2024-09-14T11:36:52.385+0000 7f4882e199c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:36:52.765 INFO:tasks.workunit.client.0.smithi138.stderr: -333> 2024-09-14T11:36:52.385+0000 7f4882e199c0 10 monclient: init 2024-09-14T11:36:52.765 INFO:tasks.workunit.client.0.smithi138.stderr: -332> 2024-09-14T11:36:52.385+0000 7f4882e199c0 5 AuthRegistry(0x7ffc46a26050) adding auth protocol: cephx 2024-09-14T11:36:52.765 INFO:tasks.workunit.client.0.smithi138.stderr: -331> 2024-09-14T11:36:52.385+0000 7f4882e199c0 5 AuthRegistry(0x7ffc46a26050) adding auth protocol: cephx 2024-09-14T11:36:52.765 INFO:tasks.workunit.client.0.smithi138.stderr: -330> 2024-09-14T11:36:52.385+0000 7f4882e199c0 5 AuthRegistry(0x7ffc46a26050) adding auth protocol: cephx 2024-09-14T11:36:52.765 INFO:tasks.workunit.client.0.smithi138.stderr: -329> 2024-09-14T11:36:52.385+0000 7f4882e199c0 5 AuthRegistry(0x7ffc46a26050) adding con mode: secure 2024-09-14T11:36:52.765 INFO:tasks.workunit.client.0.smithi138.stderr: -328> 2024-09-14T11:36:52.385+0000 7f4882e199c0 5 AuthRegistry(0x7ffc46a26050) adding con mode: crc 2024-09-14T11:36:52.765 INFO:tasks.workunit.client.0.smithi138.stderr: -327> 2024-09-14T11:36:52.385+0000 7f4882e199c0 5 AuthRegistry(0x7ffc46a26050) adding con mode: secure 2024-09-14T11:36:52.765 INFO:tasks.workunit.client.0.smithi138.stderr: -326> 2024-09-14T11:36:52.385+0000 7f4882e199c0 5 AuthRegistry(0x7ffc46a26050) adding con mode: crc 2024-09-14T11:36:52.765 INFO:tasks.workunit.client.0.smithi138.stderr: -325> 2024-09-14T11:36:52.385+0000 7f4882e199c0 5 AuthRegistry(0x7ffc46a26050) adding con mode: secure 2024-09-14T11:36:52.765 INFO:tasks.workunit.client.0.smithi138.stderr: -324> 2024-09-14T11:36:52.385+0000 7f4882e199c0 5 AuthRegistry(0x7ffc46a26050) adding con mode: crc 2024-09-14T11:36:52.765 INFO:tasks.workunit.client.0.smithi138.stderr: -323> 2024-09-14T11:36:52.385+0000 7f4882e199c0 5 AuthRegistry(0x7ffc46a26050) adding con mode: crc 2024-09-14T11:36:52.766 INFO:tasks.workunit.client.0.smithi138.stderr: -322> 2024-09-14T11:36:52.385+0000 7f4882e199c0 5 AuthRegistry(0x7ffc46a26050) adding con mode: secure 2024-09-14T11:36:52.766 INFO:tasks.workunit.client.0.smithi138.stderr: -321> 2024-09-14T11:36:52.385+0000 7f4882e199c0 5 AuthRegistry(0x7ffc46a26050) adding con mode: crc 2024-09-14T11:36:52.766 INFO:tasks.workunit.client.0.smithi138.stderr: -320> 2024-09-14T11:36:52.385+0000 7f4882e199c0 5 AuthRegistry(0x7ffc46a26050) adding con mode: secure 2024-09-14T11:36:52.766 INFO:tasks.workunit.client.0.smithi138.stderr: -319> 2024-09-14T11:36:52.385+0000 7f4882e199c0 5 AuthRegistry(0x7ffc46a26050) adding con mode: crc 2024-09-14T11:36:52.766 INFO:tasks.workunit.client.0.smithi138.stderr: -318> 2024-09-14T11:36:52.385+0000 7f4882e199c0 5 AuthRegistry(0x7ffc46a26050) adding con mode: secure 2024-09-14T11:36:52.766 INFO:tasks.workunit.client.0.smithi138.stderr: -317> 2024-09-14T11:36:52.385+0000 7f4882e199c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:36:52.766 INFO:tasks.workunit.client.0.smithi138.stderr: -316> 2024-09-14T11:36:52.385+0000 7f4882e199c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:36:52.766 INFO:tasks.workunit.client.0.smithi138.stderr: -315> 2024-09-14T11:36:52.385+0000 7f4882e199c0 5 asok(0x5626d22cbd90) register_command rotate-key cmddesc rotate-key hook 0x7ffc46a26198 EEXIST 2024-09-14T11:36:52.766 INFO:tasks.workunit.client.0.smithi138.stderr: -314> 2024-09-14T11:36:52.385+0000 7f4882e199c0 10 monclient: _reopen_session rank -1 2024-09-14T11:36:52.766 INFO:tasks.workunit.client.0.smithi138.stderr: -313> 2024-09-14T11:36:52.385+0000 7f4882e199c0 10 monclient: _add_conns ranks=[1,0,2] 2024-09-14T11:36:52.766 INFO:tasks.workunit.client.0.smithi138.stderr: -312> 2024-09-14T11:36:52.385+0000 7f4882e199c0 10 monclient(hunting): picked mon.noname-b con 0x5626d25ab6d0 addr [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] 2024-09-14T11:36:52.766 INFO:tasks.workunit.client.0.smithi138.stderr: -311> 2024-09-14T11:36:52.385+0000 7f4882e199c0 10 monclient(hunting): picked mon.noname-a con 0x5626d257b0f0 addr [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] 2024-09-14T11:36:52.767 INFO:tasks.workunit.client.0.smithi138.stderr: -310> 2024-09-14T11:36:52.385+0000 7f4882e199c0 10 monclient(hunting): picked mon.noname-c con 0x5626d25a6ea0 addr [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] 2024-09-14T11:36:52.767 INFO:tasks.workunit.client.0.smithi138.stderr: -309> 2024-09-14T11:36:52.385+0000 7f4882e199c0 10 monclient(hunting): start opening mon connection 2024-09-14T11:36:52.767 INFO:tasks.workunit.client.0.smithi138.stderr: -308> 2024-09-14T11:36:52.385+0000 7f4882e199c0 10 monclient(hunting): start opening mon connection 2024-09-14T11:36:52.767 INFO:tasks.workunit.client.0.smithi138.stderr: -307> 2024-09-14T11:36:52.385+0000 7f4882e199c0 10 monclient(hunting): start opening mon connection 2024-09-14T11:36:52.767 INFO:tasks.workunit.client.0.smithi138.stderr: -306> 2024-09-14T11:36:52.385+0000 7f4882e199c0 10 monclient(hunting): _renew_subs 2024-09-14T11:36:52.767 INFO:tasks.workunit.client.0.smithi138.stderr: -305> 2024-09-14T11:36:52.385+0000 7f4882e199c0 10 monclient(hunting): authenticate will time out at 2748.349735s 2024-09-14T11:36:52.767 INFO:tasks.workunit.client.0.smithi138.stderr: -304> 2024-09-14T11:36:52.385+0000 7f488091f640 10 monclient(hunting): get_auth_request con 0x5626d25a6ea0 auth_method 0 2024-09-14T11:36:52.767 INFO:tasks.workunit.client.0.smithi138.stderr: -303> 2024-09-14T11:36:52.385+0000 7f488091f640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:36:52.767 INFO:tasks.workunit.client.0.smithi138.stderr: -302> 2024-09-14T11:36:52.385+0000 7f488091f640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:36:52.767 INFO:tasks.workunit.client.0.smithi138.stderr: -301> 2024-09-14T11:36:52.385+0000 7f488091f640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:36:52.767 INFO:tasks.workunit.client.0.smithi138.stderr: -300> 2024-09-14T11:36:52.385+0000 7f4881120640 10 monclient(hunting): get_auth_request con 0x5626d257b0f0 auth_method 0 2024-09-14T11:36:52.767 INFO:tasks.workunit.client.0.smithi138.stderr: -299> 2024-09-14T11:36:52.385+0000 7f4881120640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:36:52.768 INFO:tasks.workunit.client.0.smithi138.stderr: -298> 2024-09-14T11:36:52.385+0000 7f4881120640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:36:52.768 INFO:tasks.workunit.client.0.smithi138.stderr: -297> 2024-09-14T11:36:52.385+0000 7f4881120640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:36:52.768 INFO:tasks.workunit.client.0.smithi138.stderr: -296> 2024-09-14T11:36:52.385+0000 7f488091f640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:36:52.768 INFO:tasks.workunit.client.0.smithi138.stderr: -295> 2024-09-14T11:36:52.385+0000 7f488091f640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:36:52.768 INFO:tasks.workunit.client.0.smithi138.stderr: -294> 2024-09-14T11:36:52.385+0000 7f488091f640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:36:52.768 INFO:tasks.workunit.client.0.smithi138.stderr: -293> 2024-09-14T11:36:52.385+0000 7f4881120640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:36:52.768 INFO:tasks.workunit.client.0.smithi138.stderr: -292> 2024-09-14T11:36:52.385+0000 7f4881120640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:36:52.768 INFO:tasks.workunit.client.0.smithi138.stderr: -291> 2024-09-14T11:36:52.385+0000 7f4881120640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:36:52.768 INFO:tasks.workunit.client.0.smithi138.stderr: -290> 2024-09-14T11:36:52.385+0000 7f488091f640 10 monclient(hunting): handle_auth_done global_id 6788 payload 274 2024-09-14T11:36:52.768 INFO:tasks.workunit.client.0.smithi138.stderr: -289> 2024-09-14T11:36:52.385+0000 7f488091f640 10 monclient: _finish_hunting 0 2024-09-14T11:36:52.768 INFO:tasks.workunit.client.0.smithi138.stderr: -288> 2024-09-14T11:36:52.385+0000 7f488091f640 1 monclient: found mon.noname-c 2024-09-14T11:36:52.768 INFO:tasks.workunit.client.0.smithi138.stderr: -287> 2024-09-14T11:36:52.385+0000 7f488091f640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.138:3301/0 2024-09-14T11:36:52.769 INFO:tasks.workunit.client.0.smithi138.stderr: -286> 2024-09-14T11:36:52.385+0000 7f4757fff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:36:52.769 INFO:tasks.workunit.client.0.smithi138.stderr: -285> 2024-09-14T11:36:52.385+0000 7f4757fff640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-14T11:36:52.769 INFO:tasks.workunit.client.0.smithi138.stderr: -284> 2024-09-14T11:36:52.385+0000 7f4757fff640 10 monclient: dump: 2024-09-14T11:36:52.769 INFO:tasks.workunit.client.0.smithi138.stderr:epoch 1 2024-09-14T11:36:52.769 INFO:tasks.workunit.client.0.smithi138.stderr:fsid 3f225f43-83a6-4aeb-b798-1f04bb49d597 2024-09-14T11:36:52.769 INFO:tasks.workunit.client.0.smithi138.stderr:last_changed 2024-09-14T11:07:09.252780+0000 2024-09-14T11:36:52.769 INFO:tasks.workunit.client.0.smithi138.stderr:created 2024-09-14T11:07:09.252780+0000 2024-09-14T11:36:52.769 INFO:tasks.workunit.client.0.smithi138.stderr:min_mon_release 19 (squid) 2024-09-14T11:36:52.769 INFO:tasks.workunit.client.0.smithi138.stderr:election_strategy: 1 2024-09-14T11:36:52.769 INFO:tasks.workunit.client.0.smithi138.stderr:0: [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] mon.a 2024-09-14T11:36:52.769 INFO:tasks.workunit.client.0.smithi138.stderr:1: [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] mon.b 2024-09-14T11:36:52.769 INFO:tasks.workunit.client.0.smithi138.stderr:2: [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] mon.c 2024-09-14T11:36:52.770 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-14T11:36:52.770 INFO:tasks.workunit.client.0.smithi138.stderr: -283> 2024-09-14T11:36:52.385+0000 7f4757fff640 10 monclient: _finish_auth 0 2024-09-14T11:36:52.770 INFO:tasks.workunit.client.0.smithi138.stderr: -282> 2024-09-14T11:36:52.385+0000 7f4757fff640 10 monclient: _check_auth_tickets 2024-09-14T11:36:52.770 INFO:tasks.workunit.client.0.smithi138.stderr: -281> 2024-09-14T11:36:52.385+0000 7f4882e199c0 5 monclient: authenticate success, global_id 6788 2024-09-14T11:36:52.770 INFO:tasks.workunit.client.0.smithi138.stderr: -280> 2024-09-14T11:36:52.385+0000 7f4757fff640 10 monclient: handle_config config(0 keys) 2024-09-14T11:36:52.770 INFO:tasks.workunit.client.0.smithi138.stderr: -279> 2024-09-14T11:36:52.385+0000 7f4882e199c0 10 monclient: get_monmap_and_config success 2024-09-14T11:36:52.770 INFO:tasks.workunit.client.0.smithi138.stderr: -278> 2024-09-14T11:36:52.385+0000 7f4882e199c0 4 set_mon_vals no callback set 2024-09-14T11:36:52.770 INFO:tasks.workunit.client.0.smithi138.stderr: -277> 2024-09-14T11:36:52.385+0000 7f4757fff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:36:52.770 INFO:tasks.workunit.client.0.smithi138.stderr: -276> 2024-09-14T11:36:52.385+0000 7f4757fff640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-14T11:36:52.770 INFO:tasks.workunit.client.0.smithi138.stderr: -275> 2024-09-14T11:36:52.385+0000 7f4757fff640 10 monclient: dump: 2024-09-14T11:36:52.770 INFO:tasks.workunit.client.0.smithi138.stderr:epoch 1 2024-09-14T11:36:52.770 INFO:tasks.workunit.client.0.smithi138.stderr:fsid 3f225f43-83a6-4aeb-b798-1f04bb49d597 2024-09-14T11:36:52.771 INFO:tasks.workunit.client.0.smithi138.stderr:last_changed 2024-09-14T11:07:09.252780+0000 2024-09-14T11:36:52.771 INFO:tasks.workunit.client.0.smithi138.stderr:created 2024-09-14T11:07:09.252780+0000 2024-09-14T11:36:52.771 INFO:tasks.workunit.client.0.smithi138.stderr:min_mon_release 19 (squid) 2024-09-14T11:36:52.771 INFO:tasks.workunit.client.0.smithi138.stderr:election_strategy: 1 2024-09-14T11:36:52.771 INFO:tasks.workunit.client.0.smithi138.stderr:0: [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] mon.a 2024-09-14T11:36:52.771 INFO:tasks.workunit.client.0.smithi138.stderr:1: [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] mon.b 2024-09-14T11:36:52.771 INFO:tasks.workunit.client.0.smithi138.stderr:2: [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] mon.c 2024-09-14T11:36:52.771 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-14T11:36:52.771 INFO:tasks.workunit.client.0.smithi138.stderr: -274> 2024-09-14T11:36:52.385+0000 7f4882e199c0 10 monclient: shutdown 2024-09-14T11:36:52.771 INFO:tasks.workunit.client.0.smithi138.stderr: -273> 2024-09-14T11:36:52.385+0000 7f4882e199c0 10 monclient: build_initial_monmap 2024-09-14T11:36:52.771 INFO:tasks.workunit.client.0.smithi138.stderr: -272> 2024-09-14T11:36:52.385+0000 7f4882e199c0 1 build_initial for_mkfs: 0 2024-09-14T11:36:52.771 INFO:tasks.workunit.client.0.smithi138.stderr: -271> 2024-09-14T11:36:52.385+0000 7f4882e199c0 10 monclient: monmap: 2024-09-14T11:36:52.771 INFO:tasks.workunit.client.0.smithi138.stderr:epoch 0 2024-09-14T11:36:52.772 INFO:tasks.workunit.client.0.smithi138.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-14T11:36:52.772 INFO:tasks.workunit.client.0.smithi138.stderr:last_changed 0.000000 2024-09-14T11:36:52.772 INFO:tasks.workunit.client.0.smithi138.stderr:created 0.000000 2024-09-14T11:36:52.772 INFO:tasks.workunit.client.0.smithi138.stderr:min_mon_release 0 (unknown) 2024-09-14T11:36:52.772 INFO:tasks.workunit.client.0.smithi138.stderr:election_strategy: 1 2024-09-14T11:36:52.772 INFO:tasks.workunit.client.0.smithi138.stderr:0: [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] mon.noname-a 2024-09-14T11:36:52.772 INFO:tasks.workunit.client.0.smithi138.stderr:1: [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] mon.noname-b 2024-09-14T11:36:52.772 INFO:tasks.workunit.client.0.smithi138.stderr:2: [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] mon.noname-c 2024-09-14T11:36:52.772 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-14T11:36:52.772 INFO:tasks.workunit.client.0.smithi138.stderr: -270> 2024-09-14T11:36:52.385+0000 7f4882e199c0 5 AuthRegistry(0x5626d259c0f0) adding auth protocol: cephx 2024-09-14T11:36:52.772 INFO:tasks.workunit.client.0.smithi138.stderr: -269> 2024-09-14T11:36:52.385+0000 7f4882e199c0 5 AuthRegistry(0x5626d259c0f0) adding auth protocol: cephx 2024-09-14T11:36:52.772 INFO:tasks.workunit.client.0.smithi138.stderr: -268> 2024-09-14T11:36:52.385+0000 7f4882e199c0 5 AuthRegistry(0x5626d259c0f0) adding auth protocol: cephx 2024-09-14T11:36:52.773 INFO:tasks.workunit.client.0.smithi138.stderr: -267> 2024-09-14T11:36:52.385+0000 7f4882e199c0 5 AuthRegistry(0x5626d259c0f0) adding con mode: secure 2024-09-14T11:36:52.773 INFO:tasks.workunit.client.0.smithi138.stderr: -266> 2024-09-14T11:36:52.385+0000 7f4882e199c0 5 AuthRegistry(0x5626d259c0f0) adding con mode: crc 2024-09-14T11:36:52.773 INFO:tasks.workunit.client.0.smithi138.stderr: -265> 2024-09-14T11:36:52.385+0000 7f4882e199c0 5 AuthRegistry(0x5626d259c0f0) adding con mode: secure 2024-09-14T11:36:52.773 INFO:tasks.workunit.client.0.smithi138.stderr: -264> 2024-09-14T11:36:52.385+0000 7f4882e199c0 5 AuthRegistry(0x5626d259c0f0) adding con mode: crc 2024-09-14T11:36:52.773 INFO:tasks.workunit.client.0.smithi138.stderr: -263> 2024-09-14T11:36:52.385+0000 7f4882e199c0 5 AuthRegistry(0x5626d259c0f0) adding con mode: secure 2024-09-14T11:36:52.773 INFO:tasks.workunit.client.0.smithi138.stderr: -262> 2024-09-14T11:36:52.385+0000 7f4882e199c0 5 AuthRegistry(0x5626d259c0f0) adding con mode: crc 2024-09-14T11:36:52.773 INFO:tasks.workunit.client.0.smithi138.stderr: -261> 2024-09-14T11:36:52.385+0000 7f4882e199c0 5 AuthRegistry(0x5626d259c0f0) adding con mode: crc 2024-09-14T11:36:52.773 INFO:tasks.workunit.client.0.smithi138.stderr: -260> 2024-09-14T11:36:52.385+0000 7f4882e199c0 5 AuthRegistry(0x5626d259c0f0) adding con mode: secure 2024-09-14T11:36:52.773 INFO:tasks.workunit.client.0.smithi138.stderr: -259> 2024-09-14T11:36:52.385+0000 7f4882e199c0 5 AuthRegistry(0x5626d259c0f0) adding con mode: crc 2024-09-14T11:36:52.773 INFO:tasks.workunit.client.0.smithi138.stderr: -258> 2024-09-14T11:36:52.385+0000 7f4882e199c0 5 AuthRegistry(0x5626d259c0f0) adding con mode: secure 2024-09-14T11:36:52.773 INFO:tasks.workunit.client.0.smithi138.stderr: -257> 2024-09-14T11:36:52.385+0000 7f4882e199c0 5 AuthRegistry(0x5626d259c0f0) adding con mode: crc 2024-09-14T11:36:52.773 INFO:tasks.workunit.client.0.smithi138.stderr: -256> 2024-09-14T11:36:52.385+0000 7f4882e199c0 5 AuthRegistry(0x5626d259c0f0) adding con mode: secure 2024-09-14T11:36:52.774 INFO:tasks.workunit.client.0.smithi138.stderr: -255> 2024-09-14T11:36:52.385+0000 7f4882e199c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:36:52.774 INFO:tasks.workunit.client.0.smithi138.stderr: -254> 2024-09-14T11:36:52.385+0000 7f4882e199c0 1 librados: starting msgr at 2024-09-14T11:36:52.774 INFO:tasks.workunit.client.0.smithi138.stderr: -253> 2024-09-14T11:36:52.385+0000 7f4882e199c0 1 librados: starting objecter 2024-09-14T11:36:52.774 INFO:tasks.workunit.client.0.smithi138.stderr: -252> 2024-09-14T11:36:52.385+0000 7f4882e199c0 5 asok(0x5626d22cbd90) register_command objecter_requests cmddesc objecter_requests hook 0x5626d2559430 EEXIST 2024-09-14T11:36:52.774 INFO:tasks.workunit.client.0.smithi138.stderr: -251> 2024-09-14T11:36:52.385+0000 7f4882e199c0 1 librados: setting wanted keys 2024-09-14T11:36:52.774 INFO:tasks.workunit.client.0.smithi138.stderr: -250> 2024-09-14T11:36:52.385+0000 7f4882e199c0 1 librados: calling monclient init 2024-09-14T11:36:52.774 INFO:tasks.workunit.client.0.smithi138.stderr: -249> 2024-09-14T11:36:52.385+0000 7f4882e199c0 10 monclient: init 2024-09-14T11:36:52.774 INFO:tasks.workunit.client.0.smithi138.stderr: -248> 2024-09-14T11:36:52.385+0000 7f4882e199c0 5 AuthRegistry(0x5626d2559950) adding auth protocol: cephx 2024-09-14T11:36:52.774 INFO:tasks.workunit.client.0.smithi138.stderr: -247> 2024-09-14T11:36:52.385+0000 7f4882e199c0 5 AuthRegistry(0x5626d2559950) adding auth protocol: cephx 2024-09-14T11:36:52.774 INFO:tasks.workunit.client.0.smithi138.stderr: -246> 2024-09-14T11:36:52.385+0000 7f4882e199c0 5 AuthRegistry(0x5626d2559950) adding auth protocol: cephx 2024-09-14T11:36:52.774 INFO:tasks.workunit.client.0.smithi138.stderr: -245> 2024-09-14T11:36:52.385+0000 7f4882e199c0 5 AuthRegistry(0x5626d2559950) adding con mode: secure 2024-09-14T11:36:52.774 INFO:tasks.workunit.client.0.smithi138.stderr: -244> 2024-09-14T11:36:52.385+0000 7f4882e199c0 5 AuthRegistry(0x5626d2559950) adding con mode: crc 2024-09-14T11:36:52.774 INFO:tasks.workunit.client.0.smithi138.stderr: -243> 2024-09-14T11:36:52.385+0000 7f4882e199c0 5 AuthRegistry(0x5626d2559950) adding con mode: secure 2024-09-14T11:36:52.775 INFO:tasks.workunit.client.0.smithi138.stderr: -242> 2024-09-14T11:36:52.385+0000 7f4882e199c0 5 AuthRegistry(0x5626d2559950) adding con mode: crc 2024-09-14T11:36:52.775 INFO:tasks.workunit.client.0.smithi138.stderr: -241> 2024-09-14T11:36:52.385+0000 7f4882e199c0 5 AuthRegistry(0x5626d2559950) adding con mode: secure 2024-09-14T11:36:52.775 INFO:tasks.workunit.client.0.smithi138.stderr: -240> 2024-09-14T11:36:52.385+0000 7f4882e199c0 5 AuthRegistry(0x5626d2559950) adding con mode: crc 2024-09-14T11:36:52.775 INFO:tasks.workunit.client.0.smithi138.stderr: -239> 2024-09-14T11:36:52.385+0000 7f4882e199c0 5 AuthRegistry(0x5626d2559950) adding con mode: crc 2024-09-14T11:36:52.775 INFO:tasks.workunit.client.0.smithi138.stderr: -238> 2024-09-14T11:36:52.385+0000 7f4882e199c0 5 AuthRegistry(0x5626d2559950) adding con mode: secure 2024-09-14T11:36:52.775 INFO:tasks.workunit.client.0.smithi138.stderr: -237> 2024-09-14T11:36:52.385+0000 7f4882e199c0 5 AuthRegistry(0x5626d2559950) adding con mode: crc 2024-09-14T11:36:52.775 INFO:tasks.workunit.client.0.smithi138.stderr: -236> 2024-09-14T11:36:52.385+0000 7f4882e199c0 5 AuthRegistry(0x5626d2559950) adding con mode: secure 2024-09-14T11:36:52.775 INFO:tasks.workunit.client.0.smithi138.stderr: -235> 2024-09-14T11:36:52.385+0000 7f4882e199c0 5 AuthRegistry(0x5626d2559950) adding con mode: crc 2024-09-14T11:36:52.775 INFO:tasks.workunit.client.0.smithi138.stderr: -234> 2024-09-14T11:36:52.385+0000 7f4882e199c0 5 AuthRegistry(0x5626d2559950) adding con mode: secure 2024-09-14T11:36:52.775 INFO:tasks.workunit.client.0.smithi138.stderr: -233> 2024-09-14T11:36:52.389+0000 7f4882e199c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:36:52.775 INFO:tasks.workunit.client.0.smithi138.stderr: -232> 2024-09-14T11:36:52.389+0000 7f4882e199c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:36:52.776 INFO:tasks.workunit.client.0.smithi138.stderr: -231> 2024-09-14T11:36:52.389+0000 7f4882e199c0 5 asok(0x5626d22cbd90) register_command rotate-key cmddesc rotate-key hook 0x5626d2559a98 EEXIST 2024-09-14T11:36:52.776 INFO:tasks.workunit.client.0.smithi138.stderr: -230> 2024-09-14T11:36:52.389+0000 7f4882e199c0 10 monclient: _reopen_session rank -1 2024-09-14T11:36:52.776 INFO:tasks.workunit.client.0.smithi138.stderr: -229> 2024-09-14T11:36:52.389+0000 7f4882e199c0 10 monclient: _add_conns ranks=[0,2,1] 2024-09-14T11:36:52.776 INFO:tasks.workunit.client.0.smithi138.stderr: -228> 2024-09-14T11:36:52.389+0000 7f4882e199c0 10 monclient(hunting): picked mon.noname-a con 0x5626d257b0f0 addr [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] 2024-09-14T11:36:52.776 INFO:tasks.workunit.client.0.smithi138.stderr: -227> 2024-09-14T11:36:52.389+0000 7f4882e199c0 10 monclient(hunting): picked mon.noname-c con 0x5626d25a6ea0 addr [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] 2024-09-14T11:36:52.776 INFO:tasks.workunit.client.0.smithi138.stderr: -226> 2024-09-14T11:36:52.389+0000 7f4882e199c0 10 monclient(hunting): picked mon.noname-b con 0x5626d25ab6d0 addr [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] 2024-09-14T11:36:52.776 INFO:tasks.workunit.client.0.smithi138.stderr: -225> 2024-09-14T11:36:52.389+0000 7f4882e199c0 10 monclient(hunting): start opening mon connection 2024-09-14T11:36:52.776 INFO:tasks.workunit.client.0.smithi138.stderr: -224> 2024-09-14T11:36:52.389+0000 7f4882e199c0 10 monclient(hunting): start opening mon connection 2024-09-14T11:36:52.776 INFO:tasks.workunit.client.0.smithi138.stderr: -223> 2024-09-14T11:36:52.389+0000 7f4882e199c0 10 monclient(hunting): start opening mon connection 2024-09-14T11:36:52.776 INFO:tasks.workunit.client.0.smithi138.stderr: -222> 2024-09-14T11:36:52.389+0000 7f4882e199c0 10 monclient(hunting): _renew_subs 2024-09-14T11:36:52.776 INFO:tasks.workunit.client.0.smithi138.stderr: -221> 2024-09-14T11:36:52.389+0000 7f4882e199c0 10 monclient(hunting): authenticate will time out at 2748.352350s 2024-09-14T11:36:52.776 INFO:tasks.workunit.client.0.smithi138.stderr: -220> 2024-09-14T11:36:52.389+0000 7f487bfff640 10 monclient(hunting): get_auth_request con 0x5626d257b0f0 auth_method 0 2024-09-14T11:36:52.777 INFO:tasks.workunit.client.0.smithi138.stderr: -219> 2024-09-14T11:36:52.389+0000 7f487bfff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:36:52.777 INFO:tasks.workunit.client.0.smithi138.stderr: -218> 2024-09-14T11:36:52.389+0000 7f487bfff640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:36:52.777 INFO:tasks.workunit.client.0.smithi138.stderr: -217> 2024-09-14T11:36:52.389+0000 7f487bfff640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:36:52.777 INFO:tasks.workunit.client.0.smithi138.stderr: -216> 2024-09-14T11:36:52.389+0000 7f4881120640 10 monclient(hunting): get_auth_request con 0x5626d25a6ea0 auth_method 0 2024-09-14T11:36:52.777 INFO:tasks.workunit.client.0.smithi138.stderr: -215> 2024-09-14T11:36:52.389+0000 7f4881120640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:36:52.777 INFO:tasks.workunit.client.0.smithi138.stderr: -214> 2024-09-14T11:36:52.389+0000 7f4881120640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:36:52.777 INFO:tasks.workunit.client.0.smithi138.stderr: -213> 2024-09-14T11:36:52.389+0000 7f4881120640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:36:52.777 INFO:tasks.workunit.client.0.smithi138.stderr: -212> 2024-09-14T11:36:52.389+0000 7f487bfff640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:36:52.777 INFO:tasks.workunit.client.0.smithi138.stderr: -211> 2024-09-14T11:36:52.389+0000 7f487bfff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:36:52.777 INFO:tasks.workunit.client.0.smithi138.stderr: -210> 2024-09-14T11:36:52.389+0000 7f487bfff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:36:52.777 INFO:tasks.workunit.client.0.smithi138.stderr: -209> 2024-09-14T11:36:52.389+0000 7f4881120640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:36:52.777 INFO:tasks.workunit.client.0.smithi138.stderr: -208> 2024-09-14T11:36:52.389+0000 7f4881120640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:36:52.778 INFO:tasks.workunit.client.0.smithi138.stderr: -207> 2024-09-14T11:36:52.389+0000 7f4881120640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:36:52.778 INFO:tasks.workunit.client.0.smithi138.stderr: -206> 2024-09-14T11:36:52.389+0000 7f487bfff640 10 monclient(hunting): handle_auth_done global_id 7254 payload 824 2024-09-14T11:36:52.778 INFO:tasks.workunit.client.0.smithi138.stderr: -205> 2024-09-14T11:36:52.389+0000 7f487bfff640 10 monclient: _finish_hunting 0 2024-09-14T11:36:52.778 INFO:tasks.workunit.client.0.smithi138.stderr: -204> 2024-09-14T11:36:52.389+0000 7f487bfff640 1 monclient: found mon.noname-a 2024-09-14T11:36:52.778 INFO:tasks.workunit.client.0.smithi138.stderr: -203> 2024-09-14T11:36:52.389+0000 7f487bfff640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.138:3300/0 2024-09-14T11:36:52.778 INFO:tasks.workunit.client.0.smithi138.stderr: -202> 2024-09-14T11:36:52.389+0000 7f47567fc640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:36:52.778 INFO:tasks.workunit.client.0.smithi138.stderr: -201> 2024-09-14T11:36:52.389+0000 7f47567fc640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-14T11:36:52.778 INFO:tasks.workunit.client.0.smithi138.stderr: -200> 2024-09-14T11:36:52.389+0000 7f47567fc640 10 monclient: dump: 2024-09-14T11:36:52.778 INFO:tasks.workunit.client.0.smithi138.stderr:epoch 1 2024-09-14T11:36:52.778 INFO:tasks.workunit.client.0.smithi138.stderr:fsid 3f225f43-83a6-4aeb-b798-1f04bb49d597 2024-09-14T11:36:52.778 INFO:tasks.workunit.client.0.smithi138.stderr:last_changed 2024-09-14T11:07:09.252780+0000 2024-09-14T11:36:52.778 INFO:tasks.workunit.client.0.smithi138.stderr:created 2024-09-14T11:07:09.252780+0000 2024-09-14T11:36:52.778 INFO:tasks.workunit.client.0.smithi138.stderr:min_mon_release 19 (squid) 2024-09-14T11:36:52.779 INFO:tasks.workunit.client.0.smithi138.stderr:election_strategy: 1 2024-09-14T11:36:52.779 INFO:tasks.workunit.client.0.smithi138.stderr:0: [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] mon.a 2024-09-14T11:36:52.779 INFO:tasks.workunit.client.0.smithi138.stderr:1: [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] mon.b 2024-09-14T11:36:52.779 INFO:tasks.workunit.client.0.smithi138.stderr:2: [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] mon.c 2024-09-14T11:36:52.779 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-14T11:36:52.779 INFO:tasks.workunit.client.0.smithi138.stderr: -199> 2024-09-14T11:36:52.389+0000 7f47567fc640 10 monclient: _finish_auth 0 2024-09-14T11:36:52.779 INFO:tasks.workunit.client.0.smithi138.stderr: -198> 2024-09-14T11:36:52.389+0000 7f47567fc640 10 monclient: _check_auth_tickets 2024-09-14T11:36:52.779 INFO:tasks.workunit.client.0.smithi138.stderr: -197> 2024-09-14T11:36:52.389+0000 7f47567fc640 10 monclient: handle_config config(0 keys) 2024-09-14T11:36:52.779 INFO:tasks.workunit.client.0.smithi138.stderr: -196> 2024-09-14T11:36:52.389+0000 7f47567fc640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:36:52.779 INFO:tasks.workunit.client.0.smithi138.stderr: -195> 2024-09-14T11:36:52.389+0000 7f47567fc640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-14T11:36:52.779 INFO:tasks.workunit.client.0.smithi138.stderr: -194> 2024-09-14T11:36:52.389+0000 7f47567fc640 10 monclient: dump: 2024-09-14T11:36:52.779 INFO:tasks.workunit.client.0.smithi138.stderr:epoch 1 2024-09-14T11:36:52.779 INFO:tasks.workunit.client.0.smithi138.stderr:fsid 3f225f43-83a6-4aeb-b798-1f04bb49d597 2024-09-14T11:36:52.780 INFO:tasks.workunit.client.0.smithi138.stderr:last_changed 2024-09-14T11:07:09.252780+0000 2024-09-14T11:36:52.780 INFO:tasks.workunit.client.0.smithi138.stderr:created 2024-09-14T11:07:09.252780+0000 2024-09-14T11:36:52.780 INFO:tasks.workunit.client.0.smithi138.stderr:min_mon_release 19 (squid) 2024-09-14T11:36:52.780 INFO:tasks.workunit.client.0.smithi138.stderr:election_strategy: 1 2024-09-14T11:36:52.780 INFO:tasks.workunit.client.0.smithi138.stderr:0: [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] mon.a 2024-09-14T11:36:52.780 INFO:tasks.workunit.client.0.smithi138.stderr:1: [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] mon.b 2024-09-14T11:36:52.780 INFO:tasks.workunit.client.0.smithi138.stderr:2: [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] mon.c 2024-09-14T11:36:52.780 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-14T11:36:52.780 INFO:tasks.workunit.client.0.smithi138.stderr: -193> 2024-09-14T11:36:52.389+0000 7f4882e199c0 5 monclient: authenticate success, global_id 7254 2024-09-14T11:36:52.780 INFO:tasks.workunit.client.0.smithi138.stderr: -192> 2024-09-14T11:36:52.389+0000 7f4882e199c0 10 monclient: _renew_subs 2024-09-14T11:36:52.780 INFO:tasks.workunit.client.0.smithi138.stderr: -191> 2024-09-14T11:36:52.389+0000 7f4882e199c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.138:3300/0 2024-09-14T11:36:52.780 INFO:tasks.workunit.client.0.smithi138.stderr: -190> 2024-09-14T11:36:52.389+0000 7f4757fff640 4 set_mon_vals no callback set 2024-09-14T11:36:52.781 INFO:tasks.workunit.client.0.smithi138.stderr: -189> 2024-09-14T11:36:52.389+0000 7f4882e199c0 10 monclient: _renew_subs 2024-09-14T11:36:52.781 INFO:tasks.workunit.client.0.smithi138.stderr: -188> 2024-09-14T11:36:52.389+0000 7f4882e199c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.138:3300/0 2024-09-14T11:36:52.781 INFO:tasks.workunit.client.0.smithi138.stderr: -187> 2024-09-14T11:36:52.389+0000 7f4882e199c0 1 librados: init done 2024-09-14T11:36:52.781 INFO:tasks.workunit.client.0.smithi138.stderr: -186> 2024-09-14T11:36:52.389+0000 7f4882e199c0 5 asok(0x5626d22cbd90) register_command cr dump hook 0x5626d259e9e8 2024-09-14T11:36:52.781 INFO:tasks.workunit.client.0.smithi138.stderr: -185> 2024-09-14T11:36:52.389+0000 7f4882e199c0 20 rados->read ofs=0 len=0 2024-09-14T11:36:52.781 INFO:tasks.workunit.client.0.smithi138.stderr: -184> 2024-09-14T11:36:52.389+0000 7f47567fc640 4 mgrc handle_mgr_map Got map version 5 2024-09-14T11:36:52.781 INFO:tasks.workunit.client.0.smithi138.stderr: -183> 2024-09-14T11:36:52.389+0000 7f47567fc640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.138:6832/3778043143,v1:172.21.15.138:6833/3778043143] 2024-09-14T11:36:52.781 INFO:tasks.workunit.client.0.smithi138.stderr: -182> 2024-09-14T11:36:52.389+0000 7f47567fc640 4 mgrc reconnect Starting new session with [v2:172.21.15.138:6832/3778043143,v1:172.21.15.138:6833/3778043143] 2024-09-14T11:36:52.781 INFO:tasks.workunit.client.0.smithi138.stderr: -181> 2024-09-14T11:36:52.389+0000 7f4881120640 10 monclient: get_auth_request con 0x7f474c071960 auth_method 0 2024-09-14T11:36:52.781 INFO:tasks.workunit.client.0.smithi138.stderr: -180> 2024-09-14T11:36:52.389+0000 7f488091f640 10 monclient: get_auth_request con 0x5626d25c4a70 auth_method 0 2024-09-14T11:36:52.781 INFO:tasks.workunit.client.0.smithi138.stderr: -179> 2024-09-14T11:36:52.393+0000 7f4882e199c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:36:52.781 INFO:tasks.workunit.client.0.smithi138.stderr: -178> 2024-09-14T11:36:52.393+0000 7f4882e199c0 20 realm 2024-09-14T11:36:52.782 INFO:tasks.workunit.client.0.smithi138.stderr: -177> 2024-09-14T11:36:52.393+0000 7f4882e199c0 20 rados->read ofs=0 len=0 2024-09-14T11:36:52.782 INFO:tasks.workunit.client.0.smithi138.stderr: -176> 2024-09-14T11:36:52.393+0000 7f4882e199c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:36:52.782 INFO:tasks.workunit.client.0.smithi138.stderr: -175> 2024-09-14T11:36:52.393+0000 7f4882e199c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:36:52.782 INFO:tasks.workunit.client.0.smithi138.stderr: -174> 2024-09-14T11:36:52.393+0000 7f4882e199c0 20 rados->read ofs=0 len=0 2024-09-14T11:36:52.782 INFO:tasks.workunit.client.0.smithi138.stderr: -173> 2024-09-14T11:36:52.393+0000 7f4882e199c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:36:52.782 INFO:tasks.workunit.client.0.smithi138.stderr: -172> 2024-09-14T11:36:52.393+0000 7f4882e199c0 20 rados->read ofs=0 len=0 2024-09-14T11:36:52.782 INFO:tasks.workunit.client.0.smithi138.stderr: -171> 2024-09-14T11:36:52.393+0000 7f487bfff640 10 monclient: get_auth_request con 0x5626d25c88f0 auth_method 0 2024-09-14T11:36:52.782 INFO:tasks.workunit.client.0.smithi138.stderr: -170> 2024-09-14T11:36:52.393+0000 7f4882e199c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:36:52.782 INFO:tasks.workunit.client.0.smithi138.stderr: -169> 2024-09-14T11:36:52.393+0000 7f4882e199c0 20 rados->read ofs=0 len=0 2024-09-14T11:36:52.782 INFO:tasks.workunit.client.0.smithi138.stderr: -168> 2024-09-14T11:36:52.393+0000 7f4881120640 10 monclient: get_auth_request con 0x5626d25cc130 auth_method 0 2024-09-14T11:36:52.782 INFO:tasks.workunit.client.0.smithi138.stderr: -167> 2024-09-14T11:36:52.393+0000 7f4882e199c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:36:52.782 INFO:tasks.workunit.client.0.smithi138.stderr: -166> 2024-09-14T11:36:52.393+0000 7f4882e199c0 20 searching for the correct realm 2024-09-14T11:36:52.782 INFO:tasks.workunit.client.0.smithi138.stderr: -165> 2024-09-14T11:36:52.393+0000 7f488091f640 10 monclient: get_auth_request con 0x5626d25d0ef0 auth_method 0 2024-09-14T11:36:52.783 INFO:tasks.workunit.client.0.smithi138.stderr: -164> 2024-09-14T11:36:52.397+0000 7f487bfff640 10 monclient: get_auth_request con 0x7f4874136030 auth_method 0 2024-09-14T11:36:52.783 INFO:tasks.workunit.client.0.smithi138.stderr: -163> 2024-09-14T11:36:52.397+0000 7f4881120640 10 monclient: get_auth_request con 0x7f487c02e040 auth_method 0 2024-09-14T11:36:52.783 INFO:tasks.workunit.client.0.smithi138.stderr: -162> 2024-09-14T11:36:52.401+0000 7f487bfff640 0 -- 172.21.15.138:0/3095715856 >> [v2:172.21.15.154:6808/1468088432,v1:172.21.15.154:6809/1468088432] conn(0x7f4874136030 msgr2=0x7f4874121b40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:36:52.783 INFO:tasks.workunit.client.0.smithi138.stderr: -161> 2024-09-14T11:36:52.401+0000 7f47567fc640 1 client.7254.objecter ms_handle_reset 0x7f4874136030 session 0x7f4874122680 osd.7 2024-09-14T11:36:52.783 INFO:tasks.workunit.client.0.smithi138.stderr: -160> 2024-09-14T11:36:52.401+0000 7f47567fc640 10 monclient: _renew_subs 2024-09-14T11:36:52.783 INFO:tasks.workunit.client.0.smithi138.stderr: -159> 2024-09-14T11:36:52.401+0000 7f47567fc640 10 monclient: _send_mon_message to mon.a at v2:172.21.15.138:3300/0 2024-09-14T11:36:52.783 INFO:tasks.workunit.client.0.smithi138.stderr: -158> 2024-09-14T11:36:52.401+0000 7f487bfff640 10 monclient: get_auth_request con 0x7f474c082090 auth_method 0 2024-09-14T11:36:52.783 INFO:tasks.workunit.client.0.smithi138.stderr: -157> 2024-09-14T11:36:52.401+0000 7f488091f640 10 monclient: get_auth_request con 0x7f487c03ea10 auth_method 0 2024-09-14T11:36:52.783 INFO:tasks.workunit.client.0.smithi138.stderr: -156> 2024-09-14T11:36:52.405+0000 7f487bfff640 10 monclient: get_auth_request con 0x7f487c04e400 auth_method 0 2024-09-14T11:36:52.783 INFO:tasks.workunit.client.0.smithi138.stderr: -155> 2024-09-14T11:36:52.405+0000 7f487bfff640 0 -- 172.21.15.138:0/3095715856 >> [v2:172.21.15.138:6816/326481658,v1:172.21.15.138:6817/326481658] conn(0x7f487c04e400 msgr2=0x7f487c04e880 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:36:52.783 INFO:tasks.workunit.client.0.smithi138.stderr: -154> 2024-09-14T11:36:52.609+0000 7f487bfff640 10 monclient: get_auth_request con 0x7f487c04e400 auth_method 0 2024-09-14T11:36:52.783 INFO:tasks.workunit.client.0.smithi138.stderr: -153> 2024-09-14T11:36:52.621+0000 7f4882e199c0 20 RGWRados::pool_iterate: got zone_info.d9e72d30-c60b-4d0d-9267-fdc36392d5ad 2024-09-14T11:36:52.784 INFO:tasks.workunit.client.0.smithi138.stderr: -152> 2024-09-14T11:36:52.621+0000 7f4882e199c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:36:52.784 INFO:tasks.workunit.client.0.smithi138.stderr: -151> 2024-09-14T11:36:52.621+0000 7f4882e199c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:36:52.784 INFO:tasks.workunit.client.0.smithi138.stderr: -150> 2024-09-14T11:36:52.621+0000 7f4882e199c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:36:52.784 INFO:tasks.workunit.client.0.smithi138.stderr: -149> 2024-09-14T11:36:52.621+0000 7f4882e199c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:36:52.784 INFO:tasks.workunit.client.0.smithi138.stderr: -148> 2024-09-14T11:36:52.621+0000 7f4882e199c0 20 RGWRados::pool_iterate: got zonegroup_info.65ab941b-da8c-4160-94fb-3672b069d44f 2024-09-14T11:36:52.784 INFO:tasks.workunit.client.0.smithi138.stderr: -147> 2024-09-14T11:36:52.621+0000 7f4882e199c0 20 rados->read ofs=0 len=0 2024-09-14T11:36:52.784 INFO:tasks.workunit.client.0.smithi138.stderr: -146> 2024-09-14T11:36:52.621+0000 7f4882e199c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:36:52.784 INFO:tasks.workunit.client.0.smithi138.stderr: -145> 2024-09-14T11:36:52.621+0000 7f4882e199c0 20 rados->read ofs=0 len=0 2024-09-14T11:36:52.784 INFO:tasks.workunit.client.0.smithi138.stderr: -144> 2024-09-14T11:36:52.621+0000 7f4882e199c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:36:52.784 INFO:tasks.workunit.client.0.smithi138.stderr: -143> 2024-09-14T11:36:52.621+0000 7f4882e199c0 20 rados->read ofs=0 len=0 2024-09-14T11:36:52.784 INFO:tasks.workunit.client.0.smithi138.stderr: -142> 2024-09-14T11:36:52.621+0000 7f4882e199c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:36:52.784 INFO:tasks.workunit.client.0.smithi138.stderr: -141> 2024-09-14T11:36:52.621+0000 7f4882e199c0 20 zone default found 2024-09-14T11:36:52.784 INFO:tasks.workunit.client.0.smithi138.stderr: -140> 2024-09-14T11:36:52.621+0000 7f4882e199c0 4 Realm: () 2024-09-14T11:36:52.785 INFO:tasks.workunit.client.0.smithi138.stderr: -139> 2024-09-14T11:36:52.621+0000 7f4882e199c0 4 ZoneGroup: default (65ab941b-da8c-4160-94fb-3672b069d44f) 2024-09-14T11:36:52.785 INFO:tasks.workunit.client.0.smithi138.stderr: -138> 2024-09-14T11:36:52.621+0000 7f4882e199c0 4 Zone: default (d9e72d30-c60b-4d0d-9267-fdc36392d5ad) 2024-09-14T11:36:52.785 INFO:tasks.workunit.client.0.smithi138.stderr: -137> 2024-09-14T11:36:52.621+0000 7f4882e199c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:36:52.785 INFO:tasks.workunit.client.0.smithi138.stderr: -136> 2024-09-14T11:36:52.621+0000 7f4882e199c0 20 zonegroup default 2024-09-14T11:36:52.785 INFO:tasks.workunit.client.0.smithi138.stderr: -135> 2024-09-14T11:36:52.621+0000 7f4882e199c0 20 rados->read ofs=0 len=0 2024-09-14T11:36:52.785 INFO:tasks.workunit.client.0.smithi138.stderr: -134> 2024-09-14T11:36:52.625+0000 7f4882e199c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:36:52.785 INFO:tasks.workunit.client.0.smithi138.stderr: -133> 2024-09-14T11:36:52.625+0000 7f4882e199c0 20 rados->read ofs=0 len=0 2024-09-14T11:36:52.785 INFO:tasks.workunit.client.0.smithi138.stderr: -132> 2024-09-14T11:36:52.625+0000 7f4882e199c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:36:52.785 INFO:tasks.workunit.client.0.smithi138.stderr: -131> 2024-09-14T11:36:52.625+0000 7f4882e199c0 20 rados->read ofs=0 len=0 2024-09-14T11:36:52.785 INFO:tasks.workunit.client.0.smithi138.stderr: -130> 2024-09-14T11:36:52.625+0000 7f4882e199c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:36:52.785 INFO:tasks.workunit.client.0.smithi138.stderr: -129> 2024-09-14T11:36:52.625+0000 7f4882e199c0 20 started sync module instance, tier type = 2024-09-14T11:36:52.785 INFO:tasks.workunit.client.0.smithi138.stderr: -128> 2024-09-14T11:36:52.625+0000 7f4882e199c0 20 started zone id=d9e72d30-c60b-4d0d-9267-fdc36392d5ad (name=default) with tier type = 2024-09-14T11:36:52.786 INFO:tasks.workunit.client.0.smithi138.stderr: -127> 2024-09-14T11:36:52.649+0000 7f4882e199c0 20 add_watcher() i=0 2024-09-14T11:36:52.786 INFO:tasks.workunit.client.0.smithi138.stderr: -126> 2024-09-14T11:36:52.649+0000 7f4882e199c0 20 add_watcher() i=1 2024-09-14T11:36:52.786 INFO:tasks.workunit.client.0.smithi138.stderr: -125> 2024-09-14T11:36:52.649+0000 7f4882e199c0 20 add_watcher() i=2 2024-09-14T11:36:52.786 INFO:tasks.workunit.client.0.smithi138.stderr: -124> 2024-09-14T11:36:52.649+0000 7f4882e199c0 20 add_watcher() i=3 2024-09-14T11:36:52.786 INFO:tasks.workunit.client.0.smithi138.stderr: -123> 2024-09-14T11:36:52.649+0000 7f4882e199c0 20 add_watcher() i=4 2024-09-14T11:36:52.786 INFO:tasks.workunit.client.0.smithi138.stderr: -122> 2024-09-14T11:36:52.649+0000 7f4882e199c0 20 add_watcher() i=5 2024-09-14T11:36:52.786 INFO:tasks.workunit.client.0.smithi138.stderr: -121> 2024-09-14T11:36:52.649+0000 7f4882e199c0 20 add_watcher() i=6 2024-09-14T11:36:52.786 INFO:tasks.workunit.client.0.smithi138.stderr: -120> 2024-09-14T11:36:52.653+0000 7f4882e199c0 20 add_watcher() i=7 2024-09-14T11:36:52.786 INFO:tasks.workunit.client.0.smithi138.stderr: -119> 2024-09-14T11:36:52.653+0000 7f4882e199c0 2 all 8 watchers are set, enabling cache 2024-09-14T11:36:52.786 INFO:tasks.workunit.client.0.smithi138.stderr: -118> 2024-09-14T11:36:52.657+0000 7f4882e199c0 5 AuthRegistry(0x7ffc46a26530) adding auth protocol: cephx 2024-09-14T11:36:52.786 INFO:tasks.workunit.client.0.smithi138.stderr: -117> 2024-09-14T11:36:52.657+0000 7f4882e199c0 5 AuthRegistry(0x7ffc46a26530) adding auth protocol: cephx 2024-09-14T11:36:52.786 INFO:tasks.workunit.client.0.smithi138.stderr: -116> 2024-09-14T11:36:52.657+0000 7f4882e199c0 5 AuthRegistry(0x7ffc46a26530) adding auth protocol: cephx 2024-09-14T11:36:52.787 INFO:tasks.workunit.client.0.smithi138.stderr: -115> 2024-09-14T11:36:52.657+0000 7f4882e199c0 5 AuthRegistry(0x7ffc46a26530) adding con mode: secure 2024-09-14T11:36:52.787 INFO:tasks.workunit.client.0.smithi138.stderr: -114> 2024-09-14T11:36:52.657+0000 7f4882e199c0 5 AuthRegistry(0x7ffc46a26530) adding con mode: crc 2024-09-14T11:36:52.787 INFO:tasks.workunit.client.0.smithi138.stderr: -113> 2024-09-14T11:36:52.657+0000 7f4882e199c0 5 AuthRegistry(0x7ffc46a26530) adding con mode: secure 2024-09-14T11:36:52.787 INFO:tasks.workunit.client.0.smithi138.stderr: -112> 2024-09-14T11:36:52.657+0000 7f4882e199c0 5 AuthRegistry(0x7ffc46a26530) adding con mode: crc 2024-09-14T11:36:52.787 INFO:tasks.workunit.client.0.smithi138.stderr: -111> 2024-09-14T11:36:52.657+0000 7f4882e199c0 5 AuthRegistry(0x7ffc46a26530) adding con mode: secure 2024-09-14T11:36:52.787 INFO:tasks.workunit.client.0.smithi138.stderr: -110> 2024-09-14T11:36:52.657+0000 7f4882e199c0 5 AuthRegistry(0x7ffc46a26530) adding con mode: crc 2024-09-14T11:36:52.787 INFO:tasks.workunit.client.0.smithi138.stderr: -109> 2024-09-14T11:36:52.657+0000 7f4882e199c0 5 AuthRegistry(0x7ffc46a26530) adding con mode: crc 2024-09-14T11:36:52.787 INFO:tasks.workunit.client.0.smithi138.stderr: -108> 2024-09-14T11:36:52.657+0000 7f4882e199c0 5 AuthRegistry(0x7ffc46a26530) adding con mode: secure 2024-09-14T11:36:52.787 INFO:tasks.workunit.client.0.smithi138.stderr: -107> 2024-09-14T11:36:52.657+0000 7f47377e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:36:52.787 INFO:tasks.workunit.client.0.smithi138.stderr: -106> 2024-09-14T11:36:52.657+0000 7f4882e199c0 5 AuthRegistry(0x7ffc46a26530) adding con mode: crc 2024-09-14T11:36:52.787 INFO:tasks.workunit.client.0.smithi138.stderr: -105> 2024-09-14T11:36:52.657+0000 7f4882e199c0 5 AuthRegistry(0x7ffc46a26530) adding con mode: secure 2024-09-14T11:36:52.787 INFO:tasks.workunit.client.0.smithi138.stderr: -104> 2024-09-14T11:36:52.657+0000 7f4882e199c0 5 AuthRegistry(0x7ffc46a26530) adding con mode: crc 2024-09-14T11:36:52.787 INFO:tasks.workunit.client.0.smithi138.stderr: -103> 2024-09-14T11:36:52.657+0000 7f4882e199c0 5 AuthRegistry(0x7ffc46a26530) adding con mode: secure 2024-09-14T11:36:52.788 INFO:tasks.workunit.client.0.smithi138.stderr: -102> 2024-09-14T11:36:52.657+0000 7f4882e199c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:36:52.788 INFO:tasks.workunit.client.0.smithi138.stderr: -101> 2024-09-14T11:36:52.657+0000 7f4882e199c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:36:52.788 INFO:tasks.workunit.client.0.smithi138.stderr: -100> 2024-09-14T11:36:52.657+0000 7f4882e199c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:36:52.788 INFO:tasks.workunit.client.0.smithi138.stderr: -99> 2024-09-14T11:36:52.657+0000 7f4882e199c0 5 asok(0x5626d22cbd90) register_command cache list hook 0x5626d259d010 2024-09-14T11:36:52.788 INFO:tasks.workunit.client.0.smithi138.stderr: -98> 2024-09-14T11:36:52.657+0000 7f4882e199c0 5 asok(0x5626d22cbd90) register_command cache inspect hook 0x5626d259d010 2024-09-14T11:36:52.788 INFO:tasks.workunit.client.0.smithi138.stderr: -97> 2024-09-14T11:36:52.657+0000 7f4882e199c0 5 asok(0x5626d22cbd90) register_command cache erase hook 0x5626d259d010 2024-09-14T11:36:52.788 INFO:tasks.workunit.client.0.smithi138.stderr: -96> 2024-09-14T11:36:52.657+0000 7f4882e199c0 5 asok(0x5626d22cbd90) register_command cache zap hook 0x5626d259d010 2024-09-14T11:36:52.788 INFO:tasks.workunit.client.0.smithi138.stderr: -95> 2024-09-14T11:36:52.657+0000 7f4882e199c0 5 note: GC not initialized 2024-09-14T11:36:52.788 INFO:tasks.workunit.client.0.smithi138.stderr: -94> 2024-09-14T11:36:52.657+0000 7f47367e4640 20 reqs_thread_entry: start 2024-09-14T11:36:52.788 INFO:tasks.workunit.client.0.smithi138.stderr: -93> 2024-09-14T11:36:52.657+0000 7f4882e199c0 5 asok(0x5626d22cbd90) register_command sync trace show hook 0x7f4874110070 2024-09-14T11:36:52.788 INFO:tasks.workunit.client.0.smithi138.stderr: -92> 2024-09-14T11:36:52.657+0000 7f4882e199c0 5 asok(0x5626d22cbd90) register_command sync trace history hook 0x7f4874110070 2024-09-14T11:36:52.788 INFO:tasks.workunit.client.0.smithi138.stderr: -91> 2024-09-14T11:36:52.657+0000 7f4882e199c0 5 asok(0x5626d22cbd90) register_command sync trace active hook 0x7f4874110070 2024-09-14T11:36:52.788 INFO:tasks.workunit.client.0.smithi138.stderr: -90> 2024-09-14T11:36:52.657+0000 7f4882e199c0 5 asok(0x5626d22cbd90) register_command sync trace active_short hook 0x7f4874110070 2024-09-14T11:36:52.789 INFO:tasks.workunit.client.0.smithi138.stderr: -89> 2024-09-14T11:36:52.657+0000 7f4882e199c0 20 init_complete bucket index max shards: 11 2024-09-14T11:36:52.789 INFO:tasks.workunit.client.0.smithi138.stderr: -88> 2024-09-14T11:36:52.657+0000 7f4882e199c0 20 Filter name: none 2024-09-14T11:36:52.789 INFO:tasks.workunit.client.0.smithi138.stderr: -87> 2024-09-14T11:36:52.657+0000 7f472f7fe640 20 reqs_thread_entry: start 2024-09-14T11:36:52.789 INFO:tasks.workunit.client.0.smithi138.stderr: -86> 2024-09-14T11:36:52.657+0000 7f4882e199c0 10 cache get: name=default.rgw.meta+root+abort-at-commit-target-layout : miss 2024-09-14T11:36:52.789 INFO:tasks.workunit.client.0.smithi138.stderr: -85> 2024-09-14T11:36:52.657+0000 7f4882e199c0 20 rados->read ofs=0 len=0 2024-09-14T11:36:52.789 INFO:tasks.workunit.client.0.smithi138.stderr: -84> 2024-09-14T11:36:52.657+0000 7f4882e199c0 20 rados_obj.operate() r=0 bl.length=197 2024-09-14T11:36:52.789 INFO:tasks.workunit.client.0.smithi138.stderr: -83> 2024-09-14T11:36:52.657+0000 7f4882e199c0 10 cache put: name=default.rgw.meta+root+abort-at-commit-target-layout info.flags=0x11 2024-09-14T11:36:52.789 INFO:tasks.workunit.client.0.smithi138.stderr: -82> 2024-09-14T11:36:52.657+0000 7f4882e199c0 10 adding default.rgw.meta+root+abort-at-commit-target-layout to cache LRU end 2024-09-14T11:36:52.789 INFO:tasks.workunit.client.0.smithi138.stderr: -81> 2024-09-14T11:36:52.657+0000 7f4882e199c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.32 : miss 2024-09-14T11:36:52.789 INFO:tasks.workunit.client.0.smithi138.stderr: -80> 2024-09-14T11:36:52.657+0000 7f4882e199c0 20 rados->read ofs=0 len=0 2024-09-14T11:36:52.789 INFO:tasks.workunit.client.0.smithi138.stderr: -79> 2024-09-14T11:36:52.661+0000 7f4882e199c0 20 rados_obj.operate() r=0 bl.length=419 2024-09-14T11:36:52.789 INFO:tasks.workunit.client.0.smithi138.stderr: -78> 2024-09-14T11:36:52.661+0000 7f4882e199c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.32 info.flags=0x17 2024-09-14T11:36:52.790 INFO:tasks.workunit.client.0.smithi138.stderr: -77> 2024-09-14T11:36:52.661+0000 7f4882e199c0 10 adding default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.32 to cache LRU end 2024-09-14T11:36:52.790 INFO:tasks.workunit.client.0.smithi138.stderr: -76> 2024-09-14T11:36:52.661+0000 7f4882e199c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:36:52.790 INFO:tasks.workunit.client.0.smithi138.stderr: -75> 2024-09-14T11:36:52.661+0000 7f4882e199c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:36:52.790 INFO:tasks.workunit.client.0.smithi138.stderr: -74> 2024-09-14T11:36:52.661+0000 7f4882e199c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.32 2024-09-14T11:36:52.790 INFO:tasks.workunit.client.0.smithi138.stderr: -73> 2024-09-14T11:36:52.669+0000 7f4882e199c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.32 info.flags=0x17 2024-09-14T11:36:52.790 INFO:tasks.workunit.client.0.smithi138.stderr: -72> 2024-09-14T11:36:52.669+0000 7f4882e199c0 10 moving default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.32 to cache LRU end 2024-09-14T11:36:52.790 INFO:tasks.workunit.client.0.smithi138.stderr: -71> 2024-09-14T11:36:52.669+0000 7f4882e199c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:36:52.790 INFO:tasks.workunit.client.0.smithi138.stderr: -70> 2024-09-14T11:36:52.669+0000 7f4882e199c0 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-commit-target-layout:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.32, ofs0, ns] 2024-09-14T11:36:52.790 INFO:tasks.workunit.client.0.smithi138.stderr: -69> 2024-09-14T11:36:52.673+0000 7f47577fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366205 cookie 94724738090224 notifier 7254 bl.length()=931 2024-09-14T11:36:52.790 INFO:tasks.workunit.client.0.smithi138.stderr: -68> 2024-09-14T11:36:52.673+0000 7f47577fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.32 info.flags=0x17 2024-09-14T11:36:52.790 INFO:tasks.workunit.client.0.smithi138.stderr: -67> 2024-09-14T11:36:52.673+0000 7f47577fe640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.32 to cache LRU end 2024-09-14T11:36:52.790 INFO:tasks.workunit.client.0.smithi138.stderr: -66> 2024-09-14T11:36:52.673+0000 7f47577fe640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:36:52.791 INFO:tasks.workunit.client.0.smithi138.stderr: -65> 2024-09-14T11:36:52.673+0000 7f4882e199c0 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.32]): orig_sources= new_sources= 2024-09-14T11:36:52.791 INFO:tasks.workunit.client.0.smithi138.stderr: -64> 2024-09-14T11:36:52.673+0000 7f4882e199c0 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.32]): potential sources added=[] removed=[] 2024-09-14T11:36:52.791 INFO:tasks.workunit.client.0.smithi138.stderr: -63> 2024-09-14T11:36:52.673+0000 7f4882e199c0 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.32]): orig_dests= new_dests= 2024-09-14T11:36:52.791 INFO:tasks.workunit.client.0.smithi138.stderr: -62> 2024-09-14T11:36:52.673+0000 7f4882e199c0 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.32]): potential dests added=[] removed=[] 2024-09-14T11:36:52.791 INFO:tasks.workunit.client.0.smithi138.stderr: -61> 2024-09-14T11:36:52.681+0000 7f4882e199c0 10 bucket_obj is .dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.32.1.0 2024-09-14T11:36:52.791 INFO:tasks.workunit.client.0.smithi138.stderr: -60> 2024-09-14T11:36:52.681+0000 7f4882e199c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.32.1.0 2024-09-14T11:36:52.791 INFO:tasks.workunit.client.0.smithi138.stderr: -59> 2024-09-14T11:36:52.681+0000 7f4882e199c0 10 bucket_obj is .dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.32.1.1 2024-09-14T11:36:52.791 INFO:tasks.workunit.client.0.smithi138.stderr: -58> 2024-09-14T11:36:52.681+0000 7f4882e199c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.32.1.1 2024-09-14T11:36:52.791 INFO:tasks.workunit.client.0.smithi138.stderr: -57> 2024-09-14T11:36:52.681+0000 7f4882e199c0 10 bucket_obj is .dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.32.1.2 2024-09-14T11:36:52.791 INFO:tasks.workunit.client.0.smithi138.stderr: -56> 2024-09-14T11:36:52.681+0000 7f4882e199c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.32.1.2 2024-09-14T11:36:52.791 INFO:tasks.workunit.client.0.smithi138.stderr: -55> 2024-09-14T11:36:52.681+0000 7f4882e199c0 10 bucket_obj is .dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.32.1.3 2024-09-14T11:36:52.792 INFO:tasks.workunit.client.0.smithi138.stderr: -54> 2024-09-14T11:36:52.681+0000 7f4882e199c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.32.1.3 2024-09-14T11:36:52.792 INFO:tasks.workunit.client.0.smithi138.stderr: -53> 2024-09-14T11:36:52.681+0000 7f4882e199c0 10 bucket_obj is .dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.32.1.4 2024-09-14T11:36:52.792 INFO:tasks.workunit.client.0.smithi138.stderr: -52> 2024-09-14T11:36:52.681+0000 7f4882e199c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.32.1.4 2024-09-14T11:36:52.792 INFO:tasks.workunit.client.0.smithi138.stderr: -51> 2024-09-14T11:36:52.681+0000 7f4882e199c0 10 bucket_obj is .dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.32.1.5 2024-09-14T11:36:52.792 INFO:tasks.workunit.client.0.smithi138.stderr: -50> 2024-09-14T11:36:52.681+0000 7f4882e199c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.32.1.5 2024-09-14T11:36:52.792 INFO:tasks.workunit.client.0.smithi138.stderr: -49> 2024-09-14T11:36:52.681+0000 7f4882e199c0 10 bucket_obj is .dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.32.1.6 2024-09-14T11:36:52.792 INFO:tasks.workunit.client.0.smithi138.stderr: -48> 2024-09-14T11:36:52.681+0000 7f4882e199c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.32.1.6 2024-09-14T11:36:52.792 INFO:tasks.workunit.client.0.smithi138.stderr: -47> 2024-09-14T11:36:52.681+0000 7f4882e199c0 10 bucket_obj is .dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.32.1.7 2024-09-14T11:36:52.792 INFO:tasks.workunit.client.0.smithi138.stderr: -46> 2024-09-14T11:36:52.681+0000 7f4882e199c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.32.1.7 2024-09-14T11:36:52.792 INFO:tasks.workunit.client.0.smithi138.stderr: -45> 2024-09-14T11:36:52.681+0000 7f4882e199c0 10 bucket_obj is .dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.32.1.8 2024-09-14T11:36:52.792 INFO:tasks.workunit.client.0.smithi138.stderr: -44> 2024-09-14T11:36:52.681+0000 7f4882e199c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.32.1.8 2024-09-14T11:36:52.792 INFO:tasks.workunit.client.0.smithi138.stderr: -43> 2024-09-14T11:36:52.681+0000 7f4882e199c0 10 bucket_obj is .dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.32.1.9 2024-09-14T11:36:52.793 INFO:tasks.workunit.client.0.smithi138.stderr: -42> 2024-09-14T11:36:52.681+0000 7f4882e199c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.32.1.9 2024-09-14T11:36:52.793 INFO:tasks.workunit.client.0.smithi138.stderr: -41> 2024-09-14T11:36:52.681+0000 7f4882e199c0 10 bucket_obj is .dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.32.1.10 2024-09-14T11:36:52.793 INFO:tasks.workunit.client.0.smithi138.stderr: -40> 2024-09-14T11:36:52.681+0000 7f4882e199c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.32.1.10 2024-09-14T11:36:52.793 INFO:tasks.workunit.client.0.smithi138.stderr: -39> 2024-09-14T11:36:52.681+0000 7f4882e199c0 10 bucket_obj is .dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.32.1.11 2024-09-14T11:36:52.793 INFO:tasks.workunit.client.0.smithi138.stderr: -38> 2024-09-14T11:36:52.681+0000 7f4882e199c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.32.1.11 2024-09-14T11:36:52.793 INFO:tasks.workunit.client.0.smithi138.stderr: -37> 2024-09-14T11:36:52.681+0000 7f4882e199c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.32.0 2024-09-14T11:36:52.793 INFO:tasks.workunit.client.0.smithi138.stderr: -36> 2024-09-14T11:36:52.685+0000 7f4882e199c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.32.1 2024-09-14T11:36:52.793 INFO:tasks.workunit.client.0.smithi138.stderr: -35> 2024-09-14T11:36:52.685+0000 7f4882e199c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.32.2 2024-09-14T11:36:52.793 INFO:tasks.workunit.client.0.smithi138.stderr: -34> 2024-09-14T11:36:52.685+0000 7f4882e199c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.32.3 2024-09-14T11:36:52.793 INFO:tasks.workunit.client.0.smithi138.stderr: -33> 2024-09-14T11:36:52.685+0000 7f4882e199c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.32.4 2024-09-14T11:36:52.793 INFO:tasks.workunit.client.0.smithi138.stderr: -32> 2024-09-14T11:36:52.689+0000 7f4882e199c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.32.5 2024-09-14T11:36:52.793 INFO:tasks.workunit.client.0.smithi138.stderr: -31> 2024-09-14T11:36:52.689+0000 7f4882e199c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.32.6 2024-09-14T11:36:52.793 INFO:tasks.workunit.client.0.smithi138.stderr: -30> 2024-09-14T11:36:52.689+0000 7f4882e199c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.32.7 2024-09-14T11:36:52.794 INFO:tasks.workunit.client.0.smithi138.stderr: -29> 2024-09-14T11:36:52.689+0000 7f4882e199c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.32.8 2024-09-14T11:36:52.794 INFO:tasks.workunit.client.0.smithi138.stderr: -28> 2024-09-14T11:36:52.689+0000 7f4882e199c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.32.9 2024-09-14T11:36:52.794 INFO:tasks.workunit.client.0.smithi138.stderr: -27> 2024-09-14T11:36:52.689+0000 7f4882e199c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.32.10 2024-09-14T11:36:52.794 INFO:tasks.workunit.client.0.smithi138.stderr: -26> 2024-09-14T11:36:52.701+0000 7f4882e199c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.32 : hit (requested=0x17, cached=0x17) 2024-09-14T11:36:52.794 INFO:tasks.workunit.client.0.smithi138.stderr: -25> 2024-09-14T11:36:52.701+0000 7f4882e199c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.32 2024-09-14T11:36:52.794 INFO:tasks.workunit.client.0.smithi138.stderr: -24> 2024-09-14T11:36:52.701+0000 7f4882e199c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.32 info.flags=0x17 2024-09-14T11:36:52.794 INFO:tasks.workunit.client.0.smithi138.stderr: -23> 2024-09-14T11:36:52.701+0000 7f4882e199c0 10 moving default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.32 to cache LRU end 2024-09-14T11:36:52.794 INFO:tasks.workunit.client.0.smithi138.stderr: -22> 2024-09-14T11:36:52.701+0000 7f4882e199c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:36:52.794 INFO:tasks.workunit.client.0.smithi138.stderr: -21> 2024-09-14T11:36:52.701+0000 7f4882e199c0 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-commit-target-layout:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.32, ofs0, ns] 2024-09-14T11:36:52.794 INFO:tasks.workunit.client.0.smithi138.stderr: -20> 2024-09-14T11:36:52.705+0000 7f4757fff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366206 cookie 94724738090224 notifier 7254 bl.length()=931 2024-09-14T11:36:52.794 INFO:tasks.workunit.client.0.smithi138.stderr: -19> 2024-09-14T11:36:52.705+0000 7f4757fff640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.32 info.flags=0x17 2024-09-14T11:36:52.794 INFO:tasks.workunit.client.0.smithi138.stderr: -18> 2024-09-14T11:36:52.705+0000 7f4757fff640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.32 to cache LRU end 2024-09-14T11:36:52.795 INFO:tasks.workunit.client.0.smithi138.stderr: -17> 2024-09-14T11:36:52.705+0000 7f4757fff640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:36:52.795 INFO:tasks.workunit.client.0.smithi138.stderr: -16> 2024-09-14T11:36:52.705+0000 7f4882e199c0 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.32]): orig_sources= new_sources= 2024-09-14T11:36:52.795 INFO:tasks.workunit.client.0.smithi138.stderr: -15> 2024-09-14T11:36:52.705+0000 7f4882e199c0 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.32]): potential sources added=[] removed=[] 2024-09-14T11:36:52.795 INFO:tasks.workunit.client.0.smithi138.stderr: -14> 2024-09-14T11:36:52.705+0000 7f4882e199c0 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.32]): orig_dests= new_dests= 2024-09-14T11:36:52.795 INFO:tasks.workunit.client.0.smithi138.stderr: -13> 2024-09-14T11:36:52.705+0000 7f4882e199c0 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.32]): potential dests added=[] removed=[] 2024-09-14T11:36:52.795 INFO:tasks.workunit.client.0.smithi138.stderr: -12> 2024-09-14T11:36:52.709+0000 7f4882e199c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.32.0 2024-09-14T11:36:52.795 INFO:tasks.workunit.client.0.smithi138.stderr: -11> 2024-09-14T11:36:52.709+0000 7f4882e199c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.32.1 2024-09-14T11:36:52.795 INFO:tasks.workunit.client.0.smithi138.stderr: -10> 2024-09-14T11:36:52.713+0000 7f4882e199c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.32.2 2024-09-14T11:36:52.795 INFO:tasks.workunit.client.0.smithi138.stderr: -9> 2024-09-14T11:36:52.713+0000 7f4882e199c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.32.3 2024-09-14T11:36:52.795 INFO:tasks.workunit.client.0.smithi138.stderr: -8> 2024-09-14T11:36:52.713+0000 7f4882e199c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.32.4 2024-09-14T11:36:52.795 INFO:tasks.workunit.client.0.smithi138.stderr: -7> 2024-09-14T11:36:52.713+0000 7f4882e199c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.32.5 2024-09-14T11:36:52.795 INFO:tasks.workunit.client.0.smithi138.stderr: -6> 2024-09-14T11:36:52.713+0000 7f4882e199c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.32.6 2024-09-14T11:36:52.796 INFO:tasks.workunit.client.0.smithi138.stderr: -5> 2024-09-14T11:36:52.713+0000 7f4882e199c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.32.7 2024-09-14T11:36:52.796 INFO:tasks.workunit.client.0.smithi138.stderr: -4> 2024-09-14T11:36:52.713+0000 7f4882e199c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.32.8 2024-09-14T11:36:52.796 INFO:tasks.workunit.client.0.smithi138.stderr: -3> 2024-09-14T11:36:52.717+0000 7f4882e199c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.32.9 2024-09-14T11:36:52.796 INFO:tasks.workunit.client.0.smithi138.stderr: -2> 2024-09-14T11:36:52.717+0000 7f4882e199c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.32.10 2024-09-14T11:36:52.796 INFO:tasks.workunit.client.0.smithi138.stderr: -1> 2024-09-14T11:36:52.717+0000 7f4882e199c0 -1 ./src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f4882e199c0 time 2024-09-14T11:36:52.722713+0000 2024-09-14T11:36:52.796 INFO:tasks.workunit.client.0.smithi138.stderr:./src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-14T11:36:52.796 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-14T11:36:52.796 INFO:tasks.workunit.client.0.smithi138.stderr: ceph version 19.3.0-4907-ga2782315 (a2782315255a3e7d5f6cdc9eb35785187ff6ddf8) squid (dev) 2024-09-14T11:36:52.796 INFO:tasks.workunit.client.0.smithi138.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x121) [0x7f48866f32eb] 2024-09-14T11:36:52.796 INFO:tasks.workunit.client.0.smithi138.stderr: 2: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7f48866f349f] 2024-09-14T11:36:52.796 INFO:tasks.workunit.client.0.smithi138.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x5626d0323c01] 2024-09-14T11:36:52.796 INFO:tasks.workunit.client.0.smithi138.stderr: 4: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x3e7) [0x5626d03391a7] 2024-09-14T11:36:52.797 INFO:tasks.workunit.client.0.smithi138.stderr: 5: main() 2024-09-14T11:36:52.797 INFO:tasks.workunit.client.0.smithi138.stderr: 6: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7f4885559d90] 2024-09-14T11:36:52.797 INFO:tasks.workunit.client.0.smithi138.stderr: 7: __libc_start_main() 2024-09-14T11:36:52.797 INFO:tasks.workunit.client.0.smithi138.stderr: 8: _start() 2024-09-14T11:36:52.797 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-14T11:36:52.797 INFO:tasks.workunit.client.0.smithi138.stderr: 0> 2024-09-14T11:36:52.721+0000 7f4882e199c0 -1 *** Caught signal (Aborted) ** 2024-09-14T11:36:52.797 INFO:tasks.workunit.client.0.smithi138.stderr: in thread 7f4882e199c0 thread_name:radosgw-admin 2024-09-14T11:36:52.797 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-14T11:36:52.797 INFO:tasks.workunit.client.0.smithi138.stderr: ceph version 19.3.0-4907-ga2782315 (a2782315255a3e7d5f6cdc9eb35785187ff6ddf8) squid (dev) 2024-09-14T11:36:52.797 INFO:tasks.workunit.client.0.smithi138.stderr: 1: /lib/x86_64-linux-gnu/libc.so.6(+0x42520) [0x7f4885572520] 2024-09-14T11:36:52.797 INFO:tasks.workunit.client.0.smithi138.stderr: 2: pthread_kill() 2024-09-14T11:36:52.797 INFO:tasks.workunit.client.0.smithi138.stderr: 3: raise() 2024-09-14T11:36:52.798 INFO:tasks.workunit.client.0.smithi138.stderr: 4: abort() 2024-09-14T11:36:52.798 INFO:tasks.workunit.client.0.smithi138.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x17b) [0x7f48866f3345] 2024-09-14T11:36:52.798 INFO:tasks.workunit.client.0.smithi138.stderr: 6: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7f48866f349f] 2024-09-14T11:36:52.798 INFO:tasks.workunit.client.0.smithi138.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x5626d0323c01] 2024-09-14T11:36:52.798 INFO:tasks.workunit.client.0.smithi138.stderr: 8: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x3e7) [0x5626d03391a7] 2024-09-14T11:36:52.798 INFO:tasks.workunit.client.0.smithi138.stderr: 9: main() 2024-09-14T11:36:52.798 INFO:tasks.workunit.client.0.smithi138.stderr: 10: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7f4885559d90] 2024-09-14T11:36:52.798 INFO:tasks.workunit.client.0.smithi138.stderr: 11: __libc_start_main() 2024-09-14T11:36:52.798 INFO:tasks.workunit.client.0.smithi138.stderr: 12: _start() 2024-09-14T11:36:52.798 INFO:tasks.workunit.client.0.smithi138.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-14T11:36:52.798 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-14T11:36:52.798 INFO:tasks.workunit.client.0.smithi138.stderr:--- logging levels --- 2024-09-14T11:36:52.799 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 none 2024-09-14T11:36:52.799 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 1 lockdep 2024-09-14T11:36:52.799 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 1 context 2024-09-14T11:36:52.799 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 1 crush 2024-09-14T11:36:52.799 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 mds 2024-09-14T11:36:52.799 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 mds_balancer 2024-09-14T11:36:52.799 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 mds_locker 2024-09-14T11:36:52.799 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 mds_log 2024-09-14T11:36:52.799 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 mds_log_expire 2024-09-14T11:36:52.799 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 mds_migrator 2024-09-14T11:36:52.799 INFO:tasks.workunit.client.0.smithi138.stderr: 3/ 5 mds_quiesce 2024-09-14T11:36:52.799 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 1 buffer 2024-09-14T11:36:52.800 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 1 timer 2024-09-14T11:36:52.800 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 1 filer 2024-09-14T11:36:52.800 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 1 striper 2024-09-14T11:36:52.800 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 1 objecter 2024-09-14T11:36:52.800 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 rados 2024-09-14T11:36:52.800 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 rbd 2024-09-14T11:36:52.800 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 rbd_mirror 2024-09-14T11:36:52.800 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 rbd_replay 2024-09-14T11:36:52.800 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 rbd_pwl 2024-09-14T11:36:52.800 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 journaler 2024-09-14T11:36:52.800 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 objectcacher 2024-09-14T11:36:52.800 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 immutable_obj_cache 2024-09-14T11:36:52.800 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 client 2024-09-14T11:36:52.801 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 osd 2024-09-14T11:36:52.801 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 optracker 2024-09-14T11:36:52.801 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 objclass 2024-09-14T11:36:52.801 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 3 filestore 2024-09-14T11:36:52.801 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 3 journal 2024-09-14T11:36:52.801 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 0 ms 2024-09-14T11:36:52.801 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 mon 2024-09-14T11:36:52.801 INFO:tasks.workunit.client.0.smithi138.stderr: 0/10 monc 2024-09-14T11:36:52.801 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 paxos 2024-09-14T11:36:52.801 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 tp 2024-09-14T11:36:52.801 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 auth 2024-09-14T11:36:52.801 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 crypto 2024-09-14T11:36:52.802 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 1 finisher 2024-09-14T11:36:52.802 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 1 reserver 2024-09-14T11:36:52.802 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 heartbeatmap 2024-09-14T11:36:52.802 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 perfcounter 2024-09-14T11:36:52.802 INFO:tasks.workunit.client.0.smithi138.stderr: 20/20 rgw 2024-09-14T11:36:52.802 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 rgw_sync 2024-09-14T11:36:52.802 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 rgw_datacache 2024-09-14T11:36:52.802 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 rgw_access 2024-09-14T11:36:52.802 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 rgw_dbstore 2024-09-14T11:36:52.802 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 rgw_flight 2024-09-14T11:36:52.802 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 rgw_lifecycle 2024-09-14T11:36:52.802 INFO:tasks.workunit.client.0.smithi138.stderr: 20/20 rgw_notification 2024-09-14T11:36:52.802 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 javaclient 2024-09-14T11:36:52.802 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 asok 2024-09-14T11:36:52.803 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 1 throttle 2024-09-14T11:36:52.803 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 0 refs 2024-09-14T11:36:52.803 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 compressor 2024-09-14T11:36:52.803 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 bluestore 2024-09-14T11:36:52.803 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 bluefs 2024-09-14T11:36:52.803 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 3 bdev 2024-09-14T11:36:52.803 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 kstore 2024-09-14T11:36:52.803 INFO:tasks.workunit.client.0.smithi138.stderr: 4/ 5 rocksdb 2024-09-14T11:36:52.803 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 fuse 2024-09-14T11:36:52.803 INFO:tasks.workunit.client.0.smithi138.stderr: 2/ 5 mgr 2024-09-14T11:36:52.803 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 mgrc 2024-09-14T11:36:52.803 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 dpdk 2024-09-14T11:36:52.803 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 eventtrace 2024-09-14T11:36:52.804 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 prioritycache 2024-09-14T11:36:52.804 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 test 2024-09-14T11:36:52.804 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 cephfs_mirror 2024-09-14T11:36:52.804 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 cephsqlite 2024-09-14T11:36:52.804 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 crimson_interrupt 2024-09-14T11:36:52.804 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 seastore 2024-09-14T11:36:52.804 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 seastore_onode 2024-09-14T11:36:52.804 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 seastore_odata 2024-09-14T11:36:52.804 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 seastore_omap 2024-09-14T11:36:52.804 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 seastore_tm 2024-09-14T11:36:52.804 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 seastore_t 2024-09-14T11:36:52.804 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 seastore_cleaner 2024-09-14T11:36:52.804 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 seastore_epm 2024-09-14T11:36:52.805 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 seastore_lba 2024-09-14T11:36:52.805 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 seastore_fixedkv_tree 2024-09-14T11:36:52.805 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 seastore_cache 2024-09-14T11:36:52.805 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 seastore_journal 2024-09-14T11:36:52.805 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 seastore_device 2024-09-14T11:36:52.805 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 seastore_backref 2024-09-14T11:36:52.805 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 alienstore 2024-09-14T11:36:52.805 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 mclock 2024-09-14T11:36:52.805 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 cyanstore 2024-09-14T11:36:52.805 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 ceph_exporter 2024-09-14T11:36:52.805 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 memstore 2024-09-14T11:36:52.805 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 trace 2024-09-14T11:36:52.805 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 ceph_dedup 2024-09-14T11:36:52.806 INFO:tasks.workunit.client.0.smithi138.stderr: -2/-2 (syslog threshold) 2024-09-14T11:36:52.806 INFO:tasks.workunit.client.0.smithi138.stderr: 99/99 (stderr threshold) 2024-09-14T11:36:52.806 INFO:tasks.workunit.client.0.smithi138.stderr:--- pthread ID / name mapping for recent threads --- 2024-09-14T11:36:52.806 INFO:tasks.workunit.client.0.smithi138.stderr: 7f472f7fe640 / http_manager 2024-09-14T11:36:52.806 INFO:tasks.workunit.client.0.smithi138.stderr: 7f47367e4640 / http_manager 2024-09-14T11:36:52.806 INFO:tasks.workunit.client.0.smithi138.stderr: 7f47377e6640 / rgw_dt_lg_renew 2024-09-14T11:36:52.806 INFO:tasks.workunit.client.0.smithi138.stderr: 7f47567fc640 / ms_dispatch 2024-09-14T11:36:52.806 INFO:tasks.workunit.client.0.smithi138.stderr: 7f47577fe640 / io_context_pool 2024-09-14T11:36:52.806 INFO:tasks.workunit.client.0.smithi138.stderr: 7f4757fff640 / io_context_pool 2024-09-14T11:36:52.806 INFO:tasks.workunit.client.0.smithi138.stderr: 7f47667fc640 / ms_dispatch 2024-09-14T11:36:52.806 INFO:tasks.workunit.client.0.smithi138.stderr: 7f476d602640 / ms_dispatch 2024-09-14T11:36:52.806 INFO:tasks.workunit.client.0.smithi138.stderr: 7f476ee05640 / io_context_pool 2024-09-14T11:36:52.807 INFO:tasks.workunit.client.0.smithi138.stderr: 7f487b7fe640 / io_context_pool 2024-09-14T11:36:52.807 INFO:tasks.workunit.client.0.smithi138.stderr: 7f487bfff640 / msgr-worker-2 2024-09-14T11:36:52.807 INFO:tasks.workunit.client.0.smithi138.stderr: 7f488091f640 / msgr-worker-1 2024-09-14T11:36:52.807 INFO:tasks.workunit.client.0.smithi138.stderr: 7f4881120640 / msgr-worker-0 2024-09-14T11:36:52.807 INFO:tasks.workunit.client.0.smithi138.stderr: 7f4882e199c0 / radosgw-admin 2024-09-14T11:36:52.807 INFO:tasks.workunit.client.0.smithi138.stderr: max_recent 500 2024-09-14T11:36:52.807 INFO:tasks.workunit.client.0.smithi138.stderr: max_new 1000 2024-09-14T11:36:52.807 INFO:tasks.workunit.client.0.smithi138.stderr: log_file /var/log/ceph/ceph-client.admin.113243.log 2024-09-14T11:36:52.807 INFO:tasks.workunit.client.0.smithi138.stderr:--- end dump of recent events --- 2024-09-14T11:36:52.807 INFO:tasks.workunit.client.0.smithi138.stderr:--- begin dump of recent events --- 2024-09-14T11:36:52.807 INFO:tasks.workunit.client.0.smithi138.stderr: -499> 2024-09-14T11:36:52.369+0000 7f4882e199c0 5 AuthRegistry(0x5626d24d94b0) adding con mode: crc 2024-09-14T11:36:52.807 INFO:tasks.workunit.client.0.smithi138.stderr: -498> 2024-09-14T11:36:52.369+0000 7f4882e199c0 5 AuthRegistry(0x5626d24d94b0) adding con mode: secure 2024-09-14T11:36:52.808 INFO:tasks.workunit.client.0.smithi138.stderr: -497> 2024-09-14T11:36:52.369+0000 7f4882e199c0 5 AuthRegistry(0x5626d24d94b0) adding con mode: crc 2024-09-14T11:36:52.808 INFO:tasks.workunit.client.0.smithi138.stderr: -496> 2024-09-14T11:36:52.369+0000 7f4882e199c0 5 AuthRegistry(0x5626d24d94b0) adding con mode: secure 2024-09-14T11:36:52.808 INFO:tasks.workunit.client.0.smithi138.stderr: -495> 2024-09-14T11:36:52.369+0000 7f4882e199c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:36:52.808 INFO:tasks.workunit.client.0.smithi138.stderr: -494> 2024-09-14T11:36:52.369+0000 7f4882e199c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:36:52.808 INFO:tasks.workunit.client.0.smithi138.stderr: -493> 2024-09-14T11:36:52.369+0000 7f4882e199c0 5 asok(0x5626d22cbd90) register_command rotate-key hook 0x5626d24d95f8 2024-09-14T11:36:52.808 INFO:tasks.workunit.client.0.smithi138.stderr: -492> 2024-09-14T11:36:52.369+0000 7f4882e199c0 10 monclient: _reopen_session rank -1 2024-09-14T11:36:52.808 INFO:tasks.workunit.client.0.smithi138.stderr: -491> 2024-09-14T11:36:52.369+0000 7f4882e199c0 10 monclient: _add_conns ranks=[0,1,2] 2024-09-14T11:36:52.808 INFO:tasks.workunit.client.0.smithi138.stderr: -490> 2024-09-14T11:36:52.369+0000 7f4882e199c0 10 monclient(hunting): picked mon.noname-a con 0x5626d23895b0 addr [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] 2024-09-14T11:36:52.808 INFO:tasks.workunit.client.0.smithi138.stderr: -489> 2024-09-14T11:36:52.369+0000 7f4882e199c0 10 monclient(hunting): picked mon.noname-b con 0x5626d2394880 addr [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] 2024-09-14T11:36:52.808 INFO:tasks.workunit.client.0.smithi138.stderr: -488> 2024-09-14T11:36:52.369+0000 7f4882e199c0 10 monclient(hunting): picked mon.noname-c con 0x5626d23956e0 addr [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] 2024-09-14T11:36:52.808 INFO:tasks.workunit.client.0.smithi138.stderr: -487> 2024-09-14T11:36:52.369+0000 7f4882e199c0 10 monclient(hunting): start opening mon connection 2024-09-14T11:36:52.808 INFO:tasks.workunit.client.0.smithi138.stderr: -486> 2024-09-14T11:36:52.369+0000 7f4882e199c0 10 monclient(hunting): start opening mon connection 2024-09-14T11:36:52.809 INFO:tasks.workunit.client.0.smithi138.stderr: -485> 2024-09-14T11:36:52.369+0000 7f4882e199c0 10 monclient(hunting): start opening mon connection 2024-09-14T11:36:52.809 INFO:tasks.workunit.client.0.smithi138.stderr: -484> 2024-09-14T11:36:52.369+0000 7f4882e199c0 10 monclient(hunting): _renew_subs 2024-09-14T11:36:52.809 INFO:tasks.workunit.client.0.smithi138.stderr: -483> 2024-09-14T11:36:52.369+0000 7f4882e199c0 10 monclient(hunting): authenticate will time out at 2748.335226s 2024-09-14T11:36:52.809 INFO:tasks.workunit.client.0.smithi138.stderr: -482> 2024-09-14T11:36:52.369+0000 7f488091f640 10 monclient(hunting): get_auth_request con 0x5626d23895b0 auth_method 0 2024-09-14T11:36:52.809 INFO:tasks.workunit.client.0.smithi138.stderr: -481> 2024-09-14T11:36:52.369+0000 7f488091f640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:36:52.809 INFO:tasks.workunit.client.0.smithi138.stderr: -480> 2024-09-14T11:36:52.369+0000 7f488091f640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:36:52.809 INFO:tasks.workunit.client.0.smithi138.stderr: -479> 2024-09-14T11:36:52.369+0000 7f488091f640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:36:52.809 INFO:tasks.workunit.client.0.smithi138.stderr: -478> 2024-09-14T11:36:52.369+0000 7f4881120640 10 monclient(hunting): get_auth_request con 0x5626d23956e0 auth_method 0 2024-09-14T11:36:52.809 INFO:tasks.workunit.client.0.smithi138.stderr: -477> 2024-09-14T11:36:52.369+0000 7f4881120640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:36:52.809 INFO:tasks.workunit.client.0.smithi138.stderr: -476> 2024-09-14T11:36:52.369+0000 7f4881120640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:36:52.809 INFO:tasks.workunit.client.0.smithi138.stderr: -475> 2024-09-14T11:36:52.369+0000 7f4881120640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:36:52.809 INFO:tasks.workunit.client.0.smithi138.stderr: -474> 2024-09-14T11:36:52.369+0000 7f488091f640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:36:52.810 INFO:tasks.workunit.client.0.smithi138.stderr: -473> 2024-09-14T11:36:52.369+0000 7f488091f640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:36:52.810 INFO:tasks.workunit.client.0.smithi138.stderr: -472> 2024-09-14T11:36:52.369+0000 7f488091f640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:36:52.810 INFO:tasks.workunit.client.0.smithi138.stderr: -471> 2024-09-14T11:36:52.369+0000 7f4881120640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:36:52.810 INFO:tasks.workunit.client.0.smithi138.stderr: -470> 2024-09-14T11:36:52.369+0000 7f4881120640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:36:52.810 INFO:tasks.workunit.client.0.smithi138.stderr: -469> 2024-09-14T11:36:52.369+0000 7f4881120640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:36:52.810 INFO:tasks.workunit.client.0.smithi138.stderr: -468> 2024-09-14T11:36:52.369+0000 7f488091f640 10 monclient(hunting): handle_auth_done global_id 7245 payload 824 2024-09-14T11:36:52.810 INFO:tasks.workunit.client.0.smithi138.stderr: -467> 2024-09-14T11:36:52.369+0000 7f488091f640 10 monclient: _finish_hunting 0 2024-09-14T11:36:52.810 INFO:tasks.workunit.client.0.smithi138.stderr: -466> 2024-09-14T11:36:52.369+0000 7f488091f640 1 monclient: found mon.noname-a 2024-09-14T11:36:52.810 INFO:tasks.workunit.client.0.smithi138.stderr: -465> 2024-09-14T11:36:52.369+0000 7f488091f640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.138:3300/0 2024-09-14T11:36:52.810 INFO:tasks.workunit.client.0.smithi138.stderr: -464> 2024-09-14T11:36:52.369+0000 7f476d602640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:36:52.810 INFO:tasks.workunit.client.0.smithi138.stderr: -463> 2024-09-14T11:36:52.369+0000 7f476d602640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-14T11:36:52.810 INFO:tasks.workunit.client.0.smithi138.stderr: -462> 2024-09-14T11:36:52.369+0000 7f476d602640 10 monclient: dump: 2024-09-14T11:36:52.811 INFO:tasks.workunit.client.0.smithi138.stderr:epoch 1 2024-09-14T11:36:52.811 INFO:tasks.workunit.client.0.smithi138.stderr:fsid 3f225f43-83a6-4aeb-b798-1f04bb49d597 2024-09-14T11:36:52.811 INFO:tasks.workunit.client.0.smithi138.stderr:last_changed 2024-09-14T11:07:09.252780+0000 2024-09-14T11:36:52.811 INFO:tasks.workunit.client.0.smithi138.stderr:created 2024-09-14T11:07:09.252780+0000 2024-09-14T11:36:52.811 INFO:tasks.workunit.client.0.smithi138.stderr:min_mon_release 19 (squid) 2024-09-14T11:36:52.811 INFO:tasks.workunit.client.0.smithi138.stderr:election_strategy: 1 2024-09-14T11:36:52.811 INFO:tasks.workunit.client.0.smithi138.stderr:0: [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] mon.a 2024-09-14T11:36:52.811 INFO:tasks.workunit.client.0.smithi138.stderr:1: [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] mon.b 2024-09-14T11:36:52.811 INFO:tasks.workunit.client.0.smithi138.stderr:2: [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] mon.c 2024-09-14T11:36:52.811 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-14T11:36:52.811 INFO:tasks.workunit.client.0.smithi138.stderr: -461> 2024-09-14T11:36:52.369+0000 7f476d602640 10 monclient: _finish_auth 0 2024-09-14T11:36:52.811 INFO:tasks.workunit.client.0.smithi138.stderr: -460> 2024-09-14T11:36:52.369+0000 7f476d602640 10 monclient: _check_auth_tickets 2024-09-14T11:36:52.811 INFO:tasks.workunit.client.0.smithi138.stderr: -459> 2024-09-14T11:36:52.373+0000 7f476d602640 10 monclient: handle_config config(0 keys) 2024-09-14T11:36:52.812 INFO:tasks.workunit.client.0.smithi138.stderr: -458> 2024-09-14T11:36:52.373+0000 7f476d602640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:36:52.812 INFO:tasks.workunit.client.0.smithi138.stderr: -457> 2024-09-14T11:36:52.373+0000 7f476d602640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-14T11:36:52.812 INFO:tasks.workunit.client.0.smithi138.stderr: -456> 2024-09-14T11:36:52.373+0000 7f476d602640 10 monclient: dump: 2024-09-14T11:36:52.812 INFO:tasks.workunit.client.0.smithi138.stderr:epoch 1 2024-09-14T11:36:52.812 INFO:tasks.workunit.client.0.smithi138.stderr:fsid 3f225f43-83a6-4aeb-b798-1f04bb49d597 2024-09-14T11:36:52.812 INFO:tasks.workunit.client.0.smithi138.stderr:last_changed 2024-09-14T11:07:09.252780+0000 2024-09-14T11:36:52.812 INFO:tasks.workunit.client.0.smithi138.stderr:created 2024-09-14T11:07:09.252780+0000 2024-09-14T11:36:52.812 INFO:tasks.workunit.client.0.smithi138.stderr:min_mon_release 19 (squid) 2024-09-14T11:36:52.812 INFO:tasks.workunit.client.0.smithi138.stderr:election_strategy: 1 2024-09-14T11:36:52.812 INFO:tasks.workunit.client.0.smithi138.stderr:0: [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] mon.a 2024-09-14T11:36:52.812 INFO:tasks.workunit.client.0.smithi138.stderr:1: [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] mon.b 2024-09-14T11:36:52.812 INFO:tasks.workunit.client.0.smithi138.stderr:2: [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] mon.c 2024-09-14T11:36:52.812 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-14T11:36:52.813 INFO:tasks.workunit.client.0.smithi138.stderr: -455> 2024-09-14T11:36:52.373+0000 7f4882e199c0 5 monclient: authenticate success, global_id 7245 2024-09-14T11:36:52.813 INFO:tasks.workunit.client.0.smithi138.stderr: -454> 2024-09-14T11:36:52.373+0000 7f476ee05640 4 set_mon_vals no callback set 2024-09-14T11:36:52.813 INFO:tasks.workunit.client.0.smithi138.stderr: -453> 2024-09-14T11:36:52.373+0000 7f4882e199c0 10 monclient: _renew_subs 2024-09-14T11:36:52.813 INFO:tasks.workunit.client.0.smithi138.stderr: -452> 2024-09-14T11:36:52.373+0000 7f4882e199c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.138:3300/0 2024-09-14T11:36:52.813 INFO:tasks.workunit.client.0.smithi138.stderr: -451> 2024-09-14T11:36:52.373+0000 7f4882e199c0 10 monclient: _renew_subs 2024-09-14T11:36:52.813 INFO:tasks.workunit.client.0.smithi138.stderr: -450> 2024-09-14T11:36:52.373+0000 7f4882e199c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.138:3300/0 2024-09-14T11:36:52.813 INFO:tasks.workunit.client.0.smithi138.stderr: -449> 2024-09-14T11:36:52.373+0000 7f4882e199c0 1 librados: init done 2024-09-14T11:36:52.813 INFO:tasks.workunit.client.0.smithi138.stderr: -448> 2024-09-14T11:36:52.373+0000 7f476d602640 4 mgrc handle_mgr_map Got map version 5 2024-09-14T11:36:52.813 INFO:tasks.workunit.client.0.smithi138.stderr: -447> 2024-09-14T11:36:52.373+0000 7f476d602640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.138:6832/3778043143,v1:172.21.15.138:6833/3778043143] 2024-09-14T11:36:52.813 INFO:tasks.workunit.client.0.smithi138.stderr: -446> 2024-09-14T11:36:52.373+0000 7f476d602640 4 mgrc reconnect Starting new session with [v2:172.21.15.138:6832/3778043143,v1:172.21.15.138:6833/3778043143] 2024-09-14T11:36:52.813 INFO:tasks.workunit.client.0.smithi138.stderr: -445> 2024-09-14T11:36:52.373+0000 7f487bfff640 10 monclient: get_auth_request con 0x7f4768071a40 auth_method 0 2024-09-14T11:36:52.813 INFO:tasks.workunit.client.0.smithi138.stderr: -444> 2024-09-14T11:36:52.373+0000 7f4881120640 10 monclient: get_auth_request con 0x5626d2500fe0 auth_method 0 2024-09-14T11:36:52.814 INFO:tasks.workunit.client.0.smithi138.stderr: -443> 2024-09-14T11:36:52.373+0000 7f488091f640 10 monclient: get_auth_request con 0x5626d2523ee0 auth_method 0 2024-09-14T11:36:52.814 INFO:tasks.workunit.client.0.smithi138.stderr: -442> 2024-09-14T11:36:52.377+0000 7f487bfff640 10 monclient: get_auth_request con 0x5626d25280d0 auth_method 0 2024-09-14T11:36:52.814 INFO:tasks.workunit.client.0.smithi138.stderr: -441> 2024-09-14T11:36:52.377+0000 7f4881120640 10 monclient: get_auth_request con 0x5626d2527760 auth_method 0 2024-09-14T11:36:52.814 INFO:tasks.workunit.client.0.smithi138.stderr: -440> 2024-09-14T11:36:52.381+0000 7f4882e199c0 10 monclient: build_initial_monmap 2024-09-14T11:36:52.814 INFO:tasks.workunit.client.0.smithi138.stderr: -439> 2024-09-14T11:36:52.381+0000 7f4882e199c0 1 build_initial for_mkfs: 0 2024-09-14T11:36:52.814 INFO:tasks.workunit.client.0.smithi138.stderr: -438> 2024-09-14T11:36:52.381+0000 7f4882e199c0 10 monclient: monmap: 2024-09-14T11:36:52.814 INFO:tasks.workunit.client.0.smithi138.stderr:epoch 0 2024-09-14T11:36:52.814 INFO:tasks.workunit.client.0.smithi138.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-14T11:36:52.814 INFO:tasks.workunit.client.0.smithi138.stderr:last_changed 0.000000 2024-09-14T11:36:52.814 INFO:tasks.workunit.client.0.smithi138.stderr:created 0.000000 2024-09-14T11:36:52.814 INFO:tasks.workunit.client.0.smithi138.stderr:min_mon_release 0 (unknown) 2024-09-14T11:36:52.814 INFO:tasks.workunit.client.0.smithi138.stderr:election_strategy: 1 2024-09-14T11:36:52.815 INFO:tasks.workunit.client.0.smithi138.stderr:0: [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] mon.noname-a 2024-09-14T11:36:52.815 INFO:tasks.workunit.client.0.smithi138.stderr:1: [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] mon.noname-b 2024-09-14T11:36:52.815 INFO:tasks.workunit.client.0.smithi138.stderr:2: [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] mon.noname-c 2024-09-14T11:36:52.815 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-14T11:36:52.815 INFO:tasks.workunit.client.0.smithi138.stderr: -437> 2024-09-14T11:36:52.381+0000 7f4882e199c0 5 AuthRegistry(0x5626d252ff90) adding auth protocol: cephx 2024-09-14T11:36:52.815 INFO:tasks.workunit.client.0.smithi138.stderr: -436> 2024-09-14T11:36:52.381+0000 7f4882e199c0 5 AuthRegistry(0x5626d252ff90) adding auth protocol: cephx 2024-09-14T11:36:52.815 INFO:tasks.workunit.client.0.smithi138.stderr: -435> 2024-09-14T11:36:52.381+0000 7f4882e199c0 5 AuthRegistry(0x5626d252ff90) adding auth protocol: cephx 2024-09-14T11:36:52.815 INFO:tasks.workunit.client.0.smithi138.stderr: -434> 2024-09-14T11:36:52.381+0000 7f4882e199c0 5 AuthRegistry(0x5626d252ff90) adding con mode: secure 2024-09-14T11:36:52.815 INFO:tasks.workunit.client.0.smithi138.stderr: -433> 2024-09-14T11:36:52.381+0000 7f4882e199c0 5 AuthRegistry(0x5626d252ff90) adding con mode: crc 2024-09-14T11:36:52.815 INFO:tasks.workunit.client.0.smithi138.stderr: -432> 2024-09-14T11:36:52.381+0000 7f4882e199c0 5 AuthRegistry(0x5626d252ff90) adding con mode: secure 2024-09-14T11:36:52.815 INFO:tasks.workunit.client.0.smithi138.stderr: -431> 2024-09-14T11:36:52.381+0000 7f4882e199c0 5 AuthRegistry(0x5626d252ff90) adding con mode: crc 2024-09-14T11:36:52.815 INFO:tasks.workunit.client.0.smithi138.stderr: -430> 2024-09-14T11:36:52.381+0000 7f4882e199c0 5 AuthRegistry(0x5626d252ff90) adding con mode: secure 2024-09-14T11:36:52.816 INFO:tasks.workunit.client.0.smithi138.stderr: -429> 2024-09-14T11:36:52.381+0000 7f4882e199c0 5 AuthRegistry(0x5626d252ff90) adding con mode: crc 2024-09-14T11:36:52.816 INFO:tasks.workunit.client.0.smithi138.stderr: -428> 2024-09-14T11:36:52.381+0000 7f4882e199c0 5 AuthRegistry(0x5626d252ff90) adding con mode: crc 2024-09-14T11:36:52.816 INFO:tasks.workunit.client.0.smithi138.stderr: -427> 2024-09-14T11:36:52.381+0000 7f4882e199c0 5 AuthRegistry(0x5626d252ff90) adding con mode: secure 2024-09-14T11:36:52.816 INFO:tasks.workunit.client.0.smithi138.stderr: -426> 2024-09-14T11:36:52.381+0000 7f4882e199c0 5 AuthRegistry(0x5626d252ff90) adding con mode: crc 2024-09-14T11:36:52.816 INFO:tasks.workunit.client.0.smithi138.stderr: -425> 2024-09-14T11:36:52.381+0000 7f4882e199c0 5 AuthRegistry(0x5626d252ff90) adding con mode: secure 2024-09-14T11:36:52.816 INFO:tasks.workunit.client.0.smithi138.stderr: -424> 2024-09-14T11:36:52.381+0000 7f4882e199c0 5 AuthRegistry(0x5626d252ff90) adding con mode: crc 2024-09-14T11:36:52.816 INFO:tasks.workunit.client.0.smithi138.stderr: -423> 2024-09-14T11:36:52.381+0000 7f4882e199c0 5 AuthRegistry(0x5626d252ff90) adding con mode: secure 2024-09-14T11:36:52.816 INFO:tasks.workunit.client.0.smithi138.stderr: -422> 2024-09-14T11:36:52.381+0000 7f4882e199c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:36:52.816 INFO:tasks.workunit.client.0.smithi138.stderr: -421> 2024-09-14T11:36:52.381+0000 7f4882e199c0 5 asok(0x5626d22cbd90) register_command objecter_requests cmddesc objecter_requests hook 0x5626d2533980 EEXIST 2024-09-14T11:36:52.816 INFO:tasks.workunit.client.0.smithi138.stderr: -420> 2024-09-14T11:36:52.381+0000 7f4882e199c0 10 monclient: init 2024-09-14T11:36:52.816 INFO:tasks.workunit.client.0.smithi138.stderr: -419> 2024-09-14T11:36:52.381+0000 7f4882e199c0 5 AuthRegistry(0x5626d252ee88) adding auth protocol: cephx 2024-09-14T11:36:52.816 INFO:tasks.workunit.client.0.smithi138.stderr: -418> 2024-09-14T11:36:52.381+0000 7f4882e199c0 5 AuthRegistry(0x5626d252ee88) adding auth protocol: cephx 2024-09-14T11:36:52.817 INFO:tasks.workunit.client.0.smithi138.stderr: -417> 2024-09-14T11:36:52.381+0000 7f4882e199c0 5 AuthRegistry(0x5626d252ee88) adding auth protocol: cephx 2024-09-14T11:36:52.817 INFO:tasks.workunit.client.0.smithi138.stderr: -416> 2024-09-14T11:36:52.381+0000 7f4882e199c0 5 AuthRegistry(0x5626d252ee88) adding con mode: secure 2024-09-14T11:36:52.817 INFO:tasks.workunit.client.0.smithi138.stderr: -415> 2024-09-14T11:36:52.381+0000 7f4882e199c0 5 AuthRegistry(0x5626d252ee88) adding con mode: crc 2024-09-14T11:36:52.817 INFO:tasks.workunit.client.0.smithi138.stderr: -414> 2024-09-14T11:36:52.381+0000 7f4882e199c0 5 AuthRegistry(0x5626d252ee88) adding con mode: secure 2024-09-14T11:36:52.817 INFO:tasks.workunit.client.0.smithi138.stderr: -413> 2024-09-14T11:36:52.381+0000 7f4882e199c0 5 AuthRegistry(0x5626d252ee88) adding con mode: crc 2024-09-14T11:36:52.817 INFO:tasks.workunit.client.0.smithi138.stderr: -412> 2024-09-14T11:36:52.381+0000 7f4882e199c0 5 AuthRegistry(0x5626d252ee88) adding con mode: secure 2024-09-14T11:36:52.817 INFO:tasks.workunit.client.0.smithi138.stderr: -411> 2024-09-14T11:36:52.381+0000 7f4882e199c0 5 AuthRegistry(0x5626d252ee88) adding con mode: crc 2024-09-14T11:36:52.817 INFO:tasks.workunit.client.0.smithi138.stderr: -410> 2024-09-14T11:36:52.381+0000 7f4882e199c0 5 AuthRegistry(0x5626d252ee88) adding con mode: crc 2024-09-14T11:36:52.817 INFO:tasks.workunit.client.0.smithi138.stderr: -409> 2024-09-14T11:36:52.381+0000 7f4882e199c0 5 AuthRegistry(0x5626d252ee88) adding con mode: secure 2024-09-14T11:36:52.817 INFO:tasks.workunit.client.0.smithi138.stderr: -408> 2024-09-14T11:36:52.381+0000 7f4882e199c0 5 AuthRegistry(0x5626d252ee88) adding con mode: crc 2024-09-14T11:36:52.817 INFO:tasks.workunit.client.0.smithi138.stderr: -407> 2024-09-14T11:36:52.381+0000 7f4882e199c0 5 AuthRegistry(0x5626d252ee88) adding con mode: secure 2024-09-14T11:36:52.817 INFO:tasks.workunit.client.0.smithi138.stderr: -406> 2024-09-14T11:36:52.381+0000 7f4882e199c0 5 AuthRegistry(0x5626d252ee88) adding con mode: crc 2024-09-14T11:36:52.818 INFO:tasks.workunit.client.0.smithi138.stderr: -405> 2024-09-14T11:36:52.381+0000 7f4882e199c0 5 AuthRegistry(0x5626d252ee88) adding con mode: secure 2024-09-14T11:36:52.818 INFO:tasks.workunit.client.0.smithi138.stderr: -404> 2024-09-14T11:36:52.381+0000 7f4882e199c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:36:52.818 INFO:tasks.workunit.client.0.smithi138.stderr: -403> 2024-09-14T11:36:52.381+0000 7f4882e199c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:36:52.818 INFO:tasks.workunit.client.0.smithi138.stderr: -402> 2024-09-14T11:36:52.381+0000 7f4882e199c0 5 asok(0x5626d22cbd90) register_command rotate-key cmddesc rotate-key hook 0x5626d252efd0 EEXIST 2024-09-14T11:36:52.818 INFO:tasks.workunit.client.0.smithi138.stderr: -401> 2024-09-14T11:36:52.381+0000 7f4882e199c0 10 monclient: _reopen_session rank -1 2024-09-14T11:36:52.818 INFO:tasks.workunit.client.0.smithi138.stderr: -400> 2024-09-14T11:36:52.381+0000 7f4882e199c0 10 monclient: _add_conns ranks=[1,2,0] 2024-09-14T11:36:52.818 INFO:tasks.workunit.client.0.smithi138.stderr: -399> 2024-09-14T11:36:52.381+0000 7f4882e199c0 10 monclient(hunting): picked mon.noname-b con 0x5626d2557b30 addr [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] 2024-09-14T11:36:52.818 INFO:tasks.workunit.client.0.smithi138.stderr: -398> 2024-09-14T11:36:52.381+0000 7f4882e199c0 10 monclient(hunting): picked mon.noname-c con 0x5626d2557460 addr [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] 2024-09-14T11:36:52.818 INFO:tasks.workunit.client.0.smithi138.stderr: -397> 2024-09-14T11:36:52.381+0000 7f4882e199c0 10 monclient(hunting): picked mon.noname-a con 0x5626d2555e40 addr [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] 2024-09-14T11:36:52.818 INFO:tasks.workunit.client.0.smithi138.stderr: -396> 2024-09-14T11:36:52.381+0000 7f4882e199c0 10 monclient(hunting): start opening mon connection 2024-09-14T11:36:52.818 INFO:tasks.workunit.client.0.smithi138.stderr: -395> 2024-09-14T11:36:52.381+0000 7f4882e199c0 10 monclient(hunting): start opening mon connection 2024-09-14T11:36:52.818 INFO:tasks.workunit.client.0.smithi138.stderr: -394> 2024-09-14T11:36:52.381+0000 7f4882e199c0 10 monclient(hunting): start opening mon connection 2024-09-14T11:36:52.819 INFO:tasks.workunit.client.0.smithi138.stderr: -393> 2024-09-14T11:36:52.381+0000 7f4882e199c0 10 monclient(hunting): _renew_subs 2024-09-14T11:36:52.819 INFO:tasks.workunit.client.0.smithi138.stderr: -392> 2024-09-14T11:36:52.381+0000 7f4882e199c0 10 monclient(hunting): authenticate will time out at 2748.345730s 2024-09-14T11:36:52.819 INFO:tasks.workunit.client.0.smithi138.stderr: -391> 2024-09-14T11:36:52.381+0000 7f488091f640 10 monclient(hunting): get_auth_request con 0x5626d2555e40 auth_method 0 2024-09-14T11:36:52.819 INFO:tasks.workunit.client.0.smithi138.stderr: -390> 2024-09-14T11:36:52.381+0000 7f488091f640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:36:52.819 INFO:tasks.workunit.client.0.smithi138.stderr: -389> 2024-09-14T11:36:52.381+0000 7f488091f640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:36:52.819 INFO:tasks.workunit.client.0.smithi138.stderr: -388> 2024-09-14T11:36:52.381+0000 7f488091f640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:36:52.819 INFO:tasks.workunit.client.0.smithi138.stderr: -387> 2024-09-14T11:36:52.381+0000 7f4881120640 10 monclient(hunting): get_auth_request con 0x5626d2557460 auth_method 0 2024-09-14T11:36:52.819 INFO:tasks.workunit.client.0.smithi138.stderr: -386> 2024-09-14T11:36:52.381+0000 7f4881120640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:36:52.819 INFO:tasks.workunit.client.0.smithi138.stderr: -385> 2024-09-14T11:36:52.381+0000 7f4881120640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:36:52.819 INFO:tasks.workunit.client.0.smithi138.stderr: -384> 2024-09-14T11:36:52.381+0000 7f4881120640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:36:52.819 INFO:tasks.workunit.client.0.smithi138.stderr: -383> 2024-09-14T11:36:52.381+0000 7f488091f640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:36:52.819 INFO:tasks.workunit.client.0.smithi138.stderr: -382> 2024-09-14T11:36:52.381+0000 7f488091f640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:36:52.819 INFO:tasks.workunit.client.0.smithi138.stderr: -381> 2024-09-14T11:36:52.381+0000 7f488091f640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:36:52.820 INFO:tasks.workunit.client.0.smithi138.stderr: -380> 2024-09-14T11:36:52.381+0000 7f4881120640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:36:52.820 INFO:tasks.workunit.client.0.smithi138.stderr: -379> 2024-09-14T11:36:52.381+0000 7f4881120640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:36:52.820 INFO:tasks.workunit.client.0.smithi138.stderr: -378> 2024-09-14T11:36:52.381+0000 7f4881120640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:36:52.820 INFO:tasks.workunit.client.0.smithi138.stderr: -377> 2024-09-14T11:36:52.381+0000 7f488091f640 10 monclient(hunting): handle_auth_done global_id 7248 payload 824 2024-09-14T11:36:52.820 INFO:tasks.workunit.client.0.smithi138.stderr: -376> 2024-09-14T11:36:52.381+0000 7f488091f640 10 monclient: _finish_hunting 0 2024-09-14T11:36:52.820 INFO:tasks.workunit.client.0.smithi138.stderr: -375> 2024-09-14T11:36:52.381+0000 7f488091f640 1 monclient: found mon.noname-a 2024-09-14T11:36:52.820 INFO:tasks.workunit.client.0.smithi138.stderr: -374> 2024-09-14T11:36:52.381+0000 7f488091f640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.138:3300/0 2024-09-14T11:36:52.820 INFO:tasks.workunit.client.0.smithi138.stderr: -373> 2024-09-14T11:36:52.381+0000 7f487bfff640 10 monclient: get_auth_request con 0x5626d2557b30 auth_method 0 2024-09-14T11:36:52.820 INFO:tasks.workunit.client.0.smithi138.stderr: -372> 2024-09-14T11:36:52.381+0000 7f47667fc640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:36:52.820 INFO:tasks.workunit.client.0.smithi138.stderr: -371> 2024-09-14T11:36:52.381+0000 7f47667fc640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-14T11:36:52.820 INFO:tasks.workunit.client.0.smithi138.stderr: -370> 2024-09-14T11:36:52.381+0000 7f47667fc640 10 monclient: dump: 2024-09-14T11:36:52.820 INFO:tasks.workunit.client.0.smithi138.stderr:epoch 1 2024-09-14T11:36:52.821 INFO:tasks.workunit.client.0.smithi138.stderr:fsid 3f225f43-83a6-4aeb-b798-1f04bb49d597 2024-09-14T11:36:52.821 INFO:tasks.workunit.client.0.smithi138.stderr:last_changed 2024-09-14T11:07:09.252780+0000 2024-09-14T11:36:52.821 INFO:tasks.workunit.client.0.smithi138.stderr:created 2024-09-14T11:07:09.252780+0000 2024-09-14T11:36:52.821 INFO:tasks.workunit.client.0.smithi138.stderr:min_mon_release 19 (squid) 2024-09-14T11:36:52.821 INFO:tasks.workunit.client.0.smithi138.stderr:election_strategy: 1 2024-09-14T11:36:52.821 INFO:tasks.workunit.client.0.smithi138.stderr:0: [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] mon.a 2024-09-14T11:36:52.821 INFO:tasks.workunit.client.0.smithi138.stderr:1: [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] mon.b 2024-09-14T11:36:52.821 INFO:tasks.workunit.client.0.smithi138.stderr:2: [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] mon.c 2024-09-14T11:36:52.821 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-14T11:36:52.821 INFO:tasks.workunit.client.0.smithi138.stderr: -369> 2024-09-14T11:36:52.381+0000 7f47667fc640 10 monclient: _finish_auth 0 2024-09-14T11:36:52.821 INFO:tasks.workunit.client.0.smithi138.stderr: -368> 2024-09-14T11:36:52.381+0000 7f47667fc640 10 monclient: _check_auth_tickets 2024-09-14T11:36:52.821 INFO:tasks.workunit.client.0.smithi138.stderr: -367> 2024-09-14T11:36:52.381+0000 7f4882e199c0 5 monclient: authenticate success, global_id 7248 2024-09-14T11:36:52.822 INFO:tasks.workunit.client.0.smithi138.stderr: -366> 2024-09-14T11:36:52.381+0000 7f47667fc640 10 monclient: handle_config config(0 keys) 2024-09-14T11:36:52.822 INFO:tasks.workunit.client.0.smithi138.stderr: -365> 2024-09-14T11:36:52.381+0000 7f47667fc640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:36:52.822 INFO:tasks.workunit.client.0.smithi138.stderr: -364> 2024-09-14T11:36:52.381+0000 7f47667fc640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-14T11:36:52.822 INFO:tasks.workunit.client.0.smithi138.stderr: -363> 2024-09-14T11:36:52.381+0000 7f47667fc640 10 monclient: dump: 2024-09-14T11:36:52.822 INFO:tasks.workunit.client.0.smithi138.stderr:epoch 1 2024-09-14T11:36:52.822 INFO:tasks.workunit.client.0.smithi138.stderr:fsid 3f225f43-83a6-4aeb-b798-1f04bb49d597 2024-09-14T11:36:52.822 INFO:tasks.workunit.client.0.smithi138.stderr:last_changed 2024-09-14T11:07:09.252780+0000 2024-09-14T11:36:52.822 INFO:tasks.workunit.client.0.smithi138.stderr:created 2024-09-14T11:07:09.252780+0000 2024-09-14T11:36:52.822 INFO:tasks.workunit.client.0.smithi138.stderr:min_mon_release 19 (squid) 2024-09-14T11:36:52.822 INFO:tasks.workunit.client.0.smithi138.stderr:election_strategy: 1 2024-09-14T11:36:52.822 INFO:tasks.workunit.client.0.smithi138.stderr:0: [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] mon.a 2024-09-14T11:36:52.822 INFO:tasks.workunit.client.0.smithi138.stderr:1: [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] mon.b 2024-09-14T11:36:52.822 INFO:tasks.workunit.client.0.smithi138.stderr:2: [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] mon.c 2024-09-14T11:36:52.823 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-14T11:36:52.823 INFO:tasks.workunit.client.0.smithi138.stderr: -362> 2024-09-14T11:36:52.381+0000 7f4882e199c0 10 monclient: _renew_subs 2024-09-14T11:36:52.823 INFO:tasks.workunit.client.0.smithi138.stderr: -361> 2024-09-14T11:36:52.381+0000 7f487b7fe640 4 set_mon_vals no callback set 2024-09-14T11:36:52.823 INFO:tasks.workunit.client.0.smithi138.stderr: -360> 2024-09-14T11:36:52.381+0000 7f4882e199c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.138:3300/0 2024-09-14T11:36:52.823 INFO:tasks.workunit.client.0.smithi138.stderr: -359> 2024-09-14T11:36:52.381+0000 7f4882e199c0 10 monclient: _renew_subs 2024-09-14T11:36:52.823 INFO:tasks.workunit.client.0.smithi138.stderr: -358> 2024-09-14T11:36:52.381+0000 7f4882e199c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.138:3300/0 2024-09-14T11:36:52.823 INFO:tasks.workunit.client.0.smithi138.stderr: -357> 2024-09-14T11:36:52.385+0000 7f47667fc640 4 mgrc handle_mgr_map Got map version 5 2024-09-14T11:36:52.823 INFO:tasks.workunit.client.0.smithi138.stderr: -356> 2024-09-14T11:36:52.385+0000 7f47667fc640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.138:6832/3778043143,v1:172.21.15.138:6833/3778043143] 2024-09-14T11:36:52.823 INFO:tasks.workunit.client.0.smithi138.stderr: -355> 2024-09-14T11:36:52.385+0000 7f47667fc640 4 mgrc reconnect Starting new session with [v2:172.21.15.138:6832/3778043143,v1:172.21.15.138:6833/3778043143] 2024-09-14T11:36:52.823 INFO:tasks.workunit.client.0.smithi138.stderr: -354> 2024-09-14T11:36:52.385+0000 7f487bfff640 10 monclient: get_auth_request con 0x7f47580717e0 auth_method 0 2024-09-14T11:36:52.823 INFO:tasks.workunit.client.0.smithi138.stderr: -353> 2024-09-14T11:36:52.385+0000 7f4882e199c0 10 monclient: get_monmap_and_config 2024-09-14T11:36:52.823 INFO:tasks.workunit.client.0.smithi138.stderr: -352> 2024-09-14T11:36:52.385+0000 7f4882e199c0 10 monclient: build_initial_monmap 2024-09-14T11:36:52.823 INFO:tasks.workunit.client.0.smithi138.stderr: -351> 2024-09-14T11:36:52.385+0000 7f4882e199c0 1 build_initial for_mkfs: 0 2024-09-14T11:36:52.824 INFO:tasks.workunit.client.0.smithi138.stderr: -350> 2024-09-14T11:36:52.385+0000 7f4882e199c0 10 monclient: monmap: 2024-09-14T11:36:52.824 INFO:tasks.workunit.client.0.smithi138.stderr:epoch 0 2024-09-14T11:36:52.824 INFO:tasks.workunit.client.0.smithi138.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-14T11:36:52.824 INFO:tasks.workunit.client.0.smithi138.stderr:last_changed 0.000000 2024-09-14T11:36:52.824 INFO:tasks.workunit.client.0.smithi138.stderr:created 0.000000 2024-09-14T11:36:52.824 INFO:tasks.workunit.client.0.smithi138.stderr:min_mon_release 0 (unknown) 2024-09-14T11:36:52.824 INFO:tasks.workunit.client.0.smithi138.stderr:election_strategy: 1 2024-09-14T11:36:52.824 INFO:tasks.workunit.client.0.smithi138.stderr:0: [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] mon.noname-a 2024-09-14T11:36:52.824 INFO:tasks.workunit.client.0.smithi138.stderr:1: [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] mon.noname-b 2024-09-14T11:36:52.824 INFO:tasks.workunit.client.0.smithi138.stderr:2: [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] mon.noname-c 2024-09-14T11:36:52.824 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-14T11:36:52.824 INFO:tasks.workunit.client.0.smithi138.stderr: -349> 2024-09-14T11:36:52.385+0000 7f4882e199c0 5 AuthRegistry(0x5626d2577040) adding auth protocol: cephx 2024-09-14T11:36:52.825 INFO:tasks.workunit.client.0.smithi138.stderr: -348> 2024-09-14T11:36:52.385+0000 7f4882e199c0 5 AuthRegistry(0x5626d2577040) adding auth protocol: cephx 2024-09-14T11:36:52.825 INFO:tasks.workunit.client.0.smithi138.stderr: -347> 2024-09-14T11:36:52.385+0000 7f4882e199c0 5 AuthRegistry(0x5626d2577040) adding auth protocol: cephx 2024-09-14T11:36:52.825 INFO:tasks.workunit.client.0.smithi138.stderr: -346> 2024-09-14T11:36:52.385+0000 7f4882e199c0 5 AuthRegistry(0x5626d2577040) adding con mode: secure 2024-09-14T11:36:52.825 INFO:tasks.workunit.client.0.smithi138.stderr: -345> 2024-09-14T11:36:52.385+0000 7f4882e199c0 5 AuthRegistry(0x5626d2577040) adding con mode: crc 2024-09-14T11:36:52.825 INFO:tasks.workunit.client.0.smithi138.stderr: -344> 2024-09-14T11:36:52.385+0000 7f4882e199c0 5 AuthRegistry(0x5626d2577040) adding con mode: secure 2024-09-14T11:36:52.825 INFO:tasks.workunit.client.0.smithi138.stderr: -343> 2024-09-14T11:36:52.385+0000 7f4882e199c0 5 AuthRegistry(0x5626d2577040) adding con mode: crc 2024-09-14T11:36:52.825 INFO:tasks.workunit.client.0.smithi138.stderr: -342> 2024-09-14T11:36:52.385+0000 7f4882e199c0 5 AuthRegistry(0x5626d2577040) adding con mode: secure 2024-09-14T11:36:52.825 INFO:tasks.workunit.client.0.smithi138.stderr: -341> 2024-09-14T11:36:52.385+0000 7f4882e199c0 5 AuthRegistry(0x5626d2577040) adding con mode: crc 2024-09-14T11:36:52.825 INFO:tasks.workunit.client.0.smithi138.stderr: -340> 2024-09-14T11:36:52.385+0000 7f4882e199c0 5 AuthRegistry(0x5626d2577040) adding con mode: crc 2024-09-14T11:36:52.825 INFO:tasks.workunit.client.0.smithi138.stderr: -339> 2024-09-14T11:36:52.385+0000 7f4882e199c0 5 AuthRegistry(0x5626d2577040) adding con mode: secure 2024-09-14T11:36:52.825 INFO:tasks.workunit.client.0.smithi138.stderr: -338> 2024-09-14T11:36:52.385+0000 7f4882e199c0 5 AuthRegistry(0x5626d2577040) adding con mode: crc 2024-09-14T11:36:52.825 INFO:tasks.workunit.client.0.smithi138.stderr: -337> 2024-09-14T11:36:52.385+0000 7f4882e199c0 5 AuthRegistry(0x5626d2577040) adding con mode: secure 2024-09-14T11:36:52.825 INFO:tasks.workunit.client.0.smithi138.stderr: -336> 2024-09-14T11:36:52.385+0000 7f4882e199c0 5 AuthRegistry(0x5626d2577040) adding con mode: crc 2024-09-14T11:36:52.826 INFO:tasks.workunit.client.0.smithi138.stderr: -335> 2024-09-14T11:36:52.385+0000 7f4882e199c0 5 AuthRegistry(0x5626d2577040) adding con mode: secure 2024-09-14T11:36:52.826 INFO:tasks.workunit.client.0.smithi138.stderr: -334> 2024-09-14T11:36:52.385+0000 7f4882e199c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:36:52.826 INFO:tasks.workunit.client.0.smithi138.stderr: -333> 2024-09-14T11:36:52.385+0000 7f4882e199c0 10 monclient: init 2024-09-14T11:36:52.826 INFO:tasks.workunit.client.0.smithi138.stderr: -332> 2024-09-14T11:36:52.385+0000 7f4882e199c0 5 AuthRegistry(0x7ffc46a26050) adding auth protocol: cephx 2024-09-14T11:36:52.826 INFO:tasks.workunit.client.0.smithi138.stderr: -331> 2024-09-14T11:36:52.385+0000 7f4882e199c0 5 AuthRegistry(0x7ffc46a26050) adding auth protocol: cephx 2024-09-14T11:36:52.826 INFO:tasks.workunit.client.0.smithi138.stderr: -330> 2024-09-14T11:36:52.385+0000 7f4882e199c0 5 AuthRegistry(0x7ffc46a26050) adding auth protocol: cephx 2024-09-14T11:36:52.826 INFO:tasks.workunit.client.0.smithi138.stderr: -329> 2024-09-14T11:36:52.385+0000 7f4882e199c0 5 AuthRegistry(0x7ffc46a26050) adding con mode: secure 2024-09-14T11:36:52.826 INFO:tasks.workunit.client.0.smithi138.stderr: -328> 2024-09-14T11:36:52.385+0000 7f4882e199c0 5 AuthRegistry(0x7ffc46a26050) adding con mode: crc 2024-09-14T11:36:52.826 INFO:tasks.workunit.client.0.smithi138.stderr: -327> 2024-09-14T11:36:52.385+0000 7f4882e199c0 5 AuthRegistry(0x7ffc46a26050) adding con mode: secure 2024-09-14T11:36:52.826 INFO:tasks.workunit.client.0.smithi138.stderr: -326> 2024-09-14T11:36:52.385+0000 7f4882e199c0 5 AuthRegistry(0x7ffc46a26050) adding con mode: crc 2024-09-14T11:36:52.826 INFO:tasks.workunit.client.0.smithi138.stderr: -325> 2024-09-14T11:36:52.385+0000 7f4882e199c0 5 AuthRegistry(0x7ffc46a26050) adding con mode: secure 2024-09-14T11:36:52.826 INFO:tasks.workunit.client.0.smithi138.stderr: -324> 2024-09-14T11:36:52.385+0000 7f4882e199c0 5 AuthRegistry(0x7ffc46a26050) adding con mode: crc 2024-09-14T11:36:52.826 INFO:tasks.workunit.client.0.smithi138.stderr: -323> 2024-09-14T11:36:52.385+0000 7f4882e199c0 5 AuthRegistry(0x7ffc46a26050) adding con mode: crc 2024-09-14T11:36:52.827 INFO:tasks.workunit.client.0.smithi138.stderr: -322> 2024-09-14T11:36:52.385+0000 7f4882e199c0 5 AuthRegistry(0x7ffc46a26050) adding con mode: secure 2024-09-14T11:36:52.827 INFO:tasks.workunit.client.0.smithi138.stderr: -321> 2024-09-14T11:36:52.385+0000 7f4882e199c0 5 AuthRegistry(0x7ffc46a26050) adding con mode: crc 2024-09-14T11:36:52.827 INFO:tasks.workunit.client.0.smithi138.stderr: -320> 2024-09-14T11:36:52.385+0000 7f4882e199c0 5 AuthRegistry(0x7ffc46a26050) adding con mode: secure 2024-09-14T11:36:52.827 INFO:tasks.workunit.client.0.smithi138.stderr: -319> 2024-09-14T11:36:52.385+0000 7f4882e199c0 5 AuthRegistry(0x7ffc46a26050) adding con mode: crc 2024-09-14T11:36:52.827 INFO:tasks.workunit.client.0.smithi138.stderr: -318> 2024-09-14T11:36:52.385+0000 7f4882e199c0 5 AuthRegistry(0x7ffc46a26050) adding con mode: secure 2024-09-14T11:36:52.827 INFO:tasks.workunit.client.0.smithi138.stderr: -317> 2024-09-14T11:36:52.385+0000 7f4882e199c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:36:52.827 INFO:tasks.workunit.client.0.smithi138.stderr: -316> 2024-09-14T11:36:52.385+0000 7f4882e199c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:36:52.827 INFO:tasks.workunit.client.0.smithi138.stderr: -315> 2024-09-14T11:36:52.385+0000 7f4882e199c0 5 asok(0x5626d22cbd90) register_command rotate-key cmddesc rotate-key hook 0x7ffc46a26198 EEXIST 2024-09-14T11:36:52.827 INFO:tasks.workunit.client.0.smithi138.stderr: -314> 2024-09-14T11:36:52.385+0000 7f4882e199c0 10 monclient: _reopen_session rank -1 2024-09-14T11:36:52.827 INFO:tasks.workunit.client.0.smithi138.stderr: -313> 2024-09-14T11:36:52.385+0000 7f4882e199c0 10 monclient: _add_conns ranks=[1,0,2] 2024-09-14T11:36:52.827 INFO:tasks.workunit.client.0.smithi138.stderr: -312> 2024-09-14T11:36:52.385+0000 7f4882e199c0 10 monclient(hunting): picked mon.noname-b con 0x5626d25ab6d0 addr [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] 2024-09-14T11:36:52.827 INFO:tasks.workunit.client.0.smithi138.stderr: -311> 2024-09-14T11:36:52.385+0000 7f4882e199c0 10 monclient(hunting): picked mon.noname-a con 0x5626d257b0f0 addr [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] 2024-09-14T11:36:52.828 INFO:tasks.workunit.client.0.smithi138.stderr: -310> 2024-09-14T11:36:52.385+0000 7f4882e199c0 10 monclient(hunting): picked mon.noname-c con 0x5626d25a6ea0 addr [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] 2024-09-14T11:36:52.828 INFO:tasks.workunit.client.0.smithi138.stderr: -309> 2024-09-14T11:36:52.385+0000 7f4882e199c0 10 monclient(hunting): start opening mon connection 2024-09-14T11:36:52.828 INFO:tasks.workunit.client.0.smithi138.stderr: -308> 2024-09-14T11:36:52.385+0000 7f4882e199c0 10 monclient(hunting): start opening mon connection 2024-09-14T11:36:52.828 INFO:tasks.workunit.client.0.smithi138.stderr: -307> 2024-09-14T11:36:52.385+0000 7f4882e199c0 10 monclient(hunting): start opening mon connection 2024-09-14T11:36:52.828 INFO:tasks.workunit.client.0.smithi138.stderr: -306> 2024-09-14T11:36:52.385+0000 7f4882e199c0 10 monclient(hunting): _renew_subs 2024-09-14T11:36:52.828 INFO:tasks.workunit.client.0.smithi138.stderr: -305> 2024-09-14T11:36:52.385+0000 7f4882e199c0 10 monclient(hunting): authenticate will time out at 2748.349735s 2024-09-14T11:36:52.828 INFO:tasks.workunit.client.0.smithi138.stderr: -304> 2024-09-14T11:36:52.385+0000 7f488091f640 10 monclient(hunting): get_auth_request con 0x5626d25a6ea0 auth_method 0 2024-09-14T11:36:52.828 INFO:tasks.workunit.client.0.smithi138.stderr: -303> 2024-09-14T11:36:52.385+0000 7f488091f640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:36:52.828 INFO:tasks.workunit.client.0.smithi138.stderr: -302> 2024-09-14T11:36:52.385+0000 7f488091f640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:36:52.828 INFO:tasks.workunit.client.0.smithi138.stderr: -301> 2024-09-14T11:36:52.385+0000 7f488091f640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:36:52.828 INFO:tasks.workunit.client.0.smithi138.stderr: -300> 2024-09-14T11:36:52.385+0000 7f4881120640 10 monclient(hunting): get_auth_request con 0x5626d257b0f0 auth_method 0 2024-09-14T11:36:52.828 INFO:tasks.workunit.client.0.smithi138.stderr: -299> 2024-09-14T11:36:52.385+0000 7f4881120640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:36:52.829 INFO:tasks.workunit.client.0.smithi138.stderr: -298> 2024-09-14T11:36:52.385+0000 7f4881120640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:36:52.829 INFO:tasks.workunit.client.0.smithi138.stderr: -297> 2024-09-14T11:36:52.385+0000 7f4881120640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:36:52.829 INFO:tasks.workunit.client.0.smithi138.stderr: -296> 2024-09-14T11:36:52.385+0000 7f488091f640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:36:52.829 INFO:tasks.workunit.client.0.smithi138.stderr: -295> 2024-09-14T11:36:52.385+0000 7f488091f640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:36:52.829 INFO:tasks.workunit.client.0.smithi138.stderr: -294> 2024-09-14T11:36:52.385+0000 7f488091f640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:36:52.829 INFO:tasks.workunit.client.0.smithi138.stderr: -293> 2024-09-14T11:36:52.385+0000 7f4881120640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:36:52.829 INFO:tasks.workunit.client.0.smithi138.stderr: -292> 2024-09-14T11:36:52.385+0000 7f4881120640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:36:52.829 INFO:tasks.workunit.client.0.smithi138.stderr: -291> 2024-09-14T11:36:52.385+0000 7f4881120640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:36:52.829 INFO:tasks.workunit.client.0.smithi138.stderr: -290> 2024-09-14T11:36:52.385+0000 7f488091f640 10 monclient(hunting): handle_auth_done global_id 6788 payload 274 2024-09-14T11:36:52.829 INFO:tasks.workunit.client.0.smithi138.stderr: -289> 2024-09-14T11:36:52.385+0000 7f488091f640 10 monclient: _finish_hunting 0 2024-09-14T11:36:52.829 INFO:tasks.workunit.client.0.smithi138.stderr: -288> 2024-09-14T11:36:52.385+0000 7f488091f640 1 monclient: found mon.noname-c 2024-09-14T11:36:52.829 INFO:tasks.workunit.client.0.smithi138.stderr: -287> 2024-09-14T11:36:52.385+0000 7f488091f640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.138:3301/0 2024-09-14T11:36:52.830 INFO:tasks.workunit.client.0.smithi138.stderr: -286> 2024-09-14T11:36:52.385+0000 7f4757fff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:36:52.830 INFO:tasks.workunit.client.0.smithi138.stderr: -285> 2024-09-14T11:36:52.385+0000 7f4757fff640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-14T11:36:52.830 INFO:tasks.workunit.client.0.smithi138.stderr: -284> 2024-09-14T11:36:52.385+0000 7f4757fff640 10 monclient: dump: 2024-09-14T11:36:52.830 INFO:tasks.workunit.client.0.smithi138.stderr:epoch 1 2024-09-14T11:36:52.830 INFO:tasks.workunit.client.0.smithi138.stderr:fsid 3f225f43-83a6-4aeb-b798-1f04bb49d597 2024-09-14T11:36:52.830 INFO:tasks.workunit.client.0.smithi138.stderr:last_changed 2024-09-14T11:07:09.252780+0000 2024-09-14T11:36:52.830 INFO:tasks.workunit.client.0.smithi138.stderr:created 2024-09-14T11:07:09.252780+0000 2024-09-14T11:36:52.830 INFO:tasks.workunit.client.0.smithi138.stderr:min_mon_release 19 (squid) 2024-09-14T11:36:52.830 INFO:tasks.workunit.client.0.smithi138.stderr:election_strategy: 1 2024-09-14T11:36:52.830 INFO:tasks.workunit.client.0.smithi138.stderr:0: [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] mon.a 2024-09-14T11:36:52.830 INFO:tasks.workunit.client.0.smithi138.stderr:1: [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] mon.b 2024-09-14T11:36:52.830 INFO:tasks.workunit.client.0.smithi138.stderr:2: [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] mon.c 2024-09-14T11:36:52.830 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-14T11:36:52.831 INFO:tasks.workunit.client.0.smithi138.stderr: -283> 2024-09-14T11:36:52.385+0000 7f4757fff640 10 monclient: _finish_auth 0 2024-09-14T11:36:52.831 INFO:tasks.workunit.client.0.smithi138.stderr: -282> 2024-09-14T11:36:52.385+0000 7f4757fff640 10 monclient: _check_auth_tickets 2024-09-14T11:36:52.831 INFO:tasks.workunit.client.0.smithi138.stderr: -281> 2024-09-14T11:36:52.385+0000 7f4882e199c0 5 monclient: authenticate success, global_id 6788 2024-09-14T11:36:52.831 INFO:tasks.workunit.client.0.smithi138.stderr: -280> 2024-09-14T11:36:52.385+0000 7f4757fff640 10 monclient: handle_config config(0 keys) 2024-09-14T11:36:52.831 INFO:tasks.workunit.client.0.smithi138.stderr: -279> 2024-09-14T11:36:52.385+0000 7f4882e199c0 10 monclient: get_monmap_and_config success 2024-09-14T11:36:52.831 INFO:tasks.workunit.client.0.smithi138.stderr: -278> 2024-09-14T11:36:52.385+0000 7f4882e199c0 4 set_mon_vals no callback set 2024-09-14T11:36:52.831 INFO:tasks.workunit.client.0.smithi138.stderr: -277> 2024-09-14T11:36:52.385+0000 7f4757fff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:36:52.831 INFO:tasks.workunit.client.0.smithi138.stderr: -276> 2024-09-14T11:36:52.385+0000 7f4757fff640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-14T11:36:52.831 INFO:tasks.workunit.client.0.smithi138.stderr: -275> 2024-09-14T11:36:52.385+0000 7f4757fff640 10 monclient: dump: 2024-09-14T11:36:52.831 INFO:tasks.workunit.client.0.smithi138.stderr:epoch 1 2024-09-14T11:36:52.831 INFO:tasks.workunit.client.0.smithi138.stderr:fsid 3f225f43-83a6-4aeb-b798-1f04bb49d597 2024-09-14T11:36:52.831 INFO:tasks.workunit.client.0.smithi138.stderr:last_changed 2024-09-14T11:07:09.252780+0000 2024-09-14T11:36:52.831 INFO:tasks.workunit.client.0.smithi138.stderr:created 2024-09-14T11:07:09.252780+0000 2024-09-14T11:36:52.831 INFO:tasks.workunit.client.0.smithi138.stderr:min_mon_release 19 (squid) 2024-09-14T11:36:52.832 INFO:tasks.workunit.client.0.smithi138.stderr:election_strategy: 1 2024-09-14T11:36:52.832 INFO:tasks.workunit.client.0.smithi138.stderr:0: [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] mon.a 2024-09-14T11:36:52.832 INFO:tasks.workunit.client.0.smithi138.stderr:1: [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] mon.b 2024-09-14T11:36:52.832 INFO:tasks.workunit.client.0.smithi138.stderr:2: [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] mon.c 2024-09-14T11:36:52.832 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-14T11:36:52.832 INFO:tasks.workunit.client.0.smithi138.stderr: -274> 2024-09-14T11:36:52.385+0000 7f4882e199c0 10 monclient: shutdown 2024-09-14T11:36:52.832 INFO:tasks.workunit.client.0.smithi138.stderr: -273> 2024-09-14T11:36:52.385+0000 7f4882e199c0 10 monclient: build_initial_monmap 2024-09-14T11:36:52.832 INFO:tasks.workunit.client.0.smithi138.stderr: -272> 2024-09-14T11:36:52.385+0000 7f4882e199c0 1 build_initial for_mkfs: 0 2024-09-14T11:36:52.832 INFO:tasks.workunit.client.0.smithi138.stderr: -271> 2024-09-14T11:36:52.385+0000 7f4882e199c0 10 monclient: monmap: 2024-09-14T11:36:52.832 INFO:tasks.workunit.client.0.smithi138.stderr:epoch 0 2024-09-14T11:36:52.832 INFO:tasks.workunit.client.0.smithi138.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-14T11:36:52.832 INFO:tasks.workunit.client.0.smithi138.stderr:last_changed 0.000000 2024-09-14T11:36:52.832 INFO:tasks.workunit.client.0.smithi138.stderr:created 0.000000 2024-09-14T11:36:52.833 INFO:tasks.workunit.client.0.smithi138.stderr:min_mon_release 0 (unknown) 2024-09-14T11:36:52.833 INFO:tasks.workunit.client.0.smithi138.stderr:election_strategy: 1 2024-09-14T11:36:52.833 INFO:tasks.workunit.client.0.smithi138.stderr:0: [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] mon.noname-a 2024-09-14T11:36:52.833 INFO:tasks.workunit.client.0.smithi138.stderr:1: [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] mon.noname-b 2024-09-14T11:36:52.833 INFO:tasks.workunit.client.0.smithi138.stderr:2: [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] mon.noname-c 2024-09-14T11:36:52.833 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-14T11:36:52.833 INFO:tasks.workunit.client.0.smithi138.stderr: -270> 2024-09-14T11:36:52.385+0000 7f4882e199c0 5 AuthRegistry(0x5626d259c0f0) adding auth protocol: cephx 2024-09-14T11:36:52.833 INFO:tasks.workunit.client.0.smithi138.stderr: -269> 2024-09-14T11:36:52.385+0000 7f4882e199c0 5 AuthRegistry(0x5626d259c0f0) adding auth protocol: cephx 2024-09-14T11:36:52.833 INFO:tasks.workunit.client.0.smithi138.stderr: -268> 2024-09-14T11:36:52.385+0000 7f4882e199c0 5 AuthRegistry(0x5626d259c0f0) adding auth protocol: cephx 2024-09-14T11:36:52.833 INFO:tasks.workunit.client.0.smithi138.stderr: -267> 2024-09-14T11:36:52.385+0000 7f4882e199c0 5 AuthRegistry(0x5626d259c0f0) adding con mode: secure 2024-09-14T11:36:52.833 INFO:tasks.workunit.client.0.smithi138.stderr: -266> 2024-09-14T11:36:52.385+0000 7f4882e199c0 5 AuthRegistry(0x5626d259c0f0) adding con mode: crc 2024-09-14T11:36:52.833 INFO:tasks.workunit.client.0.smithi138.stderr: -265> 2024-09-14T11:36:52.385+0000 7f4882e199c0 5 AuthRegistry(0x5626d259c0f0) adding con mode: secure 2024-09-14T11:36:52.833 INFO:tasks.workunit.client.0.smithi138.stderr: -264> 2024-09-14T11:36:52.385+0000 7f4882e199c0 5 AuthRegistry(0x5626d259c0f0) adding con mode: crc 2024-09-14T11:36:52.834 INFO:tasks.workunit.client.0.smithi138.stderr: -263> 2024-09-14T11:36:52.385+0000 7f4882e199c0 5 AuthRegistry(0x5626d259c0f0) adding con mode: secure 2024-09-14T11:36:52.834 INFO:tasks.workunit.client.0.smithi138.stderr: -262> 2024-09-14T11:36:52.385+0000 7f4882e199c0 5 AuthRegistry(0x5626d259c0f0) adding con mode: crc 2024-09-14T11:36:52.834 INFO:tasks.workunit.client.0.smithi138.stderr: -261> 2024-09-14T11:36:52.385+0000 7f4882e199c0 5 AuthRegistry(0x5626d259c0f0) adding con mode: crc 2024-09-14T11:36:52.834 INFO:tasks.workunit.client.0.smithi138.stderr: -260> 2024-09-14T11:36:52.385+0000 7f4882e199c0 5 AuthRegistry(0x5626d259c0f0) adding con mode: secure 2024-09-14T11:36:52.834 INFO:tasks.workunit.client.0.smithi138.stderr: -259> 2024-09-14T11:36:52.385+0000 7f4882e199c0 5 AuthRegistry(0x5626d259c0f0) adding con mode: crc 2024-09-14T11:36:52.834 INFO:tasks.workunit.client.0.smithi138.stderr: -258> 2024-09-14T11:36:52.385+0000 7f4882e199c0 5 AuthRegistry(0x5626d259c0f0) adding con mode: secure 2024-09-14T11:36:52.834 INFO:tasks.workunit.client.0.smithi138.stderr: -257> 2024-09-14T11:36:52.385+0000 7f4882e199c0 5 AuthRegistry(0x5626d259c0f0) adding con mode: crc 2024-09-14T11:36:52.834 INFO:tasks.workunit.client.0.smithi138.stderr: -256> 2024-09-14T11:36:52.385+0000 7f4882e199c0 5 AuthRegistry(0x5626d259c0f0) adding con mode: secure 2024-09-14T11:36:52.834 INFO:tasks.workunit.client.0.smithi138.stderr: -255> 2024-09-14T11:36:52.385+0000 7f4882e199c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:36:52.834 INFO:tasks.workunit.client.0.smithi138.stderr: -254> 2024-09-14T11:36:52.385+0000 7f4882e199c0 1 librados: starting msgr at 2024-09-14T11:36:52.834 INFO:tasks.workunit.client.0.smithi138.stderr: -253> 2024-09-14T11:36:52.385+0000 7f4882e199c0 1 librados: starting objecter 2024-09-14T11:36:52.834 INFO:tasks.workunit.client.0.smithi138.stderr: -252> 2024-09-14T11:36:52.385+0000 7f4882e199c0 5 asok(0x5626d22cbd90) register_command objecter_requests cmddesc objecter_requests hook 0x5626d2559430 EEXIST 2024-09-14T11:36:52.834 INFO:tasks.workunit.client.0.smithi138.stderr: -251> 2024-09-14T11:36:52.385+0000 7f4882e199c0 1 librados: setting wanted keys 2024-09-14T11:36:52.835 INFO:tasks.workunit.client.0.smithi138.stderr: -250> 2024-09-14T11:36:52.385+0000 7f4882e199c0 1 librados: calling monclient init 2024-09-14T11:36:52.835 INFO:tasks.workunit.client.0.smithi138.stderr: -249> 2024-09-14T11:36:52.385+0000 7f4882e199c0 10 monclient: init 2024-09-14T11:36:52.835 INFO:tasks.workunit.client.0.smithi138.stderr: -248> 2024-09-14T11:36:52.385+0000 7f4882e199c0 5 AuthRegistry(0x5626d2559950) adding auth protocol: cephx 2024-09-14T11:36:52.835 INFO:tasks.workunit.client.0.smithi138.stderr: -247> 2024-09-14T11:36:52.385+0000 7f4882e199c0 5 AuthRegistry(0x5626d2559950) adding auth protocol: cephx 2024-09-14T11:36:52.835 INFO:tasks.workunit.client.0.smithi138.stderr: -246> 2024-09-14T11:36:52.385+0000 7f4882e199c0 5 AuthRegistry(0x5626d2559950) adding auth protocol: cephx 2024-09-14T11:36:52.835 INFO:tasks.workunit.client.0.smithi138.stderr: -245> 2024-09-14T11:36:52.385+0000 7f4882e199c0 5 AuthRegistry(0x5626d2559950) adding con mode: secure 2024-09-14T11:36:52.835 INFO:tasks.workunit.client.0.smithi138.stderr: -244> 2024-09-14T11:36:52.385+0000 7f4882e199c0 5 AuthRegistry(0x5626d2559950) adding con mode: crc 2024-09-14T11:36:52.835 INFO:tasks.workunit.client.0.smithi138.stderr: -243> 2024-09-14T11:36:52.385+0000 7f4882e199c0 5 AuthRegistry(0x5626d2559950) adding con mode: secure 2024-09-14T11:36:52.835 INFO:tasks.workunit.client.0.smithi138.stderr: -242> 2024-09-14T11:36:52.385+0000 7f4882e199c0 5 AuthRegistry(0x5626d2559950) adding con mode: crc 2024-09-14T11:36:52.835 INFO:tasks.workunit.client.0.smithi138.stderr: -241> 2024-09-14T11:36:52.385+0000 7f4882e199c0 5 AuthRegistry(0x5626d2559950) adding con mode: secure 2024-09-14T11:36:52.835 INFO:tasks.workunit.client.0.smithi138.stderr: -240> 2024-09-14T11:36:52.385+0000 7f4882e199c0 5 AuthRegistry(0x5626d2559950) adding con mode: crc 2024-09-14T11:36:52.835 INFO:tasks.workunit.client.0.smithi138.stderr: -239> 2024-09-14T11:36:52.385+0000 7f4882e199c0 5 AuthRegistry(0x5626d2559950) adding con mode: crc 2024-09-14T11:36:52.836 INFO:tasks.workunit.client.0.smithi138.stderr: -238> 2024-09-14T11:36:52.385+0000 7f4882e199c0 5 AuthRegistry(0x5626d2559950) adding con mode: secure 2024-09-14T11:36:52.836 INFO:tasks.workunit.client.0.smithi138.stderr: -237> 2024-09-14T11:36:52.385+0000 7f4882e199c0 5 AuthRegistry(0x5626d2559950) adding con mode: crc 2024-09-14T11:36:52.836 INFO:tasks.workunit.client.0.smithi138.stderr: -236> 2024-09-14T11:36:52.385+0000 7f4882e199c0 5 AuthRegistry(0x5626d2559950) adding con mode: secure 2024-09-14T11:36:52.836 INFO:tasks.workunit.client.0.smithi138.stderr: -235> 2024-09-14T11:36:52.385+0000 7f4882e199c0 5 AuthRegistry(0x5626d2559950) adding con mode: crc 2024-09-14T11:36:52.836 INFO:tasks.workunit.client.0.smithi138.stderr: -234> 2024-09-14T11:36:52.385+0000 7f4882e199c0 5 AuthRegistry(0x5626d2559950) adding con mode: secure 2024-09-14T11:36:52.836 INFO:tasks.workunit.client.0.smithi138.stderr: -233> 2024-09-14T11:36:52.389+0000 7f4882e199c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:36:52.836 INFO:tasks.workunit.client.0.smithi138.stderr: -232> 2024-09-14T11:36:52.389+0000 7f4882e199c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:36:52.836 INFO:tasks.workunit.client.0.smithi138.stderr: -231> 2024-09-14T11:36:52.389+0000 7f4882e199c0 5 asok(0x5626d22cbd90) register_command rotate-key cmddesc rotate-key hook 0x5626d2559a98 EEXIST 2024-09-14T11:36:52.836 INFO:tasks.workunit.client.0.smithi138.stderr: -230> 2024-09-14T11:36:52.389+0000 7f4882e199c0 10 monclient: _reopen_session rank -1 2024-09-14T11:36:52.836 INFO:tasks.workunit.client.0.smithi138.stderr: -229> 2024-09-14T11:36:52.389+0000 7f4882e199c0 10 monclient: _add_conns ranks=[0,2,1] 2024-09-14T11:36:52.836 INFO:tasks.workunit.client.0.smithi138.stderr: -228> 2024-09-14T11:36:52.389+0000 7f4882e199c0 10 monclient(hunting): picked mon.noname-a con 0x5626d257b0f0 addr [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] 2024-09-14T11:36:52.836 INFO:tasks.workunit.client.0.smithi138.stderr: -227> 2024-09-14T11:36:52.389+0000 7f4882e199c0 10 monclient(hunting): picked mon.noname-c con 0x5626d25a6ea0 addr [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] 2024-09-14T11:36:52.836 INFO:tasks.workunit.client.0.smithi138.stderr: -226> 2024-09-14T11:36:52.389+0000 7f4882e199c0 10 monclient(hunting): picked mon.noname-b con 0x5626d25ab6d0 addr [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] 2024-09-14T11:36:52.837 INFO:tasks.workunit.client.0.smithi138.stderr: -225> 2024-09-14T11:36:52.389+0000 7f4882e199c0 10 monclient(hunting): start opening mon connection 2024-09-14T11:36:52.837 INFO:tasks.workunit.client.0.smithi138.stderr: -224> 2024-09-14T11:36:52.389+0000 7f4882e199c0 10 monclient(hunting): start opening mon connection 2024-09-14T11:36:52.837 INFO:tasks.workunit.client.0.smithi138.stderr: -223> 2024-09-14T11:36:52.389+0000 7f4882e199c0 10 monclient(hunting): start opening mon connection 2024-09-14T11:36:52.837 INFO:tasks.workunit.client.0.smithi138.stderr: -222> 2024-09-14T11:36:52.389+0000 7f4882e199c0 10 monclient(hunting): _renew_subs 2024-09-14T11:36:52.837 INFO:tasks.workunit.client.0.smithi138.stderr: -221> 2024-09-14T11:36:52.389+0000 7f4882e199c0 10 monclient(hunting): authenticate will time out at 2748.352350s 2024-09-14T11:36:52.837 INFO:tasks.workunit.client.0.smithi138.stderr: -220> 2024-09-14T11:36:52.389+0000 7f487bfff640 10 monclient(hunting): get_auth_request con 0x5626d257b0f0 auth_method 0 2024-09-14T11:36:52.837 INFO:tasks.workunit.client.0.smithi138.stderr: -219> 2024-09-14T11:36:52.389+0000 7f487bfff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:36:52.837 INFO:tasks.workunit.client.0.smithi138.stderr: -218> 2024-09-14T11:36:52.389+0000 7f487bfff640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:36:52.837 INFO:tasks.workunit.client.0.smithi138.stderr: -217> 2024-09-14T11:36:52.389+0000 7f487bfff640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:36:52.837 INFO:tasks.workunit.client.0.smithi138.stderr: -216> 2024-09-14T11:36:52.389+0000 7f4881120640 10 monclient(hunting): get_auth_request con 0x5626d25a6ea0 auth_method 0 2024-09-14T11:36:52.837 INFO:tasks.workunit.client.0.smithi138.stderr: -215> 2024-09-14T11:36:52.389+0000 7f4881120640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:36:52.837 INFO:tasks.workunit.client.0.smithi138.stderr: -214> 2024-09-14T11:36:52.389+0000 7f4881120640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:36:52.837 INFO:tasks.workunit.client.0.smithi138.stderr: -213> 2024-09-14T11:36:52.389+0000 7f4881120640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:36:52.838 INFO:tasks.workunit.client.0.smithi138.stderr: -212> 2024-09-14T11:36:52.389+0000 7f487bfff640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:36:52.838 INFO:tasks.workunit.client.0.smithi138.stderr: -211> 2024-09-14T11:36:52.389+0000 7f487bfff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:36:52.838 INFO:tasks.workunit.client.0.smithi138.stderr: -210> 2024-09-14T11:36:52.389+0000 7f487bfff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:36:52.838 INFO:tasks.workunit.client.0.smithi138.stderr: -209> 2024-09-14T11:36:52.389+0000 7f4881120640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:36:52.838 INFO:tasks.workunit.client.0.smithi138.stderr: -208> 2024-09-14T11:36:52.389+0000 7f4881120640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:36:52.838 INFO:tasks.workunit.client.0.smithi138.stderr: -207> 2024-09-14T11:36:52.389+0000 7f4881120640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:36:52.838 INFO:tasks.workunit.client.0.smithi138.stderr: -206> 2024-09-14T11:36:52.389+0000 7f487bfff640 10 monclient(hunting): handle_auth_done global_id 7254 payload 824 2024-09-14T11:36:52.838 INFO:tasks.workunit.client.0.smithi138.stderr: -205> 2024-09-14T11:36:52.389+0000 7f487bfff640 10 monclient: _finish_hunting 0 2024-09-14T11:36:52.838 INFO:tasks.workunit.client.0.smithi138.stderr: -204> 2024-09-14T11:36:52.389+0000 7f487bfff640 1 monclient: found mon.noname-a 2024-09-14T11:36:52.838 INFO:tasks.workunit.client.0.smithi138.stderr: -203> 2024-09-14T11:36:52.389+0000 7f487bfff640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.138:3300/0 2024-09-14T11:36:52.838 INFO:tasks.workunit.client.0.smithi138.stderr: -202> 2024-09-14T11:36:52.389+0000 7f47567fc640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:36:52.838 INFO:tasks.workunit.client.0.smithi138.stderr: -201> 2024-09-14T11:36:52.389+0000 7f47567fc640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-14T11:36:52.838 INFO:tasks.workunit.client.0.smithi138.stderr: -200> 2024-09-14T11:36:52.389+0000 7f47567fc640 10 monclient: dump: 2024-09-14T11:36:52.839 INFO:tasks.workunit.client.0.smithi138.stderr:epoch 1 2024-09-14T11:36:52.839 INFO:tasks.workunit.client.0.smithi138.stderr:fsid 3f225f43-83a6-4aeb-b798-1f04bb49d597 2024-09-14T11:36:52.839 INFO:tasks.workunit.client.0.smithi138.stderr:last_changed 2024-09-14T11:07:09.252780+0000 2024-09-14T11:36:52.839 INFO:tasks.workunit.client.0.smithi138.stderr:created 2024-09-14T11:07:09.252780+0000 2024-09-14T11:36:52.839 INFO:tasks.workunit.client.0.smithi138.stderr:min_mon_release 19 (squid) 2024-09-14T11:36:52.839 INFO:tasks.workunit.client.0.smithi138.stderr:election_strategy: 1 2024-09-14T11:36:52.839 INFO:tasks.workunit.client.0.smithi138.stderr:0: [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] mon.a 2024-09-14T11:36:52.839 INFO:tasks.workunit.client.0.smithi138.stderr:1: [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] mon.b 2024-09-14T11:36:52.839 INFO:tasks.workunit.client.0.smithi138.stderr:2: [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] mon.c 2024-09-14T11:36:52.839 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-14T11:36:52.839 INFO:tasks.workunit.client.0.smithi138.stderr: -199> 2024-09-14T11:36:52.389+0000 7f47567fc640 10 monclient: _finish_auth 0 2024-09-14T11:36:52.839 INFO:tasks.workunit.client.0.smithi138.stderr: -198> 2024-09-14T11:36:52.389+0000 7f47567fc640 10 monclient: _check_auth_tickets 2024-09-14T11:36:52.839 INFO:tasks.workunit.client.0.smithi138.stderr: -197> 2024-09-14T11:36:52.389+0000 7f47567fc640 10 monclient: handle_config config(0 keys) 2024-09-14T11:36:52.839 INFO:tasks.workunit.client.0.smithi138.stderr: -196> 2024-09-14T11:36:52.389+0000 7f47567fc640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:36:52.840 INFO:tasks.workunit.client.0.smithi138.stderr: -195> 2024-09-14T11:36:52.389+0000 7f47567fc640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-14T11:36:52.840 INFO:tasks.workunit.client.0.smithi138.stderr: -194> 2024-09-14T11:36:52.389+0000 7f47567fc640 10 monclient: dump: 2024-09-14T11:36:52.840 INFO:tasks.workunit.client.0.smithi138.stderr:epoch 1 2024-09-14T11:36:52.840 INFO:tasks.workunit.client.0.smithi138.stderr:fsid 3f225f43-83a6-4aeb-b798-1f04bb49d597 2024-09-14T11:36:52.840 INFO:tasks.workunit.client.0.smithi138.stderr:last_changed 2024-09-14T11:07:09.252780+0000 2024-09-14T11:36:52.840 INFO:tasks.workunit.client.0.smithi138.stderr:created 2024-09-14T11:07:09.252780+0000 2024-09-14T11:36:52.840 INFO:tasks.workunit.client.0.smithi138.stderr:min_mon_release 19 (squid) 2024-09-14T11:36:52.840 INFO:tasks.workunit.client.0.smithi138.stderr:election_strategy: 1 2024-09-14T11:36:52.840 INFO:tasks.workunit.client.0.smithi138.stderr:0: [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] mon.a 2024-09-14T11:36:52.840 INFO:tasks.workunit.client.0.smithi138.stderr:1: [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] mon.b 2024-09-14T11:36:52.840 INFO:tasks.workunit.client.0.smithi138.stderr:2: [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] mon.c 2024-09-14T11:36:52.840 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-14T11:36:52.840 INFO:tasks.workunit.client.0.smithi138.stderr: -193> 2024-09-14T11:36:52.389+0000 7f4882e199c0 5 monclient: authenticate success, global_id 7254 2024-09-14T11:36:52.841 INFO:tasks.workunit.client.0.smithi138.stderr: -192> 2024-09-14T11:36:52.389+0000 7f4882e199c0 10 monclient: _renew_subs 2024-09-14T11:36:52.841 INFO:tasks.workunit.client.0.smithi138.stderr: -191> 2024-09-14T11:36:52.389+0000 7f4882e199c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.138:3300/0 2024-09-14T11:36:52.841 INFO:tasks.workunit.client.0.smithi138.stderr: -190> 2024-09-14T11:36:52.389+0000 7f4757fff640 4 set_mon_vals no callback set 2024-09-14T11:36:52.841 INFO:tasks.workunit.client.0.smithi138.stderr: -189> 2024-09-14T11:36:52.389+0000 7f4882e199c0 10 monclient: _renew_subs 2024-09-14T11:36:52.841 INFO:tasks.workunit.client.0.smithi138.stderr: -188> 2024-09-14T11:36:52.389+0000 7f4882e199c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.138:3300/0 2024-09-14T11:36:52.841 INFO:tasks.workunit.client.0.smithi138.stderr: -187> 2024-09-14T11:36:52.389+0000 7f4882e199c0 1 librados: init done 2024-09-14T11:36:52.841 INFO:tasks.workunit.client.0.smithi138.stderr: -186> 2024-09-14T11:36:52.389+0000 7f4882e199c0 5 asok(0x5626d22cbd90) register_command cr dump hook 0x5626d259e9e8 2024-09-14T11:36:52.841 INFO:tasks.workunit.client.0.smithi138.stderr: -185> 2024-09-14T11:36:52.389+0000 7f4882e199c0 20 rados->read ofs=0 len=0 2024-09-14T11:36:52.841 INFO:tasks.workunit.client.0.smithi138.stderr: -184> 2024-09-14T11:36:52.389+0000 7f47567fc640 4 mgrc handle_mgr_map Got map version 5 2024-09-14T11:36:52.841 INFO:tasks.workunit.client.0.smithi138.stderr: -183> 2024-09-14T11:36:52.389+0000 7f47567fc640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.138:6832/3778043143,v1:172.21.15.138:6833/3778043143] 2024-09-14T11:36:52.841 INFO:tasks.workunit.client.0.smithi138.stderr: -182> 2024-09-14T11:36:52.389+0000 7f47567fc640 4 mgrc reconnect Starting new session with [v2:172.21.15.138:6832/3778043143,v1:172.21.15.138:6833/3778043143] 2024-09-14T11:36:52.841 INFO:tasks.workunit.client.0.smithi138.stderr: -181> 2024-09-14T11:36:52.389+0000 7f4881120640 10 monclient: get_auth_request con 0x7f474c071960 auth_method 0 2024-09-14T11:36:52.842 INFO:tasks.workunit.client.0.smithi138.stderr: -180> 2024-09-14T11:36:52.389+0000 7f488091f640 10 monclient: get_auth_request con 0x5626d25c4a70 auth_method 0 2024-09-14T11:36:52.842 INFO:tasks.workunit.client.0.smithi138.stderr: -179> 2024-09-14T11:36:52.393+0000 7f4882e199c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:36:52.842 INFO:tasks.workunit.client.0.smithi138.stderr: -178> 2024-09-14T11:36:52.393+0000 7f4882e199c0 20 realm 2024-09-14T11:36:52.842 INFO:tasks.workunit.client.0.smithi138.stderr: -177> 2024-09-14T11:36:52.393+0000 7f4882e199c0 20 rados->read ofs=0 len=0 2024-09-14T11:36:52.842 INFO:tasks.workunit.client.0.smithi138.stderr: -176> 2024-09-14T11:36:52.393+0000 7f4882e199c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:36:52.842 INFO:tasks.workunit.client.0.smithi138.stderr: -175> 2024-09-14T11:36:52.393+0000 7f4882e199c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:36:52.842 INFO:tasks.workunit.client.0.smithi138.stderr: -174> 2024-09-14T11:36:52.393+0000 7f4882e199c0 20 rados->read ofs=0 len=0 2024-09-14T11:36:52.842 INFO:tasks.workunit.client.0.smithi138.stderr: -173> 2024-09-14T11:36:52.393+0000 7f4882e199c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:36:52.842 INFO:tasks.workunit.client.0.smithi138.stderr: -172> 2024-09-14T11:36:52.393+0000 7f4882e199c0 20 rados->read ofs=0 len=0 2024-09-14T11:36:52.842 INFO:tasks.workunit.client.0.smithi138.stderr: -171> 2024-09-14T11:36:52.393+0000 7f487bfff640 10 monclient: get_auth_request con 0x5626d25c88f0 auth_method 0 2024-09-14T11:36:52.842 INFO:tasks.workunit.client.0.smithi138.stderr: -170> 2024-09-14T11:36:52.393+0000 7f4882e199c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:36:52.842 INFO:tasks.workunit.client.0.smithi138.stderr: -169> 2024-09-14T11:36:52.393+0000 7f4882e199c0 20 rados->read ofs=0 len=0 2024-09-14T11:36:52.842 INFO:tasks.workunit.client.0.smithi138.stderr: -168> 2024-09-14T11:36:52.393+0000 7f4881120640 10 monclient: get_auth_request con 0x5626d25cc130 auth_method 0 2024-09-14T11:36:52.843 INFO:tasks.workunit.client.0.smithi138.stderr: -167> 2024-09-14T11:36:52.393+0000 7f4882e199c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:36:52.843 INFO:tasks.workunit.client.0.smithi138.stderr: -166> 2024-09-14T11:36:52.393+0000 7f4882e199c0 20 searching for the correct realm 2024-09-14T11:36:52.843 INFO:tasks.workunit.client.0.smithi138.stderr: -165> 2024-09-14T11:36:52.393+0000 7f488091f640 10 monclient: get_auth_request con 0x5626d25d0ef0 auth_method 0 2024-09-14T11:36:52.843 INFO:tasks.workunit.client.0.smithi138.stderr: -164> 2024-09-14T11:36:52.397+0000 7f487bfff640 10 monclient: get_auth_request con 0x7f4874136030 auth_method 0 2024-09-14T11:36:52.843 INFO:tasks.workunit.client.0.smithi138.stderr: -163> 2024-09-14T11:36:52.397+0000 7f4881120640 10 monclient: get_auth_request con 0x7f487c02e040 auth_method 0 2024-09-14T11:36:52.843 INFO:tasks.workunit.client.0.smithi138.stderr: -162> 2024-09-14T11:36:52.401+0000 7f487bfff640 0 -- 172.21.15.138:0/3095715856 >> [v2:172.21.15.154:6808/1468088432,v1:172.21.15.154:6809/1468088432] conn(0x7f4874136030 msgr2=0x7f4874121b40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:36:52.843 INFO:tasks.workunit.client.0.smithi138.stderr: -161> 2024-09-14T11:36:52.401+0000 7f47567fc640 1 client.7254.objecter ms_handle_reset 0x7f4874136030 session 0x7f4874122680 osd.7 2024-09-14T11:36:52.843 INFO:tasks.workunit.client.0.smithi138.stderr: -160> 2024-09-14T11:36:52.401+0000 7f47567fc640 10 monclient: _renew_subs 2024-09-14T11:36:52.843 INFO:tasks.workunit.client.0.smithi138.stderr: -159> 2024-09-14T11:36:52.401+0000 7f47567fc640 10 monclient: _send_mon_message to mon.a at v2:172.21.15.138:3300/0 2024-09-14T11:36:52.843 INFO:tasks.workunit.client.0.smithi138.stderr: -158> 2024-09-14T11:36:52.401+0000 7f487bfff640 10 monclient: get_auth_request con 0x7f474c082090 auth_method 0 2024-09-14T11:36:52.843 INFO:tasks.workunit.client.0.smithi138.stderr: -157> 2024-09-14T11:36:52.401+0000 7f488091f640 10 monclient: get_auth_request con 0x7f487c03ea10 auth_method 0 2024-09-14T11:36:52.843 INFO:tasks.workunit.client.0.smithi138.stderr: -156> 2024-09-14T11:36:52.405+0000 7f487bfff640 10 monclient: get_auth_request con 0x7f487c04e400 auth_method 0 2024-09-14T11:36:52.843 INFO:tasks.workunit.client.0.smithi138.stderr: -155> 2024-09-14T11:36:52.405+0000 7f487bfff640 0 -- 172.21.15.138:0/3095715856 >> [v2:172.21.15.138:6816/326481658,v1:172.21.15.138:6817/326481658] conn(0x7f487c04e400 msgr2=0x7f487c04e880 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:36:52.844 INFO:tasks.workunit.client.0.smithi138.stderr: -154> 2024-09-14T11:36:52.609+0000 7f487bfff640 10 monclient: get_auth_request con 0x7f487c04e400 auth_method 0 2024-09-14T11:36:52.844 INFO:tasks.workunit.client.0.smithi138.stderr: -153> 2024-09-14T11:36:52.621+0000 7f4882e199c0 20 RGWRados::pool_iterate: got zone_info.d9e72d30-c60b-4d0d-9267-fdc36392d5ad 2024-09-14T11:36:52.844 INFO:tasks.workunit.client.0.smithi138.stderr: -152> 2024-09-14T11:36:52.621+0000 7f4882e199c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:36:52.844 INFO:tasks.workunit.client.0.smithi138.stderr: -151> 2024-09-14T11:36:52.621+0000 7f4882e199c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:36:52.844 INFO:tasks.workunit.client.0.smithi138.stderr: -150> 2024-09-14T11:36:52.621+0000 7f4882e199c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:36:52.844 INFO:tasks.workunit.client.0.smithi138.stderr: -149> 2024-09-14T11:36:52.621+0000 7f4882e199c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:36:52.844 INFO:tasks.workunit.client.0.smithi138.stderr: -148> 2024-09-14T11:36:52.621+0000 7f4882e199c0 20 RGWRados::pool_iterate: got zonegroup_info.65ab941b-da8c-4160-94fb-3672b069d44f 2024-09-14T11:36:52.844 INFO:tasks.workunit.client.0.smithi138.stderr: -147> 2024-09-14T11:36:52.621+0000 7f4882e199c0 20 rados->read ofs=0 len=0 2024-09-14T11:36:52.844 INFO:tasks.workunit.client.0.smithi138.stderr: -146> 2024-09-14T11:36:52.621+0000 7f4882e199c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:36:52.844 INFO:tasks.workunit.client.0.smithi138.stderr: -145> 2024-09-14T11:36:52.621+0000 7f4882e199c0 20 rados->read ofs=0 len=0 2024-09-14T11:36:52.844 INFO:tasks.workunit.client.0.smithi138.stderr: -144> 2024-09-14T11:36:52.621+0000 7f4882e199c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:36:52.844 INFO:tasks.workunit.client.0.smithi138.stderr: -143> 2024-09-14T11:36:52.621+0000 7f4882e199c0 20 rados->read ofs=0 len=0 2024-09-14T11:36:52.844 INFO:tasks.workunit.client.0.smithi138.stderr: -142> 2024-09-14T11:36:52.621+0000 7f4882e199c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:36:52.845 INFO:tasks.workunit.client.0.smithi138.stderr: -141> 2024-09-14T11:36:52.621+0000 7f4882e199c0 20 zone default found 2024-09-14T11:36:52.845 INFO:tasks.workunit.client.0.smithi138.stderr: -140> 2024-09-14T11:36:52.621+0000 7f4882e199c0 4 Realm: () 2024-09-14T11:36:52.845 INFO:tasks.workunit.client.0.smithi138.stderr: -139> 2024-09-14T11:36:52.621+0000 7f4882e199c0 4 ZoneGroup: default (65ab941b-da8c-4160-94fb-3672b069d44f) 2024-09-14T11:36:52.845 INFO:tasks.workunit.client.0.smithi138.stderr: -138> 2024-09-14T11:36:52.621+0000 7f4882e199c0 4 Zone: default (d9e72d30-c60b-4d0d-9267-fdc36392d5ad) 2024-09-14T11:36:52.845 INFO:tasks.workunit.client.0.smithi138.stderr: -137> 2024-09-14T11:36:52.621+0000 7f4882e199c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:36:52.845 INFO:tasks.workunit.client.0.smithi138.stderr: -136> 2024-09-14T11:36:52.621+0000 7f4882e199c0 20 zonegroup default 2024-09-14T11:36:52.845 INFO:tasks.workunit.client.0.smithi138.stderr: -135> 2024-09-14T11:36:52.621+0000 7f4882e199c0 20 rados->read ofs=0 len=0 2024-09-14T11:36:52.845 INFO:tasks.workunit.client.0.smithi138.stderr: -134> 2024-09-14T11:36:52.625+0000 7f4882e199c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:36:52.845 INFO:tasks.workunit.client.0.smithi138.stderr: -133> 2024-09-14T11:36:52.625+0000 7f4882e199c0 20 rados->read ofs=0 len=0 2024-09-14T11:36:52.845 INFO:tasks.workunit.client.0.smithi138.stderr: -132> 2024-09-14T11:36:52.625+0000 7f4882e199c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:36:52.845 INFO:tasks.workunit.client.0.smithi138.stderr: -131> 2024-09-14T11:36:52.625+0000 7f4882e199c0 20 rados->read ofs=0 len=0 2024-09-14T11:36:52.845 INFO:tasks.workunit.client.0.smithi138.stderr: -130> 2024-09-14T11:36:52.625+0000 7f4882e199c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:36:52.846 INFO:tasks.workunit.client.0.smithi138.stderr: -129> 2024-09-14T11:36:52.625+0000 7f4882e199c0 20 started sync module instance, tier type = 2024-09-14T11:36:52.846 INFO:tasks.workunit.client.0.smithi138.stderr: -128> 2024-09-14T11:36:52.625+0000 7f4882e199c0 20 started zone id=d9e72d30-c60b-4d0d-9267-fdc36392d5ad (name=default) with tier type = 2024-09-14T11:36:52.846 INFO:tasks.workunit.client.0.smithi138.stderr: -127> 2024-09-14T11:36:52.649+0000 7f4882e199c0 20 add_watcher() i=0 2024-09-14T11:36:52.846 INFO:tasks.workunit.client.0.smithi138.stderr: -126> 2024-09-14T11:36:52.649+0000 7f4882e199c0 20 add_watcher() i=1 2024-09-14T11:36:52.846 INFO:tasks.workunit.client.0.smithi138.stderr: -125> 2024-09-14T11:36:52.649+0000 7f4882e199c0 20 add_watcher() i=2 2024-09-14T11:36:52.846 INFO:tasks.workunit.client.0.smithi138.stderr: -124> 2024-09-14T11:36:52.649+0000 7f4882e199c0 20 add_watcher() i=3 2024-09-14T11:36:52.846 INFO:tasks.workunit.client.0.smithi138.stderr: -123> 2024-09-14T11:36:52.649+0000 7f4882e199c0 20 add_watcher() i=4 2024-09-14T11:36:52.846 INFO:tasks.workunit.client.0.smithi138.stderr: -122> 2024-09-14T11:36:52.649+0000 7f4882e199c0 20 add_watcher() i=5 2024-09-14T11:36:52.846 INFO:tasks.workunit.client.0.smithi138.stderr: -121> 2024-09-14T11:36:52.649+0000 7f4882e199c0 20 add_watcher() i=6 2024-09-14T11:36:52.846 INFO:tasks.workunit.client.0.smithi138.stderr: -120> 2024-09-14T11:36:52.653+0000 7f4882e199c0 20 add_watcher() i=7 2024-09-14T11:36:52.846 INFO:tasks.workunit.client.0.smithi138.stderr: -119> 2024-09-14T11:36:52.653+0000 7f4882e199c0 2 all 8 watchers are set, enabling cache 2024-09-14T11:36:52.846 INFO:tasks.workunit.client.0.smithi138.stderr: -118> 2024-09-14T11:36:52.657+0000 7f4882e199c0 5 AuthRegistry(0x7ffc46a26530) adding auth protocol: cephx 2024-09-14T11:36:52.846 INFO:tasks.workunit.client.0.smithi138.stderr: -117> 2024-09-14T11:36:52.657+0000 7f4882e199c0 5 AuthRegistry(0x7ffc46a26530) adding auth protocol: cephx 2024-09-14T11:36:52.846 INFO:tasks.workunit.client.0.smithi138.stderr: -116> 2024-09-14T11:36:52.657+0000 7f4882e199c0 5 AuthRegistry(0x7ffc46a26530) adding auth protocol: cephx 2024-09-14T11:36:52.847 INFO:tasks.workunit.client.0.smithi138.stderr: -115> 2024-09-14T11:36:52.657+0000 7f4882e199c0 5 AuthRegistry(0x7ffc46a26530) adding con mode: secure 2024-09-14T11:36:52.847 INFO:tasks.workunit.client.0.smithi138.stderr: -114> 2024-09-14T11:36:52.657+0000 7f4882e199c0 5 AuthRegistry(0x7ffc46a26530) adding con mode: crc 2024-09-14T11:36:52.847 INFO:tasks.workunit.client.0.smithi138.stderr: -113> 2024-09-14T11:36:52.657+0000 7f4882e199c0 5 AuthRegistry(0x7ffc46a26530) adding con mode: secure 2024-09-14T11:36:52.847 INFO:tasks.workunit.client.0.smithi138.stderr: -112> 2024-09-14T11:36:52.657+0000 7f4882e199c0 5 AuthRegistry(0x7ffc46a26530) adding con mode: crc 2024-09-14T11:36:52.847 INFO:tasks.workunit.client.0.smithi138.stderr: -111> 2024-09-14T11:36:52.657+0000 7f4882e199c0 5 AuthRegistry(0x7ffc46a26530) adding con mode: secure 2024-09-14T11:36:52.847 INFO:tasks.workunit.client.0.smithi138.stderr: -110> 2024-09-14T11:36:52.657+0000 7f4882e199c0 5 AuthRegistry(0x7ffc46a26530) adding con mode: crc 2024-09-14T11:36:52.847 INFO:tasks.workunit.client.0.smithi138.stderr: -109> 2024-09-14T11:36:52.657+0000 7f4882e199c0 5 AuthRegistry(0x7ffc46a26530) adding con mode: crc 2024-09-14T11:36:52.847 INFO:tasks.workunit.client.0.smithi138.stderr: -108> 2024-09-14T11:36:52.657+0000 7f4882e199c0 5 AuthRegistry(0x7ffc46a26530) adding con mode: secure 2024-09-14T11:36:52.847 INFO:tasks.workunit.client.0.smithi138.stderr: -107> 2024-09-14T11:36:52.657+0000 7f47377e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:36:52.847 INFO:tasks.workunit.client.0.smithi138.stderr: -106> 2024-09-14T11:36:52.657+0000 7f4882e199c0 5 AuthRegistry(0x7ffc46a26530) adding con mode: crc 2024-09-14T11:36:52.847 INFO:tasks.workunit.client.0.smithi138.stderr: -105> 2024-09-14T11:36:52.657+0000 7f4882e199c0 5 AuthRegistry(0x7ffc46a26530) adding con mode: secure 2024-09-14T11:36:52.847 INFO:tasks.workunit.client.0.smithi138.stderr: -104> 2024-09-14T11:36:52.657+0000 7f4882e199c0 5 AuthRegistry(0x7ffc46a26530) adding con mode: crc 2024-09-14T11:36:52.847 INFO:tasks.workunit.client.0.smithi138.stderr: -103> 2024-09-14T11:36:52.657+0000 7f4882e199c0 5 AuthRegistry(0x7ffc46a26530) adding con mode: secure 2024-09-14T11:36:52.848 INFO:tasks.workunit.client.0.smithi138.stderr: -102> 2024-09-14T11:36:52.657+0000 7f4882e199c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:36:52.848 INFO:tasks.workunit.client.0.smithi138.stderr: -101> 2024-09-14T11:36:52.657+0000 7f4882e199c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:36:52.848 INFO:tasks.workunit.client.0.smithi138.stderr: -100> 2024-09-14T11:36:52.657+0000 7f4882e199c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:36:52.848 INFO:tasks.workunit.client.0.smithi138.stderr: -99> 2024-09-14T11:36:52.657+0000 7f4882e199c0 5 asok(0x5626d22cbd90) register_command cache list hook 0x5626d259d010 2024-09-14T11:36:52.848 INFO:tasks.workunit.client.0.smithi138.stderr: -98> 2024-09-14T11:36:52.657+0000 7f4882e199c0 5 asok(0x5626d22cbd90) register_command cache inspect hook 0x5626d259d010 2024-09-14T11:36:52.848 INFO:tasks.workunit.client.0.smithi138.stderr: -97> 2024-09-14T11:36:52.657+0000 7f4882e199c0 5 asok(0x5626d22cbd90) register_command cache erase hook 0x5626d259d010 2024-09-14T11:36:52.848 INFO:tasks.workunit.client.0.smithi138.stderr: -96> 2024-09-14T11:36:52.657+0000 7f4882e199c0 5 asok(0x5626d22cbd90) register_command cache zap hook 0x5626d259d010 2024-09-14T11:36:52.848 INFO:tasks.workunit.client.0.smithi138.stderr: -95> 2024-09-14T11:36:52.657+0000 7f4882e199c0 5 note: GC not initialized 2024-09-14T11:36:52.848 INFO:tasks.workunit.client.0.smithi138.stderr: -94> 2024-09-14T11:36:52.657+0000 7f47367e4640 20 reqs_thread_entry: start 2024-09-14T11:36:52.848 INFO:tasks.workunit.client.0.smithi138.stderr: -93> 2024-09-14T11:36:52.657+0000 7f4882e199c0 5 asok(0x5626d22cbd90) register_command sync trace show hook 0x7f4874110070 2024-09-14T11:36:52.848 INFO:tasks.workunit.client.0.smithi138.stderr: -92> 2024-09-14T11:36:52.657+0000 7f4882e199c0 5 asok(0x5626d22cbd90) register_command sync trace history hook 0x7f4874110070 2024-09-14T11:36:52.848 INFO:tasks.workunit.client.0.smithi138.stderr: -91> 2024-09-14T11:36:52.657+0000 7f4882e199c0 5 asok(0x5626d22cbd90) register_command sync trace active hook 0x7f4874110070 2024-09-14T11:36:52.849 INFO:tasks.workunit.client.0.smithi138.stderr: -90> 2024-09-14T11:36:52.657+0000 7f4882e199c0 5 asok(0x5626d22cbd90) register_command sync trace active_short hook 0x7f4874110070 2024-09-14T11:36:52.849 INFO:tasks.workunit.client.0.smithi138.stderr: -89> 2024-09-14T11:36:52.657+0000 7f4882e199c0 20 init_complete bucket index max shards: 11 2024-09-14T11:36:52.849 INFO:tasks.workunit.client.0.smithi138.stderr: -88> 2024-09-14T11:36:52.657+0000 7f4882e199c0 20 Filter name: none 2024-09-14T11:36:52.849 INFO:tasks.workunit.client.0.smithi138.stderr: -87> 2024-09-14T11:36:52.657+0000 7f472f7fe640 20 reqs_thread_entry: start 2024-09-14T11:36:52.849 INFO:tasks.workunit.client.0.smithi138.stderr: -86> 2024-09-14T11:36:52.657+0000 7f4882e199c0 10 cache get: name=default.rgw.meta+root+abort-at-commit-target-layout : miss 2024-09-14T11:36:52.849 INFO:tasks.workunit.client.0.smithi138.stderr: -85> 2024-09-14T11:36:52.657+0000 7f4882e199c0 20 rados->read ofs=0 len=0 2024-09-14T11:36:52.849 INFO:tasks.workunit.client.0.smithi138.stderr: -84> 2024-09-14T11:36:52.657+0000 7f4882e199c0 20 rados_obj.operate() r=0 bl.length=197 2024-09-14T11:36:52.849 INFO:tasks.workunit.client.0.smithi138.stderr: -83> 2024-09-14T11:36:52.657+0000 7f4882e199c0 10 cache put: name=default.rgw.meta+root+abort-at-commit-target-layout info.flags=0x11 2024-09-14T11:36:52.849 INFO:tasks.workunit.client.0.smithi138.stderr: -82> 2024-09-14T11:36:52.657+0000 7f4882e199c0 10 adding default.rgw.meta+root+abort-at-commit-target-layout to cache LRU end 2024-09-14T11:36:52.849 INFO:tasks.workunit.client.0.smithi138.stderr: -81> 2024-09-14T11:36:52.657+0000 7f4882e199c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.32 : miss 2024-09-14T11:36:52.849 INFO:tasks.workunit.client.0.smithi138.stderr: -80> 2024-09-14T11:36:52.657+0000 7f4882e199c0 20 rados->read ofs=0 len=0 2024-09-14T11:36:52.849 INFO:tasks.workunit.client.0.smithi138.stderr: -79> 2024-09-14T11:36:52.661+0000 7f4882e199c0 20 rados_obj.operate() r=0 bl.length=419 2024-09-14T11:36:52.849 INFO:tasks.workunit.client.0.smithi138.stderr: -78> 2024-09-14T11:36:52.661+0000 7f4882e199c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.32 info.flags=0x17 2024-09-14T11:36:52.850 INFO:tasks.workunit.client.0.smithi138.stderr: -77> 2024-09-14T11:36:52.661+0000 7f4882e199c0 10 adding default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.32 to cache LRU end 2024-09-14T11:36:52.850 INFO:tasks.workunit.client.0.smithi138.stderr: -76> 2024-09-14T11:36:52.661+0000 7f4882e199c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:36:52.850 INFO:tasks.workunit.client.0.smithi138.stderr: -75> 2024-09-14T11:36:52.661+0000 7f4882e199c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:36:52.850 INFO:tasks.workunit.client.0.smithi138.stderr: -74> 2024-09-14T11:36:52.661+0000 7f4882e199c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.32 2024-09-14T11:36:52.850 INFO:tasks.workunit.client.0.smithi138.stderr: -73> 2024-09-14T11:36:52.669+0000 7f4882e199c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.32 info.flags=0x17 2024-09-14T11:36:52.850 INFO:tasks.workunit.client.0.smithi138.stderr: -72> 2024-09-14T11:36:52.669+0000 7f4882e199c0 10 moving default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.32 to cache LRU end 2024-09-14T11:36:52.850 INFO:tasks.workunit.client.0.smithi138.stderr: -71> 2024-09-14T11:36:52.669+0000 7f4882e199c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:36:52.850 INFO:tasks.workunit.client.0.smithi138.stderr: -70> 2024-09-14T11:36:52.669+0000 7f4882e199c0 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-commit-target-layout:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.32, ofs0, ns] 2024-09-14T11:36:52.850 INFO:tasks.workunit.client.0.smithi138.stderr: -69> 2024-09-14T11:36:52.673+0000 7f47577fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366205 cookie 94724738090224 notifier 7254 bl.length()=931 2024-09-14T11:36:52.850 INFO:tasks.workunit.client.0.smithi138.stderr: -68> 2024-09-14T11:36:52.673+0000 7f47577fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.32 info.flags=0x17 2024-09-14T11:36:52.850 INFO:tasks.workunit.client.0.smithi138.stderr: -67> 2024-09-14T11:36:52.673+0000 7f47577fe640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.32 to cache LRU end 2024-09-14T11:36:52.850 INFO:tasks.workunit.client.0.smithi138.stderr: -66> 2024-09-14T11:36:52.673+0000 7f47577fe640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:36:52.850 INFO:tasks.workunit.client.0.smithi138.stderr: -65> 2024-09-14T11:36:52.673+0000 7f4882e199c0 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.32]): orig_sources= new_sources= 2024-09-14T11:36:52.851 INFO:tasks.workunit.client.0.smithi138.stderr: -64> 2024-09-14T11:36:52.673+0000 7f4882e199c0 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.32]): potential sources added=[] removed=[] 2024-09-14T11:36:52.851 INFO:tasks.workunit.client.0.smithi138.stderr: -63> 2024-09-14T11:36:52.673+0000 7f4882e199c0 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.32]): orig_dests= new_dests= 2024-09-14T11:36:52.851 INFO:tasks.workunit.client.0.smithi138.stderr: -62> 2024-09-14T11:36:52.673+0000 7f4882e199c0 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.32]): potential dests added=[] removed=[] 2024-09-14T11:36:52.851 INFO:tasks.workunit.client.0.smithi138.stderr: -61> 2024-09-14T11:36:52.681+0000 7f4882e199c0 10 bucket_obj is .dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.32.1.0 2024-09-14T11:36:52.851 INFO:tasks.workunit.client.0.smithi138.stderr: -60> 2024-09-14T11:36:52.681+0000 7f4882e199c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.32.1.0 2024-09-14T11:36:52.851 INFO:tasks.workunit.client.0.smithi138.stderr: -59> 2024-09-14T11:36:52.681+0000 7f4882e199c0 10 bucket_obj is .dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.32.1.1 2024-09-14T11:36:52.851 INFO:tasks.workunit.client.0.smithi138.stderr: -58> 2024-09-14T11:36:52.681+0000 7f4882e199c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.32.1.1 2024-09-14T11:36:52.851 INFO:tasks.workunit.client.0.smithi138.stderr: -57> 2024-09-14T11:36:52.681+0000 7f4882e199c0 10 bucket_obj is .dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.32.1.2 2024-09-14T11:36:52.851 INFO:tasks.workunit.client.0.smithi138.stderr: -56> 2024-09-14T11:36:52.681+0000 7f4882e199c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.32.1.2 2024-09-14T11:36:52.851 INFO:tasks.workunit.client.0.smithi138.stderr: -55> 2024-09-14T11:36:52.681+0000 7f4882e199c0 10 bucket_obj is .dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.32.1.3 2024-09-14T11:36:52.851 INFO:tasks.workunit.client.0.smithi138.stderr: -54> 2024-09-14T11:36:52.681+0000 7f4882e199c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.32.1.3 2024-09-14T11:36:52.851 INFO:tasks.workunit.client.0.smithi138.stderr: -53> 2024-09-14T11:36:52.681+0000 7f4882e199c0 10 bucket_obj is .dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.32.1.4 2024-09-14T11:36:52.851 INFO:tasks.workunit.client.0.smithi138.stderr: -52> 2024-09-14T11:36:52.681+0000 7f4882e199c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.32.1.4 2024-09-14T11:36:52.851 INFO:tasks.workunit.client.0.smithi138.stderr: -51> 2024-09-14T11:36:52.681+0000 7f4882e199c0 10 bucket_obj is .dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.32.1.5 2024-09-14T11:36:52.852 INFO:tasks.workunit.client.0.smithi138.stderr: -50> 2024-09-14T11:36:52.681+0000 7f4882e199c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.32.1.5 2024-09-14T11:36:52.852 INFO:tasks.workunit.client.0.smithi138.stderr: -49> 2024-09-14T11:36:52.681+0000 7f4882e199c0 10 bucket_obj is .dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.32.1.6 2024-09-14T11:36:52.852 INFO:tasks.workunit.client.0.smithi138.stderr: -48> 2024-09-14T11:36:52.681+0000 7f4882e199c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.32.1.6 2024-09-14T11:36:52.852 INFO:tasks.workunit.client.0.smithi138.stderr: -47> 2024-09-14T11:36:52.681+0000 7f4882e199c0 10 bucket_obj is .dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.32.1.7 2024-09-14T11:36:52.852 INFO:tasks.workunit.client.0.smithi138.stderr: -46> 2024-09-14T11:36:52.681+0000 7f4882e199c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.32.1.7 2024-09-14T11:36:52.852 INFO:tasks.workunit.client.0.smithi138.stderr: -45> 2024-09-14T11:36:52.681+0000 7f4882e199c0 10 bucket_obj is .dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.32.1.8 2024-09-14T11:36:52.852 INFO:tasks.workunit.client.0.smithi138.stderr: -44> 2024-09-14T11:36:52.681+0000 7f4882e199c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.32.1.8 2024-09-14T11:36:52.852 INFO:tasks.workunit.client.0.smithi138.stderr: -43> 2024-09-14T11:36:52.681+0000 7f4882e199c0 10 bucket_obj is .dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.32.1.9 2024-09-14T11:36:52.852 INFO:tasks.workunit.client.0.smithi138.stderr: -42> 2024-09-14T11:36:52.681+0000 7f4882e199c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.32.1.9 2024-09-14T11:36:52.852 INFO:tasks.workunit.client.0.smithi138.stderr: -41> 2024-09-14T11:36:52.681+0000 7f4882e199c0 10 bucket_obj is .dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.32.1.10 2024-09-14T11:36:52.852 INFO:tasks.workunit.client.0.smithi138.stderr: -40> 2024-09-14T11:36:52.681+0000 7f4882e199c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.32.1.10 2024-09-14T11:36:52.852 INFO:tasks.workunit.client.0.smithi138.stderr: -39> 2024-09-14T11:36:52.681+0000 7f4882e199c0 10 bucket_obj is .dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.32.1.11 2024-09-14T11:36:52.852 INFO:tasks.workunit.client.0.smithi138.stderr: -38> 2024-09-14T11:36:52.681+0000 7f4882e199c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.32.1.11 2024-09-14T11:36:52.853 INFO:tasks.workunit.client.0.smithi138.stderr: -37> 2024-09-14T11:36:52.681+0000 7f4882e199c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.32.0 2024-09-14T11:36:52.853 INFO:tasks.workunit.client.0.smithi138.stderr: -36> 2024-09-14T11:36:52.685+0000 7f4882e199c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.32.1 2024-09-14T11:36:52.853 INFO:tasks.workunit.client.0.smithi138.stderr: -35> 2024-09-14T11:36:52.685+0000 7f4882e199c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.32.2 2024-09-14T11:36:52.853 INFO:tasks.workunit.client.0.smithi138.stderr: -34> 2024-09-14T11:36:52.685+0000 7f4882e199c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.32.3 2024-09-14T11:36:52.853 INFO:tasks.workunit.client.0.smithi138.stderr: -33> 2024-09-14T11:36:52.685+0000 7f4882e199c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.32.4 2024-09-14T11:36:52.853 INFO:tasks.workunit.client.0.smithi138.stderr: -32> 2024-09-14T11:36:52.689+0000 7f4882e199c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.32.5 2024-09-14T11:36:52.853 INFO:tasks.workunit.client.0.smithi138.stderr: -31> 2024-09-14T11:36:52.689+0000 7f4882e199c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.32.6 2024-09-14T11:36:52.853 INFO:tasks.workunit.client.0.smithi138.stderr: -30> 2024-09-14T11:36:52.689+0000 7f4882e199c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.32.7 2024-09-14T11:36:52.853 INFO:tasks.workunit.client.0.smithi138.stderr: -29> 2024-09-14T11:36:52.689+0000 7f4882e199c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.32.8 2024-09-14T11:36:52.853 INFO:tasks.workunit.client.0.smithi138.stderr: -28> 2024-09-14T11:36:52.689+0000 7f4882e199c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.32.9 2024-09-14T11:36:52.853 INFO:tasks.workunit.client.0.smithi138.stderr: -27> 2024-09-14T11:36:52.689+0000 7f4882e199c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.32.10 2024-09-14T11:36:52.853 INFO:tasks.workunit.client.0.smithi138.stderr: -26> 2024-09-14T11:36:52.701+0000 7f4882e199c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.32 : hit (requested=0x17, cached=0x17) 2024-09-14T11:36:52.853 INFO:tasks.workunit.client.0.smithi138.stderr: -25> 2024-09-14T11:36:52.701+0000 7f4882e199c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.32 2024-09-14T11:36:52.854 INFO:tasks.workunit.client.0.smithi138.stderr: -24> 2024-09-14T11:36:52.701+0000 7f4882e199c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.32 info.flags=0x17 2024-09-14T11:36:52.854 INFO:tasks.workunit.client.0.smithi138.stderr: -23> 2024-09-14T11:36:52.701+0000 7f4882e199c0 10 moving default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.32 to cache LRU end 2024-09-14T11:36:52.854 INFO:tasks.workunit.client.0.smithi138.stderr: -22> 2024-09-14T11:36:52.701+0000 7f4882e199c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:36:52.854 INFO:tasks.workunit.client.0.smithi138.stderr: -21> 2024-09-14T11:36:52.701+0000 7f4882e199c0 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-commit-target-layout:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.32, ofs0, ns] 2024-09-14T11:36:52.854 INFO:tasks.workunit.client.0.smithi138.stderr: -20> 2024-09-14T11:36:52.705+0000 7f4757fff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366206 cookie 94724738090224 notifier 7254 bl.length()=931 2024-09-14T11:36:52.854 INFO:tasks.workunit.client.0.smithi138.stderr: -19> 2024-09-14T11:36:52.705+0000 7f4757fff640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.32 info.flags=0x17 2024-09-14T11:36:52.854 INFO:tasks.workunit.client.0.smithi138.stderr: -18> 2024-09-14T11:36:52.705+0000 7f4757fff640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.32 to cache LRU end 2024-09-14T11:36:52.854 INFO:tasks.workunit.client.0.smithi138.stderr: -17> 2024-09-14T11:36:52.705+0000 7f4757fff640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:36:52.854 INFO:tasks.workunit.client.0.smithi138.stderr: -16> 2024-09-14T11:36:52.705+0000 7f4882e199c0 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.32]): orig_sources= new_sources= 2024-09-14T11:36:52.854 INFO:tasks.workunit.client.0.smithi138.stderr: -15> 2024-09-14T11:36:52.705+0000 7f4882e199c0 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.32]): potential sources added=[] removed=[] 2024-09-14T11:36:52.854 INFO:tasks.workunit.client.0.smithi138.stderr: -14> 2024-09-14T11:36:52.705+0000 7f4882e199c0 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.32]): orig_dests= new_dests= 2024-09-14T11:36:52.854 INFO:tasks.workunit.client.0.smithi138.stderr: -13> 2024-09-14T11:36:52.705+0000 7f4882e199c0 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.32]): potential dests added=[] removed=[] 2024-09-14T11:36:52.854 INFO:tasks.workunit.client.0.smithi138.stderr: -12> 2024-09-14T11:36:52.709+0000 7f4882e199c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.32.0 2024-09-14T11:36:52.855 INFO:tasks.workunit.client.0.smithi138.stderr: -11> 2024-09-14T11:36:52.709+0000 7f4882e199c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.32.1 2024-09-14T11:36:52.855 INFO:tasks.workunit.client.0.smithi138.stderr: -10> 2024-09-14T11:36:52.713+0000 7f4882e199c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.32.2 2024-09-14T11:36:52.855 INFO:tasks.workunit.client.0.smithi138.stderr: -9> 2024-09-14T11:36:52.713+0000 7f4882e199c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.32.3 2024-09-14T11:36:52.855 INFO:tasks.workunit.client.0.smithi138.stderr: -8> 2024-09-14T11:36:52.713+0000 7f4882e199c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.32.4 2024-09-14T11:36:52.855 INFO:tasks.workunit.client.0.smithi138.stderr: -7> 2024-09-14T11:36:52.713+0000 7f4882e199c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.32.5 2024-09-14T11:36:52.855 INFO:tasks.workunit.client.0.smithi138.stderr: -6> 2024-09-14T11:36:52.713+0000 7f4882e199c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.32.6 2024-09-14T11:36:52.855 INFO:tasks.workunit.client.0.smithi138.stderr: -5> 2024-09-14T11:36:52.713+0000 7f4882e199c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.32.7 2024-09-14T11:36:52.855 INFO:tasks.workunit.client.0.smithi138.stderr: -4> 2024-09-14T11:36:52.713+0000 7f4882e199c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.32.8 2024-09-14T11:36:52.855 INFO:tasks.workunit.client.0.smithi138.stderr: -3> 2024-09-14T11:36:52.717+0000 7f4882e199c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.32.9 2024-09-14T11:36:52.855 INFO:tasks.workunit.client.0.smithi138.stderr: -2> 2024-09-14T11:36:52.717+0000 7f4882e199c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.32.10 2024-09-14T11:36:52.855 INFO:tasks.workunit.client.0.smithi138.stderr: -1> 2024-09-14T11:36:52.717+0000 7f4882e199c0 -1 ./src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f4882e199c0 time 2024-09-14T11:36:52.722713+0000 2024-09-14T11:36:52.855 INFO:tasks.workunit.client.0.smithi138.stderr:./src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-14T11:36:52.855 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-14T11:36:52.856 INFO:tasks.workunit.client.0.smithi138.stderr: ceph version 19.3.0-4907-ga2782315 (a2782315255a3e7d5f6cdc9eb35785187ff6ddf8) squid (dev) 2024-09-14T11:36:52.856 INFO:tasks.workunit.client.0.smithi138.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x121) [0x7f48866f32eb] 2024-09-14T11:36:52.856 INFO:tasks.workunit.client.0.smithi138.stderr: 2: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7f48866f349f] 2024-09-14T11:36:52.856 INFO:tasks.workunit.client.0.smithi138.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x5626d0323c01] 2024-09-14T11:36:52.856 INFO:tasks.workunit.client.0.smithi138.stderr: 4: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x3e7) [0x5626d03391a7] 2024-09-14T11:36:52.856 INFO:tasks.workunit.client.0.smithi138.stderr: 5: main() 2024-09-14T11:36:52.856 INFO:tasks.workunit.client.0.smithi138.stderr: 6: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7f4885559d90] 2024-09-14T11:36:52.856 INFO:tasks.workunit.client.0.smithi138.stderr: 7: __libc_start_main() 2024-09-14T11:36:52.856 INFO:tasks.workunit.client.0.smithi138.stderr: 8: _start() 2024-09-14T11:36:52.856 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-14T11:36:52.856 INFO:tasks.workunit.client.0.smithi138.stderr: 0> 2024-09-14T11:36:52.721+0000 7f4882e199c0 -1 *** Caught signal (Aborted) ** 2024-09-14T11:36:52.856 INFO:tasks.workunit.client.0.smithi138.stderr: in thread 7f4882e199c0 thread_name:radosgw-admin 2024-09-14T11:36:52.856 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-14T11:36:52.857 INFO:tasks.workunit.client.0.smithi138.stderr: ceph version 19.3.0-4907-ga2782315 (a2782315255a3e7d5f6cdc9eb35785187ff6ddf8) squid (dev) 2024-09-14T11:36:52.857 INFO:tasks.workunit.client.0.smithi138.stderr: 1: /lib/x86_64-linux-gnu/libc.so.6(+0x42520) [0x7f4885572520] 2024-09-14T11:36:52.857 INFO:tasks.workunit.client.0.smithi138.stderr: 2: pthread_kill() 2024-09-14T11:36:52.857 INFO:tasks.workunit.client.0.smithi138.stderr: 3: raise() 2024-09-14T11:36:52.857 INFO:tasks.workunit.client.0.smithi138.stderr: 4: abort() 2024-09-14T11:36:52.857 INFO:tasks.workunit.client.0.smithi138.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x17b) [0x7f48866f3345] 2024-09-14T11:36:52.857 INFO:tasks.workunit.client.0.smithi138.stderr: 6: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7f48866f349f] 2024-09-14T11:36:52.857 INFO:tasks.workunit.client.0.smithi138.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x5626d0323c01] 2024-09-14T11:36:52.857 INFO:tasks.workunit.client.0.smithi138.stderr: 8: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x3e7) [0x5626d03391a7] 2024-09-14T11:36:52.857 INFO:tasks.workunit.client.0.smithi138.stderr: 9: main() 2024-09-14T11:36:52.857 INFO:tasks.workunit.client.0.smithi138.stderr: 10: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7f4885559d90] 2024-09-14T11:36:52.857 INFO:tasks.workunit.client.0.smithi138.stderr: 11: __libc_start_main() 2024-09-14T11:36:52.857 INFO:tasks.workunit.client.0.smithi138.stderr: 12: _start() 2024-09-14T11:36:52.858 INFO:tasks.workunit.client.0.smithi138.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-14T11:36:52.858 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-14T11:36:52.858 INFO:tasks.workunit.client.0.smithi138.stderr:--- logging levels --- 2024-09-14T11:36:52.858 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 none 2024-09-14T11:36:52.858 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 1 lockdep 2024-09-14T11:36:52.858 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 1 context 2024-09-14T11:36:52.858 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 1 crush 2024-09-14T11:36:52.858 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 mds 2024-09-14T11:36:52.858 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 mds_balancer 2024-09-14T11:36:52.858 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 mds_locker 2024-09-14T11:36:52.858 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 mds_log 2024-09-14T11:36:52.858 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 mds_log_expire 2024-09-14T11:36:52.858 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 mds_migrator 2024-09-14T11:36:52.858 INFO:tasks.workunit.client.0.smithi138.stderr: 3/ 5 mds_quiesce 2024-09-14T11:36:52.859 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 1 buffer 2024-09-14T11:36:52.859 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 1 timer 2024-09-14T11:36:52.859 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 1 filer 2024-09-14T11:36:52.859 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 1 striper 2024-09-14T11:36:52.859 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 1 objecter 2024-09-14T11:36:52.859 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 rados 2024-09-14T11:36:52.859 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 rbd 2024-09-14T11:36:52.859 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 rbd_mirror 2024-09-14T11:36:52.859 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 rbd_replay 2024-09-14T11:36:52.859 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 rbd_pwl 2024-09-14T11:36:52.859 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 journaler 2024-09-14T11:36:52.859 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 objectcacher 2024-09-14T11:36:52.859 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 immutable_obj_cache 2024-09-14T11:36:52.860 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 client 2024-09-14T11:36:52.860 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 osd 2024-09-14T11:36:52.860 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 optracker 2024-09-14T11:36:52.860 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 objclass 2024-09-14T11:36:52.860 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 3 filestore 2024-09-14T11:36:52.860 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 3 journal 2024-09-14T11:36:52.860 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 0 ms 2024-09-14T11:36:52.860 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 mon 2024-09-14T11:36:52.860 INFO:tasks.workunit.client.0.smithi138.stderr: 0/10 monc 2024-09-14T11:36:52.860 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 paxos 2024-09-14T11:36:52.860 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 tp 2024-09-14T11:36:52.860 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 auth 2024-09-14T11:36:52.860 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 crypto 2024-09-14T11:36:52.860 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 1 finisher 2024-09-14T11:36:52.861 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 1 reserver 2024-09-14T11:36:52.861 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 heartbeatmap 2024-09-14T11:36:52.861 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 perfcounter 2024-09-14T11:36:52.861 INFO:tasks.workunit.client.0.smithi138.stderr: 20/20 rgw 2024-09-14T11:36:52.861 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 rgw_sync 2024-09-14T11:36:52.861 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 rgw_datacache 2024-09-14T11:36:52.861 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 rgw_access 2024-09-14T11:36:52.861 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 rgw_dbstore 2024-09-14T11:36:52.861 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 rgw_flight 2024-09-14T11:36:52.861 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 rgw_lifecycle 2024-09-14T11:36:52.861 INFO:tasks.workunit.client.0.smithi138.stderr: 20/20 rgw_notification 2024-09-14T11:36:52.861 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 javaclient 2024-09-14T11:36:52.861 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 asok 2024-09-14T11:36:52.862 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 1 throttle 2024-09-14T11:36:52.862 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 0 refs 2024-09-14T11:36:52.862 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 compressor 2024-09-14T11:36:52.862 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 bluestore 2024-09-14T11:36:52.862 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 bluefs 2024-09-14T11:36:52.862 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 3 bdev 2024-09-14T11:36:52.862 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 kstore 2024-09-14T11:36:52.862 INFO:tasks.workunit.client.0.smithi138.stderr: 4/ 5 rocksdb 2024-09-14T11:36:52.862 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 fuse 2024-09-14T11:36:52.862 INFO:tasks.workunit.client.0.smithi138.stderr: 2/ 5 mgr 2024-09-14T11:36:52.862 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 mgrc 2024-09-14T11:36:52.862 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 dpdk 2024-09-14T11:36:52.862 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 eventtrace 2024-09-14T11:36:52.862 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 prioritycache 2024-09-14T11:36:52.863 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 test 2024-09-14T11:36:52.863 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 cephfs_mirror 2024-09-14T11:36:52.863 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 cephsqlite 2024-09-14T11:36:52.863 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 crimson_interrupt 2024-09-14T11:36:52.863 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 seastore 2024-09-14T11:36:52.863 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 seastore_onode 2024-09-14T11:36:52.863 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 seastore_odata 2024-09-14T11:36:52.863 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 seastore_omap 2024-09-14T11:36:52.863 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 seastore_tm 2024-09-14T11:36:52.863 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 seastore_t 2024-09-14T11:36:52.863 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 seastore_cleaner 2024-09-14T11:36:52.863 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 seastore_epm 2024-09-14T11:36:52.863 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 seastore_lba 2024-09-14T11:36:52.863 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 seastore_fixedkv_tree 2024-09-14T11:36:52.863 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 seastore_cache 2024-09-14T11:36:52.864 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 seastore_journal 2024-09-14T11:36:52.864 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 seastore_device 2024-09-14T11:36:52.864 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 seastore_backref 2024-09-14T11:36:52.864 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 alienstore 2024-09-14T11:36:52.864 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 mclock 2024-09-14T11:36:52.864 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 cyanstore 2024-09-14T11:36:52.864 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 ceph_exporter 2024-09-14T11:36:52.864 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 memstore 2024-09-14T11:36:52.864 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 trace 2024-09-14T11:36:52.864 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 ceph_dedup 2024-09-14T11:36:52.864 INFO:tasks.workunit.client.0.smithi138.stderr: -2/-2 (syslog threshold) 2024-09-14T11:36:52.864 INFO:tasks.workunit.client.0.smithi138.stderr: 99/99 (stderr threshold) 2024-09-14T11:36:52.864 INFO:tasks.workunit.client.0.smithi138.stderr:--- pthread ID / name mapping for recent threads --- 2024-09-14T11:36:52.864 INFO:tasks.workunit.client.0.smithi138.stderr: 7f472f7fe640 / http_manager 2024-09-14T11:36:52.865 INFO:tasks.workunit.client.0.smithi138.stderr: 7f47367e4640 / http_manager 2024-09-14T11:36:52.865 INFO:tasks.workunit.client.0.smithi138.stderr: 7f47377e6640 / rgw_dt_lg_renew 2024-09-14T11:36:52.865 INFO:tasks.workunit.client.0.smithi138.stderr: 7f47567fc640 / ms_dispatch 2024-09-14T11:36:52.865 INFO:tasks.workunit.client.0.smithi138.stderr: 7f47577fe640 / io_context_pool 2024-09-14T11:36:52.865 INFO:tasks.workunit.client.0.smithi138.stderr: 7f4757fff640 / io_context_pool 2024-09-14T11:36:52.865 INFO:tasks.workunit.client.0.smithi138.stderr: 7f47667fc640 / ms_dispatch 2024-09-14T11:36:52.865 INFO:tasks.workunit.client.0.smithi138.stderr: 7f476d602640 / ms_dispatch 2024-09-14T11:36:52.865 INFO:tasks.workunit.client.0.smithi138.stderr: 7f476ee05640 / io_context_pool 2024-09-14T11:36:52.865 INFO:tasks.workunit.client.0.smithi138.stderr: 7f487b7fe640 / io_context_pool 2024-09-14T11:36:52.865 INFO:tasks.workunit.client.0.smithi138.stderr: 7f487bfff640 / msgr-worker-2 2024-09-14T11:36:52.865 INFO:tasks.workunit.client.0.smithi138.stderr: 7f488091f640 / msgr-worker-1 2024-09-14T11:36:52.865 INFO:tasks.workunit.client.0.smithi138.stderr: 7f4881120640 / msgr-worker-0 2024-09-14T11:36:52.865 INFO:tasks.workunit.client.0.smithi138.stderr: 7f4882e199c0 / radosgw-admin 2024-09-14T11:36:52.866 INFO:tasks.workunit.client.0.smithi138.stderr: max_recent 500 2024-09-14T11:36:52.866 INFO:tasks.workunit.client.0.smithi138.stderr: max_new 1000 2024-09-14T11:36:52.866 INFO:tasks.workunit.client.0.smithi138.stderr: log_file /var/lib/ceph/crash/2024-09-14T11:36:52.725461Z_f77b4621-a447-489e-9e51-489cfabf73a5/log 2024-09-14T11:36:52.866 INFO:tasks.workunit.client.0.smithi138.stderr:--- end dump of recent events --- 2024-09-14T11:36:52.866 INFO:tasks.workunit.client.0.smithi138.stderr:Aborted 2024-09-14T11:36:52.866 INFO:tasks.workunit.client.0.smithi138.stderr:radosgw-admin bucket stats --bucket abort-at-commit-target-layout 2024-09-14T11:36:52.867 INFO:tasks.workunit.client.0.smithi138.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:36:52.867 INFO:tasks.workunit.client.0.smithi138.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:36:52.868 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:52.805+0000 7f442ae2a9c0 20 rados->read ofs=0 len=0 2024-09-14T11:36:52.868 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:52.809+0000 7f442ae2a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:36:52.868 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:52.809+0000 7f442ae2a9c0 20 realm 2024-09-14T11:36:52.868 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:52.809+0000 7f442ae2a9c0 20 rados->read ofs=0 len=0 2024-09-14T11:36:52.868 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:52.809+0000 7f442ae2a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:36:52.868 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:52.809+0000 7f442ae2a9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:36:52.868 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:52.809+0000 7f442ae2a9c0 20 rados->read ofs=0 len=0 2024-09-14T11:36:52.868 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:52.809+0000 7f442ae2a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:36:52.868 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:52.809+0000 7f442ae2a9c0 20 rados->read ofs=0 len=0 2024-09-14T11:36:52.868 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:52.809+0000 7f442ae2a9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:36:52.868 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:52.809+0000 7f442ae2a9c0 20 rados->read ofs=0 len=0 2024-09-14T11:36:52.868 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:52.813+0000 7f442ae2a9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:36:52.868 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:52.813+0000 7f442ae2a9c0 20 searching for the correct realm 2024-09-14T11:36:52.868 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:52.817+0000 7f4429131640 0 -- 172.21.15.138:0/1191260108 >> [v2:172.21.15.154:6824/416768175,v1:172.21.15.154:6825/416768175] conn(0x7f4420133430 msgr2=0x7f44200fc350 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:36:52.869 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:52.821+0000 7f442812f640 0 -- 172.21.15.138:0/1191260108 >> [v2:172.21.15.138:6816/326481658,v1:172.21.15.138:6817/326481658] conn(0x7f44200c1ba0 msgr2=0x7f44200fe900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:36:53.037 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:53.037+0000 7f442ae2a9c0 20 RGWRados::pool_iterate: got zone_info.d9e72d30-c60b-4d0d-9267-fdc36392d5ad 2024-09-14T11:36:53.037 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:53.037+0000 7f442ae2a9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:36:53.037 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:53.037+0000 7f442ae2a9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:36:53.037 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:53.037+0000 7f442ae2a9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:36:53.037 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:53.037+0000 7f442ae2a9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:36:53.037 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:53.037+0000 7f442ae2a9c0 20 RGWRados::pool_iterate: got zonegroup_info.65ab941b-da8c-4160-94fb-3672b069d44f 2024-09-14T11:36:53.037 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:53.037+0000 7f442ae2a9c0 20 rados->read ofs=0 len=0 2024-09-14T11:36:53.038 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:53.037+0000 7f442ae2a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:36:53.038 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:53.037+0000 7f442ae2a9c0 20 rados->read ofs=0 len=0 2024-09-14T11:36:53.039 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:53.037+0000 7f442ae2a9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:36:53.039 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:53.037+0000 7f442ae2a9c0 20 rados->read ofs=0 len=0 2024-09-14T11:36:53.039 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:53.041+0000 7f442ae2a9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:36:53.039 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:53.041+0000 7f442ae2a9c0 20 zone default found 2024-09-14T11:36:53.040 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:53.041+0000 7f442ae2a9c0 4 Realm: () 2024-09-14T11:36:53.040 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:53.041+0000 7f442ae2a9c0 4 ZoneGroup: default (65ab941b-da8c-4160-94fb-3672b069d44f) 2024-09-14T11:36:53.040 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:53.041+0000 7f442ae2a9c0 4 Zone: default (d9e72d30-c60b-4d0d-9267-fdc36392d5ad) 2024-09-14T11:36:53.040 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:53.041+0000 7f442ae2a9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:36:53.040 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:53.041+0000 7f442ae2a9c0 20 zonegroup default 2024-09-14T11:36:53.040 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:53.041+0000 7f442ae2a9c0 20 rados->read ofs=0 len=0 2024-09-14T11:36:53.040 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:53.041+0000 7f442ae2a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:36:53.041 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:53.041+0000 7f442ae2a9c0 20 rados->read ofs=0 len=0 2024-09-14T11:36:53.041 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:53.041+0000 7f442ae2a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:36:53.041 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:53.041+0000 7f442ae2a9c0 20 rados->read ofs=0 len=0 2024-09-14T11:36:53.042 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:53.041+0000 7f442ae2a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:36:53.043 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:53.041+0000 7f442ae2a9c0 20 started sync module instance, tier type = 2024-09-14T11:36:53.043 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:53.041+0000 7f442ae2a9c0 20 started zone id=d9e72d30-c60b-4d0d-9267-fdc36392d5ad (name=default) with tier type = 2024-09-14T11:36:53.067 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:53.065+0000 7f442ae2a9c0 20 add_watcher() i=0 2024-09-14T11:36:53.067 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:53.065+0000 7f442ae2a9c0 20 add_watcher() i=1 2024-09-14T11:36:53.067 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:53.065+0000 7f442ae2a9c0 20 add_watcher() i=2 2024-09-14T11:36:53.067 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:53.065+0000 7f442ae2a9c0 20 add_watcher() i=3 2024-09-14T11:36:53.067 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:53.065+0000 7f442ae2a9c0 20 add_watcher() i=4 2024-09-14T11:36:53.067 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:53.065+0000 7f442ae2a9c0 20 add_watcher() i=5 2024-09-14T11:36:53.067 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:53.065+0000 7f442ae2a9c0 20 add_watcher() i=6 2024-09-14T11:36:53.069 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:53.069+0000 7f442ae2a9c0 20 add_watcher() i=7 2024-09-14T11:36:53.069 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:53.069+0000 7f442ae2a9c0 2 all 8 watchers are set, enabling cache 2024-09-14T11:36:53.073 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:53.073+0000 7f42defe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:36:53.074 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:53.073+0000 7f442ae2a9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:36:53.074 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:53.073+0000 7f442ae2a9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:36:53.074 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:53.073+0000 7f442ae2a9c0 5 note: GC not initialized 2024-09-14T11:36:53.075 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:53.073+0000 7f42ddfe3640 20 reqs_thread_entry: start 2024-09-14T11:36:53.075 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:53.073+0000 7f442ae2a9c0 20 init_complete bucket index max shards: 11 2024-09-14T11:36:53.076 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:53.077+0000 7f442ae2a9c0 20 Filter name: none 2024-09-14T11:36:53.076 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:53.077+0000 7f424f7fe640 20 reqs_thread_entry: start 2024-09-14T11:36:53.076 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:53.077+0000 7f442ae2a9c0 20 rados->read ofs=0 len=0 2024-09-14T11:36:53.076 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:53.077+0000 7f442ae2a9c0 20 rados_obj.operate() r=0 bl.length=197 2024-09-14T11:36:53.076 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:53.077+0000 7f442ae2a9c0 20 rados->read ofs=0 len=0 2024-09-14T11:36:53.078 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:53.077+0000 7f442ae2a9c0 20 rados_obj.operate() r=0 bl.length=451 2024-09-14T11:36:53.078 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:53.077+0000 7f442ae2a9c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:36:53.078 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:53.077+0000 7f442ae2a9c0 20 rados->read ofs=0 len=0 2024-09-14T11:36:53.078 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:53.077+0000 7f442ae2a9c0 20 rados_obj.operate() r=0 bl.length=197 2024-09-14T11:36:53.079 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:53.077+0000 7f442ae2a9c0 20 rados->read ofs=0 len=0 2024-09-14T11:36:53.079 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:53.081+0000 7f442ae2a9c0 20 rados_obj.operate() r=0 bl.length=451 2024-09-14T11:36:53.079 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:53.081+0000 7f442ae2a9c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:36:53.082 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:53.081+0000 7f42defe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:36:53.088 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:53.089+0000 7f442ae2a9c0 20 remove_watcher() i=0 2024-09-14T11:36:53.088 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:53.089+0000 7f442ae2a9c0 2 removed watcher, disabling cache 2024-09-14T11:36:53.090 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:53.089+0000 7f442ae2a9c0 20 remove_watcher() i=1 2024-09-14T11:36:53.093 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:53.093+0000 7f442ae2a9c0 20 remove_watcher() i=2 2024-09-14T11:36:53.095 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:53.093+0000 7f442ae2a9c0 20 remove_watcher() i=3 2024-09-14T11:36:53.097 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:53.097+0000 7f442ae2a9c0 20 remove_watcher() i=4 2024-09-14T11:36:53.098 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:53.097+0000 7f442ae2a9c0 20 remove_watcher() i=5 2024-09-14T11:36:53.101 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:53.101+0000 7f442ae2a9c0 20 remove_watcher() i=6 2024-09-14T11:36:53.102 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:36:53.101+0000 7f442ae2a9c0 20 remove_watcher() i=7 2024-09-14T11:36:53.115 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-14T11:36:53.116 INFO:tasks.workunit.client.0.smithi138.stderr:BUCKET_STATS: 2024-09-14T11:36:53.116 INFO:tasks.workunit.client.0.smithi138.stderr:bucket: abort-at-commit-target-layout id: d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.32 num_objects: 20 size_kb: 1 num_shards: 11 2024-09-14T11:36:53.116 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-14T11:36:53.117 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:36:53.117 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-14T11:37:23.430 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:37:23.431 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-14T11:37:23.521 INFO:tasks.workunit.client.0.smithi138.stderr:radosgw-admin bucket reshard --bucket abort-at-commit-target-layout --num-shards 12 --rgw-reshard-bucket-lock-duration 30 2024-09-14T11:37:23.557 INFO:tasks.workunit.client.0.smithi138.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:37:23.557 INFO:tasks.workunit.client.0.smithi138.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:37:23.785 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:37:23.788+0000 7fe462f7f640 0 --2- 172.21.15.138:0/1395861822 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x55ca3637a5a0 0x55ca364fddf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request get_initial_auth_request returned -2 2024-09-14T11:37:23.812 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:37:23.816+0000 7fe4654799c0 20 rados->read ofs=0 len=0 2024-09-14T11:37:23.814 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:37:23.816+0000 7fe4654799c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:37:23.815 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:37:23.816+0000 7fe4654799c0 20 realm 2024-09-14T11:37:23.815 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:37:23.816+0000 7fe4654799c0 20 rados->read ofs=0 len=0 2024-09-14T11:37:23.815 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:37:23.816+0000 7fe4654799c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:37:23.815 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:37:23.816+0000 7fe4654799c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:37:23.815 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:37:23.816+0000 7fe4654799c0 20 rados->read ofs=0 len=0 2024-09-14T11:37:23.815 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:37:23.816+0000 7fe4654799c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:37:23.815 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:37:23.816+0000 7fe4654799c0 20 rados->read ofs=0 len=0 2024-09-14T11:37:23.816 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:37:23.820+0000 7fe4654799c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:37:23.816 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:37:23.820+0000 7fe4654799c0 20 rados->read ofs=0 len=0 2024-09-14T11:37:23.818 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:37:23.820+0000 7fe4654799c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:37:23.818 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:37:23.820+0000 7fe4654799c0 20 searching for the correct realm 2024-09-14T11:37:23.819 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:37:23.820+0000 7fe46277e640 0 -- 172.21.15.138:0/1181913006 >> [v2:172.21.15.154:6808/1468088432,v1:172.21.15.154:6809/1468088432] conn(0x7fe45400e040 msgr2=0x7fe454066cb0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:37:24.031 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:37:24.032+0000 7fe463780640 0 -- 172.21.15.138:0/1181913006 >> [v2:172.21.15.138:6824/2633984942,v1:172.21.15.138:6825/2633984942] conn(0x55ca365b6bd0 msgr2=0x55ca365b8fc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:37:24.048 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:37:24.052+0000 7fe4654799c0 20 RGWRados::pool_iterate: got zone_info.d9e72d30-c60b-4d0d-9267-fdc36392d5ad 2024-09-14T11:37:24.048 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:37:24.052+0000 7fe4654799c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:37:24.048 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:37:24.052+0000 7fe4654799c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:37:24.048 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:37:24.052+0000 7fe4654799c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:37:24.048 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:37:24.052+0000 7fe4654799c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:37:24.048 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:37:24.052+0000 7fe4654799c0 20 RGWRados::pool_iterate: got zonegroup_info.65ab941b-da8c-4160-94fb-3672b069d44f 2024-09-14T11:37:24.048 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:37:24.052+0000 7fe4654799c0 20 rados->read ofs=0 len=0 2024-09-14T11:37:24.048 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:37:24.052+0000 7fe4654799c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:37:24.049 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:37:24.052+0000 7fe4654799c0 20 rados->read ofs=0 len=0 2024-09-14T11:37:24.049 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:37:24.052+0000 7fe4654799c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:37:24.049 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:37:24.052+0000 7fe4654799c0 20 rados->read ofs=0 len=0 2024-09-14T11:37:24.050 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:37:24.052+0000 7fe4654799c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:37:24.050 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:37:24.052+0000 7fe4654799c0 20 zone default found 2024-09-14T11:37:24.050 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:37:24.052+0000 7fe4654799c0 4 Realm: () 2024-09-14T11:37:24.050 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:37:24.052+0000 7fe4654799c0 4 ZoneGroup: default (65ab941b-da8c-4160-94fb-3672b069d44f) 2024-09-14T11:37:24.050 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:37:24.052+0000 7fe4654799c0 4 Zone: default (d9e72d30-c60b-4d0d-9267-fdc36392d5ad) 2024-09-14T11:37:24.050 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:37:24.052+0000 7fe4654799c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:37:24.050 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:37:24.052+0000 7fe4654799c0 20 zonegroup default 2024-09-14T11:37:24.050 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:37:24.052+0000 7fe4654799c0 20 rados->read ofs=0 len=0 2024-09-14T11:37:24.051 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:37:24.052+0000 7fe4654799c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:37:24.051 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:37:24.052+0000 7fe4654799c0 20 rados->read ofs=0 len=0 2024-09-14T11:37:24.051 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:37:24.056+0000 7fe4654799c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:37:24.052 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:37:24.056+0000 7fe4654799c0 20 rados->read ofs=0 len=0 2024-09-14T11:37:24.052 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:37:24.056+0000 7fe4654799c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:37:24.053 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:37:24.056+0000 7fe4654799c0 20 started sync module instance, tier type = 2024-09-14T11:37:24.053 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:37:24.056+0000 7fe4654799c0 20 started zone id=d9e72d30-c60b-4d0d-9267-fdc36392d5ad (name=default) with tier type = 2024-09-14T11:37:24.075 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:37:24.076+0000 7fe4654799c0 20 add_watcher() i=0 2024-09-14T11:37:24.075 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:37:24.076+0000 7fe4654799c0 20 add_watcher() i=1 2024-09-14T11:37:24.075 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:37:24.076+0000 7fe4654799c0 20 add_watcher() i=2 2024-09-14T11:37:24.075 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:37:24.076+0000 7fe4654799c0 20 add_watcher() i=3 2024-09-14T11:37:24.075 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:37:24.076+0000 7fe4654799c0 20 add_watcher() i=4 2024-09-14T11:37:24.075 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:37:24.076+0000 7fe4654799c0 20 add_watcher() i=5 2024-09-14T11:37:24.076 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:37:24.076+0000 7fe4654799c0 20 add_watcher() i=6 2024-09-14T11:37:24.077 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:37:24.080+0000 7fe4654799c0 20 add_watcher() i=7 2024-09-14T11:37:24.077 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:37:24.080+0000 7fe4654799c0 2 all 8 watchers are set, enabling cache 2024-09-14T11:37:24.082 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:37:24.084+0000 7fe3197e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:37:24.083 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:37:24.084+0000 7fe4654799c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:37:24.083 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:37:24.084+0000 7fe4654799c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:37:24.083 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:37:24.084+0000 7fe4654799c0 5 note: GC not initialized 2024-09-14T11:37:24.083 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:37:24.084+0000 7fe293fff640 20 reqs_thread_entry: start 2024-09-14T11:37:24.083 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:37:24.088+0000 7fe4654799c0 20 init_complete bucket index max shards: 11 2024-09-14T11:37:24.084 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:37:24.088+0000 7fe4654799c0 20 Filter name: none 2024-09-14T11:37:24.084 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:37:24.088+0000 7fe291ffb640 20 reqs_thread_entry: start 2024-09-14T11:37:24.084 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:37:24.088+0000 7fe4654799c0 10 cache get: name=default.rgw.meta+root+abort-at-commit-target-layout : miss 2024-09-14T11:37:24.084 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:37:24.088+0000 7fe4654799c0 20 rados->read ofs=0 len=0 2024-09-14T11:37:24.085 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:37:24.088+0000 7fe4654799c0 20 rados_obj.operate() r=0 bl.length=197 2024-09-14T11:37:24.085 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:37:24.088+0000 7fe4654799c0 10 cache put: name=default.rgw.meta+root+abort-at-commit-target-layout info.flags=0x11 2024-09-14T11:37:24.085 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:37:24.088+0000 7fe4654799c0 10 adding default.rgw.meta+root+abort-at-commit-target-layout to cache LRU end 2024-09-14T11:37:24.085 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:37:24.088+0000 7fe4654799c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.32 : miss 2024-09-14T11:37:24.085 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:37:24.088+0000 7fe4654799c0 20 rados->read ofs=0 len=0 2024-09-14T11:37:24.086 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:37:24.088+0000 7fe4654799c0 20 rados_obj.operate() r=0 bl.length=419 2024-09-14T11:37:24.086 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:37:24.088+0000 7fe4654799c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.32 info.flags=0x17 2024-09-14T11:37:24.086 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:37:24.088+0000 7fe4654799c0 10 adding default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.32 to cache LRU end 2024-09-14T11:37:24.086 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:37:24.088+0000 7fe4654799c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:37:24.086 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:37:24.088+0000 7fe4654799c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:37:24.086 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:37:24.088+0000 7fe4654799c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.32 2024-09-14T11:37:24.097 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:37:24.100+0000 7fe4654799c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.32 info.flags=0x17 2024-09-14T11:37:24.097 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:37:24.100+0000 7fe4654799c0 10 moving default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.32 to cache LRU end 2024-09-14T11:37:24.097 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:37:24.100+0000 7fe4654799c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:37:24.097 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:37:24.100+0000 7fe4654799c0 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-commit-target-layout:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.32, ofs0, ns] 2024-09-14T11:37:24.098 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:37:24.100+0000 7fe345ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366208 cookie 94326983749680 notifier 7287 bl.length()=931 2024-09-14T11:37:24.098 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:37:24.100+0000 7fe345ffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.32 info.flags=0x17 2024-09-14T11:37:24.098 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:37:24.100+0000 7fe345ffb640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.32 to cache LRU end 2024-09-14T11:37:24.098 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:37:24.100+0000 7fe345ffb640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:37:24.100 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:37:24.104+0000 7fe4654799c0 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.32]): orig_sources= new_sources= 2024-09-14T11:37:24.100 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:37:24.104+0000 7fe4654799c0 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.32]): potential sources added=[] removed=[] 2024-09-14T11:37:24.100 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:37:24.104+0000 7fe4654799c0 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.32]): orig_dests= new_dests= 2024-09-14T11:37:24.100 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:37:24.104+0000 7fe4654799c0 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.32]): potential dests added=[] removed=[] 2024-09-14T11:37:24.112 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:37:24.116+0000 7fe4654799c0 10 bucket_obj is .dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.32.1.0 2024-09-14T11:37:24.112 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:37:24.116+0000 7fe4654799c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.32.1.0 2024-09-14T11:37:24.112 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:37:24.116+0000 7fe4654799c0 10 bucket_obj is .dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.32.1.1 2024-09-14T11:37:24.113 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:37:24.116+0000 7fe4654799c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.32.1.1 2024-09-14T11:37:24.113 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:37:24.116+0000 7fe4654799c0 10 bucket_obj is .dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.32.1.2 2024-09-14T11:37:24.113 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:37:24.116+0000 7fe4654799c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.32.1.2 2024-09-14T11:37:24.113 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:37:24.116+0000 7fe4654799c0 10 bucket_obj is .dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.32.1.3 2024-09-14T11:37:24.113 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:37:24.116+0000 7fe4654799c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.32.1.3 2024-09-14T11:37:24.113 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:37:24.116+0000 7fe4654799c0 10 bucket_obj is .dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.32.1.4 2024-09-14T11:37:24.113 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:37:24.116+0000 7fe4654799c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.32.1.4 2024-09-14T11:37:24.113 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:37:24.116+0000 7fe4654799c0 10 bucket_obj is .dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.32.1.5 2024-09-14T11:37:24.113 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:37:24.116+0000 7fe4654799c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.32.1.5 2024-09-14T11:37:24.113 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:37:24.116+0000 7fe4654799c0 10 bucket_obj is .dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.32.1.6 2024-09-14T11:37:24.113 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:37:24.116+0000 7fe4654799c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.32.1.6 2024-09-14T11:37:24.113 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:37:24.116+0000 7fe4654799c0 10 bucket_obj is .dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.32.1.7 2024-09-14T11:37:24.113 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:37:24.116+0000 7fe4654799c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.32.1.7 2024-09-14T11:37:24.113 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:37:24.116+0000 7fe4654799c0 10 bucket_obj is .dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.32.1.8 2024-09-14T11:37:24.114 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:37:24.116+0000 7fe4654799c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.32.1.8 2024-09-14T11:37:24.114 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:37:24.116+0000 7fe4654799c0 10 bucket_obj is .dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.32.1.9 2024-09-14T11:37:24.114 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:37:24.116+0000 7fe4654799c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.32.1.9 2024-09-14T11:37:24.114 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:37:24.116+0000 7fe4654799c0 10 bucket_obj is .dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.32.1.10 2024-09-14T11:37:24.114 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:37:24.116+0000 7fe4654799c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.32.1.10 2024-09-14T11:37:24.114 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:37:24.116+0000 7fe4654799c0 10 bucket_obj is .dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.32.1.11 2024-09-14T11:37:24.114 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:37:24.116+0000 7fe4654799c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.32.1.11 2024-09-14T11:37:24.114 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:37:24.116+0000 7fe4654799c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.32.0 2024-09-14T11:37:24.115 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:37:24.116+0000 7fe4654799c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.32.1 2024-09-14T11:37:24.115 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:37:24.116+0000 7fe4654799c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.32.2 2024-09-14T11:37:24.115 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:37:24.116+0000 7fe4654799c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.32.3 2024-09-14T11:37:24.115 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:37:24.120+0000 7fe4654799c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.32.4 2024-09-14T11:37:24.116 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:37:24.120+0000 7fe4654799c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.32.5 2024-09-14T11:37:24.117 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:37:24.120+0000 7fe4654799c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.32.6 2024-09-14T11:37:24.117 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:37:24.120+0000 7fe4654799c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.32.7 2024-09-14T11:37:24.118 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:37:24.120+0000 7fe4654799c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.32.8 2024-09-14T11:37:24.120 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:37:24.124+0000 7fe4654799c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.32.9 2024-09-14T11:37:24.121 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:37:24.124+0000 7fe4654799c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.32.10 2024-09-14T11:37:24.127 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:37:24.128+0000 7fe4654799c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.32 : hit (requested=0x17, cached=0x17) 2024-09-14T11:37:24.127 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:37:24.128+0000 7fe4654799c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.32 2024-09-14T11:37:24.130 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:37:24.132+0000 7fe4654799c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.32 info.flags=0x17 2024-09-14T11:37:24.130 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:37:24.132+0000 7fe4654799c0 10 moving default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.32 to cache LRU end 2024-09-14T11:37:24.131 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:37:24.132+0000 7fe4654799c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:37:24.131 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:37:24.132+0000 7fe4654799c0 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-commit-target-layout:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.32, ofs0, ns] 2024-09-14T11:37:24.131 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:37:24.132+0000 7fe3467fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366209 cookie 94326983749680 notifier 7287 bl.length()=931 2024-09-14T11:37:24.131 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:37:24.132+0000 7fe3467fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.32 info.flags=0x17 2024-09-14T11:37:24.131 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:37:24.132+0000 7fe3467fc640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.32 to cache LRU end 2024-09-14T11:37:24.131 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:37:24.132+0000 7fe3467fc640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:37:24.134 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:37:24.136+0000 7fe4654799c0 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.32]): orig_sources= new_sources= 2024-09-14T11:37:24.134 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:37:24.136+0000 7fe4654799c0 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.32]): potential sources added=[] removed=[] 2024-09-14T11:37:24.134 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:37:24.136+0000 7fe4654799c0 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.32]): orig_dests= new_dests= 2024-09-14T11:37:24.134 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:37:24.136+0000 7fe4654799c0 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.32]): potential dests added=[] removed=[] 2024-09-14T11:37:24.139 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:37:24.140+0000 7fe4654799c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.32.0 2024-09-14T11:37:24.139 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:37:24.144+0000 7fe4654799c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.32.1 2024-09-14T11:37:24.140 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:37:24.144+0000 7fe4654799c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.32.2 2024-09-14T11:37:24.141 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:37:24.144+0000 7fe4654799c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.32.3 2024-09-14T11:37:24.141 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:37:24.144+0000 7fe4654799c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.32.4 2024-09-14T11:37:24.142 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:37:24.144+0000 7fe4654799c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.32.5 2024-09-14T11:37:24.142 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:37:24.144+0000 7fe4654799c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.32.6 2024-09-14T11:37:24.143 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:37:24.144+0000 7fe4654799c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.32.7 2024-09-14T11:37:24.143 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:37:24.148+0000 7fe4654799c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.32.8 2024-09-14T11:37:24.144 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:37:24.148+0000 7fe4654799c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.32.9 2024-09-14T11:37:24.145 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:37:24.148+0000 7fe4654799c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.32.10 2024-09-14T11:37:24.145 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:37:24.148+0000 7fe4654799c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.32 : hit (requested=0x17, cached=0x17) 2024-09-14T11:37:24.146 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:37:24.148+0000 7fe4654799c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.32 2024-09-14T11:37:24.149 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:37:24.152+0000 7fe4654799c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.32 info.flags=0x17 2024-09-14T11:37:24.149 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:37:24.152+0000 7fe4654799c0 10 moving default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.32 to cache LRU end 2024-09-14T11:37:24.150 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:37:24.152+0000 7fe4654799c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:37:24.150 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:37:24.152+0000 7fe4654799c0 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-commit-target-layout:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.32, ofs0, ns] 2024-09-14T11:37:24.150 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:37:24.152+0000 7fe345ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366210 cookie 94326983749680 notifier 7287 bl.length()=899 2024-09-14T11:37:24.150 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:37:24.152+0000 7fe345ffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.32 info.flags=0x17 2024-09-14T11:37:24.150 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:37:24.152+0000 7fe345ffb640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.32 to cache LRU end 2024-09-14T11:37:24.150 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:37:24.152+0000 7fe345ffb640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:37:24.153 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:37:24.156+0000 7fe4654799c0 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.32]): orig_sources= new_sources= 2024-09-14T11:37:24.153 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:37:24.156+0000 7fe4654799c0 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.32]): potential sources added=[] removed=[] 2024-09-14T11:37:24.153 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:37:24.156+0000 7fe4654799c0 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.32]): orig_dests= new_dests= 2024-09-14T11:37:24.153 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:37:24.156+0000 7fe4654799c0 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.32]): potential dests added=[] removed=[] 2024-09-14T11:37:24.157 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:37:24.160+0000 7fe4654799c0 1 execute INFO: reshard of bucket "abort-at-commit-target-layout" from 11 shards to 12 shards completed successfully 2024-09-14T11:37:24.160 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:37:24.164+0000 7fe3197e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:37:24.165 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:37:24.168+0000 7fe4654799c0 20 remove_watcher() i=0 2024-09-14T11:37:24.165 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:37:24.168+0000 7fe4654799c0 2 removed watcher, disabling cache 2024-09-14T11:37:24.168 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:37:24.172+0000 7fe4654799c0 20 remove_watcher() i=1 2024-09-14T11:37:24.170 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:37:24.172+0000 7fe4654799c0 20 remove_watcher() i=2 2024-09-14T11:37:24.172 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:37:24.176+0000 7fe4654799c0 20 remove_watcher() i=3 2024-09-14T11:37:24.174 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:37:24.176+0000 7fe4654799c0 20 remove_watcher() i=4 2024-09-14T11:37:24.176 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:37:24.180+0000 7fe4654799c0 20 remove_watcher() i=5 2024-09-14T11:37:24.177 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:37:24.180+0000 7fe4654799c0 20 remove_watcher() i=6 2024-09-14T11:37:24.178 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:37:24.180+0000 7fe4654799c0 20 remove_watcher() i=7 2024-09-14T11:37:24.192 INFO:tasks.workunit.client.0.smithi138.stderr:radosgw-admin bucket stats --bucket abort-at-commit-target-layout 2024-09-14T11:37:24.218 INFO:tasks.workunit.client.0.smithi138.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:37:24.219 INFO:tasks.workunit.client.0.smithi138.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:37:24.263 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:37:24.268+0000 7f45a71fd9c0 20 rados->read ofs=0 len=0 2024-09-14T11:37:24.265 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:37:24.268+0000 7f45a71fd9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:37:24.265 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:37:24.268+0000 7f45a71fd9c0 20 realm 2024-09-14T11:37:24.265 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:37:24.268+0000 7f45a71fd9c0 20 rados->read ofs=0 len=0 2024-09-14T11:37:24.266 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:37:24.268+0000 7f45a71fd9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:37:24.266 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:37:24.268+0000 7f45a71fd9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:37:24.266 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:37:24.268+0000 7f45a71fd9c0 20 rados->read ofs=0 len=0 2024-09-14T11:37:24.266 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:37:24.268+0000 7f45a71fd9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:37:24.266 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:37:24.268+0000 7f45a71fd9c0 20 rados->read ofs=0 len=0 2024-09-14T11:37:24.268 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:37:24.272+0000 7f45a71fd9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:37:24.268 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:37:24.272+0000 7f45a71fd9c0 20 rados->read ofs=0 len=0 2024-09-14T11:37:24.269 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:37:24.272+0000 7f45a71fd9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:37:24.269 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:37:24.272+0000 7f45a71fd9c0 20 searching for the correct realm 2024-09-14T11:37:24.273 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:37:24.276+0000 7f45a5504640 0 -- 172.21.15.138:0/1402986889 >> [v2:172.21.15.154:6824/416768175,v1:172.21.15.154:6825/416768175] conn(0x7f45a00d8030 msgr2=0x7f45a00fcbe0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:37:24.279 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:37:24.280+0000 7f459ffff640 0 -- 172.21.15.138:0/1402986889 >> [v2:172.21.15.138:6816/326481658,v1:172.21.15.138:6817/326481658] conn(0x7f45a0107360 msgr2=0x7f45a0102210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:37:24.494 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:37:24.496+0000 7f45a71fd9c0 20 RGWRados::pool_iterate: got zone_info.d9e72d30-c60b-4d0d-9267-fdc36392d5ad 2024-09-14T11:37:24.494 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:37:24.496+0000 7f45a71fd9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:37:24.494 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:37:24.496+0000 7f45a71fd9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:37:24.494 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:37:24.496+0000 7f45a71fd9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:37:24.494 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:37:24.496+0000 7f45a71fd9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:37:24.494 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:37:24.496+0000 7f45a71fd9c0 20 RGWRados::pool_iterate: got zonegroup_info.65ab941b-da8c-4160-94fb-3672b069d44f 2024-09-14T11:37:24.494 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:37:24.496+0000 7f45a71fd9c0 20 rados->read ofs=0 len=0 2024-09-14T11:37:24.495 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:37:24.496+0000 7f45a71fd9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:37:24.495 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:37:24.496+0000 7f45a71fd9c0 20 rados->read ofs=0 len=0 2024-09-14T11:37:24.495 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:37:24.500+0000 7f45a71fd9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:37:24.495 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:37:24.500+0000 7f45a71fd9c0 20 rados->read ofs=0 len=0 2024-09-14T11:37:24.496 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:37:24.500+0000 7f45a71fd9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:37:24.496 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:37:24.500+0000 7f45a71fd9c0 20 zone default found 2024-09-14T11:37:24.496 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:37:24.500+0000 7f45a71fd9c0 4 Realm: () 2024-09-14T11:37:24.496 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:37:24.500+0000 7f45a71fd9c0 4 ZoneGroup: default (65ab941b-da8c-4160-94fb-3672b069d44f) 2024-09-14T11:37:24.497 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:37:24.500+0000 7f45a71fd9c0 4 Zone: default (d9e72d30-c60b-4d0d-9267-fdc36392d5ad) 2024-09-14T11:37:24.497 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:37:24.500+0000 7f45a71fd9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:37:24.497 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:37:24.500+0000 7f45a71fd9c0 20 zonegroup default 2024-09-14T11:37:24.497 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:37:24.500+0000 7f45a71fd9c0 20 rados->read ofs=0 len=0 2024-09-14T11:37:24.497 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:37:24.500+0000 7f45a71fd9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:37:24.497 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:37:24.500+0000 7f45a71fd9c0 20 rados->read ofs=0 len=0 2024-09-14T11:37:24.498 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:37:24.500+0000 7f45a71fd9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:37:24.498 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:37:24.500+0000 7f45a71fd9c0 20 rados->read ofs=0 len=0 2024-09-14T11:37:24.499 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:37:24.500+0000 7f45a71fd9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:37:24.499 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:37:24.500+0000 7f45a71fd9c0 20 started sync module instance, tier type = 2024-09-14T11:37:24.499 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:37:24.500+0000 7f45a71fd9c0 20 started zone id=d9e72d30-c60b-4d0d-9267-fdc36392d5ad (name=default) with tier type = 2024-09-14T11:37:24.522 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:37:24.524+0000 7f45a71fd9c0 20 add_watcher() i=0 2024-09-14T11:37:24.522 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:37:24.524+0000 7f45a71fd9c0 20 add_watcher() i=1 2024-09-14T11:37:24.522 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:37:24.524+0000 7f45a71fd9c0 20 add_watcher() i=2 2024-09-14T11:37:24.522 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:37:24.524+0000 7f45a71fd9c0 20 add_watcher() i=3 2024-09-14T11:37:24.522 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:37:24.524+0000 7f45a71fd9c0 20 add_watcher() i=4 2024-09-14T11:37:24.522 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:37:24.524+0000 7f45a71fd9c0 20 add_watcher() i=5 2024-09-14T11:37:24.522 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:37:24.524+0000 7f45a71fd9c0 20 add_watcher() i=6 2024-09-14T11:37:24.524 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:37:24.528+0000 7f45a71fd9c0 20 add_watcher() i=7 2024-09-14T11:37:24.524 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:37:24.528+0000 7f45a71fd9c0 2 all 8 watchers are set, enabling cache 2024-09-14T11:37:24.528 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:37:24.532+0000 7f445afe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:37:24.529 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:37:24.532+0000 7f45a71fd9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:37:24.529 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:37:24.532+0000 7f45a71fd9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:37:24.529 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:37:24.532+0000 7f45a71fd9c0 5 note: GC not initialized 2024-09-14T11:37:24.530 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:37:24.532+0000 7f4459fe3640 20 reqs_thread_entry: start 2024-09-14T11:37:24.530 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:37:24.532+0000 7f45a71fd9c0 20 init_complete bucket index max shards: 11 2024-09-14T11:37:24.530 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:37:24.532+0000 7f45a71fd9c0 20 Filter name: none 2024-09-14T11:37:24.530 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:37:24.532+0000 7f43cb7fe640 20 reqs_thread_entry: start 2024-09-14T11:37:24.530 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:37:24.532+0000 7f45a71fd9c0 20 rados->read ofs=0 len=0 2024-09-14T11:37:24.531 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:37:24.532+0000 7f45a71fd9c0 20 rados_obj.operate() r=0 bl.length=197 2024-09-14T11:37:24.531 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:37:24.532+0000 7f45a71fd9c0 20 rados->read ofs=0 len=0 2024-09-14T11:37:24.532 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:37:24.536+0000 7f45a71fd9c0 20 rados_obj.operate() r=0 bl.length=419 2024-09-14T11:37:24.533 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:37:24.536+0000 7f45a71fd9c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:37:24.533 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:37:24.536+0000 7f45a71fd9c0 20 rados->read ofs=0 len=0 2024-09-14T11:37:24.533 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:37:24.536+0000 7f45a71fd9c0 20 rados_obj.operate() r=0 bl.length=197 2024-09-14T11:37:24.533 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:37:24.536+0000 7f45a71fd9c0 20 rados->read ofs=0 len=0 2024-09-14T11:37:24.534 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:37:24.536+0000 7f45a71fd9c0 20 rados_obj.operate() r=0 bl.length=419 2024-09-14T11:37:24.534 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:37:24.536+0000 7f45a71fd9c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:37:24.537 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:37:24.540+0000 7f445afe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:37:24.542 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:37:24.544+0000 7f45a71fd9c0 20 remove_watcher() i=0 2024-09-14T11:37:24.542 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:37:24.544+0000 7f45a71fd9c0 2 removed watcher, disabling cache 2024-09-14T11:37:24.545 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:37:24.548+0000 7f45a71fd9c0 20 remove_watcher() i=1 2024-09-14T11:37:24.548 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:37:24.548+0000 7f45a71fd9c0 20 remove_watcher() i=2 2024-09-14T11:37:24.549 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:37:24.552+0000 7f45a71fd9c0 20 remove_watcher() i=3 2024-09-14T11:37:24.552 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:37:24.556+0000 7f45a71fd9c0 20 remove_watcher() i=4 2024-09-14T11:37:24.553 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:37:24.556+0000 7f45a71fd9c0 20 remove_watcher() i=5 2024-09-14T11:37:24.555 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:37:24.556+0000 7f45a71fd9c0 20 remove_watcher() i=6 2024-09-14T11:37:24.556 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:37:24.560+0000 7f45a71fd9c0 20 remove_watcher() i=7 2024-09-14T11:37:24.572 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-14T11:37:24.572 INFO:tasks.workunit.client.0.smithi138.stderr:BUCKET_STATS: 2024-09-14T11:37:24.572 INFO:tasks.workunit.client.0.smithi138.stderr:bucket: abort-at-commit-target-layout id: d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.32 num_objects: 19 size_kb: 1 num_shards: 12 2024-09-14T11:37:24.572 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-14T11:37:24.573 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:37:24.573 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-14T11:37:24.602 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:37:24.602 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-14T11:37:25.100 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:37:25.101 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-14T11:37:25.487 INFO:tasks.workunit.client.0.smithi138.stderr:TEST: reshard bucket with EIO injected at do_reshard 2024-09-14T11:37:25.487 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-14T11:37:25.490 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:37:25.490 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-14T11:37:25.627 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:37:25.627 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-14T11:37:25.716 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:37:25.716 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-14T11:37:25.803 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:37:25.803 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-14T11:37:25.911 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:37:25.911 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-14T11:37:25.999 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:37:26.000 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-14T11:37:26.171 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:37:26.171 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-14T11:37:26.262 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:37:26.262 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-14T11:37:26.359 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:37:26.359 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-14T11:37:26.453 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:37:26.453 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-14T11:37:26.545 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:37:26.545 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-14T11:37:26.638 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:37:26.638 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-14T11:37:26.733 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:37:26.733 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-14T11:37:26.824 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:37:26.825 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-14T11:37:26.918 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:37:26.918 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-14T11:37:27.011 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:37:27.011 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-14T11:37:27.106 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:37:27.106 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-14T11:37:27.201 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:37:27.202 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-14T11:37:27.286 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:37:27.286 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-14T11:37:27.376 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:37:27.376 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-14T11:37:27.458 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:37:27.458 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-14T11:37:27.552 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:37:27.552 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-14T11:37:27.652 INFO:tasks.workunit.client.0.smithi138.stderr:radosgw-admin bucket stats --bucket error-at-do-reshard 2024-09-14T11:37:27.685 INFO:tasks.workunit.client.0.smithi138.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:37:27.685 INFO:tasks.workunit.client.0.smithi138.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:37:27.729 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:37:27.732+0000 7f487af729c0 20 rados->read ofs=0 len=0 2024-09-14T11:37:27.732 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:37:27.732+0000 7f487af729c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:37:27.732 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:37:27.732+0000 7f487af729c0 20 realm 2024-09-14T11:37:27.732 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:37:27.732+0000 7f487af729c0 20 rados->read ofs=0 len=0 2024-09-14T11:37:27.732 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:37:27.736+0000 7f487af729c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:37:27.732 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:37:27.736+0000 7f487af729c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:37:27.732 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:37:27.736+0000 7f487af729c0 20 rados->read ofs=0 len=0 2024-09-14T11:37:27.732 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:37:27.736+0000 7f487af729c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:37:27.732 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:37:27.736+0000 7f487af729c0 20 rados->read ofs=0 len=0 2024-09-14T11:37:27.734 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:37:27.736+0000 7f487af729c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:37:27.734 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:37:27.736+0000 7f487af729c0 20 rados->read ofs=0 len=0 2024-09-14T11:37:27.735 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:37:27.736+0000 7f487af729c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:37:27.735 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:37:27.736+0000 7f487af729c0 20 searching for the correct realm 2024-09-14T11:37:27.739 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:37:27.740+0000 7f4879279640 0 -- 172.21.15.138:0/3964560385 >> [v2:172.21.15.154:6824/416768175,v1:172.21.15.154:6825/416768175] conn(0x7f487010bd70 msgr2=0x7f4870138040 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:37:27.747 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:37:27.748+0000 7f4878277640 0 -- 172.21.15.138:0/3964560385 >> [v2:172.21.15.138:6816/326481658,v1:172.21.15.138:6817/326481658] conn(0x7f4870138040 msgr2=0x7f48701384a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:37:27.963 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:37:27.964+0000 7f487af729c0 20 RGWRados::pool_iterate: got zone_info.d9e72d30-c60b-4d0d-9267-fdc36392d5ad 2024-09-14T11:37:27.963 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:37:27.964+0000 7f487af729c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:37:27.963 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:37:27.964+0000 7f487af729c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:37:27.963 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:37:27.964+0000 7f487af729c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:37:27.963 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:37:27.964+0000 7f487af729c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:37:27.964 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:37:27.964+0000 7f487af729c0 20 RGWRados::pool_iterate: got zonegroup_info.65ab941b-da8c-4160-94fb-3672b069d44f 2024-09-14T11:37:27.964 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:37:27.964+0000 7f487af729c0 20 rados->read ofs=0 len=0 2024-09-14T11:37:27.964 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:37:27.968+0000 7f487af729c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:37:27.964 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:37:27.968+0000 7f487af729c0 20 rados->read ofs=0 len=0 2024-09-14T11:37:27.964 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:37:27.968+0000 7f487af729c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:37:27.964 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:37:27.968+0000 7f487af729c0 20 rados->read ofs=0 len=0 2024-09-14T11:37:27.965 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:37:27.968+0000 7f487af729c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:37:27.965 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:37:27.968+0000 7f487af729c0 20 zone default found 2024-09-14T11:37:27.966 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:37:27.968+0000 7f487af729c0 4 Realm: () 2024-09-14T11:37:27.966 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:37:27.968+0000 7f487af729c0 4 ZoneGroup: default (65ab941b-da8c-4160-94fb-3672b069d44f) 2024-09-14T11:37:27.966 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:37:27.968+0000 7f487af729c0 4 Zone: default (d9e72d30-c60b-4d0d-9267-fdc36392d5ad) 2024-09-14T11:37:27.966 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:37:27.968+0000 7f487af729c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:37:27.966 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:37:27.968+0000 7f487af729c0 20 zonegroup default 2024-09-14T11:37:27.966 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:37:27.968+0000 7f487af729c0 20 rados->read ofs=0 len=0 2024-09-14T11:37:27.966 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:37:27.968+0000 7f487af729c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:37:27.966 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:37:27.968+0000 7f487af729c0 20 rados->read ofs=0 len=0 2024-09-14T11:37:27.967 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:37:27.968+0000 7f487af729c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:37:27.967 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:37:27.968+0000 7f487af729c0 20 rados->read ofs=0 len=0 2024-09-14T11:37:27.967 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:37:27.972+0000 7f487af729c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:37:27.967 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:37:27.972+0000 7f487af729c0 20 started sync module instance, tier type = 2024-09-14T11:37:27.968 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:37:27.972+0000 7f487af729c0 20 started zone id=d9e72d30-c60b-4d0d-9267-fdc36392d5ad (name=default) with tier type = 2024-09-14T11:37:27.991 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:37:27.992+0000 7f487af729c0 20 add_watcher() i=0 2024-09-14T11:37:27.991 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:37:27.992+0000 7f487af729c0 20 add_watcher() i=1 2024-09-14T11:37:27.991 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:37:27.992+0000 7f487af729c0 20 add_watcher() i=2 2024-09-14T11:37:27.992 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:37:27.992+0000 7f487af729c0 20 add_watcher() i=3 2024-09-14T11:37:27.992 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:37:27.992+0000 7f487af729c0 20 add_watcher() i=4 2024-09-14T11:37:27.992 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:37:27.992+0000 7f487af729c0 20 add_watcher() i=5 2024-09-14T11:37:27.992 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:37:27.996+0000 7f487af729c0 20 add_watcher() i=6 2024-09-14T11:37:27.994 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:37:27.996+0000 7f487af729c0 20 add_watcher() i=7 2024-09-14T11:37:27.994 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:37:27.996+0000 7f487af729c0 2 all 8 watchers are set, enabling cache 2024-09-14T11:37:27.998 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:37:28.000+0000 7f472efe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:37:27.999 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:37:28.000+0000 7f487af729c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:37:27.999 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:37:28.000+0000 7f487af729c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:37:27.999 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:37:28.000+0000 7f487af729c0 5 note: GC not initialized 2024-09-14T11:37:27.999 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:37:28.000+0000 7f472dfe3640 20 reqs_thread_entry: start 2024-09-14T11:37:28.000 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:37:28.004+0000 7f487af729c0 20 init_complete bucket index max shards: 11 2024-09-14T11:37:28.000 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:37:28.004+0000 7f487af729c0 20 Filter name: none 2024-09-14T11:37:28.000 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:37:28.004+0000 7f469f7fe640 20 reqs_thread_entry: start 2024-09-14T11:37:28.000 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:37:28.004+0000 7f487af729c0 20 rados->read ofs=0 len=0 2024-09-14T11:37:28.001 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:37:28.004+0000 7f487af729c0 20 rados_obj.operate() r=0 bl.length=187 2024-09-14T11:37:28.001 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:37:28.004+0000 7f487af729c0 20 rados->read ofs=0 len=0 2024-09-14T11:37:28.002 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:37:28.004+0000 7f487af729c0 20 rados_obj.operate() r=0 bl.length=409 2024-09-14T11:37:28.002 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:37:28.004+0000 7f487af729c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:37:28.002 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:37:28.004+0000 7f487af729c0 20 rados->read ofs=0 len=0 2024-09-14T11:37:28.003 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:37:28.004+0000 7f487af729c0 20 rados_obj.operate() r=0 bl.length=187 2024-09-14T11:37:28.003 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:37:28.004+0000 7f487af729c0 20 rados->read ofs=0 len=0 2024-09-14T11:37:28.003 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:37:28.004+0000 7f487af729c0 20 rados_obj.operate() r=0 bl.length=409 2024-09-14T11:37:28.003 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:37:28.004+0000 7f487af729c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:37:28.006 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:37:28.008+0000 7f472efe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:37:28.011 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:37:28.012+0000 7f487af729c0 20 remove_watcher() i=0 2024-09-14T11:37:28.011 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:37:28.012+0000 7f487af729c0 2 removed watcher, disabling cache 2024-09-14T11:37:28.013 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:37:28.016+0000 7f487af729c0 20 remove_watcher() i=1 2024-09-14T11:37:28.016 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:37:28.020+0000 7f487af729c0 20 remove_watcher() i=2 2024-09-14T11:37:28.018 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:37:28.020+0000 7f487af729c0 20 remove_watcher() i=3 2024-09-14T11:37:28.020 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:37:28.024+0000 7f487af729c0 20 remove_watcher() i=4 2024-09-14T11:37:28.022 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:37:28.024+0000 7f487af729c0 20 remove_watcher() i=5 2024-09-14T11:37:28.023 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:37:28.028+0000 7f487af729c0 20 remove_watcher() i=6 2024-09-14T11:37:28.025 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:37:28.028+0000 7f487af729c0 20 remove_watcher() i=7 2024-09-14T11:37:28.044 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-14T11:37:28.044 INFO:tasks.workunit.client.0.smithi138.stderr:BUCKET_STATS: 2024-09-14T11:37:28.044 INFO:tasks.workunit.client.0.smithi138.stderr:bucket: error-at-do-reshard id: d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.33 num_objects: 20 size_kb: 1 num_shards: 11 2024-09-14T11:37:28.044 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-14T11:37:28.044 INFO:tasks.workunit.client.0.smithi138.stderr:radosgw-admin bucket reshard --bucket error-at-do-reshard --num-shards 12 --rgw-reshard-bucket-lock-duration 30 --inject-error-at do_reshard 2024-09-14T11:37:28.082 INFO:tasks.workunit.client.0.smithi138.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:37:28.082 INFO:tasks.workunit.client.0.smithi138.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:37:28.127 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:37:28.128+0000 7f2670b819c0 20 rados->read ofs=0 len=0 2024-09-14T11:37:28.129 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:37:28.132+0000 7f2670b819c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:37:28.129 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:37:28.132+0000 7f2670b819c0 20 realm 2024-09-14T11:37:28.129 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:37:28.132+0000 7f2670b819c0 20 rados->read ofs=0 len=0 2024-09-14T11:37:28.129 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:37:28.132+0000 7f2670b819c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:37:28.129 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:37:28.132+0000 7f2670b819c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:37:28.129 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:37:28.132+0000 7f2670b819c0 20 rados->read ofs=0 len=0 2024-09-14T11:37:28.129 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:37:28.132+0000 7f2670b819c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:37:28.129 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:37:28.132+0000 7f2670b819c0 20 rados->read ofs=0 len=0 2024-09-14T11:37:28.131 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:37:28.132+0000 7f2670b819c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:37:28.131 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:37:28.132+0000 7f2670b819c0 20 rados->read ofs=0 len=0 2024-09-14T11:37:28.132 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:37:28.136+0000 7f2670b819c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:37:28.132 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:37:28.136+0000 7f2670b819c0 20 searching for the correct realm 2024-09-14T11:37:28.137 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:37:28.140+0000 7f266de86640 0 -- 172.21.15.138:0/1293249023 >> [v2:172.21.15.154:6808/1468088432,v1:172.21.15.154:6809/1468088432] conn(0x7f266002c440 msgr2=0x7f266002c860 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:37:28.143 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:37:28.144+0000 7f266de86640 0 -- 172.21.15.138:0/1293249023 >> [v2:172.21.15.138:6816/326481658,v1:172.21.15.138:6817/326481658] conn(0x7f2668070ac0 msgr2=0x7f2668081050 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:37:28.359 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:37:28.360+0000 7f2670b819c0 20 RGWRados::pool_iterate: got zone_info.d9e72d30-c60b-4d0d-9267-fdc36392d5ad 2024-09-14T11:37:28.359 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:37:28.360+0000 7f2670b819c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:37:28.359 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:37:28.360+0000 7f2670b819c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:37:28.359 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:37:28.360+0000 7f2670b819c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:37:28.359 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:37:28.360+0000 7f2670b819c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:37:28.359 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:37:28.360+0000 7f2670b819c0 20 RGWRados::pool_iterate: got zonegroup_info.65ab941b-da8c-4160-94fb-3672b069d44f 2024-09-14T11:37:28.359 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:37:28.360+0000 7f2670b819c0 20 rados->read ofs=0 len=0 2024-09-14T11:37:28.360 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:37:28.364+0000 7f2670b819c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:37:28.360 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:37:28.364+0000 7f2670b819c0 20 rados->read ofs=0 len=0 2024-09-14T11:37:28.361 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:37:28.364+0000 7f2670b819c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:37:28.361 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:37:28.364+0000 7f2670b819c0 20 rados->read ofs=0 len=0 2024-09-14T11:37:28.362 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:37:28.364+0000 7f2670b819c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:37:28.362 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:37:28.364+0000 7f2670b819c0 20 zone default found 2024-09-14T11:37:28.362 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:37:28.364+0000 7f2670b819c0 4 Realm: () 2024-09-14T11:37:28.362 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:37:28.364+0000 7f2670b819c0 4 ZoneGroup: default (65ab941b-da8c-4160-94fb-3672b069d44f) 2024-09-14T11:37:28.362 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:37:28.364+0000 7f2670b819c0 4 Zone: default (d9e72d30-c60b-4d0d-9267-fdc36392d5ad) 2024-09-14T11:37:28.362 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:37:28.364+0000 7f2670b819c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:37:28.362 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:37:28.364+0000 7f2670b819c0 20 zonegroup default 2024-09-14T11:37:28.362 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:37:28.364+0000 7f2670b819c0 20 rados->read ofs=0 len=0 2024-09-14T11:37:28.362 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:37:28.364+0000 7f2670b819c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:37:28.363 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:37:28.364+0000 7f2670b819c0 20 rados->read ofs=0 len=0 2024-09-14T11:37:28.363 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:37:28.368+0000 7f2670b819c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:37:28.363 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:37:28.368+0000 7f2670b819c0 20 rados->read ofs=0 len=0 2024-09-14T11:37:28.364 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:37:28.368+0000 7f2670b819c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:37:28.364 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:37:28.368+0000 7f2670b819c0 20 started sync module instance, tier type = 2024-09-14T11:37:28.364 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:37:28.368+0000 7f2670b819c0 20 started zone id=d9e72d30-c60b-4d0d-9267-fdc36392d5ad (name=default) with tier type = 2024-09-14T11:37:28.389 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:37:28.392+0000 7f2670b819c0 20 add_watcher() i=0 2024-09-14T11:37:28.389 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:37:28.392+0000 7f2670b819c0 20 add_watcher() i=1 2024-09-14T11:37:28.389 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:37:28.392+0000 7f2670b819c0 20 add_watcher() i=2 2024-09-14T11:37:28.389 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:37:28.392+0000 7f2670b819c0 20 add_watcher() i=3 2024-09-14T11:37:28.389 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:37:28.392+0000 7f2670b819c0 20 add_watcher() i=4 2024-09-14T11:37:28.389 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:37:28.392+0000 7f2670b819c0 20 add_watcher() i=5 2024-09-14T11:37:28.389 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:37:28.392+0000 7f2670b819c0 20 add_watcher() i=6 2024-09-14T11:37:28.391 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:37:28.396+0000 7f2670b819c0 20 add_watcher() i=7 2024-09-14T11:37:28.392 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:37:28.396+0000 7f2670b819c0 2 all 8 watchers are set, enabling cache 2024-09-14T11:37:28.395 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:37:28.400+0000 7f2524fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:37:28.396 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:37:28.400+0000 7f2670b819c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:37:28.397 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:37:28.400+0000 7f2670b819c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:37:28.397 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:37:28.400+0000 7f2670b819c0 5 note: GC not initialized 2024-09-14T11:37:28.397 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:37:28.400+0000 7f249f7fe640 20 reqs_thread_entry: start 2024-09-14T11:37:28.398 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:37:28.400+0000 7f2670b819c0 20 init_complete bucket index max shards: 11 2024-09-14T11:37:28.398 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:37:28.400+0000 7f2670b819c0 20 Filter name: none 2024-09-14T11:37:28.398 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:37:28.400+0000 7f249d7fa640 20 reqs_thread_entry: start 2024-09-14T11:37:28.398 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:37:28.400+0000 7f2670b819c0 10 cache get: name=default.rgw.meta+root+error-at-do-reshard : miss 2024-09-14T11:37:28.398 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:37:28.400+0000 7f2670b819c0 20 rados->read ofs=0 len=0 2024-09-14T11:37:28.399 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:37:28.400+0000 7f2670b819c0 20 rados_obj.operate() r=0 bl.length=187 2024-09-14T11:37:28.399 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:37:28.400+0000 7f2670b819c0 10 cache put: name=default.rgw.meta+root+error-at-do-reshard info.flags=0x11 2024-09-14T11:37:28.399 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:37:28.400+0000 7f2670b819c0 10 adding default.rgw.meta+root+error-at-do-reshard to cache LRU end 2024-09-14T11:37:28.399 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:37:28.400+0000 7f2670b819c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-do-reshard:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.33 : miss 2024-09-14T11:37:28.399 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:37:28.400+0000 7f2670b819c0 20 rados->read ofs=0 len=0 2024-09-14T11:37:28.399 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:37:28.404+0000 7f2670b819c0 20 rados_obj.operate() r=0 bl.length=409 2024-09-14T11:37:28.400 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:37:28.404+0000 7f2670b819c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-do-reshard:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.33 info.flags=0x17 2024-09-14T11:37:28.400 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:37:28.404+0000 7f2670b819c0 10 adding default.rgw.meta+root+.bucket.meta.error-at-do-reshard:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.33 to cache LRU end 2024-09-14T11:37:28.400 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:37:28.404+0000 7f2670b819c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:37:28.400 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:37:28.404+0000 7f2670b819c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:37:28.400 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:37:28.404+0000 7f2670b819c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-do-reshard:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.33 2024-09-14T11:37:28.414 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:37:28.416+0000 7f2670b819c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-do-reshard:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.33 info.flags=0x17 2024-09-14T11:37:28.414 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:37:28.416+0000 7f2670b819c0 10 moving default.rgw.meta+root+.bucket.meta.error-at-do-reshard:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.33 to cache LRU end 2024-09-14T11:37:28.414 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:37:28.416+0000 7f2670b819c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:37:28.414 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:37:28.416+0000 7f2670b819c0 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-do-reshard:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.33, ofs0, ns] 2024-09-14T11:37:28.415 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:37:28.416+0000 7f25517fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366236 cookie 93956930212288 notifier 7344 bl.length()=911 2024-09-14T11:37:28.415 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:37:28.416+0000 7f25517fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-do-reshard:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.33 info.flags=0x17 2024-09-14T11:37:28.415 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:37:28.416+0000 7f25517fa640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-do-reshard:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.33 to cache LRU end 2024-09-14T11:37:28.415 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:37:28.416+0000 7f25517fa640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:37:28.419 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:37:28.420+0000 7f2670b819c0 20 handle_bi_update(): bucket=:error-at-do-reshard[d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.33]): orig_sources= new_sources= 2024-09-14T11:37:28.419 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:37:28.420+0000 7f2670b819c0 20 handle_bi_update(): bucket=:error-at-do-reshard[d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.33]): potential sources added=[] removed=[] 2024-09-14T11:37:28.419 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:37:28.420+0000 7f2670b819c0 20 handle_bi_update(): bucket=:error-at-do-reshard[d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.33]): orig_dests= new_dests= 2024-09-14T11:37:28.419 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:37:28.420+0000 7f2670b819c0 20 handle_bi_update(): bucket=:error-at-do-reshard[d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.33]): potential dests added=[] removed=[] 2024-09-14T11:37:28.428 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:37:28.432+0000 7f2670b819c0 -1 Injecting error=-5 at location=do_reshard 2024-09-14T11:37:28.444 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:37:28.448+0000 7f2670b819c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-do-reshard:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.33 : hit (requested=0x17, cached=0x17) 2024-09-14T11:37:28.445 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:37:28.448+0000 7f2670b819c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-do-reshard:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.33 2024-09-14T11:37:28.446 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:37:28.448+0000 7f2670b819c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-do-reshard:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.33 info.flags=0x17 2024-09-14T11:37:28.446 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:37:28.448+0000 7f2670b819c0 10 moving default.rgw.meta+root+.bucket.meta.error-at-do-reshard:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.33 to cache LRU end 2024-09-14T11:37:28.446 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:37:28.448+0000 7f2670b819c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:37:28.447 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:37:28.448+0000 7f2670b819c0 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-do-reshard:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.33, ofs0, ns] 2024-09-14T11:37:28.447 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:37:28.448+0000 7f2551ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366237 cookie 93956930212288 notifier 7344 bl.length()=879 2024-09-14T11:37:28.447 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:37:28.448+0000 7f2551ffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-do-reshard:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.33 info.flags=0x17 2024-09-14T11:37:28.447 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:37:28.448+0000 7f2551ffb640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-do-reshard:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.33 to cache LRU end 2024-09-14T11:37:28.447 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:37:28.448+0000 7f2551ffb640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:37:28.450 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:37:28.452+0000 7f2670b819c0 20 handle_bi_update(): bucket=:error-at-do-reshard[d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.33]): orig_sources= new_sources= 2024-09-14T11:37:28.450 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:37:28.452+0000 7f2670b819c0 20 handle_bi_update(): bucket=:error-at-do-reshard[d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.33]): potential sources added=[] removed=[] 2024-09-14T11:37:28.450 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:37:28.452+0000 7f2670b819c0 20 handle_bi_update(): bucket=:error-at-do-reshard[d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.33]): orig_dests= new_dests= 2024-09-14T11:37:28.450 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:37:28.452+0000 7f2670b819c0 20 handle_bi_update(): bucket=:error-at-do-reshard[d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.33]): potential dests added=[] removed=[] 2024-09-14T11:37:28.450 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:37:28.452+0000 7f2670b819c0 1 execute INFO: reshard of bucket "error-at-do-reshard" canceled due to errors 2024-09-14T11:37:28.453 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:37:28.456+0000 7f2524fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:37:28.458 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:37:28.460+0000 7f2670b819c0 20 remove_watcher() i=0 2024-09-14T11:37:28.458 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:37:28.460+0000 7f2670b819c0 2 removed watcher, disabling cache 2024-09-14T11:37:28.460 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:37:28.464+0000 7f2670b819c0 20 remove_watcher() i=1 2024-09-14T11:37:28.463 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:37:28.464+0000 7f2670b819c0 20 remove_watcher() i=2 2024-09-14T11:37:28.465 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:37:28.468+0000 7f2670b819c0 20 remove_watcher() i=3 2024-09-14T11:37:28.467 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:37:28.472+0000 7f2670b819c0 20 remove_watcher() i=4 2024-09-14T11:37:28.469 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:37:28.472+0000 7f2670b819c0 20 remove_watcher() i=5 2024-09-14T11:37:28.470 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:37:28.472+0000 7f2670b819c0 20 remove_watcher() i=6 2024-09-14T11:37:28.472 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:37:28.476+0000 7f2670b819c0 20 remove_watcher() i=7 2024-09-14T11:37:28.488 INFO:tasks.workunit.client.0.smithi138.stderr:radosgw-admin bucket stats --bucket error-at-do-reshard 2024-09-14T11:37:28.517 INFO:tasks.workunit.client.0.smithi138.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:37:28.518 INFO:tasks.workunit.client.0.smithi138.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:37:28.560 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:37:28.564+0000 7f945915f9c0 20 rados->read ofs=0 len=0 2024-09-14T11:37:28.562 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:37:28.564+0000 7f945915f9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:37:28.562 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:37:28.564+0000 7f945915f9c0 20 realm 2024-09-14T11:37:28.562 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:37:28.564+0000 7f945915f9c0 20 rados->read ofs=0 len=0 2024-09-14T11:37:28.563 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:37:28.564+0000 7f945915f9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:37:28.563 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:37:28.564+0000 7f945915f9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:37:28.563 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:37:28.564+0000 7f945915f9c0 20 rados->read ofs=0 len=0 2024-09-14T11:37:28.563 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:37:28.564+0000 7f945915f9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:37:28.563 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:37:28.564+0000 7f945915f9c0 20 rados->read ofs=0 len=0 2024-09-14T11:37:28.564 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:37:28.568+0000 7f945915f9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:37:28.564 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:37:28.568+0000 7f945915f9c0 20 rados->read ofs=0 len=0 2024-09-14T11:37:28.565 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:37:28.568+0000 7f945915f9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:37:28.565 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:37:28.568+0000 7f945915f9c0 20 searching for the correct realm 2024-09-14T11:37:28.568 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:37:28.572+0000 7f9457466640 0 -- 172.21.15.138:0/1214205930 >> [v2:172.21.15.154:6824/416768175,v1:172.21.15.154:6825/416768175] conn(0x7f9450004040 msgr2=0x7f94500e7410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-14T11:37:28.785 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:37:28.788+0000 7f9456464640 0 -- 172.21.15.138:0/1214205930 >> [v2:172.21.15.138:6816/326481658,v1:172.21.15.138:6817/326481658] conn(0x7f94500b3910 msgr2=0x7f94500ff3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:37:29.002 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:37:29.004+0000 7f945915f9c0 20 RGWRados::pool_iterate: got zone_info.d9e72d30-c60b-4d0d-9267-fdc36392d5ad 2024-09-14T11:37:29.003 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:37:29.004+0000 7f945915f9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:37:29.003 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:37:29.004+0000 7f945915f9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:37:29.003 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:37:29.004+0000 7f945915f9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:37:29.003 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:37:29.004+0000 7f945915f9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:37:29.003 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:37:29.004+0000 7f945915f9c0 20 RGWRados::pool_iterate: got zonegroup_info.65ab941b-da8c-4160-94fb-3672b069d44f 2024-09-14T11:37:29.003 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:37:29.004+0000 7f945915f9c0 20 rados->read ofs=0 len=0 2024-09-14T11:37:29.003 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:37:29.004+0000 7f945915f9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:37:29.003 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:37:29.004+0000 7f945915f9c0 20 rados->read ofs=0 len=0 2024-09-14T11:37:29.004 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:37:29.008+0000 7f945915f9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:37:29.004 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:37:29.008+0000 7f945915f9c0 20 rados->read ofs=0 len=0 2024-09-14T11:37:29.005 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:37:29.008+0000 7f945915f9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:37:29.005 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:37:29.008+0000 7f945915f9c0 20 zone default found 2024-09-14T11:37:29.005 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:37:29.008+0000 7f945915f9c0 4 Realm: () 2024-09-14T11:37:29.005 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:37:29.008+0000 7f945915f9c0 4 ZoneGroup: default (65ab941b-da8c-4160-94fb-3672b069d44f) 2024-09-14T11:37:29.005 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:37:29.008+0000 7f945915f9c0 4 Zone: default (d9e72d30-c60b-4d0d-9267-fdc36392d5ad) 2024-09-14T11:37:29.005 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:37:29.008+0000 7f945915f9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:37:29.005 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:37:29.008+0000 7f945915f9c0 20 zonegroup default 2024-09-14T11:37:29.005 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:37:29.008+0000 7f945915f9c0 20 rados->read ofs=0 len=0 2024-09-14T11:37:29.006 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:37:29.008+0000 7f945915f9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:37:29.006 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:37:29.008+0000 7f945915f9c0 20 rados->read ofs=0 len=0 2024-09-14T11:37:29.006 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:37:29.008+0000 7f945915f9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:37:29.006 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:37:29.008+0000 7f945915f9c0 20 rados->read ofs=0 len=0 2024-09-14T11:37:29.007 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:37:29.008+0000 7f945915f9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:37:29.007 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:37:29.008+0000 7f945915f9c0 20 started sync module instance, tier type = 2024-09-14T11:37:29.007 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:37:29.008+0000 7f945915f9c0 20 started zone id=d9e72d30-c60b-4d0d-9267-fdc36392d5ad (name=default) with tier type = 2024-09-14T11:37:29.031 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:37:29.032+0000 7f945915f9c0 20 add_watcher() i=0 2024-09-14T11:37:29.031 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:37:29.032+0000 7f945915f9c0 20 add_watcher() i=1 2024-09-14T11:37:29.031 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:37:29.032+0000 7f945915f9c0 20 add_watcher() i=2 2024-09-14T11:37:29.031 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:37:29.032+0000 7f945915f9c0 20 add_watcher() i=3 2024-09-14T11:37:29.031 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:37:29.032+0000 7f945915f9c0 20 add_watcher() i=4 2024-09-14T11:37:29.032 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:37:29.032+0000 7f945915f9c0 20 add_watcher() i=5 2024-09-14T11:37:29.032 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:37:29.032+0000 7f945915f9c0 20 add_watcher() i=6 2024-09-14T11:37:29.033 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:37:29.036+0000 7f945915f9c0 20 add_watcher() i=7 2024-09-14T11:37:29.033 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:37:29.036+0000 7f945915f9c0 2 all 8 watchers are set, enabling cache 2024-09-14T11:37:29.037 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:37:29.040+0000 7f930d7e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:37:29.038 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:37:29.040+0000 7f945915f9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:37:29.038 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:37:29.040+0000 7f945915f9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:37:29.039 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:37:29.040+0000 7f945915f9c0 5 note: GC not initialized 2024-09-14T11:37:29.039 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:37:29.040+0000 7f9287fff640 20 reqs_thread_entry: start 2024-09-14T11:37:29.039 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:37:29.040+0000 7f945915f9c0 20 init_complete bucket index max shards: 11 2024-09-14T11:37:29.039 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:37:29.040+0000 7f945915f9c0 20 Filter name: none 2024-09-14T11:37:29.040 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:37:29.044+0000 7f9285ffb640 20 reqs_thread_entry: start 2024-09-14T11:37:29.040 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:37:29.044+0000 7f945915f9c0 20 rados->read ofs=0 len=0 2024-09-14T11:37:29.040 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:37:29.044+0000 7f945915f9c0 20 rados_obj.operate() r=0 bl.length=187 2024-09-14T11:37:29.040 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:37:29.044+0000 7f945915f9c0 20 rados->read ofs=0 len=0 2024-09-14T11:37:29.041 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:37:29.044+0000 7f945915f9c0 20 rados_obj.operate() r=0 bl.length=409 2024-09-14T11:37:29.041 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:37:29.044+0000 7f945915f9c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:37:29.041 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:37:29.044+0000 7f945915f9c0 20 rados->read ofs=0 len=0 2024-09-14T11:37:29.042 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:37:29.044+0000 7f945915f9c0 20 rados_obj.operate() r=0 bl.length=187 2024-09-14T11:37:29.042 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:37:29.044+0000 7f945915f9c0 20 rados->read ofs=0 len=0 2024-09-14T11:37:29.042 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:37:29.044+0000 7f945915f9c0 20 rados_obj.operate() r=0 bl.length=409 2024-09-14T11:37:29.042 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:37:29.044+0000 7f945915f9c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:37:29.046 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:37:29.048+0000 7f930d7e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:37:29.051 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:37:29.052+0000 7f945915f9c0 20 remove_watcher() i=0 2024-09-14T11:37:29.051 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:37:29.052+0000 7f945915f9c0 2 removed watcher, disabling cache 2024-09-14T11:37:29.053 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:37:29.056+0000 7f945915f9c0 20 remove_watcher() i=1 2024-09-14T11:37:29.055 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:37:29.060+0000 7f945915f9c0 20 remove_watcher() i=2 2024-09-14T11:37:29.057 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:37:29.060+0000 7f945915f9c0 20 remove_watcher() i=3 2024-09-14T11:37:29.059 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:37:29.064+0000 7f945915f9c0 20 remove_watcher() i=4 2024-09-14T11:37:29.061 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:37:29.064+0000 7f945915f9c0 20 remove_watcher() i=5 2024-09-14T11:37:29.063 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:37:29.064+0000 7f945915f9c0 20 remove_watcher() i=6 2024-09-14T11:37:29.064 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:37:29.068+0000 7f945915f9c0 20 remove_watcher() i=7 2024-09-14T11:37:29.080 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-14T11:37:29.080 INFO:tasks.workunit.client.0.smithi138.stderr:BUCKET_STATS: 2024-09-14T11:37:29.080 INFO:tasks.workunit.client.0.smithi138.stderr:bucket: error-at-do-reshard id: d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.33 num_objects: 20 size_kb: 1 num_shards: 11 2024-09-14T11:37:29.080 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-14T11:37:29.081 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:37:29.081 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-14T11:37:29.126 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:37:29.126 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-14T11:37:29.213 INFO:tasks.workunit.client.0.smithi138.stderr:radosgw-admin bucket reshard --bucket error-at-do-reshard --num-shards 12 --rgw-reshard-bucket-lock-duration 30 2024-09-14T11:37:29.249 INFO:tasks.workunit.client.0.smithi138.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:37:29.249 INFO:tasks.workunit.client.0.smithi138.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:37:29.294 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:37:29.296+0000 7fd8513bd9c0 20 rados->read ofs=0 len=0 2024-09-14T11:37:29.297 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:37:29.300+0000 7fd8513bd9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:37:29.297 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:37:29.300+0000 7fd8513bd9c0 20 realm 2024-09-14T11:37:29.297 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:37:29.300+0000 7fd8513bd9c0 20 rados->read ofs=0 len=0 2024-09-14T11:37:29.297 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:37:29.300+0000 7fd8513bd9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:37:29.297 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:37:29.300+0000 7fd8513bd9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:37:29.297 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:37:29.300+0000 7fd8513bd9c0 20 rados->read ofs=0 len=0 2024-09-14T11:37:29.297 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:37:29.300+0000 7fd8513bd9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:37:29.297 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:37:29.300+0000 7fd8513bd9c0 20 rados->read ofs=0 len=0 2024-09-14T11:37:29.298 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:37:29.300+0000 7fd8513bd9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:37:29.299 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:37:29.300+0000 7fd8513bd9c0 20 rados->read ofs=0 len=0 2024-09-14T11:37:29.299 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:37:29.300+0000 7fd8513bd9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:37:29.299 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:37:29.300+0000 7fd8513bd9c0 20 searching for the correct realm 2024-09-14T11:37:29.303 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:37:29.304+0000 7fd84f6c4640 0 -- 172.21.15.138:0/2768271478 >> [v2:172.21.15.154:6824/416768175,v1:172.21.15.154:6825/416768175] conn(0x7fd848117c20 msgr2=0x7fd8480eaf10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:37:29.517 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:37:29.520+0000 7fd84e6c2640 0 -- 172.21.15.138:0/2768271478 >> [v2:172.21.15.138:6816/326481658,v1:172.21.15.138:6817/326481658] conn(0x7fd8481359a0 msgr2=0x7fd84810b880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:37:29.734 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:37:29.736+0000 7fd8513bd9c0 20 RGWRados::pool_iterate: got zone_info.d9e72d30-c60b-4d0d-9267-fdc36392d5ad 2024-09-14T11:37:29.735 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:37:29.736+0000 7fd8513bd9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:37:29.735 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:37:29.736+0000 7fd8513bd9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:37:29.735 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:37:29.736+0000 7fd8513bd9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:37:29.735 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:37:29.736+0000 7fd8513bd9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:37:29.735 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:37:29.736+0000 7fd8513bd9c0 20 RGWRados::pool_iterate: got zonegroup_info.65ab941b-da8c-4160-94fb-3672b069d44f 2024-09-14T11:37:29.735 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:37:29.736+0000 7fd8513bd9c0 20 rados->read ofs=0 len=0 2024-09-14T11:37:29.735 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:37:29.736+0000 7fd8513bd9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:37:29.735 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:37:29.736+0000 7fd8513bd9c0 20 rados->read ofs=0 len=0 2024-09-14T11:37:29.736 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:37:29.740+0000 7fd8513bd9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:37:29.736 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:37:29.740+0000 7fd8513bd9c0 20 rados->read ofs=0 len=0 2024-09-14T11:37:29.737 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:37:29.740+0000 7fd8513bd9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:37:29.738 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:37:29.740+0000 7fd8513bd9c0 20 zone default found 2024-09-14T11:37:29.738 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:37:29.740+0000 7fd8513bd9c0 4 Realm: () 2024-09-14T11:37:29.738 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:37:29.740+0000 7fd8513bd9c0 4 ZoneGroup: default (65ab941b-da8c-4160-94fb-3672b069d44f) 2024-09-14T11:37:29.738 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:37:29.740+0000 7fd8513bd9c0 4 Zone: default (d9e72d30-c60b-4d0d-9267-fdc36392d5ad) 2024-09-14T11:37:29.738 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:37:29.740+0000 7fd8513bd9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:37:29.738 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:37:29.740+0000 7fd8513bd9c0 20 zonegroup default 2024-09-14T11:37:29.738 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:37:29.740+0000 7fd8513bd9c0 20 rados->read ofs=0 len=0 2024-09-14T11:37:29.738 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:37:29.740+0000 7fd8513bd9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:37:29.738 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:37:29.740+0000 7fd8513bd9c0 20 rados->read ofs=0 len=0 2024-09-14T11:37:29.738 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:37:29.740+0000 7fd8513bd9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:37:29.739 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:37:29.740+0000 7fd8513bd9c0 20 rados->read ofs=0 len=0 2024-09-14T11:37:29.739 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:37:29.740+0000 7fd8513bd9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:37:29.739 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:37:29.740+0000 7fd8513bd9c0 20 started sync module instance, tier type = 2024-09-14T11:37:29.739 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:37:29.740+0000 7fd8513bd9c0 20 started zone id=d9e72d30-c60b-4d0d-9267-fdc36392d5ad (name=default) with tier type = 2024-09-14T11:37:29.759 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:37:29.760+0000 7fd8513bd9c0 20 add_watcher() i=0 2024-09-14T11:37:29.759 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:37:29.760+0000 7fd8513bd9c0 20 add_watcher() i=1 2024-09-14T11:37:29.759 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:37:29.760+0000 7fd8513bd9c0 20 add_watcher() i=2 2024-09-14T11:37:29.759 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:37:29.760+0000 7fd8513bd9c0 20 add_watcher() i=3 2024-09-14T11:37:29.759 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:37:29.760+0000 7fd8513bd9c0 20 add_watcher() i=4 2024-09-14T11:37:29.759 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:37:29.760+0000 7fd8513bd9c0 20 add_watcher() i=5 2024-09-14T11:37:29.760 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:37:29.764+0000 7fd8513bd9c0 20 add_watcher() i=6 2024-09-14T11:37:29.761 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:37:29.764+0000 7fd8513bd9c0 20 add_watcher() i=7 2024-09-14T11:37:29.761 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:37:29.764+0000 7fd8513bd9c0 2 all 8 watchers are set, enabling cache 2024-09-14T11:37:29.765 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:37:29.768+0000 7fd7057e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:37:29.766 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:37:29.768+0000 7fd8513bd9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:37:29.766 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:37:29.768+0000 7fd8513bd9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:37:29.766 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:37:29.768+0000 7fd8513bd9c0 5 note: GC not initialized 2024-09-14T11:37:29.767 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:37:29.768+0000 7fd67ffff640 20 reqs_thread_entry: start 2024-09-14T11:37:29.767 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:37:29.768+0000 7fd8513bd9c0 20 init_complete bucket index max shards: 11 2024-09-14T11:37:29.767 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:37:29.768+0000 7fd8513bd9c0 20 Filter name: none 2024-09-14T11:37:29.767 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:37:29.768+0000 7fd67dffb640 20 reqs_thread_entry: start 2024-09-14T11:37:29.767 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:37:29.768+0000 7fd8513bd9c0 10 cache get: name=default.rgw.meta+root+error-at-do-reshard : miss 2024-09-14T11:37:29.767 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:37:29.768+0000 7fd8513bd9c0 20 rados->read ofs=0 len=0 2024-09-14T11:37:29.768 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:37:29.772+0000 7fd8513bd9c0 20 rados_obj.operate() r=0 bl.length=187 2024-09-14T11:37:29.768 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:37:29.772+0000 7fd8513bd9c0 10 cache put: name=default.rgw.meta+root+error-at-do-reshard info.flags=0x11 2024-09-14T11:37:29.768 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:37:29.772+0000 7fd8513bd9c0 10 adding default.rgw.meta+root+error-at-do-reshard to cache LRU end 2024-09-14T11:37:29.768 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:37:29.772+0000 7fd8513bd9c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-do-reshard:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.33 : miss 2024-09-14T11:37:29.768 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:37:29.772+0000 7fd8513bd9c0 20 rados->read ofs=0 len=0 2024-09-14T11:37:29.769 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:37:29.772+0000 7fd8513bd9c0 20 rados_obj.operate() r=0 bl.length=409 2024-09-14T11:37:29.769 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:37:29.772+0000 7fd8513bd9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-do-reshard:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.33 info.flags=0x17 2024-09-14T11:37:29.769 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:37:29.772+0000 7fd8513bd9c0 10 adding default.rgw.meta+root+.bucket.meta.error-at-do-reshard:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.33 to cache LRU end 2024-09-14T11:37:29.769 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:37:29.772+0000 7fd8513bd9c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:37:29.769 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:37:29.772+0000 7fd8513bd9c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:37:29.770 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:37:29.772+0000 7fd8513bd9c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-do-reshard:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.33 2024-09-14T11:37:29.782 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:37:29.784+0000 7fd8513bd9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-do-reshard:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.33 info.flags=0x17 2024-09-14T11:37:29.782 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:37:29.784+0000 7fd8513bd9c0 10 moving default.rgw.meta+root+.bucket.meta.error-at-do-reshard:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.33 to cache LRU end 2024-09-14T11:37:29.782 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:37:29.784+0000 7fd8513bd9c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:37:29.782 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:37:29.784+0000 7fd8513bd9c0 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-do-reshard:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.33, ofs0, ns] 2024-09-14T11:37:29.783 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:37:29.784+0000 7fd7327fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366238 cookie 93970484689696 notifier 6914 bl.length()=911 2024-09-14T11:37:29.783 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:37:29.784+0000 7fd7327fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-do-reshard:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.33 info.flags=0x17 2024-09-14T11:37:29.783 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:37:29.784+0000 7fd7327fc640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-do-reshard:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.33 to cache LRU end 2024-09-14T11:37:29.783 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:37:29.784+0000 7fd7327fc640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:37:29.785 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:37:29.788+0000 7fd8513bd9c0 20 handle_bi_update(): bucket=:error-at-do-reshard[d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.33]): orig_sources= new_sources= 2024-09-14T11:37:29.786 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:37:29.788+0000 7fd8513bd9c0 20 handle_bi_update(): bucket=:error-at-do-reshard[d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.33]): potential sources added=[] removed=[] 2024-09-14T11:37:29.786 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:37:29.788+0000 7fd8513bd9c0 20 handle_bi_update(): bucket=:error-at-do-reshard[d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.33]): orig_dests= new_dests= 2024-09-14T11:37:29.786 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:37:29.788+0000 7fd8513bd9c0 20 handle_bi_update(): bucket=:error-at-do-reshard[d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.33]): potential dests added=[] removed=[] 2024-09-14T11:37:29.796 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:37:29.800+0000 7fd8513bd9c0 10 bucket_obj is .dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.33.1.0 2024-09-14T11:37:29.796 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:37:29.800+0000 7fd8513bd9c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.33.1.0 2024-09-14T11:37:29.796 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:37:29.800+0000 7fd8513bd9c0 10 bucket_obj is .dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.33.1.1 2024-09-14T11:37:29.796 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:37:29.800+0000 7fd8513bd9c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.33.1.1 2024-09-14T11:37:29.796 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:37:29.800+0000 7fd8513bd9c0 10 bucket_obj is .dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.33.1.2 2024-09-14T11:37:29.797 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:37:29.800+0000 7fd8513bd9c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.33.1.2 2024-09-14T11:37:29.797 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:37:29.800+0000 7fd8513bd9c0 10 bucket_obj is .dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.33.1.3 2024-09-14T11:37:29.797 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:37:29.800+0000 7fd8513bd9c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.33.1.3 2024-09-14T11:37:29.797 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:37:29.800+0000 7fd8513bd9c0 10 bucket_obj is .dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.33.1.4 2024-09-14T11:37:29.797 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:37:29.800+0000 7fd8513bd9c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.33.1.4 2024-09-14T11:37:29.797 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:37:29.800+0000 7fd8513bd9c0 10 bucket_obj is .dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.33.1.5 2024-09-14T11:37:29.797 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:37:29.800+0000 7fd8513bd9c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.33.1.5 2024-09-14T11:37:29.797 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:37:29.800+0000 7fd8513bd9c0 10 bucket_obj is .dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.33.1.6 2024-09-14T11:37:29.797 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:37:29.800+0000 7fd8513bd9c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.33.1.6 2024-09-14T11:37:29.797 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:37:29.800+0000 7fd8513bd9c0 10 bucket_obj is .dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.33.1.7 2024-09-14T11:37:29.797 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:37:29.800+0000 7fd8513bd9c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.33.1.7 2024-09-14T11:37:29.797 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:37:29.800+0000 7fd8513bd9c0 10 bucket_obj is .dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.33.1.8 2024-09-14T11:37:29.797 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:37:29.800+0000 7fd8513bd9c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.33.1.8 2024-09-14T11:37:29.798 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:37:29.800+0000 7fd8513bd9c0 10 bucket_obj is .dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.33.1.9 2024-09-14T11:37:29.798 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:37:29.800+0000 7fd8513bd9c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.33.1.9 2024-09-14T11:37:29.798 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:37:29.800+0000 7fd8513bd9c0 10 bucket_obj is .dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.33.1.10 2024-09-14T11:37:29.798 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:37:29.800+0000 7fd8513bd9c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.33.1.10 2024-09-14T11:37:29.798 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:37:29.800+0000 7fd8513bd9c0 10 bucket_obj is .dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.33.1.11 2024-09-14T11:37:29.798 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:37:29.800+0000 7fd8513bd9c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.33.1.11 2024-09-14T11:37:29.798 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:37:29.800+0000 7fd8513bd9c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.33.0 2024-09-14T11:37:29.798 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:37:29.800+0000 7fd8513bd9c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.33.1 2024-09-14T11:37:29.799 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:37:29.800+0000 7fd8513bd9c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.33.2 2024-09-14T11:37:29.799 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:37:29.804+0000 7fd8513bd9c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.33.3 2024-09-14T11:37:29.800 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:37:29.804+0000 7fd8513bd9c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.33.4 2024-09-14T11:37:29.801 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:37:29.804+0000 7fd8513bd9c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.33.5 2024-09-14T11:37:29.802 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:37:29.804+0000 7fd8513bd9c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.33.6 2024-09-14T11:37:29.803 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:37:29.804+0000 7fd8513bd9c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.33.7 2024-09-14T11:37:29.804 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:37:29.808+0000 7fd8513bd9c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.33.8 2024-09-14T11:37:29.805 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:37:29.808+0000 7fd8513bd9c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.33.9 2024-09-14T11:37:29.807 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:37:29.808+0000 7fd8513bd9c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.33.10 2024-09-14T11:37:29.816 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:37:29.820+0000 7fd8513bd9c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-do-reshard:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.33 : hit (requested=0x17, cached=0x17) 2024-09-14T11:37:29.816 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:37:29.820+0000 7fd8513bd9c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-do-reshard:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.33 2024-09-14T11:37:29.818 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:37:29.820+0000 7fd8513bd9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-do-reshard:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.33 info.flags=0x17 2024-09-14T11:37:29.818 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:37:29.820+0000 7fd8513bd9c0 10 moving default.rgw.meta+root+.bucket.meta.error-at-do-reshard:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.33 to cache LRU end 2024-09-14T11:37:29.818 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:37:29.820+0000 7fd8513bd9c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:37:29.818 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:37:29.820+0000 7fd8513bd9c0 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-do-reshard:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.33, ofs0, ns] 2024-09-14T11:37:29.819 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:37:29.820+0000 7fd731ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366239 cookie 93970484689696 notifier 6914 bl.length()=911 2024-09-14T11:37:29.819 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:37:29.820+0000 7fd731ffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-do-reshard:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.33 info.flags=0x17 2024-09-14T11:37:29.819 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:37:29.820+0000 7fd731ffb640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-do-reshard:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.33 to cache LRU end 2024-09-14T11:37:29.819 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:37:29.820+0000 7fd731ffb640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:37:29.822 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:37:29.824+0000 7fd8513bd9c0 20 handle_bi_update(): bucket=:error-at-do-reshard[d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.33]): orig_sources= new_sources= 2024-09-14T11:37:29.822 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:37:29.824+0000 7fd8513bd9c0 20 handle_bi_update(): bucket=:error-at-do-reshard[d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.33]): potential sources added=[] removed=[] 2024-09-14T11:37:29.822 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:37:29.824+0000 7fd8513bd9c0 20 handle_bi_update(): bucket=:error-at-do-reshard[d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.33]): orig_dests= new_dests= 2024-09-14T11:37:29.822 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:37:29.824+0000 7fd8513bd9c0 20 handle_bi_update(): bucket=:error-at-do-reshard[d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.33]): potential dests added=[] removed=[] 2024-09-14T11:37:29.828 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:37:29.832+0000 7fd8513bd9c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.33.0 2024-09-14T11:37:29.829 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:37:29.832+0000 7fd8513bd9c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.33.1 2024-09-14T11:37:29.830 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:37:29.832+0000 7fd8513bd9c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.33.2 2024-09-14T11:37:29.831 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:37:29.832+0000 7fd8513bd9c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.33.3 2024-09-14T11:37:29.831 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:37:29.836+0000 7fd8513bd9c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.33.4 2024-09-14T11:37:29.832 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:37:29.836+0000 7fd8513bd9c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.33.5 2024-09-14T11:37:29.832 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:37:29.836+0000 7fd8513bd9c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.33.6 2024-09-14T11:37:29.833 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:37:29.836+0000 7fd8513bd9c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.33.7 2024-09-14T11:37:29.834 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:37:29.836+0000 7fd8513bd9c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.33.8 2024-09-14T11:37:29.834 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:37:29.836+0000 7fd8513bd9c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.33.9 2024-09-14T11:37:29.835 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:37:29.836+0000 7fd8513bd9c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.33.10 2024-09-14T11:37:29.835 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:37:29.836+0000 7fd8513bd9c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-do-reshard:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.33 : hit (requested=0x17, cached=0x17) 2024-09-14T11:37:29.835 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:37:29.836+0000 7fd8513bd9c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-do-reshard:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.33 2024-09-14T11:37:29.837 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:37:29.840+0000 7fd8513bd9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-do-reshard:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.33 info.flags=0x17 2024-09-14T11:37:29.837 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:37:29.840+0000 7fd8513bd9c0 10 moving default.rgw.meta+root+.bucket.meta.error-at-do-reshard:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.33 to cache LRU end 2024-09-14T11:37:29.837 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:37:29.840+0000 7fd8513bd9c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:37:29.838 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:37:29.840+0000 7fd8513bd9c0 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-do-reshard:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.33, ofs0, ns] 2024-09-14T11:37:29.838 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:37:29.840+0000 7fd731ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366240 cookie 93970484689696 notifier 6914 bl.length()=879 2024-09-14T11:37:29.838 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:37:29.840+0000 7fd731ffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-do-reshard:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.33 info.flags=0x17 2024-09-14T11:37:29.838 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:37:29.840+0000 7fd731ffb640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-do-reshard:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.33 to cache LRU end 2024-09-14T11:37:29.838 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:37:29.840+0000 7fd731ffb640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:37:29.841 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:37:29.844+0000 7fd8513bd9c0 20 handle_bi_update(): bucket=:error-at-do-reshard[d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.33]): orig_sources= new_sources= 2024-09-14T11:37:29.841 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:37:29.844+0000 7fd8513bd9c0 20 handle_bi_update(): bucket=:error-at-do-reshard[d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.33]): potential sources added=[] removed=[] 2024-09-14T11:37:29.841 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:37:29.844+0000 7fd8513bd9c0 20 handle_bi_update(): bucket=:error-at-do-reshard[d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.33]): orig_dests= new_dests= 2024-09-14T11:37:29.841 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:37:29.844+0000 7fd8513bd9c0 20 handle_bi_update(): bucket=:error-at-do-reshard[d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.33]): potential dests added=[] removed=[] 2024-09-14T11:37:29.845 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:37:29.848+0000 7fd8513bd9c0 1 execute INFO: reshard of bucket "error-at-do-reshard" from 11 shards to 12 shards completed successfully 2024-09-14T11:37:29.848 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:37:29.852+0000 7fd7057e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:37:29.854 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:37:29.856+0000 7fd8513bd9c0 20 remove_watcher() i=0 2024-09-14T11:37:29.854 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:37:29.856+0000 7fd8513bd9c0 2 removed watcher, disabling cache 2024-09-14T11:37:29.856 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:37:29.860+0000 7fd8513bd9c0 20 remove_watcher() i=1 2024-09-14T11:37:29.858 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:37:29.860+0000 7fd8513bd9c0 20 remove_watcher() i=2 2024-09-14T11:37:29.861 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:37:29.864+0000 7fd8513bd9c0 20 remove_watcher() i=3 2024-09-14T11:37:29.863 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:37:29.864+0000 7fd8513bd9c0 20 remove_watcher() i=4 2024-09-14T11:37:29.865 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:37:29.868+0000 7fd8513bd9c0 20 remove_watcher() i=5 2024-09-14T11:37:29.866 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:37:29.868+0000 7fd8513bd9c0 20 remove_watcher() i=6 2024-09-14T11:37:29.868 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:37:29.872+0000 7fd8513bd9c0 20 remove_watcher() i=7 2024-09-14T11:37:29.883 INFO:tasks.workunit.client.0.smithi138.stderr:radosgw-admin bucket stats --bucket error-at-do-reshard 2024-09-14T11:37:29.910 INFO:tasks.workunit.client.0.smithi138.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:37:29.910 INFO:tasks.workunit.client.0.smithi138.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:37:29.954 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:37:29.956+0000 7fdda5f689c0 20 rados->read ofs=0 len=0 2024-09-14T11:37:29.957 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:37:29.960+0000 7fdda5f689c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:37:29.957 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:37:29.960+0000 7fdda5f689c0 20 realm 2024-09-14T11:37:29.957 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:37:29.960+0000 7fdda5f689c0 20 rados->read ofs=0 len=0 2024-09-14T11:37:29.957 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:37:29.960+0000 7fdda5f689c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:37:29.957 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:37:29.960+0000 7fdda5f689c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:37:29.957 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:37:29.960+0000 7fdda5f689c0 20 rados->read ofs=0 len=0 2024-09-14T11:37:29.957 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:37:29.960+0000 7fdda5f689c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:37:29.957 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:37:29.960+0000 7fdda5f689c0 20 rados->read ofs=0 len=0 2024-09-14T11:37:29.958 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:37:29.960+0000 7fdda5f689c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:37:29.958 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:37:29.960+0000 7fdda5f689c0 20 rados->read ofs=0 len=0 2024-09-14T11:37:29.959 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:37:29.960+0000 7fdda5f689c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:37:29.959 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:37:29.960+0000 7fdda5f689c0 20 searching for the correct realm 2024-09-14T11:37:29.964 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:37:29.968+0000 7fdd9bfff640 0 -- 172.21.15.138:0/1929182044 >> [v2:172.21.15.154:6808/1468088432,v1:172.21.15.154:6809/1468088432] conn(0x7fdd94027040 msgr2=0x7fdd940993d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:37:29.970 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:37:29.972+0000 7fdd9bfff640 0 -- 172.21.15.138:0/1929182044 >> [v2:172.21.15.138:6816/326481658,v1:172.21.15.138:6817/326481658] conn(0x7fdd9c0a9070 msgr2=0x7fdd9c0bf830 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:37:30.187 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:37:30.188+0000 7fdda5f689c0 20 RGWRados::pool_iterate: got zone_info.d9e72d30-c60b-4d0d-9267-fdc36392d5ad 2024-09-14T11:37:30.187 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:37:30.188+0000 7fdda5f689c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:37:30.187 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:37:30.188+0000 7fdda5f689c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:37:30.188 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:37:30.188+0000 7fdda5f689c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:37:30.188 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:37:30.188+0000 7fdda5f689c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:37:30.188 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:37:30.188+0000 7fdda5f689c0 20 RGWRados::pool_iterate: got zonegroup_info.65ab941b-da8c-4160-94fb-3672b069d44f 2024-09-14T11:37:30.188 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:37:30.188+0000 7fdda5f689c0 20 rados->read ofs=0 len=0 2024-09-14T11:37:30.188 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:37:30.192+0000 7fdda5f689c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:37:30.188 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:37:30.192+0000 7fdda5f689c0 20 rados->read ofs=0 len=0 2024-09-14T11:37:30.189 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:37:30.192+0000 7fdda5f689c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:37:30.189 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:37:30.192+0000 7fdda5f689c0 20 rados->read ofs=0 len=0 2024-09-14T11:37:30.190 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:37:30.192+0000 7fdda5f689c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:37:30.190 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:37:30.192+0000 7fdda5f689c0 20 zone default found 2024-09-14T11:37:30.190 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:37:30.192+0000 7fdda5f689c0 4 Realm: () 2024-09-14T11:37:30.190 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:37:30.192+0000 7fdda5f689c0 4 ZoneGroup: default (65ab941b-da8c-4160-94fb-3672b069d44f) 2024-09-14T11:37:30.190 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:37:30.192+0000 7fdda5f689c0 4 Zone: default (d9e72d30-c60b-4d0d-9267-fdc36392d5ad) 2024-09-14T11:37:30.190 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:37:30.192+0000 7fdda5f689c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:37:30.190 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:37:30.192+0000 7fdda5f689c0 20 zonegroup default 2024-09-14T11:37:30.190 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:37:30.192+0000 7fdda5f689c0 20 rados->read ofs=0 len=0 2024-09-14T11:37:30.190 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:37:30.192+0000 7fdda5f689c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:37:30.191 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:37:30.192+0000 7fdda5f689c0 20 rados->read ofs=0 len=0 2024-09-14T11:37:30.191 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:37:30.196+0000 7fdda5f689c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:37:30.191 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:37:30.196+0000 7fdda5f689c0 20 rados->read ofs=0 len=0 2024-09-14T11:37:30.192 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:37:30.196+0000 7fdda5f689c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:37:30.192 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:37:30.196+0000 7fdda5f689c0 20 started sync module instance, tier type = 2024-09-14T11:37:30.192 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:37:30.196+0000 7fdda5f689c0 20 started zone id=d9e72d30-c60b-4d0d-9267-fdc36392d5ad (name=default) with tier type = 2024-09-14T11:37:30.215 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:37:30.216+0000 7fdda5f689c0 20 add_watcher() i=0 2024-09-14T11:37:30.215 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:37:30.216+0000 7fdda5f689c0 20 add_watcher() i=1 2024-09-14T11:37:30.215 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:37:30.216+0000 7fdda5f689c0 20 add_watcher() i=2 2024-09-14T11:37:30.215 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:37:30.216+0000 7fdda5f689c0 20 add_watcher() i=3 2024-09-14T11:37:30.215 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:37:30.216+0000 7fdda5f689c0 20 add_watcher() i=4 2024-09-14T11:37:30.215 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:37:30.216+0000 7fdda5f689c0 20 add_watcher() i=5 2024-09-14T11:37:30.215 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:37:30.216+0000 7fdda5f689c0 20 add_watcher() i=6 2024-09-14T11:37:30.217 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:37:30.220+0000 7fdda5f689c0 20 add_watcher() i=7 2024-09-14T11:37:30.217 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:37:30.220+0000 7fdda5f689c0 2 all 8 watchers are set, enabling cache 2024-09-14T11:37:30.220 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:37:30.224+0000 7fdc59fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:37:30.220 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:37:30.224+0000 7fdda5f689c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:37:30.221 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:37:30.224+0000 7fdda5f689c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:37:30.221 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:37:30.224+0000 7fdda5f689c0 5 note: GC not initialized 2024-09-14T11:37:30.221 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:37:30.224+0000 7fdc58fe1640 20 reqs_thread_entry: start 2024-09-14T11:37:30.221 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:37:30.224+0000 7fdda5f689c0 20 init_complete bucket index max shards: 11 2024-09-14T11:37:30.222 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:37:30.224+0000 7fdda5f689c0 20 Filter name: none 2024-09-14T11:37:30.222 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:37:30.224+0000 7fdbd27fc640 20 reqs_thread_entry: start 2024-09-14T11:37:30.222 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:37:30.224+0000 7fdda5f689c0 20 rados->read ofs=0 len=0 2024-09-14T11:37:30.222 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:37:30.224+0000 7fdda5f689c0 20 rados_obj.operate() r=0 bl.length=187 2024-09-14T11:37:30.222 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:37:30.224+0000 7fdda5f689c0 20 rados->read ofs=0 len=0 2024-09-14T11:37:30.223 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:37:30.224+0000 7fdda5f689c0 20 rados_obj.operate() r=0 bl.length=409 2024-09-14T11:37:30.223 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:37:30.224+0000 7fdda5f689c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:37:30.223 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:37:30.224+0000 7fdda5f689c0 20 rados->read ofs=0 len=0 2024-09-14T11:37:30.223 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:37:30.224+0000 7fdda5f689c0 20 rados_obj.operate() r=0 bl.length=187 2024-09-14T11:37:30.223 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:37:30.224+0000 7fdda5f689c0 20 rados->read ofs=0 len=0 2024-09-14T11:37:30.224 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:37:30.228+0000 7fdda5f689c0 20 rados_obj.operate() r=0 bl.length=409 2024-09-14T11:37:30.224 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:37:30.228+0000 7fdda5f689c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:37:30.227 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:37:30.228+0000 7fdc59fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:37:30.232 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:37:30.236+0000 7fdda5f689c0 20 remove_watcher() i=0 2024-09-14T11:37:30.232 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:37:30.236+0000 7fdda5f689c0 2 removed watcher, disabling cache 2024-09-14T11:37:30.234 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:37:30.236+0000 7fdda5f689c0 20 remove_watcher() i=1 2024-09-14T11:37:30.236 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:37:30.240+0000 7fdda5f689c0 20 remove_watcher() i=2 2024-09-14T11:37:30.238 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:37:30.240+0000 7fdda5f689c0 20 remove_watcher() i=3 2024-09-14T11:37:30.241 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:37:30.244+0000 7fdda5f689c0 20 remove_watcher() i=4 2024-09-14T11:37:30.242 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:37:30.244+0000 7fdda5f689c0 20 remove_watcher() i=5 2024-09-14T11:37:30.244 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:37:30.248+0000 7fdda5f689c0 20 remove_watcher() i=6 2024-09-14T11:37:30.245 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:37:30.248+0000 7fdda5f689c0 20 remove_watcher() i=7 2024-09-14T11:37:30.260 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-14T11:37:30.260 INFO:tasks.workunit.client.0.smithi138.stderr:BUCKET_STATS: 2024-09-14T11:37:30.260 INFO:tasks.workunit.client.0.smithi138.stderr:bucket: error-at-do-reshard id: d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.33 num_objects: 19 size_kb: 1 num_shards: 12 2024-09-14T11:37:30.260 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-14T11:37:30.261 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:37:30.261 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-14T11:37:30.289 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:37:30.289 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-14T11:37:30.744 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:37:30.744 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-14T11:37:31.145 INFO:tasks.workunit.client.0.smithi138.stderr:TEST: reshard bucket with abort at do_reshard 2024-09-14T11:37:31.145 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-14T11:37:31.148 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:37:31.148 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-14T11:37:31.283 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:37:31.284 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-14T11:37:31.372 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:37:31.372 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-14T11:37:31.478 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:37:31.478 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-14T11:37:31.574 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:37:31.574 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-14T11:37:31.665 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:37:31.665 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-14T11:37:31.752 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:37:31.752 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-14T11:37:31.849 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:37:31.849 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-14T11:37:31.932 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:37:31.933 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-14T11:37:32.022 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:37:32.022 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-14T11:37:32.111 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:37:32.111 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-14T11:37:32.197 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:37:32.197 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-14T11:37:32.295 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:37:32.295 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-14T11:37:32.391 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:37:32.391 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-14T11:37:32.486 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:37:32.486 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-14T11:37:32.580 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:37:32.580 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-14T11:37:32.672 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:37:32.672 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-14T11:37:32.767 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:37:32.767 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-14T11:37:32.861 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:37:32.861 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-14T11:37:32.960 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:37:32.960 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-14T11:37:33.048 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:37:33.048 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-14T11:37:33.138 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:37:33.139 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-14T11:37:33.226 INFO:tasks.workunit.client.0.smithi138.stderr:radosgw-admin bucket stats --bucket abort-at-do-reshard 2024-09-14T11:37:33.258 INFO:tasks.workunit.client.0.smithi138.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:37:33.258 INFO:tasks.workunit.client.0.smithi138.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:37:33.304 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:37:33.307+0000 7eff45bcc9c0 20 rados->read ofs=0 len=0 2024-09-14T11:37:33.307 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:37:33.307+0000 7eff45bcc9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:37:33.307 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:37:33.307+0000 7eff45bcc9c0 20 realm 2024-09-14T11:37:33.307 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:37:33.307+0000 7eff45bcc9c0 20 rados->read ofs=0 len=0 2024-09-14T11:37:33.307 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:37:33.307+0000 7eff45bcc9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:37:33.307 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:37:33.307+0000 7eff45bcc9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:37:33.307 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:37:33.307+0000 7eff45bcc9c0 20 rados->read ofs=0 len=0 2024-09-14T11:37:33.307 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:37:33.307+0000 7eff45bcc9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:37:33.307 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:37:33.307+0000 7eff45bcc9c0 20 rados->read ofs=0 len=0 2024-09-14T11:37:33.308 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:37:33.311+0000 7eff45bcc9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:37:33.309 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:37:33.311+0000 7eff45bcc9c0 20 rados->read ofs=0 len=0 2024-09-14T11:37:33.309 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:37:33.311+0000 7eff45bcc9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:37:33.309 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:37:33.311+0000 7eff45bcc9c0 20 searching for the correct realm 2024-09-14T11:37:33.310 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:37:33.311+0000 7eff42ed1640 0 -- 172.21.15.138:0/3645519923 >> [v2:172.21.15.154:6808/1468088432,v1:172.21.15.154:6809/1468088432] conn(0x7eff340c0020 msgr2=0x7eff340c1180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:37:33.523 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:37:33.523+0000 7eff43ed3640 0 -- 172.21.15.138:0/3645519923 >> [v2:172.21.15.138:6824/2633984942,v1:172.21.15.138:6825/2633984942] conn(0x55576c6c45e0 msgr2=0x55576c6c69d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:37:33.540 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:37:33.543+0000 7eff45bcc9c0 20 RGWRados::pool_iterate: got zone_info.d9e72d30-c60b-4d0d-9267-fdc36392d5ad 2024-09-14T11:37:33.540 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:37:33.543+0000 7eff45bcc9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:37:33.540 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:37:33.543+0000 7eff45bcc9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:37:33.540 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:37:33.543+0000 7eff45bcc9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:37:33.540 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:37:33.543+0000 7eff45bcc9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:37:33.540 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:37:33.543+0000 7eff45bcc9c0 20 RGWRados::pool_iterate: got zonegroup_info.65ab941b-da8c-4160-94fb-3672b069d44f 2024-09-14T11:37:33.540 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:37:33.543+0000 7eff45bcc9c0 20 rados->read ofs=0 len=0 2024-09-14T11:37:33.540 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:37:33.543+0000 7eff45bcc9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:37:33.541 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:37:33.543+0000 7eff45bcc9c0 20 rados->read ofs=0 len=0 2024-09-14T11:37:33.541 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:37:33.543+0000 7eff45bcc9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:37:33.541 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:37:33.543+0000 7eff45bcc9c0 20 rados->read ofs=0 len=0 2024-09-14T11:37:33.542 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:37:33.543+0000 7eff45bcc9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:37:33.542 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:37:33.543+0000 7eff45bcc9c0 20 zone default found 2024-09-14T11:37:33.542 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:37:33.543+0000 7eff45bcc9c0 4 Realm: () 2024-09-14T11:37:33.542 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:37:33.543+0000 7eff45bcc9c0 4 ZoneGroup: default (65ab941b-da8c-4160-94fb-3672b069d44f) 2024-09-14T11:37:33.542 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:37:33.543+0000 7eff45bcc9c0 4 Zone: default (d9e72d30-c60b-4d0d-9267-fdc36392d5ad) 2024-09-14T11:37:33.542 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:37:33.543+0000 7eff45bcc9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:37:33.542 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:37:33.543+0000 7eff45bcc9c0 20 zonegroup default 2024-09-14T11:37:33.542 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:37:33.543+0000 7eff45bcc9c0 20 rados->read ofs=0 len=0 2024-09-14T11:37:33.543 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:37:33.543+0000 7eff45bcc9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:37:33.543 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:37:33.543+0000 7eff45bcc9c0 20 rados->read ofs=0 len=0 2024-09-14T11:37:33.543 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:37:33.543+0000 7eff45bcc9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:37:33.543 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:37:33.547+0000 7eff45bcc9c0 20 rados->read ofs=0 len=0 2024-09-14T11:37:33.544 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:37:33.547+0000 7eff45bcc9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:37:33.544 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:37:33.547+0000 7eff45bcc9c0 20 started sync module instance, tier type = 2024-09-14T11:37:33.544 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:37:33.547+0000 7eff45bcc9c0 20 started zone id=d9e72d30-c60b-4d0d-9267-fdc36392d5ad (name=default) with tier type = 2024-09-14T11:37:33.566 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:37:33.567+0000 7eff45bcc9c0 20 add_watcher() i=0 2024-09-14T11:37:33.567 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:37:33.567+0000 7eff45bcc9c0 20 add_watcher() i=1 2024-09-14T11:37:33.567 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:37:33.567+0000 7eff45bcc9c0 20 add_watcher() i=2 2024-09-14T11:37:33.567 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:37:33.567+0000 7eff45bcc9c0 20 add_watcher() i=3 2024-09-14T11:37:33.567 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:37:33.567+0000 7eff45bcc9c0 20 add_watcher() i=4 2024-09-14T11:37:33.567 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:37:33.567+0000 7eff45bcc9c0 20 add_watcher() i=5 2024-09-14T11:37:33.567 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:37:33.567+0000 7eff45bcc9c0 20 add_watcher() i=6 2024-09-14T11:37:33.572 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:37:33.575+0000 7eff45bcc9c0 20 add_watcher() i=7 2024-09-14T11:37:33.572 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:37:33.575+0000 7eff45bcc9c0 2 all 8 watchers are set, enabling cache 2024-09-14T11:37:33.576 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:37:33.579+0000 7efdf9fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:37:33.577 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:37:33.579+0000 7eff45bcc9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:37:33.577 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:37:33.579+0000 7eff45bcc9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:37:33.577 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:37:33.579+0000 7eff45bcc9c0 5 note: GC not initialized 2024-09-14T11:37:33.578 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:37:33.579+0000 7efdf8fe1640 20 reqs_thread_entry: start 2024-09-14T11:37:33.578 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:37:33.579+0000 7eff45bcc9c0 20 init_complete bucket index max shards: 11 2024-09-14T11:37:33.578 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:37:33.579+0000 7eff45bcc9c0 20 Filter name: none 2024-09-14T11:37:33.579 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:37:33.579+0000 7efd727fc640 20 reqs_thread_entry: start 2024-09-14T11:37:33.579 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:37:33.579+0000 7eff45bcc9c0 20 rados->read ofs=0 len=0 2024-09-14T11:37:33.580 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:37:33.583+0000 7eff45bcc9c0 20 rados_obj.operate() r=0 bl.length=187 2024-09-14T11:37:33.580 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:37:33.583+0000 7eff45bcc9c0 20 rados->read ofs=0 len=0 2024-09-14T11:37:33.581 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:37:33.583+0000 7eff45bcc9c0 20 rados_obj.operate() r=0 bl.length=409 2024-09-14T11:37:33.581 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:37:33.583+0000 7eff45bcc9c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:37:33.582 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:37:33.583+0000 7eff45bcc9c0 20 rados->read ofs=0 len=0 2024-09-14T11:37:33.582 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:37:33.583+0000 7eff45bcc9c0 20 rados_obj.operate() r=0 bl.length=187 2024-09-14T11:37:33.582 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:37:33.583+0000 7eff45bcc9c0 20 rados->read ofs=0 len=0 2024-09-14T11:37:33.583 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:37:33.583+0000 7eff45bcc9c0 20 rados_obj.operate() r=0 bl.length=409 2024-09-14T11:37:33.583 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:37:33.583+0000 7eff45bcc9c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:37:33.586 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:37:33.587+0000 7efdf9fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:37:33.591 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:37:33.591+0000 7eff45bcc9c0 20 remove_watcher() i=0 2024-09-14T11:37:33.591 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:37:33.591+0000 7eff45bcc9c0 2 removed watcher, disabling cache 2024-09-14T11:37:33.593 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:37:33.595+0000 7eff45bcc9c0 20 remove_watcher() i=1 2024-09-14T11:37:33.595 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:37:33.595+0000 7eff45bcc9c0 20 remove_watcher() i=2 2024-09-14T11:37:33.597 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:37:33.599+0000 7eff45bcc9c0 20 remove_watcher() i=3 2024-09-14T11:37:33.599 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:37:33.603+0000 7eff45bcc9c0 20 remove_watcher() i=4 2024-09-14T11:37:33.601 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:37:33.603+0000 7eff45bcc9c0 20 remove_watcher() i=5 2024-09-14T11:37:33.602 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:37:33.603+0000 7eff45bcc9c0 20 remove_watcher() i=6 2024-09-14T11:37:33.604 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:37:33.607+0000 7eff45bcc9c0 20 remove_watcher() i=7 2024-09-14T11:37:33.618 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-14T11:37:33.619 INFO:tasks.workunit.client.0.smithi138.stderr:BUCKET_STATS: 2024-09-14T11:37:33.619 INFO:tasks.workunit.client.0.smithi138.stderr:bucket: abort-at-do-reshard id: d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.34 num_objects: 20 size_kb: 1 num_shards: 11 2024-09-14T11:37:33.619 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-14T11:37:33.619 INFO:tasks.workunit.client.0.smithi138.stderr:radosgw-admin bucket reshard --bucket abort-at-do-reshard --num-shards 12 --rgw-reshard-bucket-lock-duration 30 --inject-abort-at do_reshard 2024-09-14T11:37:33.656 INFO:tasks.workunit.client.0.smithi138.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:37:33.656 INFO:tasks.workunit.client.0.smithi138.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:37:33.700 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:37:33.703+0000 7fd561ddd9c0 20 rados->read ofs=0 len=0 2024-09-14T11:37:33.702 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:37:33.703+0000 7fd561ddd9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:37:33.702 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:37:33.703+0000 7fd561ddd9c0 20 realm 2024-09-14T11:37:33.702 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:37:33.703+0000 7fd561ddd9c0 20 rados->read ofs=0 len=0 2024-09-14T11:37:33.703 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:37:33.703+0000 7fd561ddd9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:37:33.703 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:37:33.703+0000 7fd561ddd9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:37:33.703 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:37:33.703+0000 7fd561ddd9c0 20 rados->read ofs=0 len=0 2024-09-14T11:37:33.703 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:37:33.703+0000 7fd561ddd9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:37:33.703 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:37:33.703+0000 7fd561ddd9c0 20 rados->read ofs=0 len=0 2024-09-14T11:37:33.705 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:37:33.707+0000 7fd561ddd9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:37:33.705 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:37:33.707+0000 7fd561ddd9c0 20 rados->read ofs=0 len=0 2024-09-14T11:37:33.705 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:37:33.707+0000 7fd561ddd9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:37:33.705 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:37:33.707+0000 7fd561ddd9c0 20 searching for the correct realm 2024-09-14T11:37:33.709 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:37:33.711+0000 7fd5600e4640 0 -- 172.21.15.138:0/2435175307 >> [v2:172.21.15.154:6824/416768175,v1:172.21.15.154:6825/416768175] conn(0x7fd5580fe920 msgr2=0x7fd558105290 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-14T11:37:33.924 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:37:33.927+0000 7fd55f0e2640 0 -- 172.21.15.138:0/2435175307 >> [v2:172.21.15.138:6816/326481658,v1:172.21.15.138:6817/326481658] conn(0x7fd558134390 msgr2=0x7fd5581180b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:37:34.143 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:37:34.143+0000 7fd561ddd9c0 20 RGWRados::pool_iterate: got zone_info.d9e72d30-c60b-4d0d-9267-fdc36392d5ad 2024-09-14T11:37:34.143 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:37:34.143+0000 7fd561ddd9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:37:34.143 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:37:34.143+0000 7fd561ddd9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:37:34.143 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:37:34.143+0000 7fd561ddd9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:37:34.143 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:37:34.143+0000 7fd561ddd9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:37:34.143 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:37:34.143+0000 7fd561ddd9c0 20 RGWRados::pool_iterate: got zonegroup_info.65ab941b-da8c-4160-94fb-3672b069d44f 2024-09-14T11:37:34.143 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:37:34.143+0000 7fd561ddd9c0 20 rados->read ofs=0 len=0 2024-09-14T11:37:34.144 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:37:34.143+0000 7fd561ddd9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:37:34.144 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:37:34.143+0000 7fd561ddd9c0 20 rados->read ofs=0 len=0 2024-09-14T11:37:34.144 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:37:34.147+0000 7fd561ddd9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:37:34.144 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:37:34.147+0000 7fd561ddd9c0 20 rados->read ofs=0 len=0 2024-09-14T11:37:34.145 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:37:34.147+0000 7fd561ddd9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:37:34.146 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:37:34.147+0000 7fd561ddd9c0 20 zone default found 2024-09-14T11:37:34.146 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:37:34.147+0000 7fd561ddd9c0 4 Realm: () 2024-09-14T11:37:34.146 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:37:34.147+0000 7fd561ddd9c0 4 ZoneGroup: default (65ab941b-da8c-4160-94fb-3672b069d44f) 2024-09-14T11:37:34.146 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:37:34.147+0000 7fd561ddd9c0 4 Zone: default (d9e72d30-c60b-4d0d-9267-fdc36392d5ad) 2024-09-14T11:37:34.146 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:37:34.147+0000 7fd561ddd9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:37:34.146 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:37:34.147+0000 7fd561ddd9c0 20 zonegroup default 2024-09-14T11:37:34.146 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:37:34.147+0000 7fd561ddd9c0 20 rados->read ofs=0 len=0 2024-09-14T11:37:34.146 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:37:34.147+0000 7fd561ddd9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:37:34.146 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:37:34.147+0000 7fd561ddd9c0 20 rados->read ofs=0 len=0 2024-09-14T11:37:34.147 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:37:34.147+0000 7fd561ddd9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:37:34.147 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:37:34.147+0000 7fd561ddd9c0 20 rados->read ofs=0 len=0 2024-09-14T11:37:34.148 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:37:34.151+0000 7fd561ddd9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:37:34.148 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:37:34.151+0000 7fd561ddd9c0 20 started sync module instance, tier type = 2024-09-14T11:37:34.148 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:37:34.151+0000 7fd561ddd9c0 20 started zone id=d9e72d30-c60b-4d0d-9267-fdc36392d5ad (name=default) with tier type = 2024-09-14T11:37:34.172 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:37:34.175+0000 7fd561ddd9c0 20 add_watcher() i=0 2024-09-14T11:37:34.172 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:37:34.175+0000 7fd561ddd9c0 20 add_watcher() i=1 2024-09-14T11:37:34.172 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:37:34.175+0000 7fd561ddd9c0 20 add_watcher() i=2 2024-09-14T11:37:34.173 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:37:34.175+0000 7fd561ddd9c0 20 add_watcher() i=3 2024-09-14T11:37:34.173 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:37:34.175+0000 7fd561ddd9c0 20 add_watcher() i=4 2024-09-14T11:37:34.173 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:37:34.175+0000 7fd561ddd9c0 20 add_watcher() i=5 2024-09-14T11:37:34.173 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:37:34.175+0000 7fd561ddd9c0 20 add_watcher() i=6 2024-09-14T11:37:34.175 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:37:34.179+0000 7fd561ddd9c0 20 add_watcher() i=7 2024-09-14T11:37:34.176 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:37:34.179+0000 7fd561ddd9c0 2 all 8 watchers are set, enabling cache 2024-09-14T11:37:34.180 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:37:34.183+0000 7fd415fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:37:34.181 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:37:34.183+0000 7fd561ddd9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:37:34.181 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:37:34.183+0000 7fd561ddd9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:37:34.181 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:37:34.183+0000 7fd561ddd9c0 5 note: GC not initialized 2024-09-14T11:37:34.182 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:37:34.183+0000 7fd414fe1640 20 reqs_thread_entry: start 2024-09-14T11:37:34.182 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:37:34.183+0000 7fd561ddd9c0 20 init_complete bucket index max shards: 11 2024-09-14T11:37:34.182 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:37:34.183+0000 7fd561ddd9c0 20 Filter name: none 2024-09-14T11:37:34.182 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:37:34.183+0000 7fd38e7fc640 20 reqs_thread_entry: start 2024-09-14T11:37:34.183 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:37:34.183+0000 7fd561ddd9c0 10 cache get: name=default.rgw.meta+root+abort-at-do-reshard : miss 2024-09-14T11:37:34.183 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:37:34.183+0000 7fd561ddd9c0 20 rados->read ofs=0 len=0 2024-09-14T11:37:34.183 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:37:34.187+0000 7fd561ddd9c0 20 rados_obj.operate() r=0 bl.length=187 2024-09-14T11:37:34.183 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:37:34.187+0000 7fd561ddd9c0 10 cache put: name=default.rgw.meta+root+abort-at-do-reshard info.flags=0x11 2024-09-14T11:37:34.184 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:37:34.187+0000 7fd561ddd9c0 10 adding default.rgw.meta+root+abort-at-do-reshard to cache LRU end 2024-09-14T11:37:34.184 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:37:34.187+0000 7fd561ddd9c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.34 : miss 2024-09-14T11:37:34.184 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:37:34.187+0000 7fd561ddd9c0 20 rados->read ofs=0 len=0 2024-09-14T11:37:34.185 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:37:34.187+0000 7fd561ddd9c0 20 rados_obj.operate() r=0 bl.length=409 2024-09-14T11:37:34.185 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:37:34.187+0000 7fd561ddd9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.34 info.flags=0x17 2024-09-14T11:37:34.185 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:37:34.187+0000 7fd561ddd9c0 10 adding default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.34 to cache LRU end 2024-09-14T11:37:34.185 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:37:34.187+0000 7fd561ddd9c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:37:34.185 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:37:34.187+0000 7fd561ddd9c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:37:34.185 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:37:34.187+0000 7fd561ddd9c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.34 2024-09-14T11:37:34.196 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:37:34.199+0000 7fd561ddd9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.34 info.flags=0x17 2024-09-14T11:37:34.196 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:37:34.199+0000 7fd561ddd9c0 10 moving default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.34 to cache LRU end 2024-09-14T11:37:34.196 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:37:34.199+0000 7fd561ddd9c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:37:34.196 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:37:34.199+0000 7fd561ddd9c0 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-do-reshard:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.34, ofs0, ns] 2024-09-14T11:37:34.197 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:37:34.199+0000 7fd43e7fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366215 cookie 94554673513184 notifier 7440 bl.length()=911 2024-09-14T11:37:34.197 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:37:34.199+0000 7fd43e7fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.34 info.flags=0x17 2024-09-14T11:37:34.197 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:37:34.199+0000 7fd43e7fc640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.34 to cache LRU end 2024-09-14T11:37:34.197 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:37:34.199+0000 7fd43e7fc640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:37:34.200 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:37:34.203+0000 7fd561ddd9c0 20 handle_bi_update(): bucket=:abort-at-do-reshard[d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.34]): orig_sources= new_sources= 2024-09-14T11:37:34.200 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:37:34.203+0000 7fd561ddd9c0 20 handle_bi_update(): bucket=:abort-at-do-reshard[d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.34]): potential sources added=[] removed=[] 2024-09-14T11:37:34.200 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:37:34.203+0000 7fd561ddd9c0 20 handle_bi_update(): bucket=:abort-at-do-reshard[d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.34]): orig_dests= new_dests= 2024-09-14T11:37:34.201 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:37:34.203+0000 7fd561ddd9c0 20 handle_bi_update(): bucket=:abort-at-do-reshard[d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.34]): potential dests added=[] removed=[] 2024-09-14T11:37:34.211 INFO:tasks.workunit.client.0.smithi138.stderr:./src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7fd561ddd9c0 time 2024-09-14T11:37:34.216403+0000 2024-09-14T11:37:34.211 INFO:tasks.workunit.client.0.smithi138.stderr:./src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-14T11:37:34.212 INFO:tasks.workunit.client.0.smithi138.stderr: ceph version 19.3.0-4907-ga2782315 (a2782315255a3e7d5f6cdc9eb35785187ff6ddf8) squid (dev) 2024-09-14T11:37:34.212 INFO:tasks.workunit.client.0.smithi138.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x121) [0x7fd5656b72eb] 2024-09-14T11:37:34.212 INFO:tasks.workunit.client.0.smithi138.stderr: 2: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7fd5656b749f] 2024-09-14T11:37:34.212 INFO:tasks.workunit.client.0.smithi138.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55ff38334c01] 2024-09-14T11:37:34.212 INFO:tasks.workunit.client.0.smithi138.stderr: 4: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x17a) [0x55ff38349f3a] 2024-09-14T11:37:34.212 INFO:tasks.workunit.client.0.smithi138.stderr: 5: main() 2024-09-14T11:37:34.212 INFO:tasks.workunit.client.0.smithi138.stderr: 6: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7fd56451dd90] 2024-09-14T11:37:34.212 INFO:tasks.workunit.client.0.smithi138.stderr: 7: __libc_start_main() 2024-09-14T11:37:34.212 INFO:tasks.workunit.client.0.smithi138.stderr: 8: _start() 2024-09-14T11:37:34.213 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:37:34.215+0000 7fd561ddd9c0 -1 ./src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7fd561ddd9c0 time 2024-09-14T11:37:34.216403+0000 2024-09-14T11:37:34.213 INFO:tasks.workunit.client.0.smithi138.stderr:./src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-14T11:37:34.213 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-14T11:37:34.213 INFO:tasks.workunit.client.0.smithi138.stderr: ceph version 19.3.0-4907-ga2782315 (a2782315255a3e7d5f6cdc9eb35785187ff6ddf8) squid (dev) 2024-09-14T11:37:34.213 INFO:tasks.workunit.client.0.smithi138.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x121) [0x7fd5656b72eb] 2024-09-14T11:37:34.213 INFO:tasks.workunit.client.0.smithi138.stderr: 2: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7fd5656b749f] 2024-09-14T11:37:34.213 INFO:tasks.workunit.client.0.smithi138.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55ff38334c01] 2024-09-14T11:37:34.213 INFO:tasks.workunit.client.0.smithi138.stderr: 4: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x17a) [0x55ff38349f3a] 2024-09-14T11:37:34.213 INFO:tasks.workunit.client.0.smithi138.stderr: 5: main() 2024-09-14T11:37:34.213 INFO:tasks.workunit.client.0.smithi138.stderr: 6: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7fd56451dd90] 2024-09-14T11:37:34.213 INFO:tasks.workunit.client.0.smithi138.stderr: 7: __libc_start_main() 2024-09-14T11:37:34.213 INFO:tasks.workunit.client.0.smithi138.stderr: 8: _start() 2024-09-14T11:37:34.213 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-14T11:37:34.213 INFO:tasks.workunit.client.0.smithi138.stderr:*** Caught signal (Aborted) ** 2024-09-14T11:37:34.214 INFO:tasks.workunit.client.0.smithi138.stderr: in thread 7fd561ddd9c0 thread_name:radosgw-admin 2024-09-14T11:37:34.230 INFO:tasks.workunit.client.0.smithi138.stderr: ceph version 19.3.0-4907-ga2782315 (a2782315255a3e7d5f6cdc9eb35785187ff6ddf8) squid (dev) 2024-09-14T11:37:34.230 INFO:tasks.workunit.client.0.smithi138.stderr: 1: /lib/x86_64-linux-gnu/libc.so.6(+0x42520) [0x7fd564536520] 2024-09-14T11:37:34.230 INFO:tasks.workunit.client.0.smithi138.stderr: 2: pthread_kill() 2024-09-14T11:37:34.230 INFO:tasks.workunit.client.0.smithi138.stderr: 3: raise() 2024-09-14T11:37:34.231 INFO:tasks.workunit.client.0.smithi138.stderr: 4: abort() 2024-09-14T11:37:34.231 INFO:tasks.workunit.client.0.smithi138.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x17b) [0x7fd5656b7345] 2024-09-14T11:37:34.231 INFO:tasks.workunit.client.0.smithi138.stderr: 6: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7fd5656b749f] 2024-09-14T11:37:34.231 INFO:tasks.workunit.client.0.smithi138.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55ff38334c01] 2024-09-14T11:37:34.231 INFO:tasks.workunit.client.0.smithi138.stderr: 8: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x17a) [0x55ff38349f3a] 2024-09-14T11:37:34.231 INFO:tasks.workunit.client.0.smithi138.stderr: 9: main() 2024-09-14T11:37:34.231 INFO:tasks.workunit.client.0.smithi138.stderr: 10: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7fd56451dd90] 2024-09-14T11:37:34.231 INFO:tasks.workunit.client.0.smithi138.stderr: 11: __libc_start_main() 2024-09-14T11:37:34.231 INFO:tasks.workunit.client.0.smithi138.stderr: 12: _start() 2024-09-14T11:37:34.231 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:37:34.215+0000 7fd561ddd9c0 -1 *** Caught signal (Aborted) ** 2024-09-14T11:37:34.231 INFO:tasks.workunit.client.0.smithi138.stderr: in thread 7fd561ddd9c0 thread_name:radosgw-admin 2024-09-14T11:37:34.231 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-14T11:37:34.231 INFO:tasks.workunit.client.0.smithi138.stderr: ceph version 19.3.0-4907-ga2782315 (a2782315255a3e7d5f6cdc9eb35785187ff6ddf8) squid (dev) 2024-09-14T11:37:34.231 INFO:tasks.workunit.client.0.smithi138.stderr: 1: /lib/x86_64-linux-gnu/libc.so.6(+0x42520) [0x7fd564536520] 2024-09-14T11:37:34.231 INFO:tasks.workunit.client.0.smithi138.stderr: 2: pthread_kill() 2024-09-14T11:37:34.232 INFO:tasks.workunit.client.0.smithi138.stderr: 3: raise() 2024-09-14T11:37:34.232 INFO:tasks.workunit.client.0.smithi138.stderr: 4: abort() 2024-09-14T11:37:34.232 INFO:tasks.workunit.client.0.smithi138.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x17b) [0x7fd5656b7345] 2024-09-14T11:37:34.232 INFO:tasks.workunit.client.0.smithi138.stderr: 6: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7fd5656b749f] 2024-09-14T11:37:34.232 INFO:tasks.workunit.client.0.smithi138.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55ff38334c01] 2024-09-14T11:37:34.232 INFO:tasks.workunit.client.0.smithi138.stderr: 8: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x17a) [0x55ff38349f3a] 2024-09-14T11:37:34.232 INFO:tasks.workunit.client.0.smithi138.stderr: 9: main() 2024-09-14T11:37:34.232 INFO:tasks.workunit.client.0.smithi138.stderr: 10: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7fd56451dd90] 2024-09-14T11:37:34.232 INFO:tasks.workunit.client.0.smithi138.stderr: 11: __libc_start_main() 2024-09-14T11:37:34.232 INFO:tasks.workunit.client.0.smithi138.stderr: 12: _start() 2024-09-14T11:37:34.232 INFO:tasks.workunit.client.0.smithi138.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-14T11:37:34.232 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-14T11:37:34.232 INFO:tasks.workunit.client.0.smithi138.stderr:--- begin dump of recent events --- 2024-09-14T11:37:34.233 INFO:tasks.workunit.client.0.smithi138.stderr: -499> 2024-09-14T11:37:33.679+0000 7fd55f0e2640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:37:34.233 INFO:tasks.workunit.client.0.smithi138.stderr: -498> 2024-09-14T11:37:33.679+0000 7fd55f0e2640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:37:34.233 INFO:tasks.workunit.client.0.smithi138.stderr: -497> 2024-09-14T11:37:33.679+0000 7fd55f0e2640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:37:34.233 INFO:tasks.workunit.client.0.smithi138.stderr: -496> 2024-09-14T11:37:33.679+0000 7fd55f8e3640 10 monclient(hunting): handle_auth_done global_id 7428 payload 274 2024-09-14T11:37:34.233 INFO:tasks.workunit.client.0.smithi138.stderr: -495> 2024-09-14T11:37:33.679+0000 7fd55f8e3640 10 monclient: _finish_hunting 0 2024-09-14T11:37:34.233 INFO:tasks.workunit.client.0.smithi138.stderr: -494> 2024-09-14T11:37:33.679+0000 7fd55f8e3640 1 monclient: found mon.noname-a 2024-09-14T11:37:34.233 INFO:tasks.workunit.client.0.smithi138.stderr: -493> 2024-09-14T11:37:33.679+0000 7fd55f8e3640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.138:3300/0 2024-09-14T11:37:34.233 INFO:tasks.workunit.client.0.smithi138.stderr: -492> 2024-09-14T11:37:33.679+0000 7fd44de0b640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:37:34.233 INFO:tasks.workunit.client.0.smithi138.stderr: -491> 2024-09-14T11:37:33.679+0000 7fd44de0b640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-14T11:37:34.233 INFO:tasks.workunit.client.0.smithi138.stderr: -490> 2024-09-14T11:37:33.679+0000 7fd44de0b640 10 monclient: dump: 2024-09-14T11:37:34.233 INFO:tasks.workunit.client.0.smithi138.stderr:epoch 1 2024-09-14T11:37:34.233 INFO:tasks.workunit.client.0.smithi138.stderr:fsid 3f225f43-83a6-4aeb-b798-1f04bb49d597 2024-09-14T11:37:34.233 INFO:tasks.workunit.client.0.smithi138.stderr:last_changed 2024-09-14T11:07:09.252780+0000 2024-09-14T11:37:34.233 INFO:tasks.workunit.client.0.smithi138.stderr:created 2024-09-14T11:07:09.252780+0000 2024-09-14T11:37:34.234 INFO:tasks.workunit.client.0.smithi138.stderr:min_mon_release 19 (squid) 2024-09-14T11:37:34.234 INFO:tasks.workunit.client.0.smithi138.stderr:election_strategy: 1 2024-09-14T11:37:34.234 INFO:tasks.workunit.client.0.smithi138.stderr:0: [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] mon.a 2024-09-14T11:37:34.234 INFO:tasks.workunit.client.0.smithi138.stderr:1: [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] mon.b 2024-09-14T11:37:34.234 INFO:tasks.workunit.client.0.smithi138.stderr:2: [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] mon.c 2024-09-14T11:37:34.234 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-14T11:37:34.234 INFO:tasks.workunit.client.0.smithi138.stderr: -489> 2024-09-14T11:37:33.679+0000 7fd44de0b640 10 monclient: _finish_auth 0 2024-09-14T11:37:34.234 INFO:tasks.workunit.client.0.smithi138.stderr: -488> 2024-09-14T11:37:33.679+0000 7fd44de0b640 10 monclient: _check_auth_tickets 2024-09-14T11:37:34.234 INFO:tasks.workunit.client.0.smithi138.stderr: -487> 2024-09-14T11:37:33.679+0000 7fd44de0b640 10 monclient: handle_config config(0 keys) 2024-09-14T11:37:34.234 INFO:tasks.workunit.client.0.smithi138.stderr: -486> 2024-09-14T11:37:33.679+0000 7fd561ddd9c0 5 monclient: authenticate success, global_id 7428 2024-09-14T11:37:34.234 INFO:tasks.workunit.client.0.smithi138.stderr: -485> 2024-09-14T11:37:33.679+0000 7fd561ddd9c0 10 monclient: get_monmap_and_config success 2024-09-14T11:37:34.234 INFO:tasks.workunit.client.0.smithi138.stderr: -484> 2024-09-14T11:37:33.679+0000 7fd561ddd9c0 4 set_mon_vals no callback set 2024-09-14T11:37:34.234 INFO:tasks.workunit.client.0.smithi138.stderr: -483> 2024-09-14T11:37:33.679+0000 7fd44de0b640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:37:34.234 INFO:tasks.workunit.client.0.smithi138.stderr: -482> 2024-09-14T11:37:33.679+0000 7fd44de0b640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-14T11:37:34.234 INFO:tasks.workunit.client.0.smithi138.stderr: -481> 2024-09-14T11:37:33.679+0000 7fd44de0b640 10 monclient: dump: 2024-09-14T11:37:34.235 INFO:tasks.workunit.client.0.smithi138.stderr:epoch 1 2024-09-14T11:37:34.235 INFO:tasks.workunit.client.0.smithi138.stderr:fsid 3f225f43-83a6-4aeb-b798-1f04bb49d597 2024-09-14T11:37:34.235 INFO:tasks.workunit.client.0.smithi138.stderr:last_changed 2024-09-14T11:07:09.252780+0000 2024-09-14T11:37:34.235 INFO:tasks.workunit.client.0.smithi138.stderr:created 2024-09-14T11:07:09.252780+0000 2024-09-14T11:37:34.235 INFO:tasks.workunit.client.0.smithi138.stderr:min_mon_release 19 (squid) 2024-09-14T11:37:34.235 INFO:tasks.workunit.client.0.smithi138.stderr:election_strategy: 1 2024-09-14T11:37:34.235 INFO:tasks.workunit.client.0.smithi138.stderr:0: [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] mon.a 2024-09-14T11:37:34.235 INFO:tasks.workunit.client.0.smithi138.stderr:1: [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] mon.b 2024-09-14T11:37:34.235 INFO:tasks.workunit.client.0.smithi138.stderr:2: [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] mon.c 2024-09-14T11:37:34.235 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-14T11:37:34.235 INFO:tasks.workunit.client.0.smithi138.stderr: -480> 2024-09-14T11:37:33.679+0000 7fd561ddd9c0 10 monclient: shutdown 2024-09-14T11:37:34.235 INFO:tasks.workunit.client.0.smithi138.stderr: -479> 2024-09-14T11:37:33.679+0000 7fd561ddd9c0 5 asok(0x55ff39895d90) unregister_commands rotate-key 2024-09-14T11:37:34.235 INFO:tasks.workunit.client.0.smithi138.stderr: -478> 2024-09-14T11:37:33.679+0000 7fd561ddd9c0 10 monclient: build_initial_monmap 2024-09-14T11:37:34.235 INFO:tasks.workunit.client.0.smithi138.stderr: -477> 2024-09-14T11:37:33.679+0000 7fd561ddd9c0 1 build_initial for_mkfs: 0 2024-09-14T11:37:34.236 INFO:tasks.workunit.client.0.smithi138.stderr: -476> 2024-09-14T11:37:33.679+0000 7fd561ddd9c0 10 monclient: monmap: 2024-09-14T11:37:34.236 INFO:tasks.workunit.client.0.smithi138.stderr:epoch 0 2024-09-14T11:37:34.236 INFO:tasks.workunit.client.0.smithi138.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-14T11:37:34.236 INFO:tasks.workunit.client.0.smithi138.stderr:last_changed 0.000000 2024-09-14T11:37:34.236 INFO:tasks.workunit.client.0.smithi138.stderr:created 0.000000 2024-09-14T11:37:34.236 INFO:tasks.workunit.client.0.smithi138.stderr:min_mon_release 0 (unknown) 2024-09-14T11:37:34.236 INFO:tasks.workunit.client.0.smithi138.stderr:election_strategy: 1 2024-09-14T11:37:34.236 INFO:tasks.workunit.client.0.smithi138.stderr:0: [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] mon.noname-a 2024-09-14T11:37:34.236 INFO:tasks.workunit.client.0.smithi138.stderr:1: [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] mon.noname-b 2024-09-14T11:37:34.236 INFO:tasks.workunit.client.0.smithi138.stderr:2: [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] mon.noname-c 2024-09-14T11:37:34.236 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-14T11:37:34.236 INFO:tasks.workunit.client.0.smithi138.stderr: -475> 2024-09-14T11:37:33.679+0000 7fd561ddd9c0 5 AuthRegistry(0x55ff39aa91b0) adding auth protocol: cephx 2024-09-14T11:37:34.236 INFO:tasks.workunit.client.0.smithi138.stderr: -474> 2024-09-14T11:37:33.679+0000 7fd561ddd9c0 5 AuthRegistry(0x55ff39aa91b0) adding auth protocol: cephx 2024-09-14T11:37:34.237 INFO:tasks.workunit.client.0.smithi138.stderr: -473> 2024-09-14T11:37:33.679+0000 7fd561ddd9c0 5 AuthRegistry(0x55ff39aa91b0) adding auth protocol: cephx 2024-09-14T11:37:34.237 INFO:tasks.workunit.client.0.smithi138.stderr: -472> 2024-09-14T11:37:33.679+0000 7fd561ddd9c0 5 AuthRegistry(0x55ff39aa91b0) adding con mode: secure 2024-09-14T11:37:34.237 INFO:tasks.workunit.client.0.smithi138.stderr: -471> 2024-09-14T11:37:33.679+0000 7fd561ddd9c0 5 AuthRegistry(0x55ff39aa91b0) adding con mode: crc 2024-09-14T11:37:34.237 INFO:tasks.workunit.client.0.smithi138.stderr: -470> 2024-09-14T11:37:33.679+0000 7fd561ddd9c0 5 AuthRegistry(0x55ff39aa91b0) adding con mode: secure 2024-09-14T11:37:34.237 INFO:tasks.workunit.client.0.smithi138.stderr: -469> 2024-09-14T11:37:33.679+0000 7fd561ddd9c0 5 AuthRegistry(0x55ff39aa91b0) adding con mode: crc 2024-09-14T11:37:34.237 INFO:tasks.workunit.client.0.smithi138.stderr: -468> 2024-09-14T11:37:33.679+0000 7fd561ddd9c0 5 AuthRegistry(0x55ff39aa91b0) adding con mode: secure 2024-09-14T11:37:34.237 INFO:tasks.workunit.client.0.smithi138.stderr: -467> 2024-09-14T11:37:33.679+0000 7fd561ddd9c0 5 AuthRegistry(0x55ff39aa91b0) adding con mode: crc 2024-09-14T11:37:34.237 INFO:tasks.workunit.client.0.smithi138.stderr: -466> 2024-09-14T11:37:33.679+0000 7fd561ddd9c0 5 AuthRegistry(0x55ff39aa91b0) adding con mode: crc 2024-09-14T11:37:34.237 INFO:tasks.workunit.client.0.smithi138.stderr: -465> 2024-09-14T11:37:33.679+0000 7fd561ddd9c0 5 AuthRegistry(0x55ff39aa91b0) adding con mode: secure 2024-09-14T11:37:34.237 INFO:tasks.workunit.client.0.smithi138.stderr: -464> 2024-09-14T11:37:33.679+0000 7fd561ddd9c0 5 AuthRegistry(0x55ff39aa91b0) adding con mode: crc 2024-09-14T11:37:34.237 INFO:tasks.workunit.client.0.smithi138.stderr: -463> 2024-09-14T11:37:33.679+0000 7fd561ddd9c0 5 AuthRegistry(0x55ff39aa91b0) adding con mode: secure 2024-09-14T11:37:34.237 INFO:tasks.workunit.client.0.smithi138.stderr: -462> 2024-09-14T11:37:33.679+0000 7fd561ddd9c0 5 AuthRegistry(0x55ff39aa91b0) adding con mode: crc 2024-09-14T11:37:34.237 INFO:tasks.workunit.client.0.smithi138.stderr: -461> 2024-09-14T11:37:33.679+0000 7fd561ddd9c0 5 AuthRegistry(0x55ff39aa91b0) adding con mode: secure 2024-09-14T11:37:34.237 INFO:tasks.workunit.client.0.smithi138.stderr: -460> 2024-09-14T11:37:33.683+0000 7fd561ddd9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:37:34.238 INFO:tasks.workunit.client.0.smithi138.stderr: -459> 2024-09-14T11:37:33.683+0000 7fd561ddd9c0 1 librados: starting msgr at 2024-09-14T11:37:34.238 INFO:tasks.workunit.client.0.smithi138.stderr: -458> 2024-09-14T11:37:33.683+0000 7fd561ddd9c0 1 librados: starting objecter 2024-09-14T11:37:34.238 INFO:tasks.workunit.client.0.smithi138.stderr: -457> 2024-09-14T11:37:33.683+0000 7fd561ddd9c0 5 asok(0x55ff39895d90) register_command objecter_requests hook 0x55ff39ad4260 2024-09-14T11:37:34.238 INFO:tasks.workunit.client.0.smithi138.stderr: -456> 2024-09-14T11:37:33.683+0000 7fd561ddd9c0 1 librados: setting wanted keys 2024-09-14T11:37:34.238 INFO:tasks.workunit.client.0.smithi138.stderr: -455> 2024-09-14T11:37:33.683+0000 7fd561ddd9c0 1 librados: calling monclient init 2024-09-14T11:37:34.238 INFO:tasks.workunit.client.0.smithi138.stderr: -454> 2024-09-14T11:37:33.683+0000 7fd561ddd9c0 10 monclient: init 2024-09-14T11:37:34.238 INFO:tasks.workunit.client.0.smithi138.stderr: -453> 2024-09-14T11:37:33.683+0000 7fd561ddd9c0 5 AuthRegistry(0x55ff39aa2fd0) adding auth protocol: cephx 2024-09-14T11:37:34.238 INFO:tasks.workunit.client.0.smithi138.stderr: -452> 2024-09-14T11:37:33.683+0000 7fd561ddd9c0 5 AuthRegistry(0x55ff39aa2fd0) adding auth protocol: cephx 2024-09-14T11:37:34.238 INFO:tasks.workunit.client.0.smithi138.stderr: -451> 2024-09-14T11:37:33.683+0000 7fd561ddd9c0 5 AuthRegistry(0x55ff39aa2fd0) adding auth protocol: cephx 2024-09-14T11:37:34.238 INFO:tasks.workunit.client.0.smithi138.stderr: -450> 2024-09-14T11:37:33.683+0000 7fd561ddd9c0 5 AuthRegistry(0x55ff39aa2fd0) adding con mode: secure 2024-09-14T11:37:34.238 INFO:tasks.workunit.client.0.smithi138.stderr: -449> 2024-09-14T11:37:33.683+0000 7fd561ddd9c0 5 AuthRegistry(0x55ff39aa2fd0) adding con mode: crc 2024-09-14T11:37:34.238 INFO:tasks.workunit.client.0.smithi138.stderr: -448> 2024-09-14T11:37:33.683+0000 7fd561ddd9c0 5 AuthRegistry(0x55ff39aa2fd0) adding con mode: secure 2024-09-14T11:37:34.238 INFO:tasks.workunit.client.0.smithi138.stderr: -447> 2024-09-14T11:37:33.683+0000 7fd561ddd9c0 5 AuthRegistry(0x55ff39aa2fd0) adding con mode: crc 2024-09-14T11:37:34.239 INFO:tasks.workunit.client.0.smithi138.stderr: -446> 2024-09-14T11:37:33.683+0000 7fd561ddd9c0 5 AuthRegistry(0x55ff39aa2fd0) adding con mode: secure 2024-09-14T11:37:34.239 INFO:tasks.workunit.client.0.smithi138.stderr: -445> 2024-09-14T11:37:33.683+0000 7fd561ddd9c0 5 AuthRegistry(0x55ff39aa2fd0) adding con mode: crc 2024-09-14T11:37:34.239 INFO:tasks.workunit.client.0.smithi138.stderr: -444> 2024-09-14T11:37:33.683+0000 7fd561ddd9c0 5 AuthRegistry(0x55ff39aa2fd0) adding con mode: crc 2024-09-14T11:37:34.239 INFO:tasks.workunit.client.0.smithi138.stderr: -443> 2024-09-14T11:37:33.683+0000 7fd561ddd9c0 5 AuthRegistry(0x55ff39aa2fd0) adding con mode: secure 2024-09-14T11:37:34.239 INFO:tasks.workunit.client.0.smithi138.stderr: -442> 2024-09-14T11:37:33.683+0000 7fd561ddd9c0 5 AuthRegistry(0x55ff39aa2fd0) adding con mode: crc 2024-09-14T11:37:34.239 INFO:tasks.workunit.client.0.smithi138.stderr: -441> 2024-09-14T11:37:33.683+0000 7fd561ddd9c0 5 AuthRegistry(0x55ff39aa2fd0) adding con mode: secure 2024-09-14T11:37:34.239 INFO:tasks.workunit.client.0.smithi138.stderr: -440> 2024-09-14T11:37:33.683+0000 7fd561ddd9c0 5 AuthRegistry(0x55ff39aa2fd0) adding con mode: crc 2024-09-14T11:37:34.239 INFO:tasks.workunit.client.0.smithi138.stderr: -439> 2024-09-14T11:37:33.683+0000 7fd561ddd9c0 5 AuthRegistry(0x55ff39aa2fd0) adding con mode: secure 2024-09-14T11:37:34.239 INFO:tasks.workunit.client.0.smithi138.stderr: -438> 2024-09-14T11:37:33.683+0000 7fd561ddd9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:37:34.239 INFO:tasks.workunit.client.0.smithi138.stderr: -437> 2024-09-14T11:37:33.683+0000 7fd561ddd9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:37:34.239 INFO:tasks.workunit.client.0.smithi138.stderr: -436> 2024-09-14T11:37:33.683+0000 7fd561ddd9c0 5 asok(0x55ff39895d90) register_command rotate-key hook 0x55ff39aa3118 2024-09-14T11:37:34.239 INFO:tasks.workunit.client.0.smithi138.stderr: -435> 2024-09-14T11:37:33.683+0000 7fd561ddd9c0 10 monclient: _reopen_session rank -1 2024-09-14T11:37:34.239 INFO:tasks.workunit.client.0.smithi138.stderr: -434> 2024-09-14T11:37:33.683+0000 7fd561ddd9c0 10 monclient: _add_conns ranks=[1,2,0] 2024-09-14T11:37:34.239 INFO:tasks.workunit.client.0.smithi138.stderr: -433> 2024-09-14T11:37:33.683+0000 7fd561ddd9c0 10 monclient(hunting): picked mon.noname-b con 0x55ff3995e880 addr [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] 2024-09-14T11:37:34.240 INFO:tasks.workunit.client.0.smithi138.stderr: -432> 2024-09-14T11:37:33.683+0000 7fd561ddd9c0 10 monclient(hunting): picked mon.noname-c con 0x55ff3995f6e0 addr [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] 2024-09-14T11:37:34.240 INFO:tasks.workunit.client.0.smithi138.stderr: -431> 2024-09-14T11:37:33.683+0000 7fd561ddd9c0 10 monclient(hunting): picked mon.noname-a con 0x55ff399e9290 addr [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] 2024-09-14T11:37:34.240 INFO:tasks.workunit.client.0.smithi138.stderr: -430> 2024-09-14T11:37:33.683+0000 7fd561ddd9c0 10 monclient(hunting): start opening mon connection 2024-09-14T11:37:34.240 INFO:tasks.workunit.client.0.smithi138.stderr: -429> 2024-09-14T11:37:33.683+0000 7fd561ddd9c0 10 monclient(hunting): start opening mon connection 2024-09-14T11:37:34.240 INFO:tasks.workunit.client.0.smithi138.stderr: -428> 2024-09-14T11:37:33.683+0000 7fd561ddd9c0 10 monclient(hunting): start opening mon connection 2024-09-14T11:37:34.240 INFO:tasks.workunit.client.0.smithi138.stderr: -427> 2024-09-14T11:37:33.683+0000 7fd561ddd9c0 10 monclient(hunting): _renew_subs 2024-09-14T11:37:34.240 INFO:tasks.workunit.client.0.smithi138.stderr: -426> 2024-09-14T11:37:33.683+0000 7fd561ddd9c0 10 monclient(hunting): authenticate will time out at 2789.644998s 2024-09-14T11:37:34.240 INFO:tasks.workunit.client.0.smithi138.stderr: -425> 2024-09-14T11:37:33.683+0000 7fd55f0e2640 10 monclient(hunting): get_auth_request con 0x55ff3995f6e0 auth_method 0 2024-09-14T11:37:34.240 INFO:tasks.workunit.client.0.smithi138.stderr: -424> 2024-09-14T11:37:33.683+0000 7fd55f0e2640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:37:34.240 INFO:tasks.workunit.client.0.smithi138.stderr: -423> 2024-09-14T11:37:33.683+0000 7fd55f0e2640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:37:34.240 INFO:tasks.workunit.client.0.smithi138.stderr: -422> 2024-09-14T11:37:33.683+0000 7fd55f0e2640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:37:34.240 INFO:tasks.workunit.client.0.smithi138.stderr: -421> 2024-09-14T11:37:33.683+0000 7fd5600e4640 10 monclient(hunting): get_auth_request con 0x55ff399e9290 auth_method 0 2024-09-14T11:37:34.240 INFO:tasks.workunit.client.0.smithi138.stderr: -420> 2024-09-14T11:37:33.683+0000 7fd5600e4640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:37:34.241 INFO:tasks.workunit.client.0.smithi138.stderr: -419> 2024-09-14T11:37:33.683+0000 7fd5600e4640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:37:34.241 INFO:tasks.workunit.client.0.smithi138.stderr: -418> 2024-09-14T11:37:33.683+0000 7fd5600e4640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:37:34.241 INFO:tasks.workunit.client.0.smithi138.stderr: -417> 2024-09-14T11:37:33.683+0000 7fd55f0e2640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:37:34.241 INFO:tasks.workunit.client.0.smithi138.stderr: -416> 2024-09-14T11:37:33.683+0000 7fd55f0e2640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:37:34.241 INFO:tasks.workunit.client.0.smithi138.stderr: -415> 2024-09-14T11:37:33.683+0000 7fd55f0e2640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:37:34.241 INFO:tasks.workunit.client.0.smithi138.stderr: -414> 2024-09-14T11:37:33.683+0000 7fd5600e4640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:37:34.241 INFO:tasks.workunit.client.0.smithi138.stderr: -413> 2024-09-14T11:37:33.683+0000 7fd5600e4640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:37:34.241 INFO:tasks.workunit.client.0.smithi138.stderr: -412> 2024-09-14T11:37:33.683+0000 7fd5600e4640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:37:34.241 INFO:tasks.workunit.client.0.smithi138.stderr: -411> 2024-09-14T11:37:33.683+0000 7fd55f0e2640 10 monclient(hunting): handle_auth_done global_id 6953 payload 824 2024-09-14T11:37:34.241 INFO:tasks.workunit.client.0.smithi138.stderr: -410> 2024-09-14T11:37:33.683+0000 7fd55f0e2640 10 monclient: _finish_hunting 0 2024-09-14T11:37:34.241 INFO:tasks.workunit.client.0.smithi138.stderr: -409> 2024-09-14T11:37:33.683+0000 7fd55f0e2640 1 monclient: found mon.noname-c 2024-09-14T11:37:34.241 INFO:tasks.workunit.client.0.smithi138.stderr: -408> 2024-09-14T11:37:33.683+0000 7fd55f0e2640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.138:3301/0 2024-09-14T11:37:34.241 INFO:tasks.workunit.client.0.smithi138.stderr: -407> 2024-09-14T11:37:33.683+0000 7fd55f8e3640 10 monclient: get_auth_request con 0x55ff3995e880 auth_method 0 2024-09-14T11:37:34.241 INFO:tasks.workunit.client.0.smithi138.stderr: -406> 2024-09-14T11:37:33.683+0000 7fd447fff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:37:34.242 INFO:tasks.workunit.client.0.smithi138.stderr: -405> 2024-09-14T11:37:33.683+0000 7fd447fff640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-14T11:37:34.242 INFO:tasks.workunit.client.0.smithi138.stderr: -404> 2024-09-14T11:37:33.683+0000 7fd447fff640 10 monclient: dump: 2024-09-14T11:37:34.242 INFO:tasks.workunit.client.0.smithi138.stderr:epoch 1 2024-09-14T11:37:34.242 INFO:tasks.workunit.client.0.smithi138.stderr:fsid 3f225f43-83a6-4aeb-b798-1f04bb49d597 2024-09-14T11:37:34.242 INFO:tasks.workunit.client.0.smithi138.stderr:last_changed 2024-09-14T11:07:09.252780+0000 2024-09-14T11:37:34.242 INFO:tasks.workunit.client.0.smithi138.stderr:created 2024-09-14T11:07:09.252780+0000 2024-09-14T11:37:34.242 INFO:tasks.workunit.client.0.smithi138.stderr:min_mon_release 19 (squid) 2024-09-14T11:37:34.242 INFO:tasks.workunit.client.0.smithi138.stderr:election_strategy: 1 2024-09-14T11:37:34.242 INFO:tasks.workunit.client.0.smithi138.stderr:0: [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] mon.a 2024-09-14T11:37:34.242 INFO:tasks.workunit.client.0.smithi138.stderr:1: [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] mon.b 2024-09-14T11:37:34.242 INFO:tasks.workunit.client.0.smithi138.stderr:2: [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] mon.c 2024-09-14T11:37:34.242 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-14T11:37:34.242 INFO:tasks.workunit.client.0.smithi138.stderr: -403> 2024-09-14T11:37:33.683+0000 7fd447fff640 10 monclient: _finish_auth 0 2024-09-14T11:37:34.242 INFO:tasks.workunit.client.0.smithi138.stderr: -402> 2024-09-14T11:37:33.683+0000 7fd447fff640 10 monclient: _check_auth_tickets 2024-09-14T11:37:34.242 INFO:tasks.workunit.client.0.smithi138.stderr: -401> 2024-09-14T11:37:33.683+0000 7fd447fff640 10 monclient: handle_config config(0 keys) 2024-09-14T11:37:34.243 INFO:tasks.workunit.client.0.smithi138.stderr: -400> 2024-09-14T11:37:33.683+0000 7fd447fff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:37:34.243 INFO:tasks.workunit.client.0.smithi138.stderr: -399> 2024-09-14T11:37:33.683+0000 7fd447fff640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-14T11:37:34.243 INFO:tasks.workunit.client.0.smithi138.stderr: -398> 2024-09-14T11:37:33.683+0000 7fd447fff640 10 monclient: dump: 2024-09-14T11:37:34.243 INFO:tasks.workunit.client.0.smithi138.stderr:epoch 1 2024-09-14T11:37:34.243 INFO:tasks.workunit.client.0.smithi138.stderr:fsid 3f225f43-83a6-4aeb-b798-1f04bb49d597 2024-09-14T11:37:34.243 INFO:tasks.workunit.client.0.smithi138.stderr:last_changed 2024-09-14T11:07:09.252780+0000 2024-09-14T11:37:34.243 INFO:tasks.workunit.client.0.smithi138.stderr:created 2024-09-14T11:07:09.252780+0000 2024-09-14T11:37:34.243 INFO:tasks.workunit.client.0.smithi138.stderr:min_mon_release 19 (squid) 2024-09-14T11:37:34.243 INFO:tasks.workunit.client.0.smithi138.stderr:election_strategy: 1 2024-09-14T11:37:34.243 INFO:tasks.workunit.client.0.smithi138.stderr:0: [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] mon.a 2024-09-14T11:37:34.243 INFO:tasks.workunit.client.0.smithi138.stderr:1: [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] mon.b 2024-09-14T11:37:34.243 INFO:tasks.workunit.client.0.smithi138.stderr:2: [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] mon.c 2024-09-14T11:37:34.243 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-14T11:37:34.243 INFO:tasks.workunit.client.0.smithi138.stderr: -397> 2024-09-14T11:37:33.683+0000 7fd561ddd9c0 5 monclient: authenticate success, global_id 6953 2024-09-14T11:37:34.244 INFO:tasks.workunit.client.0.smithi138.stderr: -396> 2024-09-14T11:37:33.683+0000 7fd561ddd9c0 10 monclient: _renew_subs 2024-09-14T11:37:34.244 INFO:tasks.workunit.client.0.smithi138.stderr: -395> 2024-09-14T11:37:33.683+0000 7fd561ddd9c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.138:3301/0 2024-09-14T11:37:34.244 INFO:tasks.workunit.client.0.smithi138.stderr: -394> 2024-09-14T11:37:33.683+0000 7fd44de0b640 4 set_mon_vals no callback set 2024-09-14T11:37:34.244 INFO:tasks.workunit.client.0.smithi138.stderr: -393> 2024-09-14T11:37:33.683+0000 7fd561ddd9c0 10 monclient: _renew_subs 2024-09-14T11:37:34.244 INFO:tasks.workunit.client.0.smithi138.stderr: -392> 2024-09-14T11:37:33.683+0000 7fd561ddd9c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.138:3301/0 2024-09-14T11:37:34.244 INFO:tasks.workunit.client.0.smithi138.stderr: -391> 2024-09-14T11:37:33.683+0000 7fd561ddd9c0 1 librados: init done 2024-09-14T11:37:34.244 INFO:tasks.workunit.client.0.smithi138.stderr: -390> 2024-09-14T11:37:33.683+0000 7fd447fff640 4 mgrc handle_mgr_map Got map version 5 2024-09-14T11:37:34.244 INFO:tasks.workunit.client.0.smithi138.stderr: -389> 2024-09-14T11:37:33.683+0000 7fd447fff640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.138:6832/3778043143,v1:172.21.15.138:6833/3778043143] 2024-09-14T11:37:34.244 INFO:tasks.workunit.client.0.smithi138.stderr: -388> 2024-09-14T11:37:33.683+0000 7fd447fff640 4 mgrc reconnect Starting new session with [v2:172.21.15.138:6832/3778043143,v1:172.21.15.138:6833/3778043143] 2024-09-14T11:37:34.244 INFO:tasks.workunit.client.0.smithi138.stderr: -387> 2024-09-14T11:37:33.687+0000 7fd55f8e3640 10 monclient: get_auth_request con 0x7fd4480718a0 auth_method 0 2024-09-14T11:37:34.244 INFO:tasks.workunit.client.0.smithi138.stderr: -386> 2024-09-14T11:37:33.687+0000 7fd5600e4640 10 monclient: get_auth_request con 0x55ff39ae2b60 auth_method 0 2024-09-14T11:37:34.244 INFO:tasks.workunit.client.0.smithi138.stderr: -385> 2024-09-14T11:37:33.687+0000 7fd55f8e3640 10 monclient: get_auth_request con 0x55ff39aedaf0 auth_method 0 2024-09-14T11:37:34.244 INFO:tasks.workunit.client.0.smithi138.stderr: -384> 2024-09-14T11:37:33.687+0000 7fd55f0e2640 10 monclient: get_auth_request con 0x55ff39af1e50 auth_method 0 2024-09-14T11:37:34.244 INFO:tasks.workunit.client.0.smithi138.stderr: -383> 2024-09-14T11:37:33.691+0000 7fd5600e4640 10 monclient: get_auth_request con 0x55ff39af13a0 auth_method 0 2024-09-14T11:37:34.245 INFO:tasks.workunit.client.0.smithi138.stderr: -382> 2024-09-14T11:37:33.691+0000 7fd561ddd9c0 10 monclient: build_initial_monmap 2024-09-14T11:37:34.245 INFO:tasks.workunit.client.0.smithi138.stderr: -381> 2024-09-14T11:37:33.691+0000 7fd561ddd9c0 1 build_initial for_mkfs: 0 2024-09-14T11:37:34.245 INFO:tasks.workunit.client.0.smithi138.stderr: -380> 2024-09-14T11:37:33.691+0000 7fd561ddd9c0 10 monclient: monmap: 2024-09-14T11:37:34.245 INFO:tasks.workunit.client.0.smithi138.stderr:epoch 0 2024-09-14T11:37:34.245 INFO:tasks.workunit.client.0.smithi138.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-14T11:37:34.245 INFO:tasks.workunit.client.0.smithi138.stderr:last_changed 0.000000 2024-09-14T11:37:34.245 INFO:tasks.workunit.client.0.smithi138.stderr:created 0.000000 2024-09-14T11:37:34.245 INFO:tasks.workunit.client.0.smithi138.stderr:min_mon_release 0 (unknown) 2024-09-14T11:37:34.245 INFO:tasks.workunit.client.0.smithi138.stderr:election_strategy: 1 2024-09-14T11:37:34.245 INFO:tasks.workunit.client.0.smithi138.stderr:0: [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] mon.noname-a 2024-09-14T11:37:34.245 INFO:tasks.workunit.client.0.smithi138.stderr:1: [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] mon.noname-b 2024-09-14T11:37:34.245 INFO:tasks.workunit.client.0.smithi138.stderr:2: [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] mon.noname-c 2024-09-14T11:37:34.245 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-14T11:37:34.246 INFO:tasks.workunit.client.0.smithi138.stderr: -379> 2024-09-14T11:37:33.691+0000 7fd561ddd9c0 5 AuthRegistry(0x55ff39af9f90) adding auth protocol: cephx 2024-09-14T11:37:34.246 INFO:tasks.workunit.client.0.smithi138.stderr: -378> 2024-09-14T11:37:33.691+0000 7fd561ddd9c0 5 AuthRegistry(0x55ff39af9f90) adding auth protocol: cephx 2024-09-14T11:37:34.246 INFO:tasks.workunit.client.0.smithi138.stderr: -377> 2024-09-14T11:37:33.691+0000 7fd561ddd9c0 5 AuthRegistry(0x55ff39af9f90) adding auth protocol: cephx 2024-09-14T11:37:34.246 INFO:tasks.workunit.client.0.smithi138.stderr: -376> 2024-09-14T11:37:33.691+0000 7fd561ddd9c0 5 AuthRegistry(0x55ff39af9f90) adding con mode: secure 2024-09-14T11:37:34.246 INFO:tasks.workunit.client.0.smithi138.stderr: -375> 2024-09-14T11:37:33.691+0000 7fd561ddd9c0 5 AuthRegistry(0x55ff39af9f90) adding con mode: crc 2024-09-14T11:37:34.246 INFO:tasks.workunit.client.0.smithi138.stderr: -374> 2024-09-14T11:37:33.691+0000 7fd561ddd9c0 5 AuthRegistry(0x55ff39af9f90) adding con mode: secure 2024-09-14T11:37:34.246 INFO:tasks.workunit.client.0.smithi138.stderr: -373> 2024-09-14T11:37:33.691+0000 7fd561ddd9c0 5 AuthRegistry(0x55ff39af9f90) adding con mode: crc 2024-09-14T11:37:34.246 INFO:tasks.workunit.client.0.smithi138.stderr: -372> 2024-09-14T11:37:33.691+0000 7fd561ddd9c0 5 AuthRegistry(0x55ff39af9f90) adding con mode: secure 2024-09-14T11:37:34.246 INFO:tasks.workunit.client.0.smithi138.stderr: -371> 2024-09-14T11:37:33.691+0000 7fd561ddd9c0 5 AuthRegistry(0x55ff39af9f90) adding con mode: crc 2024-09-14T11:37:34.246 INFO:tasks.workunit.client.0.smithi138.stderr: -370> 2024-09-14T11:37:33.691+0000 7fd561ddd9c0 5 AuthRegistry(0x55ff39af9f90) adding con mode: crc 2024-09-14T11:37:34.246 INFO:tasks.workunit.client.0.smithi138.stderr: -369> 2024-09-14T11:37:33.691+0000 7fd561ddd9c0 5 AuthRegistry(0x55ff39af9f90) adding con mode: secure 2024-09-14T11:37:34.246 INFO:tasks.workunit.client.0.smithi138.stderr: -368> 2024-09-14T11:37:33.691+0000 7fd561ddd9c0 5 AuthRegistry(0x55ff39af9f90) adding con mode: crc 2024-09-14T11:37:34.246 INFO:tasks.workunit.client.0.smithi138.stderr: -367> 2024-09-14T11:37:33.691+0000 7fd561ddd9c0 5 AuthRegistry(0x55ff39af9f90) adding con mode: secure 2024-09-14T11:37:34.246 INFO:tasks.workunit.client.0.smithi138.stderr: -366> 2024-09-14T11:37:33.691+0000 7fd561ddd9c0 5 AuthRegistry(0x55ff39af9f90) adding con mode: crc 2024-09-14T11:37:34.246 INFO:tasks.workunit.client.0.smithi138.stderr: -365> 2024-09-14T11:37:33.691+0000 7fd561ddd9c0 5 AuthRegistry(0x55ff39af9f90) adding con mode: secure 2024-09-14T11:37:34.247 INFO:tasks.workunit.client.0.smithi138.stderr: -364> 2024-09-14T11:37:33.691+0000 7fd561ddd9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:37:34.247 INFO:tasks.workunit.client.0.smithi138.stderr: -363> 2024-09-14T11:37:33.691+0000 7fd561ddd9c0 5 asok(0x55ff39895d90) register_command objecter_requests cmddesc objecter_requests hook 0x55ff39afd980 EEXIST 2024-09-14T11:37:34.247 INFO:tasks.workunit.client.0.smithi138.stderr: -362> 2024-09-14T11:37:33.691+0000 7fd561ddd9c0 10 monclient: init 2024-09-14T11:37:34.247 INFO:tasks.workunit.client.0.smithi138.stderr: -361> 2024-09-14T11:37:33.691+0000 7fd561ddd9c0 5 AuthRegistry(0x55ff39af8e88) adding auth protocol: cephx 2024-09-14T11:37:34.247 INFO:tasks.workunit.client.0.smithi138.stderr: -360> 2024-09-14T11:37:33.691+0000 7fd561ddd9c0 5 AuthRegistry(0x55ff39af8e88) adding auth protocol: cephx 2024-09-14T11:37:34.247 INFO:tasks.workunit.client.0.smithi138.stderr: -359> 2024-09-14T11:37:33.691+0000 7fd561ddd9c0 5 AuthRegistry(0x55ff39af8e88) adding auth protocol: cephx 2024-09-14T11:37:34.247 INFO:tasks.workunit.client.0.smithi138.stderr: -358> 2024-09-14T11:37:33.691+0000 7fd561ddd9c0 5 AuthRegistry(0x55ff39af8e88) adding con mode: secure 2024-09-14T11:37:34.247 INFO:tasks.workunit.client.0.smithi138.stderr: -357> 2024-09-14T11:37:33.691+0000 7fd561ddd9c0 5 AuthRegistry(0x55ff39af8e88) adding con mode: crc 2024-09-14T11:37:34.247 INFO:tasks.workunit.client.0.smithi138.stderr: -356> 2024-09-14T11:37:33.691+0000 7fd561ddd9c0 5 AuthRegistry(0x55ff39af8e88) adding con mode: secure 2024-09-14T11:37:34.247 INFO:tasks.workunit.client.0.smithi138.stderr: -355> 2024-09-14T11:37:33.691+0000 7fd561ddd9c0 5 AuthRegistry(0x55ff39af8e88) adding con mode: crc 2024-09-14T11:37:34.247 INFO:tasks.workunit.client.0.smithi138.stderr: -354> 2024-09-14T11:37:33.691+0000 7fd561ddd9c0 5 AuthRegistry(0x55ff39af8e88) adding con mode: secure 2024-09-14T11:37:34.247 INFO:tasks.workunit.client.0.smithi138.stderr: -353> 2024-09-14T11:37:33.691+0000 7fd561ddd9c0 5 AuthRegistry(0x55ff39af8e88) adding con mode: crc 2024-09-14T11:37:34.247 INFO:tasks.workunit.client.0.smithi138.stderr: -352> 2024-09-14T11:37:33.691+0000 7fd561ddd9c0 5 AuthRegistry(0x55ff39af8e88) adding con mode: crc 2024-09-14T11:37:34.247 INFO:tasks.workunit.client.0.smithi138.stderr: -351> 2024-09-14T11:37:33.691+0000 7fd561ddd9c0 5 AuthRegistry(0x55ff39af8e88) adding con mode: secure 2024-09-14T11:37:34.247 INFO:tasks.workunit.client.0.smithi138.stderr: -350> 2024-09-14T11:37:33.691+0000 7fd561ddd9c0 5 AuthRegistry(0x55ff39af8e88) adding con mode: crc 2024-09-14T11:37:34.247 INFO:tasks.workunit.client.0.smithi138.stderr: -349> 2024-09-14T11:37:33.691+0000 7fd561ddd9c0 5 AuthRegistry(0x55ff39af8e88) adding con mode: secure 2024-09-14T11:37:34.248 INFO:tasks.workunit.client.0.smithi138.stderr: -348> 2024-09-14T11:37:33.691+0000 7fd561ddd9c0 5 AuthRegistry(0x55ff39af8e88) adding con mode: crc 2024-09-14T11:37:34.248 INFO:tasks.workunit.client.0.smithi138.stderr: -347> 2024-09-14T11:37:33.691+0000 7fd561ddd9c0 5 AuthRegistry(0x55ff39af8e88) adding con mode: secure 2024-09-14T11:37:34.248 INFO:tasks.workunit.client.0.smithi138.stderr: -346> 2024-09-14T11:37:33.691+0000 7fd561ddd9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:37:34.248 INFO:tasks.workunit.client.0.smithi138.stderr: -345> 2024-09-14T11:37:33.691+0000 7fd561ddd9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:37:34.248 INFO:tasks.workunit.client.0.smithi138.stderr: -344> 2024-09-14T11:37:33.691+0000 7fd561ddd9c0 5 asok(0x55ff39895d90) register_command rotate-key cmddesc rotate-key hook 0x55ff39af8fd0 EEXIST 2024-09-14T11:37:34.248 INFO:tasks.workunit.client.0.smithi138.stderr: -343> 2024-09-14T11:37:33.691+0000 7fd561ddd9c0 10 monclient: _reopen_session rank -1 2024-09-14T11:37:34.248 INFO:tasks.workunit.client.0.smithi138.stderr: -342> 2024-09-14T11:37:33.691+0000 7fd561ddd9c0 10 monclient: _add_conns ranks=[1,2,0] 2024-09-14T11:37:34.248 INFO:tasks.workunit.client.0.smithi138.stderr: -341> 2024-09-14T11:37:33.691+0000 7fd561ddd9c0 10 monclient(hunting): picked mon.noname-b con 0x55ff39b21b30 addr [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] 2024-09-14T11:37:34.248 INFO:tasks.workunit.client.0.smithi138.stderr: -340> 2024-09-14T11:37:33.691+0000 7fd561ddd9c0 10 monclient(hunting): picked mon.noname-c con 0x55ff39b21460 addr [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] 2024-09-14T11:37:34.248 INFO:tasks.workunit.client.0.smithi138.stderr: -339> 2024-09-14T11:37:33.691+0000 7fd561ddd9c0 10 monclient(hunting): picked mon.noname-a con 0x55ff39b1fe40 addr [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] 2024-09-14T11:37:34.248 INFO:tasks.workunit.client.0.smithi138.stderr: -338> 2024-09-14T11:37:33.691+0000 7fd561ddd9c0 10 monclient(hunting): start opening mon connection 2024-09-14T11:37:34.248 INFO:tasks.workunit.client.0.smithi138.stderr: -337> 2024-09-14T11:37:33.691+0000 7fd561ddd9c0 10 monclient(hunting): start opening mon connection 2024-09-14T11:37:34.248 INFO:tasks.workunit.client.0.smithi138.stderr: -336> 2024-09-14T11:37:33.691+0000 7fd561ddd9c0 10 monclient(hunting): start opening mon connection 2024-09-14T11:37:34.248 INFO:tasks.workunit.client.0.smithi138.stderr: -335> 2024-09-14T11:37:33.691+0000 7fd561ddd9c0 10 monclient(hunting): _renew_subs 2024-09-14T11:37:34.248 INFO:tasks.workunit.client.0.smithi138.stderr: -334> 2024-09-14T11:37:33.691+0000 7fd561ddd9c0 10 monclient(hunting): authenticate will time out at 2789.655486s 2024-09-14T11:37:34.249 INFO:tasks.workunit.client.0.smithi138.stderr: -333> 2024-09-14T11:37:33.691+0000 7fd55f8e3640 10 monclient(hunting): get_auth_request con 0x55ff39b1fe40 auth_method 0 2024-09-14T11:37:34.249 INFO:tasks.workunit.client.0.smithi138.stderr: -332> 2024-09-14T11:37:33.691+0000 7fd55f8e3640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:37:34.249 INFO:tasks.workunit.client.0.smithi138.stderr: -331> 2024-09-14T11:37:33.691+0000 7fd55f8e3640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:37:34.249 INFO:tasks.workunit.client.0.smithi138.stderr: -330> 2024-09-14T11:37:33.691+0000 7fd55f8e3640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:37:34.249 INFO:tasks.workunit.client.0.smithi138.stderr: -329> 2024-09-14T11:37:33.691+0000 7fd5600e4640 10 monclient(hunting): get_auth_request con 0x55ff39b21460 auth_method 0 2024-09-14T11:37:34.249 INFO:tasks.workunit.client.0.smithi138.stderr: -328> 2024-09-14T11:37:33.691+0000 7fd5600e4640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:37:34.249 INFO:tasks.workunit.client.0.smithi138.stderr: -327> 2024-09-14T11:37:33.691+0000 7fd5600e4640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:37:34.249 INFO:tasks.workunit.client.0.smithi138.stderr: -326> 2024-09-14T11:37:33.691+0000 7fd5600e4640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:37:34.249 INFO:tasks.workunit.client.0.smithi138.stderr: -325> 2024-09-14T11:37:33.691+0000 7fd55f8e3640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:37:34.249 INFO:tasks.workunit.client.0.smithi138.stderr: -324> 2024-09-14T11:37:33.691+0000 7fd55f8e3640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:37:34.249 INFO:tasks.workunit.client.0.smithi138.stderr: -323> 2024-09-14T11:37:33.691+0000 7fd55f8e3640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:37:34.249 INFO:tasks.workunit.client.0.smithi138.stderr: -322> 2024-09-14T11:37:33.691+0000 7fd5600e4640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:37:34.249 INFO:tasks.workunit.client.0.smithi138.stderr: -321> 2024-09-14T11:37:33.691+0000 7fd5600e4640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:37:34.249 INFO:tasks.workunit.client.0.smithi138.stderr: -320> 2024-09-14T11:37:33.691+0000 7fd5600e4640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:37:34.250 INFO:tasks.workunit.client.0.smithi138.stderr: -319> 2024-09-14T11:37:33.691+0000 7fd55f0e2640 10 monclient(hunting): get_auth_request con 0x55ff39b21b30 auth_method 0 2024-09-14T11:37:34.250 INFO:tasks.workunit.client.0.smithi138.stderr: -318> 2024-09-14T11:37:33.691+0000 7fd55f0e2640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:37:34.250 INFO:tasks.workunit.client.0.smithi138.stderr: -317> 2024-09-14T11:37:33.691+0000 7fd55f0e2640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:37:34.250 INFO:tasks.workunit.client.0.smithi138.stderr: -316> 2024-09-14T11:37:33.691+0000 7fd55f0e2640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:37:34.250 INFO:tasks.workunit.client.0.smithi138.stderr: -315> 2024-09-14T11:37:33.691+0000 7fd55f8e3640 10 monclient(hunting): handle_auth_done global_id 7434 payload 824 2024-09-14T11:37:34.250 INFO:tasks.workunit.client.0.smithi138.stderr: -314> 2024-09-14T11:37:33.691+0000 7fd55f8e3640 10 monclient: _finish_hunting 0 2024-09-14T11:37:34.250 INFO:tasks.workunit.client.0.smithi138.stderr: -313> 2024-09-14T11:37:33.691+0000 7fd55f8e3640 1 monclient: found mon.noname-a 2024-09-14T11:37:34.250 INFO:tasks.workunit.client.0.smithi138.stderr: -312> 2024-09-14T11:37:33.691+0000 7fd55f8e3640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.138:3300/0 2024-09-14T11:37:34.250 INFO:tasks.workunit.client.0.smithi138.stderr: -311> 2024-09-14T11:37:33.695+0000 7fd4457fa640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:37:34.250 INFO:tasks.workunit.client.0.smithi138.stderr: -310> 2024-09-14T11:37:33.695+0000 7fd4457fa640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-14T11:37:34.250 INFO:tasks.workunit.client.0.smithi138.stderr: -309> 2024-09-14T11:37:33.695+0000 7fd4457fa640 10 monclient: dump: 2024-09-14T11:37:34.250 INFO:tasks.workunit.client.0.smithi138.stderr:epoch 1 2024-09-14T11:37:34.250 INFO:tasks.workunit.client.0.smithi138.stderr:fsid 3f225f43-83a6-4aeb-b798-1f04bb49d597 2024-09-14T11:37:34.250 INFO:tasks.workunit.client.0.smithi138.stderr:last_changed 2024-09-14T11:07:09.252780+0000 2024-09-14T11:37:34.250 INFO:tasks.workunit.client.0.smithi138.stderr:created 2024-09-14T11:07:09.252780+0000 2024-09-14T11:37:34.251 INFO:tasks.workunit.client.0.smithi138.stderr:min_mon_release 19 (squid) 2024-09-14T11:37:34.251 INFO:tasks.workunit.client.0.smithi138.stderr:election_strategy: 1 2024-09-14T11:37:34.251 INFO:tasks.workunit.client.0.smithi138.stderr:0: [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] mon.a 2024-09-14T11:37:34.251 INFO:tasks.workunit.client.0.smithi138.stderr:1: [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] mon.b 2024-09-14T11:37:34.251 INFO:tasks.workunit.client.0.smithi138.stderr:2: [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] mon.c 2024-09-14T11:37:34.251 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-14T11:37:34.251 INFO:tasks.workunit.client.0.smithi138.stderr: -308> 2024-09-14T11:37:33.695+0000 7fd4457fa640 10 monclient: _finish_auth 0 2024-09-14T11:37:34.251 INFO:tasks.workunit.client.0.smithi138.stderr: -307> 2024-09-14T11:37:33.695+0000 7fd4457fa640 10 monclient: _check_auth_tickets 2024-09-14T11:37:34.251 INFO:tasks.workunit.client.0.smithi138.stderr: -306> 2024-09-14T11:37:33.695+0000 7fd4457fa640 10 monclient: handle_config config(0 keys) 2024-09-14T11:37:34.251 INFO:tasks.workunit.client.0.smithi138.stderr: -305> 2024-09-14T11:37:33.695+0000 7fd4457fa640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:37:34.251 INFO:tasks.workunit.client.0.smithi138.stderr: -304> 2024-09-14T11:37:33.695+0000 7fd4457fa640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-14T11:37:34.251 INFO:tasks.workunit.client.0.smithi138.stderr: -303> 2024-09-14T11:37:33.695+0000 7fd4457fa640 10 monclient: dump: 2024-09-14T11:37:34.251 INFO:tasks.workunit.client.0.smithi138.stderr:epoch 1 2024-09-14T11:37:34.251 INFO:tasks.workunit.client.0.smithi138.stderr:fsid 3f225f43-83a6-4aeb-b798-1f04bb49d597 2024-09-14T11:37:34.251 INFO:tasks.workunit.client.0.smithi138.stderr:last_changed 2024-09-14T11:07:09.252780+0000 2024-09-14T11:37:34.251 INFO:tasks.workunit.client.0.smithi138.stderr:created 2024-09-14T11:07:09.252780+0000 2024-09-14T11:37:34.252 INFO:tasks.workunit.client.0.smithi138.stderr:min_mon_release 19 (squid) 2024-09-14T11:37:34.252 INFO:tasks.workunit.client.0.smithi138.stderr:election_strategy: 1 2024-09-14T11:37:34.252 INFO:tasks.workunit.client.0.smithi138.stderr:0: [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] mon.a 2024-09-14T11:37:34.252 INFO:tasks.workunit.client.0.smithi138.stderr:1: [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] mon.b 2024-09-14T11:37:34.252 INFO:tasks.workunit.client.0.smithi138.stderr:2: [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] mon.c 2024-09-14T11:37:34.252 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-14T11:37:34.252 INFO:tasks.workunit.client.0.smithi138.stderr: -302> 2024-09-14T11:37:33.695+0000 7fd5608e5640 4 set_mon_vals no callback set 2024-09-14T11:37:34.252 INFO:tasks.workunit.client.0.smithi138.stderr: -301> 2024-09-14T11:37:33.695+0000 7fd561ddd9c0 5 monclient: authenticate success, global_id 7434 2024-09-14T11:37:34.252 INFO:tasks.workunit.client.0.smithi138.stderr: -300> 2024-09-14T11:37:33.695+0000 7fd561ddd9c0 10 monclient: _renew_subs 2024-09-14T11:37:34.252 INFO:tasks.workunit.client.0.smithi138.stderr: -299> 2024-09-14T11:37:33.695+0000 7fd561ddd9c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.138:3300/0 2024-09-14T11:37:34.252 INFO:tasks.workunit.client.0.smithi138.stderr: -298> 2024-09-14T11:37:33.695+0000 7fd561ddd9c0 10 monclient: _renew_subs 2024-09-14T11:37:34.252 INFO:tasks.workunit.client.0.smithi138.stderr: -297> 2024-09-14T11:37:33.695+0000 7fd561ddd9c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.138:3300/0 2024-09-14T11:37:34.252 INFO:tasks.workunit.client.0.smithi138.stderr: -296> 2024-09-14T11:37:33.695+0000 7fd4457fa640 4 mgrc handle_mgr_map Got map version 5 2024-09-14T11:37:34.252 INFO:tasks.workunit.client.0.smithi138.stderr: -295> 2024-09-14T11:37:33.695+0000 7fd4457fa640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.138:6832/3778043143,v1:172.21.15.138:6833/3778043143] 2024-09-14T11:37:34.252 INFO:tasks.workunit.client.0.smithi138.stderr: -294> 2024-09-14T11:37:33.695+0000 7fd4457fa640 4 mgrc reconnect Starting new session with [v2:172.21.15.138:6832/3778043143,v1:172.21.15.138:6833/3778043143] 2024-09-14T11:37:34.253 INFO:tasks.workunit.client.0.smithi138.stderr: -293> 2024-09-14T11:37:33.695+0000 7fd55f0e2640 10 monclient: get_auth_request con 0x7fd4380717e0 auth_method 0 2024-09-14T11:37:34.253 INFO:tasks.workunit.client.0.smithi138.stderr: -292> 2024-09-14T11:37:33.695+0000 7fd561ddd9c0 10 monclient: get_monmap_and_config 2024-09-14T11:37:34.253 INFO:tasks.workunit.client.0.smithi138.stderr: -291> 2024-09-14T11:37:33.695+0000 7fd561ddd9c0 10 monclient: build_initial_monmap 2024-09-14T11:37:34.253 INFO:tasks.workunit.client.0.smithi138.stderr: -290> 2024-09-14T11:37:33.695+0000 7fd561ddd9c0 1 build_initial for_mkfs: 0 2024-09-14T11:37:34.253 INFO:tasks.workunit.client.0.smithi138.stderr: -289> 2024-09-14T11:37:33.695+0000 7fd561ddd9c0 10 monclient: monmap: 2024-09-14T11:37:34.253 INFO:tasks.workunit.client.0.smithi138.stderr:epoch 0 2024-09-14T11:37:34.253 INFO:tasks.workunit.client.0.smithi138.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-14T11:37:34.253 INFO:tasks.workunit.client.0.smithi138.stderr:last_changed 0.000000 2024-09-14T11:37:34.253 INFO:tasks.workunit.client.0.smithi138.stderr:created 0.000000 2024-09-14T11:37:34.253 INFO:tasks.workunit.client.0.smithi138.stderr:min_mon_release 0 (unknown) 2024-09-14T11:37:34.253 INFO:tasks.workunit.client.0.smithi138.stderr:election_strategy: 1 2024-09-14T11:37:34.253 INFO:tasks.workunit.client.0.smithi138.stderr:0: [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] mon.noname-a 2024-09-14T11:37:34.253 INFO:tasks.workunit.client.0.smithi138.stderr:1: [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] mon.noname-b 2024-09-14T11:37:34.253 INFO:tasks.workunit.client.0.smithi138.stderr:2: [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] mon.noname-c 2024-09-14T11:37:34.253 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-14T11:37:34.254 INFO:tasks.workunit.client.0.smithi138.stderr: -288> 2024-09-14T11:37:33.695+0000 7fd561ddd9c0 5 AuthRegistry(0x55ff39b412f0) adding auth protocol: cephx 2024-09-14T11:37:34.254 INFO:tasks.workunit.client.0.smithi138.stderr: -287> 2024-09-14T11:37:33.695+0000 7fd561ddd9c0 5 AuthRegistry(0x55ff39b412f0) adding auth protocol: cephx 2024-09-14T11:37:34.254 INFO:tasks.workunit.client.0.smithi138.stderr: -286> 2024-09-14T11:37:33.695+0000 7fd561ddd9c0 5 AuthRegistry(0x55ff39b412f0) adding auth protocol: cephx 2024-09-14T11:37:34.254 INFO:tasks.workunit.client.0.smithi138.stderr: -285> 2024-09-14T11:37:33.695+0000 7fd561ddd9c0 5 AuthRegistry(0x55ff39b412f0) adding con mode: secure 2024-09-14T11:37:34.254 INFO:tasks.workunit.client.0.smithi138.stderr: -284> 2024-09-14T11:37:33.695+0000 7fd561ddd9c0 5 AuthRegistry(0x55ff39b412f0) adding con mode: crc 2024-09-14T11:37:34.254 INFO:tasks.workunit.client.0.smithi138.stderr: -283> 2024-09-14T11:37:33.695+0000 7fd561ddd9c0 5 AuthRegistry(0x55ff39b412f0) adding con mode: secure 2024-09-14T11:37:34.254 INFO:tasks.workunit.client.0.smithi138.stderr: -282> 2024-09-14T11:37:33.695+0000 7fd561ddd9c0 5 AuthRegistry(0x55ff39b412f0) adding con mode: crc 2024-09-14T11:37:34.254 INFO:tasks.workunit.client.0.smithi138.stderr: -281> 2024-09-14T11:37:33.695+0000 7fd561ddd9c0 5 AuthRegistry(0x55ff39b412f0) adding con mode: secure 2024-09-14T11:37:34.254 INFO:tasks.workunit.client.0.smithi138.stderr: -280> 2024-09-14T11:37:33.695+0000 7fd561ddd9c0 5 AuthRegistry(0x55ff39b412f0) adding con mode: crc 2024-09-14T11:37:34.254 INFO:tasks.workunit.client.0.smithi138.stderr: -279> 2024-09-14T11:37:33.695+0000 7fd561ddd9c0 5 AuthRegistry(0x55ff39b412f0) adding con mode: crc 2024-09-14T11:37:34.254 INFO:tasks.workunit.client.0.smithi138.stderr: -278> 2024-09-14T11:37:33.695+0000 7fd561ddd9c0 5 AuthRegistry(0x55ff39b412f0) adding con mode: secure 2024-09-14T11:37:34.254 INFO:tasks.workunit.client.0.smithi138.stderr: -277> 2024-09-14T11:37:33.695+0000 7fd561ddd9c0 5 AuthRegistry(0x55ff39b412f0) adding con mode: crc 2024-09-14T11:37:34.254 INFO:tasks.workunit.client.0.smithi138.stderr: -276> 2024-09-14T11:37:33.695+0000 7fd561ddd9c0 5 AuthRegistry(0x55ff39b412f0) adding con mode: secure 2024-09-14T11:37:34.254 INFO:tasks.workunit.client.0.smithi138.stderr: -275> 2024-09-14T11:37:33.695+0000 7fd561ddd9c0 5 AuthRegistry(0x55ff39b412f0) adding con mode: crc 2024-09-14T11:37:34.254 INFO:tasks.workunit.client.0.smithi138.stderr: -274> 2024-09-14T11:37:33.695+0000 7fd561ddd9c0 5 AuthRegistry(0x55ff39b412f0) adding con mode: secure 2024-09-14T11:37:34.254 INFO:tasks.workunit.client.0.smithi138.stderr: -273> 2024-09-14T11:37:33.695+0000 7fd561ddd9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:37:34.255 INFO:tasks.workunit.client.0.smithi138.stderr: -272> 2024-09-14T11:37:33.695+0000 7fd561ddd9c0 10 monclient: init 2024-09-14T11:37:34.255 INFO:tasks.workunit.client.0.smithi138.stderr: -271> 2024-09-14T11:37:33.695+0000 7fd561ddd9c0 5 AuthRegistry(0x7fff90fa47e0) adding auth protocol: cephx 2024-09-14T11:37:34.255 INFO:tasks.workunit.client.0.smithi138.stderr: -270> 2024-09-14T11:37:33.695+0000 7fd561ddd9c0 5 AuthRegistry(0x7fff90fa47e0) adding auth protocol: cephx 2024-09-14T11:37:34.255 INFO:tasks.workunit.client.0.smithi138.stderr: -269> 2024-09-14T11:37:33.695+0000 7fd561ddd9c0 5 AuthRegistry(0x7fff90fa47e0) adding auth protocol: cephx 2024-09-14T11:37:34.255 INFO:tasks.workunit.client.0.smithi138.stderr: -268> 2024-09-14T11:37:33.695+0000 7fd561ddd9c0 5 AuthRegistry(0x7fff90fa47e0) adding con mode: secure 2024-09-14T11:37:34.255 INFO:tasks.workunit.client.0.smithi138.stderr: -267> 2024-09-14T11:37:33.695+0000 7fd561ddd9c0 5 AuthRegistry(0x7fff90fa47e0) adding con mode: crc 2024-09-14T11:37:34.255 INFO:tasks.workunit.client.0.smithi138.stderr: -266> 2024-09-14T11:37:33.695+0000 7fd561ddd9c0 5 AuthRegistry(0x7fff90fa47e0) adding con mode: secure 2024-09-14T11:37:34.255 INFO:tasks.workunit.client.0.smithi138.stderr: -265> 2024-09-14T11:37:33.695+0000 7fd561ddd9c0 5 AuthRegistry(0x7fff90fa47e0) adding con mode: crc 2024-09-14T11:37:34.255 INFO:tasks.workunit.client.0.smithi138.stderr: -264> 2024-09-14T11:37:33.695+0000 7fd561ddd9c0 5 AuthRegistry(0x7fff90fa47e0) adding con mode: secure 2024-09-14T11:37:34.255 INFO:tasks.workunit.client.0.smithi138.stderr: -263> 2024-09-14T11:37:33.695+0000 7fd561ddd9c0 5 AuthRegistry(0x7fff90fa47e0) adding con mode: crc 2024-09-14T11:37:34.255 INFO:tasks.workunit.client.0.smithi138.stderr: -262> 2024-09-14T11:37:33.695+0000 7fd561ddd9c0 5 AuthRegistry(0x7fff90fa47e0) adding con mode: crc 2024-09-14T11:37:34.255 INFO:tasks.workunit.client.0.smithi138.stderr: -261> 2024-09-14T11:37:33.695+0000 7fd561ddd9c0 5 AuthRegistry(0x7fff90fa47e0) adding con mode: secure 2024-09-14T11:37:34.255 INFO:tasks.workunit.client.0.smithi138.stderr: -260> 2024-09-14T11:37:33.695+0000 7fd561ddd9c0 5 AuthRegistry(0x7fff90fa47e0) adding con mode: crc 2024-09-14T11:37:34.255 INFO:tasks.workunit.client.0.smithi138.stderr: -259> 2024-09-14T11:37:33.695+0000 7fd561ddd9c0 5 AuthRegistry(0x7fff90fa47e0) adding con mode: secure 2024-09-14T11:37:34.255 INFO:tasks.workunit.client.0.smithi138.stderr: -258> 2024-09-14T11:37:33.695+0000 7fd561ddd9c0 5 AuthRegistry(0x7fff90fa47e0) adding con mode: crc 2024-09-14T11:37:34.256 INFO:tasks.workunit.client.0.smithi138.stderr: -257> 2024-09-14T11:37:33.695+0000 7fd561ddd9c0 5 AuthRegistry(0x7fff90fa47e0) adding con mode: secure 2024-09-14T11:37:34.256 INFO:tasks.workunit.client.0.smithi138.stderr: -256> 2024-09-14T11:37:33.695+0000 7fd561ddd9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:37:34.256 INFO:tasks.workunit.client.0.smithi138.stderr: -255> 2024-09-14T11:37:33.695+0000 7fd561ddd9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:37:34.256 INFO:tasks.workunit.client.0.smithi138.stderr: -254> 2024-09-14T11:37:33.695+0000 7fd561ddd9c0 5 asok(0x55ff39895d90) register_command rotate-key cmddesc rotate-key hook 0x7fff90fa4928 EEXIST 2024-09-14T11:37:34.256 INFO:tasks.workunit.client.0.smithi138.stderr: -253> 2024-09-14T11:37:33.695+0000 7fd561ddd9c0 10 monclient: _reopen_session rank -1 2024-09-14T11:37:34.256 INFO:tasks.workunit.client.0.smithi138.stderr: -252> 2024-09-14T11:37:33.695+0000 7fd561ddd9c0 10 monclient: _add_conns ranks=[0,1,2] 2024-09-14T11:37:34.256 INFO:tasks.workunit.client.0.smithi138.stderr: -251> 2024-09-14T11:37:33.695+0000 7fd561ddd9c0 10 monclient(hunting): picked mon.noname-a con 0x55ff39b757d0 addr [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] 2024-09-14T11:37:34.256 INFO:tasks.workunit.client.0.smithi138.stderr: -250> 2024-09-14T11:37:33.695+0000 7fd561ddd9c0 10 monclient(hunting): picked mon.noname-b con 0x55ff39b453a0 addr [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] 2024-09-14T11:37:34.256 INFO:tasks.workunit.client.0.smithi138.stderr: -249> 2024-09-14T11:37:33.695+0000 7fd561ddd9c0 10 monclient(hunting): picked mon.noname-c con 0x55ff39b422d0 addr [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] 2024-09-14T11:37:34.256 INFO:tasks.workunit.client.0.smithi138.stderr: -248> 2024-09-14T11:37:33.695+0000 7fd561ddd9c0 10 monclient(hunting): start opening mon connection 2024-09-14T11:37:34.256 INFO:tasks.workunit.client.0.smithi138.stderr: -247> 2024-09-14T11:37:33.695+0000 7fd561ddd9c0 10 monclient(hunting): start opening mon connection 2024-09-14T11:37:34.256 INFO:tasks.workunit.client.0.smithi138.stderr: -246> 2024-09-14T11:37:33.695+0000 7fd561ddd9c0 10 monclient(hunting): start opening mon connection 2024-09-14T11:37:34.256 INFO:tasks.workunit.client.0.smithi138.stderr: -245> 2024-09-14T11:37:33.695+0000 7fd561ddd9c0 10 monclient(hunting): _renew_subs 2024-09-14T11:37:34.256 INFO:tasks.workunit.client.0.smithi138.stderr: -244> 2024-09-14T11:37:33.695+0000 7fd561ddd9c0 10 monclient(hunting): authenticate will time out at 2789.659794s 2024-09-14T11:37:34.256 INFO:tasks.workunit.client.0.smithi138.stderr: -243> 2024-09-14T11:37:33.695+0000 7fd55f0e2640 10 monclient(hunting): get_auth_request con 0x55ff39b757d0 auth_method 0 2024-09-14T11:37:34.257 INFO:tasks.workunit.client.0.smithi138.stderr: -242> 2024-09-14T11:37:33.695+0000 7fd55f0e2640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:37:34.257 INFO:tasks.workunit.client.0.smithi138.stderr: -241> 2024-09-14T11:37:33.695+0000 7fd55f0e2640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:37:34.257 INFO:tasks.workunit.client.0.smithi138.stderr: -240> 2024-09-14T11:37:33.695+0000 7fd55f0e2640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:37:34.257 INFO:tasks.workunit.client.0.smithi138.stderr: -239> 2024-09-14T11:37:33.695+0000 7fd55f8e3640 10 monclient(hunting): get_auth_request con 0x55ff39b422d0 auth_method 0 2024-09-14T11:37:34.257 INFO:tasks.workunit.client.0.smithi138.stderr: -238> 2024-09-14T11:37:33.695+0000 7fd55f8e3640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:37:34.257 INFO:tasks.workunit.client.0.smithi138.stderr: -237> 2024-09-14T11:37:33.695+0000 7fd55f8e3640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:37:34.257 INFO:tasks.workunit.client.0.smithi138.stderr: -236> 2024-09-14T11:37:33.695+0000 7fd55f8e3640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:37:34.257 INFO:tasks.workunit.client.0.smithi138.stderr: -235> 2024-09-14T11:37:33.695+0000 7fd55f0e2640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:37:34.257 INFO:tasks.workunit.client.0.smithi138.stderr: -234> 2024-09-14T11:37:33.695+0000 7fd55f0e2640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:37:34.257 INFO:tasks.workunit.client.0.smithi138.stderr: -233> 2024-09-14T11:37:33.699+0000 7fd55f0e2640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:37:34.257 INFO:tasks.workunit.client.0.smithi138.stderr: -232> 2024-09-14T11:37:33.699+0000 7fd55f8e3640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:37:34.257 INFO:tasks.workunit.client.0.smithi138.stderr: -231> 2024-09-14T11:37:33.699+0000 7fd55f8e3640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:37:34.257 INFO:tasks.workunit.client.0.smithi138.stderr: -230> 2024-09-14T11:37:33.699+0000 7fd55f8e3640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:37:34.257 INFO:tasks.workunit.client.0.smithi138.stderr: -229> 2024-09-14T11:37:33.699+0000 7fd55f0e2640 10 monclient(hunting): handle_auth_done global_id 7437 payload 274 2024-09-14T11:37:34.257 INFO:tasks.workunit.client.0.smithi138.stderr: -228> 2024-09-14T11:37:33.699+0000 7fd55f0e2640 10 monclient: _finish_hunting 0 2024-09-14T11:37:34.258 INFO:tasks.workunit.client.0.smithi138.stderr: -227> 2024-09-14T11:37:33.699+0000 7fd55f0e2640 1 monclient: found mon.noname-a 2024-09-14T11:37:34.258 INFO:tasks.workunit.client.0.smithi138.stderr: -226> 2024-09-14T11:37:33.699+0000 7fd55f0e2640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.138:3300/0 2024-09-14T11:37:34.258 INFO:tasks.workunit.client.0.smithi138.stderr: -225> 2024-09-14T11:37:33.699+0000 7fd5600e4640 10 monclient: get_auth_request con 0x55ff39b453a0 auth_method 0 2024-09-14T11:37:34.258 INFO:tasks.workunit.client.0.smithi138.stderr: -224> 2024-09-14T11:37:33.699+0000 7fd43effd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:37:34.258 INFO:tasks.workunit.client.0.smithi138.stderr: -223> 2024-09-14T11:37:33.699+0000 7fd43effd640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-14T11:37:34.258 INFO:tasks.workunit.client.0.smithi138.stderr: -222> 2024-09-14T11:37:33.699+0000 7fd43effd640 10 monclient: dump: 2024-09-14T11:37:34.258 INFO:tasks.workunit.client.0.smithi138.stderr:epoch 1 2024-09-14T11:37:34.258 INFO:tasks.workunit.client.0.smithi138.stderr:fsid 3f225f43-83a6-4aeb-b798-1f04bb49d597 2024-09-14T11:37:34.258 INFO:tasks.workunit.client.0.smithi138.stderr:last_changed 2024-09-14T11:07:09.252780+0000 2024-09-14T11:37:34.258 INFO:tasks.workunit.client.0.smithi138.stderr:created 2024-09-14T11:07:09.252780+0000 2024-09-14T11:37:34.258 INFO:tasks.workunit.client.0.smithi138.stderr:min_mon_release 19 (squid) 2024-09-14T11:37:34.258 INFO:tasks.workunit.client.0.smithi138.stderr:election_strategy: 1 2024-09-14T11:37:34.258 INFO:tasks.workunit.client.0.smithi138.stderr:0: [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] mon.a 2024-09-14T11:37:34.258 INFO:tasks.workunit.client.0.smithi138.stderr:1: [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] mon.b 2024-09-14T11:37:34.258 INFO:tasks.workunit.client.0.smithi138.stderr:2: [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] mon.c 2024-09-14T11:37:34.259 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-14T11:37:34.259 INFO:tasks.workunit.client.0.smithi138.stderr: -221> 2024-09-14T11:37:33.699+0000 7fd43effd640 10 monclient: _finish_auth 0 2024-09-14T11:37:34.259 INFO:tasks.workunit.client.0.smithi138.stderr: -220> 2024-09-14T11:37:33.699+0000 7fd43effd640 10 monclient: _check_auth_tickets 2024-09-14T11:37:34.259 INFO:tasks.workunit.client.0.smithi138.stderr: -219> 2024-09-14T11:37:33.699+0000 7fd561ddd9c0 5 monclient: authenticate success, global_id 7437 2024-09-14T11:37:34.259 INFO:tasks.workunit.client.0.smithi138.stderr: -218> 2024-09-14T11:37:33.699+0000 7fd43effd640 10 monclient: handle_config config(0 keys) 2024-09-14T11:37:34.259 INFO:tasks.workunit.client.0.smithi138.stderr: -217> 2024-09-14T11:37:33.699+0000 7fd43effd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:37:34.259 INFO:tasks.workunit.client.0.smithi138.stderr: -216> 2024-09-14T11:37:33.699+0000 7fd43effd640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-14T11:37:34.259 INFO:tasks.workunit.client.0.smithi138.stderr: -215> 2024-09-14T11:37:33.699+0000 7fd43effd640 10 monclient: dump: 2024-09-14T11:37:34.259 INFO:tasks.workunit.client.0.smithi138.stderr:epoch 1 2024-09-14T11:37:34.259 INFO:tasks.workunit.client.0.smithi138.stderr:fsid 3f225f43-83a6-4aeb-b798-1f04bb49d597 2024-09-14T11:37:34.259 INFO:tasks.workunit.client.0.smithi138.stderr:last_changed 2024-09-14T11:07:09.252780+0000 2024-09-14T11:37:34.259 INFO:tasks.workunit.client.0.smithi138.stderr:created 2024-09-14T11:07:09.252780+0000 2024-09-14T11:37:34.259 INFO:tasks.workunit.client.0.smithi138.stderr:min_mon_release 19 (squid) 2024-09-14T11:37:34.259 INFO:tasks.workunit.client.0.smithi138.stderr:election_strategy: 1 2024-09-14T11:37:34.259 INFO:tasks.workunit.client.0.smithi138.stderr:0: [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] mon.a 2024-09-14T11:37:34.259 INFO:tasks.workunit.client.0.smithi138.stderr:1: [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] mon.b 2024-09-14T11:37:34.260 INFO:tasks.workunit.client.0.smithi138.stderr:2: [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] mon.c 2024-09-14T11:37:34.260 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-14T11:37:34.260 INFO:tasks.workunit.client.0.smithi138.stderr: -214> 2024-09-14T11:37:33.699+0000 7fd561ddd9c0 10 monclient: get_monmap_and_config success 2024-09-14T11:37:34.260 INFO:tasks.workunit.client.0.smithi138.stderr: -213> 2024-09-14T11:37:33.699+0000 7fd561ddd9c0 4 set_mon_vals no callback set 2024-09-14T11:37:34.260 INFO:tasks.workunit.client.0.smithi138.stderr: -212> 2024-09-14T11:37:33.699+0000 7fd561ddd9c0 10 monclient: shutdown 2024-09-14T11:37:34.260 INFO:tasks.workunit.client.0.smithi138.stderr: -211> 2024-09-14T11:37:33.699+0000 7fd561ddd9c0 10 monclient: build_initial_monmap 2024-09-14T11:37:34.260 INFO:tasks.workunit.client.0.smithi138.stderr: -210> 2024-09-14T11:37:33.699+0000 7fd561ddd9c0 1 build_initial for_mkfs: 0 2024-09-14T11:37:34.260 INFO:tasks.workunit.client.0.smithi138.stderr: -209> 2024-09-14T11:37:33.699+0000 7fd561ddd9c0 10 monclient: monmap: 2024-09-14T11:37:34.260 INFO:tasks.workunit.client.0.smithi138.stderr:epoch 0 2024-09-14T11:37:34.260 INFO:tasks.workunit.client.0.smithi138.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-14T11:37:34.260 INFO:tasks.workunit.client.0.smithi138.stderr:last_changed 0.000000 2024-09-14T11:37:34.260 INFO:tasks.workunit.client.0.smithi138.stderr:created 0.000000 2024-09-14T11:37:34.260 INFO:tasks.workunit.client.0.smithi138.stderr:min_mon_release 0 (unknown) 2024-09-14T11:37:34.260 INFO:tasks.workunit.client.0.smithi138.stderr:election_strategy: 1 2024-09-14T11:37:34.261 INFO:tasks.workunit.client.0.smithi138.stderr:0: [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] mon.noname-a 2024-09-14T11:37:34.261 INFO:tasks.workunit.client.0.smithi138.stderr:1: [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] mon.noname-b 2024-09-14T11:37:34.261 INFO:tasks.workunit.client.0.smithi138.stderr:2: [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] mon.noname-c 2024-09-14T11:37:34.261 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-14T11:37:34.261 INFO:tasks.workunit.client.0.smithi138.stderr: -208> 2024-09-14T11:37:33.699+0000 7fd561ddd9c0 5 AuthRegistry(0x55ff39b412a0) adding auth protocol: cephx 2024-09-14T11:37:34.261 INFO:tasks.workunit.client.0.smithi138.stderr: -207> 2024-09-14T11:37:33.699+0000 7fd561ddd9c0 5 AuthRegistry(0x55ff39b412a0) adding auth protocol: cephx 2024-09-14T11:37:34.261 INFO:tasks.workunit.client.0.smithi138.stderr: -206> 2024-09-14T11:37:33.699+0000 7fd561ddd9c0 5 AuthRegistry(0x55ff39b412a0) adding auth protocol: cephx 2024-09-14T11:37:34.261 INFO:tasks.workunit.client.0.smithi138.stderr: -205> 2024-09-14T11:37:33.699+0000 7fd561ddd9c0 5 AuthRegistry(0x55ff39b412a0) adding con mode: secure 2024-09-14T11:37:34.261 INFO:tasks.workunit.client.0.smithi138.stderr: -204> 2024-09-14T11:37:33.699+0000 7fd561ddd9c0 5 AuthRegistry(0x55ff39b412a0) adding con mode: crc 2024-09-14T11:37:34.261 INFO:tasks.workunit.client.0.smithi138.stderr: -203> 2024-09-14T11:37:33.699+0000 7fd561ddd9c0 5 AuthRegistry(0x55ff39b412a0) adding con mode: secure 2024-09-14T11:37:34.261 INFO:tasks.workunit.client.0.smithi138.stderr: -202> 2024-09-14T11:37:33.699+0000 7fd561ddd9c0 5 AuthRegistry(0x55ff39b412a0) adding con mode: crc 2024-09-14T11:37:34.261 INFO:tasks.workunit.client.0.smithi138.stderr: -201> 2024-09-14T11:37:33.699+0000 7fd561ddd9c0 5 AuthRegistry(0x55ff39b412a0) adding con mode: secure 2024-09-14T11:37:34.261 INFO:tasks.workunit.client.0.smithi138.stderr: -200> 2024-09-14T11:37:33.699+0000 7fd561ddd9c0 5 AuthRegistry(0x55ff39b412a0) adding con mode: crc 2024-09-14T11:37:34.261 INFO:tasks.workunit.client.0.smithi138.stderr: -199> 2024-09-14T11:37:33.699+0000 7fd561ddd9c0 5 AuthRegistry(0x55ff39b412a0) adding con mode: crc 2024-09-14T11:37:34.262 INFO:tasks.workunit.client.0.smithi138.stderr: -198> 2024-09-14T11:37:33.699+0000 7fd561ddd9c0 5 AuthRegistry(0x55ff39b412a0) adding con mode: secure 2024-09-14T11:37:34.262 INFO:tasks.workunit.client.0.smithi138.stderr: -197> 2024-09-14T11:37:33.699+0000 7fd561ddd9c0 5 AuthRegistry(0x55ff39b412a0) adding con mode: crc 2024-09-14T11:37:34.262 INFO:tasks.workunit.client.0.smithi138.stderr: -196> 2024-09-14T11:37:33.699+0000 7fd561ddd9c0 5 AuthRegistry(0x55ff39b412a0) adding con mode: secure 2024-09-14T11:37:34.262 INFO:tasks.workunit.client.0.smithi138.stderr: -195> 2024-09-14T11:37:33.699+0000 7fd561ddd9c0 5 AuthRegistry(0x55ff39b412a0) adding con mode: crc 2024-09-14T11:37:34.262 INFO:tasks.workunit.client.0.smithi138.stderr: -194> 2024-09-14T11:37:33.699+0000 7fd561ddd9c0 5 AuthRegistry(0x55ff39b412a0) adding con mode: secure 2024-09-14T11:37:34.262 INFO:tasks.workunit.client.0.smithi138.stderr: -193> 2024-09-14T11:37:33.699+0000 7fd561ddd9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:37:34.262 INFO:tasks.workunit.client.0.smithi138.stderr: -192> 2024-09-14T11:37:33.699+0000 7fd561ddd9c0 1 librados: starting msgr at 2024-09-14T11:37:34.262 INFO:tasks.workunit.client.0.smithi138.stderr: -191> 2024-09-14T11:37:33.699+0000 7fd561ddd9c0 1 librados: starting objecter 2024-09-14T11:37:34.262 INFO:tasks.workunit.client.0.smithi138.stderr: -190> 2024-09-14T11:37:33.699+0000 7fd561ddd9c0 5 asok(0x55ff39895d90) register_command objecter_requests cmddesc objecter_requests hook 0x55ff39b709c0 EEXIST 2024-09-14T11:37:34.262 INFO:tasks.workunit.client.0.smithi138.stderr: -189> 2024-09-14T11:37:33.699+0000 7fd561ddd9c0 1 librados: setting wanted keys 2024-09-14T11:37:34.262 INFO:tasks.workunit.client.0.smithi138.stderr: -188> 2024-09-14T11:37:33.699+0000 7fd561ddd9c0 1 librados: calling monclient init 2024-09-14T11:37:34.262 INFO:tasks.workunit.client.0.smithi138.stderr: -187> 2024-09-14T11:37:33.699+0000 7fd561ddd9c0 10 monclient: init 2024-09-14T11:37:34.262 INFO:tasks.workunit.client.0.smithi138.stderr: -186> 2024-09-14T11:37:33.699+0000 7fd561ddd9c0 5 AuthRegistry(0x55ff39b23950) adding auth protocol: cephx 2024-09-14T11:37:34.262 INFO:tasks.workunit.client.0.smithi138.stderr: -185> 2024-09-14T11:37:33.699+0000 7fd561ddd9c0 5 AuthRegistry(0x55ff39b23950) adding auth protocol: cephx 2024-09-14T11:37:34.262 INFO:tasks.workunit.client.0.smithi138.stderr: -184> 2024-09-14T11:37:33.699+0000 7fd561ddd9c0 5 AuthRegistry(0x55ff39b23950) adding auth protocol: cephx 2024-09-14T11:37:34.262 INFO:tasks.workunit.client.0.smithi138.stderr: -183> 2024-09-14T11:37:33.699+0000 7fd561ddd9c0 5 AuthRegistry(0x55ff39b23950) adding con mode: secure 2024-09-14T11:37:34.263 INFO:tasks.workunit.client.0.smithi138.stderr: -182> 2024-09-14T11:37:33.699+0000 7fd561ddd9c0 5 AuthRegistry(0x55ff39b23950) adding con mode: crc 2024-09-14T11:37:34.263 INFO:tasks.workunit.client.0.smithi138.stderr: -181> 2024-09-14T11:37:33.699+0000 7fd561ddd9c0 5 AuthRegistry(0x55ff39b23950) adding con mode: secure 2024-09-14T11:37:34.263 INFO:tasks.workunit.client.0.smithi138.stderr: -180> 2024-09-14T11:37:33.699+0000 7fd561ddd9c0 5 AuthRegistry(0x55ff39b23950) adding con mode: crc 2024-09-14T11:37:34.263 INFO:tasks.workunit.client.0.smithi138.stderr: -179> 2024-09-14T11:37:33.699+0000 7fd561ddd9c0 5 AuthRegistry(0x55ff39b23950) adding con mode: secure 2024-09-14T11:37:34.263 INFO:tasks.workunit.client.0.smithi138.stderr: -178> 2024-09-14T11:37:33.699+0000 7fd561ddd9c0 5 AuthRegistry(0x55ff39b23950) adding con mode: crc 2024-09-14T11:37:34.263 INFO:tasks.workunit.client.0.smithi138.stderr: -177> 2024-09-14T11:37:33.699+0000 7fd561ddd9c0 5 AuthRegistry(0x55ff39b23950) adding con mode: crc 2024-09-14T11:37:34.263 INFO:tasks.workunit.client.0.smithi138.stderr: -176> 2024-09-14T11:37:33.699+0000 7fd561ddd9c0 5 AuthRegistry(0x55ff39b23950) adding con mode: secure 2024-09-14T11:37:34.263 INFO:tasks.workunit.client.0.smithi138.stderr: -175> 2024-09-14T11:37:33.699+0000 7fd561ddd9c0 5 AuthRegistry(0x55ff39b23950) adding con mode: crc 2024-09-14T11:37:34.263 INFO:tasks.workunit.client.0.smithi138.stderr: -174> 2024-09-14T11:37:33.699+0000 7fd561ddd9c0 5 AuthRegistry(0x55ff39b23950) adding con mode: secure 2024-09-14T11:37:34.263 INFO:tasks.workunit.client.0.smithi138.stderr: -173> 2024-09-14T11:37:33.699+0000 7fd561ddd9c0 5 AuthRegistry(0x55ff39b23950) adding con mode: crc 2024-09-14T11:37:34.263 INFO:tasks.workunit.client.0.smithi138.stderr: -172> 2024-09-14T11:37:33.699+0000 7fd561ddd9c0 5 AuthRegistry(0x55ff39b23950) adding con mode: secure 2024-09-14T11:37:34.263 INFO:tasks.workunit.client.0.smithi138.stderr: -171> 2024-09-14T11:37:33.699+0000 7fd561ddd9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:37:34.263 INFO:tasks.workunit.client.0.smithi138.stderr: -170> 2024-09-14T11:37:33.699+0000 7fd561ddd9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:37:34.264 INFO:tasks.workunit.client.0.smithi138.stderr: -169> 2024-09-14T11:37:33.699+0000 7fd561ddd9c0 5 asok(0x55ff39895d90) register_command rotate-key cmddesc rotate-key hook 0x55ff39b23a98 EEXIST 2024-09-14T11:37:34.264 INFO:tasks.workunit.client.0.smithi138.stderr: -168> 2024-09-14T11:37:33.699+0000 7fd561ddd9c0 10 monclient: _reopen_session rank -1 2024-09-14T11:37:34.264 INFO:tasks.workunit.client.0.smithi138.stderr: -167> 2024-09-14T11:37:33.699+0000 7fd561ddd9c0 10 monclient: _add_conns ranks=[1,0,2] 2024-09-14T11:37:34.264 INFO:tasks.workunit.client.0.smithi138.stderr: -166> 2024-09-14T11:37:33.699+0000 7fd561ddd9c0 10 monclient(hunting): picked mon.noname-b con 0x55ff39b422d0 addr [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] 2024-09-14T11:37:34.264 INFO:tasks.workunit.client.0.smithi138.stderr: -165> 2024-09-14T11:37:33.699+0000 7fd561ddd9c0 10 monclient(hunting): picked mon.noname-a con 0x55ff39b453a0 addr [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] 2024-09-14T11:37:34.264 INFO:tasks.workunit.client.0.smithi138.stderr: -164> 2024-09-14T11:37:33.699+0000 7fd561ddd9c0 10 monclient(hunting): picked mon.noname-c con 0x55ff39b757d0 addr [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] 2024-09-14T11:37:34.264 INFO:tasks.workunit.client.0.smithi138.stderr: -163> 2024-09-14T11:37:33.699+0000 7fd561ddd9c0 10 monclient(hunting): start opening mon connection 2024-09-14T11:37:34.264 INFO:tasks.workunit.client.0.smithi138.stderr: -162> 2024-09-14T11:37:33.699+0000 7fd561ddd9c0 10 monclient(hunting): start opening mon connection 2024-09-14T11:37:34.264 INFO:tasks.workunit.client.0.smithi138.stderr: -161> 2024-09-14T11:37:33.699+0000 7fd561ddd9c0 10 monclient(hunting): start opening mon connection 2024-09-14T11:37:34.264 INFO:tasks.workunit.client.0.smithi138.stderr: -160> 2024-09-14T11:37:33.699+0000 7fd561ddd9c0 10 monclient(hunting): _renew_subs 2024-09-14T11:37:34.264 INFO:tasks.workunit.client.0.smithi138.stderr: -159> 2024-09-14T11:37:33.699+0000 7fd561ddd9c0 10 monclient(hunting): authenticate will time out at 2789.662424s 2024-09-14T11:37:34.264 INFO:tasks.workunit.client.0.smithi138.stderr: -158> 2024-09-14T11:37:33.699+0000 7fd5600e4640 10 monclient(hunting): get_auth_request con 0x55ff39b453a0 auth_method 0 2024-09-14T11:37:34.264 INFO:tasks.workunit.client.0.smithi138.stderr: -157> 2024-09-14T11:37:33.699+0000 7fd5600e4640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:37:34.264 INFO:tasks.workunit.client.0.smithi138.stderr: -156> 2024-09-14T11:37:33.699+0000 7fd5600e4640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:37:34.264 INFO:tasks.workunit.client.0.smithi138.stderr: -155> 2024-09-14T11:37:33.699+0000 7fd5600e4640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:37:34.265 INFO:tasks.workunit.client.0.smithi138.stderr: -154> 2024-09-14T11:37:33.699+0000 7fd55f8e3640 10 monclient(hunting): get_auth_request con 0x55ff39b757d0 auth_method 0 2024-09-14T11:37:34.265 INFO:tasks.workunit.client.0.smithi138.stderr: -153> 2024-09-14T11:37:33.699+0000 7fd55f8e3640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:37:34.265 INFO:tasks.workunit.client.0.smithi138.stderr: -152> 2024-09-14T11:37:33.699+0000 7fd55f8e3640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:37:34.265 INFO:tasks.workunit.client.0.smithi138.stderr: -151> 2024-09-14T11:37:33.699+0000 7fd55f8e3640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:37:34.265 INFO:tasks.workunit.client.0.smithi138.stderr: -150> 2024-09-14T11:37:33.699+0000 7fd5600e4640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:37:34.265 INFO:tasks.workunit.client.0.smithi138.stderr: -149> 2024-09-14T11:37:33.699+0000 7fd5600e4640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:37:34.265 INFO:tasks.workunit.client.0.smithi138.stderr: -148> 2024-09-14T11:37:33.699+0000 7fd5600e4640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:37:34.265 INFO:tasks.workunit.client.0.smithi138.stderr: -147> 2024-09-14T11:37:33.699+0000 7fd55f8e3640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:37:34.265 INFO:tasks.workunit.client.0.smithi138.stderr: -146> 2024-09-14T11:37:33.699+0000 7fd55f8e3640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:37:34.265 INFO:tasks.workunit.client.0.smithi138.stderr: -145> 2024-09-14T11:37:33.699+0000 7fd55f8e3640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:37:34.265 INFO:tasks.workunit.client.0.smithi138.stderr: -144> 2024-09-14T11:37:33.699+0000 7fd5600e4640 10 monclient(hunting): handle_auth_done global_id 7440 payload 824 2024-09-14T11:37:34.265 INFO:tasks.workunit.client.0.smithi138.stderr: -143> 2024-09-14T11:37:33.699+0000 7fd5600e4640 10 monclient: _finish_hunting 0 2024-09-14T11:37:34.265 INFO:tasks.workunit.client.0.smithi138.stderr: -142> 2024-09-14T11:37:33.699+0000 7fd5600e4640 1 monclient: found mon.noname-a 2024-09-14T11:37:34.265 INFO:tasks.workunit.client.0.smithi138.stderr: -141> 2024-09-14T11:37:33.699+0000 7fd5600e4640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.138:3300/0 2024-09-14T11:37:34.266 INFO:tasks.workunit.client.0.smithi138.stderr: -140> 2024-09-14T11:37:33.699+0000 7fd55f0e2640 10 monclient: get_auth_request con 0x55ff39b422d0 auth_method 0 2024-09-14T11:37:34.266 INFO:tasks.workunit.client.0.smithi138.stderr: -139> 2024-09-14T11:37:33.699+0000 7fd43d7fa640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:37:34.266 INFO:tasks.workunit.client.0.smithi138.stderr: -138> 2024-09-14T11:37:33.699+0000 7fd43d7fa640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-14T11:37:34.266 INFO:tasks.workunit.client.0.smithi138.stderr: -137> 2024-09-14T11:37:33.699+0000 7fd43d7fa640 10 monclient: dump: 2024-09-14T11:37:34.266 INFO:tasks.workunit.client.0.smithi138.stderr:epoch 1 2024-09-14T11:37:34.266 INFO:tasks.workunit.client.0.smithi138.stderr:fsid 3f225f43-83a6-4aeb-b798-1f04bb49d597 2024-09-14T11:37:34.266 INFO:tasks.workunit.client.0.smithi138.stderr:last_changed 2024-09-14T11:07:09.252780+0000 2024-09-14T11:37:34.266 INFO:tasks.workunit.client.0.smithi138.stderr:created 2024-09-14T11:07:09.252780+0000 2024-09-14T11:37:34.266 INFO:tasks.workunit.client.0.smithi138.stderr:min_mon_release 19 (squid) 2024-09-14T11:37:34.266 INFO:tasks.workunit.client.0.smithi138.stderr:election_strategy: 1 2024-09-14T11:37:34.266 INFO:tasks.workunit.client.0.smithi138.stderr:0: [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] mon.a 2024-09-14T11:37:34.266 INFO:tasks.workunit.client.0.smithi138.stderr:1: [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] mon.b 2024-09-14T11:37:34.266 INFO:tasks.workunit.client.0.smithi138.stderr:2: [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] mon.c 2024-09-14T11:37:34.266 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-14T11:37:34.266 INFO:tasks.workunit.client.0.smithi138.stderr: -136> 2024-09-14T11:37:33.699+0000 7fd43d7fa640 10 monclient: _finish_auth 0 2024-09-14T11:37:34.267 INFO:tasks.workunit.client.0.smithi138.stderr: -135> 2024-09-14T11:37:33.699+0000 7fd43d7fa640 10 monclient: _check_auth_tickets 2024-09-14T11:37:34.267 INFO:tasks.workunit.client.0.smithi138.stderr: -134> 2024-09-14T11:37:33.699+0000 7fd43d7fa640 10 monclient: handle_config config(0 keys) 2024-09-14T11:37:34.267 INFO:tasks.workunit.client.0.smithi138.stderr: -133> 2024-09-14T11:37:33.699+0000 7fd43d7fa640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:37:34.267 INFO:tasks.workunit.client.0.smithi138.stderr: -132> 2024-09-14T11:37:33.699+0000 7fd43d7fa640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-14T11:37:34.267 INFO:tasks.workunit.client.0.smithi138.stderr: -131> 2024-09-14T11:37:33.699+0000 7fd43d7fa640 10 monclient: dump: 2024-09-14T11:37:34.267 INFO:tasks.workunit.client.0.smithi138.stderr:epoch 1 2024-09-14T11:37:34.267 INFO:tasks.workunit.client.0.smithi138.stderr:fsid 3f225f43-83a6-4aeb-b798-1f04bb49d597 2024-09-14T11:37:34.267 INFO:tasks.workunit.client.0.smithi138.stderr:last_changed 2024-09-14T11:07:09.252780+0000 2024-09-14T11:37:34.267 INFO:tasks.workunit.client.0.smithi138.stderr:created 2024-09-14T11:07:09.252780+0000 2024-09-14T11:37:34.267 INFO:tasks.workunit.client.0.smithi138.stderr:min_mon_release 19 (squid) 2024-09-14T11:37:34.267 INFO:tasks.workunit.client.0.smithi138.stderr:election_strategy: 1 2024-09-14T11:37:34.267 INFO:tasks.workunit.client.0.smithi138.stderr:0: [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] mon.a 2024-09-14T11:37:34.267 INFO:tasks.workunit.client.0.smithi138.stderr:1: [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] mon.b 2024-09-14T11:37:34.267 INFO:tasks.workunit.client.0.smithi138.stderr:2: [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] mon.c 2024-09-14T11:37:34.267 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-14T11:37:34.268 INFO:tasks.workunit.client.0.smithi138.stderr: -130> 2024-09-14T11:37:33.699+0000 7fd43effd640 4 set_mon_vals no callback set 2024-09-14T11:37:34.268 INFO:tasks.workunit.client.0.smithi138.stderr: -129> 2024-09-14T11:37:33.699+0000 7fd561ddd9c0 5 monclient: authenticate success, global_id 7440 2024-09-14T11:37:34.268 INFO:tasks.workunit.client.0.smithi138.stderr: -128> 2024-09-14T11:37:33.699+0000 7fd561ddd9c0 10 monclient: _renew_subs 2024-09-14T11:37:34.268 INFO:tasks.workunit.client.0.smithi138.stderr: -127> 2024-09-14T11:37:33.699+0000 7fd561ddd9c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.138:3300/0 2024-09-14T11:37:34.268 INFO:tasks.workunit.client.0.smithi138.stderr: -126> 2024-09-14T11:37:33.699+0000 7fd561ddd9c0 10 monclient: _renew_subs 2024-09-14T11:37:34.268 INFO:tasks.workunit.client.0.smithi138.stderr: -125> 2024-09-14T11:37:33.699+0000 7fd561ddd9c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.138:3300/0 2024-09-14T11:37:34.268 INFO:tasks.workunit.client.0.smithi138.stderr: -124> 2024-09-14T11:37:33.699+0000 7fd561ddd9c0 1 librados: init done 2024-09-14T11:37:34.268 INFO:tasks.workunit.client.0.smithi138.stderr: -123> 2024-09-14T11:37:33.699+0000 7fd561ddd9c0 5 asok(0x55ff39895d90) register_command cr dump hook 0x55ff39b65db8 2024-09-14T11:37:34.268 INFO:tasks.workunit.client.0.smithi138.stderr: -122> 2024-09-14T11:37:33.703+0000 7fd561ddd9c0 20 rados->read ofs=0 len=0 2024-09-14T11:37:34.268 INFO:tasks.workunit.client.0.smithi138.stderr: -121> 2024-09-14T11:37:33.703+0000 7fd43d7fa640 4 mgrc handle_mgr_map Got map version 5 2024-09-14T11:37:34.268 INFO:tasks.workunit.client.0.smithi138.stderr: -120> 2024-09-14T11:37:33.703+0000 7fd43d7fa640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.138:6832/3778043143,v1:172.21.15.138:6833/3778043143] 2024-09-14T11:37:34.268 INFO:tasks.workunit.client.0.smithi138.stderr: -119> 2024-09-14T11:37:33.703+0000 7fd43d7fa640 4 mgrc reconnect Starting new session with [v2:172.21.15.138:6832/3778043143,v1:172.21.15.138:6833/3778043143] 2024-09-14T11:37:34.268 INFO:tasks.workunit.client.0.smithi138.stderr: -118> 2024-09-14T11:37:33.703+0000 7fd55f0e2640 10 monclient: get_auth_request con 0x7fd4280718d0 auth_method 0 2024-09-14T11:37:34.268 INFO:tasks.workunit.client.0.smithi138.stderr: -117> 2024-09-14T11:37:33.703+0000 7fd55f8e3640 10 monclient: get_auth_request con 0x55ff39b8f510 auth_method 0 2024-09-14T11:37:34.268 INFO:tasks.workunit.client.0.smithi138.stderr: -116> 2024-09-14T11:37:33.703+0000 7fd561ddd9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:37:34.269 INFO:tasks.workunit.client.0.smithi138.stderr: -115> 2024-09-14T11:37:33.703+0000 7fd561ddd9c0 20 realm 2024-09-14T11:37:34.269 INFO:tasks.workunit.client.0.smithi138.stderr: -114> 2024-09-14T11:37:33.703+0000 7fd561ddd9c0 20 rados->read ofs=0 len=0 2024-09-14T11:37:34.269 INFO:tasks.workunit.client.0.smithi138.stderr: -113> 2024-09-14T11:37:33.703+0000 7fd561ddd9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:37:34.269 INFO:tasks.workunit.client.0.smithi138.stderr: -112> 2024-09-14T11:37:33.703+0000 7fd561ddd9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:37:34.269 INFO:tasks.workunit.client.0.smithi138.stderr: -111> 2024-09-14T11:37:33.703+0000 7fd561ddd9c0 20 rados->read ofs=0 len=0 2024-09-14T11:37:34.269 INFO:tasks.workunit.client.0.smithi138.stderr: -110> 2024-09-14T11:37:33.703+0000 7fd561ddd9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:37:34.269 INFO:tasks.workunit.client.0.smithi138.stderr: -109> 2024-09-14T11:37:33.703+0000 7fd561ddd9c0 20 rados->read ofs=0 len=0 2024-09-14T11:37:34.269 INFO:tasks.workunit.client.0.smithi138.stderr: -108> 2024-09-14T11:37:33.707+0000 7fd55f0e2640 10 monclient: get_auth_request con 0x55ff39b93860 auth_method 0 2024-09-14T11:37:34.269 INFO:tasks.workunit.client.0.smithi138.stderr: -107> 2024-09-14T11:37:33.707+0000 7fd561ddd9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:37:34.269 INFO:tasks.workunit.client.0.smithi138.stderr: -106> 2024-09-14T11:37:33.707+0000 7fd561ddd9c0 20 rados->read ofs=0 len=0 2024-09-14T11:37:34.269 INFO:tasks.workunit.client.0.smithi138.stderr: -105> 2024-09-14T11:37:33.707+0000 7fd5600e4640 10 monclient: get_auth_request con 0x55ff39b96f80 auth_method 0 2024-09-14T11:37:34.269 INFO:tasks.workunit.client.0.smithi138.stderr: -104> 2024-09-14T11:37:33.707+0000 7fd561ddd9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:37:34.269 INFO:tasks.workunit.client.0.smithi138.stderr: -103> 2024-09-14T11:37:33.707+0000 7fd561ddd9c0 20 searching for the correct realm 2024-09-14T11:37:34.269 INFO:tasks.workunit.client.0.smithi138.stderr: -102> 2024-09-14T11:37:33.707+0000 7fd55f8e3640 10 monclient: get_auth_request con 0x55ff39b9bd40 auth_method 0 2024-09-14T11:37:34.269 INFO:tasks.workunit.client.0.smithi138.stderr: -101> 2024-09-14T11:37:33.707+0000 7fd55f0e2640 10 monclient: get_auth_request con 0x7fd55003d060 auth_method 0 2024-09-14T11:37:34.269 INFO:tasks.workunit.client.0.smithi138.stderr: -100> 2024-09-14T11:37:33.711+0000 7fd5600e4640 10 monclient: get_auth_request con 0x7fd5580fe920 auth_method 0 2024-09-14T11:37:34.270 INFO:tasks.workunit.client.0.smithi138.stderr: -99> 2024-09-14T11:37:33.711+0000 7fd5600e4640 0 -- 172.21.15.138:0/2435175307 >> [v2:172.21.15.154:6824/416768175,v1:172.21.15.154:6825/416768175] conn(0x7fd5580fe920 msgr2=0x7fd558105290 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-14T11:37:34.270 INFO:tasks.workunit.client.0.smithi138.stderr: -98> 2024-09-14T11:37:33.915+0000 7fd5600e4640 10 monclient: get_auth_request con 0x7fd5580fe920 auth_method 0 2024-09-14T11:37:34.270 INFO:tasks.workunit.client.0.smithi138.stderr: -97> 2024-09-14T11:37:33.919+0000 7fd55f8e3640 10 monclient: get_auth_request con 0x7fd558107b10 auth_method 0 2024-09-14T11:37:34.270 INFO:tasks.workunit.client.0.smithi138.stderr: -96> 2024-09-14T11:37:33.927+0000 7fd55f0e2640 10 monclient: get_auth_request con 0x7fd558134390 auth_method 0 2024-09-14T11:37:34.270 INFO:tasks.workunit.client.0.smithi138.stderr: -95> 2024-09-14T11:37:33.927+0000 7fd55f0e2640 0 -- 172.21.15.138:0/2435175307 >> [v2:172.21.15.138:6816/326481658,v1:172.21.15.138:6817/326481658] conn(0x7fd558134390 msgr2=0x7fd5581180b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:37:34.270 INFO:tasks.workunit.client.0.smithi138.stderr: -94> 2024-09-14T11:37:34.131+0000 7fd55f0e2640 10 monclient: get_auth_request con 0x7fd558134390 auth_method 0 2024-09-14T11:37:34.270 INFO:tasks.workunit.client.0.smithi138.stderr: -93> 2024-09-14T11:37:34.143+0000 7fd561ddd9c0 20 RGWRados::pool_iterate: got zone_info.d9e72d30-c60b-4d0d-9267-fdc36392d5ad 2024-09-14T11:37:34.270 INFO:tasks.workunit.client.0.smithi138.stderr: -92> 2024-09-14T11:37:34.143+0000 7fd561ddd9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:37:34.270 INFO:tasks.workunit.client.0.smithi138.stderr: -91> 2024-09-14T11:37:34.143+0000 7fd561ddd9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:37:34.270 INFO:tasks.workunit.client.0.smithi138.stderr: -90> 2024-09-14T11:37:34.143+0000 7fd561ddd9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:37:34.270 INFO:tasks.workunit.client.0.smithi138.stderr: -89> 2024-09-14T11:37:34.143+0000 7fd561ddd9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:37:34.270 INFO:tasks.workunit.client.0.smithi138.stderr: -88> 2024-09-14T11:37:34.143+0000 7fd561ddd9c0 20 RGWRados::pool_iterate: got zonegroup_info.65ab941b-da8c-4160-94fb-3672b069d44f 2024-09-14T11:37:34.270 INFO:tasks.workunit.client.0.smithi138.stderr: -87> 2024-09-14T11:37:34.143+0000 7fd561ddd9c0 20 rados->read ofs=0 len=0 2024-09-14T11:37:34.270 INFO:tasks.workunit.client.0.smithi138.stderr: -86> 2024-09-14T11:37:34.143+0000 7fd561ddd9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:37:34.270 INFO:tasks.workunit.client.0.smithi138.stderr: -85> 2024-09-14T11:37:34.143+0000 7fd561ddd9c0 20 rados->read ofs=0 len=0 2024-09-14T11:37:34.271 INFO:tasks.workunit.client.0.smithi138.stderr: -84> 2024-09-14T11:37:34.147+0000 7fd561ddd9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:37:34.271 INFO:tasks.workunit.client.0.smithi138.stderr: -83> 2024-09-14T11:37:34.147+0000 7fd561ddd9c0 20 rados->read ofs=0 len=0 2024-09-14T11:37:34.271 INFO:tasks.workunit.client.0.smithi138.stderr: -82> 2024-09-14T11:37:34.147+0000 7fd561ddd9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:37:34.271 INFO:tasks.workunit.client.0.smithi138.stderr: -81> 2024-09-14T11:37:34.147+0000 7fd561ddd9c0 20 zone default found 2024-09-14T11:37:34.271 INFO:tasks.workunit.client.0.smithi138.stderr: -80> 2024-09-14T11:37:34.147+0000 7fd561ddd9c0 4 Realm: () 2024-09-14T11:37:34.271 INFO:tasks.workunit.client.0.smithi138.stderr: -79> 2024-09-14T11:37:34.147+0000 7fd561ddd9c0 4 ZoneGroup: default (65ab941b-da8c-4160-94fb-3672b069d44f) 2024-09-14T11:37:34.271 INFO:tasks.workunit.client.0.smithi138.stderr: -78> 2024-09-14T11:37:34.147+0000 7fd561ddd9c0 4 Zone: default (d9e72d30-c60b-4d0d-9267-fdc36392d5ad) 2024-09-14T11:37:34.271 INFO:tasks.workunit.client.0.smithi138.stderr: -77> 2024-09-14T11:37:34.147+0000 7fd561ddd9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:37:34.271 INFO:tasks.workunit.client.0.smithi138.stderr: -76> 2024-09-14T11:37:34.147+0000 7fd561ddd9c0 20 zonegroup default 2024-09-14T11:37:34.271 INFO:tasks.workunit.client.0.smithi138.stderr: -75> 2024-09-14T11:37:34.147+0000 7fd561ddd9c0 20 rados->read ofs=0 len=0 2024-09-14T11:37:34.271 INFO:tasks.workunit.client.0.smithi138.stderr: -74> 2024-09-14T11:37:34.147+0000 7fd561ddd9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:37:34.271 INFO:tasks.workunit.client.0.smithi138.stderr: -73> 2024-09-14T11:37:34.147+0000 7fd561ddd9c0 20 rados->read ofs=0 len=0 2024-09-14T11:37:34.271 INFO:tasks.workunit.client.0.smithi138.stderr: -72> 2024-09-14T11:37:34.147+0000 7fd561ddd9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:37:34.271 INFO:tasks.workunit.client.0.smithi138.stderr: -71> 2024-09-14T11:37:34.147+0000 7fd561ddd9c0 20 rados->read ofs=0 len=0 2024-09-14T11:37:34.271 INFO:tasks.workunit.client.0.smithi138.stderr: -70> 2024-09-14T11:37:34.151+0000 7fd561ddd9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:37:34.271 INFO:tasks.workunit.client.0.smithi138.stderr: -69> 2024-09-14T11:37:34.151+0000 7fd561ddd9c0 20 started sync module instance, tier type = 2024-09-14T11:37:34.272 INFO:tasks.workunit.client.0.smithi138.stderr: -68> 2024-09-14T11:37:34.151+0000 7fd561ddd9c0 20 started zone id=d9e72d30-c60b-4d0d-9267-fdc36392d5ad (name=default) with tier type = 2024-09-14T11:37:34.272 INFO:tasks.workunit.client.0.smithi138.stderr: -67> 2024-09-14T11:37:34.175+0000 7fd561ddd9c0 20 add_watcher() i=0 2024-09-14T11:37:34.272 INFO:tasks.workunit.client.0.smithi138.stderr: -66> 2024-09-14T11:37:34.175+0000 7fd561ddd9c0 20 add_watcher() i=1 2024-09-14T11:37:34.272 INFO:tasks.workunit.client.0.smithi138.stderr: -65> 2024-09-14T11:37:34.175+0000 7fd561ddd9c0 20 add_watcher() i=2 2024-09-14T11:37:34.272 INFO:tasks.workunit.client.0.smithi138.stderr: -64> 2024-09-14T11:37:34.175+0000 7fd561ddd9c0 20 add_watcher() i=3 2024-09-14T11:37:34.272 INFO:tasks.workunit.client.0.smithi138.stderr: -63> 2024-09-14T11:37:34.175+0000 7fd561ddd9c0 20 add_watcher() i=4 2024-09-14T11:37:34.272 INFO:tasks.workunit.client.0.smithi138.stderr: -62> 2024-09-14T11:37:34.175+0000 7fd561ddd9c0 20 add_watcher() i=5 2024-09-14T11:37:34.272 INFO:tasks.workunit.client.0.smithi138.stderr: -61> 2024-09-14T11:37:34.175+0000 7fd561ddd9c0 20 add_watcher() i=6 2024-09-14T11:37:34.272 INFO:tasks.workunit.client.0.smithi138.stderr: -60> 2024-09-14T11:37:34.179+0000 7fd561ddd9c0 20 add_watcher() i=7 2024-09-14T11:37:34.272 INFO:tasks.workunit.client.0.smithi138.stderr: -59> 2024-09-14T11:37:34.179+0000 7fd561ddd9c0 2 all 8 watchers are set, enabling cache 2024-09-14T11:37:34.272 INFO:tasks.workunit.client.0.smithi138.stderr: -58> 2024-09-14T11:37:34.183+0000 7fd561ddd9c0 5 AuthRegistry(0x7fff90fa4cc0) adding auth protocol: cephx 2024-09-14T11:37:34.272 INFO:tasks.workunit.client.0.smithi138.stderr: -57> 2024-09-14T11:37:34.183+0000 7fd561ddd9c0 5 AuthRegistry(0x7fff90fa4cc0) adding auth protocol: cephx 2024-09-14T11:37:34.272 INFO:tasks.workunit.client.0.smithi138.stderr: -56> 2024-09-14T11:37:34.183+0000 7fd561ddd9c0 5 AuthRegistry(0x7fff90fa4cc0) adding auth protocol: cephx 2024-09-14T11:37:34.272 INFO:tasks.workunit.client.0.smithi138.stderr: -55> 2024-09-14T11:37:34.183+0000 7fd561ddd9c0 5 AuthRegistry(0x7fff90fa4cc0) adding con mode: secure 2024-09-14T11:37:34.272 INFO:tasks.workunit.client.0.smithi138.stderr: -54> 2024-09-14T11:37:34.183+0000 7fd561ddd9c0 5 AuthRegistry(0x7fff90fa4cc0) adding con mode: crc 2024-09-14T11:37:34.273 INFO:tasks.workunit.client.0.smithi138.stderr: -53> 2024-09-14T11:37:34.183+0000 7fd561ddd9c0 5 AuthRegistry(0x7fff90fa4cc0) adding con mode: secure 2024-09-14T11:37:34.273 INFO:tasks.workunit.client.0.smithi138.stderr: -52> 2024-09-14T11:37:34.183+0000 7fd561ddd9c0 5 AuthRegistry(0x7fff90fa4cc0) adding con mode: crc 2024-09-14T11:37:34.273 INFO:tasks.workunit.client.0.smithi138.stderr: -51> 2024-09-14T11:37:34.183+0000 7fd561ddd9c0 5 AuthRegistry(0x7fff90fa4cc0) adding con mode: secure 2024-09-14T11:37:34.273 INFO:tasks.workunit.client.0.smithi138.stderr: -50> 2024-09-14T11:37:34.183+0000 7fd561ddd9c0 5 AuthRegistry(0x7fff90fa4cc0) adding con mode: crc 2024-09-14T11:37:34.273 INFO:tasks.workunit.client.0.smithi138.stderr: -49> 2024-09-14T11:37:34.183+0000 7fd561ddd9c0 5 AuthRegistry(0x7fff90fa4cc0) adding con mode: crc 2024-09-14T11:37:34.273 INFO:tasks.workunit.client.0.smithi138.stderr: -48> 2024-09-14T11:37:34.183+0000 7fd561ddd9c0 5 AuthRegistry(0x7fff90fa4cc0) adding con mode: secure 2024-09-14T11:37:34.273 INFO:tasks.workunit.client.0.smithi138.stderr: -47> 2024-09-14T11:37:34.183+0000 7fd561ddd9c0 5 AuthRegistry(0x7fff90fa4cc0) adding con mode: crc 2024-09-14T11:37:34.273 INFO:tasks.workunit.client.0.smithi138.stderr: -46> 2024-09-14T11:37:34.183+0000 7fd561ddd9c0 5 AuthRegistry(0x7fff90fa4cc0) adding con mode: secure 2024-09-14T11:37:34.273 INFO:tasks.workunit.client.0.smithi138.stderr: -45> 2024-09-14T11:37:34.183+0000 7fd561ddd9c0 5 AuthRegistry(0x7fff90fa4cc0) adding con mode: crc 2024-09-14T11:37:34.273 INFO:tasks.workunit.client.0.smithi138.stderr: -44> 2024-09-14T11:37:34.183+0000 7fd561ddd9c0 5 AuthRegistry(0x7fff90fa4cc0) adding con mode: secure 2024-09-14T11:37:34.273 INFO:tasks.workunit.client.0.smithi138.stderr: -43> 2024-09-14T11:37:34.183+0000 7fd415fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:37:34.273 INFO:tasks.workunit.client.0.smithi138.stderr: -42> 2024-09-14T11:37:34.183+0000 7fd561ddd9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:37:34.273 INFO:tasks.workunit.client.0.smithi138.stderr: -41> 2024-09-14T11:37:34.183+0000 7fd561ddd9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:37:34.273 INFO:tasks.workunit.client.0.smithi138.stderr: -40> 2024-09-14T11:37:34.183+0000 7fd561ddd9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:37:34.273 INFO:tasks.workunit.client.0.smithi138.stderr: -39> 2024-09-14T11:37:34.183+0000 7fd561ddd9c0 5 asok(0x55ff39895d90) register_command cache list hook 0x55ff39b63db0 2024-09-14T11:37:34.274 INFO:tasks.workunit.client.0.smithi138.stderr: -38> 2024-09-14T11:37:34.183+0000 7fd561ddd9c0 5 asok(0x55ff39895d90) register_command cache inspect hook 0x55ff39b63db0 2024-09-14T11:37:34.274 INFO:tasks.workunit.client.0.smithi138.stderr: -37> 2024-09-14T11:37:34.183+0000 7fd561ddd9c0 5 asok(0x55ff39895d90) register_command cache erase hook 0x55ff39b63db0 2024-09-14T11:37:34.274 INFO:tasks.workunit.client.0.smithi138.stderr: -36> 2024-09-14T11:37:34.183+0000 7fd561ddd9c0 5 asok(0x55ff39895d90) register_command cache zap hook 0x55ff39b63db0 2024-09-14T11:37:34.274 INFO:tasks.workunit.client.0.smithi138.stderr: -35> 2024-09-14T11:37:34.183+0000 7fd561ddd9c0 5 note: GC not initialized 2024-09-14T11:37:34.274 INFO:tasks.workunit.client.0.smithi138.stderr: -34> 2024-09-14T11:37:34.183+0000 7fd414fe1640 20 reqs_thread_entry: start 2024-09-14T11:37:34.274 INFO:tasks.workunit.client.0.smithi138.stderr: -33> 2024-09-14T11:37:34.183+0000 7fd561ddd9c0 5 asok(0x55ff39895d90) register_command sync trace show hook 0x7fd55405d020 2024-09-14T11:37:34.274 INFO:tasks.workunit.client.0.smithi138.stderr: -32> 2024-09-14T11:37:34.183+0000 7fd561ddd9c0 5 asok(0x55ff39895d90) register_command sync trace history hook 0x7fd55405d020 2024-09-14T11:37:34.274 INFO:tasks.workunit.client.0.smithi138.stderr: -31> 2024-09-14T11:37:34.183+0000 7fd561ddd9c0 5 asok(0x55ff39895d90) register_command sync trace active hook 0x7fd55405d020 2024-09-14T11:37:34.274 INFO:tasks.workunit.client.0.smithi138.stderr: -30> 2024-09-14T11:37:34.183+0000 7fd561ddd9c0 5 asok(0x55ff39895d90) register_command sync trace active_short hook 0x7fd55405d020 2024-09-14T11:37:34.274 INFO:tasks.workunit.client.0.smithi138.stderr: -29> 2024-09-14T11:37:34.183+0000 7fd561ddd9c0 20 init_complete bucket index max shards: 11 2024-09-14T11:37:34.274 INFO:tasks.workunit.client.0.smithi138.stderr: -28> 2024-09-14T11:37:34.183+0000 7fd561ddd9c0 20 Filter name: none 2024-09-14T11:37:34.274 INFO:tasks.workunit.client.0.smithi138.stderr: -27> 2024-09-14T11:37:34.183+0000 7fd38e7fc640 20 reqs_thread_entry: start 2024-09-14T11:37:34.274 INFO:tasks.workunit.client.0.smithi138.stderr: -26> 2024-09-14T11:37:34.183+0000 7fd561ddd9c0 10 cache get: name=default.rgw.meta+root+abort-at-do-reshard : miss 2024-09-14T11:37:34.274 INFO:tasks.workunit.client.0.smithi138.stderr: -25> 2024-09-14T11:37:34.183+0000 7fd561ddd9c0 20 rados->read ofs=0 len=0 2024-09-14T11:37:34.274 INFO:tasks.workunit.client.0.smithi138.stderr: -24> 2024-09-14T11:37:34.187+0000 7fd561ddd9c0 20 rados_obj.operate() r=0 bl.length=187 2024-09-14T11:37:34.275 INFO:tasks.workunit.client.0.smithi138.stderr: -23> 2024-09-14T11:37:34.187+0000 7fd561ddd9c0 10 cache put: name=default.rgw.meta+root+abort-at-do-reshard info.flags=0x11 2024-09-14T11:37:34.275 INFO:tasks.workunit.client.0.smithi138.stderr: -22> 2024-09-14T11:37:34.187+0000 7fd561ddd9c0 10 adding default.rgw.meta+root+abort-at-do-reshard to cache LRU end 2024-09-14T11:37:34.275 INFO:tasks.workunit.client.0.smithi138.stderr: -21> 2024-09-14T11:37:34.187+0000 7fd561ddd9c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.34 : miss 2024-09-14T11:37:34.275 INFO:tasks.workunit.client.0.smithi138.stderr: -20> 2024-09-14T11:37:34.187+0000 7fd561ddd9c0 20 rados->read ofs=0 len=0 2024-09-14T11:37:34.275 INFO:tasks.workunit.client.0.smithi138.stderr: -19> 2024-09-14T11:37:34.187+0000 7fd561ddd9c0 20 rados_obj.operate() r=0 bl.length=409 2024-09-14T11:37:34.275 INFO:tasks.workunit.client.0.smithi138.stderr: -18> 2024-09-14T11:37:34.187+0000 7fd561ddd9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.34 info.flags=0x17 2024-09-14T11:37:34.275 INFO:tasks.workunit.client.0.smithi138.stderr: -17> 2024-09-14T11:37:34.187+0000 7fd561ddd9c0 10 adding default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.34 to cache LRU end 2024-09-14T11:37:34.275 INFO:tasks.workunit.client.0.smithi138.stderr: -16> 2024-09-14T11:37:34.187+0000 7fd561ddd9c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:37:34.275 INFO:tasks.workunit.client.0.smithi138.stderr: -15> 2024-09-14T11:37:34.187+0000 7fd561ddd9c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:37:34.275 INFO:tasks.workunit.client.0.smithi138.stderr: -14> 2024-09-14T11:37:34.187+0000 7fd561ddd9c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.34 2024-09-14T11:37:34.275 INFO:tasks.workunit.client.0.smithi138.stderr: -13> 2024-09-14T11:37:34.199+0000 7fd561ddd9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.34 info.flags=0x17 2024-09-14T11:37:34.275 INFO:tasks.workunit.client.0.smithi138.stderr: -12> 2024-09-14T11:37:34.199+0000 7fd561ddd9c0 10 moving default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.34 to cache LRU end 2024-09-14T11:37:34.275 INFO:tasks.workunit.client.0.smithi138.stderr: -11> 2024-09-14T11:37:34.199+0000 7fd561ddd9c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:37:34.275 INFO:tasks.workunit.client.0.smithi138.stderr: -10> 2024-09-14T11:37:34.199+0000 7fd561ddd9c0 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-do-reshard:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.34, ofs0, ns] 2024-09-14T11:37:34.275 INFO:tasks.workunit.client.0.smithi138.stderr: -9> 2024-09-14T11:37:34.199+0000 7fd43e7fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366215 cookie 94554673513184 notifier 7440 bl.length()=911 2024-09-14T11:37:34.275 INFO:tasks.workunit.client.0.smithi138.stderr: -8> 2024-09-14T11:37:34.199+0000 7fd43e7fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.34 info.flags=0x17 2024-09-14T11:37:34.276 INFO:tasks.workunit.client.0.smithi138.stderr: -7> 2024-09-14T11:37:34.199+0000 7fd43e7fc640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.34 to cache LRU end 2024-09-14T11:37:34.276 INFO:tasks.workunit.client.0.smithi138.stderr: -6> 2024-09-14T11:37:34.199+0000 7fd43e7fc640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:37:34.276 INFO:tasks.workunit.client.0.smithi138.stderr: -5> 2024-09-14T11:37:34.203+0000 7fd561ddd9c0 20 handle_bi_update(): bucket=:abort-at-do-reshard[d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.34]): orig_sources= new_sources= 2024-09-14T11:37:34.276 INFO:tasks.workunit.client.0.smithi138.stderr: -4> 2024-09-14T11:37:34.203+0000 7fd561ddd9c0 20 handle_bi_update(): bucket=:abort-at-do-reshard[d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.34]): potential sources added=[] removed=[] 2024-09-14T11:37:34.276 INFO:tasks.workunit.client.0.smithi138.stderr: -3> 2024-09-14T11:37:34.203+0000 7fd561ddd9c0 20 handle_bi_update(): bucket=:abort-at-do-reshard[d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.34]): orig_dests= new_dests= 2024-09-14T11:37:34.276 INFO:tasks.workunit.client.0.smithi138.stderr: -2> 2024-09-14T11:37:34.203+0000 7fd561ddd9c0 20 handle_bi_update(): bucket=:abort-at-do-reshard[d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.34]): potential dests added=[] removed=[] 2024-09-14T11:37:34.276 INFO:tasks.workunit.client.0.smithi138.stderr: -1> 2024-09-14T11:37:34.215+0000 7fd561ddd9c0 -1 ./src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7fd561ddd9c0 time 2024-09-14T11:37:34.216403+0000 2024-09-14T11:37:34.276 INFO:tasks.workunit.client.0.smithi138.stderr:./src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-14T11:37:34.276 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-14T11:37:34.276 INFO:tasks.workunit.client.0.smithi138.stderr: ceph version 19.3.0-4907-ga2782315 (a2782315255a3e7d5f6cdc9eb35785187ff6ddf8) squid (dev) 2024-09-14T11:37:34.276 INFO:tasks.workunit.client.0.smithi138.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x121) [0x7fd5656b72eb] 2024-09-14T11:37:34.276 INFO:tasks.workunit.client.0.smithi138.stderr: 2: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7fd5656b749f] 2024-09-14T11:37:34.276 INFO:tasks.workunit.client.0.smithi138.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55ff38334c01] 2024-09-14T11:37:34.276 INFO:tasks.workunit.client.0.smithi138.stderr: 4: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x17a) [0x55ff38349f3a] 2024-09-14T11:37:34.277 INFO:tasks.workunit.client.0.smithi138.stderr: 5: main() 2024-09-14T11:37:34.277 INFO:tasks.workunit.client.0.smithi138.stderr: 6: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7fd56451dd90] 2024-09-14T11:37:34.277 INFO:tasks.workunit.client.0.smithi138.stderr: 7: __libc_start_main() 2024-09-14T11:37:34.277 INFO:tasks.workunit.client.0.smithi138.stderr: 8: _start() 2024-09-14T11:37:34.277 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-14T11:37:34.277 INFO:tasks.workunit.client.0.smithi138.stderr: 0> 2024-09-14T11:37:34.215+0000 7fd561ddd9c0 -1 *** Caught signal (Aborted) ** 2024-09-14T11:37:34.277 INFO:tasks.workunit.client.0.smithi138.stderr: in thread 7fd561ddd9c0 thread_name:radosgw-admin 2024-09-14T11:37:34.277 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-14T11:37:34.277 INFO:tasks.workunit.client.0.smithi138.stderr: ceph version 19.3.0-4907-ga2782315 (a2782315255a3e7d5f6cdc9eb35785187ff6ddf8) squid (dev) 2024-09-14T11:37:34.277 INFO:tasks.workunit.client.0.smithi138.stderr: 1: /lib/x86_64-linux-gnu/libc.so.6(+0x42520) [0x7fd564536520] 2024-09-14T11:37:34.277 INFO:tasks.workunit.client.0.smithi138.stderr: 2: pthread_kill() 2024-09-14T11:37:34.277 INFO:tasks.workunit.client.0.smithi138.stderr: 3: raise() 2024-09-14T11:37:34.277 INFO:tasks.workunit.client.0.smithi138.stderr: 4: abort() 2024-09-14T11:37:34.277 INFO:tasks.workunit.client.0.smithi138.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x17b) [0x7fd5656b7345] 2024-09-14T11:37:34.277 INFO:tasks.workunit.client.0.smithi138.stderr: 6: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7fd5656b749f] 2024-09-14T11:37:34.278 INFO:tasks.workunit.client.0.smithi138.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55ff38334c01] 2024-09-14T11:37:34.278 INFO:tasks.workunit.client.0.smithi138.stderr: 8: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x17a) [0x55ff38349f3a] 2024-09-14T11:37:34.278 INFO:tasks.workunit.client.0.smithi138.stderr: 9: main() 2024-09-14T11:37:34.278 INFO:tasks.workunit.client.0.smithi138.stderr: 10: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7fd56451dd90] 2024-09-14T11:37:34.278 INFO:tasks.workunit.client.0.smithi138.stderr: 11: __libc_start_main() 2024-09-14T11:37:34.278 INFO:tasks.workunit.client.0.smithi138.stderr: 12: _start() 2024-09-14T11:37:34.278 INFO:tasks.workunit.client.0.smithi138.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-14T11:37:34.278 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-14T11:37:34.278 INFO:tasks.workunit.client.0.smithi138.stderr:--- logging levels --- 2024-09-14T11:37:34.278 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 none 2024-09-14T11:37:34.278 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 1 lockdep 2024-09-14T11:37:34.278 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 1 context 2024-09-14T11:37:34.278 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 1 crush 2024-09-14T11:37:34.278 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 mds 2024-09-14T11:37:34.278 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 mds_balancer 2024-09-14T11:37:34.279 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 mds_locker 2024-09-14T11:37:34.279 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 mds_log 2024-09-14T11:37:34.279 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 mds_log_expire 2024-09-14T11:37:34.279 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 mds_migrator 2024-09-14T11:37:34.279 INFO:tasks.workunit.client.0.smithi138.stderr: 3/ 5 mds_quiesce 2024-09-14T11:37:34.279 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 1 buffer 2024-09-14T11:37:34.279 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 1 timer 2024-09-14T11:37:34.279 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 1 filer 2024-09-14T11:37:34.279 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 1 striper 2024-09-14T11:37:34.279 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 1 objecter 2024-09-14T11:37:34.279 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 rados 2024-09-14T11:37:34.279 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 rbd 2024-09-14T11:37:34.279 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 rbd_mirror 2024-09-14T11:37:34.279 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 rbd_replay 2024-09-14T11:37:34.280 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 rbd_pwl 2024-09-14T11:37:34.280 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 journaler 2024-09-14T11:37:34.280 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 objectcacher 2024-09-14T11:37:34.280 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 immutable_obj_cache 2024-09-14T11:37:34.280 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 client 2024-09-14T11:37:34.280 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 osd 2024-09-14T11:37:34.280 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 optracker 2024-09-14T11:37:34.280 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 objclass 2024-09-14T11:37:34.280 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 3 filestore 2024-09-14T11:37:34.280 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 3 journal 2024-09-14T11:37:34.280 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 0 ms 2024-09-14T11:37:34.280 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 mon 2024-09-14T11:37:34.280 INFO:tasks.workunit.client.0.smithi138.stderr: 0/10 monc 2024-09-14T11:37:34.280 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 paxos 2024-09-14T11:37:34.280 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 tp 2024-09-14T11:37:34.281 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 auth 2024-09-14T11:37:34.281 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 crypto 2024-09-14T11:37:34.281 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 1 finisher 2024-09-14T11:37:34.281 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 1 reserver 2024-09-14T11:37:34.281 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 heartbeatmap 2024-09-14T11:37:34.281 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 perfcounter 2024-09-14T11:37:34.281 INFO:tasks.workunit.client.0.smithi138.stderr: 20/20 rgw 2024-09-14T11:37:34.281 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 rgw_sync 2024-09-14T11:37:34.281 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 rgw_datacache 2024-09-14T11:37:34.281 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 rgw_access 2024-09-14T11:37:34.281 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 rgw_dbstore 2024-09-14T11:37:34.281 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 rgw_flight 2024-09-14T11:37:34.281 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 rgw_lifecycle 2024-09-14T11:37:34.281 INFO:tasks.workunit.client.0.smithi138.stderr: 20/20 rgw_notification 2024-09-14T11:37:34.282 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 javaclient 2024-09-14T11:37:34.282 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 asok 2024-09-14T11:37:34.282 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 1 throttle 2024-09-14T11:37:34.282 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 0 refs 2024-09-14T11:37:34.282 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 compressor 2024-09-14T11:37:34.282 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 bluestore 2024-09-14T11:37:34.282 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 bluefs 2024-09-14T11:37:34.282 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 3 bdev 2024-09-14T11:37:34.282 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 kstore 2024-09-14T11:37:34.282 INFO:tasks.workunit.client.0.smithi138.stderr: 4/ 5 rocksdb 2024-09-14T11:37:34.282 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 fuse 2024-09-14T11:37:34.282 INFO:tasks.workunit.client.0.smithi138.stderr: 2/ 5 mgr 2024-09-14T11:37:34.282 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 mgrc 2024-09-14T11:37:34.282 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 dpdk 2024-09-14T11:37:34.282 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 eventtrace 2024-09-14T11:37:34.282 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 prioritycache 2024-09-14T11:37:34.283 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 test 2024-09-14T11:37:34.283 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 cephfs_mirror 2024-09-14T11:37:34.283 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 cephsqlite 2024-09-14T11:37:34.283 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 crimson_interrupt 2024-09-14T11:37:34.283 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 seastore 2024-09-14T11:37:34.283 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 seastore_onode 2024-09-14T11:37:34.283 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 seastore_odata 2024-09-14T11:37:34.283 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 seastore_omap 2024-09-14T11:37:34.283 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 seastore_tm 2024-09-14T11:37:34.283 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 seastore_t 2024-09-14T11:37:34.283 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 seastore_cleaner 2024-09-14T11:37:34.283 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 seastore_epm 2024-09-14T11:37:34.283 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 seastore_lba 2024-09-14T11:37:34.283 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 seastore_fixedkv_tree 2024-09-14T11:37:34.283 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 seastore_cache 2024-09-14T11:37:34.283 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 seastore_journal 2024-09-14T11:37:34.284 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 seastore_device 2024-09-14T11:37:34.284 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 seastore_backref 2024-09-14T11:37:34.284 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 alienstore 2024-09-14T11:37:34.284 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 mclock 2024-09-14T11:37:34.284 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 cyanstore 2024-09-14T11:37:34.284 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 ceph_exporter 2024-09-14T11:37:34.284 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 memstore 2024-09-14T11:37:34.284 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 trace 2024-09-14T11:37:34.284 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 ceph_dedup 2024-09-14T11:37:34.284 INFO:tasks.workunit.client.0.smithi138.stderr: -2/-2 (syslog threshold) 2024-09-14T11:37:34.284 INFO:tasks.workunit.client.0.smithi138.stderr: 99/99 (stderr threshold) 2024-09-14T11:37:34.284 INFO:tasks.workunit.client.0.smithi138.stderr:--- pthread ID / name mapping for recent threads --- 2024-09-14T11:37:34.284 INFO:tasks.workunit.client.0.smithi138.stderr: 7fd38e7fc640 / http_manager 2024-09-14T11:37:34.284 INFO:tasks.workunit.client.0.smithi138.stderr: 7fd414fe1640 / http_manager 2024-09-14T11:37:34.284 INFO:tasks.workunit.client.0.smithi138.stderr: 7fd415fe3640 / rgw_dt_lg_renew 2024-09-14T11:37:34.285 INFO:tasks.workunit.client.0.smithi138.stderr: 7fd43d7fa640 / ms_dispatch 2024-09-14T11:37:34.285 INFO:tasks.workunit.client.0.smithi138.stderr: 7fd43e7fc640 / io_context_pool 2024-09-14T11:37:34.285 INFO:tasks.workunit.client.0.smithi138.stderr: 7fd43effd640 / io_context_pool 2024-09-14T11:37:34.285 INFO:tasks.workunit.client.0.smithi138.stderr: 7fd4457fa640 / ms_dispatch 2024-09-14T11:37:34.285 INFO:tasks.workunit.client.0.smithi138.stderr: 7fd447fff640 / ms_dispatch 2024-09-14T11:37:34.285 INFO:tasks.workunit.client.0.smithi138.stderr: 7fd44de0b640 / io_context_pool 2024-09-14T11:37:34.285 INFO:tasks.workunit.client.0.smithi138.stderr: 7fd55f0e2640 / msgr-worker-2 2024-09-14T11:37:34.285 INFO:tasks.workunit.client.0.smithi138.stderr: 7fd55f8e3640 / msgr-worker-1 2024-09-14T11:37:34.285 INFO:tasks.workunit.client.0.smithi138.stderr: 7fd5600e4640 / msgr-worker-0 2024-09-14T11:37:34.285 INFO:tasks.workunit.client.0.smithi138.stderr: 7fd5608e5640 / io_context_pool 2024-09-14T11:37:34.285 INFO:tasks.workunit.client.0.smithi138.stderr: 7fd561ddd9c0 / radosgw-admin 2024-09-14T11:37:34.285 INFO:tasks.workunit.client.0.smithi138.stderr: max_recent 500 2024-09-14T11:37:34.285 INFO:tasks.workunit.client.0.smithi138.stderr: max_new 1000 2024-09-14T11:37:34.285 INFO:tasks.workunit.client.0.smithi138.stderr: log_file /var/log/ceph/ceph-client.admin.119144.log 2024-09-14T11:37:34.285 INFO:tasks.workunit.client.0.smithi138.stderr:--- end dump of recent events --- 2024-09-14T11:37:34.286 INFO:tasks.workunit.client.0.smithi138.stderr:--- begin dump of recent events --- 2024-09-14T11:37:34.286 INFO:tasks.workunit.client.0.smithi138.stderr: -499> 2024-09-14T11:37:33.679+0000 7fd55f0e2640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:37:34.286 INFO:tasks.workunit.client.0.smithi138.stderr: -498> 2024-09-14T11:37:33.679+0000 7fd55f0e2640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:37:34.286 INFO:tasks.workunit.client.0.smithi138.stderr: -497> 2024-09-14T11:37:33.679+0000 7fd55f0e2640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:37:34.286 INFO:tasks.workunit.client.0.smithi138.stderr: -496> 2024-09-14T11:37:33.679+0000 7fd55f8e3640 10 monclient(hunting): handle_auth_done global_id 7428 payload 274 2024-09-14T11:37:34.286 INFO:tasks.workunit.client.0.smithi138.stderr: -495> 2024-09-14T11:37:33.679+0000 7fd55f8e3640 10 monclient: _finish_hunting 0 2024-09-14T11:37:34.286 INFO:tasks.workunit.client.0.smithi138.stderr: -494> 2024-09-14T11:37:33.679+0000 7fd55f8e3640 1 monclient: found mon.noname-a 2024-09-14T11:37:34.286 INFO:tasks.workunit.client.0.smithi138.stderr: -493> 2024-09-14T11:37:33.679+0000 7fd55f8e3640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.138:3300/0 2024-09-14T11:37:34.286 INFO:tasks.workunit.client.0.smithi138.stderr: -492> 2024-09-14T11:37:33.679+0000 7fd44de0b640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:37:34.286 INFO:tasks.workunit.client.0.smithi138.stderr: -491> 2024-09-14T11:37:33.679+0000 7fd44de0b640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-14T11:37:34.286 INFO:tasks.workunit.client.0.smithi138.stderr: -490> 2024-09-14T11:37:33.679+0000 7fd44de0b640 10 monclient: dump: 2024-09-14T11:37:34.286 INFO:tasks.workunit.client.0.smithi138.stderr:epoch 1 2024-09-14T11:37:34.286 INFO:tasks.workunit.client.0.smithi138.stderr:fsid 3f225f43-83a6-4aeb-b798-1f04bb49d597 2024-09-14T11:37:34.286 INFO:tasks.workunit.client.0.smithi138.stderr:last_changed 2024-09-14T11:07:09.252780+0000 2024-09-14T11:37:34.286 INFO:tasks.workunit.client.0.smithi138.stderr:created 2024-09-14T11:07:09.252780+0000 2024-09-14T11:37:34.286 INFO:tasks.workunit.client.0.smithi138.stderr:min_mon_release 19 (squid) 2024-09-14T11:37:34.287 INFO:tasks.workunit.client.0.smithi138.stderr:election_strategy: 1 2024-09-14T11:37:34.287 INFO:tasks.workunit.client.0.smithi138.stderr:0: [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] mon.a 2024-09-14T11:37:34.287 INFO:tasks.workunit.client.0.smithi138.stderr:1: [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] mon.b 2024-09-14T11:37:34.287 INFO:tasks.workunit.client.0.smithi138.stderr:2: [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] mon.c 2024-09-14T11:37:34.287 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-14T11:37:34.287 INFO:tasks.workunit.client.0.smithi138.stderr: -489> 2024-09-14T11:37:33.679+0000 7fd44de0b640 10 monclient: _finish_auth 0 2024-09-14T11:37:34.287 INFO:tasks.workunit.client.0.smithi138.stderr: -488> 2024-09-14T11:37:33.679+0000 7fd44de0b640 10 monclient: _check_auth_tickets 2024-09-14T11:37:34.287 INFO:tasks.workunit.client.0.smithi138.stderr: -487> 2024-09-14T11:37:33.679+0000 7fd44de0b640 10 monclient: handle_config config(0 keys) 2024-09-14T11:37:34.287 INFO:tasks.workunit.client.0.smithi138.stderr: -486> 2024-09-14T11:37:33.679+0000 7fd561ddd9c0 5 monclient: authenticate success, global_id 7428 2024-09-14T11:37:34.287 INFO:tasks.workunit.client.0.smithi138.stderr: -485> 2024-09-14T11:37:33.679+0000 7fd561ddd9c0 10 monclient: get_monmap_and_config success 2024-09-14T11:37:34.287 INFO:tasks.workunit.client.0.smithi138.stderr: -484> 2024-09-14T11:37:33.679+0000 7fd561ddd9c0 4 set_mon_vals no callback set 2024-09-14T11:37:34.287 INFO:tasks.workunit.client.0.smithi138.stderr: -483> 2024-09-14T11:37:33.679+0000 7fd44de0b640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:37:34.287 INFO:tasks.workunit.client.0.smithi138.stderr: -482> 2024-09-14T11:37:33.679+0000 7fd44de0b640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-14T11:37:34.287 INFO:tasks.workunit.client.0.smithi138.stderr: -481> 2024-09-14T11:37:33.679+0000 7fd44de0b640 10 monclient: dump: 2024-09-14T11:37:34.288 INFO:tasks.workunit.client.0.smithi138.stderr:epoch 1 2024-09-14T11:37:34.288 INFO:tasks.workunit.client.0.smithi138.stderr:fsid 3f225f43-83a6-4aeb-b798-1f04bb49d597 2024-09-14T11:37:34.288 INFO:tasks.workunit.client.0.smithi138.stderr:last_changed 2024-09-14T11:07:09.252780+0000 2024-09-14T11:37:34.288 INFO:tasks.workunit.client.0.smithi138.stderr:created 2024-09-14T11:07:09.252780+0000 2024-09-14T11:37:34.288 INFO:tasks.workunit.client.0.smithi138.stderr:min_mon_release 19 (squid) 2024-09-14T11:37:34.288 INFO:tasks.workunit.client.0.smithi138.stderr:election_strategy: 1 2024-09-14T11:37:34.288 INFO:tasks.workunit.client.0.smithi138.stderr:0: [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] mon.a 2024-09-14T11:37:34.288 INFO:tasks.workunit.client.0.smithi138.stderr:1: [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] mon.b 2024-09-14T11:37:34.288 INFO:tasks.workunit.client.0.smithi138.stderr:2: [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] mon.c 2024-09-14T11:37:34.288 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-14T11:37:34.288 INFO:tasks.workunit.client.0.smithi138.stderr: -480> 2024-09-14T11:37:33.679+0000 7fd561ddd9c0 10 monclient: shutdown 2024-09-14T11:37:34.288 INFO:tasks.workunit.client.0.smithi138.stderr: -479> 2024-09-14T11:37:33.679+0000 7fd561ddd9c0 5 asok(0x55ff39895d90) unregister_commands rotate-key 2024-09-14T11:37:34.288 INFO:tasks.workunit.client.0.smithi138.stderr: -478> 2024-09-14T11:37:33.679+0000 7fd561ddd9c0 10 monclient: build_initial_monmap 2024-09-14T11:37:34.288 INFO:tasks.workunit.client.0.smithi138.stderr: -477> 2024-09-14T11:37:33.679+0000 7fd561ddd9c0 1 build_initial for_mkfs: 0 2024-09-14T11:37:34.288 INFO:tasks.workunit.client.0.smithi138.stderr: -476> 2024-09-14T11:37:33.679+0000 7fd561ddd9c0 10 monclient: monmap: 2024-09-14T11:37:34.289 INFO:tasks.workunit.client.0.smithi138.stderr:epoch 0 2024-09-14T11:37:34.289 INFO:tasks.workunit.client.0.smithi138.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-14T11:37:34.289 INFO:tasks.workunit.client.0.smithi138.stderr:last_changed 0.000000 2024-09-14T11:37:34.289 INFO:tasks.workunit.client.0.smithi138.stderr:created 0.000000 2024-09-14T11:37:34.289 INFO:tasks.workunit.client.0.smithi138.stderr:min_mon_release 0 (unknown) 2024-09-14T11:37:34.289 INFO:tasks.workunit.client.0.smithi138.stderr:election_strategy: 1 2024-09-14T11:37:34.289 INFO:tasks.workunit.client.0.smithi138.stderr:0: [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] mon.noname-a 2024-09-14T11:37:34.289 INFO:tasks.workunit.client.0.smithi138.stderr:1: [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] mon.noname-b 2024-09-14T11:37:34.289 INFO:tasks.workunit.client.0.smithi138.stderr:2: [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] mon.noname-c 2024-09-14T11:37:34.289 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-14T11:37:34.289 INFO:tasks.workunit.client.0.smithi138.stderr: -475> 2024-09-14T11:37:33.679+0000 7fd561ddd9c0 5 AuthRegistry(0x55ff39aa91b0) adding auth protocol: cephx 2024-09-14T11:37:34.289 INFO:tasks.workunit.client.0.smithi138.stderr: -474> 2024-09-14T11:37:33.679+0000 7fd561ddd9c0 5 AuthRegistry(0x55ff39aa91b0) adding auth protocol: cephx 2024-09-14T11:37:34.289 INFO:tasks.workunit.client.0.smithi138.stderr: -473> 2024-09-14T11:37:33.679+0000 7fd561ddd9c0 5 AuthRegistry(0x55ff39aa91b0) adding auth protocol: cephx 2024-09-14T11:37:34.289 INFO:tasks.workunit.client.0.smithi138.stderr: -472> 2024-09-14T11:37:33.679+0000 7fd561ddd9c0 5 AuthRegistry(0x55ff39aa91b0) adding con mode: secure 2024-09-14T11:37:34.289 INFO:tasks.workunit.client.0.smithi138.stderr: -471> 2024-09-14T11:37:33.679+0000 7fd561ddd9c0 5 AuthRegistry(0x55ff39aa91b0) adding con mode: crc 2024-09-14T11:37:34.290 INFO:tasks.workunit.client.0.smithi138.stderr: -470> 2024-09-14T11:37:33.679+0000 7fd561ddd9c0 5 AuthRegistry(0x55ff39aa91b0) adding con mode: secure 2024-09-14T11:37:34.290 INFO:tasks.workunit.client.0.smithi138.stderr: -469> 2024-09-14T11:37:33.679+0000 7fd561ddd9c0 5 AuthRegistry(0x55ff39aa91b0) adding con mode: crc 2024-09-14T11:37:34.290 INFO:tasks.workunit.client.0.smithi138.stderr: -468> 2024-09-14T11:37:33.679+0000 7fd561ddd9c0 5 AuthRegistry(0x55ff39aa91b0) adding con mode: secure 2024-09-14T11:37:34.290 INFO:tasks.workunit.client.0.smithi138.stderr: -467> 2024-09-14T11:37:33.679+0000 7fd561ddd9c0 5 AuthRegistry(0x55ff39aa91b0) adding con mode: crc 2024-09-14T11:37:34.290 INFO:tasks.workunit.client.0.smithi138.stderr: -466> 2024-09-14T11:37:33.679+0000 7fd561ddd9c0 5 AuthRegistry(0x55ff39aa91b0) adding con mode: crc 2024-09-14T11:37:34.290 INFO:tasks.workunit.client.0.smithi138.stderr: -465> 2024-09-14T11:37:33.679+0000 7fd561ddd9c0 5 AuthRegistry(0x55ff39aa91b0) adding con mode: secure 2024-09-14T11:37:34.290 INFO:tasks.workunit.client.0.smithi138.stderr: -464> 2024-09-14T11:37:33.679+0000 7fd561ddd9c0 5 AuthRegistry(0x55ff39aa91b0) adding con mode: crc 2024-09-14T11:37:34.290 INFO:tasks.workunit.client.0.smithi138.stderr: -463> 2024-09-14T11:37:33.679+0000 7fd561ddd9c0 5 AuthRegistry(0x55ff39aa91b0) adding con mode: secure 2024-09-14T11:37:34.290 INFO:tasks.workunit.client.0.smithi138.stderr: -462> 2024-09-14T11:37:33.679+0000 7fd561ddd9c0 5 AuthRegistry(0x55ff39aa91b0) adding con mode: crc 2024-09-14T11:37:34.290 INFO:tasks.workunit.client.0.smithi138.stderr: -461> 2024-09-14T11:37:33.679+0000 7fd561ddd9c0 5 AuthRegistry(0x55ff39aa91b0) adding con mode: secure 2024-09-14T11:37:34.290 INFO:tasks.workunit.client.0.smithi138.stderr: -460> 2024-09-14T11:37:33.683+0000 7fd561ddd9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:37:34.290 INFO:tasks.workunit.client.0.smithi138.stderr: -459> 2024-09-14T11:37:33.683+0000 7fd561ddd9c0 1 librados: starting msgr at 2024-09-14T11:37:34.290 INFO:tasks.workunit.client.0.smithi138.stderr: -458> 2024-09-14T11:37:33.683+0000 7fd561ddd9c0 1 librados: starting objecter 2024-09-14T11:37:34.290 INFO:tasks.workunit.client.0.smithi138.stderr: -457> 2024-09-14T11:37:33.683+0000 7fd561ddd9c0 5 asok(0x55ff39895d90) register_command objecter_requests hook 0x55ff39ad4260 2024-09-14T11:37:34.291 INFO:tasks.workunit.client.0.smithi138.stderr: -456> 2024-09-14T11:37:33.683+0000 7fd561ddd9c0 1 librados: setting wanted keys 2024-09-14T11:37:34.291 INFO:tasks.workunit.client.0.smithi138.stderr: -455> 2024-09-14T11:37:33.683+0000 7fd561ddd9c0 1 librados: calling monclient init 2024-09-14T11:37:34.291 INFO:tasks.workunit.client.0.smithi138.stderr: -454> 2024-09-14T11:37:33.683+0000 7fd561ddd9c0 10 monclient: init 2024-09-14T11:37:34.291 INFO:tasks.workunit.client.0.smithi138.stderr: -453> 2024-09-14T11:37:33.683+0000 7fd561ddd9c0 5 AuthRegistry(0x55ff39aa2fd0) adding auth protocol: cephx 2024-09-14T11:37:34.291 INFO:tasks.workunit.client.0.smithi138.stderr: -452> 2024-09-14T11:37:33.683+0000 7fd561ddd9c0 5 AuthRegistry(0x55ff39aa2fd0) adding auth protocol: cephx 2024-09-14T11:37:34.291 INFO:tasks.workunit.client.0.smithi138.stderr: -451> 2024-09-14T11:37:33.683+0000 7fd561ddd9c0 5 AuthRegistry(0x55ff39aa2fd0) adding auth protocol: cephx 2024-09-14T11:37:34.291 INFO:tasks.workunit.client.0.smithi138.stderr: -450> 2024-09-14T11:37:33.683+0000 7fd561ddd9c0 5 AuthRegistry(0x55ff39aa2fd0) adding con mode: secure 2024-09-14T11:37:34.291 INFO:tasks.workunit.client.0.smithi138.stderr: -449> 2024-09-14T11:37:33.683+0000 7fd561ddd9c0 5 AuthRegistry(0x55ff39aa2fd0) adding con mode: crc 2024-09-14T11:37:34.291 INFO:tasks.workunit.client.0.smithi138.stderr: -448> 2024-09-14T11:37:33.683+0000 7fd561ddd9c0 5 AuthRegistry(0x55ff39aa2fd0) adding con mode: secure 2024-09-14T11:37:34.291 INFO:tasks.workunit.client.0.smithi138.stderr: -447> 2024-09-14T11:37:33.683+0000 7fd561ddd9c0 5 AuthRegistry(0x55ff39aa2fd0) adding con mode: crc 2024-09-14T11:37:34.291 INFO:tasks.workunit.client.0.smithi138.stderr: -446> 2024-09-14T11:37:33.683+0000 7fd561ddd9c0 5 AuthRegistry(0x55ff39aa2fd0) adding con mode: secure 2024-09-14T11:37:34.291 INFO:tasks.workunit.client.0.smithi138.stderr: -445> 2024-09-14T11:37:33.683+0000 7fd561ddd9c0 5 AuthRegistry(0x55ff39aa2fd0) adding con mode: crc 2024-09-14T11:37:34.291 INFO:tasks.workunit.client.0.smithi138.stderr: -444> 2024-09-14T11:37:33.683+0000 7fd561ddd9c0 5 AuthRegistry(0x55ff39aa2fd0) adding con mode: crc 2024-09-14T11:37:34.291 INFO:tasks.workunit.client.0.smithi138.stderr: -443> 2024-09-14T11:37:33.683+0000 7fd561ddd9c0 5 AuthRegistry(0x55ff39aa2fd0) adding con mode: secure 2024-09-14T11:37:34.291 INFO:tasks.workunit.client.0.smithi138.stderr: -442> 2024-09-14T11:37:33.683+0000 7fd561ddd9c0 5 AuthRegistry(0x55ff39aa2fd0) adding con mode: crc 2024-09-14T11:37:34.291 INFO:tasks.workunit.client.0.smithi138.stderr: -441> 2024-09-14T11:37:33.683+0000 7fd561ddd9c0 5 AuthRegistry(0x55ff39aa2fd0) adding con mode: secure 2024-09-14T11:37:34.292 INFO:tasks.workunit.client.0.smithi138.stderr: -440> 2024-09-14T11:37:33.683+0000 7fd561ddd9c0 5 AuthRegistry(0x55ff39aa2fd0) adding con mode: crc 2024-09-14T11:37:34.292 INFO:tasks.workunit.client.0.smithi138.stderr: -439> 2024-09-14T11:37:33.683+0000 7fd561ddd9c0 5 AuthRegistry(0x55ff39aa2fd0) adding con mode: secure 2024-09-14T11:37:34.292 INFO:tasks.workunit.client.0.smithi138.stderr: -438> 2024-09-14T11:37:33.683+0000 7fd561ddd9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:37:34.292 INFO:tasks.workunit.client.0.smithi138.stderr: -437> 2024-09-14T11:37:33.683+0000 7fd561ddd9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:37:34.292 INFO:tasks.workunit.client.0.smithi138.stderr: -436> 2024-09-14T11:37:33.683+0000 7fd561ddd9c0 5 asok(0x55ff39895d90) register_command rotate-key hook 0x55ff39aa3118 2024-09-14T11:37:34.292 INFO:tasks.workunit.client.0.smithi138.stderr: -435> 2024-09-14T11:37:33.683+0000 7fd561ddd9c0 10 monclient: _reopen_session rank -1 2024-09-14T11:37:34.292 INFO:tasks.workunit.client.0.smithi138.stderr: -434> 2024-09-14T11:37:33.683+0000 7fd561ddd9c0 10 monclient: _add_conns ranks=[1,2,0] 2024-09-14T11:37:34.292 INFO:tasks.workunit.client.0.smithi138.stderr: -433> 2024-09-14T11:37:33.683+0000 7fd561ddd9c0 10 monclient(hunting): picked mon.noname-b con 0x55ff3995e880 addr [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] 2024-09-14T11:37:34.292 INFO:tasks.workunit.client.0.smithi138.stderr: -432> 2024-09-14T11:37:33.683+0000 7fd561ddd9c0 10 monclient(hunting): picked mon.noname-c con 0x55ff3995f6e0 addr [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] 2024-09-14T11:37:34.292 INFO:tasks.workunit.client.0.smithi138.stderr: -431> 2024-09-14T11:37:33.683+0000 7fd561ddd9c0 10 monclient(hunting): picked mon.noname-a con 0x55ff399e9290 addr [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] 2024-09-14T11:37:34.292 INFO:tasks.workunit.client.0.smithi138.stderr: -430> 2024-09-14T11:37:33.683+0000 7fd561ddd9c0 10 monclient(hunting): start opening mon connection 2024-09-14T11:37:34.292 INFO:tasks.workunit.client.0.smithi138.stderr: -429> 2024-09-14T11:37:33.683+0000 7fd561ddd9c0 10 monclient(hunting): start opening mon connection 2024-09-14T11:37:34.292 INFO:tasks.workunit.client.0.smithi138.stderr: -428> 2024-09-14T11:37:33.683+0000 7fd561ddd9c0 10 monclient(hunting): start opening mon connection 2024-09-14T11:37:34.292 INFO:tasks.workunit.client.0.smithi138.stderr: -427> 2024-09-14T11:37:33.683+0000 7fd561ddd9c0 10 monclient(hunting): _renew_subs 2024-09-14T11:37:34.292 INFO:tasks.workunit.client.0.smithi138.stderr: -426> 2024-09-14T11:37:33.683+0000 7fd561ddd9c0 10 monclient(hunting): authenticate will time out at 2789.644998s 2024-09-14T11:37:34.293 INFO:tasks.workunit.client.0.smithi138.stderr: -425> 2024-09-14T11:37:33.683+0000 7fd55f0e2640 10 monclient(hunting): get_auth_request con 0x55ff3995f6e0 auth_method 0 2024-09-14T11:37:34.293 INFO:tasks.workunit.client.0.smithi138.stderr: -424> 2024-09-14T11:37:33.683+0000 7fd55f0e2640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:37:34.293 INFO:tasks.workunit.client.0.smithi138.stderr: -423> 2024-09-14T11:37:33.683+0000 7fd55f0e2640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:37:34.293 INFO:tasks.workunit.client.0.smithi138.stderr: -422> 2024-09-14T11:37:33.683+0000 7fd55f0e2640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:37:34.293 INFO:tasks.workunit.client.0.smithi138.stderr: -421> 2024-09-14T11:37:33.683+0000 7fd5600e4640 10 monclient(hunting): get_auth_request con 0x55ff399e9290 auth_method 0 2024-09-14T11:37:34.293 INFO:tasks.workunit.client.0.smithi138.stderr: -420> 2024-09-14T11:37:33.683+0000 7fd5600e4640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:37:34.293 INFO:tasks.workunit.client.0.smithi138.stderr: -419> 2024-09-14T11:37:33.683+0000 7fd5600e4640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:37:34.293 INFO:tasks.workunit.client.0.smithi138.stderr: -418> 2024-09-14T11:37:33.683+0000 7fd5600e4640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:37:34.293 INFO:tasks.workunit.client.0.smithi138.stderr: -417> 2024-09-14T11:37:33.683+0000 7fd55f0e2640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:37:34.293 INFO:tasks.workunit.client.0.smithi138.stderr: -416> 2024-09-14T11:37:33.683+0000 7fd55f0e2640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:37:34.293 INFO:tasks.workunit.client.0.smithi138.stderr: -415> 2024-09-14T11:37:33.683+0000 7fd55f0e2640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:37:34.293 INFO:tasks.workunit.client.0.smithi138.stderr: -414> 2024-09-14T11:37:33.683+0000 7fd5600e4640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:37:34.293 INFO:tasks.workunit.client.0.smithi138.stderr: -413> 2024-09-14T11:37:33.683+0000 7fd5600e4640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:37:34.293 INFO:tasks.workunit.client.0.smithi138.stderr: -412> 2024-09-14T11:37:33.683+0000 7fd5600e4640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:37:34.293 INFO:tasks.workunit.client.0.smithi138.stderr: -411> 2024-09-14T11:37:33.683+0000 7fd55f0e2640 10 monclient(hunting): handle_auth_done global_id 6953 payload 824 2024-09-14T11:37:34.294 INFO:tasks.workunit.client.0.smithi138.stderr: -410> 2024-09-14T11:37:33.683+0000 7fd55f0e2640 10 monclient: _finish_hunting 0 2024-09-14T11:37:34.294 INFO:tasks.workunit.client.0.smithi138.stderr: -409> 2024-09-14T11:37:33.683+0000 7fd55f0e2640 1 monclient: found mon.noname-c 2024-09-14T11:37:34.294 INFO:tasks.workunit.client.0.smithi138.stderr: -408> 2024-09-14T11:37:33.683+0000 7fd55f0e2640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.138:3301/0 2024-09-14T11:37:34.294 INFO:tasks.workunit.client.0.smithi138.stderr: -407> 2024-09-14T11:37:33.683+0000 7fd55f8e3640 10 monclient: get_auth_request con 0x55ff3995e880 auth_method 0 2024-09-14T11:37:34.294 INFO:tasks.workunit.client.0.smithi138.stderr: -406> 2024-09-14T11:37:33.683+0000 7fd447fff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:37:34.294 INFO:tasks.workunit.client.0.smithi138.stderr: -405> 2024-09-14T11:37:33.683+0000 7fd447fff640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-14T11:37:34.294 INFO:tasks.workunit.client.0.smithi138.stderr: -404> 2024-09-14T11:37:33.683+0000 7fd447fff640 10 monclient: dump: 2024-09-14T11:37:34.294 INFO:tasks.workunit.client.0.smithi138.stderr:epoch 1 2024-09-14T11:37:34.294 INFO:tasks.workunit.client.0.smithi138.stderr:fsid 3f225f43-83a6-4aeb-b798-1f04bb49d597 2024-09-14T11:37:34.294 INFO:tasks.workunit.client.0.smithi138.stderr:last_changed 2024-09-14T11:07:09.252780+0000 2024-09-14T11:37:34.294 INFO:tasks.workunit.client.0.smithi138.stderr:created 2024-09-14T11:07:09.252780+0000 2024-09-14T11:37:34.294 INFO:tasks.workunit.client.0.smithi138.stderr:min_mon_release 19 (squid) 2024-09-14T11:37:34.294 INFO:tasks.workunit.client.0.smithi138.stderr:election_strategy: 1 2024-09-14T11:37:34.294 INFO:tasks.workunit.client.0.smithi138.stderr:0: [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] mon.a 2024-09-14T11:37:34.294 INFO:tasks.workunit.client.0.smithi138.stderr:1: [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] mon.b 2024-09-14T11:37:34.294 INFO:tasks.workunit.client.0.smithi138.stderr:2: [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] mon.c 2024-09-14T11:37:34.295 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-14T11:37:34.295 INFO:tasks.workunit.client.0.smithi138.stderr: -403> 2024-09-14T11:37:33.683+0000 7fd447fff640 10 monclient: _finish_auth 0 2024-09-14T11:37:34.295 INFO:tasks.workunit.client.0.smithi138.stderr: -402> 2024-09-14T11:37:33.683+0000 7fd447fff640 10 monclient: _check_auth_tickets 2024-09-14T11:37:34.295 INFO:tasks.workunit.client.0.smithi138.stderr: -401> 2024-09-14T11:37:33.683+0000 7fd447fff640 10 monclient: handle_config config(0 keys) 2024-09-14T11:37:34.295 INFO:tasks.workunit.client.0.smithi138.stderr: -400> 2024-09-14T11:37:33.683+0000 7fd447fff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:37:34.295 INFO:tasks.workunit.client.0.smithi138.stderr: -399> 2024-09-14T11:37:33.683+0000 7fd447fff640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-14T11:37:34.295 INFO:tasks.workunit.client.0.smithi138.stderr: -398> 2024-09-14T11:37:33.683+0000 7fd447fff640 10 monclient: dump: 2024-09-14T11:37:34.295 INFO:tasks.workunit.client.0.smithi138.stderr:epoch 1 2024-09-14T11:37:34.295 INFO:tasks.workunit.client.0.smithi138.stderr:fsid 3f225f43-83a6-4aeb-b798-1f04bb49d597 2024-09-14T11:37:34.295 INFO:tasks.workunit.client.0.smithi138.stderr:last_changed 2024-09-14T11:07:09.252780+0000 2024-09-14T11:37:34.295 INFO:tasks.workunit.client.0.smithi138.stderr:created 2024-09-14T11:07:09.252780+0000 2024-09-14T11:37:34.295 INFO:tasks.workunit.client.0.smithi138.stderr:min_mon_release 19 (squid) 2024-09-14T11:37:34.295 INFO:tasks.workunit.client.0.smithi138.stderr:election_strategy: 1 2024-09-14T11:37:34.295 INFO:tasks.workunit.client.0.smithi138.stderr:0: [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] mon.a 2024-09-14T11:37:34.296 INFO:tasks.workunit.client.0.smithi138.stderr:1: [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] mon.b 2024-09-14T11:37:34.296 INFO:tasks.workunit.client.0.smithi138.stderr:2: [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] mon.c 2024-09-14T11:37:34.296 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-14T11:37:34.296 INFO:tasks.workunit.client.0.smithi138.stderr: -397> 2024-09-14T11:37:33.683+0000 7fd561ddd9c0 5 monclient: authenticate success, global_id 6953 2024-09-14T11:37:34.296 INFO:tasks.workunit.client.0.smithi138.stderr: -396> 2024-09-14T11:37:33.683+0000 7fd561ddd9c0 10 monclient: _renew_subs 2024-09-14T11:37:34.296 INFO:tasks.workunit.client.0.smithi138.stderr: -395> 2024-09-14T11:37:33.683+0000 7fd561ddd9c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.138:3301/0 2024-09-14T11:37:34.296 INFO:tasks.workunit.client.0.smithi138.stderr: -394> 2024-09-14T11:37:33.683+0000 7fd44de0b640 4 set_mon_vals no callback set 2024-09-14T11:37:34.296 INFO:tasks.workunit.client.0.smithi138.stderr: -393> 2024-09-14T11:37:33.683+0000 7fd561ddd9c0 10 monclient: _renew_subs 2024-09-14T11:37:34.296 INFO:tasks.workunit.client.0.smithi138.stderr: -392> 2024-09-14T11:37:33.683+0000 7fd561ddd9c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.138:3301/0 2024-09-14T11:37:34.296 INFO:tasks.workunit.client.0.smithi138.stderr: -391> 2024-09-14T11:37:33.683+0000 7fd561ddd9c0 1 librados: init done 2024-09-14T11:37:34.296 INFO:tasks.workunit.client.0.smithi138.stderr: -390> 2024-09-14T11:37:33.683+0000 7fd447fff640 4 mgrc handle_mgr_map Got map version 5 2024-09-14T11:37:34.296 INFO:tasks.workunit.client.0.smithi138.stderr: -389> 2024-09-14T11:37:33.683+0000 7fd447fff640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.138:6832/3778043143,v1:172.21.15.138:6833/3778043143] 2024-09-14T11:37:34.296 INFO:tasks.workunit.client.0.smithi138.stderr: -388> 2024-09-14T11:37:33.683+0000 7fd447fff640 4 mgrc reconnect Starting new session with [v2:172.21.15.138:6832/3778043143,v1:172.21.15.138:6833/3778043143] 2024-09-14T11:37:34.296 INFO:tasks.workunit.client.0.smithi138.stderr: -387> 2024-09-14T11:37:33.687+0000 7fd55f8e3640 10 monclient: get_auth_request con 0x7fd4480718a0 auth_method 0 2024-09-14T11:37:34.297 INFO:tasks.workunit.client.0.smithi138.stderr: -386> 2024-09-14T11:37:33.687+0000 7fd5600e4640 10 monclient: get_auth_request con 0x55ff39ae2b60 auth_method 0 2024-09-14T11:37:34.297 INFO:tasks.workunit.client.0.smithi138.stderr: -385> 2024-09-14T11:37:33.687+0000 7fd55f8e3640 10 monclient: get_auth_request con 0x55ff39aedaf0 auth_method 0 2024-09-14T11:37:34.297 INFO:tasks.workunit.client.0.smithi138.stderr: -384> 2024-09-14T11:37:33.687+0000 7fd55f0e2640 10 monclient: get_auth_request con 0x55ff39af1e50 auth_method 0 2024-09-14T11:37:34.297 INFO:tasks.workunit.client.0.smithi138.stderr: -383> 2024-09-14T11:37:33.691+0000 7fd5600e4640 10 monclient: get_auth_request con 0x55ff39af13a0 auth_method 0 2024-09-14T11:37:34.297 INFO:tasks.workunit.client.0.smithi138.stderr: -382> 2024-09-14T11:37:33.691+0000 7fd561ddd9c0 10 monclient: build_initial_monmap 2024-09-14T11:37:34.297 INFO:tasks.workunit.client.0.smithi138.stderr: -381> 2024-09-14T11:37:33.691+0000 7fd561ddd9c0 1 build_initial for_mkfs: 0 2024-09-14T11:37:34.297 INFO:tasks.workunit.client.0.smithi138.stderr: -380> 2024-09-14T11:37:33.691+0000 7fd561ddd9c0 10 monclient: monmap: 2024-09-14T11:37:34.297 INFO:tasks.workunit.client.0.smithi138.stderr:epoch 0 2024-09-14T11:37:34.297 INFO:tasks.workunit.client.0.smithi138.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-14T11:37:34.297 INFO:tasks.workunit.client.0.smithi138.stderr:last_changed 0.000000 2024-09-14T11:37:34.297 INFO:tasks.workunit.client.0.smithi138.stderr:created 0.000000 2024-09-14T11:37:34.297 INFO:tasks.workunit.client.0.smithi138.stderr:min_mon_release 0 (unknown) 2024-09-14T11:37:34.297 INFO:tasks.workunit.client.0.smithi138.stderr:election_strategy: 1 2024-09-14T11:37:34.297 INFO:tasks.workunit.client.0.smithi138.stderr:0: [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] mon.noname-a 2024-09-14T11:37:34.297 INFO:tasks.workunit.client.0.smithi138.stderr:1: [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] mon.noname-b 2024-09-14T11:37:34.297 INFO:tasks.workunit.client.0.smithi138.stderr:2: [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] mon.noname-c 2024-09-14T11:37:34.298 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-14T11:37:34.298 INFO:tasks.workunit.client.0.smithi138.stderr: -379> 2024-09-14T11:37:33.691+0000 7fd561ddd9c0 5 AuthRegistry(0x55ff39af9f90) adding auth protocol: cephx 2024-09-14T11:37:34.298 INFO:tasks.workunit.client.0.smithi138.stderr: -378> 2024-09-14T11:37:33.691+0000 7fd561ddd9c0 5 AuthRegistry(0x55ff39af9f90) adding auth protocol: cephx 2024-09-14T11:37:34.298 INFO:tasks.workunit.client.0.smithi138.stderr: -377> 2024-09-14T11:37:33.691+0000 7fd561ddd9c0 5 AuthRegistry(0x55ff39af9f90) adding auth protocol: cephx 2024-09-14T11:37:34.298 INFO:tasks.workunit.client.0.smithi138.stderr: -376> 2024-09-14T11:37:33.691+0000 7fd561ddd9c0 5 AuthRegistry(0x55ff39af9f90) adding con mode: secure 2024-09-14T11:37:34.298 INFO:tasks.workunit.client.0.smithi138.stderr: -375> 2024-09-14T11:37:33.691+0000 7fd561ddd9c0 5 AuthRegistry(0x55ff39af9f90) adding con mode: crc 2024-09-14T11:37:34.298 INFO:tasks.workunit.client.0.smithi138.stderr: -374> 2024-09-14T11:37:33.691+0000 7fd561ddd9c0 5 AuthRegistry(0x55ff39af9f90) adding con mode: secure 2024-09-14T11:37:34.298 INFO:tasks.workunit.client.0.smithi138.stderr: -373> 2024-09-14T11:37:33.691+0000 7fd561ddd9c0 5 AuthRegistry(0x55ff39af9f90) adding con mode: crc 2024-09-14T11:37:34.298 INFO:tasks.workunit.client.0.smithi138.stderr: -372> 2024-09-14T11:37:33.691+0000 7fd561ddd9c0 5 AuthRegistry(0x55ff39af9f90) adding con mode: secure 2024-09-14T11:37:34.298 INFO:tasks.workunit.client.0.smithi138.stderr: -371> 2024-09-14T11:37:33.691+0000 7fd561ddd9c0 5 AuthRegistry(0x55ff39af9f90) adding con mode: crc 2024-09-14T11:37:34.298 INFO:tasks.workunit.client.0.smithi138.stderr: -370> 2024-09-14T11:37:33.691+0000 7fd561ddd9c0 5 AuthRegistry(0x55ff39af9f90) adding con mode: crc 2024-09-14T11:37:34.298 INFO:tasks.workunit.client.0.smithi138.stderr: -369> 2024-09-14T11:37:33.691+0000 7fd561ddd9c0 5 AuthRegistry(0x55ff39af9f90) adding con mode: secure 2024-09-14T11:37:34.298 INFO:tasks.workunit.client.0.smithi138.stderr: -368> 2024-09-14T11:37:33.691+0000 7fd561ddd9c0 5 AuthRegistry(0x55ff39af9f90) adding con mode: crc 2024-09-14T11:37:34.298 INFO:tasks.workunit.client.0.smithi138.stderr: -367> 2024-09-14T11:37:33.691+0000 7fd561ddd9c0 5 AuthRegistry(0x55ff39af9f90) adding con mode: secure 2024-09-14T11:37:34.298 INFO:tasks.workunit.client.0.smithi138.stderr: -366> 2024-09-14T11:37:33.691+0000 7fd561ddd9c0 5 AuthRegistry(0x55ff39af9f90) adding con mode: crc 2024-09-14T11:37:34.299 INFO:tasks.workunit.client.0.smithi138.stderr: -365> 2024-09-14T11:37:33.691+0000 7fd561ddd9c0 5 AuthRegistry(0x55ff39af9f90) adding con mode: secure 2024-09-14T11:37:34.299 INFO:tasks.workunit.client.0.smithi138.stderr: -364> 2024-09-14T11:37:33.691+0000 7fd561ddd9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:37:34.299 INFO:tasks.workunit.client.0.smithi138.stderr: -363> 2024-09-14T11:37:33.691+0000 7fd561ddd9c0 5 asok(0x55ff39895d90) register_command objecter_requests cmddesc objecter_requests hook 0x55ff39afd980 EEXIST 2024-09-14T11:37:34.299 INFO:tasks.workunit.client.0.smithi138.stderr: -362> 2024-09-14T11:37:33.691+0000 7fd561ddd9c0 10 monclient: init 2024-09-14T11:37:34.299 INFO:tasks.workunit.client.0.smithi138.stderr: -361> 2024-09-14T11:37:33.691+0000 7fd561ddd9c0 5 AuthRegistry(0x55ff39af8e88) adding auth protocol: cephx 2024-09-14T11:37:34.299 INFO:tasks.workunit.client.0.smithi138.stderr: -360> 2024-09-14T11:37:33.691+0000 7fd561ddd9c0 5 AuthRegistry(0x55ff39af8e88) adding auth protocol: cephx 2024-09-14T11:37:34.299 INFO:tasks.workunit.client.0.smithi138.stderr: -359> 2024-09-14T11:37:33.691+0000 7fd561ddd9c0 5 AuthRegistry(0x55ff39af8e88) adding auth protocol: cephx 2024-09-14T11:37:34.299 INFO:tasks.workunit.client.0.smithi138.stderr: -358> 2024-09-14T11:37:33.691+0000 7fd561ddd9c0 5 AuthRegistry(0x55ff39af8e88) adding con mode: secure 2024-09-14T11:37:34.299 INFO:tasks.workunit.client.0.smithi138.stderr: -357> 2024-09-14T11:37:33.691+0000 7fd561ddd9c0 5 AuthRegistry(0x55ff39af8e88) adding con mode: crc 2024-09-14T11:37:34.299 INFO:tasks.workunit.client.0.smithi138.stderr: -356> 2024-09-14T11:37:33.691+0000 7fd561ddd9c0 5 AuthRegistry(0x55ff39af8e88) adding con mode: secure 2024-09-14T11:37:34.299 INFO:tasks.workunit.client.0.smithi138.stderr: -355> 2024-09-14T11:37:33.691+0000 7fd561ddd9c0 5 AuthRegistry(0x55ff39af8e88) adding con mode: crc 2024-09-14T11:37:34.299 INFO:tasks.workunit.client.0.smithi138.stderr: -354> 2024-09-14T11:37:33.691+0000 7fd561ddd9c0 5 AuthRegistry(0x55ff39af8e88) adding con mode: secure 2024-09-14T11:37:34.299 INFO:tasks.workunit.client.0.smithi138.stderr: -353> 2024-09-14T11:37:33.691+0000 7fd561ddd9c0 5 AuthRegistry(0x55ff39af8e88) adding con mode: crc 2024-09-14T11:37:34.299 INFO:tasks.workunit.client.0.smithi138.stderr: -352> 2024-09-14T11:37:33.691+0000 7fd561ddd9c0 5 AuthRegistry(0x55ff39af8e88) adding con mode: crc 2024-09-14T11:37:34.299 INFO:tasks.workunit.client.0.smithi138.stderr: -351> 2024-09-14T11:37:33.691+0000 7fd561ddd9c0 5 AuthRegistry(0x55ff39af8e88) adding con mode: secure 2024-09-14T11:37:34.299 INFO:tasks.workunit.client.0.smithi138.stderr: -350> 2024-09-14T11:37:33.691+0000 7fd561ddd9c0 5 AuthRegistry(0x55ff39af8e88) adding con mode: crc 2024-09-14T11:37:34.300 INFO:tasks.workunit.client.0.smithi138.stderr: -349> 2024-09-14T11:37:33.691+0000 7fd561ddd9c0 5 AuthRegistry(0x55ff39af8e88) adding con mode: secure 2024-09-14T11:37:34.300 INFO:tasks.workunit.client.0.smithi138.stderr: -348> 2024-09-14T11:37:33.691+0000 7fd561ddd9c0 5 AuthRegistry(0x55ff39af8e88) adding con mode: crc 2024-09-14T11:37:34.300 INFO:tasks.workunit.client.0.smithi138.stderr: -347> 2024-09-14T11:37:33.691+0000 7fd561ddd9c0 5 AuthRegistry(0x55ff39af8e88) adding con mode: secure 2024-09-14T11:37:34.300 INFO:tasks.workunit.client.0.smithi138.stderr: -346> 2024-09-14T11:37:33.691+0000 7fd561ddd9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:37:34.300 INFO:tasks.workunit.client.0.smithi138.stderr: -345> 2024-09-14T11:37:33.691+0000 7fd561ddd9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:37:34.300 INFO:tasks.workunit.client.0.smithi138.stderr: -344> 2024-09-14T11:37:33.691+0000 7fd561ddd9c0 5 asok(0x55ff39895d90) register_command rotate-key cmddesc rotate-key hook 0x55ff39af8fd0 EEXIST 2024-09-14T11:37:34.300 INFO:tasks.workunit.client.0.smithi138.stderr: -343> 2024-09-14T11:37:33.691+0000 7fd561ddd9c0 10 monclient: _reopen_session rank -1 2024-09-14T11:37:34.300 INFO:tasks.workunit.client.0.smithi138.stderr: -342> 2024-09-14T11:37:33.691+0000 7fd561ddd9c0 10 monclient: _add_conns ranks=[1,2,0] 2024-09-14T11:37:34.300 INFO:tasks.workunit.client.0.smithi138.stderr: -341> 2024-09-14T11:37:33.691+0000 7fd561ddd9c0 10 monclient(hunting): picked mon.noname-b con 0x55ff39b21b30 addr [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] 2024-09-14T11:37:34.300 INFO:tasks.workunit.client.0.smithi138.stderr: -340> 2024-09-14T11:37:33.691+0000 7fd561ddd9c0 10 monclient(hunting): picked mon.noname-c con 0x55ff39b21460 addr [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] 2024-09-14T11:37:34.300 INFO:tasks.workunit.client.0.smithi138.stderr: -339> 2024-09-14T11:37:33.691+0000 7fd561ddd9c0 10 monclient(hunting): picked mon.noname-a con 0x55ff39b1fe40 addr [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] 2024-09-14T11:37:34.300 INFO:tasks.workunit.client.0.smithi138.stderr: -338> 2024-09-14T11:37:33.691+0000 7fd561ddd9c0 10 monclient(hunting): start opening mon connection 2024-09-14T11:37:34.300 INFO:tasks.workunit.client.0.smithi138.stderr: -337> 2024-09-14T11:37:33.691+0000 7fd561ddd9c0 10 monclient(hunting): start opening mon connection 2024-09-14T11:37:34.300 INFO:tasks.workunit.client.0.smithi138.stderr: -336> 2024-09-14T11:37:33.691+0000 7fd561ddd9c0 10 monclient(hunting): start opening mon connection 2024-09-14T11:37:34.300 INFO:tasks.workunit.client.0.smithi138.stderr: -335> 2024-09-14T11:37:33.691+0000 7fd561ddd9c0 10 monclient(hunting): _renew_subs 2024-09-14T11:37:34.301 INFO:tasks.workunit.client.0.smithi138.stderr: -334> 2024-09-14T11:37:33.691+0000 7fd561ddd9c0 10 monclient(hunting): authenticate will time out at 2789.655486s 2024-09-14T11:37:34.301 INFO:tasks.workunit.client.0.smithi138.stderr: -333> 2024-09-14T11:37:33.691+0000 7fd55f8e3640 10 monclient(hunting): get_auth_request con 0x55ff39b1fe40 auth_method 0 2024-09-14T11:37:34.301 INFO:tasks.workunit.client.0.smithi138.stderr: -332> 2024-09-14T11:37:33.691+0000 7fd55f8e3640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:37:34.301 INFO:tasks.workunit.client.0.smithi138.stderr: -331> 2024-09-14T11:37:33.691+0000 7fd55f8e3640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:37:34.301 INFO:tasks.workunit.client.0.smithi138.stderr: -330> 2024-09-14T11:37:33.691+0000 7fd55f8e3640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:37:34.301 INFO:tasks.workunit.client.0.smithi138.stderr: -329> 2024-09-14T11:37:33.691+0000 7fd5600e4640 10 monclient(hunting): get_auth_request con 0x55ff39b21460 auth_method 0 2024-09-14T11:37:34.301 INFO:tasks.workunit.client.0.smithi138.stderr: -328> 2024-09-14T11:37:33.691+0000 7fd5600e4640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:37:34.301 INFO:tasks.workunit.client.0.smithi138.stderr: -327> 2024-09-14T11:37:33.691+0000 7fd5600e4640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:37:34.301 INFO:tasks.workunit.client.0.smithi138.stderr: -326> 2024-09-14T11:37:33.691+0000 7fd5600e4640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:37:34.301 INFO:tasks.workunit.client.0.smithi138.stderr: -325> 2024-09-14T11:37:33.691+0000 7fd55f8e3640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:37:34.301 INFO:tasks.workunit.client.0.smithi138.stderr: -324> 2024-09-14T11:37:33.691+0000 7fd55f8e3640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:37:34.301 INFO:tasks.workunit.client.0.smithi138.stderr: -323> 2024-09-14T11:37:33.691+0000 7fd55f8e3640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:37:34.301 INFO:tasks.workunit.client.0.smithi138.stderr: -322> 2024-09-14T11:37:33.691+0000 7fd5600e4640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:37:34.301 INFO:tasks.workunit.client.0.smithi138.stderr: -321> 2024-09-14T11:37:33.691+0000 7fd5600e4640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:37:34.302 INFO:tasks.workunit.client.0.smithi138.stderr: -320> 2024-09-14T11:37:33.691+0000 7fd5600e4640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:37:34.302 INFO:tasks.workunit.client.0.smithi138.stderr: -319> 2024-09-14T11:37:33.691+0000 7fd55f0e2640 10 monclient(hunting): get_auth_request con 0x55ff39b21b30 auth_method 0 2024-09-14T11:37:34.302 INFO:tasks.workunit.client.0.smithi138.stderr: -318> 2024-09-14T11:37:33.691+0000 7fd55f0e2640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:37:34.302 INFO:tasks.workunit.client.0.smithi138.stderr: -317> 2024-09-14T11:37:33.691+0000 7fd55f0e2640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:37:34.302 INFO:tasks.workunit.client.0.smithi138.stderr: -316> 2024-09-14T11:37:33.691+0000 7fd55f0e2640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:37:34.302 INFO:tasks.workunit.client.0.smithi138.stderr: -315> 2024-09-14T11:37:33.691+0000 7fd55f8e3640 10 monclient(hunting): handle_auth_done global_id 7434 payload 824 2024-09-14T11:37:34.302 INFO:tasks.workunit.client.0.smithi138.stderr: -314> 2024-09-14T11:37:33.691+0000 7fd55f8e3640 10 monclient: _finish_hunting 0 2024-09-14T11:37:34.302 INFO:tasks.workunit.client.0.smithi138.stderr: -313> 2024-09-14T11:37:33.691+0000 7fd55f8e3640 1 monclient: found mon.noname-a 2024-09-14T11:37:34.302 INFO:tasks.workunit.client.0.smithi138.stderr: -312> 2024-09-14T11:37:33.691+0000 7fd55f8e3640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.138:3300/0 2024-09-14T11:37:34.302 INFO:tasks.workunit.client.0.smithi138.stderr: -311> 2024-09-14T11:37:33.695+0000 7fd4457fa640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:37:34.302 INFO:tasks.workunit.client.0.smithi138.stderr: -310> 2024-09-14T11:37:33.695+0000 7fd4457fa640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-14T11:37:34.302 INFO:tasks.workunit.client.0.smithi138.stderr: -309> 2024-09-14T11:37:33.695+0000 7fd4457fa640 10 monclient: dump: 2024-09-14T11:37:34.302 INFO:tasks.workunit.client.0.smithi138.stderr:epoch 1 2024-09-14T11:37:34.302 INFO:tasks.workunit.client.0.smithi138.stderr:fsid 3f225f43-83a6-4aeb-b798-1f04bb49d597 2024-09-14T11:37:34.302 INFO:tasks.workunit.client.0.smithi138.stderr:last_changed 2024-09-14T11:07:09.252780+0000 2024-09-14T11:37:34.302 INFO:tasks.workunit.client.0.smithi138.stderr:created 2024-09-14T11:07:09.252780+0000 2024-09-14T11:37:34.303 INFO:tasks.workunit.client.0.smithi138.stderr:min_mon_release 19 (squid) 2024-09-14T11:37:34.303 INFO:tasks.workunit.client.0.smithi138.stderr:election_strategy: 1 2024-09-14T11:37:34.303 INFO:tasks.workunit.client.0.smithi138.stderr:0: [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] mon.a 2024-09-14T11:37:34.303 INFO:tasks.workunit.client.0.smithi138.stderr:1: [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] mon.b 2024-09-14T11:37:34.303 INFO:tasks.workunit.client.0.smithi138.stderr:2: [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] mon.c 2024-09-14T11:37:34.303 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-14T11:37:34.303 INFO:tasks.workunit.client.0.smithi138.stderr: -308> 2024-09-14T11:37:33.695+0000 7fd4457fa640 10 monclient: _finish_auth 0 2024-09-14T11:37:34.303 INFO:tasks.workunit.client.0.smithi138.stderr: -307> 2024-09-14T11:37:33.695+0000 7fd4457fa640 10 monclient: _check_auth_tickets 2024-09-14T11:37:34.303 INFO:tasks.workunit.client.0.smithi138.stderr: -306> 2024-09-14T11:37:33.695+0000 7fd4457fa640 10 monclient: handle_config config(0 keys) 2024-09-14T11:37:34.303 INFO:tasks.workunit.client.0.smithi138.stderr: -305> 2024-09-14T11:37:33.695+0000 7fd4457fa640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:37:34.303 INFO:tasks.workunit.client.0.smithi138.stderr: -304> 2024-09-14T11:37:33.695+0000 7fd4457fa640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-14T11:37:34.303 INFO:tasks.workunit.client.0.smithi138.stderr: -303> 2024-09-14T11:37:33.695+0000 7fd4457fa640 10 monclient: dump: 2024-09-14T11:37:34.303 INFO:tasks.workunit.client.0.smithi138.stderr:epoch 1 2024-09-14T11:37:34.303 INFO:tasks.workunit.client.0.smithi138.stderr:fsid 3f225f43-83a6-4aeb-b798-1f04bb49d597 2024-09-14T11:37:34.303 INFO:tasks.workunit.client.0.smithi138.stderr:last_changed 2024-09-14T11:07:09.252780+0000 2024-09-14T11:37:34.303 INFO:tasks.workunit.client.0.smithi138.stderr:created 2024-09-14T11:07:09.252780+0000 2024-09-14T11:37:34.304 INFO:tasks.workunit.client.0.smithi138.stderr:min_mon_release 19 (squid) 2024-09-14T11:37:34.304 INFO:tasks.workunit.client.0.smithi138.stderr:election_strategy: 1 2024-09-14T11:37:34.304 INFO:tasks.workunit.client.0.smithi138.stderr:0: [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] mon.a 2024-09-14T11:37:34.304 INFO:tasks.workunit.client.0.smithi138.stderr:1: [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] mon.b 2024-09-14T11:37:34.304 INFO:tasks.workunit.client.0.smithi138.stderr:2: [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] mon.c 2024-09-14T11:37:34.304 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-14T11:37:34.304 INFO:tasks.workunit.client.0.smithi138.stderr: -302> 2024-09-14T11:37:33.695+0000 7fd5608e5640 4 set_mon_vals no callback set 2024-09-14T11:37:34.304 INFO:tasks.workunit.client.0.smithi138.stderr: -301> 2024-09-14T11:37:33.695+0000 7fd561ddd9c0 5 monclient: authenticate success, global_id 7434 2024-09-14T11:37:34.304 INFO:tasks.workunit.client.0.smithi138.stderr: -300> 2024-09-14T11:37:33.695+0000 7fd561ddd9c0 10 monclient: _renew_subs 2024-09-14T11:37:34.304 INFO:tasks.workunit.client.0.smithi138.stderr: -299> 2024-09-14T11:37:33.695+0000 7fd561ddd9c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.138:3300/0 2024-09-14T11:37:34.304 INFO:tasks.workunit.client.0.smithi138.stderr: -298> 2024-09-14T11:37:33.695+0000 7fd561ddd9c0 10 monclient: _renew_subs 2024-09-14T11:37:34.304 INFO:tasks.workunit.client.0.smithi138.stderr: -297> 2024-09-14T11:37:33.695+0000 7fd561ddd9c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.138:3300/0 2024-09-14T11:37:34.304 INFO:tasks.workunit.client.0.smithi138.stderr: -296> 2024-09-14T11:37:33.695+0000 7fd4457fa640 4 mgrc handle_mgr_map Got map version 5 2024-09-14T11:37:34.305 INFO:tasks.workunit.client.0.smithi138.stderr: -295> 2024-09-14T11:37:33.695+0000 7fd4457fa640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.138:6832/3778043143,v1:172.21.15.138:6833/3778043143] 2024-09-14T11:37:34.305 INFO:tasks.workunit.client.0.smithi138.stderr: -294> 2024-09-14T11:37:33.695+0000 7fd4457fa640 4 mgrc reconnect Starting new session with [v2:172.21.15.138:6832/3778043143,v1:172.21.15.138:6833/3778043143] 2024-09-14T11:37:34.305 INFO:tasks.workunit.client.0.smithi138.stderr: -293> 2024-09-14T11:37:33.695+0000 7fd55f0e2640 10 monclient: get_auth_request con 0x7fd4380717e0 auth_method 0 2024-09-14T11:37:34.305 INFO:tasks.workunit.client.0.smithi138.stderr: -292> 2024-09-14T11:37:33.695+0000 7fd561ddd9c0 10 monclient: get_monmap_and_config 2024-09-14T11:37:34.305 INFO:tasks.workunit.client.0.smithi138.stderr: -291> 2024-09-14T11:37:33.695+0000 7fd561ddd9c0 10 monclient: build_initial_monmap 2024-09-14T11:37:34.305 INFO:tasks.workunit.client.0.smithi138.stderr: -290> 2024-09-14T11:37:33.695+0000 7fd561ddd9c0 1 build_initial for_mkfs: 0 2024-09-14T11:37:34.305 INFO:tasks.workunit.client.0.smithi138.stderr: -289> 2024-09-14T11:37:33.695+0000 7fd561ddd9c0 10 monclient: monmap: 2024-09-14T11:37:34.305 INFO:tasks.workunit.client.0.smithi138.stderr:epoch 0 2024-09-14T11:37:34.305 INFO:tasks.workunit.client.0.smithi138.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-14T11:37:34.305 INFO:tasks.workunit.client.0.smithi138.stderr:last_changed 0.000000 2024-09-14T11:37:34.305 INFO:tasks.workunit.client.0.smithi138.stderr:created 0.000000 2024-09-14T11:37:34.305 INFO:tasks.workunit.client.0.smithi138.stderr:min_mon_release 0 (unknown) 2024-09-14T11:37:34.305 INFO:tasks.workunit.client.0.smithi138.stderr:election_strategy: 1 2024-09-14T11:37:34.305 INFO:tasks.workunit.client.0.smithi138.stderr:0: [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] mon.noname-a 2024-09-14T11:37:34.306 INFO:tasks.workunit.client.0.smithi138.stderr:1: [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] mon.noname-b 2024-09-14T11:37:34.306 INFO:tasks.workunit.client.0.smithi138.stderr:2: [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] mon.noname-c 2024-09-14T11:37:34.306 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-14T11:37:34.306 INFO:tasks.workunit.client.0.smithi138.stderr: -288> 2024-09-14T11:37:33.695+0000 7fd561ddd9c0 5 AuthRegistry(0x55ff39b412f0) adding auth protocol: cephx 2024-09-14T11:37:34.306 INFO:tasks.workunit.client.0.smithi138.stderr: -287> 2024-09-14T11:37:33.695+0000 7fd561ddd9c0 5 AuthRegistry(0x55ff39b412f0) adding auth protocol: cephx 2024-09-14T11:37:34.306 INFO:tasks.workunit.client.0.smithi138.stderr: -286> 2024-09-14T11:37:33.695+0000 7fd561ddd9c0 5 AuthRegistry(0x55ff39b412f0) adding auth protocol: cephx 2024-09-14T11:37:34.306 INFO:tasks.workunit.client.0.smithi138.stderr: -285> 2024-09-14T11:37:33.695+0000 7fd561ddd9c0 5 AuthRegistry(0x55ff39b412f0) adding con mode: secure 2024-09-14T11:37:34.306 INFO:tasks.workunit.client.0.smithi138.stderr: -284> 2024-09-14T11:37:33.695+0000 7fd561ddd9c0 5 AuthRegistry(0x55ff39b412f0) adding con mode: crc 2024-09-14T11:37:34.306 INFO:tasks.workunit.client.0.smithi138.stderr: -283> 2024-09-14T11:37:33.695+0000 7fd561ddd9c0 5 AuthRegistry(0x55ff39b412f0) adding con mode: secure 2024-09-14T11:37:34.306 INFO:tasks.workunit.client.0.smithi138.stderr: -282> 2024-09-14T11:37:33.695+0000 7fd561ddd9c0 5 AuthRegistry(0x55ff39b412f0) adding con mode: crc 2024-09-14T11:37:34.306 INFO:tasks.workunit.client.0.smithi138.stderr: -281> 2024-09-14T11:37:33.695+0000 7fd561ddd9c0 5 AuthRegistry(0x55ff39b412f0) adding con mode: secure 2024-09-14T11:37:34.306 INFO:tasks.workunit.client.0.smithi138.stderr: -280> 2024-09-14T11:37:33.695+0000 7fd561ddd9c0 5 AuthRegistry(0x55ff39b412f0) adding con mode: crc 2024-09-14T11:37:34.306 INFO:tasks.workunit.client.0.smithi138.stderr: -279> 2024-09-14T11:37:33.695+0000 7fd561ddd9c0 5 AuthRegistry(0x55ff39b412f0) adding con mode: crc 2024-09-14T11:37:34.306 INFO:tasks.workunit.client.0.smithi138.stderr: -278> 2024-09-14T11:37:33.695+0000 7fd561ddd9c0 5 AuthRegistry(0x55ff39b412f0) adding con mode: secure 2024-09-14T11:37:34.307 INFO:tasks.workunit.client.0.smithi138.stderr: -277> 2024-09-14T11:37:33.695+0000 7fd561ddd9c0 5 AuthRegistry(0x55ff39b412f0) adding con mode: crc 2024-09-14T11:37:34.307 INFO:tasks.workunit.client.0.smithi138.stderr: -276> 2024-09-14T11:37:33.695+0000 7fd561ddd9c0 5 AuthRegistry(0x55ff39b412f0) adding con mode: secure 2024-09-14T11:37:34.307 INFO:tasks.workunit.client.0.smithi138.stderr: -275> 2024-09-14T11:37:33.695+0000 7fd561ddd9c0 5 AuthRegistry(0x55ff39b412f0) adding con mode: crc 2024-09-14T11:37:34.307 INFO:tasks.workunit.client.0.smithi138.stderr: -274> 2024-09-14T11:37:33.695+0000 7fd561ddd9c0 5 AuthRegistry(0x55ff39b412f0) adding con mode: secure 2024-09-14T11:37:34.307 INFO:tasks.workunit.client.0.smithi138.stderr: -273> 2024-09-14T11:37:33.695+0000 7fd561ddd9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:37:34.307 INFO:tasks.workunit.client.0.smithi138.stderr: -272> 2024-09-14T11:37:33.695+0000 7fd561ddd9c0 10 monclient: init 2024-09-14T11:37:34.307 INFO:tasks.workunit.client.0.smithi138.stderr: -271> 2024-09-14T11:37:33.695+0000 7fd561ddd9c0 5 AuthRegistry(0x7fff90fa47e0) adding auth protocol: cephx 2024-09-14T11:37:34.307 INFO:tasks.workunit.client.0.smithi138.stderr: -270> 2024-09-14T11:37:33.695+0000 7fd561ddd9c0 5 AuthRegistry(0x7fff90fa47e0) adding auth protocol: cephx 2024-09-14T11:37:34.307 INFO:tasks.workunit.client.0.smithi138.stderr: -269> 2024-09-14T11:37:33.695+0000 7fd561ddd9c0 5 AuthRegistry(0x7fff90fa47e0) adding auth protocol: cephx 2024-09-14T11:37:34.307 INFO:tasks.workunit.client.0.smithi138.stderr: -268> 2024-09-14T11:37:33.695+0000 7fd561ddd9c0 5 AuthRegistry(0x7fff90fa47e0) adding con mode: secure 2024-09-14T11:37:34.307 INFO:tasks.workunit.client.0.smithi138.stderr: -267> 2024-09-14T11:37:33.695+0000 7fd561ddd9c0 5 AuthRegistry(0x7fff90fa47e0) adding con mode: crc 2024-09-14T11:37:34.307 INFO:tasks.workunit.client.0.smithi138.stderr: -266> 2024-09-14T11:37:33.695+0000 7fd561ddd9c0 5 AuthRegistry(0x7fff90fa47e0) adding con mode: secure 2024-09-14T11:37:34.307 INFO:tasks.workunit.client.0.smithi138.stderr: -265> 2024-09-14T11:37:33.695+0000 7fd561ddd9c0 5 AuthRegistry(0x7fff90fa47e0) adding con mode: crc 2024-09-14T11:37:34.307 INFO:tasks.workunit.client.0.smithi138.stderr: -264> 2024-09-14T11:37:33.695+0000 7fd561ddd9c0 5 AuthRegistry(0x7fff90fa47e0) adding con mode: secure 2024-09-14T11:37:34.307 INFO:tasks.workunit.client.0.smithi138.stderr: -263> 2024-09-14T11:37:33.695+0000 7fd561ddd9c0 5 AuthRegistry(0x7fff90fa47e0) adding con mode: crc 2024-09-14T11:37:34.307 INFO:tasks.workunit.client.0.smithi138.stderr: -262> 2024-09-14T11:37:33.695+0000 7fd561ddd9c0 5 AuthRegistry(0x7fff90fa47e0) adding con mode: crc 2024-09-14T11:37:34.308 INFO:tasks.workunit.client.0.smithi138.stderr: -261> 2024-09-14T11:37:33.695+0000 7fd561ddd9c0 5 AuthRegistry(0x7fff90fa47e0) adding con mode: secure 2024-09-14T11:37:34.308 INFO:tasks.workunit.client.0.smithi138.stderr: -260> 2024-09-14T11:37:33.695+0000 7fd561ddd9c0 5 AuthRegistry(0x7fff90fa47e0) adding con mode: crc 2024-09-14T11:37:34.308 INFO:tasks.workunit.client.0.smithi138.stderr: -259> 2024-09-14T11:37:33.695+0000 7fd561ddd9c0 5 AuthRegistry(0x7fff90fa47e0) adding con mode: secure 2024-09-14T11:37:34.308 INFO:tasks.workunit.client.0.smithi138.stderr: -258> 2024-09-14T11:37:33.695+0000 7fd561ddd9c0 5 AuthRegistry(0x7fff90fa47e0) adding con mode: crc 2024-09-14T11:37:34.308 INFO:tasks.workunit.client.0.smithi138.stderr: -257> 2024-09-14T11:37:33.695+0000 7fd561ddd9c0 5 AuthRegistry(0x7fff90fa47e0) adding con mode: secure 2024-09-14T11:37:34.308 INFO:tasks.workunit.client.0.smithi138.stderr: -256> 2024-09-14T11:37:33.695+0000 7fd561ddd9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:37:34.308 INFO:tasks.workunit.client.0.smithi138.stderr: -255> 2024-09-14T11:37:33.695+0000 7fd561ddd9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:37:34.308 INFO:tasks.workunit.client.0.smithi138.stderr: -254> 2024-09-14T11:37:33.695+0000 7fd561ddd9c0 5 asok(0x55ff39895d90) register_command rotate-key cmddesc rotate-key hook 0x7fff90fa4928 EEXIST 2024-09-14T11:37:34.308 INFO:tasks.workunit.client.0.smithi138.stderr: -253> 2024-09-14T11:37:33.695+0000 7fd561ddd9c0 10 monclient: _reopen_session rank -1 2024-09-14T11:37:34.308 INFO:tasks.workunit.client.0.smithi138.stderr: -252> 2024-09-14T11:37:33.695+0000 7fd561ddd9c0 10 monclient: _add_conns ranks=[0,1,2] 2024-09-14T11:37:34.308 INFO:tasks.workunit.client.0.smithi138.stderr: -251> 2024-09-14T11:37:33.695+0000 7fd561ddd9c0 10 monclient(hunting): picked mon.noname-a con 0x55ff39b757d0 addr [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] 2024-09-14T11:37:34.308 INFO:tasks.workunit.client.0.smithi138.stderr: -250> 2024-09-14T11:37:33.695+0000 7fd561ddd9c0 10 monclient(hunting): picked mon.noname-b con 0x55ff39b453a0 addr [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] 2024-09-14T11:37:34.308 INFO:tasks.workunit.client.0.smithi138.stderr: -249> 2024-09-14T11:37:33.695+0000 7fd561ddd9c0 10 monclient(hunting): picked mon.noname-c con 0x55ff39b422d0 addr [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] 2024-09-14T11:37:34.308 INFO:tasks.workunit.client.0.smithi138.stderr: -248> 2024-09-14T11:37:33.695+0000 7fd561ddd9c0 10 monclient(hunting): start opening mon connection 2024-09-14T11:37:34.308 INFO:tasks.workunit.client.0.smithi138.stderr: -247> 2024-09-14T11:37:33.695+0000 7fd561ddd9c0 10 monclient(hunting): start opening mon connection 2024-09-14T11:37:34.309 INFO:tasks.workunit.client.0.smithi138.stderr: -246> 2024-09-14T11:37:33.695+0000 7fd561ddd9c0 10 monclient(hunting): start opening mon connection 2024-09-14T11:37:34.309 INFO:tasks.workunit.client.0.smithi138.stderr: -245> 2024-09-14T11:37:33.695+0000 7fd561ddd9c0 10 monclient(hunting): _renew_subs 2024-09-14T11:37:34.309 INFO:tasks.workunit.client.0.smithi138.stderr: -244> 2024-09-14T11:37:33.695+0000 7fd561ddd9c0 10 monclient(hunting): authenticate will time out at 2789.659794s 2024-09-14T11:37:34.309 INFO:tasks.workunit.client.0.smithi138.stderr: -243> 2024-09-14T11:37:33.695+0000 7fd55f0e2640 10 monclient(hunting): get_auth_request con 0x55ff39b757d0 auth_method 0 2024-09-14T11:37:34.309 INFO:tasks.workunit.client.0.smithi138.stderr: -242> 2024-09-14T11:37:33.695+0000 7fd55f0e2640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:37:34.309 INFO:tasks.workunit.client.0.smithi138.stderr: -241> 2024-09-14T11:37:33.695+0000 7fd55f0e2640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:37:34.309 INFO:tasks.workunit.client.0.smithi138.stderr: -240> 2024-09-14T11:37:33.695+0000 7fd55f0e2640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:37:34.309 INFO:tasks.workunit.client.0.smithi138.stderr: -239> 2024-09-14T11:37:33.695+0000 7fd55f8e3640 10 monclient(hunting): get_auth_request con 0x55ff39b422d0 auth_method 0 2024-09-14T11:37:34.309 INFO:tasks.workunit.client.0.smithi138.stderr: -238> 2024-09-14T11:37:33.695+0000 7fd55f8e3640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:37:34.309 INFO:tasks.workunit.client.0.smithi138.stderr: -237> 2024-09-14T11:37:33.695+0000 7fd55f8e3640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:37:34.309 INFO:tasks.workunit.client.0.smithi138.stderr: -236> 2024-09-14T11:37:33.695+0000 7fd55f8e3640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:37:34.309 INFO:tasks.workunit.client.0.smithi138.stderr: -235> 2024-09-14T11:37:33.695+0000 7fd55f0e2640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:37:34.309 INFO:tasks.workunit.client.0.smithi138.stderr: -234> 2024-09-14T11:37:33.695+0000 7fd55f0e2640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:37:34.309 INFO:tasks.workunit.client.0.smithi138.stderr: -233> 2024-09-14T11:37:33.699+0000 7fd55f0e2640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:37:34.310 INFO:tasks.workunit.client.0.smithi138.stderr: -232> 2024-09-14T11:37:33.699+0000 7fd55f8e3640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:37:34.310 INFO:tasks.workunit.client.0.smithi138.stderr: -231> 2024-09-14T11:37:33.699+0000 7fd55f8e3640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:37:34.310 INFO:tasks.workunit.client.0.smithi138.stderr: -230> 2024-09-14T11:37:33.699+0000 7fd55f8e3640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:37:34.310 INFO:tasks.workunit.client.0.smithi138.stderr: -229> 2024-09-14T11:37:33.699+0000 7fd55f0e2640 10 monclient(hunting): handle_auth_done global_id 7437 payload 274 2024-09-14T11:37:34.310 INFO:tasks.workunit.client.0.smithi138.stderr: -228> 2024-09-14T11:37:33.699+0000 7fd55f0e2640 10 monclient: _finish_hunting 0 2024-09-14T11:37:34.310 INFO:tasks.workunit.client.0.smithi138.stderr: -227> 2024-09-14T11:37:33.699+0000 7fd55f0e2640 1 monclient: found mon.noname-a 2024-09-14T11:37:34.310 INFO:tasks.workunit.client.0.smithi138.stderr: -226> 2024-09-14T11:37:33.699+0000 7fd55f0e2640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.138:3300/0 2024-09-14T11:37:34.310 INFO:tasks.workunit.client.0.smithi138.stderr: -225> 2024-09-14T11:37:33.699+0000 7fd5600e4640 10 monclient: get_auth_request con 0x55ff39b453a0 auth_method 0 2024-09-14T11:37:34.310 INFO:tasks.workunit.client.0.smithi138.stderr: -224> 2024-09-14T11:37:33.699+0000 7fd43effd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:37:34.310 INFO:tasks.workunit.client.0.smithi138.stderr: -223> 2024-09-14T11:37:33.699+0000 7fd43effd640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-14T11:37:34.310 INFO:tasks.workunit.client.0.smithi138.stderr: -222> 2024-09-14T11:37:33.699+0000 7fd43effd640 10 monclient: dump: 2024-09-14T11:37:34.310 INFO:tasks.workunit.client.0.smithi138.stderr:epoch 1 2024-09-14T11:37:34.310 INFO:tasks.workunit.client.0.smithi138.stderr:fsid 3f225f43-83a6-4aeb-b798-1f04bb49d597 2024-09-14T11:37:34.310 INFO:tasks.workunit.client.0.smithi138.stderr:last_changed 2024-09-14T11:07:09.252780+0000 2024-09-14T11:37:34.310 INFO:tasks.workunit.client.0.smithi138.stderr:created 2024-09-14T11:07:09.252780+0000 2024-09-14T11:37:34.311 INFO:tasks.workunit.client.0.smithi138.stderr:min_mon_release 19 (squid) 2024-09-14T11:37:34.311 INFO:tasks.workunit.client.0.smithi138.stderr:election_strategy: 1 2024-09-14T11:37:34.311 INFO:tasks.workunit.client.0.smithi138.stderr:0: [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] mon.a 2024-09-14T11:37:34.311 INFO:tasks.workunit.client.0.smithi138.stderr:1: [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] mon.b 2024-09-14T11:37:34.311 INFO:tasks.workunit.client.0.smithi138.stderr:2: [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] mon.c 2024-09-14T11:37:34.311 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-14T11:37:34.311 INFO:tasks.workunit.client.0.smithi138.stderr: -221> 2024-09-14T11:37:33.699+0000 7fd43effd640 10 monclient: _finish_auth 0 2024-09-14T11:37:34.311 INFO:tasks.workunit.client.0.smithi138.stderr: -220> 2024-09-14T11:37:33.699+0000 7fd43effd640 10 monclient: _check_auth_tickets 2024-09-14T11:37:34.311 INFO:tasks.workunit.client.0.smithi138.stderr: -219> 2024-09-14T11:37:33.699+0000 7fd561ddd9c0 5 monclient: authenticate success, global_id 7437 2024-09-14T11:37:34.311 INFO:tasks.workunit.client.0.smithi138.stderr: -218> 2024-09-14T11:37:33.699+0000 7fd43effd640 10 monclient: handle_config config(0 keys) 2024-09-14T11:37:34.311 INFO:tasks.workunit.client.0.smithi138.stderr: -217> 2024-09-14T11:37:33.699+0000 7fd43effd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:37:34.311 INFO:tasks.workunit.client.0.smithi138.stderr: -216> 2024-09-14T11:37:33.699+0000 7fd43effd640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-14T11:37:34.311 INFO:tasks.workunit.client.0.smithi138.stderr: -215> 2024-09-14T11:37:33.699+0000 7fd43effd640 10 monclient: dump: 2024-09-14T11:37:34.311 INFO:tasks.workunit.client.0.smithi138.stderr:epoch 1 2024-09-14T11:37:34.311 INFO:tasks.workunit.client.0.smithi138.stderr:fsid 3f225f43-83a6-4aeb-b798-1f04bb49d597 2024-09-14T11:37:34.312 INFO:tasks.workunit.client.0.smithi138.stderr:last_changed 2024-09-14T11:07:09.252780+0000 2024-09-14T11:37:34.312 INFO:tasks.workunit.client.0.smithi138.stderr:created 2024-09-14T11:07:09.252780+0000 2024-09-14T11:37:34.312 INFO:tasks.workunit.client.0.smithi138.stderr:min_mon_release 19 (squid) 2024-09-14T11:37:34.312 INFO:tasks.workunit.client.0.smithi138.stderr:election_strategy: 1 2024-09-14T11:37:34.312 INFO:tasks.workunit.client.0.smithi138.stderr:0: [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] mon.a 2024-09-14T11:37:34.312 INFO:tasks.workunit.client.0.smithi138.stderr:1: [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] mon.b 2024-09-14T11:37:34.312 INFO:tasks.workunit.client.0.smithi138.stderr:2: [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] mon.c 2024-09-14T11:37:34.312 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-14T11:37:34.312 INFO:tasks.workunit.client.0.smithi138.stderr: -214> 2024-09-14T11:37:33.699+0000 7fd561ddd9c0 10 monclient: get_monmap_and_config success 2024-09-14T11:37:34.312 INFO:tasks.workunit.client.0.smithi138.stderr: -213> 2024-09-14T11:37:33.699+0000 7fd561ddd9c0 4 set_mon_vals no callback set 2024-09-14T11:37:34.312 INFO:tasks.workunit.client.0.smithi138.stderr: -212> 2024-09-14T11:37:33.699+0000 7fd561ddd9c0 10 monclient: shutdown 2024-09-14T11:37:34.312 INFO:tasks.workunit.client.0.smithi138.stderr: -211> 2024-09-14T11:37:33.699+0000 7fd561ddd9c0 10 monclient: build_initial_monmap 2024-09-14T11:37:34.312 INFO:tasks.workunit.client.0.smithi138.stderr: -210> 2024-09-14T11:37:33.699+0000 7fd561ddd9c0 1 build_initial for_mkfs: 0 2024-09-14T11:37:34.312 INFO:tasks.workunit.client.0.smithi138.stderr: -209> 2024-09-14T11:37:33.699+0000 7fd561ddd9c0 10 monclient: monmap: 2024-09-14T11:37:34.312 INFO:tasks.workunit.client.0.smithi138.stderr:epoch 0 2024-09-14T11:37:34.312 INFO:tasks.workunit.client.0.smithi138.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-14T11:37:34.313 INFO:tasks.workunit.client.0.smithi138.stderr:last_changed 0.000000 2024-09-14T11:37:34.313 INFO:tasks.workunit.client.0.smithi138.stderr:created 0.000000 2024-09-14T11:37:34.313 INFO:tasks.workunit.client.0.smithi138.stderr:min_mon_release 0 (unknown) 2024-09-14T11:37:34.313 INFO:tasks.workunit.client.0.smithi138.stderr:election_strategy: 1 2024-09-14T11:37:34.313 INFO:tasks.workunit.client.0.smithi138.stderr:0: [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] mon.noname-a 2024-09-14T11:37:34.313 INFO:tasks.workunit.client.0.smithi138.stderr:1: [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] mon.noname-b 2024-09-14T11:37:34.313 INFO:tasks.workunit.client.0.smithi138.stderr:2: [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] mon.noname-c 2024-09-14T11:37:34.313 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-14T11:37:34.313 INFO:tasks.workunit.client.0.smithi138.stderr: -208> 2024-09-14T11:37:33.699+0000 7fd561ddd9c0 5 AuthRegistry(0x55ff39b412a0) adding auth protocol: cephx 2024-09-14T11:37:34.313 INFO:tasks.workunit.client.0.smithi138.stderr: -207> 2024-09-14T11:37:33.699+0000 7fd561ddd9c0 5 AuthRegistry(0x55ff39b412a0) adding auth protocol: cephx 2024-09-14T11:37:34.313 INFO:tasks.workunit.client.0.smithi138.stderr: -206> 2024-09-14T11:37:33.699+0000 7fd561ddd9c0 5 AuthRegistry(0x55ff39b412a0) adding auth protocol: cephx 2024-09-14T11:37:34.313 INFO:tasks.workunit.client.0.smithi138.stderr: -205> 2024-09-14T11:37:33.699+0000 7fd561ddd9c0 5 AuthRegistry(0x55ff39b412a0) adding con mode: secure 2024-09-14T11:37:34.313 INFO:tasks.workunit.client.0.smithi138.stderr: -204> 2024-09-14T11:37:33.699+0000 7fd561ddd9c0 5 AuthRegistry(0x55ff39b412a0) adding con mode: crc 2024-09-14T11:37:34.313 INFO:tasks.workunit.client.0.smithi138.stderr: -203> 2024-09-14T11:37:33.699+0000 7fd561ddd9c0 5 AuthRegistry(0x55ff39b412a0) adding con mode: secure 2024-09-14T11:37:34.314 INFO:tasks.workunit.client.0.smithi138.stderr: -202> 2024-09-14T11:37:33.699+0000 7fd561ddd9c0 5 AuthRegistry(0x55ff39b412a0) adding con mode: crc 2024-09-14T11:37:34.314 INFO:tasks.workunit.client.0.smithi138.stderr: -201> 2024-09-14T11:37:33.699+0000 7fd561ddd9c0 5 AuthRegistry(0x55ff39b412a0) adding con mode: secure 2024-09-14T11:37:34.314 INFO:tasks.workunit.client.0.smithi138.stderr: -200> 2024-09-14T11:37:33.699+0000 7fd561ddd9c0 5 AuthRegistry(0x55ff39b412a0) adding con mode: crc 2024-09-14T11:37:34.314 INFO:tasks.workunit.client.0.smithi138.stderr: -199> 2024-09-14T11:37:33.699+0000 7fd561ddd9c0 5 AuthRegistry(0x55ff39b412a0) adding con mode: crc 2024-09-14T11:37:34.314 INFO:tasks.workunit.client.0.smithi138.stderr: -198> 2024-09-14T11:37:33.699+0000 7fd561ddd9c0 5 AuthRegistry(0x55ff39b412a0) adding con mode: secure 2024-09-14T11:37:34.314 INFO:tasks.workunit.client.0.smithi138.stderr: -197> 2024-09-14T11:37:33.699+0000 7fd561ddd9c0 5 AuthRegistry(0x55ff39b412a0) adding con mode: crc 2024-09-14T11:37:34.314 INFO:tasks.workunit.client.0.smithi138.stderr: -196> 2024-09-14T11:37:33.699+0000 7fd561ddd9c0 5 AuthRegistry(0x55ff39b412a0) adding con mode: secure 2024-09-14T11:37:34.314 INFO:tasks.workunit.client.0.smithi138.stderr: -195> 2024-09-14T11:37:33.699+0000 7fd561ddd9c0 5 AuthRegistry(0x55ff39b412a0) adding con mode: crc 2024-09-14T11:37:34.314 INFO:tasks.workunit.client.0.smithi138.stderr: -194> 2024-09-14T11:37:33.699+0000 7fd561ddd9c0 5 AuthRegistry(0x55ff39b412a0) adding con mode: secure 2024-09-14T11:37:34.314 INFO:tasks.workunit.client.0.smithi138.stderr: -193> 2024-09-14T11:37:33.699+0000 7fd561ddd9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:37:34.314 INFO:tasks.workunit.client.0.smithi138.stderr: -192> 2024-09-14T11:37:33.699+0000 7fd561ddd9c0 1 librados: starting msgr at 2024-09-14T11:37:34.314 INFO:tasks.workunit.client.0.smithi138.stderr: -191> 2024-09-14T11:37:33.699+0000 7fd561ddd9c0 1 librados: starting objecter 2024-09-14T11:37:34.314 INFO:tasks.workunit.client.0.smithi138.stderr: -190> 2024-09-14T11:37:33.699+0000 7fd561ddd9c0 5 asok(0x55ff39895d90) register_command objecter_requests cmddesc objecter_requests hook 0x55ff39b709c0 EEXIST 2024-09-14T11:37:34.314 INFO:tasks.workunit.client.0.smithi138.stderr: -189> 2024-09-14T11:37:33.699+0000 7fd561ddd9c0 1 librados: setting wanted keys 2024-09-14T11:37:34.314 INFO:tasks.workunit.client.0.smithi138.stderr: -188> 2024-09-14T11:37:33.699+0000 7fd561ddd9c0 1 librados: calling monclient init 2024-09-14T11:37:34.315 INFO:tasks.workunit.client.0.smithi138.stderr: -187> 2024-09-14T11:37:33.699+0000 7fd561ddd9c0 10 monclient: init 2024-09-14T11:37:34.315 INFO:tasks.workunit.client.0.smithi138.stderr: -186> 2024-09-14T11:37:33.699+0000 7fd561ddd9c0 5 AuthRegistry(0x55ff39b23950) adding auth protocol: cephx 2024-09-14T11:37:34.315 INFO:tasks.workunit.client.0.smithi138.stderr: -185> 2024-09-14T11:37:33.699+0000 7fd561ddd9c0 5 AuthRegistry(0x55ff39b23950) adding auth protocol: cephx 2024-09-14T11:37:34.315 INFO:tasks.workunit.client.0.smithi138.stderr: -184> 2024-09-14T11:37:33.699+0000 7fd561ddd9c0 5 AuthRegistry(0x55ff39b23950) adding auth protocol: cephx 2024-09-14T11:37:34.315 INFO:tasks.workunit.client.0.smithi138.stderr: -183> 2024-09-14T11:37:33.699+0000 7fd561ddd9c0 5 AuthRegistry(0x55ff39b23950) adding con mode: secure 2024-09-14T11:37:34.315 INFO:tasks.workunit.client.0.smithi138.stderr: -182> 2024-09-14T11:37:33.699+0000 7fd561ddd9c0 5 AuthRegistry(0x55ff39b23950) adding con mode: crc 2024-09-14T11:37:34.315 INFO:tasks.workunit.client.0.smithi138.stderr: -181> 2024-09-14T11:37:33.699+0000 7fd561ddd9c0 5 AuthRegistry(0x55ff39b23950) adding con mode: secure 2024-09-14T11:37:34.315 INFO:tasks.workunit.client.0.smithi138.stderr: -180> 2024-09-14T11:37:33.699+0000 7fd561ddd9c0 5 AuthRegistry(0x55ff39b23950) adding con mode: crc 2024-09-14T11:37:34.315 INFO:tasks.workunit.client.0.smithi138.stderr: -179> 2024-09-14T11:37:33.699+0000 7fd561ddd9c0 5 AuthRegistry(0x55ff39b23950) adding con mode: secure 2024-09-14T11:37:34.315 INFO:tasks.workunit.client.0.smithi138.stderr: -178> 2024-09-14T11:37:33.699+0000 7fd561ddd9c0 5 AuthRegistry(0x55ff39b23950) adding con mode: crc 2024-09-14T11:37:34.315 INFO:tasks.workunit.client.0.smithi138.stderr: -177> 2024-09-14T11:37:33.699+0000 7fd561ddd9c0 5 AuthRegistry(0x55ff39b23950) adding con mode: crc 2024-09-14T11:37:34.315 INFO:tasks.workunit.client.0.smithi138.stderr: -176> 2024-09-14T11:37:33.699+0000 7fd561ddd9c0 5 AuthRegistry(0x55ff39b23950) adding con mode: secure 2024-09-14T11:37:34.315 INFO:tasks.workunit.client.0.smithi138.stderr: -175> 2024-09-14T11:37:33.699+0000 7fd561ddd9c0 5 AuthRegistry(0x55ff39b23950) adding con mode: crc 2024-09-14T11:37:34.315 INFO:tasks.workunit.client.0.smithi138.stderr: -174> 2024-09-14T11:37:33.699+0000 7fd561ddd9c0 5 AuthRegistry(0x55ff39b23950) adding con mode: secure 2024-09-14T11:37:34.316 INFO:tasks.workunit.client.0.smithi138.stderr: -173> 2024-09-14T11:37:33.699+0000 7fd561ddd9c0 5 AuthRegistry(0x55ff39b23950) adding con mode: crc 2024-09-14T11:37:34.316 INFO:tasks.workunit.client.0.smithi138.stderr: -172> 2024-09-14T11:37:33.699+0000 7fd561ddd9c0 5 AuthRegistry(0x55ff39b23950) adding con mode: secure 2024-09-14T11:37:34.316 INFO:tasks.workunit.client.0.smithi138.stderr: -171> 2024-09-14T11:37:33.699+0000 7fd561ddd9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:37:34.316 INFO:tasks.workunit.client.0.smithi138.stderr: -170> 2024-09-14T11:37:33.699+0000 7fd561ddd9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:37:34.316 INFO:tasks.workunit.client.0.smithi138.stderr: -169> 2024-09-14T11:37:33.699+0000 7fd561ddd9c0 5 asok(0x55ff39895d90) register_command rotate-key cmddesc rotate-key hook 0x55ff39b23a98 EEXIST 2024-09-14T11:37:34.316 INFO:tasks.workunit.client.0.smithi138.stderr: -168> 2024-09-14T11:37:33.699+0000 7fd561ddd9c0 10 monclient: _reopen_session rank -1 2024-09-14T11:37:34.316 INFO:tasks.workunit.client.0.smithi138.stderr: -167> 2024-09-14T11:37:33.699+0000 7fd561ddd9c0 10 monclient: _add_conns ranks=[1,0,2] 2024-09-14T11:37:34.316 INFO:tasks.workunit.client.0.smithi138.stderr: -166> 2024-09-14T11:37:33.699+0000 7fd561ddd9c0 10 monclient(hunting): picked mon.noname-b con 0x55ff39b422d0 addr [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] 2024-09-14T11:37:34.316 INFO:tasks.workunit.client.0.smithi138.stderr: -165> 2024-09-14T11:37:33.699+0000 7fd561ddd9c0 10 monclient(hunting): picked mon.noname-a con 0x55ff39b453a0 addr [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] 2024-09-14T11:37:34.316 INFO:tasks.workunit.client.0.smithi138.stderr: -164> 2024-09-14T11:37:33.699+0000 7fd561ddd9c0 10 monclient(hunting): picked mon.noname-c con 0x55ff39b757d0 addr [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] 2024-09-14T11:37:34.316 INFO:tasks.workunit.client.0.smithi138.stderr: -163> 2024-09-14T11:37:33.699+0000 7fd561ddd9c0 10 monclient(hunting): start opening mon connection 2024-09-14T11:37:34.316 INFO:tasks.workunit.client.0.smithi138.stderr: -162> 2024-09-14T11:37:33.699+0000 7fd561ddd9c0 10 monclient(hunting): start opening mon connection 2024-09-14T11:37:34.316 INFO:tasks.workunit.client.0.smithi138.stderr: -161> 2024-09-14T11:37:33.699+0000 7fd561ddd9c0 10 monclient(hunting): start opening mon connection 2024-09-14T11:37:34.316 INFO:tasks.workunit.client.0.smithi138.stderr: -160> 2024-09-14T11:37:33.699+0000 7fd561ddd9c0 10 monclient(hunting): _renew_subs 2024-09-14T11:37:34.316 INFO:tasks.workunit.client.0.smithi138.stderr: -159> 2024-09-14T11:37:33.699+0000 7fd561ddd9c0 10 monclient(hunting): authenticate will time out at 2789.662424s 2024-09-14T11:37:34.317 INFO:tasks.workunit.client.0.smithi138.stderr: -158> 2024-09-14T11:37:33.699+0000 7fd5600e4640 10 monclient(hunting): get_auth_request con 0x55ff39b453a0 auth_method 0 2024-09-14T11:37:34.317 INFO:tasks.workunit.client.0.smithi138.stderr: -157> 2024-09-14T11:37:33.699+0000 7fd5600e4640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:37:34.317 INFO:tasks.workunit.client.0.smithi138.stderr: -156> 2024-09-14T11:37:33.699+0000 7fd5600e4640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:37:34.317 INFO:tasks.workunit.client.0.smithi138.stderr: -155> 2024-09-14T11:37:33.699+0000 7fd5600e4640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:37:34.317 INFO:tasks.workunit.client.0.smithi138.stderr: -154> 2024-09-14T11:37:33.699+0000 7fd55f8e3640 10 monclient(hunting): get_auth_request con 0x55ff39b757d0 auth_method 0 2024-09-14T11:37:34.317 INFO:tasks.workunit.client.0.smithi138.stderr: -153> 2024-09-14T11:37:33.699+0000 7fd55f8e3640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:37:34.317 INFO:tasks.workunit.client.0.smithi138.stderr: -152> 2024-09-14T11:37:33.699+0000 7fd55f8e3640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:37:34.317 INFO:tasks.workunit.client.0.smithi138.stderr: -151> 2024-09-14T11:37:33.699+0000 7fd55f8e3640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:37:34.317 INFO:tasks.workunit.client.0.smithi138.stderr: -150> 2024-09-14T11:37:33.699+0000 7fd5600e4640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:37:34.317 INFO:tasks.workunit.client.0.smithi138.stderr: -149> 2024-09-14T11:37:33.699+0000 7fd5600e4640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:37:34.317 INFO:tasks.workunit.client.0.smithi138.stderr: -148> 2024-09-14T11:37:33.699+0000 7fd5600e4640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:37:34.317 INFO:tasks.workunit.client.0.smithi138.stderr: -147> 2024-09-14T11:37:33.699+0000 7fd55f8e3640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:37:34.317 INFO:tasks.workunit.client.0.smithi138.stderr: -146> 2024-09-14T11:37:33.699+0000 7fd55f8e3640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:37:34.317 INFO:tasks.workunit.client.0.smithi138.stderr: -145> 2024-09-14T11:37:33.699+0000 7fd55f8e3640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:37:34.317 INFO:tasks.workunit.client.0.smithi138.stderr: -144> 2024-09-14T11:37:33.699+0000 7fd5600e4640 10 monclient(hunting): handle_auth_done global_id 7440 payload 824 2024-09-14T11:37:34.318 INFO:tasks.workunit.client.0.smithi138.stderr: -143> 2024-09-14T11:37:33.699+0000 7fd5600e4640 10 monclient: _finish_hunting 0 2024-09-14T11:37:34.318 INFO:tasks.workunit.client.0.smithi138.stderr: -142> 2024-09-14T11:37:33.699+0000 7fd5600e4640 1 monclient: found mon.noname-a 2024-09-14T11:37:34.318 INFO:tasks.workunit.client.0.smithi138.stderr: -141> 2024-09-14T11:37:33.699+0000 7fd5600e4640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.138:3300/0 2024-09-14T11:37:34.318 INFO:tasks.workunit.client.0.smithi138.stderr: -140> 2024-09-14T11:37:33.699+0000 7fd55f0e2640 10 monclient: get_auth_request con 0x55ff39b422d0 auth_method 0 2024-09-14T11:37:34.318 INFO:tasks.workunit.client.0.smithi138.stderr: -139> 2024-09-14T11:37:33.699+0000 7fd43d7fa640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:37:34.318 INFO:tasks.workunit.client.0.smithi138.stderr: -138> 2024-09-14T11:37:33.699+0000 7fd43d7fa640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-14T11:37:34.318 INFO:tasks.workunit.client.0.smithi138.stderr: -137> 2024-09-14T11:37:33.699+0000 7fd43d7fa640 10 monclient: dump: 2024-09-14T11:37:34.318 INFO:tasks.workunit.client.0.smithi138.stderr:epoch 1 2024-09-14T11:37:34.318 INFO:tasks.workunit.client.0.smithi138.stderr:fsid 3f225f43-83a6-4aeb-b798-1f04bb49d597 2024-09-14T11:37:34.318 INFO:tasks.workunit.client.0.smithi138.stderr:last_changed 2024-09-14T11:07:09.252780+0000 2024-09-14T11:37:34.318 INFO:tasks.workunit.client.0.smithi138.stderr:created 2024-09-14T11:07:09.252780+0000 2024-09-14T11:37:34.318 INFO:tasks.workunit.client.0.smithi138.stderr:min_mon_release 19 (squid) 2024-09-14T11:37:34.318 INFO:tasks.workunit.client.0.smithi138.stderr:election_strategy: 1 2024-09-14T11:37:34.319 INFO:tasks.workunit.client.0.smithi138.stderr:0: [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] mon.a 2024-09-14T11:37:34.319 INFO:tasks.workunit.client.0.smithi138.stderr:1: [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] mon.b 2024-09-14T11:37:34.319 INFO:tasks.workunit.client.0.smithi138.stderr:2: [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] mon.c 2024-09-14T11:37:34.319 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-14T11:37:34.319 INFO:tasks.workunit.client.0.smithi138.stderr: -136> 2024-09-14T11:37:33.699+0000 7fd43d7fa640 10 monclient: _finish_auth 0 2024-09-14T11:37:34.319 INFO:tasks.workunit.client.0.smithi138.stderr: -135> 2024-09-14T11:37:33.699+0000 7fd43d7fa640 10 monclient: _check_auth_tickets 2024-09-14T11:37:34.319 INFO:tasks.workunit.client.0.smithi138.stderr: -134> 2024-09-14T11:37:33.699+0000 7fd43d7fa640 10 monclient: handle_config config(0 keys) 2024-09-14T11:37:34.319 INFO:tasks.workunit.client.0.smithi138.stderr: -133> 2024-09-14T11:37:33.699+0000 7fd43d7fa640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:37:34.319 INFO:tasks.workunit.client.0.smithi138.stderr: -132> 2024-09-14T11:37:33.699+0000 7fd43d7fa640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-14T11:37:34.319 INFO:tasks.workunit.client.0.smithi138.stderr: -131> 2024-09-14T11:37:33.699+0000 7fd43d7fa640 10 monclient: dump: 2024-09-14T11:37:34.319 INFO:tasks.workunit.client.0.smithi138.stderr:epoch 1 2024-09-14T11:37:34.319 INFO:tasks.workunit.client.0.smithi138.stderr:fsid 3f225f43-83a6-4aeb-b798-1f04bb49d597 2024-09-14T11:37:34.319 INFO:tasks.workunit.client.0.smithi138.stderr:last_changed 2024-09-14T11:07:09.252780+0000 2024-09-14T11:37:34.319 INFO:tasks.workunit.client.0.smithi138.stderr:created 2024-09-14T11:07:09.252780+0000 2024-09-14T11:37:34.319 INFO:tasks.workunit.client.0.smithi138.stderr:min_mon_release 19 (squid) 2024-09-14T11:37:34.319 INFO:tasks.workunit.client.0.smithi138.stderr:election_strategy: 1 2024-09-14T11:37:34.320 INFO:tasks.workunit.client.0.smithi138.stderr:0: [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] mon.a 2024-09-14T11:37:34.320 INFO:tasks.workunit.client.0.smithi138.stderr:1: [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] mon.b 2024-09-14T11:37:34.320 INFO:tasks.workunit.client.0.smithi138.stderr:2: [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] mon.c 2024-09-14T11:37:34.320 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-14T11:37:34.320 INFO:tasks.workunit.client.0.smithi138.stderr: -130> 2024-09-14T11:37:33.699+0000 7fd43effd640 4 set_mon_vals no callback set 2024-09-14T11:37:34.320 INFO:tasks.workunit.client.0.smithi138.stderr: -129> 2024-09-14T11:37:33.699+0000 7fd561ddd9c0 5 monclient: authenticate success, global_id 7440 2024-09-14T11:37:34.320 INFO:tasks.workunit.client.0.smithi138.stderr: -128> 2024-09-14T11:37:33.699+0000 7fd561ddd9c0 10 monclient: _renew_subs 2024-09-14T11:37:34.320 INFO:tasks.workunit.client.0.smithi138.stderr: -127> 2024-09-14T11:37:33.699+0000 7fd561ddd9c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.138:3300/0 2024-09-14T11:37:34.320 INFO:tasks.workunit.client.0.smithi138.stderr: -126> 2024-09-14T11:37:33.699+0000 7fd561ddd9c0 10 monclient: _renew_subs 2024-09-14T11:37:34.320 INFO:tasks.workunit.client.0.smithi138.stderr: -125> 2024-09-14T11:37:33.699+0000 7fd561ddd9c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.138:3300/0 2024-09-14T11:37:34.320 INFO:tasks.workunit.client.0.smithi138.stderr: -124> 2024-09-14T11:37:33.699+0000 7fd561ddd9c0 1 librados: init done 2024-09-14T11:37:34.320 INFO:tasks.workunit.client.0.smithi138.stderr: -123> 2024-09-14T11:37:33.699+0000 7fd561ddd9c0 5 asok(0x55ff39895d90) register_command cr dump hook 0x55ff39b65db8 2024-09-14T11:37:34.320 INFO:tasks.workunit.client.0.smithi138.stderr: -122> 2024-09-14T11:37:33.703+0000 7fd561ddd9c0 20 rados->read ofs=0 len=0 2024-09-14T11:37:34.320 INFO:tasks.workunit.client.0.smithi138.stderr: -121> 2024-09-14T11:37:33.703+0000 7fd43d7fa640 4 mgrc handle_mgr_map Got map version 5 2024-09-14T11:37:34.320 INFO:tasks.workunit.client.0.smithi138.stderr: -120> 2024-09-14T11:37:33.703+0000 7fd43d7fa640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.138:6832/3778043143,v1:172.21.15.138:6833/3778043143] 2024-09-14T11:37:34.320 INFO:tasks.workunit.client.0.smithi138.stderr: -119> 2024-09-14T11:37:33.703+0000 7fd43d7fa640 4 mgrc reconnect Starting new session with [v2:172.21.15.138:6832/3778043143,v1:172.21.15.138:6833/3778043143] 2024-09-14T11:37:34.321 INFO:tasks.workunit.client.0.smithi138.stderr: -118> 2024-09-14T11:37:33.703+0000 7fd55f0e2640 10 monclient: get_auth_request con 0x7fd4280718d0 auth_method 0 2024-09-14T11:37:34.321 INFO:tasks.workunit.client.0.smithi138.stderr: -117> 2024-09-14T11:37:33.703+0000 7fd55f8e3640 10 monclient: get_auth_request con 0x55ff39b8f510 auth_method 0 2024-09-14T11:37:34.321 INFO:tasks.workunit.client.0.smithi138.stderr: -116> 2024-09-14T11:37:33.703+0000 7fd561ddd9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:37:34.321 INFO:tasks.workunit.client.0.smithi138.stderr: -115> 2024-09-14T11:37:33.703+0000 7fd561ddd9c0 20 realm 2024-09-14T11:37:34.321 INFO:tasks.workunit.client.0.smithi138.stderr: -114> 2024-09-14T11:37:33.703+0000 7fd561ddd9c0 20 rados->read ofs=0 len=0 2024-09-14T11:37:34.321 INFO:tasks.workunit.client.0.smithi138.stderr: -113> 2024-09-14T11:37:33.703+0000 7fd561ddd9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:37:34.321 INFO:tasks.workunit.client.0.smithi138.stderr: -112> 2024-09-14T11:37:33.703+0000 7fd561ddd9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:37:34.321 INFO:tasks.workunit.client.0.smithi138.stderr: -111> 2024-09-14T11:37:33.703+0000 7fd561ddd9c0 20 rados->read ofs=0 len=0 2024-09-14T11:37:34.321 INFO:tasks.workunit.client.0.smithi138.stderr: -110> 2024-09-14T11:37:33.703+0000 7fd561ddd9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:37:34.321 INFO:tasks.workunit.client.0.smithi138.stderr: -109> 2024-09-14T11:37:33.703+0000 7fd561ddd9c0 20 rados->read ofs=0 len=0 2024-09-14T11:37:34.321 INFO:tasks.workunit.client.0.smithi138.stderr: -108> 2024-09-14T11:37:33.707+0000 7fd55f0e2640 10 monclient: get_auth_request con 0x55ff39b93860 auth_method 0 2024-09-14T11:37:34.321 INFO:tasks.workunit.client.0.smithi138.stderr: -107> 2024-09-14T11:37:33.707+0000 7fd561ddd9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:37:34.321 INFO:tasks.workunit.client.0.smithi138.stderr: -106> 2024-09-14T11:37:33.707+0000 7fd561ddd9c0 20 rados->read ofs=0 len=0 2024-09-14T11:37:34.321 INFO:tasks.workunit.client.0.smithi138.stderr: -105> 2024-09-14T11:37:33.707+0000 7fd5600e4640 10 monclient: get_auth_request con 0x55ff39b96f80 auth_method 0 2024-09-14T11:37:34.321 INFO:tasks.workunit.client.0.smithi138.stderr: -104> 2024-09-14T11:37:33.707+0000 7fd561ddd9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:37:34.322 INFO:tasks.workunit.client.0.smithi138.stderr: -103> 2024-09-14T11:37:33.707+0000 7fd561ddd9c0 20 searching for the correct realm 2024-09-14T11:37:34.322 INFO:tasks.workunit.client.0.smithi138.stderr: -102> 2024-09-14T11:37:33.707+0000 7fd55f8e3640 10 monclient: get_auth_request con 0x55ff39b9bd40 auth_method 0 2024-09-14T11:37:34.322 INFO:tasks.workunit.client.0.smithi138.stderr: -101> 2024-09-14T11:37:33.707+0000 7fd55f0e2640 10 monclient: get_auth_request con 0x7fd55003d060 auth_method 0 2024-09-14T11:37:34.322 INFO:tasks.workunit.client.0.smithi138.stderr: -100> 2024-09-14T11:37:33.711+0000 7fd5600e4640 10 monclient: get_auth_request con 0x7fd5580fe920 auth_method 0 2024-09-14T11:37:34.322 INFO:tasks.workunit.client.0.smithi138.stderr: -99> 2024-09-14T11:37:33.711+0000 7fd5600e4640 0 -- 172.21.15.138:0/2435175307 >> [v2:172.21.15.154:6824/416768175,v1:172.21.15.154:6825/416768175] conn(0x7fd5580fe920 msgr2=0x7fd558105290 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-14T11:37:34.322 INFO:tasks.workunit.client.0.smithi138.stderr: -98> 2024-09-14T11:37:33.915+0000 7fd5600e4640 10 monclient: get_auth_request con 0x7fd5580fe920 auth_method 0 2024-09-14T11:37:34.322 INFO:tasks.workunit.client.0.smithi138.stderr: -97> 2024-09-14T11:37:33.919+0000 7fd55f8e3640 10 monclient: get_auth_request con 0x7fd558107b10 auth_method 0 2024-09-14T11:37:34.322 INFO:tasks.workunit.client.0.smithi138.stderr: -96> 2024-09-14T11:37:33.927+0000 7fd55f0e2640 10 monclient: get_auth_request con 0x7fd558134390 auth_method 0 2024-09-14T11:37:34.322 INFO:tasks.workunit.client.0.smithi138.stderr: -95> 2024-09-14T11:37:33.927+0000 7fd55f0e2640 0 -- 172.21.15.138:0/2435175307 >> [v2:172.21.15.138:6816/326481658,v1:172.21.15.138:6817/326481658] conn(0x7fd558134390 msgr2=0x7fd5581180b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:37:34.322 INFO:tasks.workunit.client.0.smithi138.stderr: -94> 2024-09-14T11:37:34.131+0000 7fd55f0e2640 10 monclient: get_auth_request con 0x7fd558134390 auth_method 0 2024-09-14T11:37:34.322 INFO:tasks.workunit.client.0.smithi138.stderr: -93> 2024-09-14T11:37:34.143+0000 7fd561ddd9c0 20 RGWRados::pool_iterate: got zone_info.d9e72d30-c60b-4d0d-9267-fdc36392d5ad 2024-09-14T11:37:34.322 INFO:tasks.workunit.client.0.smithi138.stderr: -92> 2024-09-14T11:37:34.143+0000 7fd561ddd9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:37:34.322 INFO:tasks.workunit.client.0.smithi138.stderr: -91> 2024-09-14T11:37:34.143+0000 7fd561ddd9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:37:34.322 INFO:tasks.workunit.client.0.smithi138.stderr: -90> 2024-09-14T11:37:34.143+0000 7fd561ddd9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:37:34.322 INFO:tasks.workunit.client.0.smithi138.stderr: -89> 2024-09-14T11:37:34.143+0000 7fd561ddd9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:37:34.323 INFO:tasks.workunit.client.0.smithi138.stderr: -88> 2024-09-14T11:37:34.143+0000 7fd561ddd9c0 20 RGWRados::pool_iterate: got zonegroup_info.65ab941b-da8c-4160-94fb-3672b069d44f 2024-09-14T11:37:34.323 INFO:tasks.workunit.client.0.smithi138.stderr: -87> 2024-09-14T11:37:34.143+0000 7fd561ddd9c0 20 rados->read ofs=0 len=0 2024-09-14T11:37:34.323 INFO:tasks.workunit.client.0.smithi138.stderr: -86> 2024-09-14T11:37:34.143+0000 7fd561ddd9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:37:34.323 INFO:tasks.workunit.client.0.smithi138.stderr: -85> 2024-09-14T11:37:34.143+0000 7fd561ddd9c0 20 rados->read ofs=0 len=0 2024-09-14T11:37:34.323 INFO:tasks.workunit.client.0.smithi138.stderr: -84> 2024-09-14T11:37:34.147+0000 7fd561ddd9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:37:34.323 INFO:tasks.workunit.client.0.smithi138.stderr: -83> 2024-09-14T11:37:34.147+0000 7fd561ddd9c0 20 rados->read ofs=0 len=0 2024-09-14T11:37:34.323 INFO:tasks.workunit.client.0.smithi138.stderr: -82> 2024-09-14T11:37:34.147+0000 7fd561ddd9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:37:34.323 INFO:tasks.workunit.client.0.smithi138.stderr: -81> 2024-09-14T11:37:34.147+0000 7fd561ddd9c0 20 zone default found 2024-09-14T11:37:34.323 INFO:tasks.workunit.client.0.smithi138.stderr: -80> 2024-09-14T11:37:34.147+0000 7fd561ddd9c0 4 Realm: () 2024-09-14T11:37:34.323 INFO:tasks.workunit.client.0.smithi138.stderr: -79> 2024-09-14T11:37:34.147+0000 7fd561ddd9c0 4 ZoneGroup: default (65ab941b-da8c-4160-94fb-3672b069d44f) 2024-09-14T11:37:34.323 INFO:tasks.workunit.client.0.smithi138.stderr: -78> 2024-09-14T11:37:34.147+0000 7fd561ddd9c0 4 Zone: default (d9e72d30-c60b-4d0d-9267-fdc36392d5ad) 2024-09-14T11:37:34.323 INFO:tasks.workunit.client.0.smithi138.stderr: -77> 2024-09-14T11:37:34.147+0000 7fd561ddd9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:37:34.323 INFO:tasks.workunit.client.0.smithi138.stderr: -76> 2024-09-14T11:37:34.147+0000 7fd561ddd9c0 20 zonegroup default 2024-09-14T11:37:34.323 INFO:tasks.workunit.client.0.smithi138.stderr: -75> 2024-09-14T11:37:34.147+0000 7fd561ddd9c0 20 rados->read ofs=0 len=0 2024-09-14T11:37:34.323 INFO:tasks.workunit.client.0.smithi138.stderr: -74> 2024-09-14T11:37:34.147+0000 7fd561ddd9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:37:34.324 INFO:tasks.workunit.client.0.smithi138.stderr: -73> 2024-09-14T11:37:34.147+0000 7fd561ddd9c0 20 rados->read ofs=0 len=0 2024-09-14T11:37:34.324 INFO:tasks.workunit.client.0.smithi138.stderr: -72> 2024-09-14T11:37:34.147+0000 7fd561ddd9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:37:34.324 INFO:tasks.workunit.client.0.smithi138.stderr: -71> 2024-09-14T11:37:34.147+0000 7fd561ddd9c0 20 rados->read ofs=0 len=0 2024-09-14T11:37:34.324 INFO:tasks.workunit.client.0.smithi138.stderr: -70> 2024-09-14T11:37:34.151+0000 7fd561ddd9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:37:34.324 INFO:tasks.workunit.client.0.smithi138.stderr: -69> 2024-09-14T11:37:34.151+0000 7fd561ddd9c0 20 started sync module instance, tier type = 2024-09-14T11:37:34.324 INFO:tasks.workunit.client.0.smithi138.stderr: -68> 2024-09-14T11:37:34.151+0000 7fd561ddd9c0 20 started zone id=d9e72d30-c60b-4d0d-9267-fdc36392d5ad (name=default) with tier type = 2024-09-14T11:37:34.324 INFO:tasks.workunit.client.0.smithi138.stderr: -67> 2024-09-14T11:37:34.175+0000 7fd561ddd9c0 20 add_watcher() i=0 2024-09-14T11:37:34.324 INFO:tasks.workunit.client.0.smithi138.stderr: -66> 2024-09-14T11:37:34.175+0000 7fd561ddd9c0 20 add_watcher() i=1 2024-09-14T11:37:34.324 INFO:tasks.workunit.client.0.smithi138.stderr: -65> 2024-09-14T11:37:34.175+0000 7fd561ddd9c0 20 add_watcher() i=2 2024-09-14T11:37:34.324 INFO:tasks.workunit.client.0.smithi138.stderr: -64> 2024-09-14T11:37:34.175+0000 7fd561ddd9c0 20 add_watcher() i=3 2024-09-14T11:37:34.324 INFO:tasks.workunit.client.0.smithi138.stderr: -63> 2024-09-14T11:37:34.175+0000 7fd561ddd9c0 20 add_watcher() i=4 2024-09-14T11:37:34.324 INFO:tasks.workunit.client.0.smithi138.stderr: -62> 2024-09-14T11:37:34.175+0000 7fd561ddd9c0 20 add_watcher() i=5 2024-09-14T11:37:34.324 INFO:tasks.workunit.client.0.smithi138.stderr: -61> 2024-09-14T11:37:34.175+0000 7fd561ddd9c0 20 add_watcher() i=6 2024-09-14T11:37:34.324 INFO:tasks.workunit.client.0.smithi138.stderr: -60> 2024-09-14T11:37:34.179+0000 7fd561ddd9c0 20 add_watcher() i=7 2024-09-14T11:37:34.324 INFO:tasks.workunit.client.0.smithi138.stderr: -59> 2024-09-14T11:37:34.179+0000 7fd561ddd9c0 2 all 8 watchers are set, enabling cache 2024-09-14T11:37:34.325 INFO:tasks.workunit.client.0.smithi138.stderr: -58> 2024-09-14T11:37:34.183+0000 7fd561ddd9c0 5 AuthRegistry(0x7fff90fa4cc0) adding auth protocol: cephx 2024-09-14T11:37:34.325 INFO:tasks.workunit.client.0.smithi138.stderr: -57> 2024-09-14T11:37:34.183+0000 7fd561ddd9c0 5 AuthRegistry(0x7fff90fa4cc0) adding auth protocol: cephx 2024-09-14T11:37:34.325 INFO:tasks.workunit.client.0.smithi138.stderr: -56> 2024-09-14T11:37:34.183+0000 7fd561ddd9c0 5 AuthRegistry(0x7fff90fa4cc0) adding auth protocol: cephx 2024-09-14T11:37:34.325 INFO:tasks.workunit.client.0.smithi138.stderr: -55> 2024-09-14T11:37:34.183+0000 7fd561ddd9c0 5 AuthRegistry(0x7fff90fa4cc0) adding con mode: secure 2024-09-14T11:37:34.325 INFO:tasks.workunit.client.0.smithi138.stderr: -54> 2024-09-14T11:37:34.183+0000 7fd561ddd9c0 5 AuthRegistry(0x7fff90fa4cc0) adding con mode: crc 2024-09-14T11:37:34.325 INFO:tasks.workunit.client.0.smithi138.stderr: -53> 2024-09-14T11:37:34.183+0000 7fd561ddd9c0 5 AuthRegistry(0x7fff90fa4cc0) adding con mode: secure 2024-09-14T11:37:34.325 INFO:tasks.workunit.client.0.smithi138.stderr: -52> 2024-09-14T11:37:34.183+0000 7fd561ddd9c0 5 AuthRegistry(0x7fff90fa4cc0) adding con mode: crc 2024-09-14T11:37:34.325 INFO:tasks.workunit.client.0.smithi138.stderr: -51> 2024-09-14T11:37:34.183+0000 7fd561ddd9c0 5 AuthRegistry(0x7fff90fa4cc0) adding con mode: secure 2024-09-14T11:37:34.325 INFO:tasks.workunit.client.0.smithi138.stderr: -50> 2024-09-14T11:37:34.183+0000 7fd561ddd9c0 5 AuthRegistry(0x7fff90fa4cc0) adding con mode: crc 2024-09-14T11:37:34.325 INFO:tasks.workunit.client.0.smithi138.stderr: -49> 2024-09-14T11:37:34.183+0000 7fd561ddd9c0 5 AuthRegistry(0x7fff90fa4cc0) adding con mode: crc 2024-09-14T11:37:34.325 INFO:tasks.workunit.client.0.smithi138.stderr: -48> 2024-09-14T11:37:34.183+0000 7fd561ddd9c0 5 AuthRegistry(0x7fff90fa4cc0) adding con mode: secure 2024-09-14T11:37:34.325 INFO:tasks.workunit.client.0.smithi138.stderr: -47> 2024-09-14T11:37:34.183+0000 7fd561ddd9c0 5 AuthRegistry(0x7fff90fa4cc0) adding con mode: crc 2024-09-14T11:37:34.325 INFO:tasks.workunit.client.0.smithi138.stderr: -46> 2024-09-14T11:37:34.183+0000 7fd561ddd9c0 5 AuthRegistry(0x7fff90fa4cc0) adding con mode: secure 2024-09-14T11:37:34.325 INFO:tasks.workunit.client.0.smithi138.stderr: -45> 2024-09-14T11:37:34.183+0000 7fd561ddd9c0 5 AuthRegistry(0x7fff90fa4cc0) adding con mode: crc 2024-09-14T11:37:34.325 INFO:tasks.workunit.client.0.smithi138.stderr: -44> 2024-09-14T11:37:34.183+0000 7fd561ddd9c0 5 AuthRegistry(0x7fff90fa4cc0) adding con mode: secure 2024-09-14T11:37:34.326 INFO:tasks.workunit.client.0.smithi138.stderr: -43> 2024-09-14T11:37:34.183+0000 7fd415fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:37:34.326 INFO:tasks.workunit.client.0.smithi138.stderr: -42> 2024-09-14T11:37:34.183+0000 7fd561ddd9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:37:34.326 INFO:tasks.workunit.client.0.smithi138.stderr: -41> 2024-09-14T11:37:34.183+0000 7fd561ddd9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:37:34.326 INFO:tasks.workunit.client.0.smithi138.stderr: -40> 2024-09-14T11:37:34.183+0000 7fd561ddd9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:37:34.326 INFO:tasks.workunit.client.0.smithi138.stderr: -39> 2024-09-14T11:37:34.183+0000 7fd561ddd9c0 5 asok(0x55ff39895d90) register_command cache list hook 0x55ff39b63db0 2024-09-14T11:37:34.326 INFO:tasks.workunit.client.0.smithi138.stderr: -38> 2024-09-14T11:37:34.183+0000 7fd561ddd9c0 5 asok(0x55ff39895d90) register_command cache inspect hook 0x55ff39b63db0 2024-09-14T11:37:34.326 INFO:tasks.workunit.client.0.smithi138.stderr: -37> 2024-09-14T11:37:34.183+0000 7fd561ddd9c0 5 asok(0x55ff39895d90) register_command cache erase hook 0x55ff39b63db0 2024-09-14T11:37:34.326 INFO:tasks.workunit.client.0.smithi138.stderr: -36> 2024-09-14T11:37:34.183+0000 7fd561ddd9c0 5 asok(0x55ff39895d90) register_command cache zap hook 0x55ff39b63db0 2024-09-14T11:37:34.326 INFO:tasks.workunit.client.0.smithi138.stderr: -35> 2024-09-14T11:37:34.183+0000 7fd561ddd9c0 5 note: GC not initialized 2024-09-14T11:37:34.326 INFO:tasks.workunit.client.0.smithi138.stderr: -34> 2024-09-14T11:37:34.183+0000 7fd414fe1640 20 reqs_thread_entry: start 2024-09-14T11:37:34.326 INFO:tasks.workunit.client.0.smithi138.stderr: -33> 2024-09-14T11:37:34.183+0000 7fd561ddd9c0 5 asok(0x55ff39895d90) register_command sync trace show hook 0x7fd55405d020 2024-09-14T11:37:34.326 INFO:tasks.workunit.client.0.smithi138.stderr: -32> 2024-09-14T11:37:34.183+0000 7fd561ddd9c0 5 asok(0x55ff39895d90) register_command sync trace history hook 0x7fd55405d020 2024-09-14T11:37:34.326 INFO:tasks.workunit.client.0.smithi138.stderr: -31> 2024-09-14T11:37:34.183+0000 7fd561ddd9c0 5 asok(0x55ff39895d90) register_command sync trace active hook 0x7fd55405d020 2024-09-14T11:37:34.326 INFO:tasks.workunit.client.0.smithi138.stderr: -30> 2024-09-14T11:37:34.183+0000 7fd561ddd9c0 5 asok(0x55ff39895d90) register_command sync trace active_short hook 0x7fd55405d020 2024-09-14T11:37:34.327 INFO:tasks.workunit.client.0.smithi138.stderr: -29> 2024-09-14T11:37:34.183+0000 7fd561ddd9c0 20 init_complete bucket index max shards: 11 2024-09-14T11:37:34.327 INFO:tasks.workunit.client.0.smithi138.stderr: -28> 2024-09-14T11:37:34.183+0000 7fd561ddd9c0 20 Filter name: none 2024-09-14T11:37:34.327 INFO:tasks.workunit.client.0.smithi138.stderr: -27> 2024-09-14T11:37:34.183+0000 7fd38e7fc640 20 reqs_thread_entry: start 2024-09-14T11:37:34.327 INFO:tasks.workunit.client.0.smithi138.stderr: -26> 2024-09-14T11:37:34.183+0000 7fd561ddd9c0 10 cache get: name=default.rgw.meta+root+abort-at-do-reshard : miss 2024-09-14T11:37:34.327 INFO:tasks.workunit.client.0.smithi138.stderr: -25> 2024-09-14T11:37:34.183+0000 7fd561ddd9c0 20 rados->read ofs=0 len=0 2024-09-14T11:37:34.327 INFO:tasks.workunit.client.0.smithi138.stderr: -24> 2024-09-14T11:37:34.187+0000 7fd561ddd9c0 20 rados_obj.operate() r=0 bl.length=187 2024-09-14T11:37:34.327 INFO:tasks.workunit.client.0.smithi138.stderr: -23> 2024-09-14T11:37:34.187+0000 7fd561ddd9c0 10 cache put: name=default.rgw.meta+root+abort-at-do-reshard info.flags=0x11 2024-09-14T11:37:34.327 INFO:tasks.workunit.client.0.smithi138.stderr: -22> 2024-09-14T11:37:34.187+0000 7fd561ddd9c0 10 adding default.rgw.meta+root+abort-at-do-reshard to cache LRU end 2024-09-14T11:37:34.327 INFO:tasks.workunit.client.0.smithi138.stderr: -21> 2024-09-14T11:37:34.187+0000 7fd561ddd9c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.34 : miss 2024-09-14T11:37:34.327 INFO:tasks.workunit.client.0.smithi138.stderr: -20> 2024-09-14T11:37:34.187+0000 7fd561ddd9c0 20 rados->read ofs=0 len=0 2024-09-14T11:37:34.327 INFO:tasks.workunit.client.0.smithi138.stderr: -19> 2024-09-14T11:37:34.187+0000 7fd561ddd9c0 20 rados_obj.operate() r=0 bl.length=409 2024-09-14T11:37:34.327 INFO:tasks.workunit.client.0.smithi138.stderr: -18> 2024-09-14T11:37:34.187+0000 7fd561ddd9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.34 info.flags=0x17 2024-09-14T11:37:34.327 INFO:tasks.workunit.client.0.smithi138.stderr: -17> 2024-09-14T11:37:34.187+0000 7fd561ddd9c0 10 adding default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.34 to cache LRU end 2024-09-14T11:37:34.327 INFO:tasks.workunit.client.0.smithi138.stderr: -16> 2024-09-14T11:37:34.187+0000 7fd561ddd9c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:37:34.327 INFO:tasks.workunit.client.0.smithi138.stderr: -15> 2024-09-14T11:37:34.187+0000 7fd561ddd9c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:37:34.328 INFO:tasks.workunit.client.0.smithi138.stderr: -14> 2024-09-14T11:37:34.187+0000 7fd561ddd9c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.34 2024-09-14T11:37:34.328 INFO:tasks.workunit.client.0.smithi138.stderr: -13> 2024-09-14T11:37:34.199+0000 7fd561ddd9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.34 info.flags=0x17 2024-09-14T11:37:34.328 INFO:tasks.workunit.client.0.smithi138.stderr: -12> 2024-09-14T11:37:34.199+0000 7fd561ddd9c0 10 moving default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.34 to cache LRU end 2024-09-14T11:37:34.328 INFO:tasks.workunit.client.0.smithi138.stderr: -11> 2024-09-14T11:37:34.199+0000 7fd561ddd9c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:37:34.328 INFO:tasks.workunit.client.0.smithi138.stderr: -10> 2024-09-14T11:37:34.199+0000 7fd561ddd9c0 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-do-reshard:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.34, ofs0, ns] 2024-09-14T11:37:34.328 INFO:tasks.workunit.client.0.smithi138.stderr: -9> 2024-09-14T11:37:34.199+0000 7fd43e7fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366215 cookie 94554673513184 notifier 7440 bl.length()=911 2024-09-14T11:37:34.328 INFO:tasks.workunit.client.0.smithi138.stderr: -8> 2024-09-14T11:37:34.199+0000 7fd43e7fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.34 info.flags=0x17 2024-09-14T11:37:34.328 INFO:tasks.workunit.client.0.smithi138.stderr: -7> 2024-09-14T11:37:34.199+0000 7fd43e7fc640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.34 to cache LRU end 2024-09-14T11:37:34.328 INFO:tasks.workunit.client.0.smithi138.stderr: -6> 2024-09-14T11:37:34.199+0000 7fd43e7fc640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:37:34.328 INFO:tasks.workunit.client.0.smithi138.stderr: -5> 2024-09-14T11:37:34.203+0000 7fd561ddd9c0 20 handle_bi_update(): bucket=:abort-at-do-reshard[d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.34]): orig_sources= new_sources= 2024-09-14T11:37:34.328 INFO:tasks.workunit.client.0.smithi138.stderr: -4> 2024-09-14T11:37:34.203+0000 7fd561ddd9c0 20 handle_bi_update(): bucket=:abort-at-do-reshard[d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.34]): potential sources added=[] removed=[] 2024-09-14T11:37:34.328 INFO:tasks.workunit.client.0.smithi138.stderr: -3> 2024-09-14T11:37:34.203+0000 7fd561ddd9c0 20 handle_bi_update(): bucket=:abort-at-do-reshard[d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.34]): orig_dests= new_dests= 2024-09-14T11:37:34.328 INFO:tasks.workunit.client.0.smithi138.stderr: -2> 2024-09-14T11:37:34.203+0000 7fd561ddd9c0 20 handle_bi_update(): bucket=:abort-at-do-reshard[d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.34]): potential dests added=[] removed=[] 2024-09-14T11:37:34.329 INFO:tasks.workunit.client.0.smithi138.stderr: -1> 2024-09-14T11:37:34.215+0000 7fd561ddd9c0 -1 ./src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7fd561ddd9c0 time 2024-09-14T11:37:34.216403+0000 2024-09-14T11:37:34.329 INFO:tasks.workunit.client.0.smithi138.stderr:./src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-14T11:37:34.329 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-14T11:37:34.329 INFO:tasks.workunit.client.0.smithi138.stderr: ceph version 19.3.0-4907-ga2782315 (a2782315255a3e7d5f6cdc9eb35785187ff6ddf8) squid (dev) 2024-09-14T11:37:34.329 INFO:tasks.workunit.client.0.smithi138.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x121) [0x7fd5656b72eb] 2024-09-14T11:37:34.329 INFO:tasks.workunit.client.0.smithi138.stderr: 2: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7fd5656b749f] 2024-09-14T11:37:34.329 INFO:tasks.workunit.client.0.smithi138.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55ff38334c01] 2024-09-14T11:37:34.329 INFO:tasks.workunit.client.0.smithi138.stderr: 4: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x17a) [0x55ff38349f3a] 2024-09-14T11:37:34.329 INFO:tasks.workunit.client.0.smithi138.stderr: 5: main() 2024-09-14T11:37:34.329 INFO:tasks.workunit.client.0.smithi138.stderr: 6: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7fd56451dd90] 2024-09-14T11:37:34.329 INFO:tasks.workunit.client.0.smithi138.stderr: 7: __libc_start_main() 2024-09-14T11:37:34.329 INFO:tasks.workunit.client.0.smithi138.stderr: 8: _start() 2024-09-14T11:37:34.329 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-14T11:37:34.329 INFO:tasks.workunit.client.0.smithi138.stderr: 0> 2024-09-14T11:37:34.215+0000 7fd561ddd9c0 -1 *** Caught signal (Aborted) ** 2024-09-14T11:37:34.329 INFO:tasks.workunit.client.0.smithi138.stderr: in thread 7fd561ddd9c0 thread_name:radosgw-admin 2024-09-14T11:37:34.330 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-14T11:37:34.330 INFO:tasks.workunit.client.0.smithi138.stderr: ceph version 19.3.0-4907-ga2782315 (a2782315255a3e7d5f6cdc9eb35785187ff6ddf8) squid (dev) 2024-09-14T11:37:34.330 INFO:tasks.workunit.client.0.smithi138.stderr: 1: /lib/x86_64-linux-gnu/libc.so.6(+0x42520) [0x7fd564536520] 2024-09-14T11:37:34.330 INFO:tasks.workunit.client.0.smithi138.stderr: 2: pthread_kill() 2024-09-14T11:37:34.330 INFO:tasks.workunit.client.0.smithi138.stderr: 3: raise() 2024-09-14T11:37:34.330 INFO:tasks.workunit.client.0.smithi138.stderr: 4: abort() 2024-09-14T11:37:34.330 INFO:tasks.workunit.client.0.smithi138.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x17b) [0x7fd5656b7345] 2024-09-14T11:37:34.330 INFO:tasks.workunit.client.0.smithi138.stderr: 6: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7fd5656b749f] 2024-09-14T11:37:34.330 INFO:tasks.workunit.client.0.smithi138.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55ff38334c01] 2024-09-14T11:37:34.330 INFO:tasks.workunit.client.0.smithi138.stderr: 8: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x17a) [0x55ff38349f3a] 2024-09-14T11:37:34.330 INFO:tasks.workunit.client.0.smithi138.stderr: 9: main() 2024-09-14T11:37:34.330 INFO:tasks.workunit.client.0.smithi138.stderr: 10: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7fd56451dd90] 2024-09-14T11:37:34.330 INFO:tasks.workunit.client.0.smithi138.stderr: 11: __libc_start_main() 2024-09-14T11:37:34.330 INFO:tasks.workunit.client.0.smithi138.stderr: 12: _start() 2024-09-14T11:37:34.330 INFO:tasks.workunit.client.0.smithi138.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-14T11:37:34.331 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-14T11:37:34.331 INFO:tasks.workunit.client.0.smithi138.stderr:--- logging levels --- 2024-09-14T11:37:34.331 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 none 2024-09-14T11:37:34.331 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 1 lockdep 2024-09-14T11:37:34.331 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 1 context 2024-09-14T11:37:34.331 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 1 crush 2024-09-14T11:37:34.331 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 mds 2024-09-14T11:37:34.331 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 mds_balancer 2024-09-14T11:37:34.331 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 mds_locker 2024-09-14T11:37:34.331 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 mds_log 2024-09-14T11:37:34.331 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 mds_log_expire 2024-09-14T11:37:34.331 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 mds_migrator 2024-09-14T11:37:34.331 INFO:tasks.workunit.client.0.smithi138.stderr: 3/ 5 mds_quiesce 2024-09-14T11:37:34.331 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 1 buffer 2024-09-14T11:37:34.331 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 1 timer 2024-09-14T11:37:34.332 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 1 filer 2024-09-14T11:37:34.332 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 1 striper 2024-09-14T11:37:34.332 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 1 objecter 2024-09-14T11:37:34.332 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 rados 2024-09-14T11:37:34.332 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 rbd 2024-09-14T11:37:34.332 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 rbd_mirror 2024-09-14T11:37:34.332 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 rbd_replay 2024-09-14T11:37:34.332 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 rbd_pwl 2024-09-14T11:37:34.332 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 journaler 2024-09-14T11:37:34.332 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 objectcacher 2024-09-14T11:37:34.332 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 immutable_obj_cache 2024-09-14T11:37:34.332 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 client 2024-09-14T11:37:34.332 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 osd 2024-09-14T11:37:34.332 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 optracker 2024-09-14T11:37:34.333 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 objclass 2024-09-14T11:37:34.333 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 3 filestore 2024-09-14T11:37:34.333 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 3 journal 2024-09-14T11:37:34.333 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 0 ms 2024-09-14T11:37:34.333 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 mon 2024-09-14T11:37:34.333 INFO:tasks.workunit.client.0.smithi138.stderr: 0/10 monc 2024-09-14T11:37:34.333 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 paxos 2024-09-14T11:37:34.333 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 tp 2024-09-14T11:37:34.333 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 auth 2024-09-14T11:37:34.333 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 crypto 2024-09-14T11:37:34.333 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 1 finisher 2024-09-14T11:37:34.333 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 1 reserver 2024-09-14T11:37:34.333 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 heartbeatmap 2024-09-14T11:37:34.333 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 perfcounter 2024-09-14T11:37:34.333 INFO:tasks.workunit.client.0.smithi138.stderr: 20/20 rgw 2024-09-14T11:37:34.334 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 rgw_sync 2024-09-14T11:37:34.334 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 rgw_datacache 2024-09-14T11:37:34.334 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 rgw_access 2024-09-14T11:37:34.334 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 rgw_dbstore 2024-09-14T11:37:34.334 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 rgw_flight 2024-09-14T11:37:34.334 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 rgw_lifecycle 2024-09-14T11:37:34.334 INFO:tasks.workunit.client.0.smithi138.stderr: 20/20 rgw_notification 2024-09-14T11:37:34.334 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 javaclient 2024-09-14T11:37:34.334 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 asok 2024-09-14T11:37:34.334 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 1 throttle 2024-09-14T11:37:34.334 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 0 refs 2024-09-14T11:37:34.334 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 compressor 2024-09-14T11:37:34.334 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 bluestore 2024-09-14T11:37:34.334 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 bluefs 2024-09-14T11:37:34.334 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 3 bdev 2024-09-14T11:37:34.335 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 kstore 2024-09-14T11:37:34.335 INFO:tasks.workunit.client.0.smithi138.stderr: 4/ 5 rocksdb 2024-09-14T11:37:34.335 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 fuse 2024-09-14T11:37:34.335 INFO:tasks.workunit.client.0.smithi138.stderr: 2/ 5 mgr 2024-09-14T11:37:34.335 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 mgrc 2024-09-14T11:37:34.335 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 dpdk 2024-09-14T11:37:34.335 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 eventtrace 2024-09-14T11:37:34.335 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 prioritycache 2024-09-14T11:37:34.335 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 test 2024-09-14T11:37:34.335 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 cephfs_mirror 2024-09-14T11:37:34.335 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 cephsqlite 2024-09-14T11:37:34.335 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 crimson_interrupt 2024-09-14T11:37:34.335 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 seastore 2024-09-14T11:37:34.335 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 seastore_onode 2024-09-14T11:37:34.336 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 seastore_odata 2024-09-14T11:37:34.336 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 seastore_omap 2024-09-14T11:37:34.336 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 seastore_tm 2024-09-14T11:37:34.336 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 seastore_t 2024-09-14T11:37:34.336 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 seastore_cleaner 2024-09-14T11:37:34.336 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 seastore_epm 2024-09-14T11:37:34.336 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 seastore_lba 2024-09-14T11:37:34.336 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 seastore_fixedkv_tree 2024-09-14T11:37:34.336 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 seastore_cache 2024-09-14T11:37:34.336 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 seastore_journal 2024-09-14T11:37:34.336 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 seastore_device 2024-09-14T11:37:34.336 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 seastore_backref 2024-09-14T11:37:34.336 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 alienstore 2024-09-14T11:37:34.336 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 mclock 2024-09-14T11:37:34.337 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 cyanstore 2024-09-14T11:37:34.337 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 ceph_exporter 2024-09-14T11:37:34.337 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 memstore 2024-09-14T11:37:34.337 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 trace 2024-09-14T11:37:34.337 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 ceph_dedup 2024-09-14T11:37:34.337 INFO:tasks.workunit.client.0.smithi138.stderr: -2/-2 (syslog threshold) 2024-09-14T11:37:34.337 INFO:tasks.workunit.client.0.smithi138.stderr: 99/99 (stderr threshold) 2024-09-14T11:37:34.337 INFO:tasks.workunit.client.0.smithi138.stderr:--- pthread ID / name mapping for recent threads --- 2024-09-14T11:37:34.337 INFO:tasks.workunit.client.0.smithi138.stderr: 7fd38e7fc640 / http_manager 2024-09-14T11:37:34.337 INFO:tasks.workunit.client.0.smithi138.stderr: 7fd414fe1640 / http_manager 2024-09-14T11:37:34.337 INFO:tasks.workunit.client.0.smithi138.stderr: 7fd415fe3640 / rgw_dt_lg_renew 2024-09-14T11:37:34.337 INFO:tasks.workunit.client.0.smithi138.stderr: 7fd43d7fa640 / ms_dispatch 2024-09-14T11:37:34.337 INFO:tasks.workunit.client.0.smithi138.stderr: 7fd43e7fc640 / io_context_pool 2024-09-14T11:37:34.337 INFO:tasks.workunit.client.0.smithi138.stderr: 7fd43effd640 / io_context_pool 2024-09-14T11:37:34.338 INFO:tasks.workunit.client.0.smithi138.stderr: 7fd4457fa640 / ms_dispatch 2024-09-14T11:37:34.338 INFO:tasks.workunit.client.0.smithi138.stderr: 7fd447fff640 / ms_dispatch 2024-09-14T11:37:34.338 INFO:tasks.workunit.client.0.smithi138.stderr: 7fd44de0b640 / io_context_pool 2024-09-14T11:37:34.338 INFO:tasks.workunit.client.0.smithi138.stderr: 7fd55f0e2640 / msgr-worker-2 2024-09-14T11:37:34.338 INFO:tasks.workunit.client.0.smithi138.stderr: 7fd55f8e3640 / msgr-worker-1 2024-09-14T11:37:34.338 INFO:tasks.workunit.client.0.smithi138.stderr: 7fd5600e4640 / msgr-worker-0 2024-09-14T11:37:34.338 INFO:tasks.workunit.client.0.smithi138.stderr: 7fd5608e5640 / io_context_pool 2024-09-14T11:37:34.338 INFO:tasks.workunit.client.0.smithi138.stderr: 7fd561ddd9c0 / radosgw-admin 2024-09-14T11:37:34.338 INFO:tasks.workunit.client.0.smithi138.stderr: max_recent 500 2024-09-14T11:37:34.338 INFO:tasks.workunit.client.0.smithi138.stderr: max_new 1000 2024-09-14T11:37:34.338 INFO:tasks.workunit.client.0.smithi138.stderr: log_file /var/lib/ceph/crash/2024-09-14T11:37:34.218468Z_1983afbf-468b-43b6-82f0-5924d276d35b/log 2024-09-14T11:37:34.338 INFO:tasks.workunit.client.0.smithi138.stderr:--- end dump of recent events --- 2024-09-14T11:37:34.338 INFO:tasks.workunit.client.0.smithi138.stderr:Aborted 2024-09-14T11:37:34.338 INFO:tasks.workunit.client.0.smithi138.stderr:radosgw-admin bucket stats --bucket abort-at-do-reshard 2024-09-14T11:37:34.340 INFO:tasks.workunit.client.0.smithi138.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:37:34.340 INFO:tasks.workunit.client.0.smithi138.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:37:34.340 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:37:34.303+0000 7ff4fb5239c0 20 rados->read ofs=0 len=0 2024-09-14T11:37:34.340 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:37:34.303+0000 7ff4fb5239c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:37:34.340 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:37:34.303+0000 7ff4fb5239c0 20 realm 2024-09-14T11:37:34.340 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:37:34.303+0000 7ff4fb5239c0 20 rados->read ofs=0 len=0 2024-09-14T11:37:34.340 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:37:34.303+0000 7ff4fb5239c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:37:34.341 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:37:34.303+0000 7ff4fb5239c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:37:34.341 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:37:34.303+0000 7ff4fb5239c0 20 rados->read ofs=0 len=0 2024-09-14T11:37:34.341 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:37:34.303+0000 7ff4fb5239c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:37:34.341 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:37:34.303+0000 7ff4fb5239c0 20 rados->read ofs=0 len=0 2024-09-14T11:37:34.341 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:37:34.307+0000 7ff4fb5239c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:37:34.341 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:37:34.307+0000 7ff4fb5239c0 20 rados->read ofs=0 len=0 2024-09-14T11:37:34.341 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:37:34.307+0000 7ff4fb5239c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:37:34.341 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:37:34.307+0000 7ff4fb5239c0 20 searching for the correct realm 2024-09-14T11:37:34.341 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:37:34.311+0000 7ff4f982a640 0 -- 172.21.15.138:0/299852990 >> [v2:172.21.15.154:6824/416768175,v1:172.21.15.154:6825/416768175] conn(0x7ff4f4026040 msgr2=0x7ff4f4064690 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:37:34.341 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:37:34.319+0000 7ff4f8828640 0 -- 172.21.15.138:0/299852990 >> [v2:172.21.15.138:6816/326481658,v1:172.21.15.138:6817/326481658] conn(0x7ff4f406eec0 msgr2=0x7ff4f406e040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:37:34.534 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:37:34.535+0000 7ff4fb5239c0 20 RGWRados::pool_iterate: got zone_info.d9e72d30-c60b-4d0d-9267-fdc36392d5ad 2024-09-14T11:37:34.534 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:37:34.535+0000 7ff4fb5239c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:37:34.535 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:37:34.535+0000 7ff4fb5239c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:37:34.535 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:37:34.535+0000 7ff4fb5239c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:37:34.535 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:37:34.535+0000 7ff4fb5239c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:37:34.535 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:37:34.535+0000 7ff4fb5239c0 20 RGWRados::pool_iterate: got zonegroup_info.65ab941b-da8c-4160-94fb-3672b069d44f 2024-09-14T11:37:34.535 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:37:34.535+0000 7ff4fb5239c0 20 rados->read ofs=0 len=0 2024-09-14T11:37:34.535 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:37:34.535+0000 7ff4fb5239c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:37:34.535 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:37:34.535+0000 7ff4fb5239c0 20 rados->read ofs=0 len=0 2024-09-14T11:37:34.536 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:37:34.539+0000 7ff4fb5239c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:37:34.536 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:37:34.539+0000 7ff4fb5239c0 20 rados->read ofs=0 len=0 2024-09-14T11:37:34.537 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:37:34.539+0000 7ff4fb5239c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:37:34.537 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:37:34.539+0000 7ff4fb5239c0 20 zone default found 2024-09-14T11:37:34.537 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:37:34.539+0000 7ff4fb5239c0 4 Realm: () 2024-09-14T11:37:34.537 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:37:34.539+0000 7ff4fb5239c0 4 ZoneGroup: default (65ab941b-da8c-4160-94fb-3672b069d44f) 2024-09-14T11:37:34.537 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:37:34.539+0000 7ff4fb5239c0 4 Zone: default (d9e72d30-c60b-4d0d-9267-fdc36392d5ad) 2024-09-14T11:37:34.537 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:37:34.539+0000 7ff4fb5239c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:37:34.537 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:37:34.539+0000 7ff4fb5239c0 20 zonegroup default 2024-09-14T11:37:34.537 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:37:34.539+0000 7ff4fb5239c0 20 rados->read ofs=0 len=0 2024-09-14T11:37:34.538 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:37:34.539+0000 7ff4fb5239c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:37:34.538 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:37:34.539+0000 7ff4fb5239c0 20 rados->read ofs=0 len=0 2024-09-14T11:37:34.538 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:37:34.539+0000 7ff4fb5239c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:37:34.538 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:37:34.539+0000 7ff4fb5239c0 20 rados->read ofs=0 len=0 2024-09-14T11:37:34.539 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:37:34.539+0000 7ff4fb5239c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:37:34.539 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:37:34.539+0000 7ff4fb5239c0 20 started sync module instance, tier type = 2024-09-14T11:37:34.539 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:37:34.539+0000 7ff4fb5239c0 20 started zone id=d9e72d30-c60b-4d0d-9267-fdc36392d5ad (name=default) with tier type = 2024-09-14T11:37:34.563 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:37:34.563+0000 7ff4fb5239c0 20 add_watcher() i=0 2024-09-14T11:37:34.563 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:37:34.563+0000 7ff4fb5239c0 20 add_watcher() i=1 2024-09-14T11:37:34.563 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:37:34.563+0000 7ff4fb5239c0 20 add_watcher() i=2 2024-09-14T11:37:34.564 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:37:34.563+0000 7ff4fb5239c0 20 add_watcher() i=3 2024-09-14T11:37:34.564 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:37:34.563+0000 7ff4fb5239c0 20 add_watcher() i=4 2024-09-14T11:37:34.564 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:37:34.563+0000 7ff4fb5239c0 20 add_watcher() i=5 2024-09-14T11:37:34.564 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:37:34.563+0000 7ff4fb5239c0 20 add_watcher() i=6 2024-09-14T11:37:34.566 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:37:34.567+0000 7ff4fb5239c0 20 add_watcher() i=7 2024-09-14T11:37:34.566 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:37:34.567+0000 7ff4fb5239c0 2 all 8 watchers are set, enabling cache 2024-09-14T11:37:34.570 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:37:34.571+0000 7ff3affe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:37:34.570 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:37:34.571+0000 7ff4fb5239c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:37:34.570 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:37:34.571+0000 7ff4fb5239c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:37:34.570 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:37:34.571+0000 7ff4fb5239c0 5 note: GC not initialized 2024-09-14T11:37:34.571 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:37:34.571+0000 7ff3aefe5640 20 reqs_thread_entry: start 2024-09-14T11:37:34.571 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:37:34.571+0000 7ff4fb5239c0 20 init_complete bucket index max shards: 11 2024-09-14T11:37:34.571 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:37:34.571+0000 7ff4fb5239c0 20 Filter name: none 2024-09-14T11:37:34.571 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:37:34.571+0000 7ff3acfe1640 20 reqs_thread_entry: start 2024-09-14T11:37:34.571 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:37:34.571+0000 7ff4fb5239c0 20 rados->read ofs=0 len=0 2024-09-14T11:37:34.572 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:37:34.575+0000 7ff4fb5239c0 20 rados_obj.operate() r=0 bl.length=187 2024-09-14T11:37:34.572 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:37:34.575+0000 7ff4fb5239c0 20 rados->read ofs=0 len=0 2024-09-14T11:37:34.574 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:37:34.575+0000 7ff4fb5239c0 20 rados_obj.operate() r=0 bl.length=441 2024-09-14T11:37:34.574 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:37:34.575+0000 7ff4fb5239c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:37:34.574 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:37:34.575+0000 7ff4fb5239c0 20 rados->read ofs=0 len=0 2024-09-14T11:37:34.574 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:37:34.575+0000 7ff4fb5239c0 20 rados_obj.operate() r=0 bl.length=187 2024-09-14T11:37:34.574 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:37:34.575+0000 7ff4fb5239c0 20 rados->read ofs=0 len=0 2024-09-14T11:37:34.575 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:37:34.575+0000 7ff4fb5239c0 20 rados_obj.operate() r=0 bl.length=441 2024-09-14T11:37:34.575 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:37:34.579+0000 7ff4fb5239c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:37:34.578 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:37:34.579+0000 7ff3affe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:37:34.583 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:37:34.583+0000 7ff4fb5239c0 20 remove_watcher() i=0 2024-09-14T11:37:34.583 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:37:34.583+0000 7ff4fb5239c0 2 removed watcher, disabling cache 2024-09-14T11:37:34.585 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:37:34.587+0000 7ff4fb5239c0 20 remove_watcher() i=1 2024-09-14T11:37:34.587 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:37:34.587+0000 7ff4fb5239c0 20 remove_watcher() i=2 2024-09-14T11:37:34.589 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:37:34.591+0000 7ff4fb5239c0 20 remove_watcher() i=3 2024-09-14T11:37:34.592 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:37:34.595+0000 7ff4fb5239c0 20 remove_watcher() i=4 2024-09-14T11:37:34.594 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:37:34.595+0000 7ff4fb5239c0 20 remove_watcher() i=5 2024-09-14T11:37:34.596 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:37:34.599+0000 7ff4fb5239c0 20 remove_watcher() i=6 2024-09-14T11:37:34.597 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:37:34.599+0000 7ff4fb5239c0 20 remove_watcher() i=7 2024-09-14T11:37:34.614 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-14T11:37:34.614 INFO:tasks.workunit.client.0.smithi138.stderr:BUCKET_STATS: 2024-09-14T11:37:34.615 INFO:tasks.workunit.client.0.smithi138.stderr:bucket: abort-at-do-reshard id: d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.34 num_objects: 20 size_kb: 1 num_shards: 11 2024-09-14T11:37:34.615 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-14T11:37:34.616 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:37:34.616 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-14T11:37:34.659 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:37:34.659 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-14T11:37:34.729 INFO:tasks.workunit.client.0.smithi138.stderr:radosgw-admin bucket reshard --bucket abort-at-do-reshard --num-shards 12 --rgw-reshard-bucket-lock-duration 30 2024-09-14T11:37:34.765 INFO:tasks.workunit.client.0.smithi138.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:37:34.765 INFO:tasks.workunit.client.0.smithi138.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:37:34.812 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:37:34.815+0000 7f1cfcb509c0 20 rados->read ofs=0 len=0 2024-09-14T11:37:34.814 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:37:34.815+0000 7f1cfcb509c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:37:34.814 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:37:34.815+0000 7f1cfcb509c0 20 realm 2024-09-14T11:37:34.815 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:37:34.815+0000 7f1cfcb509c0 20 rados->read ofs=0 len=0 2024-09-14T11:37:34.815 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:37:34.815+0000 7f1cfcb509c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:37:34.815 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:37:34.815+0000 7f1cfcb509c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:37:34.815 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:37:34.815+0000 7f1cfcb509c0 20 rados->read ofs=0 len=0 2024-09-14T11:37:34.815 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:37:34.815+0000 7f1cfcb509c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:37:34.815 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:37:34.815+0000 7f1cfcb509c0 20 rados->read ofs=0 len=0 2024-09-14T11:37:34.816 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:37:34.819+0000 7f1cfcb509c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:37:34.817 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:37:34.819+0000 7f1cfcb509c0 20 rados->read ofs=0 len=0 2024-09-14T11:37:34.817 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:37:34.819+0000 7f1cfcb509c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:37:34.817 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:37:34.819+0000 7f1cfcb509c0 20 searching for the correct realm 2024-09-14T11:37:34.821 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:37:34.823+0000 7f1cfae57640 0 -- 172.21.15.138:0/2453189033 >> [v2:172.21.15.154:6824/416768175,v1:172.21.15.154:6825/416768175] conn(0x7f1cf40743a0 msgr2=0x7f1cf4067950 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:37:35.037 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:37:35.039+0000 7f1cf9e55640 0 -- 172.21.15.138:0/2453189033 >> [v2:172.21.15.138:6816/326481658,v1:172.21.15.138:6817/326481658] conn(0x7f1cf4064c00 msgr2=0x7f1cf405f410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:37:35.255 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:37:35.255+0000 7f1cfcb509c0 20 RGWRados::pool_iterate: got zone_info.d9e72d30-c60b-4d0d-9267-fdc36392d5ad 2024-09-14T11:37:35.255 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:37:35.255+0000 7f1cfcb509c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:37:35.255 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:37:35.255+0000 7f1cfcb509c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:37:35.255 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:37:35.255+0000 7f1cfcb509c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:37:35.255 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:37:35.255+0000 7f1cfcb509c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:37:35.255 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:37:35.255+0000 7f1cfcb509c0 20 RGWRados::pool_iterate: got zonegroup_info.65ab941b-da8c-4160-94fb-3672b069d44f 2024-09-14T11:37:35.255 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:37:35.255+0000 7f1cfcb509c0 20 rados->read ofs=0 len=0 2024-09-14T11:37:35.255 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:37:35.255+0000 7f1cfcb509c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:37:35.255 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:37:35.255+0000 7f1cfcb509c0 20 rados->read ofs=0 len=0 2024-09-14T11:37:35.256 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:37:35.259+0000 7f1cfcb509c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:37:35.256 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:37:35.259+0000 7f1cfcb509c0 20 rados->read ofs=0 len=0 2024-09-14T11:37:35.258 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:37:35.259+0000 7f1cfcb509c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:37:35.258 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:37:35.259+0000 7f1cfcb509c0 20 zone default found 2024-09-14T11:37:35.258 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:37:35.259+0000 7f1cfcb509c0 4 Realm: () 2024-09-14T11:37:35.258 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:37:35.259+0000 7f1cfcb509c0 4 ZoneGroup: default (65ab941b-da8c-4160-94fb-3672b069d44f) 2024-09-14T11:37:35.258 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:37:35.259+0000 7f1cfcb509c0 4 Zone: default (d9e72d30-c60b-4d0d-9267-fdc36392d5ad) 2024-09-14T11:37:35.258 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:37:35.259+0000 7f1cfcb509c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:37:35.258 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:37:35.259+0000 7f1cfcb509c0 20 zonegroup default 2024-09-14T11:37:35.258 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:37:35.259+0000 7f1cfcb509c0 20 rados->read ofs=0 len=0 2024-09-14T11:37:35.258 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:37:35.259+0000 7f1cfcb509c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:37:35.258 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:37:35.259+0000 7f1cfcb509c0 20 rados->read ofs=0 len=0 2024-09-14T11:37:35.259 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:37:35.259+0000 7f1cfcb509c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:37:35.259 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:37:35.259+0000 7f1cfcb509c0 20 rados->read ofs=0 len=0 2024-09-14T11:37:35.260 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:37:35.263+0000 7f1cfcb509c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:37:35.260 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:37:35.263+0000 7f1cfcb509c0 20 started sync module instance, tier type = 2024-09-14T11:37:35.260 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:37:35.263+0000 7f1cfcb509c0 20 started zone id=d9e72d30-c60b-4d0d-9267-fdc36392d5ad (name=default) with tier type = 2024-09-14T11:37:35.287 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:37:35.287+0000 7f1cfcb509c0 20 add_watcher() i=0 2024-09-14T11:37:35.287 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:37:35.287+0000 7f1cfcb509c0 20 add_watcher() i=1 2024-09-14T11:37:35.287 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:37:35.287+0000 7f1cfcb509c0 20 add_watcher() i=2 2024-09-14T11:37:35.287 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:37:35.287+0000 7f1cfcb509c0 20 add_watcher() i=3 2024-09-14T11:37:35.287 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:37:35.287+0000 7f1cfcb509c0 20 add_watcher() i=4 2024-09-14T11:37:35.287 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:37:35.287+0000 7f1cfcb509c0 20 add_watcher() i=5 2024-09-14T11:37:35.287 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:37:35.287+0000 7f1cfcb509c0 20 add_watcher() i=6 2024-09-14T11:37:35.289 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:37:35.291+0000 7f1cfcb509c0 20 add_watcher() i=7 2024-09-14T11:37:35.289 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:37:35.291+0000 7f1cfcb509c0 2 all 8 watchers are set, enabling cache 2024-09-14T11:37:35.293 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:37:35.295+0000 7f1bb0fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:37:35.294 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:37:35.295+0000 7f1cfcb509c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:37:35.294 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:37:35.295+0000 7f1cfcb509c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:37:35.294 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:37:35.295+0000 7f1cfcb509c0 5 note: GC not initialized 2024-09-14T11:37:35.295 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:37:35.295+0000 7f1b2b7fe640 20 reqs_thread_entry: start 2024-09-14T11:37:35.295 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:37:35.295+0000 7f1cfcb509c0 20 init_complete bucket index max shards: 11 2024-09-14T11:37:35.295 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:37:35.295+0000 7f1cfcb509c0 20 Filter name: none 2024-09-14T11:37:35.295 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:37:35.295+0000 7f1b297fa640 20 reqs_thread_entry: start 2024-09-14T11:37:35.296 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:37:35.295+0000 7f1cfcb509c0 10 cache get: name=default.rgw.meta+root+abort-at-do-reshard : miss 2024-09-14T11:37:35.296 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:37:35.295+0000 7f1cfcb509c0 20 rados->read ofs=0 len=0 2024-09-14T11:37:35.297 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:37:35.299+0000 7f1cfcb509c0 20 rados_obj.operate() r=0 bl.length=187 2024-09-14T11:37:35.297 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:37:35.299+0000 7f1cfcb509c0 10 cache put: name=default.rgw.meta+root+abort-at-do-reshard info.flags=0x11 2024-09-14T11:37:35.297 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:37:35.299+0000 7f1cfcb509c0 10 adding default.rgw.meta+root+abort-at-do-reshard to cache LRU end 2024-09-14T11:37:35.297 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:37:35.299+0000 7f1cfcb509c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.34 : miss 2024-09-14T11:37:35.297 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:37:35.299+0000 7f1cfcb509c0 20 rados->read ofs=0 len=0 2024-09-14T11:37:35.298 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:37:35.299+0000 7f1cfcb509c0 20 rados_obj.operate() r=0 bl.length=441 2024-09-14T11:37:35.298 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:37:35.299+0000 7f1cfcb509c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.34 info.flags=0x17 2024-09-14T11:37:35.298 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:37:35.299+0000 7f1cfcb509c0 10 adding default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.34 to cache LRU end 2024-09-14T11:37:35.298 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:37:35.299+0000 7f1cfcb509c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:37:35.298 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:37:35.299+0000 7f1cfcb509c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:37:35.298 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:37:35.299+0000 7f1cfcb509c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.34 2024-09-14T11:37:35.299 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:37:35.303+0000 7f1cfcb509c0 0 INFO: RGWReshardLock::lock found lock on abort-at-do-reshard:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.34 to be held by another RGW process; skipping for now 2024-09-14T11:37:35.301 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:37:35.303+0000 7f1bb0fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:37:35.306 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:37:35.307+0000 7f1cfcb509c0 20 remove_watcher() i=0 2024-09-14T11:37:35.306 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:37:35.307+0000 7f1cfcb509c0 2 removed watcher, disabling cache 2024-09-14T11:37:35.308 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:37:35.311+0000 7f1cfcb509c0 20 remove_watcher() i=1 2024-09-14T11:37:35.310 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:37:35.311+0000 7f1cfcb509c0 20 remove_watcher() i=2 2024-09-14T11:37:35.312 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:37:35.315+0000 7f1cfcb509c0 20 remove_watcher() i=3 2024-09-14T11:37:35.315 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:37:35.315+0000 7f1cfcb509c0 20 remove_watcher() i=4 2024-09-14T11:37:35.316 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:37:35.319+0000 7f1cfcb509c0 20 remove_watcher() i=5 2024-09-14T11:37:35.318 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:37:35.319+0000 7f1cfcb509c0 20 remove_watcher() i=6 2024-09-14T11:37:35.319 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:37:35.319+0000 7f1cfcb509c0 20 remove_watcher() i=7 2024-09-14T11:37:35.335 INFO:tasks.workunit.client.0.smithi138.stderr:waiting 30 seconds for reshard lock to expire... 2024-09-14T11:38:05.365 INFO:tasks.workunit.client.0.smithi138.stderr:radosgw-admin bucket reshard --bucket abort-at-do-reshard --num-shards 12 --rgw-reshard-bucket-lock-duration 30 2024-09-14T11:38:05.401 INFO:tasks.workunit.client.0.smithi138.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:38:05.401 INFO:tasks.workunit.client.0.smithi138.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:38:05.446 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:05.447+0000 7f1f8877a9c0 20 rados->read ofs=0 len=0 2024-09-14T11:38:05.448 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:05.451+0000 7f1f8877a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:38:05.448 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:05.451+0000 7f1f8877a9c0 20 realm 2024-09-14T11:38:05.448 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:05.451+0000 7f1f8877a9c0 20 rados->read ofs=0 len=0 2024-09-14T11:38:05.448 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:05.451+0000 7f1f8877a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:38:05.448 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:05.451+0000 7f1f8877a9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:38:05.448 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:05.451+0000 7f1f8877a9c0 20 rados->read ofs=0 len=0 2024-09-14T11:38:05.448 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:05.451+0000 7f1f8877a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:38:05.448 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:05.451+0000 7f1f8877a9c0 20 rados->read ofs=0 len=0 2024-09-14T11:38:05.450 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:05.451+0000 7f1f8877a9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:38:05.450 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:05.451+0000 7f1f8877a9c0 20 rados->read ofs=0 len=0 2024-09-14T11:38:05.451 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:05.451+0000 7f1f8877a9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:38:05.451 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:05.451+0000 7f1f8877a9c0 20 searching for the correct realm 2024-09-14T11:38:05.455 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:05.455+0000 7f1f86a81640 0 -- 172.21.15.138:0/6469570 >> [v2:172.21.15.154:6824/416768175,v1:172.21.15.154:6825/416768175] conn(0x7f1f80008040 msgr2=0x7f1f8002e930 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:38:05.461 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:05.463+0000 7f1f85a7f640 0 -- 172.21.15.138:0/6469570 >> [v2:172.21.15.138:6816/326481658,v1:172.21.15.138:6817/326481658] conn(0x7f1f80021910 msgr2=0x7f1f800073b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-14T11:38:05.678 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:05.679+0000 7f1f8877a9c0 20 RGWRados::pool_iterate: got zone_info.d9e72d30-c60b-4d0d-9267-fdc36392d5ad 2024-09-14T11:38:05.678 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:05.679+0000 7f1f8877a9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:38:05.678 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:05.679+0000 7f1f8877a9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:38:05.678 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:05.679+0000 7f1f8877a9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:38:05.679 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:05.679+0000 7f1f8877a9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:38:05.679 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:05.679+0000 7f1f8877a9c0 20 RGWRados::pool_iterate: got zonegroup_info.65ab941b-da8c-4160-94fb-3672b069d44f 2024-09-14T11:38:05.679 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:05.679+0000 7f1f8877a9c0 20 rados->read ofs=0 len=0 2024-09-14T11:38:05.679 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:05.679+0000 7f1f8877a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:38:05.679 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:05.679+0000 7f1f8877a9c0 20 rados->read ofs=0 len=0 2024-09-14T11:38:05.679 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:05.683+0000 7f1f8877a9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:38:05.680 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:05.683+0000 7f1f8877a9c0 20 rados->read ofs=0 len=0 2024-09-14T11:38:05.681 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:05.683+0000 7f1f8877a9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:38:05.681 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:05.683+0000 7f1f8877a9c0 20 zone default found 2024-09-14T11:38:05.681 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:05.683+0000 7f1f8877a9c0 4 Realm: () 2024-09-14T11:38:05.681 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:05.683+0000 7f1f8877a9c0 4 ZoneGroup: default (65ab941b-da8c-4160-94fb-3672b069d44f) 2024-09-14T11:38:05.681 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:05.683+0000 7f1f8877a9c0 4 Zone: default (d9e72d30-c60b-4d0d-9267-fdc36392d5ad) 2024-09-14T11:38:05.681 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:05.683+0000 7f1f8877a9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:38:05.681 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:05.683+0000 7f1f8877a9c0 20 zonegroup default 2024-09-14T11:38:05.681 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:05.683+0000 7f1f8877a9c0 20 rados->read ofs=0 len=0 2024-09-14T11:38:05.682 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:05.683+0000 7f1f8877a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:38:05.682 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:05.683+0000 7f1f8877a9c0 20 rados->read ofs=0 len=0 2024-09-14T11:38:05.682 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:05.683+0000 7f1f8877a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:38:05.682 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:05.683+0000 7f1f8877a9c0 20 rados->read ofs=0 len=0 2024-09-14T11:38:05.683 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:05.683+0000 7f1f8877a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:38:05.683 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:05.683+0000 7f1f8877a9c0 20 started sync module instance, tier type = 2024-09-14T11:38:05.683 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:05.683+0000 7f1f8877a9c0 20 started zone id=d9e72d30-c60b-4d0d-9267-fdc36392d5ad (name=default) with tier type = 2024-09-14T11:38:05.716 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:05.719+0000 7f1f8877a9c0 20 add_watcher() i=0 2024-09-14T11:38:05.716 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:05.719+0000 7f1f8877a9c0 20 add_watcher() i=1 2024-09-14T11:38:05.717 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:05.719+0000 7f1f8877a9c0 20 add_watcher() i=2 2024-09-14T11:38:05.717 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:05.719+0000 7f1f8877a9c0 20 add_watcher() i=3 2024-09-14T11:38:05.717 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:05.719+0000 7f1f8877a9c0 20 add_watcher() i=4 2024-09-14T11:38:05.717 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:05.719+0000 7f1f8877a9c0 20 add_watcher() i=5 2024-09-14T11:38:05.717 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:05.719+0000 7f1f8877a9c0 20 add_watcher() i=6 2024-09-14T11:38:05.719 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:05.719+0000 7f1f8877a9c0 20 add_watcher() i=7 2024-09-14T11:38:05.719 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:05.719+0000 7f1f8877a9c0 2 all 8 watchers are set, enabling cache 2024-09-14T11:38:05.723 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:05.723+0000 7f1e3cfe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:38:05.724 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:05.727+0000 7f1f8877a9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:38:05.724 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:05.727+0000 7f1f8877a9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:38:05.724 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:05.727+0000 7f1f8877a9c0 5 note: GC not initialized 2024-09-14T11:38:05.724 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:05.727+0000 7f1db77fe640 20 reqs_thread_entry: start 2024-09-14T11:38:05.725 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:05.727+0000 7f1f8877a9c0 20 init_complete bucket index max shards: 11 2024-09-14T11:38:05.725 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:05.727+0000 7f1f8877a9c0 20 Filter name: none 2024-09-14T11:38:05.725 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:05.727+0000 7f1db57fa640 20 reqs_thread_entry: start 2024-09-14T11:38:05.725 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:05.727+0000 7f1f8877a9c0 10 cache get: name=default.rgw.meta+root+abort-at-do-reshard : miss 2024-09-14T11:38:05.725 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:05.727+0000 7f1f8877a9c0 20 rados->read ofs=0 len=0 2024-09-14T11:38:05.726 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:05.727+0000 7f1f8877a9c0 20 rados_obj.operate() r=0 bl.length=187 2024-09-14T11:38:05.726 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:05.727+0000 7f1f8877a9c0 10 cache put: name=default.rgw.meta+root+abort-at-do-reshard info.flags=0x11 2024-09-14T11:38:05.726 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:05.727+0000 7f1f8877a9c0 10 adding default.rgw.meta+root+abort-at-do-reshard to cache LRU end 2024-09-14T11:38:05.726 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:05.727+0000 7f1f8877a9c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.34 : miss 2024-09-14T11:38:05.726 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:05.727+0000 7f1f8877a9c0 20 rados->read ofs=0 len=0 2024-09-14T11:38:05.727 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:05.727+0000 7f1f8877a9c0 20 rados_obj.operate() r=0 bl.length=441 2024-09-14T11:38:05.727 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:05.727+0000 7f1f8877a9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.34 info.flags=0x17 2024-09-14T11:38:05.727 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:05.727+0000 7f1f8877a9c0 10 adding default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.34 to cache LRU end 2024-09-14T11:38:05.727 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:05.727+0000 7f1f8877a9c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:38:05.728 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:05.727+0000 7f1f8877a9c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:38:05.728 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:05.727+0000 7f1f8877a9c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.34 2024-09-14T11:38:05.730 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:05.731+0000 7f1f8877a9c0 10 init_target_layout removing existing target index objects from a previous reshard attempt 2024-09-14T11:38:05.745 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:05.747+0000 7f1f8877a9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.34 info.flags=0x17 2024-09-14T11:38:05.745 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:05.747+0000 7f1f8877a9c0 10 moving default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.34 to cache LRU end 2024-09-14T11:38:05.745 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:05.747+0000 7f1f8877a9c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:38:05.745 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:05.747+0000 7f1f8877a9c0 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-do-reshard:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.34, ofs0, ns] 2024-09-14T11:38:05.746 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:05.747+0000 7f1e697fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366216 cookie 94026505815040 notifier 7016 bl.length()=911 2024-09-14T11:38:05.746 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:05.747+0000 7f1e697fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.34 info.flags=0x17 2024-09-14T11:38:05.746 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:05.747+0000 7f1e697fa640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.34 to cache LRU end 2024-09-14T11:38:05.746 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:05.747+0000 7f1e697fa640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:38:05.748 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:05.751+0000 7f1f8877a9c0 20 handle_bi_update(): bucket=:abort-at-do-reshard[d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.34]): orig_sources= new_sources= 2024-09-14T11:38:05.748 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:05.751+0000 7f1f8877a9c0 20 handle_bi_update(): bucket=:abort-at-do-reshard[d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.34]): potential sources added=[] removed=[] 2024-09-14T11:38:05.748 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:05.751+0000 7f1f8877a9c0 20 handle_bi_update(): bucket=:abort-at-do-reshard[d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.34]): orig_dests= new_dests= 2024-09-14T11:38:05.748 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:05.751+0000 7f1f8877a9c0 20 handle_bi_update(): bucket=:abort-at-do-reshard[d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.34]): potential dests added=[] removed=[] 2024-09-14T11:38:05.762 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:05.763+0000 7f1f8877a9c0 10 bucket_obj is .dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.34.2.0 2024-09-14T11:38:05.762 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:05.763+0000 7f1f8877a9c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.34.2.0 2024-09-14T11:38:05.762 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:05.763+0000 7f1f8877a9c0 10 bucket_obj is .dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.34.2.1 2024-09-14T11:38:05.762 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:05.763+0000 7f1f8877a9c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.34.2.1 2024-09-14T11:38:05.762 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:05.763+0000 7f1f8877a9c0 10 bucket_obj is .dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.34.2.2 2024-09-14T11:38:05.762 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:05.763+0000 7f1f8877a9c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.34.2.2 2024-09-14T11:38:05.762 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:05.763+0000 7f1f8877a9c0 10 bucket_obj is .dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.34.2.3 2024-09-14T11:38:05.763 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:05.763+0000 7f1f8877a9c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.34.2.3 2024-09-14T11:38:05.763 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:05.763+0000 7f1f8877a9c0 10 bucket_obj is .dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.34.2.4 2024-09-14T11:38:05.763 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:05.763+0000 7f1f8877a9c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.34.2.4 2024-09-14T11:38:05.763 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:05.763+0000 7f1f8877a9c0 10 bucket_obj is .dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.34.2.5 2024-09-14T11:38:05.763 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:05.763+0000 7f1f8877a9c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.34.2.5 2024-09-14T11:38:05.763 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:05.763+0000 7f1f8877a9c0 10 bucket_obj is .dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.34.2.6 2024-09-14T11:38:05.763 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:05.763+0000 7f1f8877a9c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.34.2.6 2024-09-14T11:38:05.763 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:05.763+0000 7f1f8877a9c0 10 bucket_obj is .dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.34.2.7 2024-09-14T11:38:05.763 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:05.763+0000 7f1f8877a9c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.34.2.7 2024-09-14T11:38:05.763 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:05.763+0000 7f1f8877a9c0 10 bucket_obj is .dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.34.2.8 2024-09-14T11:38:05.763 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:05.763+0000 7f1f8877a9c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.34.2.8 2024-09-14T11:38:05.763 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:05.763+0000 7f1f8877a9c0 10 bucket_obj is .dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.34.2.9 2024-09-14T11:38:05.763 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:05.763+0000 7f1f8877a9c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.34.2.9 2024-09-14T11:38:05.763 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:05.763+0000 7f1f8877a9c0 10 bucket_obj is .dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.34.2.10 2024-09-14T11:38:05.763 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:05.763+0000 7f1f8877a9c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.34.2.10 2024-09-14T11:38:05.764 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:05.763+0000 7f1f8877a9c0 10 bucket_obj is .dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.34.2.11 2024-09-14T11:38:05.764 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:05.763+0000 7f1f8877a9c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.34.2.11 2024-09-14T11:38:05.764 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:05.763+0000 7f1f8877a9c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.34.0 2024-09-14T11:38:05.764 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:05.763+0000 7f1f8877a9c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.34.1 2024-09-14T11:38:05.764 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:05.763+0000 7f1f8877a9c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.34.2 2024-09-14T11:38:05.764 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:05.767+0000 7f1f8877a9c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.34.3 2024-09-14T11:38:05.765 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:05.767+0000 7f1f8877a9c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.34.4 2024-09-14T11:38:05.766 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:05.767+0000 7f1f8877a9c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.34.5 2024-09-14T11:38:05.768 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:05.771+0000 7f1f8877a9c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.34.6 2024-09-14T11:38:05.769 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:05.771+0000 7f1f8877a9c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.34.7 2024-09-14T11:38:05.769 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:05.771+0000 7f1f8877a9c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.34.8 2024-09-14T11:38:05.770 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:05.771+0000 7f1f8877a9c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.34.9 2024-09-14T11:38:05.772 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:05.775+0000 7f1f8877a9c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.34.10 2024-09-14T11:38:05.778 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:05.779+0000 7f1f8877a9c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.34 : hit (requested=0x17, cached=0x17) 2024-09-14T11:38:05.778 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:05.779+0000 7f1f8877a9c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.34 2024-09-14T11:38:05.781 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:05.783+0000 7f1f8877a9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.34 info.flags=0x17 2024-09-14T11:38:05.781 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:05.783+0000 7f1f8877a9c0 10 moving default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.34 to cache LRU end 2024-09-14T11:38:05.781 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:05.783+0000 7f1f8877a9c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:38:05.781 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:05.783+0000 7f1f8877a9c0 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-do-reshard:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.34, ofs0, ns] 2024-09-14T11:38:05.782 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:05.783+0000 7f1e69ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366217 cookie 94026505815040 notifier 7016 bl.length()=911 2024-09-14T11:38:05.782 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:05.783+0000 7f1e69ffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.34 info.flags=0x17 2024-09-14T11:38:05.782 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:05.783+0000 7f1e69ffb640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.34 to cache LRU end 2024-09-14T11:38:05.782 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:05.783+0000 7f1e69ffb640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:38:05.786 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:05.787+0000 7f1f8877a9c0 20 handle_bi_update(): bucket=:abort-at-do-reshard[d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.34]): orig_sources= new_sources= 2024-09-14T11:38:05.786 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:05.787+0000 7f1f8877a9c0 20 handle_bi_update(): bucket=:abort-at-do-reshard[d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.34]): potential sources added=[] removed=[] 2024-09-14T11:38:05.786 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:05.787+0000 7f1f8877a9c0 20 handle_bi_update(): bucket=:abort-at-do-reshard[d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.34]): orig_dests= new_dests= 2024-09-14T11:38:05.786 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:05.787+0000 7f1f8877a9c0 20 handle_bi_update(): bucket=:abort-at-do-reshard[d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.34]): potential dests added=[] removed=[] 2024-09-14T11:38:05.792 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:05.795+0000 7f1f8877a9c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.34.0 2024-09-14T11:38:05.792 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:05.795+0000 7f1f8877a9c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.34.1 2024-09-14T11:38:05.793 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:05.795+0000 7f1f8877a9c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.34.2 2024-09-14T11:38:05.794 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:05.795+0000 7f1f8877a9c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.34.3 2024-09-14T11:38:05.795 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:05.795+0000 7f1f8877a9c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.34.4 2024-09-14T11:38:05.796 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:05.799+0000 7f1f8877a9c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.34.5 2024-09-14T11:38:05.797 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:05.799+0000 7f1f8877a9c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.34.6 2024-09-14T11:38:05.797 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:05.799+0000 7f1f8877a9c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.34.7 2024-09-14T11:38:05.798 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:05.799+0000 7f1f8877a9c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.34.8 2024-09-14T11:38:05.798 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:05.799+0000 7f1f8877a9c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.34.9 2024-09-14T11:38:05.799 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:05.803+0000 7f1f8877a9c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.34.10 2024-09-14T11:38:05.800 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:05.803+0000 7f1f8877a9c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.34 : hit (requested=0x17, cached=0x17) 2024-09-14T11:38:05.800 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:05.803+0000 7f1f8877a9c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.34 2024-09-14T11:38:05.803 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:05.803+0000 7f1f8877a9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.34 info.flags=0x17 2024-09-14T11:38:05.803 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:05.803+0000 7f1f8877a9c0 10 moving default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.34 to cache LRU end 2024-09-14T11:38:05.803 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:05.803+0000 7f1f8877a9c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:38:05.803 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:05.803+0000 7f1f8877a9c0 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-do-reshard:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.34, ofs0, ns] 2024-09-14T11:38:05.804 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:05.807+0000 7f1e69ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366218 cookie 94026505815040 notifier 7016 bl.length()=879 2024-09-14T11:38:05.804 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:05.807+0000 7f1e69ffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.34 info.flags=0x17 2024-09-14T11:38:05.804 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:05.807+0000 7f1e69ffb640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.34 to cache LRU end 2024-09-14T11:38:05.804 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:05.807+0000 7f1e69ffb640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:38:05.808 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:05.807+0000 7f1f8877a9c0 20 handle_bi_update(): bucket=:abort-at-do-reshard[d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.34]): orig_sources= new_sources= 2024-09-14T11:38:05.808 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:05.807+0000 7f1f8877a9c0 20 handle_bi_update(): bucket=:abort-at-do-reshard[d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.34]): potential sources added=[] removed=[] 2024-09-14T11:38:05.808 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:05.807+0000 7f1f8877a9c0 20 handle_bi_update(): bucket=:abort-at-do-reshard[d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.34]): orig_dests= new_dests= 2024-09-14T11:38:05.808 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:05.807+0000 7f1f8877a9c0 20 handle_bi_update(): bucket=:abort-at-do-reshard[d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.34]): potential dests added=[] removed=[] 2024-09-14T11:38:05.813 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:05.815+0000 7f1f8877a9c0 1 execute INFO: reshard of bucket "abort-at-do-reshard" from 11 shards to 12 shards completed successfully 2024-09-14T11:38:05.817 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:05.819+0000 7f1e3cfe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:38:05.822 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:05.823+0000 7f1f8877a9c0 20 remove_watcher() i=0 2024-09-14T11:38:05.822 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:05.823+0000 7f1f8877a9c0 2 removed watcher, disabling cache 2024-09-14T11:38:05.824 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:05.827+0000 7f1f8877a9c0 20 remove_watcher() i=1 2024-09-14T11:38:05.826 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:05.827+0000 7f1f8877a9c0 20 remove_watcher() i=2 2024-09-14T11:38:05.828 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:05.831+0000 7f1f8877a9c0 20 remove_watcher() i=3 2024-09-14T11:38:05.831 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:05.831+0000 7f1f8877a9c0 20 remove_watcher() i=4 2024-09-14T11:38:05.833 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:05.835+0000 7f1f8877a9c0 20 remove_watcher() i=5 2024-09-14T11:38:05.834 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:05.835+0000 7f1f8877a9c0 20 remove_watcher() i=6 2024-09-14T11:38:05.836 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:05.839+0000 7f1f8877a9c0 20 remove_watcher() i=7 2024-09-14T11:38:05.855 INFO:tasks.workunit.client.0.smithi138.stderr:radosgw-admin bucket stats --bucket abort-at-do-reshard 2024-09-14T11:38:05.886 INFO:tasks.workunit.client.0.smithi138.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:38:05.886 INFO:tasks.workunit.client.0.smithi138.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:38:05.931 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:05.931+0000 7fb4455d39c0 20 rados->read ofs=0 len=0 2024-09-14T11:38:05.933 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:05.935+0000 7fb4455d39c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:38:05.933 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:05.935+0000 7fb4455d39c0 20 realm 2024-09-14T11:38:05.933 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:05.935+0000 7fb4455d39c0 20 rados->read ofs=0 len=0 2024-09-14T11:38:05.934 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:05.935+0000 7fb4455d39c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:38:05.934 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:05.935+0000 7fb4455d39c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:38:05.934 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:05.935+0000 7fb4455d39c0 20 rados->read ofs=0 len=0 2024-09-14T11:38:05.934 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:05.935+0000 7fb4455d39c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:38:05.934 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:05.935+0000 7fb4455d39c0 20 rados->read ofs=0 len=0 2024-09-14T11:38:05.935 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:05.935+0000 7fb4455d39c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:38:05.935 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:05.935+0000 7fb4455d39c0 20 rados->read ofs=0 len=0 2024-09-14T11:38:05.936 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:05.939+0000 7fb4455d39c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:38:05.936 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:05.939+0000 7fb4455d39c0 20 searching for the correct realm 2024-09-14T11:38:05.938 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:05.939+0000 7fb4428d8640 0 -- 172.21.15.138:0/63600980 >> [v2:172.21.15.154:6808/1468088432,v1:172.21.15.154:6809/1468088432] conn(0x7fb438008050 msgr2=0x7fb4380233f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:38:06.152 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:06.155+0000 7fb4438da640 0 -- 172.21.15.138:0/63600980 >> [v2:172.21.15.138:6824/2633984942,v1:172.21.15.138:6825/2633984942] conn(0x55c0fc01edc0 msgr2=0x55c0fc0211b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:38:06.169 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:06.171+0000 7fb4455d39c0 20 RGWRados::pool_iterate: got zone_info.d9e72d30-c60b-4d0d-9267-fdc36392d5ad 2024-09-14T11:38:06.169 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:06.171+0000 7fb4455d39c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:38:06.169 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:06.171+0000 7fb4455d39c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:38:06.169 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:06.171+0000 7fb4455d39c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:38:06.169 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:06.171+0000 7fb4455d39c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:38:06.169 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:06.171+0000 7fb4455d39c0 20 RGWRados::pool_iterate: got zonegroup_info.65ab941b-da8c-4160-94fb-3672b069d44f 2024-09-14T11:38:06.170 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:06.171+0000 7fb4455d39c0 20 rados->read ofs=0 len=0 2024-09-14T11:38:06.170 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:06.171+0000 7fb4455d39c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:38:06.170 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:06.171+0000 7fb4455d39c0 20 rados->read ofs=0 len=0 2024-09-14T11:38:06.171 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:06.171+0000 7fb4455d39c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:38:06.171 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:06.171+0000 7fb4455d39c0 20 rados->read ofs=0 len=0 2024-09-14T11:38:06.172 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:06.175+0000 7fb4455d39c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:38:06.172 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:06.175+0000 7fb4455d39c0 20 zone default found 2024-09-14T11:38:06.172 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:06.175+0000 7fb4455d39c0 4 Realm: () 2024-09-14T11:38:06.172 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:06.175+0000 7fb4455d39c0 4 ZoneGroup: default (65ab941b-da8c-4160-94fb-3672b069d44f) 2024-09-14T11:38:06.172 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:06.175+0000 7fb4455d39c0 4 Zone: default (d9e72d30-c60b-4d0d-9267-fdc36392d5ad) 2024-09-14T11:38:06.172 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:06.175+0000 7fb4455d39c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:38:06.172 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:06.175+0000 7fb4455d39c0 20 zonegroup default 2024-09-14T11:38:06.172 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:06.175+0000 7fb4455d39c0 20 rados->read ofs=0 len=0 2024-09-14T11:38:06.173 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:06.175+0000 7fb4455d39c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:38:06.173 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:06.175+0000 7fb4455d39c0 20 rados->read ofs=0 len=0 2024-09-14T11:38:06.173 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:06.175+0000 7fb4455d39c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:38:06.173 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:06.175+0000 7fb4455d39c0 20 rados->read ofs=0 len=0 2024-09-14T11:38:06.174 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:06.175+0000 7fb4455d39c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:38:06.174 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:06.175+0000 7fb4455d39c0 20 started sync module instance, tier type = 2024-09-14T11:38:06.174 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:06.175+0000 7fb4455d39c0 20 started zone id=d9e72d30-c60b-4d0d-9267-fdc36392d5ad (name=default) with tier type = 2024-09-14T11:38:06.196 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:06.199+0000 7fb4455d39c0 20 add_watcher() i=0 2024-09-14T11:38:06.196 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:06.199+0000 7fb4455d39c0 20 add_watcher() i=1 2024-09-14T11:38:06.197 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:06.199+0000 7fb4455d39c0 20 add_watcher() i=2 2024-09-14T11:38:06.197 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:06.199+0000 7fb4455d39c0 20 add_watcher() i=3 2024-09-14T11:38:06.197 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:06.199+0000 7fb4455d39c0 20 add_watcher() i=4 2024-09-14T11:38:06.197 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:06.199+0000 7fb4455d39c0 20 add_watcher() i=5 2024-09-14T11:38:06.197 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:06.199+0000 7fb4455d39c0 20 add_watcher() i=6 2024-09-14T11:38:06.199 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:06.199+0000 7fb4455d39c0 20 add_watcher() i=7 2024-09-14T11:38:06.199 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:06.199+0000 7fb4455d39c0 2 all 8 watchers are set, enabling cache 2024-09-14T11:38:06.203 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:06.203+0000 7fb2f9fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:38:06.204 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:06.207+0000 7fb4455d39c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:38:06.204 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:06.207+0000 7fb4455d39c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:38:06.204 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:06.207+0000 7fb4455d39c0 5 note: GC not initialized 2024-09-14T11:38:06.205 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:06.207+0000 7fb2f8fe1640 20 reqs_thread_entry: start 2024-09-14T11:38:06.205 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:06.207+0000 7fb4455d39c0 20 init_complete bucket index max shards: 11 2024-09-14T11:38:06.205 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:06.207+0000 7fb4455d39c0 20 Filter name: none 2024-09-14T11:38:06.205 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:06.207+0000 7fb2727fc640 20 reqs_thread_entry: start 2024-09-14T11:38:06.205 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:06.207+0000 7fb4455d39c0 20 rados->read ofs=0 len=0 2024-09-14T11:38:06.206 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:06.207+0000 7fb4455d39c0 20 rados_obj.operate() r=0 bl.length=187 2024-09-14T11:38:06.206 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:06.207+0000 7fb4455d39c0 20 rados->read ofs=0 len=0 2024-09-14T11:38:06.208 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:06.211+0000 7fb4455d39c0 20 rados_obj.operate() r=0 bl.length=409 2024-09-14T11:38:06.208 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:06.211+0000 7fb4455d39c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:38:06.208 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:06.211+0000 7fb4455d39c0 20 rados->read ofs=0 len=0 2024-09-14T11:38:06.209 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:06.211+0000 7fb4455d39c0 20 rados_obj.operate() r=0 bl.length=187 2024-09-14T11:38:06.209 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:06.211+0000 7fb4455d39c0 20 rados->read ofs=0 len=0 2024-09-14T11:38:06.210 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:06.211+0000 7fb4455d39c0 20 rados_obj.operate() r=0 bl.length=409 2024-09-14T11:38:06.210 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:06.211+0000 7fb4455d39c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:38:06.213 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:06.215+0000 7fb2f9fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:38:06.218 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:06.219+0000 7fb4455d39c0 20 remove_watcher() i=0 2024-09-14T11:38:06.218 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:06.219+0000 7fb4455d39c0 2 removed watcher, disabling cache 2024-09-14T11:38:06.220 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:06.223+0000 7fb4455d39c0 20 remove_watcher() i=1 2024-09-14T11:38:06.223 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:06.223+0000 7fb4455d39c0 20 remove_watcher() i=2 2024-09-14T11:38:06.225 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:06.227+0000 7fb4455d39c0 20 remove_watcher() i=3 2024-09-14T11:38:06.227 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:06.227+0000 7fb4455d39c0 20 remove_watcher() i=4 2024-09-14T11:38:06.228 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:06.231+0000 7fb4455d39c0 20 remove_watcher() i=5 2024-09-14T11:38:06.230 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:06.231+0000 7fb4455d39c0 20 remove_watcher() i=6 2024-09-14T11:38:06.232 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:06.235+0000 7fb4455d39c0 20 remove_watcher() i=7 2024-09-14T11:38:06.247 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-14T11:38:06.247 INFO:tasks.workunit.client.0.smithi138.stderr:BUCKET_STATS: 2024-09-14T11:38:06.247 INFO:tasks.workunit.client.0.smithi138.stderr:bucket: abort-at-do-reshard id: d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.34 num_objects: 19 size_kb: 1 num_shards: 12 2024-09-14T11:38:06.247 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-14T11:38:06.248 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:38:06.248 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-14T11:38:06.277 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:38:06.277 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-14T11:38:06.777 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:38:06.777 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-14T11:38:07.159 INFO:tasks.workunit.client.0.smithi138.stderr:TEST: reshard bucket with EIO injected at logrecord_writes 2024-09-14T11:38:07.159 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-14T11:38:07.162 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:38:07.162 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-14T11:38:07.298 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:38:07.298 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-14T11:38:07.388 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:38:07.388 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-14T11:38:07.496 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:38:07.496 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-14T11:38:07.581 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:38:07.581 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-14T11:38:07.663 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:38:07.663 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-14T11:38:07.762 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:38:07.762 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-14T11:38:07.850 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:38:07.850 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-14T11:38:07.938 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:38:07.938 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-14T11:38:08.026 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:38:08.026 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-14T11:38:08.116 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:38:08.116 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-14T11:38:08.206 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:38:08.206 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-14T11:38:08.297 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:38:08.297 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-14T11:38:08.384 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:38:08.384 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-14T11:38:08.479 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:38:08.479 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-14T11:38:08.572 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:38:08.572 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-14T11:38:08.664 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:38:08.664 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-14T11:38:08.760 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:38:08.760 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-14T11:38:08.852 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:38:08.852 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-14T11:38:08.944 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:38:08.944 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-14T11:38:09.039 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:38:09.039 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-14T11:38:09.136 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:38:09.136 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-14T11:38:09.225 INFO:tasks.workunit.client.0.smithi138.stderr:radosgw-admin bucket stats --bucket error-at-logrecord-writes 2024-09-14T11:38:09.257 INFO:tasks.workunit.client.0.smithi138.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:38:09.257 INFO:tasks.workunit.client.0.smithi138.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:38:09.303 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:09.303+0000 7ff5c27e79c0 20 rados->read ofs=0 len=0 2024-09-14T11:38:09.305 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:09.307+0000 7ff5c27e79c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:38:09.306 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:09.307+0000 7ff5c27e79c0 20 realm 2024-09-14T11:38:09.306 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:09.307+0000 7ff5c27e79c0 20 rados->read ofs=0 len=0 2024-09-14T11:38:09.306 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:09.307+0000 7ff5c27e79c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:38:09.306 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:09.307+0000 7ff5c27e79c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:38:09.306 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:09.307+0000 7ff5c27e79c0 20 rados->read ofs=0 len=0 2024-09-14T11:38:09.306 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:09.307+0000 7ff5c27e79c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:38:09.306 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:09.307+0000 7ff5c27e79c0 20 rados->read ofs=0 len=0 2024-09-14T11:38:09.307 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:09.307+0000 7ff5c27e79c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:38:09.307 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:09.307+0000 7ff5c27e79c0 20 rados->read ofs=0 len=0 2024-09-14T11:38:09.308 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:09.311+0000 7ff5c27e79c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:38:09.308 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:09.311+0000 7ff5c27e79c0 20 searching for the correct realm 2024-09-14T11:38:09.311 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:09.311+0000 7ff5c0aee640 0 -- 172.21.15.138:0/2118509434 >> [v2:172.21.15.154:6824/416768175,v1:172.21.15.154:6825/416768175] conn(0x7ff5b8107560 msgr2=0x7ff5b8106f30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:38:09.529 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:09.531+0000 7ff5bfaec640 0 -- 172.21.15.138:0/2118509434 >> [v2:172.21.15.138:6816/326481658,v1:172.21.15.138:6817/326481658] conn(0x7ff5b80ce6f0 msgr2=0x7ff5b81020d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-14T11:38:09.747 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:09.747+0000 7ff5c27e79c0 20 RGWRados::pool_iterate: got zone_info.d9e72d30-c60b-4d0d-9267-fdc36392d5ad 2024-09-14T11:38:09.747 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:09.747+0000 7ff5c27e79c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:38:09.747 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:09.747+0000 7ff5c27e79c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:38:09.747 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:09.747+0000 7ff5c27e79c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:38:09.747 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:09.747+0000 7ff5c27e79c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:38:09.748 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:09.747+0000 7ff5c27e79c0 20 RGWRados::pool_iterate: got zonegroup_info.65ab941b-da8c-4160-94fb-3672b069d44f 2024-09-14T11:38:09.748 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:09.747+0000 7ff5c27e79c0 20 rados->read ofs=0 len=0 2024-09-14T11:38:09.748 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:09.747+0000 7ff5c27e79c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:38:09.748 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:09.747+0000 7ff5c27e79c0 20 rados->read ofs=0 len=0 2024-09-14T11:38:09.748 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:09.751+0000 7ff5c27e79c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:38:09.749 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:09.751+0000 7ff5c27e79c0 20 rados->read ofs=0 len=0 2024-09-14T11:38:09.749 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:09.751+0000 7ff5c27e79c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:38:09.749 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:09.751+0000 7ff5c27e79c0 20 zone default found 2024-09-14T11:38:09.749 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:09.751+0000 7ff5c27e79c0 4 Realm: () 2024-09-14T11:38:09.749 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:09.751+0000 7ff5c27e79c0 4 ZoneGroup: default (65ab941b-da8c-4160-94fb-3672b069d44f) 2024-09-14T11:38:09.749 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:09.751+0000 7ff5c27e79c0 4 Zone: default (d9e72d30-c60b-4d0d-9267-fdc36392d5ad) 2024-09-14T11:38:09.750 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:09.751+0000 7ff5c27e79c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:38:09.750 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:09.751+0000 7ff5c27e79c0 20 zonegroup default 2024-09-14T11:38:09.750 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:09.751+0000 7ff5c27e79c0 20 rados->read ofs=0 len=0 2024-09-14T11:38:09.750 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:09.751+0000 7ff5c27e79c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:38:09.750 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:09.751+0000 7ff5c27e79c0 20 rados->read ofs=0 len=0 2024-09-14T11:38:09.751 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:09.751+0000 7ff5c27e79c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:38:09.751 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:09.751+0000 7ff5c27e79c0 20 rados->read ofs=0 len=0 2024-09-14T11:38:09.752 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:09.751+0000 7ff5c27e79c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:38:09.752 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:09.751+0000 7ff5c27e79c0 20 started sync module instance, tier type = 2024-09-14T11:38:09.752 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:09.751+0000 7ff5c27e79c0 20 started zone id=d9e72d30-c60b-4d0d-9267-fdc36392d5ad (name=default) with tier type = 2024-09-14T11:38:09.776 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:09.779+0000 7ff5c27e79c0 20 add_watcher() i=0 2024-09-14T11:38:09.776 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:09.779+0000 7ff5c27e79c0 20 add_watcher() i=1 2024-09-14T11:38:09.776 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:09.779+0000 7ff5c27e79c0 20 add_watcher() i=2 2024-09-14T11:38:09.776 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:09.779+0000 7ff5c27e79c0 20 add_watcher() i=3 2024-09-14T11:38:09.776 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:09.779+0000 7ff5c27e79c0 20 add_watcher() i=4 2024-09-14T11:38:09.776 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:09.779+0000 7ff5c27e79c0 20 add_watcher() i=5 2024-09-14T11:38:09.776 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:09.779+0000 7ff5c27e79c0 20 add_watcher() i=6 2024-09-14T11:38:09.778 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:09.779+0000 7ff5c27e79c0 20 add_watcher() i=7 2024-09-14T11:38:09.778 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:09.779+0000 7ff5c27e79c0 2 all 8 watchers are set, enabling cache 2024-09-14T11:38:09.782 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:09.783+0000 7ff476fdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:38:09.783 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:09.783+0000 7ff5c27e79c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:38:09.783 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:09.783+0000 7ff5c27e79c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:38:09.783 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:09.783+0000 7ff5c27e79c0 5 note: GC not initialized 2024-09-14T11:38:09.784 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:09.787+0000 7ff475fdb640 20 reqs_thread_entry: start 2024-09-14T11:38:09.785 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:09.787+0000 7ff5c27e79c0 20 init_complete bucket index max shards: 11 2024-09-14T11:38:09.785 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:09.787+0000 7ff5c27e79c0 20 Filter name: none 2024-09-14T11:38:09.785 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:09.787+0000 7ff3e77fe640 20 reqs_thread_entry: start 2024-09-14T11:38:09.785 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:09.787+0000 7ff5c27e79c0 20 rados->read ofs=0 len=0 2024-09-14T11:38:09.786 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:09.787+0000 7ff5c27e79c0 20 rados_obj.operate() r=0 bl.length=193 2024-09-14T11:38:09.786 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:09.787+0000 7ff5c27e79c0 20 rados->read ofs=0 len=0 2024-09-14T11:38:09.787 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:09.787+0000 7ff5c27e79c0 20 rados_obj.operate() r=0 bl.length=415 2024-09-14T11:38:09.787 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:09.787+0000 7ff5c27e79c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:38:09.787 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:09.787+0000 7ff5c27e79c0 20 rados->read ofs=0 len=0 2024-09-14T11:38:09.788 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:09.791+0000 7ff5c27e79c0 20 rados_obj.operate() r=0 bl.length=193 2024-09-14T11:38:09.788 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:09.791+0000 7ff5c27e79c0 20 rados->read ofs=0 len=0 2024-09-14T11:38:09.788 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:09.791+0000 7ff5c27e79c0 20 rados_obj.operate() r=0 bl.length=415 2024-09-14T11:38:09.788 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:09.791+0000 7ff5c27e79c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:38:09.791 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:09.791+0000 7ff476fdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:38:09.796 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:09.799+0000 7ff5c27e79c0 20 remove_watcher() i=0 2024-09-14T11:38:09.796 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:09.799+0000 7ff5c27e79c0 2 removed watcher, disabling cache 2024-09-14T11:38:09.798 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:09.799+0000 7ff5c27e79c0 20 remove_watcher() i=1 2024-09-14T11:38:09.800 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:09.803+0000 7ff5c27e79c0 20 remove_watcher() i=2 2024-09-14T11:38:09.802 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:09.803+0000 7ff5c27e79c0 20 remove_watcher() i=3 2024-09-14T11:38:09.805 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:09.807+0000 7ff5c27e79c0 20 remove_watcher() i=4 2024-09-14T11:38:09.807 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:09.807+0000 7ff5c27e79c0 20 remove_watcher() i=5 2024-09-14T11:38:09.808 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:09.811+0000 7ff5c27e79c0 20 remove_watcher() i=6 2024-09-14T11:38:09.810 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:09.811+0000 7ff5c27e79c0 20 remove_watcher() i=7 2024-09-14T11:38:09.833 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-14T11:38:09.833 INFO:tasks.workunit.client.0.smithi138.stderr:BUCKET_STATS: 2024-09-14T11:38:09.833 INFO:tasks.workunit.client.0.smithi138.stderr:bucket: error-at-logrecord-writes id: d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.35 num_objects: 20 size_kb: 1 num_shards: 11 2024-09-14T11:38:09.833 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-14T11:38:09.833 INFO:tasks.workunit.client.0.smithi138.stderr:radosgw-admin bucket reshard --bucket error-at-logrecord-writes --num-shards 12 --rgw-reshard-bucket-lock-duration 30 --inject-error-at logrecord_writes 2024-09-14T11:38:09.867 INFO:tasks.workunit.client.0.smithi138.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:38:09.867 INFO:tasks.workunit.client.0.smithi138.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:38:09.912 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:09.915+0000 7f0cb3d269c0 20 rados->read ofs=0 len=0 2024-09-14T11:38:09.914 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:09.915+0000 7f0cb3d269c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:38:09.914 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:09.915+0000 7f0cb3d269c0 20 realm 2024-09-14T11:38:09.914 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:09.915+0000 7f0cb3d269c0 20 rados->read ofs=0 len=0 2024-09-14T11:38:09.914 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:09.915+0000 7f0cb3d269c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:38:09.914 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:09.915+0000 7f0cb3d269c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:38:09.914 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:09.915+0000 7f0cb3d269c0 20 rados->read ofs=0 len=0 2024-09-14T11:38:09.914 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:09.915+0000 7f0cb3d269c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:38:09.915 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:09.915+0000 7f0cb3d269c0 20 rados->read ofs=0 len=0 2024-09-14T11:38:09.915 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:09.915+0000 7f0cb3d269c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:38:09.915 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:09.915+0000 7f0cb3d269c0 20 rados->read ofs=0 len=0 2024-09-14T11:38:09.916 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:09.919+0000 7f0cb3d269c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:38:09.917 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:09.919+0000 7f0cb3d269c0 20 searching for the correct realm 2024-09-14T11:38:09.921 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:09.923+0000 7f0cb102b640 0 -- 172.21.15.138:0/3649564889 >> [v2:172.21.15.154:6808/1468088432,v1:172.21.15.154:6809/1468088432] conn(0x7f0ca4033b50 msgr2=0x7f0ca4025910 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:38:09.927 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:09.927+0000 7f0cb102b640 0 -- 172.21.15.138:0/3649564889 >> [v2:172.21.15.138:6816/326481658,v1:172.21.15.138:6817/326481658] conn(0x7f0cac0ab070 msgr2=0x7f0cac138a30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:38:10.143 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:10.143+0000 7f0cb3d269c0 20 RGWRados::pool_iterate: got zone_info.d9e72d30-c60b-4d0d-9267-fdc36392d5ad 2024-09-14T11:38:10.143 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:10.143+0000 7f0cb3d269c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:38:10.143 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:10.143+0000 7f0cb3d269c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:38:10.143 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:10.143+0000 7f0cb3d269c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:38:10.143 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:10.143+0000 7f0cb3d269c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:38:10.143 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:10.143+0000 7f0cb3d269c0 20 RGWRados::pool_iterate: got zonegroup_info.65ab941b-da8c-4160-94fb-3672b069d44f 2024-09-14T11:38:10.143 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:10.143+0000 7f0cb3d269c0 20 rados->read ofs=0 len=0 2024-09-14T11:38:10.143 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:10.143+0000 7f0cb3d269c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:38:10.144 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:10.143+0000 7f0cb3d269c0 20 rados->read ofs=0 len=0 2024-09-14T11:38:10.144 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:10.147+0000 7f0cb3d269c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:38:10.144 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:10.147+0000 7f0cb3d269c0 20 rados->read ofs=0 len=0 2024-09-14T11:38:10.145 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:10.147+0000 7f0cb3d269c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:38:10.145 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:10.147+0000 7f0cb3d269c0 20 zone default found 2024-09-14T11:38:10.145 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:10.147+0000 7f0cb3d269c0 4 Realm: () 2024-09-14T11:38:10.145 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:10.147+0000 7f0cb3d269c0 4 ZoneGroup: default (65ab941b-da8c-4160-94fb-3672b069d44f) 2024-09-14T11:38:10.145 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:10.147+0000 7f0cb3d269c0 4 Zone: default (d9e72d30-c60b-4d0d-9267-fdc36392d5ad) 2024-09-14T11:38:10.145 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:10.147+0000 7f0cb3d269c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:38:10.145 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:10.147+0000 7f0cb3d269c0 20 zonegroup default 2024-09-14T11:38:10.145 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:10.147+0000 7f0cb3d269c0 20 rados->read ofs=0 len=0 2024-09-14T11:38:10.146 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:10.147+0000 7f0cb3d269c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:38:10.146 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:10.147+0000 7f0cb3d269c0 20 rados->read ofs=0 len=0 2024-09-14T11:38:10.146 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:10.147+0000 7f0cb3d269c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:38:10.146 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:10.147+0000 7f0cb3d269c0 20 rados->read ofs=0 len=0 2024-09-14T11:38:10.147 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:10.147+0000 7f0cb3d269c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:38:10.147 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:10.147+0000 7f0cb3d269c0 20 started sync module instance, tier type = 2024-09-14T11:38:10.147 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:10.147+0000 7f0cb3d269c0 20 started zone id=d9e72d30-c60b-4d0d-9267-fdc36392d5ad (name=default) with tier type = 2024-09-14T11:38:10.171 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:10.171+0000 7f0cb3d269c0 20 add_watcher() i=0 2024-09-14T11:38:10.171 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:10.171+0000 7f0cb3d269c0 20 add_watcher() i=1 2024-09-14T11:38:10.171 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:10.171+0000 7f0cb3d269c0 20 add_watcher() i=2 2024-09-14T11:38:10.171 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:10.171+0000 7f0cb3d269c0 20 add_watcher() i=3 2024-09-14T11:38:10.171 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:10.171+0000 7f0cb3d269c0 20 add_watcher() i=4 2024-09-14T11:38:10.171 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:10.171+0000 7f0cb3d269c0 20 add_watcher() i=5 2024-09-14T11:38:10.171 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:10.171+0000 7f0cb3d269c0 20 add_watcher() i=6 2024-09-14T11:38:10.173 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:10.175+0000 7f0cb3d269c0 20 add_watcher() i=7 2024-09-14T11:38:10.173 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:10.175+0000 7f0cb3d269c0 2 all 8 watchers are set, enabling cache 2024-09-14T11:38:10.177 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:10.179+0000 7f0b637fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:38:10.178 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:10.179+0000 7f0cb3d269c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:38:10.178 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:10.179+0000 7f0cb3d269c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:38:10.178 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:10.179+0000 7f0cb3d269c0 5 note: GC not initialized 2024-09-14T11:38:10.179 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:10.179+0000 7f0b627fc640 20 reqs_thread_entry: start 2024-09-14T11:38:10.179 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:10.179+0000 7f0cb3d269c0 20 init_complete bucket index max shards: 11 2024-09-14T11:38:10.180 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:10.179+0000 7f0cb3d269c0 20 Filter name: none 2024-09-14T11:38:10.180 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:10.183+0000 7f0ad3fff640 20 reqs_thread_entry: start 2024-09-14T11:38:10.180 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:10.183+0000 7f0cb3d269c0 10 cache get: name=default.rgw.meta+root+error-at-logrecord-writes : miss 2024-09-14T11:38:10.180 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:10.183+0000 7f0cb3d269c0 20 rados->read ofs=0 len=0 2024-09-14T11:38:10.181 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:10.183+0000 7f0cb3d269c0 20 rados_obj.operate() r=0 bl.length=193 2024-09-14T11:38:10.181 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:10.183+0000 7f0cb3d269c0 10 cache put: name=default.rgw.meta+root+error-at-logrecord-writes info.flags=0x11 2024-09-14T11:38:10.181 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:10.183+0000 7f0cb3d269c0 10 adding default.rgw.meta+root+error-at-logrecord-writes to cache LRU end 2024-09-14T11:38:10.181 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:10.183+0000 7f0cb3d269c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.35 : miss 2024-09-14T11:38:10.181 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:10.183+0000 7f0cb3d269c0 20 rados->read ofs=0 len=0 2024-09-14T11:38:10.182 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:10.183+0000 7f0cb3d269c0 20 rados_obj.operate() r=0 bl.length=415 2024-09-14T11:38:10.182 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:10.183+0000 7f0cb3d269c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.35 info.flags=0x17 2024-09-14T11:38:10.182 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:10.183+0000 7f0cb3d269c0 10 adding default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.35 to cache LRU end 2024-09-14T11:38:10.182 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:10.183+0000 7f0cb3d269c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:38:10.182 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:10.183+0000 7f0cb3d269c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:38:10.182 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:10.183+0000 7f0cb3d269c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.35 2024-09-14T11:38:10.195 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:10.195+0000 7f0cb3d269c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.35 info.flags=0x17 2024-09-14T11:38:10.195 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:10.195+0000 7f0cb3d269c0 10 moving default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.35 to cache LRU end 2024-09-14T11:38:10.195 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:10.195+0000 7f0cb3d269c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:38:10.195 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:10.195+0000 7f0cb3d269c0 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-logrecord-writes:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.35, ofs0, ns] 2024-09-14T11:38:10.196 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:10.199+0000 7f0b94ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366221 cookie 94249917985664 notifier 7064 bl.length()=923 2024-09-14T11:38:10.196 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:10.199+0000 7f0b94ff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.35 info.flags=0x17 2024-09-14T11:38:10.196 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:10.199+0000 7f0b94ff9640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.35 to cache LRU end 2024-09-14T11:38:10.196 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:10.199+0000 7f0b94ff9640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:38:10.199 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:10.199+0000 7f0cb3d269c0 20 handle_bi_update(): bucket=:error-at-logrecord-writes[d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.35]): orig_sources= new_sources= 2024-09-14T11:38:10.199 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:10.199+0000 7f0cb3d269c0 20 handle_bi_update(): bucket=:error-at-logrecord-writes[d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.35]): potential sources added=[] removed=[] 2024-09-14T11:38:10.199 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:10.199+0000 7f0cb3d269c0 20 handle_bi_update(): bucket=:error-at-logrecord-writes[d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.35]): orig_dests= new_dests= 2024-09-14T11:38:10.200 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:10.199+0000 7f0cb3d269c0 20 handle_bi_update(): bucket=:error-at-logrecord-writes[d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.35]): potential dests added=[] removed=[] 2024-09-14T11:38:10.203 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:10.207+0000 7f0cb3d269c0 -1 Injecting error=-5 at location=logrecord_writes 2024-09-14T11:38:10.204 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:10.207+0000 7f0cb3d269c0 0 ERROR: init_reshard failed to pause writes to the current index: (5) Input/output error 2024-09-14T11:38:10.214 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:10.215+0000 7f0cb3d269c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.35 : hit (requested=0x17, cached=0x17) 2024-09-14T11:38:10.214 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:10.215+0000 7f0cb3d269c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.35 2024-09-14T11:38:10.216 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:10.219+0000 7f0cb3d269c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.35 info.flags=0x17 2024-09-14T11:38:10.216 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:10.219+0000 7f0cb3d269c0 10 moving default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.35 to cache LRU end 2024-09-14T11:38:10.216 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:10.219+0000 7f0cb3d269c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:38:10.216 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:10.219+0000 7f0cb3d269c0 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-logrecord-writes:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.35, ofs0, ns] 2024-09-14T11:38:10.217 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:10.219+0000 7f0b957fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366222 cookie 94249917985664 notifier 7064 bl.length()=891 2024-09-14T11:38:10.217 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:10.219+0000 7f0b957fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.35 info.flags=0x17 2024-09-14T11:38:10.217 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:10.219+0000 7f0b957fa640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.35 to cache LRU end 2024-09-14T11:38:10.217 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:10.219+0000 7f0b957fa640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:38:10.219 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:10.219+0000 7f0cb3d269c0 20 handle_bi_update(): bucket=:error-at-logrecord-writes[d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.35]): orig_sources= new_sources= 2024-09-14T11:38:10.219 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:10.219+0000 7f0cb3d269c0 20 handle_bi_update(): bucket=:error-at-logrecord-writes[d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.35]): potential sources added=[] removed=[] 2024-09-14T11:38:10.219 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:10.219+0000 7f0cb3d269c0 20 handle_bi_update(): bucket=:error-at-logrecord-writes[d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.35]): orig_dests= new_dests= 2024-09-14T11:38:10.219 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:10.219+0000 7f0cb3d269c0 20 handle_bi_update(): bucket=:error-at-logrecord-writes[d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.35]): potential dests added=[] removed=[] 2024-09-14T11:38:10.223 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:10.227+0000 7f0b637fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:38:10.229 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:10.231+0000 7f0cb3d269c0 20 remove_watcher() i=0 2024-09-14T11:38:10.229 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:10.231+0000 7f0cb3d269c0 2 removed watcher, disabling cache 2024-09-14T11:38:10.231 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:10.231+0000 7f0cb3d269c0 20 remove_watcher() i=1 2024-09-14T11:38:10.233 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:10.235+0000 7f0cb3d269c0 20 remove_watcher() i=2 2024-09-14T11:38:10.235 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:10.239+0000 7f0cb3d269c0 20 remove_watcher() i=3 2024-09-14T11:38:10.238 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:10.239+0000 7f0cb3d269c0 20 remove_watcher() i=4 2024-09-14T11:38:10.239 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:10.239+0000 7f0cb3d269c0 20 remove_watcher() i=5 2024-09-14T11:38:10.241 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:10.243+0000 7f0cb3d269c0 20 remove_watcher() i=6 2024-09-14T11:38:10.242 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:10.243+0000 7f0cb3d269c0 20 remove_watcher() i=7 2024-09-14T11:38:10.259 INFO:tasks.workunit.client.0.smithi138.stderr:radosgw-admin bucket stats --bucket error-at-logrecord-writes 2024-09-14T11:38:10.290 INFO:tasks.workunit.client.0.smithi138.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:38:10.290 INFO:tasks.workunit.client.0.smithi138.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:38:10.335 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:10.335+0000 7fbd4e1349c0 20 rados->read ofs=0 len=0 2024-09-14T11:38:10.337 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:10.339+0000 7fbd4e1349c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:38:10.337 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:10.339+0000 7fbd4e1349c0 20 realm 2024-09-14T11:38:10.337 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:10.339+0000 7fbd4e1349c0 20 rados->read ofs=0 len=0 2024-09-14T11:38:10.337 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:10.339+0000 7fbd4e1349c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:38:10.337 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:10.339+0000 7fbd4e1349c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:38:10.338 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:10.339+0000 7fbd4e1349c0 20 rados->read ofs=0 len=0 2024-09-14T11:38:10.338 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:10.339+0000 7fbd4e1349c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:38:10.338 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:10.339+0000 7fbd4e1349c0 20 rados->read ofs=0 len=0 2024-09-14T11:38:10.339 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:10.339+0000 7fbd4e1349c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:38:10.339 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:10.339+0000 7fbd4e1349c0 20 rados->read ofs=0 len=0 2024-09-14T11:38:10.340 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:10.343+0000 7fbd4e1349c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:38:10.340 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:10.343+0000 7fbd4e1349c0 20 searching for the correct realm 2024-09-14T11:38:10.344 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:10.347+0000 7fbd4c43b640 0 -- 172.21.15.138:0/4266956475 >> [v2:172.21.15.154:6824/416768175,v1:172.21.15.154:6825/416768175] conn(0x7fbd4400e040 msgr2=0x7fbd44035410 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:38:10.350 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:10.351+0000 7fbd4b439640 0 -- 172.21.15.138:0/4266956475 >> [v2:172.21.15.138:6816/326481658,v1:172.21.15.138:6817/326481658] conn(0x7fbd440283f0 msgr2=0x7fbd44028850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-14T11:38:10.567 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:10.567+0000 7fbd4e1349c0 20 RGWRados::pool_iterate: got zone_info.d9e72d30-c60b-4d0d-9267-fdc36392d5ad 2024-09-14T11:38:10.567 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:10.567+0000 7fbd4e1349c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:38:10.567 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:10.567+0000 7fbd4e1349c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:38:10.567 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:10.567+0000 7fbd4e1349c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:38:10.567 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:10.567+0000 7fbd4e1349c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:38:10.567 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:10.567+0000 7fbd4e1349c0 20 RGWRados::pool_iterate: got zonegroup_info.65ab941b-da8c-4160-94fb-3672b069d44f 2024-09-14T11:38:10.568 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:10.567+0000 7fbd4e1349c0 20 rados->read ofs=0 len=0 2024-09-14T11:38:10.568 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:10.567+0000 7fbd4e1349c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:38:10.568 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:10.567+0000 7fbd4e1349c0 20 rados->read ofs=0 len=0 2024-09-14T11:38:10.568 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:10.571+0000 7fbd4e1349c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:38:10.568 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:10.571+0000 7fbd4e1349c0 20 rados->read ofs=0 len=0 2024-09-14T11:38:10.570 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:10.571+0000 7fbd4e1349c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:38:10.570 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:10.571+0000 7fbd4e1349c0 20 zone default found 2024-09-14T11:38:10.570 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:10.571+0000 7fbd4e1349c0 4 Realm: () 2024-09-14T11:38:10.570 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:10.571+0000 7fbd4e1349c0 4 ZoneGroup: default (65ab941b-da8c-4160-94fb-3672b069d44f) 2024-09-14T11:38:10.570 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:10.571+0000 7fbd4e1349c0 4 Zone: default (d9e72d30-c60b-4d0d-9267-fdc36392d5ad) 2024-09-14T11:38:10.570 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:10.571+0000 7fbd4e1349c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:38:10.570 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:10.571+0000 7fbd4e1349c0 20 zonegroup default 2024-09-14T11:38:10.570 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:10.571+0000 7fbd4e1349c0 20 rados->read ofs=0 len=0 2024-09-14T11:38:10.570 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:10.571+0000 7fbd4e1349c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:38:10.570 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:10.571+0000 7fbd4e1349c0 20 rados->read ofs=0 len=0 2024-09-14T11:38:10.571 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:10.571+0000 7fbd4e1349c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:38:10.571 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:10.571+0000 7fbd4e1349c0 20 rados->read ofs=0 len=0 2024-09-14T11:38:10.571 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:10.571+0000 7fbd4e1349c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:38:10.571 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:10.575+0000 7fbd4e1349c0 20 started sync module instance, tier type = 2024-09-14T11:38:10.572 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:10.575+0000 7fbd4e1349c0 20 started zone id=d9e72d30-c60b-4d0d-9267-fdc36392d5ad (name=default) with tier type = 2024-09-14T11:38:10.595 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:10.595+0000 7fbd4e1349c0 20 add_watcher() i=0 2024-09-14T11:38:10.595 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:10.595+0000 7fbd4e1349c0 20 add_watcher() i=1 2024-09-14T11:38:10.595 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:10.595+0000 7fbd4e1349c0 20 add_watcher() i=2 2024-09-14T11:38:10.596 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:10.595+0000 7fbd4e1349c0 20 add_watcher() i=3 2024-09-14T11:38:10.596 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:10.595+0000 7fbd4e1349c0 20 add_watcher() i=4 2024-09-14T11:38:10.596 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:10.595+0000 7fbd4e1349c0 20 add_watcher() i=5 2024-09-14T11:38:10.596 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:10.595+0000 7fbd4e1349c0 20 add_watcher() i=6 2024-09-14T11:38:10.598 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:10.599+0000 7fbd4e1349c0 20 add_watcher() i=7 2024-09-14T11:38:10.598 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:10.599+0000 7fbd4e1349c0 2 all 8 watchers are set, enabling cache 2024-09-14T11:38:10.602 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:10.603+0000 7fbc01fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:38:10.603 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:10.603+0000 7fbd4e1349c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:38:10.603 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:10.603+0000 7fbd4e1349c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:38:10.603 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:10.603+0000 7fbd4e1349c0 5 note: GC not initialized 2024-09-14T11:38:10.604 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:10.603+0000 7fbc00fe1640 20 reqs_thread_entry: start 2024-09-14T11:38:10.604 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:10.603+0000 7fbd4e1349c0 20 init_complete bucket index max shards: 11 2024-09-14T11:38:10.604 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:10.607+0000 7fbd4e1349c0 20 Filter name: none 2024-09-14T11:38:10.604 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:10.607+0000 7fbb7a7fc640 20 reqs_thread_entry: start 2024-09-14T11:38:10.604 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:10.607+0000 7fbd4e1349c0 20 rados->read ofs=0 len=0 2024-09-14T11:38:10.605 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:10.607+0000 7fbd4e1349c0 20 rados_obj.operate() r=0 bl.length=193 2024-09-14T11:38:10.605 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:10.607+0000 7fbd4e1349c0 20 rados->read ofs=0 len=0 2024-09-14T11:38:10.606 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:10.607+0000 7fbd4e1349c0 20 rados_obj.operate() r=0 bl.length=415 2024-09-14T11:38:10.606 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:10.607+0000 7fbd4e1349c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:38:10.606 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:10.607+0000 7fbd4e1349c0 20 rados->read ofs=0 len=0 2024-09-14T11:38:10.607 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:10.607+0000 7fbd4e1349c0 20 rados_obj.operate() r=0 bl.length=193 2024-09-14T11:38:10.607 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:10.607+0000 7fbd4e1349c0 20 rados->read ofs=0 len=0 2024-09-14T11:38:10.608 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:10.611+0000 7fbd4e1349c0 20 rados_obj.operate() r=0 bl.length=415 2024-09-14T11:38:10.608 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:10.611+0000 7fbd4e1349c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:38:10.611 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:10.611+0000 7fbc01fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:38:10.616 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:10.619+0000 7fbd4e1349c0 20 remove_watcher() i=0 2024-09-14T11:38:10.616 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:10.619+0000 7fbd4e1349c0 2 removed watcher, disabling cache 2024-09-14T11:38:10.618 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:10.619+0000 7fbd4e1349c0 20 remove_watcher() i=1 2024-09-14T11:38:10.620 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:10.623+0000 7fbd4e1349c0 20 remove_watcher() i=2 2024-09-14T11:38:10.622 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:10.623+0000 7fbd4e1349c0 20 remove_watcher() i=3 2024-09-14T11:38:10.625 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:10.627+0000 7fbd4e1349c0 20 remove_watcher() i=4 2024-09-14T11:38:10.627 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:10.627+0000 7fbd4e1349c0 20 remove_watcher() i=5 2024-09-14T11:38:10.628 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:10.631+0000 7fbd4e1349c0 20 remove_watcher() i=6 2024-09-14T11:38:10.630 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:10.631+0000 7fbd4e1349c0 20 remove_watcher() i=7 2024-09-14T11:38:10.645 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-14T11:38:10.645 INFO:tasks.workunit.client.0.smithi138.stderr:BUCKET_STATS: 2024-09-14T11:38:10.645 INFO:tasks.workunit.client.0.smithi138.stderr:bucket: error-at-logrecord-writes id: d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.35 num_objects: 20 size_kb: 1 num_shards: 11 2024-09-14T11:38:10.645 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-14T11:38:10.646 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:38:10.647 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-14T11:38:10.692 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:38:10.692 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-14T11:38:10.761 INFO:tasks.workunit.client.0.smithi138.stderr:radosgw-admin bucket reshard --bucket error-at-logrecord-writes --num-shards 12 --rgw-reshard-bucket-lock-duration 30 2024-09-14T11:38:10.797 INFO:tasks.workunit.client.0.smithi138.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:38:10.797 INFO:tasks.workunit.client.0.smithi138.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:38:10.846 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:10.847+0000 7f53dd9cd9c0 20 rados->read ofs=0 len=0 2024-09-14T11:38:10.848 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:10.847+0000 7f53dd9cd9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:38:10.848 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:10.847+0000 7f53dd9cd9c0 20 realm 2024-09-14T11:38:10.848 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:10.847+0000 7f53dd9cd9c0 20 rados->read ofs=0 len=0 2024-09-14T11:38:10.848 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:10.851+0000 7f53dd9cd9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:38:10.848 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:10.851+0000 7f53dd9cd9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:38:10.848 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:10.851+0000 7f53dd9cd9c0 20 rados->read ofs=0 len=0 2024-09-14T11:38:10.848 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:10.851+0000 7f53dd9cd9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:38:10.848 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:10.851+0000 7f53dd9cd9c0 20 rados->read ofs=0 len=0 2024-09-14T11:38:10.849 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:10.851+0000 7f53dd9cd9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:38:10.850 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:10.851+0000 7f53dd9cd9c0 20 rados->read ofs=0 len=0 2024-09-14T11:38:10.850 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:10.851+0000 7f53dd9cd9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:38:10.850 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:10.851+0000 7f53dd9cd9c0 20 searching for the correct realm 2024-09-14T11:38:10.854 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:10.855+0000 7f53dbcd4640 0 -- 172.21.15.138:0/3863568967 >> [v2:172.21.15.154:6824/416768175,v1:172.21.15.154:6825/416768175] conn(0x7f53d40dd030 msgr2=0x7f53d41216d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:38:11.069 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:11.071+0000 7f53dacd2640 0 -- 172.21.15.138:0/3863568967 >> [v2:172.21.15.138:6816/326481658,v1:172.21.15.138:6817/326481658] conn(0x7f53d410e040 msgr2=0x7f53d41165e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-14T11:38:11.287 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:11.286+0000 7f53dd9cd9c0 20 RGWRados::pool_iterate: got zone_info.d9e72d30-c60b-4d0d-9267-fdc36392d5ad 2024-09-14T11:38:11.287 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:11.286+0000 7f53dd9cd9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:38:11.287 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:11.286+0000 7f53dd9cd9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:38:11.287 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:11.286+0000 7f53dd9cd9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:38:11.287 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:11.286+0000 7f53dd9cd9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:38:11.287 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:11.286+0000 7f53dd9cd9c0 20 RGWRados::pool_iterate: got zonegroup_info.65ab941b-da8c-4160-94fb-3672b069d44f 2024-09-14T11:38:11.287 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:11.286+0000 7f53dd9cd9c0 20 rados->read ofs=0 len=0 2024-09-14T11:38:11.287 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:11.286+0000 7f53dd9cd9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:38:11.287 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:11.286+0000 7f53dd9cd9c0 20 rados->read ofs=0 len=0 2024-09-14T11:38:11.288 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:11.290+0000 7f53dd9cd9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:38:11.288 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:11.290+0000 7f53dd9cd9c0 20 rados->read ofs=0 len=0 2024-09-14T11:38:11.289 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:11.290+0000 7f53dd9cd9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:38:11.289 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:11.290+0000 7f53dd9cd9c0 20 zone default found 2024-09-14T11:38:11.289 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:11.290+0000 7f53dd9cd9c0 4 Realm: () 2024-09-14T11:38:11.289 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:11.290+0000 7f53dd9cd9c0 4 ZoneGroup: default (65ab941b-da8c-4160-94fb-3672b069d44f) 2024-09-14T11:38:11.289 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:11.290+0000 7f53dd9cd9c0 4 Zone: default (d9e72d30-c60b-4d0d-9267-fdc36392d5ad) 2024-09-14T11:38:11.289 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:11.290+0000 7f53dd9cd9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:38:11.289 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:11.290+0000 7f53dd9cd9c0 20 zonegroup default 2024-09-14T11:38:11.289 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:11.290+0000 7f53dd9cd9c0 20 rados->read ofs=0 len=0 2024-09-14T11:38:11.290 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:11.290+0000 7f53dd9cd9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:38:11.290 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:11.290+0000 7f53dd9cd9c0 20 rados->read ofs=0 len=0 2024-09-14T11:38:11.290 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:11.290+0000 7f53dd9cd9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:38:11.290 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:11.290+0000 7f53dd9cd9c0 20 rados->read ofs=0 len=0 2024-09-14T11:38:11.291 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:11.290+0000 7f53dd9cd9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:38:11.291 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:11.290+0000 7f53dd9cd9c0 20 started sync module instance, tier type = 2024-09-14T11:38:11.291 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:11.290+0000 7f53dd9cd9c0 20 started zone id=d9e72d30-c60b-4d0d-9267-fdc36392d5ad (name=default) with tier type = 2024-09-14T11:38:11.315 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:11.314+0000 7f53dd9cd9c0 20 add_watcher() i=0 2024-09-14T11:38:11.315 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:11.314+0000 7f53dd9cd9c0 20 add_watcher() i=1 2024-09-14T11:38:11.315 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:11.314+0000 7f53dd9cd9c0 20 add_watcher() i=2 2024-09-14T11:38:11.315 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:11.314+0000 7f53dd9cd9c0 20 add_watcher() i=3 2024-09-14T11:38:11.315 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:11.314+0000 7f53dd9cd9c0 20 add_watcher() i=4 2024-09-14T11:38:11.315 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:11.314+0000 7f53dd9cd9c0 20 add_watcher() i=5 2024-09-14T11:38:11.315 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:11.314+0000 7f53dd9cd9c0 20 add_watcher() i=6 2024-09-14T11:38:11.317 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:11.318+0000 7f53dd9cd9c0 20 add_watcher() i=7 2024-09-14T11:38:11.318 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:11.318+0000 7f53dd9cd9c0 2 all 8 watchers are set, enabling cache 2024-09-14T11:38:11.321 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:11.322+0000 7f5291fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:38:11.322 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:11.322+0000 7f53dd9cd9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:38:11.322 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:11.322+0000 7f53dd9cd9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:38:11.322 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:11.322+0000 7f53dd9cd9c0 5 note: GC not initialized 2024-09-14T11:38:11.323 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:11.322+0000 7f5290fe1640 20 reqs_thread_entry: start 2024-09-14T11:38:11.323 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:11.322+0000 7f53dd9cd9c0 20 init_complete bucket index max shards: 11 2024-09-14T11:38:11.323 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:11.322+0000 7f53dd9cd9c0 20 Filter name: none 2024-09-14T11:38:11.323 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:11.322+0000 7f520a7fc640 20 reqs_thread_entry: start 2024-09-14T11:38:11.323 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:11.322+0000 7f53dd9cd9c0 10 cache get: name=default.rgw.meta+root+error-at-logrecord-writes : miss 2024-09-14T11:38:11.323 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:11.322+0000 7f53dd9cd9c0 20 rados->read ofs=0 len=0 2024-09-14T11:38:11.324 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:11.326+0000 7f53dd9cd9c0 20 rados_obj.operate() r=0 bl.length=193 2024-09-14T11:38:11.324 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:11.326+0000 7f53dd9cd9c0 10 cache put: name=default.rgw.meta+root+error-at-logrecord-writes info.flags=0x11 2024-09-14T11:38:11.325 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:11.326+0000 7f53dd9cd9c0 10 adding default.rgw.meta+root+error-at-logrecord-writes to cache LRU end 2024-09-14T11:38:11.325 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:11.326+0000 7f53dd9cd9c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.35 : miss 2024-09-14T11:38:11.325 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:11.326+0000 7f53dd9cd9c0 20 rados->read ofs=0 len=0 2024-09-14T11:38:11.325 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:11.326+0000 7f53dd9cd9c0 20 rados_obj.operate() r=0 bl.length=415 2024-09-14T11:38:11.325 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:11.326+0000 7f53dd9cd9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.35 info.flags=0x17 2024-09-14T11:38:11.326 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:11.326+0000 7f53dd9cd9c0 10 adding default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.35 to cache LRU end 2024-09-14T11:38:11.326 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:11.326+0000 7f53dd9cd9c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:38:11.326 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:11.326+0000 7f53dd9cd9c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:38:11.326 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:11.326+0000 7f53dd9cd9c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.35 2024-09-14T11:38:11.338 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:11.338+0000 7f53dd9cd9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.35 info.flags=0x17 2024-09-14T11:38:11.338 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:11.338+0000 7f53dd9cd9c0 10 moving default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.35 to cache LRU end 2024-09-14T11:38:11.338 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:11.338+0000 7f53dd9cd9c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:38:11.338 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:11.338+0000 7f53dd9cd9c0 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-logrecord-writes:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.35, ofs0, ns] 2024-09-14T11:38:11.339 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:11.338+0000 7f52beffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366223 cookie 94700662970880 notifier 7581 bl.length()=923 2024-09-14T11:38:11.339 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:11.338+0000 7f52beffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.35 info.flags=0x17 2024-09-14T11:38:11.339 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:11.338+0000 7f52beffd640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.35 to cache LRU end 2024-09-14T11:38:11.339 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:11.338+0000 7f52beffd640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:38:11.341 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:11.342+0000 7f53dd9cd9c0 20 handle_bi_update(): bucket=:error-at-logrecord-writes[d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.35]): orig_sources= new_sources= 2024-09-14T11:38:11.341 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:11.342+0000 7f53dd9cd9c0 20 handle_bi_update(): bucket=:error-at-logrecord-writes[d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.35]): potential sources added=[] removed=[] 2024-09-14T11:38:11.342 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:11.342+0000 7f53dd9cd9c0 20 handle_bi_update(): bucket=:error-at-logrecord-writes[d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.35]): orig_dests= new_dests= 2024-09-14T11:38:11.342 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:11.342+0000 7f53dd9cd9c0 20 handle_bi_update(): bucket=:error-at-logrecord-writes[d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.35]): potential dests added=[] removed=[] 2024-09-14T11:38:11.351 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:11.350+0000 7f53dd9cd9c0 10 bucket_obj is .dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.35.1.0 2024-09-14T11:38:11.351 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:11.350+0000 7f53dd9cd9c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.35.1.0 2024-09-14T11:38:11.351 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:11.350+0000 7f53dd9cd9c0 10 bucket_obj is .dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.35.1.1 2024-09-14T11:38:11.351 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:11.350+0000 7f53dd9cd9c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.35.1.1 2024-09-14T11:38:11.351 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:11.350+0000 7f53dd9cd9c0 10 bucket_obj is .dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.35.1.2 2024-09-14T11:38:11.351 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:11.350+0000 7f53dd9cd9c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.35.1.2 2024-09-14T11:38:11.351 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:11.350+0000 7f53dd9cd9c0 10 bucket_obj is .dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.35.1.3 2024-09-14T11:38:11.351 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:11.350+0000 7f53dd9cd9c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.35.1.3 2024-09-14T11:38:11.351 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:11.350+0000 7f53dd9cd9c0 10 bucket_obj is .dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.35.1.4 2024-09-14T11:38:11.351 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:11.350+0000 7f53dd9cd9c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.35.1.4 2024-09-14T11:38:11.352 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:11.350+0000 7f53dd9cd9c0 10 bucket_obj is .dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.35.1.5 2024-09-14T11:38:11.352 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:11.350+0000 7f53dd9cd9c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.35.1.5 2024-09-14T11:38:11.352 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:11.350+0000 7f53dd9cd9c0 10 bucket_obj is .dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.35.1.6 2024-09-14T11:38:11.352 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:11.350+0000 7f53dd9cd9c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.35.1.6 2024-09-14T11:38:11.352 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:11.350+0000 7f53dd9cd9c0 10 bucket_obj is .dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.35.1.7 2024-09-14T11:38:11.352 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:11.350+0000 7f53dd9cd9c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.35.1.7 2024-09-14T11:38:11.352 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:11.350+0000 7f53dd9cd9c0 10 bucket_obj is .dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.35.1.8 2024-09-14T11:38:11.352 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:11.350+0000 7f53dd9cd9c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.35.1.8 2024-09-14T11:38:11.352 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:11.350+0000 7f53dd9cd9c0 10 bucket_obj is .dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.35.1.9 2024-09-14T11:38:11.352 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:11.350+0000 7f53dd9cd9c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.35.1.9 2024-09-14T11:38:11.352 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:11.350+0000 7f53dd9cd9c0 10 bucket_obj is .dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.35.1.10 2024-09-14T11:38:11.352 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:11.350+0000 7f53dd9cd9c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.35.1.10 2024-09-14T11:38:11.352 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:11.350+0000 7f53dd9cd9c0 10 bucket_obj is .dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.35.1.11 2024-09-14T11:38:11.352 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:11.350+0000 7f53dd9cd9c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.35.1.11 2024-09-14T11:38:11.353 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:11.350+0000 7f53dd9cd9c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.35.0 2024-09-14T11:38:11.353 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:11.354+0000 7f53dd9cd9c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.35.1 2024-09-14T11:38:11.353 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:11.354+0000 7f53dd9cd9c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.35.2 2024-09-14T11:38:11.354 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:11.354+0000 7f53dd9cd9c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.35.3 2024-09-14T11:38:11.354 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:11.354+0000 7f53dd9cd9c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.35.4 2024-09-14T11:38:11.355 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:11.354+0000 7f53dd9cd9c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.35.5 2024-09-14T11:38:11.356 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:11.358+0000 7f53dd9cd9c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.35.6 2024-09-14T11:38:11.357 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:11.358+0000 7f53dd9cd9c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.35.7 2024-09-14T11:38:11.359 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:11.358+0000 7f53dd9cd9c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.35.8 2024-09-14T11:38:11.359 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:11.362+0000 7f53dd9cd9c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.35.9 2024-09-14T11:38:11.360 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:11.362+0000 7f53dd9cd9c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.35.10 2024-09-14T11:38:11.371 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:11.370+0000 7f53dd9cd9c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.35 : hit (requested=0x17, cached=0x17) 2024-09-14T11:38:11.371 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:11.370+0000 7f53dd9cd9c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.35 2024-09-14T11:38:11.373 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:11.374+0000 7f53dd9cd9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.35 info.flags=0x17 2024-09-14T11:38:11.373 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:11.374+0000 7f53dd9cd9c0 10 moving default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.35 to cache LRU end 2024-09-14T11:38:11.373 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:11.374+0000 7f53dd9cd9c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:38:11.373 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:11.374+0000 7f53dd9cd9c0 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-logrecord-writes:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.35, ofs0, ns] 2024-09-14T11:38:11.374 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:11.374+0000 7f52beffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366224 cookie 94700662970880 notifier 7581 bl.length()=923 2024-09-14T11:38:11.374 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:11.374+0000 7f52beffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.35 info.flags=0x17 2024-09-14T11:38:11.374 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:11.374+0000 7f52beffd640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.35 to cache LRU end 2024-09-14T11:38:11.374 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:11.374+0000 7f52beffd640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:38:11.377 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:11.378+0000 7f53dd9cd9c0 20 handle_bi_update(): bucket=:error-at-logrecord-writes[d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.35]): orig_sources= new_sources= 2024-09-14T11:38:11.377 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:11.378+0000 7f53dd9cd9c0 20 handle_bi_update(): bucket=:error-at-logrecord-writes[d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.35]): potential sources added=[] removed=[] 2024-09-14T11:38:11.378 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:11.378+0000 7f53dd9cd9c0 20 handle_bi_update(): bucket=:error-at-logrecord-writes[d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.35]): orig_dests= new_dests= 2024-09-14T11:38:11.378 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:11.378+0000 7f53dd9cd9c0 20 handle_bi_update(): bucket=:error-at-logrecord-writes[d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.35]): potential dests added=[] removed=[] 2024-09-14T11:38:11.383 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:11.382+0000 7f53dd9cd9c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.35.0 2024-09-14T11:38:11.384 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:11.386+0000 7f53dd9cd9c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.35.1 2024-09-14T11:38:11.385 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:11.386+0000 7f53dd9cd9c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.35.2 2024-09-14T11:38:11.385 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:11.386+0000 7f53dd9cd9c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.35.3 2024-09-14T11:38:11.386 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:11.386+0000 7f53dd9cd9c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.35.4 2024-09-14T11:38:11.386 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:11.386+0000 7f53dd9cd9c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.35.5 2024-09-14T11:38:11.387 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:11.386+0000 7f53dd9cd9c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.35.6 2024-09-14T11:38:11.388 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:11.390+0000 7f53dd9cd9c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.35.7 2024-09-14T11:38:11.389 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:11.390+0000 7f53dd9cd9c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.35.8 2024-09-14T11:38:11.389 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:11.390+0000 7f53dd9cd9c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.35.9 2024-09-14T11:38:11.390 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:11.390+0000 7f53dd9cd9c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.35.10 2024-09-14T11:38:11.391 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:11.390+0000 7f53dd9cd9c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.35 : hit (requested=0x17, cached=0x17) 2024-09-14T11:38:11.391 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:11.390+0000 7f53dd9cd9c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.35 2024-09-14T11:38:11.393 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:11.394+0000 7f53dd9cd9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.35 info.flags=0x17 2024-09-14T11:38:11.393 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:11.394+0000 7f53dd9cd9c0 10 moving default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.35 to cache LRU end 2024-09-14T11:38:11.393 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:11.394+0000 7f53dd9cd9c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:38:11.393 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:11.394+0000 7f53dd9cd9c0 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-logrecord-writes:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.35, ofs0, ns] 2024-09-14T11:38:11.393 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:11.394+0000 7f52beffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366225 cookie 94700662970880 notifier 7581 bl.length()=891 2024-09-14T11:38:11.393 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:11.394+0000 7f52beffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.35 info.flags=0x17 2024-09-14T11:38:11.394 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:11.394+0000 7f52beffd640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.35 to cache LRU end 2024-09-14T11:38:11.394 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:11.394+0000 7f52beffd640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:38:11.396 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:11.398+0000 7f53dd9cd9c0 20 handle_bi_update(): bucket=:error-at-logrecord-writes[d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.35]): orig_sources= new_sources= 2024-09-14T11:38:11.396 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:11.398+0000 7f53dd9cd9c0 20 handle_bi_update(): bucket=:error-at-logrecord-writes[d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.35]): potential sources added=[] removed=[] 2024-09-14T11:38:11.397 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:11.398+0000 7f53dd9cd9c0 20 handle_bi_update(): bucket=:error-at-logrecord-writes[d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.35]): orig_dests= new_dests= 2024-09-14T11:38:11.397 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:11.398+0000 7f53dd9cd9c0 20 handle_bi_update(): bucket=:error-at-logrecord-writes[d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.35]): potential dests added=[] removed=[] 2024-09-14T11:38:11.401 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:11.402+0000 7f53dd9cd9c0 1 execute INFO: reshard of bucket "error-at-logrecord-writes" from 11 shards to 12 shards completed successfully 2024-09-14T11:38:11.405 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:11.406+0000 7f5291fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:38:11.410 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:11.410+0000 7f53dd9cd9c0 20 remove_watcher() i=0 2024-09-14T11:38:11.410 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:11.410+0000 7f53dd9cd9c0 2 removed watcher, disabling cache 2024-09-14T11:38:11.412 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:11.414+0000 7f53dd9cd9c0 20 remove_watcher() i=1 2024-09-14T11:38:11.415 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:11.414+0000 7f53dd9cd9c0 20 remove_watcher() i=2 2024-09-14T11:38:11.417 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:11.418+0000 7f53dd9cd9c0 20 remove_watcher() i=3 2024-09-14T11:38:11.419 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:11.418+0000 7f53dd9cd9c0 20 remove_watcher() i=4 2024-09-14T11:38:11.420 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:11.422+0000 7f53dd9cd9c0 20 remove_watcher() i=5 2024-09-14T11:38:11.422 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:11.422+0000 7f53dd9cd9c0 20 remove_watcher() i=6 2024-09-14T11:38:11.423 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:11.426+0000 7f53dd9cd9c0 20 remove_watcher() i=7 2024-09-14T11:38:11.441 INFO:tasks.workunit.client.0.smithi138.stderr:radosgw-admin bucket stats --bucket error-at-logrecord-writes 2024-09-14T11:38:11.471 INFO:tasks.workunit.client.0.smithi138.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:38:11.471 INFO:tasks.workunit.client.0.smithi138.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:38:11.514 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:11.514+0000 7f2954b959c0 20 rados->read ofs=0 len=0 2024-09-14T11:38:11.516 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:11.518+0000 7f2954b959c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:38:11.517 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:11.518+0000 7f2954b959c0 20 realm 2024-09-14T11:38:11.517 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:11.518+0000 7f2954b959c0 20 rados->read ofs=0 len=0 2024-09-14T11:38:11.517 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:11.518+0000 7f2954b959c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:38:11.517 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:11.518+0000 7f2954b959c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:38:11.517 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:11.518+0000 7f2954b959c0 20 rados->read ofs=0 len=0 2024-09-14T11:38:11.517 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:11.518+0000 7f2954b959c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:38:11.518 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:11.518+0000 7f2954b959c0 20 rados->read ofs=0 len=0 2024-09-14T11:38:11.518 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:11.518+0000 7f2954b959c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:38:11.518 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:11.518+0000 7f2954b959c0 20 rados->read ofs=0 len=0 2024-09-14T11:38:11.519 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:11.518+0000 7f2954b959c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:38:11.519 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:11.518+0000 7f2954b959c0 20 searching for the correct realm 2024-09-14T11:38:11.522 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:11.522+0000 7f2952e9c640 0 -- 172.21.15.138:0/2017743770 >> [v2:172.21.15.154:6824/416768175,v1:172.21.15.154:6825/416768175] conn(0x7f294c078040 msgr2=0x7f294c05d010 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-14T11:38:11.737 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:11.738+0000 7f2951e9a640 0 -- 172.21.15.138:0/2017743770 >> [v2:172.21.15.138:6816/326481658,v1:172.21.15.138:6817/326481658] conn(0x7f294c0835e0 msgr2=0x7f294c07f160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:38:11.955 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:11.954+0000 7f2954b959c0 20 RGWRados::pool_iterate: got zone_info.d9e72d30-c60b-4d0d-9267-fdc36392d5ad 2024-09-14T11:38:11.955 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:11.954+0000 7f2954b959c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:38:11.955 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:11.954+0000 7f2954b959c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:38:11.955 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:11.954+0000 7f2954b959c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:38:11.955 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:11.954+0000 7f2954b959c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:38:11.955 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:11.954+0000 7f2954b959c0 20 RGWRados::pool_iterate: got zonegroup_info.65ab941b-da8c-4160-94fb-3672b069d44f 2024-09-14T11:38:11.956 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:11.954+0000 7f2954b959c0 20 rados->read ofs=0 len=0 2024-09-14T11:38:11.956 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:11.958+0000 7f2954b959c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:38:11.956 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:11.958+0000 7f2954b959c0 20 rados->read ofs=0 len=0 2024-09-14T11:38:11.957 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:11.958+0000 7f2954b959c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:38:11.957 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:11.958+0000 7f2954b959c0 20 rados->read ofs=0 len=0 2024-09-14T11:38:11.957 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:11.958+0000 7f2954b959c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:38:11.957 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:11.958+0000 7f2954b959c0 20 zone default found 2024-09-14T11:38:11.958 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:11.958+0000 7f2954b959c0 4 Realm: () 2024-09-14T11:38:11.958 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:11.958+0000 7f2954b959c0 4 ZoneGroup: default (65ab941b-da8c-4160-94fb-3672b069d44f) 2024-09-14T11:38:11.958 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:11.958+0000 7f2954b959c0 4 Zone: default (d9e72d30-c60b-4d0d-9267-fdc36392d5ad) 2024-09-14T11:38:11.958 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:11.958+0000 7f2954b959c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:38:11.958 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:11.958+0000 7f2954b959c0 20 zonegroup default 2024-09-14T11:38:11.958 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:11.958+0000 7f2954b959c0 20 rados->read ofs=0 len=0 2024-09-14T11:38:11.958 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:11.958+0000 7f2954b959c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:38:11.958 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:11.958+0000 7f2954b959c0 20 rados->read ofs=0 len=0 2024-09-14T11:38:11.958 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:11.958+0000 7f2954b959c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:38:11.959 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:11.958+0000 7f2954b959c0 20 rados->read ofs=0 len=0 2024-09-14T11:38:11.959 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:11.958+0000 7f2954b959c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:38:11.960 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:11.958+0000 7f2954b959c0 20 started sync module instance, tier type = 2024-09-14T11:38:11.960 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:11.958+0000 7f2954b959c0 20 started zone id=d9e72d30-c60b-4d0d-9267-fdc36392d5ad (name=default) with tier type = 2024-09-14T11:38:11.983 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:11.982+0000 7f2954b959c0 20 add_watcher() i=0 2024-09-14T11:38:11.983 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:11.982+0000 7f2954b959c0 20 add_watcher() i=1 2024-09-14T11:38:11.983 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:11.982+0000 7f2954b959c0 20 add_watcher() i=2 2024-09-14T11:38:11.983 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:11.982+0000 7f2954b959c0 20 add_watcher() i=3 2024-09-14T11:38:11.983 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:11.982+0000 7f2954b959c0 20 add_watcher() i=4 2024-09-14T11:38:11.983 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:11.982+0000 7f2954b959c0 20 add_watcher() i=5 2024-09-14T11:38:11.983 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:11.982+0000 7f2954b959c0 20 add_watcher() i=6 2024-09-14T11:38:11.985 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:11.986+0000 7f2954b959c0 20 add_watcher() i=7 2024-09-14T11:38:11.986 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:11.986+0000 7f2954b959c0 2 all 8 watchers are set, enabling cache 2024-09-14T11:38:11.989 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:11.990+0000 7f2808fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:38:11.990 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:11.990+0000 7f2954b959c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:38:11.990 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:11.990+0000 7f2954b959c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:38:11.991 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:11.990+0000 7f2954b959c0 5 note: GC not initialized 2024-09-14T11:38:11.991 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:11.990+0000 7f27837fe640 20 reqs_thread_entry: start 2024-09-14T11:38:11.991 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:11.990+0000 7f2954b959c0 20 init_complete bucket index max shards: 11 2024-09-14T11:38:11.991 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:11.990+0000 7f2954b959c0 20 Filter name: none 2024-09-14T11:38:11.992 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:11.994+0000 7f27817fa640 20 reqs_thread_entry: start 2024-09-14T11:38:11.992 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:11.994+0000 7f2954b959c0 20 rados->read ofs=0 len=0 2024-09-14T11:38:11.993 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:11.994+0000 7f2954b959c0 20 rados_obj.operate() r=0 bl.length=193 2024-09-14T11:38:11.993 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:11.994+0000 7f2954b959c0 20 rados->read ofs=0 len=0 2024-09-14T11:38:11.994 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:11.994+0000 7f2954b959c0 20 rados_obj.operate() r=0 bl.length=415 2024-09-14T11:38:11.994 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:11.994+0000 7f2954b959c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:38:11.994 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:11.994+0000 7f2954b959c0 20 rados->read ofs=0 len=0 2024-09-14T11:38:11.995 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:11.994+0000 7f2954b959c0 20 rados_obj.operate() r=0 bl.length=193 2024-09-14T11:38:11.995 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:11.994+0000 7f2954b959c0 20 rados->read ofs=0 len=0 2024-09-14T11:38:11.995 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:11.994+0000 7f2954b959c0 20 rados_obj.operate() r=0 bl.length=415 2024-09-14T11:38:11.995 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:11.994+0000 7f2954b959c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:38:11.998 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:11.998+0000 7f2808fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:38:12.004 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:12.006+0000 7f2954b959c0 20 remove_watcher() i=0 2024-09-14T11:38:12.004 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:12.006+0000 7f2954b959c0 2 removed watcher, disabling cache 2024-09-14T11:38:12.005 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:12.006+0000 7f2954b959c0 20 remove_watcher() i=1 2024-09-14T11:38:12.007 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:12.006+0000 7f2954b959c0 20 remove_watcher() i=2 2024-09-14T11:38:12.009 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:12.010+0000 7f2954b959c0 20 remove_watcher() i=3 2024-09-14T11:38:12.011 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:12.010+0000 7f2954b959c0 20 remove_watcher() i=4 2024-09-14T11:38:12.013 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:12.014+0000 7f2954b959c0 20 remove_watcher() i=5 2024-09-14T11:38:12.014 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:12.014+0000 7f2954b959c0 20 remove_watcher() i=6 2024-09-14T11:38:12.015 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:12.014+0000 7f2954b959c0 20 remove_watcher() i=7 2024-09-14T11:38:12.030 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-14T11:38:12.030 INFO:tasks.workunit.client.0.smithi138.stderr:BUCKET_STATS: 2024-09-14T11:38:12.030 INFO:tasks.workunit.client.0.smithi138.stderr:bucket: error-at-logrecord-writes id: d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.35 num_objects: 19 size_kb: 1 num_shards: 12 2024-09-14T11:38:12.030 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-14T11:38:12.031 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:38:12.031 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-14T11:38:12.054 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:38:12.054 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-14T11:38:12.520 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:38:12.520 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-14T11:38:12.904 INFO:tasks.workunit.client.0.smithi138.stderr:TEST: reshard bucket with abort at logrecord_writes 2024-09-14T11:38:12.905 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-14T11:38:12.907 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:38:12.908 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-14T11:38:13.046 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:38:13.046 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-14T11:38:13.136 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:38:13.136 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-14T11:38:13.241 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:38:13.241 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-14T11:38:13.334 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:38:13.335 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-14T11:38:13.429 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:38:13.429 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-14T11:38:13.519 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:38:13.519 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-14T11:38:13.613 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:38:13.613 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-14T11:38:13.705 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:38:13.705 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-14T11:38:13.797 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:38:13.797 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-14T11:38:13.896 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:38:13.896 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-14T11:38:13.983 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:38:13.983 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-14T11:38:14.073 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:38:14.073 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-14T11:38:14.169 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:38:14.170 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-14T11:38:14.266 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:38:14.266 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-14T11:38:14.357 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:38:14.357 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-14T11:38:14.449 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:38:14.449 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-14T11:38:14.540 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:38:14.540 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-14T11:38:14.634 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:38:14.635 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-14T11:38:14.730 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:38:14.730 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-14T11:38:14.826 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:38:14.827 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-14T11:38:14.917 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:38:14.917 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-14T11:38:15.006 INFO:tasks.workunit.client.0.smithi138.stderr:radosgw-admin bucket stats --bucket abort-at-logrecord-writes 2024-09-14T11:38:15.038 INFO:tasks.workunit.client.0.smithi138.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:38:15.038 INFO:tasks.workunit.client.0.smithi138.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:38:15.085 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:15.086+0000 7ff3d453b9c0 20 rados->read ofs=0 len=0 2024-09-14T11:38:15.087 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:15.086+0000 7ff3d453b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:38:15.087 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:15.086+0000 7ff3d453b9c0 20 realm 2024-09-14T11:38:15.087 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:15.086+0000 7ff3d453b9c0 20 rados->read ofs=0 len=0 2024-09-14T11:38:15.088 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:15.086+0000 7ff3d453b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:38:15.088 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:15.086+0000 7ff3d453b9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:38:15.088 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:15.086+0000 7ff3d453b9c0 20 rados->read ofs=0 len=0 2024-09-14T11:38:15.088 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:15.086+0000 7ff3d453b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:38:15.088 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:15.086+0000 7ff3d453b9c0 20 rados->read ofs=0 len=0 2024-09-14T11:38:15.089 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:15.090+0000 7ff3d453b9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:38:15.089 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:15.090+0000 7ff3d453b9c0 20 rados->read ofs=0 len=0 2024-09-14T11:38:15.090 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:15.090+0000 7ff3d453b9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:38:15.090 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:15.090+0000 7ff3d453b9c0 20 searching for the correct realm 2024-09-14T11:38:15.095 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:15.094+0000 7ff3d1840640 0 -- 172.21.15.138:0/3420064566 >> [v2:172.21.15.154:6808/1468088432,v1:172.21.15.154:6809/1468088432] conn(0x7ff3c40c1070 msgr2=0x7ff3c4102ab0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:38:15.098 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:15.098+0000 7ff3d2041640 0 -- 172.21.15.138:0/3420064566 >> [v2:172.21.15.138:6800/1799335858,v1:172.21.15.138:6801/1799335858] conn(0x564882227d10 msgr2=0x56488222a100 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:38:15.110 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:15.110+0000 7ff3d453b9c0 20 RGWRados::pool_iterate: got zone_info.d9e72d30-c60b-4d0d-9267-fdc36392d5ad 2024-09-14T11:38:15.110 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:15.110+0000 7ff3d453b9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:38:15.110 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:15.110+0000 7ff3d453b9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:38:15.110 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:15.110+0000 7ff3d453b9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:38:15.110 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:15.110+0000 7ff3d453b9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:38:15.110 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:15.110+0000 7ff3d453b9c0 20 RGWRados::pool_iterate: got zonegroup_info.65ab941b-da8c-4160-94fb-3672b069d44f 2024-09-14T11:38:15.110 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:15.110+0000 7ff3d453b9c0 20 rados->read ofs=0 len=0 2024-09-14T11:38:15.111 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:15.110+0000 7ff3d453b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:38:15.111 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:15.110+0000 7ff3d453b9c0 20 rados->read ofs=0 len=0 2024-09-14T11:38:15.112 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:15.110+0000 7ff3d453b9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:38:15.112 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:15.110+0000 7ff3d453b9c0 20 rados->read ofs=0 len=0 2024-09-14T11:38:15.112 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:15.110+0000 7ff3d453b9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:38:15.112 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:15.110+0000 7ff3d453b9c0 20 zone default found 2024-09-14T11:38:15.112 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:15.110+0000 7ff3d453b9c0 4 Realm: () 2024-09-14T11:38:15.112 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:15.110+0000 7ff3d453b9c0 4 ZoneGroup: default (65ab941b-da8c-4160-94fb-3672b069d44f) 2024-09-14T11:38:15.113 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:15.110+0000 7ff3d453b9c0 4 Zone: default (d9e72d30-c60b-4d0d-9267-fdc36392d5ad) 2024-09-14T11:38:15.113 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:15.110+0000 7ff3d453b9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:38:15.113 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:15.110+0000 7ff3d453b9c0 20 zonegroup default 2024-09-14T11:38:15.113 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:15.110+0000 7ff3d453b9c0 20 rados->read ofs=0 len=0 2024-09-14T11:38:15.113 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:15.114+0000 7ff3d453b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:38:15.113 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:15.114+0000 7ff3d453b9c0 20 rados->read ofs=0 len=0 2024-09-14T11:38:15.114 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:15.114+0000 7ff3d453b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:38:15.114 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:15.114+0000 7ff3d453b9c0 20 rados->read ofs=0 len=0 2024-09-14T11:38:15.114 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:15.114+0000 7ff3d453b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:38:15.114 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:15.114+0000 7ff3d453b9c0 20 started sync module instance, tier type = 2024-09-14T11:38:15.114 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:15.114+0000 7ff3d453b9c0 20 started zone id=d9e72d30-c60b-4d0d-9267-fdc36392d5ad (name=default) with tier type = 2024-09-14T11:38:15.128 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:15.130+0000 7ff3d453b9c0 20 add_watcher() i=0 2024-09-14T11:38:15.128 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:15.130+0000 7ff3d453b9c0 20 add_watcher() i=1 2024-09-14T11:38:15.128 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:15.130+0000 7ff3d453b9c0 20 add_watcher() i=2 2024-09-14T11:38:15.128 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:15.130+0000 7ff3d453b9c0 20 add_watcher() i=3 2024-09-14T11:38:15.128 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:15.130+0000 7ff3d453b9c0 20 add_watcher() i=4 2024-09-14T11:38:15.129 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:15.130+0000 7ff3d453b9c0 20 add_watcher() i=5 2024-09-14T11:38:15.129 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:15.130+0000 7ff3d453b9c0 20 add_watcher() i=6 2024-09-14T11:38:15.129 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:15.130+0000 7ff3d453b9c0 20 add_watcher() i=7 2024-09-14T11:38:15.129 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:15.130+0000 7ff3d453b9c0 2 all 8 watchers are set, enabling cache 2024-09-14T11:38:15.132 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:15.130+0000 7ff288fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:38:15.133 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:15.134+0000 7ff3d453b9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:38:15.133 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:15.134+0000 7ff3d453b9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:38:15.133 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:15.134+0000 7ff3d453b9c0 5 note: GC not initialized 2024-09-14T11:38:15.133 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:15.134+0000 7ff2037fe640 20 reqs_thread_entry: start 2024-09-14T11:38:15.133 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:15.134+0000 7ff3d453b9c0 20 init_complete bucket index max shards: 11 2024-09-14T11:38:15.133 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:15.134+0000 7ff3d453b9c0 20 Filter name: none 2024-09-14T11:38:15.133 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:15.134+0000 7ff2017fa640 20 reqs_thread_entry: start 2024-09-14T11:38:15.133 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:15.134+0000 7ff3d453b9c0 20 rados->read ofs=0 len=0 2024-09-14T11:38:15.134 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:15.134+0000 7ff3d453b9c0 20 rados_obj.operate() r=0 bl.length=193 2024-09-14T11:38:15.134 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:15.134+0000 7ff3d453b9c0 20 rados->read ofs=0 len=0 2024-09-14T11:38:15.135 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:15.134+0000 7ff3d453b9c0 20 rados_obj.operate() r=0 bl.length=415 2024-09-14T11:38:15.135 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:15.134+0000 7ff3d453b9c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:38:15.135 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:15.134+0000 7ff3d453b9c0 20 rados->read ofs=0 len=0 2024-09-14T11:38:15.136 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:15.138+0000 7ff3d453b9c0 20 rados_obj.operate() r=0 bl.length=193 2024-09-14T11:38:15.137 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:15.138+0000 7ff3d453b9c0 20 rados->read ofs=0 len=0 2024-09-14T11:38:15.137 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:15.138+0000 7ff3d453b9c0 20 rados_obj.operate() r=0 bl.length=415 2024-09-14T11:38:15.138 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:15.138+0000 7ff3d453b9c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:38:15.140 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:15.142+0000 7ff288fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:38:15.145 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:15.146+0000 7ff3d453b9c0 20 remove_watcher() i=0 2024-09-14T11:38:15.145 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:15.146+0000 7ff3d453b9c0 2 removed watcher, disabling cache 2024-09-14T11:38:15.147 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:15.146+0000 7ff3d453b9c0 20 remove_watcher() i=1 2024-09-14T11:38:15.149 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:15.150+0000 7ff3d453b9c0 20 remove_watcher() i=2 2024-09-14T11:38:15.150 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:15.150+0000 7ff3d453b9c0 20 remove_watcher() i=3 2024-09-14T11:38:15.153 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:15.154+0000 7ff3d453b9c0 20 remove_watcher() i=4 2024-09-14T11:38:15.154 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:15.154+0000 7ff3d453b9c0 20 remove_watcher() i=5 2024-09-14T11:38:15.155 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:15.154+0000 7ff3d453b9c0 20 remove_watcher() i=6 2024-09-14T11:38:15.157 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:15.158+0000 7ff3d453b9c0 20 remove_watcher() i=7 2024-09-14T11:38:15.172 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-14T11:38:15.172 INFO:tasks.workunit.client.0.smithi138.stderr:BUCKET_STATS: 2024-09-14T11:38:15.172 INFO:tasks.workunit.client.0.smithi138.stderr:bucket: abort-at-logrecord-writes id: d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.36 num_objects: 20 size_kb: 1 num_shards: 11 2024-09-14T11:38:15.172 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-14T11:38:15.173 INFO:tasks.workunit.client.0.smithi138.stderr:radosgw-admin bucket reshard --bucket abort-at-logrecord-writes --num-shards 12 --rgw-reshard-bucket-lock-duration 30 --inject-abort-at logrecord_writes 2024-09-14T11:38:15.203 INFO:tasks.workunit.client.0.smithi138.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:38:15.203 INFO:tasks.workunit.client.0.smithi138.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:38:15.247 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:15.246+0000 7f9a6ba0c9c0 20 rados->read ofs=0 len=0 2024-09-14T11:38:15.249 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:15.250+0000 7f9a6ba0c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:38:15.249 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:15.250+0000 7f9a6ba0c9c0 20 realm 2024-09-14T11:38:15.249 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:15.250+0000 7f9a6ba0c9c0 20 rados->read ofs=0 len=0 2024-09-14T11:38:15.249 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:15.250+0000 7f9a6ba0c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:38:15.249 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:15.250+0000 7f9a6ba0c9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:38:15.249 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:15.250+0000 7f9a6ba0c9c0 20 rados->read ofs=0 len=0 2024-09-14T11:38:15.249 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:15.250+0000 7f9a6ba0c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:38:15.249 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:15.250+0000 7f9a6ba0c9c0 20 rados->read ofs=0 len=0 2024-09-14T11:38:15.250 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:15.250+0000 7f9a6ba0c9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:38:15.250 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:15.250+0000 7f9a6ba0c9c0 20 rados->read ofs=0 len=0 2024-09-14T11:38:15.251 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:15.250+0000 7f9a6ba0c9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:38:15.251 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:15.250+0000 7f9a6ba0c9c0 20 searching for the correct realm 2024-09-14T11:38:15.256 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:15.258+0000 7f9a68d11640 0 -- 172.21.15.138:0/233349919 >> [v2:172.21.15.154:6808/1468088432,v1:172.21.15.154:6809/1468088432] conn(0x7f9a5c008030 msgr2=0x7f9a5c05c360 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:38:15.262 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:15.262+0000 7f9a68d11640 0 -- 172.21.15.138:0/233349919 >> [v2:172.21.15.138:6816/326481658,v1:172.21.15.138:6817/326481658] conn(0x7f9a64117000 msgr2=0x7f9a64115860 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:38:15.479 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:15.478+0000 7f9a6ba0c9c0 20 RGWRados::pool_iterate: got zone_info.d9e72d30-c60b-4d0d-9267-fdc36392d5ad 2024-09-14T11:38:15.479 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:15.478+0000 7f9a6ba0c9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:38:15.479 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:15.478+0000 7f9a6ba0c9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:38:15.480 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:15.478+0000 7f9a6ba0c9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:38:15.480 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:15.478+0000 7f9a6ba0c9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:38:15.480 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:15.478+0000 7f9a6ba0c9c0 20 RGWRados::pool_iterate: got zonegroup_info.65ab941b-da8c-4160-94fb-3672b069d44f 2024-09-14T11:38:15.480 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:15.478+0000 7f9a6ba0c9c0 20 rados->read ofs=0 len=0 2024-09-14T11:38:15.480 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:15.478+0000 7f9a6ba0c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:38:15.480 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:15.478+0000 7f9a6ba0c9c0 20 rados->read ofs=0 len=0 2024-09-14T11:38:15.480 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:15.482+0000 7f9a6ba0c9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:38:15.481 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:15.482+0000 7f9a6ba0c9c0 20 rados->read ofs=0 len=0 2024-09-14T11:38:15.481 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:15.482+0000 7f9a6ba0c9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:38:15.482 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:15.482+0000 7f9a6ba0c9c0 20 zone default found 2024-09-14T11:38:15.482 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:15.482+0000 7f9a6ba0c9c0 4 Realm: () 2024-09-14T11:38:15.482 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:15.482+0000 7f9a6ba0c9c0 4 ZoneGroup: default (65ab941b-da8c-4160-94fb-3672b069d44f) 2024-09-14T11:38:15.482 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:15.482+0000 7f9a6ba0c9c0 4 Zone: default (d9e72d30-c60b-4d0d-9267-fdc36392d5ad) 2024-09-14T11:38:15.482 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:15.482+0000 7f9a6ba0c9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:38:15.482 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:15.482+0000 7f9a6ba0c9c0 20 zonegroup default 2024-09-14T11:38:15.482 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:15.482+0000 7f9a6ba0c9c0 20 rados->read ofs=0 len=0 2024-09-14T11:38:15.483 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:15.482+0000 7f9a6ba0c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:38:15.483 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:15.482+0000 7f9a6ba0c9c0 20 rados->read ofs=0 len=0 2024-09-14T11:38:15.483 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:15.482+0000 7f9a6ba0c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:38:15.483 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:15.482+0000 7f9a6ba0c9c0 20 rados->read ofs=0 len=0 2024-09-14T11:38:15.484 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:15.486+0000 7f9a6ba0c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:38:15.484 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:15.486+0000 7f9a6ba0c9c0 20 started sync module instance, tier type = 2024-09-14T11:38:15.484 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:15.486+0000 7f9a6ba0c9c0 20 started zone id=d9e72d30-c60b-4d0d-9267-fdc36392d5ad (name=default) with tier type = 2024-09-14T11:38:15.506 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:15.506+0000 7f9a6ba0c9c0 20 add_watcher() i=0 2024-09-14T11:38:15.507 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:15.506+0000 7f9a6ba0c9c0 20 add_watcher() i=1 2024-09-14T11:38:15.507 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:15.506+0000 7f9a6ba0c9c0 20 add_watcher() i=2 2024-09-14T11:38:15.507 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:15.506+0000 7f9a6ba0c9c0 20 add_watcher() i=3 2024-09-14T11:38:15.507 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:15.506+0000 7f9a6ba0c9c0 20 add_watcher() i=4 2024-09-14T11:38:15.507 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:15.506+0000 7f9a6ba0c9c0 20 add_watcher() i=5 2024-09-14T11:38:15.507 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:15.506+0000 7f9a6ba0c9c0 20 add_watcher() i=6 2024-09-14T11:38:15.508 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:15.510+0000 7f9a6ba0c9c0 20 add_watcher() i=7 2024-09-14T11:38:15.509 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:15.510+0000 7f9a6ba0c9c0 2 all 8 watchers are set, enabling cache 2024-09-14T11:38:15.513 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:15.514+0000 7f991ffe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:38:15.514 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:15.514+0000 7f9a6ba0c9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:38:15.514 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:15.514+0000 7f9a6ba0c9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:38:15.514 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:15.514+0000 7f9a6ba0c9c0 5 note: GC not initialized 2024-09-14T11:38:15.515 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:15.514+0000 7f991efe5640 20 reqs_thread_entry: start 2024-09-14T11:38:15.515 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:15.514+0000 7f9a6ba0c9c0 20 init_complete bucket index max shards: 11 2024-09-14T11:38:15.515 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:15.514+0000 7f9a6ba0c9c0 20 Filter name: none 2024-09-14T11:38:15.515 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:15.514+0000 7f991cfe1640 20 reqs_thread_entry: start 2024-09-14T11:38:15.515 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:15.514+0000 7f9a6ba0c9c0 10 cache get: name=default.rgw.meta+root+abort-at-logrecord-writes : miss 2024-09-14T11:38:15.516 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:15.514+0000 7f9a6ba0c9c0 20 rados->read ofs=0 len=0 2024-09-14T11:38:15.517 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:15.518+0000 7f9a6ba0c9c0 20 rados_obj.operate() r=0 bl.length=193 2024-09-14T11:38:15.517 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:15.518+0000 7f9a6ba0c9c0 10 cache put: name=default.rgw.meta+root+abort-at-logrecord-writes info.flags=0x11 2024-09-14T11:38:15.517 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:15.518+0000 7f9a6ba0c9c0 10 adding default.rgw.meta+root+abort-at-logrecord-writes to cache LRU end 2024-09-14T11:38:15.517 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:15.518+0000 7f9a6ba0c9c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.36 : miss 2024-09-14T11:38:15.517 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:15.518+0000 7f9a6ba0c9c0 20 rados->read ofs=0 len=0 2024-09-14T11:38:15.518 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:15.518+0000 7f9a6ba0c9c0 20 rados_obj.operate() r=0 bl.length=415 2024-09-14T11:38:15.518 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:15.518+0000 7f9a6ba0c9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.36 info.flags=0x17 2024-09-14T11:38:15.519 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:15.518+0000 7f9a6ba0c9c0 10 adding default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.36 to cache LRU end 2024-09-14T11:38:15.519 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:15.518+0000 7f9a6ba0c9c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:38:15.519 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:15.518+0000 7f9a6ba0c9c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:38:15.519 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:15.518+0000 7f9a6ba0c9c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.36 2024-09-14T11:38:15.531 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:15.530+0000 7f9a6ba0c9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.36 info.flags=0x17 2024-09-14T11:38:15.531 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:15.530+0000 7f9a6ba0c9c0 10 moving default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.36 to cache LRU end 2024-09-14T11:38:15.531 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:15.530+0000 7f9a6ba0c9c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:38:15.531 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:15.530+0000 7f9a6ba0c9c0 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-logrecord-writes:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.36, ofs0, ns] 2024-09-14T11:38:15.532 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:15.534+0000 7f994cff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366169 cookie 94160890663888 notifier 7151 bl.length()=923 2024-09-14T11:38:15.532 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:15.534+0000 7f994cff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.36 info.flags=0x17 2024-09-14T11:38:15.532 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:15.534+0000 7f994cff9640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.36 to cache LRU end 2024-09-14T11:38:15.532 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:15.534+0000 7f994cff9640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:38:15.535 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:15.534+0000 7f9a6ba0c9c0 20 handle_bi_update(): bucket=:abort-at-logrecord-writes[d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.36]): orig_sources= new_sources= 2024-09-14T11:38:15.535 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:15.534+0000 7f9a6ba0c9c0 20 handle_bi_update(): bucket=:abort-at-logrecord-writes[d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.36]): potential sources added=[] removed=[] 2024-09-14T11:38:15.535 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:15.534+0000 7f9a6ba0c9c0 20 handle_bi_update(): bucket=:abort-at-logrecord-writes[d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.36]): orig_dests= new_dests= 2024-09-14T11:38:15.535 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:15.534+0000 7f9a6ba0c9c0 20 handle_bi_update(): bucket=:abort-at-logrecord-writes[d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.36]): potential dests added=[] removed=[] 2024-09-14T11:38:15.539 INFO:tasks.workunit.client.0.smithi138.stderr:./src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f9a6ba0c9c0 time 2024-09-14T11:38:15.545043+0000 2024-09-14T11:38:15.540 INFO:tasks.workunit.client.0.smithi138.stderr:./src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-14T11:38:15.541 INFO:tasks.workunit.client.0.smithi138.stderr: ceph version 19.3.0-4907-ga2782315 (a2782315255a3e7d5f6cdc9eb35785187ff6ddf8) squid (dev) 2024-09-14T11:38:15.542 INFO:tasks.workunit.client.0.smithi138.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x121) [0x7f9a6f2e62eb] 2024-09-14T11:38:15.542 INFO:tasks.workunit.client.0.smithi138.stderr: 2: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7f9a6f2e649f] 2024-09-14T11:38:15.542 INFO:tasks.workunit.client.0.smithi138.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55a388c47c01] 2024-09-14T11:38:15.542 INFO:tasks.workunit.client.0.smithi138.stderr: 4: radosgw-admin(+0x142325c) [0x55a3896a625c] 2024-09-14T11:38:15.542 INFO:tasks.workunit.client.0.smithi138.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x55a388c5cecd] 2024-09-14T11:38:15.542 INFO:tasks.workunit.client.0.smithi138.stderr: 6: main() 2024-09-14T11:38:15.542 INFO:tasks.workunit.client.0.smithi138.stderr: 7: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7f9a6e14cd90] 2024-09-14T11:38:15.542 INFO:tasks.workunit.client.0.smithi138.stderr: 8: __libc_start_main() 2024-09-14T11:38:15.542 INFO:tasks.workunit.client.0.smithi138.stderr: 9: _start() 2024-09-14T11:38:15.543 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:15.542+0000 7f9a6ba0c9c0 -1 ./src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f9a6ba0c9c0 time 2024-09-14T11:38:15.545043+0000 2024-09-14T11:38:15.543 INFO:tasks.workunit.client.0.smithi138.stderr:./src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-14T11:38:15.543 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-14T11:38:15.543 INFO:tasks.workunit.client.0.smithi138.stderr: ceph version 19.3.0-4907-ga2782315 (a2782315255a3e7d5f6cdc9eb35785187ff6ddf8) squid (dev) 2024-09-14T11:38:15.543 INFO:tasks.workunit.client.0.smithi138.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x121) [0x7f9a6f2e62eb] 2024-09-14T11:38:15.543 INFO:tasks.workunit.client.0.smithi138.stderr: 2: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7f9a6f2e649f] 2024-09-14T11:38:15.543 INFO:tasks.workunit.client.0.smithi138.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55a388c47c01] 2024-09-14T11:38:15.543 INFO:tasks.workunit.client.0.smithi138.stderr: 4: radosgw-admin(+0x142325c) [0x55a3896a625c] 2024-09-14T11:38:15.543 INFO:tasks.workunit.client.0.smithi138.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x55a388c5cecd] 2024-09-14T11:38:15.543 INFO:tasks.workunit.client.0.smithi138.stderr: 6: main() 2024-09-14T11:38:15.544 INFO:tasks.workunit.client.0.smithi138.stderr: 7: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7f9a6e14cd90] 2024-09-14T11:38:15.544 INFO:tasks.workunit.client.0.smithi138.stderr: 8: __libc_start_main() 2024-09-14T11:38:15.544 INFO:tasks.workunit.client.0.smithi138.stderr: 9: _start() 2024-09-14T11:38:15.544 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-14T11:38:15.544 INFO:tasks.workunit.client.0.smithi138.stderr:*** Caught signal (Aborted) ** 2024-09-14T11:38:15.544 INFO:tasks.workunit.client.0.smithi138.stderr: in thread 7f9a6ba0c9c0 thread_name:radosgw-admin 2024-09-14T11:38:15.568 INFO:tasks.workunit.client.0.smithi138.stderr: ceph version 19.3.0-4907-ga2782315 (a2782315255a3e7d5f6cdc9eb35785187ff6ddf8) squid (dev) 2024-09-14T11:38:15.568 INFO:tasks.workunit.client.0.smithi138.stderr: 1: /lib/x86_64-linux-gnu/libc.so.6(+0x42520) [0x7f9a6e165520] 2024-09-14T11:38:15.568 INFO:tasks.workunit.client.0.smithi138.stderr: 2: pthread_kill() 2024-09-14T11:38:15.568 INFO:tasks.workunit.client.0.smithi138.stderr: 3: raise() 2024-09-14T11:38:15.568 INFO:tasks.workunit.client.0.smithi138.stderr: 4: abort() 2024-09-14T11:38:15.568 INFO:tasks.workunit.client.0.smithi138.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x17b) [0x7f9a6f2e6345] 2024-09-14T11:38:15.568 INFO:tasks.workunit.client.0.smithi138.stderr: 6: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7f9a6f2e649f] 2024-09-14T11:38:15.569 INFO:tasks.workunit.client.0.smithi138.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55a388c47c01] 2024-09-14T11:38:15.569 INFO:tasks.workunit.client.0.smithi138.stderr: 8: radosgw-admin(+0x142325c) [0x55a3896a625c] 2024-09-14T11:38:15.569 INFO:tasks.workunit.client.0.smithi138.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x55a388c5cecd] 2024-09-14T11:38:15.569 INFO:tasks.workunit.client.0.smithi138.stderr: 10: main() 2024-09-14T11:38:15.569 INFO:tasks.workunit.client.0.smithi138.stderr: 11: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7f9a6e14cd90] 2024-09-14T11:38:15.569 INFO:tasks.workunit.client.0.smithi138.stderr: 12: __libc_start_main() 2024-09-14T11:38:15.569 INFO:tasks.workunit.client.0.smithi138.stderr: 13: _start() 2024-09-14T11:38:15.569 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:15.542+0000 7f9a6ba0c9c0 -1 *** Caught signal (Aborted) ** 2024-09-14T11:38:15.569 INFO:tasks.workunit.client.0.smithi138.stderr: in thread 7f9a6ba0c9c0 thread_name:radosgw-admin 2024-09-14T11:38:15.569 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-14T11:38:15.569 INFO:tasks.workunit.client.0.smithi138.stderr: ceph version 19.3.0-4907-ga2782315 (a2782315255a3e7d5f6cdc9eb35785187ff6ddf8) squid (dev) 2024-09-14T11:38:15.569 INFO:tasks.workunit.client.0.smithi138.stderr: 1: /lib/x86_64-linux-gnu/libc.so.6(+0x42520) [0x7f9a6e165520] 2024-09-14T11:38:15.570 INFO:tasks.workunit.client.0.smithi138.stderr: 2: pthread_kill() 2024-09-14T11:38:15.570 INFO:tasks.workunit.client.0.smithi138.stderr: 3: raise() 2024-09-14T11:38:15.570 INFO:tasks.workunit.client.0.smithi138.stderr: 4: abort() 2024-09-14T11:38:15.570 INFO:tasks.workunit.client.0.smithi138.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x17b) [0x7f9a6f2e6345] 2024-09-14T11:38:15.570 INFO:tasks.workunit.client.0.smithi138.stderr: 6: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7f9a6f2e649f] 2024-09-14T11:38:15.570 INFO:tasks.workunit.client.0.smithi138.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55a388c47c01] 2024-09-14T11:38:15.570 INFO:tasks.workunit.client.0.smithi138.stderr: 8: radosgw-admin(+0x142325c) [0x55a3896a625c] 2024-09-14T11:38:15.570 INFO:tasks.workunit.client.0.smithi138.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x55a388c5cecd] 2024-09-14T11:38:15.570 INFO:tasks.workunit.client.0.smithi138.stderr: 10: main() 2024-09-14T11:38:15.570 INFO:tasks.workunit.client.0.smithi138.stderr: 11: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7f9a6e14cd90] 2024-09-14T11:38:15.570 INFO:tasks.workunit.client.0.smithi138.stderr: 12: __libc_start_main() 2024-09-14T11:38:15.571 INFO:tasks.workunit.client.0.smithi138.stderr: 13: _start() 2024-09-14T11:38:15.571 INFO:tasks.workunit.client.0.smithi138.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-14T11:38:15.571 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-14T11:38:15.571 INFO:tasks.workunit.client.0.smithi138.stderr:--- begin dump of recent events --- 2024-09-14T11:38:15.571 INFO:tasks.workunit.client.0.smithi138.stderr: -499> 2024-09-14T11:38:15.226+0000 7f9a69d13640 10 monclient: _finish_hunting 0 2024-09-14T11:38:15.571 INFO:tasks.workunit.client.0.smithi138.stderr: -498> 2024-09-14T11:38:15.226+0000 7f9a69d13640 1 monclient: found mon.noname-c 2024-09-14T11:38:15.571 INFO:tasks.workunit.client.0.smithi138.stderr: -497> 2024-09-14T11:38:15.226+0000 7f9a69d13640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.138:3301/0 2024-09-14T11:38:15.571 INFO:tasks.workunit.client.0.smithi138.stderr: -496> 2024-09-14T11:38:15.226+0000 7f9957606640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:38:15.571 INFO:tasks.workunit.client.0.smithi138.stderr: -495> 2024-09-14T11:38:15.226+0000 7f9957606640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-14T11:38:15.571 INFO:tasks.workunit.client.0.smithi138.stderr: -494> 2024-09-14T11:38:15.226+0000 7f9957606640 10 monclient: dump: 2024-09-14T11:38:15.571 INFO:tasks.workunit.client.0.smithi138.stderr:epoch 1 2024-09-14T11:38:15.571 INFO:tasks.workunit.client.0.smithi138.stderr:fsid 3f225f43-83a6-4aeb-b798-1f04bb49d597 2024-09-14T11:38:15.572 INFO:tasks.workunit.client.0.smithi138.stderr:last_changed 2024-09-14T11:07:09.252780+0000 2024-09-14T11:38:15.572 INFO:tasks.workunit.client.0.smithi138.stderr:created 2024-09-14T11:07:09.252780+0000 2024-09-14T11:38:15.572 INFO:tasks.workunit.client.0.smithi138.stderr:min_mon_release 19 (squid) 2024-09-14T11:38:15.572 INFO:tasks.workunit.client.0.smithi138.stderr:election_strategy: 1 2024-09-14T11:38:15.572 INFO:tasks.workunit.client.0.smithi138.stderr:0: [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] mon.a 2024-09-14T11:38:15.572 INFO:tasks.workunit.client.0.smithi138.stderr:1: [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] mon.b 2024-09-14T11:38:15.572 INFO:tasks.workunit.client.0.smithi138.stderr:2: [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] mon.c 2024-09-14T11:38:15.572 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-14T11:38:15.572 INFO:tasks.workunit.client.0.smithi138.stderr: -493> 2024-09-14T11:38:15.226+0000 7f9957606640 10 monclient: _finish_auth 0 2024-09-14T11:38:15.572 INFO:tasks.workunit.client.0.smithi138.stderr: -492> 2024-09-14T11:38:15.226+0000 7f9957606640 10 monclient: _check_auth_tickets 2024-09-14T11:38:15.572 INFO:tasks.workunit.client.0.smithi138.stderr: -491> 2024-09-14T11:38:15.226+0000 7f9957606640 10 monclient: handle_config config(0 keys) 2024-09-14T11:38:15.572 INFO:tasks.workunit.client.0.smithi138.stderr: -490> 2024-09-14T11:38:15.226+0000 7f9957606640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:38:15.573 INFO:tasks.workunit.client.0.smithi138.stderr: -489> 2024-09-14T11:38:15.226+0000 7f9957606640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-14T11:38:15.573 INFO:tasks.workunit.client.0.smithi138.stderr: -488> 2024-09-14T11:38:15.226+0000 7f9957606640 10 monclient: dump: 2024-09-14T11:38:15.573 INFO:tasks.workunit.client.0.smithi138.stderr:epoch 1 2024-09-14T11:38:15.573 INFO:tasks.workunit.client.0.smithi138.stderr:fsid 3f225f43-83a6-4aeb-b798-1f04bb49d597 2024-09-14T11:38:15.573 INFO:tasks.workunit.client.0.smithi138.stderr:last_changed 2024-09-14T11:07:09.252780+0000 2024-09-14T11:38:15.573 INFO:tasks.workunit.client.0.smithi138.stderr:created 2024-09-14T11:07:09.252780+0000 2024-09-14T11:38:15.573 INFO:tasks.workunit.client.0.smithi138.stderr:min_mon_release 19 (squid) 2024-09-14T11:38:15.573 INFO:tasks.workunit.client.0.smithi138.stderr:election_strategy: 1 2024-09-14T11:38:15.573 INFO:tasks.workunit.client.0.smithi138.stderr:0: [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] mon.a 2024-09-14T11:38:15.573 INFO:tasks.workunit.client.0.smithi138.stderr:1: [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] mon.b 2024-09-14T11:38:15.573 INFO:tasks.workunit.client.0.smithi138.stderr:2: [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] mon.c 2024-09-14T11:38:15.573 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-14T11:38:15.574 INFO:tasks.workunit.client.0.smithi138.stderr: -487> 2024-09-14T11:38:15.226+0000 7f9a6ba0c9c0 5 monclient: authenticate success, global_id 7139 2024-09-14T11:38:15.574 INFO:tasks.workunit.client.0.smithi138.stderr: -486> 2024-09-14T11:38:15.226+0000 7f9a6ba0c9c0 10 monclient: get_monmap_and_config success 2024-09-14T11:38:15.574 INFO:tasks.workunit.client.0.smithi138.stderr: -485> 2024-09-14T11:38:15.226+0000 7f9a6ba0c9c0 4 set_mon_vals no callback set 2024-09-14T11:38:15.574 INFO:tasks.workunit.client.0.smithi138.stderr: -484> 2024-09-14T11:38:15.226+0000 7f9a6ba0c9c0 10 monclient: shutdown 2024-09-14T11:38:15.574 INFO:tasks.workunit.client.0.smithi138.stderr: -483> 2024-09-14T11:38:15.226+0000 7f9a6ba0c9c0 5 asok(0x55a38a3fed90) unregister_commands rotate-key 2024-09-14T11:38:15.574 INFO:tasks.workunit.client.0.smithi138.stderr: -482> 2024-09-14T11:38:15.226+0000 7f9a6ba0c9c0 10 monclient: build_initial_monmap 2024-09-14T11:38:15.574 INFO:tasks.workunit.client.0.smithi138.stderr: -481> 2024-09-14T11:38:15.226+0000 7f9a6ba0c9c0 1 build_initial for_mkfs: 0 2024-09-14T11:38:15.574 INFO:tasks.workunit.client.0.smithi138.stderr: -480> 2024-09-14T11:38:15.226+0000 7f9a6ba0c9c0 10 monclient: monmap: 2024-09-14T11:38:15.574 INFO:tasks.workunit.client.0.smithi138.stderr:epoch 0 2024-09-14T11:38:15.574 INFO:tasks.workunit.client.0.smithi138.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-14T11:38:15.574 INFO:tasks.workunit.client.0.smithi138.stderr:last_changed 0.000000 2024-09-14T11:38:15.574 INFO:tasks.workunit.client.0.smithi138.stderr:created 0.000000 2024-09-14T11:38:15.574 INFO:tasks.workunit.client.0.smithi138.stderr:min_mon_release 0 (unknown) 2024-09-14T11:38:15.574 INFO:tasks.workunit.client.0.smithi138.stderr:election_strategy: 1 2024-09-14T11:38:15.575 INFO:tasks.workunit.client.0.smithi138.stderr:0: [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] mon.noname-a 2024-09-14T11:38:15.575 INFO:tasks.workunit.client.0.smithi138.stderr:1: [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] mon.noname-b 2024-09-14T11:38:15.575 INFO:tasks.workunit.client.0.smithi138.stderr:2: [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] mon.noname-c 2024-09-14T11:38:15.575 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-14T11:38:15.575 INFO:tasks.workunit.client.0.smithi138.stderr: -479> 2024-09-14T11:38:15.226+0000 7f9a6ba0c9c0 5 AuthRegistry(0x55a38a632d10) adding auth protocol: cephx 2024-09-14T11:38:15.575 INFO:tasks.workunit.client.0.smithi138.stderr: -478> 2024-09-14T11:38:15.226+0000 7f9a6ba0c9c0 5 AuthRegistry(0x55a38a632d10) adding auth protocol: cephx 2024-09-14T11:38:15.575 INFO:tasks.workunit.client.0.smithi138.stderr: -477> 2024-09-14T11:38:15.226+0000 7f9a6ba0c9c0 5 AuthRegistry(0x55a38a632d10) adding auth protocol: cephx 2024-09-14T11:38:15.575 INFO:tasks.workunit.client.0.smithi138.stderr: -476> 2024-09-14T11:38:15.226+0000 7f9a6ba0c9c0 5 AuthRegistry(0x55a38a632d10) adding con mode: secure 2024-09-14T11:38:15.575 INFO:tasks.workunit.client.0.smithi138.stderr: -475> 2024-09-14T11:38:15.226+0000 7f9a6ba0c9c0 5 AuthRegistry(0x55a38a632d10) adding con mode: crc 2024-09-14T11:38:15.575 INFO:tasks.workunit.client.0.smithi138.stderr: -474> 2024-09-14T11:38:15.226+0000 7f9a6ba0c9c0 5 AuthRegistry(0x55a38a632d10) adding con mode: secure 2024-09-14T11:38:15.575 INFO:tasks.workunit.client.0.smithi138.stderr: -473> 2024-09-14T11:38:15.226+0000 7f9a6ba0c9c0 5 AuthRegistry(0x55a38a632d10) adding con mode: crc 2024-09-14T11:38:15.575 INFO:tasks.workunit.client.0.smithi138.stderr: -472> 2024-09-14T11:38:15.226+0000 7f9a6ba0c9c0 5 AuthRegistry(0x55a38a632d10) adding con mode: secure 2024-09-14T11:38:15.575 INFO:tasks.workunit.client.0.smithi138.stderr: -471> 2024-09-14T11:38:15.226+0000 7f9a6ba0c9c0 5 AuthRegistry(0x55a38a632d10) adding con mode: crc 2024-09-14T11:38:15.576 INFO:tasks.workunit.client.0.smithi138.stderr: -470> 2024-09-14T11:38:15.226+0000 7f9a6ba0c9c0 5 AuthRegistry(0x55a38a632d10) adding con mode: crc 2024-09-14T11:38:15.576 INFO:tasks.workunit.client.0.smithi138.stderr: -469> 2024-09-14T11:38:15.226+0000 7f9a6ba0c9c0 5 AuthRegistry(0x55a38a632d10) adding con mode: secure 2024-09-14T11:38:15.576 INFO:tasks.workunit.client.0.smithi138.stderr: -468> 2024-09-14T11:38:15.226+0000 7f9a6ba0c9c0 5 AuthRegistry(0x55a38a632d10) adding con mode: crc 2024-09-14T11:38:15.576 INFO:tasks.workunit.client.0.smithi138.stderr: -467> 2024-09-14T11:38:15.226+0000 7f9a6ba0c9c0 5 AuthRegistry(0x55a38a632d10) adding con mode: secure 2024-09-14T11:38:15.576 INFO:tasks.workunit.client.0.smithi138.stderr: -466> 2024-09-14T11:38:15.226+0000 7f9a6ba0c9c0 5 AuthRegistry(0x55a38a632d10) adding con mode: crc 2024-09-14T11:38:15.576 INFO:tasks.workunit.client.0.smithi138.stderr: -465> 2024-09-14T11:38:15.226+0000 7f9a6ba0c9c0 5 AuthRegistry(0x55a38a632d10) adding con mode: secure 2024-09-14T11:38:15.576 INFO:tasks.workunit.client.0.smithi138.stderr: -464> 2024-09-14T11:38:15.226+0000 7f9a6ba0c9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:38:15.576 INFO:tasks.workunit.client.0.smithi138.stderr: -463> 2024-09-14T11:38:15.226+0000 7f9a6ba0c9c0 1 librados: starting msgr at 2024-09-14T11:38:15.576 INFO:tasks.workunit.client.0.smithi138.stderr: -462> 2024-09-14T11:38:15.226+0000 7f9a6ba0c9c0 1 librados: starting objecter 2024-09-14T11:38:15.576 INFO:tasks.workunit.client.0.smithi138.stderr: -461> 2024-09-14T11:38:15.226+0000 7f9a6ba0c9c0 5 asok(0x55a38a3fed90) register_command objecter_requests hook 0x55a38a639290 2024-09-14T11:38:15.576 INFO:tasks.workunit.client.0.smithi138.stderr: -460> 2024-09-14T11:38:15.226+0000 7f9a6ba0c9c0 1 librados: setting wanted keys 2024-09-14T11:38:15.576 INFO:tasks.workunit.client.0.smithi138.stderr: -459> 2024-09-14T11:38:15.226+0000 7f9a6ba0c9c0 1 librados: calling monclient init 2024-09-14T11:38:15.576 INFO:tasks.workunit.client.0.smithi138.stderr: -458> 2024-09-14T11:38:15.226+0000 7f9a6ba0c9c0 10 monclient: init 2024-09-14T11:38:15.577 INFO:tasks.workunit.client.0.smithi138.stderr: -457> 2024-09-14T11:38:15.226+0000 7f9a6ba0c9c0 5 AuthRegistry(0x55a38a608ab0) adding auth protocol: cephx 2024-09-14T11:38:15.577 INFO:tasks.workunit.client.0.smithi138.stderr: -456> 2024-09-14T11:38:15.226+0000 7f9a6ba0c9c0 5 AuthRegistry(0x55a38a608ab0) adding auth protocol: cephx 2024-09-14T11:38:15.577 INFO:tasks.workunit.client.0.smithi138.stderr: -455> 2024-09-14T11:38:15.226+0000 7f9a6ba0c9c0 5 AuthRegistry(0x55a38a608ab0) adding auth protocol: cephx 2024-09-14T11:38:15.577 INFO:tasks.workunit.client.0.smithi138.stderr: -454> 2024-09-14T11:38:15.226+0000 7f9a6ba0c9c0 5 AuthRegistry(0x55a38a608ab0) adding con mode: secure 2024-09-14T11:38:15.577 INFO:tasks.workunit.client.0.smithi138.stderr: -453> 2024-09-14T11:38:15.226+0000 7f9a6ba0c9c0 5 AuthRegistry(0x55a38a608ab0) adding con mode: crc 2024-09-14T11:38:15.577 INFO:tasks.workunit.client.0.smithi138.stderr: -452> 2024-09-14T11:38:15.226+0000 7f9a6ba0c9c0 5 AuthRegistry(0x55a38a608ab0) adding con mode: secure 2024-09-14T11:38:15.577 INFO:tasks.workunit.client.0.smithi138.stderr: -451> 2024-09-14T11:38:15.226+0000 7f9a6ba0c9c0 5 AuthRegistry(0x55a38a608ab0) adding con mode: crc 2024-09-14T11:38:15.577 INFO:tasks.workunit.client.0.smithi138.stderr: -450> 2024-09-14T11:38:15.226+0000 7f9a6ba0c9c0 5 AuthRegistry(0x55a38a608ab0) adding con mode: secure 2024-09-14T11:38:15.577 INFO:tasks.workunit.client.0.smithi138.stderr: -449> 2024-09-14T11:38:15.226+0000 7f9a6ba0c9c0 5 AuthRegistry(0x55a38a608ab0) adding con mode: crc 2024-09-14T11:38:15.577 INFO:tasks.workunit.client.0.smithi138.stderr: -448> 2024-09-14T11:38:15.226+0000 7f9a6ba0c9c0 5 AuthRegistry(0x55a38a608ab0) adding con mode: crc 2024-09-14T11:38:15.577 INFO:tasks.workunit.client.0.smithi138.stderr: -447> 2024-09-14T11:38:15.226+0000 7f9a6ba0c9c0 5 AuthRegistry(0x55a38a608ab0) adding con mode: secure 2024-09-14T11:38:15.577 INFO:tasks.workunit.client.0.smithi138.stderr: -446> 2024-09-14T11:38:15.226+0000 7f9a6ba0c9c0 5 AuthRegistry(0x55a38a608ab0) adding con mode: crc 2024-09-14T11:38:15.578 INFO:tasks.workunit.client.0.smithi138.stderr: -445> 2024-09-14T11:38:15.226+0000 7f9a6ba0c9c0 5 AuthRegistry(0x55a38a608ab0) adding con mode: secure 2024-09-14T11:38:15.578 INFO:tasks.workunit.client.0.smithi138.stderr: -444> 2024-09-14T11:38:15.226+0000 7f9a6ba0c9c0 5 AuthRegistry(0x55a38a608ab0) adding con mode: crc 2024-09-14T11:38:15.578 INFO:tasks.workunit.client.0.smithi138.stderr: -443> 2024-09-14T11:38:15.226+0000 7f9a6ba0c9c0 5 AuthRegistry(0x55a38a608ab0) adding con mode: secure 2024-09-14T11:38:15.578 INFO:tasks.workunit.client.0.smithi138.stderr: -442> 2024-09-14T11:38:15.226+0000 7f9a6ba0c9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:38:15.578 INFO:tasks.workunit.client.0.smithi138.stderr: -441> 2024-09-14T11:38:15.226+0000 7f9a6ba0c9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:38:15.578 INFO:tasks.workunit.client.0.smithi138.stderr: -440> 2024-09-14T11:38:15.226+0000 7f9a6ba0c9c0 5 asok(0x55a38a3fed90) register_command rotate-key hook 0x55a38a608bf8 2024-09-14T11:38:15.578 INFO:tasks.workunit.client.0.smithi138.stderr: -439> 2024-09-14T11:38:15.226+0000 7f9a6ba0c9c0 10 monclient: _reopen_session rank -1 2024-09-14T11:38:15.578 INFO:tasks.workunit.client.0.smithi138.stderr: -438> 2024-09-14T11:38:15.226+0000 7f9a6ba0c9c0 10 monclient: _add_conns ranks=[0,1,2] 2024-09-14T11:38:15.578 INFO:tasks.workunit.client.0.smithi138.stderr: -437> 2024-09-14T11:38:15.226+0000 7f9a6ba0c9c0 10 monclient(hunting): picked mon.noname-a con 0x55a38a4b8a00 addr [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] 2024-09-14T11:38:15.578 INFO:tasks.workunit.client.0.smithi138.stderr: -436> 2024-09-14T11:38:15.226+0000 7f9a6ba0c9c0 10 monclient(hunting): picked mon.noname-b con 0x55a38a4c1270 addr [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] 2024-09-14T11:38:15.578 INFO:tasks.workunit.client.0.smithi138.stderr: -435> 2024-09-14T11:38:15.226+0000 7f9a6ba0c9c0 10 monclient(hunting): picked mon.noname-c con 0x55a38a551c70 addr [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] 2024-09-14T11:38:15.578 INFO:tasks.workunit.client.0.smithi138.stderr: -434> 2024-09-14T11:38:15.226+0000 7f9a6ba0c9c0 10 monclient(hunting): start opening mon connection 2024-09-14T11:38:15.578 INFO:tasks.workunit.client.0.smithi138.stderr: -433> 2024-09-14T11:38:15.226+0000 7f9a6ba0c9c0 10 monclient(hunting): start opening mon connection 2024-09-14T11:38:15.579 INFO:tasks.workunit.client.0.smithi138.stderr: -432> 2024-09-14T11:38:15.226+0000 7f9a6ba0c9c0 10 monclient(hunting): start opening mon connection 2024-09-14T11:38:15.579 INFO:tasks.workunit.client.0.smithi138.stderr: -431> 2024-09-14T11:38:15.226+0000 7f9a6ba0c9c0 10 monclient(hunting): _renew_subs 2024-09-14T11:38:15.579 INFO:tasks.workunit.client.0.smithi138.stderr: -430> 2024-09-14T11:38:15.226+0000 7f9a6ba0c9c0 10 monclient(hunting): authenticate will time out at 2831.191581s 2024-09-14T11:38:15.579 INFO:tasks.workunit.client.0.smithi138.stderr: -429> 2024-09-14T11:38:15.226+0000 7f9a69512640 10 monclient(hunting): get_auth_request con 0x55a38a4b8a00 auth_method 0 2024-09-14T11:38:15.579 INFO:tasks.workunit.client.0.smithi138.stderr: -428> 2024-09-14T11:38:15.226+0000 7f9a69512640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:38:15.579 INFO:tasks.workunit.client.0.smithi138.stderr: -427> 2024-09-14T11:38:15.226+0000 7f9a69512640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:38:15.579 INFO:tasks.workunit.client.0.smithi138.stderr: -426> 2024-09-14T11:38:15.226+0000 7f9a69512640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:38:15.579 INFO:tasks.workunit.client.0.smithi138.stderr: -425> 2024-09-14T11:38:15.226+0000 7f9a69d13640 10 monclient(hunting): get_auth_request con 0x55a38a551c70 auth_method 0 2024-09-14T11:38:15.579 INFO:tasks.workunit.client.0.smithi138.stderr: -424> 2024-09-14T11:38:15.226+0000 7f9a69d13640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:38:15.579 INFO:tasks.workunit.client.0.smithi138.stderr: -423> 2024-09-14T11:38:15.226+0000 7f9a69d13640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:38:15.579 INFO:tasks.workunit.client.0.smithi138.stderr: -422> 2024-09-14T11:38:15.226+0000 7f9a69d13640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:38:15.579 INFO:tasks.workunit.client.0.smithi138.stderr: -421> 2024-09-14T11:38:15.226+0000 7f9a69512640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:38:15.580 INFO:tasks.workunit.client.0.smithi138.stderr: -420> 2024-09-14T11:38:15.226+0000 7f9a69512640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:38:15.580 INFO:tasks.workunit.client.0.smithi138.stderr: -419> 2024-09-14T11:38:15.226+0000 7f9a69512640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:38:15.580 INFO:tasks.workunit.client.0.smithi138.stderr: -418> 2024-09-14T11:38:15.226+0000 7f9a69d13640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:38:15.580 INFO:tasks.workunit.client.0.smithi138.stderr: -417> 2024-09-14T11:38:15.226+0000 7f9a69d13640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:38:15.580 INFO:tasks.workunit.client.0.smithi138.stderr: -416> 2024-09-14T11:38:15.226+0000 7f9a69d13640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:38:15.580 INFO:tasks.workunit.client.0.smithi138.stderr: -415> 2024-09-14T11:38:15.226+0000 7f9a69512640 10 monclient(hunting): handle_auth_done global_id 7626 payload 824 2024-09-14T11:38:15.580 INFO:tasks.workunit.client.0.smithi138.stderr: -414> 2024-09-14T11:38:15.230+0000 7f9a69512640 10 monclient: _finish_hunting 0 2024-09-14T11:38:15.580 INFO:tasks.workunit.client.0.smithi138.stderr: -413> 2024-09-14T11:38:15.230+0000 7f9a69512640 1 monclient: found mon.noname-a 2024-09-14T11:38:15.580 INFO:tasks.workunit.client.0.smithi138.stderr: -412> 2024-09-14T11:38:15.230+0000 7f9a69512640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.138:3300/0 2024-09-14T11:38:15.580 INFO:tasks.workunit.client.0.smithi138.stderr: -411> 2024-09-14T11:38:15.230+0000 7f9955e03640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:38:15.580 INFO:tasks.workunit.client.0.smithi138.stderr: -410> 2024-09-14T11:38:15.230+0000 7f9955e03640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-14T11:38:15.580 INFO:tasks.workunit.client.0.smithi138.stderr: -409> 2024-09-14T11:38:15.230+0000 7f9955e03640 10 monclient: dump: 2024-09-14T11:38:15.580 INFO:tasks.workunit.client.0.smithi138.stderr:epoch 1 2024-09-14T11:38:15.581 INFO:tasks.workunit.client.0.smithi138.stderr:fsid 3f225f43-83a6-4aeb-b798-1f04bb49d597 2024-09-14T11:38:15.581 INFO:tasks.workunit.client.0.smithi138.stderr:last_changed 2024-09-14T11:07:09.252780+0000 2024-09-14T11:38:15.581 INFO:tasks.workunit.client.0.smithi138.stderr:created 2024-09-14T11:07:09.252780+0000 2024-09-14T11:38:15.581 INFO:tasks.workunit.client.0.smithi138.stderr:min_mon_release 19 (squid) 2024-09-14T11:38:15.581 INFO:tasks.workunit.client.0.smithi138.stderr:election_strategy: 1 2024-09-14T11:38:15.581 INFO:tasks.workunit.client.0.smithi138.stderr:0: [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] mon.a 2024-09-14T11:38:15.581 INFO:tasks.workunit.client.0.smithi138.stderr:1: [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] mon.b 2024-09-14T11:38:15.581 INFO:tasks.workunit.client.0.smithi138.stderr:2: [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] mon.c 2024-09-14T11:38:15.581 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-14T11:38:15.581 INFO:tasks.workunit.client.0.smithi138.stderr: -408> 2024-09-14T11:38:15.230+0000 7f9955e03640 10 monclient: _finish_auth 0 2024-09-14T11:38:15.581 INFO:tasks.workunit.client.0.smithi138.stderr: -407> 2024-09-14T11:38:15.230+0000 7f9955e03640 10 monclient: _check_auth_tickets 2024-09-14T11:38:15.582 INFO:tasks.workunit.client.0.smithi138.stderr: -406> 2024-09-14T11:38:15.230+0000 7f9955e03640 10 monclient: handle_config config(0 keys) 2024-09-14T11:38:15.582 INFO:tasks.workunit.client.0.smithi138.stderr: -405> 2024-09-14T11:38:15.230+0000 7f9955e03640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:38:15.582 INFO:tasks.workunit.client.0.smithi138.stderr: -404> 2024-09-14T11:38:15.230+0000 7f9955e03640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-14T11:38:15.582 INFO:tasks.workunit.client.0.smithi138.stderr: -403> 2024-09-14T11:38:15.230+0000 7f9955e03640 10 monclient: dump: 2024-09-14T11:38:15.582 INFO:tasks.workunit.client.0.smithi138.stderr:epoch 1 2024-09-14T11:38:15.582 INFO:tasks.workunit.client.0.smithi138.stderr:fsid 3f225f43-83a6-4aeb-b798-1f04bb49d597 2024-09-14T11:38:15.582 INFO:tasks.workunit.client.0.smithi138.stderr:last_changed 2024-09-14T11:07:09.252780+0000 2024-09-14T11:38:15.582 INFO:tasks.workunit.client.0.smithi138.stderr:created 2024-09-14T11:07:09.252780+0000 2024-09-14T11:38:15.582 INFO:tasks.workunit.client.0.smithi138.stderr:min_mon_release 19 (squid) 2024-09-14T11:38:15.584 INFO:tasks.workunit.client.0.smithi138.stderr:election_strategy: 1 2024-09-14T11:38:15.584 INFO:tasks.workunit.client.0.smithi138.stderr:0: [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] mon.a 2024-09-14T11:38:15.584 INFO:tasks.workunit.client.0.smithi138.stderr:1: [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] mon.b 2024-09-14T11:38:15.584 INFO:tasks.workunit.client.0.smithi138.stderr:2: [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] mon.c 2024-09-14T11:38:15.584 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-14T11:38:15.584 INFO:tasks.workunit.client.0.smithi138.stderr: -402> 2024-09-14T11:38:15.230+0000 7f9a6ba0c9c0 5 monclient: authenticate success, global_id 7626 2024-09-14T11:38:15.584 INFO:tasks.workunit.client.0.smithi138.stderr: -401> 2024-09-14T11:38:15.230+0000 7f9957606640 4 set_mon_vals no callback set 2024-09-14T11:38:15.584 INFO:tasks.workunit.client.0.smithi138.stderr: -400> 2024-09-14T11:38:15.230+0000 7f9a6ba0c9c0 10 monclient: _renew_subs 2024-09-14T11:38:15.584 INFO:tasks.workunit.client.0.smithi138.stderr: -399> 2024-09-14T11:38:15.230+0000 7f9a6ba0c9c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.138:3300/0 2024-09-14T11:38:15.584 INFO:tasks.workunit.client.0.smithi138.stderr: -398> 2024-09-14T11:38:15.230+0000 7f9a6ba0c9c0 10 monclient: _renew_subs 2024-09-14T11:38:15.584 INFO:tasks.workunit.client.0.smithi138.stderr: -397> 2024-09-14T11:38:15.230+0000 7f9a6ba0c9c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.138:3300/0 2024-09-14T11:38:15.584 INFO:tasks.workunit.client.0.smithi138.stderr: -396> 2024-09-14T11:38:15.230+0000 7f9a6ba0c9c0 1 librados: init done 2024-09-14T11:38:15.585 INFO:tasks.workunit.client.0.smithi138.stderr: -395> 2024-09-14T11:38:15.230+0000 7f9955e03640 4 mgrc handle_mgr_map Got map version 5 2024-09-14T11:38:15.585 INFO:tasks.workunit.client.0.smithi138.stderr: -394> 2024-09-14T11:38:15.230+0000 7f9955e03640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.138:6832/3778043143,v1:172.21.15.138:6833/3778043143] 2024-09-14T11:38:15.585 INFO:tasks.workunit.client.0.smithi138.stderr: -393> 2024-09-14T11:38:15.230+0000 7f9955e03640 4 mgrc reconnect Starting new session with [v2:172.21.15.138:6832/3778043143,v1:172.21.15.138:6833/3778043143] 2024-09-14T11:38:15.585 INFO:tasks.workunit.client.0.smithi138.stderr: -392> 2024-09-14T11:38:15.230+0000 7f9a68d11640 10 monclient: get_auth_request con 0x7f99500718d0 auth_method 0 2024-09-14T11:38:15.585 INFO:tasks.workunit.client.0.smithi138.stderr: -391> 2024-09-14T11:38:15.230+0000 7f9a69d13640 10 monclient: get_auth_request con 0x55a38a651a30 auth_method 0 2024-09-14T11:38:15.585 INFO:tasks.workunit.client.0.smithi138.stderr: -390> 2024-09-14T11:38:15.234+0000 7f9a69512640 10 monclient: get_auth_request con 0x55a38a654c10 auth_method 0 2024-09-14T11:38:15.585 INFO:tasks.workunit.client.0.smithi138.stderr: -389> 2024-09-14T11:38:15.234+0000 7f9a68d11640 10 monclient: get_auth_request con 0x55a38a658e00 auth_method 0 2024-09-14T11:38:15.585 INFO:tasks.workunit.client.0.smithi138.stderr: -388> 2024-09-14T11:38:15.234+0000 7f9a69d13640 10 monclient: get_auth_request con 0x55a38a6584a0 auth_method 0 2024-09-14T11:38:15.585 INFO:tasks.workunit.client.0.smithi138.stderr: -387> 2024-09-14T11:38:15.238+0000 7f9a6ba0c9c0 10 monclient: build_initial_monmap 2024-09-14T11:38:15.585 INFO:tasks.workunit.client.0.smithi138.stderr: -386> 2024-09-14T11:38:15.238+0000 7f9a6ba0c9c0 1 build_initial for_mkfs: 0 2024-09-14T11:38:15.585 INFO:tasks.workunit.client.0.smithi138.stderr: -385> 2024-09-14T11:38:15.238+0000 7f9a6ba0c9c0 10 monclient: monmap: 2024-09-14T11:38:15.585 INFO:tasks.workunit.client.0.smithi138.stderr:epoch 0 2024-09-14T11:38:15.586 INFO:tasks.workunit.client.0.smithi138.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-14T11:38:15.586 INFO:tasks.workunit.client.0.smithi138.stderr:last_changed 0.000000 2024-09-14T11:38:15.586 INFO:tasks.workunit.client.0.smithi138.stderr:created 0.000000 2024-09-14T11:38:15.586 INFO:tasks.workunit.client.0.smithi138.stderr:min_mon_release 0 (unknown) 2024-09-14T11:38:15.586 INFO:tasks.workunit.client.0.smithi138.stderr:election_strategy: 1 2024-09-14T11:38:15.586 INFO:tasks.workunit.client.0.smithi138.stderr:0: [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] mon.noname-a 2024-09-14T11:38:15.586 INFO:tasks.workunit.client.0.smithi138.stderr:1: [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] mon.noname-b 2024-09-14T11:38:15.586 INFO:tasks.workunit.client.0.smithi138.stderr:2: [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] mon.noname-c 2024-09-14T11:38:15.586 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-14T11:38:15.586 INFO:tasks.workunit.client.0.smithi138.stderr: -384> 2024-09-14T11:38:15.238+0000 7f9a6ba0c9c0 5 AuthRegistry(0x55a38a660d30) adding auth protocol: cephx 2024-09-14T11:38:15.586 INFO:tasks.workunit.client.0.smithi138.stderr: -383> 2024-09-14T11:38:15.238+0000 7f9a6ba0c9c0 5 AuthRegistry(0x55a38a660d30) adding auth protocol: cephx 2024-09-14T11:38:15.586 INFO:tasks.workunit.client.0.smithi138.stderr: -382> 2024-09-14T11:38:15.238+0000 7f9a6ba0c9c0 5 AuthRegistry(0x55a38a660d30) adding auth protocol: cephx 2024-09-14T11:38:15.586 INFO:tasks.workunit.client.0.smithi138.stderr: -381> 2024-09-14T11:38:15.238+0000 7f9a6ba0c9c0 5 AuthRegistry(0x55a38a660d30) adding con mode: secure 2024-09-14T11:38:15.587 INFO:tasks.workunit.client.0.smithi138.stderr: -380> 2024-09-14T11:38:15.238+0000 7f9a6ba0c9c0 5 AuthRegistry(0x55a38a660d30) adding con mode: crc 2024-09-14T11:38:15.587 INFO:tasks.workunit.client.0.smithi138.stderr: -379> 2024-09-14T11:38:15.238+0000 7f9a6ba0c9c0 5 AuthRegistry(0x55a38a660d30) adding con mode: secure 2024-09-14T11:38:15.587 INFO:tasks.workunit.client.0.smithi138.stderr: -378> 2024-09-14T11:38:15.238+0000 7f9a6ba0c9c0 5 AuthRegistry(0x55a38a660d30) adding con mode: crc 2024-09-14T11:38:15.587 INFO:tasks.workunit.client.0.smithi138.stderr: -377> 2024-09-14T11:38:15.238+0000 7f9a6ba0c9c0 5 AuthRegistry(0x55a38a660d30) adding con mode: secure 2024-09-14T11:38:15.587 INFO:tasks.workunit.client.0.smithi138.stderr: -376> 2024-09-14T11:38:15.238+0000 7f9a6ba0c9c0 5 AuthRegistry(0x55a38a660d30) adding con mode: crc 2024-09-14T11:38:15.587 INFO:tasks.workunit.client.0.smithi138.stderr: -375> 2024-09-14T11:38:15.238+0000 7f9a6ba0c9c0 5 AuthRegistry(0x55a38a660d30) adding con mode: crc 2024-09-14T11:38:15.587 INFO:tasks.workunit.client.0.smithi138.stderr: -374> 2024-09-14T11:38:15.238+0000 7f9a6ba0c9c0 5 AuthRegistry(0x55a38a660d30) adding con mode: secure 2024-09-14T11:38:15.587 INFO:tasks.workunit.client.0.smithi138.stderr: -373> 2024-09-14T11:38:15.238+0000 7f9a6ba0c9c0 5 AuthRegistry(0x55a38a660d30) adding con mode: crc 2024-09-14T11:38:15.587 INFO:tasks.workunit.client.0.smithi138.stderr: -372> 2024-09-14T11:38:15.238+0000 7f9a6ba0c9c0 5 AuthRegistry(0x55a38a660d30) adding con mode: secure 2024-09-14T11:38:15.587 INFO:tasks.workunit.client.0.smithi138.stderr: -371> 2024-09-14T11:38:15.238+0000 7f9a6ba0c9c0 5 AuthRegistry(0x55a38a660d30) adding con mode: crc 2024-09-14T11:38:15.587 INFO:tasks.workunit.client.0.smithi138.stderr: -370> 2024-09-14T11:38:15.238+0000 7f9a6ba0c9c0 5 AuthRegistry(0x55a38a660d30) adding con mode: secure 2024-09-14T11:38:15.587 INFO:tasks.workunit.client.0.smithi138.stderr: -369> 2024-09-14T11:38:15.238+0000 7f9a6ba0c9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:38:15.587 INFO:tasks.workunit.client.0.smithi138.stderr: -368> 2024-09-14T11:38:15.238+0000 7f9a6ba0c9c0 5 asok(0x55a38a3fed90) register_command objecter_requests cmddesc objecter_requests hook 0x55a38a664690 EEXIST 2024-09-14T11:38:15.588 INFO:tasks.workunit.client.0.smithi138.stderr: -367> 2024-09-14T11:38:15.238+0000 7f9a6ba0c9c0 10 monclient: init 2024-09-14T11:38:15.588 INFO:tasks.workunit.client.0.smithi138.stderr: -366> 2024-09-14T11:38:15.238+0000 7f9a6ba0c9c0 5 AuthRegistry(0x55a38a65fc28) adding auth protocol: cephx 2024-09-14T11:38:15.588 INFO:tasks.workunit.client.0.smithi138.stderr: -365> 2024-09-14T11:38:15.238+0000 7f9a6ba0c9c0 5 AuthRegistry(0x55a38a65fc28) adding auth protocol: cephx 2024-09-14T11:38:15.588 INFO:tasks.workunit.client.0.smithi138.stderr: -364> 2024-09-14T11:38:15.238+0000 7f9a6ba0c9c0 5 AuthRegistry(0x55a38a65fc28) adding auth protocol: cephx 2024-09-14T11:38:15.588 INFO:tasks.workunit.client.0.smithi138.stderr: -363> 2024-09-14T11:38:15.238+0000 7f9a6ba0c9c0 5 AuthRegistry(0x55a38a65fc28) adding con mode: secure 2024-09-14T11:38:15.588 INFO:tasks.workunit.client.0.smithi138.stderr: -362> 2024-09-14T11:38:15.238+0000 7f9a6ba0c9c0 5 AuthRegistry(0x55a38a65fc28) adding con mode: crc 2024-09-14T11:38:15.588 INFO:tasks.workunit.client.0.smithi138.stderr: -361> 2024-09-14T11:38:15.238+0000 7f9a6ba0c9c0 5 AuthRegistry(0x55a38a65fc28) adding con mode: secure 2024-09-14T11:38:15.588 INFO:tasks.workunit.client.0.smithi138.stderr: -360> 2024-09-14T11:38:15.238+0000 7f9a6ba0c9c0 5 AuthRegistry(0x55a38a65fc28) adding con mode: crc 2024-09-14T11:38:15.588 INFO:tasks.workunit.client.0.smithi138.stderr: -359> 2024-09-14T11:38:15.238+0000 7f9a6ba0c9c0 5 AuthRegistry(0x55a38a65fc28) adding con mode: secure 2024-09-14T11:38:15.588 INFO:tasks.workunit.client.0.smithi138.stderr: -358> 2024-09-14T11:38:15.238+0000 7f9a6ba0c9c0 5 AuthRegistry(0x55a38a65fc28) adding con mode: crc 2024-09-14T11:38:15.588 INFO:tasks.workunit.client.0.smithi138.stderr: -357> 2024-09-14T11:38:15.238+0000 7f9a6ba0c9c0 5 AuthRegistry(0x55a38a65fc28) adding con mode: crc 2024-09-14T11:38:15.588 INFO:tasks.workunit.client.0.smithi138.stderr: -356> 2024-09-14T11:38:15.238+0000 7f9a6ba0c9c0 5 AuthRegistry(0x55a38a65fc28) adding con mode: secure 2024-09-14T11:38:15.588 INFO:tasks.workunit.client.0.smithi138.stderr: -355> 2024-09-14T11:38:15.238+0000 7f9a6ba0c9c0 5 AuthRegistry(0x55a38a65fc28) adding con mode: crc 2024-09-14T11:38:15.589 INFO:tasks.workunit.client.0.smithi138.stderr: -354> 2024-09-14T11:38:15.238+0000 7f9a6ba0c9c0 5 AuthRegistry(0x55a38a65fc28) adding con mode: secure 2024-09-14T11:38:15.589 INFO:tasks.workunit.client.0.smithi138.stderr: -353> 2024-09-14T11:38:15.238+0000 7f9a6ba0c9c0 5 AuthRegistry(0x55a38a65fc28) adding con mode: crc 2024-09-14T11:38:15.589 INFO:tasks.workunit.client.0.smithi138.stderr: -352> 2024-09-14T11:38:15.238+0000 7f9a6ba0c9c0 5 AuthRegistry(0x55a38a65fc28) adding con mode: secure 2024-09-14T11:38:15.589 INFO:tasks.workunit.client.0.smithi138.stderr: -351> 2024-09-14T11:38:15.238+0000 7f9a6ba0c9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:38:15.589 INFO:tasks.workunit.client.0.smithi138.stderr: -350> 2024-09-14T11:38:15.238+0000 7f9a6ba0c9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:38:15.589 INFO:tasks.workunit.client.0.smithi138.stderr: -349> 2024-09-14T11:38:15.238+0000 7f9a6ba0c9c0 5 asok(0x55a38a3fed90) register_command rotate-key cmddesc rotate-key hook 0x55a38a65fd70 EEXIST 2024-09-14T11:38:15.589 INFO:tasks.workunit.client.0.smithi138.stderr: -348> 2024-09-14T11:38:15.238+0000 7f9a6ba0c9c0 10 monclient: _reopen_session rank -1 2024-09-14T11:38:15.589 INFO:tasks.workunit.client.0.smithi138.stderr: -347> 2024-09-14T11:38:15.238+0000 7f9a6ba0c9c0 10 monclient: _add_conns ranks=[0,2,1] 2024-09-14T11:38:15.589 INFO:tasks.workunit.client.0.smithi138.stderr: -346> 2024-09-14T11:38:15.238+0000 7f9a6ba0c9c0 10 monclient(hunting): picked mon.noname-a con 0x55a38a688840 addr [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] 2024-09-14T11:38:15.589 INFO:tasks.workunit.client.0.smithi138.stderr: -345> 2024-09-14T11:38:15.238+0000 7f9a6ba0c9c0 10 monclient(hunting): picked mon.noname-c con 0x55a38a688170 addr [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] 2024-09-14T11:38:15.589 INFO:tasks.workunit.client.0.smithi138.stderr: -344> 2024-09-14T11:38:15.238+0000 7f9a6ba0c9c0 10 monclient(hunting): picked mon.noname-b con 0x55a38a686b50 addr [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] 2024-09-14T11:38:15.590 INFO:tasks.workunit.client.0.smithi138.stderr: -343> 2024-09-14T11:38:15.238+0000 7f9a6ba0c9c0 10 monclient(hunting): start opening mon connection 2024-09-14T11:38:15.590 INFO:tasks.workunit.client.0.smithi138.stderr: -342> 2024-09-14T11:38:15.238+0000 7f9a6ba0c9c0 10 monclient(hunting): start opening mon connection 2024-09-14T11:38:15.590 INFO:tasks.workunit.client.0.smithi138.stderr: -341> 2024-09-14T11:38:15.238+0000 7f9a6ba0c9c0 10 monclient(hunting): start opening mon connection 2024-09-14T11:38:15.590 INFO:tasks.workunit.client.0.smithi138.stderr: -340> 2024-09-14T11:38:15.238+0000 7f9a6ba0c9c0 10 monclient(hunting): _renew_subs 2024-09-14T11:38:15.590 INFO:tasks.workunit.client.0.smithi138.stderr: -339> 2024-09-14T11:38:15.238+0000 7f9a6ba0c9c0 10 monclient(hunting): authenticate will time out at 2831.201806s 2024-09-14T11:38:15.590 INFO:tasks.workunit.client.0.smithi138.stderr: -338> 2024-09-14T11:38:15.238+0000 7f9a68d11640 10 monclient(hunting): get_auth_request con 0x55a38a688840 auth_method 0 2024-09-14T11:38:15.590 INFO:tasks.workunit.client.0.smithi138.stderr: -337> 2024-09-14T11:38:15.238+0000 7f9a68d11640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:38:15.590 INFO:tasks.workunit.client.0.smithi138.stderr: -336> 2024-09-14T11:38:15.238+0000 7f9a68d11640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:38:15.590 INFO:tasks.workunit.client.0.smithi138.stderr: -335> 2024-09-14T11:38:15.238+0000 7f9a68d11640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:38:15.590 INFO:tasks.workunit.client.0.smithi138.stderr: -334> 2024-09-14T11:38:15.238+0000 7f9a69d13640 10 monclient(hunting): get_auth_request con 0x55a38a688170 auth_method 0 2024-09-14T11:38:15.590 INFO:tasks.workunit.client.0.smithi138.stderr: -333> 2024-09-14T11:38:15.238+0000 7f9a69d13640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:38:15.590 INFO:tasks.workunit.client.0.smithi138.stderr: -332> 2024-09-14T11:38:15.238+0000 7f9a69d13640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:38:15.590 INFO:tasks.workunit.client.0.smithi138.stderr: -331> 2024-09-14T11:38:15.238+0000 7f9a69d13640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:38:15.591 INFO:tasks.workunit.client.0.smithi138.stderr: -330> 2024-09-14T11:38:15.238+0000 7f9a69d13640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:38:15.591 INFO:tasks.workunit.client.0.smithi138.stderr: -329> 2024-09-14T11:38:15.238+0000 7f9a69d13640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:38:15.591 INFO:tasks.workunit.client.0.smithi138.stderr: -328> 2024-09-14T11:38:15.238+0000 7f9a69d13640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:38:15.591 INFO:tasks.workunit.client.0.smithi138.stderr: -327> 2024-09-14T11:38:15.238+0000 7f9a68d11640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:38:15.591 INFO:tasks.workunit.client.0.smithi138.stderr: -326> 2024-09-14T11:38:15.238+0000 7f9a68d11640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:38:15.591 INFO:tasks.workunit.client.0.smithi138.stderr: -325> 2024-09-14T11:38:15.238+0000 7f9a68d11640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:38:15.591 INFO:tasks.workunit.client.0.smithi138.stderr: -324> 2024-09-14T11:38:15.238+0000 7f9a69512640 10 monclient(hunting): get_auth_request con 0x55a38a686b50 auth_method 0 2024-09-14T11:38:15.591 INFO:tasks.workunit.client.0.smithi138.stderr: -323> 2024-09-14T11:38:15.238+0000 7f9a69512640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:38:15.591 INFO:tasks.workunit.client.0.smithi138.stderr: -322> 2024-09-14T11:38:15.238+0000 7f9a69512640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:38:15.591 INFO:tasks.workunit.client.0.smithi138.stderr: -321> 2024-09-14T11:38:15.238+0000 7f9a69512640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:38:15.591 INFO:tasks.workunit.client.0.smithi138.stderr: -320> 2024-09-14T11:38:15.238+0000 7f9a69d13640 10 monclient(hunting): handle_auth_done global_id 7145 payload 824 2024-09-14T11:38:15.591 INFO:tasks.workunit.client.0.smithi138.stderr: -319> 2024-09-14T11:38:15.238+0000 7f9a69d13640 10 monclient: _finish_hunting 0 2024-09-14T11:38:15.591 INFO:tasks.workunit.client.0.smithi138.stderr: -318> 2024-09-14T11:38:15.238+0000 7f9a69d13640 1 monclient: found mon.noname-c 2024-09-14T11:38:15.591 INFO:tasks.workunit.client.0.smithi138.stderr: -317> 2024-09-14T11:38:15.238+0000 7f9a69d13640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.138:3301/0 2024-09-14T11:38:15.592 INFO:tasks.workunit.client.0.smithi138.stderr: -316> 2024-09-14T11:38:15.238+0000 7f994effd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:38:15.592 INFO:tasks.workunit.client.0.smithi138.stderr: -315> 2024-09-14T11:38:15.238+0000 7f994effd640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-14T11:38:15.592 INFO:tasks.workunit.client.0.smithi138.stderr: -314> 2024-09-14T11:38:15.238+0000 7f994effd640 10 monclient: dump: 2024-09-14T11:38:15.592 INFO:tasks.workunit.client.0.smithi138.stderr:epoch 1 2024-09-14T11:38:15.592 INFO:tasks.workunit.client.0.smithi138.stderr:fsid 3f225f43-83a6-4aeb-b798-1f04bb49d597 2024-09-14T11:38:15.592 INFO:tasks.workunit.client.0.smithi138.stderr:last_changed 2024-09-14T11:07:09.252780+0000 2024-09-14T11:38:15.592 INFO:tasks.workunit.client.0.smithi138.stderr:created 2024-09-14T11:07:09.252780+0000 2024-09-14T11:38:15.592 INFO:tasks.workunit.client.0.smithi138.stderr:min_mon_release 19 (squid) 2024-09-14T11:38:15.592 INFO:tasks.workunit.client.0.smithi138.stderr:election_strategy: 1 2024-09-14T11:38:15.592 INFO:tasks.workunit.client.0.smithi138.stderr:0: [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] mon.a 2024-09-14T11:38:15.592 INFO:tasks.workunit.client.0.smithi138.stderr:1: [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] mon.b 2024-09-14T11:38:15.592 INFO:tasks.workunit.client.0.smithi138.stderr:2: [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] mon.c 2024-09-14T11:38:15.593 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-14T11:38:15.593 INFO:tasks.workunit.client.0.smithi138.stderr: -313> 2024-09-14T11:38:15.238+0000 7f994effd640 10 monclient: _finish_auth 0 2024-09-14T11:38:15.593 INFO:tasks.workunit.client.0.smithi138.stderr: -312> 2024-09-14T11:38:15.238+0000 7f994effd640 10 monclient: _check_auth_tickets 2024-09-14T11:38:15.593 INFO:tasks.workunit.client.0.smithi138.stderr: -311> 2024-09-14T11:38:15.238+0000 7f9a6ba0c9c0 5 monclient: authenticate success, global_id 7145 2024-09-14T11:38:15.593 INFO:tasks.workunit.client.0.smithi138.stderr: -310> 2024-09-14T11:38:15.238+0000 7f9a6ba0c9c0 10 monclient: _renew_subs 2024-09-14T11:38:15.593 INFO:tasks.workunit.client.0.smithi138.stderr: -309> 2024-09-14T11:38:15.238+0000 7f9a6ba0c9c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.138:3301/0 2024-09-14T11:38:15.593 INFO:tasks.workunit.client.0.smithi138.stderr: -308> 2024-09-14T11:38:15.238+0000 7f994effd640 10 monclient: handle_config config(0 keys) 2024-09-14T11:38:15.593 INFO:tasks.workunit.client.0.smithi138.stderr: -307> 2024-09-14T11:38:15.238+0000 7f994effd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:38:15.593 INFO:tasks.workunit.client.0.smithi138.stderr: -306> 2024-09-14T11:38:15.238+0000 7f994effd640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-14T11:38:15.593 INFO:tasks.workunit.client.0.smithi138.stderr: -305> 2024-09-14T11:38:15.238+0000 7f994effd640 10 monclient: dump: 2024-09-14T11:38:15.593 INFO:tasks.workunit.client.0.smithi138.stderr:epoch 1 2024-09-14T11:38:15.593 INFO:tasks.workunit.client.0.smithi138.stderr:fsid 3f225f43-83a6-4aeb-b798-1f04bb49d597 2024-09-14T11:38:15.593 INFO:tasks.workunit.client.0.smithi138.stderr:last_changed 2024-09-14T11:07:09.252780+0000 2024-09-14T11:38:15.594 INFO:tasks.workunit.client.0.smithi138.stderr:created 2024-09-14T11:07:09.252780+0000 2024-09-14T11:38:15.594 INFO:tasks.workunit.client.0.smithi138.stderr:min_mon_release 19 (squid) 2024-09-14T11:38:15.594 INFO:tasks.workunit.client.0.smithi138.stderr:election_strategy: 1 2024-09-14T11:38:15.594 INFO:tasks.workunit.client.0.smithi138.stderr:0: [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] mon.a 2024-09-14T11:38:15.594 INFO:tasks.workunit.client.0.smithi138.stderr:1: [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] mon.b 2024-09-14T11:38:15.594 INFO:tasks.workunit.client.0.smithi138.stderr:2: [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] mon.c 2024-09-14T11:38:15.594 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-14T11:38:15.594 INFO:tasks.workunit.client.0.smithi138.stderr: -304> 2024-09-14T11:38:15.238+0000 7f9a6a514640 4 set_mon_vals no callback set 2024-09-14T11:38:15.594 INFO:tasks.workunit.client.0.smithi138.stderr: -303> 2024-09-14T11:38:15.238+0000 7f9a6ba0c9c0 10 monclient: _renew_subs 2024-09-14T11:38:15.594 INFO:tasks.workunit.client.0.smithi138.stderr: -302> 2024-09-14T11:38:15.238+0000 7f9a6ba0c9c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.138:3301/0 2024-09-14T11:38:15.594 INFO:tasks.workunit.client.0.smithi138.stderr: -301> 2024-09-14T11:38:15.242+0000 7f994effd640 4 mgrc handle_mgr_map Got map version 5 2024-09-14T11:38:15.594 INFO:tasks.workunit.client.0.smithi138.stderr: -300> 2024-09-14T11:38:15.242+0000 7f994effd640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.138:6832/3778043143,v1:172.21.15.138:6833/3778043143] 2024-09-14T11:38:15.594 INFO:tasks.workunit.client.0.smithi138.stderr: -299> 2024-09-14T11:38:15.242+0000 7f994effd640 4 mgrc reconnect Starting new session with [v2:172.21.15.138:6832/3778043143,v1:172.21.15.138:6833/3778043143] 2024-09-14T11:38:15.594 INFO:tasks.workunit.client.0.smithi138.stderr: -298> 2024-09-14T11:38:15.242+0000 7f9a68d11640 10 monclient: get_auth_request con 0x7f99440717e0 auth_method 0 2024-09-14T11:38:15.595 INFO:tasks.workunit.client.0.smithi138.stderr: -297> 2024-09-14T11:38:15.242+0000 7f9a6ba0c9c0 10 monclient: get_monmap_and_config 2024-09-14T11:38:15.595 INFO:tasks.workunit.client.0.smithi138.stderr: -296> 2024-09-14T11:38:15.242+0000 7f9a6ba0c9c0 10 monclient: build_initial_monmap 2024-09-14T11:38:15.595 INFO:tasks.workunit.client.0.smithi138.stderr: -295> 2024-09-14T11:38:15.242+0000 7f9a6ba0c9c0 1 build_initial for_mkfs: 0 2024-09-14T11:38:15.595 INFO:tasks.workunit.client.0.smithi138.stderr: -294> 2024-09-14T11:38:15.242+0000 7f9a6ba0c9c0 10 monclient: monmap: 2024-09-14T11:38:15.595 INFO:tasks.workunit.client.0.smithi138.stderr:epoch 0 2024-09-14T11:38:15.595 INFO:tasks.workunit.client.0.smithi138.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-14T11:38:15.595 INFO:tasks.workunit.client.0.smithi138.stderr:last_changed 0.000000 2024-09-14T11:38:15.595 INFO:tasks.workunit.client.0.smithi138.stderr:created 0.000000 2024-09-14T11:38:15.595 INFO:tasks.workunit.client.0.smithi138.stderr:min_mon_release 0 (unknown) 2024-09-14T11:38:15.595 INFO:tasks.workunit.client.0.smithi138.stderr:election_strategy: 1 2024-09-14T11:38:15.595 INFO:tasks.workunit.client.0.smithi138.stderr:0: [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] mon.noname-a 2024-09-14T11:38:15.595 INFO:tasks.workunit.client.0.smithi138.stderr:1: [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] mon.noname-b 2024-09-14T11:38:15.595 INFO:tasks.workunit.client.0.smithi138.stderr:2: [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] mon.noname-c 2024-09-14T11:38:15.595 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-14T11:38:15.596 INFO:tasks.workunit.client.0.smithi138.stderr: -293> 2024-09-14T11:38:15.242+0000 7f9a6ba0c9c0 5 AuthRegistry(0x55a38a6a7f70) adding auth protocol: cephx 2024-09-14T11:38:15.596 INFO:tasks.workunit.client.0.smithi138.stderr: -292> 2024-09-14T11:38:15.242+0000 7f9a6ba0c9c0 5 AuthRegistry(0x55a38a6a7f70) adding auth protocol: cephx 2024-09-14T11:38:15.596 INFO:tasks.workunit.client.0.smithi138.stderr: -291> 2024-09-14T11:38:15.242+0000 7f9a6ba0c9c0 5 AuthRegistry(0x55a38a6a7f70) adding auth protocol: cephx 2024-09-14T11:38:15.596 INFO:tasks.workunit.client.0.smithi138.stderr: -290> 2024-09-14T11:38:15.242+0000 7f9a6ba0c9c0 5 AuthRegistry(0x55a38a6a7f70) adding con mode: secure 2024-09-14T11:38:15.596 INFO:tasks.workunit.client.0.smithi138.stderr: -289> 2024-09-14T11:38:15.242+0000 7f9a6ba0c9c0 5 AuthRegistry(0x55a38a6a7f70) adding con mode: crc 2024-09-14T11:38:15.596 INFO:tasks.workunit.client.0.smithi138.stderr: -288> 2024-09-14T11:38:15.242+0000 7f9a6ba0c9c0 5 AuthRegistry(0x55a38a6a7f70) adding con mode: secure 2024-09-14T11:38:15.596 INFO:tasks.workunit.client.0.smithi138.stderr: -287> 2024-09-14T11:38:15.242+0000 7f9a6ba0c9c0 5 AuthRegistry(0x55a38a6a7f70) adding con mode: crc 2024-09-14T11:38:15.596 INFO:tasks.workunit.client.0.smithi138.stderr: -286> 2024-09-14T11:38:15.242+0000 7f9a6ba0c9c0 5 AuthRegistry(0x55a38a6a7f70) adding con mode: secure 2024-09-14T11:38:15.596 INFO:tasks.workunit.client.0.smithi138.stderr: -285> 2024-09-14T11:38:15.242+0000 7f9a6ba0c9c0 5 AuthRegistry(0x55a38a6a7f70) adding con mode: crc 2024-09-14T11:38:15.596 INFO:tasks.workunit.client.0.smithi138.stderr: -284> 2024-09-14T11:38:15.242+0000 7f9a6ba0c9c0 5 AuthRegistry(0x55a38a6a7f70) adding con mode: crc 2024-09-14T11:38:15.596 INFO:tasks.workunit.client.0.smithi138.stderr: -283> 2024-09-14T11:38:15.242+0000 7f9a6ba0c9c0 5 AuthRegistry(0x55a38a6a7f70) adding con mode: secure 2024-09-14T11:38:15.596 INFO:tasks.workunit.client.0.smithi138.stderr: -282> 2024-09-14T11:38:15.242+0000 7f9a6ba0c9c0 5 AuthRegistry(0x55a38a6a7f70) adding con mode: crc 2024-09-14T11:38:15.596 INFO:tasks.workunit.client.0.smithi138.stderr: -281> 2024-09-14T11:38:15.242+0000 7f9a6ba0c9c0 5 AuthRegistry(0x55a38a6a7f70) adding con mode: secure 2024-09-14T11:38:15.597 INFO:tasks.workunit.client.0.smithi138.stderr: -280> 2024-09-14T11:38:15.242+0000 7f9a6ba0c9c0 5 AuthRegistry(0x55a38a6a7f70) adding con mode: crc 2024-09-14T11:38:15.597 INFO:tasks.workunit.client.0.smithi138.stderr: -279> 2024-09-14T11:38:15.242+0000 7f9a6ba0c9c0 5 AuthRegistry(0x55a38a6a7f70) adding con mode: secure 2024-09-14T11:38:15.597 INFO:tasks.workunit.client.0.smithi138.stderr: -278> 2024-09-14T11:38:15.242+0000 7f9a6ba0c9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:38:15.597 INFO:tasks.workunit.client.0.smithi138.stderr: -277> 2024-09-14T11:38:15.242+0000 7f9a6ba0c9c0 10 monclient: init 2024-09-14T11:38:15.597 INFO:tasks.workunit.client.0.smithi138.stderr: -276> 2024-09-14T11:38:15.242+0000 7f9a6ba0c9c0 5 AuthRegistry(0x7fff9ef3b890) adding auth protocol: cephx 2024-09-14T11:38:15.597 INFO:tasks.workunit.client.0.smithi138.stderr: -275> 2024-09-14T11:38:15.242+0000 7f9a6ba0c9c0 5 AuthRegistry(0x7fff9ef3b890) adding auth protocol: cephx 2024-09-14T11:38:15.597 INFO:tasks.workunit.client.0.smithi138.stderr: -274> 2024-09-14T11:38:15.242+0000 7f9a6ba0c9c0 5 AuthRegistry(0x7fff9ef3b890) adding auth protocol: cephx 2024-09-14T11:38:15.597 INFO:tasks.workunit.client.0.smithi138.stderr: -273> 2024-09-14T11:38:15.242+0000 7f9a6ba0c9c0 5 AuthRegistry(0x7fff9ef3b890) adding con mode: secure 2024-09-14T11:38:15.597 INFO:tasks.workunit.client.0.smithi138.stderr: -272> 2024-09-14T11:38:15.242+0000 7f9a6ba0c9c0 5 AuthRegistry(0x7fff9ef3b890) adding con mode: crc 2024-09-14T11:38:15.597 INFO:tasks.workunit.client.0.smithi138.stderr: -271> 2024-09-14T11:38:15.242+0000 7f9a6ba0c9c0 5 AuthRegistry(0x7fff9ef3b890) adding con mode: secure 2024-09-14T11:38:15.597 INFO:tasks.workunit.client.0.smithi138.stderr: -270> 2024-09-14T11:38:15.242+0000 7f9a6ba0c9c0 5 AuthRegistry(0x7fff9ef3b890) adding con mode: crc 2024-09-14T11:38:15.597 INFO:tasks.workunit.client.0.smithi138.stderr: -269> 2024-09-14T11:38:15.242+0000 7f9a6ba0c9c0 5 AuthRegistry(0x7fff9ef3b890) adding con mode: secure 2024-09-14T11:38:15.597 INFO:tasks.workunit.client.0.smithi138.stderr: -268> 2024-09-14T11:38:15.242+0000 7f9a6ba0c9c0 5 AuthRegistry(0x7fff9ef3b890) adding con mode: crc 2024-09-14T11:38:15.598 INFO:tasks.workunit.client.0.smithi138.stderr: -267> 2024-09-14T11:38:15.242+0000 7f9a6ba0c9c0 5 AuthRegistry(0x7fff9ef3b890) adding con mode: crc 2024-09-14T11:38:15.598 INFO:tasks.workunit.client.0.smithi138.stderr: -266> 2024-09-14T11:38:15.242+0000 7f9a6ba0c9c0 5 AuthRegistry(0x7fff9ef3b890) adding con mode: secure 2024-09-14T11:38:15.598 INFO:tasks.workunit.client.0.smithi138.stderr: -265> 2024-09-14T11:38:15.242+0000 7f9a6ba0c9c0 5 AuthRegistry(0x7fff9ef3b890) adding con mode: crc 2024-09-14T11:38:15.598 INFO:tasks.workunit.client.0.smithi138.stderr: -264> 2024-09-14T11:38:15.242+0000 7f9a6ba0c9c0 5 AuthRegistry(0x7fff9ef3b890) adding con mode: secure 2024-09-14T11:38:15.598 INFO:tasks.workunit.client.0.smithi138.stderr: -263> 2024-09-14T11:38:15.242+0000 7f9a6ba0c9c0 5 AuthRegistry(0x7fff9ef3b890) adding con mode: crc 2024-09-14T11:38:15.598 INFO:tasks.workunit.client.0.smithi138.stderr: -262> 2024-09-14T11:38:15.242+0000 7f9a6ba0c9c0 5 AuthRegistry(0x7fff9ef3b890) adding con mode: secure 2024-09-14T11:38:15.598 INFO:tasks.workunit.client.0.smithi138.stderr: -261> 2024-09-14T11:38:15.242+0000 7f9a6ba0c9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:38:15.598 INFO:tasks.workunit.client.0.smithi138.stderr: -260> 2024-09-14T11:38:15.242+0000 7f9a6ba0c9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:38:15.598 INFO:tasks.workunit.client.0.smithi138.stderr: -259> 2024-09-14T11:38:15.242+0000 7f9a6ba0c9c0 5 asok(0x55a38a3fed90) register_command rotate-key cmddesc rotate-key hook 0x7fff9ef3b9d8 EEXIST 2024-09-14T11:38:15.598 INFO:tasks.workunit.client.0.smithi138.stderr: -258> 2024-09-14T11:38:15.242+0000 7f9a6ba0c9c0 10 monclient: _reopen_session rank -1 2024-09-14T11:38:15.598 INFO:tasks.workunit.client.0.smithi138.stderr: -257> 2024-09-14T11:38:15.242+0000 7f9a6ba0c9c0 10 monclient: _add_conns ranks=[1,0,2] 2024-09-14T11:38:15.598 INFO:tasks.workunit.client.0.smithi138.stderr: -256> 2024-09-14T11:38:15.242+0000 7f9a6ba0c9c0 10 monclient(hunting): picked mon.noname-b con 0x55a38a6dc500 addr [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] 2024-09-14T11:38:15.598 INFO:tasks.workunit.client.0.smithi138.stderr: -255> 2024-09-14T11:38:15.242+0000 7f9a6ba0c9c0 10 monclient(hunting): picked mon.noname-a con 0x55a38a6ac280 addr [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] 2024-09-14T11:38:15.598 INFO:tasks.workunit.client.0.smithi138.stderr: -254> 2024-09-14T11:38:15.242+0000 7f9a6ba0c9c0 10 monclient(hunting): picked mon.noname-c con 0x55a38a6d7960 addr [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] 2024-09-14T11:38:15.599 INFO:tasks.workunit.client.0.smithi138.stderr: -253> 2024-09-14T11:38:15.242+0000 7f9a6ba0c9c0 10 monclient(hunting): start opening mon connection 2024-09-14T11:38:15.599 INFO:tasks.workunit.client.0.smithi138.stderr: -252> 2024-09-14T11:38:15.242+0000 7f9a6ba0c9c0 10 monclient(hunting): start opening mon connection 2024-09-14T11:38:15.599 INFO:tasks.workunit.client.0.smithi138.stderr: -251> 2024-09-14T11:38:15.242+0000 7f9a6ba0c9c0 10 monclient(hunting): start opening mon connection 2024-09-14T11:38:15.599 INFO:tasks.workunit.client.0.smithi138.stderr: -250> 2024-09-14T11:38:15.242+0000 7f9a6ba0c9c0 10 monclient(hunting): _renew_subs 2024-09-14T11:38:15.599 INFO:tasks.workunit.client.0.smithi138.stderr: -249> 2024-09-14T11:38:15.242+0000 7f9a6ba0c9c0 10 monclient(hunting): authenticate will time out at 2831.206123s 2024-09-14T11:38:15.599 INFO:tasks.workunit.client.0.smithi138.stderr: -248> 2024-09-14T11:38:15.242+0000 7f9a69d13640 10 monclient(hunting): get_auth_request con 0x55a38a6ac280 auth_method 0 2024-09-14T11:38:15.599 INFO:tasks.workunit.client.0.smithi138.stderr: -247> 2024-09-14T11:38:15.242+0000 7f9a69d13640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:38:15.599 INFO:tasks.workunit.client.0.smithi138.stderr: -246> 2024-09-14T11:38:15.242+0000 7f9a69d13640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:38:15.599 INFO:tasks.workunit.client.0.smithi138.stderr: -245> 2024-09-14T11:38:15.242+0000 7f9a69d13640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:38:15.599 INFO:tasks.workunit.client.0.smithi138.stderr: -244> 2024-09-14T11:38:15.242+0000 7f9a69512640 10 monclient(hunting): get_auth_request con 0x55a38a6d7960 auth_method 0 2024-09-14T11:38:15.599 INFO:tasks.workunit.client.0.smithi138.stderr: -243> 2024-09-14T11:38:15.242+0000 7f9a69512640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:38:15.599 INFO:tasks.workunit.client.0.smithi138.stderr: -242> 2024-09-14T11:38:15.242+0000 7f9a69512640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:38:15.599 INFO:tasks.workunit.client.0.smithi138.stderr: -241> 2024-09-14T11:38:15.242+0000 7f9a69512640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:38:15.600 INFO:tasks.workunit.client.0.smithi138.stderr: -240> 2024-09-14T11:38:15.242+0000 7f9a69d13640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:38:15.600 INFO:tasks.workunit.client.0.smithi138.stderr: -239> 2024-09-14T11:38:15.242+0000 7f9a69d13640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:38:15.600 INFO:tasks.workunit.client.0.smithi138.stderr: -238> 2024-09-14T11:38:15.242+0000 7f9a69d13640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:38:15.600 INFO:tasks.workunit.client.0.smithi138.stderr: -237> 2024-09-14T11:38:15.242+0000 7f9a69512640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:38:15.600 INFO:tasks.workunit.client.0.smithi138.stderr: -236> 2024-09-14T11:38:15.242+0000 7f9a69512640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:38:15.600 INFO:tasks.workunit.client.0.smithi138.stderr: -235> 2024-09-14T11:38:15.242+0000 7f9a69512640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:38:15.600 INFO:tasks.workunit.client.0.smithi138.stderr: -234> 2024-09-14T11:38:15.242+0000 7f9a69d13640 10 monclient(hunting): handle_auth_done global_id 7632 payload 274 2024-09-14T11:38:15.600 INFO:tasks.workunit.client.0.smithi138.stderr: -233> 2024-09-14T11:38:15.242+0000 7f9a69d13640 10 monclient: _finish_hunting 0 2024-09-14T11:38:15.600 INFO:tasks.workunit.client.0.smithi138.stderr: -232> 2024-09-14T11:38:15.242+0000 7f9a69d13640 1 monclient: found mon.noname-a 2024-09-14T11:38:15.600 INFO:tasks.workunit.client.0.smithi138.stderr: -231> 2024-09-14T11:38:15.242+0000 7f9a69d13640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.138:3300/0 2024-09-14T11:38:15.600 INFO:tasks.workunit.client.0.smithi138.stderr: -230> 2024-09-14T11:38:15.242+0000 7f994cff9640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:38:15.600 INFO:tasks.workunit.client.0.smithi138.stderr: -229> 2024-09-14T11:38:15.242+0000 7f994cff9640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-14T11:38:15.600 INFO:tasks.workunit.client.0.smithi138.stderr: -228> 2024-09-14T11:38:15.242+0000 7f994cff9640 10 monclient: dump: 2024-09-14T11:38:15.600 INFO:tasks.workunit.client.0.smithi138.stderr:epoch 1 2024-09-14T11:38:15.601 INFO:tasks.workunit.client.0.smithi138.stderr:fsid 3f225f43-83a6-4aeb-b798-1f04bb49d597 2024-09-14T11:38:15.601 INFO:tasks.workunit.client.0.smithi138.stderr:last_changed 2024-09-14T11:07:09.252780+0000 2024-09-14T11:38:15.601 INFO:tasks.workunit.client.0.smithi138.stderr:created 2024-09-14T11:07:09.252780+0000 2024-09-14T11:38:15.601 INFO:tasks.workunit.client.0.smithi138.stderr:min_mon_release 19 (squid) 2024-09-14T11:38:15.601 INFO:tasks.workunit.client.0.smithi138.stderr:election_strategy: 1 2024-09-14T11:38:15.601 INFO:tasks.workunit.client.0.smithi138.stderr:0: [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] mon.a 2024-09-14T11:38:15.601 INFO:tasks.workunit.client.0.smithi138.stderr:1: [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] mon.b 2024-09-14T11:38:15.601 INFO:tasks.workunit.client.0.smithi138.stderr:2: [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] mon.c 2024-09-14T11:38:15.601 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-14T11:38:15.601 INFO:tasks.workunit.client.0.smithi138.stderr: -227> 2024-09-14T11:38:15.242+0000 7f994cff9640 10 monclient: _finish_auth 0 2024-09-14T11:38:15.601 INFO:tasks.workunit.client.0.smithi138.stderr: -226> 2024-09-14T11:38:15.242+0000 7f994cff9640 10 monclient: _check_auth_tickets 2024-09-14T11:38:15.601 INFO:tasks.workunit.client.0.smithi138.stderr: -225> 2024-09-14T11:38:15.242+0000 7f994cff9640 10 monclient: handle_config config(0 keys) 2024-09-14T11:38:15.601 INFO:tasks.workunit.client.0.smithi138.stderr: -224> 2024-09-14T11:38:15.242+0000 7f994cff9640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:38:15.602 INFO:tasks.workunit.client.0.smithi138.stderr: -223> 2024-09-14T11:38:15.242+0000 7f994cff9640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-14T11:38:15.602 INFO:tasks.workunit.client.0.smithi138.stderr: -222> 2024-09-14T11:38:15.242+0000 7f994cff9640 10 monclient: dump: 2024-09-14T11:38:15.602 INFO:tasks.workunit.client.0.smithi138.stderr:epoch 1 2024-09-14T11:38:15.602 INFO:tasks.workunit.client.0.smithi138.stderr:fsid 3f225f43-83a6-4aeb-b798-1f04bb49d597 2024-09-14T11:38:15.602 INFO:tasks.workunit.client.0.smithi138.stderr:last_changed 2024-09-14T11:07:09.252780+0000 2024-09-14T11:38:15.602 INFO:tasks.workunit.client.0.smithi138.stderr:created 2024-09-14T11:07:09.252780+0000 2024-09-14T11:38:15.602 INFO:tasks.workunit.client.0.smithi138.stderr:min_mon_release 19 (squid) 2024-09-14T11:38:15.602 INFO:tasks.workunit.client.0.smithi138.stderr:election_strategy: 1 2024-09-14T11:38:15.602 INFO:tasks.workunit.client.0.smithi138.stderr:0: [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] mon.a 2024-09-14T11:38:15.602 INFO:tasks.workunit.client.0.smithi138.stderr:1: [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] mon.b 2024-09-14T11:38:15.602 INFO:tasks.workunit.client.0.smithi138.stderr:2: [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] mon.c 2024-09-14T11:38:15.602 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-14T11:38:15.602 INFO:tasks.workunit.client.0.smithi138.stderr: -221> 2024-09-14T11:38:15.242+0000 7f9a6ba0c9c0 5 monclient: authenticate success, global_id 7632 2024-09-14T11:38:15.602 INFO:tasks.workunit.client.0.smithi138.stderr: -220> 2024-09-14T11:38:15.242+0000 7f9a6ba0c9c0 10 monclient: get_monmap_and_config success 2024-09-14T11:38:15.603 INFO:tasks.workunit.client.0.smithi138.stderr: -219> 2024-09-14T11:38:15.242+0000 7f9a6ba0c9c0 4 set_mon_vals no callback set 2024-09-14T11:38:15.603 INFO:tasks.workunit.client.0.smithi138.stderr: -218> 2024-09-14T11:38:15.242+0000 7f9a6ba0c9c0 10 monclient: shutdown 2024-09-14T11:38:15.603 INFO:tasks.workunit.client.0.smithi138.stderr: -217> 2024-09-14T11:38:15.242+0000 7f9a6ba0c9c0 10 monclient: build_initial_monmap 2024-09-14T11:38:15.603 INFO:tasks.workunit.client.0.smithi138.stderr: -216> 2024-09-14T11:38:15.242+0000 7f9a6ba0c9c0 1 build_initial for_mkfs: 0 2024-09-14T11:38:15.603 INFO:tasks.workunit.client.0.smithi138.stderr: -215> 2024-09-14T11:38:15.242+0000 7f9a6ba0c9c0 10 monclient: monmap: 2024-09-14T11:38:15.603 INFO:tasks.workunit.client.0.smithi138.stderr:epoch 0 2024-09-14T11:38:15.603 INFO:tasks.workunit.client.0.smithi138.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-14T11:38:15.603 INFO:tasks.workunit.client.0.smithi138.stderr:last_changed 0.000000 2024-09-14T11:38:15.603 INFO:tasks.workunit.client.0.smithi138.stderr:created 0.000000 2024-09-14T11:38:15.603 INFO:tasks.workunit.client.0.smithi138.stderr:min_mon_release 0 (unknown) 2024-09-14T11:38:15.603 INFO:tasks.workunit.client.0.smithi138.stderr:election_strategy: 1 2024-09-14T11:38:15.603 INFO:tasks.workunit.client.0.smithi138.stderr:0: [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] mon.noname-a 2024-09-14T11:38:15.603 INFO:tasks.workunit.client.0.smithi138.stderr:1: [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] mon.noname-b 2024-09-14T11:38:15.603 INFO:tasks.workunit.client.0.smithi138.stderr:2: [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] mon.noname-c 2024-09-14T11:38:15.603 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-14T11:38:15.604 INFO:tasks.workunit.client.0.smithi138.stderr: -214> 2024-09-14T11:38:15.242+0000 7f9a6ba0c9c0 5 AuthRegistry(0x55a38a6ad0a0) adding auth protocol: cephx 2024-09-14T11:38:15.604 INFO:tasks.workunit.client.0.smithi138.stderr: -213> 2024-09-14T11:38:15.242+0000 7f9a6ba0c9c0 5 AuthRegistry(0x55a38a6ad0a0) adding auth protocol: cephx 2024-09-14T11:38:15.604 INFO:tasks.workunit.client.0.smithi138.stderr: -212> 2024-09-14T11:38:15.242+0000 7f9a6ba0c9c0 5 AuthRegistry(0x55a38a6ad0a0) adding auth protocol: cephx 2024-09-14T11:38:15.604 INFO:tasks.workunit.client.0.smithi138.stderr: -211> 2024-09-14T11:38:15.242+0000 7f9a6ba0c9c0 5 AuthRegistry(0x55a38a6ad0a0) adding con mode: secure 2024-09-14T11:38:15.604 INFO:tasks.workunit.client.0.smithi138.stderr: -210> 2024-09-14T11:38:15.242+0000 7f9a6ba0c9c0 5 AuthRegistry(0x55a38a6ad0a0) adding con mode: crc 2024-09-14T11:38:15.604 INFO:tasks.workunit.client.0.smithi138.stderr: -209> 2024-09-14T11:38:15.242+0000 7f9a6ba0c9c0 5 AuthRegistry(0x55a38a6ad0a0) adding con mode: secure 2024-09-14T11:38:15.604 INFO:tasks.workunit.client.0.smithi138.stderr: -208> 2024-09-14T11:38:15.242+0000 7f9a6ba0c9c0 5 AuthRegistry(0x55a38a6ad0a0) adding con mode: crc 2024-09-14T11:38:15.604 INFO:tasks.workunit.client.0.smithi138.stderr: -207> 2024-09-14T11:38:15.242+0000 7f9a6ba0c9c0 5 AuthRegistry(0x55a38a6ad0a0) adding con mode: secure 2024-09-14T11:38:15.604 INFO:tasks.workunit.client.0.smithi138.stderr: -206> 2024-09-14T11:38:15.242+0000 7f9a6ba0c9c0 5 AuthRegistry(0x55a38a6ad0a0) adding con mode: crc 2024-09-14T11:38:15.604 INFO:tasks.workunit.client.0.smithi138.stderr: -205> 2024-09-14T11:38:15.242+0000 7f9a6ba0c9c0 5 AuthRegistry(0x55a38a6ad0a0) adding con mode: crc 2024-09-14T11:38:15.604 INFO:tasks.workunit.client.0.smithi138.stderr: -204> 2024-09-14T11:38:15.242+0000 7f9a6ba0c9c0 5 AuthRegistry(0x55a38a6ad0a0) adding con mode: secure 2024-09-14T11:38:15.604 INFO:tasks.workunit.client.0.smithi138.stderr: -203> 2024-09-14T11:38:15.242+0000 7f9a6ba0c9c0 5 AuthRegistry(0x55a38a6ad0a0) adding con mode: crc 2024-09-14T11:38:15.604 INFO:tasks.workunit.client.0.smithi138.stderr: -202> 2024-09-14T11:38:15.242+0000 7f9a6ba0c9c0 5 AuthRegistry(0x55a38a6ad0a0) adding con mode: secure 2024-09-14T11:38:15.605 INFO:tasks.workunit.client.0.smithi138.stderr: -201> 2024-09-14T11:38:15.242+0000 7f9a6ba0c9c0 5 AuthRegistry(0x55a38a6ad0a0) adding con mode: crc 2024-09-14T11:38:15.605 INFO:tasks.workunit.client.0.smithi138.stderr: -200> 2024-09-14T11:38:15.242+0000 7f9a6ba0c9c0 5 AuthRegistry(0x55a38a6ad0a0) adding con mode: secure 2024-09-14T11:38:15.605 INFO:tasks.workunit.client.0.smithi138.stderr: -199> 2024-09-14T11:38:15.242+0000 7f9a6ba0c9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:38:15.605 INFO:tasks.workunit.client.0.smithi138.stderr: -198> 2024-09-14T11:38:15.242+0000 7f9a6ba0c9c0 1 librados: starting msgr at 2024-09-14T11:38:15.605 INFO:tasks.workunit.client.0.smithi138.stderr: -197> 2024-09-14T11:38:15.242+0000 7f9a6ba0c9c0 1 librados: starting objecter 2024-09-14T11:38:15.605 INFO:tasks.workunit.client.0.smithi138.stderr: -196> 2024-09-14T11:38:15.242+0000 7f9a6ba0c9c0 5 asok(0x55a38a3fed90) register_command objecter_requests cmddesc objecter_requests hook 0x55a38a68b410 EEXIST 2024-09-14T11:38:15.605 INFO:tasks.workunit.client.0.smithi138.stderr: -195> 2024-09-14T11:38:15.246+0000 7f9a6ba0c9c0 1 librados: setting wanted keys 2024-09-14T11:38:15.605 INFO:tasks.workunit.client.0.smithi138.stderr: -194> 2024-09-14T11:38:15.246+0000 7f9a6ba0c9c0 1 librados: calling monclient init 2024-09-14T11:38:15.605 INFO:tasks.workunit.client.0.smithi138.stderr: -193> 2024-09-14T11:38:15.246+0000 7f9a6ba0c9c0 10 monclient: init 2024-09-14T11:38:15.605 INFO:tasks.workunit.client.0.smithi138.stderr: -192> 2024-09-14T11:38:15.246+0000 7f9a6ba0c9c0 5 AuthRegistry(0x55a38a68a660) adding auth protocol: cephx 2024-09-14T11:38:15.605 INFO:tasks.workunit.client.0.smithi138.stderr: -191> 2024-09-14T11:38:15.246+0000 7f9a6ba0c9c0 5 AuthRegistry(0x55a38a68a660) adding auth protocol: cephx 2024-09-14T11:38:15.605 INFO:tasks.workunit.client.0.smithi138.stderr: -190> 2024-09-14T11:38:15.246+0000 7f9a6ba0c9c0 5 AuthRegistry(0x55a38a68a660) adding auth protocol: cephx 2024-09-14T11:38:15.605 INFO:tasks.workunit.client.0.smithi138.stderr: -189> 2024-09-14T11:38:15.246+0000 7f9a6ba0c9c0 5 AuthRegistry(0x55a38a68a660) adding con mode: secure 2024-09-14T11:38:15.605 INFO:tasks.workunit.client.0.smithi138.stderr: -188> 2024-09-14T11:38:15.246+0000 7f9a6ba0c9c0 5 AuthRegistry(0x55a38a68a660) adding con mode: crc 2024-09-14T11:38:15.606 INFO:tasks.workunit.client.0.smithi138.stderr: -187> 2024-09-14T11:38:15.246+0000 7f9a6ba0c9c0 5 AuthRegistry(0x55a38a68a660) adding con mode: secure 2024-09-14T11:38:15.606 INFO:tasks.workunit.client.0.smithi138.stderr: -186> 2024-09-14T11:38:15.246+0000 7f9a6ba0c9c0 5 AuthRegistry(0x55a38a68a660) adding con mode: crc 2024-09-14T11:38:15.606 INFO:tasks.workunit.client.0.smithi138.stderr: -185> 2024-09-14T11:38:15.246+0000 7f9a6ba0c9c0 5 AuthRegistry(0x55a38a68a660) adding con mode: secure 2024-09-14T11:38:15.606 INFO:tasks.workunit.client.0.smithi138.stderr: -184> 2024-09-14T11:38:15.246+0000 7f9a6ba0c9c0 5 AuthRegistry(0x55a38a68a660) adding con mode: crc 2024-09-14T11:38:15.606 INFO:tasks.workunit.client.0.smithi138.stderr: -183> 2024-09-14T11:38:15.246+0000 7f9a6ba0c9c0 5 AuthRegistry(0x55a38a68a660) adding con mode: crc 2024-09-14T11:38:15.606 INFO:tasks.workunit.client.0.smithi138.stderr: -182> 2024-09-14T11:38:15.246+0000 7f9a6ba0c9c0 5 AuthRegistry(0x55a38a68a660) adding con mode: secure 2024-09-14T11:38:15.606 INFO:tasks.workunit.client.0.smithi138.stderr: -181> 2024-09-14T11:38:15.246+0000 7f9a6ba0c9c0 5 AuthRegistry(0x55a38a68a660) adding con mode: crc 2024-09-14T11:38:15.606 INFO:tasks.workunit.client.0.smithi138.stderr: -180> 2024-09-14T11:38:15.246+0000 7f9a6ba0c9c0 5 AuthRegistry(0x55a38a68a660) adding con mode: secure 2024-09-14T11:38:15.606 INFO:tasks.workunit.client.0.smithi138.stderr: -179> 2024-09-14T11:38:15.246+0000 7f9a6ba0c9c0 5 AuthRegistry(0x55a38a68a660) adding con mode: crc 2024-09-14T11:38:15.606 INFO:tasks.workunit.client.0.smithi138.stderr: -178> 2024-09-14T11:38:15.246+0000 7f9a6ba0c9c0 5 AuthRegistry(0x55a38a68a660) adding con mode: secure 2024-09-14T11:38:15.606 INFO:tasks.workunit.client.0.smithi138.stderr: -177> 2024-09-14T11:38:15.246+0000 7f9a6ba0c9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:38:15.606 INFO:tasks.workunit.client.0.smithi138.stderr: -176> 2024-09-14T11:38:15.246+0000 7f9a6ba0c9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:38:15.606 INFO:tasks.workunit.client.0.smithi138.stderr: -175> 2024-09-14T11:38:15.246+0000 7f9a6ba0c9c0 5 asok(0x55a38a3fed90) register_command rotate-key cmddesc rotate-key hook 0x55a38a68a7a8 EEXIST 2024-09-14T11:38:15.606 INFO:tasks.workunit.client.0.smithi138.stderr: -174> 2024-09-14T11:38:15.246+0000 7f9a6ba0c9c0 10 monclient: _reopen_session rank -1 2024-09-14T11:38:15.607 INFO:tasks.workunit.client.0.smithi138.stderr: -173> 2024-09-14T11:38:15.246+0000 7f9a6ba0c9c0 10 monclient: _add_conns ranks=[1,2,0] 2024-09-14T11:38:15.607 INFO:tasks.workunit.client.0.smithi138.stderr: -172> 2024-09-14T11:38:15.246+0000 7f9a6ba0c9c0 10 monclient(hunting): picked mon.noname-b con 0x55a38a6ac280 addr [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] 2024-09-14T11:38:15.607 INFO:tasks.workunit.client.0.smithi138.stderr: -171> 2024-09-14T11:38:15.246+0000 7f9a6ba0c9c0 10 monclient(hunting): picked mon.noname-c con 0x55a38a6d7960 addr [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] 2024-09-14T11:38:15.607 INFO:tasks.workunit.client.0.smithi138.stderr: -170> 2024-09-14T11:38:15.246+0000 7f9a6ba0c9c0 10 monclient(hunting): picked mon.noname-a con 0x55a38a6dc500 addr [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] 2024-09-14T11:38:15.607 INFO:tasks.workunit.client.0.smithi138.stderr: -169> 2024-09-14T11:38:15.246+0000 7f9a6ba0c9c0 10 monclient(hunting): start opening mon connection 2024-09-14T11:38:15.607 INFO:tasks.workunit.client.0.smithi138.stderr: -168> 2024-09-14T11:38:15.246+0000 7f9a6ba0c9c0 10 monclient(hunting): start opening mon connection 2024-09-14T11:38:15.607 INFO:tasks.workunit.client.0.smithi138.stderr: -167> 2024-09-14T11:38:15.246+0000 7f9a6ba0c9c0 10 monclient(hunting): start opening mon connection 2024-09-14T11:38:15.607 INFO:tasks.workunit.client.0.smithi138.stderr: -166> 2024-09-14T11:38:15.246+0000 7f9a6ba0c9c0 10 monclient(hunting): _renew_subs 2024-09-14T11:38:15.607 INFO:tasks.workunit.client.0.smithi138.stderr: -165> 2024-09-14T11:38:15.246+0000 7f9a6ba0c9c0 10 monclient(hunting): authenticate will time out at 2831.208660s 2024-09-14T11:38:15.607 INFO:tasks.workunit.client.0.smithi138.stderr: -164> 2024-09-14T11:38:15.246+0000 7f9a69512640 10 monclient(hunting): get_auth_request con 0x55a38a6dc500 auth_method 0 2024-09-14T11:38:15.607 INFO:tasks.workunit.client.0.smithi138.stderr: -163> 2024-09-14T11:38:15.246+0000 7f9a69512640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:38:15.607 INFO:tasks.workunit.client.0.smithi138.stderr: -162> 2024-09-14T11:38:15.246+0000 7f9a69512640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:38:15.608 INFO:tasks.workunit.client.0.smithi138.stderr: -161> 2024-09-14T11:38:15.246+0000 7f9a69512640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:38:15.608 INFO:tasks.workunit.client.0.smithi138.stderr: -160> 2024-09-14T11:38:15.246+0000 7f9a69d13640 10 monclient(hunting): get_auth_request con 0x55a38a6d7960 auth_method 0 2024-09-14T11:38:15.608 INFO:tasks.workunit.client.0.smithi138.stderr: -159> 2024-09-14T11:38:15.246+0000 7f9a69d13640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:38:15.608 INFO:tasks.workunit.client.0.smithi138.stderr: -158> 2024-09-14T11:38:15.246+0000 7f9a69d13640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:38:15.608 INFO:tasks.workunit.client.0.smithi138.stderr: -157> 2024-09-14T11:38:15.246+0000 7f9a69d13640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:38:15.608 INFO:tasks.workunit.client.0.smithi138.stderr: -156> 2024-09-14T11:38:15.246+0000 7f9a69512640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:38:15.608 INFO:tasks.workunit.client.0.smithi138.stderr: -155> 2024-09-14T11:38:15.246+0000 7f9a69512640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:38:15.608 INFO:tasks.workunit.client.0.smithi138.stderr: -154> 2024-09-14T11:38:15.246+0000 7f9a69512640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:38:15.608 INFO:tasks.workunit.client.0.smithi138.stderr: -153> 2024-09-14T11:38:15.246+0000 7f9a69d13640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:38:15.608 INFO:tasks.workunit.client.0.smithi138.stderr: -152> 2024-09-14T11:38:15.246+0000 7f9a69d13640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:38:15.608 INFO:tasks.workunit.client.0.smithi138.stderr: -151> 2024-09-14T11:38:15.246+0000 7f9a69d13640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:38:15.608 INFO:tasks.workunit.client.0.smithi138.stderr: -150> 2024-09-14T11:38:15.246+0000 7f9a68d11640 10 monclient(hunting): get_auth_request con 0x55a38a6ac280 auth_method 0 2024-09-14T11:38:15.608 INFO:tasks.workunit.client.0.smithi138.stderr: -149> 2024-09-14T11:38:15.246+0000 7f9a68d11640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:38:15.609 INFO:tasks.workunit.client.0.smithi138.stderr: -148> 2024-09-14T11:38:15.246+0000 7f9a68d11640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:38:15.609 INFO:tasks.workunit.client.0.smithi138.stderr: -147> 2024-09-14T11:38:15.246+0000 7f9a68d11640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:38:15.609 INFO:tasks.workunit.client.0.smithi138.stderr: -146> 2024-09-14T11:38:15.246+0000 7f9a69d13640 10 monclient(hunting): handle_auth_done global_id 7151 payload 824 2024-09-14T11:38:15.609 INFO:tasks.workunit.client.0.smithi138.stderr: -145> 2024-09-14T11:38:15.246+0000 7f9a69d13640 10 monclient: _finish_hunting 0 2024-09-14T11:38:15.609 INFO:tasks.workunit.client.0.smithi138.stderr: -144> 2024-09-14T11:38:15.246+0000 7f9a69d13640 1 monclient: found mon.noname-c 2024-09-14T11:38:15.609 INFO:tasks.workunit.client.0.smithi138.stderr: -143> 2024-09-14T11:38:15.246+0000 7f9a69d13640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.138:3301/0 2024-09-14T11:38:15.609 INFO:tasks.workunit.client.0.smithi138.stderr: -142> 2024-09-14T11:38:15.246+0000 7f993affd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:38:15.609 INFO:tasks.workunit.client.0.smithi138.stderr: -141> 2024-09-14T11:38:15.246+0000 7f993affd640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-14T11:38:15.609 INFO:tasks.workunit.client.0.smithi138.stderr: -140> 2024-09-14T11:38:15.246+0000 7f993affd640 10 monclient: dump: 2024-09-14T11:38:15.609 INFO:tasks.workunit.client.0.smithi138.stderr:epoch 1 2024-09-14T11:38:15.609 INFO:tasks.workunit.client.0.smithi138.stderr:fsid 3f225f43-83a6-4aeb-b798-1f04bb49d597 2024-09-14T11:38:15.609 INFO:tasks.workunit.client.0.smithi138.stderr:last_changed 2024-09-14T11:07:09.252780+0000 2024-09-14T11:38:15.609 INFO:tasks.workunit.client.0.smithi138.stderr:created 2024-09-14T11:07:09.252780+0000 2024-09-14T11:38:15.609 INFO:tasks.workunit.client.0.smithi138.stderr:min_mon_release 19 (squid) 2024-09-14T11:38:15.610 INFO:tasks.workunit.client.0.smithi138.stderr:election_strategy: 1 2024-09-14T11:38:15.610 INFO:tasks.workunit.client.0.smithi138.stderr:0: [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] mon.a 2024-09-14T11:38:15.610 INFO:tasks.workunit.client.0.smithi138.stderr:1: [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] mon.b 2024-09-14T11:38:15.610 INFO:tasks.workunit.client.0.smithi138.stderr:2: [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] mon.c 2024-09-14T11:38:15.610 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-14T11:38:15.610 INFO:tasks.workunit.client.0.smithi138.stderr: -139> 2024-09-14T11:38:15.246+0000 7f993affd640 10 monclient: _finish_auth 0 2024-09-14T11:38:15.610 INFO:tasks.workunit.client.0.smithi138.stderr: -138> 2024-09-14T11:38:15.246+0000 7f993affd640 10 monclient: _check_auth_tickets 2024-09-14T11:38:15.610 INFO:tasks.workunit.client.0.smithi138.stderr: -137> 2024-09-14T11:38:15.246+0000 7f993affd640 10 monclient: handle_config config(0 keys) 2024-09-14T11:38:15.610 INFO:tasks.workunit.client.0.smithi138.stderr: -136> 2024-09-14T11:38:15.246+0000 7f993affd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:38:15.610 INFO:tasks.workunit.client.0.smithi138.stderr: -135> 2024-09-14T11:38:15.246+0000 7f993affd640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-14T11:38:15.610 INFO:tasks.workunit.client.0.smithi138.stderr: -134> 2024-09-14T11:38:15.246+0000 7f993affd640 10 monclient: dump: 2024-09-14T11:38:15.610 INFO:tasks.workunit.client.0.smithi138.stderr:epoch 1 2024-09-14T11:38:15.610 INFO:tasks.workunit.client.0.smithi138.stderr:fsid 3f225f43-83a6-4aeb-b798-1f04bb49d597 2024-09-14T11:38:15.610 INFO:tasks.workunit.client.0.smithi138.stderr:last_changed 2024-09-14T11:07:09.252780+0000 2024-09-14T11:38:15.611 INFO:tasks.workunit.client.0.smithi138.stderr:created 2024-09-14T11:07:09.252780+0000 2024-09-14T11:38:15.611 INFO:tasks.workunit.client.0.smithi138.stderr:min_mon_release 19 (squid) 2024-09-14T11:38:15.611 INFO:tasks.workunit.client.0.smithi138.stderr:election_strategy: 1 2024-09-14T11:38:15.611 INFO:tasks.workunit.client.0.smithi138.stderr:0: [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] mon.a 2024-09-14T11:38:15.611 INFO:tasks.workunit.client.0.smithi138.stderr:1: [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] mon.b 2024-09-14T11:38:15.611 INFO:tasks.workunit.client.0.smithi138.stderr:2: [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] mon.c 2024-09-14T11:38:15.611 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-14T11:38:15.611 INFO:tasks.workunit.client.0.smithi138.stderr: -133> 2024-09-14T11:38:15.246+0000 7f9a6ba0c9c0 5 monclient: authenticate success, global_id 7151 2024-09-14T11:38:15.611 INFO:tasks.workunit.client.0.smithi138.stderr: -132> 2024-09-14T11:38:15.246+0000 7f9a6ba0c9c0 10 monclient: _renew_subs 2024-09-14T11:38:15.611 INFO:tasks.workunit.client.0.smithi138.stderr: -131> 2024-09-14T11:38:15.246+0000 7f994cff9640 4 set_mon_vals no callback set 2024-09-14T11:38:15.611 INFO:tasks.workunit.client.0.smithi138.stderr: -130> 2024-09-14T11:38:15.246+0000 7f9a6ba0c9c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.138:3301/0 2024-09-14T11:38:15.611 INFO:tasks.workunit.client.0.smithi138.stderr: -129> 2024-09-14T11:38:15.246+0000 7f9a6ba0c9c0 10 monclient: _renew_subs 2024-09-14T11:38:15.611 INFO:tasks.workunit.client.0.smithi138.stderr: -128> 2024-09-14T11:38:15.246+0000 7f9a6ba0c9c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.138:3301/0 2024-09-14T11:38:15.611 INFO:tasks.workunit.client.0.smithi138.stderr: -127> 2024-09-14T11:38:15.246+0000 7f9a6ba0c9c0 1 librados: init done 2024-09-14T11:38:15.612 INFO:tasks.workunit.client.0.smithi138.stderr: -126> 2024-09-14T11:38:15.246+0000 7f9a6ba0c9c0 5 asok(0x55a38a3fed90) register_command cr dump hook 0x7f9a640dafc8 2024-09-14T11:38:15.612 INFO:tasks.workunit.client.0.smithi138.stderr: -125> 2024-09-14T11:38:15.246+0000 7f9a6ba0c9c0 20 rados->read ofs=0 len=0 2024-09-14T11:38:15.612 INFO:tasks.workunit.client.0.smithi138.stderr: -124> 2024-09-14T11:38:15.246+0000 7f993affd640 4 mgrc handle_mgr_map Got map version 5 2024-09-14T11:38:15.612 INFO:tasks.workunit.client.0.smithi138.stderr: -123> 2024-09-14T11:38:15.246+0000 7f993affd640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.138:6832/3778043143,v1:172.21.15.138:6833/3778043143] 2024-09-14T11:38:15.612 INFO:tasks.workunit.client.0.smithi138.stderr: -122> 2024-09-14T11:38:15.246+0000 7f993affd640 4 mgrc reconnect Starting new session with [v2:172.21.15.138:6832/3778043143,v1:172.21.15.138:6833/3778043143] 2024-09-14T11:38:15.612 INFO:tasks.workunit.client.0.smithi138.stderr: -121> 2024-09-14T11:38:15.246+0000 7f9a68d11640 10 monclient: get_auth_request con 0x7f99340718a0 auth_method 0 2024-09-14T11:38:15.612 INFO:tasks.workunit.client.0.smithi138.stderr: -120> 2024-09-14T11:38:15.246+0000 7f9a69512640 10 monclient: get_auth_request con 0x55a38a6f5450 auth_method 0 2024-09-14T11:38:15.612 INFO:tasks.workunit.client.0.smithi138.stderr: -119> 2024-09-14T11:38:15.250+0000 7f9a6ba0c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:38:15.612 INFO:tasks.workunit.client.0.smithi138.stderr: -118> 2024-09-14T11:38:15.250+0000 7f9a6ba0c9c0 20 realm 2024-09-14T11:38:15.612 INFO:tasks.workunit.client.0.smithi138.stderr: -117> 2024-09-14T11:38:15.250+0000 7f9a6ba0c9c0 20 rados->read ofs=0 len=0 2024-09-14T11:38:15.612 INFO:tasks.workunit.client.0.smithi138.stderr: -116> 2024-09-14T11:38:15.250+0000 7f9a6ba0c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:38:15.612 INFO:tasks.workunit.client.0.smithi138.stderr: -115> 2024-09-14T11:38:15.250+0000 7f9a6ba0c9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:38:15.612 INFO:tasks.workunit.client.0.smithi138.stderr: -114> 2024-09-14T11:38:15.250+0000 7f9a6ba0c9c0 20 rados->read ofs=0 len=0 2024-09-14T11:38:15.612 INFO:tasks.workunit.client.0.smithi138.stderr: -113> 2024-09-14T11:38:15.250+0000 7f9a6ba0c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:38:15.613 INFO:tasks.workunit.client.0.smithi138.stderr: -112> 2024-09-14T11:38:15.250+0000 7f9a6ba0c9c0 20 rados->read ofs=0 len=0 2024-09-14T11:38:15.613 INFO:tasks.workunit.client.0.smithi138.stderr: -111> 2024-09-14T11:38:15.250+0000 7f9a68d11640 10 monclient: get_auth_request con 0x55a38a6f96d0 auth_method 0 2024-09-14T11:38:15.613 INFO:tasks.workunit.client.0.smithi138.stderr: -110> 2024-09-14T11:38:15.250+0000 7f9a6ba0c9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:38:15.613 INFO:tasks.workunit.client.0.smithi138.stderr: -109> 2024-09-14T11:38:15.250+0000 7f9a6ba0c9c0 20 rados->read ofs=0 len=0 2024-09-14T11:38:15.613 INFO:tasks.workunit.client.0.smithi138.stderr: -108> 2024-09-14T11:38:15.250+0000 7f9a69d13640 10 monclient: get_auth_request con 0x55a38a6fcf80 auth_method 0 2024-09-14T11:38:15.613 INFO:tasks.workunit.client.0.smithi138.stderr: -107> 2024-09-14T11:38:15.250+0000 7f9a6ba0c9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:38:15.613 INFO:tasks.workunit.client.0.smithi138.stderr: -106> 2024-09-14T11:38:15.250+0000 7f9a6ba0c9c0 20 searching for the correct realm 2024-09-14T11:38:15.613 INFO:tasks.workunit.client.0.smithi138.stderr: -105> 2024-09-14T11:38:15.250+0000 7f9a69512640 10 monclient: get_auth_request con 0x55a38a701d00 auth_method 0 2024-09-14T11:38:15.613 INFO:tasks.workunit.client.0.smithi138.stderr: -104> 2024-09-14T11:38:15.254+0000 7f9a68d11640 10 monclient: get_auth_request con 0x7f9a5c008030 auth_method 0 2024-09-14T11:38:15.613 INFO:tasks.workunit.client.0.smithi138.stderr: -103> 2024-09-14T11:38:15.254+0000 7f9a69d13640 10 monclient: get_auth_request con 0x7f9a64004040 auth_method 0 2024-09-14T11:38:15.613 INFO:tasks.workunit.client.0.smithi138.stderr: -102> 2024-09-14T11:38:15.258+0000 7f9a68d11640 0 -- 172.21.15.138:0/233349919 >> [v2:172.21.15.154:6808/1468088432,v1:172.21.15.154:6809/1468088432] conn(0x7f9a5c008030 msgr2=0x7f9a5c05c360 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:38:15.613 INFO:tasks.workunit.client.0.smithi138.stderr: -101> 2024-09-14T11:38:15.258+0000 7f993affd640 1 client.7151.objecter ms_handle_reset 0x7f9a5c008030 session 0x7f9a5c0621f0 osd.7 2024-09-14T11:38:15.613 INFO:tasks.workunit.client.0.smithi138.stderr: -100> 2024-09-14T11:38:15.258+0000 7f993affd640 10 monclient: _renew_subs 2024-09-14T11:38:15.613 INFO:tasks.workunit.client.0.smithi138.stderr: -99> 2024-09-14T11:38:15.258+0000 7f993affd640 10 monclient: _send_mon_message to mon.c at v2:172.21.15.138:3301/0 2024-09-14T11:38:15.614 INFO:tasks.workunit.client.0.smithi138.stderr: -98> 2024-09-14T11:38:15.258+0000 7f9a68d11640 10 monclient: get_auth_request con 0x7f9934081fd0 auth_method 0 2024-09-14T11:38:15.614 INFO:tasks.workunit.client.0.smithi138.stderr: -97> 2024-09-14T11:38:15.258+0000 7f9a69512640 10 monclient: get_auth_request con 0x7f9a640b9440 auth_method 0 2024-09-14T11:38:15.614 INFO:tasks.workunit.client.0.smithi138.stderr: -96> 2024-09-14T11:38:15.262+0000 7f9a68d11640 10 monclient: get_auth_request con 0x7f9a64117000 auth_method 0 2024-09-14T11:38:15.614 INFO:tasks.workunit.client.0.smithi138.stderr: -95> 2024-09-14T11:38:15.262+0000 7f9a68d11640 0 -- 172.21.15.138:0/233349919 >> [v2:172.21.15.138:6816/326481658,v1:172.21.15.138:6817/326481658] conn(0x7f9a64117000 msgr2=0x7f9a64115860 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:38:15.614 INFO:tasks.workunit.client.0.smithi138.stderr: -94> 2024-09-14T11:38:15.466+0000 7f9a68d11640 10 monclient: get_auth_request con 0x7f9a64117000 auth_method 0 2024-09-14T11:38:15.614 INFO:tasks.workunit.client.0.smithi138.stderr: -93> 2024-09-14T11:38:15.478+0000 7f9a6ba0c9c0 20 RGWRados::pool_iterate: got zone_info.d9e72d30-c60b-4d0d-9267-fdc36392d5ad 2024-09-14T11:38:15.614 INFO:tasks.workunit.client.0.smithi138.stderr: -92> 2024-09-14T11:38:15.478+0000 7f9a6ba0c9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:38:15.614 INFO:tasks.workunit.client.0.smithi138.stderr: -91> 2024-09-14T11:38:15.478+0000 7f9a6ba0c9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:38:15.614 INFO:tasks.workunit.client.0.smithi138.stderr: -90> 2024-09-14T11:38:15.478+0000 7f9a6ba0c9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:38:15.614 INFO:tasks.workunit.client.0.smithi138.stderr: -89> 2024-09-14T11:38:15.478+0000 7f9a6ba0c9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:38:15.614 INFO:tasks.workunit.client.0.smithi138.stderr: -88> 2024-09-14T11:38:15.478+0000 7f9a6ba0c9c0 20 RGWRados::pool_iterate: got zonegroup_info.65ab941b-da8c-4160-94fb-3672b069d44f 2024-09-14T11:38:15.614 INFO:tasks.workunit.client.0.smithi138.stderr: -87> 2024-09-14T11:38:15.478+0000 7f9a6ba0c9c0 20 rados->read ofs=0 len=0 2024-09-14T11:38:15.614 INFO:tasks.workunit.client.0.smithi138.stderr: -86> 2024-09-14T11:38:15.478+0000 7f9a6ba0c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:38:15.615 INFO:tasks.workunit.client.0.smithi138.stderr: -85> 2024-09-14T11:38:15.478+0000 7f9a6ba0c9c0 20 rados->read ofs=0 len=0 2024-09-14T11:38:15.615 INFO:tasks.workunit.client.0.smithi138.stderr: -84> 2024-09-14T11:38:15.482+0000 7f9a6ba0c9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:38:15.615 INFO:tasks.workunit.client.0.smithi138.stderr: -83> 2024-09-14T11:38:15.482+0000 7f9a6ba0c9c0 20 rados->read ofs=0 len=0 2024-09-14T11:38:15.615 INFO:tasks.workunit.client.0.smithi138.stderr: -82> 2024-09-14T11:38:15.482+0000 7f9a6ba0c9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:38:15.615 INFO:tasks.workunit.client.0.smithi138.stderr: -81> 2024-09-14T11:38:15.482+0000 7f9a6ba0c9c0 20 zone default found 2024-09-14T11:38:15.615 INFO:tasks.workunit.client.0.smithi138.stderr: -80> 2024-09-14T11:38:15.482+0000 7f9a6ba0c9c0 4 Realm: () 2024-09-14T11:38:15.615 INFO:tasks.workunit.client.0.smithi138.stderr: -79> 2024-09-14T11:38:15.482+0000 7f9a6ba0c9c0 4 ZoneGroup: default (65ab941b-da8c-4160-94fb-3672b069d44f) 2024-09-14T11:38:15.615 INFO:tasks.workunit.client.0.smithi138.stderr: -78> 2024-09-14T11:38:15.482+0000 7f9a6ba0c9c0 4 Zone: default (d9e72d30-c60b-4d0d-9267-fdc36392d5ad) 2024-09-14T11:38:15.615 INFO:tasks.workunit.client.0.smithi138.stderr: -77> 2024-09-14T11:38:15.482+0000 7f9a6ba0c9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:38:15.615 INFO:tasks.workunit.client.0.smithi138.stderr: -76> 2024-09-14T11:38:15.482+0000 7f9a6ba0c9c0 20 zonegroup default 2024-09-14T11:38:15.615 INFO:tasks.workunit.client.0.smithi138.stderr: -75> 2024-09-14T11:38:15.482+0000 7f9a6ba0c9c0 20 rados->read ofs=0 len=0 2024-09-14T11:38:15.615 INFO:tasks.workunit.client.0.smithi138.stderr: -74> 2024-09-14T11:38:15.482+0000 7f9a6ba0c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:38:15.615 INFO:tasks.workunit.client.0.smithi138.stderr: -73> 2024-09-14T11:38:15.482+0000 7f9a6ba0c9c0 20 rados->read ofs=0 len=0 2024-09-14T11:38:15.615 INFO:tasks.workunit.client.0.smithi138.stderr: -72> 2024-09-14T11:38:15.482+0000 7f9a6ba0c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:38:15.616 INFO:tasks.workunit.client.0.smithi138.stderr: -71> 2024-09-14T11:38:15.482+0000 7f9a6ba0c9c0 20 rados->read ofs=0 len=0 2024-09-14T11:38:15.616 INFO:tasks.workunit.client.0.smithi138.stderr: -70> 2024-09-14T11:38:15.486+0000 7f9a6ba0c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:38:15.616 INFO:tasks.workunit.client.0.smithi138.stderr: -69> 2024-09-14T11:38:15.486+0000 7f9a6ba0c9c0 20 started sync module instance, tier type = 2024-09-14T11:38:15.616 INFO:tasks.workunit.client.0.smithi138.stderr: -68> 2024-09-14T11:38:15.486+0000 7f9a6ba0c9c0 20 started zone id=d9e72d30-c60b-4d0d-9267-fdc36392d5ad (name=default) with tier type = 2024-09-14T11:38:15.616 INFO:tasks.workunit.client.0.smithi138.stderr: -67> 2024-09-14T11:38:15.506+0000 7f9a6ba0c9c0 20 add_watcher() i=0 2024-09-14T11:38:15.616 INFO:tasks.workunit.client.0.smithi138.stderr: -66> 2024-09-14T11:38:15.506+0000 7f9a6ba0c9c0 20 add_watcher() i=1 2024-09-14T11:38:15.616 INFO:tasks.workunit.client.0.smithi138.stderr: -65> 2024-09-14T11:38:15.506+0000 7f9a6ba0c9c0 20 add_watcher() i=2 2024-09-14T11:38:15.616 INFO:tasks.workunit.client.0.smithi138.stderr: -64> 2024-09-14T11:38:15.506+0000 7f9a6ba0c9c0 20 add_watcher() i=3 2024-09-14T11:38:15.616 INFO:tasks.workunit.client.0.smithi138.stderr: -63> 2024-09-14T11:38:15.506+0000 7f9a6ba0c9c0 20 add_watcher() i=4 2024-09-14T11:38:15.616 INFO:tasks.workunit.client.0.smithi138.stderr: -62> 2024-09-14T11:38:15.506+0000 7f9a6ba0c9c0 20 add_watcher() i=5 2024-09-14T11:38:15.616 INFO:tasks.workunit.client.0.smithi138.stderr: -61> 2024-09-14T11:38:15.506+0000 7f9a6ba0c9c0 20 add_watcher() i=6 2024-09-14T11:38:15.616 INFO:tasks.workunit.client.0.smithi138.stderr: -60> 2024-09-14T11:38:15.510+0000 7f9a6ba0c9c0 20 add_watcher() i=7 2024-09-14T11:38:15.616 INFO:tasks.workunit.client.0.smithi138.stderr: -59> 2024-09-14T11:38:15.510+0000 7f9a6ba0c9c0 2 all 8 watchers are set, enabling cache 2024-09-14T11:38:15.616 INFO:tasks.workunit.client.0.smithi138.stderr: -58> 2024-09-14T11:38:15.514+0000 7f9a6ba0c9c0 5 AuthRegistry(0x7fff9ef3bd70) adding auth protocol: cephx 2024-09-14T11:38:15.617 INFO:tasks.workunit.client.0.smithi138.stderr: -57> 2024-09-14T11:38:15.514+0000 7f9a6ba0c9c0 5 AuthRegistry(0x7fff9ef3bd70) adding auth protocol: cephx 2024-09-14T11:38:15.617 INFO:tasks.workunit.client.0.smithi138.stderr: -56> 2024-09-14T11:38:15.514+0000 7f9a6ba0c9c0 5 AuthRegistry(0x7fff9ef3bd70) adding auth protocol: cephx 2024-09-14T11:38:15.617 INFO:tasks.workunit.client.0.smithi138.stderr: -55> 2024-09-14T11:38:15.514+0000 7f9a6ba0c9c0 5 AuthRegistry(0x7fff9ef3bd70) adding con mode: secure 2024-09-14T11:38:15.617 INFO:tasks.workunit.client.0.smithi138.stderr: -54> 2024-09-14T11:38:15.514+0000 7f9a6ba0c9c0 5 AuthRegistry(0x7fff9ef3bd70) adding con mode: crc 2024-09-14T11:38:15.617 INFO:tasks.workunit.client.0.smithi138.stderr: -53> 2024-09-14T11:38:15.514+0000 7f9a6ba0c9c0 5 AuthRegistry(0x7fff9ef3bd70) adding con mode: secure 2024-09-14T11:38:15.617 INFO:tasks.workunit.client.0.smithi138.stderr: -52> 2024-09-14T11:38:15.514+0000 7f9a6ba0c9c0 5 AuthRegistry(0x7fff9ef3bd70) adding con mode: crc 2024-09-14T11:38:15.617 INFO:tasks.workunit.client.0.smithi138.stderr: -51> 2024-09-14T11:38:15.514+0000 7f9a6ba0c9c0 5 AuthRegistry(0x7fff9ef3bd70) adding con mode: secure 2024-09-14T11:38:15.617 INFO:tasks.workunit.client.0.smithi138.stderr: -50> 2024-09-14T11:38:15.514+0000 7f9a6ba0c9c0 5 AuthRegistry(0x7fff9ef3bd70) adding con mode: crc 2024-09-14T11:38:15.617 INFO:tasks.workunit.client.0.smithi138.stderr: -49> 2024-09-14T11:38:15.514+0000 7f9a6ba0c9c0 5 AuthRegistry(0x7fff9ef3bd70) adding con mode: crc 2024-09-14T11:38:15.617 INFO:tasks.workunit.client.0.smithi138.stderr: -48> 2024-09-14T11:38:15.514+0000 7f9a6ba0c9c0 5 AuthRegistry(0x7fff9ef3bd70) adding con mode: secure 2024-09-14T11:38:15.617 INFO:tasks.workunit.client.0.smithi138.stderr: -47> 2024-09-14T11:38:15.514+0000 7f9a6ba0c9c0 5 AuthRegistry(0x7fff9ef3bd70) adding con mode: crc 2024-09-14T11:38:15.617 INFO:tasks.workunit.client.0.smithi138.stderr: -46> 2024-09-14T11:38:15.514+0000 7f9a6ba0c9c0 5 AuthRegistry(0x7fff9ef3bd70) adding con mode: secure 2024-09-14T11:38:15.617 INFO:tasks.workunit.client.0.smithi138.stderr: -45> 2024-09-14T11:38:15.514+0000 7f9a6ba0c9c0 5 AuthRegistry(0x7fff9ef3bd70) adding con mode: crc 2024-09-14T11:38:15.617 INFO:tasks.workunit.client.0.smithi138.stderr: -44> 2024-09-14T11:38:15.514+0000 7f991ffe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:38:15.618 INFO:tasks.workunit.client.0.smithi138.stderr: -43> 2024-09-14T11:38:15.514+0000 7f9a6ba0c9c0 5 AuthRegistry(0x7fff9ef3bd70) adding con mode: secure 2024-09-14T11:38:15.618 INFO:tasks.workunit.client.0.smithi138.stderr: -42> 2024-09-14T11:38:15.514+0000 7f9a6ba0c9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:38:15.618 INFO:tasks.workunit.client.0.smithi138.stderr: -41> 2024-09-14T11:38:15.514+0000 7f9a6ba0c9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:38:15.618 INFO:tasks.workunit.client.0.smithi138.stderr: -40> 2024-09-14T11:38:15.514+0000 7f9a6ba0c9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:38:15.618 INFO:tasks.workunit.client.0.smithi138.stderr: -39> 2024-09-14T11:38:15.514+0000 7f9a6ba0c9c0 5 asok(0x55a38a3fed90) register_command cache list hook 0x55a38a6aadf0 2024-09-14T11:38:15.618 INFO:tasks.workunit.client.0.smithi138.stderr: -38> 2024-09-14T11:38:15.514+0000 7f9a6ba0c9c0 5 asok(0x55a38a3fed90) register_command cache inspect hook 0x55a38a6aadf0 2024-09-14T11:38:15.618 INFO:tasks.workunit.client.0.smithi138.stderr: -37> 2024-09-14T11:38:15.514+0000 7f9a6ba0c9c0 5 asok(0x55a38a3fed90) register_command cache erase hook 0x55a38a6aadf0 2024-09-14T11:38:15.618 INFO:tasks.workunit.client.0.smithi138.stderr: -36> 2024-09-14T11:38:15.514+0000 7f9a6ba0c9c0 5 asok(0x55a38a3fed90) register_command cache zap hook 0x55a38a6aadf0 2024-09-14T11:38:15.618 INFO:tasks.workunit.client.0.smithi138.stderr: -35> 2024-09-14T11:38:15.514+0000 7f9a6ba0c9c0 5 note: GC not initialized 2024-09-14T11:38:15.618 INFO:tasks.workunit.client.0.smithi138.stderr: -34> 2024-09-14T11:38:15.514+0000 7f991efe5640 20 reqs_thread_entry: start 2024-09-14T11:38:15.618 INFO:tasks.workunit.client.0.smithi138.stderr: -33> 2024-09-14T11:38:15.514+0000 7f9a6ba0c9c0 5 asok(0x55a38a3fed90) register_command sync trace show hook 0x7f9a60007040 2024-09-14T11:38:15.618 INFO:tasks.workunit.client.0.smithi138.stderr: -32> 2024-09-14T11:38:15.514+0000 7f9a6ba0c9c0 5 asok(0x55a38a3fed90) register_command sync trace history hook 0x7f9a60007040 2024-09-14T11:38:15.618 INFO:tasks.workunit.client.0.smithi138.stderr: -31> 2024-09-14T11:38:15.514+0000 7f9a6ba0c9c0 5 asok(0x55a38a3fed90) register_command sync trace active hook 0x7f9a60007040 2024-09-14T11:38:15.618 INFO:tasks.workunit.client.0.smithi138.stderr: -30> 2024-09-14T11:38:15.514+0000 7f9a6ba0c9c0 5 asok(0x55a38a3fed90) register_command sync trace active_short hook 0x7f9a60007040 2024-09-14T11:38:15.619 INFO:tasks.workunit.client.0.smithi138.stderr: -29> 2024-09-14T11:38:15.514+0000 7f9a6ba0c9c0 20 init_complete bucket index max shards: 11 2024-09-14T11:38:15.619 INFO:tasks.workunit.client.0.smithi138.stderr: -28> 2024-09-14T11:38:15.514+0000 7f9a6ba0c9c0 20 Filter name: none 2024-09-14T11:38:15.619 INFO:tasks.workunit.client.0.smithi138.stderr: -27> 2024-09-14T11:38:15.514+0000 7f991cfe1640 20 reqs_thread_entry: start 2024-09-14T11:38:15.619 INFO:tasks.workunit.client.0.smithi138.stderr: -26> 2024-09-14T11:38:15.514+0000 7f9a6ba0c9c0 10 cache get: name=default.rgw.meta+root+abort-at-logrecord-writes : miss 2024-09-14T11:38:15.619 INFO:tasks.workunit.client.0.smithi138.stderr: -25> 2024-09-14T11:38:15.514+0000 7f9a6ba0c9c0 20 rados->read ofs=0 len=0 2024-09-14T11:38:15.619 INFO:tasks.workunit.client.0.smithi138.stderr: -24> 2024-09-14T11:38:15.518+0000 7f9a6ba0c9c0 20 rados_obj.operate() r=0 bl.length=193 2024-09-14T11:38:15.619 INFO:tasks.workunit.client.0.smithi138.stderr: -23> 2024-09-14T11:38:15.518+0000 7f9a6ba0c9c0 10 cache put: name=default.rgw.meta+root+abort-at-logrecord-writes info.flags=0x11 2024-09-14T11:38:15.619 INFO:tasks.workunit.client.0.smithi138.stderr: -22> 2024-09-14T11:38:15.518+0000 7f9a6ba0c9c0 10 adding default.rgw.meta+root+abort-at-logrecord-writes to cache LRU end 2024-09-14T11:38:15.619 INFO:tasks.workunit.client.0.smithi138.stderr: -21> 2024-09-14T11:38:15.518+0000 7f9a6ba0c9c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.36 : miss 2024-09-14T11:38:15.619 INFO:tasks.workunit.client.0.smithi138.stderr: -20> 2024-09-14T11:38:15.518+0000 7f9a6ba0c9c0 20 rados->read ofs=0 len=0 2024-09-14T11:38:15.619 INFO:tasks.workunit.client.0.smithi138.stderr: -19> 2024-09-14T11:38:15.518+0000 7f9a6ba0c9c0 20 rados_obj.operate() r=0 bl.length=415 2024-09-14T11:38:15.619 INFO:tasks.workunit.client.0.smithi138.stderr: -18> 2024-09-14T11:38:15.518+0000 7f9a6ba0c9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.36 info.flags=0x17 2024-09-14T11:38:15.619 INFO:tasks.workunit.client.0.smithi138.stderr: -17> 2024-09-14T11:38:15.518+0000 7f9a6ba0c9c0 10 adding default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.36 to cache LRU end 2024-09-14T11:38:15.620 INFO:tasks.workunit.client.0.smithi138.stderr: -16> 2024-09-14T11:38:15.518+0000 7f9a6ba0c9c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:38:15.620 INFO:tasks.workunit.client.0.smithi138.stderr: -15> 2024-09-14T11:38:15.518+0000 7f9a6ba0c9c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:38:15.620 INFO:tasks.workunit.client.0.smithi138.stderr: -14> 2024-09-14T11:38:15.518+0000 7f9a6ba0c9c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.36 2024-09-14T11:38:15.620 INFO:tasks.workunit.client.0.smithi138.stderr: -13> 2024-09-14T11:38:15.530+0000 7f9a6ba0c9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.36 info.flags=0x17 2024-09-14T11:38:15.620 INFO:tasks.workunit.client.0.smithi138.stderr: -12> 2024-09-14T11:38:15.530+0000 7f9a6ba0c9c0 10 moving default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.36 to cache LRU end 2024-09-14T11:38:15.620 INFO:tasks.workunit.client.0.smithi138.stderr: -11> 2024-09-14T11:38:15.530+0000 7f9a6ba0c9c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:38:15.620 INFO:tasks.workunit.client.0.smithi138.stderr: -10> 2024-09-14T11:38:15.530+0000 7f9a6ba0c9c0 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-logrecord-writes:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.36, ofs0, ns] 2024-09-14T11:38:15.620 INFO:tasks.workunit.client.0.smithi138.stderr: -9> 2024-09-14T11:38:15.534+0000 7f994cff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366169 cookie 94160890663888 notifier 7151 bl.length()=923 2024-09-14T11:38:15.620 INFO:tasks.workunit.client.0.smithi138.stderr: -8> 2024-09-14T11:38:15.534+0000 7f994cff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.36 info.flags=0x17 2024-09-14T11:38:15.620 INFO:tasks.workunit.client.0.smithi138.stderr: -7> 2024-09-14T11:38:15.534+0000 7f994cff9640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.36 to cache LRU end 2024-09-14T11:38:15.620 INFO:tasks.workunit.client.0.smithi138.stderr: -6> 2024-09-14T11:38:15.534+0000 7f994cff9640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:38:15.620 INFO:tasks.workunit.client.0.smithi138.stderr: -5> 2024-09-14T11:38:15.534+0000 7f9a6ba0c9c0 20 handle_bi_update(): bucket=:abort-at-logrecord-writes[d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.36]): orig_sources= new_sources= 2024-09-14T11:38:15.620 INFO:tasks.workunit.client.0.smithi138.stderr: -4> 2024-09-14T11:38:15.534+0000 7f9a6ba0c9c0 20 handle_bi_update(): bucket=:abort-at-logrecord-writes[d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.36]): potential sources added=[] removed=[] 2024-09-14T11:38:15.621 INFO:tasks.workunit.client.0.smithi138.stderr: -3> 2024-09-14T11:38:15.534+0000 7f9a6ba0c9c0 20 handle_bi_update(): bucket=:abort-at-logrecord-writes[d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.36]): orig_dests= new_dests= 2024-09-14T11:38:15.621 INFO:tasks.workunit.client.0.smithi138.stderr: -2> 2024-09-14T11:38:15.534+0000 7f9a6ba0c9c0 20 handle_bi_update(): bucket=:abort-at-logrecord-writes[d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.36]): potential dests added=[] removed=[] 2024-09-14T11:38:15.621 INFO:tasks.workunit.client.0.smithi138.stderr: -1> 2024-09-14T11:38:15.542+0000 7f9a6ba0c9c0 -1 ./src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f9a6ba0c9c0 time 2024-09-14T11:38:15.545043+0000 2024-09-14T11:38:15.621 INFO:tasks.workunit.client.0.smithi138.stderr:./src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-14T11:38:15.621 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-14T11:38:15.621 INFO:tasks.workunit.client.0.smithi138.stderr: ceph version 19.3.0-4907-ga2782315 (a2782315255a3e7d5f6cdc9eb35785187ff6ddf8) squid (dev) 2024-09-14T11:38:15.621 INFO:tasks.workunit.client.0.smithi138.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x121) [0x7f9a6f2e62eb] 2024-09-14T11:38:15.621 INFO:tasks.workunit.client.0.smithi138.stderr: 2: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7f9a6f2e649f] 2024-09-14T11:38:15.621 INFO:tasks.workunit.client.0.smithi138.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55a388c47c01] 2024-09-14T11:38:15.621 INFO:tasks.workunit.client.0.smithi138.stderr: 4: radosgw-admin(+0x142325c) [0x55a3896a625c] 2024-09-14T11:38:15.621 INFO:tasks.workunit.client.0.smithi138.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x55a388c5cecd] 2024-09-14T11:38:15.621 INFO:tasks.workunit.client.0.smithi138.stderr: 6: main() 2024-09-14T11:38:15.621 INFO:tasks.workunit.client.0.smithi138.stderr: 7: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7f9a6e14cd90] 2024-09-14T11:38:15.621 INFO:tasks.workunit.client.0.smithi138.stderr: 8: __libc_start_main() 2024-09-14T11:38:15.622 INFO:tasks.workunit.client.0.smithi138.stderr: 9: _start() 2024-09-14T11:38:15.622 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-14T11:38:15.622 INFO:tasks.workunit.client.0.smithi138.stderr: 0> 2024-09-14T11:38:15.542+0000 7f9a6ba0c9c0 -1 *** Caught signal (Aborted) ** 2024-09-14T11:38:15.622 INFO:tasks.workunit.client.0.smithi138.stderr: in thread 7f9a6ba0c9c0 thread_name:radosgw-admin 2024-09-14T11:38:15.622 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-14T11:38:15.622 INFO:tasks.workunit.client.0.smithi138.stderr: ceph version 19.3.0-4907-ga2782315 (a2782315255a3e7d5f6cdc9eb35785187ff6ddf8) squid (dev) 2024-09-14T11:38:15.622 INFO:tasks.workunit.client.0.smithi138.stderr: 1: /lib/x86_64-linux-gnu/libc.so.6(+0x42520) [0x7f9a6e165520] 2024-09-14T11:38:15.622 INFO:tasks.workunit.client.0.smithi138.stderr: 2: pthread_kill() 2024-09-14T11:38:15.622 INFO:tasks.workunit.client.0.smithi138.stderr: 3: raise() 2024-09-14T11:38:15.622 INFO:tasks.workunit.client.0.smithi138.stderr: 4: abort() 2024-09-14T11:38:15.622 INFO:tasks.workunit.client.0.smithi138.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x17b) [0x7f9a6f2e6345] 2024-09-14T11:38:15.622 INFO:tasks.workunit.client.0.smithi138.stderr: 6: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7f9a6f2e649f] 2024-09-14T11:38:15.623 INFO:tasks.workunit.client.0.smithi138.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55a388c47c01] 2024-09-14T11:38:15.623 INFO:tasks.workunit.client.0.smithi138.stderr: 8: radosgw-admin(+0x142325c) [0x55a3896a625c] 2024-09-14T11:38:15.623 INFO:tasks.workunit.client.0.smithi138.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x55a388c5cecd] 2024-09-14T11:38:15.623 INFO:tasks.workunit.client.0.smithi138.stderr: 10: main() 2024-09-14T11:38:15.623 INFO:tasks.workunit.client.0.smithi138.stderr: 11: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7f9a6e14cd90] 2024-09-14T11:38:15.623 INFO:tasks.workunit.client.0.smithi138.stderr: 12: __libc_start_main() 2024-09-14T11:38:15.623 INFO:tasks.workunit.client.0.smithi138.stderr: 13: _start() 2024-09-14T11:38:15.623 INFO:tasks.workunit.client.0.smithi138.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-14T11:38:15.623 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-14T11:38:15.623 INFO:tasks.workunit.client.0.smithi138.stderr:--- logging levels --- 2024-09-14T11:38:15.623 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 none 2024-09-14T11:38:15.623 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 1 lockdep 2024-09-14T11:38:15.623 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 1 context 2024-09-14T11:38:15.623 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 1 crush 2024-09-14T11:38:15.624 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 mds 2024-09-14T11:38:15.624 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 mds_balancer 2024-09-14T11:38:15.624 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 mds_locker 2024-09-14T11:38:15.624 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 mds_log 2024-09-14T11:38:15.624 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 mds_log_expire 2024-09-14T11:38:15.624 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 mds_migrator 2024-09-14T11:38:15.624 INFO:tasks.workunit.client.0.smithi138.stderr: 3/ 5 mds_quiesce 2024-09-14T11:38:15.624 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 1 buffer 2024-09-14T11:38:15.624 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 1 timer 2024-09-14T11:38:15.624 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 1 filer 2024-09-14T11:38:15.624 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 1 striper 2024-09-14T11:38:15.624 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 1 objecter 2024-09-14T11:38:15.624 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 rados 2024-09-14T11:38:15.624 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 rbd 2024-09-14T11:38:15.625 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 rbd_mirror 2024-09-14T11:38:15.625 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 rbd_replay 2024-09-14T11:38:15.625 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 rbd_pwl 2024-09-14T11:38:15.625 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 journaler 2024-09-14T11:38:15.625 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 objectcacher 2024-09-14T11:38:15.625 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 immutable_obj_cache 2024-09-14T11:38:15.625 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 client 2024-09-14T11:38:15.625 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 osd 2024-09-14T11:38:15.625 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 optracker 2024-09-14T11:38:15.625 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 objclass 2024-09-14T11:38:15.625 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 3 filestore 2024-09-14T11:38:15.625 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 3 journal 2024-09-14T11:38:15.625 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 0 ms 2024-09-14T11:38:15.625 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 mon 2024-09-14T11:38:15.625 INFO:tasks.workunit.client.0.smithi138.stderr: 0/10 monc 2024-09-14T11:38:15.626 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 paxos 2024-09-14T11:38:15.626 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 tp 2024-09-14T11:38:15.626 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 auth 2024-09-14T11:38:15.626 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 crypto 2024-09-14T11:38:15.626 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 1 finisher 2024-09-14T11:38:15.626 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 1 reserver 2024-09-14T11:38:15.626 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 heartbeatmap 2024-09-14T11:38:15.626 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 perfcounter 2024-09-14T11:38:15.626 INFO:tasks.workunit.client.0.smithi138.stderr: 20/20 rgw 2024-09-14T11:38:15.626 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 rgw_sync 2024-09-14T11:38:15.626 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 rgw_datacache 2024-09-14T11:38:15.626 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 rgw_access 2024-09-14T11:38:15.626 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 rgw_dbstore 2024-09-14T11:38:15.626 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 rgw_flight 2024-09-14T11:38:15.627 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 rgw_lifecycle 2024-09-14T11:38:15.627 INFO:tasks.workunit.client.0.smithi138.stderr: 20/20 rgw_notification 2024-09-14T11:38:15.627 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 javaclient 2024-09-14T11:38:15.627 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 asok 2024-09-14T11:38:15.627 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 1 throttle 2024-09-14T11:38:15.627 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 0 refs 2024-09-14T11:38:15.627 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 compressor 2024-09-14T11:38:15.627 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 bluestore 2024-09-14T11:38:15.627 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 bluefs 2024-09-14T11:38:15.627 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 3 bdev 2024-09-14T11:38:15.627 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 kstore 2024-09-14T11:38:15.627 INFO:tasks.workunit.client.0.smithi138.stderr: 4/ 5 rocksdb 2024-09-14T11:38:15.627 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 fuse 2024-09-14T11:38:15.627 INFO:tasks.workunit.client.0.smithi138.stderr: 2/ 5 mgr 2024-09-14T11:38:15.628 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 mgrc 2024-09-14T11:38:15.628 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 dpdk 2024-09-14T11:38:15.628 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 eventtrace 2024-09-14T11:38:15.628 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 prioritycache 2024-09-14T11:38:15.628 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 test 2024-09-14T11:38:15.628 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 cephfs_mirror 2024-09-14T11:38:15.628 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 cephsqlite 2024-09-14T11:38:15.628 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 crimson_interrupt 2024-09-14T11:38:15.628 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 seastore 2024-09-14T11:38:15.628 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 seastore_onode 2024-09-14T11:38:15.628 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 seastore_odata 2024-09-14T11:38:15.628 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 seastore_omap 2024-09-14T11:38:15.628 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 seastore_tm 2024-09-14T11:38:15.629 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 seastore_t 2024-09-14T11:38:15.629 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 seastore_cleaner 2024-09-14T11:38:15.629 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 seastore_epm 2024-09-14T11:38:15.629 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 seastore_lba 2024-09-14T11:38:15.629 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 seastore_fixedkv_tree 2024-09-14T11:38:15.629 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 seastore_cache 2024-09-14T11:38:15.629 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 seastore_journal 2024-09-14T11:38:15.629 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 seastore_device 2024-09-14T11:38:15.629 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 seastore_backref 2024-09-14T11:38:15.629 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 alienstore 2024-09-14T11:38:15.629 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 mclock 2024-09-14T11:38:15.629 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 cyanstore 2024-09-14T11:38:15.629 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 ceph_exporter 2024-09-14T11:38:15.629 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 memstore 2024-09-14T11:38:15.629 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 trace 2024-09-14T11:38:15.630 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 ceph_dedup 2024-09-14T11:38:15.630 INFO:tasks.workunit.client.0.smithi138.stderr: -2/-2 (syslog threshold) 2024-09-14T11:38:15.630 INFO:tasks.workunit.client.0.smithi138.stderr: 99/99 (stderr threshold) 2024-09-14T11:38:15.630 INFO:tasks.workunit.client.0.smithi138.stderr:--- pthread ID / name mapping for recent threads --- 2024-09-14T11:38:15.630 INFO:tasks.workunit.client.0.smithi138.stderr: 7f991cfe1640 / http_manager 2024-09-14T11:38:15.630 INFO:tasks.workunit.client.0.smithi138.stderr: 7f991efe5640 / http_manager 2024-09-14T11:38:15.630 INFO:tasks.workunit.client.0.smithi138.stderr: 7f991ffe7640 / rgw_dt_lg_renew 2024-09-14T11:38:15.630 INFO:tasks.workunit.client.0.smithi138.stderr: 7f993affd640 / ms_dispatch 2024-09-14T11:38:15.630 INFO:tasks.workunit.client.0.smithi138.stderr: 7f994cff9640 / io_context_pool 2024-09-14T11:38:15.630 INFO:tasks.workunit.client.0.smithi138.stderr: 7f994effd640 / ms_dispatch 2024-09-14T11:38:15.630 INFO:tasks.workunit.client.0.smithi138.stderr: 7f9955e03640 / ms_dispatch 2024-09-14T11:38:15.630 INFO:tasks.workunit.client.0.smithi138.stderr: 7f9957606640 / io_context_pool 2024-09-14T11:38:15.630 INFO:tasks.workunit.client.0.smithi138.stderr: 7f9a68d11640 / msgr-worker-2 2024-09-14T11:38:15.630 INFO:tasks.workunit.client.0.smithi138.stderr: 7f9a69512640 / msgr-worker-1 2024-09-14T11:38:15.631 INFO:tasks.workunit.client.0.smithi138.stderr: 7f9a69d13640 / msgr-worker-0 2024-09-14T11:38:15.631 INFO:tasks.workunit.client.0.smithi138.stderr: 7f9a6a514640 / io_context_pool 2024-09-14T11:38:15.631 INFO:tasks.workunit.client.0.smithi138.stderr: 7f9a6ba0c9c0 / radosgw-admin 2024-09-14T11:38:15.631 INFO:tasks.workunit.client.0.smithi138.stderr: max_recent 500 2024-09-14T11:38:15.631 INFO:tasks.workunit.client.0.smithi138.stderr: max_new 1000 2024-09-14T11:38:15.631 INFO:tasks.workunit.client.0.smithi138.stderr: log_file /var/log/ceph/ceph-client.admin.125634.log 2024-09-14T11:38:15.631 INFO:tasks.workunit.client.0.smithi138.stderr:--- end dump of recent events --- 2024-09-14T11:38:15.631 INFO:tasks.workunit.client.0.smithi138.stderr:--- begin dump of recent events --- 2024-09-14T11:38:15.631 INFO:tasks.workunit.client.0.smithi138.stderr: -499> 2024-09-14T11:38:15.226+0000 7f9a69d13640 10 monclient: _finish_hunting 0 2024-09-14T11:38:15.631 INFO:tasks.workunit.client.0.smithi138.stderr: -498> 2024-09-14T11:38:15.226+0000 7f9a69d13640 1 monclient: found mon.noname-c 2024-09-14T11:38:15.631 INFO:tasks.workunit.client.0.smithi138.stderr: -497> 2024-09-14T11:38:15.226+0000 7f9a69d13640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.138:3301/0 2024-09-14T11:38:15.631 INFO:tasks.workunit.client.0.smithi138.stderr: -496> 2024-09-14T11:38:15.226+0000 7f9957606640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:38:15.631 INFO:tasks.workunit.client.0.smithi138.stderr: -495> 2024-09-14T11:38:15.226+0000 7f9957606640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-14T11:38:15.631 INFO:tasks.workunit.client.0.smithi138.stderr: -494> 2024-09-14T11:38:15.226+0000 7f9957606640 10 monclient: dump: 2024-09-14T11:38:15.632 INFO:tasks.workunit.client.0.smithi138.stderr:epoch 1 2024-09-14T11:38:15.632 INFO:tasks.workunit.client.0.smithi138.stderr:fsid 3f225f43-83a6-4aeb-b798-1f04bb49d597 2024-09-14T11:38:15.632 INFO:tasks.workunit.client.0.smithi138.stderr:last_changed 2024-09-14T11:07:09.252780+0000 2024-09-14T11:38:15.632 INFO:tasks.workunit.client.0.smithi138.stderr:created 2024-09-14T11:07:09.252780+0000 2024-09-14T11:38:15.632 INFO:tasks.workunit.client.0.smithi138.stderr:min_mon_release 19 (squid) 2024-09-14T11:38:15.632 INFO:tasks.workunit.client.0.smithi138.stderr:election_strategy: 1 2024-09-14T11:38:15.632 INFO:tasks.workunit.client.0.smithi138.stderr:0: [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] mon.a 2024-09-14T11:38:15.632 INFO:tasks.workunit.client.0.smithi138.stderr:1: [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] mon.b 2024-09-14T11:38:15.632 INFO:tasks.workunit.client.0.smithi138.stderr:2: [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] mon.c 2024-09-14T11:38:15.632 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-14T11:38:15.632 INFO:tasks.workunit.client.0.smithi138.stderr: -493> 2024-09-14T11:38:15.226+0000 7f9957606640 10 monclient: _finish_auth 0 2024-09-14T11:38:15.632 INFO:tasks.workunit.client.0.smithi138.stderr: -492> 2024-09-14T11:38:15.226+0000 7f9957606640 10 monclient: _check_auth_tickets 2024-09-14T11:38:15.632 INFO:tasks.workunit.client.0.smithi138.stderr: -491> 2024-09-14T11:38:15.226+0000 7f9957606640 10 monclient: handle_config config(0 keys) 2024-09-14T11:38:15.632 INFO:tasks.workunit.client.0.smithi138.stderr: -490> 2024-09-14T11:38:15.226+0000 7f9957606640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:38:15.633 INFO:tasks.workunit.client.0.smithi138.stderr: -489> 2024-09-14T11:38:15.226+0000 7f9957606640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-14T11:38:15.633 INFO:tasks.workunit.client.0.smithi138.stderr: -488> 2024-09-14T11:38:15.226+0000 7f9957606640 10 monclient: dump: 2024-09-14T11:38:15.633 INFO:tasks.workunit.client.0.smithi138.stderr:epoch 1 2024-09-14T11:38:15.633 INFO:tasks.workunit.client.0.smithi138.stderr:fsid 3f225f43-83a6-4aeb-b798-1f04bb49d597 2024-09-14T11:38:15.633 INFO:tasks.workunit.client.0.smithi138.stderr:last_changed 2024-09-14T11:07:09.252780+0000 2024-09-14T11:38:15.633 INFO:tasks.workunit.client.0.smithi138.stderr:created 2024-09-14T11:07:09.252780+0000 2024-09-14T11:38:15.633 INFO:tasks.workunit.client.0.smithi138.stderr:min_mon_release 19 (squid) 2024-09-14T11:38:15.633 INFO:tasks.workunit.client.0.smithi138.stderr:election_strategy: 1 2024-09-14T11:38:15.633 INFO:tasks.workunit.client.0.smithi138.stderr:0: [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] mon.a 2024-09-14T11:38:15.633 INFO:tasks.workunit.client.0.smithi138.stderr:1: [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] mon.b 2024-09-14T11:38:15.633 INFO:tasks.workunit.client.0.smithi138.stderr:2: [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] mon.c 2024-09-14T11:38:15.633 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-14T11:38:15.633 INFO:tasks.workunit.client.0.smithi138.stderr: -487> 2024-09-14T11:38:15.226+0000 7f9a6ba0c9c0 5 monclient: authenticate success, global_id 7139 2024-09-14T11:38:15.633 INFO:tasks.workunit.client.0.smithi138.stderr: -486> 2024-09-14T11:38:15.226+0000 7f9a6ba0c9c0 10 monclient: get_monmap_and_config success 2024-09-14T11:38:15.634 INFO:tasks.workunit.client.0.smithi138.stderr: -485> 2024-09-14T11:38:15.226+0000 7f9a6ba0c9c0 4 set_mon_vals no callback set 2024-09-14T11:38:15.634 INFO:tasks.workunit.client.0.smithi138.stderr: -484> 2024-09-14T11:38:15.226+0000 7f9a6ba0c9c0 10 monclient: shutdown 2024-09-14T11:38:15.634 INFO:tasks.workunit.client.0.smithi138.stderr: -483> 2024-09-14T11:38:15.226+0000 7f9a6ba0c9c0 5 asok(0x55a38a3fed90) unregister_commands rotate-key 2024-09-14T11:38:15.634 INFO:tasks.workunit.client.0.smithi138.stderr: -482> 2024-09-14T11:38:15.226+0000 7f9a6ba0c9c0 10 monclient: build_initial_monmap 2024-09-14T11:38:15.634 INFO:tasks.workunit.client.0.smithi138.stderr: -481> 2024-09-14T11:38:15.226+0000 7f9a6ba0c9c0 1 build_initial for_mkfs: 0 2024-09-14T11:38:15.634 INFO:tasks.workunit.client.0.smithi138.stderr: -480> 2024-09-14T11:38:15.226+0000 7f9a6ba0c9c0 10 monclient: monmap: 2024-09-14T11:38:15.634 INFO:tasks.workunit.client.0.smithi138.stderr:epoch 0 2024-09-14T11:38:15.634 INFO:tasks.workunit.client.0.smithi138.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-14T11:38:15.634 INFO:tasks.workunit.client.0.smithi138.stderr:last_changed 0.000000 2024-09-14T11:38:15.634 INFO:tasks.workunit.client.0.smithi138.stderr:created 0.000000 2024-09-14T11:38:15.634 INFO:tasks.workunit.client.0.smithi138.stderr:min_mon_release 0 (unknown) 2024-09-14T11:38:15.634 INFO:tasks.workunit.client.0.smithi138.stderr:election_strategy: 1 2024-09-14T11:38:15.634 INFO:tasks.workunit.client.0.smithi138.stderr:0: [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] mon.noname-a 2024-09-14T11:38:15.634 INFO:tasks.workunit.client.0.smithi138.stderr:1: [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] mon.noname-b 2024-09-14T11:38:15.635 INFO:tasks.workunit.client.0.smithi138.stderr:2: [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] mon.noname-c 2024-09-14T11:38:15.635 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-14T11:38:15.635 INFO:tasks.workunit.client.0.smithi138.stderr: -479> 2024-09-14T11:38:15.226+0000 7f9a6ba0c9c0 5 AuthRegistry(0x55a38a632d10) adding auth protocol: cephx 2024-09-14T11:38:15.635 INFO:tasks.workunit.client.0.smithi138.stderr: -478> 2024-09-14T11:38:15.226+0000 7f9a6ba0c9c0 5 AuthRegistry(0x55a38a632d10) adding auth protocol: cephx 2024-09-14T11:38:15.635 INFO:tasks.workunit.client.0.smithi138.stderr: -477> 2024-09-14T11:38:15.226+0000 7f9a6ba0c9c0 5 AuthRegistry(0x55a38a632d10) adding auth protocol: cephx 2024-09-14T11:38:15.635 INFO:tasks.workunit.client.0.smithi138.stderr: -476> 2024-09-14T11:38:15.226+0000 7f9a6ba0c9c0 5 AuthRegistry(0x55a38a632d10) adding con mode: secure 2024-09-14T11:38:15.635 INFO:tasks.workunit.client.0.smithi138.stderr: -475> 2024-09-14T11:38:15.226+0000 7f9a6ba0c9c0 5 AuthRegistry(0x55a38a632d10) adding con mode: crc 2024-09-14T11:38:15.635 INFO:tasks.workunit.client.0.smithi138.stderr: -474> 2024-09-14T11:38:15.226+0000 7f9a6ba0c9c0 5 AuthRegistry(0x55a38a632d10) adding con mode: secure 2024-09-14T11:38:15.635 INFO:tasks.workunit.client.0.smithi138.stderr: -473> 2024-09-14T11:38:15.226+0000 7f9a6ba0c9c0 5 AuthRegistry(0x55a38a632d10) adding con mode: crc 2024-09-14T11:38:15.635 INFO:tasks.workunit.client.0.smithi138.stderr: -472> 2024-09-14T11:38:15.226+0000 7f9a6ba0c9c0 5 AuthRegistry(0x55a38a632d10) adding con mode: secure 2024-09-14T11:38:15.635 INFO:tasks.workunit.client.0.smithi138.stderr: -471> 2024-09-14T11:38:15.226+0000 7f9a6ba0c9c0 5 AuthRegistry(0x55a38a632d10) adding con mode: crc 2024-09-14T11:38:15.635 INFO:tasks.workunit.client.0.smithi138.stderr: -470> 2024-09-14T11:38:15.226+0000 7f9a6ba0c9c0 5 AuthRegistry(0x55a38a632d10) adding con mode: crc 2024-09-14T11:38:15.635 INFO:tasks.workunit.client.0.smithi138.stderr: -469> 2024-09-14T11:38:15.226+0000 7f9a6ba0c9c0 5 AuthRegistry(0x55a38a632d10) adding con mode: secure 2024-09-14T11:38:15.635 INFO:tasks.workunit.client.0.smithi138.stderr: -468> 2024-09-14T11:38:15.226+0000 7f9a6ba0c9c0 5 AuthRegistry(0x55a38a632d10) adding con mode: crc 2024-09-14T11:38:15.636 INFO:tasks.workunit.client.0.smithi138.stderr: -467> 2024-09-14T11:38:15.226+0000 7f9a6ba0c9c0 5 AuthRegistry(0x55a38a632d10) adding con mode: secure 2024-09-14T11:38:15.636 INFO:tasks.workunit.client.0.smithi138.stderr: -466> 2024-09-14T11:38:15.226+0000 7f9a6ba0c9c0 5 AuthRegistry(0x55a38a632d10) adding con mode: crc 2024-09-14T11:38:15.636 INFO:tasks.workunit.client.0.smithi138.stderr: -465> 2024-09-14T11:38:15.226+0000 7f9a6ba0c9c0 5 AuthRegistry(0x55a38a632d10) adding con mode: secure 2024-09-14T11:38:15.636 INFO:tasks.workunit.client.0.smithi138.stderr: -464> 2024-09-14T11:38:15.226+0000 7f9a6ba0c9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:38:15.636 INFO:tasks.workunit.client.0.smithi138.stderr: -463> 2024-09-14T11:38:15.226+0000 7f9a6ba0c9c0 1 librados: starting msgr at 2024-09-14T11:38:15.636 INFO:tasks.workunit.client.0.smithi138.stderr: -462> 2024-09-14T11:38:15.226+0000 7f9a6ba0c9c0 1 librados: starting objecter 2024-09-14T11:38:15.636 INFO:tasks.workunit.client.0.smithi138.stderr: -461> 2024-09-14T11:38:15.226+0000 7f9a6ba0c9c0 5 asok(0x55a38a3fed90) register_command objecter_requests hook 0x55a38a639290 2024-09-14T11:38:15.636 INFO:tasks.workunit.client.0.smithi138.stderr: -460> 2024-09-14T11:38:15.226+0000 7f9a6ba0c9c0 1 librados: setting wanted keys 2024-09-14T11:38:15.636 INFO:tasks.workunit.client.0.smithi138.stderr: -459> 2024-09-14T11:38:15.226+0000 7f9a6ba0c9c0 1 librados: calling monclient init 2024-09-14T11:38:15.636 INFO:tasks.workunit.client.0.smithi138.stderr: -458> 2024-09-14T11:38:15.226+0000 7f9a6ba0c9c0 10 monclient: init 2024-09-14T11:38:15.636 INFO:tasks.workunit.client.0.smithi138.stderr: -457> 2024-09-14T11:38:15.226+0000 7f9a6ba0c9c0 5 AuthRegistry(0x55a38a608ab0) adding auth protocol: cephx 2024-09-14T11:38:15.636 INFO:tasks.workunit.client.0.smithi138.stderr: -456> 2024-09-14T11:38:15.226+0000 7f9a6ba0c9c0 5 AuthRegistry(0x55a38a608ab0) adding auth protocol: cephx 2024-09-14T11:38:15.636 INFO:tasks.workunit.client.0.smithi138.stderr: -455> 2024-09-14T11:38:15.226+0000 7f9a6ba0c9c0 5 AuthRegistry(0x55a38a608ab0) adding auth protocol: cephx 2024-09-14T11:38:15.636 INFO:tasks.workunit.client.0.smithi138.stderr: -454> 2024-09-14T11:38:15.226+0000 7f9a6ba0c9c0 5 AuthRegistry(0x55a38a608ab0) adding con mode: secure 2024-09-14T11:38:15.636 INFO:tasks.workunit.client.0.smithi138.stderr: -453> 2024-09-14T11:38:15.226+0000 7f9a6ba0c9c0 5 AuthRegistry(0x55a38a608ab0) adding con mode: crc 2024-09-14T11:38:15.637 INFO:tasks.workunit.client.0.smithi138.stderr: -452> 2024-09-14T11:38:15.226+0000 7f9a6ba0c9c0 5 AuthRegistry(0x55a38a608ab0) adding con mode: secure 2024-09-14T11:38:15.637 INFO:tasks.workunit.client.0.smithi138.stderr: -451> 2024-09-14T11:38:15.226+0000 7f9a6ba0c9c0 5 AuthRegistry(0x55a38a608ab0) adding con mode: crc 2024-09-14T11:38:15.637 INFO:tasks.workunit.client.0.smithi138.stderr: -450> 2024-09-14T11:38:15.226+0000 7f9a6ba0c9c0 5 AuthRegistry(0x55a38a608ab0) adding con mode: secure 2024-09-14T11:38:15.637 INFO:tasks.workunit.client.0.smithi138.stderr: -449> 2024-09-14T11:38:15.226+0000 7f9a6ba0c9c0 5 AuthRegistry(0x55a38a608ab0) adding con mode: crc 2024-09-14T11:38:15.637 INFO:tasks.workunit.client.0.smithi138.stderr: -448> 2024-09-14T11:38:15.226+0000 7f9a6ba0c9c0 5 AuthRegistry(0x55a38a608ab0) adding con mode: crc 2024-09-14T11:38:15.637 INFO:tasks.workunit.client.0.smithi138.stderr: -447> 2024-09-14T11:38:15.226+0000 7f9a6ba0c9c0 5 AuthRegistry(0x55a38a608ab0) adding con mode: secure 2024-09-14T11:38:15.637 INFO:tasks.workunit.client.0.smithi138.stderr: -446> 2024-09-14T11:38:15.226+0000 7f9a6ba0c9c0 5 AuthRegistry(0x55a38a608ab0) adding con mode: crc 2024-09-14T11:38:15.637 INFO:tasks.workunit.client.0.smithi138.stderr: -445> 2024-09-14T11:38:15.226+0000 7f9a6ba0c9c0 5 AuthRegistry(0x55a38a608ab0) adding con mode: secure 2024-09-14T11:38:15.637 INFO:tasks.workunit.client.0.smithi138.stderr: -444> 2024-09-14T11:38:15.226+0000 7f9a6ba0c9c0 5 AuthRegistry(0x55a38a608ab0) adding con mode: crc 2024-09-14T11:38:15.637 INFO:tasks.workunit.client.0.smithi138.stderr: -443> 2024-09-14T11:38:15.226+0000 7f9a6ba0c9c0 5 AuthRegistry(0x55a38a608ab0) adding con mode: secure 2024-09-14T11:38:15.637 INFO:tasks.workunit.client.0.smithi138.stderr: -442> 2024-09-14T11:38:15.226+0000 7f9a6ba0c9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:38:15.637 INFO:tasks.workunit.client.0.smithi138.stderr: -441> 2024-09-14T11:38:15.226+0000 7f9a6ba0c9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:38:15.637 INFO:tasks.workunit.client.0.smithi138.stderr: -440> 2024-09-14T11:38:15.226+0000 7f9a6ba0c9c0 5 asok(0x55a38a3fed90) register_command rotate-key hook 0x55a38a608bf8 2024-09-14T11:38:15.637 INFO:tasks.workunit.client.0.smithi138.stderr: -439> 2024-09-14T11:38:15.226+0000 7f9a6ba0c9c0 10 monclient: _reopen_session rank -1 2024-09-14T11:38:15.637 INFO:tasks.workunit.client.0.smithi138.stderr: -438> 2024-09-14T11:38:15.226+0000 7f9a6ba0c9c0 10 monclient: _add_conns ranks=[0,1,2] 2024-09-14T11:38:15.638 INFO:tasks.workunit.client.0.smithi138.stderr: -437> 2024-09-14T11:38:15.226+0000 7f9a6ba0c9c0 10 monclient(hunting): picked mon.noname-a con 0x55a38a4b8a00 addr [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] 2024-09-14T11:38:15.638 INFO:tasks.workunit.client.0.smithi138.stderr: -436> 2024-09-14T11:38:15.226+0000 7f9a6ba0c9c0 10 monclient(hunting): picked mon.noname-b con 0x55a38a4c1270 addr [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] 2024-09-14T11:38:15.638 INFO:tasks.workunit.client.0.smithi138.stderr: -435> 2024-09-14T11:38:15.226+0000 7f9a6ba0c9c0 10 monclient(hunting): picked mon.noname-c con 0x55a38a551c70 addr [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] 2024-09-14T11:38:15.638 INFO:tasks.workunit.client.0.smithi138.stderr: -434> 2024-09-14T11:38:15.226+0000 7f9a6ba0c9c0 10 monclient(hunting): start opening mon connection 2024-09-14T11:38:15.638 INFO:tasks.workunit.client.0.smithi138.stderr: -433> 2024-09-14T11:38:15.226+0000 7f9a6ba0c9c0 10 monclient(hunting): start opening mon connection 2024-09-14T11:38:15.638 INFO:tasks.workunit.client.0.smithi138.stderr: -432> 2024-09-14T11:38:15.226+0000 7f9a6ba0c9c0 10 monclient(hunting): start opening mon connection 2024-09-14T11:38:15.638 INFO:tasks.workunit.client.0.smithi138.stderr: -431> 2024-09-14T11:38:15.226+0000 7f9a6ba0c9c0 10 monclient(hunting): _renew_subs 2024-09-14T11:38:15.638 INFO:tasks.workunit.client.0.smithi138.stderr: -430> 2024-09-14T11:38:15.226+0000 7f9a6ba0c9c0 10 monclient(hunting): authenticate will time out at 2831.191581s 2024-09-14T11:38:15.638 INFO:tasks.workunit.client.0.smithi138.stderr: -429> 2024-09-14T11:38:15.226+0000 7f9a69512640 10 monclient(hunting): get_auth_request con 0x55a38a4b8a00 auth_method 0 2024-09-14T11:38:15.638 INFO:tasks.workunit.client.0.smithi138.stderr: -428> 2024-09-14T11:38:15.226+0000 7f9a69512640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:38:15.638 INFO:tasks.workunit.client.0.smithi138.stderr: -427> 2024-09-14T11:38:15.226+0000 7f9a69512640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:38:15.638 INFO:tasks.workunit.client.0.smithi138.stderr: -426> 2024-09-14T11:38:15.226+0000 7f9a69512640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:38:15.638 INFO:tasks.workunit.client.0.smithi138.stderr: -425> 2024-09-14T11:38:15.226+0000 7f9a69d13640 10 monclient(hunting): get_auth_request con 0x55a38a551c70 auth_method 0 2024-09-14T11:38:15.638 INFO:tasks.workunit.client.0.smithi138.stderr: -424> 2024-09-14T11:38:15.226+0000 7f9a69d13640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:38:15.638 INFO:tasks.workunit.client.0.smithi138.stderr: -423> 2024-09-14T11:38:15.226+0000 7f9a69d13640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:38:15.639 INFO:tasks.workunit.client.0.smithi138.stderr: -422> 2024-09-14T11:38:15.226+0000 7f9a69d13640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:38:15.639 INFO:tasks.workunit.client.0.smithi138.stderr: -421> 2024-09-14T11:38:15.226+0000 7f9a69512640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:38:15.639 INFO:tasks.workunit.client.0.smithi138.stderr: -420> 2024-09-14T11:38:15.226+0000 7f9a69512640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:38:15.639 INFO:tasks.workunit.client.0.smithi138.stderr: -419> 2024-09-14T11:38:15.226+0000 7f9a69512640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:38:15.639 INFO:tasks.workunit.client.0.smithi138.stderr: -418> 2024-09-14T11:38:15.226+0000 7f9a69d13640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:38:15.639 INFO:tasks.workunit.client.0.smithi138.stderr: -417> 2024-09-14T11:38:15.226+0000 7f9a69d13640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:38:15.639 INFO:tasks.workunit.client.0.smithi138.stderr: -416> 2024-09-14T11:38:15.226+0000 7f9a69d13640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:38:15.639 INFO:tasks.workunit.client.0.smithi138.stderr: -415> 2024-09-14T11:38:15.226+0000 7f9a69512640 10 monclient(hunting): handle_auth_done global_id 7626 payload 824 2024-09-14T11:38:15.639 INFO:tasks.workunit.client.0.smithi138.stderr: -414> 2024-09-14T11:38:15.230+0000 7f9a69512640 10 monclient: _finish_hunting 0 2024-09-14T11:38:15.639 INFO:tasks.workunit.client.0.smithi138.stderr: -413> 2024-09-14T11:38:15.230+0000 7f9a69512640 1 monclient: found mon.noname-a 2024-09-14T11:38:15.639 INFO:tasks.workunit.client.0.smithi138.stderr: -412> 2024-09-14T11:38:15.230+0000 7f9a69512640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.138:3300/0 2024-09-14T11:38:15.639 INFO:tasks.workunit.client.0.smithi138.stderr: -411> 2024-09-14T11:38:15.230+0000 7f9955e03640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:38:15.639 INFO:tasks.workunit.client.0.smithi138.stderr: -410> 2024-09-14T11:38:15.230+0000 7f9955e03640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-14T11:38:15.639 INFO:tasks.workunit.client.0.smithi138.stderr: -409> 2024-09-14T11:38:15.230+0000 7f9955e03640 10 monclient: dump: 2024-09-14T11:38:15.640 INFO:tasks.workunit.client.0.smithi138.stderr:epoch 1 2024-09-14T11:38:15.640 INFO:tasks.workunit.client.0.smithi138.stderr:fsid 3f225f43-83a6-4aeb-b798-1f04bb49d597 2024-09-14T11:38:15.640 INFO:tasks.workunit.client.0.smithi138.stderr:last_changed 2024-09-14T11:07:09.252780+0000 2024-09-14T11:38:15.640 INFO:tasks.workunit.client.0.smithi138.stderr:created 2024-09-14T11:07:09.252780+0000 2024-09-14T11:38:15.640 INFO:tasks.workunit.client.0.smithi138.stderr:min_mon_release 19 (squid) 2024-09-14T11:38:15.640 INFO:tasks.workunit.client.0.smithi138.stderr:election_strategy: 1 2024-09-14T11:38:15.640 INFO:tasks.workunit.client.0.smithi138.stderr:0: [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] mon.a 2024-09-14T11:38:15.640 INFO:tasks.workunit.client.0.smithi138.stderr:1: [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] mon.b 2024-09-14T11:38:15.640 INFO:tasks.workunit.client.0.smithi138.stderr:2: [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] mon.c 2024-09-14T11:38:15.640 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-14T11:38:15.640 INFO:tasks.workunit.client.0.smithi138.stderr: -408> 2024-09-14T11:38:15.230+0000 7f9955e03640 10 monclient: _finish_auth 0 2024-09-14T11:38:15.640 INFO:tasks.workunit.client.0.smithi138.stderr: -407> 2024-09-14T11:38:15.230+0000 7f9955e03640 10 monclient: _check_auth_tickets 2024-09-14T11:38:15.640 INFO:tasks.workunit.client.0.smithi138.stderr: -406> 2024-09-14T11:38:15.230+0000 7f9955e03640 10 monclient: handle_config config(0 keys) 2024-09-14T11:38:15.641 INFO:tasks.workunit.client.0.smithi138.stderr: -405> 2024-09-14T11:38:15.230+0000 7f9955e03640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:38:15.641 INFO:tasks.workunit.client.0.smithi138.stderr: -404> 2024-09-14T11:38:15.230+0000 7f9955e03640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-14T11:38:15.641 INFO:tasks.workunit.client.0.smithi138.stderr: -403> 2024-09-14T11:38:15.230+0000 7f9955e03640 10 monclient: dump: 2024-09-14T11:38:15.641 INFO:tasks.workunit.client.0.smithi138.stderr:epoch 1 2024-09-14T11:38:15.641 INFO:tasks.workunit.client.0.smithi138.stderr:fsid 3f225f43-83a6-4aeb-b798-1f04bb49d597 2024-09-14T11:38:15.641 INFO:tasks.workunit.client.0.smithi138.stderr:last_changed 2024-09-14T11:07:09.252780+0000 2024-09-14T11:38:15.641 INFO:tasks.workunit.client.0.smithi138.stderr:created 2024-09-14T11:07:09.252780+0000 2024-09-14T11:38:15.641 INFO:tasks.workunit.client.0.smithi138.stderr:min_mon_release 19 (squid) 2024-09-14T11:38:15.641 INFO:tasks.workunit.client.0.smithi138.stderr:election_strategy: 1 2024-09-14T11:38:15.641 INFO:tasks.workunit.client.0.smithi138.stderr:0: [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] mon.a 2024-09-14T11:38:15.641 INFO:tasks.workunit.client.0.smithi138.stderr:1: [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] mon.b 2024-09-14T11:38:15.641 INFO:tasks.workunit.client.0.smithi138.stderr:2: [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] mon.c 2024-09-14T11:38:15.641 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-14T11:38:15.641 INFO:tasks.workunit.client.0.smithi138.stderr: -402> 2024-09-14T11:38:15.230+0000 7f9a6ba0c9c0 5 monclient: authenticate success, global_id 7626 2024-09-14T11:38:15.641 INFO:tasks.workunit.client.0.smithi138.stderr: -401> 2024-09-14T11:38:15.230+0000 7f9957606640 4 set_mon_vals no callback set 2024-09-14T11:38:15.642 INFO:tasks.workunit.client.0.smithi138.stderr: -400> 2024-09-14T11:38:15.230+0000 7f9a6ba0c9c0 10 monclient: _renew_subs 2024-09-14T11:38:15.642 INFO:tasks.workunit.client.0.smithi138.stderr: -399> 2024-09-14T11:38:15.230+0000 7f9a6ba0c9c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.138:3300/0 2024-09-14T11:38:15.642 INFO:tasks.workunit.client.0.smithi138.stderr: -398> 2024-09-14T11:38:15.230+0000 7f9a6ba0c9c0 10 monclient: _renew_subs 2024-09-14T11:38:15.642 INFO:tasks.workunit.client.0.smithi138.stderr: -397> 2024-09-14T11:38:15.230+0000 7f9a6ba0c9c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.138:3300/0 2024-09-14T11:38:15.642 INFO:tasks.workunit.client.0.smithi138.stderr: -396> 2024-09-14T11:38:15.230+0000 7f9a6ba0c9c0 1 librados: init done 2024-09-14T11:38:15.642 INFO:tasks.workunit.client.0.smithi138.stderr: -395> 2024-09-14T11:38:15.230+0000 7f9955e03640 4 mgrc handle_mgr_map Got map version 5 2024-09-14T11:38:15.642 INFO:tasks.workunit.client.0.smithi138.stderr: -394> 2024-09-14T11:38:15.230+0000 7f9955e03640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.138:6832/3778043143,v1:172.21.15.138:6833/3778043143] 2024-09-14T11:38:15.642 INFO:tasks.workunit.client.0.smithi138.stderr: -393> 2024-09-14T11:38:15.230+0000 7f9955e03640 4 mgrc reconnect Starting new session with [v2:172.21.15.138:6832/3778043143,v1:172.21.15.138:6833/3778043143] 2024-09-14T11:38:15.642 INFO:tasks.workunit.client.0.smithi138.stderr: -392> 2024-09-14T11:38:15.230+0000 7f9a68d11640 10 monclient: get_auth_request con 0x7f99500718d0 auth_method 0 2024-09-14T11:38:15.642 INFO:tasks.workunit.client.0.smithi138.stderr: -391> 2024-09-14T11:38:15.230+0000 7f9a69d13640 10 monclient: get_auth_request con 0x55a38a651a30 auth_method 0 2024-09-14T11:38:15.642 INFO:tasks.workunit.client.0.smithi138.stderr: -390> 2024-09-14T11:38:15.234+0000 7f9a69512640 10 monclient: get_auth_request con 0x55a38a654c10 auth_method 0 2024-09-14T11:38:15.642 INFO:tasks.workunit.client.0.smithi138.stderr: -389> 2024-09-14T11:38:15.234+0000 7f9a68d11640 10 monclient: get_auth_request con 0x55a38a658e00 auth_method 0 2024-09-14T11:38:15.642 INFO:tasks.workunit.client.0.smithi138.stderr: -388> 2024-09-14T11:38:15.234+0000 7f9a69d13640 10 monclient: get_auth_request con 0x55a38a6584a0 auth_method 0 2024-09-14T11:38:15.642 INFO:tasks.workunit.client.0.smithi138.stderr: -387> 2024-09-14T11:38:15.238+0000 7f9a6ba0c9c0 10 monclient: build_initial_monmap 2024-09-14T11:38:15.643 INFO:tasks.workunit.client.0.smithi138.stderr: -386> 2024-09-14T11:38:15.238+0000 7f9a6ba0c9c0 1 build_initial for_mkfs: 0 2024-09-14T11:38:15.643 INFO:tasks.workunit.client.0.smithi138.stderr: -385> 2024-09-14T11:38:15.238+0000 7f9a6ba0c9c0 10 monclient: monmap: 2024-09-14T11:38:15.643 INFO:tasks.workunit.client.0.smithi138.stderr:epoch 0 2024-09-14T11:38:15.643 INFO:tasks.workunit.client.0.smithi138.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-14T11:38:15.643 INFO:tasks.workunit.client.0.smithi138.stderr:last_changed 0.000000 2024-09-14T11:38:15.643 INFO:tasks.workunit.client.0.smithi138.stderr:created 0.000000 2024-09-14T11:38:15.643 INFO:tasks.workunit.client.0.smithi138.stderr:min_mon_release 0 (unknown) 2024-09-14T11:38:15.643 INFO:tasks.workunit.client.0.smithi138.stderr:election_strategy: 1 2024-09-14T11:38:15.643 INFO:tasks.workunit.client.0.smithi138.stderr:0: [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] mon.noname-a 2024-09-14T11:38:15.643 INFO:tasks.workunit.client.0.smithi138.stderr:1: [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] mon.noname-b 2024-09-14T11:38:15.643 INFO:tasks.workunit.client.0.smithi138.stderr:2: [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] mon.noname-c 2024-09-14T11:38:15.643 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-14T11:38:15.643 INFO:tasks.workunit.client.0.smithi138.stderr: -384> 2024-09-14T11:38:15.238+0000 7f9a6ba0c9c0 5 AuthRegistry(0x55a38a660d30) adding auth protocol: cephx 2024-09-14T11:38:15.643 INFO:tasks.workunit.client.0.smithi138.stderr: -383> 2024-09-14T11:38:15.238+0000 7f9a6ba0c9c0 5 AuthRegistry(0x55a38a660d30) adding auth protocol: cephx 2024-09-14T11:38:15.643 INFO:tasks.workunit.client.0.smithi138.stderr: -382> 2024-09-14T11:38:15.238+0000 7f9a6ba0c9c0 5 AuthRegistry(0x55a38a660d30) adding auth protocol: cephx 2024-09-14T11:38:15.644 INFO:tasks.workunit.client.0.smithi138.stderr: -381> 2024-09-14T11:38:15.238+0000 7f9a6ba0c9c0 5 AuthRegistry(0x55a38a660d30) adding con mode: secure 2024-09-14T11:38:15.644 INFO:tasks.workunit.client.0.smithi138.stderr: -380> 2024-09-14T11:38:15.238+0000 7f9a6ba0c9c0 5 AuthRegistry(0x55a38a660d30) adding con mode: crc 2024-09-14T11:38:15.644 INFO:tasks.workunit.client.0.smithi138.stderr: -379> 2024-09-14T11:38:15.238+0000 7f9a6ba0c9c0 5 AuthRegistry(0x55a38a660d30) adding con mode: secure 2024-09-14T11:38:15.644 INFO:tasks.workunit.client.0.smithi138.stderr: -378> 2024-09-14T11:38:15.238+0000 7f9a6ba0c9c0 5 AuthRegistry(0x55a38a660d30) adding con mode: crc 2024-09-14T11:38:15.644 INFO:tasks.workunit.client.0.smithi138.stderr: -377> 2024-09-14T11:38:15.238+0000 7f9a6ba0c9c0 5 AuthRegistry(0x55a38a660d30) adding con mode: secure 2024-09-14T11:38:15.644 INFO:tasks.workunit.client.0.smithi138.stderr: -376> 2024-09-14T11:38:15.238+0000 7f9a6ba0c9c0 5 AuthRegistry(0x55a38a660d30) adding con mode: crc 2024-09-14T11:38:15.644 INFO:tasks.workunit.client.0.smithi138.stderr: -375> 2024-09-14T11:38:15.238+0000 7f9a6ba0c9c0 5 AuthRegistry(0x55a38a660d30) adding con mode: crc 2024-09-14T11:38:15.644 INFO:tasks.workunit.client.0.smithi138.stderr: -374> 2024-09-14T11:38:15.238+0000 7f9a6ba0c9c0 5 AuthRegistry(0x55a38a660d30) adding con mode: secure 2024-09-14T11:38:15.644 INFO:tasks.workunit.client.0.smithi138.stderr: -373> 2024-09-14T11:38:15.238+0000 7f9a6ba0c9c0 5 AuthRegistry(0x55a38a660d30) adding con mode: crc 2024-09-14T11:38:15.644 INFO:tasks.workunit.client.0.smithi138.stderr: -372> 2024-09-14T11:38:15.238+0000 7f9a6ba0c9c0 5 AuthRegistry(0x55a38a660d30) adding con mode: secure 2024-09-14T11:38:15.644 INFO:tasks.workunit.client.0.smithi138.stderr: -371> 2024-09-14T11:38:15.238+0000 7f9a6ba0c9c0 5 AuthRegistry(0x55a38a660d30) adding con mode: crc 2024-09-14T11:38:15.644 INFO:tasks.workunit.client.0.smithi138.stderr: -370> 2024-09-14T11:38:15.238+0000 7f9a6ba0c9c0 5 AuthRegistry(0x55a38a660d30) adding con mode: secure 2024-09-14T11:38:15.644 INFO:tasks.workunit.client.0.smithi138.stderr: -369> 2024-09-14T11:38:15.238+0000 7f9a6ba0c9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:38:15.644 INFO:tasks.workunit.client.0.smithi138.stderr: -368> 2024-09-14T11:38:15.238+0000 7f9a6ba0c9c0 5 asok(0x55a38a3fed90) register_command objecter_requests cmddesc objecter_requests hook 0x55a38a664690 EEXIST 2024-09-14T11:38:15.645 INFO:tasks.workunit.client.0.smithi138.stderr: -367> 2024-09-14T11:38:15.238+0000 7f9a6ba0c9c0 10 monclient: init 2024-09-14T11:38:15.645 INFO:tasks.workunit.client.0.smithi138.stderr: -366> 2024-09-14T11:38:15.238+0000 7f9a6ba0c9c0 5 AuthRegistry(0x55a38a65fc28) adding auth protocol: cephx 2024-09-14T11:38:15.645 INFO:tasks.workunit.client.0.smithi138.stderr: -365> 2024-09-14T11:38:15.238+0000 7f9a6ba0c9c0 5 AuthRegistry(0x55a38a65fc28) adding auth protocol: cephx 2024-09-14T11:38:15.645 INFO:tasks.workunit.client.0.smithi138.stderr: -364> 2024-09-14T11:38:15.238+0000 7f9a6ba0c9c0 5 AuthRegistry(0x55a38a65fc28) adding auth protocol: cephx 2024-09-14T11:38:15.645 INFO:tasks.workunit.client.0.smithi138.stderr: -363> 2024-09-14T11:38:15.238+0000 7f9a6ba0c9c0 5 AuthRegistry(0x55a38a65fc28) adding con mode: secure 2024-09-14T11:38:15.645 INFO:tasks.workunit.client.0.smithi138.stderr: -362> 2024-09-14T11:38:15.238+0000 7f9a6ba0c9c0 5 AuthRegistry(0x55a38a65fc28) adding con mode: crc 2024-09-14T11:38:15.645 INFO:tasks.workunit.client.0.smithi138.stderr: -361> 2024-09-14T11:38:15.238+0000 7f9a6ba0c9c0 5 AuthRegistry(0x55a38a65fc28) adding con mode: secure 2024-09-14T11:38:15.645 INFO:tasks.workunit.client.0.smithi138.stderr: -360> 2024-09-14T11:38:15.238+0000 7f9a6ba0c9c0 5 AuthRegistry(0x55a38a65fc28) adding con mode: crc 2024-09-14T11:38:15.645 INFO:tasks.workunit.client.0.smithi138.stderr: -359> 2024-09-14T11:38:15.238+0000 7f9a6ba0c9c0 5 AuthRegistry(0x55a38a65fc28) adding con mode: secure 2024-09-14T11:38:15.645 INFO:tasks.workunit.client.0.smithi138.stderr: -358> 2024-09-14T11:38:15.238+0000 7f9a6ba0c9c0 5 AuthRegistry(0x55a38a65fc28) adding con mode: crc 2024-09-14T11:38:15.645 INFO:tasks.workunit.client.0.smithi138.stderr: -357> 2024-09-14T11:38:15.238+0000 7f9a6ba0c9c0 5 AuthRegistry(0x55a38a65fc28) adding con mode: crc 2024-09-14T11:38:15.645 INFO:tasks.workunit.client.0.smithi138.stderr: -356> 2024-09-14T11:38:15.238+0000 7f9a6ba0c9c0 5 AuthRegistry(0x55a38a65fc28) adding con mode: secure 2024-09-14T11:38:15.645 INFO:tasks.workunit.client.0.smithi138.stderr: -355> 2024-09-14T11:38:15.238+0000 7f9a6ba0c9c0 5 AuthRegistry(0x55a38a65fc28) adding con mode: crc 2024-09-14T11:38:15.645 INFO:tasks.workunit.client.0.smithi138.stderr: -354> 2024-09-14T11:38:15.238+0000 7f9a6ba0c9c0 5 AuthRegistry(0x55a38a65fc28) adding con mode: secure 2024-09-14T11:38:15.646 INFO:tasks.workunit.client.0.smithi138.stderr: -353> 2024-09-14T11:38:15.238+0000 7f9a6ba0c9c0 5 AuthRegistry(0x55a38a65fc28) adding con mode: crc 2024-09-14T11:38:15.646 INFO:tasks.workunit.client.0.smithi138.stderr: -352> 2024-09-14T11:38:15.238+0000 7f9a6ba0c9c0 5 AuthRegistry(0x55a38a65fc28) adding con mode: secure 2024-09-14T11:38:15.646 INFO:tasks.workunit.client.0.smithi138.stderr: -351> 2024-09-14T11:38:15.238+0000 7f9a6ba0c9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:38:15.646 INFO:tasks.workunit.client.0.smithi138.stderr: -350> 2024-09-14T11:38:15.238+0000 7f9a6ba0c9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:38:15.646 INFO:tasks.workunit.client.0.smithi138.stderr: -349> 2024-09-14T11:38:15.238+0000 7f9a6ba0c9c0 5 asok(0x55a38a3fed90) register_command rotate-key cmddesc rotate-key hook 0x55a38a65fd70 EEXIST 2024-09-14T11:38:15.646 INFO:tasks.workunit.client.0.smithi138.stderr: -348> 2024-09-14T11:38:15.238+0000 7f9a6ba0c9c0 10 monclient: _reopen_session rank -1 2024-09-14T11:38:15.646 INFO:tasks.workunit.client.0.smithi138.stderr: -347> 2024-09-14T11:38:15.238+0000 7f9a6ba0c9c0 10 monclient: _add_conns ranks=[0,2,1] 2024-09-14T11:38:15.646 INFO:tasks.workunit.client.0.smithi138.stderr: -346> 2024-09-14T11:38:15.238+0000 7f9a6ba0c9c0 10 monclient(hunting): picked mon.noname-a con 0x55a38a688840 addr [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] 2024-09-14T11:38:15.646 INFO:tasks.workunit.client.0.smithi138.stderr: -345> 2024-09-14T11:38:15.238+0000 7f9a6ba0c9c0 10 monclient(hunting): picked mon.noname-c con 0x55a38a688170 addr [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] 2024-09-14T11:38:15.646 INFO:tasks.workunit.client.0.smithi138.stderr: -344> 2024-09-14T11:38:15.238+0000 7f9a6ba0c9c0 10 monclient(hunting): picked mon.noname-b con 0x55a38a686b50 addr [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] 2024-09-14T11:38:15.646 INFO:tasks.workunit.client.0.smithi138.stderr: -343> 2024-09-14T11:38:15.238+0000 7f9a6ba0c9c0 10 monclient(hunting): start opening mon connection 2024-09-14T11:38:15.646 INFO:tasks.workunit.client.0.smithi138.stderr: -342> 2024-09-14T11:38:15.238+0000 7f9a6ba0c9c0 10 monclient(hunting): start opening mon connection 2024-09-14T11:38:15.646 INFO:tasks.workunit.client.0.smithi138.stderr: -341> 2024-09-14T11:38:15.238+0000 7f9a6ba0c9c0 10 monclient(hunting): start opening mon connection 2024-09-14T11:38:15.646 INFO:tasks.workunit.client.0.smithi138.stderr: -340> 2024-09-14T11:38:15.238+0000 7f9a6ba0c9c0 10 monclient(hunting): _renew_subs 2024-09-14T11:38:15.647 INFO:tasks.workunit.client.0.smithi138.stderr: -339> 2024-09-14T11:38:15.238+0000 7f9a6ba0c9c0 10 monclient(hunting): authenticate will time out at 2831.201806s 2024-09-14T11:38:15.647 INFO:tasks.workunit.client.0.smithi138.stderr: -338> 2024-09-14T11:38:15.238+0000 7f9a68d11640 10 monclient(hunting): get_auth_request con 0x55a38a688840 auth_method 0 2024-09-14T11:38:15.647 INFO:tasks.workunit.client.0.smithi138.stderr: -337> 2024-09-14T11:38:15.238+0000 7f9a68d11640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:38:15.647 INFO:tasks.workunit.client.0.smithi138.stderr: -336> 2024-09-14T11:38:15.238+0000 7f9a68d11640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:38:15.647 INFO:tasks.workunit.client.0.smithi138.stderr: -335> 2024-09-14T11:38:15.238+0000 7f9a68d11640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:38:15.647 INFO:tasks.workunit.client.0.smithi138.stderr: -334> 2024-09-14T11:38:15.238+0000 7f9a69d13640 10 monclient(hunting): get_auth_request con 0x55a38a688170 auth_method 0 2024-09-14T11:38:15.647 INFO:tasks.workunit.client.0.smithi138.stderr: -333> 2024-09-14T11:38:15.238+0000 7f9a69d13640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:38:15.647 INFO:tasks.workunit.client.0.smithi138.stderr: -332> 2024-09-14T11:38:15.238+0000 7f9a69d13640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:38:15.647 INFO:tasks.workunit.client.0.smithi138.stderr: -331> 2024-09-14T11:38:15.238+0000 7f9a69d13640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:38:15.647 INFO:tasks.workunit.client.0.smithi138.stderr: -330> 2024-09-14T11:38:15.238+0000 7f9a69d13640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:38:15.647 INFO:tasks.workunit.client.0.smithi138.stderr: -329> 2024-09-14T11:38:15.238+0000 7f9a69d13640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:38:15.647 INFO:tasks.workunit.client.0.smithi138.stderr: -328> 2024-09-14T11:38:15.238+0000 7f9a69d13640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:38:15.647 INFO:tasks.workunit.client.0.smithi138.stderr: -327> 2024-09-14T11:38:15.238+0000 7f9a68d11640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:38:15.648 INFO:tasks.workunit.client.0.smithi138.stderr: -326> 2024-09-14T11:38:15.238+0000 7f9a68d11640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:38:15.648 INFO:tasks.workunit.client.0.smithi138.stderr: -325> 2024-09-14T11:38:15.238+0000 7f9a68d11640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:38:15.648 INFO:tasks.workunit.client.0.smithi138.stderr: -324> 2024-09-14T11:38:15.238+0000 7f9a69512640 10 monclient(hunting): get_auth_request con 0x55a38a686b50 auth_method 0 2024-09-14T11:38:15.648 INFO:tasks.workunit.client.0.smithi138.stderr: -323> 2024-09-14T11:38:15.238+0000 7f9a69512640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:38:15.648 INFO:tasks.workunit.client.0.smithi138.stderr: -322> 2024-09-14T11:38:15.238+0000 7f9a69512640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:38:15.648 INFO:tasks.workunit.client.0.smithi138.stderr: -321> 2024-09-14T11:38:15.238+0000 7f9a69512640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:38:15.648 INFO:tasks.workunit.client.0.smithi138.stderr: -320> 2024-09-14T11:38:15.238+0000 7f9a69d13640 10 monclient(hunting): handle_auth_done global_id 7145 payload 824 2024-09-14T11:38:15.648 INFO:tasks.workunit.client.0.smithi138.stderr: -319> 2024-09-14T11:38:15.238+0000 7f9a69d13640 10 monclient: _finish_hunting 0 2024-09-14T11:38:15.648 INFO:tasks.workunit.client.0.smithi138.stderr: -318> 2024-09-14T11:38:15.238+0000 7f9a69d13640 1 monclient: found mon.noname-c 2024-09-14T11:38:15.648 INFO:tasks.workunit.client.0.smithi138.stderr: -317> 2024-09-14T11:38:15.238+0000 7f9a69d13640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.138:3301/0 2024-09-14T11:38:15.648 INFO:tasks.workunit.client.0.smithi138.stderr: -316> 2024-09-14T11:38:15.238+0000 7f994effd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:38:15.648 INFO:tasks.workunit.client.0.smithi138.stderr: -315> 2024-09-14T11:38:15.238+0000 7f994effd640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-14T11:38:15.648 INFO:tasks.workunit.client.0.smithi138.stderr: -314> 2024-09-14T11:38:15.238+0000 7f994effd640 10 monclient: dump: 2024-09-14T11:38:15.648 INFO:tasks.workunit.client.0.smithi138.stderr:epoch 1 2024-09-14T11:38:15.649 INFO:tasks.workunit.client.0.smithi138.stderr:fsid 3f225f43-83a6-4aeb-b798-1f04bb49d597 2024-09-14T11:38:15.649 INFO:tasks.workunit.client.0.smithi138.stderr:last_changed 2024-09-14T11:07:09.252780+0000 2024-09-14T11:38:15.649 INFO:tasks.workunit.client.0.smithi138.stderr:created 2024-09-14T11:07:09.252780+0000 2024-09-14T11:38:15.649 INFO:tasks.workunit.client.0.smithi138.stderr:min_mon_release 19 (squid) 2024-09-14T11:38:15.649 INFO:tasks.workunit.client.0.smithi138.stderr:election_strategy: 1 2024-09-14T11:38:15.649 INFO:tasks.workunit.client.0.smithi138.stderr:0: [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] mon.a 2024-09-14T11:38:15.649 INFO:tasks.workunit.client.0.smithi138.stderr:1: [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] mon.b 2024-09-14T11:38:15.649 INFO:tasks.workunit.client.0.smithi138.stderr:2: [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] mon.c 2024-09-14T11:38:15.649 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-14T11:38:15.649 INFO:tasks.workunit.client.0.smithi138.stderr: -313> 2024-09-14T11:38:15.238+0000 7f994effd640 10 monclient: _finish_auth 0 2024-09-14T11:38:15.649 INFO:tasks.workunit.client.0.smithi138.stderr: -312> 2024-09-14T11:38:15.238+0000 7f994effd640 10 monclient: _check_auth_tickets 2024-09-14T11:38:15.649 INFO:tasks.workunit.client.0.smithi138.stderr: -311> 2024-09-14T11:38:15.238+0000 7f9a6ba0c9c0 5 monclient: authenticate success, global_id 7145 2024-09-14T11:38:15.649 INFO:tasks.workunit.client.0.smithi138.stderr: -310> 2024-09-14T11:38:15.238+0000 7f9a6ba0c9c0 10 monclient: _renew_subs 2024-09-14T11:38:15.649 INFO:tasks.workunit.client.0.smithi138.stderr: -309> 2024-09-14T11:38:15.238+0000 7f9a6ba0c9c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.138:3301/0 2024-09-14T11:38:15.650 INFO:tasks.workunit.client.0.smithi138.stderr: -308> 2024-09-14T11:38:15.238+0000 7f994effd640 10 monclient: handle_config config(0 keys) 2024-09-14T11:38:15.650 INFO:tasks.workunit.client.0.smithi138.stderr: -307> 2024-09-14T11:38:15.238+0000 7f994effd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:38:15.650 INFO:tasks.workunit.client.0.smithi138.stderr: -306> 2024-09-14T11:38:15.238+0000 7f994effd640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-14T11:38:15.650 INFO:tasks.workunit.client.0.smithi138.stderr: -305> 2024-09-14T11:38:15.238+0000 7f994effd640 10 monclient: dump: 2024-09-14T11:38:15.650 INFO:tasks.workunit.client.0.smithi138.stderr:epoch 1 2024-09-14T11:38:15.650 INFO:tasks.workunit.client.0.smithi138.stderr:fsid 3f225f43-83a6-4aeb-b798-1f04bb49d597 2024-09-14T11:38:15.650 INFO:tasks.workunit.client.0.smithi138.stderr:last_changed 2024-09-14T11:07:09.252780+0000 2024-09-14T11:38:15.650 INFO:tasks.workunit.client.0.smithi138.stderr:created 2024-09-14T11:07:09.252780+0000 2024-09-14T11:38:15.650 INFO:tasks.workunit.client.0.smithi138.stderr:min_mon_release 19 (squid) 2024-09-14T11:38:15.650 INFO:tasks.workunit.client.0.smithi138.stderr:election_strategy: 1 2024-09-14T11:38:15.650 INFO:tasks.workunit.client.0.smithi138.stderr:0: [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] mon.a 2024-09-14T11:38:15.650 INFO:tasks.workunit.client.0.smithi138.stderr:1: [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] mon.b 2024-09-14T11:38:15.650 INFO:tasks.workunit.client.0.smithi138.stderr:2: [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] mon.c 2024-09-14T11:38:15.650 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-14T11:38:15.650 INFO:tasks.workunit.client.0.smithi138.stderr: -304> 2024-09-14T11:38:15.238+0000 7f9a6a514640 4 set_mon_vals no callback set 2024-09-14T11:38:15.651 INFO:tasks.workunit.client.0.smithi138.stderr: -303> 2024-09-14T11:38:15.238+0000 7f9a6ba0c9c0 10 monclient: _renew_subs 2024-09-14T11:38:15.651 INFO:tasks.workunit.client.0.smithi138.stderr: -302> 2024-09-14T11:38:15.238+0000 7f9a6ba0c9c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.138:3301/0 2024-09-14T11:38:15.651 INFO:tasks.workunit.client.0.smithi138.stderr: -301> 2024-09-14T11:38:15.242+0000 7f994effd640 4 mgrc handle_mgr_map Got map version 5 2024-09-14T11:38:15.651 INFO:tasks.workunit.client.0.smithi138.stderr: -300> 2024-09-14T11:38:15.242+0000 7f994effd640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.138:6832/3778043143,v1:172.21.15.138:6833/3778043143] 2024-09-14T11:38:15.651 INFO:tasks.workunit.client.0.smithi138.stderr: -299> 2024-09-14T11:38:15.242+0000 7f994effd640 4 mgrc reconnect Starting new session with [v2:172.21.15.138:6832/3778043143,v1:172.21.15.138:6833/3778043143] 2024-09-14T11:38:15.651 INFO:tasks.workunit.client.0.smithi138.stderr: -298> 2024-09-14T11:38:15.242+0000 7f9a68d11640 10 monclient: get_auth_request con 0x7f99440717e0 auth_method 0 2024-09-14T11:38:15.651 INFO:tasks.workunit.client.0.smithi138.stderr: -297> 2024-09-14T11:38:15.242+0000 7f9a6ba0c9c0 10 monclient: get_monmap_and_config 2024-09-14T11:38:15.651 INFO:tasks.workunit.client.0.smithi138.stderr: -296> 2024-09-14T11:38:15.242+0000 7f9a6ba0c9c0 10 monclient: build_initial_monmap 2024-09-14T11:38:15.651 INFO:tasks.workunit.client.0.smithi138.stderr: -295> 2024-09-14T11:38:15.242+0000 7f9a6ba0c9c0 1 build_initial for_mkfs: 0 2024-09-14T11:38:15.651 INFO:tasks.workunit.client.0.smithi138.stderr: -294> 2024-09-14T11:38:15.242+0000 7f9a6ba0c9c0 10 monclient: monmap: 2024-09-14T11:38:15.651 INFO:tasks.workunit.client.0.smithi138.stderr:epoch 0 2024-09-14T11:38:15.651 INFO:tasks.workunit.client.0.smithi138.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-14T11:38:15.651 INFO:tasks.workunit.client.0.smithi138.stderr:last_changed 0.000000 2024-09-14T11:38:15.651 INFO:tasks.workunit.client.0.smithi138.stderr:created 0.000000 2024-09-14T11:38:15.651 INFO:tasks.workunit.client.0.smithi138.stderr:min_mon_release 0 (unknown) 2024-09-14T11:38:15.651 INFO:tasks.workunit.client.0.smithi138.stderr:election_strategy: 1 2024-09-14T11:38:15.652 INFO:tasks.workunit.client.0.smithi138.stderr:0: [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] mon.noname-a 2024-09-14T11:38:15.652 INFO:tasks.workunit.client.0.smithi138.stderr:1: [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] mon.noname-b 2024-09-14T11:38:15.652 INFO:tasks.workunit.client.0.smithi138.stderr:2: [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] mon.noname-c 2024-09-14T11:38:15.652 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-14T11:38:15.652 INFO:tasks.workunit.client.0.smithi138.stderr: -293> 2024-09-14T11:38:15.242+0000 7f9a6ba0c9c0 5 AuthRegistry(0x55a38a6a7f70) adding auth protocol: cephx 2024-09-14T11:38:15.652 INFO:tasks.workunit.client.0.smithi138.stderr: -292> 2024-09-14T11:38:15.242+0000 7f9a6ba0c9c0 5 AuthRegistry(0x55a38a6a7f70) adding auth protocol: cephx 2024-09-14T11:38:15.652 INFO:tasks.workunit.client.0.smithi138.stderr: -291> 2024-09-14T11:38:15.242+0000 7f9a6ba0c9c0 5 AuthRegistry(0x55a38a6a7f70) adding auth protocol: cephx 2024-09-14T11:38:15.652 INFO:tasks.workunit.client.0.smithi138.stderr: -290> 2024-09-14T11:38:15.242+0000 7f9a6ba0c9c0 5 AuthRegistry(0x55a38a6a7f70) adding con mode: secure 2024-09-14T11:38:15.652 INFO:tasks.workunit.client.0.smithi138.stderr: -289> 2024-09-14T11:38:15.242+0000 7f9a6ba0c9c0 5 AuthRegistry(0x55a38a6a7f70) adding con mode: crc 2024-09-14T11:38:15.652 INFO:tasks.workunit.client.0.smithi138.stderr: -288> 2024-09-14T11:38:15.242+0000 7f9a6ba0c9c0 5 AuthRegistry(0x55a38a6a7f70) adding con mode: secure 2024-09-14T11:38:15.652 INFO:tasks.workunit.client.0.smithi138.stderr: -287> 2024-09-14T11:38:15.242+0000 7f9a6ba0c9c0 5 AuthRegistry(0x55a38a6a7f70) adding con mode: crc 2024-09-14T11:38:15.652 INFO:tasks.workunit.client.0.smithi138.stderr: -286> 2024-09-14T11:38:15.242+0000 7f9a6ba0c9c0 5 AuthRegistry(0x55a38a6a7f70) adding con mode: secure 2024-09-14T11:38:15.652 INFO:tasks.workunit.client.0.smithi138.stderr: -285> 2024-09-14T11:38:15.242+0000 7f9a6ba0c9c0 5 AuthRegistry(0x55a38a6a7f70) adding con mode: crc 2024-09-14T11:38:15.652 INFO:tasks.workunit.client.0.smithi138.stderr: -284> 2024-09-14T11:38:15.242+0000 7f9a6ba0c9c0 5 AuthRegistry(0x55a38a6a7f70) adding con mode: crc 2024-09-14T11:38:15.652 INFO:tasks.workunit.client.0.smithi138.stderr: -283> 2024-09-14T11:38:15.242+0000 7f9a6ba0c9c0 5 AuthRegistry(0x55a38a6a7f70) adding con mode: secure 2024-09-14T11:38:15.653 INFO:tasks.workunit.client.0.smithi138.stderr: -282> 2024-09-14T11:38:15.242+0000 7f9a6ba0c9c0 5 AuthRegistry(0x55a38a6a7f70) adding con mode: crc 2024-09-14T11:38:15.653 INFO:tasks.workunit.client.0.smithi138.stderr: -281> 2024-09-14T11:38:15.242+0000 7f9a6ba0c9c0 5 AuthRegistry(0x55a38a6a7f70) adding con mode: secure 2024-09-14T11:38:15.653 INFO:tasks.workunit.client.0.smithi138.stderr: -280> 2024-09-14T11:38:15.242+0000 7f9a6ba0c9c0 5 AuthRegistry(0x55a38a6a7f70) adding con mode: crc 2024-09-14T11:38:15.653 INFO:tasks.workunit.client.0.smithi138.stderr: -279> 2024-09-14T11:38:15.242+0000 7f9a6ba0c9c0 5 AuthRegistry(0x55a38a6a7f70) adding con mode: secure 2024-09-14T11:38:15.653 INFO:tasks.workunit.client.0.smithi138.stderr: -278> 2024-09-14T11:38:15.242+0000 7f9a6ba0c9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:38:15.653 INFO:tasks.workunit.client.0.smithi138.stderr: -277> 2024-09-14T11:38:15.242+0000 7f9a6ba0c9c0 10 monclient: init 2024-09-14T11:38:15.653 INFO:tasks.workunit.client.0.smithi138.stderr: -276> 2024-09-14T11:38:15.242+0000 7f9a6ba0c9c0 5 AuthRegistry(0x7fff9ef3b890) adding auth protocol: cephx 2024-09-14T11:38:15.653 INFO:tasks.workunit.client.0.smithi138.stderr: -275> 2024-09-14T11:38:15.242+0000 7f9a6ba0c9c0 5 AuthRegistry(0x7fff9ef3b890) adding auth protocol: cephx 2024-09-14T11:38:15.653 INFO:tasks.workunit.client.0.smithi138.stderr: -274> 2024-09-14T11:38:15.242+0000 7f9a6ba0c9c0 5 AuthRegistry(0x7fff9ef3b890) adding auth protocol: cephx 2024-09-14T11:38:15.653 INFO:tasks.workunit.client.0.smithi138.stderr: -273> 2024-09-14T11:38:15.242+0000 7f9a6ba0c9c0 5 AuthRegistry(0x7fff9ef3b890) adding con mode: secure 2024-09-14T11:38:15.653 INFO:tasks.workunit.client.0.smithi138.stderr: -272> 2024-09-14T11:38:15.242+0000 7f9a6ba0c9c0 5 AuthRegistry(0x7fff9ef3b890) adding con mode: crc 2024-09-14T11:38:15.653 INFO:tasks.workunit.client.0.smithi138.stderr: -271> 2024-09-14T11:38:15.242+0000 7f9a6ba0c9c0 5 AuthRegistry(0x7fff9ef3b890) adding con mode: secure 2024-09-14T11:38:15.653 INFO:tasks.workunit.client.0.smithi138.stderr: -270> 2024-09-14T11:38:15.242+0000 7f9a6ba0c9c0 5 AuthRegistry(0x7fff9ef3b890) adding con mode: crc 2024-09-14T11:38:15.653 INFO:tasks.workunit.client.0.smithi138.stderr: -269> 2024-09-14T11:38:15.242+0000 7f9a6ba0c9c0 5 AuthRegistry(0x7fff9ef3b890) adding con mode: secure 2024-09-14T11:38:15.654 INFO:tasks.workunit.client.0.smithi138.stderr: -268> 2024-09-14T11:38:15.242+0000 7f9a6ba0c9c0 5 AuthRegistry(0x7fff9ef3b890) adding con mode: crc 2024-09-14T11:38:15.654 INFO:tasks.workunit.client.0.smithi138.stderr: -267> 2024-09-14T11:38:15.242+0000 7f9a6ba0c9c0 5 AuthRegistry(0x7fff9ef3b890) adding con mode: crc 2024-09-14T11:38:15.654 INFO:tasks.workunit.client.0.smithi138.stderr: -266> 2024-09-14T11:38:15.242+0000 7f9a6ba0c9c0 5 AuthRegistry(0x7fff9ef3b890) adding con mode: secure 2024-09-14T11:38:15.654 INFO:tasks.workunit.client.0.smithi138.stderr: -265> 2024-09-14T11:38:15.242+0000 7f9a6ba0c9c0 5 AuthRegistry(0x7fff9ef3b890) adding con mode: crc 2024-09-14T11:38:15.654 INFO:tasks.workunit.client.0.smithi138.stderr: -264> 2024-09-14T11:38:15.242+0000 7f9a6ba0c9c0 5 AuthRegistry(0x7fff9ef3b890) adding con mode: secure 2024-09-14T11:38:15.654 INFO:tasks.workunit.client.0.smithi138.stderr: -263> 2024-09-14T11:38:15.242+0000 7f9a6ba0c9c0 5 AuthRegistry(0x7fff9ef3b890) adding con mode: crc 2024-09-14T11:38:15.654 INFO:tasks.workunit.client.0.smithi138.stderr: -262> 2024-09-14T11:38:15.242+0000 7f9a6ba0c9c0 5 AuthRegistry(0x7fff9ef3b890) adding con mode: secure 2024-09-14T11:38:15.654 INFO:tasks.workunit.client.0.smithi138.stderr: -261> 2024-09-14T11:38:15.242+0000 7f9a6ba0c9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:38:15.654 INFO:tasks.workunit.client.0.smithi138.stderr: -260> 2024-09-14T11:38:15.242+0000 7f9a6ba0c9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:38:15.654 INFO:tasks.workunit.client.0.smithi138.stderr: -259> 2024-09-14T11:38:15.242+0000 7f9a6ba0c9c0 5 asok(0x55a38a3fed90) register_command rotate-key cmddesc rotate-key hook 0x7fff9ef3b9d8 EEXIST 2024-09-14T11:38:15.654 INFO:tasks.workunit.client.0.smithi138.stderr: -258> 2024-09-14T11:38:15.242+0000 7f9a6ba0c9c0 10 monclient: _reopen_session rank -1 2024-09-14T11:38:15.654 INFO:tasks.workunit.client.0.smithi138.stderr: -257> 2024-09-14T11:38:15.242+0000 7f9a6ba0c9c0 10 monclient: _add_conns ranks=[1,0,2] 2024-09-14T11:38:15.654 INFO:tasks.workunit.client.0.smithi138.stderr: -256> 2024-09-14T11:38:15.242+0000 7f9a6ba0c9c0 10 monclient(hunting): picked mon.noname-b con 0x55a38a6dc500 addr [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] 2024-09-14T11:38:15.654 INFO:tasks.workunit.client.0.smithi138.stderr: -255> 2024-09-14T11:38:15.242+0000 7f9a6ba0c9c0 10 monclient(hunting): picked mon.noname-a con 0x55a38a6ac280 addr [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] 2024-09-14T11:38:15.654 INFO:tasks.workunit.client.0.smithi138.stderr: -254> 2024-09-14T11:38:15.242+0000 7f9a6ba0c9c0 10 monclient(hunting): picked mon.noname-c con 0x55a38a6d7960 addr [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] 2024-09-14T11:38:15.654 INFO:tasks.workunit.client.0.smithi138.stderr: -253> 2024-09-14T11:38:15.242+0000 7f9a6ba0c9c0 10 monclient(hunting): start opening mon connection 2024-09-14T11:38:15.655 INFO:tasks.workunit.client.0.smithi138.stderr: -252> 2024-09-14T11:38:15.242+0000 7f9a6ba0c9c0 10 monclient(hunting): start opening mon connection 2024-09-14T11:38:15.655 INFO:tasks.workunit.client.0.smithi138.stderr: -251> 2024-09-14T11:38:15.242+0000 7f9a6ba0c9c0 10 monclient(hunting): start opening mon connection 2024-09-14T11:38:15.655 INFO:tasks.workunit.client.0.smithi138.stderr: -250> 2024-09-14T11:38:15.242+0000 7f9a6ba0c9c0 10 monclient(hunting): _renew_subs 2024-09-14T11:38:15.655 INFO:tasks.workunit.client.0.smithi138.stderr: -249> 2024-09-14T11:38:15.242+0000 7f9a6ba0c9c0 10 monclient(hunting): authenticate will time out at 2831.206123s 2024-09-14T11:38:15.655 INFO:tasks.workunit.client.0.smithi138.stderr: -248> 2024-09-14T11:38:15.242+0000 7f9a69d13640 10 monclient(hunting): get_auth_request con 0x55a38a6ac280 auth_method 0 2024-09-14T11:38:15.655 INFO:tasks.workunit.client.0.smithi138.stderr: -247> 2024-09-14T11:38:15.242+0000 7f9a69d13640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:38:15.655 INFO:tasks.workunit.client.0.smithi138.stderr: -246> 2024-09-14T11:38:15.242+0000 7f9a69d13640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:38:15.655 INFO:tasks.workunit.client.0.smithi138.stderr: -245> 2024-09-14T11:38:15.242+0000 7f9a69d13640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:38:15.655 INFO:tasks.workunit.client.0.smithi138.stderr: -244> 2024-09-14T11:38:15.242+0000 7f9a69512640 10 monclient(hunting): get_auth_request con 0x55a38a6d7960 auth_method 0 2024-09-14T11:38:15.655 INFO:tasks.workunit.client.0.smithi138.stderr: -243> 2024-09-14T11:38:15.242+0000 7f9a69512640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:38:15.655 INFO:tasks.workunit.client.0.smithi138.stderr: -242> 2024-09-14T11:38:15.242+0000 7f9a69512640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:38:15.655 INFO:tasks.workunit.client.0.smithi138.stderr: -241> 2024-09-14T11:38:15.242+0000 7f9a69512640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:38:15.655 INFO:tasks.workunit.client.0.smithi138.stderr: -240> 2024-09-14T11:38:15.242+0000 7f9a69d13640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:38:15.655 INFO:tasks.workunit.client.0.smithi138.stderr: -239> 2024-09-14T11:38:15.242+0000 7f9a69d13640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:38:15.655 INFO:tasks.workunit.client.0.smithi138.stderr: -238> 2024-09-14T11:38:15.242+0000 7f9a69d13640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:38:15.656 INFO:tasks.workunit.client.0.smithi138.stderr: -237> 2024-09-14T11:38:15.242+0000 7f9a69512640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:38:15.656 INFO:tasks.workunit.client.0.smithi138.stderr: -236> 2024-09-14T11:38:15.242+0000 7f9a69512640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:38:15.656 INFO:tasks.workunit.client.0.smithi138.stderr: -235> 2024-09-14T11:38:15.242+0000 7f9a69512640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:38:15.656 INFO:tasks.workunit.client.0.smithi138.stderr: -234> 2024-09-14T11:38:15.242+0000 7f9a69d13640 10 monclient(hunting): handle_auth_done global_id 7632 payload 274 2024-09-14T11:38:15.656 INFO:tasks.workunit.client.0.smithi138.stderr: -233> 2024-09-14T11:38:15.242+0000 7f9a69d13640 10 monclient: _finish_hunting 0 2024-09-14T11:38:15.656 INFO:tasks.workunit.client.0.smithi138.stderr: -232> 2024-09-14T11:38:15.242+0000 7f9a69d13640 1 monclient: found mon.noname-a 2024-09-14T11:38:15.656 INFO:tasks.workunit.client.0.smithi138.stderr: -231> 2024-09-14T11:38:15.242+0000 7f9a69d13640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.138:3300/0 2024-09-14T11:38:15.656 INFO:tasks.workunit.client.0.smithi138.stderr: -230> 2024-09-14T11:38:15.242+0000 7f994cff9640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:38:15.656 INFO:tasks.workunit.client.0.smithi138.stderr: -229> 2024-09-14T11:38:15.242+0000 7f994cff9640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-14T11:38:15.656 INFO:tasks.workunit.client.0.smithi138.stderr: -228> 2024-09-14T11:38:15.242+0000 7f994cff9640 10 monclient: dump: 2024-09-14T11:38:15.656 INFO:tasks.workunit.client.0.smithi138.stderr:epoch 1 2024-09-14T11:38:15.656 INFO:tasks.workunit.client.0.smithi138.stderr:fsid 3f225f43-83a6-4aeb-b798-1f04bb49d597 2024-09-14T11:38:15.656 INFO:tasks.workunit.client.0.smithi138.stderr:last_changed 2024-09-14T11:07:09.252780+0000 2024-09-14T11:38:15.656 INFO:tasks.workunit.client.0.smithi138.stderr:created 2024-09-14T11:07:09.252780+0000 2024-09-14T11:38:15.656 INFO:tasks.workunit.client.0.smithi138.stderr:min_mon_release 19 (squid) 2024-09-14T11:38:15.657 INFO:tasks.workunit.client.0.smithi138.stderr:election_strategy: 1 2024-09-14T11:38:15.657 INFO:tasks.workunit.client.0.smithi138.stderr:0: [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] mon.a 2024-09-14T11:38:15.657 INFO:tasks.workunit.client.0.smithi138.stderr:1: [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] mon.b 2024-09-14T11:38:15.657 INFO:tasks.workunit.client.0.smithi138.stderr:2: [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] mon.c 2024-09-14T11:38:15.657 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-14T11:38:15.657 INFO:tasks.workunit.client.0.smithi138.stderr: -227> 2024-09-14T11:38:15.242+0000 7f994cff9640 10 monclient: _finish_auth 0 2024-09-14T11:38:15.657 INFO:tasks.workunit.client.0.smithi138.stderr: -226> 2024-09-14T11:38:15.242+0000 7f994cff9640 10 monclient: _check_auth_tickets 2024-09-14T11:38:15.657 INFO:tasks.workunit.client.0.smithi138.stderr: -225> 2024-09-14T11:38:15.242+0000 7f994cff9640 10 monclient: handle_config config(0 keys) 2024-09-14T11:38:15.657 INFO:tasks.workunit.client.0.smithi138.stderr: -224> 2024-09-14T11:38:15.242+0000 7f994cff9640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:38:15.657 INFO:tasks.workunit.client.0.smithi138.stderr: -223> 2024-09-14T11:38:15.242+0000 7f994cff9640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-14T11:38:15.657 INFO:tasks.workunit.client.0.smithi138.stderr: -222> 2024-09-14T11:38:15.242+0000 7f994cff9640 10 monclient: dump: 2024-09-14T11:38:15.657 INFO:tasks.workunit.client.0.smithi138.stderr:epoch 1 2024-09-14T11:38:15.657 INFO:tasks.workunit.client.0.smithi138.stderr:fsid 3f225f43-83a6-4aeb-b798-1f04bb49d597 2024-09-14T11:38:15.657 INFO:tasks.workunit.client.0.smithi138.stderr:last_changed 2024-09-14T11:07:09.252780+0000 2024-09-14T11:38:15.658 INFO:tasks.workunit.client.0.smithi138.stderr:created 2024-09-14T11:07:09.252780+0000 2024-09-14T11:38:15.658 INFO:tasks.workunit.client.0.smithi138.stderr:min_mon_release 19 (squid) 2024-09-14T11:38:15.658 INFO:tasks.workunit.client.0.smithi138.stderr:election_strategy: 1 2024-09-14T11:38:15.658 INFO:tasks.workunit.client.0.smithi138.stderr:0: [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] mon.a 2024-09-14T11:38:15.658 INFO:tasks.workunit.client.0.smithi138.stderr:1: [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] mon.b 2024-09-14T11:38:15.658 INFO:tasks.workunit.client.0.smithi138.stderr:2: [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] mon.c 2024-09-14T11:38:15.658 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-14T11:38:15.658 INFO:tasks.workunit.client.0.smithi138.stderr: -221> 2024-09-14T11:38:15.242+0000 7f9a6ba0c9c0 5 monclient: authenticate success, global_id 7632 2024-09-14T11:38:15.658 INFO:tasks.workunit.client.0.smithi138.stderr: -220> 2024-09-14T11:38:15.242+0000 7f9a6ba0c9c0 10 monclient: get_monmap_and_config success 2024-09-14T11:38:15.658 INFO:tasks.workunit.client.0.smithi138.stderr: -219> 2024-09-14T11:38:15.242+0000 7f9a6ba0c9c0 4 set_mon_vals no callback set 2024-09-14T11:38:15.658 INFO:tasks.workunit.client.0.smithi138.stderr: -218> 2024-09-14T11:38:15.242+0000 7f9a6ba0c9c0 10 monclient: shutdown 2024-09-14T11:38:15.658 INFO:tasks.workunit.client.0.smithi138.stderr: -217> 2024-09-14T11:38:15.242+0000 7f9a6ba0c9c0 10 monclient: build_initial_monmap 2024-09-14T11:38:15.658 INFO:tasks.workunit.client.0.smithi138.stderr: -216> 2024-09-14T11:38:15.242+0000 7f9a6ba0c9c0 1 build_initial for_mkfs: 0 2024-09-14T11:38:15.658 INFO:tasks.workunit.client.0.smithi138.stderr: -215> 2024-09-14T11:38:15.242+0000 7f9a6ba0c9c0 10 monclient: monmap: 2024-09-14T11:38:15.658 INFO:tasks.workunit.client.0.smithi138.stderr:epoch 0 2024-09-14T11:38:15.659 INFO:tasks.workunit.client.0.smithi138.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-14T11:38:15.659 INFO:tasks.workunit.client.0.smithi138.stderr:last_changed 0.000000 2024-09-14T11:38:15.659 INFO:tasks.workunit.client.0.smithi138.stderr:created 0.000000 2024-09-14T11:38:15.659 INFO:tasks.workunit.client.0.smithi138.stderr:min_mon_release 0 (unknown) 2024-09-14T11:38:15.659 INFO:tasks.workunit.client.0.smithi138.stderr:election_strategy: 1 2024-09-14T11:38:15.659 INFO:tasks.workunit.client.0.smithi138.stderr:0: [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] mon.noname-a 2024-09-14T11:38:15.659 INFO:tasks.workunit.client.0.smithi138.stderr:1: [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] mon.noname-b 2024-09-14T11:38:15.659 INFO:tasks.workunit.client.0.smithi138.stderr:2: [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] mon.noname-c 2024-09-14T11:38:15.659 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-14T11:38:15.659 INFO:tasks.workunit.client.0.smithi138.stderr: -214> 2024-09-14T11:38:15.242+0000 7f9a6ba0c9c0 5 AuthRegistry(0x55a38a6ad0a0) adding auth protocol: cephx 2024-09-14T11:38:15.659 INFO:tasks.workunit.client.0.smithi138.stderr: -213> 2024-09-14T11:38:15.242+0000 7f9a6ba0c9c0 5 AuthRegistry(0x55a38a6ad0a0) adding auth protocol: cephx 2024-09-14T11:38:15.659 INFO:tasks.workunit.client.0.smithi138.stderr: -212> 2024-09-14T11:38:15.242+0000 7f9a6ba0c9c0 5 AuthRegistry(0x55a38a6ad0a0) adding auth protocol: cephx 2024-09-14T11:38:15.659 INFO:tasks.workunit.client.0.smithi138.stderr: -211> 2024-09-14T11:38:15.242+0000 7f9a6ba0c9c0 5 AuthRegistry(0x55a38a6ad0a0) adding con mode: secure 2024-09-14T11:38:15.659 INFO:tasks.workunit.client.0.smithi138.stderr: -210> 2024-09-14T11:38:15.242+0000 7f9a6ba0c9c0 5 AuthRegistry(0x55a38a6ad0a0) adding con mode: crc 2024-09-14T11:38:15.660 INFO:tasks.workunit.client.0.smithi138.stderr: -209> 2024-09-14T11:38:15.242+0000 7f9a6ba0c9c0 5 AuthRegistry(0x55a38a6ad0a0) adding con mode: secure 2024-09-14T11:38:15.660 INFO:tasks.workunit.client.0.smithi138.stderr: -208> 2024-09-14T11:38:15.242+0000 7f9a6ba0c9c0 5 AuthRegistry(0x55a38a6ad0a0) adding con mode: crc 2024-09-14T11:38:15.660 INFO:tasks.workunit.client.0.smithi138.stderr: -207> 2024-09-14T11:38:15.242+0000 7f9a6ba0c9c0 5 AuthRegistry(0x55a38a6ad0a0) adding con mode: secure 2024-09-14T11:38:15.660 INFO:tasks.workunit.client.0.smithi138.stderr: -206> 2024-09-14T11:38:15.242+0000 7f9a6ba0c9c0 5 AuthRegistry(0x55a38a6ad0a0) adding con mode: crc 2024-09-14T11:38:15.660 INFO:tasks.workunit.client.0.smithi138.stderr: -205> 2024-09-14T11:38:15.242+0000 7f9a6ba0c9c0 5 AuthRegistry(0x55a38a6ad0a0) adding con mode: crc 2024-09-14T11:38:15.660 INFO:tasks.workunit.client.0.smithi138.stderr: -204> 2024-09-14T11:38:15.242+0000 7f9a6ba0c9c0 5 AuthRegistry(0x55a38a6ad0a0) adding con mode: secure 2024-09-14T11:38:15.660 INFO:tasks.workunit.client.0.smithi138.stderr: -203> 2024-09-14T11:38:15.242+0000 7f9a6ba0c9c0 5 AuthRegistry(0x55a38a6ad0a0) adding con mode: crc 2024-09-14T11:38:15.660 INFO:tasks.workunit.client.0.smithi138.stderr: -202> 2024-09-14T11:38:15.242+0000 7f9a6ba0c9c0 5 AuthRegistry(0x55a38a6ad0a0) adding con mode: secure 2024-09-14T11:38:15.660 INFO:tasks.workunit.client.0.smithi138.stderr: -201> 2024-09-14T11:38:15.242+0000 7f9a6ba0c9c0 5 AuthRegistry(0x55a38a6ad0a0) adding con mode: crc 2024-09-14T11:38:15.660 INFO:tasks.workunit.client.0.smithi138.stderr: -200> 2024-09-14T11:38:15.242+0000 7f9a6ba0c9c0 5 AuthRegistry(0x55a38a6ad0a0) adding con mode: secure 2024-09-14T11:38:15.660 INFO:tasks.workunit.client.0.smithi138.stderr: -199> 2024-09-14T11:38:15.242+0000 7f9a6ba0c9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:38:15.660 INFO:tasks.workunit.client.0.smithi138.stderr: -198> 2024-09-14T11:38:15.242+0000 7f9a6ba0c9c0 1 librados: starting msgr at 2024-09-14T11:38:15.660 INFO:tasks.workunit.client.0.smithi138.stderr: -197> 2024-09-14T11:38:15.242+0000 7f9a6ba0c9c0 1 librados: starting objecter 2024-09-14T11:38:15.661 INFO:tasks.workunit.client.0.smithi138.stderr: -196> 2024-09-14T11:38:15.242+0000 7f9a6ba0c9c0 5 asok(0x55a38a3fed90) register_command objecter_requests cmddesc objecter_requests hook 0x55a38a68b410 EEXIST 2024-09-14T11:38:15.661 INFO:tasks.workunit.client.0.smithi138.stderr: -195> 2024-09-14T11:38:15.246+0000 7f9a6ba0c9c0 1 librados: setting wanted keys 2024-09-14T11:38:15.661 INFO:tasks.workunit.client.0.smithi138.stderr: -194> 2024-09-14T11:38:15.246+0000 7f9a6ba0c9c0 1 librados: calling monclient init 2024-09-14T11:38:15.661 INFO:tasks.workunit.client.0.smithi138.stderr: -193> 2024-09-14T11:38:15.246+0000 7f9a6ba0c9c0 10 monclient: init 2024-09-14T11:38:15.661 INFO:tasks.workunit.client.0.smithi138.stderr: -192> 2024-09-14T11:38:15.246+0000 7f9a6ba0c9c0 5 AuthRegistry(0x55a38a68a660) adding auth protocol: cephx 2024-09-14T11:38:15.661 INFO:tasks.workunit.client.0.smithi138.stderr: -191> 2024-09-14T11:38:15.246+0000 7f9a6ba0c9c0 5 AuthRegistry(0x55a38a68a660) adding auth protocol: cephx 2024-09-14T11:38:15.661 INFO:tasks.workunit.client.0.smithi138.stderr: -190> 2024-09-14T11:38:15.246+0000 7f9a6ba0c9c0 5 AuthRegistry(0x55a38a68a660) adding auth protocol: cephx 2024-09-14T11:38:15.661 INFO:tasks.workunit.client.0.smithi138.stderr: -189> 2024-09-14T11:38:15.246+0000 7f9a6ba0c9c0 5 AuthRegistry(0x55a38a68a660) adding con mode: secure 2024-09-14T11:38:15.661 INFO:tasks.workunit.client.0.smithi138.stderr: -188> 2024-09-14T11:38:15.246+0000 7f9a6ba0c9c0 5 AuthRegistry(0x55a38a68a660) adding con mode: crc 2024-09-14T11:38:15.661 INFO:tasks.workunit.client.0.smithi138.stderr: -187> 2024-09-14T11:38:15.246+0000 7f9a6ba0c9c0 5 AuthRegistry(0x55a38a68a660) adding con mode: secure 2024-09-14T11:38:15.661 INFO:tasks.workunit.client.0.smithi138.stderr: -186> 2024-09-14T11:38:15.246+0000 7f9a6ba0c9c0 5 AuthRegistry(0x55a38a68a660) adding con mode: crc 2024-09-14T11:38:15.661 INFO:tasks.workunit.client.0.smithi138.stderr: -185> 2024-09-14T11:38:15.246+0000 7f9a6ba0c9c0 5 AuthRegistry(0x55a38a68a660) adding con mode: secure 2024-09-14T11:38:15.661 INFO:tasks.workunit.client.0.smithi138.stderr: -184> 2024-09-14T11:38:15.246+0000 7f9a6ba0c9c0 5 AuthRegistry(0x55a38a68a660) adding con mode: crc 2024-09-14T11:38:15.661 INFO:tasks.workunit.client.0.smithi138.stderr: -183> 2024-09-14T11:38:15.246+0000 7f9a6ba0c9c0 5 AuthRegistry(0x55a38a68a660) adding con mode: crc 2024-09-14T11:38:15.662 INFO:tasks.workunit.client.0.smithi138.stderr: -182> 2024-09-14T11:38:15.246+0000 7f9a6ba0c9c0 5 AuthRegistry(0x55a38a68a660) adding con mode: secure 2024-09-14T11:38:15.662 INFO:tasks.workunit.client.0.smithi138.stderr: -181> 2024-09-14T11:38:15.246+0000 7f9a6ba0c9c0 5 AuthRegistry(0x55a38a68a660) adding con mode: crc 2024-09-14T11:38:15.662 INFO:tasks.workunit.client.0.smithi138.stderr: -180> 2024-09-14T11:38:15.246+0000 7f9a6ba0c9c0 5 AuthRegistry(0x55a38a68a660) adding con mode: secure 2024-09-14T11:38:15.662 INFO:tasks.workunit.client.0.smithi138.stderr: -179> 2024-09-14T11:38:15.246+0000 7f9a6ba0c9c0 5 AuthRegistry(0x55a38a68a660) adding con mode: crc 2024-09-14T11:38:15.662 INFO:tasks.workunit.client.0.smithi138.stderr: -178> 2024-09-14T11:38:15.246+0000 7f9a6ba0c9c0 5 AuthRegistry(0x55a38a68a660) adding con mode: secure 2024-09-14T11:38:15.662 INFO:tasks.workunit.client.0.smithi138.stderr: -177> 2024-09-14T11:38:15.246+0000 7f9a6ba0c9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:38:15.662 INFO:tasks.workunit.client.0.smithi138.stderr: -176> 2024-09-14T11:38:15.246+0000 7f9a6ba0c9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:38:15.662 INFO:tasks.workunit.client.0.smithi138.stderr: -175> 2024-09-14T11:38:15.246+0000 7f9a6ba0c9c0 5 asok(0x55a38a3fed90) register_command rotate-key cmddesc rotate-key hook 0x55a38a68a7a8 EEXIST 2024-09-14T11:38:15.662 INFO:tasks.workunit.client.0.smithi138.stderr: -174> 2024-09-14T11:38:15.246+0000 7f9a6ba0c9c0 10 monclient: _reopen_session rank -1 2024-09-14T11:38:15.662 INFO:tasks.workunit.client.0.smithi138.stderr: -173> 2024-09-14T11:38:15.246+0000 7f9a6ba0c9c0 10 monclient: _add_conns ranks=[1,2,0] 2024-09-14T11:38:15.662 INFO:tasks.workunit.client.0.smithi138.stderr: -172> 2024-09-14T11:38:15.246+0000 7f9a6ba0c9c0 10 monclient(hunting): picked mon.noname-b con 0x55a38a6ac280 addr [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] 2024-09-14T11:38:15.662 INFO:tasks.workunit.client.0.smithi138.stderr: -171> 2024-09-14T11:38:15.246+0000 7f9a6ba0c9c0 10 monclient(hunting): picked mon.noname-c con 0x55a38a6d7960 addr [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] 2024-09-14T11:38:15.662 INFO:tasks.workunit.client.0.smithi138.stderr: -170> 2024-09-14T11:38:15.246+0000 7f9a6ba0c9c0 10 monclient(hunting): picked mon.noname-a con 0x55a38a6dc500 addr [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] 2024-09-14T11:38:15.662 INFO:tasks.workunit.client.0.smithi138.stderr: -169> 2024-09-14T11:38:15.246+0000 7f9a6ba0c9c0 10 monclient(hunting): start opening mon connection 2024-09-14T11:38:15.662 INFO:tasks.workunit.client.0.smithi138.stderr: -168> 2024-09-14T11:38:15.246+0000 7f9a6ba0c9c0 10 monclient(hunting): start opening mon connection 2024-09-14T11:38:15.663 INFO:tasks.workunit.client.0.smithi138.stderr: -167> 2024-09-14T11:38:15.246+0000 7f9a6ba0c9c0 10 monclient(hunting): start opening mon connection 2024-09-14T11:38:15.663 INFO:tasks.workunit.client.0.smithi138.stderr: -166> 2024-09-14T11:38:15.246+0000 7f9a6ba0c9c0 10 monclient(hunting): _renew_subs 2024-09-14T11:38:15.663 INFO:tasks.workunit.client.0.smithi138.stderr: -165> 2024-09-14T11:38:15.246+0000 7f9a6ba0c9c0 10 monclient(hunting): authenticate will time out at 2831.208660s 2024-09-14T11:38:15.663 INFO:tasks.workunit.client.0.smithi138.stderr: -164> 2024-09-14T11:38:15.246+0000 7f9a69512640 10 monclient(hunting): get_auth_request con 0x55a38a6dc500 auth_method 0 2024-09-14T11:38:15.663 INFO:tasks.workunit.client.0.smithi138.stderr: -163> 2024-09-14T11:38:15.246+0000 7f9a69512640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:38:15.663 INFO:tasks.workunit.client.0.smithi138.stderr: -162> 2024-09-14T11:38:15.246+0000 7f9a69512640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:38:15.663 INFO:tasks.workunit.client.0.smithi138.stderr: -161> 2024-09-14T11:38:15.246+0000 7f9a69512640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:38:15.663 INFO:tasks.workunit.client.0.smithi138.stderr: -160> 2024-09-14T11:38:15.246+0000 7f9a69d13640 10 monclient(hunting): get_auth_request con 0x55a38a6d7960 auth_method 0 2024-09-14T11:38:15.663 INFO:tasks.workunit.client.0.smithi138.stderr: -159> 2024-09-14T11:38:15.246+0000 7f9a69d13640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:38:15.663 INFO:tasks.workunit.client.0.smithi138.stderr: -158> 2024-09-14T11:38:15.246+0000 7f9a69d13640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:38:15.663 INFO:tasks.workunit.client.0.smithi138.stderr: -157> 2024-09-14T11:38:15.246+0000 7f9a69d13640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:38:15.663 INFO:tasks.workunit.client.0.smithi138.stderr: -156> 2024-09-14T11:38:15.246+0000 7f9a69512640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:38:15.663 INFO:tasks.workunit.client.0.smithi138.stderr: -155> 2024-09-14T11:38:15.246+0000 7f9a69512640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:38:15.663 INFO:tasks.workunit.client.0.smithi138.stderr: -154> 2024-09-14T11:38:15.246+0000 7f9a69512640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:38:15.664 INFO:tasks.workunit.client.0.smithi138.stderr: -153> 2024-09-14T11:38:15.246+0000 7f9a69d13640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:38:15.664 INFO:tasks.workunit.client.0.smithi138.stderr: -152> 2024-09-14T11:38:15.246+0000 7f9a69d13640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:38:15.664 INFO:tasks.workunit.client.0.smithi138.stderr: -151> 2024-09-14T11:38:15.246+0000 7f9a69d13640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:38:15.664 INFO:tasks.workunit.client.0.smithi138.stderr: -150> 2024-09-14T11:38:15.246+0000 7f9a68d11640 10 monclient(hunting): get_auth_request con 0x55a38a6ac280 auth_method 0 2024-09-14T11:38:15.664 INFO:tasks.workunit.client.0.smithi138.stderr: -149> 2024-09-14T11:38:15.246+0000 7f9a68d11640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:38:15.664 INFO:tasks.workunit.client.0.smithi138.stderr: -148> 2024-09-14T11:38:15.246+0000 7f9a68d11640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:38:15.664 INFO:tasks.workunit.client.0.smithi138.stderr: -147> 2024-09-14T11:38:15.246+0000 7f9a68d11640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:38:15.664 INFO:tasks.workunit.client.0.smithi138.stderr: -146> 2024-09-14T11:38:15.246+0000 7f9a69d13640 10 monclient(hunting): handle_auth_done global_id 7151 payload 824 2024-09-14T11:38:15.664 INFO:tasks.workunit.client.0.smithi138.stderr: -145> 2024-09-14T11:38:15.246+0000 7f9a69d13640 10 monclient: _finish_hunting 0 2024-09-14T11:38:15.664 INFO:tasks.workunit.client.0.smithi138.stderr: -144> 2024-09-14T11:38:15.246+0000 7f9a69d13640 1 monclient: found mon.noname-c 2024-09-14T11:38:15.664 INFO:tasks.workunit.client.0.smithi138.stderr: -143> 2024-09-14T11:38:15.246+0000 7f9a69d13640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.138:3301/0 2024-09-14T11:38:15.664 INFO:tasks.workunit.client.0.smithi138.stderr: -142> 2024-09-14T11:38:15.246+0000 7f993affd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:38:15.664 INFO:tasks.workunit.client.0.smithi138.stderr: -141> 2024-09-14T11:38:15.246+0000 7f993affd640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-14T11:38:15.664 INFO:tasks.workunit.client.0.smithi138.stderr: -140> 2024-09-14T11:38:15.246+0000 7f993affd640 10 monclient: dump: 2024-09-14T11:38:15.665 INFO:tasks.workunit.client.0.smithi138.stderr:epoch 1 2024-09-14T11:38:15.665 INFO:tasks.workunit.client.0.smithi138.stderr:fsid 3f225f43-83a6-4aeb-b798-1f04bb49d597 2024-09-14T11:38:15.665 INFO:tasks.workunit.client.0.smithi138.stderr:last_changed 2024-09-14T11:07:09.252780+0000 2024-09-14T11:38:15.665 INFO:tasks.workunit.client.0.smithi138.stderr:created 2024-09-14T11:07:09.252780+0000 2024-09-14T11:38:15.665 INFO:tasks.workunit.client.0.smithi138.stderr:min_mon_release 19 (squid) 2024-09-14T11:38:15.665 INFO:tasks.workunit.client.0.smithi138.stderr:election_strategy: 1 2024-09-14T11:38:15.665 INFO:tasks.workunit.client.0.smithi138.stderr:0: [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] mon.a 2024-09-14T11:38:15.665 INFO:tasks.workunit.client.0.smithi138.stderr:1: [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] mon.b 2024-09-14T11:38:15.665 INFO:tasks.workunit.client.0.smithi138.stderr:2: [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] mon.c 2024-09-14T11:38:15.665 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-14T11:38:15.665 INFO:tasks.workunit.client.0.smithi138.stderr: -139> 2024-09-14T11:38:15.246+0000 7f993affd640 10 monclient: _finish_auth 0 2024-09-14T11:38:15.665 INFO:tasks.workunit.client.0.smithi138.stderr: -138> 2024-09-14T11:38:15.246+0000 7f993affd640 10 monclient: _check_auth_tickets 2024-09-14T11:38:15.665 INFO:tasks.workunit.client.0.smithi138.stderr: -137> 2024-09-14T11:38:15.246+0000 7f993affd640 10 monclient: handle_config config(0 keys) 2024-09-14T11:38:15.665 INFO:tasks.workunit.client.0.smithi138.stderr: -136> 2024-09-14T11:38:15.246+0000 7f993affd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:38:15.665 INFO:tasks.workunit.client.0.smithi138.stderr: -135> 2024-09-14T11:38:15.246+0000 7f993affd640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-14T11:38:15.666 INFO:tasks.workunit.client.0.smithi138.stderr: -134> 2024-09-14T11:38:15.246+0000 7f993affd640 10 monclient: dump: 2024-09-14T11:38:15.666 INFO:tasks.workunit.client.0.smithi138.stderr:epoch 1 2024-09-14T11:38:15.666 INFO:tasks.workunit.client.0.smithi138.stderr:fsid 3f225f43-83a6-4aeb-b798-1f04bb49d597 2024-09-14T11:38:15.666 INFO:tasks.workunit.client.0.smithi138.stderr:last_changed 2024-09-14T11:07:09.252780+0000 2024-09-14T11:38:15.666 INFO:tasks.workunit.client.0.smithi138.stderr:created 2024-09-14T11:07:09.252780+0000 2024-09-14T11:38:15.666 INFO:tasks.workunit.client.0.smithi138.stderr:min_mon_release 19 (squid) 2024-09-14T11:38:15.666 INFO:tasks.workunit.client.0.smithi138.stderr:election_strategy: 1 2024-09-14T11:38:15.666 INFO:tasks.workunit.client.0.smithi138.stderr:0: [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] mon.a 2024-09-14T11:38:15.666 INFO:tasks.workunit.client.0.smithi138.stderr:1: [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] mon.b 2024-09-14T11:38:15.666 INFO:tasks.workunit.client.0.smithi138.stderr:2: [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] mon.c 2024-09-14T11:38:15.666 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-14T11:38:15.666 INFO:tasks.workunit.client.0.smithi138.stderr: -133> 2024-09-14T11:38:15.246+0000 7f9a6ba0c9c0 5 monclient: authenticate success, global_id 7151 2024-09-14T11:38:15.666 INFO:tasks.workunit.client.0.smithi138.stderr: -132> 2024-09-14T11:38:15.246+0000 7f9a6ba0c9c0 10 monclient: _renew_subs 2024-09-14T11:38:15.666 INFO:tasks.workunit.client.0.smithi138.stderr: -131> 2024-09-14T11:38:15.246+0000 7f994cff9640 4 set_mon_vals no callback set 2024-09-14T11:38:15.667 INFO:tasks.workunit.client.0.smithi138.stderr: -130> 2024-09-14T11:38:15.246+0000 7f9a6ba0c9c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.138:3301/0 2024-09-14T11:38:15.667 INFO:tasks.workunit.client.0.smithi138.stderr: -129> 2024-09-14T11:38:15.246+0000 7f9a6ba0c9c0 10 monclient: _renew_subs 2024-09-14T11:38:15.667 INFO:tasks.workunit.client.0.smithi138.stderr: -128> 2024-09-14T11:38:15.246+0000 7f9a6ba0c9c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.138:3301/0 2024-09-14T11:38:15.667 INFO:tasks.workunit.client.0.smithi138.stderr: -127> 2024-09-14T11:38:15.246+0000 7f9a6ba0c9c0 1 librados: init done 2024-09-14T11:38:15.667 INFO:tasks.workunit.client.0.smithi138.stderr: -126> 2024-09-14T11:38:15.246+0000 7f9a6ba0c9c0 5 asok(0x55a38a3fed90) register_command cr dump hook 0x7f9a640dafc8 2024-09-14T11:38:15.667 INFO:tasks.workunit.client.0.smithi138.stderr: -125> 2024-09-14T11:38:15.246+0000 7f9a6ba0c9c0 20 rados->read ofs=0 len=0 2024-09-14T11:38:15.667 INFO:tasks.workunit.client.0.smithi138.stderr: -124> 2024-09-14T11:38:15.246+0000 7f993affd640 4 mgrc handle_mgr_map Got map version 5 2024-09-14T11:38:15.667 INFO:tasks.workunit.client.0.smithi138.stderr: -123> 2024-09-14T11:38:15.246+0000 7f993affd640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.138:6832/3778043143,v1:172.21.15.138:6833/3778043143] 2024-09-14T11:38:15.667 INFO:tasks.workunit.client.0.smithi138.stderr: -122> 2024-09-14T11:38:15.246+0000 7f993affd640 4 mgrc reconnect Starting new session with [v2:172.21.15.138:6832/3778043143,v1:172.21.15.138:6833/3778043143] 2024-09-14T11:38:15.667 INFO:tasks.workunit.client.0.smithi138.stderr: -121> 2024-09-14T11:38:15.246+0000 7f9a68d11640 10 monclient: get_auth_request con 0x7f99340718a0 auth_method 0 2024-09-14T11:38:15.667 INFO:tasks.workunit.client.0.smithi138.stderr: -120> 2024-09-14T11:38:15.246+0000 7f9a69512640 10 monclient: get_auth_request con 0x55a38a6f5450 auth_method 0 2024-09-14T11:38:15.667 INFO:tasks.workunit.client.0.smithi138.stderr: -119> 2024-09-14T11:38:15.250+0000 7f9a6ba0c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:38:15.667 INFO:tasks.workunit.client.0.smithi138.stderr: -118> 2024-09-14T11:38:15.250+0000 7f9a6ba0c9c0 20 realm 2024-09-14T11:38:15.667 INFO:tasks.workunit.client.0.smithi138.stderr: -117> 2024-09-14T11:38:15.250+0000 7f9a6ba0c9c0 20 rados->read ofs=0 len=0 2024-09-14T11:38:15.667 INFO:tasks.workunit.client.0.smithi138.stderr: -116> 2024-09-14T11:38:15.250+0000 7f9a6ba0c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:38:15.668 INFO:tasks.workunit.client.0.smithi138.stderr: -115> 2024-09-14T11:38:15.250+0000 7f9a6ba0c9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:38:15.668 INFO:tasks.workunit.client.0.smithi138.stderr: -114> 2024-09-14T11:38:15.250+0000 7f9a6ba0c9c0 20 rados->read ofs=0 len=0 2024-09-14T11:38:15.668 INFO:tasks.workunit.client.0.smithi138.stderr: -113> 2024-09-14T11:38:15.250+0000 7f9a6ba0c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:38:15.668 INFO:tasks.workunit.client.0.smithi138.stderr: -112> 2024-09-14T11:38:15.250+0000 7f9a6ba0c9c0 20 rados->read ofs=0 len=0 2024-09-14T11:38:15.668 INFO:tasks.workunit.client.0.smithi138.stderr: -111> 2024-09-14T11:38:15.250+0000 7f9a68d11640 10 monclient: get_auth_request con 0x55a38a6f96d0 auth_method 0 2024-09-14T11:38:15.668 INFO:tasks.workunit.client.0.smithi138.stderr: -110> 2024-09-14T11:38:15.250+0000 7f9a6ba0c9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:38:15.668 INFO:tasks.workunit.client.0.smithi138.stderr: -109> 2024-09-14T11:38:15.250+0000 7f9a6ba0c9c0 20 rados->read ofs=0 len=0 2024-09-14T11:38:15.668 INFO:tasks.workunit.client.0.smithi138.stderr: -108> 2024-09-14T11:38:15.250+0000 7f9a69d13640 10 monclient: get_auth_request con 0x55a38a6fcf80 auth_method 0 2024-09-14T11:38:15.668 INFO:tasks.workunit.client.0.smithi138.stderr: -107> 2024-09-14T11:38:15.250+0000 7f9a6ba0c9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:38:15.668 INFO:tasks.workunit.client.0.smithi138.stderr: -106> 2024-09-14T11:38:15.250+0000 7f9a6ba0c9c0 20 searching for the correct realm 2024-09-14T11:38:15.668 INFO:tasks.workunit.client.0.smithi138.stderr: -105> 2024-09-14T11:38:15.250+0000 7f9a69512640 10 monclient: get_auth_request con 0x55a38a701d00 auth_method 0 2024-09-14T11:38:15.668 INFO:tasks.workunit.client.0.smithi138.stderr: -104> 2024-09-14T11:38:15.254+0000 7f9a68d11640 10 monclient: get_auth_request con 0x7f9a5c008030 auth_method 0 2024-09-14T11:38:15.668 INFO:tasks.workunit.client.0.smithi138.stderr: -103> 2024-09-14T11:38:15.254+0000 7f9a69d13640 10 monclient: get_auth_request con 0x7f9a64004040 auth_method 0 2024-09-14T11:38:15.668 INFO:tasks.workunit.client.0.smithi138.stderr: -102> 2024-09-14T11:38:15.258+0000 7f9a68d11640 0 -- 172.21.15.138:0/233349919 >> [v2:172.21.15.154:6808/1468088432,v1:172.21.15.154:6809/1468088432] conn(0x7f9a5c008030 msgr2=0x7f9a5c05c360 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:38:15.668 INFO:tasks.workunit.client.0.smithi138.stderr: -101> 2024-09-14T11:38:15.258+0000 7f993affd640 1 client.7151.objecter ms_handle_reset 0x7f9a5c008030 session 0x7f9a5c0621f0 osd.7 2024-09-14T11:38:15.669 INFO:tasks.workunit.client.0.smithi138.stderr: -100> 2024-09-14T11:38:15.258+0000 7f993affd640 10 monclient: _renew_subs 2024-09-14T11:38:15.669 INFO:tasks.workunit.client.0.smithi138.stderr: -99> 2024-09-14T11:38:15.258+0000 7f993affd640 10 monclient: _send_mon_message to mon.c at v2:172.21.15.138:3301/0 2024-09-14T11:38:15.669 INFO:tasks.workunit.client.0.smithi138.stderr: -98> 2024-09-14T11:38:15.258+0000 7f9a68d11640 10 monclient: get_auth_request con 0x7f9934081fd0 auth_method 0 2024-09-14T11:38:15.669 INFO:tasks.workunit.client.0.smithi138.stderr: -97> 2024-09-14T11:38:15.258+0000 7f9a69512640 10 monclient: get_auth_request con 0x7f9a640b9440 auth_method 0 2024-09-14T11:38:15.669 INFO:tasks.workunit.client.0.smithi138.stderr: -96> 2024-09-14T11:38:15.262+0000 7f9a68d11640 10 monclient: get_auth_request con 0x7f9a64117000 auth_method 0 2024-09-14T11:38:15.669 INFO:tasks.workunit.client.0.smithi138.stderr: -95> 2024-09-14T11:38:15.262+0000 7f9a68d11640 0 -- 172.21.15.138:0/233349919 >> [v2:172.21.15.138:6816/326481658,v1:172.21.15.138:6817/326481658] conn(0x7f9a64117000 msgr2=0x7f9a64115860 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:38:15.669 INFO:tasks.workunit.client.0.smithi138.stderr: -94> 2024-09-14T11:38:15.466+0000 7f9a68d11640 10 monclient: get_auth_request con 0x7f9a64117000 auth_method 0 2024-09-14T11:38:15.669 INFO:tasks.workunit.client.0.smithi138.stderr: -93> 2024-09-14T11:38:15.478+0000 7f9a6ba0c9c0 20 RGWRados::pool_iterate: got zone_info.d9e72d30-c60b-4d0d-9267-fdc36392d5ad 2024-09-14T11:38:15.669 INFO:tasks.workunit.client.0.smithi138.stderr: -92> 2024-09-14T11:38:15.478+0000 7f9a6ba0c9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:38:15.669 INFO:tasks.workunit.client.0.smithi138.stderr: -91> 2024-09-14T11:38:15.478+0000 7f9a6ba0c9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:38:15.669 INFO:tasks.workunit.client.0.smithi138.stderr: -90> 2024-09-14T11:38:15.478+0000 7f9a6ba0c9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:38:15.669 INFO:tasks.workunit.client.0.smithi138.stderr: -89> 2024-09-14T11:38:15.478+0000 7f9a6ba0c9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:38:15.669 INFO:tasks.workunit.client.0.smithi138.stderr: -88> 2024-09-14T11:38:15.478+0000 7f9a6ba0c9c0 20 RGWRados::pool_iterate: got zonegroup_info.65ab941b-da8c-4160-94fb-3672b069d44f 2024-09-14T11:38:15.669 INFO:tasks.workunit.client.0.smithi138.stderr: -87> 2024-09-14T11:38:15.478+0000 7f9a6ba0c9c0 20 rados->read ofs=0 len=0 2024-09-14T11:38:15.669 INFO:tasks.workunit.client.0.smithi138.stderr: -86> 2024-09-14T11:38:15.478+0000 7f9a6ba0c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:38:15.670 INFO:tasks.workunit.client.0.smithi138.stderr: -85> 2024-09-14T11:38:15.478+0000 7f9a6ba0c9c0 20 rados->read ofs=0 len=0 2024-09-14T11:38:15.670 INFO:tasks.workunit.client.0.smithi138.stderr: -84> 2024-09-14T11:38:15.482+0000 7f9a6ba0c9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:38:15.670 INFO:tasks.workunit.client.0.smithi138.stderr: -83> 2024-09-14T11:38:15.482+0000 7f9a6ba0c9c0 20 rados->read ofs=0 len=0 2024-09-14T11:38:15.670 INFO:tasks.workunit.client.0.smithi138.stderr: -82> 2024-09-14T11:38:15.482+0000 7f9a6ba0c9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:38:15.670 INFO:tasks.workunit.client.0.smithi138.stderr: -81> 2024-09-14T11:38:15.482+0000 7f9a6ba0c9c0 20 zone default found 2024-09-14T11:38:15.670 INFO:tasks.workunit.client.0.smithi138.stderr: -80> 2024-09-14T11:38:15.482+0000 7f9a6ba0c9c0 4 Realm: () 2024-09-14T11:38:15.670 INFO:tasks.workunit.client.0.smithi138.stderr: -79> 2024-09-14T11:38:15.482+0000 7f9a6ba0c9c0 4 ZoneGroup: default (65ab941b-da8c-4160-94fb-3672b069d44f) 2024-09-14T11:38:15.670 INFO:tasks.workunit.client.0.smithi138.stderr: -78> 2024-09-14T11:38:15.482+0000 7f9a6ba0c9c0 4 Zone: default (d9e72d30-c60b-4d0d-9267-fdc36392d5ad) 2024-09-14T11:38:15.670 INFO:tasks.workunit.client.0.smithi138.stderr: -77> 2024-09-14T11:38:15.482+0000 7f9a6ba0c9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:38:15.670 INFO:tasks.workunit.client.0.smithi138.stderr: -76> 2024-09-14T11:38:15.482+0000 7f9a6ba0c9c0 20 zonegroup default 2024-09-14T11:38:15.670 INFO:tasks.workunit.client.0.smithi138.stderr: -75> 2024-09-14T11:38:15.482+0000 7f9a6ba0c9c0 20 rados->read ofs=0 len=0 2024-09-14T11:38:15.670 INFO:tasks.workunit.client.0.smithi138.stderr: -74> 2024-09-14T11:38:15.482+0000 7f9a6ba0c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:38:15.670 INFO:tasks.workunit.client.0.smithi138.stderr: -73> 2024-09-14T11:38:15.482+0000 7f9a6ba0c9c0 20 rados->read ofs=0 len=0 2024-09-14T11:38:15.670 INFO:tasks.workunit.client.0.smithi138.stderr: -72> 2024-09-14T11:38:15.482+0000 7f9a6ba0c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:38:15.671 INFO:tasks.workunit.client.0.smithi138.stderr: -71> 2024-09-14T11:38:15.482+0000 7f9a6ba0c9c0 20 rados->read ofs=0 len=0 2024-09-14T11:38:15.671 INFO:tasks.workunit.client.0.smithi138.stderr: -70> 2024-09-14T11:38:15.486+0000 7f9a6ba0c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:38:15.671 INFO:tasks.workunit.client.0.smithi138.stderr: -69> 2024-09-14T11:38:15.486+0000 7f9a6ba0c9c0 20 started sync module instance, tier type = 2024-09-14T11:38:15.671 INFO:tasks.workunit.client.0.smithi138.stderr: -68> 2024-09-14T11:38:15.486+0000 7f9a6ba0c9c0 20 started zone id=d9e72d30-c60b-4d0d-9267-fdc36392d5ad (name=default) with tier type = 2024-09-14T11:38:15.671 INFO:tasks.workunit.client.0.smithi138.stderr: -67> 2024-09-14T11:38:15.506+0000 7f9a6ba0c9c0 20 add_watcher() i=0 2024-09-14T11:38:15.671 INFO:tasks.workunit.client.0.smithi138.stderr: -66> 2024-09-14T11:38:15.506+0000 7f9a6ba0c9c0 20 add_watcher() i=1 2024-09-14T11:38:15.671 INFO:tasks.workunit.client.0.smithi138.stderr: -65> 2024-09-14T11:38:15.506+0000 7f9a6ba0c9c0 20 add_watcher() i=2 2024-09-14T11:38:15.671 INFO:tasks.workunit.client.0.smithi138.stderr: -64> 2024-09-14T11:38:15.506+0000 7f9a6ba0c9c0 20 add_watcher() i=3 2024-09-14T11:38:15.671 INFO:tasks.workunit.client.0.smithi138.stderr: -63> 2024-09-14T11:38:15.506+0000 7f9a6ba0c9c0 20 add_watcher() i=4 2024-09-14T11:38:15.671 INFO:tasks.workunit.client.0.smithi138.stderr: -62> 2024-09-14T11:38:15.506+0000 7f9a6ba0c9c0 20 add_watcher() i=5 2024-09-14T11:38:15.671 INFO:tasks.workunit.client.0.smithi138.stderr: -61> 2024-09-14T11:38:15.506+0000 7f9a6ba0c9c0 20 add_watcher() i=6 2024-09-14T11:38:15.671 INFO:tasks.workunit.client.0.smithi138.stderr: -60> 2024-09-14T11:38:15.510+0000 7f9a6ba0c9c0 20 add_watcher() i=7 2024-09-14T11:38:15.671 INFO:tasks.workunit.client.0.smithi138.stderr: -59> 2024-09-14T11:38:15.510+0000 7f9a6ba0c9c0 2 all 8 watchers are set, enabling cache 2024-09-14T11:38:15.671 INFO:tasks.workunit.client.0.smithi138.stderr: -58> 2024-09-14T11:38:15.514+0000 7f9a6ba0c9c0 5 AuthRegistry(0x7fff9ef3bd70) adding auth protocol: cephx 2024-09-14T11:38:15.671 INFO:tasks.workunit.client.0.smithi138.stderr: -57> 2024-09-14T11:38:15.514+0000 7f9a6ba0c9c0 5 AuthRegistry(0x7fff9ef3bd70) adding auth protocol: cephx 2024-09-14T11:38:15.671 INFO:tasks.workunit.client.0.smithi138.stderr: -56> 2024-09-14T11:38:15.514+0000 7f9a6ba0c9c0 5 AuthRegistry(0x7fff9ef3bd70) adding auth protocol: cephx 2024-09-14T11:38:15.672 INFO:tasks.workunit.client.0.smithi138.stderr: -55> 2024-09-14T11:38:15.514+0000 7f9a6ba0c9c0 5 AuthRegistry(0x7fff9ef3bd70) adding con mode: secure 2024-09-14T11:38:15.672 INFO:tasks.workunit.client.0.smithi138.stderr: -54> 2024-09-14T11:38:15.514+0000 7f9a6ba0c9c0 5 AuthRegistry(0x7fff9ef3bd70) adding con mode: crc 2024-09-14T11:38:15.672 INFO:tasks.workunit.client.0.smithi138.stderr: -53> 2024-09-14T11:38:15.514+0000 7f9a6ba0c9c0 5 AuthRegistry(0x7fff9ef3bd70) adding con mode: secure 2024-09-14T11:38:15.672 INFO:tasks.workunit.client.0.smithi138.stderr: -52> 2024-09-14T11:38:15.514+0000 7f9a6ba0c9c0 5 AuthRegistry(0x7fff9ef3bd70) adding con mode: crc 2024-09-14T11:38:15.672 INFO:tasks.workunit.client.0.smithi138.stderr: -51> 2024-09-14T11:38:15.514+0000 7f9a6ba0c9c0 5 AuthRegistry(0x7fff9ef3bd70) adding con mode: secure 2024-09-14T11:38:15.672 INFO:tasks.workunit.client.0.smithi138.stderr: -50> 2024-09-14T11:38:15.514+0000 7f9a6ba0c9c0 5 AuthRegistry(0x7fff9ef3bd70) adding con mode: crc 2024-09-14T11:38:15.672 INFO:tasks.workunit.client.0.smithi138.stderr: -49> 2024-09-14T11:38:15.514+0000 7f9a6ba0c9c0 5 AuthRegistry(0x7fff9ef3bd70) adding con mode: crc 2024-09-14T11:38:15.672 INFO:tasks.workunit.client.0.smithi138.stderr: -48> 2024-09-14T11:38:15.514+0000 7f9a6ba0c9c0 5 AuthRegistry(0x7fff9ef3bd70) adding con mode: secure 2024-09-14T11:38:15.672 INFO:tasks.workunit.client.0.smithi138.stderr: -47> 2024-09-14T11:38:15.514+0000 7f9a6ba0c9c0 5 AuthRegistry(0x7fff9ef3bd70) adding con mode: crc 2024-09-14T11:38:15.672 INFO:tasks.workunit.client.0.smithi138.stderr: -46> 2024-09-14T11:38:15.514+0000 7f9a6ba0c9c0 5 AuthRegistry(0x7fff9ef3bd70) adding con mode: secure 2024-09-14T11:38:15.672 INFO:tasks.workunit.client.0.smithi138.stderr: -45> 2024-09-14T11:38:15.514+0000 7f9a6ba0c9c0 5 AuthRegistry(0x7fff9ef3bd70) adding con mode: crc 2024-09-14T11:38:15.672 INFO:tasks.workunit.client.0.smithi138.stderr: -44> 2024-09-14T11:38:15.514+0000 7f991ffe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:38:15.672 INFO:tasks.workunit.client.0.smithi138.stderr: -43> 2024-09-14T11:38:15.514+0000 7f9a6ba0c9c0 5 AuthRegistry(0x7fff9ef3bd70) adding con mode: secure 2024-09-14T11:38:15.672 INFO:tasks.workunit.client.0.smithi138.stderr: -42> 2024-09-14T11:38:15.514+0000 7f9a6ba0c9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:38:15.672 INFO:tasks.workunit.client.0.smithi138.stderr: -41> 2024-09-14T11:38:15.514+0000 7f9a6ba0c9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:38:15.673 INFO:tasks.workunit.client.0.smithi138.stderr: -40> 2024-09-14T11:38:15.514+0000 7f9a6ba0c9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:38:15.673 INFO:tasks.workunit.client.0.smithi138.stderr: -39> 2024-09-14T11:38:15.514+0000 7f9a6ba0c9c0 5 asok(0x55a38a3fed90) register_command cache list hook 0x55a38a6aadf0 2024-09-14T11:38:15.673 INFO:tasks.workunit.client.0.smithi138.stderr: -38> 2024-09-14T11:38:15.514+0000 7f9a6ba0c9c0 5 asok(0x55a38a3fed90) register_command cache inspect hook 0x55a38a6aadf0 2024-09-14T11:38:15.673 INFO:tasks.workunit.client.0.smithi138.stderr: -37> 2024-09-14T11:38:15.514+0000 7f9a6ba0c9c0 5 asok(0x55a38a3fed90) register_command cache erase hook 0x55a38a6aadf0 2024-09-14T11:38:15.673 INFO:tasks.workunit.client.0.smithi138.stderr: -36> 2024-09-14T11:38:15.514+0000 7f9a6ba0c9c0 5 asok(0x55a38a3fed90) register_command cache zap hook 0x55a38a6aadf0 2024-09-14T11:38:15.673 INFO:tasks.workunit.client.0.smithi138.stderr: -35> 2024-09-14T11:38:15.514+0000 7f9a6ba0c9c0 5 note: GC not initialized 2024-09-14T11:38:15.673 INFO:tasks.workunit.client.0.smithi138.stderr: -34> 2024-09-14T11:38:15.514+0000 7f991efe5640 20 reqs_thread_entry: start 2024-09-14T11:38:15.673 INFO:tasks.workunit.client.0.smithi138.stderr: -33> 2024-09-14T11:38:15.514+0000 7f9a6ba0c9c0 5 asok(0x55a38a3fed90) register_command sync trace show hook 0x7f9a60007040 2024-09-14T11:38:15.673 INFO:tasks.workunit.client.0.smithi138.stderr: -32> 2024-09-14T11:38:15.514+0000 7f9a6ba0c9c0 5 asok(0x55a38a3fed90) register_command sync trace history hook 0x7f9a60007040 2024-09-14T11:38:15.673 INFO:tasks.workunit.client.0.smithi138.stderr: -31> 2024-09-14T11:38:15.514+0000 7f9a6ba0c9c0 5 asok(0x55a38a3fed90) register_command sync trace active hook 0x7f9a60007040 2024-09-14T11:38:15.673 INFO:tasks.workunit.client.0.smithi138.stderr: -30> 2024-09-14T11:38:15.514+0000 7f9a6ba0c9c0 5 asok(0x55a38a3fed90) register_command sync trace active_short hook 0x7f9a60007040 2024-09-14T11:38:15.673 INFO:tasks.workunit.client.0.smithi138.stderr: -29> 2024-09-14T11:38:15.514+0000 7f9a6ba0c9c0 20 init_complete bucket index max shards: 11 2024-09-14T11:38:15.673 INFO:tasks.workunit.client.0.smithi138.stderr: -28> 2024-09-14T11:38:15.514+0000 7f9a6ba0c9c0 20 Filter name: none 2024-09-14T11:38:15.673 INFO:tasks.workunit.client.0.smithi138.stderr: -27> 2024-09-14T11:38:15.514+0000 7f991cfe1640 20 reqs_thread_entry: start 2024-09-14T11:38:15.674 INFO:tasks.workunit.client.0.smithi138.stderr: -26> 2024-09-14T11:38:15.514+0000 7f9a6ba0c9c0 10 cache get: name=default.rgw.meta+root+abort-at-logrecord-writes : miss 2024-09-14T11:38:15.674 INFO:tasks.workunit.client.0.smithi138.stderr: -25> 2024-09-14T11:38:15.514+0000 7f9a6ba0c9c0 20 rados->read ofs=0 len=0 2024-09-14T11:38:15.674 INFO:tasks.workunit.client.0.smithi138.stderr: -24> 2024-09-14T11:38:15.518+0000 7f9a6ba0c9c0 20 rados_obj.operate() r=0 bl.length=193 2024-09-14T11:38:15.674 INFO:tasks.workunit.client.0.smithi138.stderr: -23> 2024-09-14T11:38:15.518+0000 7f9a6ba0c9c0 10 cache put: name=default.rgw.meta+root+abort-at-logrecord-writes info.flags=0x11 2024-09-14T11:38:15.674 INFO:tasks.workunit.client.0.smithi138.stderr: -22> 2024-09-14T11:38:15.518+0000 7f9a6ba0c9c0 10 adding default.rgw.meta+root+abort-at-logrecord-writes to cache LRU end 2024-09-14T11:38:15.674 INFO:tasks.workunit.client.0.smithi138.stderr: -21> 2024-09-14T11:38:15.518+0000 7f9a6ba0c9c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.36 : miss 2024-09-14T11:38:15.674 INFO:tasks.workunit.client.0.smithi138.stderr: -20> 2024-09-14T11:38:15.518+0000 7f9a6ba0c9c0 20 rados->read ofs=0 len=0 2024-09-14T11:38:15.674 INFO:tasks.workunit.client.0.smithi138.stderr: -19> 2024-09-14T11:38:15.518+0000 7f9a6ba0c9c0 20 rados_obj.operate() r=0 bl.length=415 2024-09-14T11:38:15.674 INFO:tasks.workunit.client.0.smithi138.stderr: -18> 2024-09-14T11:38:15.518+0000 7f9a6ba0c9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.36 info.flags=0x17 2024-09-14T11:38:15.674 INFO:tasks.workunit.client.0.smithi138.stderr: -17> 2024-09-14T11:38:15.518+0000 7f9a6ba0c9c0 10 adding default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.36 to cache LRU end 2024-09-14T11:38:15.674 INFO:tasks.workunit.client.0.smithi138.stderr: -16> 2024-09-14T11:38:15.518+0000 7f9a6ba0c9c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:38:15.674 INFO:tasks.workunit.client.0.smithi138.stderr: -15> 2024-09-14T11:38:15.518+0000 7f9a6ba0c9c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:38:15.675 INFO:tasks.workunit.client.0.smithi138.stderr: -14> 2024-09-14T11:38:15.518+0000 7f9a6ba0c9c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.36 2024-09-14T11:38:15.675 INFO:tasks.workunit.client.0.smithi138.stderr: -13> 2024-09-14T11:38:15.530+0000 7f9a6ba0c9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.36 info.flags=0x17 2024-09-14T11:38:15.675 INFO:tasks.workunit.client.0.smithi138.stderr: -12> 2024-09-14T11:38:15.530+0000 7f9a6ba0c9c0 10 moving default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.36 to cache LRU end 2024-09-14T11:38:15.675 INFO:tasks.workunit.client.0.smithi138.stderr: -11> 2024-09-14T11:38:15.530+0000 7f9a6ba0c9c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:38:15.675 INFO:tasks.workunit.client.0.smithi138.stderr: -10> 2024-09-14T11:38:15.530+0000 7f9a6ba0c9c0 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-logrecord-writes:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.36, ofs0, ns] 2024-09-14T11:38:15.675 INFO:tasks.workunit.client.0.smithi138.stderr: -9> 2024-09-14T11:38:15.534+0000 7f994cff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366169 cookie 94160890663888 notifier 7151 bl.length()=923 2024-09-14T11:38:15.675 INFO:tasks.workunit.client.0.smithi138.stderr: -8> 2024-09-14T11:38:15.534+0000 7f994cff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.36 info.flags=0x17 2024-09-14T11:38:15.675 INFO:tasks.workunit.client.0.smithi138.stderr: -7> 2024-09-14T11:38:15.534+0000 7f994cff9640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.36 to cache LRU end 2024-09-14T11:38:15.675 INFO:tasks.workunit.client.0.smithi138.stderr: -6> 2024-09-14T11:38:15.534+0000 7f994cff9640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:38:15.675 INFO:tasks.workunit.client.0.smithi138.stderr: -5> 2024-09-14T11:38:15.534+0000 7f9a6ba0c9c0 20 handle_bi_update(): bucket=:abort-at-logrecord-writes[d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.36]): orig_sources= new_sources= 2024-09-14T11:38:15.675 INFO:tasks.workunit.client.0.smithi138.stderr: -4> 2024-09-14T11:38:15.534+0000 7f9a6ba0c9c0 20 handle_bi_update(): bucket=:abort-at-logrecord-writes[d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.36]): potential sources added=[] removed=[] 2024-09-14T11:38:15.675 INFO:tasks.workunit.client.0.smithi138.stderr: -3> 2024-09-14T11:38:15.534+0000 7f9a6ba0c9c0 20 handle_bi_update(): bucket=:abort-at-logrecord-writes[d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.36]): orig_dests= new_dests= 2024-09-14T11:38:15.675 INFO:tasks.workunit.client.0.smithi138.stderr: -2> 2024-09-14T11:38:15.534+0000 7f9a6ba0c9c0 20 handle_bi_update(): bucket=:abort-at-logrecord-writes[d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.36]): potential dests added=[] removed=[] 2024-09-14T11:38:15.675 INFO:tasks.workunit.client.0.smithi138.stderr: -1> 2024-09-14T11:38:15.542+0000 7f9a6ba0c9c0 -1 ./src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f9a6ba0c9c0 time 2024-09-14T11:38:15.545043+0000 2024-09-14T11:38:15.676 INFO:tasks.workunit.client.0.smithi138.stderr:./src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-14T11:38:15.676 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-14T11:38:15.676 INFO:tasks.workunit.client.0.smithi138.stderr: ceph version 19.3.0-4907-ga2782315 (a2782315255a3e7d5f6cdc9eb35785187ff6ddf8) squid (dev) 2024-09-14T11:38:15.676 INFO:tasks.workunit.client.0.smithi138.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x121) [0x7f9a6f2e62eb] 2024-09-14T11:38:15.676 INFO:tasks.workunit.client.0.smithi138.stderr: 2: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7f9a6f2e649f] 2024-09-14T11:38:15.676 INFO:tasks.workunit.client.0.smithi138.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55a388c47c01] 2024-09-14T11:38:15.676 INFO:tasks.workunit.client.0.smithi138.stderr: 4: radosgw-admin(+0x142325c) [0x55a3896a625c] 2024-09-14T11:38:15.676 INFO:tasks.workunit.client.0.smithi138.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x55a388c5cecd] 2024-09-14T11:38:15.676 INFO:tasks.workunit.client.0.smithi138.stderr: 6: main() 2024-09-14T11:38:15.676 INFO:tasks.workunit.client.0.smithi138.stderr: 7: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7f9a6e14cd90] 2024-09-14T11:38:15.676 INFO:tasks.workunit.client.0.smithi138.stderr: 8: __libc_start_main() 2024-09-14T11:38:15.676 INFO:tasks.workunit.client.0.smithi138.stderr: 9: _start() 2024-09-14T11:38:15.676 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-14T11:38:15.676 INFO:tasks.workunit.client.0.smithi138.stderr: 0> 2024-09-14T11:38:15.542+0000 7f9a6ba0c9c0 -1 *** Caught signal (Aborted) ** 2024-09-14T11:38:15.676 INFO:tasks.workunit.client.0.smithi138.stderr: in thread 7f9a6ba0c9c0 thread_name:radosgw-admin 2024-09-14T11:38:15.677 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-14T11:38:15.677 INFO:tasks.workunit.client.0.smithi138.stderr: ceph version 19.3.0-4907-ga2782315 (a2782315255a3e7d5f6cdc9eb35785187ff6ddf8) squid (dev) 2024-09-14T11:38:15.677 INFO:tasks.workunit.client.0.smithi138.stderr: 1: /lib/x86_64-linux-gnu/libc.so.6(+0x42520) [0x7f9a6e165520] 2024-09-14T11:38:15.677 INFO:tasks.workunit.client.0.smithi138.stderr: 2: pthread_kill() 2024-09-14T11:38:15.677 INFO:tasks.workunit.client.0.smithi138.stderr: 3: raise() 2024-09-14T11:38:15.677 INFO:tasks.workunit.client.0.smithi138.stderr: 4: abort() 2024-09-14T11:38:15.677 INFO:tasks.workunit.client.0.smithi138.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x17b) [0x7f9a6f2e6345] 2024-09-14T11:38:15.677 INFO:tasks.workunit.client.0.smithi138.stderr: 6: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7f9a6f2e649f] 2024-09-14T11:38:15.677 INFO:tasks.workunit.client.0.smithi138.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55a388c47c01] 2024-09-14T11:38:15.677 INFO:tasks.workunit.client.0.smithi138.stderr: 8: radosgw-admin(+0x142325c) [0x55a3896a625c] 2024-09-14T11:38:15.677 INFO:tasks.workunit.client.0.smithi138.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x55a388c5cecd] 2024-09-14T11:38:15.677 INFO:tasks.workunit.client.0.smithi138.stderr: 10: main() 2024-09-14T11:38:15.677 INFO:tasks.workunit.client.0.smithi138.stderr: 11: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7f9a6e14cd90] 2024-09-14T11:38:15.677 INFO:tasks.workunit.client.0.smithi138.stderr: 12: __libc_start_main() 2024-09-14T11:38:15.677 INFO:tasks.workunit.client.0.smithi138.stderr: 13: _start() 2024-09-14T11:38:15.678 INFO:tasks.workunit.client.0.smithi138.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-14T11:38:15.678 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-14T11:38:15.678 INFO:tasks.workunit.client.0.smithi138.stderr:--- logging levels --- 2024-09-14T11:38:15.678 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 none 2024-09-14T11:38:15.678 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 1 lockdep 2024-09-14T11:38:15.678 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 1 context 2024-09-14T11:38:15.678 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 1 crush 2024-09-14T11:38:15.678 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 mds 2024-09-14T11:38:15.678 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 mds_balancer 2024-09-14T11:38:15.678 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 mds_locker 2024-09-14T11:38:15.678 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 mds_log 2024-09-14T11:38:15.678 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 mds_log_expire 2024-09-14T11:38:15.678 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 mds_migrator 2024-09-14T11:38:15.678 INFO:tasks.workunit.client.0.smithi138.stderr: 3/ 5 mds_quiesce 2024-09-14T11:38:15.678 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 1 buffer 2024-09-14T11:38:15.679 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 1 timer 2024-09-14T11:38:15.679 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 1 filer 2024-09-14T11:38:15.679 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 1 striper 2024-09-14T11:38:15.679 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 1 objecter 2024-09-14T11:38:15.679 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 rados 2024-09-14T11:38:15.679 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 rbd 2024-09-14T11:38:15.679 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 rbd_mirror 2024-09-14T11:38:15.679 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 rbd_replay 2024-09-14T11:38:15.679 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 rbd_pwl 2024-09-14T11:38:15.679 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 journaler 2024-09-14T11:38:15.679 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 objectcacher 2024-09-14T11:38:15.679 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 immutable_obj_cache 2024-09-14T11:38:15.679 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 client 2024-09-14T11:38:15.679 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 osd 2024-09-14T11:38:15.680 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 optracker 2024-09-14T11:38:15.680 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 objclass 2024-09-14T11:38:15.680 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 3 filestore 2024-09-14T11:38:15.680 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 3 journal 2024-09-14T11:38:15.680 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 0 ms 2024-09-14T11:38:15.680 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 mon 2024-09-14T11:38:15.680 INFO:tasks.workunit.client.0.smithi138.stderr: 0/10 monc 2024-09-14T11:38:15.680 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 paxos 2024-09-14T11:38:15.680 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 tp 2024-09-14T11:38:15.680 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 auth 2024-09-14T11:38:15.680 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 crypto 2024-09-14T11:38:15.680 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 1 finisher 2024-09-14T11:38:15.680 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 1 reserver 2024-09-14T11:38:15.680 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 heartbeatmap 2024-09-14T11:38:15.680 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 perfcounter 2024-09-14T11:38:15.680 INFO:tasks.workunit.client.0.smithi138.stderr: 20/20 rgw 2024-09-14T11:38:15.681 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 rgw_sync 2024-09-14T11:38:15.681 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 rgw_datacache 2024-09-14T11:38:15.681 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 rgw_access 2024-09-14T11:38:15.681 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 rgw_dbstore 2024-09-14T11:38:15.681 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 rgw_flight 2024-09-14T11:38:15.681 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 rgw_lifecycle 2024-09-14T11:38:15.681 INFO:tasks.workunit.client.0.smithi138.stderr: 20/20 rgw_notification 2024-09-14T11:38:15.681 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 javaclient 2024-09-14T11:38:15.681 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 asok 2024-09-14T11:38:15.681 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 1 throttle 2024-09-14T11:38:15.681 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 0 refs 2024-09-14T11:38:15.681 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 compressor 2024-09-14T11:38:15.681 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 bluestore 2024-09-14T11:38:15.681 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 bluefs 2024-09-14T11:38:15.681 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 3 bdev 2024-09-14T11:38:15.681 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 kstore 2024-09-14T11:38:15.682 INFO:tasks.workunit.client.0.smithi138.stderr: 4/ 5 rocksdb 2024-09-14T11:38:15.682 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 fuse 2024-09-14T11:38:15.682 INFO:tasks.workunit.client.0.smithi138.stderr: 2/ 5 mgr 2024-09-14T11:38:15.682 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 mgrc 2024-09-14T11:38:15.682 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 dpdk 2024-09-14T11:38:15.682 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 eventtrace 2024-09-14T11:38:15.682 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 prioritycache 2024-09-14T11:38:15.682 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 test 2024-09-14T11:38:15.682 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 cephfs_mirror 2024-09-14T11:38:15.682 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 cephsqlite 2024-09-14T11:38:15.682 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 crimson_interrupt 2024-09-14T11:38:15.682 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 seastore 2024-09-14T11:38:15.682 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 seastore_onode 2024-09-14T11:38:15.682 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 seastore_odata 2024-09-14T11:38:15.682 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 seastore_omap 2024-09-14T11:38:15.682 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 seastore_tm 2024-09-14T11:38:15.683 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 seastore_t 2024-09-14T11:38:15.683 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 seastore_cleaner 2024-09-14T11:38:15.683 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 seastore_epm 2024-09-14T11:38:15.683 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 seastore_lba 2024-09-14T11:38:15.683 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 seastore_fixedkv_tree 2024-09-14T11:38:15.683 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 seastore_cache 2024-09-14T11:38:15.683 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 seastore_journal 2024-09-14T11:38:15.683 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 seastore_device 2024-09-14T11:38:15.683 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 seastore_backref 2024-09-14T11:38:15.683 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 alienstore 2024-09-14T11:38:15.683 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 mclock 2024-09-14T11:38:15.683 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 cyanstore 2024-09-14T11:38:15.683 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 ceph_exporter 2024-09-14T11:38:15.683 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 memstore 2024-09-14T11:38:15.683 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 trace 2024-09-14T11:38:15.683 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 ceph_dedup 2024-09-14T11:38:15.684 INFO:tasks.workunit.client.0.smithi138.stderr: -2/-2 (syslog threshold) 2024-09-14T11:38:15.684 INFO:tasks.workunit.client.0.smithi138.stderr: 99/99 (stderr threshold) 2024-09-14T11:38:15.684 INFO:tasks.workunit.client.0.smithi138.stderr:--- pthread ID / name mapping for recent threads --- 2024-09-14T11:38:15.684 INFO:tasks.workunit.client.0.smithi138.stderr: 7f991cfe1640 / http_manager 2024-09-14T11:38:15.684 INFO:tasks.workunit.client.0.smithi138.stderr: 7f991efe5640 / http_manager 2024-09-14T11:38:15.684 INFO:tasks.workunit.client.0.smithi138.stderr: 7f991ffe7640 / rgw_dt_lg_renew 2024-09-14T11:38:15.684 INFO:tasks.workunit.client.0.smithi138.stderr: 7f993affd640 / ms_dispatch 2024-09-14T11:38:15.684 INFO:tasks.workunit.client.0.smithi138.stderr: 7f994cff9640 / io_context_pool 2024-09-14T11:38:15.684 INFO:tasks.workunit.client.0.smithi138.stderr: 7f994effd640 / ms_dispatch 2024-09-14T11:38:15.684 INFO:tasks.workunit.client.0.smithi138.stderr: 7f9955e03640 / ms_dispatch 2024-09-14T11:38:15.684 INFO:tasks.workunit.client.0.smithi138.stderr: 7f9957606640 / io_context_pool 2024-09-14T11:38:15.684 INFO:tasks.workunit.client.0.smithi138.stderr: 7f9a68d11640 / msgr-worker-2 2024-09-14T11:38:15.684 INFO:tasks.workunit.client.0.smithi138.stderr: 7f9a69512640 / msgr-worker-1 2024-09-14T11:38:15.684 INFO:tasks.workunit.client.0.smithi138.stderr: 7f9a69d13640 / msgr-worker-0 2024-09-14T11:38:15.685 INFO:tasks.workunit.client.0.smithi138.stderr: 7f9a6a514640 / io_context_pool 2024-09-14T11:38:15.685 INFO:tasks.workunit.client.0.smithi138.stderr: 7f9a6ba0c9c0 / radosgw-admin 2024-09-14T11:38:15.685 INFO:tasks.workunit.client.0.smithi138.stderr: max_recent 500 2024-09-14T11:38:15.685 INFO:tasks.workunit.client.0.smithi138.stderr: max_new 1000 2024-09-14T11:38:15.685 INFO:tasks.workunit.client.0.smithi138.stderr: log_file /var/lib/ceph/crash/2024-09-14T11:38:15.548438Z_28e9a718-5119-407f-b1dc-b4c6acef14b1/log 2024-09-14T11:38:15.685 INFO:tasks.workunit.client.0.smithi138.stderr:--- end dump of recent events --- 2024-09-14T11:38:15.685 INFO:tasks.workunit.client.0.smithi138.stderr:Aborted 2024-09-14T11:38:15.685 INFO:tasks.workunit.client.0.smithi138.stderr:radosgw-admin bucket stats --bucket abort-at-logrecord-writes 2024-09-14T11:38:15.686 INFO:tasks.workunit.client.0.smithi138.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:38:15.686 INFO:tasks.workunit.client.0.smithi138.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:38:15.686 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:15.626+0000 7f5486fb29c0 20 rados->read ofs=0 len=0 2024-09-14T11:38:15.686 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:15.630+0000 7f5486fb29c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:38:15.687 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:15.630+0000 7f5486fb29c0 20 realm 2024-09-14T11:38:15.687 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:15.630+0000 7f5486fb29c0 20 rados->read ofs=0 len=0 2024-09-14T11:38:15.687 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:15.630+0000 7f5486fb29c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:38:15.687 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:15.630+0000 7f5486fb29c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:38:15.687 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:15.630+0000 7f5486fb29c0 20 rados->read ofs=0 len=0 2024-09-14T11:38:15.687 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:15.630+0000 7f5486fb29c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:38:15.687 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:15.630+0000 7f5486fb29c0 20 rados->read ofs=0 len=0 2024-09-14T11:38:15.687 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:15.630+0000 7f5486fb29c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:38:15.687 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:15.630+0000 7f5486fb29c0 20 rados->read ofs=0 len=0 2024-09-14T11:38:15.687 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:15.630+0000 7f5486fb29c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:38:15.687 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:15.630+0000 7f5486fb29c0 20 searching for the correct realm 2024-09-14T11:38:15.687 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:15.634+0000 7f54852b9640 0 -- 172.21.15.138:0/3160507571 >> [v2:172.21.15.154:6824/416768175,v1:172.21.15.154:6825/416768175] conn(0x7f547c03cc20 msgr2=0x7f547c043400 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:38:15.687 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:15.642+0000 7f54842b7640 0 -- 172.21.15.138:0/3160507571 >> [v2:172.21.15.138:6816/326481658,v1:172.21.15.138:6817/326481658] conn(0x7f547c057450 msgr2=0x7f547c0578d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-14T11:38:15.858 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:15.858+0000 7f5486fb29c0 20 RGWRados::pool_iterate: got zone_info.d9e72d30-c60b-4d0d-9267-fdc36392d5ad 2024-09-14T11:38:15.859 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:15.858+0000 7f5486fb29c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:38:15.859 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:15.858+0000 7f5486fb29c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:38:15.859 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:15.858+0000 7f5486fb29c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:38:15.859 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:15.858+0000 7f5486fb29c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:38:15.859 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:15.858+0000 7f5486fb29c0 20 RGWRados::pool_iterate: got zonegroup_info.65ab941b-da8c-4160-94fb-3672b069d44f 2024-09-14T11:38:15.859 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:15.858+0000 7f5486fb29c0 20 rados->read ofs=0 len=0 2024-09-14T11:38:15.859 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:15.858+0000 7f5486fb29c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:38:15.859 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:15.858+0000 7f5486fb29c0 20 rados->read ofs=0 len=0 2024-09-14T11:38:15.860 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:15.862+0000 7f5486fb29c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:38:15.860 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:15.862+0000 7f5486fb29c0 20 rados->read ofs=0 len=0 2024-09-14T11:38:15.861 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:15.862+0000 7f5486fb29c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:38:15.861 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:15.862+0000 7f5486fb29c0 20 zone default found 2024-09-14T11:38:15.861 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:15.862+0000 7f5486fb29c0 4 Realm: () 2024-09-14T11:38:15.861 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:15.862+0000 7f5486fb29c0 4 ZoneGroup: default (65ab941b-da8c-4160-94fb-3672b069d44f) 2024-09-14T11:38:15.861 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:15.862+0000 7f5486fb29c0 4 Zone: default (d9e72d30-c60b-4d0d-9267-fdc36392d5ad) 2024-09-14T11:38:15.862 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:15.862+0000 7f5486fb29c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:38:15.862 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:15.862+0000 7f5486fb29c0 20 zonegroup default 2024-09-14T11:38:15.862 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:15.862+0000 7f5486fb29c0 20 rados->read ofs=0 len=0 2024-09-14T11:38:15.862 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:15.862+0000 7f5486fb29c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:38:15.862 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:15.862+0000 7f5486fb29c0 20 rados->read ofs=0 len=0 2024-09-14T11:38:15.863 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:15.862+0000 7f5486fb29c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:38:15.863 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:15.862+0000 7f5486fb29c0 20 rados->read ofs=0 len=0 2024-09-14T11:38:15.863 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:15.862+0000 7f5486fb29c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:38:15.863 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:15.862+0000 7f5486fb29c0 20 started sync module instance, tier type = 2024-09-14T11:38:15.863 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:15.862+0000 7f5486fb29c0 20 started zone id=d9e72d30-c60b-4d0d-9267-fdc36392d5ad (name=default) with tier type = 2024-09-14T11:38:15.887 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:15.886+0000 7f5486fb29c0 20 add_watcher() i=0 2024-09-14T11:38:15.887 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:15.886+0000 7f5486fb29c0 20 add_watcher() i=1 2024-09-14T11:38:15.887 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:15.886+0000 7f5486fb29c0 20 add_watcher() i=2 2024-09-14T11:38:15.887 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:15.886+0000 7f5486fb29c0 20 add_watcher() i=3 2024-09-14T11:38:15.887 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:15.886+0000 7f5486fb29c0 20 add_watcher() i=4 2024-09-14T11:38:15.887 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:15.886+0000 7f5486fb29c0 20 add_watcher() i=5 2024-09-14T11:38:15.887 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:15.886+0000 7f5486fb29c0 20 add_watcher() i=6 2024-09-14T11:38:15.889 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:15.890+0000 7f5486fb29c0 20 add_watcher() i=7 2024-09-14T11:38:15.889 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:15.890+0000 7f5486fb29c0 2 all 8 watchers are set, enabling cache 2024-09-14T11:38:15.893 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:15.894+0000 7f533afe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:38:15.894 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:15.894+0000 7f5486fb29c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:38:15.894 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:15.894+0000 7f5486fb29c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:38:15.894 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:15.894+0000 7f5486fb29c0 5 note: GC not initialized 2024-09-14T11:38:15.895 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:15.894+0000 7f5339fe3640 20 reqs_thread_entry: start 2024-09-14T11:38:15.895 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:15.894+0000 7f5486fb29c0 20 init_complete bucket index max shards: 11 2024-09-14T11:38:15.895 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:15.894+0000 7f5486fb29c0 20 Filter name: none 2024-09-14T11:38:15.896 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:15.894+0000 7f52ab7fe640 20 reqs_thread_entry: start 2024-09-14T11:38:15.896 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:15.894+0000 7f5486fb29c0 20 rados->read ofs=0 len=0 2024-09-14T11:38:15.897 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:15.898+0000 7f5486fb29c0 20 rados_obj.operate() r=0 bl.length=193 2024-09-14T11:38:15.897 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:15.898+0000 7f5486fb29c0 20 rados->read ofs=0 len=0 2024-09-14T11:38:15.898 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:15.898+0000 7f5486fb29c0 20 rados_obj.operate() r=0 bl.length=447 2024-09-14T11:38:15.899 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:15.898+0000 7f5486fb29c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:38:15.899 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:15.898+0000 7f5486fb29c0 20 rados->read ofs=0 len=0 2024-09-14T11:38:15.900 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:15.902+0000 7f5486fb29c0 20 rados_obj.operate() r=0 bl.length=193 2024-09-14T11:38:15.900 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:15.902+0000 7f5486fb29c0 20 rados->read ofs=0 len=0 2024-09-14T11:38:15.901 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:15.902+0000 7f5486fb29c0 20 rados_obj.operate() r=0 bl.length=447 2024-09-14T11:38:15.901 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:15.902+0000 7f5486fb29c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:38:15.904 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:15.906+0000 7f533afe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:38:15.908 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:15.910+0000 7f5486fb29c0 20 remove_watcher() i=0 2024-09-14T11:38:15.908 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:15.910+0000 7f5486fb29c0 2 removed watcher, disabling cache 2024-09-14T11:38:15.911 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:15.910+0000 7f5486fb29c0 20 remove_watcher() i=1 2024-09-14T11:38:15.913 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:15.914+0000 7f5486fb29c0 20 remove_watcher() i=2 2024-09-14T11:38:15.915 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:15.914+0000 7f5486fb29c0 20 remove_watcher() i=3 2024-09-14T11:38:15.917 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:15.918+0000 7f5486fb29c0 20 remove_watcher() i=4 2024-09-14T11:38:15.919 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:15.918+0000 7f5486fb29c0 20 remove_watcher() i=5 2024-09-14T11:38:15.920 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:15.922+0000 7f5486fb29c0 20 remove_watcher() i=6 2024-09-14T11:38:15.921 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:15.922+0000 7f5486fb29c0 20 remove_watcher() i=7 2024-09-14T11:38:15.936 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-14T11:38:15.937 INFO:tasks.workunit.client.0.smithi138.stderr:BUCKET_STATS: 2024-09-14T11:38:15.937 INFO:tasks.workunit.client.0.smithi138.stderr:bucket: abort-at-logrecord-writes id: d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.36 num_objects: 20 size_kb: 1 num_shards: 11 2024-09-14T11:38:15.937 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-14T11:38:15.938 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:38:15.938 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-14T11:38:15.985 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:38:15.985 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-14T11:38:16.066 INFO:tasks.workunit.client.0.smithi138.stderr:radosgw-admin bucket reshard --bucket abort-at-logrecord-writes --num-shards 12 --rgw-reshard-bucket-lock-duration 30 2024-09-14T11:38:16.102 INFO:tasks.workunit.client.0.smithi138.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:38:16.102 INFO:tasks.workunit.client.0.smithi138.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:38:16.150 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:16.150+0000 7f81d2b3f9c0 20 rados->read ofs=0 len=0 2024-09-14T11:38:16.152 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:16.154+0000 7f81d2b3f9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:38:16.152 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:16.154+0000 7f81d2b3f9c0 20 realm 2024-09-14T11:38:16.152 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:16.154+0000 7f81d2b3f9c0 20 rados->read ofs=0 len=0 2024-09-14T11:38:16.152 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:16.154+0000 7f81d2b3f9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:38:16.153 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:16.154+0000 7f81d2b3f9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:38:16.153 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:16.154+0000 7f81d2b3f9c0 20 rados->read ofs=0 len=0 2024-09-14T11:38:16.153 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:16.154+0000 7f81d2b3f9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:38:16.153 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:16.154+0000 7f81d2b3f9c0 20 rados->read ofs=0 len=0 2024-09-14T11:38:16.154 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:16.154+0000 7f81d2b3f9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:38:16.154 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:16.154+0000 7f81d2b3f9c0 20 rados->read ofs=0 len=0 2024-09-14T11:38:16.155 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:16.154+0000 7f81d2b3f9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:38:16.155 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:16.154+0000 7f81d2b3f9c0 20 searching for the correct realm 2024-09-14T11:38:16.159 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:16.158+0000 7f81d0e46640 0 -- 172.21.15.138:0/3965962169 >> [v2:172.21.15.154:6824/416768175,v1:172.21.15.154:6825/416768175] conn(0x7f81c801a040 msgr2=0x7f81c805ded0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:38:16.166 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:16.166+0000 7f81cfe44640 0 -- 172.21.15.138:0/3965962169 >> [v2:172.21.15.138:6816/326481658,v1:172.21.15.138:6817/326481658] conn(0x7f81c8048d20 msgr2=0x7f81c80680d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-14T11:38:16.382 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:16.382+0000 7f81d2b3f9c0 20 RGWRados::pool_iterate: got zone_info.d9e72d30-c60b-4d0d-9267-fdc36392d5ad 2024-09-14T11:38:16.383 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:16.382+0000 7f81d2b3f9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:38:16.383 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:16.382+0000 7f81d2b3f9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:38:16.383 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:16.382+0000 7f81d2b3f9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:38:16.383 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:16.382+0000 7f81d2b3f9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:38:16.383 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:16.382+0000 7f81d2b3f9c0 20 RGWRados::pool_iterate: got zonegroup_info.65ab941b-da8c-4160-94fb-3672b069d44f 2024-09-14T11:38:16.383 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:16.382+0000 7f81d2b3f9c0 20 rados->read ofs=0 len=0 2024-09-14T11:38:16.383 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:16.382+0000 7f81d2b3f9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:38:16.384 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:16.382+0000 7f81d2b3f9c0 20 rados->read ofs=0 len=0 2024-09-14T11:38:16.384 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:16.386+0000 7f81d2b3f9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:38:16.384 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:16.386+0000 7f81d2b3f9c0 20 rados->read ofs=0 len=0 2024-09-14T11:38:16.385 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:16.386+0000 7f81d2b3f9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:38:16.385 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:16.386+0000 7f81d2b3f9c0 20 zone default found 2024-09-14T11:38:16.385 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:16.386+0000 7f81d2b3f9c0 4 Realm: () 2024-09-14T11:38:16.386 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:16.386+0000 7f81d2b3f9c0 4 ZoneGroup: default (65ab941b-da8c-4160-94fb-3672b069d44f) 2024-09-14T11:38:16.386 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:16.386+0000 7f81d2b3f9c0 4 Zone: default (d9e72d30-c60b-4d0d-9267-fdc36392d5ad) 2024-09-14T11:38:16.386 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:16.386+0000 7f81d2b3f9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:38:16.386 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:16.386+0000 7f81d2b3f9c0 20 zonegroup default 2024-09-14T11:38:16.386 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:16.386+0000 7f81d2b3f9c0 20 rados->read ofs=0 len=0 2024-09-14T11:38:16.386 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:16.386+0000 7f81d2b3f9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:38:16.386 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:16.386+0000 7f81d2b3f9c0 20 rados->read ofs=0 len=0 2024-09-14T11:38:16.387 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:16.386+0000 7f81d2b3f9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:38:16.387 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:16.386+0000 7f81d2b3f9c0 20 rados->read ofs=0 len=0 2024-09-14T11:38:16.388 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:16.390+0000 7f81d2b3f9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:38:16.388 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:16.390+0000 7f81d2b3f9c0 20 started sync module instance, tier type = 2024-09-14T11:38:16.388 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:16.390+0000 7f81d2b3f9c0 20 started zone id=d9e72d30-c60b-4d0d-9267-fdc36392d5ad (name=default) with tier type = 2024-09-14T11:38:16.410 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:16.410+0000 7f81d2b3f9c0 20 add_watcher() i=0 2024-09-14T11:38:16.410 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:16.410+0000 7f81d2b3f9c0 20 add_watcher() i=1 2024-09-14T11:38:16.410 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:16.410+0000 7f81d2b3f9c0 20 add_watcher() i=2 2024-09-14T11:38:16.410 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:16.410+0000 7f81d2b3f9c0 20 add_watcher() i=3 2024-09-14T11:38:16.410 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:16.410+0000 7f81d2b3f9c0 20 add_watcher() i=4 2024-09-14T11:38:16.411 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:16.410+0000 7f81d2b3f9c0 20 add_watcher() i=5 2024-09-14T11:38:16.411 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:16.410+0000 7f81d2b3f9c0 20 add_watcher() i=6 2024-09-14T11:38:16.413 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:16.414+0000 7f81d2b3f9c0 20 add_watcher() i=7 2024-09-14T11:38:16.413 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:16.414+0000 7f81d2b3f9c0 2 all 8 watchers are set, enabling cache 2024-09-14T11:38:16.417 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:16.418+0000 7f8086fdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:38:16.418 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:16.418+0000 7f81d2b3f9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:38:16.418 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:16.418+0000 7f81d2b3f9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:38:16.418 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:16.418+0000 7f81d2b3f9c0 5 note: GC not initialized 2024-09-14T11:38:16.419 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:16.418+0000 7f8085fdb640 20 reqs_thread_entry: start 2024-09-14T11:38:16.419 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:16.418+0000 7f81d2b3f9c0 20 init_complete bucket index max shards: 11 2024-09-14T11:38:16.419 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:16.418+0000 7f81d2b3f9c0 20 Filter name: none 2024-09-14T11:38:16.419 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:16.418+0000 7f7ff77fe640 20 reqs_thread_entry: start 2024-09-14T11:38:16.419 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:16.418+0000 7f81d2b3f9c0 10 cache get: name=default.rgw.meta+root+abort-at-logrecord-writes : miss 2024-09-14T11:38:16.420 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:16.418+0000 7f81d2b3f9c0 20 rados->read ofs=0 len=0 2024-09-14T11:38:16.420 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:16.422+0000 7f81d2b3f9c0 20 rados_obj.operate() r=0 bl.length=193 2024-09-14T11:38:16.420 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:16.422+0000 7f81d2b3f9c0 10 cache put: name=default.rgw.meta+root+abort-at-logrecord-writes info.flags=0x11 2024-09-14T11:38:16.420 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:16.422+0000 7f81d2b3f9c0 10 adding default.rgw.meta+root+abort-at-logrecord-writes to cache LRU end 2024-09-14T11:38:16.421 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:16.422+0000 7f81d2b3f9c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.36 : miss 2024-09-14T11:38:16.421 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:16.422+0000 7f81d2b3f9c0 20 rados->read ofs=0 len=0 2024-09-14T11:38:16.421 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:16.422+0000 7f81d2b3f9c0 20 rados_obj.operate() r=0 bl.length=447 2024-09-14T11:38:16.421 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:16.422+0000 7f81d2b3f9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.36 info.flags=0x17 2024-09-14T11:38:16.421 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:16.422+0000 7f81d2b3f9c0 10 adding default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.36 to cache LRU end 2024-09-14T11:38:16.422 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:16.422+0000 7f81d2b3f9c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:38:16.422 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:16.422+0000 7f81d2b3f9c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:38:16.422 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:16.422+0000 7f81d2b3f9c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.36 2024-09-14T11:38:16.424 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:16.426+0000 7f81d2b3f9c0 0 INFO: RGWReshardLock::lock found lock on abort-at-logrecord-writes:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.36 to be held by another RGW process; skipping for now 2024-09-14T11:38:16.426 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:16.426+0000 7f8086fdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:38:16.431 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:16.430+0000 7f81d2b3f9c0 20 remove_watcher() i=0 2024-09-14T11:38:16.431 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:16.430+0000 7f81d2b3f9c0 2 removed watcher, disabling cache 2024-09-14T11:38:16.434 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:16.434+0000 7f81d2b3f9c0 20 remove_watcher() i=1 2024-09-14T11:38:16.436 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:16.438+0000 7f81d2b3f9c0 20 remove_watcher() i=2 2024-09-14T11:38:16.438 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:16.438+0000 7f81d2b3f9c0 20 remove_watcher() i=3 2024-09-14T11:38:16.440 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:16.442+0000 7f81d2b3f9c0 20 remove_watcher() i=4 2024-09-14T11:38:16.442 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:16.442+0000 7f81d2b3f9c0 20 remove_watcher() i=5 2024-09-14T11:38:16.443 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:16.446+0000 7f81d2b3f9c0 20 remove_watcher() i=6 2024-09-14T11:38:16.445 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:16.446+0000 7f81d2b3f9c0 20 remove_watcher() i=7 2024-09-14T11:38:16.465 INFO:tasks.workunit.client.0.smithi138.stderr:waiting 30 seconds for reshard lock to expire... 2024-09-14T11:38:46.476 INFO:tasks.workunit.client.0.smithi138.stderr:radosgw-admin bucket reshard --bucket abort-at-logrecord-writes --num-shards 12 --rgw-reshard-bucket-lock-duration 30 2024-09-14T11:38:46.513 INFO:tasks.workunit.client.0.smithi138.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:38:46.513 INFO:tasks.workunit.client.0.smithi138.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:38:46.560 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:46.562+0000 7fc1ad10a9c0 20 rados->read ofs=0 len=0 2024-09-14T11:38:46.561 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:46.562+0000 7fc1ad10a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:38:46.561 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:46.562+0000 7fc1ad10a9c0 20 realm 2024-09-14T11:38:46.561 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:46.562+0000 7fc1ad10a9c0 20 rados->read ofs=0 len=0 2024-09-14T11:38:46.562 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:46.562+0000 7fc1ad10a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:38:46.562 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:46.562+0000 7fc1ad10a9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:38:46.562 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:46.562+0000 7fc1ad10a9c0 20 rados->read ofs=0 len=0 2024-09-14T11:38:46.562 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:46.562+0000 7fc1ad10a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:38:46.562 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:46.562+0000 7fc1ad10a9c0 20 rados->read ofs=0 len=0 2024-09-14T11:38:46.564 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:46.566+0000 7fc1ad10a9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:38:46.564 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:46.566+0000 7fc1ad10a9c0 20 rados->read ofs=0 len=0 2024-09-14T11:38:46.565 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:46.566+0000 7fc1ad10a9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:38:46.565 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:46.566+0000 7fc1ad10a9c0 20 searching for the correct realm 2024-09-14T11:38:46.568 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:46.570+0000 7fc1ab411640 0 -- 172.21.15.138:0/3763336175 >> [v2:172.21.15.154:6824/416768175,v1:172.21.15.154:6825/416768175] conn(0x7fc1a40dab60 msgr2=0x7fc1a40ba440 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:38:46.785 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:46.786+0000 7fc1aa40f640 0 -- 172.21.15.138:0/3763336175 >> [v2:172.21.15.138:6816/326481658,v1:172.21.15.138:6817/326481658] conn(0x7fc1a40f4900 msgr2=0x7fc1a40e93f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-14T11:38:47.004 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:47.006+0000 7fc1ad10a9c0 20 RGWRados::pool_iterate: got zone_info.d9e72d30-c60b-4d0d-9267-fdc36392d5ad 2024-09-14T11:38:47.004 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:47.006+0000 7fc1ad10a9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:38:47.004 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:47.006+0000 7fc1ad10a9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:38:47.004 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:47.006+0000 7fc1ad10a9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:38:47.004 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:47.006+0000 7fc1ad10a9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:38:47.004 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:47.006+0000 7fc1ad10a9c0 20 RGWRados::pool_iterate: got zonegroup_info.65ab941b-da8c-4160-94fb-3672b069d44f 2024-09-14T11:38:47.005 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:47.006+0000 7fc1ad10a9c0 20 rados->read ofs=0 len=0 2024-09-14T11:38:47.005 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:47.006+0000 7fc1ad10a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:38:47.005 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:47.006+0000 7fc1ad10a9c0 20 rados->read ofs=0 len=0 2024-09-14T11:38:47.006 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:47.006+0000 7fc1ad10a9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:38:47.006 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:47.006+0000 7fc1ad10a9c0 20 rados->read ofs=0 len=0 2024-09-14T11:38:47.007 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:47.006+0000 7fc1ad10a9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:38:47.007 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:47.006+0000 7fc1ad10a9c0 20 zone default found 2024-09-14T11:38:47.007 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:47.006+0000 7fc1ad10a9c0 4 Realm: () 2024-09-14T11:38:47.007 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:47.006+0000 7fc1ad10a9c0 4 ZoneGroup: default (65ab941b-da8c-4160-94fb-3672b069d44f) 2024-09-14T11:38:47.007 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:47.006+0000 7fc1ad10a9c0 4 Zone: default (d9e72d30-c60b-4d0d-9267-fdc36392d5ad) 2024-09-14T11:38:47.007 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:47.006+0000 7fc1ad10a9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:38:47.007 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:47.006+0000 7fc1ad10a9c0 20 zonegroup default 2024-09-14T11:38:47.008 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:47.006+0000 7fc1ad10a9c0 20 rados->read ofs=0 len=0 2024-09-14T11:38:47.008 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:47.010+0000 7fc1ad10a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:38:47.008 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:47.010+0000 7fc1ad10a9c0 20 rados->read ofs=0 len=0 2024-09-14T11:38:47.009 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:47.010+0000 7fc1ad10a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:38:47.009 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:47.010+0000 7fc1ad10a9c0 20 rados->read ofs=0 len=0 2024-09-14T11:38:47.009 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:47.010+0000 7fc1ad10a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:38:47.009 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:47.010+0000 7fc1ad10a9c0 20 started sync module instance, tier type = 2024-09-14T11:38:47.010 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:47.010+0000 7fc1ad10a9c0 20 started zone id=d9e72d30-c60b-4d0d-9267-fdc36392d5ad (name=default) with tier type = 2024-09-14T11:38:47.034 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:47.034+0000 7fc1ad10a9c0 20 add_watcher() i=0 2024-09-14T11:38:47.034 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:47.034+0000 7fc1ad10a9c0 20 add_watcher() i=1 2024-09-14T11:38:47.034 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:47.034+0000 7fc1ad10a9c0 20 add_watcher() i=2 2024-09-14T11:38:47.034 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:47.034+0000 7fc1ad10a9c0 20 add_watcher() i=3 2024-09-14T11:38:47.034 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:47.034+0000 7fc1ad10a9c0 20 add_watcher() i=4 2024-09-14T11:38:47.034 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:47.034+0000 7fc1ad10a9c0 20 add_watcher() i=5 2024-09-14T11:38:47.034 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:47.034+0000 7fc1ad10a9c0 20 add_watcher() i=6 2024-09-14T11:38:47.036 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:47.038+0000 7fc1ad10a9c0 20 add_watcher() i=7 2024-09-14T11:38:47.036 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:47.038+0000 7fc1ad10a9c0 2 all 8 watchers are set, enabling cache 2024-09-14T11:38:47.041 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:47.042+0000 7fc0617e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:38:47.042 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:47.042+0000 7fc1ad10a9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:38:47.042 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:47.042+0000 7fc1ad10a9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:38:47.042 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:47.042+0000 7fc1ad10a9c0 5 note: GC not initialized 2024-09-14T11:38:47.043 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:47.042+0000 7fbfdbfff640 20 reqs_thread_entry: start 2024-09-14T11:38:47.043 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:47.042+0000 7fc1ad10a9c0 20 init_complete bucket index max shards: 11 2024-09-14T11:38:47.043 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:47.042+0000 7fc1ad10a9c0 20 Filter name: none 2024-09-14T11:38:47.043 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:47.042+0000 7fbfd9ffb640 20 reqs_thread_entry: start 2024-09-14T11:38:47.043 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:47.042+0000 7fc1ad10a9c0 10 cache get: name=default.rgw.meta+root+abort-at-logrecord-writes : miss 2024-09-14T11:38:47.044 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:47.042+0000 7fc1ad10a9c0 20 rados->read ofs=0 len=0 2024-09-14T11:38:47.044 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:47.046+0000 7fc1ad10a9c0 20 rados_obj.operate() r=0 bl.length=193 2024-09-14T11:38:47.045 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:47.046+0000 7fc1ad10a9c0 10 cache put: name=default.rgw.meta+root+abort-at-logrecord-writes info.flags=0x11 2024-09-14T11:38:47.045 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:47.046+0000 7fc1ad10a9c0 10 adding default.rgw.meta+root+abort-at-logrecord-writes to cache LRU end 2024-09-14T11:38:47.045 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:47.046+0000 7fc1ad10a9c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.36 : miss 2024-09-14T11:38:47.045 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:47.046+0000 7fc1ad10a9c0 20 rados->read ofs=0 len=0 2024-09-14T11:38:47.046 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:47.046+0000 7fc1ad10a9c0 20 rados_obj.operate() r=0 bl.length=447 2024-09-14T11:38:47.046 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:47.046+0000 7fc1ad10a9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.36 info.flags=0x17 2024-09-14T11:38:47.046 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:47.046+0000 7fc1ad10a9c0 10 adding default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.36 to cache LRU end 2024-09-14T11:38:47.046 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:47.046+0000 7fc1ad10a9c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:38:47.046 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:47.046+0000 7fc1ad10a9c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:38:47.046 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:47.046+0000 7fc1ad10a9c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.36 2024-09-14T11:38:47.049 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:47.050+0000 7fc1ad10a9c0 10 init_target_layout removing existing target index objects from a previous reshard attempt 2024-09-14T11:38:47.062 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:47.062+0000 7fc1ad10a9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.36 info.flags=0x17 2024-09-14T11:38:47.062 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:47.062+0000 7fc1ad10a9c0 10 moving default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.36 to cache LRU end 2024-09-14T11:38:47.063 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:47.062+0000 7fc1ad10a9c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:38:47.063 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:47.062+0000 7fc1ad10a9c0 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-logrecord-writes:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.36, ofs0, ns] 2024-09-14T11:38:47.063 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:47.062+0000 7fc08dffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366170 cookie 94019552219248 notifier 7692 bl.length()=923 2024-09-14T11:38:47.063 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:47.062+0000 7fc08dffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.36 info.flags=0x17 2024-09-14T11:38:47.063 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:47.062+0000 7fc08dffb640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.36 to cache LRU end 2024-09-14T11:38:47.063 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:47.062+0000 7fc08dffb640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:38:47.065 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:47.066+0000 7fc1ad10a9c0 20 handle_bi_update(): bucket=:abort-at-logrecord-writes[d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.36]): orig_sources= new_sources= 2024-09-14T11:38:47.065 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:47.066+0000 7fc1ad10a9c0 20 handle_bi_update(): bucket=:abort-at-logrecord-writes[d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.36]): potential sources added=[] removed=[] 2024-09-14T11:38:47.066 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:47.066+0000 7fc1ad10a9c0 20 handle_bi_update(): bucket=:abort-at-logrecord-writes[d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.36]): orig_dests= new_dests= 2024-09-14T11:38:47.066 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:47.066+0000 7fc1ad10a9c0 20 handle_bi_update(): bucket=:abort-at-logrecord-writes[d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.36]): potential dests added=[] removed=[] 2024-09-14T11:38:47.075 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:47.074+0000 7fc1ad10a9c0 10 bucket_obj is .dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.36.2.0 2024-09-14T11:38:47.075 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:47.074+0000 7fc1ad10a9c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.36.2.0 2024-09-14T11:38:47.075 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:47.074+0000 7fc1ad10a9c0 10 bucket_obj is .dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.36.2.1 2024-09-14T11:38:47.075 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:47.074+0000 7fc1ad10a9c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.36.2.1 2024-09-14T11:38:47.075 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:47.074+0000 7fc1ad10a9c0 10 bucket_obj is .dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.36.2.2 2024-09-14T11:38:47.075 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:47.074+0000 7fc1ad10a9c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.36.2.2 2024-09-14T11:38:47.075 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:47.074+0000 7fc1ad10a9c0 10 bucket_obj is .dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.36.2.3 2024-09-14T11:38:47.075 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:47.074+0000 7fc1ad10a9c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.36.2.3 2024-09-14T11:38:47.075 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:47.074+0000 7fc1ad10a9c0 10 bucket_obj is .dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.36.2.4 2024-09-14T11:38:47.075 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:47.074+0000 7fc1ad10a9c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.36.2.4 2024-09-14T11:38:47.075 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:47.074+0000 7fc1ad10a9c0 10 bucket_obj is .dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.36.2.5 2024-09-14T11:38:47.075 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:47.074+0000 7fc1ad10a9c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.36.2.5 2024-09-14T11:38:47.076 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:47.074+0000 7fc1ad10a9c0 10 bucket_obj is .dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.36.2.6 2024-09-14T11:38:47.076 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:47.074+0000 7fc1ad10a9c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.36.2.6 2024-09-14T11:38:47.076 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:47.074+0000 7fc1ad10a9c0 10 bucket_obj is .dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.36.2.7 2024-09-14T11:38:47.076 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:47.074+0000 7fc1ad10a9c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.36.2.7 2024-09-14T11:38:47.076 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:47.074+0000 7fc1ad10a9c0 10 bucket_obj is .dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.36.2.8 2024-09-14T11:38:47.076 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:47.074+0000 7fc1ad10a9c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.36.2.8 2024-09-14T11:38:47.076 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:47.074+0000 7fc1ad10a9c0 10 bucket_obj is .dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.36.2.9 2024-09-14T11:38:47.076 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:47.074+0000 7fc1ad10a9c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.36.2.9 2024-09-14T11:38:47.076 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:47.074+0000 7fc1ad10a9c0 10 bucket_obj is .dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.36.2.10 2024-09-14T11:38:47.076 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:47.074+0000 7fc1ad10a9c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.36.2.10 2024-09-14T11:38:47.076 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:47.074+0000 7fc1ad10a9c0 10 bucket_obj is .dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.36.2.11 2024-09-14T11:38:47.076 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:47.074+0000 7fc1ad10a9c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.36.2.11 2024-09-14T11:38:47.076 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:47.074+0000 7fc1ad10a9c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.36.0 2024-09-14T11:38:47.077 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:47.074+0000 7fc1ad10a9c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.36.1 2024-09-14T11:38:47.077 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:47.078+0000 7fc1ad10a9c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.36.2 2024-09-14T11:38:47.077 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:47.078+0000 7fc1ad10a9c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.36.3 2024-09-14T11:38:47.079 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:47.078+0000 7fc1ad10a9c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.36.4 2024-09-14T11:38:47.079 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:47.082+0000 7fc1ad10a9c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.36.5 2024-09-14T11:38:47.080 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:47.082+0000 7fc1ad10a9c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.36.6 2024-09-14T11:38:47.081 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:47.082+0000 7fc1ad10a9c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.36.7 2024-09-14T11:38:47.081 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:47.082+0000 7fc1ad10a9c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.36.8 2024-09-14T11:38:47.082 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:47.082+0000 7fc1ad10a9c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.36.9 2024-09-14T11:38:47.082 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:47.082+0000 7fc1ad10a9c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.36.10 2024-09-14T11:38:47.088 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:47.090+0000 7fc1ad10a9c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.36 : hit (requested=0x17, cached=0x17) 2024-09-14T11:38:47.088 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:47.090+0000 7fc1ad10a9c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.36 2024-09-14T11:38:47.092 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:47.094+0000 7fc1ad10a9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.36 info.flags=0x17 2024-09-14T11:38:47.092 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:47.094+0000 7fc1ad10a9c0 10 moving default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.36 to cache LRU end 2024-09-14T11:38:47.092 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:47.094+0000 7fc1ad10a9c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:38:47.092 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:47.094+0000 7fc1ad10a9c0 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-logrecord-writes:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.36, ofs0, ns] 2024-09-14T11:38:47.092 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:47.094+0000 7fc08e7fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366171 cookie 94019552219248 notifier 7692 bl.length()=923 2024-09-14T11:38:47.092 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:47.094+0000 7fc08e7fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.36 info.flags=0x17 2024-09-14T11:38:47.093 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:47.094+0000 7fc08e7fc640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.36 to cache LRU end 2024-09-14T11:38:47.093 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:47.094+0000 7fc08e7fc640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:38:47.094 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:47.094+0000 7fc1ad10a9c0 20 handle_bi_update(): bucket=:abort-at-logrecord-writes[d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.36]): orig_sources= new_sources= 2024-09-14T11:38:47.095 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:47.094+0000 7fc1ad10a9c0 20 handle_bi_update(): bucket=:abort-at-logrecord-writes[d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.36]): potential sources added=[] removed=[] 2024-09-14T11:38:47.095 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:47.094+0000 7fc1ad10a9c0 20 handle_bi_update(): bucket=:abort-at-logrecord-writes[d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.36]): orig_dests= new_dests= 2024-09-14T11:38:47.095 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:47.094+0000 7fc1ad10a9c0 20 handle_bi_update(): bucket=:abort-at-logrecord-writes[d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.36]): potential dests added=[] removed=[] 2024-09-14T11:38:47.099 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:47.098+0000 7fc1ad10a9c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.36.0 2024-09-14T11:38:47.099 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:47.098+0000 7fc1ad10a9c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.36.1 2024-09-14T11:38:47.100 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:47.102+0000 7fc1ad10a9c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.36.2 2024-09-14T11:38:47.101 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:47.102+0000 7fc1ad10a9c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.36.3 2024-09-14T11:38:47.102 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:47.102+0000 7fc1ad10a9c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.36.4 2024-09-14T11:38:47.102 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:47.102+0000 7fc1ad10a9c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.36.5 2024-09-14T11:38:47.103 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:47.102+0000 7fc1ad10a9c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.36.6 2024-09-14T11:38:47.103 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:47.106+0000 7fc1ad10a9c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.36.7 2024-09-14T11:38:47.104 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:47.106+0000 7fc1ad10a9c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.36.8 2024-09-14T11:38:47.104 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:47.106+0000 7fc1ad10a9c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.36.9 2024-09-14T11:38:47.105 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:47.106+0000 7fc1ad10a9c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.36.10 2024-09-14T11:38:47.105 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:47.106+0000 7fc1ad10a9c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.36 : hit (requested=0x17, cached=0x17) 2024-09-14T11:38:47.105 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:47.106+0000 7fc1ad10a9c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.36 2024-09-14T11:38:47.109 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:47.110+0000 7fc1ad10a9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.36 info.flags=0x17 2024-09-14T11:38:47.109 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:47.110+0000 7fc1ad10a9c0 10 moving default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.36 to cache LRU end 2024-09-14T11:38:47.109 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:47.110+0000 7fc1ad10a9c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:38:47.109 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:47.110+0000 7fc1ad10a9c0 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-logrecord-writes:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.36, ofs0, ns] 2024-09-14T11:38:47.109 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:47.110+0000 7fc08dffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366172 cookie 94019552219248 notifier 7692 bl.length()=891 2024-09-14T11:38:47.109 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:47.110+0000 7fc08dffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.36 info.flags=0x17 2024-09-14T11:38:47.109 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:47.110+0000 7fc08dffb640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.36 to cache LRU end 2024-09-14T11:38:47.110 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:47.110+0000 7fc08dffb640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:38:47.111 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:47.110+0000 7fc1ad10a9c0 20 handle_bi_update(): bucket=:abort-at-logrecord-writes[d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.36]): orig_sources= new_sources= 2024-09-14T11:38:47.111 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:47.110+0000 7fc1ad10a9c0 20 handle_bi_update(): bucket=:abort-at-logrecord-writes[d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.36]): potential sources added=[] removed=[] 2024-09-14T11:38:47.111 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:47.110+0000 7fc1ad10a9c0 20 handle_bi_update(): bucket=:abort-at-logrecord-writes[d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.36]): orig_dests= new_dests= 2024-09-14T11:38:47.112 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:47.110+0000 7fc1ad10a9c0 20 handle_bi_update(): bucket=:abort-at-logrecord-writes[d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.36]): potential dests added=[] removed=[] 2024-09-14T11:38:47.116 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:47.118+0000 7fc1ad10a9c0 1 execute INFO: reshard of bucket "abort-at-logrecord-writes" from 11 shards to 12 shards completed successfully 2024-09-14T11:38:47.120 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:47.122+0000 7fc0617e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:38:47.125 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:47.126+0000 7fc1ad10a9c0 20 remove_watcher() i=0 2024-09-14T11:38:47.125 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:47.126+0000 7fc1ad10a9c0 2 removed watcher, disabling cache 2024-09-14T11:38:47.127 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:47.126+0000 7fc1ad10a9c0 20 remove_watcher() i=1 2024-09-14T11:38:47.129 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:47.130+0000 7fc1ad10a9c0 20 remove_watcher() i=2 2024-09-14T11:38:47.131 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:47.134+0000 7fc1ad10a9c0 20 remove_watcher() i=3 2024-09-14T11:38:47.134 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:47.134+0000 7fc1ad10a9c0 20 remove_watcher() i=4 2024-09-14T11:38:47.135 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:47.138+0000 7fc1ad10a9c0 20 remove_watcher() i=5 2024-09-14T11:38:47.137 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:47.138+0000 7fc1ad10a9c0 20 remove_watcher() i=6 2024-09-14T11:38:47.138 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:47.138+0000 7fc1ad10a9c0 20 remove_watcher() i=7 2024-09-14T11:38:47.157 INFO:tasks.workunit.client.0.smithi138.stderr:radosgw-admin bucket stats --bucket abort-at-logrecord-writes 2024-09-14T11:38:47.186 INFO:tasks.workunit.client.0.smithi138.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:38:47.186 INFO:tasks.workunit.client.0.smithi138.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:38:47.229 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:47.230+0000 7f0d04d6e9c0 20 rados->read ofs=0 len=0 2024-09-14T11:38:47.231 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:47.230+0000 7f0d04d6e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:38:47.231 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:47.230+0000 7f0d04d6e9c0 20 realm 2024-09-14T11:38:47.231 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:47.230+0000 7f0d04d6e9c0 20 rados->read ofs=0 len=0 2024-09-14T11:38:47.231 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:47.230+0000 7f0d04d6e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:38:47.232 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:47.230+0000 7f0d04d6e9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:38:47.232 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:47.230+0000 7f0d04d6e9c0 20 rados->read ofs=0 len=0 2024-09-14T11:38:47.232 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:47.230+0000 7f0d04d6e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:38:47.232 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:47.230+0000 7f0d04d6e9c0 20 rados->read ofs=0 len=0 2024-09-14T11:38:47.233 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:47.234+0000 7f0d04d6e9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:38:47.233 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:47.234+0000 7f0d04d6e9c0 20 rados->read ofs=0 len=0 2024-09-14T11:38:47.234 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:47.234+0000 7f0d04d6e9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:38:47.234 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:47.234+0000 7f0d04d6e9c0 20 searching for the correct realm 2024-09-14T11:38:47.238 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:47.238+0000 7f0d03075640 0 -- 172.21.15.138:0/2425904707 >> [v2:172.21.15.154:6824/416768175,v1:172.21.15.154:6825/416768175] conn(0x7f0cf4018070 msgr2=0x7f0cf4077a80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:38:47.245 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:47.246+0000 7f0d02073640 0 -- 172.21.15.138:0/2425904707 >> [v2:172.21.15.138:6816/326481658,v1:172.21.15.138:6817/326481658] conn(0x7f0cf4073c20 msgr2=0x7f0cf40930b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-14T11:38:47.463 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:47.462+0000 7f0d04d6e9c0 20 RGWRados::pool_iterate: got zone_info.d9e72d30-c60b-4d0d-9267-fdc36392d5ad 2024-09-14T11:38:47.463 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:47.462+0000 7f0d04d6e9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:38:47.463 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:47.462+0000 7f0d04d6e9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:38:47.463 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:47.462+0000 7f0d04d6e9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:38:47.463 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:47.462+0000 7f0d04d6e9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:38:47.463 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:47.462+0000 7f0d04d6e9c0 20 RGWRados::pool_iterate: got zonegroup_info.65ab941b-da8c-4160-94fb-3672b069d44f 2024-09-14T11:38:47.464 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:47.462+0000 7f0d04d6e9c0 20 rados->read ofs=0 len=0 2024-09-14T11:38:47.464 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:47.466+0000 7f0d04d6e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:38:47.464 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:47.466+0000 7f0d04d6e9c0 20 rados->read ofs=0 len=0 2024-09-14T11:38:47.464 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:47.466+0000 7f0d04d6e9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:38:47.465 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:47.466+0000 7f0d04d6e9c0 20 rados->read ofs=0 len=0 2024-09-14T11:38:47.466 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:47.466+0000 7f0d04d6e9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:38:47.466 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:47.466+0000 7f0d04d6e9c0 20 zone default found 2024-09-14T11:38:47.466 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:47.466+0000 7f0d04d6e9c0 4 Realm: () 2024-09-14T11:38:47.466 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:47.466+0000 7f0d04d6e9c0 4 ZoneGroup: default (65ab941b-da8c-4160-94fb-3672b069d44f) 2024-09-14T11:38:47.466 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:47.466+0000 7f0d04d6e9c0 4 Zone: default (d9e72d30-c60b-4d0d-9267-fdc36392d5ad) 2024-09-14T11:38:47.466 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:47.466+0000 7f0d04d6e9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:38:47.466 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:47.466+0000 7f0d04d6e9c0 20 zonegroup default 2024-09-14T11:38:47.466 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:47.466+0000 7f0d04d6e9c0 20 rados->read ofs=0 len=0 2024-09-14T11:38:47.467 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:47.466+0000 7f0d04d6e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:38:47.467 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:47.466+0000 7f0d04d6e9c0 20 rados->read ofs=0 len=0 2024-09-14T11:38:47.467 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:47.466+0000 7f0d04d6e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:38:47.467 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:47.466+0000 7f0d04d6e9c0 20 rados->read ofs=0 len=0 2024-09-14T11:38:47.468 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:47.470+0000 7f0d04d6e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:38:47.468 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:47.470+0000 7f0d04d6e9c0 20 started sync module instance, tier type = 2024-09-14T11:38:47.468 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:47.470+0000 7f0d04d6e9c0 20 started zone id=d9e72d30-c60b-4d0d-9267-fdc36392d5ad (name=default) with tier type = 2024-09-14T11:38:47.491 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:47.490+0000 7f0d04d6e9c0 20 add_watcher() i=0 2024-09-14T11:38:47.491 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:47.490+0000 7f0d04d6e9c0 20 add_watcher() i=1 2024-09-14T11:38:47.491 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:47.490+0000 7f0d04d6e9c0 20 add_watcher() i=2 2024-09-14T11:38:47.491 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:47.490+0000 7f0d04d6e9c0 20 add_watcher() i=3 2024-09-14T11:38:47.491 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:47.490+0000 7f0d04d6e9c0 20 add_watcher() i=4 2024-09-14T11:38:47.492 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:47.490+0000 7f0d04d6e9c0 20 add_watcher() i=5 2024-09-14T11:38:47.492 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:47.490+0000 7f0d04d6e9c0 20 add_watcher() i=6 2024-09-14T11:38:47.493 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:47.494+0000 7f0d04d6e9c0 20 add_watcher() i=7 2024-09-14T11:38:47.494 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:47.494+0000 7f0d04d6e9c0 2 all 8 watchers are set, enabling cache 2024-09-14T11:38:47.498 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:47.498+0000 7f0bb97e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:38:47.499 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:47.498+0000 7f0d04d6e9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:38:47.499 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:47.498+0000 7f0d04d6e9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:38:47.499 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:47.498+0000 7f0d04d6e9c0 5 note: GC not initialized 2024-09-14T11:38:47.499 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:47.498+0000 7f0b33fff640 20 reqs_thread_entry: start 2024-09-14T11:38:47.499 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:47.498+0000 7f0d04d6e9c0 20 init_complete bucket index max shards: 11 2024-09-14T11:38:47.500 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:47.502+0000 7f0d04d6e9c0 20 Filter name: none 2024-09-14T11:38:47.500 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:47.502+0000 7f0b31ffb640 20 reqs_thread_entry: start 2024-09-14T11:38:47.500 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:47.502+0000 7f0d04d6e9c0 20 rados->read ofs=0 len=0 2024-09-14T11:38:47.501 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:47.502+0000 7f0d04d6e9c0 20 rados_obj.operate() r=0 bl.length=193 2024-09-14T11:38:47.501 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:47.502+0000 7f0d04d6e9c0 20 rados->read ofs=0 len=0 2024-09-14T11:38:47.502 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:47.502+0000 7f0d04d6e9c0 20 rados_obj.operate() r=0 bl.length=415 2024-09-14T11:38:47.503 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:47.502+0000 7f0d04d6e9c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:38:47.503 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:47.502+0000 7f0d04d6e9c0 20 rados->read ofs=0 len=0 2024-09-14T11:38:47.503 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:47.502+0000 7f0d04d6e9c0 20 rados_obj.operate() r=0 bl.length=193 2024-09-14T11:38:47.503 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:47.502+0000 7f0d04d6e9c0 20 rados->read ofs=0 len=0 2024-09-14T11:38:47.504 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:47.506+0000 7f0d04d6e9c0 20 rados_obj.operate() r=0 bl.length=415 2024-09-14T11:38:47.504 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:47.506+0000 7f0d04d6e9c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:38:47.508 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:47.510+0000 7f0bb97e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:38:47.513 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:47.514+0000 7f0d04d6e9c0 20 remove_watcher() i=0 2024-09-14T11:38:47.513 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:47.514+0000 7f0d04d6e9c0 2 removed watcher, disabling cache 2024-09-14T11:38:47.515 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:47.514+0000 7f0d04d6e9c0 20 remove_watcher() i=1 2024-09-14T11:38:47.517 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:47.518+0000 7f0d04d6e9c0 20 remove_watcher() i=2 2024-09-14T11:38:47.520 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:47.522+0000 7f0d04d6e9c0 20 remove_watcher() i=3 2024-09-14T11:38:47.522 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:47.522+0000 7f0d04d6e9c0 20 remove_watcher() i=4 2024-09-14T11:38:47.524 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:47.526+0000 7f0d04d6e9c0 20 remove_watcher() i=5 2024-09-14T11:38:47.525 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:47.526+0000 7f0d04d6e9c0 20 remove_watcher() i=6 2024-09-14T11:38:47.527 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:47.526+0000 7f0d04d6e9c0 20 remove_watcher() i=7 2024-09-14T11:38:47.541 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-14T11:38:47.542 INFO:tasks.workunit.client.0.smithi138.stderr:BUCKET_STATS: 2024-09-14T11:38:47.542 INFO:tasks.workunit.client.0.smithi138.stderr:bucket: abort-at-logrecord-writes id: d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.36 num_objects: 19 size_kb: 1 num_shards: 12 2024-09-14T11:38:47.542 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-14T11:38:47.543 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:38:47.543 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-14T11:38:47.569 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:38:47.569 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-14T11:38:48.057 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:38:48.057 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-14T11:38:48.438 INFO:tasks.workunit.client.0.smithi138.stderr:TEST: reshard bucket with EIO injected at change_reshard_state 2024-09-14T11:38:48.438 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-14T11:38:48.441 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:38:48.441 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-14T11:38:48.578 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:38:48.578 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-14T11:38:48.668 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:38:48.668 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-14T11:38:48.772 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:38:48.772 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-14T11:38:48.868 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:38:48.868 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-14T11:38:48.960 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:38:48.960 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-14T11:38:49.055 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:38:49.055 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-14T11:38:49.145 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:38:49.145 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-14T11:38:49.238 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:38:49.238 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-14T11:38:49.334 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:38:49.335 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-14T11:38:49.430 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:38:49.430 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-14T11:38:49.522 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:38:49.522 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-14T11:38:49.614 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:38:49.614 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-14T11:38:49.692 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:38:49.693 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-14T11:38:49.785 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:38:49.785 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-14T11:38:49.886 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:38:49.886 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-14T11:38:49.976 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:38:49.977 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-14T11:38:50.070 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:38:50.070 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-14T11:38:50.149 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:38:50.149 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-14T11:38:50.207 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:38:50.207 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-14T11:38:50.276 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:38:50.276 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-14T11:38:50.369 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:38:50.369 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-14T11:38:50.462 INFO:tasks.workunit.client.0.smithi138.stderr:radosgw-admin bucket stats --bucket error-at-change-reshard-state 2024-09-14T11:38:50.495 INFO:tasks.workunit.client.0.smithi138.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:38:50.495 INFO:tasks.workunit.client.0.smithi138.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:38:50.541 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:50.542+0000 7fb6e37d69c0 20 rados->read ofs=0 len=0 2024-09-14T11:38:50.543 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:50.542+0000 7fb6e37d69c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:38:50.543 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:50.542+0000 7fb6e37d69c0 20 realm 2024-09-14T11:38:50.543 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:50.542+0000 7fb6e37d69c0 20 rados->read ofs=0 len=0 2024-09-14T11:38:50.543 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:50.542+0000 7fb6e37d69c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:38:50.543 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:50.542+0000 7fb6e37d69c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:38:50.543 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:50.542+0000 7fb6e37d69c0 20 rados->read ofs=0 len=0 2024-09-14T11:38:50.543 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:50.542+0000 7fb6e37d69c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:38:50.543 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:50.542+0000 7fb6e37d69c0 20 rados->read ofs=0 len=0 2024-09-14T11:38:50.544 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:50.546+0000 7fb6e37d69c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:38:50.545 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:50.546+0000 7fb6e37d69c0 20 rados->read ofs=0 len=0 2024-09-14T11:38:50.545 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:50.546+0000 7fb6e37d69c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:38:50.545 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:50.546+0000 7fb6e37d69c0 20 searching for the correct realm 2024-09-14T11:38:50.550 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:50.550+0000 7fb6e1add640 0 -- 172.21.15.138:0/2630829471 >> [v2:172.21.15.154:6824/416768175,v1:172.21.15.154:6825/416768175] conn(0x7fb6dc0e4070 msgr2=0x7fb6dc0e4960 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:38:50.557 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:50.558+0000 7fb6d8adb640 0 -- 172.21.15.138:0/2630829471 >> [v2:172.21.15.138:6816/326481658,v1:172.21.15.138:6817/326481658] conn(0x7fb6dc0c0070 msgr2=0x7fb6dc0c0960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-14T11:38:50.775 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:50.774+0000 7fb6e37d69c0 20 RGWRados::pool_iterate: got zone_info.d9e72d30-c60b-4d0d-9267-fdc36392d5ad 2024-09-14T11:38:50.775 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:50.774+0000 7fb6e37d69c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:38:50.775 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:50.774+0000 7fb6e37d69c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:38:50.775 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:50.774+0000 7fb6e37d69c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:38:50.775 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:50.774+0000 7fb6e37d69c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:38:50.775 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:50.774+0000 7fb6e37d69c0 20 RGWRados::pool_iterate: got zonegroup_info.65ab941b-da8c-4160-94fb-3672b069d44f 2024-09-14T11:38:50.775 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:50.774+0000 7fb6e37d69c0 20 rados->read ofs=0 len=0 2024-09-14T11:38:50.775 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:50.774+0000 7fb6e37d69c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:38:50.775 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:50.774+0000 7fb6e37d69c0 20 rados->read ofs=0 len=0 2024-09-14T11:38:50.776 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:50.778+0000 7fb6e37d69c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:38:50.776 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:50.778+0000 7fb6e37d69c0 20 rados->read ofs=0 len=0 2024-09-14T11:38:50.777 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:50.778+0000 7fb6e37d69c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:38:50.778 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:50.778+0000 7fb6e37d69c0 20 zone default found 2024-09-14T11:38:50.778 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:50.778+0000 7fb6e37d69c0 4 Realm: () 2024-09-14T11:38:50.778 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:50.778+0000 7fb6e37d69c0 4 ZoneGroup: default (65ab941b-da8c-4160-94fb-3672b069d44f) 2024-09-14T11:38:50.778 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:50.778+0000 7fb6e37d69c0 4 Zone: default (d9e72d30-c60b-4d0d-9267-fdc36392d5ad) 2024-09-14T11:38:50.778 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:50.778+0000 7fb6e37d69c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:38:50.778 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:50.778+0000 7fb6e37d69c0 20 zonegroup default 2024-09-14T11:38:50.778 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:50.778+0000 7fb6e37d69c0 20 rados->read ofs=0 len=0 2024-09-14T11:38:50.778 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:50.778+0000 7fb6e37d69c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:38:50.778 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:50.778+0000 7fb6e37d69c0 20 rados->read ofs=0 len=0 2024-09-14T11:38:50.779 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:50.778+0000 7fb6e37d69c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:38:50.779 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:50.778+0000 7fb6e37d69c0 20 rados->read ofs=0 len=0 2024-09-14T11:38:50.780 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:50.782+0000 7fb6e37d69c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:38:50.780 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:50.782+0000 7fb6e37d69c0 20 started sync module instance, tier type = 2024-09-14T11:38:50.780 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:50.782+0000 7fb6e37d69c0 20 started zone id=d9e72d30-c60b-4d0d-9267-fdc36392d5ad (name=default) with tier type = 2024-09-14T11:38:50.805 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:50.806+0000 7fb6e37d69c0 20 add_watcher() i=0 2024-09-14T11:38:50.805 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:50.806+0000 7fb6e37d69c0 20 add_watcher() i=1 2024-09-14T11:38:50.805 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:50.806+0000 7fb6e37d69c0 20 add_watcher() i=2 2024-09-14T11:38:50.805 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:50.806+0000 7fb6e37d69c0 20 add_watcher() i=3 2024-09-14T11:38:50.805 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:50.806+0000 7fb6e37d69c0 20 add_watcher() i=4 2024-09-14T11:38:50.805 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:50.806+0000 7fb6e37d69c0 20 add_watcher() i=5 2024-09-14T11:38:50.805 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:50.806+0000 7fb6e37d69c0 20 add_watcher() i=6 2024-09-14T11:38:50.807 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:50.806+0000 7fb6e37d69c0 20 add_watcher() i=7 2024-09-14T11:38:50.807 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:50.806+0000 7fb6e37d69c0 2 all 8 watchers are set, enabling cache 2024-09-14T11:38:50.811 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:50.810+0000 7fb5977e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:38:50.813 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:50.814+0000 7fb6e37d69c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:38:50.813 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:50.814+0000 7fb6e37d69c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:38:50.813 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:50.814+0000 7fb6e37d69c0 5 note: GC not initialized 2024-09-14T11:38:50.814 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:50.814+0000 7fb5967e4640 20 reqs_thread_entry: start 2024-09-14T11:38:50.814 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:50.814+0000 7fb6e37d69c0 20 init_complete bucket index max shards: 11 2024-09-14T11:38:50.814 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:50.814+0000 7fb6e37d69c0 20 Filter name: none 2024-09-14T11:38:50.814 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:50.814+0000 7fb507fff640 20 reqs_thread_entry: start 2024-09-14T11:38:50.815 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:50.814+0000 7fb6e37d69c0 20 rados->read ofs=0 len=0 2024-09-14T11:38:50.816 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:50.818+0000 7fb6e37d69c0 20 rados_obj.operate() r=0 bl.length=197 2024-09-14T11:38:50.816 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:50.818+0000 7fb6e37d69c0 20 rados->read ofs=0 len=0 2024-09-14T11:38:50.817 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:50.818+0000 7fb6e37d69c0 20 rados_obj.operate() r=0 bl.length=419 2024-09-14T11:38:50.817 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:50.818+0000 7fb6e37d69c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:38:50.817 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:50.818+0000 7fb6e37d69c0 20 rados->read ofs=0 len=0 2024-09-14T11:38:50.818 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:50.818+0000 7fb6e37d69c0 20 rados_obj.operate() r=0 bl.length=197 2024-09-14T11:38:50.818 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:50.818+0000 7fb6e37d69c0 20 rados->read ofs=0 len=0 2024-09-14T11:38:50.818 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:50.818+0000 7fb6e37d69c0 20 rados_obj.operate() r=0 bl.length=419 2024-09-14T11:38:50.818 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:50.818+0000 7fb6e37d69c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:38:50.822 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:50.822+0000 7fb5977e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:38:50.827 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:50.826+0000 7fb6e37d69c0 20 remove_watcher() i=0 2024-09-14T11:38:50.827 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:50.826+0000 7fb6e37d69c0 2 removed watcher, disabling cache 2024-09-14T11:38:50.830 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:50.830+0000 7fb6e37d69c0 20 remove_watcher() i=1 2024-09-14T11:38:50.832 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:50.834+0000 7fb6e37d69c0 20 remove_watcher() i=2 2024-09-14T11:38:50.835 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:50.834+0000 7fb6e37d69c0 20 remove_watcher() i=3 2024-09-14T11:38:50.837 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:50.838+0000 7fb6e37d69c0 20 remove_watcher() i=4 2024-09-14T11:38:50.839 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:50.838+0000 7fb6e37d69c0 20 remove_watcher() i=5 2024-09-14T11:38:50.841 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:50.842+0000 7fb6e37d69c0 20 remove_watcher() i=6 2024-09-14T11:38:50.842 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:50.842+0000 7fb6e37d69c0 20 remove_watcher() i=7 2024-09-14T11:38:50.865 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-14T11:38:50.866 INFO:tasks.workunit.client.0.smithi138.stderr:BUCKET_STATS: 2024-09-14T11:38:50.866 INFO:tasks.workunit.client.0.smithi138.stderr:bucket: error-at-change-reshard-state id: d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.37 num_objects: 20 size_kb: 1 num_shards: 11 2024-09-14T11:38:50.866 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-14T11:38:50.866 INFO:tasks.workunit.client.0.smithi138.stderr:radosgw-admin bucket reshard --bucket error-at-change-reshard-state --num-shards 12 --rgw-reshard-bucket-lock-duration 30 --inject-error-at change_reshard_state 2024-09-14T11:38:50.903 INFO:tasks.workunit.client.0.smithi138.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:38:50.903 INFO:tasks.workunit.client.0.smithi138.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:38:50.948 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:50.950+0000 7f60e6b179c0 20 rados->read ofs=0 len=0 2024-09-14T11:38:50.950 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:50.950+0000 7f60e6b179c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:38:50.950 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:50.950+0000 7f60e6b179c0 20 realm 2024-09-14T11:38:50.950 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:50.950+0000 7f60e6b179c0 20 rados->read ofs=0 len=0 2024-09-14T11:38:50.950 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:50.950+0000 7f60e6b179c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:38:50.950 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:50.950+0000 7f60e6b179c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:38:50.950 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:50.950+0000 7f60e6b179c0 20 rados->read ofs=0 len=0 2024-09-14T11:38:50.950 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:50.950+0000 7f60e6b179c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:38:50.950 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:50.950+0000 7f60e6b179c0 20 rados->read ofs=0 len=0 2024-09-14T11:38:50.952 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:50.954+0000 7f60e6b179c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:38:50.952 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:50.954+0000 7f60e6b179c0 20 rados->read ofs=0 len=0 2024-09-14T11:38:50.952 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:50.954+0000 7f60e6b179c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:38:50.953 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:50.954+0000 7f60e6b179c0 20 searching for the correct realm 2024-09-14T11:38:50.956 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:50.958+0000 7f60e4e1e640 0 -- 172.21.15.138:0/3992965339 >> [v2:172.21.15.154:6824/416768175,v1:172.21.15.154:6825/416768175] conn(0x7f60dc0eac00 msgr2=0x7f60dc0e0990 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:38:51.172 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:51.174+0000 7f60e3e1c640 0 -- 172.21.15.138:0/3992965339 >> [v2:172.21.15.138:6816/326481658,v1:172.21.15.138:6817/326481658] conn(0x7f60dc0b78f0 msgr2=0x7f60dc0a9390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-14T11:38:51.391 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:51.390+0000 7f60e6b179c0 20 RGWRados::pool_iterate: got zone_info.d9e72d30-c60b-4d0d-9267-fdc36392d5ad 2024-09-14T11:38:51.391 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:51.390+0000 7f60e6b179c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:38:51.391 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:51.390+0000 7f60e6b179c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:38:51.391 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:51.390+0000 7f60e6b179c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:38:51.392 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:51.390+0000 7f60e6b179c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:38:51.392 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:51.390+0000 7f60e6b179c0 20 RGWRados::pool_iterate: got zonegroup_info.65ab941b-da8c-4160-94fb-3672b069d44f 2024-09-14T11:38:51.392 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:51.390+0000 7f60e6b179c0 20 rados->read ofs=0 len=0 2024-09-14T11:38:51.392 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:51.394+0000 7f60e6b179c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:38:51.392 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:51.394+0000 7f60e6b179c0 20 rados->read ofs=0 len=0 2024-09-14T11:38:51.393 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:51.394+0000 7f60e6b179c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:38:51.393 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:51.394+0000 7f60e6b179c0 20 rados->read ofs=0 len=0 2024-09-14T11:38:51.394 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:51.394+0000 7f60e6b179c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:38:51.394 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:51.394+0000 7f60e6b179c0 20 zone default found 2024-09-14T11:38:51.394 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:51.394+0000 7f60e6b179c0 4 Realm: () 2024-09-14T11:38:51.395 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:51.394+0000 7f60e6b179c0 4 ZoneGroup: default (65ab941b-da8c-4160-94fb-3672b069d44f) 2024-09-14T11:38:51.395 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:51.394+0000 7f60e6b179c0 4 Zone: default (d9e72d30-c60b-4d0d-9267-fdc36392d5ad) 2024-09-14T11:38:51.395 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:51.394+0000 7f60e6b179c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:38:51.395 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:51.394+0000 7f60e6b179c0 20 zonegroup default 2024-09-14T11:38:51.395 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:51.394+0000 7f60e6b179c0 20 rados->read ofs=0 len=0 2024-09-14T11:38:51.395 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:51.394+0000 7f60e6b179c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:38:51.395 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:51.394+0000 7f60e6b179c0 20 rados->read ofs=0 len=0 2024-09-14T11:38:51.396 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:51.398+0000 7f60e6b179c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:38:51.396 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:51.398+0000 7f60e6b179c0 20 rados->read ofs=0 len=0 2024-09-14T11:38:51.397 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:51.398+0000 7f60e6b179c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:38:51.397 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:51.398+0000 7f60e6b179c0 20 started sync module instance, tier type = 2024-09-14T11:38:51.397 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:51.398+0000 7f60e6b179c0 20 started zone id=d9e72d30-c60b-4d0d-9267-fdc36392d5ad (name=default) with tier type = 2024-09-14T11:38:51.418 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:51.418+0000 7f60e6b179c0 20 add_watcher() i=0 2024-09-14T11:38:51.418 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:51.418+0000 7f60e6b179c0 20 add_watcher() i=1 2024-09-14T11:38:51.418 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:51.418+0000 7f60e6b179c0 20 add_watcher() i=2 2024-09-14T11:38:51.418 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:51.418+0000 7f60e6b179c0 20 add_watcher() i=3 2024-09-14T11:38:51.419 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:51.418+0000 7f60e6b179c0 20 add_watcher() i=4 2024-09-14T11:38:51.419 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:51.418+0000 7f60e6b179c0 20 add_watcher() i=5 2024-09-14T11:38:51.419 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:51.418+0000 7f60e6b179c0 20 add_watcher() i=6 2024-09-14T11:38:51.420 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:51.422+0000 7f60e6b179c0 20 add_watcher() i=7 2024-09-14T11:38:51.420 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:51.422+0000 7f60e6b179c0 2 all 8 watchers are set, enabling cache 2024-09-14T11:38:51.424 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:51.426+0000 7f5f9a7e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:38:51.425 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:51.426+0000 7f60e6b179c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:38:51.425 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:51.426+0000 7f60e6b179c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:38:51.425 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:51.426+0000 7f60e6b179c0 5 note: GC not initialized 2024-09-14T11:38:51.426 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:51.426+0000 7f5f997e2640 20 reqs_thread_entry: start 2024-09-14T11:38:51.426 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:51.426+0000 7f60e6b179c0 20 init_complete bucket index max shards: 11 2024-09-14T11:38:51.426 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:51.426+0000 7f60e6b179c0 20 Filter name: none 2024-09-14T11:38:51.427 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:51.426+0000 7f5f0affd640 20 reqs_thread_entry: start 2024-09-14T11:38:51.427 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:51.426+0000 7f60e6b179c0 10 cache get: name=default.rgw.meta+root+error-at-change-reshard-state : miss 2024-09-14T11:38:51.427 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:51.426+0000 7f60e6b179c0 20 rados->read ofs=0 len=0 2024-09-14T11:38:51.427 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:51.426+0000 7f60e6b179c0 20 rados_obj.operate() r=0 bl.length=197 2024-09-14T11:38:51.428 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:51.430+0000 7f60e6b179c0 10 cache put: name=default.rgw.meta+root+error-at-change-reshard-state info.flags=0x11 2024-09-14T11:38:51.428 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:51.430+0000 7f60e6b179c0 10 adding default.rgw.meta+root+error-at-change-reshard-state to cache LRU end 2024-09-14T11:38:51.428 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:51.430+0000 7f60e6b179c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.37 : miss 2024-09-14T11:38:51.428 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:51.430+0000 7f60e6b179c0 20 rados->read ofs=0 len=0 2024-09-14T11:38:51.428 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:51.430+0000 7f60e6b179c0 20 rados_obj.operate() r=0 bl.length=419 2024-09-14T11:38:51.428 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:51.430+0000 7f60e6b179c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.37 info.flags=0x17 2024-09-14T11:38:51.428 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:51.430+0000 7f60e6b179c0 10 adding default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.37 to cache LRU end 2024-09-14T11:38:51.429 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:51.430+0000 7f60e6b179c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:38:51.429 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:51.430+0000 7f60e6b179c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:38:51.429 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:51.430+0000 7f60e6b179c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.37 2024-09-14T11:38:51.440 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:51.442+0000 7f60e6b179c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.37 info.flags=0x17 2024-09-14T11:38:51.440 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:51.442+0000 7f60e6b179c0 10 moving default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.37 to cache LRU end 2024-09-14T11:38:51.440 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:51.442+0000 7f60e6b179c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:38:51.440 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:51.442+0000 7f60e6b179c0 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-change-reshard-state:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.37, ofs0, ns] 2024-09-14T11:38:51.440 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:51.442+0000 7f5fbb7fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366228 cookie 94634262509408 notifier 7250 bl.length()=931 2024-09-14T11:38:51.440 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:51.442+0000 7f5fbb7fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.37 info.flags=0x17 2024-09-14T11:38:51.440 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:51.442+0000 7f5fbb7fe640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.37 to cache LRU end 2024-09-14T11:38:51.440 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:51.442+0000 7f5fbb7fe640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:38:51.443 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:51.442+0000 7f60e6b179c0 20 handle_bi_update(): bucket=:error-at-change-reshard-state[d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.37]): orig_sources= new_sources= 2024-09-14T11:38:51.444 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:51.442+0000 7f60e6b179c0 20 handle_bi_update(): bucket=:error-at-change-reshard-state[d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.37]): potential sources added=[] removed=[] 2024-09-14T11:38:51.444 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:51.442+0000 7f60e6b179c0 20 handle_bi_update(): bucket=:error-at-change-reshard-state[d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.37]): orig_dests= new_dests= 2024-09-14T11:38:51.444 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:51.442+0000 7f60e6b179c0 20 handle_bi_update(): bucket=:error-at-change-reshard-state[d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.37]): potential dests added=[] removed=[] 2024-09-14T11:38:51.455 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:51.454+0000 7f60e6b179c0 10 bucket_obj is .dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.37.1.0 2024-09-14T11:38:51.455 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:51.454+0000 7f60e6b179c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.37.1.0 2024-09-14T11:38:51.455 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:51.454+0000 7f60e6b179c0 10 bucket_obj is .dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.37.1.1 2024-09-14T11:38:51.455 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:51.454+0000 7f60e6b179c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.37.1.1 2024-09-14T11:38:51.455 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:51.454+0000 7f60e6b179c0 10 bucket_obj is .dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.37.1.2 2024-09-14T11:38:51.455 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:51.454+0000 7f60e6b179c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.37.1.2 2024-09-14T11:38:51.455 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:51.454+0000 7f60e6b179c0 10 bucket_obj is .dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.37.1.3 2024-09-14T11:38:51.455 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:51.454+0000 7f60e6b179c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.37.1.3 2024-09-14T11:38:51.455 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:51.454+0000 7f60e6b179c0 10 bucket_obj is .dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.37.1.4 2024-09-14T11:38:51.455 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:51.454+0000 7f60e6b179c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.37.1.4 2024-09-14T11:38:51.455 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:51.454+0000 7f60e6b179c0 10 bucket_obj is .dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.37.1.5 2024-09-14T11:38:51.455 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:51.454+0000 7f60e6b179c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.37.1.5 2024-09-14T11:38:51.456 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:51.454+0000 7f60e6b179c0 10 bucket_obj is .dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.37.1.6 2024-09-14T11:38:51.456 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:51.454+0000 7f60e6b179c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.37.1.6 2024-09-14T11:38:51.456 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:51.454+0000 7f60e6b179c0 10 bucket_obj is .dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.37.1.7 2024-09-14T11:38:51.456 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:51.454+0000 7f60e6b179c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.37.1.7 2024-09-14T11:38:51.456 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:51.454+0000 7f60e6b179c0 10 bucket_obj is .dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.37.1.8 2024-09-14T11:38:51.456 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:51.454+0000 7f60e6b179c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.37.1.8 2024-09-14T11:38:51.456 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:51.454+0000 7f60e6b179c0 10 bucket_obj is .dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.37.1.9 2024-09-14T11:38:51.456 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:51.454+0000 7f60e6b179c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.37.1.9 2024-09-14T11:38:51.456 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:51.454+0000 7f60e6b179c0 10 bucket_obj is .dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.37.1.10 2024-09-14T11:38:51.456 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:51.454+0000 7f60e6b179c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.37.1.10 2024-09-14T11:38:51.456 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:51.454+0000 7f60e6b179c0 10 bucket_obj is .dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.37.1.11 2024-09-14T11:38:51.456 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:51.454+0000 7f60e6b179c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.37.1.11 2024-09-14T11:38:51.456 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:51.454+0000 7f60e6b179c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.37.0 2024-09-14T11:38:51.457 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:51.454+0000 7f60e6b179c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.37.1 2024-09-14T11:38:51.457 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:51.458+0000 7f60e6b179c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.37.2 2024-09-14T11:38:51.457 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:51.458+0000 7f60e6b179c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.37.3 2024-09-14T11:38:51.457 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:51.458+0000 7f60e6b179c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.37.4 2024-09-14T11:38:51.458 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:51.458+0000 7f60e6b179c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.37.5 2024-09-14T11:38:51.459 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:51.458+0000 7f60e6b179c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.37.6 2024-09-14T11:38:51.460 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:51.462+0000 7f60e6b179c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.37.7 2024-09-14T11:38:51.462 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:51.462+0000 7f60e6b179c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.37.8 2024-09-14T11:38:51.463 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:51.462+0000 7f60e6b179c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.37.9 2024-09-14T11:38:51.464 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:51.466+0000 7f60e6b179c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.37.10 2024-09-14T11:38:51.472 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:51.474+0000 7f60e6b179c0 -1 Injecting error=-5 at location=change_reshard_state 2024-09-14T11:38:51.472 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:51.474+0000 7f60e6b179c0 0 ERROR: change_reshard_state failed to commit target index layout: (5) Input/output error 2024-09-14T11:38:51.497 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:51.498+0000 7f60e6b179c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.37 : hit (requested=0x17, cached=0x17) 2024-09-14T11:38:51.497 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:51.498+0000 7f60e6b179c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.37 2024-09-14T11:38:51.498 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:51.498+0000 7f60e6b179c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.37 info.flags=0x17 2024-09-14T11:38:51.499 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:51.498+0000 7f60e6b179c0 10 moving default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.37 to cache LRU end 2024-09-14T11:38:51.499 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:51.498+0000 7f60e6b179c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:38:51.499 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:51.498+0000 7f60e6b179c0 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-change-reshard-state:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.37, ofs0, ns] 2024-09-14T11:38:51.499 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:51.498+0000 7f5fbb7fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366229 cookie 94634262509408 notifier 7250 bl.length()=899 2024-09-14T11:38:51.499 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:51.498+0000 7f5fbb7fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.37 info.flags=0x17 2024-09-14T11:38:51.499 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:51.498+0000 7f5fbb7fe640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.37 to cache LRU end 2024-09-14T11:38:51.499 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:51.498+0000 7f5fbb7fe640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:38:51.502 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:51.502+0000 7f60e6b179c0 20 handle_bi_update(): bucket=:error-at-change-reshard-state[d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.37]): orig_sources= new_sources= 2024-09-14T11:38:51.502 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:51.502+0000 7f60e6b179c0 20 handle_bi_update(): bucket=:error-at-change-reshard-state[d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.37]): potential sources added=[] removed=[] 2024-09-14T11:38:51.502 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:51.502+0000 7f60e6b179c0 20 handle_bi_update(): bucket=:error-at-change-reshard-state[d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.37]): orig_dests= new_dests= 2024-09-14T11:38:51.502 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:51.502+0000 7f60e6b179c0 20 handle_bi_update(): bucket=:error-at-change-reshard-state[d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.37]): potential dests added=[] removed=[] 2024-09-14T11:38:51.502 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:51.502+0000 7f60e6b179c0 1 execute INFO: reshard of bucket "error-at-change-reshard-state" canceled due to errors 2024-09-14T11:38:51.506 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:51.506+0000 7f5f9a7e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:38:51.514 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:51.514+0000 7f60e6b179c0 20 remove_watcher() i=0 2024-09-14T11:38:51.514 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:51.514+0000 7f60e6b179c0 2 removed watcher, disabling cache 2024-09-14T11:38:51.516 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:51.518+0000 7f60e6b179c0 20 remove_watcher() i=1 2024-09-14T11:38:51.518 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:51.518+0000 7f60e6b179c0 20 remove_watcher() i=2 2024-09-14T11:38:51.520 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:51.522+0000 7f60e6b179c0 20 remove_watcher() i=3 2024-09-14T11:38:51.522 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:51.522+0000 7f60e6b179c0 20 remove_watcher() i=4 2024-09-14T11:38:51.524 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:51.526+0000 7f60e6b179c0 20 remove_watcher() i=5 2024-09-14T11:38:51.525 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:51.526+0000 7f60e6b179c0 20 remove_watcher() i=6 2024-09-14T11:38:51.526 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:51.526+0000 7f60e6b179c0 20 remove_watcher() i=7 2024-09-14T11:38:51.546 INFO:tasks.workunit.client.0.smithi138.stderr:radosgw-admin bucket stats --bucket error-at-change-reshard-state 2024-09-14T11:38:51.574 INFO:tasks.workunit.client.0.smithi138.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:38:51.574 INFO:tasks.workunit.client.0.smithi138.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:38:51.619 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:51.618+0000 7fbc1dcf89c0 20 rados->read ofs=0 len=0 2024-09-14T11:38:51.622 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:51.622+0000 7fbc1dcf89c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:38:51.622 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:51.622+0000 7fbc1dcf89c0 20 realm 2024-09-14T11:38:51.622 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:51.622+0000 7fbc1dcf89c0 20 rados->read ofs=0 len=0 2024-09-14T11:38:51.622 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:51.622+0000 7fbc1dcf89c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:38:51.622 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:51.622+0000 7fbc1dcf89c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:38:51.622 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:51.622+0000 7fbc1dcf89c0 20 rados->read ofs=0 len=0 2024-09-14T11:38:51.622 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:51.622+0000 7fbc1dcf89c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:38:51.622 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:51.622+0000 7fbc1dcf89c0 20 rados->read ofs=0 len=0 2024-09-14T11:38:51.624 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:51.626+0000 7fbc1dcf89c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:38:51.624 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:51.626+0000 7fbc1dcf89c0 20 rados->read ofs=0 len=0 2024-09-14T11:38:51.625 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:51.626+0000 7fbc1dcf89c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:38:51.625 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:51.626+0000 7fbc1dcf89c0 20 searching for the correct realm 2024-09-14T11:38:51.629 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:51.630+0000 7fbc1bfff640 0 -- 172.21.15.138:0/1452499664 >> [v2:172.21.15.154:6824/416768175,v1:172.21.15.154:6825/416768175] conn(0x7fbc1400f940 msgr2=0x7fbc14025410 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:38:51.635 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:51.634+0000 7fbc1affd640 0 -- 172.21.15.138:0/1452499664 >> [v2:172.21.15.138:6816/326481658,v1:172.21.15.138:6817/326481658] conn(0x7fbc1403f420 msgr2=0x7fbc1403f880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:38:51.851 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:51.850+0000 7fbc1dcf89c0 20 RGWRados::pool_iterate: got zone_info.d9e72d30-c60b-4d0d-9267-fdc36392d5ad 2024-09-14T11:38:51.852 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:51.850+0000 7fbc1dcf89c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:38:51.852 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:51.850+0000 7fbc1dcf89c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:38:51.852 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:51.850+0000 7fbc1dcf89c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:38:51.852 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:51.850+0000 7fbc1dcf89c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:38:51.852 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:51.850+0000 7fbc1dcf89c0 20 RGWRados::pool_iterate: got zonegroup_info.65ab941b-da8c-4160-94fb-3672b069d44f 2024-09-14T11:38:51.852 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:51.850+0000 7fbc1dcf89c0 20 rados->read ofs=0 len=0 2024-09-14T11:38:51.852 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:51.854+0000 7fbc1dcf89c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:38:51.852 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:51.854+0000 7fbc1dcf89c0 20 rados->read ofs=0 len=0 2024-09-14T11:38:51.853 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:51.854+0000 7fbc1dcf89c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:38:51.853 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:51.854+0000 7fbc1dcf89c0 20 rados->read ofs=0 len=0 2024-09-14T11:38:51.854 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:51.854+0000 7fbc1dcf89c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:38:51.854 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:51.854+0000 7fbc1dcf89c0 20 zone default found 2024-09-14T11:38:51.854 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:51.854+0000 7fbc1dcf89c0 4 Realm: () 2024-09-14T11:38:51.854 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:51.854+0000 7fbc1dcf89c0 4 ZoneGroup: default (65ab941b-da8c-4160-94fb-3672b069d44f) 2024-09-14T11:38:51.854 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:51.854+0000 7fbc1dcf89c0 4 Zone: default (d9e72d30-c60b-4d0d-9267-fdc36392d5ad) 2024-09-14T11:38:51.854 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:51.854+0000 7fbc1dcf89c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:38:51.854 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:51.854+0000 7fbc1dcf89c0 20 zonegroup default 2024-09-14T11:38:51.854 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:51.854+0000 7fbc1dcf89c0 20 rados->read ofs=0 len=0 2024-09-14T11:38:51.854 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:51.854+0000 7fbc1dcf89c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:38:51.855 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:51.854+0000 7fbc1dcf89c0 20 rados->read ofs=0 len=0 2024-09-14T11:38:51.855 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:51.854+0000 7fbc1dcf89c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:38:51.855 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:51.854+0000 7fbc1dcf89c0 20 rados->read ofs=0 len=0 2024-09-14T11:38:51.856 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:51.858+0000 7fbc1dcf89c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:38:51.856 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:51.858+0000 7fbc1dcf89c0 20 started sync module instance, tier type = 2024-09-14T11:38:51.856 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:51.858+0000 7fbc1dcf89c0 20 started zone id=d9e72d30-c60b-4d0d-9267-fdc36392d5ad (name=default) with tier type = 2024-09-14T11:38:51.880 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:51.878+0000 7fbc1dcf89c0 20 add_watcher() i=0 2024-09-14T11:38:51.880 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:51.878+0000 7fbc1dcf89c0 20 add_watcher() i=1 2024-09-14T11:38:51.880 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:51.878+0000 7fbc1dcf89c0 20 add_watcher() i=2 2024-09-14T11:38:51.880 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:51.878+0000 7fbc1dcf89c0 20 add_watcher() i=3 2024-09-14T11:38:51.880 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:51.878+0000 7fbc1dcf89c0 20 add_watcher() i=4 2024-09-14T11:38:51.880 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:51.878+0000 7fbc1dcf89c0 20 add_watcher() i=5 2024-09-14T11:38:51.880 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:51.882+0000 7fbc1dcf89c0 20 add_watcher() i=6 2024-09-14T11:38:51.882 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:51.882+0000 7fbc1dcf89c0 20 add_watcher() i=7 2024-09-14T11:38:51.882 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:51.882+0000 7fbc1dcf89c0 2 all 8 watchers are set, enabling cache 2024-09-14T11:38:51.886 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:51.886+0000 7fbad1fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:38:51.887 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:51.886+0000 7fbc1dcf89c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:38:51.888 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:51.886+0000 7fbc1dcf89c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:38:51.888 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:51.886+0000 7fbc1dcf89c0 5 note: GC not initialized 2024-09-14T11:38:51.888 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:51.890+0000 7fbad0fe1640 20 reqs_thread_entry: start 2024-09-14T11:38:51.889 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:51.890+0000 7fbc1dcf89c0 20 init_complete bucket index max shards: 11 2024-09-14T11:38:51.889 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:51.890+0000 7fbc1dcf89c0 20 Filter name: none 2024-09-14T11:38:51.889 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:51.890+0000 7fba4a7fc640 20 reqs_thread_entry: start 2024-09-14T11:38:51.889 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:51.890+0000 7fbc1dcf89c0 20 rados->read ofs=0 len=0 2024-09-14T11:38:51.890 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:51.890+0000 7fbc1dcf89c0 20 rados_obj.operate() r=0 bl.length=197 2024-09-14T11:38:51.890 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:51.890+0000 7fbc1dcf89c0 20 rados->read ofs=0 len=0 2024-09-14T11:38:51.891 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:51.890+0000 7fbc1dcf89c0 20 rados_obj.operate() r=0 bl.length=419 2024-09-14T11:38:51.891 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:51.890+0000 7fbc1dcf89c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:38:51.891 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:51.890+0000 7fbc1dcf89c0 20 rados->read ofs=0 len=0 2024-09-14T11:38:51.892 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:51.894+0000 7fbc1dcf89c0 20 rados_obj.operate() r=0 bl.length=197 2024-09-14T11:38:51.892 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:51.894+0000 7fbc1dcf89c0 20 rados->read ofs=0 len=0 2024-09-14T11:38:51.892 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:51.894+0000 7fbc1dcf89c0 20 rados_obj.operate() r=0 bl.length=419 2024-09-14T11:38:51.892 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:51.894+0000 7fbc1dcf89c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:38:51.896 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:51.898+0000 7fbad1fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:38:51.901 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:51.902+0000 7fbc1dcf89c0 20 remove_watcher() i=0 2024-09-14T11:38:51.901 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:51.902+0000 7fbc1dcf89c0 2 removed watcher, disabling cache 2024-09-14T11:38:51.903 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:51.902+0000 7fbc1dcf89c0 20 remove_watcher() i=1 2024-09-14T11:38:51.906 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:51.906+0000 7fbc1dcf89c0 20 remove_watcher() i=2 2024-09-14T11:38:51.908 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:51.910+0000 7fbc1dcf89c0 20 remove_watcher() i=3 2024-09-14T11:38:51.910 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:51.910+0000 7fbc1dcf89c0 20 remove_watcher() i=4 2024-09-14T11:38:51.912 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:51.914+0000 7fbc1dcf89c0 20 remove_watcher() i=5 2024-09-14T11:38:51.914 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:51.914+0000 7fbc1dcf89c0 20 remove_watcher() i=6 2024-09-14T11:38:51.915 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:51.914+0000 7fbc1dcf89c0 20 remove_watcher() i=7 2024-09-14T11:38:51.930 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-14T11:38:51.931 INFO:tasks.workunit.client.0.smithi138.stderr:BUCKET_STATS: 2024-09-14T11:38:51.931 INFO:tasks.workunit.client.0.smithi138.stderr:bucket: error-at-change-reshard-state id: d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.37 num_objects: 20 size_kb: 1 num_shards: 11 2024-09-14T11:38:51.931 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-14T11:38:51.932 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:38:51.932 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-14T11:38:51.969 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:38:51.969 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-14T11:38:52.029 INFO:tasks.workunit.client.0.smithi138.stderr:radosgw-admin bucket reshard --bucket error-at-change-reshard-state --num-shards 12 --rgw-reshard-bucket-lock-duration 30 2024-09-14T11:38:52.065 INFO:tasks.workunit.client.0.smithi138.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:38:52.065 INFO:tasks.workunit.client.0.smithi138.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:38:52.108 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:52.110+0000 7f4bd93ec9c0 20 rados->read ofs=0 len=0 2024-09-14T11:38:52.110 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:52.110+0000 7f4bd93ec9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:38:52.110 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:52.110+0000 7f4bd93ec9c0 20 realm 2024-09-14T11:38:52.110 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:52.110+0000 7f4bd93ec9c0 20 rados->read ofs=0 len=0 2024-09-14T11:38:52.111 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:52.110+0000 7f4bd93ec9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:38:52.111 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:52.110+0000 7f4bd93ec9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:38:52.111 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:52.110+0000 7f4bd93ec9c0 20 rados->read ofs=0 len=0 2024-09-14T11:38:52.111 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:52.110+0000 7f4bd93ec9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:38:52.111 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:52.110+0000 7f4bd93ec9c0 20 rados->read ofs=0 len=0 2024-09-14T11:38:52.112 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:52.114+0000 7f4bd93ec9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:38:52.112 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:52.114+0000 7f4bd93ec9c0 20 rados->read ofs=0 len=0 2024-09-14T11:38:52.113 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:52.114+0000 7f4bd93ec9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:38:52.113 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:52.114+0000 7f4bd93ec9c0 20 searching for the correct realm 2024-09-14T11:38:52.114 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:52.114+0000 7f4bd66f1640 0 -- 172.21.15.138:0/1716567227 >> [v2:172.21.15.154:6808/1468088432,v1:172.21.15.154:6809/1468088432] conn(0x7f4bc8018040 msgr2=0x7f4bc8018930 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-14T11:38:52.326 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:52.326+0000 7f4bd76f3640 0 -- 172.21.15.138:0/1716567227 >> [v2:172.21.15.138:6824/2633984942,v1:172.21.15.138:6825/2633984942] conn(0x555670732eb0 msgr2=0x5556707352c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:38:52.343 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:52.342+0000 7f4bd93ec9c0 20 RGWRados::pool_iterate: got zone_info.d9e72d30-c60b-4d0d-9267-fdc36392d5ad 2024-09-14T11:38:52.343 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:52.342+0000 7f4bd93ec9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:38:52.343 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:52.342+0000 7f4bd93ec9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:38:52.343 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:52.342+0000 7f4bd93ec9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:38:52.343 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:52.342+0000 7f4bd93ec9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:38:52.343 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:52.342+0000 7f4bd93ec9c0 20 RGWRados::pool_iterate: got zonegroup_info.65ab941b-da8c-4160-94fb-3672b069d44f 2024-09-14T11:38:52.343 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:52.342+0000 7f4bd93ec9c0 20 rados->read ofs=0 len=0 2024-09-14T11:38:52.344 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:52.342+0000 7f4bd93ec9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:38:52.344 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:52.342+0000 7f4bd93ec9c0 20 rados->read ofs=0 len=0 2024-09-14T11:38:52.344 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:52.346+0000 7f4bd93ec9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:38:52.344 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:52.346+0000 7f4bd93ec9c0 20 rados->read ofs=0 len=0 2024-09-14T11:38:52.345 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:52.346+0000 7f4bd93ec9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:38:52.345 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:52.346+0000 7f4bd93ec9c0 20 zone default found 2024-09-14T11:38:52.345 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:52.346+0000 7f4bd93ec9c0 4 Realm: () 2024-09-14T11:38:52.345 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:52.346+0000 7f4bd93ec9c0 4 ZoneGroup: default (65ab941b-da8c-4160-94fb-3672b069d44f) 2024-09-14T11:38:52.345 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:52.346+0000 7f4bd93ec9c0 4 Zone: default (d9e72d30-c60b-4d0d-9267-fdc36392d5ad) 2024-09-14T11:38:52.345 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:52.346+0000 7f4bd93ec9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:38:52.346 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:52.346+0000 7f4bd93ec9c0 20 zonegroup default 2024-09-14T11:38:52.346 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:52.346+0000 7f4bd93ec9c0 20 rados->read ofs=0 len=0 2024-09-14T11:38:52.346 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:52.346+0000 7f4bd93ec9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:38:52.346 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:52.346+0000 7f4bd93ec9c0 20 rados->read ofs=0 len=0 2024-09-14T11:38:52.346 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:52.346+0000 7f4bd93ec9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:38:52.347 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:52.346+0000 7f4bd93ec9c0 20 rados->read ofs=0 len=0 2024-09-14T11:38:52.347 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:52.346+0000 7f4bd93ec9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:38:52.347 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:52.346+0000 7f4bd93ec9c0 20 started sync module instance, tier type = 2024-09-14T11:38:52.347 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:52.346+0000 7f4bd93ec9c0 20 started zone id=d9e72d30-c60b-4d0d-9267-fdc36392d5ad (name=default) with tier type = 2024-09-14T11:38:52.368 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:52.370+0000 7f4bd93ec9c0 20 add_watcher() i=0 2024-09-14T11:38:52.369 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:52.370+0000 7f4bd93ec9c0 20 add_watcher() i=1 2024-09-14T11:38:52.369 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:52.370+0000 7f4bd93ec9c0 20 add_watcher() i=2 2024-09-14T11:38:52.369 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:52.370+0000 7f4bd93ec9c0 20 add_watcher() i=3 2024-09-14T11:38:52.369 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:52.370+0000 7f4bd93ec9c0 20 add_watcher() i=4 2024-09-14T11:38:52.369 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:52.370+0000 7f4bd93ec9c0 20 add_watcher() i=5 2024-09-14T11:38:52.369 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:52.370+0000 7f4bd93ec9c0 20 add_watcher() i=6 2024-09-14T11:38:52.371 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:52.370+0000 7f4bd93ec9c0 20 add_watcher() i=7 2024-09-14T11:38:52.371 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:52.370+0000 7f4bd93ec9c0 2 all 8 watchers are set, enabling cache 2024-09-14T11:38:52.376 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:52.378+0000 7f4a8d7e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:38:52.377 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:52.378+0000 7f4bd93ec9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:38:52.377 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:52.378+0000 7f4bd93ec9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:38:52.377 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:52.378+0000 7f4bd93ec9c0 5 note: GC not initialized 2024-09-14T11:38:52.378 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:52.378+0000 7f4a07fff640 20 reqs_thread_entry: start 2024-09-14T11:38:52.378 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:52.378+0000 7f4bd93ec9c0 20 init_complete bucket index max shards: 11 2024-09-14T11:38:52.378 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:52.378+0000 7f4bd93ec9c0 20 Filter name: none 2024-09-14T11:38:52.378 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:52.378+0000 7f4a05ffb640 20 reqs_thread_entry: start 2024-09-14T11:38:52.378 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:52.378+0000 7f4bd93ec9c0 10 cache get: name=default.rgw.meta+root+error-at-change-reshard-state : miss 2024-09-14T11:38:52.378 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:52.378+0000 7f4bd93ec9c0 20 rados->read ofs=0 len=0 2024-09-14T11:38:52.379 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:52.378+0000 7f4bd93ec9c0 20 rados_obj.operate() r=0 bl.length=197 2024-09-14T11:38:52.379 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:52.378+0000 7f4bd93ec9c0 10 cache put: name=default.rgw.meta+root+error-at-change-reshard-state info.flags=0x11 2024-09-14T11:38:52.380 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:52.378+0000 7f4bd93ec9c0 10 adding default.rgw.meta+root+error-at-change-reshard-state to cache LRU end 2024-09-14T11:38:52.380 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:52.378+0000 7f4bd93ec9c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.37 : miss 2024-09-14T11:38:52.380 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:52.378+0000 7f4bd93ec9c0 20 rados->read ofs=0 len=0 2024-09-14T11:38:52.380 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:52.382+0000 7f4bd93ec9c0 20 rados_obj.operate() r=0 bl.length=419 2024-09-14T11:38:52.380 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:52.382+0000 7f4bd93ec9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.37 info.flags=0x17 2024-09-14T11:38:52.381 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:52.382+0000 7f4bd93ec9c0 10 adding default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.37 to cache LRU end 2024-09-14T11:38:52.381 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:52.382+0000 7f4bd93ec9c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:38:52.381 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:52.382+0000 7f4bd93ec9c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:38:52.381 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:52.382+0000 7f4bd93ec9c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.37 2024-09-14T11:38:52.393 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:52.394+0000 7f4bd93ec9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.37 info.flags=0x17 2024-09-14T11:38:52.393 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:52.394+0000 7f4bd93ec9c0 10 moving default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.37 to cache LRU end 2024-09-14T11:38:52.393 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:52.394+0000 7f4bd93ec9c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:38:52.393 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:52.394+0000 7f4bd93ec9c0 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-change-reshard-state:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.37, ofs0, ns] 2024-09-14T11:38:52.394 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:52.394+0000 7f4aba7fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366230 cookie 93829742189120 notifier 7779 bl.length()=931 2024-09-14T11:38:52.394 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:52.394+0000 7f4aba7fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.37 info.flags=0x17 2024-09-14T11:38:52.394 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:52.394+0000 7f4aba7fc640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.37 to cache LRU end 2024-09-14T11:38:52.394 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:52.394+0000 7f4aba7fc640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:38:52.397 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:52.398+0000 7f4bd93ec9c0 20 handle_bi_update(): bucket=:error-at-change-reshard-state[d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.37]): orig_sources= new_sources= 2024-09-14T11:38:52.397 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:52.398+0000 7f4bd93ec9c0 20 handle_bi_update(): bucket=:error-at-change-reshard-state[d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.37]): potential sources added=[] removed=[] 2024-09-14T11:38:52.397 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:52.398+0000 7f4bd93ec9c0 20 handle_bi_update(): bucket=:error-at-change-reshard-state[d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.37]): orig_dests= new_dests= 2024-09-14T11:38:52.397 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:52.398+0000 7f4bd93ec9c0 20 handle_bi_update(): bucket=:error-at-change-reshard-state[d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.37]): potential dests added=[] removed=[] 2024-09-14T11:38:52.408 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:52.410+0000 7f4bd93ec9c0 10 bucket_obj is .dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.37.1.0 2024-09-14T11:38:52.408 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:52.410+0000 7f4bd93ec9c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.37.1.0 2024-09-14T11:38:52.408 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:52.410+0000 7f4bd93ec9c0 10 bucket_obj is .dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.37.1.1 2024-09-14T11:38:52.408 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:52.410+0000 7f4bd93ec9c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.37.1.1 2024-09-14T11:38:52.408 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:52.410+0000 7f4bd93ec9c0 10 bucket_obj is .dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.37.1.2 2024-09-14T11:38:52.408 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:52.410+0000 7f4bd93ec9c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.37.1.2 2024-09-14T11:38:52.408 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:52.410+0000 7f4bd93ec9c0 10 bucket_obj is .dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.37.1.3 2024-09-14T11:38:52.408 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:52.410+0000 7f4bd93ec9c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.37.1.3 2024-09-14T11:38:52.409 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:52.410+0000 7f4bd93ec9c0 10 bucket_obj is .dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.37.1.4 2024-09-14T11:38:52.409 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:52.410+0000 7f4bd93ec9c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.37.1.4 2024-09-14T11:38:52.409 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:52.410+0000 7f4bd93ec9c0 10 bucket_obj is .dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.37.1.5 2024-09-14T11:38:52.409 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:52.410+0000 7f4bd93ec9c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.37.1.5 2024-09-14T11:38:52.409 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:52.410+0000 7f4bd93ec9c0 10 bucket_obj is .dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.37.1.6 2024-09-14T11:38:52.409 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:52.410+0000 7f4bd93ec9c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.37.1.6 2024-09-14T11:38:52.409 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:52.410+0000 7f4bd93ec9c0 10 bucket_obj is .dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.37.1.7 2024-09-14T11:38:52.409 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:52.410+0000 7f4bd93ec9c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.37.1.7 2024-09-14T11:38:52.409 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:52.410+0000 7f4bd93ec9c0 10 bucket_obj is .dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.37.1.8 2024-09-14T11:38:52.409 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:52.410+0000 7f4bd93ec9c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.37.1.8 2024-09-14T11:38:52.409 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:52.410+0000 7f4bd93ec9c0 10 bucket_obj is .dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.37.1.9 2024-09-14T11:38:52.409 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:52.410+0000 7f4bd93ec9c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.37.1.9 2024-09-14T11:38:52.409 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:52.410+0000 7f4bd93ec9c0 10 bucket_obj is .dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.37.1.10 2024-09-14T11:38:52.409 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:52.410+0000 7f4bd93ec9c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.37.1.10 2024-09-14T11:38:52.410 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:52.410+0000 7f4bd93ec9c0 10 bucket_obj is .dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.37.1.11 2024-09-14T11:38:52.410 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:52.410+0000 7f4bd93ec9c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.37.1.11 2024-09-14T11:38:52.410 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:52.410+0000 7f4bd93ec9c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.37.0 2024-09-14T11:38:52.410 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:52.410+0000 7f4bd93ec9c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.37.1 2024-09-14T11:38:52.411 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:52.410+0000 7f4bd93ec9c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.37.2 2024-09-14T11:38:52.411 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:52.410+0000 7f4bd93ec9c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.37.3 2024-09-14T11:38:52.411 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:52.410+0000 7f4bd93ec9c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.37.4 2024-09-14T11:38:52.411 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:52.410+0000 7f4bd93ec9c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.37.5 2024-09-14T11:38:52.412 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:52.414+0000 7f4bd93ec9c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.37.6 2024-09-14T11:38:52.413 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:52.414+0000 7f4bd93ec9c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.37.7 2024-09-14T11:38:52.414 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:52.414+0000 7f4bd93ec9c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.37.8 2024-09-14T11:38:52.416 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:52.418+0000 7f4bd93ec9c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.37.9 2024-09-14T11:38:52.417 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:52.418+0000 7f4bd93ec9c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.37.10 2024-09-14T11:38:52.425 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:52.426+0000 7f4bd93ec9c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.37 : hit (requested=0x17, cached=0x17) 2024-09-14T11:38:52.425 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:52.426+0000 7f4bd93ec9c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.37 2024-09-14T11:38:52.427 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:52.426+0000 7f4bd93ec9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.37 info.flags=0x17 2024-09-14T11:38:52.427 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:52.426+0000 7f4bd93ec9c0 10 moving default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.37 to cache LRU end 2024-09-14T11:38:52.428 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:52.426+0000 7f4bd93ec9c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:38:52.428 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:52.426+0000 7f4bd93ec9c0 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-change-reshard-state:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.37, ofs0, ns] 2024-09-14T11:38:52.428 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:52.430+0000 7f4aba7fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366231 cookie 93829742189120 notifier 7779 bl.length()=931 2024-09-14T11:38:52.428 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:52.430+0000 7f4aba7fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.37 info.flags=0x17 2024-09-14T11:38:52.428 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:52.430+0000 7f4aba7fc640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.37 to cache LRU end 2024-09-14T11:38:52.428 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:52.430+0000 7f4aba7fc640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:38:52.430 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:52.430+0000 7f4bd93ec9c0 20 handle_bi_update(): bucket=:error-at-change-reshard-state[d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.37]): orig_sources= new_sources= 2024-09-14T11:38:52.430 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:52.430+0000 7f4bd93ec9c0 20 handle_bi_update(): bucket=:error-at-change-reshard-state[d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.37]): potential sources added=[] removed=[] 2024-09-14T11:38:52.430 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:52.430+0000 7f4bd93ec9c0 20 handle_bi_update(): bucket=:error-at-change-reshard-state[d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.37]): orig_dests= new_dests= 2024-09-14T11:38:52.430 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:52.430+0000 7f4bd93ec9c0 20 handle_bi_update(): bucket=:error-at-change-reshard-state[d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.37]): potential dests added=[] removed=[] 2024-09-14T11:38:52.435 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:52.438+0000 7f4bd93ec9c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.37.0 2024-09-14T11:38:52.436 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:52.438+0000 7f4bd93ec9c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.37.1 2024-09-14T11:38:52.436 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:52.438+0000 7f4bd93ec9c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.37.2 2024-09-14T11:38:52.437 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:52.438+0000 7f4bd93ec9c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.37.3 2024-09-14T11:38:52.437 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:52.438+0000 7f4bd93ec9c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.37.4 2024-09-14T11:38:52.438 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:52.438+0000 7f4bd93ec9c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.37.5 2024-09-14T11:38:52.439 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:52.438+0000 7f4bd93ec9c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.37.6 2024-09-14T11:38:52.440 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:52.442+0000 7f4bd93ec9c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.37.7 2024-09-14T11:38:52.440 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:52.442+0000 7f4bd93ec9c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.37.8 2024-09-14T11:38:52.441 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:52.442+0000 7f4bd93ec9c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.37.9 2024-09-14T11:38:52.442 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:52.442+0000 7f4bd93ec9c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.37.10 2024-09-14T11:38:52.443 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:52.442+0000 7f4bd93ec9c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.37 : hit (requested=0x17, cached=0x17) 2024-09-14T11:38:52.443 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:52.442+0000 7f4bd93ec9c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.37 2024-09-14T11:38:52.445 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:52.446+0000 7f4bd93ec9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.37 info.flags=0x17 2024-09-14T11:38:52.445 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:52.446+0000 7f4bd93ec9c0 10 moving default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.37 to cache LRU end 2024-09-14T11:38:52.445 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:52.446+0000 7f4bd93ec9c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:38:52.445 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:52.446+0000 7f4bd93ec9c0 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-change-reshard-state:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.37, ofs0, ns] 2024-09-14T11:38:52.446 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:52.446+0000 7f4aba7fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366232 cookie 93829742189120 notifier 7779 bl.length()=899 2024-09-14T11:38:52.446 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:52.446+0000 7f4aba7fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.37 info.flags=0x17 2024-09-14T11:38:52.446 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:52.446+0000 7f4aba7fc640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.37 to cache LRU end 2024-09-14T11:38:52.446 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:52.446+0000 7f4aba7fc640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:38:52.449 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:52.450+0000 7f4bd93ec9c0 20 handle_bi_update(): bucket=:error-at-change-reshard-state[d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.37]): orig_sources= new_sources= 2024-09-14T11:38:52.449 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:52.450+0000 7f4bd93ec9c0 20 handle_bi_update(): bucket=:error-at-change-reshard-state[d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.37]): potential sources added=[] removed=[] 2024-09-14T11:38:52.449 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:52.450+0000 7f4bd93ec9c0 20 handle_bi_update(): bucket=:error-at-change-reshard-state[d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.37]): orig_dests= new_dests= 2024-09-14T11:38:52.449 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:52.450+0000 7f4bd93ec9c0 20 handle_bi_update(): bucket=:error-at-change-reshard-state[d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.37]): potential dests added=[] removed=[] 2024-09-14T11:38:52.454 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:52.454+0000 7f4bd93ec9c0 1 execute INFO: reshard of bucket "error-at-change-reshard-state" from 11 shards to 12 shards completed successfully 2024-09-14T11:38:52.458 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:52.458+0000 7f4a8d7e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:38:52.463 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:52.462+0000 7f4bd93ec9c0 20 remove_watcher() i=0 2024-09-14T11:38:52.463 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:52.462+0000 7f4bd93ec9c0 2 removed watcher, disabling cache 2024-09-14T11:38:52.465 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:52.466+0000 7f4bd93ec9c0 20 remove_watcher() i=1 2024-09-14T11:38:52.467 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:52.466+0000 7f4bd93ec9c0 20 remove_watcher() i=2 2024-09-14T11:38:52.469 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:52.470+0000 7f4bd93ec9c0 20 remove_watcher() i=3 2024-09-14T11:38:52.471 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:52.474+0000 7f4bd93ec9c0 20 remove_watcher() i=4 2024-09-14T11:38:52.473 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:52.474+0000 7f4bd93ec9c0 20 remove_watcher() i=5 2024-09-14T11:38:52.475 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:52.474+0000 7f4bd93ec9c0 20 remove_watcher() i=6 2024-09-14T11:38:52.477 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:52.478+0000 7f4bd93ec9c0 20 remove_watcher() i=7 2024-09-14T11:38:52.499 INFO:tasks.workunit.client.0.smithi138.stderr:radosgw-admin bucket stats --bucket error-at-change-reshard-state 2024-09-14T11:38:52.532 INFO:tasks.workunit.client.0.smithi138.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:38:52.533 INFO:tasks.workunit.client.0.smithi138.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:38:52.578 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:52.578+0000 7ff5951389c0 20 rados->read ofs=0 len=0 2024-09-14T11:38:52.580 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:52.582+0000 7ff5951389c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:38:52.580 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:52.582+0000 7ff5951389c0 20 realm 2024-09-14T11:38:52.581 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:52.582+0000 7ff5951389c0 20 rados->read ofs=0 len=0 2024-09-14T11:38:52.581 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:52.582+0000 7ff5951389c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:38:52.581 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:52.582+0000 7ff5951389c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:38:52.581 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:52.582+0000 7ff5951389c0 20 rados->read ofs=0 len=0 2024-09-14T11:38:52.581 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:52.582+0000 7ff5951389c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:38:52.581 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:52.582+0000 7ff5951389c0 20 rados->read ofs=0 len=0 2024-09-14T11:38:52.582 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:52.582+0000 7ff5951389c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:38:52.583 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:52.582+0000 7ff5951389c0 20 rados->read ofs=0 len=0 2024-09-14T11:38:52.583 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:52.582+0000 7ff5951389c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:38:52.583 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:52.582+0000 7ff5951389c0 20 searching for the correct realm 2024-09-14T11:38:52.587 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:52.586+0000 7ff59343f640 0 -- 172.21.15.138:0/112008939 >> [v2:172.21.15.154:6824/416768175,v1:172.21.15.154:6825/416768175] conn(0x7ff58c01a040 msgr2=0x7ff58c0462c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:38:52.801 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:52.802+0000 7ff59243d640 0 -- 172.21.15.138:0/112008939 >> [v2:172.21.15.138:6816/326481658,v1:172.21.15.138:6817/326481658] conn(0x7ff58c0468f0 msgr2=0x7ff58c0492b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:38:53.019 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:53.018+0000 7ff5951389c0 20 RGWRados::pool_iterate: got zone_info.d9e72d30-c60b-4d0d-9267-fdc36392d5ad 2024-09-14T11:38:53.019 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:53.018+0000 7ff5951389c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:38:53.020 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:53.018+0000 7ff5951389c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:38:53.020 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:53.018+0000 7ff5951389c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:38:53.020 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:53.018+0000 7ff5951389c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:38:53.020 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:53.018+0000 7ff5951389c0 20 RGWRados::pool_iterate: got zonegroup_info.65ab941b-da8c-4160-94fb-3672b069d44f 2024-09-14T11:38:53.020 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:53.018+0000 7ff5951389c0 20 rados->read ofs=0 len=0 2024-09-14T11:38:53.020 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:53.018+0000 7ff5951389c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:38:53.020 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:53.018+0000 7ff5951389c0 20 rados->read ofs=0 len=0 2024-09-14T11:38:53.020 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:53.022+0000 7ff5951389c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:38:53.020 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:53.022+0000 7ff5951389c0 20 rados->read ofs=0 len=0 2024-09-14T11:38:53.021 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:53.022+0000 7ff5951389c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:38:53.022 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:53.022+0000 7ff5951389c0 20 zone default found 2024-09-14T11:38:53.022 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:53.022+0000 7ff5951389c0 4 Realm: () 2024-09-14T11:38:53.022 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:53.022+0000 7ff5951389c0 4 ZoneGroup: default (65ab941b-da8c-4160-94fb-3672b069d44f) 2024-09-14T11:38:53.022 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:53.022+0000 7ff5951389c0 4 Zone: default (d9e72d30-c60b-4d0d-9267-fdc36392d5ad) 2024-09-14T11:38:53.022 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:53.022+0000 7ff5951389c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:38:53.022 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:53.022+0000 7ff5951389c0 20 zonegroup default 2024-09-14T11:38:53.022 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:53.022+0000 7ff5951389c0 20 rados->read ofs=0 len=0 2024-09-14T11:38:53.022 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:53.022+0000 7ff5951389c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:38:53.023 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:53.022+0000 7ff5951389c0 20 rados->read ofs=0 len=0 2024-09-14T11:38:53.023 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:53.022+0000 7ff5951389c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:38:53.023 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:53.022+0000 7ff5951389c0 20 rados->read ofs=0 len=0 2024-09-14T11:38:53.024 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:53.026+0000 7ff5951389c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:38:53.024 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:53.026+0000 7ff5951389c0 20 started sync module instance, tier type = 2024-09-14T11:38:53.024 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:53.026+0000 7ff5951389c0 20 started zone id=d9e72d30-c60b-4d0d-9267-fdc36392d5ad (name=default) with tier type = 2024-09-14T11:38:53.046 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:53.046+0000 7ff5951389c0 20 add_watcher() i=0 2024-09-14T11:38:53.046 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:53.046+0000 7ff5951389c0 20 add_watcher() i=1 2024-09-14T11:38:53.047 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:53.046+0000 7ff5951389c0 20 add_watcher() i=2 2024-09-14T11:38:53.047 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:53.046+0000 7ff5951389c0 20 add_watcher() i=3 2024-09-14T11:38:53.047 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:53.046+0000 7ff5951389c0 20 add_watcher() i=4 2024-09-14T11:38:53.047 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:53.046+0000 7ff5951389c0 20 add_watcher() i=5 2024-09-14T11:38:53.047 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:53.046+0000 7ff5951389c0 20 add_watcher() i=6 2024-09-14T11:38:53.049 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:53.050+0000 7ff5951389c0 20 add_watcher() i=7 2024-09-14T11:38:53.049 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:53.050+0000 7ff5951389c0 2 all 8 watchers are set, enabling cache 2024-09-14T11:38:53.053 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:53.054+0000 7ff4497e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:38:53.054 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:53.054+0000 7ff5951389c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:38:53.054 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:53.054+0000 7ff5951389c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:38:53.054 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:53.054+0000 7ff5951389c0 5 note: GC not initialized 2024-09-14T11:38:53.055 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:53.054+0000 7ff3c3fff640 20 reqs_thread_entry: start 2024-09-14T11:38:53.055 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:53.054+0000 7ff5951389c0 20 init_complete bucket index max shards: 11 2024-09-14T11:38:53.055 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:53.054+0000 7ff5951389c0 20 Filter name: none 2024-09-14T11:38:53.055 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:53.054+0000 7ff3c1ffb640 20 reqs_thread_entry: start 2024-09-14T11:38:53.055 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:53.054+0000 7ff5951389c0 20 rados->read ofs=0 len=0 2024-09-14T11:38:53.056 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:53.058+0000 7ff5951389c0 20 rados_obj.operate() r=0 bl.length=197 2024-09-14T11:38:53.056 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:53.058+0000 7ff5951389c0 20 rados->read ofs=0 len=0 2024-09-14T11:38:53.057 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:53.058+0000 7ff5951389c0 20 rados_obj.operate() r=0 bl.length=419 2024-09-14T11:38:53.057 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:53.058+0000 7ff5951389c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:38:53.057 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:53.058+0000 7ff5951389c0 20 rados->read ofs=0 len=0 2024-09-14T11:38:53.058 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:53.058+0000 7ff5951389c0 20 rados_obj.operate() r=0 bl.length=197 2024-09-14T11:38:53.058 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:53.058+0000 7ff5951389c0 20 rados->read ofs=0 len=0 2024-09-14T11:38:53.059 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:53.058+0000 7ff5951389c0 20 rados_obj.operate() r=0 bl.length=419 2024-09-14T11:38:53.059 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:53.058+0000 7ff5951389c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:38:53.063 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:53.062+0000 7ff4497e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:38:53.068 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:53.070+0000 7ff5951389c0 20 remove_watcher() i=0 2024-09-14T11:38:53.068 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:53.070+0000 7ff5951389c0 2 removed watcher, disabling cache 2024-09-14T11:38:53.070 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:53.070+0000 7ff5951389c0 20 remove_watcher() i=1 2024-09-14T11:38:53.072 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:53.074+0000 7ff5951389c0 20 remove_watcher() i=2 2024-09-14T11:38:53.074 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:53.074+0000 7ff5951389c0 20 remove_watcher() i=3 2024-09-14T11:38:53.076 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:53.078+0000 7ff5951389c0 20 remove_watcher() i=4 2024-09-14T11:38:53.078 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:53.078+0000 7ff5951389c0 20 remove_watcher() i=5 2024-09-14T11:38:53.080 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:53.082+0000 7ff5951389c0 20 remove_watcher() i=6 2024-09-14T11:38:53.081 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:53.082+0000 7ff5951389c0 20 remove_watcher() i=7 2024-09-14T11:38:53.096 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-14T11:38:53.096 INFO:tasks.workunit.client.0.smithi138.stderr:BUCKET_STATS: 2024-09-14T11:38:53.096 INFO:tasks.workunit.client.0.smithi138.stderr:bucket: error-at-change-reshard-state id: d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.37 num_objects: 19 size_kb: 1 num_shards: 12 2024-09-14T11:38:53.096 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-14T11:38:53.097 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:38:53.097 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-14T11:38:53.118 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:38:53.118 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-14T11:38:53.581 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:38:53.581 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-14T11:38:53.979 INFO:tasks.workunit.client.0.smithi138.stderr:TEST: reshard bucket with ECANCELED injected at change_reshard_state 2024-09-14T11:38:53.980 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-14T11:38:53.981 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:38:53.982 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-14T11:38:54.120 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:38:54.120 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-14T11:38:54.211 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:38:54.211 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-14T11:38:54.299 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:38:54.299 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-14T11:38:54.395 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:38:54.395 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-14T11:38:54.474 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:38:54.474 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-14T11:38:54.562 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:38:54.562 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-14T11:38:54.654 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:38:54.654 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-14T11:38:54.749 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:38:54.749 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-14T11:38:54.847 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:38:54.847 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-14T11:38:54.939 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:38:54.939 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-14T11:38:55.039 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:38:55.039 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-14T11:38:55.137 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:38:55.137 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-14T11:38:55.232 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:38:55.232 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-14T11:38:55.328 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:38:55.328 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-14T11:38:55.413 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:38:55.413 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-14T11:38:55.496 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:38:55.496 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-14T11:38:55.591 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:38:55.591 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-14T11:38:55.689 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:38:55.689 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-14T11:38:55.780 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:38:55.780 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-14T11:38:55.877 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:38:55.877 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-14T11:38:55.968 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:38:55.968 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-14T11:38:56.063 INFO:tasks.workunit.client.0.smithi138.stderr:radosgw-admin bucket stats --bucket error-at-change-reshard-state 2024-09-14T11:38:56.098 INFO:tasks.workunit.client.0.smithi138.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:38:56.098 INFO:tasks.workunit.client.0.smithi138.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:38:56.145 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:56.145+0000 7f6d65abd9c0 20 rados->read ofs=0 len=0 2024-09-14T11:38:56.147 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:56.145+0000 7f6d65abd9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:38:56.147 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:56.145+0000 7f6d65abd9c0 20 realm 2024-09-14T11:38:56.147 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:56.145+0000 7f6d65abd9c0 20 rados->read ofs=0 len=0 2024-09-14T11:38:56.148 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:56.145+0000 7f6d65abd9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:38:56.148 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:56.145+0000 7f6d65abd9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:38:56.148 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:56.145+0000 7f6d65abd9c0 20 rados->read ofs=0 len=0 2024-09-14T11:38:56.148 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:56.149+0000 7f6d65abd9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:38:56.148 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:56.149+0000 7f6d65abd9c0 20 rados->read ofs=0 len=0 2024-09-14T11:38:56.149 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:56.149+0000 7f6d65abd9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:38:56.149 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:56.149+0000 7f6d65abd9c0 20 rados->read ofs=0 len=0 2024-09-14T11:38:56.150 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:56.149+0000 7f6d65abd9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:38:56.150 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:56.149+0000 7f6d65abd9c0 20 searching for the correct realm 2024-09-14T11:38:56.151 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:56.149+0000 7f6d62dc2640 0 -- 172.21.15.138:0/2332776201 >> [v2:172.21.15.154:6808/1468088432,v1:172.21.15.154:6809/1468088432] conn(0x7f6d540683f0 msgr2=0x7f6d54066e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-14T11:38:56.364 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:56.361+0000 7f6d63dc4640 0 -- 172.21.15.138:0/2332776201 >> [v2:172.21.15.138:6824/2633984942,v1:172.21.15.138:6825/2633984942] conn(0x559f4264fc60 msgr2=0x559f42652050 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:38:56.381 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:56.381+0000 7f6d65abd9c0 20 RGWRados::pool_iterate: got zone_info.d9e72d30-c60b-4d0d-9267-fdc36392d5ad 2024-09-14T11:38:56.381 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:56.381+0000 7f6d65abd9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:38:56.381 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:56.381+0000 7f6d65abd9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:38:56.381 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:56.381+0000 7f6d65abd9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:38:56.381 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:56.381+0000 7f6d65abd9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:38:56.381 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:56.381+0000 7f6d65abd9c0 20 RGWRados::pool_iterate: got zonegroup_info.65ab941b-da8c-4160-94fb-3672b069d44f 2024-09-14T11:38:56.381 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:56.381+0000 7f6d65abd9c0 20 rados->read ofs=0 len=0 2024-09-14T11:38:56.382 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:56.381+0000 7f6d65abd9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:38:56.382 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:56.381+0000 7f6d65abd9c0 20 rados->read ofs=0 len=0 2024-09-14T11:38:56.382 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:56.381+0000 7f6d65abd9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:38:56.382 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:56.381+0000 7f6d65abd9c0 20 rados->read ofs=0 len=0 2024-09-14T11:38:56.383 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:56.381+0000 7f6d65abd9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:38:56.383 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:56.381+0000 7f6d65abd9c0 20 zone default found 2024-09-14T11:38:56.383 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:56.381+0000 7f6d65abd9c0 4 Realm: () 2024-09-14T11:38:56.383 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:56.381+0000 7f6d65abd9c0 4 ZoneGroup: default (65ab941b-da8c-4160-94fb-3672b069d44f) 2024-09-14T11:38:56.384 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:56.381+0000 7f6d65abd9c0 4 Zone: default (d9e72d30-c60b-4d0d-9267-fdc36392d5ad) 2024-09-14T11:38:56.384 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:56.381+0000 7f6d65abd9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:38:56.384 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:56.381+0000 7f6d65abd9c0 20 zonegroup default 2024-09-14T11:38:56.384 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:56.381+0000 7f6d65abd9c0 20 rados->read ofs=0 len=0 2024-09-14T11:38:56.384 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:56.385+0000 7f6d65abd9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:38:56.384 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:56.385+0000 7f6d65abd9c0 20 rados->read ofs=0 len=0 2024-09-14T11:38:56.385 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:56.385+0000 7f6d65abd9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:38:56.385 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:56.385+0000 7f6d65abd9c0 20 rados->read ofs=0 len=0 2024-09-14T11:38:56.385 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:56.385+0000 7f6d65abd9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:38:56.385 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:56.385+0000 7f6d65abd9c0 20 started sync module instance, tier type = 2024-09-14T11:38:56.385 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:56.385+0000 7f6d65abd9c0 20 started zone id=d9e72d30-c60b-4d0d-9267-fdc36392d5ad (name=default) with tier type = 2024-09-14T11:38:56.409 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:56.409+0000 7f6d65abd9c0 20 add_watcher() i=0 2024-09-14T11:38:56.409 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:56.409+0000 7f6d65abd9c0 20 add_watcher() i=1 2024-09-14T11:38:56.409 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:56.409+0000 7f6d65abd9c0 20 add_watcher() i=2 2024-09-14T11:38:56.409 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:56.409+0000 7f6d65abd9c0 20 add_watcher() i=3 2024-09-14T11:38:56.409 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:56.409+0000 7f6d65abd9c0 20 add_watcher() i=4 2024-09-14T11:38:56.409 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:56.409+0000 7f6d65abd9c0 20 add_watcher() i=5 2024-09-14T11:38:56.409 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:56.409+0000 7f6d65abd9c0 20 add_watcher() i=6 2024-09-14T11:38:56.411 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:56.409+0000 7f6d65abd9c0 20 add_watcher() i=7 2024-09-14T11:38:56.411 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:56.409+0000 7f6d65abd9c0 2 all 8 watchers are set, enabling cache 2024-09-14T11:38:56.415 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:56.413+0000 7f6c19fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:38:56.416 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:56.417+0000 7f6d65abd9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:38:56.416 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:56.417+0000 7f6d65abd9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:38:56.416 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:56.417+0000 7f6d65abd9c0 5 note: GC not initialized 2024-09-14T11:38:56.417 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:56.417+0000 7f6c18fe1640 20 reqs_thread_entry: start 2024-09-14T11:38:56.417 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:56.417+0000 7f6d65abd9c0 20 init_complete bucket index max shards: 11 2024-09-14T11:38:56.418 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:56.417+0000 7f6d65abd9c0 20 Filter name: none 2024-09-14T11:38:56.418 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:56.417+0000 7f6b927fc640 20 reqs_thread_entry: start 2024-09-14T11:38:56.418 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:56.417+0000 7f6d65abd9c0 20 rados->read ofs=0 len=0 2024-09-14T11:38:56.419 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:56.417+0000 7f6d65abd9c0 20 rados_obj.operate() r=0 bl.length=197 2024-09-14T11:38:56.419 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:56.417+0000 7f6d65abd9c0 20 rados->read ofs=0 len=0 2024-09-14T11:38:56.420 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:56.421+0000 7f6d65abd9c0 20 rados_obj.operate() r=0 bl.length=419 2024-09-14T11:38:56.420 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:56.421+0000 7f6d65abd9c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:38:56.420 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:56.421+0000 7f6d65abd9c0 20 rados->read ofs=0 len=0 2024-09-14T11:38:56.421 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:56.421+0000 7f6d65abd9c0 20 rados_obj.operate() r=0 bl.length=197 2024-09-14T11:38:56.421 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:56.421+0000 7f6d65abd9c0 20 rados->read ofs=0 len=0 2024-09-14T11:38:56.421 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:56.421+0000 7f6d65abd9c0 20 rados_obj.operate() r=0 bl.length=419 2024-09-14T11:38:56.422 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:56.421+0000 7f6d65abd9c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:38:56.424 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:56.425+0000 7f6c19fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:38:56.429 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:56.429+0000 7f6d65abd9c0 20 remove_watcher() i=0 2024-09-14T11:38:56.429 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:56.429+0000 7f6d65abd9c0 2 removed watcher, disabling cache 2024-09-14T11:38:56.431 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:56.429+0000 7f6d65abd9c0 20 remove_watcher() i=1 2024-09-14T11:38:56.434 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:56.433+0000 7f6d65abd9c0 20 remove_watcher() i=2 2024-09-14T11:38:56.436 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:56.437+0000 7f6d65abd9c0 20 remove_watcher() i=3 2024-09-14T11:38:56.440 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:56.437+0000 7f6d65abd9c0 20 remove_watcher() i=4 2024-09-14T11:38:56.440 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:56.437+0000 7f6d65abd9c0 20 remove_watcher() i=5 2024-09-14T11:38:56.441 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:56.441+0000 7f6d65abd9c0 20 remove_watcher() i=6 2024-09-14T11:38:56.442 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:56.441+0000 7f6d65abd9c0 20 remove_watcher() i=7 2024-09-14T11:38:56.457 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-14T11:38:56.457 INFO:tasks.workunit.client.0.smithi138.stderr:BUCKET_STATS: 2024-09-14T11:38:56.457 INFO:tasks.workunit.client.0.smithi138.stderr:bucket: error-at-change-reshard-state id: d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.38 num_objects: 20 size_kb: 1 num_shards: 11 2024-09-14T11:38:56.457 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-14T11:38:56.457 INFO:tasks.workunit.client.0.smithi138.stderr:radosgw-admin bucket reshard --bucket error-at-change-reshard-state --num-shards 12 --rgw-reshard-bucket-lock-duration 30 --inject-error-at change_reshard_state --inject-error-code 125 2024-09-14T11:38:56.495 INFO:tasks.workunit.client.0.smithi138.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:38:56.495 INFO:tasks.workunit.client.0.smithi138.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:38:56.540 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:56.541+0000 7f0ff27529c0 20 rados->read ofs=0 len=0 2024-09-14T11:38:56.542 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:56.541+0000 7f0ff27529c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:38:56.542 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:56.541+0000 7f0ff27529c0 20 realm 2024-09-14T11:38:56.543 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:56.541+0000 7f0ff27529c0 20 rados->read ofs=0 len=0 2024-09-14T11:38:56.543 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:56.541+0000 7f0ff27529c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:38:56.543 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:56.541+0000 7f0ff27529c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:38:56.543 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:56.541+0000 7f0ff27529c0 20 rados->read ofs=0 len=0 2024-09-14T11:38:56.543 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:56.541+0000 7f0ff27529c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:38:56.543 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:56.541+0000 7f0ff27529c0 20 rados->read ofs=0 len=0 2024-09-14T11:38:56.544 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:56.545+0000 7f0ff27529c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:38:56.544 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:56.545+0000 7f0ff27529c0 20 rados->read ofs=0 len=0 2024-09-14T11:38:56.750 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:56.749+0000 7f0ff27529c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:38:56.751 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:56.749+0000 7f0ff27529c0 20 searching for the correct realm 2024-09-14T11:38:56.755 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:56.753+0000 7f0ff0a59640 0 -- 172.21.15.138:0/321977947 >> [v2:172.21.15.154:6824/416768175,v1:172.21.15.154:6825/416768175] conn(0x7f0fe807fb60 msgr2=0x7f0fe8077e80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:38:56.973 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:56.973+0000 7f0fe7a57640 0 -- 172.21.15.138:0/321977947 >> [v2:172.21.15.138:6816/326481658,v1:172.21.15.138:6817/326481658] conn(0x7f0fe80a2170 msgr2=0x7f0fe802f9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:38:57.190 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:57.189+0000 7f0ff27529c0 20 RGWRados::pool_iterate: got zone_info.d9e72d30-c60b-4d0d-9267-fdc36392d5ad 2024-09-14T11:38:57.191 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:57.189+0000 7f0ff27529c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:38:57.191 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:57.189+0000 7f0ff27529c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:38:57.191 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:57.189+0000 7f0ff27529c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:38:57.191 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:57.189+0000 7f0ff27529c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:38:57.191 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:57.189+0000 7f0ff27529c0 20 RGWRados::pool_iterate: got zonegroup_info.65ab941b-da8c-4160-94fb-3672b069d44f 2024-09-14T11:38:57.191 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:57.189+0000 7f0ff27529c0 20 rados->read ofs=0 len=0 2024-09-14T11:38:57.191 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:57.189+0000 7f0ff27529c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:38:57.191 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:57.189+0000 7f0ff27529c0 20 rados->read ofs=0 len=0 2024-09-14T11:38:57.192 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:57.193+0000 7f0ff27529c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:38:57.192 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:57.193+0000 7f0ff27529c0 20 rados->read ofs=0 len=0 2024-09-14T11:38:57.193 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:57.193+0000 7f0ff27529c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:38:57.193 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:57.193+0000 7f0ff27529c0 20 zone default found 2024-09-14T11:38:57.193 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:57.193+0000 7f0ff27529c0 4 Realm: () 2024-09-14T11:38:57.194 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:57.193+0000 7f0ff27529c0 4 ZoneGroup: default (65ab941b-da8c-4160-94fb-3672b069d44f) 2024-09-14T11:38:57.194 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:57.193+0000 7f0ff27529c0 4 Zone: default (d9e72d30-c60b-4d0d-9267-fdc36392d5ad) 2024-09-14T11:38:57.194 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:57.193+0000 7f0ff27529c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:38:57.194 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:57.193+0000 7f0ff27529c0 20 zonegroup default 2024-09-14T11:38:57.194 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:57.193+0000 7f0ff27529c0 20 rados->read ofs=0 len=0 2024-09-14T11:38:57.194 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:57.193+0000 7f0ff27529c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:38:57.194 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:57.193+0000 7f0ff27529c0 20 rados->read ofs=0 len=0 2024-09-14T11:38:57.195 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:57.193+0000 7f0ff27529c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:38:57.195 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:57.193+0000 7f0ff27529c0 20 rados->read ofs=0 len=0 2024-09-14T11:38:57.196 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:57.197+0000 7f0ff27529c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:38:57.196 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:57.197+0000 7f0ff27529c0 20 started sync module instance, tier type = 2024-09-14T11:38:57.196 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:57.197+0000 7f0ff27529c0 20 started zone id=d9e72d30-c60b-4d0d-9267-fdc36392d5ad (name=default) with tier type = 2024-09-14T11:38:57.218 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:57.217+0000 7f0ff27529c0 20 add_watcher() i=0 2024-09-14T11:38:57.219 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:57.217+0000 7f0ff27529c0 20 add_watcher() i=1 2024-09-14T11:38:57.219 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:57.217+0000 7f0ff27529c0 20 add_watcher() i=2 2024-09-14T11:38:57.219 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:57.217+0000 7f0ff27529c0 20 add_watcher() i=3 2024-09-14T11:38:57.219 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:57.217+0000 7f0ff27529c0 20 add_watcher() i=4 2024-09-14T11:38:57.219 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:57.217+0000 7f0ff27529c0 20 add_watcher() i=5 2024-09-14T11:38:57.219 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:57.217+0000 7f0ff27529c0 20 add_watcher() i=6 2024-09-14T11:38:57.220 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:57.221+0000 7f0ff27529c0 20 add_watcher() i=7 2024-09-14T11:38:57.221 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:57.221+0000 7f0ff27529c0 2 all 8 watchers are set, enabling cache 2024-09-14T11:38:57.224 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:57.225+0000 7f0ea67e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:38:57.225 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:57.225+0000 7f0ff27529c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:38:57.226 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:57.225+0000 7f0ff27529c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:38:57.226 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:57.225+0000 7f0ff27529c0 5 note: GC not initialized 2024-09-14T11:38:57.227 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:57.225+0000 7f0ea57e2640 20 reqs_thread_entry: start 2024-09-14T11:38:57.227 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:57.225+0000 7f0ff27529c0 20 init_complete bucket index max shards: 11 2024-09-14T11:38:57.227 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:57.225+0000 7f0ff27529c0 20 Filter name: none 2024-09-14T11:38:57.227 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:57.225+0000 7f0e16ffd640 20 reqs_thread_entry: start 2024-09-14T11:38:57.227 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:57.225+0000 7f0ff27529c0 10 cache get: name=default.rgw.meta+root+error-at-change-reshard-state : miss 2024-09-14T11:38:57.227 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:57.225+0000 7f0ff27529c0 20 rados->read ofs=0 len=0 2024-09-14T11:38:57.229 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:57.229+0000 7f0ff27529c0 20 rados_obj.operate() r=0 bl.length=197 2024-09-14T11:38:57.229 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:57.229+0000 7f0ff27529c0 10 cache put: name=default.rgw.meta+root+error-at-change-reshard-state info.flags=0x11 2024-09-14T11:38:57.229 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:57.229+0000 7f0ff27529c0 10 adding default.rgw.meta+root+error-at-change-reshard-state to cache LRU end 2024-09-14T11:38:57.229 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:57.229+0000 7f0ff27529c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.38 : miss 2024-09-14T11:38:57.229 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:57.229+0000 7f0ff27529c0 20 rados->read ofs=0 len=0 2024-09-14T11:38:57.229 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:57.229+0000 7f0ff27529c0 20 rados_obj.operate() r=0 bl.length=419 2024-09-14T11:38:57.229 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:57.229+0000 7f0ff27529c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.38 info.flags=0x17 2024-09-14T11:38:57.229 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:57.229+0000 7f0ff27529c0 10 adding default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.38 to cache LRU end 2024-09-14T11:38:57.229 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:57.229+0000 7f0ff27529c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:38:57.229 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:57.229+0000 7f0ff27529c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:38:57.229 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:57.229+0000 7f0ff27529c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.38 2024-09-14T11:38:57.239 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:57.237+0000 7f0ff27529c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.38 info.flags=0x17 2024-09-14T11:38:57.239 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:57.237+0000 7f0ff27529c0 10 moving default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.38 to cache LRU end 2024-09-14T11:38:57.239 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:57.237+0000 7f0ff27529c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:38:57.240 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:57.237+0000 7f0ff27529c0 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-change-reshard-state:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.38, ofs0, ns] 2024-09-14T11:38:57.240 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:57.241+0000 7f0ecf7fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366235 cookie 94357098984704 notifier 7331 bl.length()=931 2024-09-14T11:38:57.240 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:57.241+0000 7f0ecf7fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.38 info.flags=0x17 2024-09-14T11:38:57.240 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:57.241+0000 7f0ecf7fe640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.38 to cache LRU end 2024-09-14T11:38:57.240 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:57.241+0000 7f0ecf7fe640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:38:57.243 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:57.241+0000 7f0ff27529c0 20 handle_bi_update(): bucket=:error-at-change-reshard-state[d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.38]): orig_sources= new_sources= 2024-09-14T11:38:57.243 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:57.241+0000 7f0ff27529c0 20 handle_bi_update(): bucket=:error-at-change-reshard-state[d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.38]): potential sources added=[] removed=[] 2024-09-14T11:38:57.243 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:57.241+0000 7f0ff27529c0 20 handle_bi_update(): bucket=:error-at-change-reshard-state[d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.38]): orig_dests= new_dests= 2024-09-14T11:38:57.243 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:57.241+0000 7f0ff27529c0 20 handle_bi_update(): bucket=:error-at-change-reshard-state[d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.38]): potential dests added=[] removed=[] 2024-09-14T11:38:57.253 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:57.253+0000 7f0ff27529c0 10 bucket_obj is .dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.38.1.0 2024-09-14T11:38:57.253 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:57.253+0000 7f0ff27529c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.38.1.0 2024-09-14T11:38:57.253 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:57.253+0000 7f0ff27529c0 10 bucket_obj is .dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.38.1.1 2024-09-14T11:38:57.253 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:57.253+0000 7f0ff27529c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.38.1.1 2024-09-14T11:38:57.253 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:57.253+0000 7f0ff27529c0 10 bucket_obj is .dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.38.1.2 2024-09-14T11:38:57.254 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:57.253+0000 7f0ff27529c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.38.1.2 2024-09-14T11:38:57.254 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:57.253+0000 7f0ff27529c0 10 bucket_obj is .dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.38.1.3 2024-09-14T11:38:57.254 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:57.253+0000 7f0ff27529c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.38.1.3 2024-09-14T11:38:57.255 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:57.253+0000 7f0ff27529c0 10 bucket_obj is .dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.38.1.4 2024-09-14T11:38:57.255 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:57.253+0000 7f0ff27529c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.38.1.4 2024-09-14T11:38:57.255 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:57.253+0000 7f0ff27529c0 10 bucket_obj is .dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.38.1.5 2024-09-14T11:38:57.255 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:57.253+0000 7f0ff27529c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.38.1.5 2024-09-14T11:38:57.255 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:57.253+0000 7f0ff27529c0 10 bucket_obj is .dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.38.1.6 2024-09-14T11:38:57.256 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:57.253+0000 7f0ff27529c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.38.1.6 2024-09-14T11:38:57.256 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:57.253+0000 7f0ff27529c0 10 bucket_obj is .dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.38.1.7 2024-09-14T11:38:57.256 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:57.253+0000 7f0ff27529c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.38.1.7 2024-09-14T11:38:57.256 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:57.253+0000 7f0ff27529c0 10 bucket_obj is .dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.38.1.8 2024-09-14T11:38:57.256 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:57.253+0000 7f0ff27529c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.38.1.8 2024-09-14T11:38:57.256 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:57.253+0000 7f0ff27529c0 10 bucket_obj is .dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.38.1.9 2024-09-14T11:38:57.256 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:57.253+0000 7f0ff27529c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.38.1.9 2024-09-14T11:38:57.256 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:57.253+0000 7f0ff27529c0 10 bucket_obj is .dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.38.1.10 2024-09-14T11:38:57.256 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:57.253+0000 7f0ff27529c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.38.1.10 2024-09-14T11:38:57.256 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:57.253+0000 7f0ff27529c0 10 bucket_obj is .dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.38.1.11 2024-09-14T11:38:57.256 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:57.253+0000 7f0ff27529c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.38.1.11 2024-09-14T11:38:57.257 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:57.253+0000 7f0ff27529c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.38.0 2024-09-14T11:38:57.257 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:57.253+0000 7f0ff27529c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.38.1 2024-09-14T11:38:57.258 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:57.253+0000 7f0ff27529c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.38.2 2024-09-14T11:38:57.258 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:57.253+0000 7f0ff27529c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.38.3 2024-09-14T11:38:57.258 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:57.257+0000 7f0ff27529c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.38.4 2024-09-14T11:38:57.258 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:57.257+0000 7f0ff27529c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.38.5 2024-09-14T11:38:57.259 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:57.257+0000 7f0ff27529c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.38.6 2024-09-14T11:38:57.260 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:57.261+0000 7f0ff27529c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.38.7 2024-09-14T11:38:57.261 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:57.261+0000 7f0ff27529c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.38.8 2024-09-14T11:38:57.261 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:57.261+0000 7f0ff27529c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.38.9 2024-09-14T11:38:57.263 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:57.261+0000 7f0ff27529c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.38.10 2024-09-14T11:38:57.269 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:57.269+0000 7f0ff27529c0 -1 Injecting error=-125 at location=change_reshard_state 2024-09-14T11:38:57.269 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:57.269+0000 7f0ff27529c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.38 : hit (requested=0x17, cached=0x17) 2024-09-14T11:38:57.269 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:57.269+0000 7f0ff27529c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.38 2024-09-14T11:38:57.271 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:57.269+0000 7f0ff27529c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.38 info.flags=0x17 2024-09-14T11:38:57.271 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:57.269+0000 7f0ff27529c0 10 moving default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.38 to cache LRU end 2024-09-14T11:38:57.271 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:57.269+0000 7f0ff27529c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:38:57.271 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:57.269+0000 7f0ff27529c0 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-change-reshard-state:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.38, ofs0, ns] 2024-09-14T11:38:57.272 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:57.269+0000 7f0eceffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366236 cookie 94357098984704 notifier 7331 bl.length()=931 2024-09-14T11:38:57.272 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:57.273+0000 7f0eceffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.38 info.flags=0x17 2024-09-14T11:38:57.272 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:57.273+0000 7f0eceffd640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.38 to cache LRU end 2024-09-14T11:38:57.272 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:57.273+0000 7f0eceffd640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:38:57.274 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:57.273+0000 7f0ff27529c0 20 handle_bi_update(): bucket=:error-at-change-reshard-state[d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.38]): orig_sources= new_sources= 2024-09-14T11:38:57.274 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:57.273+0000 7f0ff27529c0 20 handle_bi_update(): bucket=:error-at-change-reshard-state[d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.38]): potential sources added=[] removed=[] 2024-09-14T11:38:57.274 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:57.273+0000 7f0ff27529c0 20 handle_bi_update(): bucket=:error-at-change-reshard-state[d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.38]): orig_dests= new_dests= 2024-09-14T11:38:57.274 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:57.273+0000 7f0ff27529c0 20 handle_bi_update(): bucket=:error-at-change-reshard-state[d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.38]): potential dests added=[] removed=[] 2024-09-14T11:38:57.279 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:57.277+0000 7f0ff27529c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.38.0 2024-09-14T11:38:57.280 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:57.281+0000 7f0ff27529c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.38.1 2024-09-14T11:38:57.280 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:57.281+0000 7f0ff27529c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.38.2 2024-09-14T11:38:57.280 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:57.281+0000 7f0ff27529c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.38.3 2024-09-14T11:38:57.281 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:57.281+0000 7f0ff27529c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.38.4 2024-09-14T11:38:57.282 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:57.281+0000 7f0ff27529c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.38.5 2024-09-14T11:38:57.282 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:57.281+0000 7f0ff27529c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.38.6 2024-09-14T11:38:57.283 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:57.281+0000 7f0ff27529c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.38.7 2024-09-14T11:38:57.284 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:57.285+0000 7f0ff27529c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.38.8 2024-09-14T11:38:57.284 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:57.285+0000 7f0ff27529c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.38.9 2024-09-14T11:38:57.285 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:57.285+0000 7f0ff27529c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.38.10 2024-09-14T11:38:57.285 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:57.285+0000 7f0ff27529c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.38 : hit (requested=0x17, cached=0x17) 2024-09-14T11:38:57.285 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:57.285+0000 7f0ff27529c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.38 2024-09-14T11:38:57.287 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:57.285+0000 7f0ff27529c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.38 info.flags=0x17 2024-09-14T11:38:57.287 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:57.285+0000 7f0ff27529c0 10 moving default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.38 to cache LRU end 2024-09-14T11:38:57.288 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:57.285+0000 7f0ff27529c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:38:57.288 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:57.285+0000 7f0ff27529c0 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-change-reshard-state:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.38, ofs0, ns] 2024-09-14T11:38:57.288 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:57.289+0000 7f0eceffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366237 cookie 94357098984704 notifier 7331 bl.length()=899 2024-09-14T11:38:57.288 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:57.289+0000 7f0eceffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.38 info.flags=0x17 2024-09-14T11:38:57.288 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:57.289+0000 7f0eceffd640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.38 to cache LRU end 2024-09-14T11:38:57.288 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:57.289+0000 7f0eceffd640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:38:57.291 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:57.289+0000 7f0ff27529c0 20 handle_bi_update(): bucket=:error-at-change-reshard-state[d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.38]): orig_sources= new_sources= 2024-09-14T11:38:57.291 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:57.289+0000 7f0ff27529c0 20 handle_bi_update(): bucket=:error-at-change-reshard-state[d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.38]): potential sources added=[] removed=[] 2024-09-14T11:38:57.291 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:57.289+0000 7f0ff27529c0 20 handle_bi_update(): bucket=:error-at-change-reshard-state[d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.38]): orig_dests= new_dests= 2024-09-14T11:38:57.291 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:57.289+0000 7f0ff27529c0 20 handle_bi_update(): bucket=:error-at-change-reshard-state[d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.38]): potential dests added=[] removed=[] 2024-09-14T11:38:57.296 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:57.297+0000 7f0ff27529c0 1 execute INFO: reshard of bucket "error-at-change-reshard-state" from 11 shards to 12 shards completed successfully 2024-09-14T11:38:57.300 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:57.301+0000 7f0ea67e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:38:57.305 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:57.305+0000 7f0ff27529c0 20 remove_watcher() i=0 2024-09-14T11:38:57.305 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:57.305+0000 7f0ff27529c0 2 removed watcher, disabling cache 2024-09-14T11:38:57.307 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:57.305+0000 7f0ff27529c0 20 remove_watcher() i=1 2024-09-14T11:38:57.310 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:57.309+0000 7f0ff27529c0 20 remove_watcher() i=2 2024-09-14T11:38:57.312 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:57.313+0000 7f0ff27529c0 20 remove_watcher() i=3 2024-09-14T11:38:57.314 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:57.313+0000 7f0ff27529c0 20 remove_watcher() i=4 2024-09-14T11:38:57.316 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:57.317+0000 7f0ff27529c0 20 remove_watcher() i=5 2024-09-14T11:38:57.317 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:57.317+0000 7f0ff27529c0 20 remove_watcher() i=6 2024-09-14T11:38:57.318 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:57.317+0000 7f0ff27529c0 20 remove_watcher() i=7 2024-09-14T11:38:57.333 INFO:tasks.workunit.client.0.smithi138.stderr:radosgw-admin bucket stats --bucket error-at-change-reshard-state 2024-09-14T11:38:57.361 INFO:tasks.workunit.client.0.smithi138.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:38:57.361 INFO:tasks.workunit.client.0.smithi138.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:38:57.405 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:57.405+0000 7f43773429c0 20 rados->read ofs=0 len=0 2024-09-14T11:38:57.407 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:57.405+0000 7f43773429c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:38:57.407 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:57.405+0000 7f43773429c0 20 realm 2024-09-14T11:38:57.407 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:57.405+0000 7f43773429c0 20 rados->read ofs=0 len=0 2024-09-14T11:38:57.407 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:57.405+0000 7f43773429c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:38:57.407 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:57.405+0000 7f43773429c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:38:57.407 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:57.405+0000 7f43773429c0 20 rados->read ofs=0 len=0 2024-09-14T11:38:57.407 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:57.405+0000 7f43773429c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:38:57.407 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:57.405+0000 7f43773429c0 20 rados->read ofs=0 len=0 2024-09-14T11:38:57.409 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:57.409+0000 7f43773429c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:38:57.409 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:57.409+0000 7f43773429c0 20 rados->read ofs=0 len=0 2024-09-14T11:38:57.410 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:57.409+0000 7f43773429c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:38:57.410 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:57.409+0000 7f43773429c0 20 searching for the correct realm 2024-09-14T11:38:57.414 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:57.413+0000 7f4374e48640 0 -- 172.21.15.138:0/2331085853 >> [v2:172.21.15.138:6808/3258321916,v1:172.21.15.138:6809/3258321916] conn(0x5619e4a2b450 msgr2=0x5619e4a2d910 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:38:57.421 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:57.421+0000 7f4374647640 0 -- 172.21.15.138:0/2331085853 >> [v2:172.21.15.138:6816/326481658,v1:172.21.15.138:6817/326481658] conn(0x7f436c00e040 msgr2=0x7f436c056970 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:38:57.429 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:57.429+0000 7f43773429c0 20 RGWRados::pool_iterate: got zone_info.d9e72d30-c60b-4d0d-9267-fdc36392d5ad 2024-09-14T11:38:57.429 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:57.429+0000 7f43773429c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:38:57.429 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:57.429+0000 7f43773429c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:38:57.429 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:57.429+0000 7f43773429c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:38:57.429 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:57.429+0000 7f43773429c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:38:57.429 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:57.429+0000 7f43773429c0 20 RGWRados::pool_iterate: got zonegroup_info.65ab941b-da8c-4160-94fb-3672b069d44f 2024-09-14T11:38:57.429 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:57.429+0000 7f43773429c0 20 rados->read ofs=0 len=0 2024-09-14T11:38:57.429 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:57.429+0000 7f43773429c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:38:57.429 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:57.429+0000 7f43773429c0 20 rados->read ofs=0 len=0 2024-09-14T11:38:57.430 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:57.429+0000 7f43773429c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:38:57.430 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:57.429+0000 7f43773429c0 20 rados->read ofs=0 len=0 2024-09-14T11:38:57.430 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:57.429+0000 7f43773429c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:38:57.431 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:57.429+0000 7f43773429c0 20 zone default found 2024-09-14T11:38:57.431 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:57.429+0000 7f43773429c0 4 Realm: () 2024-09-14T11:38:57.431 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:57.429+0000 7f43773429c0 4 ZoneGroup: default (65ab941b-da8c-4160-94fb-3672b069d44f) 2024-09-14T11:38:57.431 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:57.429+0000 7f43773429c0 4 Zone: default (d9e72d30-c60b-4d0d-9267-fdc36392d5ad) 2024-09-14T11:38:57.431 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:57.429+0000 7f43773429c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:38:57.431 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:57.429+0000 7f43773429c0 20 zonegroup default 2024-09-14T11:38:57.431 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:57.429+0000 7f43773429c0 20 rados->read ofs=0 len=0 2024-09-14T11:38:57.431 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:57.429+0000 7f43773429c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:38:57.431 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:57.429+0000 7f43773429c0 20 rados->read ofs=0 len=0 2024-09-14T11:38:57.432 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:57.429+0000 7f43773429c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:38:57.432 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:57.429+0000 7f43773429c0 20 rados->read ofs=0 len=0 2024-09-14T11:38:57.432 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:57.429+0000 7f43773429c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:38:57.432 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:57.429+0000 7f43773429c0 20 started sync module instance, tier type = 2024-09-14T11:38:57.432 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:57.429+0000 7f43773429c0 20 started zone id=d9e72d30-c60b-4d0d-9267-fdc36392d5ad (name=default) with tier type = 2024-09-14T11:38:57.447 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:57.445+0000 7f43773429c0 20 add_watcher() i=0 2024-09-14T11:38:57.447 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:57.445+0000 7f43773429c0 20 add_watcher() i=1 2024-09-14T11:38:57.447 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:57.445+0000 7f43773429c0 20 add_watcher() i=2 2024-09-14T11:38:57.447 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:57.445+0000 7f43773429c0 20 add_watcher() i=3 2024-09-14T11:38:57.447 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:57.445+0000 7f43773429c0 20 add_watcher() i=4 2024-09-14T11:38:57.447 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:57.445+0000 7f43773429c0 20 add_watcher() i=5 2024-09-14T11:38:57.447 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:57.445+0000 7f43773429c0 20 add_watcher() i=6 2024-09-14T11:38:57.448 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:57.449+0000 7f43773429c0 20 add_watcher() i=7 2024-09-14T11:38:57.448 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:57.449+0000 7f43773429c0 2 all 8 watchers are set, enabling cache 2024-09-14T11:38:57.450 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:57.449+0000 7f422afe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:38:57.451 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:57.449+0000 7f43773429c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:38:57.451 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:57.449+0000 7f43773429c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:38:57.451 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:57.449+0000 7f43773429c0 5 note: GC not initialized 2024-09-14T11:38:57.451 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:57.449+0000 7f4229fe3640 20 reqs_thread_entry: start 2024-09-14T11:38:57.451 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:57.449+0000 7f43773429c0 20 init_complete bucket index max shards: 11 2024-09-14T11:38:57.452 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:57.449+0000 7f43773429c0 20 Filter name: none 2024-09-14T11:38:57.452 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:57.449+0000 7f419b7fe640 20 reqs_thread_entry: start 2024-09-14T11:38:57.452 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:57.449+0000 7f43773429c0 20 rados->read ofs=0 len=0 2024-09-14T11:38:57.452 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:57.453+0000 7f43773429c0 20 rados_obj.operate() r=0 bl.length=197 2024-09-14T11:38:57.452 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:57.453+0000 7f43773429c0 20 rados->read ofs=0 len=0 2024-09-14T11:38:57.453 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:57.453+0000 7f43773429c0 20 rados_obj.operate() r=0 bl.length=419 2024-09-14T11:38:57.453 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:57.453+0000 7f43773429c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:38:57.453 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:57.453+0000 7f43773429c0 20 rados->read ofs=0 len=0 2024-09-14T11:38:57.454 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:57.453+0000 7f43773429c0 20 rados_obj.operate() r=0 bl.length=197 2024-09-14T11:38:57.454 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:57.453+0000 7f43773429c0 20 rados->read ofs=0 len=0 2024-09-14T11:38:57.454 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:57.453+0000 7f43773429c0 20 rados_obj.operate() r=0 bl.length=419 2024-09-14T11:38:57.454 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:57.453+0000 7f43773429c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:38:57.457 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:57.457+0000 7f422afe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:38:57.461 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:57.461+0000 7f43773429c0 20 remove_watcher() i=0 2024-09-14T11:38:57.462 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:57.461+0000 7f43773429c0 2 removed watcher, disabling cache 2024-09-14T11:38:57.463 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:57.461+0000 7f43773429c0 20 remove_watcher() i=1 2024-09-14T11:38:57.465 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:57.465+0000 7f43773429c0 20 remove_watcher() i=2 2024-09-14T11:38:57.467 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:57.465+0000 7f43773429c0 20 remove_watcher() i=3 2024-09-14T11:38:57.469 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:57.469+0000 7f43773429c0 20 remove_watcher() i=4 2024-09-14T11:38:57.470 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:57.469+0000 7f43773429c0 20 remove_watcher() i=5 2024-09-14T11:38:57.471 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:57.473+0000 7f43773429c0 20 remove_watcher() i=6 2024-09-14T11:38:57.473 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:38:57.473+0000 7f43773429c0 20 remove_watcher() i=7 2024-09-14T11:38:57.487 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-14T11:38:57.487 INFO:tasks.workunit.client.0.smithi138.stderr:BUCKET_STATS: 2024-09-14T11:38:57.487 INFO:tasks.workunit.client.0.smithi138.stderr:bucket: error-at-change-reshard-state id: d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.38 num_objects: 20 size_kb: 1 num_shards: 12 2024-09-14T11:38:57.487 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-14T11:38:57.488 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:38:57.488 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-14T11:38:57.511 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:38:57.511 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-14T11:38:57.988 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:38:57.989 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-14T11:38:58.366 INFO:tasks.workunit.client.0.smithi138.stderr:TEST: reshard bucket with abort at change_reshard_state 2024-09-14T11:38:58.366 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-14T11:38:58.369 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:38:58.369 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-14T11:38:58.514 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:38:58.515 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-14T11:38:58.604 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:38:58.604 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-14T11:38:58.712 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:38:58.713 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-14T11:38:58.802 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:38:58.802 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-14T11:38:58.898 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:38:58.898 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-14T11:38:58.997 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:38:58.997 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-14T11:38:59.094 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:38:59.094 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-14T11:38:59.190 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:38:59.190 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-14T11:38:59.295 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:38:59.295 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-14T11:38:59.405 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:38:59.405 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-14T11:38:59.506 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:38:59.506 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-14T11:38:59.608 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:38:59.608 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-14T11:38:59.768 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:38:59.768 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-14T11:38:59.883 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:38:59.883 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-14T11:38:59.993 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:38:59.993 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-14T11:39:00.098 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:39:00.099 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-14T11:39:00.203 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:39:00.203 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-14T11:39:00.299 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:39:00.425 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-14T11:39:00.426 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:39:00.426 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-14T11:39:00.520 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:39:00.520 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-14T11:39:00.659 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:39:00.659 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-14T11:39:00.792 INFO:tasks.workunit.client.0.smithi138.stderr:radosgw-admin bucket stats --bucket abort-at-change-reshard-state 2024-09-14T11:39:00.827 INFO:tasks.workunit.client.0.smithi138.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:39:00.827 INFO:tasks.workunit.client.0.smithi138.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:39:00.883 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:39:00.881+0000 7fea294f69c0 20 rados->read ofs=0 len=0 2024-09-14T11:39:00.885 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:39:00.885+0000 7fea294f69c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:39:00.885 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:39:00.885+0000 7fea294f69c0 20 realm 2024-09-14T11:39:00.885 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:39:00.885+0000 7fea294f69c0 20 rados->read ofs=0 len=0 2024-09-14T11:39:00.885 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:39:00.885+0000 7fea294f69c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:39:00.885 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:39:00.885+0000 7fea294f69c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:39:00.885 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:39:00.885+0000 7fea294f69c0 20 rados->read ofs=0 len=0 2024-09-14T11:39:00.886 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:39:00.885+0000 7fea294f69c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:39:00.886 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:39:00.885+0000 7fea294f69c0 20 rados->read ofs=0 len=0 2024-09-14T11:39:00.887 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:39:00.885+0000 7fea294f69c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:39:00.887 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:39:00.885+0000 7fea294f69c0 20 rados->read ofs=0 len=0 2024-09-14T11:39:00.888 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:39:00.889+0000 7fea294f69c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:39:00.888 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:39:00.889+0000 7fea294f69c0 20 searching for the correct realm 2024-09-14T11:39:00.892 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:39:00.893+0000 7fea277fd640 0 -- 172.21.15.138:0/3333019882 >> [v2:172.21.15.154:6824/416768175,v1:172.21.15.154:6825/416768175] conn(0x7fea200d7040 msgr2=0x7fea200d8940 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:39:01.108 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:39:01.109+0000 7fea267fb640 0 -- 172.21.15.138:0/3333019882 >> [v2:172.21.15.138:6816/326481658,v1:172.21.15.138:6817/326481658] conn(0x7fea200c1410 msgr2=0x7fea200c1890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:39:01.327 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:39:01.325+0000 7fea294f69c0 20 RGWRados::pool_iterate: got zone_info.d9e72d30-c60b-4d0d-9267-fdc36392d5ad 2024-09-14T11:39:01.327 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:39:01.325+0000 7fea294f69c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:39:01.327 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:39:01.325+0000 7fea294f69c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:39:01.328 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:39:01.325+0000 7fea294f69c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:39:01.328 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:39:01.325+0000 7fea294f69c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:39:01.328 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:39:01.325+0000 7fea294f69c0 20 RGWRados::pool_iterate: got zonegroup_info.65ab941b-da8c-4160-94fb-3672b069d44f 2024-09-14T11:39:01.328 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:39:01.325+0000 7fea294f69c0 20 rados->read ofs=0 len=0 2024-09-14T11:39:01.328 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:39:01.329+0000 7fea294f69c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:39:01.328 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:39:01.329+0000 7fea294f69c0 20 rados->read ofs=0 len=0 2024-09-14T11:39:01.329 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:39:01.329+0000 7fea294f69c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:39:01.329 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:39:01.329+0000 7fea294f69c0 20 rados->read ofs=0 len=0 2024-09-14T11:39:01.330 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:39:01.329+0000 7fea294f69c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:39:01.330 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:39:01.329+0000 7fea294f69c0 20 zone default found 2024-09-14T11:39:01.330 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:39:01.329+0000 7fea294f69c0 4 Realm: () 2024-09-14T11:39:01.330 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:39:01.329+0000 7fea294f69c0 4 ZoneGroup: default (65ab941b-da8c-4160-94fb-3672b069d44f) 2024-09-14T11:39:01.330 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:39:01.329+0000 7fea294f69c0 4 Zone: default (d9e72d30-c60b-4d0d-9267-fdc36392d5ad) 2024-09-14T11:39:01.330 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:39:01.329+0000 7fea294f69c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:39:01.330 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:39:01.329+0000 7fea294f69c0 20 zonegroup default 2024-09-14T11:39:01.330 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:39:01.329+0000 7fea294f69c0 20 rados->read ofs=0 len=0 2024-09-14T11:39:01.331 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:39:01.329+0000 7fea294f69c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:39:01.331 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:39:01.329+0000 7fea294f69c0 20 rados->read ofs=0 len=0 2024-09-14T11:39:01.331 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:39:01.329+0000 7fea294f69c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:39:01.331 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:39:01.329+0000 7fea294f69c0 20 rados->read ofs=0 len=0 2024-09-14T11:39:01.332 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:39:01.333+0000 7fea294f69c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:39:01.332 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:39:01.333+0000 7fea294f69c0 20 started sync module instance, tier type = 2024-09-14T11:39:01.332 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:39:01.333+0000 7fea294f69c0 20 started zone id=d9e72d30-c60b-4d0d-9267-fdc36392d5ad (name=default) with tier type = 2024-09-14T11:39:01.355 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:39:01.353+0000 7fea294f69c0 20 add_watcher() i=0 2024-09-14T11:39:01.355 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:39:01.353+0000 7fea294f69c0 20 add_watcher() i=1 2024-09-14T11:39:01.355 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:39:01.353+0000 7fea294f69c0 20 add_watcher() i=2 2024-09-14T11:39:01.356 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:39:01.353+0000 7fea294f69c0 20 add_watcher() i=3 2024-09-14T11:39:01.356 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:39:01.353+0000 7fea294f69c0 20 add_watcher() i=4 2024-09-14T11:39:01.356 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:39:01.353+0000 7fea294f69c0 20 add_watcher() i=5 2024-09-14T11:39:01.356 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:39:01.353+0000 7fea294f69c0 20 add_watcher() i=6 2024-09-14T11:39:01.357 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:39:01.357+0000 7fea294f69c0 20 add_watcher() i=7 2024-09-14T11:39:01.357 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:39:01.357+0000 7fea294f69c0 2 all 8 watchers are set, enabling cache 2024-09-14T11:39:01.361 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:39:01.361+0000 7fe8dd7e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:39:01.362 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:39:01.361+0000 7fea294f69c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:39:01.362 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:39:01.361+0000 7fea294f69c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:39:01.362 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:39:01.361+0000 7fea294f69c0 5 note: GC not initialized 2024-09-14T11:39:01.363 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:39:01.361+0000 7fe857fff640 20 reqs_thread_entry: start 2024-09-14T11:39:01.363 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:39:01.361+0000 7fea294f69c0 20 init_complete bucket index max shards: 11 2024-09-14T11:39:01.363 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:39:01.361+0000 7fea294f69c0 20 Filter name: none 2024-09-14T11:39:01.363 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:39:01.361+0000 7fe855ffb640 20 reqs_thread_entry: start 2024-09-14T11:39:01.363 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:39:01.361+0000 7fea294f69c0 20 rados->read ofs=0 len=0 2024-09-14T11:39:01.364 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:39:01.365+0000 7fea294f69c0 20 rados_obj.operate() r=0 bl.length=197 2024-09-14T11:39:01.364 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:39:01.365+0000 7fea294f69c0 20 rados->read ofs=0 len=0 2024-09-14T11:39:01.365 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:39:01.365+0000 7fea294f69c0 20 rados_obj.operate() r=0 bl.length=419 2024-09-14T11:39:01.365 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:39:01.365+0000 7fea294f69c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:39:01.365 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:39:01.365+0000 7fea294f69c0 20 rados->read ofs=0 len=0 2024-09-14T11:39:01.366 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:39:01.365+0000 7fea294f69c0 20 rados_obj.operate() r=0 bl.length=197 2024-09-14T11:39:01.366 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:39:01.365+0000 7fea294f69c0 20 rados->read ofs=0 len=0 2024-09-14T11:39:01.367 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:39:01.365+0000 7fea294f69c0 20 rados_obj.operate() r=0 bl.length=419 2024-09-14T11:39:01.367 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:39:01.365+0000 7fea294f69c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:39:01.370 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:39:01.369+0000 7fe8dd7e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:39:01.375 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:39:01.373+0000 7fea294f69c0 20 remove_watcher() i=0 2024-09-14T11:39:01.375 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:39:01.373+0000 7fea294f69c0 2 removed watcher, disabling cache 2024-09-14T11:39:01.377 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:39:01.377+0000 7fea294f69c0 20 remove_watcher() i=1 2024-09-14T11:39:01.379 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:39:01.377+0000 7fea294f69c0 20 remove_watcher() i=2 2024-09-14T11:39:01.381 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:39:01.381+0000 7fea294f69c0 20 remove_watcher() i=3 2024-09-14T11:39:01.383 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:39:01.381+0000 7fea294f69c0 20 remove_watcher() i=4 2024-09-14T11:39:01.384 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:39:01.385+0000 7fea294f69c0 20 remove_watcher() i=5 2024-09-14T11:39:01.386 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:39:01.385+0000 7fea294f69c0 20 remove_watcher() i=6 2024-09-14T11:39:01.387 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:39:01.385+0000 7fea294f69c0 20 remove_watcher() i=7 2024-09-14T11:39:01.403 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-14T11:39:01.403 INFO:tasks.workunit.client.0.smithi138.stderr:BUCKET_STATS: 2024-09-14T11:39:01.403 INFO:tasks.workunit.client.0.smithi138.stderr:bucket: abort-at-change-reshard-state id: d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.39 num_objects: 20 size_kb: 1 num_shards: 11 2024-09-14T11:39:01.403 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-14T11:39:01.403 INFO:tasks.workunit.client.0.smithi138.stderr:radosgw-admin bucket reshard --bucket abort-at-change-reshard-state --num-shards 12 --rgw-reshard-bucket-lock-duration 30 --inject-abort-at change_reshard_state 2024-09-14T11:39:01.442 INFO:tasks.workunit.client.0.smithi138.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:39:01.442 INFO:tasks.workunit.client.0.smithi138.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:39:01.490 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:39:01.489+0000 7fd1d37cc9c0 20 rados->read ofs=0 len=0 2024-09-14T11:39:01.492 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:39:01.493+0000 7fd1d37cc9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:39:01.492 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:39:01.493+0000 7fd1d37cc9c0 20 realm 2024-09-14T11:39:01.492 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:39:01.493+0000 7fd1d37cc9c0 20 rados->read ofs=0 len=0 2024-09-14T11:39:01.492 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:39:01.493+0000 7fd1d37cc9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:39:01.492 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:39:01.493+0000 7fd1d37cc9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:39:01.492 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:39:01.493+0000 7fd1d37cc9c0 20 rados->read ofs=0 len=0 2024-09-14T11:39:01.492 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:39:01.493+0000 7fd1d37cc9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:39:01.493 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:39:01.493+0000 7fd1d37cc9c0 20 rados->read ofs=0 len=0 2024-09-14T11:39:01.494 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:39:01.493+0000 7fd1d37cc9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:39:01.494 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:39:01.493+0000 7fd1d37cc9c0 20 rados->read ofs=0 len=0 2024-09-14T11:39:01.494 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:39:01.493+0000 7fd1d37cc9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:39:01.495 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:39:01.493+0000 7fd1d37cc9c0 20 searching for the correct realm 2024-09-14T11:39:01.498 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:39:01.497+0000 7fd1d1ad3640 0 -- 172.21.15.138:0/2620737197 >> [v2:172.21.15.154:6824/416768175,v1:172.21.15.154:6825/416768175] conn(0x7fd1cc041040 msgr2=0x7fd1cc041420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:39:01.712 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:39:01.713+0000 7fd1d0ad1640 0 -- 172.21.15.138:0/2620737197 >> [v2:172.21.15.138:6816/326481658,v1:172.21.15.138:6817/326481658] conn(0x7fd1cc016400 msgr2=0x7fd1cc016880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:39:01.932 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:39:01.929+0000 7fd1d37cc9c0 20 RGWRados::pool_iterate: got zone_info.d9e72d30-c60b-4d0d-9267-fdc36392d5ad 2024-09-14T11:39:01.932 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:39:01.929+0000 7fd1d37cc9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:39:01.932 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:39:01.929+0000 7fd1d37cc9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:39:01.932 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:39:01.929+0000 7fd1d37cc9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:39:01.932 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:39:01.929+0000 7fd1d37cc9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:39:01.932 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:39:01.929+0000 7fd1d37cc9c0 20 RGWRados::pool_iterate: got zonegroup_info.65ab941b-da8c-4160-94fb-3672b069d44f 2024-09-14T11:39:01.932 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:39:01.929+0000 7fd1d37cc9c0 20 rados->read ofs=0 len=0 2024-09-14T11:39:01.933 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:39:01.933+0000 7fd1d37cc9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:39:01.933 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:39:01.933+0000 7fd1d37cc9c0 20 rados->read ofs=0 len=0 2024-09-14T11:39:01.933 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:39:01.933+0000 7fd1d37cc9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:39:01.933 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:39:01.933+0000 7fd1d37cc9c0 20 rados->read ofs=0 len=0 2024-09-14T11:39:01.934 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:39:01.933+0000 7fd1d37cc9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:39:01.934 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:39:01.933+0000 7fd1d37cc9c0 20 zone default found 2024-09-14T11:39:01.934 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:39:01.933+0000 7fd1d37cc9c0 4 Realm: () 2024-09-14T11:39:01.934 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:39:01.933+0000 7fd1d37cc9c0 4 ZoneGroup: default (65ab941b-da8c-4160-94fb-3672b069d44f) 2024-09-14T11:39:01.934 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:39:01.933+0000 7fd1d37cc9c0 4 Zone: default (d9e72d30-c60b-4d0d-9267-fdc36392d5ad) 2024-09-14T11:39:01.934 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:39:01.933+0000 7fd1d37cc9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:39:01.934 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:39:01.933+0000 7fd1d37cc9c0 20 zonegroup default 2024-09-14T11:39:01.934 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:39:01.933+0000 7fd1d37cc9c0 20 rados->read ofs=0 len=0 2024-09-14T11:39:01.935 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:39:01.933+0000 7fd1d37cc9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:39:01.935 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:39:01.933+0000 7fd1d37cc9c0 20 rados->read ofs=0 len=0 2024-09-14T11:39:01.935 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:39:01.933+0000 7fd1d37cc9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:39:01.935 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:39:01.933+0000 7fd1d37cc9c0 20 rados->read ofs=0 len=0 2024-09-14T11:39:01.935 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:39:01.933+0000 7fd1d37cc9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:39:01.936 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:39:01.933+0000 7fd1d37cc9c0 20 started sync module instance, tier type = 2024-09-14T11:39:01.936 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:39:01.937+0000 7fd1d37cc9c0 20 started zone id=d9e72d30-c60b-4d0d-9267-fdc36392d5ad (name=default) with tier type = 2024-09-14T11:39:01.958 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:39:01.957+0000 7fd1d37cc9c0 20 add_watcher() i=0 2024-09-14T11:39:01.958 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:39:01.957+0000 7fd1d37cc9c0 20 add_watcher() i=1 2024-09-14T11:39:01.958 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:39:01.957+0000 7fd1d37cc9c0 20 add_watcher() i=2 2024-09-14T11:39:01.958 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:39:01.957+0000 7fd1d37cc9c0 20 add_watcher() i=3 2024-09-14T11:39:01.958 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:39:01.957+0000 7fd1d37cc9c0 20 add_watcher() i=4 2024-09-14T11:39:01.958 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:39:01.957+0000 7fd1d37cc9c0 20 add_watcher() i=5 2024-09-14T11:39:01.958 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:39:01.957+0000 7fd1d37cc9c0 20 add_watcher() i=6 2024-09-14T11:39:01.960 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:39:01.961+0000 7fd1d37cc9c0 20 add_watcher() i=7 2024-09-14T11:39:01.960 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:39:01.961+0000 7fd1d37cc9c0 2 all 8 watchers are set, enabling cache 2024-09-14T11:39:01.963 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:39:01.961+0000 7fd0877e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:39:01.964 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:39:01.965+0000 7fd1d37cc9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:39:01.964 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:39:01.965+0000 7fd1d37cc9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:39:01.964 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:39:01.965+0000 7fd1d37cc9c0 5 note: GC not initialized 2024-09-14T11:39:01.965 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:39:01.965+0000 7fd0867e4640 20 reqs_thread_entry: start 2024-09-14T11:39:01.965 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:39:01.965+0000 7fd1d37cc9c0 20 init_complete bucket index max shards: 11 2024-09-14T11:39:01.965 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:39:01.965+0000 7fd1d37cc9c0 20 Filter name: none 2024-09-14T11:39:01.965 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:39:01.965+0000 7fcff7fff640 20 reqs_thread_entry: start 2024-09-14T11:39:01.965 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:39:01.965+0000 7fd1d37cc9c0 10 cache get: name=default.rgw.meta+root+abort-at-change-reshard-state : miss 2024-09-14T11:39:01.965 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:39:01.965+0000 7fd1d37cc9c0 20 rados->read ofs=0 len=0 2024-09-14T11:39:01.966 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:39:01.965+0000 7fd1d37cc9c0 20 rados_obj.operate() r=0 bl.length=197 2024-09-14T11:39:01.966 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:39:01.965+0000 7fd1d37cc9c0 10 cache put: name=default.rgw.meta+root+abort-at-change-reshard-state info.flags=0x11 2024-09-14T11:39:01.966 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:39:01.965+0000 7fd1d37cc9c0 10 adding default.rgw.meta+root+abort-at-change-reshard-state to cache LRU end 2024-09-14T11:39:01.966 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:39:01.965+0000 7fd1d37cc9c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.39 : miss 2024-09-14T11:39:01.966 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:39:01.965+0000 7fd1d37cc9c0 20 rados->read ofs=0 len=0 2024-09-14T11:39:01.966 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:39:01.965+0000 7fd1d37cc9c0 20 rados_obj.operate() r=0 bl.length=419 2024-09-14T11:39:01.967 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:39:01.965+0000 7fd1d37cc9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.39 info.flags=0x17 2024-09-14T11:39:01.967 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:39:01.965+0000 7fd1d37cc9c0 10 adding default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.39 to cache LRU end 2024-09-14T11:39:01.967 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:39:01.965+0000 7fd1d37cc9c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:39:01.967 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:39:01.965+0000 7fd1d37cc9c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:39:01.967 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:39:01.965+0000 7fd1d37cc9c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.39 2024-09-14T11:39:01.979 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:39:01.977+0000 7fd1d37cc9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.39 info.flags=0x17 2024-09-14T11:39:01.979 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:39:01.977+0000 7fd1d37cc9c0 10 moving default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.39 to cache LRU end 2024-09-14T11:39:01.979 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:39:01.977+0000 7fd1d37cc9c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:39:01.979 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:39:01.977+0000 7fd1d37cc9c0 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-change-reshard-state:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.39, ofs0, ns] 2024-09-14T11:39:01.979 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:39:01.977+0000 7fd0a3fff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366175 cookie 94633467721168 notifier 7373 bl.length()=931 2024-09-14T11:39:01.979 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:39:01.977+0000 7fd0a3fff640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.39 info.flags=0x17 2024-09-14T11:39:01.979 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:39:01.977+0000 7fd0a3fff640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.39 to cache LRU end 2024-09-14T11:39:01.979 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:39:01.977+0000 7fd0a3fff640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:39:01.981 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:39:01.981+0000 7fd1d37cc9c0 20 handle_bi_update(): bucket=:abort-at-change-reshard-state[d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.39]): orig_sources= new_sources= 2024-09-14T11:39:01.981 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:39:01.981+0000 7fd1d37cc9c0 20 handle_bi_update(): bucket=:abort-at-change-reshard-state[d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.39]): potential sources added=[] removed=[] 2024-09-14T11:39:01.981 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:39:01.981+0000 7fd1d37cc9c0 20 handle_bi_update(): bucket=:abort-at-change-reshard-state[d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.39]): orig_dests= new_dests= 2024-09-14T11:39:01.981 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:39:01.981+0000 7fd1d37cc9c0 20 handle_bi_update(): bucket=:abort-at-change-reshard-state[d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.39]): potential dests added=[] removed=[] 2024-09-14T11:39:01.993 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:39:01.993+0000 7fd1d37cc9c0 10 bucket_obj is .dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.39.1.0 2024-09-14T11:39:01.993 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:39:01.993+0000 7fd1d37cc9c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.39.1.0 2024-09-14T11:39:01.993 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:39:01.993+0000 7fd1d37cc9c0 10 bucket_obj is .dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.39.1.1 2024-09-14T11:39:01.993 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:39:01.993+0000 7fd1d37cc9c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.39.1.1 2024-09-14T11:39:01.993 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:39:01.993+0000 7fd1d37cc9c0 10 bucket_obj is .dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.39.1.2 2024-09-14T11:39:01.993 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:39:01.993+0000 7fd1d37cc9c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.39.1.2 2024-09-14T11:39:01.993 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:39:01.993+0000 7fd1d37cc9c0 10 bucket_obj is .dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.39.1.3 2024-09-14T11:39:01.993 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:39:01.993+0000 7fd1d37cc9c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.39.1.3 2024-09-14T11:39:01.994 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:39:01.993+0000 7fd1d37cc9c0 10 bucket_obj is .dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.39.1.4 2024-09-14T11:39:01.994 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:39:01.993+0000 7fd1d37cc9c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.39.1.4 2024-09-14T11:39:01.994 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:39:01.993+0000 7fd1d37cc9c0 10 bucket_obj is .dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.39.1.5 2024-09-14T11:39:01.994 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:39:01.993+0000 7fd1d37cc9c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.39.1.5 2024-09-14T11:39:01.994 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:39:01.993+0000 7fd1d37cc9c0 10 bucket_obj is .dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.39.1.6 2024-09-14T11:39:01.994 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:39:01.993+0000 7fd1d37cc9c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.39.1.6 2024-09-14T11:39:01.994 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:39:01.993+0000 7fd1d37cc9c0 10 bucket_obj is .dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.39.1.7 2024-09-14T11:39:01.994 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:39:01.993+0000 7fd1d37cc9c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.39.1.7 2024-09-14T11:39:01.994 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:39:01.993+0000 7fd1d37cc9c0 10 bucket_obj is .dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.39.1.8 2024-09-14T11:39:01.994 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:39:01.993+0000 7fd1d37cc9c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.39.1.8 2024-09-14T11:39:01.994 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:39:01.993+0000 7fd1d37cc9c0 10 bucket_obj is .dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.39.1.9 2024-09-14T11:39:01.994 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:39:01.993+0000 7fd1d37cc9c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.39.1.9 2024-09-14T11:39:01.994 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:39:01.993+0000 7fd1d37cc9c0 10 bucket_obj is .dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.39.1.10 2024-09-14T11:39:01.995 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:39:01.993+0000 7fd1d37cc9c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.39.1.10 2024-09-14T11:39:01.995 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:39:01.993+0000 7fd1d37cc9c0 10 bucket_obj is .dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.39.1.11 2024-09-14T11:39:01.995 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:39:01.993+0000 7fd1d37cc9c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.39.1.11 2024-09-14T11:39:01.995 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:39:01.993+0000 7fd1d37cc9c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.39.0 2024-09-14T11:39:01.995 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:39:01.993+0000 7fd1d37cc9c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.39.1 2024-09-14T11:39:01.995 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:39:01.993+0000 7fd1d37cc9c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.39.2 2024-09-14T11:39:01.996 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:39:01.997+0000 7fd1d37cc9c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.39.3 2024-09-14T11:39:01.996 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:39:01.997+0000 7fd1d37cc9c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.39.4 2024-09-14T11:39:01.997 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:39:01.997+0000 7fd1d37cc9c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.39.5 2024-09-14T11:39:01.998 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:39:01.997+0000 7fd1d37cc9c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.39.6 2024-09-14T11:39:01.999 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:39:01.997+0000 7fd1d37cc9c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.39.7 2024-09-14T11:39:02.000 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:39:02.001+0000 7fd1d37cc9c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.39.8 2024-09-14T11:39:02.001 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:39:02.001+0000 7fd1d37cc9c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.39.9 2024-09-14T11:39:02.002 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:39:02.001+0000 7fd1d37cc9c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.39.10 2024-09-14T11:39:02.007 INFO:tasks.workunit.client.0.smithi138.stderr:./src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7fd1d37cc9c0 time 2024-09-14T11:39:02.012491+0000 2024-09-14T11:39:02.007 INFO:tasks.workunit.client.0.smithi138.stderr:./src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-14T11:39:02.009 INFO:tasks.workunit.client.0.smithi138.stderr: ceph version 19.3.0-4907-ga2782315 (a2782315255a3e7d5f6cdc9eb35785187ff6ddf8) squid (dev) 2024-09-14T11:39:02.009 INFO:tasks.workunit.client.0.smithi138.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x121) [0x7fd1d70a62eb] 2024-09-14T11:39:02.009 INFO:tasks.workunit.client.0.smithi138.stderr: 2: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7fd1d70a649f] 2024-09-14T11:39:02.009 INFO:tasks.workunit.client.0.smithi138.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x56118f2c1c01] 2024-09-14T11:39:02.009 INFO:tasks.workunit.client.0.smithi138.stderr: 4: (RGWBucketReshard::do_reshard(rgw::bucket_index_layout_generation const&, rgw::bucket_index_layout_generation const&, int, bool, bool, std::ostream*, ceph::Formatter*, FaultInjector > >&, DoutPrefixProvider const*, optional_yield)+0x1411) [0x56118f2d6231] 2024-09-14T11:39:02.009 INFO:tasks.workunit.client.0.smithi138.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0xac4) [0x56118f2d7884] 2024-09-14T11:39:02.009 INFO:tasks.workunit.client.0.smithi138.stderr: 6: main() 2024-09-14T11:39:02.009 INFO:tasks.workunit.client.0.smithi138.stderr: 7: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7fd1d5f0cd90] 2024-09-14T11:39:02.009 INFO:tasks.workunit.client.0.smithi138.stderr: 8: __libc_start_main() 2024-09-14T11:39:02.009 INFO:tasks.workunit.client.0.smithi138.stderr: 9: _start() 2024-09-14T11:39:02.009 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:39:02.009+0000 7fd1d37cc9c0 -1 ./src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7fd1d37cc9c0 time 2024-09-14T11:39:02.012491+0000 2024-09-14T11:39:02.010 INFO:tasks.workunit.client.0.smithi138.stderr:./src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-14T11:39:02.010 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-14T11:39:02.010 INFO:tasks.workunit.client.0.smithi138.stderr: ceph version 19.3.0-4907-ga2782315 (a2782315255a3e7d5f6cdc9eb35785187ff6ddf8) squid (dev) 2024-09-14T11:39:02.010 INFO:tasks.workunit.client.0.smithi138.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x121) [0x7fd1d70a62eb] 2024-09-14T11:39:02.010 INFO:tasks.workunit.client.0.smithi138.stderr: 2: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7fd1d70a649f] 2024-09-14T11:39:02.010 INFO:tasks.workunit.client.0.smithi138.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x56118f2c1c01] 2024-09-14T11:39:02.010 INFO:tasks.workunit.client.0.smithi138.stderr: 4: (RGWBucketReshard::do_reshard(rgw::bucket_index_layout_generation const&, rgw::bucket_index_layout_generation const&, int, bool, bool, std::ostream*, ceph::Formatter*, FaultInjector > >&, DoutPrefixProvider const*, optional_yield)+0x1411) [0x56118f2d6231] 2024-09-14T11:39:02.010 INFO:tasks.workunit.client.0.smithi138.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0xac4) [0x56118f2d7884] 2024-09-14T11:39:02.010 INFO:tasks.workunit.client.0.smithi138.stderr: 6: main() 2024-09-14T11:39:02.010 INFO:tasks.workunit.client.0.smithi138.stderr: 7: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7fd1d5f0cd90] 2024-09-14T11:39:02.010 INFO:tasks.workunit.client.0.smithi138.stderr: 8: __libc_start_main() 2024-09-14T11:39:02.010 INFO:tasks.workunit.client.0.smithi138.stderr: 9: _start() 2024-09-14T11:39:02.010 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-14T11:39:02.011 INFO:tasks.workunit.client.0.smithi138.stderr:*** Caught signal (Aborted) ** 2024-09-14T11:39:02.011 INFO:tasks.workunit.client.0.smithi138.stderr: in thread 7fd1d37cc9c0 thread_name:radosgw-admin 2024-09-14T11:39:02.026 INFO:tasks.workunit.client.0.smithi138.stderr: ceph version 19.3.0-4907-ga2782315 (a2782315255a3e7d5f6cdc9eb35785187ff6ddf8) squid (dev) 2024-09-14T11:39:02.026 INFO:tasks.workunit.client.0.smithi138.stderr: 1: /lib/x86_64-linux-gnu/libc.so.6(+0x42520) [0x7fd1d5f25520] 2024-09-14T11:39:02.026 INFO:tasks.workunit.client.0.smithi138.stderr: 2: pthread_kill() 2024-09-14T11:39:02.026 INFO:tasks.workunit.client.0.smithi138.stderr: 3: raise() 2024-09-14T11:39:02.027 INFO:tasks.workunit.client.0.smithi138.stderr: 4: abort() 2024-09-14T11:39:02.027 INFO:tasks.workunit.client.0.smithi138.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x17b) [0x7fd1d70a6345] 2024-09-14T11:39:02.027 INFO:tasks.workunit.client.0.smithi138.stderr: 6: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7fd1d70a649f] 2024-09-14T11:39:02.027 INFO:tasks.workunit.client.0.smithi138.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x56118f2c1c01] 2024-09-14T11:39:02.027 INFO:tasks.workunit.client.0.smithi138.stderr: 8: (RGWBucketReshard::do_reshard(rgw::bucket_index_layout_generation const&, rgw::bucket_index_layout_generation const&, int, bool, bool, std::ostream*, ceph::Formatter*, FaultInjector > >&, DoutPrefixProvider const*, optional_yield)+0x1411) [0x56118f2d6231] 2024-09-14T11:39:02.027 INFO:tasks.workunit.client.0.smithi138.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0xac4) [0x56118f2d7884] 2024-09-14T11:39:02.027 INFO:tasks.workunit.client.0.smithi138.stderr: 10: main() 2024-09-14T11:39:02.027 INFO:tasks.workunit.client.0.smithi138.stderr: 11: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7fd1d5f0cd90] 2024-09-14T11:39:02.027 INFO:tasks.workunit.client.0.smithi138.stderr: 12: __libc_start_main() 2024-09-14T11:39:02.027 INFO:tasks.workunit.client.0.smithi138.stderr: 13: _start() 2024-09-14T11:39:02.027 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:39:02.009+0000 7fd1d37cc9c0 -1 *** Caught signal (Aborted) ** 2024-09-14T11:39:02.027 INFO:tasks.workunit.client.0.smithi138.stderr: in thread 7fd1d37cc9c0 thread_name:radosgw-admin 2024-09-14T11:39:02.027 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-14T11:39:02.028 INFO:tasks.workunit.client.0.smithi138.stderr: ceph version 19.3.0-4907-ga2782315 (a2782315255a3e7d5f6cdc9eb35785187ff6ddf8) squid (dev) 2024-09-14T11:39:02.028 INFO:tasks.workunit.client.0.smithi138.stderr: 1: /lib/x86_64-linux-gnu/libc.so.6(+0x42520) [0x7fd1d5f25520] 2024-09-14T11:39:02.028 INFO:tasks.workunit.client.0.smithi138.stderr: 2: pthread_kill() 2024-09-14T11:39:02.028 INFO:tasks.workunit.client.0.smithi138.stderr: 3: raise() 2024-09-14T11:39:02.028 INFO:tasks.workunit.client.0.smithi138.stderr: 4: abort() 2024-09-14T11:39:02.028 INFO:tasks.workunit.client.0.smithi138.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x17b) [0x7fd1d70a6345] 2024-09-14T11:39:02.028 INFO:tasks.workunit.client.0.smithi138.stderr: 6: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7fd1d70a649f] 2024-09-14T11:39:02.028 INFO:tasks.workunit.client.0.smithi138.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x56118f2c1c01] 2024-09-14T11:39:02.028 INFO:tasks.workunit.client.0.smithi138.stderr: 8: (RGWBucketReshard::do_reshard(rgw::bucket_index_layout_generation const&, rgw::bucket_index_layout_generation const&, int, bool, bool, std::ostream*, ceph::Formatter*, FaultInjector > >&, DoutPrefixProvider const*, optional_yield)+0x1411) [0x56118f2d6231] 2024-09-14T11:39:02.028 INFO:tasks.workunit.client.0.smithi138.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0xac4) [0x56118f2d7884] 2024-09-14T11:39:02.028 INFO:tasks.workunit.client.0.smithi138.stderr: 10: main() 2024-09-14T11:39:02.028 INFO:tasks.workunit.client.0.smithi138.stderr: 11: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7fd1d5f0cd90] 2024-09-14T11:39:02.028 INFO:tasks.workunit.client.0.smithi138.stderr: 12: __libc_start_main() 2024-09-14T11:39:02.028 INFO:tasks.workunit.client.0.smithi138.stderr: 13: _start() 2024-09-14T11:39:02.029 INFO:tasks.workunit.client.0.smithi138.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-14T11:39:02.029 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-14T11:39:02.029 INFO:tasks.workunit.client.0.smithi138.stderr:--- begin dump of recent events --- 2024-09-14T11:39:02.029 INFO:tasks.workunit.client.0.smithi138.stderr: -499> 2024-09-14T11:39:01.469+0000 7fd1d37cc9c0 1 librados: setting wanted keys 2024-09-14T11:39:02.029 INFO:tasks.workunit.client.0.smithi138.stderr: -498> 2024-09-14T11:39:01.469+0000 7fd1d37cc9c0 1 librados: calling monclient init 2024-09-14T11:39:02.029 INFO:tasks.workunit.client.0.smithi138.stderr: -497> 2024-09-14T11:39:01.469+0000 7fd1d37cc9c0 10 monclient: init 2024-09-14T11:39:02.029 INFO:tasks.workunit.client.0.smithi138.stderr: -496> 2024-09-14T11:39:01.469+0000 7fd1d37cc9c0 5 AuthRegistry(0x5611922a2df0) adding auth protocol: cephx 2024-09-14T11:39:02.029 INFO:tasks.workunit.client.0.smithi138.stderr: -495> 2024-09-14T11:39:01.469+0000 7fd1d37cc9c0 5 AuthRegistry(0x5611922a2df0) adding auth protocol: cephx 2024-09-14T11:39:02.029 INFO:tasks.workunit.client.0.smithi138.stderr: -494> 2024-09-14T11:39:01.469+0000 7fd1d37cc9c0 5 AuthRegistry(0x5611922a2df0) adding auth protocol: cephx 2024-09-14T11:39:02.029 INFO:tasks.workunit.client.0.smithi138.stderr: -493> 2024-09-14T11:39:01.469+0000 7fd1d37cc9c0 5 AuthRegistry(0x5611922a2df0) adding con mode: secure 2024-09-14T11:39:02.029 INFO:tasks.workunit.client.0.smithi138.stderr: -492> 2024-09-14T11:39:01.469+0000 7fd1d37cc9c0 5 AuthRegistry(0x5611922a2df0) adding con mode: crc 2024-09-14T11:39:02.029 INFO:tasks.workunit.client.0.smithi138.stderr: -491> 2024-09-14T11:39:01.469+0000 7fd1d37cc9c0 5 AuthRegistry(0x5611922a2df0) adding con mode: secure 2024-09-14T11:39:02.029 INFO:tasks.workunit.client.0.smithi138.stderr: -490> 2024-09-14T11:39:01.469+0000 7fd1d37cc9c0 5 AuthRegistry(0x5611922a2df0) adding con mode: crc 2024-09-14T11:39:02.030 INFO:tasks.workunit.client.0.smithi138.stderr: -489> 2024-09-14T11:39:01.469+0000 7fd1d37cc9c0 5 AuthRegistry(0x5611922a2df0) adding con mode: secure 2024-09-14T11:39:02.030 INFO:tasks.workunit.client.0.smithi138.stderr: -488> 2024-09-14T11:39:01.469+0000 7fd1d37cc9c0 5 AuthRegistry(0x5611922a2df0) adding con mode: crc 2024-09-14T11:39:02.030 INFO:tasks.workunit.client.0.smithi138.stderr: -487> 2024-09-14T11:39:01.469+0000 7fd1d37cc9c0 5 AuthRegistry(0x5611922a2df0) adding con mode: crc 2024-09-14T11:39:02.030 INFO:tasks.workunit.client.0.smithi138.stderr: -486> 2024-09-14T11:39:01.469+0000 7fd1d37cc9c0 5 AuthRegistry(0x5611922a2df0) adding con mode: secure 2024-09-14T11:39:02.030 INFO:tasks.workunit.client.0.smithi138.stderr: -485> 2024-09-14T11:39:01.469+0000 7fd1d37cc9c0 5 AuthRegistry(0x5611922a2df0) adding con mode: crc 2024-09-14T11:39:02.030 INFO:tasks.workunit.client.0.smithi138.stderr: -484> 2024-09-14T11:39:01.469+0000 7fd1d37cc9c0 5 AuthRegistry(0x5611922a2df0) adding con mode: secure 2024-09-14T11:39:02.030 INFO:tasks.workunit.client.0.smithi138.stderr: -483> 2024-09-14T11:39:01.469+0000 7fd1d37cc9c0 5 AuthRegistry(0x5611922a2df0) adding con mode: crc 2024-09-14T11:39:02.030 INFO:tasks.workunit.client.0.smithi138.stderr: -482> 2024-09-14T11:39:01.469+0000 7fd1d37cc9c0 5 AuthRegistry(0x5611922a2df0) adding con mode: secure 2024-09-14T11:39:02.030 INFO:tasks.workunit.client.0.smithi138.stderr: -481> 2024-09-14T11:39:01.469+0000 7fd1d37cc9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:39:02.030 INFO:tasks.workunit.client.0.smithi138.stderr: -480> 2024-09-14T11:39:01.469+0000 7fd1d37cc9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:39:02.030 INFO:tasks.workunit.client.0.smithi138.stderr: -479> 2024-09-14T11:39:01.469+0000 7fd1d37cc9c0 5 asok(0x561192097d90) register_command rotate-key hook 0x5611922a2f38 2024-09-14T11:39:02.030 INFO:tasks.workunit.client.0.smithi138.stderr: -478> 2024-09-14T11:39:01.469+0000 7fd1d37cc9c0 10 monclient: _reopen_session rank -1 2024-09-14T11:39:02.030 INFO:tasks.workunit.client.0.smithi138.stderr: -477> 2024-09-14T11:39:01.469+0000 7fd1d37cc9c0 10 monclient: _add_conns ranks=[2,1,0] 2024-09-14T11:39:02.030 INFO:tasks.workunit.client.0.smithi138.stderr: -476> 2024-09-14T11:39:01.469+0000 7fd1d37cc9c0 10 monclient(hunting): picked mon.noname-c con 0x561192130740 addr [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] 2024-09-14T11:39:02.031 INFO:tasks.workunit.client.0.smithi138.stderr: -475> 2024-09-14T11:39:01.469+0000 7fd1d37cc9c0 10 monclient(hunting): picked mon.noname-b con 0x5611921e8120 addr [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] 2024-09-14T11:39:02.031 INFO:tasks.workunit.client.0.smithi138.stderr: -474> 2024-09-14T11:39:01.469+0000 7fd1d37cc9c0 10 monclient(hunting): picked mon.noname-a con 0x5611921ecaf0 addr [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] 2024-09-14T11:39:02.031 INFO:tasks.workunit.client.0.smithi138.stderr: -473> 2024-09-14T11:39:01.469+0000 7fd1d37cc9c0 10 monclient(hunting): start opening mon connection 2024-09-14T11:39:02.031 INFO:tasks.workunit.client.0.smithi138.stderr: -472> 2024-09-14T11:39:01.469+0000 7fd1d37cc9c0 10 monclient(hunting): start opening mon connection 2024-09-14T11:39:02.031 INFO:tasks.workunit.client.0.smithi138.stderr: -471> 2024-09-14T11:39:01.469+0000 7fd1d37cc9c0 10 monclient(hunting): start opening mon connection 2024-09-14T11:39:02.031 INFO:tasks.workunit.client.0.smithi138.stderr: -470> 2024-09-14T11:39:01.469+0000 7fd1d37cc9c0 10 monclient(hunting): _renew_subs 2024-09-14T11:39:02.031 INFO:tasks.workunit.client.0.smithi138.stderr: -469> 2024-09-14T11:39:01.469+0000 7fd1d37cc9c0 10 monclient(hunting): authenticate will time out at 2877.432797s 2024-09-14T11:39:02.031 INFO:tasks.workunit.client.0.smithi138.stderr: -468> 2024-09-14T11:39:01.469+0000 7fd1d12d2640 10 monclient(hunting): get_auth_request con 0x561192130740 auth_method 0 2024-09-14T11:39:02.031 INFO:tasks.workunit.client.0.smithi138.stderr: -467> 2024-09-14T11:39:01.469+0000 7fd1d12d2640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:39:02.031 INFO:tasks.workunit.client.0.smithi138.stderr: -466> 2024-09-14T11:39:01.469+0000 7fd1d12d2640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:39:02.031 INFO:tasks.workunit.client.0.smithi138.stderr: -465> 2024-09-14T11:39:01.469+0000 7fd1d12d2640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:39:02.031 INFO:tasks.workunit.client.0.smithi138.stderr: -464> 2024-09-14T11:39:01.469+0000 7fd1d1ad3640 10 monclient(hunting): get_auth_request con 0x5611921ecaf0 auth_method 0 2024-09-14T11:39:02.032 INFO:tasks.workunit.client.0.smithi138.stderr: -463> 2024-09-14T11:39:01.469+0000 7fd1d1ad3640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:39:02.032 INFO:tasks.workunit.client.0.smithi138.stderr: -462> 2024-09-14T11:39:01.469+0000 7fd1d1ad3640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:39:02.032 INFO:tasks.workunit.client.0.smithi138.stderr: -461> 2024-09-14T11:39:01.469+0000 7fd1d1ad3640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:39:02.032 INFO:tasks.workunit.client.0.smithi138.stderr: -460> 2024-09-14T11:39:01.469+0000 7fd1d12d2640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:39:02.032 INFO:tasks.workunit.client.0.smithi138.stderr: -459> 2024-09-14T11:39:01.469+0000 7fd1d12d2640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:39:02.032 INFO:tasks.workunit.client.0.smithi138.stderr: -458> 2024-09-14T11:39:01.469+0000 7fd1d12d2640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:39:02.032 INFO:tasks.workunit.client.0.smithi138.stderr: -457> 2024-09-14T11:39:01.469+0000 7fd1d1ad3640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:39:02.032 INFO:tasks.workunit.client.0.smithi138.stderr: -456> 2024-09-14T11:39:01.469+0000 7fd1d1ad3640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:39:02.032 INFO:tasks.workunit.client.0.smithi138.stderr: -455> 2024-09-14T11:39:01.469+0000 7fd1d1ad3640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:39:02.032 INFO:tasks.workunit.client.0.smithi138.stderr: -454> 2024-09-14T11:39:01.469+0000 7fd1d12d2640 10 monclient(hunting): handle_auth_done global_id 7364 payload 824 2024-09-14T11:39:02.032 INFO:tasks.workunit.client.0.smithi138.stderr: -453> 2024-09-14T11:39:01.469+0000 7fd1d12d2640 10 monclient: _finish_hunting 0 2024-09-14T11:39:02.032 INFO:tasks.workunit.client.0.smithi138.stderr: -452> 2024-09-14T11:39:01.469+0000 7fd1d12d2640 1 monclient: found mon.noname-c 2024-09-14T11:39:02.032 INFO:tasks.workunit.client.0.smithi138.stderr: -451> 2024-09-14T11:39:01.469+0000 7fd1d12d2640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.138:3301/0 2024-09-14T11:39:02.033 INFO:tasks.workunit.client.0.smithi138.stderr: -450> 2024-09-14T11:39:01.469+0000 7fd1d0ad1640 10 monclient: get_auth_request con 0x5611921e8120 auth_method 0 2024-09-14T11:39:02.033 INFO:tasks.workunit.client.0.smithi138.stderr: -449> 2024-09-14T11:39:01.469+0000 7fd0bde03640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:39:02.033 INFO:tasks.workunit.client.0.smithi138.stderr: -448> 2024-09-14T11:39:01.469+0000 7fd0bde03640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-14T11:39:02.033 INFO:tasks.workunit.client.0.smithi138.stderr: -447> 2024-09-14T11:39:01.469+0000 7fd0bde03640 10 monclient: dump: 2024-09-14T11:39:02.033 INFO:tasks.workunit.client.0.smithi138.stderr:epoch 1 2024-09-14T11:39:02.033 INFO:tasks.workunit.client.0.smithi138.stderr:fsid 3f225f43-83a6-4aeb-b798-1f04bb49d597 2024-09-14T11:39:02.033 INFO:tasks.workunit.client.0.smithi138.stderr:last_changed 2024-09-14T11:07:09.252780+0000 2024-09-14T11:39:02.033 INFO:tasks.workunit.client.0.smithi138.stderr:created 2024-09-14T11:07:09.252780+0000 2024-09-14T11:39:02.033 INFO:tasks.workunit.client.0.smithi138.stderr:min_mon_release 19 (squid) 2024-09-14T11:39:02.033 INFO:tasks.workunit.client.0.smithi138.stderr:election_strategy: 1 2024-09-14T11:39:02.033 INFO:tasks.workunit.client.0.smithi138.stderr:0: [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] mon.a 2024-09-14T11:39:02.033 INFO:tasks.workunit.client.0.smithi138.stderr:1: [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] mon.b 2024-09-14T11:39:02.033 INFO:tasks.workunit.client.0.smithi138.stderr:2: [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] mon.c 2024-09-14T11:39:02.033 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-14T11:39:02.033 INFO:tasks.workunit.client.0.smithi138.stderr: -446> 2024-09-14T11:39:01.469+0000 7fd0bde03640 10 monclient: _finish_auth 0 2024-09-14T11:39:02.034 INFO:tasks.workunit.client.0.smithi138.stderr: -445> 2024-09-14T11:39:01.469+0000 7fd0bde03640 10 monclient: _check_auth_tickets 2024-09-14T11:39:02.034 INFO:tasks.workunit.client.0.smithi138.stderr: -444> 2024-09-14T11:39:01.469+0000 7fd0bde03640 10 monclient: handle_config config(0 keys) 2024-09-14T11:39:02.034 INFO:tasks.workunit.client.0.smithi138.stderr: -443> 2024-09-14T11:39:01.469+0000 7fd0bde03640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:39:02.034 INFO:tasks.workunit.client.0.smithi138.stderr: -442> 2024-09-14T11:39:01.469+0000 7fd0bde03640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-14T11:39:02.034 INFO:tasks.workunit.client.0.smithi138.stderr: -441> 2024-09-14T11:39:01.469+0000 7fd0bde03640 10 monclient: dump: 2024-09-14T11:39:02.034 INFO:tasks.workunit.client.0.smithi138.stderr:epoch 1 2024-09-14T11:39:02.034 INFO:tasks.workunit.client.0.smithi138.stderr:fsid 3f225f43-83a6-4aeb-b798-1f04bb49d597 2024-09-14T11:39:02.034 INFO:tasks.workunit.client.0.smithi138.stderr:last_changed 2024-09-14T11:07:09.252780+0000 2024-09-14T11:39:02.034 INFO:tasks.workunit.client.0.smithi138.stderr:created 2024-09-14T11:07:09.252780+0000 2024-09-14T11:39:02.034 INFO:tasks.workunit.client.0.smithi138.stderr:min_mon_release 19 (squid) 2024-09-14T11:39:02.034 INFO:tasks.workunit.client.0.smithi138.stderr:election_strategy: 1 2024-09-14T11:39:02.034 INFO:tasks.workunit.client.0.smithi138.stderr:0: [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] mon.a 2024-09-14T11:39:02.034 INFO:tasks.workunit.client.0.smithi138.stderr:1: [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] mon.b 2024-09-14T11:39:02.034 INFO:tasks.workunit.client.0.smithi138.stderr:2: [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] mon.c 2024-09-14T11:39:02.035 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-14T11:39:02.035 INFO:tasks.workunit.client.0.smithi138.stderr: -440> 2024-09-14T11:39:01.469+0000 7fd0bf606640 4 set_mon_vals no callback set 2024-09-14T11:39:02.035 INFO:tasks.workunit.client.0.smithi138.stderr: -439> 2024-09-14T11:39:01.469+0000 7fd1d37cc9c0 5 monclient: authenticate success, global_id 7364 2024-09-14T11:39:02.035 INFO:tasks.workunit.client.0.smithi138.stderr: -438> 2024-09-14T11:39:01.469+0000 7fd1d37cc9c0 10 monclient: _renew_subs 2024-09-14T11:39:02.035 INFO:tasks.workunit.client.0.smithi138.stderr: -437> 2024-09-14T11:39:01.469+0000 7fd1d37cc9c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.138:3301/0 2024-09-14T11:39:02.035 INFO:tasks.workunit.client.0.smithi138.stderr: -436> 2024-09-14T11:39:01.469+0000 7fd1d37cc9c0 10 monclient: _renew_subs 2024-09-14T11:39:02.035 INFO:tasks.workunit.client.0.smithi138.stderr: -435> 2024-09-14T11:39:01.469+0000 7fd1d37cc9c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.138:3301/0 2024-09-14T11:39:02.035 INFO:tasks.workunit.client.0.smithi138.stderr: -434> 2024-09-14T11:39:01.469+0000 7fd1d37cc9c0 1 librados: init done 2024-09-14T11:39:02.035 INFO:tasks.workunit.client.0.smithi138.stderr: -433> 2024-09-14T11:39:01.473+0000 7fd0bde03640 4 mgrc handle_mgr_map Got map version 5 2024-09-14T11:39:02.035 INFO:tasks.workunit.client.0.smithi138.stderr: -432> 2024-09-14T11:39:01.473+0000 7fd0bde03640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.138:6832/3778043143,v1:172.21.15.138:6833/3778043143] 2024-09-14T11:39:02.035 INFO:tasks.workunit.client.0.smithi138.stderr: -431> 2024-09-14T11:39:01.473+0000 7fd0bde03640 4 mgrc reconnect Starting new session with [v2:172.21.15.138:6832/3778043143,v1:172.21.15.138:6833/3778043143] 2024-09-14T11:39:02.035 INFO:tasks.workunit.client.0.smithi138.stderr: -430> 2024-09-14T11:39:01.473+0000 7fd1d0ad1640 10 monclient: get_auth_request con 0x7fd0b80718a0 auth_method 0 2024-09-14T11:39:02.035 INFO:tasks.workunit.client.0.smithi138.stderr: -429> 2024-09-14T11:39:01.473+0000 7fd1d1ad3640 10 monclient: get_auth_request con 0x5611922ca230 auth_method 0 2024-09-14T11:39:02.035 INFO:tasks.workunit.client.0.smithi138.stderr: -428> 2024-09-14T11:39:01.473+0000 7fd1d12d2640 10 monclient: get_auth_request con 0x5611922edb90 auth_method 0 2024-09-14T11:39:02.035 INFO:tasks.workunit.client.0.smithi138.stderr: -427> 2024-09-14T11:39:01.473+0000 7fd1d0ad1640 10 monclient: get_auth_request con 0x5611922f1ef0 auth_method 0 2024-09-14T11:39:02.036 INFO:tasks.workunit.client.0.smithi138.stderr: -426> 2024-09-14T11:39:01.477+0000 7fd1d1ad3640 10 monclient: get_auth_request con 0x5611922f1410 auth_method 0 2024-09-14T11:39:02.036 INFO:tasks.workunit.client.0.smithi138.stderr: -425> 2024-09-14T11:39:01.477+0000 7fd1d37cc9c0 10 monclient: build_initial_monmap 2024-09-14T11:39:02.036 INFO:tasks.workunit.client.0.smithi138.stderr: -424> 2024-09-14T11:39:01.477+0000 7fd1d37cc9c0 1 build_initial for_mkfs: 0 2024-09-14T11:39:02.036 INFO:tasks.workunit.client.0.smithi138.stderr: -423> 2024-09-14T11:39:01.477+0000 7fd1d37cc9c0 10 monclient: monmap: 2024-09-14T11:39:02.036 INFO:tasks.workunit.client.0.smithi138.stderr:epoch 0 2024-09-14T11:39:02.036 INFO:tasks.workunit.client.0.smithi138.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-14T11:39:02.036 INFO:tasks.workunit.client.0.smithi138.stderr:last_changed 0.000000 2024-09-14T11:39:02.036 INFO:tasks.workunit.client.0.smithi138.stderr:created 0.000000 2024-09-14T11:39:02.036 INFO:tasks.workunit.client.0.smithi138.stderr:min_mon_release 0 (unknown) 2024-09-14T11:39:02.036 INFO:tasks.workunit.client.0.smithi138.stderr:election_strategy: 1 2024-09-14T11:39:02.036 INFO:tasks.workunit.client.0.smithi138.stderr:0: [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] mon.noname-a 2024-09-14T11:39:02.036 INFO:tasks.workunit.client.0.smithi138.stderr:1: [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] mon.noname-b 2024-09-14T11:39:02.036 INFO:tasks.workunit.client.0.smithi138.stderr:2: [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] mon.noname-c 2024-09-14T11:39:02.036 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-14T11:39:02.037 INFO:tasks.workunit.client.0.smithi138.stderr: -422> 2024-09-14T11:39:01.477+0000 7fd1d37cc9c0 5 AuthRegistry(0x5611922fa0e0) adding auth protocol: cephx 2024-09-14T11:39:02.037 INFO:tasks.workunit.client.0.smithi138.stderr: -421> 2024-09-14T11:39:01.477+0000 7fd1d37cc9c0 5 AuthRegistry(0x5611922fa0e0) adding auth protocol: cephx 2024-09-14T11:39:02.037 INFO:tasks.workunit.client.0.smithi138.stderr: -420> 2024-09-14T11:39:01.477+0000 7fd1d37cc9c0 5 AuthRegistry(0x5611922fa0e0) adding auth protocol: cephx 2024-09-14T11:39:02.037 INFO:tasks.workunit.client.0.smithi138.stderr: -419> 2024-09-14T11:39:01.477+0000 7fd1d37cc9c0 5 AuthRegistry(0x5611922fa0e0) adding con mode: secure 2024-09-14T11:39:02.037 INFO:tasks.workunit.client.0.smithi138.stderr: -418> 2024-09-14T11:39:01.477+0000 7fd1d37cc9c0 5 AuthRegistry(0x5611922fa0e0) adding con mode: crc 2024-09-14T11:39:02.037 INFO:tasks.workunit.client.0.smithi138.stderr: -417> 2024-09-14T11:39:01.477+0000 7fd1d37cc9c0 5 AuthRegistry(0x5611922fa0e0) adding con mode: secure 2024-09-14T11:39:02.037 INFO:tasks.workunit.client.0.smithi138.stderr: -416> 2024-09-14T11:39:01.477+0000 7fd1d37cc9c0 5 AuthRegistry(0x5611922fa0e0) adding con mode: crc 2024-09-14T11:39:02.037 INFO:tasks.workunit.client.0.smithi138.stderr: -415> 2024-09-14T11:39:01.477+0000 7fd1d37cc9c0 5 AuthRegistry(0x5611922fa0e0) adding con mode: secure 2024-09-14T11:39:02.037 INFO:tasks.workunit.client.0.smithi138.stderr: -414> 2024-09-14T11:39:01.477+0000 7fd1d37cc9c0 5 AuthRegistry(0x5611922fa0e0) adding con mode: crc 2024-09-14T11:39:02.037 INFO:tasks.workunit.client.0.smithi138.stderr: -413> 2024-09-14T11:39:01.477+0000 7fd1d37cc9c0 5 AuthRegistry(0x5611922fa0e0) adding con mode: crc 2024-09-14T11:39:02.037 INFO:tasks.workunit.client.0.smithi138.stderr: -412> 2024-09-14T11:39:01.477+0000 7fd1d37cc9c0 5 AuthRegistry(0x5611922fa0e0) adding con mode: secure 2024-09-14T11:39:02.037 INFO:tasks.workunit.client.0.smithi138.stderr: -411> 2024-09-14T11:39:01.477+0000 7fd1d37cc9c0 5 AuthRegistry(0x5611922fa0e0) adding con mode: crc 2024-09-14T11:39:02.037 INFO:tasks.workunit.client.0.smithi138.stderr: -410> 2024-09-14T11:39:01.477+0000 7fd1d37cc9c0 5 AuthRegistry(0x5611922fa0e0) adding con mode: secure 2024-09-14T11:39:02.037 INFO:tasks.workunit.client.0.smithi138.stderr: -409> 2024-09-14T11:39:01.477+0000 7fd1d37cc9c0 5 AuthRegistry(0x5611922fa0e0) adding con mode: crc 2024-09-14T11:39:02.037 INFO:tasks.workunit.client.0.smithi138.stderr: -408> 2024-09-14T11:39:01.477+0000 7fd1d37cc9c0 5 AuthRegistry(0x5611922fa0e0) adding con mode: secure 2024-09-14T11:39:02.038 INFO:tasks.workunit.client.0.smithi138.stderr: -407> 2024-09-14T11:39:01.477+0000 7fd1d37cc9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:39:02.038 INFO:tasks.workunit.client.0.smithi138.stderr: -406> 2024-09-14T11:39:01.477+0000 7fd1d37cc9c0 5 asok(0x561192097d90) register_command objecter_requests cmddesc objecter_requests hook 0x5611922fdad0 EEXIST 2024-09-14T11:39:02.038 INFO:tasks.workunit.client.0.smithi138.stderr: -405> 2024-09-14T11:39:01.477+0000 7fd1d37cc9c0 10 monclient: init 2024-09-14T11:39:02.038 INFO:tasks.workunit.client.0.smithi138.stderr: -404> 2024-09-14T11:39:01.477+0000 7fd1d37cc9c0 5 AuthRegistry(0x5611922f8fd8) adding auth protocol: cephx 2024-09-14T11:39:02.038 INFO:tasks.workunit.client.0.smithi138.stderr: -403> 2024-09-14T11:39:01.477+0000 7fd1d37cc9c0 5 AuthRegistry(0x5611922f8fd8) adding auth protocol: cephx 2024-09-14T11:39:02.038 INFO:tasks.workunit.client.0.smithi138.stderr: -402> 2024-09-14T11:39:01.477+0000 7fd1d37cc9c0 5 AuthRegistry(0x5611922f8fd8) adding auth protocol: cephx 2024-09-14T11:39:02.038 INFO:tasks.workunit.client.0.smithi138.stderr: -401> 2024-09-14T11:39:01.477+0000 7fd1d37cc9c0 5 AuthRegistry(0x5611922f8fd8) adding con mode: secure 2024-09-14T11:39:02.038 INFO:tasks.workunit.client.0.smithi138.stderr: -400> 2024-09-14T11:39:01.477+0000 7fd1d37cc9c0 5 AuthRegistry(0x5611922f8fd8) adding con mode: crc 2024-09-14T11:39:02.038 INFO:tasks.workunit.client.0.smithi138.stderr: -399> 2024-09-14T11:39:01.477+0000 7fd1d37cc9c0 5 AuthRegistry(0x5611922f8fd8) adding con mode: secure 2024-09-14T11:39:02.038 INFO:tasks.workunit.client.0.smithi138.stderr: -398> 2024-09-14T11:39:01.477+0000 7fd1d37cc9c0 5 AuthRegistry(0x5611922f8fd8) adding con mode: crc 2024-09-14T11:39:02.038 INFO:tasks.workunit.client.0.smithi138.stderr: -397> 2024-09-14T11:39:01.477+0000 7fd1d37cc9c0 5 AuthRegistry(0x5611922f8fd8) adding con mode: secure 2024-09-14T11:39:02.038 INFO:tasks.workunit.client.0.smithi138.stderr: -396> 2024-09-14T11:39:01.477+0000 7fd1d37cc9c0 5 AuthRegistry(0x5611922f8fd8) adding con mode: crc 2024-09-14T11:39:02.038 INFO:tasks.workunit.client.0.smithi138.stderr: -395> 2024-09-14T11:39:01.477+0000 7fd1d37cc9c0 5 AuthRegistry(0x5611922f8fd8) adding con mode: crc 2024-09-14T11:39:02.038 INFO:tasks.workunit.client.0.smithi138.stderr: -394> 2024-09-14T11:39:01.477+0000 7fd1d37cc9c0 5 AuthRegistry(0x5611922f8fd8) adding con mode: secure 2024-09-14T11:39:02.039 INFO:tasks.workunit.client.0.smithi138.stderr: -393> 2024-09-14T11:39:01.477+0000 7fd1d37cc9c0 5 AuthRegistry(0x5611922f8fd8) adding con mode: crc 2024-09-14T11:39:02.039 INFO:tasks.workunit.client.0.smithi138.stderr: -392> 2024-09-14T11:39:01.477+0000 7fd1d37cc9c0 5 AuthRegistry(0x5611922f8fd8) adding con mode: secure 2024-09-14T11:39:02.039 INFO:tasks.workunit.client.0.smithi138.stderr: -391> 2024-09-14T11:39:01.477+0000 7fd1d37cc9c0 5 AuthRegistry(0x5611922f8fd8) adding con mode: crc 2024-09-14T11:39:02.039 INFO:tasks.workunit.client.0.smithi138.stderr: -390> 2024-09-14T11:39:01.477+0000 7fd1d37cc9c0 5 AuthRegistry(0x5611922f8fd8) adding con mode: secure 2024-09-14T11:39:02.039 INFO:tasks.workunit.client.0.smithi138.stderr: -389> 2024-09-14T11:39:01.477+0000 7fd1d37cc9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:39:02.039 INFO:tasks.workunit.client.0.smithi138.stderr: -388> 2024-09-14T11:39:01.477+0000 7fd1d37cc9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:39:02.039 INFO:tasks.workunit.client.0.smithi138.stderr: -387> 2024-09-14T11:39:01.477+0000 7fd1d37cc9c0 5 asok(0x561192097d90) register_command rotate-key cmddesc rotate-key hook 0x5611922f9120 EEXIST 2024-09-14T11:39:02.039 INFO:tasks.workunit.client.0.smithi138.stderr: -386> 2024-09-14T11:39:01.477+0000 7fd1d37cc9c0 10 monclient: _reopen_session rank -1 2024-09-14T11:39:02.039 INFO:tasks.workunit.client.0.smithi138.stderr: -385> 2024-09-14T11:39:01.477+0000 7fd1d37cc9c0 10 monclient: _add_conns ranks=[0,1,2] 2024-09-14T11:39:02.039 INFO:tasks.workunit.client.0.smithi138.stderr: -384> 2024-09-14T11:39:01.477+0000 7fd1d37cc9c0 10 monclient(hunting): picked mon.noname-a con 0x561192321c80 addr [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] 2024-09-14T11:39:02.039 INFO:tasks.workunit.client.0.smithi138.stderr: -383> 2024-09-14T11:39:01.477+0000 7fd1d37cc9c0 10 monclient(hunting): picked mon.noname-b con 0x5611923215b0 addr [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] 2024-09-14T11:39:02.040 INFO:tasks.workunit.client.0.smithi138.stderr: -382> 2024-09-14T11:39:01.477+0000 7fd1d37cc9c0 10 monclient(hunting): picked mon.noname-c con 0x56119231ff90 addr [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] 2024-09-14T11:39:02.040 INFO:tasks.workunit.client.0.smithi138.stderr: -381> 2024-09-14T11:39:01.477+0000 7fd1d37cc9c0 10 monclient(hunting): start opening mon connection 2024-09-14T11:39:02.040 INFO:tasks.workunit.client.0.smithi138.stderr: -380> 2024-09-14T11:39:01.477+0000 7fd1d37cc9c0 10 monclient(hunting): start opening mon connection 2024-09-14T11:39:02.040 INFO:tasks.workunit.client.0.smithi138.stderr: -379> 2024-09-14T11:39:01.477+0000 7fd1d37cc9c0 10 monclient(hunting): start opening mon connection 2024-09-14T11:39:02.040 INFO:tasks.workunit.client.0.smithi138.stderr: -378> 2024-09-14T11:39:01.477+0000 7fd1d37cc9c0 10 monclient(hunting): _renew_subs 2024-09-14T11:39:02.040 INFO:tasks.workunit.client.0.smithi138.stderr: -377> 2024-09-14T11:39:01.477+0000 7fd1d37cc9c0 10 monclient(hunting): authenticate will time out at 2877.443557s 2024-09-14T11:39:02.040 INFO:tasks.workunit.client.0.smithi138.stderr: -376> 2024-09-14T11:39:01.477+0000 7fd1d0ad1640 10 monclient(hunting): get_auth_request con 0x561192321c80 auth_method 0 2024-09-14T11:39:02.040 INFO:tasks.workunit.client.0.smithi138.stderr: -375> 2024-09-14T11:39:01.477+0000 7fd1d0ad1640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:39:02.040 INFO:tasks.workunit.client.0.smithi138.stderr: -374> 2024-09-14T11:39:01.477+0000 7fd1d0ad1640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:39:02.040 INFO:tasks.workunit.client.0.smithi138.stderr: -373> 2024-09-14T11:39:01.477+0000 7fd1d0ad1640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:39:02.040 INFO:tasks.workunit.client.0.smithi138.stderr: -372> 2024-09-14T11:39:01.477+0000 7fd1d12d2640 10 monclient(hunting): get_auth_request con 0x56119231ff90 auth_method 0 2024-09-14T11:39:02.040 INFO:tasks.workunit.client.0.smithi138.stderr: -371> 2024-09-14T11:39:01.477+0000 7fd1d12d2640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:39:02.040 INFO:tasks.workunit.client.0.smithi138.stderr: -370> 2024-09-14T11:39:01.477+0000 7fd1d12d2640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:39:02.041 INFO:tasks.workunit.client.0.smithi138.stderr: -369> 2024-09-14T11:39:01.477+0000 7fd1d12d2640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:39:02.041 INFO:tasks.workunit.client.0.smithi138.stderr: -368> 2024-09-14T11:39:01.477+0000 7fd1d0ad1640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:39:02.041 INFO:tasks.workunit.client.0.smithi138.stderr: -367> 2024-09-14T11:39:01.477+0000 7fd1d0ad1640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:39:02.041 INFO:tasks.workunit.client.0.smithi138.stderr: -366> 2024-09-14T11:39:01.477+0000 7fd1d0ad1640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:39:02.041 INFO:tasks.workunit.client.0.smithi138.stderr: -365> 2024-09-14T11:39:01.477+0000 7fd1d12d2640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:39:02.041 INFO:tasks.workunit.client.0.smithi138.stderr: -364> 2024-09-14T11:39:01.477+0000 7fd1d12d2640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:39:02.041 INFO:tasks.workunit.client.0.smithi138.stderr: -363> 2024-09-14T11:39:01.477+0000 7fd1d12d2640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:39:02.041 INFO:tasks.workunit.client.0.smithi138.stderr: -362> 2024-09-14T11:39:01.477+0000 7fd1d1ad3640 10 monclient(hunting): get_auth_request con 0x5611923215b0 auth_method 0 2024-09-14T11:39:02.041 INFO:tasks.workunit.client.0.smithi138.stderr: -361> 2024-09-14T11:39:01.477+0000 7fd1d1ad3640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:39:02.041 INFO:tasks.workunit.client.0.smithi138.stderr: -360> 2024-09-14T11:39:01.477+0000 7fd1d1ad3640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:39:02.041 INFO:tasks.workunit.client.0.smithi138.stderr: -359> 2024-09-14T11:39:01.477+0000 7fd1d1ad3640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:39:02.041 INFO:tasks.workunit.client.0.smithi138.stderr: -358> 2024-09-14T11:39:01.481+0000 7fd1d1ad3640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:39:02.041 INFO:tasks.workunit.client.0.smithi138.stderr: -357> 2024-09-14T11:39:01.481+0000 7fd1d1ad3640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:39:02.041 INFO:tasks.workunit.client.0.smithi138.stderr: -356> 2024-09-14T11:39:01.481+0000 7fd1d1ad3640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:39:02.041 INFO:tasks.workunit.client.0.smithi138.stderr: -355> 2024-09-14T11:39:01.481+0000 7fd1d0ad1640 10 monclient(hunting): handle_auth_done global_id 7887 payload 824 2024-09-14T11:39:02.042 INFO:tasks.workunit.client.0.smithi138.stderr: -354> 2024-09-14T11:39:01.481+0000 7fd1d0ad1640 10 monclient: _finish_hunting 0 2024-09-14T11:39:02.042 INFO:tasks.workunit.client.0.smithi138.stderr: -353> 2024-09-14T11:39:01.481+0000 7fd1d0ad1640 1 monclient: found mon.noname-a 2024-09-14T11:39:02.042 INFO:tasks.workunit.client.0.smithi138.stderr: -352> 2024-09-14T11:39:01.481+0000 7fd1d0ad1640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.138:3300/0 2024-09-14T11:39:02.042 INFO:tasks.workunit.client.0.smithi138.stderr: -351> 2024-09-14T11:39:01.481+0000 7fd0b6ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:39:02.042 INFO:tasks.workunit.client.0.smithi138.stderr: -350> 2024-09-14T11:39:01.481+0000 7fd0b6ffd640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-14T11:39:02.042 INFO:tasks.workunit.client.0.smithi138.stderr: -349> 2024-09-14T11:39:01.481+0000 7fd0b6ffd640 10 monclient: dump: 2024-09-14T11:39:02.042 INFO:tasks.workunit.client.0.smithi138.stderr:epoch 1 2024-09-14T11:39:02.042 INFO:tasks.workunit.client.0.smithi138.stderr:fsid 3f225f43-83a6-4aeb-b798-1f04bb49d597 2024-09-14T11:39:02.042 INFO:tasks.workunit.client.0.smithi138.stderr:last_changed 2024-09-14T11:07:09.252780+0000 2024-09-14T11:39:02.042 INFO:tasks.workunit.client.0.smithi138.stderr:created 2024-09-14T11:07:09.252780+0000 2024-09-14T11:39:02.042 INFO:tasks.workunit.client.0.smithi138.stderr:min_mon_release 19 (squid) 2024-09-14T11:39:02.042 INFO:tasks.workunit.client.0.smithi138.stderr:election_strategy: 1 2024-09-14T11:39:02.042 INFO:tasks.workunit.client.0.smithi138.stderr:0: [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] mon.a 2024-09-14T11:39:02.042 INFO:tasks.workunit.client.0.smithi138.stderr:1: [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] mon.b 2024-09-14T11:39:02.042 INFO:tasks.workunit.client.0.smithi138.stderr:2: [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] mon.c 2024-09-14T11:39:02.043 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-14T11:39:02.043 INFO:tasks.workunit.client.0.smithi138.stderr: -348> 2024-09-14T11:39:01.481+0000 7fd0b6ffd640 10 monclient: _finish_auth 0 2024-09-14T11:39:02.043 INFO:tasks.workunit.client.0.smithi138.stderr: -347> 2024-09-14T11:39:01.481+0000 7fd0b6ffd640 10 monclient: _check_auth_tickets 2024-09-14T11:39:02.043 INFO:tasks.workunit.client.0.smithi138.stderr: -346> 2024-09-14T11:39:01.481+0000 7fd0b6ffd640 10 monclient: handle_config config(0 keys) 2024-09-14T11:39:02.043 INFO:tasks.workunit.client.0.smithi138.stderr: -345> 2024-09-14T11:39:01.481+0000 7fd0b6ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:39:02.043 INFO:tasks.workunit.client.0.smithi138.stderr: -344> 2024-09-14T11:39:01.481+0000 7fd0b6ffd640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-14T11:39:02.043 INFO:tasks.workunit.client.0.smithi138.stderr: -343> 2024-09-14T11:39:01.481+0000 7fd0b6ffd640 10 monclient: dump: 2024-09-14T11:39:02.043 INFO:tasks.workunit.client.0.smithi138.stderr:epoch 1 2024-09-14T11:39:02.043 INFO:tasks.workunit.client.0.smithi138.stderr:fsid 3f225f43-83a6-4aeb-b798-1f04bb49d597 2024-09-14T11:39:02.043 INFO:tasks.workunit.client.0.smithi138.stderr:last_changed 2024-09-14T11:07:09.252780+0000 2024-09-14T11:39:02.043 INFO:tasks.workunit.client.0.smithi138.stderr:created 2024-09-14T11:07:09.252780+0000 2024-09-14T11:39:02.043 INFO:tasks.workunit.client.0.smithi138.stderr:min_mon_release 19 (squid) 2024-09-14T11:39:02.043 INFO:tasks.workunit.client.0.smithi138.stderr:election_strategy: 1 2024-09-14T11:39:02.043 INFO:tasks.workunit.client.0.smithi138.stderr:0: [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] mon.a 2024-09-14T11:39:02.044 INFO:tasks.workunit.client.0.smithi138.stderr:1: [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] mon.b 2024-09-14T11:39:02.044 INFO:tasks.workunit.client.0.smithi138.stderr:2: [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] mon.c 2024-09-14T11:39:02.044 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-14T11:39:02.044 INFO:tasks.workunit.client.0.smithi138.stderr: -342> 2024-09-14T11:39:01.481+0000 7fd1d22d4640 4 set_mon_vals no callback set 2024-09-14T11:39:02.044 INFO:tasks.workunit.client.0.smithi138.stderr: -341> 2024-09-14T11:39:01.481+0000 7fd1d37cc9c0 5 monclient: authenticate success, global_id 7887 2024-09-14T11:39:02.044 INFO:tasks.workunit.client.0.smithi138.stderr: -340> 2024-09-14T11:39:01.481+0000 7fd1d37cc9c0 10 monclient: _renew_subs 2024-09-14T11:39:02.044 INFO:tasks.workunit.client.0.smithi138.stderr: -339> 2024-09-14T11:39:01.481+0000 7fd1d37cc9c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.138:3300/0 2024-09-14T11:39:02.044 INFO:tasks.workunit.client.0.smithi138.stderr: -338> 2024-09-14T11:39:01.481+0000 7fd1d37cc9c0 10 monclient: _renew_subs 2024-09-14T11:39:02.044 INFO:tasks.workunit.client.0.smithi138.stderr: -337> 2024-09-14T11:39:01.481+0000 7fd1d37cc9c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.138:3300/0 2024-09-14T11:39:02.044 INFO:tasks.workunit.client.0.smithi138.stderr: -336> 2024-09-14T11:39:01.481+0000 7fd0b6ffd640 4 mgrc handle_mgr_map Got map version 5 2024-09-14T11:39:02.044 INFO:tasks.workunit.client.0.smithi138.stderr: -335> 2024-09-14T11:39:01.481+0000 7fd0b6ffd640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.138:6832/3778043143,v1:172.21.15.138:6833/3778043143] 2024-09-14T11:39:02.044 INFO:tasks.workunit.client.0.smithi138.stderr: -334> 2024-09-14T11:39:01.481+0000 7fd0b6ffd640 4 mgrc reconnect Starting new session with [v2:172.21.15.138:6832/3778043143,v1:172.21.15.138:6833/3778043143] 2024-09-14T11:39:02.044 INFO:tasks.workunit.client.0.smithi138.stderr: -333> 2024-09-14T11:39:01.481+0000 7fd1d1ad3640 10 monclient: get_auth_request con 0x7fd0ac0717e0 auth_method 0 2024-09-14T11:39:02.044 INFO:tasks.workunit.client.0.smithi138.stderr: -332> 2024-09-14T11:39:01.481+0000 7fd1d37cc9c0 10 monclient: get_monmap_and_config 2024-09-14T11:39:02.045 INFO:tasks.workunit.client.0.smithi138.stderr: -331> 2024-09-14T11:39:01.481+0000 7fd1d37cc9c0 10 monclient: build_initial_monmap 2024-09-14T11:39:02.045 INFO:tasks.workunit.client.0.smithi138.stderr: -330> 2024-09-14T11:39:01.481+0000 7fd1d37cc9c0 1 build_initial for_mkfs: 0 2024-09-14T11:39:02.045 INFO:tasks.workunit.client.0.smithi138.stderr: -329> 2024-09-14T11:39:01.481+0000 7fd1d37cc9c0 10 monclient: monmap: 2024-09-14T11:39:02.045 INFO:tasks.workunit.client.0.smithi138.stderr:epoch 0 2024-09-14T11:39:02.045 INFO:tasks.workunit.client.0.smithi138.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-14T11:39:02.045 INFO:tasks.workunit.client.0.smithi138.stderr:last_changed 0.000000 2024-09-14T11:39:02.045 INFO:tasks.workunit.client.0.smithi138.stderr:created 0.000000 2024-09-14T11:39:02.045 INFO:tasks.workunit.client.0.smithi138.stderr:min_mon_release 0 (unknown) 2024-09-14T11:39:02.045 INFO:tasks.workunit.client.0.smithi138.stderr:election_strategy: 1 2024-09-14T11:39:02.045 INFO:tasks.workunit.client.0.smithi138.stderr:0: [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] mon.noname-a 2024-09-14T11:39:02.045 INFO:tasks.workunit.client.0.smithi138.stderr:1: [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] mon.noname-b 2024-09-14T11:39:02.045 INFO:tasks.workunit.client.0.smithi138.stderr:2: [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] mon.noname-c 2024-09-14T11:39:02.045 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-14T11:39:02.045 INFO:tasks.workunit.client.0.smithi138.stderr: -328> 2024-09-14T11:39:01.481+0000 7fd1d37cc9c0 5 AuthRegistry(0x561192341680) adding auth protocol: cephx 2024-09-14T11:39:02.045 INFO:tasks.workunit.client.0.smithi138.stderr: -327> 2024-09-14T11:39:01.481+0000 7fd1d37cc9c0 5 AuthRegistry(0x561192341680) adding auth protocol: cephx 2024-09-14T11:39:02.045 INFO:tasks.workunit.client.0.smithi138.stderr: -326> 2024-09-14T11:39:01.481+0000 7fd1d37cc9c0 5 AuthRegistry(0x561192341680) adding auth protocol: cephx 2024-09-14T11:39:02.046 INFO:tasks.workunit.client.0.smithi138.stderr: -325> 2024-09-14T11:39:01.481+0000 7fd1d37cc9c0 5 AuthRegistry(0x561192341680) adding con mode: secure 2024-09-14T11:39:02.046 INFO:tasks.workunit.client.0.smithi138.stderr: -324> 2024-09-14T11:39:01.481+0000 7fd1d37cc9c0 5 AuthRegistry(0x561192341680) adding con mode: crc 2024-09-14T11:39:02.046 INFO:tasks.workunit.client.0.smithi138.stderr: -323> 2024-09-14T11:39:01.481+0000 7fd1d37cc9c0 5 AuthRegistry(0x561192341680) adding con mode: secure 2024-09-14T11:39:02.046 INFO:tasks.workunit.client.0.smithi138.stderr: -322> 2024-09-14T11:39:01.481+0000 7fd1d37cc9c0 5 AuthRegistry(0x561192341680) adding con mode: crc 2024-09-14T11:39:02.046 INFO:tasks.workunit.client.0.smithi138.stderr: -321> 2024-09-14T11:39:01.481+0000 7fd1d37cc9c0 5 AuthRegistry(0x561192341680) adding con mode: secure 2024-09-14T11:39:02.046 INFO:tasks.workunit.client.0.smithi138.stderr: -320> 2024-09-14T11:39:01.481+0000 7fd1d37cc9c0 5 AuthRegistry(0x561192341680) adding con mode: crc 2024-09-14T11:39:02.046 INFO:tasks.workunit.client.0.smithi138.stderr: -319> 2024-09-14T11:39:01.481+0000 7fd1d37cc9c0 5 AuthRegistry(0x561192341680) adding con mode: crc 2024-09-14T11:39:02.046 INFO:tasks.workunit.client.0.smithi138.stderr: -318> 2024-09-14T11:39:01.481+0000 7fd1d37cc9c0 5 AuthRegistry(0x561192341680) adding con mode: secure 2024-09-14T11:39:02.046 INFO:tasks.workunit.client.0.smithi138.stderr: -317> 2024-09-14T11:39:01.481+0000 7fd1d37cc9c0 5 AuthRegistry(0x561192341680) adding con mode: crc 2024-09-14T11:39:02.046 INFO:tasks.workunit.client.0.smithi138.stderr: -316> 2024-09-14T11:39:01.481+0000 7fd1d37cc9c0 5 AuthRegistry(0x561192341680) adding con mode: secure 2024-09-14T11:39:02.046 INFO:tasks.workunit.client.0.smithi138.stderr: -315> 2024-09-14T11:39:01.481+0000 7fd1d37cc9c0 5 AuthRegistry(0x561192341680) adding con mode: crc 2024-09-14T11:39:02.046 INFO:tasks.workunit.client.0.smithi138.stderr: -314> 2024-09-14T11:39:01.481+0000 7fd1d37cc9c0 5 AuthRegistry(0x561192341680) adding con mode: secure 2024-09-14T11:39:02.046 INFO:tasks.workunit.client.0.smithi138.stderr: -313> 2024-09-14T11:39:01.485+0000 7fd1d37cc9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:39:02.047 INFO:tasks.workunit.client.0.smithi138.stderr: -312> 2024-09-14T11:39:01.485+0000 7fd1d37cc9c0 10 monclient: init 2024-09-14T11:39:02.047 INFO:tasks.workunit.client.0.smithi138.stderr: -311> 2024-09-14T11:39:01.485+0000 7fd1d37cc9c0 5 AuthRegistry(0x7ffff5249420) adding auth protocol: cephx 2024-09-14T11:39:02.047 INFO:tasks.workunit.client.0.smithi138.stderr: -310> 2024-09-14T11:39:01.485+0000 7fd1d37cc9c0 5 AuthRegistry(0x7ffff5249420) adding auth protocol: cephx 2024-09-14T11:39:02.047 INFO:tasks.workunit.client.0.smithi138.stderr: -309> 2024-09-14T11:39:01.485+0000 7fd1d37cc9c0 5 AuthRegistry(0x7ffff5249420) adding auth protocol: cephx 2024-09-14T11:39:02.047 INFO:tasks.workunit.client.0.smithi138.stderr: -308> 2024-09-14T11:39:01.485+0000 7fd1d37cc9c0 5 AuthRegistry(0x7ffff5249420) adding con mode: secure 2024-09-14T11:39:02.047 INFO:tasks.workunit.client.0.smithi138.stderr: -307> 2024-09-14T11:39:01.485+0000 7fd1d37cc9c0 5 AuthRegistry(0x7ffff5249420) adding con mode: crc 2024-09-14T11:39:02.047 INFO:tasks.workunit.client.0.smithi138.stderr: -306> 2024-09-14T11:39:01.485+0000 7fd1d37cc9c0 5 AuthRegistry(0x7ffff5249420) adding con mode: secure 2024-09-14T11:39:02.047 INFO:tasks.workunit.client.0.smithi138.stderr: -305> 2024-09-14T11:39:01.485+0000 7fd1d37cc9c0 5 AuthRegistry(0x7ffff5249420) adding con mode: crc 2024-09-14T11:39:02.047 INFO:tasks.workunit.client.0.smithi138.stderr: -304> 2024-09-14T11:39:01.485+0000 7fd1d37cc9c0 5 AuthRegistry(0x7ffff5249420) adding con mode: secure 2024-09-14T11:39:02.047 INFO:tasks.workunit.client.0.smithi138.stderr: -303> 2024-09-14T11:39:01.485+0000 7fd1d37cc9c0 5 AuthRegistry(0x7ffff5249420) adding con mode: crc 2024-09-14T11:39:02.047 INFO:tasks.workunit.client.0.smithi138.stderr: -302> 2024-09-14T11:39:01.485+0000 7fd1d37cc9c0 5 AuthRegistry(0x7ffff5249420) adding con mode: crc 2024-09-14T11:39:02.047 INFO:tasks.workunit.client.0.smithi138.stderr: -301> 2024-09-14T11:39:01.485+0000 7fd1d37cc9c0 5 AuthRegistry(0x7ffff5249420) adding con mode: secure 2024-09-14T11:39:02.047 INFO:tasks.workunit.client.0.smithi138.stderr: -300> 2024-09-14T11:39:01.485+0000 7fd1d37cc9c0 5 AuthRegistry(0x7ffff5249420) adding con mode: crc 2024-09-14T11:39:02.047 INFO:tasks.workunit.client.0.smithi138.stderr: -299> 2024-09-14T11:39:01.485+0000 7fd1d37cc9c0 5 AuthRegistry(0x7ffff5249420) adding con mode: secure 2024-09-14T11:39:02.048 INFO:tasks.workunit.client.0.smithi138.stderr: -298> 2024-09-14T11:39:01.485+0000 7fd1d37cc9c0 5 AuthRegistry(0x7ffff5249420) adding con mode: crc 2024-09-14T11:39:02.048 INFO:tasks.workunit.client.0.smithi138.stderr: -297> 2024-09-14T11:39:01.485+0000 7fd1d37cc9c0 5 AuthRegistry(0x7ffff5249420) adding con mode: secure 2024-09-14T11:39:02.048 INFO:tasks.workunit.client.0.smithi138.stderr: -296> 2024-09-14T11:39:01.485+0000 7fd1d37cc9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:39:02.048 INFO:tasks.workunit.client.0.smithi138.stderr: -295> 2024-09-14T11:39:01.485+0000 7fd1d37cc9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:39:02.048 INFO:tasks.workunit.client.0.smithi138.stderr: -294> 2024-09-14T11:39:01.485+0000 7fd1d37cc9c0 5 asok(0x561192097d90) register_command rotate-key cmddesc rotate-key hook 0x7ffff5249568 EEXIST 2024-09-14T11:39:02.048 INFO:tasks.workunit.client.0.smithi138.stderr: -293> 2024-09-14T11:39:01.485+0000 7fd1d37cc9c0 10 monclient: _reopen_session rank -1 2024-09-14T11:39:02.048 INFO:tasks.workunit.client.0.smithi138.stderr: -292> 2024-09-14T11:39:01.485+0000 7fd1d37cc9c0 10 monclient: _add_conns ranks=[1,0,2] 2024-09-14T11:39:02.048 INFO:tasks.workunit.client.0.smithi138.stderr: -291> 2024-09-14T11:39:01.485+0000 7fd1d37cc9c0 10 monclient(hunting): picked mon.noname-b con 0x561192345870 addr [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] 2024-09-14T11:39:02.048 INFO:tasks.workunit.client.0.smithi138.stderr: -290> 2024-09-14T11:39:01.485+0000 7fd1d37cc9c0 10 monclient(hunting): picked mon.noname-a con 0x561192375f20 addr [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] 2024-09-14T11:39:02.048 INFO:tasks.workunit.client.0.smithi138.stderr: -289> 2024-09-14T11:39:01.485+0000 7fd1d37cc9c0 10 monclient(hunting): picked mon.noname-c con 0x5611923710d0 addr [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] 2024-09-14T11:39:02.048 INFO:tasks.workunit.client.0.smithi138.stderr: -288> 2024-09-14T11:39:01.485+0000 7fd1d37cc9c0 10 monclient(hunting): start opening mon connection 2024-09-14T11:39:02.048 INFO:tasks.workunit.client.0.smithi138.stderr: -287> 2024-09-14T11:39:01.485+0000 7fd1d37cc9c0 10 monclient(hunting): start opening mon connection 2024-09-14T11:39:02.048 INFO:tasks.workunit.client.0.smithi138.stderr: -286> 2024-09-14T11:39:01.485+0000 7fd1d37cc9c0 10 monclient(hunting): start opening mon connection 2024-09-14T11:39:02.048 INFO:tasks.workunit.client.0.smithi138.stderr: -285> 2024-09-14T11:39:01.485+0000 7fd1d37cc9c0 10 monclient(hunting): _renew_subs 2024-09-14T11:39:02.049 INFO:tasks.workunit.client.0.smithi138.stderr: -284> 2024-09-14T11:39:01.485+0000 7fd1d37cc9c0 10 monclient(hunting): authenticate will time out at 2877.449064s 2024-09-14T11:39:02.049 INFO:tasks.workunit.client.0.smithi138.stderr: -283> 2024-09-14T11:39:01.485+0000 7fd1d1ad3640 10 monclient(hunting): get_auth_request con 0x561192375f20 auth_method 0 2024-09-14T11:39:02.049 INFO:tasks.workunit.client.0.smithi138.stderr: -282> 2024-09-14T11:39:01.485+0000 7fd1d1ad3640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:39:02.049 INFO:tasks.workunit.client.0.smithi138.stderr: -281> 2024-09-14T11:39:01.485+0000 7fd1d1ad3640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:39:02.049 INFO:tasks.workunit.client.0.smithi138.stderr: -280> 2024-09-14T11:39:01.485+0000 7fd1d1ad3640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:39:02.049 INFO:tasks.workunit.client.0.smithi138.stderr: -279> 2024-09-14T11:39:01.485+0000 7fd1d12d2640 10 monclient(hunting): get_auth_request con 0x5611923710d0 auth_method 0 2024-09-14T11:39:02.049 INFO:tasks.workunit.client.0.smithi138.stderr: -278> 2024-09-14T11:39:01.485+0000 7fd1d12d2640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:39:02.049 INFO:tasks.workunit.client.0.smithi138.stderr: -277> 2024-09-14T11:39:01.485+0000 7fd1d12d2640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:39:02.049 INFO:tasks.workunit.client.0.smithi138.stderr: -276> 2024-09-14T11:39:01.485+0000 7fd1d12d2640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:39:02.049 INFO:tasks.workunit.client.0.smithi138.stderr: -275> 2024-09-14T11:39:01.485+0000 7fd1d12d2640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:39:02.049 INFO:tasks.workunit.client.0.smithi138.stderr: -274> 2024-09-14T11:39:01.485+0000 7fd1d12d2640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:39:02.049 INFO:tasks.workunit.client.0.smithi138.stderr: -273> 2024-09-14T11:39:01.485+0000 7fd1d12d2640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:39:02.049 INFO:tasks.workunit.client.0.smithi138.stderr: -272> 2024-09-14T11:39:01.485+0000 7fd1d0ad1640 10 monclient(hunting): get_auth_request con 0x561192345870 auth_method 0 2024-09-14T11:39:02.049 INFO:tasks.workunit.client.0.smithi138.stderr: -271> 2024-09-14T11:39:01.485+0000 7fd1d0ad1640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:39:02.050 INFO:tasks.workunit.client.0.smithi138.stderr: -270> 2024-09-14T11:39:01.485+0000 7fd1d0ad1640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:39:02.050 INFO:tasks.workunit.client.0.smithi138.stderr: -269> 2024-09-14T11:39:01.485+0000 7fd1d0ad1640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:39:02.050 INFO:tasks.workunit.client.0.smithi138.stderr: -268> 2024-09-14T11:39:01.485+0000 7fd1d1ad3640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:39:02.050 INFO:tasks.workunit.client.0.smithi138.stderr: -267> 2024-09-14T11:39:01.485+0000 7fd1d1ad3640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:39:02.050 INFO:tasks.workunit.client.0.smithi138.stderr: -266> 2024-09-14T11:39:01.485+0000 7fd1d1ad3640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:39:02.050 INFO:tasks.workunit.client.0.smithi138.stderr: -265> 2024-09-14T11:39:01.485+0000 7fd1d12d2640 10 monclient(hunting): handle_auth_done global_id 7370 payload 274 2024-09-14T11:39:02.050 INFO:tasks.workunit.client.0.smithi138.stderr: -264> 2024-09-14T11:39:01.485+0000 7fd1d12d2640 10 monclient: _finish_hunting 0 2024-09-14T11:39:02.050 INFO:tasks.workunit.client.0.smithi138.stderr: -263> 2024-09-14T11:39:01.485+0000 7fd1d12d2640 1 monclient: found mon.noname-c 2024-09-14T11:39:02.050 INFO:tasks.workunit.client.0.smithi138.stderr: -262> 2024-09-14T11:39:01.485+0000 7fd1d12d2640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.138:3301/0 2024-09-14T11:39:02.050 INFO:tasks.workunit.client.0.smithi138.stderr: -261> 2024-09-14T11:39:01.485+0000 7fd0b4ff9640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:39:02.050 INFO:tasks.workunit.client.0.smithi138.stderr: -260> 2024-09-14T11:39:01.485+0000 7fd0b4ff9640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-14T11:39:02.050 INFO:tasks.workunit.client.0.smithi138.stderr: -259> 2024-09-14T11:39:01.485+0000 7fd0b4ff9640 10 monclient: dump: 2024-09-14T11:39:02.050 INFO:tasks.workunit.client.0.smithi138.stderr:epoch 1 2024-09-14T11:39:02.050 INFO:tasks.workunit.client.0.smithi138.stderr:fsid 3f225f43-83a6-4aeb-b798-1f04bb49d597 2024-09-14T11:39:02.050 INFO:tasks.workunit.client.0.smithi138.stderr:last_changed 2024-09-14T11:07:09.252780+0000 2024-09-14T11:39:02.051 INFO:tasks.workunit.client.0.smithi138.stderr:created 2024-09-14T11:07:09.252780+0000 2024-09-14T11:39:02.051 INFO:tasks.workunit.client.0.smithi138.stderr:min_mon_release 19 (squid) 2024-09-14T11:39:02.051 INFO:tasks.workunit.client.0.smithi138.stderr:election_strategy: 1 2024-09-14T11:39:02.051 INFO:tasks.workunit.client.0.smithi138.stderr:0: [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] mon.a 2024-09-14T11:39:02.051 INFO:tasks.workunit.client.0.smithi138.stderr:1: [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] mon.b 2024-09-14T11:39:02.051 INFO:tasks.workunit.client.0.smithi138.stderr:2: [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] mon.c 2024-09-14T11:39:02.051 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-14T11:39:02.051 INFO:tasks.workunit.client.0.smithi138.stderr: -258> 2024-09-14T11:39:01.485+0000 7fd0b4ff9640 10 monclient: _finish_auth 0 2024-09-14T11:39:02.051 INFO:tasks.workunit.client.0.smithi138.stderr: -257> 2024-09-14T11:39:01.485+0000 7fd0b4ff9640 10 monclient: _check_auth_tickets 2024-09-14T11:39:02.051 INFO:tasks.workunit.client.0.smithi138.stderr: -256> 2024-09-14T11:39:01.485+0000 7fd1d37cc9c0 5 monclient: authenticate success, global_id 7370 2024-09-14T11:39:02.051 INFO:tasks.workunit.client.0.smithi138.stderr: -255> 2024-09-14T11:39:01.485+0000 7fd0b4ff9640 10 monclient: handle_config config(0 keys) 2024-09-14T11:39:02.051 INFO:tasks.workunit.client.0.smithi138.stderr: -254> 2024-09-14T11:39:01.485+0000 7fd0b4ff9640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:39:02.051 INFO:tasks.workunit.client.0.smithi138.stderr: -253> 2024-09-14T11:39:01.485+0000 7fd0b4ff9640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-14T11:39:02.051 INFO:tasks.workunit.client.0.smithi138.stderr: -252> 2024-09-14T11:39:01.485+0000 7fd0b4ff9640 10 monclient: dump: 2024-09-14T11:39:02.052 INFO:tasks.workunit.client.0.smithi138.stderr:epoch 1 2024-09-14T11:39:02.052 INFO:tasks.workunit.client.0.smithi138.stderr:fsid 3f225f43-83a6-4aeb-b798-1f04bb49d597 2024-09-14T11:39:02.052 INFO:tasks.workunit.client.0.smithi138.stderr:last_changed 2024-09-14T11:07:09.252780+0000 2024-09-14T11:39:02.052 INFO:tasks.workunit.client.0.smithi138.stderr:created 2024-09-14T11:07:09.252780+0000 2024-09-14T11:39:02.052 INFO:tasks.workunit.client.0.smithi138.stderr:min_mon_release 19 (squid) 2024-09-14T11:39:02.052 INFO:tasks.workunit.client.0.smithi138.stderr:election_strategy: 1 2024-09-14T11:39:02.052 INFO:tasks.workunit.client.0.smithi138.stderr:0: [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] mon.a 2024-09-14T11:39:02.052 INFO:tasks.workunit.client.0.smithi138.stderr:1: [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] mon.b 2024-09-14T11:39:02.052 INFO:tasks.workunit.client.0.smithi138.stderr:2: [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] mon.c 2024-09-14T11:39:02.052 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-14T11:39:02.052 INFO:tasks.workunit.client.0.smithi138.stderr: -251> 2024-09-14T11:39:01.485+0000 7fd1d37cc9c0 10 monclient: get_monmap_and_config success 2024-09-14T11:39:02.052 INFO:tasks.workunit.client.0.smithi138.stderr: -250> 2024-09-14T11:39:01.485+0000 7fd1d37cc9c0 4 set_mon_vals no callback set 2024-09-14T11:39:02.052 INFO:tasks.workunit.client.0.smithi138.stderr: -249> 2024-09-14T11:39:01.485+0000 7fd1d37cc9c0 10 monclient: shutdown 2024-09-14T11:39:02.052 INFO:tasks.workunit.client.0.smithi138.stderr: -248> 2024-09-14T11:39:01.485+0000 7fd1d37cc9c0 10 monclient: build_initial_monmap 2024-09-14T11:39:02.053 INFO:tasks.workunit.client.0.smithi138.stderr: -247> 2024-09-14T11:39:01.485+0000 7fd1d37cc9c0 1 build_initial for_mkfs: 0 2024-09-14T11:39:02.053 INFO:tasks.workunit.client.0.smithi138.stderr: -246> 2024-09-14T11:39:01.485+0000 7fd1d37cc9c0 10 monclient: monmap: 2024-09-14T11:39:02.053 INFO:tasks.workunit.client.0.smithi138.stderr:epoch 0 2024-09-14T11:39:02.053 INFO:tasks.workunit.client.0.smithi138.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-14T11:39:02.053 INFO:tasks.workunit.client.0.smithi138.stderr:last_changed 0.000000 2024-09-14T11:39:02.053 INFO:tasks.workunit.client.0.smithi138.stderr:created 0.000000 2024-09-14T11:39:02.053 INFO:tasks.workunit.client.0.smithi138.stderr:min_mon_release 0 (unknown) 2024-09-14T11:39:02.053 INFO:tasks.workunit.client.0.smithi138.stderr:election_strategy: 1 2024-09-14T11:39:02.053 INFO:tasks.workunit.client.0.smithi138.stderr:0: [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] mon.noname-a 2024-09-14T11:39:02.053 INFO:tasks.workunit.client.0.smithi138.stderr:1: [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] mon.noname-b 2024-09-14T11:39:02.053 INFO:tasks.workunit.client.0.smithi138.stderr:2: [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] mon.noname-c 2024-09-14T11:39:02.053 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-14T11:39:02.053 INFO:tasks.workunit.client.0.smithi138.stderr: -245> 2024-09-14T11:39:01.485+0000 7fd1d37cc9c0 5 AuthRegistry(0x561192346800) adding auth protocol: cephx 2024-09-14T11:39:02.053 INFO:tasks.workunit.client.0.smithi138.stderr: -244> 2024-09-14T11:39:01.485+0000 7fd1d37cc9c0 5 AuthRegistry(0x561192346800) adding auth protocol: cephx 2024-09-14T11:39:02.054 INFO:tasks.workunit.client.0.smithi138.stderr: -243> 2024-09-14T11:39:01.485+0000 7fd1d37cc9c0 5 AuthRegistry(0x561192346800) adding auth protocol: cephx 2024-09-14T11:39:02.054 INFO:tasks.workunit.client.0.smithi138.stderr: -242> 2024-09-14T11:39:01.485+0000 7fd1d37cc9c0 5 AuthRegistry(0x561192346800) adding con mode: secure 2024-09-14T11:39:02.054 INFO:tasks.workunit.client.0.smithi138.stderr: -241> 2024-09-14T11:39:01.485+0000 7fd1d37cc9c0 5 AuthRegistry(0x561192346800) adding con mode: crc 2024-09-14T11:39:02.054 INFO:tasks.workunit.client.0.smithi138.stderr: -240> 2024-09-14T11:39:01.485+0000 7fd1d37cc9c0 5 AuthRegistry(0x561192346800) adding con mode: secure 2024-09-14T11:39:02.054 INFO:tasks.workunit.client.0.smithi138.stderr: -239> 2024-09-14T11:39:01.485+0000 7fd1d37cc9c0 5 AuthRegistry(0x561192346800) adding con mode: crc 2024-09-14T11:39:02.054 INFO:tasks.workunit.client.0.smithi138.stderr: -238> 2024-09-14T11:39:01.485+0000 7fd1d37cc9c0 5 AuthRegistry(0x561192346800) adding con mode: secure 2024-09-14T11:39:02.054 INFO:tasks.workunit.client.0.smithi138.stderr: -237> 2024-09-14T11:39:01.485+0000 7fd1d37cc9c0 5 AuthRegistry(0x561192346800) adding con mode: crc 2024-09-14T11:39:02.054 INFO:tasks.workunit.client.0.smithi138.stderr: -236> 2024-09-14T11:39:01.485+0000 7fd1d37cc9c0 5 AuthRegistry(0x561192346800) adding con mode: crc 2024-09-14T11:39:02.054 INFO:tasks.workunit.client.0.smithi138.stderr: -235> 2024-09-14T11:39:01.485+0000 7fd1d37cc9c0 5 AuthRegistry(0x561192346800) adding con mode: secure 2024-09-14T11:39:02.054 INFO:tasks.workunit.client.0.smithi138.stderr: -234> 2024-09-14T11:39:01.485+0000 7fd1d37cc9c0 5 AuthRegistry(0x561192346800) adding con mode: crc 2024-09-14T11:39:02.054 INFO:tasks.workunit.client.0.smithi138.stderr: -233> 2024-09-14T11:39:01.485+0000 7fd1d37cc9c0 5 AuthRegistry(0x561192346800) adding con mode: secure 2024-09-14T11:39:02.054 INFO:tasks.workunit.client.0.smithi138.stderr: -232> 2024-09-14T11:39:01.485+0000 7fd1d37cc9c0 5 AuthRegistry(0x561192346800) adding con mode: crc 2024-09-14T11:39:02.054 INFO:tasks.workunit.client.0.smithi138.stderr: -231> 2024-09-14T11:39:01.485+0000 7fd1d37cc9c0 5 AuthRegistry(0x561192346800) adding con mode: secure 2024-09-14T11:39:02.054 INFO:tasks.workunit.client.0.smithi138.stderr: -230> 2024-09-14T11:39:01.485+0000 7fd1d37cc9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:39:02.055 INFO:tasks.workunit.client.0.smithi138.stderr: -229> 2024-09-14T11:39:01.485+0000 7fd1d37cc9c0 1 librados: starting msgr at 2024-09-14T11:39:02.055 INFO:tasks.workunit.client.0.smithi138.stderr: -228> 2024-09-14T11:39:01.485+0000 7fd1d37cc9c0 1 librados: starting objecter 2024-09-14T11:39:02.055 INFO:tasks.workunit.client.0.smithi138.stderr: -227> 2024-09-14T11:39:01.485+0000 7fd1d37cc9c0 5 asok(0x561192097d90) register_command objecter_requests cmddesc objecter_requests hook 0x561192372c80 EEXIST 2024-09-14T11:39:02.055 INFO:tasks.workunit.client.0.smithi138.stderr: -226> 2024-09-14T11:39:01.485+0000 7fd1d37cc9c0 1 librados: setting wanted keys 2024-09-14T11:39:02.055 INFO:tasks.workunit.client.0.smithi138.stderr: -225> 2024-09-14T11:39:01.485+0000 7fd1d37cc9c0 1 librados: calling monclient init 2024-09-14T11:39:02.055 INFO:tasks.workunit.client.0.smithi138.stderr: -224> 2024-09-14T11:39:01.485+0000 7fd1d37cc9c0 10 monclient: init 2024-09-14T11:39:02.055 INFO:tasks.workunit.client.0.smithi138.stderr: -223> 2024-09-14T11:39:01.485+0000 7fd1d37cc9c0 5 AuthRegistry(0x561192323aa0) adding auth protocol: cephx 2024-09-14T11:39:02.055 INFO:tasks.workunit.client.0.smithi138.stderr: -222> 2024-09-14T11:39:01.485+0000 7fd1d37cc9c0 5 AuthRegistry(0x561192323aa0) adding auth protocol: cephx 2024-09-14T11:39:02.055 INFO:tasks.workunit.client.0.smithi138.stderr: -221> 2024-09-14T11:39:01.485+0000 7fd1d37cc9c0 5 AuthRegistry(0x561192323aa0) adding auth protocol: cephx 2024-09-14T11:39:02.055 INFO:tasks.workunit.client.0.smithi138.stderr: -220> 2024-09-14T11:39:01.485+0000 7fd1d37cc9c0 5 AuthRegistry(0x561192323aa0) adding con mode: secure 2024-09-14T11:39:02.055 INFO:tasks.workunit.client.0.smithi138.stderr: -219> 2024-09-14T11:39:01.485+0000 7fd1d37cc9c0 5 AuthRegistry(0x561192323aa0) adding con mode: crc 2024-09-14T11:39:02.055 INFO:tasks.workunit.client.0.smithi138.stderr: -218> 2024-09-14T11:39:01.485+0000 7fd1d37cc9c0 5 AuthRegistry(0x561192323aa0) adding con mode: secure 2024-09-14T11:39:02.055 INFO:tasks.workunit.client.0.smithi138.stderr: -217> 2024-09-14T11:39:01.485+0000 7fd1d37cc9c0 5 AuthRegistry(0x561192323aa0) adding con mode: crc 2024-09-14T11:39:02.055 INFO:tasks.workunit.client.0.smithi138.stderr: -216> 2024-09-14T11:39:01.485+0000 7fd1d37cc9c0 5 AuthRegistry(0x561192323aa0) adding con mode: secure 2024-09-14T11:39:02.056 INFO:tasks.workunit.client.0.smithi138.stderr: -215> 2024-09-14T11:39:01.485+0000 7fd1d37cc9c0 5 AuthRegistry(0x561192323aa0) adding con mode: crc 2024-09-14T11:39:02.056 INFO:tasks.workunit.client.0.smithi138.stderr: -214> 2024-09-14T11:39:01.485+0000 7fd1d37cc9c0 5 AuthRegistry(0x561192323aa0) adding con mode: crc 2024-09-14T11:39:02.056 INFO:tasks.workunit.client.0.smithi138.stderr: -213> 2024-09-14T11:39:01.485+0000 7fd1d37cc9c0 5 AuthRegistry(0x561192323aa0) adding con mode: secure 2024-09-14T11:39:02.056 INFO:tasks.workunit.client.0.smithi138.stderr: -212> 2024-09-14T11:39:01.485+0000 7fd1d37cc9c0 5 AuthRegistry(0x561192323aa0) adding con mode: crc 2024-09-14T11:39:02.056 INFO:tasks.workunit.client.0.smithi138.stderr: -211> 2024-09-14T11:39:01.485+0000 7fd1d37cc9c0 5 AuthRegistry(0x561192323aa0) adding con mode: secure 2024-09-14T11:39:02.056 INFO:tasks.workunit.client.0.smithi138.stderr: -210> 2024-09-14T11:39:01.485+0000 7fd1d37cc9c0 5 AuthRegistry(0x561192323aa0) adding con mode: crc 2024-09-14T11:39:02.056 INFO:tasks.workunit.client.0.smithi138.stderr: -209> 2024-09-14T11:39:01.485+0000 7fd1d37cc9c0 5 AuthRegistry(0x561192323aa0) adding con mode: secure 2024-09-14T11:39:02.056 INFO:tasks.workunit.client.0.smithi138.stderr: -208> 2024-09-14T11:39:01.485+0000 7fd1d37cc9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:39:02.056 INFO:tasks.workunit.client.0.smithi138.stderr: -207> 2024-09-14T11:39:01.485+0000 7fd1d37cc9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:39:02.056 INFO:tasks.workunit.client.0.smithi138.stderr: -206> 2024-09-14T11:39:01.485+0000 7fd1d37cc9c0 5 asok(0x561192097d90) register_command rotate-key cmddesc rotate-key hook 0x561192323be8 EEXIST 2024-09-14T11:39:02.056 INFO:tasks.workunit.client.0.smithi138.stderr: -205> 2024-09-14T11:39:01.485+0000 7fd1d37cc9c0 10 monclient: _reopen_session rank -1 2024-09-14T11:39:02.056 INFO:tasks.workunit.client.0.smithi138.stderr: -204> 2024-09-14T11:39:01.485+0000 7fd1d37cc9c0 10 monclient: _add_conns ranks=[2,1,0] 2024-09-14T11:39:02.056 INFO:tasks.workunit.client.0.smithi138.stderr: -203> 2024-09-14T11:39:01.489+0000 7fd1d37cc9c0 10 monclient(hunting): picked mon.noname-c con 0x561192345870 addr [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] 2024-09-14T11:39:02.056 INFO:tasks.workunit.client.0.smithi138.stderr: -202> 2024-09-14T11:39:01.489+0000 7fd1d37cc9c0 10 monclient(hunting): picked mon.noname-b con 0x5611923710d0 addr [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] 2024-09-14T11:39:02.056 INFO:tasks.workunit.client.0.smithi138.stderr: -201> 2024-09-14T11:39:01.489+0000 7fd1d37cc9c0 10 monclient(hunting): picked mon.noname-a con 0x561192375f20 addr [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] 2024-09-14T11:39:02.057 INFO:tasks.workunit.client.0.smithi138.stderr: -200> 2024-09-14T11:39:01.489+0000 7fd1d37cc9c0 10 monclient(hunting): start opening mon connection 2024-09-14T11:39:02.057 INFO:tasks.workunit.client.0.smithi138.stderr: -199> 2024-09-14T11:39:01.489+0000 7fd1d37cc9c0 10 monclient(hunting): start opening mon connection 2024-09-14T11:39:02.057 INFO:tasks.workunit.client.0.smithi138.stderr: -198> 2024-09-14T11:39:01.489+0000 7fd1d37cc9c0 10 monclient(hunting): start opening mon connection 2024-09-14T11:39:02.057 INFO:tasks.workunit.client.0.smithi138.stderr: -197> 2024-09-14T11:39:01.489+0000 7fd1d37cc9c0 10 monclient(hunting): _renew_subs 2024-09-14T11:39:02.057 INFO:tasks.workunit.client.0.smithi138.stderr: -196> 2024-09-14T11:39:01.489+0000 7fd1d37cc9c0 10 monclient(hunting): authenticate will time out at 2877.452228s 2024-09-14T11:39:02.057 INFO:tasks.workunit.client.0.smithi138.stderr: -195> 2024-09-14T11:39:01.489+0000 7fd1d12d2640 10 monclient(hunting): get_auth_request con 0x561192375f20 auth_method 0 2024-09-14T11:39:02.057 INFO:tasks.workunit.client.0.smithi138.stderr: -194> 2024-09-14T11:39:01.489+0000 7fd1d12d2640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:39:02.057 INFO:tasks.workunit.client.0.smithi138.stderr: -193> 2024-09-14T11:39:01.489+0000 7fd1d12d2640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:39:02.057 INFO:tasks.workunit.client.0.smithi138.stderr: -192> 2024-09-14T11:39:01.489+0000 7fd1d12d2640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:39:02.057 INFO:tasks.workunit.client.0.smithi138.stderr: -191> 2024-09-14T11:39:01.489+0000 7fd1d0ad1640 10 monclient(hunting): get_auth_request con 0x561192345870 auth_method 0 2024-09-14T11:39:02.057 INFO:tasks.workunit.client.0.smithi138.stderr: -190> 2024-09-14T11:39:01.489+0000 7fd1d0ad1640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:39:02.057 INFO:tasks.workunit.client.0.smithi138.stderr: -189> 2024-09-14T11:39:01.489+0000 7fd1d0ad1640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:39:02.057 INFO:tasks.workunit.client.0.smithi138.stderr: -188> 2024-09-14T11:39:01.489+0000 7fd1d0ad1640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:39:02.057 INFO:tasks.workunit.client.0.smithi138.stderr: -187> 2024-09-14T11:39:01.489+0000 7fd1d12d2640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:39:02.058 INFO:tasks.workunit.client.0.smithi138.stderr: -186> 2024-09-14T11:39:01.489+0000 7fd1d12d2640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:39:02.058 INFO:tasks.workunit.client.0.smithi138.stderr: -185> 2024-09-14T11:39:01.489+0000 7fd1d12d2640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:39:02.058 INFO:tasks.workunit.client.0.smithi138.stderr: -184> 2024-09-14T11:39:01.489+0000 7fd1d0ad1640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:39:02.058 INFO:tasks.workunit.client.0.smithi138.stderr: -183> 2024-09-14T11:39:01.489+0000 7fd1d0ad1640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:39:02.058 INFO:tasks.workunit.client.0.smithi138.stderr: -182> 2024-09-14T11:39:01.489+0000 7fd1d0ad1640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:39:02.058 INFO:tasks.workunit.client.0.smithi138.stderr: -181> 2024-09-14T11:39:01.489+0000 7fd1d1ad3640 10 monclient(hunting): get_auth_request con 0x5611923710d0 auth_method 0 2024-09-14T11:39:02.058 INFO:tasks.workunit.client.0.smithi138.stderr: -180> 2024-09-14T11:39:01.489+0000 7fd1d1ad3640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:39:02.058 INFO:tasks.workunit.client.0.smithi138.stderr: -179> 2024-09-14T11:39:01.489+0000 7fd1d1ad3640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:39:02.058 INFO:tasks.workunit.client.0.smithi138.stderr: -178> 2024-09-14T11:39:01.489+0000 7fd1d1ad3640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:39:02.058 INFO:tasks.workunit.client.0.smithi138.stderr: -177> 2024-09-14T11:39:01.489+0000 7fd1d0ad1640 10 monclient(hunting): handle_auth_done global_id 7373 payload 824 2024-09-14T11:39:02.058 INFO:tasks.workunit.client.0.smithi138.stderr: -176> 2024-09-14T11:39:01.489+0000 7fd1d0ad1640 10 monclient: _finish_hunting 0 2024-09-14T11:39:02.058 INFO:tasks.workunit.client.0.smithi138.stderr: -175> 2024-09-14T11:39:01.489+0000 7fd1d0ad1640 1 monclient: found mon.noname-c 2024-09-14T11:39:02.058 INFO:tasks.workunit.client.0.smithi138.stderr: -174> 2024-09-14T11:39:01.489+0000 7fd1d0ad1640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.138:3301/0 2024-09-14T11:39:02.059 INFO:tasks.workunit.client.0.smithi138.stderr: -173> 2024-09-14T11:39:01.489+0000 7fd0a2ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:39:02.059 INFO:tasks.workunit.client.0.smithi138.stderr: -172> 2024-09-14T11:39:01.489+0000 7fd0a2ffd640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-14T11:39:02.059 INFO:tasks.workunit.client.0.smithi138.stderr: -171> 2024-09-14T11:39:01.489+0000 7fd0a2ffd640 10 monclient: dump: 2024-09-14T11:39:02.059 INFO:tasks.workunit.client.0.smithi138.stderr:epoch 1 2024-09-14T11:39:02.059 INFO:tasks.workunit.client.0.smithi138.stderr:fsid 3f225f43-83a6-4aeb-b798-1f04bb49d597 2024-09-14T11:39:02.059 INFO:tasks.workunit.client.0.smithi138.stderr:last_changed 2024-09-14T11:07:09.252780+0000 2024-09-14T11:39:02.059 INFO:tasks.workunit.client.0.smithi138.stderr:created 2024-09-14T11:07:09.252780+0000 2024-09-14T11:39:02.059 INFO:tasks.workunit.client.0.smithi138.stderr:min_mon_release 19 (squid) 2024-09-14T11:39:02.059 INFO:tasks.workunit.client.0.smithi138.stderr:election_strategy: 1 2024-09-14T11:39:02.059 INFO:tasks.workunit.client.0.smithi138.stderr:0: [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] mon.a 2024-09-14T11:39:02.059 INFO:tasks.workunit.client.0.smithi138.stderr:1: [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] mon.b 2024-09-14T11:39:02.059 INFO:tasks.workunit.client.0.smithi138.stderr:2: [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] mon.c 2024-09-14T11:39:02.059 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-14T11:39:02.059 INFO:tasks.workunit.client.0.smithi138.stderr: -170> 2024-09-14T11:39:01.489+0000 7fd0a2ffd640 10 monclient: _finish_auth 0 2024-09-14T11:39:02.059 INFO:tasks.workunit.client.0.smithi138.stderr: -169> 2024-09-14T11:39:01.489+0000 7fd0a2ffd640 10 monclient: _check_auth_tickets 2024-09-14T11:39:02.060 INFO:tasks.workunit.client.0.smithi138.stderr: -168> 2024-09-14T11:39:01.489+0000 7fd0a2ffd640 10 monclient: handle_config config(0 keys) 2024-09-14T11:39:02.060 INFO:tasks.workunit.client.0.smithi138.stderr: -167> 2024-09-14T11:39:01.489+0000 7fd0a2ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:39:02.060 INFO:tasks.workunit.client.0.smithi138.stderr: -166> 2024-09-14T11:39:01.489+0000 7fd0a2ffd640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-14T11:39:02.060 INFO:tasks.workunit.client.0.smithi138.stderr: -165> 2024-09-14T11:39:01.489+0000 7fd0a2ffd640 10 monclient: dump: 2024-09-14T11:39:02.060 INFO:tasks.workunit.client.0.smithi138.stderr:epoch 1 2024-09-14T11:39:02.060 INFO:tasks.workunit.client.0.smithi138.stderr:fsid 3f225f43-83a6-4aeb-b798-1f04bb49d597 2024-09-14T11:39:02.060 INFO:tasks.workunit.client.0.smithi138.stderr:last_changed 2024-09-14T11:07:09.252780+0000 2024-09-14T11:39:02.060 INFO:tasks.workunit.client.0.smithi138.stderr:created 2024-09-14T11:07:09.252780+0000 2024-09-14T11:39:02.060 INFO:tasks.workunit.client.0.smithi138.stderr:min_mon_release 19 (squid) 2024-09-14T11:39:02.060 INFO:tasks.workunit.client.0.smithi138.stderr:election_strategy: 1 2024-09-14T11:39:02.060 INFO:tasks.workunit.client.0.smithi138.stderr:0: [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] mon.a 2024-09-14T11:39:02.060 INFO:tasks.workunit.client.0.smithi138.stderr:1: [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] mon.b 2024-09-14T11:39:02.060 INFO:tasks.workunit.client.0.smithi138.stderr:2: [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] mon.c 2024-09-14T11:39:02.060 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-14T11:39:02.061 INFO:tasks.workunit.client.0.smithi138.stderr: -164> 2024-09-14T11:39:01.489+0000 7fd1d37cc9c0 5 monclient: authenticate success, global_id 7373 2024-09-14T11:39:02.061 INFO:tasks.workunit.client.0.smithi138.stderr: -163> 2024-09-14T11:39:01.489+0000 7fd1d37cc9c0 10 monclient: _renew_subs 2024-09-14T11:39:02.061 INFO:tasks.workunit.client.0.smithi138.stderr: -162> 2024-09-14T11:39:01.489+0000 7fd1d37cc9c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.138:3301/0 2024-09-14T11:39:02.061 INFO:tasks.workunit.client.0.smithi138.stderr: -161> 2024-09-14T11:39:01.489+0000 7fd0b4ff9640 4 set_mon_vals no callback set 2024-09-14T11:39:02.061 INFO:tasks.workunit.client.0.smithi138.stderr: -160> 2024-09-14T11:39:01.489+0000 7fd1d37cc9c0 10 monclient: _renew_subs 2024-09-14T11:39:02.061 INFO:tasks.workunit.client.0.smithi138.stderr: -159> 2024-09-14T11:39:01.489+0000 7fd1d37cc9c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.138:3301/0 2024-09-14T11:39:02.061 INFO:tasks.workunit.client.0.smithi138.stderr: -158> 2024-09-14T11:39:01.489+0000 7fd1d37cc9c0 1 librados: init done 2024-09-14T11:39:02.061 INFO:tasks.workunit.client.0.smithi138.stderr: -157> 2024-09-14T11:39:01.489+0000 7fd1d37cc9c0 5 asok(0x561192097d90) register_command cr dump hook 0x561192380388 2024-09-14T11:39:02.061 INFO:tasks.workunit.client.0.smithi138.stderr: -156> 2024-09-14T11:39:01.489+0000 7fd1d37cc9c0 20 rados->read ofs=0 len=0 2024-09-14T11:39:02.061 INFO:tasks.workunit.client.0.smithi138.stderr: -155> 2024-09-14T11:39:01.489+0000 7fd0a2ffd640 4 mgrc handle_mgr_map Got map version 5 2024-09-14T11:39:02.061 INFO:tasks.workunit.client.0.smithi138.stderr: -154> 2024-09-14T11:39:01.489+0000 7fd0a2ffd640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.138:6832/3778043143,v1:172.21.15.138:6833/3778043143] 2024-09-14T11:39:02.061 INFO:tasks.workunit.client.0.smithi138.stderr: -153> 2024-09-14T11:39:01.489+0000 7fd0a2ffd640 4 mgrc reconnect Starting new session with [v2:172.21.15.138:6832/3778043143,v1:172.21.15.138:6833/3778043143] 2024-09-14T11:39:02.061 INFO:tasks.workunit.client.0.smithi138.stderr: -152> 2024-09-14T11:39:01.489+0000 7fd1d1ad3640 10 monclient: get_auth_request con 0x7fd09c0718a0 auth_method 0 2024-09-14T11:39:02.061 INFO:tasks.workunit.client.0.smithi138.stderr: -151> 2024-09-14T11:39:01.489+0000 7fd1d12d2640 10 monclient: get_auth_request con 0x56119238fc90 auth_method 0 2024-09-14T11:39:02.062 INFO:tasks.workunit.client.0.smithi138.stderr: -150> 2024-09-14T11:39:01.493+0000 7fd1d37cc9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:39:02.062 INFO:tasks.workunit.client.0.smithi138.stderr: -149> 2024-09-14T11:39:01.493+0000 7fd1d37cc9c0 20 realm 2024-09-14T11:39:02.062 INFO:tasks.workunit.client.0.smithi138.stderr: -148> 2024-09-14T11:39:01.493+0000 7fd1d37cc9c0 20 rados->read ofs=0 len=0 2024-09-14T11:39:02.062 INFO:tasks.workunit.client.0.smithi138.stderr: -147> 2024-09-14T11:39:01.493+0000 7fd1d37cc9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:39:02.062 INFO:tasks.workunit.client.0.smithi138.stderr: -146> 2024-09-14T11:39:01.493+0000 7fd1d37cc9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:39:02.062 INFO:tasks.workunit.client.0.smithi138.stderr: -145> 2024-09-14T11:39:01.493+0000 7fd1d37cc9c0 20 rados->read ofs=0 len=0 2024-09-14T11:39:02.062 INFO:tasks.workunit.client.0.smithi138.stderr: -144> 2024-09-14T11:39:01.493+0000 7fd1d37cc9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:39:02.062 INFO:tasks.workunit.client.0.smithi138.stderr: -143> 2024-09-14T11:39:01.493+0000 7fd1d37cc9c0 20 rados->read ofs=0 len=0 2024-09-14T11:39:02.062 INFO:tasks.workunit.client.0.smithi138.stderr: -142> 2024-09-14T11:39:01.493+0000 7fd1d0ad1640 10 monclient: get_auth_request con 0x561192393ff0 auth_method 0 2024-09-14T11:39:02.062 INFO:tasks.workunit.client.0.smithi138.stderr: -141> 2024-09-14T11:39:01.493+0000 7fd1d37cc9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:39:02.062 INFO:tasks.workunit.client.0.smithi138.stderr: -140> 2024-09-14T11:39:01.493+0000 7fd1d37cc9c0 20 rados->read ofs=0 len=0 2024-09-14T11:39:02.062 INFO:tasks.workunit.client.0.smithi138.stderr: -139> 2024-09-14T11:39:01.493+0000 7fd1d1ad3640 10 monclient: get_auth_request con 0x561192397730 auth_method 0 2024-09-14T11:39:02.062 INFO:tasks.workunit.client.0.smithi138.stderr: -138> 2024-09-14T11:39:01.493+0000 7fd1d37cc9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:39:02.062 INFO:tasks.workunit.client.0.smithi138.stderr: -137> 2024-09-14T11:39:01.493+0000 7fd1d37cc9c0 20 searching for the correct realm 2024-09-14T11:39:02.062 INFO:tasks.workunit.client.0.smithi138.stderr: -136> 2024-09-14T11:39:01.493+0000 7fd1d12d2640 10 monclient: get_auth_request con 0x56119239c4d0 auth_method 0 2024-09-14T11:39:02.063 INFO:tasks.workunit.client.0.smithi138.stderr: -135> 2024-09-14T11:39:01.497+0000 7fd1d0ad1640 10 monclient: get_auth_request con 0x7fd1c40bf070 auth_method 0 2024-09-14T11:39:02.063 INFO:tasks.workunit.client.0.smithi138.stderr: -134> 2024-09-14T11:39:01.497+0000 7fd1d1ad3640 0 -- 172.21.15.138:0/2620737197 >> [v2:172.21.15.154:6824/416768175,v1:172.21.15.154:6825/416768175] conn(0x7fd1cc041040 msgr2=0x7fd1cc041420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:39:02.063 INFO:tasks.workunit.client.0.smithi138.stderr: -133> 2024-09-14T11:39:01.701+0000 7fd1d1ad3640 10 monclient: get_auth_request con 0x7fd1cc041040 auth_method 0 2024-09-14T11:39:02.063 INFO:tasks.workunit.client.0.smithi138.stderr: -132> 2024-09-14T11:39:01.705+0000 7fd1d12d2640 10 monclient: get_auth_request con 0x7fd1cc034920 auth_method 0 2024-09-14T11:39:02.063 INFO:tasks.workunit.client.0.smithi138.stderr: -131> 2024-09-14T11:39:01.713+0000 7fd1d0ad1640 10 monclient: get_auth_request con 0x7fd1cc016400 auth_method 0 2024-09-14T11:39:02.063 INFO:tasks.workunit.client.0.smithi138.stderr: -130> 2024-09-14T11:39:01.713+0000 7fd1d0ad1640 0 -- 172.21.15.138:0/2620737197 >> [v2:172.21.15.138:6816/326481658,v1:172.21.15.138:6817/326481658] conn(0x7fd1cc016400 msgr2=0x7fd1cc016880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:39:02.063 INFO:tasks.workunit.client.0.smithi138.stderr: -129> 2024-09-14T11:39:01.917+0000 7fd1d0ad1640 10 monclient: get_auth_request con 0x7fd1cc016400 auth_method 0 2024-09-14T11:39:02.063 INFO:tasks.workunit.client.0.smithi138.stderr: -128> 2024-09-14T11:39:01.929+0000 7fd1d37cc9c0 20 RGWRados::pool_iterate: got zone_info.d9e72d30-c60b-4d0d-9267-fdc36392d5ad 2024-09-14T11:39:02.063 INFO:tasks.workunit.client.0.smithi138.stderr: -127> 2024-09-14T11:39:01.929+0000 7fd1d37cc9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:39:02.063 INFO:tasks.workunit.client.0.smithi138.stderr: -126> 2024-09-14T11:39:01.929+0000 7fd1d37cc9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:39:02.063 INFO:tasks.workunit.client.0.smithi138.stderr: -125> 2024-09-14T11:39:01.929+0000 7fd1d37cc9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:39:02.063 INFO:tasks.workunit.client.0.smithi138.stderr: -124> 2024-09-14T11:39:01.929+0000 7fd1d37cc9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:39:02.063 INFO:tasks.workunit.client.0.smithi138.stderr: -123> 2024-09-14T11:39:01.929+0000 7fd1d37cc9c0 20 RGWRados::pool_iterate: got zonegroup_info.65ab941b-da8c-4160-94fb-3672b069d44f 2024-09-14T11:39:02.063 INFO:tasks.workunit.client.0.smithi138.stderr: -122> 2024-09-14T11:39:01.929+0000 7fd1d37cc9c0 20 rados->read ofs=0 len=0 2024-09-14T11:39:02.064 INFO:tasks.workunit.client.0.smithi138.stderr: -121> 2024-09-14T11:39:01.933+0000 7fd1d37cc9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:39:02.064 INFO:tasks.workunit.client.0.smithi138.stderr: -120> 2024-09-14T11:39:01.933+0000 7fd1d37cc9c0 20 rados->read ofs=0 len=0 2024-09-14T11:39:02.064 INFO:tasks.workunit.client.0.smithi138.stderr: -119> 2024-09-14T11:39:01.933+0000 7fd1d37cc9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:39:02.064 INFO:tasks.workunit.client.0.smithi138.stderr: -118> 2024-09-14T11:39:01.933+0000 7fd1d37cc9c0 20 rados->read ofs=0 len=0 2024-09-14T11:39:02.064 INFO:tasks.workunit.client.0.smithi138.stderr: -117> 2024-09-14T11:39:01.933+0000 7fd1d37cc9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:39:02.064 INFO:tasks.workunit.client.0.smithi138.stderr: -116> 2024-09-14T11:39:01.933+0000 7fd1d37cc9c0 20 zone default found 2024-09-14T11:39:02.064 INFO:tasks.workunit.client.0.smithi138.stderr: -115> 2024-09-14T11:39:01.933+0000 7fd1d37cc9c0 4 Realm: () 2024-09-14T11:39:02.064 INFO:tasks.workunit.client.0.smithi138.stderr: -114> 2024-09-14T11:39:01.933+0000 7fd1d37cc9c0 4 ZoneGroup: default (65ab941b-da8c-4160-94fb-3672b069d44f) 2024-09-14T11:39:02.064 INFO:tasks.workunit.client.0.smithi138.stderr: -113> 2024-09-14T11:39:01.933+0000 7fd1d37cc9c0 4 Zone: default (d9e72d30-c60b-4d0d-9267-fdc36392d5ad) 2024-09-14T11:39:02.064 INFO:tasks.workunit.client.0.smithi138.stderr: -112> 2024-09-14T11:39:01.933+0000 7fd1d37cc9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:39:02.064 INFO:tasks.workunit.client.0.smithi138.stderr: -111> 2024-09-14T11:39:01.933+0000 7fd1d37cc9c0 20 zonegroup default 2024-09-14T11:39:02.064 INFO:tasks.workunit.client.0.smithi138.stderr: -110> 2024-09-14T11:39:01.933+0000 7fd1d37cc9c0 20 rados->read ofs=0 len=0 2024-09-14T11:39:02.064 INFO:tasks.workunit.client.0.smithi138.stderr: -109> 2024-09-14T11:39:01.933+0000 7fd1d37cc9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:39:02.064 INFO:tasks.workunit.client.0.smithi138.stderr: -108> 2024-09-14T11:39:01.933+0000 7fd1d37cc9c0 20 rados->read ofs=0 len=0 2024-09-14T11:39:02.065 INFO:tasks.workunit.client.0.smithi138.stderr: -107> 2024-09-14T11:39:01.933+0000 7fd1d37cc9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:39:02.065 INFO:tasks.workunit.client.0.smithi138.stderr: -106> 2024-09-14T11:39:01.933+0000 7fd1d37cc9c0 20 rados->read ofs=0 len=0 2024-09-14T11:39:02.065 INFO:tasks.workunit.client.0.smithi138.stderr: -105> 2024-09-14T11:39:01.933+0000 7fd1d37cc9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:39:02.065 INFO:tasks.workunit.client.0.smithi138.stderr: -104> 2024-09-14T11:39:01.933+0000 7fd1d37cc9c0 20 started sync module instance, tier type = 2024-09-14T11:39:02.065 INFO:tasks.workunit.client.0.smithi138.stderr: -103> 2024-09-14T11:39:01.937+0000 7fd1d37cc9c0 20 started zone id=d9e72d30-c60b-4d0d-9267-fdc36392d5ad (name=default) with tier type = 2024-09-14T11:39:02.065 INFO:tasks.workunit.client.0.smithi138.stderr: -102> 2024-09-14T11:39:01.957+0000 7fd1d37cc9c0 20 add_watcher() i=0 2024-09-14T11:39:02.065 INFO:tasks.workunit.client.0.smithi138.stderr: -101> 2024-09-14T11:39:01.957+0000 7fd1d37cc9c0 20 add_watcher() i=1 2024-09-14T11:39:02.065 INFO:tasks.workunit.client.0.smithi138.stderr: -100> 2024-09-14T11:39:01.957+0000 7fd1d37cc9c0 20 add_watcher() i=2 2024-09-14T11:39:02.065 INFO:tasks.workunit.client.0.smithi138.stderr: -99> 2024-09-14T11:39:01.957+0000 7fd1d37cc9c0 20 add_watcher() i=3 2024-09-14T11:39:02.065 INFO:tasks.workunit.client.0.smithi138.stderr: -98> 2024-09-14T11:39:01.957+0000 7fd1d37cc9c0 20 add_watcher() i=4 2024-09-14T11:39:02.065 INFO:tasks.workunit.client.0.smithi138.stderr: -97> 2024-09-14T11:39:01.957+0000 7fd1d37cc9c0 20 add_watcher() i=5 2024-09-14T11:39:02.065 INFO:tasks.workunit.client.0.smithi138.stderr: -96> 2024-09-14T11:39:01.957+0000 7fd1d37cc9c0 20 add_watcher() i=6 2024-09-14T11:39:02.065 INFO:tasks.workunit.client.0.smithi138.stderr: -95> 2024-09-14T11:39:01.961+0000 7fd1d37cc9c0 20 add_watcher() i=7 2024-09-14T11:39:02.065 INFO:tasks.workunit.client.0.smithi138.stderr: -94> 2024-09-14T11:39:01.961+0000 7fd1d37cc9c0 2 all 8 watchers are set, enabling cache 2024-09-14T11:39:02.065 INFO:tasks.workunit.client.0.smithi138.stderr: -93> 2024-09-14T11:39:01.961+0000 7fd1d37cc9c0 5 AuthRegistry(0x7ffff5249900) adding auth protocol: cephx 2024-09-14T11:39:02.065 INFO:tasks.workunit.client.0.smithi138.stderr: -92> 2024-09-14T11:39:01.961+0000 7fd1d37cc9c0 5 AuthRegistry(0x7ffff5249900) adding auth protocol: cephx 2024-09-14T11:39:02.066 INFO:tasks.workunit.client.0.smithi138.stderr: -91> 2024-09-14T11:39:01.961+0000 7fd1d37cc9c0 5 AuthRegistry(0x7ffff5249900) adding auth protocol: cephx 2024-09-14T11:39:02.066 INFO:tasks.workunit.client.0.smithi138.stderr: -90> 2024-09-14T11:39:01.961+0000 7fd1d37cc9c0 5 AuthRegistry(0x7ffff5249900) adding con mode: secure 2024-09-14T11:39:02.066 INFO:tasks.workunit.client.0.smithi138.stderr: -89> 2024-09-14T11:39:01.961+0000 7fd1d37cc9c0 5 AuthRegistry(0x7ffff5249900) adding con mode: crc 2024-09-14T11:39:02.066 INFO:tasks.workunit.client.0.smithi138.stderr: -88> 2024-09-14T11:39:01.961+0000 7fd1d37cc9c0 5 AuthRegistry(0x7ffff5249900) adding con mode: secure 2024-09-14T11:39:02.066 INFO:tasks.workunit.client.0.smithi138.stderr: -87> 2024-09-14T11:39:01.961+0000 7fd1d37cc9c0 5 AuthRegistry(0x7ffff5249900) adding con mode: crc 2024-09-14T11:39:02.066 INFO:tasks.workunit.client.0.smithi138.stderr: -86> 2024-09-14T11:39:01.961+0000 7fd1d37cc9c0 5 AuthRegistry(0x7ffff5249900) adding con mode: secure 2024-09-14T11:39:02.066 INFO:tasks.workunit.client.0.smithi138.stderr: -85> 2024-09-14T11:39:01.961+0000 7fd1d37cc9c0 5 AuthRegistry(0x7ffff5249900) adding con mode: crc 2024-09-14T11:39:02.066 INFO:tasks.workunit.client.0.smithi138.stderr: -84> 2024-09-14T11:39:01.961+0000 7fd1d37cc9c0 5 AuthRegistry(0x7ffff5249900) adding con mode: crc 2024-09-14T11:39:02.066 INFO:tasks.workunit.client.0.smithi138.stderr: -83> 2024-09-14T11:39:01.961+0000 7fd1d37cc9c0 5 AuthRegistry(0x7ffff5249900) adding con mode: secure 2024-09-14T11:39:02.066 INFO:tasks.workunit.client.0.smithi138.stderr: -82> 2024-09-14T11:39:01.961+0000 7fd1d37cc9c0 5 AuthRegistry(0x7ffff5249900) adding con mode: crc 2024-09-14T11:39:02.066 INFO:tasks.workunit.client.0.smithi138.stderr: -81> 2024-09-14T11:39:01.961+0000 7fd1d37cc9c0 5 AuthRegistry(0x7ffff5249900) adding con mode: secure 2024-09-14T11:39:02.066 INFO:tasks.workunit.client.0.smithi138.stderr: -80> 2024-09-14T11:39:01.961+0000 7fd1d37cc9c0 5 AuthRegistry(0x7ffff5249900) adding con mode: crc 2024-09-14T11:39:02.066 INFO:tasks.workunit.client.0.smithi138.stderr: -79> 2024-09-14T11:39:01.961+0000 7fd1d37cc9c0 5 AuthRegistry(0x7ffff5249900) adding con mode: secure 2024-09-14T11:39:02.066 INFO:tasks.workunit.client.0.smithi138.stderr: -78> 2024-09-14T11:39:01.961+0000 7fd0877e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:39:02.066 INFO:tasks.workunit.client.0.smithi138.stderr: -77> 2024-09-14T11:39:01.965+0000 7fd1d37cc9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:39:02.067 INFO:tasks.workunit.client.0.smithi138.stderr: -76> 2024-09-14T11:39:01.965+0000 7fd1d37cc9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:39:02.067 INFO:tasks.workunit.client.0.smithi138.stderr: -75> 2024-09-14T11:39:01.965+0000 7fd1d37cc9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:39:02.067 INFO:tasks.workunit.client.0.smithi138.stderr: -74> 2024-09-14T11:39:01.965+0000 7fd1d37cc9c0 5 asok(0x561192097d90) register_command cache list hook 0x56119236b6c0 2024-09-14T11:39:02.067 INFO:tasks.workunit.client.0.smithi138.stderr: -73> 2024-09-14T11:39:01.965+0000 7fd1d37cc9c0 5 asok(0x561192097d90) register_command cache inspect hook 0x56119236b6c0 2024-09-14T11:39:02.067 INFO:tasks.workunit.client.0.smithi138.stderr: -72> 2024-09-14T11:39:01.965+0000 7fd1d37cc9c0 5 asok(0x561192097d90) register_command cache erase hook 0x56119236b6c0 2024-09-14T11:39:02.067 INFO:tasks.workunit.client.0.smithi138.stderr: -71> 2024-09-14T11:39:01.965+0000 7fd1d37cc9c0 5 asok(0x561192097d90) register_command cache zap hook 0x56119236b6c0 2024-09-14T11:39:02.067 INFO:tasks.workunit.client.0.smithi138.stderr: -70> 2024-09-14T11:39:01.965+0000 7fd1d37cc9c0 5 note: GC not initialized 2024-09-14T11:39:02.067 INFO:tasks.workunit.client.0.smithi138.stderr: -69> 2024-09-14T11:39:01.965+0000 7fd0867e4640 20 reqs_thread_entry: start 2024-09-14T11:39:02.067 INFO:tasks.workunit.client.0.smithi138.stderr: -68> 2024-09-14T11:39:01.965+0000 7fd1d37cc9c0 5 asok(0x561192097d90) register_command sync trace show hook 0x7fd1c8001340 2024-09-14T11:39:02.067 INFO:tasks.workunit.client.0.smithi138.stderr: -67> 2024-09-14T11:39:01.965+0000 7fd1d37cc9c0 5 asok(0x561192097d90) register_command sync trace history hook 0x7fd1c8001340 2024-09-14T11:39:02.067 INFO:tasks.workunit.client.0.smithi138.stderr: -66> 2024-09-14T11:39:01.965+0000 7fd1d37cc9c0 5 asok(0x561192097d90) register_command sync trace active hook 0x7fd1c8001340 2024-09-14T11:39:02.067 INFO:tasks.workunit.client.0.smithi138.stderr: -65> 2024-09-14T11:39:01.965+0000 7fd1d37cc9c0 5 asok(0x561192097d90) register_command sync trace active_short hook 0x7fd1c8001340 2024-09-14T11:39:02.067 INFO:tasks.workunit.client.0.smithi138.stderr: -64> 2024-09-14T11:39:01.965+0000 7fd1d37cc9c0 20 init_complete bucket index max shards: 11 2024-09-14T11:39:02.067 INFO:tasks.workunit.client.0.smithi138.stderr: -63> 2024-09-14T11:39:01.965+0000 7fd1d37cc9c0 20 Filter name: none 2024-09-14T11:39:02.067 INFO:tasks.workunit.client.0.smithi138.stderr: -62> 2024-09-14T11:39:01.965+0000 7fcff7fff640 20 reqs_thread_entry: start 2024-09-14T11:39:02.068 INFO:tasks.workunit.client.0.smithi138.stderr: -61> 2024-09-14T11:39:01.965+0000 7fd1d37cc9c0 10 cache get: name=default.rgw.meta+root+abort-at-change-reshard-state : miss 2024-09-14T11:39:02.068 INFO:tasks.workunit.client.0.smithi138.stderr: -60> 2024-09-14T11:39:01.965+0000 7fd1d37cc9c0 20 rados->read ofs=0 len=0 2024-09-14T11:39:02.068 INFO:tasks.workunit.client.0.smithi138.stderr: -59> 2024-09-14T11:39:01.965+0000 7fd1d37cc9c0 20 rados_obj.operate() r=0 bl.length=197 2024-09-14T11:39:02.068 INFO:tasks.workunit.client.0.smithi138.stderr: -58> 2024-09-14T11:39:01.965+0000 7fd1d37cc9c0 10 cache put: name=default.rgw.meta+root+abort-at-change-reshard-state info.flags=0x11 2024-09-14T11:39:02.068 INFO:tasks.workunit.client.0.smithi138.stderr: -57> 2024-09-14T11:39:01.965+0000 7fd1d37cc9c0 10 adding default.rgw.meta+root+abort-at-change-reshard-state to cache LRU end 2024-09-14T11:39:02.068 INFO:tasks.workunit.client.0.smithi138.stderr: -56> 2024-09-14T11:39:01.965+0000 7fd1d37cc9c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.39 : miss 2024-09-14T11:39:02.068 INFO:tasks.workunit.client.0.smithi138.stderr: -55> 2024-09-14T11:39:01.965+0000 7fd1d37cc9c0 20 rados->read ofs=0 len=0 2024-09-14T11:39:02.068 INFO:tasks.workunit.client.0.smithi138.stderr: -54> 2024-09-14T11:39:01.965+0000 7fd1d37cc9c0 20 rados_obj.operate() r=0 bl.length=419 2024-09-14T11:39:02.068 INFO:tasks.workunit.client.0.smithi138.stderr: -53> 2024-09-14T11:39:01.965+0000 7fd1d37cc9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.39 info.flags=0x17 2024-09-14T11:39:02.068 INFO:tasks.workunit.client.0.smithi138.stderr: -52> 2024-09-14T11:39:01.965+0000 7fd1d37cc9c0 10 adding default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.39 to cache LRU end 2024-09-14T11:39:02.068 INFO:tasks.workunit.client.0.smithi138.stderr: -51> 2024-09-14T11:39:01.965+0000 7fd1d37cc9c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:39:02.068 INFO:tasks.workunit.client.0.smithi138.stderr: -50> 2024-09-14T11:39:01.965+0000 7fd1d37cc9c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:39:02.068 INFO:tasks.workunit.client.0.smithi138.stderr: -49> 2024-09-14T11:39:01.965+0000 7fd1d37cc9c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.39 2024-09-14T11:39:02.068 INFO:tasks.workunit.client.0.smithi138.stderr: -48> 2024-09-14T11:39:01.977+0000 7fd1d37cc9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.39 info.flags=0x17 2024-09-14T11:39:02.068 INFO:tasks.workunit.client.0.smithi138.stderr: -47> 2024-09-14T11:39:01.977+0000 7fd1d37cc9c0 10 moving default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.39 to cache LRU end 2024-09-14T11:39:02.069 INFO:tasks.workunit.client.0.smithi138.stderr: -46> 2024-09-14T11:39:01.977+0000 7fd1d37cc9c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:39:02.069 INFO:tasks.workunit.client.0.smithi138.stderr: -45> 2024-09-14T11:39:01.977+0000 7fd1d37cc9c0 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-change-reshard-state:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.39, ofs0, ns] 2024-09-14T11:39:02.069 INFO:tasks.workunit.client.0.smithi138.stderr: -44> 2024-09-14T11:39:01.977+0000 7fd0a3fff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366175 cookie 94633467721168 notifier 7373 bl.length()=931 2024-09-14T11:39:02.069 INFO:tasks.workunit.client.0.smithi138.stderr: -43> 2024-09-14T11:39:01.977+0000 7fd0a3fff640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.39 info.flags=0x17 2024-09-14T11:39:02.069 INFO:tasks.workunit.client.0.smithi138.stderr: -42> 2024-09-14T11:39:01.977+0000 7fd0a3fff640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.39 to cache LRU end 2024-09-14T11:39:02.069 INFO:tasks.workunit.client.0.smithi138.stderr: -41> 2024-09-14T11:39:01.977+0000 7fd0a3fff640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:39:02.069 INFO:tasks.workunit.client.0.smithi138.stderr: -40> 2024-09-14T11:39:01.981+0000 7fd1d37cc9c0 20 handle_bi_update(): bucket=:abort-at-change-reshard-state[d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.39]): orig_sources= new_sources= 2024-09-14T11:39:02.069 INFO:tasks.workunit.client.0.smithi138.stderr: -39> 2024-09-14T11:39:01.981+0000 7fd1d37cc9c0 20 handle_bi_update(): bucket=:abort-at-change-reshard-state[d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.39]): potential sources added=[] removed=[] 2024-09-14T11:39:02.069 INFO:tasks.workunit.client.0.smithi138.stderr: -38> 2024-09-14T11:39:01.981+0000 7fd1d37cc9c0 20 handle_bi_update(): bucket=:abort-at-change-reshard-state[d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.39]): orig_dests= new_dests= 2024-09-14T11:39:02.069 INFO:tasks.workunit.client.0.smithi138.stderr: -37> 2024-09-14T11:39:01.981+0000 7fd1d37cc9c0 20 handle_bi_update(): bucket=:abort-at-change-reshard-state[d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.39]): potential dests added=[] removed=[] 2024-09-14T11:39:02.069 INFO:tasks.workunit.client.0.smithi138.stderr: -36> 2024-09-14T11:39:01.993+0000 7fd1d37cc9c0 10 bucket_obj is .dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.39.1.0 2024-09-14T11:39:02.069 INFO:tasks.workunit.client.0.smithi138.stderr: -35> 2024-09-14T11:39:01.993+0000 7fd1d37cc9c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.39.1.0 2024-09-14T11:39:02.069 INFO:tasks.workunit.client.0.smithi138.stderr: -34> 2024-09-14T11:39:01.993+0000 7fd1d37cc9c0 10 bucket_obj is .dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.39.1.1 2024-09-14T11:39:02.069 INFO:tasks.workunit.client.0.smithi138.stderr: -33> 2024-09-14T11:39:01.993+0000 7fd1d37cc9c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.39.1.1 2024-09-14T11:39:02.069 INFO:tasks.workunit.client.0.smithi138.stderr: -32> 2024-09-14T11:39:01.993+0000 7fd1d37cc9c0 10 bucket_obj is .dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.39.1.2 2024-09-14T11:39:02.070 INFO:tasks.workunit.client.0.smithi138.stderr: -31> 2024-09-14T11:39:01.993+0000 7fd1d37cc9c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.39.1.2 2024-09-14T11:39:02.070 INFO:tasks.workunit.client.0.smithi138.stderr: -30> 2024-09-14T11:39:01.993+0000 7fd1d37cc9c0 10 bucket_obj is .dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.39.1.3 2024-09-14T11:39:02.070 INFO:tasks.workunit.client.0.smithi138.stderr: -29> 2024-09-14T11:39:01.993+0000 7fd1d37cc9c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.39.1.3 2024-09-14T11:39:02.070 INFO:tasks.workunit.client.0.smithi138.stderr: -28> 2024-09-14T11:39:01.993+0000 7fd1d37cc9c0 10 bucket_obj is .dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.39.1.4 2024-09-14T11:39:02.070 INFO:tasks.workunit.client.0.smithi138.stderr: -27> 2024-09-14T11:39:01.993+0000 7fd1d37cc9c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.39.1.4 2024-09-14T11:39:02.070 INFO:tasks.workunit.client.0.smithi138.stderr: -26> 2024-09-14T11:39:01.993+0000 7fd1d37cc9c0 10 bucket_obj is .dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.39.1.5 2024-09-14T11:39:02.070 INFO:tasks.workunit.client.0.smithi138.stderr: -25> 2024-09-14T11:39:01.993+0000 7fd1d37cc9c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.39.1.5 2024-09-14T11:39:02.070 INFO:tasks.workunit.client.0.smithi138.stderr: -24> 2024-09-14T11:39:01.993+0000 7fd1d37cc9c0 10 bucket_obj is .dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.39.1.6 2024-09-14T11:39:02.070 INFO:tasks.workunit.client.0.smithi138.stderr: -23> 2024-09-14T11:39:01.993+0000 7fd1d37cc9c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.39.1.6 2024-09-14T11:39:02.070 INFO:tasks.workunit.client.0.smithi138.stderr: -22> 2024-09-14T11:39:01.993+0000 7fd1d37cc9c0 10 bucket_obj is .dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.39.1.7 2024-09-14T11:39:02.070 INFO:tasks.workunit.client.0.smithi138.stderr: -21> 2024-09-14T11:39:01.993+0000 7fd1d37cc9c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.39.1.7 2024-09-14T11:39:02.070 INFO:tasks.workunit.client.0.smithi138.stderr: -20> 2024-09-14T11:39:01.993+0000 7fd1d37cc9c0 10 bucket_obj is .dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.39.1.8 2024-09-14T11:39:02.070 INFO:tasks.workunit.client.0.smithi138.stderr: -19> 2024-09-14T11:39:01.993+0000 7fd1d37cc9c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.39.1.8 2024-09-14T11:39:02.070 INFO:tasks.workunit.client.0.smithi138.stderr: -18> 2024-09-14T11:39:01.993+0000 7fd1d37cc9c0 10 bucket_obj is .dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.39.1.9 2024-09-14T11:39:02.071 INFO:tasks.workunit.client.0.smithi138.stderr: -17> 2024-09-14T11:39:01.993+0000 7fd1d37cc9c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.39.1.9 2024-09-14T11:39:02.071 INFO:tasks.workunit.client.0.smithi138.stderr: -16> 2024-09-14T11:39:01.993+0000 7fd1d37cc9c0 10 bucket_obj is .dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.39.1.10 2024-09-14T11:39:02.071 INFO:tasks.workunit.client.0.smithi138.stderr: -15> 2024-09-14T11:39:01.993+0000 7fd1d37cc9c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.39.1.10 2024-09-14T11:39:02.071 INFO:tasks.workunit.client.0.smithi138.stderr: -14> 2024-09-14T11:39:01.993+0000 7fd1d37cc9c0 10 bucket_obj is .dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.39.1.11 2024-09-14T11:39:02.071 INFO:tasks.workunit.client.0.smithi138.stderr: -13> 2024-09-14T11:39:01.993+0000 7fd1d37cc9c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.39.1.11 2024-09-14T11:39:02.071 INFO:tasks.workunit.client.0.smithi138.stderr: -12> 2024-09-14T11:39:01.993+0000 7fd1d37cc9c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.39.0 2024-09-14T11:39:02.071 INFO:tasks.workunit.client.0.smithi138.stderr: -11> 2024-09-14T11:39:01.993+0000 7fd1d37cc9c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.39.1 2024-09-14T11:39:02.071 INFO:tasks.workunit.client.0.smithi138.stderr: -10> 2024-09-14T11:39:01.993+0000 7fd1d37cc9c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.39.2 2024-09-14T11:39:02.071 INFO:tasks.workunit.client.0.smithi138.stderr: -9> 2024-09-14T11:39:01.997+0000 7fd1d37cc9c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.39.3 2024-09-14T11:39:02.071 INFO:tasks.workunit.client.0.smithi138.stderr: -8> 2024-09-14T11:39:01.997+0000 7fd1d37cc9c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.39.4 2024-09-14T11:39:02.071 INFO:tasks.workunit.client.0.smithi138.stderr: -7> 2024-09-14T11:39:01.997+0000 7fd1d37cc9c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.39.5 2024-09-14T11:39:02.071 INFO:tasks.workunit.client.0.smithi138.stderr: -6> 2024-09-14T11:39:01.997+0000 7fd1d37cc9c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.39.6 2024-09-14T11:39:02.071 INFO:tasks.workunit.client.0.smithi138.stderr: -5> 2024-09-14T11:39:01.997+0000 7fd1d37cc9c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.39.7 2024-09-14T11:39:02.071 INFO:tasks.workunit.client.0.smithi138.stderr: -4> 2024-09-14T11:39:02.001+0000 7fd1d37cc9c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.39.8 2024-09-14T11:39:02.071 INFO:tasks.workunit.client.0.smithi138.stderr: -3> 2024-09-14T11:39:02.001+0000 7fd1d37cc9c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.39.9 2024-09-14T11:39:02.072 INFO:tasks.workunit.client.0.smithi138.stderr: -2> 2024-09-14T11:39:02.001+0000 7fd1d37cc9c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.39.10 2024-09-14T11:39:02.072 INFO:tasks.workunit.client.0.smithi138.stderr: -1> 2024-09-14T11:39:02.009+0000 7fd1d37cc9c0 -1 ./src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7fd1d37cc9c0 time 2024-09-14T11:39:02.012491+0000 2024-09-14T11:39:02.072 INFO:tasks.workunit.client.0.smithi138.stderr:./src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-14T11:39:02.072 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-14T11:39:02.072 INFO:tasks.workunit.client.0.smithi138.stderr: ceph version 19.3.0-4907-ga2782315 (a2782315255a3e7d5f6cdc9eb35785187ff6ddf8) squid (dev) 2024-09-14T11:39:02.072 INFO:tasks.workunit.client.0.smithi138.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x121) [0x7fd1d70a62eb] 2024-09-14T11:39:02.072 INFO:tasks.workunit.client.0.smithi138.stderr: 2: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7fd1d70a649f] 2024-09-14T11:39:02.072 INFO:tasks.workunit.client.0.smithi138.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x56118f2c1c01] 2024-09-14T11:39:02.072 INFO:tasks.workunit.client.0.smithi138.stderr: 4: (RGWBucketReshard::do_reshard(rgw::bucket_index_layout_generation const&, rgw::bucket_index_layout_generation const&, int, bool, bool, std::ostream*, ceph::Formatter*, FaultInjector > >&, DoutPrefixProvider const*, optional_yield)+0x1411) [0x56118f2d6231] 2024-09-14T11:39:02.072 INFO:tasks.workunit.client.0.smithi138.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0xac4) [0x56118f2d7884] 2024-09-14T11:39:02.072 INFO:tasks.workunit.client.0.smithi138.stderr: 6: main() 2024-09-14T11:39:02.072 INFO:tasks.workunit.client.0.smithi138.stderr: 7: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7fd1d5f0cd90] 2024-09-14T11:39:02.072 INFO:tasks.workunit.client.0.smithi138.stderr: 8: __libc_start_main() 2024-09-14T11:39:02.073 INFO:tasks.workunit.client.0.smithi138.stderr: 9: _start() 2024-09-14T11:39:02.073 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-14T11:39:02.073 INFO:tasks.workunit.client.0.smithi138.stderr: 0> 2024-09-14T11:39:02.009+0000 7fd1d37cc9c0 -1 *** Caught signal (Aborted) ** 2024-09-14T11:39:02.073 INFO:tasks.workunit.client.0.smithi138.stderr: in thread 7fd1d37cc9c0 thread_name:radosgw-admin 2024-09-14T11:39:02.073 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-14T11:39:02.073 INFO:tasks.workunit.client.0.smithi138.stderr: ceph version 19.3.0-4907-ga2782315 (a2782315255a3e7d5f6cdc9eb35785187ff6ddf8) squid (dev) 2024-09-14T11:39:02.073 INFO:tasks.workunit.client.0.smithi138.stderr: 1: /lib/x86_64-linux-gnu/libc.so.6(+0x42520) [0x7fd1d5f25520] 2024-09-14T11:39:02.073 INFO:tasks.workunit.client.0.smithi138.stderr: 2: pthread_kill() 2024-09-14T11:39:02.073 INFO:tasks.workunit.client.0.smithi138.stderr: 3: raise() 2024-09-14T11:39:02.073 INFO:tasks.workunit.client.0.smithi138.stderr: 4: abort() 2024-09-14T11:39:02.073 INFO:tasks.workunit.client.0.smithi138.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x17b) [0x7fd1d70a6345] 2024-09-14T11:39:02.073 INFO:tasks.workunit.client.0.smithi138.stderr: 6: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7fd1d70a649f] 2024-09-14T11:39:02.073 INFO:tasks.workunit.client.0.smithi138.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x56118f2c1c01] 2024-09-14T11:39:02.073 INFO:tasks.workunit.client.0.smithi138.stderr: 8: (RGWBucketReshard::do_reshard(rgw::bucket_index_layout_generation const&, rgw::bucket_index_layout_generation const&, int, bool, bool, std::ostream*, ceph::Formatter*, FaultInjector > >&, DoutPrefixProvider const*, optional_yield)+0x1411) [0x56118f2d6231] 2024-09-14T11:39:02.074 INFO:tasks.workunit.client.0.smithi138.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0xac4) [0x56118f2d7884] 2024-09-14T11:39:02.074 INFO:tasks.workunit.client.0.smithi138.stderr: 10: main() 2024-09-14T11:39:02.074 INFO:tasks.workunit.client.0.smithi138.stderr: 11: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7fd1d5f0cd90] 2024-09-14T11:39:02.074 INFO:tasks.workunit.client.0.smithi138.stderr: 12: __libc_start_main() 2024-09-14T11:39:02.074 INFO:tasks.workunit.client.0.smithi138.stderr: 13: _start() 2024-09-14T11:39:02.074 INFO:tasks.workunit.client.0.smithi138.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-14T11:39:02.074 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-14T11:39:02.074 INFO:tasks.workunit.client.0.smithi138.stderr:--- logging levels --- 2024-09-14T11:39:02.074 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 none 2024-09-14T11:39:02.074 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 1 lockdep 2024-09-14T11:39:02.074 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 1 context 2024-09-14T11:39:02.074 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 1 crush 2024-09-14T11:39:02.074 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 mds 2024-09-14T11:39:02.074 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 mds_balancer 2024-09-14T11:39:02.074 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 mds_locker 2024-09-14T11:39:02.075 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 mds_log 2024-09-14T11:39:02.075 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 mds_log_expire 2024-09-14T11:39:02.075 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 mds_migrator 2024-09-14T11:39:02.075 INFO:tasks.workunit.client.0.smithi138.stderr: 3/ 5 mds_quiesce 2024-09-14T11:39:02.075 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 1 buffer 2024-09-14T11:39:02.075 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 1 timer 2024-09-14T11:39:02.075 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 1 filer 2024-09-14T11:39:02.075 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 1 striper 2024-09-14T11:39:02.075 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 1 objecter 2024-09-14T11:39:02.075 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 rados 2024-09-14T11:39:02.075 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 rbd 2024-09-14T11:39:02.075 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 rbd_mirror 2024-09-14T11:39:02.075 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 rbd_replay 2024-09-14T11:39:02.075 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 rbd_pwl 2024-09-14T11:39:02.076 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 journaler 2024-09-14T11:39:02.076 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 objectcacher 2024-09-14T11:39:02.076 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 immutable_obj_cache 2024-09-14T11:39:02.076 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 client 2024-09-14T11:39:02.076 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 osd 2024-09-14T11:39:02.076 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 optracker 2024-09-14T11:39:02.076 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 objclass 2024-09-14T11:39:02.076 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 3 filestore 2024-09-14T11:39:02.076 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 3 journal 2024-09-14T11:39:02.076 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 0 ms 2024-09-14T11:39:02.076 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 mon 2024-09-14T11:39:02.076 INFO:tasks.workunit.client.0.smithi138.stderr: 0/10 monc 2024-09-14T11:39:02.076 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 paxos 2024-09-14T11:39:02.076 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 tp 2024-09-14T11:39:02.077 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 auth 2024-09-14T11:39:02.077 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 crypto 2024-09-14T11:39:02.077 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 1 finisher 2024-09-14T11:39:02.077 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 1 reserver 2024-09-14T11:39:02.077 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 heartbeatmap 2024-09-14T11:39:02.078 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 perfcounter 2024-09-14T11:39:02.078 INFO:tasks.workunit.client.0.smithi138.stderr: 20/20 rgw 2024-09-14T11:39:02.078 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 rgw_sync 2024-09-14T11:39:02.078 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 rgw_datacache 2024-09-14T11:39:02.078 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 rgw_access 2024-09-14T11:39:02.078 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 rgw_dbstore 2024-09-14T11:39:02.078 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 rgw_flight 2024-09-14T11:39:02.078 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 rgw_lifecycle 2024-09-14T11:39:02.078 INFO:tasks.workunit.client.0.smithi138.stderr: 20/20 rgw_notification 2024-09-14T11:39:02.078 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 javaclient 2024-09-14T11:39:02.078 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 asok 2024-09-14T11:39:02.078 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 1 throttle 2024-09-14T11:39:02.078 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 0 refs 2024-09-14T11:39:02.078 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 compressor 2024-09-14T11:39:02.078 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 bluestore 2024-09-14T11:39:02.079 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 bluefs 2024-09-14T11:39:02.079 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 3 bdev 2024-09-14T11:39:02.079 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 kstore 2024-09-14T11:39:02.079 INFO:tasks.workunit.client.0.smithi138.stderr: 4/ 5 rocksdb 2024-09-14T11:39:02.079 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 fuse 2024-09-14T11:39:02.079 INFO:tasks.workunit.client.0.smithi138.stderr: 2/ 5 mgr 2024-09-14T11:39:02.079 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 mgrc 2024-09-14T11:39:02.079 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 dpdk 2024-09-14T11:39:02.079 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 eventtrace 2024-09-14T11:39:02.079 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 prioritycache 2024-09-14T11:39:02.079 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 test 2024-09-14T11:39:02.079 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 cephfs_mirror 2024-09-14T11:39:02.079 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 cephsqlite 2024-09-14T11:39:02.079 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 crimson_interrupt 2024-09-14T11:39:02.079 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 seastore 2024-09-14T11:39:02.080 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 seastore_onode 2024-09-14T11:39:02.080 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 seastore_odata 2024-09-14T11:39:02.080 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 seastore_omap 2024-09-14T11:39:02.080 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 seastore_tm 2024-09-14T11:39:02.080 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 seastore_t 2024-09-14T11:39:02.080 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 seastore_cleaner 2024-09-14T11:39:02.080 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 seastore_epm 2024-09-14T11:39:02.080 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 seastore_lba 2024-09-14T11:39:02.080 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 seastore_fixedkv_tree 2024-09-14T11:39:02.080 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 seastore_cache 2024-09-14T11:39:02.080 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 seastore_journal 2024-09-14T11:39:02.080 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 seastore_device 2024-09-14T11:39:02.080 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 seastore_backref 2024-09-14T11:39:02.080 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 alienstore 2024-09-14T11:39:02.081 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 mclock 2024-09-14T11:39:02.081 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 cyanstore 2024-09-14T11:39:02.081 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 ceph_exporter 2024-09-14T11:39:02.081 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 memstore 2024-09-14T11:39:02.081 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 trace 2024-09-14T11:39:02.081 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 ceph_dedup 2024-09-14T11:39:02.081 INFO:tasks.workunit.client.0.smithi138.stderr: -2/-2 (syslog threshold) 2024-09-14T11:39:02.081 INFO:tasks.workunit.client.0.smithi138.stderr: 99/99 (stderr threshold) 2024-09-14T11:39:02.081 INFO:tasks.workunit.client.0.smithi138.stderr:--- pthread ID / name mapping for recent threads --- 2024-09-14T11:39:02.081 INFO:tasks.workunit.client.0.smithi138.stderr: 7fcff7fff640 / http_manager 2024-09-14T11:39:02.081 INFO:tasks.workunit.client.0.smithi138.stderr: 7fd0867e4640 / http_manager 2024-09-14T11:39:02.081 INFO:tasks.workunit.client.0.smithi138.stderr: 7fd0877e6640 / rgw_dt_lg_renew 2024-09-14T11:39:02.081 INFO:tasks.workunit.client.0.smithi138.stderr: 7fd0a2ffd640 / ms_dispatch 2024-09-14T11:39:02.081 INFO:tasks.workunit.client.0.smithi138.stderr: 7fd0a3fff640 / io_context_pool 2024-09-14T11:39:02.082 INFO:tasks.workunit.client.0.smithi138.stderr: 7fd0b4ff9640 / io_context_pool 2024-09-14T11:39:02.082 INFO:tasks.workunit.client.0.smithi138.stderr: 7fd0b6ffd640 / ms_dispatch 2024-09-14T11:39:02.082 INFO:tasks.workunit.client.0.smithi138.stderr: 7fd0bde03640 / ms_dispatch 2024-09-14T11:39:02.082 INFO:tasks.workunit.client.0.smithi138.stderr: 7fd0bf606640 / io_context_pool 2024-09-14T11:39:02.082 INFO:tasks.workunit.client.0.smithi138.stderr: 7fd1d0ad1640 / msgr-worker-2 2024-09-14T11:39:02.082 INFO:tasks.workunit.client.0.smithi138.stderr: 7fd1d12d2640 / msgr-worker-1 2024-09-14T11:39:02.082 INFO:tasks.workunit.client.0.smithi138.stderr: 7fd1d1ad3640 / msgr-worker-0 2024-09-14T11:39:02.082 INFO:tasks.workunit.client.0.smithi138.stderr: 7fd1d22d4640 / io_context_pool 2024-09-14T11:39:02.082 INFO:tasks.workunit.client.0.smithi138.stderr: 7fd1d37cc9c0 / radosgw-admin 2024-09-14T11:39:02.082 INFO:tasks.workunit.client.0.smithi138.stderr: max_recent 500 2024-09-14T11:39:02.082 INFO:tasks.workunit.client.0.smithi138.stderr: max_new 1000 2024-09-14T11:39:02.082 INFO:tasks.workunit.client.0.smithi138.stderr: log_file /var/log/ceph/ceph-client.admin.133895.log 2024-09-14T11:39:02.082 INFO:tasks.workunit.client.0.smithi138.stderr:--- end dump of recent events --- 2024-09-14T11:39:02.082 INFO:tasks.workunit.client.0.smithi138.stderr:--- begin dump of recent events --- 2024-09-14T11:39:02.082 INFO:tasks.workunit.client.0.smithi138.stderr: -499> 2024-09-14T11:39:01.469+0000 7fd1d37cc9c0 1 librados: setting wanted keys 2024-09-14T11:39:02.083 INFO:tasks.workunit.client.0.smithi138.stderr: -498> 2024-09-14T11:39:01.469+0000 7fd1d37cc9c0 1 librados: calling monclient init 2024-09-14T11:39:02.083 INFO:tasks.workunit.client.0.smithi138.stderr: -497> 2024-09-14T11:39:01.469+0000 7fd1d37cc9c0 10 monclient: init 2024-09-14T11:39:02.083 INFO:tasks.workunit.client.0.smithi138.stderr: -496> 2024-09-14T11:39:01.469+0000 7fd1d37cc9c0 5 AuthRegistry(0x5611922a2df0) adding auth protocol: cephx 2024-09-14T11:39:02.083 INFO:tasks.workunit.client.0.smithi138.stderr: -495> 2024-09-14T11:39:01.469+0000 7fd1d37cc9c0 5 AuthRegistry(0x5611922a2df0) adding auth protocol: cephx 2024-09-14T11:39:02.083 INFO:tasks.workunit.client.0.smithi138.stderr: -494> 2024-09-14T11:39:01.469+0000 7fd1d37cc9c0 5 AuthRegistry(0x5611922a2df0) adding auth protocol: cephx 2024-09-14T11:39:02.083 INFO:tasks.workunit.client.0.smithi138.stderr: -493> 2024-09-14T11:39:01.469+0000 7fd1d37cc9c0 5 AuthRegistry(0x5611922a2df0) adding con mode: secure 2024-09-14T11:39:02.083 INFO:tasks.workunit.client.0.smithi138.stderr: -492> 2024-09-14T11:39:01.469+0000 7fd1d37cc9c0 5 AuthRegistry(0x5611922a2df0) adding con mode: crc 2024-09-14T11:39:02.083 INFO:tasks.workunit.client.0.smithi138.stderr: -491> 2024-09-14T11:39:01.469+0000 7fd1d37cc9c0 5 AuthRegistry(0x5611922a2df0) adding con mode: secure 2024-09-14T11:39:02.083 INFO:tasks.workunit.client.0.smithi138.stderr: -490> 2024-09-14T11:39:01.469+0000 7fd1d37cc9c0 5 AuthRegistry(0x5611922a2df0) adding con mode: crc 2024-09-14T11:39:02.083 INFO:tasks.workunit.client.0.smithi138.stderr: -489> 2024-09-14T11:39:01.469+0000 7fd1d37cc9c0 5 AuthRegistry(0x5611922a2df0) adding con mode: secure 2024-09-14T11:39:02.083 INFO:tasks.workunit.client.0.smithi138.stderr: -488> 2024-09-14T11:39:01.469+0000 7fd1d37cc9c0 5 AuthRegistry(0x5611922a2df0) adding con mode: crc 2024-09-14T11:39:02.083 INFO:tasks.workunit.client.0.smithi138.stderr: -487> 2024-09-14T11:39:01.469+0000 7fd1d37cc9c0 5 AuthRegistry(0x5611922a2df0) adding con mode: crc 2024-09-14T11:39:02.083 INFO:tasks.workunit.client.0.smithi138.stderr: -486> 2024-09-14T11:39:01.469+0000 7fd1d37cc9c0 5 AuthRegistry(0x5611922a2df0) adding con mode: secure 2024-09-14T11:39:02.083 INFO:tasks.workunit.client.0.smithi138.stderr: -485> 2024-09-14T11:39:01.469+0000 7fd1d37cc9c0 5 AuthRegistry(0x5611922a2df0) adding con mode: crc 2024-09-14T11:39:02.083 INFO:tasks.workunit.client.0.smithi138.stderr: -484> 2024-09-14T11:39:01.469+0000 7fd1d37cc9c0 5 AuthRegistry(0x5611922a2df0) adding con mode: secure 2024-09-14T11:39:02.084 INFO:tasks.workunit.client.0.smithi138.stderr: -483> 2024-09-14T11:39:01.469+0000 7fd1d37cc9c0 5 AuthRegistry(0x5611922a2df0) adding con mode: crc 2024-09-14T11:39:02.084 INFO:tasks.workunit.client.0.smithi138.stderr: -482> 2024-09-14T11:39:01.469+0000 7fd1d37cc9c0 5 AuthRegistry(0x5611922a2df0) adding con mode: secure 2024-09-14T11:39:02.084 INFO:tasks.workunit.client.0.smithi138.stderr: -481> 2024-09-14T11:39:01.469+0000 7fd1d37cc9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:39:02.084 INFO:tasks.workunit.client.0.smithi138.stderr: -480> 2024-09-14T11:39:01.469+0000 7fd1d37cc9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:39:02.084 INFO:tasks.workunit.client.0.smithi138.stderr: -479> 2024-09-14T11:39:01.469+0000 7fd1d37cc9c0 5 asok(0x561192097d90) register_command rotate-key hook 0x5611922a2f38 2024-09-14T11:39:02.084 INFO:tasks.workunit.client.0.smithi138.stderr: -478> 2024-09-14T11:39:01.469+0000 7fd1d37cc9c0 10 monclient: _reopen_session rank -1 2024-09-14T11:39:02.084 INFO:tasks.workunit.client.0.smithi138.stderr: -477> 2024-09-14T11:39:01.469+0000 7fd1d37cc9c0 10 monclient: _add_conns ranks=[2,1,0] 2024-09-14T11:39:02.084 INFO:tasks.workunit.client.0.smithi138.stderr: -476> 2024-09-14T11:39:01.469+0000 7fd1d37cc9c0 10 monclient(hunting): picked mon.noname-c con 0x561192130740 addr [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] 2024-09-14T11:39:02.084 INFO:tasks.workunit.client.0.smithi138.stderr: -475> 2024-09-14T11:39:01.469+0000 7fd1d37cc9c0 10 monclient(hunting): picked mon.noname-b con 0x5611921e8120 addr [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] 2024-09-14T11:39:02.084 INFO:tasks.workunit.client.0.smithi138.stderr: -474> 2024-09-14T11:39:01.469+0000 7fd1d37cc9c0 10 monclient(hunting): picked mon.noname-a con 0x5611921ecaf0 addr [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] 2024-09-14T11:39:02.084 INFO:tasks.workunit.client.0.smithi138.stderr: -473> 2024-09-14T11:39:01.469+0000 7fd1d37cc9c0 10 monclient(hunting): start opening mon connection 2024-09-14T11:39:02.084 INFO:tasks.workunit.client.0.smithi138.stderr: -472> 2024-09-14T11:39:01.469+0000 7fd1d37cc9c0 10 monclient(hunting): start opening mon connection 2024-09-14T11:39:02.084 INFO:tasks.workunit.client.0.smithi138.stderr: -471> 2024-09-14T11:39:01.469+0000 7fd1d37cc9c0 10 monclient(hunting): start opening mon connection 2024-09-14T11:39:02.084 INFO:tasks.workunit.client.0.smithi138.stderr: -470> 2024-09-14T11:39:01.469+0000 7fd1d37cc9c0 10 monclient(hunting): _renew_subs 2024-09-14T11:39:02.085 INFO:tasks.workunit.client.0.smithi138.stderr: -469> 2024-09-14T11:39:01.469+0000 7fd1d37cc9c0 10 monclient(hunting): authenticate will time out at 2877.432797s 2024-09-14T11:39:02.085 INFO:tasks.workunit.client.0.smithi138.stderr: -468> 2024-09-14T11:39:01.469+0000 7fd1d12d2640 10 monclient(hunting): get_auth_request con 0x561192130740 auth_method 0 2024-09-14T11:39:02.085 INFO:tasks.workunit.client.0.smithi138.stderr: -467> 2024-09-14T11:39:01.469+0000 7fd1d12d2640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:39:02.085 INFO:tasks.workunit.client.0.smithi138.stderr: -466> 2024-09-14T11:39:01.469+0000 7fd1d12d2640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:39:02.085 INFO:tasks.workunit.client.0.smithi138.stderr: -465> 2024-09-14T11:39:01.469+0000 7fd1d12d2640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:39:02.085 INFO:tasks.workunit.client.0.smithi138.stderr: -464> 2024-09-14T11:39:01.469+0000 7fd1d1ad3640 10 monclient(hunting): get_auth_request con 0x5611921ecaf0 auth_method 0 2024-09-14T11:39:02.085 INFO:tasks.workunit.client.0.smithi138.stderr: -463> 2024-09-14T11:39:01.469+0000 7fd1d1ad3640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:39:02.085 INFO:tasks.workunit.client.0.smithi138.stderr: -462> 2024-09-14T11:39:01.469+0000 7fd1d1ad3640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:39:02.085 INFO:tasks.workunit.client.0.smithi138.stderr: -461> 2024-09-14T11:39:01.469+0000 7fd1d1ad3640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:39:02.085 INFO:tasks.workunit.client.0.smithi138.stderr: -460> 2024-09-14T11:39:01.469+0000 7fd1d12d2640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:39:02.085 INFO:tasks.workunit.client.0.smithi138.stderr: -459> 2024-09-14T11:39:01.469+0000 7fd1d12d2640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:39:02.085 INFO:tasks.workunit.client.0.smithi138.stderr: -458> 2024-09-14T11:39:01.469+0000 7fd1d12d2640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:39:02.085 INFO:tasks.workunit.client.0.smithi138.stderr: -457> 2024-09-14T11:39:01.469+0000 7fd1d1ad3640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:39:02.085 INFO:tasks.workunit.client.0.smithi138.stderr: -456> 2024-09-14T11:39:01.469+0000 7fd1d1ad3640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:39:02.085 INFO:tasks.workunit.client.0.smithi138.stderr: -455> 2024-09-14T11:39:01.469+0000 7fd1d1ad3640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:39:02.086 INFO:tasks.workunit.client.0.smithi138.stderr: -454> 2024-09-14T11:39:01.469+0000 7fd1d12d2640 10 monclient(hunting): handle_auth_done global_id 7364 payload 824 2024-09-14T11:39:02.086 INFO:tasks.workunit.client.0.smithi138.stderr: -453> 2024-09-14T11:39:01.469+0000 7fd1d12d2640 10 monclient: _finish_hunting 0 2024-09-14T11:39:02.086 INFO:tasks.workunit.client.0.smithi138.stderr: -452> 2024-09-14T11:39:01.469+0000 7fd1d12d2640 1 monclient: found mon.noname-c 2024-09-14T11:39:02.086 INFO:tasks.workunit.client.0.smithi138.stderr: -451> 2024-09-14T11:39:01.469+0000 7fd1d12d2640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.138:3301/0 2024-09-14T11:39:02.086 INFO:tasks.workunit.client.0.smithi138.stderr: -450> 2024-09-14T11:39:01.469+0000 7fd1d0ad1640 10 monclient: get_auth_request con 0x5611921e8120 auth_method 0 2024-09-14T11:39:02.086 INFO:tasks.workunit.client.0.smithi138.stderr: -449> 2024-09-14T11:39:01.469+0000 7fd0bde03640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:39:02.086 INFO:tasks.workunit.client.0.smithi138.stderr: -448> 2024-09-14T11:39:01.469+0000 7fd0bde03640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-14T11:39:02.086 INFO:tasks.workunit.client.0.smithi138.stderr: -447> 2024-09-14T11:39:01.469+0000 7fd0bde03640 10 monclient: dump: 2024-09-14T11:39:02.086 INFO:tasks.workunit.client.0.smithi138.stderr:epoch 1 2024-09-14T11:39:02.086 INFO:tasks.workunit.client.0.smithi138.stderr:fsid 3f225f43-83a6-4aeb-b798-1f04bb49d597 2024-09-14T11:39:02.086 INFO:tasks.workunit.client.0.smithi138.stderr:last_changed 2024-09-14T11:07:09.252780+0000 2024-09-14T11:39:02.086 INFO:tasks.workunit.client.0.smithi138.stderr:created 2024-09-14T11:07:09.252780+0000 2024-09-14T11:39:02.086 INFO:tasks.workunit.client.0.smithi138.stderr:min_mon_release 19 (squid) 2024-09-14T11:39:02.086 INFO:tasks.workunit.client.0.smithi138.stderr:election_strategy: 1 2024-09-14T11:39:02.087 INFO:tasks.workunit.client.0.smithi138.stderr:0: [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] mon.a 2024-09-14T11:39:02.087 INFO:tasks.workunit.client.0.smithi138.stderr:1: [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] mon.b 2024-09-14T11:39:02.087 INFO:tasks.workunit.client.0.smithi138.stderr:2: [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] mon.c 2024-09-14T11:39:02.087 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-14T11:39:02.087 INFO:tasks.workunit.client.0.smithi138.stderr: -446> 2024-09-14T11:39:01.469+0000 7fd0bde03640 10 monclient: _finish_auth 0 2024-09-14T11:39:02.087 INFO:tasks.workunit.client.0.smithi138.stderr: -445> 2024-09-14T11:39:01.469+0000 7fd0bde03640 10 monclient: _check_auth_tickets 2024-09-14T11:39:02.087 INFO:tasks.workunit.client.0.smithi138.stderr: -444> 2024-09-14T11:39:01.469+0000 7fd0bde03640 10 monclient: handle_config config(0 keys) 2024-09-14T11:39:02.087 INFO:tasks.workunit.client.0.smithi138.stderr: -443> 2024-09-14T11:39:01.469+0000 7fd0bde03640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:39:02.087 INFO:tasks.workunit.client.0.smithi138.stderr: -442> 2024-09-14T11:39:01.469+0000 7fd0bde03640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-14T11:39:02.087 INFO:tasks.workunit.client.0.smithi138.stderr: -441> 2024-09-14T11:39:01.469+0000 7fd0bde03640 10 monclient: dump: 2024-09-14T11:39:02.087 INFO:tasks.workunit.client.0.smithi138.stderr:epoch 1 2024-09-14T11:39:02.087 INFO:tasks.workunit.client.0.smithi138.stderr:fsid 3f225f43-83a6-4aeb-b798-1f04bb49d597 2024-09-14T11:39:02.087 INFO:tasks.workunit.client.0.smithi138.stderr:last_changed 2024-09-14T11:07:09.252780+0000 2024-09-14T11:39:02.087 INFO:tasks.workunit.client.0.smithi138.stderr:created 2024-09-14T11:07:09.252780+0000 2024-09-14T11:39:02.087 INFO:tasks.workunit.client.0.smithi138.stderr:min_mon_release 19 (squid) 2024-09-14T11:39:02.088 INFO:tasks.workunit.client.0.smithi138.stderr:election_strategy: 1 2024-09-14T11:39:02.088 INFO:tasks.workunit.client.0.smithi138.stderr:0: [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] mon.a 2024-09-14T11:39:02.088 INFO:tasks.workunit.client.0.smithi138.stderr:1: [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] mon.b 2024-09-14T11:39:02.088 INFO:tasks.workunit.client.0.smithi138.stderr:2: [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] mon.c 2024-09-14T11:39:02.088 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-14T11:39:02.088 INFO:tasks.workunit.client.0.smithi138.stderr: -440> 2024-09-14T11:39:01.469+0000 7fd0bf606640 4 set_mon_vals no callback set 2024-09-14T11:39:02.088 INFO:tasks.workunit.client.0.smithi138.stderr: -439> 2024-09-14T11:39:01.469+0000 7fd1d37cc9c0 5 monclient: authenticate success, global_id 7364 2024-09-14T11:39:02.088 INFO:tasks.workunit.client.0.smithi138.stderr: -438> 2024-09-14T11:39:01.469+0000 7fd1d37cc9c0 10 monclient: _renew_subs 2024-09-14T11:39:02.088 INFO:tasks.workunit.client.0.smithi138.stderr: -437> 2024-09-14T11:39:01.469+0000 7fd1d37cc9c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.138:3301/0 2024-09-14T11:39:02.088 INFO:tasks.workunit.client.0.smithi138.stderr: -436> 2024-09-14T11:39:01.469+0000 7fd1d37cc9c0 10 monclient: _renew_subs 2024-09-14T11:39:02.088 INFO:tasks.workunit.client.0.smithi138.stderr: -435> 2024-09-14T11:39:01.469+0000 7fd1d37cc9c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.138:3301/0 2024-09-14T11:39:02.088 INFO:tasks.workunit.client.0.smithi138.stderr: -434> 2024-09-14T11:39:01.469+0000 7fd1d37cc9c0 1 librados: init done 2024-09-14T11:39:02.088 INFO:tasks.workunit.client.0.smithi138.stderr: -433> 2024-09-14T11:39:01.473+0000 7fd0bde03640 4 mgrc handle_mgr_map Got map version 5 2024-09-14T11:39:02.088 INFO:tasks.workunit.client.0.smithi138.stderr: -432> 2024-09-14T11:39:01.473+0000 7fd0bde03640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.138:6832/3778043143,v1:172.21.15.138:6833/3778043143] 2024-09-14T11:39:02.089 INFO:tasks.workunit.client.0.smithi138.stderr: -431> 2024-09-14T11:39:01.473+0000 7fd0bde03640 4 mgrc reconnect Starting new session with [v2:172.21.15.138:6832/3778043143,v1:172.21.15.138:6833/3778043143] 2024-09-14T11:39:02.089 INFO:tasks.workunit.client.0.smithi138.stderr: -430> 2024-09-14T11:39:01.473+0000 7fd1d0ad1640 10 monclient: get_auth_request con 0x7fd0b80718a0 auth_method 0 2024-09-14T11:39:02.089 INFO:tasks.workunit.client.0.smithi138.stderr: -429> 2024-09-14T11:39:01.473+0000 7fd1d1ad3640 10 monclient: get_auth_request con 0x5611922ca230 auth_method 0 2024-09-14T11:39:02.089 INFO:tasks.workunit.client.0.smithi138.stderr: -428> 2024-09-14T11:39:01.473+0000 7fd1d12d2640 10 monclient: get_auth_request con 0x5611922edb90 auth_method 0 2024-09-14T11:39:02.089 INFO:tasks.workunit.client.0.smithi138.stderr: -427> 2024-09-14T11:39:01.473+0000 7fd1d0ad1640 10 monclient: get_auth_request con 0x5611922f1ef0 auth_method 0 2024-09-14T11:39:02.089 INFO:tasks.workunit.client.0.smithi138.stderr: -426> 2024-09-14T11:39:01.477+0000 7fd1d1ad3640 10 monclient: get_auth_request con 0x5611922f1410 auth_method 0 2024-09-14T11:39:02.089 INFO:tasks.workunit.client.0.smithi138.stderr: -425> 2024-09-14T11:39:01.477+0000 7fd1d37cc9c0 10 monclient: build_initial_monmap 2024-09-14T11:39:02.089 INFO:tasks.workunit.client.0.smithi138.stderr: -424> 2024-09-14T11:39:01.477+0000 7fd1d37cc9c0 1 build_initial for_mkfs: 0 2024-09-14T11:39:02.089 INFO:tasks.workunit.client.0.smithi138.stderr: -423> 2024-09-14T11:39:01.477+0000 7fd1d37cc9c0 10 monclient: monmap: 2024-09-14T11:39:02.089 INFO:tasks.workunit.client.0.smithi138.stderr:epoch 0 2024-09-14T11:39:02.089 INFO:tasks.workunit.client.0.smithi138.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-14T11:39:02.089 INFO:tasks.workunit.client.0.smithi138.stderr:last_changed 0.000000 2024-09-14T11:39:02.089 INFO:tasks.workunit.client.0.smithi138.stderr:created 0.000000 2024-09-14T11:39:02.089 INFO:tasks.workunit.client.0.smithi138.stderr:min_mon_release 0 (unknown) 2024-09-14T11:39:02.090 INFO:tasks.workunit.client.0.smithi138.stderr:election_strategy: 1 2024-09-14T11:39:02.090 INFO:tasks.workunit.client.0.smithi138.stderr:0: [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] mon.noname-a 2024-09-14T11:39:02.090 INFO:tasks.workunit.client.0.smithi138.stderr:1: [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] mon.noname-b 2024-09-14T11:39:02.090 INFO:tasks.workunit.client.0.smithi138.stderr:2: [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] mon.noname-c 2024-09-14T11:39:02.090 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-14T11:39:02.090 INFO:tasks.workunit.client.0.smithi138.stderr: -422> 2024-09-14T11:39:01.477+0000 7fd1d37cc9c0 5 AuthRegistry(0x5611922fa0e0) adding auth protocol: cephx 2024-09-14T11:39:02.090 INFO:tasks.workunit.client.0.smithi138.stderr: -421> 2024-09-14T11:39:01.477+0000 7fd1d37cc9c0 5 AuthRegistry(0x5611922fa0e0) adding auth protocol: cephx 2024-09-14T11:39:02.090 INFO:tasks.workunit.client.0.smithi138.stderr: -420> 2024-09-14T11:39:01.477+0000 7fd1d37cc9c0 5 AuthRegistry(0x5611922fa0e0) adding auth protocol: cephx 2024-09-14T11:39:02.090 INFO:tasks.workunit.client.0.smithi138.stderr: -419> 2024-09-14T11:39:01.477+0000 7fd1d37cc9c0 5 AuthRegistry(0x5611922fa0e0) adding con mode: secure 2024-09-14T11:39:02.090 INFO:tasks.workunit.client.0.smithi138.stderr: -418> 2024-09-14T11:39:01.477+0000 7fd1d37cc9c0 5 AuthRegistry(0x5611922fa0e0) adding con mode: crc 2024-09-14T11:39:02.090 INFO:tasks.workunit.client.0.smithi138.stderr: -417> 2024-09-14T11:39:01.477+0000 7fd1d37cc9c0 5 AuthRegistry(0x5611922fa0e0) adding con mode: secure 2024-09-14T11:39:02.090 INFO:tasks.workunit.client.0.smithi138.stderr: -416> 2024-09-14T11:39:01.477+0000 7fd1d37cc9c0 5 AuthRegistry(0x5611922fa0e0) adding con mode: crc 2024-09-14T11:39:02.090 INFO:tasks.workunit.client.0.smithi138.stderr: -415> 2024-09-14T11:39:01.477+0000 7fd1d37cc9c0 5 AuthRegistry(0x5611922fa0e0) adding con mode: secure 2024-09-14T11:39:02.090 INFO:tasks.workunit.client.0.smithi138.stderr: -414> 2024-09-14T11:39:01.477+0000 7fd1d37cc9c0 5 AuthRegistry(0x5611922fa0e0) adding con mode: crc 2024-09-14T11:39:02.090 INFO:tasks.workunit.client.0.smithi138.stderr: -413> 2024-09-14T11:39:01.477+0000 7fd1d37cc9c0 5 AuthRegistry(0x5611922fa0e0) adding con mode: crc 2024-09-14T11:39:02.091 INFO:tasks.workunit.client.0.smithi138.stderr: -412> 2024-09-14T11:39:01.477+0000 7fd1d37cc9c0 5 AuthRegistry(0x5611922fa0e0) adding con mode: secure 2024-09-14T11:39:02.091 INFO:tasks.workunit.client.0.smithi138.stderr: -411> 2024-09-14T11:39:01.477+0000 7fd1d37cc9c0 5 AuthRegistry(0x5611922fa0e0) adding con mode: crc 2024-09-14T11:39:02.091 INFO:tasks.workunit.client.0.smithi138.stderr: -410> 2024-09-14T11:39:01.477+0000 7fd1d37cc9c0 5 AuthRegistry(0x5611922fa0e0) adding con mode: secure 2024-09-14T11:39:02.091 INFO:tasks.workunit.client.0.smithi138.stderr: -409> 2024-09-14T11:39:01.477+0000 7fd1d37cc9c0 5 AuthRegistry(0x5611922fa0e0) adding con mode: crc 2024-09-14T11:39:02.091 INFO:tasks.workunit.client.0.smithi138.stderr: -408> 2024-09-14T11:39:01.477+0000 7fd1d37cc9c0 5 AuthRegistry(0x5611922fa0e0) adding con mode: secure 2024-09-14T11:39:02.091 INFO:tasks.workunit.client.0.smithi138.stderr: -407> 2024-09-14T11:39:01.477+0000 7fd1d37cc9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:39:02.091 INFO:tasks.workunit.client.0.smithi138.stderr: -406> 2024-09-14T11:39:01.477+0000 7fd1d37cc9c0 5 asok(0x561192097d90) register_command objecter_requests cmddesc objecter_requests hook 0x5611922fdad0 EEXIST 2024-09-14T11:39:02.091 INFO:tasks.workunit.client.0.smithi138.stderr: -405> 2024-09-14T11:39:01.477+0000 7fd1d37cc9c0 10 monclient: init 2024-09-14T11:39:02.091 INFO:tasks.workunit.client.0.smithi138.stderr: -404> 2024-09-14T11:39:01.477+0000 7fd1d37cc9c0 5 AuthRegistry(0x5611922f8fd8) adding auth protocol: cephx 2024-09-14T11:39:02.091 INFO:tasks.workunit.client.0.smithi138.stderr: -403> 2024-09-14T11:39:01.477+0000 7fd1d37cc9c0 5 AuthRegistry(0x5611922f8fd8) adding auth protocol: cephx 2024-09-14T11:39:02.091 INFO:tasks.workunit.client.0.smithi138.stderr: -402> 2024-09-14T11:39:01.477+0000 7fd1d37cc9c0 5 AuthRegistry(0x5611922f8fd8) adding auth protocol: cephx 2024-09-14T11:39:02.091 INFO:tasks.workunit.client.0.smithi138.stderr: -401> 2024-09-14T11:39:01.477+0000 7fd1d37cc9c0 5 AuthRegistry(0x5611922f8fd8) adding con mode: secure 2024-09-14T11:39:02.091 INFO:tasks.workunit.client.0.smithi138.stderr: -400> 2024-09-14T11:39:01.477+0000 7fd1d37cc9c0 5 AuthRegistry(0x5611922f8fd8) adding con mode: crc 2024-09-14T11:39:02.091 INFO:tasks.workunit.client.0.smithi138.stderr: -399> 2024-09-14T11:39:01.477+0000 7fd1d37cc9c0 5 AuthRegistry(0x5611922f8fd8) adding con mode: secure 2024-09-14T11:39:02.092 INFO:tasks.workunit.client.0.smithi138.stderr: -398> 2024-09-14T11:39:01.477+0000 7fd1d37cc9c0 5 AuthRegistry(0x5611922f8fd8) adding con mode: crc 2024-09-14T11:39:02.092 INFO:tasks.workunit.client.0.smithi138.stderr: -397> 2024-09-14T11:39:01.477+0000 7fd1d37cc9c0 5 AuthRegistry(0x5611922f8fd8) adding con mode: secure 2024-09-14T11:39:02.092 INFO:tasks.workunit.client.0.smithi138.stderr: -396> 2024-09-14T11:39:01.477+0000 7fd1d37cc9c0 5 AuthRegistry(0x5611922f8fd8) adding con mode: crc 2024-09-14T11:39:02.092 INFO:tasks.workunit.client.0.smithi138.stderr: -395> 2024-09-14T11:39:01.477+0000 7fd1d37cc9c0 5 AuthRegistry(0x5611922f8fd8) adding con mode: crc 2024-09-14T11:39:02.092 INFO:tasks.workunit.client.0.smithi138.stderr: -394> 2024-09-14T11:39:01.477+0000 7fd1d37cc9c0 5 AuthRegistry(0x5611922f8fd8) adding con mode: secure 2024-09-14T11:39:02.092 INFO:tasks.workunit.client.0.smithi138.stderr: -393> 2024-09-14T11:39:01.477+0000 7fd1d37cc9c0 5 AuthRegistry(0x5611922f8fd8) adding con mode: crc 2024-09-14T11:39:02.092 INFO:tasks.workunit.client.0.smithi138.stderr: -392> 2024-09-14T11:39:01.477+0000 7fd1d37cc9c0 5 AuthRegistry(0x5611922f8fd8) adding con mode: secure 2024-09-14T11:39:02.092 INFO:tasks.workunit.client.0.smithi138.stderr: -391> 2024-09-14T11:39:01.477+0000 7fd1d37cc9c0 5 AuthRegistry(0x5611922f8fd8) adding con mode: crc 2024-09-14T11:39:02.092 INFO:tasks.workunit.client.0.smithi138.stderr: -390> 2024-09-14T11:39:01.477+0000 7fd1d37cc9c0 5 AuthRegistry(0x5611922f8fd8) adding con mode: secure 2024-09-14T11:39:02.092 INFO:tasks.workunit.client.0.smithi138.stderr: -389> 2024-09-14T11:39:01.477+0000 7fd1d37cc9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:39:02.092 INFO:tasks.workunit.client.0.smithi138.stderr: -388> 2024-09-14T11:39:01.477+0000 7fd1d37cc9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:39:02.092 INFO:tasks.workunit.client.0.smithi138.stderr: -387> 2024-09-14T11:39:01.477+0000 7fd1d37cc9c0 5 asok(0x561192097d90) register_command rotate-key cmddesc rotate-key hook 0x5611922f9120 EEXIST 2024-09-14T11:39:02.092 INFO:tasks.workunit.client.0.smithi138.stderr: -386> 2024-09-14T11:39:01.477+0000 7fd1d37cc9c0 10 monclient: _reopen_session rank -1 2024-09-14T11:39:02.092 INFO:tasks.workunit.client.0.smithi138.stderr: -385> 2024-09-14T11:39:01.477+0000 7fd1d37cc9c0 10 monclient: _add_conns ranks=[0,1,2] 2024-09-14T11:39:02.093 INFO:tasks.workunit.client.0.smithi138.stderr: -384> 2024-09-14T11:39:01.477+0000 7fd1d37cc9c0 10 monclient(hunting): picked mon.noname-a con 0x561192321c80 addr [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] 2024-09-14T11:39:02.093 INFO:tasks.workunit.client.0.smithi138.stderr: -383> 2024-09-14T11:39:01.477+0000 7fd1d37cc9c0 10 monclient(hunting): picked mon.noname-b con 0x5611923215b0 addr [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] 2024-09-14T11:39:02.093 INFO:tasks.workunit.client.0.smithi138.stderr: -382> 2024-09-14T11:39:01.477+0000 7fd1d37cc9c0 10 monclient(hunting): picked mon.noname-c con 0x56119231ff90 addr [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] 2024-09-14T11:39:02.093 INFO:tasks.workunit.client.0.smithi138.stderr: -381> 2024-09-14T11:39:01.477+0000 7fd1d37cc9c0 10 monclient(hunting): start opening mon connection 2024-09-14T11:39:02.093 INFO:tasks.workunit.client.0.smithi138.stderr: -380> 2024-09-14T11:39:01.477+0000 7fd1d37cc9c0 10 monclient(hunting): start opening mon connection 2024-09-14T11:39:02.093 INFO:tasks.workunit.client.0.smithi138.stderr: -379> 2024-09-14T11:39:01.477+0000 7fd1d37cc9c0 10 monclient(hunting): start opening mon connection 2024-09-14T11:39:02.093 INFO:tasks.workunit.client.0.smithi138.stderr: -378> 2024-09-14T11:39:01.477+0000 7fd1d37cc9c0 10 monclient(hunting): _renew_subs 2024-09-14T11:39:02.093 INFO:tasks.workunit.client.0.smithi138.stderr: -377> 2024-09-14T11:39:01.477+0000 7fd1d37cc9c0 10 monclient(hunting): authenticate will time out at 2877.443557s 2024-09-14T11:39:02.093 INFO:tasks.workunit.client.0.smithi138.stderr: -376> 2024-09-14T11:39:01.477+0000 7fd1d0ad1640 10 monclient(hunting): get_auth_request con 0x561192321c80 auth_method 0 2024-09-14T11:39:02.093 INFO:tasks.workunit.client.0.smithi138.stderr: -375> 2024-09-14T11:39:01.477+0000 7fd1d0ad1640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:39:02.093 INFO:tasks.workunit.client.0.smithi138.stderr: -374> 2024-09-14T11:39:01.477+0000 7fd1d0ad1640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:39:02.093 INFO:tasks.workunit.client.0.smithi138.stderr: -373> 2024-09-14T11:39:01.477+0000 7fd1d0ad1640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:39:02.093 INFO:tasks.workunit.client.0.smithi138.stderr: -372> 2024-09-14T11:39:01.477+0000 7fd1d12d2640 10 monclient(hunting): get_auth_request con 0x56119231ff90 auth_method 0 2024-09-14T11:39:02.094 INFO:tasks.workunit.client.0.smithi138.stderr: -371> 2024-09-14T11:39:01.477+0000 7fd1d12d2640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:39:02.094 INFO:tasks.workunit.client.0.smithi138.stderr: -370> 2024-09-14T11:39:01.477+0000 7fd1d12d2640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:39:02.094 INFO:tasks.workunit.client.0.smithi138.stderr: -369> 2024-09-14T11:39:01.477+0000 7fd1d12d2640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:39:02.094 INFO:tasks.workunit.client.0.smithi138.stderr: -368> 2024-09-14T11:39:01.477+0000 7fd1d0ad1640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:39:02.094 INFO:tasks.workunit.client.0.smithi138.stderr: -367> 2024-09-14T11:39:01.477+0000 7fd1d0ad1640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:39:02.094 INFO:tasks.workunit.client.0.smithi138.stderr: -366> 2024-09-14T11:39:01.477+0000 7fd1d0ad1640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:39:02.094 INFO:tasks.workunit.client.0.smithi138.stderr: -365> 2024-09-14T11:39:01.477+0000 7fd1d12d2640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:39:02.094 INFO:tasks.workunit.client.0.smithi138.stderr: -364> 2024-09-14T11:39:01.477+0000 7fd1d12d2640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:39:02.094 INFO:tasks.workunit.client.0.smithi138.stderr: -363> 2024-09-14T11:39:01.477+0000 7fd1d12d2640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:39:02.094 INFO:tasks.workunit.client.0.smithi138.stderr: -362> 2024-09-14T11:39:01.477+0000 7fd1d1ad3640 10 monclient(hunting): get_auth_request con 0x5611923215b0 auth_method 0 2024-09-14T11:39:02.094 INFO:tasks.workunit.client.0.smithi138.stderr: -361> 2024-09-14T11:39:01.477+0000 7fd1d1ad3640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:39:02.094 INFO:tasks.workunit.client.0.smithi138.stderr: -360> 2024-09-14T11:39:01.477+0000 7fd1d1ad3640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:39:02.094 INFO:tasks.workunit.client.0.smithi138.stderr: -359> 2024-09-14T11:39:01.477+0000 7fd1d1ad3640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:39:02.094 INFO:tasks.workunit.client.0.smithi138.stderr: -358> 2024-09-14T11:39:01.481+0000 7fd1d1ad3640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:39:02.094 INFO:tasks.workunit.client.0.smithi138.stderr: -357> 2024-09-14T11:39:01.481+0000 7fd1d1ad3640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:39:02.095 INFO:tasks.workunit.client.0.smithi138.stderr: -356> 2024-09-14T11:39:01.481+0000 7fd1d1ad3640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:39:02.095 INFO:tasks.workunit.client.0.smithi138.stderr: -355> 2024-09-14T11:39:01.481+0000 7fd1d0ad1640 10 monclient(hunting): handle_auth_done global_id 7887 payload 824 2024-09-14T11:39:02.095 INFO:tasks.workunit.client.0.smithi138.stderr: -354> 2024-09-14T11:39:01.481+0000 7fd1d0ad1640 10 monclient: _finish_hunting 0 2024-09-14T11:39:02.095 INFO:tasks.workunit.client.0.smithi138.stderr: -353> 2024-09-14T11:39:01.481+0000 7fd1d0ad1640 1 monclient: found mon.noname-a 2024-09-14T11:39:02.095 INFO:tasks.workunit.client.0.smithi138.stderr: -352> 2024-09-14T11:39:01.481+0000 7fd1d0ad1640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.138:3300/0 2024-09-14T11:39:02.095 INFO:tasks.workunit.client.0.smithi138.stderr: -351> 2024-09-14T11:39:01.481+0000 7fd0b6ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:39:02.095 INFO:tasks.workunit.client.0.smithi138.stderr: -350> 2024-09-14T11:39:01.481+0000 7fd0b6ffd640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-14T11:39:02.095 INFO:tasks.workunit.client.0.smithi138.stderr: -349> 2024-09-14T11:39:01.481+0000 7fd0b6ffd640 10 monclient: dump: 2024-09-14T11:39:02.095 INFO:tasks.workunit.client.0.smithi138.stderr:epoch 1 2024-09-14T11:39:02.095 INFO:tasks.workunit.client.0.smithi138.stderr:fsid 3f225f43-83a6-4aeb-b798-1f04bb49d597 2024-09-14T11:39:02.095 INFO:tasks.workunit.client.0.smithi138.stderr:last_changed 2024-09-14T11:07:09.252780+0000 2024-09-14T11:39:02.095 INFO:tasks.workunit.client.0.smithi138.stderr:created 2024-09-14T11:07:09.252780+0000 2024-09-14T11:39:02.095 INFO:tasks.workunit.client.0.smithi138.stderr:min_mon_release 19 (squid) 2024-09-14T11:39:02.096 INFO:tasks.workunit.client.0.smithi138.stderr:election_strategy: 1 2024-09-14T11:39:02.096 INFO:tasks.workunit.client.0.smithi138.stderr:0: [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] mon.a 2024-09-14T11:39:02.096 INFO:tasks.workunit.client.0.smithi138.stderr:1: [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] mon.b 2024-09-14T11:39:02.096 INFO:tasks.workunit.client.0.smithi138.stderr:2: [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] mon.c 2024-09-14T11:39:02.096 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-14T11:39:02.096 INFO:tasks.workunit.client.0.smithi138.stderr: -348> 2024-09-14T11:39:01.481+0000 7fd0b6ffd640 10 monclient: _finish_auth 0 2024-09-14T11:39:02.096 INFO:tasks.workunit.client.0.smithi138.stderr: -347> 2024-09-14T11:39:01.481+0000 7fd0b6ffd640 10 monclient: _check_auth_tickets 2024-09-14T11:39:02.096 INFO:tasks.workunit.client.0.smithi138.stderr: -346> 2024-09-14T11:39:01.481+0000 7fd0b6ffd640 10 monclient: handle_config config(0 keys) 2024-09-14T11:39:02.096 INFO:tasks.workunit.client.0.smithi138.stderr: -345> 2024-09-14T11:39:01.481+0000 7fd0b6ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:39:02.096 INFO:tasks.workunit.client.0.smithi138.stderr: -344> 2024-09-14T11:39:01.481+0000 7fd0b6ffd640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-14T11:39:02.096 INFO:tasks.workunit.client.0.smithi138.stderr: -343> 2024-09-14T11:39:01.481+0000 7fd0b6ffd640 10 monclient: dump: 2024-09-14T11:39:02.096 INFO:tasks.workunit.client.0.smithi138.stderr:epoch 1 2024-09-14T11:39:02.096 INFO:tasks.workunit.client.0.smithi138.stderr:fsid 3f225f43-83a6-4aeb-b798-1f04bb49d597 2024-09-14T11:39:02.096 INFO:tasks.workunit.client.0.smithi138.stderr:last_changed 2024-09-14T11:07:09.252780+0000 2024-09-14T11:39:02.097 INFO:tasks.workunit.client.0.smithi138.stderr:created 2024-09-14T11:07:09.252780+0000 2024-09-14T11:39:02.097 INFO:tasks.workunit.client.0.smithi138.stderr:min_mon_release 19 (squid) 2024-09-14T11:39:02.097 INFO:tasks.workunit.client.0.smithi138.stderr:election_strategy: 1 2024-09-14T11:39:02.097 INFO:tasks.workunit.client.0.smithi138.stderr:0: [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] mon.a 2024-09-14T11:39:02.097 INFO:tasks.workunit.client.0.smithi138.stderr:1: [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] mon.b 2024-09-14T11:39:02.097 INFO:tasks.workunit.client.0.smithi138.stderr:2: [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] mon.c 2024-09-14T11:39:02.097 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-14T11:39:02.097 INFO:tasks.workunit.client.0.smithi138.stderr: -342> 2024-09-14T11:39:01.481+0000 7fd1d22d4640 4 set_mon_vals no callback set 2024-09-14T11:39:02.097 INFO:tasks.workunit.client.0.smithi138.stderr: -341> 2024-09-14T11:39:01.481+0000 7fd1d37cc9c0 5 monclient: authenticate success, global_id 7887 2024-09-14T11:39:02.097 INFO:tasks.workunit.client.0.smithi138.stderr: -340> 2024-09-14T11:39:01.481+0000 7fd1d37cc9c0 10 monclient: _renew_subs 2024-09-14T11:39:02.097 INFO:tasks.workunit.client.0.smithi138.stderr: -339> 2024-09-14T11:39:01.481+0000 7fd1d37cc9c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.138:3300/0 2024-09-14T11:39:02.097 INFO:tasks.workunit.client.0.smithi138.stderr: -338> 2024-09-14T11:39:01.481+0000 7fd1d37cc9c0 10 monclient: _renew_subs 2024-09-14T11:39:02.097 INFO:tasks.workunit.client.0.smithi138.stderr: -337> 2024-09-14T11:39:01.481+0000 7fd1d37cc9c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.138:3300/0 2024-09-14T11:39:02.097 INFO:tasks.workunit.client.0.smithi138.stderr: -336> 2024-09-14T11:39:01.481+0000 7fd0b6ffd640 4 mgrc handle_mgr_map Got map version 5 2024-09-14T11:39:02.097 INFO:tasks.workunit.client.0.smithi138.stderr: -335> 2024-09-14T11:39:01.481+0000 7fd0b6ffd640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.138:6832/3778043143,v1:172.21.15.138:6833/3778043143] 2024-09-14T11:39:02.098 INFO:tasks.workunit.client.0.smithi138.stderr: -334> 2024-09-14T11:39:01.481+0000 7fd0b6ffd640 4 mgrc reconnect Starting new session with [v2:172.21.15.138:6832/3778043143,v1:172.21.15.138:6833/3778043143] 2024-09-14T11:39:02.098 INFO:tasks.workunit.client.0.smithi138.stderr: -333> 2024-09-14T11:39:01.481+0000 7fd1d1ad3640 10 monclient: get_auth_request con 0x7fd0ac0717e0 auth_method 0 2024-09-14T11:39:02.098 INFO:tasks.workunit.client.0.smithi138.stderr: -332> 2024-09-14T11:39:01.481+0000 7fd1d37cc9c0 10 monclient: get_monmap_and_config 2024-09-14T11:39:02.098 INFO:tasks.workunit.client.0.smithi138.stderr: -331> 2024-09-14T11:39:01.481+0000 7fd1d37cc9c0 10 monclient: build_initial_monmap 2024-09-14T11:39:02.098 INFO:tasks.workunit.client.0.smithi138.stderr: -330> 2024-09-14T11:39:01.481+0000 7fd1d37cc9c0 1 build_initial for_mkfs: 0 2024-09-14T11:39:02.098 INFO:tasks.workunit.client.0.smithi138.stderr: -329> 2024-09-14T11:39:01.481+0000 7fd1d37cc9c0 10 monclient: monmap: 2024-09-14T11:39:02.098 INFO:tasks.workunit.client.0.smithi138.stderr:epoch 0 2024-09-14T11:39:02.098 INFO:tasks.workunit.client.0.smithi138.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-14T11:39:02.098 INFO:tasks.workunit.client.0.smithi138.stderr:last_changed 0.000000 2024-09-14T11:39:02.098 INFO:tasks.workunit.client.0.smithi138.stderr:created 0.000000 2024-09-14T11:39:02.098 INFO:tasks.workunit.client.0.smithi138.stderr:min_mon_release 0 (unknown) 2024-09-14T11:39:02.098 INFO:tasks.workunit.client.0.smithi138.stderr:election_strategy: 1 2024-09-14T11:39:02.098 INFO:tasks.workunit.client.0.smithi138.stderr:0: [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] mon.noname-a 2024-09-14T11:39:02.098 INFO:tasks.workunit.client.0.smithi138.stderr:1: [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] mon.noname-b 2024-09-14T11:39:02.099 INFO:tasks.workunit.client.0.smithi138.stderr:2: [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] mon.noname-c 2024-09-14T11:39:02.099 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-14T11:39:02.099 INFO:tasks.workunit.client.0.smithi138.stderr: -328> 2024-09-14T11:39:01.481+0000 7fd1d37cc9c0 5 AuthRegistry(0x561192341680) adding auth protocol: cephx 2024-09-14T11:39:02.099 INFO:tasks.workunit.client.0.smithi138.stderr: -327> 2024-09-14T11:39:01.481+0000 7fd1d37cc9c0 5 AuthRegistry(0x561192341680) adding auth protocol: cephx 2024-09-14T11:39:02.099 INFO:tasks.workunit.client.0.smithi138.stderr: -326> 2024-09-14T11:39:01.481+0000 7fd1d37cc9c0 5 AuthRegistry(0x561192341680) adding auth protocol: cephx 2024-09-14T11:39:02.099 INFO:tasks.workunit.client.0.smithi138.stderr: -325> 2024-09-14T11:39:01.481+0000 7fd1d37cc9c0 5 AuthRegistry(0x561192341680) adding con mode: secure 2024-09-14T11:39:02.099 INFO:tasks.workunit.client.0.smithi138.stderr: -324> 2024-09-14T11:39:01.481+0000 7fd1d37cc9c0 5 AuthRegistry(0x561192341680) adding con mode: crc 2024-09-14T11:39:02.099 INFO:tasks.workunit.client.0.smithi138.stderr: -323> 2024-09-14T11:39:01.481+0000 7fd1d37cc9c0 5 AuthRegistry(0x561192341680) adding con mode: secure 2024-09-14T11:39:02.099 INFO:tasks.workunit.client.0.smithi138.stderr: -322> 2024-09-14T11:39:01.481+0000 7fd1d37cc9c0 5 AuthRegistry(0x561192341680) adding con mode: crc 2024-09-14T11:39:02.099 INFO:tasks.workunit.client.0.smithi138.stderr: -321> 2024-09-14T11:39:01.481+0000 7fd1d37cc9c0 5 AuthRegistry(0x561192341680) adding con mode: secure 2024-09-14T11:39:02.099 INFO:tasks.workunit.client.0.smithi138.stderr: -320> 2024-09-14T11:39:01.481+0000 7fd1d37cc9c0 5 AuthRegistry(0x561192341680) adding con mode: crc 2024-09-14T11:39:02.099 INFO:tasks.workunit.client.0.smithi138.stderr: -319> 2024-09-14T11:39:01.481+0000 7fd1d37cc9c0 5 AuthRegistry(0x561192341680) adding con mode: crc 2024-09-14T11:39:02.099 INFO:tasks.workunit.client.0.smithi138.stderr: -318> 2024-09-14T11:39:01.481+0000 7fd1d37cc9c0 5 AuthRegistry(0x561192341680) adding con mode: secure 2024-09-14T11:39:02.099 INFO:tasks.workunit.client.0.smithi138.stderr: -317> 2024-09-14T11:39:01.481+0000 7fd1d37cc9c0 5 AuthRegistry(0x561192341680) adding con mode: crc 2024-09-14T11:39:02.100 INFO:tasks.workunit.client.0.smithi138.stderr: -316> 2024-09-14T11:39:01.481+0000 7fd1d37cc9c0 5 AuthRegistry(0x561192341680) adding con mode: secure 2024-09-14T11:39:02.100 INFO:tasks.workunit.client.0.smithi138.stderr: -315> 2024-09-14T11:39:01.481+0000 7fd1d37cc9c0 5 AuthRegistry(0x561192341680) adding con mode: crc 2024-09-14T11:39:02.100 INFO:tasks.workunit.client.0.smithi138.stderr: -314> 2024-09-14T11:39:01.481+0000 7fd1d37cc9c0 5 AuthRegistry(0x561192341680) adding con mode: secure 2024-09-14T11:39:02.100 INFO:tasks.workunit.client.0.smithi138.stderr: -313> 2024-09-14T11:39:01.485+0000 7fd1d37cc9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:39:02.100 INFO:tasks.workunit.client.0.smithi138.stderr: -312> 2024-09-14T11:39:01.485+0000 7fd1d37cc9c0 10 monclient: init 2024-09-14T11:39:02.100 INFO:tasks.workunit.client.0.smithi138.stderr: -311> 2024-09-14T11:39:01.485+0000 7fd1d37cc9c0 5 AuthRegistry(0x7ffff5249420) adding auth protocol: cephx 2024-09-14T11:39:02.100 INFO:tasks.workunit.client.0.smithi138.stderr: -310> 2024-09-14T11:39:01.485+0000 7fd1d37cc9c0 5 AuthRegistry(0x7ffff5249420) adding auth protocol: cephx 2024-09-14T11:39:02.100 INFO:tasks.workunit.client.0.smithi138.stderr: -309> 2024-09-14T11:39:01.485+0000 7fd1d37cc9c0 5 AuthRegistry(0x7ffff5249420) adding auth protocol: cephx 2024-09-14T11:39:02.100 INFO:tasks.workunit.client.0.smithi138.stderr: -308> 2024-09-14T11:39:01.485+0000 7fd1d37cc9c0 5 AuthRegistry(0x7ffff5249420) adding con mode: secure 2024-09-14T11:39:02.100 INFO:tasks.workunit.client.0.smithi138.stderr: -307> 2024-09-14T11:39:01.485+0000 7fd1d37cc9c0 5 AuthRegistry(0x7ffff5249420) adding con mode: crc 2024-09-14T11:39:02.100 INFO:tasks.workunit.client.0.smithi138.stderr: -306> 2024-09-14T11:39:01.485+0000 7fd1d37cc9c0 5 AuthRegistry(0x7ffff5249420) adding con mode: secure 2024-09-14T11:39:02.100 INFO:tasks.workunit.client.0.smithi138.stderr: -305> 2024-09-14T11:39:01.485+0000 7fd1d37cc9c0 5 AuthRegistry(0x7ffff5249420) adding con mode: crc 2024-09-14T11:39:02.100 INFO:tasks.workunit.client.0.smithi138.stderr: -304> 2024-09-14T11:39:01.485+0000 7fd1d37cc9c0 5 AuthRegistry(0x7ffff5249420) adding con mode: secure 2024-09-14T11:39:02.100 INFO:tasks.workunit.client.0.smithi138.stderr: -303> 2024-09-14T11:39:01.485+0000 7fd1d37cc9c0 5 AuthRegistry(0x7ffff5249420) adding con mode: crc 2024-09-14T11:39:02.101 INFO:tasks.workunit.client.0.smithi138.stderr: -302> 2024-09-14T11:39:01.485+0000 7fd1d37cc9c0 5 AuthRegistry(0x7ffff5249420) adding con mode: crc 2024-09-14T11:39:02.101 INFO:tasks.workunit.client.0.smithi138.stderr: -301> 2024-09-14T11:39:01.485+0000 7fd1d37cc9c0 5 AuthRegistry(0x7ffff5249420) adding con mode: secure 2024-09-14T11:39:02.101 INFO:tasks.workunit.client.0.smithi138.stderr: -300> 2024-09-14T11:39:01.485+0000 7fd1d37cc9c0 5 AuthRegistry(0x7ffff5249420) adding con mode: crc 2024-09-14T11:39:02.101 INFO:tasks.workunit.client.0.smithi138.stderr: -299> 2024-09-14T11:39:01.485+0000 7fd1d37cc9c0 5 AuthRegistry(0x7ffff5249420) adding con mode: secure 2024-09-14T11:39:02.101 INFO:tasks.workunit.client.0.smithi138.stderr: -298> 2024-09-14T11:39:01.485+0000 7fd1d37cc9c0 5 AuthRegistry(0x7ffff5249420) adding con mode: crc 2024-09-14T11:39:02.101 INFO:tasks.workunit.client.0.smithi138.stderr: -297> 2024-09-14T11:39:01.485+0000 7fd1d37cc9c0 5 AuthRegistry(0x7ffff5249420) adding con mode: secure 2024-09-14T11:39:02.101 INFO:tasks.workunit.client.0.smithi138.stderr: -296> 2024-09-14T11:39:01.485+0000 7fd1d37cc9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:39:02.101 INFO:tasks.workunit.client.0.smithi138.stderr: -295> 2024-09-14T11:39:01.485+0000 7fd1d37cc9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:39:02.101 INFO:tasks.workunit.client.0.smithi138.stderr: -294> 2024-09-14T11:39:01.485+0000 7fd1d37cc9c0 5 asok(0x561192097d90) register_command rotate-key cmddesc rotate-key hook 0x7ffff5249568 EEXIST 2024-09-14T11:39:02.101 INFO:tasks.workunit.client.0.smithi138.stderr: -293> 2024-09-14T11:39:01.485+0000 7fd1d37cc9c0 10 monclient: _reopen_session rank -1 2024-09-14T11:39:02.101 INFO:tasks.workunit.client.0.smithi138.stderr: -292> 2024-09-14T11:39:01.485+0000 7fd1d37cc9c0 10 monclient: _add_conns ranks=[1,0,2] 2024-09-14T11:39:02.101 INFO:tasks.workunit.client.0.smithi138.stderr: -291> 2024-09-14T11:39:01.485+0000 7fd1d37cc9c0 10 monclient(hunting): picked mon.noname-b con 0x561192345870 addr [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] 2024-09-14T11:39:02.102 INFO:tasks.workunit.client.0.smithi138.stderr: -290> 2024-09-14T11:39:01.485+0000 7fd1d37cc9c0 10 monclient(hunting): picked mon.noname-a con 0x561192375f20 addr [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] 2024-09-14T11:39:02.102 INFO:tasks.workunit.client.0.smithi138.stderr: -289> 2024-09-14T11:39:01.485+0000 7fd1d37cc9c0 10 monclient(hunting): picked mon.noname-c con 0x5611923710d0 addr [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] 2024-09-14T11:39:02.102 INFO:tasks.workunit.client.0.smithi138.stderr: -288> 2024-09-14T11:39:01.485+0000 7fd1d37cc9c0 10 monclient(hunting): start opening mon connection 2024-09-14T11:39:02.102 INFO:tasks.workunit.client.0.smithi138.stderr: -287> 2024-09-14T11:39:01.485+0000 7fd1d37cc9c0 10 monclient(hunting): start opening mon connection 2024-09-14T11:39:02.102 INFO:tasks.workunit.client.0.smithi138.stderr: -286> 2024-09-14T11:39:01.485+0000 7fd1d37cc9c0 10 monclient(hunting): start opening mon connection 2024-09-14T11:39:02.102 INFO:tasks.workunit.client.0.smithi138.stderr: -285> 2024-09-14T11:39:01.485+0000 7fd1d37cc9c0 10 monclient(hunting): _renew_subs 2024-09-14T11:39:02.102 INFO:tasks.workunit.client.0.smithi138.stderr: -284> 2024-09-14T11:39:01.485+0000 7fd1d37cc9c0 10 monclient(hunting): authenticate will time out at 2877.449064s 2024-09-14T11:39:02.102 INFO:tasks.workunit.client.0.smithi138.stderr: -283> 2024-09-14T11:39:01.485+0000 7fd1d1ad3640 10 monclient(hunting): get_auth_request con 0x561192375f20 auth_method 0 2024-09-14T11:39:02.102 INFO:tasks.workunit.client.0.smithi138.stderr: -282> 2024-09-14T11:39:01.485+0000 7fd1d1ad3640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:39:02.102 INFO:tasks.workunit.client.0.smithi138.stderr: -281> 2024-09-14T11:39:01.485+0000 7fd1d1ad3640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:39:02.102 INFO:tasks.workunit.client.0.smithi138.stderr: -280> 2024-09-14T11:39:01.485+0000 7fd1d1ad3640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:39:02.102 INFO:tasks.workunit.client.0.smithi138.stderr: -279> 2024-09-14T11:39:01.485+0000 7fd1d12d2640 10 monclient(hunting): get_auth_request con 0x5611923710d0 auth_method 0 2024-09-14T11:39:02.102 INFO:tasks.workunit.client.0.smithi138.stderr: -278> 2024-09-14T11:39:01.485+0000 7fd1d12d2640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:39:02.102 INFO:tasks.workunit.client.0.smithi138.stderr: -277> 2024-09-14T11:39:01.485+0000 7fd1d12d2640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:39:02.102 INFO:tasks.workunit.client.0.smithi138.stderr: -276> 2024-09-14T11:39:01.485+0000 7fd1d12d2640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:39:02.103 INFO:tasks.workunit.client.0.smithi138.stderr: -275> 2024-09-14T11:39:01.485+0000 7fd1d12d2640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:39:02.103 INFO:tasks.workunit.client.0.smithi138.stderr: -274> 2024-09-14T11:39:01.485+0000 7fd1d12d2640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:39:02.103 INFO:tasks.workunit.client.0.smithi138.stderr: -273> 2024-09-14T11:39:01.485+0000 7fd1d12d2640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:39:02.103 INFO:tasks.workunit.client.0.smithi138.stderr: -272> 2024-09-14T11:39:01.485+0000 7fd1d0ad1640 10 monclient(hunting): get_auth_request con 0x561192345870 auth_method 0 2024-09-14T11:39:02.103 INFO:tasks.workunit.client.0.smithi138.stderr: -271> 2024-09-14T11:39:01.485+0000 7fd1d0ad1640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:39:02.103 INFO:tasks.workunit.client.0.smithi138.stderr: -270> 2024-09-14T11:39:01.485+0000 7fd1d0ad1640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:39:02.103 INFO:tasks.workunit.client.0.smithi138.stderr: -269> 2024-09-14T11:39:01.485+0000 7fd1d0ad1640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:39:02.103 INFO:tasks.workunit.client.0.smithi138.stderr: -268> 2024-09-14T11:39:01.485+0000 7fd1d1ad3640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:39:02.103 INFO:tasks.workunit.client.0.smithi138.stderr: -267> 2024-09-14T11:39:01.485+0000 7fd1d1ad3640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:39:02.103 INFO:tasks.workunit.client.0.smithi138.stderr: -266> 2024-09-14T11:39:01.485+0000 7fd1d1ad3640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:39:02.103 INFO:tasks.workunit.client.0.smithi138.stderr: -265> 2024-09-14T11:39:01.485+0000 7fd1d12d2640 10 monclient(hunting): handle_auth_done global_id 7370 payload 274 2024-09-14T11:39:02.103 INFO:tasks.workunit.client.0.smithi138.stderr: -264> 2024-09-14T11:39:01.485+0000 7fd1d12d2640 10 monclient: _finish_hunting 0 2024-09-14T11:39:02.103 INFO:tasks.workunit.client.0.smithi138.stderr: -263> 2024-09-14T11:39:01.485+0000 7fd1d12d2640 1 monclient: found mon.noname-c 2024-09-14T11:39:02.103 INFO:tasks.workunit.client.0.smithi138.stderr: -262> 2024-09-14T11:39:01.485+0000 7fd1d12d2640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.138:3301/0 2024-09-14T11:39:02.103 INFO:tasks.workunit.client.0.smithi138.stderr: -261> 2024-09-14T11:39:01.485+0000 7fd0b4ff9640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:39:02.104 INFO:tasks.workunit.client.0.smithi138.stderr: -260> 2024-09-14T11:39:01.485+0000 7fd0b4ff9640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-14T11:39:02.104 INFO:tasks.workunit.client.0.smithi138.stderr: -259> 2024-09-14T11:39:01.485+0000 7fd0b4ff9640 10 monclient: dump: 2024-09-14T11:39:02.104 INFO:tasks.workunit.client.0.smithi138.stderr:epoch 1 2024-09-14T11:39:02.104 INFO:tasks.workunit.client.0.smithi138.stderr:fsid 3f225f43-83a6-4aeb-b798-1f04bb49d597 2024-09-14T11:39:02.104 INFO:tasks.workunit.client.0.smithi138.stderr:last_changed 2024-09-14T11:07:09.252780+0000 2024-09-14T11:39:02.104 INFO:tasks.workunit.client.0.smithi138.stderr:created 2024-09-14T11:07:09.252780+0000 2024-09-14T11:39:02.104 INFO:tasks.workunit.client.0.smithi138.stderr:min_mon_release 19 (squid) 2024-09-14T11:39:02.104 INFO:tasks.workunit.client.0.smithi138.stderr:election_strategy: 1 2024-09-14T11:39:02.104 INFO:tasks.workunit.client.0.smithi138.stderr:0: [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] mon.a 2024-09-14T11:39:02.104 INFO:tasks.workunit.client.0.smithi138.stderr:1: [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] mon.b 2024-09-14T11:39:02.104 INFO:tasks.workunit.client.0.smithi138.stderr:2: [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] mon.c 2024-09-14T11:39:02.104 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-14T11:39:02.104 INFO:tasks.workunit.client.0.smithi138.stderr: -258> 2024-09-14T11:39:01.485+0000 7fd0b4ff9640 10 monclient: _finish_auth 0 2024-09-14T11:39:02.104 INFO:tasks.workunit.client.0.smithi138.stderr: -257> 2024-09-14T11:39:01.485+0000 7fd0b4ff9640 10 monclient: _check_auth_tickets 2024-09-14T11:39:02.105 INFO:tasks.workunit.client.0.smithi138.stderr: -256> 2024-09-14T11:39:01.485+0000 7fd1d37cc9c0 5 monclient: authenticate success, global_id 7370 2024-09-14T11:39:02.105 INFO:tasks.workunit.client.0.smithi138.stderr: -255> 2024-09-14T11:39:01.485+0000 7fd0b4ff9640 10 monclient: handle_config config(0 keys) 2024-09-14T11:39:02.105 INFO:tasks.workunit.client.0.smithi138.stderr: -254> 2024-09-14T11:39:01.485+0000 7fd0b4ff9640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:39:02.105 INFO:tasks.workunit.client.0.smithi138.stderr: -253> 2024-09-14T11:39:01.485+0000 7fd0b4ff9640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-14T11:39:02.105 INFO:tasks.workunit.client.0.smithi138.stderr: -252> 2024-09-14T11:39:01.485+0000 7fd0b4ff9640 10 monclient: dump: 2024-09-14T11:39:02.105 INFO:tasks.workunit.client.0.smithi138.stderr:epoch 1 2024-09-14T11:39:02.105 INFO:tasks.workunit.client.0.smithi138.stderr:fsid 3f225f43-83a6-4aeb-b798-1f04bb49d597 2024-09-14T11:39:02.105 INFO:tasks.workunit.client.0.smithi138.stderr:last_changed 2024-09-14T11:07:09.252780+0000 2024-09-14T11:39:02.105 INFO:tasks.workunit.client.0.smithi138.stderr:created 2024-09-14T11:07:09.252780+0000 2024-09-14T11:39:02.105 INFO:tasks.workunit.client.0.smithi138.stderr:min_mon_release 19 (squid) 2024-09-14T11:39:02.105 INFO:tasks.workunit.client.0.smithi138.stderr:election_strategy: 1 2024-09-14T11:39:02.105 INFO:tasks.workunit.client.0.smithi138.stderr:0: [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] mon.a 2024-09-14T11:39:02.105 INFO:tasks.workunit.client.0.smithi138.stderr:1: [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] mon.b 2024-09-14T11:39:02.105 INFO:tasks.workunit.client.0.smithi138.stderr:2: [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] mon.c 2024-09-14T11:39:02.106 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-14T11:39:02.106 INFO:tasks.workunit.client.0.smithi138.stderr: -251> 2024-09-14T11:39:01.485+0000 7fd1d37cc9c0 10 monclient: get_monmap_and_config success 2024-09-14T11:39:02.106 INFO:tasks.workunit.client.0.smithi138.stderr: -250> 2024-09-14T11:39:01.485+0000 7fd1d37cc9c0 4 set_mon_vals no callback set 2024-09-14T11:39:02.106 INFO:tasks.workunit.client.0.smithi138.stderr: -249> 2024-09-14T11:39:01.485+0000 7fd1d37cc9c0 10 monclient: shutdown 2024-09-14T11:39:02.106 INFO:tasks.workunit.client.0.smithi138.stderr: -248> 2024-09-14T11:39:01.485+0000 7fd1d37cc9c0 10 monclient: build_initial_monmap 2024-09-14T11:39:02.106 INFO:tasks.workunit.client.0.smithi138.stderr: -247> 2024-09-14T11:39:01.485+0000 7fd1d37cc9c0 1 build_initial for_mkfs: 0 2024-09-14T11:39:02.106 INFO:tasks.workunit.client.0.smithi138.stderr: -246> 2024-09-14T11:39:01.485+0000 7fd1d37cc9c0 10 monclient: monmap: 2024-09-14T11:39:02.106 INFO:tasks.workunit.client.0.smithi138.stderr:epoch 0 2024-09-14T11:39:02.106 INFO:tasks.workunit.client.0.smithi138.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-14T11:39:02.106 INFO:tasks.workunit.client.0.smithi138.stderr:last_changed 0.000000 2024-09-14T11:39:02.106 INFO:tasks.workunit.client.0.smithi138.stderr:created 0.000000 2024-09-14T11:39:02.106 INFO:tasks.workunit.client.0.smithi138.stderr:min_mon_release 0 (unknown) 2024-09-14T11:39:02.106 INFO:tasks.workunit.client.0.smithi138.stderr:election_strategy: 1 2024-09-14T11:39:02.106 INFO:tasks.workunit.client.0.smithi138.stderr:0: [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] mon.noname-a 2024-09-14T11:39:02.106 INFO:tasks.workunit.client.0.smithi138.stderr:1: [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] mon.noname-b 2024-09-14T11:39:02.107 INFO:tasks.workunit.client.0.smithi138.stderr:2: [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] mon.noname-c 2024-09-14T11:39:02.107 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-14T11:39:02.107 INFO:tasks.workunit.client.0.smithi138.stderr: -245> 2024-09-14T11:39:01.485+0000 7fd1d37cc9c0 5 AuthRegistry(0x561192346800) adding auth protocol: cephx 2024-09-14T11:39:02.107 INFO:tasks.workunit.client.0.smithi138.stderr: -244> 2024-09-14T11:39:01.485+0000 7fd1d37cc9c0 5 AuthRegistry(0x561192346800) adding auth protocol: cephx 2024-09-14T11:39:02.107 INFO:tasks.workunit.client.0.smithi138.stderr: -243> 2024-09-14T11:39:01.485+0000 7fd1d37cc9c0 5 AuthRegistry(0x561192346800) adding auth protocol: cephx 2024-09-14T11:39:02.107 INFO:tasks.workunit.client.0.smithi138.stderr: -242> 2024-09-14T11:39:01.485+0000 7fd1d37cc9c0 5 AuthRegistry(0x561192346800) adding con mode: secure 2024-09-14T11:39:02.107 INFO:tasks.workunit.client.0.smithi138.stderr: -241> 2024-09-14T11:39:01.485+0000 7fd1d37cc9c0 5 AuthRegistry(0x561192346800) adding con mode: crc 2024-09-14T11:39:02.107 INFO:tasks.workunit.client.0.smithi138.stderr: -240> 2024-09-14T11:39:01.485+0000 7fd1d37cc9c0 5 AuthRegistry(0x561192346800) adding con mode: secure 2024-09-14T11:39:02.107 INFO:tasks.workunit.client.0.smithi138.stderr: -239> 2024-09-14T11:39:01.485+0000 7fd1d37cc9c0 5 AuthRegistry(0x561192346800) adding con mode: crc 2024-09-14T11:39:02.107 INFO:tasks.workunit.client.0.smithi138.stderr: -238> 2024-09-14T11:39:01.485+0000 7fd1d37cc9c0 5 AuthRegistry(0x561192346800) adding con mode: secure 2024-09-14T11:39:02.107 INFO:tasks.workunit.client.0.smithi138.stderr: -237> 2024-09-14T11:39:01.485+0000 7fd1d37cc9c0 5 AuthRegistry(0x561192346800) adding con mode: crc 2024-09-14T11:39:02.107 INFO:tasks.workunit.client.0.smithi138.stderr: -236> 2024-09-14T11:39:01.485+0000 7fd1d37cc9c0 5 AuthRegistry(0x561192346800) adding con mode: crc 2024-09-14T11:39:02.107 INFO:tasks.workunit.client.0.smithi138.stderr: -235> 2024-09-14T11:39:01.485+0000 7fd1d37cc9c0 5 AuthRegistry(0x561192346800) adding con mode: secure 2024-09-14T11:39:02.107 INFO:tasks.workunit.client.0.smithi138.stderr: -234> 2024-09-14T11:39:01.485+0000 7fd1d37cc9c0 5 AuthRegistry(0x561192346800) adding con mode: crc 2024-09-14T11:39:02.108 INFO:tasks.workunit.client.0.smithi138.stderr: -233> 2024-09-14T11:39:01.485+0000 7fd1d37cc9c0 5 AuthRegistry(0x561192346800) adding con mode: secure 2024-09-14T11:39:02.108 INFO:tasks.workunit.client.0.smithi138.stderr: -232> 2024-09-14T11:39:01.485+0000 7fd1d37cc9c0 5 AuthRegistry(0x561192346800) adding con mode: crc 2024-09-14T11:39:02.108 INFO:tasks.workunit.client.0.smithi138.stderr: -231> 2024-09-14T11:39:01.485+0000 7fd1d37cc9c0 5 AuthRegistry(0x561192346800) adding con mode: secure 2024-09-14T11:39:02.108 INFO:tasks.workunit.client.0.smithi138.stderr: -230> 2024-09-14T11:39:01.485+0000 7fd1d37cc9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:39:02.108 INFO:tasks.workunit.client.0.smithi138.stderr: -229> 2024-09-14T11:39:01.485+0000 7fd1d37cc9c0 1 librados: starting msgr at 2024-09-14T11:39:02.108 INFO:tasks.workunit.client.0.smithi138.stderr: -228> 2024-09-14T11:39:01.485+0000 7fd1d37cc9c0 1 librados: starting objecter 2024-09-14T11:39:02.108 INFO:tasks.workunit.client.0.smithi138.stderr: -227> 2024-09-14T11:39:01.485+0000 7fd1d37cc9c0 5 asok(0x561192097d90) register_command objecter_requests cmddesc objecter_requests hook 0x561192372c80 EEXIST 2024-09-14T11:39:02.108 INFO:tasks.workunit.client.0.smithi138.stderr: -226> 2024-09-14T11:39:01.485+0000 7fd1d37cc9c0 1 librados: setting wanted keys 2024-09-14T11:39:02.108 INFO:tasks.workunit.client.0.smithi138.stderr: -225> 2024-09-14T11:39:01.485+0000 7fd1d37cc9c0 1 librados: calling monclient init 2024-09-14T11:39:02.108 INFO:tasks.workunit.client.0.smithi138.stderr: -224> 2024-09-14T11:39:01.485+0000 7fd1d37cc9c0 10 monclient: init 2024-09-14T11:39:02.108 INFO:tasks.workunit.client.0.smithi138.stderr: -223> 2024-09-14T11:39:01.485+0000 7fd1d37cc9c0 5 AuthRegistry(0x561192323aa0) adding auth protocol: cephx 2024-09-14T11:39:02.108 INFO:tasks.workunit.client.0.smithi138.stderr: -222> 2024-09-14T11:39:01.485+0000 7fd1d37cc9c0 5 AuthRegistry(0x561192323aa0) adding auth protocol: cephx 2024-09-14T11:39:02.108 INFO:tasks.workunit.client.0.smithi138.stderr: -221> 2024-09-14T11:39:01.485+0000 7fd1d37cc9c0 5 AuthRegistry(0x561192323aa0) adding auth protocol: cephx 2024-09-14T11:39:02.109 INFO:tasks.workunit.client.0.smithi138.stderr: -220> 2024-09-14T11:39:01.485+0000 7fd1d37cc9c0 5 AuthRegistry(0x561192323aa0) adding con mode: secure 2024-09-14T11:39:02.109 INFO:tasks.workunit.client.0.smithi138.stderr: -219> 2024-09-14T11:39:01.485+0000 7fd1d37cc9c0 5 AuthRegistry(0x561192323aa0) adding con mode: crc 2024-09-14T11:39:02.109 INFO:tasks.workunit.client.0.smithi138.stderr: -218> 2024-09-14T11:39:01.485+0000 7fd1d37cc9c0 5 AuthRegistry(0x561192323aa0) adding con mode: secure 2024-09-14T11:39:02.109 INFO:tasks.workunit.client.0.smithi138.stderr: -217> 2024-09-14T11:39:01.485+0000 7fd1d37cc9c0 5 AuthRegistry(0x561192323aa0) adding con mode: crc 2024-09-14T11:39:02.109 INFO:tasks.workunit.client.0.smithi138.stderr: -216> 2024-09-14T11:39:01.485+0000 7fd1d37cc9c0 5 AuthRegistry(0x561192323aa0) adding con mode: secure 2024-09-14T11:39:02.109 INFO:tasks.workunit.client.0.smithi138.stderr: -215> 2024-09-14T11:39:01.485+0000 7fd1d37cc9c0 5 AuthRegistry(0x561192323aa0) adding con mode: crc 2024-09-14T11:39:02.109 INFO:tasks.workunit.client.0.smithi138.stderr: -214> 2024-09-14T11:39:01.485+0000 7fd1d37cc9c0 5 AuthRegistry(0x561192323aa0) adding con mode: crc 2024-09-14T11:39:02.109 INFO:tasks.workunit.client.0.smithi138.stderr: -213> 2024-09-14T11:39:01.485+0000 7fd1d37cc9c0 5 AuthRegistry(0x561192323aa0) adding con mode: secure 2024-09-14T11:39:02.109 INFO:tasks.workunit.client.0.smithi138.stderr: -212> 2024-09-14T11:39:01.485+0000 7fd1d37cc9c0 5 AuthRegistry(0x561192323aa0) adding con mode: crc 2024-09-14T11:39:02.109 INFO:tasks.workunit.client.0.smithi138.stderr: -211> 2024-09-14T11:39:01.485+0000 7fd1d37cc9c0 5 AuthRegistry(0x561192323aa0) adding con mode: secure 2024-09-14T11:39:02.109 INFO:tasks.workunit.client.0.smithi138.stderr: -210> 2024-09-14T11:39:01.485+0000 7fd1d37cc9c0 5 AuthRegistry(0x561192323aa0) adding con mode: crc 2024-09-14T11:39:02.109 INFO:tasks.workunit.client.0.smithi138.stderr: -209> 2024-09-14T11:39:01.485+0000 7fd1d37cc9c0 5 AuthRegistry(0x561192323aa0) adding con mode: secure 2024-09-14T11:39:02.109 INFO:tasks.workunit.client.0.smithi138.stderr: -208> 2024-09-14T11:39:01.485+0000 7fd1d37cc9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:39:02.109 INFO:tasks.workunit.client.0.smithi138.stderr: -207> 2024-09-14T11:39:01.485+0000 7fd1d37cc9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:39:02.110 INFO:tasks.workunit.client.0.smithi138.stderr: -206> 2024-09-14T11:39:01.485+0000 7fd1d37cc9c0 5 asok(0x561192097d90) register_command rotate-key cmddesc rotate-key hook 0x561192323be8 EEXIST 2024-09-14T11:39:02.110 INFO:tasks.workunit.client.0.smithi138.stderr: -205> 2024-09-14T11:39:01.485+0000 7fd1d37cc9c0 10 monclient: _reopen_session rank -1 2024-09-14T11:39:02.110 INFO:tasks.workunit.client.0.smithi138.stderr: -204> 2024-09-14T11:39:01.485+0000 7fd1d37cc9c0 10 monclient: _add_conns ranks=[2,1,0] 2024-09-14T11:39:02.110 INFO:tasks.workunit.client.0.smithi138.stderr: -203> 2024-09-14T11:39:01.489+0000 7fd1d37cc9c0 10 monclient(hunting): picked mon.noname-c con 0x561192345870 addr [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] 2024-09-14T11:39:02.110 INFO:tasks.workunit.client.0.smithi138.stderr: -202> 2024-09-14T11:39:01.489+0000 7fd1d37cc9c0 10 monclient(hunting): picked mon.noname-b con 0x5611923710d0 addr [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] 2024-09-14T11:39:02.110 INFO:tasks.workunit.client.0.smithi138.stderr: -201> 2024-09-14T11:39:01.489+0000 7fd1d37cc9c0 10 monclient(hunting): picked mon.noname-a con 0x561192375f20 addr [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] 2024-09-14T11:39:02.110 INFO:tasks.workunit.client.0.smithi138.stderr: -200> 2024-09-14T11:39:01.489+0000 7fd1d37cc9c0 10 monclient(hunting): start opening mon connection 2024-09-14T11:39:02.110 INFO:tasks.workunit.client.0.smithi138.stderr: -199> 2024-09-14T11:39:01.489+0000 7fd1d37cc9c0 10 monclient(hunting): start opening mon connection 2024-09-14T11:39:02.110 INFO:tasks.workunit.client.0.smithi138.stderr: -198> 2024-09-14T11:39:01.489+0000 7fd1d37cc9c0 10 monclient(hunting): start opening mon connection 2024-09-14T11:39:02.110 INFO:tasks.workunit.client.0.smithi138.stderr: -197> 2024-09-14T11:39:01.489+0000 7fd1d37cc9c0 10 monclient(hunting): _renew_subs 2024-09-14T11:39:02.110 INFO:tasks.workunit.client.0.smithi138.stderr: -196> 2024-09-14T11:39:01.489+0000 7fd1d37cc9c0 10 monclient(hunting): authenticate will time out at 2877.452228s 2024-09-14T11:39:02.110 INFO:tasks.workunit.client.0.smithi138.stderr: -195> 2024-09-14T11:39:01.489+0000 7fd1d12d2640 10 monclient(hunting): get_auth_request con 0x561192375f20 auth_method 0 2024-09-14T11:39:02.110 INFO:tasks.workunit.client.0.smithi138.stderr: -194> 2024-09-14T11:39:01.489+0000 7fd1d12d2640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:39:02.110 INFO:tasks.workunit.client.0.smithi138.stderr: -193> 2024-09-14T11:39:01.489+0000 7fd1d12d2640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:39:02.111 INFO:tasks.workunit.client.0.smithi138.stderr: -192> 2024-09-14T11:39:01.489+0000 7fd1d12d2640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:39:02.111 INFO:tasks.workunit.client.0.smithi138.stderr: -191> 2024-09-14T11:39:01.489+0000 7fd1d0ad1640 10 monclient(hunting): get_auth_request con 0x561192345870 auth_method 0 2024-09-14T11:39:02.111 INFO:tasks.workunit.client.0.smithi138.stderr: -190> 2024-09-14T11:39:01.489+0000 7fd1d0ad1640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:39:02.111 INFO:tasks.workunit.client.0.smithi138.stderr: -189> 2024-09-14T11:39:01.489+0000 7fd1d0ad1640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:39:02.111 INFO:tasks.workunit.client.0.smithi138.stderr: -188> 2024-09-14T11:39:01.489+0000 7fd1d0ad1640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:39:02.111 INFO:tasks.workunit.client.0.smithi138.stderr: -187> 2024-09-14T11:39:01.489+0000 7fd1d12d2640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:39:02.111 INFO:tasks.workunit.client.0.smithi138.stderr: -186> 2024-09-14T11:39:01.489+0000 7fd1d12d2640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:39:02.111 INFO:tasks.workunit.client.0.smithi138.stderr: -185> 2024-09-14T11:39:01.489+0000 7fd1d12d2640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:39:02.111 INFO:tasks.workunit.client.0.smithi138.stderr: -184> 2024-09-14T11:39:01.489+0000 7fd1d0ad1640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:39:02.111 INFO:tasks.workunit.client.0.smithi138.stderr: -183> 2024-09-14T11:39:01.489+0000 7fd1d0ad1640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:39:02.111 INFO:tasks.workunit.client.0.smithi138.stderr: -182> 2024-09-14T11:39:01.489+0000 7fd1d0ad1640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:39:02.111 INFO:tasks.workunit.client.0.smithi138.stderr: -181> 2024-09-14T11:39:01.489+0000 7fd1d1ad3640 10 monclient(hunting): get_auth_request con 0x5611923710d0 auth_method 0 2024-09-14T11:39:02.111 INFO:tasks.workunit.client.0.smithi138.stderr: -180> 2024-09-14T11:39:01.489+0000 7fd1d1ad3640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:39:02.111 INFO:tasks.workunit.client.0.smithi138.stderr: -179> 2024-09-14T11:39:01.489+0000 7fd1d1ad3640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:39:02.112 INFO:tasks.workunit.client.0.smithi138.stderr: -178> 2024-09-14T11:39:01.489+0000 7fd1d1ad3640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:39:02.112 INFO:tasks.workunit.client.0.smithi138.stderr: -177> 2024-09-14T11:39:01.489+0000 7fd1d0ad1640 10 monclient(hunting): handle_auth_done global_id 7373 payload 824 2024-09-14T11:39:02.112 INFO:tasks.workunit.client.0.smithi138.stderr: -176> 2024-09-14T11:39:01.489+0000 7fd1d0ad1640 10 monclient: _finish_hunting 0 2024-09-14T11:39:02.112 INFO:tasks.workunit.client.0.smithi138.stderr: -175> 2024-09-14T11:39:01.489+0000 7fd1d0ad1640 1 monclient: found mon.noname-c 2024-09-14T11:39:02.112 INFO:tasks.workunit.client.0.smithi138.stderr: -174> 2024-09-14T11:39:01.489+0000 7fd1d0ad1640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.138:3301/0 2024-09-14T11:39:02.112 INFO:tasks.workunit.client.0.smithi138.stderr: -173> 2024-09-14T11:39:01.489+0000 7fd0a2ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:39:02.112 INFO:tasks.workunit.client.0.smithi138.stderr: -172> 2024-09-14T11:39:01.489+0000 7fd0a2ffd640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-14T11:39:02.112 INFO:tasks.workunit.client.0.smithi138.stderr: -171> 2024-09-14T11:39:01.489+0000 7fd0a2ffd640 10 monclient: dump: 2024-09-14T11:39:02.112 INFO:tasks.workunit.client.0.smithi138.stderr:epoch 1 2024-09-14T11:39:02.112 INFO:tasks.workunit.client.0.smithi138.stderr:fsid 3f225f43-83a6-4aeb-b798-1f04bb49d597 2024-09-14T11:39:02.112 INFO:tasks.workunit.client.0.smithi138.stderr:last_changed 2024-09-14T11:07:09.252780+0000 2024-09-14T11:39:02.112 INFO:tasks.workunit.client.0.smithi138.stderr:created 2024-09-14T11:07:09.252780+0000 2024-09-14T11:39:02.112 INFO:tasks.workunit.client.0.smithi138.stderr:min_mon_release 19 (squid) 2024-09-14T11:39:02.112 INFO:tasks.workunit.client.0.smithi138.stderr:election_strategy: 1 2024-09-14T11:39:02.113 INFO:tasks.workunit.client.0.smithi138.stderr:0: [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] mon.a 2024-09-14T11:39:02.113 INFO:tasks.workunit.client.0.smithi138.stderr:1: [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] mon.b 2024-09-14T11:39:02.113 INFO:tasks.workunit.client.0.smithi138.stderr:2: [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] mon.c 2024-09-14T11:39:02.113 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-14T11:39:02.113 INFO:tasks.workunit.client.0.smithi138.stderr: -170> 2024-09-14T11:39:01.489+0000 7fd0a2ffd640 10 monclient: _finish_auth 0 2024-09-14T11:39:02.113 INFO:tasks.workunit.client.0.smithi138.stderr: -169> 2024-09-14T11:39:01.489+0000 7fd0a2ffd640 10 monclient: _check_auth_tickets 2024-09-14T11:39:02.113 INFO:tasks.workunit.client.0.smithi138.stderr: -168> 2024-09-14T11:39:01.489+0000 7fd0a2ffd640 10 monclient: handle_config config(0 keys) 2024-09-14T11:39:02.113 INFO:tasks.workunit.client.0.smithi138.stderr: -167> 2024-09-14T11:39:01.489+0000 7fd0a2ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:39:02.113 INFO:tasks.workunit.client.0.smithi138.stderr: -166> 2024-09-14T11:39:01.489+0000 7fd0a2ffd640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-14T11:39:02.113 INFO:tasks.workunit.client.0.smithi138.stderr: -165> 2024-09-14T11:39:01.489+0000 7fd0a2ffd640 10 monclient: dump: 2024-09-14T11:39:02.113 INFO:tasks.workunit.client.0.smithi138.stderr:epoch 1 2024-09-14T11:39:02.113 INFO:tasks.workunit.client.0.smithi138.stderr:fsid 3f225f43-83a6-4aeb-b798-1f04bb49d597 2024-09-14T11:39:02.113 INFO:tasks.workunit.client.0.smithi138.stderr:last_changed 2024-09-14T11:07:09.252780+0000 2024-09-14T11:39:02.113 INFO:tasks.workunit.client.0.smithi138.stderr:created 2024-09-14T11:07:09.252780+0000 2024-09-14T11:39:02.113 INFO:tasks.workunit.client.0.smithi138.stderr:min_mon_release 19 (squid) 2024-09-14T11:39:02.114 INFO:tasks.workunit.client.0.smithi138.stderr:election_strategy: 1 2024-09-14T11:39:02.114 INFO:tasks.workunit.client.0.smithi138.stderr:0: [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] mon.a 2024-09-14T11:39:02.114 INFO:tasks.workunit.client.0.smithi138.stderr:1: [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] mon.b 2024-09-14T11:39:02.114 INFO:tasks.workunit.client.0.smithi138.stderr:2: [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] mon.c 2024-09-14T11:39:02.114 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-14T11:39:02.114 INFO:tasks.workunit.client.0.smithi138.stderr: -164> 2024-09-14T11:39:01.489+0000 7fd1d37cc9c0 5 monclient: authenticate success, global_id 7373 2024-09-14T11:39:02.114 INFO:tasks.workunit.client.0.smithi138.stderr: -163> 2024-09-14T11:39:01.489+0000 7fd1d37cc9c0 10 monclient: _renew_subs 2024-09-14T11:39:02.114 INFO:tasks.workunit.client.0.smithi138.stderr: -162> 2024-09-14T11:39:01.489+0000 7fd1d37cc9c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.138:3301/0 2024-09-14T11:39:02.114 INFO:tasks.workunit.client.0.smithi138.stderr: -161> 2024-09-14T11:39:01.489+0000 7fd0b4ff9640 4 set_mon_vals no callback set 2024-09-14T11:39:02.114 INFO:tasks.workunit.client.0.smithi138.stderr: -160> 2024-09-14T11:39:01.489+0000 7fd1d37cc9c0 10 monclient: _renew_subs 2024-09-14T11:39:02.114 INFO:tasks.workunit.client.0.smithi138.stderr: -159> 2024-09-14T11:39:01.489+0000 7fd1d37cc9c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.138:3301/0 2024-09-14T11:39:02.114 INFO:tasks.workunit.client.0.smithi138.stderr: -158> 2024-09-14T11:39:01.489+0000 7fd1d37cc9c0 1 librados: init done 2024-09-14T11:39:02.114 INFO:tasks.workunit.client.0.smithi138.stderr: -157> 2024-09-14T11:39:01.489+0000 7fd1d37cc9c0 5 asok(0x561192097d90) register_command cr dump hook 0x561192380388 2024-09-14T11:39:02.114 INFO:tasks.workunit.client.0.smithi138.stderr: -156> 2024-09-14T11:39:01.489+0000 7fd1d37cc9c0 20 rados->read ofs=0 len=0 2024-09-14T11:39:02.114 INFO:tasks.workunit.client.0.smithi138.stderr: -155> 2024-09-14T11:39:01.489+0000 7fd0a2ffd640 4 mgrc handle_mgr_map Got map version 5 2024-09-14T11:39:02.115 INFO:tasks.workunit.client.0.smithi138.stderr: -154> 2024-09-14T11:39:01.489+0000 7fd0a2ffd640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.138:6832/3778043143,v1:172.21.15.138:6833/3778043143] 2024-09-14T11:39:02.115 INFO:tasks.workunit.client.0.smithi138.stderr: -153> 2024-09-14T11:39:01.489+0000 7fd0a2ffd640 4 mgrc reconnect Starting new session with [v2:172.21.15.138:6832/3778043143,v1:172.21.15.138:6833/3778043143] 2024-09-14T11:39:02.115 INFO:tasks.workunit.client.0.smithi138.stderr: -152> 2024-09-14T11:39:01.489+0000 7fd1d1ad3640 10 monclient: get_auth_request con 0x7fd09c0718a0 auth_method 0 2024-09-14T11:39:02.115 INFO:tasks.workunit.client.0.smithi138.stderr: -151> 2024-09-14T11:39:01.489+0000 7fd1d12d2640 10 monclient: get_auth_request con 0x56119238fc90 auth_method 0 2024-09-14T11:39:02.115 INFO:tasks.workunit.client.0.smithi138.stderr: -150> 2024-09-14T11:39:01.493+0000 7fd1d37cc9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:39:02.115 INFO:tasks.workunit.client.0.smithi138.stderr: -149> 2024-09-14T11:39:01.493+0000 7fd1d37cc9c0 20 realm 2024-09-14T11:39:02.115 INFO:tasks.workunit.client.0.smithi138.stderr: -148> 2024-09-14T11:39:01.493+0000 7fd1d37cc9c0 20 rados->read ofs=0 len=0 2024-09-14T11:39:02.115 INFO:tasks.workunit.client.0.smithi138.stderr: -147> 2024-09-14T11:39:01.493+0000 7fd1d37cc9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:39:02.115 INFO:tasks.workunit.client.0.smithi138.stderr: -146> 2024-09-14T11:39:01.493+0000 7fd1d37cc9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:39:02.115 INFO:tasks.workunit.client.0.smithi138.stderr: -145> 2024-09-14T11:39:01.493+0000 7fd1d37cc9c0 20 rados->read ofs=0 len=0 2024-09-14T11:39:02.115 INFO:tasks.workunit.client.0.smithi138.stderr: -144> 2024-09-14T11:39:01.493+0000 7fd1d37cc9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:39:02.115 INFO:tasks.workunit.client.0.smithi138.stderr: -143> 2024-09-14T11:39:01.493+0000 7fd1d37cc9c0 20 rados->read ofs=0 len=0 2024-09-14T11:39:02.115 INFO:tasks.workunit.client.0.smithi138.stderr: -142> 2024-09-14T11:39:01.493+0000 7fd1d0ad1640 10 monclient: get_auth_request con 0x561192393ff0 auth_method 0 2024-09-14T11:39:02.115 INFO:tasks.workunit.client.0.smithi138.stderr: -141> 2024-09-14T11:39:01.493+0000 7fd1d37cc9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:39:02.115 INFO:tasks.workunit.client.0.smithi138.stderr: -140> 2024-09-14T11:39:01.493+0000 7fd1d37cc9c0 20 rados->read ofs=0 len=0 2024-09-14T11:39:02.116 INFO:tasks.workunit.client.0.smithi138.stderr: -139> 2024-09-14T11:39:01.493+0000 7fd1d1ad3640 10 monclient: get_auth_request con 0x561192397730 auth_method 0 2024-09-14T11:39:02.116 INFO:tasks.workunit.client.0.smithi138.stderr: -138> 2024-09-14T11:39:01.493+0000 7fd1d37cc9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:39:02.116 INFO:tasks.workunit.client.0.smithi138.stderr: -137> 2024-09-14T11:39:01.493+0000 7fd1d37cc9c0 20 searching for the correct realm 2024-09-14T11:39:02.116 INFO:tasks.workunit.client.0.smithi138.stderr: -136> 2024-09-14T11:39:01.493+0000 7fd1d12d2640 10 monclient: get_auth_request con 0x56119239c4d0 auth_method 0 2024-09-14T11:39:02.116 INFO:tasks.workunit.client.0.smithi138.stderr: -135> 2024-09-14T11:39:01.497+0000 7fd1d0ad1640 10 monclient: get_auth_request con 0x7fd1c40bf070 auth_method 0 2024-09-14T11:39:02.116 INFO:tasks.workunit.client.0.smithi138.stderr: -134> 2024-09-14T11:39:01.497+0000 7fd1d1ad3640 0 -- 172.21.15.138:0/2620737197 >> [v2:172.21.15.154:6824/416768175,v1:172.21.15.154:6825/416768175] conn(0x7fd1cc041040 msgr2=0x7fd1cc041420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:39:02.116 INFO:tasks.workunit.client.0.smithi138.stderr: -133> 2024-09-14T11:39:01.701+0000 7fd1d1ad3640 10 monclient: get_auth_request con 0x7fd1cc041040 auth_method 0 2024-09-14T11:39:02.116 INFO:tasks.workunit.client.0.smithi138.stderr: -132> 2024-09-14T11:39:01.705+0000 7fd1d12d2640 10 monclient: get_auth_request con 0x7fd1cc034920 auth_method 0 2024-09-14T11:39:02.116 INFO:tasks.workunit.client.0.smithi138.stderr: -131> 2024-09-14T11:39:01.713+0000 7fd1d0ad1640 10 monclient: get_auth_request con 0x7fd1cc016400 auth_method 0 2024-09-14T11:39:02.116 INFO:tasks.workunit.client.0.smithi138.stderr: -130> 2024-09-14T11:39:01.713+0000 7fd1d0ad1640 0 -- 172.21.15.138:0/2620737197 >> [v2:172.21.15.138:6816/326481658,v1:172.21.15.138:6817/326481658] conn(0x7fd1cc016400 msgr2=0x7fd1cc016880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:39:02.116 INFO:tasks.workunit.client.0.smithi138.stderr: -129> 2024-09-14T11:39:01.917+0000 7fd1d0ad1640 10 monclient: get_auth_request con 0x7fd1cc016400 auth_method 0 2024-09-14T11:39:02.116 INFO:tasks.workunit.client.0.smithi138.stderr: -128> 2024-09-14T11:39:01.929+0000 7fd1d37cc9c0 20 RGWRados::pool_iterate: got zone_info.d9e72d30-c60b-4d0d-9267-fdc36392d5ad 2024-09-14T11:39:02.116 INFO:tasks.workunit.client.0.smithi138.stderr: -127> 2024-09-14T11:39:01.929+0000 7fd1d37cc9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:39:02.117 INFO:tasks.workunit.client.0.smithi138.stderr: -126> 2024-09-14T11:39:01.929+0000 7fd1d37cc9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:39:02.117 INFO:tasks.workunit.client.0.smithi138.stderr: -125> 2024-09-14T11:39:01.929+0000 7fd1d37cc9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:39:02.117 INFO:tasks.workunit.client.0.smithi138.stderr: -124> 2024-09-14T11:39:01.929+0000 7fd1d37cc9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:39:02.117 INFO:tasks.workunit.client.0.smithi138.stderr: -123> 2024-09-14T11:39:01.929+0000 7fd1d37cc9c0 20 RGWRados::pool_iterate: got zonegroup_info.65ab941b-da8c-4160-94fb-3672b069d44f 2024-09-14T11:39:02.117 INFO:tasks.workunit.client.0.smithi138.stderr: -122> 2024-09-14T11:39:01.929+0000 7fd1d37cc9c0 20 rados->read ofs=0 len=0 2024-09-14T11:39:02.117 INFO:tasks.workunit.client.0.smithi138.stderr: -121> 2024-09-14T11:39:01.933+0000 7fd1d37cc9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:39:02.117 INFO:tasks.workunit.client.0.smithi138.stderr: -120> 2024-09-14T11:39:01.933+0000 7fd1d37cc9c0 20 rados->read ofs=0 len=0 2024-09-14T11:39:02.117 INFO:tasks.workunit.client.0.smithi138.stderr: -119> 2024-09-14T11:39:01.933+0000 7fd1d37cc9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:39:02.117 INFO:tasks.workunit.client.0.smithi138.stderr: -118> 2024-09-14T11:39:01.933+0000 7fd1d37cc9c0 20 rados->read ofs=0 len=0 2024-09-14T11:39:02.117 INFO:tasks.workunit.client.0.smithi138.stderr: -117> 2024-09-14T11:39:01.933+0000 7fd1d37cc9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:39:02.117 INFO:tasks.workunit.client.0.smithi138.stderr: -116> 2024-09-14T11:39:01.933+0000 7fd1d37cc9c0 20 zone default found 2024-09-14T11:39:02.117 INFO:tasks.workunit.client.0.smithi138.stderr: -115> 2024-09-14T11:39:01.933+0000 7fd1d37cc9c0 4 Realm: () 2024-09-14T11:39:02.117 INFO:tasks.workunit.client.0.smithi138.stderr: -114> 2024-09-14T11:39:01.933+0000 7fd1d37cc9c0 4 ZoneGroup: default (65ab941b-da8c-4160-94fb-3672b069d44f) 2024-09-14T11:39:02.117 INFO:tasks.workunit.client.0.smithi138.stderr: -113> 2024-09-14T11:39:01.933+0000 7fd1d37cc9c0 4 Zone: default (d9e72d30-c60b-4d0d-9267-fdc36392d5ad) 2024-09-14T11:39:02.117 INFO:tasks.workunit.client.0.smithi138.stderr: -112> 2024-09-14T11:39:01.933+0000 7fd1d37cc9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:39:02.118 INFO:tasks.workunit.client.0.smithi138.stderr: -111> 2024-09-14T11:39:01.933+0000 7fd1d37cc9c0 20 zonegroup default 2024-09-14T11:39:02.118 INFO:tasks.workunit.client.0.smithi138.stderr: -110> 2024-09-14T11:39:01.933+0000 7fd1d37cc9c0 20 rados->read ofs=0 len=0 2024-09-14T11:39:02.118 INFO:tasks.workunit.client.0.smithi138.stderr: -109> 2024-09-14T11:39:01.933+0000 7fd1d37cc9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:39:02.118 INFO:tasks.workunit.client.0.smithi138.stderr: -108> 2024-09-14T11:39:01.933+0000 7fd1d37cc9c0 20 rados->read ofs=0 len=0 2024-09-14T11:39:02.118 INFO:tasks.workunit.client.0.smithi138.stderr: -107> 2024-09-14T11:39:01.933+0000 7fd1d37cc9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:39:02.118 INFO:tasks.workunit.client.0.smithi138.stderr: -106> 2024-09-14T11:39:01.933+0000 7fd1d37cc9c0 20 rados->read ofs=0 len=0 2024-09-14T11:39:02.118 INFO:tasks.workunit.client.0.smithi138.stderr: -105> 2024-09-14T11:39:01.933+0000 7fd1d37cc9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:39:02.118 INFO:tasks.workunit.client.0.smithi138.stderr: -104> 2024-09-14T11:39:01.933+0000 7fd1d37cc9c0 20 started sync module instance, tier type = 2024-09-14T11:39:02.118 INFO:tasks.workunit.client.0.smithi138.stderr: -103> 2024-09-14T11:39:01.937+0000 7fd1d37cc9c0 20 started zone id=d9e72d30-c60b-4d0d-9267-fdc36392d5ad (name=default) with tier type = 2024-09-14T11:39:02.118 INFO:tasks.workunit.client.0.smithi138.stderr: -102> 2024-09-14T11:39:01.957+0000 7fd1d37cc9c0 20 add_watcher() i=0 2024-09-14T11:39:02.118 INFO:tasks.workunit.client.0.smithi138.stderr: -101> 2024-09-14T11:39:01.957+0000 7fd1d37cc9c0 20 add_watcher() i=1 2024-09-14T11:39:02.118 INFO:tasks.workunit.client.0.smithi138.stderr: -100> 2024-09-14T11:39:01.957+0000 7fd1d37cc9c0 20 add_watcher() i=2 2024-09-14T11:39:02.118 INFO:tasks.workunit.client.0.smithi138.stderr: -99> 2024-09-14T11:39:01.957+0000 7fd1d37cc9c0 20 add_watcher() i=3 2024-09-14T11:39:02.118 INFO:tasks.workunit.client.0.smithi138.stderr: -98> 2024-09-14T11:39:01.957+0000 7fd1d37cc9c0 20 add_watcher() i=4 2024-09-14T11:39:02.119 INFO:tasks.workunit.client.0.smithi138.stderr: -97> 2024-09-14T11:39:01.957+0000 7fd1d37cc9c0 20 add_watcher() i=5 2024-09-14T11:39:02.119 INFO:tasks.workunit.client.0.smithi138.stderr: -96> 2024-09-14T11:39:01.957+0000 7fd1d37cc9c0 20 add_watcher() i=6 2024-09-14T11:39:02.119 INFO:tasks.workunit.client.0.smithi138.stderr: -95> 2024-09-14T11:39:01.961+0000 7fd1d37cc9c0 20 add_watcher() i=7 2024-09-14T11:39:02.119 INFO:tasks.workunit.client.0.smithi138.stderr: -94> 2024-09-14T11:39:01.961+0000 7fd1d37cc9c0 2 all 8 watchers are set, enabling cache 2024-09-14T11:39:02.119 INFO:tasks.workunit.client.0.smithi138.stderr: -93> 2024-09-14T11:39:01.961+0000 7fd1d37cc9c0 5 AuthRegistry(0x7ffff5249900) adding auth protocol: cephx 2024-09-14T11:39:02.119 INFO:tasks.workunit.client.0.smithi138.stderr: -92> 2024-09-14T11:39:01.961+0000 7fd1d37cc9c0 5 AuthRegistry(0x7ffff5249900) adding auth protocol: cephx 2024-09-14T11:39:02.119 INFO:tasks.workunit.client.0.smithi138.stderr: -91> 2024-09-14T11:39:01.961+0000 7fd1d37cc9c0 5 AuthRegistry(0x7ffff5249900) adding auth protocol: cephx 2024-09-14T11:39:02.119 INFO:tasks.workunit.client.0.smithi138.stderr: -90> 2024-09-14T11:39:01.961+0000 7fd1d37cc9c0 5 AuthRegistry(0x7ffff5249900) adding con mode: secure 2024-09-14T11:39:02.119 INFO:tasks.workunit.client.0.smithi138.stderr: -89> 2024-09-14T11:39:01.961+0000 7fd1d37cc9c0 5 AuthRegistry(0x7ffff5249900) adding con mode: crc 2024-09-14T11:39:02.119 INFO:tasks.workunit.client.0.smithi138.stderr: -88> 2024-09-14T11:39:01.961+0000 7fd1d37cc9c0 5 AuthRegistry(0x7ffff5249900) adding con mode: secure 2024-09-14T11:39:02.119 INFO:tasks.workunit.client.0.smithi138.stderr: -87> 2024-09-14T11:39:01.961+0000 7fd1d37cc9c0 5 AuthRegistry(0x7ffff5249900) adding con mode: crc 2024-09-14T11:39:02.119 INFO:tasks.workunit.client.0.smithi138.stderr: -86> 2024-09-14T11:39:01.961+0000 7fd1d37cc9c0 5 AuthRegistry(0x7ffff5249900) adding con mode: secure 2024-09-14T11:39:02.119 INFO:tasks.workunit.client.0.smithi138.stderr: -85> 2024-09-14T11:39:01.961+0000 7fd1d37cc9c0 5 AuthRegistry(0x7ffff5249900) adding con mode: crc 2024-09-14T11:39:02.119 INFO:tasks.workunit.client.0.smithi138.stderr: -84> 2024-09-14T11:39:01.961+0000 7fd1d37cc9c0 5 AuthRegistry(0x7ffff5249900) adding con mode: crc 2024-09-14T11:39:02.120 INFO:tasks.workunit.client.0.smithi138.stderr: -83> 2024-09-14T11:39:01.961+0000 7fd1d37cc9c0 5 AuthRegistry(0x7ffff5249900) adding con mode: secure 2024-09-14T11:39:02.120 INFO:tasks.workunit.client.0.smithi138.stderr: -82> 2024-09-14T11:39:01.961+0000 7fd1d37cc9c0 5 AuthRegistry(0x7ffff5249900) adding con mode: crc 2024-09-14T11:39:02.120 INFO:tasks.workunit.client.0.smithi138.stderr: -81> 2024-09-14T11:39:01.961+0000 7fd1d37cc9c0 5 AuthRegistry(0x7ffff5249900) adding con mode: secure 2024-09-14T11:39:02.120 INFO:tasks.workunit.client.0.smithi138.stderr: -80> 2024-09-14T11:39:01.961+0000 7fd1d37cc9c0 5 AuthRegistry(0x7ffff5249900) adding con mode: crc 2024-09-14T11:39:02.120 INFO:tasks.workunit.client.0.smithi138.stderr: -79> 2024-09-14T11:39:01.961+0000 7fd1d37cc9c0 5 AuthRegistry(0x7ffff5249900) adding con mode: secure 2024-09-14T11:39:02.120 INFO:tasks.workunit.client.0.smithi138.stderr: -78> 2024-09-14T11:39:01.961+0000 7fd0877e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:39:02.120 INFO:tasks.workunit.client.0.smithi138.stderr: -77> 2024-09-14T11:39:01.965+0000 7fd1d37cc9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:39:02.120 INFO:tasks.workunit.client.0.smithi138.stderr: -76> 2024-09-14T11:39:01.965+0000 7fd1d37cc9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:39:02.120 INFO:tasks.workunit.client.0.smithi138.stderr: -75> 2024-09-14T11:39:01.965+0000 7fd1d37cc9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:39:02.120 INFO:tasks.workunit.client.0.smithi138.stderr: -74> 2024-09-14T11:39:01.965+0000 7fd1d37cc9c0 5 asok(0x561192097d90) register_command cache list hook 0x56119236b6c0 2024-09-14T11:39:02.120 INFO:tasks.workunit.client.0.smithi138.stderr: -73> 2024-09-14T11:39:01.965+0000 7fd1d37cc9c0 5 asok(0x561192097d90) register_command cache inspect hook 0x56119236b6c0 2024-09-14T11:39:02.120 INFO:tasks.workunit.client.0.smithi138.stderr: -72> 2024-09-14T11:39:01.965+0000 7fd1d37cc9c0 5 asok(0x561192097d90) register_command cache erase hook 0x56119236b6c0 2024-09-14T11:39:02.120 INFO:tasks.workunit.client.0.smithi138.stderr: -71> 2024-09-14T11:39:01.965+0000 7fd1d37cc9c0 5 asok(0x561192097d90) register_command cache zap hook 0x56119236b6c0 2024-09-14T11:39:02.120 INFO:tasks.workunit.client.0.smithi138.stderr: -70> 2024-09-14T11:39:01.965+0000 7fd1d37cc9c0 5 note: GC not initialized 2024-09-14T11:39:02.120 INFO:tasks.workunit.client.0.smithi138.stderr: -69> 2024-09-14T11:39:01.965+0000 7fd0867e4640 20 reqs_thread_entry: start 2024-09-14T11:39:02.121 INFO:tasks.workunit.client.0.smithi138.stderr: -68> 2024-09-14T11:39:01.965+0000 7fd1d37cc9c0 5 asok(0x561192097d90) register_command sync trace show hook 0x7fd1c8001340 2024-09-14T11:39:02.121 INFO:tasks.workunit.client.0.smithi138.stderr: -67> 2024-09-14T11:39:01.965+0000 7fd1d37cc9c0 5 asok(0x561192097d90) register_command sync trace history hook 0x7fd1c8001340 2024-09-14T11:39:02.121 INFO:tasks.workunit.client.0.smithi138.stderr: -66> 2024-09-14T11:39:01.965+0000 7fd1d37cc9c0 5 asok(0x561192097d90) register_command sync trace active hook 0x7fd1c8001340 2024-09-14T11:39:02.121 INFO:tasks.workunit.client.0.smithi138.stderr: -65> 2024-09-14T11:39:01.965+0000 7fd1d37cc9c0 5 asok(0x561192097d90) register_command sync trace active_short hook 0x7fd1c8001340 2024-09-14T11:39:02.121 INFO:tasks.workunit.client.0.smithi138.stderr: -64> 2024-09-14T11:39:01.965+0000 7fd1d37cc9c0 20 init_complete bucket index max shards: 11 2024-09-14T11:39:02.121 INFO:tasks.workunit.client.0.smithi138.stderr: -63> 2024-09-14T11:39:01.965+0000 7fd1d37cc9c0 20 Filter name: none 2024-09-14T11:39:02.121 INFO:tasks.workunit.client.0.smithi138.stderr: -62> 2024-09-14T11:39:01.965+0000 7fcff7fff640 20 reqs_thread_entry: start 2024-09-14T11:39:02.121 INFO:tasks.workunit.client.0.smithi138.stderr: -61> 2024-09-14T11:39:01.965+0000 7fd1d37cc9c0 10 cache get: name=default.rgw.meta+root+abort-at-change-reshard-state : miss 2024-09-14T11:39:02.121 INFO:tasks.workunit.client.0.smithi138.stderr: -60> 2024-09-14T11:39:01.965+0000 7fd1d37cc9c0 20 rados->read ofs=0 len=0 2024-09-14T11:39:02.121 INFO:tasks.workunit.client.0.smithi138.stderr: -59> 2024-09-14T11:39:01.965+0000 7fd1d37cc9c0 20 rados_obj.operate() r=0 bl.length=197 2024-09-14T11:39:02.121 INFO:tasks.workunit.client.0.smithi138.stderr: -58> 2024-09-14T11:39:01.965+0000 7fd1d37cc9c0 10 cache put: name=default.rgw.meta+root+abort-at-change-reshard-state info.flags=0x11 2024-09-14T11:39:02.121 INFO:tasks.workunit.client.0.smithi138.stderr: -57> 2024-09-14T11:39:01.965+0000 7fd1d37cc9c0 10 adding default.rgw.meta+root+abort-at-change-reshard-state to cache LRU end 2024-09-14T11:39:02.121 INFO:tasks.workunit.client.0.smithi138.stderr: -56> 2024-09-14T11:39:01.965+0000 7fd1d37cc9c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.39 : miss 2024-09-14T11:39:02.121 INFO:tasks.workunit.client.0.smithi138.stderr: -55> 2024-09-14T11:39:01.965+0000 7fd1d37cc9c0 20 rados->read ofs=0 len=0 2024-09-14T11:39:02.122 INFO:tasks.workunit.client.0.smithi138.stderr: -54> 2024-09-14T11:39:01.965+0000 7fd1d37cc9c0 20 rados_obj.operate() r=0 bl.length=419 2024-09-14T11:39:02.122 INFO:tasks.workunit.client.0.smithi138.stderr: -53> 2024-09-14T11:39:01.965+0000 7fd1d37cc9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.39 info.flags=0x17 2024-09-14T11:39:02.122 INFO:tasks.workunit.client.0.smithi138.stderr: -52> 2024-09-14T11:39:01.965+0000 7fd1d37cc9c0 10 adding default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.39 to cache LRU end 2024-09-14T11:39:02.122 INFO:tasks.workunit.client.0.smithi138.stderr: -51> 2024-09-14T11:39:01.965+0000 7fd1d37cc9c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:39:02.122 INFO:tasks.workunit.client.0.smithi138.stderr: -50> 2024-09-14T11:39:01.965+0000 7fd1d37cc9c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:39:02.122 INFO:tasks.workunit.client.0.smithi138.stderr: -49> 2024-09-14T11:39:01.965+0000 7fd1d37cc9c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.39 2024-09-14T11:39:02.122 INFO:tasks.workunit.client.0.smithi138.stderr: -48> 2024-09-14T11:39:01.977+0000 7fd1d37cc9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.39 info.flags=0x17 2024-09-14T11:39:02.122 INFO:tasks.workunit.client.0.smithi138.stderr: -47> 2024-09-14T11:39:01.977+0000 7fd1d37cc9c0 10 moving default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.39 to cache LRU end 2024-09-14T11:39:02.122 INFO:tasks.workunit.client.0.smithi138.stderr: -46> 2024-09-14T11:39:01.977+0000 7fd1d37cc9c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:39:02.122 INFO:tasks.workunit.client.0.smithi138.stderr: -45> 2024-09-14T11:39:01.977+0000 7fd1d37cc9c0 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-change-reshard-state:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.39, ofs0, ns] 2024-09-14T11:39:02.122 INFO:tasks.workunit.client.0.smithi138.stderr: -44> 2024-09-14T11:39:01.977+0000 7fd0a3fff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366175 cookie 94633467721168 notifier 7373 bl.length()=931 2024-09-14T11:39:02.122 INFO:tasks.workunit.client.0.smithi138.stderr: -43> 2024-09-14T11:39:01.977+0000 7fd0a3fff640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.39 info.flags=0x17 2024-09-14T11:39:02.122 INFO:tasks.workunit.client.0.smithi138.stderr: -42> 2024-09-14T11:39:01.977+0000 7fd0a3fff640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.39 to cache LRU end 2024-09-14T11:39:02.122 INFO:tasks.workunit.client.0.smithi138.stderr: -41> 2024-09-14T11:39:01.977+0000 7fd0a3fff640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:39:02.123 INFO:tasks.workunit.client.0.smithi138.stderr: -40> 2024-09-14T11:39:01.981+0000 7fd1d37cc9c0 20 handle_bi_update(): bucket=:abort-at-change-reshard-state[d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.39]): orig_sources= new_sources= 2024-09-14T11:39:02.123 INFO:tasks.workunit.client.0.smithi138.stderr: -39> 2024-09-14T11:39:01.981+0000 7fd1d37cc9c0 20 handle_bi_update(): bucket=:abort-at-change-reshard-state[d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.39]): potential sources added=[] removed=[] 2024-09-14T11:39:02.123 INFO:tasks.workunit.client.0.smithi138.stderr: -38> 2024-09-14T11:39:01.981+0000 7fd1d37cc9c0 20 handle_bi_update(): bucket=:abort-at-change-reshard-state[d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.39]): orig_dests= new_dests= 2024-09-14T11:39:02.123 INFO:tasks.workunit.client.0.smithi138.stderr: -37> 2024-09-14T11:39:01.981+0000 7fd1d37cc9c0 20 handle_bi_update(): bucket=:abort-at-change-reshard-state[d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.39]): potential dests added=[] removed=[] 2024-09-14T11:39:02.123 INFO:tasks.workunit.client.0.smithi138.stderr: -36> 2024-09-14T11:39:01.993+0000 7fd1d37cc9c0 10 bucket_obj is .dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.39.1.0 2024-09-14T11:39:02.123 INFO:tasks.workunit.client.0.smithi138.stderr: -35> 2024-09-14T11:39:01.993+0000 7fd1d37cc9c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.39.1.0 2024-09-14T11:39:02.123 INFO:tasks.workunit.client.0.smithi138.stderr: -34> 2024-09-14T11:39:01.993+0000 7fd1d37cc9c0 10 bucket_obj is .dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.39.1.1 2024-09-14T11:39:02.123 INFO:tasks.workunit.client.0.smithi138.stderr: -33> 2024-09-14T11:39:01.993+0000 7fd1d37cc9c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.39.1.1 2024-09-14T11:39:02.123 INFO:tasks.workunit.client.0.smithi138.stderr: -32> 2024-09-14T11:39:01.993+0000 7fd1d37cc9c0 10 bucket_obj is .dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.39.1.2 2024-09-14T11:39:02.123 INFO:tasks.workunit.client.0.smithi138.stderr: -31> 2024-09-14T11:39:01.993+0000 7fd1d37cc9c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.39.1.2 2024-09-14T11:39:02.123 INFO:tasks.workunit.client.0.smithi138.stderr: -30> 2024-09-14T11:39:01.993+0000 7fd1d37cc9c0 10 bucket_obj is .dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.39.1.3 2024-09-14T11:39:02.123 INFO:tasks.workunit.client.0.smithi138.stderr: -29> 2024-09-14T11:39:01.993+0000 7fd1d37cc9c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.39.1.3 2024-09-14T11:39:02.123 INFO:tasks.workunit.client.0.smithi138.stderr: -28> 2024-09-14T11:39:01.993+0000 7fd1d37cc9c0 10 bucket_obj is .dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.39.1.4 2024-09-14T11:39:02.123 INFO:tasks.workunit.client.0.smithi138.stderr: -27> 2024-09-14T11:39:01.993+0000 7fd1d37cc9c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.39.1.4 2024-09-14T11:39:02.123 INFO:tasks.workunit.client.0.smithi138.stderr: -26> 2024-09-14T11:39:01.993+0000 7fd1d37cc9c0 10 bucket_obj is .dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.39.1.5 2024-09-14T11:39:02.124 INFO:tasks.workunit.client.0.smithi138.stderr: -25> 2024-09-14T11:39:01.993+0000 7fd1d37cc9c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.39.1.5 2024-09-14T11:39:02.124 INFO:tasks.workunit.client.0.smithi138.stderr: -24> 2024-09-14T11:39:01.993+0000 7fd1d37cc9c0 10 bucket_obj is .dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.39.1.6 2024-09-14T11:39:02.124 INFO:tasks.workunit.client.0.smithi138.stderr: -23> 2024-09-14T11:39:01.993+0000 7fd1d37cc9c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.39.1.6 2024-09-14T11:39:02.124 INFO:tasks.workunit.client.0.smithi138.stderr: -22> 2024-09-14T11:39:01.993+0000 7fd1d37cc9c0 10 bucket_obj is .dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.39.1.7 2024-09-14T11:39:02.124 INFO:tasks.workunit.client.0.smithi138.stderr: -21> 2024-09-14T11:39:01.993+0000 7fd1d37cc9c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.39.1.7 2024-09-14T11:39:02.124 INFO:tasks.workunit.client.0.smithi138.stderr: -20> 2024-09-14T11:39:01.993+0000 7fd1d37cc9c0 10 bucket_obj is .dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.39.1.8 2024-09-14T11:39:02.124 INFO:tasks.workunit.client.0.smithi138.stderr: -19> 2024-09-14T11:39:01.993+0000 7fd1d37cc9c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.39.1.8 2024-09-14T11:39:02.124 INFO:tasks.workunit.client.0.smithi138.stderr: -18> 2024-09-14T11:39:01.993+0000 7fd1d37cc9c0 10 bucket_obj is .dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.39.1.9 2024-09-14T11:39:02.124 INFO:tasks.workunit.client.0.smithi138.stderr: -17> 2024-09-14T11:39:01.993+0000 7fd1d37cc9c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.39.1.9 2024-09-14T11:39:02.124 INFO:tasks.workunit.client.0.smithi138.stderr: -16> 2024-09-14T11:39:01.993+0000 7fd1d37cc9c0 10 bucket_obj is .dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.39.1.10 2024-09-14T11:39:02.124 INFO:tasks.workunit.client.0.smithi138.stderr: -15> 2024-09-14T11:39:01.993+0000 7fd1d37cc9c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.39.1.10 2024-09-14T11:39:02.124 INFO:tasks.workunit.client.0.smithi138.stderr: -14> 2024-09-14T11:39:01.993+0000 7fd1d37cc9c0 10 bucket_obj is .dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.39.1.11 2024-09-14T11:39:02.124 INFO:tasks.workunit.client.0.smithi138.stderr: -13> 2024-09-14T11:39:01.993+0000 7fd1d37cc9c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.39.1.11 2024-09-14T11:39:02.124 INFO:tasks.workunit.client.0.smithi138.stderr: -12> 2024-09-14T11:39:01.993+0000 7fd1d37cc9c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.39.0 2024-09-14T11:39:02.124 INFO:tasks.workunit.client.0.smithi138.stderr: -11> 2024-09-14T11:39:01.993+0000 7fd1d37cc9c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.39.1 2024-09-14T11:39:02.125 INFO:tasks.workunit.client.0.smithi138.stderr: -10> 2024-09-14T11:39:01.993+0000 7fd1d37cc9c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.39.2 2024-09-14T11:39:02.125 INFO:tasks.workunit.client.0.smithi138.stderr: -9> 2024-09-14T11:39:01.997+0000 7fd1d37cc9c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.39.3 2024-09-14T11:39:02.125 INFO:tasks.workunit.client.0.smithi138.stderr: -8> 2024-09-14T11:39:01.997+0000 7fd1d37cc9c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.39.4 2024-09-14T11:39:02.125 INFO:tasks.workunit.client.0.smithi138.stderr: -7> 2024-09-14T11:39:01.997+0000 7fd1d37cc9c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.39.5 2024-09-14T11:39:02.125 INFO:tasks.workunit.client.0.smithi138.stderr: -6> 2024-09-14T11:39:01.997+0000 7fd1d37cc9c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.39.6 2024-09-14T11:39:02.125 INFO:tasks.workunit.client.0.smithi138.stderr: -5> 2024-09-14T11:39:01.997+0000 7fd1d37cc9c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.39.7 2024-09-14T11:39:02.125 INFO:tasks.workunit.client.0.smithi138.stderr: -4> 2024-09-14T11:39:02.001+0000 7fd1d37cc9c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.39.8 2024-09-14T11:39:02.125 INFO:tasks.workunit.client.0.smithi138.stderr: -3> 2024-09-14T11:39:02.001+0000 7fd1d37cc9c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.39.9 2024-09-14T11:39:02.125 INFO:tasks.workunit.client.0.smithi138.stderr: -2> 2024-09-14T11:39:02.001+0000 7fd1d37cc9c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.39.10 2024-09-14T11:39:02.125 INFO:tasks.workunit.client.0.smithi138.stderr: -1> 2024-09-14T11:39:02.009+0000 7fd1d37cc9c0 -1 ./src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7fd1d37cc9c0 time 2024-09-14T11:39:02.012491+0000 2024-09-14T11:39:02.125 INFO:tasks.workunit.client.0.smithi138.stderr:./src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-14T11:39:02.125 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-14T11:39:02.125 INFO:tasks.workunit.client.0.smithi138.stderr: ceph version 19.3.0-4907-ga2782315 (a2782315255a3e7d5f6cdc9eb35785187ff6ddf8) squid (dev) 2024-09-14T11:39:02.125 INFO:tasks.workunit.client.0.smithi138.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x121) [0x7fd1d70a62eb] 2024-09-14T11:39:02.126 INFO:tasks.workunit.client.0.smithi138.stderr: 2: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7fd1d70a649f] 2024-09-14T11:39:02.126 INFO:tasks.workunit.client.0.smithi138.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x56118f2c1c01] 2024-09-14T11:39:02.126 INFO:tasks.workunit.client.0.smithi138.stderr: 4: (RGWBucketReshard::do_reshard(rgw::bucket_index_layout_generation const&, rgw::bucket_index_layout_generation const&, int, bool, bool, std::ostream*, ceph::Formatter*, FaultInjector > >&, DoutPrefixProvider const*, optional_yield)+0x1411) [0x56118f2d6231] 2024-09-14T11:39:02.126 INFO:tasks.workunit.client.0.smithi138.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0xac4) [0x56118f2d7884] 2024-09-14T11:39:02.126 INFO:tasks.workunit.client.0.smithi138.stderr: 6: main() 2024-09-14T11:39:02.126 INFO:tasks.workunit.client.0.smithi138.stderr: 7: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7fd1d5f0cd90] 2024-09-14T11:39:02.126 INFO:tasks.workunit.client.0.smithi138.stderr: 8: __libc_start_main() 2024-09-14T11:39:02.126 INFO:tasks.workunit.client.0.smithi138.stderr: 9: _start() 2024-09-14T11:39:02.126 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-14T11:39:02.126 INFO:tasks.workunit.client.0.smithi138.stderr: 0> 2024-09-14T11:39:02.009+0000 7fd1d37cc9c0 -1 *** Caught signal (Aborted) ** 2024-09-14T11:39:02.126 INFO:tasks.workunit.client.0.smithi138.stderr: in thread 7fd1d37cc9c0 thread_name:radosgw-admin 2024-09-14T11:39:02.126 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-14T11:39:02.126 INFO:tasks.workunit.client.0.smithi138.stderr: ceph version 19.3.0-4907-ga2782315 (a2782315255a3e7d5f6cdc9eb35785187ff6ddf8) squid (dev) 2024-09-14T11:39:02.126 INFO:tasks.workunit.client.0.smithi138.stderr: 1: /lib/x86_64-linux-gnu/libc.so.6(+0x42520) [0x7fd1d5f25520] 2024-09-14T11:39:02.127 INFO:tasks.workunit.client.0.smithi138.stderr: 2: pthread_kill() 2024-09-14T11:39:02.127 INFO:tasks.workunit.client.0.smithi138.stderr: 3: raise() 2024-09-14T11:39:02.127 INFO:tasks.workunit.client.0.smithi138.stderr: 4: abort() 2024-09-14T11:39:02.127 INFO:tasks.workunit.client.0.smithi138.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x17b) [0x7fd1d70a6345] 2024-09-14T11:39:02.127 INFO:tasks.workunit.client.0.smithi138.stderr: 6: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7fd1d70a649f] 2024-09-14T11:39:02.127 INFO:tasks.workunit.client.0.smithi138.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x56118f2c1c01] 2024-09-14T11:39:02.127 INFO:tasks.workunit.client.0.smithi138.stderr: 8: (RGWBucketReshard::do_reshard(rgw::bucket_index_layout_generation const&, rgw::bucket_index_layout_generation const&, int, bool, bool, std::ostream*, ceph::Formatter*, FaultInjector > >&, DoutPrefixProvider const*, optional_yield)+0x1411) [0x56118f2d6231] 2024-09-14T11:39:02.127 INFO:tasks.workunit.client.0.smithi138.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0xac4) [0x56118f2d7884] 2024-09-14T11:39:02.127 INFO:tasks.workunit.client.0.smithi138.stderr: 10: main() 2024-09-14T11:39:02.127 INFO:tasks.workunit.client.0.smithi138.stderr: 11: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7fd1d5f0cd90] 2024-09-14T11:39:02.127 INFO:tasks.workunit.client.0.smithi138.stderr: 12: __libc_start_main() 2024-09-14T11:39:02.127 INFO:tasks.workunit.client.0.smithi138.stderr: 13: _start() 2024-09-14T11:39:02.127 INFO:tasks.workunit.client.0.smithi138.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-14T11:39:02.127 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-14T11:39:02.128 INFO:tasks.workunit.client.0.smithi138.stderr:--- logging levels --- 2024-09-14T11:39:02.128 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 none 2024-09-14T11:39:02.128 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 1 lockdep 2024-09-14T11:39:02.128 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 1 context 2024-09-14T11:39:02.128 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 1 crush 2024-09-14T11:39:02.128 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 mds 2024-09-14T11:39:02.128 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 mds_balancer 2024-09-14T11:39:02.128 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 mds_locker 2024-09-14T11:39:02.128 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 mds_log 2024-09-14T11:39:02.128 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 mds_log_expire 2024-09-14T11:39:02.128 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 mds_migrator 2024-09-14T11:39:02.128 INFO:tasks.workunit.client.0.smithi138.stderr: 3/ 5 mds_quiesce 2024-09-14T11:39:02.128 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 1 buffer 2024-09-14T11:39:02.128 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 1 timer 2024-09-14T11:39:02.128 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 1 filer 2024-09-14T11:39:02.129 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 1 striper 2024-09-14T11:39:02.129 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 1 objecter 2024-09-14T11:39:02.129 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 rados 2024-09-14T11:39:02.129 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 rbd 2024-09-14T11:39:02.129 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 rbd_mirror 2024-09-14T11:39:02.129 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 rbd_replay 2024-09-14T11:39:02.129 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 rbd_pwl 2024-09-14T11:39:02.129 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 journaler 2024-09-14T11:39:02.129 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 objectcacher 2024-09-14T11:39:02.129 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 immutable_obj_cache 2024-09-14T11:39:02.129 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 client 2024-09-14T11:39:02.129 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 osd 2024-09-14T11:39:02.129 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 optracker 2024-09-14T11:39:02.129 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 objclass 2024-09-14T11:39:02.129 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 3 filestore 2024-09-14T11:39:02.130 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 3 journal 2024-09-14T11:39:02.130 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 0 ms 2024-09-14T11:39:02.130 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 mon 2024-09-14T11:39:02.130 INFO:tasks.workunit.client.0.smithi138.stderr: 0/10 monc 2024-09-14T11:39:02.130 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 paxos 2024-09-14T11:39:02.130 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 tp 2024-09-14T11:39:02.130 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 auth 2024-09-14T11:39:02.130 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 crypto 2024-09-14T11:39:02.130 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 1 finisher 2024-09-14T11:39:02.130 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 1 reserver 2024-09-14T11:39:02.130 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 heartbeatmap 2024-09-14T11:39:02.130 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 perfcounter 2024-09-14T11:39:02.130 INFO:tasks.workunit.client.0.smithi138.stderr: 20/20 rgw 2024-09-14T11:39:02.130 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 rgw_sync 2024-09-14T11:39:02.131 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 rgw_datacache 2024-09-14T11:39:02.131 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 rgw_access 2024-09-14T11:39:02.131 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 rgw_dbstore 2024-09-14T11:39:02.131 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 rgw_flight 2024-09-14T11:39:02.131 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 rgw_lifecycle 2024-09-14T11:39:02.131 INFO:tasks.workunit.client.0.smithi138.stderr: 20/20 rgw_notification 2024-09-14T11:39:02.131 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 javaclient 2024-09-14T11:39:02.131 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 asok 2024-09-14T11:39:02.131 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 1 throttle 2024-09-14T11:39:02.131 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 0 refs 2024-09-14T11:39:02.131 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 compressor 2024-09-14T11:39:02.131 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 bluestore 2024-09-14T11:39:02.131 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 bluefs 2024-09-14T11:39:02.131 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 3 bdev 2024-09-14T11:39:02.132 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 kstore 2024-09-14T11:39:02.132 INFO:tasks.workunit.client.0.smithi138.stderr: 4/ 5 rocksdb 2024-09-14T11:39:02.132 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 fuse 2024-09-14T11:39:02.132 INFO:tasks.workunit.client.0.smithi138.stderr: 2/ 5 mgr 2024-09-14T11:39:02.132 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 mgrc 2024-09-14T11:39:02.132 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 dpdk 2024-09-14T11:39:02.132 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 eventtrace 2024-09-14T11:39:02.132 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 prioritycache 2024-09-14T11:39:02.132 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 test 2024-09-14T11:39:02.132 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 cephfs_mirror 2024-09-14T11:39:02.132 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 cephsqlite 2024-09-14T11:39:02.132 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 crimson_interrupt 2024-09-14T11:39:02.132 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 seastore 2024-09-14T11:39:02.132 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 seastore_onode 2024-09-14T11:39:02.133 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 seastore_odata 2024-09-14T11:39:02.133 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 seastore_omap 2024-09-14T11:39:02.133 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 seastore_tm 2024-09-14T11:39:02.133 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 seastore_t 2024-09-14T11:39:02.133 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 seastore_cleaner 2024-09-14T11:39:02.133 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 seastore_epm 2024-09-14T11:39:02.133 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 seastore_lba 2024-09-14T11:39:02.133 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 seastore_fixedkv_tree 2024-09-14T11:39:02.133 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 seastore_cache 2024-09-14T11:39:02.133 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 seastore_journal 2024-09-14T11:39:02.133 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 seastore_device 2024-09-14T11:39:02.133 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 seastore_backref 2024-09-14T11:39:02.133 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 alienstore 2024-09-14T11:39:02.133 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 mclock 2024-09-14T11:39:02.133 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 cyanstore 2024-09-14T11:39:02.133 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 ceph_exporter 2024-09-14T11:39:02.134 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 memstore 2024-09-14T11:39:02.134 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 trace 2024-09-14T11:39:02.134 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 ceph_dedup 2024-09-14T11:39:02.134 INFO:tasks.workunit.client.0.smithi138.stderr: -2/-2 (syslog threshold) 2024-09-14T11:39:02.134 INFO:tasks.workunit.client.0.smithi138.stderr: 99/99 (stderr threshold) 2024-09-14T11:39:02.134 INFO:tasks.workunit.client.0.smithi138.stderr:--- pthread ID / name mapping for recent threads --- 2024-09-14T11:39:02.134 INFO:tasks.workunit.client.0.smithi138.stderr: 7fcff7fff640 / http_manager 2024-09-14T11:39:02.134 INFO:tasks.workunit.client.0.smithi138.stderr: 7fd0867e4640 / http_manager 2024-09-14T11:39:02.134 INFO:tasks.workunit.client.0.smithi138.stderr: 7fd0877e6640 / rgw_dt_lg_renew 2024-09-14T11:39:02.134 INFO:tasks.workunit.client.0.smithi138.stderr: 7fd0a2ffd640 / ms_dispatch 2024-09-14T11:39:02.134 INFO:tasks.workunit.client.0.smithi138.stderr: 7fd0a3fff640 / io_context_pool 2024-09-14T11:39:02.134 INFO:tasks.workunit.client.0.smithi138.stderr: 7fd0b4ff9640 / io_context_pool 2024-09-14T11:39:02.134 INFO:tasks.workunit.client.0.smithi138.stderr: 7fd0b6ffd640 / ms_dispatch 2024-09-14T11:39:02.134 INFO:tasks.workunit.client.0.smithi138.stderr: 7fd0bde03640 / ms_dispatch 2024-09-14T11:39:02.134 INFO:tasks.workunit.client.0.smithi138.stderr: 7fd0bf606640 / io_context_pool 2024-09-14T11:39:02.135 INFO:tasks.workunit.client.0.smithi138.stderr: 7fd1d0ad1640 / msgr-worker-2 2024-09-14T11:39:02.135 INFO:tasks.workunit.client.0.smithi138.stderr: 7fd1d12d2640 / msgr-worker-1 2024-09-14T11:39:02.135 INFO:tasks.workunit.client.0.smithi138.stderr: 7fd1d1ad3640 / msgr-worker-0 2024-09-14T11:39:02.135 INFO:tasks.workunit.client.0.smithi138.stderr: 7fd1d22d4640 / io_context_pool 2024-09-14T11:39:02.135 INFO:tasks.workunit.client.0.smithi138.stderr: 7fd1d37cc9c0 / radosgw-admin 2024-09-14T11:39:02.135 INFO:tasks.workunit.client.0.smithi138.stderr: max_recent 500 2024-09-14T11:39:02.135 INFO:tasks.workunit.client.0.smithi138.stderr: max_new 1000 2024-09-14T11:39:02.135 INFO:tasks.workunit.client.0.smithi138.stderr: log_file /var/lib/ceph/crash/2024-09-14T11:39:02.015674Z_036277c2-a9a4-4b86-a01c-62c6deb1da0f/log 2024-09-14T11:39:02.135 INFO:tasks.workunit.client.0.smithi138.stderr:--- end dump of recent events --- 2024-09-14T11:39:02.135 INFO:tasks.workunit.client.0.smithi138.stderr:Aborted 2024-09-14T11:39:02.135 INFO:tasks.workunit.client.0.smithi138.stderr:radosgw-admin bucket stats --bucket abort-at-change-reshard-state 2024-09-14T11:39:02.136 INFO:tasks.workunit.client.0.smithi138.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:39:02.136 INFO:tasks.workunit.client.0.smithi138.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:39:02.137 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:39:02.093+0000 7fda3fe379c0 20 rados->read ofs=0 len=0 2024-09-14T11:39:02.137 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:39:02.097+0000 7fda3fe379c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:39:02.137 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:39:02.097+0000 7fda3fe379c0 20 realm 2024-09-14T11:39:02.137 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:39:02.097+0000 7fda3fe379c0 20 rados->read ofs=0 len=0 2024-09-14T11:39:02.137 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:39:02.097+0000 7fda3fe379c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:39:02.137 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:39:02.097+0000 7fda3fe379c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:39:02.137 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:39:02.097+0000 7fda3fe379c0 20 rados->read ofs=0 len=0 2024-09-14T11:39:02.137 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:39:02.097+0000 7fda3fe379c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:39:02.137 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:39:02.097+0000 7fda3fe379c0 20 rados->read ofs=0 len=0 2024-09-14T11:39:02.137 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:39:02.097+0000 7fda3fe379c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:39:02.137 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:39:02.097+0000 7fda3fe379c0 20 rados->read ofs=0 len=0 2024-09-14T11:39:02.137 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:39:02.097+0000 7fda3fe379c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:39:02.137 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:39:02.097+0000 7fda3fe379c0 20 searching for the correct realm 2024-09-14T11:39:02.137 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:39:02.101+0000 7fda3e13e640 0 -- 172.21.15.138:0/963451190 >> [v2:172.21.15.154:6824/416768175,v1:172.21.15.154:6825/416768175] conn(0x7fda3802f040 msgr2=0x7fda3802f420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:39:02.316 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:39:02.317+0000 7fda3d13c640 0 -- 172.21.15.138:0/963451190 >> [v2:172.21.15.138:6816/326481658,v1:172.21.15.138:6817/326481658] conn(0x7fda3802fc20 msgr2=0x7fda38056900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-14T11:39:02.534 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:39:02.533+0000 7fda3fe379c0 20 RGWRados::pool_iterate: got zone_info.d9e72d30-c60b-4d0d-9267-fdc36392d5ad 2024-09-14T11:39:02.534 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:39:02.533+0000 7fda3fe379c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:39:02.534 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:39:02.533+0000 7fda3fe379c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:39:02.534 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:39:02.533+0000 7fda3fe379c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:39:02.534 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:39:02.533+0000 7fda3fe379c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:39:02.535 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:39:02.533+0000 7fda3fe379c0 20 RGWRados::pool_iterate: got zonegroup_info.65ab941b-da8c-4160-94fb-3672b069d44f 2024-09-14T11:39:02.535 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:39:02.533+0000 7fda3fe379c0 20 rados->read ofs=0 len=0 2024-09-14T11:39:02.535 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:39:02.533+0000 7fda3fe379c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:39:02.535 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:39:02.533+0000 7fda3fe379c0 20 rados->read ofs=0 len=0 2024-09-14T11:39:02.536 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:39:02.537+0000 7fda3fe379c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:39:02.536 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:39:02.537+0000 7fda3fe379c0 20 rados->read ofs=0 len=0 2024-09-14T11:39:02.536 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:39:02.537+0000 7fda3fe379c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:39:02.537 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:39:02.537+0000 7fda3fe379c0 20 zone default found 2024-09-14T11:39:02.537 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:39:02.537+0000 7fda3fe379c0 4 Realm: () 2024-09-14T11:39:02.537 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:39:02.537+0000 7fda3fe379c0 4 ZoneGroup: default (65ab941b-da8c-4160-94fb-3672b069d44f) 2024-09-14T11:39:02.537 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:39:02.537+0000 7fda3fe379c0 4 Zone: default (d9e72d30-c60b-4d0d-9267-fdc36392d5ad) 2024-09-14T11:39:02.537 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:39:02.537+0000 7fda3fe379c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:39:02.537 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:39:02.537+0000 7fda3fe379c0 20 zonegroup default 2024-09-14T11:39:02.537 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:39:02.537+0000 7fda3fe379c0 20 rados->read ofs=0 len=0 2024-09-14T11:39:02.537 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:39:02.537+0000 7fda3fe379c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:39:02.538 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:39:02.537+0000 7fda3fe379c0 20 rados->read ofs=0 len=0 2024-09-14T11:39:02.538 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:39:02.537+0000 7fda3fe379c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:39:02.538 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:39:02.537+0000 7fda3fe379c0 20 rados->read ofs=0 len=0 2024-09-14T11:39:02.538 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:39:02.537+0000 7fda3fe379c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:39:02.538 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:39:02.537+0000 7fda3fe379c0 20 started sync module instance, tier type = 2024-09-14T11:39:02.539 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:39:02.537+0000 7fda3fe379c0 20 started zone id=d9e72d30-c60b-4d0d-9267-fdc36392d5ad (name=default) with tier type = 2024-09-14T11:39:02.561 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:39:02.561+0000 7fda3fe379c0 20 add_watcher() i=0 2024-09-14T11:39:02.561 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:39:02.561+0000 7fda3fe379c0 20 add_watcher() i=1 2024-09-14T11:39:02.562 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:39:02.561+0000 7fda3fe379c0 20 add_watcher() i=2 2024-09-14T11:39:02.562 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:39:02.561+0000 7fda3fe379c0 20 add_watcher() i=3 2024-09-14T11:39:02.562 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:39:02.561+0000 7fda3fe379c0 20 add_watcher() i=4 2024-09-14T11:39:02.562 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:39:02.561+0000 7fda3fe379c0 20 add_watcher() i=5 2024-09-14T11:39:02.562 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:39:02.561+0000 7fda3fe379c0 20 add_watcher() i=6 2024-09-14T11:39:02.564 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:39:02.565+0000 7fda3fe379c0 20 add_watcher() i=7 2024-09-14T11:39:02.564 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:39:02.565+0000 7fda3fe379c0 2 all 8 watchers are set, enabling cache 2024-09-14T11:39:02.567 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:39:02.565+0000 7fd8ef7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:39:02.567 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:39:02.565+0000 7fda3fe379c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:39:02.567 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:39:02.565+0000 7fda3fe379c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:39:02.567 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:39:02.565+0000 7fda3fe379c0 5 note: GC not initialized 2024-09-14T11:39:02.568 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:39:02.569+0000 7fd8ee7fc640 20 reqs_thread_entry: start 2024-09-14T11:39:02.568 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:39:02.569+0000 7fda3fe379c0 20 init_complete bucket index max shards: 11 2024-09-14T11:39:02.568 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:39:02.569+0000 7fda3fe379c0 20 Filter name: none 2024-09-14T11:39:02.568 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:39:02.569+0000 7fd85ffff640 20 reqs_thread_entry: start 2024-09-14T11:39:02.568 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:39:02.569+0000 7fda3fe379c0 20 rados->read ofs=0 len=0 2024-09-14T11:39:02.569 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:39:02.569+0000 7fda3fe379c0 20 rados_obj.operate() r=0 bl.length=197 2024-09-14T11:39:02.569 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:39:02.569+0000 7fda3fe379c0 20 rados->read ofs=0 len=0 2024-09-14T11:39:02.570 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:39:02.569+0000 7fda3fe379c0 20 rados_obj.operate() r=0 bl.length=451 2024-09-14T11:39:02.570 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:39:02.569+0000 7fda3fe379c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:39:02.570 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:39:02.569+0000 7fda3fe379c0 20 rados->read ofs=0 len=0 2024-09-14T11:39:02.570 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:39:02.569+0000 7fda3fe379c0 20 rados_obj.operate() r=0 bl.length=197 2024-09-14T11:39:02.571 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:39:02.569+0000 7fda3fe379c0 20 rados->read ofs=0 len=0 2024-09-14T11:39:02.571 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:39:02.569+0000 7fda3fe379c0 20 rados_obj.operate() r=0 bl.length=451 2024-09-14T11:39:02.571 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:39:02.569+0000 7fda3fe379c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:39:02.574 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:39:02.573+0000 7fd8ef7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:39:02.579 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:39:02.577+0000 7fda3fe379c0 20 remove_watcher() i=0 2024-09-14T11:39:02.579 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:39:02.577+0000 7fda3fe379c0 2 removed watcher, disabling cache 2024-09-14T11:39:02.582 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:39:02.581+0000 7fda3fe379c0 20 remove_watcher() i=1 2024-09-14T11:39:02.584 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:39:02.585+0000 7fda3fe379c0 20 remove_watcher() i=2 2024-09-14T11:39:02.586 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:39:02.585+0000 7fda3fe379c0 20 remove_watcher() i=3 2024-09-14T11:39:02.588 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:39:02.589+0000 7fda3fe379c0 20 remove_watcher() i=4 2024-09-14T11:39:02.590 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:39:02.589+0000 7fda3fe379c0 20 remove_watcher() i=5 2024-09-14T11:39:02.591 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:39:02.589+0000 7fda3fe379c0 20 remove_watcher() i=6 2024-09-14T11:39:02.593 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:39:02.593+0000 7fda3fe379c0 20 remove_watcher() i=7 2024-09-14T11:39:02.608 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-14T11:39:02.608 INFO:tasks.workunit.client.0.smithi138.stderr:BUCKET_STATS: 2024-09-14T11:39:02.608 INFO:tasks.workunit.client.0.smithi138.stderr:bucket: abort-at-change-reshard-state id: d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.39 num_objects: 20 size_kb: 1 num_shards: 11 2024-09-14T11:39:02.608 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-14T11:39:02.609 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:39:02.609 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-14T11:39:02.646 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:39:02.646 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-14T11:39:02.705 INFO:tasks.workunit.client.0.smithi138.stderr:radosgw-admin bucket reshard --bucket abort-at-change-reshard-state --num-shards 12 --rgw-reshard-bucket-lock-duration 30 2024-09-14T11:39:02.742 INFO:tasks.workunit.client.0.smithi138.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:39:02.742 INFO:tasks.workunit.client.0.smithi138.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:39:02.786 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:39:02.785+0000 7fdd3e9579c0 20 rados->read ofs=0 len=0 2024-09-14T11:39:02.788 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:39:02.785+0000 7fdd3e9579c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:39:02.788 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:39:02.785+0000 7fdd3e9579c0 20 realm 2024-09-14T11:39:02.788 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:39:02.785+0000 7fdd3e9579c0 20 rados->read ofs=0 len=0 2024-09-14T11:39:02.788 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:39:02.785+0000 7fdd3e9579c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:39:02.788 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:39:02.785+0000 7fdd3e9579c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:39:02.788 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:39:02.785+0000 7fdd3e9579c0 20 rados->read ofs=0 len=0 2024-09-14T11:39:02.788 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:39:02.789+0000 7fdd3e9579c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:39:02.788 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:39:02.789+0000 7fdd3e9579c0 20 rados->read ofs=0 len=0 2024-09-14T11:39:02.789 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:39:02.789+0000 7fdd3e9579c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:39:02.789 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:39:02.789+0000 7fdd3e9579c0 20 rados->read ofs=0 len=0 2024-09-14T11:39:02.790 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:39:02.789+0000 7fdd3e9579c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:39:02.790 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:39:02.789+0000 7fdd3e9579c0 20 searching for the correct realm 2024-09-14T11:39:02.795 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:39:02.793+0000 7fdd3c45d640 0 -- 172.21.15.138:0/2035569292 >> [v2:172.21.15.138:6808/3258321916,v1:172.21.15.138:6809/3258321916] conn(0x55df58bd37e0 msgr2=0x55df58bd5ca0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:39:02.801 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:39:02.801+0000 7fdd3bc5c640 0 -- 172.21.15.138:0/2035569292 >> [v2:172.21.15.138:6816/326481658,v1:172.21.15.138:6817/326481658] conn(0x7fdd34073be0 msgr2=0x7fdd34071240 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:39:02.809 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:39:02.809+0000 7fdd3e9579c0 20 RGWRados::pool_iterate: got zone_info.d9e72d30-c60b-4d0d-9267-fdc36392d5ad 2024-09-14T11:39:02.809 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:39:02.809+0000 7fdd3e9579c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:39:02.809 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:39:02.809+0000 7fdd3e9579c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:39:02.809 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:39:02.809+0000 7fdd3e9579c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:39:02.809 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:39:02.809+0000 7fdd3e9579c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:39:02.810 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:39:02.809+0000 7fdd3e9579c0 20 RGWRados::pool_iterate: got zonegroup_info.65ab941b-da8c-4160-94fb-3672b069d44f 2024-09-14T11:39:02.810 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:39:02.809+0000 7fdd3e9579c0 20 rados->read ofs=0 len=0 2024-09-14T11:39:02.810 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:39:02.809+0000 7fdd3e9579c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:39:02.810 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:39:02.809+0000 7fdd3e9579c0 20 rados->read ofs=0 len=0 2024-09-14T11:39:02.810 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:39:02.809+0000 7fdd3e9579c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:39:02.810 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:39:02.809+0000 7fdd3e9579c0 20 rados->read ofs=0 len=0 2024-09-14T11:39:02.811 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:39:02.809+0000 7fdd3e9579c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:39:02.811 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:39:02.809+0000 7fdd3e9579c0 20 zone default found 2024-09-14T11:39:02.811 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:39:02.809+0000 7fdd3e9579c0 4 Realm: () 2024-09-14T11:39:02.812 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:39:02.809+0000 7fdd3e9579c0 4 ZoneGroup: default (65ab941b-da8c-4160-94fb-3672b069d44f) 2024-09-14T11:39:02.812 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:39:02.809+0000 7fdd3e9579c0 4 Zone: default (d9e72d30-c60b-4d0d-9267-fdc36392d5ad) 2024-09-14T11:39:02.812 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:39:02.809+0000 7fdd3e9579c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:39:02.812 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:39:02.809+0000 7fdd3e9579c0 20 zonegroup default 2024-09-14T11:39:02.812 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:39:02.809+0000 7fdd3e9579c0 20 rados->read ofs=0 len=0 2024-09-14T11:39:02.812 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:39:02.809+0000 7fdd3e9579c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:39:02.812 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:39:02.809+0000 7fdd3e9579c0 20 rados->read ofs=0 len=0 2024-09-14T11:39:02.812 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:39:02.813+0000 7fdd3e9579c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:39:02.812 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:39:02.813+0000 7fdd3e9579c0 20 rados->read ofs=0 len=0 2024-09-14T11:39:02.813 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:39:02.813+0000 7fdd3e9579c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:39:02.813 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:39:02.813+0000 7fdd3e9579c0 20 started sync module instance, tier type = 2024-09-14T11:39:02.813 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:39:02.813+0000 7fdd3e9579c0 20 started zone id=d9e72d30-c60b-4d0d-9267-fdc36392d5ad (name=default) with tier type = 2024-09-14T11:39:02.829 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:39:02.829+0000 7fdd3e9579c0 20 add_watcher() i=0 2024-09-14T11:39:02.829 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:39:02.829+0000 7fdd3e9579c0 20 add_watcher() i=1 2024-09-14T11:39:02.829 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:39:02.829+0000 7fdd3e9579c0 20 add_watcher() i=2 2024-09-14T11:39:02.829 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:39:02.829+0000 7fdd3e9579c0 20 add_watcher() i=3 2024-09-14T11:39:02.829 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:39:02.829+0000 7fdd3e9579c0 20 add_watcher() i=4 2024-09-14T11:39:02.829 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:39:02.829+0000 7fdd3e9579c0 20 add_watcher() i=5 2024-09-14T11:39:02.829 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:39:02.829+0000 7fdd3e9579c0 20 add_watcher() i=6 2024-09-14T11:39:02.830 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:39:02.829+0000 7fdd3e9579c0 20 add_watcher() i=7 2024-09-14T11:39:02.830 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:39:02.829+0000 7fdd3e9579c0 2 all 8 watchers are set, enabling cache 2024-09-14T11:39:02.832 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:39:02.833+0000 7fdbf27e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:39:02.833 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:39:02.833+0000 7fdd3e9579c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:39:02.833 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:39:02.833+0000 7fdd3e9579c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:39:02.834 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:39:02.833+0000 7fdd3e9579c0 5 note: GC not initialized 2024-09-14T11:39:02.834 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:39:02.833+0000 7fdbf17e2640 20 reqs_thread_entry: start 2024-09-14T11:39:02.834 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:39:02.833+0000 7fdd3e9579c0 20 init_complete bucket index max shards: 11 2024-09-14T11:39:02.834 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:39:02.833+0000 7fdd3e9579c0 20 Filter name: none 2024-09-14T11:39:02.834 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:39:02.833+0000 7fdb62ffd640 20 reqs_thread_entry: start 2024-09-14T11:39:02.834 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:39:02.833+0000 7fdd3e9579c0 10 cache get: name=default.rgw.meta+root+abort-at-change-reshard-state : miss 2024-09-14T11:39:02.834 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:39:02.833+0000 7fdd3e9579c0 20 rados->read ofs=0 len=0 2024-09-14T11:39:02.834 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:39:02.833+0000 7fdd3e9579c0 20 rados_obj.operate() r=0 bl.length=197 2024-09-14T11:39:02.835 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:39:02.833+0000 7fdd3e9579c0 10 cache put: name=default.rgw.meta+root+abort-at-change-reshard-state info.flags=0x11 2024-09-14T11:39:02.835 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:39:02.833+0000 7fdd3e9579c0 10 adding default.rgw.meta+root+abort-at-change-reshard-state to cache LRU end 2024-09-14T11:39:02.835 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:39:02.833+0000 7fdd3e9579c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.39 : miss 2024-09-14T11:39:02.835 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:39:02.833+0000 7fdd3e9579c0 20 rados->read ofs=0 len=0 2024-09-14T11:39:02.835 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:39:02.833+0000 7fdd3e9579c0 20 rados_obj.operate() r=0 bl.length=451 2024-09-14T11:39:02.835 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:39:02.833+0000 7fdd3e9579c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.39 info.flags=0x17 2024-09-14T11:39:02.836 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:39:02.833+0000 7fdd3e9579c0 10 adding default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.39 to cache LRU end 2024-09-14T11:39:02.836 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:39:02.833+0000 7fdd3e9579c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:39:02.836 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:39:02.833+0000 7fdd3e9579c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:39:02.836 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:39:02.833+0000 7fdd3e9579c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.39 2024-09-14T11:39:02.838 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:39:02.837+0000 7fdd3e9579c0 0 INFO: RGWReshardLock::lock found lock on abort-at-change-reshard-state:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.39 to be held by another RGW process; skipping for now 2024-09-14T11:39:02.839 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:39:02.837+0000 7fdbf27e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:39:02.843 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:39:02.841+0000 7fdd3e9579c0 20 remove_watcher() i=0 2024-09-14T11:39:02.843 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:39:02.841+0000 7fdd3e9579c0 2 removed watcher, disabling cache 2024-09-14T11:39:02.845 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:39:02.845+0000 7fdd3e9579c0 20 remove_watcher() i=1 2024-09-14T11:39:02.847 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:39:02.845+0000 7fdd3e9579c0 20 remove_watcher() i=2 2024-09-14T11:39:02.850 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:39:02.849+0000 7fdd3e9579c0 20 remove_watcher() i=3 2024-09-14T11:39:02.852 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:39:02.853+0000 7fdd3e9579c0 20 remove_watcher() i=4 2024-09-14T11:39:02.854 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:39:02.853+0000 7fdd3e9579c0 20 remove_watcher() i=5 2024-09-14T11:39:02.855 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:39:02.853+0000 7fdd3e9579c0 20 remove_watcher() i=6 2024-09-14T11:39:02.856 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:39:02.857+0000 7fdd3e9579c0 20 remove_watcher() i=7 2024-09-14T11:39:02.869 INFO:tasks.workunit.client.0.smithi138.stderr:waiting 30 seconds for reshard lock to expire... 2024-09-14T11:39:32.898 INFO:tasks.workunit.client.0.smithi138.stderr:radosgw-admin bucket reshard --bucket abort-at-change-reshard-state --num-shards 12 --rgw-reshard-bucket-lock-duration 30 2024-09-14T11:39:32.933 INFO:tasks.workunit.client.0.smithi138.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:39:32.933 INFO:tasks.workunit.client.0.smithi138.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:39:32.979 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:39:32.977+0000 7f4949aa69c0 20 rados->read ofs=0 len=0 2024-09-14T11:39:32.980 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:39:32.981+0000 7f4949aa69c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:39:32.980 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:39:32.981+0000 7f4949aa69c0 20 realm 2024-09-14T11:39:32.980 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:39:32.981+0000 7f4949aa69c0 20 rados->read ofs=0 len=0 2024-09-14T11:39:32.980 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:39:32.981+0000 7f4949aa69c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:39:32.980 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:39:32.981+0000 7f4949aa69c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:39:32.981 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:39:32.981+0000 7f4949aa69c0 20 rados->read ofs=0 len=0 2024-09-14T11:39:32.981 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:39:32.981+0000 7f4949aa69c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:39:32.981 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:39:32.981+0000 7f4949aa69c0 20 rados->read ofs=0 len=0 2024-09-14T11:39:32.982 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:39:32.981+0000 7f4949aa69c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:39:32.982 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:39:32.981+0000 7f4949aa69c0 20 rados->read ofs=0 len=0 2024-09-14T11:39:32.983 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:39:32.981+0000 7f4949aa69c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:39:32.983 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:39:32.981+0000 7f4949aa69c0 20 searching for the correct realm 2024-09-14T11:39:32.987 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:39:32.985+0000 7f4947dad640 0 -- 172.21.15.138:0/859786818 >> [v2:172.21.15.154:6824/416768175,v1:172.21.15.154:6825/416768175] conn(0x7f4940131040 msgr2=0x7f4940117780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:39:33.201 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:39:33.201+0000 7f4946dab640 0 -- 172.21.15.138:0/859786818 >> [v2:172.21.15.138:6816/326481658,v1:172.21.15.138:6817/326481658] conn(0x7f494011ea10 msgr2=0x7f494012c8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-14T11:39:33.418 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:39:33.417+0000 7f4949aa69c0 20 RGWRados::pool_iterate: got zone_info.d9e72d30-c60b-4d0d-9267-fdc36392d5ad 2024-09-14T11:39:33.419 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:39:33.417+0000 7f4949aa69c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:39:33.419 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:39:33.417+0000 7f4949aa69c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:39:33.419 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:39:33.417+0000 7f4949aa69c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:39:33.419 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:39:33.417+0000 7f4949aa69c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:39:33.419 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:39:33.417+0000 7f4949aa69c0 20 RGWRados::pool_iterate: got zonegroup_info.65ab941b-da8c-4160-94fb-3672b069d44f 2024-09-14T11:39:33.419 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:39:33.417+0000 7f4949aa69c0 20 rados->read ofs=0 len=0 2024-09-14T11:39:33.419 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:39:33.417+0000 7f4949aa69c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:39:33.419 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:39:33.417+0000 7f4949aa69c0 20 rados->read ofs=0 len=0 2024-09-14T11:39:33.420 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:39:33.421+0000 7f4949aa69c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:39:33.420 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:39:33.421+0000 7f4949aa69c0 20 rados->read ofs=0 len=0 2024-09-14T11:39:33.421 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:39:33.421+0000 7f4949aa69c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:39:33.421 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:39:33.421+0000 7f4949aa69c0 20 zone default found 2024-09-14T11:39:33.421 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:39:33.421+0000 7f4949aa69c0 4 Realm: () 2024-09-14T11:39:33.421 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:39:33.421+0000 7f4949aa69c0 4 ZoneGroup: default (65ab941b-da8c-4160-94fb-3672b069d44f) 2024-09-14T11:39:33.421 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:39:33.421+0000 7f4949aa69c0 4 Zone: default (d9e72d30-c60b-4d0d-9267-fdc36392d5ad) 2024-09-14T11:39:33.422 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:39:33.421+0000 7f4949aa69c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:39:33.422 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:39:33.421+0000 7f4949aa69c0 20 zonegroup default 2024-09-14T11:39:33.422 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:39:33.421+0000 7f4949aa69c0 20 rados->read ofs=0 len=0 2024-09-14T11:39:33.422 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:39:33.421+0000 7f4949aa69c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:39:33.422 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:39:33.421+0000 7f4949aa69c0 20 rados->read ofs=0 len=0 2024-09-14T11:39:33.423 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:39:33.421+0000 7f4949aa69c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:39:33.423 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:39:33.421+0000 7f4949aa69c0 20 rados->read ofs=0 len=0 2024-09-14T11:39:33.423 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:39:33.421+0000 7f4949aa69c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:39:33.423 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:39:33.421+0000 7f4949aa69c0 20 started sync module instance, tier type = 2024-09-14T11:39:33.423 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:39:33.421+0000 7f4949aa69c0 20 started zone id=d9e72d30-c60b-4d0d-9267-fdc36392d5ad (name=default) with tier type = 2024-09-14T11:39:33.447 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:39:33.445+0000 7f4949aa69c0 20 add_watcher() i=0 2024-09-14T11:39:33.448 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:39:33.445+0000 7f4949aa69c0 20 add_watcher() i=1 2024-09-14T11:39:33.448 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:39:33.445+0000 7f4949aa69c0 20 add_watcher() i=2 2024-09-14T11:39:33.448 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:39:33.445+0000 7f4949aa69c0 20 add_watcher() i=3 2024-09-14T11:39:33.448 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:39:33.445+0000 7f4949aa69c0 20 add_watcher() i=4 2024-09-14T11:39:33.448 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:39:33.445+0000 7f4949aa69c0 20 add_watcher() i=5 2024-09-14T11:39:33.448 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:39:33.445+0000 7f4949aa69c0 20 add_watcher() i=6 2024-09-14T11:39:33.450 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:39:33.449+0000 7f4949aa69c0 20 add_watcher() i=7 2024-09-14T11:39:33.450 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:39:33.449+0000 7f4949aa69c0 2 all 8 watchers are set, enabling cache 2024-09-14T11:39:33.454 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:39:33.453+0000 7f47fdfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:39:33.455 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:39:33.453+0000 7f4949aa69c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:39:33.455 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:39:33.453+0000 7f4949aa69c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:39:33.455 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:39:33.453+0000 7f4949aa69c0 5 note: GC not initialized 2024-09-14T11:39:33.455 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:39:33.453+0000 7f47fcfe1640 20 reqs_thread_entry: start 2024-09-14T11:39:33.456 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:39:33.453+0000 7f4949aa69c0 20 init_complete bucket index max shards: 11 2024-09-14T11:39:33.456 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:39:33.457+0000 7f4949aa69c0 20 Filter name: none 2024-09-14T11:39:33.456 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:39:33.457+0000 7f47767fc640 20 reqs_thread_entry: start 2024-09-14T11:39:33.456 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:39:33.457+0000 7f4949aa69c0 10 cache get: name=default.rgw.meta+root+abort-at-change-reshard-state : miss 2024-09-14T11:39:33.456 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:39:33.457+0000 7f4949aa69c0 20 rados->read ofs=0 len=0 2024-09-14T11:39:33.457 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:39:33.457+0000 7f4949aa69c0 20 rados_obj.operate() r=0 bl.length=197 2024-09-14T11:39:33.457 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:39:33.457+0000 7f4949aa69c0 10 cache put: name=default.rgw.meta+root+abort-at-change-reshard-state info.flags=0x11 2024-09-14T11:39:33.457 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:39:33.457+0000 7f4949aa69c0 10 adding default.rgw.meta+root+abort-at-change-reshard-state to cache LRU end 2024-09-14T11:39:33.457 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:39:33.457+0000 7f4949aa69c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.39 : miss 2024-09-14T11:39:33.457 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:39:33.457+0000 7f4949aa69c0 20 rados->read ofs=0 len=0 2024-09-14T11:39:33.458 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:39:33.457+0000 7f4949aa69c0 20 rados_obj.operate() r=0 bl.length=451 2024-09-14T11:39:33.458 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:39:33.457+0000 7f4949aa69c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.39 info.flags=0x17 2024-09-14T11:39:33.458 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:39:33.457+0000 7f4949aa69c0 10 adding default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.39 to cache LRU end 2024-09-14T11:39:33.458 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:39:33.457+0000 7f4949aa69c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:39:33.458 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:39:33.457+0000 7f4949aa69c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:39:33.458 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:39:33.457+0000 7f4949aa69c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.39 2024-09-14T11:39:33.460 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:39:33.461+0000 7f4949aa69c0 10 init_target_layout removing existing target index objects from a previous reshard attempt 2024-09-14T11:39:33.476 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:39:33.477+0000 7f4949aa69c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.39 info.flags=0x17 2024-09-14T11:39:33.476 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:39:33.477+0000 7f4949aa69c0 10 moving default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.39 to cache LRU end 2024-09-14T11:39:33.476 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:39:33.477+0000 7f4949aa69c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:39:33.476 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:39:33.477+0000 7f4949aa69c0 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-change-reshard-state:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.39, ofs0, ns] 2024-09-14T11:39:33.477 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:39:33.477+0000 7f482affd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366176 cookie 94484293912112 notifier 7427 bl.length()=931 2024-09-14T11:39:33.477 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:39:33.477+0000 7f482affd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.39 info.flags=0x17 2024-09-14T11:39:33.477 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:39:33.477+0000 7f482affd640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.39 to cache LRU end 2024-09-14T11:39:33.477 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:39:33.477+0000 7f482affd640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:39:33.479 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:39:33.477+0000 7f4949aa69c0 20 handle_bi_update(): bucket=:abort-at-change-reshard-state[d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.39]): orig_sources= new_sources= 2024-09-14T11:39:33.479 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:39:33.477+0000 7f4949aa69c0 20 handle_bi_update(): bucket=:abort-at-change-reshard-state[d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.39]): potential sources added=[] removed=[] 2024-09-14T11:39:33.479 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:39:33.477+0000 7f4949aa69c0 20 handle_bi_update(): bucket=:abort-at-change-reshard-state[d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.39]): orig_dests= new_dests= 2024-09-14T11:39:33.479 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:39:33.477+0000 7f4949aa69c0 20 handle_bi_update(): bucket=:abort-at-change-reshard-state[d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.39]): potential dests added=[] removed=[] 2024-09-14T11:39:33.490 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:39:33.489+0000 7f4949aa69c0 10 bucket_obj is .dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.39.2.0 2024-09-14T11:39:33.491 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:39:33.489+0000 7f4949aa69c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.39.2.0 2024-09-14T11:39:33.491 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:39:33.489+0000 7f4949aa69c0 10 bucket_obj is .dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.39.2.1 2024-09-14T11:39:33.491 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:39:33.489+0000 7f4949aa69c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.39.2.1 2024-09-14T11:39:33.491 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:39:33.489+0000 7f4949aa69c0 10 bucket_obj is .dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.39.2.2 2024-09-14T11:39:33.491 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:39:33.489+0000 7f4949aa69c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.39.2.2 2024-09-14T11:39:33.491 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:39:33.489+0000 7f4949aa69c0 10 bucket_obj is .dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.39.2.3 2024-09-14T11:39:33.491 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:39:33.489+0000 7f4949aa69c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.39.2.3 2024-09-14T11:39:33.491 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:39:33.489+0000 7f4949aa69c0 10 bucket_obj is .dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.39.2.4 2024-09-14T11:39:33.491 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:39:33.489+0000 7f4949aa69c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.39.2.4 2024-09-14T11:39:33.491 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:39:33.489+0000 7f4949aa69c0 10 bucket_obj is .dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.39.2.5 2024-09-14T11:39:33.491 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:39:33.489+0000 7f4949aa69c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.39.2.5 2024-09-14T11:39:33.491 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:39:33.489+0000 7f4949aa69c0 10 bucket_obj is .dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.39.2.6 2024-09-14T11:39:33.492 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:39:33.489+0000 7f4949aa69c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.39.2.6 2024-09-14T11:39:33.492 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:39:33.489+0000 7f4949aa69c0 10 bucket_obj is .dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.39.2.7 2024-09-14T11:39:33.492 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:39:33.489+0000 7f4949aa69c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.39.2.7 2024-09-14T11:39:33.492 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:39:33.489+0000 7f4949aa69c0 10 bucket_obj is .dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.39.2.8 2024-09-14T11:39:33.492 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:39:33.489+0000 7f4949aa69c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.39.2.8 2024-09-14T11:39:33.492 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:39:33.489+0000 7f4949aa69c0 10 bucket_obj is .dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.39.2.9 2024-09-14T11:39:33.492 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:39:33.489+0000 7f4949aa69c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.39.2.9 2024-09-14T11:39:33.492 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:39:33.489+0000 7f4949aa69c0 10 bucket_obj is .dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.39.2.10 2024-09-14T11:39:33.492 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:39:33.489+0000 7f4949aa69c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.39.2.10 2024-09-14T11:39:33.492 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:39:33.489+0000 7f4949aa69c0 10 bucket_obj is .dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.39.2.11 2024-09-14T11:39:33.492 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:39:33.489+0000 7f4949aa69c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.39.2.11 2024-09-14T11:39:33.492 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:39:33.489+0000 7f4949aa69c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.39.0 2024-09-14T11:39:33.493 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:39:33.489+0000 7f4949aa69c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.39.1 2024-09-14T11:39:33.493 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:39:33.493+0000 7f4949aa69c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.39.2 2024-09-14T11:39:33.493 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:39:33.493+0000 7f4949aa69c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.39.3 2024-09-14T11:39:33.494 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:39:33.493+0000 7f4949aa69c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.39.4 2024-09-14T11:39:33.495 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:39:33.493+0000 7f4949aa69c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.39.5 2024-09-14T11:39:33.496 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:39:33.497+0000 7f4949aa69c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.39.6 2024-09-14T11:39:33.497 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:39:33.497+0000 7f4949aa69c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.39.7 2024-09-14T11:39:33.498 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:39:33.497+0000 7f4949aa69c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.39.8 2024-09-14T11:39:33.499 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:39:33.497+0000 7f4949aa69c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.39.9 2024-09-14T11:39:33.500 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:39:33.501+0000 7f4949aa69c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.39.10 2024-09-14T11:39:33.507 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:39:33.505+0000 7f4949aa69c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.39 : hit (requested=0x17, cached=0x17) 2024-09-14T11:39:33.507 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:39:33.505+0000 7f4949aa69c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.39 2024-09-14T11:39:33.511 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:39:33.509+0000 7f4949aa69c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.39 info.flags=0x17 2024-09-14T11:39:33.511 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:39:33.509+0000 7f4949aa69c0 10 moving default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.39 to cache LRU end 2024-09-14T11:39:33.511 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:39:33.509+0000 7f4949aa69c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:39:33.511 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:39:33.509+0000 7f4949aa69c0 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-change-reshard-state:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.39, ofs0, ns] 2024-09-14T11:39:33.512 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:39:33.509+0000 7f482a7fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366177 cookie 94484293912112 notifier 7427 bl.length()=931 2024-09-14T11:39:33.512 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:39:33.509+0000 7f482a7fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.39 info.flags=0x17 2024-09-14T11:39:33.512 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:39:33.509+0000 7f482a7fc640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.39 to cache LRU end 2024-09-14T11:39:33.512 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:39:33.509+0000 7f482a7fc640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:39:33.514 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:39:33.513+0000 7f4949aa69c0 20 handle_bi_update(): bucket=:abort-at-change-reshard-state[d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.39]): orig_sources= new_sources= 2024-09-14T11:39:33.514 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:39:33.513+0000 7f4949aa69c0 20 handle_bi_update(): bucket=:abort-at-change-reshard-state[d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.39]): potential sources added=[] removed=[] 2024-09-14T11:39:33.514 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:39:33.513+0000 7f4949aa69c0 20 handle_bi_update(): bucket=:abort-at-change-reshard-state[d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.39]): orig_dests= new_dests= 2024-09-14T11:39:33.514 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:39:33.513+0000 7f4949aa69c0 20 handle_bi_update(): bucket=:abort-at-change-reshard-state[d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.39]): potential dests added=[] removed=[] 2024-09-14T11:39:33.519 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:39:33.517+0000 7f4949aa69c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.39.0 2024-09-14T11:39:33.519 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:39:33.517+0000 7f4949aa69c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.39.1 2024-09-14T11:39:33.520 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:39:33.521+0000 7f4949aa69c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.39.2 2024-09-14T11:39:33.521 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:39:33.521+0000 7f4949aa69c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.39.3 2024-09-14T11:39:33.522 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:39:33.521+0000 7f4949aa69c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.39.4 2024-09-14T11:39:33.522 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:39:33.521+0000 7f4949aa69c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.39.5 2024-09-14T11:39:33.524 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:39:33.525+0000 7f4949aa69c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.39.6 2024-09-14T11:39:33.525 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:39:33.525+0000 7f4949aa69c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.39.7 2024-09-14T11:39:33.526 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:39:33.525+0000 7f4949aa69c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.39.8 2024-09-14T11:39:33.527 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:39:33.525+0000 7f4949aa69c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.39.9 2024-09-14T11:39:33.527 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:39:33.525+0000 7f4949aa69c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.39.10 2024-09-14T11:39:33.528 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:39:33.529+0000 7f4949aa69c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.39 : hit (requested=0x17, cached=0x17) 2024-09-14T11:39:33.528 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:39:33.529+0000 7f4949aa69c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.39 2024-09-14T11:39:33.532 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:39:33.533+0000 7f4949aa69c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.39 info.flags=0x17 2024-09-14T11:39:33.532 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:39:33.533+0000 7f4949aa69c0 10 moving default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.39 to cache LRU end 2024-09-14T11:39:33.532 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:39:33.533+0000 7f4949aa69c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:39:33.532 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:39:33.533+0000 7f4949aa69c0 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-change-reshard-state:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.39, ofs0, ns] 2024-09-14T11:39:33.532 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:39:33.533+0000 7f482affd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366178 cookie 94484293912112 notifier 7427 bl.length()=899 2024-09-14T11:39:33.532 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:39:33.533+0000 7f482affd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.39 info.flags=0x17 2024-09-14T11:39:33.532 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:39:33.533+0000 7f482affd640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.39 to cache LRU end 2024-09-14T11:39:33.532 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:39:33.533+0000 7f482affd640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:39:33.534 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:39:33.533+0000 7f4949aa69c0 20 handle_bi_update(): bucket=:abort-at-change-reshard-state[d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.39]): orig_sources= new_sources= 2024-09-14T11:39:33.534 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:39:33.533+0000 7f4949aa69c0 20 handle_bi_update(): bucket=:abort-at-change-reshard-state[d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.39]): potential sources added=[] removed=[] 2024-09-14T11:39:33.535 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:39:33.533+0000 7f4949aa69c0 20 handle_bi_update(): bucket=:abort-at-change-reshard-state[d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.39]): orig_dests= new_dests= 2024-09-14T11:39:33.535 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:39:33.533+0000 7f4949aa69c0 20 handle_bi_update(): bucket=:abort-at-change-reshard-state[d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.39]): potential dests added=[] removed=[] 2024-09-14T11:39:33.539 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:39:33.537+0000 7f4949aa69c0 1 execute INFO: reshard of bucket "abort-at-change-reshard-state" from 11 shards to 12 shards completed successfully 2024-09-14T11:39:33.543 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:39:33.541+0000 7f47fdfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:39:33.548 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:39:33.549+0000 7f4949aa69c0 20 remove_watcher() i=0 2024-09-14T11:39:33.548 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:39:33.549+0000 7f4949aa69c0 2 removed watcher, disabling cache 2024-09-14T11:39:33.550 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:39:33.549+0000 7f4949aa69c0 20 remove_watcher() i=1 2024-09-14T11:39:33.553 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:39:33.553+0000 7f4949aa69c0 20 remove_watcher() i=2 2024-09-14T11:39:33.555 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:39:33.557+0000 7f4949aa69c0 20 remove_watcher() i=3 2024-09-14T11:39:33.558 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:39:33.557+0000 7f4949aa69c0 20 remove_watcher() i=4 2024-09-14T11:39:33.560 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:39:33.561+0000 7f4949aa69c0 20 remove_watcher() i=5 2024-09-14T11:39:33.561 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:39:33.561+0000 7f4949aa69c0 20 remove_watcher() i=6 2024-09-14T11:39:33.563 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:39:33.561+0000 7f4949aa69c0 20 remove_watcher() i=7 2024-09-14T11:39:33.580 INFO:tasks.workunit.client.0.smithi138.stderr:radosgw-admin bucket stats --bucket abort-at-change-reshard-state 2024-09-14T11:39:33.610 INFO:tasks.workunit.client.0.smithi138.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:39:33.610 INFO:tasks.workunit.client.0.smithi138.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:39:33.654 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:39:33.653+0000 7f03a96e79c0 20 rados->read ofs=0 len=0 2024-09-14T11:39:33.656 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:39:33.657+0000 7f03a96e79c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:39:33.656 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:39:33.657+0000 7f03a96e79c0 20 realm 2024-09-14T11:39:33.656 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:39:33.657+0000 7f03a96e79c0 20 rados->read ofs=0 len=0 2024-09-14T11:39:33.656 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:39:33.657+0000 7f03a96e79c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:39:33.656 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:39:33.657+0000 7f03a96e79c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:39:33.656 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:39:33.657+0000 7f03a96e79c0 20 rados->read ofs=0 len=0 2024-09-14T11:39:33.657 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:39:33.657+0000 7f03a96e79c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:39:33.657 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:39:33.657+0000 7f03a96e79c0 20 rados->read ofs=0 len=0 2024-09-14T11:39:33.658 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:39:33.657+0000 7f03a96e79c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:39:33.658 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:39:33.657+0000 7f03a96e79c0 20 rados->read ofs=0 len=0 2024-09-14T11:39:33.659 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:39:33.657+0000 7f03a96e79c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:39:33.659 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:39:33.657+0000 7f03a96e79c0 20 searching for the correct realm 2024-09-14T11:39:33.662 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:39:33.661+0000 7f03a79ee640 0 -- 172.21.15.138:0/2573589872 >> [v2:172.21.15.154:6824/416768175,v1:172.21.15.154:6825/416768175] conn(0x7f03980d04b0 msgr2=0x7f03980d0910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-14T11:39:33.877 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:39:33.877+0000 7f03a69ec640 0 -- 172.21.15.138:0/2573589872 >> [v2:172.21.15.138:6816/326481658,v1:172.21.15.138:6817/326481658] conn(0x7f03980b83f0 msgr2=0x7f03980b8850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-14T11:39:34.096 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:39:34.097+0000 7f03a96e79c0 20 RGWRados::pool_iterate: got zone_info.d9e72d30-c60b-4d0d-9267-fdc36392d5ad 2024-09-14T11:39:34.097 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:39:34.097+0000 7f03a96e79c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:39:34.097 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:39:34.097+0000 7f03a96e79c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:39:34.097 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:39:34.097+0000 7f03a96e79c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:39:34.097 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:39:34.097+0000 7f03a96e79c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:39:34.097 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:39:34.097+0000 7f03a96e79c0 20 RGWRados::pool_iterate: got zonegroup_info.65ab941b-da8c-4160-94fb-3672b069d44f 2024-09-14T11:39:34.097 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:39:34.097+0000 7f03a96e79c0 20 rados->read ofs=0 len=0 2024-09-14T11:39:34.097 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:39:34.097+0000 7f03a96e79c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:39:34.098 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:39:34.097+0000 7f03a96e79c0 20 rados->read ofs=0 len=0 2024-09-14T11:39:34.098 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:39:34.097+0000 7f03a96e79c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:39:34.098 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:39:34.097+0000 7f03a96e79c0 20 rados->read ofs=0 len=0 2024-09-14T11:39:34.098 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:39:34.097+0000 7f03a96e79c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:39:34.099 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:39:34.097+0000 7f03a96e79c0 20 zone default found 2024-09-14T11:39:34.099 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:39:34.097+0000 7f03a96e79c0 4 Realm: () 2024-09-14T11:39:34.099 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:39:34.097+0000 7f03a96e79c0 4 ZoneGroup: default (65ab941b-da8c-4160-94fb-3672b069d44f) 2024-09-14T11:39:34.099 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:39:34.097+0000 7f03a96e79c0 4 Zone: default (d9e72d30-c60b-4d0d-9267-fdc36392d5ad) 2024-09-14T11:39:34.099 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:39:34.097+0000 7f03a96e79c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:39:34.099 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:39:34.097+0000 7f03a96e79c0 20 zonegroup default 2024-09-14T11:39:34.099 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:39:34.097+0000 7f03a96e79c0 20 rados->read ofs=0 len=0 2024-09-14T11:39:34.099 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:39:34.097+0000 7f03a96e79c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:39:34.099 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:39:34.097+0000 7f03a96e79c0 20 rados->read ofs=0 len=0 2024-09-14T11:39:34.100 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:39:34.101+0000 7f03a96e79c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:39:34.100 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:39:34.101+0000 7f03a96e79c0 20 rados->read ofs=0 len=0 2024-09-14T11:39:34.101 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:39:34.101+0000 7f03a96e79c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:39:34.101 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:39:34.101+0000 7f03a96e79c0 20 started sync module instance, tier type = 2024-09-14T11:39:34.101 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:39:34.101+0000 7f03a96e79c0 20 started zone id=d9e72d30-c60b-4d0d-9267-fdc36392d5ad (name=default) with tier type = 2024-09-14T11:39:34.125 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:39:34.125+0000 7f03a96e79c0 20 add_watcher() i=0 2024-09-14T11:39:34.125 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:39:34.125+0000 7f03a96e79c0 20 add_watcher() i=1 2024-09-14T11:39:34.125 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:39:34.125+0000 7f03a96e79c0 20 add_watcher() i=2 2024-09-14T11:39:34.125 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:39:34.125+0000 7f03a96e79c0 20 add_watcher() i=3 2024-09-14T11:39:34.125 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:39:34.125+0000 7f03a96e79c0 20 add_watcher() i=4 2024-09-14T11:39:34.125 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:39:34.125+0000 7f03a96e79c0 20 add_watcher() i=5 2024-09-14T11:39:34.126 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:39:34.125+0000 7f03a96e79c0 20 add_watcher() i=6 2024-09-14T11:39:34.128 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:39:34.129+0000 7f03a96e79c0 20 add_watcher() i=7 2024-09-14T11:39:34.128 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:39:34.129+0000 7f03a96e79c0 2 all 8 watchers are set, enabling cache 2024-09-14T11:39:34.132 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:39:34.133+0000 7f025dfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:39:34.132 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:39:34.133+0000 7f03a96e79c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:39:34.133 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:39:34.133+0000 7f03a96e79c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:39:34.133 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:39:34.133+0000 7f03a96e79c0 5 note: GC not initialized 2024-09-14T11:39:34.133 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:39:34.133+0000 7f025cfe1640 20 reqs_thread_entry: start 2024-09-14T11:39:34.133 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:39:34.133+0000 7f03a96e79c0 20 init_complete bucket index max shards: 11 2024-09-14T11:39:34.133 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:39:34.133+0000 7f03a96e79c0 20 Filter name: none 2024-09-14T11:39:34.134 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:39:34.133+0000 7f01d67fc640 20 reqs_thread_entry: start 2024-09-14T11:39:34.134 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:39:34.133+0000 7f03a96e79c0 20 rados->read ofs=0 len=0 2024-09-14T11:39:34.134 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:39:34.133+0000 7f03a96e79c0 20 rados_obj.operate() r=0 bl.length=197 2024-09-14T11:39:34.134 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:39:34.133+0000 7f03a96e79c0 20 rados->read ofs=0 len=0 2024-09-14T11:39:34.136 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:39:34.137+0000 7f03a96e79c0 20 rados_obj.operate() r=0 bl.length=419 2024-09-14T11:39:34.136 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:39:34.137+0000 7f03a96e79c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:39:34.137 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:39:34.137+0000 7f03a96e79c0 20 rados->read ofs=0 len=0 2024-09-14T11:39:34.137 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:39:34.137+0000 7f03a96e79c0 20 rados_obj.operate() r=0 bl.length=197 2024-09-14T11:39:34.137 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:39:34.137+0000 7f03a96e79c0 20 rados->read ofs=0 len=0 2024-09-14T11:39:34.138 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:39:34.137+0000 7f03a96e79c0 20 rados_obj.operate() r=0 bl.length=419 2024-09-14T11:39:34.138 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:39:34.137+0000 7f03a96e79c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:39:34.142 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:39:34.141+0000 7f025dfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:39:34.146 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:39:34.145+0000 7f03a96e79c0 20 remove_watcher() i=0 2024-09-14T11:39:34.146 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:39:34.145+0000 7f03a96e79c0 2 removed watcher, disabling cache 2024-09-14T11:39:34.149 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:39:34.149+0000 7f03a96e79c0 20 remove_watcher() i=1 2024-09-14T11:39:34.151 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:39:34.149+0000 7f03a96e79c0 20 remove_watcher() i=2 2024-09-14T11:39:34.153 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:39:34.153+0000 7f03a96e79c0 20 remove_watcher() i=3 2024-09-14T11:39:34.155 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:39:34.153+0000 7f03a96e79c0 20 remove_watcher() i=4 2024-09-14T11:39:34.157 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:39:34.157+0000 7f03a96e79c0 20 remove_watcher() i=5 2024-09-14T11:39:34.158 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:39:34.157+0000 7f03a96e79c0 20 remove_watcher() i=6 2024-09-14T11:39:34.160 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:39:34.161+0000 7f03a96e79c0 20 remove_watcher() i=7 2024-09-14T11:39:34.177 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-14T11:39:34.177 INFO:tasks.workunit.client.0.smithi138.stderr:BUCKET_STATS: 2024-09-14T11:39:34.177 INFO:tasks.workunit.client.0.smithi138.stderr:bucket: abort-at-change-reshard-state id: d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.39 num_objects: 19 size_kb: 1 num_shards: 12 2024-09-14T11:39:34.177 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-14T11:39:34.178 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:39:34.178 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-14T11:39:34.210 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:39:34.210 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-14T11:39:34.639 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:39:34.639 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-14T11:39:35.030 INFO:tasks.workunit.client.0.smithi138.stderr: test: logrecord could be stopped after reshard failed 2024-09-14T11:39:35.030 INFO:tasks.workunit.client.0.smithi138.stderr:radosgw-admin bucket stats --bucket a-bucket 2024-09-14T11:39:35.062 INFO:tasks.workunit.client.0.smithi138.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:39:35.062 INFO:tasks.workunit.client.0.smithi138.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:39:35.107 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:39:35.105+0000 7f5578a0b9c0 20 rados->read ofs=0 len=0 2024-09-14T11:39:35.109 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:39:35.109+0000 7f5578a0b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:39:35.109 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:39:35.109+0000 7f5578a0b9c0 20 realm 2024-09-14T11:39:35.109 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:39:35.109+0000 7f5578a0b9c0 20 rados->read ofs=0 len=0 2024-09-14T11:39:35.110 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:39:35.109+0000 7f5578a0b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:39:35.110 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:39:35.109+0000 7f5578a0b9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:39:35.110 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:39:35.109+0000 7f5578a0b9c0 20 rados->read ofs=0 len=0 2024-09-14T11:39:35.110 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:39:35.109+0000 7f5578a0b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:39:35.110 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:39:35.109+0000 7f5578a0b9c0 20 rados->read ofs=0 len=0 2024-09-14T11:39:35.111 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:39:35.109+0000 7f5578a0b9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:39:35.111 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:39:35.109+0000 7f5578a0b9c0 20 rados->read ofs=0 len=0 2024-09-14T11:39:35.112 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:39:35.113+0000 7f5578a0b9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:39:35.112 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:39:35.113+0000 7f5578a0b9c0 20 searching for the correct realm 2024-09-14T11:39:35.116 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:39:35.117+0000 7f5576d12640 0 -- 172.21.15.138:0/4114940674 >> [v2:172.21.15.154:6824/416768175,v1:172.21.15.154:6825/416768175] conn(0x7f557008e040 msgr2=0x7f557005db90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:39:35.333 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:39:35.333+0000 7f5575d10640 0 -- 172.21.15.138:0/4114940674 >> [v2:172.21.15.138:6816/326481658,v1:172.21.15.138:6817/326481658] conn(0x7f5570017020 msgr2=0x7f5570080040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:39:35.551 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:39:35.549+0000 7f5578a0b9c0 20 RGWRados::pool_iterate: got zone_info.d9e72d30-c60b-4d0d-9267-fdc36392d5ad 2024-09-14T11:39:35.551 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:39:35.549+0000 7f5578a0b9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:39:35.551 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:39:35.549+0000 7f5578a0b9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:39:35.551 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:39:35.549+0000 7f5578a0b9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:39:35.551 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:39:35.549+0000 7f5578a0b9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:39:35.551 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:39:35.549+0000 7f5578a0b9c0 20 RGWRados::pool_iterate: got zonegroup_info.65ab941b-da8c-4160-94fb-3672b069d44f 2024-09-14T11:39:35.551 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:39:35.549+0000 7f5578a0b9c0 20 rados->read ofs=0 len=0 2024-09-14T11:39:35.552 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:39:35.549+0000 7f5578a0b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:39:35.552 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:39:35.549+0000 7f5578a0b9c0 20 rados->read ofs=0 len=0 2024-09-14T11:39:35.552 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:39:35.553+0000 7f5578a0b9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:39:35.552 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:39:35.553+0000 7f5578a0b9c0 20 rados->read ofs=0 len=0 2024-09-14T11:39:35.553 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:39:35.553+0000 7f5578a0b9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:39:35.553 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:39:35.553+0000 7f5578a0b9c0 20 zone default found 2024-09-14T11:39:35.553 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:39:35.553+0000 7f5578a0b9c0 4 Realm: () 2024-09-14T11:39:35.553 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:39:35.553+0000 7f5578a0b9c0 4 ZoneGroup: default (65ab941b-da8c-4160-94fb-3672b069d44f) 2024-09-14T11:39:35.553 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:39:35.553+0000 7f5578a0b9c0 4 Zone: default (d9e72d30-c60b-4d0d-9267-fdc36392d5ad) 2024-09-14T11:39:35.553 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:39:35.553+0000 7f5578a0b9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:39:35.554 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:39:35.553+0000 7f5578a0b9c0 20 zonegroup default 2024-09-14T11:39:35.554 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:39:35.553+0000 7f5578a0b9c0 20 rados->read ofs=0 len=0 2024-09-14T11:39:35.554 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:39:35.553+0000 7f5578a0b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:39:35.554 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:39:35.553+0000 7f5578a0b9c0 20 rados->read ofs=0 len=0 2024-09-14T11:39:35.555 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:39:35.553+0000 7f5578a0b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:39:35.555 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:39:35.553+0000 7f5578a0b9c0 20 rados->read ofs=0 len=0 2024-09-14T11:39:35.555 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:39:35.553+0000 7f5578a0b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:39:35.555 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:39:35.553+0000 7f5578a0b9c0 20 started sync module instance, tier type = 2024-09-14T11:39:35.556 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:39:35.553+0000 7f5578a0b9c0 20 started zone id=d9e72d30-c60b-4d0d-9267-fdc36392d5ad (name=default) with tier type = 2024-09-14T11:39:35.577 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:39:35.577+0000 7f5578a0b9c0 20 add_watcher() i=0 2024-09-14T11:39:35.577 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:39:35.577+0000 7f5578a0b9c0 20 add_watcher() i=1 2024-09-14T11:39:35.577 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:39:35.577+0000 7f5578a0b9c0 20 add_watcher() i=2 2024-09-14T11:39:35.577 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:39:35.577+0000 7f5578a0b9c0 20 add_watcher() i=3 2024-09-14T11:39:35.577 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:39:35.577+0000 7f5578a0b9c0 20 add_watcher() i=4 2024-09-14T11:39:35.577 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:39:35.577+0000 7f5578a0b9c0 20 add_watcher() i=5 2024-09-14T11:39:35.577 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:39:35.577+0000 7f5578a0b9c0 20 add_watcher() i=6 2024-09-14T11:39:35.579 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:39:35.577+0000 7f5578a0b9c0 20 add_watcher() i=7 2024-09-14T11:39:35.579 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:39:35.577+0000 7f5578a0b9c0 2 all 8 watchers are set, enabling cache 2024-09-14T11:39:35.583 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:39:35.581+0000 7f542cfe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:39:35.584 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:39:35.585+0000 7f5578a0b9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:39:35.584 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:39:35.585+0000 7f5578a0b9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:39:35.584 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:39:35.585+0000 7f5578a0b9c0 5 note: GC not initialized 2024-09-14T11:39:35.585 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:39:35.585+0000 7f53a77fe640 20 reqs_thread_entry: start 2024-09-14T11:39:35.585 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:39:35.585+0000 7f5578a0b9c0 20 init_complete bucket index max shards: 11 2024-09-14T11:39:35.585 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:39:35.585+0000 7f5578a0b9c0 20 Filter name: none 2024-09-14T11:39:35.585 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:39:35.585+0000 7f53a57fa640 20 reqs_thread_entry: start 2024-09-14T11:39:35.586 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:39:35.585+0000 7f5578a0b9c0 20 rados->read ofs=0 len=0 2024-09-14T11:39:35.586 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:39:35.585+0000 7f5578a0b9c0 20 rados_obj.operate() r=0 bl.length=176 2024-09-14T11:39:35.587 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:39:35.585+0000 7f5578a0b9c0 20 rados->read ofs=0 len=0 2024-09-14T11:39:35.587 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:39:35.585+0000 7f5578a0b9c0 20 rados_obj.operate() r=0 bl.length=398 2024-09-14T11:39:35.588 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:39:35.585+0000 7f5578a0b9c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:39:35.588 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:39:35.585+0000 7f5578a0b9c0 20 rados->read ofs=0 len=0 2024-09-14T11:39:35.588 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:39:35.589+0000 7f5578a0b9c0 20 rados_obj.operate() r=0 bl.length=176 2024-09-14T11:39:35.588 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:39:35.589+0000 7f5578a0b9c0 20 rados->read ofs=0 len=0 2024-09-14T11:39:35.589 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:39:35.589+0000 7f5578a0b9c0 20 rados_obj.operate() r=0 bl.length=398 2024-09-14T11:39:35.589 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:39:35.589+0000 7f5578a0b9c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:39:35.592 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:39:35.593+0000 7f542cfe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:39:35.597 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:39:35.597+0000 7f5578a0b9c0 20 remove_watcher() i=0 2024-09-14T11:39:35.597 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:39:35.597+0000 7f5578a0b9c0 2 removed watcher, disabling cache 2024-09-14T11:39:35.600 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:39:35.601+0000 7f5578a0b9c0 20 remove_watcher() i=1 2024-09-14T11:39:35.602 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:39:35.601+0000 7f5578a0b9c0 20 remove_watcher() i=2 2024-09-14T11:39:35.604 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:39:35.605+0000 7f5578a0b9c0 20 remove_watcher() i=3 2024-09-14T11:39:35.606 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:39:35.605+0000 7f5578a0b9c0 20 remove_watcher() i=4 2024-09-14T11:39:35.608 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:39:35.609+0000 7f5578a0b9c0 20 remove_watcher() i=5 2024-09-14T11:39:35.610 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:39:35.609+0000 7f5578a0b9c0 20 remove_watcher() i=6 2024-09-14T11:39:35.611 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:39:35.609+0000 7f5578a0b9c0 20 remove_watcher() i=7 2024-09-14T11:39:35.627 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-14T11:39:35.627 INFO:tasks.workunit.client.0.smithi138.stderr:BUCKET_STATS: 2024-09-14T11:39:35.627 INFO:tasks.workunit.client.0.smithi138.stderr:bucket: a-bucket id: d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.17 num_objects: 8 size_kb: 1 num_shards: 13 2024-09-14T11:39:35.627 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-14T11:39:35.627 INFO:tasks.workunit.client.0.smithi138.stderr:radosgw-admin bucket stats --bucket a-bucket 2024-09-14T11:39:35.654 INFO:tasks.workunit.client.0.smithi138.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:39:35.654 INFO:tasks.workunit.client.0.smithi138.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:39:35.699 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:39:35.701+0000 7f1acfc149c0 20 rados->read ofs=0 len=0 2024-09-14T11:39:35.702 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:39:35.701+0000 7f1acfc149c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:39:35.702 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:39:35.701+0000 7f1acfc149c0 20 realm 2024-09-14T11:39:35.702 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:39:35.701+0000 7f1acfc149c0 20 rados->read ofs=0 len=0 2024-09-14T11:39:35.702 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:39:35.701+0000 7f1acfc149c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:39:35.702 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:39:35.701+0000 7f1acfc149c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:39:35.702 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:39:35.701+0000 7f1acfc149c0 20 rados->read ofs=0 len=0 2024-09-14T11:39:35.703 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:39:35.701+0000 7f1acfc149c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:39:35.703 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:39:35.701+0000 7f1acfc149c0 20 rados->read ofs=0 len=0 2024-09-14T11:39:35.704 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:39:35.705+0000 7f1acfc149c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:39:35.704 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:39:35.705+0000 7f1acfc149c0 20 rados->read ofs=0 len=0 2024-09-14T11:39:35.705 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:39:35.705+0000 7f1acfc149c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:39:35.705 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:39:35.705+0000 7f1acfc149c0 20 searching for the correct realm 2024-09-14T11:39:35.708 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:39:35.709+0000 7f1acdf1b640 0 -- 172.21.15.138:0/2445424346 >> [v2:172.21.15.154:6824/416768175,v1:172.21.15.154:6825/416768175] conn(0x7f1ac8110030 msgr2=0x7f1ac80f8100 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:39:35.925 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:39:35.925+0000 7f1accf19640 0 -- 172.21.15.138:0/2445424346 >> [v2:172.21.15.138:6816/326481658,v1:172.21.15.138:6817/326481658] conn(0x7f1ac80f7800 msgr2=0x7f1ac80f9dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:39:36.143 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:39:36.141+0000 7f1acfc149c0 20 RGWRados::pool_iterate: got zone_info.d9e72d30-c60b-4d0d-9267-fdc36392d5ad 2024-09-14T11:39:36.143 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:39:36.141+0000 7f1acfc149c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:39:36.143 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:39:36.141+0000 7f1acfc149c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:39:36.143 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:39:36.141+0000 7f1acfc149c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:39:36.143 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:39:36.141+0000 7f1acfc149c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:39:36.143 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:39:36.141+0000 7f1acfc149c0 20 RGWRados::pool_iterate: got zonegroup_info.65ab941b-da8c-4160-94fb-3672b069d44f 2024-09-14T11:39:36.144 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:39:36.141+0000 7f1acfc149c0 20 rados->read ofs=0 len=0 2024-09-14T11:39:36.144 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:39:36.141+0000 7f1acfc149c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:39:36.144 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:39:36.141+0000 7f1acfc149c0 20 rados->read ofs=0 len=0 2024-09-14T11:39:36.144 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:39:36.145+0000 7f1acfc149c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:39:36.144 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:39:36.145+0000 7f1acfc149c0 20 rados->read ofs=0 len=0 2024-09-14T11:39:36.146 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:39:36.145+0000 7f1acfc149c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:39:36.146 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:39:36.145+0000 7f1acfc149c0 20 zone default found 2024-09-14T11:39:36.146 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:39:36.145+0000 7f1acfc149c0 4 Realm: () 2024-09-14T11:39:36.146 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:39:36.145+0000 7f1acfc149c0 4 ZoneGroup: default (65ab941b-da8c-4160-94fb-3672b069d44f) 2024-09-14T11:39:36.146 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:39:36.145+0000 7f1acfc149c0 4 Zone: default (d9e72d30-c60b-4d0d-9267-fdc36392d5ad) 2024-09-14T11:39:36.146 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:39:36.145+0000 7f1acfc149c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:39:36.146 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:39:36.145+0000 7f1acfc149c0 20 zonegroup default 2024-09-14T11:39:36.146 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:39:36.145+0000 7f1acfc149c0 20 rados->read ofs=0 len=0 2024-09-14T11:39:36.147 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:39:36.145+0000 7f1acfc149c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:39:36.147 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:39:36.145+0000 7f1acfc149c0 20 rados->read ofs=0 len=0 2024-09-14T11:39:36.147 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:39:36.145+0000 7f1acfc149c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:39:36.148 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:39:36.145+0000 7f1acfc149c0 20 rados->read ofs=0 len=0 2024-09-14T11:39:36.148 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:39:36.149+0000 7f1acfc149c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:39:36.148 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:39:36.149+0000 7f1acfc149c0 20 started sync module instance, tier type = 2024-09-14T11:39:36.149 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:39:36.149+0000 7f1acfc149c0 20 started zone id=d9e72d30-c60b-4d0d-9267-fdc36392d5ad (name=default) with tier type = 2024-09-14T11:39:36.173 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:39:36.173+0000 7f1acfc149c0 20 add_watcher() i=0 2024-09-14T11:39:36.173 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:39:36.173+0000 7f1acfc149c0 20 add_watcher() i=1 2024-09-14T11:39:36.173 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:39:36.173+0000 7f1acfc149c0 20 add_watcher() i=2 2024-09-14T11:39:36.173 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:39:36.173+0000 7f1acfc149c0 20 add_watcher() i=3 2024-09-14T11:39:36.173 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:39:36.173+0000 7f1acfc149c0 20 add_watcher() i=4 2024-09-14T11:39:36.173 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:39:36.173+0000 7f1acfc149c0 20 add_watcher() i=5 2024-09-14T11:39:36.173 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:39:36.173+0000 7f1acfc149c0 20 add_watcher() i=6 2024-09-14T11:39:36.175 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:39:36.177+0000 7f1acfc149c0 20 add_watcher() i=7 2024-09-14T11:39:36.176 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:39:36.177+0000 7f1acfc149c0 2 all 8 watchers are set, enabling cache 2024-09-14T11:39:36.180 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:39:36.181+0000 7f19837e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:39:36.181 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:39:36.181+0000 7f1acfc149c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:39:36.181 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:39:36.181+0000 7f1acfc149c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:39:36.181 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:39:36.181+0000 7f1acfc149c0 5 note: GC not initialized 2024-09-14T11:39:36.182 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:39:36.181+0000 7f19827e4640 20 reqs_thread_entry: start 2024-09-14T11:39:36.182 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:39:36.181+0000 7f1acfc149c0 20 init_complete bucket index max shards: 11 2024-09-14T11:39:36.182 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:39:36.181+0000 7f1acfc149c0 20 Filter name: none 2024-09-14T11:39:36.182 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:39:36.181+0000 7f18f3fff640 20 reqs_thread_entry: start 2024-09-14T11:39:36.182 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:39:36.181+0000 7f1acfc149c0 20 rados->read ofs=0 len=0 2024-09-14T11:39:36.183 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:39:36.181+0000 7f1acfc149c0 20 rados_obj.operate() r=0 bl.length=176 2024-09-14T11:39:36.183 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:39:36.181+0000 7f1acfc149c0 20 rados->read ofs=0 len=0 2024-09-14T11:39:36.184 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:39:36.185+0000 7f1acfc149c0 20 rados_obj.operate() r=0 bl.length=398 2024-09-14T11:39:36.184 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:39:36.185+0000 7f1acfc149c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:39:36.184 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:39:36.185+0000 7f1acfc149c0 20 rados->read ofs=0 len=0 2024-09-14T11:39:36.184 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:39:36.185+0000 7f1acfc149c0 20 rados_obj.operate() r=0 bl.length=176 2024-09-14T11:39:36.184 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:39:36.185+0000 7f1acfc149c0 20 rados->read ofs=0 len=0 2024-09-14T11:39:36.185 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:39:36.185+0000 7f1acfc149c0 20 rados_obj.operate() r=0 bl.length=398 2024-09-14T11:39:36.185 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:39:36.185+0000 7f1acfc149c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:39:36.188 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:39:36.189+0000 7f19837e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:39:36.193 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:39:36.193+0000 7f1acfc149c0 20 remove_watcher() i=0 2024-09-14T11:39:36.193 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:39:36.193+0000 7f1acfc149c0 2 removed watcher, disabling cache 2024-09-14T11:39:36.195 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:39:36.193+0000 7f1acfc149c0 20 remove_watcher() i=1 2024-09-14T11:39:36.197 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:39:36.197+0000 7f1acfc149c0 20 remove_watcher() i=2 2024-09-14T11:39:36.199 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:39:36.197+0000 7f1acfc149c0 20 remove_watcher() i=3 2024-09-14T11:39:36.201 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:39:36.201+0000 7f1acfc149c0 20 remove_watcher() i=4 2024-09-14T11:39:36.202 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:39:36.201+0000 7f1acfc149c0 20 remove_watcher() i=5 2024-09-14T11:39:36.204 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:39:36.205+0000 7f1acfc149c0 20 remove_watcher() i=6 2024-09-14T11:39:36.205 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:39:36.205+0000 7f1acfc149c0 20 remove_watcher() i=7 2024-09-14T11:39:36.220 INFO:tasks.workunit.client.0.smithi138.stderr:radosgw-admin bucket reshard --bucket a-bucket --num-shards 14 --rgw-reshard-bucket-lock-duration 30 --inject-abort-at change_reshard_state 2024-09-14T11:39:36.253 INFO:tasks.workunit.client.0.smithi138.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:39:36.254 INFO:tasks.workunit.client.0.smithi138.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:39:36.298 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:39:36.297+0000 7f1fff8b29c0 20 rados->read ofs=0 len=0 2024-09-14T11:39:36.299 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:39:36.301+0000 7f1fff8b29c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:39:36.300 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:39:36.301+0000 7f1fff8b29c0 20 realm 2024-09-14T11:39:36.300 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:39:36.301+0000 7f1fff8b29c0 20 rados->read ofs=0 len=0 2024-09-14T11:39:36.300 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:39:36.301+0000 7f1fff8b29c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:39:36.300 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:39:36.301+0000 7f1fff8b29c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:39:36.300 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:39:36.301+0000 7f1fff8b29c0 20 rados->read ofs=0 len=0 2024-09-14T11:39:36.301 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:39:36.301+0000 7f1fff8b29c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:39:36.301 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:39:36.301+0000 7f1fff8b29c0 20 rados->read ofs=0 len=0 2024-09-14T11:39:36.302 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:39:36.301+0000 7f1fff8b29c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:39:36.302 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:39:36.301+0000 7f1fff8b29c0 20 rados->read ofs=0 len=0 2024-09-14T11:39:36.303 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:39:36.301+0000 7f1fff8b29c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:39:36.303 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:39:36.301+0000 7f1fff8b29c0 20 searching for the correct realm 2024-09-14T11:39:36.306 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:39:36.305+0000 7f1ffdbb9640 0 -- 172.21.15.138:0/2558815668 >> [v2:172.21.15.154:6824/416768175,v1:172.21.15.154:6825/416768175] conn(0x7f1ff80b8070 msgr2=0x7f1ff80f71e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:39:36.520 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:39:36.521+0000 7f1ffcbb7640 0 -- 172.21.15.138:0/2558815668 >> [v2:172.21.15.138:6816/326481658,v1:172.21.15.138:6817/326481658] conn(0x7f1ff81013e0 msgr2=0x7f1ff811e000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-14T11:39:36.738 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:39:36.737+0000 7f1fff8b29c0 20 RGWRados::pool_iterate: got zone_info.d9e72d30-c60b-4d0d-9267-fdc36392d5ad 2024-09-14T11:39:36.738 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:39:36.737+0000 7f1fff8b29c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:39:36.738 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:39:36.737+0000 7f1fff8b29c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:39:36.738 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:39:36.737+0000 7f1fff8b29c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:39:36.738 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:39:36.737+0000 7f1fff8b29c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:39:36.738 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:39:36.737+0000 7f1fff8b29c0 20 RGWRados::pool_iterate: got zonegroup_info.65ab941b-da8c-4160-94fb-3672b069d44f 2024-09-14T11:39:36.738 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:39:36.737+0000 7f1fff8b29c0 20 rados->read ofs=0 len=0 2024-09-14T11:39:36.739 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:39:36.737+0000 7f1fff8b29c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:39:36.739 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:39:36.737+0000 7f1fff8b29c0 20 rados->read ofs=0 len=0 2024-09-14T11:39:36.739 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:39:36.737+0000 7f1fff8b29c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:39:36.739 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:39:36.737+0000 7f1fff8b29c0 20 rados->read ofs=0 len=0 2024-09-14T11:39:36.740 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:39:36.741+0000 7f1fff8b29c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:39:36.740 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:39:36.741+0000 7f1fff8b29c0 20 zone default found 2024-09-14T11:39:36.740 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:39:36.741+0000 7f1fff8b29c0 4 Realm: () 2024-09-14T11:39:36.740 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:39:36.741+0000 7f1fff8b29c0 4 ZoneGroup: default (65ab941b-da8c-4160-94fb-3672b069d44f) 2024-09-14T11:39:36.741 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:39:36.741+0000 7f1fff8b29c0 4 Zone: default (d9e72d30-c60b-4d0d-9267-fdc36392d5ad) 2024-09-14T11:39:36.741 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:39:36.741+0000 7f1fff8b29c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:39:36.741 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:39:36.741+0000 7f1fff8b29c0 20 zonegroup default 2024-09-14T11:39:36.741 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:39:36.741+0000 7f1fff8b29c0 20 rados->read ofs=0 len=0 2024-09-14T11:39:36.741 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:39:36.741+0000 7f1fff8b29c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:39:36.741 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:39:36.741+0000 7f1fff8b29c0 20 rados->read ofs=0 len=0 2024-09-14T11:39:36.742 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:39:36.741+0000 7f1fff8b29c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:39:36.742 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:39:36.741+0000 7f1fff8b29c0 20 rados->read ofs=0 len=0 2024-09-14T11:39:36.742 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:39:36.741+0000 7f1fff8b29c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:39:36.743 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:39:36.741+0000 7f1fff8b29c0 20 started sync module instance, tier type = 2024-09-14T11:39:36.743 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:39:36.741+0000 7f1fff8b29c0 20 started zone id=d9e72d30-c60b-4d0d-9267-fdc36392d5ad (name=default) with tier type = 2024-09-14T11:39:36.771 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:39:36.769+0000 7f1fff8b29c0 20 add_watcher() i=0 2024-09-14T11:39:36.772 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:39:36.769+0000 7f1fff8b29c0 20 add_watcher() i=1 2024-09-14T11:39:36.772 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:39:36.769+0000 7f1fff8b29c0 20 add_watcher() i=2 2024-09-14T11:39:36.772 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:39:36.769+0000 7f1fff8b29c0 20 add_watcher() i=3 2024-09-14T11:39:36.772 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:39:36.769+0000 7f1fff8b29c0 20 add_watcher() i=4 2024-09-14T11:39:36.772 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:39:36.769+0000 7f1fff8b29c0 20 add_watcher() i=5 2024-09-14T11:39:36.772 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:39:36.769+0000 7f1fff8b29c0 20 add_watcher() i=6 2024-09-14T11:39:36.774 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:39:36.773+0000 7f1fff8b29c0 20 add_watcher() i=7 2024-09-14T11:39:36.774 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:39:36.773+0000 7f1fff8b29c0 2 all 8 watchers are set, enabling cache 2024-09-14T11:39:36.778 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:39:36.777+0000 7f1eb37e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:39:36.779 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:39:36.777+0000 7f1fff8b29c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:39:36.779 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:39:36.777+0000 7f1fff8b29c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:39:36.779 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:39:36.777+0000 7f1fff8b29c0 5 note: GC not initialized 2024-09-14T11:39:36.779 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:39:36.777+0000 7f1eb27e4640 20 reqs_thread_entry: start 2024-09-14T11:39:36.780 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:39:36.781+0000 7f1fff8b29c0 20 init_complete bucket index max shards: 11 2024-09-14T11:39:36.780 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:39:36.781+0000 7f1fff8b29c0 20 Filter name: none 2024-09-14T11:39:36.780 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:39:36.781+0000 7f1e23fff640 20 reqs_thread_entry: start 2024-09-14T11:39:36.780 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:39:36.781+0000 7f1fff8b29c0 10 cache get: name=default.rgw.meta+root+a-bucket : miss 2024-09-14T11:39:36.780 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:39:36.781+0000 7f1fff8b29c0 20 rados->read ofs=0 len=0 2024-09-14T11:39:36.781 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:39:36.781+0000 7f1fff8b29c0 20 rados_obj.operate() r=0 bl.length=176 2024-09-14T11:39:36.781 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:39:36.781+0000 7f1fff8b29c0 10 cache put: name=default.rgw.meta+root+a-bucket info.flags=0x11 2024-09-14T11:39:36.782 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:39:36.781+0000 7f1fff8b29c0 10 adding default.rgw.meta+root+a-bucket to cache LRU end 2024-09-14T11:39:36.782 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:39:36.781+0000 7f1fff8b29c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.17 : miss 2024-09-14T11:39:36.782 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:39:36.781+0000 7f1fff8b29c0 20 rados->read ofs=0 len=0 2024-09-14T11:39:36.782 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:39:36.781+0000 7f1fff8b29c0 20 rados_obj.operate() r=0 bl.length=398 2024-09-14T11:39:36.782 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:39:36.781+0000 7f1fff8b29c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.17 info.flags=0x17 2024-09-14T11:39:36.782 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:39:36.781+0000 7f1fff8b29c0 10 adding default.rgw.meta+root+.bucket.meta.a-bucket:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.17 to cache LRU end 2024-09-14T11:39:36.783 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:39:36.781+0000 7f1fff8b29c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:39:36.783 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:39:36.781+0000 7f1fff8b29c0 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-14T11:39:36.783 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:39:36.781+0000 7f1fff8b29c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.17 2024-09-14T11:39:36.795 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:39:36.793+0000 7f1fff8b29c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.17 info.flags=0x17 2024-09-14T11:39:36.795 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:39:36.793+0000 7f1fff8b29c0 10 moving default.rgw.meta+root+.bucket.meta.a-bucket:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.17 to cache LRU end 2024-09-14T11:39:36.795 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:39:36.793+0000 7f1fff8b29c0 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-14T11:39:36.795 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:39:36.793+0000 7f1fff8b29c0 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.a-bucket:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.17, ofs0, ns] 2024-09-14T11:39:36.795 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:39:36.793+0000 7f1ed3fff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366239 cookie 94636754505008 notifier 8019 bl.length()=827 2024-09-14T11:39:36.795 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:39:36.793+0000 7f1ed3fff640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.17 info.flags=0x17 2024-09-14T11:39:36.795 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:39:36.793+0000 7f1ed3fff640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.a-bucket:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.17 to cache LRU end 2024-09-14T11:39:36.796 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:39:36.793+0000 7f1ed3fff640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=143 2024-09-14T11:39:36.799 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:39:36.797+0000 7f1fff8b29c0 20 handle_bi_update(): bucket=:a-bucket[d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.17]): orig_sources= new_sources= 2024-09-14T11:39:36.799 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:39:36.797+0000 7f1fff8b29c0 20 handle_bi_update(): bucket=:a-bucket[d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.17]): potential sources added=[] removed=[] 2024-09-14T11:39:36.799 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:39:36.797+0000 7f1fff8b29c0 20 handle_bi_update(): bucket=:a-bucket[d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.17]): orig_dests= new_dests= 2024-09-14T11:39:36.799 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:39:36.797+0000 7f1fff8b29c0 20 handle_bi_update(): bucket=:a-bucket[d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.17]): potential dests added=[] removed=[] 2024-09-14T11:39:36.813 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:39:36.813+0000 7f1fff8b29c0 10 bucket_obj is .dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.17.3.0 2024-09-14T11:39:36.813 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:39:36.813+0000 7f1fff8b29c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.17.3.0 2024-09-14T11:39:36.813 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:39:36.813+0000 7f1fff8b29c0 10 bucket_obj is .dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.17.3.1 2024-09-14T11:39:36.813 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:39:36.813+0000 7f1fff8b29c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.17.3.1 2024-09-14T11:39:36.813 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:39:36.813+0000 7f1fff8b29c0 10 bucket_obj is .dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.17.3.2 2024-09-14T11:39:36.814 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:39:36.813+0000 7f1fff8b29c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.17.3.2 2024-09-14T11:39:36.814 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:39:36.813+0000 7f1fff8b29c0 10 bucket_obj is .dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.17.3.3 2024-09-14T11:39:36.814 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:39:36.813+0000 7f1fff8b29c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.17.3.3 2024-09-14T11:39:36.814 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:39:36.813+0000 7f1fff8b29c0 10 bucket_obj is .dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.17.3.4 2024-09-14T11:39:36.814 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:39:36.813+0000 7f1fff8b29c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.17.3.4 2024-09-14T11:39:36.814 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:39:36.813+0000 7f1fff8b29c0 10 bucket_obj is .dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.17.3.5 2024-09-14T11:39:36.814 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:39:36.813+0000 7f1fff8b29c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.17.3.5 2024-09-14T11:39:36.814 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:39:36.813+0000 7f1fff8b29c0 10 bucket_obj is .dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.17.3.6 2024-09-14T11:39:36.814 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:39:36.813+0000 7f1fff8b29c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.17.3.6 2024-09-14T11:39:36.814 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:39:36.813+0000 7f1fff8b29c0 10 bucket_obj is .dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.17.3.7 2024-09-14T11:39:36.814 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:39:36.813+0000 7f1fff8b29c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.17.3.7 2024-09-14T11:39:36.814 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:39:36.813+0000 7f1fff8b29c0 10 bucket_obj is .dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.17.3.8 2024-09-14T11:39:36.814 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:39:36.813+0000 7f1fff8b29c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.17.3.8 2024-09-14T11:39:36.814 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:39:36.813+0000 7f1fff8b29c0 10 bucket_obj is .dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.17.3.9 2024-09-14T11:39:36.815 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:39:36.813+0000 7f1fff8b29c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.17.3.9 2024-09-14T11:39:36.815 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:39:36.813+0000 7f1fff8b29c0 10 bucket_obj is .dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.17.3.10 2024-09-14T11:39:36.815 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:39:36.813+0000 7f1fff8b29c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.17.3.10 2024-09-14T11:39:36.815 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:39:36.813+0000 7f1fff8b29c0 10 bucket_obj is .dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.17.3.11 2024-09-14T11:39:36.815 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:39:36.813+0000 7f1fff8b29c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.17.3.11 2024-09-14T11:39:36.815 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:39:36.813+0000 7f1fff8b29c0 10 bucket_obj is .dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.17.3.12 2024-09-14T11:39:36.815 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:39:36.813+0000 7f1fff8b29c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.17.3.12 2024-09-14T11:39:36.815 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:39:36.813+0000 7f1fff8b29c0 10 bucket_obj is .dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.17.3.13 2024-09-14T11:39:36.815 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:39:36.813+0000 7f1fff8b29c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.17.3.13 2024-09-14T11:39:36.815 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:39:36.813+0000 7f1fff8b29c0 10 bucket_obj is .dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.17.2.0 2024-09-14T11:39:36.815 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:39:36.813+0000 7f1fff8b29c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.17.2.0 2024-09-14T11:39:36.816 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:39:36.813+0000 7f1fff8b29c0 10 bucket_obj is .dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.17.2.1 2024-09-14T11:39:36.816 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:39:36.813+0000 7f1fff8b29c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.17.2.1 2024-09-14T11:39:36.816 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:39:36.813+0000 7f1fff8b29c0 10 bucket_obj is .dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.17.2.2 2024-09-14T11:39:36.816 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:39:36.813+0000 7f1fff8b29c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.17.2.2 2024-09-14T11:39:36.816 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:39:36.813+0000 7f1fff8b29c0 10 bucket_obj is .dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.17.2.3 2024-09-14T11:39:36.816 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:39:36.813+0000 7f1fff8b29c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.17.2.3 2024-09-14T11:39:36.817 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:39:36.817+0000 7f1fff8b29c0 10 bucket_obj is .dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.17.2.4 2024-09-14T11:39:36.817 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:39:36.817+0000 7f1fff8b29c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.17.2.4 2024-09-14T11:39:36.818 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:39:36.817+0000 7f1fff8b29c0 10 bucket_obj is .dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.17.2.5 2024-09-14T11:39:36.818 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:39:36.817+0000 7f1fff8b29c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.17.2.5 2024-09-14T11:39:36.818 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:39:36.817+0000 7f1fff8b29c0 10 bucket_obj is .dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.17.2.6 2024-09-14T11:39:36.819 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:39:36.817+0000 7f1fff8b29c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.17.2.6 2024-09-14T11:39:36.820 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:39:36.821+0000 7f1fff8b29c0 10 bucket_obj is .dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.17.2.7 2024-09-14T11:39:36.820 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:39:36.821+0000 7f1fff8b29c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.17.2.7 2024-09-14T11:39:36.821 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:39:36.821+0000 7f1fff8b29c0 10 bucket_obj is .dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.17.2.8 2024-09-14T11:39:36.821 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:39:36.821+0000 7f1fff8b29c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.17.2.8 2024-09-14T11:39:36.821 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:39:36.821+0000 7f1fff8b29c0 10 bucket_obj is .dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.17.2.9 2024-09-14T11:39:36.821 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:39:36.821+0000 7f1fff8b29c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.17.2.9 2024-09-14T11:39:36.823 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:39:36.821+0000 7f1fff8b29c0 10 bucket_obj is .dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.17.2.10 2024-09-14T11:39:36.823 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:39:36.821+0000 7f1fff8b29c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.17.2.10 2024-09-14T11:39:36.823 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:39:36.821+0000 7f1fff8b29c0 10 bucket_obj is .dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.17.2.11 2024-09-14T11:39:36.823 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:39:36.821+0000 7f1fff8b29c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.17.2.11 2024-09-14T11:39:36.824 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:39:36.825+0000 7f1fff8b29c0 10 bucket_obj is .dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.17.2.12 2024-09-14T11:39:36.824 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:39:36.825+0000 7f1fff8b29c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.17.2.12 2024-09-14T11:39:36.829 INFO:tasks.workunit.client.0.smithi138.stderr:./src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f1fff8b29c0 time 2024-09-14T11:39:36.834404+0000 2024-09-14T11:39:36.829 INFO:tasks.workunit.client.0.smithi138.stderr:./src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-14T11:39:36.830 INFO:tasks.workunit.client.0.smithi138.stderr: ceph version 19.3.0-4907-ga2782315 (a2782315255a3e7d5f6cdc9eb35785187ff6ddf8) squid (dev) 2024-09-14T11:39:36.830 INFO:tasks.workunit.client.0.smithi138.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x121) [0x7f200318c2eb] 2024-09-14T11:39:36.830 INFO:tasks.workunit.client.0.smithi138.stderr: 2: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7f200318c49f] 2024-09-14T11:39:36.830 INFO:tasks.workunit.client.0.smithi138.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x5612537bec01] 2024-09-14T11:39:36.831 INFO:tasks.workunit.client.0.smithi138.stderr: 4: (RGWBucketReshard::do_reshard(rgw::bucket_index_layout_generation const&, rgw::bucket_index_layout_generation const&, int, bool, bool, std::ostream*, ceph::Formatter*, FaultInjector > >&, DoutPrefixProvider const*, optional_yield)+0x1411) [0x5612537d3231] 2024-09-14T11:39:36.831 INFO:tasks.workunit.client.0.smithi138.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0xac4) [0x5612537d4884] 2024-09-14T11:39:36.831 INFO:tasks.workunit.client.0.smithi138.stderr: 6: main() 2024-09-14T11:39:36.831 INFO:tasks.workunit.client.0.smithi138.stderr: 7: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7f2001ff2d90] 2024-09-14T11:39:36.831 INFO:tasks.workunit.client.0.smithi138.stderr: 8: __libc_start_main() 2024-09-14T11:39:36.831 INFO:tasks.workunit.client.0.smithi138.stderr: 9: _start() 2024-09-14T11:39:36.831 INFO:tasks.workunit.client.0.smithi138.stderr:*** Caught signal (Aborted) ** 2024-09-14T11:39:36.831 INFO:tasks.workunit.client.0.smithi138.stderr: in thread 7f1fff8b29c0 thread_name:radosgw-admin 2024-09-14T11:39:36.831 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:39:36.829+0000 7f1fff8b29c0 -1 ./src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f1fff8b29c0 time 2024-09-14T11:39:36.834404+0000 2024-09-14T11:39:36.831 INFO:tasks.workunit.client.0.smithi138.stderr:./src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-14T11:39:36.831 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-14T11:39:36.831 INFO:tasks.workunit.client.0.smithi138.stderr: ceph version 19.3.0-4907-ga2782315 (a2782315255a3e7d5f6cdc9eb35785187ff6ddf8) squid (dev) 2024-09-14T11:39:36.831 INFO:tasks.workunit.client.0.smithi138.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x121) [0x7f200318c2eb] 2024-09-14T11:39:36.831 INFO:tasks.workunit.client.0.smithi138.stderr: 2: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7f200318c49f] 2024-09-14T11:39:36.832 INFO:tasks.workunit.client.0.smithi138.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x5612537bec01] 2024-09-14T11:39:36.832 INFO:tasks.workunit.client.0.smithi138.stderr: 4: (RGWBucketReshard::do_reshard(rgw::bucket_index_layout_generation const&, rgw::bucket_index_layout_generation const&, int, bool, bool, std::ostream*, ceph::Formatter*, FaultInjector > >&, DoutPrefixProvider const*, optional_yield)+0x1411) [0x5612537d3231] 2024-09-14T11:39:36.832 INFO:tasks.workunit.client.0.smithi138.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0xac4) [0x5612537d4884] 2024-09-14T11:39:36.832 INFO:tasks.workunit.client.0.smithi138.stderr: 6: main() 2024-09-14T11:39:36.832 INFO:tasks.workunit.client.0.smithi138.stderr: 7: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7f2001ff2d90] 2024-09-14T11:39:36.832 INFO:tasks.workunit.client.0.smithi138.stderr: 8: __libc_start_main() 2024-09-14T11:39:36.832 INFO:tasks.workunit.client.0.smithi138.stderr: 9: _start() 2024-09-14T11:39:36.832 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-14T11:39:36.849 INFO:tasks.workunit.client.0.smithi138.stderr: ceph version 19.3.0-4907-ga2782315 (a2782315255a3e7d5f6cdc9eb35785187ff6ddf8) squid (dev) 2024-09-14T11:39:36.849 INFO:tasks.workunit.client.0.smithi138.stderr: 1: /lib/x86_64-linux-gnu/libc.so.6(+0x42520) [0x7f200200b520] 2024-09-14T11:39:36.849 INFO:tasks.workunit.client.0.smithi138.stderr: 2: pthread_kill() 2024-09-14T11:39:36.850 INFO:tasks.workunit.client.0.smithi138.stderr: 3: raise() 2024-09-14T11:39:36.850 INFO:tasks.workunit.client.0.smithi138.stderr: 4: abort() 2024-09-14T11:39:36.850 INFO:tasks.workunit.client.0.smithi138.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x17b) [0x7f200318c345] 2024-09-14T11:39:36.850 INFO:tasks.workunit.client.0.smithi138.stderr: 6: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7f200318c49f] 2024-09-14T11:39:36.850 INFO:tasks.workunit.client.0.smithi138.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x5612537bec01] 2024-09-14T11:39:36.850 INFO:tasks.workunit.client.0.smithi138.stderr: 8: (RGWBucketReshard::do_reshard(rgw::bucket_index_layout_generation const&, rgw::bucket_index_layout_generation const&, int, bool, bool, std::ostream*, ceph::Formatter*, FaultInjector > >&, DoutPrefixProvider const*, optional_yield)+0x1411) [0x5612537d3231] 2024-09-14T11:39:36.850 INFO:tasks.workunit.client.0.smithi138.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0xac4) [0x5612537d4884] 2024-09-14T11:39:36.850 INFO:tasks.workunit.client.0.smithi138.stderr: 10: main() 2024-09-14T11:39:36.850 INFO:tasks.workunit.client.0.smithi138.stderr: 11: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7f2001ff2d90] 2024-09-14T11:39:36.850 INFO:tasks.workunit.client.0.smithi138.stderr: 12: __libc_start_main() 2024-09-14T11:39:36.850 INFO:tasks.workunit.client.0.smithi138.stderr: 13: _start() 2024-09-14T11:39:36.850 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:39:36.829+0000 7f1fff8b29c0 -1 *** Caught signal (Aborted) ** 2024-09-14T11:39:36.850 INFO:tasks.workunit.client.0.smithi138.stderr: in thread 7f1fff8b29c0 thread_name:radosgw-admin 2024-09-14T11:39:36.850 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-14T11:39:36.851 INFO:tasks.workunit.client.0.smithi138.stderr: ceph version 19.3.0-4907-ga2782315 (a2782315255a3e7d5f6cdc9eb35785187ff6ddf8) squid (dev) 2024-09-14T11:39:36.851 INFO:tasks.workunit.client.0.smithi138.stderr: 1: /lib/x86_64-linux-gnu/libc.so.6(+0x42520) [0x7f200200b520] 2024-09-14T11:39:36.851 INFO:tasks.workunit.client.0.smithi138.stderr: 2: pthread_kill() 2024-09-14T11:39:36.851 INFO:tasks.workunit.client.0.smithi138.stderr: 3: raise() 2024-09-14T11:39:36.851 INFO:tasks.workunit.client.0.smithi138.stderr: 4: abort() 2024-09-14T11:39:36.851 INFO:tasks.workunit.client.0.smithi138.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x17b) [0x7f200318c345] 2024-09-14T11:39:36.851 INFO:tasks.workunit.client.0.smithi138.stderr: 6: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7f200318c49f] 2024-09-14T11:39:36.851 INFO:tasks.workunit.client.0.smithi138.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x5612537bec01] 2024-09-14T11:39:36.851 INFO:tasks.workunit.client.0.smithi138.stderr: 8: (RGWBucketReshard::do_reshard(rgw::bucket_index_layout_generation const&, rgw::bucket_index_layout_generation const&, int, bool, bool, std::ostream*, ceph::Formatter*, FaultInjector > >&, DoutPrefixProvider const*, optional_yield)+0x1411) [0x5612537d3231] 2024-09-14T11:39:36.851 INFO:tasks.workunit.client.0.smithi138.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0xac4) [0x5612537d4884] 2024-09-14T11:39:36.851 INFO:tasks.workunit.client.0.smithi138.stderr: 10: main() 2024-09-14T11:39:36.851 INFO:tasks.workunit.client.0.smithi138.stderr: 11: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7f2001ff2d90] 2024-09-14T11:39:36.851 INFO:tasks.workunit.client.0.smithi138.stderr: 12: __libc_start_main() 2024-09-14T11:39:36.851 INFO:tasks.workunit.client.0.smithi138.stderr: 13: _start() 2024-09-14T11:39:36.852 INFO:tasks.workunit.client.0.smithi138.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-14T11:39:36.852 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-14T11:39:36.852 INFO:tasks.workunit.client.0.smithi138.stderr:--- begin dump of recent events --- 2024-09-14T11:39:36.852 INFO:tasks.workunit.client.0.smithi138.stderr: -499> 2024-09-14T11:39:36.277+0000 7f1fff8b29c0 5 AuthRegistry(0x561256128a60) adding con mode: crc 2024-09-14T11:39:36.852 INFO:tasks.workunit.client.0.smithi138.stderr: -498> 2024-09-14T11:39:36.277+0000 7f1fff8b29c0 5 AuthRegistry(0x561256128a60) adding con mode: secure 2024-09-14T11:39:36.852 INFO:tasks.workunit.client.0.smithi138.stderr: -497> 2024-09-14T11:39:36.277+0000 7f1fff8b29c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:39:36.852 INFO:tasks.workunit.client.0.smithi138.stderr: -496> 2024-09-14T11:39:36.277+0000 7f1fff8b29c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:39:36.852 INFO:tasks.workunit.client.0.smithi138.stderr: -495> 2024-09-14T11:39:36.277+0000 7f1fff8b29c0 5 asok(0x561255f1dd90) register_command rotate-key hook 0x561256128ba8 2024-09-14T11:39:36.852 INFO:tasks.workunit.client.0.smithi138.stderr: -494> 2024-09-14T11:39:36.277+0000 7f1fff8b29c0 10 monclient: _reopen_session rank -1 2024-09-14T11:39:36.852 INFO:tasks.workunit.client.0.smithi138.stderr: -493> 2024-09-14T11:39:36.277+0000 7f1fff8b29c0 10 monclient: _add_conns ranks=[1,2,0] 2024-09-14T11:39:36.852 INFO:tasks.workunit.client.0.smithi138.stderr: -492> 2024-09-14T11:39:36.277+0000 7f1fff8b29c0 10 monclient(hunting): picked mon.noname-b con 0x561255fd97f0 addr [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] 2024-09-14T11:39:36.852 INFO:tasks.workunit.client.0.smithi138.stderr: -491> 2024-09-14T11:39:36.277+0000 7f1fff8b29c0 10 monclient(hunting): picked mon.noname-c con 0x561256071800 addr [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] 2024-09-14T11:39:36.852 INFO:tasks.workunit.client.0.smithi138.stderr: -490> 2024-09-14T11:39:36.277+0000 7f1fff8b29c0 10 monclient(hunting): picked mon.noname-a con 0x561256071be0 addr [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] 2024-09-14T11:39:36.852 INFO:tasks.workunit.client.0.smithi138.stderr: -489> 2024-09-14T11:39:36.277+0000 7f1fff8b29c0 10 monclient(hunting): start opening mon connection 2024-09-14T11:39:36.852 INFO:tasks.workunit.client.0.smithi138.stderr: -488> 2024-09-14T11:39:36.277+0000 7f1fff8b29c0 10 monclient(hunting): start opening mon connection 2024-09-14T11:39:36.853 INFO:tasks.workunit.client.0.smithi138.stderr: -487> 2024-09-14T11:39:36.277+0000 7f1fff8b29c0 10 monclient(hunting): start opening mon connection 2024-09-14T11:39:36.853 INFO:tasks.workunit.client.0.smithi138.stderr: -486> 2024-09-14T11:39:36.277+0000 7f1fff8b29c0 10 monclient(hunting): _renew_subs 2024-09-14T11:39:36.853 INFO:tasks.workunit.client.0.smithi138.stderr: -485> 2024-09-14T11:39:36.277+0000 7f1fff8b29c0 10 monclient(hunting): authenticate will time out at 2912.242421s 2024-09-14T11:39:36.853 INFO:tasks.workunit.client.0.smithi138.stderr: -484> 2024-09-14T11:39:36.277+0000 7f1ffdbb9640 10 monclient(hunting): get_auth_request con 0x561256071be0 auth_method 0 2024-09-14T11:39:36.853 INFO:tasks.workunit.client.0.smithi138.stderr: -483> 2024-09-14T11:39:36.277+0000 7f1ffdbb9640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:39:36.853 INFO:tasks.workunit.client.0.smithi138.stderr: -482> 2024-09-14T11:39:36.277+0000 7f1ffdbb9640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:39:36.853 INFO:tasks.workunit.client.0.smithi138.stderr: -481> 2024-09-14T11:39:36.277+0000 7f1ffdbb9640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:39:36.853 INFO:tasks.workunit.client.0.smithi138.stderr: -480> 2024-09-14T11:39:36.277+0000 7f1ffcbb7640 10 monclient(hunting): get_auth_request con 0x561256071800 auth_method 0 2024-09-14T11:39:36.853 INFO:tasks.workunit.client.0.smithi138.stderr: -479> 2024-09-14T11:39:36.277+0000 7f1ffcbb7640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:39:36.853 INFO:tasks.workunit.client.0.smithi138.stderr: -478> 2024-09-14T11:39:36.277+0000 7f1ffcbb7640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:39:36.853 INFO:tasks.workunit.client.0.smithi138.stderr: -477> 2024-09-14T11:39:36.277+0000 7f1ffcbb7640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:39:36.853 INFO:tasks.workunit.client.0.smithi138.stderr: -476> 2024-09-14T11:39:36.277+0000 7f1ffdbb9640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:39:36.853 INFO:tasks.workunit.client.0.smithi138.stderr: -475> 2024-09-14T11:39:36.277+0000 7f1ffdbb9640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:39:36.853 INFO:tasks.workunit.client.0.smithi138.stderr: -474> 2024-09-14T11:39:36.277+0000 7f1ffdbb9640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:39:36.854 INFO:tasks.workunit.client.0.smithi138.stderr: -473> 2024-09-14T11:39:36.277+0000 7f1ffcbb7640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:39:36.854 INFO:tasks.workunit.client.0.smithi138.stderr: -472> 2024-09-14T11:39:36.277+0000 7f1ffcbb7640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:39:36.854 INFO:tasks.workunit.client.0.smithi138.stderr: -471> 2024-09-14T11:39:36.277+0000 7f1ffcbb7640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:39:36.854 INFO:tasks.workunit.client.0.smithi138.stderr: -470> 2024-09-14T11:39:36.277+0000 7f1ffd3b8640 10 monclient(hunting): get_auth_request con 0x561255fd97f0 auth_method 0 2024-09-14T11:39:36.854 INFO:tasks.workunit.client.0.smithi138.stderr: -469> 2024-09-14T11:39:36.277+0000 7f1ffd3b8640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:39:36.854 INFO:tasks.workunit.client.0.smithi138.stderr: -468> 2024-09-14T11:39:36.277+0000 7f1ffd3b8640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:39:36.854 INFO:tasks.workunit.client.0.smithi138.stderr: -467> 2024-09-14T11:39:36.277+0000 7f1ffd3b8640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:39:36.854 INFO:tasks.workunit.client.0.smithi138.stderr: -466> 2024-09-14T11:39:36.277+0000 7f1ffdbb9640 10 monclient(hunting): handle_auth_done global_id 8010 payload 824 2024-09-14T11:39:36.854 INFO:tasks.workunit.client.0.smithi138.stderr: -465> 2024-09-14T11:39:36.277+0000 7f1ffdbb9640 10 monclient: _finish_hunting 0 2024-09-14T11:39:36.854 INFO:tasks.workunit.client.0.smithi138.stderr: -464> 2024-09-14T11:39:36.277+0000 7f1ffdbb9640 1 monclient: found mon.noname-a 2024-09-14T11:39:36.854 INFO:tasks.workunit.client.0.smithi138.stderr: -463> 2024-09-14T11:39:36.277+0000 7f1ffdbb9640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.138:3300/0 2024-09-14T11:39:36.854 INFO:tasks.workunit.client.0.smithi138.stderr: -462> 2024-09-14T11:39:36.277+0000 7f1ee9e03640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:39:36.854 INFO:tasks.workunit.client.0.smithi138.stderr: -461> 2024-09-14T11:39:36.277+0000 7f1ee9e03640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-14T11:39:36.854 INFO:tasks.workunit.client.0.smithi138.stderr: -460> 2024-09-14T11:39:36.277+0000 7f1ee9e03640 10 monclient: dump: 2024-09-14T11:39:36.855 INFO:tasks.workunit.client.0.smithi138.stderr:epoch 1 2024-09-14T11:39:36.855 INFO:tasks.workunit.client.0.smithi138.stderr:fsid 3f225f43-83a6-4aeb-b798-1f04bb49d597 2024-09-14T11:39:36.855 INFO:tasks.workunit.client.0.smithi138.stderr:last_changed 2024-09-14T11:07:09.252780+0000 2024-09-14T11:39:36.855 INFO:tasks.workunit.client.0.smithi138.stderr:created 2024-09-14T11:07:09.252780+0000 2024-09-14T11:39:36.855 INFO:tasks.workunit.client.0.smithi138.stderr:min_mon_release 19 (squid) 2024-09-14T11:39:36.855 INFO:tasks.workunit.client.0.smithi138.stderr:election_strategy: 1 2024-09-14T11:39:36.855 INFO:tasks.workunit.client.0.smithi138.stderr:0: [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] mon.a 2024-09-14T11:39:36.855 INFO:tasks.workunit.client.0.smithi138.stderr:1: [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] mon.b 2024-09-14T11:39:36.855 INFO:tasks.workunit.client.0.smithi138.stderr:2: [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] mon.c 2024-09-14T11:39:36.855 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-14T11:39:36.855 INFO:tasks.workunit.client.0.smithi138.stderr: -459> 2024-09-14T11:39:36.277+0000 7f1ee9e03640 10 monclient: _finish_auth 0 2024-09-14T11:39:36.855 INFO:tasks.workunit.client.0.smithi138.stderr: -458> 2024-09-14T11:39:36.277+0000 7f1ee9e03640 10 monclient: _check_auth_tickets 2024-09-14T11:39:36.855 INFO:tasks.workunit.client.0.smithi138.stderr: -457> 2024-09-14T11:39:36.277+0000 7f1fff8b29c0 5 monclient: authenticate success, global_id 8010 2024-09-14T11:39:36.855 INFO:tasks.workunit.client.0.smithi138.stderr: -456> 2024-09-14T11:39:36.277+0000 7f1fff8b29c0 10 monclient: _renew_subs 2024-09-14T11:39:36.856 INFO:tasks.workunit.client.0.smithi138.stderr: -455> 2024-09-14T11:39:36.277+0000 7f1fff8b29c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.138:3300/0 2024-09-14T11:39:36.856 INFO:tasks.workunit.client.0.smithi138.stderr: -454> 2024-09-14T11:39:36.277+0000 7f1ee9e03640 10 monclient: handle_config config(0 keys) 2024-09-14T11:39:36.856 INFO:tasks.workunit.client.0.smithi138.stderr: -453> 2024-09-14T11:39:36.277+0000 7f1ee9e03640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:39:36.856 INFO:tasks.workunit.client.0.smithi138.stderr: -452> 2024-09-14T11:39:36.277+0000 7f1ee9e03640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-14T11:39:36.856 INFO:tasks.workunit.client.0.smithi138.stderr: -451> 2024-09-14T11:39:36.277+0000 7f1ee9e03640 10 monclient: dump: 2024-09-14T11:39:36.856 INFO:tasks.workunit.client.0.smithi138.stderr:epoch 1 2024-09-14T11:39:36.856 INFO:tasks.workunit.client.0.smithi138.stderr:fsid 3f225f43-83a6-4aeb-b798-1f04bb49d597 2024-09-14T11:39:36.856 INFO:tasks.workunit.client.0.smithi138.stderr:last_changed 2024-09-14T11:07:09.252780+0000 2024-09-14T11:39:36.856 INFO:tasks.workunit.client.0.smithi138.stderr:created 2024-09-14T11:07:09.252780+0000 2024-09-14T11:39:36.856 INFO:tasks.workunit.client.0.smithi138.stderr:min_mon_release 19 (squid) 2024-09-14T11:39:36.856 INFO:tasks.workunit.client.0.smithi138.stderr:election_strategy: 1 2024-09-14T11:39:36.856 INFO:tasks.workunit.client.0.smithi138.stderr:0: [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] mon.a 2024-09-14T11:39:36.856 INFO:tasks.workunit.client.0.smithi138.stderr:1: [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] mon.b 2024-09-14T11:39:36.857 INFO:tasks.workunit.client.0.smithi138.stderr:2: [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] mon.c 2024-09-14T11:39:36.857 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-14T11:39:36.857 INFO:tasks.workunit.client.0.smithi138.stderr: -450> 2024-09-14T11:39:36.277+0000 7f1eeb606640 4 set_mon_vals no callback set 2024-09-14T11:39:36.857 INFO:tasks.workunit.client.0.smithi138.stderr: -449> 2024-09-14T11:39:36.277+0000 7f1fff8b29c0 10 monclient: _renew_subs 2024-09-14T11:39:36.857 INFO:tasks.workunit.client.0.smithi138.stderr: -448> 2024-09-14T11:39:36.277+0000 7f1fff8b29c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.138:3300/0 2024-09-14T11:39:36.857 INFO:tasks.workunit.client.0.smithi138.stderr: -447> 2024-09-14T11:39:36.277+0000 7f1fff8b29c0 1 librados: init done 2024-09-14T11:39:36.857 INFO:tasks.workunit.client.0.smithi138.stderr: -446> 2024-09-14T11:39:36.281+0000 7f1ee9e03640 4 mgrc handle_mgr_map Got map version 5 2024-09-14T11:39:36.857 INFO:tasks.workunit.client.0.smithi138.stderr: -445> 2024-09-14T11:39:36.281+0000 7f1ee9e03640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.138:6832/3778043143,v1:172.21.15.138:6833/3778043143] 2024-09-14T11:39:36.857 INFO:tasks.workunit.client.0.smithi138.stderr: -444> 2024-09-14T11:39:36.281+0000 7f1ee9e03640 4 mgrc reconnect Starting new session with [v2:172.21.15.138:6832/3778043143,v1:172.21.15.138:6833/3778043143] 2024-09-14T11:39:36.857 INFO:tasks.workunit.client.0.smithi138.stderr: -443> 2024-09-14T11:39:36.281+0000 7f1ffd3b8640 10 monclient: get_auth_request con 0x7f1ee40718d0 auth_method 0 2024-09-14T11:39:36.857 INFO:tasks.workunit.client.0.smithi138.stderr: -442> 2024-09-14T11:39:36.281+0000 7f1ffcbb7640 10 monclient: get_auth_request con 0x5612561507a0 auth_method 0 2024-09-14T11:39:36.857 INFO:tasks.workunit.client.0.smithi138.stderr: -441> 2024-09-14T11:39:36.281+0000 7f1ffd3b8640 10 monclient: get_auth_request con 0x561256173760 auth_method 0 2024-09-14T11:39:36.857 INFO:tasks.workunit.client.0.smithi138.stderr: -440> 2024-09-14T11:39:36.285+0000 7f1ffcbb7640 10 monclient: get_auth_request con 0x561256177e00 auth_method 0 2024-09-14T11:39:36.857 INFO:tasks.workunit.client.0.smithi138.stderr: -439> 2024-09-14T11:39:36.285+0000 7f1ffdbb9640 10 monclient: get_auth_request con 0x561256177460 auth_method 0 2024-09-14T11:39:36.858 INFO:tasks.workunit.client.0.smithi138.stderr: -438> 2024-09-14T11:39:36.285+0000 7f1fff8b29c0 10 monclient: build_initial_monmap 2024-09-14T11:39:36.858 INFO:tasks.workunit.client.0.smithi138.stderr: -437> 2024-09-14T11:39:36.285+0000 7f1fff8b29c0 1 build_initial for_mkfs: 0 2024-09-14T11:39:36.858 INFO:tasks.workunit.client.0.smithi138.stderr: -436> 2024-09-14T11:39:36.285+0000 7f1fff8b29c0 10 monclient: monmap: 2024-09-14T11:39:36.858 INFO:tasks.workunit.client.0.smithi138.stderr:epoch 0 2024-09-14T11:39:36.858 INFO:tasks.workunit.client.0.smithi138.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-14T11:39:36.858 INFO:tasks.workunit.client.0.smithi138.stderr:last_changed 0.000000 2024-09-14T11:39:36.858 INFO:tasks.workunit.client.0.smithi138.stderr:created 0.000000 2024-09-14T11:39:36.858 INFO:tasks.workunit.client.0.smithi138.stderr:min_mon_release 0 (unknown) 2024-09-14T11:39:36.858 INFO:tasks.workunit.client.0.smithi138.stderr:election_strategy: 1 2024-09-14T11:39:36.858 INFO:tasks.workunit.client.0.smithi138.stderr:0: [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] mon.noname-a 2024-09-14T11:39:36.858 INFO:tasks.workunit.client.0.smithi138.stderr:1: [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] mon.noname-b 2024-09-14T11:39:36.858 INFO:tasks.workunit.client.0.smithi138.stderr:2: [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] mon.noname-c 2024-09-14T11:39:36.858 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-14T11:39:36.858 INFO:tasks.workunit.client.0.smithi138.stderr: -435> 2024-09-14T11:39:36.285+0000 7f1fff8b29c0 5 AuthRegistry(0x56125617fde0) adding auth protocol: cephx 2024-09-14T11:39:36.859 INFO:tasks.workunit.client.0.smithi138.stderr: -434> 2024-09-14T11:39:36.285+0000 7f1fff8b29c0 5 AuthRegistry(0x56125617fde0) adding auth protocol: cephx 2024-09-14T11:39:36.859 INFO:tasks.workunit.client.0.smithi138.stderr: -433> 2024-09-14T11:39:36.285+0000 7f1fff8b29c0 5 AuthRegistry(0x56125617fde0) adding auth protocol: cephx 2024-09-14T11:39:36.859 INFO:tasks.workunit.client.0.smithi138.stderr: -432> 2024-09-14T11:39:36.285+0000 7f1fff8b29c0 5 AuthRegistry(0x56125617fde0) adding con mode: secure 2024-09-14T11:39:36.859 INFO:tasks.workunit.client.0.smithi138.stderr: -431> 2024-09-14T11:39:36.285+0000 7f1fff8b29c0 5 AuthRegistry(0x56125617fde0) adding con mode: crc 2024-09-14T11:39:36.859 INFO:tasks.workunit.client.0.smithi138.stderr: -430> 2024-09-14T11:39:36.285+0000 7f1fff8b29c0 5 AuthRegistry(0x56125617fde0) adding con mode: secure 2024-09-14T11:39:36.859 INFO:tasks.workunit.client.0.smithi138.stderr: -429> 2024-09-14T11:39:36.285+0000 7f1fff8b29c0 5 AuthRegistry(0x56125617fde0) adding con mode: crc 2024-09-14T11:39:36.859 INFO:tasks.workunit.client.0.smithi138.stderr: -428> 2024-09-14T11:39:36.285+0000 7f1fff8b29c0 5 AuthRegistry(0x56125617fde0) adding con mode: secure 2024-09-14T11:39:36.859 INFO:tasks.workunit.client.0.smithi138.stderr: -427> 2024-09-14T11:39:36.285+0000 7f1fff8b29c0 5 AuthRegistry(0x56125617fde0) adding con mode: crc 2024-09-14T11:39:36.859 INFO:tasks.workunit.client.0.smithi138.stderr: -426> 2024-09-14T11:39:36.285+0000 7f1fff8b29c0 5 AuthRegistry(0x56125617fde0) adding con mode: crc 2024-09-14T11:39:36.859 INFO:tasks.workunit.client.0.smithi138.stderr: -425> 2024-09-14T11:39:36.285+0000 7f1fff8b29c0 5 AuthRegistry(0x56125617fde0) adding con mode: secure 2024-09-14T11:39:36.859 INFO:tasks.workunit.client.0.smithi138.stderr: -424> 2024-09-14T11:39:36.285+0000 7f1fff8b29c0 5 AuthRegistry(0x56125617fde0) adding con mode: crc 2024-09-14T11:39:36.859 INFO:tasks.workunit.client.0.smithi138.stderr: -423> 2024-09-14T11:39:36.285+0000 7f1fff8b29c0 5 AuthRegistry(0x56125617fde0) adding con mode: secure 2024-09-14T11:39:36.859 INFO:tasks.workunit.client.0.smithi138.stderr: -422> 2024-09-14T11:39:36.285+0000 7f1fff8b29c0 5 AuthRegistry(0x56125617fde0) adding con mode: crc 2024-09-14T11:39:36.859 INFO:tasks.workunit.client.0.smithi138.stderr: -421> 2024-09-14T11:39:36.285+0000 7f1fff8b29c0 5 AuthRegistry(0x56125617fde0) adding con mode: secure 2024-09-14T11:39:36.860 INFO:tasks.workunit.client.0.smithi138.stderr: -420> 2024-09-14T11:39:36.285+0000 7f1fff8b29c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:39:36.860 INFO:tasks.workunit.client.0.smithi138.stderr: -419> 2024-09-14T11:39:36.285+0000 7f1fff8b29c0 5 asok(0x561255f1dd90) register_command objecter_requests cmddesc objecter_requests hook 0x561256183810 EEXIST 2024-09-14T11:39:36.860 INFO:tasks.workunit.client.0.smithi138.stderr: -418> 2024-09-14T11:39:36.285+0000 7f1fff8b29c0 10 monclient: init 2024-09-14T11:39:36.860 INFO:tasks.workunit.client.0.smithi138.stderr: -417> 2024-09-14T11:39:36.285+0000 7f1fff8b29c0 5 AuthRegistry(0x56125617ecd8) adding auth protocol: cephx 2024-09-14T11:39:36.860 INFO:tasks.workunit.client.0.smithi138.stderr: -416> 2024-09-14T11:39:36.285+0000 7f1fff8b29c0 5 AuthRegistry(0x56125617ecd8) adding auth protocol: cephx 2024-09-14T11:39:36.860 INFO:tasks.workunit.client.0.smithi138.stderr: -415> 2024-09-14T11:39:36.285+0000 7f1fff8b29c0 5 AuthRegistry(0x56125617ecd8) adding auth protocol: cephx 2024-09-14T11:39:36.860 INFO:tasks.workunit.client.0.smithi138.stderr: -414> 2024-09-14T11:39:36.285+0000 7f1fff8b29c0 5 AuthRegistry(0x56125617ecd8) adding con mode: secure 2024-09-14T11:39:36.860 INFO:tasks.workunit.client.0.smithi138.stderr: -413> 2024-09-14T11:39:36.285+0000 7f1fff8b29c0 5 AuthRegistry(0x56125617ecd8) adding con mode: crc 2024-09-14T11:39:36.860 INFO:tasks.workunit.client.0.smithi138.stderr: -412> 2024-09-14T11:39:36.285+0000 7f1fff8b29c0 5 AuthRegistry(0x56125617ecd8) adding con mode: secure 2024-09-14T11:39:36.860 INFO:tasks.workunit.client.0.smithi138.stderr: -411> 2024-09-14T11:39:36.285+0000 7f1fff8b29c0 5 AuthRegistry(0x56125617ecd8) adding con mode: crc 2024-09-14T11:39:36.860 INFO:tasks.workunit.client.0.smithi138.stderr: -410> 2024-09-14T11:39:36.285+0000 7f1fff8b29c0 5 AuthRegistry(0x56125617ecd8) adding con mode: secure 2024-09-14T11:39:36.860 INFO:tasks.workunit.client.0.smithi138.stderr: -409> 2024-09-14T11:39:36.285+0000 7f1fff8b29c0 5 AuthRegistry(0x56125617ecd8) adding con mode: crc 2024-09-14T11:39:36.860 INFO:tasks.workunit.client.0.smithi138.stderr: -408> 2024-09-14T11:39:36.285+0000 7f1fff8b29c0 5 AuthRegistry(0x56125617ecd8) adding con mode: crc 2024-09-14T11:39:36.860 INFO:tasks.workunit.client.0.smithi138.stderr: -407> 2024-09-14T11:39:36.285+0000 7f1fff8b29c0 5 AuthRegistry(0x56125617ecd8) adding con mode: secure 2024-09-14T11:39:36.861 INFO:tasks.workunit.client.0.smithi138.stderr: -406> 2024-09-14T11:39:36.285+0000 7f1fff8b29c0 5 AuthRegistry(0x56125617ecd8) adding con mode: crc 2024-09-14T11:39:36.861 INFO:tasks.workunit.client.0.smithi138.stderr: -405> 2024-09-14T11:39:36.285+0000 7f1fff8b29c0 5 AuthRegistry(0x56125617ecd8) adding con mode: secure 2024-09-14T11:39:36.861 INFO:tasks.workunit.client.0.smithi138.stderr: -404> 2024-09-14T11:39:36.285+0000 7f1fff8b29c0 5 AuthRegistry(0x56125617ecd8) adding con mode: crc 2024-09-14T11:39:36.861 INFO:tasks.workunit.client.0.smithi138.stderr: -403> 2024-09-14T11:39:36.285+0000 7f1fff8b29c0 5 AuthRegistry(0x56125617ecd8) adding con mode: secure 2024-09-14T11:39:36.861 INFO:tasks.workunit.client.0.smithi138.stderr: -402> 2024-09-14T11:39:36.289+0000 7f1fff8b29c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:39:36.861 INFO:tasks.workunit.client.0.smithi138.stderr: -401> 2024-09-14T11:39:36.289+0000 7f1fff8b29c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:39:36.861 INFO:tasks.workunit.client.0.smithi138.stderr: -400> 2024-09-14T11:39:36.289+0000 7f1fff8b29c0 5 asok(0x561255f1dd90) register_command rotate-key cmddesc rotate-key hook 0x56125617ee20 EEXIST 2024-09-14T11:39:36.861 INFO:tasks.workunit.client.0.smithi138.stderr: -399> 2024-09-14T11:39:36.289+0000 7f1fff8b29c0 10 monclient: _reopen_session rank -1 2024-09-14T11:39:36.861 INFO:tasks.workunit.client.0.smithi138.stderr: -398> 2024-09-14T11:39:36.289+0000 7f1fff8b29c0 10 monclient: _add_conns ranks=[2,0,1] 2024-09-14T11:39:36.861 INFO:tasks.workunit.client.0.smithi138.stderr: -397> 2024-09-14T11:39:36.289+0000 7f1fff8b29c0 10 monclient(hunting): picked mon.noname-c con 0x5612561a79c0 addr [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] 2024-09-14T11:39:36.861 INFO:tasks.workunit.client.0.smithi138.stderr: -396> 2024-09-14T11:39:36.289+0000 7f1fff8b29c0 10 monclient(hunting): picked mon.noname-a con 0x5612561a72f0 addr [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] 2024-09-14T11:39:36.861 INFO:tasks.workunit.client.0.smithi138.stderr: -395> 2024-09-14T11:39:36.289+0000 7f1fff8b29c0 10 monclient(hunting): picked mon.noname-b con 0x5612561a5cd0 addr [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] 2024-09-14T11:39:36.861 INFO:tasks.workunit.client.0.smithi138.stderr: -394> 2024-09-14T11:39:36.289+0000 7f1fff8b29c0 10 monclient(hunting): start opening mon connection 2024-09-14T11:39:36.862 INFO:tasks.workunit.client.0.smithi138.stderr: -393> 2024-09-14T11:39:36.289+0000 7f1fff8b29c0 10 monclient(hunting): start opening mon connection 2024-09-14T11:39:36.862 INFO:tasks.workunit.client.0.smithi138.stderr: -392> 2024-09-14T11:39:36.289+0000 7f1fff8b29c0 10 monclient(hunting): start opening mon connection 2024-09-14T11:39:36.862 INFO:tasks.workunit.client.0.smithi138.stderr: -391> 2024-09-14T11:39:36.289+0000 7f1fff8b29c0 10 monclient(hunting): _renew_subs 2024-09-14T11:39:36.862 INFO:tasks.workunit.client.0.smithi138.stderr: -390> 2024-09-14T11:39:36.289+0000 7f1fff8b29c0 10 monclient(hunting): authenticate will time out at 2912.252450s 2024-09-14T11:39:36.862 INFO:tasks.workunit.client.0.smithi138.stderr: -389> 2024-09-14T11:39:36.289+0000 7f1ffcbb7640 10 monclient(hunting): get_auth_request con 0x5612561a79c0 auth_method 0 2024-09-14T11:39:36.862 INFO:tasks.workunit.client.0.smithi138.stderr: -388> 2024-09-14T11:39:36.289+0000 7f1ffcbb7640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:39:36.862 INFO:tasks.workunit.client.0.smithi138.stderr: -387> 2024-09-14T11:39:36.289+0000 7f1ffcbb7640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:39:36.862 INFO:tasks.workunit.client.0.smithi138.stderr: -386> 2024-09-14T11:39:36.289+0000 7f1ffcbb7640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:39:36.863 INFO:tasks.workunit.client.0.smithi138.stderr: -385> 2024-09-14T11:39:36.289+0000 7f1ffdbb9640 10 monclient(hunting): get_auth_request con 0x5612561a72f0 auth_method 0 2024-09-14T11:39:36.863 INFO:tasks.workunit.client.0.smithi138.stderr: -384> 2024-09-14T11:39:36.289+0000 7f1ffdbb9640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:39:36.863 INFO:tasks.workunit.client.0.smithi138.stderr: -383> 2024-09-14T11:39:36.289+0000 7f1ffdbb9640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:39:36.863 INFO:tasks.workunit.client.0.smithi138.stderr: -382> 2024-09-14T11:39:36.289+0000 7f1ffdbb9640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:39:36.863 INFO:tasks.workunit.client.0.smithi138.stderr: -381> 2024-09-14T11:39:36.289+0000 7f1ffcbb7640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:39:36.863 INFO:tasks.workunit.client.0.smithi138.stderr: -380> 2024-09-14T11:39:36.289+0000 7f1ffcbb7640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:39:36.863 INFO:tasks.workunit.client.0.smithi138.stderr: -379> 2024-09-14T11:39:36.289+0000 7f1ffcbb7640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:39:36.863 INFO:tasks.workunit.client.0.smithi138.stderr: -378> 2024-09-14T11:39:36.289+0000 7f1ffdbb9640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:39:36.863 INFO:tasks.workunit.client.0.smithi138.stderr: -377> 2024-09-14T11:39:36.289+0000 7f1ffdbb9640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:39:36.863 INFO:tasks.workunit.client.0.smithi138.stderr: -376> 2024-09-14T11:39:36.289+0000 7f1ffdbb9640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:39:36.863 INFO:tasks.workunit.client.0.smithi138.stderr: -375> 2024-09-14T11:39:36.289+0000 7f1ffdbb9640 10 monclient(hunting): handle_auth_done global_id 8013 payload 824 2024-09-14T11:39:36.863 INFO:tasks.workunit.client.0.smithi138.stderr: -374> 2024-09-14T11:39:36.289+0000 7f1ffdbb9640 10 monclient: _finish_hunting 0 2024-09-14T11:39:36.864 INFO:tasks.workunit.client.0.smithi138.stderr: -373> 2024-09-14T11:39:36.289+0000 7f1ffdbb9640 1 monclient: found mon.noname-a 2024-09-14T11:39:36.864 INFO:tasks.workunit.client.0.smithi138.stderr: -372> 2024-09-14T11:39:36.289+0000 7f1ffdbb9640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.138:3300/0 2024-09-14T11:39:36.864 INFO:tasks.workunit.client.0.smithi138.stderr: -371> 2024-09-14T11:39:36.289+0000 7f1ffd3b8640 10 monclient: get_auth_request con 0x5612561a5cd0 auth_method 0 2024-09-14T11:39:36.864 INFO:tasks.workunit.client.0.smithi138.stderr: -370> 2024-09-14T11:39:36.289+0000 7f1ee2ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:39:36.864 INFO:tasks.workunit.client.0.smithi138.stderr: -369> 2024-09-14T11:39:36.289+0000 7f1ee2ffd640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-14T11:39:36.864 INFO:tasks.workunit.client.0.smithi138.stderr: -368> 2024-09-14T11:39:36.289+0000 7f1ee2ffd640 10 monclient: dump: 2024-09-14T11:39:36.864 INFO:tasks.workunit.client.0.smithi138.stderr:epoch 1 2024-09-14T11:39:36.864 INFO:tasks.workunit.client.0.smithi138.stderr:fsid 3f225f43-83a6-4aeb-b798-1f04bb49d597 2024-09-14T11:39:36.864 INFO:tasks.workunit.client.0.smithi138.stderr:last_changed 2024-09-14T11:07:09.252780+0000 2024-09-14T11:39:36.864 INFO:tasks.workunit.client.0.smithi138.stderr:created 2024-09-14T11:07:09.252780+0000 2024-09-14T11:39:36.864 INFO:tasks.workunit.client.0.smithi138.stderr:min_mon_release 19 (squid) 2024-09-14T11:39:36.864 INFO:tasks.workunit.client.0.smithi138.stderr:election_strategy: 1 2024-09-14T11:39:36.864 INFO:tasks.workunit.client.0.smithi138.stderr:0: [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] mon.a 2024-09-14T11:39:36.864 INFO:tasks.workunit.client.0.smithi138.stderr:1: [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] mon.b 2024-09-14T11:39:36.865 INFO:tasks.workunit.client.0.smithi138.stderr:2: [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] mon.c 2024-09-14T11:39:36.865 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-14T11:39:36.865 INFO:tasks.workunit.client.0.smithi138.stderr: -367> 2024-09-14T11:39:36.289+0000 7f1ee2ffd640 10 monclient: _finish_auth 0 2024-09-14T11:39:36.865 INFO:tasks.workunit.client.0.smithi138.stderr: -366> 2024-09-14T11:39:36.289+0000 7f1ee2ffd640 10 monclient: _check_auth_tickets 2024-09-14T11:39:36.865 INFO:tasks.workunit.client.0.smithi138.stderr: -365> 2024-09-14T11:39:36.289+0000 7f1fff8b29c0 5 monclient: authenticate success, global_id 8013 2024-09-14T11:39:36.865 INFO:tasks.workunit.client.0.smithi138.stderr: -364> 2024-09-14T11:39:36.289+0000 7f1ee2ffd640 10 monclient: handle_config config(0 keys) 2024-09-14T11:39:36.865 INFO:tasks.workunit.client.0.smithi138.stderr: -363> 2024-09-14T11:39:36.289+0000 7f1ee2ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:39:36.865 INFO:tasks.workunit.client.0.smithi138.stderr: -362> 2024-09-14T11:39:36.289+0000 7f1ee2ffd640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-14T11:39:36.865 INFO:tasks.workunit.client.0.smithi138.stderr: -361> 2024-09-14T11:39:36.289+0000 7f1ee2ffd640 10 monclient: dump: 2024-09-14T11:39:36.865 INFO:tasks.workunit.client.0.smithi138.stderr:epoch 1 2024-09-14T11:39:36.865 INFO:tasks.workunit.client.0.smithi138.stderr:fsid 3f225f43-83a6-4aeb-b798-1f04bb49d597 2024-09-14T11:39:36.865 INFO:tasks.workunit.client.0.smithi138.stderr:last_changed 2024-09-14T11:07:09.252780+0000 2024-09-14T11:39:36.865 INFO:tasks.workunit.client.0.smithi138.stderr:created 2024-09-14T11:07:09.252780+0000 2024-09-14T11:39:36.866 INFO:tasks.workunit.client.0.smithi138.stderr:min_mon_release 19 (squid) 2024-09-14T11:39:36.866 INFO:tasks.workunit.client.0.smithi138.stderr:election_strategy: 1 2024-09-14T11:39:36.866 INFO:tasks.workunit.client.0.smithi138.stderr:0: [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] mon.a 2024-09-14T11:39:36.866 INFO:tasks.workunit.client.0.smithi138.stderr:1: [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] mon.b 2024-09-14T11:39:36.866 INFO:tasks.workunit.client.0.smithi138.stderr:2: [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] mon.c 2024-09-14T11:39:36.866 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-14T11:39:36.866 INFO:tasks.workunit.client.0.smithi138.stderr: -360> 2024-09-14T11:39:36.289+0000 7f1ffe3ba640 4 set_mon_vals no callback set 2024-09-14T11:39:36.866 INFO:tasks.workunit.client.0.smithi138.stderr: -359> 2024-09-14T11:39:36.289+0000 7f1fff8b29c0 10 monclient: _renew_subs 2024-09-14T11:39:36.866 INFO:tasks.workunit.client.0.smithi138.stderr: -358> 2024-09-14T11:39:36.289+0000 7f1fff8b29c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.138:3300/0 2024-09-14T11:39:36.866 INFO:tasks.workunit.client.0.smithi138.stderr: -357> 2024-09-14T11:39:36.289+0000 7f1fff8b29c0 10 monclient: _renew_subs 2024-09-14T11:39:36.866 INFO:tasks.workunit.client.0.smithi138.stderr: -356> 2024-09-14T11:39:36.289+0000 7f1fff8b29c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.138:3300/0 2024-09-14T11:39:36.866 INFO:tasks.workunit.client.0.smithi138.stderr: -355> 2024-09-14T11:39:36.289+0000 7f1ee2ffd640 4 mgrc handle_mgr_map Got map version 5 2024-09-14T11:39:36.866 INFO:tasks.workunit.client.0.smithi138.stderr: -354> 2024-09-14T11:39:36.289+0000 7f1ee2ffd640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.138:6832/3778043143,v1:172.21.15.138:6833/3778043143] 2024-09-14T11:39:36.866 INFO:tasks.workunit.client.0.smithi138.stderr: -353> 2024-09-14T11:39:36.289+0000 7f1ee2ffd640 4 mgrc reconnect Starting new session with [v2:172.21.15.138:6832/3778043143,v1:172.21.15.138:6833/3778043143] 2024-09-14T11:39:36.867 INFO:tasks.workunit.client.0.smithi138.stderr: -352> 2024-09-14T11:39:36.289+0000 7f1ffcbb7640 10 monclient: get_auth_request con 0x7f1ed40717e0 auth_method 0 2024-09-14T11:39:36.867 INFO:tasks.workunit.client.0.smithi138.stderr: -351> 2024-09-14T11:39:36.289+0000 7f1fff8b29c0 10 monclient: get_monmap_and_config 2024-09-14T11:39:36.867 INFO:tasks.workunit.client.0.smithi138.stderr: -350> 2024-09-14T11:39:36.289+0000 7f1fff8b29c0 10 monclient: build_initial_monmap 2024-09-14T11:39:36.867 INFO:tasks.workunit.client.0.smithi138.stderr: -349> 2024-09-14T11:39:36.289+0000 7f1fff8b29c0 1 build_initial for_mkfs: 0 2024-09-14T11:39:36.867 INFO:tasks.workunit.client.0.smithi138.stderr: -348> 2024-09-14T11:39:36.289+0000 7f1fff8b29c0 10 monclient: monmap: 2024-09-14T11:39:36.867 INFO:tasks.workunit.client.0.smithi138.stderr:epoch 0 2024-09-14T11:39:36.867 INFO:tasks.workunit.client.0.smithi138.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-14T11:39:36.867 INFO:tasks.workunit.client.0.smithi138.stderr:last_changed 0.000000 2024-09-14T11:39:36.867 INFO:tasks.workunit.client.0.smithi138.stderr:created 0.000000 2024-09-14T11:39:36.867 INFO:tasks.workunit.client.0.smithi138.stderr:min_mon_release 0 (unknown) 2024-09-14T11:39:36.867 INFO:tasks.workunit.client.0.smithi138.stderr:election_strategy: 1 2024-09-14T11:39:36.867 INFO:tasks.workunit.client.0.smithi138.stderr:0: [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] mon.noname-a 2024-09-14T11:39:36.867 INFO:tasks.workunit.client.0.smithi138.stderr:1: [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] mon.noname-b 2024-09-14T11:39:36.867 INFO:tasks.workunit.client.0.smithi138.stderr:2: [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] mon.noname-c 2024-09-14T11:39:36.867 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-14T11:39:36.868 INFO:tasks.workunit.client.0.smithi138.stderr: -347> 2024-09-14T11:39:36.293+0000 7f1fff8b29c0 5 AuthRegistry(0x5612561c7160) adding auth protocol: cephx 2024-09-14T11:39:36.868 INFO:tasks.workunit.client.0.smithi138.stderr: -346> 2024-09-14T11:39:36.293+0000 7f1fff8b29c0 5 AuthRegistry(0x5612561c7160) adding auth protocol: cephx 2024-09-14T11:39:36.868 INFO:tasks.workunit.client.0.smithi138.stderr: -345> 2024-09-14T11:39:36.293+0000 7f1fff8b29c0 5 AuthRegistry(0x5612561c7160) adding auth protocol: cephx 2024-09-14T11:39:36.868 INFO:tasks.workunit.client.0.smithi138.stderr: -344> 2024-09-14T11:39:36.293+0000 7f1fff8b29c0 5 AuthRegistry(0x5612561c7160) adding con mode: secure 2024-09-14T11:39:36.868 INFO:tasks.workunit.client.0.smithi138.stderr: -343> 2024-09-14T11:39:36.293+0000 7f1fff8b29c0 5 AuthRegistry(0x5612561c7160) adding con mode: crc 2024-09-14T11:39:36.868 INFO:tasks.workunit.client.0.smithi138.stderr: -342> 2024-09-14T11:39:36.293+0000 7f1fff8b29c0 5 AuthRegistry(0x5612561c7160) adding con mode: secure 2024-09-14T11:39:36.868 INFO:tasks.workunit.client.0.smithi138.stderr: -341> 2024-09-14T11:39:36.293+0000 7f1fff8b29c0 5 AuthRegistry(0x5612561c7160) adding con mode: crc 2024-09-14T11:39:36.868 INFO:tasks.workunit.client.0.smithi138.stderr: -340> 2024-09-14T11:39:36.293+0000 7f1fff8b29c0 5 AuthRegistry(0x5612561c7160) adding con mode: secure 2024-09-14T11:39:36.868 INFO:tasks.workunit.client.0.smithi138.stderr: -339> 2024-09-14T11:39:36.293+0000 7f1fff8b29c0 5 AuthRegistry(0x5612561c7160) adding con mode: crc 2024-09-14T11:39:36.868 INFO:tasks.workunit.client.0.smithi138.stderr: -338> 2024-09-14T11:39:36.293+0000 7f1fff8b29c0 5 AuthRegistry(0x5612561c7160) adding con mode: crc 2024-09-14T11:39:36.868 INFO:tasks.workunit.client.0.smithi138.stderr: -337> 2024-09-14T11:39:36.293+0000 7f1fff8b29c0 5 AuthRegistry(0x5612561c7160) adding con mode: secure 2024-09-14T11:39:36.868 INFO:tasks.workunit.client.0.smithi138.stderr: -336> 2024-09-14T11:39:36.293+0000 7f1fff8b29c0 5 AuthRegistry(0x5612561c7160) adding con mode: crc 2024-09-14T11:39:36.868 INFO:tasks.workunit.client.0.smithi138.stderr: -335> 2024-09-14T11:39:36.293+0000 7f1fff8b29c0 5 AuthRegistry(0x5612561c7160) adding con mode: secure 2024-09-14T11:39:36.869 INFO:tasks.workunit.client.0.smithi138.stderr: -334> 2024-09-14T11:39:36.293+0000 7f1fff8b29c0 5 AuthRegistry(0x5612561c7160) adding con mode: crc 2024-09-14T11:39:36.869 INFO:tasks.workunit.client.0.smithi138.stderr: -333> 2024-09-14T11:39:36.293+0000 7f1fff8b29c0 5 AuthRegistry(0x5612561c7160) adding con mode: secure 2024-09-14T11:39:36.869 INFO:tasks.workunit.client.0.smithi138.stderr: -332> 2024-09-14T11:39:36.293+0000 7f1fff8b29c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:39:36.869 INFO:tasks.workunit.client.0.smithi138.stderr: -331> 2024-09-14T11:39:36.293+0000 7f1fff8b29c0 10 monclient: init 2024-09-14T11:39:36.869 INFO:tasks.workunit.client.0.smithi138.stderr: -330> 2024-09-14T11:39:36.293+0000 7f1fff8b29c0 5 AuthRegistry(0x7fffbf76b4b0) adding auth protocol: cephx 2024-09-14T11:39:36.869 INFO:tasks.workunit.client.0.smithi138.stderr: -329> 2024-09-14T11:39:36.293+0000 7f1fff8b29c0 5 AuthRegistry(0x7fffbf76b4b0) adding auth protocol: cephx 2024-09-14T11:39:36.869 INFO:tasks.workunit.client.0.smithi138.stderr: -328> 2024-09-14T11:39:36.293+0000 7f1fff8b29c0 5 AuthRegistry(0x7fffbf76b4b0) adding auth protocol: cephx 2024-09-14T11:39:36.869 INFO:tasks.workunit.client.0.smithi138.stderr: -327> 2024-09-14T11:39:36.293+0000 7f1fff8b29c0 5 AuthRegistry(0x7fffbf76b4b0) adding con mode: secure 2024-09-14T11:39:36.869 INFO:tasks.workunit.client.0.smithi138.stderr: -326> 2024-09-14T11:39:36.293+0000 7f1fff8b29c0 5 AuthRegistry(0x7fffbf76b4b0) adding con mode: crc 2024-09-14T11:39:36.869 INFO:tasks.workunit.client.0.smithi138.stderr: -325> 2024-09-14T11:39:36.293+0000 7f1fff8b29c0 5 AuthRegistry(0x7fffbf76b4b0) adding con mode: secure 2024-09-14T11:39:36.869 INFO:tasks.workunit.client.0.smithi138.stderr: -324> 2024-09-14T11:39:36.293+0000 7f1fff8b29c0 5 AuthRegistry(0x7fffbf76b4b0) adding con mode: crc 2024-09-14T11:39:36.869 INFO:tasks.workunit.client.0.smithi138.stderr: -323> 2024-09-14T11:39:36.293+0000 7f1fff8b29c0 5 AuthRegistry(0x7fffbf76b4b0) adding con mode: secure 2024-09-14T11:39:36.869 INFO:tasks.workunit.client.0.smithi138.stderr: -322> 2024-09-14T11:39:36.293+0000 7f1fff8b29c0 5 AuthRegistry(0x7fffbf76b4b0) adding con mode: crc 2024-09-14T11:39:36.870 INFO:tasks.workunit.client.0.smithi138.stderr: -321> 2024-09-14T11:39:36.293+0000 7f1fff8b29c0 5 AuthRegistry(0x7fffbf76b4b0) adding con mode: crc 2024-09-14T11:39:36.870 INFO:tasks.workunit.client.0.smithi138.stderr: -320> 2024-09-14T11:39:36.293+0000 7f1fff8b29c0 5 AuthRegistry(0x7fffbf76b4b0) adding con mode: secure 2024-09-14T11:39:36.870 INFO:tasks.workunit.client.0.smithi138.stderr: -319> 2024-09-14T11:39:36.293+0000 7f1fff8b29c0 5 AuthRegistry(0x7fffbf76b4b0) adding con mode: crc 2024-09-14T11:39:36.870 INFO:tasks.workunit.client.0.smithi138.stderr: -318> 2024-09-14T11:39:36.293+0000 7f1fff8b29c0 5 AuthRegistry(0x7fffbf76b4b0) adding con mode: secure 2024-09-14T11:39:36.870 INFO:tasks.workunit.client.0.smithi138.stderr: -317> 2024-09-14T11:39:36.293+0000 7f1fff8b29c0 5 AuthRegistry(0x7fffbf76b4b0) adding con mode: crc 2024-09-14T11:39:36.870 INFO:tasks.workunit.client.0.smithi138.stderr: -316> 2024-09-14T11:39:36.293+0000 7f1fff8b29c0 5 AuthRegistry(0x7fffbf76b4b0) adding con mode: secure 2024-09-14T11:39:36.870 INFO:tasks.workunit.client.0.smithi138.stderr: -315> 2024-09-14T11:39:36.293+0000 7f1fff8b29c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:39:36.870 INFO:tasks.workunit.client.0.smithi138.stderr: -314> 2024-09-14T11:39:36.293+0000 7f1fff8b29c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:39:36.870 INFO:tasks.workunit.client.0.smithi138.stderr: -313> 2024-09-14T11:39:36.293+0000 7f1fff8b29c0 5 asok(0x561255f1dd90) register_command rotate-key cmddesc rotate-key hook 0x7fffbf76b5f8 EEXIST 2024-09-14T11:39:36.870 INFO:tasks.workunit.client.0.smithi138.stderr: -312> 2024-09-14T11:39:36.293+0000 7f1fff8b29c0 10 monclient: _reopen_session rank -1 2024-09-14T11:39:36.870 INFO:tasks.workunit.client.0.smithi138.stderr: -311> 2024-09-14T11:39:36.293+0000 7f1fff8b29c0 10 monclient: _add_conns ranks=[1,2,0] 2024-09-14T11:39:36.870 INFO:tasks.workunit.client.0.smithi138.stderr: -310> 2024-09-14T11:39:36.293+0000 7f1fff8b29c0 10 monclient(hunting): picked mon.noname-b con 0x5612561fb4d0 addr [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] 2024-09-14T11:39:36.870 INFO:tasks.workunit.client.0.smithi138.stderr: -309> 2024-09-14T11:39:36.293+0000 7f1fff8b29c0 10 monclient(hunting): picked mon.noname-c con 0x5612561fb8b0 addr [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] 2024-09-14T11:39:36.870 INFO:tasks.workunit.client.0.smithi138.stderr: -308> 2024-09-14T11:39:36.293+0000 7f1fff8b29c0 10 monclient(hunting): picked mon.noname-a con 0x5612561f7090 addr [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] 2024-09-14T11:39:36.871 INFO:tasks.workunit.client.0.smithi138.stderr: -307> 2024-09-14T11:39:36.293+0000 7f1fff8b29c0 10 monclient(hunting): start opening mon connection 2024-09-14T11:39:36.871 INFO:tasks.workunit.client.0.smithi138.stderr: -306> 2024-09-14T11:39:36.293+0000 7f1fff8b29c0 10 monclient(hunting): start opening mon connection 2024-09-14T11:39:36.871 INFO:tasks.workunit.client.0.smithi138.stderr: -305> 2024-09-14T11:39:36.293+0000 7f1fff8b29c0 10 monclient(hunting): start opening mon connection 2024-09-14T11:39:36.871 INFO:tasks.workunit.client.0.smithi138.stderr: -304> 2024-09-14T11:39:36.293+0000 7f1fff8b29c0 10 monclient(hunting): _renew_subs 2024-09-14T11:39:36.871 INFO:tasks.workunit.client.0.smithi138.stderr: -303> 2024-09-14T11:39:36.293+0000 7f1fff8b29c0 10 monclient(hunting): authenticate will time out at 2912.257030s 2024-09-14T11:39:36.871 INFO:tasks.workunit.client.0.smithi138.stderr: -302> 2024-09-14T11:39:36.293+0000 7f1ffdbb9640 10 monclient(hunting): get_auth_request con 0x5612561fb8b0 auth_method 0 2024-09-14T11:39:36.871 INFO:tasks.workunit.client.0.smithi138.stderr: -301> 2024-09-14T11:39:36.293+0000 7f1ffdbb9640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:39:36.871 INFO:tasks.workunit.client.0.smithi138.stderr: -300> 2024-09-14T11:39:36.293+0000 7f1ffdbb9640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:39:36.871 INFO:tasks.workunit.client.0.smithi138.stderr: -299> 2024-09-14T11:39:36.293+0000 7f1ffdbb9640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:39:36.871 INFO:tasks.workunit.client.0.smithi138.stderr: -298> 2024-09-14T11:39:36.293+0000 7f1ffd3b8640 10 monclient(hunting): get_auth_request con 0x5612561f7090 auth_method 0 2024-09-14T11:39:36.871 INFO:tasks.workunit.client.0.smithi138.stderr: -297> 2024-09-14T11:39:36.293+0000 7f1ffd3b8640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:39:36.871 INFO:tasks.workunit.client.0.smithi138.stderr: -296> 2024-09-14T11:39:36.293+0000 7f1ffd3b8640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:39:36.871 INFO:tasks.workunit.client.0.smithi138.stderr: -295> 2024-09-14T11:39:36.293+0000 7f1ffd3b8640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:39:36.871 INFO:tasks.workunit.client.0.smithi138.stderr: -294> 2024-09-14T11:39:36.293+0000 7f1ffdbb9640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:39:36.872 INFO:tasks.workunit.client.0.smithi138.stderr: -293> 2024-09-14T11:39:36.293+0000 7f1ffdbb9640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:39:36.872 INFO:tasks.workunit.client.0.smithi138.stderr: -292> 2024-09-14T11:39:36.293+0000 7f1ffdbb9640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:39:36.872 INFO:tasks.workunit.client.0.smithi138.stderr: -291> 2024-09-14T11:39:36.293+0000 7f1ffd3b8640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:39:36.872 INFO:tasks.workunit.client.0.smithi138.stderr: -290> 2024-09-14T11:39:36.293+0000 7f1ffd3b8640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:39:36.872 INFO:tasks.workunit.client.0.smithi138.stderr: -289> 2024-09-14T11:39:36.293+0000 7f1ffd3b8640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:39:36.872 INFO:tasks.workunit.client.0.smithi138.stderr: -288> 2024-09-14T11:39:36.293+0000 7f1ffdbb9640 10 monclient(hunting): handle_auth_done global_id 7496 payload 274 2024-09-14T11:39:36.872 INFO:tasks.workunit.client.0.smithi138.stderr: -287> 2024-09-14T11:39:36.293+0000 7f1ffdbb9640 10 monclient: _finish_hunting 0 2024-09-14T11:39:36.872 INFO:tasks.workunit.client.0.smithi138.stderr: -286> 2024-09-14T11:39:36.293+0000 7f1ffdbb9640 1 monclient: found mon.noname-c 2024-09-14T11:39:36.872 INFO:tasks.workunit.client.0.smithi138.stderr: -285> 2024-09-14T11:39:36.293+0000 7f1ffdbb9640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.138:3301/0 2024-09-14T11:39:36.872 INFO:tasks.workunit.client.0.smithi138.stderr: -284> 2024-09-14T11:39:36.293+0000 7f1ee0ff9640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:39:36.872 INFO:tasks.workunit.client.0.smithi138.stderr: -283> 2024-09-14T11:39:36.293+0000 7f1ee0ff9640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-14T11:39:36.872 INFO:tasks.workunit.client.0.smithi138.stderr: -282> 2024-09-14T11:39:36.293+0000 7f1ee0ff9640 10 monclient: dump: 2024-09-14T11:39:36.872 INFO:tasks.workunit.client.0.smithi138.stderr:epoch 1 2024-09-14T11:39:36.873 INFO:tasks.workunit.client.0.smithi138.stderr:fsid 3f225f43-83a6-4aeb-b798-1f04bb49d597 2024-09-14T11:39:36.873 INFO:tasks.workunit.client.0.smithi138.stderr:last_changed 2024-09-14T11:07:09.252780+0000 2024-09-14T11:39:36.873 INFO:tasks.workunit.client.0.smithi138.stderr:created 2024-09-14T11:07:09.252780+0000 2024-09-14T11:39:36.873 INFO:tasks.workunit.client.0.smithi138.stderr:min_mon_release 19 (squid) 2024-09-14T11:39:36.873 INFO:tasks.workunit.client.0.smithi138.stderr:election_strategy: 1 2024-09-14T11:39:36.873 INFO:tasks.workunit.client.0.smithi138.stderr:0: [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] mon.a 2024-09-14T11:39:36.873 INFO:tasks.workunit.client.0.smithi138.stderr:1: [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] mon.b 2024-09-14T11:39:36.873 INFO:tasks.workunit.client.0.smithi138.stderr:2: [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] mon.c 2024-09-14T11:39:36.873 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-14T11:39:36.873 INFO:tasks.workunit.client.0.smithi138.stderr: -281> 2024-09-14T11:39:36.293+0000 7f1ee0ff9640 10 monclient: _finish_auth 0 2024-09-14T11:39:36.873 INFO:tasks.workunit.client.0.smithi138.stderr: -280> 2024-09-14T11:39:36.293+0000 7f1ee0ff9640 10 monclient: _check_auth_tickets 2024-09-14T11:39:36.873 INFO:tasks.workunit.client.0.smithi138.stderr: -279> 2024-09-14T11:39:36.293+0000 7f1ee0ff9640 10 monclient: handle_config config(0 keys) 2024-09-14T11:39:36.873 INFO:tasks.workunit.client.0.smithi138.stderr: -278> 2024-09-14T11:39:36.293+0000 7f1fff8b29c0 5 monclient: authenticate success, global_id 7496 2024-09-14T11:39:36.873 INFO:tasks.workunit.client.0.smithi138.stderr: -277> 2024-09-14T11:39:36.293+0000 7f1fff8b29c0 10 monclient: get_monmap_and_config success 2024-09-14T11:39:36.874 INFO:tasks.workunit.client.0.smithi138.stderr: -276> 2024-09-14T11:39:36.293+0000 7f1fff8b29c0 4 set_mon_vals no callback set 2024-09-14T11:39:36.874 INFO:tasks.workunit.client.0.smithi138.stderr: -275> 2024-09-14T11:39:36.293+0000 7f1ee0ff9640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:39:36.874 INFO:tasks.workunit.client.0.smithi138.stderr: -274> 2024-09-14T11:39:36.293+0000 7f1ee0ff9640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-14T11:39:36.874 INFO:tasks.workunit.client.0.smithi138.stderr: -273> 2024-09-14T11:39:36.293+0000 7f1ee0ff9640 10 monclient: dump: 2024-09-14T11:39:36.874 INFO:tasks.workunit.client.0.smithi138.stderr:epoch 1 2024-09-14T11:39:36.874 INFO:tasks.workunit.client.0.smithi138.stderr:fsid 3f225f43-83a6-4aeb-b798-1f04bb49d597 2024-09-14T11:39:36.874 INFO:tasks.workunit.client.0.smithi138.stderr:last_changed 2024-09-14T11:07:09.252780+0000 2024-09-14T11:39:36.874 INFO:tasks.workunit.client.0.smithi138.stderr:created 2024-09-14T11:07:09.252780+0000 2024-09-14T11:39:36.874 INFO:tasks.workunit.client.0.smithi138.stderr:min_mon_release 19 (squid) 2024-09-14T11:39:36.874 INFO:tasks.workunit.client.0.smithi138.stderr:election_strategy: 1 2024-09-14T11:39:36.874 INFO:tasks.workunit.client.0.smithi138.stderr:0: [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] mon.a 2024-09-14T11:39:36.874 INFO:tasks.workunit.client.0.smithi138.stderr:1: [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] mon.b 2024-09-14T11:39:36.874 INFO:tasks.workunit.client.0.smithi138.stderr:2: [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] mon.c 2024-09-14T11:39:36.874 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-14T11:39:36.875 INFO:tasks.workunit.client.0.smithi138.stderr: -272> 2024-09-14T11:39:36.293+0000 7f1fff8b29c0 10 monclient: shutdown 2024-09-14T11:39:36.875 INFO:tasks.workunit.client.0.smithi138.stderr: -271> 2024-09-14T11:39:36.293+0000 7f1fff8b29c0 10 monclient: build_initial_monmap 2024-09-14T11:39:36.875 INFO:tasks.workunit.client.0.smithi138.stderr: -270> 2024-09-14T11:39:36.293+0000 7f1fff8b29c0 1 build_initial for_mkfs: 0 2024-09-14T11:39:36.875 INFO:tasks.workunit.client.0.smithi138.stderr: -269> 2024-09-14T11:39:36.293+0000 7f1fff8b29c0 10 monclient: monmap: 2024-09-14T11:39:36.875 INFO:tasks.workunit.client.0.smithi138.stderr:epoch 0 2024-09-14T11:39:36.875 INFO:tasks.workunit.client.0.smithi138.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-14T11:39:36.875 INFO:tasks.workunit.client.0.smithi138.stderr:last_changed 0.000000 2024-09-14T11:39:36.875 INFO:tasks.workunit.client.0.smithi138.stderr:created 0.000000 2024-09-14T11:39:36.875 INFO:tasks.workunit.client.0.smithi138.stderr:min_mon_release 0 (unknown) 2024-09-14T11:39:36.875 INFO:tasks.workunit.client.0.smithi138.stderr:election_strategy: 1 2024-09-14T11:39:36.875 INFO:tasks.workunit.client.0.smithi138.stderr:0: [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] mon.noname-a 2024-09-14T11:39:36.875 INFO:tasks.workunit.client.0.smithi138.stderr:1: [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] mon.noname-b 2024-09-14T11:39:36.875 INFO:tasks.workunit.client.0.smithi138.stderr:2: [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] mon.noname-c 2024-09-14T11:39:36.875 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-14T11:39:36.876 INFO:tasks.workunit.client.0.smithi138.stderr: -268> 2024-09-14T11:39:36.293+0000 7f1fff8b29c0 5 AuthRegistry(0x5612561ebd10) adding auth protocol: cephx 2024-09-14T11:39:36.876 INFO:tasks.workunit.client.0.smithi138.stderr: -267> 2024-09-14T11:39:36.293+0000 7f1fff8b29c0 5 AuthRegistry(0x5612561ebd10) adding auth protocol: cephx 2024-09-14T11:39:36.876 INFO:tasks.workunit.client.0.smithi138.stderr: -266> 2024-09-14T11:39:36.293+0000 7f1fff8b29c0 5 AuthRegistry(0x5612561ebd10) adding auth protocol: cephx 2024-09-14T11:39:36.876 INFO:tasks.workunit.client.0.smithi138.stderr: -265> 2024-09-14T11:39:36.293+0000 7f1fff8b29c0 5 AuthRegistry(0x5612561ebd10) adding con mode: secure 2024-09-14T11:39:36.876 INFO:tasks.workunit.client.0.smithi138.stderr: -264> 2024-09-14T11:39:36.293+0000 7f1fff8b29c0 5 AuthRegistry(0x5612561ebd10) adding con mode: crc 2024-09-14T11:39:36.876 INFO:tasks.workunit.client.0.smithi138.stderr: -263> 2024-09-14T11:39:36.293+0000 7f1fff8b29c0 5 AuthRegistry(0x5612561ebd10) adding con mode: secure 2024-09-14T11:39:36.876 INFO:tasks.workunit.client.0.smithi138.stderr: -262> 2024-09-14T11:39:36.293+0000 7f1fff8b29c0 5 AuthRegistry(0x5612561ebd10) adding con mode: crc 2024-09-14T11:39:36.876 INFO:tasks.workunit.client.0.smithi138.stderr: -261> 2024-09-14T11:39:36.293+0000 7f1fff8b29c0 5 AuthRegistry(0x5612561ebd10) adding con mode: secure 2024-09-14T11:39:36.876 INFO:tasks.workunit.client.0.smithi138.stderr: -260> 2024-09-14T11:39:36.293+0000 7f1fff8b29c0 5 AuthRegistry(0x5612561ebd10) adding con mode: crc 2024-09-14T11:39:36.876 INFO:tasks.workunit.client.0.smithi138.stderr: -259> 2024-09-14T11:39:36.293+0000 7f1fff8b29c0 5 AuthRegistry(0x5612561ebd10) adding con mode: crc 2024-09-14T11:39:36.876 INFO:tasks.workunit.client.0.smithi138.stderr: -258> 2024-09-14T11:39:36.293+0000 7f1fff8b29c0 5 AuthRegistry(0x5612561ebd10) adding con mode: secure 2024-09-14T11:39:36.876 INFO:tasks.workunit.client.0.smithi138.stderr: -257> 2024-09-14T11:39:36.293+0000 7f1fff8b29c0 5 AuthRegistry(0x5612561ebd10) adding con mode: crc 2024-09-14T11:39:36.876 INFO:tasks.workunit.client.0.smithi138.stderr: -256> 2024-09-14T11:39:36.293+0000 7f1fff8b29c0 5 AuthRegistry(0x5612561ebd10) adding con mode: secure 2024-09-14T11:39:36.877 INFO:tasks.workunit.client.0.smithi138.stderr: -255> 2024-09-14T11:39:36.293+0000 7f1fff8b29c0 5 AuthRegistry(0x5612561ebd10) adding con mode: crc 2024-09-14T11:39:36.877 INFO:tasks.workunit.client.0.smithi138.stderr: -254> 2024-09-14T11:39:36.293+0000 7f1fff8b29c0 5 AuthRegistry(0x5612561ebd10) adding con mode: secure 2024-09-14T11:39:36.877 INFO:tasks.workunit.client.0.smithi138.stderr: -253> 2024-09-14T11:39:36.293+0000 7f1fff8b29c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:39:36.877 INFO:tasks.workunit.client.0.smithi138.stderr: -252> 2024-09-14T11:39:36.293+0000 7f1fff8b29c0 1 librados: starting msgr at 2024-09-14T11:39:36.877 INFO:tasks.workunit.client.0.smithi138.stderr: -251> 2024-09-14T11:39:36.293+0000 7f1fff8b29c0 1 librados: starting objecter 2024-09-14T11:39:36.877 INFO:tasks.workunit.client.0.smithi138.stderr: -250> 2024-09-14T11:39:36.293+0000 7f1fff8b29c0 5 asok(0x561255f1dd90) register_command objecter_requests cmddesc objecter_requests hook 0x5612561c9b70 EEXIST 2024-09-14T11:39:36.877 INFO:tasks.workunit.client.0.smithi138.stderr: -249> 2024-09-14T11:39:36.293+0000 7f1fff8b29c0 1 librados: setting wanted keys 2024-09-14T11:39:36.877 INFO:tasks.workunit.client.0.smithi138.stderr: -248> 2024-09-14T11:39:36.293+0000 7f1fff8b29c0 1 librados: calling monclient init 2024-09-14T11:39:36.877 INFO:tasks.workunit.client.0.smithi138.stderr: -247> 2024-09-14T11:39:36.293+0000 7f1fff8b29c0 10 monclient: init 2024-09-14T11:39:36.877 INFO:tasks.workunit.client.0.smithi138.stderr: -246> 2024-09-14T11:39:36.293+0000 7f1fff8b29c0 5 AuthRegistry(0x5612561a97e0) adding auth protocol: cephx 2024-09-14T11:39:36.877 INFO:tasks.workunit.client.0.smithi138.stderr: -245> 2024-09-14T11:39:36.293+0000 7f1fff8b29c0 5 AuthRegistry(0x5612561a97e0) adding auth protocol: cephx 2024-09-14T11:39:36.877 INFO:tasks.workunit.client.0.smithi138.stderr: -244> 2024-09-14T11:39:36.293+0000 7f1fff8b29c0 5 AuthRegistry(0x5612561a97e0) adding auth protocol: cephx 2024-09-14T11:39:36.877 INFO:tasks.workunit.client.0.smithi138.stderr: -243> 2024-09-14T11:39:36.293+0000 7f1fff8b29c0 5 AuthRegistry(0x5612561a97e0) adding con mode: secure 2024-09-14T11:39:36.877 INFO:tasks.workunit.client.0.smithi138.stderr: -242> 2024-09-14T11:39:36.293+0000 7f1fff8b29c0 5 AuthRegistry(0x5612561a97e0) adding con mode: crc 2024-09-14T11:39:36.878 INFO:tasks.workunit.client.0.smithi138.stderr: -241> 2024-09-14T11:39:36.293+0000 7f1fff8b29c0 5 AuthRegistry(0x5612561a97e0) adding con mode: secure 2024-09-14T11:39:36.878 INFO:tasks.workunit.client.0.smithi138.stderr: -240> 2024-09-14T11:39:36.293+0000 7f1fff8b29c0 5 AuthRegistry(0x5612561a97e0) adding con mode: crc 2024-09-14T11:39:36.878 INFO:tasks.workunit.client.0.smithi138.stderr: -239> 2024-09-14T11:39:36.293+0000 7f1fff8b29c0 5 AuthRegistry(0x5612561a97e0) adding con mode: secure 2024-09-14T11:39:36.878 INFO:tasks.workunit.client.0.smithi138.stderr: -238> 2024-09-14T11:39:36.293+0000 7f1fff8b29c0 5 AuthRegistry(0x5612561a97e0) adding con mode: crc 2024-09-14T11:39:36.878 INFO:tasks.workunit.client.0.smithi138.stderr: -237> 2024-09-14T11:39:36.293+0000 7f1fff8b29c0 5 AuthRegistry(0x5612561a97e0) adding con mode: crc 2024-09-14T11:39:36.878 INFO:tasks.workunit.client.0.smithi138.stderr: -236> 2024-09-14T11:39:36.293+0000 7f1fff8b29c0 5 AuthRegistry(0x5612561a97e0) adding con mode: secure 2024-09-14T11:39:36.878 INFO:tasks.workunit.client.0.smithi138.stderr: -235> 2024-09-14T11:39:36.293+0000 7f1fff8b29c0 5 AuthRegistry(0x5612561a97e0) adding con mode: crc 2024-09-14T11:39:36.878 INFO:tasks.workunit.client.0.smithi138.stderr: -234> 2024-09-14T11:39:36.293+0000 7f1fff8b29c0 5 AuthRegistry(0x5612561a97e0) adding con mode: secure 2024-09-14T11:39:36.878 INFO:tasks.workunit.client.0.smithi138.stderr: -233> 2024-09-14T11:39:36.293+0000 7f1fff8b29c0 5 AuthRegistry(0x5612561a97e0) adding con mode: crc 2024-09-14T11:39:36.878 INFO:tasks.workunit.client.0.smithi138.stderr: -232> 2024-09-14T11:39:36.293+0000 7f1fff8b29c0 5 AuthRegistry(0x5612561a97e0) adding con mode: secure 2024-09-14T11:39:36.878 INFO:tasks.workunit.client.0.smithi138.stderr: -231> 2024-09-14T11:39:36.293+0000 7f1fff8b29c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:39:36.878 INFO:tasks.workunit.client.0.smithi138.stderr: -230> 2024-09-14T11:39:36.293+0000 7f1fff8b29c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:39:36.878 INFO:tasks.workunit.client.0.smithi138.stderr: -229> 2024-09-14T11:39:36.293+0000 7f1fff8b29c0 5 asok(0x561255f1dd90) register_command rotate-key cmddesc rotate-key hook 0x5612561a9928 EEXIST 2024-09-14T11:39:36.878 INFO:tasks.workunit.client.0.smithi138.stderr: -228> 2024-09-14T11:39:36.293+0000 7f1fff8b29c0 10 monclient: _reopen_session rank -1 2024-09-14T11:39:36.878 INFO:tasks.workunit.client.0.smithi138.stderr: -227> 2024-09-14T11:39:36.293+0000 7f1fff8b29c0 10 monclient: _add_conns ranks=[1,0,2] 2024-09-14T11:39:36.879 INFO:tasks.workunit.client.0.smithi138.stderr: -226> 2024-09-14T11:39:36.293+0000 7f1fff8b29c0 10 monclient(hunting): picked mon.noname-b con 0x5612561f7090 addr [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] 2024-09-14T11:39:36.879 INFO:tasks.workunit.client.0.smithi138.stderr: -225> 2024-09-14T11:39:36.293+0000 7f1fff8b29c0 10 monclient(hunting): picked mon.noname-a con 0x5612561fb4d0 addr [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] 2024-09-14T11:39:36.879 INFO:tasks.workunit.client.0.smithi138.stderr: -224> 2024-09-14T11:39:36.293+0000 7f1fff8b29c0 10 monclient(hunting): picked mon.noname-c con 0x5612561f3b90 addr [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] 2024-09-14T11:39:36.879 INFO:tasks.workunit.client.0.smithi138.stderr: -223> 2024-09-14T11:39:36.293+0000 7f1fff8b29c0 10 monclient(hunting): start opening mon connection 2024-09-14T11:39:36.879 INFO:tasks.workunit.client.0.smithi138.stderr: -222> 2024-09-14T11:39:36.293+0000 7f1fff8b29c0 10 monclient(hunting): start opening mon connection 2024-09-14T11:39:36.879 INFO:tasks.workunit.client.0.smithi138.stderr: -221> 2024-09-14T11:39:36.293+0000 7f1fff8b29c0 10 monclient(hunting): start opening mon connection 2024-09-14T11:39:36.879 INFO:tasks.workunit.client.0.smithi138.stderr: -220> 2024-09-14T11:39:36.293+0000 7f1fff8b29c0 10 monclient(hunting): _renew_subs 2024-09-14T11:39:36.879 INFO:tasks.workunit.client.0.smithi138.stderr: -219> 2024-09-14T11:39:36.293+0000 7f1fff8b29c0 10 monclient(hunting): authenticate will time out at 2912.259600s 2024-09-14T11:39:36.879 INFO:tasks.workunit.client.0.smithi138.stderr: -218> 2024-09-14T11:39:36.293+0000 7f1ffd3b8640 10 monclient(hunting): get_auth_request con 0x5612561f3b90 auth_method 0 2024-09-14T11:39:36.879 INFO:tasks.workunit.client.0.smithi138.stderr: -217> 2024-09-14T11:39:36.293+0000 7f1ffd3b8640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:39:36.879 INFO:tasks.workunit.client.0.smithi138.stderr: -216> 2024-09-14T11:39:36.293+0000 7f1ffd3b8640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:39:36.879 INFO:tasks.workunit.client.0.smithi138.stderr: -215> 2024-09-14T11:39:36.293+0000 7f1ffd3b8640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:39:36.879 INFO:tasks.workunit.client.0.smithi138.stderr: -214> 2024-09-14T11:39:36.293+0000 7f1ffdbb9640 10 monclient(hunting): get_auth_request con 0x5612561fb4d0 auth_method 0 2024-09-14T11:39:36.879 INFO:tasks.workunit.client.0.smithi138.stderr: -213> 2024-09-14T11:39:36.293+0000 7f1ffdbb9640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:39:36.879 INFO:tasks.workunit.client.0.smithi138.stderr: -212> 2024-09-14T11:39:36.293+0000 7f1ffdbb9640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:39:36.879 INFO:tasks.workunit.client.0.smithi138.stderr: -211> 2024-09-14T11:39:36.293+0000 7f1ffdbb9640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:39:36.880 INFO:tasks.workunit.client.0.smithi138.stderr: -210> 2024-09-14T11:39:36.293+0000 7f1ffd3b8640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:39:36.880 INFO:tasks.workunit.client.0.smithi138.stderr: -209> 2024-09-14T11:39:36.293+0000 7f1ffd3b8640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:39:36.880 INFO:tasks.workunit.client.0.smithi138.stderr: -208> 2024-09-14T11:39:36.293+0000 7f1ffd3b8640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:39:36.880 INFO:tasks.workunit.client.0.smithi138.stderr: -207> 2024-09-14T11:39:36.293+0000 7f1ffdbb9640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:39:36.880 INFO:tasks.workunit.client.0.smithi138.stderr: -206> 2024-09-14T11:39:36.293+0000 7f1ffdbb9640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:39:36.880 INFO:tasks.workunit.client.0.smithi138.stderr: -205> 2024-09-14T11:39:36.293+0000 7f1ffdbb9640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:39:36.880 INFO:tasks.workunit.client.0.smithi138.stderr: -204> 2024-09-14T11:39:36.293+0000 7f1ffdbb9640 10 monclient(hunting): handle_auth_done global_id 8019 payload 824 2024-09-14T11:39:36.880 INFO:tasks.workunit.client.0.smithi138.stderr: -203> 2024-09-14T11:39:36.297+0000 7f1ffdbb9640 10 monclient: _finish_hunting 0 2024-09-14T11:39:36.880 INFO:tasks.workunit.client.0.smithi138.stderr: -202> 2024-09-14T11:39:36.297+0000 7f1ffdbb9640 1 monclient: found mon.noname-a 2024-09-14T11:39:36.880 INFO:tasks.workunit.client.0.smithi138.stderr: -201> 2024-09-14T11:39:36.297+0000 7f1ffdbb9640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.138:3300/0 2024-09-14T11:39:36.880 INFO:tasks.workunit.client.0.smithi138.stderr: -200> 2024-09-14T11:39:36.297+0000 7f1ffcbb7640 10 monclient: get_auth_request con 0x5612561f7090 auth_method 0 2024-09-14T11:39:36.880 INFO:tasks.workunit.client.0.smithi138.stderr: -199> 2024-09-14T11:39:36.297+0000 7f1ed2ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:39:36.880 INFO:tasks.workunit.client.0.smithi138.stderr: -198> 2024-09-14T11:39:36.297+0000 7f1ed2ffd640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-14T11:39:36.880 INFO:tasks.workunit.client.0.smithi138.stderr: -197> 2024-09-14T11:39:36.297+0000 7f1ed2ffd640 10 monclient: dump: 2024-09-14T11:39:36.881 INFO:tasks.workunit.client.0.smithi138.stderr:epoch 1 2024-09-14T11:39:36.881 INFO:tasks.workunit.client.0.smithi138.stderr:fsid 3f225f43-83a6-4aeb-b798-1f04bb49d597 2024-09-14T11:39:36.881 INFO:tasks.workunit.client.0.smithi138.stderr:last_changed 2024-09-14T11:07:09.252780+0000 2024-09-14T11:39:36.881 INFO:tasks.workunit.client.0.smithi138.stderr:created 2024-09-14T11:07:09.252780+0000 2024-09-14T11:39:36.881 INFO:tasks.workunit.client.0.smithi138.stderr:min_mon_release 19 (squid) 2024-09-14T11:39:36.881 INFO:tasks.workunit.client.0.smithi138.stderr:election_strategy: 1 2024-09-14T11:39:36.881 INFO:tasks.workunit.client.0.smithi138.stderr:0: [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] mon.a 2024-09-14T11:39:36.881 INFO:tasks.workunit.client.0.smithi138.stderr:1: [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] mon.b 2024-09-14T11:39:36.881 INFO:tasks.workunit.client.0.smithi138.stderr:2: [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] mon.c 2024-09-14T11:39:36.881 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-14T11:39:36.881 INFO:tasks.workunit.client.0.smithi138.stderr: -196> 2024-09-14T11:39:36.297+0000 7f1ed2ffd640 10 monclient: _finish_auth 0 2024-09-14T11:39:36.881 INFO:tasks.workunit.client.0.smithi138.stderr: -195> 2024-09-14T11:39:36.297+0000 7f1ed2ffd640 10 monclient: _check_auth_tickets 2024-09-14T11:39:36.881 INFO:tasks.workunit.client.0.smithi138.stderr: -194> 2024-09-14T11:39:36.297+0000 7f1ed2ffd640 10 monclient: handle_config config(0 keys) 2024-09-14T11:39:36.882 INFO:tasks.workunit.client.0.smithi138.stderr: -193> 2024-09-14T11:39:36.297+0000 7f1ed2ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:39:36.882 INFO:tasks.workunit.client.0.smithi138.stderr: -192> 2024-09-14T11:39:36.297+0000 7f1ed2ffd640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-14T11:39:36.882 INFO:tasks.workunit.client.0.smithi138.stderr: -191> 2024-09-14T11:39:36.297+0000 7f1ed2ffd640 10 monclient: dump: 2024-09-14T11:39:36.882 INFO:tasks.workunit.client.0.smithi138.stderr:epoch 1 2024-09-14T11:39:36.882 INFO:tasks.workunit.client.0.smithi138.stderr:fsid 3f225f43-83a6-4aeb-b798-1f04bb49d597 2024-09-14T11:39:36.882 INFO:tasks.workunit.client.0.smithi138.stderr:last_changed 2024-09-14T11:07:09.252780+0000 2024-09-14T11:39:36.882 INFO:tasks.workunit.client.0.smithi138.stderr:created 2024-09-14T11:07:09.252780+0000 2024-09-14T11:39:36.882 INFO:tasks.workunit.client.0.smithi138.stderr:min_mon_release 19 (squid) 2024-09-14T11:39:36.882 INFO:tasks.workunit.client.0.smithi138.stderr:election_strategy: 1 2024-09-14T11:39:36.882 INFO:tasks.workunit.client.0.smithi138.stderr:0: [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] mon.a 2024-09-14T11:39:36.882 INFO:tasks.workunit.client.0.smithi138.stderr:1: [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] mon.b 2024-09-14T11:39:36.882 INFO:tasks.workunit.client.0.smithi138.stderr:2: [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] mon.c 2024-09-14T11:39:36.882 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-14T11:39:36.882 INFO:tasks.workunit.client.0.smithi138.stderr: -190> 2024-09-14T11:39:36.297+0000 7f1ee0ff9640 4 set_mon_vals no callback set 2024-09-14T11:39:36.882 INFO:tasks.workunit.client.0.smithi138.stderr: -189> 2024-09-14T11:39:36.297+0000 7f1fff8b29c0 5 monclient: authenticate success, global_id 8019 2024-09-14T11:39:36.883 INFO:tasks.workunit.client.0.smithi138.stderr: -188> 2024-09-14T11:39:36.297+0000 7f1fff8b29c0 10 monclient: _renew_subs 2024-09-14T11:39:36.883 INFO:tasks.workunit.client.0.smithi138.stderr: -187> 2024-09-14T11:39:36.297+0000 7f1fff8b29c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.138:3300/0 2024-09-14T11:39:36.883 INFO:tasks.workunit.client.0.smithi138.stderr: -186> 2024-09-14T11:39:36.297+0000 7f1fff8b29c0 10 monclient: _renew_subs 2024-09-14T11:39:36.883 INFO:tasks.workunit.client.0.smithi138.stderr: -185> 2024-09-14T11:39:36.297+0000 7f1fff8b29c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.138:3300/0 2024-09-14T11:39:36.883 INFO:tasks.workunit.client.0.smithi138.stderr: -184> 2024-09-14T11:39:36.297+0000 7f1fff8b29c0 1 librados: init done 2024-09-14T11:39:36.883 INFO:tasks.workunit.client.0.smithi138.stderr: -183> 2024-09-14T11:39:36.297+0000 7f1fff8b29c0 5 asok(0x561255f1dd90) register_command cr dump hook 0x7f1ff80f7b98 2024-09-14T11:39:36.883 INFO:tasks.workunit.client.0.smithi138.stderr: -182> 2024-09-14T11:39:36.297+0000 7f1fff8b29c0 20 rados->read ofs=0 len=0 2024-09-14T11:39:36.883 INFO:tasks.workunit.client.0.smithi138.stderr: -181> 2024-09-14T11:39:36.297+0000 7f1ed2ffd640 4 mgrc handle_mgr_map Got map version 5 2024-09-14T11:39:36.883 INFO:tasks.workunit.client.0.smithi138.stderr: -180> 2024-09-14T11:39:36.297+0000 7f1ed2ffd640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.138:6832/3778043143,v1:172.21.15.138:6833/3778043143] 2024-09-14T11:39:36.883 INFO:tasks.workunit.client.0.smithi138.stderr: -179> 2024-09-14T11:39:36.297+0000 7f1ed2ffd640 4 mgrc reconnect Starting new session with [v2:172.21.15.138:6832/3778043143,v1:172.21.15.138:6833/3778043143] 2024-09-14T11:39:36.883 INFO:tasks.workunit.client.0.smithi138.stderr: -178> 2024-09-14T11:39:36.297+0000 7f1ffcbb7640 10 monclient: get_auth_request con 0x7f1ec80718a0 auth_method 0 2024-09-14T11:39:36.883 INFO:tasks.workunit.client.0.smithi138.stderr: -177> 2024-09-14T11:39:36.297+0000 7f1ffd3b8640 10 monclient: get_auth_request con 0x561256214a20 auth_method 0 2024-09-14T11:39:36.883 INFO:tasks.workunit.client.0.smithi138.stderr: -176> 2024-09-14T11:39:36.301+0000 7f1fff8b29c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:39:36.883 INFO:tasks.workunit.client.0.smithi138.stderr: -175> 2024-09-14T11:39:36.301+0000 7f1fff8b29c0 20 realm 2024-09-14T11:39:36.883 INFO:tasks.workunit.client.0.smithi138.stderr: -174> 2024-09-14T11:39:36.301+0000 7f1fff8b29c0 20 rados->read ofs=0 len=0 2024-09-14T11:39:36.884 INFO:tasks.workunit.client.0.smithi138.stderr: -173> 2024-09-14T11:39:36.301+0000 7f1fff8b29c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:39:36.884 INFO:tasks.workunit.client.0.smithi138.stderr: -172> 2024-09-14T11:39:36.301+0000 7f1fff8b29c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:39:36.884 INFO:tasks.workunit.client.0.smithi138.stderr: -171> 2024-09-14T11:39:36.301+0000 7f1fff8b29c0 20 rados->read ofs=0 len=0 2024-09-14T11:39:36.884 INFO:tasks.workunit.client.0.smithi138.stderr: -170> 2024-09-14T11:39:36.301+0000 7f1fff8b29c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:39:36.884 INFO:tasks.workunit.client.0.smithi138.stderr: -169> 2024-09-14T11:39:36.301+0000 7f1fff8b29c0 20 rados->read ofs=0 len=0 2024-09-14T11:39:36.884 INFO:tasks.workunit.client.0.smithi138.stderr: -168> 2024-09-14T11:39:36.301+0000 7f1ffcbb7640 10 monclient: get_auth_request con 0x561256218ba0 auth_method 0 2024-09-14T11:39:36.884 INFO:tasks.workunit.client.0.smithi138.stderr: -167> 2024-09-14T11:39:36.301+0000 7f1fff8b29c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:39:36.884 INFO:tasks.workunit.client.0.smithi138.stderr: -166> 2024-09-14T11:39:36.301+0000 7f1fff8b29c0 20 rados->read ofs=0 len=0 2024-09-14T11:39:36.884 INFO:tasks.workunit.client.0.smithi138.stderr: -165> 2024-09-14T11:39:36.301+0000 7f1ffdbb9640 10 monclient: get_auth_request con 0x56125621c450 auth_method 0 2024-09-14T11:39:36.884 INFO:tasks.workunit.client.0.smithi138.stderr: -164> 2024-09-14T11:39:36.301+0000 7f1fff8b29c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:39:36.884 INFO:tasks.workunit.client.0.smithi138.stderr: -163> 2024-09-14T11:39:36.301+0000 7f1fff8b29c0 20 searching for the correct realm 2024-09-14T11:39:36.884 INFO:tasks.workunit.client.0.smithi138.stderr: -162> 2024-09-14T11:39:36.301+0000 7f1ffd3b8640 10 monclient: get_auth_request con 0x5612562211d0 auth_method 0 2024-09-14T11:39:36.884 INFO:tasks.workunit.client.0.smithi138.stderr: -161> 2024-09-14T11:39:36.305+0000 7f1ffcbb7640 10 monclient: get_auth_request con 0x7f1ff001b950 auth_method 0 2024-09-14T11:39:36.884 INFO:tasks.workunit.client.0.smithi138.stderr: -160> 2024-09-14T11:39:36.305+0000 7f1ffdbb9640 10 monclient: get_auth_request con 0x7f1ff80b8070 auth_method 0 2024-09-14T11:39:36.884 INFO:tasks.workunit.client.0.smithi138.stderr: -159> 2024-09-14T11:39:36.305+0000 7f1ffdbb9640 0 -- 172.21.15.138:0/2558815668 >> [v2:172.21.15.154:6824/416768175,v1:172.21.15.154:6825/416768175] conn(0x7f1ff80b8070 msgr2=0x7f1ff80f71e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:39:36.885 INFO:tasks.workunit.client.0.smithi138.stderr: -158> 2024-09-14T11:39:36.509+0000 7f1ffdbb9640 10 monclient: get_auth_request con 0x7f1ff80b8070 auth_method 0 2024-09-14T11:39:36.885 INFO:tasks.workunit.client.0.smithi138.stderr: -157> 2024-09-14T11:39:36.513+0000 7f1ffd3b8640 10 monclient: get_auth_request con 0x7f1ff8129080 auth_method 0 2024-09-14T11:39:36.885 INFO:tasks.workunit.client.0.smithi138.stderr: -156> 2024-09-14T11:39:36.521+0000 7f1ffcbb7640 10 monclient: get_auth_request con 0x7f1ff81013e0 auth_method 0 2024-09-14T11:39:36.885 INFO:tasks.workunit.client.0.smithi138.stderr: -155> 2024-09-14T11:39:36.521+0000 7f1ffcbb7640 0 -- 172.21.15.138:0/2558815668 >> [v2:172.21.15.138:6816/326481658,v1:172.21.15.138:6817/326481658] conn(0x7f1ff81013e0 msgr2=0x7f1ff811e000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-14T11:39:36.885 INFO:tasks.workunit.client.0.smithi138.stderr: -154> 2024-09-14T11:39:36.725+0000 7f1ffcbb7640 10 monclient: get_auth_request con 0x7f1ff81013e0 auth_method 0 2024-09-14T11:39:36.885 INFO:tasks.workunit.client.0.smithi138.stderr: -153> 2024-09-14T11:39:36.737+0000 7f1fff8b29c0 20 RGWRados::pool_iterate: got zone_info.d9e72d30-c60b-4d0d-9267-fdc36392d5ad 2024-09-14T11:39:36.885 INFO:tasks.workunit.client.0.smithi138.stderr: -152> 2024-09-14T11:39:36.737+0000 7f1fff8b29c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:39:36.885 INFO:tasks.workunit.client.0.smithi138.stderr: -151> 2024-09-14T11:39:36.737+0000 7f1fff8b29c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:39:36.885 INFO:tasks.workunit.client.0.smithi138.stderr: -150> 2024-09-14T11:39:36.737+0000 7f1fff8b29c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:39:36.885 INFO:tasks.workunit.client.0.smithi138.stderr: -149> 2024-09-14T11:39:36.737+0000 7f1fff8b29c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:39:36.885 INFO:tasks.workunit.client.0.smithi138.stderr: -148> 2024-09-14T11:39:36.737+0000 7f1fff8b29c0 20 RGWRados::pool_iterate: got zonegroup_info.65ab941b-da8c-4160-94fb-3672b069d44f 2024-09-14T11:39:36.885 INFO:tasks.workunit.client.0.smithi138.stderr: -147> 2024-09-14T11:39:36.737+0000 7f1fff8b29c0 20 rados->read ofs=0 len=0 2024-09-14T11:39:36.885 INFO:tasks.workunit.client.0.smithi138.stderr: -146> 2024-09-14T11:39:36.737+0000 7f1fff8b29c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:39:36.886 INFO:tasks.workunit.client.0.smithi138.stderr: -145> 2024-09-14T11:39:36.737+0000 7f1fff8b29c0 20 rados->read ofs=0 len=0 2024-09-14T11:39:36.886 INFO:tasks.workunit.client.0.smithi138.stderr: -144> 2024-09-14T11:39:36.737+0000 7f1fff8b29c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:39:36.886 INFO:tasks.workunit.client.0.smithi138.stderr: -143> 2024-09-14T11:39:36.737+0000 7f1fff8b29c0 20 rados->read ofs=0 len=0 2024-09-14T11:39:36.886 INFO:tasks.workunit.client.0.smithi138.stderr: -142> 2024-09-14T11:39:36.741+0000 7f1fff8b29c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:39:36.886 INFO:tasks.workunit.client.0.smithi138.stderr: -141> 2024-09-14T11:39:36.741+0000 7f1fff8b29c0 20 zone default found 2024-09-14T11:39:36.886 INFO:tasks.workunit.client.0.smithi138.stderr: -140> 2024-09-14T11:39:36.741+0000 7f1fff8b29c0 4 Realm: () 2024-09-14T11:39:36.886 INFO:tasks.workunit.client.0.smithi138.stderr: -139> 2024-09-14T11:39:36.741+0000 7f1fff8b29c0 4 ZoneGroup: default (65ab941b-da8c-4160-94fb-3672b069d44f) 2024-09-14T11:39:36.886 INFO:tasks.workunit.client.0.smithi138.stderr: -138> 2024-09-14T11:39:36.741+0000 7f1fff8b29c0 4 Zone: default (d9e72d30-c60b-4d0d-9267-fdc36392d5ad) 2024-09-14T11:39:36.886 INFO:tasks.workunit.client.0.smithi138.stderr: -137> 2024-09-14T11:39:36.741+0000 7f1fff8b29c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:39:36.886 INFO:tasks.workunit.client.0.smithi138.stderr: -136> 2024-09-14T11:39:36.741+0000 7f1fff8b29c0 20 zonegroup default 2024-09-14T11:39:36.886 INFO:tasks.workunit.client.0.smithi138.stderr: -135> 2024-09-14T11:39:36.741+0000 7f1fff8b29c0 20 rados->read ofs=0 len=0 2024-09-14T11:39:36.886 INFO:tasks.workunit.client.0.smithi138.stderr: -134> 2024-09-14T11:39:36.741+0000 7f1fff8b29c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:39:36.886 INFO:tasks.workunit.client.0.smithi138.stderr: -133> 2024-09-14T11:39:36.741+0000 7f1fff8b29c0 20 rados->read ofs=0 len=0 2024-09-14T11:39:36.886 INFO:tasks.workunit.client.0.smithi138.stderr: -132> 2024-09-14T11:39:36.741+0000 7f1fff8b29c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:39:36.886 INFO:tasks.workunit.client.0.smithi138.stderr: -131> 2024-09-14T11:39:36.741+0000 7f1fff8b29c0 20 rados->read ofs=0 len=0 2024-09-14T11:39:36.886 INFO:tasks.workunit.client.0.smithi138.stderr: -130> 2024-09-14T11:39:36.741+0000 7f1fff8b29c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:39:36.887 INFO:tasks.workunit.client.0.smithi138.stderr: -129> 2024-09-14T11:39:36.741+0000 7f1fff8b29c0 20 started sync module instance, tier type = 2024-09-14T11:39:36.887 INFO:tasks.workunit.client.0.smithi138.stderr: -128> 2024-09-14T11:39:36.741+0000 7f1fff8b29c0 20 started zone id=d9e72d30-c60b-4d0d-9267-fdc36392d5ad (name=default) with tier type = 2024-09-14T11:39:36.887 INFO:tasks.workunit.client.0.smithi138.stderr: -127> 2024-09-14T11:39:36.761+0000 7f1ed2ffd640 1 client.8019.objecter ms_handle_reset 0x5612562211d0 session 0x561256220b50 osd.3 2024-09-14T11:39:36.887 INFO:tasks.workunit.client.0.smithi138.stderr: -126> 2024-09-14T11:39:36.761+0000 7f1ed2ffd640 10 monclient: _renew_subs 2024-09-14T11:39:36.887 INFO:tasks.workunit.client.0.smithi138.stderr: -125> 2024-09-14T11:39:36.761+0000 7f1ed2ffd640 10 monclient: _send_mon_message to mon.a at v2:172.21.15.138:3300/0 2024-09-14T11:39:36.887 INFO:tasks.workunit.client.0.smithi138.stderr: -124> 2024-09-14T11:39:36.761+0000 7f1ffd3b8640 10 monclient: get_auth_request con 0x7f1ec8082050 auth_method 0 2024-09-14T11:39:36.887 INFO:tasks.workunit.client.0.smithi138.stderr: -123> 2024-09-14T11:39:36.769+0000 7f1fff8b29c0 20 add_watcher() i=0 2024-09-14T11:39:36.887 INFO:tasks.workunit.client.0.smithi138.stderr: -122> 2024-09-14T11:39:36.769+0000 7f1fff8b29c0 20 add_watcher() i=1 2024-09-14T11:39:36.887 INFO:tasks.workunit.client.0.smithi138.stderr: -121> 2024-09-14T11:39:36.769+0000 7f1fff8b29c0 20 add_watcher() i=2 2024-09-14T11:39:36.887 INFO:tasks.workunit.client.0.smithi138.stderr: -120> 2024-09-14T11:39:36.769+0000 7f1fff8b29c0 20 add_watcher() i=3 2024-09-14T11:39:36.887 INFO:tasks.workunit.client.0.smithi138.stderr: -119> 2024-09-14T11:39:36.769+0000 7f1fff8b29c0 20 add_watcher() i=4 2024-09-14T11:39:36.887 INFO:tasks.workunit.client.0.smithi138.stderr: -118> 2024-09-14T11:39:36.769+0000 7f1fff8b29c0 20 add_watcher() i=5 2024-09-14T11:39:36.887 INFO:tasks.workunit.client.0.smithi138.stderr: -117> 2024-09-14T11:39:36.769+0000 7f1fff8b29c0 20 add_watcher() i=6 2024-09-14T11:39:36.887 INFO:tasks.workunit.client.0.smithi138.stderr: -116> 2024-09-14T11:39:36.773+0000 7f1fff8b29c0 20 add_watcher() i=7 2024-09-14T11:39:36.887 INFO:tasks.workunit.client.0.smithi138.stderr: -115> 2024-09-14T11:39:36.773+0000 7f1fff8b29c0 2 all 8 watchers are set, enabling cache 2024-09-14T11:39:36.888 INFO:tasks.workunit.client.0.smithi138.stderr: -114> 2024-09-14T11:39:36.777+0000 7f1fff8b29c0 5 AuthRegistry(0x7fffbf76b990) adding auth protocol: cephx 2024-09-14T11:39:36.888 INFO:tasks.workunit.client.0.smithi138.stderr: -113> 2024-09-14T11:39:36.777+0000 7f1fff8b29c0 5 AuthRegistry(0x7fffbf76b990) adding auth protocol: cephx 2024-09-14T11:39:36.888 INFO:tasks.workunit.client.0.smithi138.stderr: -112> 2024-09-14T11:39:36.777+0000 7f1fff8b29c0 5 AuthRegistry(0x7fffbf76b990) adding auth protocol: cephx 2024-09-14T11:39:36.888 INFO:tasks.workunit.client.0.smithi138.stderr: -111> 2024-09-14T11:39:36.777+0000 7f1fff8b29c0 5 AuthRegistry(0x7fffbf76b990) adding con mode: secure 2024-09-14T11:39:36.888 INFO:tasks.workunit.client.0.smithi138.stderr: -110> 2024-09-14T11:39:36.777+0000 7f1fff8b29c0 5 AuthRegistry(0x7fffbf76b990) adding con mode: crc 2024-09-14T11:39:36.888 INFO:tasks.workunit.client.0.smithi138.stderr: -109> 2024-09-14T11:39:36.777+0000 7f1fff8b29c0 5 AuthRegistry(0x7fffbf76b990) adding con mode: secure 2024-09-14T11:39:36.888 INFO:tasks.workunit.client.0.smithi138.stderr: -108> 2024-09-14T11:39:36.777+0000 7f1fff8b29c0 5 AuthRegistry(0x7fffbf76b990) adding con mode: crc 2024-09-14T11:39:36.888 INFO:tasks.workunit.client.0.smithi138.stderr: -107> 2024-09-14T11:39:36.777+0000 7f1eb37e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:39:36.888 INFO:tasks.workunit.client.0.smithi138.stderr: -106> 2024-09-14T11:39:36.777+0000 7f1fff8b29c0 5 AuthRegistry(0x7fffbf76b990) adding con mode: secure 2024-09-14T11:39:36.888 INFO:tasks.workunit.client.0.smithi138.stderr: -105> 2024-09-14T11:39:36.777+0000 7f1fff8b29c0 5 AuthRegistry(0x7fffbf76b990) adding con mode: crc 2024-09-14T11:39:36.888 INFO:tasks.workunit.client.0.smithi138.stderr: -104> 2024-09-14T11:39:36.777+0000 7f1fff8b29c0 5 AuthRegistry(0x7fffbf76b990) adding con mode: crc 2024-09-14T11:39:36.888 INFO:tasks.workunit.client.0.smithi138.stderr: -103> 2024-09-14T11:39:36.777+0000 7f1fff8b29c0 5 AuthRegistry(0x7fffbf76b990) adding con mode: secure 2024-09-14T11:39:36.888 INFO:tasks.workunit.client.0.smithi138.stderr: -102> 2024-09-14T11:39:36.777+0000 7f1fff8b29c0 5 AuthRegistry(0x7fffbf76b990) adding con mode: crc 2024-09-14T11:39:36.888 INFO:tasks.workunit.client.0.smithi138.stderr: -101> 2024-09-14T11:39:36.777+0000 7f1fff8b29c0 5 AuthRegistry(0x7fffbf76b990) adding con mode: secure 2024-09-14T11:39:36.889 INFO:tasks.workunit.client.0.smithi138.stderr: -100> 2024-09-14T11:39:36.777+0000 7f1fff8b29c0 5 AuthRegistry(0x7fffbf76b990) adding con mode: crc 2024-09-14T11:39:36.889 INFO:tasks.workunit.client.0.smithi138.stderr: -99> 2024-09-14T11:39:36.777+0000 7f1fff8b29c0 5 AuthRegistry(0x7fffbf76b990) adding con mode: secure 2024-09-14T11:39:36.889 INFO:tasks.workunit.client.0.smithi138.stderr: -98> 2024-09-14T11:39:36.777+0000 7f1fff8b29c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:39:36.889 INFO:tasks.workunit.client.0.smithi138.stderr: -97> 2024-09-14T11:39:36.777+0000 7f1fff8b29c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:39:36.889 INFO:tasks.workunit.client.0.smithi138.stderr: -96> 2024-09-14T11:39:36.777+0000 7f1fff8b29c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:39:36.889 INFO:tasks.workunit.client.0.smithi138.stderr: -95> 2024-09-14T11:39:36.777+0000 7f1fff8b29c0 5 asok(0x561255f1dd90) register_command cache list hook 0x5612561f1de0 2024-09-14T11:39:36.889 INFO:tasks.workunit.client.0.smithi138.stderr: -94> 2024-09-14T11:39:36.777+0000 7f1fff8b29c0 5 asok(0x561255f1dd90) register_command cache inspect hook 0x5612561f1de0 2024-09-14T11:39:36.889 INFO:tasks.workunit.client.0.smithi138.stderr: -93> 2024-09-14T11:39:36.777+0000 7f1fff8b29c0 5 asok(0x561255f1dd90) register_command cache erase hook 0x5612561f1de0 2024-09-14T11:39:36.889 INFO:tasks.workunit.client.0.smithi138.stderr: -92> 2024-09-14T11:39:36.777+0000 7f1fff8b29c0 5 asok(0x561255f1dd90) register_command cache zap hook 0x5612561f1de0 2024-09-14T11:39:36.889 INFO:tasks.workunit.client.0.smithi138.stderr: -91> 2024-09-14T11:39:36.777+0000 7f1fff8b29c0 5 note: GC not initialized 2024-09-14T11:39:36.889 INFO:tasks.workunit.client.0.smithi138.stderr: -90> 2024-09-14T11:39:36.777+0000 7f1eb27e4640 20 reqs_thread_entry: start 2024-09-14T11:39:36.889 INFO:tasks.workunit.client.0.smithi138.stderr: -89> 2024-09-14T11:39:36.777+0000 7f1fff8b29c0 5 asok(0x561255f1dd90) register_command sync trace show hook 0x7f1ff4010040 2024-09-14T11:39:36.889 INFO:tasks.workunit.client.0.smithi138.stderr: -88> 2024-09-14T11:39:36.777+0000 7f1fff8b29c0 5 asok(0x561255f1dd90) register_command sync trace history hook 0x7f1ff4010040 2024-09-14T11:39:36.889 INFO:tasks.workunit.client.0.smithi138.stderr: -87> 2024-09-14T11:39:36.777+0000 7f1fff8b29c0 5 asok(0x561255f1dd90) register_command sync trace active hook 0x7f1ff4010040 2024-09-14T11:39:36.890 INFO:tasks.workunit.client.0.smithi138.stderr: -86> 2024-09-14T11:39:36.777+0000 7f1fff8b29c0 5 asok(0x561255f1dd90) register_command sync trace active_short hook 0x7f1ff4010040 2024-09-14T11:39:36.890 INFO:tasks.workunit.client.0.smithi138.stderr: -85> 2024-09-14T11:39:36.781+0000 7f1fff8b29c0 20 init_complete bucket index max shards: 11 2024-09-14T11:39:36.890 INFO:tasks.workunit.client.0.smithi138.stderr: -84> 2024-09-14T11:39:36.781+0000 7f1fff8b29c0 20 Filter name: none 2024-09-14T11:39:36.890 INFO:tasks.workunit.client.0.smithi138.stderr: -83> 2024-09-14T11:39:36.781+0000 7f1e23fff640 20 reqs_thread_entry: start 2024-09-14T11:39:36.890 INFO:tasks.workunit.client.0.smithi138.stderr: -82> 2024-09-14T11:39:36.781+0000 7f1fff8b29c0 10 cache get: name=default.rgw.meta+root+a-bucket : miss 2024-09-14T11:39:36.890 INFO:tasks.workunit.client.0.smithi138.stderr: -81> 2024-09-14T11:39:36.781+0000 7f1fff8b29c0 20 rados->read ofs=0 len=0 2024-09-14T11:39:36.890 INFO:tasks.workunit.client.0.smithi138.stderr: -80> 2024-09-14T11:39:36.781+0000 7f1fff8b29c0 20 rados_obj.operate() r=0 bl.length=176 2024-09-14T11:39:36.890 INFO:tasks.workunit.client.0.smithi138.stderr: -79> 2024-09-14T11:39:36.781+0000 7f1fff8b29c0 10 cache put: name=default.rgw.meta+root+a-bucket info.flags=0x11 2024-09-14T11:39:36.890 INFO:tasks.workunit.client.0.smithi138.stderr: -78> 2024-09-14T11:39:36.781+0000 7f1fff8b29c0 10 adding default.rgw.meta+root+a-bucket to cache LRU end 2024-09-14T11:39:36.890 INFO:tasks.workunit.client.0.smithi138.stderr: -77> 2024-09-14T11:39:36.781+0000 7f1fff8b29c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.17 : miss 2024-09-14T11:39:36.890 INFO:tasks.workunit.client.0.smithi138.stderr: -76> 2024-09-14T11:39:36.781+0000 7f1fff8b29c0 20 rados->read ofs=0 len=0 2024-09-14T11:39:36.890 INFO:tasks.workunit.client.0.smithi138.stderr: -75> 2024-09-14T11:39:36.781+0000 7f1fff8b29c0 20 rados_obj.operate() r=0 bl.length=398 2024-09-14T11:39:36.890 INFO:tasks.workunit.client.0.smithi138.stderr: -74> 2024-09-14T11:39:36.781+0000 7f1fff8b29c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.17 info.flags=0x17 2024-09-14T11:39:36.890 INFO:tasks.workunit.client.0.smithi138.stderr: -73> 2024-09-14T11:39:36.781+0000 7f1fff8b29c0 10 adding default.rgw.meta+root+.bucket.meta.a-bucket:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.17 to cache LRU end 2024-09-14T11:39:36.890 INFO:tasks.workunit.client.0.smithi138.stderr: -72> 2024-09-14T11:39:36.781+0000 7f1fff8b29c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:39:36.891 INFO:tasks.workunit.client.0.smithi138.stderr: -71> 2024-09-14T11:39:36.781+0000 7f1fff8b29c0 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-14T11:39:36.891 INFO:tasks.workunit.client.0.smithi138.stderr: -70> 2024-09-14T11:39:36.781+0000 7f1fff8b29c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.17 2024-09-14T11:39:36.891 INFO:tasks.workunit.client.0.smithi138.stderr: -69> 2024-09-14T11:39:36.793+0000 7f1fff8b29c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.17 info.flags=0x17 2024-09-14T11:39:36.891 INFO:tasks.workunit.client.0.smithi138.stderr: -68> 2024-09-14T11:39:36.793+0000 7f1fff8b29c0 10 moving default.rgw.meta+root+.bucket.meta.a-bucket:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.17 to cache LRU end 2024-09-14T11:39:36.891 INFO:tasks.workunit.client.0.smithi138.stderr: -67> 2024-09-14T11:39:36.793+0000 7f1fff8b29c0 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-14T11:39:36.891 INFO:tasks.workunit.client.0.smithi138.stderr: -66> 2024-09-14T11:39:36.793+0000 7f1fff8b29c0 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.a-bucket:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.17, ofs0, ns] 2024-09-14T11:39:36.891 INFO:tasks.workunit.client.0.smithi138.stderr: -65> 2024-09-14T11:39:36.793+0000 7f1ed3fff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366239 cookie 94636754505008 notifier 8019 bl.length()=827 2024-09-14T11:39:36.891 INFO:tasks.workunit.client.0.smithi138.stderr: -64> 2024-09-14T11:39:36.793+0000 7f1ed3fff640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.17 info.flags=0x17 2024-09-14T11:39:36.891 INFO:tasks.workunit.client.0.smithi138.stderr: -63> 2024-09-14T11:39:36.793+0000 7f1ed3fff640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.a-bucket:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.17 to cache LRU end 2024-09-14T11:39:36.891 INFO:tasks.workunit.client.0.smithi138.stderr: -62> 2024-09-14T11:39:36.793+0000 7f1ed3fff640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=143 2024-09-14T11:39:36.891 INFO:tasks.workunit.client.0.smithi138.stderr: -61> 2024-09-14T11:39:36.797+0000 7f1fff8b29c0 20 handle_bi_update(): bucket=:a-bucket[d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.17]): orig_sources= new_sources= 2024-09-14T11:39:36.891 INFO:tasks.workunit.client.0.smithi138.stderr: -60> 2024-09-14T11:39:36.797+0000 7f1fff8b29c0 20 handle_bi_update(): bucket=:a-bucket[d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.17]): potential sources added=[] removed=[] 2024-09-14T11:39:36.891 INFO:tasks.workunit.client.0.smithi138.stderr: -59> 2024-09-14T11:39:36.797+0000 7f1fff8b29c0 20 handle_bi_update(): bucket=:a-bucket[d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.17]): orig_dests= new_dests= 2024-09-14T11:39:36.891 INFO:tasks.workunit.client.0.smithi138.stderr: -58> 2024-09-14T11:39:36.797+0000 7f1fff8b29c0 20 handle_bi_update(): bucket=:a-bucket[d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.17]): potential dests added=[] removed=[] 2024-09-14T11:39:36.891 INFO:tasks.workunit.client.0.smithi138.stderr: -57> 2024-09-14T11:39:36.797+0000 7f1ed2ffd640 1 client.8019.objecter ms_handle_reset 0x7f1ff81013e0 session 0x7f1ff80097d0 osd.0 2024-09-14T11:39:36.892 INFO:tasks.workunit.client.0.smithi138.stderr: -56> 2024-09-14T11:39:36.801+0000 7f1ffcbb7640 10 monclient: get_auth_request con 0x5612562211d0 auth_method 0 2024-09-14T11:39:36.892 INFO:tasks.workunit.client.0.smithi138.stderr: -55> 2024-09-14T11:39:36.813+0000 7f1fff8b29c0 10 bucket_obj is .dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.17.3.0 2024-09-14T11:39:36.892 INFO:tasks.workunit.client.0.smithi138.stderr: -54> 2024-09-14T11:39:36.813+0000 7f1fff8b29c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.17.3.0 2024-09-14T11:39:36.892 INFO:tasks.workunit.client.0.smithi138.stderr: -53> 2024-09-14T11:39:36.813+0000 7f1fff8b29c0 10 bucket_obj is .dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.17.3.1 2024-09-14T11:39:36.892 INFO:tasks.workunit.client.0.smithi138.stderr: -52> 2024-09-14T11:39:36.813+0000 7f1fff8b29c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.17.3.1 2024-09-14T11:39:36.892 INFO:tasks.workunit.client.0.smithi138.stderr: -51> 2024-09-14T11:39:36.813+0000 7f1fff8b29c0 10 bucket_obj is .dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.17.3.2 2024-09-14T11:39:36.892 INFO:tasks.workunit.client.0.smithi138.stderr: -50> 2024-09-14T11:39:36.813+0000 7f1fff8b29c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.17.3.2 2024-09-14T11:39:36.892 INFO:tasks.workunit.client.0.smithi138.stderr: -49> 2024-09-14T11:39:36.813+0000 7f1fff8b29c0 10 bucket_obj is .dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.17.3.3 2024-09-14T11:39:36.892 INFO:tasks.workunit.client.0.smithi138.stderr: -48> 2024-09-14T11:39:36.813+0000 7f1fff8b29c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.17.3.3 2024-09-14T11:39:36.892 INFO:tasks.workunit.client.0.smithi138.stderr: -47> 2024-09-14T11:39:36.813+0000 7f1fff8b29c0 10 bucket_obj is .dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.17.3.4 2024-09-14T11:39:36.892 INFO:tasks.workunit.client.0.smithi138.stderr: -46> 2024-09-14T11:39:36.813+0000 7f1fff8b29c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.17.3.4 2024-09-14T11:39:36.892 INFO:tasks.workunit.client.0.smithi138.stderr: -45> 2024-09-14T11:39:36.813+0000 7f1fff8b29c0 10 bucket_obj is .dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.17.3.5 2024-09-14T11:39:36.892 INFO:tasks.workunit.client.0.smithi138.stderr: -44> 2024-09-14T11:39:36.813+0000 7f1fff8b29c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.17.3.5 2024-09-14T11:39:36.892 INFO:tasks.workunit.client.0.smithi138.stderr: -43> 2024-09-14T11:39:36.813+0000 7f1fff8b29c0 10 bucket_obj is .dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.17.3.6 2024-09-14T11:39:36.893 INFO:tasks.workunit.client.0.smithi138.stderr: -42> 2024-09-14T11:39:36.813+0000 7f1fff8b29c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.17.3.6 2024-09-14T11:39:36.893 INFO:tasks.workunit.client.0.smithi138.stderr: -41> 2024-09-14T11:39:36.813+0000 7f1fff8b29c0 10 bucket_obj is .dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.17.3.7 2024-09-14T11:39:36.893 INFO:tasks.workunit.client.0.smithi138.stderr: -40> 2024-09-14T11:39:36.813+0000 7f1fff8b29c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.17.3.7 2024-09-14T11:39:36.893 INFO:tasks.workunit.client.0.smithi138.stderr: -39> 2024-09-14T11:39:36.813+0000 7f1fff8b29c0 10 bucket_obj is .dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.17.3.8 2024-09-14T11:39:36.893 INFO:tasks.workunit.client.0.smithi138.stderr: -38> 2024-09-14T11:39:36.813+0000 7f1fff8b29c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.17.3.8 2024-09-14T11:39:36.893 INFO:tasks.workunit.client.0.smithi138.stderr: -37> 2024-09-14T11:39:36.813+0000 7f1fff8b29c0 10 bucket_obj is .dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.17.3.9 2024-09-14T11:39:36.893 INFO:tasks.workunit.client.0.smithi138.stderr: -36> 2024-09-14T11:39:36.813+0000 7f1fff8b29c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.17.3.9 2024-09-14T11:39:36.893 INFO:tasks.workunit.client.0.smithi138.stderr: -35> 2024-09-14T11:39:36.813+0000 7f1fff8b29c0 10 bucket_obj is .dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.17.3.10 2024-09-14T11:39:36.893 INFO:tasks.workunit.client.0.smithi138.stderr: -34> 2024-09-14T11:39:36.813+0000 7f1fff8b29c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.17.3.10 2024-09-14T11:39:36.893 INFO:tasks.workunit.client.0.smithi138.stderr: -33> 2024-09-14T11:39:36.813+0000 7f1fff8b29c0 10 bucket_obj is .dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.17.3.11 2024-09-14T11:39:36.893 INFO:tasks.workunit.client.0.smithi138.stderr: -32> 2024-09-14T11:39:36.813+0000 7f1fff8b29c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.17.3.11 2024-09-14T11:39:36.893 INFO:tasks.workunit.client.0.smithi138.stderr: -31> 2024-09-14T11:39:36.813+0000 7f1fff8b29c0 10 bucket_obj is .dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.17.3.12 2024-09-14T11:39:36.893 INFO:tasks.workunit.client.0.smithi138.stderr: -30> 2024-09-14T11:39:36.813+0000 7f1fff8b29c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.17.3.12 2024-09-14T11:39:36.894 INFO:tasks.workunit.client.0.smithi138.stderr: -29> 2024-09-14T11:39:36.813+0000 7f1fff8b29c0 10 bucket_obj is .dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.17.3.13 2024-09-14T11:39:36.894 INFO:tasks.workunit.client.0.smithi138.stderr: -28> 2024-09-14T11:39:36.813+0000 7f1fff8b29c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.17.3.13 2024-09-14T11:39:36.894 INFO:tasks.workunit.client.0.smithi138.stderr: -27> 2024-09-14T11:39:36.813+0000 7f1fff8b29c0 10 bucket_obj is .dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.17.2.0 2024-09-14T11:39:36.894 INFO:tasks.workunit.client.0.smithi138.stderr: -26> 2024-09-14T11:39:36.813+0000 7f1fff8b29c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.17.2.0 2024-09-14T11:39:36.894 INFO:tasks.workunit.client.0.smithi138.stderr: -25> 2024-09-14T11:39:36.813+0000 7f1fff8b29c0 10 bucket_obj is .dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.17.2.1 2024-09-14T11:39:36.894 INFO:tasks.workunit.client.0.smithi138.stderr: -24> 2024-09-14T11:39:36.813+0000 7f1fff8b29c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.17.2.1 2024-09-14T11:39:36.894 INFO:tasks.workunit.client.0.smithi138.stderr: -23> 2024-09-14T11:39:36.813+0000 7f1fff8b29c0 10 bucket_obj is .dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.17.2.2 2024-09-14T11:39:36.894 INFO:tasks.workunit.client.0.smithi138.stderr: -22> 2024-09-14T11:39:36.813+0000 7f1fff8b29c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.17.2.2 2024-09-14T11:39:36.894 INFO:tasks.workunit.client.0.smithi138.stderr: -21> 2024-09-14T11:39:36.813+0000 7f1fff8b29c0 10 bucket_obj is .dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.17.2.3 2024-09-14T11:39:36.894 INFO:tasks.workunit.client.0.smithi138.stderr: -20> 2024-09-14T11:39:36.813+0000 7f1fff8b29c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.17.2.3 2024-09-14T11:39:36.894 INFO:tasks.workunit.client.0.smithi138.stderr: -19> 2024-09-14T11:39:36.817+0000 7f1fff8b29c0 10 bucket_obj is .dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.17.2.4 2024-09-14T11:39:36.894 INFO:tasks.workunit.client.0.smithi138.stderr: -18> 2024-09-14T11:39:36.817+0000 7f1fff8b29c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.17.2.4 2024-09-14T11:39:36.894 INFO:tasks.workunit.client.0.smithi138.stderr: -17> 2024-09-14T11:39:36.817+0000 7f1fff8b29c0 10 bucket_obj is .dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.17.2.5 2024-09-14T11:39:36.894 INFO:tasks.workunit.client.0.smithi138.stderr: -16> 2024-09-14T11:39:36.817+0000 7f1fff8b29c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.17.2.5 2024-09-14T11:39:36.895 INFO:tasks.workunit.client.0.smithi138.stderr: -15> 2024-09-14T11:39:36.817+0000 7f1fff8b29c0 10 bucket_obj is .dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.17.2.6 2024-09-14T11:39:36.895 INFO:tasks.workunit.client.0.smithi138.stderr: -14> 2024-09-14T11:39:36.817+0000 7f1fff8b29c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.17.2.6 2024-09-14T11:39:36.895 INFO:tasks.workunit.client.0.smithi138.stderr: -13> 2024-09-14T11:39:36.821+0000 7f1fff8b29c0 10 bucket_obj is .dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.17.2.7 2024-09-14T11:39:36.895 INFO:tasks.workunit.client.0.smithi138.stderr: -12> 2024-09-14T11:39:36.821+0000 7f1fff8b29c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.17.2.7 2024-09-14T11:39:36.895 INFO:tasks.workunit.client.0.smithi138.stderr: -11> 2024-09-14T11:39:36.821+0000 7f1fff8b29c0 10 bucket_obj is .dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.17.2.8 2024-09-14T11:39:36.895 INFO:tasks.workunit.client.0.smithi138.stderr: -10> 2024-09-14T11:39:36.821+0000 7f1fff8b29c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.17.2.8 2024-09-14T11:39:36.895 INFO:tasks.workunit.client.0.smithi138.stderr: -9> 2024-09-14T11:39:36.821+0000 7f1fff8b29c0 10 bucket_obj is .dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.17.2.9 2024-09-14T11:39:36.895 INFO:tasks.workunit.client.0.smithi138.stderr: -8> 2024-09-14T11:39:36.821+0000 7f1fff8b29c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.17.2.9 2024-09-14T11:39:36.895 INFO:tasks.workunit.client.0.smithi138.stderr: -7> 2024-09-14T11:39:36.821+0000 7f1fff8b29c0 10 bucket_obj is .dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.17.2.10 2024-09-14T11:39:36.895 INFO:tasks.workunit.client.0.smithi138.stderr: -6> 2024-09-14T11:39:36.821+0000 7f1fff8b29c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.17.2.10 2024-09-14T11:39:36.895 INFO:tasks.workunit.client.0.smithi138.stderr: -5> 2024-09-14T11:39:36.821+0000 7f1fff8b29c0 10 bucket_obj is .dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.17.2.11 2024-09-14T11:39:36.895 INFO:tasks.workunit.client.0.smithi138.stderr: -4> 2024-09-14T11:39:36.821+0000 7f1fff8b29c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.17.2.11 2024-09-14T11:39:36.895 INFO:tasks.workunit.client.0.smithi138.stderr: -3> 2024-09-14T11:39:36.825+0000 7f1fff8b29c0 10 bucket_obj is .dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.17.2.12 2024-09-14T11:39:36.895 INFO:tasks.workunit.client.0.smithi138.stderr: -2> 2024-09-14T11:39:36.825+0000 7f1fff8b29c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.17.2.12 2024-09-14T11:39:36.895 INFO:tasks.workunit.client.0.smithi138.stderr: -1> 2024-09-14T11:39:36.829+0000 7f1fff8b29c0 -1 ./src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f1fff8b29c0 time 2024-09-14T11:39:36.834404+0000 2024-09-14T11:39:36.896 INFO:tasks.workunit.client.0.smithi138.stderr:./src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-14T11:39:36.896 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-14T11:39:36.896 INFO:tasks.workunit.client.0.smithi138.stderr: ceph version 19.3.0-4907-ga2782315 (a2782315255a3e7d5f6cdc9eb35785187ff6ddf8) squid (dev) 2024-09-14T11:39:36.896 INFO:tasks.workunit.client.0.smithi138.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x121) [0x7f200318c2eb] 2024-09-14T11:39:36.896 INFO:tasks.workunit.client.0.smithi138.stderr: 2: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7f200318c49f] 2024-09-14T11:39:36.896 INFO:tasks.workunit.client.0.smithi138.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x5612537bec01] 2024-09-14T11:39:36.896 INFO:tasks.workunit.client.0.smithi138.stderr: 4: (RGWBucketReshard::do_reshard(rgw::bucket_index_layout_generation const&, rgw::bucket_index_layout_generation const&, int, bool, bool, std::ostream*, ceph::Formatter*, FaultInjector > >&, DoutPrefixProvider const*, optional_yield)+0x1411) [0x5612537d3231] 2024-09-14T11:39:36.896 INFO:tasks.workunit.client.0.smithi138.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0xac4) [0x5612537d4884] 2024-09-14T11:39:36.896 INFO:tasks.workunit.client.0.smithi138.stderr: 6: main() 2024-09-14T11:39:36.896 INFO:tasks.workunit.client.0.smithi138.stderr: 7: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7f2001ff2d90] 2024-09-14T11:39:36.896 INFO:tasks.workunit.client.0.smithi138.stderr: 8: __libc_start_main() 2024-09-14T11:39:36.896 INFO:tasks.workunit.client.0.smithi138.stderr: 9: _start() 2024-09-14T11:39:36.896 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-14T11:39:36.896 INFO:tasks.workunit.client.0.smithi138.stderr: 0> 2024-09-14T11:39:36.829+0000 7f1fff8b29c0 -1 *** Caught signal (Aborted) ** 2024-09-14T11:39:36.896 INFO:tasks.workunit.client.0.smithi138.stderr: in thread 7f1fff8b29c0 thread_name:radosgw-admin 2024-09-14T11:39:36.897 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-14T11:39:36.897 INFO:tasks.workunit.client.0.smithi138.stderr: ceph version 19.3.0-4907-ga2782315 (a2782315255a3e7d5f6cdc9eb35785187ff6ddf8) squid (dev) 2024-09-14T11:39:36.897 INFO:tasks.workunit.client.0.smithi138.stderr: 1: /lib/x86_64-linux-gnu/libc.so.6(+0x42520) [0x7f200200b520] 2024-09-14T11:39:36.897 INFO:tasks.workunit.client.0.smithi138.stderr: 2: pthread_kill() 2024-09-14T11:39:36.897 INFO:tasks.workunit.client.0.smithi138.stderr: 3: raise() 2024-09-14T11:39:36.897 INFO:tasks.workunit.client.0.smithi138.stderr: 4: abort() 2024-09-14T11:39:36.897 INFO:tasks.workunit.client.0.smithi138.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x17b) [0x7f200318c345] 2024-09-14T11:39:36.897 INFO:tasks.workunit.client.0.smithi138.stderr: 6: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7f200318c49f] 2024-09-14T11:39:36.897 INFO:tasks.workunit.client.0.smithi138.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x5612537bec01] 2024-09-14T11:39:36.897 INFO:tasks.workunit.client.0.smithi138.stderr: 8: (RGWBucketReshard::do_reshard(rgw::bucket_index_layout_generation const&, rgw::bucket_index_layout_generation const&, int, bool, bool, std::ostream*, ceph::Formatter*, FaultInjector > >&, DoutPrefixProvider const*, optional_yield)+0x1411) [0x5612537d3231] 2024-09-14T11:39:36.897 INFO:tasks.workunit.client.0.smithi138.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0xac4) [0x5612537d4884] 2024-09-14T11:39:36.897 INFO:tasks.workunit.client.0.smithi138.stderr: 10: main() 2024-09-14T11:39:36.897 INFO:tasks.workunit.client.0.smithi138.stderr: 11: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7f2001ff2d90] 2024-09-14T11:39:36.897 INFO:tasks.workunit.client.0.smithi138.stderr: 12: __libc_start_main() 2024-09-14T11:39:36.898 INFO:tasks.workunit.client.0.smithi138.stderr: 13: _start() 2024-09-14T11:39:36.898 INFO:tasks.workunit.client.0.smithi138.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-14T11:39:36.898 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-14T11:39:36.898 INFO:tasks.workunit.client.0.smithi138.stderr:--- logging levels --- 2024-09-14T11:39:36.898 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 none 2024-09-14T11:39:36.898 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 1 lockdep 2024-09-14T11:39:36.898 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 1 context 2024-09-14T11:39:36.898 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 1 crush 2024-09-14T11:39:36.898 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 mds 2024-09-14T11:39:36.898 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 mds_balancer 2024-09-14T11:39:36.898 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 mds_locker 2024-09-14T11:39:36.898 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 mds_log 2024-09-14T11:39:36.898 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 mds_log_expire 2024-09-14T11:39:36.898 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 mds_migrator 2024-09-14T11:39:36.899 INFO:tasks.workunit.client.0.smithi138.stderr: 3/ 5 mds_quiesce 2024-09-14T11:39:36.899 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 1 buffer 2024-09-14T11:39:36.899 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 1 timer 2024-09-14T11:39:36.899 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 1 filer 2024-09-14T11:39:36.899 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 1 striper 2024-09-14T11:39:36.899 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 1 objecter 2024-09-14T11:39:36.899 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 rados 2024-09-14T11:39:36.899 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 rbd 2024-09-14T11:39:36.899 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 rbd_mirror 2024-09-14T11:39:36.899 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 rbd_replay 2024-09-14T11:39:36.899 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 rbd_pwl 2024-09-14T11:39:36.899 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 journaler 2024-09-14T11:39:36.899 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 objectcacher 2024-09-14T11:39:36.899 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 immutable_obj_cache 2024-09-14T11:39:36.899 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 client 2024-09-14T11:39:36.899 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 osd 2024-09-14T11:39:36.900 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 optracker 2024-09-14T11:39:36.900 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 objclass 2024-09-14T11:39:36.900 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 3 filestore 2024-09-14T11:39:36.900 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 3 journal 2024-09-14T11:39:36.900 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 0 ms 2024-09-14T11:39:36.900 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 mon 2024-09-14T11:39:36.900 INFO:tasks.workunit.client.0.smithi138.stderr: 0/10 monc 2024-09-14T11:39:36.900 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 paxos 2024-09-14T11:39:36.900 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 tp 2024-09-14T11:39:36.900 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 auth 2024-09-14T11:39:36.900 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 crypto 2024-09-14T11:39:36.900 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 1 finisher 2024-09-14T11:39:36.900 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 1 reserver 2024-09-14T11:39:36.900 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 heartbeatmap 2024-09-14T11:39:36.900 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 perfcounter 2024-09-14T11:39:36.901 INFO:tasks.workunit.client.0.smithi138.stderr: 20/20 rgw 2024-09-14T11:39:36.901 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 rgw_sync 2024-09-14T11:39:36.901 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 rgw_datacache 2024-09-14T11:39:36.901 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 rgw_access 2024-09-14T11:39:36.901 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 rgw_dbstore 2024-09-14T11:39:36.901 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 rgw_flight 2024-09-14T11:39:36.901 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 rgw_lifecycle 2024-09-14T11:39:36.901 INFO:tasks.workunit.client.0.smithi138.stderr: 20/20 rgw_notification 2024-09-14T11:39:36.901 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 javaclient 2024-09-14T11:39:36.901 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 asok 2024-09-14T11:39:36.901 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 1 throttle 2024-09-14T11:39:36.901 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 0 refs 2024-09-14T11:39:36.901 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 compressor 2024-09-14T11:39:36.901 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 bluestore 2024-09-14T11:39:36.901 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 bluefs 2024-09-14T11:39:36.902 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 3 bdev 2024-09-14T11:39:36.902 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 kstore 2024-09-14T11:39:36.902 INFO:tasks.workunit.client.0.smithi138.stderr: 4/ 5 rocksdb 2024-09-14T11:39:36.902 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 fuse 2024-09-14T11:39:36.902 INFO:tasks.workunit.client.0.smithi138.stderr: 2/ 5 mgr 2024-09-14T11:39:36.902 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 mgrc 2024-09-14T11:39:36.902 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 dpdk 2024-09-14T11:39:36.902 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 eventtrace 2024-09-14T11:39:36.902 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 prioritycache 2024-09-14T11:39:36.902 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 test 2024-09-14T11:39:36.902 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 cephfs_mirror 2024-09-14T11:39:36.902 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 cephsqlite 2024-09-14T11:39:36.902 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 crimson_interrupt 2024-09-14T11:39:36.902 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 seastore 2024-09-14T11:39:36.902 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 seastore_onode 2024-09-14T11:39:36.903 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 seastore_odata 2024-09-14T11:39:36.903 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 seastore_omap 2024-09-14T11:39:36.903 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 seastore_tm 2024-09-14T11:39:36.903 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 seastore_t 2024-09-14T11:39:36.903 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 seastore_cleaner 2024-09-14T11:39:36.903 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 seastore_epm 2024-09-14T11:39:36.903 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 seastore_lba 2024-09-14T11:39:36.903 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 seastore_fixedkv_tree 2024-09-14T11:39:36.903 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 seastore_cache 2024-09-14T11:39:36.903 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 seastore_journal 2024-09-14T11:39:36.903 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 seastore_device 2024-09-14T11:39:36.903 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 seastore_backref 2024-09-14T11:39:36.903 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 alienstore 2024-09-14T11:39:36.903 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 mclock 2024-09-14T11:39:36.903 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 cyanstore 2024-09-14T11:39:36.903 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 ceph_exporter 2024-09-14T11:39:36.904 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 memstore 2024-09-14T11:39:36.904 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 trace 2024-09-14T11:39:36.904 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 ceph_dedup 2024-09-14T11:39:36.904 INFO:tasks.workunit.client.0.smithi138.stderr: -2/-2 (syslog threshold) 2024-09-14T11:39:36.904 INFO:tasks.workunit.client.0.smithi138.stderr: 99/99 (stderr threshold) 2024-09-14T11:39:36.904 INFO:tasks.workunit.client.0.smithi138.stderr:--- pthread ID / name mapping for recent threads --- 2024-09-14T11:39:36.904 INFO:tasks.workunit.client.0.smithi138.stderr: 7f1e23fff640 / http_manager 2024-09-14T11:39:36.904 INFO:tasks.workunit.client.0.smithi138.stderr: 7f1eb27e4640 / http_manager 2024-09-14T11:39:36.904 INFO:tasks.workunit.client.0.smithi138.stderr: 7f1eb37e6640 / rgw_dt_lg_renew 2024-09-14T11:39:36.904 INFO:tasks.workunit.client.0.smithi138.stderr: 7f1ed2ffd640 / ms_dispatch 2024-09-14T11:39:36.904 INFO:tasks.workunit.client.0.smithi138.stderr: 7f1ed3fff640 / io_context_pool 2024-09-14T11:39:36.904 INFO:tasks.workunit.client.0.smithi138.stderr: 7f1ee0ff9640 / io_context_pool 2024-09-14T11:39:36.904 INFO:tasks.workunit.client.0.smithi138.stderr: 7f1ee2ffd640 / ms_dispatch 2024-09-14T11:39:36.904 INFO:tasks.workunit.client.0.smithi138.stderr: 7f1ee9e03640 / ms_dispatch 2024-09-14T11:39:36.904 INFO:tasks.workunit.client.0.smithi138.stderr: 7f1eeb606640 / io_context_pool 2024-09-14T11:39:36.905 INFO:tasks.workunit.client.0.smithi138.stderr: 7f1ffcbb7640 / msgr-worker-2 2024-09-14T11:39:36.905 INFO:tasks.workunit.client.0.smithi138.stderr: 7f1ffd3b8640 / msgr-worker-1 2024-09-14T11:39:36.905 INFO:tasks.workunit.client.0.smithi138.stderr: 7f1ffdbb9640 / msgr-worker-0 2024-09-14T11:39:36.905 INFO:tasks.workunit.client.0.smithi138.stderr: 7f1ffe3ba640 / io_context_pool 2024-09-14T11:39:36.905 INFO:tasks.workunit.client.0.smithi138.stderr: 7f1fff8b29c0 / radosgw-admin 2024-09-14T11:39:36.905 INFO:tasks.workunit.client.0.smithi138.stderr: max_recent 500 2024-09-14T11:39:36.905 INFO:tasks.workunit.client.0.smithi138.stderr: max_new 1000 2024-09-14T11:39:36.905 INFO:tasks.workunit.client.0.smithi138.stderr: log_file /var/log/ceph/ceph-client.admin.138025.log 2024-09-14T11:39:36.905 INFO:tasks.workunit.client.0.smithi138.stderr:--- end dump of recent events --- 2024-09-14T11:39:36.905 INFO:tasks.workunit.client.0.smithi138.stderr:--- begin dump of recent events --- 2024-09-14T11:39:36.905 INFO:tasks.workunit.client.0.smithi138.stderr: -499> 2024-09-14T11:39:36.277+0000 7f1fff8b29c0 5 AuthRegistry(0x561256128a60) adding con mode: crc 2024-09-14T11:39:36.905 INFO:tasks.workunit.client.0.smithi138.stderr: -498> 2024-09-14T11:39:36.277+0000 7f1fff8b29c0 5 AuthRegistry(0x561256128a60) adding con mode: secure 2024-09-14T11:39:36.905 INFO:tasks.workunit.client.0.smithi138.stderr: -497> 2024-09-14T11:39:36.277+0000 7f1fff8b29c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:39:36.905 INFO:tasks.workunit.client.0.smithi138.stderr: -496> 2024-09-14T11:39:36.277+0000 7f1fff8b29c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:39:36.905 INFO:tasks.workunit.client.0.smithi138.stderr: -495> 2024-09-14T11:39:36.277+0000 7f1fff8b29c0 5 asok(0x561255f1dd90) register_command rotate-key hook 0x561256128ba8 2024-09-14T11:39:36.906 INFO:tasks.workunit.client.0.smithi138.stderr: -494> 2024-09-14T11:39:36.277+0000 7f1fff8b29c0 10 monclient: _reopen_session rank -1 2024-09-14T11:39:36.906 INFO:tasks.workunit.client.0.smithi138.stderr: -493> 2024-09-14T11:39:36.277+0000 7f1fff8b29c0 10 monclient: _add_conns ranks=[1,2,0] 2024-09-14T11:39:36.906 INFO:tasks.workunit.client.0.smithi138.stderr: -492> 2024-09-14T11:39:36.277+0000 7f1fff8b29c0 10 monclient(hunting): picked mon.noname-b con 0x561255fd97f0 addr [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] 2024-09-14T11:39:36.906 INFO:tasks.workunit.client.0.smithi138.stderr: -491> 2024-09-14T11:39:36.277+0000 7f1fff8b29c0 10 monclient(hunting): picked mon.noname-c con 0x561256071800 addr [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] 2024-09-14T11:39:36.906 INFO:tasks.workunit.client.0.smithi138.stderr: -490> 2024-09-14T11:39:36.277+0000 7f1fff8b29c0 10 monclient(hunting): picked mon.noname-a con 0x561256071be0 addr [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] 2024-09-14T11:39:36.906 INFO:tasks.workunit.client.0.smithi138.stderr: -489> 2024-09-14T11:39:36.277+0000 7f1fff8b29c0 10 monclient(hunting): start opening mon connection 2024-09-14T11:39:36.906 INFO:tasks.workunit.client.0.smithi138.stderr: -488> 2024-09-14T11:39:36.277+0000 7f1fff8b29c0 10 monclient(hunting): start opening mon connection 2024-09-14T11:39:36.906 INFO:tasks.workunit.client.0.smithi138.stderr: -487> 2024-09-14T11:39:36.277+0000 7f1fff8b29c0 10 monclient(hunting): start opening mon connection 2024-09-14T11:39:36.906 INFO:tasks.workunit.client.0.smithi138.stderr: -486> 2024-09-14T11:39:36.277+0000 7f1fff8b29c0 10 monclient(hunting): _renew_subs 2024-09-14T11:39:36.906 INFO:tasks.workunit.client.0.smithi138.stderr: -485> 2024-09-14T11:39:36.277+0000 7f1fff8b29c0 10 monclient(hunting): authenticate will time out at 2912.242421s 2024-09-14T11:39:36.906 INFO:tasks.workunit.client.0.smithi138.stderr: -484> 2024-09-14T11:39:36.277+0000 7f1ffdbb9640 10 monclient(hunting): get_auth_request con 0x561256071be0 auth_method 0 2024-09-14T11:39:36.906 INFO:tasks.workunit.client.0.smithi138.stderr: -483> 2024-09-14T11:39:36.277+0000 7f1ffdbb9640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:39:36.906 INFO:tasks.workunit.client.0.smithi138.stderr: -482> 2024-09-14T11:39:36.277+0000 7f1ffdbb9640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:39:36.907 INFO:tasks.workunit.client.0.smithi138.stderr: -481> 2024-09-14T11:39:36.277+0000 7f1ffdbb9640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:39:36.907 INFO:tasks.workunit.client.0.smithi138.stderr: -480> 2024-09-14T11:39:36.277+0000 7f1ffcbb7640 10 monclient(hunting): get_auth_request con 0x561256071800 auth_method 0 2024-09-14T11:39:36.907 INFO:tasks.workunit.client.0.smithi138.stderr: -479> 2024-09-14T11:39:36.277+0000 7f1ffcbb7640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:39:36.907 INFO:tasks.workunit.client.0.smithi138.stderr: -478> 2024-09-14T11:39:36.277+0000 7f1ffcbb7640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:39:36.907 INFO:tasks.workunit.client.0.smithi138.stderr: -477> 2024-09-14T11:39:36.277+0000 7f1ffcbb7640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:39:36.907 INFO:tasks.workunit.client.0.smithi138.stderr: -476> 2024-09-14T11:39:36.277+0000 7f1ffdbb9640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:39:36.907 INFO:tasks.workunit.client.0.smithi138.stderr: -475> 2024-09-14T11:39:36.277+0000 7f1ffdbb9640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:39:36.907 INFO:tasks.workunit.client.0.smithi138.stderr: -474> 2024-09-14T11:39:36.277+0000 7f1ffdbb9640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:39:36.907 INFO:tasks.workunit.client.0.smithi138.stderr: -473> 2024-09-14T11:39:36.277+0000 7f1ffcbb7640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:39:36.907 INFO:tasks.workunit.client.0.smithi138.stderr: -472> 2024-09-14T11:39:36.277+0000 7f1ffcbb7640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:39:36.907 INFO:tasks.workunit.client.0.smithi138.stderr: -471> 2024-09-14T11:39:36.277+0000 7f1ffcbb7640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:39:36.907 INFO:tasks.workunit.client.0.smithi138.stderr: -470> 2024-09-14T11:39:36.277+0000 7f1ffd3b8640 10 monclient(hunting): get_auth_request con 0x561255fd97f0 auth_method 0 2024-09-14T11:39:36.907 INFO:tasks.workunit.client.0.smithi138.stderr: -469> 2024-09-14T11:39:36.277+0000 7f1ffd3b8640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:39:36.907 INFO:tasks.workunit.client.0.smithi138.stderr: -468> 2024-09-14T11:39:36.277+0000 7f1ffd3b8640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:39:36.907 INFO:tasks.workunit.client.0.smithi138.stderr: -467> 2024-09-14T11:39:36.277+0000 7f1ffd3b8640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:39:36.908 INFO:tasks.workunit.client.0.smithi138.stderr: -466> 2024-09-14T11:39:36.277+0000 7f1ffdbb9640 10 monclient(hunting): handle_auth_done global_id 8010 payload 824 2024-09-14T11:39:36.908 INFO:tasks.workunit.client.0.smithi138.stderr: -465> 2024-09-14T11:39:36.277+0000 7f1ffdbb9640 10 monclient: _finish_hunting 0 2024-09-14T11:39:36.908 INFO:tasks.workunit.client.0.smithi138.stderr: -464> 2024-09-14T11:39:36.277+0000 7f1ffdbb9640 1 monclient: found mon.noname-a 2024-09-14T11:39:36.908 INFO:tasks.workunit.client.0.smithi138.stderr: -463> 2024-09-14T11:39:36.277+0000 7f1ffdbb9640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.138:3300/0 2024-09-14T11:39:36.908 INFO:tasks.workunit.client.0.smithi138.stderr: -462> 2024-09-14T11:39:36.277+0000 7f1ee9e03640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:39:36.908 INFO:tasks.workunit.client.0.smithi138.stderr: -461> 2024-09-14T11:39:36.277+0000 7f1ee9e03640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-14T11:39:36.908 INFO:tasks.workunit.client.0.smithi138.stderr: -460> 2024-09-14T11:39:36.277+0000 7f1ee9e03640 10 monclient: dump: 2024-09-14T11:39:36.908 INFO:tasks.workunit.client.0.smithi138.stderr:epoch 1 2024-09-14T11:39:36.908 INFO:tasks.workunit.client.0.smithi138.stderr:fsid 3f225f43-83a6-4aeb-b798-1f04bb49d597 2024-09-14T11:39:36.908 INFO:tasks.workunit.client.0.smithi138.stderr:last_changed 2024-09-14T11:07:09.252780+0000 2024-09-14T11:39:36.908 INFO:tasks.workunit.client.0.smithi138.stderr:created 2024-09-14T11:07:09.252780+0000 2024-09-14T11:39:36.908 INFO:tasks.workunit.client.0.smithi138.stderr:min_mon_release 19 (squid) 2024-09-14T11:39:36.908 INFO:tasks.workunit.client.0.smithi138.stderr:election_strategy: 1 2024-09-14T11:39:36.908 INFO:tasks.workunit.client.0.smithi138.stderr:0: [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] mon.a 2024-09-14T11:39:36.908 INFO:tasks.workunit.client.0.smithi138.stderr:1: [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] mon.b 2024-09-14T11:39:36.909 INFO:tasks.workunit.client.0.smithi138.stderr:2: [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] mon.c 2024-09-14T11:39:36.909 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-14T11:39:36.909 INFO:tasks.workunit.client.0.smithi138.stderr: -459> 2024-09-14T11:39:36.277+0000 7f1ee9e03640 10 monclient: _finish_auth 0 2024-09-14T11:39:36.909 INFO:tasks.workunit.client.0.smithi138.stderr: -458> 2024-09-14T11:39:36.277+0000 7f1ee9e03640 10 monclient: _check_auth_tickets 2024-09-14T11:39:36.909 INFO:tasks.workunit.client.0.smithi138.stderr: -457> 2024-09-14T11:39:36.277+0000 7f1fff8b29c0 5 monclient: authenticate success, global_id 8010 2024-09-14T11:39:36.909 INFO:tasks.workunit.client.0.smithi138.stderr: -456> 2024-09-14T11:39:36.277+0000 7f1fff8b29c0 10 monclient: _renew_subs 2024-09-14T11:39:36.909 INFO:tasks.workunit.client.0.smithi138.stderr: -455> 2024-09-14T11:39:36.277+0000 7f1fff8b29c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.138:3300/0 2024-09-14T11:39:36.909 INFO:tasks.workunit.client.0.smithi138.stderr: -454> 2024-09-14T11:39:36.277+0000 7f1ee9e03640 10 monclient: handle_config config(0 keys) 2024-09-14T11:39:36.909 INFO:tasks.workunit.client.0.smithi138.stderr: -453> 2024-09-14T11:39:36.277+0000 7f1ee9e03640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:39:36.909 INFO:tasks.workunit.client.0.smithi138.stderr: -452> 2024-09-14T11:39:36.277+0000 7f1ee9e03640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-14T11:39:36.909 INFO:tasks.workunit.client.0.smithi138.stderr: -451> 2024-09-14T11:39:36.277+0000 7f1ee9e03640 10 monclient: dump: 2024-09-14T11:39:36.909 INFO:tasks.workunit.client.0.smithi138.stderr:epoch 1 2024-09-14T11:39:36.909 INFO:tasks.workunit.client.0.smithi138.stderr:fsid 3f225f43-83a6-4aeb-b798-1f04bb49d597 2024-09-14T11:39:36.909 INFO:tasks.workunit.client.0.smithi138.stderr:last_changed 2024-09-14T11:07:09.252780+0000 2024-09-14T11:39:36.910 INFO:tasks.workunit.client.0.smithi138.stderr:created 2024-09-14T11:07:09.252780+0000 2024-09-14T11:39:36.910 INFO:tasks.workunit.client.0.smithi138.stderr:min_mon_release 19 (squid) 2024-09-14T11:39:36.910 INFO:tasks.workunit.client.0.smithi138.stderr:election_strategy: 1 2024-09-14T11:39:36.910 INFO:tasks.workunit.client.0.smithi138.stderr:0: [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] mon.a 2024-09-14T11:39:36.910 INFO:tasks.workunit.client.0.smithi138.stderr:1: [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] mon.b 2024-09-14T11:39:36.910 INFO:tasks.workunit.client.0.smithi138.stderr:2: [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] mon.c 2024-09-14T11:39:36.910 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-14T11:39:36.910 INFO:tasks.workunit.client.0.smithi138.stderr: -450> 2024-09-14T11:39:36.277+0000 7f1eeb606640 4 set_mon_vals no callback set 2024-09-14T11:39:36.910 INFO:tasks.workunit.client.0.smithi138.stderr: -449> 2024-09-14T11:39:36.277+0000 7f1fff8b29c0 10 monclient: _renew_subs 2024-09-14T11:39:36.910 INFO:tasks.workunit.client.0.smithi138.stderr: -448> 2024-09-14T11:39:36.277+0000 7f1fff8b29c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.138:3300/0 2024-09-14T11:39:36.910 INFO:tasks.workunit.client.0.smithi138.stderr: -447> 2024-09-14T11:39:36.277+0000 7f1fff8b29c0 1 librados: init done 2024-09-14T11:39:36.910 INFO:tasks.workunit.client.0.smithi138.stderr: -446> 2024-09-14T11:39:36.281+0000 7f1ee9e03640 4 mgrc handle_mgr_map Got map version 5 2024-09-14T11:39:36.910 INFO:tasks.workunit.client.0.smithi138.stderr: -445> 2024-09-14T11:39:36.281+0000 7f1ee9e03640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.138:6832/3778043143,v1:172.21.15.138:6833/3778043143] 2024-09-14T11:39:36.910 INFO:tasks.workunit.client.0.smithi138.stderr: -444> 2024-09-14T11:39:36.281+0000 7f1ee9e03640 4 mgrc reconnect Starting new session with [v2:172.21.15.138:6832/3778043143,v1:172.21.15.138:6833/3778043143] 2024-09-14T11:39:36.911 INFO:tasks.workunit.client.0.smithi138.stderr: -443> 2024-09-14T11:39:36.281+0000 7f1ffd3b8640 10 monclient: get_auth_request con 0x7f1ee40718d0 auth_method 0 2024-09-14T11:39:36.911 INFO:tasks.workunit.client.0.smithi138.stderr: -442> 2024-09-14T11:39:36.281+0000 7f1ffcbb7640 10 monclient: get_auth_request con 0x5612561507a0 auth_method 0 2024-09-14T11:39:36.911 INFO:tasks.workunit.client.0.smithi138.stderr: -441> 2024-09-14T11:39:36.281+0000 7f1ffd3b8640 10 monclient: get_auth_request con 0x561256173760 auth_method 0 2024-09-14T11:39:36.911 INFO:tasks.workunit.client.0.smithi138.stderr: -440> 2024-09-14T11:39:36.285+0000 7f1ffcbb7640 10 monclient: get_auth_request con 0x561256177e00 auth_method 0 2024-09-14T11:39:36.911 INFO:tasks.workunit.client.0.smithi138.stderr: -439> 2024-09-14T11:39:36.285+0000 7f1ffdbb9640 10 monclient: get_auth_request con 0x561256177460 auth_method 0 2024-09-14T11:39:36.911 INFO:tasks.workunit.client.0.smithi138.stderr: -438> 2024-09-14T11:39:36.285+0000 7f1fff8b29c0 10 monclient: build_initial_monmap 2024-09-14T11:39:36.911 INFO:tasks.workunit.client.0.smithi138.stderr: -437> 2024-09-14T11:39:36.285+0000 7f1fff8b29c0 1 build_initial for_mkfs: 0 2024-09-14T11:39:36.911 INFO:tasks.workunit.client.0.smithi138.stderr: -436> 2024-09-14T11:39:36.285+0000 7f1fff8b29c0 10 monclient: monmap: 2024-09-14T11:39:36.911 INFO:tasks.workunit.client.0.smithi138.stderr:epoch 0 2024-09-14T11:39:36.911 INFO:tasks.workunit.client.0.smithi138.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-14T11:39:36.911 INFO:tasks.workunit.client.0.smithi138.stderr:last_changed 0.000000 2024-09-14T11:39:36.911 INFO:tasks.workunit.client.0.smithi138.stderr:created 0.000000 2024-09-14T11:39:36.911 INFO:tasks.workunit.client.0.smithi138.stderr:min_mon_release 0 (unknown) 2024-09-14T11:39:36.911 INFO:tasks.workunit.client.0.smithi138.stderr:election_strategy: 1 2024-09-14T11:39:36.911 INFO:tasks.workunit.client.0.smithi138.stderr:0: [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] mon.noname-a 2024-09-14T11:39:36.912 INFO:tasks.workunit.client.0.smithi138.stderr:1: [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] mon.noname-b 2024-09-14T11:39:36.912 INFO:tasks.workunit.client.0.smithi138.stderr:2: [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] mon.noname-c 2024-09-14T11:39:36.912 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-14T11:39:36.912 INFO:tasks.workunit.client.0.smithi138.stderr: -435> 2024-09-14T11:39:36.285+0000 7f1fff8b29c0 5 AuthRegistry(0x56125617fde0) adding auth protocol: cephx 2024-09-14T11:39:36.912 INFO:tasks.workunit.client.0.smithi138.stderr: -434> 2024-09-14T11:39:36.285+0000 7f1fff8b29c0 5 AuthRegistry(0x56125617fde0) adding auth protocol: cephx 2024-09-14T11:39:36.912 INFO:tasks.workunit.client.0.smithi138.stderr: -433> 2024-09-14T11:39:36.285+0000 7f1fff8b29c0 5 AuthRegistry(0x56125617fde0) adding auth protocol: cephx 2024-09-14T11:39:36.912 INFO:tasks.workunit.client.0.smithi138.stderr: -432> 2024-09-14T11:39:36.285+0000 7f1fff8b29c0 5 AuthRegistry(0x56125617fde0) adding con mode: secure 2024-09-14T11:39:36.912 INFO:tasks.workunit.client.0.smithi138.stderr: -431> 2024-09-14T11:39:36.285+0000 7f1fff8b29c0 5 AuthRegistry(0x56125617fde0) adding con mode: crc 2024-09-14T11:39:36.912 INFO:tasks.workunit.client.0.smithi138.stderr: -430> 2024-09-14T11:39:36.285+0000 7f1fff8b29c0 5 AuthRegistry(0x56125617fde0) adding con mode: secure 2024-09-14T11:39:36.912 INFO:tasks.workunit.client.0.smithi138.stderr: -429> 2024-09-14T11:39:36.285+0000 7f1fff8b29c0 5 AuthRegistry(0x56125617fde0) adding con mode: crc 2024-09-14T11:39:36.912 INFO:tasks.workunit.client.0.smithi138.stderr: -428> 2024-09-14T11:39:36.285+0000 7f1fff8b29c0 5 AuthRegistry(0x56125617fde0) adding con mode: secure 2024-09-14T11:39:36.912 INFO:tasks.workunit.client.0.smithi138.stderr: -427> 2024-09-14T11:39:36.285+0000 7f1fff8b29c0 5 AuthRegistry(0x56125617fde0) adding con mode: crc 2024-09-14T11:39:36.912 INFO:tasks.workunit.client.0.smithi138.stderr: -426> 2024-09-14T11:39:36.285+0000 7f1fff8b29c0 5 AuthRegistry(0x56125617fde0) adding con mode: crc 2024-09-14T11:39:36.912 INFO:tasks.workunit.client.0.smithi138.stderr: -425> 2024-09-14T11:39:36.285+0000 7f1fff8b29c0 5 AuthRegistry(0x56125617fde0) adding con mode: secure 2024-09-14T11:39:36.912 INFO:tasks.workunit.client.0.smithi138.stderr: -424> 2024-09-14T11:39:36.285+0000 7f1fff8b29c0 5 AuthRegistry(0x56125617fde0) adding con mode: crc 2024-09-14T11:39:36.913 INFO:tasks.workunit.client.0.smithi138.stderr: -423> 2024-09-14T11:39:36.285+0000 7f1fff8b29c0 5 AuthRegistry(0x56125617fde0) adding con mode: secure 2024-09-14T11:39:36.913 INFO:tasks.workunit.client.0.smithi138.stderr: -422> 2024-09-14T11:39:36.285+0000 7f1fff8b29c0 5 AuthRegistry(0x56125617fde0) adding con mode: crc 2024-09-14T11:39:36.913 INFO:tasks.workunit.client.0.smithi138.stderr: -421> 2024-09-14T11:39:36.285+0000 7f1fff8b29c0 5 AuthRegistry(0x56125617fde0) adding con mode: secure 2024-09-14T11:39:36.913 INFO:tasks.workunit.client.0.smithi138.stderr: -420> 2024-09-14T11:39:36.285+0000 7f1fff8b29c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:39:36.913 INFO:tasks.workunit.client.0.smithi138.stderr: -419> 2024-09-14T11:39:36.285+0000 7f1fff8b29c0 5 asok(0x561255f1dd90) register_command objecter_requests cmddesc objecter_requests hook 0x561256183810 EEXIST 2024-09-14T11:39:36.913 INFO:tasks.workunit.client.0.smithi138.stderr: -418> 2024-09-14T11:39:36.285+0000 7f1fff8b29c0 10 monclient: init 2024-09-14T11:39:36.913 INFO:tasks.workunit.client.0.smithi138.stderr: -417> 2024-09-14T11:39:36.285+0000 7f1fff8b29c0 5 AuthRegistry(0x56125617ecd8) adding auth protocol: cephx 2024-09-14T11:39:36.913 INFO:tasks.workunit.client.0.smithi138.stderr: -416> 2024-09-14T11:39:36.285+0000 7f1fff8b29c0 5 AuthRegistry(0x56125617ecd8) adding auth protocol: cephx 2024-09-14T11:39:36.913 INFO:tasks.workunit.client.0.smithi138.stderr: -415> 2024-09-14T11:39:36.285+0000 7f1fff8b29c0 5 AuthRegistry(0x56125617ecd8) adding auth protocol: cephx 2024-09-14T11:39:36.913 INFO:tasks.workunit.client.0.smithi138.stderr: -414> 2024-09-14T11:39:36.285+0000 7f1fff8b29c0 5 AuthRegistry(0x56125617ecd8) adding con mode: secure 2024-09-14T11:39:36.913 INFO:tasks.workunit.client.0.smithi138.stderr: -413> 2024-09-14T11:39:36.285+0000 7f1fff8b29c0 5 AuthRegistry(0x56125617ecd8) adding con mode: crc 2024-09-14T11:39:36.913 INFO:tasks.workunit.client.0.smithi138.stderr: -412> 2024-09-14T11:39:36.285+0000 7f1fff8b29c0 5 AuthRegistry(0x56125617ecd8) adding con mode: secure 2024-09-14T11:39:36.913 INFO:tasks.workunit.client.0.smithi138.stderr: -411> 2024-09-14T11:39:36.285+0000 7f1fff8b29c0 5 AuthRegistry(0x56125617ecd8) adding con mode: crc 2024-09-14T11:39:36.913 INFO:tasks.workunit.client.0.smithi138.stderr: -410> 2024-09-14T11:39:36.285+0000 7f1fff8b29c0 5 AuthRegistry(0x56125617ecd8) adding con mode: secure 2024-09-14T11:39:36.913 INFO:tasks.workunit.client.0.smithi138.stderr: -409> 2024-09-14T11:39:36.285+0000 7f1fff8b29c0 5 AuthRegistry(0x56125617ecd8) adding con mode: crc 2024-09-14T11:39:36.914 INFO:tasks.workunit.client.0.smithi138.stderr: -408> 2024-09-14T11:39:36.285+0000 7f1fff8b29c0 5 AuthRegistry(0x56125617ecd8) adding con mode: crc 2024-09-14T11:39:36.914 INFO:tasks.workunit.client.0.smithi138.stderr: -407> 2024-09-14T11:39:36.285+0000 7f1fff8b29c0 5 AuthRegistry(0x56125617ecd8) adding con mode: secure 2024-09-14T11:39:36.914 INFO:tasks.workunit.client.0.smithi138.stderr: -406> 2024-09-14T11:39:36.285+0000 7f1fff8b29c0 5 AuthRegistry(0x56125617ecd8) adding con mode: crc 2024-09-14T11:39:36.914 INFO:tasks.workunit.client.0.smithi138.stderr: -405> 2024-09-14T11:39:36.285+0000 7f1fff8b29c0 5 AuthRegistry(0x56125617ecd8) adding con mode: secure 2024-09-14T11:39:36.914 INFO:tasks.workunit.client.0.smithi138.stderr: -404> 2024-09-14T11:39:36.285+0000 7f1fff8b29c0 5 AuthRegistry(0x56125617ecd8) adding con mode: crc 2024-09-14T11:39:36.914 INFO:tasks.workunit.client.0.smithi138.stderr: -403> 2024-09-14T11:39:36.285+0000 7f1fff8b29c0 5 AuthRegistry(0x56125617ecd8) adding con mode: secure 2024-09-14T11:39:36.914 INFO:tasks.workunit.client.0.smithi138.stderr: -402> 2024-09-14T11:39:36.289+0000 7f1fff8b29c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:39:36.914 INFO:tasks.workunit.client.0.smithi138.stderr: -401> 2024-09-14T11:39:36.289+0000 7f1fff8b29c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:39:36.914 INFO:tasks.workunit.client.0.smithi138.stderr: -400> 2024-09-14T11:39:36.289+0000 7f1fff8b29c0 5 asok(0x561255f1dd90) register_command rotate-key cmddesc rotate-key hook 0x56125617ee20 EEXIST 2024-09-14T11:39:36.914 INFO:tasks.workunit.client.0.smithi138.stderr: -399> 2024-09-14T11:39:36.289+0000 7f1fff8b29c0 10 monclient: _reopen_session rank -1 2024-09-14T11:39:36.914 INFO:tasks.workunit.client.0.smithi138.stderr: -398> 2024-09-14T11:39:36.289+0000 7f1fff8b29c0 10 monclient: _add_conns ranks=[2,0,1] 2024-09-14T11:39:36.914 INFO:tasks.workunit.client.0.smithi138.stderr: -397> 2024-09-14T11:39:36.289+0000 7f1fff8b29c0 10 monclient(hunting): picked mon.noname-c con 0x5612561a79c0 addr [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] 2024-09-14T11:39:36.914 INFO:tasks.workunit.client.0.smithi138.stderr: -396> 2024-09-14T11:39:36.289+0000 7f1fff8b29c0 10 monclient(hunting): picked mon.noname-a con 0x5612561a72f0 addr [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] 2024-09-14T11:39:36.914 INFO:tasks.workunit.client.0.smithi138.stderr: -395> 2024-09-14T11:39:36.289+0000 7f1fff8b29c0 10 monclient(hunting): picked mon.noname-b con 0x5612561a5cd0 addr [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] 2024-09-14T11:39:36.914 INFO:tasks.workunit.client.0.smithi138.stderr: -394> 2024-09-14T11:39:36.289+0000 7f1fff8b29c0 10 monclient(hunting): start opening mon connection 2024-09-14T11:39:36.915 INFO:tasks.workunit.client.0.smithi138.stderr: -393> 2024-09-14T11:39:36.289+0000 7f1fff8b29c0 10 monclient(hunting): start opening mon connection 2024-09-14T11:39:36.915 INFO:tasks.workunit.client.0.smithi138.stderr: -392> 2024-09-14T11:39:36.289+0000 7f1fff8b29c0 10 monclient(hunting): start opening mon connection 2024-09-14T11:39:36.915 INFO:tasks.workunit.client.0.smithi138.stderr: -391> 2024-09-14T11:39:36.289+0000 7f1fff8b29c0 10 monclient(hunting): _renew_subs 2024-09-14T11:39:36.915 INFO:tasks.workunit.client.0.smithi138.stderr: -390> 2024-09-14T11:39:36.289+0000 7f1fff8b29c0 10 monclient(hunting): authenticate will time out at 2912.252450s 2024-09-14T11:39:36.915 INFO:tasks.workunit.client.0.smithi138.stderr: -389> 2024-09-14T11:39:36.289+0000 7f1ffcbb7640 10 monclient(hunting): get_auth_request con 0x5612561a79c0 auth_method 0 2024-09-14T11:39:36.915 INFO:tasks.workunit.client.0.smithi138.stderr: -388> 2024-09-14T11:39:36.289+0000 7f1ffcbb7640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:39:36.915 INFO:tasks.workunit.client.0.smithi138.stderr: -387> 2024-09-14T11:39:36.289+0000 7f1ffcbb7640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:39:36.915 INFO:tasks.workunit.client.0.smithi138.stderr: -386> 2024-09-14T11:39:36.289+0000 7f1ffcbb7640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:39:36.915 INFO:tasks.workunit.client.0.smithi138.stderr: -385> 2024-09-14T11:39:36.289+0000 7f1ffdbb9640 10 monclient(hunting): get_auth_request con 0x5612561a72f0 auth_method 0 2024-09-14T11:39:36.915 INFO:tasks.workunit.client.0.smithi138.stderr: -384> 2024-09-14T11:39:36.289+0000 7f1ffdbb9640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:39:36.915 INFO:tasks.workunit.client.0.smithi138.stderr: -383> 2024-09-14T11:39:36.289+0000 7f1ffdbb9640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:39:36.915 INFO:tasks.workunit.client.0.smithi138.stderr: -382> 2024-09-14T11:39:36.289+0000 7f1ffdbb9640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:39:36.915 INFO:tasks.workunit.client.0.smithi138.stderr: -381> 2024-09-14T11:39:36.289+0000 7f1ffcbb7640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:39:36.915 INFO:tasks.workunit.client.0.smithi138.stderr: -380> 2024-09-14T11:39:36.289+0000 7f1ffcbb7640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:39:36.915 INFO:tasks.workunit.client.0.smithi138.stderr: -379> 2024-09-14T11:39:36.289+0000 7f1ffcbb7640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:39:36.916 INFO:tasks.workunit.client.0.smithi138.stderr: -378> 2024-09-14T11:39:36.289+0000 7f1ffdbb9640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:39:36.916 INFO:tasks.workunit.client.0.smithi138.stderr: -377> 2024-09-14T11:39:36.289+0000 7f1ffdbb9640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:39:36.916 INFO:tasks.workunit.client.0.smithi138.stderr: -376> 2024-09-14T11:39:36.289+0000 7f1ffdbb9640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:39:36.916 INFO:tasks.workunit.client.0.smithi138.stderr: -375> 2024-09-14T11:39:36.289+0000 7f1ffdbb9640 10 monclient(hunting): handle_auth_done global_id 8013 payload 824 2024-09-14T11:39:36.916 INFO:tasks.workunit.client.0.smithi138.stderr: -374> 2024-09-14T11:39:36.289+0000 7f1ffdbb9640 10 monclient: _finish_hunting 0 2024-09-14T11:39:36.916 INFO:tasks.workunit.client.0.smithi138.stderr: -373> 2024-09-14T11:39:36.289+0000 7f1ffdbb9640 1 monclient: found mon.noname-a 2024-09-14T11:39:36.916 INFO:tasks.workunit.client.0.smithi138.stderr: -372> 2024-09-14T11:39:36.289+0000 7f1ffdbb9640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.138:3300/0 2024-09-14T11:39:36.916 INFO:tasks.workunit.client.0.smithi138.stderr: -371> 2024-09-14T11:39:36.289+0000 7f1ffd3b8640 10 monclient: get_auth_request con 0x5612561a5cd0 auth_method 0 2024-09-14T11:39:36.916 INFO:tasks.workunit.client.0.smithi138.stderr: -370> 2024-09-14T11:39:36.289+0000 7f1ee2ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:39:36.916 INFO:tasks.workunit.client.0.smithi138.stderr: -369> 2024-09-14T11:39:36.289+0000 7f1ee2ffd640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-14T11:39:36.916 INFO:tasks.workunit.client.0.smithi138.stderr: -368> 2024-09-14T11:39:36.289+0000 7f1ee2ffd640 10 monclient: dump: 2024-09-14T11:39:36.916 INFO:tasks.workunit.client.0.smithi138.stderr:epoch 1 2024-09-14T11:39:36.916 INFO:tasks.workunit.client.0.smithi138.stderr:fsid 3f225f43-83a6-4aeb-b798-1f04bb49d597 2024-09-14T11:39:36.916 INFO:tasks.workunit.client.0.smithi138.stderr:last_changed 2024-09-14T11:07:09.252780+0000 2024-09-14T11:39:36.916 INFO:tasks.workunit.client.0.smithi138.stderr:created 2024-09-14T11:07:09.252780+0000 2024-09-14T11:39:36.917 INFO:tasks.workunit.client.0.smithi138.stderr:min_mon_release 19 (squid) 2024-09-14T11:39:36.917 INFO:tasks.workunit.client.0.smithi138.stderr:election_strategy: 1 2024-09-14T11:39:36.917 INFO:tasks.workunit.client.0.smithi138.stderr:0: [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] mon.a 2024-09-14T11:39:36.917 INFO:tasks.workunit.client.0.smithi138.stderr:1: [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] mon.b 2024-09-14T11:39:36.917 INFO:tasks.workunit.client.0.smithi138.stderr:2: [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] mon.c 2024-09-14T11:39:36.917 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-14T11:39:36.917 INFO:tasks.workunit.client.0.smithi138.stderr: -367> 2024-09-14T11:39:36.289+0000 7f1ee2ffd640 10 monclient: _finish_auth 0 2024-09-14T11:39:36.917 INFO:tasks.workunit.client.0.smithi138.stderr: -366> 2024-09-14T11:39:36.289+0000 7f1ee2ffd640 10 monclient: _check_auth_tickets 2024-09-14T11:39:36.917 INFO:tasks.workunit.client.0.smithi138.stderr: -365> 2024-09-14T11:39:36.289+0000 7f1fff8b29c0 5 monclient: authenticate success, global_id 8013 2024-09-14T11:39:36.917 INFO:tasks.workunit.client.0.smithi138.stderr: -364> 2024-09-14T11:39:36.289+0000 7f1ee2ffd640 10 monclient: handle_config config(0 keys) 2024-09-14T11:39:36.917 INFO:tasks.workunit.client.0.smithi138.stderr: -363> 2024-09-14T11:39:36.289+0000 7f1ee2ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:39:36.917 INFO:tasks.workunit.client.0.smithi138.stderr: -362> 2024-09-14T11:39:36.289+0000 7f1ee2ffd640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-14T11:39:36.917 INFO:tasks.workunit.client.0.smithi138.stderr: -361> 2024-09-14T11:39:36.289+0000 7f1ee2ffd640 10 monclient: dump: 2024-09-14T11:39:36.917 INFO:tasks.workunit.client.0.smithi138.stderr:epoch 1 2024-09-14T11:39:36.917 INFO:tasks.workunit.client.0.smithi138.stderr:fsid 3f225f43-83a6-4aeb-b798-1f04bb49d597 2024-09-14T11:39:36.918 INFO:tasks.workunit.client.0.smithi138.stderr:last_changed 2024-09-14T11:07:09.252780+0000 2024-09-14T11:39:36.918 INFO:tasks.workunit.client.0.smithi138.stderr:created 2024-09-14T11:07:09.252780+0000 2024-09-14T11:39:36.918 INFO:tasks.workunit.client.0.smithi138.stderr:min_mon_release 19 (squid) 2024-09-14T11:39:36.918 INFO:tasks.workunit.client.0.smithi138.stderr:election_strategy: 1 2024-09-14T11:39:36.918 INFO:tasks.workunit.client.0.smithi138.stderr:0: [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] mon.a 2024-09-14T11:39:36.918 INFO:tasks.workunit.client.0.smithi138.stderr:1: [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] mon.b 2024-09-14T11:39:36.918 INFO:tasks.workunit.client.0.smithi138.stderr:2: [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] mon.c 2024-09-14T11:39:36.918 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-14T11:39:36.918 INFO:tasks.workunit.client.0.smithi138.stderr: -360> 2024-09-14T11:39:36.289+0000 7f1ffe3ba640 4 set_mon_vals no callback set 2024-09-14T11:39:36.918 INFO:tasks.workunit.client.0.smithi138.stderr: -359> 2024-09-14T11:39:36.289+0000 7f1fff8b29c0 10 monclient: _renew_subs 2024-09-14T11:39:36.918 INFO:tasks.workunit.client.0.smithi138.stderr: -358> 2024-09-14T11:39:36.289+0000 7f1fff8b29c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.138:3300/0 2024-09-14T11:39:36.918 INFO:tasks.workunit.client.0.smithi138.stderr: -357> 2024-09-14T11:39:36.289+0000 7f1fff8b29c0 10 monclient: _renew_subs 2024-09-14T11:39:36.918 INFO:tasks.workunit.client.0.smithi138.stderr: -356> 2024-09-14T11:39:36.289+0000 7f1fff8b29c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.138:3300/0 2024-09-14T11:39:36.918 INFO:tasks.workunit.client.0.smithi138.stderr: -355> 2024-09-14T11:39:36.289+0000 7f1ee2ffd640 4 mgrc handle_mgr_map Got map version 5 2024-09-14T11:39:36.918 INFO:tasks.workunit.client.0.smithi138.stderr: -354> 2024-09-14T11:39:36.289+0000 7f1ee2ffd640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.138:6832/3778043143,v1:172.21.15.138:6833/3778043143] 2024-09-14T11:39:36.918 INFO:tasks.workunit.client.0.smithi138.stderr: -353> 2024-09-14T11:39:36.289+0000 7f1ee2ffd640 4 mgrc reconnect Starting new session with [v2:172.21.15.138:6832/3778043143,v1:172.21.15.138:6833/3778043143] 2024-09-14T11:39:36.919 INFO:tasks.workunit.client.0.smithi138.stderr: -352> 2024-09-14T11:39:36.289+0000 7f1ffcbb7640 10 monclient: get_auth_request con 0x7f1ed40717e0 auth_method 0 2024-09-14T11:39:36.919 INFO:tasks.workunit.client.0.smithi138.stderr: -351> 2024-09-14T11:39:36.289+0000 7f1fff8b29c0 10 monclient: get_monmap_and_config 2024-09-14T11:39:36.919 INFO:tasks.workunit.client.0.smithi138.stderr: -350> 2024-09-14T11:39:36.289+0000 7f1fff8b29c0 10 monclient: build_initial_monmap 2024-09-14T11:39:36.919 INFO:tasks.workunit.client.0.smithi138.stderr: -349> 2024-09-14T11:39:36.289+0000 7f1fff8b29c0 1 build_initial for_mkfs: 0 2024-09-14T11:39:36.919 INFO:tasks.workunit.client.0.smithi138.stderr: -348> 2024-09-14T11:39:36.289+0000 7f1fff8b29c0 10 monclient: monmap: 2024-09-14T11:39:36.919 INFO:tasks.workunit.client.0.smithi138.stderr:epoch 0 2024-09-14T11:39:36.919 INFO:tasks.workunit.client.0.smithi138.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-14T11:39:36.919 INFO:tasks.workunit.client.0.smithi138.stderr:last_changed 0.000000 2024-09-14T11:39:36.919 INFO:tasks.workunit.client.0.smithi138.stderr:created 0.000000 2024-09-14T11:39:36.919 INFO:tasks.workunit.client.0.smithi138.stderr:min_mon_release 0 (unknown) 2024-09-14T11:39:36.919 INFO:tasks.workunit.client.0.smithi138.stderr:election_strategy: 1 2024-09-14T11:39:36.919 INFO:tasks.workunit.client.0.smithi138.stderr:0: [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] mon.noname-a 2024-09-14T11:39:36.919 INFO:tasks.workunit.client.0.smithi138.stderr:1: [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] mon.noname-b 2024-09-14T11:39:36.919 INFO:tasks.workunit.client.0.smithi138.stderr:2: [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] mon.noname-c 2024-09-14T11:39:36.919 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-14T11:39:36.919 INFO:tasks.workunit.client.0.smithi138.stderr: -347> 2024-09-14T11:39:36.293+0000 7f1fff8b29c0 5 AuthRegistry(0x5612561c7160) adding auth protocol: cephx 2024-09-14T11:39:36.920 INFO:tasks.workunit.client.0.smithi138.stderr: -346> 2024-09-14T11:39:36.293+0000 7f1fff8b29c0 5 AuthRegistry(0x5612561c7160) adding auth protocol: cephx 2024-09-14T11:39:36.920 INFO:tasks.workunit.client.0.smithi138.stderr: -345> 2024-09-14T11:39:36.293+0000 7f1fff8b29c0 5 AuthRegistry(0x5612561c7160) adding auth protocol: cephx 2024-09-14T11:39:36.920 INFO:tasks.workunit.client.0.smithi138.stderr: -344> 2024-09-14T11:39:36.293+0000 7f1fff8b29c0 5 AuthRegistry(0x5612561c7160) adding con mode: secure 2024-09-14T11:39:36.920 INFO:tasks.workunit.client.0.smithi138.stderr: -343> 2024-09-14T11:39:36.293+0000 7f1fff8b29c0 5 AuthRegistry(0x5612561c7160) adding con mode: crc 2024-09-14T11:39:36.920 INFO:tasks.workunit.client.0.smithi138.stderr: -342> 2024-09-14T11:39:36.293+0000 7f1fff8b29c0 5 AuthRegistry(0x5612561c7160) adding con mode: secure 2024-09-14T11:39:36.920 INFO:tasks.workunit.client.0.smithi138.stderr: -341> 2024-09-14T11:39:36.293+0000 7f1fff8b29c0 5 AuthRegistry(0x5612561c7160) adding con mode: crc 2024-09-14T11:39:36.920 INFO:tasks.workunit.client.0.smithi138.stderr: -340> 2024-09-14T11:39:36.293+0000 7f1fff8b29c0 5 AuthRegistry(0x5612561c7160) adding con mode: secure 2024-09-14T11:39:36.920 INFO:tasks.workunit.client.0.smithi138.stderr: -339> 2024-09-14T11:39:36.293+0000 7f1fff8b29c0 5 AuthRegistry(0x5612561c7160) adding con mode: crc 2024-09-14T11:39:36.920 INFO:tasks.workunit.client.0.smithi138.stderr: -338> 2024-09-14T11:39:36.293+0000 7f1fff8b29c0 5 AuthRegistry(0x5612561c7160) adding con mode: crc 2024-09-14T11:39:36.920 INFO:tasks.workunit.client.0.smithi138.stderr: -337> 2024-09-14T11:39:36.293+0000 7f1fff8b29c0 5 AuthRegistry(0x5612561c7160) adding con mode: secure 2024-09-14T11:39:36.920 INFO:tasks.workunit.client.0.smithi138.stderr: -336> 2024-09-14T11:39:36.293+0000 7f1fff8b29c0 5 AuthRegistry(0x5612561c7160) adding con mode: crc 2024-09-14T11:39:36.920 INFO:tasks.workunit.client.0.smithi138.stderr: -335> 2024-09-14T11:39:36.293+0000 7f1fff8b29c0 5 AuthRegistry(0x5612561c7160) adding con mode: secure 2024-09-14T11:39:36.920 INFO:tasks.workunit.client.0.smithi138.stderr: -334> 2024-09-14T11:39:36.293+0000 7f1fff8b29c0 5 AuthRegistry(0x5612561c7160) adding con mode: crc 2024-09-14T11:39:36.920 INFO:tasks.workunit.client.0.smithi138.stderr: -333> 2024-09-14T11:39:36.293+0000 7f1fff8b29c0 5 AuthRegistry(0x5612561c7160) adding con mode: secure 2024-09-14T11:39:36.920 INFO:tasks.workunit.client.0.smithi138.stderr: -332> 2024-09-14T11:39:36.293+0000 7f1fff8b29c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:39:36.921 INFO:tasks.workunit.client.0.smithi138.stderr: -331> 2024-09-14T11:39:36.293+0000 7f1fff8b29c0 10 monclient: init 2024-09-14T11:39:36.921 INFO:tasks.workunit.client.0.smithi138.stderr: -330> 2024-09-14T11:39:36.293+0000 7f1fff8b29c0 5 AuthRegistry(0x7fffbf76b4b0) adding auth protocol: cephx 2024-09-14T11:39:36.921 INFO:tasks.workunit.client.0.smithi138.stderr: -329> 2024-09-14T11:39:36.293+0000 7f1fff8b29c0 5 AuthRegistry(0x7fffbf76b4b0) adding auth protocol: cephx 2024-09-14T11:39:36.921 INFO:tasks.workunit.client.0.smithi138.stderr: -328> 2024-09-14T11:39:36.293+0000 7f1fff8b29c0 5 AuthRegistry(0x7fffbf76b4b0) adding auth protocol: cephx 2024-09-14T11:39:36.921 INFO:tasks.workunit.client.0.smithi138.stderr: -327> 2024-09-14T11:39:36.293+0000 7f1fff8b29c0 5 AuthRegistry(0x7fffbf76b4b0) adding con mode: secure 2024-09-14T11:39:36.921 INFO:tasks.workunit.client.0.smithi138.stderr: -326> 2024-09-14T11:39:36.293+0000 7f1fff8b29c0 5 AuthRegistry(0x7fffbf76b4b0) adding con mode: crc 2024-09-14T11:39:36.921 INFO:tasks.workunit.client.0.smithi138.stderr: -325> 2024-09-14T11:39:36.293+0000 7f1fff8b29c0 5 AuthRegistry(0x7fffbf76b4b0) adding con mode: secure 2024-09-14T11:39:36.921 INFO:tasks.workunit.client.0.smithi138.stderr: -324> 2024-09-14T11:39:36.293+0000 7f1fff8b29c0 5 AuthRegistry(0x7fffbf76b4b0) adding con mode: crc 2024-09-14T11:39:36.921 INFO:tasks.workunit.client.0.smithi138.stderr: -323> 2024-09-14T11:39:36.293+0000 7f1fff8b29c0 5 AuthRegistry(0x7fffbf76b4b0) adding con mode: secure 2024-09-14T11:39:36.921 INFO:tasks.workunit.client.0.smithi138.stderr: -322> 2024-09-14T11:39:36.293+0000 7f1fff8b29c0 5 AuthRegistry(0x7fffbf76b4b0) adding con mode: crc 2024-09-14T11:39:36.921 INFO:tasks.workunit.client.0.smithi138.stderr: -321> 2024-09-14T11:39:36.293+0000 7f1fff8b29c0 5 AuthRegistry(0x7fffbf76b4b0) adding con mode: crc 2024-09-14T11:39:36.921 INFO:tasks.workunit.client.0.smithi138.stderr: -320> 2024-09-14T11:39:36.293+0000 7f1fff8b29c0 5 AuthRegistry(0x7fffbf76b4b0) adding con mode: secure 2024-09-14T11:39:36.921 INFO:tasks.workunit.client.0.smithi138.stderr: -319> 2024-09-14T11:39:36.293+0000 7f1fff8b29c0 5 AuthRegistry(0x7fffbf76b4b0) adding con mode: crc 2024-09-14T11:39:36.922 INFO:tasks.workunit.client.0.smithi138.stderr: -318> 2024-09-14T11:39:36.293+0000 7f1fff8b29c0 5 AuthRegistry(0x7fffbf76b4b0) adding con mode: secure 2024-09-14T11:39:36.922 INFO:tasks.workunit.client.0.smithi138.stderr: -317> 2024-09-14T11:39:36.293+0000 7f1fff8b29c0 5 AuthRegistry(0x7fffbf76b4b0) adding con mode: crc 2024-09-14T11:39:36.922 INFO:tasks.workunit.client.0.smithi138.stderr: -316> 2024-09-14T11:39:36.293+0000 7f1fff8b29c0 5 AuthRegistry(0x7fffbf76b4b0) adding con mode: secure 2024-09-14T11:39:36.922 INFO:tasks.workunit.client.0.smithi138.stderr: -315> 2024-09-14T11:39:36.293+0000 7f1fff8b29c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:39:36.922 INFO:tasks.workunit.client.0.smithi138.stderr: -314> 2024-09-14T11:39:36.293+0000 7f1fff8b29c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:39:36.922 INFO:tasks.workunit.client.0.smithi138.stderr: -313> 2024-09-14T11:39:36.293+0000 7f1fff8b29c0 5 asok(0x561255f1dd90) register_command rotate-key cmddesc rotate-key hook 0x7fffbf76b5f8 EEXIST 2024-09-14T11:39:36.922 INFO:tasks.workunit.client.0.smithi138.stderr: -312> 2024-09-14T11:39:36.293+0000 7f1fff8b29c0 10 monclient: _reopen_session rank -1 2024-09-14T11:39:36.922 INFO:tasks.workunit.client.0.smithi138.stderr: -311> 2024-09-14T11:39:36.293+0000 7f1fff8b29c0 10 monclient: _add_conns ranks=[1,2,0] 2024-09-14T11:39:36.922 INFO:tasks.workunit.client.0.smithi138.stderr: -310> 2024-09-14T11:39:36.293+0000 7f1fff8b29c0 10 monclient(hunting): picked mon.noname-b con 0x5612561fb4d0 addr [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] 2024-09-14T11:39:36.922 INFO:tasks.workunit.client.0.smithi138.stderr: -309> 2024-09-14T11:39:36.293+0000 7f1fff8b29c0 10 monclient(hunting): picked mon.noname-c con 0x5612561fb8b0 addr [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] 2024-09-14T11:39:36.922 INFO:tasks.workunit.client.0.smithi138.stderr: -308> 2024-09-14T11:39:36.293+0000 7f1fff8b29c0 10 monclient(hunting): picked mon.noname-a con 0x5612561f7090 addr [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] 2024-09-14T11:39:36.922 INFO:tasks.workunit.client.0.smithi138.stderr: -307> 2024-09-14T11:39:36.293+0000 7f1fff8b29c0 10 monclient(hunting): start opening mon connection 2024-09-14T11:39:36.922 INFO:tasks.workunit.client.0.smithi138.stderr: -306> 2024-09-14T11:39:36.293+0000 7f1fff8b29c0 10 monclient(hunting): start opening mon connection 2024-09-14T11:39:36.922 INFO:tasks.workunit.client.0.smithi138.stderr: -305> 2024-09-14T11:39:36.293+0000 7f1fff8b29c0 10 monclient(hunting): start opening mon connection 2024-09-14T11:39:36.923 INFO:tasks.workunit.client.0.smithi138.stderr: -304> 2024-09-14T11:39:36.293+0000 7f1fff8b29c0 10 monclient(hunting): _renew_subs 2024-09-14T11:39:36.923 INFO:tasks.workunit.client.0.smithi138.stderr: -303> 2024-09-14T11:39:36.293+0000 7f1fff8b29c0 10 monclient(hunting): authenticate will time out at 2912.257030s 2024-09-14T11:39:36.923 INFO:tasks.workunit.client.0.smithi138.stderr: -302> 2024-09-14T11:39:36.293+0000 7f1ffdbb9640 10 monclient(hunting): get_auth_request con 0x5612561fb8b0 auth_method 0 2024-09-14T11:39:36.923 INFO:tasks.workunit.client.0.smithi138.stderr: -301> 2024-09-14T11:39:36.293+0000 7f1ffdbb9640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:39:36.923 INFO:tasks.workunit.client.0.smithi138.stderr: -300> 2024-09-14T11:39:36.293+0000 7f1ffdbb9640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:39:36.923 INFO:tasks.workunit.client.0.smithi138.stderr: -299> 2024-09-14T11:39:36.293+0000 7f1ffdbb9640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:39:36.923 INFO:tasks.workunit.client.0.smithi138.stderr: -298> 2024-09-14T11:39:36.293+0000 7f1ffd3b8640 10 monclient(hunting): get_auth_request con 0x5612561f7090 auth_method 0 2024-09-14T11:39:36.923 INFO:tasks.workunit.client.0.smithi138.stderr: -297> 2024-09-14T11:39:36.293+0000 7f1ffd3b8640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:39:36.923 INFO:tasks.workunit.client.0.smithi138.stderr: -296> 2024-09-14T11:39:36.293+0000 7f1ffd3b8640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:39:36.923 INFO:tasks.workunit.client.0.smithi138.stderr: -295> 2024-09-14T11:39:36.293+0000 7f1ffd3b8640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:39:36.923 INFO:tasks.workunit.client.0.smithi138.stderr: -294> 2024-09-14T11:39:36.293+0000 7f1ffdbb9640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:39:36.923 INFO:tasks.workunit.client.0.smithi138.stderr: -293> 2024-09-14T11:39:36.293+0000 7f1ffdbb9640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:39:36.923 INFO:tasks.workunit.client.0.smithi138.stderr: -292> 2024-09-14T11:39:36.293+0000 7f1ffdbb9640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:39:36.923 INFO:tasks.workunit.client.0.smithi138.stderr: -291> 2024-09-14T11:39:36.293+0000 7f1ffd3b8640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:39:36.924 INFO:tasks.workunit.client.0.smithi138.stderr: -290> 2024-09-14T11:39:36.293+0000 7f1ffd3b8640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:39:36.924 INFO:tasks.workunit.client.0.smithi138.stderr: -289> 2024-09-14T11:39:36.293+0000 7f1ffd3b8640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:39:36.924 INFO:tasks.workunit.client.0.smithi138.stderr: -288> 2024-09-14T11:39:36.293+0000 7f1ffdbb9640 10 monclient(hunting): handle_auth_done global_id 7496 payload 274 2024-09-14T11:39:36.924 INFO:tasks.workunit.client.0.smithi138.stderr: -287> 2024-09-14T11:39:36.293+0000 7f1ffdbb9640 10 monclient: _finish_hunting 0 2024-09-14T11:39:36.924 INFO:tasks.workunit.client.0.smithi138.stderr: -286> 2024-09-14T11:39:36.293+0000 7f1ffdbb9640 1 monclient: found mon.noname-c 2024-09-14T11:39:36.924 INFO:tasks.workunit.client.0.smithi138.stderr: -285> 2024-09-14T11:39:36.293+0000 7f1ffdbb9640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.138:3301/0 2024-09-14T11:39:36.924 INFO:tasks.workunit.client.0.smithi138.stderr: -284> 2024-09-14T11:39:36.293+0000 7f1ee0ff9640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:39:36.924 INFO:tasks.workunit.client.0.smithi138.stderr: -283> 2024-09-14T11:39:36.293+0000 7f1ee0ff9640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-14T11:39:36.924 INFO:tasks.workunit.client.0.smithi138.stderr: -282> 2024-09-14T11:39:36.293+0000 7f1ee0ff9640 10 monclient: dump: 2024-09-14T11:39:36.924 INFO:tasks.workunit.client.0.smithi138.stderr:epoch 1 2024-09-14T11:39:36.924 INFO:tasks.workunit.client.0.smithi138.stderr:fsid 3f225f43-83a6-4aeb-b798-1f04bb49d597 2024-09-14T11:39:36.924 INFO:tasks.workunit.client.0.smithi138.stderr:last_changed 2024-09-14T11:07:09.252780+0000 2024-09-14T11:39:36.924 INFO:tasks.workunit.client.0.smithi138.stderr:created 2024-09-14T11:07:09.252780+0000 2024-09-14T11:39:36.925 INFO:tasks.workunit.client.0.smithi138.stderr:min_mon_release 19 (squid) 2024-09-14T11:39:36.925 INFO:tasks.workunit.client.0.smithi138.stderr:election_strategy: 1 2024-09-14T11:39:36.925 INFO:tasks.workunit.client.0.smithi138.stderr:0: [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] mon.a 2024-09-14T11:39:36.925 INFO:tasks.workunit.client.0.smithi138.stderr:1: [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] mon.b 2024-09-14T11:39:36.925 INFO:tasks.workunit.client.0.smithi138.stderr:2: [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] mon.c 2024-09-14T11:39:36.925 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-14T11:39:36.925 INFO:tasks.workunit.client.0.smithi138.stderr: -281> 2024-09-14T11:39:36.293+0000 7f1ee0ff9640 10 monclient: _finish_auth 0 2024-09-14T11:39:36.925 INFO:tasks.workunit.client.0.smithi138.stderr: -280> 2024-09-14T11:39:36.293+0000 7f1ee0ff9640 10 monclient: _check_auth_tickets 2024-09-14T11:39:36.925 INFO:tasks.workunit.client.0.smithi138.stderr: -279> 2024-09-14T11:39:36.293+0000 7f1ee0ff9640 10 monclient: handle_config config(0 keys) 2024-09-14T11:39:36.925 INFO:tasks.workunit.client.0.smithi138.stderr: -278> 2024-09-14T11:39:36.293+0000 7f1fff8b29c0 5 monclient: authenticate success, global_id 7496 2024-09-14T11:39:36.925 INFO:tasks.workunit.client.0.smithi138.stderr: -277> 2024-09-14T11:39:36.293+0000 7f1fff8b29c0 10 monclient: get_monmap_and_config success 2024-09-14T11:39:36.925 INFO:tasks.workunit.client.0.smithi138.stderr: -276> 2024-09-14T11:39:36.293+0000 7f1fff8b29c0 4 set_mon_vals no callback set 2024-09-14T11:39:36.925 INFO:tasks.workunit.client.0.smithi138.stderr: -275> 2024-09-14T11:39:36.293+0000 7f1ee0ff9640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:39:36.925 INFO:tasks.workunit.client.0.smithi138.stderr: -274> 2024-09-14T11:39:36.293+0000 7f1ee0ff9640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-14T11:39:36.926 INFO:tasks.workunit.client.0.smithi138.stderr: -273> 2024-09-14T11:39:36.293+0000 7f1ee0ff9640 10 monclient: dump: 2024-09-14T11:39:36.926 INFO:tasks.workunit.client.0.smithi138.stderr:epoch 1 2024-09-14T11:39:36.926 INFO:tasks.workunit.client.0.smithi138.stderr:fsid 3f225f43-83a6-4aeb-b798-1f04bb49d597 2024-09-14T11:39:36.926 INFO:tasks.workunit.client.0.smithi138.stderr:last_changed 2024-09-14T11:07:09.252780+0000 2024-09-14T11:39:36.926 INFO:tasks.workunit.client.0.smithi138.stderr:created 2024-09-14T11:07:09.252780+0000 2024-09-14T11:39:36.926 INFO:tasks.workunit.client.0.smithi138.stderr:min_mon_release 19 (squid) 2024-09-14T11:39:36.926 INFO:tasks.workunit.client.0.smithi138.stderr:election_strategy: 1 2024-09-14T11:39:36.926 INFO:tasks.workunit.client.0.smithi138.stderr:0: [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] mon.a 2024-09-14T11:39:36.926 INFO:tasks.workunit.client.0.smithi138.stderr:1: [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] mon.b 2024-09-14T11:39:36.926 INFO:tasks.workunit.client.0.smithi138.stderr:2: [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] mon.c 2024-09-14T11:39:36.926 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-14T11:39:36.926 INFO:tasks.workunit.client.0.smithi138.stderr: -272> 2024-09-14T11:39:36.293+0000 7f1fff8b29c0 10 monclient: shutdown 2024-09-14T11:39:36.926 INFO:tasks.workunit.client.0.smithi138.stderr: -271> 2024-09-14T11:39:36.293+0000 7f1fff8b29c0 10 monclient: build_initial_monmap 2024-09-14T11:39:36.926 INFO:tasks.workunit.client.0.smithi138.stderr: -270> 2024-09-14T11:39:36.293+0000 7f1fff8b29c0 1 build_initial for_mkfs: 0 2024-09-14T11:39:36.927 INFO:tasks.workunit.client.0.smithi138.stderr: -269> 2024-09-14T11:39:36.293+0000 7f1fff8b29c0 10 monclient: monmap: 2024-09-14T11:39:36.927 INFO:tasks.workunit.client.0.smithi138.stderr:epoch 0 2024-09-14T11:39:36.927 INFO:tasks.workunit.client.0.smithi138.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-14T11:39:36.927 INFO:tasks.workunit.client.0.smithi138.stderr:last_changed 0.000000 2024-09-14T11:39:36.927 INFO:tasks.workunit.client.0.smithi138.stderr:created 0.000000 2024-09-14T11:39:36.927 INFO:tasks.workunit.client.0.smithi138.stderr:min_mon_release 0 (unknown) 2024-09-14T11:39:36.927 INFO:tasks.workunit.client.0.smithi138.stderr:election_strategy: 1 2024-09-14T11:39:36.927 INFO:tasks.workunit.client.0.smithi138.stderr:0: [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] mon.noname-a 2024-09-14T11:39:36.927 INFO:tasks.workunit.client.0.smithi138.stderr:1: [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] mon.noname-b 2024-09-14T11:39:36.927 INFO:tasks.workunit.client.0.smithi138.stderr:2: [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] mon.noname-c 2024-09-14T11:39:36.927 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-14T11:39:36.927 INFO:tasks.workunit.client.0.smithi138.stderr: -268> 2024-09-14T11:39:36.293+0000 7f1fff8b29c0 5 AuthRegistry(0x5612561ebd10) adding auth protocol: cephx 2024-09-14T11:39:36.927 INFO:tasks.workunit.client.0.smithi138.stderr: -267> 2024-09-14T11:39:36.293+0000 7f1fff8b29c0 5 AuthRegistry(0x5612561ebd10) adding auth protocol: cephx 2024-09-14T11:39:36.927 INFO:tasks.workunit.client.0.smithi138.stderr: -266> 2024-09-14T11:39:36.293+0000 7f1fff8b29c0 5 AuthRegistry(0x5612561ebd10) adding auth protocol: cephx 2024-09-14T11:39:36.927 INFO:tasks.workunit.client.0.smithi138.stderr: -265> 2024-09-14T11:39:36.293+0000 7f1fff8b29c0 5 AuthRegistry(0x5612561ebd10) adding con mode: secure 2024-09-14T11:39:36.927 INFO:tasks.workunit.client.0.smithi138.stderr: -264> 2024-09-14T11:39:36.293+0000 7f1fff8b29c0 5 AuthRegistry(0x5612561ebd10) adding con mode: crc 2024-09-14T11:39:36.928 INFO:tasks.workunit.client.0.smithi138.stderr: -263> 2024-09-14T11:39:36.293+0000 7f1fff8b29c0 5 AuthRegistry(0x5612561ebd10) adding con mode: secure 2024-09-14T11:39:36.928 INFO:tasks.workunit.client.0.smithi138.stderr: -262> 2024-09-14T11:39:36.293+0000 7f1fff8b29c0 5 AuthRegistry(0x5612561ebd10) adding con mode: crc 2024-09-14T11:39:36.928 INFO:tasks.workunit.client.0.smithi138.stderr: -261> 2024-09-14T11:39:36.293+0000 7f1fff8b29c0 5 AuthRegistry(0x5612561ebd10) adding con mode: secure 2024-09-14T11:39:36.928 INFO:tasks.workunit.client.0.smithi138.stderr: -260> 2024-09-14T11:39:36.293+0000 7f1fff8b29c0 5 AuthRegistry(0x5612561ebd10) adding con mode: crc 2024-09-14T11:39:36.928 INFO:tasks.workunit.client.0.smithi138.stderr: -259> 2024-09-14T11:39:36.293+0000 7f1fff8b29c0 5 AuthRegistry(0x5612561ebd10) adding con mode: crc 2024-09-14T11:39:36.928 INFO:tasks.workunit.client.0.smithi138.stderr: -258> 2024-09-14T11:39:36.293+0000 7f1fff8b29c0 5 AuthRegistry(0x5612561ebd10) adding con mode: secure 2024-09-14T11:39:36.928 INFO:tasks.workunit.client.0.smithi138.stderr: -257> 2024-09-14T11:39:36.293+0000 7f1fff8b29c0 5 AuthRegistry(0x5612561ebd10) adding con mode: crc 2024-09-14T11:39:36.928 INFO:tasks.workunit.client.0.smithi138.stderr: -256> 2024-09-14T11:39:36.293+0000 7f1fff8b29c0 5 AuthRegistry(0x5612561ebd10) adding con mode: secure 2024-09-14T11:39:36.928 INFO:tasks.workunit.client.0.smithi138.stderr: -255> 2024-09-14T11:39:36.293+0000 7f1fff8b29c0 5 AuthRegistry(0x5612561ebd10) adding con mode: crc 2024-09-14T11:39:36.928 INFO:tasks.workunit.client.0.smithi138.stderr: -254> 2024-09-14T11:39:36.293+0000 7f1fff8b29c0 5 AuthRegistry(0x5612561ebd10) adding con mode: secure 2024-09-14T11:39:36.928 INFO:tasks.workunit.client.0.smithi138.stderr: -253> 2024-09-14T11:39:36.293+0000 7f1fff8b29c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:39:36.928 INFO:tasks.workunit.client.0.smithi138.stderr: -252> 2024-09-14T11:39:36.293+0000 7f1fff8b29c0 1 librados: starting msgr at 2024-09-14T11:39:36.928 INFO:tasks.workunit.client.0.smithi138.stderr: -251> 2024-09-14T11:39:36.293+0000 7f1fff8b29c0 1 librados: starting objecter 2024-09-14T11:39:36.928 INFO:tasks.workunit.client.0.smithi138.stderr: -250> 2024-09-14T11:39:36.293+0000 7f1fff8b29c0 5 asok(0x561255f1dd90) register_command objecter_requests cmddesc objecter_requests hook 0x5612561c9b70 EEXIST 2024-09-14T11:39:36.928 INFO:tasks.workunit.client.0.smithi138.stderr: -249> 2024-09-14T11:39:36.293+0000 7f1fff8b29c0 1 librados: setting wanted keys 2024-09-14T11:39:36.929 INFO:tasks.workunit.client.0.smithi138.stderr: -248> 2024-09-14T11:39:36.293+0000 7f1fff8b29c0 1 librados: calling monclient init 2024-09-14T11:39:36.929 INFO:tasks.workunit.client.0.smithi138.stderr: -247> 2024-09-14T11:39:36.293+0000 7f1fff8b29c0 10 monclient: init 2024-09-14T11:39:36.929 INFO:tasks.workunit.client.0.smithi138.stderr: -246> 2024-09-14T11:39:36.293+0000 7f1fff8b29c0 5 AuthRegistry(0x5612561a97e0) adding auth protocol: cephx 2024-09-14T11:39:36.929 INFO:tasks.workunit.client.0.smithi138.stderr: -245> 2024-09-14T11:39:36.293+0000 7f1fff8b29c0 5 AuthRegistry(0x5612561a97e0) adding auth protocol: cephx 2024-09-14T11:39:36.929 INFO:tasks.workunit.client.0.smithi138.stderr: -244> 2024-09-14T11:39:36.293+0000 7f1fff8b29c0 5 AuthRegistry(0x5612561a97e0) adding auth protocol: cephx 2024-09-14T11:39:36.929 INFO:tasks.workunit.client.0.smithi138.stderr: -243> 2024-09-14T11:39:36.293+0000 7f1fff8b29c0 5 AuthRegistry(0x5612561a97e0) adding con mode: secure 2024-09-14T11:39:36.929 INFO:tasks.workunit.client.0.smithi138.stderr: -242> 2024-09-14T11:39:36.293+0000 7f1fff8b29c0 5 AuthRegistry(0x5612561a97e0) adding con mode: crc 2024-09-14T11:39:36.929 INFO:tasks.workunit.client.0.smithi138.stderr: -241> 2024-09-14T11:39:36.293+0000 7f1fff8b29c0 5 AuthRegistry(0x5612561a97e0) adding con mode: secure 2024-09-14T11:39:36.929 INFO:tasks.workunit.client.0.smithi138.stderr: -240> 2024-09-14T11:39:36.293+0000 7f1fff8b29c0 5 AuthRegistry(0x5612561a97e0) adding con mode: crc 2024-09-14T11:39:36.929 INFO:tasks.workunit.client.0.smithi138.stderr: -239> 2024-09-14T11:39:36.293+0000 7f1fff8b29c0 5 AuthRegistry(0x5612561a97e0) adding con mode: secure 2024-09-14T11:39:36.929 INFO:tasks.workunit.client.0.smithi138.stderr: -238> 2024-09-14T11:39:36.293+0000 7f1fff8b29c0 5 AuthRegistry(0x5612561a97e0) adding con mode: crc 2024-09-14T11:39:36.929 INFO:tasks.workunit.client.0.smithi138.stderr: -237> 2024-09-14T11:39:36.293+0000 7f1fff8b29c0 5 AuthRegistry(0x5612561a97e0) adding con mode: crc 2024-09-14T11:39:36.929 INFO:tasks.workunit.client.0.smithi138.stderr: -236> 2024-09-14T11:39:36.293+0000 7f1fff8b29c0 5 AuthRegistry(0x5612561a97e0) adding con mode: secure 2024-09-14T11:39:36.930 INFO:tasks.workunit.client.0.smithi138.stderr: -235> 2024-09-14T11:39:36.293+0000 7f1fff8b29c0 5 AuthRegistry(0x5612561a97e0) adding con mode: crc 2024-09-14T11:39:36.930 INFO:tasks.workunit.client.0.smithi138.stderr: -234> 2024-09-14T11:39:36.293+0000 7f1fff8b29c0 5 AuthRegistry(0x5612561a97e0) adding con mode: secure 2024-09-14T11:39:36.930 INFO:tasks.workunit.client.0.smithi138.stderr: -233> 2024-09-14T11:39:36.293+0000 7f1fff8b29c0 5 AuthRegistry(0x5612561a97e0) adding con mode: crc 2024-09-14T11:39:36.930 INFO:tasks.workunit.client.0.smithi138.stderr: -232> 2024-09-14T11:39:36.293+0000 7f1fff8b29c0 5 AuthRegistry(0x5612561a97e0) adding con mode: secure 2024-09-14T11:39:36.930 INFO:tasks.workunit.client.0.smithi138.stderr: -231> 2024-09-14T11:39:36.293+0000 7f1fff8b29c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:39:36.930 INFO:tasks.workunit.client.0.smithi138.stderr: -230> 2024-09-14T11:39:36.293+0000 7f1fff8b29c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:39:36.930 INFO:tasks.workunit.client.0.smithi138.stderr: -229> 2024-09-14T11:39:36.293+0000 7f1fff8b29c0 5 asok(0x561255f1dd90) register_command rotate-key cmddesc rotate-key hook 0x5612561a9928 EEXIST 2024-09-14T11:39:36.930 INFO:tasks.workunit.client.0.smithi138.stderr: -228> 2024-09-14T11:39:36.293+0000 7f1fff8b29c0 10 monclient: _reopen_session rank -1 2024-09-14T11:39:36.930 INFO:tasks.workunit.client.0.smithi138.stderr: -227> 2024-09-14T11:39:36.293+0000 7f1fff8b29c0 10 monclient: _add_conns ranks=[1,0,2] 2024-09-14T11:39:36.930 INFO:tasks.workunit.client.0.smithi138.stderr: -226> 2024-09-14T11:39:36.293+0000 7f1fff8b29c0 10 monclient(hunting): picked mon.noname-b con 0x5612561f7090 addr [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] 2024-09-14T11:39:36.930 INFO:tasks.workunit.client.0.smithi138.stderr: -225> 2024-09-14T11:39:36.293+0000 7f1fff8b29c0 10 monclient(hunting): picked mon.noname-a con 0x5612561fb4d0 addr [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] 2024-09-14T11:39:36.930 INFO:tasks.workunit.client.0.smithi138.stderr: -224> 2024-09-14T11:39:36.293+0000 7f1fff8b29c0 10 monclient(hunting): picked mon.noname-c con 0x5612561f3b90 addr [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] 2024-09-14T11:39:36.930 INFO:tasks.workunit.client.0.smithi138.stderr: -223> 2024-09-14T11:39:36.293+0000 7f1fff8b29c0 10 monclient(hunting): start opening mon connection 2024-09-14T11:39:36.930 INFO:tasks.workunit.client.0.smithi138.stderr: -222> 2024-09-14T11:39:36.293+0000 7f1fff8b29c0 10 monclient(hunting): start opening mon connection 2024-09-14T11:39:36.931 INFO:tasks.workunit.client.0.smithi138.stderr: -221> 2024-09-14T11:39:36.293+0000 7f1fff8b29c0 10 monclient(hunting): start opening mon connection 2024-09-14T11:39:36.931 INFO:tasks.workunit.client.0.smithi138.stderr: -220> 2024-09-14T11:39:36.293+0000 7f1fff8b29c0 10 monclient(hunting): _renew_subs 2024-09-14T11:39:36.931 INFO:tasks.workunit.client.0.smithi138.stderr: -219> 2024-09-14T11:39:36.293+0000 7f1fff8b29c0 10 monclient(hunting): authenticate will time out at 2912.259600s 2024-09-14T11:39:36.931 INFO:tasks.workunit.client.0.smithi138.stderr: -218> 2024-09-14T11:39:36.293+0000 7f1ffd3b8640 10 monclient(hunting): get_auth_request con 0x5612561f3b90 auth_method 0 2024-09-14T11:39:36.931 INFO:tasks.workunit.client.0.smithi138.stderr: -217> 2024-09-14T11:39:36.293+0000 7f1ffd3b8640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:39:36.931 INFO:tasks.workunit.client.0.smithi138.stderr: -216> 2024-09-14T11:39:36.293+0000 7f1ffd3b8640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:39:36.931 INFO:tasks.workunit.client.0.smithi138.stderr: -215> 2024-09-14T11:39:36.293+0000 7f1ffd3b8640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:39:36.931 INFO:tasks.workunit.client.0.smithi138.stderr: -214> 2024-09-14T11:39:36.293+0000 7f1ffdbb9640 10 monclient(hunting): get_auth_request con 0x5612561fb4d0 auth_method 0 2024-09-14T11:39:36.931 INFO:tasks.workunit.client.0.smithi138.stderr: -213> 2024-09-14T11:39:36.293+0000 7f1ffdbb9640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:39:36.931 INFO:tasks.workunit.client.0.smithi138.stderr: -212> 2024-09-14T11:39:36.293+0000 7f1ffdbb9640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:39:36.931 INFO:tasks.workunit.client.0.smithi138.stderr: -211> 2024-09-14T11:39:36.293+0000 7f1ffdbb9640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:39:36.931 INFO:tasks.workunit.client.0.smithi138.stderr: -210> 2024-09-14T11:39:36.293+0000 7f1ffd3b8640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:39:36.931 INFO:tasks.workunit.client.0.smithi138.stderr: -209> 2024-09-14T11:39:36.293+0000 7f1ffd3b8640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:39:36.931 INFO:tasks.workunit.client.0.smithi138.stderr: -208> 2024-09-14T11:39:36.293+0000 7f1ffd3b8640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:39:36.931 INFO:tasks.workunit.client.0.smithi138.stderr: -207> 2024-09-14T11:39:36.293+0000 7f1ffdbb9640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:39:36.931 INFO:tasks.workunit.client.0.smithi138.stderr: -206> 2024-09-14T11:39:36.293+0000 7f1ffdbb9640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:39:36.932 INFO:tasks.workunit.client.0.smithi138.stderr: -205> 2024-09-14T11:39:36.293+0000 7f1ffdbb9640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:39:36.932 INFO:tasks.workunit.client.0.smithi138.stderr: -204> 2024-09-14T11:39:36.293+0000 7f1ffdbb9640 10 monclient(hunting): handle_auth_done global_id 8019 payload 824 2024-09-14T11:39:36.932 INFO:tasks.workunit.client.0.smithi138.stderr: -203> 2024-09-14T11:39:36.297+0000 7f1ffdbb9640 10 monclient: _finish_hunting 0 2024-09-14T11:39:36.932 INFO:tasks.workunit.client.0.smithi138.stderr: -202> 2024-09-14T11:39:36.297+0000 7f1ffdbb9640 1 monclient: found mon.noname-a 2024-09-14T11:39:36.932 INFO:tasks.workunit.client.0.smithi138.stderr: -201> 2024-09-14T11:39:36.297+0000 7f1ffdbb9640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.138:3300/0 2024-09-14T11:39:36.932 INFO:tasks.workunit.client.0.smithi138.stderr: -200> 2024-09-14T11:39:36.297+0000 7f1ffcbb7640 10 monclient: get_auth_request con 0x5612561f7090 auth_method 0 2024-09-14T11:39:36.932 INFO:tasks.workunit.client.0.smithi138.stderr: -199> 2024-09-14T11:39:36.297+0000 7f1ed2ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:39:36.932 INFO:tasks.workunit.client.0.smithi138.stderr: -198> 2024-09-14T11:39:36.297+0000 7f1ed2ffd640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-14T11:39:36.932 INFO:tasks.workunit.client.0.smithi138.stderr: -197> 2024-09-14T11:39:36.297+0000 7f1ed2ffd640 10 monclient: dump: 2024-09-14T11:39:36.932 INFO:tasks.workunit.client.0.smithi138.stderr:epoch 1 2024-09-14T11:39:36.932 INFO:tasks.workunit.client.0.smithi138.stderr:fsid 3f225f43-83a6-4aeb-b798-1f04bb49d597 2024-09-14T11:39:36.932 INFO:tasks.workunit.client.0.smithi138.stderr:last_changed 2024-09-14T11:07:09.252780+0000 2024-09-14T11:39:36.932 INFO:tasks.workunit.client.0.smithi138.stderr:created 2024-09-14T11:07:09.252780+0000 2024-09-14T11:39:36.932 INFO:tasks.workunit.client.0.smithi138.stderr:min_mon_release 19 (squid) 2024-09-14T11:39:36.932 INFO:tasks.workunit.client.0.smithi138.stderr:election_strategy: 1 2024-09-14T11:39:36.933 INFO:tasks.workunit.client.0.smithi138.stderr:0: [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] mon.a 2024-09-14T11:39:36.933 INFO:tasks.workunit.client.0.smithi138.stderr:1: [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] mon.b 2024-09-14T11:39:36.933 INFO:tasks.workunit.client.0.smithi138.stderr:2: [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] mon.c 2024-09-14T11:39:36.933 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-14T11:39:36.933 INFO:tasks.workunit.client.0.smithi138.stderr: -196> 2024-09-14T11:39:36.297+0000 7f1ed2ffd640 10 monclient: _finish_auth 0 2024-09-14T11:39:36.933 INFO:tasks.workunit.client.0.smithi138.stderr: -195> 2024-09-14T11:39:36.297+0000 7f1ed2ffd640 10 monclient: _check_auth_tickets 2024-09-14T11:39:36.933 INFO:tasks.workunit.client.0.smithi138.stderr: -194> 2024-09-14T11:39:36.297+0000 7f1ed2ffd640 10 monclient: handle_config config(0 keys) 2024-09-14T11:39:36.933 INFO:tasks.workunit.client.0.smithi138.stderr: -193> 2024-09-14T11:39:36.297+0000 7f1ed2ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:39:36.933 INFO:tasks.workunit.client.0.smithi138.stderr: -192> 2024-09-14T11:39:36.297+0000 7f1ed2ffd640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-14T11:39:36.933 INFO:tasks.workunit.client.0.smithi138.stderr: -191> 2024-09-14T11:39:36.297+0000 7f1ed2ffd640 10 monclient: dump: 2024-09-14T11:39:36.933 INFO:tasks.workunit.client.0.smithi138.stderr:epoch 1 2024-09-14T11:39:36.933 INFO:tasks.workunit.client.0.smithi138.stderr:fsid 3f225f43-83a6-4aeb-b798-1f04bb49d597 2024-09-14T11:39:36.933 INFO:tasks.workunit.client.0.smithi138.stderr:last_changed 2024-09-14T11:07:09.252780+0000 2024-09-14T11:39:36.933 INFO:tasks.workunit.client.0.smithi138.stderr:created 2024-09-14T11:07:09.252780+0000 2024-09-14T11:39:36.933 INFO:tasks.workunit.client.0.smithi138.stderr:min_mon_release 19 (squid) 2024-09-14T11:39:36.934 INFO:tasks.workunit.client.0.smithi138.stderr:election_strategy: 1 2024-09-14T11:39:36.934 INFO:tasks.workunit.client.0.smithi138.stderr:0: [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] mon.a 2024-09-14T11:39:36.934 INFO:tasks.workunit.client.0.smithi138.stderr:1: [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] mon.b 2024-09-14T11:39:36.934 INFO:tasks.workunit.client.0.smithi138.stderr:2: [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] mon.c 2024-09-14T11:39:36.934 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-14T11:39:36.934 INFO:tasks.workunit.client.0.smithi138.stderr: -190> 2024-09-14T11:39:36.297+0000 7f1ee0ff9640 4 set_mon_vals no callback set 2024-09-14T11:39:36.934 INFO:tasks.workunit.client.0.smithi138.stderr: -189> 2024-09-14T11:39:36.297+0000 7f1fff8b29c0 5 monclient: authenticate success, global_id 8019 2024-09-14T11:39:36.934 INFO:tasks.workunit.client.0.smithi138.stderr: -188> 2024-09-14T11:39:36.297+0000 7f1fff8b29c0 10 monclient: _renew_subs 2024-09-14T11:39:36.934 INFO:tasks.workunit.client.0.smithi138.stderr: -187> 2024-09-14T11:39:36.297+0000 7f1fff8b29c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.138:3300/0 2024-09-14T11:39:36.934 INFO:tasks.workunit.client.0.smithi138.stderr: -186> 2024-09-14T11:39:36.297+0000 7f1fff8b29c0 10 monclient: _renew_subs 2024-09-14T11:39:36.934 INFO:tasks.workunit.client.0.smithi138.stderr: -185> 2024-09-14T11:39:36.297+0000 7f1fff8b29c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.138:3300/0 2024-09-14T11:39:36.934 INFO:tasks.workunit.client.0.smithi138.stderr: -184> 2024-09-14T11:39:36.297+0000 7f1fff8b29c0 1 librados: init done 2024-09-14T11:39:36.934 INFO:tasks.workunit.client.0.smithi138.stderr: -183> 2024-09-14T11:39:36.297+0000 7f1fff8b29c0 5 asok(0x561255f1dd90) register_command cr dump hook 0x7f1ff80f7b98 2024-09-14T11:39:36.934 INFO:tasks.workunit.client.0.smithi138.stderr: -182> 2024-09-14T11:39:36.297+0000 7f1fff8b29c0 20 rados->read ofs=0 len=0 2024-09-14T11:39:36.934 INFO:tasks.workunit.client.0.smithi138.stderr: -181> 2024-09-14T11:39:36.297+0000 7f1ed2ffd640 4 mgrc handle_mgr_map Got map version 5 2024-09-14T11:39:36.934 INFO:tasks.workunit.client.0.smithi138.stderr: -180> 2024-09-14T11:39:36.297+0000 7f1ed2ffd640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.138:6832/3778043143,v1:172.21.15.138:6833/3778043143] 2024-09-14T11:39:36.935 INFO:tasks.workunit.client.0.smithi138.stderr: -179> 2024-09-14T11:39:36.297+0000 7f1ed2ffd640 4 mgrc reconnect Starting new session with [v2:172.21.15.138:6832/3778043143,v1:172.21.15.138:6833/3778043143] 2024-09-14T11:39:36.935 INFO:tasks.workunit.client.0.smithi138.stderr: -178> 2024-09-14T11:39:36.297+0000 7f1ffcbb7640 10 monclient: get_auth_request con 0x7f1ec80718a0 auth_method 0 2024-09-14T11:39:36.935 INFO:tasks.workunit.client.0.smithi138.stderr: -177> 2024-09-14T11:39:36.297+0000 7f1ffd3b8640 10 monclient: get_auth_request con 0x561256214a20 auth_method 0 2024-09-14T11:39:36.935 INFO:tasks.workunit.client.0.smithi138.stderr: -176> 2024-09-14T11:39:36.301+0000 7f1fff8b29c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:39:36.935 INFO:tasks.workunit.client.0.smithi138.stderr: -175> 2024-09-14T11:39:36.301+0000 7f1fff8b29c0 20 realm 2024-09-14T11:39:36.935 INFO:tasks.workunit.client.0.smithi138.stderr: -174> 2024-09-14T11:39:36.301+0000 7f1fff8b29c0 20 rados->read ofs=0 len=0 2024-09-14T11:39:36.935 INFO:tasks.workunit.client.0.smithi138.stderr: -173> 2024-09-14T11:39:36.301+0000 7f1fff8b29c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:39:36.935 INFO:tasks.workunit.client.0.smithi138.stderr: -172> 2024-09-14T11:39:36.301+0000 7f1fff8b29c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:39:36.935 INFO:tasks.workunit.client.0.smithi138.stderr: -171> 2024-09-14T11:39:36.301+0000 7f1fff8b29c0 20 rados->read ofs=0 len=0 2024-09-14T11:39:36.935 INFO:tasks.workunit.client.0.smithi138.stderr: -170> 2024-09-14T11:39:36.301+0000 7f1fff8b29c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:39:36.935 INFO:tasks.workunit.client.0.smithi138.stderr: -169> 2024-09-14T11:39:36.301+0000 7f1fff8b29c0 20 rados->read ofs=0 len=0 2024-09-14T11:39:36.935 INFO:tasks.workunit.client.0.smithi138.stderr: -168> 2024-09-14T11:39:36.301+0000 7f1ffcbb7640 10 monclient: get_auth_request con 0x561256218ba0 auth_method 0 2024-09-14T11:39:36.935 INFO:tasks.workunit.client.0.smithi138.stderr: -167> 2024-09-14T11:39:36.301+0000 7f1fff8b29c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:39:36.935 INFO:tasks.workunit.client.0.smithi138.stderr: -166> 2024-09-14T11:39:36.301+0000 7f1fff8b29c0 20 rados->read ofs=0 len=0 2024-09-14T11:39:36.936 INFO:tasks.workunit.client.0.smithi138.stderr: -165> 2024-09-14T11:39:36.301+0000 7f1ffdbb9640 10 monclient: get_auth_request con 0x56125621c450 auth_method 0 2024-09-14T11:39:36.936 INFO:tasks.workunit.client.0.smithi138.stderr: -164> 2024-09-14T11:39:36.301+0000 7f1fff8b29c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:39:36.936 INFO:tasks.workunit.client.0.smithi138.stderr: -163> 2024-09-14T11:39:36.301+0000 7f1fff8b29c0 20 searching for the correct realm 2024-09-14T11:39:36.936 INFO:tasks.workunit.client.0.smithi138.stderr: -162> 2024-09-14T11:39:36.301+0000 7f1ffd3b8640 10 monclient: get_auth_request con 0x5612562211d0 auth_method 0 2024-09-14T11:39:36.936 INFO:tasks.workunit.client.0.smithi138.stderr: -161> 2024-09-14T11:39:36.305+0000 7f1ffcbb7640 10 monclient: get_auth_request con 0x7f1ff001b950 auth_method 0 2024-09-14T11:39:36.936 INFO:tasks.workunit.client.0.smithi138.stderr: -160> 2024-09-14T11:39:36.305+0000 7f1ffdbb9640 10 monclient: get_auth_request con 0x7f1ff80b8070 auth_method 0 2024-09-14T11:39:36.936 INFO:tasks.workunit.client.0.smithi138.stderr: -159> 2024-09-14T11:39:36.305+0000 7f1ffdbb9640 0 -- 172.21.15.138:0/2558815668 >> [v2:172.21.15.154:6824/416768175,v1:172.21.15.154:6825/416768175] conn(0x7f1ff80b8070 msgr2=0x7f1ff80f71e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:39:36.936 INFO:tasks.workunit.client.0.smithi138.stderr: -158> 2024-09-14T11:39:36.509+0000 7f1ffdbb9640 10 monclient: get_auth_request con 0x7f1ff80b8070 auth_method 0 2024-09-14T11:39:36.936 INFO:tasks.workunit.client.0.smithi138.stderr: -157> 2024-09-14T11:39:36.513+0000 7f1ffd3b8640 10 monclient: get_auth_request con 0x7f1ff8129080 auth_method 0 2024-09-14T11:39:36.936 INFO:tasks.workunit.client.0.smithi138.stderr: -156> 2024-09-14T11:39:36.521+0000 7f1ffcbb7640 10 monclient: get_auth_request con 0x7f1ff81013e0 auth_method 0 2024-09-14T11:39:36.936 INFO:tasks.workunit.client.0.smithi138.stderr: -155> 2024-09-14T11:39:36.521+0000 7f1ffcbb7640 0 -- 172.21.15.138:0/2558815668 >> [v2:172.21.15.138:6816/326481658,v1:172.21.15.138:6817/326481658] conn(0x7f1ff81013e0 msgr2=0x7f1ff811e000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-14T11:39:36.936 INFO:tasks.workunit.client.0.smithi138.stderr: -154> 2024-09-14T11:39:36.725+0000 7f1ffcbb7640 10 monclient: get_auth_request con 0x7f1ff81013e0 auth_method 0 2024-09-14T11:39:36.936 INFO:tasks.workunit.client.0.smithi138.stderr: -153> 2024-09-14T11:39:36.737+0000 7f1fff8b29c0 20 RGWRados::pool_iterate: got zone_info.d9e72d30-c60b-4d0d-9267-fdc36392d5ad 2024-09-14T11:39:36.936 INFO:tasks.workunit.client.0.smithi138.stderr: -152> 2024-09-14T11:39:36.737+0000 7f1fff8b29c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:39:36.936 INFO:tasks.workunit.client.0.smithi138.stderr: -151> 2024-09-14T11:39:36.737+0000 7f1fff8b29c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:39:36.937 INFO:tasks.workunit.client.0.smithi138.stderr: -150> 2024-09-14T11:39:36.737+0000 7f1fff8b29c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:39:36.937 INFO:tasks.workunit.client.0.smithi138.stderr: -149> 2024-09-14T11:39:36.737+0000 7f1fff8b29c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:39:36.937 INFO:tasks.workunit.client.0.smithi138.stderr: -148> 2024-09-14T11:39:36.737+0000 7f1fff8b29c0 20 RGWRados::pool_iterate: got zonegroup_info.65ab941b-da8c-4160-94fb-3672b069d44f 2024-09-14T11:39:36.937 INFO:tasks.workunit.client.0.smithi138.stderr: -147> 2024-09-14T11:39:36.737+0000 7f1fff8b29c0 20 rados->read ofs=0 len=0 2024-09-14T11:39:36.937 INFO:tasks.workunit.client.0.smithi138.stderr: -146> 2024-09-14T11:39:36.737+0000 7f1fff8b29c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:39:36.937 INFO:tasks.workunit.client.0.smithi138.stderr: -145> 2024-09-14T11:39:36.737+0000 7f1fff8b29c0 20 rados->read ofs=0 len=0 2024-09-14T11:39:36.937 INFO:tasks.workunit.client.0.smithi138.stderr: -144> 2024-09-14T11:39:36.737+0000 7f1fff8b29c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:39:36.937 INFO:tasks.workunit.client.0.smithi138.stderr: -143> 2024-09-14T11:39:36.737+0000 7f1fff8b29c0 20 rados->read ofs=0 len=0 2024-09-14T11:39:36.937 INFO:tasks.workunit.client.0.smithi138.stderr: -142> 2024-09-14T11:39:36.741+0000 7f1fff8b29c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:39:36.937 INFO:tasks.workunit.client.0.smithi138.stderr: -141> 2024-09-14T11:39:36.741+0000 7f1fff8b29c0 20 zone default found 2024-09-14T11:39:36.937 INFO:tasks.workunit.client.0.smithi138.stderr: -140> 2024-09-14T11:39:36.741+0000 7f1fff8b29c0 4 Realm: () 2024-09-14T11:39:36.937 INFO:tasks.workunit.client.0.smithi138.stderr: -139> 2024-09-14T11:39:36.741+0000 7f1fff8b29c0 4 ZoneGroup: default (65ab941b-da8c-4160-94fb-3672b069d44f) 2024-09-14T11:39:36.937 INFO:tasks.workunit.client.0.smithi138.stderr: -138> 2024-09-14T11:39:36.741+0000 7f1fff8b29c0 4 Zone: default (d9e72d30-c60b-4d0d-9267-fdc36392d5ad) 2024-09-14T11:39:36.937 INFO:tasks.workunit.client.0.smithi138.stderr: -137> 2024-09-14T11:39:36.741+0000 7f1fff8b29c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:39:36.938 INFO:tasks.workunit.client.0.smithi138.stderr: -136> 2024-09-14T11:39:36.741+0000 7f1fff8b29c0 20 zonegroup default 2024-09-14T11:39:36.938 INFO:tasks.workunit.client.0.smithi138.stderr: -135> 2024-09-14T11:39:36.741+0000 7f1fff8b29c0 20 rados->read ofs=0 len=0 2024-09-14T11:39:36.938 INFO:tasks.workunit.client.0.smithi138.stderr: -134> 2024-09-14T11:39:36.741+0000 7f1fff8b29c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:39:36.938 INFO:tasks.workunit.client.0.smithi138.stderr: -133> 2024-09-14T11:39:36.741+0000 7f1fff8b29c0 20 rados->read ofs=0 len=0 2024-09-14T11:39:36.938 INFO:tasks.workunit.client.0.smithi138.stderr: -132> 2024-09-14T11:39:36.741+0000 7f1fff8b29c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:39:36.938 INFO:tasks.workunit.client.0.smithi138.stderr: -131> 2024-09-14T11:39:36.741+0000 7f1fff8b29c0 20 rados->read ofs=0 len=0 2024-09-14T11:39:36.938 INFO:tasks.workunit.client.0.smithi138.stderr: -130> 2024-09-14T11:39:36.741+0000 7f1fff8b29c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:39:36.938 INFO:tasks.workunit.client.0.smithi138.stderr: -129> 2024-09-14T11:39:36.741+0000 7f1fff8b29c0 20 started sync module instance, tier type = 2024-09-14T11:39:36.938 INFO:tasks.workunit.client.0.smithi138.stderr: -128> 2024-09-14T11:39:36.741+0000 7f1fff8b29c0 20 started zone id=d9e72d30-c60b-4d0d-9267-fdc36392d5ad (name=default) with tier type = 2024-09-14T11:39:36.938 INFO:tasks.workunit.client.0.smithi138.stderr: -127> 2024-09-14T11:39:36.761+0000 7f1ed2ffd640 1 client.8019.objecter ms_handle_reset 0x5612562211d0 session 0x561256220b50 osd.3 2024-09-14T11:39:36.938 INFO:tasks.workunit.client.0.smithi138.stderr: -126> 2024-09-14T11:39:36.761+0000 7f1ed2ffd640 10 monclient: _renew_subs 2024-09-14T11:39:36.938 INFO:tasks.workunit.client.0.smithi138.stderr: -125> 2024-09-14T11:39:36.761+0000 7f1ed2ffd640 10 monclient: _send_mon_message to mon.a at v2:172.21.15.138:3300/0 2024-09-14T11:39:36.938 INFO:tasks.workunit.client.0.smithi138.stderr: -124> 2024-09-14T11:39:36.761+0000 7f1ffd3b8640 10 monclient: get_auth_request con 0x7f1ec8082050 auth_method 0 2024-09-14T11:39:36.938 INFO:tasks.workunit.client.0.smithi138.stderr: -123> 2024-09-14T11:39:36.769+0000 7f1fff8b29c0 20 add_watcher() i=0 2024-09-14T11:39:36.938 INFO:tasks.workunit.client.0.smithi138.stderr: -122> 2024-09-14T11:39:36.769+0000 7f1fff8b29c0 20 add_watcher() i=1 2024-09-14T11:39:36.939 INFO:tasks.workunit.client.0.smithi138.stderr: -121> 2024-09-14T11:39:36.769+0000 7f1fff8b29c0 20 add_watcher() i=2 2024-09-14T11:39:36.939 INFO:tasks.workunit.client.0.smithi138.stderr: -120> 2024-09-14T11:39:36.769+0000 7f1fff8b29c0 20 add_watcher() i=3 2024-09-14T11:39:36.939 INFO:tasks.workunit.client.0.smithi138.stderr: -119> 2024-09-14T11:39:36.769+0000 7f1fff8b29c0 20 add_watcher() i=4 2024-09-14T11:39:36.939 INFO:tasks.workunit.client.0.smithi138.stderr: -118> 2024-09-14T11:39:36.769+0000 7f1fff8b29c0 20 add_watcher() i=5 2024-09-14T11:39:36.939 INFO:tasks.workunit.client.0.smithi138.stderr: -117> 2024-09-14T11:39:36.769+0000 7f1fff8b29c0 20 add_watcher() i=6 2024-09-14T11:39:36.939 INFO:tasks.workunit.client.0.smithi138.stderr: -116> 2024-09-14T11:39:36.773+0000 7f1fff8b29c0 20 add_watcher() i=7 2024-09-14T11:39:36.939 INFO:tasks.workunit.client.0.smithi138.stderr: -115> 2024-09-14T11:39:36.773+0000 7f1fff8b29c0 2 all 8 watchers are set, enabling cache 2024-09-14T11:39:36.939 INFO:tasks.workunit.client.0.smithi138.stderr: -114> 2024-09-14T11:39:36.777+0000 7f1fff8b29c0 5 AuthRegistry(0x7fffbf76b990) adding auth protocol: cephx 2024-09-14T11:39:36.939 INFO:tasks.workunit.client.0.smithi138.stderr: -113> 2024-09-14T11:39:36.777+0000 7f1fff8b29c0 5 AuthRegistry(0x7fffbf76b990) adding auth protocol: cephx 2024-09-14T11:39:36.939 INFO:tasks.workunit.client.0.smithi138.stderr: -112> 2024-09-14T11:39:36.777+0000 7f1fff8b29c0 5 AuthRegistry(0x7fffbf76b990) adding auth protocol: cephx 2024-09-14T11:39:36.939 INFO:tasks.workunit.client.0.smithi138.stderr: -111> 2024-09-14T11:39:36.777+0000 7f1fff8b29c0 5 AuthRegistry(0x7fffbf76b990) adding con mode: secure 2024-09-14T11:39:36.939 INFO:tasks.workunit.client.0.smithi138.stderr: -110> 2024-09-14T11:39:36.777+0000 7f1fff8b29c0 5 AuthRegistry(0x7fffbf76b990) adding con mode: crc 2024-09-14T11:39:36.939 INFO:tasks.workunit.client.0.smithi138.stderr: -109> 2024-09-14T11:39:36.777+0000 7f1fff8b29c0 5 AuthRegistry(0x7fffbf76b990) adding con mode: secure 2024-09-14T11:39:36.939 INFO:tasks.workunit.client.0.smithi138.stderr: -108> 2024-09-14T11:39:36.777+0000 7f1fff8b29c0 5 AuthRegistry(0x7fffbf76b990) adding con mode: crc 2024-09-14T11:39:36.939 INFO:tasks.workunit.client.0.smithi138.stderr: -107> 2024-09-14T11:39:36.777+0000 7f1eb37e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:39:36.939 INFO:tasks.workunit.client.0.smithi138.stderr: -106> 2024-09-14T11:39:36.777+0000 7f1fff8b29c0 5 AuthRegistry(0x7fffbf76b990) adding con mode: secure 2024-09-14T11:39:36.940 INFO:tasks.workunit.client.0.smithi138.stderr: -105> 2024-09-14T11:39:36.777+0000 7f1fff8b29c0 5 AuthRegistry(0x7fffbf76b990) adding con mode: crc 2024-09-14T11:39:36.940 INFO:tasks.workunit.client.0.smithi138.stderr: -104> 2024-09-14T11:39:36.777+0000 7f1fff8b29c0 5 AuthRegistry(0x7fffbf76b990) adding con mode: crc 2024-09-14T11:39:36.940 INFO:tasks.workunit.client.0.smithi138.stderr: -103> 2024-09-14T11:39:36.777+0000 7f1fff8b29c0 5 AuthRegistry(0x7fffbf76b990) adding con mode: secure 2024-09-14T11:39:36.940 INFO:tasks.workunit.client.0.smithi138.stderr: -102> 2024-09-14T11:39:36.777+0000 7f1fff8b29c0 5 AuthRegistry(0x7fffbf76b990) adding con mode: crc 2024-09-14T11:39:36.940 INFO:tasks.workunit.client.0.smithi138.stderr: -101> 2024-09-14T11:39:36.777+0000 7f1fff8b29c0 5 AuthRegistry(0x7fffbf76b990) adding con mode: secure 2024-09-14T11:39:36.940 INFO:tasks.workunit.client.0.smithi138.stderr: -100> 2024-09-14T11:39:36.777+0000 7f1fff8b29c0 5 AuthRegistry(0x7fffbf76b990) adding con mode: crc 2024-09-14T11:39:36.940 INFO:tasks.workunit.client.0.smithi138.stderr: -99> 2024-09-14T11:39:36.777+0000 7f1fff8b29c0 5 AuthRegistry(0x7fffbf76b990) adding con mode: secure 2024-09-14T11:39:36.940 INFO:tasks.workunit.client.0.smithi138.stderr: -98> 2024-09-14T11:39:36.777+0000 7f1fff8b29c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:39:36.940 INFO:tasks.workunit.client.0.smithi138.stderr: -97> 2024-09-14T11:39:36.777+0000 7f1fff8b29c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:39:36.940 INFO:tasks.workunit.client.0.smithi138.stderr: -96> 2024-09-14T11:39:36.777+0000 7f1fff8b29c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:39:36.940 INFO:tasks.workunit.client.0.smithi138.stderr: -95> 2024-09-14T11:39:36.777+0000 7f1fff8b29c0 5 asok(0x561255f1dd90) register_command cache list hook 0x5612561f1de0 2024-09-14T11:39:36.940 INFO:tasks.workunit.client.0.smithi138.stderr: -94> 2024-09-14T11:39:36.777+0000 7f1fff8b29c0 5 asok(0x561255f1dd90) register_command cache inspect hook 0x5612561f1de0 2024-09-14T11:39:36.940 INFO:tasks.workunit.client.0.smithi138.stderr: -93> 2024-09-14T11:39:36.777+0000 7f1fff8b29c0 5 asok(0x561255f1dd90) register_command cache erase hook 0x5612561f1de0 2024-09-14T11:39:36.941 INFO:tasks.workunit.client.0.smithi138.stderr: -92> 2024-09-14T11:39:36.777+0000 7f1fff8b29c0 5 asok(0x561255f1dd90) register_command cache zap hook 0x5612561f1de0 2024-09-14T11:39:36.941 INFO:tasks.workunit.client.0.smithi138.stderr: -91> 2024-09-14T11:39:36.777+0000 7f1fff8b29c0 5 note: GC not initialized 2024-09-14T11:39:36.941 INFO:tasks.workunit.client.0.smithi138.stderr: -90> 2024-09-14T11:39:36.777+0000 7f1eb27e4640 20 reqs_thread_entry: start 2024-09-14T11:39:36.941 INFO:tasks.workunit.client.0.smithi138.stderr: -89> 2024-09-14T11:39:36.777+0000 7f1fff8b29c0 5 asok(0x561255f1dd90) register_command sync trace show hook 0x7f1ff4010040 2024-09-14T11:39:36.941 INFO:tasks.workunit.client.0.smithi138.stderr: -88> 2024-09-14T11:39:36.777+0000 7f1fff8b29c0 5 asok(0x561255f1dd90) register_command sync trace history hook 0x7f1ff4010040 2024-09-14T11:39:36.941 INFO:tasks.workunit.client.0.smithi138.stderr: -87> 2024-09-14T11:39:36.777+0000 7f1fff8b29c0 5 asok(0x561255f1dd90) register_command sync trace active hook 0x7f1ff4010040 2024-09-14T11:39:36.941 INFO:tasks.workunit.client.0.smithi138.stderr: -86> 2024-09-14T11:39:36.777+0000 7f1fff8b29c0 5 asok(0x561255f1dd90) register_command sync trace active_short hook 0x7f1ff4010040 2024-09-14T11:39:36.941 INFO:tasks.workunit.client.0.smithi138.stderr: -85> 2024-09-14T11:39:36.781+0000 7f1fff8b29c0 20 init_complete bucket index max shards: 11 2024-09-14T11:39:36.941 INFO:tasks.workunit.client.0.smithi138.stderr: -84> 2024-09-14T11:39:36.781+0000 7f1fff8b29c0 20 Filter name: none 2024-09-14T11:39:36.941 INFO:tasks.workunit.client.0.smithi138.stderr: -83> 2024-09-14T11:39:36.781+0000 7f1e23fff640 20 reqs_thread_entry: start 2024-09-14T11:39:36.941 INFO:tasks.workunit.client.0.smithi138.stderr: -82> 2024-09-14T11:39:36.781+0000 7f1fff8b29c0 10 cache get: name=default.rgw.meta+root+a-bucket : miss 2024-09-14T11:39:36.941 INFO:tasks.workunit.client.0.smithi138.stderr: -81> 2024-09-14T11:39:36.781+0000 7f1fff8b29c0 20 rados->read ofs=0 len=0 2024-09-14T11:39:36.941 INFO:tasks.workunit.client.0.smithi138.stderr: -80> 2024-09-14T11:39:36.781+0000 7f1fff8b29c0 20 rados_obj.operate() r=0 bl.length=176 2024-09-14T11:39:36.941 INFO:tasks.workunit.client.0.smithi138.stderr: -79> 2024-09-14T11:39:36.781+0000 7f1fff8b29c0 10 cache put: name=default.rgw.meta+root+a-bucket info.flags=0x11 2024-09-14T11:39:36.941 INFO:tasks.workunit.client.0.smithi138.stderr: -78> 2024-09-14T11:39:36.781+0000 7f1fff8b29c0 10 adding default.rgw.meta+root+a-bucket to cache LRU end 2024-09-14T11:39:36.942 INFO:tasks.workunit.client.0.smithi138.stderr: -77> 2024-09-14T11:39:36.781+0000 7f1fff8b29c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.17 : miss 2024-09-14T11:39:36.942 INFO:tasks.workunit.client.0.smithi138.stderr: -76> 2024-09-14T11:39:36.781+0000 7f1fff8b29c0 20 rados->read ofs=0 len=0 2024-09-14T11:39:36.942 INFO:tasks.workunit.client.0.smithi138.stderr: -75> 2024-09-14T11:39:36.781+0000 7f1fff8b29c0 20 rados_obj.operate() r=0 bl.length=398 2024-09-14T11:39:36.942 INFO:tasks.workunit.client.0.smithi138.stderr: -74> 2024-09-14T11:39:36.781+0000 7f1fff8b29c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.17 info.flags=0x17 2024-09-14T11:39:36.942 INFO:tasks.workunit.client.0.smithi138.stderr: -73> 2024-09-14T11:39:36.781+0000 7f1fff8b29c0 10 adding default.rgw.meta+root+.bucket.meta.a-bucket:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.17 to cache LRU end 2024-09-14T11:39:36.942 INFO:tasks.workunit.client.0.smithi138.stderr: -72> 2024-09-14T11:39:36.781+0000 7f1fff8b29c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:39:36.942 INFO:tasks.workunit.client.0.smithi138.stderr: -71> 2024-09-14T11:39:36.781+0000 7f1fff8b29c0 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-14T11:39:36.942 INFO:tasks.workunit.client.0.smithi138.stderr: -70> 2024-09-14T11:39:36.781+0000 7f1fff8b29c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.17 2024-09-14T11:39:36.942 INFO:tasks.workunit.client.0.smithi138.stderr: -69> 2024-09-14T11:39:36.793+0000 7f1fff8b29c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.17 info.flags=0x17 2024-09-14T11:39:36.942 INFO:tasks.workunit.client.0.smithi138.stderr: -68> 2024-09-14T11:39:36.793+0000 7f1fff8b29c0 10 moving default.rgw.meta+root+.bucket.meta.a-bucket:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.17 to cache LRU end 2024-09-14T11:39:36.942 INFO:tasks.workunit.client.0.smithi138.stderr: -67> 2024-09-14T11:39:36.793+0000 7f1fff8b29c0 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-14T11:39:36.942 INFO:tasks.workunit.client.0.smithi138.stderr: -66> 2024-09-14T11:39:36.793+0000 7f1fff8b29c0 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.a-bucket:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.17, ofs0, ns] 2024-09-14T11:39:36.942 INFO:tasks.workunit.client.0.smithi138.stderr: -65> 2024-09-14T11:39:36.793+0000 7f1ed3fff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366239 cookie 94636754505008 notifier 8019 bl.length()=827 2024-09-14T11:39:36.942 INFO:tasks.workunit.client.0.smithi138.stderr: -64> 2024-09-14T11:39:36.793+0000 7f1ed3fff640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.17 info.flags=0x17 2024-09-14T11:39:36.943 INFO:tasks.workunit.client.0.smithi138.stderr: -63> 2024-09-14T11:39:36.793+0000 7f1ed3fff640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.a-bucket:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.17 to cache LRU end 2024-09-14T11:39:36.943 INFO:tasks.workunit.client.0.smithi138.stderr: -62> 2024-09-14T11:39:36.793+0000 7f1ed3fff640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=143 2024-09-14T11:39:36.943 INFO:tasks.workunit.client.0.smithi138.stderr: -61> 2024-09-14T11:39:36.797+0000 7f1fff8b29c0 20 handle_bi_update(): bucket=:a-bucket[d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.17]): orig_sources= new_sources= 2024-09-14T11:39:36.943 INFO:tasks.workunit.client.0.smithi138.stderr: -60> 2024-09-14T11:39:36.797+0000 7f1fff8b29c0 20 handle_bi_update(): bucket=:a-bucket[d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.17]): potential sources added=[] removed=[] 2024-09-14T11:39:36.943 INFO:tasks.workunit.client.0.smithi138.stderr: -59> 2024-09-14T11:39:36.797+0000 7f1fff8b29c0 20 handle_bi_update(): bucket=:a-bucket[d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.17]): orig_dests= new_dests= 2024-09-14T11:39:36.943 INFO:tasks.workunit.client.0.smithi138.stderr: -58> 2024-09-14T11:39:36.797+0000 7f1fff8b29c0 20 handle_bi_update(): bucket=:a-bucket[d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.17]): potential dests added=[] removed=[] 2024-09-14T11:39:36.943 INFO:tasks.workunit.client.0.smithi138.stderr: -57> 2024-09-14T11:39:36.797+0000 7f1ed2ffd640 1 client.8019.objecter ms_handle_reset 0x7f1ff81013e0 session 0x7f1ff80097d0 osd.0 2024-09-14T11:39:36.943 INFO:tasks.workunit.client.0.smithi138.stderr: -56> 2024-09-14T11:39:36.801+0000 7f1ffcbb7640 10 monclient: get_auth_request con 0x5612562211d0 auth_method 0 2024-09-14T11:39:36.943 INFO:tasks.workunit.client.0.smithi138.stderr: -55> 2024-09-14T11:39:36.813+0000 7f1fff8b29c0 10 bucket_obj is .dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.17.3.0 2024-09-14T11:39:36.943 INFO:tasks.workunit.client.0.smithi138.stderr: -54> 2024-09-14T11:39:36.813+0000 7f1fff8b29c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.17.3.0 2024-09-14T11:39:36.943 INFO:tasks.workunit.client.0.smithi138.stderr: -53> 2024-09-14T11:39:36.813+0000 7f1fff8b29c0 10 bucket_obj is .dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.17.3.1 2024-09-14T11:39:36.943 INFO:tasks.workunit.client.0.smithi138.stderr: -52> 2024-09-14T11:39:36.813+0000 7f1fff8b29c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.17.3.1 2024-09-14T11:39:36.943 INFO:tasks.workunit.client.0.smithi138.stderr: -51> 2024-09-14T11:39:36.813+0000 7f1fff8b29c0 10 bucket_obj is .dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.17.3.2 2024-09-14T11:39:36.943 INFO:tasks.workunit.client.0.smithi138.stderr: -50> 2024-09-14T11:39:36.813+0000 7f1fff8b29c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.17.3.2 2024-09-14T11:39:36.943 INFO:tasks.workunit.client.0.smithi138.stderr: -49> 2024-09-14T11:39:36.813+0000 7f1fff8b29c0 10 bucket_obj is .dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.17.3.3 2024-09-14T11:39:36.944 INFO:tasks.workunit.client.0.smithi138.stderr: -48> 2024-09-14T11:39:36.813+0000 7f1fff8b29c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.17.3.3 2024-09-14T11:39:36.944 INFO:tasks.workunit.client.0.smithi138.stderr: -47> 2024-09-14T11:39:36.813+0000 7f1fff8b29c0 10 bucket_obj is .dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.17.3.4 2024-09-14T11:39:36.944 INFO:tasks.workunit.client.0.smithi138.stderr: -46> 2024-09-14T11:39:36.813+0000 7f1fff8b29c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.17.3.4 2024-09-14T11:39:36.944 INFO:tasks.workunit.client.0.smithi138.stderr: -45> 2024-09-14T11:39:36.813+0000 7f1fff8b29c0 10 bucket_obj is .dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.17.3.5 2024-09-14T11:39:36.944 INFO:tasks.workunit.client.0.smithi138.stderr: -44> 2024-09-14T11:39:36.813+0000 7f1fff8b29c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.17.3.5 2024-09-14T11:39:36.944 INFO:tasks.workunit.client.0.smithi138.stderr: -43> 2024-09-14T11:39:36.813+0000 7f1fff8b29c0 10 bucket_obj is .dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.17.3.6 2024-09-14T11:39:36.944 INFO:tasks.workunit.client.0.smithi138.stderr: -42> 2024-09-14T11:39:36.813+0000 7f1fff8b29c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.17.3.6 2024-09-14T11:39:36.944 INFO:tasks.workunit.client.0.smithi138.stderr: -41> 2024-09-14T11:39:36.813+0000 7f1fff8b29c0 10 bucket_obj is .dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.17.3.7 2024-09-14T11:39:36.944 INFO:tasks.workunit.client.0.smithi138.stderr: -40> 2024-09-14T11:39:36.813+0000 7f1fff8b29c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.17.3.7 2024-09-14T11:39:36.944 INFO:tasks.workunit.client.0.smithi138.stderr: -39> 2024-09-14T11:39:36.813+0000 7f1fff8b29c0 10 bucket_obj is .dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.17.3.8 2024-09-14T11:39:36.944 INFO:tasks.workunit.client.0.smithi138.stderr: -38> 2024-09-14T11:39:36.813+0000 7f1fff8b29c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.17.3.8 2024-09-14T11:39:36.944 INFO:tasks.workunit.client.0.smithi138.stderr: -37> 2024-09-14T11:39:36.813+0000 7f1fff8b29c0 10 bucket_obj is .dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.17.3.9 2024-09-14T11:39:36.944 INFO:tasks.workunit.client.0.smithi138.stderr: -36> 2024-09-14T11:39:36.813+0000 7f1fff8b29c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.17.3.9 2024-09-14T11:39:36.944 INFO:tasks.workunit.client.0.smithi138.stderr: -35> 2024-09-14T11:39:36.813+0000 7f1fff8b29c0 10 bucket_obj is .dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.17.3.10 2024-09-14T11:39:36.945 INFO:tasks.workunit.client.0.smithi138.stderr: -34> 2024-09-14T11:39:36.813+0000 7f1fff8b29c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.17.3.10 2024-09-14T11:39:36.945 INFO:tasks.workunit.client.0.smithi138.stderr: -33> 2024-09-14T11:39:36.813+0000 7f1fff8b29c0 10 bucket_obj is .dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.17.3.11 2024-09-14T11:39:36.945 INFO:tasks.workunit.client.0.smithi138.stderr: -32> 2024-09-14T11:39:36.813+0000 7f1fff8b29c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.17.3.11 2024-09-14T11:39:36.945 INFO:tasks.workunit.client.0.smithi138.stderr: -31> 2024-09-14T11:39:36.813+0000 7f1fff8b29c0 10 bucket_obj is .dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.17.3.12 2024-09-14T11:39:36.945 INFO:tasks.workunit.client.0.smithi138.stderr: -30> 2024-09-14T11:39:36.813+0000 7f1fff8b29c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.17.3.12 2024-09-14T11:39:36.945 INFO:tasks.workunit.client.0.smithi138.stderr: -29> 2024-09-14T11:39:36.813+0000 7f1fff8b29c0 10 bucket_obj is .dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.17.3.13 2024-09-14T11:39:36.945 INFO:tasks.workunit.client.0.smithi138.stderr: -28> 2024-09-14T11:39:36.813+0000 7f1fff8b29c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.17.3.13 2024-09-14T11:39:36.945 INFO:tasks.workunit.client.0.smithi138.stderr: -27> 2024-09-14T11:39:36.813+0000 7f1fff8b29c0 10 bucket_obj is .dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.17.2.0 2024-09-14T11:39:36.945 INFO:tasks.workunit.client.0.smithi138.stderr: -26> 2024-09-14T11:39:36.813+0000 7f1fff8b29c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.17.2.0 2024-09-14T11:39:36.945 INFO:tasks.workunit.client.0.smithi138.stderr: -25> 2024-09-14T11:39:36.813+0000 7f1fff8b29c0 10 bucket_obj is .dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.17.2.1 2024-09-14T11:39:36.945 INFO:tasks.workunit.client.0.smithi138.stderr: -24> 2024-09-14T11:39:36.813+0000 7f1fff8b29c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.17.2.1 2024-09-14T11:39:36.945 INFO:tasks.workunit.client.0.smithi138.stderr: -23> 2024-09-14T11:39:36.813+0000 7f1fff8b29c0 10 bucket_obj is .dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.17.2.2 2024-09-14T11:39:36.945 INFO:tasks.workunit.client.0.smithi138.stderr: -22> 2024-09-14T11:39:36.813+0000 7f1fff8b29c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.17.2.2 2024-09-14T11:39:36.945 INFO:tasks.workunit.client.0.smithi138.stderr: -21> 2024-09-14T11:39:36.813+0000 7f1fff8b29c0 10 bucket_obj is .dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.17.2.3 2024-09-14T11:39:36.946 INFO:tasks.workunit.client.0.smithi138.stderr: -20> 2024-09-14T11:39:36.813+0000 7f1fff8b29c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.17.2.3 2024-09-14T11:39:36.946 INFO:tasks.workunit.client.0.smithi138.stderr: -19> 2024-09-14T11:39:36.817+0000 7f1fff8b29c0 10 bucket_obj is .dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.17.2.4 2024-09-14T11:39:36.946 INFO:tasks.workunit.client.0.smithi138.stderr: -18> 2024-09-14T11:39:36.817+0000 7f1fff8b29c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.17.2.4 2024-09-14T11:39:36.946 INFO:tasks.workunit.client.0.smithi138.stderr: -17> 2024-09-14T11:39:36.817+0000 7f1fff8b29c0 10 bucket_obj is .dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.17.2.5 2024-09-14T11:39:36.946 INFO:tasks.workunit.client.0.smithi138.stderr: -16> 2024-09-14T11:39:36.817+0000 7f1fff8b29c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.17.2.5 2024-09-14T11:39:36.946 INFO:tasks.workunit.client.0.smithi138.stderr: -15> 2024-09-14T11:39:36.817+0000 7f1fff8b29c0 10 bucket_obj is .dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.17.2.6 2024-09-14T11:39:36.946 INFO:tasks.workunit.client.0.smithi138.stderr: -14> 2024-09-14T11:39:36.817+0000 7f1fff8b29c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.17.2.6 2024-09-14T11:39:36.946 INFO:tasks.workunit.client.0.smithi138.stderr: -13> 2024-09-14T11:39:36.821+0000 7f1fff8b29c0 10 bucket_obj is .dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.17.2.7 2024-09-14T11:39:36.946 INFO:tasks.workunit.client.0.smithi138.stderr: -12> 2024-09-14T11:39:36.821+0000 7f1fff8b29c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.17.2.7 2024-09-14T11:39:36.946 INFO:tasks.workunit.client.0.smithi138.stderr: -11> 2024-09-14T11:39:36.821+0000 7f1fff8b29c0 10 bucket_obj is .dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.17.2.8 2024-09-14T11:39:36.946 INFO:tasks.workunit.client.0.smithi138.stderr: -10> 2024-09-14T11:39:36.821+0000 7f1fff8b29c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.17.2.8 2024-09-14T11:39:36.946 INFO:tasks.workunit.client.0.smithi138.stderr: -9> 2024-09-14T11:39:36.821+0000 7f1fff8b29c0 10 bucket_obj is .dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.17.2.9 2024-09-14T11:39:36.946 INFO:tasks.workunit.client.0.smithi138.stderr: -8> 2024-09-14T11:39:36.821+0000 7f1fff8b29c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.17.2.9 2024-09-14T11:39:36.946 INFO:tasks.workunit.client.0.smithi138.stderr: -7> 2024-09-14T11:39:36.821+0000 7f1fff8b29c0 10 bucket_obj is .dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.17.2.10 2024-09-14T11:39:36.946 INFO:tasks.workunit.client.0.smithi138.stderr: -6> 2024-09-14T11:39:36.821+0000 7f1fff8b29c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.17.2.10 2024-09-14T11:39:36.947 INFO:tasks.workunit.client.0.smithi138.stderr: -5> 2024-09-14T11:39:36.821+0000 7f1fff8b29c0 10 bucket_obj is .dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.17.2.11 2024-09-14T11:39:36.947 INFO:tasks.workunit.client.0.smithi138.stderr: -4> 2024-09-14T11:39:36.821+0000 7f1fff8b29c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.17.2.11 2024-09-14T11:39:36.947 INFO:tasks.workunit.client.0.smithi138.stderr: -3> 2024-09-14T11:39:36.825+0000 7f1fff8b29c0 10 bucket_obj is .dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.17.2.12 2024-09-14T11:39:36.947 INFO:tasks.workunit.client.0.smithi138.stderr: -2> 2024-09-14T11:39:36.825+0000 7f1fff8b29c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.17.2.12 2024-09-14T11:39:36.947 INFO:tasks.workunit.client.0.smithi138.stderr: -1> 2024-09-14T11:39:36.829+0000 7f1fff8b29c0 -1 ./src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f1fff8b29c0 time 2024-09-14T11:39:36.834404+0000 2024-09-14T11:39:36.947 INFO:tasks.workunit.client.0.smithi138.stderr:./src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-14T11:39:36.947 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-14T11:39:36.947 INFO:tasks.workunit.client.0.smithi138.stderr: ceph version 19.3.0-4907-ga2782315 (a2782315255a3e7d5f6cdc9eb35785187ff6ddf8) squid (dev) 2024-09-14T11:39:36.947 INFO:tasks.workunit.client.0.smithi138.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x121) [0x7f200318c2eb] 2024-09-14T11:39:36.947 INFO:tasks.workunit.client.0.smithi138.stderr: 2: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7f200318c49f] 2024-09-14T11:39:36.947 INFO:tasks.workunit.client.0.smithi138.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x5612537bec01] 2024-09-14T11:39:36.947 INFO:tasks.workunit.client.0.smithi138.stderr: 4: (RGWBucketReshard::do_reshard(rgw::bucket_index_layout_generation const&, rgw::bucket_index_layout_generation const&, int, bool, bool, std::ostream*, ceph::Formatter*, FaultInjector > >&, DoutPrefixProvider const*, optional_yield)+0x1411) [0x5612537d3231] 2024-09-14T11:39:36.947 INFO:tasks.workunit.client.0.smithi138.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0xac4) [0x5612537d4884] 2024-09-14T11:39:36.947 INFO:tasks.workunit.client.0.smithi138.stderr: 6: main() 2024-09-14T11:39:36.948 INFO:tasks.workunit.client.0.smithi138.stderr: 7: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7f2001ff2d90] 2024-09-14T11:39:36.948 INFO:tasks.workunit.client.0.smithi138.stderr: 8: __libc_start_main() 2024-09-14T11:39:36.948 INFO:tasks.workunit.client.0.smithi138.stderr: 9: _start() 2024-09-14T11:39:36.948 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-14T11:39:36.948 INFO:tasks.workunit.client.0.smithi138.stderr: 0> 2024-09-14T11:39:36.829+0000 7f1fff8b29c0 -1 *** Caught signal (Aborted) ** 2024-09-14T11:39:36.948 INFO:tasks.workunit.client.0.smithi138.stderr: in thread 7f1fff8b29c0 thread_name:radosgw-admin 2024-09-14T11:39:36.948 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-14T11:39:36.948 INFO:tasks.workunit.client.0.smithi138.stderr: ceph version 19.3.0-4907-ga2782315 (a2782315255a3e7d5f6cdc9eb35785187ff6ddf8) squid (dev) 2024-09-14T11:39:36.948 INFO:tasks.workunit.client.0.smithi138.stderr: 1: /lib/x86_64-linux-gnu/libc.so.6(+0x42520) [0x7f200200b520] 2024-09-14T11:39:36.948 INFO:tasks.workunit.client.0.smithi138.stderr: 2: pthread_kill() 2024-09-14T11:39:36.948 INFO:tasks.workunit.client.0.smithi138.stderr: 3: raise() 2024-09-14T11:39:36.948 INFO:tasks.workunit.client.0.smithi138.stderr: 4: abort() 2024-09-14T11:39:36.948 INFO:tasks.workunit.client.0.smithi138.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x17b) [0x7f200318c345] 2024-09-14T11:39:36.948 INFO:tasks.workunit.client.0.smithi138.stderr: 6: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7f200318c49f] 2024-09-14T11:39:36.949 INFO:tasks.workunit.client.0.smithi138.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x5612537bec01] 2024-09-14T11:39:36.949 INFO:tasks.workunit.client.0.smithi138.stderr: 8: (RGWBucketReshard::do_reshard(rgw::bucket_index_layout_generation const&, rgw::bucket_index_layout_generation const&, int, bool, bool, std::ostream*, ceph::Formatter*, FaultInjector > >&, DoutPrefixProvider const*, optional_yield)+0x1411) [0x5612537d3231] 2024-09-14T11:39:36.949 INFO:tasks.workunit.client.0.smithi138.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0xac4) [0x5612537d4884] 2024-09-14T11:39:36.949 INFO:tasks.workunit.client.0.smithi138.stderr: 10: main() 2024-09-14T11:39:36.949 INFO:tasks.workunit.client.0.smithi138.stderr: 11: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7f2001ff2d90] 2024-09-14T11:39:36.949 INFO:tasks.workunit.client.0.smithi138.stderr: 12: __libc_start_main() 2024-09-14T11:39:36.949 INFO:tasks.workunit.client.0.smithi138.stderr: 13: _start() 2024-09-14T11:39:36.949 INFO:tasks.workunit.client.0.smithi138.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-14T11:39:36.949 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-14T11:39:36.949 INFO:tasks.workunit.client.0.smithi138.stderr:--- logging levels --- 2024-09-14T11:39:36.949 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 none 2024-09-14T11:39:36.949 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 1 lockdep 2024-09-14T11:39:36.949 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 1 context 2024-09-14T11:39:36.949 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 1 crush 2024-09-14T11:39:36.949 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 mds 2024-09-14T11:39:36.950 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 mds_balancer 2024-09-14T11:39:36.950 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 mds_locker 2024-09-14T11:39:36.950 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 mds_log 2024-09-14T11:39:36.950 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 mds_log_expire 2024-09-14T11:39:36.950 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 mds_migrator 2024-09-14T11:39:36.950 INFO:tasks.workunit.client.0.smithi138.stderr: 3/ 5 mds_quiesce 2024-09-14T11:39:36.950 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 1 buffer 2024-09-14T11:39:36.950 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 1 timer 2024-09-14T11:39:36.950 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 1 filer 2024-09-14T11:39:36.950 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 1 striper 2024-09-14T11:39:36.950 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 1 objecter 2024-09-14T11:39:36.950 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 rados 2024-09-14T11:39:36.950 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 rbd 2024-09-14T11:39:36.950 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 rbd_mirror 2024-09-14T11:39:36.950 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 rbd_replay 2024-09-14T11:39:36.950 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 rbd_pwl 2024-09-14T11:39:36.951 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 journaler 2024-09-14T11:39:36.951 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 objectcacher 2024-09-14T11:39:36.951 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 immutable_obj_cache 2024-09-14T11:39:36.951 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 client 2024-09-14T11:39:36.951 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 osd 2024-09-14T11:39:36.951 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 optracker 2024-09-14T11:39:36.951 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 objclass 2024-09-14T11:39:36.951 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 3 filestore 2024-09-14T11:39:36.951 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 3 journal 2024-09-14T11:39:36.951 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 0 ms 2024-09-14T11:39:36.951 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 mon 2024-09-14T11:39:36.951 INFO:tasks.workunit.client.0.smithi138.stderr: 0/10 monc 2024-09-14T11:39:36.951 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 paxos 2024-09-14T11:39:36.952 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 tp 2024-09-14T11:39:36.952 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 auth 2024-09-14T11:39:36.952 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 crypto 2024-09-14T11:39:36.952 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 1 finisher 2024-09-14T11:39:36.952 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 1 reserver 2024-09-14T11:39:36.952 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 heartbeatmap 2024-09-14T11:39:36.952 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 perfcounter 2024-09-14T11:39:36.952 INFO:tasks.workunit.client.0.smithi138.stderr: 20/20 rgw 2024-09-14T11:39:36.952 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 rgw_sync 2024-09-14T11:39:36.952 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 rgw_datacache 2024-09-14T11:39:36.952 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 rgw_access 2024-09-14T11:39:36.952 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 rgw_dbstore 2024-09-14T11:39:36.952 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 rgw_flight 2024-09-14T11:39:36.952 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 rgw_lifecycle 2024-09-14T11:39:36.952 INFO:tasks.workunit.client.0.smithi138.stderr: 20/20 rgw_notification 2024-09-14T11:39:36.952 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 javaclient 2024-09-14T11:39:36.953 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 asok 2024-09-14T11:39:36.953 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 1 throttle 2024-09-14T11:39:36.953 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 0 refs 2024-09-14T11:39:36.953 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 compressor 2024-09-14T11:39:36.953 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 bluestore 2024-09-14T11:39:36.953 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 bluefs 2024-09-14T11:39:36.953 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 3 bdev 2024-09-14T11:39:36.953 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 kstore 2024-09-14T11:39:36.953 INFO:tasks.workunit.client.0.smithi138.stderr: 4/ 5 rocksdb 2024-09-14T11:39:36.953 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 fuse 2024-09-14T11:39:36.953 INFO:tasks.workunit.client.0.smithi138.stderr: 2/ 5 mgr 2024-09-14T11:39:36.953 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 mgrc 2024-09-14T11:39:36.953 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 dpdk 2024-09-14T11:39:36.953 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 eventtrace 2024-09-14T11:39:36.953 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 prioritycache 2024-09-14T11:39:36.954 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 test 2024-09-14T11:39:36.954 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 cephfs_mirror 2024-09-14T11:39:36.954 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 cephsqlite 2024-09-14T11:39:36.954 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 crimson_interrupt 2024-09-14T11:39:36.954 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 seastore 2024-09-14T11:39:36.954 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 seastore_onode 2024-09-14T11:39:36.954 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 seastore_odata 2024-09-14T11:39:36.954 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 seastore_omap 2024-09-14T11:39:36.954 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 seastore_tm 2024-09-14T11:39:36.954 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 seastore_t 2024-09-14T11:39:36.954 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 seastore_cleaner 2024-09-14T11:39:36.954 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 seastore_epm 2024-09-14T11:39:36.954 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 seastore_lba 2024-09-14T11:39:36.954 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 seastore_fixedkv_tree 2024-09-14T11:39:36.954 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 seastore_cache 2024-09-14T11:39:36.954 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 seastore_journal 2024-09-14T11:39:36.955 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 seastore_device 2024-09-14T11:39:36.955 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 seastore_backref 2024-09-14T11:39:36.955 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 alienstore 2024-09-14T11:39:36.955 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 mclock 2024-09-14T11:39:36.955 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 cyanstore 2024-09-14T11:39:36.955 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 ceph_exporter 2024-09-14T11:39:36.955 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 memstore 2024-09-14T11:39:36.955 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 trace 2024-09-14T11:39:36.955 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 ceph_dedup 2024-09-14T11:39:36.955 INFO:tasks.workunit.client.0.smithi138.stderr: -2/-2 (syslog threshold) 2024-09-14T11:39:36.955 INFO:tasks.workunit.client.0.smithi138.stderr: 99/99 (stderr threshold) 2024-09-14T11:39:36.955 INFO:tasks.workunit.client.0.smithi138.stderr:--- pthread ID / name mapping for recent threads --- 2024-09-14T11:39:36.955 INFO:tasks.workunit.client.0.smithi138.stderr: 7f1e23fff640 / http_manager 2024-09-14T11:39:36.955 INFO:tasks.workunit.client.0.smithi138.stderr: 7f1eb27e4640 / http_manager 2024-09-14T11:39:36.955 INFO:tasks.workunit.client.0.smithi138.stderr: 7f1eb37e6640 / rgw_dt_lg_renew 2024-09-14T11:39:36.955 INFO:tasks.workunit.client.0.smithi138.stderr: 7f1ed2ffd640 / ms_dispatch 2024-09-14T11:39:36.956 INFO:tasks.workunit.client.0.smithi138.stderr: 7f1ed3fff640 / io_context_pool 2024-09-14T11:39:36.956 INFO:tasks.workunit.client.0.smithi138.stderr: 7f1ee0ff9640 / io_context_pool 2024-09-14T11:39:36.956 INFO:tasks.workunit.client.0.smithi138.stderr: 7f1ee2ffd640 / ms_dispatch 2024-09-14T11:39:36.956 INFO:tasks.workunit.client.0.smithi138.stderr: 7f1ee9e03640 / ms_dispatch 2024-09-14T11:39:36.956 INFO:tasks.workunit.client.0.smithi138.stderr: 7f1eeb606640 / io_context_pool 2024-09-14T11:39:36.956 INFO:tasks.workunit.client.0.smithi138.stderr: 7f1ffcbb7640 / msgr-worker-2 2024-09-14T11:39:36.956 INFO:tasks.workunit.client.0.smithi138.stderr: 7f1ffd3b8640 / msgr-worker-1 2024-09-14T11:39:36.956 INFO:tasks.workunit.client.0.smithi138.stderr: 7f1ffdbb9640 / msgr-worker-0 2024-09-14T11:39:36.956 INFO:tasks.workunit.client.0.smithi138.stderr: 7f1ffe3ba640 / io_context_pool 2024-09-14T11:39:36.956 INFO:tasks.workunit.client.0.smithi138.stderr: 7f1fff8b29c0 / radosgw-admin 2024-09-14T11:39:36.956 INFO:tasks.workunit.client.0.smithi138.stderr: max_recent 500 2024-09-14T11:39:36.956 INFO:tasks.workunit.client.0.smithi138.stderr: max_new 1000 2024-09-14T11:39:36.956 INFO:tasks.workunit.client.0.smithi138.stderr: log_file /var/lib/ceph/crash/2024-09-14T11:39:36.836837Z_1f0a6c08-d935-4826-a59d-2f3aab8e7a45/log 2024-09-14T11:39:36.956 INFO:tasks.workunit.client.0.smithi138.stderr:--- end dump of recent events --- 2024-09-14T11:39:36.956 INFO:tasks.workunit.client.0.smithi138.stderr:Aborted 2024-09-14T11:39:36.957 INFO:tasks.workunit.client.0.smithi138.stderr:radosgw-admin bucket stats --bucket a-bucket 2024-09-14T11:39:36.959 INFO:tasks.workunit.client.0.smithi138.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:39:36.959 INFO:tasks.workunit.client.0.smithi138.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:39:36.959 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:39:36.921+0000 7f9ff5b4d9c0 20 rados->read ofs=0 len=0 2024-09-14T11:39:36.959 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:39:36.921+0000 7f9ff5b4d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:39:36.959 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:39:36.921+0000 7f9ff5b4d9c0 20 realm 2024-09-14T11:39:36.959 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:39:36.921+0000 7f9ff5b4d9c0 20 rados->read ofs=0 len=0 2024-09-14T11:39:36.959 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:39:36.921+0000 7f9ff5b4d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:39:36.959 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:39:36.921+0000 7f9ff5b4d9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:39:36.959 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:39:36.921+0000 7f9ff5b4d9c0 20 rados->read ofs=0 len=0 2024-09-14T11:39:36.959 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:39:36.921+0000 7f9ff5b4d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:39:36.959 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:39:36.921+0000 7f9ff5b4d9c0 20 rados->read ofs=0 len=0 2024-09-14T11:39:36.960 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:39:36.925+0000 7f9ff5b4d9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:39:36.960 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:39:36.925+0000 7f9ff5b4d9c0 20 rados->read ofs=0 len=0 2024-09-14T11:39:36.960 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:39:36.925+0000 7f9ff3e54640 0 -- 172.21.15.138:0/97625509 >> [v2:172.21.15.138:6824/2633984942,v1:172.21.15.138:6825/2633984942] conn(0x55ce9127a750 msgr2=0x55ce9127cb40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:39:36.960 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:39:36.925+0000 7f9ff5b4d9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:39:36.960 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:39:36.925+0000 7f9ff5b4d9c0 20 searching for the correct realm 2024-09-14T11:39:36.960 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:39:36.929+0000 7f9ff2e52640 0 -- 172.21.15.138:0/97625509 >> [v2:172.21.15.154:6808/1468088432,v1:172.21.15.154:6809/1468088432] conn(0x7f9fe4011450 msgr2=0x7f9fe4011890 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:39:36.960 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:39:36.945+0000 7f9ff5b4d9c0 20 RGWRados::pool_iterate: got zone_info.d9e72d30-c60b-4d0d-9267-fdc36392d5ad 2024-09-14T11:39:36.960 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:39:36.945+0000 7f9ff5b4d9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:39:36.960 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:39:36.945+0000 7f9ff5b4d9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:39:36.960 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:39:36.945+0000 7f9ff5b4d9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:39:36.960 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:39:36.945+0000 7f9ff5b4d9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:39:36.960 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:39:36.945+0000 7f9ff5b4d9c0 20 RGWRados::pool_iterate: got zonegroup_info.65ab941b-da8c-4160-94fb-3672b069d44f 2024-09-14T11:39:36.960 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:39:36.945+0000 7f9ff5b4d9c0 20 rados->read ofs=0 len=0 2024-09-14T11:39:36.960 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:39:36.945+0000 7f9ff5b4d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:39:36.960 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:39:36.945+0000 7f9ff5b4d9c0 20 rados->read ofs=0 len=0 2024-09-14T11:39:36.961 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:39:36.945+0000 7f9ff5b4d9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:39:36.961 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:39:36.945+0000 7f9ff5b4d9c0 20 rados->read ofs=0 len=0 2024-09-14T11:39:36.961 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:39:36.945+0000 7f9ff5b4d9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:39:36.961 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:39:36.945+0000 7f9ff5b4d9c0 20 zone default found 2024-09-14T11:39:36.961 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:39:36.945+0000 7f9ff5b4d9c0 4 Realm: () 2024-09-14T11:39:36.961 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:39:36.945+0000 7f9ff5b4d9c0 4 ZoneGroup: default (65ab941b-da8c-4160-94fb-3672b069d44f) 2024-09-14T11:39:36.961 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:39:36.945+0000 7f9ff5b4d9c0 4 Zone: default (d9e72d30-c60b-4d0d-9267-fdc36392d5ad) 2024-09-14T11:39:36.961 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:39:36.945+0000 7f9ff5b4d9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:39:36.961 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:39:36.945+0000 7f9ff5b4d9c0 20 zonegroup default 2024-09-14T11:39:36.961 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:39:36.945+0000 7f9ff5b4d9c0 20 rados->read ofs=0 len=0 2024-09-14T11:39:36.961 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:39:36.945+0000 7f9ff5b4d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:39:36.961 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:39:36.945+0000 7f9ff5b4d9c0 20 rados->read ofs=0 len=0 2024-09-14T11:39:36.961 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:39:36.945+0000 7f9ff5b4d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:39:36.961 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:39:36.945+0000 7f9ff5b4d9c0 20 rados->read ofs=0 len=0 2024-09-14T11:39:36.961 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:39:36.945+0000 7f9ff5b4d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:39:36.962 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:39:36.945+0000 7f9ff5b4d9c0 20 started sync module instance, tier type = 2024-09-14T11:39:36.962 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:39:36.945+0000 7f9ff5b4d9c0 20 started zone id=d9e72d30-c60b-4d0d-9267-fdc36392d5ad (name=default) with tier type = 2024-09-14T11:39:36.962 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:39:36.961+0000 7f9ff5b4d9c0 20 add_watcher() i=0 2024-09-14T11:39:36.962 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:39:36.961+0000 7f9ff5b4d9c0 20 add_watcher() i=1 2024-09-14T11:39:36.962 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:39:36.961+0000 7f9ff5b4d9c0 20 add_watcher() i=2 2024-09-14T11:39:36.962 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:39:36.961+0000 7f9ff5b4d9c0 20 add_watcher() i=3 2024-09-14T11:39:36.962 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:39:36.961+0000 7f9ff5b4d9c0 20 add_watcher() i=4 2024-09-14T11:39:36.963 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:39:36.961+0000 7f9ff5b4d9c0 20 add_watcher() i=5 2024-09-14T11:39:36.963 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:39:36.961+0000 7f9ff5b4d9c0 20 add_watcher() i=6 2024-09-14T11:39:36.963 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:39:36.961+0000 7f9ff5b4d9c0 20 add_watcher() i=7 2024-09-14T11:39:36.963 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:39:36.961+0000 7f9ff5b4d9c0 2 all 8 watchers are set, enabling cache 2024-09-14T11:39:36.966 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:39:36.965+0000 7f9ea9fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:39:36.966 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:39:36.965+0000 7f9ff5b4d9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:39:36.966 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:39:36.965+0000 7f9ff5b4d9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:39:36.966 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:39:36.965+0000 7f9ff5b4d9c0 5 note: GC not initialized 2024-09-14T11:39:36.967 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:39:36.965+0000 7f9ea8fe1640 20 reqs_thread_entry: start 2024-09-14T11:39:36.967 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:39:36.965+0000 7f9ff5b4d9c0 20 init_complete bucket index max shards: 11 2024-09-14T11:39:36.967 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:39:36.965+0000 7f9ff5b4d9c0 20 Filter name: none 2024-09-14T11:39:36.967 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:39:36.965+0000 7f9e227fc640 20 reqs_thread_entry: start 2024-09-14T11:39:36.967 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:39:36.965+0000 7f9ff5b4d9c0 20 rados->read ofs=0 len=0 2024-09-14T11:39:36.968 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:39:36.969+0000 7f9ff5b4d9c0 20 rados_obj.operate() r=0 bl.length=176 2024-09-14T11:39:36.968 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:39:36.969+0000 7f9ff5b4d9c0 20 rados->read ofs=0 len=0 2024-09-14T11:39:36.969 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:39:36.969+0000 7f9ff5b4d9c0 20 rados_obj.operate() r=0 bl.length=430 2024-09-14T11:39:36.969 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:39:36.969+0000 7f9ff5b4d9c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:39:36.969 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:39:36.969+0000 7f9ff5b4d9c0 20 rados->read ofs=0 len=0 2024-09-14T11:39:36.970 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:39:36.969+0000 7f9ff5b4d9c0 20 rados_obj.operate() r=0 bl.length=176 2024-09-14T11:39:36.970 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:39:36.969+0000 7f9ff5b4d9c0 20 rados->read ofs=0 len=0 2024-09-14T11:39:36.970 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:39:36.969+0000 7f9ff5b4d9c0 20 rados_obj.operate() r=0 bl.length=430 2024-09-14T11:39:36.970 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:39:36.969+0000 7f9ff5b4d9c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:39:36.973 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:39:36.973+0000 7f9ea9fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:39:36.978 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:39:36.977+0000 7f9ff5b4d9c0 20 remove_watcher() i=0 2024-09-14T11:39:36.978 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:39:36.977+0000 7f9ff5b4d9c0 2 removed watcher, disabling cache 2024-09-14T11:39:36.980 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:39:36.981+0000 7f9ff5b4d9c0 20 remove_watcher() i=1 2024-09-14T11:39:36.982 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:39:36.981+0000 7f9ff5b4d9c0 20 remove_watcher() i=2 2024-09-14T11:39:36.984 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:39:36.985+0000 7f9ff5b4d9c0 20 remove_watcher() i=3 2024-09-14T11:39:36.986 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:39:36.985+0000 7f9ff5b4d9c0 20 remove_watcher() i=4 2024-09-14T11:39:36.988 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:39:36.989+0000 7f9ff5b4d9c0 20 remove_watcher() i=5 2024-09-14T11:39:36.989 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:39:36.989+0000 7f9ff5b4d9c0 20 remove_watcher() i=6 2024-09-14T11:39:36.990 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:39:36.989+0000 7f9ff5b4d9c0 20 remove_watcher() i=7 2024-09-14T11:39:37.005 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:39:37.005 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-14T11:39:37.046 INFO:tasks.workunit.client.0.smithi138.stderr:radosgw-admin reshardlog list --bucket a-bucket 2024-09-14T11:39:37.072 INFO:tasks.workunit.client.0.smithi138.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:39:37.073 INFO:tasks.workunit.client.0.smithi138.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:39:37.115 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:39:37.113+0000 7fad5ffff9c0 20 rados->read ofs=0 len=0 2024-09-14T11:39:37.117 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:39:37.117+0000 7fad5ffff9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:39:37.117 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:39:37.117+0000 7fad5ffff9c0 20 realm 2024-09-14T11:39:37.117 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:39:37.117+0000 7fad5ffff9c0 20 rados->read ofs=0 len=0 2024-09-14T11:39:37.117 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:39:37.117+0000 7fad5ffff9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:39:37.117 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:39:37.117+0000 7fad5ffff9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:39:37.117 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:39:37.117+0000 7fad5ffff9c0 20 rados->read ofs=0 len=0 2024-09-14T11:39:37.118 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:39:37.117+0000 7fad5ffff9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:39:37.118 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:39:37.117+0000 7fad5ffff9c0 20 rados->read ofs=0 len=0 2024-09-14T11:39:37.119 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:39:37.117+0000 7fad5ffff9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:39:37.119 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:39:37.117+0000 7fad5ffff9c0 20 rados->read ofs=0 len=0 2024-09-14T11:39:37.119 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:39:37.117+0000 7fad5ffff9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:39:37.119 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:39:37.117+0000 7fad5ffff9c0 20 searching for the correct realm 2024-09-14T11:39:37.123 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:39:37.121+0000 7fad5e306640 0 -- 172.21.15.138:0/3366740635 >> [v2:172.21.15.154:6824/416768175,v1:172.21.15.154:6825/416768175] conn(0x7fad580d9b00 msgr2=0x7fad580d0970 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:39:37.337 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:39:37.337+0000 7fad5d304640 0 -- 172.21.15.138:0/3366740635 >> [v2:172.21.15.138:6816/326481658,v1:172.21.15.138:6817/326481658] conn(0x7fad580b83f0 msgr2=0x7fad580b8850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-14T11:39:37.555 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:39:37.553+0000 7fad5ffff9c0 20 RGWRados::pool_iterate: got zone_info.d9e72d30-c60b-4d0d-9267-fdc36392d5ad 2024-09-14T11:39:37.556 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:39:37.553+0000 7fad5ffff9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:39:37.556 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:39:37.553+0000 7fad5ffff9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:39:37.556 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:39:37.553+0000 7fad5ffff9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:39:37.556 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:39:37.553+0000 7fad5ffff9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:39:37.556 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:39:37.553+0000 7fad5ffff9c0 20 RGWRados::pool_iterate: got zonegroup_info.65ab941b-da8c-4160-94fb-3672b069d44f 2024-09-14T11:39:37.556 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:39:37.553+0000 7fad5ffff9c0 20 rados->read ofs=0 len=0 2024-09-14T11:39:37.556 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:39:37.557+0000 7fad5ffff9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:39:37.556 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:39:37.557+0000 7fad5ffff9c0 20 rados->read ofs=0 len=0 2024-09-14T11:39:37.557 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:39:37.557+0000 7fad5ffff9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:39:37.557 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:39:37.557+0000 7fad5ffff9c0 20 rados->read ofs=0 len=0 2024-09-14T11:39:37.558 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:39:37.557+0000 7fad5ffff9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:39:37.558 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:39:37.557+0000 7fad5ffff9c0 20 zone default found 2024-09-14T11:39:37.558 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:39:37.557+0000 7fad5ffff9c0 4 Realm: () 2024-09-14T11:39:37.558 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:39:37.557+0000 7fad5ffff9c0 4 ZoneGroup: default (65ab941b-da8c-4160-94fb-3672b069d44f) 2024-09-14T11:39:37.558 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:39:37.557+0000 7fad5ffff9c0 4 Zone: default (d9e72d30-c60b-4d0d-9267-fdc36392d5ad) 2024-09-14T11:39:37.558 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:39:37.557+0000 7fad5ffff9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:39:37.558 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:39:37.557+0000 7fad5ffff9c0 20 zonegroup default 2024-09-14T11:39:37.558 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:39:37.557+0000 7fad5ffff9c0 20 rados->read ofs=0 len=0 2024-09-14T11:39:37.558 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:39:37.557+0000 7fad5ffff9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:39:37.558 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:39:37.557+0000 7fad5ffff9c0 20 rados->read ofs=0 len=0 2024-09-14T11:39:37.559 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:39:37.557+0000 7fad5ffff9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:39:37.559 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:39:37.557+0000 7fad5ffff9c0 20 rados->read ofs=0 len=0 2024-09-14T11:39:37.560 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:39:37.561+0000 7fad5ffff9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:39:37.560 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:39:37.561+0000 7fad5ffff9c0 20 started sync module instance, tier type = 2024-09-14T11:39:37.560 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:39:37.561+0000 7fad5ffff9c0 20 started zone id=d9e72d30-c60b-4d0d-9267-fdc36392d5ad (name=default) with tier type = 2024-09-14T11:39:37.586 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:39:37.585+0000 7fad5ffff9c0 20 add_watcher() i=0 2024-09-14T11:39:37.586 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:39:37.585+0000 7fad5ffff9c0 20 add_watcher() i=1 2024-09-14T11:39:37.587 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:39:37.585+0000 7fad5ffff9c0 20 add_watcher() i=2 2024-09-14T11:39:37.587 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:39:37.585+0000 7fad5ffff9c0 20 add_watcher() i=3 2024-09-14T11:39:37.587 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:39:37.585+0000 7fad5ffff9c0 20 add_watcher() i=4 2024-09-14T11:39:37.587 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:39:37.585+0000 7fad5ffff9c0 20 add_watcher() i=5 2024-09-14T11:39:37.587 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:39:37.585+0000 7fad5ffff9c0 20 add_watcher() i=6 2024-09-14T11:39:37.589 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:39:37.589+0000 7fad5ffff9c0 20 add_watcher() i=7 2024-09-14T11:39:37.589 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:39:37.589+0000 7fad5ffff9c0 2 all 8 watchers are set, enabling cache 2024-09-14T11:39:37.593 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:39:37.593+0000 7fac13fe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:39:37.594 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:39:37.593+0000 7fad5ffff9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:39:37.594 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:39:37.593+0000 7fad5ffff9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:39:37.594 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:39:37.593+0000 7fad5ffff9c0 5 note: GC not initialized 2024-09-14T11:39:37.595 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:39:37.593+0000 7fac12fe5640 20 reqs_thread_entry: start 2024-09-14T11:39:37.595 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:39:37.593+0000 7fad5ffff9c0 20 init_complete bucket index max shards: 11 2024-09-14T11:39:37.595 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:39:37.593+0000 7fad5ffff9c0 20 Filter name: none 2024-09-14T11:39:37.595 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:39:37.593+0000 7fac10fe1640 20 reqs_thread_entry: start 2024-09-14T11:39:37.595 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:39:37.593+0000 7fad5ffff9c0 10 cache get: name=default.rgw.meta+root+a-bucket : miss 2024-09-14T11:39:37.595 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:39:37.593+0000 7fad5ffff9c0 20 rados->read ofs=0 len=0 2024-09-14T11:39:37.596 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:39:37.597+0000 7fad5ffff9c0 20 rados_obj.operate() r=0 bl.length=176 2024-09-14T11:39:37.597 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:39:37.597+0000 7fad5ffff9c0 10 cache put: name=default.rgw.meta+root+a-bucket info.flags=0x11 2024-09-14T11:39:37.597 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:39:37.597+0000 7fad5ffff9c0 10 adding default.rgw.meta+root+a-bucket to cache LRU end 2024-09-14T11:39:37.597 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:39:37.597+0000 7fad5ffff9c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.17 : miss 2024-09-14T11:39:37.597 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:39:37.597+0000 7fad5ffff9c0 20 rados->read ofs=0 len=0 2024-09-14T11:39:37.597 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:39:37.597+0000 7fad5ffff9c0 20 rados_obj.operate() r=0 bl.length=430 2024-09-14T11:39:37.598 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:39:37.597+0000 7fad5ffff9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.17 info.flags=0x17 2024-09-14T11:39:37.598 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:39:37.597+0000 7fad5ffff9c0 10 adding default.rgw.meta+root+.bucket.meta.a-bucket:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.17 to cache LRU end 2024-09-14T11:39:37.598 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:39:37.597+0000 7fad5ffff9c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:39:37.598 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:39:37.597+0000 7fad5ffff9c0 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-14T11:39:37.598 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:39:37.597+0000 7fad5ffff9c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.17 2024-09-14T11:39:37.598 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:39:37.597+0000 7fad5ffff9c0 10 bucket_obj is .dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.17.2.0 2024-09-14T11:39:37.598 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:39:37.597+0000 7fad5ffff9c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.17.2.0 2024-09-14T11:39:37.598 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:39:37.597+0000 7fad5ffff9c0 10 bucket_obj is .dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.17.2.1 2024-09-14T11:39:37.598 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:39:37.597+0000 7fad5ffff9c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.17.2.1 2024-09-14T11:39:37.599 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:39:37.597+0000 7fad5ffff9c0 10 bucket_obj is .dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.17.2.2 2024-09-14T11:39:37.599 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:39:37.597+0000 7fad5ffff9c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.17.2.2 2024-09-14T11:39:37.599 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:39:37.597+0000 7fad5ffff9c0 10 bucket_obj is .dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.17.2.3 2024-09-14T11:39:37.599 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:39:37.597+0000 7fad5ffff9c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.17.2.3 2024-09-14T11:39:37.601 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:39:37.601+0000 7fad5ffff9c0 10 bucket_obj is .dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.17.2.4 2024-09-14T11:39:37.601 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:39:37.601+0000 7fad5ffff9c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.17.2.4 2024-09-14T11:39:37.602 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:39:37.601+0000 7fad5ffff9c0 10 bucket_obj is .dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.17.2.5 2024-09-14T11:39:37.602 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:39:37.601+0000 7fad5ffff9c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.17.2.5 2024-09-14T11:39:37.602 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:39:37.601+0000 7fad5ffff9c0 10 bucket_obj is .dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.17.2.6 2024-09-14T11:39:37.602 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:39:37.601+0000 7fad5ffff9c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.17.2.6 2024-09-14T11:39:37.603 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:39:37.601+0000 7fad5ffff9c0 10 bucket_obj is .dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.17.2.7 2024-09-14T11:39:37.604 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:39:37.601+0000 7fad5ffff9c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.17.2.7 2024-09-14T11:39:37.604 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:39:37.605+0000 7fad5ffff9c0 10 bucket_obj is .dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.17.2.8 2024-09-14T11:39:37.604 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:39:37.605+0000 7fad5ffff9c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.17.2.8 2024-09-14T11:39:37.604 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:39:37.605+0000 7fad5ffff9c0 10 bucket_obj is .dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.17.2.9 2024-09-14T11:39:37.604 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:39:37.605+0000 7fad5ffff9c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.17.2.9 2024-09-14T11:39:37.605 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:39:37.605+0000 7fad5ffff9c0 10 bucket_obj is .dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.17.2.10 2024-09-14T11:39:37.605 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:39:37.605+0000 7fad5ffff9c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.17.2.10 2024-09-14T11:39:37.606 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:39:37.605+0000 7fad5ffff9c0 10 bucket_obj is .dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.17.2.11 2024-09-14T11:39:37.606 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:39:37.605+0000 7fad5ffff9c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.17.2.11 2024-09-14T11:39:37.606 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:39:37.605+0000 7fad5ffff9c0 10 bucket_obj is .dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.17.2.12 2024-09-14T11:39:37.606 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:39:37.605+0000 7fad5ffff9c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.17.2.12 2024-09-14T11:39:37.609 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:39:37.609+0000 7fac13fe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:39:37.614 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:39:37.613+0000 7fad5ffff9c0 20 remove_watcher() i=0 2024-09-14T11:39:37.614 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:39:37.613+0000 7fad5ffff9c0 2 removed watcher, disabling cache 2024-09-14T11:39:37.617 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:39:37.617+0000 7fad5ffff9c0 20 remove_watcher() i=1 2024-09-14T11:39:37.621 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:39:37.621+0000 7fad5ffff9c0 20 remove_watcher() i=2 2024-09-14T11:39:37.623 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:39:37.621+0000 7fad5ffff9c0 20 remove_watcher() i=3 2024-09-14T11:39:37.626 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:39:37.625+0000 7fad5ffff9c0 20 remove_watcher() i=4 2024-09-14T11:39:37.628 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:39:37.629+0000 7fad5ffff9c0 20 remove_watcher() i=5 2024-09-14T11:39:37.630 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:39:37.629+0000 7fad5ffff9c0 20 remove_watcher() i=6 2024-09-14T11:39:37.631 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:39:37.629+0000 7fad5ffff9c0 20 remove_watcher() i=7 2024-09-14T11:40:07.679 INFO:tasks.workunit.client.0.smithi138.stderr:radosgw-admin bucket stats --bucket a-bucket 2024-09-14T11:40:07.711 INFO:tasks.workunit.client.0.smithi138.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:40:07.711 INFO:tasks.workunit.client.0.smithi138.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:40:07.759 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:40:07.760+0000 7f82764379c0 20 rados->read ofs=0 len=0 2024-09-14T11:40:07.761 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:40:07.764+0000 7f82764379c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:40:07.761 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:40:07.764+0000 7f82764379c0 20 realm 2024-09-14T11:40:07.761 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:40:07.764+0000 7f82764379c0 20 rados->read ofs=0 len=0 2024-09-14T11:40:07.761 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:40:07.764+0000 7f82764379c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:40:07.762 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:40:07.764+0000 7f82764379c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:40:07.762 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:40:07.764+0000 7f82764379c0 20 rados->read ofs=0 len=0 2024-09-14T11:40:07.762 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:40:07.764+0000 7f82764379c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:40:07.762 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:40:07.764+0000 7f82764379c0 20 rados->read ofs=0 len=0 2024-09-14T11:40:07.763 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:40:07.764+0000 7f82764379c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:40:07.763 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:40:07.764+0000 7f82764379c0 20 rados->read ofs=0 len=0 2024-09-14T11:40:07.764 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:40:07.768+0000 7f82764379c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:40:07.764 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:40:07.768+0000 7f82764379c0 20 searching for the correct realm 2024-09-14T11:40:07.765 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:40:07.768+0000 7f827373c640 0 -- 172.21.15.138:0/3375931329 >> [v2:172.21.15.154:6808/1468088432,v1:172.21.15.154:6809/1468088432] conn(0x7f8264015030 msgr2=0x7f8264015410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:40:07.980 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:40:07.980+0000 7f827473e640 0 -- 172.21.15.138:0/3375931329 >> [v2:172.21.15.138:6824/2633984942,v1:172.21.15.138:6825/2633984942] conn(0x562b34406910 msgr2=0x562b34408d00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:40:07.997 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:40:08.000+0000 7f82764379c0 20 RGWRados::pool_iterate: got zone_info.d9e72d30-c60b-4d0d-9267-fdc36392d5ad 2024-09-14T11:40:07.998 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:40:08.000+0000 7f82764379c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:40:07.998 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:40:08.000+0000 7f82764379c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:40:07.998 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:40:08.000+0000 7f82764379c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:40:07.998 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:40:08.000+0000 7f82764379c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:40:07.998 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:40:08.000+0000 7f82764379c0 20 RGWRados::pool_iterate: got zonegroup_info.65ab941b-da8c-4160-94fb-3672b069d44f 2024-09-14T11:40:07.998 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:40:08.000+0000 7f82764379c0 20 rados->read ofs=0 len=0 2024-09-14T11:40:07.998 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:40:08.000+0000 7f82764379c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:40:07.999 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:40:08.000+0000 7f82764379c0 20 rados->read ofs=0 len=0 2024-09-14T11:40:07.999 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:40:08.000+0000 7f82764379c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:40:07.999 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:40:08.000+0000 7f82764379c0 20 rados->read ofs=0 len=0 2024-09-14T11:40:08.000 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:40:08.004+0000 7f82764379c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:40:08.000 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:40:08.004+0000 7f82764379c0 20 zone default found 2024-09-14T11:40:08.000 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:40:08.004+0000 7f82764379c0 4 Realm: () 2024-09-14T11:40:08.000 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:40:08.004+0000 7f82764379c0 4 ZoneGroup: default (65ab941b-da8c-4160-94fb-3672b069d44f) 2024-09-14T11:40:08.000 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:40:08.004+0000 7f82764379c0 4 Zone: default (d9e72d30-c60b-4d0d-9267-fdc36392d5ad) 2024-09-14T11:40:08.000 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:40:08.004+0000 7f82764379c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:40:08.000 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:40:08.004+0000 7f82764379c0 20 zonegroup default 2024-09-14T11:40:08.000 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:40:08.004+0000 7f82764379c0 20 rados->read ofs=0 len=0 2024-09-14T11:40:08.001 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:40:08.004+0000 7f82764379c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:40:08.001 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:40:08.004+0000 7f82764379c0 20 rados->read ofs=0 len=0 2024-09-14T11:40:08.001 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:40:08.004+0000 7f82764379c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:40:08.001 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:40:08.004+0000 7f82764379c0 20 rados->read ofs=0 len=0 2024-09-14T11:40:08.002 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:40:08.004+0000 7f82764379c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:40:08.002 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:40:08.004+0000 7f82764379c0 20 started sync module instance, tier type = 2024-09-14T11:40:08.002 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:40:08.004+0000 7f82764379c0 20 started zone id=d9e72d30-c60b-4d0d-9267-fdc36392d5ad (name=default) with tier type = 2024-09-14T11:40:08.029 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:40:08.032+0000 7f82764379c0 20 add_watcher() i=0 2024-09-14T11:40:08.029 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:40:08.032+0000 7f82764379c0 20 add_watcher() i=1 2024-09-14T11:40:08.029 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:40:08.032+0000 7f82764379c0 20 add_watcher() i=2 2024-09-14T11:40:08.029 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:40:08.032+0000 7f82764379c0 20 add_watcher() i=3 2024-09-14T11:40:08.029 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:40:08.032+0000 7f82764379c0 20 add_watcher() i=4 2024-09-14T11:40:08.029 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:40:08.032+0000 7f82764379c0 20 add_watcher() i=5 2024-09-14T11:40:08.029 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:40:08.032+0000 7f82764379c0 20 add_watcher() i=6 2024-09-14T11:40:08.032 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:40:08.036+0000 7f82764379c0 20 add_watcher() i=7 2024-09-14T11:40:08.032 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:40:08.036+0000 7f82764379c0 2 all 8 watchers are set, enabling cache 2024-09-14T11:40:08.036 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:40:08.040+0000 7f8129fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:40:08.037 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:40:08.040+0000 7f82764379c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:40:08.037 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:40:08.040+0000 7f82764379c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:40:08.037 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:40:08.040+0000 7f82764379c0 5 note: GC not initialized 2024-09-14T11:40:08.038 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:40:08.040+0000 7f8128fe1640 20 reqs_thread_entry: start 2024-09-14T11:40:08.038 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:40:08.040+0000 7f82764379c0 20 init_complete bucket index max shards: 11 2024-09-14T11:40:08.038 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:40:08.040+0000 7f82764379c0 20 Filter name: none 2024-09-14T11:40:08.038 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:40:08.040+0000 7f80a27fc640 20 reqs_thread_entry: start 2024-09-14T11:40:08.038 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:40:08.040+0000 7f82764379c0 20 rados->read ofs=0 len=0 2024-09-14T11:40:08.040 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:40:08.040+0000 7f82764379c0 20 rados_obj.operate() r=0 bl.length=176 2024-09-14T11:40:08.040 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:40:08.040+0000 7f82764379c0 20 rados->read ofs=0 len=0 2024-09-14T11:40:08.040 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:40:08.044+0000 7f82764379c0 20 rados_obj.operate() r=0 bl.length=430 2024-09-14T11:40:08.041 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:40:08.044+0000 7f82764379c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:40:08.041 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:40:08.044+0000 7f82764379c0 20 rados->read ofs=0 len=0 2024-09-14T11:40:08.042 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:40:08.044+0000 7f82764379c0 20 rados_obj.operate() r=0 bl.length=176 2024-09-14T11:40:08.042 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:40:08.044+0000 7f82764379c0 20 rados->read ofs=0 len=0 2024-09-14T11:40:08.042 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:40:08.044+0000 7f82764379c0 20 rados_obj.operate() r=0 bl.length=430 2024-09-14T11:40:08.042 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:40:08.044+0000 7f82764379c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:40:08.045 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:40:08.048+0000 7f8129fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:40:08.050 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:40:08.052+0000 7f82764379c0 20 remove_watcher() i=0 2024-09-14T11:40:08.050 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:40:08.052+0000 7f82764379c0 2 removed watcher, disabling cache 2024-09-14T11:40:08.052 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:40:08.056+0000 7f82764379c0 20 remove_watcher() i=1 2024-09-14T11:40:08.055 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:40:08.056+0000 7f82764379c0 20 remove_watcher() i=2 2024-09-14T11:40:08.057 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:40:08.060+0000 7f82764379c0 20 remove_watcher() i=3 2024-09-14T11:40:08.059 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:40:08.060+0000 7f82764379c0 20 remove_watcher() i=4 2024-09-14T11:40:08.061 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:40:08.064+0000 7f82764379c0 20 remove_watcher() i=5 2024-09-14T11:40:08.062 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:40:08.064+0000 7f82764379c0 20 remove_watcher() i=6 2024-09-14T11:40:08.064 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:40:08.068+0000 7f82764379c0 20 remove_watcher() i=7 2024-09-14T11:40:08.083 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:40:08.083 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-14T11:40:08.262 INFO:tasks.workunit.client.0.smithi138.stderr:radosgw-admin reshardlog list --bucket a-bucket 2024-09-14T11:40:08.296 INFO:tasks.workunit.client.0.smithi138.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:40:08.296 INFO:tasks.workunit.client.0.smithi138.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:40:08.341 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:40:08.344+0000 7fe99244c9c0 20 rados->read ofs=0 len=0 2024-09-14T11:40:08.343 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:40:08.344+0000 7fe99244c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:40:08.344 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:40:08.344+0000 7fe99244c9c0 20 realm 2024-09-14T11:40:08.344 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:40:08.344+0000 7fe99244c9c0 20 rados->read ofs=0 len=0 2024-09-14T11:40:08.344 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:40:08.344+0000 7fe99244c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:40:08.344 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:40:08.344+0000 7fe99244c9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:40:08.344 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:40:08.344+0000 7fe99244c9c0 20 rados->read ofs=0 len=0 2024-09-14T11:40:08.344 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:40:08.344+0000 7fe99244c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:40:08.344 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:40:08.344+0000 7fe99244c9c0 20 rados->read ofs=0 len=0 2024-09-14T11:40:08.345 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:40:08.348+0000 7fe99244c9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:40:08.345 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:40:08.348+0000 7fe99244c9c0 20 rados->read ofs=0 len=0 2024-09-14T11:40:08.346 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:40:08.348+0000 7fe99244c9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:40:08.346 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:40:08.348+0000 7fe99244c9c0 20 searching for the correct realm 2024-09-14T11:40:08.350 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:40:08.352+0000 7fe990753640 0 -- 172.21.15.138:0/1078340028 >> [v2:172.21.15.154:6824/416768175,v1:172.21.15.154:6825/416768175] conn(0x7fe9880c8020 msgr2=0x7fe9880ffd20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:40:08.357 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:40:08.360+0000 7fe98f751640 0 -- 172.21.15.138:0/1078340028 >> [v2:172.21.15.138:6816/326481658,v1:172.21.15.138:6817/326481658] conn(0x7fe9880fd450 msgr2=0x7fe98811e7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:40:08.575 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:40:08.576+0000 7fe99244c9c0 20 RGWRados::pool_iterate: got zone_info.d9e72d30-c60b-4d0d-9267-fdc36392d5ad 2024-09-14T11:40:08.575 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:40:08.576+0000 7fe99244c9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:40:08.575 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:40:08.576+0000 7fe99244c9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:40:08.575 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:40:08.576+0000 7fe99244c9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:40:08.575 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:40:08.576+0000 7fe99244c9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:40:08.575 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:40:08.576+0000 7fe99244c9c0 20 RGWRados::pool_iterate: got zonegroup_info.65ab941b-da8c-4160-94fb-3672b069d44f 2024-09-14T11:40:08.575 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:40:08.576+0000 7fe99244c9c0 20 rados->read ofs=0 len=0 2024-09-14T11:40:08.576 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:40:08.576+0000 7fe99244c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:40:08.576 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:40:08.576+0000 7fe99244c9c0 20 rados->read ofs=0 len=0 2024-09-14T11:40:08.576 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:40:08.580+0000 7fe99244c9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:40:08.576 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:40:08.580+0000 7fe99244c9c0 20 rados->read ofs=0 len=0 2024-09-14T11:40:08.577 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:40:08.580+0000 7fe99244c9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:40:08.578 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:40:08.580+0000 7fe99244c9c0 20 zone default found 2024-09-14T11:40:08.578 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:40:08.580+0000 7fe99244c9c0 4 Realm: () 2024-09-14T11:40:08.578 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:40:08.580+0000 7fe99244c9c0 4 ZoneGroup: default (65ab941b-da8c-4160-94fb-3672b069d44f) 2024-09-14T11:40:08.578 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:40:08.580+0000 7fe99244c9c0 4 Zone: default (d9e72d30-c60b-4d0d-9267-fdc36392d5ad) 2024-09-14T11:40:08.578 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:40:08.580+0000 7fe99244c9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:40:08.578 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:40:08.580+0000 7fe99244c9c0 20 zonegroup default 2024-09-14T11:40:08.578 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:40:08.580+0000 7fe99244c9c0 20 rados->read ofs=0 len=0 2024-09-14T11:40:08.579 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:40:08.580+0000 7fe99244c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:40:08.579 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:40:08.580+0000 7fe99244c9c0 20 rados->read ofs=0 len=0 2024-09-14T11:40:08.579 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:40:08.580+0000 7fe99244c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:40:08.579 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:40:08.580+0000 7fe99244c9c0 20 rados->read ofs=0 len=0 2024-09-14T11:40:08.579 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:40:08.580+0000 7fe99244c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:40:08.579 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:40:08.580+0000 7fe99244c9c0 20 started sync module instance, tier type = 2024-09-14T11:40:08.580 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:40:08.580+0000 7fe99244c9c0 20 started zone id=d9e72d30-c60b-4d0d-9267-fdc36392d5ad (name=default) with tier type = 2024-09-14T11:40:08.609 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:40:08.612+0000 7fe99244c9c0 20 add_watcher() i=0 2024-09-14T11:40:08.609 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:40:08.612+0000 7fe99244c9c0 20 add_watcher() i=1 2024-09-14T11:40:08.609 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:40:08.612+0000 7fe99244c9c0 20 add_watcher() i=2 2024-09-14T11:40:08.609 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:40:08.612+0000 7fe99244c9c0 20 add_watcher() i=3 2024-09-14T11:40:08.609 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:40:08.612+0000 7fe99244c9c0 20 add_watcher() i=4 2024-09-14T11:40:08.610 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:40:08.612+0000 7fe99244c9c0 20 add_watcher() i=5 2024-09-14T11:40:08.610 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:40:08.612+0000 7fe99244c9c0 20 add_watcher() i=6 2024-09-14T11:40:08.612 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:40:08.612+0000 7fe99244c9c0 20 add_watcher() i=7 2024-09-14T11:40:08.612 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:40:08.612+0000 7fe99244c9c0 2 all 8 watchers are set, enabling cache 2024-09-14T11:40:08.616 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:40:08.616+0000 7fe845fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:40:08.616 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:40:08.620+0000 7fe99244c9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:40:08.617 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:40:08.620+0000 7fe99244c9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:40:08.617 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:40:08.620+0000 7fe99244c9c0 5 note: GC not initialized 2024-09-14T11:40:08.617 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:40:08.620+0000 7fe844fe1640 20 reqs_thread_entry: start 2024-09-14T11:40:08.618 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:40:08.620+0000 7fe99244c9c0 20 init_complete bucket index max shards: 11 2024-09-14T11:40:08.618 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:40:08.620+0000 7fe99244c9c0 20 Filter name: none 2024-09-14T11:40:08.618 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:40:08.620+0000 7fe7be7fc640 20 reqs_thread_entry: start 2024-09-14T11:40:08.618 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:40:08.620+0000 7fe99244c9c0 10 cache get: name=default.rgw.meta+root+a-bucket : miss 2024-09-14T11:40:08.619 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:40:08.620+0000 7fe99244c9c0 20 rados->read ofs=0 len=0 2024-09-14T11:40:08.619 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:40:08.620+0000 7fe99244c9c0 20 rados_obj.operate() r=0 bl.length=176 2024-09-14T11:40:08.620 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:40:08.620+0000 7fe99244c9c0 10 cache put: name=default.rgw.meta+root+a-bucket info.flags=0x11 2024-09-14T11:40:08.620 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:40:08.620+0000 7fe99244c9c0 10 adding default.rgw.meta+root+a-bucket to cache LRU end 2024-09-14T11:40:08.620 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:40:08.620+0000 7fe99244c9c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.17 : miss 2024-09-14T11:40:08.620 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:40:08.620+0000 7fe99244c9c0 20 rados->read ofs=0 len=0 2024-09-14T11:40:08.621 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:40:08.624+0000 7fe99244c9c0 20 rados_obj.operate() r=0 bl.length=398 2024-09-14T11:40:08.621 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:40:08.624+0000 7fe99244c9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.17 info.flags=0x17 2024-09-14T11:40:08.621 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:40:08.624+0000 7fe99244c9c0 10 adding default.rgw.meta+root+.bucket.meta.a-bucket:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.17 to cache LRU end 2024-09-14T11:40:08.621 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:40:08.624+0000 7fe99244c9c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:40:08.622 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:40:08.624+0000 7fe99244c9c0 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-14T11:40:08.622 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:40:08.624+0000 7fe99244c9c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.17 2024-09-14T11:40:08.622 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:40:08.624+0000 7fe99244c9c0 10 bucket_obj is .dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.17.2.0 2024-09-14T11:40:08.622 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:40:08.624+0000 7fe99244c9c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.17.2.0 2024-09-14T11:40:08.622 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:40:08.624+0000 7fe99244c9c0 10 bucket_obj is .dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.17.2.1 2024-09-14T11:40:08.622 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:40:08.624+0000 7fe99244c9c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.17.2.1 2024-09-14T11:40:08.623 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:40:08.624+0000 7fe99244c9c0 10 bucket_obj is .dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.17.2.2 2024-09-14T11:40:08.623 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:40:08.624+0000 7fe99244c9c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.17.2.2 2024-09-14T11:40:08.623 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:40:08.624+0000 7fe99244c9c0 10 bucket_obj is .dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.17.2.3 2024-09-14T11:40:08.623 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:40:08.624+0000 7fe99244c9c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.17.2.3 2024-09-14T11:40:08.624 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:40:08.628+0000 7fe99244c9c0 10 bucket_obj is .dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.17.2.4 2024-09-14T11:40:08.624 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:40:08.628+0000 7fe99244c9c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.17.2.4 2024-09-14T11:40:08.626 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:40:08.628+0000 7fe99244c9c0 10 bucket_obj is .dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.17.2.5 2024-09-14T11:40:08.626 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:40:08.628+0000 7fe99244c9c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.17.2.5 2024-09-14T11:40:08.626 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:40:08.628+0000 7fe99244c9c0 10 bucket_obj is .dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.17.2.6 2024-09-14T11:40:08.626 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:40:08.628+0000 7fe99244c9c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.17.2.6 2024-09-14T11:40:08.627 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:40:08.628+0000 7fe99244c9c0 10 bucket_obj is .dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.17.2.7 2024-09-14T11:40:08.627 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:40:08.628+0000 7fe99244c9c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.17.2.7 2024-09-14T11:40:08.628 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:40:08.632+0000 7fe99244c9c0 10 bucket_obj is .dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.17.2.8 2024-09-14T11:40:08.628 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:40:08.632+0000 7fe99244c9c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.17.2.8 2024-09-14T11:40:08.629 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:40:08.632+0000 7fe99244c9c0 10 bucket_obj is .dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.17.2.9 2024-09-14T11:40:08.629 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:40:08.632+0000 7fe99244c9c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.17.2.9 2024-09-14T11:40:08.630 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:40:08.632+0000 7fe99244c9c0 10 bucket_obj is .dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.17.2.10 2024-09-14T11:40:08.630 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:40:08.632+0000 7fe99244c9c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.17.2.10 2024-09-14T11:40:08.630 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:40:08.632+0000 7fe99244c9c0 10 bucket_obj is .dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.17.2.11 2024-09-14T11:40:08.630 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:40:08.632+0000 7fe99244c9c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.17.2.11 2024-09-14T11:40:08.631 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:40:08.632+0000 7fe99244c9c0 10 bucket_obj is .dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.17.2.12 2024-09-14T11:40:08.631 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:40:08.632+0000 7fe99244c9c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.17.2.12 2024-09-14T11:40:08.633 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:40:08.636+0000 7fe845fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:40:08.638 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:40:08.640+0000 7fe99244c9c0 20 remove_watcher() i=0 2024-09-14T11:40:08.638 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:40:08.640+0000 7fe99244c9c0 2 removed watcher, disabling cache 2024-09-14T11:40:08.640 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:40:08.644+0000 7fe99244c9c0 20 remove_watcher() i=1 2024-09-14T11:40:08.643 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:40:08.644+0000 7fe99244c9c0 20 remove_watcher() i=2 2024-09-14T11:40:08.645 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:40:08.648+0000 7fe99244c9c0 20 remove_watcher() i=3 2024-09-14T11:40:08.648 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:40:08.652+0000 7fe99244c9c0 20 remove_watcher() i=4 2024-09-14T11:40:08.649 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:40:08.652+0000 7fe99244c9c0 20 remove_watcher() i=5 2024-09-14T11:40:08.651 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:40:08.652+0000 7fe99244c9c0 20 remove_watcher() i=6 2024-09-14T11:40:08.653 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:40:08.656+0000 7fe99244c9c0 20 remove_watcher() i=7 2024-09-14T11:40:08.674 INFO:tasks.workunit.client.0.smithi138.stderr:radosgw-admin bucket stats --bucket a-bucket 2024-09-14T11:40:08.705 INFO:tasks.workunit.client.0.smithi138.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:40:08.705 INFO:tasks.workunit.client.0.smithi138.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:40:08.750 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:40:08.752+0000 7fd6f80e09c0 20 rados->read ofs=0 len=0 2024-09-14T11:40:08.752 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:40:08.752+0000 7fd6f80e09c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:40:08.752 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:40:08.752+0000 7fd6f80e09c0 20 realm 2024-09-14T11:40:08.752 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:40:08.752+0000 7fd6f80e09c0 20 rados->read ofs=0 len=0 2024-09-14T11:40:08.752 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:40:08.756+0000 7fd6f80e09c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:40:08.752 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:40:08.756+0000 7fd6f80e09c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:40:08.752 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:40:08.756+0000 7fd6f80e09c0 20 rados->read ofs=0 len=0 2024-09-14T11:40:08.752 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:40:08.756+0000 7fd6f80e09c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:40:08.753 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:40:08.756+0000 7fd6f80e09c0 20 rados->read ofs=0 len=0 2024-09-14T11:40:08.754 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:40:08.756+0000 7fd6f80e09c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:40:08.754 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:40:08.756+0000 7fd6f80e09c0 20 rados->read ofs=0 len=0 2024-09-14T11:40:08.755 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:40:08.756+0000 7fd6f80e09c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:40:08.755 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:40:08.756+0000 7fd6f80e09c0 20 searching for the correct realm 2024-09-14T11:40:08.759 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:40:08.760+0000 7fd6f63e7640 0 -- 172.21.15.138:0/3650886388 >> [v2:172.21.15.154:6824/416768175,v1:172.21.15.154:6825/416768175] conn(0x7fd6e8080040 msgr2=0x7fd6e805b7d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:40:08.765 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:40:08.768+0000 7fd6f53e5640 0 -- 172.21.15.138:0/3650886388 >> [v2:172.21.15.138:6816/326481658,v1:172.21.15.138:6817/326481658] conn(0x7fd6e80729d0 msgr2=0x7fd6e8090860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:40:08.983 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:40:08.984+0000 7fd6f80e09c0 20 RGWRados::pool_iterate: got zone_info.d9e72d30-c60b-4d0d-9267-fdc36392d5ad 2024-09-14T11:40:08.983 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:40:08.984+0000 7fd6f80e09c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:40:08.983 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:40:08.984+0000 7fd6f80e09c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:40:08.983 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:40:08.984+0000 7fd6f80e09c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:40:08.983 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:40:08.984+0000 7fd6f80e09c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:40:08.984 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:40:08.984+0000 7fd6f80e09c0 20 RGWRados::pool_iterate: got zonegroup_info.65ab941b-da8c-4160-94fb-3672b069d44f 2024-09-14T11:40:08.984 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:40:08.984+0000 7fd6f80e09c0 20 rados->read ofs=0 len=0 2024-09-14T11:40:08.984 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:40:08.984+0000 7fd6f80e09c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:40:08.984 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:40:08.984+0000 7fd6f80e09c0 20 rados->read ofs=0 len=0 2024-09-14T11:40:08.984 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:40:08.988+0000 7fd6f80e09c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:40:08.985 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:40:08.988+0000 7fd6f80e09c0 20 rados->read ofs=0 len=0 2024-09-14T11:40:08.985 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:40:08.988+0000 7fd6f80e09c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:40:08.985 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:40:08.988+0000 7fd6f80e09c0 20 zone default found 2024-09-14T11:40:08.986 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:40:08.988+0000 7fd6f80e09c0 4 Realm: () 2024-09-14T11:40:08.986 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:40:08.988+0000 7fd6f80e09c0 4 ZoneGroup: default (65ab941b-da8c-4160-94fb-3672b069d44f) 2024-09-14T11:40:08.986 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:40:08.988+0000 7fd6f80e09c0 4 Zone: default (d9e72d30-c60b-4d0d-9267-fdc36392d5ad) 2024-09-14T11:40:08.986 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:40:08.988+0000 7fd6f80e09c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:40:08.986 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:40:08.988+0000 7fd6f80e09c0 20 zonegroup default 2024-09-14T11:40:08.986 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:40:08.988+0000 7fd6f80e09c0 20 rados->read ofs=0 len=0 2024-09-14T11:40:08.986 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:40:08.988+0000 7fd6f80e09c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:40:08.987 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:40:08.988+0000 7fd6f80e09c0 20 rados->read ofs=0 len=0 2024-09-14T11:40:08.987 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:40:08.988+0000 7fd6f80e09c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:40:08.987 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:40:08.988+0000 7fd6f80e09c0 20 rados->read ofs=0 len=0 2024-09-14T11:40:08.988 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:40:08.992+0000 7fd6f80e09c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:40:08.988 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:40:08.992+0000 7fd6f80e09c0 20 started sync module instance, tier type = 2024-09-14T11:40:08.988 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:40:08.992+0000 7fd6f80e09c0 20 started zone id=d9e72d30-c60b-4d0d-9267-fdc36392d5ad (name=default) with tier type = 2024-09-14T11:40:09.012 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:40:09.016+0000 7fd6f80e09c0 20 add_watcher() i=0 2024-09-14T11:40:09.012 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:40:09.016+0000 7fd6f80e09c0 20 add_watcher() i=1 2024-09-14T11:40:09.013 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:40:09.016+0000 7fd6f80e09c0 20 add_watcher() i=2 2024-09-14T11:40:09.013 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:40:09.016+0000 7fd6f80e09c0 20 add_watcher() i=3 2024-09-14T11:40:09.013 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:40:09.016+0000 7fd6f80e09c0 20 add_watcher() i=4 2024-09-14T11:40:09.013 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:40:09.016+0000 7fd6f80e09c0 20 add_watcher() i=5 2024-09-14T11:40:09.013 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:40:09.016+0000 7fd6f80e09c0 20 add_watcher() i=6 2024-09-14T11:40:09.015 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:40:09.016+0000 7fd6f80e09c0 20 add_watcher() i=7 2024-09-14T11:40:09.015 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:40:09.016+0000 7fd6f80e09c0 2 all 8 watchers are set, enabling cache 2024-09-14T11:40:09.019 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:40:09.020+0000 7fd5a77fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:40:09.020 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:40:09.020+0000 7fd6f80e09c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:40:09.020 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:40:09.020+0000 7fd6f80e09c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:40:09.020 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:40:09.024+0000 7fd6f80e09c0 5 note: GC not initialized 2024-09-14T11:40:09.020 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:40:09.024+0000 7fd5a67fc640 20 reqs_thread_entry: start 2024-09-14T11:40:09.020 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:40:09.024+0000 7fd6f80e09c0 20 init_complete bucket index max shards: 11 2024-09-14T11:40:09.021 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:40:09.024+0000 7fd6f80e09c0 20 Filter name: none 2024-09-14T11:40:09.021 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:40:09.024+0000 7fd517fff640 20 reqs_thread_entry: start 2024-09-14T11:40:09.021 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:40:09.024+0000 7fd6f80e09c0 20 rados->read ofs=0 len=0 2024-09-14T11:40:09.022 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:40:09.024+0000 7fd6f80e09c0 20 rados_obj.operate() r=0 bl.length=176 2024-09-14T11:40:09.022 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:40:09.024+0000 7fd6f80e09c0 20 rados->read ofs=0 len=0 2024-09-14T11:40:09.023 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:40:09.024+0000 7fd6f80e09c0 20 rados_obj.operate() r=0 bl.length=398 2024-09-14T11:40:09.023 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:40:09.024+0000 7fd6f80e09c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:40:09.023 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:40:09.024+0000 7fd6f80e09c0 20 rados->read ofs=0 len=0 2024-09-14T11:40:09.024 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:40:09.028+0000 7fd6f80e09c0 20 rados_obj.operate() r=0 bl.length=176 2024-09-14T11:40:09.024 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:40:09.028+0000 7fd6f80e09c0 20 rados->read ofs=0 len=0 2024-09-14T11:40:09.025 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:40:09.028+0000 7fd6f80e09c0 20 rados_obj.operate() r=0 bl.length=398 2024-09-14T11:40:09.025 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:40:09.028+0000 7fd6f80e09c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:40:09.028 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:40:09.032+0000 7fd5a77fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:40:09.033 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:40:09.036+0000 7fd6f80e09c0 20 remove_watcher() i=0 2024-09-14T11:40:09.033 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:40:09.036+0000 7fd6f80e09c0 2 removed watcher, disabling cache 2024-09-14T11:40:09.035 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:40:09.036+0000 7fd6f80e09c0 20 remove_watcher() i=1 2024-09-14T11:40:09.038 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:40:09.040+0000 7fd6f80e09c0 20 remove_watcher() i=2 2024-09-14T11:40:09.040 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:40:09.044+0000 7fd6f80e09c0 20 remove_watcher() i=3 2024-09-14T11:40:09.042 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:40:09.044+0000 7fd6f80e09c0 20 remove_watcher() i=4 2024-09-14T11:40:09.044 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:40:09.048+0000 7fd6f80e09c0 20 remove_watcher() i=5 2024-09-14T11:40:09.046 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:40:09.048+0000 7fd6f80e09c0 20 remove_watcher() i=6 2024-09-14T11:40:09.048 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:40:09.052+0000 7fd6f80e09c0 20 remove_watcher() i=7 2024-09-14T11:40:09.064 INFO:tasks.workunit.client.0.smithi138.stderr: test: duplicated entries should be purged before reshard 2024-09-14T11:40:09.065 INFO:tasks.workunit.client.0.smithi138.stderr:radosgw-admin bucket stats --bucket a-bucket 2024-09-14T11:40:09.092 INFO:tasks.workunit.client.0.smithi138.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:40:09.092 INFO:tasks.workunit.client.0.smithi138.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:40:09.137 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:40:09.140+0000 7fd95a22e9c0 20 rados->read ofs=0 len=0 2024-09-14T11:40:09.139 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:40:09.140+0000 7fd95a22e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:40:09.139 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:40:09.140+0000 7fd95a22e9c0 20 realm 2024-09-14T11:40:09.139 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:40:09.140+0000 7fd95a22e9c0 20 rados->read ofs=0 len=0 2024-09-14T11:40:09.139 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:40:09.140+0000 7fd95a22e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:40:09.139 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:40:09.140+0000 7fd95a22e9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:40:09.139 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:40:09.140+0000 7fd95a22e9c0 20 rados->read ofs=0 len=0 2024-09-14T11:40:09.139 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:40:09.140+0000 7fd95a22e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:40:09.139 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:40:09.140+0000 7fd95a22e9c0 20 rados->read ofs=0 len=0 2024-09-14T11:40:09.141 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:40:09.144+0000 7fd95a22e9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:40:09.141 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:40:09.144+0000 7fd95a22e9c0 20 rados->read ofs=0 len=0 2024-09-14T11:40:09.141 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:40:09.144+0000 7fd95a22e9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:40:09.141 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:40:09.144+0000 7fd95a22e9c0 20 searching for the correct realm 2024-09-14T11:40:09.145 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:40:09.148+0000 7fd958535640 0 -- 172.21.15.138:0/267021717 >> [v2:172.21.15.154:6824/416768175,v1:172.21.15.154:6825/416768175] conn(0x7fd950017020 msgr2=0x7fd95005dc30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:40:09.153 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:40:09.156+0000 7fd957533640 0 -- 172.21.15.138:0/267021717 >> [v2:172.21.15.138:6816/326481658,v1:172.21.15.138:6817/326481658] conn(0x7fd9500920f0 msgr2=0x7fd950067d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:40:09.371 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:40:09.372+0000 7fd95a22e9c0 20 RGWRados::pool_iterate: got zone_info.d9e72d30-c60b-4d0d-9267-fdc36392d5ad 2024-09-14T11:40:09.371 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:40:09.372+0000 7fd95a22e9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:40:09.371 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:40:09.372+0000 7fd95a22e9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:40:09.372 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:40:09.372+0000 7fd95a22e9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:40:09.372 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:40:09.372+0000 7fd95a22e9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:40:09.372 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:40:09.372+0000 7fd95a22e9c0 20 RGWRados::pool_iterate: got zonegroup_info.65ab941b-da8c-4160-94fb-3672b069d44f 2024-09-14T11:40:09.372 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:40:09.372+0000 7fd95a22e9c0 20 rados->read ofs=0 len=0 2024-09-14T11:40:09.372 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:40:09.376+0000 7fd95a22e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:40:09.372 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:40:09.376+0000 7fd95a22e9c0 20 rados->read ofs=0 len=0 2024-09-14T11:40:09.373 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:40:09.376+0000 7fd95a22e9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:40:09.373 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:40:09.376+0000 7fd95a22e9c0 20 rados->read ofs=0 len=0 2024-09-14T11:40:09.374 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:40:09.376+0000 7fd95a22e9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:40:09.374 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:40:09.376+0000 7fd95a22e9c0 20 zone default found 2024-09-14T11:40:09.374 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:40:09.376+0000 7fd95a22e9c0 4 Realm: () 2024-09-14T11:40:09.374 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:40:09.376+0000 7fd95a22e9c0 4 ZoneGroup: default (65ab941b-da8c-4160-94fb-3672b069d44f) 2024-09-14T11:40:09.374 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:40:09.376+0000 7fd95a22e9c0 4 Zone: default (d9e72d30-c60b-4d0d-9267-fdc36392d5ad) 2024-09-14T11:40:09.374 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:40:09.376+0000 7fd95a22e9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:40:09.374 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:40:09.376+0000 7fd95a22e9c0 20 zonegroup default 2024-09-14T11:40:09.374 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:40:09.376+0000 7fd95a22e9c0 20 rados->read ofs=0 len=0 2024-09-14T11:40:09.375 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:40:09.376+0000 7fd95a22e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:40:09.375 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:40:09.376+0000 7fd95a22e9c0 20 rados->read ofs=0 len=0 2024-09-14T11:40:09.375 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:40:09.376+0000 7fd95a22e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:40:09.375 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:40:09.376+0000 7fd95a22e9c0 20 rados->read ofs=0 len=0 2024-09-14T11:40:09.376 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:40:09.380+0000 7fd95a22e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:40:09.376 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:40:09.380+0000 7fd95a22e9c0 20 started sync module instance, tier type = 2024-09-14T11:40:09.376 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:40:09.380+0000 7fd95a22e9c0 20 started zone id=d9e72d30-c60b-4d0d-9267-fdc36392d5ad (name=default) with tier type = 2024-09-14T11:40:09.397 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:40:09.400+0000 7fd95a22e9c0 20 add_watcher() i=0 2024-09-14T11:40:09.397 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:40:09.400+0000 7fd95a22e9c0 20 add_watcher() i=1 2024-09-14T11:40:09.397 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:40:09.400+0000 7fd95a22e9c0 20 add_watcher() i=2 2024-09-14T11:40:09.398 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:40:09.400+0000 7fd95a22e9c0 20 add_watcher() i=3 2024-09-14T11:40:09.398 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:40:09.400+0000 7fd95a22e9c0 20 add_watcher() i=4 2024-09-14T11:40:09.398 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:40:09.400+0000 7fd95a22e9c0 20 add_watcher() i=5 2024-09-14T11:40:09.398 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:40:09.400+0000 7fd95a22e9c0 20 add_watcher() i=6 2024-09-14T11:40:09.400 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:40:09.404+0000 7fd95a22e9c0 20 add_watcher() i=7 2024-09-14T11:40:09.400 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:40:09.404+0000 7fd95a22e9c0 2 all 8 watchers are set, enabling cache 2024-09-14T11:40:09.404 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:40:09.404+0000 7fd80dfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:40:09.405 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:40:09.408+0000 7fd95a22e9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:40:09.405 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:40:09.408+0000 7fd95a22e9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:40:09.405 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:40:09.408+0000 7fd95a22e9c0 5 note: GC not initialized 2024-09-14T11:40:09.405 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:40:09.408+0000 7fd80cfe1640 20 reqs_thread_entry: start 2024-09-14T11:40:09.405 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:40:09.408+0000 7fd95a22e9c0 20 init_complete bucket index max shards: 11 2024-09-14T11:40:09.406 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:40:09.408+0000 7fd95a22e9c0 20 Filter name: none 2024-09-14T11:40:09.406 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:40:09.408+0000 7fd7867fc640 20 reqs_thread_entry: start 2024-09-14T11:40:09.406 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:40:09.408+0000 7fd95a22e9c0 20 rados->read ofs=0 len=0 2024-09-14T11:40:09.407 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:40:09.408+0000 7fd95a22e9c0 20 rados_obj.operate() r=0 bl.length=176 2024-09-14T11:40:09.407 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:40:09.408+0000 7fd95a22e9c0 20 rados->read ofs=0 len=0 2024-09-14T11:40:09.408 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:40:09.412+0000 7fd95a22e9c0 20 rados_obj.operate() r=0 bl.length=398 2024-09-14T11:40:09.408 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:40:09.412+0000 7fd95a22e9c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:40:09.408 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:40:09.412+0000 7fd95a22e9c0 20 rados->read ofs=0 len=0 2024-09-14T11:40:09.409 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:40:09.412+0000 7fd95a22e9c0 20 rados_obj.operate() r=0 bl.length=176 2024-09-14T11:40:09.409 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:40:09.412+0000 7fd95a22e9c0 20 rados->read ofs=0 len=0 2024-09-14T11:40:09.410 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:40:09.412+0000 7fd95a22e9c0 20 rados_obj.operate() r=0 bl.length=398 2024-09-14T11:40:09.411 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:40:09.412+0000 7fd95a22e9c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:40:09.414 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:40:09.416+0000 7fd80dfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:40:09.419 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:40:09.420+0000 7fd95a22e9c0 20 remove_watcher() i=0 2024-09-14T11:40:09.419 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:40:09.420+0000 7fd95a22e9c0 2 removed watcher, disabling cache 2024-09-14T11:40:09.421 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:40:09.424+0000 7fd95a22e9c0 20 remove_watcher() i=1 2024-09-14T11:40:09.423 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:40:09.424+0000 7fd95a22e9c0 20 remove_watcher() i=2 2024-09-14T11:40:09.425 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:40:09.428+0000 7fd95a22e9c0 20 remove_watcher() i=3 2024-09-14T11:40:09.427 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:40:09.428+0000 7fd95a22e9c0 20 remove_watcher() i=4 2024-09-14T11:40:09.429 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:40:09.432+0000 7fd95a22e9c0 20 remove_watcher() i=5 2024-09-14T11:40:09.431 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:40:09.432+0000 7fd95a22e9c0 20 remove_watcher() i=6 2024-09-14T11:40:09.432 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:40:09.436+0000 7fd95a22e9c0 20 remove_watcher() i=7 2024-09-14T11:40:09.450 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-14T11:40:09.450 INFO:tasks.workunit.client.0.smithi138.stderr:BUCKET_STATS: 2024-09-14T11:40:09.450 INFO:tasks.workunit.client.0.smithi138.stderr:bucket: a-bucket id: d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.17 num_objects: 10 size_kb: 1 num_shards: 13 2024-09-14T11:40:09.450 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-14T11:40:09.451 INFO:tasks.workunit.client.0.smithi138.stderr:radosgw-admin bucket reshard --bucket a-bucket --num-shards 14 --rgw-reshard-bucket-lock-duration 30 --inject-abort-at do_reshard 2024-09-14T11:40:09.486 INFO:tasks.workunit.client.0.smithi138.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:40:09.486 INFO:tasks.workunit.client.0.smithi138.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:40:09.530 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:40:09.532+0000 7f7a769219c0 20 rados->read ofs=0 len=0 2024-09-14T11:40:09.532 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:40:09.536+0000 7f7a769219c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:40:09.532 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:40:09.536+0000 7f7a769219c0 20 realm 2024-09-14T11:40:09.533 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:40:09.536+0000 7f7a769219c0 20 rados->read ofs=0 len=0 2024-09-14T11:40:09.533 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:40:09.536+0000 7f7a769219c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:40:09.533 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:40:09.536+0000 7f7a769219c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:40:09.533 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:40:09.536+0000 7f7a769219c0 20 rados->read ofs=0 len=0 2024-09-14T11:40:09.533 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:40:09.536+0000 7f7a769219c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:40:09.533 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:40:09.536+0000 7f7a769219c0 20 rados->read ofs=0 len=0 2024-09-14T11:40:09.534 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:40:09.536+0000 7f7a769219c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:40:09.534 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:40:09.536+0000 7f7a769219c0 20 rados->read ofs=0 len=0 2024-09-14T11:40:09.535 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:40:09.536+0000 7f7a769219c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:40:09.535 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:40:09.536+0000 7f7a769219c0 20 searching for the correct realm 2024-09-14T11:40:09.538 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:40:09.540+0000 7f7a74c28640 0 -- 172.21.15.138:0/2740999781 >> [v2:172.21.15.154:6824/416768175,v1:172.21.15.154:6825/416768175] conn(0x7f7a6c044060 msgr2=0x7f7a6c086270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:40:09.753 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:40:09.756+0000 7f7a73c26640 0 -- 172.21.15.138:0/2740999781 >> [v2:172.21.15.138:6816/326481658,v1:172.21.15.138:6817/326481658] conn(0x7f7a6c09b090 msgr2=0x7f7a6c0274f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:40:09.972 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:40:09.972+0000 7f7a769219c0 20 RGWRados::pool_iterate: got zone_info.d9e72d30-c60b-4d0d-9267-fdc36392d5ad 2024-09-14T11:40:09.972 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:40:09.972+0000 7f7a769219c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:40:09.972 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:40:09.972+0000 7f7a769219c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:40:09.972 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:40:09.972+0000 7f7a769219c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:40:09.972 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:40:09.972+0000 7f7a769219c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:40:09.972 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:40:09.972+0000 7f7a769219c0 20 RGWRados::pool_iterate: got zonegroup_info.65ab941b-da8c-4160-94fb-3672b069d44f 2024-09-14T11:40:09.972 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:40:09.972+0000 7f7a769219c0 20 rados->read ofs=0 len=0 2024-09-14T11:40:09.973 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:40:09.976+0000 7f7a769219c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:40:09.973 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:40:09.976+0000 7f7a769219c0 20 rados->read ofs=0 len=0 2024-09-14T11:40:09.973 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:40:09.976+0000 7f7a769219c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:40:09.973 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:40:09.976+0000 7f7a769219c0 20 rados->read ofs=0 len=0 2024-09-14T11:40:09.975 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:40:09.976+0000 7f7a769219c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:40:09.975 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:40:09.976+0000 7f7a769219c0 20 zone default found 2024-09-14T11:40:09.975 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:40:09.976+0000 7f7a769219c0 4 Realm: () 2024-09-14T11:40:09.975 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:40:09.976+0000 7f7a769219c0 4 ZoneGroup: default (65ab941b-da8c-4160-94fb-3672b069d44f) 2024-09-14T11:40:09.975 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:40:09.976+0000 7f7a769219c0 4 Zone: default (d9e72d30-c60b-4d0d-9267-fdc36392d5ad) 2024-09-14T11:40:09.975 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:40:09.976+0000 7f7a769219c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:40:09.975 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:40:09.976+0000 7f7a769219c0 20 zonegroup default 2024-09-14T11:40:09.975 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:40:09.976+0000 7f7a769219c0 20 rados->read ofs=0 len=0 2024-09-14T11:40:09.976 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:40:09.976+0000 7f7a769219c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:40:09.976 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:40:09.976+0000 7f7a769219c0 20 rados->read ofs=0 len=0 2024-09-14T11:40:09.976 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:40:09.980+0000 7f7a769219c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:40:09.976 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:40:09.980+0000 7f7a769219c0 20 rados->read ofs=0 len=0 2024-09-14T11:40:09.977 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:40:09.980+0000 7f7a769219c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:40:09.977 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:40:09.980+0000 7f7a769219c0 20 started sync module instance, tier type = 2024-09-14T11:40:09.977 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:40:09.980+0000 7f7a769219c0 20 started zone id=d9e72d30-c60b-4d0d-9267-fdc36392d5ad (name=default) with tier type = 2024-09-14T11:40:10.000 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:40:10.000+0000 7f7a769219c0 20 add_watcher() i=0 2024-09-14T11:40:10.000 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:40:10.000+0000 7f7a769219c0 20 add_watcher() i=1 2024-09-14T11:40:10.000 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:40:10.004+0000 7f7a769219c0 20 add_watcher() i=2 2024-09-14T11:40:10.000 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:40:10.004+0000 7f7a769219c0 20 add_watcher() i=3 2024-09-14T11:40:10.000 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:40:10.004+0000 7f7a769219c0 20 add_watcher() i=4 2024-09-14T11:40:10.000 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:40:10.004+0000 7f7a769219c0 20 add_watcher() i=5 2024-09-14T11:40:10.000 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:40:10.004+0000 7f7a769219c0 20 add_watcher() i=6 2024-09-14T11:40:10.001 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:40:10.004+0000 7f7a769219c0 20 add_watcher() i=7 2024-09-14T11:40:10.002 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:40:10.004+0000 7f7a769219c0 2 all 8 watchers are set, enabling cache 2024-09-14T11:40:10.005 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:40:10.008+0000 7f792afdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:40:10.005 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:40:10.008+0000 7f7a769219c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:40:10.006 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:40:10.008+0000 7f7a769219c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:40:10.006 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:40:10.008+0000 7f7a769219c0 5 note: GC not initialized 2024-09-14T11:40:10.006 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:40:10.008+0000 7f7929fdb640 20 reqs_thread_entry: start 2024-09-14T11:40:10.006 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:40:10.008+0000 7f7a769219c0 20 init_complete bucket index max shards: 11 2024-09-14T11:40:10.007 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:40:10.008+0000 7f7a769219c0 20 Filter name: none 2024-09-14T11:40:10.007 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:40:10.008+0000 7f789b7fe640 20 reqs_thread_entry: start 2024-09-14T11:40:10.007 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:40:10.008+0000 7f7a769219c0 10 cache get: name=default.rgw.meta+root+a-bucket : miss 2024-09-14T11:40:10.007 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:40:10.008+0000 7f7a769219c0 20 rados->read ofs=0 len=0 2024-09-14T11:40:10.007 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:40:10.008+0000 7f7a769219c0 20 rados_obj.operate() r=0 bl.length=176 2024-09-14T11:40:10.008 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:40:10.008+0000 7f7a769219c0 10 cache put: name=default.rgw.meta+root+a-bucket info.flags=0x11 2024-09-14T11:40:10.008 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:40:10.008+0000 7f7a769219c0 10 adding default.rgw.meta+root+a-bucket to cache LRU end 2024-09-14T11:40:10.008 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:40:10.008+0000 7f7a769219c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.17 : miss 2024-09-14T11:40:10.008 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:40:10.008+0000 7f7a769219c0 20 rados->read ofs=0 len=0 2024-09-14T11:40:10.008 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:40:10.012+0000 7f7a769219c0 20 rados_obj.operate() r=0 bl.length=398 2024-09-14T11:40:10.009 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:40:10.012+0000 7f7a769219c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.17 info.flags=0x17 2024-09-14T11:40:10.009 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:40:10.012+0000 7f7a769219c0 10 adding default.rgw.meta+root+.bucket.meta.a-bucket:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.17 to cache LRU end 2024-09-14T11:40:10.009 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:40:10.012+0000 7f7a769219c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:40:10.009 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:40:10.012+0000 7f7a769219c0 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-14T11:40:10.009 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:40:10.012+0000 7f7a769219c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.17 2024-09-14T11:40:10.024 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:40:10.028+0000 7f7a769219c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.17 info.flags=0x17 2024-09-14T11:40:10.024 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:40:10.028+0000 7f7a769219c0 10 moving default.rgw.meta+root+.bucket.meta.a-bucket:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.17 to cache LRU end 2024-09-14T11:40:10.024 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:40:10.028+0000 7f7a769219c0 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-14T11:40:10.024 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:40:10.028+0000 7f7a769219c0 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.a-bucket:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.17, ofs0, ns] 2024-09-14T11:40:10.025 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:40:10.028+0000 7f794affd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366241 cookie 94506902665136 notifier 8148 bl.length()=827 2024-09-14T11:40:10.025 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:40:10.028+0000 7f794affd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.17 info.flags=0x17 2024-09-14T11:40:10.025 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:40:10.028+0000 7f794affd640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.a-bucket:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.17 to cache LRU end 2024-09-14T11:40:10.025 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:40:10.028+0000 7f794affd640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=143 2024-09-14T11:40:10.027 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:40:10.028+0000 7f7a769219c0 20 handle_bi_update(): bucket=:a-bucket[d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.17]): orig_sources= new_sources= 2024-09-14T11:40:10.027 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:40:10.028+0000 7f7a769219c0 20 handle_bi_update(): bucket=:a-bucket[d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.17]): potential sources added=[] removed=[] 2024-09-14T11:40:10.028 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:40:10.028+0000 7f7a769219c0 20 handle_bi_update(): bucket=:a-bucket[d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.17]): orig_dests= new_dests= 2024-09-14T11:40:10.028 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:40:10.028+0000 7f7a769219c0 20 handle_bi_update(): bucket=:a-bucket[d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.17]): potential dests added=[] removed=[] 2024-09-14T11:40:10.037 INFO:tasks.workunit.client.0.smithi138.stderr:./src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f7a769219c0 time 2024-09-14T11:40:10.042582+0000 2024-09-14T11:40:10.037 INFO:tasks.workunit.client.0.smithi138.stderr:./src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-14T11:40:10.038 INFO:tasks.workunit.client.0.smithi138.stderr: ceph version 19.3.0-4907-ga2782315 (a2782315255a3e7d5f6cdc9eb35785187ff6ddf8) squid (dev) 2024-09-14T11:40:10.039 INFO:tasks.workunit.client.0.smithi138.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x121) [0x7f7a7a1fb2eb] 2024-09-14T11:40:10.039 INFO:tasks.workunit.client.0.smithi138.stderr: 2: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7f7a7a1fb49f] 2024-09-14T11:40:10.039 INFO:tasks.workunit.client.0.smithi138.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55f418b18c01] 2024-09-14T11:40:10.039 INFO:tasks.workunit.client.0.smithi138.stderr: 4: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x17a) [0x55f418b2df3a] 2024-09-14T11:40:10.039 INFO:tasks.workunit.client.0.smithi138.stderr: 5: main() 2024-09-14T11:40:10.039 INFO:tasks.workunit.client.0.smithi138.stderr: 6: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7f7a79061d90] 2024-09-14T11:40:10.039 INFO:tasks.workunit.client.0.smithi138.stderr: 7: __libc_start_main() 2024-09-14T11:40:10.039 INFO:tasks.workunit.client.0.smithi138.stderr: 8: _start() 2024-09-14T11:40:10.039 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:40:10.040+0000 7f7a769219c0 -1 ./src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f7a769219c0 time 2024-09-14T11:40:10.042582+0000 2024-09-14T11:40:10.039 INFO:tasks.workunit.client.0.smithi138.stderr:./src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-14T11:40:10.039 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-14T11:40:10.040 INFO:tasks.workunit.client.0.smithi138.stderr: ceph version 19.3.0-4907-ga2782315 (a2782315255a3e7d5f6cdc9eb35785187ff6ddf8) squid (dev) 2024-09-14T11:40:10.040 INFO:tasks.workunit.client.0.smithi138.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x121) [0x7f7a7a1fb2eb] 2024-09-14T11:40:10.040 INFO:tasks.workunit.client.0.smithi138.stderr: 2: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7f7a7a1fb49f] 2024-09-14T11:40:10.040 INFO:tasks.workunit.client.0.smithi138.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55f418b18c01] 2024-09-14T11:40:10.040 INFO:tasks.workunit.client.0.smithi138.stderr: 4: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x17a) [0x55f418b2df3a] 2024-09-14T11:40:10.040 INFO:tasks.workunit.client.0.smithi138.stderr: 5: main() 2024-09-14T11:40:10.040 INFO:tasks.workunit.client.0.smithi138.stderr: 6: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7f7a79061d90] 2024-09-14T11:40:10.040 INFO:tasks.workunit.client.0.smithi138.stderr: 7: __libc_start_main() 2024-09-14T11:40:10.040 INFO:tasks.workunit.client.0.smithi138.stderr: 8: _start() 2024-09-14T11:40:10.040 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-14T11:40:10.040 INFO:tasks.workunit.client.0.smithi138.stderr:*** Caught signal (Aborted) ** 2024-09-14T11:40:10.040 INFO:tasks.workunit.client.0.smithi138.stderr: in thread 7f7a769219c0 thread_name:radosgw-admin 2024-09-14T11:40:10.057 INFO:tasks.workunit.client.0.smithi138.stderr: ceph version 19.3.0-4907-ga2782315 (a2782315255a3e7d5f6cdc9eb35785187ff6ddf8) squid (dev) 2024-09-14T11:40:10.057 INFO:tasks.workunit.client.0.smithi138.stderr: 1: /lib/x86_64-linux-gnu/libc.so.6(+0x42520) [0x7f7a7907a520] 2024-09-14T11:40:10.057 INFO:tasks.workunit.client.0.smithi138.stderr: 2: pthread_kill() 2024-09-14T11:40:10.057 INFO:tasks.workunit.client.0.smithi138.stderr: 3: raise() 2024-09-14T11:40:10.057 INFO:tasks.workunit.client.0.smithi138.stderr: 4: abort() 2024-09-14T11:40:10.057 INFO:tasks.workunit.client.0.smithi138.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x17b) [0x7f7a7a1fb345] 2024-09-14T11:40:10.057 INFO:tasks.workunit.client.0.smithi138.stderr: 6: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7f7a7a1fb49f] 2024-09-14T11:40:10.057 INFO:tasks.workunit.client.0.smithi138.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55f418b18c01] 2024-09-14T11:40:10.058 INFO:tasks.workunit.client.0.smithi138.stderr: 8: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x17a) [0x55f418b2df3a] 2024-09-14T11:40:10.058 INFO:tasks.workunit.client.0.smithi138.stderr: 9: main() 2024-09-14T11:40:10.058 INFO:tasks.workunit.client.0.smithi138.stderr: 10: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7f7a79061d90] 2024-09-14T11:40:10.058 INFO:tasks.workunit.client.0.smithi138.stderr: 11: __libc_start_main() 2024-09-14T11:40:10.058 INFO:tasks.workunit.client.0.smithi138.stderr: 12: _start() 2024-09-14T11:40:10.058 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:40:10.040+0000 7f7a769219c0 -1 *** Caught signal (Aborted) ** 2024-09-14T11:40:10.058 INFO:tasks.workunit.client.0.smithi138.stderr: in thread 7f7a769219c0 thread_name:radosgw-admin 2024-09-14T11:40:10.058 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-14T11:40:10.058 INFO:tasks.workunit.client.0.smithi138.stderr: ceph version 19.3.0-4907-ga2782315 (a2782315255a3e7d5f6cdc9eb35785187ff6ddf8) squid (dev) 2024-09-14T11:40:10.058 INFO:tasks.workunit.client.0.smithi138.stderr: 1: /lib/x86_64-linux-gnu/libc.so.6(+0x42520) [0x7f7a7907a520] 2024-09-14T11:40:10.058 INFO:tasks.workunit.client.0.smithi138.stderr: 2: pthread_kill() 2024-09-14T11:40:10.058 INFO:tasks.workunit.client.0.smithi138.stderr: 3: raise() 2024-09-14T11:40:10.058 INFO:tasks.workunit.client.0.smithi138.stderr: 4: abort() 2024-09-14T11:40:10.059 INFO:tasks.workunit.client.0.smithi138.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x17b) [0x7f7a7a1fb345] 2024-09-14T11:40:10.059 INFO:tasks.workunit.client.0.smithi138.stderr: 6: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7f7a7a1fb49f] 2024-09-14T11:40:10.059 INFO:tasks.workunit.client.0.smithi138.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55f418b18c01] 2024-09-14T11:40:10.059 INFO:tasks.workunit.client.0.smithi138.stderr: 8: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x17a) [0x55f418b2df3a] 2024-09-14T11:40:10.059 INFO:tasks.workunit.client.0.smithi138.stderr: 9: main() 2024-09-14T11:40:10.059 INFO:tasks.workunit.client.0.smithi138.stderr: 10: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7f7a79061d90] 2024-09-14T11:40:10.059 INFO:tasks.workunit.client.0.smithi138.stderr: 11: __libc_start_main() 2024-09-14T11:40:10.059 INFO:tasks.workunit.client.0.smithi138.stderr: 12: _start() 2024-09-14T11:40:10.059 INFO:tasks.workunit.client.0.smithi138.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-14T11:40:10.059 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-14T11:40:10.059 INFO:tasks.workunit.client.0.smithi138.stderr:--- begin dump of recent events --- 2024-09-14T11:40:10.059 INFO:tasks.workunit.client.0.smithi138.stderr: -499> 2024-09-14T11:40:09.508+0000 7f7a74c28640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.138:3300/0 2024-09-14T11:40:10.059 INFO:tasks.workunit.client.0.smithi138.stderr: -498> 2024-09-14T11:40:09.508+0000 7f796260c640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:40:10.059 INFO:tasks.workunit.client.0.smithi138.stderr: -497> 2024-09-14T11:40:09.508+0000 7f796260c640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-14T11:40:10.059 INFO:tasks.workunit.client.0.smithi138.stderr: -496> 2024-09-14T11:40:09.508+0000 7f796260c640 10 monclient: dump: 2024-09-14T11:40:10.060 INFO:tasks.workunit.client.0.smithi138.stderr:epoch 1 2024-09-14T11:40:10.060 INFO:tasks.workunit.client.0.smithi138.stderr:fsid 3f225f43-83a6-4aeb-b798-1f04bb49d597 2024-09-14T11:40:10.060 INFO:tasks.workunit.client.0.smithi138.stderr:last_changed 2024-09-14T11:07:09.252780+0000 2024-09-14T11:40:10.060 INFO:tasks.workunit.client.0.smithi138.stderr:created 2024-09-14T11:07:09.252780+0000 2024-09-14T11:40:10.060 INFO:tasks.workunit.client.0.smithi138.stderr:min_mon_release 19 (squid) 2024-09-14T11:40:10.060 INFO:tasks.workunit.client.0.smithi138.stderr:election_strategy: 1 2024-09-14T11:40:10.060 INFO:tasks.workunit.client.0.smithi138.stderr:0: [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] mon.a 2024-09-14T11:40:10.060 INFO:tasks.workunit.client.0.smithi138.stderr:1: [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] mon.b 2024-09-14T11:40:10.060 INFO:tasks.workunit.client.0.smithi138.stderr:2: [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] mon.c 2024-09-14T11:40:10.060 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-14T11:40:10.060 INFO:tasks.workunit.client.0.smithi138.stderr: -495> 2024-09-14T11:40:09.508+0000 7f796260c640 10 monclient: _finish_auth 0 2024-09-14T11:40:10.060 INFO:tasks.workunit.client.0.smithi138.stderr: -494> 2024-09-14T11:40:09.508+0000 7f796260c640 10 monclient: _check_auth_tickets 2024-09-14T11:40:10.060 INFO:tasks.workunit.client.0.smithi138.stderr: -493> 2024-09-14T11:40:09.508+0000 7f796260c640 10 monclient: handle_config config(0 keys) 2024-09-14T11:40:10.061 INFO:tasks.workunit.client.0.smithi138.stderr: -492> 2024-09-14T11:40:09.508+0000 7f7a769219c0 5 monclient: authenticate success, global_id 8136 2024-09-14T11:40:10.061 INFO:tasks.workunit.client.0.smithi138.stderr: -491> 2024-09-14T11:40:09.508+0000 7f7a769219c0 10 monclient: get_monmap_and_config success 2024-09-14T11:40:10.061 INFO:tasks.workunit.client.0.smithi138.stderr: -490> 2024-09-14T11:40:09.508+0000 7f7a769219c0 4 set_mon_vals no callback set 2024-09-14T11:40:10.061 INFO:tasks.workunit.client.0.smithi138.stderr: -489> 2024-09-14T11:40:09.508+0000 7f796260c640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:40:10.061 INFO:tasks.workunit.client.0.smithi138.stderr: -488> 2024-09-14T11:40:09.508+0000 7f796260c640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-14T11:40:10.061 INFO:tasks.workunit.client.0.smithi138.stderr: -487> 2024-09-14T11:40:09.508+0000 7f796260c640 10 monclient: dump: 2024-09-14T11:40:10.061 INFO:tasks.workunit.client.0.smithi138.stderr:epoch 1 2024-09-14T11:40:10.061 INFO:tasks.workunit.client.0.smithi138.stderr:fsid 3f225f43-83a6-4aeb-b798-1f04bb49d597 2024-09-14T11:40:10.061 INFO:tasks.workunit.client.0.smithi138.stderr:last_changed 2024-09-14T11:07:09.252780+0000 2024-09-14T11:40:10.061 INFO:tasks.workunit.client.0.smithi138.stderr:created 2024-09-14T11:07:09.252780+0000 2024-09-14T11:40:10.061 INFO:tasks.workunit.client.0.smithi138.stderr:min_mon_release 19 (squid) 2024-09-14T11:40:10.061 INFO:tasks.workunit.client.0.smithi138.stderr:election_strategy: 1 2024-09-14T11:40:10.061 INFO:tasks.workunit.client.0.smithi138.stderr:0: [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] mon.a 2024-09-14T11:40:10.061 INFO:tasks.workunit.client.0.smithi138.stderr:1: [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] mon.b 2024-09-14T11:40:10.062 INFO:tasks.workunit.client.0.smithi138.stderr:2: [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] mon.c 2024-09-14T11:40:10.062 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-14T11:40:10.062 INFO:tasks.workunit.client.0.smithi138.stderr: -486> 2024-09-14T11:40:09.512+0000 7f7a769219c0 10 monclient: shutdown 2024-09-14T11:40:10.062 INFO:tasks.workunit.client.0.smithi138.stderr: -485> 2024-09-14T11:40:09.512+0000 7f7a769219c0 5 asok(0x55f41a2bfd90) unregister_commands rotate-key 2024-09-14T11:40:10.062 INFO:tasks.workunit.client.0.smithi138.stderr: -484> 2024-09-14T11:40:09.512+0000 7f7a769219c0 10 monclient: build_initial_monmap 2024-09-14T11:40:10.062 INFO:tasks.workunit.client.0.smithi138.stderr: -483> 2024-09-14T11:40:09.512+0000 7f7a769219c0 1 build_initial for_mkfs: 0 2024-09-14T11:40:10.062 INFO:tasks.workunit.client.0.smithi138.stderr: -482> 2024-09-14T11:40:09.512+0000 7f7a769219c0 10 monclient: monmap: 2024-09-14T11:40:10.062 INFO:tasks.workunit.client.0.smithi138.stderr:epoch 0 2024-09-14T11:40:10.062 INFO:tasks.workunit.client.0.smithi138.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-14T11:40:10.062 INFO:tasks.workunit.client.0.smithi138.stderr:last_changed 0.000000 2024-09-14T11:40:10.062 INFO:tasks.workunit.client.0.smithi138.stderr:created 0.000000 2024-09-14T11:40:10.062 INFO:tasks.workunit.client.0.smithi138.stderr:min_mon_release 0 (unknown) 2024-09-14T11:40:10.062 INFO:tasks.workunit.client.0.smithi138.stderr:election_strategy: 1 2024-09-14T11:40:10.062 INFO:tasks.workunit.client.0.smithi138.stderr:0: [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] mon.noname-a 2024-09-14T11:40:10.062 INFO:tasks.workunit.client.0.smithi138.stderr:1: [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] mon.noname-b 2024-09-14T11:40:10.063 INFO:tasks.workunit.client.0.smithi138.stderr:2: [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] mon.noname-c 2024-09-14T11:40:10.063 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-14T11:40:10.063 INFO:tasks.workunit.client.0.smithi138.stderr: -481> 2024-09-14T11:40:09.512+0000 7f7a769219c0 5 AuthRegistry(0x55f41a4cca40) adding auth protocol: cephx 2024-09-14T11:40:10.063 INFO:tasks.workunit.client.0.smithi138.stderr: -480> 2024-09-14T11:40:09.512+0000 7f7a769219c0 5 AuthRegistry(0x55f41a4cca40) adding auth protocol: cephx 2024-09-14T11:40:10.063 INFO:tasks.workunit.client.0.smithi138.stderr: -479> 2024-09-14T11:40:09.512+0000 7f7a769219c0 5 AuthRegistry(0x55f41a4cca40) adding auth protocol: cephx 2024-09-14T11:40:10.063 INFO:tasks.workunit.client.0.smithi138.stderr: -478> 2024-09-14T11:40:09.512+0000 7f7a769219c0 5 AuthRegistry(0x55f41a4cca40) adding con mode: secure 2024-09-14T11:40:10.063 INFO:tasks.workunit.client.0.smithi138.stderr: -477> 2024-09-14T11:40:09.512+0000 7f7a769219c0 5 AuthRegistry(0x55f41a4cca40) adding con mode: crc 2024-09-14T11:40:10.063 INFO:tasks.workunit.client.0.smithi138.stderr: -476> 2024-09-14T11:40:09.512+0000 7f7a769219c0 5 AuthRegistry(0x55f41a4cca40) adding con mode: secure 2024-09-14T11:40:10.063 INFO:tasks.workunit.client.0.smithi138.stderr: -475> 2024-09-14T11:40:09.512+0000 7f7a769219c0 5 AuthRegistry(0x55f41a4cca40) adding con mode: crc 2024-09-14T11:40:10.063 INFO:tasks.workunit.client.0.smithi138.stderr: -474> 2024-09-14T11:40:09.512+0000 7f7a769219c0 5 AuthRegistry(0x55f41a4cca40) adding con mode: secure 2024-09-14T11:40:10.063 INFO:tasks.workunit.client.0.smithi138.stderr: -473> 2024-09-14T11:40:09.512+0000 7f7a769219c0 5 AuthRegistry(0x55f41a4cca40) adding con mode: crc 2024-09-14T11:40:10.063 INFO:tasks.workunit.client.0.smithi138.stderr: -472> 2024-09-14T11:40:09.512+0000 7f7a769219c0 5 AuthRegistry(0x55f41a4cca40) adding con mode: crc 2024-09-14T11:40:10.063 INFO:tasks.workunit.client.0.smithi138.stderr: -471> 2024-09-14T11:40:09.512+0000 7f7a769219c0 5 AuthRegistry(0x55f41a4cca40) adding con mode: secure 2024-09-14T11:40:10.063 INFO:tasks.workunit.client.0.smithi138.stderr: -470> 2024-09-14T11:40:09.512+0000 7f7a769219c0 5 AuthRegistry(0x55f41a4cca40) adding con mode: crc 2024-09-14T11:40:10.063 INFO:tasks.workunit.client.0.smithi138.stderr: -469> 2024-09-14T11:40:09.512+0000 7f7a769219c0 5 AuthRegistry(0x55f41a4cca40) adding con mode: secure 2024-09-14T11:40:10.063 INFO:tasks.workunit.client.0.smithi138.stderr: -468> 2024-09-14T11:40:09.512+0000 7f7a769219c0 5 AuthRegistry(0x55f41a4cca40) adding con mode: crc 2024-09-14T11:40:10.064 INFO:tasks.workunit.client.0.smithi138.stderr: -467> 2024-09-14T11:40:09.512+0000 7f7a769219c0 5 AuthRegistry(0x55f41a4cca40) adding con mode: secure 2024-09-14T11:40:10.064 INFO:tasks.workunit.client.0.smithi138.stderr: -466> 2024-09-14T11:40:09.512+0000 7f7a769219c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:40:10.064 INFO:tasks.workunit.client.0.smithi138.stderr: -465> 2024-09-14T11:40:09.512+0000 7f7a769219c0 1 librados: starting msgr at 2024-09-14T11:40:10.064 INFO:tasks.workunit.client.0.smithi138.stderr: -464> 2024-09-14T11:40:09.512+0000 7f7a769219c0 1 librados: starting objecter 2024-09-14T11:40:10.064 INFO:tasks.workunit.client.0.smithi138.stderr: -463> 2024-09-14T11:40:09.512+0000 7f7a769219c0 5 asok(0x55f41a2bfd90) register_command objecter_requests hook 0x55f41a4cef90 2024-09-14T11:40:10.064 INFO:tasks.workunit.client.0.smithi138.stderr: -462> 2024-09-14T11:40:09.512+0000 7f7a769219c0 1 librados: setting wanted keys 2024-09-14T11:40:10.064 INFO:tasks.workunit.client.0.smithi138.stderr: -461> 2024-09-14T11:40:09.512+0000 7f7a769219c0 1 librados: calling monclient init 2024-09-14T11:40:10.064 INFO:tasks.workunit.client.0.smithi138.stderr: -460> 2024-09-14T11:40:09.512+0000 7f7a769219c0 10 monclient: init 2024-09-14T11:40:10.064 INFO:tasks.workunit.client.0.smithi138.stderr: -459> 2024-09-14T11:40:09.512+0000 7f7a769219c0 5 AuthRegistry(0x55f41a4cac50) adding auth protocol: cephx 2024-09-14T11:40:10.064 INFO:tasks.workunit.client.0.smithi138.stderr: -458> 2024-09-14T11:40:09.512+0000 7f7a769219c0 5 AuthRegistry(0x55f41a4cac50) adding auth protocol: cephx 2024-09-14T11:40:10.064 INFO:tasks.workunit.client.0.smithi138.stderr: -457> 2024-09-14T11:40:09.512+0000 7f7a769219c0 5 AuthRegistry(0x55f41a4cac50) adding auth protocol: cephx 2024-09-14T11:40:10.064 INFO:tasks.workunit.client.0.smithi138.stderr: -456> 2024-09-14T11:40:09.512+0000 7f7a769219c0 5 AuthRegistry(0x55f41a4cac50) adding con mode: secure 2024-09-14T11:40:10.064 INFO:tasks.workunit.client.0.smithi138.stderr: -455> 2024-09-14T11:40:09.512+0000 7f7a769219c0 5 AuthRegistry(0x55f41a4cac50) adding con mode: crc 2024-09-14T11:40:10.064 INFO:tasks.workunit.client.0.smithi138.stderr: -454> 2024-09-14T11:40:09.512+0000 7f7a769219c0 5 AuthRegistry(0x55f41a4cac50) adding con mode: secure 2024-09-14T11:40:10.064 INFO:tasks.workunit.client.0.smithi138.stderr: -453> 2024-09-14T11:40:09.512+0000 7f7a769219c0 5 AuthRegistry(0x55f41a4cac50) adding con mode: crc 2024-09-14T11:40:10.064 INFO:tasks.workunit.client.0.smithi138.stderr: -452> 2024-09-14T11:40:09.512+0000 7f7a769219c0 5 AuthRegistry(0x55f41a4cac50) adding con mode: secure 2024-09-14T11:40:10.065 INFO:tasks.workunit.client.0.smithi138.stderr: -451> 2024-09-14T11:40:09.512+0000 7f7a769219c0 5 AuthRegistry(0x55f41a4cac50) adding con mode: crc 2024-09-14T11:40:10.065 INFO:tasks.workunit.client.0.smithi138.stderr: -450> 2024-09-14T11:40:09.512+0000 7f7a769219c0 5 AuthRegistry(0x55f41a4cac50) adding con mode: crc 2024-09-14T11:40:10.065 INFO:tasks.workunit.client.0.smithi138.stderr: -449> 2024-09-14T11:40:09.512+0000 7f7a769219c0 5 AuthRegistry(0x55f41a4cac50) adding con mode: secure 2024-09-14T11:40:10.065 INFO:tasks.workunit.client.0.smithi138.stderr: -448> 2024-09-14T11:40:09.512+0000 7f7a769219c0 5 AuthRegistry(0x55f41a4cac50) adding con mode: crc 2024-09-14T11:40:10.065 INFO:tasks.workunit.client.0.smithi138.stderr: -447> 2024-09-14T11:40:09.512+0000 7f7a769219c0 5 AuthRegistry(0x55f41a4cac50) adding con mode: secure 2024-09-14T11:40:10.065 INFO:tasks.workunit.client.0.smithi138.stderr: -446> 2024-09-14T11:40:09.512+0000 7f7a769219c0 5 AuthRegistry(0x55f41a4cac50) adding con mode: crc 2024-09-14T11:40:10.065 INFO:tasks.workunit.client.0.smithi138.stderr: -445> 2024-09-14T11:40:09.512+0000 7f7a769219c0 5 AuthRegistry(0x55f41a4cac50) adding con mode: secure 2024-09-14T11:40:10.065 INFO:tasks.workunit.client.0.smithi138.stderr: -444> 2024-09-14T11:40:09.512+0000 7f7a769219c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:40:10.065 INFO:tasks.workunit.client.0.smithi138.stderr: -443> 2024-09-14T11:40:09.512+0000 7f7a769219c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:40:10.065 INFO:tasks.workunit.client.0.smithi138.stderr: -442> 2024-09-14T11:40:09.512+0000 7f7a769219c0 5 asok(0x55f41a2bfd90) register_command rotate-key hook 0x55f41a4cad98 2024-09-14T11:40:10.065 INFO:tasks.workunit.client.0.smithi138.stderr: -441> 2024-09-14T11:40:09.512+0000 7f7a769219c0 10 monclient: _reopen_session rank -1 2024-09-14T11:40:10.065 INFO:tasks.workunit.client.0.smithi138.stderr: -440> 2024-09-14T11:40:09.512+0000 7f7a769219c0 10 monclient: _add_conns ranks=[0,2,1] 2024-09-14T11:40:10.065 INFO:tasks.workunit.client.0.smithi138.stderr: -439> 2024-09-14T11:40:09.512+0000 7f7a769219c0 10 monclient(hunting): picked mon.noname-a con 0x55f41a37b7f0 addr [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] 2024-09-14T11:40:10.065 INFO:tasks.workunit.client.0.smithi138.stderr: -438> 2024-09-14T11:40:09.512+0000 7f7a769219c0 10 monclient(hunting): picked mon.noname-c con 0x55f41a413800 addr [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] 2024-09-14T11:40:10.065 INFO:tasks.workunit.client.0.smithi138.stderr: -437> 2024-09-14T11:40:09.512+0000 7f7a769219c0 10 monclient(hunting): picked mon.noname-b con 0x55f41a413be0 addr [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] 2024-09-14T11:40:10.066 INFO:tasks.workunit.client.0.smithi138.stderr: -436> 2024-09-14T11:40:09.512+0000 7f7a769219c0 10 monclient(hunting): start opening mon connection 2024-09-14T11:40:10.066 INFO:tasks.workunit.client.0.smithi138.stderr: -435> 2024-09-14T11:40:09.512+0000 7f7a769219c0 10 monclient(hunting): start opening mon connection 2024-09-14T11:40:10.066 INFO:tasks.workunit.client.0.smithi138.stderr: -434> 2024-09-14T11:40:09.512+0000 7f7a769219c0 10 monclient(hunting): start opening mon connection 2024-09-14T11:40:10.066 INFO:tasks.workunit.client.0.smithi138.stderr: -433> 2024-09-14T11:40:09.512+0000 7f7a769219c0 10 monclient(hunting): _renew_subs 2024-09-14T11:40:10.066 INFO:tasks.workunit.client.0.smithi138.stderr: -432> 2024-09-14T11:40:09.512+0000 7f7a769219c0 10 monclient(hunting): authenticate will time out at 2945.473991s 2024-09-14T11:40:10.066 INFO:tasks.workunit.client.0.smithi138.stderr: -431> 2024-09-14T11:40:09.512+0000 7f7a73c26640 10 monclient(hunting): get_auth_request con 0x55f41a413800 auth_method 0 2024-09-14T11:40:10.066 INFO:tasks.workunit.client.0.smithi138.stderr: -430> 2024-09-14T11:40:09.512+0000 7f7a73c26640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:40:10.066 INFO:tasks.workunit.client.0.smithi138.stderr: -429> 2024-09-14T11:40:09.512+0000 7f7a73c26640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:40:10.066 INFO:tasks.workunit.client.0.smithi138.stderr: -428> 2024-09-14T11:40:09.512+0000 7f7a73c26640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:40:10.066 INFO:tasks.workunit.client.0.smithi138.stderr: -427> 2024-09-14T11:40:09.512+0000 7f7a74427640 10 monclient(hunting): get_auth_request con 0x55f41a37b7f0 auth_method 0 2024-09-14T11:40:10.066 INFO:tasks.workunit.client.0.smithi138.stderr: -426> 2024-09-14T11:40:09.512+0000 7f7a74427640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:40:10.066 INFO:tasks.workunit.client.0.smithi138.stderr: -425> 2024-09-14T11:40:09.512+0000 7f7a74427640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:40:10.066 INFO:tasks.workunit.client.0.smithi138.stderr: -424> 2024-09-14T11:40:09.512+0000 7f7a74427640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:40:10.066 INFO:tasks.workunit.client.0.smithi138.stderr: -423> 2024-09-14T11:40:09.512+0000 7f7a74427640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:40:10.066 INFO:tasks.workunit.client.0.smithi138.stderr: -422> 2024-09-14T11:40:09.512+0000 7f7a74427640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:40:10.067 INFO:tasks.workunit.client.0.smithi138.stderr: -421> 2024-09-14T11:40:09.512+0000 7f7a74427640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:40:10.067 INFO:tasks.workunit.client.0.smithi138.stderr: -420> 2024-09-14T11:40:09.512+0000 7f7a73c26640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:40:10.067 INFO:tasks.workunit.client.0.smithi138.stderr: -419> 2024-09-14T11:40:09.512+0000 7f7a73c26640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:40:10.067 INFO:tasks.workunit.client.0.smithi138.stderr: -418> 2024-09-14T11:40:09.512+0000 7f7a73c26640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:40:10.067 INFO:tasks.workunit.client.0.smithi138.stderr: -417> 2024-09-14T11:40:09.512+0000 7f7a74427640 10 monclient(hunting): handle_auth_done global_id 8139 payload 824 2024-09-14T11:40:10.067 INFO:tasks.workunit.client.0.smithi138.stderr: -416> 2024-09-14T11:40:09.512+0000 7f7a74427640 10 monclient: _finish_hunting 0 2024-09-14T11:40:10.067 INFO:tasks.workunit.client.0.smithi138.stderr: -415> 2024-09-14T11:40:09.512+0000 7f7a74427640 1 monclient: found mon.noname-a 2024-09-14T11:40:10.067 INFO:tasks.workunit.client.0.smithi138.stderr: -414> 2024-09-14T11:40:09.512+0000 7f7a74427640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.138:3300/0 2024-09-14T11:40:10.067 INFO:tasks.workunit.client.0.smithi138.stderr: -413> 2024-09-14T11:40:09.512+0000 7f7a74c28640 10 monclient: get_auth_request con 0x55f41a413be0 auth_method 0 2024-09-14T11:40:10.067 INFO:tasks.workunit.client.0.smithi138.stderr: -412> 2024-09-14T11:40:09.512+0000 7f7960e09640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:40:10.067 INFO:tasks.workunit.client.0.smithi138.stderr: -411> 2024-09-14T11:40:09.512+0000 7f7960e09640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-14T11:40:10.067 INFO:tasks.workunit.client.0.smithi138.stderr: -410> 2024-09-14T11:40:09.512+0000 7f7960e09640 10 monclient: dump: 2024-09-14T11:40:10.067 INFO:tasks.workunit.client.0.smithi138.stderr:epoch 1 2024-09-14T11:40:10.067 INFO:tasks.workunit.client.0.smithi138.stderr:fsid 3f225f43-83a6-4aeb-b798-1f04bb49d597 2024-09-14T11:40:10.067 INFO:tasks.workunit.client.0.smithi138.stderr:last_changed 2024-09-14T11:07:09.252780+0000 2024-09-14T11:40:10.067 INFO:tasks.workunit.client.0.smithi138.stderr:created 2024-09-14T11:07:09.252780+0000 2024-09-14T11:40:10.068 INFO:tasks.workunit.client.0.smithi138.stderr:min_mon_release 19 (squid) 2024-09-14T11:40:10.068 INFO:tasks.workunit.client.0.smithi138.stderr:election_strategy: 1 2024-09-14T11:40:10.068 INFO:tasks.workunit.client.0.smithi138.stderr:0: [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] mon.a 2024-09-14T11:40:10.068 INFO:tasks.workunit.client.0.smithi138.stderr:1: [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] mon.b 2024-09-14T11:40:10.068 INFO:tasks.workunit.client.0.smithi138.stderr:2: [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] mon.c 2024-09-14T11:40:10.068 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-14T11:40:10.068 INFO:tasks.workunit.client.0.smithi138.stderr: -409> 2024-09-14T11:40:09.512+0000 7f7960e09640 10 monclient: _finish_auth 0 2024-09-14T11:40:10.068 INFO:tasks.workunit.client.0.smithi138.stderr: -408> 2024-09-14T11:40:09.512+0000 7f7960e09640 10 monclient: _check_auth_tickets 2024-09-14T11:40:10.068 INFO:tasks.workunit.client.0.smithi138.stderr: -407> 2024-09-14T11:40:09.512+0000 7f7960e09640 10 monclient: handle_config config(0 keys) 2024-09-14T11:40:10.068 INFO:tasks.workunit.client.0.smithi138.stderr: -406> 2024-09-14T11:40:09.512+0000 7f7960e09640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:40:10.068 INFO:tasks.workunit.client.0.smithi138.stderr: -405> 2024-09-14T11:40:09.512+0000 7f7960e09640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-14T11:40:10.068 INFO:tasks.workunit.client.0.smithi138.stderr: -404> 2024-09-14T11:40:09.512+0000 7f7960e09640 10 monclient: dump: 2024-09-14T11:40:10.068 INFO:tasks.workunit.client.0.smithi138.stderr:epoch 1 2024-09-14T11:40:10.068 INFO:tasks.workunit.client.0.smithi138.stderr:fsid 3f225f43-83a6-4aeb-b798-1f04bb49d597 2024-09-14T11:40:10.068 INFO:tasks.workunit.client.0.smithi138.stderr:last_changed 2024-09-14T11:07:09.252780+0000 2024-09-14T11:40:10.069 INFO:tasks.workunit.client.0.smithi138.stderr:created 2024-09-14T11:07:09.252780+0000 2024-09-14T11:40:10.069 INFO:tasks.workunit.client.0.smithi138.stderr:min_mon_release 19 (squid) 2024-09-14T11:40:10.069 INFO:tasks.workunit.client.0.smithi138.stderr:election_strategy: 1 2024-09-14T11:40:10.069 INFO:tasks.workunit.client.0.smithi138.stderr:0: [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] mon.a 2024-09-14T11:40:10.069 INFO:tasks.workunit.client.0.smithi138.stderr:1: [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] mon.b 2024-09-14T11:40:10.069 INFO:tasks.workunit.client.0.smithi138.stderr:2: [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] mon.c 2024-09-14T11:40:10.069 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-14T11:40:10.069 INFO:tasks.workunit.client.0.smithi138.stderr: -403> 2024-09-14T11:40:09.512+0000 7f796260c640 4 set_mon_vals no callback set 2024-09-14T11:40:10.069 INFO:tasks.workunit.client.0.smithi138.stderr: -402> 2024-09-14T11:40:09.512+0000 7f7a769219c0 5 monclient: authenticate success, global_id 8139 2024-09-14T11:40:10.069 INFO:tasks.workunit.client.0.smithi138.stderr: -401> 2024-09-14T11:40:09.512+0000 7f7a769219c0 10 monclient: _renew_subs 2024-09-14T11:40:10.069 INFO:tasks.workunit.client.0.smithi138.stderr: -400> 2024-09-14T11:40:09.512+0000 7f7a769219c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.138:3300/0 2024-09-14T11:40:10.069 INFO:tasks.workunit.client.0.smithi138.stderr: -399> 2024-09-14T11:40:09.512+0000 7f7a769219c0 10 monclient: _renew_subs 2024-09-14T11:40:10.069 INFO:tasks.workunit.client.0.smithi138.stderr: -398> 2024-09-14T11:40:09.512+0000 7f7a769219c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.138:3300/0 2024-09-14T11:40:10.069 INFO:tasks.workunit.client.0.smithi138.stderr: -397> 2024-09-14T11:40:09.512+0000 7f7a769219c0 1 librados: init done 2024-09-14T11:40:10.069 INFO:tasks.workunit.client.0.smithi138.stderr: -396> 2024-09-14T11:40:09.516+0000 7f7960e09640 4 mgrc handle_mgr_map Got map version 5 2024-09-14T11:40:10.069 INFO:tasks.workunit.client.0.smithi138.stderr: -395> 2024-09-14T11:40:09.516+0000 7f7960e09640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.138:6832/3778043143,v1:172.21.15.138:6833/3778043143] 2024-09-14T11:40:10.070 INFO:tasks.workunit.client.0.smithi138.stderr: -394> 2024-09-14T11:40:09.516+0000 7f7960e09640 4 mgrc reconnect Starting new session with [v2:172.21.15.138:6832/3778043143,v1:172.21.15.138:6833/3778043143] 2024-09-14T11:40:10.070 INFO:tasks.workunit.client.0.smithi138.stderr: -393> 2024-09-14T11:40:09.516+0000 7f7a73c26640 10 monclient: get_auth_request con 0x7f795c0718a0 auth_method 0 2024-09-14T11:40:10.070 INFO:tasks.workunit.client.0.smithi138.stderr: -392> 2024-09-14T11:40:09.516+0000 7f7a74c28640 10 monclient: get_auth_request con 0x55f41a5129a0 auth_method 0 2024-09-14T11:40:10.070 INFO:tasks.workunit.client.0.smithi138.stderr: -391> 2024-09-14T11:40:09.516+0000 7f7a74427640 10 monclient: get_auth_request con 0x55f41a515b80 auth_method 0 2024-09-14T11:40:10.070 INFO:tasks.workunit.client.0.smithi138.stderr: -390> 2024-09-14T11:40:09.520+0000 7f7a73c26640 10 monclient: get_auth_request con 0x55f41a519d70 auth_method 0 2024-09-14T11:40:10.070 INFO:tasks.workunit.client.0.smithi138.stderr: -389> 2024-09-14T11:40:09.520+0000 7f7a74c28640 10 monclient: get_auth_request con 0x55f41a519450 auth_method 0 2024-09-14T11:40:10.070 INFO:tasks.workunit.client.0.smithi138.stderr: -388> 2024-09-14T11:40:09.520+0000 7f7a769219c0 10 monclient: build_initial_monmap 2024-09-14T11:40:10.070 INFO:tasks.workunit.client.0.smithi138.stderr: -387> 2024-09-14T11:40:09.520+0000 7f7a769219c0 1 build_initial for_mkfs: 0 2024-09-14T11:40:10.070 INFO:tasks.workunit.client.0.smithi138.stderr: -386> 2024-09-14T11:40:09.520+0000 7f7a769219c0 10 monclient: monmap: 2024-09-14T11:40:10.070 INFO:tasks.workunit.client.0.smithi138.stderr:epoch 0 2024-09-14T11:40:10.070 INFO:tasks.workunit.client.0.smithi138.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-14T11:40:10.070 INFO:tasks.workunit.client.0.smithi138.stderr:last_changed 0.000000 2024-09-14T11:40:10.070 INFO:tasks.workunit.client.0.smithi138.stderr:created 0.000000 2024-09-14T11:40:10.070 INFO:tasks.workunit.client.0.smithi138.stderr:min_mon_release 0 (unknown) 2024-09-14T11:40:10.071 INFO:tasks.workunit.client.0.smithi138.stderr:election_strategy: 1 2024-09-14T11:40:10.071 INFO:tasks.workunit.client.0.smithi138.stderr:0: [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] mon.noname-a 2024-09-14T11:40:10.071 INFO:tasks.workunit.client.0.smithi138.stderr:1: [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] mon.noname-b 2024-09-14T11:40:10.071 INFO:tasks.workunit.client.0.smithi138.stderr:2: [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] mon.noname-c 2024-09-14T11:40:10.071 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-14T11:40:10.071 INFO:tasks.workunit.client.0.smithi138.stderr: -385> 2024-09-14T11:40:09.520+0000 7f7a769219c0 5 AuthRegistry(0x55f41a521e80) adding auth protocol: cephx 2024-09-14T11:40:10.071 INFO:tasks.workunit.client.0.smithi138.stderr: -384> 2024-09-14T11:40:09.520+0000 7f7a769219c0 5 AuthRegistry(0x55f41a521e80) adding auth protocol: cephx 2024-09-14T11:40:10.071 INFO:tasks.workunit.client.0.smithi138.stderr: -383> 2024-09-14T11:40:09.520+0000 7f7a769219c0 5 AuthRegistry(0x55f41a521e80) adding auth protocol: cephx 2024-09-14T11:40:10.071 INFO:tasks.workunit.client.0.smithi138.stderr: -382> 2024-09-14T11:40:09.520+0000 7f7a769219c0 5 AuthRegistry(0x55f41a521e80) adding con mode: secure 2024-09-14T11:40:10.071 INFO:tasks.workunit.client.0.smithi138.stderr: -381> 2024-09-14T11:40:09.520+0000 7f7a769219c0 5 AuthRegistry(0x55f41a521e80) adding con mode: crc 2024-09-14T11:40:10.071 INFO:tasks.workunit.client.0.smithi138.stderr: -380> 2024-09-14T11:40:09.520+0000 7f7a769219c0 5 AuthRegistry(0x55f41a521e80) adding con mode: secure 2024-09-14T11:40:10.071 INFO:tasks.workunit.client.0.smithi138.stderr: -379> 2024-09-14T11:40:09.520+0000 7f7a769219c0 5 AuthRegistry(0x55f41a521e80) adding con mode: crc 2024-09-14T11:40:10.071 INFO:tasks.workunit.client.0.smithi138.stderr: -378> 2024-09-14T11:40:09.520+0000 7f7a769219c0 5 AuthRegistry(0x55f41a521e80) adding con mode: secure 2024-09-14T11:40:10.071 INFO:tasks.workunit.client.0.smithi138.stderr: -377> 2024-09-14T11:40:09.520+0000 7f7a769219c0 5 AuthRegistry(0x55f41a521e80) adding con mode: crc 2024-09-14T11:40:10.072 INFO:tasks.workunit.client.0.smithi138.stderr: -376> 2024-09-14T11:40:09.520+0000 7f7a769219c0 5 AuthRegistry(0x55f41a521e80) adding con mode: crc 2024-09-14T11:40:10.072 INFO:tasks.workunit.client.0.smithi138.stderr: -375> 2024-09-14T11:40:09.520+0000 7f7a769219c0 5 AuthRegistry(0x55f41a521e80) adding con mode: secure 2024-09-14T11:40:10.072 INFO:tasks.workunit.client.0.smithi138.stderr: -374> 2024-09-14T11:40:09.520+0000 7f7a769219c0 5 AuthRegistry(0x55f41a521e80) adding con mode: crc 2024-09-14T11:40:10.072 INFO:tasks.workunit.client.0.smithi138.stderr: -373> 2024-09-14T11:40:09.520+0000 7f7a769219c0 5 AuthRegistry(0x55f41a521e80) adding con mode: secure 2024-09-14T11:40:10.072 INFO:tasks.workunit.client.0.smithi138.stderr: -372> 2024-09-14T11:40:09.520+0000 7f7a769219c0 5 AuthRegistry(0x55f41a521e80) adding con mode: crc 2024-09-14T11:40:10.072 INFO:tasks.workunit.client.0.smithi138.stderr: -371> 2024-09-14T11:40:09.520+0000 7f7a769219c0 5 AuthRegistry(0x55f41a521e80) adding con mode: secure 2024-09-14T11:40:10.072 INFO:tasks.workunit.client.0.smithi138.stderr: -370> 2024-09-14T11:40:09.520+0000 7f7a769219c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:40:10.072 INFO:tasks.workunit.client.0.smithi138.stderr: -369> 2024-09-14T11:40:09.520+0000 7f7a769219c0 5 asok(0x55f41a2bfd90) register_command objecter_requests cmddesc objecter_requests hook 0x55f41a525870 EEXIST 2024-09-14T11:40:10.072 INFO:tasks.workunit.client.0.smithi138.stderr: -368> 2024-09-14T11:40:09.524+0000 7f7a769219c0 10 monclient: init 2024-09-14T11:40:10.072 INFO:tasks.workunit.client.0.smithi138.stderr: -367> 2024-09-14T11:40:09.524+0000 7f7a769219c0 5 AuthRegistry(0x55f41a520d78) adding auth protocol: cephx 2024-09-14T11:40:10.072 INFO:tasks.workunit.client.0.smithi138.stderr: -366> 2024-09-14T11:40:09.524+0000 7f7a769219c0 5 AuthRegistry(0x55f41a520d78) adding auth protocol: cephx 2024-09-14T11:40:10.072 INFO:tasks.workunit.client.0.smithi138.stderr: -365> 2024-09-14T11:40:09.524+0000 7f7a769219c0 5 AuthRegistry(0x55f41a520d78) adding auth protocol: cephx 2024-09-14T11:40:10.072 INFO:tasks.workunit.client.0.smithi138.stderr: -364> 2024-09-14T11:40:09.524+0000 7f7a769219c0 5 AuthRegistry(0x55f41a520d78) adding con mode: secure 2024-09-14T11:40:10.072 INFO:tasks.workunit.client.0.smithi138.stderr: -363> 2024-09-14T11:40:09.524+0000 7f7a769219c0 5 AuthRegistry(0x55f41a520d78) adding con mode: crc 2024-09-14T11:40:10.072 INFO:tasks.workunit.client.0.smithi138.stderr: -362> 2024-09-14T11:40:09.524+0000 7f7a769219c0 5 AuthRegistry(0x55f41a520d78) adding con mode: secure 2024-09-14T11:40:10.073 INFO:tasks.workunit.client.0.smithi138.stderr: -361> 2024-09-14T11:40:09.524+0000 7f7a769219c0 5 AuthRegistry(0x55f41a520d78) adding con mode: crc 2024-09-14T11:40:10.073 INFO:tasks.workunit.client.0.smithi138.stderr: -360> 2024-09-14T11:40:09.524+0000 7f7a769219c0 5 AuthRegistry(0x55f41a520d78) adding con mode: secure 2024-09-14T11:40:10.073 INFO:tasks.workunit.client.0.smithi138.stderr: -359> 2024-09-14T11:40:09.524+0000 7f7a769219c0 5 AuthRegistry(0x55f41a520d78) adding con mode: crc 2024-09-14T11:40:10.073 INFO:tasks.workunit.client.0.smithi138.stderr: -358> 2024-09-14T11:40:09.524+0000 7f7a769219c0 5 AuthRegistry(0x55f41a520d78) adding con mode: crc 2024-09-14T11:40:10.073 INFO:tasks.workunit.client.0.smithi138.stderr: -357> 2024-09-14T11:40:09.524+0000 7f7a769219c0 5 AuthRegistry(0x55f41a520d78) adding con mode: secure 2024-09-14T11:40:10.073 INFO:tasks.workunit.client.0.smithi138.stderr: -356> 2024-09-14T11:40:09.524+0000 7f7a769219c0 5 AuthRegistry(0x55f41a520d78) adding con mode: crc 2024-09-14T11:40:10.073 INFO:tasks.workunit.client.0.smithi138.stderr: -355> 2024-09-14T11:40:09.524+0000 7f7a769219c0 5 AuthRegistry(0x55f41a520d78) adding con mode: secure 2024-09-14T11:40:10.073 INFO:tasks.workunit.client.0.smithi138.stderr: -354> 2024-09-14T11:40:09.524+0000 7f7a769219c0 5 AuthRegistry(0x55f41a520d78) adding con mode: crc 2024-09-14T11:40:10.073 INFO:tasks.workunit.client.0.smithi138.stderr: -353> 2024-09-14T11:40:09.524+0000 7f7a769219c0 5 AuthRegistry(0x55f41a520d78) adding con mode: secure 2024-09-14T11:40:10.073 INFO:tasks.workunit.client.0.smithi138.stderr: -352> 2024-09-14T11:40:09.524+0000 7f7a769219c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:40:10.073 INFO:tasks.workunit.client.0.smithi138.stderr: -351> 2024-09-14T11:40:09.524+0000 7f7a769219c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:40:10.073 INFO:tasks.workunit.client.0.smithi138.stderr: -350> 2024-09-14T11:40:09.524+0000 7f7a769219c0 5 asok(0x55f41a2bfd90) register_command rotate-key cmddesc rotate-key hook 0x55f41a520ec0 EEXIST 2024-09-14T11:40:10.073 INFO:tasks.workunit.client.0.smithi138.stderr: -349> 2024-09-14T11:40:09.524+0000 7f7a769219c0 10 monclient: _reopen_session rank -1 2024-09-14T11:40:10.073 INFO:tasks.workunit.client.0.smithi138.stderr: -348> 2024-09-14T11:40:09.524+0000 7f7a769219c0 10 monclient: _add_conns ranks=[1,0,2] 2024-09-14T11:40:10.073 INFO:tasks.workunit.client.0.smithi138.stderr: -347> 2024-09-14T11:40:09.524+0000 7f7a769219c0 10 monclient(hunting): picked mon.noname-b con 0x55f41a549a20 addr [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] 2024-09-14T11:40:10.074 INFO:tasks.workunit.client.0.smithi138.stderr: -346> 2024-09-14T11:40:09.524+0000 7f7a769219c0 10 monclient(hunting): picked mon.noname-a con 0x55f41a549350 addr [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] 2024-09-14T11:40:10.074 INFO:tasks.workunit.client.0.smithi138.stderr: -345> 2024-09-14T11:40:09.524+0000 7f7a769219c0 10 monclient(hunting): picked mon.noname-c con 0x55f41a547d30 addr [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] 2024-09-14T11:40:10.074 INFO:tasks.workunit.client.0.smithi138.stderr: -344> 2024-09-14T11:40:09.524+0000 7f7a769219c0 10 monclient(hunting): start opening mon connection 2024-09-14T11:40:10.074 INFO:tasks.workunit.client.0.smithi138.stderr: -343> 2024-09-14T11:40:09.524+0000 7f7a769219c0 10 monclient(hunting): start opening mon connection 2024-09-14T11:40:10.074 INFO:tasks.workunit.client.0.smithi138.stderr: -342> 2024-09-14T11:40:09.524+0000 7f7a769219c0 10 monclient(hunting): start opening mon connection 2024-09-14T11:40:10.074 INFO:tasks.workunit.client.0.smithi138.stderr: -341> 2024-09-14T11:40:09.524+0000 7f7a769219c0 10 monclient(hunting): _renew_subs 2024-09-14T11:40:10.074 INFO:tasks.workunit.client.0.smithi138.stderr: -340> 2024-09-14T11:40:09.524+0000 7f7a769219c0 10 monclient(hunting): authenticate will time out at 2945.484716s 2024-09-14T11:40:10.074 INFO:tasks.workunit.client.0.smithi138.stderr: -339> 2024-09-14T11:40:09.524+0000 7f7a74427640 10 monclient(hunting): get_auth_request con 0x55f41a547d30 auth_method 0 2024-09-14T11:40:10.074 INFO:tasks.workunit.client.0.smithi138.stderr: -338> 2024-09-14T11:40:09.524+0000 7f7a74427640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:40:10.074 INFO:tasks.workunit.client.0.smithi138.stderr: -337> 2024-09-14T11:40:09.524+0000 7f7a74427640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:40:10.074 INFO:tasks.workunit.client.0.smithi138.stderr: -336> 2024-09-14T11:40:09.524+0000 7f7a74427640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:40:10.074 INFO:tasks.workunit.client.0.smithi138.stderr: -335> 2024-09-14T11:40:09.524+0000 7f7a74c28640 10 monclient(hunting): get_auth_request con 0x55f41a549350 auth_method 0 2024-09-14T11:40:10.074 INFO:tasks.workunit.client.0.smithi138.stderr: -334> 2024-09-14T11:40:09.524+0000 7f7a74c28640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:40:10.074 INFO:tasks.workunit.client.0.smithi138.stderr: -333> 2024-09-14T11:40:09.524+0000 7f7a74c28640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:40:10.074 INFO:tasks.workunit.client.0.smithi138.stderr: -332> 2024-09-14T11:40:09.524+0000 7f7a74c28640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:40:10.075 INFO:tasks.workunit.client.0.smithi138.stderr: -331> 2024-09-14T11:40:09.524+0000 7f7a74427640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:40:10.075 INFO:tasks.workunit.client.0.smithi138.stderr: -330> 2024-09-14T11:40:09.524+0000 7f7a74427640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:40:10.075 INFO:tasks.workunit.client.0.smithi138.stderr: -329> 2024-09-14T11:40:09.524+0000 7f7a74427640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:40:10.075 INFO:tasks.workunit.client.0.smithi138.stderr: -328> 2024-09-14T11:40:09.524+0000 7f7a74c28640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:40:10.075 INFO:tasks.workunit.client.0.smithi138.stderr: -327> 2024-09-14T11:40:09.524+0000 7f7a74c28640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:40:10.075 INFO:tasks.workunit.client.0.smithi138.stderr: -326> 2024-09-14T11:40:09.524+0000 7f7a74c28640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:40:10.075 INFO:tasks.workunit.client.0.smithi138.stderr: -325> 2024-09-14T11:40:09.524+0000 7f7a73c26640 10 monclient(hunting): get_auth_request con 0x55f41a549a20 auth_method 0 2024-09-14T11:40:10.075 INFO:tasks.workunit.client.0.smithi138.stderr: -324> 2024-09-14T11:40:09.524+0000 7f7a73c26640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:40:10.075 INFO:tasks.workunit.client.0.smithi138.stderr: -323> 2024-09-14T11:40:09.524+0000 7f7a73c26640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:40:10.075 INFO:tasks.workunit.client.0.smithi138.stderr: -322> 2024-09-14T11:40:09.524+0000 7f7a73c26640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:40:10.075 INFO:tasks.workunit.client.0.smithi138.stderr: -321> 2024-09-14T11:40:09.524+0000 7f7a74427640 10 monclient(hunting): handle_auth_done global_id 7607 payload 824 2024-09-14T11:40:10.075 INFO:tasks.workunit.client.0.smithi138.stderr: -320> 2024-09-14T11:40:09.524+0000 7f7a74427640 10 monclient: _finish_hunting 0 2024-09-14T11:40:10.075 INFO:tasks.workunit.client.0.smithi138.stderr: -319> 2024-09-14T11:40:09.524+0000 7f7a74427640 1 monclient: found mon.noname-c 2024-09-14T11:40:10.075 INFO:tasks.workunit.client.0.smithi138.stderr: -318> 2024-09-14T11:40:09.524+0000 7f7a74427640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.138:3301/0 2024-09-14T11:40:10.075 INFO:tasks.workunit.client.0.smithi138.stderr: -317> 2024-09-14T11:40:09.524+0000 7f7959ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:40:10.076 INFO:tasks.workunit.client.0.smithi138.stderr: -316> 2024-09-14T11:40:09.524+0000 7f7959ffb640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-14T11:40:10.076 INFO:tasks.workunit.client.0.smithi138.stderr: -315> 2024-09-14T11:40:09.524+0000 7f7959ffb640 10 monclient: dump: 2024-09-14T11:40:10.076 INFO:tasks.workunit.client.0.smithi138.stderr:epoch 1 2024-09-14T11:40:10.076 INFO:tasks.workunit.client.0.smithi138.stderr:fsid 3f225f43-83a6-4aeb-b798-1f04bb49d597 2024-09-14T11:40:10.076 INFO:tasks.workunit.client.0.smithi138.stderr:last_changed 2024-09-14T11:07:09.252780+0000 2024-09-14T11:40:10.076 INFO:tasks.workunit.client.0.smithi138.stderr:created 2024-09-14T11:07:09.252780+0000 2024-09-14T11:40:10.076 INFO:tasks.workunit.client.0.smithi138.stderr:min_mon_release 19 (squid) 2024-09-14T11:40:10.076 INFO:tasks.workunit.client.0.smithi138.stderr:election_strategy: 1 2024-09-14T11:40:10.076 INFO:tasks.workunit.client.0.smithi138.stderr:0: [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] mon.a 2024-09-14T11:40:10.076 INFO:tasks.workunit.client.0.smithi138.stderr:1: [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] mon.b 2024-09-14T11:40:10.076 INFO:tasks.workunit.client.0.smithi138.stderr:2: [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] mon.c 2024-09-14T11:40:10.076 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-14T11:40:10.076 INFO:tasks.workunit.client.0.smithi138.stderr: -314> 2024-09-14T11:40:09.524+0000 7f7959ffb640 10 monclient: _finish_auth 0 2024-09-14T11:40:10.076 INFO:tasks.workunit.client.0.smithi138.stderr: -313> 2024-09-14T11:40:09.524+0000 7f7959ffb640 10 monclient: _check_auth_tickets 2024-09-14T11:40:10.076 INFO:tasks.workunit.client.0.smithi138.stderr: -312> 2024-09-14T11:40:09.524+0000 7f7959ffb640 10 monclient: handle_config config(0 keys) 2024-09-14T11:40:10.077 INFO:tasks.workunit.client.0.smithi138.stderr: -311> 2024-09-14T11:40:09.524+0000 7f7959ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:40:10.077 INFO:tasks.workunit.client.0.smithi138.stderr: -310> 2024-09-14T11:40:09.524+0000 7f7959ffb640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-14T11:40:10.077 INFO:tasks.workunit.client.0.smithi138.stderr: -309> 2024-09-14T11:40:09.524+0000 7f7959ffb640 10 monclient: dump: 2024-09-14T11:40:10.077 INFO:tasks.workunit.client.0.smithi138.stderr:epoch 1 2024-09-14T11:40:10.077 INFO:tasks.workunit.client.0.smithi138.stderr:fsid 3f225f43-83a6-4aeb-b798-1f04bb49d597 2024-09-14T11:40:10.077 INFO:tasks.workunit.client.0.smithi138.stderr:last_changed 2024-09-14T11:07:09.252780+0000 2024-09-14T11:40:10.077 INFO:tasks.workunit.client.0.smithi138.stderr:created 2024-09-14T11:07:09.252780+0000 2024-09-14T11:40:10.077 INFO:tasks.workunit.client.0.smithi138.stderr:min_mon_release 19 (squid) 2024-09-14T11:40:10.077 INFO:tasks.workunit.client.0.smithi138.stderr:election_strategy: 1 2024-09-14T11:40:10.077 INFO:tasks.workunit.client.0.smithi138.stderr:0: [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] mon.a 2024-09-14T11:40:10.077 INFO:tasks.workunit.client.0.smithi138.stderr:1: [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] mon.b 2024-09-14T11:40:10.077 INFO:tasks.workunit.client.0.smithi138.stderr:2: [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] mon.c 2024-09-14T11:40:10.077 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-14T11:40:10.077 INFO:tasks.workunit.client.0.smithi138.stderr: -308> 2024-09-14T11:40:09.524+0000 7f7a75429640 4 set_mon_vals no callback set 2024-09-14T11:40:10.078 INFO:tasks.workunit.client.0.smithi138.stderr: -307> 2024-09-14T11:40:09.524+0000 7f7a769219c0 5 monclient: authenticate success, global_id 7607 2024-09-14T11:40:10.078 INFO:tasks.workunit.client.0.smithi138.stderr: -306> 2024-09-14T11:40:09.524+0000 7f7a769219c0 10 monclient: _renew_subs 2024-09-14T11:40:10.078 INFO:tasks.workunit.client.0.smithi138.stderr: -305> 2024-09-14T11:40:09.524+0000 7f7a769219c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.138:3301/0 2024-09-14T11:40:10.078 INFO:tasks.workunit.client.0.smithi138.stderr: -304> 2024-09-14T11:40:09.524+0000 7f7a769219c0 10 monclient: _renew_subs 2024-09-14T11:40:10.078 INFO:tasks.workunit.client.0.smithi138.stderr: -303> 2024-09-14T11:40:09.524+0000 7f7a769219c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.138:3301/0 2024-09-14T11:40:10.078 INFO:tasks.workunit.client.0.smithi138.stderr: -302> 2024-09-14T11:40:09.524+0000 7f7959ffb640 4 mgrc handle_mgr_map Got map version 5 2024-09-14T11:40:10.078 INFO:tasks.workunit.client.0.smithi138.stderr: -301> 2024-09-14T11:40:09.524+0000 7f7959ffb640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.138:6832/3778043143,v1:172.21.15.138:6833/3778043143] 2024-09-14T11:40:10.078 INFO:tasks.workunit.client.0.smithi138.stderr: -300> 2024-09-14T11:40:09.524+0000 7f7959ffb640 4 mgrc reconnect Starting new session with [v2:172.21.15.138:6832/3778043143,v1:172.21.15.138:6833/3778043143] 2024-09-14T11:40:10.078 INFO:tasks.workunit.client.0.smithi138.stderr: -299> 2024-09-14T11:40:09.524+0000 7f7a73c26640 10 monclient: get_auth_request con 0x7f794c0717e0 auth_method 0 2024-09-14T11:40:10.078 INFO:tasks.workunit.client.0.smithi138.stderr: -298> 2024-09-14T11:40:09.524+0000 7f7a769219c0 10 monclient: get_monmap_and_config 2024-09-14T11:40:10.078 INFO:tasks.workunit.client.0.smithi138.stderr: -297> 2024-09-14T11:40:09.524+0000 7f7a769219c0 10 monclient: build_initial_monmap 2024-09-14T11:40:10.078 INFO:tasks.workunit.client.0.smithi138.stderr: -296> 2024-09-14T11:40:09.524+0000 7f7a769219c0 1 build_initial for_mkfs: 0 2024-09-14T11:40:10.078 INFO:tasks.workunit.client.0.smithi138.stderr: -295> 2024-09-14T11:40:09.524+0000 7f7a769219c0 10 monclient: monmap: 2024-09-14T11:40:10.078 INFO:tasks.workunit.client.0.smithi138.stderr:epoch 0 2024-09-14T11:40:10.078 INFO:tasks.workunit.client.0.smithi138.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-14T11:40:10.079 INFO:tasks.workunit.client.0.smithi138.stderr:last_changed 0.000000 2024-09-14T11:40:10.079 INFO:tasks.workunit.client.0.smithi138.stderr:created 0.000000 2024-09-14T11:40:10.079 INFO:tasks.workunit.client.0.smithi138.stderr:min_mon_release 0 (unknown) 2024-09-14T11:40:10.079 INFO:tasks.workunit.client.0.smithi138.stderr:election_strategy: 1 2024-09-14T11:40:10.079 INFO:tasks.workunit.client.0.smithi138.stderr:0: [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] mon.noname-a 2024-09-14T11:40:10.079 INFO:tasks.workunit.client.0.smithi138.stderr:1: [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] mon.noname-b 2024-09-14T11:40:10.079 INFO:tasks.workunit.client.0.smithi138.stderr:2: [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] mon.noname-c 2024-09-14T11:40:10.079 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-14T11:40:10.079 INFO:tasks.workunit.client.0.smithi138.stderr: -294> 2024-09-14T11:40:09.524+0000 7f7a769219c0 5 AuthRegistry(0x55f41a5693b0) adding auth protocol: cephx 2024-09-14T11:40:10.079 INFO:tasks.workunit.client.0.smithi138.stderr: -293> 2024-09-14T11:40:09.524+0000 7f7a769219c0 5 AuthRegistry(0x55f41a5693b0) adding auth protocol: cephx 2024-09-14T11:40:10.079 INFO:tasks.workunit.client.0.smithi138.stderr: -292> 2024-09-14T11:40:09.524+0000 7f7a769219c0 5 AuthRegistry(0x55f41a5693b0) adding auth protocol: cephx 2024-09-14T11:40:10.079 INFO:tasks.workunit.client.0.smithi138.stderr: -291> 2024-09-14T11:40:09.524+0000 7f7a769219c0 5 AuthRegistry(0x55f41a5693b0) adding con mode: secure 2024-09-14T11:40:10.079 INFO:tasks.workunit.client.0.smithi138.stderr: -290> 2024-09-14T11:40:09.524+0000 7f7a769219c0 5 AuthRegistry(0x55f41a5693b0) adding con mode: crc 2024-09-14T11:40:10.079 INFO:tasks.workunit.client.0.smithi138.stderr: -289> 2024-09-14T11:40:09.524+0000 7f7a769219c0 5 AuthRegistry(0x55f41a5693b0) adding con mode: secure 2024-09-14T11:40:10.079 INFO:tasks.workunit.client.0.smithi138.stderr: -288> 2024-09-14T11:40:09.524+0000 7f7a769219c0 5 AuthRegistry(0x55f41a5693b0) adding con mode: crc 2024-09-14T11:40:10.079 INFO:tasks.workunit.client.0.smithi138.stderr: -287> 2024-09-14T11:40:09.524+0000 7f7a769219c0 5 AuthRegistry(0x55f41a5693b0) adding con mode: secure 2024-09-14T11:40:10.080 INFO:tasks.workunit.client.0.smithi138.stderr: -286> 2024-09-14T11:40:09.524+0000 7f7a769219c0 5 AuthRegistry(0x55f41a5693b0) adding con mode: crc 2024-09-14T11:40:10.080 INFO:tasks.workunit.client.0.smithi138.stderr: -285> 2024-09-14T11:40:09.524+0000 7f7a769219c0 5 AuthRegistry(0x55f41a5693b0) adding con mode: crc 2024-09-14T11:40:10.080 INFO:tasks.workunit.client.0.smithi138.stderr: -284> 2024-09-14T11:40:09.524+0000 7f7a769219c0 5 AuthRegistry(0x55f41a5693b0) adding con mode: secure 2024-09-14T11:40:10.080 INFO:tasks.workunit.client.0.smithi138.stderr: -283> 2024-09-14T11:40:09.524+0000 7f7a769219c0 5 AuthRegistry(0x55f41a5693b0) adding con mode: crc 2024-09-14T11:40:10.080 INFO:tasks.workunit.client.0.smithi138.stderr: -282> 2024-09-14T11:40:09.524+0000 7f7a769219c0 5 AuthRegistry(0x55f41a5693b0) adding con mode: secure 2024-09-14T11:40:10.080 INFO:tasks.workunit.client.0.smithi138.stderr: -281> 2024-09-14T11:40:09.524+0000 7f7a769219c0 5 AuthRegistry(0x55f41a5693b0) adding con mode: crc 2024-09-14T11:40:10.080 INFO:tasks.workunit.client.0.smithi138.stderr: -280> 2024-09-14T11:40:09.524+0000 7f7a769219c0 5 AuthRegistry(0x55f41a5693b0) adding con mode: secure 2024-09-14T11:40:10.080 INFO:tasks.workunit.client.0.smithi138.stderr: -279> 2024-09-14T11:40:09.528+0000 7f7a769219c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:40:10.080 INFO:tasks.workunit.client.0.smithi138.stderr: -278> 2024-09-14T11:40:09.528+0000 7f7a769219c0 10 monclient: init 2024-09-14T11:40:10.080 INFO:tasks.workunit.client.0.smithi138.stderr: -277> 2024-09-14T11:40:09.528+0000 7f7a769219c0 5 AuthRegistry(0x7ffece940880) adding auth protocol: cephx 2024-09-14T11:40:10.080 INFO:tasks.workunit.client.0.smithi138.stderr: -276> 2024-09-14T11:40:09.528+0000 7f7a769219c0 5 AuthRegistry(0x7ffece940880) adding auth protocol: cephx 2024-09-14T11:40:10.080 INFO:tasks.workunit.client.0.smithi138.stderr: -275> 2024-09-14T11:40:09.528+0000 7f7a769219c0 5 AuthRegistry(0x7ffece940880) adding auth protocol: cephx 2024-09-14T11:40:10.080 INFO:tasks.workunit.client.0.smithi138.stderr: -274> 2024-09-14T11:40:09.528+0000 7f7a769219c0 5 AuthRegistry(0x7ffece940880) adding con mode: secure 2024-09-14T11:40:10.080 INFO:tasks.workunit.client.0.smithi138.stderr: -273> 2024-09-14T11:40:09.528+0000 7f7a769219c0 5 AuthRegistry(0x7ffece940880) adding con mode: crc 2024-09-14T11:40:10.080 INFO:tasks.workunit.client.0.smithi138.stderr: -272> 2024-09-14T11:40:09.528+0000 7f7a769219c0 5 AuthRegistry(0x7ffece940880) adding con mode: secure 2024-09-14T11:40:10.081 INFO:tasks.workunit.client.0.smithi138.stderr: -271> 2024-09-14T11:40:09.528+0000 7f7a769219c0 5 AuthRegistry(0x7ffece940880) adding con mode: crc 2024-09-14T11:40:10.081 INFO:tasks.workunit.client.0.smithi138.stderr: -270> 2024-09-14T11:40:09.528+0000 7f7a769219c0 5 AuthRegistry(0x7ffece940880) adding con mode: secure 2024-09-14T11:40:10.081 INFO:tasks.workunit.client.0.smithi138.stderr: -269> 2024-09-14T11:40:09.528+0000 7f7a769219c0 5 AuthRegistry(0x7ffece940880) adding con mode: crc 2024-09-14T11:40:10.081 INFO:tasks.workunit.client.0.smithi138.stderr: -268> 2024-09-14T11:40:09.528+0000 7f7a769219c0 5 AuthRegistry(0x7ffece940880) adding con mode: crc 2024-09-14T11:40:10.081 INFO:tasks.workunit.client.0.smithi138.stderr: -267> 2024-09-14T11:40:09.528+0000 7f7a769219c0 5 AuthRegistry(0x7ffece940880) adding con mode: secure 2024-09-14T11:40:10.081 INFO:tasks.workunit.client.0.smithi138.stderr: -266> 2024-09-14T11:40:09.528+0000 7f7a769219c0 5 AuthRegistry(0x7ffece940880) adding con mode: crc 2024-09-14T11:40:10.081 INFO:tasks.workunit.client.0.smithi138.stderr: -265> 2024-09-14T11:40:09.528+0000 7f7a769219c0 5 AuthRegistry(0x7ffece940880) adding con mode: secure 2024-09-14T11:40:10.081 INFO:tasks.workunit.client.0.smithi138.stderr: -264> 2024-09-14T11:40:09.528+0000 7f7a769219c0 5 AuthRegistry(0x7ffece940880) adding con mode: crc 2024-09-14T11:40:10.081 INFO:tasks.workunit.client.0.smithi138.stderr: -263> 2024-09-14T11:40:09.528+0000 7f7a769219c0 5 AuthRegistry(0x7ffece940880) adding con mode: secure 2024-09-14T11:40:10.081 INFO:tasks.workunit.client.0.smithi138.stderr: -262> 2024-09-14T11:40:09.528+0000 7f7a769219c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:40:10.081 INFO:tasks.workunit.client.0.smithi138.stderr: -261> 2024-09-14T11:40:09.528+0000 7f7a769219c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:40:10.081 INFO:tasks.workunit.client.0.smithi138.stderr: -260> 2024-09-14T11:40:09.528+0000 7f7a769219c0 5 asok(0x55f41a2bfd90) register_command rotate-key cmddesc rotate-key hook 0x7ffece9409c8 EEXIST 2024-09-14T11:40:10.081 INFO:tasks.workunit.client.0.smithi138.stderr: -259> 2024-09-14T11:40:09.528+0000 7f7a769219c0 10 monclient: _reopen_session rank -1 2024-09-14T11:40:10.081 INFO:tasks.workunit.client.0.smithi138.stderr: -258> 2024-09-14T11:40:09.528+0000 7f7a769219c0 10 monclient: _add_conns ranks=[2,0,1] 2024-09-14T11:40:10.082 INFO:tasks.workunit.client.0.smithi138.stderr: -257> 2024-09-14T11:40:09.528+0000 7f7a769219c0 10 monclient(hunting): picked mon.noname-c con 0x55f41a59d8d0 addr [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] 2024-09-14T11:40:10.082 INFO:tasks.workunit.client.0.smithi138.stderr: -256> 2024-09-14T11:40:09.528+0000 7f7a769219c0 10 monclient(hunting): picked mon.noname-a con 0x55f41a598cc0 addr [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] 2024-09-14T11:40:10.082 INFO:tasks.workunit.client.0.smithi138.stderr: -255> 2024-09-14T11:40:09.528+0000 7f7a769219c0 10 monclient(hunting): picked mon.noname-b con 0x55f41a599640 addr [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] 2024-09-14T11:40:10.082 INFO:tasks.workunit.client.0.smithi138.stderr: -254> 2024-09-14T11:40:09.528+0000 7f7a769219c0 10 monclient(hunting): start opening mon connection 2024-09-14T11:40:10.082 INFO:tasks.workunit.client.0.smithi138.stderr: -253> 2024-09-14T11:40:09.528+0000 7f7a769219c0 10 monclient(hunting): start opening mon connection 2024-09-14T11:40:10.082 INFO:tasks.workunit.client.0.smithi138.stderr: -252> 2024-09-14T11:40:09.528+0000 7f7a769219c0 10 monclient(hunting): start opening mon connection 2024-09-14T11:40:10.082 INFO:tasks.workunit.client.0.smithi138.stderr: -251> 2024-09-14T11:40:09.528+0000 7f7a769219c0 10 monclient(hunting): _renew_subs 2024-09-14T11:40:10.082 INFO:tasks.workunit.client.0.smithi138.stderr: -250> 2024-09-14T11:40:09.528+0000 7f7a769219c0 10 monclient(hunting): authenticate will time out at 2945.488914s 2024-09-14T11:40:10.082 INFO:tasks.workunit.client.0.smithi138.stderr: -249> 2024-09-14T11:40:09.528+0000 7f7a74c28640 10 monclient(hunting): get_auth_request con 0x55f41a598cc0 auth_method 0 2024-09-14T11:40:10.082 INFO:tasks.workunit.client.0.smithi138.stderr: -248> 2024-09-14T11:40:09.528+0000 7f7a74c28640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:40:10.083 INFO:tasks.workunit.client.0.smithi138.stderr: -247> 2024-09-14T11:40:09.528+0000 7f7a74c28640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:40:10.083 INFO:tasks.workunit.client.0.smithi138.stderr: -246> 2024-09-14T11:40:09.528+0000 7f7a74c28640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:40:10.083 INFO:tasks.workunit.client.0.smithi138.stderr: -245> 2024-09-14T11:40:09.528+0000 7f7a73c26640 10 monclient(hunting): get_auth_request con 0x55f41a59d8d0 auth_method 0 2024-09-14T11:40:10.083 INFO:tasks.workunit.client.0.smithi138.stderr: -244> 2024-09-14T11:40:09.528+0000 7f7a73c26640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:40:10.083 INFO:tasks.workunit.client.0.smithi138.stderr: -243> 2024-09-14T11:40:09.528+0000 7f7a73c26640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:40:10.083 INFO:tasks.workunit.client.0.smithi138.stderr: -242> 2024-09-14T11:40:09.528+0000 7f7a73c26640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:40:10.083 INFO:tasks.workunit.client.0.smithi138.stderr: -241> 2024-09-14T11:40:09.528+0000 7f7a74c28640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:40:10.083 INFO:tasks.workunit.client.0.smithi138.stderr: -240> 2024-09-14T11:40:09.528+0000 7f7a74c28640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:40:10.083 INFO:tasks.workunit.client.0.smithi138.stderr: -239> 2024-09-14T11:40:09.528+0000 7f7a74c28640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:40:10.083 INFO:tasks.workunit.client.0.smithi138.stderr: -238> 2024-09-14T11:40:09.528+0000 7f7a73c26640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:40:10.083 INFO:tasks.workunit.client.0.smithi138.stderr: -237> 2024-09-14T11:40:09.528+0000 7f7a73c26640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:40:10.083 INFO:tasks.workunit.client.0.smithi138.stderr: -236> 2024-09-14T11:40:09.528+0000 7f7a73c26640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:40:10.083 INFO:tasks.workunit.client.0.smithi138.stderr: -235> 2024-09-14T11:40:09.528+0000 7f7a74427640 10 monclient(hunting): get_auth_request con 0x55f41a599640 auth_method 0 2024-09-14T11:40:10.083 INFO:tasks.workunit.client.0.smithi138.stderr: -234> 2024-09-14T11:40:09.528+0000 7f7a74427640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:40:10.083 INFO:tasks.workunit.client.0.smithi138.stderr: -233> 2024-09-14T11:40:09.528+0000 7f7a74427640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:40:10.084 INFO:tasks.workunit.client.0.smithi138.stderr: -232> 2024-09-14T11:40:09.528+0000 7f7a74427640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:40:10.084 INFO:tasks.workunit.client.0.smithi138.stderr: -231> 2024-09-14T11:40:09.528+0000 7f7a74c28640 10 monclient(hunting): handle_auth_done global_id 8145 payload 274 2024-09-14T11:40:10.084 INFO:tasks.workunit.client.0.smithi138.stderr: -230> 2024-09-14T11:40:09.528+0000 7f7a74c28640 10 monclient: _finish_hunting 0 2024-09-14T11:40:10.084 INFO:tasks.workunit.client.0.smithi138.stderr: -229> 2024-09-14T11:40:09.528+0000 7f7a74c28640 1 monclient: found mon.noname-a 2024-09-14T11:40:10.084 INFO:tasks.workunit.client.0.smithi138.stderr: -228> 2024-09-14T11:40:09.528+0000 7f7a74c28640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.138:3300/0 2024-09-14T11:40:10.084 INFO:tasks.workunit.client.0.smithi138.stderr: -227> 2024-09-14T11:40:09.528+0000 7f794b7fe640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:40:10.084 INFO:tasks.workunit.client.0.smithi138.stderr: -226> 2024-09-14T11:40:09.528+0000 7f794b7fe640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-14T11:40:10.084 INFO:tasks.workunit.client.0.smithi138.stderr: -225> 2024-09-14T11:40:09.528+0000 7f794b7fe640 10 monclient: dump: 2024-09-14T11:40:10.084 INFO:tasks.workunit.client.0.smithi138.stderr:epoch 1 2024-09-14T11:40:10.084 INFO:tasks.workunit.client.0.smithi138.stderr:fsid 3f225f43-83a6-4aeb-b798-1f04bb49d597 2024-09-14T11:40:10.084 INFO:tasks.workunit.client.0.smithi138.stderr:last_changed 2024-09-14T11:07:09.252780+0000 2024-09-14T11:40:10.084 INFO:tasks.workunit.client.0.smithi138.stderr:created 2024-09-14T11:07:09.252780+0000 2024-09-14T11:40:10.084 INFO:tasks.workunit.client.0.smithi138.stderr:min_mon_release 19 (squid) 2024-09-14T11:40:10.084 INFO:tasks.workunit.client.0.smithi138.stderr:election_strategy: 1 2024-09-14T11:40:10.085 INFO:tasks.workunit.client.0.smithi138.stderr:0: [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] mon.a 2024-09-14T11:40:10.085 INFO:tasks.workunit.client.0.smithi138.stderr:1: [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] mon.b 2024-09-14T11:40:10.085 INFO:tasks.workunit.client.0.smithi138.stderr:2: [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] mon.c 2024-09-14T11:40:10.085 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-14T11:40:10.085 INFO:tasks.workunit.client.0.smithi138.stderr: -224> 2024-09-14T11:40:09.528+0000 7f794b7fe640 10 monclient: _finish_auth 0 2024-09-14T11:40:10.085 INFO:tasks.workunit.client.0.smithi138.stderr: -223> 2024-09-14T11:40:09.528+0000 7f794b7fe640 10 monclient: _check_auth_tickets 2024-09-14T11:40:10.085 INFO:tasks.workunit.client.0.smithi138.stderr: -222> 2024-09-14T11:40:09.528+0000 7f794b7fe640 10 monclient: handle_config config(0 keys) 2024-09-14T11:40:10.085 INFO:tasks.workunit.client.0.smithi138.stderr: -221> 2024-09-14T11:40:09.528+0000 7f794b7fe640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:40:10.085 INFO:tasks.workunit.client.0.smithi138.stderr: -220> 2024-09-14T11:40:09.528+0000 7f794b7fe640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-14T11:40:10.085 INFO:tasks.workunit.client.0.smithi138.stderr: -219> 2024-09-14T11:40:09.528+0000 7f794b7fe640 10 monclient: dump: 2024-09-14T11:40:10.085 INFO:tasks.workunit.client.0.smithi138.stderr:epoch 1 2024-09-14T11:40:10.085 INFO:tasks.workunit.client.0.smithi138.stderr:fsid 3f225f43-83a6-4aeb-b798-1f04bb49d597 2024-09-14T11:40:10.085 INFO:tasks.workunit.client.0.smithi138.stderr:last_changed 2024-09-14T11:07:09.252780+0000 2024-09-14T11:40:10.085 INFO:tasks.workunit.client.0.smithi138.stderr:created 2024-09-14T11:07:09.252780+0000 2024-09-14T11:40:10.085 INFO:tasks.workunit.client.0.smithi138.stderr:min_mon_release 19 (squid) 2024-09-14T11:40:10.085 INFO:tasks.workunit.client.0.smithi138.stderr:election_strategy: 1 2024-09-14T11:40:10.086 INFO:tasks.workunit.client.0.smithi138.stderr:0: [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] mon.a 2024-09-14T11:40:10.086 INFO:tasks.workunit.client.0.smithi138.stderr:1: [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] mon.b 2024-09-14T11:40:10.086 INFO:tasks.workunit.client.0.smithi138.stderr:2: [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] mon.c 2024-09-14T11:40:10.086 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-14T11:40:10.086 INFO:tasks.workunit.client.0.smithi138.stderr: -218> 2024-09-14T11:40:09.528+0000 7f7a769219c0 5 monclient: authenticate success, global_id 8145 2024-09-14T11:40:10.086 INFO:tasks.workunit.client.0.smithi138.stderr: -217> 2024-09-14T11:40:09.528+0000 7f7a769219c0 10 monclient: get_monmap_and_config success 2024-09-14T11:40:10.086 INFO:tasks.workunit.client.0.smithi138.stderr: -216> 2024-09-14T11:40:09.528+0000 7f7a769219c0 4 set_mon_vals no callback set 2024-09-14T11:40:10.086 INFO:tasks.workunit.client.0.smithi138.stderr: -215> 2024-09-14T11:40:09.528+0000 7f7a769219c0 10 monclient: shutdown 2024-09-14T11:40:10.086 INFO:tasks.workunit.client.0.smithi138.stderr: -214> 2024-09-14T11:40:09.528+0000 7f7a769219c0 10 monclient: build_initial_monmap 2024-09-14T11:40:10.086 INFO:tasks.workunit.client.0.smithi138.stderr: -213> 2024-09-14T11:40:09.528+0000 7f7a769219c0 1 build_initial for_mkfs: 0 2024-09-14T11:40:10.086 INFO:tasks.workunit.client.0.smithi138.stderr: -212> 2024-09-14T11:40:09.528+0000 7f7a769219c0 10 monclient: monmap: 2024-09-14T11:40:10.086 INFO:tasks.workunit.client.0.smithi138.stderr:epoch 0 2024-09-14T11:40:10.086 INFO:tasks.workunit.client.0.smithi138.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-14T11:40:10.086 INFO:tasks.workunit.client.0.smithi138.stderr:last_changed 0.000000 2024-09-14T11:40:10.086 INFO:tasks.workunit.client.0.smithi138.stderr:created 0.000000 2024-09-14T11:40:10.087 INFO:tasks.workunit.client.0.smithi138.stderr:min_mon_release 0 (unknown) 2024-09-14T11:40:10.087 INFO:tasks.workunit.client.0.smithi138.stderr:election_strategy: 1 2024-09-14T11:40:10.087 INFO:tasks.workunit.client.0.smithi138.stderr:0: [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] mon.noname-a 2024-09-14T11:40:10.087 INFO:tasks.workunit.client.0.smithi138.stderr:1: [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] mon.noname-b 2024-09-14T11:40:10.087 INFO:tasks.workunit.client.0.smithi138.stderr:2: [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] mon.noname-c 2024-09-14T11:40:10.087 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-14T11:40:10.087 INFO:tasks.workunit.client.0.smithi138.stderr: -211> 2024-09-14T11:40:09.528+0000 7f7a769219c0 5 AuthRegistry(0x55f41a58fcb0) adding auth protocol: cephx 2024-09-14T11:40:10.087 INFO:tasks.workunit.client.0.smithi138.stderr: -210> 2024-09-14T11:40:09.528+0000 7f7a769219c0 5 AuthRegistry(0x55f41a58fcb0) adding auth protocol: cephx 2024-09-14T11:40:10.087 INFO:tasks.workunit.client.0.smithi138.stderr: -209> 2024-09-14T11:40:09.528+0000 7f7a769219c0 5 AuthRegistry(0x55f41a58fcb0) adding auth protocol: cephx 2024-09-14T11:40:10.087 INFO:tasks.workunit.client.0.smithi138.stderr: -208> 2024-09-14T11:40:09.528+0000 7f7a769219c0 5 AuthRegistry(0x55f41a58fcb0) adding con mode: secure 2024-09-14T11:40:10.087 INFO:tasks.workunit.client.0.smithi138.stderr: -207> 2024-09-14T11:40:09.528+0000 7f7a769219c0 5 AuthRegistry(0x55f41a58fcb0) adding con mode: crc 2024-09-14T11:40:10.087 INFO:tasks.workunit.client.0.smithi138.stderr: -206> 2024-09-14T11:40:09.528+0000 7f7a769219c0 5 AuthRegistry(0x55f41a58fcb0) adding con mode: secure 2024-09-14T11:40:10.087 INFO:tasks.workunit.client.0.smithi138.stderr: -205> 2024-09-14T11:40:09.528+0000 7f7a769219c0 5 AuthRegistry(0x55f41a58fcb0) adding con mode: crc 2024-09-14T11:40:10.087 INFO:tasks.workunit.client.0.smithi138.stderr: -204> 2024-09-14T11:40:09.528+0000 7f7a769219c0 5 AuthRegistry(0x55f41a58fcb0) adding con mode: secure 2024-09-14T11:40:10.087 INFO:tasks.workunit.client.0.smithi138.stderr: -203> 2024-09-14T11:40:09.528+0000 7f7a769219c0 5 AuthRegistry(0x55f41a58fcb0) adding con mode: crc 2024-09-14T11:40:10.087 INFO:tasks.workunit.client.0.smithi138.stderr: -202> 2024-09-14T11:40:09.528+0000 7f7a769219c0 5 AuthRegistry(0x55f41a58fcb0) adding con mode: crc 2024-09-14T11:40:10.088 INFO:tasks.workunit.client.0.smithi138.stderr: -201> 2024-09-14T11:40:09.528+0000 7f7a769219c0 5 AuthRegistry(0x55f41a58fcb0) adding con mode: secure 2024-09-14T11:40:10.088 INFO:tasks.workunit.client.0.smithi138.stderr: -200> 2024-09-14T11:40:09.528+0000 7f7a769219c0 5 AuthRegistry(0x55f41a58fcb0) adding con mode: crc 2024-09-14T11:40:10.088 INFO:tasks.workunit.client.0.smithi138.stderr: -199> 2024-09-14T11:40:09.528+0000 7f7a769219c0 5 AuthRegistry(0x55f41a58fcb0) adding con mode: secure 2024-09-14T11:40:10.088 INFO:tasks.workunit.client.0.smithi138.stderr: -198> 2024-09-14T11:40:09.528+0000 7f7a769219c0 5 AuthRegistry(0x55f41a58fcb0) adding con mode: crc 2024-09-14T11:40:10.088 INFO:tasks.workunit.client.0.smithi138.stderr: -197> 2024-09-14T11:40:09.528+0000 7f7a769219c0 5 AuthRegistry(0x55f41a58fcb0) adding con mode: secure 2024-09-14T11:40:10.088 INFO:tasks.workunit.client.0.smithi138.stderr: -196> 2024-09-14T11:40:09.528+0000 7f7a769219c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:40:10.088 INFO:tasks.workunit.client.0.smithi138.stderr: -195> 2024-09-14T11:40:09.528+0000 7f7a769219c0 1 librados: starting msgr at 2024-09-14T11:40:10.088 INFO:tasks.workunit.client.0.smithi138.stderr: -194> 2024-09-14T11:40:09.528+0000 7f7a769219c0 1 librados: starting objecter 2024-09-14T11:40:10.088 INFO:tasks.workunit.client.0.smithi138.stderr: -193> 2024-09-14T11:40:09.528+0000 7f7a769219c0 5 asok(0x55f41a2bfd90) register_command objecter_requests cmddesc objecter_requests hook 0x55f41a590930 EEXIST 2024-09-14T11:40:10.088 INFO:tasks.workunit.client.0.smithi138.stderr: -192> 2024-09-14T11:40:09.528+0000 7f7a769219c0 1 librados: setting wanted keys 2024-09-14T11:40:10.088 INFO:tasks.workunit.client.0.smithi138.stderr: -191> 2024-09-14T11:40:09.528+0000 7f7a769219c0 1 librados: calling monclient init 2024-09-14T11:40:10.088 INFO:tasks.workunit.client.0.smithi138.stderr: -190> 2024-09-14T11:40:09.528+0000 7f7a769219c0 10 monclient: init 2024-09-14T11:40:10.088 INFO:tasks.workunit.client.0.smithi138.stderr: -189> 2024-09-14T11:40:09.528+0000 7f7a769219c0 5 AuthRegistry(0x55f41a54b840) adding auth protocol: cephx 2024-09-14T11:40:10.088 INFO:tasks.workunit.client.0.smithi138.stderr: -188> 2024-09-14T11:40:09.528+0000 7f7a769219c0 5 AuthRegistry(0x55f41a54b840) adding auth protocol: cephx 2024-09-14T11:40:10.088 INFO:tasks.workunit.client.0.smithi138.stderr: -187> 2024-09-14T11:40:09.528+0000 7f7a769219c0 5 AuthRegistry(0x55f41a54b840) adding auth protocol: cephx 2024-09-14T11:40:10.089 INFO:tasks.workunit.client.0.smithi138.stderr: -186> 2024-09-14T11:40:09.528+0000 7f7a769219c0 5 AuthRegistry(0x55f41a54b840) adding con mode: secure 2024-09-14T11:40:10.089 INFO:tasks.workunit.client.0.smithi138.stderr: -185> 2024-09-14T11:40:09.528+0000 7f7a769219c0 5 AuthRegistry(0x55f41a54b840) adding con mode: crc 2024-09-14T11:40:10.089 INFO:tasks.workunit.client.0.smithi138.stderr: -184> 2024-09-14T11:40:09.528+0000 7f7a769219c0 5 AuthRegistry(0x55f41a54b840) adding con mode: secure 2024-09-14T11:40:10.089 INFO:tasks.workunit.client.0.smithi138.stderr: -183> 2024-09-14T11:40:09.528+0000 7f7a769219c0 5 AuthRegistry(0x55f41a54b840) adding con mode: crc 2024-09-14T11:40:10.089 INFO:tasks.workunit.client.0.smithi138.stderr: -182> 2024-09-14T11:40:09.528+0000 7f7a769219c0 5 AuthRegistry(0x55f41a54b840) adding con mode: secure 2024-09-14T11:40:10.089 INFO:tasks.workunit.client.0.smithi138.stderr: -181> 2024-09-14T11:40:09.528+0000 7f7a769219c0 5 AuthRegistry(0x55f41a54b840) adding con mode: crc 2024-09-14T11:40:10.089 INFO:tasks.workunit.client.0.smithi138.stderr: -180> 2024-09-14T11:40:09.528+0000 7f7a769219c0 5 AuthRegistry(0x55f41a54b840) adding con mode: crc 2024-09-14T11:40:10.089 INFO:tasks.workunit.client.0.smithi138.stderr: -179> 2024-09-14T11:40:09.528+0000 7f7a769219c0 5 AuthRegistry(0x55f41a54b840) adding con mode: secure 2024-09-14T11:40:10.089 INFO:tasks.workunit.client.0.smithi138.stderr: -178> 2024-09-14T11:40:09.528+0000 7f7a769219c0 5 AuthRegistry(0x55f41a54b840) adding con mode: crc 2024-09-14T11:40:10.089 INFO:tasks.workunit.client.0.smithi138.stderr: -177> 2024-09-14T11:40:09.528+0000 7f7a769219c0 5 AuthRegistry(0x55f41a54b840) adding con mode: secure 2024-09-14T11:40:10.089 INFO:tasks.workunit.client.0.smithi138.stderr: -176> 2024-09-14T11:40:09.528+0000 7f7a769219c0 5 AuthRegistry(0x55f41a54b840) adding con mode: crc 2024-09-14T11:40:10.089 INFO:tasks.workunit.client.0.smithi138.stderr: -175> 2024-09-14T11:40:09.528+0000 7f7a769219c0 5 AuthRegistry(0x55f41a54b840) adding con mode: secure 2024-09-14T11:40:10.089 INFO:tasks.workunit.client.0.smithi138.stderr: -174> 2024-09-14T11:40:09.528+0000 7f7a769219c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:40:10.089 INFO:tasks.workunit.client.0.smithi138.stderr: -173> 2024-09-14T11:40:09.528+0000 7f7a769219c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:40:10.089 INFO:tasks.workunit.client.0.smithi138.stderr: -172> 2024-09-14T11:40:09.528+0000 7f7a769219c0 5 asok(0x55f41a2bfd90) register_command rotate-key cmddesc rotate-key hook 0x55f41a54b988 EEXIST 2024-09-14T11:40:10.090 INFO:tasks.workunit.client.0.smithi138.stderr: -171> 2024-09-14T11:40:09.528+0000 7f7a769219c0 10 monclient: _reopen_session rank -1 2024-09-14T11:40:10.090 INFO:tasks.workunit.client.0.smithi138.stderr: -170> 2024-09-14T11:40:09.528+0000 7f7a769219c0 10 monclient: _add_conns ranks=[1,0,2] 2024-09-14T11:40:10.090 INFO:tasks.workunit.client.0.smithi138.stderr: -169> 2024-09-14T11:40:09.528+0000 7f7a769219c0 10 monclient(hunting): picked mon.noname-b con 0x55f41a598cc0 addr [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] 2024-09-14T11:40:10.090 INFO:tasks.workunit.client.0.smithi138.stderr: -168> 2024-09-14T11:40:09.528+0000 7f7a769219c0 10 monclient(hunting): picked mon.noname-a con 0x55f41a599640 addr [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] 2024-09-14T11:40:10.090 INFO:tasks.workunit.client.0.smithi138.stderr: -167> 2024-09-14T11:40:09.528+0000 7f7a769219c0 10 monclient(hunting): picked mon.noname-c con 0x55f41a59d8d0 addr [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] 2024-09-14T11:40:10.090 INFO:tasks.workunit.client.0.smithi138.stderr: -166> 2024-09-14T11:40:09.528+0000 7f7a769219c0 10 monclient(hunting): start opening mon connection 2024-09-14T11:40:10.090 INFO:tasks.workunit.client.0.smithi138.stderr: -165> 2024-09-14T11:40:09.528+0000 7f7a769219c0 10 monclient(hunting): start opening mon connection 2024-09-14T11:40:10.090 INFO:tasks.workunit.client.0.smithi138.stderr: -164> 2024-09-14T11:40:09.528+0000 7f7a769219c0 10 monclient(hunting): start opening mon connection 2024-09-14T11:40:10.090 INFO:tasks.workunit.client.0.smithi138.stderr: -163> 2024-09-14T11:40:09.528+0000 7f7a769219c0 10 monclient(hunting): _renew_subs 2024-09-14T11:40:10.090 INFO:tasks.workunit.client.0.smithi138.stderr: -162> 2024-09-14T11:40:09.528+0000 7f7a769219c0 10 monclient(hunting): authenticate will time out at 2945.491639s 2024-09-14T11:40:10.090 INFO:tasks.workunit.client.0.smithi138.stderr: -161> 2024-09-14T11:40:09.528+0000 7f7a74c28640 10 monclient(hunting): get_auth_request con 0x55f41a599640 auth_method 0 2024-09-14T11:40:10.090 INFO:tasks.workunit.client.0.smithi138.stderr: -160> 2024-09-14T11:40:09.528+0000 7f7a74c28640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:40:10.090 INFO:tasks.workunit.client.0.smithi138.stderr: -159> 2024-09-14T11:40:09.528+0000 7f7a74c28640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:40:10.090 INFO:tasks.workunit.client.0.smithi138.stderr: -158> 2024-09-14T11:40:09.528+0000 7f7a74c28640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:40:10.090 INFO:tasks.workunit.client.0.smithi138.stderr: -157> 2024-09-14T11:40:09.528+0000 7f7a74427640 10 monclient(hunting): get_auth_request con 0x55f41a59d8d0 auth_method 0 2024-09-14T11:40:10.091 INFO:tasks.workunit.client.0.smithi138.stderr: -156> 2024-09-14T11:40:09.528+0000 7f7a74427640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:40:10.091 INFO:tasks.workunit.client.0.smithi138.stderr: -155> 2024-09-14T11:40:09.528+0000 7f7a74427640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:40:10.091 INFO:tasks.workunit.client.0.smithi138.stderr: -154> 2024-09-14T11:40:09.528+0000 7f7a74427640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:40:10.091 INFO:tasks.workunit.client.0.smithi138.stderr: -153> 2024-09-14T11:40:09.528+0000 7f7a74c28640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:40:10.091 INFO:tasks.workunit.client.0.smithi138.stderr: -152> 2024-09-14T11:40:09.528+0000 7f7a74c28640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:40:10.091 INFO:tasks.workunit.client.0.smithi138.stderr: -151> 2024-09-14T11:40:09.528+0000 7f7a74c28640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:40:10.091 INFO:tasks.workunit.client.0.smithi138.stderr: -150> 2024-09-14T11:40:09.528+0000 7f7a74427640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:40:10.091 INFO:tasks.workunit.client.0.smithi138.stderr: -149> 2024-09-14T11:40:09.528+0000 7f7a74427640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:40:10.091 INFO:tasks.workunit.client.0.smithi138.stderr: -148> 2024-09-14T11:40:09.528+0000 7f7a74427640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:40:10.091 INFO:tasks.workunit.client.0.smithi138.stderr: -147> 2024-09-14T11:40:09.532+0000 7f7a73c26640 10 monclient(hunting): get_auth_request con 0x55f41a598cc0 auth_method 0 2024-09-14T11:40:10.091 INFO:tasks.workunit.client.0.smithi138.stderr: -146> 2024-09-14T11:40:09.532+0000 7f7a73c26640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:40:10.091 INFO:tasks.workunit.client.0.smithi138.stderr: -145> 2024-09-14T11:40:09.532+0000 7f7a73c26640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:40:10.091 INFO:tasks.workunit.client.0.smithi138.stderr: -144> 2024-09-14T11:40:09.532+0000 7f7a73c26640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:40:10.092 INFO:tasks.workunit.client.0.smithi138.stderr: -143> 2024-09-14T11:40:09.532+0000 7f7a74c28640 10 monclient(hunting): handle_auth_done global_id 8148 payload 824 2024-09-14T11:40:10.092 INFO:tasks.workunit.client.0.smithi138.stderr: -142> 2024-09-14T11:40:09.532+0000 7f7a74c28640 10 monclient: _finish_hunting 0 2024-09-14T11:40:10.092 INFO:tasks.workunit.client.0.smithi138.stderr: -141> 2024-09-14T11:40:09.532+0000 7f7a74c28640 1 monclient: found mon.noname-a 2024-09-14T11:40:10.092 INFO:tasks.workunit.client.0.smithi138.stderr: -140> 2024-09-14T11:40:09.532+0000 7f7a74c28640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.138:3300/0 2024-09-14T11:40:10.092 INFO:tasks.workunit.client.0.smithi138.stderr: -139> 2024-09-14T11:40:09.532+0000 7f7949ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:40:10.092 INFO:tasks.workunit.client.0.smithi138.stderr: -138> 2024-09-14T11:40:09.532+0000 7f7949ffb640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-14T11:40:10.092 INFO:tasks.workunit.client.0.smithi138.stderr: -137> 2024-09-14T11:40:09.532+0000 7f7949ffb640 10 monclient: dump: 2024-09-14T11:40:10.092 INFO:tasks.workunit.client.0.smithi138.stderr:epoch 1 2024-09-14T11:40:10.092 INFO:tasks.workunit.client.0.smithi138.stderr:fsid 3f225f43-83a6-4aeb-b798-1f04bb49d597 2024-09-14T11:40:10.092 INFO:tasks.workunit.client.0.smithi138.stderr:last_changed 2024-09-14T11:07:09.252780+0000 2024-09-14T11:40:10.092 INFO:tasks.workunit.client.0.smithi138.stderr:created 2024-09-14T11:07:09.252780+0000 2024-09-14T11:40:10.092 INFO:tasks.workunit.client.0.smithi138.stderr:min_mon_release 19 (squid) 2024-09-14T11:40:10.092 INFO:tasks.workunit.client.0.smithi138.stderr:election_strategy: 1 2024-09-14T11:40:10.092 INFO:tasks.workunit.client.0.smithi138.stderr:0: [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] mon.a 2024-09-14T11:40:10.093 INFO:tasks.workunit.client.0.smithi138.stderr:1: [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] mon.b 2024-09-14T11:40:10.093 INFO:tasks.workunit.client.0.smithi138.stderr:2: [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] mon.c 2024-09-14T11:40:10.093 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-14T11:40:10.093 INFO:tasks.workunit.client.0.smithi138.stderr: -136> 2024-09-14T11:40:09.532+0000 7f7949ffb640 10 monclient: _finish_auth 0 2024-09-14T11:40:10.093 INFO:tasks.workunit.client.0.smithi138.stderr: -135> 2024-09-14T11:40:09.532+0000 7f7949ffb640 10 monclient: _check_auth_tickets 2024-09-14T11:40:10.093 INFO:tasks.workunit.client.0.smithi138.stderr: -134> 2024-09-14T11:40:09.532+0000 7f7949ffb640 10 monclient: handle_config config(0 keys) 2024-09-14T11:40:10.093 INFO:tasks.workunit.client.0.smithi138.stderr: -133> 2024-09-14T11:40:09.532+0000 7f7949ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:40:10.093 INFO:tasks.workunit.client.0.smithi138.stderr: -132> 2024-09-14T11:40:09.532+0000 7f7949ffb640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-14T11:40:10.093 INFO:tasks.workunit.client.0.smithi138.stderr: -131> 2024-09-14T11:40:09.532+0000 7f7949ffb640 10 monclient: dump: 2024-09-14T11:40:10.093 INFO:tasks.workunit.client.0.smithi138.stderr:epoch 1 2024-09-14T11:40:10.093 INFO:tasks.workunit.client.0.smithi138.stderr:fsid 3f225f43-83a6-4aeb-b798-1f04bb49d597 2024-09-14T11:40:10.093 INFO:tasks.workunit.client.0.smithi138.stderr:last_changed 2024-09-14T11:07:09.252780+0000 2024-09-14T11:40:10.093 INFO:tasks.workunit.client.0.smithi138.stderr:created 2024-09-14T11:07:09.252780+0000 2024-09-14T11:40:10.093 INFO:tasks.workunit.client.0.smithi138.stderr:min_mon_release 19 (squid) 2024-09-14T11:40:10.094 INFO:tasks.workunit.client.0.smithi138.stderr:election_strategy: 1 2024-09-14T11:40:10.094 INFO:tasks.workunit.client.0.smithi138.stderr:0: [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] mon.a 2024-09-14T11:40:10.094 INFO:tasks.workunit.client.0.smithi138.stderr:1: [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] mon.b 2024-09-14T11:40:10.094 INFO:tasks.workunit.client.0.smithi138.stderr:2: [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] mon.c 2024-09-14T11:40:10.094 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-14T11:40:10.094 INFO:tasks.workunit.client.0.smithi138.stderr: -130> 2024-09-14T11:40:09.532+0000 7f794b7fe640 4 set_mon_vals no callback set 2024-09-14T11:40:10.094 INFO:tasks.workunit.client.0.smithi138.stderr: -129> 2024-09-14T11:40:09.532+0000 7f7a769219c0 5 monclient: authenticate success, global_id 8148 2024-09-14T11:40:10.094 INFO:tasks.workunit.client.0.smithi138.stderr: -128> 2024-09-14T11:40:09.532+0000 7f7a769219c0 10 monclient: _renew_subs 2024-09-14T11:40:10.094 INFO:tasks.workunit.client.0.smithi138.stderr: -127> 2024-09-14T11:40:09.532+0000 7f7a769219c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.138:3300/0 2024-09-14T11:40:10.094 INFO:tasks.workunit.client.0.smithi138.stderr: -126> 2024-09-14T11:40:09.532+0000 7f7a769219c0 10 monclient: _renew_subs 2024-09-14T11:40:10.094 INFO:tasks.workunit.client.0.smithi138.stderr: -125> 2024-09-14T11:40:09.532+0000 7f7a769219c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.138:3300/0 2024-09-14T11:40:10.094 INFO:tasks.workunit.client.0.smithi138.stderr: -124> 2024-09-14T11:40:09.532+0000 7f7a769219c0 1 librados: init done 2024-09-14T11:40:10.094 INFO:tasks.workunit.client.0.smithi138.stderr: -123> 2024-09-14T11:40:09.532+0000 7f7a769219c0 5 asok(0x55f41a2bfd90) register_command cr dump hook 0x55f41a5980e8 2024-09-14T11:40:10.095 INFO:tasks.workunit.client.0.smithi138.stderr: -122> 2024-09-14T11:40:09.532+0000 7f7a769219c0 20 rados->read ofs=0 len=0 2024-09-14T11:40:10.095 INFO:tasks.workunit.client.0.smithi138.stderr: -121> 2024-09-14T11:40:09.532+0000 7f7949ffb640 4 mgrc handle_mgr_map Got map version 5 2024-09-14T11:40:10.095 INFO:tasks.workunit.client.0.smithi138.stderr: -120> 2024-09-14T11:40:09.532+0000 7f7949ffb640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.138:6832/3778043143,v1:172.21.15.138:6833/3778043143] 2024-09-14T11:40:10.095 INFO:tasks.workunit.client.0.smithi138.stderr: -119> 2024-09-14T11:40:09.532+0000 7f7949ffb640 4 mgrc reconnect Starting new session with [v2:172.21.15.138:6832/3778043143,v1:172.21.15.138:6833/3778043143] 2024-09-14T11:40:10.095 INFO:tasks.workunit.client.0.smithi138.stderr: -118> 2024-09-14T11:40:09.532+0000 7f7a73c26640 10 monclient: get_auth_request con 0x7f793c0718d0 auth_method 0 2024-09-14T11:40:10.095 INFO:tasks.workunit.client.0.smithi138.stderr: -117> 2024-09-14T11:40:09.532+0000 7f7a74427640 10 monclient: get_auth_request con 0x55f41a5b6fe0 auth_method 0 2024-09-14T11:40:10.095 INFO:tasks.workunit.client.0.smithi138.stderr: -116> 2024-09-14T11:40:09.536+0000 7f7a769219c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:40:10.095 INFO:tasks.workunit.client.0.smithi138.stderr: -115> 2024-09-14T11:40:09.536+0000 7f7a769219c0 20 realm 2024-09-14T11:40:10.095 INFO:tasks.workunit.client.0.smithi138.stderr: -114> 2024-09-14T11:40:09.536+0000 7f7a769219c0 20 rados->read ofs=0 len=0 2024-09-14T11:40:10.095 INFO:tasks.workunit.client.0.smithi138.stderr: -113> 2024-09-14T11:40:09.536+0000 7f7a769219c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:40:10.095 INFO:tasks.workunit.client.0.smithi138.stderr: -112> 2024-09-14T11:40:09.536+0000 7f7a769219c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:40:10.095 INFO:tasks.workunit.client.0.smithi138.stderr: -111> 2024-09-14T11:40:09.536+0000 7f7a769219c0 20 rados->read ofs=0 len=0 2024-09-14T11:40:10.095 INFO:tasks.workunit.client.0.smithi138.stderr: -110> 2024-09-14T11:40:09.536+0000 7f7a769219c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:40:10.095 INFO:tasks.workunit.client.0.smithi138.stderr: -109> 2024-09-14T11:40:09.536+0000 7f7a769219c0 20 rados->read ofs=0 len=0 2024-09-14T11:40:10.096 INFO:tasks.workunit.client.0.smithi138.stderr: -108> 2024-09-14T11:40:09.536+0000 7f7a73c26640 10 monclient: get_auth_request con 0x55f41a5bb0b0 auth_method 0 2024-09-14T11:40:10.096 INFO:tasks.workunit.client.0.smithi138.stderr: -107> 2024-09-14T11:40:09.536+0000 7f7a769219c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:40:10.096 INFO:tasks.workunit.client.0.smithi138.stderr: -106> 2024-09-14T11:40:09.536+0000 7f7a769219c0 20 rados->read ofs=0 len=0 2024-09-14T11:40:10.096 INFO:tasks.workunit.client.0.smithi138.stderr: -105> 2024-09-14T11:40:09.536+0000 7f7a74c28640 10 monclient: get_auth_request con 0x55f41a5be8f0 auth_method 0 2024-09-14T11:40:10.096 INFO:tasks.workunit.client.0.smithi138.stderr: -104> 2024-09-14T11:40:09.536+0000 7f7a769219c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:40:10.096 INFO:tasks.workunit.client.0.smithi138.stderr: -103> 2024-09-14T11:40:09.536+0000 7f7a769219c0 20 searching for the correct realm 2024-09-14T11:40:10.096 INFO:tasks.workunit.client.0.smithi138.stderr: -102> 2024-09-14T11:40:09.536+0000 7f7a74427640 10 monclient: get_auth_request con 0x55f41a5c3670 auth_method 0 2024-09-14T11:40:10.096 INFO:tasks.workunit.client.0.smithi138.stderr: -101> 2024-09-14T11:40:09.540+0000 7f7a73c26640 10 monclient: get_auth_request con 0x7f7a6403d360 auth_method 0 2024-09-14T11:40:10.096 INFO:tasks.workunit.client.0.smithi138.stderr: -100> 2024-09-14T11:40:09.540+0000 7f7a74c28640 0 -- 172.21.15.138:0/2740999781 >> [v2:172.21.15.154:6824/416768175,v1:172.21.15.154:6825/416768175] conn(0x7f7a6c044060 msgr2=0x7f7a6c086270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:40:10.096 INFO:tasks.workunit.client.0.smithi138.stderr: -99> 2024-09-14T11:40:09.540+0000 7f7a74c28640 10 monclient: get_auth_request con 0x7f7a6c044060 auth_method 0 2024-09-14T11:40:10.096 INFO:tasks.workunit.client.0.smithi138.stderr: -98> 2024-09-14T11:40:09.744+0000 7f7a74c28640 10 monclient: get_auth_request con 0x7f7a6c044060 auth_method 0 2024-09-14T11:40:10.096 INFO:tasks.workunit.client.0.smithi138.stderr: -97> 2024-09-14T11:40:09.748+0000 7f7a74427640 10 monclient: get_auth_request con 0x7f7a6c019040 auth_method 0 2024-09-14T11:40:10.096 INFO:tasks.workunit.client.0.smithi138.stderr: -96> 2024-09-14T11:40:09.756+0000 7f7a73c26640 10 monclient: get_auth_request con 0x7f7a6c09b090 auth_method 0 2024-09-14T11:40:10.096 INFO:tasks.workunit.client.0.smithi138.stderr: -95> 2024-09-14T11:40:09.756+0000 7f7a73c26640 0 -- 172.21.15.138:0/2740999781 >> [v2:172.21.15.138:6816/326481658,v1:172.21.15.138:6817/326481658] conn(0x7f7a6c09b090 msgr2=0x7f7a6c0274f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:40:10.097 INFO:tasks.workunit.client.0.smithi138.stderr: -94> 2024-09-14T11:40:09.960+0000 7f7a73c26640 10 monclient: get_auth_request con 0x7f7a6c09b090 auth_method 0 2024-09-14T11:40:10.097 INFO:tasks.workunit.client.0.smithi138.stderr: -93> 2024-09-14T11:40:09.972+0000 7f7a769219c0 20 RGWRados::pool_iterate: got zone_info.d9e72d30-c60b-4d0d-9267-fdc36392d5ad 2024-09-14T11:40:10.097 INFO:tasks.workunit.client.0.smithi138.stderr: -92> 2024-09-14T11:40:09.972+0000 7f7a769219c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:40:10.097 INFO:tasks.workunit.client.0.smithi138.stderr: -91> 2024-09-14T11:40:09.972+0000 7f7a769219c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:40:10.097 INFO:tasks.workunit.client.0.smithi138.stderr: -90> 2024-09-14T11:40:09.972+0000 7f7a769219c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:40:10.097 INFO:tasks.workunit.client.0.smithi138.stderr: -89> 2024-09-14T11:40:09.972+0000 7f7a769219c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:40:10.097 INFO:tasks.workunit.client.0.smithi138.stderr: -88> 2024-09-14T11:40:09.972+0000 7f7a769219c0 20 RGWRados::pool_iterate: got zonegroup_info.65ab941b-da8c-4160-94fb-3672b069d44f 2024-09-14T11:40:10.097 INFO:tasks.workunit.client.0.smithi138.stderr: -87> 2024-09-14T11:40:09.972+0000 7f7a769219c0 20 rados->read ofs=0 len=0 2024-09-14T11:40:10.097 INFO:tasks.workunit.client.0.smithi138.stderr: -86> 2024-09-14T11:40:09.976+0000 7f7a769219c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:40:10.097 INFO:tasks.workunit.client.0.smithi138.stderr: -85> 2024-09-14T11:40:09.976+0000 7f7a769219c0 20 rados->read ofs=0 len=0 2024-09-14T11:40:10.097 INFO:tasks.workunit.client.0.smithi138.stderr: -84> 2024-09-14T11:40:09.976+0000 7f7a769219c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:40:10.097 INFO:tasks.workunit.client.0.smithi138.stderr: -83> 2024-09-14T11:40:09.976+0000 7f7a769219c0 20 rados->read ofs=0 len=0 2024-09-14T11:40:10.097 INFO:tasks.workunit.client.0.smithi138.stderr: -82> 2024-09-14T11:40:09.976+0000 7f7a769219c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:40:10.097 INFO:tasks.workunit.client.0.smithi138.stderr: -81> 2024-09-14T11:40:09.976+0000 7f7a769219c0 20 zone default found 2024-09-14T11:40:10.097 INFO:tasks.workunit.client.0.smithi138.stderr: -80> 2024-09-14T11:40:09.976+0000 7f7a769219c0 4 Realm: () 2024-09-14T11:40:10.098 INFO:tasks.workunit.client.0.smithi138.stderr: -79> 2024-09-14T11:40:09.976+0000 7f7a769219c0 4 ZoneGroup: default (65ab941b-da8c-4160-94fb-3672b069d44f) 2024-09-14T11:40:10.098 INFO:tasks.workunit.client.0.smithi138.stderr: -78> 2024-09-14T11:40:09.976+0000 7f7a769219c0 4 Zone: default (d9e72d30-c60b-4d0d-9267-fdc36392d5ad) 2024-09-14T11:40:10.098 INFO:tasks.workunit.client.0.smithi138.stderr: -77> 2024-09-14T11:40:09.976+0000 7f7a769219c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:40:10.098 INFO:tasks.workunit.client.0.smithi138.stderr: -76> 2024-09-14T11:40:09.976+0000 7f7a769219c0 20 zonegroup default 2024-09-14T11:40:10.098 INFO:tasks.workunit.client.0.smithi138.stderr: -75> 2024-09-14T11:40:09.976+0000 7f7a769219c0 20 rados->read ofs=0 len=0 2024-09-14T11:40:10.098 INFO:tasks.workunit.client.0.smithi138.stderr: -74> 2024-09-14T11:40:09.976+0000 7f7a769219c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:40:10.098 INFO:tasks.workunit.client.0.smithi138.stderr: -73> 2024-09-14T11:40:09.976+0000 7f7a769219c0 20 rados->read ofs=0 len=0 2024-09-14T11:40:10.098 INFO:tasks.workunit.client.0.smithi138.stderr: -72> 2024-09-14T11:40:09.980+0000 7f7a769219c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:40:10.098 INFO:tasks.workunit.client.0.smithi138.stderr: -71> 2024-09-14T11:40:09.980+0000 7f7a769219c0 20 rados->read ofs=0 len=0 2024-09-14T11:40:10.098 INFO:tasks.workunit.client.0.smithi138.stderr: -70> 2024-09-14T11:40:09.980+0000 7f7a769219c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:40:10.098 INFO:tasks.workunit.client.0.smithi138.stderr: -69> 2024-09-14T11:40:09.980+0000 7f7a769219c0 20 started sync module instance, tier type = 2024-09-14T11:40:10.098 INFO:tasks.workunit.client.0.smithi138.stderr: -68> 2024-09-14T11:40:09.980+0000 7f7a769219c0 20 started zone id=d9e72d30-c60b-4d0d-9267-fdc36392d5ad (name=default) with tier type = 2024-09-14T11:40:10.098 INFO:tasks.workunit.client.0.smithi138.stderr: -67> 2024-09-14T11:40:10.000+0000 7f7a769219c0 20 add_watcher() i=0 2024-09-14T11:40:10.098 INFO:tasks.workunit.client.0.smithi138.stderr: -66> 2024-09-14T11:40:10.000+0000 7f7a769219c0 20 add_watcher() i=1 2024-09-14T11:40:10.098 INFO:tasks.workunit.client.0.smithi138.stderr: -65> 2024-09-14T11:40:10.004+0000 7f7a769219c0 20 add_watcher() i=2 2024-09-14T11:40:10.099 INFO:tasks.workunit.client.0.smithi138.stderr: -64> 2024-09-14T11:40:10.004+0000 7f7a769219c0 20 add_watcher() i=3 2024-09-14T11:40:10.099 INFO:tasks.workunit.client.0.smithi138.stderr: -63> 2024-09-14T11:40:10.004+0000 7f7a769219c0 20 add_watcher() i=4 2024-09-14T11:40:10.099 INFO:tasks.workunit.client.0.smithi138.stderr: -62> 2024-09-14T11:40:10.004+0000 7f7a769219c0 20 add_watcher() i=5 2024-09-14T11:40:10.099 INFO:tasks.workunit.client.0.smithi138.stderr: -61> 2024-09-14T11:40:10.004+0000 7f7a769219c0 20 add_watcher() i=6 2024-09-14T11:40:10.099 INFO:tasks.workunit.client.0.smithi138.stderr: -60> 2024-09-14T11:40:10.004+0000 7f7a769219c0 20 add_watcher() i=7 2024-09-14T11:40:10.099 INFO:tasks.workunit.client.0.smithi138.stderr: -59> 2024-09-14T11:40:10.004+0000 7f7a769219c0 2 all 8 watchers are set, enabling cache 2024-09-14T11:40:10.099 INFO:tasks.workunit.client.0.smithi138.stderr: -58> 2024-09-14T11:40:10.008+0000 7f7a769219c0 5 AuthRegistry(0x7ffece940d60) adding auth protocol: cephx 2024-09-14T11:40:10.099 INFO:tasks.workunit.client.0.smithi138.stderr: -57> 2024-09-14T11:40:10.008+0000 7f7a769219c0 5 AuthRegistry(0x7ffece940d60) adding auth protocol: cephx 2024-09-14T11:40:10.099 INFO:tasks.workunit.client.0.smithi138.stderr: -56> 2024-09-14T11:40:10.008+0000 7f7a769219c0 5 AuthRegistry(0x7ffece940d60) adding auth protocol: cephx 2024-09-14T11:40:10.099 INFO:tasks.workunit.client.0.smithi138.stderr: -55> 2024-09-14T11:40:10.008+0000 7f7a769219c0 5 AuthRegistry(0x7ffece940d60) adding con mode: secure 2024-09-14T11:40:10.099 INFO:tasks.workunit.client.0.smithi138.stderr: -54> 2024-09-14T11:40:10.008+0000 7f7a769219c0 5 AuthRegistry(0x7ffece940d60) adding con mode: crc 2024-09-14T11:40:10.099 INFO:tasks.workunit.client.0.smithi138.stderr: -53> 2024-09-14T11:40:10.008+0000 7f7a769219c0 5 AuthRegistry(0x7ffece940d60) adding con mode: secure 2024-09-14T11:40:10.099 INFO:tasks.workunit.client.0.smithi138.stderr: -52> 2024-09-14T11:40:10.008+0000 7f792afdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:40:10.099 INFO:tasks.workunit.client.0.smithi138.stderr: -51> 2024-09-14T11:40:10.008+0000 7f7a769219c0 5 AuthRegistry(0x7ffece940d60) adding con mode: crc 2024-09-14T11:40:10.099 INFO:tasks.workunit.client.0.smithi138.stderr: -50> 2024-09-14T11:40:10.008+0000 7f7a769219c0 5 AuthRegistry(0x7ffece940d60) adding con mode: secure 2024-09-14T11:40:10.099 INFO:tasks.workunit.client.0.smithi138.stderr: -49> 2024-09-14T11:40:10.008+0000 7f7a769219c0 5 AuthRegistry(0x7ffece940d60) adding con mode: crc 2024-09-14T11:40:10.100 INFO:tasks.workunit.client.0.smithi138.stderr: -48> 2024-09-14T11:40:10.008+0000 7f7a769219c0 5 AuthRegistry(0x7ffece940d60) adding con mode: crc 2024-09-14T11:40:10.100 INFO:tasks.workunit.client.0.smithi138.stderr: -47> 2024-09-14T11:40:10.008+0000 7f7a769219c0 5 AuthRegistry(0x7ffece940d60) adding con mode: secure 2024-09-14T11:40:10.100 INFO:tasks.workunit.client.0.smithi138.stderr: -46> 2024-09-14T11:40:10.008+0000 7f7a769219c0 5 AuthRegistry(0x7ffece940d60) adding con mode: crc 2024-09-14T11:40:10.100 INFO:tasks.workunit.client.0.smithi138.stderr: -45> 2024-09-14T11:40:10.008+0000 7f7a769219c0 5 AuthRegistry(0x7ffece940d60) adding con mode: secure 2024-09-14T11:40:10.100 INFO:tasks.workunit.client.0.smithi138.stderr: -44> 2024-09-14T11:40:10.008+0000 7f7a769219c0 5 AuthRegistry(0x7ffece940d60) adding con mode: crc 2024-09-14T11:40:10.100 INFO:tasks.workunit.client.0.smithi138.stderr: -43> 2024-09-14T11:40:10.008+0000 7f7a769219c0 5 AuthRegistry(0x7ffece940d60) adding con mode: secure 2024-09-14T11:40:10.100 INFO:tasks.workunit.client.0.smithi138.stderr: -42> 2024-09-14T11:40:10.008+0000 7f7a769219c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:40:10.100 INFO:tasks.workunit.client.0.smithi138.stderr: -41> 2024-09-14T11:40:10.008+0000 7f7a769219c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:40:10.100 INFO:tasks.workunit.client.0.smithi138.stderr: -40> 2024-09-14T11:40:10.008+0000 7f7a769219c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:40:10.100 INFO:tasks.workunit.client.0.smithi138.stderr: -39> 2024-09-14T11:40:10.008+0000 7f7a769219c0 5 asok(0x55f41a2bfd90) register_command cache list hook 0x55f41a599110 2024-09-14T11:40:10.100 INFO:tasks.workunit.client.0.smithi138.stderr: -38> 2024-09-14T11:40:10.008+0000 7f7a769219c0 5 asok(0x55f41a2bfd90) register_command cache inspect hook 0x55f41a599110 2024-09-14T11:40:10.100 INFO:tasks.workunit.client.0.smithi138.stderr: -37> 2024-09-14T11:40:10.008+0000 7f7a769219c0 5 asok(0x55f41a2bfd90) register_command cache erase hook 0x55f41a599110 2024-09-14T11:40:10.100 INFO:tasks.workunit.client.0.smithi138.stderr: -36> 2024-09-14T11:40:10.008+0000 7f7a769219c0 5 asok(0x55f41a2bfd90) register_command cache zap hook 0x55f41a599110 2024-09-14T11:40:10.100 INFO:tasks.workunit.client.0.smithi138.stderr: -35> 2024-09-14T11:40:10.008+0000 7f7a769219c0 5 note: GC not initialized 2024-09-14T11:40:10.100 INFO:tasks.workunit.client.0.smithi138.stderr: -34> 2024-09-14T11:40:10.008+0000 7f7929fdb640 20 reqs_thread_entry: start 2024-09-14T11:40:10.101 INFO:tasks.workunit.client.0.smithi138.stderr: -33> 2024-09-14T11:40:10.008+0000 7f7a769219c0 5 asok(0x55f41a2bfd90) register_command sync trace show hook 0x7f7a64005520 2024-09-14T11:40:10.101 INFO:tasks.workunit.client.0.smithi138.stderr: -32> 2024-09-14T11:40:10.008+0000 7f7a769219c0 5 asok(0x55f41a2bfd90) register_command sync trace history hook 0x7f7a64005520 2024-09-14T11:40:10.101 INFO:tasks.workunit.client.0.smithi138.stderr: -31> 2024-09-14T11:40:10.008+0000 7f7a769219c0 5 asok(0x55f41a2bfd90) register_command sync trace active hook 0x7f7a64005520 2024-09-14T11:40:10.101 INFO:tasks.workunit.client.0.smithi138.stderr: -30> 2024-09-14T11:40:10.008+0000 7f7a769219c0 5 asok(0x55f41a2bfd90) register_command sync trace active_short hook 0x7f7a64005520 2024-09-14T11:40:10.101 INFO:tasks.workunit.client.0.smithi138.stderr: -29> 2024-09-14T11:40:10.008+0000 7f7a769219c0 20 init_complete bucket index max shards: 11 2024-09-14T11:40:10.101 INFO:tasks.workunit.client.0.smithi138.stderr: -28> 2024-09-14T11:40:10.008+0000 7f7a769219c0 20 Filter name: none 2024-09-14T11:40:10.101 INFO:tasks.workunit.client.0.smithi138.stderr: -27> 2024-09-14T11:40:10.008+0000 7f789b7fe640 20 reqs_thread_entry: start 2024-09-14T11:40:10.101 INFO:tasks.workunit.client.0.smithi138.stderr: -26> 2024-09-14T11:40:10.008+0000 7f7a769219c0 10 cache get: name=default.rgw.meta+root+a-bucket : miss 2024-09-14T11:40:10.101 INFO:tasks.workunit.client.0.smithi138.stderr: -25> 2024-09-14T11:40:10.008+0000 7f7a769219c0 20 rados->read ofs=0 len=0 2024-09-14T11:40:10.101 INFO:tasks.workunit.client.0.smithi138.stderr: -24> 2024-09-14T11:40:10.008+0000 7f7a769219c0 20 rados_obj.operate() r=0 bl.length=176 2024-09-14T11:40:10.101 INFO:tasks.workunit.client.0.smithi138.stderr: -23> 2024-09-14T11:40:10.008+0000 7f7a769219c0 10 cache put: name=default.rgw.meta+root+a-bucket info.flags=0x11 2024-09-14T11:40:10.101 INFO:tasks.workunit.client.0.smithi138.stderr: -22> 2024-09-14T11:40:10.008+0000 7f7a769219c0 10 adding default.rgw.meta+root+a-bucket to cache LRU end 2024-09-14T11:40:10.101 INFO:tasks.workunit.client.0.smithi138.stderr: -21> 2024-09-14T11:40:10.008+0000 7f7a769219c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.17 : miss 2024-09-14T11:40:10.101 INFO:tasks.workunit.client.0.smithi138.stderr: -20> 2024-09-14T11:40:10.008+0000 7f7a769219c0 20 rados->read ofs=0 len=0 2024-09-14T11:40:10.102 INFO:tasks.workunit.client.0.smithi138.stderr: -19> 2024-09-14T11:40:10.012+0000 7f7a769219c0 20 rados_obj.operate() r=0 bl.length=398 2024-09-14T11:40:10.102 INFO:tasks.workunit.client.0.smithi138.stderr: -18> 2024-09-14T11:40:10.012+0000 7f7a769219c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.17 info.flags=0x17 2024-09-14T11:40:10.102 INFO:tasks.workunit.client.0.smithi138.stderr: -17> 2024-09-14T11:40:10.012+0000 7f7a769219c0 10 adding default.rgw.meta+root+.bucket.meta.a-bucket:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.17 to cache LRU end 2024-09-14T11:40:10.102 INFO:tasks.workunit.client.0.smithi138.stderr: -16> 2024-09-14T11:40:10.012+0000 7f7a769219c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:40:10.102 INFO:tasks.workunit.client.0.smithi138.stderr: -15> 2024-09-14T11:40:10.012+0000 7f7a769219c0 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-14T11:40:10.102 INFO:tasks.workunit.client.0.smithi138.stderr: -14> 2024-09-14T11:40:10.012+0000 7f7a769219c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.17 2024-09-14T11:40:10.102 INFO:tasks.workunit.client.0.smithi138.stderr: -13> 2024-09-14T11:40:10.028+0000 7f7a769219c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.17 info.flags=0x17 2024-09-14T11:40:10.102 INFO:tasks.workunit.client.0.smithi138.stderr: -12> 2024-09-14T11:40:10.028+0000 7f7a769219c0 10 moving default.rgw.meta+root+.bucket.meta.a-bucket:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.17 to cache LRU end 2024-09-14T11:40:10.102 INFO:tasks.workunit.client.0.smithi138.stderr: -11> 2024-09-14T11:40:10.028+0000 7f7a769219c0 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-14T11:40:10.102 INFO:tasks.workunit.client.0.smithi138.stderr: -10> 2024-09-14T11:40:10.028+0000 7f7a769219c0 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.a-bucket:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.17, ofs0, ns] 2024-09-14T11:40:10.102 INFO:tasks.workunit.client.0.smithi138.stderr: -9> 2024-09-14T11:40:10.028+0000 7f794affd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366241 cookie 94506902665136 notifier 8148 bl.length()=827 2024-09-14T11:40:10.102 INFO:tasks.workunit.client.0.smithi138.stderr: -8> 2024-09-14T11:40:10.028+0000 7f794affd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.17 info.flags=0x17 2024-09-14T11:40:10.102 INFO:tasks.workunit.client.0.smithi138.stderr: -7> 2024-09-14T11:40:10.028+0000 7f794affd640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.a-bucket:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.17 to cache LRU end 2024-09-14T11:40:10.102 INFO:tasks.workunit.client.0.smithi138.stderr: -6> 2024-09-14T11:40:10.028+0000 7f794affd640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=143 2024-09-14T11:40:10.102 INFO:tasks.workunit.client.0.smithi138.stderr: -5> 2024-09-14T11:40:10.028+0000 7f7a769219c0 20 handle_bi_update(): bucket=:a-bucket[d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.17]): orig_sources= new_sources= 2024-09-14T11:40:10.103 INFO:tasks.workunit.client.0.smithi138.stderr: -4> 2024-09-14T11:40:10.028+0000 7f7a769219c0 20 handle_bi_update(): bucket=:a-bucket[d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.17]): potential sources added=[] removed=[] 2024-09-14T11:40:10.103 INFO:tasks.workunit.client.0.smithi138.stderr: -3> 2024-09-14T11:40:10.028+0000 7f7a769219c0 20 handle_bi_update(): bucket=:a-bucket[d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.17]): orig_dests= new_dests= 2024-09-14T11:40:10.103 INFO:tasks.workunit.client.0.smithi138.stderr: -2> 2024-09-14T11:40:10.028+0000 7f7a769219c0 20 handle_bi_update(): bucket=:a-bucket[d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.17]): potential dests added=[] removed=[] 2024-09-14T11:40:10.103 INFO:tasks.workunit.client.0.smithi138.stderr: -1> 2024-09-14T11:40:10.040+0000 7f7a769219c0 -1 ./src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f7a769219c0 time 2024-09-14T11:40:10.042582+0000 2024-09-14T11:40:10.103 INFO:tasks.workunit.client.0.smithi138.stderr:./src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-14T11:40:10.103 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-14T11:40:10.103 INFO:tasks.workunit.client.0.smithi138.stderr: ceph version 19.3.0-4907-ga2782315 (a2782315255a3e7d5f6cdc9eb35785187ff6ddf8) squid (dev) 2024-09-14T11:40:10.103 INFO:tasks.workunit.client.0.smithi138.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x121) [0x7f7a7a1fb2eb] 2024-09-14T11:40:10.103 INFO:tasks.workunit.client.0.smithi138.stderr: 2: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7f7a7a1fb49f] 2024-09-14T11:40:10.103 INFO:tasks.workunit.client.0.smithi138.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55f418b18c01] 2024-09-14T11:40:10.103 INFO:tasks.workunit.client.0.smithi138.stderr: 4: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x17a) [0x55f418b2df3a] 2024-09-14T11:40:10.103 INFO:tasks.workunit.client.0.smithi138.stderr: 5: main() 2024-09-14T11:40:10.103 INFO:tasks.workunit.client.0.smithi138.stderr: 6: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7f7a79061d90] 2024-09-14T11:40:10.103 INFO:tasks.workunit.client.0.smithi138.stderr: 7: __libc_start_main() 2024-09-14T11:40:10.103 INFO:tasks.workunit.client.0.smithi138.stderr: 8: _start() 2024-09-14T11:40:10.104 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-14T11:40:10.104 INFO:tasks.workunit.client.0.smithi138.stderr: 0> 2024-09-14T11:40:10.040+0000 7f7a769219c0 -1 *** Caught signal (Aborted) ** 2024-09-14T11:40:10.104 INFO:tasks.workunit.client.0.smithi138.stderr: in thread 7f7a769219c0 thread_name:radosgw-admin 2024-09-14T11:40:10.104 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-14T11:40:10.104 INFO:tasks.workunit.client.0.smithi138.stderr: ceph version 19.3.0-4907-ga2782315 (a2782315255a3e7d5f6cdc9eb35785187ff6ddf8) squid (dev) 2024-09-14T11:40:10.104 INFO:tasks.workunit.client.0.smithi138.stderr: 1: /lib/x86_64-linux-gnu/libc.so.6(+0x42520) [0x7f7a7907a520] 2024-09-14T11:40:10.104 INFO:tasks.workunit.client.0.smithi138.stderr: 2: pthread_kill() 2024-09-14T11:40:10.104 INFO:tasks.workunit.client.0.smithi138.stderr: 3: raise() 2024-09-14T11:40:10.104 INFO:tasks.workunit.client.0.smithi138.stderr: 4: abort() 2024-09-14T11:40:10.104 INFO:tasks.workunit.client.0.smithi138.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x17b) [0x7f7a7a1fb345] 2024-09-14T11:40:10.104 INFO:tasks.workunit.client.0.smithi138.stderr: 6: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7f7a7a1fb49f] 2024-09-14T11:40:10.104 INFO:tasks.workunit.client.0.smithi138.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55f418b18c01] 2024-09-14T11:40:10.104 INFO:tasks.workunit.client.0.smithi138.stderr: 8: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x17a) [0x55f418b2df3a] 2024-09-14T11:40:10.104 INFO:tasks.workunit.client.0.smithi138.stderr: 9: main() 2024-09-14T11:40:10.104 INFO:tasks.workunit.client.0.smithi138.stderr: 10: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7f7a79061d90] 2024-09-14T11:40:10.105 INFO:tasks.workunit.client.0.smithi138.stderr: 11: __libc_start_main() 2024-09-14T11:40:10.105 INFO:tasks.workunit.client.0.smithi138.stderr: 12: _start() 2024-09-14T11:40:10.105 INFO:tasks.workunit.client.0.smithi138.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-14T11:40:10.105 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-14T11:40:10.105 INFO:tasks.workunit.client.0.smithi138.stderr:--- logging levels --- 2024-09-14T11:40:10.105 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 none 2024-09-14T11:40:10.105 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 1 lockdep 2024-09-14T11:40:10.105 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 1 context 2024-09-14T11:40:10.105 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 1 crush 2024-09-14T11:40:10.105 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 mds 2024-09-14T11:40:10.105 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 mds_balancer 2024-09-14T11:40:10.105 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 mds_locker 2024-09-14T11:40:10.105 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 mds_log 2024-09-14T11:40:10.105 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 mds_log_expire 2024-09-14T11:40:10.105 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 mds_migrator 2024-09-14T11:40:10.105 INFO:tasks.workunit.client.0.smithi138.stderr: 3/ 5 mds_quiesce 2024-09-14T11:40:10.106 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 1 buffer 2024-09-14T11:40:10.106 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 1 timer 2024-09-14T11:40:10.106 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 1 filer 2024-09-14T11:40:10.106 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 1 striper 2024-09-14T11:40:10.106 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 1 objecter 2024-09-14T11:40:10.106 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 rados 2024-09-14T11:40:10.106 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 rbd 2024-09-14T11:40:10.106 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 rbd_mirror 2024-09-14T11:40:10.106 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 rbd_replay 2024-09-14T11:40:10.106 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 rbd_pwl 2024-09-14T11:40:10.106 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 journaler 2024-09-14T11:40:10.106 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 objectcacher 2024-09-14T11:40:10.106 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 immutable_obj_cache 2024-09-14T11:40:10.106 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 client 2024-09-14T11:40:10.106 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 osd 2024-09-14T11:40:10.106 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 optracker 2024-09-14T11:40:10.106 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 objclass 2024-09-14T11:40:10.107 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 3 filestore 2024-09-14T11:40:10.107 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 3 journal 2024-09-14T11:40:10.107 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 0 ms 2024-09-14T11:40:10.107 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 mon 2024-09-14T11:40:10.107 INFO:tasks.workunit.client.0.smithi138.stderr: 0/10 monc 2024-09-14T11:40:10.107 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 paxos 2024-09-14T11:40:10.107 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 tp 2024-09-14T11:40:10.107 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 auth 2024-09-14T11:40:10.107 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 crypto 2024-09-14T11:40:10.107 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 1 finisher 2024-09-14T11:40:10.107 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 1 reserver 2024-09-14T11:40:10.107 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 heartbeatmap 2024-09-14T11:40:10.107 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 perfcounter 2024-09-14T11:40:10.107 INFO:tasks.workunit.client.0.smithi138.stderr: 20/20 rgw 2024-09-14T11:40:10.107 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 rgw_sync 2024-09-14T11:40:10.107 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 rgw_datacache 2024-09-14T11:40:10.108 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 rgw_access 2024-09-14T11:40:10.108 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 rgw_dbstore 2024-09-14T11:40:10.108 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 rgw_flight 2024-09-14T11:40:10.108 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 rgw_lifecycle 2024-09-14T11:40:10.108 INFO:tasks.workunit.client.0.smithi138.stderr: 20/20 rgw_notification 2024-09-14T11:40:10.108 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 javaclient 2024-09-14T11:40:10.108 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 asok 2024-09-14T11:40:10.108 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 1 throttle 2024-09-14T11:40:10.108 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 0 refs 2024-09-14T11:40:10.108 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 compressor 2024-09-14T11:40:10.108 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 bluestore 2024-09-14T11:40:10.108 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 bluefs 2024-09-14T11:40:10.108 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 3 bdev 2024-09-14T11:40:10.108 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 kstore 2024-09-14T11:40:10.108 INFO:tasks.workunit.client.0.smithi138.stderr: 4/ 5 rocksdb 2024-09-14T11:40:10.108 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 fuse 2024-09-14T11:40:10.108 INFO:tasks.workunit.client.0.smithi138.stderr: 2/ 5 mgr 2024-09-14T11:40:10.109 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 mgrc 2024-09-14T11:40:10.109 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 dpdk 2024-09-14T11:40:10.109 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 eventtrace 2024-09-14T11:40:10.109 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 prioritycache 2024-09-14T11:40:10.109 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 test 2024-09-14T11:40:10.109 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 cephfs_mirror 2024-09-14T11:40:10.109 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 cephsqlite 2024-09-14T11:40:10.109 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 crimson_interrupt 2024-09-14T11:40:10.109 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 seastore 2024-09-14T11:40:10.109 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 seastore_onode 2024-09-14T11:40:10.109 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 seastore_odata 2024-09-14T11:40:10.109 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 seastore_omap 2024-09-14T11:40:10.109 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 seastore_tm 2024-09-14T11:40:10.109 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 seastore_t 2024-09-14T11:40:10.109 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 seastore_cleaner 2024-09-14T11:40:10.109 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 seastore_epm 2024-09-14T11:40:10.110 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 seastore_lba 2024-09-14T11:40:10.110 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 seastore_fixedkv_tree 2024-09-14T11:40:10.110 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 seastore_cache 2024-09-14T11:40:10.110 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 seastore_journal 2024-09-14T11:40:10.110 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 seastore_device 2024-09-14T11:40:10.110 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 seastore_backref 2024-09-14T11:40:10.110 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 alienstore 2024-09-14T11:40:10.110 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 mclock 2024-09-14T11:40:10.110 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 cyanstore 2024-09-14T11:40:10.110 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 ceph_exporter 2024-09-14T11:40:10.110 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 memstore 2024-09-14T11:40:10.110 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 trace 2024-09-14T11:40:10.110 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 ceph_dedup 2024-09-14T11:40:10.110 INFO:tasks.workunit.client.0.smithi138.stderr: -2/-2 (syslog threshold) 2024-09-14T11:40:10.110 INFO:tasks.workunit.client.0.smithi138.stderr: 99/99 (stderr threshold) 2024-09-14T11:40:10.110 INFO:tasks.workunit.client.0.smithi138.stderr:--- pthread ID / name mapping for recent threads --- 2024-09-14T11:40:10.111 INFO:tasks.workunit.client.0.smithi138.stderr: 7f789b7fe640 / http_manager 2024-09-14T11:40:10.111 INFO:tasks.workunit.client.0.smithi138.stderr: 7f7929fdb640 / http_manager 2024-09-14T11:40:10.111 INFO:tasks.workunit.client.0.smithi138.stderr: 7f792afdd640 / rgw_dt_lg_renew 2024-09-14T11:40:10.111 INFO:tasks.workunit.client.0.smithi138.stderr: 7f7949ffb640 / ms_dispatch 2024-09-14T11:40:10.111 INFO:tasks.workunit.client.0.smithi138.stderr: 7f794affd640 / io_context_pool 2024-09-14T11:40:10.111 INFO:tasks.workunit.client.0.smithi138.stderr: 7f794b7fe640 / io_context_pool 2024-09-14T11:40:10.111 INFO:tasks.workunit.client.0.smithi138.stderr: 7f7959ffb640 / ms_dispatch 2024-09-14T11:40:10.111 INFO:tasks.workunit.client.0.smithi138.stderr: 7f7960e09640 / ms_dispatch 2024-09-14T11:40:10.111 INFO:tasks.workunit.client.0.smithi138.stderr: 7f796260c640 / io_context_pool 2024-09-14T11:40:10.111 INFO:tasks.workunit.client.0.smithi138.stderr: 7f7a73c26640 / msgr-worker-2 2024-09-14T11:40:10.111 INFO:tasks.workunit.client.0.smithi138.stderr: 7f7a74427640 / msgr-worker-1 2024-09-14T11:40:10.111 INFO:tasks.workunit.client.0.smithi138.stderr: 7f7a74c28640 / msgr-worker-0 2024-09-14T11:40:10.111 INFO:tasks.workunit.client.0.smithi138.stderr: 7f7a75429640 / io_context_pool 2024-09-14T11:40:10.112 INFO:tasks.workunit.client.0.smithi138.stderr: 7f7a769219c0 / radosgw-admin 2024-09-14T11:40:10.112 INFO:tasks.workunit.client.0.smithi138.stderr: max_recent 500 2024-09-14T11:40:10.112 INFO:tasks.workunit.client.0.smithi138.stderr: max_new 1000 2024-09-14T11:40:10.112 INFO:tasks.workunit.client.0.smithi138.stderr: log_file /var/log/ceph/ceph-client.admin.142156.log 2024-09-14T11:40:10.112 INFO:tasks.workunit.client.0.smithi138.stderr:--- end dump of recent events --- 2024-09-14T11:40:10.112 INFO:tasks.workunit.client.0.smithi138.stderr:--- begin dump of recent events --- 2024-09-14T11:40:10.112 INFO:tasks.workunit.client.0.smithi138.stderr: -499> 2024-09-14T11:40:09.508+0000 7f7a74c28640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.138:3300/0 2024-09-14T11:40:10.112 INFO:tasks.workunit.client.0.smithi138.stderr: -498> 2024-09-14T11:40:09.508+0000 7f796260c640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:40:10.112 INFO:tasks.workunit.client.0.smithi138.stderr: -497> 2024-09-14T11:40:09.508+0000 7f796260c640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-14T11:40:10.112 INFO:tasks.workunit.client.0.smithi138.stderr: -496> 2024-09-14T11:40:09.508+0000 7f796260c640 10 monclient: dump: 2024-09-14T11:40:10.112 INFO:tasks.workunit.client.0.smithi138.stderr:epoch 1 2024-09-14T11:40:10.112 INFO:tasks.workunit.client.0.smithi138.stderr:fsid 3f225f43-83a6-4aeb-b798-1f04bb49d597 2024-09-14T11:40:10.112 INFO:tasks.workunit.client.0.smithi138.stderr:last_changed 2024-09-14T11:07:09.252780+0000 2024-09-14T11:40:10.112 INFO:tasks.workunit.client.0.smithi138.stderr:created 2024-09-14T11:07:09.252780+0000 2024-09-14T11:40:10.112 INFO:tasks.workunit.client.0.smithi138.stderr:min_mon_release 19 (squid) 2024-09-14T11:40:10.113 INFO:tasks.workunit.client.0.smithi138.stderr:election_strategy: 1 2024-09-14T11:40:10.113 INFO:tasks.workunit.client.0.smithi138.stderr:0: [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] mon.a 2024-09-14T11:40:10.113 INFO:tasks.workunit.client.0.smithi138.stderr:1: [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] mon.b 2024-09-14T11:40:10.113 INFO:tasks.workunit.client.0.smithi138.stderr:2: [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] mon.c 2024-09-14T11:40:10.113 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-14T11:40:10.113 INFO:tasks.workunit.client.0.smithi138.stderr: -495> 2024-09-14T11:40:09.508+0000 7f796260c640 10 monclient: _finish_auth 0 2024-09-14T11:40:10.113 INFO:tasks.workunit.client.0.smithi138.stderr: -494> 2024-09-14T11:40:09.508+0000 7f796260c640 10 monclient: _check_auth_tickets 2024-09-14T11:40:10.113 INFO:tasks.workunit.client.0.smithi138.stderr: -493> 2024-09-14T11:40:09.508+0000 7f796260c640 10 monclient: handle_config config(0 keys) 2024-09-14T11:40:10.113 INFO:tasks.workunit.client.0.smithi138.stderr: -492> 2024-09-14T11:40:09.508+0000 7f7a769219c0 5 monclient: authenticate success, global_id 8136 2024-09-14T11:40:10.113 INFO:tasks.workunit.client.0.smithi138.stderr: -491> 2024-09-14T11:40:09.508+0000 7f7a769219c0 10 monclient: get_monmap_and_config success 2024-09-14T11:40:10.113 INFO:tasks.workunit.client.0.smithi138.stderr: -490> 2024-09-14T11:40:09.508+0000 7f7a769219c0 4 set_mon_vals no callback set 2024-09-14T11:40:10.113 INFO:tasks.workunit.client.0.smithi138.stderr: -489> 2024-09-14T11:40:09.508+0000 7f796260c640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:40:10.113 INFO:tasks.workunit.client.0.smithi138.stderr: -488> 2024-09-14T11:40:09.508+0000 7f796260c640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-14T11:40:10.113 INFO:tasks.workunit.client.0.smithi138.stderr: -487> 2024-09-14T11:40:09.508+0000 7f796260c640 10 monclient: dump: 2024-09-14T11:40:10.113 INFO:tasks.workunit.client.0.smithi138.stderr:epoch 1 2024-09-14T11:40:10.114 INFO:tasks.workunit.client.0.smithi138.stderr:fsid 3f225f43-83a6-4aeb-b798-1f04bb49d597 2024-09-14T11:40:10.114 INFO:tasks.workunit.client.0.smithi138.stderr:last_changed 2024-09-14T11:07:09.252780+0000 2024-09-14T11:40:10.114 INFO:tasks.workunit.client.0.smithi138.stderr:created 2024-09-14T11:07:09.252780+0000 2024-09-14T11:40:10.114 INFO:tasks.workunit.client.0.smithi138.stderr:min_mon_release 19 (squid) 2024-09-14T11:40:10.114 INFO:tasks.workunit.client.0.smithi138.stderr:election_strategy: 1 2024-09-14T11:40:10.114 INFO:tasks.workunit.client.0.smithi138.stderr:0: [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] mon.a 2024-09-14T11:40:10.114 INFO:tasks.workunit.client.0.smithi138.stderr:1: [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] mon.b 2024-09-14T11:40:10.114 INFO:tasks.workunit.client.0.smithi138.stderr:2: [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] mon.c 2024-09-14T11:40:10.114 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-14T11:40:10.114 INFO:tasks.workunit.client.0.smithi138.stderr: -486> 2024-09-14T11:40:09.512+0000 7f7a769219c0 10 monclient: shutdown 2024-09-14T11:40:10.114 INFO:tasks.workunit.client.0.smithi138.stderr: -485> 2024-09-14T11:40:09.512+0000 7f7a769219c0 5 asok(0x55f41a2bfd90) unregister_commands rotate-key 2024-09-14T11:40:10.114 INFO:tasks.workunit.client.0.smithi138.stderr: -484> 2024-09-14T11:40:09.512+0000 7f7a769219c0 10 monclient: build_initial_monmap 2024-09-14T11:40:10.114 INFO:tasks.workunit.client.0.smithi138.stderr: -483> 2024-09-14T11:40:09.512+0000 7f7a769219c0 1 build_initial for_mkfs: 0 2024-09-14T11:40:10.114 INFO:tasks.workunit.client.0.smithi138.stderr: -482> 2024-09-14T11:40:09.512+0000 7f7a769219c0 10 monclient: monmap: 2024-09-14T11:40:10.114 INFO:tasks.workunit.client.0.smithi138.stderr:epoch 0 2024-09-14T11:40:10.114 INFO:tasks.workunit.client.0.smithi138.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-14T11:40:10.115 INFO:tasks.workunit.client.0.smithi138.stderr:last_changed 0.000000 2024-09-14T11:40:10.115 INFO:tasks.workunit.client.0.smithi138.stderr:created 0.000000 2024-09-14T11:40:10.115 INFO:tasks.workunit.client.0.smithi138.stderr:min_mon_release 0 (unknown) 2024-09-14T11:40:10.115 INFO:tasks.workunit.client.0.smithi138.stderr:election_strategy: 1 2024-09-14T11:40:10.115 INFO:tasks.workunit.client.0.smithi138.stderr:0: [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] mon.noname-a 2024-09-14T11:40:10.115 INFO:tasks.workunit.client.0.smithi138.stderr:1: [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] mon.noname-b 2024-09-14T11:40:10.115 INFO:tasks.workunit.client.0.smithi138.stderr:2: [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] mon.noname-c 2024-09-14T11:40:10.115 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-14T11:40:10.115 INFO:tasks.workunit.client.0.smithi138.stderr: -481> 2024-09-14T11:40:09.512+0000 7f7a769219c0 5 AuthRegistry(0x55f41a4cca40) adding auth protocol: cephx 2024-09-14T11:40:10.115 INFO:tasks.workunit.client.0.smithi138.stderr: -480> 2024-09-14T11:40:09.512+0000 7f7a769219c0 5 AuthRegistry(0x55f41a4cca40) adding auth protocol: cephx 2024-09-14T11:40:10.115 INFO:tasks.workunit.client.0.smithi138.stderr: -479> 2024-09-14T11:40:09.512+0000 7f7a769219c0 5 AuthRegistry(0x55f41a4cca40) adding auth protocol: cephx 2024-09-14T11:40:10.115 INFO:tasks.workunit.client.0.smithi138.stderr: -478> 2024-09-14T11:40:09.512+0000 7f7a769219c0 5 AuthRegistry(0x55f41a4cca40) adding con mode: secure 2024-09-14T11:40:10.115 INFO:tasks.workunit.client.0.smithi138.stderr: -477> 2024-09-14T11:40:09.512+0000 7f7a769219c0 5 AuthRegistry(0x55f41a4cca40) adding con mode: crc 2024-09-14T11:40:10.115 INFO:tasks.workunit.client.0.smithi138.stderr: -476> 2024-09-14T11:40:09.512+0000 7f7a769219c0 5 AuthRegistry(0x55f41a4cca40) adding con mode: secure 2024-09-14T11:40:10.115 INFO:tasks.workunit.client.0.smithi138.stderr: -475> 2024-09-14T11:40:09.512+0000 7f7a769219c0 5 AuthRegistry(0x55f41a4cca40) adding con mode: crc 2024-09-14T11:40:10.115 INFO:tasks.workunit.client.0.smithi138.stderr: -474> 2024-09-14T11:40:09.512+0000 7f7a769219c0 5 AuthRegistry(0x55f41a4cca40) adding con mode: secure 2024-09-14T11:40:10.116 INFO:tasks.workunit.client.0.smithi138.stderr: -473> 2024-09-14T11:40:09.512+0000 7f7a769219c0 5 AuthRegistry(0x55f41a4cca40) adding con mode: crc 2024-09-14T11:40:10.116 INFO:tasks.workunit.client.0.smithi138.stderr: -472> 2024-09-14T11:40:09.512+0000 7f7a769219c0 5 AuthRegistry(0x55f41a4cca40) adding con mode: crc 2024-09-14T11:40:10.116 INFO:tasks.workunit.client.0.smithi138.stderr: -471> 2024-09-14T11:40:09.512+0000 7f7a769219c0 5 AuthRegistry(0x55f41a4cca40) adding con mode: secure 2024-09-14T11:40:10.116 INFO:tasks.workunit.client.0.smithi138.stderr: -470> 2024-09-14T11:40:09.512+0000 7f7a769219c0 5 AuthRegistry(0x55f41a4cca40) adding con mode: crc 2024-09-14T11:40:10.116 INFO:tasks.workunit.client.0.smithi138.stderr: -469> 2024-09-14T11:40:09.512+0000 7f7a769219c0 5 AuthRegistry(0x55f41a4cca40) adding con mode: secure 2024-09-14T11:40:10.116 INFO:tasks.workunit.client.0.smithi138.stderr: -468> 2024-09-14T11:40:09.512+0000 7f7a769219c0 5 AuthRegistry(0x55f41a4cca40) adding con mode: crc 2024-09-14T11:40:10.116 INFO:tasks.workunit.client.0.smithi138.stderr: -467> 2024-09-14T11:40:09.512+0000 7f7a769219c0 5 AuthRegistry(0x55f41a4cca40) adding con mode: secure 2024-09-14T11:40:10.116 INFO:tasks.workunit.client.0.smithi138.stderr: -466> 2024-09-14T11:40:09.512+0000 7f7a769219c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:40:10.116 INFO:tasks.workunit.client.0.smithi138.stderr: -465> 2024-09-14T11:40:09.512+0000 7f7a769219c0 1 librados: starting msgr at 2024-09-14T11:40:10.116 INFO:tasks.workunit.client.0.smithi138.stderr: -464> 2024-09-14T11:40:09.512+0000 7f7a769219c0 1 librados: starting objecter 2024-09-14T11:40:10.116 INFO:tasks.workunit.client.0.smithi138.stderr: -463> 2024-09-14T11:40:09.512+0000 7f7a769219c0 5 asok(0x55f41a2bfd90) register_command objecter_requests hook 0x55f41a4cef90 2024-09-14T11:40:10.116 INFO:tasks.workunit.client.0.smithi138.stderr: -462> 2024-09-14T11:40:09.512+0000 7f7a769219c0 1 librados: setting wanted keys 2024-09-14T11:40:10.116 INFO:tasks.workunit.client.0.smithi138.stderr: -461> 2024-09-14T11:40:09.512+0000 7f7a769219c0 1 librados: calling monclient init 2024-09-14T11:40:10.116 INFO:tasks.workunit.client.0.smithi138.stderr: -460> 2024-09-14T11:40:09.512+0000 7f7a769219c0 10 monclient: init 2024-09-14T11:40:10.116 INFO:tasks.workunit.client.0.smithi138.stderr: -459> 2024-09-14T11:40:09.512+0000 7f7a769219c0 5 AuthRegistry(0x55f41a4cac50) adding auth protocol: cephx 2024-09-14T11:40:10.116 INFO:tasks.workunit.client.0.smithi138.stderr: -458> 2024-09-14T11:40:09.512+0000 7f7a769219c0 5 AuthRegistry(0x55f41a4cac50) adding auth protocol: cephx 2024-09-14T11:40:10.117 INFO:tasks.workunit.client.0.smithi138.stderr: -457> 2024-09-14T11:40:09.512+0000 7f7a769219c0 5 AuthRegistry(0x55f41a4cac50) adding auth protocol: cephx 2024-09-14T11:40:10.117 INFO:tasks.workunit.client.0.smithi138.stderr: -456> 2024-09-14T11:40:09.512+0000 7f7a769219c0 5 AuthRegistry(0x55f41a4cac50) adding con mode: secure 2024-09-14T11:40:10.117 INFO:tasks.workunit.client.0.smithi138.stderr: -455> 2024-09-14T11:40:09.512+0000 7f7a769219c0 5 AuthRegistry(0x55f41a4cac50) adding con mode: crc 2024-09-14T11:40:10.117 INFO:tasks.workunit.client.0.smithi138.stderr: -454> 2024-09-14T11:40:09.512+0000 7f7a769219c0 5 AuthRegistry(0x55f41a4cac50) adding con mode: secure 2024-09-14T11:40:10.117 INFO:tasks.workunit.client.0.smithi138.stderr: -453> 2024-09-14T11:40:09.512+0000 7f7a769219c0 5 AuthRegistry(0x55f41a4cac50) adding con mode: crc 2024-09-14T11:40:10.117 INFO:tasks.workunit.client.0.smithi138.stderr: -452> 2024-09-14T11:40:09.512+0000 7f7a769219c0 5 AuthRegistry(0x55f41a4cac50) adding con mode: secure 2024-09-14T11:40:10.117 INFO:tasks.workunit.client.0.smithi138.stderr: -451> 2024-09-14T11:40:09.512+0000 7f7a769219c0 5 AuthRegistry(0x55f41a4cac50) adding con mode: crc 2024-09-14T11:40:10.117 INFO:tasks.workunit.client.0.smithi138.stderr: -450> 2024-09-14T11:40:09.512+0000 7f7a769219c0 5 AuthRegistry(0x55f41a4cac50) adding con mode: crc 2024-09-14T11:40:10.117 INFO:tasks.workunit.client.0.smithi138.stderr: -449> 2024-09-14T11:40:09.512+0000 7f7a769219c0 5 AuthRegistry(0x55f41a4cac50) adding con mode: secure 2024-09-14T11:40:10.117 INFO:tasks.workunit.client.0.smithi138.stderr: -448> 2024-09-14T11:40:09.512+0000 7f7a769219c0 5 AuthRegistry(0x55f41a4cac50) adding con mode: crc 2024-09-14T11:40:10.117 INFO:tasks.workunit.client.0.smithi138.stderr: -447> 2024-09-14T11:40:09.512+0000 7f7a769219c0 5 AuthRegistry(0x55f41a4cac50) adding con mode: secure 2024-09-14T11:40:10.117 INFO:tasks.workunit.client.0.smithi138.stderr: -446> 2024-09-14T11:40:09.512+0000 7f7a769219c0 5 AuthRegistry(0x55f41a4cac50) adding con mode: crc 2024-09-14T11:40:10.117 INFO:tasks.workunit.client.0.smithi138.stderr: -445> 2024-09-14T11:40:09.512+0000 7f7a769219c0 5 AuthRegistry(0x55f41a4cac50) adding con mode: secure 2024-09-14T11:40:10.117 INFO:tasks.workunit.client.0.smithi138.stderr: -444> 2024-09-14T11:40:09.512+0000 7f7a769219c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:40:10.117 INFO:tasks.workunit.client.0.smithi138.stderr: -443> 2024-09-14T11:40:09.512+0000 7f7a769219c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:40:10.117 INFO:tasks.workunit.client.0.smithi138.stderr: -442> 2024-09-14T11:40:09.512+0000 7f7a769219c0 5 asok(0x55f41a2bfd90) register_command rotate-key hook 0x55f41a4cad98 2024-09-14T11:40:10.118 INFO:tasks.workunit.client.0.smithi138.stderr: -441> 2024-09-14T11:40:09.512+0000 7f7a769219c0 10 monclient: _reopen_session rank -1 2024-09-14T11:40:10.118 INFO:tasks.workunit.client.0.smithi138.stderr: -440> 2024-09-14T11:40:09.512+0000 7f7a769219c0 10 monclient: _add_conns ranks=[0,2,1] 2024-09-14T11:40:10.118 INFO:tasks.workunit.client.0.smithi138.stderr: -439> 2024-09-14T11:40:09.512+0000 7f7a769219c0 10 monclient(hunting): picked mon.noname-a con 0x55f41a37b7f0 addr [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] 2024-09-14T11:40:10.118 INFO:tasks.workunit.client.0.smithi138.stderr: -438> 2024-09-14T11:40:09.512+0000 7f7a769219c0 10 monclient(hunting): picked mon.noname-c con 0x55f41a413800 addr [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] 2024-09-14T11:40:10.118 INFO:tasks.workunit.client.0.smithi138.stderr: -437> 2024-09-14T11:40:09.512+0000 7f7a769219c0 10 monclient(hunting): picked mon.noname-b con 0x55f41a413be0 addr [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] 2024-09-14T11:40:10.118 INFO:tasks.workunit.client.0.smithi138.stderr: -436> 2024-09-14T11:40:09.512+0000 7f7a769219c0 10 monclient(hunting): start opening mon connection 2024-09-14T11:40:10.118 INFO:tasks.workunit.client.0.smithi138.stderr: -435> 2024-09-14T11:40:09.512+0000 7f7a769219c0 10 monclient(hunting): start opening mon connection 2024-09-14T11:40:10.118 INFO:tasks.workunit.client.0.smithi138.stderr: -434> 2024-09-14T11:40:09.512+0000 7f7a769219c0 10 monclient(hunting): start opening mon connection 2024-09-14T11:40:10.118 INFO:tasks.workunit.client.0.smithi138.stderr: -433> 2024-09-14T11:40:09.512+0000 7f7a769219c0 10 monclient(hunting): _renew_subs 2024-09-14T11:40:10.118 INFO:tasks.workunit.client.0.smithi138.stderr: -432> 2024-09-14T11:40:09.512+0000 7f7a769219c0 10 monclient(hunting): authenticate will time out at 2945.473991s 2024-09-14T11:40:10.118 INFO:tasks.workunit.client.0.smithi138.stderr: -431> 2024-09-14T11:40:09.512+0000 7f7a73c26640 10 monclient(hunting): get_auth_request con 0x55f41a413800 auth_method 0 2024-09-14T11:40:10.118 INFO:tasks.workunit.client.0.smithi138.stderr: -430> 2024-09-14T11:40:09.512+0000 7f7a73c26640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:40:10.118 INFO:tasks.workunit.client.0.smithi138.stderr: -429> 2024-09-14T11:40:09.512+0000 7f7a73c26640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:40:10.118 INFO:tasks.workunit.client.0.smithi138.stderr: -428> 2024-09-14T11:40:09.512+0000 7f7a73c26640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:40:10.118 INFO:tasks.workunit.client.0.smithi138.stderr: -427> 2024-09-14T11:40:09.512+0000 7f7a74427640 10 monclient(hunting): get_auth_request con 0x55f41a37b7f0 auth_method 0 2024-09-14T11:40:10.119 INFO:tasks.workunit.client.0.smithi138.stderr: -426> 2024-09-14T11:40:09.512+0000 7f7a74427640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:40:10.119 INFO:tasks.workunit.client.0.smithi138.stderr: -425> 2024-09-14T11:40:09.512+0000 7f7a74427640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:40:10.119 INFO:tasks.workunit.client.0.smithi138.stderr: -424> 2024-09-14T11:40:09.512+0000 7f7a74427640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:40:10.119 INFO:tasks.workunit.client.0.smithi138.stderr: -423> 2024-09-14T11:40:09.512+0000 7f7a74427640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:40:10.119 INFO:tasks.workunit.client.0.smithi138.stderr: -422> 2024-09-14T11:40:09.512+0000 7f7a74427640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:40:10.119 INFO:tasks.workunit.client.0.smithi138.stderr: -421> 2024-09-14T11:40:09.512+0000 7f7a74427640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:40:10.119 INFO:tasks.workunit.client.0.smithi138.stderr: -420> 2024-09-14T11:40:09.512+0000 7f7a73c26640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:40:10.119 INFO:tasks.workunit.client.0.smithi138.stderr: -419> 2024-09-14T11:40:09.512+0000 7f7a73c26640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:40:10.119 INFO:tasks.workunit.client.0.smithi138.stderr: -418> 2024-09-14T11:40:09.512+0000 7f7a73c26640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:40:10.119 INFO:tasks.workunit.client.0.smithi138.stderr: -417> 2024-09-14T11:40:09.512+0000 7f7a74427640 10 monclient(hunting): handle_auth_done global_id 8139 payload 824 2024-09-14T11:40:10.119 INFO:tasks.workunit.client.0.smithi138.stderr: -416> 2024-09-14T11:40:09.512+0000 7f7a74427640 10 monclient: _finish_hunting 0 2024-09-14T11:40:10.119 INFO:tasks.workunit.client.0.smithi138.stderr: -415> 2024-09-14T11:40:09.512+0000 7f7a74427640 1 monclient: found mon.noname-a 2024-09-14T11:40:10.119 INFO:tasks.workunit.client.0.smithi138.stderr: -414> 2024-09-14T11:40:09.512+0000 7f7a74427640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.138:3300/0 2024-09-14T11:40:10.119 INFO:tasks.workunit.client.0.smithi138.stderr: -413> 2024-09-14T11:40:09.512+0000 7f7a74c28640 10 monclient: get_auth_request con 0x55f41a413be0 auth_method 0 2024-09-14T11:40:10.119 INFO:tasks.workunit.client.0.smithi138.stderr: -412> 2024-09-14T11:40:09.512+0000 7f7960e09640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:40:10.119 INFO:tasks.workunit.client.0.smithi138.stderr: -411> 2024-09-14T11:40:09.512+0000 7f7960e09640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-14T11:40:10.120 INFO:tasks.workunit.client.0.smithi138.stderr: -410> 2024-09-14T11:40:09.512+0000 7f7960e09640 10 monclient: dump: 2024-09-14T11:40:10.120 INFO:tasks.workunit.client.0.smithi138.stderr:epoch 1 2024-09-14T11:40:10.120 INFO:tasks.workunit.client.0.smithi138.stderr:fsid 3f225f43-83a6-4aeb-b798-1f04bb49d597 2024-09-14T11:40:10.120 INFO:tasks.workunit.client.0.smithi138.stderr:last_changed 2024-09-14T11:07:09.252780+0000 2024-09-14T11:40:10.120 INFO:tasks.workunit.client.0.smithi138.stderr:created 2024-09-14T11:07:09.252780+0000 2024-09-14T11:40:10.120 INFO:tasks.workunit.client.0.smithi138.stderr:min_mon_release 19 (squid) 2024-09-14T11:40:10.120 INFO:tasks.workunit.client.0.smithi138.stderr:election_strategy: 1 2024-09-14T11:40:10.120 INFO:tasks.workunit.client.0.smithi138.stderr:0: [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] mon.a 2024-09-14T11:40:10.120 INFO:tasks.workunit.client.0.smithi138.stderr:1: [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] mon.b 2024-09-14T11:40:10.120 INFO:tasks.workunit.client.0.smithi138.stderr:2: [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] mon.c 2024-09-14T11:40:10.120 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-14T11:40:10.120 INFO:tasks.workunit.client.0.smithi138.stderr: -409> 2024-09-14T11:40:09.512+0000 7f7960e09640 10 monclient: _finish_auth 0 2024-09-14T11:40:10.120 INFO:tasks.workunit.client.0.smithi138.stderr: -408> 2024-09-14T11:40:09.512+0000 7f7960e09640 10 monclient: _check_auth_tickets 2024-09-14T11:40:10.120 INFO:tasks.workunit.client.0.smithi138.stderr: -407> 2024-09-14T11:40:09.512+0000 7f7960e09640 10 monclient: handle_config config(0 keys) 2024-09-14T11:40:10.120 INFO:tasks.workunit.client.0.smithi138.stderr: -406> 2024-09-14T11:40:09.512+0000 7f7960e09640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:40:10.121 INFO:tasks.workunit.client.0.smithi138.stderr: -405> 2024-09-14T11:40:09.512+0000 7f7960e09640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-14T11:40:10.121 INFO:tasks.workunit.client.0.smithi138.stderr: -404> 2024-09-14T11:40:09.512+0000 7f7960e09640 10 monclient: dump: 2024-09-14T11:40:10.121 INFO:tasks.workunit.client.0.smithi138.stderr:epoch 1 2024-09-14T11:40:10.121 INFO:tasks.workunit.client.0.smithi138.stderr:fsid 3f225f43-83a6-4aeb-b798-1f04bb49d597 2024-09-14T11:40:10.121 INFO:tasks.workunit.client.0.smithi138.stderr:last_changed 2024-09-14T11:07:09.252780+0000 2024-09-14T11:40:10.121 INFO:tasks.workunit.client.0.smithi138.stderr:created 2024-09-14T11:07:09.252780+0000 2024-09-14T11:40:10.121 INFO:tasks.workunit.client.0.smithi138.stderr:min_mon_release 19 (squid) 2024-09-14T11:40:10.121 INFO:tasks.workunit.client.0.smithi138.stderr:election_strategy: 1 2024-09-14T11:40:10.121 INFO:tasks.workunit.client.0.smithi138.stderr:0: [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] mon.a 2024-09-14T11:40:10.121 INFO:tasks.workunit.client.0.smithi138.stderr:1: [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] mon.b 2024-09-14T11:40:10.121 INFO:tasks.workunit.client.0.smithi138.stderr:2: [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] mon.c 2024-09-14T11:40:10.121 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-14T11:40:10.121 INFO:tasks.workunit.client.0.smithi138.stderr: -403> 2024-09-14T11:40:09.512+0000 7f796260c640 4 set_mon_vals no callback set 2024-09-14T11:40:10.121 INFO:tasks.workunit.client.0.smithi138.stderr: -402> 2024-09-14T11:40:09.512+0000 7f7a769219c0 5 monclient: authenticate success, global_id 8139 2024-09-14T11:40:10.121 INFO:tasks.workunit.client.0.smithi138.stderr: -401> 2024-09-14T11:40:09.512+0000 7f7a769219c0 10 monclient: _renew_subs 2024-09-14T11:40:10.122 INFO:tasks.workunit.client.0.smithi138.stderr: -400> 2024-09-14T11:40:09.512+0000 7f7a769219c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.138:3300/0 2024-09-14T11:40:10.122 INFO:tasks.workunit.client.0.smithi138.stderr: -399> 2024-09-14T11:40:09.512+0000 7f7a769219c0 10 monclient: _renew_subs 2024-09-14T11:40:10.122 INFO:tasks.workunit.client.0.smithi138.stderr: -398> 2024-09-14T11:40:09.512+0000 7f7a769219c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.138:3300/0 2024-09-14T11:40:10.122 INFO:tasks.workunit.client.0.smithi138.stderr: -397> 2024-09-14T11:40:09.512+0000 7f7a769219c0 1 librados: init done 2024-09-14T11:40:10.122 INFO:tasks.workunit.client.0.smithi138.stderr: -396> 2024-09-14T11:40:09.516+0000 7f7960e09640 4 mgrc handle_mgr_map Got map version 5 2024-09-14T11:40:10.122 INFO:tasks.workunit.client.0.smithi138.stderr: -395> 2024-09-14T11:40:09.516+0000 7f7960e09640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.138:6832/3778043143,v1:172.21.15.138:6833/3778043143] 2024-09-14T11:40:10.122 INFO:tasks.workunit.client.0.smithi138.stderr: -394> 2024-09-14T11:40:09.516+0000 7f7960e09640 4 mgrc reconnect Starting new session with [v2:172.21.15.138:6832/3778043143,v1:172.21.15.138:6833/3778043143] 2024-09-14T11:40:10.122 INFO:tasks.workunit.client.0.smithi138.stderr: -393> 2024-09-14T11:40:09.516+0000 7f7a73c26640 10 monclient: get_auth_request con 0x7f795c0718a0 auth_method 0 2024-09-14T11:40:10.122 INFO:tasks.workunit.client.0.smithi138.stderr: -392> 2024-09-14T11:40:09.516+0000 7f7a74c28640 10 monclient: get_auth_request con 0x55f41a5129a0 auth_method 0 2024-09-14T11:40:10.122 INFO:tasks.workunit.client.0.smithi138.stderr: -391> 2024-09-14T11:40:09.516+0000 7f7a74427640 10 monclient: get_auth_request con 0x55f41a515b80 auth_method 0 2024-09-14T11:40:10.122 INFO:tasks.workunit.client.0.smithi138.stderr: -390> 2024-09-14T11:40:09.520+0000 7f7a73c26640 10 monclient: get_auth_request con 0x55f41a519d70 auth_method 0 2024-09-14T11:40:10.122 INFO:tasks.workunit.client.0.smithi138.stderr: -389> 2024-09-14T11:40:09.520+0000 7f7a74c28640 10 monclient: get_auth_request con 0x55f41a519450 auth_method 0 2024-09-14T11:40:10.122 INFO:tasks.workunit.client.0.smithi138.stderr: -388> 2024-09-14T11:40:09.520+0000 7f7a769219c0 10 monclient: build_initial_monmap 2024-09-14T11:40:10.122 INFO:tasks.workunit.client.0.smithi138.stderr: -387> 2024-09-14T11:40:09.520+0000 7f7a769219c0 1 build_initial for_mkfs: 0 2024-09-14T11:40:10.122 INFO:tasks.workunit.client.0.smithi138.stderr: -386> 2024-09-14T11:40:09.520+0000 7f7a769219c0 10 monclient: monmap: 2024-09-14T11:40:10.122 INFO:tasks.workunit.client.0.smithi138.stderr:epoch 0 2024-09-14T11:40:10.123 INFO:tasks.workunit.client.0.smithi138.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-14T11:40:10.123 INFO:tasks.workunit.client.0.smithi138.stderr:last_changed 0.000000 2024-09-14T11:40:10.123 INFO:tasks.workunit.client.0.smithi138.stderr:created 0.000000 2024-09-14T11:40:10.123 INFO:tasks.workunit.client.0.smithi138.stderr:min_mon_release 0 (unknown) 2024-09-14T11:40:10.123 INFO:tasks.workunit.client.0.smithi138.stderr:election_strategy: 1 2024-09-14T11:40:10.123 INFO:tasks.workunit.client.0.smithi138.stderr:0: [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] mon.noname-a 2024-09-14T11:40:10.123 INFO:tasks.workunit.client.0.smithi138.stderr:1: [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] mon.noname-b 2024-09-14T11:40:10.123 INFO:tasks.workunit.client.0.smithi138.stderr:2: [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] mon.noname-c 2024-09-14T11:40:10.123 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-14T11:40:10.123 INFO:tasks.workunit.client.0.smithi138.stderr: -385> 2024-09-14T11:40:09.520+0000 7f7a769219c0 5 AuthRegistry(0x55f41a521e80) adding auth protocol: cephx 2024-09-14T11:40:10.123 INFO:tasks.workunit.client.0.smithi138.stderr: -384> 2024-09-14T11:40:09.520+0000 7f7a769219c0 5 AuthRegistry(0x55f41a521e80) adding auth protocol: cephx 2024-09-14T11:40:10.123 INFO:tasks.workunit.client.0.smithi138.stderr: -383> 2024-09-14T11:40:09.520+0000 7f7a769219c0 5 AuthRegistry(0x55f41a521e80) adding auth protocol: cephx 2024-09-14T11:40:10.123 INFO:tasks.workunit.client.0.smithi138.stderr: -382> 2024-09-14T11:40:09.520+0000 7f7a769219c0 5 AuthRegistry(0x55f41a521e80) adding con mode: secure 2024-09-14T11:40:10.123 INFO:tasks.workunit.client.0.smithi138.stderr: -381> 2024-09-14T11:40:09.520+0000 7f7a769219c0 5 AuthRegistry(0x55f41a521e80) adding con mode: crc 2024-09-14T11:40:10.123 INFO:tasks.workunit.client.0.smithi138.stderr: -380> 2024-09-14T11:40:09.520+0000 7f7a769219c0 5 AuthRegistry(0x55f41a521e80) adding con mode: secure 2024-09-14T11:40:10.123 INFO:tasks.workunit.client.0.smithi138.stderr: -379> 2024-09-14T11:40:09.520+0000 7f7a769219c0 5 AuthRegistry(0x55f41a521e80) adding con mode: crc 2024-09-14T11:40:10.124 INFO:tasks.workunit.client.0.smithi138.stderr: -378> 2024-09-14T11:40:09.520+0000 7f7a769219c0 5 AuthRegistry(0x55f41a521e80) adding con mode: secure 2024-09-14T11:40:10.124 INFO:tasks.workunit.client.0.smithi138.stderr: -377> 2024-09-14T11:40:09.520+0000 7f7a769219c0 5 AuthRegistry(0x55f41a521e80) adding con mode: crc 2024-09-14T11:40:10.124 INFO:tasks.workunit.client.0.smithi138.stderr: -376> 2024-09-14T11:40:09.520+0000 7f7a769219c0 5 AuthRegistry(0x55f41a521e80) adding con mode: crc 2024-09-14T11:40:10.124 INFO:tasks.workunit.client.0.smithi138.stderr: -375> 2024-09-14T11:40:09.520+0000 7f7a769219c0 5 AuthRegistry(0x55f41a521e80) adding con mode: secure 2024-09-14T11:40:10.124 INFO:tasks.workunit.client.0.smithi138.stderr: -374> 2024-09-14T11:40:09.520+0000 7f7a769219c0 5 AuthRegistry(0x55f41a521e80) adding con mode: crc 2024-09-14T11:40:10.124 INFO:tasks.workunit.client.0.smithi138.stderr: -373> 2024-09-14T11:40:09.520+0000 7f7a769219c0 5 AuthRegistry(0x55f41a521e80) adding con mode: secure 2024-09-14T11:40:10.124 INFO:tasks.workunit.client.0.smithi138.stderr: -372> 2024-09-14T11:40:09.520+0000 7f7a769219c0 5 AuthRegistry(0x55f41a521e80) adding con mode: crc 2024-09-14T11:40:10.124 INFO:tasks.workunit.client.0.smithi138.stderr: -371> 2024-09-14T11:40:09.520+0000 7f7a769219c0 5 AuthRegistry(0x55f41a521e80) adding con mode: secure 2024-09-14T11:40:10.124 INFO:tasks.workunit.client.0.smithi138.stderr: -370> 2024-09-14T11:40:09.520+0000 7f7a769219c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:40:10.124 INFO:tasks.workunit.client.0.smithi138.stderr: -369> 2024-09-14T11:40:09.520+0000 7f7a769219c0 5 asok(0x55f41a2bfd90) register_command objecter_requests cmddesc objecter_requests hook 0x55f41a525870 EEXIST 2024-09-14T11:40:10.124 INFO:tasks.workunit.client.0.smithi138.stderr: -368> 2024-09-14T11:40:09.524+0000 7f7a769219c0 10 monclient: init 2024-09-14T11:40:10.124 INFO:tasks.workunit.client.0.smithi138.stderr: -367> 2024-09-14T11:40:09.524+0000 7f7a769219c0 5 AuthRegistry(0x55f41a520d78) adding auth protocol: cephx 2024-09-14T11:40:10.124 INFO:tasks.workunit.client.0.smithi138.stderr: -366> 2024-09-14T11:40:09.524+0000 7f7a769219c0 5 AuthRegistry(0x55f41a520d78) adding auth protocol: cephx 2024-09-14T11:40:10.124 INFO:tasks.workunit.client.0.smithi138.stderr: -365> 2024-09-14T11:40:09.524+0000 7f7a769219c0 5 AuthRegistry(0x55f41a520d78) adding auth protocol: cephx 2024-09-14T11:40:10.125 INFO:tasks.workunit.client.0.smithi138.stderr: -364> 2024-09-14T11:40:09.524+0000 7f7a769219c0 5 AuthRegistry(0x55f41a520d78) adding con mode: secure 2024-09-14T11:40:10.125 INFO:tasks.workunit.client.0.smithi138.stderr: -363> 2024-09-14T11:40:09.524+0000 7f7a769219c0 5 AuthRegistry(0x55f41a520d78) adding con mode: crc 2024-09-14T11:40:10.125 INFO:tasks.workunit.client.0.smithi138.stderr: -362> 2024-09-14T11:40:09.524+0000 7f7a769219c0 5 AuthRegistry(0x55f41a520d78) adding con mode: secure 2024-09-14T11:40:10.125 INFO:tasks.workunit.client.0.smithi138.stderr: -361> 2024-09-14T11:40:09.524+0000 7f7a769219c0 5 AuthRegistry(0x55f41a520d78) adding con mode: crc 2024-09-14T11:40:10.125 INFO:tasks.workunit.client.0.smithi138.stderr: -360> 2024-09-14T11:40:09.524+0000 7f7a769219c0 5 AuthRegistry(0x55f41a520d78) adding con mode: secure 2024-09-14T11:40:10.125 INFO:tasks.workunit.client.0.smithi138.stderr: -359> 2024-09-14T11:40:09.524+0000 7f7a769219c0 5 AuthRegistry(0x55f41a520d78) adding con mode: crc 2024-09-14T11:40:10.125 INFO:tasks.workunit.client.0.smithi138.stderr: -358> 2024-09-14T11:40:09.524+0000 7f7a769219c0 5 AuthRegistry(0x55f41a520d78) adding con mode: crc 2024-09-14T11:40:10.125 INFO:tasks.workunit.client.0.smithi138.stderr: -357> 2024-09-14T11:40:09.524+0000 7f7a769219c0 5 AuthRegistry(0x55f41a520d78) adding con mode: secure 2024-09-14T11:40:10.125 INFO:tasks.workunit.client.0.smithi138.stderr: -356> 2024-09-14T11:40:09.524+0000 7f7a769219c0 5 AuthRegistry(0x55f41a520d78) adding con mode: crc 2024-09-14T11:40:10.125 INFO:tasks.workunit.client.0.smithi138.stderr: -355> 2024-09-14T11:40:09.524+0000 7f7a769219c0 5 AuthRegistry(0x55f41a520d78) adding con mode: secure 2024-09-14T11:40:10.125 INFO:tasks.workunit.client.0.smithi138.stderr: -354> 2024-09-14T11:40:09.524+0000 7f7a769219c0 5 AuthRegistry(0x55f41a520d78) adding con mode: crc 2024-09-14T11:40:10.125 INFO:tasks.workunit.client.0.smithi138.stderr: -353> 2024-09-14T11:40:09.524+0000 7f7a769219c0 5 AuthRegistry(0x55f41a520d78) adding con mode: secure 2024-09-14T11:40:10.125 INFO:tasks.workunit.client.0.smithi138.stderr: -352> 2024-09-14T11:40:09.524+0000 7f7a769219c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:40:10.125 INFO:tasks.workunit.client.0.smithi138.stderr: -351> 2024-09-14T11:40:09.524+0000 7f7a769219c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:40:10.126 INFO:tasks.workunit.client.0.smithi138.stderr: -350> 2024-09-14T11:40:09.524+0000 7f7a769219c0 5 asok(0x55f41a2bfd90) register_command rotate-key cmddesc rotate-key hook 0x55f41a520ec0 EEXIST 2024-09-14T11:40:10.126 INFO:tasks.workunit.client.0.smithi138.stderr: -349> 2024-09-14T11:40:09.524+0000 7f7a769219c0 10 monclient: _reopen_session rank -1 2024-09-14T11:40:10.126 INFO:tasks.workunit.client.0.smithi138.stderr: -348> 2024-09-14T11:40:09.524+0000 7f7a769219c0 10 monclient: _add_conns ranks=[1,0,2] 2024-09-14T11:40:10.126 INFO:tasks.workunit.client.0.smithi138.stderr: -347> 2024-09-14T11:40:09.524+0000 7f7a769219c0 10 monclient(hunting): picked mon.noname-b con 0x55f41a549a20 addr [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] 2024-09-14T11:40:10.126 INFO:tasks.workunit.client.0.smithi138.stderr: -346> 2024-09-14T11:40:09.524+0000 7f7a769219c0 10 monclient(hunting): picked mon.noname-a con 0x55f41a549350 addr [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] 2024-09-14T11:40:10.126 INFO:tasks.workunit.client.0.smithi138.stderr: -345> 2024-09-14T11:40:09.524+0000 7f7a769219c0 10 monclient(hunting): picked mon.noname-c con 0x55f41a547d30 addr [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] 2024-09-14T11:40:10.126 INFO:tasks.workunit.client.0.smithi138.stderr: -344> 2024-09-14T11:40:09.524+0000 7f7a769219c0 10 monclient(hunting): start opening mon connection 2024-09-14T11:40:10.126 INFO:tasks.workunit.client.0.smithi138.stderr: -343> 2024-09-14T11:40:09.524+0000 7f7a769219c0 10 monclient(hunting): start opening mon connection 2024-09-14T11:40:10.126 INFO:tasks.workunit.client.0.smithi138.stderr: -342> 2024-09-14T11:40:09.524+0000 7f7a769219c0 10 monclient(hunting): start opening mon connection 2024-09-14T11:40:10.126 INFO:tasks.workunit.client.0.smithi138.stderr: -341> 2024-09-14T11:40:09.524+0000 7f7a769219c0 10 monclient(hunting): _renew_subs 2024-09-14T11:40:10.126 INFO:tasks.workunit.client.0.smithi138.stderr: -340> 2024-09-14T11:40:09.524+0000 7f7a769219c0 10 monclient(hunting): authenticate will time out at 2945.484716s 2024-09-14T11:40:10.126 INFO:tasks.workunit.client.0.smithi138.stderr: -339> 2024-09-14T11:40:09.524+0000 7f7a74427640 10 monclient(hunting): get_auth_request con 0x55f41a547d30 auth_method 0 2024-09-14T11:40:10.126 INFO:tasks.workunit.client.0.smithi138.stderr: -338> 2024-09-14T11:40:09.524+0000 7f7a74427640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:40:10.126 INFO:tasks.workunit.client.0.smithi138.stderr: -337> 2024-09-14T11:40:09.524+0000 7f7a74427640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:40:10.126 INFO:tasks.workunit.client.0.smithi138.stderr: -336> 2024-09-14T11:40:09.524+0000 7f7a74427640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:40:10.127 INFO:tasks.workunit.client.0.smithi138.stderr: -335> 2024-09-14T11:40:09.524+0000 7f7a74c28640 10 monclient(hunting): get_auth_request con 0x55f41a549350 auth_method 0 2024-09-14T11:40:10.127 INFO:tasks.workunit.client.0.smithi138.stderr: -334> 2024-09-14T11:40:09.524+0000 7f7a74c28640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:40:10.127 INFO:tasks.workunit.client.0.smithi138.stderr: -333> 2024-09-14T11:40:09.524+0000 7f7a74c28640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:40:10.127 INFO:tasks.workunit.client.0.smithi138.stderr: -332> 2024-09-14T11:40:09.524+0000 7f7a74c28640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:40:10.127 INFO:tasks.workunit.client.0.smithi138.stderr: -331> 2024-09-14T11:40:09.524+0000 7f7a74427640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:40:10.127 INFO:tasks.workunit.client.0.smithi138.stderr: -330> 2024-09-14T11:40:09.524+0000 7f7a74427640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:40:10.127 INFO:tasks.workunit.client.0.smithi138.stderr: -329> 2024-09-14T11:40:09.524+0000 7f7a74427640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:40:10.127 INFO:tasks.workunit.client.0.smithi138.stderr: -328> 2024-09-14T11:40:09.524+0000 7f7a74c28640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:40:10.127 INFO:tasks.workunit.client.0.smithi138.stderr: -327> 2024-09-14T11:40:09.524+0000 7f7a74c28640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:40:10.127 INFO:tasks.workunit.client.0.smithi138.stderr: -326> 2024-09-14T11:40:09.524+0000 7f7a74c28640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:40:10.127 INFO:tasks.workunit.client.0.smithi138.stderr: -325> 2024-09-14T11:40:09.524+0000 7f7a73c26640 10 monclient(hunting): get_auth_request con 0x55f41a549a20 auth_method 0 2024-09-14T11:40:10.127 INFO:tasks.workunit.client.0.smithi138.stderr: -324> 2024-09-14T11:40:09.524+0000 7f7a73c26640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:40:10.127 INFO:tasks.workunit.client.0.smithi138.stderr: -323> 2024-09-14T11:40:09.524+0000 7f7a73c26640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:40:10.127 INFO:tasks.workunit.client.0.smithi138.stderr: -322> 2024-09-14T11:40:09.524+0000 7f7a73c26640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:40:10.127 INFO:tasks.workunit.client.0.smithi138.stderr: -321> 2024-09-14T11:40:09.524+0000 7f7a74427640 10 monclient(hunting): handle_auth_done global_id 7607 payload 824 2024-09-14T11:40:10.128 INFO:tasks.workunit.client.0.smithi138.stderr: -320> 2024-09-14T11:40:09.524+0000 7f7a74427640 10 monclient: _finish_hunting 0 2024-09-14T11:40:10.128 INFO:tasks.workunit.client.0.smithi138.stderr: -319> 2024-09-14T11:40:09.524+0000 7f7a74427640 1 monclient: found mon.noname-c 2024-09-14T11:40:10.128 INFO:tasks.workunit.client.0.smithi138.stderr: -318> 2024-09-14T11:40:09.524+0000 7f7a74427640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.138:3301/0 2024-09-14T11:40:10.128 INFO:tasks.workunit.client.0.smithi138.stderr: -317> 2024-09-14T11:40:09.524+0000 7f7959ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:40:10.128 INFO:tasks.workunit.client.0.smithi138.stderr: -316> 2024-09-14T11:40:09.524+0000 7f7959ffb640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-14T11:40:10.128 INFO:tasks.workunit.client.0.smithi138.stderr: -315> 2024-09-14T11:40:09.524+0000 7f7959ffb640 10 monclient: dump: 2024-09-14T11:40:10.128 INFO:tasks.workunit.client.0.smithi138.stderr:epoch 1 2024-09-14T11:40:10.128 INFO:tasks.workunit.client.0.smithi138.stderr:fsid 3f225f43-83a6-4aeb-b798-1f04bb49d597 2024-09-14T11:40:10.128 INFO:tasks.workunit.client.0.smithi138.stderr:last_changed 2024-09-14T11:07:09.252780+0000 2024-09-14T11:40:10.128 INFO:tasks.workunit.client.0.smithi138.stderr:created 2024-09-14T11:07:09.252780+0000 2024-09-14T11:40:10.128 INFO:tasks.workunit.client.0.smithi138.stderr:min_mon_release 19 (squid) 2024-09-14T11:40:10.128 INFO:tasks.workunit.client.0.smithi138.stderr:election_strategy: 1 2024-09-14T11:40:10.128 INFO:tasks.workunit.client.0.smithi138.stderr:0: [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] mon.a 2024-09-14T11:40:10.128 INFO:tasks.workunit.client.0.smithi138.stderr:1: [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] mon.b 2024-09-14T11:40:10.128 INFO:tasks.workunit.client.0.smithi138.stderr:2: [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] mon.c 2024-09-14T11:40:10.129 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-14T11:40:10.129 INFO:tasks.workunit.client.0.smithi138.stderr: -314> 2024-09-14T11:40:09.524+0000 7f7959ffb640 10 monclient: _finish_auth 0 2024-09-14T11:40:10.129 INFO:tasks.workunit.client.0.smithi138.stderr: -313> 2024-09-14T11:40:09.524+0000 7f7959ffb640 10 monclient: _check_auth_tickets 2024-09-14T11:40:10.129 INFO:tasks.workunit.client.0.smithi138.stderr: -312> 2024-09-14T11:40:09.524+0000 7f7959ffb640 10 monclient: handle_config config(0 keys) 2024-09-14T11:40:10.129 INFO:tasks.workunit.client.0.smithi138.stderr: -311> 2024-09-14T11:40:09.524+0000 7f7959ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:40:10.129 INFO:tasks.workunit.client.0.smithi138.stderr: -310> 2024-09-14T11:40:09.524+0000 7f7959ffb640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-14T11:40:10.129 INFO:tasks.workunit.client.0.smithi138.stderr: -309> 2024-09-14T11:40:09.524+0000 7f7959ffb640 10 monclient: dump: 2024-09-14T11:40:10.129 INFO:tasks.workunit.client.0.smithi138.stderr:epoch 1 2024-09-14T11:40:10.129 INFO:tasks.workunit.client.0.smithi138.stderr:fsid 3f225f43-83a6-4aeb-b798-1f04bb49d597 2024-09-14T11:40:10.129 INFO:tasks.workunit.client.0.smithi138.stderr:last_changed 2024-09-14T11:07:09.252780+0000 2024-09-14T11:40:10.129 INFO:tasks.workunit.client.0.smithi138.stderr:created 2024-09-14T11:07:09.252780+0000 2024-09-14T11:40:10.129 INFO:tasks.workunit.client.0.smithi138.stderr:min_mon_release 19 (squid) 2024-09-14T11:40:10.129 INFO:tasks.workunit.client.0.smithi138.stderr:election_strategy: 1 2024-09-14T11:40:10.129 INFO:tasks.workunit.client.0.smithi138.stderr:0: [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] mon.a 2024-09-14T11:40:10.129 INFO:tasks.workunit.client.0.smithi138.stderr:1: [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] mon.b 2024-09-14T11:40:10.129 INFO:tasks.workunit.client.0.smithi138.stderr:2: [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] mon.c 2024-09-14T11:40:10.129 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-14T11:40:10.130 INFO:tasks.workunit.client.0.smithi138.stderr: -308> 2024-09-14T11:40:09.524+0000 7f7a75429640 4 set_mon_vals no callback set 2024-09-14T11:40:10.130 INFO:tasks.workunit.client.0.smithi138.stderr: -307> 2024-09-14T11:40:09.524+0000 7f7a769219c0 5 monclient: authenticate success, global_id 7607 2024-09-14T11:40:10.130 INFO:tasks.workunit.client.0.smithi138.stderr: -306> 2024-09-14T11:40:09.524+0000 7f7a769219c0 10 monclient: _renew_subs 2024-09-14T11:40:10.130 INFO:tasks.workunit.client.0.smithi138.stderr: -305> 2024-09-14T11:40:09.524+0000 7f7a769219c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.138:3301/0 2024-09-14T11:40:10.130 INFO:tasks.workunit.client.0.smithi138.stderr: -304> 2024-09-14T11:40:09.524+0000 7f7a769219c0 10 monclient: _renew_subs 2024-09-14T11:40:10.130 INFO:tasks.workunit.client.0.smithi138.stderr: -303> 2024-09-14T11:40:09.524+0000 7f7a769219c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.138:3301/0 2024-09-14T11:40:10.130 INFO:tasks.workunit.client.0.smithi138.stderr: -302> 2024-09-14T11:40:09.524+0000 7f7959ffb640 4 mgrc handle_mgr_map Got map version 5 2024-09-14T11:40:10.130 INFO:tasks.workunit.client.0.smithi138.stderr: -301> 2024-09-14T11:40:09.524+0000 7f7959ffb640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.138:6832/3778043143,v1:172.21.15.138:6833/3778043143] 2024-09-14T11:40:10.130 INFO:tasks.workunit.client.0.smithi138.stderr: -300> 2024-09-14T11:40:09.524+0000 7f7959ffb640 4 mgrc reconnect Starting new session with [v2:172.21.15.138:6832/3778043143,v1:172.21.15.138:6833/3778043143] 2024-09-14T11:40:10.130 INFO:tasks.workunit.client.0.smithi138.stderr: -299> 2024-09-14T11:40:09.524+0000 7f7a73c26640 10 monclient: get_auth_request con 0x7f794c0717e0 auth_method 0 2024-09-14T11:40:10.130 INFO:tasks.workunit.client.0.smithi138.stderr: -298> 2024-09-14T11:40:09.524+0000 7f7a769219c0 10 monclient: get_monmap_and_config 2024-09-14T11:40:10.130 INFO:tasks.workunit.client.0.smithi138.stderr: -297> 2024-09-14T11:40:09.524+0000 7f7a769219c0 10 monclient: build_initial_monmap 2024-09-14T11:40:10.130 INFO:tasks.workunit.client.0.smithi138.stderr: -296> 2024-09-14T11:40:09.524+0000 7f7a769219c0 1 build_initial for_mkfs: 0 2024-09-14T11:40:10.130 INFO:tasks.workunit.client.0.smithi138.stderr: -295> 2024-09-14T11:40:09.524+0000 7f7a769219c0 10 monclient: monmap: 2024-09-14T11:40:10.131 INFO:tasks.workunit.client.0.smithi138.stderr:epoch 0 2024-09-14T11:40:10.131 INFO:tasks.workunit.client.0.smithi138.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-14T11:40:10.131 INFO:tasks.workunit.client.0.smithi138.stderr:last_changed 0.000000 2024-09-14T11:40:10.131 INFO:tasks.workunit.client.0.smithi138.stderr:created 0.000000 2024-09-14T11:40:10.131 INFO:tasks.workunit.client.0.smithi138.stderr:min_mon_release 0 (unknown) 2024-09-14T11:40:10.131 INFO:tasks.workunit.client.0.smithi138.stderr:election_strategy: 1 2024-09-14T11:40:10.131 INFO:tasks.workunit.client.0.smithi138.stderr:0: [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] mon.noname-a 2024-09-14T11:40:10.131 INFO:tasks.workunit.client.0.smithi138.stderr:1: [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] mon.noname-b 2024-09-14T11:40:10.131 INFO:tasks.workunit.client.0.smithi138.stderr:2: [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] mon.noname-c 2024-09-14T11:40:10.131 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-14T11:40:10.131 INFO:tasks.workunit.client.0.smithi138.stderr: -294> 2024-09-14T11:40:09.524+0000 7f7a769219c0 5 AuthRegistry(0x55f41a5693b0) adding auth protocol: cephx 2024-09-14T11:40:10.131 INFO:tasks.workunit.client.0.smithi138.stderr: -293> 2024-09-14T11:40:09.524+0000 7f7a769219c0 5 AuthRegistry(0x55f41a5693b0) adding auth protocol: cephx 2024-09-14T11:40:10.131 INFO:tasks.workunit.client.0.smithi138.stderr: -292> 2024-09-14T11:40:09.524+0000 7f7a769219c0 5 AuthRegistry(0x55f41a5693b0) adding auth protocol: cephx 2024-09-14T11:40:10.131 INFO:tasks.workunit.client.0.smithi138.stderr: -291> 2024-09-14T11:40:09.524+0000 7f7a769219c0 5 AuthRegistry(0x55f41a5693b0) adding con mode: secure 2024-09-14T11:40:10.131 INFO:tasks.workunit.client.0.smithi138.stderr: -290> 2024-09-14T11:40:09.524+0000 7f7a769219c0 5 AuthRegistry(0x55f41a5693b0) adding con mode: crc 2024-09-14T11:40:10.132 INFO:tasks.workunit.client.0.smithi138.stderr: -289> 2024-09-14T11:40:09.524+0000 7f7a769219c0 5 AuthRegistry(0x55f41a5693b0) adding con mode: secure 2024-09-14T11:40:10.132 INFO:tasks.workunit.client.0.smithi138.stderr: -288> 2024-09-14T11:40:09.524+0000 7f7a769219c0 5 AuthRegistry(0x55f41a5693b0) adding con mode: crc 2024-09-14T11:40:10.132 INFO:tasks.workunit.client.0.smithi138.stderr: -287> 2024-09-14T11:40:09.524+0000 7f7a769219c0 5 AuthRegistry(0x55f41a5693b0) adding con mode: secure 2024-09-14T11:40:10.132 INFO:tasks.workunit.client.0.smithi138.stderr: -286> 2024-09-14T11:40:09.524+0000 7f7a769219c0 5 AuthRegistry(0x55f41a5693b0) adding con mode: crc 2024-09-14T11:40:10.132 INFO:tasks.workunit.client.0.smithi138.stderr: -285> 2024-09-14T11:40:09.524+0000 7f7a769219c0 5 AuthRegistry(0x55f41a5693b0) adding con mode: crc 2024-09-14T11:40:10.132 INFO:tasks.workunit.client.0.smithi138.stderr: -284> 2024-09-14T11:40:09.524+0000 7f7a769219c0 5 AuthRegistry(0x55f41a5693b0) adding con mode: secure 2024-09-14T11:40:10.132 INFO:tasks.workunit.client.0.smithi138.stderr: -283> 2024-09-14T11:40:09.524+0000 7f7a769219c0 5 AuthRegistry(0x55f41a5693b0) adding con mode: crc 2024-09-14T11:40:10.132 INFO:tasks.workunit.client.0.smithi138.stderr: -282> 2024-09-14T11:40:09.524+0000 7f7a769219c0 5 AuthRegistry(0x55f41a5693b0) adding con mode: secure 2024-09-14T11:40:10.132 INFO:tasks.workunit.client.0.smithi138.stderr: -281> 2024-09-14T11:40:09.524+0000 7f7a769219c0 5 AuthRegistry(0x55f41a5693b0) adding con mode: crc 2024-09-14T11:40:10.132 INFO:tasks.workunit.client.0.smithi138.stderr: -280> 2024-09-14T11:40:09.524+0000 7f7a769219c0 5 AuthRegistry(0x55f41a5693b0) adding con mode: secure 2024-09-14T11:40:10.132 INFO:tasks.workunit.client.0.smithi138.stderr: -279> 2024-09-14T11:40:09.528+0000 7f7a769219c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:40:10.132 INFO:tasks.workunit.client.0.smithi138.stderr: -278> 2024-09-14T11:40:09.528+0000 7f7a769219c0 10 monclient: init 2024-09-14T11:40:10.132 INFO:tasks.workunit.client.0.smithi138.stderr: -277> 2024-09-14T11:40:09.528+0000 7f7a769219c0 5 AuthRegistry(0x7ffece940880) adding auth protocol: cephx 2024-09-14T11:40:10.132 INFO:tasks.workunit.client.0.smithi138.stderr: -276> 2024-09-14T11:40:09.528+0000 7f7a769219c0 5 AuthRegistry(0x7ffece940880) adding auth protocol: cephx 2024-09-14T11:40:10.132 INFO:tasks.workunit.client.0.smithi138.stderr: -275> 2024-09-14T11:40:09.528+0000 7f7a769219c0 5 AuthRegistry(0x7ffece940880) adding auth protocol: cephx 2024-09-14T11:40:10.133 INFO:tasks.workunit.client.0.smithi138.stderr: -274> 2024-09-14T11:40:09.528+0000 7f7a769219c0 5 AuthRegistry(0x7ffece940880) adding con mode: secure 2024-09-14T11:40:10.133 INFO:tasks.workunit.client.0.smithi138.stderr: -273> 2024-09-14T11:40:09.528+0000 7f7a769219c0 5 AuthRegistry(0x7ffece940880) adding con mode: crc 2024-09-14T11:40:10.133 INFO:tasks.workunit.client.0.smithi138.stderr: -272> 2024-09-14T11:40:09.528+0000 7f7a769219c0 5 AuthRegistry(0x7ffece940880) adding con mode: secure 2024-09-14T11:40:10.133 INFO:tasks.workunit.client.0.smithi138.stderr: -271> 2024-09-14T11:40:09.528+0000 7f7a769219c0 5 AuthRegistry(0x7ffece940880) adding con mode: crc 2024-09-14T11:40:10.133 INFO:tasks.workunit.client.0.smithi138.stderr: -270> 2024-09-14T11:40:09.528+0000 7f7a769219c0 5 AuthRegistry(0x7ffece940880) adding con mode: secure 2024-09-14T11:40:10.133 INFO:tasks.workunit.client.0.smithi138.stderr: -269> 2024-09-14T11:40:09.528+0000 7f7a769219c0 5 AuthRegistry(0x7ffece940880) adding con mode: crc 2024-09-14T11:40:10.133 INFO:tasks.workunit.client.0.smithi138.stderr: -268> 2024-09-14T11:40:09.528+0000 7f7a769219c0 5 AuthRegistry(0x7ffece940880) adding con mode: crc 2024-09-14T11:40:10.133 INFO:tasks.workunit.client.0.smithi138.stderr: -267> 2024-09-14T11:40:09.528+0000 7f7a769219c0 5 AuthRegistry(0x7ffece940880) adding con mode: secure 2024-09-14T11:40:10.133 INFO:tasks.workunit.client.0.smithi138.stderr: -266> 2024-09-14T11:40:09.528+0000 7f7a769219c0 5 AuthRegistry(0x7ffece940880) adding con mode: crc 2024-09-14T11:40:10.133 INFO:tasks.workunit.client.0.smithi138.stderr: -265> 2024-09-14T11:40:09.528+0000 7f7a769219c0 5 AuthRegistry(0x7ffece940880) adding con mode: secure 2024-09-14T11:40:10.133 INFO:tasks.workunit.client.0.smithi138.stderr: -264> 2024-09-14T11:40:09.528+0000 7f7a769219c0 5 AuthRegistry(0x7ffece940880) adding con mode: crc 2024-09-14T11:40:10.133 INFO:tasks.workunit.client.0.smithi138.stderr: -263> 2024-09-14T11:40:09.528+0000 7f7a769219c0 5 AuthRegistry(0x7ffece940880) adding con mode: secure 2024-09-14T11:40:10.133 INFO:tasks.workunit.client.0.smithi138.stderr: -262> 2024-09-14T11:40:09.528+0000 7f7a769219c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:40:10.133 INFO:tasks.workunit.client.0.smithi138.stderr: -261> 2024-09-14T11:40:09.528+0000 7f7a769219c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:40:10.133 INFO:tasks.workunit.client.0.smithi138.stderr: -260> 2024-09-14T11:40:09.528+0000 7f7a769219c0 5 asok(0x55f41a2bfd90) register_command rotate-key cmddesc rotate-key hook 0x7ffece9409c8 EEXIST 2024-09-14T11:40:10.134 INFO:tasks.workunit.client.0.smithi138.stderr: -259> 2024-09-14T11:40:09.528+0000 7f7a769219c0 10 monclient: _reopen_session rank -1 2024-09-14T11:40:10.134 INFO:tasks.workunit.client.0.smithi138.stderr: -258> 2024-09-14T11:40:09.528+0000 7f7a769219c0 10 monclient: _add_conns ranks=[2,0,1] 2024-09-14T11:40:10.134 INFO:tasks.workunit.client.0.smithi138.stderr: -257> 2024-09-14T11:40:09.528+0000 7f7a769219c0 10 monclient(hunting): picked mon.noname-c con 0x55f41a59d8d0 addr [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] 2024-09-14T11:40:10.134 INFO:tasks.workunit.client.0.smithi138.stderr: -256> 2024-09-14T11:40:09.528+0000 7f7a769219c0 10 monclient(hunting): picked mon.noname-a con 0x55f41a598cc0 addr [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] 2024-09-14T11:40:10.134 INFO:tasks.workunit.client.0.smithi138.stderr: -255> 2024-09-14T11:40:09.528+0000 7f7a769219c0 10 monclient(hunting): picked mon.noname-b con 0x55f41a599640 addr [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] 2024-09-14T11:40:10.134 INFO:tasks.workunit.client.0.smithi138.stderr: -254> 2024-09-14T11:40:09.528+0000 7f7a769219c0 10 monclient(hunting): start opening mon connection 2024-09-14T11:40:10.134 INFO:tasks.workunit.client.0.smithi138.stderr: -253> 2024-09-14T11:40:09.528+0000 7f7a769219c0 10 monclient(hunting): start opening mon connection 2024-09-14T11:40:10.134 INFO:tasks.workunit.client.0.smithi138.stderr: -252> 2024-09-14T11:40:09.528+0000 7f7a769219c0 10 monclient(hunting): start opening mon connection 2024-09-14T11:40:10.134 INFO:tasks.workunit.client.0.smithi138.stderr: -251> 2024-09-14T11:40:09.528+0000 7f7a769219c0 10 monclient(hunting): _renew_subs 2024-09-14T11:40:10.134 INFO:tasks.workunit.client.0.smithi138.stderr: -250> 2024-09-14T11:40:09.528+0000 7f7a769219c0 10 monclient(hunting): authenticate will time out at 2945.488914s 2024-09-14T11:40:10.134 INFO:tasks.workunit.client.0.smithi138.stderr: -249> 2024-09-14T11:40:09.528+0000 7f7a74c28640 10 monclient(hunting): get_auth_request con 0x55f41a598cc0 auth_method 0 2024-09-14T11:40:10.134 INFO:tasks.workunit.client.0.smithi138.stderr: -248> 2024-09-14T11:40:09.528+0000 7f7a74c28640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:40:10.134 INFO:tasks.workunit.client.0.smithi138.stderr: -247> 2024-09-14T11:40:09.528+0000 7f7a74c28640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:40:10.135 INFO:tasks.workunit.client.0.smithi138.stderr: -246> 2024-09-14T11:40:09.528+0000 7f7a74c28640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:40:10.135 INFO:tasks.workunit.client.0.smithi138.stderr: -245> 2024-09-14T11:40:09.528+0000 7f7a73c26640 10 monclient(hunting): get_auth_request con 0x55f41a59d8d0 auth_method 0 2024-09-14T11:40:10.135 INFO:tasks.workunit.client.0.smithi138.stderr: -244> 2024-09-14T11:40:09.528+0000 7f7a73c26640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:40:10.135 INFO:tasks.workunit.client.0.smithi138.stderr: -243> 2024-09-14T11:40:09.528+0000 7f7a73c26640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:40:10.135 INFO:tasks.workunit.client.0.smithi138.stderr: -242> 2024-09-14T11:40:09.528+0000 7f7a73c26640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:40:10.135 INFO:tasks.workunit.client.0.smithi138.stderr: -241> 2024-09-14T11:40:09.528+0000 7f7a74c28640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:40:10.135 INFO:tasks.workunit.client.0.smithi138.stderr: -240> 2024-09-14T11:40:09.528+0000 7f7a74c28640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:40:10.135 INFO:tasks.workunit.client.0.smithi138.stderr: -239> 2024-09-14T11:40:09.528+0000 7f7a74c28640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:40:10.135 INFO:tasks.workunit.client.0.smithi138.stderr: -238> 2024-09-14T11:40:09.528+0000 7f7a73c26640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:40:10.135 INFO:tasks.workunit.client.0.smithi138.stderr: -237> 2024-09-14T11:40:09.528+0000 7f7a73c26640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:40:10.135 INFO:tasks.workunit.client.0.smithi138.stderr: -236> 2024-09-14T11:40:09.528+0000 7f7a73c26640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:40:10.135 INFO:tasks.workunit.client.0.smithi138.stderr: -235> 2024-09-14T11:40:09.528+0000 7f7a74427640 10 monclient(hunting): get_auth_request con 0x55f41a599640 auth_method 0 2024-09-14T11:40:10.135 INFO:tasks.workunit.client.0.smithi138.stderr: -234> 2024-09-14T11:40:09.528+0000 7f7a74427640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:40:10.135 INFO:tasks.workunit.client.0.smithi138.stderr: -233> 2024-09-14T11:40:09.528+0000 7f7a74427640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:40:10.135 INFO:tasks.workunit.client.0.smithi138.stderr: -232> 2024-09-14T11:40:09.528+0000 7f7a74427640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:40:10.136 INFO:tasks.workunit.client.0.smithi138.stderr: -231> 2024-09-14T11:40:09.528+0000 7f7a74c28640 10 monclient(hunting): handle_auth_done global_id 8145 payload 274 2024-09-14T11:40:10.136 INFO:tasks.workunit.client.0.smithi138.stderr: -230> 2024-09-14T11:40:09.528+0000 7f7a74c28640 10 monclient: _finish_hunting 0 2024-09-14T11:40:10.136 INFO:tasks.workunit.client.0.smithi138.stderr: -229> 2024-09-14T11:40:09.528+0000 7f7a74c28640 1 monclient: found mon.noname-a 2024-09-14T11:40:10.136 INFO:tasks.workunit.client.0.smithi138.stderr: -228> 2024-09-14T11:40:09.528+0000 7f7a74c28640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.138:3300/0 2024-09-14T11:40:10.136 INFO:tasks.workunit.client.0.smithi138.stderr: -227> 2024-09-14T11:40:09.528+0000 7f794b7fe640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:40:10.136 INFO:tasks.workunit.client.0.smithi138.stderr: -226> 2024-09-14T11:40:09.528+0000 7f794b7fe640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-14T11:40:10.136 INFO:tasks.workunit.client.0.smithi138.stderr: -225> 2024-09-14T11:40:09.528+0000 7f794b7fe640 10 monclient: dump: 2024-09-14T11:40:10.136 INFO:tasks.workunit.client.0.smithi138.stderr:epoch 1 2024-09-14T11:40:10.136 INFO:tasks.workunit.client.0.smithi138.stderr:fsid 3f225f43-83a6-4aeb-b798-1f04bb49d597 2024-09-14T11:40:10.136 INFO:tasks.workunit.client.0.smithi138.stderr:last_changed 2024-09-14T11:07:09.252780+0000 2024-09-14T11:40:10.136 INFO:tasks.workunit.client.0.smithi138.stderr:created 2024-09-14T11:07:09.252780+0000 2024-09-14T11:40:10.136 INFO:tasks.workunit.client.0.smithi138.stderr:min_mon_release 19 (squid) 2024-09-14T11:40:10.136 INFO:tasks.workunit.client.0.smithi138.stderr:election_strategy: 1 2024-09-14T11:40:10.136 INFO:tasks.workunit.client.0.smithi138.stderr:0: [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] mon.a 2024-09-14T11:40:10.137 INFO:tasks.workunit.client.0.smithi138.stderr:1: [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] mon.b 2024-09-14T11:40:10.137 INFO:tasks.workunit.client.0.smithi138.stderr:2: [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] mon.c 2024-09-14T11:40:10.137 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-14T11:40:10.137 INFO:tasks.workunit.client.0.smithi138.stderr: -224> 2024-09-14T11:40:09.528+0000 7f794b7fe640 10 monclient: _finish_auth 0 2024-09-14T11:40:10.137 INFO:tasks.workunit.client.0.smithi138.stderr: -223> 2024-09-14T11:40:09.528+0000 7f794b7fe640 10 monclient: _check_auth_tickets 2024-09-14T11:40:10.137 INFO:tasks.workunit.client.0.smithi138.stderr: -222> 2024-09-14T11:40:09.528+0000 7f794b7fe640 10 monclient: handle_config config(0 keys) 2024-09-14T11:40:10.137 INFO:tasks.workunit.client.0.smithi138.stderr: -221> 2024-09-14T11:40:09.528+0000 7f794b7fe640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:40:10.137 INFO:tasks.workunit.client.0.smithi138.stderr: -220> 2024-09-14T11:40:09.528+0000 7f794b7fe640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-14T11:40:10.137 INFO:tasks.workunit.client.0.smithi138.stderr: -219> 2024-09-14T11:40:09.528+0000 7f794b7fe640 10 monclient: dump: 2024-09-14T11:40:10.137 INFO:tasks.workunit.client.0.smithi138.stderr:epoch 1 2024-09-14T11:40:10.137 INFO:tasks.workunit.client.0.smithi138.stderr:fsid 3f225f43-83a6-4aeb-b798-1f04bb49d597 2024-09-14T11:40:10.137 INFO:tasks.workunit.client.0.smithi138.stderr:last_changed 2024-09-14T11:07:09.252780+0000 2024-09-14T11:40:10.137 INFO:tasks.workunit.client.0.smithi138.stderr:created 2024-09-14T11:07:09.252780+0000 2024-09-14T11:40:10.137 INFO:tasks.workunit.client.0.smithi138.stderr:min_mon_release 19 (squid) 2024-09-14T11:40:10.137 INFO:tasks.workunit.client.0.smithi138.stderr:election_strategy: 1 2024-09-14T11:40:10.138 INFO:tasks.workunit.client.0.smithi138.stderr:0: [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] mon.a 2024-09-14T11:40:10.138 INFO:tasks.workunit.client.0.smithi138.stderr:1: [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] mon.b 2024-09-14T11:40:10.138 INFO:tasks.workunit.client.0.smithi138.stderr:2: [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] mon.c 2024-09-14T11:40:10.138 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-14T11:40:10.138 INFO:tasks.workunit.client.0.smithi138.stderr: -218> 2024-09-14T11:40:09.528+0000 7f7a769219c0 5 monclient: authenticate success, global_id 8145 2024-09-14T11:40:10.138 INFO:tasks.workunit.client.0.smithi138.stderr: -217> 2024-09-14T11:40:09.528+0000 7f7a769219c0 10 monclient: get_monmap_and_config success 2024-09-14T11:40:10.138 INFO:tasks.workunit.client.0.smithi138.stderr: -216> 2024-09-14T11:40:09.528+0000 7f7a769219c0 4 set_mon_vals no callback set 2024-09-14T11:40:10.138 INFO:tasks.workunit.client.0.smithi138.stderr: -215> 2024-09-14T11:40:09.528+0000 7f7a769219c0 10 monclient: shutdown 2024-09-14T11:40:10.138 INFO:tasks.workunit.client.0.smithi138.stderr: -214> 2024-09-14T11:40:09.528+0000 7f7a769219c0 10 monclient: build_initial_monmap 2024-09-14T11:40:10.138 INFO:tasks.workunit.client.0.smithi138.stderr: -213> 2024-09-14T11:40:09.528+0000 7f7a769219c0 1 build_initial for_mkfs: 0 2024-09-14T11:40:10.138 INFO:tasks.workunit.client.0.smithi138.stderr: -212> 2024-09-14T11:40:09.528+0000 7f7a769219c0 10 monclient: monmap: 2024-09-14T11:40:10.138 INFO:tasks.workunit.client.0.smithi138.stderr:epoch 0 2024-09-14T11:40:10.138 INFO:tasks.workunit.client.0.smithi138.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-14T11:40:10.138 INFO:tasks.workunit.client.0.smithi138.stderr:last_changed 0.000000 2024-09-14T11:40:10.138 INFO:tasks.workunit.client.0.smithi138.stderr:created 0.000000 2024-09-14T11:40:10.139 INFO:tasks.workunit.client.0.smithi138.stderr:min_mon_release 0 (unknown) 2024-09-14T11:40:10.139 INFO:tasks.workunit.client.0.smithi138.stderr:election_strategy: 1 2024-09-14T11:40:10.139 INFO:tasks.workunit.client.0.smithi138.stderr:0: [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] mon.noname-a 2024-09-14T11:40:10.139 INFO:tasks.workunit.client.0.smithi138.stderr:1: [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] mon.noname-b 2024-09-14T11:40:10.139 INFO:tasks.workunit.client.0.smithi138.stderr:2: [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] mon.noname-c 2024-09-14T11:40:10.139 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-14T11:40:10.139 INFO:tasks.workunit.client.0.smithi138.stderr: -211> 2024-09-14T11:40:09.528+0000 7f7a769219c0 5 AuthRegistry(0x55f41a58fcb0) adding auth protocol: cephx 2024-09-14T11:40:10.139 INFO:tasks.workunit.client.0.smithi138.stderr: -210> 2024-09-14T11:40:09.528+0000 7f7a769219c0 5 AuthRegistry(0x55f41a58fcb0) adding auth protocol: cephx 2024-09-14T11:40:10.139 INFO:tasks.workunit.client.0.smithi138.stderr: -209> 2024-09-14T11:40:09.528+0000 7f7a769219c0 5 AuthRegistry(0x55f41a58fcb0) adding auth protocol: cephx 2024-09-14T11:40:10.139 INFO:tasks.workunit.client.0.smithi138.stderr: -208> 2024-09-14T11:40:09.528+0000 7f7a769219c0 5 AuthRegistry(0x55f41a58fcb0) adding con mode: secure 2024-09-14T11:40:10.139 INFO:tasks.workunit.client.0.smithi138.stderr: -207> 2024-09-14T11:40:09.528+0000 7f7a769219c0 5 AuthRegistry(0x55f41a58fcb0) adding con mode: crc 2024-09-14T11:40:10.139 INFO:tasks.workunit.client.0.smithi138.stderr: -206> 2024-09-14T11:40:09.528+0000 7f7a769219c0 5 AuthRegistry(0x55f41a58fcb0) adding con mode: secure 2024-09-14T11:40:10.139 INFO:tasks.workunit.client.0.smithi138.stderr: -205> 2024-09-14T11:40:09.528+0000 7f7a769219c0 5 AuthRegistry(0x55f41a58fcb0) adding con mode: crc 2024-09-14T11:40:10.139 INFO:tasks.workunit.client.0.smithi138.stderr: -204> 2024-09-14T11:40:09.528+0000 7f7a769219c0 5 AuthRegistry(0x55f41a58fcb0) adding con mode: secure 2024-09-14T11:40:10.139 INFO:tasks.workunit.client.0.smithi138.stderr: -203> 2024-09-14T11:40:09.528+0000 7f7a769219c0 5 AuthRegistry(0x55f41a58fcb0) adding con mode: crc 2024-09-14T11:40:10.139 INFO:tasks.workunit.client.0.smithi138.stderr: -202> 2024-09-14T11:40:09.528+0000 7f7a769219c0 5 AuthRegistry(0x55f41a58fcb0) adding con mode: crc 2024-09-14T11:40:10.140 INFO:tasks.workunit.client.0.smithi138.stderr: -201> 2024-09-14T11:40:09.528+0000 7f7a769219c0 5 AuthRegistry(0x55f41a58fcb0) adding con mode: secure 2024-09-14T11:40:10.140 INFO:tasks.workunit.client.0.smithi138.stderr: -200> 2024-09-14T11:40:09.528+0000 7f7a769219c0 5 AuthRegistry(0x55f41a58fcb0) adding con mode: crc 2024-09-14T11:40:10.140 INFO:tasks.workunit.client.0.smithi138.stderr: -199> 2024-09-14T11:40:09.528+0000 7f7a769219c0 5 AuthRegistry(0x55f41a58fcb0) adding con mode: secure 2024-09-14T11:40:10.140 INFO:tasks.workunit.client.0.smithi138.stderr: -198> 2024-09-14T11:40:09.528+0000 7f7a769219c0 5 AuthRegistry(0x55f41a58fcb0) adding con mode: crc 2024-09-14T11:40:10.140 INFO:tasks.workunit.client.0.smithi138.stderr: -197> 2024-09-14T11:40:09.528+0000 7f7a769219c0 5 AuthRegistry(0x55f41a58fcb0) adding con mode: secure 2024-09-14T11:40:10.140 INFO:tasks.workunit.client.0.smithi138.stderr: -196> 2024-09-14T11:40:09.528+0000 7f7a769219c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:40:10.140 INFO:tasks.workunit.client.0.smithi138.stderr: -195> 2024-09-14T11:40:09.528+0000 7f7a769219c0 1 librados: starting msgr at 2024-09-14T11:40:10.140 INFO:tasks.workunit.client.0.smithi138.stderr: -194> 2024-09-14T11:40:09.528+0000 7f7a769219c0 1 librados: starting objecter 2024-09-14T11:40:10.140 INFO:tasks.workunit.client.0.smithi138.stderr: -193> 2024-09-14T11:40:09.528+0000 7f7a769219c0 5 asok(0x55f41a2bfd90) register_command objecter_requests cmddesc objecter_requests hook 0x55f41a590930 EEXIST 2024-09-14T11:40:10.140 INFO:tasks.workunit.client.0.smithi138.stderr: -192> 2024-09-14T11:40:09.528+0000 7f7a769219c0 1 librados: setting wanted keys 2024-09-14T11:40:10.140 INFO:tasks.workunit.client.0.smithi138.stderr: -191> 2024-09-14T11:40:09.528+0000 7f7a769219c0 1 librados: calling monclient init 2024-09-14T11:40:10.140 INFO:tasks.workunit.client.0.smithi138.stderr: -190> 2024-09-14T11:40:09.528+0000 7f7a769219c0 10 monclient: init 2024-09-14T11:40:10.140 INFO:tasks.workunit.client.0.smithi138.stderr: -189> 2024-09-14T11:40:09.528+0000 7f7a769219c0 5 AuthRegistry(0x55f41a54b840) adding auth protocol: cephx 2024-09-14T11:40:10.140 INFO:tasks.workunit.client.0.smithi138.stderr: -188> 2024-09-14T11:40:09.528+0000 7f7a769219c0 5 AuthRegistry(0x55f41a54b840) adding auth protocol: cephx 2024-09-14T11:40:10.140 INFO:tasks.workunit.client.0.smithi138.stderr: -187> 2024-09-14T11:40:09.528+0000 7f7a769219c0 5 AuthRegistry(0x55f41a54b840) adding auth protocol: cephx 2024-09-14T11:40:10.141 INFO:tasks.workunit.client.0.smithi138.stderr: -186> 2024-09-14T11:40:09.528+0000 7f7a769219c0 5 AuthRegistry(0x55f41a54b840) adding con mode: secure 2024-09-14T11:40:10.141 INFO:tasks.workunit.client.0.smithi138.stderr: -185> 2024-09-14T11:40:09.528+0000 7f7a769219c0 5 AuthRegistry(0x55f41a54b840) adding con mode: crc 2024-09-14T11:40:10.141 INFO:tasks.workunit.client.0.smithi138.stderr: -184> 2024-09-14T11:40:09.528+0000 7f7a769219c0 5 AuthRegistry(0x55f41a54b840) adding con mode: secure 2024-09-14T11:40:10.141 INFO:tasks.workunit.client.0.smithi138.stderr: -183> 2024-09-14T11:40:09.528+0000 7f7a769219c0 5 AuthRegistry(0x55f41a54b840) adding con mode: crc 2024-09-14T11:40:10.141 INFO:tasks.workunit.client.0.smithi138.stderr: -182> 2024-09-14T11:40:09.528+0000 7f7a769219c0 5 AuthRegistry(0x55f41a54b840) adding con mode: secure 2024-09-14T11:40:10.141 INFO:tasks.workunit.client.0.smithi138.stderr: -181> 2024-09-14T11:40:09.528+0000 7f7a769219c0 5 AuthRegistry(0x55f41a54b840) adding con mode: crc 2024-09-14T11:40:10.141 INFO:tasks.workunit.client.0.smithi138.stderr: -180> 2024-09-14T11:40:09.528+0000 7f7a769219c0 5 AuthRegistry(0x55f41a54b840) adding con mode: crc 2024-09-14T11:40:10.141 INFO:tasks.workunit.client.0.smithi138.stderr: -179> 2024-09-14T11:40:09.528+0000 7f7a769219c0 5 AuthRegistry(0x55f41a54b840) adding con mode: secure 2024-09-14T11:40:10.141 INFO:tasks.workunit.client.0.smithi138.stderr: -178> 2024-09-14T11:40:09.528+0000 7f7a769219c0 5 AuthRegistry(0x55f41a54b840) adding con mode: crc 2024-09-14T11:40:10.141 INFO:tasks.workunit.client.0.smithi138.stderr: -177> 2024-09-14T11:40:09.528+0000 7f7a769219c0 5 AuthRegistry(0x55f41a54b840) adding con mode: secure 2024-09-14T11:40:10.141 INFO:tasks.workunit.client.0.smithi138.stderr: -176> 2024-09-14T11:40:09.528+0000 7f7a769219c0 5 AuthRegistry(0x55f41a54b840) adding con mode: crc 2024-09-14T11:40:10.141 INFO:tasks.workunit.client.0.smithi138.stderr: -175> 2024-09-14T11:40:09.528+0000 7f7a769219c0 5 AuthRegistry(0x55f41a54b840) adding con mode: secure 2024-09-14T11:40:10.141 INFO:tasks.workunit.client.0.smithi138.stderr: -174> 2024-09-14T11:40:09.528+0000 7f7a769219c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:40:10.141 INFO:tasks.workunit.client.0.smithi138.stderr: -173> 2024-09-14T11:40:09.528+0000 7f7a769219c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:40:10.141 INFO:tasks.workunit.client.0.smithi138.stderr: -172> 2024-09-14T11:40:09.528+0000 7f7a769219c0 5 asok(0x55f41a2bfd90) register_command rotate-key cmddesc rotate-key hook 0x55f41a54b988 EEXIST 2024-09-14T11:40:10.142 INFO:tasks.workunit.client.0.smithi138.stderr: -171> 2024-09-14T11:40:09.528+0000 7f7a769219c0 10 monclient: _reopen_session rank -1 2024-09-14T11:40:10.142 INFO:tasks.workunit.client.0.smithi138.stderr: -170> 2024-09-14T11:40:09.528+0000 7f7a769219c0 10 monclient: _add_conns ranks=[1,0,2] 2024-09-14T11:40:10.142 INFO:tasks.workunit.client.0.smithi138.stderr: -169> 2024-09-14T11:40:09.528+0000 7f7a769219c0 10 monclient(hunting): picked mon.noname-b con 0x55f41a598cc0 addr [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] 2024-09-14T11:40:10.142 INFO:tasks.workunit.client.0.smithi138.stderr: -168> 2024-09-14T11:40:09.528+0000 7f7a769219c0 10 monclient(hunting): picked mon.noname-a con 0x55f41a599640 addr [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] 2024-09-14T11:40:10.142 INFO:tasks.workunit.client.0.smithi138.stderr: -167> 2024-09-14T11:40:09.528+0000 7f7a769219c0 10 monclient(hunting): picked mon.noname-c con 0x55f41a59d8d0 addr [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] 2024-09-14T11:40:10.142 INFO:tasks.workunit.client.0.smithi138.stderr: -166> 2024-09-14T11:40:09.528+0000 7f7a769219c0 10 monclient(hunting): start opening mon connection 2024-09-14T11:40:10.142 INFO:tasks.workunit.client.0.smithi138.stderr: -165> 2024-09-14T11:40:09.528+0000 7f7a769219c0 10 monclient(hunting): start opening mon connection 2024-09-14T11:40:10.142 INFO:tasks.workunit.client.0.smithi138.stderr: -164> 2024-09-14T11:40:09.528+0000 7f7a769219c0 10 monclient(hunting): start opening mon connection 2024-09-14T11:40:10.142 INFO:tasks.workunit.client.0.smithi138.stderr: -163> 2024-09-14T11:40:09.528+0000 7f7a769219c0 10 monclient(hunting): _renew_subs 2024-09-14T11:40:10.142 INFO:tasks.workunit.client.0.smithi138.stderr: -162> 2024-09-14T11:40:09.528+0000 7f7a769219c0 10 monclient(hunting): authenticate will time out at 2945.491639s 2024-09-14T11:40:10.142 INFO:tasks.workunit.client.0.smithi138.stderr: -161> 2024-09-14T11:40:09.528+0000 7f7a74c28640 10 monclient(hunting): get_auth_request con 0x55f41a599640 auth_method 0 2024-09-14T11:40:10.142 INFO:tasks.workunit.client.0.smithi138.stderr: -160> 2024-09-14T11:40:09.528+0000 7f7a74c28640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:40:10.142 INFO:tasks.workunit.client.0.smithi138.stderr: -159> 2024-09-14T11:40:09.528+0000 7f7a74c28640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:40:10.142 INFO:tasks.workunit.client.0.smithi138.stderr: -158> 2024-09-14T11:40:09.528+0000 7f7a74c28640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:40:10.142 INFO:tasks.workunit.client.0.smithi138.stderr: -157> 2024-09-14T11:40:09.528+0000 7f7a74427640 10 monclient(hunting): get_auth_request con 0x55f41a59d8d0 auth_method 0 2024-09-14T11:40:10.143 INFO:tasks.workunit.client.0.smithi138.stderr: -156> 2024-09-14T11:40:09.528+0000 7f7a74427640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:40:10.143 INFO:tasks.workunit.client.0.smithi138.stderr: -155> 2024-09-14T11:40:09.528+0000 7f7a74427640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:40:10.143 INFO:tasks.workunit.client.0.smithi138.stderr: -154> 2024-09-14T11:40:09.528+0000 7f7a74427640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:40:10.143 INFO:tasks.workunit.client.0.smithi138.stderr: -153> 2024-09-14T11:40:09.528+0000 7f7a74c28640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:40:10.143 INFO:tasks.workunit.client.0.smithi138.stderr: -152> 2024-09-14T11:40:09.528+0000 7f7a74c28640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:40:10.143 INFO:tasks.workunit.client.0.smithi138.stderr: -151> 2024-09-14T11:40:09.528+0000 7f7a74c28640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:40:10.143 INFO:tasks.workunit.client.0.smithi138.stderr: -150> 2024-09-14T11:40:09.528+0000 7f7a74427640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:40:10.143 INFO:tasks.workunit.client.0.smithi138.stderr: -149> 2024-09-14T11:40:09.528+0000 7f7a74427640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:40:10.143 INFO:tasks.workunit.client.0.smithi138.stderr: -148> 2024-09-14T11:40:09.528+0000 7f7a74427640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:40:10.143 INFO:tasks.workunit.client.0.smithi138.stderr: -147> 2024-09-14T11:40:09.532+0000 7f7a73c26640 10 monclient(hunting): get_auth_request con 0x55f41a598cc0 auth_method 0 2024-09-14T11:40:10.143 INFO:tasks.workunit.client.0.smithi138.stderr: -146> 2024-09-14T11:40:09.532+0000 7f7a73c26640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:40:10.143 INFO:tasks.workunit.client.0.smithi138.stderr: -145> 2024-09-14T11:40:09.532+0000 7f7a73c26640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:40:10.143 INFO:tasks.workunit.client.0.smithi138.stderr: -144> 2024-09-14T11:40:09.532+0000 7f7a73c26640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:40:10.143 INFO:tasks.workunit.client.0.smithi138.stderr: -143> 2024-09-14T11:40:09.532+0000 7f7a74c28640 10 monclient(hunting): handle_auth_done global_id 8148 payload 824 2024-09-14T11:40:10.143 INFO:tasks.workunit.client.0.smithi138.stderr: -142> 2024-09-14T11:40:09.532+0000 7f7a74c28640 10 monclient: _finish_hunting 0 2024-09-14T11:40:10.144 INFO:tasks.workunit.client.0.smithi138.stderr: -141> 2024-09-14T11:40:09.532+0000 7f7a74c28640 1 monclient: found mon.noname-a 2024-09-14T11:40:10.144 INFO:tasks.workunit.client.0.smithi138.stderr: -140> 2024-09-14T11:40:09.532+0000 7f7a74c28640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.138:3300/0 2024-09-14T11:40:10.144 INFO:tasks.workunit.client.0.smithi138.stderr: -139> 2024-09-14T11:40:09.532+0000 7f7949ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:40:10.144 INFO:tasks.workunit.client.0.smithi138.stderr: -138> 2024-09-14T11:40:09.532+0000 7f7949ffb640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-14T11:40:10.144 INFO:tasks.workunit.client.0.smithi138.stderr: -137> 2024-09-14T11:40:09.532+0000 7f7949ffb640 10 monclient: dump: 2024-09-14T11:40:10.144 INFO:tasks.workunit.client.0.smithi138.stderr:epoch 1 2024-09-14T11:40:10.144 INFO:tasks.workunit.client.0.smithi138.stderr:fsid 3f225f43-83a6-4aeb-b798-1f04bb49d597 2024-09-14T11:40:10.144 INFO:tasks.workunit.client.0.smithi138.stderr:last_changed 2024-09-14T11:07:09.252780+0000 2024-09-14T11:40:10.144 INFO:tasks.workunit.client.0.smithi138.stderr:created 2024-09-14T11:07:09.252780+0000 2024-09-14T11:40:10.144 INFO:tasks.workunit.client.0.smithi138.stderr:min_mon_release 19 (squid) 2024-09-14T11:40:10.144 INFO:tasks.workunit.client.0.smithi138.stderr:election_strategy: 1 2024-09-14T11:40:10.144 INFO:tasks.workunit.client.0.smithi138.stderr:0: [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] mon.a 2024-09-14T11:40:10.144 INFO:tasks.workunit.client.0.smithi138.stderr:1: [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] mon.b 2024-09-14T11:40:10.144 INFO:tasks.workunit.client.0.smithi138.stderr:2: [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] mon.c 2024-09-14T11:40:10.144 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-14T11:40:10.144 INFO:tasks.workunit.client.0.smithi138.stderr: -136> 2024-09-14T11:40:09.532+0000 7f7949ffb640 10 monclient: _finish_auth 0 2024-09-14T11:40:10.145 INFO:tasks.workunit.client.0.smithi138.stderr: -135> 2024-09-14T11:40:09.532+0000 7f7949ffb640 10 monclient: _check_auth_tickets 2024-09-14T11:40:10.145 INFO:tasks.workunit.client.0.smithi138.stderr: -134> 2024-09-14T11:40:09.532+0000 7f7949ffb640 10 monclient: handle_config config(0 keys) 2024-09-14T11:40:10.145 INFO:tasks.workunit.client.0.smithi138.stderr: -133> 2024-09-14T11:40:09.532+0000 7f7949ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:40:10.145 INFO:tasks.workunit.client.0.smithi138.stderr: -132> 2024-09-14T11:40:09.532+0000 7f7949ffb640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-14T11:40:10.145 INFO:tasks.workunit.client.0.smithi138.stderr: -131> 2024-09-14T11:40:09.532+0000 7f7949ffb640 10 monclient: dump: 2024-09-14T11:40:10.145 INFO:tasks.workunit.client.0.smithi138.stderr:epoch 1 2024-09-14T11:40:10.145 INFO:tasks.workunit.client.0.smithi138.stderr:fsid 3f225f43-83a6-4aeb-b798-1f04bb49d597 2024-09-14T11:40:10.145 INFO:tasks.workunit.client.0.smithi138.stderr:last_changed 2024-09-14T11:07:09.252780+0000 2024-09-14T11:40:10.145 INFO:tasks.workunit.client.0.smithi138.stderr:created 2024-09-14T11:07:09.252780+0000 2024-09-14T11:40:10.145 INFO:tasks.workunit.client.0.smithi138.stderr:min_mon_release 19 (squid) 2024-09-14T11:40:10.145 INFO:tasks.workunit.client.0.smithi138.stderr:election_strategy: 1 2024-09-14T11:40:10.145 INFO:tasks.workunit.client.0.smithi138.stderr:0: [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] mon.a 2024-09-14T11:40:10.145 INFO:tasks.workunit.client.0.smithi138.stderr:1: [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] mon.b 2024-09-14T11:40:10.145 INFO:tasks.workunit.client.0.smithi138.stderr:2: [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] mon.c 2024-09-14T11:40:10.145 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-14T11:40:10.146 INFO:tasks.workunit.client.0.smithi138.stderr: -130> 2024-09-14T11:40:09.532+0000 7f794b7fe640 4 set_mon_vals no callback set 2024-09-14T11:40:10.146 INFO:tasks.workunit.client.0.smithi138.stderr: -129> 2024-09-14T11:40:09.532+0000 7f7a769219c0 5 monclient: authenticate success, global_id 8148 2024-09-14T11:40:10.146 INFO:tasks.workunit.client.0.smithi138.stderr: -128> 2024-09-14T11:40:09.532+0000 7f7a769219c0 10 monclient: _renew_subs 2024-09-14T11:40:10.146 INFO:tasks.workunit.client.0.smithi138.stderr: -127> 2024-09-14T11:40:09.532+0000 7f7a769219c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.138:3300/0 2024-09-14T11:40:10.146 INFO:tasks.workunit.client.0.smithi138.stderr: -126> 2024-09-14T11:40:09.532+0000 7f7a769219c0 10 monclient: _renew_subs 2024-09-14T11:40:10.146 INFO:tasks.workunit.client.0.smithi138.stderr: -125> 2024-09-14T11:40:09.532+0000 7f7a769219c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.138:3300/0 2024-09-14T11:40:10.146 INFO:tasks.workunit.client.0.smithi138.stderr: -124> 2024-09-14T11:40:09.532+0000 7f7a769219c0 1 librados: init done 2024-09-14T11:40:10.146 INFO:tasks.workunit.client.0.smithi138.stderr: -123> 2024-09-14T11:40:09.532+0000 7f7a769219c0 5 asok(0x55f41a2bfd90) register_command cr dump hook 0x55f41a5980e8 2024-09-14T11:40:10.146 INFO:tasks.workunit.client.0.smithi138.stderr: -122> 2024-09-14T11:40:09.532+0000 7f7a769219c0 20 rados->read ofs=0 len=0 2024-09-14T11:40:10.146 INFO:tasks.workunit.client.0.smithi138.stderr: -121> 2024-09-14T11:40:09.532+0000 7f7949ffb640 4 mgrc handle_mgr_map Got map version 5 2024-09-14T11:40:10.146 INFO:tasks.workunit.client.0.smithi138.stderr: -120> 2024-09-14T11:40:09.532+0000 7f7949ffb640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.138:6832/3778043143,v1:172.21.15.138:6833/3778043143] 2024-09-14T11:40:10.146 INFO:tasks.workunit.client.0.smithi138.stderr: -119> 2024-09-14T11:40:09.532+0000 7f7949ffb640 4 mgrc reconnect Starting new session with [v2:172.21.15.138:6832/3778043143,v1:172.21.15.138:6833/3778043143] 2024-09-14T11:40:10.146 INFO:tasks.workunit.client.0.smithi138.stderr: -118> 2024-09-14T11:40:09.532+0000 7f7a73c26640 10 monclient: get_auth_request con 0x7f793c0718d0 auth_method 0 2024-09-14T11:40:10.146 INFO:tasks.workunit.client.0.smithi138.stderr: -117> 2024-09-14T11:40:09.532+0000 7f7a74427640 10 monclient: get_auth_request con 0x55f41a5b6fe0 auth_method 0 2024-09-14T11:40:10.146 INFO:tasks.workunit.client.0.smithi138.stderr: -116> 2024-09-14T11:40:09.536+0000 7f7a769219c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:40:10.146 INFO:tasks.workunit.client.0.smithi138.stderr: -115> 2024-09-14T11:40:09.536+0000 7f7a769219c0 20 realm 2024-09-14T11:40:10.147 INFO:tasks.workunit.client.0.smithi138.stderr: -114> 2024-09-14T11:40:09.536+0000 7f7a769219c0 20 rados->read ofs=0 len=0 2024-09-14T11:40:10.147 INFO:tasks.workunit.client.0.smithi138.stderr: -113> 2024-09-14T11:40:09.536+0000 7f7a769219c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:40:10.147 INFO:tasks.workunit.client.0.smithi138.stderr: -112> 2024-09-14T11:40:09.536+0000 7f7a769219c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:40:10.147 INFO:tasks.workunit.client.0.smithi138.stderr: -111> 2024-09-14T11:40:09.536+0000 7f7a769219c0 20 rados->read ofs=0 len=0 2024-09-14T11:40:10.147 INFO:tasks.workunit.client.0.smithi138.stderr: -110> 2024-09-14T11:40:09.536+0000 7f7a769219c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:40:10.147 INFO:tasks.workunit.client.0.smithi138.stderr: -109> 2024-09-14T11:40:09.536+0000 7f7a769219c0 20 rados->read ofs=0 len=0 2024-09-14T11:40:10.147 INFO:tasks.workunit.client.0.smithi138.stderr: -108> 2024-09-14T11:40:09.536+0000 7f7a73c26640 10 monclient: get_auth_request con 0x55f41a5bb0b0 auth_method 0 2024-09-14T11:40:10.147 INFO:tasks.workunit.client.0.smithi138.stderr: -107> 2024-09-14T11:40:09.536+0000 7f7a769219c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:40:10.147 INFO:tasks.workunit.client.0.smithi138.stderr: -106> 2024-09-14T11:40:09.536+0000 7f7a769219c0 20 rados->read ofs=0 len=0 2024-09-14T11:40:10.147 INFO:tasks.workunit.client.0.smithi138.stderr: -105> 2024-09-14T11:40:09.536+0000 7f7a74c28640 10 monclient: get_auth_request con 0x55f41a5be8f0 auth_method 0 2024-09-14T11:40:10.147 INFO:tasks.workunit.client.0.smithi138.stderr: -104> 2024-09-14T11:40:09.536+0000 7f7a769219c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:40:10.147 INFO:tasks.workunit.client.0.smithi138.stderr: -103> 2024-09-14T11:40:09.536+0000 7f7a769219c0 20 searching for the correct realm 2024-09-14T11:40:10.147 INFO:tasks.workunit.client.0.smithi138.stderr: -102> 2024-09-14T11:40:09.536+0000 7f7a74427640 10 monclient: get_auth_request con 0x55f41a5c3670 auth_method 0 2024-09-14T11:40:10.148 INFO:tasks.workunit.client.0.smithi138.stderr: -101> 2024-09-14T11:40:09.540+0000 7f7a73c26640 10 monclient: get_auth_request con 0x7f7a6403d360 auth_method 0 2024-09-14T11:40:10.148 INFO:tasks.workunit.client.0.smithi138.stderr: -100> 2024-09-14T11:40:09.540+0000 7f7a74c28640 0 -- 172.21.15.138:0/2740999781 >> [v2:172.21.15.154:6824/416768175,v1:172.21.15.154:6825/416768175] conn(0x7f7a6c044060 msgr2=0x7f7a6c086270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:40:10.148 INFO:tasks.workunit.client.0.smithi138.stderr: -99> 2024-09-14T11:40:09.540+0000 7f7a74c28640 10 monclient: get_auth_request con 0x7f7a6c044060 auth_method 0 2024-09-14T11:40:10.148 INFO:tasks.workunit.client.0.smithi138.stderr: -98> 2024-09-14T11:40:09.744+0000 7f7a74c28640 10 monclient: get_auth_request con 0x7f7a6c044060 auth_method 0 2024-09-14T11:40:10.148 INFO:tasks.workunit.client.0.smithi138.stderr: -97> 2024-09-14T11:40:09.748+0000 7f7a74427640 10 monclient: get_auth_request con 0x7f7a6c019040 auth_method 0 2024-09-14T11:40:10.148 INFO:tasks.workunit.client.0.smithi138.stderr: -96> 2024-09-14T11:40:09.756+0000 7f7a73c26640 10 monclient: get_auth_request con 0x7f7a6c09b090 auth_method 0 2024-09-14T11:40:10.148 INFO:tasks.workunit.client.0.smithi138.stderr: -95> 2024-09-14T11:40:09.756+0000 7f7a73c26640 0 -- 172.21.15.138:0/2740999781 >> [v2:172.21.15.138:6816/326481658,v1:172.21.15.138:6817/326481658] conn(0x7f7a6c09b090 msgr2=0x7f7a6c0274f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:40:10.148 INFO:tasks.workunit.client.0.smithi138.stderr: -94> 2024-09-14T11:40:09.960+0000 7f7a73c26640 10 monclient: get_auth_request con 0x7f7a6c09b090 auth_method 0 2024-09-14T11:40:10.148 INFO:tasks.workunit.client.0.smithi138.stderr: -93> 2024-09-14T11:40:09.972+0000 7f7a769219c0 20 RGWRados::pool_iterate: got zone_info.d9e72d30-c60b-4d0d-9267-fdc36392d5ad 2024-09-14T11:40:10.148 INFO:tasks.workunit.client.0.smithi138.stderr: -92> 2024-09-14T11:40:09.972+0000 7f7a769219c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:40:10.148 INFO:tasks.workunit.client.0.smithi138.stderr: -91> 2024-09-14T11:40:09.972+0000 7f7a769219c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:40:10.148 INFO:tasks.workunit.client.0.smithi138.stderr: -90> 2024-09-14T11:40:09.972+0000 7f7a769219c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:40:10.148 INFO:tasks.workunit.client.0.smithi138.stderr: -89> 2024-09-14T11:40:09.972+0000 7f7a769219c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:40:10.148 INFO:tasks.workunit.client.0.smithi138.stderr: -88> 2024-09-14T11:40:09.972+0000 7f7a769219c0 20 RGWRados::pool_iterate: got zonegroup_info.65ab941b-da8c-4160-94fb-3672b069d44f 2024-09-14T11:40:10.148 INFO:tasks.workunit.client.0.smithi138.stderr: -87> 2024-09-14T11:40:09.972+0000 7f7a769219c0 20 rados->read ofs=0 len=0 2024-09-14T11:40:10.149 INFO:tasks.workunit.client.0.smithi138.stderr: -86> 2024-09-14T11:40:09.976+0000 7f7a769219c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:40:10.149 INFO:tasks.workunit.client.0.smithi138.stderr: -85> 2024-09-14T11:40:09.976+0000 7f7a769219c0 20 rados->read ofs=0 len=0 2024-09-14T11:40:10.149 INFO:tasks.workunit.client.0.smithi138.stderr: -84> 2024-09-14T11:40:09.976+0000 7f7a769219c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:40:10.149 INFO:tasks.workunit.client.0.smithi138.stderr: -83> 2024-09-14T11:40:09.976+0000 7f7a769219c0 20 rados->read ofs=0 len=0 2024-09-14T11:40:10.149 INFO:tasks.workunit.client.0.smithi138.stderr: -82> 2024-09-14T11:40:09.976+0000 7f7a769219c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:40:10.149 INFO:tasks.workunit.client.0.smithi138.stderr: -81> 2024-09-14T11:40:09.976+0000 7f7a769219c0 20 zone default found 2024-09-14T11:40:10.149 INFO:tasks.workunit.client.0.smithi138.stderr: -80> 2024-09-14T11:40:09.976+0000 7f7a769219c0 4 Realm: () 2024-09-14T11:40:10.149 INFO:tasks.workunit.client.0.smithi138.stderr: -79> 2024-09-14T11:40:09.976+0000 7f7a769219c0 4 ZoneGroup: default (65ab941b-da8c-4160-94fb-3672b069d44f) 2024-09-14T11:40:10.149 INFO:tasks.workunit.client.0.smithi138.stderr: -78> 2024-09-14T11:40:09.976+0000 7f7a769219c0 4 Zone: default (d9e72d30-c60b-4d0d-9267-fdc36392d5ad) 2024-09-14T11:40:10.149 INFO:tasks.workunit.client.0.smithi138.stderr: -77> 2024-09-14T11:40:09.976+0000 7f7a769219c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:40:10.149 INFO:tasks.workunit.client.0.smithi138.stderr: -76> 2024-09-14T11:40:09.976+0000 7f7a769219c0 20 zonegroup default 2024-09-14T11:40:10.149 INFO:tasks.workunit.client.0.smithi138.stderr: -75> 2024-09-14T11:40:09.976+0000 7f7a769219c0 20 rados->read ofs=0 len=0 2024-09-14T11:40:10.149 INFO:tasks.workunit.client.0.smithi138.stderr: -74> 2024-09-14T11:40:09.976+0000 7f7a769219c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:40:10.149 INFO:tasks.workunit.client.0.smithi138.stderr: -73> 2024-09-14T11:40:09.976+0000 7f7a769219c0 20 rados->read ofs=0 len=0 2024-09-14T11:40:10.149 INFO:tasks.workunit.client.0.smithi138.stderr: -72> 2024-09-14T11:40:09.980+0000 7f7a769219c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:40:10.150 INFO:tasks.workunit.client.0.smithi138.stderr: -71> 2024-09-14T11:40:09.980+0000 7f7a769219c0 20 rados->read ofs=0 len=0 2024-09-14T11:40:10.150 INFO:tasks.workunit.client.0.smithi138.stderr: -70> 2024-09-14T11:40:09.980+0000 7f7a769219c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:40:10.150 INFO:tasks.workunit.client.0.smithi138.stderr: -69> 2024-09-14T11:40:09.980+0000 7f7a769219c0 20 started sync module instance, tier type = 2024-09-14T11:40:10.150 INFO:tasks.workunit.client.0.smithi138.stderr: -68> 2024-09-14T11:40:09.980+0000 7f7a769219c0 20 started zone id=d9e72d30-c60b-4d0d-9267-fdc36392d5ad (name=default) with tier type = 2024-09-14T11:40:10.150 INFO:tasks.workunit.client.0.smithi138.stderr: -67> 2024-09-14T11:40:10.000+0000 7f7a769219c0 20 add_watcher() i=0 2024-09-14T11:40:10.150 INFO:tasks.workunit.client.0.smithi138.stderr: -66> 2024-09-14T11:40:10.000+0000 7f7a769219c0 20 add_watcher() i=1 2024-09-14T11:40:10.150 INFO:tasks.workunit.client.0.smithi138.stderr: -65> 2024-09-14T11:40:10.004+0000 7f7a769219c0 20 add_watcher() i=2 2024-09-14T11:40:10.150 INFO:tasks.workunit.client.0.smithi138.stderr: -64> 2024-09-14T11:40:10.004+0000 7f7a769219c0 20 add_watcher() i=3 2024-09-14T11:40:10.150 INFO:tasks.workunit.client.0.smithi138.stderr: -63> 2024-09-14T11:40:10.004+0000 7f7a769219c0 20 add_watcher() i=4 2024-09-14T11:40:10.150 INFO:tasks.workunit.client.0.smithi138.stderr: -62> 2024-09-14T11:40:10.004+0000 7f7a769219c0 20 add_watcher() i=5 2024-09-14T11:40:10.150 INFO:tasks.workunit.client.0.smithi138.stderr: -61> 2024-09-14T11:40:10.004+0000 7f7a769219c0 20 add_watcher() i=6 2024-09-14T11:40:10.150 INFO:tasks.workunit.client.0.smithi138.stderr: -60> 2024-09-14T11:40:10.004+0000 7f7a769219c0 20 add_watcher() i=7 2024-09-14T11:40:10.150 INFO:tasks.workunit.client.0.smithi138.stderr: -59> 2024-09-14T11:40:10.004+0000 7f7a769219c0 2 all 8 watchers are set, enabling cache 2024-09-14T11:40:10.150 INFO:tasks.workunit.client.0.smithi138.stderr: -58> 2024-09-14T11:40:10.008+0000 7f7a769219c0 5 AuthRegistry(0x7ffece940d60) adding auth protocol: cephx 2024-09-14T11:40:10.151 INFO:tasks.workunit.client.0.smithi138.stderr: -57> 2024-09-14T11:40:10.008+0000 7f7a769219c0 5 AuthRegistry(0x7ffece940d60) adding auth protocol: cephx 2024-09-14T11:40:10.151 INFO:tasks.workunit.client.0.smithi138.stderr: -56> 2024-09-14T11:40:10.008+0000 7f7a769219c0 5 AuthRegistry(0x7ffece940d60) adding auth protocol: cephx 2024-09-14T11:40:10.151 INFO:tasks.workunit.client.0.smithi138.stderr: -55> 2024-09-14T11:40:10.008+0000 7f7a769219c0 5 AuthRegistry(0x7ffece940d60) adding con mode: secure 2024-09-14T11:40:10.151 INFO:tasks.workunit.client.0.smithi138.stderr: -54> 2024-09-14T11:40:10.008+0000 7f7a769219c0 5 AuthRegistry(0x7ffece940d60) adding con mode: crc 2024-09-14T11:40:10.151 INFO:tasks.workunit.client.0.smithi138.stderr: -53> 2024-09-14T11:40:10.008+0000 7f7a769219c0 5 AuthRegistry(0x7ffece940d60) adding con mode: secure 2024-09-14T11:40:10.151 INFO:tasks.workunit.client.0.smithi138.stderr: -52> 2024-09-14T11:40:10.008+0000 7f792afdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:40:10.151 INFO:tasks.workunit.client.0.smithi138.stderr: -51> 2024-09-14T11:40:10.008+0000 7f7a769219c0 5 AuthRegistry(0x7ffece940d60) adding con mode: crc 2024-09-14T11:40:10.151 INFO:tasks.workunit.client.0.smithi138.stderr: -50> 2024-09-14T11:40:10.008+0000 7f7a769219c0 5 AuthRegistry(0x7ffece940d60) adding con mode: secure 2024-09-14T11:40:10.151 INFO:tasks.workunit.client.0.smithi138.stderr: -49> 2024-09-14T11:40:10.008+0000 7f7a769219c0 5 AuthRegistry(0x7ffece940d60) adding con mode: crc 2024-09-14T11:40:10.151 INFO:tasks.workunit.client.0.smithi138.stderr: -48> 2024-09-14T11:40:10.008+0000 7f7a769219c0 5 AuthRegistry(0x7ffece940d60) adding con mode: crc 2024-09-14T11:40:10.151 INFO:tasks.workunit.client.0.smithi138.stderr: -47> 2024-09-14T11:40:10.008+0000 7f7a769219c0 5 AuthRegistry(0x7ffece940d60) adding con mode: secure 2024-09-14T11:40:10.151 INFO:tasks.workunit.client.0.smithi138.stderr: -46> 2024-09-14T11:40:10.008+0000 7f7a769219c0 5 AuthRegistry(0x7ffece940d60) adding con mode: crc 2024-09-14T11:40:10.151 INFO:tasks.workunit.client.0.smithi138.stderr: -45> 2024-09-14T11:40:10.008+0000 7f7a769219c0 5 AuthRegistry(0x7ffece940d60) adding con mode: secure 2024-09-14T11:40:10.151 INFO:tasks.workunit.client.0.smithi138.stderr: -44> 2024-09-14T11:40:10.008+0000 7f7a769219c0 5 AuthRegistry(0x7ffece940d60) adding con mode: crc 2024-09-14T11:40:10.151 INFO:tasks.workunit.client.0.smithi138.stderr: -43> 2024-09-14T11:40:10.008+0000 7f7a769219c0 5 AuthRegistry(0x7ffece940d60) adding con mode: secure 2024-09-14T11:40:10.151 INFO:tasks.workunit.client.0.smithi138.stderr: -42> 2024-09-14T11:40:10.008+0000 7f7a769219c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:40:10.152 INFO:tasks.workunit.client.0.smithi138.stderr: -41> 2024-09-14T11:40:10.008+0000 7f7a769219c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:40:10.152 INFO:tasks.workunit.client.0.smithi138.stderr: -40> 2024-09-14T11:40:10.008+0000 7f7a769219c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:40:10.152 INFO:tasks.workunit.client.0.smithi138.stderr: -39> 2024-09-14T11:40:10.008+0000 7f7a769219c0 5 asok(0x55f41a2bfd90) register_command cache list hook 0x55f41a599110 2024-09-14T11:40:10.152 INFO:tasks.workunit.client.0.smithi138.stderr: -38> 2024-09-14T11:40:10.008+0000 7f7a769219c0 5 asok(0x55f41a2bfd90) register_command cache inspect hook 0x55f41a599110 2024-09-14T11:40:10.152 INFO:tasks.workunit.client.0.smithi138.stderr: -37> 2024-09-14T11:40:10.008+0000 7f7a769219c0 5 asok(0x55f41a2bfd90) register_command cache erase hook 0x55f41a599110 2024-09-14T11:40:10.152 INFO:tasks.workunit.client.0.smithi138.stderr: -36> 2024-09-14T11:40:10.008+0000 7f7a769219c0 5 asok(0x55f41a2bfd90) register_command cache zap hook 0x55f41a599110 2024-09-14T11:40:10.152 INFO:tasks.workunit.client.0.smithi138.stderr: -35> 2024-09-14T11:40:10.008+0000 7f7a769219c0 5 note: GC not initialized 2024-09-14T11:40:10.152 INFO:tasks.workunit.client.0.smithi138.stderr: -34> 2024-09-14T11:40:10.008+0000 7f7929fdb640 20 reqs_thread_entry: start 2024-09-14T11:40:10.152 INFO:tasks.workunit.client.0.smithi138.stderr: -33> 2024-09-14T11:40:10.008+0000 7f7a769219c0 5 asok(0x55f41a2bfd90) register_command sync trace show hook 0x7f7a64005520 2024-09-14T11:40:10.152 INFO:tasks.workunit.client.0.smithi138.stderr: -32> 2024-09-14T11:40:10.008+0000 7f7a769219c0 5 asok(0x55f41a2bfd90) register_command sync trace history hook 0x7f7a64005520 2024-09-14T11:40:10.152 INFO:tasks.workunit.client.0.smithi138.stderr: -31> 2024-09-14T11:40:10.008+0000 7f7a769219c0 5 asok(0x55f41a2bfd90) register_command sync trace active hook 0x7f7a64005520 2024-09-14T11:40:10.152 INFO:tasks.workunit.client.0.smithi138.stderr: -30> 2024-09-14T11:40:10.008+0000 7f7a769219c0 5 asok(0x55f41a2bfd90) register_command sync trace active_short hook 0x7f7a64005520 2024-09-14T11:40:10.152 INFO:tasks.workunit.client.0.smithi138.stderr: -29> 2024-09-14T11:40:10.008+0000 7f7a769219c0 20 init_complete bucket index max shards: 11 2024-09-14T11:40:10.152 INFO:tasks.workunit.client.0.smithi138.stderr: -28> 2024-09-14T11:40:10.008+0000 7f7a769219c0 20 Filter name: none 2024-09-14T11:40:10.152 INFO:tasks.workunit.client.0.smithi138.stderr: -27> 2024-09-14T11:40:10.008+0000 7f789b7fe640 20 reqs_thread_entry: start 2024-09-14T11:40:10.153 INFO:tasks.workunit.client.0.smithi138.stderr: -26> 2024-09-14T11:40:10.008+0000 7f7a769219c0 10 cache get: name=default.rgw.meta+root+a-bucket : miss 2024-09-14T11:40:10.153 INFO:tasks.workunit.client.0.smithi138.stderr: -25> 2024-09-14T11:40:10.008+0000 7f7a769219c0 20 rados->read ofs=0 len=0 2024-09-14T11:40:10.153 INFO:tasks.workunit.client.0.smithi138.stderr: -24> 2024-09-14T11:40:10.008+0000 7f7a769219c0 20 rados_obj.operate() r=0 bl.length=176 2024-09-14T11:40:10.153 INFO:tasks.workunit.client.0.smithi138.stderr: -23> 2024-09-14T11:40:10.008+0000 7f7a769219c0 10 cache put: name=default.rgw.meta+root+a-bucket info.flags=0x11 2024-09-14T11:40:10.153 INFO:tasks.workunit.client.0.smithi138.stderr: -22> 2024-09-14T11:40:10.008+0000 7f7a769219c0 10 adding default.rgw.meta+root+a-bucket to cache LRU end 2024-09-14T11:40:10.153 INFO:tasks.workunit.client.0.smithi138.stderr: -21> 2024-09-14T11:40:10.008+0000 7f7a769219c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.17 : miss 2024-09-14T11:40:10.153 INFO:tasks.workunit.client.0.smithi138.stderr: -20> 2024-09-14T11:40:10.008+0000 7f7a769219c0 20 rados->read ofs=0 len=0 2024-09-14T11:40:10.153 INFO:tasks.workunit.client.0.smithi138.stderr: -19> 2024-09-14T11:40:10.012+0000 7f7a769219c0 20 rados_obj.operate() r=0 bl.length=398 2024-09-14T11:40:10.153 INFO:tasks.workunit.client.0.smithi138.stderr: -18> 2024-09-14T11:40:10.012+0000 7f7a769219c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.17 info.flags=0x17 2024-09-14T11:40:10.153 INFO:tasks.workunit.client.0.smithi138.stderr: -17> 2024-09-14T11:40:10.012+0000 7f7a769219c0 10 adding default.rgw.meta+root+.bucket.meta.a-bucket:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.17 to cache LRU end 2024-09-14T11:40:10.153 INFO:tasks.workunit.client.0.smithi138.stderr: -16> 2024-09-14T11:40:10.012+0000 7f7a769219c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:40:10.153 INFO:tasks.workunit.client.0.smithi138.stderr: -15> 2024-09-14T11:40:10.012+0000 7f7a769219c0 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-14T11:40:10.153 INFO:tasks.workunit.client.0.smithi138.stderr: -14> 2024-09-14T11:40:10.012+0000 7f7a769219c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.17 2024-09-14T11:40:10.153 INFO:tasks.workunit.client.0.smithi138.stderr: -13> 2024-09-14T11:40:10.028+0000 7f7a769219c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.17 info.flags=0x17 2024-09-14T11:40:10.154 INFO:tasks.workunit.client.0.smithi138.stderr: -12> 2024-09-14T11:40:10.028+0000 7f7a769219c0 10 moving default.rgw.meta+root+.bucket.meta.a-bucket:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.17 to cache LRU end 2024-09-14T11:40:10.154 INFO:tasks.workunit.client.0.smithi138.stderr: -11> 2024-09-14T11:40:10.028+0000 7f7a769219c0 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-14T11:40:10.154 INFO:tasks.workunit.client.0.smithi138.stderr: -10> 2024-09-14T11:40:10.028+0000 7f7a769219c0 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.a-bucket:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.17, ofs0, ns] 2024-09-14T11:40:10.154 INFO:tasks.workunit.client.0.smithi138.stderr: -9> 2024-09-14T11:40:10.028+0000 7f794affd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366241 cookie 94506902665136 notifier 8148 bl.length()=827 2024-09-14T11:40:10.154 INFO:tasks.workunit.client.0.smithi138.stderr: -8> 2024-09-14T11:40:10.028+0000 7f794affd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.17 info.flags=0x17 2024-09-14T11:40:10.154 INFO:tasks.workunit.client.0.smithi138.stderr: -7> 2024-09-14T11:40:10.028+0000 7f794affd640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.a-bucket:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.17 to cache LRU end 2024-09-14T11:40:10.154 INFO:tasks.workunit.client.0.smithi138.stderr: -6> 2024-09-14T11:40:10.028+0000 7f794affd640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=143 2024-09-14T11:40:10.154 INFO:tasks.workunit.client.0.smithi138.stderr: -5> 2024-09-14T11:40:10.028+0000 7f7a769219c0 20 handle_bi_update(): bucket=:a-bucket[d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.17]): orig_sources= new_sources= 2024-09-14T11:40:10.154 INFO:tasks.workunit.client.0.smithi138.stderr: -4> 2024-09-14T11:40:10.028+0000 7f7a769219c0 20 handle_bi_update(): bucket=:a-bucket[d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.17]): potential sources added=[] removed=[] 2024-09-14T11:40:10.154 INFO:tasks.workunit.client.0.smithi138.stderr: -3> 2024-09-14T11:40:10.028+0000 7f7a769219c0 20 handle_bi_update(): bucket=:a-bucket[d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.17]): orig_dests= new_dests= 2024-09-14T11:40:10.154 INFO:tasks.workunit.client.0.smithi138.stderr: -2> 2024-09-14T11:40:10.028+0000 7f7a769219c0 20 handle_bi_update(): bucket=:a-bucket[d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.17]): potential dests added=[] removed=[] 2024-09-14T11:40:10.154 INFO:tasks.workunit.client.0.smithi138.stderr: -1> 2024-09-14T11:40:10.040+0000 7f7a769219c0 -1 ./src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f7a769219c0 time 2024-09-14T11:40:10.042582+0000 2024-09-14T11:40:10.154 INFO:tasks.workunit.client.0.smithi138.stderr:./src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-14T11:40:10.154 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-14T11:40:10.154 INFO:tasks.workunit.client.0.smithi138.stderr: ceph version 19.3.0-4907-ga2782315 (a2782315255a3e7d5f6cdc9eb35785187ff6ddf8) squid (dev) 2024-09-14T11:40:10.154 INFO:tasks.workunit.client.0.smithi138.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x121) [0x7f7a7a1fb2eb] 2024-09-14T11:40:10.155 INFO:tasks.workunit.client.0.smithi138.stderr: 2: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7f7a7a1fb49f] 2024-09-14T11:40:10.155 INFO:tasks.workunit.client.0.smithi138.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55f418b18c01] 2024-09-14T11:40:10.155 INFO:tasks.workunit.client.0.smithi138.stderr: 4: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x17a) [0x55f418b2df3a] 2024-09-14T11:40:10.155 INFO:tasks.workunit.client.0.smithi138.stderr: 5: main() 2024-09-14T11:40:10.155 INFO:tasks.workunit.client.0.smithi138.stderr: 6: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7f7a79061d90] 2024-09-14T11:40:10.155 INFO:tasks.workunit.client.0.smithi138.stderr: 7: __libc_start_main() 2024-09-14T11:40:10.155 INFO:tasks.workunit.client.0.smithi138.stderr: 8: _start() 2024-09-14T11:40:10.155 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-14T11:40:10.155 INFO:tasks.workunit.client.0.smithi138.stderr: 0> 2024-09-14T11:40:10.040+0000 7f7a769219c0 -1 *** Caught signal (Aborted) ** 2024-09-14T11:40:10.155 INFO:tasks.workunit.client.0.smithi138.stderr: in thread 7f7a769219c0 thread_name:radosgw-admin 2024-09-14T11:40:10.155 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-14T11:40:10.155 INFO:tasks.workunit.client.0.smithi138.stderr: ceph version 19.3.0-4907-ga2782315 (a2782315255a3e7d5f6cdc9eb35785187ff6ddf8) squid (dev) 2024-09-14T11:40:10.155 INFO:tasks.workunit.client.0.smithi138.stderr: 1: /lib/x86_64-linux-gnu/libc.so.6(+0x42520) [0x7f7a7907a520] 2024-09-14T11:40:10.155 INFO:tasks.workunit.client.0.smithi138.stderr: 2: pthread_kill() 2024-09-14T11:40:10.155 INFO:tasks.workunit.client.0.smithi138.stderr: 3: raise() 2024-09-14T11:40:10.156 INFO:tasks.workunit.client.0.smithi138.stderr: 4: abort() 2024-09-14T11:40:10.156 INFO:tasks.workunit.client.0.smithi138.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x17b) [0x7f7a7a1fb345] 2024-09-14T11:40:10.156 INFO:tasks.workunit.client.0.smithi138.stderr: 6: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7f7a7a1fb49f] 2024-09-14T11:40:10.156 INFO:tasks.workunit.client.0.smithi138.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55f418b18c01] 2024-09-14T11:40:10.156 INFO:tasks.workunit.client.0.smithi138.stderr: 8: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x17a) [0x55f418b2df3a] 2024-09-14T11:40:10.156 INFO:tasks.workunit.client.0.smithi138.stderr: 9: main() 2024-09-14T11:40:10.156 INFO:tasks.workunit.client.0.smithi138.stderr: 10: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7f7a79061d90] 2024-09-14T11:40:10.156 INFO:tasks.workunit.client.0.smithi138.stderr: 11: __libc_start_main() 2024-09-14T11:40:10.156 INFO:tasks.workunit.client.0.smithi138.stderr: 12: _start() 2024-09-14T11:40:10.156 INFO:tasks.workunit.client.0.smithi138.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-14T11:40:10.156 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-14T11:40:10.156 INFO:tasks.workunit.client.0.smithi138.stderr:--- logging levels --- 2024-09-14T11:40:10.156 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 none 2024-09-14T11:40:10.156 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 1 lockdep 2024-09-14T11:40:10.156 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 1 context 2024-09-14T11:40:10.157 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 1 crush 2024-09-14T11:40:10.157 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 mds 2024-09-14T11:40:10.157 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 mds_balancer 2024-09-14T11:40:10.157 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 mds_locker 2024-09-14T11:40:10.157 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 mds_log 2024-09-14T11:40:10.157 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 mds_log_expire 2024-09-14T11:40:10.157 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 mds_migrator 2024-09-14T11:40:10.157 INFO:tasks.workunit.client.0.smithi138.stderr: 3/ 5 mds_quiesce 2024-09-14T11:40:10.157 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 1 buffer 2024-09-14T11:40:10.157 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 1 timer 2024-09-14T11:40:10.157 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 1 filer 2024-09-14T11:40:10.157 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 1 striper 2024-09-14T11:40:10.157 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 1 objecter 2024-09-14T11:40:10.157 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 rados 2024-09-14T11:40:10.157 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 rbd 2024-09-14T11:40:10.158 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 rbd_mirror 2024-09-14T11:40:10.158 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 rbd_replay 2024-09-14T11:40:10.158 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 rbd_pwl 2024-09-14T11:40:10.158 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 journaler 2024-09-14T11:40:10.158 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 objectcacher 2024-09-14T11:40:10.158 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 immutable_obj_cache 2024-09-14T11:40:10.158 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 client 2024-09-14T11:40:10.158 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 osd 2024-09-14T11:40:10.158 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 optracker 2024-09-14T11:40:10.158 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 objclass 2024-09-14T11:40:10.158 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 3 filestore 2024-09-14T11:40:10.158 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 3 journal 2024-09-14T11:40:10.158 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 0 ms 2024-09-14T11:40:10.158 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 mon 2024-09-14T11:40:10.158 INFO:tasks.workunit.client.0.smithi138.stderr: 0/10 monc 2024-09-14T11:40:10.159 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 paxos 2024-09-14T11:40:10.159 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 tp 2024-09-14T11:40:10.159 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 auth 2024-09-14T11:40:10.159 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 crypto 2024-09-14T11:40:10.159 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 1 finisher 2024-09-14T11:40:10.159 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 1 reserver 2024-09-14T11:40:10.159 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 heartbeatmap 2024-09-14T11:40:10.159 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 perfcounter 2024-09-14T11:40:10.159 INFO:tasks.workunit.client.0.smithi138.stderr: 20/20 rgw 2024-09-14T11:40:10.159 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 rgw_sync 2024-09-14T11:40:10.159 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 rgw_datacache 2024-09-14T11:40:10.159 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 rgw_access 2024-09-14T11:40:10.159 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 rgw_dbstore 2024-09-14T11:40:10.159 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 rgw_flight 2024-09-14T11:40:10.159 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 rgw_lifecycle 2024-09-14T11:40:10.159 INFO:tasks.workunit.client.0.smithi138.stderr: 20/20 rgw_notification 2024-09-14T11:40:10.160 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 javaclient 2024-09-14T11:40:10.160 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 asok 2024-09-14T11:40:10.160 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 1 throttle 2024-09-14T11:40:10.160 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 0 refs 2024-09-14T11:40:10.160 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 compressor 2024-09-14T11:40:10.160 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 bluestore 2024-09-14T11:40:10.160 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 bluefs 2024-09-14T11:40:10.160 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 3 bdev 2024-09-14T11:40:10.160 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 kstore 2024-09-14T11:40:10.160 INFO:tasks.workunit.client.0.smithi138.stderr: 4/ 5 rocksdb 2024-09-14T11:40:10.160 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 fuse 2024-09-14T11:40:10.160 INFO:tasks.workunit.client.0.smithi138.stderr: 2/ 5 mgr 2024-09-14T11:40:10.160 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 mgrc 2024-09-14T11:40:10.160 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 dpdk 2024-09-14T11:40:10.160 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 eventtrace 2024-09-14T11:40:10.160 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 prioritycache 2024-09-14T11:40:10.161 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 test 2024-09-14T11:40:10.161 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 cephfs_mirror 2024-09-14T11:40:10.161 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 cephsqlite 2024-09-14T11:40:10.161 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 crimson_interrupt 2024-09-14T11:40:10.161 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 seastore 2024-09-14T11:40:10.161 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 seastore_onode 2024-09-14T11:40:10.161 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 seastore_odata 2024-09-14T11:40:10.161 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 seastore_omap 2024-09-14T11:40:10.161 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 seastore_tm 2024-09-14T11:40:10.161 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 seastore_t 2024-09-14T11:40:10.161 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 seastore_cleaner 2024-09-14T11:40:10.161 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 seastore_epm 2024-09-14T11:40:10.161 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 seastore_lba 2024-09-14T11:40:10.161 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 seastore_fixedkv_tree 2024-09-14T11:40:10.162 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 seastore_cache 2024-09-14T11:40:10.162 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 seastore_journal 2024-09-14T11:40:10.162 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 seastore_device 2024-09-14T11:40:10.162 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 seastore_backref 2024-09-14T11:40:10.162 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 alienstore 2024-09-14T11:40:10.162 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 mclock 2024-09-14T11:40:10.162 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 cyanstore 2024-09-14T11:40:10.162 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 ceph_exporter 2024-09-14T11:40:10.162 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 memstore 2024-09-14T11:40:10.162 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 trace 2024-09-14T11:40:10.162 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 ceph_dedup 2024-09-14T11:40:10.162 INFO:tasks.workunit.client.0.smithi138.stderr: -2/-2 (syslog threshold) 2024-09-14T11:40:10.162 INFO:tasks.workunit.client.0.smithi138.stderr: 99/99 (stderr threshold) 2024-09-14T11:40:10.162 INFO:tasks.workunit.client.0.smithi138.stderr:--- pthread ID / name mapping for recent threads --- 2024-09-14T11:40:10.162 INFO:tasks.workunit.client.0.smithi138.stderr: 7f789b7fe640 / http_manager 2024-09-14T11:40:10.162 INFO:tasks.workunit.client.0.smithi138.stderr: 7f7929fdb640 / http_manager 2024-09-14T11:40:10.163 INFO:tasks.workunit.client.0.smithi138.stderr: 7f792afdd640 / rgw_dt_lg_renew 2024-09-14T11:40:10.163 INFO:tasks.workunit.client.0.smithi138.stderr: 7f7949ffb640 / ms_dispatch 2024-09-14T11:40:10.163 INFO:tasks.workunit.client.0.smithi138.stderr: 7f794affd640 / io_context_pool 2024-09-14T11:40:10.163 INFO:tasks.workunit.client.0.smithi138.stderr: 7f794b7fe640 / io_context_pool 2024-09-14T11:40:10.163 INFO:tasks.workunit.client.0.smithi138.stderr: 7f7959ffb640 / ms_dispatch 2024-09-14T11:40:10.163 INFO:tasks.workunit.client.0.smithi138.stderr: 7f7960e09640 / ms_dispatch 2024-09-14T11:40:10.163 INFO:tasks.workunit.client.0.smithi138.stderr: 7f796260c640 / io_context_pool 2024-09-14T11:40:10.163 INFO:tasks.workunit.client.0.smithi138.stderr: 7f7a73c26640 / msgr-worker-2 2024-09-14T11:40:10.163 INFO:tasks.workunit.client.0.smithi138.stderr: 7f7a74427640 / msgr-worker-1 2024-09-14T11:40:10.163 INFO:tasks.workunit.client.0.smithi138.stderr: 7f7a74c28640 / msgr-worker-0 2024-09-14T11:40:10.163 INFO:tasks.workunit.client.0.smithi138.stderr: 7f7a75429640 / io_context_pool 2024-09-14T11:40:10.163 INFO:tasks.workunit.client.0.smithi138.stderr: 7f7a769219c0 / radosgw-admin 2024-09-14T11:40:10.163 INFO:tasks.workunit.client.0.smithi138.stderr: max_recent 500 2024-09-14T11:40:10.163 INFO:tasks.workunit.client.0.smithi138.stderr: max_new 1000 2024-09-14T11:40:10.163 INFO:tasks.workunit.client.0.smithi138.stderr: log_file /var/lib/ceph/crash/2024-09-14T11:40:10.044640Z_10cbc4f1-5c48-4ed8-83f0-dd990b042166/log 2024-09-14T11:40:10.163 INFO:tasks.workunit.client.0.smithi138.stderr:--- end dump of recent events --- 2024-09-14T11:40:10.163 INFO:tasks.workunit.client.0.smithi138.stderr:Aborted 2024-09-14T11:40:10.164 INFO:tasks.workunit.client.0.smithi138.stderr:radosgw-admin bucket stats --bucket a-bucket 2024-09-14T11:40:10.165 INFO:tasks.workunit.client.0.smithi138.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:40:10.165 INFO:tasks.workunit.client.0.smithi138.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:40:10.165 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:40:10.128+0000 7f80eba0b9c0 20 rados->read ofs=0 len=0 2024-09-14T11:40:10.165 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:40:10.128+0000 7f80eba0b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:40:10.165 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:40:10.128+0000 7f80eba0b9c0 20 realm 2024-09-14T11:40:10.165 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:40:10.128+0000 7f80eba0b9c0 20 rados->read ofs=0 len=0 2024-09-14T11:40:10.165 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:40:10.132+0000 7f80eba0b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:40:10.165 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:40:10.132+0000 7f80eba0b9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:40:10.165 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:40:10.132+0000 7f80eba0b9c0 20 rados->read ofs=0 len=0 2024-09-14T11:40:10.165 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:40:10.132+0000 7f80eba0b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:40:10.165 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:40:10.132+0000 7f80eba0b9c0 20 rados->read ofs=0 len=0 2024-09-14T11:40:10.165 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:40:10.132+0000 7f80eba0b9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:40:10.165 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:40:10.132+0000 7f80eba0b9c0 20 rados->read ofs=0 len=0 2024-09-14T11:40:10.166 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:40:10.132+0000 7f80eba0b9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:40:10.166 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:40:10.132+0000 7f80eba0b9c0 20 searching for the correct realm 2024-09-14T11:40:10.166 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:40:10.136+0000 7f80e9d12640 0 -- 172.21.15.138:0/377580021 >> [v2:172.21.15.154:6824/416768175,v1:172.21.15.154:6825/416768175] conn(0x7f80e40d8040 msgr2=0x7f80e40c1420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:40:10.349 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:40:10.352+0000 7f80e8d10640 0 -- 172.21.15.138:0/377580021 >> [v2:172.21.15.138:6816/326481658,v1:172.21.15.138:6817/326481658] conn(0x7f80e40c1c20 msgr2=0x7f80e40e7900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:40:10.568 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:40:10.568+0000 7f80eba0b9c0 20 RGWRados::pool_iterate: got zone_info.d9e72d30-c60b-4d0d-9267-fdc36392d5ad 2024-09-14T11:40:10.568 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:40:10.568+0000 7f80eba0b9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:40:10.568 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:40:10.568+0000 7f80eba0b9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:40:10.568 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:40:10.568+0000 7f80eba0b9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:40:10.568 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:40:10.568+0000 7f80eba0b9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:40:10.568 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:40:10.568+0000 7f80eba0b9c0 20 RGWRados::pool_iterate: got zonegroup_info.65ab941b-da8c-4160-94fb-3672b069d44f 2024-09-14T11:40:10.568 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:40:10.568+0000 7f80eba0b9c0 20 rados->read ofs=0 len=0 2024-09-14T11:40:10.568 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:40:10.572+0000 7f80eba0b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:40:10.569 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:40:10.572+0000 7f80eba0b9c0 20 rados->read ofs=0 len=0 2024-09-14T11:40:10.569 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:40:10.572+0000 7f80eba0b9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:40:10.569 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:40:10.572+0000 7f80eba0b9c0 20 rados->read ofs=0 len=0 2024-09-14T11:40:10.570 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:40:10.572+0000 7f80eba0b9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:40:10.570 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:40:10.572+0000 7f80eba0b9c0 20 zone default found 2024-09-14T11:40:10.570 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:40:10.572+0000 7f80eba0b9c0 4 Realm: () 2024-09-14T11:40:10.570 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:40:10.572+0000 7f80eba0b9c0 4 ZoneGroup: default (65ab941b-da8c-4160-94fb-3672b069d44f) 2024-09-14T11:40:10.570 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:40:10.572+0000 7f80eba0b9c0 4 Zone: default (d9e72d30-c60b-4d0d-9267-fdc36392d5ad) 2024-09-14T11:40:10.570 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:40:10.572+0000 7f80eba0b9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:40:10.570 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:40:10.572+0000 7f80eba0b9c0 20 zonegroup default 2024-09-14T11:40:10.571 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:40:10.572+0000 7f80eba0b9c0 20 rados->read ofs=0 len=0 2024-09-14T11:40:10.571 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:40:10.572+0000 7f80eba0b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:40:10.571 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:40:10.572+0000 7f80eba0b9c0 20 rados->read ofs=0 len=0 2024-09-14T11:40:10.572 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:40:10.572+0000 7f80eba0b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:40:10.572 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:40:10.576+0000 7f80eba0b9c0 20 rados->read ofs=0 len=0 2024-09-14T11:40:10.572 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:40:10.576+0000 7f80eba0b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:40:10.572 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:40:10.576+0000 7f80eba0b9c0 20 started sync module instance, tier type = 2024-09-14T11:40:10.573 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:40:10.576+0000 7f80eba0b9c0 20 started zone id=d9e72d30-c60b-4d0d-9267-fdc36392d5ad (name=default) with tier type = 2024-09-14T11:40:10.596 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:40:10.596+0000 7f80eba0b9c0 20 add_watcher() i=0 2024-09-14T11:40:10.596 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:40:10.596+0000 7f80eba0b9c0 20 add_watcher() i=1 2024-09-14T11:40:10.596 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:40:10.596+0000 7f80eba0b9c0 20 add_watcher() i=2 2024-09-14T11:40:10.596 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:40:10.596+0000 7f80eba0b9c0 20 add_watcher() i=3 2024-09-14T11:40:10.596 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:40:10.596+0000 7f80eba0b9c0 20 add_watcher() i=4 2024-09-14T11:40:10.596 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:40:10.596+0000 7f80eba0b9c0 20 add_watcher() i=5 2024-09-14T11:40:10.596 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:40:10.596+0000 7f80eba0b9c0 20 add_watcher() i=6 2024-09-14T11:40:10.598 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:40:10.600+0000 7f80eba0b9c0 20 add_watcher() i=7 2024-09-14T11:40:10.598 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:40:10.600+0000 7f80eba0b9c0 2 all 8 watchers are set, enabling cache 2024-09-14T11:40:10.602 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:40:10.604+0000 7f7f9f7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:40:10.603 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:40:10.604+0000 7f80eba0b9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:40:10.603 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:40:10.604+0000 7f80eba0b9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:40:10.603 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:40:10.604+0000 7f80eba0b9c0 5 note: GC not initialized 2024-09-14T11:40:10.604 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:40:10.604+0000 7f7f9e7e4640 20 reqs_thread_entry: start 2024-09-14T11:40:10.604 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:40:10.608+0000 7f80eba0b9c0 20 init_complete bucket index max shards: 11 2024-09-14T11:40:10.604 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:40:10.608+0000 7f80eba0b9c0 20 Filter name: none 2024-09-14T11:40:10.605 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:40:10.608+0000 7f7f0ffff640 20 reqs_thread_entry: start 2024-09-14T11:40:10.605 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:40:10.608+0000 7f80eba0b9c0 20 rados->read ofs=0 len=0 2024-09-14T11:40:10.606 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:40:10.608+0000 7f80eba0b9c0 20 rados_obj.operate() r=0 bl.length=176 2024-09-14T11:40:10.606 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:40:10.608+0000 7f80eba0b9c0 20 rados->read ofs=0 len=0 2024-09-14T11:40:10.606 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:40:10.608+0000 7f80eba0b9c0 20 rados_obj.operate() r=0 bl.length=430 2024-09-14T11:40:10.606 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:40:10.608+0000 7f80eba0b9c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:40:10.607 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:40:10.608+0000 7f80eba0b9c0 20 rados->read ofs=0 len=0 2024-09-14T11:40:10.607 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:40:10.608+0000 7f80eba0b9c0 20 rados_obj.operate() r=0 bl.length=176 2024-09-14T11:40:10.607 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:40:10.608+0000 7f80eba0b9c0 20 rados->read ofs=0 len=0 2024-09-14T11:40:10.608 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:40:10.608+0000 7f80eba0b9c0 20 rados_obj.operate() r=0 bl.length=430 2024-09-14T11:40:10.608 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:40:10.612+0000 7f80eba0b9c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:40:10.611 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:40:10.612+0000 7f7f9f7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:40:10.616 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:40:10.616+0000 7f80eba0b9c0 20 remove_watcher() i=0 2024-09-14T11:40:10.616 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:40:10.620+0000 7f80eba0b9c0 2 removed watcher, disabling cache 2024-09-14T11:40:10.618 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:40:10.620+0000 7f80eba0b9c0 20 remove_watcher() i=1 2024-09-14T11:40:10.620 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:40:10.624+0000 7f80eba0b9c0 20 remove_watcher() i=2 2024-09-14T11:40:10.622 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:40:10.624+0000 7f80eba0b9c0 20 remove_watcher() i=3 2024-09-14T11:40:10.625 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:40:10.628+0000 7f80eba0b9c0 20 remove_watcher() i=4 2024-09-14T11:40:10.626 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:40:10.628+0000 7f80eba0b9c0 20 remove_watcher() i=5 2024-09-14T11:40:10.627 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:40:10.628+0000 7f80eba0b9c0 20 remove_watcher() i=6 2024-09-14T11:40:10.629 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:40:10.632+0000 7f80eba0b9c0 20 remove_watcher() i=7 2024-09-14T11:40:10.652 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:40:10.652 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-14T11:40:10.695 INFO:tasks.workunit.client.0.smithi138.stderr:radosgw-admin reshardlog list --bucket a-bucket 2024-09-14T11:40:10.722 INFO:tasks.workunit.client.0.smithi138.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:40:10.722 INFO:tasks.workunit.client.0.smithi138.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:40:10.766 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:40:10.768+0000 7fac8c8bf9c0 20 rados->read ofs=0 len=0 2024-09-14T11:40:10.768 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:40:10.772+0000 7fac8c8bf9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:40:10.769 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:40:10.772+0000 7fac8c8bf9c0 20 realm 2024-09-14T11:40:10.769 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:40:10.772+0000 7fac8c8bf9c0 20 rados->read ofs=0 len=0 2024-09-14T11:40:10.769 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:40:10.772+0000 7fac8c8bf9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:40:10.769 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:40:10.772+0000 7fac8c8bf9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:40:10.769 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:40:10.772+0000 7fac8c8bf9c0 20 rados->read ofs=0 len=0 2024-09-14T11:40:10.769 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:40:10.772+0000 7fac8c8bf9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:40:10.769 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:40:10.772+0000 7fac8c8bf9c0 20 rados->read ofs=0 len=0 2024-09-14T11:40:10.770 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:40:10.772+0000 7fac8c8bf9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:40:10.770 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:40:10.772+0000 7fac8c8bf9c0 20 rados->read ofs=0 len=0 2024-09-14T11:40:10.771 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:40:10.772+0000 7fac8c8bf9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:40:10.771 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:40:10.772+0000 7fac8c8bf9c0 20 searching for the correct realm 2024-09-14T11:40:10.774 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:40:10.776+0000 7fac8abc6640 0 -- 172.21.15.138:0/460713805 >> [v2:172.21.15.154:6824/416768175,v1:172.21.15.154:6825/416768175] conn(0x7fac7c01e060 msgr2=0x7fac7c051a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:40:10.988 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:40:10.992+0000 7fac89bc4640 0 -- 172.21.15.138:0/460713805 >> [v2:172.21.15.138:6816/326481658,v1:172.21.15.138:6817/326481658] conn(0x7fac7c066320 msgr2=0x7fac7c056a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:40:11.207 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:40:11.208+0000 7fac8c8bf9c0 20 RGWRados::pool_iterate: got zone_info.d9e72d30-c60b-4d0d-9267-fdc36392d5ad 2024-09-14T11:40:11.208 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:40:11.208+0000 7fac8c8bf9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:40:11.208 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:40:11.208+0000 7fac8c8bf9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:40:11.208 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:40:11.208+0000 7fac8c8bf9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:40:11.208 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:40:11.208+0000 7fac8c8bf9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:40:11.208 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:40:11.208+0000 7fac8c8bf9c0 20 RGWRados::pool_iterate: got zonegroup_info.65ab941b-da8c-4160-94fb-3672b069d44f 2024-09-14T11:40:11.208 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:40:11.208+0000 7fac8c8bf9c0 20 rados->read ofs=0 len=0 2024-09-14T11:40:11.208 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:40:11.212+0000 7fac8c8bf9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:40:11.209 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:40:11.212+0000 7fac8c8bf9c0 20 rados->read ofs=0 len=0 2024-09-14T11:40:11.209 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:40:11.212+0000 7fac8c8bf9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:40:11.209 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:40:11.212+0000 7fac8c8bf9c0 20 rados->read ofs=0 len=0 2024-09-14T11:40:11.210 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:40:11.212+0000 7fac8c8bf9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:40:11.210 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:40:11.212+0000 7fac8c8bf9c0 20 zone default found 2024-09-14T11:40:11.210 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:40:11.212+0000 7fac8c8bf9c0 4 Realm: () 2024-09-14T11:40:11.210 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:40:11.212+0000 7fac8c8bf9c0 4 ZoneGroup: default (65ab941b-da8c-4160-94fb-3672b069d44f) 2024-09-14T11:40:11.210 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:40:11.212+0000 7fac8c8bf9c0 4 Zone: default (d9e72d30-c60b-4d0d-9267-fdc36392d5ad) 2024-09-14T11:40:11.210 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:40:11.212+0000 7fac8c8bf9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:40:11.211 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:40:11.212+0000 7fac8c8bf9c0 20 zonegroup default 2024-09-14T11:40:11.211 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:40:11.212+0000 7fac8c8bf9c0 20 rados->read ofs=0 len=0 2024-09-14T11:40:11.211 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:40:11.212+0000 7fac8c8bf9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:40:11.211 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:40:11.212+0000 7fac8c8bf9c0 20 rados->read ofs=0 len=0 2024-09-14T11:40:11.212 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:40:11.212+0000 7fac8c8bf9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:40:11.212 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:40:11.212+0000 7fac8c8bf9c0 20 rados->read ofs=0 len=0 2024-09-14T11:40:11.212 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:40:11.216+0000 7fac8c8bf9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:40:11.212 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:40:11.216+0000 7fac8c8bf9c0 20 started sync module instance, tier type = 2024-09-14T11:40:11.212 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:40:11.216+0000 7fac8c8bf9c0 20 started zone id=d9e72d30-c60b-4d0d-9267-fdc36392d5ad (name=default) with tier type = 2024-09-14T11:40:11.236 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:40:11.236+0000 7fac8c8bf9c0 20 add_watcher() i=0 2024-09-14T11:40:11.236 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:40:11.236+0000 7fac8c8bf9c0 20 add_watcher() i=1 2024-09-14T11:40:11.236 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:40:11.236+0000 7fac8c8bf9c0 20 add_watcher() i=2 2024-09-14T11:40:11.236 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:40:11.236+0000 7fac8c8bf9c0 20 add_watcher() i=3 2024-09-14T11:40:11.236 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:40:11.236+0000 7fac8c8bf9c0 20 add_watcher() i=4 2024-09-14T11:40:11.236 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:40:11.236+0000 7fac8c8bf9c0 20 add_watcher() i=5 2024-09-14T11:40:11.236 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:40:11.236+0000 7fac8c8bf9c0 20 add_watcher() i=6 2024-09-14T11:40:11.238 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:40:11.240+0000 7fac8c8bf9c0 20 add_watcher() i=7 2024-09-14T11:40:11.238 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:40:11.240+0000 7fac8c8bf9c0 2 all 8 watchers are set, enabling cache 2024-09-14T11:40:11.242 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:40:11.244+0000 7fab40fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:40:11.242 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:40:11.244+0000 7fac8c8bf9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:40:11.243 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:40:11.244+0000 7fac8c8bf9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:40:11.243 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:40:11.244+0000 7fac8c8bf9c0 5 note: GC not initialized 2024-09-14T11:40:11.243 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:40:11.244+0000 7faabb7fe640 20 reqs_thread_entry: start 2024-09-14T11:40:11.243 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:40:11.244+0000 7fac8c8bf9c0 20 init_complete bucket index max shards: 11 2024-09-14T11:40:11.243 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:40:11.244+0000 7fac8c8bf9c0 20 Filter name: none 2024-09-14T11:40:11.244 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:40:11.248+0000 7faab97fa640 20 reqs_thread_entry: start 2024-09-14T11:40:11.244 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:40:11.248+0000 7fac8c8bf9c0 10 cache get: name=default.rgw.meta+root+a-bucket : miss 2024-09-14T11:40:11.244 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:40:11.248+0000 7fac8c8bf9c0 20 rados->read ofs=0 len=0 2024-09-14T11:40:11.245 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:40:11.248+0000 7fac8c8bf9c0 20 rados_obj.operate() r=0 bl.length=176 2024-09-14T11:40:11.245 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:40:11.248+0000 7fac8c8bf9c0 10 cache put: name=default.rgw.meta+root+a-bucket info.flags=0x11 2024-09-14T11:40:11.245 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:40:11.248+0000 7fac8c8bf9c0 10 adding default.rgw.meta+root+a-bucket to cache LRU end 2024-09-14T11:40:11.245 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:40:11.248+0000 7fac8c8bf9c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.17 : miss 2024-09-14T11:40:11.245 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:40:11.248+0000 7fac8c8bf9c0 20 rados->read ofs=0 len=0 2024-09-14T11:40:11.246 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:40:11.248+0000 7fac8c8bf9c0 20 rados_obj.operate() r=0 bl.length=430 2024-09-14T11:40:11.246 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:40:11.248+0000 7fac8c8bf9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.17 info.flags=0x17 2024-09-14T11:40:11.246 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:40:11.248+0000 7fac8c8bf9c0 10 adding default.rgw.meta+root+.bucket.meta.a-bucket:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.17 to cache LRU end 2024-09-14T11:40:11.246 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:40:11.248+0000 7fac8c8bf9c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:40:11.246 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:40:11.248+0000 7fac8c8bf9c0 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-14T11:40:11.246 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:40:11.248+0000 7fac8c8bf9c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.17 2024-09-14T11:40:11.246 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:40:11.248+0000 7fac8c8bf9c0 10 bucket_obj is .dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.17.2.0 2024-09-14T11:40:11.246 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:40:11.248+0000 7fac8c8bf9c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.17.2.0 2024-09-14T11:40:11.247 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:40:11.248+0000 7fac8c8bf9c0 10 bucket_obj is .dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.17.2.1 2024-09-14T11:40:11.247 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:40:11.248+0000 7fac8c8bf9c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.17.2.1 2024-09-14T11:40:11.248 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:40:11.252+0000 7fac8c8bf9c0 10 bucket_obj is .dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.17.2.2 2024-09-14T11:40:11.248 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:40:11.252+0000 7fac8c8bf9c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.17.2.2 2024-09-14T11:40:11.248 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:40:11.252+0000 7fac8c8bf9c0 10 bucket_obj is .dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.17.2.3 2024-09-14T11:40:11.248 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:40:11.252+0000 7fac8c8bf9c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.17.2.3 2024-09-14T11:40:11.249 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:40:11.252+0000 7fac8c8bf9c0 10 bucket_obj is .dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.17.2.4 2024-09-14T11:40:11.249 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:40:11.252+0000 7fac8c8bf9c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.17.2.4 2024-09-14T11:40:11.250 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:40:11.252+0000 7fac8c8bf9c0 10 bucket_obj is .dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.17.2.5 2024-09-14T11:40:11.250 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:40:11.252+0000 7fac8c8bf9c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.17.2.5 2024-09-14T11:40:11.251 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:40:11.252+0000 7fac8c8bf9c0 10 bucket_obj is .dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.17.2.6 2024-09-14T11:40:11.251 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:40:11.252+0000 7fac8c8bf9c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.17.2.6 2024-09-14T11:40:11.251 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:40:11.252+0000 7fac8c8bf9c0 10 bucket_obj is .dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.17.2.7 2024-09-14T11:40:11.252 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:40:11.252+0000 7fac8c8bf9c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.17.2.7 2024-09-14T11:40:11.252 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:40:11.256+0000 7fac8c8bf9c0 10 bucket_obj is .dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.17.2.8 2024-09-14T11:40:11.252 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:40:11.256+0000 7fac8c8bf9c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.17.2.8 2024-09-14T11:40:11.253 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:40:11.256+0000 7fac8c8bf9c0 10 bucket_obj is .dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.17.2.9 2024-09-14T11:40:11.253 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:40:11.256+0000 7fac8c8bf9c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.17.2.9 2024-09-14T11:40:11.254 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:40:11.256+0000 7fac8c8bf9c0 10 bucket_obj is .dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.17.2.10 2024-09-14T11:40:11.254 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:40:11.256+0000 7fac8c8bf9c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.17.2.10 2024-09-14T11:40:11.254 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:40:11.256+0000 7fac8c8bf9c0 10 bucket_obj is .dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.17.2.11 2024-09-14T11:40:11.254 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:40:11.256+0000 7fac8c8bf9c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.17.2.11 2024-09-14T11:40:11.255 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:40:11.256+0000 7fac8c8bf9c0 10 bucket_obj is .dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.17.2.12 2024-09-14T11:40:11.255 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:40:11.256+0000 7fac8c8bf9c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.17.2.12 2024-09-14T11:40:11.257 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:40:11.260+0000 7fab40fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:40:11.262 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:40:11.264+0000 7fac8c8bf9c0 20 remove_watcher() i=0 2024-09-14T11:40:11.262 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:40:11.264+0000 7fac8c8bf9c0 2 removed watcher, disabling cache 2024-09-14T11:40:11.264 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:40:11.268+0000 7fac8c8bf9c0 20 remove_watcher() i=1 2024-09-14T11:40:11.266 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:40:11.268+0000 7fac8c8bf9c0 20 remove_watcher() i=2 2024-09-14T11:40:11.268 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:40:11.272+0000 7fac8c8bf9c0 20 remove_watcher() i=3 2024-09-14T11:40:11.271 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:40:11.272+0000 7fac8c8bf9c0 20 remove_watcher() i=4 2024-09-14T11:40:11.273 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:40:11.276+0000 7fac8c8bf9c0 20 remove_watcher() i=5 2024-09-14T11:40:11.274 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:40:11.276+0000 7fac8c8bf9c0 20 remove_watcher() i=6 2024-09-14T11:40:11.275 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:40:11.276+0000 7fac8c8bf9c0 20 remove_watcher() i=7 2024-09-14T11:40:41.322 INFO:tasks.workunit.client.0.smithi138.stderr:radosgw-admin bucket reshard --bucket a-bucket --num-shards 14 --rgw-reshard-bucket-lock-duration 30 --inject-abort-at logrecord_writes 2024-09-14T11:40:41.362 INFO:tasks.workunit.client.0.smithi138.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:40:41.362 INFO:tasks.workunit.client.0.smithi138.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:40:41.621 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:40:41.623+0000 7efc0c3fa9c0 20 rados->read ofs=0 len=0 2024-09-14T11:40:41.624 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:40:41.627+0000 7efc0c3fa9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:40:41.624 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:40:41.627+0000 7efc0c3fa9c0 20 realm 2024-09-14T11:40:41.624 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:40:41.627+0000 7efc0c3fa9c0 20 rados->read ofs=0 len=0 2024-09-14T11:40:41.625 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:40:41.627+0000 7efc0c3fa9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:40:41.625 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:40:41.627+0000 7efc0c3fa9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:40:41.625 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:40:41.627+0000 7efc0c3fa9c0 20 rados->read ofs=0 len=0 2024-09-14T11:40:41.625 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:40:41.627+0000 7efc0c3fa9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:40:41.625 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:40:41.627+0000 7efc0c3fa9c0 20 rados->read ofs=0 len=0 2024-09-14T11:40:41.626 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:40:41.627+0000 7efc0c3fa9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:40:41.626 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:40:41.627+0000 7efc0c3fa9c0 20 rados->read ofs=0 len=0 2024-09-14T11:40:41.627 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:40:41.627+0000 7efc0c3fa9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:40:41.628 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:40:41.627+0000 7efc0c3fa9c0 20 searching for the correct realm 2024-09-14T11:40:41.631 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:40:41.631+0000 7efc0a701640 0 -- 172.21.15.138:0/3254551000 >> [v2:172.21.15.154:6824/416768175,v1:172.21.15.154:6825/416768175] conn(0x7efc04018040 msgr2=0x7efc04011460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:40:41.845 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:40:41.847+0000 7efc096ff640 0 -- 172.21.15.138:0/3254551000 >> [v2:172.21.15.138:6816/326481658,v1:172.21.15.138:6817/326481658] conn(0x7efc04034920 msgr2=0x7efc04058380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-14T11:40:42.063 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:40:42.063+0000 7efc0c3fa9c0 20 RGWRados::pool_iterate: got zone_info.d9e72d30-c60b-4d0d-9267-fdc36392d5ad 2024-09-14T11:40:42.063 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:40:42.063+0000 7efc0c3fa9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:40:42.063 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:40:42.063+0000 7efc0c3fa9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:40:42.063 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:40:42.063+0000 7efc0c3fa9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:40:42.063 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:40:42.063+0000 7efc0c3fa9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:40:42.064 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:40:42.063+0000 7efc0c3fa9c0 20 RGWRados::pool_iterate: got zonegroup_info.65ab941b-da8c-4160-94fb-3672b069d44f 2024-09-14T11:40:42.064 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:40:42.063+0000 7efc0c3fa9c0 20 rados->read ofs=0 len=0 2024-09-14T11:40:42.064 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:40:42.063+0000 7efc0c3fa9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:40:42.064 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:40:42.063+0000 7efc0c3fa9c0 20 rados->read ofs=0 len=0 2024-09-14T11:40:42.065 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:40:42.067+0000 7efc0c3fa9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:40:42.065 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:40:42.067+0000 7efc0c3fa9c0 20 rados->read ofs=0 len=0 2024-09-14T11:40:42.065 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:40:42.067+0000 7efc0c3fa9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:40:42.065 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:40:42.067+0000 7efc0c3fa9c0 20 zone default found 2024-09-14T11:40:42.065 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:40:42.067+0000 7efc0c3fa9c0 4 Realm: () 2024-09-14T11:40:42.066 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:40:42.067+0000 7efc0c3fa9c0 4 ZoneGroup: default (65ab941b-da8c-4160-94fb-3672b069d44f) 2024-09-14T11:40:42.066 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:40:42.067+0000 7efc0c3fa9c0 4 Zone: default (d9e72d30-c60b-4d0d-9267-fdc36392d5ad) 2024-09-14T11:40:42.066 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:40:42.067+0000 7efc0c3fa9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:40:42.066 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:40:42.067+0000 7efc0c3fa9c0 20 zonegroup default 2024-09-14T11:40:42.066 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:40:42.067+0000 7efc0c3fa9c0 20 rados->read ofs=0 len=0 2024-09-14T11:40:42.066 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:40:42.067+0000 7efc0c3fa9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:40:42.066 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:40:42.067+0000 7efc0c3fa9c0 20 rados->read ofs=0 len=0 2024-09-14T11:40:42.067 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:40:42.067+0000 7efc0c3fa9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:40:42.067 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:40:42.067+0000 7efc0c3fa9c0 20 rados->read ofs=0 len=0 2024-09-14T11:40:42.068 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:40:42.067+0000 7efc0c3fa9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:40:42.068 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:40:42.071+0000 7efc0c3fa9c0 20 started sync module instance, tier type = 2024-09-14T11:40:42.068 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:40:42.071+0000 7efc0c3fa9c0 20 started zone id=d9e72d30-c60b-4d0d-9267-fdc36392d5ad (name=default) with tier type = 2024-09-14T11:40:42.091 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:40:42.091+0000 7efc0c3fa9c0 20 add_watcher() i=0 2024-09-14T11:40:42.091 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:40:42.091+0000 7efc0c3fa9c0 20 add_watcher() i=1 2024-09-14T11:40:42.091 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:40:42.091+0000 7efc0c3fa9c0 20 add_watcher() i=2 2024-09-14T11:40:42.091 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:40:42.091+0000 7efc0c3fa9c0 20 add_watcher() i=3 2024-09-14T11:40:42.091 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:40:42.091+0000 7efc0c3fa9c0 20 add_watcher() i=4 2024-09-14T11:40:42.091 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:40:42.091+0000 7efc0c3fa9c0 20 add_watcher() i=5 2024-09-14T11:40:42.091 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:40:42.091+0000 7efc0c3fa9c0 20 add_watcher() i=6 2024-09-14T11:40:42.093 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:40:42.095+0000 7efc0c3fa9c0 20 add_watcher() i=7 2024-09-14T11:40:42.093 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:40:42.095+0000 7efc0c3fa9c0 2 all 8 watchers are set, enabling cache 2024-09-14T11:40:42.097 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:40:42.099+0000 7efabb7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:40:42.098 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:40:42.099+0000 7efc0c3fa9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:40:42.098 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:40:42.099+0000 7efc0c3fa9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:40:42.098 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:40:42.099+0000 7efc0c3fa9c0 5 note: GC not initialized 2024-09-14T11:40:42.098 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:40:42.099+0000 7efaba7fc640 20 reqs_thread_entry: start 2024-09-14T11:40:42.099 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:40:42.099+0000 7efc0c3fa9c0 20 init_complete bucket index max shards: 11 2024-09-14T11:40:42.099 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:40:42.099+0000 7efc0c3fa9c0 20 Filter name: none 2024-09-14T11:40:42.099 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:40:42.099+0000 7efa2bfff640 20 reqs_thread_entry: start 2024-09-14T11:40:42.099 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:40:42.099+0000 7efc0c3fa9c0 10 cache get: name=default.rgw.meta+root+a-bucket : miss 2024-09-14T11:40:42.099 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:40:42.099+0000 7efc0c3fa9c0 20 rados->read ofs=0 len=0 2024-09-14T11:40:42.100 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:40:42.103+0000 7efc0c3fa9c0 20 rados_obj.operate() r=0 bl.length=176 2024-09-14T11:40:42.100 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:40:42.103+0000 7efc0c3fa9c0 10 cache put: name=default.rgw.meta+root+a-bucket info.flags=0x11 2024-09-14T11:40:42.100 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:40:42.103+0000 7efc0c3fa9c0 10 adding default.rgw.meta+root+a-bucket to cache LRU end 2024-09-14T11:40:42.100 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:40:42.103+0000 7efc0c3fa9c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.17 : miss 2024-09-14T11:40:42.100 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:40:42.103+0000 7efc0c3fa9c0 20 rados->read ofs=0 len=0 2024-09-14T11:40:42.101 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:40:42.103+0000 7efc0c3fa9c0 20 rados_obj.operate() r=0 bl.length=430 2024-09-14T11:40:42.101 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:40:42.103+0000 7efc0c3fa9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.17 info.flags=0x17 2024-09-14T11:40:42.101 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:40:42.103+0000 7efc0c3fa9c0 10 adding default.rgw.meta+root+.bucket.meta.a-bucket:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.17 to cache LRU end 2024-09-14T11:40:42.102 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:40:42.103+0000 7efc0c3fa9c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:40:42.102 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:40:42.103+0000 7efc0c3fa9c0 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-14T11:40:42.102 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:40:42.103+0000 7efc0c3fa9c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.17 2024-09-14T11:40:42.103 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:40:42.103+0000 7efc0c3fa9c0 10 init_target_layout removing existing target index objects from a previous reshard attempt 2024-09-14T11:40:42.121 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:40:42.123+0000 7efc0c3fa9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.17 info.flags=0x17 2024-09-14T11:40:42.121 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:40:42.123+0000 7efc0c3fa9c0 10 moving default.rgw.meta+root+.bucket.meta.a-bucket:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.17 to cache LRU end 2024-09-14T11:40:42.121 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:40:42.123+0000 7efc0c3fa9c0 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-14T11:40:42.121 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:40:42.123+0000 7efc0c3fa9c0 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.a-bucket:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.17, ofs0, ns] 2024-09-14T11:40:42.122 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:40:42.123+0000 7efaecff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366242 cookie 94534015775408 notifier 8205 bl.length()=827 2024-09-14T11:40:42.122 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:40:42.123+0000 7efaecff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.17 info.flags=0x17 2024-09-14T11:40:42.122 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:40:42.123+0000 7efaecff9640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.a-bucket:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.17 to cache LRU end 2024-09-14T11:40:42.122 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:40:42.123+0000 7efaecff9640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=143 2024-09-14T11:40:42.125 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:40:42.127+0000 7efc0c3fa9c0 20 handle_bi_update(): bucket=:a-bucket[d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.17]): orig_sources= new_sources= 2024-09-14T11:40:42.125 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:40:42.127+0000 7efc0c3fa9c0 20 handle_bi_update(): bucket=:a-bucket[d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.17]): potential sources added=[] removed=[] 2024-09-14T11:40:42.125 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:40:42.127+0000 7efc0c3fa9c0 20 handle_bi_update(): bucket=:a-bucket[d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.17]): orig_dests= new_dests= 2024-09-14T11:40:42.125 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:40:42.127+0000 7efc0c3fa9c0 20 handle_bi_update(): bucket=:a-bucket[d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.17]): potential dests added=[] removed=[] 2024-09-14T11:40:42.134 INFO:tasks.workunit.client.0.smithi138.stderr:./src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7efc0c3fa9c0 time 2024-09-14T11:40:42.139277+0000 2024-09-14T11:40:42.135 INFO:tasks.workunit.client.0.smithi138.stderr:./src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-14T11:40:42.136 INFO:tasks.workunit.client.0.smithi138.stderr: ceph version 19.3.0-4907-ga2782315 (a2782315255a3e7d5f6cdc9eb35785187ff6ddf8) squid (dev) 2024-09-14T11:40:42.136 INFO:tasks.workunit.client.0.smithi138.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x121) [0x7efc0fcd42eb] 2024-09-14T11:40:42.136 INFO:tasks.workunit.client.0.smithi138.stderr: 2: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7efc0fcd449f] 2024-09-14T11:40:42.136 INFO:tasks.workunit.client.0.smithi138.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55fa68f09c01] 2024-09-14T11:40:42.136 INFO:tasks.workunit.client.0.smithi138.stderr: 4: radosgw-admin(+0x142325c) [0x55fa6996825c] 2024-09-14T11:40:42.137 INFO:tasks.workunit.client.0.smithi138.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x55fa68f1eecd] 2024-09-14T11:40:42.137 INFO:tasks.workunit.client.0.smithi138.stderr: 6: main() 2024-09-14T11:40:42.137 INFO:tasks.workunit.client.0.smithi138.stderr: 7: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7efc0eb3ad90] 2024-09-14T11:40:42.137 INFO:tasks.workunit.client.0.smithi138.stderr: 8: __libc_start_main() 2024-09-14T11:40:42.137 INFO:tasks.workunit.client.0.smithi138.stderr: 9: _start() 2024-09-14T11:40:42.137 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:40:42.135+0000 7efc0c3fa9c0 -1 ./src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7efc0c3fa9c0 time 2024-09-14T11:40:42.139277+0000 2024-09-14T11:40:42.137 INFO:tasks.workunit.client.0.smithi138.stderr:./src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-14T11:40:42.137 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-14T11:40:42.137 INFO:tasks.workunit.client.0.smithi138.stderr: ceph version 19.3.0-4907-ga2782315 (a2782315255a3e7d5f6cdc9eb35785187ff6ddf8) squid (dev) 2024-09-14T11:40:42.137 INFO:tasks.workunit.client.0.smithi138.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x121) [0x7efc0fcd42eb] 2024-09-14T11:40:42.137 INFO:tasks.workunit.client.0.smithi138.stderr: 2: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7efc0fcd449f] 2024-09-14T11:40:42.137 INFO:tasks.workunit.client.0.smithi138.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55fa68f09c01] 2024-09-14T11:40:42.138 INFO:tasks.workunit.client.0.smithi138.stderr: 4: radosgw-admin(+0x142325c) [0x55fa6996825c] 2024-09-14T11:40:42.138 INFO:tasks.workunit.client.0.smithi138.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x55fa68f1eecd] 2024-09-14T11:40:42.138 INFO:tasks.workunit.client.0.smithi138.stderr: 6: main() 2024-09-14T11:40:42.138 INFO:tasks.workunit.client.0.smithi138.stderr: 7: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7efc0eb3ad90] 2024-09-14T11:40:42.138 INFO:tasks.workunit.client.0.smithi138.stderr: 8: __libc_start_main() 2024-09-14T11:40:42.138 INFO:tasks.workunit.client.0.smithi138.stderr: 9: _start() 2024-09-14T11:40:42.138 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-14T11:40:42.138 INFO:tasks.workunit.client.0.smithi138.stderr:*** Caught signal (Aborted) ** 2024-09-14T11:40:42.138 INFO:tasks.workunit.client.0.smithi138.stderr: in thread 7efc0c3fa9c0 thread_name:radosgw-admin 2024-09-14T11:40:42.160 INFO:tasks.workunit.client.0.smithi138.stderr: ceph version 19.3.0-4907-ga2782315 (a2782315255a3e7d5f6cdc9eb35785187ff6ddf8) squid (dev) 2024-09-14T11:40:42.160 INFO:tasks.workunit.client.0.smithi138.stderr: 1: /lib/x86_64-linux-gnu/libc.so.6(+0x42520) [0x7efc0eb53520] 2024-09-14T11:40:42.161 INFO:tasks.workunit.client.0.smithi138.stderr: 2: pthread_kill() 2024-09-14T11:40:42.161 INFO:tasks.workunit.client.0.smithi138.stderr: 3: raise() 2024-09-14T11:40:42.161 INFO:tasks.workunit.client.0.smithi138.stderr: 4: abort() 2024-09-14T11:40:42.161 INFO:tasks.workunit.client.0.smithi138.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x17b) [0x7efc0fcd4345] 2024-09-14T11:40:42.161 INFO:tasks.workunit.client.0.smithi138.stderr: 6: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7efc0fcd449f] 2024-09-14T11:40:42.161 INFO:tasks.workunit.client.0.smithi138.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55fa68f09c01] 2024-09-14T11:40:42.161 INFO:tasks.workunit.client.0.smithi138.stderr: 8: radosgw-admin(+0x142325c) [0x55fa6996825c] 2024-09-14T11:40:42.161 INFO:tasks.workunit.client.0.smithi138.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x55fa68f1eecd] 2024-09-14T11:40:42.161 INFO:tasks.workunit.client.0.smithi138.stderr: 10: main() 2024-09-14T11:40:42.161 INFO:tasks.workunit.client.0.smithi138.stderr: 11: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7efc0eb3ad90] 2024-09-14T11:40:42.161 INFO:tasks.workunit.client.0.smithi138.stderr: 12: __libc_start_main() 2024-09-14T11:40:42.161 INFO:tasks.workunit.client.0.smithi138.stderr: 13: _start() 2024-09-14T11:40:42.161 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:40:42.139+0000 7efc0c3fa9c0 -1 *** Caught signal (Aborted) ** 2024-09-14T11:40:42.162 INFO:tasks.workunit.client.0.smithi138.stderr: in thread 7efc0c3fa9c0 thread_name:radosgw-admin 2024-09-14T11:40:42.162 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-14T11:40:42.162 INFO:tasks.workunit.client.0.smithi138.stderr: ceph version 19.3.0-4907-ga2782315 (a2782315255a3e7d5f6cdc9eb35785187ff6ddf8) squid (dev) 2024-09-14T11:40:42.162 INFO:tasks.workunit.client.0.smithi138.stderr: 1: /lib/x86_64-linux-gnu/libc.so.6(+0x42520) [0x7efc0eb53520] 2024-09-14T11:40:42.162 INFO:tasks.workunit.client.0.smithi138.stderr: 2: pthread_kill() 2024-09-14T11:40:42.162 INFO:tasks.workunit.client.0.smithi138.stderr: 3: raise() 2024-09-14T11:40:42.162 INFO:tasks.workunit.client.0.smithi138.stderr: 4: abort() 2024-09-14T11:40:42.162 INFO:tasks.workunit.client.0.smithi138.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x17b) [0x7efc0fcd4345] 2024-09-14T11:40:42.162 INFO:tasks.workunit.client.0.smithi138.stderr: 6: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7efc0fcd449f] 2024-09-14T11:40:42.162 INFO:tasks.workunit.client.0.smithi138.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55fa68f09c01] 2024-09-14T11:40:42.162 INFO:tasks.workunit.client.0.smithi138.stderr: 8: radosgw-admin(+0x142325c) [0x55fa6996825c] 2024-09-14T11:40:42.163 INFO:tasks.workunit.client.0.smithi138.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x55fa68f1eecd] 2024-09-14T11:40:42.163 INFO:tasks.workunit.client.0.smithi138.stderr: 10: main() 2024-09-14T11:40:42.163 INFO:tasks.workunit.client.0.smithi138.stderr: 11: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7efc0eb3ad90] 2024-09-14T11:40:42.163 INFO:tasks.workunit.client.0.smithi138.stderr: 12: __libc_start_main() 2024-09-14T11:40:42.163 INFO:tasks.workunit.client.0.smithi138.stderr: 13: _start() 2024-09-14T11:40:42.163 INFO:tasks.workunit.client.0.smithi138.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-14T11:40:42.163 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-14T11:40:42.163 INFO:tasks.workunit.client.0.smithi138.stderr:--- begin dump of recent events --- 2024-09-14T11:40:42.163 INFO:tasks.workunit.client.0.smithi138.stderr: -499> 2024-09-14T11:40:41.387+0000 7efaf7e07640 10 monclient: dump: 2024-09-14T11:40:42.163 INFO:tasks.workunit.client.0.smithi138.stderr:epoch 1 2024-09-14T11:40:42.163 INFO:tasks.workunit.client.0.smithi138.stderr:fsid 3f225f43-83a6-4aeb-b798-1f04bb49d597 2024-09-14T11:40:42.163 INFO:tasks.workunit.client.0.smithi138.stderr:last_changed 2024-09-14T11:07:09.252780+0000 2024-09-14T11:40:42.164 INFO:tasks.workunit.client.0.smithi138.stderr:created 2024-09-14T11:07:09.252780+0000 2024-09-14T11:40:42.164 INFO:tasks.workunit.client.0.smithi138.stderr:min_mon_release 19 (squid) 2024-09-14T11:40:42.164 INFO:tasks.workunit.client.0.smithi138.stderr:election_strategy: 1 2024-09-14T11:40:42.164 INFO:tasks.workunit.client.0.smithi138.stderr:0: [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] mon.a 2024-09-14T11:40:42.164 INFO:tasks.workunit.client.0.smithi138.stderr:1: [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] mon.b 2024-09-14T11:40:42.164 INFO:tasks.workunit.client.0.smithi138.stderr:2: [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] mon.c 2024-09-14T11:40:42.164 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-14T11:40:42.164 INFO:tasks.workunit.client.0.smithi138.stderr: -498> 2024-09-14T11:40:41.387+0000 7efaf7e07640 10 monclient: _finish_auth 0 2024-09-14T11:40:42.164 INFO:tasks.workunit.client.0.smithi138.stderr: -497> 2024-09-14T11:40:41.387+0000 7efaf7e07640 10 monclient: _check_auth_tickets 2024-09-14T11:40:42.164 INFO:tasks.workunit.client.0.smithi138.stderr: -496> 2024-09-14T11:40:41.387+0000 7efc0c3fa9c0 5 monclient: authenticate success, global_id 8193 2024-09-14T11:40:42.164 INFO:tasks.workunit.client.0.smithi138.stderr: -495> 2024-09-14T11:40:41.387+0000 7efaf7e07640 10 monclient: handle_config config(0 keys) 2024-09-14T11:40:42.164 INFO:tasks.workunit.client.0.smithi138.stderr: -494> 2024-09-14T11:40:41.387+0000 7efaf7e07640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:40:42.165 INFO:tasks.workunit.client.0.smithi138.stderr: -493> 2024-09-14T11:40:41.387+0000 7efaf7e07640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-14T11:40:42.165 INFO:tasks.workunit.client.0.smithi138.stderr: -492> 2024-09-14T11:40:41.387+0000 7efaf7e07640 10 monclient: dump: 2024-09-14T11:40:42.165 INFO:tasks.workunit.client.0.smithi138.stderr:epoch 1 2024-09-14T11:40:42.165 INFO:tasks.workunit.client.0.smithi138.stderr:fsid 3f225f43-83a6-4aeb-b798-1f04bb49d597 2024-09-14T11:40:42.165 INFO:tasks.workunit.client.0.smithi138.stderr:last_changed 2024-09-14T11:07:09.252780+0000 2024-09-14T11:40:42.165 INFO:tasks.workunit.client.0.smithi138.stderr:created 2024-09-14T11:07:09.252780+0000 2024-09-14T11:40:42.165 INFO:tasks.workunit.client.0.smithi138.stderr:min_mon_release 19 (squid) 2024-09-14T11:40:42.165 INFO:tasks.workunit.client.0.smithi138.stderr:election_strategy: 1 2024-09-14T11:40:42.165 INFO:tasks.workunit.client.0.smithi138.stderr:0: [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] mon.a 2024-09-14T11:40:42.165 INFO:tasks.workunit.client.0.smithi138.stderr:1: [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] mon.b 2024-09-14T11:40:42.165 INFO:tasks.workunit.client.0.smithi138.stderr:2: [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] mon.c 2024-09-14T11:40:42.165 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-14T11:40:42.165 INFO:tasks.workunit.client.0.smithi138.stderr: -491> 2024-09-14T11:40:41.387+0000 7efc0c3fa9c0 10 monclient: get_monmap_and_config success 2024-09-14T11:40:42.165 INFO:tasks.workunit.client.0.smithi138.stderr: -490> 2024-09-14T11:40:41.387+0000 7efc0c3fa9c0 4 set_mon_vals no callback set 2024-09-14T11:40:42.166 INFO:tasks.workunit.client.0.smithi138.stderr: -489> 2024-09-14T11:40:41.387+0000 7efc0c3fa9c0 10 monclient: shutdown 2024-09-14T11:40:42.166 INFO:tasks.workunit.client.0.smithi138.stderr: -488> 2024-09-14T11:40:41.387+0000 7efc0c3fa9c0 5 asok(0x55fa6a3d0d90) unregister_commands rotate-key 2024-09-14T11:40:42.166 INFO:tasks.workunit.client.0.smithi138.stderr: -487> 2024-09-14T11:40:41.387+0000 7efc0c3fa9c0 10 monclient: build_initial_monmap 2024-09-14T11:40:42.166 INFO:tasks.workunit.client.0.smithi138.stderr: -486> 2024-09-14T11:40:41.387+0000 7efc0c3fa9c0 1 build_initial for_mkfs: 0 2024-09-14T11:40:42.166 INFO:tasks.workunit.client.0.smithi138.stderr: -485> 2024-09-14T11:40:41.387+0000 7efc0c3fa9c0 10 monclient: monmap: 2024-09-14T11:40:42.166 INFO:tasks.workunit.client.0.smithi138.stderr:epoch 0 2024-09-14T11:40:42.166 INFO:tasks.workunit.client.0.smithi138.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-14T11:40:42.166 INFO:tasks.workunit.client.0.smithi138.stderr:last_changed 0.000000 2024-09-14T11:40:42.166 INFO:tasks.workunit.client.0.smithi138.stderr:created 0.000000 2024-09-14T11:40:42.166 INFO:tasks.workunit.client.0.smithi138.stderr:min_mon_release 0 (unknown) 2024-09-14T11:40:42.166 INFO:tasks.workunit.client.0.smithi138.stderr:election_strategy: 1 2024-09-14T11:40:42.166 INFO:tasks.workunit.client.0.smithi138.stderr:0: [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] mon.noname-a 2024-09-14T11:40:42.166 INFO:tasks.workunit.client.0.smithi138.stderr:1: [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] mon.noname-b 2024-09-14T11:40:42.167 INFO:tasks.workunit.client.0.smithi138.stderr:2: [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] mon.noname-c 2024-09-14T11:40:42.167 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-14T11:40:42.167 INFO:tasks.workunit.client.0.smithi138.stderr: -484> 2024-09-14T11:40:41.387+0000 7efc0c3fa9c0 5 AuthRegistry(0x55fa6a60aa10) adding auth protocol: cephx 2024-09-14T11:40:42.167 INFO:tasks.workunit.client.0.smithi138.stderr: -483> 2024-09-14T11:40:41.387+0000 7efc0c3fa9c0 5 AuthRegistry(0x55fa6a60aa10) adding auth protocol: cephx 2024-09-14T11:40:42.167 INFO:tasks.workunit.client.0.smithi138.stderr: -482> 2024-09-14T11:40:41.387+0000 7efc0c3fa9c0 5 AuthRegistry(0x55fa6a60aa10) adding auth protocol: cephx 2024-09-14T11:40:42.167 INFO:tasks.workunit.client.0.smithi138.stderr: -481> 2024-09-14T11:40:41.387+0000 7efc0c3fa9c0 5 AuthRegistry(0x55fa6a60aa10) adding con mode: secure 2024-09-14T11:40:42.167 INFO:tasks.workunit.client.0.smithi138.stderr: -480> 2024-09-14T11:40:41.387+0000 7efc0c3fa9c0 5 AuthRegistry(0x55fa6a60aa10) adding con mode: crc 2024-09-14T11:40:42.167 INFO:tasks.workunit.client.0.smithi138.stderr: -479> 2024-09-14T11:40:41.387+0000 7efc0c3fa9c0 5 AuthRegistry(0x55fa6a60aa10) adding con mode: secure 2024-09-14T11:40:42.167 INFO:tasks.workunit.client.0.smithi138.stderr: -478> 2024-09-14T11:40:41.387+0000 7efc0c3fa9c0 5 AuthRegistry(0x55fa6a60aa10) adding con mode: crc 2024-09-14T11:40:42.167 INFO:tasks.workunit.client.0.smithi138.stderr: -477> 2024-09-14T11:40:41.387+0000 7efc0c3fa9c0 5 AuthRegistry(0x55fa6a60aa10) adding con mode: secure 2024-09-14T11:40:42.167 INFO:tasks.workunit.client.0.smithi138.stderr: -476> 2024-09-14T11:40:41.387+0000 7efc0c3fa9c0 5 AuthRegistry(0x55fa6a60aa10) adding con mode: crc 2024-09-14T11:40:42.167 INFO:tasks.workunit.client.0.smithi138.stderr: -475> 2024-09-14T11:40:41.387+0000 7efc0c3fa9c0 5 AuthRegistry(0x55fa6a60aa10) adding con mode: crc 2024-09-14T11:40:42.167 INFO:tasks.workunit.client.0.smithi138.stderr: -474> 2024-09-14T11:40:41.387+0000 7efc0c3fa9c0 5 AuthRegistry(0x55fa6a60aa10) adding con mode: secure 2024-09-14T11:40:42.168 INFO:tasks.workunit.client.0.smithi138.stderr: -473> 2024-09-14T11:40:41.387+0000 7efc0c3fa9c0 5 AuthRegistry(0x55fa6a60aa10) adding con mode: crc 2024-09-14T11:40:42.168 INFO:tasks.workunit.client.0.smithi138.stderr: -472> 2024-09-14T11:40:41.387+0000 7efc0c3fa9c0 5 AuthRegistry(0x55fa6a60aa10) adding con mode: secure 2024-09-14T11:40:42.168 INFO:tasks.workunit.client.0.smithi138.stderr: -471> 2024-09-14T11:40:41.387+0000 7efc0c3fa9c0 5 AuthRegistry(0x55fa6a60aa10) adding con mode: crc 2024-09-14T11:40:42.168 INFO:tasks.workunit.client.0.smithi138.stderr: -470> 2024-09-14T11:40:41.387+0000 7efc0c3fa9c0 5 AuthRegistry(0x55fa6a60aa10) adding con mode: secure 2024-09-14T11:40:42.168 INFO:tasks.workunit.client.0.smithi138.stderr: -469> 2024-09-14T11:40:41.387+0000 7efc0c3fa9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:40:42.168 INFO:tasks.workunit.client.0.smithi138.stderr: -468> 2024-09-14T11:40:41.387+0000 7efc0c3fa9c0 1 librados: starting msgr at 2024-09-14T11:40:42.168 INFO:tasks.workunit.client.0.smithi138.stderr: -467> 2024-09-14T11:40:41.387+0000 7efc0c3fa9c0 1 librados: starting objecter 2024-09-14T11:40:42.168 INFO:tasks.workunit.client.0.smithi138.stderr: -466> 2024-09-14T11:40:41.387+0000 7efc0c3fa9c0 5 asok(0x55fa6a3d0d90) register_command objecter_requests hook 0x55fa6a60f5e0 2024-09-14T11:40:42.168 INFO:tasks.workunit.client.0.smithi138.stderr: -465> 2024-09-14T11:40:41.387+0000 7efc0c3fa9c0 1 librados: setting wanted keys 2024-09-14T11:40:42.168 INFO:tasks.workunit.client.0.smithi138.stderr: -464> 2024-09-14T11:40:41.387+0000 7efc0c3fa9c0 1 librados: calling monclient init 2024-09-14T11:40:42.168 INFO:tasks.workunit.client.0.smithi138.stderr: -463> 2024-09-14T11:40:41.387+0000 7efc0c3fa9c0 10 monclient: init 2024-09-14T11:40:42.168 INFO:tasks.workunit.client.0.smithi138.stderr: -462> 2024-09-14T11:40:41.387+0000 7efc0c3fa9c0 5 AuthRegistry(0x55fa6a5de200) adding auth protocol: cephx 2024-09-14T11:40:42.168 INFO:tasks.workunit.client.0.smithi138.stderr: -461> 2024-09-14T11:40:41.387+0000 7efc0c3fa9c0 5 AuthRegistry(0x55fa6a5de200) adding auth protocol: cephx 2024-09-14T11:40:42.169 INFO:tasks.workunit.client.0.smithi138.stderr: -460> 2024-09-14T11:40:41.387+0000 7efc0c3fa9c0 5 AuthRegistry(0x55fa6a5de200) adding auth protocol: cephx 2024-09-14T11:40:42.169 INFO:tasks.workunit.client.0.smithi138.stderr: -459> 2024-09-14T11:40:41.387+0000 7efc0c3fa9c0 5 AuthRegistry(0x55fa6a5de200) adding con mode: secure 2024-09-14T11:40:42.169 INFO:tasks.workunit.client.0.smithi138.stderr: -458> 2024-09-14T11:40:41.387+0000 7efc0c3fa9c0 5 AuthRegistry(0x55fa6a5de200) adding con mode: crc 2024-09-14T11:40:42.169 INFO:tasks.workunit.client.0.smithi138.stderr: -457> 2024-09-14T11:40:41.387+0000 7efc0c3fa9c0 5 AuthRegistry(0x55fa6a5de200) adding con mode: secure 2024-09-14T11:40:42.169 INFO:tasks.workunit.client.0.smithi138.stderr: -456> 2024-09-14T11:40:41.387+0000 7efc0c3fa9c0 5 AuthRegistry(0x55fa6a5de200) adding con mode: crc 2024-09-14T11:40:42.169 INFO:tasks.workunit.client.0.smithi138.stderr: -455> 2024-09-14T11:40:41.387+0000 7efc0c3fa9c0 5 AuthRegistry(0x55fa6a5de200) adding con mode: secure 2024-09-14T11:40:42.169 INFO:tasks.workunit.client.0.smithi138.stderr: -454> 2024-09-14T11:40:41.387+0000 7efc0c3fa9c0 5 AuthRegistry(0x55fa6a5de200) adding con mode: crc 2024-09-14T11:40:42.169 INFO:tasks.workunit.client.0.smithi138.stderr: -453> 2024-09-14T11:40:41.387+0000 7efc0c3fa9c0 5 AuthRegistry(0x55fa6a5de200) adding con mode: crc 2024-09-14T11:40:42.169 INFO:tasks.workunit.client.0.smithi138.stderr: -452> 2024-09-14T11:40:41.387+0000 7efc0c3fa9c0 5 AuthRegistry(0x55fa6a5de200) adding con mode: secure 2024-09-14T11:40:42.169 INFO:tasks.workunit.client.0.smithi138.stderr: -451> 2024-09-14T11:40:41.387+0000 7efc0c3fa9c0 5 AuthRegistry(0x55fa6a5de200) adding con mode: crc 2024-09-14T11:40:42.169 INFO:tasks.workunit.client.0.smithi138.stderr: -450> 2024-09-14T11:40:41.387+0000 7efc0c3fa9c0 5 AuthRegistry(0x55fa6a5de200) adding con mode: secure 2024-09-14T11:40:42.169 INFO:tasks.workunit.client.0.smithi138.stderr: -449> 2024-09-14T11:40:41.387+0000 7efc0c3fa9c0 5 AuthRegistry(0x55fa6a5de200) adding con mode: crc 2024-09-14T11:40:42.169 INFO:tasks.workunit.client.0.smithi138.stderr: -448> 2024-09-14T11:40:41.387+0000 7efc0c3fa9c0 5 AuthRegistry(0x55fa6a5de200) adding con mode: secure 2024-09-14T11:40:42.170 INFO:tasks.workunit.client.0.smithi138.stderr: -447> 2024-09-14T11:40:41.387+0000 7efc0c3fa9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:40:42.170 INFO:tasks.workunit.client.0.smithi138.stderr: -446> 2024-09-14T11:40:41.387+0000 7efc0c3fa9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:40:42.170 INFO:tasks.workunit.client.0.smithi138.stderr: -445> 2024-09-14T11:40:41.387+0000 7efc0c3fa9c0 5 asok(0x55fa6a3d0d90) register_command rotate-key hook 0x55fa6a5de348 2024-09-14T11:40:42.170 INFO:tasks.workunit.client.0.smithi138.stderr: -444> 2024-09-14T11:40:41.387+0000 7efc0c3fa9c0 10 monclient: _reopen_session rank -1 2024-09-14T11:40:42.170 INFO:tasks.workunit.client.0.smithi138.stderr: -443> 2024-09-14T11:40:41.387+0000 7efc0c3fa9c0 10 monclient: _add_conns ranks=[2,0,1] 2024-09-14T11:40:42.170 INFO:tasks.workunit.client.0.smithi138.stderr: -442> 2024-09-14T11:40:41.387+0000 7efc0c3fa9c0 10 monclient(hunting): picked mon.noname-c con 0x55fa6a48e5b0 addr [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] 2024-09-14T11:40:42.170 INFO:tasks.workunit.client.0.smithi138.stderr: -441> 2024-09-14T11:40:41.387+0000 7efc0c3fa9c0 10 monclient(hunting): picked mon.noname-a con 0x55fa6a499880 addr [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] 2024-09-14T11:40:42.170 INFO:tasks.workunit.client.0.smithi138.stderr: -440> 2024-09-14T11:40:41.387+0000 7efc0c3fa9c0 10 monclient(hunting): picked mon.noname-b con 0x55fa6a49a6e0 addr [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] 2024-09-14T11:40:42.170 INFO:tasks.workunit.client.0.smithi138.stderr: -439> 2024-09-14T11:40:41.387+0000 7efc0c3fa9c0 10 monclient(hunting): start opening mon connection 2024-09-14T11:40:42.170 INFO:tasks.workunit.client.0.smithi138.stderr: -438> 2024-09-14T11:40:41.387+0000 7efc0c3fa9c0 10 monclient(hunting): start opening mon connection 2024-09-14T11:40:42.170 INFO:tasks.workunit.client.0.smithi138.stderr: -437> 2024-09-14T11:40:41.387+0000 7efc0c3fa9c0 10 monclient(hunting): start opening mon connection 2024-09-14T11:40:42.170 INFO:tasks.workunit.client.0.smithi138.stderr: -436> 2024-09-14T11:40:41.387+0000 7efc0c3fa9c0 10 monclient(hunting): _renew_subs 2024-09-14T11:40:42.170 INFO:tasks.workunit.client.0.smithi138.stderr: -435> 2024-09-14T11:40:41.387+0000 7efc0c3fa9c0 10 monclient(hunting): authenticate will time out at 2977.351038s 2024-09-14T11:40:42.170 INFO:tasks.workunit.client.0.smithi138.stderr: -434> 2024-09-14T11:40:41.387+0000 7efc096ff640 10 monclient(hunting): get_auth_request con 0x55fa6a499880 auth_method 0 2024-09-14T11:40:42.171 INFO:tasks.workunit.client.0.smithi138.stderr: -433> 2024-09-14T11:40:41.387+0000 7efc096ff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:40:42.171 INFO:tasks.workunit.client.0.smithi138.stderr: -432> 2024-09-14T11:40:41.387+0000 7efc096ff640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:40:42.171 INFO:tasks.workunit.client.0.smithi138.stderr: -431> 2024-09-14T11:40:41.387+0000 7efc096ff640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:40:42.171 INFO:tasks.workunit.client.0.smithi138.stderr: -430> 2024-09-14T11:40:41.387+0000 7efc09f00640 10 monclient(hunting): get_auth_request con 0x55fa6a48e5b0 auth_method 0 2024-09-14T11:40:42.171 INFO:tasks.workunit.client.0.smithi138.stderr: -429> 2024-09-14T11:40:41.387+0000 7efc09f00640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:40:42.171 INFO:tasks.workunit.client.0.smithi138.stderr: -428> 2024-09-14T11:40:41.387+0000 7efc09f00640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:40:42.171 INFO:tasks.workunit.client.0.smithi138.stderr: -427> 2024-09-14T11:40:41.387+0000 7efc09f00640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:40:42.171 INFO:tasks.workunit.client.0.smithi138.stderr: -426> 2024-09-14T11:40:41.387+0000 7efc096ff640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:40:42.171 INFO:tasks.workunit.client.0.smithi138.stderr: -425> 2024-09-14T11:40:41.387+0000 7efc096ff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:40:42.171 INFO:tasks.workunit.client.0.smithi138.stderr: -424> 2024-09-14T11:40:41.387+0000 7efc096ff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:40:42.171 INFO:tasks.workunit.client.0.smithi138.stderr: -423> 2024-09-14T11:40:41.387+0000 7efc09f00640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:40:42.171 INFO:tasks.workunit.client.0.smithi138.stderr: -422> 2024-09-14T11:40:41.387+0000 7efc09f00640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:40:42.171 INFO:tasks.workunit.client.0.smithi138.stderr: -421> 2024-09-14T11:40:41.387+0000 7efc09f00640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:40:42.171 INFO:tasks.workunit.client.0.smithi138.stderr: -420> 2024-09-14T11:40:41.387+0000 7efc096ff640 10 monclient(hunting): handle_auth_done global_id 8196 payload 824 2024-09-14T11:40:42.172 INFO:tasks.workunit.client.0.smithi138.stderr: -419> 2024-09-14T11:40:41.387+0000 7efc096ff640 10 monclient: _finish_hunting 0 2024-09-14T11:40:42.172 INFO:tasks.workunit.client.0.smithi138.stderr: -418> 2024-09-14T11:40:41.387+0000 7efc096ff640 1 monclient: found mon.noname-a 2024-09-14T11:40:42.172 INFO:tasks.workunit.client.0.smithi138.stderr: -417> 2024-09-14T11:40:41.387+0000 7efc096ff640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.138:3300/0 2024-09-14T11:40:42.172 INFO:tasks.workunit.client.0.smithi138.stderr: -416> 2024-09-14T11:40:41.387+0000 7efaf6604640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:40:42.172 INFO:tasks.workunit.client.0.smithi138.stderr: -415> 2024-09-14T11:40:41.387+0000 7efaf6604640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-14T11:40:42.172 INFO:tasks.workunit.client.0.smithi138.stderr: -414> 2024-09-14T11:40:41.387+0000 7efaf6604640 10 monclient: dump: 2024-09-14T11:40:42.172 INFO:tasks.workunit.client.0.smithi138.stderr:epoch 1 2024-09-14T11:40:42.172 INFO:tasks.workunit.client.0.smithi138.stderr:fsid 3f225f43-83a6-4aeb-b798-1f04bb49d597 2024-09-14T11:40:42.172 INFO:tasks.workunit.client.0.smithi138.stderr:last_changed 2024-09-14T11:07:09.252780+0000 2024-09-14T11:40:42.172 INFO:tasks.workunit.client.0.smithi138.stderr:created 2024-09-14T11:07:09.252780+0000 2024-09-14T11:40:42.172 INFO:tasks.workunit.client.0.smithi138.stderr:min_mon_release 19 (squid) 2024-09-14T11:40:42.172 INFO:tasks.workunit.client.0.smithi138.stderr:election_strategy: 1 2024-09-14T11:40:42.172 INFO:tasks.workunit.client.0.smithi138.stderr:0: [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] mon.a 2024-09-14T11:40:42.172 INFO:tasks.workunit.client.0.smithi138.stderr:1: [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] mon.b 2024-09-14T11:40:42.173 INFO:tasks.workunit.client.0.smithi138.stderr:2: [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] mon.c 2024-09-14T11:40:42.173 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-14T11:40:42.173 INFO:tasks.workunit.client.0.smithi138.stderr: -413> 2024-09-14T11:40:41.387+0000 7efaf6604640 10 monclient: _finish_auth 0 2024-09-14T11:40:42.173 INFO:tasks.workunit.client.0.smithi138.stderr: -412> 2024-09-14T11:40:41.387+0000 7efaf6604640 10 monclient: _check_auth_tickets 2024-09-14T11:40:42.173 INFO:tasks.workunit.client.0.smithi138.stderr: -411> 2024-09-14T11:40:41.387+0000 7efaf6604640 10 monclient: handle_config config(0 keys) 2024-09-14T11:40:42.173 INFO:tasks.workunit.client.0.smithi138.stderr: -410> 2024-09-14T11:40:41.387+0000 7efaf6604640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:40:42.173 INFO:tasks.workunit.client.0.smithi138.stderr: -409> 2024-09-14T11:40:41.387+0000 7efaf6604640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-14T11:40:42.173 INFO:tasks.workunit.client.0.smithi138.stderr: -408> 2024-09-14T11:40:41.387+0000 7efaf6604640 10 monclient: dump: 2024-09-14T11:40:42.173 INFO:tasks.workunit.client.0.smithi138.stderr:epoch 1 2024-09-14T11:40:42.173 INFO:tasks.workunit.client.0.smithi138.stderr:fsid 3f225f43-83a6-4aeb-b798-1f04bb49d597 2024-09-14T11:40:42.173 INFO:tasks.workunit.client.0.smithi138.stderr:last_changed 2024-09-14T11:07:09.252780+0000 2024-09-14T11:40:42.173 INFO:tasks.workunit.client.0.smithi138.stderr:created 2024-09-14T11:07:09.252780+0000 2024-09-14T11:40:42.173 INFO:tasks.workunit.client.0.smithi138.stderr:min_mon_release 19 (squid) 2024-09-14T11:40:42.174 INFO:tasks.workunit.client.0.smithi138.stderr:election_strategy: 1 2024-09-14T11:40:42.174 INFO:tasks.workunit.client.0.smithi138.stderr:0: [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] mon.a 2024-09-14T11:40:42.174 INFO:tasks.workunit.client.0.smithi138.stderr:1: [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] mon.b 2024-09-14T11:40:42.174 INFO:tasks.workunit.client.0.smithi138.stderr:2: [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] mon.c 2024-09-14T11:40:42.174 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-14T11:40:42.174 INFO:tasks.workunit.client.0.smithi138.stderr: -407> 2024-09-14T11:40:41.387+0000 7efaf7e07640 4 set_mon_vals no callback set 2024-09-14T11:40:42.174 INFO:tasks.workunit.client.0.smithi138.stderr: -406> 2024-09-14T11:40:41.391+0000 7efc0c3fa9c0 5 monclient: authenticate success, global_id 8196 2024-09-14T11:40:42.174 INFO:tasks.workunit.client.0.smithi138.stderr: -405> 2024-09-14T11:40:41.391+0000 7efc0c3fa9c0 10 monclient: _renew_subs 2024-09-14T11:40:42.174 INFO:tasks.workunit.client.0.smithi138.stderr: -404> 2024-09-14T11:40:41.391+0000 7efc0c3fa9c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.138:3300/0 2024-09-14T11:40:42.174 INFO:tasks.workunit.client.0.smithi138.stderr: -403> 2024-09-14T11:40:41.391+0000 7efc0c3fa9c0 10 monclient: _renew_subs 2024-09-14T11:40:42.174 INFO:tasks.workunit.client.0.smithi138.stderr: -402> 2024-09-14T11:40:41.391+0000 7efc0c3fa9c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.138:3300/0 2024-09-14T11:40:42.174 INFO:tasks.workunit.client.0.smithi138.stderr: -401> 2024-09-14T11:40:41.391+0000 7efc0c3fa9c0 1 librados: init done 2024-09-14T11:40:42.174 INFO:tasks.workunit.client.0.smithi138.stderr: -400> 2024-09-14T11:40:41.391+0000 7efaf6604640 4 mgrc handle_mgr_map Got map version 5 2024-09-14T11:40:42.174 INFO:tasks.workunit.client.0.smithi138.stderr: -399> 2024-09-14T11:40:41.391+0000 7efaf6604640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.138:6832/3778043143,v1:172.21.15.138:6833/3778043143] 2024-09-14T11:40:42.175 INFO:tasks.workunit.client.0.smithi138.stderr: -398> 2024-09-14T11:40:41.391+0000 7efaf6604640 4 mgrc reconnect Starting new session with [v2:172.21.15.138:6832/3778043143,v1:172.21.15.138:6833/3778043143] 2024-09-14T11:40:42.175 INFO:tasks.workunit.client.0.smithi138.stderr: -397> 2024-09-14T11:40:41.391+0000 7efc09f00640 10 monclient: get_auth_request con 0x7efaf00718d0 auth_method 0 2024-09-14T11:40:42.175 INFO:tasks.workunit.client.0.smithi138.stderr: -396> 2024-09-14T11:40:41.391+0000 7efc0a701640 10 monclient: get_auth_request con 0x55fa6a609730 auth_method 0 2024-09-14T11:40:42.175 INFO:tasks.workunit.client.0.smithi138.stderr: -395> 2024-09-14T11:40:41.595+0000 7efc09f00640 10 monclient: get_auth_request con 0x55fa6a628f50 auth_method 0 2024-09-14T11:40:42.175 INFO:tasks.workunit.client.0.smithi138.stderr: -394> 2024-09-14T11:40:41.595+0000 7efc096ff640 10 monclient: get_auth_request con 0x55fa6a62d190 auth_method 0 2024-09-14T11:40:42.175 INFO:tasks.workunit.client.0.smithi138.stderr: -393> 2024-09-14T11:40:41.599+0000 7efc0a701640 10 monclient: get_auth_request con 0x55fa6a62c7e0 auth_method 0 2024-09-14T11:40:42.175 INFO:tasks.workunit.client.0.smithi138.stderr: -392> 2024-09-14T11:40:41.603+0000 7efc0c3fa9c0 10 monclient: build_initial_monmap 2024-09-14T11:40:42.175 INFO:tasks.workunit.client.0.smithi138.stderr: -391> 2024-09-14T11:40:41.603+0000 7efc0c3fa9c0 1 build_initial for_mkfs: 0 2024-09-14T11:40:42.175 INFO:tasks.workunit.client.0.smithi138.stderr: -390> 2024-09-14T11:40:41.603+0000 7efc0c3fa9c0 10 monclient: monmap: 2024-09-14T11:40:42.175 INFO:tasks.workunit.client.0.smithi138.stderr:epoch 0 2024-09-14T11:40:42.175 INFO:tasks.workunit.client.0.smithi138.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-14T11:40:42.175 INFO:tasks.workunit.client.0.smithi138.stderr:last_changed 0.000000 2024-09-14T11:40:42.175 INFO:tasks.workunit.client.0.smithi138.stderr:created 0.000000 2024-09-14T11:40:42.175 INFO:tasks.workunit.client.0.smithi138.stderr:min_mon_release 0 (unknown) 2024-09-14T11:40:42.176 INFO:tasks.workunit.client.0.smithi138.stderr:election_strategy: 1 2024-09-14T11:40:42.176 INFO:tasks.workunit.client.0.smithi138.stderr:0: [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] mon.noname-a 2024-09-14T11:40:42.176 INFO:tasks.workunit.client.0.smithi138.stderr:1: [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] mon.noname-b 2024-09-14T11:40:42.176 INFO:tasks.workunit.client.0.smithi138.stderr:2: [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] mon.noname-c 2024-09-14T11:40:42.176 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-14T11:40:42.176 INFO:tasks.workunit.client.0.smithi138.stderr: -389> 2024-09-14T11:40:41.603+0000 7efc0c3fa9c0 5 AuthRegistry(0x55fa6a635260) adding auth protocol: cephx 2024-09-14T11:40:42.176 INFO:tasks.workunit.client.0.smithi138.stderr: -388> 2024-09-14T11:40:41.603+0000 7efc0c3fa9c0 5 AuthRegistry(0x55fa6a635260) adding auth protocol: cephx 2024-09-14T11:40:42.176 INFO:tasks.workunit.client.0.smithi138.stderr: -387> 2024-09-14T11:40:41.603+0000 7efc0c3fa9c0 5 AuthRegistry(0x55fa6a635260) adding auth protocol: cephx 2024-09-14T11:40:42.176 INFO:tasks.workunit.client.0.smithi138.stderr: -386> 2024-09-14T11:40:41.603+0000 7efc0c3fa9c0 5 AuthRegistry(0x55fa6a635260) adding con mode: secure 2024-09-14T11:40:42.176 INFO:tasks.workunit.client.0.smithi138.stderr: -385> 2024-09-14T11:40:41.603+0000 7efc0c3fa9c0 5 AuthRegistry(0x55fa6a635260) adding con mode: crc 2024-09-14T11:40:42.176 INFO:tasks.workunit.client.0.smithi138.stderr: -384> 2024-09-14T11:40:41.603+0000 7efc0c3fa9c0 5 AuthRegistry(0x55fa6a635260) adding con mode: secure 2024-09-14T11:40:42.176 INFO:tasks.workunit.client.0.smithi138.stderr: -383> 2024-09-14T11:40:41.603+0000 7efc0c3fa9c0 5 AuthRegistry(0x55fa6a635260) adding con mode: crc 2024-09-14T11:40:42.176 INFO:tasks.workunit.client.0.smithi138.stderr: -382> 2024-09-14T11:40:41.603+0000 7efc0c3fa9c0 5 AuthRegistry(0x55fa6a635260) adding con mode: secure 2024-09-14T11:40:42.177 INFO:tasks.workunit.client.0.smithi138.stderr: -381> 2024-09-14T11:40:41.603+0000 7efc0c3fa9c0 5 AuthRegistry(0x55fa6a635260) adding con mode: crc 2024-09-14T11:40:42.177 INFO:tasks.workunit.client.0.smithi138.stderr: -380> 2024-09-14T11:40:41.603+0000 7efc0c3fa9c0 5 AuthRegistry(0x55fa6a635260) adding con mode: crc 2024-09-14T11:40:42.177 INFO:tasks.workunit.client.0.smithi138.stderr: -379> 2024-09-14T11:40:41.603+0000 7efc0c3fa9c0 5 AuthRegistry(0x55fa6a635260) adding con mode: secure 2024-09-14T11:40:42.177 INFO:tasks.workunit.client.0.smithi138.stderr: -378> 2024-09-14T11:40:41.603+0000 7efc0c3fa9c0 5 AuthRegistry(0x55fa6a635260) adding con mode: crc 2024-09-14T11:40:42.177 INFO:tasks.workunit.client.0.smithi138.stderr: -377> 2024-09-14T11:40:41.603+0000 7efc0c3fa9c0 5 AuthRegistry(0x55fa6a635260) adding con mode: secure 2024-09-14T11:40:42.177 INFO:tasks.workunit.client.0.smithi138.stderr: -376> 2024-09-14T11:40:41.603+0000 7efc0c3fa9c0 5 AuthRegistry(0x55fa6a635260) adding con mode: crc 2024-09-14T11:40:42.177 INFO:tasks.workunit.client.0.smithi138.stderr: -375> 2024-09-14T11:40:41.603+0000 7efc0c3fa9c0 5 AuthRegistry(0x55fa6a635260) adding con mode: secure 2024-09-14T11:40:42.177 INFO:tasks.workunit.client.0.smithi138.stderr: -374> 2024-09-14T11:40:41.603+0000 7efc0c3fa9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:40:42.177 INFO:tasks.workunit.client.0.smithi138.stderr: -373> 2024-09-14T11:40:41.603+0000 7efc0c3fa9c0 5 asok(0x55fa6a3d0d90) register_command objecter_requests cmddesc objecter_requests hook 0x55fa6a638bc0 EEXIST 2024-09-14T11:40:42.177 INFO:tasks.workunit.client.0.smithi138.stderr: -372> 2024-09-14T11:40:41.603+0000 7efc0c3fa9c0 10 monclient: init 2024-09-14T11:40:42.177 INFO:tasks.workunit.client.0.smithi138.stderr: -371> 2024-09-14T11:40:41.603+0000 7efc0c3fa9c0 5 AuthRegistry(0x55fa6a6341e8) adding auth protocol: cephx 2024-09-14T11:40:42.177 INFO:tasks.workunit.client.0.smithi138.stderr: -370> 2024-09-14T11:40:41.603+0000 7efc0c3fa9c0 5 AuthRegistry(0x55fa6a6341e8) adding auth protocol: cephx 2024-09-14T11:40:42.178 INFO:tasks.workunit.client.0.smithi138.stderr: -369> 2024-09-14T11:40:41.603+0000 7efc0c3fa9c0 5 AuthRegistry(0x55fa6a6341e8) adding auth protocol: cephx 2024-09-14T11:40:42.178 INFO:tasks.workunit.client.0.smithi138.stderr: -368> 2024-09-14T11:40:41.603+0000 7efc0c3fa9c0 5 AuthRegistry(0x55fa6a6341e8) adding con mode: secure 2024-09-14T11:40:42.178 INFO:tasks.workunit.client.0.smithi138.stderr: -367> 2024-09-14T11:40:41.603+0000 7efc0c3fa9c0 5 AuthRegistry(0x55fa6a6341e8) adding con mode: crc 2024-09-14T11:40:42.178 INFO:tasks.workunit.client.0.smithi138.stderr: -366> 2024-09-14T11:40:41.603+0000 7efc0c3fa9c0 5 AuthRegistry(0x55fa6a6341e8) adding con mode: secure 2024-09-14T11:40:42.178 INFO:tasks.workunit.client.0.smithi138.stderr: -365> 2024-09-14T11:40:41.603+0000 7efc0c3fa9c0 5 AuthRegistry(0x55fa6a6341e8) adding con mode: crc 2024-09-14T11:40:42.178 INFO:tasks.workunit.client.0.smithi138.stderr: -364> 2024-09-14T11:40:41.603+0000 7efc0c3fa9c0 5 AuthRegistry(0x55fa6a6341e8) adding con mode: secure 2024-09-14T11:40:42.178 INFO:tasks.workunit.client.0.smithi138.stderr: -363> 2024-09-14T11:40:41.603+0000 7efc0c3fa9c0 5 AuthRegistry(0x55fa6a6341e8) adding con mode: crc 2024-09-14T11:40:42.178 INFO:tasks.workunit.client.0.smithi138.stderr: -362> 2024-09-14T11:40:41.603+0000 7efc0c3fa9c0 5 AuthRegistry(0x55fa6a6341e8) adding con mode: crc 2024-09-14T11:40:42.178 INFO:tasks.workunit.client.0.smithi138.stderr: -361> 2024-09-14T11:40:41.603+0000 7efc0c3fa9c0 5 AuthRegistry(0x55fa6a6341e8) adding con mode: secure 2024-09-14T11:40:42.178 INFO:tasks.workunit.client.0.smithi138.stderr: -360> 2024-09-14T11:40:41.603+0000 7efc0c3fa9c0 5 AuthRegistry(0x55fa6a6341e8) adding con mode: crc 2024-09-14T11:40:42.178 INFO:tasks.workunit.client.0.smithi138.stderr: -359> 2024-09-14T11:40:41.603+0000 7efc0c3fa9c0 5 AuthRegistry(0x55fa6a6341e8) adding con mode: secure 2024-09-14T11:40:42.178 INFO:tasks.workunit.client.0.smithi138.stderr: -358> 2024-09-14T11:40:41.603+0000 7efc0c3fa9c0 5 AuthRegistry(0x55fa6a6341e8) adding con mode: crc 2024-09-14T11:40:42.178 INFO:tasks.workunit.client.0.smithi138.stderr: -357> 2024-09-14T11:40:41.603+0000 7efc0c3fa9c0 5 AuthRegistry(0x55fa6a6341e8) adding con mode: secure 2024-09-14T11:40:42.178 INFO:tasks.workunit.client.0.smithi138.stderr: -356> 2024-09-14T11:40:41.603+0000 7efc0c3fa9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:40:42.179 INFO:tasks.workunit.client.0.smithi138.stderr: -355> 2024-09-14T11:40:41.603+0000 7efc0c3fa9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:40:42.179 INFO:tasks.workunit.client.0.smithi138.stderr: -354> 2024-09-14T11:40:41.603+0000 7efc0c3fa9c0 5 asok(0x55fa6a3d0d90) register_command rotate-key cmddesc rotate-key hook 0x55fa6a634330 EEXIST 2024-09-14T11:40:42.179 INFO:tasks.workunit.client.0.smithi138.stderr: -353> 2024-09-14T11:40:41.603+0000 7efc0c3fa9c0 10 monclient: _reopen_session rank -1 2024-09-14T11:40:42.179 INFO:tasks.workunit.client.0.smithi138.stderr: -352> 2024-09-14T11:40:41.603+0000 7efc0c3fa9c0 10 monclient: _add_conns ranks=[0,2,1] 2024-09-14T11:40:42.179 INFO:tasks.workunit.client.0.smithi138.stderr: -351> 2024-09-14T11:40:41.603+0000 7efc0c3fa9c0 10 monclient(hunting): picked mon.noname-a con 0x55fa6a65cd70 addr [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] 2024-09-14T11:40:42.179 INFO:tasks.workunit.client.0.smithi138.stderr: -350> 2024-09-14T11:40:41.603+0000 7efc0c3fa9c0 10 monclient(hunting): picked mon.noname-c con 0x55fa6a65c6a0 addr [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] 2024-09-14T11:40:42.179 INFO:tasks.workunit.client.0.smithi138.stderr: -349> 2024-09-14T11:40:41.603+0000 7efc0c3fa9c0 10 monclient(hunting): picked mon.noname-b con 0x55fa6a65b080 addr [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] 2024-09-14T11:40:42.179 INFO:tasks.workunit.client.0.smithi138.stderr: -348> 2024-09-14T11:40:41.603+0000 7efc0c3fa9c0 10 monclient(hunting): start opening mon connection 2024-09-14T11:40:42.179 INFO:tasks.workunit.client.0.smithi138.stderr: -347> 2024-09-14T11:40:41.603+0000 7efc0c3fa9c0 10 monclient(hunting): start opening mon connection 2024-09-14T11:40:42.179 INFO:tasks.workunit.client.0.smithi138.stderr: -346> 2024-09-14T11:40:41.603+0000 7efc0c3fa9c0 10 monclient(hunting): start opening mon connection 2024-09-14T11:40:42.179 INFO:tasks.workunit.client.0.smithi138.stderr: -345> 2024-09-14T11:40:41.603+0000 7efc0c3fa9c0 10 monclient(hunting): _renew_subs 2024-09-14T11:40:42.179 INFO:tasks.workunit.client.0.smithi138.stderr: -344> 2024-09-14T11:40:41.603+0000 7efc0c3fa9c0 10 monclient(hunting): authenticate will time out at 2977.567445s 2024-09-14T11:40:42.179 INFO:tasks.workunit.client.0.smithi138.stderr: -343> 2024-09-14T11:40:41.603+0000 7efc096ff640 10 monclient(hunting): get_auth_request con 0x55fa6a65cd70 auth_method 0 2024-09-14T11:40:42.179 INFO:tasks.workunit.client.0.smithi138.stderr: -342> 2024-09-14T11:40:41.603+0000 7efc096ff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:40:42.180 INFO:tasks.workunit.client.0.smithi138.stderr: -341> 2024-09-14T11:40:41.603+0000 7efc096ff640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:40:42.180 INFO:tasks.workunit.client.0.smithi138.stderr: -340> 2024-09-14T11:40:41.603+0000 7efc096ff640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:40:42.180 INFO:tasks.workunit.client.0.smithi138.stderr: -339> 2024-09-14T11:40:41.603+0000 7efc096ff640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:40:42.180 INFO:tasks.workunit.client.0.smithi138.stderr: -338> 2024-09-14T11:40:41.603+0000 7efc096ff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:40:42.180 INFO:tasks.workunit.client.0.smithi138.stderr: -337> 2024-09-14T11:40:41.603+0000 7efc096ff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:40:42.180 INFO:tasks.workunit.client.0.smithi138.stderr: -336> 2024-09-14T11:40:41.603+0000 7efc0a701640 10 monclient(hunting): get_auth_request con 0x55fa6a65c6a0 auth_method 0 2024-09-14T11:40:42.180 INFO:tasks.workunit.client.0.smithi138.stderr: -335> 2024-09-14T11:40:41.603+0000 7efc0a701640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:40:42.180 INFO:tasks.workunit.client.0.smithi138.stderr: -334> 2024-09-14T11:40:41.603+0000 7efc0a701640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:40:42.180 INFO:tasks.workunit.client.0.smithi138.stderr: -333> 2024-09-14T11:40:41.603+0000 7efc0a701640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:40:42.180 INFO:tasks.workunit.client.0.smithi138.stderr: -332> 2024-09-14T11:40:41.603+0000 7efc09f00640 10 monclient(hunting): get_auth_request con 0x55fa6a65b080 auth_method 0 2024-09-14T11:40:42.180 INFO:tasks.workunit.client.0.smithi138.stderr: -331> 2024-09-14T11:40:41.603+0000 7efc09f00640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:40:42.180 INFO:tasks.workunit.client.0.smithi138.stderr: -330> 2024-09-14T11:40:41.603+0000 7efc09f00640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:40:42.180 INFO:tasks.workunit.client.0.smithi138.stderr: -329> 2024-09-14T11:40:41.603+0000 7efc09f00640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:40:42.180 INFO:tasks.workunit.client.0.smithi138.stderr: -328> 2024-09-14T11:40:41.607+0000 7efc0a701640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:40:42.181 INFO:tasks.workunit.client.0.smithi138.stderr: -327> 2024-09-14T11:40:41.607+0000 7efc0a701640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:40:42.181 INFO:tasks.workunit.client.0.smithi138.stderr: -326> 2024-09-14T11:40:41.607+0000 7efc0a701640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:40:42.181 INFO:tasks.workunit.client.0.smithi138.stderr: -325> 2024-09-14T11:40:41.607+0000 7efc096ff640 10 monclient(hunting): handle_auth_done global_id 8199 payload 824 2024-09-14T11:40:42.181 INFO:tasks.workunit.client.0.smithi138.stderr: -324> 2024-09-14T11:40:41.607+0000 7efc096ff640 10 monclient: _finish_hunting 0 2024-09-14T11:40:42.181 INFO:tasks.workunit.client.0.smithi138.stderr: -323> 2024-09-14T11:40:41.607+0000 7efc096ff640 1 monclient: found mon.noname-a 2024-09-14T11:40:42.181 INFO:tasks.workunit.client.0.smithi138.stderr: -322> 2024-09-14T11:40:41.607+0000 7efc096ff640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.138:3300/0 2024-09-14T11:40:42.181 INFO:tasks.workunit.client.0.smithi138.stderr: -321> 2024-09-14T11:40:41.607+0000 7efaef7fe640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:40:42.181 INFO:tasks.workunit.client.0.smithi138.stderr: -320> 2024-09-14T11:40:41.607+0000 7efaef7fe640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-14T11:40:42.181 INFO:tasks.workunit.client.0.smithi138.stderr: -319> 2024-09-14T11:40:41.607+0000 7efaef7fe640 10 monclient: dump: 2024-09-14T11:40:42.181 INFO:tasks.workunit.client.0.smithi138.stderr:epoch 1 2024-09-14T11:40:42.181 INFO:tasks.workunit.client.0.smithi138.stderr:fsid 3f225f43-83a6-4aeb-b798-1f04bb49d597 2024-09-14T11:40:42.181 INFO:tasks.workunit.client.0.smithi138.stderr:last_changed 2024-09-14T11:07:09.252780+0000 2024-09-14T11:40:42.181 INFO:tasks.workunit.client.0.smithi138.stderr:created 2024-09-14T11:07:09.252780+0000 2024-09-14T11:40:42.182 INFO:tasks.workunit.client.0.smithi138.stderr:min_mon_release 19 (squid) 2024-09-14T11:40:42.182 INFO:tasks.workunit.client.0.smithi138.stderr:election_strategy: 1 2024-09-14T11:40:42.182 INFO:tasks.workunit.client.0.smithi138.stderr:0: [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] mon.a 2024-09-14T11:40:42.182 INFO:tasks.workunit.client.0.smithi138.stderr:1: [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] mon.b 2024-09-14T11:40:42.182 INFO:tasks.workunit.client.0.smithi138.stderr:2: [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] mon.c 2024-09-14T11:40:42.182 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-14T11:40:42.182 INFO:tasks.workunit.client.0.smithi138.stderr: -318> 2024-09-14T11:40:41.607+0000 7efaef7fe640 10 monclient: _finish_auth 0 2024-09-14T11:40:42.182 INFO:tasks.workunit.client.0.smithi138.stderr: -317> 2024-09-14T11:40:41.607+0000 7efaef7fe640 10 monclient: _check_auth_tickets 2024-09-14T11:40:42.182 INFO:tasks.workunit.client.0.smithi138.stderr: -316> 2024-09-14T11:40:41.607+0000 7efaef7fe640 10 monclient: handle_config config(0 keys) 2024-09-14T11:40:42.182 INFO:tasks.workunit.client.0.smithi138.stderr: -315> 2024-09-14T11:40:41.607+0000 7efaef7fe640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:40:42.182 INFO:tasks.workunit.client.0.smithi138.stderr: -314> 2024-09-14T11:40:41.607+0000 7efaef7fe640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-14T11:40:42.182 INFO:tasks.workunit.client.0.smithi138.stderr: -313> 2024-09-14T11:40:41.607+0000 7efaef7fe640 10 monclient: dump: 2024-09-14T11:40:42.182 INFO:tasks.workunit.client.0.smithi138.stderr:epoch 1 2024-09-14T11:40:42.182 INFO:tasks.workunit.client.0.smithi138.stderr:fsid 3f225f43-83a6-4aeb-b798-1f04bb49d597 2024-09-14T11:40:42.183 INFO:tasks.workunit.client.0.smithi138.stderr:last_changed 2024-09-14T11:07:09.252780+0000 2024-09-14T11:40:42.183 INFO:tasks.workunit.client.0.smithi138.stderr:created 2024-09-14T11:07:09.252780+0000 2024-09-14T11:40:42.183 INFO:tasks.workunit.client.0.smithi138.stderr:min_mon_release 19 (squid) 2024-09-14T11:40:42.183 INFO:tasks.workunit.client.0.smithi138.stderr:election_strategy: 1 2024-09-14T11:40:42.183 INFO:tasks.workunit.client.0.smithi138.stderr:0: [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] mon.a 2024-09-14T11:40:42.183 INFO:tasks.workunit.client.0.smithi138.stderr:1: [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] mon.b 2024-09-14T11:40:42.183 INFO:tasks.workunit.client.0.smithi138.stderr:2: [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] mon.c 2024-09-14T11:40:42.183 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-14T11:40:42.183 INFO:tasks.workunit.client.0.smithi138.stderr: -312> 2024-09-14T11:40:41.607+0000 7efc0c3fa9c0 5 monclient: authenticate success, global_id 8199 2024-09-14T11:40:42.183 INFO:tasks.workunit.client.0.smithi138.stderr: -311> 2024-09-14T11:40:41.607+0000 7efc0af02640 4 set_mon_vals no callback set 2024-09-14T11:40:42.183 INFO:tasks.workunit.client.0.smithi138.stderr: -310> 2024-09-14T11:40:41.607+0000 7efc0c3fa9c0 10 monclient: _renew_subs 2024-09-14T11:40:42.183 INFO:tasks.workunit.client.0.smithi138.stderr: -309> 2024-09-14T11:40:41.607+0000 7efc0c3fa9c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.138:3300/0 2024-09-14T11:40:42.183 INFO:tasks.workunit.client.0.smithi138.stderr: -308> 2024-09-14T11:40:41.607+0000 7efc0c3fa9c0 10 monclient: _renew_subs 2024-09-14T11:40:42.183 INFO:tasks.workunit.client.0.smithi138.stderr: -307> 2024-09-14T11:40:41.607+0000 7efc0c3fa9c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.138:3300/0 2024-09-14T11:40:42.184 INFO:tasks.workunit.client.0.smithi138.stderr: -306> 2024-09-14T11:40:41.607+0000 7efaef7fe640 4 mgrc handle_mgr_map Got map version 5 2024-09-14T11:40:42.184 INFO:tasks.workunit.client.0.smithi138.stderr: -305> 2024-09-14T11:40:41.607+0000 7efaef7fe640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.138:6832/3778043143,v1:172.21.15.138:6833/3778043143] 2024-09-14T11:40:42.184 INFO:tasks.workunit.client.0.smithi138.stderr: -304> 2024-09-14T11:40:41.607+0000 7efaef7fe640 4 mgrc reconnect Starting new session with [v2:172.21.15.138:6832/3778043143,v1:172.21.15.138:6833/3778043143] 2024-09-14T11:40:42.184 INFO:tasks.workunit.client.0.smithi138.stderr: -303> 2024-09-14T11:40:41.607+0000 7efc0a701640 10 monclient: get_auth_request con 0x7efae40717e0 auth_method 0 2024-09-14T11:40:42.184 INFO:tasks.workunit.client.0.smithi138.stderr: -302> 2024-09-14T11:40:41.607+0000 7efc0c3fa9c0 10 monclient: get_monmap_and_config 2024-09-14T11:40:42.184 INFO:tasks.workunit.client.0.smithi138.stderr: -301> 2024-09-14T11:40:41.607+0000 7efc0c3fa9c0 10 monclient: build_initial_monmap 2024-09-14T11:40:42.184 INFO:tasks.workunit.client.0.smithi138.stderr: -300> 2024-09-14T11:40:41.607+0000 7efc0c3fa9c0 1 build_initial for_mkfs: 0 2024-09-14T11:40:42.184 INFO:tasks.workunit.client.0.smithi138.stderr: -299> 2024-09-14T11:40:41.607+0000 7efc0c3fa9c0 10 monclient: monmap: 2024-09-14T11:40:42.184 INFO:tasks.workunit.client.0.smithi138.stderr:epoch 0 2024-09-14T11:40:42.184 INFO:tasks.workunit.client.0.smithi138.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-14T11:40:42.184 INFO:tasks.workunit.client.0.smithi138.stderr:last_changed 0.000000 2024-09-14T11:40:42.184 INFO:tasks.workunit.client.0.smithi138.stderr:created 0.000000 2024-09-14T11:40:42.184 INFO:tasks.workunit.client.0.smithi138.stderr:min_mon_release 0 (unknown) 2024-09-14T11:40:42.184 INFO:tasks.workunit.client.0.smithi138.stderr:election_strategy: 1 2024-09-14T11:40:42.185 INFO:tasks.workunit.client.0.smithi138.stderr:0: [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] mon.noname-a 2024-09-14T11:40:42.185 INFO:tasks.workunit.client.0.smithi138.stderr:1: [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] mon.noname-b 2024-09-14T11:40:42.185 INFO:tasks.workunit.client.0.smithi138.stderr:2: [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] mon.noname-c 2024-09-14T11:40:42.185 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-14T11:40:42.185 INFO:tasks.workunit.client.0.smithi138.stderr: -298> 2024-09-14T11:40:41.607+0000 7efc0c3fa9c0 5 AuthRegistry(0x55fa6a67c5b0) adding auth protocol: cephx 2024-09-14T11:40:42.185 INFO:tasks.workunit.client.0.smithi138.stderr: -297> 2024-09-14T11:40:41.607+0000 7efc0c3fa9c0 5 AuthRegistry(0x55fa6a67c5b0) adding auth protocol: cephx 2024-09-14T11:40:42.185 INFO:tasks.workunit.client.0.smithi138.stderr: -296> 2024-09-14T11:40:41.607+0000 7efc0c3fa9c0 5 AuthRegistry(0x55fa6a67c5b0) adding auth protocol: cephx 2024-09-14T11:40:42.185 INFO:tasks.workunit.client.0.smithi138.stderr: -295> 2024-09-14T11:40:41.607+0000 7efc0c3fa9c0 5 AuthRegistry(0x55fa6a67c5b0) adding con mode: secure 2024-09-14T11:40:42.185 INFO:tasks.workunit.client.0.smithi138.stderr: -294> 2024-09-14T11:40:41.607+0000 7efc0c3fa9c0 5 AuthRegistry(0x55fa6a67c5b0) adding con mode: crc 2024-09-14T11:40:42.185 INFO:tasks.workunit.client.0.smithi138.stderr: -293> 2024-09-14T11:40:41.607+0000 7efc0c3fa9c0 5 AuthRegistry(0x55fa6a67c5b0) adding con mode: secure 2024-09-14T11:40:42.185 INFO:tasks.workunit.client.0.smithi138.stderr: -292> 2024-09-14T11:40:41.607+0000 7efc0c3fa9c0 5 AuthRegistry(0x55fa6a67c5b0) adding con mode: crc 2024-09-14T11:40:42.185 INFO:tasks.workunit.client.0.smithi138.stderr: -291> 2024-09-14T11:40:41.607+0000 7efc0c3fa9c0 5 AuthRegistry(0x55fa6a67c5b0) adding con mode: secure 2024-09-14T11:40:42.185 INFO:tasks.workunit.client.0.smithi138.stderr: -290> 2024-09-14T11:40:41.607+0000 7efc0c3fa9c0 5 AuthRegistry(0x55fa6a67c5b0) adding con mode: crc 2024-09-14T11:40:42.185 INFO:tasks.workunit.client.0.smithi138.stderr: -289> 2024-09-14T11:40:41.607+0000 7efc0c3fa9c0 5 AuthRegistry(0x55fa6a67c5b0) adding con mode: crc 2024-09-14T11:40:42.186 INFO:tasks.workunit.client.0.smithi138.stderr: -288> 2024-09-14T11:40:41.607+0000 7efc0c3fa9c0 5 AuthRegistry(0x55fa6a67c5b0) adding con mode: secure 2024-09-14T11:40:42.186 INFO:tasks.workunit.client.0.smithi138.stderr: -287> 2024-09-14T11:40:41.607+0000 7efc0c3fa9c0 5 AuthRegistry(0x55fa6a67c5b0) adding con mode: crc 2024-09-14T11:40:42.186 INFO:tasks.workunit.client.0.smithi138.stderr: -286> 2024-09-14T11:40:41.607+0000 7efc0c3fa9c0 5 AuthRegistry(0x55fa6a67c5b0) adding con mode: secure 2024-09-14T11:40:42.186 INFO:tasks.workunit.client.0.smithi138.stderr: -285> 2024-09-14T11:40:41.607+0000 7efc0c3fa9c0 5 AuthRegistry(0x55fa6a67c5b0) adding con mode: crc 2024-09-14T11:40:42.186 INFO:tasks.workunit.client.0.smithi138.stderr: -284> 2024-09-14T11:40:41.607+0000 7efc0c3fa9c0 5 AuthRegistry(0x55fa6a67c5b0) adding con mode: secure 2024-09-14T11:40:42.186 INFO:tasks.workunit.client.0.smithi138.stderr: -283> 2024-09-14T11:40:41.611+0000 7efc0c3fa9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:40:42.186 INFO:tasks.workunit.client.0.smithi138.stderr: -282> 2024-09-14T11:40:41.611+0000 7efc0c3fa9c0 10 monclient: init 2024-09-14T11:40:42.186 INFO:tasks.workunit.client.0.smithi138.stderr: -281> 2024-09-14T11:40:41.611+0000 7efc0c3fa9c0 5 AuthRegistry(0x7ffd9cb6f910) adding auth protocol: cephx 2024-09-14T11:40:42.186 INFO:tasks.workunit.client.0.smithi138.stderr: -280> 2024-09-14T11:40:41.611+0000 7efc0c3fa9c0 5 AuthRegistry(0x7ffd9cb6f910) adding auth protocol: cephx 2024-09-14T11:40:42.186 INFO:tasks.workunit.client.0.smithi138.stderr: -279> 2024-09-14T11:40:41.611+0000 7efc0c3fa9c0 5 AuthRegistry(0x7ffd9cb6f910) adding auth protocol: cephx 2024-09-14T11:40:42.186 INFO:tasks.workunit.client.0.smithi138.stderr: -278> 2024-09-14T11:40:41.611+0000 7efc0c3fa9c0 5 AuthRegistry(0x7ffd9cb6f910) adding con mode: secure 2024-09-14T11:40:42.186 INFO:tasks.workunit.client.0.smithi138.stderr: -277> 2024-09-14T11:40:41.611+0000 7efc0c3fa9c0 5 AuthRegistry(0x7ffd9cb6f910) adding con mode: crc 2024-09-14T11:40:42.186 INFO:tasks.workunit.client.0.smithi138.stderr: -276> 2024-09-14T11:40:41.611+0000 7efc0c3fa9c0 5 AuthRegistry(0x7ffd9cb6f910) adding con mode: secure 2024-09-14T11:40:42.186 INFO:tasks.workunit.client.0.smithi138.stderr: -275> 2024-09-14T11:40:41.611+0000 7efc0c3fa9c0 5 AuthRegistry(0x7ffd9cb6f910) adding con mode: crc 2024-09-14T11:40:42.186 INFO:tasks.workunit.client.0.smithi138.stderr: -274> 2024-09-14T11:40:41.611+0000 7efc0c3fa9c0 5 AuthRegistry(0x7ffd9cb6f910) adding con mode: secure 2024-09-14T11:40:42.187 INFO:tasks.workunit.client.0.smithi138.stderr: -273> 2024-09-14T11:40:41.611+0000 7efc0c3fa9c0 5 AuthRegistry(0x7ffd9cb6f910) adding con mode: crc 2024-09-14T11:40:42.187 INFO:tasks.workunit.client.0.smithi138.stderr: -272> 2024-09-14T11:40:41.611+0000 7efc0c3fa9c0 5 AuthRegistry(0x7ffd9cb6f910) adding con mode: crc 2024-09-14T11:40:42.187 INFO:tasks.workunit.client.0.smithi138.stderr: -271> 2024-09-14T11:40:41.611+0000 7efc0c3fa9c0 5 AuthRegistry(0x7ffd9cb6f910) adding con mode: secure 2024-09-14T11:40:42.187 INFO:tasks.workunit.client.0.smithi138.stderr: -270> 2024-09-14T11:40:41.611+0000 7efc0c3fa9c0 5 AuthRegistry(0x7ffd9cb6f910) adding con mode: crc 2024-09-14T11:40:42.187 INFO:tasks.workunit.client.0.smithi138.stderr: -269> 2024-09-14T11:40:41.611+0000 7efc0c3fa9c0 5 AuthRegistry(0x7ffd9cb6f910) adding con mode: secure 2024-09-14T11:40:42.187 INFO:tasks.workunit.client.0.smithi138.stderr: -268> 2024-09-14T11:40:41.611+0000 7efc0c3fa9c0 5 AuthRegistry(0x7ffd9cb6f910) adding con mode: crc 2024-09-14T11:40:42.187 INFO:tasks.workunit.client.0.smithi138.stderr: -267> 2024-09-14T11:40:41.611+0000 7efc0c3fa9c0 5 AuthRegistry(0x7ffd9cb6f910) adding con mode: secure 2024-09-14T11:40:42.187 INFO:tasks.workunit.client.0.smithi138.stderr: -266> 2024-09-14T11:40:41.611+0000 7efc0c3fa9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:40:42.187 INFO:tasks.workunit.client.0.smithi138.stderr: -265> 2024-09-14T11:40:41.611+0000 7efc0c3fa9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:40:42.187 INFO:tasks.workunit.client.0.smithi138.stderr: -264> 2024-09-14T11:40:41.611+0000 7efc0c3fa9c0 5 asok(0x55fa6a3d0d90) register_command rotate-key cmddesc rotate-key hook 0x7ffd9cb6fa58 EEXIST 2024-09-14T11:40:42.187 INFO:tasks.workunit.client.0.smithi138.stderr: -263> 2024-09-14T11:40:41.611+0000 7efc0c3fa9c0 10 monclient: _reopen_session rank -1 2024-09-14T11:40:42.187 INFO:tasks.workunit.client.0.smithi138.stderr: -262> 2024-09-14T11:40:41.611+0000 7efc0c3fa9c0 10 monclient: _add_conns ranks=[2,1,0] 2024-09-14T11:40:42.187 INFO:tasks.workunit.client.0.smithi138.stderr: -261> 2024-09-14T11:40:41.611+0000 7efc0c3fa9c0 10 monclient(hunting): picked mon.noname-c con 0x55fa6a6b0ab0 addr [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] 2024-09-14T11:40:42.187 INFO:tasks.workunit.client.0.smithi138.stderr: -260> 2024-09-14T11:40:41.611+0000 7efc0c3fa9c0 10 monclient(hunting): picked mon.noname-b con 0x55fa6a6abea0 addr [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] 2024-09-14T11:40:42.187 INFO:tasks.workunit.client.0.smithi138.stderr: -259> 2024-09-14T11:40:41.611+0000 7efc0c3fa9c0 10 monclient(hunting): picked mon.noname-a con 0x55fa6a6ac820 addr [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] 2024-09-14T11:40:42.188 INFO:tasks.workunit.client.0.smithi138.stderr: -258> 2024-09-14T11:40:41.611+0000 7efc0c3fa9c0 10 monclient(hunting): start opening mon connection 2024-09-14T11:40:42.188 INFO:tasks.workunit.client.0.smithi138.stderr: -257> 2024-09-14T11:40:41.611+0000 7efc0c3fa9c0 10 monclient(hunting): start opening mon connection 2024-09-14T11:40:42.188 INFO:tasks.workunit.client.0.smithi138.stderr: -256> 2024-09-14T11:40:41.611+0000 7efc0c3fa9c0 10 monclient(hunting): start opening mon connection 2024-09-14T11:40:42.188 INFO:tasks.workunit.client.0.smithi138.stderr: -255> 2024-09-14T11:40:41.611+0000 7efc0c3fa9c0 10 monclient(hunting): _renew_subs 2024-09-14T11:40:42.188 INFO:tasks.workunit.client.0.smithi138.stderr: -254> 2024-09-14T11:40:41.611+0000 7efc0c3fa9c0 10 monclient(hunting): authenticate will time out at 2977.574393s 2024-09-14T11:40:42.188 INFO:tasks.workunit.client.0.smithi138.stderr: -253> 2024-09-14T11:40:41.611+0000 7efc096ff640 10 monclient(hunting): get_auth_request con 0x55fa6a6b0ab0 auth_method 0 2024-09-14T11:40:42.188 INFO:tasks.workunit.client.0.smithi138.stderr: -252> 2024-09-14T11:40:41.611+0000 7efc096ff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:40:42.188 INFO:tasks.workunit.client.0.smithi138.stderr: -251> 2024-09-14T11:40:41.611+0000 7efc096ff640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:40:42.188 INFO:tasks.workunit.client.0.smithi138.stderr: -250> 2024-09-14T11:40:41.611+0000 7efc096ff640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:40:42.188 INFO:tasks.workunit.client.0.smithi138.stderr: -249> 2024-09-14T11:40:41.611+0000 7efc09f00640 10 monclient(hunting): get_auth_request con 0x55fa6a6ac820 auth_method 0 2024-09-14T11:40:42.188 INFO:tasks.workunit.client.0.smithi138.stderr: -248> 2024-09-14T11:40:41.611+0000 7efc09f00640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:40:42.188 INFO:tasks.workunit.client.0.smithi138.stderr: -247> 2024-09-14T11:40:41.611+0000 7efc09f00640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:40:42.188 INFO:tasks.workunit.client.0.smithi138.stderr: -246> 2024-09-14T11:40:41.611+0000 7efc09f00640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:40:42.188 INFO:tasks.workunit.client.0.smithi138.stderr: -245> 2024-09-14T11:40:41.611+0000 7efc096ff640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:40:42.189 INFO:tasks.workunit.client.0.smithi138.stderr: -244> 2024-09-14T11:40:41.611+0000 7efc096ff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:40:42.189 INFO:tasks.workunit.client.0.smithi138.stderr: -243> 2024-09-14T11:40:41.611+0000 7efc096ff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:40:42.189 INFO:tasks.workunit.client.0.smithi138.stderr: -242> 2024-09-14T11:40:41.611+0000 7efc0a701640 10 monclient(hunting): get_auth_request con 0x55fa6a6abea0 auth_method 0 2024-09-14T11:40:42.189 INFO:tasks.workunit.client.0.smithi138.stderr: -241> 2024-09-14T11:40:41.611+0000 7efc0a701640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:40:42.189 INFO:tasks.workunit.client.0.smithi138.stderr: -240> 2024-09-14T11:40:41.611+0000 7efc0a701640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:40:42.189 INFO:tasks.workunit.client.0.smithi138.stderr: -239> 2024-09-14T11:40:41.611+0000 7efc0a701640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:40:42.189 INFO:tasks.workunit.client.0.smithi138.stderr: -238> 2024-09-14T11:40:41.611+0000 7efc09f00640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:40:42.189 INFO:tasks.workunit.client.0.smithi138.stderr: -237> 2024-09-14T11:40:41.611+0000 7efc09f00640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:40:42.189 INFO:tasks.workunit.client.0.smithi138.stderr: -236> 2024-09-14T11:40:41.611+0000 7efc09f00640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:40:42.189 INFO:tasks.workunit.client.0.smithi138.stderr: -235> 2024-09-14T11:40:41.611+0000 7efc096ff640 10 monclient(hunting): handle_auth_done global_id 7661 payload 274 2024-09-14T11:40:42.189 INFO:tasks.workunit.client.0.smithi138.stderr: -234> 2024-09-14T11:40:41.611+0000 7efc096ff640 10 monclient: _finish_hunting 0 2024-09-14T11:40:42.189 INFO:tasks.workunit.client.0.smithi138.stderr: -233> 2024-09-14T11:40:41.611+0000 7efc096ff640 1 monclient: found mon.noname-c 2024-09-14T11:40:42.189 INFO:tasks.workunit.client.0.smithi138.stderr: -232> 2024-09-14T11:40:41.611+0000 7efc096ff640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.138:3301/0 2024-09-14T11:40:42.190 INFO:tasks.workunit.client.0.smithi138.stderr: -231> 2024-09-14T11:40:41.611+0000 7efaed7fa640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:40:42.190 INFO:tasks.workunit.client.0.smithi138.stderr: -230> 2024-09-14T11:40:41.611+0000 7efaed7fa640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-14T11:40:42.190 INFO:tasks.workunit.client.0.smithi138.stderr: -229> 2024-09-14T11:40:41.611+0000 7efaed7fa640 10 monclient: dump: 2024-09-14T11:40:42.190 INFO:tasks.workunit.client.0.smithi138.stderr:epoch 1 2024-09-14T11:40:42.190 INFO:tasks.workunit.client.0.smithi138.stderr:fsid 3f225f43-83a6-4aeb-b798-1f04bb49d597 2024-09-14T11:40:42.190 INFO:tasks.workunit.client.0.smithi138.stderr:last_changed 2024-09-14T11:07:09.252780+0000 2024-09-14T11:40:42.190 INFO:tasks.workunit.client.0.smithi138.stderr:created 2024-09-14T11:07:09.252780+0000 2024-09-14T11:40:42.190 INFO:tasks.workunit.client.0.smithi138.stderr:min_mon_release 19 (squid) 2024-09-14T11:40:42.190 INFO:tasks.workunit.client.0.smithi138.stderr:election_strategy: 1 2024-09-14T11:40:42.190 INFO:tasks.workunit.client.0.smithi138.stderr:0: [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] mon.a 2024-09-14T11:40:42.190 INFO:tasks.workunit.client.0.smithi138.stderr:1: [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] mon.b 2024-09-14T11:40:42.190 INFO:tasks.workunit.client.0.smithi138.stderr:2: [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] mon.c 2024-09-14T11:40:42.190 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-14T11:40:42.190 INFO:tasks.workunit.client.0.smithi138.stderr: -228> 2024-09-14T11:40:41.611+0000 7efaed7fa640 10 monclient: _finish_auth 0 2024-09-14T11:40:42.190 INFO:tasks.workunit.client.0.smithi138.stderr: -227> 2024-09-14T11:40:41.611+0000 7efaed7fa640 10 monclient: _check_auth_tickets 2024-09-14T11:40:42.191 INFO:tasks.workunit.client.0.smithi138.stderr: -226> 2024-09-14T11:40:41.611+0000 7efaed7fa640 10 monclient: handle_config config(0 keys) 2024-09-14T11:40:42.191 INFO:tasks.workunit.client.0.smithi138.stderr: -225> 2024-09-14T11:40:41.611+0000 7efaed7fa640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:40:42.191 INFO:tasks.workunit.client.0.smithi138.stderr: -224> 2024-09-14T11:40:41.611+0000 7efaed7fa640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-14T11:40:42.191 INFO:tasks.workunit.client.0.smithi138.stderr: -223> 2024-09-14T11:40:41.611+0000 7efaed7fa640 10 monclient: dump: 2024-09-14T11:40:42.191 INFO:tasks.workunit.client.0.smithi138.stderr:epoch 1 2024-09-14T11:40:42.191 INFO:tasks.workunit.client.0.smithi138.stderr:fsid 3f225f43-83a6-4aeb-b798-1f04bb49d597 2024-09-14T11:40:42.191 INFO:tasks.workunit.client.0.smithi138.stderr:last_changed 2024-09-14T11:07:09.252780+0000 2024-09-14T11:40:42.191 INFO:tasks.workunit.client.0.smithi138.stderr:created 2024-09-14T11:07:09.252780+0000 2024-09-14T11:40:42.191 INFO:tasks.workunit.client.0.smithi138.stderr:min_mon_release 19 (squid) 2024-09-14T11:40:42.191 INFO:tasks.workunit.client.0.smithi138.stderr:election_strategy: 1 2024-09-14T11:40:42.191 INFO:tasks.workunit.client.0.smithi138.stderr:0: [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] mon.a 2024-09-14T11:40:42.191 INFO:tasks.workunit.client.0.smithi138.stderr:1: [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] mon.b 2024-09-14T11:40:42.191 INFO:tasks.workunit.client.0.smithi138.stderr:2: [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] mon.c 2024-09-14T11:40:42.192 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-14T11:40:42.192 INFO:tasks.workunit.client.0.smithi138.stderr: -222> 2024-09-14T11:40:41.611+0000 7efc0c3fa9c0 5 monclient: authenticate success, global_id 7661 2024-09-14T11:40:42.192 INFO:tasks.workunit.client.0.smithi138.stderr: -221> 2024-09-14T11:40:41.611+0000 7efc0c3fa9c0 10 monclient: get_monmap_and_config success 2024-09-14T11:40:42.192 INFO:tasks.workunit.client.0.smithi138.stderr: -220> 2024-09-14T11:40:41.611+0000 7efc0c3fa9c0 4 set_mon_vals no callback set 2024-09-14T11:40:42.192 INFO:tasks.workunit.client.0.smithi138.stderr: -219> 2024-09-14T11:40:41.615+0000 7efc0c3fa9c0 10 monclient: shutdown 2024-09-14T11:40:42.192 INFO:tasks.workunit.client.0.smithi138.stderr: -218> 2024-09-14T11:40:41.615+0000 7efc0c3fa9c0 10 monclient: build_initial_monmap 2024-09-14T11:40:42.192 INFO:tasks.workunit.client.0.smithi138.stderr: -217> 2024-09-14T11:40:41.615+0000 7efc0c3fa9c0 1 build_initial for_mkfs: 0 2024-09-14T11:40:42.192 INFO:tasks.workunit.client.0.smithi138.stderr: -216> 2024-09-14T11:40:41.615+0000 7efc0c3fa9c0 10 monclient: monmap: 2024-09-14T11:40:42.192 INFO:tasks.workunit.client.0.smithi138.stderr:epoch 0 2024-09-14T11:40:42.192 INFO:tasks.workunit.client.0.smithi138.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-14T11:40:42.192 INFO:tasks.workunit.client.0.smithi138.stderr:last_changed 0.000000 2024-09-14T11:40:42.192 INFO:tasks.workunit.client.0.smithi138.stderr:created 0.000000 2024-09-14T11:40:42.192 INFO:tasks.workunit.client.0.smithi138.stderr:min_mon_release 0 (unknown) 2024-09-14T11:40:42.193 INFO:tasks.workunit.client.0.smithi138.stderr:election_strategy: 1 2024-09-14T11:40:42.193 INFO:tasks.workunit.client.0.smithi138.stderr:0: [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] mon.noname-a 2024-09-14T11:40:42.193 INFO:tasks.workunit.client.0.smithi138.stderr:1: [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] mon.noname-b 2024-09-14T11:40:42.193 INFO:tasks.workunit.client.0.smithi138.stderr:2: [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] mon.noname-c 2024-09-14T11:40:42.193 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-14T11:40:42.193 INFO:tasks.workunit.client.0.smithi138.stderr: -215> 2024-09-14T11:40:41.615+0000 7efc0c3fa9c0 5 AuthRegistry(0x55fa6a6accf0) adding auth protocol: cephx 2024-09-14T11:40:42.193 INFO:tasks.workunit.client.0.smithi138.stderr: -214> 2024-09-14T11:40:41.615+0000 7efc0c3fa9c0 5 AuthRegistry(0x55fa6a6accf0) adding auth protocol: cephx 2024-09-14T11:40:42.193 INFO:tasks.workunit.client.0.smithi138.stderr: -213> 2024-09-14T11:40:41.615+0000 7efc0c3fa9c0 5 AuthRegistry(0x55fa6a6accf0) adding auth protocol: cephx 2024-09-14T11:40:42.193 INFO:tasks.workunit.client.0.smithi138.stderr: -212> 2024-09-14T11:40:41.615+0000 7efc0c3fa9c0 5 AuthRegistry(0x55fa6a6accf0) adding con mode: secure 2024-09-14T11:40:42.193 INFO:tasks.workunit.client.0.smithi138.stderr: -211> 2024-09-14T11:40:41.615+0000 7efc0c3fa9c0 5 AuthRegistry(0x55fa6a6accf0) adding con mode: crc 2024-09-14T11:40:42.193 INFO:tasks.workunit.client.0.smithi138.stderr: -210> 2024-09-14T11:40:41.615+0000 7efc0c3fa9c0 5 AuthRegistry(0x55fa6a6accf0) adding con mode: secure 2024-09-14T11:40:42.193 INFO:tasks.workunit.client.0.smithi138.stderr: -209> 2024-09-14T11:40:41.615+0000 7efc0c3fa9c0 5 AuthRegistry(0x55fa6a6accf0) adding con mode: crc 2024-09-14T11:40:42.193 INFO:tasks.workunit.client.0.smithi138.stderr: -208> 2024-09-14T11:40:41.615+0000 7efc0c3fa9c0 5 AuthRegistry(0x55fa6a6accf0) adding con mode: secure 2024-09-14T11:40:42.193 INFO:tasks.workunit.client.0.smithi138.stderr: -207> 2024-09-14T11:40:41.615+0000 7efc0c3fa9c0 5 AuthRegistry(0x55fa6a6accf0) adding con mode: crc 2024-09-14T11:40:42.194 INFO:tasks.workunit.client.0.smithi138.stderr: -206> 2024-09-14T11:40:41.615+0000 7efc0c3fa9c0 5 AuthRegistry(0x55fa6a6accf0) adding con mode: crc 2024-09-14T11:40:42.194 INFO:tasks.workunit.client.0.smithi138.stderr: -205> 2024-09-14T11:40:41.615+0000 7efc0c3fa9c0 5 AuthRegistry(0x55fa6a6accf0) adding con mode: secure 2024-09-14T11:40:42.194 INFO:tasks.workunit.client.0.smithi138.stderr: -204> 2024-09-14T11:40:41.615+0000 7efc0c3fa9c0 5 AuthRegistry(0x55fa6a6accf0) adding con mode: crc 2024-09-14T11:40:42.194 INFO:tasks.workunit.client.0.smithi138.stderr: -203> 2024-09-14T11:40:41.615+0000 7efc0c3fa9c0 5 AuthRegistry(0x55fa6a6accf0) adding con mode: secure 2024-09-14T11:40:42.194 INFO:tasks.workunit.client.0.smithi138.stderr: -202> 2024-09-14T11:40:41.615+0000 7efc0c3fa9c0 5 AuthRegistry(0x55fa6a6accf0) adding con mode: crc 2024-09-14T11:40:42.194 INFO:tasks.workunit.client.0.smithi138.stderr: -201> 2024-09-14T11:40:41.615+0000 7efc0c3fa9c0 5 AuthRegistry(0x55fa6a6accf0) adding con mode: secure 2024-09-14T11:40:42.194 INFO:tasks.workunit.client.0.smithi138.stderr: -200> 2024-09-14T11:40:41.615+0000 7efc0c3fa9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:40:42.194 INFO:tasks.workunit.client.0.smithi138.stderr: -199> 2024-09-14T11:40:41.615+0000 7efc0c3fa9c0 1 librados: starting msgr at 2024-09-14T11:40:42.194 INFO:tasks.workunit.client.0.smithi138.stderr: -198> 2024-09-14T11:40:41.615+0000 7efc0c3fa9c0 1 librados: starting objecter 2024-09-14T11:40:42.194 INFO:tasks.workunit.client.0.smithi138.stderr: -197> 2024-09-14T11:40:41.615+0000 7efc0c3fa9c0 5 asok(0x55fa6a3d0d90) register_command objecter_requests cmddesc objecter_requests hook 0x55fa6a67c2a0 EEXIST 2024-09-14T11:40:42.194 INFO:tasks.workunit.client.0.smithi138.stderr: -196> 2024-09-14T11:40:41.615+0000 7efc0c3fa9c0 1 librados: setting wanted keys 2024-09-14T11:40:42.194 INFO:tasks.workunit.client.0.smithi138.stderr: -195> 2024-09-14T11:40:41.615+0000 7efc0c3fa9c0 1 librados: calling monclient init 2024-09-14T11:40:42.194 INFO:tasks.workunit.client.0.smithi138.stderr: -194> 2024-09-14T11:40:41.615+0000 7efc0c3fa9c0 10 monclient: init 2024-09-14T11:40:42.194 INFO:tasks.workunit.client.0.smithi138.stderr: -193> 2024-09-14T11:40:41.615+0000 7efc0c3fa9c0 5 AuthRegistry(0x55fa6a65eb90) adding auth protocol: cephx 2024-09-14T11:40:42.195 INFO:tasks.workunit.client.0.smithi138.stderr: -192> 2024-09-14T11:40:41.615+0000 7efc0c3fa9c0 5 AuthRegistry(0x55fa6a65eb90) adding auth protocol: cephx 2024-09-14T11:40:42.195 INFO:tasks.workunit.client.0.smithi138.stderr: -191> 2024-09-14T11:40:41.615+0000 7efc0c3fa9c0 5 AuthRegistry(0x55fa6a65eb90) adding auth protocol: cephx 2024-09-14T11:40:42.195 INFO:tasks.workunit.client.0.smithi138.stderr: -190> 2024-09-14T11:40:41.615+0000 7efc0c3fa9c0 5 AuthRegistry(0x55fa6a65eb90) adding con mode: secure 2024-09-14T11:40:42.195 INFO:tasks.workunit.client.0.smithi138.stderr: -189> 2024-09-14T11:40:41.615+0000 7efc0c3fa9c0 5 AuthRegistry(0x55fa6a65eb90) adding con mode: crc 2024-09-14T11:40:42.195 INFO:tasks.workunit.client.0.smithi138.stderr: -188> 2024-09-14T11:40:41.615+0000 7efc0c3fa9c0 5 AuthRegistry(0x55fa6a65eb90) adding con mode: secure 2024-09-14T11:40:42.195 INFO:tasks.workunit.client.0.smithi138.stderr: -187> 2024-09-14T11:40:41.615+0000 7efc0c3fa9c0 5 AuthRegistry(0x55fa6a65eb90) adding con mode: crc 2024-09-14T11:40:42.195 INFO:tasks.workunit.client.0.smithi138.stderr: -186> 2024-09-14T11:40:41.615+0000 7efc0c3fa9c0 5 AuthRegistry(0x55fa6a65eb90) adding con mode: secure 2024-09-14T11:40:42.195 INFO:tasks.workunit.client.0.smithi138.stderr: -185> 2024-09-14T11:40:41.615+0000 7efc0c3fa9c0 5 AuthRegistry(0x55fa6a65eb90) adding con mode: crc 2024-09-14T11:40:42.195 INFO:tasks.workunit.client.0.smithi138.stderr: -184> 2024-09-14T11:40:41.615+0000 7efc0c3fa9c0 5 AuthRegistry(0x55fa6a65eb90) adding con mode: crc 2024-09-14T11:40:42.195 INFO:tasks.workunit.client.0.smithi138.stderr: -183> 2024-09-14T11:40:41.615+0000 7efc0c3fa9c0 5 AuthRegistry(0x55fa6a65eb90) adding con mode: secure 2024-09-14T11:40:42.195 INFO:tasks.workunit.client.0.smithi138.stderr: -182> 2024-09-14T11:40:41.615+0000 7efc0c3fa9c0 5 AuthRegistry(0x55fa6a65eb90) adding con mode: crc 2024-09-14T11:40:42.195 INFO:tasks.workunit.client.0.smithi138.stderr: -181> 2024-09-14T11:40:41.615+0000 7efc0c3fa9c0 5 AuthRegistry(0x55fa6a65eb90) adding con mode: secure 2024-09-14T11:40:42.195 INFO:tasks.workunit.client.0.smithi138.stderr: -180> 2024-09-14T11:40:41.615+0000 7efc0c3fa9c0 5 AuthRegistry(0x55fa6a65eb90) adding con mode: crc 2024-09-14T11:40:42.195 INFO:tasks.workunit.client.0.smithi138.stderr: -179> 2024-09-14T11:40:41.615+0000 7efc0c3fa9c0 5 AuthRegistry(0x55fa6a65eb90) adding con mode: secure 2024-09-14T11:40:42.195 INFO:tasks.workunit.client.0.smithi138.stderr: -178> 2024-09-14T11:40:41.615+0000 7efc0c3fa9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:40:42.196 INFO:tasks.workunit.client.0.smithi138.stderr: -177> 2024-09-14T11:40:41.615+0000 7efc0c3fa9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:40:42.196 INFO:tasks.workunit.client.0.smithi138.stderr: -176> 2024-09-14T11:40:41.615+0000 7efc0c3fa9c0 5 asok(0x55fa6a3d0d90) register_command rotate-key cmddesc rotate-key hook 0x55fa6a65ecd8 EEXIST 2024-09-14T11:40:42.196 INFO:tasks.workunit.client.0.smithi138.stderr: -175> 2024-09-14T11:40:41.615+0000 7efc0c3fa9c0 10 monclient: _reopen_session rank -1 2024-09-14T11:40:42.196 INFO:tasks.workunit.client.0.smithi138.stderr: -174> 2024-09-14T11:40:41.615+0000 7efc0c3fa9c0 10 monclient: _add_conns ranks=[1,2,0] 2024-09-14T11:40:42.196 INFO:tasks.workunit.client.0.smithi138.stderr: -173> 2024-09-14T11:40:41.615+0000 7efc0c3fa9c0 10 monclient(hunting): picked mon.noname-b con 0x55fa6a6abea0 addr [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] 2024-09-14T11:40:42.196 INFO:tasks.workunit.client.0.smithi138.stderr: -172> 2024-09-14T11:40:41.615+0000 7efc0c3fa9c0 10 monclient(hunting): picked mon.noname-c con 0x55fa6a6ac820 addr [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] 2024-09-14T11:40:42.196 INFO:tasks.workunit.client.0.smithi138.stderr: -171> 2024-09-14T11:40:41.615+0000 7efc0c3fa9c0 10 monclient(hunting): picked mon.noname-a con 0x55fa6a6b0ab0 addr [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] 2024-09-14T11:40:42.196 INFO:tasks.workunit.client.0.smithi138.stderr: -170> 2024-09-14T11:40:41.615+0000 7efc0c3fa9c0 10 monclient(hunting): start opening mon connection 2024-09-14T11:40:42.196 INFO:tasks.workunit.client.0.smithi138.stderr: -169> 2024-09-14T11:40:41.615+0000 7efc0c3fa9c0 10 monclient(hunting): start opening mon connection 2024-09-14T11:40:42.196 INFO:tasks.workunit.client.0.smithi138.stderr: -168> 2024-09-14T11:40:41.615+0000 7efc0c3fa9c0 10 monclient(hunting): start opening mon connection 2024-09-14T11:40:42.196 INFO:tasks.workunit.client.0.smithi138.stderr: -167> 2024-09-14T11:40:41.615+0000 7efc0c3fa9c0 10 monclient(hunting): _renew_subs 2024-09-14T11:40:42.196 INFO:tasks.workunit.client.0.smithi138.stderr: -166> 2024-09-14T11:40:41.619+0000 7efc0c3fa9c0 10 monclient(hunting): authenticate will time out at 2977.580028s 2024-09-14T11:40:42.196 INFO:tasks.workunit.client.0.smithi138.stderr: -165> 2024-09-14T11:40:41.619+0000 7efc0a701640 10 monclient(hunting): get_auth_request con 0x55fa6a6ac820 auth_method 0 2024-09-14T11:40:42.196 INFO:tasks.workunit.client.0.smithi138.stderr: -164> 2024-09-14T11:40:41.619+0000 7efc0a701640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:40:42.197 INFO:tasks.workunit.client.0.smithi138.stderr: -163> 2024-09-14T11:40:41.619+0000 7efc0a701640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:40:42.197 INFO:tasks.workunit.client.0.smithi138.stderr: -162> 2024-09-14T11:40:41.619+0000 7efc0a701640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:40:42.197 INFO:tasks.workunit.client.0.smithi138.stderr: -161> 2024-09-14T11:40:41.619+0000 7efc096ff640 10 monclient(hunting): get_auth_request con 0x55fa6a6abea0 auth_method 0 2024-09-14T11:40:42.197 INFO:tasks.workunit.client.0.smithi138.stderr: -160> 2024-09-14T11:40:41.619+0000 7efc096ff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:40:42.197 INFO:tasks.workunit.client.0.smithi138.stderr: -159> 2024-09-14T11:40:41.619+0000 7efc096ff640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:40:42.197 INFO:tasks.workunit.client.0.smithi138.stderr: -158> 2024-09-14T11:40:41.619+0000 7efc096ff640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:40:42.197 INFO:tasks.workunit.client.0.smithi138.stderr: -157> 2024-09-14T11:40:41.619+0000 7efc09f00640 10 monclient(hunting): get_auth_request con 0x55fa6a6b0ab0 auth_method 0 2024-09-14T11:40:42.197 INFO:tasks.workunit.client.0.smithi138.stderr: -156> 2024-09-14T11:40:41.619+0000 7efc09f00640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:40:42.197 INFO:tasks.workunit.client.0.smithi138.stderr: -155> 2024-09-14T11:40:41.619+0000 7efc09f00640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:40:42.197 INFO:tasks.workunit.client.0.smithi138.stderr: -154> 2024-09-14T11:40:41.619+0000 7efc09f00640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:40:42.197 INFO:tasks.workunit.client.0.smithi138.stderr: -153> 2024-09-14T11:40:41.619+0000 7efc0a701640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:40:42.197 INFO:tasks.workunit.client.0.smithi138.stderr: -152> 2024-09-14T11:40:41.619+0000 7efc0a701640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:40:42.197 INFO:tasks.workunit.client.0.smithi138.stderr: -151> 2024-09-14T11:40:41.619+0000 7efc0a701640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:40:42.197 INFO:tasks.workunit.client.0.smithi138.stderr: -150> 2024-09-14T11:40:41.619+0000 7efc096ff640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:40:42.198 INFO:tasks.workunit.client.0.smithi138.stderr: -149> 2024-09-14T11:40:41.619+0000 7efc096ff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:40:42.198 INFO:tasks.workunit.client.0.smithi138.stderr: -148> 2024-09-14T11:40:41.619+0000 7efc096ff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:40:42.198 INFO:tasks.workunit.client.0.smithi138.stderr: -147> 2024-09-14T11:40:41.619+0000 7efc09f00640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:40:42.198 INFO:tasks.workunit.client.0.smithi138.stderr: -146> 2024-09-14T11:40:41.619+0000 7efc09f00640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:40:42.198 INFO:tasks.workunit.client.0.smithi138.stderr: -145> 2024-09-14T11:40:41.619+0000 7efc09f00640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:40:42.198 INFO:tasks.workunit.client.0.smithi138.stderr: -144> 2024-09-14T11:40:41.619+0000 7efc09f00640 10 monclient(hunting): handle_auth_done global_id 8205 payload 824 2024-09-14T11:40:42.198 INFO:tasks.workunit.client.0.smithi138.stderr: -143> 2024-09-14T11:40:41.619+0000 7efc09f00640 10 monclient: _finish_hunting 0 2024-09-14T11:40:42.198 INFO:tasks.workunit.client.0.smithi138.stderr: -142> 2024-09-14T11:40:41.619+0000 7efc09f00640 1 monclient: found mon.noname-a 2024-09-14T11:40:42.198 INFO:tasks.workunit.client.0.smithi138.stderr: -141> 2024-09-14T11:40:41.619+0000 7efc09f00640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.138:3300/0 2024-09-14T11:40:42.198 INFO:tasks.workunit.client.0.smithi138.stderr: -140> 2024-09-14T11:40:41.619+0000 7efadb7fe640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:40:42.198 INFO:tasks.workunit.client.0.smithi138.stderr: -139> 2024-09-14T11:40:41.619+0000 7efadb7fe640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-14T11:40:42.198 INFO:tasks.workunit.client.0.smithi138.stderr: -138> 2024-09-14T11:40:41.619+0000 7efadb7fe640 10 monclient: dump: 2024-09-14T11:40:42.198 INFO:tasks.workunit.client.0.smithi138.stderr:epoch 1 2024-09-14T11:40:42.198 INFO:tasks.workunit.client.0.smithi138.stderr:fsid 3f225f43-83a6-4aeb-b798-1f04bb49d597 2024-09-14T11:40:42.198 INFO:tasks.workunit.client.0.smithi138.stderr:last_changed 2024-09-14T11:07:09.252780+0000 2024-09-14T11:40:42.199 INFO:tasks.workunit.client.0.smithi138.stderr:created 2024-09-14T11:07:09.252780+0000 2024-09-14T11:40:42.199 INFO:tasks.workunit.client.0.smithi138.stderr:min_mon_release 19 (squid) 2024-09-14T11:40:42.199 INFO:tasks.workunit.client.0.smithi138.stderr:election_strategy: 1 2024-09-14T11:40:42.199 INFO:tasks.workunit.client.0.smithi138.stderr:0: [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] mon.a 2024-09-14T11:40:42.199 INFO:tasks.workunit.client.0.smithi138.stderr:1: [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] mon.b 2024-09-14T11:40:42.199 INFO:tasks.workunit.client.0.smithi138.stderr:2: [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] mon.c 2024-09-14T11:40:42.199 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-14T11:40:42.199 INFO:tasks.workunit.client.0.smithi138.stderr: -137> 2024-09-14T11:40:41.619+0000 7efadb7fe640 10 monclient: _finish_auth 0 2024-09-14T11:40:42.199 INFO:tasks.workunit.client.0.smithi138.stderr: -136> 2024-09-14T11:40:41.619+0000 7efadb7fe640 10 monclient: _check_auth_tickets 2024-09-14T11:40:42.199 INFO:tasks.workunit.client.0.smithi138.stderr: -135> 2024-09-14T11:40:41.619+0000 7efadb7fe640 10 monclient: handle_config config(0 keys) 2024-09-14T11:40:42.199 INFO:tasks.workunit.client.0.smithi138.stderr: -134> 2024-09-14T11:40:41.619+0000 7efadb7fe640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:40:42.199 INFO:tasks.workunit.client.0.smithi138.stderr: -133> 2024-09-14T11:40:41.619+0000 7efadb7fe640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-14T11:40:42.199 INFO:tasks.workunit.client.0.smithi138.stderr: -132> 2024-09-14T11:40:41.619+0000 7efadb7fe640 10 monclient: dump: 2024-09-14T11:40:42.199 INFO:tasks.workunit.client.0.smithi138.stderr:epoch 1 2024-09-14T11:40:42.199 INFO:tasks.workunit.client.0.smithi138.stderr:fsid 3f225f43-83a6-4aeb-b798-1f04bb49d597 2024-09-14T11:40:42.200 INFO:tasks.workunit.client.0.smithi138.stderr:last_changed 2024-09-14T11:07:09.252780+0000 2024-09-14T11:40:42.200 INFO:tasks.workunit.client.0.smithi138.stderr:created 2024-09-14T11:07:09.252780+0000 2024-09-14T11:40:42.200 INFO:tasks.workunit.client.0.smithi138.stderr:min_mon_release 19 (squid) 2024-09-14T11:40:42.200 INFO:tasks.workunit.client.0.smithi138.stderr:election_strategy: 1 2024-09-14T11:40:42.200 INFO:tasks.workunit.client.0.smithi138.stderr:0: [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] mon.a 2024-09-14T11:40:42.200 INFO:tasks.workunit.client.0.smithi138.stderr:1: [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] mon.b 2024-09-14T11:40:42.200 INFO:tasks.workunit.client.0.smithi138.stderr:2: [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] mon.c 2024-09-14T11:40:42.200 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-14T11:40:42.200 INFO:tasks.workunit.client.0.smithi138.stderr: -131> 2024-09-14T11:40:41.619+0000 7efc0c3fa9c0 5 monclient: authenticate success, global_id 8205 2024-09-14T11:40:42.200 INFO:tasks.workunit.client.0.smithi138.stderr: -130> 2024-09-14T11:40:41.619+0000 7efaed7fa640 4 set_mon_vals no callback set 2024-09-14T11:40:42.200 INFO:tasks.workunit.client.0.smithi138.stderr: -129> 2024-09-14T11:40:41.619+0000 7efc0c3fa9c0 10 monclient: _renew_subs 2024-09-14T11:40:42.200 INFO:tasks.workunit.client.0.smithi138.stderr: -128> 2024-09-14T11:40:41.619+0000 7efc0c3fa9c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.138:3300/0 2024-09-14T11:40:42.200 INFO:tasks.workunit.client.0.smithi138.stderr: -127> 2024-09-14T11:40:41.619+0000 7efc0c3fa9c0 10 monclient: _renew_subs 2024-09-14T11:40:42.200 INFO:tasks.workunit.client.0.smithi138.stderr: -126> 2024-09-14T11:40:41.619+0000 7efc0c3fa9c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.138:3300/0 2024-09-14T11:40:42.201 INFO:tasks.workunit.client.0.smithi138.stderr: -125> 2024-09-14T11:40:41.619+0000 7efc0c3fa9c0 1 librados: init done 2024-09-14T11:40:42.201 INFO:tasks.workunit.client.0.smithi138.stderr: -124> 2024-09-14T11:40:41.619+0000 7efc0c3fa9c0 5 asok(0x55fa6a3d0d90) register_command cr dump hook 0x55fa6a6b0ea8 2024-09-14T11:40:42.201 INFO:tasks.workunit.client.0.smithi138.stderr: -123> 2024-09-14T11:40:41.623+0000 7efc0c3fa9c0 20 rados->read ofs=0 len=0 2024-09-14T11:40:42.201 INFO:tasks.workunit.client.0.smithi138.stderr: -122> 2024-09-14T11:40:41.623+0000 7efadb7fe640 4 mgrc handle_mgr_map Got map version 5 2024-09-14T11:40:42.201 INFO:tasks.workunit.client.0.smithi138.stderr: -121> 2024-09-14T11:40:41.623+0000 7efadb7fe640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.138:6832/3778043143,v1:172.21.15.138:6833/3778043143] 2024-09-14T11:40:42.201 INFO:tasks.workunit.client.0.smithi138.stderr: -120> 2024-09-14T11:40:41.623+0000 7efadb7fe640 4 mgrc reconnect Starting new session with [v2:172.21.15.138:6832/3778043143,v1:172.21.15.138:6833/3778043143] 2024-09-14T11:40:42.201 INFO:tasks.workunit.client.0.smithi138.stderr: -119> 2024-09-14T11:40:41.623+0000 7efc096ff640 10 monclient: get_auth_request con 0x7efad40718d0 auth_method 0 2024-09-14T11:40:42.201 INFO:tasks.workunit.client.0.smithi138.stderr: -118> 2024-09-14T11:40:41.623+0000 7efc0a701640 10 monclient: get_auth_request con 0x55fa6a6ca330 auth_method 0 2024-09-14T11:40:42.201 INFO:tasks.workunit.client.0.smithi138.stderr: -117> 2024-09-14T11:40:41.627+0000 7efc0c3fa9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:40:42.201 INFO:tasks.workunit.client.0.smithi138.stderr: -116> 2024-09-14T11:40:41.627+0000 7efc0c3fa9c0 20 realm 2024-09-14T11:40:42.201 INFO:tasks.workunit.client.0.smithi138.stderr: -115> 2024-09-14T11:40:41.627+0000 7efc0c3fa9c0 20 rados->read ofs=0 len=0 2024-09-14T11:40:42.201 INFO:tasks.workunit.client.0.smithi138.stderr: -114> 2024-09-14T11:40:41.627+0000 7efc0c3fa9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:40:42.201 INFO:tasks.workunit.client.0.smithi138.stderr: -113> 2024-09-14T11:40:41.627+0000 7efc0c3fa9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:40:42.201 INFO:tasks.workunit.client.0.smithi138.stderr: -112> 2024-09-14T11:40:41.627+0000 7efc0c3fa9c0 20 rados->read ofs=0 len=0 2024-09-14T11:40:42.201 INFO:tasks.workunit.client.0.smithi138.stderr: -111> 2024-09-14T11:40:41.627+0000 7efc0c3fa9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:40:42.202 INFO:tasks.workunit.client.0.smithi138.stderr: -110> 2024-09-14T11:40:41.627+0000 7efc0c3fa9c0 20 rados->read ofs=0 len=0 2024-09-14T11:40:42.202 INFO:tasks.workunit.client.0.smithi138.stderr: -109> 2024-09-14T11:40:41.627+0000 7efc096ff640 10 monclient: get_auth_request con 0x55fa6a6ce450 auth_method 0 2024-09-14T11:40:42.202 INFO:tasks.workunit.client.0.smithi138.stderr: -108> 2024-09-14T11:40:41.627+0000 7efc0c3fa9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:40:42.202 INFO:tasks.workunit.client.0.smithi138.stderr: -107> 2024-09-14T11:40:41.627+0000 7efc0c3fa9c0 20 rados->read ofs=0 len=0 2024-09-14T11:40:42.202 INFO:tasks.workunit.client.0.smithi138.stderr: -106> 2024-09-14T11:40:41.627+0000 7efc0a701640 10 monclient: get_auth_request con 0x55fa6a6d1cb0 auth_method 0 2024-09-14T11:40:42.202 INFO:tasks.workunit.client.0.smithi138.stderr: -105> 2024-09-14T11:40:41.627+0000 7efc0c3fa9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:40:42.202 INFO:tasks.workunit.client.0.smithi138.stderr: -104> 2024-09-14T11:40:41.627+0000 7efc0c3fa9c0 20 searching for the correct realm 2024-09-14T11:40:42.202 INFO:tasks.workunit.client.0.smithi138.stderr: -103> 2024-09-14T11:40:41.627+0000 7efc09f00640 10 monclient: get_auth_request con 0x55fa6a6d6840 auth_method 0 2024-09-14T11:40:42.202 INFO:tasks.workunit.client.0.smithi138.stderr: -102> 2024-09-14T11:40:41.631+0000 7efc096ff640 10 monclient: get_auth_request con 0x7efbfc136320 auth_method 0 2024-09-14T11:40:42.202 INFO:tasks.workunit.client.0.smithi138.stderr: -101> 2024-09-14T11:40:41.631+0000 7efc0a701640 10 monclient: get_auth_request con 0x7efc04018040 auth_method 0 2024-09-14T11:40:42.202 INFO:tasks.workunit.client.0.smithi138.stderr: -100> 2024-09-14T11:40:41.631+0000 7efc0a701640 0 -- 172.21.15.138:0/3254551000 >> [v2:172.21.15.154:6824/416768175,v1:172.21.15.154:6825/416768175] conn(0x7efc04018040 msgr2=0x7efc04011460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:40:42.202 INFO:tasks.workunit.client.0.smithi138.stderr: -99> 2024-09-14T11:40:41.835+0000 7efc0a701640 10 monclient: get_auth_request con 0x7efc04018040 auth_method 0 2024-09-14T11:40:42.202 INFO:tasks.workunit.client.0.smithi138.stderr: -98> 2024-09-14T11:40:41.839+0000 7efc09f00640 10 monclient: get_auth_request con 0x7efc0404d3f0 auth_method 0 2024-09-14T11:40:42.203 INFO:tasks.workunit.client.0.smithi138.stderr: -97> 2024-09-14T11:40:41.847+0000 7efc096ff640 10 monclient: get_auth_request con 0x7efc04034920 auth_method 0 2024-09-14T11:40:42.203 INFO:tasks.workunit.client.0.smithi138.stderr: -96> 2024-09-14T11:40:41.847+0000 7efc096ff640 0 -- 172.21.15.138:0/3254551000 >> [v2:172.21.15.138:6816/326481658,v1:172.21.15.138:6817/326481658] conn(0x7efc04034920 msgr2=0x7efc04058380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-14T11:40:42.203 INFO:tasks.workunit.client.0.smithi138.stderr: -95> 2024-09-14T11:40:42.051+0000 7efc096ff640 10 monclient: get_auth_request con 0x7efc04034920 auth_method 0 2024-09-14T11:40:42.203 INFO:tasks.workunit.client.0.smithi138.stderr: -94> 2024-09-14T11:40:42.063+0000 7efc0c3fa9c0 20 RGWRados::pool_iterate: got zone_info.d9e72d30-c60b-4d0d-9267-fdc36392d5ad 2024-09-14T11:40:42.203 INFO:tasks.workunit.client.0.smithi138.stderr: -93> 2024-09-14T11:40:42.063+0000 7efc0c3fa9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:40:42.203 INFO:tasks.workunit.client.0.smithi138.stderr: -92> 2024-09-14T11:40:42.063+0000 7efc0c3fa9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:40:42.203 INFO:tasks.workunit.client.0.smithi138.stderr: -91> 2024-09-14T11:40:42.063+0000 7efc0c3fa9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:40:42.203 INFO:tasks.workunit.client.0.smithi138.stderr: -90> 2024-09-14T11:40:42.063+0000 7efc0c3fa9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:40:42.203 INFO:tasks.workunit.client.0.smithi138.stderr: -89> 2024-09-14T11:40:42.063+0000 7efc0c3fa9c0 20 RGWRados::pool_iterate: got zonegroup_info.65ab941b-da8c-4160-94fb-3672b069d44f 2024-09-14T11:40:42.203 INFO:tasks.workunit.client.0.smithi138.stderr: -88> 2024-09-14T11:40:42.063+0000 7efc0c3fa9c0 20 rados->read ofs=0 len=0 2024-09-14T11:40:42.203 INFO:tasks.workunit.client.0.smithi138.stderr: -87> 2024-09-14T11:40:42.063+0000 7efc0c3fa9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:40:42.203 INFO:tasks.workunit.client.0.smithi138.stderr: -86> 2024-09-14T11:40:42.063+0000 7efc0c3fa9c0 20 rados->read ofs=0 len=0 2024-09-14T11:40:42.203 INFO:tasks.workunit.client.0.smithi138.stderr: -85> 2024-09-14T11:40:42.067+0000 7efc0c3fa9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:40:42.203 INFO:tasks.workunit.client.0.smithi138.stderr: -84> 2024-09-14T11:40:42.067+0000 7efc0c3fa9c0 20 rados->read ofs=0 len=0 2024-09-14T11:40:42.203 INFO:tasks.workunit.client.0.smithi138.stderr: -83> 2024-09-14T11:40:42.067+0000 7efc0c3fa9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:40:42.204 INFO:tasks.workunit.client.0.smithi138.stderr: -82> 2024-09-14T11:40:42.067+0000 7efc0c3fa9c0 20 zone default found 2024-09-14T11:40:42.204 INFO:tasks.workunit.client.0.smithi138.stderr: -81> 2024-09-14T11:40:42.067+0000 7efc0c3fa9c0 4 Realm: () 2024-09-14T11:40:42.204 INFO:tasks.workunit.client.0.smithi138.stderr: -80> 2024-09-14T11:40:42.067+0000 7efc0c3fa9c0 4 ZoneGroup: default (65ab941b-da8c-4160-94fb-3672b069d44f) 2024-09-14T11:40:42.204 INFO:tasks.workunit.client.0.smithi138.stderr: -79> 2024-09-14T11:40:42.067+0000 7efc0c3fa9c0 4 Zone: default (d9e72d30-c60b-4d0d-9267-fdc36392d5ad) 2024-09-14T11:40:42.204 INFO:tasks.workunit.client.0.smithi138.stderr: -78> 2024-09-14T11:40:42.067+0000 7efc0c3fa9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:40:42.204 INFO:tasks.workunit.client.0.smithi138.stderr: -77> 2024-09-14T11:40:42.067+0000 7efc0c3fa9c0 20 zonegroup default 2024-09-14T11:40:42.204 INFO:tasks.workunit.client.0.smithi138.stderr: -76> 2024-09-14T11:40:42.067+0000 7efc0c3fa9c0 20 rados->read ofs=0 len=0 2024-09-14T11:40:42.204 INFO:tasks.workunit.client.0.smithi138.stderr: -75> 2024-09-14T11:40:42.067+0000 7efc0c3fa9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:40:42.204 INFO:tasks.workunit.client.0.smithi138.stderr: -74> 2024-09-14T11:40:42.067+0000 7efc0c3fa9c0 20 rados->read ofs=0 len=0 2024-09-14T11:40:42.204 INFO:tasks.workunit.client.0.smithi138.stderr: -73> 2024-09-14T11:40:42.067+0000 7efc0c3fa9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:40:42.204 INFO:tasks.workunit.client.0.smithi138.stderr: -72> 2024-09-14T11:40:42.067+0000 7efc0c3fa9c0 20 rados->read ofs=0 len=0 2024-09-14T11:40:42.204 INFO:tasks.workunit.client.0.smithi138.stderr: -71> 2024-09-14T11:40:42.067+0000 7efc0c3fa9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:40:42.204 INFO:tasks.workunit.client.0.smithi138.stderr: -70> 2024-09-14T11:40:42.071+0000 7efc0c3fa9c0 20 started sync module instance, tier type = 2024-09-14T11:40:42.204 INFO:tasks.workunit.client.0.smithi138.stderr: -69> 2024-09-14T11:40:42.071+0000 7efc0c3fa9c0 20 started zone id=d9e72d30-c60b-4d0d-9267-fdc36392d5ad (name=default) with tier type = 2024-09-14T11:40:42.205 INFO:tasks.workunit.client.0.smithi138.stderr: -68> 2024-09-14T11:40:42.091+0000 7efc0c3fa9c0 20 add_watcher() i=0 2024-09-14T11:40:42.205 INFO:tasks.workunit.client.0.smithi138.stderr: -67> 2024-09-14T11:40:42.091+0000 7efc0c3fa9c0 20 add_watcher() i=1 2024-09-14T11:40:42.205 INFO:tasks.workunit.client.0.smithi138.stderr: -66> 2024-09-14T11:40:42.091+0000 7efc0c3fa9c0 20 add_watcher() i=2 2024-09-14T11:40:42.205 INFO:tasks.workunit.client.0.smithi138.stderr: -65> 2024-09-14T11:40:42.091+0000 7efc0c3fa9c0 20 add_watcher() i=3 2024-09-14T11:40:42.205 INFO:tasks.workunit.client.0.smithi138.stderr: -64> 2024-09-14T11:40:42.091+0000 7efc0c3fa9c0 20 add_watcher() i=4 2024-09-14T11:40:42.205 INFO:tasks.workunit.client.0.smithi138.stderr: -63> 2024-09-14T11:40:42.091+0000 7efc0c3fa9c0 20 add_watcher() i=5 2024-09-14T11:40:42.205 INFO:tasks.workunit.client.0.smithi138.stderr: -62> 2024-09-14T11:40:42.091+0000 7efc0c3fa9c0 20 add_watcher() i=6 2024-09-14T11:40:42.205 INFO:tasks.workunit.client.0.smithi138.stderr: -61> 2024-09-14T11:40:42.095+0000 7efc0c3fa9c0 20 add_watcher() i=7 2024-09-14T11:40:42.205 INFO:tasks.workunit.client.0.smithi138.stderr: -60> 2024-09-14T11:40:42.095+0000 7efc0c3fa9c0 2 all 8 watchers are set, enabling cache 2024-09-14T11:40:42.205 INFO:tasks.workunit.client.0.smithi138.stderr: -59> 2024-09-14T11:40:42.099+0000 7efc0c3fa9c0 5 AuthRegistry(0x7ffd9cb6fdf0) adding auth protocol: cephx 2024-09-14T11:40:42.205 INFO:tasks.workunit.client.0.smithi138.stderr: -58> 2024-09-14T11:40:42.099+0000 7efc0c3fa9c0 5 AuthRegistry(0x7ffd9cb6fdf0) adding auth protocol: cephx 2024-09-14T11:40:42.205 INFO:tasks.workunit.client.0.smithi138.stderr: -57> 2024-09-14T11:40:42.099+0000 7efc0c3fa9c0 5 AuthRegistry(0x7ffd9cb6fdf0) adding auth protocol: cephx 2024-09-14T11:40:42.205 INFO:tasks.workunit.client.0.smithi138.stderr: -56> 2024-09-14T11:40:42.099+0000 7efc0c3fa9c0 5 AuthRegistry(0x7ffd9cb6fdf0) adding con mode: secure 2024-09-14T11:40:42.205 INFO:tasks.workunit.client.0.smithi138.stderr: -55> 2024-09-14T11:40:42.099+0000 7efc0c3fa9c0 5 AuthRegistry(0x7ffd9cb6fdf0) adding con mode: crc 2024-09-14T11:40:42.206 INFO:tasks.workunit.client.0.smithi138.stderr: -54> 2024-09-14T11:40:42.099+0000 7efabb7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:40:42.206 INFO:tasks.workunit.client.0.smithi138.stderr: -53> 2024-09-14T11:40:42.099+0000 7efc0c3fa9c0 5 AuthRegistry(0x7ffd9cb6fdf0) adding con mode: secure 2024-09-14T11:40:42.206 INFO:tasks.workunit.client.0.smithi138.stderr: -52> 2024-09-14T11:40:42.099+0000 7efc0c3fa9c0 5 AuthRegistry(0x7ffd9cb6fdf0) adding con mode: crc 2024-09-14T11:40:42.206 INFO:tasks.workunit.client.0.smithi138.stderr: -51> 2024-09-14T11:40:42.099+0000 7efc0c3fa9c0 5 AuthRegistry(0x7ffd9cb6fdf0) adding con mode: secure 2024-09-14T11:40:42.206 INFO:tasks.workunit.client.0.smithi138.stderr: -50> 2024-09-14T11:40:42.099+0000 7efc0c3fa9c0 5 AuthRegistry(0x7ffd9cb6fdf0) adding con mode: crc 2024-09-14T11:40:42.206 INFO:tasks.workunit.client.0.smithi138.stderr: -49> 2024-09-14T11:40:42.099+0000 7efc0c3fa9c0 5 AuthRegistry(0x7ffd9cb6fdf0) adding con mode: crc 2024-09-14T11:40:42.206 INFO:tasks.workunit.client.0.smithi138.stderr: -48> 2024-09-14T11:40:42.099+0000 7efc0c3fa9c0 5 AuthRegistry(0x7ffd9cb6fdf0) adding con mode: secure 2024-09-14T11:40:42.206 INFO:tasks.workunit.client.0.smithi138.stderr: -47> 2024-09-14T11:40:42.099+0000 7efc0c3fa9c0 5 AuthRegistry(0x7ffd9cb6fdf0) adding con mode: crc 2024-09-14T11:40:42.206 INFO:tasks.workunit.client.0.smithi138.stderr: -46> 2024-09-14T11:40:42.099+0000 7efc0c3fa9c0 5 AuthRegistry(0x7ffd9cb6fdf0) adding con mode: secure 2024-09-14T11:40:42.206 INFO:tasks.workunit.client.0.smithi138.stderr: -45> 2024-09-14T11:40:42.099+0000 7efc0c3fa9c0 5 AuthRegistry(0x7ffd9cb6fdf0) adding con mode: crc 2024-09-14T11:40:42.206 INFO:tasks.workunit.client.0.smithi138.stderr: -44> 2024-09-14T11:40:42.099+0000 7efc0c3fa9c0 5 AuthRegistry(0x7ffd9cb6fdf0) adding con mode: secure 2024-09-14T11:40:42.206 INFO:tasks.workunit.client.0.smithi138.stderr: -43> 2024-09-14T11:40:42.099+0000 7efc0c3fa9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:40:42.206 INFO:tasks.workunit.client.0.smithi138.stderr: -42> 2024-09-14T11:40:42.099+0000 7efc0c3fa9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:40:42.206 INFO:tasks.workunit.client.0.smithi138.stderr: -41> 2024-09-14T11:40:42.099+0000 7efc0c3fa9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:40:42.206 INFO:tasks.workunit.client.0.smithi138.stderr: -40> 2024-09-14T11:40:42.099+0000 7efc0c3fa9c0 5 asok(0x55fa6a3d0d90) register_command cache list hook 0x55fa6a680980 2024-09-14T11:40:42.207 INFO:tasks.workunit.client.0.smithi138.stderr: -39> 2024-09-14T11:40:42.099+0000 7efc0c3fa9c0 5 asok(0x55fa6a3d0d90) register_command cache inspect hook 0x55fa6a680980 2024-09-14T11:40:42.207 INFO:tasks.workunit.client.0.smithi138.stderr: -38> 2024-09-14T11:40:42.099+0000 7efc0c3fa9c0 5 asok(0x55fa6a3d0d90) register_command cache erase hook 0x55fa6a680980 2024-09-14T11:40:42.207 INFO:tasks.workunit.client.0.smithi138.stderr: -37> 2024-09-14T11:40:42.099+0000 7efc0c3fa9c0 5 asok(0x55fa6a3d0d90) register_command cache zap hook 0x55fa6a680980 2024-09-14T11:40:42.207 INFO:tasks.workunit.client.0.smithi138.stderr: -36> 2024-09-14T11:40:42.099+0000 7efc0c3fa9c0 5 note: GC not initialized 2024-09-14T11:40:42.207 INFO:tasks.workunit.client.0.smithi138.stderr: -35> 2024-09-14T11:40:42.099+0000 7efaba7fc640 20 reqs_thread_entry: start 2024-09-14T11:40:42.207 INFO:tasks.workunit.client.0.smithi138.stderr: -34> 2024-09-14T11:40:42.099+0000 7efc0c3fa9c0 5 asok(0x55fa6a3d0d90) register_command sync trace show hook 0x7efc00077070 2024-09-14T11:40:42.207 INFO:tasks.workunit.client.0.smithi138.stderr: -33> 2024-09-14T11:40:42.099+0000 7efc0c3fa9c0 5 asok(0x55fa6a3d0d90) register_command sync trace history hook 0x7efc00077070 2024-09-14T11:40:42.207 INFO:tasks.workunit.client.0.smithi138.stderr: -32> 2024-09-14T11:40:42.099+0000 7efc0c3fa9c0 5 asok(0x55fa6a3d0d90) register_command sync trace active hook 0x7efc00077070 2024-09-14T11:40:42.207 INFO:tasks.workunit.client.0.smithi138.stderr: -31> 2024-09-14T11:40:42.099+0000 7efc0c3fa9c0 5 asok(0x55fa6a3d0d90) register_command sync trace active_short hook 0x7efc00077070 2024-09-14T11:40:42.207 INFO:tasks.workunit.client.0.smithi138.stderr: -30> 2024-09-14T11:40:42.099+0000 7efc0c3fa9c0 20 init_complete bucket index max shards: 11 2024-09-14T11:40:42.207 INFO:tasks.workunit.client.0.smithi138.stderr: -29> 2024-09-14T11:40:42.099+0000 7efc0c3fa9c0 20 Filter name: none 2024-09-14T11:40:42.207 INFO:tasks.workunit.client.0.smithi138.stderr: -28> 2024-09-14T11:40:42.099+0000 7efa2bfff640 20 reqs_thread_entry: start 2024-09-14T11:40:42.207 INFO:tasks.workunit.client.0.smithi138.stderr: -27> 2024-09-14T11:40:42.099+0000 7efc0c3fa9c0 10 cache get: name=default.rgw.meta+root+a-bucket : miss 2024-09-14T11:40:42.208 INFO:tasks.workunit.client.0.smithi138.stderr: -26> 2024-09-14T11:40:42.099+0000 7efc0c3fa9c0 20 rados->read ofs=0 len=0 2024-09-14T11:40:42.208 INFO:tasks.workunit.client.0.smithi138.stderr: -25> 2024-09-14T11:40:42.103+0000 7efc0c3fa9c0 20 rados_obj.operate() r=0 bl.length=176 2024-09-14T11:40:42.208 INFO:tasks.workunit.client.0.smithi138.stderr: -24> 2024-09-14T11:40:42.103+0000 7efc0c3fa9c0 10 cache put: name=default.rgw.meta+root+a-bucket info.flags=0x11 2024-09-14T11:40:42.208 INFO:tasks.workunit.client.0.smithi138.stderr: -23> 2024-09-14T11:40:42.103+0000 7efc0c3fa9c0 10 adding default.rgw.meta+root+a-bucket to cache LRU end 2024-09-14T11:40:42.208 INFO:tasks.workunit.client.0.smithi138.stderr: -22> 2024-09-14T11:40:42.103+0000 7efc0c3fa9c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.17 : miss 2024-09-14T11:40:42.208 INFO:tasks.workunit.client.0.smithi138.stderr: -21> 2024-09-14T11:40:42.103+0000 7efc0c3fa9c0 20 rados->read ofs=0 len=0 2024-09-14T11:40:42.208 INFO:tasks.workunit.client.0.smithi138.stderr: -20> 2024-09-14T11:40:42.103+0000 7efc0c3fa9c0 20 rados_obj.operate() r=0 bl.length=430 2024-09-14T11:40:42.208 INFO:tasks.workunit.client.0.smithi138.stderr: -19> 2024-09-14T11:40:42.103+0000 7efc0c3fa9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.17 info.flags=0x17 2024-09-14T11:40:42.208 INFO:tasks.workunit.client.0.smithi138.stderr: -18> 2024-09-14T11:40:42.103+0000 7efc0c3fa9c0 10 adding default.rgw.meta+root+.bucket.meta.a-bucket:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.17 to cache LRU end 2024-09-14T11:40:42.208 INFO:tasks.workunit.client.0.smithi138.stderr: -17> 2024-09-14T11:40:42.103+0000 7efc0c3fa9c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:40:42.208 INFO:tasks.workunit.client.0.smithi138.stderr: -16> 2024-09-14T11:40:42.103+0000 7efc0c3fa9c0 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-14T11:40:42.208 INFO:tasks.workunit.client.0.smithi138.stderr: -15> 2024-09-14T11:40:42.103+0000 7efc0c3fa9c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.17 2024-09-14T11:40:42.208 INFO:tasks.workunit.client.0.smithi138.stderr: -14> 2024-09-14T11:40:42.103+0000 7efc0c3fa9c0 10 init_target_layout removing existing target index objects from a previous reshard attempt 2024-09-14T11:40:42.208 INFO:tasks.workunit.client.0.smithi138.stderr: -13> 2024-09-14T11:40:42.123+0000 7efc0c3fa9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.17 info.flags=0x17 2024-09-14T11:40:42.209 INFO:tasks.workunit.client.0.smithi138.stderr: -12> 2024-09-14T11:40:42.123+0000 7efc0c3fa9c0 10 moving default.rgw.meta+root+.bucket.meta.a-bucket:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.17 to cache LRU end 2024-09-14T11:40:42.209 INFO:tasks.workunit.client.0.smithi138.stderr: -11> 2024-09-14T11:40:42.123+0000 7efc0c3fa9c0 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-14T11:40:42.209 INFO:tasks.workunit.client.0.smithi138.stderr: -10> 2024-09-14T11:40:42.123+0000 7efc0c3fa9c0 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.a-bucket:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.17, ofs0, ns] 2024-09-14T11:40:42.209 INFO:tasks.workunit.client.0.smithi138.stderr: -9> 2024-09-14T11:40:42.123+0000 7efaecff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366242 cookie 94534015775408 notifier 8205 bl.length()=827 2024-09-14T11:40:42.209 INFO:tasks.workunit.client.0.smithi138.stderr: -8> 2024-09-14T11:40:42.123+0000 7efaecff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.17 info.flags=0x17 2024-09-14T11:40:42.209 INFO:tasks.workunit.client.0.smithi138.stderr: -7> 2024-09-14T11:40:42.123+0000 7efaecff9640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.a-bucket:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.17 to cache LRU end 2024-09-14T11:40:42.209 INFO:tasks.workunit.client.0.smithi138.stderr: -6> 2024-09-14T11:40:42.123+0000 7efaecff9640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=143 2024-09-14T11:40:42.209 INFO:tasks.workunit.client.0.smithi138.stderr: -5> 2024-09-14T11:40:42.127+0000 7efc0c3fa9c0 20 handle_bi_update(): bucket=:a-bucket[d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.17]): orig_sources= new_sources= 2024-09-14T11:40:42.209 INFO:tasks.workunit.client.0.smithi138.stderr: -4> 2024-09-14T11:40:42.127+0000 7efc0c3fa9c0 20 handle_bi_update(): bucket=:a-bucket[d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.17]): potential sources added=[] removed=[] 2024-09-14T11:40:42.209 INFO:tasks.workunit.client.0.smithi138.stderr: -3> 2024-09-14T11:40:42.127+0000 7efc0c3fa9c0 20 handle_bi_update(): bucket=:a-bucket[d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.17]): orig_dests= new_dests= 2024-09-14T11:40:42.209 INFO:tasks.workunit.client.0.smithi138.stderr: -2> 2024-09-14T11:40:42.127+0000 7efc0c3fa9c0 20 handle_bi_update(): bucket=:a-bucket[d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.17]): potential dests added=[] removed=[] 2024-09-14T11:40:42.209 INFO:tasks.workunit.client.0.smithi138.stderr: -1> 2024-09-14T11:40:42.135+0000 7efc0c3fa9c0 -1 ./src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7efc0c3fa9c0 time 2024-09-14T11:40:42.139277+0000 2024-09-14T11:40:42.209 INFO:tasks.workunit.client.0.smithi138.stderr:./src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-14T11:40:42.209 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-14T11:40:42.210 INFO:tasks.workunit.client.0.smithi138.stderr: ceph version 19.3.0-4907-ga2782315 (a2782315255a3e7d5f6cdc9eb35785187ff6ddf8) squid (dev) 2024-09-14T11:40:42.210 INFO:tasks.workunit.client.0.smithi138.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x121) [0x7efc0fcd42eb] 2024-09-14T11:40:42.210 INFO:tasks.workunit.client.0.smithi138.stderr: 2: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7efc0fcd449f] 2024-09-14T11:40:42.210 INFO:tasks.workunit.client.0.smithi138.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55fa68f09c01] 2024-09-14T11:40:42.210 INFO:tasks.workunit.client.0.smithi138.stderr: 4: radosgw-admin(+0x142325c) [0x55fa6996825c] 2024-09-14T11:40:42.210 INFO:tasks.workunit.client.0.smithi138.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x55fa68f1eecd] 2024-09-14T11:40:42.210 INFO:tasks.workunit.client.0.smithi138.stderr: 6: main() 2024-09-14T11:40:42.210 INFO:tasks.workunit.client.0.smithi138.stderr: 7: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7efc0eb3ad90] 2024-09-14T11:40:42.210 INFO:tasks.workunit.client.0.smithi138.stderr: 8: __libc_start_main() 2024-09-14T11:40:42.210 INFO:tasks.workunit.client.0.smithi138.stderr: 9: _start() 2024-09-14T11:40:42.210 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-14T11:40:42.210 INFO:tasks.workunit.client.0.smithi138.stderr: 0> 2024-09-14T11:40:42.139+0000 7efc0c3fa9c0 -1 *** Caught signal (Aborted) ** 2024-09-14T11:40:42.210 INFO:tasks.workunit.client.0.smithi138.stderr: in thread 7efc0c3fa9c0 thread_name:radosgw-admin 2024-09-14T11:40:42.210 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-14T11:40:42.211 INFO:tasks.workunit.client.0.smithi138.stderr: ceph version 19.3.0-4907-ga2782315 (a2782315255a3e7d5f6cdc9eb35785187ff6ddf8) squid (dev) 2024-09-14T11:40:42.211 INFO:tasks.workunit.client.0.smithi138.stderr: 1: /lib/x86_64-linux-gnu/libc.so.6(+0x42520) [0x7efc0eb53520] 2024-09-14T11:40:42.211 INFO:tasks.workunit.client.0.smithi138.stderr: 2: pthread_kill() 2024-09-14T11:40:42.211 INFO:tasks.workunit.client.0.smithi138.stderr: 3: raise() 2024-09-14T11:40:42.211 INFO:tasks.workunit.client.0.smithi138.stderr: 4: abort() 2024-09-14T11:40:42.211 INFO:tasks.workunit.client.0.smithi138.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x17b) [0x7efc0fcd4345] 2024-09-14T11:40:42.211 INFO:tasks.workunit.client.0.smithi138.stderr: 6: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7efc0fcd449f] 2024-09-14T11:40:42.211 INFO:tasks.workunit.client.0.smithi138.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55fa68f09c01] 2024-09-14T11:40:42.211 INFO:tasks.workunit.client.0.smithi138.stderr: 8: radosgw-admin(+0x142325c) [0x55fa6996825c] 2024-09-14T11:40:42.211 INFO:tasks.workunit.client.0.smithi138.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x55fa68f1eecd] 2024-09-14T11:40:42.211 INFO:tasks.workunit.client.0.smithi138.stderr: 10: main() 2024-09-14T11:40:42.211 INFO:tasks.workunit.client.0.smithi138.stderr: 11: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7efc0eb3ad90] 2024-09-14T11:40:42.211 INFO:tasks.workunit.client.0.smithi138.stderr: 12: __libc_start_main() 2024-09-14T11:40:42.211 INFO:tasks.workunit.client.0.smithi138.stderr: 13: _start() 2024-09-14T11:40:42.211 INFO:tasks.workunit.client.0.smithi138.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-14T11:40:42.212 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-14T11:40:42.212 INFO:tasks.workunit.client.0.smithi138.stderr:--- logging levels --- 2024-09-14T11:40:42.212 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 none 2024-09-14T11:40:42.212 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 1 lockdep 2024-09-14T11:40:42.212 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 1 context 2024-09-14T11:40:42.212 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 1 crush 2024-09-14T11:40:42.212 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 mds 2024-09-14T11:40:42.212 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 mds_balancer 2024-09-14T11:40:42.212 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 mds_locker 2024-09-14T11:40:42.212 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 mds_log 2024-09-14T11:40:42.212 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 mds_log_expire 2024-09-14T11:40:42.212 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 mds_migrator 2024-09-14T11:40:42.212 INFO:tasks.workunit.client.0.smithi138.stderr: 3/ 5 mds_quiesce 2024-09-14T11:40:42.212 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 1 buffer 2024-09-14T11:40:42.212 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 1 timer 2024-09-14T11:40:42.213 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 1 filer 2024-09-14T11:40:42.213 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 1 striper 2024-09-14T11:40:42.213 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 1 objecter 2024-09-14T11:40:42.213 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 rados 2024-09-14T11:40:42.213 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 rbd 2024-09-14T11:40:42.213 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 rbd_mirror 2024-09-14T11:40:42.213 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 rbd_replay 2024-09-14T11:40:42.213 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 rbd_pwl 2024-09-14T11:40:42.213 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 journaler 2024-09-14T11:40:42.213 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 objectcacher 2024-09-14T11:40:42.213 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 immutable_obj_cache 2024-09-14T11:40:42.213 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 client 2024-09-14T11:40:42.213 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 osd 2024-09-14T11:40:42.213 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 optracker 2024-09-14T11:40:42.213 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 objclass 2024-09-14T11:40:42.213 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 3 filestore 2024-09-14T11:40:42.214 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 3 journal 2024-09-14T11:40:42.214 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 0 ms 2024-09-14T11:40:42.214 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 mon 2024-09-14T11:40:42.214 INFO:tasks.workunit.client.0.smithi138.stderr: 0/10 monc 2024-09-14T11:40:42.214 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 paxos 2024-09-14T11:40:42.214 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 tp 2024-09-14T11:40:42.214 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 auth 2024-09-14T11:40:42.214 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 crypto 2024-09-14T11:40:42.214 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 1 finisher 2024-09-14T11:40:42.214 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 1 reserver 2024-09-14T11:40:42.214 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 heartbeatmap 2024-09-14T11:40:42.214 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 perfcounter 2024-09-14T11:40:42.214 INFO:tasks.workunit.client.0.smithi138.stderr: 20/20 rgw 2024-09-14T11:40:42.214 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 rgw_sync 2024-09-14T11:40:42.214 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 rgw_datacache 2024-09-14T11:40:42.215 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 rgw_access 2024-09-14T11:40:42.215 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 rgw_dbstore 2024-09-14T11:40:42.215 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 rgw_flight 2024-09-14T11:40:42.215 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 rgw_lifecycle 2024-09-14T11:40:42.215 INFO:tasks.workunit.client.0.smithi138.stderr: 20/20 rgw_notification 2024-09-14T11:40:42.215 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 javaclient 2024-09-14T11:40:42.215 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 asok 2024-09-14T11:40:42.215 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 1 throttle 2024-09-14T11:40:42.215 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 0 refs 2024-09-14T11:40:42.215 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 compressor 2024-09-14T11:40:42.215 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 bluestore 2024-09-14T11:40:42.215 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 bluefs 2024-09-14T11:40:42.215 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 3 bdev 2024-09-14T11:40:42.215 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 kstore 2024-09-14T11:40:42.215 INFO:tasks.workunit.client.0.smithi138.stderr: 4/ 5 rocksdb 2024-09-14T11:40:42.216 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 fuse 2024-09-14T11:40:42.216 INFO:tasks.workunit.client.0.smithi138.stderr: 2/ 5 mgr 2024-09-14T11:40:42.216 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 mgrc 2024-09-14T11:40:42.216 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 dpdk 2024-09-14T11:40:42.216 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 eventtrace 2024-09-14T11:40:42.216 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 prioritycache 2024-09-14T11:40:42.216 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 test 2024-09-14T11:40:42.216 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 cephfs_mirror 2024-09-14T11:40:42.216 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 cephsqlite 2024-09-14T11:40:42.216 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 crimson_interrupt 2024-09-14T11:40:42.216 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 seastore 2024-09-14T11:40:42.216 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 seastore_onode 2024-09-14T11:40:42.216 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 seastore_odata 2024-09-14T11:40:42.216 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 seastore_omap 2024-09-14T11:40:42.216 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 seastore_tm 2024-09-14T11:40:42.217 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 seastore_t 2024-09-14T11:40:42.217 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 seastore_cleaner 2024-09-14T11:40:42.217 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 seastore_epm 2024-09-14T11:40:42.217 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 seastore_lba 2024-09-14T11:40:42.217 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 seastore_fixedkv_tree 2024-09-14T11:40:42.217 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 seastore_cache 2024-09-14T11:40:42.217 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 seastore_journal 2024-09-14T11:40:42.217 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 seastore_device 2024-09-14T11:40:42.217 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 seastore_backref 2024-09-14T11:40:42.217 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 alienstore 2024-09-14T11:40:42.217 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 mclock 2024-09-14T11:40:42.217 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 cyanstore 2024-09-14T11:40:42.217 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 ceph_exporter 2024-09-14T11:40:42.217 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 memstore 2024-09-14T11:40:42.217 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 trace 2024-09-14T11:40:42.218 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 ceph_dedup 2024-09-14T11:40:42.218 INFO:tasks.workunit.client.0.smithi138.stderr: -2/-2 (syslog threshold) 2024-09-14T11:40:42.218 INFO:tasks.workunit.client.0.smithi138.stderr: 99/99 (stderr threshold) 2024-09-14T11:40:42.218 INFO:tasks.workunit.client.0.smithi138.stderr:--- pthread ID / name mapping for recent threads --- 2024-09-14T11:40:42.218 INFO:tasks.workunit.client.0.smithi138.stderr: 7efa2bfff640 / http_manager 2024-09-14T11:40:42.218 INFO:tasks.workunit.client.0.smithi138.stderr: 7efaba7fc640 / http_manager 2024-09-14T11:40:42.218 INFO:tasks.workunit.client.0.smithi138.stderr: 7efabb7fe640 / rgw_dt_lg_renew 2024-09-14T11:40:42.218 INFO:tasks.workunit.client.0.smithi138.stderr: 7efadb7fe640 / ms_dispatch 2024-09-14T11:40:42.218 INFO:tasks.workunit.client.0.smithi138.stderr: 7efaecff9640 / io_context_pool 2024-09-14T11:40:42.218 INFO:tasks.workunit.client.0.smithi138.stderr: 7efaed7fa640 / io_context_pool 2024-09-14T11:40:42.218 INFO:tasks.workunit.client.0.smithi138.stderr: 7efaef7fe640 / ms_dispatch 2024-09-14T11:40:42.218 INFO:tasks.workunit.client.0.smithi138.stderr: 7efaf6604640 / ms_dispatch 2024-09-14T11:40:42.218 INFO:tasks.workunit.client.0.smithi138.stderr: 7efaf7e07640 / io_context_pool 2024-09-14T11:40:42.218 INFO:tasks.workunit.client.0.smithi138.stderr: 7efc096ff640 / msgr-worker-2 2024-09-14T11:40:42.218 INFO:tasks.workunit.client.0.smithi138.stderr: 7efc09f00640 / msgr-worker-1 2024-09-14T11:40:42.219 INFO:tasks.workunit.client.0.smithi138.stderr: 7efc0a701640 / msgr-worker-0 2024-09-14T11:40:42.219 INFO:tasks.workunit.client.0.smithi138.stderr: 7efc0af02640 / io_context_pool 2024-09-14T11:40:42.219 INFO:tasks.workunit.client.0.smithi138.stderr: 7efc0c3fa9c0 / radosgw-admin 2024-09-14T11:40:42.219 INFO:tasks.workunit.client.0.smithi138.stderr: max_recent 500 2024-09-14T11:40:42.219 INFO:tasks.workunit.client.0.smithi138.stderr: max_new 1000 2024-09-14T11:40:42.219 INFO:tasks.workunit.client.0.smithi138.stderr: log_file /var/log/ceph/ceph-client.admin.143926.log 2024-09-14T11:40:42.219 INFO:tasks.workunit.client.0.smithi138.stderr:--- end dump of recent events --- 2024-09-14T11:40:42.219 INFO:tasks.workunit.client.0.smithi138.stderr:--- begin dump of recent events --- 2024-09-14T11:40:42.219 INFO:tasks.workunit.client.0.smithi138.stderr: -499> 2024-09-14T11:40:41.387+0000 7efaf7e07640 10 monclient: dump: 2024-09-14T11:40:42.219 INFO:tasks.workunit.client.0.smithi138.stderr:epoch 1 2024-09-14T11:40:42.219 INFO:tasks.workunit.client.0.smithi138.stderr:fsid 3f225f43-83a6-4aeb-b798-1f04bb49d597 2024-09-14T11:40:42.219 INFO:tasks.workunit.client.0.smithi138.stderr:last_changed 2024-09-14T11:07:09.252780+0000 2024-09-14T11:40:42.219 INFO:tasks.workunit.client.0.smithi138.stderr:created 2024-09-14T11:07:09.252780+0000 2024-09-14T11:40:42.219 INFO:tasks.workunit.client.0.smithi138.stderr:min_mon_release 19 (squid) 2024-09-14T11:40:42.219 INFO:tasks.workunit.client.0.smithi138.stderr:election_strategy: 1 2024-09-14T11:40:42.220 INFO:tasks.workunit.client.0.smithi138.stderr:0: [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] mon.a 2024-09-14T11:40:42.220 INFO:tasks.workunit.client.0.smithi138.stderr:1: [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] mon.b 2024-09-14T11:40:42.220 INFO:tasks.workunit.client.0.smithi138.stderr:2: [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] mon.c 2024-09-14T11:40:42.220 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-14T11:40:42.220 INFO:tasks.workunit.client.0.smithi138.stderr: -498> 2024-09-14T11:40:41.387+0000 7efaf7e07640 10 monclient: _finish_auth 0 2024-09-14T11:40:42.220 INFO:tasks.workunit.client.0.smithi138.stderr: -497> 2024-09-14T11:40:41.387+0000 7efaf7e07640 10 monclient: _check_auth_tickets 2024-09-14T11:40:42.220 INFO:tasks.workunit.client.0.smithi138.stderr: -496> 2024-09-14T11:40:41.387+0000 7efc0c3fa9c0 5 monclient: authenticate success, global_id 8193 2024-09-14T11:40:42.220 INFO:tasks.workunit.client.0.smithi138.stderr: -495> 2024-09-14T11:40:41.387+0000 7efaf7e07640 10 monclient: handle_config config(0 keys) 2024-09-14T11:40:42.220 INFO:tasks.workunit.client.0.smithi138.stderr: -494> 2024-09-14T11:40:41.387+0000 7efaf7e07640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:40:42.220 INFO:tasks.workunit.client.0.smithi138.stderr: -493> 2024-09-14T11:40:41.387+0000 7efaf7e07640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-14T11:40:42.220 INFO:tasks.workunit.client.0.smithi138.stderr: -492> 2024-09-14T11:40:41.387+0000 7efaf7e07640 10 monclient: dump: 2024-09-14T11:40:42.220 INFO:tasks.workunit.client.0.smithi138.stderr:epoch 1 2024-09-14T11:40:42.220 INFO:tasks.workunit.client.0.smithi138.stderr:fsid 3f225f43-83a6-4aeb-b798-1f04bb49d597 2024-09-14T11:40:42.220 INFO:tasks.workunit.client.0.smithi138.stderr:last_changed 2024-09-14T11:07:09.252780+0000 2024-09-14T11:40:42.221 INFO:tasks.workunit.client.0.smithi138.stderr:created 2024-09-14T11:07:09.252780+0000 2024-09-14T11:40:42.221 INFO:tasks.workunit.client.0.smithi138.stderr:min_mon_release 19 (squid) 2024-09-14T11:40:42.221 INFO:tasks.workunit.client.0.smithi138.stderr:election_strategy: 1 2024-09-14T11:40:42.221 INFO:tasks.workunit.client.0.smithi138.stderr:0: [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] mon.a 2024-09-14T11:40:42.221 INFO:tasks.workunit.client.0.smithi138.stderr:1: [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] mon.b 2024-09-14T11:40:42.221 INFO:tasks.workunit.client.0.smithi138.stderr:2: [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] mon.c 2024-09-14T11:40:42.221 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-14T11:40:42.221 INFO:tasks.workunit.client.0.smithi138.stderr: -491> 2024-09-14T11:40:41.387+0000 7efc0c3fa9c0 10 monclient: get_monmap_and_config success 2024-09-14T11:40:42.221 INFO:tasks.workunit.client.0.smithi138.stderr: -490> 2024-09-14T11:40:41.387+0000 7efc0c3fa9c0 4 set_mon_vals no callback set 2024-09-14T11:40:42.221 INFO:tasks.workunit.client.0.smithi138.stderr: -489> 2024-09-14T11:40:41.387+0000 7efc0c3fa9c0 10 monclient: shutdown 2024-09-14T11:40:42.221 INFO:tasks.workunit.client.0.smithi138.stderr: -488> 2024-09-14T11:40:41.387+0000 7efc0c3fa9c0 5 asok(0x55fa6a3d0d90) unregister_commands rotate-key 2024-09-14T11:40:42.221 INFO:tasks.workunit.client.0.smithi138.stderr: -487> 2024-09-14T11:40:41.387+0000 7efc0c3fa9c0 10 monclient: build_initial_monmap 2024-09-14T11:40:42.221 INFO:tasks.workunit.client.0.smithi138.stderr: -486> 2024-09-14T11:40:41.387+0000 7efc0c3fa9c0 1 build_initial for_mkfs: 0 2024-09-14T11:40:42.221 INFO:tasks.workunit.client.0.smithi138.stderr: -485> 2024-09-14T11:40:41.387+0000 7efc0c3fa9c0 10 monclient: monmap: 2024-09-14T11:40:42.221 INFO:tasks.workunit.client.0.smithi138.stderr:epoch 0 2024-09-14T11:40:42.221 INFO:tasks.workunit.client.0.smithi138.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-14T11:40:42.222 INFO:tasks.workunit.client.0.smithi138.stderr:last_changed 0.000000 2024-09-14T11:40:42.222 INFO:tasks.workunit.client.0.smithi138.stderr:created 0.000000 2024-09-14T11:40:42.222 INFO:tasks.workunit.client.0.smithi138.stderr:min_mon_release 0 (unknown) 2024-09-14T11:40:42.222 INFO:tasks.workunit.client.0.smithi138.stderr:election_strategy: 1 2024-09-14T11:40:42.222 INFO:tasks.workunit.client.0.smithi138.stderr:0: [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] mon.noname-a 2024-09-14T11:40:42.222 INFO:tasks.workunit.client.0.smithi138.stderr:1: [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] mon.noname-b 2024-09-14T11:40:42.222 INFO:tasks.workunit.client.0.smithi138.stderr:2: [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] mon.noname-c 2024-09-14T11:40:42.222 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-14T11:40:42.222 INFO:tasks.workunit.client.0.smithi138.stderr: -484> 2024-09-14T11:40:41.387+0000 7efc0c3fa9c0 5 AuthRegistry(0x55fa6a60aa10) adding auth protocol: cephx 2024-09-14T11:40:42.222 INFO:tasks.workunit.client.0.smithi138.stderr: -483> 2024-09-14T11:40:41.387+0000 7efc0c3fa9c0 5 AuthRegistry(0x55fa6a60aa10) adding auth protocol: cephx 2024-09-14T11:40:42.222 INFO:tasks.workunit.client.0.smithi138.stderr: -482> 2024-09-14T11:40:41.387+0000 7efc0c3fa9c0 5 AuthRegistry(0x55fa6a60aa10) adding auth protocol: cephx 2024-09-14T11:40:42.222 INFO:tasks.workunit.client.0.smithi138.stderr: -481> 2024-09-14T11:40:41.387+0000 7efc0c3fa9c0 5 AuthRegistry(0x55fa6a60aa10) adding con mode: secure 2024-09-14T11:40:42.222 INFO:tasks.workunit.client.0.smithi138.stderr: -480> 2024-09-14T11:40:41.387+0000 7efc0c3fa9c0 5 AuthRegistry(0x55fa6a60aa10) adding con mode: crc 2024-09-14T11:40:42.222 INFO:tasks.workunit.client.0.smithi138.stderr: -479> 2024-09-14T11:40:41.387+0000 7efc0c3fa9c0 5 AuthRegistry(0x55fa6a60aa10) adding con mode: secure 2024-09-14T11:40:42.223 INFO:tasks.workunit.client.0.smithi138.stderr: -478> 2024-09-14T11:40:41.387+0000 7efc0c3fa9c0 5 AuthRegistry(0x55fa6a60aa10) adding con mode: crc 2024-09-14T11:40:42.223 INFO:tasks.workunit.client.0.smithi138.stderr: -477> 2024-09-14T11:40:41.387+0000 7efc0c3fa9c0 5 AuthRegistry(0x55fa6a60aa10) adding con mode: secure 2024-09-14T11:40:42.223 INFO:tasks.workunit.client.0.smithi138.stderr: -476> 2024-09-14T11:40:41.387+0000 7efc0c3fa9c0 5 AuthRegistry(0x55fa6a60aa10) adding con mode: crc 2024-09-14T11:40:42.223 INFO:tasks.workunit.client.0.smithi138.stderr: -475> 2024-09-14T11:40:41.387+0000 7efc0c3fa9c0 5 AuthRegistry(0x55fa6a60aa10) adding con mode: crc 2024-09-14T11:40:42.223 INFO:tasks.workunit.client.0.smithi138.stderr: -474> 2024-09-14T11:40:41.387+0000 7efc0c3fa9c0 5 AuthRegistry(0x55fa6a60aa10) adding con mode: secure 2024-09-14T11:40:42.223 INFO:tasks.workunit.client.0.smithi138.stderr: -473> 2024-09-14T11:40:41.387+0000 7efc0c3fa9c0 5 AuthRegistry(0x55fa6a60aa10) adding con mode: crc 2024-09-14T11:40:42.223 INFO:tasks.workunit.client.0.smithi138.stderr: -472> 2024-09-14T11:40:41.387+0000 7efc0c3fa9c0 5 AuthRegistry(0x55fa6a60aa10) adding con mode: secure 2024-09-14T11:40:42.223 INFO:tasks.workunit.client.0.smithi138.stderr: -471> 2024-09-14T11:40:41.387+0000 7efc0c3fa9c0 5 AuthRegistry(0x55fa6a60aa10) adding con mode: crc 2024-09-14T11:40:42.223 INFO:tasks.workunit.client.0.smithi138.stderr: -470> 2024-09-14T11:40:41.387+0000 7efc0c3fa9c0 5 AuthRegistry(0x55fa6a60aa10) adding con mode: secure 2024-09-14T11:40:42.223 INFO:tasks.workunit.client.0.smithi138.stderr: -469> 2024-09-14T11:40:41.387+0000 7efc0c3fa9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:40:42.223 INFO:tasks.workunit.client.0.smithi138.stderr: -468> 2024-09-14T11:40:41.387+0000 7efc0c3fa9c0 1 librados: starting msgr at 2024-09-14T11:40:42.223 INFO:tasks.workunit.client.0.smithi138.stderr: -467> 2024-09-14T11:40:41.387+0000 7efc0c3fa9c0 1 librados: starting objecter 2024-09-14T11:40:42.223 INFO:tasks.workunit.client.0.smithi138.stderr: -466> 2024-09-14T11:40:41.387+0000 7efc0c3fa9c0 5 asok(0x55fa6a3d0d90) register_command objecter_requests hook 0x55fa6a60f5e0 2024-09-14T11:40:42.223 INFO:tasks.workunit.client.0.smithi138.stderr: -465> 2024-09-14T11:40:41.387+0000 7efc0c3fa9c0 1 librados: setting wanted keys 2024-09-14T11:40:42.223 INFO:tasks.workunit.client.0.smithi138.stderr: -464> 2024-09-14T11:40:41.387+0000 7efc0c3fa9c0 1 librados: calling monclient init 2024-09-14T11:40:42.224 INFO:tasks.workunit.client.0.smithi138.stderr: -463> 2024-09-14T11:40:41.387+0000 7efc0c3fa9c0 10 monclient: init 2024-09-14T11:40:42.224 INFO:tasks.workunit.client.0.smithi138.stderr: -462> 2024-09-14T11:40:41.387+0000 7efc0c3fa9c0 5 AuthRegistry(0x55fa6a5de200) adding auth protocol: cephx 2024-09-14T11:40:42.224 INFO:tasks.workunit.client.0.smithi138.stderr: -461> 2024-09-14T11:40:41.387+0000 7efc0c3fa9c0 5 AuthRegistry(0x55fa6a5de200) adding auth protocol: cephx 2024-09-14T11:40:42.224 INFO:tasks.workunit.client.0.smithi138.stderr: -460> 2024-09-14T11:40:41.387+0000 7efc0c3fa9c0 5 AuthRegistry(0x55fa6a5de200) adding auth protocol: cephx 2024-09-14T11:40:42.224 INFO:tasks.workunit.client.0.smithi138.stderr: -459> 2024-09-14T11:40:41.387+0000 7efc0c3fa9c0 5 AuthRegistry(0x55fa6a5de200) adding con mode: secure 2024-09-14T11:40:42.224 INFO:tasks.workunit.client.0.smithi138.stderr: -458> 2024-09-14T11:40:41.387+0000 7efc0c3fa9c0 5 AuthRegistry(0x55fa6a5de200) adding con mode: crc 2024-09-14T11:40:42.224 INFO:tasks.workunit.client.0.smithi138.stderr: -457> 2024-09-14T11:40:41.387+0000 7efc0c3fa9c0 5 AuthRegistry(0x55fa6a5de200) adding con mode: secure 2024-09-14T11:40:42.224 INFO:tasks.workunit.client.0.smithi138.stderr: -456> 2024-09-14T11:40:41.387+0000 7efc0c3fa9c0 5 AuthRegistry(0x55fa6a5de200) adding con mode: crc 2024-09-14T11:40:42.224 INFO:tasks.workunit.client.0.smithi138.stderr: -455> 2024-09-14T11:40:41.387+0000 7efc0c3fa9c0 5 AuthRegistry(0x55fa6a5de200) adding con mode: secure 2024-09-14T11:40:42.224 INFO:tasks.workunit.client.0.smithi138.stderr: -454> 2024-09-14T11:40:41.387+0000 7efc0c3fa9c0 5 AuthRegistry(0x55fa6a5de200) adding con mode: crc 2024-09-14T11:40:42.224 INFO:tasks.workunit.client.0.smithi138.stderr: -453> 2024-09-14T11:40:41.387+0000 7efc0c3fa9c0 5 AuthRegistry(0x55fa6a5de200) adding con mode: crc 2024-09-14T11:40:42.224 INFO:tasks.workunit.client.0.smithi138.stderr: -452> 2024-09-14T11:40:41.387+0000 7efc0c3fa9c0 5 AuthRegistry(0x55fa6a5de200) adding con mode: secure 2024-09-14T11:40:42.224 INFO:tasks.workunit.client.0.smithi138.stderr: -451> 2024-09-14T11:40:41.387+0000 7efc0c3fa9c0 5 AuthRegistry(0x55fa6a5de200) adding con mode: crc 2024-09-14T11:40:42.224 INFO:tasks.workunit.client.0.smithi138.stderr: -450> 2024-09-14T11:40:41.387+0000 7efc0c3fa9c0 5 AuthRegistry(0x55fa6a5de200) adding con mode: secure 2024-09-14T11:40:42.224 INFO:tasks.workunit.client.0.smithi138.stderr: -449> 2024-09-14T11:40:41.387+0000 7efc0c3fa9c0 5 AuthRegistry(0x55fa6a5de200) adding con mode: crc 2024-09-14T11:40:42.225 INFO:tasks.workunit.client.0.smithi138.stderr: -448> 2024-09-14T11:40:41.387+0000 7efc0c3fa9c0 5 AuthRegistry(0x55fa6a5de200) adding con mode: secure 2024-09-14T11:40:42.225 INFO:tasks.workunit.client.0.smithi138.stderr: -447> 2024-09-14T11:40:41.387+0000 7efc0c3fa9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:40:42.225 INFO:tasks.workunit.client.0.smithi138.stderr: -446> 2024-09-14T11:40:41.387+0000 7efc0c3fa9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:40:42.225 INFO:tasks.workunit.client.0.smithi138.stderr: -445> 2024-09-14T11:40:41.387+0000 7efc0c3fa9c0 5 asok(0x55fa6a3d0d90) register_command rotate-key hook 0x55fa6a5de348 2024-09-14T11:40:42.225 INFO:tasks.workunit.client.0.smithi138.stderr: -444> 2024-09-14T11:40:41.387+0000 7efc0c3fa9c0 10 monclient: _reopen_session rank -1 2024-09-14T11:40:42.225 INFO:tasks.workunit.client.0.smithi138.stderr: -443> 2024-09-14T11:40:41.387+0000 7efc0c3fa9c0 10 monclient: _add_conns ranks=[2,0,1] 2024-09-14T11:40:42.225 INFO:tasks.workunit.client.0.smithi138.stderr: -442> 2024-09-14T11:40:41.387+0000 7efc0c3fa9c0 10 monclient(hunting): picked mon.noname-c con 0x55fa6a48e5b0 addr [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] 2024-09-14T11:40:42.225 INFO:tasks.workunit.client.0.smithi138.stderr: -441> 2024-09-14T11:40:41.387+0000 7efc0c3fa9c0 10 monclient(hunting): picked mon.noname-a con 0x55fa6a499880 addr [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] 2024-09-14T11:40:42.225 INFO:tasks.workunit.client.0.smithi138.stderr: -440> 2024-09-14T11:40:41.387+0000 7efc0c3fa9c0 10 monclient(hunting): picked mon.noname-b con 0x55fa6a49a6e0 addr [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] 2024-09-14T11:40:42.225 INFO:tasks.workunit.client.0.smithi138.stderr: -439> 2024-09-14T11:40:41.387+0000 7efc0c3fa9c0 10 monclient(hunting): start opening mon connection 2024-09-14T11:40:42.225 INFO:tasks.workunit.client.0.smithi138.stderr: -438> 2024-09-14T11:40:41.387+0000 7efc0c3fa9c0 10 monclient(hunting): start opening mon connection 2024-09-14T11:40:42.225 INFO:tasks.workunit.client.0.smithi138.stderr: -437> 2024-09-14T11:40:41.387+0000 7efc0c3fa9c0 10 monclient(hunting): start opening mon connection 2024-09-14T11:40:42.225 INFO:tasks.workunit.client.0.smithi138.stderr: -436> 2024-09-14T11:40:41.387+0000 7efc0c3fa9c0 10 monclient(hunting): _renew_subs 2024-09-14T11:40:42.225 INFO:tasks.workunit.client.0.smithi138.stderr: -435> 2024-09-14T11:40:41.387+0000 7efc0c3fa9c0 10 monclient(hunting): authenticate will time out at 2977.351038s 2024-09-14T11:40:42.226 INFO:tasks.workunit.client.0.smithi138.stderr: -434> 2024-09-14T11:40:41.387+0000 7efc096ff640 10 monclient(hunting): get_auth_request con 0x55fa6a499880 auth_method 0 2024-09-14T11:40:42.226 INFO:tasks.workunit.client.0.smithi138.stderr: -433> 2024-09-14T11:40:41.387+0000 7efc096ff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:40:42.226 INFO:tasks.workunit.client.0.smithi138.stderr: -432> 2024-09-14T11:40:41.387+0000 7efc096ff640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:40:42.226 INFO:tasks.workunit.client.0.smithi138.stderr: -431> 2024-09-14T11:40:41.387+0000 7efc096ff640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:40:42.226 INFO:tasks.workunit.client.0.smithi138.stderr: -430> 2024-09-14T11:40:41.387+0000 7efc09f00640 10 monclient(hunting): get_auth_request con 0x55fa6a48e5b0 auth_method 0 2024-09-14T11:40:42.226 INFO:tasks.workunit.client.0.smithi138.stderr: -429> 2024-09-14T11:40:41.387+0000 7efc09f00640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:40:42.226 INFO:tasks.workunit.client.0.smithi138.stderr: -428> 2024-09-14T11:40:41.387+0000 7efc09f00640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:40:42.226 INFO:tasks.workunit.client.0.smithi138.stderr: -427> 2024-09-14T11:40:41.387+0000 7efc09f00640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:40:42.226 INFO:tasks.workunit.client.0.smithi138.stderr: -426> 2024-09-14T11:40:41.387+0000 7efc096ff640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:40:42.226 INFO:tasks.workunit.client.0.smithi138.stderr: -425> 2024-09-14T11:40:41.387+0000 7efc096ff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:40:42.226 INFO:tasks.workunit.client.0.smithi138.stderr: -424> 2024-09-14T11:40:41.387+0000 7efc096ff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:40:42.226 INFO:tasks.workunit.client.0.smithi138.stderr: -423> 2024-09-14T11:40:41.387+0000 7efc09f00640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:40:42.226 INFO:tasks.workunit.client.0.smithi138.stderr: -422> 2024-09-14T11:40:41.387+0000 7efc09f00640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:40:42.226 INFO:tasks.workunit.client.0.smithi138.stderr: -421> 2024-09-14T11:40:41.387+0000 7efc09f00640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:40:42.226 INFO:tasks.workunit.client.0.smithi138.stderr: -420> 2024-09-14T11:40:41.387+0000 7efc096ff640 10 monclient(hunting): handle_auth_done global_id 8196 payload 824 2024-09-14T11:40:42.227 INFO:tasks.workunit.client.0.smithi138.stderr: -419> 2024-09-14T11:40:41.387+0000 7efc096ff640 10 monclient: _finish_hunting 0 2024-09-14T11:40:42.227 INFO:tasks.workunit.client.0.smithi138.stderr: -418> 2024-09-14T11:40:41.387+0000 7efc096ff640 1 monclient: found mon.noname-a 2024-09-14T11:40:42.227 INFO:tasks.workunit.client.0.smithi138.stderr: -417> 2024-09-14T11:40:41.387+0000 7efc096ff640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.138:3300/0 2024-09-14T11:40:42.227 INFO:tasks.workunit.client.0.smithi138.stderr: -416> 2024-09-14T11:40:41.387+0000 7efaf6604640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:40:42.227 INFO:tasks.workunit.client.0.smithi138.stderr: -415> 2024-09-14T11:40:41.387+0000 7efaf6604640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-14T11:40:42.227 INFO:tasks.workunit.client.0.smithi138.stderr: -414> 2024-09-14T11:40:41.387+0000 7efaf6604640 10 monclient: dump: 2024-09-14T11:40:42.227 INFO:tasks.workunit.client.0.smithi138.stderr:epoch 1 2024-09-14T11:40:42.227 INFO:tasks.workunit.client.0.smithi138.stderr:fsid 3f225f43-83a6-4aeb-b798-1f04bb49d597 2024-09-14T11:40:42.227 INFO:tasks.workunit.client.0.smithi138.stderr:last_changed 2024-09-14T11:07:09.252780+0000 2024-09-14T11:40:42.227 INFO:tasks.workunit.client.0.smithi138.stderr:created 2024-09-14T11:07:09.252780+0000 2024-09-14T11:40:42.227 INFO:tasks.workunit.client.0.smithi138.stderr:min_mon_release 19 (squid) 2024-09-14T11:40:42.227 INFO:tasks.workunit.client.0.smithi138.stderr:election_strategy: 1 2024-09-14T11:40:42.227 INFO:tasks.workunit.client.0.smithi138.stderr:0: [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] mon.a 2024-09-14T11:40:42.227 INFO:tasks.workunit.client.0.smithi138.stderr:1: [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] mon.b 2024-09-14T11:40:42.227 INFO:tasks.workunit.client.0.smithi138.stderr:2: [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] mon.c 2024-09-14T11:40:42.228 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-14T11:40:42.228 INFO:tasks.workunit.client.0.smithi138.stderr: -413> 2024-09-14T11:40:41.387+0000 7efaf6604640 10 monclient: _finish_auth 0 2024-09-14T11:40:42.228 INFO:tasks.workunit.client.0.smithi138.stderr: -412> 2024-09-14T11:40:41.387+0000 7efaf6604640 10 monclient: _check_auth_tickets 2024-09-14T11:40:42.228 INFO:tasks.workunit.client.0.smithi138.stderr: -411> 2024-09-14T11:40:41.387+0000 7efaf6604640 10 monclient: handle_config config(0 keys) 2024-09-14T11:40:42.228 INFO:tasks.workunit.client.0.smithi138.stderr: -410> 2024-09-14T11:40:41.387+0000 7efaf6604640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:40:42.228 INFO:tasks.workunit.client.0.smithi138.stderr: -409> 2024-09-14T11:40:41.387+0000 7efaf6604640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-14T11:40:42.228 INFO:tasks.workunit.client.0.smithi138.stderr: -408> 2024-09-14T11:40:41.387+0000 7efaf6604640 10 monclient: dump: 2024-09-14T11:40:42.228 INFO:tasks.workunit.client.0.smithi138.stderr:epoch 1 2024-09-14T11:40:42.228 INFO:tasks.workunit.client.0.smithi138.stderr:fsid 3f225f43-83a6-4aeb-b798-1f04bb49d597 2024-09-14T11:40:42.228 INFO:tasks.workunit.client.0.smithi138.stderr:last_changed 2024-09-14T11:07:09.252780+0000 2024-09-14T11:40:42.228 INFO:tasks.workunit.client.0.smithi138.stderr:created 2024-09-14T11:07:09.252780+0000 2024-09-14T11:40:42.228 INFO:tasks.workunit.client.0.smithi138.stderr:min_mon_release 19 (squid) 2024-09-14T11:40:42.228 INFO:tasks.workunit.client.0.smithi138.stderr:election_strategy: 1 2024-09-14T11:40:42.228 INFO:tasks.workunit.client.0.smithi138.stderr:0: [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] mon.a 2024-09-14T11:40:42.228 INFO:tasks.workunit.client.0.smithi138.stderr:1: [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] mon.b 2024-09-14T11:40:42.229 INFO:tasks.workunit.client.0.smithi138.stderr:2: [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] mon.c 2024-09-14T11:40:42.229 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-14T11:40:42.229 INFO:tasks.workunit.client.0.smithi138.stderr: -407> 2024-09-14T11:40:41.387+0000 7efaf7e07640 4 set_mon_vals no callback set 2024-09-14T11:40:42.229 INFO:tasks.workunit.client.0.smithi138.stderr: -406> 2024-09-14T11:40:41.391+0000 7efc0c3fa9c0 5 monclient: authenticate success, global_id 8196 2024-09-14T11:40:42.229 INFO:tasks.workunit.client.0.smithi138.stderr: -405> 2024-09-14T11:40:41.391+0000 7efc0c3fa9c0 10 monclient: _renew_subs 2024-09-14T11:40:42.229 INFO:tasks.workunit.client.0.smithi138.stderr: -404> 2024-09-14T11:40:41.391+0000 7efc0c3fa9c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.138:3300/0 2024-09-14T11:40:42.229 INFO:tasks.workunit.client.0.smithi138.stderr: -403> 2024-09-14T11:40:41.391+0000 7efc0c3fa9c0 10 monclient: _renew_subs 2024-09-14T11:40:42.229 INFO:tasks.workunit.client.0.smithi138.stderr: -402> 2024-09-14T11:40:41.391+0000 7efc0c3fa9c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.138:3300/0 2024-09-14T11:40:42.229 INFO:tasks.workunit.client.0.smithi138.stderr: -401> 2024-09-14T11:40:41.391+0000 7efc0c3fa9c0 1 librados: init done 2024-09-14T11:40:42.229 INFO:tasks.workunit.client.0.smithi138.stderr: -400> 2024-09-14T11:40:41.391+0000 7efaf6604640 4 mgrc handle_mgr_map Got map version 5 2024-09-14T11:40:42.229 INFO:tasks.workunit.client.0.smithi138.stderr: -399> 2024-09-14T11:40:41.391+0000 7efaf6604640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.138:6832/3778043143,v1:172.21.15.138:6833/3778043143] 2024-09-14T11:40:42.229 INFO:tasks.workunit.client.0.smithi138.stderr: -398> 2024-09-14T11:40:41.391+0000 7efaf6604640 4 mgrc reconnect Starting new session with [v2:172.21.15.138:6832/3778043143,v1:172.21.15.138:6833/3778043143] 2024-09-14T11:40:42.229 INFO:tasks.workunit.client.0.smithi138.stderr: -397> 2024-09-14T11:40:41.391+0000 7efc09f00640 10 monclient: get_auth_request con 0x7efaf00718d0 auth_method 0 2024-09-14T11:40:42.229 INFO:tasks.workunit.client.0.smithi138.stderr: -396> 2024-09-14T11:40:41.391+0000 7efc0a701640 10 monclient: get_auth_request con 0x55fa6a609730 auth_method 0 2024-09-14T11:40:42.229 INFO:tasks.workunit.client.0.smithi138.stderr: -395> 2024-09-14T11:40:41.595+0000 7efc09f00640 10 monclient: get_auth_request con 0x55fa6a628f50 auth_method 0 2024-09-14T11:40:42.230 INFO:tasks.workunit.client.0.smithi138.stderr: -394> 2024-09-14T11:40:41.595+0000 7efc096ff640 10 monclient: get_auth_request con 0x55fa6a62d190 auth_method 0 2024-09-14T11:40:42.230 INFO:tasks.workunit.client.0.smithi138.stderr: -393> 2024-09-14T11:40:41.599+0000 7efc0a701640 10 monclient: get_auth_request con 0x55fa6a62c7e0 auth_method 0 2024-09-14T11:40:42.230 INFO:tasks.workunit.client.0.smithi138.stderr: -392> 2024-09-14T11:40:41.603+0000 7efc0c3fa9c0 10 monclient: build_initial_monmap 2024-09-14T11:40:42.230 INFO:tasks.workunit.client.0.smithi138.stderr: -391> 2024-09-14T11:40:41.603+0000 7efc0c3fa9c0 1 build_initial for_mkfs: 0 2024-09-14T11:40:42.230 INFO:tasks.workunit.client.0.smithi138.stderr: -390> 2024-09-14T11:40:41.603+0000 7efc0c3fa9c0 10 monclient: monmap: 2024-09-14T11:40:42.230 INFO:tasks.workunit.client.0.smithi138.stderr:epoch 0 2024-09-14T11:40:42.230 INFO:tasks.workunit.client.0.smithi138.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-14T11:40:42.230 INFO:tasks.workunit.client.0.smithi138.stderr:last_changed 0.000000 2024-09-14T11:40:42.230 INFO:tasks.workunit.client.0.smithi138.stderr:created 0.000000 2024-09-14T11:40:42.230 INFO:tasks.workunit.client.0.smithi138.stderr:min_mon_release 0 (unknown) 2024-09-14T11:40:42.230 INFO:tasks.workunit.client.0.smithi138.stderr:election_strategy: 1 2024-09-14T11:40:42.230 INFO:tasks.workunit.client.0.smithi138.stderr:0: [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] mon.noname-a 2024-09-14T11:40:42.230 INFO:tasks.workunit.client.0.smithi138.stderr:1: [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] mon.noname-b 2024-09-14T11:40:42.231 INFO:tasks.workunit.client.0.smithi138.stderr:2: [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] mon.noname-c 2024-09-14T11:40:42.231 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-14T11:40:42.231 INFO:tasks.workunit.client.0.smithi138.stderr: -389> 2024-09-14T11:40:41.603+0000 7efc0c3fa9c0 5 AuthRegistry(0x55fa6a635260) adding auth protocol: cephx 2024-09-14T11:40:42.231 INFO:tasks.workunit.client.0.smithi138.stderr: -388> 2024-09-14T11:40:41.603+0000 7efc0c3fa9c0 5 AuthRegistry(0x55fa6a635260) adding auth protocol: cephx 2024-09-14T11:40:42.231 INFO:tasks.workunit.client.0.smithi138.stderr: -387> 2024-09-14T11:40:41.603+0000 7efc0c3fa9c0 5 AuthRegistry(0x55fa6a635260) adding auth protocol: cephx 2024-09-14T11:40:42.231 INFO:tasks.workunit.client.0.smithi138.stderr: -386> 2024-09-14T11:40:41.603+0000 7efc0c3fa9c0 5 AuthRegistry(0x55fa6a635260) adding con mode: secure 2024-09-14T11:40:42.231 INFO:tasks.workunit.client.0.smithi138.stderr: -385> 2024-09-14T11:40:41.603+0000 7efc0c3fa9c0 5 AuthRegistry(0x55fa6a635260) adding con mode: crc 2024-09-14T11:40:42.231 INFO:tasks.workunit.client.0.smithi138.stderr: -384> 2024-09-14T11:40:41.603+0000 7efc0c3fa9c0 5 AuthRegistry(0x55fa6a635260) adding con mode: secure 2024-09-14T11:40:42.231 INFO:tasks.workunit.client.0.smithi138.stderr: -383> 2024-09-14T11:40:41.603+0000 7efc0c3fa9c0 5 AuthRegistry(0x55fa6a635260) adding con mode: crc 2024-09-14T11:40:42.231 INFO:tasks.workunit.client.0.smithi138.stderr: -382> 2024-09-14T11:40:41.603+0000 7efc0c3fa9c0 5 AuthRegistry(0x55fa6a635260) adding con mode: secure 2024-09-14T11:40:42.231 INFO:tasks.workunit.client.0.smithi138.stderr: -381> 2024-09-14T11:40:41.603+0000 7efc0c3fa9c0 5 AuthRegistry(0x55fa6a635260) adding con mode: crc 2024-09-14T11:40:42.231 INFO:tasks.workunit.client.0.smithi138.stderr: -380> 2024-09-14T11:40:41.603+0000 7efc0c3fa9c0 5 AuthRegistry(0x55fa6a635260) adding con mode: crc 2024-09-14T11:40:42.231 INFO:tasks.workunit.client.0.smithi138.stderr: -379> 2024-09-14T11:40:41.603+0000 7efc0c3fa9c0 5 AuthRegistry(0x55fa6a635260) adding con mode: secure 2024-09-14T11:40:42.231 INFO:tasks.workunit.client.0.smithi138.stderr: -378> 2024-09-14T11:40:41.603+0000 7efc0c3fa9c0 5 AuthRegistry(0x55fa6a635260) adding con mode: crc 2024-09-14T11:40:42.231 INFO:tasks.workunit.client.0.smithi138.stderr: -377> 2024-09-14T11:40:41.603+0000 7efc0c3fa9c0 5 AuthRegistry(0x55fa6a635260) adding con mode: secure 2024-09-14T11:40:42.232 INFO:tasks.workunit.client.0.smithi138.stderr: -376> 2024-09-14T11:40:41.603+0000 7efc0c3fa9c0 5 AuthRegistry(0x55fa6a635260) adding con mode: crc 2024-09-14T11:40:42.232 INFO:tasks.workunit.client.0.smithi138.stderr: -375> 2024-09-14T11:40:41.603+0000 7efc0c3fa9c0 5 AuthRegistry(0x55fa6a635260) adding con mode: secure 2024-09-14T11:40:42.232 INFO:tasks.workunit.client.0.smithi138.stderr: -374> 2024-09-14T11:40:41.603+0000 7efc0c3fa9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:40:42.232 INFO:tasks.workunit.client.0.smithi138.stderr: -373> 2024-09-14T11:40:41.603+0000 7efc0c3fa9c0 5 asok(0x55fa6a3d0d90) register_command objecter_requests cmddesc objecter_requests hook 0x55fa6a638bc0 EEXIST 2024-09-14T11:40:42.232 INFO:tasks.workunit.client.0.smithi138.stderr: -372> 2024-09-14T11:40:41.603+0000 7efc0c3fa9c0 10 monclient: init 2024-09-14T11:40:42.232 INFO:tasks.workunit.client.0.smithi138.stderr: -371> 2024-09-14T11:40:41.603+0000 7efc0c3fa9c0 5 AuthRegistry(0x55fa6a6341e8) adding auth protocol: cephx 2024-09-14T11:40:42.232 INFO:tasks.workunit.client.0.smithi138.stderr: -370> 2024-09-14T11:40:41.603+0000 7efc0c3fa9c0 5 AuthRegistry(0x55fa6a6341e8) adding auth protocol: cephx 2024-09-14T11:40:42.232 INFO:tasks.workunit.client.0.smithi138.stderr: -369> 2024-09-14T11:40:41.603+0000 7efc0c3fa9c0 5 AuthRegistry(0x55fa6a6341e8) adding auth protocol: cephx 2024-09-14T11:40:42.232 INFO:tasks.workunit.client.0.smithi138.stderr: -368> 2024-09-14T11:40:41.603+0000 7efc0c3fa9c0 5 AuthRegistry(0x55fa6a6341e8) adding con mode: secure 2024-09-14T11:40:42.232 INFO:tasks.workunit.client.0.smithi138.stderr: -367> 2024-09-14T11:40:41.603+0000 7efc0c3fa9c0 5 AuthRegistry(0x55fa6a6341e8) adding con mode: crc 2024-09-14T11:40:42.232 INFO:tasks.workunit.client.0.smithi138.stderr: -366> 2024-09-14T11:40:41.603+0000 7efc0c3fa9c0 5 AuthRegistry(0x55fa6a6341e8) adding con mode: secure 2024-09-14T11:40:42.232 INFO:tasks.workunit.client.0.smithi138.stderr: -365> 2024-09-14T11:40:41.603+0000 7efc0c3fa9c0 5 AuthRegistry(0x55fa6a6341e8) adding con mode: crc 2024-09-14T11:40:42.232 INFO:tasks.workunit.client.0.smithi138.stderr: -364> 2024-09-14T11:40:41.603+0000 7efc0c3fa9c0 5 AuthRegistry(0x55fa6a6341e8) adding con mode: secure 2024-09-14T11:40:42.232 INFO:tasks.workunit.client.0.smithi138.stderr: -363> 2024-09-14T11:40:41.603+0000 7efc0c3fa9c0 5 AuthRegistry(0x55fa6a6341e8) adding con mode: crc 2024-09-14T11:40:42.232 INFO:tasks.workunit.client.0.smithi138.stderr: -362> 2024-09-14T11:40:41.603+0000 7efc0c3fa9c0 5 AuthRegistry(0x55fa6a6341e8) adding con mode: crc 2024-09-14T11:40:42.233 INFO:tasks.workunit.client.0.smithi138.stderr: -361> 2024-09-14T11:40:41.603+0000 7efc0c3fa9c0 5 AuthRegistry(0x55fa6a6341e8) adding con mode: secure 2024-09-14T11:40:42.233 INFO:tasks.workunit.client.0.smithi138.stderr: -360> 2024-09-14T11:40:41.603+0000 7efc0c3fa9c0 5 AuthRegistry(0x55fa6a6341e8) adding con mode: crc 2024-09-14T11:40:42.233 INFO:tasks.workunit.client.0.smithi138.stderr: -359> 2024-09-14T11:40:41.603+0000 7efc0c3fa9c0 5 AuthRegistry(0x55fa6a6341e8) adding con mode: secure 2024-09-14T11:40:42.233 INFO:tasks.workunit.client.0.smithi138.stderr: -358> 2024-09-14T11:40:41.603+0000 7efc0c3fa9c0 5 AuthRegistry(0x55fa6a6341e8) adding con mode: crc 2024-09-14T11:40:42.233 INFO:tasks.workunit.client.0.smithi138.stderr: -357> 2024-09-14T11:40:41.603+0000 7efc0c3fa9c0 5 AuthRegistry(0x55fa6a6341e8) adding con mode: secure 2024-09-14T11:40:42.233 INFO:tasks.workunit.client.0.smithi138.stderr: -356> 2024-09-14T11:40:41.603+0000 7efc0c3fa9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:40:42.233 INFO:tasks.workunit.client.0.smithi138.stderr: -355> 2024-09-14T11:40:41.603+0000 7efc0c3fa9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:40:42.233 INFO:tasks.workunit.client.0.smithi138.stderr: -354> 2024-09-14T11:40:41.603+0000 7efc0c3fa9c0 5 asok(0x55fa6a3d0d90) register_command rotate-key cmddesc rotate-key hook 0x55fa6a634330 EEXIST 2024-09-14T11:40:42.233 INFO:tasks.workunit.client.0.smithi138.stderr: -353> 2024-09-14T11:40:41.603+0000 7efc0c3fa9c0 10 monclient: _reopen_session rank -1 2024-09-14T11:40:42.233 INFO:tasks.workunit.client.0.smithi138.stderr: -352> 2024-09-14T11:40:41.603+0000 7efc0c3fa9c0 10 monclient: _add_conns ranks=[0,2,1] 2024-09-14T11:40:42.233 INFO:tasks.workunit.client.0.smithi138.stderr: -351> 2024-09-14T11:40:41.603+0000 7efc0c3fa9c0 10 monclient(hunting): picked mon.noname-a con 0x55fa6a65cd70 addr [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] 2024-09-14T11:40:42.233 INFO:tasks.workunit.client.0.smithi138.stderr: -350> 2024-09-14T11:40:41.603+0000 7efc0c3fa9c0 10 monclient(hunting): picked mon.noname-c con 0x55fa6a65c6a0 addr [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] 2024-09-14T11:40:42.233 INFO:tasks.workunit.client.0.smithi138.stderr: -349> 2024-09-14T11:40:41.603+0000 7efc0c3fa9c0 10 monclient(hunting): picked mon.noname-b con 0x55fa6a65b080 addr [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] 2024-09-14T11:40:42.233 INFO:tasks.workunit.client.0.smithi138.stderr: -348> 2024-09-14T11:40:41.603+0000 7efc0c3fa9c0 10 monclient(hunting): start opening mon connection 2024-09-14T11:40:42.234 INFO:tasks.workunit.client.0.smithi138.stderr: -347> 2024-09-14T11:40:41.603+0000 7efc0c3fa9c0 10 monclient(hunting): start opening mon connection 2024-09-14T11:40:42.234 INFO:tasks.workunit.client.0.smithi138.stderr: -346> 2024-09-14T11:40:41.603+0000 7efc0c3fa9c0 10 monclient(hunting): start opening mon connection 2024-09-14T11:40:42.234 INFO:tasks.workunit.client.0.smithi138.stderr: -345> 2024-09-14T11:40:41.603+0000 7efc0c3fa9c0 10 monclient(hunting): _renew_subs 2024-09-14T11:40:42.234 INFO:tasks.workunit.client.0.smithi138.stderr: -344> 2024-09-14T11:40:41.603+0000 7efc0c3fa9c0 10 monclient(hunting): authenticate will time out at 2977.567445s 2024-09-14T11:40:42.234 INFO:tasks.workunit.client.0.smithi138.stderr: -343> 2024-09-14T11:40:41.603+0000 7efc096ff640 10 monclient(hunting): get_auth_request con 0x55fa6a65cd70 auth_method 0 2024-09-14T11:40:42.234 INFO:tasks.workunit.client.0.smithi138.stderr: -342> 2024-09-14T11:40:41.603+0000 7efc096ff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:40:42.234 INFO:tasks.workunit.client.0.smithi138.stderr: -341> 2024-09-14T11:40:41.603+0000 7efc096ff640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:40:42.234 INFO:tasks.workunit.client.0.smithi138.stderr: -340> 2024-09-14T11:40:41.603+0000 7efc096ff640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:40:42.234 INFO:tasks.workunit.client.0.smithi138.stderr: -339> 2024-09-14T11:40:41.603+0000 7efc096ff640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:40:42.234 INFO:tasks.workunit.client.0.smithi138.stderr: -338> 2024-09-14T11:40:41.603+0000 7efc096ff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:40:42.234 INFO:tasks.workunit.client.0.smithi138.stderr: -337> 2024-09-14T11:40:41.603+0000 7efc096ff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:40:42.234 INFO:tasks.workunit.client.0.smithi138.stderr: -336> 2024-09-14T11:40:41.603+0000 7efc0a701640 10 monclient(hunting): get_auth_request con 0x55fa6a65c6a0 auth_method 0 2024-09-14T11:40:42.234 INFO:tasks.workunit.client.0.smithi138.stderr: -335> 2024-09-14T11:40:41.603+0000 7efc0a701640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:40:42.234 INFO:tasks.workunit.client.0.smithi138.stderr: -334> 2024-09-14T11:40:41.603+0000 7efc0a701640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:40:42.235 INFO:tasks.workunit.client.0.smithi138.stderr: -333> 2024-09-14T11:40:41.603+0000 7efc0a701640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:40:42.235 INFO:tasks.workunit.client.0.smithi138.stderr: -332> 2024-09-14T11:40:41.603+0000 7efc09f00640 10 monclient(hunting): get_auth_request con 0x55fa6a65b080 auth_method 0 2024-09-14T11:40:42.235 INFO:tasks.workunit.client.0.smithi138.stderr: -331> 2024-09-14T11:40:41.603+0000 7efc09f00640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:40:42.235 INFO:tasks.workunit.client.0.smithi138.stderr: -330> 2024-09-14T11:40:41.603+0000 7efc09f00640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:40:42.235 INFO:tasks.workunit.client.0.smithi138.stderr: -329> 2024-09-14T11:40:41.603+0000 7efc09f00640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:40:42.235 INFO:tasks.workunit.client.0.smithi138.stderr: -328> 2024-09-14T11:40:41.607+0000 7efc0a701640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:40:42.235 INFO:tasks.workunit.client.0.smithi138.stderr: -327> 2024-09-14T11:40:41.607+0000 7efc0a701640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:40:42.235 INFO:tasks.workunit.client.0.smithi138.stderr: -326> 2024-09-14T11:40:41.607+0000 7efc0a701640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:40:42.235 INFO:tasks.workunit.client.0.smithi138.stderr: -325> 2024-09-14T11:40:41.607+0000 7efc096ff640 10 monclient(hunting): handle_auth_done global_id 8199 payload 824 2024-09-14T11:40:42.235 INFO:tasks.workunit.client.0.smithi138.stderr: -324> 2024-09-14T11:40:41.607+0000 7efc096ff640 10 monclient: _finish_hunting 0 2024-09-14T11:40:42.235 INFO:tasks.workunit.client.0.smithi138.stderr: -323> 2024-09-14T11:40:41.607+0000 7efc096ff640 1 monclient: found mon.noname-a 2024-09-14T11:40:42.235 INFO:tasks.workunit.client.0.smithi138.stderr: -322> 2024-09-14T11:40:41.607+0000 7efc096ff640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.138:3300/0 2024-09-14T11:40:42.235 INFO:tasks.workunit.client.0.smithi138.stderr: -321> 2024-09-14T11:40:41.607+0000 7efaef7fe640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:40:42.235 INFO:tasks.workunit.client.0.smithi138.stderr: -320> 2024-09-14T11:40:41.607+0000 7efaef7fe640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-14T11:40:42.236 INFO:tasks.workunit.client.0.smithi138.stderr: -319> 2024-09-14T11:40:41.607+0000 7efaef7fe640 10 monclient: dump: 2024-09-14T11:40:42.236 INFO:tasks.workunit.client.0.smithi138.stderr:epoch 1 2024-09-14T11:40:42.236 INFO:tasks.workunit.client.0.smithi138.stderr:fsid 3f225f43-83a6-4aeb-b798-1f04bb49d597 2024-09-14T11:40:42.236 INFO:tasks.workunit.client.0.smithi138.stderr:last_changed 2024-09-14T11:07:09.252780+0000 2024-09-14T11:40:42.236 INFO:tasks.workunit.client.0.smithi138.stderr:created 2024-09-14T11:07:09.252780+0000 2024-09-14T11:40:42.236 INFO:tasks.workunit.client.0.smithi138.stderr:min_mon_release 19 (squid) 2024-09-14T11:40:42.236 INFO:tasks.workunit.client.0.smithi138.stderr:election_strategy: 1 2024-09-14T11:40:42.236 INFO:tasks.workunit.client.0.smithi138.stderr:0: [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] mon.a 2024-09-14T11:40:42.236 INFO:tasks.workunit.client.0.smithi138.stderr:1: [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] mon.b 2024-09-14T11:40:42.236 INFO:tasks.workunit.client.0.smithi138.stderr:2: [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] mon.c 2024-09-14T11:40:42.236 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-14T11:40:42.236 INFO:tasks.workunit.client.0.smithi138.stderr: -318> 2024-09-14T11:40:41.607+0000 7efaef7fe640 10 monclient: _finish_auth 0 2024-09-14T11:40:42.236 INFO:tasks.workunit.client.0.smithi138.stderr: -317> 2024-09-14T11:40:41.607+0000 7efaef7fe640 10 monclient: _check_auth_tickets 2024-09-14T11:40:42.236 INFO:tasks.workunit.client.0.smithi138.stderr: -316> 2024-09-14T11:40:41.607+0000 7efaef7fe640 10 monclient: handle_config config(0 keys) 2024-09-14T11:40:42.237 INFO:tasks.workunit.client.0.smithi138.stderr: -315> 2024-09-14T11:40:41.607+0000 7efaef7fe640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:40:42.237 INFO:tasks.workunit.client.0.smithi138.stderr: -314> 2024-09-14T11:40:41.607+0000 7efaef7fe640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-14T11:40:42.237 INFO:tasks.workunit.client.0.smithi138.stderr: -313> 2024-09-14T11:40:41.607+0000 7efaef7fe640 10 monclient: dump: 2024-09-14T11:40:42.237 INFO:tasks.workunit.client.0.smithi138.stderr:epoch 1 2024-09-14T11:40:42.237 INFO:tasks.workunit.client.0.smithi138.stderr:fsid 3f225f43-83a6-4aeb-b798-1f04bb49d597 2024-09-14T11:40:42.237 INFO:tasks.workunit.client.0.smithi138.stderr:last_changed 2024-09-14T11:07:09.252780+0000 2024-09-14T11:40:42.237 INFO:tasks.workunit.client.0.smithi138.stderr:created 2024-09-14T11:07:09.252780+0000 2024-09-14T11:40:42.237 INFO:tasks.workunit.client.0.smithi138.stderr:min_mon_release 19 (squid) 2024-09-14T11:40:42.237 INFO:tasks.workunit.client.0.smithi138.stderr:election_strategy: 1 2024-09-14T11:40:42.237 INFO:tasks.workunit.client.0.smithi138.stderr:0: [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] mon.a 2024-09-14T11:40:42.237 INFO:tasks.workunit.client.0.smithi138.stderr:1: [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] mon.b 2024-09-14T11:40:42.237 INFO:tasks.workunit.client.0.smithi138.stderr:2: [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] mon.c 2024-09-14T11:40:42.237 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-14T11:40:42.237 INFO:tasks.workunit.client.0.smithi138.stderr: -312> 2024-09-14T11:40:41.607+0000 7efc0c3fa9c0 5 monclient: authenticate success, global_id 8199 2024-09-14T11:40:42.237 INFO:tasks.workunit.client.0.smithi138.stderr: -311> 2024-09-14T11:40:41.607+0000 7efc0af02640 4 set_mon_vals no callback set 2024-09-14T11:40:42.237 INFO:tasks.workunit.client.0.smithi138.stderr: -310> 2024-09-14T11:40:41.607+0000 7efc0c3fa9c0 10 monclient: _renew_subs 2024-09-14T11:40:42.238 INFO:tasks.workunit.client.0.smithi138.stderr: -309> 2024-09-14T11:40:41.607+0000 7efc0c3fa9c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.138:3300/0 2024-09-14T11:40:42.238 INFO:tasks.workunit.client.0.smithi138.stderr: -308> 2024-09-14T11:40:41.607+0000 7efc0c3fa9c0 10 monclient: _renew_subs 2024-09-14T11:40:42.238 INFO:tasks.workunit.client.0.smithi138.stderr: -307> 2024-09-14T11:40:41.607+0000 7efc0c3fa9c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.138:3300/0 2024-09-14T11:40:42.238 INFO:tasks.workunit.client.0.smithi138.stderr: -306> 2024-09-14T11:40:41.607+0000 7efaef7fe640 4 mgrc handle_mgr_map Got map version 5 2024-09-14T11:40:42.238 INFO:tasks.workunit.client.0.smithi138.stderr: -305> 2024-09-14T11:40:41.607+0000 7efaef7fe640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.138:6832/3778043143,v1:172.21.15.138:6833/3778043143] 2024-09-14T11:40:42.238 INFO:tasks.workunit.client.0.smithi138.stderr: -304> 2024-09-14T11:40:41.607+0000 7efaef7fe640 4 mgrc reconnect Starting new session with [v2:172.21.15.138:6832/3778043143,v1:172.21.15.138:6833/3778043143] 2024-09-14T11:40:42.238 INFO:tasks.workunit.client.0.smithi138.stderr: -303> 2024-09-14T11:40:41.607+0000 7efc0a701640 10 monclient: get_auth_request con 0x7efae40717e0 auth_method 0 2024-09-14T11:40:42.238 INFO:tasks.workunit.client.0.smithi138.stderr: -302> 2024-09-14T11:40:41.607+0000 7efc0c3fa9c0 10 monclient: get_monmap_and_config 2024-09-14T11:40:42.238 INFO:tasks.workunit.client.0.smithi138.stderr: -301> 2024-09-14T11:40:41.607+0000 7efc0c3fa9c0 10 monclient: build_initial_monmap 2024-09-14T11:40:42.238 INFO:tasks.workunit.client.0.smithi138.stderr: -300> 2024-09-14T11:40:41.607+0000 7efc0c3fa9c0 1 build_initial for_mkfs: 0 2024-09-14T11:40:42.238 INFO:tasks.workunit.client.0.smithi138.stderr: -299> 2024-09-14T11:40:41.607+0000 7efc0c3fa9c0 10 monclient: monmap: 2024-09-14T11:40:42.238 INFO:tasks.workunit.client.0.smithi138.stderr:epoch 0 2024-09-14T11:40:42.238 INFO:tasks.workunit.client.0.smithi138.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-14T11:40:42.239 INFO:tasks.workunit.client.0.smithi138.stderr:last_changed 0.000000 2024-09-14T11:40:42.239 INFO:tasks.workunit.client.0.smithi138.stderr:created 0.000000 2024-09-14T11:40:42.239 INFO:tasks.workunit.client.0.smithi138.stderr:min_mon_release 0 (unknown) 2024-09-14T11:40:42.239 INFO:tasks.workunit.client.0.smithi138.stderr:election_strategy: 1 2024-09-14T11:40:42.239 INFO:tasks.workunit.client.0.smithi138.stderr:0: [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] mon.noname-a 2024-09-14T11:40:42.239 INFO:tasks.workunit.client.0.smithi138.stderr:1: [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] mon.noname-b 2024-09-14T11:40:42.239 INFO:tasks.workunit.client.0.smithi138.stderr:2: [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] mon.noname-c 2024-09-14T11:40:42.239 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-14T11:40:42.239 INFO:tasks.workunit.client.0.smithi138.stderr: -298> 2024-09-14T11:40:41.607+0000 7efc0c3fa9c0 5 AuthRegistry(0x55fa6a67c5b0) adding auth protocol: cephx 2024-09-14T11:40:42.239 INFO:tasks.workunit.client.0.smithi138.stderr: -297> 2024-09-14T11:40:41.607+0000 7efc0c3fa9c0 5 AuthRegistry(0x55fa6a67c5b0) adding auth protocol: cephx 2024-09-14T11:40:42.239 INFO:tasks.workunit.client.0.smithi138.stderr: -296> 2024-09-14T11:40:41.607+0000 7efc0c3fa9c0 5 AuthRegistry(0x55fa6a67c5b0) adding auth protocol: cephx 2024-09-14T11:40:42.239 INFO:tasks.workunit.client.0.smithi138.stderr: -295> 2024-09-14T11:40:41.607+0000 7efc0c3fa9c0 5 AuthRegistry(0x55fa6a67c5b0) adding con mode: secure 2024-09-14T11:40:42.239 INFO:tasks.workunit.client.0.smithi138.stderr: -294> 2024-09-14T11:40:41.607+0000 7efc0c3fa9c0 5 AuthRegistry(0x55fa6a67c5b0) adding con mode: crc 2024-09-14T11:40:42.239 INFO:tasks.workunit.client.0.smithi138.stderr: -293> 2024-09-14T11:40:41.607+0000 7efc0c3fa9c0 5 AuthRegistry(0x55fa6a67c5b0) adding con mode: secure 2024-09-14T11:40:42.239 INFO:tasks.workunit.client.0.smithi138.stderr: -292> 2024-09-14T11:40:41.607+0000 7efc0c3fa9c0 5 AuthRegistry(0x55fa6a67c5b0) adding con mode: crc 2024-09-14T11:40:42.240 INFO:tasks.workunit.client.0.smithi138.stderr: -291> 2024-09-14T11:40:41.607+0000 7efc0c3fa9c0 5 AuthRegistry(0x55fa6a67c5b0) adding con mode: secure 2024-09-14T11:40:42.240 INFO:tasks.workunit.client.0.smithi138.stderr: -290> 2024-09-14T11:40:41.607+0000 7efc0c3fa9c0 5 AuthRegistry(0x55fa6a67c5b0) adding con mode: crc 2024-09-14T11:40:42.240 INFO:tasks.workunit.client.0.smithi138.stderr: -289> 2024-09-14T11:40:41.607+0000 7efc0c3fa9c0 5 AuthRegistry(0x55fa6a67c5b0) adding con mode: crc 2024-09-14T11:40:42.240 INFO:tasks.workunit.client.0.smithi138.stderr: -288> 2024-09-14T11:40:41.607+0000 7efc0c3fa9c0 5 AuthRegistry(0x55fa6a67c5b0) adding con mode: secure 2024-09-14T11:40:42.240 INFO:tasks.workunit.client.0.smithi138.stderr: -287> 2024-09-14T11:40:41.607+0000 7efc0c3fa9c0 5 AuthRegistry(0x55fa6a67c5b0) adding con mode: crc 2024-09-14T11:40:42.240 INFO:tasks.workunit.client.0.smithi138.stderr: -286> 2024-09-14T11:40:41.607+0000 7efc0c3fa9c0 5 AuthRegistry(0x55fa6a67c5b0) adding con mode: secure 2024-09-14T11:40:42.240 INFO:tasks.workunit.client.0.smithi138.stderr: -285> 2024-09-14T11:40:41.607+0000 7efc0c3fa9c0 5 AuthRegistry(0x55fa6a67c5b0) adding con mode: crc 2024-09-14T11:40:42.240 INFO:tasks.workunit.client.0.smithi138.stderr: -284> 2024-09-14T11:40:41.607+0000 7efc0c3fa9c0 5 AuthRegistry(0x55fa6a67c5b0) adding con mode: secure 2024-09-14T11:40:42.240 INFO:tasks.workunit.client.0.smithi138.stderr: -283> 2024-09-14T11:40:41.611+0000 7efc0c3fa9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:40:42.240 INFO:tasks.workunit.client.0.smithi138.stderr: -282> 2024-09-14T11:40:41.611+0000 7efc0c3fa9c0 10 monclient: init 2024-09-14T11:40:42.240 INFO:tasks.workunit.client.0.smithi138.stderr: -281> 2024-09-14T11:40:41.611+0000 7efc0c3fa9c0 5 AuthRegistry(0x7ffd9cb6f910) adding auth protocol: cephx 2024-09-14T11:40:42.240 INFO:tasks.workunit.client.0.smithi138.stderr: -280> 2024-09-14T11:40:41.611+0000 7efc0c3fa9c0 5 AuthRegistry(0x7ffd9cb6f910) adding auth protocol: cephx 2024-09-14T11:40:42.240 INFO:tasks.workunit.client.0.smithi138.stderr: -279> 2024-09-14T11:40:41.611+0000 7efc0c3fa9c0 5 AuthRegistry(0x7ffd9cb6f910) adding auth protocol: cephx 2024-09-14T11:40:42.240 INFO:tasks.workunit.client.0.smithi138.stderr: -278> 2024-09-14T11:40:41.611+0000 7efc0c3fa9c0 5 AuthRegistry(0x7ffd9cb6f910) adding con mode: secure 2024-09-14T11:40:42.240 INFO:tasks.workunit.client.0.smithi138.stderr: -277> 2024-09-14T11:40:41.611+0000 7efc0c3fa9c0 5 AuthRegistry(0x7ffd9cb6f910) adding con mode: crc 2024-09-14T11:40:42.241 INFO:tasks.workunit.client.0.smithi138.stderr: -276> 2024-09-14T11:40:41.611+0000 7efc0c3fa9c0 5 AuthRegistry(0x7ffd9cb6f910) adding con mode: secure 2024-09-14T11:40:42.241 INFO:tasks.workunit.client.0.smithi138.stderr: -275> 2024-09-14T11:40:41.611+0000 7efc0c3fa9c0 5 AuthRegistry(0x7ffd9cb6f910) adding con mode: crc 2024-09-14T11:40:42.241 INFO:tasks.workunit.client.0.smithi138.stderr: -274> 2024-09-14T11:40:41.611+0000 7efc0c3fa9c0 5 AuthRegistry(0x7ffd9cb6f910) adding con mode: secure 2024-09-14T11:40:42.241 INFO:tasks.workunit.client.0.smithi138.stderr: -273> 2024-09-14T11:40:41.611+0000 7efc0c3fa9c0 5 AuthRegistry(0x7ffd9cb6f910) adding con mode: crc 2024-09-14T11:40:42.241 INFO:tasks.workunit.client.0.smithi138.stderr: -272> 2024-09-14T11:40:41.611+0000 7efc0c3fa9c0 5 AuthRegistry(0x7ffd9cb6f910) adding con mode: crc 2024-09-14T11:40:42.241 INFO:tasks.workunit.client.0.smithi138.stderr: -271> 2024-09-14T11:40:41.611+0000 7efc0c3fa9c0 5 AuthRegistry(0x7ffd9cb6f910) adding con mode: secure 2024-09-14T11:40:42.241 INFO:tasks.workunit.client.0.smithi138.stderr: -270> 2024-09-14T11:40:41.611+0000 7efc0c3fa9c0 5 AuthRegistry(0x7ffd9cb6f910) adding con mode: crc 2024-09-14T11:40:42.241 INFO:tasks.workunit.client.0.smithi138.stderr: -269> 2024-09-14T11:40:41.611+0000 7efc0c3fa9c0 5 AuthRegistry(0x7ffd9cb6f910) adding con mode: secure 2024-09-14T11:40:42.241 INFO:tasks.workunit.client.0.smithi138.stderr: -268> 2024-09-14T11:40:41.611+0000 7efc0c3fa9c0 5 AuthRegistry(0x7ffd9cb6f910) adding con mode: crc 2024-09-14T11:40:42.241 INFO:tasks.workunit.client.0.smithi138.stderr: -267> 2024-09-14T11:40:41.611+0000 7efc0c3fa9c0 5 AuthRegistry(0x7ffd9cb6f910) adding con mode: secure 2024-09-14T11:40:42.241 INFO:tasks.workunit.client.0.smithi138.stderr: -266> 2024-09-14T11:40:41.611+0000 7efc0c3fa9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:40:42.241 INFO:tasks.workunit.client.0.smithi138.stderr: -265> 2024-09-14T11:40:41.611+0000 7efc0c3fa9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:40:42.241 INFO:tasks.workunit.client.0.smithi138.stderr: -264> 2024-09-14T11:40:41.611+0000 7efc0c3fa9c0 5 asok(0x55fa6a3d0d90) register_command rotate-key cmddesc rotate-key hook 0x7ffd9cb6fa58 EEXIST 2024-09-14T11:40:42.241 INFO:tasks.workunit.client.0.smithi138.stderr: -263> 2024-09-14T11:40:41.611+0000 7efc0c3fa9c0 10 monclient: _reopen_session rank -1 2024-09-14T11:40:42.241 INFO:tasks.workunit.client.0.smithi138.stderr: -262> 2024-09-14T11:40:41.611+0000 7efc0c3fa9c0 10 monclient: _add_conns ranks=[2,1,0] 2024-09-14T11:40:42.242 INFO:tasks.workunit.client.0.smithi138.stderr: -261> 2024-09-14T11:40:41.611+0000 7efc0c3fa9c0 10 monclient(hunting): picked mon.noname-c con 0x55fa6a6b0ab0 addr [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] 2024-09-14T11:40:42.242 INFO:tasks.workunit.client.0.smithi138.stderr: -260> 2024-09-14T11:40:41.611+0000 7efc0c3fa9c0 10 monclient(hunting): picked mon.noname-b con 0x55fa6a6abea0 addr [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] 2024-09-14T11:40:42.242 INFO:tasks.workunit.client.0.smithi138.stderr: -259> 2024-09-14T11:40:41.611+0000 7efc0c3fa9c0 10 monclient(hunting): picked mon.noname-a con 0x55fa6a6ac820 addr [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] 2024-09-14T11:40:42.242 INFO:tasks.workunit.client.0.smithi138.stderr: -258> 2024-09-14T11:40:41.611+0000 7efc0c3fa9c0 10 monclient(hunting): start opening mon connection 2024-09-14T11:40:42.242 INFO:tasks.workunit.client.0.smithi138.stderr: -257> 2024-09-14T11:40:41.611+0000 7efc0c3fa9c0 10 monclient(hunting): start opening mon connection 2024-09-14T11:40:42.242 INFO:tasks.workunit.client.0.smithi138.stderr: -256> 2024-09-14T11:40:41.611+0000 7efc0c3fa9c0 10 monclient(hunting): start opening mon connection 2024-09-14T11:40:42.242 INFO:tasks.workunit.client.0.smithi138.stderr: -255> 2024-09-14T11:40:41.611+0000 7efc0c3fa9c0 10 monclient(hunting): _renew_subs 2024-09-14T11:40:42.242 INFO:tasks.workunit.client.0.smithi138.stderr: -254> 2024-09-14T11:40:41.611+0000 7efc0c3fa9c0 10 monclient(hunting): authenticate will time out at 2977.574393s 2024-09-14T11:40:42.242 INFO:tasks.workunit.client.0.smithi138.stderr: -253> 2024-09-14T11:40:41.611+0000 7efc096ff640 10 monclient(hunting): get_auth_request con 0x55fa6a6b0ab0 auth_method 0 2024-09-14T11:40:42.242 INFO:tasks.workunit.client.0.smithi138.stderr: -252> 2024-09-14T11:40:41.611+0000 7efc096ff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:40:42.242 INFO:tasks.workunit.client.0.smithi138.stderr: -251> 2024-09-14T11:40:41.611+0000 7efc096ff640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:40:42.242 INFO:tasks.workunit.client.0.smithi138.stderr: -250> 2024-09-14T11:40:41.611+0000 7efc096ff640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:40:42.242 INFO:tasks.workunit.client.0.smithi138.stderr: -249> 2024-09-14T11:40:41.611+0000 7efc09f00640 10 monclient(hunting): get_auth_request con 0x55fa6a6ac820 auth_method 0 2024-09-14T11:40:42.242 INFO:tasks.workunit.client.0.smithi138.stderr: -248> 2024-09-14T11:40:41.611+0000 7efc09f00640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:40:42.243 INFO:tasks.workunit.client.0.smithi138.stderr: -247> 2024-09-14T11:40:41.611+0000 7efc09f00640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:40:42.243 INFO:tasks.workunit.client.0.smithi138.stderr: -246> 2024-09-14T11:40:41.611+0000 7efc09f00640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:40:42.243 INFO:tasks.workunit.client.0.smithi138.stderr: -245> 2024-09-14T11:40:41.611+0000 7efc096ff640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:40:42.243 INFO:tasks.workunit.client.0.smithi138.stderr: -244> 2024-09-14T11:40:41.611+0000 7efc096ff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:40:42.243 INFO:tasks.workunit.client.0.smithi138.stderr: -243> 2024-09-14T11:40:41.611+0000 7efc096ff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:40:42.243 INFO:tasks.workunit.client.0.smithi138.stderr: -242> 2024-09-14T11:40:41.611+0000 7efc0a701640 10 monclient(hunting): get_auth_request con 0x55fa6a6abea0 auth_method 0 2024-09-14T11:40:42.243 INFO:tasks.workunit.client.0.smithi138.stderr: -241> 2024-09-14T11:40:41.611+0000 7efc0a701640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:40:42.243 INFO:tasks.workunit.client.0.smithi138.stderr: -240> 2024-09-14T11:40:41.611+0000 7efc0a701640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:40:42.243 INFO:tasks.workunit.client.0.smithi138.stderr: -239> 2024-09-14T11:40:41.611+0000 7efc0a701640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:40:42.243 INFO:tasks.workunit.client.0.smithi138.stderr: -238> 2024-09-14T11:40:41.611+0000 7efc09f00640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:40:42.243 INFO:tasks.workunit.client.0.smithi138.stderr: -237> 2024-09-14T11:40:41.611+0000 7efc09f00640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:40:42.243 INFO:tasks.workunit.client.0.smithi138.stderr: -236> 2024-09-14T11:40:41.611+0000 7efc09f00640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:40:42.243 INFO:tasks.workunit.client.0.smithi138.stderr: -235> 2024-09-14T11:40:41.611+0000 7efc096ff640 10 monclient(hunting): handle_auth_done global_id 7661 payload 274 2024-09-14T11:40:42.243 INFO:tasks.workunit.client.0.smithi138.stderr: -234> 2024-09-14T11:40:41.611+0000 7efc096ff640 10 monclient: _finish_hunting 0 2024-09-14T11:40:42.243 INFO:tasks.workunit.client.0.smithi138.stderr: -233> 2024-09-14T11:40:41.611+0000 7efc096ff640 1 monclient: found mon.noname-c 2024-09-14T11:40:42.243 INFO:tasks.workunit.client.0.smithi138.stderr: -232> 2024-09-14T11:40:41.611+0000 7efc096ff640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.138:3301/0 2024-09-14T11:40:42.244 INFO:tasks.workunit.client.0.smithi138.stderr: -231> 2024-09-14T11:40:41.611+0000 7efaed7fa640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:40:42.244 INFO:tasks.workunit.client.0.smithi138.stderr: -230> 2024-09-14T11:40:41.611+0000 7efaed7fa640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-14T11:40:42.244 INFO:tasks.workunit.client.0.smithi138.stderr: -229> 2024-09-14T11:40:41.611+0000 7efaed7fa640 10 monclient: dump: 2024-09-14T11:40:42.244 INFO:tasks.workunit.client.0.smithi138.stderr:epoch 1 2024-09-14T11:40:42.244 INFO:tasks.workunit.client.0.smithi138.stderr:fsid 3f225f43-83a6-4aeb-b798-1f04bb49d597 2024-09-14T11:40:42.244 INFO:tasks.workunit.client.0.smithi138.stderr:last_changed 2024-09-14T11:07:09.252780+0000 2024-09-14T11:40:42.244 INFO:tasks.workunit.client.0.smithi138.stderr:created 2024-09-14T11:07:09.252780+0000 2024-09-14T11:40:42.244 INFO:tasks.workunit.client.0.smithi138.stderr:min_mon_release 19 (squid) 2024-09-14T11:40:42.244 INFO:tasks.workunit.client.0.smithi138.stderr:election_strategy: 1 2024-09-14T11:40:42.244 INFO:tasks.workunit.client.0.smithi138.stderr:0: [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] mon.a 2024-09-14T11:40:42.244 INFO:tasks.workunit.client.0.smithi138.stderr:1: [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] mon.b 2024-09-14T11:40:42.244 INFO:tasks.workunit.client.0.smithi138.stderr:2: [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] mon.c 2024-09-14T11:40:42.244 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-14T11:40:42.244 INFO:tasks.workunit.client.0.smithi138.stderr: -228> 2024-09-14T11:40:41.611+0000 7efaed7fa640 10 monclient: _finish_auth 0 2024-09-14T11:40:42.244 INFO:tasks.workunit.client.0.smithi138.stderr: -227> 2024-09-14T11:40:41.611+0000 7efaed7fa640 10 monclient: _check_auth_tickets 2024-09-14T11:40:42.245 INFO:tasks.workunit.client.0.smithi138.stderr: -226> 2024-09-14T11:40:41.611+0000 7efaed7fa640 10 monclient: handle_config config(0 keys) 2024-09-14T11:40:42.245 INFO:tasks.workunit.client.0.smithi138.stderr: -225> 2024-09-14T11:40:41.611+0000 7efaed7fa640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:40:42.245 INFO:tasks.workunit.client.0.smithi138.stderr: -224> 2024-09-14T11:40:41.611+0000 7efaed7fa640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-14T11:40:42.245 INFO:tasks.workunit.client.0.smithi138.stderr: -223> 2024-09-14T11:40:41.611+0000 7efaed7fa640 10 monclient: dump: 2024-09-14T11:40:42.245 INFO:tasks.workunit.client.0.smithi138.stderr:epoch 1 2024-09-14T11:40:42.245 INFO:tasks.workunit.client.0.smithi138.stderr:fsid 3f225f43-83a6-4aeb-b798-1f04bb49d597 2024-09-14T11:40:42.245 INFO:tasks.workunit.client.0.smithi138.stderr:last_changed 2024-09-14T11:07:09.252780+0000 2024-09-14T11:40:42.245 INFO:tasks.workunit.client.0.smithi138.stderr:created 2024-09-14T11:07:09.252780+0000 2024-09-14T11:40:42.245 INFO:tasks.workunit.client.0.smithi138.stderr:min_mon_release 19 (squid) 2024-09-14T11:40:42.245 INFO:tasks.workunit.client.0.smithi138.stderr:election_strategy: 1 2024-09-14T11:40:42.245 INFO:tasks.workunit.client.0.smithi138.stderr:0: [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] mon.a 2024-09-14T11:40:42.245 INFO:tasks.workunit.client.0.smithi138.stderr:1: [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] mon.b 2024-09-14T11:40:42.245 INFO:tasks.workunit.client.0.smithi138.stderr:2: [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] mon.c 2024-09-14T11:40:42.245 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-14T11:40:42.245 INFO:tasks.workunit.client.0.smithi138.stderr: -222> 2024-09-14T11:40:41.611+0000 7efc0c3fa9c0 5 monclient: authenticate success, global_id 7661 2024-09-14T11:40:42.246 INFO:tasks.workunit.client.0.smithi138.stderr: -221> 2024-09-14T11:40:41.611+0000 7efc0c3fa9c0 10 monclient: get_monmap_and_config success 2024-09-14T11:40:42.246 INFO:tasks.workunit.client.0.smithi138.stderr: -220> 2024-09-14T11:40:41.611+0000 7efc0c3fa9c0 4 set_mon_vals no callback set 2024-09-14T11:40:42.246 INFO:tasks.workunit.client.0.smithi138.stderr: -219> 2024-09-14T11:40:41.615+0000 7efc0c3fa9c0 10 monclient: shutdown 2024-09-14T11:40:42.246 INFO:tasks.workunit.client.0.smithi138.stderr: -218> 2024-09-14T11:40:41.615+0000 7efc0c3fa9c0 10 monclient: build_initial_monmap 2024-09-14T11:40:42.246 INFO:tasks.workunit.client.0.smithi138.stderr: -217> 2024-09-14T11:40:41.615+0000 7efc0c3fa9c0 1 build_initial for_mkfs: 0 2024-09-14T11:40:42.246 INFO:tasks.workunit.client.0.smithi138.stderr: -216> 2024-09-14T11:40:41.615+0000 7efc0c3fa9c0 10 monclient: monmap: 2024-09-14T11:40:42.246 INFO:tasks.workunit.client.0.smithi138.stderr:epoch 0 2024-09-14T11:40:42.246 INFO:tasks.workunit.client.0.smithi138.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-14T11:40:42.246 INFO:tasks.workunit.client.0.smithi138.stderr:last_changed 0.000000 2024-09-14T11:40:42.246 INFO:tasks.workunit.client.0.smithi138.stderr:created 0.000000 2024-09-14T11:40:42.246 INFO:tasks.workunit.client.0.smithi138.stderr:min_mon_release 0 (unknown) 2024-09-14T11:40:42.246 INFO:tasks.workunit.client.0.smithi138.stderr:election_strategy: 1 2024-09-14T11:40:42.246 INFO:tasks.workunit.client.0.smithi138.stderr:0: [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] mon.noname-a 2024-09-14T11:40:42.246 INFO:tasks.workunit.client.0.smithi138.stderr:1: [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] mon.noname-b 2024-09-14T11:40:42.246 INFO:tasks.workunit.client.0.smithi138.stderr:2: [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] mon.noname-c 2024-09-14T11:40:42.246 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-14T11:40:42.247 INFO:tasks.workunit.client.0.smithi138.stderr: -215> 2024-09-14T11:40:41.615+0000 7efc0c3fa9c0 5 AuthRegistry(0x55fa6a6accf0) adding auth protocol: cephx 2024-09-14T11:40:42.247 INFO:tasks.workunit.client.0.smithi138.stderr: -214> 2024-09-14T11:40:41.615+0000 7efc0c3fa9c0 5 AuthRegistry(0x55fa6a6accf0) adding auth protocol: cephx 2024-09-14T11:40:42.247 INFO:tasks.workunit.client.0.smithi138.stderr: -213> 2024-09-14T11:40:41.615+0000 7efc0c3fa9c0 5 AuthRegistry(0x55fa6a6accf0) adding auth protocol: cephx 2024-09-14T11:40:42.247 INFO:tasks.workunit.client.0.smithi138.stderr: -212> 2024-09-14T11:40:41.615+0000 7efc0c3fa9c0 5 AuthRegistry(0x55fa6a6accf0) adding con mode: secure 2024-09-14T11:40:42.247 INFO:tasks.workunit.client.0.smithi138.stderr: -211> 2024-09-14T11:40:41.615+0000 7efc0c3fa9c0 5 AuthRegistry(0x55fa6a6accf0) adding con mode: crc 2024-09-14T11:40:42.247 INFO:tasks.workunit.client.0.smithi138.stderr: -210> 2024-09-14T11:40:41.615+0000 7efc0c3fa9c0 5 AuthRegistry(0x55fa6a6accf0) adding con mode: secure 2024-09-14T11:40:42.247 INFO:tasks.workunit.client.0.smithi138.stderr: -209> 2024-09-14T11:40:41.615+0000 7efc0c3fa9c0 5 AuthRegistry(0x55fa6a6accf0) adding con mode: crc 2024-09-14T11:40:42.247 INFO:tasks.workunit.client.0.smithi138.stderr: -208> 2024-09-14T11:40:41.615+0000 7efc0c3fa9c0 5 AuthRegistry(0x55fa6a6accf0) adding con mode: secure 2024-09-14T11:40:42.247 INFO:tasks.workunit.client.0.smithi138.stderr: -207> 2024-09-14T11:40:41.615+0000 7efc0c3fa9c0 5 AuthRegistry(0x55fa6a6accf0) adding con mode: crc 2024-09-14T11:40:42.247 INFO:tasks.workunit.client.0.smithi138.stderr: -206> 2024-09-14T11:40:41.615+0000 7efc0c3fa9c0 5 AuthRegistry(0x55fa6a6accf0) adding con mode: crc 2024-09-14T11:40:42.247 INFO:tasks.workunit.client.0.smithi138.stderr: -205> 2024-09-14T11:40:41.615+0000 7efc0c3fa9c0 5 AuthRegistry(0x55fa6a6accf0) adding con mode: secure 2024-09-14T11:40:42.247 INFO:tasks.workunit.client.0.smithi138.stderr: -204> 2024-09-14T11:40:41.615+0000 7efc0c3fa9c0 5 AuthRegistry(0x55fa6a6accf0) adding con mode: crc 2024-09-14T11:40:42.247 INFO:tasks.workunit.client.0.smithi138.stderr: -203> 2024-09-14T11:40:41.615+0000 7efc0c3fa9c0 5 AuthRegistry(0x55fa6a6accf0) adding con mode: secure 2024-09-14T11:40:42.247 INFO:tasks.workunit.client.0.smithi138.stderr: -202> 2024-09-14T11:40:41.615+0000 7efc0c3fa9c0 5 AuthRegistry(0x55fa6a6accf0) adding con mode: crc 2024-09-14T11:40:42.247 INFO:tasks.workunit.client.0.smithi138.stderr: -201> 2024-09-14T11:40:41.615+0000 7efc0c3fa9c0 5 AuthRegistry(0x55fa6a6accf0) adding con mode: secure 2024-09-14T11:40:42.247 INFO:tasks.workunit.client.0.smithi138.stderr: -200> 2024-09-14T11:40:41.615+0000 7efc0c3fa9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:40:42.248 INFO:tasks.workunit.client.0.smithi138.stderr: -199> 2024-09-14T11:40:41.615+0000 7efc0c3fa9c0 1 librados: starting msgr at 2024-09-14T11:40:42.248 INFO:tasks.workunit.client.0.smithi138.stderr: -198> 2024-09-14T11:40:41.615+0000 7efc0c3fa9c0 1 librados: starting objecter 2024-09-14T11:40:42.248 INFO:tasks.workunit.client.0.smithi138.stderr: -197> 2024-09-14T11:40:41.615+0000 7efc0c3fa9c0 5 asok(0x55fa6a3d0d90) register_command objecter_requests cmddesc objecter_requests hook 0x55fa6a67c2a0 EEXIST 2024-09-14T11:40:42.248 INFO:tasks.workunit.client.0.smithi138.stderr: -196> 2024-09-14T11:40:41.615+0000 7efc0c3fa9c0 1 librados: setting wanted keys 2024-09-14T11:40:42.248 INFO:tasks.workunit.client.0.smithi138.stderr: -195> 2024-09-14T11:40:41.615+0000 7efc0c3fa9c0 1 librados: calling monclient init 2024-09-14T11:40:42.248 INFO:tasks.workunit.client.0.smithi138.stderr: -194> 2024-09-14T11:40:41.615+0000 7efc0c3fa9c0 10 monclient: init 2024-09-14T11:40:42.248 INFO:tasks.workunit.client.0.smithi138.stderr: -193> 2024-09-14T11:40:41.615+0000 7efc0c3fa9c0 5 AuthRegistry(0x55fa6a65eb90) adding auth protocol: cephx 2024-09-14T11:40:42.248 INFO:tasks.workunit.client.0.smithi138.stderr: -192> 2024-09-14T11:40:41.615+0000 7efc0c3fa9c0 5 AuthRegistry(0x55fa6a65eb90) adding auth protocol: cephx 2024-09-14T11:40:42.248 INFO:tasks.workunit.client.0.smithi138.stderr: -191> 2024-09-14T11:40:41.615+0000 7efc0c3fa9c0 5 AuthRegistry(0x55fa6a65eb90) adding auth protocol: cephx 2024-09-14T11:40:42.248 INFO:tasks.workunit.client.0.smithi138.stderr: -190> 2024-09-14T11:40:41.615+0000 7efc0c3fa9c0 5 AuthRegistry(0x55fa6a65eb90) adding con mode: secure 2024-09-14T11:40:42.248 INFO:tasks.workunit.client.0.smithi138.stderr: -189> 2024-09-14T11:40:41.615+0000 7efc0c3fa9c0 5 AuthRegistry(0x55fa6a65eb90) adding con mode: crc 2024-09-14T11:40:42.248 INFO:tasks.workunit.client.0.smithi138.stderr: -188> 2024-09-14T11:40:41.615+0000 7efc0c3fa9c0 5 AuthRegistry(0x55fa6a65eb90) adding con mode: secure 2024-09-14T11:40:42.249 INFO:tasks.workunit.client.0.smithi138.stderr: -187> 2024-09-14T11:40:41.615+0000 7efc0c3fa9c0 5 AuthRegistry(0x55fa6a65eb90) adding con mode: crc 2024-09-14T11:40:42.249 INFO:tasks.workunit.client.0.smithi138.stderr: -186> 2024-09-14T11:40:41.615+0000 7efc0c3fa9c0 5 AuthRegistry(0x55fa6a65eb90) adding con mode: secure 2024-09-14T11:40:42.249 INFO:tasks.workunit.client.0.smithi138.stderr: -185> 2024-09-14T11:40:41.615+0000 7efc0c3fa9c0 5 AuthRegistry(0x55fa6a65eb90) adding con mode: crc 2024-09-14T11:40:42.249 INFO:tasks.workunit.client.0.smithi138.stderr: -184> 2024-09-14T11:40:41.615+0000 7efc0c3fa9c0 5 AuthRegistry(0x55fa6a65eb90) adding con mode: crc 2024-09-14T11:40:42.249 INFO:tasks.workunit.client.0.smithi138.stderr: -183> 2024-09-14T11:40:41.615+0000 7efc0c3fa9c0 5 AuthRegistry(0x55fa6a65eb90) adding con mode: secure 2024-09-14T11:40:42.249 INFO:tasks.workunit.client.0.smithi138.stderr: -182> 2024-09-14T11:40:41.615+0000 7efc0c3fa9c0 5 AuthRegistry(0x55fa6a65eb90) adding con mode: crc 2024-09-14T11:40:42.249 INFO:tasks.workunit.client.0.smithi138.stderr: -181> 2024-09-14T11:40:41.615+0000 7efc0c3fa9c0 5 AuthRegistry(0x55fa6a65eb90) adding con mode: secure 2024-09-14T11:40:42.249 INFO:tasks.workunit.client.0.smithi138.stderr: -180> 2024-09-14T11:40:41.615+0000 7efc0c3fa9c0 5 AuthRegistry(0x55fa6a65eb90) adding con mode: crc 2024-09-14T11:40:42.249 INFO:tasks.workunit.client.0.smithi138.stderr: -179> 2024-09-14T11:40:41.615+0000 7efc0c3fa9c0 5 AuthRegistry(0x55fa6a65eb90) adding con mode: secure 2024-09-14T11:40:42.249 INFO:tasks.workunit.client.0.smithi138.stderr: -178> 2024-09-14T11:40:41.615+0000 7efc0c3fa9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:40:42.249 INFO:tasks.workunit.client.0.smithi138.stderr: -177> 2024-09-14T11:40:41.615+0000 7efc0c3fa9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:40:42.249 INFO:tasks.workunit.client.0.smithi138.stderr: -176> 2024-09-14T11:40:41.615+0000 7efc0c3fa9c0 5 asok(0x55fa6a3d0d90) register_command rotate-key cmddesc rotate-key hook 0x55fa6a65ecd8 EEXIST 2024-09-14T11:40:42.249 INFO:tasks.workunit.client.0.smithi138.stderr: -175> 2024-09-14T11:40:41.615+0000 7efc0c3fa9c0 10 monclient: _reopen_session rank -1 2024-09-14T11:40:42.250 INFO:tasks.workunit.client.0.smithi138.stderr: -174> 2024-09-14T11:40:41.615+0000 7efc0c3fa9c0 10 monclient: _add_conns ranks=[1,2,0] 2024-09-14T11:40:42.250 INFO:tasks.workunit.client.0.smithi138.stderr: -173> 2024-09-14T11:40:41.615+0000 7efc0c3fa9c0 10 monclient(hunting): picked mon.noname-b con 0x55fa6a6abea0 addr [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] 2024-09-14T11:40:42.250 INFO:tasks.workunit.client.0.smithi138.stderr: -172> 2024-09-14T11:40:41.615+0000 7efc0c3fa9c0 10 monclient(hunting): picked mon.noname-c con 0x55fa6a6ac820 addr [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] 2024-09-14T11:40:42.250 INFO:tasks.workunit.client.0.smithi138.stderr: -171> 2024-09-14T11:40:41.615+0000 7efc0c3fa9c0 10 monclient(hunting): picked mon.noname-a con 0x55fa6a6b0ab0 addr [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] 2024-09-14T11:40:42.250 INFO:tasks.workunit.client.0.smithi138.stderr: -170> 2024-09-14T11:40:41.615+0000 7efc0c3fa9c0 10 monclient(hunting): start opening mon connection 2024-09-14T11:40:42.250 INFO:tasks.workunit.client.0.smithi138.stderr: -169> 2024-09-14T11:40:41.615+0000 7efc0c3fa9c0 10 monclient(hunting): start opening mon connection 2024-09-14T11:40:42.250 INFO:tasks.workunit.client.0.smithi138.stderr: -168> 2024-09-14T11:40:41.615+0000 7efc0c3fa9c0 10 monclient(hunting): start opening mon connection 2024-09-14T11:40:42.250 INFO:tasks.workunit.client.0.smithi138.stderr: -167> 2024-09-14T11:40:41.615+0000 7efc0c3fa9c0 10 monclient(hunting): _renew_subs 2024-09-14T11:40:42.250 INFO:tasks.workunit.client.0.smithi138.stderr: -166> 2024-09-14T11:40:41.619+0000 7efc0c3fa9c0 10 monclient(hunting): authenticate will time out at 2977.580028s 2024-09-14T11:40:42.250 INFO:tasks.workunit.client.0.smithi138.stderr: -165> 2024-09-14T11:40:41.619+0000 7efc0a701640 10 monclient(hunting): get_auth_request con 0x55fa6a6ac820 auth_method 0 2024-09-14T11:40:42.250 INFO:tasks.workunit.client.0.smithi138.stderr: -164> 2024-09-14T11:40:41.619+0000 7efc0a701640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:40:42.250 INFO:tasks.workunit.client.0.smithi138.stderr: -163> 2024-09-14T11:40:41.619+0000 7efc0a701640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:40:42.250 INFO:tasks.workunit.client.0.smithi138.stderr: -162> 2024-09-14T11:40:41.619+0000 7efc0a701640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:40:42.250 INFO:tasks.workunit.client.0.smithi138.stderr: -161> 2024-09-14T11:40:41.619+0000 7efc096ff640 10 monclient(hunting): get_auth_request con 0x55fa6a6abea0 auth_method 0 2024-09-14T11:40:42.250 INFO:tasks.workunit.client.0.smithi138.stderr: -160> 2024-09-14T11:40:41.619+0000 7efc096ff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:40:42.251 INFO:tasks.workunit.client.0.smithi138.stderr: -159> 2024-09-14T11:40:41.619+0000 7efc096ff640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:40:42.251 INFO:tasks.workunit.client.0.smithi138.stderr: -158> 2024-09-14T11:40:41.619+0000 7efc096ff640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:40:42.251 INFO:tasks.workunit.client.0.smithi138.stderr: -157> 2024-09-14T11:40:41.619+0000 7efc09f00640 10 monclient(hunting): get_auth_request con 0x55fa6a6b0ab0 auth_method 0 2024-09-14T11:40:42.251 INFO:tasks.workunit.client.0.smithi138.stderr: -156> 2024-09-14T11:40:41.619+0000 7efc09f00640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:40:42.251 INFO:tasks.workunit.client.0.smithi138.stderr: -155> 2024-09-14T11:40:41.619+0000 7efc09f00640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:40:42.251 INFO:tasks.workunit.client.0.smithi138.stderr: -154> 2024-09-14T11:40:41.619+0000 7efc09f00640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:40:42.251 INFO:tasks.workunit.client.0.smithi138.stderr: -153> 2024-09-14T11:40:41.619+0000 7efc0a701640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:40:42.251 INFO:tasks.workunit.client.0.smithi138.stderr: -152> 2024-09-14T11:40:41.619+0000 7efc0a701640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:40:42.251 INFO:tasks.workunit.client.0.smithi138.stderr: -151> 2024-09-14T11:40:41.619+0000 7efc0a701640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:40:42.251 INFO:tasks.workunit.client.0.smithi138.stderr: -150> 2024-09-14T11:40:41.619+0000 7efc096ff640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:40:42.251 INFO:tasks.workunit.client.0.smithi138.stderr: -149> 2024-09-14T11:40:41.619+0000 7efc096ff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:40:42.251 INFO:tasks.workunit.client.0.smithi138.stderr: -148> 2024-09-14T11:40:41.619+0000 7efc096ff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:40:42.251 INFO:tasks.workunit.client.0.smithi138.stderr: -147> 2024-09-14T11:40:41.619+0000 7efc09f00640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:40:42.251 INFO:tasks.workunit.client.0.smithi138.stderr: -146> 2024-09-14T11:40:41.619+0000 7efc09f00640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:40:42.252 INFO:tasks.workunit.client.0.smithi138.stderr: -145> 2024-09-14T11:40:41.619+0000 7efc09f00640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:40:42.252 INFO:tasks.workunit.client.0.smithi138.stderr: -144> 2024-09-14T11:40:41.619+0000 7efc09f00640 10 monclient(hunting): handle_auth_done global_id 8205 payload 824 2024-09-14T11:40:42.252 INFO:tasks.workunit.client.0.smithi138.stderr: -143> 2024-09-14T11:40:41.619+0000 7efc09f00640 10 monclient: _finish_hunting 0 2024-09-14T11:40:42.252 INFO:tasks.workunit.client.0.smithi138.stderr: -142> 2024-09-14T11:40:41.619+0000 7efc09f00640 1 monclient: found mon.noname-a 2024-09-14T11:40:42.252 INFO:tasks.workunit.client.0.smithi138.stderr: -141> 2024-09-14T11:40:41.619+0000 7efc09f00640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.138:3300/0 2024-09-14T11:40:42.252 INFO:tasks.workunit.client.0.smithi138.stderr: -140> 2024-09-14T11:40:41.619+0000 7efadb7fe640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:40:42.252 INFO:tasks.workunit.client.0.smithi138.stderr: -139> 2024-09-14T11:40:41.619+0000 7efadb7fe640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-14T11:40:42.252 INFO:tasks.workunit.client.0.smithi138.stderr: -138> 2024-09-14T11:40:41.619+0000 7efadb7fe640 10 monclient: dump: 2024-09-14T11:40:42.252 INFO:tasks.workunit.client.0.smithi138.stderr:epoch 1 2024-09-14T11:40:42.252 INFO:tasks.workunit.client.0.smithi138.stderr:fsid 3f225f43-83a6-4aeb-b798-1f04bb49d597 2024-09-14T11:40:42.252 INFO:tasks.workunit.client.0.smithi138.stderr:last_changed 2024-09-14T11:07:09.252780+0000 2024-09-14T11:40:42.252 INFO:tasks.workunit.client.0.smithi138.stderr:created 2024-09-14T11:07:09.252780+0000 2024-09-14T11:40:42.252 INFO:tasks.workunit.client.0.smithi138.stderr:min_mon_release 19 (squid) 2024-09-14T11:40:42.252 INFO:tasks.workunit.client.0.smithi138.stderr:election_strategy: 1 2024-09-14T11:40:42.253 INFO:tasks.workunit.client.0.smithi138.stderr:0: [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] mon.a 2024-09-14T11:40:42.253 INFO:tasks.workunit.client.0.smithi138.stderr:1: [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] mon.b 2024-09-14T11:40:42.253 INFO:tasks.workunit.client.0.smithi138.stderr:2: [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] mon.c 2024-09-14T11:40:42.253 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-14T11:40:42.253 INFO:tasks.workunit.client.0.smithi138.stderr: -137> 2024-09-14T11:40:41.619+0000 7efadb7fe640 10 monclient: _finish_auth 0 2024-09-14T11:40:42.253 INFO:tasks.workunit.client.0.smithi138.stderr: -136> 2024-09-14T11:40:41.619+0000 7efadb7fe640 10 monclient: _check_auth_tickets 2024-09-14T11:40:42.253 INFO:tasks.workunit.client.0.smithi138.stderr: -135> 2024-09-14T11:40:41.619+0000 7efadb7fe640 10 monclient: handle_config config(0 keys) 2024-09-14T11:40:42.253 INFO:tasks.workunit.client.0.smithi138.stderr: -134> 2024-09-14T11:40:41.619+0000 7efadb7fe640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:40:42.253 INFO:tasks.workunit.client.0.smithi138.stderr: -133> 2024-09-14T11:40:41.619+0000 7efadb7fe640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-14T11:40:42.253 INFO:tasks.workunit.client.0.smithi138.stderr: -132> 2024-09-14T11:40:41.619+0000 7efadb7fe640 10 monclient: dump: 2024-09-14T11:40:42.253 INFO:tasks.workunit.client.0.smithi138.stderr:epoch 1 2024-09-14T11:40:42.253 INFO:tasks.workunit.client.0.smithi138.stderr:fsid 3f225f43-83a6-4aeb-b798-1f04bb49d597 2024-09-14T11:40:42.253 INFO:tasks.workunit.client.0.smithi138.stderr:last_changed 2024-09-14T11:07:09.252780+0000 2024-09-14T11:40:42.253 INFO:tasks.workunit.client.0.smithi138.stderr:created 2024-09-14T11:07:09.252780+0000 2024-09-14T11:40:42.253 INFO:tasks.workunit.client.0.smithi138.stderr:min_mon_release 19 (squid) 2024-09-14T11:40:42.254 INFO:tasks.workunit.client.0.smithi138.stderr:election_strategy: 1 2024-09-14T11:40:42.254 INFO:tasks.workunit.client.0.smithi138.stderr:0: [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] mon.a 2024-09-14T11:40:42.254 INFO:tasks.workunit.client.0.smithi138.stderr:1: [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] mon.b 2024-09-14T11:40:42.254 INFO:tasks.workunit.client.0.smithi138.stderr:2: [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] mon.c 2024-09-14T11:40:42.254 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-14T11:40:42.254 INFO:tasks.workunit.client.0.smithi138.stderr: -131> 2024-09-14T11:40:41.619+0000 7efc0c3fa9c0 5 monclient: authenticate success, global_id 8205 2024-09-14T11:40:42.254 INFO:tasks.workunit.client.0.smithi138.stderr: -130> 2024-09-14T11:40:41.619+0000 7efaed7fa640 4 set_mon_vals no callback set 2024-09-14T11:40:42.254 INFO:tasks.workunit.client.0.smithi138.stderr: -129> 2024-09-14T11:40:41.619+0000 7efc0c3fa9c0 10 monclient: _renew_subs 2024-09-14T11:40:42.254 INFO:tasks.workunit.client.0.smithi138.stderr: -128> 2024-09-14T11:40:41.619+0000 7efc0c3fa9c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.138:3300/0 2024-09-14T11:40:42.254 INFO:tasks.workunit.client.0.smithi138.stderr: -127> 2024-09-14T11:40:41.619+0000 7efc0c3fa9c0 10 monclient: _renew_subs 2024-09-14T11:40:42.254 INFO:tasks.workunit.client.0.smithi138.stderr: -126> 2024-09-14T11:40:41.619+0000 7efc0c3fa9c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.138:3300/0 2024-09-14T11:40:42.254 INFO:tasks.workunit.client.0.smithi138.stderr: -125> 2024-09-14T11:40:41.619+0000 7efc0c3fa9c0 1 librados: init done 2024-09-14T11:40:42.254 INFO:tasks.workunit.client.0.smithi138.stderr: -124> 2024-09-14T11:40:41.619+0000 7efc0c3fa9c0 5 asok(0x55fa6a3d0d90) register_command cr dump hook 0x55fa6a6b0ea8 2024-09-14T11:40:42.254 INFO:tasks.workunit.client.0.smithi138.stderr: -123> 2024-09-14T11:40:41.623+0000 7efc0c3fa9c0 20 rados->read ofs=0 len=0 2024-09-14T11:40:42.254 INFO:tasks.workunit.client.0.smithi138.stderr: -122> 2024-09-14T11:40:41.623+0000 7efadb7fe640 4 mgrc handle_mgr_map Got map version 5 2024-09-14T11:40:42.255 INFO:tasks.workunit.client.0.smithi138.stderr: -121> 2024-09-14T11:40:41.623+0000 7efadb7fe640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.138:6832/3778043143,v1:172.21.15.138:6833/3778043143] 2024-09-14T11:40:42.255 INFO:tasks.workunit.client.0.smithi138.stderr: -120> 2024-09-14T11:40:41.623+0000 7efadb7fe640 4 mgrc reconnect Starting new session with [v2:172.21.15.138:6832/3778043143,v1:172.21.15.138:6833/3778043143] 2024-09-14T11:40:42.255 INFO:tasks.workunit.client.0.smithi138.stderr: -119> 2024-09-14T11:40:41.623+0000 7efc096ff640 10 monclient: get_auth_request con 0x7efad40718d0 auth_method 0 2024-09-14T11:40:42.255 INFO:tasks.workunit.client.0.smithi138.stderr: -118> 2024-09-14T11:40:41.623+0000 7efc0a701640 10 monclient: get_auth_request con 0x55fa6a6ca330 auth_method 0 2024-09-14T11:40:42.255 INFO:tasks.workunit.client.0.smithi138.stderr: -117> 2024-09-14T11:40:41.627+0000 7efc0c3fa9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:40:42.255 INFO:tasks.workunit.client.0.smithi138.stderr: -116> 2024-09-14T11:40:41.627+0000 7efc0c3fa9c0 20 realm 2024-09-14T11:40:42.255 INFO:tasks.workunit.client.0.smithi138.stderr: -115> 2024-09-14T11:40:41.627+0000 7efc0c3fa9c0 20 rados->read ofs=0 len=0 2024-09-14T11:40:42.255 INFO:tasks.workunit.client.0.smithi138.stderr: -114> 2024-09-14T11:40:41.627+0000 7efc0c3fa9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:40:42.255 INFO:tasks.workunit.client.0.smithi138.stderr: -113> 2024-09-14T11:40:41.627+0000 7efc0c3fa9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:40:42.255 INFO:tasks.workunit.client.0.smithi138.stderr: -112> 2024-09-14T11:40:41.627+0000 7efc0c3fa9c0 20 rados->read ofs=0 len=0 2024-09-14T11:40:42.255 INFO:tasks.workunit.client.0.smithi138.stderr: -111> 2024-09-14T11:40:41.627+0000 7efc0c3fa9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:40:42.255 INFO:tasks.workunit.client.0.smithi138.stderr: -110> 2024-09-14T11:40:41.627+0000 7efc0c3fa9c0 20 rados->read ofs=0 len=0 2024-09-14T11:40:42.255 INFO:tasks.workunit.client.0.smithi138.stderr: -109> 2024-09-14T11:40:41.627+0000 7efc096ff640 10 monclient: get_auth_request con 0x55fa6a6ce450 auth_method 0 2024-09-14T11:40:42.255 INFO:tasks.workunit.client.0.smithi138.stderr: -108> 2024-09-14T11:40:41.627+0000 7efc0c3fa9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:40:42.255 INFO:tasks.workunit.client.0.smithi138.stderr: -107> 2024-09-14T11:40:41.627+0000 7efc0c3fa9c0 20 rados->read ofs=0 len=0 2024-09-14T11:40:42.256 INFO:tasks.workunit.client.0.smithi138.stderr: -106> 2024-09-14T11:40:41.627+0000 7efc0a701640 10 monclient: get_auth_request con 0x55fa6a6d1cb0 auth_method 0 2024-09-14T11:40:42.256 INFO:tasks.workunit.client.0.smithi138.stderr: -105> 2024-09-14T11:40:41.627+0000 7efc0c3fa9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:40:42.256 INFO:tasks.workunit.client.0.smithi138.stderr: -104> 2024-09-14T11:40:41.627+0000 7efc0c3fa9c0 20 searching for the correct realm 2024-09-14T11:40:42.256 INFO:tasks.workunit.client.0.smithi138.stderr: -103> 2024-09-14T11:40:41.627+0000 7efc09f00640 10 monclient: get_auth_request con 0x55fa6a6d6840 auth_method 0 2024-09-14T11:40:42.256 INFO:tasks.workunit.client.0.smithi138.stderr: -102> 2024-09-14T11:40:41.631+0000 7efc096ff640 10 monclient: get_auth_request con 0x7efbfc136320 auth_method 0 2024-09-14T11:40:42.256 INFO:tasks.workunit.client.0.smithi138.stderr: -101> 2024-09-14T11:40:41.631+0000 7efc0a701640 10 monclient: get_auth_request con 0x7efc04018040 auth_method 0 2024-09-14T11:40:42.256 INFO:tasks.workunit.client.0.smithi138.stderr: -100> 2024-09-14T11:40:41.631+0000 7efc0a701640 0 -- 172.21.15.138:0/3254551000 >> [v2:172.21.15.154:6824/416768175,v1:172.21.15.154:6825/416768175] conn(0x7efc04018040 msgr2=0x7efc04011460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:40:42.256 INFO:tasks.workunit.client.0.smithi138.stderr: -99> 2024-09-14T11:40:41.835+0000 7efc0a701640 10 monclient: get_auth_request con 0x7efc04018040 auth_method 0 2024-09-14T11:40:42.256 INFO:tasks.workunit.client.0.smithi138.stderr: -98> 2024-09-14T11:40:41.839+0000 7efc09f00640 10 monclient: get_auth_request con 0x7efc0404d3f0 auth_method 0 2024-09-14T11:40:42.256 INFO:tasks.workunit.client.0.smithi138.stderr: -97> 2024-09-14T11:40:41.847+0000 7efc096ff640 10 monclient: get_auth_request con 0x7efc04034920 auth_method 0 2024-09-14T11:40:42.256 INFO:tasks.workunit.client.0.smithi138.stderr: -96> 2024-09-14T11:40:41.847+0000 7efc096ff640 0 -- 172.21.15.138:0/3254551000 >> [v2:172.21.15.138:6816/326481658,v1:172.21.15.138:6817/326481658] conn(0x7efc04034920 msgr2=0x7efc04058380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-14T11:40:42.256 INFO:tasks.workunit.client.0.smithi138.stderr: -95> 2024-09-14T11:40:42.051+0000 7efc096ff640 10 monclient: get_auth_request con 0x7efc04034920 auth_method 0 2024-09-14T11:40:42.256 INFO:tasks.workunit.client.0.smithi138.stderr: -94> 2024-09-14T11:40:42.063+0000 7efc0c3fa9c0 20 RGWRados::pool_iterate: got zone_info.d9e72d30-c60b-4d0d-9267-fdc36392d5ad 2024-09-14T11:40:42.256 INFO:tasks.workunit.client.0.smithi138.stderr: -93> 2024-09-14T11:40:42.063+0000 7efc0c3fa9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:40:42.256 INFO:tasks.workunit.client.0.smithi138.stderr: -92> 2024-09-14T11:40:42.063+0000 7efc0c3fa9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:40:42.257 INFO:tasks.workunit.client.0.smithi138.stderr: -91> 2024-09-14T11:40:42.063+0000 7efc0c3fa9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:40:42.257 INFO:tasks.workunit.client.0.smithi138.stderr: -90> 2024-09-14T11:40:42.063+0000 7efc0c3fa9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:40:42.257 INFO:tasks.workunit.client.0.smithi138.stderr: -89> 2024-09-14T11:40:42.063+0000 7efc0c3fa9c0 20 RGWRados::pool_iterate: got zonegroup_info.65ab941b-da8c-4160-94fb-3672b069d44f 2024-09-14T11:40:42.257 INFO:tasks.workunit.client.0.smithi138.stderr: -88> 2024-09-14T11:40:42.063+0000 7efc0c3fa9c0 20 rados->read ofs=0 len=0 2024-09-14T11:40:42.257 INFO:tasks.workunit.client.0.smithi138.stderr: -87> 2024-09-14T11:40:42.063+0000 7efc0c3fa9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:40:42.257 INFO:tasks.workunit.client.0.smithi138.stderr: -86> 2024-09-14T11:40:42.063+0000 7efc0c3fa9c0 20 rados->read ofs=0 len=0 2024-09-14T11:40:42.257 INFO:tasks.workunit.client.0.smithi138.stderr: -85> 2024-09-14T11:40:42.067+0000 7efc0c3fa9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:40:42.257 INFO:tasks.workunit.client.0.smithi138.stderr: -84> 2024-09-14T11:40:42.067+0000 7efc0c3fa9c0 20 rados->read ofs=0 len=0 2024-09-14T11:40:42.257 INFO:tasks.workunit.client.0.smithi138.stderr: -83> 2024-09-14T11:40:42.067+0000 7efc0c3fa9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:40:42.257 INFO:tasks.workunit.client.0.smithi138.stderr: -82> 2024-09-14T11:40:42.067+0000 7efc0c3fa9c0 20 zone default found 2024-09-14T11:40:42.257 INFO:tasks.workunit.client.0.smithi138.stderr: -81> 2024-09-14T11:40:42.067+0000 7efc0c3fa9c0 4 Realm: () 2024-09-14T11:40:42.257 INFO:tasks.workunit.client.0.smithi138.stderr: -80> 2024-09-14T11:40:42.067+0000 7efc0c3fa9c0 4 ZoneGroup: default (65ab941b-da8c-4160-94fb-3672b069d44f) 2024-09-14T11:40:42.257 INFO:tasks.workunit.client.0.smithi138.stderr: -79> 2024-09-14T11:40:42.067+0000 7efc0c3fa9c0 4 Zone: default (d9e72d30-c60b-4d0d-9267-fdc36392d5ad) 2024-09-14T11:40:42.257 INFO:tasks.workunit.client.0.smithi138.stderr: -78> 2024-09-14T11:40:42.067+0000 7efc0c3fa9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:40:42.257 INFO:tasks.workunit.client.0.smithi138.stderr: -77> 2024-09-14T11:40:42.067+0000 7efc0c3fa9c0 20 zonegroup default 2024-09-14T11:40:42.258 INFO:tasks.workunit.client.0.smithi138.stderr: -76> 2024-09-14T11:40:42.067+0000 7efc0c3fa9c0 20 rados->read ofs=0 len=0 2024-09-14T11:40:42.258 INFO:tasks.workunit.client.0.smithi138.stderr: -75> 2024-09-14T11:40:42.067+0000 7efc0c3fa9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:40:42.258 INFO:tasks.workunit.client.0.smithi138.stderr: -74> 2024-09-14T11:40:42.067+0000 7efc0c3fa9c0 20 rados->read ofs=0 len=0 2024-09-14T11:40:42.258 INFO:tasks.workunit.client.0.smithi138.stderr: -73> 2024-09-14T11:40:42.067+0000 7efc0c3fa9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:40:42.258 INFO:tasks.workunit.client.0.smithi138.stderr: -72> 2024-09-14T11:40:42.067+0000 7efc0c3fa9c0 20 rados->read ofs=0 len=0 2024-09-14T11:40:42.258 INFO:tasks.workunit.client.0.smithi138.stderr: -71> 2024-09-14T11:40:42.067+0000 7efc0c3fa9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:40:42.258 INFO:tasks.workunit.client.0.smithi138.stderr: -70> 2024-09-14T11:40:42.071+0000 7efc0c3fa9c0 20 started sync module instance, tier type = 2024-09-14T11:40:42.258 INFO:tasks.workunit.client.0.smithi138.stderr: -69> 2024-09-14T11:40:42.071+0000 7efc0c3fa9c0 20 started zone id=d9e72d30-c60b-4d0d-9267-fdc36392d5ad (name=default) with tier type = 2024-09-14T11:40:42.258 INFO:tasks.workunit.client.0.smithi138.stderr: -68> 2024-09-14T11:40:42.091+0000 7efc0c3fa9c0 20 add_watcher() i=0 2024-09-14T11:40:42.258 INFO:tasks.workunit.client.0.smithi138.stderr: -67> 2024-09-14T11:40:42.091+0000 7efc0c3fa9c0 20 add_watcher() i=1 2024-09-14T11:40:42.258 INFO:tasks.workunit.client.0.smithi138.stderr: -66> 2024-09-14T11:40:42.091+0000 7efc0c3fa9c0 20 add_watcher() i=2 2024-09-14T11:40:42.258 INFO:tasks.workunit.client.0.smithi138.stderr: -65> 2024-09-14T11:40:42.091+0000 7efc0c3fa9c0 20 add_watcher() i=3 2024-09-14T11:40:42.258 INFO:tasks.workunit.client.0.smithi138.stderr: -64> 2024-09-14T11:40:42.091+0000 7efc0c3fa9c0 20 add_watcher() i=4 2024-09-14T11:40:42.258 INFO:tasks.workunit.client.0.smithi138.stderr: -63> 2024-09-14T11:40:42.091+0000 7efc0c3fa9c0 20 add_watcher() i=5 2024-09-14T11:40:42.258 INFO:tasks.workunit.client.0.smithi138.stderr: -62> 2024-09-14T11:40:42.091+0000 7efc0c3fa9c0 20 add_watcher() i=6 2024-09-14T11:40:42.258 INFO:tasks.workunit.client.0.smithi138.stderr: -61> 2024-09-14T11:40:42.095+0000 7efc0c3fa9c0 20 add_watcher() i=7 2024-09-14T11:40:42.259 INFO:tasks.workunit.client.0.smithi138.stderr: -60> 2024-09-14T11:40:42.095+0000 7efc0c3fa9c0 2 all 8 watchers are set, enabling cache 2024-09-14T11:40:42.259 INFO:tasks.workunit.client.0.smithi138.stderr: -59> 2024-09-14T11:40:42.099+0000 7efc0c3fa9c0 5 AuthRegistry(0x7ffd9cb6fdf0) adding auth protocol: cephx 2024-09-14T11:40:42.259 INFO:tasks.workunit.client.0.smithi138.stderr: -58> 2024-09-14T11:40:42.099+0000 7efc0c3fa9c0 5 AuthRegistry(0x7ffd9cb6fdf0) adding auth protocol: cephx 2024-09-14T11:40:42.259 INFO:tasks.workunit.client.0.smithi138.stderr: -57> 2024-09-14T11:40:42.099+0000 7efc0c3fa9c0 5 AuthRegistry(0x7ffd9cb6fdf0) adding auth protocol: cephx 2024-09-14T11:40:42.259 INFO:tasks.workunit.client.0.smithi138.stderr: -56> 2024-09-14T11:40:42.099+0000 7efc0c3fa9c0 5 AuthRegistry(0x7ffd9cb6fdf0) adding con mode: secure 2024-09-14T11:40:42.259 INFO:tasks.workunit.client.0.smithi138.stderr: -55> 2024-09-14T11:40:42.099+0000 7efc0c3fa9c0 5 AuthRegistry(0x7ffd9cb6fdf0) adding con mode: crc 2024-09-14T11:40:42.259 INFO:tasks.workunit.client.0.smithi138.stderr: -54> 2024-09-14T11:40:42.099+0000 7efabb7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:40:42.259 INFO:tasks.workunit.client.0.smithi138.stderr: -53> 2024-09-14T11:40:42.099+0000 7efc0c3fa9c0 5 AuthRegistry(0x7ffd9cb6fdf0) adding con mode: secure 2024-09-14T11:40:42.259 INFO:tasks.workunit.client.0.smithi138.stderr: -52> 2024-09-14T11:40:42.099+0000 7efc0c3fa9c0 5 AuthRegistry(0x7ffd9cb6fdf0) adding con mode: crc 2024-09-14T11:40:42.259 INFO:tasks.workunit.client.0.smithi138.stderr: -51> 2024-09-14T11:40:42.099+0000 7efc0c3fa9c0 5 AuthRegistry(0x7ffd9cb6fdf0) adding con mode: secure 2024-09-14T11:40:42.259 INFO:tasks.workunit.client.0.smithi138.stderr: -50> 2024-09-14T11:40:42.099+0000 7efc0c3fa9c0 5 AuthRegistry(0x7ffd9cb6fdf0) adding con mode: crc 2024-09-14T11:40:42.259 INFO:tasks.workunit.client.0.smithi138.stderr: -49> 2024-09-14T11:40:42.099+0000 7efc0c3fa9c0 5 AuthRegistry(0x7ffd9cb6fdf0) adding con mode: crc 2024-09-14T11:40:42.259 INFO:tasks.workunit.client.0.smithi138.stderr: -48> 2024-09-14T11:40:42.099+0000 7efc0c3fa9c0 5 AuthRegistry(0x7ffd9cb6fdf0) adding con mode: secure 2024-09-14T11:40:42.259 INFO:tasks.workunit.client.0.smithi138.stderr: -47> 2024-09-14T11:40:42.099+0000 7efc0c3fa9c0 5 AuthRegistry(0x7ffd9cb6fdf0) adding con mode: crc 2024-09-14T11:40:42.259 INFO:tasks.workunit.client.0.smithi138.stderr: -46> 2024-09-14T11:40:42.099+0000 7efc0c3fa9c0 5 AuthRegistry(0x7ffd9cb6fdf0) adding con mode: secure 2024-09-14T11:40:42.260 INFO:tasks.workunit.client.0.smithi138.stderr: -45> 2024-09-14T11:40:42.099+0000 7efc0c3fa9c0 5 AuthRegistry(0x7ffd9cb6fdf0) adding con mode: crc 2024-09-14T11:40:42.260 INFO:tasks.workunit.client.0.smithi138.stderr: -44> 2024-09-14T11:40:42.099+0000 7efc0c3fa9c0 5 AuthRegistry(0x7ffd9cb6fdf0) adding con mode: secure 2024-09-14T11:40:42.260 INFO:tasks.workunit.client.0.smithi138.stderr: -43> 2024-09-14T11:40:42.099+0000 7efc0c3fa9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:40:42.260 INFO:tasks.workunit.client.0.smithi138.stderr: -42> 2024-09-14T11:40:42.099+0000 7efc0c3fa9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:40:42.260 INFO:tasks.workunit.client.0.smithi138.stderr: -41> 2024-09-14T11:40:42.099+0000 7efc0c3fa9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:40:42.260 INFO:tasks.workunit.client.0.smithi138.stderr: -40> 2024-09-14T11:40:42.099+0000 7efc0c3fa9c0 5 asok(0x55fa6a3d0d90) register_command cache list hook 0x55fa6a680980 2024-09-14T11:40:42.260 INFO:tasks.workunit.client.0.smithi138.stderr: -39> 2024-09-14T11:40:42.099+0000 7efc0c3fa9c0 5 asok(0x55fa6a3d0d90) register_command cache inspect hook 0x55fa6a680980 2024-09-14T11:40:42.260 INFO:tasks.workunit.client.0.smithi138.stderr: -38> 2024-09-14T11:40:42.099+0000 7efc0c3fa9c0 5 asok(0x55fa6a3d0d90) register_command cache erase hook 0x55fa6a680980 2024-09-14T11:40:42.260 INFO:tasks.workunit.client.0.smithi138.stderr: -37> 2024-09-14T11:40:42.099+0000 7efc0c3fa9c0 5 asok(0x55fa6a3d0d90) register_command cache zap hook 0x55fa6a680980 2024-09-14T11:40:42.260 INFO:tasks.workunit.client.0.smithi138.stderr: -36> 2024-09-14T11:40:42.099+0000 7efc0c3fa9c0 5 note: GC not initialized 2024-09-14T11:40:42.260 INFO:tasks.workunit.client.0.smithi138.stderr: -35> 2024-09-14T11:40:42.099+0000 7efaba7fc640 20 reqs_thread_entry: start 2024-09-14T11:40:42.260 INFO:tasks.workunit.client.0.smithi138.stderr: -34> 2024-09-14T11:40:42.099+0000 7efc0c3fa9c0 5 asok(0x55fa6a3d0d90) register_command sync trace show hook 0x7efc00077070 2024-09-14T11:40:42.260 INFO:tasks.workunit.client.0.smithi138.stderr: -33> 2024-09-14T11:40:42.099+0000 7efc0c3fa9c0 5 asok(0x55fa6a3d0d90) register_command sync trace history hook 0x7efc00077070 2024-09-14T11:40:42.260 INFO:tasks.workunit.client.0.smithi138.stderr: -32> 2024-09-14T11:40:42.099+0000 7efc0c3fa9c0 5 asok(0x55fa6a3d0d90) register_command sync trace active hook 0x7efc00077070 2024-09-14T11:40:42.260 INFO:tasks.workunit.client.0.smithi138.stderr: -31> 2024-09-14T11:40:42.099+0000 7efc0c3fa9c0 5 asok(0x55fa6a3d0d90) register_command sync trace active_short hook 0x7efc00077070 2024-09-14T11:40:42.261 INFO:tasks.workunit.client.0.smithi138.stderr: -30> 2024-09-14T11:40:42.099+0000 7efc0c3fa9c0 20 init_complete bucket index max shards: 11 2024-09-14T11:40:42.261 INFO:tasks.workunit.client.0.smithi138.stderr: -29> 2024-09-14T11:40:42.099+0000 7efc0c3fa9c0 20 Filter name: none 2024-09-14T11:40:42.261 INFO:tasks.workunit.client.0.smithi138.stderr: -28> 2024-09-14T11:40:42.099+0000 7efa2bfff640 20 reqs_thread_entry: start 2024-09-14T11:40:42.261 INFO:tasks.workunit.client.0.smithi138.stderr: -27> 2024-09-14T11:40:42.099+0000 7efc0c3fa9c0 10 cache get: name=default.rgw.meta+root+a-bucket : miss 2024-09-14T11:40:42.261 INFO:tasks.workunit.client.0.smithi138.stderr: -26> 2024-09-14T11:40:42.099+0000 7efc0c3fa9c0 20 rados->read ofs=0 len=0 2024-09-14T11:40:42.261 INFO:tasks.workunit.client.0.smithi138.stderr: -25> 2024-09-14T11:40:42.103+0000 7efc0c3fa9c0 20 rados_obj.operate() r=0 bl.length=176 2024-09-14T11:40:42.261 INFO:tasks.workunit.client.0.smithi138.stderr: -24> 2024-09-14T11:40:42.103+0000 7efc0c3fa9c0 10 cache put: name=default.rgw.meta+root+a-bucket info.flags=0x11 2024-09-14T11:40:42.261 INFO:tasks.workunit.client.0.smithi138.stderr: -23> 2024-09-14T11:40:42.103+0000 7efc0c3fa9c0 10 adding default.rgw.meta+root+a-bucket to cache LRU end 2024-09-14T11:40:42.261 INFO:tasks.workunit.client.0.smithi138.stderr: -22> 2024-09-14T11:40:42.103+0000 7efc0c3fa9c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.17 : miss 2024-09-14T11:40:42.261 INFO:tasks.workunit.client.0.smithi138.stderr: -21> 2024-09-14T11:40:42.103+0000 7efc0c3fa9c0 20 rados->read ofs=0 len=0 2024-09-14T11:40:42.261 INFO:tasks.workunit.client.0.smithi138.stderr: -20> 2024-09-14T11:40:42.103+0000 7efc0c3fa9c0 20 rados_obj.operate() r=0 bl.length=430 2024-09-14T11:40:42.261 INFO:tasks.workunit.client.0.smithi138.stderr: -19> 2024-09-14T11:40:42.103+0000 7efc0c3fa9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.17 info.flags=0x17 2024-09-14T11:40:42.261 INFO:tasks.workunit.client.0.smithi138.stderr: -18> 2024-09-14T11:40:42.103+0000 7efc0c3fa9c0 10 adding default.rgw.meta+root+.bucket.meta.a-bucket:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.17 to cache LRU end 2024-09-14T11:40:42.262 INFO:tasks.workunit.client.0.smithi138.stderr: -17> 2024-09-14T11:40:42.103+0000 7efc0c3fa9c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:40:42.262 INFO:tasks.workunit.client.0.smithi138.stderr: -16> 2024-09-14T11:40:42.103+0000 7efc0c3fa9c0 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-14T11:40:42.262 INFO:tasks.workunit.client.0.smithi138.stderr: -15> 2024-09-14T11:40:42.103+0000 7efc0c3fa9c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.17 2024-09-14T11:40:42.262 INFO:tasks.workunit.client.0.smithi138.stderr: -14> 2024-09-14T11:40:42.103+0000 7efc0c3fa9c0 10 init_target_layout removing existing target index objects from a previous reshard attempt 2024-09-14T11:40:42.262 INFO:tasks.workunit.client.0.smithi138.stderr: -13> 2024-09-14T11:40:42.123+0000 7efc0c3fa9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.17 info.flags=0x17 2024-09-14T11:40:42.262 INFO:tasks.workunit.client.0.smithi138.stderr: -12> 2024-09-14T11:40:42.123+0000 7efc0c3fa9c0 10 moving default.rgw.meta+root+.bucket.meta.a-bucket:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.17 to cache LRU end 2024-09-14T11:40:42.262 INFO:tasks.workunit.client.0.smithi138.stderr: -11> 2024-09-14T11:40:42.123+0000 7efc0c3fa9c0 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-14T11:40:42.262 INFO:tasks.workunit.client.0.smithi138.stderr: -10> 2024-09-14T11:40:42.123+0000 7efc0c3fa9c0 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.a-bucket:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.17, ofs0, ns] 2024-09-14T11:40:42.262 INFO:tasks.workunit.client.0.smithi138.stderr: -9> 2024-09-14T11:40:42.123+0000 7efaecff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366242 cookie 94534015775408 notifier 8205 bl.length()=827 2024-09-14T11:40:42.262 INFO:tasks.workunit.client.0.smithi138.stderr: -8> 2024-09-14T11:40:42.123+0000 7efaecff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.17 info.flags=0x17 2024-09-14T11:40:42.262 INFO:tasks.workunit.client.0.smithi138.stderr: -7> 2024-09-14T11:40:42.123+0000 7efaecff9640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.a-bucket:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.17 to cache LRU end 2024-09-14T11:40:42.262 INFO:tasks.workunit.client.0.smithi138.stderr: -6> 2024-09-14T11:40:42.123+0000 7efaecff9640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=143 2024-09-14T11:40:42.262 INFO:tasks.workunit.client.0.smithi138.stderr: -5> 2024-09-14T11:40:42.127+0000 7efc0c3fa9c0 20 handle_bi_update(): bucket=:a-bucket[d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.17]): orig_sources= new_sources= 2024-09-14T11:40:42.262 INFO:tasks.workunit.client.0.smithi138.stderr: -4> 2024-09-14T11:40:42.127+0000 7efc0c3fa9c0 20 handle_bi_update(): bucket=:a-bucket[d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.17]): potential sources added=[] removed=[] 2024-09-14T11:40:42.263 INFO:tasks.workunit.client.0.smithi138.stderr: -3> 2024-09-14T11:40:42.127+0000 7efc0c3fa9c0 20 handle_bi_update(): bucket=:a-bucket[d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.17]): orig_dests= new_dests= 2024-09-14T11:40:42.263 INFO:tasks.workunit.client.0.smithi138.stderr: -2> 2024-09-14T11:40:42.127+0000 7efc0c3fa9c0 20 handle_bi_update(): bucket=:a-bucket[d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.17]): potential dests added=[] removed=[] 2024-09-14T11:40:42.263 INFO:tasks.workunit.client.0.smithi138.stderr: -1> 2024-09-14T11:40:42.135+0000 7efc0c3fa9c0 -1 ./src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7efc0c3fa9c0 time 2024-09-14T11:40:42.139277+0000 2024-09-14T11:40:42.263 INFO:tasks.workunit.client.0.smithi138.stderr:./src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-14T11:40:42.263 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-14T11:40:42.263 INFO:tasks.workunit.client.0.smithi138.stderr: ceph version 19.3.0-4907-ga2782315 (a2782315255a3e7d5f6cdc9eb35785187ff6ddf8) squid (dev) 2024-09-14T11:40:42.263 INFO:tasks.workunit.client.0.smithi138.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x121) [0x7efc0fcd42eb] 2024-09-14T11:40:42.263 INFO:tasks.workunit.client.0.smithi138.stderr: 2: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7efc0fcd449f] 2024-09-14T11:40:42.263 INFO:tasks.workunit.client.0.smithi138.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55fa68f09c01] 2024-09-14T11:40:42.263 INFO:tasks.workunit.client.0.smithi138.stderr: 4: radosgw-admin(+0x142325c) [0x55fa6996825c] 2024-09-14T11:40:42.263 INFO:tasks.workunit.client.0.smithi138.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x55fa68f1eecd] 2024-09-14T11:40:42.263 INFO:tasks.workunit.client.0.smithi138.stderr: 6: main() 2024-09-14T11:40:42.263 INFO:tasks.workunit.client.0.smithi138.stderr: 7: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7efc0eb3ad90] 2024-09-14T11:40:42.263 INFO:tasks.workunit.client.0.smithi138.stderr: 8: __libc_start_main() 2024-09-14T11:40:42.263 INFO:tasks.workunit.client.0.smithi138.stderr: 9: _start() 2024-09-14T11:40:42.264 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-14T11:40:42.264 INFO:tasks.workunit.client.0.smithi138.stderr: 0> 2024-09-14T11:40:42.139+0000 7efc0c3fa9c0 -1 *** Caught signal (Aborted) ** 2024-09-14T11:40:42.264 INFO:tasks.workunit.client.0.smithi138.stderr: in thread 7efc0c3fa9c0 thread_name:radosgw-admin 2024-09-14T11:40:42.264 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-14T11:40:42.264 INFO:tasks.workunit.client.0.smithi138.stderr: ceph version 19.3.0-4907-ga2782315 (a2782315255a3e7d5f6cdc9eb35785187ff6ddf8) squid (dev) 2024-09-14T11:40:42.264 INFO:tasks.workunit.client.0.smithi138.stderr: 1: /lib/x86_64-linux-gnu/libc.so.6(+0x42520) [0x7efc0eb53520] 2024-09-14T11:40:42.264 INFO:tasks.workunit.client.0.smithi138.stderr: 2: pthread_kill() 2024-09-14T11:40:42.264 INFO:tasks.workunit.client.0.smithi138.stderr: 3: raise() 2024-09-14T11:40:42.264 INFO:tasks.workunit.client.0.smithi138.stderr: 4: abort() 2024-09-14T11:40:42.264 INFO:tasks.workunit.client.0.smithi138.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x17b) [0x7efc0fcd4345] 2024-09-14T11:40:42.264 INFO:tasks.workunit.client.0.smithi138.stderr: 6: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7efc0fcd449f] 2024-09-14T11:40:42.264 INFO:tasks.workunit.client.0.smithi138.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55fa68f09c01] 2024-09-14T11:40:42.264 INFO:tasks.workunit.client.0.smithi138.stderr: 8: radosgw-admin(+0x142325c) [0x55fa6996825c] 2024-09-14T11:40:42.264 INFO:tasks.workunit.client.0.smithi138.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x55fa68f1eecd] 2024-09-14T11:40:42.264 INFO:tasks.workunit.client.0.smithi138.stderr: 10: main() 2024-09-14T11:40:42.265 INFO:tasks.workunit.client.0.smithi138.stderr: 11: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7efc0eb3ad90] 2024-09-14T11:40:42.265 INFO:tasks.workunit.client.0.smithi138.stderr: 12: __libc_start_main() 2024-09-14T11:40:42.265 INFO:tasks.workunit.client.0.smithi138.stderr: 13: _start() 2024-09-14T11:40:42.265 INFO:tasks.workunit.client.0.smithi138.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-14T11:40:42.265 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-14T11:40:42.265 INFO:tasks.workunit.client.0.smithi138.stderr:--- logging levels --- 2024-09-14T11:40:42.265 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 none 2024-09-14T11:40:42.265 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 1 lockdep 2024-09-14T11:40:42.265 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 1 context 2024-09-14T11:40:42.265 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 1 crush 2024-09-14T11:40:42.265 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 mds 2024-09-14T11:40:42.265 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 mds_balancer 2024-09-14T11:40:42.265 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 mds_locker 2024-09-14T11:40:42.265 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 mds_log 2024-09-14T11:40:42.265 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 mds_log_expire 2024-09-14T11:40:42.265 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 mds_migrator 2024-09-14T11:40:42.266 INFO:tasks.workunit.client.0.smithi138.stderr: 3/ 5 mds_quiesce 2024-09-14T11:40:42.266 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 1 buffer 2024-09-14T11:40:42.266 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 1 timer 2024-09-14T11:40:42.266 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 1 filer 2024-09-14T11:40:42.266 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 1 striper 2024-09-14T11:40:42.266 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 1 objecter 2024-09-14T11:40:42.266 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 rados 2024-09-14T11:40:42.266 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 rbd 2024-09-14T11:40:42.266 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 rbd_mirror 2024-09-14T11:40:42.266 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 rbd_replay 2024-09-14T11:40:42.266 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 rbd_pwl 2024-09-14T11:40:42.266 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 journaler 2024-09-14T11:40:42.266 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 objectcacher 2024-09-14T11:40:42.266 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 immutable_obj_cache 2024-09-14T11:40:42.266 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 client 2024-09-14T11:40:42.267 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 osd 2024-09-14T11:40:42.267 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 optracker 2024-09-14T11:40:42.267 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 objclass 2024-09-14T11:40:42.267 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 3 filestore 2024-09-14T11:40:42.267 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 3 journal 2024-09-14T11:40:42.267 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 0 ms 2024-09-14T11:40:42.267 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 mon 2024-09-14T11:40:42.267 INFO:tasks.workunit.client.0.smithi138.stderr: 0/10 monc 2024-09-14T11:40:42.267 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 paxos 2024-09-14T11:40:42.267 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 tp 2024-09-14T11:40:42.267 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 auth 2024-09-14T11:40:42.267 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 crypto 2024-09-14T11:40:42.267 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 1 finisher 2024-09-14T11:40:42.267 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 1 reserver 2024-09-14T11:40:42.268 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 heartbeatmap 2024-09-14T11:40:42.268 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 perfcounter 2024-09-14T11:40:42.268 INFO:tasks.workunit.client.0.smithi138.stderr: 20/20 rgw 2024-09-14T11:40:42.268 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 rgw_sync 2024-09-14T11:40:42.268 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 rgw_datacache 2024-09-14T11:40:42.268 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 rgw_access 2024-09-14T11:40:42.268 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 rgw_dbstore 2024-09-14T11:40:42.268 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 rgw_flight 2024-09-14T11:40:42.268 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 rgw_lifecycle 2024-09-14T11:40:42.268 INFO:tasks.workunit.client.0.smithi138.stderr: 20/20 rgw_notification 2024-09-14T11:40:42.268 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 javaclient 2024-09-14T11:40:42.268 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 asok 2024-09-14T11:40:42.268 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 1 throttle 2024-09-14T11:40:42.268 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 0 refs 2024-09-14T11:40:42.269 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 compressor 2024-09-14T11:40:42.269 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 bluestore 2024-09-14T11:40:42.269 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 bluefs 2024-09-14T11:40:42.269 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 3 bdev 2024-09-14T11:40:42.269 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 kstore 2024-09-14T11:40:42.269 INFO:tasks.workunit.client.0.smithi138.stderr: 4/ 5 rocksdb 2024-09-14T11:40:42.269 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 fuse 2024-09-14T11:40:42.269 INFO:tasks.workunit.client.0.smithi138.stderr: 2/ 5 mgr 2024-09-14T11:40:42.269 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 mgrc 2024-09-14T11:40:42.269 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 dpdk 2024-09-14T11:40:42.269 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 eventtrace 2024-09-14T11:40:42.269 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 prioritycache 2024-09-14T11:40:42.269 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 test 2024-09-14T11:40:42.269 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 cephfs_mirror 2024-09-14T11:40:42.270 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 cephsqlite 2024-09-14T11:40:42.270 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 crimson_interrupt 2024-09-14T11:40:42.270 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 seastore 2024-09-14T11:40:42.270 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 seastore_onode 2024-09-14T11:40:42.270 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 seastore_odata 2024-09-14T11:40:42.270 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 seastore_omap 2024-09-14T11:40:42.270 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 seastore_tm 2024-09-14T11:40:42.270 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 seastore_t 2024-09-14T11:40:42.270 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 seastore_cleaner 2024-09-14T11:40:42.270 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 seastore_epm 2024-09-14T11:40:42.270 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 seastore_lba 2024-09-14T11:40:42.270 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 seastore_fixedkv_tree 2024-09-14T11:40:42.270 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 seastore_cache 2024-09-14T11:40:42.270 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 seastore_journal 2024-09-14T11:40:42.270 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 seastore_device 2024-09-14T11:40:42.271 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 seastore_backref 2024-09-14T11:40:42.271 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 alienstore 2024-09-14T11:40:42.271 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 mclock 2024-09-14T11:40:42.271 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 cyanstore 2024-09-14T11:40:42.271 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 ceph_exporter 2024-09-14T11:40:42.271 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 memstore 2024-09-14T11:40:42.271 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 trace 2024-09-14T11:40:42.271 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 ceph_dedup 2024-09-14T11:40:42.271 INFO:tasks.workunit.client.0.smithi138.stderr: -2/-2 (syslog threshold) 2024-09-14T11:40:42.271 INFO:tasks.workunit.client.0.smithi138.stderr: 99/99 (stderr threshold) 2024-09-14T11:40:42.271 INFO:tasks.workunit.client.0.smithi138.stderr:--- pthread ID / name mapping for recent threads --- 2024-09-14T11:40:42.271 INFO:tasks.workunit.client.0.smithi138.stderr: 7efa2bfff640 / http_manager 2024-09-14T11:40:42.272 INFO:tasks.workunit.client.0.smithi138.stderr: 7efaba7fc640 / http_manager 2024-09-14T11:40:42.272 INFO:tasks.workunit.client.0.smithi138.stderr: 7efabb7fe640 / rgw_dt_lg_renew 2024-09-14T11:40:42.272 INFO:tasks.workunit.client.0.smithi138.stderr: 7efadb7fe640 / ms_dispatch 2024-09-14T11:40:42.272 INFO:tasks.workunit.client.0.smithi138.stderr: 7efaecff9640 / io_context_pool 2024-09-14T11:40:42.272 INFO:tasks.workunit.client.0.smithi138.stderr: 7efaed7fa640 / io_context_pool 2024-09-14T11:40:42.272 INFO:tasks.workunit.client.0.smithi138.stderr: 7efaef7fe640 / ms_dispatch 2024-09-14T11:40:42.272 INFO:tasks.workunit.client.0.smithi138.stderr: 7efaf6604640 / ms_dispatch 2024-09-14T11:40:42.272 INFO:tasks.workunit.client.0.smithi138.stderr: 7efaf7e07640 / io_context_pool 2024-09-14T11:40:42.272 INFO:tasks.workunit.client.0.smithi138.stderr: 7efc096ff640 / msgr-worker-2 2024-09-14T11:40:42.272 INFO:tasks.workunit.client.0.smithi138.stderr: 7efc09f00640 / msgr-worker-1 2024-09-14T11:40:42.272 INFO:tasks.workunit.client.0.smithi138.stderr: 7efc0a701640 / msgr-worker-0 2024-09-14T11:40:42.272 INFO:tasks.workunit.client.0.smithi138.stderr: 7efc0af02640 / io_context_pool 2024-09-14T11:40:42.272 INFO:tasks.workunit.client.0.smithi138.stderr: 7efc0c3fa9c0 / radosgw-admin 2024-09-14T11:40:42.272 INFO:tasks.workunit.client.0.smithi138.stderr: max_recent 500 2024-09-14T11:40:42.272 INFO:tasks.workunit.client.0.smithi138.stderr: max_new 1000 2024-09-14T11:40:42.272 INFO:tasks.workunit.client.0.smithi138.stderr: log_file /var/lib/ceph/crash/2024-09-14T11:40:42.142626Z_93cedda0-d0b0-4d53-b738-ec08e7907cc3/log 2024-09-14T11:40:42.273 INFO:tasks.workunit.client.0.smithi138.stderr:--- end dump of recent events --- 2024-09-14T11:40:42.273 INFO:tasks.workunit.client.0.smithi138.stderr:Aborted 2024-09-14T11:40:42.273 INFO:tasks.workunit.client.0.smithi138.stderr:radosgw-admin reshardlog list --bucket a-bucket 2024-09-14T11:40:42.274 INFO:tasks.workunit.client.0.smithi138.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:40:42.274 INFO:tasks.workunit.client.0.smithi138.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:40:42.274 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:40:42.223+0000 7fcd2042b9c0 20 rados->read ofs=0 len=0 2024-09-14T11:40:42.274 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:40:42.227+0000 7fcd2042b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:40:42.274 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:40:42.227+0000 7fcd2042b9c0 20 realm 2024-09-14T11:40:42.274 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:40:42.227+0000 7fcd2042b9c0 20 rados->read ofs=0 len=0 2024-09-14T11:40:42.274 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:40:42.227+0000 7fcd2042b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:40:42.275 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:40:42.227+0000 7fcd2042b9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:40:42.275 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:40:42.227+0000 7fcd2042b9c0 20 rados->read ofs=0 len=0 2024-09-14T11:40:42.275 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:40:42.227+0000 7fcd2042b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:40:42.275 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:40:42.227+0000 7fcd2042b9c0 20 rados->read ofs=0 len=0 2024-09-14T11:40:42.275 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:40:42.227+0000 7fcd2042b9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:40:42.275 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:40:42.227+0000 7fcd2042b9c0 20 rados->read ofs=0 len=0 2024-09-14T11:40:42.275 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:40:42.227+0000 7fcd2042b9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:40:42.275 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:40:42.227+0000 7fcd2042b9c0 20 searching for the correct realm 2024-09-14T11:40:42.275 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:40:42.231+0000 7fcd1e732640 0 -- 172.21.15.138:0/2229515317 >> [v2:172.21.15.154:6824/416768175,v1:172.21.15.154:6825/416768175] conn(0x7fcd18131be0 msgr2=0x7fcd181022e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-14T11:40:42.446 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:40:42.447+0000 7fcd1d730640 0 -- 172.21.15.138:0/2229515317 >> [v2:172.21.15.138:6816/326481658,v1:172.21.15.138:6817/326481658] conn(0x7fcd181072d0 msgr2=0x7fcd180fc250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:40:42.663 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:40:42.663+0000 7fcd2042b9c0 20 RGWRados::pool_iterate: got zone_info.d9e72d30-c60b-4d0d-9267-fdc36392d5ad 2024-09-14T11:40:42.663 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:40:42.663+0000 7fcd2042b9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:40:42.663 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:40:42.663+0000 7fcd2042b9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:40:42.663 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:40:42.663+0000 7fcd2042b9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:40:42.663 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:40:42.663+0000 7fcd2042b9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:40:42.663 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:40:42.663+0000 7fcd2042b9c0 20 RGWRados::pool_iterate: got zonegroup_info.65ab941b-da8c-4160-94fb-3672b069d44f 2024-09-14T11:40:42.664 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:40:42.663+0000 7fcd2042b9c0 20 rados->read ofs=0 len=0 2024-09-14T11:40:42.664 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:40:42.663+0000 7fcd2042b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:40:42.664 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:40:42.663+0000 7fcd2042b9c0 20 rados->read ofs=0 len=0 2024-09-14T11:40:42.664 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:40:42.667+0000 7fcd2042b9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:40:42.664 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:40:42.667+0000 7fcd2042b9c0 20 rados->read ofs=0 len=0 2024-09-14T11:40:42.665 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:40:42.667+0000 7fcd2042b9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:40:42.665 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:40:42.667+0000 7fcd2042b9c0 20 zone default found 2024-09-14T11:40:42.665 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:40:42.667+0000 7fcd2042b9c0 4 Realm: () 2024-09-14T11:40:42.665 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:40:42.667+0000 7fcd2042b9c0 4 ZoneGroup: default (65ab941b-da8c-4160-94fb-3672b069d44f) 2024-09-14T11:40:42.665 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:40:42.667+0000 7fcd2042b9c0 4 Zone: default (d9e72d30-c60b-4d0d-9267-fdc36392d5ad) 2024-09-14T11:40:42.665 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:40:42.667+0000 7fcd2042b9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:40:42.666 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:40:42.667+0000 7fcd2042b9c0 20 zonegroup default 2024-09-14T11:40:42.666 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:40:42.667+0000 7fcd2042b9c0 20 rados->read ofs=0 len=0 2024-09-14T11:40:42.666 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:40:42.667+0000 7fcd2042b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:40:42.666 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:40:42.667+0000 7fcd2042b9c0 20 rados->read ofs=0 len=0 2024-09-14T11:40:42.666 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:40:42.667+0000 7fcd2042b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:40:42.666 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:40:42.667+0000 7fcd2042b9c0 20 rados->read ofs=0 len=0 2024-09-14T11:40:42.667 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:40:42.667+0000 7fcd2042b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:40:42.667 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:40:42.667+0000 7fcd2042b9c0 20 started sync module instance, tier type = 2024-09-14T11:40:42.667 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:40:42.667+0000 7fcd2042b9c0 20 started zone id=d9e72d30-c60b-4d0d-9267-fdc36392d5ad (name=default) with tier type = 2024-09-14T11:40:42.690 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:40:42.691+0000 7fcd2042b9c0 20 add_watcher() i=0 2024-09-14T11:40:42.736 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:40:42.691+0000 7fcd2042b9c0 20 add_watcher() i=1 2024-09-14T11:40:42.736 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:40:42.691+0000 7fcd2042b9c0 20 add_watcher() i=2 2024-09-14T11:40:42.736 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:40:42.691+0000 7fcd2042b9c0 20 add_watcher() i=3 2024-09-14T11:40:42.737 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:40:42.691+0000 7fcd2042b9c0 20 add_watcher() i=4 2024-09-14T11:40:42.737 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:40:42.691+0000 7fcd2042b9c0 20 add_watcher() i=5 2024-09-14T11:40:42.737 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:40:42.691+0000 7fcd2042b9c0 20 add_watcher() i=6 2024-09-14T11:40:42.740 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:40:42.695+0000 7fcd2042b9c0 20 add_watcher() i=7 2024-09-14T11:40:42.740 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:40:42.695+0000 7fcd2042b9c0 2 all 8 watchers are set, enabling cache 2024-09-14T11:40:42.740 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:40:42.695+0000 7fcbcf7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:40:42.740 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:40:42.699+0000 7fcd2042b9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:40:42.740 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:40:42.699+0000 7fcd2042b9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:40:42.740 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:40:42.699+0000 7fcd2042b9c0 5 note: GC not initialized 2024-09-14T11:40:42.740 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:40:42.699+0000 7fcbce7fc640 20 reqs_thread_entry: start 2024-09-14T11:40:42.740 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:40:42.699+0000 7fcd2042b9c0 20 init_complete bucket index max shards: 11 2024-09-14T11:40:42.741 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:40:42.699+0000 7fcd2042b9c0 20 Filter name: none 2024-09-14T11:40:42.741 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:40:42.699+0000 7fcb3ffff640 20 reqs_thread_entry: start 2024-09-14T11:40:42.741 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:40:42.699+0000 7fcd2042b9c0 10 cache get: name=default.rgw.meta+root+a-bucket : miss 2024-09-14T11:40:42.741 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:40:42.699+0000 7fcd2042b9c0 20 rados->read ofs=0 len=0 2024-09-14T11:40:42.741 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:40:42.699+0000 7fcd2042b9c0 20 rados_obj.operate() r=0 bl.length=176 2024-09-14T11:40:42.741 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:40:42.699+0000 7fcd2042b9c0 10 cache put: name=default.rgw.meta+root+a-bucket info.flags=0x11 2024-09-14T11:40:42.741 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:40:42.699+0000 7fcd2042b9c0 10 adding default.rgw.meta+root+a-bucket to cache LRU end 2024-09-14T11:40:42.741 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:40:42.699+0000 7fcd2042b9c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.17 : miss 2024-09-14T11:40:42.741 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:40:42.699+0000 7fcd2042b9c0 20 rados->read ofs=0 len=0 2024-09-14T11:40:42.741 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:40:42.699+0000 7fcd2042b9c0 20 rados_obj.operate() r=0 bl.length=430 2024-09-14T11:40:42.741 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:40:42.699+0000 7fcd2042b9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.17 info.flags=0x17 2024-09-14T11:40:42.741 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:40:42.699+0000 7fcd2042b9c0 10 adding default.rgw.meta+root+.bucket.meta.a-bucket:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.17 to cache LRU end 2024-09-14T11:40:42.741 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:40:42.699+0000 7fcd2042b9c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:40:42.741 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:40:42.699+0000 7fcd2042b9c0 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-14T11:40:42.742 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:40:42.699+0000 7fcd2042b9c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.17 2024-09-14T11:40:42.742 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:40:42.699+0000 7fcd2042b9c0 10 bucket_obj is .dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.17.2.0 2024-09-14T11:40:42.742 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:40:42.699+0000 7fcd2042b9c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.17.2.0 2024-09-14T11:40:42.742 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:40:42.703+0000 7fcd2042b9c0 10 bucket_obj is .dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.17.2.1 2024-09-14T11:40:42.742 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:40:42.703+0000 7fcd2042b9c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.17.2.1 2024-09-14T11:40:42.742 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:40:42.703+0000 7fcd2042b9c0 10 bucket_obj is .dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.17.2.2 2024-09-14T11:40:42.742 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:40:42.703+0000 7fcd2042b9c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.17.2.2 2024-09-14T11:40:42.742 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:40:42.703+0000 7fcd2042b9c0 10 bucket_obj is .dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.17.2.3 2024-09-14T11:40:42.742 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:40:42.703+0000 7fcd2042b9c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.17.2.3 2024-09-14T11:40:42.742 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:40:42.703+0000 7fcd2042b9c0 10 bucket_obj is .dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.17.2.4 2024-09-14T11:40:42.742 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:40:42.703+0000 7fcd2042b9c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.17.2.4 2024-09-14T11:40:42.742 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:40:42.703+0000 7fcd2042b9c0 10 bucket_obj is .dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.17.2.5 2024-09-14T11:40:42.742 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:40:42.703+0000 7fcd2042b9c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.17.2.5 2024-09-14T11:40:42.742 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:40:42.707+0000 7fcd2042b9c0 10 bucket_obj is .dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.17.2.6 2024-09-14T11:40:42.742 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:40:42.707+0000 7fcd2042b9c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.17.2.6 2024-09-14T11:40:42.743 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:40:42.707+0000 7fcd2042b9c0 10 bucket_obj is .dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.17.2.7 2024-09-14T11:40:42.743 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:40:42.707+0000 7fcd2042b9c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.17.2.7 2024-09-14T11:40:42.743 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:40:42.707+0000 7fcd2042b9c0 10 bucket_obj is .dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.17.2.8 2024-09-14T11:40:42.743 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:40:42.707+0000 7fcd2042b9c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.17.2.8 2024-09-14T11:40:42.743 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:40:42.707+0000 7fcd2042b9c0 10 bucket_obj is .dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.17.2.9 2024-09-14T11:40:42.743 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:40:42.707+0000 7fcd2042b9c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.17.2.9 2024-09-14T11:40:42.743 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:40:42.707+0000 7fcd2042b9c0 10 bucket_obj is .dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.17.2.10 2024-09-14T11:40:42.743 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:40:42.707+0000 7fcd2042b9c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.17.2.10 2024-09-14T11:40:42.743 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:40:42.707+0000 7fcd2042b9c0 10 bucket_obj is .dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.17.2.11 2024-09-14T11:40:42.743 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:40:42.707+0000 7fcd2042b9c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.17.2.11 2024-09-14T11:40:42.743 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:40:42.711+0000 7fcd2042b9c0 10 bucket_obj is .dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.17.2.12 2024-09-14T11:40:42.743 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:40:42.711+0000 7fcd2042b9c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.17.2.12 2024-09-14T11:40:42.743 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:40:42.711+0000 7fcbcf7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:40:42.743 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:40:42.715+0000 7fcd2042b9c0 20 remove_watcher() i=0 2024-09-14T11:40:42.743 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:40:42.715+0000 7fcd2042b9c0 2 removed watcher, disabling cache 2024-09-14T11:40:42.743 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:40:42.719+0000 7fcd2042b9c0 20 remove_watcher() i=1 2024-09-14T11:40:42.744 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:40:42.723+0000 7fcd2042b9c0 20 remove_watcher() i=2 2024-09-14T11:40:42.744 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:40:42.723+0000 7fcd2042b9c0 20 remove_watcher() i=3 2024-09-14T11:40:42.744 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:40:42.727+0000 7fcd2042b9c0 20 remove_watcher() i=4 2024-09-14T11:40:42.744 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:40:42.727+0000 7fcd2042b9c0 20 remove_watcher() i=5 2024-09-14T11:40:42.744 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:40:42.727+0000 7fcd2042b9c0 20 remove_watcher() i=6 2024-09-14T11:40:42.744 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:40:42.731+0000 7fcd2042b9c0 20 remove_watcher() i=7 2024-09-14T11:40:42.744 INFO:tasks.workunit.client.0.smithi138.stderr: test: duplicated entries can be purged manually 2024-09-14T11:41:12.765 INFO:tasks.workunit.client.0.smithi138.stderr:radosgw-admin bucket stats --bucket a-bucket 2024-09-14T11:41:12.798 INFO:tasks.workunit.client.0.smithi138.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:41:12.798 INFO:tasks.workunit.client.0.smithi138.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:41:12.844 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:12.842+0000 7f2f552c99c0 20 rados->read ofs=0 len=0 2024-09-14T11:41:12.845 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:12.846+0000 7f2f552c99c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:41:12.845 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:12.846+0000 7f2f552c99c0 20 realm 2024-09-14T11:41:12.845 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:12.846+0000 7f2f552c99c0 20 rados->read ofs=0 len=0 2024-09-14T11:41:12.846 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:12.846+0000 7f2f552c99c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:41:12.846 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:12.846+0000 7f2f552c99c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:41:12.846 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:12.846+0000 7f2f552c99c0 20 rados->read ofs=0 len=0 2024-09-14T11:41:12.846 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:12.846+0000 7f2f552c99c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:41:12.846 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:12.846+0000 7f2f552c99c0 20 rados->read ofs=0 len=0 2024-09-14T11:41:12.848 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:12.850+0000 7f2f552c99c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:41:12.848 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:12.850+0000 7f2f552c99c0 20 rados->read ofs=0 len=0 2024-09-14T11:41:12.849 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:12.850+0000 7f2f552c99c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:41:12.849 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:12.850+0000 7f2f552c99c0 20 searching for the correct realm 2024-09-14T11:41:12.854 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:12.854+0000 7f2f52dcf640 0 -- 172.21.15.138:0/320794743 >> [v2:172.21.15.138:6800/1799335858,v1:172.21.15.138:6801/1799335858] conn(0x55c360361ec0 msgr2=0x55c360364380 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-14T11:41:12.861 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:12.862+0000 7f2f525ce640 0 -- 172.21.15.138:0/320794743 >> [v2:172.21.15.138:6816/326481658,v1:172.21.15.138:6817/326481658] conn(0x7f2f44086720 msgr2=0x7f2f440666d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:41:12.869 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:12.870+0000 7f2f552c99c0 20 RGWRados::pool_iterate: got zone_info.d9e72d30-c60b-4d0d-9267-fdc36392d5ad 2024-09-14T11:41:12.869 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:12.870+0000 7f2f552c99c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:41:12.869 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:12.870+0000 7f2f552c99c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:41:12.869 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:12.870+0000 7f2f552c99c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:41:12.869 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:12.870+0000 7f2f552c99c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:41:12.869 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:12.870+0000 7f2f552c99c0 20 RGWRados::pool_iterate: got zonegroup_info.65ab941b-da8c-4160-94fb-3672b069d44f 2024-09-14T11:41:12.869 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:12.870+0000 7f2f552c99c0 20 rados->read ofs=0 len=0 2024-09-14T11:41:12.870 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:12.870+0000 7f2f552c99c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:41:12.870 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:12.870+0000 7f2f552c99c0 20 rados->read ofs=0 len=0 2024-09-14T11:41:12.870 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:12.870+0000 7f2f552c99c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:41:12.870 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:12.870+0000 7f2f552c99c0 20 rados->read ofs=0 len=0 2024-09-14T11:41:12.871 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:12.870+0000 7f2f552c99c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:41:12.871 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:12.870+0000 7f2f552c99c0 20 zone default found 2024-09-14T11:41:12.871 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:12.870+0000 7f2f552c99c0 4 Realm: () 2024-09-14T11:41:12.871 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:12.870+0000 7f2f552c99c0 4 ZoneGroup: default (65ab941b-da8c-4160-94fb-3672b069d44f) 2024-09-14T11:41:12.871 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:12.870+0000 7f2f552c99c0 4 Zone: default (d9e72d30-c60b-4d0d-9267-fdc36392d5ad) 2024-09-14T11:41:12.871 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:12.870+0000 7f2f552c99c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:41:12.871 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:12.870+0000 7f2f552c99c0 20 zonegroup default 2024-09-14T11:41:12.872 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:12.870+0000 7f2f552c99c0 20 rados->read ofs=0 len=0 2024-09-14T11:41:12.872 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:12.870+0000 7f2f552c99c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:41:12.872 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:12.870+0000 7f2f552c99c0 20 rados->read ofs=0 len=0 2024-09-14T11:41:12.872 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:12.870+0000 7f2f552c99c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:41:12.872 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:12.870+0000 7f2f552c99c0 20 rados->read ofs=0 len=0 2024-09-14T11:41:12.872 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:12.874+0000 7f2f552c99c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:41:12.873 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:12.874+0000 7f2f552c99c0 20 started sync module instance, tier type = 2024-09-14T11:41:12.873 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:12.874+0000 7f2f552c99c0 20 started zone id=d9e72d30-c60b-4d0d-9267-fdc36392d5ad (name=default) with tier type = 2024-09-14T11:41:12.887 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:12.886+0000 7f2f552c99c0 20 add_watcher() i=0 2024-09-14T11:41:12.887 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:12.886+0000 7f2f552c99c0 20 add_watcher() i=1 2024-09-14T11:41:12.887 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:12.886+0000 7f2f552c99c0 20 add_watcher() i=2 2024-09-14T11:41:12.887 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:12.886+0000 7f2f552c99c0 20 add_watcher() i=3 2024-09-14T11:41:12.887 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:12.886+0000 7f2f552c99c0 20 add_watcher() i=4 2024-09-14T11:41:12.887 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:12.886+0000 7f2f552c99c0 20 add_watcher() i=5 2024-09-14T11:41:12.888 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:12.886+0000 7f2f552c99c0 20 add_watcher() i=6 2024-09-14T11:41:12.889 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:12.890+0000 7f2f552c99c0 20 add_watcher() i=7 2024-09-14T11:41:12.889 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:12.890+0000 7f2f552c99c0 2 all 8 watchers are set, enabling cache 2024-09-14T11:41:12.892 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:12.890+0000 7f2e097e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:41:12.893 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:12.894+0000 7f2f552c99c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:41:12.893 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:12.894+0000 7f2f552c99c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:41:12.893 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:12.894+0000 7f2f552c99c0 5 note: GC not initialized 2024-09-14T11:41:12.893 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:12.894+0000 7f2d83fff640 20 reqs_thread_entry: start 2024-09-14T11:41:12.893 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:12.894+0000 7f2f552c99c0 20 init_complete bucket index max shards: 11 2024-09-14T11:41:12.893 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:12.894+0000 7f2f552c99c0 20 Filter name: none 2024-09-14T11:41:12.893 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:12.894+0000 7f2d81ffb640 20 reqs_thread_entry: start 2024-09-14T11:41:12.893 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:12.894+0000 7f2f552c99c0 20 rados->read ofs=0 len=0 2024-09-14T11:41:12.894 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:12.894+0000 7f2f552c99c0 20 rados_obj.operate() r=0 bl.length=176 2024-09-14T11:41:12.894 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:12.894+0000 7f2f552c99c0 20 rados->read ofs=0 len=0 2024-09-14T11:41:12.894 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:12.894+0000 7f2f552c99c0 20 rados_obj.operate() r=0 bl.length=430 2024-09-14T11:41:12.895 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:12.894+0000 7f2f552c99c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:41:12.895 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:12.894+0000 7f2f552c99c0 20 rados->read ofs=0 len=0 2024-09-14T11:41:12.895 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:12.894+0000 7f2f552c99c0 20 rados_obj.operate() r=0 bl.length=176 2024-09-14T11:41:12.895 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:12.894+0000 7f2f552c99c0 20 rados->read ofs=0 len=0 2024-09-14T11:41:12.896 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:12.894+0000 7f2f552c99c0 20 rados_obj.operate() r=0 bl.length=430 2024-09-14T11:41:12.896 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:12.894+0000 7f2f552c99c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:41:12.898 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:12.898+0000 7f2e097e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:41:12.903 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:12.902+0000 7f2f552c99c0 20 remove_watcher() i=0 2024-09-14T11:41:12.903 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:12.902+0000 7f2f552c99c0 2 removed watcher, disabling cache 2024-09-14T11:41:12.905 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:12.906+0000 7f2f552c99c0 20 remove_watcher() i=1 2024-09-14T11:41:12.907 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:12.906+0000 7f2f552c99c0 20 remove_watcher() i=2 2024-09-14T11:41:12.909 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:12.910+0000 7f2f552c99c0 20 remove_watcher() i=3 2024-09-14T11:41:12.911 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:12.910+0000 7f2f552c99c0 20 remove_watcher() i=4 2024-09-14T11:41:12.913 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:12.914+0000 7f2f552c99c0 20 remove_watcher() i=5 2024-09-14T11:41:12.914 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:12.914+0000 7f2f552c99c0 20 remove_watcher() i=6 2024-09-14T11:41:12.915 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:12.914+0000 7f2f552c99c0 20 remove_watcher() i=7 2024-09-14T11:41:12.929 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-14T11:41:12.929 INFO:tasks.workunit.client.0.smithi138.stderr:BUCKET_STATS: 2024-09-14T11:41:12.930 INFO:tasks.workunit.client.0.smithi138.stderr:bucket: a-bucket id: d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.17 num_objects: 11 size_kb: 1 num_shards: 13 2024-09-14T11:41:12.930 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-14T11:41:12.930 INFO:tasks.workunit.client.0.smithi138.stderr:radosgw-admin bucket reshard --bucket a-bucket --num-shards 14 --rgw-reshard-bucket-lock-duration 30 --inject-abort-at do_reshard 2024-09-14T11:41:12.962 INFO:tasks.workunit.client.0.smithi138.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:41:12.962 INFO:tasks.workunit.client.0.smithi138.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:41:13.005 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:13.006+0000 7fdce3c279c0 20 rados->read ofs=0 len=0 2024-09-14T11:41:13.008 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:13.006+0000 7fdce3c279c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:41:13.008 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:13.006+0000 7fdce3c279c0 20 realm 2024-09-14T11:41:13.008 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:13.006+0000 7fdce3c279c0 20 rados->read ofs=0 len=0 2024-09-14T11:41:13.008 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:13.010+0000 7fdce3c279c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:41:13.008 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:13.010+0000 7fdce3c279c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:41:13.008 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:13.010+0000 7fdce3c279c0 20 rados->read ofs=0 len=0 2024-09-14T11:41:13.009 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:13.010+0000 7fdce3c279c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:41:13.009 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:13.010+0000 7fdce3c279c0 20 rados->read ofs=0 len=0 2024-09-14T11:41:13.010 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:13.010+0000 7fdce3c279c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:41:13.010 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:13.010+0000 7fdce3c279c0 20 rados->read ofs=0 len=0 2024-09-14T11:41:13.010 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:13.010+0000 7fdce3c279c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:41:13.011 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:13.010+0000 7fdce3c279c0 20 searching for the correct realm 2024-09-14T11:41:13.015 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:13.014+0000 7fdce1f2e640 0 -- 172.21.15.138:0/1011542782 >> [v2:172.21.15.154:6824/416768175,v1:172.21.15.154:6825/416768175] conn(0x7fdcd4018930 msgr2=0x7fdcd4033400 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:41:13.021 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:13.022+0000 7fdce0f2c640 0 -- 172.21.15.138:0/1011542782 >> [v2:172.21.15.138:6816/326481658,v1:172.21.15.138:6817/326481658] conn(0x7fdcd405bac0 msgr2=0x7fdcd403f3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:41:13.240 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:13.242+0000 7fdce3c279c0 20 RGWRados::pool_iterate: got zone_info.d9e72d30-c60b-4d0d-9267-fdc36392d5ad 2024-09-14T11:41:13.240 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:13.242+0000 7fdce3c279c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:41:13.241 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:13.242+0000 7fdce3c279c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:41:13.241 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:13.242+0000 7fdce3c279c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:41:13.241 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:13.242+0000 7fdce3c279c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:41:13.241 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:13.242+0000 7fdce3c279c0 20 RGWRados::pool_iterate: got zonegroup_info.65ab941b-da8c-4160-94fb-3672b069d44f 2024-09-14T11:41:13.241 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:13.242+0000 7fdce3c279c0 20 rados->read ofs=0 len=0 2024-09-14T11:41:13.241 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:13.242+0000 7fdce3c279c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:41:13.241 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:13.242+0000 7fdce3c279c0 20 rados->read ofs=0 len=0 2024-09-14T11:41:13.242 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:13.242+0000 7fdce3c279c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:41:13.242 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:13.242+0000 7fdce3c279c0 20 rados->read ofs=0 len=0 2024-09-14T11:41:13.243 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:13.242+0000 7fdce3c279c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:41:13.243 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:13.242+0000 7fdce3c279c0 20 zone default found 2024-09-14T11:41:13.243 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:13.242+0000 7fdce3c279c0 4 Realm: () 2024-09-14T11:41:13.243 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:13.242+0000 7fdce3c279c0 4 ZoneGroup: default (65ab941b-da8c-4160-94fb-3672b069d44f) 2024-09-14T11:41:13.243 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:13.242+0000 7fdce3c279c0 4 Zone: default (d9e72d30-c60b-4d0d-9267-fdc36392d5ad) 2024-09-14T11:41:13.243 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:13.242+0000 7fdce3c279c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:41:13.243 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:13.242+0000 7fdce3c279c0 20 zonegroup default 2024-09-14T11:41:13.243 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:13.242+0000 7fdce3c279c0 20 rados->read ofs=0 len=0 2024-09-14T11:41:13.244 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:13.242+0000 7fdce3c279c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:41:13.244 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:13.242+0000 7fdce3c279c0 20 rados->read ofs=0 len=0 2024-09-14T11:41:13.244 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:13.246+0000 7fdce3c279c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:41:13.244 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:13.246+0000 7fdce3c279c0 20 rados->read ofs=0 len=0 2024-09-14T11:41:13.245 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:13.246+0000 7fdce3c279c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:41:13.245 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:13.246+0000 7fdce3c279c0 20 started sync module instance, tier type = 2024-09-14T11:41:13.245 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:13.246+0000 7fdce3c279c0 20 started zone id=d9e72d30-c60b-4d0d-9267-fdc36392d5ad (name=default) with tier type = 2024-09-14T11:41:13.268 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:13.270+0000 7fdce3c279c0 20 add_watcher() i=0 2024-09-14T11:41:13.268 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:13.270+0000 7fdce3c279c0 20 add_watcher() i=1 2024-09-14T11:41:13.268 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:13.270+0000 7fdce3c279c0 20 add_watcher() i=2 2024-09-14T11:41:13.269 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:13.270+0000 7fdce3c279c0 20 add_watcher() i=3 2024-09-14T11:41:13.269 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:13.270+0000 7fdce3c279c0 20 add_watcher() i=4 2024-09-14T11:41:13.269 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:13.270+0000 7fdce3c279c0 20 add_watcher() i=5 2024-09-14T11:41:13.269 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:13.270+0000 7fdce3c279c0 20 add_watcher() i=6 2024-09-14T11:41:13.271 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:13.270+0000 7fdce3c279c0 20 add_watcher() i=7 2024-09-14T11:41:13.271 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:13.270+0000 7fdce3c279c0 2 all 8 watchers are set, enabling cache 2024-09-14T11:41:13.275 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:13.274+0000 7fdb97fe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:41:13.276 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:13.274+0000 7fdce3c279c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:41:13.276 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:13.274+0000 7fdce3c279c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:41:13.276 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:13.278+0000 7fdce3c279c0 5 note: GC not initialized 2024-09-14T11:41:13.277 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:13.278+0000 7fdb96fe5640 20 reqs_thread_entry: start 2024-09-14T11:41:13.277 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:13.278+0000 7fdce3c279c0 20 init_complete bucket index max shards: 11 2024-09-14T11:41:13.277 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:13.278+0000 7fdce3c279c0 20 Filter name: none 2024-09-14T11:41:13.277 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:13.278+0000 7fdb94fe1640 20 reqs_thread_entry: start 2024-09-14T11:41:13.277 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:13.278+0000 7fdce3c279c0 10 cache get: name=default.rgw.meta+root+a-bucket : miss 2024-09-14T11:41:13.277 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:13.278+0000 7fdce3c279c0 20 rados->read ofs=0 len=0 2024-09-14T11:41:13.279 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:13.278+0000 7fdce3c279c0 20 rados_obj.operate() r=0 bl.length=176 2024-09-14T11:41:13.279 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:13.278+0000 7fdce3c279c0 10 cache put: name=default.rgw.meta+root+a-bucket info.flags=0x11 2024-09-14T11:41:13.279 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:13.278+0000 7fdce3c279c0 10 adding default.rgw.meta+root+a-bucket to cache LRU end 2024-09-14T11:41:13.279 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:13.278+0000 7fdce3c279c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.17 : miss 2024-09-14T11:41:13.279 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:13.278+0000 7fdce3c279c0 20 rados->read ofs=0 len=0 2024-09-14T11:41:13.279 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:13.278+0000 7fdce3c279c0 20 rados_obj.operate() r=0 bl.length=430 2024-09-14T11:41:13.279 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:13.278+0000 7fdce3c279c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.17 info.flags=0x17 2024-09-14T11:41:13.279 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:13.278+0000 7fdce3c279c0 10 adding default.rgw.meta+root+.bucket.meta.a-bucket:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.17 to cache LRU end 2024-09-14T11:41:13.279 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:13.278+0000 7fdce3c279c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:41:13.279 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:13.278+0000 7fdce3c279c0 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-14T11:41:13.279 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:13.278+0000 7fdce3c279c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.17 2024-09-14T11:41:13.281 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:13.282+0000 7fdce3c279c0 10 init_target_layout removing existing target index objects from a previous reshard attempt 2024-09-14T11:41:13.298 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:13.298+0000 7fdce3c279c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.17 info.flags=0x17 2024-09-14T11:41:13.298 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:13.298+0000 7fdce3c279c0 10 moving default.rgw.meta+root+.bucket.meta.a-bucket:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.17 to cache LRU end 2024-09-14T11:41:13.298 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:13.298+0000 7fdce3c279c0 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-14T11:41:13.298 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:13.298+0000 7fdce3c279c0 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.a-bucket:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.17, ofs0, ns] 2024-09-14T11:41:13.298 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:13.298+0000 7fdbb7fff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366243 cookie 94100999125296 notifier 8259 bl.length()=827 2024-09-14T11:41:13.298 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:13.298+0000 7fdbb7fff640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.17 info.flags=0x17 2024-09-14T11:41:13.299 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:13.298+0000 7fdbb7fff640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.a-bucket:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.17 to cache LRU end 2024-09-14T11:41:13.299 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:13.298+0000 7fdbb7fff640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=143 2024-09-14T11:41:13.302 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:13.302+0000 7fdce3c279c0 20 handle_bi_update(): bucket=:a-bucket[d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.17]): orig_sources= new_sources= 2024-09-14T11:41:13.302 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:13.302+0000 7fdce3c279c0 20 handle_bi_update(): bucket=:a-bucket[d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.17]): potential sources added=[] removed=[] 2024-09-14T11:41:13.302 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:13.302+0000 7fdce3c279c0 20 handle_bi_update(): bucket=:a-bucket[d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.17]): orig_dests= new_dests= 2024-09-14T11:41:13.302 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:13.302+0000 7fdce3c279c0 20 handle_bi_update(): bucket=:a-bucket[d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.17]): potential dests added=[] removed=[] 2024-09-14T11:41:13.312 INFO:tasks.workunit.client.0.smithi138.stderr:./src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7fdce3c279c0 time 2024-09-14T11:41:13.317278+0000 2024-09-14T11:41:13.312 INFO:tasks.workunit.client.0.smithi138.stderr:./src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-14T11:41:13.313 INFO:tasks.workunit.client.0.smithi138.stderr: ceph version 19.3.0-4907-ga2782315 (a2782315255a3e7d5f6cdc9eb35785187ff6ddf8) squid (dev) 2024-09-14T11:41:13.314 INFO:tasks.workunit.client.0.smithi138.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x121) [0x7fdce75012eb] 2024-09-14T11:41:13.314 INFO:tasks.workunit.client.0.smithi138.stderr: 2: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7fdce750149f] 2024-09-14T11:41:13.314 INFO:tasks.workunit.client.0.smithi138.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x559596c0bc01] 2024-09-14T11:41:13.314 INFO:tasks.workunit.client.0.smithi138.stderr: 4: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x17a) [0x559596c20f3a] 2024-09-14T11:41:13.314 INFO:tasks.workunit.client.0.smithi138.stderr: 5: main() 2024-09-14T11:41:13.314 INFO:tasks.workunit.client.0.smithi138.stderr: 6: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7fdce6367d90] 2024-09-14T11:41:13.314 INFO:tasks.workunit.client.0.smithi138.stderr: 7: __libc_start_main() 2024-09-14T11:41:13.314 INFO:tasks.workunit.client.0.smithi138.stderr: 8: _start() 2024-09-14T11:41:13.314 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:13.314+0000 7fdce3c279c0 -1 ./src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7fdce3c279c0 time 2024-09-14T11:41:13.317278+0000 2024-09-14T11:41:13.314 INFO:tasks.workunit.client.0.smithi138.stderr:./src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-14T11:41:13.314 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-14T11:41:13.314 INFO:tasks.workunit.client.0.smithi138.stderr: ceph version 19.3.0-4907-ga2782315 (a2782315255a3e7d5f6cdc9eb35785187ff6ddf8) squid (dev) 2024-09-14T11:41:13.314 INFO:tasks.workunit.client.0.smithi138.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x121) [0x7fdce75012eb] 2024-09-14T11:41:13.315 INFO:tasks.workunit.client.0.smithi138.stderr: 2: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7fdce750149f] 2024-09-14T11:41:13.315 INFO:tasks.workunit.client.0.smithi138.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x559596c0bc01] 2024-09-14T11:41:13.315 INFO:tasks.workunit.client.0.smithi138.stderr: 4: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x17a) [0x559596c20f3a] 2024-09-14T11:41:13.315 INFO:tasks.workunit.client.0.smithi138.stderr: 5: main() 2024-09-14T11:41:13.315 INFO:tasks.workunit.client.0.smithi138.stderr: 6: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7fdce6367d90] 2024-09-14T11:41:13.315 INFO:tasks.workunit.client.0.smithi138.stderr: 7: __libc_start_main() 2024-09-14T11:41:13.315 INFO:tasks.workunit.client.0.smithi138.stderr: 8: _start() 2024-09-14T11:41:13.315 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-14T11:41:13.315 INFO:tasks.workunit.client.0.smithi138.stderr:*** Caught signal (Aborted) ** 2024-09-14T11:41:13.315 INFO:tasks.workunit.client.0.smithi138.stderr: in thread 7fdce3c279c0 thread_name:radosgw-admin 2024-09-14T11:41:13.335 INFO:tasks.workunit.client.0.smithi138.stderr: ceph version 19.3.0-4907-ga2782315 (a2782315255a3e7d5f6cdc9eb35785187ff6ddf8) squid (dev) 2024-09-14T11:41:13.335 INFO:tasks.workunit.client.0.smithi138.stderr: 1: /lib/x86_64-linux-gnu/libc.so.6(+0x42520) [0x7fdce6380520] 2024-09-14T11:41:13.336 INFO:tasks.workunit.client.0.smithi138.stderr: 2: pthread_kill() 2024-09-14T11:41:13.336 INFO:tasks.workunit.client.0.smithi138.stderr: 3: raise() 2024-09-14T11:41:13.336 INFO:tasks.workunit.client.0.smithi138.stderr: 4: abort() 2024-09-14T11:41:13.336 INFO:tasks.workunit.client.0.smithi138.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x17b) [0x7fdce7501345] 2024-09-14T11:41:13.336 INFO:tasks.workunit.client.0.smithi138.stderr: 6: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7fdce750149f] 2024-09-14T11:41:13.336 INFO:tasks.workunit.client.0.smithi138.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x559596c0bc01] 2024-09-14T11:41:13.336 INFO:tasks.workunit.client.0.smithi138.stderr: 8: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x17a) [0x559596c20f3a] 2024-09-14T11:41:13.336 INFO:tasks.workunit.client.0.smithi138.stderr: 9: main() 2024-09-14T11:41:13.336 INFO:tasks.workunit.client.0.smithi138.stderr: 10: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7fdce6367d90] 2024-09-14T11:41:13.336 INFO:tasks.workunit.client.0.smithi138.stderr: 11: __libc_start_main() 2024-09-14T11:41:13.336 INFO:tasks.workunit.client.0.smithi138.stderr: 12: _start() 2024-09-14T11:41:13.336 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:13.314+0000 7fdce3c279c0 -1 *** Caught signal (Aborted) ** 2024-09-14T11:41:13.336 INFO:tasks.workunit.client.0.smithi138.stderr: in thread 7fdce3c279c0 thread_name:radosgw-admin 2024-09-14T11:41:13.337 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-14T11:41:13.337 INFO:tasks.workunit.client.0.smithi138.stderr: ceph version 19.3.0-4907-ga2782315 (a2782315255a3e7d5f6cdc9eb35785187ff6ddf8) squid (dev) 2024-09-14T11:41:13.337 INFO:tasks.workunit.client.0.smithi138.stderr: 1: /lib/x86_64-linux-gnu/libc.so.6(+0x42520) [0x7fdce6380520] 2024-09-14T11:41:13.337 INFO:tasks.workunit.client.0.smithi138.stderr: 2: pthread_kill() 2024-09-14T11:41:13.337 INFO:tasks.workunit.client.0.smithi138.stderr: 3: raise() 2024-09-14T11:41:13.337 INFO:tasks.workunit.client.0.smithi138.stderr: 4: abort() 2024-09-14T11:41:13.337 INFO:tasks.workunit.client.0.smithi138.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x17b) [0x7fdce7501345] 2024-09-14T11:41:13.337 INFO:tasks.workunit.client.0.smithi138.stderr: 6: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7fdce750149f] 2024-09-14T11:41:13.337 INFO:tasks.workunit.client.0.smithi138.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x559596c0bc01] 2024-09-14T11:41:13.337 INFO:tasks.workunit.client.0.smithi138.stderr: 8: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x17a) [0x559596c20f3a] 2024-09-14T11:41:13.337 INFO:tasks.workunit.client.0.smithi138.stderr: 9: main() 2024-09-14T11:41:13.337 INFO:tasks.workunit.client.0.smithi138.stderr: 10: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7fdce6367d90] 2024-09-14T11:41:13.337 INFO:tasks.workunit.client.0.smithi138.stderr: 11: __libc_start_main() 2024-09-14T11:41:13.337 INFO:tasks.workunit.client.0.smithi138.stderr: 12: _start() 2024-09-14T11:41:13.338 INFO:tasks.workunit.client.0.smithi138.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-14T11:41:13.338 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-14T11:41:13.338 INFO:tasks.workunit.client.0.smithi138.stderr:--- begin dump of recent events --- 2024-09-14T11:41:13.338 INFO:tasks.workunit.client.0.smithi138.stderr: -499> 2024-09-14T11:41:12.982+0000 7fdce172d640 1 monclient: found mon.noname-c 2024-09-14T11:41:13.338 INFO:tasks.workunit.client.0.smithi138.stderr: -498> 2024-09-14T11:41:12.982+0000 7fdce172d640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.138:3301/0 2024-09-14T11:41:13.338 INFO:tasks.workunit.client.0.smithi138.stderr: -497> 2024-09-14T11:41:12.986+0000 7fdbcf606640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:41:13.338 INFO:tasks.workunit.client.0.smithi138.stderr: -496> 2024-09-14T11:41:12.986+0000 7fdbcf606640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-14T11:41:13.338 INFO:tasks.workunit.client.0.smithi138.stderr: -495> 2024-09-14T11:41:12.986+0000 7fdbcf606640 10 monclient: dump: 2024-09-14T11:41:13.338 INFO:tasks.workunit.client.0.smithi138.stderr:epoch 1 2024-09-14T11:41:13.338 INFO:tasks.workunit.client.0.smithi138.stderr:fsid 3f225f43-83a6-4aeb-b798-1f04bb49d597 2024-09-14T11:41:13.338 INFO:tasks.workunit.client.0.smithi138.stderr:last_changed 2024-09-14T11:07:09.252780+0000 2024-09-14T11:41:13.338 INFO:tasks.workunit.client.0.smithi138.stderr:created 2024-09-14T11:07:09.252780+0000 2024-09-14T11:41:13.338 INFO:tasks.workunit.client.0.smithi138.stderr:min_mon_release 19 (squid) 2024-09-14T11:41:13.338 INFO:tasks.workunit.client.0.smithi138.stderr:election_strategy: 1 2024-09-14T11:41:13.339 INFO:tasks.workunit.client.0.smithi138.stderr:0: [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] mon.a 2024-09-14T11:41:13.339 INFO:tasks.workunit.client.0.smithi138.stderr:1: [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] mon.b 2024-09-14T11:41:13.339 INFO:tasks.workunit.client.0.smithi138.stderr:2: [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] mon.c 2024-09-14T11:41:13.339 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-14T11:41:13.339 INFO:tasks.workunit.client.0.smithi138.stderr: -494> 2024-09-14T11:41:12.986+0000 7fdbcf606640 10 monclient: _finish_auth 0 2024-09-14T11:41:13.339 INFO:tasks.workunit.client.0.smithi138.stderr: -493> 2024-09-14T11:41:12.986+0000 7fdbcf606640 10 monclient: _check_auth_tickets 2024-09-14T11:41:13.339 INFO:tasks.workunit.client.0.smithi138.stderr: -492> 2024-09-14T11:41:12.986+0000 7fdbcf606640 10 monclient: handle_config config(0 keys) 2024-09-14T11:41:13.339 INFO:tasks.workunit.client.0.smithi138.stderr: -491> 2024-09-14T11:41:12.986+0000 7fdce3c279c0 5 monclient: authenticate success, global_id 7703 2024-09-14T11:41:13.339 INFO:tasks.workunit.client.0.smithi138.stderr: -490> 2024-09-14T11:41:12.986+0000 7fdce3c279c0 10 monclient: get_monmap_and_config success 2024-09-14T11:41:13.339 INFO:tasks.workunit.client.0.smithi138.stderr: -489> 2024-09-14T11:41:12.986+0000 7fdce3c279c0 4 set_mon_vals no callback set 2024-09-14T11:41:13.339 INFO:tasks.workunit.client.0.smithi138.stderr: -488> 2024-09-14T11:41:12.986+0000 7fdbcf606640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:41:13.339 INFO:tasks.workunit.client.0.smithi138.stderr: -487> 2024-09-14T11:41:12.986+0000 7fdbcf606640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-14T11:41:13.339 INFO:tasks.workunit.client.0.smithi138.stderr: -486> 2024-09-14T11:41:12.986+0000 7fdbcf606640 10 monclient: dump: 2024-09-14T11:41:13.339 INFO:tasks.workunit.client.0.smithi138.stderr:epoch 1 2024-09-14T11:41:13.339 INFO:tasks.workunit.client.0.smithi138.stderr:fsid 3f225f43-83a6-4aeb-b798-1f04bb49d597 2024-09-14T11:41:13.340 INFO:tasks.workunit.client.0.smithi138.stderr:last_changed 2024-09-14T11:07:09.252780+0000 2024-09-14T11:41:13.340 INFO:tasks.workunit.client.0.smithi138.stderr:created 2024-09-14T11:07:09.252780+0000 2024-09-14T11:41:13.340 INFO:tasks.workunit.client.0.smithi138.stderr:min_mon_release 19 (squid) 2024-09-14T11:41:13.340 INFO:tasks.workunit.client.0.smithi138.stderr:election_strategy: 1 2024-09-14T11:41:13.340 INFO:tasks.workunit.client.0.smithi138.stderr:0: [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] mon.a 2024-09-14T11:41:13.340 INFO:tasks.workunit.client.0.smithi138.stderr:1: [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] mon.b 2024-09-14T11:41:13.340 INFO:tasks.workunit.client.0.smithi138.stderr:2: [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] mon.c 2024-09-14T11:41:13.340 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-14T11:41:13.340 INFO:tasks.workunit.client.0.smithi138.stderr: -485> 2024-09-14T11:41:12.986+0000 7fdce3c279c0 10 monclient: shutdown 2024-09-14T11:41:13.340 INFO:tasks.workunit.client.0.smithi138.stderr: -484> 2024-09-14T11:41:12.986+0000 7fdce3c279c0 5 asok(0x5595986f9d90) unregister_commands rotate-key 2024-09-14T11:41:13.340 INFO:tasks.workunit.client.0.smithi138.stderr: -483> 2024-09-14T11:41:12.986+0000 7fdce3c279c0 10 monclient: build_initial_monmap 2024-09-14T11:41:13.340 INFO:tasks.workunit.client.0.smithi138.stderr: -482> 2024-09-14T11:41:12.986+0000 7fdce3c279c0 1 build_initial for_mkfs: 0 2024-09-14T11:41:13.340 INFO:tasks.workunit.client.0.smithi138.stderr: -481> 2024-09-14T11:41:12.986+0000 7fdce3c279c0 10 monclient: monmap: 2024-09-14T11:41:13.340 INFO:tasks.workunit.client.0.smithi138.stderr:epoch 0 2024-09-14T11:41:13.341 INFO:tasks.workunit.client.0.smithi138.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-14T11:41:13.341 INFO:tasks.workunit.client.0.smithi138.stderr:last_changed 0.000000 2024-09-14T11:41:13.341 INFO:tasks.workunit.client.0.smithi138.stderr:created 0.000000 2024-09-14T11:41:13.341 INFO:tasks.workunit.client.0.smithi138.stderr:min_mon_release 0 (unknown) 2024-09-14T11:41:13.341 INFO:tasks.workunit.client.0.smithi138.stderr:election_strategy: 1 2024-09-14T11:41:13.341 INFO:tasks.workunit.client.0.smithi138.stderr:0: [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] mon.noname-a 2024-09-14T11:41:13.341 INFO:tasks.workunit.client.0.smithi138.stderr:1: [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] mon.noname-b 2024-09-14T11:41:13.341 INFO:tasks.workunit.client.0.smithi138.stderr:2: [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] mon.noname-c 2024-09-14T11:41:13.341 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-14T11:41:13.341 INFO:tasks.workunit.client.0.smithi138.stderr: -480> 2024-09-14T11:41:12.986+0000 7fdce3c279c0 5 AuthRegistry(0x55959890afe0) adding auth protocol: cephx 2024-09-14T11:41:13.341 INFO:tasks.workunit.client.0.smithi138.stderr: -479> 2024-09-14T11:41:12.986+0000 7fdce3c279c0 5 AuthRegistry(0x55959890afe0) adding auth protocol: cephx 2024-09-14T11:41:13.341 INFO:tasks.workunit.client.0.smithi138.stderr: -478> 2024-09-14T11:41:12.986+0000 7fdce3c279c0 5 AuthRegistry(0x55959890afe0) adding auth protocol: cephx 2024-09-14T11:41:13.341 INFO:tasks.workunit.client.0.smithi138.stderr: -477> 2024-09-14T11:41:12.986+0000 7fdce3c279c0 5 AuthRegistry(0x55959890afe0) adding con mode: secure 2024-09-14T11:41:13.341 INFO:tasks.workunit.client.0.smithi138.stderr: -476> 2024-09-14T11:41:12.986+0000 7fdce3c279c0 5 AuthRegistry(0x55959890afe0) adding con mode: crc 2024-09-14T11:41:13.342 INFO:tasks.workunit.client.0.smithi138.stderr: -475> 2024-09-14T11:41:12.986+0000 7fdce3c279c0 5 AuthRegistry(0x55959890afe0) adding con mode: secure 2024-09-14T11:41:13.342 INFO:tasks.workunit.client.0.smithi138.stderr: -474> 2024-09-14T11:41:12.986+0000 7fdce3c279c0 5 AuthRegistry(0x55959890afe0) adding con mode: crc 2024-09-14T11:41:13.342 INFO:tasks.workunit.client.0.smithi138.stderr: -473> 2024-09-14T11:41:12.986+0000 7fdce3c279c0 5 AuthRegistry(0x55959890afe0) adding con mode: secure 2024-09-14T11:41:13.342 INFO:tasks.workunit.client.0.smithi138.stderr: -472> 2024-09-14T11:41:12.986+0000 7fdce3c279c0 5 AuthRegistry(0x55959890afe0) adding con mode: crc 2024-09-14T11:41:13.342 INFO:tasks.workunit.client.0.smithi138.stderr: -471> 2024-09-14T11:41:12.986+0000 7fdce3c279c0 5 AuthRegistry(0x55959890afe0) adding con mode: crc 2024-09-14T11:41:13.342 INFO:tasks.workunit.client.0.smithi138.stderr: -470> 2024-09-14T11:41:12.986+0000 7fdce3c279c0 5 AuthRegistry(0x55959890afe0) adding con mode: secure 2024-09-14T11:41:13.342 INFO:tasks.workunit.client.0.smithi138.stderr: -469> 2024-09-14T11:41:12.986+0000 7fdce3c279c0 5 AuthRegistry(0x55959890afe0) adding con mode: crc 2024-09-14T11:41:13.342 INFO:tasks.workunit.client.0.smithi138.stderr: -468> 2024-09-14T11:41:12.986+0000 7fdce3c279c0 5 AuthRegistry(0x55959890afe0) adding con mode: secure 2024-09-14T11:41:13.342 INFO:tasks.workunit.client.0.smithi138.stderr: -467> 2024-09-14T11:41:12.986+0000 7fdce3c279c0 5 AuthRegistry(0x55959890afe0) adding con mode: crc 2024-09-14T11:41:13.342 INFO:tasks.workunit.client.0.smithi138.stderr: -466> 2024-09-14T11:41:12.986+0000 7fdce3c279c0 5 AuthRegistry(0x55959890afe0) adding con mode: secure 2024-09-14T11:41:13.342 INFO:tasks.workunit.client.0.smithi138.stderr: -465> 2024-09-14T11:41:12.986+0000 7fdce3c279c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:41:13.342 INFO:tasks.workunit.client.0.smithi138.stderr: -464> 2024-09-14T11:41:12.986+0000 7fdce3c279c0 1 librados: starting msgr at 2024-09-14T11:41:13.342 INFO:tasks.workunit.client.0.smithi138.stderr: -463> 2024-09-14T11:41:12.986+0000 7fdce3c279c0 1 librados: starting objecter 2024-09-14T11:41:13.342 INFO:tasks.workunit.client.0.smithi138.stderr: -462> 2024-09-14T11:41:12.986+0000 7fdce3c279c0 5 asok(0x5595986f9d90) register_command objecter_requests hook 0x5595987268b0 2024-09-14T11:41:13.342 INFO:tasks.workunit.client.0.smithi138.stderr: -461> 2024-09-14T11:41:12.986+0000 7fdce3c279c0 1 librados: setting wanted keys 2024-09-14T11:41:13.343 INFO:tasks.workunit.client.0.smithi138.stderr: -460> 2024-09-14T11:41:12.986+0000 7fdce3c279c0 1 librados: calling monclient init 2024-09-14T11:41:13.343 INFO:tasks.workunit.client.0.smithi138.stderr: -459> 2024-09-14T11:41:12.986+0000 7fdce3c279c0 10 monclient: init 2024-09-14T11:41:13.343 INFO:tasks.workunit.client.0.smithi138.stderr: -458> 2024-09-14T11:41:12.986+0000 7fdce3c279c0 5 AuthRegistry(0x5595989052a0) adding auth protocol: cephx 2024-09-14T11:41:13.343 INFO:tasks.workunit.client.0.smithi138.stderr: -457> 2024-09-14T11:41:12.986+0000 7fdce3c279c0 5 AuthRegistry(0x5595989052a0) adding auth protocol: cephx 2024-09-14T11:41:13.343 INFO:tasks.workunit.client.0.smithi138.stderr: -456> 2024-09-14T11:41:12.986+0000 7fdce3c279c0 5 AuthRegistry(0x5595989052a0) adding auth protocol: cephx 2024-09-14T11:41:13.343 INFO:tasks.workunit.client.0.smithi138.stderr: -455> 2024-09-14T11:41:12.986+0000 7fdce3c279c0 5 AuthRegistry(0x5595989052a0) adding con mode: secure 2024-09-14T11:41:13.343 INFO:tasks.workunit.client.0.smithi138.stderr: -454> 2024-09-14T11:41:12.986+0000 7fdce3c279c0 5 AuthRegistry(0x5595989052a0) adding con mode: crc 2024-09-14T11:41:13.343 INFO:tasks.workunit.client.0.smithi138.stderr: -453> 2024-09-14T11:41:12.986+0000 7fdce3c279c0 5 AuthRegistry(0x5595989052a0) adding con mode: secure 2024-09-14T11:41:13.343 INFO:tasks.workunit.client.0.smithi138.stderr: -452> 2024-09-14T11:41:12.986+0000 7fdce3c279c0 5 AuthRegistry(0x5595989052a0) adding con mode: crc 2024-09-14T11:41:13.343 INFO:tasks.workunit.client.0.smithi138.stderr: -451> 2024-09-14T11:41:12.986+0000 7fdce3c279c0 5 AuthRegistry(0x5595989052a0) adding con mode: secure 2024-09-14T11:41:13.343 INFO:tasks.workunit.client.0.smithi138.stderr: -450> 2024-09-14T11:41:12.986+0000 7fdce3c279c0 5 AuthRegistry(0x5595989052a0) adding con mode: crc 2024-09-14T11:41:13.343 INFO:tasks.workunit.client.0.smithi138.stderr: -449> 2024-09-14T11:41:12.986+0000 7fdce3c279c0 5 AuthRegistry(0x5595989052a0) adding con mode: crc 2024-09-14T11:41:13.343 INFO:tasks.workunit.client.0.smithi138.stderr: -448> 2024-09-14T11:41:12.986+0000 7fdce3c279c0 5 AuthRegistry(0x5595989052a0) adding con mode: secure 2024-09-14T11:41:13.343 INFO:tasks.workunit.client.0.smithi138.stderr: -447> 2024-09-14T11:41:12.986+0000 7fdce3c279c0 5 AuthRegistry(0x5595989052a0) adding con mode: crc 2024-09-14T11:41:13.344 INFO:tasks.workunit.client.0.smithi138.stderr: -446> 2024-09-14T11:41:12.986+0000 7fdce3c279c0 5 AuthRegistry(0x5595989052a0) adding con mode: secure 2024-09-14T11:41:13.344 INFO:tasks.workunit.client.0.smithi138.stderr: -445> 2024-09-14T11:41:12.986+0000 7fdce3c279c0 5 AuthRegistry(0x5595989052a0) adding con mode: crc 2024-09-14T11:41:13.344 INFO:tasks.workunit.client.0.smithi138.stderr: -444> 2024-09-14T11:41:12.986+0000 7fdce3c279c0 5 AuthRegistry(0x5595989052a0) adding con mode: secure 2024-09-14T11:41:13.344 INFO:tasks.workunit.client.0.smithi138.stderr: -443> 2024-09-14T11:41:12.986+0000 7fdce3c279c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:41:13.344 INFO:tasks.workunit.client.0.smithi138.stderr: -442> 2024-09-14T11:41:12.986+0000 7fdce3c279c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:41:13.344 INFO:tasks.workunit.client.0.smithi138.stderr: -441> 2024-09-14T11:41:12.986+0000 7fdce3c279c0 5 asok(0x5595986f9d90) register_command rotate-key hook 0x5595989053e8 2024-09-14T11:41:13.344 INFO:tasks.workunit.client.0.smithi138.stderr: -440> 2024-09-14T11:41:12.986+0000 7fdce3c279c0 10 monclient: _reopen_session rank -1 2024-09-14T11:41:13.344 INFO:tasks.workunit.client.0.smithi138.stderr: -439> 2024-09-14T11:41:12.986+0000 7fdce3c279c0 10 monclient: _add_conns ranks=[1,2,0] 2024-09-14T11:41:13.344 INFO:tasks.workunit.client.0.smithi138.stderr: -438> 2024-09-14T11:41:12.986+0000 7fdce3c279c0 10 monclient(hunting): picked mon.noname-b con 0x5595987b4c70 addr [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] 2024-09-14T11:41:13.344 INFO:tasks.workunit.client.0.smithi138.stderr: -437> 2024-09-14T11:41:12.986+0000 7fdce3c279c0 10 monclient(hunting): picked mon.noname-c con 0x55959884d800 addr [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] 2024-09-14T11:41:13.344 INFO:tasks.workunit.client.0.smithi138.stderr: -436> 2024-09-14T11:41:12.986+0000 7fdce3c279c0 10 monclient(hunting): picked mon.noname-a con 0x55959890ba10 addr [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] 2024-09-14T11:41:13.344 INFO:tasks.workunit.client.0.smithi138.stderr: -435> 2024-09-14T11:41:12.986+0000 7fdce3c279c0 10 monclient(hunting): start opening mon connection 2024-09-14T11:41:13.344 INFO:tasks.workunit.client.0.smithi138.stderr: -434> 2024-09-14T11:41:12.986+0000 7fdce3c279c0 10 monclient(hunting): start opening mon connection 2024-09-14T11:41:13.344 INFO:tasks.workunit.client.0.smithi138.stderr: -433> 2024-09-14T11:41:12.986+0000 7fdce3c279c0 10 monclient(hunting): start opening mon connection 2024-09-14T11:41:13.344 INFO:tasks.workunit.client.0.smithi138.stderr: -432> 2024-09-14T11:41:12.986+0000 7fdce3c279c0 10 monclient(hunting): _renew_subs 2024-09-14T11:41:13.345 INFO:tasks.workunit.client.0.smithi138.stderr: -431> 2024-09-14T11:41:12.986+0000 7fdce3c279c0 10 monclient(hunting): authenticate will time out at 3008.950344s 2024-09-14T11:41:13.345 INFO:tasks.workunit.client.0.smithi138.stderr: -430> 2024-09-14T11:41:12.986+0000 7fdce0f2c640 10 monclient(hunting): get_auth_request con 0x55959884d800 auth_method 0 2024-09-14T11:41:13.345 INFO:tasks.workunit.client.0.smithi138.stderr: -429> 2024-09-14T11:41:12.986+0000 7fdce0f2c640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:41:13.345 INFO:tasks.workunit.client.0.smithi138.stderr: -428> 2024-09-14T11:41:12.986+0000 7fdce0f2c640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:41:13.345 INFO:tasks.workunit.client.0.smithi138.stderr: -427> 2024-09-14T11:41:12.986+0000 7fdce0f2c640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:41:13.345 INFO:tasks.workunit.client.0.smithi138.stderr: -426> 2024-09-14T11:41:12.986+0000 7fdce1f2e640 10 monclient(hunting): get_auth_request con 0x55959890ba10 auth_method 0 2024-09-14T11:41:13.345 INFO:tasks.workunit.client.0.smithi138.stderr: -425> 2024-09-14T11:41:12.986+0000 7fdce1f2e640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:41:13.345 INFO:tasks.workunit.client.0.smithi138.stderr: -424> 2024-09-14T11:41:12.986+0000 7fdce1f2e640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:41:13.345 INFO:tasks.workunit.client.0.smithi138.stderr: -423> 2024-09-14T11:41:12.986+0000 7fdce1f2e640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:41:13.345 INFO:tasks.workunit.client.0.smithi138.stderr: -422> 2024-09-14T11:41:12.986+0000 7fdce0f2c640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:41:13.345 INFO:tasks.workunit.client.0.smithi138.stderr: -421> 2024-09-14T11:41:12.986+0000 7fdce0f2c640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:41:13.345 INFO:tasks.workunit.client.0.smithi138.stderr: -420> 2024-09-14T11:41:12.986+0000 7fdce0f2c640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:41:13.345 INFO:tasks.workunit.client.0.smithi138.stderr: -419> 2024-09-14T11:41:12.986+0000 7fdce1f2e640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:41:13.345 INFO:tasks.workunit.client.0.smithi138.stderr: -418> 2024-09-14T11:41:12.986+0000 7fdce1f2e640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:41:13.346 INFO:tasks.workunit.client.0.smithi138.stderr: -417> 2024-09-14T11:41:12.986+0000 7fdce1f2e640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:41:13.346 INFO:tasks.workunit.client.0.smithi138.stderr: -416> 2024-09-14T11:41:12.986+0000 7fdce172d640 10 monclient(hunting): get_auth_request con 0x5595987b4c70 auth_method 0 2024-09-14T11:41:13.346 INFO:tasks.workunit.client.0.smithi138.stderr: -415> 2024-09-14T11:41:12.986+0000 7fdce172d640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:41:13.346 INFO:tasks.workunit.client.0.smithi138.stderr: -414> 2024-09-14T11:41:12.986+0000 7fdce172d640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:41:13.346 INFO:tasks.workunit.client.0.smithi138.stderr: -413> 2024-09-14T11:41:12.986+0000 7fdce172d640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:41:13.346 INFO:tasks.workunit.client.0.smithi138.stderr: -412> 2024-09-14T11:41:12.986+0000 7fdce0f2c640 10 monclient(hunting): handle_auth_done global_id 7706 payload 824 2024-09-14T11:41:13.346 INFO:tasks.workunit.client.0.smithi138.stderr: -411> 2024-09-14T11:41:12.986+0000 7fdce0f2c640 10 monclient: _finish_hunting 0 2024-09-14T11:41:13.346 INFO:tasks.workunit.client.0.smithi138.stderr: -410> 2024-09-14T11:41:12.986+0000 7fdce0f2c640 1 monclient: found mon.noname-c 2024-09-14T11:41:13.346 INFO:tasks.workunit.client.0.smithi138.stderr: -409> 2024-09-14T11:41:12.986+0000 7fdce0f2c640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.138:3301/0 2024-09-14T11:41:13.346 INFO:tasks.workunit.client.0.smithi138.stderr: -408> 2024-09-14T11:41:12.986+0000 7fdbcde03640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:41:13.346 INFO:tasks.workunit.client.0.smithi138.stderr: -407> 2024-09-14T11:41:12.986+0000 7fdbcde03640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-14T11:41:13.346 INFO:tasks.workunit.client.0.smithi138.stderr: -406> 2024-09-14T11:41:12.986+0000 7fdbcde03640 10 monclient: dump: 2024-09-14T11:41:13.346 INFO:tasks.workunit.client.0.smithi138.stderr:epoch 1 2024-09-14T11:41:13.346 INFO:tasks.workunit.client.0.smithi138.stderr:fsid 3f225f43-83a6-4aeb-b798-1f04bb49d597 2024-09-14T11:41:13.346 INFO:tasks.workunit.client.0.smithi138.stderr:last_changed 2024-09-14T11:07:09.252780+0000 2024-09-14T11:41:13.347 INFO:tasks.workunit.client.0.smithi138.stderr:created 2024-09-14T11:07:09.252780+0000 2024-09-14T11:41:13.347 INFO:tasks.workunit.client.0.smithi138.stderr:min_mon_release 19 (squid) 2024-09-14T11:41:13.347 INFO:tasks.workunit.client.0.smithi138.stderr:election_strategy: 1 2024-09-14T11:41:13.347 INFO:tasks.workunit.client.0.smithi138.stderr:0: [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] mon.a 2024-09-14T11:41:13.347 INFO:tasks.workunit.client.0.smithi138.stderr:1: [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] mon.b 2024-09-14T11:41:13.347 INFO:tasks.workunit.client.0.smithi138.stderr:2: [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] mon.c 2024-09-14T11:41:13.347 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-14T11:41:13.347 INFO:tasks.workunit.client.0.smithi138.stderr: -405> 2024-09-14T11:41:12.986+0000 7fdbcde03640 10 monclient: _finish_auth 0 2024-09-14T11:41:13.347 INFO:tasks.workunit.client.0.smithi138.stderr: -404> 2024-09-14T11:41:12.986+0000 7fdbcde03640 10 monclient: _check_auth_tickets 2024-09-14T11:41:13.347 INFO:tasks.workunit.client.0.smithi138.stderr: -403> 2024-09-14T11:41:12.986+0000 7fdce3c279c0 5 monclient: authenticate success, global_id 7706 2024-09-14T11:41:13.347 INFO:tasks.workunit.client.0.smithi138.stderr: -402> 2024-09-14T11:41:12.986+0000 7fdce3c279c0 10 monclient: _renew_subs 2024-09-14T11:41:13.347 INFO:tasks.workunit.client.0.smithi138.stderr: -401> 2024-09-14T11:41:12.986+0000 7fdce3c279c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.138:3301/0 2024-09-14T11:41:13.347 INFO:tasks.workunit.client.0.smithi138.stderr: -400> 2024-09-14T11:41:12.986+0000 7fdbcde03640 10 monclient: handle_config config(0 keys) 2024-09-14T11:41:13.347 INFO:tasks.workunit.client.0.smithi138.stderr: -399> 2024-09-14T11:41:12.986+0000 7fdbcde03640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:41:13.347 INFO:tasks.workunit.client.0.smithi138.stderr: -398> 2024-09-14T11:41:12.986+0000 7fdbcde03640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-14T11:41:13.348 INFO:tasks.workunit.client.0.smithi138.stderr: -397> 2024-09-14T11:41:12.986+0000 7fdbcde03640 10 monclient: dump: 2024-09-14T11:41:13.348 INFO:tasks.workunit.client.0.smithi138.stderr:epoch 1 2024-09-14T11:41:13.348 INFO:tasks.workunit.client.0.smithi138.stderr:fsid 3f225f43-83a6-4aeb-b798-1f04bb49d597 2024-09-14T11:41:13.348 INFO:tasks.workunit.client.0.smithi138.stderr:last_changed 2024-09-14T11:07:09.252780+0000 2024-09-14T11:41:13.348 INFO:tasks.workunit.client.0.smithi138.stderr:created 2024-09-14T11:07:09.252780+0000 2024-09-14T11:41:13.348 INFO:tasks.workunit.client.0.smithi138.stderr:min_mon_release 19 (squid) 2024-09-14T11:41:13.348 INFO:tasks.workunit.client.0.smithi138.stderr:election_strategy: 1 2024-09-14T11:41:13.348 INFO:tasks.workunit.client.0.smithi138.stderr:0: [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] mon.a 2024-09-14T11:41:13.348 INFO:tasks.workunit.client.0.smithi138.stderr:1: [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] mon.b 2024-09-14T11:41:13.348 INFO:tasks.workunit.client.0.smithi138.stderr:2: [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] mon.c 2024-09-14T11:41:13.348 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-14T11:41:13.348 INFO:tasks.workunit.client.0.smithi138.stderr: -396> 2024-09-14T11:41:12.986+0000 7fdbcf606640 4 set_mon_vals no callback set 2024-09-14T11:41:13.348 INFO:tasks.workunit.client.0.smithi138.stderr: -395> 2024-09-14T11:41:12.986+0000 7fdce3c279c0 10 monclient: _renew_subs 2024-09-14T11:41:13.348 INFO:tasks.workunit.client.0.smithi138.stderr: -394> 2024-09-14T11:41:12.986+0000 7fdce3c279c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.138:3301/0 2024-09-14T11:41:13.349 INFO:tasks.workunit.client.0.smithi138.stderr: -393> 2024-09-14T11:41:12.986+0000 7fdce3c279c0 1 librados: init done 2024-09-14T11:41:13.349 INFO:tasks.workunit.client.0.smithi138.stderr: -392> 2024-09-14T11:41:12.990+0000 7fdbcde03640 4 mgrc handle_mgr_map Got map version 5 2024-09-14T11:41:13.349 INFO:tasks.workunit.client.0.smithi138.stderr: -391> 2024-09-14T11:41:12.990+0000 7fdbcde03640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.138:6832/3778043143,v1:172.21.15.138:6833/3778043143] 2024-09-14T11:41:13.349 INFO:tasks.workunit.client.0.smithi138.stderr: -390> 2024-09-14T11:41:12.990+0000 7fdbcde03640 4 mgrc reconnect Starting new session with [v2:172.21.15.138:6832/3778043143,v1:172.21.15.138:6833/3778043143] 2024-09-14T11:41:13.349 INFO:tasks.workunit.client.0.smithi138.stderr: -389> 2024-09-14T11:41:12.990+0000 7fdce172d640 10 monclient: get_auth_request con 0x7fdbc8071a40 auth_method 0 2024-09-14T11:41:13.349 INFO:tasks.workunit.client.0.smithi138.stderr: -388> 2024-09-14T11:41:12.990+0000 7fdce1f2e640 10 monclient: get_auth_request con 0x55959892cf70 auth_method 0 2024-09-14T11:41:13.349 INFO:tasks.workunit.client.0.smithi138.stderr: -387> 2024-09-14T11:41:12.990+0000 7fdce172d640 10 monclient: get_auth_request con 0x5595989500e0 auth_method 0 2024-09-14T11:41:13.349 INFO:tasks.workunit.client.0.smithi138.stderr: -386> 2024-09-14T11:41:12.994+0000 7fdce0f2c640 10 monclient: get_auth_request con 0x559598954780 auth_method 0 2024-09-14T11:41:13.349 INFO:tasks.workunit.client.0.smithi138.stderr: -385> 2024-09-14T11:41:12.994+0000 7fdce1f2e640 10 monclient: get_auth_request con 0x559598953dd0 auth_method 0 2024-09-14T11:41:13.349 INFO:tasks.workunit.client.0.smithi138.stderr: -384> 2024-09-14T11:41:12.994+0000 7fdce3c279c0 10 monclient: build_initial_monmap 2024-09-14T11:41:13.349 INFO:tasks.workunit.client.0.smithi138.stderr: -383> 2024-09-14T11:41:12.994+0000 7fdce3c279c0 1 build_initial for_mkfs: 0 2024-09-14T11:41:13.349 INFO:tasks.workunit.client.0.smithi138.stderr: -382> 2024-09-14T11:41:12.994+0000 7fdce3c279c0 10 monclient: monmap: 2024-09-14T11:41:13.349 INFO:tasks.workunit.client.0.smithi138.stderr:epoch 0 2024-09-14T11:41:13.349 INFO:tasks.workunit.client.0.smithi138.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-14T11:41:13.350 INFO:tasks.workunit.client.0.smithi138.stderr:last_changed 0.000000 2024-09-14T11:41:13.350 INFO:tasks.workunit.client.0.smithi138.stderr:created 0.000000 2024-09-14T11:41:13.350 INFO:tasks.workunit.client.0.smithi138.stderr:min_mon_release 0 (unknown) 2024-09-14T11:41:13.350 INFO:tasks.workunit.client.0.smithi138.stderr:election_strategy: 1 2024-09-14T11:41:13.350 INFO:tasks.workunit.client.0.smithi138.stderr:0: [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] mon.noname-a 2024-09-14T11:41:13.350 INFO:tasks.workunit.client.0.smithi138.stderr:1: [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] mon.noname-b 2024-09-14T11:41:13.350 INFO:tasks.workunit.client.0.smithi138.stderr:2: [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] mon.noname-c 2024-09-14T11:41:13.350 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-14T11:41:13.350 INFO:tasks.workunit.client.0.smithi138.stderr: -381> 2024-09-14T11:41:12.994+0000 7fdce3c279c0 5 AuthRegistry(0x55959895c7e0) adding auth protocol: cephx 2024-09-14T11:41:13.350 INFO:tasks.workunit.client.0.smithi138.stderr: -380> 2024-09-14T11:41:12.994+0000 7fdce3c279c0 5 AuthRegistry(0x55959895c7e0) adding auth protocol: cephx 2024-09-14T11:41:13.350 INFO:tasks.workunit.client.0.smithi138.stderr: -379> 2024-09-14T11:41:12.994+0000 7fdce3c279c0 5 AuthRegistry(0x55959895c7e0) adding auth protocol: cephx 2024-09-14T11:41:13.350 INFO:tasks.workunit.client.0.smithi138.stderr: -378> 2024-09-14T11:41:12.994+0000 7fdce3c279c0 5 AuthRegistry(0x55959895c7e0) adding con mode: secure 2024-09-14T11:41:13.350 INFO:tasks.workunit.client.0.smithi138.stderr: -377> 2024-09-14T11:41:12.994+0000 7fdce3c279c0 5 AuthRegistry(0x55959895c7e0) adding con mode: crc 2024-09-14T11:41:13.350 INFO:tasks.workunit.client.0.smithi138.stderr: -376> 2024-09-14T11:41:12.994+0000 7fdce3c279c0 5 AuthRegistry(0x55959895c7e0) adding con mode: secure 2024-09-14T11:41:13.350 INFO:tasks.workunit.client.0.smithi138.stderr: -375> 2024-09-14T11:41:12.994+0000 7fdce3c279c0 5 AuthRegistry(0x55959895c7e0) adding con mode: crc 2024-09-14T11:41:13.351 INFO:tasks.workunit.client.0.smithi138.stderr: -374> 2024-09-14T11:41:12.994+0000 7fdce3c279c0 5 AuthRegistry(0x55959895c7e0) adding con mode: secure 2024-09-14T11:41:13.351 INFO:tasks.workunit.client.0.smithi138.stderr: -373> 2024-09-14T11:41:12.994+0000 7fdce3c279c0 5 AuthRegistry(0x55959895c7e0) adding con mode: crc 2024-09-14T11:41:13.351 INFO:tasks.workunit.client.0.smithi138.stderr: -372> 2024-09-14T11:41:12.994+0000 7fdce3c279c0 5 AuthRegistry(0x55959895c7e0) adding con mode: crc 2024-09-14T11:41:13.351 INFO:tasks.workunit.client.0.smithi138.stderr: -371> 2024-09-14T11:41:12.994+0000 7fdce3c279c0 5 AuthRegistry(0x55959895c7e0) adding con mode: secure 2024-09-14T11:41:13.351 INFO:tasks.workunit.client.0.smithi138.stderr: -370> 2024-09-14T11:41:12.994+0000 7fdce3c279c0 5 AuthRegistry(0x55959895c7e0) adding con mode: crc 2024-09-14T11:41:13.351 INFO:tasks.workunit.client.0.smithi138.stderr: -369> 2024-09-14T11:41:12.994+0000 7fdce3c279c0 5 AuthRegistry(0x55959895c7e0) adding con mode: secure 2024-09-14T11:41:13.351 INFO:tasks.workunit.client.0.smithi138.stderr: -368> 2024-09-14T11:41:12.994+0000 7fdce3c279c0 5 AuthRegistry(0x55959895c7e0) adding con mode: crc 2024-09-14T11:41:13.351 INFO:tasks.workunit.client.0.smithi138.stderr: -367> 2024-09-14T11:41:12.994+0000 7fdce3c279c0 5 AuthRegistry(0x55959895c7e0) adding con mode: secure 2024-09-14T11:41:13.351 INFO:tasks.workunit.client.0.smithi138.stderr: -366> 2024-09-14T11:41:12.994+0000 7fdce3c279c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:41:13.351 INFO:tasks.workunit.client.0.smithi138.stderr: -365> 2024-09-14T11:41:12.994+0000 7fdce3c279c0 5 asok(0x5595986f9d90) register_command objecter_requests cmddesc objecter_requests hook 0x5595989601d0 EEXIST 2024-09-14T11:41:13.351 INFO:tasks.workunit.client.0.smithi138.stderr: -364> 2024-09-14T11:41:12.994+0000 7fdce3c279c0 10 monclient: init 2024-09-14T11:41:13.351 INFO:tasks.workunit.client.0.smithi138.stderr: -363> 2024-09-14T11:41:12.994+0000 7fdce3c279c0 5 AuthRegistry(0x55959895b6d8) adding auth protocol: cephx 2024-09-14T11:41:13.351 INFO:tasks.workunit.client.0.smithi138.stderr: -362> 2024-09-14T11:41:12.994+0000 7fdce3c279c0 5 AuthRegistry(0x55959895b6d8) adding auth protocol: cephx 2024-09-14T11:41:13.351 INFO:tasks.workunit.client.0.smithi138.stderr: -361> 2024-09-14T11:41:12.994+0000 7fdce3c279c0 5 AuthRegistry(0x55959895b6d8) adding auth protocol: cephx 2024-09-14T11:41:13.351 INFO:tasks.workunit.client.0.smithi138.stderr: -360> 2024-09-14T11:41:12.994+0000 7fdce3c279c0 5 AuthRegistry(0x55959895b6d8) adding con mode: secure 2024-09-14T11:41:13.352 INFO:tasks.workunit.client.0.smithi138.stderr: -359> 2024-09-14T11:41:12.994+0000 7fdce3c279c0 5 AuthRegistry(0x55959895b6d8) adding con mode: crc 2024-09-14T11:41:13.352 INFO:tasks.workunit.client.0.smithi138.stderr: -358> 2024-09-14T11:41:12.994+0000 7fdce3c279c0 5 AuthRegistry(0x55959895b6d8) adding con mode: secure 2024-09-14T11:41:13.352 INFO:tasks.workunit.client.0.smithi138.stderr: -357> 2024-09-14T11:41:12.994+0000 7fdce3c279c0 5 AuthRegistry(0x55959895b6d8) adding con mode: crc 2024-09-14T11:41:13.352 INFO:tasks.workunit.client.0.smithi138.stderr: -356> 2024-09-14T11:41:12.994+0000 7fdce3c279c0 5 AuthRegistry(0x55959895b6d8) adding con mode: secure 2024-09-14T11:41:13.352 INFO:tasks.workunit.client.0.smithi138.stderr: -355> 2024-09-14T11:41:12.994+0000 7fdce3c279c0 5 AuthRegistry(0x55959895b6d8) adding con mode: crc 2024-09-14T11:41:13.352 INFO:tasks.workunit.client.0.smithi138.stderr: -354> 2024-09-14T11:41:12.994+0000 7fdce3c279c0 5 AuthRegistry(0x55959895b6d8) adding con mode: crc 2024-09-14T11:41:13.352 INFO:tasks.workunit.client.0.smithi138.stderr: -353> 2024-09-14T11:41:12.994+0000 7fdce3c279c0 5 AuthRegistry(0x55959895b6d8) adding con mode: secure 2024-09-14T11:41:13.352 INFO:tasks.workunit.client.0.smithi138.stderr: -352> 2024-09-14T11:41:12.994+0000 7fdce3c279c0 5 AuthRegistry(0x55959895b6d8) adding con mode: crc 2024-09-14T11:41:13.352 INFO:tasks.workunit.client.0.smithi138.stderr: -351> 2024-09-14T11:41:12.994+0000 7fdce3c279c0 5 AuthRegistry(0x55959895b6d8) adding con mode: secure 2024-09-14T11:41:13.352 INFO:tasks.workunit.client.0.smithi138.stderr: -350> 2024-09-14T11:41:12.994+0000 7fdce3c279c0 5 AuthRegistry(0x55959895b6d8) adding con mode: crc 2024-09-14T11:41:13.352 INFO:tasks.workunit.client.0.smithi138.stderr: -349> 2024-09-14T11:41:12.994+0000 7fdce3c279c0 5 AuthRegistry(0x55959895b6d8) adding con mode: secure 2024-09-14T11:41:13.352 INFO:tasks.workunit.client.0.smithi138.stderr: -348> 2024-09-14T11:41:12.998+0000 7fdce3c279c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:41:13.352 INFO:tasks.workunit.client.0.smithi138.stderr: -347> 2024-09-14T11:41:12.998+0000 7fdce3c279c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:41:13.352 INFO:tasks.workunit.client.0.smithi138.stderr: -346> 2024-09-14T11:41:12.998+0000 7fdce3c279c0 5 asok(0x5595986f9d90) register_command rotate-key cmddesc rotate-key hook 0x55959895b820 EEXIST 2024-09-14T11:41:13.353 INFO:tasks.workunit.client.0.smithi138.stderr: -345> 2024-09-14T11:41:12.998+0000 7fdce3c279c0 10 monclient: _reopen_session rank -1 2024-09-14T11:41:13.353 INFO:tasks.workunit.client.0.smithi138.stderr: -344> 2024-09-14T11:41:12.998+0000 7fdce3c279c0 10 monclient: _add_conns ranks=[2,0,1] 2024-09-14T11:41:13.353 INFO:tasks.workunit.client.0.smithi138.stderr: -343> 2024-09-14T11:41:12.998+0000 7fdce3c279c0 10 monclient(hunting): picked mon.noname-c con 0x559598984380 addr [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] 2024-09-14T11:41:13.353 INFO:tasks.workunit.client.0.smithi138.stderr: -342> 2024-09-14T11:41:12.998+0000 7fdce3c279c0 10 monclient(hunting): picked mon.noname-a con 0x559598983cb0 addr [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] 2024-09-14T11:41:13.353 INFO:tasks.workunit.client.0.smithi138.stderr: -341> 2024-09-14T11:41:12.998+0000 7fdce3c279c0 10 monclient(hunting): picked mon.noname-b con 0x559598982690 addr [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] 2024-09-14T11:41:13.353 INFO:tasks.workunit.client.0.smithi138.stderr: -340> 2024-09-14T11:41:12.998+0000 7fdce3c279c0 10 monclient(hunting): start opening mon connection 2024-09-14T11:41:13.353 INFO:tasks.workunit.client.0.smithi138.stderr: -339> 2024-09-14T11:41:12.998+0000 7fdce3c279c0 10 monclient(hunting): start opening mon connection 2024-09-14T11:41:13.353 INFO:tasks.workunit.client.0.smithi138.stderr: -338> 2024-09-14T11:41:12.998+0000 7fdce3c279c0 10 monclient(hunting): start opening mon connection 2024-09-14T11:41:13.353 INFO:tasks.workunit.client.0.smithi138.stderr: -337> 2024-09-14T11:41:12.998+0000 7fdce3c279c0 10 monclient(hunting): _renew_subs 2024-09-14T11:41:13.353 INFO:tasks.workunit.client.0.smithi138.stderr: -336> 2024-09-14T11:41:12.998+0000 7fdce3c279c0 10 monclient(hunting): authenticate will time out at 3008.960512s 2024-09-14T11:41:13.353 INFO:tasks.workunit.client.0.smithi138.stderr: -335> 2024-09-14T11:41:12.998+0000 7fdce0f2c640 10 monclient(hunting): get_auth_request con 0x559598984380 auth_method 0 2024-09-14T11:41:13.353 INFO:tasks.workunit.client.0.smithi138.stderr: -334> 2024-09-14T11:41:12.998+0000 7fdce0f2c640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:41:13.353 INFO:tasks.workunit.client.0.smithi138.stderr: -333> 2024-09-14T11:41:12.998+0000 7fdce0f2c640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:41:13.353 INFO:tasks.workunit.client.0.smithi138.stderr: -332> 2024-09-14T11:41:12.998+0000 7fdce0f2c640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:41:13.354 INFO:tasks.workunit.client.0.smithi138.stderr: -331> 2024-09-14T11:41:12.998+0000 7fdce1f2e640 10 monclient(hunting): get_auth_request con 0x559598983cb0 auth_method 0 2024-09-14T11:41:13.354 INFO:tasks.workunit.client.0.smithi138.stderr: -330> 2024-09-14T11:41:12.998+0000 7fdce1f2e640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:41:13.354 INFO:tasks.workunit.client.0.smithi138.stderr: -329> 2024-09-14T11:41:12.998+0000 7fdce1f2e640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:41:13.354 INFO:tasks.workunit.client.0.smithi138.stderr: -328> 2024-09-14T11:41:12.998+0000 7fdce1f2e640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:41:13.354 INFO:tasks.workunit.client.0.smithi138.stderr: -327> 2024-09-14T11:41:12.998+0000 7fdce0f2c640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:41:13.354 INFO:tasks.workunit.client.0.smithi138.stderr: -326> 2024-09-14T11:41:12.998+0000 7fdce0f2c640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:41:13.354 INFO:tasks.workunit.client.0.smithi138.stderr: -325> 2024-09-14T11:41:12.998+0000 7fdce0f2c640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:41:13.354 INFO:tasks.workunit.client.0.smithi138.stderr: -324> 2024-09-14T11:41:12.998+0000 7fdce1f2e640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:41:13.354 INFO:tasks.workunit.client.0.smithi138.stderr: -323> 2024-09-14T11:41:12.998+0000 7fdce1f2e640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:41:13.354 INFO:tasks.workunit.client.0.smithi138.stderr: -322> 2024-09-14T11:41:12.998+0000 7fdce1f2e640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:41:13.354 INFO:tasks.workunit.client.0.smithi138.stderr: -321> 2024-09-14T11:41:12.998+0000 7fdce0f2c640 10 monclient(hunting): handle_auth_done global_id 7709 payload 824 2024-09-14T11:41:13.354 INFO:tasks.workunit.client.0.smithi138.stderr: -320> 2024-09-14T11:41:12.998+0000 7fdce0f2c640 10 monclient: _finish_hunting 0 2024-09-14T11:41:13.354 INFO:tasks.workunit.client.0.smithi138.stderr: -319> 2024-09-14T11:41:12.998+0000 7fdce0f2c640 1 monclient: found mon.noname-c 2024-09-14T11:41:13.354 INFO:tasks.workunit.client.0.smithi138.stderr: -318> 2024-09-14T11:41:12.998+0000 7fdce0f2c640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.138:3301/0 2024-09-14T11:41:13.354 INFO:tasks.workunit.client.0.smithi138.stderr: -317> 2024-09-14T11:41:12.998+0000 7fdbc6ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:41:13.355 INFO:tasks.workunit.client.0.smithi138.stderr: -316> 2024-09-14T11:41:12.998+0000 7fdbc6ffd640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-14T11:41:13.355 INFO:tasks.workunit.client.0.smithi138.stderr: -315> 2024-09-14T11:41:12.998+0000 7fdbc6ffd640 10 monclient: dump: 2024-09-14T11:41:13.355 INFO:tasks.workunit.client.0.smithi138.stderr:epoch 1 2024-09-14T11:41:13.355 INFO:tasks.workunit.client.0.smithi138.stderr:fsid 3f225f43-83a6-4aeb-b798-1f04bb49d597 2024-09-14T11:41:13.355 INFO:tasks.workunit.client.0.smithi138.stderr:last_changed 2024-09-14T11:07:09.252780+0000 2024-09-14T11:41:13.355 INFO:tasks.workunit.client.0.smithi138.stderr:created 2024-09-14T11:07:09.252780+0000 2024-09-14T11:41:13.355 INFO:tasks.workunit.client.0.smithi138.stderr:min_mon_release 19 (squid) 2024-09-14T11:41:13.355 INFO:tasks.workunit.client.0.smithi138.stderr:election_strategy: 1 2024-09-14T11:41:13.355 INFO:tasks.workunit.client.0.smithi138.stderr:0: [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] mon.a 2024-09-14T11:41:13.355 INFO:tasks.workunit.client.0.smithi138.stderr:1: [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] mon.b 2024-09-14T11:41:13.355 INFO:tasks.workunit.client.0.smithi138.stderr:2: [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] mon.c 2024-09-14T11:41:13.355 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-14T11:41:13.355 INFO:tasks.workunit.client.0.smithi138.stderr: -314> 2024-09-14T11:41:12.998+0000 7fdbc6ffd640 10 monclient: _finish_auth 0 2024-09-14T11:41:13.355 INFO:tasks.workunit.client.0.smithi138.stderr: -313> 2024-09-14T11:41:12.998+0000 7fdbc6ffd640 10 monclient: _check_auth_tickets 2024-09-14T11:41:13.356 INFO:tasks.workunit.client.0.smithi138.stderr: -312> 2024-09-14T11:41:12.998+0000 7fdbc6ffd640 10 monclient: handle_config config(0 keys) 2024-09-14T11:41:13.356 INFO:tasks.workunit.client.0.smithi138.stderr: -311> 2024-09-14T11:41:12.998+0000 7fdbc6ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:41:13.356 INFO:tasks.workunit.client.0.smithi138.stderr: -310> 2024-09-14T11:41:12.998+0000 7fdbc6ffd640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-14T11:41:13.356 INFO:tasks.workunit.client.0.smithi138.stderr: -309> 2024-09-14T11:41:12.998+0000 7fdbc6ffd640 10 monclient: dump: 2024-09-14T11:41:13.356 INFO:tasks.workunit.client.0.smithi138.stderr:epoch 1 2024-09-14T11:41:13.356 INFO:tasks.workunit.client.0.smithi138.stderr:fsid 3f225f43-83a6-4aeb-b798-1f04bb49d597 2024-09-14T11:41:13.356 INFO:tasks.workunit.client.0.smithi138.stderr:last_changed 2024-09-14T11:07:09.252780+0000 2024-09-14T11:41:13.356 INFO:tasks.workunit.client.0.smithi138.stderr:created 2024-09-14T11:07:09.252780+0000 2024-09-14T11:41:13.356 INFO:tasks.workunit.client.0.smithi138.stderr:min_mon_release 19 (squid) 2024-09-14T11:41:13.356 INFO:tasks.workunit.client.0.smithi138.stderr:election_strategy: 1 2024-09-14T11:41:13.356 INFO:tasks.workunit.client.0.smithi138.stderr:0: [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] mon.a 2024-09-14T11:41:13.356 INFO:tasks.workunit.client.0.smithi138.stderr:1: [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] mon.b 2024-09-14T11:41:13.356 INFO:tasks.workunit.client.0.smithi138.stderr:2: [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] mon.c 2024-09-14T11:41:13.356 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-14T11:41:13.357 INFO:tasks.workunit.client.0.smithi138.stderr: -308> 2024-09-14T11:41:12.998+0000 7fdce272f640 4 set_mon_vals no callback set 2024-09-14T11:41:13.357 INFO:tasks.workunit.client.0.smithi138.stderr: -307> 2024-09-14T11:41:12.998+0000 7fdce3c279c0 5 monclient: authenticate success, global_id 7709 2024-09-14T11:41:13.357 INFO:tasks.workunit.client.0.smithi138.stderr: -306> 2024-09-14T11:41:12.998+0000 7fdce3c279c0 10 monclient: _renew_subs 2024-09-14T11:41:13.357 INFO:tasks.workunit.client.0.smithi138.stderr: -305> 2024-09-14T11:41:12.998+0000 7fdce3c279c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.138:3301/0 2024-09-14T11:41:13.357 INFO:tasks.workunit.client.0.smithi138.stderr: -304> 2024-09-14T11:41:12.998+0000 7fdce3c279c0 10 monclient: _renew_subs 2024-09-14T11:41:13.357 INFO:tasks.workunit.client.0.smithi138.stderr: -303> 2024-09-14T11:41:12.998+0000 7fdce3c279c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.138:3301/0 2024-09-14T11:41:13.357 INFO:tasks.workunit.client.0.smithi138.stderr: -302> 2024-09-14T11:41:12.998+0000 7fdbc6ffd640 4 mgrc handle_mgr_map Got map version 5 2024-09-14T11:41:13.357 INFO:tasks.workunit.client.0.smithi138.stderr: -301> 2024-09-14T11:41:12.998+0000 7fdbc6ffd640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.138:6832/3778043143,v1:172.21.15.138:6833/3778043143] 2024-09-14T11:41:13.357 INFO:tasks.workunit.client.0.smithi138.stderr: -300> 2024-09-14T11:41:12.998+0000 7fdbc6ffd640 4 mgrc reconnect Starting new session with [v2:172.21.15.138:6832/3778043143,v1:172.21.15.138:6833/3778043143] 2024-09-14T11:41:13.357 INFO:tasks.workunit.client.0.smithi138.stderr: -299> 2024-09-14T11:41:12.998+0000 7fdce1f2e640 10 monclient: get_auth_request con 0x7fdbb80717e0 auth_method 0 2024-09-14T11:41:13.357 INFO:tasks.workunit.client.0.smithi138.stderr: -298> 2024-09-14T11:41:12.998+0000 7fdce3c279c0 10 monclient: get_monmap_and_config 2024-09-14T11:41:13.357 INFO:tasks.workunit.client.0.smithi138.stderr: -297> 2024-09-14T11:41:12.998+0000 7fdce3c279c0 10 monclient: build_initial_monmap 2024-09-14T11:41:13.357 INFO:tasks.workunit.client.0.smithi138.stderr: -296> 2024-09-14T11:41:12.998+0000 7fdce3c279c0 1 build_initial for_mkfs: 0 2024-09-14T11:41:13.357 INFO:tasks.workunit.client.0.smithi138.stderr: -295> 2024-09-14T11:41:12.998+0000 7fdce3c279c0 10 monclient: monmap: 2024-09-14T11:41:13.358 INFO:tasks.workunit.client.0.smithi138.stderr:epoch 0 2024-09-14T11:41:13.358 INFO:tasks.workunit.client.0.smithi138.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-14T11:41:13.358 INFO:tasks.workunit.client.0.smithi138.stderr:last_changed 0.000000 2024-09-14T11:41:13.358 INFO:tasks.workunit.client.0.smithi138.stderr:created 0.000000 2024-09-14T11:41:13.358 INFO:tasks.workunit.client.0.smithi138.stderr:min_mon_release 0 (unknown) 2024-09-14T11:41:13.358 INFO:tasks.workunit.client.0.smithi138.stderr:election_strategy: 1 2024-09-14T11:41:13.358 INFO:tasks.workunit.client.0.smithi138.stderr:0: [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] mon.noname-a 2024-09-14T11:41:13.358 INFO:tasks.workunit.client.0.smithi138.stderr:1: [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] mon.noname-b 2024-09-14T11:41:13.358 INFO:tasks.workunit.client.0.smithi138.stderr:2: [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] mon.noname-c 2024-09-14T11:41:13.358 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-14T11:41:13.358 INFO:tasks.workunit.client.0.smithi138.stderr: -294> 2024-09-14T11:41:12.998+0000 7fdce3c279c0 5 AuthRegistry(0x5595989a3c30) adding auth protocol: cephx 2024-09-14T11:41:13.358 INFO:tasks.workunit.client.0.smithi138.stderr: -293> 2024-09-14T11:41:12.998+0000 7fdce3c279c0 5 AuthRegistry(0x5595989a3c30) adding auth protocol: cephx 2024-09-14T11:41:13.358 INFO:tasks.workunit.client.0.smithi138.stderr: -292> 2024-09-14T11:41:12.998+0000 7fdce3c279c0 5 AuthRegistry(0x5595989a3c30) adding auth protocol: cephx 2024-09-14T11:41:13.358 INFO:tasks.workunit.client.0.smithi138.stderr: -291> 2024-09-14T11:41:12.998+0000 7fdce3c279c0 5 AuthRegistry(0x5595989a3c30) adding con mode: secure 2024-09-14T11:41:13.358 INFO:tasks.workunit.client.0.smithi138.stderr: -290> 2024-09-14T11:41:12.998+0000 7fdce3c279c0 5 AuthRegistry(0x5595989a3c30) adding con mode: crc 2024-09-14T11:41:13.359 INFO:tasks.workunit.client.0.smithi138.stderr: -289> 2024-09-14T11:41:12.998+0000 7fdce3c279c0 5 AuthRegistry(0x5595989a3c30) adding con mode: secure 2024-09-14T11:41:13.359 INFO:tasks.workunit.client.0.smithi138.stderr: -288> 2024-09-14T11:41:12.998+0000 7fdce3c279c0 5 AuthRegistry(0x5595989a3c30) adding con mode: crc 2024-09-14T11:41:13.359 INFO:tasks.workunit.client.0.smithi138.stderr: -287> 2024-09-14T11:41:12.998+0000 7fdce3c279c0 5 AuthRegistry(0x5595989a3c30) adding con mode: secure 2024-09-14T11:41:13.359 INFO:tasks.workunit.client.0.smithi138.stderr: -286> 2024-09-14T11:41:12.998+0000 7fdce3c279c0 5 AuthRegistry(0x5595989a3c30) adding con mode: crc 2024-09-14T11:41:13.359 INFO:tasks.workunit.client.0.smithi138.stderr: -285> 2024-09-14T11:41:12.998+0000 7fdce3c279c0 5 AuthRegistry(0x5595989a3c30) adding con mode: crc 2024-09-14T11:41:13.359 INFO:tasks.workunit.client.0.smithi138.stderr: -284> 2024-09-14T11:41:12.998+0000 7fdce3c279c0 5 AuthRegistry(0x5595989a3c30) adding con mode: secure 2024-09-14T11:41:13.359 INFO:tasks.workunit.client.0.smithi138.stderr: -283> 2024-09-14T11:41:12.998+0000 7fdce3c279c0 5 AuthRegistry(0x5595989a3c30) adding con mode: crc 2024-09-14T11:41:13.359 INFO:tasks.workunit.client.0.smithi138.stderr: -282> 2024-09-14T11:41:12.998+0000 7fdce3c279c0 5 AuthRegistry(0x5595989a3c30) adding con mode: secure 2024-09-14T11:41:13.359 INFO:tasks.workunit.client.0.smithi138.stderr: -281> 2024-09-14T11:41:12.998+0000 7fdce3c279c0 5 AuthRegistry(0x5595989a3c30) adding con mode: crc 2024-09-14T11:41:13.359 INFO:tasks.workunit.client.0.smithi138.stderr: -280> 2024-09-14T11:41:12.998+0000 7fdce3c279c0 5 AuthRegistry(0x5595989a3c30) adding con mode: secure 2024-09-14T11:41:13.359 INFO:tasks.workunit.client.0.smithi138.stderr: -279> 2024-09-14T11:41:12.998+0000 7fdce3c279c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:41:13.359 INFO:tasks.workunit.client.0.smithi138.stderr: -278> 2024-09-14T11:41:12.998+0000 7fdce3c279c0 10 monclient: init 2024-09-14T11:41:13.359 INFO:tasks.workunit.client.0.smithi138.stderr: -277> 2024-09-14T11:41:12.998+0000 7fdce3c279c0 5 AuthRegistry(0x7ffdf80599a0) adding auth protocol: cephx 2024-09-14T11:41:13.359 INFO:tasks.workunit.client.0.smithi138.stderr: -276> 2024-09-14T11:41:12.998+0000 7fdce3c279c0 5 AuthRegistry(0x7ffdf80599a0) adding auth protocol: cephx 2024-09-14T11:41:13.360 INFO:tasks.workunit.client.0.smithi138.stderr: -275> 2024-09-14T11:41:12.998+0000 7fdce3c279c0 5 AuthRegistry(0x7ffdf80599a0) adding auth protocol: cephx 2024-09-14T11:41:13.360 INFO:tasks.workunit.client.0.smithi138.stderr: -274> 2024-09-14T11:41:12.998+0000 7fdce3c279c0 5 AuthRegistry(0x7ffdf80599a0) adding con mode: secure 2024-09-14T11:41:13.360 INFO:tasks.workunit.client.0.smithi138.stderr: -273> 2024-09-14T11:41:12.998+0000 7fdce3c279c0 5 AuthRegistry(0x7ffdf80599a0) adding con mode: crc 2024-09-14T11:41:13.360 INFO:tasks.workunit.client.0.smithi138.stderr: -272> 2024-09-14T11:41:12.998+0000 7fdce3c279c0 5 AuthRegistry(0x7ffdf80599a0) adding con mode: secure 2024-09-14T11:41:13.360 INFO:tasks.workunit.client.0.smithi138.stderr: -271> 2024-09-14T11:41:12.998+0000 7fdce3c279c0 5 AuthRegistry(0x7ffdf80599a0) adding con mode: crc 2024-09-14T11:41:13.360 INFO:tasks.workunit.client.0.smithi138.stderr: -270> 2024-09-14T11:41:12.998+0000 7fdce3c279c0 5 AuthRegistry(0x7ffdf80599a0) adding con mode: secure 2024-09-14T11:41:13.360 INFO:tasks.workunit.client.0.smithi138.stderr: -269> 2024-09-14T11:41:12.998+0000 7fdce3c279c0 5 AuthRegistry(0x7ffdf80599a0) adding con mode: crc 2024-09-14T11:41:13.360 INFO:tasks.workunit.client.0.smithi138.stderr: -268> 2024-09-14T11:41:12.998+0000 7fdce3c279c0 5 AuthRegistry(0x7ffdf80599a0) adding con mode: crc 2024-09-14T11:41:13.360 INFO:tasks.workunit.client.0.smithi138.stderr: -267> 2024-09-14T11:41:12.998+0000 7fdce3c279c0 5 AuthRegistry(0x7ffdf80599a0) adding con mode: secure 2024-09-14T11:41:13.360 INFO:tasks.workunit.client.0.smithi138.stderr: -266> 2024-09-14T11:41:12.998+0000 7fdce3c279c0 5 AuthRegistry(0x7ffdf80599a0) adding con mode: crc 2024-09-14T11:41:13.360 INFO:tasks.workunit.client.0.smithi138.stderr: -265> 2024-09-14T11:41:12.998+0000 7fdce3c279c0 5 AuthRegistry(0x7ffdf80599a0) adding con mode: secure 2024-09-14T11:41:13.360 INFO:tasks.workunit.client.0.smithi138.stderr: -264> 2024-09-14T11:41:12.998+0000 7fdce3c279c0 5 AuthRegistry(0x7ffdf80599a0) adding con mode: crc 2024-09-14T11:41:13.360 INFO:tasks.workunit.client.0.smithi138.stderr: -263> 2024-09-14T11:41:12.998+0000 7fdce3c279c0 5 AuthRegistry(0x7ffdf80599a0) adding con mode: secure 2024-09-14T11:41:13.360 INFO:tasks.workunit.client.0.smithi138.stderr: -262> 2024-09-14T11:41:13.002+0000 7fdce3c279c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:41:13.361 INFO:tasks.workunit.client.0.smithi138.stderr: -261> 2024-09-14T11:41:13.002+0000 7fdce3c279c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:41:13.361 INFO:tasks.workunit.client.0.smithi138.stderr: -260> 2024-09-14T11:41:13.002+0000 7fdce3c279c0 5 asok(0x5595986f9d90) register_command rotate-key cmddesc rotate-key hook 0x7ffdf8059ae8 EEXIST 2024-09-14T11:41:13.361 INFO:tasks.workunit.client.0.smithi138.stderr: -259> 2024-09-14T11:41:13.002+0000 7fdce3c279c0 10 monclient: _reopen_session rank -1 2024-09-14T11:41:13.361 INFO:tasks.workunit.client.0.smithi138.stderr: -258> 2024-09-14T11:41:13.002+0000 7fdce3c279c0 10 monclient: _add_conns ranks=[0,2,1] 2024-09-14T11:41:13.361 INFO:tasks.workunit.client.0.smithi138.stderr: -257> 2024-09-14T11:41:13.002+0000 7fdce3c279c0 10 monclient(hunting): picked mon.noname-a con 0x5595989d8140 addr [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] 2024-09-14T11:41:13.361 INFO:tasks.workunit.client.0.smithi138.stderr: -256> 2024-09-14T11:41:13.002+0000 7fdce3c279c0 10 monclient(hunting): picked mon.noname-c con 0x5595989d2330 addr [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] 2024-09-14T11:41:13.361 INFO:tasks.workunit.client.0.smithi138.stderr: -255> 2024-09-14T11:41:13.002+0000 7fdce3c279c0 10 monclient(hunting): picked mon.noname-b con 0x5595989d3560 addr [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] 2024-09-14T11:41:13.361 INFO:tasks.workunit.client.0.smithi138.stderr: -254> 2024-09-14T11:41:13.002+0000 7fdce3c279c0 10 monclient(hunting): start opening mon connection 2024-09-14T11:41:13.361 INFO:tasks.workunit.client.0.smithi138.stderr: -253> 2024-09-14T11:41:13.002+0000 7fdce3c279c0 10 monclient(hunting): start opening mon connection 2024-09-14T11:41:13.361 INFO:tasks.workunit.client.0.smithi138.stderr: -252> 2024-09-14T11:41:13.002+0000 7fdce3c279c0 10 monclient(hunting): start opening mon connection 2024-09-14T11:41:13.361 INFO:tasks.workunit.client.0.smithi138.stderr: -251> 2024-09-14T11:41:13.002+0000 7fdce3c279c0 10 monclient(hunting): _renew_subs 2024-09-14T11:41:13.361 INFO:tasks.workunit.client.0.smithi138.stderr: -250> 2024-09-14T11:41:13.002+0000 7fdce3c279c0 10 monclient(hunting): authenticate will time out at 3008.964484s 2024-09-14T11:41:13.361 INFO:tasks.workunit.client.0.smithi138.stderr: -249> 2024-09-14T11:41:13.002+0000 7fdce1f2e640 10 monclient(hunting): get_auth_request con 0x5595989d2330 auth_method 0 2024-09-14T11:41:13.361 INFO:tasks.workunit.client.0.smithi138.stderr: -248> 2024-09-14T11:41:13.002+0000 7fdce1f2e640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:41:13.362 INFO:tasks.workunit.client.0.smithi138.stderr: -247> 2024-09-14T11:41:13.002+0000 7fdce1f2e640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:41:13.362 INFO:tasks.workunit.client.0.smithi138.stderr: -246> 2024-09-14T11:41:13.002+0000 7fdce1f2e640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:41:13.362 INFO:tasks.workunit.client.0.smithi138.stderr: -245> 2024-09-14T11:41:13.002+0000 7fdce0f2c640 10 monclient(hunting): get_auth_request con 0x5595989d8140 auth_method 0 2024-09-14T11:41:13.362 INFO:tasks.workunit.client.0.smithi138.stderr: -244> 2024-09-14T11:41:13.002+0000 7fdce0f2c640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:41:13.362 INFO:tasks.workunit.client.0.smithi138.stderr: -243> 2024-09-14T11:41:13.002+0000 7fdce0f2c640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:41:13.362 INFO:tasks.workunit.client.0.smithi138.stderr: -242> 2024-09-14T11:41:13.002+0000 7fdce0f2c640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:41:13.362 INFO:tasks.workunit.client.0.smithi138.stderr: -241> 2024-09-14T11:41:13.002+0000 7fdce1f2e640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:41:13.362 INFO:tasks.workunit.client.0.smithi138.stderr: -240> 2024-09-14T11:41:13.002+0000 7fdce1f2e640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:41:13.362 INFO:tasks.workunit.client.0.smithi138.stderr: -239> 2024-09-14T11:41:13.002+0000 7fdce1f2e640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:41:13.362 INFO:tasks.workunit.client.0.smithi138.stderr: -238> 2024-09-14T11:41:13.002+0000 7fdce0f2c640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:41:13.362 INFO:tasks.workunit.client.0.smithi138.stderr: -237> 2024-09-14T11:41:13.002+0000 7fdce0f2c640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:41:13.362 INFO:tasks.workunit.client.0.smithi138.stderr: -236> 2024-09-14T11:41:13.002+0000 7fdce0f2c640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:41:13.362 INFO:tasks.workunit.client.0.smithi138.stderr: -235> 2024-09-14T11:41:13.002+0000 7fdce0f2c640 10 monclient(hunting): handle_auth_done global_id 8256 payload 274 2024-09-14T11:41:13.362 INFO:tasks.workunit.client.0.smithi138.stderr: -234> 2024-09-14T11:41:13.002+0000 7fdce0f2c640 10 monclient: _finish_hunting 0 2024-09-14T11:41:13.363 INFO:tasks.workunit.client.0.smithi138.stderr: -233> 2024-09-14T11:41:13.002+0000 7fdce0f2c640 1 monclient: found mon.noname-a 2024-09-14T11:41:13.363 INFO:tasks.workunit.client.0.smithi138.stderr: -232> 2024-09-14T11:41:13.002+0000 7fdce0f2c640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.138:3300/0 2024-09-14T11:41:13.363 INFO:tasks.workunit.client.0.smithi138.stderr: -231> 2024-09-14T11:41:13.002+0000 7fdbc4ff9640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:41:13.363 INFO:tasks.workunit.client.0.smithi138.stderr: -230> 2024-09-14T11:41:13.002+0000 7fdbc4ff9640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-14T11:41:13.363 INFO:tasks.workunit.client.0.smithi138.stderr: -229> 2024-09-14T11:41:13.002+0000 7fdbc4ff9640 10 monclient: dump: 2024-09-14T11:41:13.363 INFO:tasks.workunit.client.0.smithi138.stderr:epoch 1 2024-09-14T11:41:13.363 INFO:tasks.workunit.client.0.smithi138.stderr:fsid 3f225f43-83a6-4aeb-b798-1f04bb49d597 2024-09-14T11:41:13.363 INFO:tasks.workunit.client.0.smithi138.stderr:last_changed 2024-09-14T11:07:09.252780+0000 2024-09-14T11:41:13.363 INFO:tasks.workunit.client.0.smithi138.stderr:created 2024-09-14T11:07:09.252780+0000 2024-09-14T11:41:13.363 INFO:tasks.workunit.client.0.smithi138.stderr:min_mon_release 19 (squid) 2024-09-14T11:41:13.363 INFO:tasks.workunit.client.0.smithi138.stderr:election_strategy: 1 2024-09-14T11:41:13.363 INFO:tasks.workunit.client.0.smithi138.stderr:0: [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] mon.a 2024-09-14T11:41:13.363 INFO:tasks.workunit.client.0.smithi138.stderr:1: [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] mon.b 2024-09-14T11:41:13.363 INFO:tasks.workunit.client.0.smithi138.stderr:2: [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] mon.c 2024-09-14T11:41:13.363 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-14T11:41:13.364 INFO:tasks.workunit.client.0.smithi138.stderr: -228> 2024-09-14T11:41:13.002+0000 7fdbc4ff9640 10 monclient: _finish_auth 0 2024-09-14T11:41:13.364 INFO:tasks.workunit.client.0.smithi138.stderr: -227> 2024-09-14T11:41:13.002+0000 7fdbc4ff9640 10 monclient: _check_auth_tickets 2024-09-14T11:41:13.364 INFO:tasks.workunit.client.0.smithi138.stderr: -226> 2024-09-14T11:41:13.002+0000 7fdbc4ff9640 10 monclient: handle_config config(0 keys) 2024-09-14T11:41:13.364 INFO:tasks.workunit.client.0.smithi138.stderr: -225> 2024-09-14T11:41:13.002+0000 7fdce3c279c0 5 monclient: authenticate success, global_id 8256 2024-09-14T11:41:13.364 INFO:tasks.workunit.client.0.smithi138.stderr: -224> 2024-09-14T11:41:13.002+0000 7fdce3c279c0 10 monclient: get_monmap_and_config success 2024-09-14T11:41:13.364 INFO:tasks.workunit.client.0.smithi138.stderr: -223> 2024-09-14T11:41:13.002+0000 7fdbc4ff9640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:41:13.364 INFO:tasks.workunit.client.0.smithi138.stderr: -222> 2024-09-14T11:41:13.002+0000 7fdce3c279c0 4 set_mon_vals no callback set 2024-09-14T11:41:13.364 INFO:tasks.workunit.client.0.smithi138.stderr: -221> 2024-09-14T11:41:13.002+0000 7fdbc4ff9640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-14T11:41:13.364 INFO:tasks.workunit.client.0.smithi138.stderr: -220> 2024-09-14T11:41:13.002+0000 7fdbc4ff9640 10 monclient: dump: 2024-09-14T11:41:13.364 INFO:tasks.workunit.client.0.smithi138.stderr:epoch 1 2024-09-14T11:41:13.364 INFO:tasks.workunit.client.0.smithi138.stderr:fsid 3f225f43-83a6-4aeb-b798-1f04bb49d597 2024-09-14T11:41:13.364 INFO:tasks.workunit.client.0.smithi138.stderr:last_changed 2024-09-14T11:07:09.252780+0000 2024-09-14T11:41:13.364 INFO:tasks.workunit.client.0.smithi138.stderr:created 2024-09-14T11:07:09.252780+0000 2024-09-14T11:41:13.364 INFO:tasks.workunit.client.0.smithi138.stderr:min_mon_release 19 (squid) 2024-09-14T11:41:13.364 INFO:tasks.workunit.client.0.smithi138.stderr:election_strategy: 1 2024-09-14T11:41:13.365 INFO:tasks.workunit.client.0.smithi138.stderr:0: [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] mon.a 2024-09-14T11:41:13.365 INFO:tasks.workunit.client.0.smithi138.stderr:1: [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] mon.b 2024-09-14T11:41:13.365 INFO:tasks.workunit.client.0.smithi138.stderr:2: [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] mon.c 2024-09-14T11:41:13.365 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-14T11:41:13.365 INFO:tasks.workunit.client.0.smithi138.stderr: -219> 2024-09-14T11:41:13.002+0000 7fdce3c279c0 10 monclient: shutdown 2024-09-14T11:41:13.365 INFO:tasks.workunit.client.0.smithi138.stderr: -218> 2024-09-14T11:41:13.002+0000 7fdce3c279c0 10 monclient: build_initial_monmap 2024-09-14T11:41:13.365 INFO:tasks.workunit.client.0.smithi138.stderr: -217> 2024-09-14T11:41:13.002+0000 7fdce3c279c0 1 build_initial for_mkfs: 0 2024-09-14T11:41:13.365 INFO:tasks.workunit.client.0.smithi138.stderr: -216> 2024-09-14T11:41:13.002+0000 7fdce3c279c0 10 monclient: monmap: 2024-09-14T11:41:13.365 INFO:tasks.workunit.client.0.smithi138.stderr:epoch 0 2024-09-14T11:41:13.365 INFO:tasks.workunit.client.0.smithi138.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-14T11:41:13.365 INFO:tasks.workunit.client.0.smithi138.stderr:last_changed 0.000000 2024-09-14T11:41:13.365 INFO:tasks.workunit.client.0.smithi138.stderr:created 0.000000 2024-09-14T11:41:13.365 INFO:tasks.workunit.client.0.smithi138.stderr:min_mon_release 0 (unknown) 2024-09-14T11:41:13.365 INFO:tasks.workunit.client.0.smithi138.stderr:election_strategy: 1 2024-09-14T11:41:13.366 INFO:tasks.workunit.client.0.smithi138.stderr:0: [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] mon.noname-a 2024-09-14T11:41:13.366 INFO:tasks.workunit.client.0.smithi138.stderr:1: [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] mon.noname-b 2024-09-14T11:41:13.366 INFO:tasks.workunit.client.0.smithi138.stderr:2: [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] mon.noname-c 2024-09-14T11:41:13.366 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-14T11:41:13.366 INFO:tasks.workunit.client.0.smithi138.stderr: -215> 2024-09-14T11:41:13.002+0000 7fdce3c279c0 5 AuthRegistry(0x5595989d43a0) adding auth protocol: cephx 2024-09-14T11:41:13.366 INFO:tasks.workunit.client.0.smithi138.stderr: -214> 2024-09-14T11:41:13.002+0000 7fdce3c279c0 5 AuthRegistry(0x5595989d43a0) adding auth protocol: cephx 2024-09-14T11:41:13.366 INFO:tasks.workunit.client.0.smithi138.stderr: -213> 2024-09-14T11:41:13.002+0000 7fdce3c279c0 5 AuthRegistry(0x5595989d43a0) adding auth protocol: cephx 2024-09-14T11:41:13.366 INFO:tasks.workunit.client.0.smithi138.stderr: -212> 2024-09-14T11:41:13.002+0000 7fdce3c279c0 5 AuthRegistry(0x5595989d43a0) adding con mode: secure 2024-09-14T11:41:13.366 INFO:tasks.workunit.client.0.smithi138.stderr: -211> 2024-09-14T11:41:13.002+0000 7fdce3c279c0 5 AuthRegistry(0x5595989d43a0) adding con mode: crc 2024-09-14T11:41:13.366 INFO:tasks.workunit.client.0.smithi138.stderr: -210> 2024-09-14T11:41:13.002+0000 7fdce3c279c0 5 AuthRegistry(0x5595989d43a0) adding con mode: secure 2024-09-14T11:41:13.366 INFO:tasks.workunit.client.0.smithi138.stderr: -209> 2024-09-14T11:41:13.002+0000 7fdce3c279c0 5 AuthRegistry(0x5595989d43a0) adding con mode: crc 2024-09-14T11:41:13.366 INFO:tasks.workunit.client.0.smithi138.stderr: -208> 2024-09-14T11:41:13.002+0000 7fdce3c279c0 5 AuthRegistry(0x5595989d43a0) adding con mode: secure 2024-09-14T11:41:13.366 INFO:tasks.workunit.client.0.smithi138.stderr: -207> 2024-09-14T11:41:13.002+0000 7fdce3c279c0 5 AuthRegistry(0x5595989d43a0) adding con mode: crc 2024-09-14T11:41:13.366 INFO:tasks.workunit.client.0.smithi138.stderr: -206> 2024-09-14T11:41:13.002+0000 7fdce3c279c0 5 AuthRegistry(0x5595989d43a0) adding con mode: crc 2024-09-14T11:41:13.366 INFO:tasks.workunit.client.0.smithi138.stderr: -205> 2024-09-14T11:41:13.002+0000 7fdce3c279c0 5 AuthRegistry(0x5595989d43a0) adding con mode: secure 2024-09-14T11:41:13.367 INFO:tasks.workunit.client.0.smithi138.stderr: -204> 2024-09-14T11:41:13.002+0000 7fdce3c279c0 5 AuthRegistry(0x5595989d43a0) adding con mode: crc 2024-09-14T11:41:13.367 INFO:tasks.workunit.client.0.smithi138.stderr: -203> 2024-09-14T11:41:13.002+0000 7fdce3c279c0 5 AuthRegistry(0x5595989d43a0) adding con mode: secure 2024-09-14T11:41:13.367 INFO:tasks.workunit.client.0.smithi138.stderr: -202> 2024-09-14T11:41:13.002+0000 7fdce3c279c0 5 AuthRegistry(0x5595989d43a0) adding con mode: crc 2024-09-14T11:41:13.367 INFO:tasks.workunit.client.0.smithi138.stderr: -201> 2024-09-14T11:41:13.002+0000 7fdce3c279c0 5 AuthRegistry(0x5595989d43a0) adding con mode: secure 2024-09-14T11:41:13.367 INFO:tasks.workunit.client.0.smithi138.stderr: -200> 2024-09-14T11:41:13.002+0000 7fdce3c279c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:41:13.367 INFO:tasks.workunit.client.0.smithi138.stderr: -199> 2024-09-14T11:41:13.002+0000 7fdce3c279c0 1 librados: starting msgr at 2024-09-14T11:41:13.367 INFO:tasks.workunit.client.0.smithi138.stderr: -198> 2024-09-14T11:41:13.002+0000 7fdce3c279c0 1 librados: starting objecter 2024-09-14T11:41:13.367 INFO:tasks.workunit.client.0.smithi138.stderr: -197> 2024-09-14T11:41:13.002+0000 7fdce3c279c0 5 asok(0x5595986f9d90) register_command objecter_requests cmddesc objecter_requests hook 0x5595989d2890 EEXIST 2024-09-14T11:41:13.367 INFO:tasks.workunit.client.0.smithi138.stderr: -196> 2024-09-14T11:41:13.002+0000 7fdce3c279c0 1 librados: setting wanted keys 2024-09-14T11:41:13.367 INFO:tasks.workunit.client.0.smithi138.stderr: -195> 2024-09-14T11:41:13.002+0000 7fdce3c279c0 1 librados: calling monclient init 2024-09-14T11:41:13.367 INFO:tasks.workunit.client.0.smithi138.stderr: -194> 2024-09-14T11:41:13.002+0000 7fdce3c279c0 10 monclient: init 2024-09-14T11:41:13.367 INFO:tasks.workunit.client.0.smithi138.stderr: -193> 2024-09-14T11:41:13.002+0000 7fdce3c279c0 5 AuthRegistry(0x5595989861a0) adding auth protocol: cephx 2024-09-14T11:41:13.367 INFO:tasks.workunit.client.0.smithi138.stderr: -192> 2024-09-14T11:41:13.002+0000 7fdce3c279c0 5 AuthRegistry(0x5595989861a0) adding auth protocol: cephx 2024-09-14T11:41:13.367 INFO:tasks.workunit.client.0.smithi138.stderr: -191> 2024-09-14T11:41:13.002+0000 7fdce3c279c0 5 AuthRegistry(0x5595989861a0) adding auth protocol: cephx 2024-09-14T11:41:13.367 INFO:tasks.workunit.client.0.smithi138.stderr: -190> 2024-09-14T11:41:13.002+0000 7fdce3c279c0 5 AuthRegistry(0x5595989861a0) adding con mode: secure 2024-09-14T11:41:13.368 INFO:tasks.workunit.client.0.smithi138.stderr: -189> 2024-09-14T11:41:13.002+0000 7fdce3c279c0 5 AuthRegistry(0x5595989861a0) adding con mode: crc 2024-09-14T11:41:13.368 INFO:tasks.workunit.client.0.smithi138.stderr: -188> 2024-09-14T11:41:13.002+0000 7fdce3c279c0 5 AuthRegistry(0x5595989861a0) adding con mode: secure 2024-09-14T11:41:13.368 INFO:tasks.workunit.client.0.smithi138.stderr: -187> 2024-09-14T11:41:13.002+0000 7fdce3c279c0 5 AuthRegistry(0x5595989861a0) adding con mode: crc 2024-09-14T11:41:13.368 INFO:tasks.workunit.client.0.smithi138.stderr: -186> 2024-09-14T11:41:13.002+0000 7fdce3c279c0 5 AuthRegistry(0x5595989861a0) adding con mode: secure 2024-09-14T11:41:13.368 INFO:tasks.workunit.client.0.smithi138.stderr: -185> 2024-09-14T11:41:13.002+0000 7fdce3c279c0 5 AuthRegistry(0x5595989861a0) adding con mode: crc 2024-09-14T11:41:13.368 INFO:tasks.workunit.client.0.smithi138.stderr: -184> 2024-09-14T11:41:13.002+0000 7fdce3c279c0 5 AuthRegistry(0x5595989861a0) adding con mode: crc 2024-09-14T11:41:13.368 INFO:tasks.workunit.client.0.smithi138.stderr: -183> 2024-09-14T11:41:13.002+0000 7fdce3c279c0 5 AuthRegistry(0x5595989861a0) adding con mode: secure 2024-09-14T11:41:13.368 INFO:tasks.workunit.client.0.smithi138.stderr: -182> 2024-09-14T11:41:13.002+0000 7fdce3c279c0 5 AuthRegistry(0x5595989861a0) adding con mode: crc 2024-09-14T11:41:13.368 INFO:tasks.workunit.client.0.smithi138.stderr: -181> 2024-09-14T11:41:13.002+0000 7fdce3c279c0 5 AuthRegistry(0x5595989861a0) adding con mode: secure 2024-09-14T11:41:13.368 INFO:tasks.workunit.client.0.smithi138.stderr: -180> 2024-09-14T11:41:13.002+0000 7fdce3c279c0 5 AuthRegistry(0x5595989861a0) adding con mode: crc 2024-09-14T11:41:13.368 INFO:tasks.workunit.client.0.smithi138.stderr: -179> 2024-09-14T11:41:13.002+0000 7fdce3c279c0 5 AuthRegistry(0x5595989861a0) adding con mode: secure 2024-09-14T11:41:13.368 INFO:tasks.workunit.client.0.smithi138.stderr: -178> 2024-09-14T11:41:13.002+0000 7fdce3c279c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:41:13.368 INFO:tasks.workunit.client.0.smithi138.stderr: -177> 2024-09-14T11:41:13.002+0000 7fdce3c279c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:41:13.368 INFO:tasks.workunit.client.0.smithi138.stderr: -176> 2024-09-14T11:41:13.002+0000 7fdce3c279c0 5 asok(0x5595986f9d90) register_command rotate-key cmddesc rotate-key hook 0x5595989862e8 EEXIST 2024-09-14T11:41:13.369 INFO:tasks.workunit.client.0.smithi138.stderr: -175> 2024-09-14T11:41:13.002+0000 7fdce3c279c0 10 monclient: _reopen_session rank -1 2024-09-14T11:41:13.369 INFO:tasks.workunit.client.0.smithi138.stderr: -174> 2024-09-14T11:41:13.002+0000 7fdce3c279c0 10 monclient: _add_conns ranks=[1,2,0] 2024-09-14T11:41:13.369 INFO:tasks.workunit.client.0.smithi138.stderr: -173> 2024-09-14T11:41:13.002+0000 7fdce3c279c0 10 monclient(hunting): picked mon.noname-b con 0x5595989d2330 addr [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] 2024-09-14T11:41:13.369 INFO:tasks.workunit.client.0.smithi138.stderr: -172> 2024-09-14T11:41:13.002+0000 7fdce3c279c0 10 monclient(hunting): picked mon.noname-c con 0x5595989d3560 addr [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] 2024-09-14T11:41:13.369 INFO:tasks.workunit.client.0.smithi138.stderr: -171> 2024-09-14T11:41:13.002+0000 7fdce3c279c0 10 monclient(hunting): picked mon.noname-a con 0x5595989d8140 addr [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] 2024-09-14T11:41:13.369 INFO:tasks.workunit.client.0.smithi138.stderr: -170> 2024-09-14T11:41:13.002+0000 7fdce3c279c0 10 monclient(hunting): start opening mon connection 2024-09-14T11:41:13.369 INFO:tasks.workunit.client.0.smithi138.stderr: -169> 2024-09-14T11:41:13.002+0000 7fdce3c279c0 10 monclient(hunting): start opening mon connection 2024-09-14T11:41:13.369 INFO:tasks.workunit.client.0.smithi138.stderr: -168> 2024-09-14T11:41:13.002+0000 7fdce3c279c0 10 monclient(hunting): start opening mon connection 2024-09-14T11:41:13.369 INFO:tasks.workunit.client.0.smithi138.stderr: -167> 2024-09-14T11:41:13.002+0000 7fdce3c279c0 10 monclient(hunting): _renew_subs 2024-09-14T11:41:13.369 INFO:tasks.workunit.client.0.smithi138.stderr: -166> 2024-09-14T11:41:13.002+0000 7fdce3c279c0 10 monclient(hunting): authenticate will time out at 3008.967136s 2024-09-14T11:41:13.369 INFO:tasks.workunit.client.0.smithi138.stderr: -165> 2024-09-14T11:41:13.002+0000 7fdce172d640 10 monclient(hunting): get_auth_request con 0x5595989d8140 auth_method 0 2024-09-14T11:41:13.369 INFO:tasks.workunit.client.0.smithi138.stderr: -164> 2024-09-14T11:41:13.002+0000 7fdce172d640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:41:13.369 INFO:tasks.workunit.client.0.smithi138.stderr: -163> 2024-09-14T11:41:13.002+0000 7fdce172d640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:41:13.369 INFO:tasks.workunit.client.0.smithi138.stderr: -162> 2024-09-14T11:41:13.002+0000 7fdce172d640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:41:13.369 INFO:tasks.workunit.client.0.smithi138.stderr: -161> 2024-09-14T11:41:13.002+0000 7fdce1f2e640 10 monclient(hunting): get_auth_request con 0x5595989d3560 auth_method 0 2024-09-14T11:41:13.370 INFO:tasks.workunit.client.0.smithi138.stderr: -160> 2024-09-14T11:41:13.002+0000 7fdce1f2e640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:41:13.370 INFO:tasks.workunit.client.0.smithi138.stderr: -159> 2024-09-14T11:41:13.002+0000 7fdce1f2e640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:41:13.370 INFO:tasks.workunit.client.0.smithi138.stderr: -158> 2024-09-14T11:41:13.002+0000 7fdce1f2e640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:41:13.370 INFO:tasks.workunit.client.0.smithi138.stderr: -157> 2024-09-14T11:41:13.002+0000 7fdce1f2e640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:41:13.370 INFO:tasks.workunit.client.0.smithi138.stderr: -156> 2024-09-14T11:41:13.002+0000 7fdce1f2e640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:41:13.370 INFO:tasks.workunit.client.0.smithi138.stderr: -155> 2024-09-14T11:41:13.002+0000 7fdce1f2e640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:41:13.370 INFO:tasks.workunit.client.0.smithi138.stderr: -154> 2024-09-14T11:41:13.002+0000 7fdce172d640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:41:13.370 INFO:tasks.workunit.client.0.smithi138.stderr: -153> 2024-09-14T11:41:13.002+0000 7fdce172d640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:41:13.370 INFO:tasks.workunit.client.0.smithi138.stderr: -152> 2024-09-14T11:41:13.002+0000 7fdce172d640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:41:13.370 INFO:tasks.workunit.client.0.smithi138.stderr: -151> 2024-09-14T11:41:13.002+0000 7fdce0f2c640 10 monclient(hunting): get_auth_request con 0x5595989d2330 auth_method 0 2024-09-14T11:41:13.370 INFO:tasks.workunit.client.0.smithi138.stderr: -150> 2024-09-14T11:41:13.002+0000 7fdce0f2c640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:41:13.370 INFO:tasks.workunit.client.0.smithi138.stderr: -149> 2024-09-14T11:41:13.002+0000 7fdce0f2c640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:41:13.370 INFO:tasks.workunit.client.0.smithi138.stderr: -148> 2024-09-14T11:41:13.002+0000 7fdce0f2c640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:41:13.370 INFO:tasks.workunit.client.0.smithi138.stderr: -147> 2024-09-14T11:41:13.002+0000 7fdce172d640 10 monclient(hunting): handle_auth_done global_id 8259 payload 824 2024-09-14T11:41:13.371 INFO:tasks.workunit.client.0.smithi138.stderr: -146> 2024-09-14T11:41:13.002+0000 7fdce172d640 10 monclient: _finish_hunting 0 2024-09-14T11:41:13.371 INFO:tasks.workunit.client.0.smithi138.stderr: -145> 2024-09-14T11:41:13.002+0000 7fdce172d640 1 monclient: found mon.noname-a 2024-09-14T11:41:13.371 INFO:tasks.workunit.client.0.smithi138.stderr: -144> 2024-09-14T11:41:13.002+0000 7fdce172d640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.138:3300/0 2024-09-14T11:41:13.371 INFO:tasks.workunit.client.0.smithi138.stderr: -143> 2024-09-14T11:41:13.002+0000 7fdbb6ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:41:13.371 INFO:tasks.workunit.client.0.smithi138.stderr: -142> 2024-09-14T11:41:13.002+0000 7fdbb6ffd640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-14T11:41:13.371 INFO:tasks.workunit.client.0.smithi138.stderr: -141> 2024-09-14T11:41:13.002+0000 7fdbb6ffd640 10 monclient: dump: 2024-09-14T11:41:13.371 INFO:tasks.workunit.client.0.smithi138.stderr:epoch 1 2024-09-14T11:41:13.371 INFO:tasks.workunit.client.0.smithi138.stderr:fsid 3f225f43-83a6-4aeb-b798-1f04bb49d597 2024-09-14T11:41:13.371 INFO:tasks.workunit.client.0.smithi138.stderr:last_changed 2024-09-14T11:07:09.252780+0000 2024-09-14T11:41:13.371 INFO:tasks.workunit.client.0.smithi138.stderr:created 2024-09-14T11:07:09.252780+0000 2024-09-14T11:41:13.371 INFO:tasks.workunit.client.0.smithi138.stderr:min_mon_release 19 (squid) 2024-09-14T11:41:13.371 INFO:tasks.workunit.client.0.smithi138.stderr:election_strategy: 1 2024-09-14T11:41:13.371 INFO:tasks.workunit.client.0.smithi138.stderr:0: [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] mon.a 2024-09-14T11:41:13.371 INFO:tasks.workunit.client.0.smithi138.stderr:1: [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] mon.b 2024-09-14T11:41:13.371 INFO:tasks.workunit.client.0.smithi138.stderr:2: [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] mon.c 2024-09-14T11:41:13.372 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-14T11:41:13.372 INFO:tasks.workunit.client.0.smithi138.stderr: -140> 2024-09-14T11:41:13.002+0000 7fdbb6ffd640 10 monclient: _finish_auth 0 2024-09-14T11:41:13.372 INFO:tasks.workunit.client.0.smithi138.stderr: -139> 2024-09-14T11:41:13.002+0000 7fdbb6ffd640 10 monclient: _check_auth_tickets 2024-09-14T11:41:13.372 INFO:tasks.workunit.client.0.smithi138.stderr: -138> 2024-09-14T11:41:13.002+0000 7fdbb6ffd640 10 monclient: handle_config config(0 keys) 2024-09-14T11:41:13.372 INFO:tasks.workunit.client.0.smithi138.stderr: -137> 2024-09-14T11:41:13.002+0000 7fdbb6ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:41:13.372 INFO:tasks.workunit.client.0.smithi138.stderr: -136> 2024-09-14T11:41:13.002+0000 7fdbb6ffd640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-14T11:41:13.372 INFO:tasks.workunit.client.0.smithi138.stderr: -135> 2024-09-14T11:41:13.002+0000 7fdbb6ffd640 10 monclient: dump: 2024-09-14T11:41:13.372 INFO:tasks.workunit.client.0.smithi138.stderr:epoch 1 2024-09-14T11:41:13.372 INFO:tasks.workunit.client.0.smithi138.stderr:fsid 3f225f43-83a6-4aeb-b798-1f04bb49d597 2024-09-14T11:41:13.372 INFO:tasks.workunit.client.0.smithi138.stderr:last_changed 2024-09-14T11:07:09.252780+0000 2024-09-14T11:41:13.372 INFO:tasks.workunit.client.0.smithi138.stderr:created 2024-09-14T11:07:09.252780+0000 2024-09-14T11:41:13.372 INFO:tasks.workunit.client.0.smithi138.stderr:min_mon_release 19 (squid) 2024-09-14T11:41:13.372 INFO:tasks.workunit.client.0.smithi138.stderr:election_strategy: 1 2024-09-14T11:41:13.372 INFO:tasks.workunit.client.0.smithi138.stderr:0: [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] mon.a 2024-09-14T11:41:13.372 INFO:tasks.workunit.client.0.smithi138.stderr:1: [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] mon.b 2024-09-14T11:41:13.372 INFO:tasks.workunit.client.0.smithi138.stderr:2: [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] mon.c 2024-09-14T11:41:13.373 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-14T11:41:13.373 INFO:tasks.workunit.client.0.smithi138.stderr: -134> 2024-09-14T11:41:13.002+0000 7fdbc4ff9640 4 set_mon_vals no callback set 2024-09-14T11:41:13.373 INFO:tasks.workunit.client.0.smithi138.stderr: -133> 2024-09-14T11:41:13.006+0000 7fdce3c279c0 5 monclient: authenticate success, global_id 8259 2024-09-14T11:41:13.373 INFO:tasks.workunit.client.0.smithi138.stderr: -132> 2024-09-14T11:41:13.006+0000 7fdce3c279c0 10 monclient: _renew_subs 2024-09-14T11:41:13.373 INFO:tasks.workunit.client.0.smithi138.stderr: -131> 2024-09-14T11:41:13.006+0000 7fdce3c279c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.138:3300/0 2024-09-14T11:41:13.373 INFO:tasks.workunit.client.0.smithi138.stderr: -130> 2024-09-14T11:41:13.006+0000 7fdce3c279c0 10 monclient: _renew_subs 2024-09-14T11:41:13.373 INFO:tasks.workunit.client.0.smithi138.stderr: -129> 2024-09-14T11:41:13.006+0000 7fdce3c279c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.138:3300/0 2024-09-14T11:41:13.373 INFO:tasks.workunit.client.0.smithi138.stderr: -128> 2024-09-14T11:41:13.006+0000 7fdce3c279c0 1 librados: init done 2024-09-14T11:41:13.373 INFO:tasks.workunit.client.0.smithi138.stderr: -127> 2024-09-14T11:41:13.006+0000 7fdce3c279c0 5 asok(0x5595986f9d90) register_command cr dump hook 0x5595989a9468 2024-09-14T11:41:13.373 INFO:tasks.workunit.client.0.smithi138.stderr: -126> 2024-09-14T11:41:13.006+0000 7fdce3c279c0 20 rados->read ofs=0 len=0 2024-09-14T11:41:13.373 INFO:tasks.workunit.client.0.smithi138.stderr: -125> 2024-09-14T11:41:13.006+0000 7fdbb6ffd640 4 mgrc handle_mgr_map Got map version 5 2024-09-14T11:41:13.373 INFO:tasks.workunit.client.0.smithi138.stderr: -124> 2024-09-14T11:41:13.006+0000 7fdbb6ffd640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.138:6832/3778043143,v1:172.21.15.138:6833/3778043143] 2024-09-14T11:41:13.373 INFO:tasks.workunit.client.0.smithi138.stderr: -123> 2024-09-14T11:41:13.006+0000 7fdbb6ffd640 4 mgrc reconnect Starting new session with [v2:172.21.15.138:6832/3778043143,v1:172.21.15.138:6833/3778043143] 2024-09-14T11:41:13.373 INFO:tasks.workunit.client.0.smithi138.stderr: -122> 2024-09-14T11:41:13.006+0000 7fdce0f2c640 10 monclient: get_auth_request con 0x7fdbac0718a0 auth_method 0 2024-09-14T11:41:13.374 INFO:tasks.workunit.client.0.smithi138.stderr: -121> 2024-09-14T11:41:13.006+0000 7fdce1f2e640 10 monclient: get_auth_request con 0x5595989f1720 auth_method 0 2024-09-14T11:41:13.374 INFO:tasks.workunit.client.0.smithi138.stderr: -120> 2024-09-14T11:41:13.006+0000 7fdce3c279c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:41:13.374 INFO:tasks.workunit.client.0.smithi138.stderr: -119> 2024-09-14T11:41:13.006+0000 7fdce3c279c0 20 realm 2024-09-14T11:41:13.374 INFO:tasks.workunit.client.0.smithi138.stderr: -118> 2024-09-14T11:41:13.006+0000 7fdce3c279c0 20 rados->read ofs=0 len=0 2024-09-14T11:41:13.374 INFO:tasks.workunit.client.0.smithi138.stderr: -117> 2024-09-14T11:41:13.010+0000 7fdce3c279c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:41:13.374 INFO:tasks.workunit.client.0.smithi138.stderr: -116> 2024-09-14T11:41:13.010+0000 7fdce3c279c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:41:13.374 INFO:tasks.workunit.client.0.smithi138.stderr: -115> 2024-09-14T11:41:13.010+0000 7fdce3c279c0 20 rados->read ofs=0 len=0 2024-09-14T11:41:13.374 INFO:tasks.workunit.client.0.smithi138.stderr: -114> 2024-09-14T11:41:13.010+0000 7fdce3c279c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:41:13.374 INFO:tasks.workunit.client.0.smithi138.stderr: -113> 2024-09-14T11:41:13.010+0000 7fdce3c279c0 20 rados->read ofs=0 len=0 2024-09-14T11:41:13.374 INFO:tasks.workunit.client.0.smithi138.stderr: -112> 2024-09-14T11:41:13.010+0000 7fdce0f2c640 10 monclient: get_auth_request con 0x5595989f5950 auth_method 0 2024-09-14T11:41:13.374 INFO:tasks.workunit.client.0.smithi138.stderr: -111> 2024-09-14T11:41:13.010+0000 7fdce3c279c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:41:13.374 INFO:tasks.workunit.client.0.smithi138.stderr: -110> 2024-09-14T11:41:13.010+0000 7fdce3c279c0 20 rados->read ofs=0 len=0 2024-09-14T11:41:13.374 INFO:tasks.workunit.client.0.smithi138.stderr: -109> 2024-09-14T11:41:13.010+0000 7fdce1f2e640 10 monclient: get_auth_request con 0x5595989f91b0 auth_method 0 2024-09-14T11:41:13.374 INFO:tasks.workunit.client.0.smithi138.stderr: -108> 2024-09-14T11:41:13.010+0000 7fdce3c279c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:41:13.374 INFO:tasks.workunit.client.0.smithi138.stderr: -107> 2024-09-14T11:41:13.010+0000 7fdce3c279c0 20 searching for the correct realm 2024-09-14T11:41:13.375 INFO:tasks.workunit.client.0.smithi138.stderr: -106> 2024-09-14T11:41:13.010+0000 7fdce172d640 10 monclient: get_auth_request con 0x5595989fdec0 auth_method 0 2024-09-14T11:41:13.375 INFO:tasks.workunit.client.0.smithi138.stderr: -105> 2024-09-14T11:41:13.010+0000 7fdce0f2c640 10 monclient: get_auth_request con 0x7fdcdc0cd040 auth_method 0 2024-09-14T11:41:13.375 INFO:tasks.workunit.client.0.smithi138.stderr: -104> 2024-09-14T11:41:13.014+0000 7fdce1f2e640 10 monclient: get_auth_request con 0x7fdcd4018930 auth_method 0 2024-09-14T11:41:13.375 INFO:tasks.workunit.client.0.smithi138.stderr: -103> 2024-09-14T11:41:13.014+0000 7fdce1f2e640 0 -- 172.21.15.138:0/1011542782 >> [v2:172.21.15.154:6824/416768175,v1:172.21.15.154:6825/416768175] conn(0x7fdcd4018930 msgr2=0x7fdcd4033400 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:41:13.375 INFO:tasks.workunit.client.0.smithi138.stderr: -102> 2024-09-14T11:41:13.014+0000 7fdbb6ffd640 1 client.8259.objecter ms_handle_reset 0x7fdcd4018930 session 0x7fdcd401e040 osd.4 2024-09-14T11:41:13.375 INFO:tasks.workunit.client.0.smithi138.stderr: -101> 2024-09-14T11:41:13.014+0000 7fdbb6ffd640 10 monclient: _renew_subs 2024-09-14T11:41:13.375 INFO:tasks.workunit.client.0.smithi138.stderr: -100> 2024-09-14T11:41:13.014+0000 7fdbb6ffd640 10 monclient: _send_mon_message to mon.a at v2:172.21.15.138:3300/0 2024-09-14T11:41:13.375 INFO:tasks.workunit.client.0.smithi138.stderr: -99> 2024-09-14T11:41:13.014+0000 7fdce1f2e640 10 monclient: get_auth_request con 0x7fdbac082050 auth_method 0 2024-09-14T11:41:13.375 INFO:tasks.workunit.client.0.smithi138.stderr: -98> 2024-09-14T11:41:13.018+0000 7fdce172d640 10 monclient: get_auth_request con 0x7fdcd404f3f0 auth_method 0 2024-09-14T11:41:13.375 INFO:tasks.workunit.client.0.smithi138.stderr: -97> 2024-09-14T11:41:13.022+0000 7fdce0f2c640 10 monclient: get_auth_request con 0x7fdcd405bac0 auth_method 0 2024-09-14T11:41:13.375 INFO:tasks.workunit.client.0.smithi138.stderr: -96> 2024-09-14T11:41:13.022+0000 7fdce0f2c640 0 -- 172.21.15.138:0/1011542782 >> [v2:172.21.15.138:6816/326481658,v1:172.21.15.138:6817/326481658] conn(0x7fdcd405bac0 msgr2=0x7fdcd403f3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:41:13.375 INFO:tasks.workunit.client.0.smithi138.stderr: -95> 2024-09-14T11:41:13.226+0000 7fdce0f2c640 10 monclient: get_auth_request con 0x7fdcd405bac0 auth_method 0 2024-09-14T11:41:13.375 INFO:tasks.workunit.client.0.smithi138.stderr: -94> 2024-09-14T11:41:13.242+0000 7fdce3c279c0 20 RGWRados::pool_iterate: got zone_info.d9e72d30-c60b-4d0d-9267-fdc36392d5ad 2024-09-14T11:41:13.375 INFO:tasks.workunit.client.0.smithi138.stderr: -93> 2024-09-14T11:41:13.242+0000 7fdce3c279c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:41:13.375 INFO:tasks.workunit.client.0.smithi138.stderr: -92> 2024-09-14T11:41:13.242+0000 7fdce3c279c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:41:13.376 INFO:tasks.workunit.client.0.smithi138.stderr: -91> 2024-09-14T11:41:13.242+0000 7fdce3c279c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:41:13.376 INFO:tasks.workunit.client.0.smithi138.stderr: -90> 2024-09-14T11:41:13.242+0000 7fdce3c279c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:41:13.376 INFO:tasks.workunit.client.0.smithi138.stderr: -89> 2024-09-14T11:41:13.242+0000 7fdce3c279c0 20 RGWRados::pool_iterate: got zonegroup_info.65ab941b-da8c-4160-94fb-3672b069d44f 2024-09-14T11:41:13.376 INFO:tasks.workunit.client.0.smithi138.stderr: -88> 2024-09-14T11:41:13.242+0000 7fdce3c279c0 20 rados->read ofs=0 len=0 2024-09-14T11:41:13.376 INFO:tasks.workunit.client.0.smithi138.stderr: -87> 2024-09-14T11:41:13.242+0000 7fdce3c279c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:41:13.376 INFO:tasks.workunit.client.0.smithi138.stderr: -86> 2024-09-14T11:41:13.242+0000 7fdce3c279c0 20 rados->read ofs=0 len=0 2024-09-14T11:41:13.376 INFO:tasks.workunit.client.0.smithi138.stderr: -85> 2024-09-14T11:41:13.242+0000 7fdce3c279c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:41:13.376 INFO:tasks.workunit.client.0.smithi138.stderr: -84> 2024-09-14T11:41:13.242+0000 7fdce3c279c0 20 rados->read ofs=0 len=0 2024-09-14T11:41:13.376 INFO:tasks.workunit.client.0.smithi138.stderr: -83> 2024-09-14T11:41:13.242+0000 7fdce3c279c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:41:13.376 INFO:tasks.workunit.client.0.smithi138.stderr: -82> 2024-09-14T11:41:13.242+0000 7fdce3c279c0 20 zone default found 2024-09-14T11:41:13.376 INFO:tasks.workunit.client.0.smithi138.stderr: -81> 2024-09-14T11:41:13.242+0000 7fdce3c279c0 4 Realm: () 2024-09-14T11:41:13.376 INFO:tasks.workunit.client.0.smithi138.stderr: -80> 2024-09-14T11:41:13.242+0000 7fdce3c279c0 4 ZoneGroup: default (65ab941b-da8c-4160-94fb-3672b069d44f) 2024-09-14T11:41:13.376 INFO:tasks.workunit.client.0.smithi138.stderr: -79> 2024-09-14T11:41:13.242+0000 7fdce3c279c0 4 Zone: default (d9e72d30-c60b-4d0d-9267-fdc36392d5ad) 2024-09-14T11:41:13.377 INFO:tasks.workunit.client.0.smithi138.stderr: -78> 2024-09-14T11:41:13.242+0000 7fdce3c279c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:41:13.377 INFO:tasks.workunit.client.0.smithi138.stderr: -77> 2024-09-14T11:41:13.242+0000 7fdce3c279c0 20 zonegroup default 2024-09-14T11:41:13.377 INFO:tasks.workunit.client.0.smithi138.stderr: -76> 2024-09-14T11:41:13.242+0000 7fdce3c279c0 20 rados->read ofs=0 len=0 2024-09-14T11:41:13.377 INFO:tasks.workunit.client.0.smithi138.stderr: -75> 2024-09-14T11:41:13.242+0000 7fdce3c279c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:41:13.377 INFO:tasks.workunit.client.0.smithi138.stderr: -74> 2024-09-14T11:41:13.242+0000 7fdce3c279c0 20 rados->read ofs=0 len=0 2024-09-14T11:41:13.377 INFO:tasks.workunit.client.0.smithi138.stderr: -73> 2024-09-14T11:41:13.246+0000 7fdce3c279c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:41:13.377 INFO:tasks.workunit.client.0.smithi138.stderr: -72> 2024-09-14T11:41:13.246+0000 7fdce3c279c0 20 rados->read ofs=0 len=0 2024-09-14T11:41:13.377 INFO:tasks.workunit.client.0.smithi138.stderr: -71> 2024-09-14T11:41:13.246+0000 7fdce3c279c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:41:13.377 INFO:tasks.workunit.client.0.smithi138.stderr: -70> 2024-09-14T11:41:13.246+0000 7fdce3c279c0 20 started sync module instance, tier type = 2024-09-14T11:41:13.377 INFO:tasks.workunit.client.0.smithi138.stderr: -69> 2024-09-14T11:41:13.246+0000 7fdce3c279c0 20 started zone id=d9e72d30-c60b-4d0d-9267-fdc36392d5ad (name=default) with tier type = 2024-09-14T11:41:13.377 INFO:tasks.workunit.client.0.smithi138.stderr: -68> 2024-09-14T11:41:13.270+0000 7fdce3c279c0 20 add_watcher() i=0 2024-09-14T11:41:13.377 INFO:tasks.workunit.client.0.smithi138.stderr: -67> 2024-09-14T11:41:13.270+0000 7fdce3c279c0 20 add_watcher() i=1 2024-09-14T11:41:13.377 INFO:tasks.workunit.client.0.smithi138.stderr: -66> 2024-09-14T11:41:13.270+0000 7fdce3c279c0 20 add_watcher() i=2 2024-09-14T11:41:13.377 INFO:tasks.workunit.client.0.smithi138.stderr: -65> 2024-09-14T11:41:13.270+0000 7fdce3c279c0 20 add_watcher() i=3 2024-09-14T11:41:13.378 INFO:tasks.workunit.client.0.smithi138.stderr: -64> 2024-09-14T11:41:13.270+0000 7fdce3c279c0 20 add_watcher() i=4 2024-09-14T11:41:13.378 INFO:tasks.workunit.client.0.smithi138.stderr: -63> 2024-09-14T11:41:13.270+0000 7fdce3c279c0 20 add_watcher() i=5 2024-09-14T11:41:13.378 INFO:tasks.workunit.client.0.smithi138.stderr: -62> 2024-09-14T11:41:13.270+0000 7fdce3c279c0 20 add_watcher() i=6 2024-09-14T11:41:13.378 INFO:tasks.workunit.client.0.smithi138.stderr: -61> 2024-09-14T11:41:13.270+0000 7fdce3c279c0 20 add_watcher() i=7 2024-09-14T11:41:13.378 INFO:tasks.workunit.client.0.smithi138.stderr: -60> 2024-09-14T11:41:13.270+0000 7fdce3c279c0 2 all 8 watchers are set, enabling cache 2024-09-14T11:41:13.378 INFO:tasks.workunit.client.0.smithi138.stderr: -59> 2024-09-14T11:41:13.274+0000 7fdce3c279c0 5 AuthRegistry(0x7ffdf8059e80) adding auth protocol: cephx 2024-09-14T11:41:13.378 INFO:tasks.workunit.client.0.smithi138.stderr: -58> 2024-09-14T11:41:13.274+0000 7fdce3c279c0 5 AuthRegistry(0x7ffdf8059e80) adding auth protocol: cephx 2024-09-14T11:41:13.378 INFO:tasks.workunit.client.0.smithi138.stderr: -57> 2024-09-14T11:41:13.274+0000 7fdce3c279c0 5 AuthRegistry(0x7ffdf8059e80) adding auth protocol: cephx 2024-09-14T11:41:13.378 INFO:tasks.workunit.client.0.smithi138.stderr: -56> 2024-09-14T11:41:13.274+0000 7fdce3c279c0 5 AuthRegistry(0x7ffdf8059e80) adding con mode: secure 2024-09-14T11:41:13.378 INFO:tasks.workunit.client.0.smithi138.stderr: -55> 2024-09-14T11:41:13.274+0000 7fdce3c279c0 5 AuthRegistry(0x7ffdf8059e80) adding con mode: crc 2024-09-14T11:41:13.378 INFO:tasks.workunit.client.0.smithi138.stderr: -54> 2024-09-14T11:41:13.274+0000 7fdb97fe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:41:13.378 INFO:tasks.workunit.client.0.smithi138.stderr: -53> 2024-09-14T11:41:13.274+0000 7fdce3c279c0 5 AuthRegistry(0x7ffdf8059e80) adding con mode: secure 2024-09-14T11:41:13.378 INFO:tasks.workunit.client.0.smithi138.stderr: -52> 2024-09-14T11:41:13.274+0000 7fdce3c279c0 5 AuthRegistry(0x7ffdf8059e80) adding con mode: crc 2024-09-14T11:41:13.378 INFO:tasks.workunit.client.0.smithi138.stderr: -51> 2024-09-14T11:41:13.274+0000 7fdce3c279c0 5 AuthRegistry(0x7ffdf8059e80) adding con mode: secure 2024-09-14T11:41:13.378 INFO:tasks.workunit.client.0.smithi138.stderr: -50> 2024-09-14T11:41:13.274+0000 7fdce3c279c0 5 AuthRegistry(0x7ffdf8059e80) adding con mode: crc 2024-09-14T11:41:13.378 INFO:tasks.workunit.client.0.smithi138.stderr: -49> 2024-09-14T11:41:13.274+0000 7fdce3c279c0 5 AuthRegistry(0x7ffdf8059e80) adding con mode: crc 2024-09-14T11:41:13.379 INFO:tasks.workunit.client.0.smithi138.stderr: -48> 2024-09-14T11:41:13.274+0000 7fdce3c279c0 5 AuthRegistry(0x7ffdf8059e80) adding con mode: secure 2024-09-14T11:41:13.379 INFO:tasks.workunit.client.0.smithi138.stderr: -47> 2024-09-14T11:41:13.274+0000 7fdce3c279c0 5 AuthRegistry(0x7ffdf8059e80) adding con mode: crc 2024-09-14T11:41:13.379 INFO:tasks.workunit.client.0.smithi138.stderr: -46> 2024-09-14T11:41:13.274+0000 7fdce3c279c0 5 AuthRegistry(0x7ffdf8059e80) adding con mode: secure 2024-09-14T11:41:13.379 INFO:tasks.workunit.client.0.smithi138.stderr: -45> 2024-09-14T11:41:13.274+0000 7fdce3c279c0 5 AuthRegistry(0x7ffdf8059e80) adding con mode: crc 2024-09-14T11:41:13.379 INFO:tasks.workunit.client.0.smithi138.stderr: -44> 2024-09-14T11:41:13.274+0000 7fdce3c279c0 5 AuthRegistry(0x7ffdf8059e80) adding con mode: secure 2024-09-14T11:41:13.379 INFO:tasks.workunit.client.0.smithi138.stderr: -43> 2024-09-14T11:41:13.274+0000 7fdce3c279c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:41:13.379 INFO:tasks.workunit.client.0.smithi138.stderr: -42> 2024-09-14T11:41:13.274+0000 7fdce3c279c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:41:13.379 INFO:tasks.workunit.client.0.smithi138.stderr: -41> 2024-09-14T11:41:13.274+0000 7fdce3c279c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:41:13.379 INFO:tasks.workunit.client.0.smithi138.stderr: -40> 2024-09-14T11:41:13.274+0000 7fdce3c279c0 5 asok(0x5595986f9d90) register_command cache list hook 0x5595989cccf0 2024-09-14T11:41:13.379 INFO:tasks.workunit.client.0.smithi138.stderr: -39> 2024-09-14T11:41:13.274+0000 7fdce3c279c0 5 asok(0x5595986f9d90) register_command cache inspect hook 0x5595989cccf0 2024-09-14T11:41:13.379 INFO:tasks.workunit.client.0.smithi138.stderr: -38> 2024-09-14T11:41:13.274+0000 7fdce3c279c0 5 asok(0x5595986f9d90) register_command cache erase hook 0x5595989cccf0 2024-09-14T11:41:13.379 INFO:tasks.workunit.client.0.smithi138.stderr: -37> 2024-09-14T11:41:13.274+0000 7fdce3c279c0 5 asok(0x5595986f9d90) register_command cache zap hook 0x5595989cccf0 2024-09-14T11:41:13.379 INFO:tasks.workunit.client.0.smithi138.stderr: -36> 2024-09-14T11:41:13.278+0000 7fdce3c279c0 5 note: GC not initialized 2024-09-14T11:41:13.379 INFO:tasks.workunit.client.0.smithi138.stderr: -35> 2024-09-14T11:41:13.278+0000 7fdb96fe5640 20 reqs_thread_entry: start 2024-09-14T11:41:13.379 INFO:tasks.workunit.client.0.smithi138.stderr: -34> 2024-09-14T11:41:13.278+0000 7fdce3c279c0 5 asok(0x5595986f9d90) register_command sync trace show hook 0x7fdcd400c040 2024-09-14T11:41:13.379 INFO:tasks.workunit.client.0.smithi138.stderr: -33> 2024-09-14T11:41:13.278+0000 7fdce3c279c0 5 asok(0x5595986f9d90) register_command sync trace history hook 0x7fdcd400c040 2024-09-14T11:41:13.380 INFO:tasks.workunit.client.0.smithi138.stderr: -32> 2024-09-14T11:41:13.278+0000 7fdce3c279c0 5 asok(0x5595986f9d90) register_command sync trace active hook 0x7fdcd400c040 2024-09-14T11:41:13.380 INFO:tasks.workunit.client.0.smithi138.stderr: -31> 2024-09-14T11:41:13.278+0000 7fdce3c279c0 5 asok(0x5595986f9d90) register_command sync trace active_short hook 0x7fdcd400c040 2024-09-14T11:41:13.380 INFO:tasks.workunit.client.0.smithi138.stderr: -30> 2024-09-14T11:41:13.278+0000 7fdce3c279c0 20 init_complete bucket index max shards: 11 2024-09-14T11:41:13.380 INFO:tasks.workunit.client.0.smithi138.stderr: -29> 2024-09-14T11:41:13.278+0000 7fdce3c279c0 20 Filter name: none 2024-09-14T11:41:13.380 INFO:tasks.workunit.client.0.smithi138.stderr: -28> 2024-09-14T11:41:13.278+0000 7fdb94fe1640 20 reqs_thread_entry: start 2024-09-14T11:41:13.380 INFO:tasks.workunit.client.0.smithi138.stderr: -27> 2024-09-14T11:41:13.278+0000 7fdce3c279c0 10 cache get: name=default.rgw.meta+root+a-bucket : miss 2024-09-14T11:41:13.380 INFO:tasks.workunit.client.0.smithi138.stderr: -26> 2024-09-14T11:41:13.278+0000 7fdce3c279c0 20 rados->read ofs=0 len=0 2024-09-14T11:41:13.380 INFO:tasks.workunit.client.0.smithi138.stderr: -25> 2024-09-14T11:41:13.278+0000 7fdce3c279c0 20 rados_obj.operate() r=0 bl.length=176 2024-09-14T11:41:13.380 INFO:tasks.workunit.client.0.smithi138.stderr: -24> 2024-09-14T11:41:13.278+0000 7fdce3c279c0 10 cache put: name=default.rgw.meta+root+a-bucket info.flags=0x11 2024-09-14T11:41:13.380 INFO:tasks.workunit.client.0.smithi138.stderr: -23> 2024-09-14T11:41:13.278+0000 7fdce3c279c0 10 adding default.rgw.meta+root+a-bucket to cache LRU end 2024-09-14T11:41:13.380 INFO:tasks.workunit.client.0.smithi138.stderr: -22> 2024-09-14T11:41:13.278+0000 7fdce3c279c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.17 : miss 2024-09-14T11:41:13.380 INFO:tasks.workunit.client.0.smithi138.stderr: -21> 2024-09-14T11:41:13.278+0000 7fdce3c279c0 20 rados->read ofs=0 len=0 2024-09-14T11:41:13.380 INFO:tasks.workunit.client.0.smithi138.stderr: -20> 2024-09-14T11:41:13.278+0000 7fdce3c279c0 20 rados_obj.operate() r=0 bl.length=430 2024-09-14T11:41:13.380 INFO:tasks.workunit.client.0.smithi138.stderr: -19> 2024-09-14T11:41:13.278+0000 7fdce3c279c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.17 info.flags=0x17 2024-09-14T11:41:13.380 INFO:tasks.workunit.client.0.smithi138.stderr: -18> 2024-09-14T11:41:13.278+0000 7fdce3c279c0 10 adding default.rgw.meta+root+.bucket.meta.a-bucket:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.17 to cache LRU end 2024-09-14T11:41:13.381 INFO:tasks.workunit.client.0.smithi138.stderr: -17> 2024-09-14T11:41:13.278+0000 7fdce3c279c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:41:13.381 INFO:tasks.workunit.client.0.smithi138.stderr: -16> 2024-09-14T11:41:13.278+0000 7fdce3c279c0 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-14T11:41:13.381 INFO:tasks.workunit.client.0.smithi138.stderr: -15> 2024-09-14T11:41:13.278+0000 7fdce3c279c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.17 2024-09-14T11:41:13.381 INFO:tasks.workunit.client.0.smithi138.stderr: -14> 2024-09-14T11:41:13.282+0000 7fdce3c279c0 10 init_target_layout removing existing target index objects from a previous reshard attempt 2024-09-14T11:41:13.381 INFO:tasks.workunit.client.0.smithi138.stderr: -13> 2024-09-14T11:41:13.298+0000 7fdce3c279c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.17 info.flags=0x17 2024-09-14T11:41:13.381 INFO:tasks.workunit.client.0.smithi138.stderr: -12> 2024-09-14T11:41:13.298+0000 7fdce3c279c0 10 moving default.rgw.meta+root+.bucket.meta.a-bucket:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.17 to cache LRU end 2024-09-14T11:41:13.381 INFO:tasks.workunit.client.0.smithi138.stderr: -11> 2024-09-14T11:41:13.298+0000 7fdce3c279c0 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-14T11:41:13.381 INFO:tasks.workunit.client.0.smithi138.stderr: -10> 2024-09-14T11:41:13.298+0000 7fdce3c279c0 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.a-bucket:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.17, ofs0, ns] 2024-09-14T11:41:13.381 INFO:tasks.workunit.client.0.smithi138.stderr: -9> 2024-09-14T11:41:13.298+0000 7fdbb7fff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366243 cookie 94100999125296 notifier 8259 bl.length()=827 2024-09-14T11:41:13.381 INFO:tasks.workunit.client.0.smithi138.stderr: -8> 2024-09-14T11:41:13.298+0000 7fdbb7fff640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.17 info.flags=0x17 2024-09-14T11:41:13.381 INFO:tasks.workunit.client.0.smithi138.stderr: -7> 2024-09-14T11:41:13.298+0000 7fdbb7fff640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.a-bucket:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.17 to cache LRU end 2024-09-14T11:41:13.381 INFO:tasks.workunit.client.0.smithi138.stderr: -6> 2024-09-14T11:41:13.298+0000 7fdbb7fff640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=143 2024-09-14T11:41:13.381 INFO:tasks.workunit.client.0.smithi138.stderr: -5> 2024-09-14T11:41:13.302+0000 7fdce3c279c0 20 handle_bi_update(): bucket=:a-bucket[d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.17]): orig_sources= new_sources= 2024-09-14T11:41:13.381 INFO:tasks.workunit.client.0.smithi138.stderr: -4> 2024-09-14T11:41:13.302+0000 7fdce3c279c0 20 handle_bi_update(): bucket=:a-bucket[d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.17]): potential sources added=[] removed=[] 2024-09-14T11:41:13.381 INFO:tasks.workunit.client.0.smithi138.stderr: -3> 2024-09-14T11:41:13.302+0000 7fdce3c279c0 20 handle_bi_update(): bucket=:a-bucket[d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.17]): orig_dests= new_dests= 2024-09-14T11:41:13.382 INFO:tasks.workunit.client.0.smithi138.stderr: -2> 2024-09-14T11:41:13.302+0000 7fdce3c279c0 20 handle_bi_update(): bucket=:a-bucket[d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.17]): potential dests added=[] removed=[] 2024-09-14T11:41:13.382 INFO:tasks.workunit.client.0.smithi138.stderr: -1> 2024-09-14T11:41:13.314+0000 7fdce3c279c0 -1 ./src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7fdce3c279c0 time 2024-09-14T11:41:13.317278+0000 2024-09-14T11:41:13.382 INFO:tasks.workunit.client.0.smithi138.stderr:./src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-14T11:41:13.382 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-14T11:41:13.382 INFO:tasks.workunit.client.0.smithi138.stderr: ceph version 19.3.0-4907-ga2782315 (a2782315255a3e7d5f6cdc9eb35785187ff6ddf8) squid (dev) 2024-09-14T11:41:13.382 INFO:tasks.workunit.client.0.smithi138.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x121) [0x7fdce75012eb] 2024-09-14T11:41:13.382 INFO:tasks.workunit.client.0.smithi138.stderr: 2: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7fdce750149f] 2024-09-14T11:41:13.382 INFO:tasks.workunit.client.0.smithi138.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x559596c0bc01] 2024-09-14T11:41:13.382 INFO:tasks.workunit.client.0.smithi138.stderr: 4: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x17a) [0x559596c20f3a] 2024-09-14T11:41:13.382 INFO:tasks.workunit.client.0.smithi138.stderr: 5: main() 2024-09-14T11:41:13.382 INFO:tasks.workunit.client.0.smithi138.stderr: 6: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7fdce6367d90] 2024-09-14T11:41:13.382 INFO:tasks.workunit.client.0.smithi138.stderr: 7: __libc_start_main() 2024-09-14T11:41:13.382 INFO:tasks.workunit.client.0.smithi138.stderr: 8: _start() 2024-09-14T11:41:13.382 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-14T11:41:13.383 INFO:tasks.workunit.client.0.smithi138.stderr: 0> 2024-09-14T11:41:13.314+0000 7fdce3c279c0 -1 *** Caught signal (Aborted) ** 2024-09-14T11:41:13.383 INFO:tasks.workunit.client.0.smithi138.stderr: in thread 7fdce3c279c0 thread_name:radosgw-admin 2024-09-14T11:41:13.383 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-14T11:41:13.383 INFO:tasks.workunit.client.0.smithi138.stderr: ceph version 19.3.0-4907-ga2782315 (a2782315255a3e7d5f6cdc9eb35785187ff6ddf8) squid (dev) 2024-09-14T11:41:13.383 INFO:tasks.workunit.client.0.smithi138.stderr: 1: /lib/x86_64-linux-gnu/libc.so.6(+0x42520) [0x7fdce6380520] 2024-09-14T11:41:13.383 INFO:tasks.workunit.client.0.smithi138.stderr: 2: pthread_kill() 2024-09-14T11:41:13.383 INFO:tasks.workunit.client.0.smithi138.stderr: 3: raise() 2024-09-14T11:41:13.383 INFO:tasks.workunit.client.0.smithi138.stderr: 4: abort() 2024-09-14T11:41:13.383 INFO:tasks.workunit.client.0.smithi138.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x17b) [0x7fdce7501345] 2024-09-14T11:41:13.383 INFO:tasks.workunit.client.0.smithi138.stderr: 6: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7fdce750149f] 2024-09-14T11:41:13.383 INFO:tasks.workunit.client.0.smithi138.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x559596c0bc01] 2024-09-14T11:41:13.383 INFO:tasks.workunit.client.0.smithi138.stderr: 8: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x17a) [0x559596c20f3a] 2024-09-14T11:41:13.383 INFO:tasks.workunit.client.0.smithi138.stderr: 9: main() 2024-09-14T11:41:13.383 INFO:tasks.workunit.client.0.smithi138.stderr: 10: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7fdce6367d90] 2024-09-14T11:41:13.383 INFO:tasks.workunit.client.0.smithi138.stderr: 11: __libc_start_main() 2024-09-14T11:41:13.384 INFO:tasks.workunit.client.0.smithi138.stderr: 12: _start() 2024-09-14T11:41:13.384 INFO:tasks.workunit.client.0.smithi138.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-14T11:41:13.384 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-14T11:41:13.384 INFO:tasks.workunit.client.0.smithi138.stderr:--- logging levels --- 2024-09-14T11:41:13.384 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 none 2024-09-14T11:41:13.384 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 1 lockdep 2024-09-14T11:41:13.384 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 1 context 2024-09-14T11:41:13.384 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 1 crush 2024-09-14T11:41:13.384 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 mds 2024-09-14T11:41:13.384 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 mds_balancer 2024-09-14T11:41:13.384 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 mds_locker 2024-09-14T11:41:13.384 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 mds_log 2024-09-14T11:41:13.384 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 mds_log_expire 2024-09-14T11:41:13.384 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 mds_migrator 2024-09-14T11:41:13.384 INFO:tasks.workunit.client.0.smithi138.stderr: 3/ 5 mds_quiesce 2024-09-14T11:41:13.385 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 1 buffer 2024-09-14T11:41:13.385 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 1 timer 2024-09-14T11:41:13.385 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 1 filer 2024-09-14T11:41:13.385 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 1 striper 2024-09-14T11:41:13.385 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 1 objecter 2024-09-14T11:41:13.385 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 rados 2024-09-14T11:41:13.385 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 rbd 2024-09-14T11:41:13.385 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 rbd_mirror 2024-09-14T11:41:13.385 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 rbd_replay 2024-09-14T11:41:13.385 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 rbd_pwl 2024-09-14T11:41:13.385 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 journaler 2024-09-14T11:41:13.385 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 objectcacher 2024-09-14T11:41:13.385 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 immutable_obj_cache 2024-09-14T11:41:13.385 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 client 2024-09-14T11:41:13.385 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 osd 2024-09-14T11:41:13.386 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 optracker 2024-09-14T11:41:13.386 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 objclass 2024-09-14T11:41:13.386 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 3 filestore 2024-09-14T11:41:13.386 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 3 journal 2024-09-14T11:41:13.386 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 0 ms 2024-09-14T11:41:13.386 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 mon 2024-09-14T11:41:13.386 INFO:tasks.workunit.client.0.smithi138.stderr: 0/10 monc 2024-09-14T11:41:13.386 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 paxos 2024-09-14T11:41:13.386 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 tp 2024-09-14T11:41:13.386 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 auth 2024-09-14T11:41:13.386 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 crypto 2024-09-14T11:41:13.386 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 1 finisher 2024-09-14T11:41:13.386 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 1 reserver 2024-09-14T11:41:13.386 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 heartbeatmap 2024-09-14T11:41:13.386 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 perfcounter 2024-09-14T11:41:13.386 INFO:tasks.workunit.client.0.smithi138.stderr: 20/20 rgw 2024-09-14T11:41:13.386 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 rgw_sync 2024-09-14T11:41:13.387 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 rgw_datacache 2024-09-14T11:41:13.387 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 rgw_access 2024-09-14T11:41:13.387 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 rgw_dbstore 2024-09-14T11:41:13.387 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 rgw_flight 2024-09-14T11:41:13.387 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 rgw_lifecycle 2024-09-14T11:41:13.387 INFO:tasks.workunit.client.0.smithi138.stderr: 20/20 rgw_notification 2024-09-14T11:41:13.387 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 javaclient 2024-09-14T11:41:13.387 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 asok 2024-09-14T11:41:13.387 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 1 throttle 2024-09-14T11:41:13.387 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 0 refs 2024-09-14T11:41:13.387 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 compressor 2024-09-14T11:41:13.387 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 bluestore 2024-09-14T11:41:13.387 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 bluefs 2024-09-14T11:41:13.387 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 3 bdev 2024-09-14T11:41:13.387 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 kstore 2024-09-14T11:41:13.388 INFO:tasks.workunit.client.0.smithi138.stderr: 4/ 5 rocksdb 2024-09-14T11:41:13.388 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 fuse 2024-09-14T11:41:13.388 INFO:tasks.workunit.client.0.smithi138.stderr: 2/ 5 mgr 2024-09-14T11:41:13.388 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 mgrc 2024-09-14T11:41:13.388 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 dpdk 2024-09-14T11:41:13.388 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 eventtrace 2024-09-14T11:41:13.388 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 prioritycache 2024-09-14T11:41:13.388 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 test 2024-09-14T11:41:13.388 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 cephfs_mirror 2024-09-14T11:41:13.388 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 cephsqlite 2024-09-14T11:41:13.388 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 crimson_interrupt 2024-09-14T11:41:13.388 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 seastore 2024-09-14T11:41:13.388 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 seastore_onode 2024-09-14T11:41:13.388 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 seastore_odata 2024-09-14T11:41:13.389 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 seastore_omap 2024-09-14T11:41:13.389 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 seastore_tm 2024-09-14T11:41:13.389 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 seastore_t 2024-09-14T11:41:13.389 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 seastore_cleaner 2024-09-14T11:41:13.389 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 seastore_epm 2024-09-14T11:41:13.389 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 seastore_lba 2024-09-14T11:41:13.389 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 seastore_fixedkv_tree 2024-09-14T11:41:13.389 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 seastore_cache 2024-09-14T11:41:13.389 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 seastore_journal 2024-09-14T11:41:13.389 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 seastore_device 2024-09-14T11:41:13.389 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 seastore_backref 2024-09-14T11:41:13.389 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 alienstore 2024-09-14T11:41:13.389 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 mclock 2024-09-14T11:41:13.389 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 cyanstore 2024-09-14T11:41:13.389 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 ceph_exporter 2024-09-14T11:41:13.390 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 memstore 2024-09-14T11:41:13.390 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 trace 2024-09-14T11:41:13.390 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 ceph_dedup 2024-09-14T11:41:13.390 INFO:tasks.workunit.client.0.smithi138.stderr: -2/-2 (syslog threshold) 2024-09-14T11:41:13.390 INFO:tasks.workunit.client.0.smithi138.stderr: 99/99 (stderr threshold) 2024-09-14T11:41:13.390 INFO:tasks.workunit.client.0.smithi138.stderr:--- pthread ID / name mapping for recent threads --- 2024-09-14T11:41:13.390 INFO:tasks.workunit.client.0.smithi138.stderr: 7fdb94fe1640 / http_manager 2024-09-14T11:41:13.390 INFO:tasks.workunit.client.0.smithi138.stderr: 7fdb96fe5640 / http_manager 2024-09-14T11:41:13.390 INFO:tasks.workunit.client.0.smithi138.stderr: 7fdb97fe7640 / rgw_dt_lg_renew 2024-09-14T11:41:13.390 INFO:tasks.workunit.client.0.smithi138.stderr: 7fdbb6ffd640 / ms_dispatch 2024-09-14T11:41:13.390 INFO:tasks.workunit.client.0.smithi138.stderr: 7fdbb7fff640 / io_context_pool 2024-09-14T11:41:13.390 INFO:tasks.workunit.client.0.smithi138.stderr: 7fdbc4ff9640 / io_context_pool 2024-09-14T11:41:13.390 INFO:tasks.workunit.client.0.smithi138.stderr: 7fdbc6ffd640 / ms_dispatch 2024-09-14T11:41:13.390 INFO:tasks.workunit.client.0.smithi138.stderr: 7fdbcde03640 / ms_dispatch 2024-09-14T11:41:13.390 INFO:tasks.workunit.client.0.smithi138.stderr: 7fdbcf606640 / io_context_pool 2024-09-14T11:41:13.391 INFO:tasks.workunit.client.0.smithi138.stderr: 7fdce0f2c640 / msgr-worker-2 2024-09-14T11:41:13.391 INFO:tasks.workunit.client.0.smithi138.stderr: 7fdce172d640 / msgr-worker-1 2024-09-14T11:41:13.391 INFO:tasks.workunit.client.0.smithi138.stderr: 7fdce1f2e640 / msgr-worker-0 2024-09-14T11:41:13.391 INFO:tasks.workunit.client.0.smithi138.stderr: 7fdce272f640 / io_context_pool 2024-09-14T11:41:13.391 INFO:tasks.workunit.client.0.smithi138.stderr: 7fdce3c279c0 / radosgw-admin 2024-09-14T11:41:13.391 INFO:tasks.workunit.client.0.smithi138.stderr: max_recent 500 2024-09-14T11:41:13.391 INFO:tasks.workunit.client.0.smithi138.stderr: max_new 1000 2024-09-14T11:41:13.391 INFO:tasks.workunit.client.0.smithi138.stderr: log_file /var/log/ceph/ceph-client.admin.145696.log 2024-09-14T11:41:13.391 INFO:tasks.workunit.client.0.smithi138.stderr:--- end dump of recent events --- 2024-09-14T11:41:13.391 INFO:tasks.workunit.client.0.smithi138.stderr:--- begin dump of recent events --- 2024-09-14T11:41:13.391 INFO:tasks.workunit.client.0.smithi138.stderr: -499> 2024-09-14T11:41:12.982+0000 7fdce172d640 1 monclient: found mon.noname-c 2024-09-14T11:41:13.391 INFO:tasks.workunit.client.0.smithi138.stderr: -498> 2024-09-14T11:41:12.982+0000 7fdce172d640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.138:3301/0 2024-09-14T11:41:13.391 INFO:tasks.workunit.client.0.smithi138.stderr: -497> 2024-09-14T11:41:12.986+0000 7fdbcf606640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:41:13.391 INFO:tasks.workunit.client.0.smithi138.stderr: -496> 2024-09-14T11:41:12.986+0000 7fdbcf606640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-14T11:41:13.391 INFO:tasks.workunit.client.0.smithi138.stderr: -495> 2024-09-14T11:41:12.986+0000 7fdbcf606640 10 monclient: dump: 2024-09-14T11:41:13.391 INFO:tasks.workunit.client.0.smithi138.stderr:epoch 1 2024-09-14T11:41:13.392 INFO:tasks.workunit.client.0.smithi138.stderr:fsid 3f225f43-83a6-4aeb-b798-1f04bb49d597 2024-09-14T11:41:13.392 INFO:tasks.workunit.client.0.smithi138.stderr:last_changed 2024-09-14T11:07:09.252780+0000 2024-09-14T11:41:13.392 INFO:tasks.workunit.client.0.smithi138.stderr:created 2024-09-14T11:07:09.252780+0000 2024-09-14T11:41:13.392 INFO:tasks.workunit.client.0.smithi138.stderr:min_mon_release 19 (squid) 2024-09-14T11:41:13.392 INFO:tasks.workunit.client.0.smithi138.stderr:election_strategy: 1 2024-09-14T11:41:13.392 INFO:tasks.workunit.client.0.smithi138.stderr:0: [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] mon.a 2024-09-14T11:41:13.392 INFO:tasks.workunit.client.0.smithi138.stderr:1: [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] mon.b 2024-09-14T11:41:13.392 INFO:tasks.workunit.client.0.smithi138.stderr:2: [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] mon.c 2024-09-14T11:41:13.392 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-14T11:41:13.392 INFO:tasks.workunit.client.0.smithi138.stderr: -494> 2024-09-14T11:41:12.986+0000 7fdbcf606640 10 monclient: _finish_auth 0 2024-09-14T11:41:13.392 INFO:tasks.workunit.client.0.smithi138.stderr: -493> 2024-09-14T11:41:12.986+0000 7fdbcf606640 10 monclient: _check_auth_tickets 2024-09-14T11:41:13.392 INFO:tasks.workunit.client.0.smithi138.stderr: -492> 2024-09-14T11:41:12.986+0000 7fdbcf606640 10 monclient: handle_config config(0 keys) 2024-09-14T11:41:13.392 INFO:tasks.workunit.client.0.smithi138.stderr: -491> 2024-09-14T11:41:12.986+0000 7fdce3c279c0 5 monclient: authenticate success, global_id 7703 2024-09-14T11:41:13.392 INFO:tasks.workunit.client.0.smithi138.stderr: -490> 2024-09-14T11:41:12.986+0000 7fdce3c279c0 10 monclient: get_monmap_and_config success 2024-09-14T11:41:13.392 INFO:tasks.workunit.client.0.smithi138.stderr: -489> 2024-09-14T11:41:12.986+0000 7fdce3c279c0 4 set_mon_vals no callback set 2024-09-14T11:41:13.393 INFO:tasks.workunit.client.0.smithi138.stderr: -488> 2024-09-14T11:41:12.986+0000 7fdbcf606640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:41:13.393 INFO:tasks.workunit.client.0.smithi138.stderr: -487> 2024-09-14T11:41:12.986+0000 7fdbcf606640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-14T11:41:13.393 INFO:tasks.workunit.client.0.smithi138.stderr: -486> 2024-09-14T11:41:12.986+0000 7fdbcf606640 10 monclient: dump: 2024-09-14T11:41:13.393 INFO:tasks.workunit.client.0.smithi138.stderr:epoch 1 2024-09-14T11:41:13.393 INFO:tasks.workunit.client.0.smithi138.stderr:fsid 3f225f43-83a6-4aeb-b798-1f04bb49d597 2024-09-14T11:41:13.393 INFO:tasks.workunit.client.0.smithi138.stderr:last_changed 2024-09-14T11:07:09.252780+0000 2024-09-14T11:41:13.393 INFO:tasks.workunit.client.0.smithi138.stderr:created 2024-09-14T11:07:09.252780+0000 2024-09-14T11:41:13.393 INFO:tasks.workunit.client.0.smithi138.stderr:min_mon_release 19 (squid) 2024-09-14T11:41:13.393 INFO:tasks.workunit.client.0.smithi138.stderr:election_strategy: 1 2024-09-14T11:41:13.393 INFO:tasks.workunit.client.0.smithi138.stderr:0: [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] mon.a 2024-09-14T11:41:13.393 INFO:tasks.workunit.client.0.smithi138.stderr:1: [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] mon.b 2024-09-14T11:41:13.393 INFO:tasks.workunit.client.0.smithi138.stderr:2: [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] mon.c 2024-09-14T11:41:13.393 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-14T11:41:13.393 INFO:tasks.workunit.client.0.smithi138.stderr: -485> 2024-09-14T11:41:12.986+0000 7fdce3c279c0 10 monclient: shutdown 2024-09-14T11:41:13.394 INFO:tasks.workunit.client.0.smithi138.stderr: -484> 2024-09-14T11:41:12.986+0000 7fdce3c279c0 5 asok(0x5595986f9d90) unregister_commands rotate-key 2024-09-14T11:41:13.394 INFO:tasks.workunit.client.0.smithi138.stderr: -483> 2024-09-14T11:41:12.986+0000 7fdce3c279c0 10 monclient: build_initial_monmap 2024-09-14T11:41:13.394 INFO:tasks.workunit.client.0.smithi138.stderr: -482> 2024-09-14T11:41:12.986+0000 7fdce3c279c0 1 build_initial for_mkfs: 0 2024-09-14T11:41:13.394 INFO:tasks.workunit.client.0.smithi138.stderr: -481> 2024-09-14T11:41:12.986+0000 7fdce3c279c0 10 monclient: monmap: 2024-09-14T11:41:13.394 INFO:tasks.workunit.client.0.smithi138.stderr:epoch 0 2024-09-14T11:41:13.394 INFO:tasks.workunit.client.0.smithi138.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-14T11:41:13.394 INFO:tasks.workunit.client.0.smithi138.stderr:last_changed 0.000000 2024-09-14T11:41:13.394 INFO:tasks.workunit.client.0.smithi138.stderr:created 0.000000 2024-09-14T11:41:13.394 INFO:tasks.workunit.client.0.smithi138.stderr:min_mon_release 0 (unknown) 2024-09-14T11:41:13.394 INFO:tasks.workunit.client.0.smithi138.stderr:election_strategy: 1 2024-09-14T11:41:13.394 INFO:tasks.workunit.client.0.smithi138.stderr:0: [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] mon.noname-a 2024-09-14T11:41:13.394 INFO:tasks.workunit.client.0.smithi138.stderr:1: [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] mon.noname-b 2024-09-14T11:41:13.394 INFO:tasks.workunit.client.0.smithi138.stderr:2: [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] mon.noname-c 2024-09-14T11:41:13.394 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-14T11:41:13.394 INFO:tasks.workunit.client.0.smithi138.stderr: -480> 2024-09-14T11:41:12.986+0000 7fdce3c279c0 5 AuthRegistry(0x55959890afe0) adding auth protocol: cephx 2024-09-14T11:41:13.394 INFO:tasks.workunit.client.0.smithi138.stderr: -479> 2024-09-14T11:41:12.986+0000 7fdce3c279c0 5 AuthRegistry(0x55959890afe0) adding auth protocol: cephx 2024-09-14T11:41:13.395 INFO:tasks.workunit.client.0.smithi138.stderr: -478> 2024-09-14T11:41:12.986+0000 7fdce3c279c0 5 AuthRegistry(0x55959890afe0) adding auth protocol: cephx 2024-09-14T11:41:13.395 INFO:tasks.workunit.client.0.smithi138.stderr: -477> 2024-09-14T11:41:12.986+0000 7fdce3c279c0 5 AuthRegistry(0x55959890afe0) adding con mode: secure 2024-09-14T11:41:13.395 INFO:tasks.workunit.client.0.smithi138.stderr: -476> 2024-09-14T11:41:12.986+0000 7fdce3c279c0 5 AuthRegistry(0x55959890afe0) adding con mode: crc 2024-09-14T11:41:13.395 INFO:tasks.workunit.client.0.smithi138.stderr: -475> 2024-09-14T11:41:12.986+0000 7fdce3c279c0 5 AuthRegistry(0x55959890afe0) adding con mode: secure 2024-09-14T11:41:13.395 INFO:tasks.workunit.client.0.smithi138.stderr: -474> 2024-09-14T11:41:12.986+0000 7fdce3c279c0 5 AuthRegistry(0x55959890afe0) adding con mode: crc 2024-09-14T11:41:13.395 INFO:tasks.workunit.client.0.smithi138.stderr: -473> 2024-09-14T11:41:12.986+0000 7fdce3c279c0 5 AuthRegistry(0x55959890afe0) adding con mode: secure 2024-09-14T11:41:13.395 INFO:tasks.workunit.client.0.smithi138.stderr: -472> 2024-09-14T11:41:12.986+0000 7fdce3c279c0 5 AuthRegistry(0x55959890afe0) adding con mode: crc 2024-09-14T11:41:13.395 INFO:tasks.workunit.client.0.smithi138.stderr: -471> 2024-09-14T11:41:12.986+0000 7fdce3c279c0 5 AuthRegistry(0x55959890afe0) adding con mode: crc 2024-09-14T11:41:13.395 INFO:tasks.workunit.client.0.smithi138.stderr: -470> 2024-09-14T11:41:12.986+0000 7fdce3c279c0 5 AuthRegistry(0x55959890afe0) adding con mode: secure 2024-09-14T11:41:13.395 INFO:tasks.workunit.client.0.smithi138.stderr: -469> 2024-09-14T11:41:12.986+0000 7fdce3c279c0 5 AuthRegistry(0x55959890afe0) adding con mode: crc 2024-09-14T11:41:13.395 INFO:tasks.workunit.client.0.smithi138.stderr: -468> 2024-09-14T11:41:12.986+0000 7fdce3c279c0 5 AuthRegistry(0x55959890afe0) adding con mode: secure 2024-09-14T11:41:13.395 INFO:tasks.workunit.client.0.smithi138.stderr: -467> 2024-09-14T11:41:12.986+0000 7fdce3c279c0 5 AuthRegistry(0x55959890afe0) adding con mode: crc 2024-09-14T11:41:13.395 INFO:tasks.workunit.client.0.smithi138.stderr: -466> 2024-09-14T11:41:12.986+0000 7fdce3c279c0 5 AuthRegistry(0x55959890afe0) adding con mode: secure 2024-09-14T11:41:13.395 INFO:tasks.workunit.client.0.smithi138.stderr: -465> 2024-09-14T11:41:12.986+0000 7fdce3c279c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:41:13.395 INFO:tasks.workunit.client.0.smithi138.stderr: -464> 2024-09-14T11:41:12.986+0000 7fdce3c279c0 1 librados: starting msgr at 2024-09-14T11:41:13.395 INFO:tasks.workunit.client.0.smithi138.stderr: -463> 2024-09-14T11:41:12.986+0000 7fdce3c279c0 1 librados: starting objecter 2024-09-14T11:41:13.396 INFO:tasks.workunit.client.0.smithi138.stderr: -462> 2024-09-14T11:41:12.986+0000 7fdce3c279c0 5 asok(0x5595986f9d90) register_command objecter_requests hook 0x5595987268b0 2024-09-14T11:41:13.396 INFO:tasks.workunit.client.0.smithi138.stderr: -461> 2024-09-14T11:41:12.986+0000 7fdce3c279c0 1 librados: setting wanted keys 2024-09-14T11:41:13.396 INFO:tasks.workunit.client.0.smithi138.stderr: -460> 2024-09-14T11:41:12.986+0000 7fdce3c279c0 1 librados: calling monclient init 2024-09-14T11:41:13.396 INFO:tasks.workunit.client.0.smithi138.stderr: -459> 2024-09-14T11:41:12.986+0000 7fdce3c279c0 10 monclient: init 2024-09-14T11:41:13.396 INFO:tasks.workunit.client.0.smithi138.stderr: -458> 2024-09-14T11:41:12.986+0000 7fdce3c279c0 5 AuthRegistry(0x5595989052a0) adding auth protocol: cephx 2024-09-14T11:41:13.396 INFO:tasks.workunit.client.0.smithi138.stderr: -457> 2024-09-14T11:41:12.986+0000 7fdce3c279c0 5 AuthRegistry(0x5595989052a0) adding auth protocol: cephx 2024-09-14T11:41:13.396 INFO:tasks.workunit.client.0.smithi138.stderr: -456> 2024-09-14T11:41:12.986+0000 7fdce3c279c0 5 AuthRegistry(0x5595989052a0) adding auth protocol: cephx 2024-09-14T11:41:13.396 INFO:tasks.workunit.client.0.smithi138.stderr: -455> 2024-09-14T11:41:12.986+0000 7fdce3c279c0 5 AuthRegistry(0x5595989052a0) adding con mode: secure 2024-09-14T11:41:13.396 INFO:tasks.workunit.client.0.smithi138.stderr: -454> 2024-09-14T11:41:12.986+0000 7fdce3c279c0 5 AuthRegistry(0x5595989052a0) adding con mode: crc 2024-09-14T11:41:13.396 INFO:tasks.workunit.client.0.smithi138.stderr: -453> 2024-09-14T11:41:12.986+0000 7fdce3c279c0 5 AuthRegistry(0x5595989052a0) adding con mode: secure 2024-09-14T11:41:13.396 INFO:tasks.workunit.client.0.smithi138.stderr: -452> 2024-09-14T11:41:12.986+0000 7fdce3c279c0 5 AuthRegistry(0x5595989052a0) adding con mode: crc 2024-09-14T11:41:13.396 INFO:tasks.workunit.client.0.smithi138.stderr: -451> 2024-09-14T11:41:12.986+0000 7fdce3c279c0 5 AuthRegistry(0x5595989052a0) adding con mode: secure 2024-09-14T11:41:13.396 INFO:tasks.workunit.client.0.smithi138.stderr: -450> 2024-09-14T11:41:12.986+0000 7fdce3c279c0 5 AuthRegistry(0x5595989052a0) adding con mode: crc 2024-09-14T11:41:13.396 INFO:tasks.workunit.client.0.smithi138.stderr: -449> 2024-09-14T11:41:12.986+0000 7fdce3c279c0 5 AuthRegistry(0x5595989052a0) adding con mode: crc 2024-09-14T11:41:13.396 INFO:tasks.workunit.client.0.smithi138.stderr: -448> 2024-09-14T11:41:12.986+0000 7fdce3c279c0 5 AuthRegistry(0x5595989052a0) adding con mode: secure 2024-09-14T11:41:13.397 INFO:tasks.workunit.client.0.smithi138.stderr: -447> 2024-09-14T11:41:12.986+0000 7fdce3c279c0 5 AuthRegistry(0x5595989052a0) adding con mode: crc 2024-09-14T11:41:13.397 INFO:tasks.workunit.client.0.smithi138.stderr: -446> 2024-09-14T11:41:12.986+0000 7fdce3c279c0 5 AuthRegistry(0x5595989052a0) adding con mode: secure 2024-09-14T11:41:13.397 INFO:tasks.workunit.client.0.smithi138.stderr: -445> 2024-09-14T11:41:12.986+0000 7fdce3c279c0 5 AuthRegistry(0x5595989052a0) adding con mode: crc 2024-09-14T11:41:13.397 INFO:tasks.workunit.client.0.smithi138.stderr: -444> 2024-09-14T11:41:12.986+0000 7fdce3c279c0 5 AuthRegistry(0x5595989052a0) adding con mode: secure 2024-09-14T11:41:13.397 INFO:tasks.workunit.client.0.smithi138.stderr: -443> 2024-09-14T11:41:12.986+0000 7fdce3c279c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:41:13.397 INFO:tasks.workunit.client.0.smithi138.stderr: -442> 2024-09-14T11:41:12.986+0000 7fdce3c279c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:41:13.397 INFO:tasks.workunit.client.0.smithi138.stderr: -441> 2024-09-14T11:41:12.986+0000 7fdce3c279c0 5 asok(0x5595986f9d90) register_command rotate-key hook 0x5595989053e8 2024-09-14T11:41:13.397 INFO:tasks.workunit.client.0.smithi138.stderr: -440> 2024-09-14T11:41:12.986+0000 7fdce3c279c0 10 monclient: _reopen_session rank -1 2024-09-14T11:41:13.397 INFO:tasks.workunit.client.0.smithi138.stderr: -439> 2024-09-14T11:41:12.986+0000 7fdce3c279c0 10 monclient: _add_conns ranks=[1,2,0] 2024-09-14T11:41:13.397 INFO:tasks.workunit.client.0.smithi138.stderr: -438> 2024-09-14T11:41:12.986+0000 7fdce3c279c0 10 monclient(hunting): picked mon.noname-b con 0x5595987b4c70 addr [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] 2024-09-14T11:41:13.397 INFO:tasks.workunit.client.0.smithi138.stderr: -437> 2024-09-14T11:41:12.986+0000 7fdce3c279c0 10 monclient(hunting): picked mon.noname-c con 0x55959884d800 addr [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] 2024-09-14T11:41:13.397 INFO:tasks.workunit.client.0.smithi138.stderr: -436> 2024-09-14T11:41:12.986+0000 7fdce3c279c0 10 monclient(hunting): picked mon.noname-a con 0x55959890ba10 addr [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] 2024-09-14T11:41:13.397 INFO:tasks.workunit.client.0.smithi138.stderr: -435> 2024-09-14T11:41:12.986+0000 7fdce3c279c0 10 monclient(hunting): start opening mon connection 2024-09-14T11:41:13.397 INFO:tasks.workunit.client.0.smithi138.stderr: -434> 2024-09-14T11:41:12.986+0000 7fdce3c279c0 10 monclient(hunting): start opening mon connection 2024-09-14T11:41:13.397 INFO:tasks.workunit.client.0.smithi138.stderr: -433> 2024-09-14T11:41:12.986+0000 7fdce3c279c0 10 monclient(hunting): start opening mon connection 2024-09-14T11:41:13.398 INFO:tasks.workunit.client.0.smithi138.stderr: -432> 2024-09-14T11:41:12.986+0000 7fdce3c279c0 10 monclient(hunting): _renew_subs 2024-09-14T11:41:13.398 INFO:tasks.workunit.client.0.smithi138.stderr: -431> 2024-09-14T11:41:12.986+0000 7fdce3c279c0 10 monclient(hunting): authenticate will time out at 3008.950344s 2024-09-14T11:41:13.398 INFO:tasks.workunit.client.0.smithi138.stderr: -430> 2024-09-14T11:41:12.986+0000 7fdce0f2c640 10 monclient(hunting): get_auth_request con 0x55959884d800 auth_method 0 2024-09-14T11:41:13.398 INFO:tasks.workunit.client.0.smithi138.stderr: -429> 2024-09-14T11:41:12.986+0000 7fdce0f2c640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:41:13.398 INFO:tasks.workunit.client.0.smithi138.stderr: -428> 2024-09-14T11:41:12.986+0000 7fdce0f2c640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:41:13.398 INFO:tasks.workunit.client.0.smithi138.stderr: -427> 2024-09-14T11:41:12.986+0000 7fdce0f2c640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:41:13.398 INFO:tasks.workunit.client.0.smithi138.stderr: -426> 2024-09-14T11:41:12.986+0000 7fdce1f2e640 10 monclient(hunting): get_auth_request con 0x55959890ba10 auth_method 0 2024-09-14T11:41:13.398 INFO:tasks.workunit.client.0.smithi138.stderr: -425> 2024-09-14T11:41:12.986+0000 7fdce1f2e640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:41:13.398 INFO:tasks.workunit.client.0.smithi138.stderr: -424> 2024-09-14T11:41:12.986+0000 7fdce1f2e640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:41:13.398 INFO:tasks.workunit.client.0.smithi138.stderr: -423> 2024-09-14T11:41:12.986+0000 7fdce1f2e640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:41:13.398 INFO:tasks.workunit.client.0.smithi138.stderr: -422> 2024-09-14T11:41:12.986+0000 7fdce0f2c640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:41:13.398 INFO:tasks.workunit.client.0.smithi138.stderr: -421> 2024-09-14T11:41:12.986+0000 7fdce0f2c640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:41:13.398 INFO:tasks.workunit.client.0.smithi138.stderr: -420> 2024-09-14T11:41:12.986+0000 7fdce0f2c640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:41:13.398 INFO:tasks.workunit.client.0.smithi138.stderr: -419> 2024-09-14T11:41:12.986+0000 7fdce1f2e640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:41:13.398 INFO:tasks.workunit.client.0.smithi138.stderr: -418> 2024-09-14T11:41:12.986+0000 7fdce1f2e640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:41:13.399 INFO:tasks.workunit.client.0.smithi138.stderr: -417> 2024-09-14T11:41:12.986+0000 7fdce1f2e640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:41:13.399 INFO:tasks.workunit.client.0.smithi138.stderr: -416> 2024-09-14T11:41:12.986+0000 7fdce172d640 10 monclient(hunting): get_auth_request con 0x5595987b4c70 auth_method 0 2024-09-14T11:41:13.399 INFO:tasks.workunit.client.0.smithi138.stderr: -415> 2024-09-14T11:41:12.986+0000 7fdce172d640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:41:13.399 INFO:tasks.workunit.client.0.smithi138.stderr: -414> 2024-09-14T11:41:12.986+0000 7fdce172d640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:41:13.399 INFO:tasks.workunit.client.0.smithi138.stderr: -413> 2024-09-14T11:41:12.986+0000 7fdce172d640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:41:13.399 INFO:tasks.workunit.client.0.smithi138.stderr: -412> 2024-09-14T11:41:12.986+0000 7fdce0f2c640 10 monclient(hunting): handle_auth_done global_id 7706 payload 824 2024-09-14T11:41:13.399 INFO:tasks.workunit.client.0.smithi138.stderr: -411> 2024-09-14T11:41:12.986+0000 7fdce0f2c640 10 monclient: _finish_hunting 0 2024-09-14T11:41:13.399 INFO:tasks.workunit.client.0.smithi138.stderr: -410> 2024-09-14T11:41:12.986+0000 7fdce0f2c640 1 monclient: found mon.noname-c 2024-09-14T11:41:13.399 INFO:tasks.workunit.client.0.smithi138.stderr: -409> 2024-09-14T11:41:12.986+0000 7fdce0f2c640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.138:3301/0 2024-09-14T11:41:13.399 INFO:tasks.workunit.client.0.smithi138.stderr: -408> 2024-09-14T11:41:12.986+0000 7fdbcde03640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:41:13.399 INFO:tasks.workunit.client.0.smithi138.stderr: -407> 2024-09-14T11:41:12.986+0000 7fdbcde03640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-14T11:41:13.399 INFO:tasks.workunit.client.0.smithi138.stderr: -406> 2024-09-14T11:41:12.986+0000 7fdbcde03640 10 monclient: dump: 2024-09-14T11:41:13.399 INFO:tasks.workunit.client.0.smithi138.stderr:epoch 1 2024-09-14T11:41:13.399 INFO:tasks.workunit.client.0.smithi138.stderr:fsid 3f225f43-83a6-4aeb-b798-1f04bb49d597 2024-09-14T11:41:13.399 INFO:tasks.workunit.client.0.smithi138.stderr:last_changed 2024-09-14T11:07:09.252780+0000 2024-09-14T11:41:13.400 INFO:tasks.workunit.client.0.smithi138.stderr:created 2024-09-14T11:07:09.252780+0000 2024-09-14T11:41:13.400 INFO:tasks.workunit.client.0.smithi138.stderr:min_mon_release 19 (squid) 2024-09-14T11:41:13.400 INFO:tasks.workunit.client.0.smithi138.stderr:election_strategy: 1 2024-09-14T11:41:13.400 INFO:tasks.workunit.client.0.smithi138.stderr:0: [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] mon.a 2024-09-14T11:41:13.400 INFO:tasks.workunit.client.0.smithi138.stderr:1: [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] mon.b 2024-09-14T11:41:13.400 INFO:tasks.workunit.client.0.smithi138.stderr:2: [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] mon.c 2024-09-14T11:41:13.400 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-14T11:41:13.400 INFO:tasks.workunit.client.0.smithi138.stderr: -405> 2024-09-14T11:41:12.986+0000 7fdbcde03640 10 monclient: _finish_auth 0 2024-09-14T11:41:13.400 INFO:tasks.workunit.client.0.smithi138.stderr: -404> 2024-09-14T11:41:12.986+0000 7fdbcde03640 10 monclient: _check_auth_tickets 2024-09-14T11:41:13.400 INFO:tasks.workunit.client.0.smithi138.stderr: -403> 2024-09-14T11:41:12.986+0000 7fdce3c279c0 5 monclient: authenticate success, global_id 7706 2024-09-14T11:41:13.400 INFO:tasks.workunit.client.0.smithi138.stderr: -402> 2024-09-14T11:41:12.986+0000 7fdce3c279c0 10 monclient: _renew_subs 2024-09-14T11:41:13.400 INFO:tasks.workunit.client.0.smithi138.stderr: -401> 2024-09-14T11:41:12.986+0000 7fdce3c279c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.138:3301/0 2024-09-14T11:41:13.400 INFO:tasks.workunit.client.0.smithi138.stderr: -400> 2024-09-14T11:41:12.986+0000 7fdbcde03640 10 monclient: handle_config config(0 keys) 2024-09-14T11:41:13.400 INFO:tasks.workunit.client.0.smithi138.stderr: -399> 2024-09-14T11:41:12.986+0000 7fdbcde03640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:41:13.400 INFO:tasks.workunit.client.0.smithi138.stderr: -398> 2024-09-14T11:41:12.986+0000 7fdbcde03640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-14T11:41:13.401 INFO:tasks.workunit.client.0.smithi138.stderr: -397> 2024-09-14T11:41:12.986+0000 7fdbcde03640 10 monclient: dump: 2024-09-14T11:41:13.401 INFO:tasks.workunit.client.0.smithi138.stderr:epoch 1 2024-09-14T11:41:13.401 INFO:tasks.workunit.client.0.smithi138.stderr:fsid 3f225f43-83a6-4aeb-b798-1f04bb49d597 2024-09-14T11:41:13.401 INFO:tasks.workunit.client.0.smithi138.stderr:last_changed 2024-09-14T11:07:09.252780+0000 2024-09-14T11:41:13.401 INFO:tasks.workunit.client.0.smithi138.stderr:created 2024-09-14T11:07:09.252780+0000 2024-09-14T11:41:13.401 INFO:tasks.workunit.client.0.smithi138.stderr:min_mon_release 19 (squid) 2024-09-14T11:41:13.401 INFO:tasks.workunit.client.0.smithi138.stderr:election_strategy: 1 2024-09-14T11:41:13.401 INFO:tasks.workunit.client.0.smithi138.stderr:0: [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] mon.a 2024-09-14T11:41:13.401 INFO:tasks.workunit.client.0.smithi138.stderr:1: [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] mon.b 2024-09-14T11:41:13.401 INFO:tasks.workunit.client.0.smithi138.stderr:2: [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] mon.c 2024-09-14T11:41:13.401 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-14T11:41:13.401 INFO:tasks.workunit.client.0.smithi138.stderr: -396> 2024-09-14T11:41:12.986+0000 7fdbcf606640 4 set_mon_vals no callback set 2024-09-14T11:41:13.401 INFO:tasks.workunit.client.0.smithi138.stderr: -395> 2024-09-14T11:41:12.986+0000 7fdce3c279c0 10 monclient: _renew_subs 2024-09-14T11:41:13.401 INFO:tasks.workunit.client.0.smithi138.stderr: -394> 2024-09-14T11:41:12.986+0000 7fdce3c279c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.138:3301/0 2024-09-14T11:41:13.401 INFO:tasks.workunit.client.0.smithi138.stderr: -393> 2024-09-14T11:41:12.986+0000 7fdce3c279c0 1 librados: init done 2024-09-14T11:41:13.402 INFO:tasks.workunit.client.0.smithi138.stderr: -392> 2024-09-14T11:41:12.990+0000 7fdbcde03640 4 mgrc handle_mgr_map Got map version 5 2024-09-14T11:41:13.402 INFO:tasks.workunit.client.0.smithi138.stderr: -391> 2024-09-14T11:41:12.990+0000 7fdbcde03640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.138:6832/3778043143,v1:172.21.15.138:6833/3778043143] 2024-09-14T11:41:13.402 INFO:tasks.workunit.client.0.smithi138.stderr: -390> 2024-09-14T11:41:12.990+0000 7fdbcde03640 4 mgrc reconnect Starting new session with [v2:172.21.15.138:6832/3778043143,v1:172.21.15.138:6833/3778043143] 2024-09-14T11:41:13.402 INFO:tasks.workunit.client.0.smithi138.stderr: -389> 2024-09-14T11:41:12.990+0000 7fdce172d640 10 monclient: get_auth_request con 0x7fdbc8071a40 auth_method 0 2024-09-14T11:41:13.402 INFO:tasks.workunit.client.0.smithi138.stderr: -388> 2024-09-14T11:41:12.990+0000 7fdce1f2e640 10 monclient: get_auth_request con 0x55959892cf70 auth_method 0 2024-09-14T11:41:13.402 INFO:tasks.workunit.client.0.smithi138.stderr: -387> 2024-09-14T11:41:12.990+0000 7fdce172d640 10 monclient: get_auth_request con 0x5595989500e0 auth_method 0 2024-09-14T11:41:13.402 INFO:tasks.workunit.client.0.smithi138.stderr: -386> 2024-09-14T11:41:12.994+0000 7fdce0f2c640 10 monclient: get_auth_request con 0x559598954780 auth_method 0 2024-09-14T11:41:13.402 INFO:tasks.workunit.client.0.smithi138.stderr: -385> 2024-09-14T11:41:12.994+0000 7fdce1f2e640 10 monclient: get_auth_request con 0x559598953dd0 auth_method 0 2024-09-14T11:41:13.402 INFO:tasks.workunit.client.0.smithi138.stderr: -384> 2024-09-14T11:41:12.994+0000 7fdce3c279c0 10 monclient: build_initial_monmap 2024-09-14T11:41:13.402 INFO:tasks.workunit.client.0.smithi138.stderr: -383> 2024-09-14T11:41:12.994+0000 7fdce3c279c0 1 build_initial for_mkfs: 0 2024-09-14T11:41:13.402 INFO:tasks.workunit.client.0.smithi138.stderr: -382> 2024-09-14T11:41:12.994+0000 7fdce3c279c0 10 monclient: monmap: 2024-09-14T11:41:13.402 INFO:tasks.workunit.client.0.smithi138.stderr:epoch 0 2024-09-14T11:41:13.402 INFO:tasks.workunit.client.0.smithi138.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-14T11:41:13.402 INFO:tasks.workunit.client.0.smithi138.stderr:last_changed 0.000000 2024-09-14T11:41:13.403 INFO:tasks.workunit.client.0.smithi138.stderr:created 0.000000 2024-09-14T11:41:13.403 INFO:tasks.workunit.client.0.smithi138.stderr:min_mon_release 0 (unknown) 2024-09-14T11:41:13.403 INFO:tasks.workunit.client.0.smithi138.stderr:election_strategy: 1 2024-09-14T11:41:13.403 INFO:tasks.workunit.client.0.smithi138.stderr:0: [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] mon.noname-a 2024-09-14T11:41:13.403 INFO:tasks.workunit.client.0.smithi138.stderr:1: [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] mon.noname-b 2024-09-14T11:41:13.403 INFO:tasks.workunit.client.0.smithi138.stderr:2: [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] mon.noname-c 2024-09-14T11:41:13.403 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-14T11:41:13.403 INFO:tasks.workunit.client.0.smithi138.stderr: -381> 2024-09-14T11:41:12.994+0000 7fdce3c279c0 5 AuthRegistry(0x55959895c7e0) adding auth protocol: cephx 2024-09-14T11:41:13.403 INFO:tasks.workunit.client.0.smithi138.stderr: -380> 2024-09-14T11:41:12.994+0000 7fdce3c279c0 5 AuthRegistry(0x55959895c7e0) adding auth protocol: cephx 2024-09-14T11:41:13.403 INFO:tasks.workunit.client.0.smithi138.stderr: -379> 2024-09-14T11:41:12.994+0000 7fdce3c279c0 5 AuthRegistry(0x55959895c7e0) adding auth protocol: cephx 2024-09-14T11:41:13.403 INFO:tasks.workunit.client.0.smithi138.stderr: -378> 2024-09-14T11:41:12.994+0000 7fdce3c279c0 5 AuthRegistry(0x55959895c7e0) adding con mode: secure 2024-09-14T11:41:13.403 INFO:tasks.workunit.client.0.smithi138.stderr: -377> 2024-09-14T11:41:12.994+0000 7fdce3c279c0 5 AuthRegistry(0x55959895c7e0) adding con mode: crc 2024-09-14T11:41:13.403 INFO:tasks.workunit.client.0.smithi138.stderr: -376> 2024-09-14T11:41:12.994+0000 7fdce3c279c0 5 AuthRegistry(0x55959895c7e0) adding con mode: secure 2024-09-14T11:41:13.403 INFO:tasks.workunit.client.0.smithi138.stderr: -375> 2024-09-14T11:41:12.994+0000 7fdce3c279c0 5 AuthRegistry(0x55959895c7e0) adding con mode: crc 2024-09-14T11:41:13.403 INFO:tasks.workunit.client.0.smithi138.stderr: -374> 2024-09-14T11:41:12.994+0000 7fdce3c279c0 5 AuthRegistry(0x55959895c7e0) adding con mode: secure 2024-09-14T11:41:13.403 INFO:tasks.workunit.client.0.smithi138.stderr: -373> 2024-09-14T11:41:12.994+0000 7fdce3c279c0 5 AuthRegistry(0x55959895c7e0) adding con mode: crc 2024-09-14T11:41:13.404 INFO:tasks.workunit.client.0.smithi138.stderr: -372> 2024-09-14T11:41:12.994+0000 7fdce3c279c0 5 AuthRegistry(0x55959895c7e0) adding con mode: crc 2024-09-14T11:41:13.404 INFO:tasks.workunit.client.0.smithi138.stderr: -371> 2024-09-14T11:41:12.994+0000 7fdce3c279c0 5 AuthRegistry(0x55959895c7e0) adding con mode: secure 2024-09-14T11:41:13.404 INFO:tasks.workunit.client.0.smithi138.stderr: -370> 2024-09-14T11:41:12.994+0000 7fdce3c279c0 5 AuthRegistry(0x55959895c7e0) adding con mode: crc 2024-09-14T11:41:13.404 INFO:tasks.workunit.client.0.smithi138.stderr: -369> 2024-09-14T11:41:12.994+0000 7fdce3c279c0 5 AuthRegistry(0x55959895c7e0) adding con mode: secure 2024-09-14T11:41:13.404 INFO:tasks.workunit.client.0.smithi138.stderr: -368> 2024-09-14T11:41:12.994+0000 7fdce3c279c0 5 AuthRegistry(0x55959895c7e0) adding con mode: crc 2024-09-14T11:41:13.404 INFO:tasks.workunit.client.0.smithi138.stderr: -367> 2024-09-14T11:41:12.994+0000 7fdce3c279c0 5 AuthRegistry(0x55959895c7e0) adding con mode: secure 2024-09-14T11:41:13.404 INFO:tasks.workunit.client.0.smithi138.stderr: -366> 2024-09-14T11:41:12.994+0000 7fdce3c279c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:41:13.404 INFO:tasks.workunit.client.0.smithi138.stderr: -365> 2024-09-14T11:41:12.994+0000 7fdce3c279c0 5 asok(0x5595986f9d90) register_command objecter_requests cmddesc objecter_requests hook 0x5595989601d0 EEXIST 2024-09-14T11:41:13.404 INFO:tasks.workunit.client.0.smithi138.stderr: -364> 2024-09-14T11:41:12.994+0000 7fdce3c279c0 10 monclient: init 2024-09-14T11:41:13.404 INFO:tasks.workunit.client.0.smithi138.stderr: -363> 2024-09-14T11:41:12.994+0000 7fdce3c279c0 5 AuthRegistry(0x55959895b6d8) adding auth protocol: cephx 2024-09-14T11:41:13.404 INFO:tasks.workunit.client.0.smithi138.stderr: -362> 2024-09-14T11:41:12.994+0000 7fdce3c279c0 5 AuthRegistry(0x55959895b6d8) adding auth protocol: cephx 2024-09-14T11:41:13.404 INFO:tasks.workunit.client.0.smithi138.stderr: -361> 2024-09-14T11:41:12.994+0000 7fdce3c279c0 5 AuthRegistry(0x55959895b6d8) adding auth protocol: cephx 2024-09-14T11:41:13.404 INFO:tasks.workunit.client.0.smithi138.stderr: -360> 2024-09-14T11:41:12.994+0000 7fdce3c279c0 5 AuthRegistry(0x55959895b6d8) adding con mode: secure 2024-09-14T11:41:13.404 INFO:tasks.workunit.client.0.smithi138.stderr: -359> 2024-09-14T11:41:12.994+0000 7fdce3c279c0 5 AuthRegistry(0x55959895b6d8) adding con mode: crc 2024-09-14T11:41:13.404 INFO:tasks.workunit.client.0.smithi138.stderr: -358> 2024-09-14T11:41:12.994+0000 7fdce3c279c0 5 AuthRegistry(0x55959895b6d8) adding con mode: secure 2024-09-14T11:41:13.405 INFO:tasks.workunit.client.0.smithi138.stderr: -357> 2024-09-14T11:41:12.994+0000 7fdce3c279c0 5 AuthRegistry(0x55959895b6d8) adding con mode: crc 2024-09-14T11:41:13.405 INFO:tasks.workunit.client.0.smithi138.stderr: -356> 2024-09-14T11:41:12.994+0000 7fdce3c279c0 5 AuthRegistry(0x55959895b6d8) adding con mode: secure 2024-09-14T11:41:13.405 INFO:tasks.workunit.client.0.smithi138.stderr: -355> 2024-09-14T11:41:12.994+0000 7fdce3c279c0 5 AuthRegistry(0x55959895b6d8) adding con mode: crc 2024-09-14T11:41:13.405 INFO:tasks.workunit.client.0.smithi138.stderr: -354> 2024-09-14T11:41:12.994+0000 7fdce3c279c0 5 AuthRegistry(0x55959895b6d8) adding con mode: crc 2024-09-14T11:41:13.405 INFO:tasks.workunit.client.0.smithi138.stderr: -353> 2024-09-14T11:41:12.994+0000 7fdce3c279c0 5 AuthRegistry(0x55959895b6d8) adding con mode: secure 2024-09-14T11:41:13.405 INFO:tasks.workunit.client.0.smithi138.stderr: -352> 2024-09-14T11:41:12.994+0000 7fdce3c279c0 5 AuthRegistry(0x55959895b6d8) adding con mode: crc 2024-09-14T11:41:13.405 INFO:tasks.workunit.client.0.smithi138.stderr: -351> 2024-09-14T11:41:12.994+0000 7fdce3c279c0 5 AuthRegistry(0x55959895b6d8) adding con mode: secure 2024-09-14T11:41:13.405 INFO:tasks.workunit.client.0.smithi138.stderr: -350> 2024-09-14T11:41:12.994+0000 7fdce3c279c0 5 AuthRegistry(0x55959895b6d8) adding con mode: crc 2024-09-14T11:41:13.405 INFO:tasks.workunit.client.0.smithi138.stderr: -349> 2024-09-14T11:41:12.994+0000 7fdce3c279c0 5 AuthRegistry(0x55959895b6d8) adding con mode: secure 2024-09-14T11:41:13.405 INFO:tasks.workunit.client.0.smithi138.stderr: -348> 2024-09-14T11:41:12.998+0000 7fdce3c279c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:41:13.405 INFO:tasks.workunit.client.0.smithi138.stderr: -347> 2024-09-14T11:41:12.998+0000 7fdce3c279c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:41:13.405 INFO:tasks.workunit.client.0.smithi138.stderr: -346> 2024-09-14T11:41:12.998+0000 7fdce3c279c0 5 asok(0x5595986f9d90) register_command rotate-key cmddesc rotate-key hook 0x55959895b820 EEXIST 2024-09-14T11:41:13.405 INFO:tasks.workunit.client.0.smithi138.stderr: -345> 2024-09-14T11:41:12.998+0000 7fdce3c279c0 10 monclient: _reopen_session rank -1 2024-09-14T11:41:13.406 INFO:tasks.workunit.client.0.smithi138.stderr: -344> 2024-09-14T11:41:12.998+0000 7fdce3c279c0 10 monclient: _add_conns ranks=[2,0,1] 2024-09-14T11:41:13.406 INFO:tasks.workunit.client.0.smithi138.stderr: -343> 2024-09-14T11:41:12.998+0000 7fdce3c279c0 10 monclient(hunting): picked mon.noname-c con 0x559598984380 addr [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] 2024-09-14T11:41:13.406 INFO:tasks.workunit.client.0.smithi138.stderr: -342> 2024-09-14T11:41:12.998+0000 7fdce3c279c0 10 monclient(hunting): picked mon.noname-a con 0x559598983cb0 addr [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] 2024-09-14T11:41:13.406 INFO:tasks.workunit.client.0.smithi138.stderr: -341> 2024-09-14T11:41:12.998+0000 7fdce3c279c0 10 monclient(hunting): picked mon.noname-b con 0x559598982690 addr [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] 2024-09-14T11:41:13.406 INFO:tasks.workunit.client.0.smithi138.stderr: -340> 2024-09-14T11:41:12.998+0000 7fdce3c279c0 10 monclient(hunting): start opening mon connection 2024-09-14T11:41:13.406 INFO:tasks.workunit.client.0.smithi138.stderr: -339> 2024-09-14T11:41:12.998+0000 7fdce3c279c0 10 monclient(hunting): start opening mon connection 2024-09-14T11:41:13.406 INFO:tasks.workunit.client.0.smithi138.stderr: -338> 2024-09-14T11:41:12.998+0000 7fdce3c279c0 10 monclient(hunting): start opening mon connection 2024-09-14T11:41:13.406 INFO:tasks.workunit.client.0.smithi138.stderr: -337> 2024-09-14T11:41:12.998+0000 7fdce3c279c0 10 monclient(hunting): _renew_subs 2024-09-14T11:41:13.406 INFO:tasks.workunit.client.0.smithi138.stderr: -336> 2024-09-14T11:41:12.998+0000 7fdce3c279c0 10 monclient(hunting): authenticate will time out at 3008.960512s 2024-09-14T11:41:13.406 INFO:tasks.workunit.client.0.smithi138.stderr: -335> 2024-09-14T11:41:12.998+0000 7fdce0f2c640 10 monclient(hunting): get_auth_request con 0x559598984380 auth_method 0 2024-09-14T11:41:13.406 INFO:tasks.workunit.client.0.smithi138.stderr: -334> 2024-09-14T11:41:12.998+0000 7fdce0f2c640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:41:13.406 INFO:tasks.workunit.client.0.smithi138.stderr: -333> 2024-09-14T11:41:12.998+0000 7fdce0f2c640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:41:13.406 INFO:tasks.workunit.client.0.smithi138.stderr: -332> 2024-09-14T11:41:12.998+0000 7fdce0f2c640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:41:13.406 INFO:tasks.workunit.client.0.smithi138.stderr: -331> 2024-09-14T11:41:12.998+0000 7fdce1f2e640 10 monclient(hunting): get_auth_request con 0x559598983cb0 auth_method 0 2024-09-14T11:41:13.407 INFO:tasks.workunit.client.0.smithi138.stderr: -330> 2024-09-14T11:41:12.998+0000 7fdce1f2e640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:41:13.407 INFO:tasks.workunit.client.0.smithi138.stderr: -329> 2024-09-14T11:41:12.998+0000 7fdce1f2e640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:41:13.407 INFO:tasks.workunit.client.0.smithi138.stderr: -328> 2024-09-14T11:41:12.998+0000 7fdce1f2e640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:41:13.407 INFO:tasks.workunit.client.0.smithi138.stderr: -327> 2024-09-14T11:41:12.998+0000 7fdce0f2c640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:41:13.407 INFO:tasks.workunit.client.0.smithi138.stderr: -326> 2024-09-14T11:41:12.998+0000 7fdce0f2c640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:41:13.407 INFO:tasks.workunit.client.0.smithi138.stderr: -325> 2024-09-14T11:41:12.998+0000 7fdce0f2c640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:41:13.407 INFO:tasks.workunit.client.0.smithi138.stderr: -324> 2024-09-14T11:41:12.998+0000 7fdce1f2e640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:41:13.407 INFO:tasks.workunit.client.0.smithi138.stderr: -323> 2024-09-14T11:41:12.998+0000 7fdce1f2e640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:41:13.407 INFO:tasks.workunit.client.0.smithi138.stderr: -322> 2024-09-14T11:41:12.998+0000 7fdce1f2e640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:41:13.407 INFO:tasks.workunit.client.0.smithi138.stderr: -321> 2024-09-14T11:41:12.998+0000 7fdce0f2c640 10 monclient(hunting): handle_auth_done global_id 7709 payload 824 2024-09-14T11:41:13.407 INFO:tasks.workunit.client.0.smithi138.stderr: -320> 2024-09-14T11:41:12.998+0000 7fdce0f2c640 10 monclient: _finish_hunting 0 2024-09-14T11:41:13.407 INFO:tasks.workunit.client.0.smithi138.stderr: -319> 2024-09-14T11:41:12.998+0000 7fdce0f2c640 1 monclient: found mon.noname-c 2024-09-14T11:41:13.407 INFO:tasks.workunit.client.0.smithi138.stderr: -318> 2024-09-14T11:41:12.998+0000 7fdce0f2c640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.138:3301/0 2024-09-14T11:41:13.407 INFO:tasks.workunit.client.0.smithi138.stderr: -317> 2024-09-14T11:41:12.998+0000 7fdbc6ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:41:13.407 INFO:tasks.workunit.client.0.smithi138.stderr: -316> 2024-09-14T11:41:12.998+0000 7fdbc6ffd640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-14T11:41:13.408 INFO:tasks.workunit.client.0.smithi138.stderr: -315> 2024-09-14T11:41:12.998+0000 7fdbc6ffd640 10 monclient: dump: 2024-09-14T11:41:13.408 INFO:tasks.workunit.client.0.smithi138.stderr:epoch 1 2024-09-14T11:41:13.408 INFO:tasks.workunit.client.0.smithi138.stderr:fsid 3f225f43-83a6-4aeb-b798-1f04bb49d597 2024-09-14T11:41:13.408 INFO:tasks.workunit.client.0.smithi138.stderr:last_changed 2024-09-14T11:07:09.252780+0000 2024-09-14T11:41:13.408 INFO:tasks.workunit.client.0.smithi138.stderr:created 2024-09-14T11:07:09.252780+0000 2024-09-14T11:41:13.408 INFO:tasks.workunit.client.0.smithi138.stderr:min_mon_release 19 (squid) 2024-09-14T11:41:13.408 INFO:tasks.workunit.client.0.smithi138.stderr:election_strategy: 1 2024-09-14T11:41:13.408 INFO:tasks.workunit.client.0.smithi138.stderr:0: [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] mon.a 2024-09-14T11:41:13.408 INFO:tasks.workunit.client.0.smithi138.stderr:1: [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] mon.b 2024-09-14T11:41:13.408 INFO:tasks.workunit.client.0.smithi138.stderr:2: [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] mon.c 2024-09-14T11:41:13.408 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-14T11:41:13.408 INFO:tasks.workunit.client.0.smithi138.stderr: -314> 2024-09-14T11:41:12.998+0000 7fdbc6ffd640 10 monclient: _finish_auth 0 2024-09-14T11:41:13.408 INFO:tasks.workunit.client.0.smithi138.stderr: -313> 2024-09-14T11:41:12.998+0000 7fdbc6ffd640 10 monclient: _check_auth_tickets 2024-09-14T11:41:13.409 INFO:tasks.workunit.client.0.smithi138.stderr: -312> 2024-09-14T11:41:12.998+0000 7fdbc6ffd640 10 monclient: handle_config config(0 keys) 2024-09-14T11:41:13.409 INFO:tasks.workunit.client.0.smithi138.stderr: -311> 2024-09-14T11:41:12.998+0000 7fdbc6ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:41:13.409 INFO:tasks.workunit.client.0.smithi138.stderr: -310> 2024-09-14T11:41:12.998+0000 7fdbc6ffd640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-14T11:41:13.409 INFO:tasks.workunit.client.0.smithi138.stderr: -309> 2024-09-14T11:41:12.998+0000 7fdbc6ffd640 10 monclient: dump: 2024-09-14T11:41:13.409 INFO:tasks.workunit.client.0.smithi138.stderr:epoch 1 2024-09-14T11:41:13.409 INFO:tasks.workunit.client.0.smithi138.stderr:fsid 3f225f43-83a6-4aeb-b798-1f04bb49d597 2024-09-14T11:41:13.409 INFO:tasks.workunit.client.0.smithi138.stderr:last_changed 2024-09-14T11:07:09.252780+0000 2024-09-14T11:41:13.409 INFO:tasks.workunit.client.0.smithi138.stderr:created 2024-09-14T11:07:09.252780+0000 2024-09-14T11:41:13.409 INFO:tasks.workunit.client.0.smithi138.stderr:min_mon_release 19 (squid) 2024-09-14T11:41:13.409 INFO:tasks.workunit.client.0.smithi138.stderr:election_strategy: 1 2024-09-14T11:41:13.409 INFO:tasks.workunit.client.0.smithi138.stderr:0: [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] mon.a 2024-09-14T11:41:13.409 INFO:tasks.workunit.client.0.smithi138.stderr:1: [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] mon.b 2024-09-14T11:41:13.409 INFO:tasks.workunit.client.0.smithi138.stderr:2: [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] mon.c 2024-09-14T11:41:13.409 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-14T11:41:13.409 INFO:tasks.workunit.client.0.smithi138.stderr: -308> 2024-09-14T11:41:12.998+0000 7fdce272f640 4 set_mon_vals no callback set 2024-09-14T11:41:13.410 INFO:tasks.workunit.client.0.smithi138.stderr: -307> 2024-09-14T11:41:12.998+0000 7fdce3c279c0 5 monclient: authenticate success, global_id 7709 2024-09-14T11:41:13.410 INFO:tasks.workunit.client.0.smithi138.stderr: -306> 2024-09-14T11:41:12.998+0000 7fdce3c279c0 10 monclient: _renew_subs 2024-09-14T11:41:13.410 INFO:tasks.workunit.client.0.smithi138.stderr: -305> 2024-09-14T11:41:12.998+0000 7fdce3c279c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.138:3301/0 2024-09-14T11:41:13.410 INFO:tasks.workunit.client.0.smithi138.stderr: -304> 2024-09-14T11:41:12.998+0000 7fdce3c279c0 10 monclient: _renew_subs 2024-09-14T11:41:13.410 INFO:tasks.workunit.client.0.smithi138.stderr: -303> 2024-09-14T11:41:12.998+0000 7fdce3c279c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.138:3301/0 2024-09-14T11:41:13.410 INFO:tasks.workunit.client.0.smithi138.stderr: -302> 2024-09-14T11:41:12.998+0000 7fdbc6ffd640 4 mgrc handle_mgr_map Got map version 5 2024-09-14T11:41:13.410 INFO:tasks.workunit.client.0.smithi138.stderr: -301> 2024-09-14T11:41:12.998+0000 7fdbc6ffd640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.138:6832/3778043143,v1:172.21.15.138:6833/3778043143] 2024-09-14T11:41:13.410 INFO:tasks.workunit.client.0.smithi138.stderr: -300> 2024-09-14T11:41:12.998+0000 7fdbc6ffd640 4 mgrc reconnect Starting new session with [v2:172.21.15.138:6832/3778043143,v1:172.21.15.138:6833/3778043143] 2024-09-14T11:41:13.410 INFO:tasks.workunit.client.0.smithi138.stderr: -299> 2024-09-14T11:41:12.998+0000 7fdce1f2e640 10 monclient: get_auth_request con 0x7fdbb80717e0 auth_method 0 2024-09-14T11:41:13.410 INFO:tasks.workunit.client.0.smithi138.stderr: -298> 2024-09-14T11:41:12.998+0000 7fdce3c279c0 10 monclient: get_monmap_and_config 2024-09-14T11:41:13.410 INFO:tasks.workunit.client.0.smithi138.stderr: -297> 2024-09-14T11:41:12.998+0000 7fdce3c279c0 10 monclient: build_initial_monmap 2024-09-14T11:41:13.410 INFO:tasks.workunit.client.0.smithi138.stderr: -296> 2024-09-14T11:41:12.998+0000 7fdce3c279c0 1 build_initial for_mkfs: 0 2024-09-14T11:41:13.410 INFO:tasks.workunit.client.0.smithi138.stderr: -295> 2024-09-14T11:41:12.998+0000 7fdce3c279c0 10 monclient: monmap: 2024-09-14T11:41:13.410 INFO:tasks.workunit.client.0.smithi138.stderr:epoch 0 2024-09-14T11:41:13.411 INFO:tasks.workunit.client.0.smithi138.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-14T11:41:13.411 INFO:tasks.workunit.client.0.smithi138.stderr:last_changed 0.000000 2024-09-14T11:41:13.411 INFO:tasks.workunit.client.0.smithi138.stderr:created 0.000000 2024-09-14T11:41:13.411 INFO:tasks.workunit.client.0.smithi138.stderr:min_mon_release 0 (unknown) 2024-09-14T11:41:13.411 INFO:tasks.workunit.client.0.smithi138.stderr:election_strategy: 1 2024-09-14T11:41:13.411 INFO:tasks.workunit.client.0.smithi138.stderr:0: [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] mon.noname-a 2024-09-14T11:41:13.411 INFO:tasks.workunit.client.0.smithi138.stderr:1: [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] mon.noname-b 2024-09-14T11:41:13.411 INFO:tasks.workunit.client.0.smithi138.stderr:2: [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] mon.noname-c 2024-09-14T11:41:13.411 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-14T11:41:13.411 INFO:tasks.workunit.client.0.smithi138.stderr: -294> 2024-09-14T11:41:12.998+0000 7fdce3c279c0 5 AuthRegistry(0x5595989a3c30) adding auth protocol: cephx 2024-09-14T11:41:13.411 INFO:tasks.workunit.client.0.smithi138.stderr: -293> 2024-09-14T11:41:12.998+0000 7fdce3c279c0 5 AuthRegistry(0x5595989a3c30) adding auth protocol: cephx 2024-09-14T11:41:13.411 INFO:tasks.workunit.client.0.smithi138.stderr: -292> 2024-09-14T11:41:12.998+0000 7fdce3c279c0 5 AuthRegistry(0x5595989a3c30) adding auth protocol: cephx 2024-09-14T11:41:13.411 INFO:tasks.workunit.client.0.smithi138.stderr: -291> 2024-09-14T11:41:12.998+0000 7fdce3c279c0 5 AuthRegistry(0x5595989a3c30) adding con mode: secure 2024-09-14T11:41:13.411 INFO:tasks.workunit.client.0.smithi138.stderr: -290> 2024-09-14T11:41:12.998+0000 7fdce3c279c0 5 AuthRegistry(0x5595989a3c30) adding con mode: crc 2024-09-14T11:41:13.412 INFO:tasks.workunit.client.0.smithi138.stderr: -289> 2024-09-14T11:41:12.998+0000 7fdce3c279c0 5 AuthRegistry(0x5595989a3c30) adding con mode: secure 2024-09-14T11:41:13.412 INFO:tasks.workunit.client.0.smithi138.stderr: -288> 2024-09-14T11:41:12.998+0000 7fdce3c279c0 5 AuthRegistry(0x5595989a3c30) adding con mode: crc 2024-09-14T11:41:13.412 INFO:tasks.workunit.client.0.smithi138.stderr: -287> 2024-09-14T11:41:12.998+0000 7fdce3c279c0 5 AuthRegistry(0x5595989a3c30) adding con mode: secure 2024-09-14T11:41:13.412 INFO:tasks.workunit.client.0.smithi138.stderr: -286> 2024-09-14T11:41:12.998+0000 7fdce3c279c0 5 AuthRegistry(0x5595989a3c30) adding con mode: crc 2024-09-14T11:41:13.412 INFO:tasks.workunit.client.0.smithi138.stderr: -285> 2024-09-14T11:41:12.998+0000 7fdce3c279c0 5 AuthRegistry(0x5595989a3c30) adding con mode: crc 2024-09-14T11:41:13.412 INFO:tasks.workunit.client.0.smithi138.stderr: -284> 2024-09-14T11:41:12.998+0000 7fdce3c279c0 5 AuthRegistry(0x5595989a3c30) adding con mode: secure 2024-09-14T11:41:13.412 INFO:tasks.workunit.client.0.smithi138.stderr: -283> 2024-09-14T11:41:12.998+0000 7fdce3c279c0 5 AuthRegistry(0x5595989a3c30) adding con mode: crc 2024-09-14T11:41:13.412 INFO:tasks.workunit.client.0.smithi138.stderr: -282> 2024-09-14T11:41:12.998+0000 7fdce3c279c0 5 AuthRegistry(0x5595989a3c30) adding con mode: secure 2024-09-14T11:41:13.412 INFO:tasks.workunit.client.0.smithi138.stderr: -281> 2024-09-14T11:41:12.998+0000 7fdce3c279c0 5 AuthRegistry(0x5595989a3c30) adding con mode: crc 2024-09-14T11:41:13.412 INFO:tasks.workunit.client.0.smithi138.stderr: -280> 2024-09-14T11:41:12.998+0000 7fdce3c279c0 5 AuthRegistry(0x5595989a3c30) adding con mode: secure 2024-09-14T11:41:13.412 INFO:tasks.workunit.client.0.smithi138.stderr: -279> 2024-09-14T11:41:12.998+0000 7fdce3c279c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:41:13.412 INFO:tasks.workunit.client.0.smithi138.stderr: -278> 2024-09-14T11:41:12.998+0000 7fdce3c279c0 10 monclient: init 2024-09-14T11:41:13.412 INFO:tasks.workunit.client.0.smithi138.stderr: -277> 2024-09-14T11:41:12.998+0000 7fdce3c279c0 5 AuthRegistry(0x7ffdf80599a0) adding auth protocol: cephx 2024-09-14T11:41:13.412 INFO:tasks.workunit.client.0.smithi138.stderr: -276> 2024-09-14T11:41:12.998+0000 7fdce3c279c0 5 AuthRegistry(0x7ffdf80599a0) adding auth protocol: cephx 2024-09-14T11:41:13.412 INFO:tasks.workunit.client.0.smithi138.stderr: -275> 2024-09-14T11:41:12.998+0000 7fdce3c279c0 5 AuthRegistry(0x7ffdf80599a0) adding auth protocol: cephx 2024-09-14T11:41:13.413 INFO:tasks.workunit.client.0.smithi138.stderr: -274> 2024-09-14T11:41:12.998+0000 7fdce3c279c0 5 AuthRegistry(0x7ffdf80599a0) adding con mode: secure 2024-09-14T11:41:13.413 INFO:tasks.workunit.client.0.smithi138.stderr: -273> 2024-09-14T11:41:12.998+0000 7fdce3c279c0 5 AuthRegistry(0x7ffdf80599a0) adding con mode: crc 2024-09-14T11:41:13.413 INFO:tasks.workunit.client.0.smithi138.stderr: -272> 2024-09-14T11:41:12.998+0000 7fdce3c279c0 5 AuthRegistry(0x7ffdf80599a0) adding con mode: secure 2024-09-14T11:41:13.413 INFO:tasks.workunit.client.0.smithi138.stderr: -271> 2024-09-14T11:41:12.998+0000 7fdce3c279c0 5 AuthRegistry(0x7ffdf80599a0) adding con mode: crc 2024-09-14T11:41:13.413 INFO:tasks.workunit.client.0.smithi138.stderr: -270> 2024-09-14T11:41:12.998+0000 7fdce3c279c0 5 AuthRegistry(0x7ffdf80599a0) adding con mode: secure 2024-09-14T11:41:13.413 INFO:tasks.workunit.client.0.smithi138.stderr: -269> 2024-09-14T11:41:12.998+0000 7fdce3c279c0 5 AuthRegistry(0x7ffdf80599a0) adding con mode: crc 2024-09-14T11:41:13.413 INFO:tasks.workunit.client.0.smithi138.stderr: -268> 2024-09-14T11:41:12.998+0000 7fdce3c279c0 5 AuthRegistry(0x7ffdf80599a0) adding con mode: crc 2024-09-14T11:41:13.413 INFO:tasks.workunit.client.0.smithi138.stderr: -267> 2024-09-14T11:41:12.998+0000 7fdce3c279c0 5 AuthRegistry(0x7ffdf80599a0) adding con mode: secure 2024-09-14T11:41:13.413 INFO:tasks.workunit.client.0.smithi138.stderr: -266> 2024-09-14T11:41:12.998+0000 7fdce3c279c0 5 AuthRegistry(0x7ffdf80599a0) adding con mode: crc 2024-09-14T11:41:13.413 INFO:tasks.workunit.client.0.smithi138.stderr: -265> 2024-09-14T11:41:12.998+0000 7fdce3c279c0 5 AuthRegistry(0x7ffdf80599a0) adding con mode: secure 2024-09-14T11:41:13.413 INFO:tasks.workunit.client.0.smithi138.stderr: -264> 2024-09-14T11:41:12.998+0000 7fdce3c279c0 5 AuthRegistry(0x7ffdf80599a0) adding con mode: crc 2024-09-14T11:41:13.413 INFO:tasks.workunit.client.0.smithi138.stderr: -263> 2024-09-14T11:41:12.998+0000 7fdce3c279c0 5 AuthRegistry(0x7ffdf80599a0) adding con mode: secure 2024-09-14T11:41:13.413 INFO:tasks.workunit.client.0.smithi138.stderr: -262> 2024-09-14T11:41:13.002+0000 7fdce3c279c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:41:13.413 INFO:tasks.workunit.client.0.smithi138.stderr: -261> 2024-09-14T11:41:13.002+0000 7fdce3c279c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:41:13.413 INFO:tasks.workunit.client.0.smithi138.stderr: -260> 2024-09-14T11:41:13.002+0000 7fdce3c279c0 5 asok(0x5595986f9d90) register_command rotate-key cmddesc rotate-key hook 0x7ffdf8059ae8 EEXIST 2024-09-14T11:41:13.414 INFO:tasks.workunit.client.0.smithi138.stderr: -259> 2024-09-14T11:41:13.002+0000 7fdce3c279c0 10 monclient: _reopen_session rank -1 2024-09-14T11:41:13.414 INFO:tasks.workunit.client.0.smithi138.stderr: -258> 2024-09-14T11:41:13.002+0000 7fdce3c279c0 10 monclient: _add_conns ranks=[0,2,1] 2024-09-14T11:41:13.414 INFO:tasks.workunit.client.0.smithi138.stderr: -257> 2024-09-14T11:41:13.002+0000 7fdce3c279c0 10 monclient(hunting): picked mon.noname-a con 0x5595989d8140 addr [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] 2024-09-14T11:41:13.414 INFO:tasks.workunit.client.0.smithi138.stderr: -256> 2024-09-14T11:41:13.002+0000 7fdce3c279c0 10 monclient(hunting): picked mon.noname-c con 0x5595989d2330 addr [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] 2024-09-14T11:41:13.414 INFO:tasks.workunit.client.0.smithi138.stderr: -255> 2024-09-14T11:41:13.002+0000 7fdce3c279c0 10 monclient(hunting): picked mon.noname-b con 0x5595989d3560 addr [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] 2024-09-14T11:41:13.414 INFO:tasks.workunit.client.0.smithi138.stderr: -254> 2024-09-14T11:41:13.002+0000 7fdce3c279c0 10 monclient(hunting): start opening mon connection 2024-09-14T11:41:13.414 INFO:tasks.workunit.client.0.smithi138.stderr: -253> 2024-09-14T11:41:13.002+0000 7fdce3c279c0 10 monclient(hunting): start opening mon connection 2024-09-14T11:41:13.414 INFO:tasks.workunit.client.0.smithi138.stderr: -252> 2024-09-14T11:41:13.002+0000 7fdce3c279c0 10 monclient(hunting): start opening mon connection 2024-09-14T11:41:13.414 INFO:tasks.workunit.client.0.smithi138.stderr: -251> 2024-09-14T11:41:13.002+0000 7fdce3c279c0 10 monclient(hunting): _renew_subs 2024-09-14T11:41:13.414 INFO:tasks.workunit.client.0.smithi138.stderr: -250> 2024-09-14T11:41:13.002+0000 7fdce3c279c0 10 monclient(hunting): authenticate will time out at 3008.964484s 2024-09-14T11:41:13.414 INFO:tasks.workunit.client.0.smithi138.stderr: -249> 2024-09-14T11:41:13.002+0000 7fdce1f2e640 10 monclient(hunting): get_auth_request con 0x5595989d2330 auth_method 0 2024-09-14T11:41:13.414 INFO:tasks.workunit.client.0.smithi138.stderr: -248> 2024-09-14T11:41:13.002+0000 7fdce1f2e640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:41:13.414 INFO:tasks.workunit.client.0.smithi138.stderr: -247> 2024-09-14T11:41:13.002+0000 7fdce1f2e640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:41:13.414 INFO:tasks.workunit.client.0.smithi138.stderr: -246> 2024-09-14T11:41:13.002+0000 7fdce1f2e640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:41:13.415 INFO:tasks.workunit.client.0.smithi138.stderr: -245> 2024-09-14T11:41:13.002+0000 7fdce0f2c640 10 monclient(hunting): get_auth_request con 0x5595989d8140 auth_method 0 2024-09-14T11:41:13.415 INFO:tasks.workunit.client.0.smithi138.stderr: -244> 2024-09-14T11:41:13.002+0000 7fdce0f2c640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:41:13.415 INFO:tasks.workunit.client.0.smithi138.stderr: -243> 2024-09-14T11:41:13.002+0000 7fdce0f2c640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:41:13.415 INFO:tasks.workunit.client.0.smithi138.stderr: -242> 2024-09-14T11:41:13.002+0000 7fdce0f2c640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:41:13.415 INFO:tasks.workunit.client.0.smithi138.stderr: -241> 2024-09-14T11:41:13.002+0000 7fdce1f2e640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:41:13.415 INFO:tasks.workunit.client.0.smithi138.stderr: -240> 2024-09-14T11:41:13.002+0000 7fdce1f2e640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:41:13.415 INFO:tasks.workunit.client.0.smithi138.stderr: -239> 2024-09-14T11:41:13.002+0000 7fdce1f2e640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:41:13.415 INFO:tasks.workunit.client.0.smithi138.stderr: -238> 2024-09-14T11:41:13.002+0000 7fdce0f2c640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:41:13.415 INFO:tasks.workunit.client.0.smithi138.stderr: -237> 2024-09-14T11:41:13.002+0000 7fdce0f2c640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:41:13.415 INFO:tasks.workunit.client.0.smithi138.stderr: -236> 2024-09-14T11:41:13.002+0000 7fdce0f2c640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:41:13.415 INFO:tasks.workunit.client.0.smithi138.stderr: -235> 2024-09-14T11:41:13.002+0000 7fdce0f2c640 10 monclient(hunting): handle_auth_done global_id 8256 payload 274 2024-09-14T11:41:13.415 INFO:tasks.workunit.client.0.smithi138.stderr: -234> 2024-09-14T11:41:13.002+0000 7fdce0f2c640 10 monclient: _finish_hunting 0 2024-09-14T11:41:13.415 INFO:tasks.workunit.client.0.smithi138.stderr: -233> 2024-09-14T11:41:13.002+0000 7fdce0f2c640 1 monclient: found mon.noname-a 2024-09-14T11:41:13.415 INFO:tasks.workunit.client.0.smithi138.stderr: -232> 2024-09-14T11:41:13.002+0000 7fdce0f2c640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.138:3300/0 2024-09-14T11:41:13.415 INFO:tasks.workunit.client.0.smithi138.stderr: -231> 2024-09-14T11:41:13.002+0000 7fdbc4ff9640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:41:13.415 INFO:tasks.workunit.client.0.smithi138.stderr: -230> 2024-09-14T11:41:13.002+0000 7fdbc4ff9640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-14T11:41:13.416 INFO:tasks.workunit.client.0.smithi138.stderr: -229> 2024-09-14T11:41:13.002+0000 7fdbc4ff9640 10 monclient: dump: 2024-09-14T11:41:13.416 INFO:tasks.workunit.client.0.smithi138.stderr:epoch 1 2024-09-14T11:41:13.416 INFO:tasks.workunit.client.0.smithi138.stderr:fsid 3f225f43-83a6-4aeb-b798-1f04bb49d597 2024-09-14T11:41:13.416 INFO:tasks.workunit.client.0.smithi138.stderr:last_changed 2024-09-14T11:07:09.252780+0000 2024-09-14T11:41:13.416 INFO:tasks.workunit.client.0.smithi138.stderr:created 2024-09-14T11:07:09.252780+0000 2024-09-14T11:41:13.416 INFO:tasks.workunit.client.0.smithi138.stderr:min_mon_release 19 (squid) 2024-09-14T11:41:13.416 INFO:tasks.workunit.client.0.smithi138.stderr:election_strategy: 1 2024-09-14T11:41:13.416 INFO:tasks.workunit.client.0.smithi138.stderr:0: [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] mon.a 2024-09-14T11:41:13.416 INFO:tasks.workunit.client.0.smithi138.stderr:1: [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] mon.b 2024-09-14T11:41:13.416 INFO:tasks.workunit.client.0.smithi138.stderr:2: [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] mon.c 2024-09-14T11:41:13.416 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-14T11:41:13.416 INFO:tasks.workunit.client.0.smithi138.stderr: -228> 2024-09-14T11:41:13.002+0000 7fdbc4ff9640 10 monclient: _finish_auth 0 2024-09-14T11:41:13.416 INFO:tasks.workunit.client.0.smithi138.stderr: -227> 2024-09-14T11:41:13.002+0000 7fdbc4ff9640 10 monclient: _check_auth_tickets 2024-09-14T11:41:13.416 INFO:tasks.workunit.client.0.smithi138.stderr: -226> 2024-09-14T11:41:13.002+0000 7fdbc4ff9640 10 monclient: handle_config config(0 keys) 2024-09-14T11:41:13.417 INFO:tasks.workunit.client.0.smithi138.stderr: -225> 2024-09-14T11:41:13.002+0000 7fdce3c279c0 5 monclient: authenticate success, global_id 8256 2024-09-14T11:41:13.417 INFO:tasks.workunit.client.0.smithi138.stderr: -224> 2024-09-14T11:41:13.002+0000 7fdce3c279c0 10 monclient: get_monmap_and_config success 2024-09-14T11:41:13.417 INFO:tasks.workunit.client.0.smithi138.stderr: -223> 2024-09-14T11:41:13.002+0000 7fdbc4ff9640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:41:13.417 INFO:tasks.workunit.client.0.smithi138.stderr: -222> 2024-09-14T11:41:13.002+0000 7fdce3c279c0 4 set_mon_vals no callback set 2024-09-14T11:41:13.417 INFO:tasks.workunit.client.0.smithi138.stderr: -221> 2024-09-14T11:41:13.002+0000 7fdbc4ff9640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-14T11:41:13.417 INFO:tasks.workunit.client.0.smithi138.stderr: -220> 2024-09-14T11:41:13.002+0000 7fdbc4ff9640 10 monclient: dump: 2024-09-14T11:41:13.417 INFO:tasks.workunit.client.0.smithi138.stderr:epoch 1 2024-09-14T11:41:13.417 INFO:tasks.workunit.client.0.smithi138.stderr:fsid 3f225f43-83a6-4aeb-b798-1f04bb49d597 2024-09-14T11:41:13.417 INFO:tasks.workunit.client.0.smithi138.stderr:last_changed 2024-09-14T11:07:09.252780+0000 2024-09-14T11:41:13.417 INFO:tasks.workunit.client.0.smithi138.stderr:created 2024-09-14T11:07:09.252780+0000 2024-09-14T11:41:13.417 INFO:tasks.workunit.client.0.smithi138.stderr:min_mon_release 19 (squid) 2024-09-14T11:41:13.417 INFO:tasks.workunit.client.0.smithi138.stderr:election_strategy: 1 2024-09-14T11:41:13.417 INFO:tasks.workunit.client.0.smithi138.stderr:0: [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] mon.a 2024-09-14T11:41:13.417 INFO:tasks.workunit.client.0.smithi138.stderr:1: [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] mon.b 2024-09-14T11:41:13.418 INFO:tasks.workunit.client.0.smithi138.stderr:2: [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] mon.c 2024-09-14T11:41:13.418 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-14T11:41:13.418 INFO:tasks.workunit.client.0.smithi138.stderr: -219> 2024-09-14T11:41:13.002+0000 7fdce3c279c0 10 monclient: shutdown 2024-09-14T11:41:13.418 INFO:tasks.workunit.client.0.smithi138.stderr: -218> 2024-09-14T11:41:13.002+0000 7fdce3c279c0 10 monclient: build_initial_monmap 2024-09-14T11:41:13.418 INFO:tasks.workunit.client.0.smithi138.stderr: -217> 2024-09-14T11:41:13.002+0000 7fdce3c279c0 1 build_initial for_mkfs: 0 2024-09-14T11:41:13.418 INFO:tasks.workunit.client.0.smithi138.stderr: -216> 2024-09-14T11:41:13.002+0000 7fdce3c279c0 10 monclient: monmap: 2024-09-14T11:41:13.418 INFO:tasks.workunit.client.0.smithi138.stderr:epoch 0 2024-09-14T11:41:13.418 INFO:tasks.workunit.client.0.smithi138.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-14T11:41:13.418 INFO:tasks.workunit.client.0.smithi138.stderr:last_changed 0.000000 2024-09-14T11:41:13.418 INFO:tasks.workunit.client.0.smithi138.stderr:created 0.000000 2024-09-14T11:41:13.418 INFO:tasks.workunit.client.0.smithi138.stderr:min_mon_release 0 (unknown) 2024-09-14T11:41:13.418 INFO:tasks.workunit.client.0.smithi138.stderr:election_strategy: 1 2024-09-14T11:41:13.418 INFO:tasks.workunit.client.0.smithi138.stderr:0: [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] mon.noname-a 2024-09-14T11:41:13.418 INFO:tasks.workunit.client.0.smithi138.stderr:1: [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] mon.noname-b 2024-09-14T11:41:13.418 INFO:tasks.workunit.client.0.smithi138.stderr:2: [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] mon.noname-c 2024-09-14T11:41:13.418 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-14T11:41:13.419 INFO:tasks.workunit.client.0.smithi138.stderr: -215> 2024-09-14T11:41:13.002+0000 7fdce3c279c0 5 AuthRegistry(0x5595989d43a0) adding auth protocol: cephx 2024-09-14T11:41:13.419 INFO:tasks.workunit.client.0.smithi138.stderr: -214> 2024-09-14T11:41:13.002+0000 7fdce3c279c0 5 AuthRegistry(0x5595989d43a0) adding auth protocol: cephx 2024-09-14T11:41:13.419 INFO:tasks.workunit.client.0.smithi138.stderr: -213> 2024-09-14T11:41:13.002+0000 7fdce3c279c0 5 AuthRegistry(0x5595989d43a0) adding auth protocol: cephx 2024-09-14T11:41:13.419 INFO:tasks.workunit.client.0.smithi138.stderr: -212> 2024-09-14T11:41:13.002+0000 7fdce3c279c0 5 AuthRegistry(0x5595989d43a0) adding con mode: secure 2024-09-14T11:41:13.419 INFO:tasks.workunit.client.0.smithi138.stderr: -211> 2024-09-14T11:41:13.002+0000 7fdce3c279c0 5 AuthRegistry(0x5595989d43a0) adding con mode: crc 2024-09-14T11:41:13.419 INFO:tasks.workunit.client.0.smithi138.stderr: -210> 2024-09-14T11:41:13.002+0000 7fdce3c279c0 5 AuthRegistry(0x5595989d43a0) adding con mode: secure 2024-09-14T11:41:13.419 INFO:tasks.workunit.client.0.smithi138.stderr: -209> 2024-09-14T11:41:13.002+0000 7fdce3c279c0 5 AuthRegistry(0x5595989d43a0) adding con mode: crc 2024-09-14T11:41:13.419 INFO:tasks.workunit.client.0.smithi138.stderr: -208> 2024-09-14T11:41:13.002+0000 7fdce3c279c0 5 AuthRegistry(0x5595989d43a0) adding con mode: secure 2024-09-14T11:41:13.419 INFO:tasks.workunit.client.0.smithi138.stderr: -207> 2024-09-14T11:41:13.002+0000 7fdce3c279c0 5 AuthRegistry(0x5595989d43a0) adding con mode: crc 2024-09-14T11:41:13.419 INFO:tasks.workunit.client.0.smithi138.stderr: -206> 2024-09-14T11:41:13.002+0000 7fdce3c279c0 5 AuthRegistry(0x5595989d43a0) adding con mode: crc 2024-09-14T11:41:13.419 INFO:tasks.workunit.client.0.smithi138.stderr: -205> 2024-09-14T11:41:13.002+0000 7fdce3c279c0 5 AuthRegistry(0x5595989d43a0) adding con mode: secure 2024-09-14T11:41:13.419 INFO:tasks.workunit.client.0.smithi138.stderr: -204> 2024-09-14T11:41:13.002+0000 7fdce3c279c0 5 AuthRegistry(0x5595989d43a0) adding con mode: crc 2024-09-14T11:41:13.419 INFO:tasks.workunit.client.0.smithi138.stderr: -203> 2024-09-14T11:41:13.002+0000 7fdce3c279c0 5 AuthRegistry(0x5595989d43a0) adding con mode: secure 2024-09-14T11:41:13.419 INFO:tasks.workunit.client.0.smithi138.stderr: -202> 2024-09-14T11:41:13.002+0000 7fdce3c279c0 5 AuthRegistry(0x5595989d43a0) adding con mode: crc 2024-09-14T11:41:13.419 INFO:tasks.workunit.client.0.smithi138.stderr: -201> 2024-09-14T11:41:13.002+0000 7fdce3c279c0 5 AuthRegistry(0x5595989d43a0) adding con mode: secure 2024-09-14T11:41:13.420 INFO:tasks.workunit.client.0.smithi138.stderr: -200> 2024-09-14T11:41:13.002+0000 7fdce3c279c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:41:13.420 INFO:tasks.workunit.client.0.smithi138.stderr: -199> 2024-09-14T11:41:13.002+0000 7fdce3c279c0 1 librados: starting msgr at 2024-09-14T11:41:13.420 INFO:tasks.workunit.client.0.smithi138.stderr: -198> 2024-09-14T11:41:13.002+0000 7fdce3c279c0 1 librados: starting objecter 2024-09-14T11:41:13.420 INFO:tasks.workunit.client.0.smithi138.stderr: -197> 2024-09-14T11:41:13.002+0000 7fdce3c279c0 5 asok(0x5595986f9d90) register_command objecter_requests cmddesc objecter_requests hook 0x5595989d2890 EEXIST 2024-09-14T11:41:13.420 INFO:tasks.workunit.client.0.smithi138.stderr: -196> 2024-09-14T11:41:13.002+0000 7fdce3c279c0 1 librados: setting wanted keys 2024-09-14T11:41:13.420 INFO:tasks.workunit.client.0.smithi138.stderr: -195> 2024-09-14T11:41:13.002+0000 7fdce3c279c0 1 librados: calling monclient init 2024-09-14T11:41:13.420 INFO:tasks.workunit.client.0.smithi138.stderr: -194> 2024-09-14T11:41:13.002+0000 7fdce3c279c0 10 monclient: init 2024-09-14T11:41:13.420 INFO:tasks.workunit.client.0.smithi138.stderr: -193> 2024-09-14T11:41:13.002+0000 7fdce3c279c0 5 AuthRegistry(0x5595989861a0) adding auth protocol: cephx 2024-09-14T11:41:13.420 INFO:tasks.workunit.client.0.smithi138.stderr: -192> 2024-09-14T11:41:13.002+0000 7fdce3c279c0 5 AuthRegistry(0x5595989861a0) adding auth protocol: cephx 2024-09-14T11:41:13.420 INFO:tasks.workunit.client.0.smithi138.stderr: -191> 2024-09-14T11:41:13.002+0000 7fdce3c279c0 5 AuthRegistry(0x5595989861a0) adding auth protocol: cephx 2024-09-14T11:41:13.420 INFO:tasks.workunit.client.0.smithi138.stderr: -190> 2024-09-14T11:41:13.002+0000 7fdce3c279c0 5 AuthRegistry(0x5595989861a0) adding con mode: secure 2024-09-14T11:41:13.420 INFO:tasks.workunit.client.0.smithi138.stderr: -189> 2024-09-14T11:41:13.002+0000 7fdce3c279c0 5 AuthRegistry(0x5595989861a0) adding con mode: crc 2024-09-14T11:41:13.420 INFO:tasks.workunit.client.0.smithi138.stderr: -188> 2024-09-14T11:41:13.002+0000 7fdce3c279c0 5 AuthRegistry(0x5595989861a0) adding con mode: secure 2024-09-14T11:41:13.420 INFO:tasks.workunit.client.0.smithi138.stderr: -187> 2024-09-14T11:41:13.002+0000 7fdce3c279c0 5 AuthRegistry(0x5595989861a0) adding con mode: crc 2024-09-14T11:41:13.421 INFO:tasks.workunit.client.0.smithi138.stderr: -186> 2024-09-14T11:41:13.002+0000 7fdce3c279c0 5 AuthRegistry(0x5595989861a0) adding con mode: secure 2024-09-14T11:41:13.421 INFO:tasks.workunit.client.0.smithi138.stderr: -185> 2024-09-14T11:41:13.002+0000 7fdce3c279c0 5 AuthRegistry(0x5595989861a0) adding con mode: crc 2024-09-14T11:41:13.421 INFO:tasks.workunit.client.0.smithi138.stderr: -184> 2024-09-14T11:41:13.002+0000 7fdce3c279c0 5 AuthRegistry(0x5595989861a0) adding con mode: crc 2024-09-14T11:41:13.421 INFO:tasks.workunit.client.0.smithi138.stderr: -183> 2024-09-14T11:41:13.002+0000 7fdce3c279c0 5 AuthRegistry(0x5595989861a0) adding con mode: secure 2024-09-14T11:41:13.421 INFO:tasks.workunit.client.0.smithi138.stderr: -182> 2024-09-14T11:41:13.002+0000 7fdce3c279c0 5 AuthRegistry(0x5595989861a0) adding con mode: crc 2024-09-14T11:41:13.421 INFO:tasks.workunit.client.0.smithi138.stderr: -181> 2024-09-14T11:41:13.002+0000 7fdce3c279c0 5 AuthRegistry(0x5595989861a0) adding con mode: secure 2024-09-14T11:41:13.421 INFO:tasks.workunit.client.0.smithi138.stderr: -180> 2024-09-14T11:41:13.002+0000 7fdce3c279c0 5 AuthRegistry(0x5595989861a0) adding con mode: crc 2024-09-14T11:41:13.421 INFO:tasks.workunit.client.0.smithi138.stderr: -179> 2024-09-14T11:41:13.002+0000 7fdce3c279c0 5 AuthRegistry(0x5595989861a0) adding con mode: secure 2024-09-14T11:41:13.421 INFO:tasks.workunit.client.0.smithi138.stderr: -178> 2024-09-14T11:41:13.002+0000 7fdce3c279c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:41:13.421 INFO:tasks.workunit.client.0.smithi138.stderr: -177> 2024-09-14T11:41:13.002+0000 7fdce3c279c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:41:13.421 INFO:tasks.workunit.client.0.smithi138.stderr: -176> 2024-09-14T11:41:13.002+0000 7fdce3c279c0 5 asok(0x5595986f9d90) register_command rotate-key cmddesc rotate-key hook 0x5595989862e8 EEXIST 2024-09-14T11:41:13.421 INFO:tasks.workunit.client.0.smithi138.stderr: -175> 2024-09-14T11:41:13.002+0000 7fdce3c279c0 10 monclient: _reopen_session rank -1 2024-09-14T11:41:13.421 INFO:tasks.workunit.client.0.smithi138.stderr: -174> 2024-09-14T11:41:13.002+0000 7fdce3c279c0 10 monclient: _add_conns ranks=[1,2,0] 2024-09-14T11:41:13.421 INFO:tasks.workunit.client.0.smithi138.stderr: -173> 2024-09-14T11:41:13.002+0000 7fdce3c279c0 10 monclient(hunting): picked mon.noname-b con 0x5595989d2330 addr [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] 2024-09-14T11:41:13.421 INFO:tasks.workunit.client.0.smithi138.stderr: -172> 2024-09-14T11:41:13.002+0000 7fdce3c279c0 10 monclient(hunting): picked mon.noname-c con 0x5595989d3560 addr [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] 2024-09-14T11:41:13.422 INFO:tasks.workunit.client.0.smithi138.stderr: -171> 2024-09-14T11:41:13.002+0000 7fdce3c279c0 10 monclient(hunting): picked mon.noname-a con 0x5595989d8140 addr [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] 2024-09-14T11:41:13.422 INFO:tasks.workunit.client.0.smithi138.stderr: -170> 2024-09-14T11:41:13.002+0000 7fdce3c279c0 10 monclient(hunting): start opening mon connection 2024-09-14T11:41:13.422 INFO:tasks.workunit.client.0.smithi138.stderr: -169> 2024-09-14T11:41:13.002+0000 7fdce3c279c0 10 monclient(hunting): start opening mon connection 2024-09-14T11:41:13.422 INFO:tasks.workunit.client.0.smithi138.stderr: -168> 2024-09-14T11:41:13.002+0000 7fdce3c279c0 10 monclient(hunting): start opening mon connection 2024-09-14T11:41:13.422 INFO:tasks.workunit.client.0.smithi138.stderr: -167> 2024-09-14T11:41:13.002+0000 7fdce3c279c0 10 monclient(hunting): _renew_subs 2024-09-14T11:41:13.422 INFO:tasks.workunit.client.0.smithi138.stderr: -166> 2024-09-14T11:41:13.002+0000 7fdce3c279c0 10 monclient(hunting): authenticate will time out at 3008.967136s 2024-09-14T11:41:13.422 INFO:tasks.workunit.client.0.smithi138.stderr: -165> 2024-09-14T11:41:13.002+0000 7fdce172d640 10 monclient(hunting): get_auth_request con 0x5595989d8140 auth_method 0 2024-09-14T11:41:13.422 INFO:tasks.workunit.client.0.smithi138.stderr: -164> 2024-09-14T11:41:13.002+0000 7fdce172d640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:41:13.422 INFO:tasks.workunit.client.0.smithi138.stderr: -163> 2024-09-14T11:41:13.002+0000 7fdce172d640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:41:13.422 INFO:tasks.workunit.client.0.smithi138.stderr: -162> 2024-09-14T11:41:13.002+0000 7fdce172d640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:41:13.422 INFO:tasks.workunit.client.0.smithi138.stderr: -161> 2024-09-14T11:41:13.002+0000 7fdce1f2e640 10 monclient(hunting): get_auth_request con 0x5595989d3560 auth_method 0 2024-09-14T11:41:13.422 INFO:tasks.workunit.client.0.smithi138.stderr: -160> 2024-09-14T11:41:13.002+0000 7fdce1f2e640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:41:13.422 INFO:tasks.workunit.client.0.smithi138.stderr: -159> 2024-09-14T11:41:13.002+0000 7fdce1f2e640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:41:13.422 INFO:tasks.workunit.client.0.smithi138.stderr: -158> 2024-09-14T11:41:13.002+0000 7fdce1f2e640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:41:13.422 INFO:tasks.workunit.client.0.smithi138.stderr: -157> 2024-09-14T11:41:13.002+0000 7fdce1f2e640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:41:13.422 INFO:tasks.workunit.client.0.smithi138.stderr: -156> 2024-09-14T11:41:13.002+0000 7fdce1f2e640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:41:13.423 INFO:tasks.workunit.client.0.smithi138.stderr: -155> 2024-09-14T11:41:13.002+0000 7fdce1f2e640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:41:13.423 INFO:tasks.workunit.client.0.smithi138.stderr: -154> 2024-09-14T11:41:13.002+0000 7fdce172d640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:41:13.423 INFO:tasks.workunit.client.0.smithi138.stderr: -153> 2024-09-14T11:41:13.002+0000 7fdce172d640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:41:13.423 INFO:tasks.workunit.client.0.smithi138.stderr: -152> 2024-09-14T11:41:13.002+0000 7fdce172d640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:41:13.423 INFO:tasks.workunit.client.0.smithi138.stderr: -151> 2024-09-14T11:41:13.002+0000 7fdce0f2c640 10 monclient(hunting): get_auth_request con 0x5595989d2330 auth_method 0 2024-09-14T11:41:13.423 INFO:tasks.workunit.client.0.smithi138.stderr: -150> 2024-09-14T11:41:13.002+0000 7fdce0f2c640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:41:13.423 INFO:tasks.workunit.client.0.smithi138.stderr: -149> 2024-09-14T11:41:13.002+0000 7fdce0f2c640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:41:13.423 INFO:tasks.workunit.client.0.smithi138.stderr: -148> 2024-09-14T11:41:13.002+0000 7fdce0f2c640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:41:13.423 INFO:tasks.workunit.client.0.smithi138.stderr: -147> 2024-09-14T11:41:13.002+0000 7fdce172d640 10 monclient(hunting): handle_auth_done global_id 8259 payload 824 2024-09-14T11:41:13.423 INFO:tasks.workunit.client.0.smithi138.stderr: -146> 2024-09-14T11:41:13.002+0000 7fdce172d640 10 monclient: _finish_hunting 0 2024-09-14T11:41:13.423 INFO:tasks.workunit.client.0.smithi138.stderr: -145> 2024-09-14T11:41:13.002+0000 7fdce172d640 1 monclient: found mon.noname-a 2024-09-14T11:41:13.423 INFO:tasks.workunit.client.0.smithi138.stderr: -144> 2024-09-14T11:41:13.002+0000 7fdce172d640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.138:3300/0 2024-09-14T11:41:13.423 INFO:tasks.workunit.client.0.smithi138.stderr: -143> 2024-09-14T11:41:13.002+0000 7fdbb6ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:41:13.423 INFO:tasks.workunit.client.0.smithi138.stderr: -142> 2024-09-14T11:41:13.002+0000 7fdbb6ffd640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-14T11:41:13.423 INFO:tasks.workunit.client.0.smithi138.stderr: -141> 2024-09-14T11:41:13.002+0000 7fdbb6ffd640 10 monclient: dump: 2024-09-14T11:41:13.424 INFO:tasks.workunit.client.0.smithi138.stderr:epoch 1 2024-09-14T11:41:13.424 INFO:tasks.workunit.client.0.smithi138.stderr:fsid 3f225f43-83a6-4aeb-b798-1f04bb49d597 2024-09-14T11:41:13.424 INFO:tasks.workunit.client.0.smithi138.stderr:last_changed 2024-09-14T11:07:09.252780+0000 2024-09-14T11:41:13.424 INFO:tasks.workunit.client.0.smithi138.stderr:created 2024-09-14T11:07:09.252780+0000 2024-09-14T11:41:13.424 INFO:tasks.workunit.client.0.smithi138.stderr:min_mon_release 19 (squid) 2024-09-14T11:41:13.424 INFO:tasks.workunit.client.0.smithi138.stderr:election_strategy: 1 2024-09-14T11:41:13.424 INFO:tasks.workunit.client.0.smithi138.stderr:0: [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] mon.a 2024-09-14T11:41:13.424 INFO:tasks.workunit.client.0.smithi138.stderr:1: [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] mon.b 2024-09-14T11:41:13.424 INFO:tasks.workunit.client.0.smithi138.stderr:2: [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] mon.c 2024-09-14T11:41:13.424 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-14T11:41:13.424 INFO:tasks.workunit.client.0.smithi138.stderr: -140> 2024-09-14T11:41:13.002+0000 7fdbb6ffd640 10 monclient: _finish_auth 0 2024-09-14T11:41:13.424 INFO:tasks.workunit.client.0.smithi138.stderr: -139> 2024-09-14T11:41:13.002+0000 7fdbb6ffd640 10 monclient: _check_auth_tickets 2024-09-14T11:41:13.424 INFO:tasks.workunit.client.0.smithi138.stderr: -138> 2024-09-14T11:41:13.002+0000 7fdbb6ffd640 10 monclient: handle_config config(0 keys) 2024-09-14T11:41:13.424 INFO:tasks.workunit.client.0.smithi138.stderr: -137> 2024-09-14T11:41:13.002+0000 7fdbb6ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:41:13.425 INFO:tasks.workunit.client.0.smithi138.stderr: -136> 2024-09-14T11:41:13.002+0000 7fdbb6ffd640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-14T11:41:13.425 INFO:tasks.workunit.client.0.smithi138.stderr: -135> 2024-09-14T11:41:13.002+0000 7fdbb6ffd640 10 monclient: dump: 2024-09-14T11:41:13.425 INFO:tasks.workunit.client.0.smithi138.stderr:epoch 1 2024-09-14T11:41:13.425 INFO:tasks.workunit.client.0.smithi138.stderr:fsid 3f225f43-83a6-4aeb-b798-1f04bb49d597 2024-09-14T11:41:13.425 INFO:tasks.workunit.client.0.smithi138.stderr:last_changed 2024-09-14T11:07:09.252780+0000 2024-09-14T11:41:13.425 INFO:tasks.workunit.client.0.smithi138.stderr:created 2024-09-14T11:07:09.252780+0000 2024-09-14T11:41:13.425 INFO:tasks.workunit.client.0.smithi138.stderr:min_mon_release 19 (squid) 2024-09-14T11:41:13.425 INFO:tasks.workunit.client.0.smithi138.stderr:election_strategy: 1 2024-09-14T11:41:13.425 INFO:tasks.workunit.client.0.smithi138.stderr:0: [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] mon.a 2024-09-14T11:41:13.425 INFO:tasks.workunit.client.0.smithi138.stderr:1: [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] mon.b 2024-09-14T11:41:13.425 INFO:tasks.workunit.client.0.smithi138.stderr:2: [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] mon.c 2024-09-14T11:41:13.425 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-14T11:41:13.425 INFO:tasks.workunit.client.0.smithi138.stderr: -134> 2024-09-14T11:41:13.002+0000 7fdbc4ff9640 4 set_mon_vals no callback set 2024-09-14T11:41:13.425 INFO:tasks.workunit.client.0.smithi138.stderr: -133> 2024-09-14T11:41:13.006+0000 7fdce3c279c0 5 monclient: authenticate success, global_id 8259 2024-09-14T11:41:13.428 INFO:tasks.workunit.client.0.smithi138.stderr: -132> 2024-09-14T11:41:13.006+0000 7fdce3c279c0 10 monclient: _renew_subs 2024-09-14T11:41:13.428 INFO:tasks.workunit.client.0.smithi138.stderr: -131> 2024-09-14T11:41:13.006+0000 7fdce3c279c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.138:3300/0 2024-09-14T11:41:13.428 INFO:tasks.workunit.client.0.smithi138.stderr: -130> 2024-09-14T11:41:13.006+0000 7fdce3c279c0 10 monclient: _renew_subs 2024-09-14T11:41:13.428 INFO:tasks.workunit.client.0.smithi138.stderr: -129> 2024-09-14T11:41:13.006+0000 7fdce3c279c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.138:3300/0 2024-09-14T11:41:13.428 INFO:tasks.workunit.client.0.smithi138.stderr: -128> 2024-09-14T11:41:13.006+0000 7fdce3c279c0 1 librados: init done 2024-09-14T11:41:13.428 INFO:tasks.workunit.client.0.smithi138.stderr: -127> 2024-09-14T11:41:13.006+0000 7fdce3c279c0 5 asok(0x5595986f9d90) register_command cr dump hook 0x5595989a9468 2024-09-14T11:41:13.428 INFO:tasks.workunit.client.0.smithi138.stderr: -126> 2024-09-14T11:41:13.006+0000 7fdce3c279c0 20 rados->read ofs=0 len=0 2024-09-14T11:41:13.428 INFO:tasks.workunit.client.0.smithi138.stderr: -125> 2024-09-14T11:41:13.006+0000 7fdbb6ffd640 4 mgrc handle_mgr_map Got map version 5 2024-09-14T11:41:13.428 INFO:tasks.workunit.client.0.smithi138.stderr: -124> 2024-09-14T11:41:13.006+0000 7fdbb6ffd640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.138:6832/3778043143,v1:172.21.15.138:6833/3778043143] 2024-09-14T11:41:13.428 INFO:tasks.workunit.client.0.smithi138.stderr: -123> 2024-09-14T11:41:13.006+0000 7fdbb6ffd640 4 mgrc reconnect Starting new session with [v2:172.21.15.138:6832/3778043143,v1:172.21.15.138:6833/3778043143] 2024-09-14T11:41:13.428 INFO:tasks.workunit.client.0.smithi138.stderr: -122> 2024-09-14T11:41:13.006+0000 7fdce0f2c640 10 monclient: get_auth_request con 0x7fdbac0718a0 auth_method 0 2024-09-14T11:41:13.428 INFO:tasks.workunit.client.0.smithi138.stderr: -121> 2024-09-14T11:41:13.006+0000 7fdce1f2e640 10 monclient: get_auth_request con 0x5595989f1720 auth_method 0 2024-09-14T11:41:13.429 INFO:tasks.workunit.client.0.smithi138.stderr: -120> 2024-09-14T11:41:13.006+0000 7fdce3c279c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:41:13.429 INFO:tasks.workunit.client.0.smithi138.stderr: -119> 2024-09-14T11:41:13.006+0000 7fdce3c279c0 20 realm 2024-09-14T11:41:13.429 INFO:tasks.workunit.client.0.smithi138.stderr: -118> 2024-09-14T11:41:13.006+0000 7fdce3c279c0 20 rados->read ofs=0 len=0 2024-09-14T11:41:13.429 INFO:tasks.workunit.client.0.smithi138.stderr: -117> 2024-09-14T11:41:13.010+0000 7fdce3c279c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:41:13.429 INFO:tasks.workunit.client.0.smithi138.stderr: -116> 2024-09-14T11:41:13.010+0000 7fdce3c279c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:41:13.429 INFO:tasks.workunit.client.0.smithi138.stderr: -115> 2024-09-14T11:41:13.010+0000 7fdce3c279c0 20 rados->read ofs=0 len=0 2024-09-14T11:41:13.429 INFO:tasks.workunit.client.0.smithi138.stderr: -114> 2024-09-14T11:41:13.010+0000 7fdce3c279c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:41:13.429 INFO:tasks.workunit.client.0.smithi138.stderr: -113> 2024-09-14T11:41:13.010+0000 7fdce3c279c0 20 rados->read ofs=0 len=0 2024-09-14T11:41:13.429 INFO:tasks.workunit.client.0.smithi138.stderr: -112> 2024-09-14T11:41:13.010+0000 7fdce0f2c640 10 monclient: get_auth_request con 0x5595989f5950 auth_method 0 2024-09-14T11:41:13.429 INFO:tasks.workunit.client.0.smithi138.stderr: -111> 2024-09-14T11:41:13.010+0000 7fdce3c279c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:41:13.429 INFO:tasks.workunit.client.0.smithi138.stderr: -110> 2024-09-14T11:41:13.010+0000 7fdce3c279c0 20 rados->read ofs=0 len=0 2024-09-14T11:41:13.429 INFO:tasks.workunit.client.0.smithi138.stderr: -109> 2024-09-14T11:41:13.010+0000 7fdce1f2e640 10 monclient: get_auth_request con 0x5595989f91b0 auth_method 0 2024-09-14T11:41:13.429 INFO:tasks.workunit.client.0.smithi138.stderr: -108> 2024-09-14T11:41:13.010+0000 7fdce3c279c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:41:13.429 INFO:tasks.workunit.client.0.smithi138.stderr: -107> 2024-09-14T11:41:13.010+0000 7fdce3c279c0 20 searching for the correct realm 2024-09-14T11:41:13.430 INFO:tasks.workunit.client.0.smithi138.stderr: -106> 2024-09-14T11:41:13.010+0000 7fdce172d640 10 monclient: get_auth_request con 0x5595989fdec0 auth_method 0 2024-09-14T11:41:13.430 INFO:tasks.workunit.client.0.smithi138.stderr: -105> 2024-09-14T11:41:13.010+0000 7fdce0f2c640 10 monclient: get_auth_request con 0x7fdcdc0cd040 auth_method 0 2024-09-14T11:41:13.430 INFO:tasks.workunit.client.0.smithi138.stderr: -104> 2024-09-14T11:41:13.014+0000 7fdce1f2e640 10 monclient: get_auth_request con 0x7fdcd4018930 auth_method 0 2024-09-14T11:41:13.430 INFO:tasks.workunit.client.0.smithi138.stderr: -103> 2024-09-14T11:41:13.014+0000 7fdce1f2e640 0 -- 172.21.15.138:0/1011542782 >> [v2:172.21.15.154:6824/416768175,v1:172.21.15.154:6825/416768175] conn(0x7fdcd4018930 msgr2=0x7fdcd4033400 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:41:13.430 INFO:tasks.workunit.client.0.smithi138.stderr: -102> 2024-09-14T11:41:13.014+0000 7fdbb6ffd640 1 client.8259.objecter ms_handle_reset 0x7fdcd4018930 session 0x7fdcd401e040 osd.4 2024-09-14T11:41:13.430 INFO:tasks.workunit.client.0.smithi138.stderr: -101> 2024-09-14T11:41:13.014+0000 7fdbb6ffd640 10 monclient: _renew_subs 2024-09-14T11:41:13.430 INFO:tasks.workunit.client.0.smithi138.stderr: -100> 2024-09-14T11:41:13.014+0000 7fdbb6ffd640 10 monclient: _send_mon_message to mon.a at v2:172.21.15.138:3300/0 2024-09-14T11:41:13.430 INFO:tasks.workunit.client.0.smithi138.stderr: -99> 2024-09-14T11:41:13.014+0000 7fdce1f2e640 10 monclient: get_auth_request con 0x7fdbac082050 auth_method 0 2024-09-14T11:41:13.430 INFO:tasks.workunit.client.0.smithi138.stderr: -98> 2024-09-14T11:41:13.018+0000 7fdce172d640 10 monclient: get_auth_request con 0x7fdcd404f3f0 auth_method 0 2024-09-14T11:41:13.430 INFO:tasks.workunit.client.0.smithi138.stderr: -97> 2024-09-14T11:41:13.022+0000 7fdce0f2c640 10 monclient: get_auth_request con 0x7fdcd405bac0 auth_method 0 2024-09-14T11:41:13.430 INFO:tasks.workunit.client.0.smithi138.stderr: -96> 2024-09-14T11:41:13.022+0000 7fdce0f2c640 0 -- 172.21.15.138:0/1011542782 >> [v2:172.21.15.138:6816/326481658,v1:172.21.15.138:6817/326481658] conn(0x7fdcd405bac0 msgr2=0x7fdcd403f3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:41:13.430 INFO:tasks.workunit.client.0.smithi138.stderr: -95> 2024-09-14T11:41:13.226+0000 7fdce0f2c640 10 monclient: get_auth_request con 0x7fdcd405bac0 auth_method 0 2024-09-14T11:41:13.430 INFO:tasks.workunit.client.0.smithi138.stderr: -94> 2024-09-14T11:41:13.242+0000 7fdce3c279c0 20 RGWRados::pool_iterate: got zone_info.d9e72d30-c60b-4d0d-9267-fdc36392d5ad 2024-09-14T11:41:13.430 INFO:tasks.workunit.client.0.smithi138.stderr: -93> 2024-09-14T11:41:13.242+0000 7fdce3c279c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:41:13.430 INFO:tasks.workunit.client.0.smithi138.stderr: -92> 2024-09-14T11:41:13.242+0000 7fdce3c279c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:41:13.431 INFO:tasks.workunit.client.0.smithi138.stderr: -91> 2024-09-14T11:41:13.242+0000 7fdce3c279c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:41:13.431 INFO:tasks.workunit.client.0.smithi138.stderr: -90> 2024-09-14T11:41:13.242+0000 7fdce3c279c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:41:13.431 INFO:tasks.workunit.client.0.smithi138.stderr: -89> 2024-09-14T11:41:13.242+0000 7fdce3c279c0 20 RGWRados::pool_iterate: got zonegroup_info.65ab941b-da8c-4160-94fb-3672b069d44f 2024-09-14T11:41:13.431 INFO:tasks.workunit.client.0.smithi138.stderr: -88> 2024-09-14T11:41:13.242+0000 7fdce3c279c0 20 rados->read ofs=0 len=0 2024-09-14T11:41:13.431 INFO:tasks.workunit.client.0.smithi138.stderr: -87> 2024-09-14T11:41:13.242+0000 7fdce3c279c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:41:13.431 INFO:tasks.workunit.client.0.smithi138.stderr: -86> 2024-09-14T11:41:13.242+0000 7fdce3c279c0 20 rados->read ofs=0 len=0 2024-09-14T11:41:13.431 INFO:tasks.workunit.client.0.smithi138.stderr: -85> 2024-09-14T11:41:13.242+0000 7fdce3c279c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:41:13.431 INFO:tasks.workunit.client.0.smithi138.stderr: -84> 2024-09-14T11:41:13.242+0000 7fdce3c279c0 20 rados->read ofs=0 len=0 2024-09-14T11:41:13.431 INFO:tasks.workunit.client.0.smithi138.stderr: -83> 2024-09-14T11:41:13.242+0000 7fdce3c279c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:41:13.431 INFO:tasks.workunit.client.0.smithi138.stderr: -82> 2024-09-14T11:41:13.242+0000 7fdce3c279c0 20 zone default found 2024-09-14T11:41:13.431 INFO:tasks.workunit.client.0.smithi138.stderr: -81> 2024-09-14T11:41:13.242+0000 7fdce3c279c0 4 Realm: () 2024-09-14T11:41:13.431 INFO:tasks.workunit.client.0.smithi138.stderr: -80> 2024-09-14T11:41:13.242+0000 7fdce3c279c0 4 ZoneGroup: default (65ab941b-da8c-4160-94fb-3672b069d44f) 2024-09-14T11:41:13.431 INFO:tasks.workunit.client.0.smithi138.stderr: -79> 2024-09-14T11:41:13.242+0000 7fdce3c279c0 4 Zone: default (d9e72d30-c60b-4d0d-9267-fdc36392d5ad) 2024-09-14T11:41:13.431 INFO:tasks.workunit.client.0.smithi138.stderr: -78> 2024-09-14T11:41:13.242+0000 7fdce3c279c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:41:13.431 INFO:tasks.workunit.client.0.smithi138.stderr: -77> 2024-09-14T11:41:13.242+0000 7fdce3c279c0 20 zonegroup default 2024-09-14T11:41:13.432 INFO:tasks.workunit.client.0.smithi138.stderr: -76> 2024-09-14T11:41:13.242+0000 7fdce3c279c0 20 rados->read ofs=0 len=0 2024-09-14T11:41:13.432 INFO:tasks.workunit.client.0.smithi138.stderr: -75> 2024-09-14T11:41:13.242+0000 7fdce3c279c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:41:13.432 INFO:tasks.workunit.client.0.smithi138.stderr: -74> 2024-09-14T11:41:13.242+0000 7fdce3c279c0 20 rados->read ofs=0 len=0 2024-09-14T11:41:13.432 INFO:tasks.workunit.client.0.smithi138.stderr: -73> 2024-09-14T11:41:13.246+0000 7fdce3c279c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:41:13.432 INFO:tasks.workunit.client.0.smithi138.stderr: -72> 2024-09-14T11:41:13.246+0000 7fdce3c279c0 20 rados->read ofs=0 len=0 2024-09-14T11:41:13.432 INFO:tasks.workunit.client.0.smithi138.stderr: -71> 2024-09-14T11:41:13.246+0000 7fdce3c279c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:41:13.432 INFO:tasks.workunit.client.0.smithi138.stderr: -70> 2024-09-14T11:41:13.246+0000 7fdce3c279c0 20 started sync module instance, tier type = 2024-09-14T11:41:13.432 INFO:tasks.workunit.client.0.smithi138.stderr: -69> 2024-09-14T11:41:13.246+0000 7fdce3c279c0 20 started zone id=d9e72d30-c60b-4d0d-9267-fdc36392d5ad (name=default) with tier type = 2024-09-14T11:41:13.432 INFO:tasks.workunit.client.0.smithi138.stderr: -68> 2024-09-14T11:41:13.270+0000 7fdce3c279c0 20 add_watcher() i=0 2024-09-14T11:41:13.432 INFO:tasks.workunit.client.0.smithi138.stderr: -67> 2024-09-14T11:41:13.270+0000 7fdce3c279c0 20 add_watcher() i=1 2024-09-14T11:41:13.432 INFO:tasks.workunit.client.0.smithi138.stderr: -66> 2024-09-14T11:41:13.270+0000 7fdce3c279c0 20 add_watcher() i=2 2024-09-14T11:41:13.432 INFO:tasks.workunit.client.0.smithi138.stderr: -65> 2024-09-14T11:41:13.270+0000 7fdce3c279c0 20 add_watcher() i=3 2024-09-14T11:41:13.432 INFO:tasks.workunit.client.0.smithi138.stderr: -64> 2024-09-14T11:41:13.270+0000 7fdce3c279c0 20 add_watcher() i=4 2024-09-14T11:41:13.432 INFO:tasks.workunit.client.0.smithi138.stderr: -63> 2024-09-14T11:41:13.270+0000 7fdce3c279c0 20 add_watcher() i=5 2024-09-14T11:41:13.432 INFO:tasks.workunit.client.0.smithi138.stderr: -62> 2024-09-14T11:41:13.270+0000 7fdce3c279c0 20 add_watcher() i=6 2024-09-14T11:41:13.433 INFO:tasks.workunit.client.0.smithi138.stderr: -61> 2024-09-14T11:41:13.270+0000 7fdce3c279c0 20 add_watcher() i=7 2024-09-14T11:41:13.433 INFO:tasks.workunit.client.0.smithi138.stderr: -60> 2024-09-14T11:41:13.270+0000 7fdce3c279c0 2 all 8 watchers are set, enabling cache 2024-09-14T11:41:13.433 INFO:tasks.workunit.client.0.smithi138.stderr: -59> 2024-09-14T11:41:13.274+0000 7fdce3c279c0 5 AuthRegistry(0x7ffdf8059e80) adding auth protocol: cephx 2024-09-14T11:41:13.433 INFO:tasks.workunit.client.0.smithi138.stderr: -58> 2024-09-14T11:41:13.274+0000 7fdce3c279c0 5 AuthRegistry(0x7ffdf8059e80) adding auth protocol: cephx 2024-09-14T11:41:13.433 INFO:tasks.workunit.client.0.smithi138.stderr: -57> 2024-09-14T11:41:13.274+0000 7fdce3c279c0 5 AuthRegistry(0x7ffdf8059e80) adding auth protocol: cephx 2024-09-14T11:41:13.433 INFO:tasks.workunit.client.0.smithi138.stderr: -56> 2024-09-14T11:41:13.274+0000 7fdce3c279c0 5 AuthRegistry(0x7ffdf8059e80) adding con mode: secure 2024-09-14T11:41:13.433 INFO:tasks.workunit.client.0.smithi138.stderr: -55> 2024-09-14T11:41:13.274+0000 7fdce3c279c0 5 AuthRegistry(0x7ffdf8059e80) adding con mode: crc 2024-09-14T11:41:13.433 INFO:tasks.workunit.client.0.smithi138.stderr: -54> 2024-09-14T11:41:13.274+0000 7fdb97fe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:41:13.433 INFO:tasks.workunit.client.0.smithi138.stderr: -53> 2024-09-14T11:41:13.274+0000 7fdce3c279c0 5 AuthRegistry(0x7ffdf8059e80) adding con mode: secure 2024-09-14T11:41:13.433 INFO:tasks.workunit.client.0.smithi138.stderr: -52> 2024-09-14T11:41:13.274+0000 7fdce3c279c0 5 AuthRegistry(0x7ffdf8059e80) adding con mode: crc 2024-09-14T11:41:13.433 INFO:tasks.workunit.client.0.smithi138.stderr: -51> 2024-09-14T11:41:13.274+0000 7fdce3c279c0 5 AuthRegistry(0x7ffdf8059e80) adding con mode: secure 2024-09-14T11:41:13.433 INFO:tasks.workunit.client.0.smithi138.stderr: -50> 2024-09-14T11:41:13.274+0000 7fdce3c279c0 5 AuthRegistry(0x7ffdf8059e80) adding con mode: crc 2024-09-14T11:41:13.433 INFO:tasks.workunit.client.0.smithi138.stderr: -49> 2024-09-14T11:41:13.274+0000 7fdce3c279c0 5 AuthRegistry(0x7ffdf8059e80) adding con mode: crc 2024-09-14T11:41:13.433 INFO:tasks.workunit.client.0.smithi138.stderr: -48> 2024-09-14T11:41:13.274+0000 7fdce3c279c0 5 AuthRegistry(0x7ffdf8059e80) adding con mode: secure 2024-09-14T11:41:13.434 INFO:tasks.workunit.client.0.smithi138.stderr: -47> 2024-09-14T11:41:13.274+0000 7fdce3c279c0 5 AuthRegistry(0x7ffdf8059e80) adding con mode: crc 2024-09-14T11:41:13.434 INFO:tasks.workunit.client.0.smithi138.stderr: -46> 2024-09-14T11:41:13.274+0000 7fdce3c279c0 5 AuthRegistry(0x7ffdf8059e80) adding con mode: secure 2024-09-14T11:41:13.434 INFO:tasks.workunit.client.0.smithi138.stderr: -45> 2024-09-14T11:41:13.274+0000 7fdce3c279c0 5 AuthRegistry(0x7ffdf8059e80) adding con mode: crc 2024-09-14T11:41:13.434 INFO:tasks.workunit.client.0.smithi138.stderr: -44> 2024-09-14T11:41:13.274+0000 7fdce3c279c0 5 AuthRegistry(0x7ffdf8059e80) adding con mode: secure 2024-09-14T11:41:13.434 INFO:tasks.workunit.client.0.smithi138.stderr: -43> 2024-09-14T11:41:13.274+0000 7fdce3c279c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:41:13.434 INFO:tasks.workunit.client.0.smithi138.stderr: -42> 2024-09-14T11:41:13.274+0000 7fdce3c279c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:41:13.434 INFO:tasks.workunit.client.0.smithi138.stderr: -41> 2024-09-14T11:41:13.274+0000 7fdce3c279c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:41:13.434 INFO:tasks.workunit.client.0.smithi138.stderr: -40> 2024-09-14T11:41:13.274+0000 7fdce3c279c0 5 asok(0x5595986f9d90) register_command cache list hook 0x5595989cccf0 2024-09-14T11:41:13.434 INFO:tasks.workunit.client.0.smithi138.stderr: -39> 2024-09-14T11:41:13.274+0000 7fdce3c279c0 5 asok(0x5595986f9d90) register_command cache inspect hook 0x5595989cccf0 2024-09-14T11:41:13.434 INFO:tasks.workunit.client.0.smithi138.stderr: -38> 2024-09-14T11:41:13.274+0000 7fdce3c279c0 5 asok(0x5595986f9d90) register_command cache erase hook 0x5595989cccf0 2024-09-14T11:41:13.434 INFO:tasks.workunit.client.0.smithi138.stderr: -37> 2024-09-14T11:41:13.274+0000 7fdce3c279c0 5 asok(0x5595986f9d90) register_command cache zap hook 0x5595989cccf0 2024-09-14T11:41:13.434 INFO:tasks.workunit.client.0.smithi138.stderr: -36> 2024-09-14T11:41:13.278+0000 7fdce3c279c0 5 note: GC not initialized 2024-09-14T11:41:13.434 INFO:tasks.workunit.client.0.smithi138.stderr: -35> 2024-09-14T11:41:13.278+0000 7fdb96fe5640 20 reqs_thread_entry: start 2024-09-14T11:41:13.434 INFO:tasks.workunit.client.0.smithi138.stderr: -34> 2024-09-14T11:41:13.278+0000 7fdce3c279c0 5 asok(0x5595986f9d90) register_command sync trace show hook 0x7fdcd400c040 2024-09-14T11:41:13.435 INFO:tasks.workunit.client.0.smithi138.stderr: -33> 2024-09-14T11:41:13.278+0000 7fdce3c279c0 5 asok(0x5595986f9d90) register_command sync trace history hook 0x7fdcd400c040 2024-09-14T11:41:13.435 INFO:tasks.workunit.client.0.smithi138.stderr: -32> 2024-09-14T11:41:13.278+0000 7fdce3c279c0 5 asok(0x5595986f9d90) register_command sync trace active hook 0x7fdcd400c040 2024-09-14T11:41:13.435 INFO:tasks.workunit.client.0.smithi138.stderr: -31> 2024-09-14T11:41:13.278+0000 7fdce3c279c0 5 asok(0x5595986f9d90) register_command sync trace active_short hook 0x7fdcd400c040 2024-09-14T11:41:13.435 INFO:tasks.workunit.client.0.smithi138.stderr: -30> 2024-09-14T11:41:13.278+0000 7fdce3c279c0 20 init_complete bucket index max shards: 11 2024-09-14T11:41:13.435 INFO:tasks.workunit.client.0.smithi138.stderr: -29> 2024-09-14T11:41:13.278+0000 7fdce3c279c0 20 Filter name: none 2024-09-14T11:41:13.435 INFO:tasks.workunit.client.0.smithi138.stderr: -28> 2024-09-14T11:41:13.278+0000 7fdb94fe1640 20 reqs_thread_entry: start 2024-09-14T11:41:13.435 INFO:tasks.workunit.client.0.smithi138.stderr: -27> 2024-09-14T11:41:13.278+0000 7fdce3c279c0 10 cache get: name=default.rgw.meta+root+a-bucket : miss 2024-09-14T11:41:13.435 INFO:tasks.workunit.client.0.smithi138.stderr: -26> 2024-09-14T11:41:13.278+0000 7fdce3c279c0 20 rados->read ofs=0 len=0 2024-09-14T11:41:13.435 INFO:tasks.workunit.client.0.smithi138.stderr: -25> 2024-09-14T11:41:13.278+0000 7fdce3c279c0 20 rados_obj.operate() r=0 bl.length=176 2024-09-14T11:41:13.435 INFO:tasks.workunit.client.0.smithi138.stderr: -24> 2024-09-14T11:41:13.278+0000 7fdce3c279c0 10 cache put: name=default.rgw.meta+root+a-bucket info.flags=0x11 2024-09-14T11:41:13.435 INFO:tasks.workunit.client.0.smithi138.stderr: -23> 2024-09-14T11:41:13.278+0000 7fdce3c279c0 10 adding default.rgw.meta+root+a-bucket to cache LRU end 2024-09-14T11:41:13.435 INFO:tasks.workunit.client.0.smithi138.stderr: -22> 2024-09-14T11:41:13.278+0000 7fdce3c279c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.17 : miss 2024-09-14T11:41:13.435 INFO:tasks.workunit.client.0.smithi138.stderr: -21> 2024-09-14T11:41:13.278+0000 7fdce3c279c0 20 rados->read ofs=0 len=0 2024-09-14T11:41:13.435 INFO:tasks.workunit.client.0.smithi138.stderr: -20> 2024-09-14T11:41:13.278+0000 7fdce3c279c0 20 rados_obj.operate() r=0 bl.length=430 2024-09-14T11:41:13.435 INFO:tasks.workunit.client.0.smithi138.stderr: -19> 2024-09-14T11:41:13.278+0000 7fdce3c279c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.17 info.flags=0x17 2024-09-14T11:41:13.436 INFO:tasks.workunit.client.0.smithi138.stderr: -18> 2024-09-14T11:41:13.278+0000 7fdce3c279c0 10 adding default.rgw.meta+root+.bucket.meta.a-bucket:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.17 to cache LRU end 2024-09-14T11:41:13.436 INFO:tasks.workunit.client.0.smithi138.stderr: -17> 2024-09-14T11:41:13.278+0000 7fdce3c279c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:41:13.436 INFO:tasks.workunit.client.0.smithi138.stderr: -16> 2024-09-14T11:41:13.278+0000 7fdce3c279c0 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-14T11:41:13.436 INFO:tasks.workunit.client.0.smithi138.stderr: -15> 2024-09-14T11:41:13.278+0000 7fdce3c279c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.17 2024-09-14T11:41:13.436 INFO:tasks.workunit.client.0.smithi138.stderr: -14> 2024-09-14T11:41:13.282+0000 7fdce3c279c0 10 init_target_layout removing existing target index objects from a previous reshard attempt 2024-09-14T11:41:13.436 INFO:tasks.workunit.client.0.smithi138.stderr: -13> 2024-09-14T11:41:13.298+0000 7fdce3c279c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.17 info.flags=0x17 2024-09-14T11:41:13.436 INFO:tasks.workunit.client.0.smithi138.stderr: -12> 2024-09-14T11:41:13.298+0000 7fdce3c279c0 10 moving default.rgw.meta+root+.bucket.meta.a-bucket:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.17 to cache LRU end 2024-09-14T11:41:13.436 INFO:tasks.workunit.client.0.smithi138.stderr: -11> 2024-09-14T11:41:13.298+0000 7fdce3c279c0 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-14T11:41:13.436 INFO:tasks.workunit.client.0.smithi138.stderr: -10> 2024-09-14T11:41:13.298+0000 7fdce3c279c0 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.a-bucket:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.17, ofs0, ns] 2024-09-14T11:41:13.436 INFO:tasks.workunit.client.0.smithi138.stderr: -9> 2024-09-14T11:41:13.298+0000 7fdbb7fff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366243 cookie 94100999125296 notifier 8259 bl.length()=827 2024-09-14T11:41:13.436 INFO:tasks.workunit.client.0.smithi138.stderr: -8> 2024-09-14T11:41:13.298+0000 7fdbb7fff640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.17 info.flags=0x17 2024-09-14T11:41:13.436 INFO:tasks.workunit.client.0.smithi138.stderr: -7> 2024-09-14T11:41:13.298+0000 7fdbb7fff640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.a-bucket:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.17 to cache LRU end 2024-09-14T11:41:13.436 INFO:tasks.workunit.client.0.smithi138.stderr: -6> 2024-09-14T11:41:13.298+0000 7fdbb7fff640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=143 2024-09-14T11:41:13.437 INFO:tasks.workunit.client.0.smithi138.stderr: -5> 2024-09-14T11:41:13.302+0000 7fdce3c279c0 20 handle_bi_update(): bucket=:a-bucket[d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.17]): orig_sources= new_sources= 2024-09-14T11:41:13.437 INFO:tasks.workunit.client.0.smithi138.stderr: -4> 2024-09-14T11:41:13.302+0000 7fdce3c279c0 20 handle_bi_update(): bucket=:a-bucket[d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.17]): potential sources added=[] removed=[] 2024-09-14T11:41:13.437 INFO:tasks.workunit.client.0.smithi138.stderr: -3> 2024-09-14T11:41:13.302+0000 7fdce3c279c0 20 handle_bi_update(): bucket=:a-bucket[d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.17]): orig_dests= new_dests= 2024-09-14T11:41:13.437 INFO:tasks.workunit.client.0.smithi138.stderr: -2> 2024-09-14T11:41:13.302+0000 7fdce3c279c0 20 handle_bi_update(): bucket=:a-bucket[d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.17]): potential dests added=[] removed=[] 2024-09-14T11:41:13.437 INFO:tasks.workunit.client.0.smithi138.stderr: -1> 2024-09-14T11:41:13.314+0000 7fdce3c279c0 -1 ./src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7fdce3c279c0 time 2024-09-14T11:41:13.317278+0000 2024-09-14T11:41:13.437 INFO:tasks.workunit.client.0.smithi138.stderr:./src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-14T11:41:13.437 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-14T11:41:13.437 INFO:tasks.workunit.client.0.smithi138.stderr: ceph version 19.3.0-4907-ga2782315 (a2782315255a3e7d5f6cdc9eb35785187ff6ddf8) squid (dev) 2024-09-14T11:41:13.437 INFO:tasks.workunit.client.0.smithi138.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x121) [0x7fdce75012eb] 2024-09-14T11:41:13.437 INFO:tasks.workunit.client.0.smithi138.stderr: 2: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7fdce750149f] 2024-09-14T11:41:13.437 INFO:tasks.workunit.client.0.smithi138.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x559596c0bc01] 2024-09-14T11:41:13.437 INFO:tasks.workunit.client.0.smithi138.stderr: 4: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x17a) [0x559596c20f3a] 2024-09-14T11:41:13.437 INFO:tasks.workunit.client.0.smithi138.stderr: 5: main() 2024-09-14T11:41:13.437 INFO:tasks.workunit.client.0.smithi138.stderr: 6: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7fdce6367d90] 2024-09-14T11:41:13.437 INFO:tasks.workunit.client.0.smithi138.stderr: 7: __libc_start_main() 2024-09-14T11:41:13.438 INFO:tasks.workunit.client.0.smithi138.stderr: 8: _start() 2024-09-14T11:41:13.438 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-14T11:41:13.438 INFO:tasks.workunit.client.0.smithi138.stderr: 0> 2024-09-14T11:41:13.314+0000 7fdce3c279c0 -1 *** Caught signal (Aborted) ** 2024-09-14T11:41:13.438 INFO:tasks.workunit.client.0.smithi138.stderr: in thread 7fdce3c279c0 thread_name:radosgw-admin 2024-09-14T11:41:13.438 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-14T11:41:13.438 INFO:tasks.workunit.client.0.smithi138.stderr: ceph version 19.3.0-4907-ga2782315 (a2782315255a3e7d5f6cdc9eb35785187ff6ddf8) squid (dev) 2024-09-14T11:41:13.438 INFO:tasks.workunit.client.0.smithi138.stderr: 1: /lib/x86_64-linux-gnu/libc.so.6(+0x42520) [0x7fdce6380520] 2024-09-14T11:41:13.438 INFO:tasks.workunit.client.0.smithi138.stderr: 2: pthread_kill() 2024-09-14T11:41:13.438 INFO:tasks.workunit.client.0.smithi138.stderr: 3: raise() 2024-09-14T11:41:13.438 INFO:tasks.workunit.client.0.smithi138.stderr: 4: abort() 2024-09-14T11:41:13.438 INFO:tasks.workunit.client.0.smithi138.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x17b) [0x7fdce7501345] 2024-09-14T11:41:13.438 INFO:tasks.workunit.client.0.smithi138.stderr: 6: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7fdce750149f] 2024-09-14T11:41:13.438 INFO:tasks.workunit.client.0.smithi138.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x559596c0bc01] 2024-09-14T11:41:13.438 INFO:tasks.workunit.client.0.smithi138.stderr: 8: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x17a) [0x559596c20f3a] 2024-09-14T11:41:13.438 INFO:tasks.workunit.client.0.smithi138.stderr: 9: main() 2024-09-14T11:41:13.439 INFO:tasks.workunit.client.0.smithi138.stderr: 10: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7fdce6367d90] 2024-09-14T11:41:13.439 INFO:tasks.workunit.client.0.smithi138.stderr: 11: __libc_start_main() 2024-09-14T11:41:13.439 INFO:tasks.workunit.client.0.smithi138.stderr: 12: _start() 2024-09-14T11:41:13.439 INFO:tasks.workunit.client.0.smithi138.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-14T11:41:13.439 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-14T11:41:13.439 INFO:tasks.workunit.client.0.smithi138.stderr:--- logging levels --- 2024-09-14T11:41:13.439 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 none 2024-09-14T11:41:13.439 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 1 lockdep 2024-09-14T11:41:13.439 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 1 context 2024-09-14T11:41:13.439 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 1 crush 2024-09-14T11:41:13.439 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 mds 2024-09-14T11:41:13.439 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 mds_balancer 2024-09-14T11:41:13.439 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 mds_locker 2024-09-14T11:41:13.439 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 mds_log 2024-09-14T11:41:13.440 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 mds_log_expire 2024-09-14T11:41:13.440 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 mds_migrator 2024-09-14T11:41:13.440 INFO:tasks.workunit.client.0.smithi138.stderr: 3/ 5 mds_quiesce 2024-09-14T11:41:13.440 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 1 buffer 2024-09-14T11:41:13.440 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 1 timer 2024-09-14T11:41:13.440 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 1 filer 2024-09-14T11:41:13.440 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 1 striper 2024-09-14T11:41:13.440 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 1 objecter 2024-09-14T11:41:13.440 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 rados 2024-09-14T11:41:13.440 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 rbd 2024-09-14T11:41:13.440 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 rbd_mirror 2024-09-14T11:41:13.440 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 rbd_replay 2024-09-14T11:41:13.440 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 rbd_pwl 2024-09-14T11:41:13.440 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 journaler 2024-09-14T11:41:13.441 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 objectcacher 2024-09-14T11:41:13.441 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 immutable_obj_cache 2024-09-14T11:41:13.441 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 client 2024-09-14T11:41:13.441 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 osd 2024-09-14T11:41:13.441 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 optracker 2024-09-14T11:41:13.441 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 objclass 2024-09-14T11:41:13.441 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 3 filestore 2024-09-14T11:41:13.441 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 3 journal 2024-09-14T11:41:13.441 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 0 ms 2024-09-14T11:41:13.441 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 mon 2024-09-14T11:41:13.441 INFO:tasks.workunit.client.0.smithi138.stderr: 0/10 monc 2024-09-14T11:41:13.441 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 paxos 2024-09-14T11:41:13.441 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 tp 2024-09-14T11:41:13.441 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 auth 2024-09-14T11:41:13.441 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 crypto 2024-09-14T11:41:13.442 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 1 finisher 2024-09-14T11:41:13.442 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 1 reserver 2024-09-14T11:41:13.442 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 heartbeatmap 2024-09-14T11:41:13.442 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 perfcounter 2024-09-14T11:41:13.442 INFO:tasks.workunit.client.0.smithi138.stderr: 20/20 rgw 2024-09-14T11:41:13.442 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 rgw_sync 2024-09-14T11:41:13.442 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 rgw_datacache 2024-09-14T11:41:13.442 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 rgw_access 2024-09-14T11:41:13.442 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 rgw_dbstore 2024-09-14T11:41:13.442 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 rgw_flight 2024-09-14T11:41:13.442 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 rgw_lifecycle 2024-09-14T11:41:13.442 INFO:tasks.workunit.client.0.smithi138.stderr: 20/20 rgw_notification 2024-09-14T11:41:13.442 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 javaclient 2024-09-14T11:41:13.442 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 asok 2024-09-14T11:41:13.442 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 1 throttle 2024-09-14T11:41:13.443 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 0 refs 2024-09-14T11:41:13.443 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 compressor 2024-09-14T11:41:13.443 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 bluestore 2024-09-14T11:41:13.443 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 bluefs 2024-09-14T11:41:13.443 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 3 bdev 2024-09-14T11:41:13.443 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 kstore 2024-09-14T11:41:13.443 INFO:tasks.workunit.client.0.smithi138.stderr: 4/ 5 rocksdb 2024-09-14T11:41:13.443 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 fuse 2024-09-14T11:41:13.443 INFO:tasks.workunit.client.0.smithi138.stderr: 2/ 5 mgr 2024-09-14T11:41:13.443 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 mgrc 2024-09-14T11:41:13.443 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 dpdk 2024-09-14T11:41:13.443 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 eventtrace 2024-09-14T11:41:13.443 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 prioritycache 2024-09-14T11:41:13.443 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 test 2024-09-14T11:41:13.443 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 cephfs_mirror 2024-09-14T11:41:13.444 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 cephsqlite 2024-09-14T11:41:13.444 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 crimson_interrupt 2024-09-14T11:41:13.444 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 seastore 2024-09-14T11:41:13.444 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 seastore_onode 2024-09-14T11:41:13.444 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 seastore_odata 2024-09-14T11:41:13.444 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 seastore_omap 2024-09-14T11:41:13.444 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 seastore_tm 2024-09-14T11:41:13.444 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 seastore_t 2024-09-14T11:41:13.444 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 seastore_cleaner 2024-09-14T11:41:13.444 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 seastore_epm 2024-09-14T11:41:13.444 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 seastore_lba 2024-09-14T11:41:13.444 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 seastore_fixedkv_tree 2024-09-14T11:41:13.444 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 seastore_cache 2024-09-14T11:41:13.444 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 seastore_journal 2024-09-14T11:41:13.444 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 seastore_device 2024-09-14T11:41:13.445 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 seastore_backref 2024-09-14T11:41:13.445 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 alienstore 2024-09-14T11:41:13.445 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 mclock 2024-09-14T11:41:13.445 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 cyanstore 2024-09-14T11:41:13.445 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 ceph_exporter 2024-09-14T11:41:13.445 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 memstore 2024-09-14T11:41:13.445 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 trace 2024-09-14T11:41:13.445 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 ceph_dedup 2024-09-14T11:41:13.445 INFO:tasks.workunit.client.0.smithi138.stderr: -2/-2 (syslog threshold) 2024-09-14T11:41:13.445 INFO:tasks.workunit.client.0.smithi138.stderr: 99/99 (stderr threshold) 2024-09-14T11:41:13.445 INFO:tasks.workunit.client.0.smithi138.stderr:--- pthread ID / name mapping for recent threads --- 2024-09-14T11:41:13.445 INFO:tasks.workunit.client.0.smithi138.stderr: 7fdb94fe1640 / http_manager 2024-09-14T11:41:13.445 INFO:tasks.workunit.client.0.smithi138.stderr: 7fdb96fe5640 / http_manager 2024-09-14T11:41:13.445 INFO:tasks.workunit.client.0.smithi138.stderr: 7fdb97fe7640 / rgw_dt_lg_renew 2024-09-14T11:41:13.446 INFO:tasks.workunit.client.0.smithi138.stderr: 7fdbb6ffd640 / ms_dispatch 2024-09-14T11:41:13.446 INFO:tasks.workunit.client.0.smithi138.stderr: 7fdbb7fff640 / io_context_pool 2024-09-14T11:41:13.446 INFO:tasks.workunit.client.0.smithi138.stderr: 7fdbc4ff9640 / io_context_pool 2024-09-14T11:41:13.446 INFO:tasks.workunit.client.0.smithi138.stderr: 7fdbc6ffd640 / ms_dispatch 2024-09-14T11:41:13.446 INFO:tasks.workunit.client.0.smithi138.stderr: 7fdbcde03640 / ms_dispatch 2024-09-14T11:41:13.446 INFO:tasks.workunit.client.0.smithi138.stderr: 7fdbcf606640 / io_context_pool 2024-09-14T11:41:13.446 INFO:tasks.workunit.client.0.smithi138.stderr: 7fdce0f2c640 / msgr-worker-2 2024-09-14T11:41:13.446 INFO:tasks.workunit.client.0.smithi138.stderr: 7fdce172d640 / msgr-worker-1 2024-09-14T11:41:13.446 INFO:tasks.workunit.client.0.smithi138.stderr: 7fdce1f2e640 / msgr-worker-0 2024-09-14T11:41:13.446 INFO:tasks.workunit.client.0.smithi138.stderr: 7fdce272f640 / io_context_pool 2024-09-14T11:41:13.446 INFO:tasks.workunit.client.0.smithi138.stderr: 7fdce3c279c0 / radosgw-admin 2024-09-14T11:41:13.446 INFO:tasks.workunit.client.0.smithi138.stderr: max_recent 500 2024-09-14T11:41:13.446 INFO:tasks.workunit.client.0.smithi138.stderr: max_new 1000 2024-09-14T11:41:13.446 INFO:tasks.workunit.client.0.smithi138.stderr: log_file /var/lib/ceph/crash/2024-09-14T11:41:13.319913Z_eaca72ea-9126-4c55-ace7-c1d3c3735d74/log 2024-09-14T11:41:13.446 INFO:tasks.workunit.client.0.smithi138.stderr:--- end dump of recent events --- 2024-09-14T11:41:13.447 INFO:tasks.workunit.client.0.smithi138.stderr:Aborted 2024-09-14T11:41:13.447 INFO:tasks.workunit.client.0.smithi138.stderr:radosgw-admin bucket stats --bucket a-bucket 2024-09-14T11:41:13.451 INFO:tasks.workunit.client.0.smithi138.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:41:13.451 INFO:tasks.workunit.client.0.smithi138.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:41:13.451 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:13.398+0000 7fa50ae139c0 20 rados->read ofs=0 len=0 2024-09-14T11:41:13.451 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:13.398+0000 7fa50ae139c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:41:13.451 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:13.398+0000 7fa50ae139c0 20 realm 2024-09-14T11:41:13.451 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:13.398+0000 7fa50ae139c0 20 rados->read ofs=0 len=0 2024-09-14T11:41:13.452 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:13.398+0000 7fa50ae139c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:41:13.452 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:13.398+0000 7fa50ae139c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:41:13.452 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:13.398+0000 7fa50ae139c0 20 rados->read ofs=0 len=0 2024-09-14T11:41:13.452 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:13.398+0000 7fa50ae139c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:41:13.452 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:13.398+0000 7fa50ae139c0 20 rados->read ofs=0 len=0 2024-09-14T11:41:13.452 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:13.402+0000 7fa50ae139c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:41:13.452 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:13.402+0000 7fa50ae139c0 20 rados->read ofs=0 len=0 2024-09-14T11:41:13.452 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:13.402+0000 7fa50ae139c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:41:13.452 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:13.402+0000 7fa50ae139c0 20 searching for the correct realm 2024-09-14T11:41:13.452 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:13.406+0000 7fa508919640 0 -- 172.21.15.138:0/3117065835 >> [v2:172.21.15.138:6808/3258321916,v1:172.21.15.138:6809/3258321916] conn(0x5579a1690550 msgr2=0x5579a1692a10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:41:13.452 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:13.410+0000 7fa508118640 0 -- 172.21.15.138:0/3117065835 >> [v2:172.21.15.138:6816/326481658,v1:172.21.15.138:6817/326481658] conn(0x7fa500110c00 msgr2=0x7fa500107d50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:41:13.452 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:13.418+0000 7fa50ae139c0 20 RGWRados::pool_iterate: got zone_info.d9e72d30-c60b-4d0d-9267-fdc36392d5ad 2024-09-14T11:41:13.452 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:13.418+0000 7fa50ae139c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:41:13.452 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:13.418+0000 7fa50ae139c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:41:13.453 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:13.418+0000 7fa50ae139c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:41:13.453 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:13.418+0000 7fa50ae139c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:41:13.453 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:13.418+0000 7fa50ae139c0 20 RGWRados::pool_iterate: got zonegroup_info.65ab941b-da8c-4160-94fb-3672b069d44f 2024-09-14T11:41:13.453 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:13.418+0000 7fa50ae139c0 20 rados->read ofs=0 len=0 2024-09-14T11:41:13.453 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:13.422+0000 7fa50ae139c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:41:13.453 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:13.422+0000 7fa50ae139c0 20 rados->read ofs=0 len=0 2024-09-14T11:41:13.453 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:13.422+0000 7fa50ae139c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:41:13.453 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:13.422+0000 7fa50ae139c0 20 rados->read ofs=0 len=0 2024-09-14T11:41:13.453 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:13.422+0000 7fa50ae139c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:41:13.453 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:13.422+0000 7fa50ae139c0 20 zone default found 2024-09-14T11:41:13.453 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:13.422+0000 7fa50ae139c0 4 Realm: () 2024-09-14T11:41:13.453 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:13.422+0000 7fa50ae139c0 4 ZoneGroup: default (65ab941b-da8c-4160-94fb-3672b069d44f) 2024-09-14T11:41:13.453 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:13.422+0000 7fa50ae139c0 4 Zone: default (d9e72d30-c60b-4d0d-9267-fdc36392d5ad) 2024-09-14T11:41:13.453 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:13.422+0000 7fa50ae139c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:41:13.454 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:13.422+0000 7fa50ae139c0 20 zonegroup default 2024-09-14T11:41:13.454 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:13.422+0000 7fa50ae139c0 20 rados->read ofs=0 len=0 2024-09-14T11:41:13.454 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:13.422+0000 7fa50ae139c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:41:13.454 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:13.422+0000 7fa50ae139c0 20 rados->read ofs=0 len=0 2024-09-14T11:41:13.454 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:13.422+0000 7fa50ae139c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:41:13.454 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:13.422+0000 7fa50ae139c0 20 rados->read ofs=0 len=0 2024-09-14T11:41:13.454 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:13.422+0000 7fa50ae139c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:41:13.454 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:13.422+0000 7fa50ae139c0 20 started sync module instance, tier type = 2024-09-14T11:41:13.454 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:13.422+0000 7fa50ae139c0 20 started zone id=d9e72d30-c60b-4d0d-9267-fdc36392d5ad (name=default) with tier type = 2024-09-14T11:41:13.454 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:13.438+0000 7fa50ae139c0 20 add_watcher() i=0 2024-09-14T11:41:13.454 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:13.438+0000 7fa50ae139c0 20 add_watcher() i=1 2024-09-14T11:41:13.454 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:13.438+0000 7fa50ae139c0 20 add_watcher() i=2 2024-09-14T11:41:13.454 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:13.438+0000 7fa50ae139c0 20 add_watcher() i=3 2024-09-14T11:41:13.454 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:13.438+0000 7fa50ae139c0 20 add_watcher() i=4 2024-09-14T11:41:13.454 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:13.438+0000 7fa50ae139c0 20 add_watcher() i=5 2024-09-14T11:41:13.455 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:13.438+0000 7fa50ae139c0 20 add_watcher() i=6 2024-09-14T11:41:13.455 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:13.442+0000 7fa50ae139c0 20 add_watcher() i=7 2024-09-14T11:41:13.455 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:13.442+0000 7fa50ae139c0 2 all 8 watchers are set, enabling cache 2024-09-14T11:41:13.455 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:13.442+0000 7fa3befe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:41:13.455 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:13.442+0000 7fa50ae139c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:41:13.455 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:13.442+0000 7fa50ae139c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:41:13.455 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:13.442+0000 7fa50ae139c0 5 note: GC not initialized 2024-09-14T11:41:13.455 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:13.446+0000 7fa3bdfe3640 20 reqs_thread_entry: start 2024-09-14T11:41:13.455 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:13.446+0000 7fa50ae139c0 20 init_complete bucket index max shards: 11 2024-09-14T11:41:13.455 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:13.446+0000 7fa50ae139c0 20 Filter name: none 2024-09-14T11:41:13.455 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:13.446+0000 7fa32f7fe640 20 reqs_thread_entry: start 2024-09-14T11:41:13.455 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:13.446+0000 7fa50ae139c0 20 rados->read ofs=0 len=0 2024-09-14T11:41:13.455 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:13.446+0000 7fa50ae139c0 20 rados_obj.operate() r=0 bl.length=176 2024-09-14T11:41:13.455 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:13.446+0000 7fa50ae139c0 20 rados->read ofs=0 len=0 2024-09-14T11:41:13.455 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:13.446+0000 7fa50ae139c0 20 rados_obj.operate() r=0 bl.length=430 2024-09-14T11:41:13.456 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:13.446+0000 7fa50ae139c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:41:13.456 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:13.446+0000 7fa50ae139c0 20 rados->read ofs=0 len=0 2024-09-14T11:41:13.456 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:13.446+0000 7fa50ae139c0 20 rados_obj.operate() r=0 bl.length=176 2024-09-14T11:41:13.456 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:13.446+0000 7fa50ae139c0 20 rados->read ofs=0 len=0 2024-09-14T11:41:13.456 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:13.446+0000 7fa50ae139c0 20 rados_obj.operate() r=0 bl.length=430 2024-09-14T11:41:13.456 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:13.446+0000 7fa50ae139c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:41:13.456 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:13.450+0000 7fa3befe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:41:13.456 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:13.454+0000 7fa50ae139c0 20 remove_watcher() i=0 2024-09-14T11:41:13.456 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:13.454+0000 7fa50ae139c0 2 removed watcher, disabling cache 2024-09-14T11:41:13.457 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:13.458+0000 7fa50ae139c0 20 remove_watcher() i=1 2024-09-14T11:41:13.459 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:13.458+0000 7fa50ae139c0 20 remove_watcher() i=2 2024-09-14T11:41:13.460 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:13.462+0000 7fa50ae139c0 20 remove_watcher() i=3 2024-09-14T11:41:13.462 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:13.462+0000 7fa50ae139c0 20 remove_watcher() i=4 2024-09-14T11:41:13.463 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:13.462+0000 7fa50ae139c0 20 remove_watcher() i=5 2024-09-14T11:41:13.465 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:13.466+0000 7fa50ae139c0 20 remove_watcher() i=6 2024-09-14T11:41:13.466 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:13.466+0000 7fa50ae139c0 20 remove_watcher() i=7 2024-09-14T11:41:13.480 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:41:13.481 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-14T11:41:13.525 INFO:tasks.workunit.client.0.smithi138.stderr:radosgw-admin reshardlog list --bucket a-bucket 2024-09-14T11:41:13.551 INFO:tasks.workunit.client.0.smithi138.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:41:13.551 INFO:tasks.workunit.client.0.smithi138.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:41:13.593 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:13.594+0000 7f6e13c049c0 20 rados->read ofs=0 len=0 2024-09-14T11:41:13.595 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:13.594+0000 7f6e13c049c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:41:13.595 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:13.594+0000 7f6e13c049c0 20 realm 2024-09-14T11:41:13.595 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:13.594+0000 7f6e13c049c0 20 rados->read ofs=0 len=0 2024-09-14T11:41:13.595 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:13.594+0000 7f6e13c049c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:41:13.595 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:13.594+0000 7f6e13c049c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:41:13.595 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:13.594+0000 7f6e13c049c0 20 rados->read ofs=0 len=0 2024-09-14T11:41:13.595 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:13.594+0000 7f6e13c049c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:41:13.595 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:13.594+0000 7f6e13c049c0 20 rados->read ofs=0 len=0 2024-09-14T11:41:13.597 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:13.598+0000 7f6e13c049c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:41:13.597 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:13.598+0000 7f6e13c049c0 20 rados->read ofs=0 len=0 2024-09-14T11:41:13.598 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:13.598+0000 7f6e13c049c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:41:13.598 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:13.598+0000 7f6e13c049c0 20 searching for the correct realm 2024-09-14T11:41:13.602 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:13.602+0000 7f6e11f0b640 0 -- 172.21.15.138:0/2436037176 >> [v2:172.21.15.154:6824/416768175,v1:172.21.15.154:6825/416768175] conn(0x7f6e0c0da040 msgr2=0x7f6e0c0dc950 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:41:13.608 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:13.610+0000 7f6e10f09640 0 -- 172.21.15.138:0/2436037176 >> [v2:172.21.15.138:6816/326481658,v1:172.21.15.138:6817/326481658] conn(0x7f6e0c0cd920 msgr2=0x7f6e0c0ed3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:41:13.829 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:13.830+0000 7f6e13c049c0 20 RGWRados::pool_iterate: got zone_info.d9e72d30-c60b-4d0d-9267-fdc36392d5ad 2024-09-14T11:41:13.829 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:13.830+0000 7f6e13c049c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:41:13.829 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:13.830+0000 7f6e13c049c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:41:13.829 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:13.830+0000 7f6e13c049c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:41:13.829 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:13.830+0000 7f6e13c049c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:41:13.829 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:13.830+0000 7f6e13c049c0 20 RGWRados::pool_iterate: got zonegroup_info.65ab941b-da8c-4160-94fb-3672b069d44f 2024-09-14T11:41:13.829 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:13.830+0000 7f6e13c049c0 20 rados->read ofs=0 len=0 2024-09-14T11:41:13.829 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:13.830+0000 7f6e13c049c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:41:13.829 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:13.830+0000 7f6e13c049c0 20 rados->read ofs=0 len=0 2024-09-14T11:41:13.830 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:13.830+0000 7f6e13c049c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:41:13.830 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:13.830+0000 7f6e13c049c0 20 rados->read ofs=0 len=0 2024-09-14T11:41:13.831 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:13.830+0000 7f6e13c049c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:41:13.831 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:13.830+0000 7f6e13c049c0 20 zone default found 2024-09-14T11:41:13.831 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:13.830+0000 7f6e13c049c0 4 Realm: () 2024-09-14T11:41:13.831 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:13.830+0000 7f6e13c049c0 4 ZoneGroup: default (65ab941b-da8c-4160-94fb-3672b069d44f) 2024-09-14T11:41:13.831 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:13.830+0000 7f6e13c049c0 4 Zone: default (d9e72d30-c60b-4d0d-9267-fdc36392d5ad) 2024-09-14T11:41:13.831 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:13.830+0000 7f6e13c049c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:41:13.832 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:13.830+0000 7f6e13c049c0 20 zonegroup default 2024-09-14T11:41:13.832 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:13.830+0000 7f6e13c049c0 20 rados->read ofs=0 len=0 2024-09-14T11:41:13.832 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:13.830+0000 7f6e13c049c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:41:13.832 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:13.830+0000 7f6e13c049c0 20 rados->read ofs=0 len=0 2024-09-14T11:41:13.832 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:13.834+0000 7f6e13c049c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:41:13.832 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:13.834+0000 7f6e13c049c0 20 rados->read ofs=0 len=0 2024-09-14T11:41:13.833 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:13.834+0000 7f6e13c049c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:41:13.833 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:13.834+0000 7f6e13c049c0 20 started sync module instance, tier type = 2024-09-14T11:41:13.833 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:13.834+0000 7f6e13c049c0 20 started zone id=d9e72d30-c60b-4d0d-9267-fdc36392d5ad (name=default) with tier type = 2024-09-14T11:41:13.855 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:13.854+0000 7f6e13c049c0 20 add_watcher() i=0 2024-09-14T11:41:13.855 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:13.854+0000 7f6e13c049c0 20 add_watcher() i=1 2024-09-14T11:41:13.855 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:13.854+0000 7f6e13c049c0 20 add_watcher() i=2 2024-09-14T11:41:13.855 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:13.854+0000 7f6e13c049c0 20 add_watcher() i=3 2024-09-14T11:41:13.855 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:13.854+0000 7f6e13c049c0 20 add_watcher() i=4 2024-09-14T11:41:13.855 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:13.854+0000 7f6e13c049c0 20 add_watcher() i=5 2024-09-14T11:41:13.855 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:13.854+0000 7f6e13c049c0 20 add_watcher() i=6 2024-09-14T11:41:13.857 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:13.858+0000 7f6e13c049c0 20 add_watcher() i=7 2024-09-14T11:41:13.857 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:13.858+0000 7f6e13c049c0 2 all 8 watchers are set, enabling cache 2024-09-14T11:41:13.861 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:13.862+0000 7f6cc77e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:41:13.862 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:13.862+0000 7f6e13c049c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:41:13.862 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:13.862+0000 7f6e13c049c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:41:13.862 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:13.862+0000 7f6e13c049c0 5 note: GC not initialized 2024-09-14T11:41:13.862 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:13.862+0000 7f6cc67e4640 20 reqs_thread_entry: start 2024-09-14T11:41:13.863 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:13.862+0000 7f6e13c049c0 20 init_complete bucket index max shards: 11 2024-09-14T11:41:13.863 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:13.862+0000 7f6e13c049c0 20 Filter name: none 2024-09-14T11:41:13.863 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:13.862+0000 7f6c37fff640 20 reqs_thread_entry: start 2024-09-14T11:41:13.863 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:13.862+0000 7f6e13c049c0 10 cache get: name=default.rgw.meta+root+a-bucket : miss 2024-09-14T11:41:13.863 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:13.862+0000 7f6e13c049c0 20 rados->read ofs=0 len=0 2024-09-14T11:41:13.864 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:13.866+0000 7f6e13c049c0 20 rados_obj.operate() r=0 bl.length=176 2024-09-14T11:41:13.864 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:13.866+0000 7f6e13c049c0 10 cache put: name=default.rgw.meta+root+a-bucket info.flags=0x11 2024-09-14T11:41:13.864 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:13.866+0000 7f6e13c049c0 10 adding default.rgw.meta+root+a-bucket to cache LRU end 2024-09-14T11:41:13.864 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:13.866+0000 7f6e13c049c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.17 : miss 2024-09-14T11:41:13.865 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:13.866+0000 7f6e13c049c0 20 rados->read ofs=0 len=0 2024-09-14T11:41:13.865 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:13.866+0000 7f6e13c049c0 20 rados_obj.operate() r=0 bl.length=430 2024-09-14T11:41:13.865 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:13.866+0000 7f6e13c049c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.17 info.flags=0x17 2024-09-14T11:41:13.865 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:13.866+0000 7f6e13c049c0 10 adding default.rgw.meta+root+.bucket.meta.a-bucket:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.17 to cache LRU end 2024-09-14T11:41:13.865 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:13.866+0000 7f6e13c049c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:41:13.866 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:13.866+0000 7f6e13c049c0 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-14T11:41:13.866 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:13.866+0000 7f6e13c049c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.17 2024-09-14T11:41:13.866 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:13.866+0000 7f6e13c049c0 10 bucket_obj is .dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.17.2.0 2024-09-14T11:41:13.866 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:13.866+0000 7f6e13c049c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.17.2.0 2024-09-14T11:41:13.866 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:13.866+0000 7f6e13c049c0 10 bucket_obj is .dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.17.2.1 2024-09-14T11:41:13.866 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:13.866+0000 7f6e13c049c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.17.2.1 2024-09-14T11:41:13.867 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:13.866+0000 7f6e13c049c0 10 bucket_obj is .dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.17.2.2 2024-09-14T11:41:13.867 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:13.866+0000 7f6e13c049c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.17.2.2 2024-09-14T11:41:13.867 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:13.866+0000 7f6e13c049c0 10 bucket_obj is .dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.17.2.3 2024-09-14T11:41:13.867 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:13.866+0000 7f6e13c049c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.17.2.3 2024-09-14T11:41:13.868 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:13.870+0000 7f6e13c049c0 10 bucket_obj is .dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.17.2.4 2024-09-14T11:41:13.868 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:13.870+0000 7f6e13c049c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.17.2.4 2024-09-14T11:41:13.869 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:13.870+0000 7f6e13c049c0 10 bucket_obj is .dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.17.2.5 2024-09-14T11:41:13.869 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:13.870+0000 7f6e13c049c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.17.2.5 2024-09-14T11:41:13.870 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:13.870+0000 7f6e13c049c0 10 bucket_obj is .dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.17.2.6 2024-09-14T11:41:13.870 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:13.870+0000 7f6e13c049c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.17.2.6 2024-09-14T11:41:13.871 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:13.870+0000 7f6e13c049c0 10 bucket_obj is .dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.17.2.7 2024-09-14T11:41:13.871 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:13.870+0000 7f6e13c049c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.17.2.7 2024-09-14T11:41:13.872 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:13.874+0000 7f6e13c049c0 10 bucket_obj is .dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.17.2.8 2024-09-14T11:41:13.872 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:13.874+0000 7f6e13c049c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.17.2.8 2024-09-14T11:41:13.873 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:13.874+0000 7f6e13c049c0 10 bucket_obj is .dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.17.2.9 2024-09-14T11:41:13.873 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:13.874+0000 7f6e13c049c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.17.2.9 2024-09-14T11:41:13.874 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:13.874+0000 7f6e13c049c0 10 bucket_obj is .dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.17.2.10 2024-09-14T11:41:13.874 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:13.874+0000 7f6e13c049c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.17.2.10 2024-09-14T11:41:13.874 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:13.874+0000 7f6e13c049c0 10 bucket_obj is .dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.17.2.11 2024-09-14T11:41:13.875 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:13.874+0000 7f6e13c049c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.17.2.11 2024-09-14T11:41:13.875 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:13.874+0000 7f6e13c049c0 10 bucket_obj is .dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.17.2.12 2024-09-14T11:41:13.875 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:13.874+0000 7f6e13c049c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.17.2.12 2024-09-14T11:41:13.878 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:13.878+0000 7f6cc77e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:41:13.882 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:13.882+0000 7f6e13c049c0 20 remove_watcher() i=0 2024-09-14T11:41:13.883 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:13.882+0000 7f6e13c049c0 2 removed watcher, disabling cache 2024-09-14T11:41:13.885 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:13.886+0000 7f6e13c049c0 20 remove_watcher() i=1 2024-09-14T11:41:13.887 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:13.886+0000 7f6e13c049c0 20 remove_watcher() i=2 2024-09-14T11:41:13.889 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:13.890+0000 7f6e13c049c0 20 remove_watcher() i=3 2024-09-14T11:41:13.891 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:13.890+0000 7f6e13c049c0 20 remove_watcher() i=4 2024-09-14T11:41:13.893 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:13.894+0000 7f6e13c049c0 20 remove_watcher() i=5 2024-09-14T11:41:13.895 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:13.894+0000 7f6e13c049c0 20 remove_watcher() i=6 2024-09-14T11:41:13.896 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:13.898+0000 7f6e13c049c0 20 remove_watcher() i=7 2024-09-14T11:41:43.941 INFO:tasks.workunit.client.0.smithi138.stderr:radosgw-admin reshardlog purge --bucket a-bucket 2024-09-14T11:41:43.974 INFO:tasks.workunit.client.0.smithi138.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:41:43.974 INFO:tasks.workunit.client.0.smithi138.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:41:44.020 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:44.021+0000 7f88fac789c0 20 rados->read ofs=0 len=0 2024-09-14T11:41:44.022 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:44.021+0000 7f88fac789c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:41:44.022 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:44.021+0000 7f88fac789c0 20 realm 2024-09-14T11:41:44.022 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:44.021+0000 7f88fac789c0 20 rados->read ofs=0 len=0 2024-09-14T11:41:44.022 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:44.021+0000 7f88fac789c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:41:44.022 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:44.021+0000 7f88fac789c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:41:44.023 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:44.021+0000 7f88fac789c0 20 rados->read ofs=0 len=0 2024-09-14T11:41:44.023 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:44.021+0000 7f88fac789c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:41:44.023 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:44.021+0000 7f88fac789c0 20 rados->read ofs=0 len=0 2024-09-14T11:41:44.024 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:44.025+0000 7f88fac789c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:41:44.024 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:44.025+0000 7f88fac789c0 20 rados->read ofs=0 len=0 2024-09-14T11:41:44.025 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:44.025+0000 7f88fac789c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:41:44.025 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:44.025+0000 7f88fac789c0 20 searching for the correct realm 2024-09-14T11:41:44.028 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:44.029+0000 7f88f8f7f640 0 -- 172.21.15.138:0/608464277 >> [v2:172.21.15.154:6824/416768175,v1:172.21.15.154:6825/416768175] conn(0x7f88f00c2bd0 msgr2=0x7f88f0104820 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-14T11:41:44.245 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:44.245+0000 7f88f7f7d640 0 -- 172.21.15.138:0/608464277 >> [v2:172.21.15.138:6816/326481658,v1:172.21.15.138:6817/326481658] conn(0x7f88f01070a0 msgr2=0x7f88f0105970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:41:44.462 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:44.461+0000 7f88fac789c0 20 RGWRados::pool_iterate: got zone_info.d9e72d30-c60b-4d0d-9267-fdc36392d5ad 2024-09-14T11:41:44.463 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:44.461+0000 7f88fac789c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:41:44.463 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:44.461+0000 7f88fac789c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:41:44.463 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:44.461+0000 7f88fac789c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:41:44.463 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:44.461+0000 7f88fac789c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:41:44.463 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:44.461+0000 7f88fac789c0 20 RGWRados::pool_iterate: got zonegroup_info.65ab941b-da8c-4160-94fb-3672b069d44f 2024-09-14T11:41:44.463 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:44.461+0000 7f88fac789c0 20 rados->read ofs=0 len=0 2024-09-14T11:41:44.464 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:44.461+0000 7f88fac789c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:41:44.464 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:44.461+0000 7f88fac789c0 20 rados->read ofs=0 len=0 2024-09-14T11:41:44.464 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:44.461+0000 7f88fac789c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:41:44.464 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:44.461+0000 7f88fac789c0 20 rados->read ofs=0 len=0 2024-09-14T11:41:44.465 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:44.465+0000 7f88fac789c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:41:44.465 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:44.465+0000 7f88fac789c0 20 zone default found 2024-09-14T11:41:44.465 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:44.465+0000 7f88fac789c0 4 Realm: () 2024-09-14T11:41:44.466 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:44.465+0000 7f88fac789c0 4 ZoneGroup: default (65ab941b-da8c-4160-94fb-3672b069d44f) 2024-09-14T11:41:44.466 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:44.465+0000 7f88fac789c0 4 Zone: default (d9e72d30-c60b-4d0d-9267-fdc36392d5ad) 2024-09-14T11:41:44.466 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:44.465+0000 7f88fac789c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:41:44.466 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:44.465+0000 7f88fac789c0 20 zonegroup default 2024-09-14T11:41:44.466 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:44.465+0000 7f88fac789c0 20 rados->read ofs=0 len=0 2024-09-14T11:41:44.466 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:44.465+0000 7f88fac789c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:41:44.466 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:44.465+0000 7f88fac789c0 20 rados->read ofs=0 len=0 2024-09-14T11:41:44.467 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:44.465+0000 7f88fac789c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:41:44.467 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:44.465+0000 7f88fac789c0 20 rados->read ofs=0 len=0 2024-09-14T11:41:44.467 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:44.465+0000 7f88fac789c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:41:44.467 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:44.465+0000 7f88fac789c0 20 started sync module instance, tier type = 2024-09-14T11:41:44.467 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:44.465+0000 7f88fac789c0 20 started zone id=d9e72d30-c60b-4d0d-9267-fdc36392d5ad (name=default) with tier type = 2024-09-14T11:41:44.488 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:44.485+0000 7f88fac789c0 20 add_watcher() i=0 2024-09-14T11:41:44.488 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:44.485+0000 7f88fac789c0 20 add_watcher() i=1 2024-09-14T11:41:44.488 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:44.485+0000 7f88fac789c0 20 add_watcher() i=2 2024-09-14T11:41:44.489 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:44.485+0000 7f88fac789c0 20 add_watcher() i=3 2024-09-14T11:41:44.489 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:44.485+0000 7f88fac789c0 20 add_watcher() i=4 2024-09-14T11:41:44.489 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:44.485+0000 7f88fac789c0 20 add_watcher() i=5 2024-09-14T11:41:44.489 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:44.489+0000 7f88fac789c0 20 add_watcher() i=6 2024-09-14T11:41:44.490 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:44.489+0000 7f88fac789c0 20 add_watcher() i=7 2024-09-14T11:41:44.490 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:44.489+0000 7f88fac789c0 2 all 8 watchers are set, enabling cache 2024-09-14T11:41:44.493 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:44.493+0000 7f87aefe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:41:44.494 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:44.493+0000 7f88fac789c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:41:44.495 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:44.493+0000 7f88fac789c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:41:44.495 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:44.493+0000 7f88fac789c0 5 note: GC not initialized 2024-09-14T11:41:44.496 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:44.493+0000 7f87adfe3640 20 reqs_thread_entry: start 2024-09-14T11:41:44.496 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:44.493+0000 7f88fac789c0 20 init_complete bucket index max shards: 11 2024-09-14T11:41:44.496 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:44.493+0000 7f88fac789c0 20 Filter name: none 2024-09-14T11:41:44.496 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:44.493+0000 7f87a6ffd640 20 reqs_thread_entry: start 2024-09-14T11:41:44.497 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:44.497+0000 7f88fac789c0 10 cache get: name=default.rgw.meta+root+a-bucket : miss 2024-09-14T11:41:44.497 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:44.497+0000 7f88fac789c0 20 rados->read ofs=0 len=0 2024-09-14T11:41:44.498 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:44.497+0000 7f88fac789c0 20 rados_obj.operate() r=0 bl.length=176 2024-09-14T11:41:44.498 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:44.497+0000 7f88fac789c0 10 cache put: name=default.rgw.meta+root+a-bucket info.flags=0x11 2024-09-14T11:41:44.498 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:44.497+0000 7f88fac789c0 10 adding default.rgw.meta+root+a-bucket to cache LRU end 2024-09-14T11:41:44.498 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:44.497+0000 7f88fac789c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.17 : miss 2024-09-14T11:41:44.498 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:44.497+0000 7f88fac789c0 20 rados->read ofs=0 len=0 2024-09-14T11:41:44.498 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:44.497+0000 7f88fac789c0 20 rados_obj.operate() r=0 bl.length=430 2024-09-14T11:41:44.499 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:44.497+0000 7f88fac789c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.17 info.flags=0x17 2024-09-14T11:41:44.499 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:44.497+0000 7f88fac789c0 10 adding default.rgw.meta+root+.bucket.meta.a-bucket:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.17 to cache LRU end 2024-09-14T11:41:44.499 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:44.497+0000 7f88fac789c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:41:44.499 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:44.497+0000 7f88fac789c0 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-14T11:41:44.499 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:44.497+0000 7f88fac789c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.17 2024-09-14T11:41:44.508 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:44.509+0000 7f87aefe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:41:44.513 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:44.513+0000 7f88fac789c0 20 remove_watcher() i=0 2024-09-14T11:41:44.513 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:44.513+0000 7f88fac789c0 2 removed watcher, disabling cache 2024-09-14T11:41:44.515 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:44.513+0000 7f88fac789c0 20 remove_watcher() i=1 2024-09-14T11:41:44.517 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:44.517+0000 7f88fac789c0 20 remove_watcher() i=2 2024-09-14T11:41:44.519 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:44.517+0000 7f88fac789c0 20 remove_watcher() i=3 2024-09-14T11:41:44.521 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:44.521+0000 7f88fac789c0 20 remove_watcher() i=4 2024-09-14T11:41:44.523 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:44.521+0000 7f88fac789c0 20 remove_watcher() i=5 2024-09-14T11:41:44.524 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:44.525+0000 7f88fac789c0 20 remove_watcher() i=6 2024-09-14T11:41:44.525 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:44.525+0000 7f88fac789c0 20 remove_watcher() i=7 2024-09-14T11:41:44.541 INFO:tasks.workunit.client.0.smithi138.stderr:radosgw-admin reshardlog list --bucket a-bucket 2024-09-14T11:41:44.572 INFO:tasks.workunit.client.0.smithi138.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:41:44.572 INFO:tasks.workunit.client.0.smithi138.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:41:44.617 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:44.617+0000 7ff37ca5e9c0 20 rados->read ofs=0 len=0 2024-09-14T11:41:44.619 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:44.617+0000 7ff37ca5e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:41:44.619 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:44.617+0000 7ff37ca5e9c0 20 realm 2024-09-14T11:41:44.619 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:44.617+0000 7ff37ca5e9c0 20 rados->read ofs=0 len=0 2024-09-14T11:41:44.619 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:44.617+0000 7ff37ca5e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:41:44.619 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:44.617+0000 7ff37ca5e9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:41:44.619 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:44.617+0000 7ff37ca5e9c0 20 rados->read ofs=0 len=0 2024-09-14T11:41:44.619 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:44.617+0000 7ff37ca5e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:41:44.619 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:44.617+0000 7ff37ca5e9c0 20 rados->read ofs=0 len=0 2024-09-14T11:41:44.620 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:44.621+0000 7ff37ca5e9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:41:44.620 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:44.621+0000 7ff37ca5e9c0 20 rados->read ofs=0 len=0 2024-09-14T11:41:44.621 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:44.621+0000 7ff37ca5e9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:41:44.621 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:44.621+0000 7ff37ca5e9c0 20 searching for the correct realm 2024-09-14T11:41:44.625 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:44.625+0000 7ff37ad65640 0 -- 172.21.15.138:0/3085075226 >> [v2:172.21.15.154:6824/416768175,v1:172.21.15.154:6825/416768175] conn(0x7ff374041040 msgr2=0x7ff374035420 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:41:44.841 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:44.841+0000 7ff379d63640 0 -- 172.21.15.138:0/3085075226 >> [v2:172.21.15.138:6816/326481658,v1:172.21.15.138:6817/326481658] conn(0x7ff374016040 msgr2=0x7ff3740408c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:41:45.060 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:45.061+0000 7ff37ca5e9c0 20 RGWRados::pool_iterate: got zone_info.d9e72d30-c60b-4d0d-9267-fdc36392d5ad 2024-09-14T11:41:45.060 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:45.061+0000 7ff37ca5e9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:41:45.061 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:45.061+0000 7ff37ca5e9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:41:45.061 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:45.061+0000 7ff37ca5e9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:41:45.061 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:45.061+0000 7ff37ca5e9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:41:45.061 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:45.061+0000 7ff37ca5e9c0 20 RGWRados::pool_iterate: got zonegroup_info.65ab941b-da8c-4160-94fb-3672b069d44f 2024-09-14T11:41:45.061 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:45.061+0000 7ff37ca5e9c0 20 rados->read ofs=0 len=0 2024-09-14T11:41:45.061 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:45.061+0000 7ff37ca5e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:41:45.061 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:45.061+0000 7ff37ca5e9c0 20 rados->read ofs=0 len=0 2024-09-14T11:41:45.062 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:45.061+0000 7ff37ca5e9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:41:45.062 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:45.061+0000 7ff37ca5e9c0 20 rados->read ofs=0 len=0 2024-09-14T11:41:45.063 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:45.061+0000 7ff37ca5e9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:41:45.063 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:45.061+0000 7ff37ca5e9c0 20 zone default found 2024-09-14T11:41:45.063 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:45.061+0000 7ff37ca5e9c0 4 Realm: () 2024-09-14T11:41:45.063 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:45.061+0000 7ff37ca5e9c0 4 ZoneGroup: default (65ab941b-da8c-4160-94fb-3672b069d44f) 2024-09-14T11:41:45.063 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:45.061+0000 7ff37ca5e9c0 4 Zone: default (d9e72d30-c60b-4d0d-9267-fdc36392d5ad) 2024-09-14T11:41:45.063 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:45.061+0000 7ff37ca5e9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:41:45.063 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:45.061+0000 7ff37ca5e9c0 20 zonegroup default 2024-09-14T11:41:45.063 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:45.061+0000 7ff37ca5e9c0 20 rados->read ofs=0 len=0 2024-09-14T11:41:45.064 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:45.061+0000 7ff37ca5e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:41:45.064 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:45.061+0000 7ff37ca5e9c0 20 rados->read ofs=0 len=0 2024-09-14T11:41:45.064 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:45.065+0000 7ff37ca5e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:41:45.064 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:45.065+0000 7ff37ca5e9c0 20 rados->read ofs=0 len=0 2024-09-14T11:41:45.065 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:45.065+0000 7ff37ca5e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:41:45.065 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:45.065+0000 7ff37ca5e9c0 20 started sync module instance, tier type = 2024-09-14T11:41:45.065 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:45.065+0000 7ff37ca5e9c0 20 started zone id=d9e72d30-c60b-4d0d-9267-fdc36392d5ad (name=default) with tier type = 2024-09-14T11:41:45.088 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:45.089+0000 7ff37ca5e9c0 20 add_watcher() i=0 2024-09-14T11:41:45.089 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:45.089+0000 7ff37ca5e9c0 20 add_watcher() i=1 2024-09-14T11:41:45.089 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:45.089+0000 7ff37ca5e9c0 20 add_watcher() i=2 2024-09-14T11:41:45.089 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:45.089+0000 7ff37ca5e9c0 20 add_watcher() i=3 2024-09-14T11:41:45.089 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:45.089+0000 7ff37ca5e9c0 20 add_watcher() i=4 2024-09-14T11:41:45.089 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:45.089+0000 7ff37ca5e9c0 20 add_watcher() i=5 2024-09-14T11:41:45.089 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:45.089+0000 7ff37ca5e9c0 20 add_watcher() i=6 2024-09-14T11:41:45.091 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:45.089+0000 7ff37ca5e9c0 20 add_watcher() i=7 2024-09-14T11:41:45.091 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:45.089+0000 7ff37ca5e9c0 2 all 8 watchers are set, enabling cache 2024-09-14T11:41:45.095 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:45.093+0000 7ff230fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:41:45.096 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:45.093+0000 7ff37ca5e9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:41:45.096 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:45.093+0000 7ff37ca5e9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:41:45.096 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:45.097+0000 7ff37ca5e9c0 5 note: GC not initialized 2024-09-14T11:41:45.097 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:45.097+0000 7ff1ab7fe640 20 reqs_thread_entry: start 2024-09-14T11:41:45.097 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:45.097+0000 7ff37ca5e9c0 20 init_complete bucket index max shards: 11 2024-09-14T11:41:45.097 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:45.097+0000 7ff37ca5e9c0 20 Filter name: none 2024-09-14T11:41:45.097 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:45.097+0000 7ff1a97fa640 20 reqs_thread_entry: start 2024-09-14T11:41:45.097 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:45.097+0000 7ff37ca5e9c0 10 cache get: name=default.rgw.meta+root+a-bucket : miss 2024-09-14T11:41:45.097 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:45.097+0000 7ff37ca5e9c0 20 rados->read ofs=0 len=0 2024-09-14T11:41:45.098 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:45.097+0000 7ff37ca5e9c0 20 rados_obj.operate() r=0 bl.length=176 2024-09-14T11:41:45.098 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:45.097+0000 7ff37ca5e9c0 10 cache put: name=default.rgw.meta+root+a-bucket info.flags=0x11 2024-09-14T11:41:45.098 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:45.097+0000 7ff37ca5e9c0 10 adding default.rgw.meta+root+a-bucket to cache LRU end 2024-09-14T11:41:45.099 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:45.097+0000 7ff37ca5e9c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.17 : miss 2024-09-14T11:41:45.099 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:45.097+0000 7ff37ca5e9c0 20 rados->read ofs=0 len=0 2024-09-14T11:41:45.099 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:45.097+0000 7ff37ca5e9c0 20 rados_obj.operate() r=0 bl.length=430 2024-09-14T11:41:45.099 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:45.097+0000 7ff37ca5e9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.17 info.flags=0x17 2024-09-14T11:41:45.100 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:45.097+0000 7ff37ca5e9c0 10 adding default.rgw.meta+root+.bucket.meta.a-bucket:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.17 to cache LRU end 2024-09-14T11:41:45.100 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:45.097+0000 7ff37ca5e9c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:41:45.100 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:45.097+0000 7ff37ca5e9c0 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-14T11:41:45.100 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:45.097+0000 7ff37ca5e9c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.17 2024-09-14T11:41:45.100 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:45.097+0000 7ff37ca5e9c0 10 bucket_obj is .dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.17.2.0 2024-09-14T11:41:45.100 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:45.097+0000 7ff37ca5e9c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.17.2.0 2024-09-14T11:41:45.100 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:45.101+0000 7ff37ca5e9c0 10 bucket_obj is .dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.17.2.1 2024-09-14T11:41:45.100 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:45.101+0000 7ff37ca5e9c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.17.2.1 2024-09-14T11:41:45.101 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:45.101+0000 7ff37ca5e9c0 10 bucket_obj is .dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.17.2.2 2024-09-14T11:41:45.101 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:45.101+0000 7ff37ca5e9c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.17.2.2 2024-09-14T11:41:45.101 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:45.101+0000 7ff37ca5e9c0 10 bucket_obj is .dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.17.2.3 2024-09-14T11:41:45.102 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:45.101+0000 7ff37ca5e9c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.17.2.3 2024-09-14T11:41:45.102 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:45.101+0000 7ff37ca5e9c0 10 bucket_obj is .dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.17.2.4 2024-09-14T11:41:45.103 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:45.101+0000 7ff37ca5e9c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.17.2.4 2024-09-14T11:41:45.103 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:45.101+0000 7ff37ca5e9c0 10 bucket_obj is .dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.17.2.5 2024-09-14T11:41:45.103 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:45.101+0000 7ff37ca5e9c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.17.2.5 2024-09-14T11:41:45.104 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:45.105+0000 7ff37ca5e9c0 10 bucket_obj is .dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.17.2.6 2024-09-14T11:41:45.104 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:45.105+0000 7ff37ca5e9c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.17.2.6 2024-09-14T11:41:45.105 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:45.105+0000 7ff37ca5e9c0 10 bucket_obj is .dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.17.2.7 2024-09-14T11:41:45.105 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:45.105+0000 7ff37ca5e9c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.17.2.7 2024-09-14T11:41:45.105 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:45.105+0000 7ff37ca5e9c0 10 bucket_obj is .dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.17.2.8 2024-09-14T11:41:45.105 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:45.105+0000 7ff37ca5e9c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.17.2.8 2024-09-14T11:41:45.106 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:45.105+0000 7ff37ca5e9c0 10 bucket_obj is .dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.17.2.9 2024-09-14T11:41:45.106 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:45.105+0000 7ff37ca5e9c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.17.2.9 2024-09-14T11:41:45.107 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:45.105+0000 7ff37ca5e9c0 10 bucket_obj is .dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.17.2.10 2024-09-14T11:41:45.107 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:45.105+0000 7ff37ca5e9c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.17.2.10 2024-09-14T11:41:45.107 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:45.105+0000 7ff37ca5e9c0 10 bucket_obj is .dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.17.2.11 2024-09-14T11:41:45.107 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:45.105+0000 7ff37ca5e9c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.17.2.11 2024-09-14T11:41:45.108 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:45.105+0000 7ff37ca5e9c0 10 bucket_obj is .dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.17.2.12 2024-09-14T11:41:45.108 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:45.105+0000 7ff37ca5e9c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.17.2.12 2024-09-14T11:41:45.110 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:45.109+0000 7ff230fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:41:45.116 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:45.117+0000 7ff37ca5e9c0 20 remove_watcher() i=0 2024-09-14T11:41:45.116 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:45.117+0000 7ff37ca5e9c0 2 removed watcher, disabling cache 2024-09-14T11:41:45.118 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:45.117+0000 7ff37ca5e9c0 20 remove_watcher() i=1 2024-09-14T11:41:45.121 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:45.121+0000 7ff37ca5e9c0 20 remove_watcher() i=2 2024-09-14T11:41:45.123 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:45.121+0000 7ff37ca5e9c0 20 remove_watcher() i=3 2024-09-14T11:41:45.126 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:45.125+0000 7ff37ca5e9c0 20 remove_watcher() i=4 2024-09-14T11:41:45.127 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:45.125+0000 7ff37ca5e9c0 20 remove_watcher() i=5 2024-09-14T11:41:45.129 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:45.129+0000 7ff37ca5e9c0 20 remove_watcher() i=6 2024-09-14T11:41:45.131 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:45.129+0000 7ff37ca5e9c0 20 remove_watcher() i=7 2024-09-14T11:41:45.149 INFO:tasks.workunit.client.0.smithi138.stderr:check reshard logrecord successfully 2024-09-14T11:41:45.149 INFO:tasks.workunit.client.0.smithi138.stderr: test: reshard versioned bucket 2024-09-14T11:41:45.149 INFO:tasks.workunit.client.0.smithi138.stderr:radosgw-admin bucket stats --bucket myver 2024-09-14T11:41:45.179 INFO:tasks.workunit.client.0.smithi138.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:41:45.179 INFO:tasks.workunit.client.0.smithi138.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:41:45.225 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:45.225+0000 7ffb7f8c59c0 20 rados->read ofs=0 len=0 2024-09-14T11:41:45.227 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:45.225+0000 7ffb7f8c59c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:41:45.227 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:45.225+0000 7ffb7f8c59c0 20 realm 2024-09-14T11:41:45.227 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:45.225+0000 7ffb7f8c59c0 20 rados->read ofs=0 len=0 2024-09-14T11:41:45.227 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:45.225+0000 7ffb7f8c59c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:41:45.227 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:45.225+0000 7ffb7f8c59c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:41:45.228 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:45.225+0000 7ffb7f8c59c0 20 rados->read ofs=0 len=0 2024-09-14T11:41:45.228 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:45.225+0000 7ffb7f8c59c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:41:45.228 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:45.225+0000 7ffb7f8c59c0 20 rados->read ofs=0 len=0 2024-09-14T11:41:45.229 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:45.229+0000 7ffb7f8c59c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:41:45.229 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:45.229+0000 7ffb7f8c59c0 20 rados->read ofs=0 len=0 2024-09-14T11:41:45.230 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:45.229+0000 7ffb7f8c59c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:41:45.230 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:45.229+0000 7ffb7f8c59c0 20 searching for the correct realm 2024-09-14T11:41:45.231 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:45.229+0000 7ffb7cbca640 0 -- 172.21.15.138:0/1476297833 >> [v2:172.21.15.154:6808/1468088432,v1:172.21.15.154:6809/1468088432] conn(0x7ffb70077040 msgr2=0x7ffb7005c130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:41:45.444 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:45.441+0000 7ffb7dbcc640 0 -- 172.21.15.138:0/1476297833 >> [v2:172.21.15.138:6824/2633984942,v1:172.21.15.138:6825/2633984942] conn(0x55f8009cf0e0 msgr2=0x55f8009d14d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:41:45.462 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:45.461+0000 7ffb7f8c59c0 20 RGWRados::pool_iterate: got zone_info.d9e72d30-c60b-4d0d-9267-fdc36392d5ad 2024-09-14T11:41:45.463 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:45.461+0000 7ffb7f8c59c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:41:45.463 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:45.461+0000 7ffb7f8c59c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:41:45.463 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:45.461+0000 7ffb7f8c59c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:41:45.463 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:45.461+0000 7ffb7f8c59c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:41:45.463 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:45.461+0000 7ffb7f8c59c0 20 RGWRados::pool_iterate: got zonegroup_info.65ab941b-da8c-4160-94fb-3672b069d44f 2024-09-14T11:41:45.463 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:45.461+0000 7ffb7f8c59c0 20 rados->read ofs=0 len=0 2024-09-14T11:41:45.463 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:45.461+0000 7ffb7f8c59c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:41:45.463 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:45.461+0000 7ffb7f8c59c0 20 rados->read ofs=0 len=0 2024-09-14T11:41:45.464 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:45.465+0000 7ffb7f8c59c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:41:45.464 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:45.465+0000 7ffb7f8c59c0 20 rados->read ofs=0 len=0 2024-09-14T11:41:45.465 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:45.465+0000 7ffb7f8c59c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:41:45.465 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:45.465+0000 7ffb7f8c59c0 20 zone default found 2024-09-14T11:41:45.466 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:45.465+0000 7ffb7f8c59c0 4 Realm: () 2024-09-14T11:41:45.466 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:45.465+0000 7ffb7f8c59c0 4 ZoneGroup: default (65ab941b-da8c-4160-94fb-3672b069d44f) 2024-09-14T11:41:45.466 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:45.465+0000 7ffb7f8c59c0 4 Zone: default (d9e72d30-c60b-4d0d-9267-fdc36392d5ad) 2024-09-14T11:41:45.466 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:45.465+0000 7ffb7f8c59c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:41:45.466 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:45.465+0000 7ffb7f8c59c0 20 zonegroup default 2024-09-14T11:41:45.466 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:45.465+0000 7ffb7f8c59c0 20 rados->read ofs=0 len=0 2024-09-14T11:41:45.466 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:45.465+0000 7ffb7f8c59c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:41:45.466 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:45.465+0000 7ffb7f8c59c0 20 rados->read ofs=0 len=0 2024-09-14T11:41:45.467 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:45.465+0000 7ffb7f8c59c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:41:45.467 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:45.465+0000 7ffb7f8c59c0 20 rados->read ofs=0 len=0 2024-09-14T11:41:45.468 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:45.465+0000 7ffb7f8c59c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:41:45.468 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:45.465+0000 7ffb7f8c59c0 20 started sync module instance, tier type = 2024-09-14T11:41:45.468 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:45.465+0000 7ffb7f8c59c0 20 started zone id=d9e72d30-c60b-4d0d-9267-fdc36392d5ad (name=default) with tier type = 2024-09-14T11:41:45.492 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:45.489+0000 7ffb7f8c59c0 20 add_watcher() i=0 2024-09-14T11:41:45.492 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:45.489+0000 7ffb7f8c59c0 20 add_watcher() i=1 2024-09-14T11:41:45.492 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:45.489+0000 7ffb7f8c59c0 20 add_watcher() i=2 2024-09-14T11:41:45.492 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:45.489+0000 7ffb7f8c59c0 20 add_watcher() i=3 2024-09-14T11:41:45.492 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:45.489+0000 7ffb7f8c59c0 20 add_watcher() i=4 2024-09-14T11:41:45.492 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:45.489+0000 7ffb7f8c59c0 20 add_watcher() i=5 2024-09-14T11:41:45.492 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:45.493+0000 7ffb7f8c59c0 20 add_watcher() i=6 2024-09-14T11:41:45.494 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:45.493+0000 7ffb7f8c59c0 20 add_watcher() i=7 2024-09-14T11:41:45.494 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:45.493+0000 7ffb7f8c59c0 2 all 8 watchers are set, enabling cache 2024-09-14T11:41:45.498 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:45.497+0000 7ffa33fe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:41:45.499 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:45.497+0000 7ffb7f8c59c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:41:45.499 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:45.497+0000 7ffb7f8c59c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:41:45.499 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:45.497+0000 7ffb7f8c59c0 5 note: GC not initialized 2024-09-14T11:41:45.500 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:45.497+0000 7ffa32fe5640 20 reqs_thread_entry: start 2024-09-14T11:41:45.500 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:45.497+0000 7ffb7f8c59c0 20 init_complete bucket index max shards: 11 2024-09-14T11:41:45.500 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:45.501+0000 7ffb7f8c59c0 20 Filter name: none 2024-09-14T11:41:45.500 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:45.501+0000 7ffa30fe1640 20 reqs_thread_entry: start 2024-09-14T11:41:45.501 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:45.501+0000 7ffb7f8c59c0 20 rados->read ofs=0 len=0 2024-09-14T11:41:45.501 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:45.501+0000 7ffb7f8c59c0 20 rados_obj.operate() r=0 bl.length=173 2024-09-14T11:41:45.501 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:45.501+0000 7ffb7f8c59c0 20 rados->read ofs=0 len=0 2024-09-14T11:41:45.502 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:45.501+0000 7ffb7f8c59c0 20 rados_obj.operate() r=0 bl.length=395 2024-09-14T11:41:45.502 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:45.501+0000 7ffb7f8c59c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:41:45.502 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:45.501+0000 7ffb7f8c59c0 20 rados->read ofs=0 len=0 2024-09-14T11:41:45.503 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:45.501+0000 7ffb7f8c59c0 20 rados_obj.operate() r=0 bl.length=173 2024-09-14T11:41:45.503 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:45.501+0000 7ffb7f8c59c0 20 rados->read ofs=0 len=0 2024-09-14T11:41:45.503 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:45.501+0000 7ffb7f8c59c0 20 rados_obj.operate() r=0 bl.length=395 2024-09-14T11:41:45.503 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:45.501+0000 7ffb7f8c59c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:41:45.506 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:45.505+0000 7ffa33fe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:41:45.511 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:45.509+0000 7ffb7f8c59c0 20 remove_watcher() i=0 2024-09-14T11:41:45.511 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:45.509+0000 7ffb7f8c59c0 2 removed watcher, disabling cache 2024-09-14T11:41:45.513 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:45.513+0000 7ffb7f8c59c0 20 remove_watcher() i=1 2024-09-14T11:41:45.515 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:45.513+0000 7ffb7f8c59c0 20 remove_watcher() i=2 2024-09-14T11:41:45.517 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:45.517+0000 7ffb7f8c59c0 20 remove_watcher() i=3 2024-09-14T11:41:45.519 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:45.517+0000 7ffb7f8c59c0 20 remove_watcher() i=4 2024-09-14T11:41:45.521 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:45.521+0000 7ffb7f8c59c0 20 remove_watcher() i=5 2024-09-14T11:41:45.522 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:45.521+0000 7ffb7f8c59c0 20 remove_watcher() i=6 2024-09-14T11:41:45.524 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:45.521+0000 7ffb7f8c59c0 20 remove_watcher() i=7 2024-09-14T11:41:45.540 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-14T11:41:45.540 INFO:tasks.workunit.client.0.smithi138.stderr:BUCKET_STATS: 2024-09-14T11:41:45.540 INFO:tasks.workunit.client.0.smithi138.stderr:bucket: myver id: d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.18 num_objects: 0 size_kb: 0 num_shards: 11 2024-09-14T11:41:45.540 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-14T11:41:45.541 INFO:tasks.workunit.client.0.smithi138.stderr:radosgw-admin bucket reshard --bucket myver --num-shards 12 2024-09-14T11:41:45.573 INFO:tasks.workunit.client.0.smithi138.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:41:45.573 INFO:tasks.workunit.client.0.smithi138.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:41:45.617 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:45.617+0000 7f4ba054a9c0 20 rados->read ofs=0 len=0 2024-09-14T11:41:45.619 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:45.617+0000 7f4ba054a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:41:45.619 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:45.617+0000 7f4ba054a9c0 20 realm 2024-09-14T11:41:45.619 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:45.617+0000 7f4ba054a9c0 20 rados->read ofs=0 len=0 2024-09-14T11:41:45.620 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:45.617+0000 7f4ba054a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:41:45.620 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:45.617+0000 7f4ba054a9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:41:45.620 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:45.617+0000 7f4ba054a9c0 20 rados->read ofs=0 len=0 2024-09-14T11:41:45.620 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:45.617+0000 7f4ba054a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:41:45.620 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:45.617+0000 7f4ba054a9c0 20 rados->read ofs=0 len=0 2024-09-14T11:41:45.621 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:45.621+0000 7f4ba054a9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:41:45.621 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:45.621+0000 7f4ba054a9c0 20 rados->read ofs=0 len=0 2024-09-14T11:41:45.622 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:45.621+0000 7f4ba054a9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:41:45.622 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:45.621+0000 7f4ba054a9c0 20 searching for the correct realm 2024-09-14T11:41:45.623 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:45.621+0000 7f4b9d84f640 0 -- 172.21.15.138:0/810225146 >> [v2:172.21.15.154:6808/1468088432,v1:172.21.15.154:6809/1468088432] conn(0x7f4b90027040 msgr2=0x7f4b900639c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:41:45.837 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:45.837+0000 7f4b9e851640 0 -- 172.21.15.138:0/810225146 >> [v2:172.21.15.138:6824/2633984942,v1:172.21.15.138:6825/2633984942] conn(0x561012a2b380 msgr2=0x561012a2d770 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:41:45.853 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:45.853+0000 7f4ba054a9c0 20 RGWRados::pool_iterate: got zone_info.d9e72d30-c60b-4d0d-9267-fdc36392d5ad 2024-09-14T11:41:45.853 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:45.853+0000 7f4ba054a9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:41:45.853 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:45.853+0000 7f4ba054a9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:41:45.853 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:45.853+0000 7f4ba054a9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:41:45.853 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:45.853+0000 7f4ba054a9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:41:45.853 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:45.853+0000 7f4ba054a9c0 20 RGWRados::pool_iterate: got zonegroup_info.65ab941b-da8c-4160-94fb-3672b069d44f 2024-09-14T11:41:45.853 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:45.853+0000 7f4ba054a9c0 20 rados->read ofs=0 len=0 2024-09-14T11:41:45.854 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:45.853+0000 7f4ba054a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:41:45.854 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:45.853+0000 7f4ba054a9c0 20 rados->read ofs=0 len=0 2024-09-14T11:41:45.854 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:45.853+0000 7f4ba054a9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:41:45.854 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:45.853+0000 7f4ba054a9c0 20 rados->read ofs=0 len=0 2024-09-14T11:41:45.855 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:45.853+0000 7f4ba054a9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:41:45.855 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:45.853+0000 7f4ba054a9c0 20 zone default found 2024-09-14T11:41:45.856 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:45.853+0000 7f4ba054a9c0 4 Realm: () 2024-09-14T11:41:45.856 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:45.853+0000 7f4ba054a9c0 4 ZoneGroup: default (65ab941b-da8c-4160-94fb-3672b069d44f) 2024-09-14T11:41:45.856 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:45.853+0000 7f4ba054a9c0 4 Zone: default (d9e72d30-c60b-4d0d-9267-fdc36392d5ad) 2024-09-14T11:41:45.856 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:45.853+0000 7f4ba054a9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:41:45.856 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:45.853+0000 7f4ba054a9c0 20 zonegroup default 2024-09-14T11:41:45.856 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:45.853+0000 7f4ba054a9c0 20 rados->read ofs=0 len=0 2024-09-14T11:41:45.856 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:45.857+0000 7f4ba054a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:41:45.857 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:45.857+0000 7f4ba054a9c0 20 rados->read ofs=0 len=0 2024-09-14T11:41:45.857 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:45.857+0000 7f4ba054a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:41:45.857 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:45.857+0000 7f4ba054a9c0 20 rados->read ofs=0 len=0 2024-09-14T11:41:45.858 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:45.857+0000 7f4ba054a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:41:45.858 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:45.857+0000 7f4ba054a9c0 20 started sync module instance, tier type = 2024-09-14T11:41:45.858 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:45.857+0000 7f4ba054a9c0 20 started zone id=d9e72d30-c60b-4d0d-9267-fdc36392d5ad (name=default) with tier type = 2024-09-14T11:41:45.880 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:45.881+0000 7f4ba054a9c0 20 add_watcher() i=0 2024-09-14T11:41:45.880 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:45.881+0000 7f4ba054a9c0 20 add_watcher() i=1 2024-09-14T11:41:45.880 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:45.881+0000 7f4ba054a9c0 20 add_watcher() i=2 2024-09-14T11:41:45.880 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:45.881+0000 7f4ba054a9c0 20 add_watcher() i=3 2024-09-14T11:41:45.880 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:45.881+0000 7f4ba054a9c0 20 add_watcher() i=4 2024-09-14T11:41:45.881 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:45.881+0000 7f4ba054a9c0 20 add_watcher() i=5 2024-09-14T11:41:45.881 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:45.881+0000 7f4ba054a9c0 20 add_watcher() i=6 2024-09-14T11:41:45.883 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:45.881+0000 7f4ba054a9c0 20 add_watcher() i=7 2024-09-14T11:41:45.883 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:45.881+0000 7f4ba054a9c0 2 all 8 watchers are set, enabling cache 2024-09-14T11:41:45.886 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:45.885+0000 7f4a54fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:41:45.888 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:45.885+0000 7f4ba054a9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:41:45.888 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:45.885+0000 7f4ba054a9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:41:45.888 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:45.885+0000 7f4ba054a9c0 5 note: GC not initialized 2024-09-14T11:41:45.889 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:45.889+0000 7f49cf7fe640 20 reqs_thread_entry: start 2024-09-14T11:41:45.889 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:45.889+0000 7f4ba054a9c0 20 init_complete bucket index max shards: 11 2024-09-14T11:41:45.889 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:45.889+0000 7f4ba054a9c0 20 Filter name: none 2024-09-14T11:41:45.889 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:45.889+0000 7f49cd7fa640 20 reqs_thread_entry: start 2024-09-14T11:41:45.889 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:45.889+0000 7f4ba054a9c0 10 cache get: name=default.rgw.meta+root+myver : miss 2024-09-14T11:41:45.889 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:45.889+0000 7f4ba054a9c0 20 rados->read ofs=0 len=0 2024-09-14T11:41:45.890 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:45.889+0000 7f4ba054a9c0 20 rados_obj.operate() r=0 bl.length=173 2024-09-14T11:41:45.890 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:45.889+0000 7f4ba054a9c0 10 cache put: name=default.rgw.meta+root+myver info.flags=0x11 2024-09-14T11:41:45.890 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:45.889+0000 7f4ba054a9c0 10 adding default.rgw.meta+root+myver to cache LRU end 2024-09-14T11:41:45.890 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:45.889+0000 7f4ba054a9c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.myver:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.18 : miss 2024-09-14T11:41:45.890 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:45.889+0000 7f4ba054a9c0 20 rados->read ofs=0 len=0 2024-09-14T11:41:45.891 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:45.889+0000 7f4ba054a9c0 20 rados_obj.operate() r=0 bl.length=395 2024-09-14T11:41:45.891 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:45.889+0000 7f4ba054a9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.myver:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.18 info.flags=0x17 2024-09-14T11:41:45.891 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:45.889+0000 7f4ba054a9c0 10 adding default.rgw.meta+root+.bucket.meta.myver:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.18 to cache LRU end 2024-09-14T11:41:45.891 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:45.889+0000 7f4ba054a9c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:41:45.891 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:45.889+0000 7f4ba054a9c0 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-14T11:41:45.891 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:45.889+0000 7f4ba054a9c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myver:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.18 2024-09-14T11:41:45.900 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:45.901+0000 7f4ba054a9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.myver:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.18 info.flags=0x17 2024-09-14T11:41:45.900 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:45.901+0000 7f4ba054a9c0 10 moving default.rgw.meta+root+.bucket.meta.myver:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.18 to cache LRU end 2024-09-14T11:41:45.901 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:45.901+0000 7f4ba054a9c0 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-14T11:41:45.901 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:45.901+0000 7f4ba054a9c0 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.myver:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.18, ofs0, ns] 2024-09-14T11:41:45.901 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:45.901+0000 7f4a81ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366201 cookie 94627032123664 notifier 7814 bl.length()=821 2024-09-14T11:41:45.901 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:45.901+0000 7f4a81ffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.myver:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.18 info.flags=0x17 2024-09-14T11:41:45.901 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:45.901+0000 7f4a81ffb640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.myver:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.18 to cache LRU end 2024-09-14T11:41:45.901 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:45.901+0000 7f4a81ffb640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=143 2024-09-14T11:41:45.903 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:45.901+0000 7f4ba054a9c0 20 handle_bi_update(): bucket=:myver[d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.18]): orig_sources= new_sources= 2024-09-14T11:41:45.903 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:45.901+0000 7f4ba054a9c0 20 handle_bi_update(): bucket=:myver[d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.18]): potential sources added=[] removed=[] 2024-09-14T11:41:45.903 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:45.901+0000 7f4ba054a9c0 20 handle_bi_update(): bucket=:myver[d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.18]): orig_dests= new_dests= 2024-09-14T11:41:45.904 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:45.901+0000 7f4ba054a9c0 20 handle_bi_update(): bucket=:myver[d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.18]): potential dests added=[] removed=[] 2024-09-14T11:41:45.913 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:45.913+0000 7f4ba054a9c0 10 bucket_obj is .dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.18.1.0 2024-09-14T11:41:45.913 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:45.913+0000 7f4ba054a9c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.18.1.0 2024-09-14T11:41:45.913 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:45.913+0000 7f4ba054a9c0 10 bucket_obj is .dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.18.1.1 2024-09-14T11:41:45.913 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:45.913+0000 7f4ba054a9c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.18.1.1 2024-09-14T11:41:45.913 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:45.913+0000 7f4ba054a9c0 10 bucket_obj is .dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.18.1.2 2024-09-14T11:41:45.913 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:45.913+0000 7f4ba054a9c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.18.1.2 2024-09-14T11:41:45.913 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:45.913+0000 7f4ba054a9c0 10 bucket_obj is .dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.18.1.3 2024-09-14T11:41:45.913 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:45.913+0000 7f4ba054a9c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.18.1.3 2024-09-14T11:41:45.914 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:45.913+0000 7f4ba054a9c0 10 bucket_obj is .dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.18.1.4 2024-09-14T11:41:45.914 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:45.913+0000 7f4ba054a9c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.18.1.4 2024-09-14T11:41:45.914 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:45.913+0000 7f4ba054a9c0 10 bucket_obj is .dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.18.1.5 2024-09-14T11:41:45.914 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:45.913+0000 7f4ba054a9c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.18.1.5 2024-09-14T11:41:45.914 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:45.913+0000 7f4ba054a9c0 10 bucket_obj is .dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.18.1.6 2024-09-14T11:41:45.914 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:45.913+0000 7f4ba054a9c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.18.1.6 2024-09-14T11:41:45.914 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:45.913+0000 7f4ba054a9c0 10 bucket_obj is .dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.18.1.7 2024-09-14T11:41:45.914 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:45.913+0000 7f4ba054a9c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.18.1.7 2024-09-14T11:41:45.914 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:45.913+0000 7f4ba054a9c0 10 bucket_obj is .dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.18.1.8 2024-09-14T11:41:45.914 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:45.913+0000 7f4ba054a9c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.18.1.8 2024-09-14T11:41:45.914 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:45.913+0000 7f4ba054a9c0 10 bucket_obj is .dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.18.1.9 2024-09-14T11:41:45.914 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:45.913+0000 7f4ba054a9c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.18.1.9 2024-09-14T11:41:45.914 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:45.913+0000 7f4ba054a9c0 10 bucket_obj is .dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.18.1.10 2024-09-14T11:41:45.914 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:45.913+0000 7f4ba054a9c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.18.1.10 2024-09-14T11:41:45.914 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:45.913+0000 7f4ba054a9c0 10 bucket_obj is .dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.18.1.11 2024-09-14T11:41:45.915 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:45.913+0000 7f4ba054a9c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.18.1.11 2024-09-14T11:41:45.915 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:45.913+0000 7f4ba054a9c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.18.0 2024-09-14T11:41:45.915 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:45.913+0000 7f4ba054a9c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.18.1 2024-09-14T11:41:45.915 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:45.913+0000 7f4ba054a9c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.18.2 2024-09-14T11:41:45.916 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:45.917+0000 7f4ba054a9c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.18.3 2024-09-14T11:41:45.917 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:45.917+0000 7f4ba054a9c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.18.4 2024-09-14T11:41:45.918 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:45.917+0000 7f4ba054a9c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.18.5 2024-09-14T11:41:45.919 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:45.917+0000 7f4ba054a9c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.18.6 2024-09-14T11:41:45.919 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:45.917+0000 7f4ba054a9c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.18.7 2024-09-14T11:41:45.921 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:45.921+0000 7f4ba054a9c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.18.8 2024-09-14T11:41:45.923 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:45.921+0000 7f4ba054a9c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.18.9 2024-09-14T11:41:45.924 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:45.925+0000 7f4ba054a9c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.18.10 2024-09-14T11:41:45.925 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:45.925+0000 7f4ba054a9c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.myver:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.18 : hit (requested=0x17, cached=0x17) 2024-09-14T11:41:45.925 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:45.925+0000 7f4ba054a9c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myver:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.18 2024-09-14T11:41:45.927 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:45.925+0000 7f4ba054a9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.myver:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.18 info.flags=0x17 2024-09-14T11:41:45.927 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:45.925+0000 7f4ba054a9c0 10 moving default.rgw.meta+root+.bucket.meta.myver:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.18 to cache LRU end 2024-09-14T11:41:45.927 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:45.925+0000 7f4ba054a9c0 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-14T11:41:45.927 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:45.925+0000 7f4ba054a9c0 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.myver:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.18, ofs0, ns] 2024-09-14T11:41:45.928 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:45.925+0000 7f4a817fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366202 cookie 94627032123664 notifier 7814 bl.length()=821 2024-09-14T11:41:45.928 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:45.925+0000 7f4a817fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.myver:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.18 info.flags=0x17 2024-09-14T11:41:45.928 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:45.925+0000 7f4a817fa640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.myver:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.18 to cache LRU end 2024-09-14T11:41:45.928 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:45.925+0000 7f4a817fa640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=143 2024-09-14T11:41:45.930 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:45.929+0000 7f4ba054a9c0 20 handle_bi_update(): bucket=:myver[d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.18]): orig_sources= new_sources= 2024-09-14T11:41:45.930 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:45.929+0000 7f4ba054a9c0 20 handle_bi_update(): bucket=:myver[d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.18]): potential sources added=[] removed=[] 2024-09-14T11:41:45.930 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:45.929+0000 7f4ba054a9c0 20 handle_bi_update(): bucket=:myver[d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.18]): orig_dests= new_dests= 2024-09-14T11:41:45.930 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:45.929+0000 7f4ba054a9c0 20 handle_bi_update(): bucket=:myver[d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.18]): potential dests added=[] removed=[] 2024-09-14T11:41:45.934 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:45.933+0000 7f4ba054a9c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.18.0 2024-09-14T11:41:45.935 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:45.933+0000 7f4ba054a9c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.18.1 2024-09-14T11:41:45.936 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:45.933+0000 7f4ba054a9c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.18.2 2024-09-14T11:41:45.937 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:45.937+0000 7f4ba054a9c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.18.3 2024-09-14T11:41:45.937 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:45.937+0000 7f4ba054a9c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.18.4 2024-09-14T11:41:45.938 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:45.937+0000 7f4ba054a9c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.18.5 2024-09-14T11:41:45.939 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:45.937+0000 7f4ba054a9c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.18.6 2024-09-14T11:41:45.939 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:45.937+0000 7f4ba054a9c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.18.7 2024-09-14T11:41:45.940 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:45.941+0000 7f4ba054a9c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.18.8 2024-09-14T11:41:45.942 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:45.941+0000 7f4ba054a9c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.18.9 2024-09-14T11:41:45.943 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:45.941+0000 7f4ba054a9c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.18.10 2024-09-14T11:41:45.943 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:45.941+0000 7f4ba054a9c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.myver:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.18 : hit (requested=0x17, cached=0x17) 2024-09-14T11:41:45.943 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:45.941+0000 7f4ba054a9c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myver:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.18 2024-09-14T11:41:45.945 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:45.945+0000 7f4ba054a9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.myver:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.18 info.flags=0x17 2024-09-14T11:41:45.945 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:45.945+0000 7f4ba054a9c0 10 moving default.rgw.meta+root+.bucket.meta.myver:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.18 to cache LRU end 2024-09-14T11:41:45.945 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:45.945+0000 7f4ba054a9c0 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-14T11:41:45.945 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:45.945+0000 7f4ba054a9c0 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.myver:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.18, ofs0, ns] 2024-09-14T11:41:45.945 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:45.945+0000 7f4a81ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366203 cookie 94627032123664 notifier 7814 bl.length()=789 2024-09-14T11:41:45.945 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:45.945+0000 7f4a81ffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.myver:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.18 info.flags=0x17 2024-09-14T11:41:45.946 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:45.945+0000 7f4a81ffb640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.myver:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.18 to cache LRU end 2024-09-14T11:41:45.946 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:45.945+0000 7f4a81ffb640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=143 2024-09-14T11:41:45.948 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:45.945+0000 7f4ba054a9c0 20 handle_bi_update(): bucket=:myver[d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.18]): orig_sources= new_sources= 2024-09-14T11:41:45.948 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:45.945+0000 7f4ba054a9c0 20 handle_bi_update(): bucket=:myver[d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.18]): potential sources added=[] removed=[] 2024-09-14T11:41:45.948 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:45.945+0000 7f4ba054a9c0 20 handle_bi_update(): bucket=:myver[d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.18]): orig_dests= new_dests= 2024-09-14T11:41:45.948 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:45.945+0000 7f4ba054a9c0 20 handle_bi_update(): bucket=:myver[d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.18]): potential dests added=[] removed=[] 2024-09-14T11:41:45.952 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:45.953+0000 7f4ba054a9c0 1 execute INFO: reshard of bucket "myver" from 11 shards to 12 shards completed successfully 2024-09-14T11:41:45.956 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:45.953+0000 7f4a54fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:41:45.961 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:45.961+0000 7f4ba054a9c0 20 remove_watcher() i=0 2024-09-14T11:41:45.961 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:45.961+0000 7f4ba054a9c0 2 removed watcher, disabling cache 2024-09-14T11:41:45.963 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:45.961+0000 7f4ba054a9c0 20 remove_watcher() i=1 2024-09-14T11:41:45.965 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:45.965+0000 7f4ba054a9c0 20 remove_watcher() i=2 2024-09-14T11:41:45.967 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:45.965+0000 7f4ba054a9c0 20 remove_watcher() i=3 2024-09-14T11:41:45.969 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:45.969+0000 7f4ba054a9c0 20 remove_watcher() i=4 2024-09-14T11:41:45.971 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:45.969+0000 7f4ba054a9c0 20 remove_watcher() i=5 2024-09-14T11:41:45.973 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:45.973+0000 7f4ba054a9c0 20 remove_watcher() i=6 2024-09-14T11:41:45.974 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:45.973+0000 7f4ba054a9c0 20 remove_watcher() i=7 2024-09-14T11:41:45.998 INFO:tasks.workunit.client.0.smithi138.stderr:radosgw-admin bucket stats --bucket myver 2024-09-14T11:41:46.029 INFO:tasks.workunit.client.0.smithi138.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:41:46.029 INFO:tasks.workunit.client.0.smithi138.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:41:46.075 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:46.073+0000 7fa4ff24f9c0 20 rados->read ofs=0 len=0 2024-09-14T11:41:46.078 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:46.077+0000 7fa4ff24f9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:41:46.078 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:46.077+0000 7fa4ff24f9c0 20 realm 2024-09-14T11:41:46.078 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:46.077+0000 7fa4ff24f9c0 20 rados->read ofs=0 len=0 2024-09-14T11:41:46.078 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:46.077+0000 7fa4ff24f9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:41:46.078 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:46.077+0000 7fa4ff24f9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:41:46.078 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:46.077+0000 7fa4ff24f9c0 20 rados->read ofs=0 len=0 2024-09-14T11:41:46.078 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:46.077+0000 7fa4ff24f9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:41:46.078 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:46.077+0000 7fa4ff24f9c0 20 rados->read ofs=0 len=0 2024-09-14T11:41:46.080 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:46.077+0000 7fa4ff24f9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:41:46.080 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:46.077+0000 7fa4ff24f9c0 20 rados->read ofs=0 len=0 2024-09-14T11:41:46.081 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:46.081+0000 7fa4ff24f9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:41:46.081 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:46.081+0000 7fa4ff24f9c0 20 searching for the correct realm 2024-09-14T11:41:46.084 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:46.081+0000 7fa4fd556640 0 -- 172.21.15.138:0/2282559528 >> [v2:172.21.15.154:6824/416768175,v1:172.21.15.154:6825/416768175] conn(0x7fa4f403fc00 msgr2=0x7fa4f4035ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:41:46.303 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:46.301+0000 7fa4fc554640 0 -- 172.21.15.138:0/2282559528 >> [v2:172.21.15.138:6816/326481658,v1:172.21.15.138:6817/326481658] conn(0x7fa4f404e900 msgr2=0x7fa4f40333c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-14T11:41:46.520 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:46.517+0000 7fa4ff24f9c0 20 RGWRados::pool_iterate: got zone_info.d9e72d30-c60b-4d0d-9267-fdc36392d5ad 2024-09-14T11:41:46.520 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:46.517+0000 7fa4ff24f9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:41:46.520 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:46.517+0000 7fa4ff24f9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:41:46.520 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:46.517+0000 7fa4ff24f9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:41:46.520 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:46.517+0000 7fa4ff24f9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:41:46.520 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:46.517+0000 7fa4ff24f9c0 20 RGWRados::pool_iterate: got zonegroup_info.65ab941b-da8c-4160-94fb-3672b069d44f 2024-09-14T11:41:46.520 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:46.517+0000 7fa4ff24f9c0 20 rados->read ofs=0 len=0 2024-09-14T11:41:46.521 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:46.521+0000 7fa4ff24f9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:41:46.521 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:46.521+0000 7fa4ff24f9c0 20 rados->read ofs=0 len=0 2024-09-14T11:41:46.521 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:46.521+0000 7fa4ff24f9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:41:46.521 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:46.521+0000 7fa4ff24f9c0 20 rados->read ofs=0 len=0 2024-09-14T11:41:46.522 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:46.521+0000 7fa4ff24f9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:41:46.522 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:46.521+0000 7fa4ff24f9c0 20 zone default found 2024-09-14T11:41:46.522 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:46.521+0000 7fa4ff24f9c0 4 Realm: () 2024-09-14T11:41:46.522 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:46.521+0000 7fa4ff24f9c0 4 ZoneGroup: default (65ab941b-da8c-4160-94fb-3672b069d44f) 2024-09-14T11:41:46.523 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:46.521+0000 7fa4ff24f9c0 4 Zone: default (d9e72d30-c60b-4d0d-9267-fdc36392d5ad) 2024-09-14T11:41:46.523 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:46.521+0000 7fa4ff24f9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:41:46.523 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:46.521+0000 7fa4ff24f9c0 20 zonegroup default 2024-09-14T11:41:46.523 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:46.521+0000 7fa4ff24f9c0 20 rados->read ofs=0 len=0 2024-09-14T11:41:46.523 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:46.521+0000 7fa4ff24f9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:41:46.523 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:46.521+0000 7fa4ff24f9c0 20 rados->read ofs=0 len=0 2024-09-14T11:41:46.524 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:46.521+0000 7fa4ff24f9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:41:46.524 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:46.521+0000 7fa4ff24f9c0 20 rados->read ofs=0 len=0 2024-09-14T11:41:46.524 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:46.525+0000 7fa4ff24f9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:41:46.525 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:46.525+0000 7fa4ff24f9c0 20 started sync module instance, tier type = 2024-09-14T11:41:46.525 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:46.525+0000 7fa4ff24f9c0 20 started zone id=d9e72d30-c60b-4d0d-9267-fdc36392d5ad (name=default) with tier type = 2024-09-14T11:41:46.548 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:46.545+0000 7fa4ff24f9c0 20 add_watcher() i=0 2024-09-14T11:41:46.548 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:46.545+0000 7fa4ff24f9c0 20 add_watcher() i=1 2024-09-14T11:41:46.548 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:46.549+0000 7fa4ff24f9c0 20 add_watcher() i=2 2024-09-14T11:41:46.548 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:46.549+0000 7fa4ff24f9c0 20 add_watcher() i=3 2024-09-14T11:41:46.548 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:46.549+0000 7fa4ff24f9c0 20 add_watcher() i=4 2024-09-14T11:41:46.548 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:46.549+0000 7fa4ff24f9c0 20 add_watcher() i=5 2024-09-14T11:41:46.548 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:46.549+0000 7fa4ff24f9c0 20 add_watcher() i=6 2024-09-14T11:41:46.550 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:46.549+0000 7fa4ff24f9c0 20 add_watcher() i=7 2024-09-14T11:41:46.550 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:46.549+0000 7fa4ff24f9c0 2 all 8 watchers are set, enabling cache 2024-09-14T11:41:46.554 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:46.553+0000 7fa3b2fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:41:46.555 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:46.553+0000 7fa4ff24f9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:41:46.555 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:46.553+0000 7fa4ff24f9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:41:46.555 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:46.553+0000 7fa4ff24f9c0 5 note: GC not initialized 2024-09-14T11:41:46.556 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:46.553+0000 7fa3b1fe3640 20 reqs_thread_entry: start 2024-09-14T11:41:46.556 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:46.557+0000 7fa4ff24f9c0 20 init_complete bucket index max shards: 11 2024-09-14T11:41:46.556 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:46.557+0000 7fa4ff24f9c0 20 Filter name: none 2024-09-14T11:41:46.557 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:46.557+0000 7fa3237fe640 20 reqs_thread_entry: start 2024-09-14T11:41:46.557 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:46.557+0000 7fa4ff24f9c0 20 rados->read ofs=0 len=0 2024-09-14T11:41:46.557 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:46.557+0000 7fa4ff24f9c0 20 rados_obj.operate() r=0 bl.length=173 2024-09-14T11:41:46.557 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:46.557+0000 7fa4ff24f9c0 20 rados->read ofs=0 len=0 2024-09-14T11:41:46.558 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:46.557+0000 7fa4ff24f9c0 20 rados_obj.operate() r=0 bl.length=395 2024-09-14T11:41:46.558 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:46.557+0000 7fa4ff24f9c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:41:46.558 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:46.557+0000 7fa4ff24f9c0 20 rados->read ofs=0 len=0 2024-09-14T11:41:46.559 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:46.557+0000 7fa4ff24f9c0 20 rados_obj.operate() r=0 bl.length=173 2024-09-14T11:41:46.559 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:46.557+0000 7fa4ff24f9c0 20 rados->read ofs=0 len=0 2024-09-14T11:41:46.559 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:46.557+0000 7fa4ff24f9c0 20 rados_obj.operate() r=0 bl.length=395 2024-09-14T11:41:46.559 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:46.557+0000 7fa4ff24f9c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:41:46.562 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:46.561+0000 7fa3b2fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:41:46.567 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:46.565+0000 7fa4ff24f9c0 20 remove_watcher() i=0 2024-09-14T11:41:46.567 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:46.565+0000 7fa4ff24f9c0 2 removed watcher, disabling cache 2024-09-14T11:41:46.570 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:46.569+0000 7fa4ff24f9c0 20 remove_watcher() i=1 2024-09-14T11:41:46.572 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:46.573+0000 7fa4ff24f9c0 20 remove_watcher() i=2 2024-09-14T11:41:46.574 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:46.573+0000 7fa4ff24f9c0 20 remove_watcher() i=3 2024-09-14T11:41:46.576 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:46.577+0000 7fa4ff24f9c0 20 remove_watcher() i=4 2024-09-14T11:41:46.578 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:46.577+0000 7fa4ff24f9c0 20 remove_watcher() i=5 2024-09-14T11:41:46.580 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:46.577+0000 7fa4ff24f9c0 20 remove_watcher() i=6 2024-09-14T11:41:46.581 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:46.581+0000 7fa4ff24f9c0 20 remove_watcher() i=7 2024-09-14T11:41:46.596 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-14T11:41:46.596 INFO:tasks.workunit.client.0.smithi138.stderr:BUCKET_STATS: 2024-09-14T11:41:46.596 INFO:tasks.workunit.client.0.smithi138.stderr:bucket: myver id: d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.18 num_objects: 0 size_kb: 0 num_shards: 12 2024-09-14T11:41:46.596 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-14T11:41:46.598 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:41:46.598 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-14T11:41:46.628 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:41:46.628 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-14T11:41:46.693 INFO:tasks.workunit.client.0.smithi138.stderr: test: reshard removes olh entries with empty name 2024-09-14T11:41:46.698 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:41:46.698 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-14T11:41:46.847 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:41:46.848 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-14T11:41:47.470 INFO:tasks.workunit.client.0.smithi138.stderr:radosgw-admin bucket stats --bucket a-bucket 2024-09-14T11:41:47.502 INFO:tasks.workunit.client.0.smithi138.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:41:47.502 INFO:tasks.workunit.client.0.smithi138.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:41:47.547 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:47.545+0000 7f36b09409c0 20 rados->read ofs=0 len=0 2024-09-14T11:41:47.550 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:47.549+0000 7f36b09409c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:41:47.550 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:47.549+0000 7f36b09409c0 20 realm 2024-09-14T11:41:47.550 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:47.549+0000 7f36b09409c0 20 rados->read ofs=0 len=0 2024-09-14T11:41:47.550 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:47.549+0000 7f36b09409c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:41:47.550 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:47.549+0000 7f36b09409c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:41:47.550 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:47.549+0000 7f36b09409c0 20 rados->read ofs=0 len=0 2024-09-14T11:41:47.550 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:47.549+0000 7f36b09409c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:41:47.550 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:47.549+0000 7f36b09409c0 20 rados->read ofs=0 len=0 2024-09-14T11:41:47.551 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:47.549+0000 7f36b09409c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:41:47.551 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:47.549+0000 7f36b09409c0 20 rados->read ofs=0 len=0 2024-09-14T11:41:47.755 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:47.753+0000 7f36b09409c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:41:47.755 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:47.753+0000 7f36b09409c0 20 searching for the correct realm 2024-09-14T11:41:47.760 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:47.761+0000 7f36aec47640 0 -- 172.21.15.138:0/4242347766 >> [v2:172.21.15.154:6824/416768175,v1:172.21.15.154:6825/416768175] conn(0x7f36a804d040 msgr2=0x7f36a804d420 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-14T11:41:47.977 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:47.977+0000 7f36adc45640 0 -- 172.21.15.138:0/4242347766 >> [v2:172.21.15.138:6816/326481658,v1:172.21.15.138:6817/326481658] conn(0x7f36a805c900 msgr2=0x7f36a800f430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:41:48.196 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:48.197+0000 7f36b09409c0 20 RGWRados::pool_iterate: got zone_info.d9e72d30-c60b-4d0d-9267-fdc36392d5ad 2024-09-14T11:41:48.197 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:48.197+0000 7f36b09409c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:41:48.197 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:48.197+0000 7f36b09409c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:41:48.197 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:48.197+0000 7f36b09409c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:41:48.197 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:48.197+0000 7f36b09409c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:41:48.197 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:48.197+0000 7f36b09409c0 20 RGWRados::pool_iterate: got zonegroup_info.65ab941b-da8c-4160-94fb-3672b069d44f 2024-09-14T11:41:48.197 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:48.197+0000 7f36b09409c0 20 rados->read ofs=0 len=0 2024-09-14T11:41:48.197 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:48.197+0000 7f36b09409c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:41:48.197 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:48.197+0000 7f36b09409c0 20 rados->read ofs=0 len=0 2024-09-14T11:41:48.198 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:48.197+0000 7f36b09409c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:41:48.198 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:48.197+0000 7f36b09409c0 20 rados->read ofs=0 len=0 2024-09-14T11:41:48.199 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:48.197+0000 7f36b09409c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:41:48.199 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:48.197+0000 7f36b09409c0 20 zone default found 2024-09-14T11:41:48.199 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:48.197+0000 7f36b09409c0 4 Realm: () 2024-09-14T11:41:48.200 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:48.197+0000 7f36b09409c0 4 ZoneGroup: default (65ab941b-da8c-4160-94fb-3672b069d44f) 2024-09-14T11:41:48.200 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:48.197+0000 7f36b09409c0 4 Zone: default (d9e72d30-c60b-4d0d-9267-fdc36392d5ad) 2024-09-14T11:41:48.200 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:48.197+0000 7f36b09409c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:41:48.200 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:48.197+0000 7f36b09409c0 20 zonegroup default 2024-09-14T11:41:48.200 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:48.197+0000 7f36b09409c0 20 rados->read ofs=0 len=0 2024-09-14T11:41:48.200 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:48.197+0000 7f36b09409c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:41:48.200 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:48.201+0000 7f36b09409c0 20 rados->read ofs=0 len=0 2024-09-14T11:41:48.201 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:48.201+0000 7f36b09409c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:41:48.201 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:48.201+0000 7f36b09409c0 20 rados->read ofs=0 len=0 2024-09-14T11:41:48.201 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:48.201+0000 7f36b09409c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:41:48.201 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:48.201+0000 7f36b09409c0 20 started sync module instance, tier type = 2024-09-14T11:41:48.201 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:48.201+0000 7f36b09409c0 20 started zone id=d9e72d30-c60b-4d0d-9267-fdc36392d5ad (name=default) with tier type = 2024-09-14T11:41:48.226 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:48.225+0000 7f36b09409c0 20 add_watcher() i=0 2024-09-14T11:41:48.226 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:48.225+0000 7f36b09409c0 20 add_watcher() i=1 2024-09-14T11:41:48.226 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:48.225+0000 7f36b09409c0 20 add_watcher() i=2 2024-09-14T11:41:48.226 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:48.225+0000 7f36b09409c0 20 add_watcher() i=3 2024-09-14T11:41:48.226 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:48.225+0000 7f36b09409c0 20 add_watcher() i=4 2024-09-14T11:41:48.226 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:48.225+0000 7f36b09409c0 20 add_watcher() i=5 2024-09-14T11:41:48.226 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:48.225+0000 7f36b09409c0 20 add_watcher() i=6 2024-09-14T11:41:48.228 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:48.229+0000 7f36b09409c0 20 add_watcher() i=7 2024-09-14T11:41:48.228 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:48.229+0000 7f36b09409c0 2 all 8 watchers are set, enabling cache 2024-09-14T11:41:48.232 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:48.229+0000 7f3564fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:41:48.233 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:48.233+0000 7f36b09409c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:41:48.233 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:48.233+0000 7f36b09409c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:41:48.233 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:48.233+0000 7f36b09409c0 5 note: GC not initialized 2024-09-14T11:41:48.234 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:48.233+0000 7f34df7fe640 20 reqs_thread_entry: start 2024-09-14T11:41:48.234 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:48.233+0000 7f36b09409c0 20 init_complete bucket index max shards: 11 2024-09-14T11:41:48.234 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:48.233+0000 7f36b09409c0 20 Filter name: none 2024-09-14T11:41:48.234 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:48.233+0000 7f34dd7fa640 20 reqs_thread_entry: start 2024-09-14T11:41:48.234 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:48.233+0000 7f36b09409c0 20 rados->read ofs=0 len=0 2024-09-14T11:41:48.235 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:48.233+0000 7f36b09409c0 20 rados_obj.operate() r=0 bl.length=176 2024-09-14T11:41:48.235 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:48.233+0000 7f36b09409c0 20 rados->read ofs=0 len=0 2024-09-14T11:41:48.236 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:48.233+0000 7f36b09409c0 20 rados_obj.operate() r=0 bl.length=398 2024-09-14T11:41:48.236 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:48.233+0000 7f36b09409c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:41:48.236 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:48.233+0000 7f36b09409c0 20 rados->read ofs=0 len=0 2024-09-14T11:41:48.237 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:48.237+0000 7f36b09409c0 20 rados_obj.operate() r=0 bl.length=176 2024-09-14T11:41:48.237 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:48.237+0000 7f36b09409c0 20 rados->read ofs=0 len=0 2024-09-14T11:41:48.237 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:48.237+0000 7f36b09409c0 20 rados_obj.operate() r=0 bl.length=398 2024-09-14T11:41:48.237 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:48.237+0000 7f36b09409c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:41:48.241 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:48.241+0000 7f3564fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:41:48.246 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:48.245+0000 7f36b09409c0 20 remove_watcher() i=0 2024-09-14T11:41:48.246 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:48.245+0000 7f36b09409c0 2 removed watcher, disabling cache 2024-09-14T11:41:48.248 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:48.245+0000 7f36b09409c0 20 remove_watcher() i=1 2024-09-14T11:41:48.250 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:48.249+0000 7f36b09409c0 20 remove_watcher() i=2 2024-09-14T11:41:48.252 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:48.253+0000 7f36b09409c0 20 remove_watcher() i=3 2024-09-14T11:41:48.254 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:48.253+0000 7f36b09409c0 20 remove_watcher() i=4 2024-09-14T11:41:48.256 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:48.253+0000 7f36b09409c0 20 remove_watcher() i=5 2024-09-14T11:41:48.258 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:48.257+0000 7f36b09409c0 20 remove_watcher() i=6 2024-09-14T11:41:48.259 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:48.257+0000 7f36b09409c0 20 remove_watcher() i=7 2024-09-14T11:41:48.275 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-14T11:41:48.275 INFO:tasks.workunit.client.0.smithi138.stderr:BUCKET_STATS: 2024-09-14T11:41:48.275 INFO:tasks.workunit.client.0.smithi138.stderr:bucket: a-bucket id: d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.17 num_objects: 0 size_kb: 0 num_shards: 13 2024-09-14T11:41:48.275 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-14T11:41:48.275 INFO:tasks.workunit.client.0.smithi138.stderr:radosgw-admin bucket layout --bucket a-bucket 2024-09-14T11:41:48.302 INFO:tasks.workunit.client.0.smithi138.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:41:48.302 INFO:tasks.workunit.client.0.smithi138.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:41:48.347 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:48.345+0000 7f3e8fa839c0 20 rados->read ofs=0 len=0 2024-09-14T11:41:48.349 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:48.349+0000 7f3e8fa839c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:41:48.349 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:48.349+0000 7f3e8fa839c0 20 realm 2024-09-14T11:41:48.349 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:48.349+0000 7f3e8fa839c0 20 rados->read ofs=0 len=0 2024-09-14T11:41:48.349 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:48.349+0000 7f3e8fa839c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:41:48.349 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:48.349+0000 7f3e8fa839c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:41:48.349 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:48.349+0000 7f3e8fa839c0 20 rados->read ofs=0 len=0 2024-09-14T11:41:48.350 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:48.349+0000 7f3e8fa839c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:41:48.350 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:48.349+0000 7f3e8fa839c0 20 rados->read ofs=0 len=0 2024-09-14T11:41:48.351 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:48.349+0000 7f3e8fa839c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:41:48.351 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:48.349+0000 7f3e8fa839c0 20 rados->read ofs=0 len=0 2024-09-14T11:41:48.352 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:48.353+0000 7f3e8fa839c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:41:48.352 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:48.353+0000 7f3e8fa839c0 20 searching for the correct realm 2024-09-14T11:41:48.357 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:48.357+0000 7f3e8d589640 0 -- 172.21.15.138:0/2071984827 >> [v2:172.21.15.138:6808/3258321916,v1:172.21.15.138:6809/3258321916] conn(0x564009bf61b0 msgr2=0x564009bf8670 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:41:48.362 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:48.361+0000 7f3e8cd88640 0 -- 172.21.15.138:0/2071984827 >> [v2:172.21.15.138:6816/326481658,v1:172.21.15.138:6817/326481658] conn(0x7f3e800977b0 msgr2=0x7f3e8006b770 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-14T11:41:48.371 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:48.369+0000 7f3e8fa839c0 20 RGWRados::pool_iterate: got zone_info.d9e72d30-c60b-4d0d-9267-fdc36392d5ad 2024-09-14T11:41:48.371 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:48.369+0000 7f3e8fa839c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:41:48.371 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:48.369+0000 7f3e8fa839c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:41:48.371 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:48.369+0000 7f3e8fa839c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:41:48.371 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:48.369+0000 7f3e8fa839c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:41:48.371 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:48.369+0000 7f3e8fa839c0 20 RGWRados::pool_iterate: got zonegroup_info.65ab941b-da8c-4160-94fb-3672b069d44f 2024-09-14T11:41:48.371 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:48.369+0000 7f3e8fa839c0 20 rados->read ofs=0 len=0 2024-09-14T11:41:48.372 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:48.369+0000 7f3e8fa839c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:41:48.372 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:48.369+0000 7f3e8fa839c0 20 rados->read ofs=0 len=0 2024-09-14T11:41:48.372 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:48.373+0000 7f3e8fa839c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:41:48.372 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:48.373+0000 7f3e8fa839c0 20 rados->read ofs=0 len=0 2024-09-14T11:41:48.373 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:48.373+0000 7f3e8fa839c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:41:48.373 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:48.373+0000 7f3e8fa839c0 20 zone default found 2024-09-14T11:41:48.373 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:48.373+0000 7f3e8fa839c0 4 Realm: () 2024-09-14T11:41:48.373 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:48.373+0000 7f3e8fa839c0 4 ZoneGroup: default (65ab941b-da8c-4160-94fb-3672b069d44f) 2024-09-14T11:41:48.373 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:48.373+0000 7f3e8fa839c0 4 Zone: default (d9e72d30-c60b-4d0d-9267-fdc36392d5ad) 2024-09-14T11:41:48.373 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:48.373+0000 7f3e8fa839c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:41:48.373 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:48.373+0000 7f3e8fa839c0 20 zonegroup default 2024-09-14T11:41:48.373 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:48.373+0000 7f3e8fa839c0 20 rados->read ofs=0 len=0 2024-09-14T11:41:48.374 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:48.373+0000 7f3e8fa839c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:41:48.374 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:48.373+0000 7f3e8fa839c0 20 rados->read ofs=0 len=0 2024-09-14T11:41:48.374 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:48.373+0000 7f3e8fa839c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:41:48.375 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:48.373+0000 7f3e8fa839c0 20 rados->read ofs=0 len=0 2024-09-14T11:41:48.375 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:48.373+0000 7f3e8fa839c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:41:48.375 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:48.373+0000 7f3e8fa839c0 20 started sync module instance, tier type = 2024-09-14T11:41:48.375 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:48.373+0000 7f3e8fa839c0 20 started zone id=d9e72d30-c60b-4d0d-9267-fdc36392d5ad (name=default) with tier type = 2024-09-14T11:41:48.390 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:48.389+0000 7f3e8fa839c0 20 add_watcher() i=0 2024-09-14T11:41:48.390 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:48.389+0000 7f3e8fa839c0 20 add_watcher() i=1 2024-09-14T11:41:48.390 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:48.389+0000 7f3e8fa839c0 20 add_watcher() i=2 2024-09-14T11:41:48.390 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:48.389+0000 7f3e8fa839c0 20 add_watcher() i=3 2024-09-14T11:41:48.390 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:48.389+0000 7f3e8fa839c0 20 add_watcher() i=4 2024-09-14T11:41:48.390 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:48.389+0000 7f3e8fa839c0 20 add_watcher() i=5 2024-09-14T11:41:48.390 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:48.389+0000 7f3e8fa839c0 20 add_watcher() i=6 2024-09-14T11:41:48.391 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:48.389+0000 7f3e8fa839c0 20 add_watcher() i=7 2024-09-14T11:41:48.391 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:48.389+0000 7f3e8fa839c0 2 all 8 watchers are set, enabling cache 2024-09-14T11:41:48.393 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:48.393+0000 7f3d437e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:41:48.394 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:48.393+0000 7f3e8fa839c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:41:48.394 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:48.393+0000 7f3e8fa839c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:41:48.394 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:48.393+0000 7f3e8fa839c0 5 note: GC not initialized 2024-09-14T11:41:48.395 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:48.393+0000 7f3d427e4640 20 reqs_thread_entry: start 2024-09-14T11:41:48.395 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:48.393+0000 7f3e8fa839c0 20 init_complete bucket index max shards: 11 2024-09-14T11:41:48.395 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:48.393+0000 7f3e8fa839c0 20 Filter name: none 2024-09-14T11:41:48.395 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:48.393+0000 7f3cb3fff640 20 reqs_thread_entry: start 2024-09-14T11:41:48.395 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:48.393+0000 7f3e8fa839c0 20 rados->read ofs=0 len=0 2024-09-14T11:41:48.396 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:48.393+0000 7f3e8fa839c0 20 rados_obj.operate() r=0 bl.length=176 2024-09-14T11:41:48.396 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:48.393+0000 7f3e8fa839c0 20 rados->read ofs=0 len=0 2024-09-14T11:41:48.396 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:48.393+0000 7f3e8fa839c0 20 rados_obj.operate() r=0 bl.length=398 2024-09-14T11:41:48.396 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:48.393+0000 7f3e8fa839c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:41:48.396 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:48.397+0000 7f3d437e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:41:48.402 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:48.401+0000 7f3e8fa839c0 20 remove_watcher() i=0 2024-09-14T11:41:48.402 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:48.401+0000 7f3e8fa839c0 2 removed watcher, disabling cache 2024-09-14T11:41:48.404 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:48.401+0000 7f3e8fa839c0 20 remove_watcher() i=1 2024-09-14T11:41:48.406 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:48.405+0000 7f3e8fa839c0 20 remove_watcher() i=2 2024-09-14T11:41:48.408 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:48.405+0000 7f3e8fa839c0 20 remove_watcher() i=3 2024-09-14T11:41:48.410 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:48.409+0000 7f3e8fa839c0 20 remove_watcher() i=4 2024-09-14T11:41:48.412 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:48.409+0000 7f3e8fa839c0 20 remove_watcher() i=5 2024-09-14T11:41:48.413 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:48.413+0000 7f3e8fa839c0 20 remove_watcher() i=6 2024-09-14T11:41:48.414 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:48.413+0000 7f3e8fa839c0 20 remove_watcher() i=7 2024-09-14T11:41:48.427 INFO:tasks.workunit.client.0.smithi138.stderr:rados -p default.rgw.buckets.index setomapval .dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.17.2.0 --omap-key-file /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/olh_noname_key < /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/olh_noname_val 2024-09-14T11:41:48.453 INFO:tasks.workunit.client.0.smithi138.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:41:48.453 INFO:tasks.workunit.client.0.smithi138.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:41:48.473 INFO:tasks.workunit.client.0.smithi138.stderr:radosgw-admin bi list --bucket a-bucket 2024-09-14T11:41:48.499 INFO:tasks.workunit.client.0.smithi138.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:41:48.499 INFO:tasks.workunit.client.0.smithi138.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:41:48.541 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:48.541+0000 7f174e0aa9c0 20 rados->read ofs=0 len=0 2024-09-14T11:41:48.543 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:48.541+0000 7f174e0aa9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:41:48.543 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:48.541+0000 7f174e0aa9c0 20 realm 2024-09-14T11:41:48.544 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:48.541+0000 7f174e0aa9c0 20 rados->read ofs=0 len=0 2024-09-14T11:41:48.544 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:48.541+0000 7f174e0aa9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:41:48.544 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:48.541+0000 7f174e0aa9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:41:48.544 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:48.541+0000 7f174e0aa9c0 20 rados->read ofs=0 len=0 2024-09-14T11:41:48.544 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:48.541+0000 7f174e0aa9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:41:48.544 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:48.541+0000 7f174e0aa9c0 20 rados->read ofs=0 len=0 2024-09-14T11:41:48.545 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:48.545+0000 7f174e0aa9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:41:48.545 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:48.545+0000 7f174e0aa9c0 20 rados->read ofs=0 len=0 2024-09-14T11:41:48.546 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:48.545+0000 7f174e0aa9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:41:48.546 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:48.545+0000 7f174e0aa9c0 20 searching for the correct realm 2024-09-14T11:41:48.547 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:48.545+0000 7f174b3af640 0 -- 172.21.15.138:0/1837084251 >> [v2:172.21.15.154:6808/1468088432,v1:172.21.15.154:6809/1468088432] conn(0x7f173c0df950 msgr2=0x7f173c0d1410 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:41:48.759 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:48.757+0000 7f174c3b1640 0 -- 172.21.15.138:0/1837084251 >> [v2:172.21.15.138:6824/2633984942,v1:172.21.15.138:6825/2633984942] conn(0x5622342f5c00 msgr2=0x5622342f7ff0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:41:48.776 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:48.777+0000 7f174e0aa9c0 20 RGWRados::pool_iterate: got zone_info.d9e72d30-c60b-4d0d-9267-fdc36392d5ad 2024-09-14T11:41:48.776 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:48.777+0000 7f174e0aa9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:41:48.777 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:48.777+0000 7f174e0aa9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:41:48.777 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:48.777+0000 7f174e0aa9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:41:48.777 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:48.777+0000 7f174e0aa9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:41:48.777 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:48.777+0000 7f174e0aa9c0 20 RGWRados::pool_iterate: got zonegroup_info.65ab941b-da8c-4160-94fb-3672b069d44f 2024-09-14T11:41:48.777 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:48.777+0000 7f174e0aa9c0 20 rados->read ofs=0 len=0 2024-09-14T11:41:48.778 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:48.777+0000 7f174e0aa9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:41:48.778 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:48.777+0000 7f174e0aa9c0 20 rados->read ofs=0 len=0 2024-09-14T11:41:48.778 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:48.777+0000 7f174e0aa9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:41:48.778 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:48.777+0000 7f174e0aa9c0 20 rados->read ofs=0 len=0 2024-09-14T11:41:48.779 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:48.777+0000 7f174e0aa9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:41:48.779 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:48.777+0000 7f174e0aa9c0 20 zone default found 2024-09-14T11:41:48.779 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:48.777+0000 7f174e0aa9c0 4 Realm: () 2024-09-14T11:41:48.779 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:48.777+0000 7f174e0aa9c0 4 ZoneGroup: default (65ab941b-da8c-4160-94fb-3672b069d44f) 2024-09-14T11:41:48.779 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:48.777+0000 7f174e0aa9c0 4 Zone: default (d9e72d30-c60b-4d0d-9267-fdc36392d5ad) 2024-09-14T11:41:48.779 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:48.777+0000 7f174e0aa9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:41:48.779 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:48.777+0000 7f174e0aa9c0 20 zonegroup default 2024-09-14T11:41:48.779 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:48.777+0000 7f174e0aa9c0 20 rados->read ofs=0 len=0 2024-09-14T11:41:48.780 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:48.777+0000 7f174e0aa9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:41:48.780 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:48.777+0000 7f174e0aa9c0 20 rados->read ofs=0 len=0 2024-09-14T11:41:48.780 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:48.781+0000 7f174e0aa9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:41:48.780 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:48.781+0000 7f174e0aa9c0 20 rados->read ofs=0 len=0 2024-09-14T11:41:48.781 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:48.781+0000 7f174e0aa9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:41:48.781 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:48.781+0000 7f174e0aa9c0 20 started sync module instance, tier type = 2024-09-14T11:41:48.781 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:48.781+0000 7f174e0aa9c0 20 started zone id=d9e72d30-c60b-4d0d-9267-fdc36392d5ad (name=default) with tier type = 2024-09-14T11:41:48.801 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:48.801+0000 7f174e0aa9c0 20 add_watcher() i=0 2024-09-14T11:41:48.801 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:48.801+0000 7f174e0aa9c0 20 add_watcher() i=1 2024-09-14T11:41:48.801 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:48.801+0000 7f174e0aa9c0 20 add_watcher() i=2 2024-09-14T11:41:48.801 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:48.801+0000 7f174e0aa9c0 20 add_watcher() i=3 2024-09-14T11:41:48.801 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:48.801+0000 7f174e0aa9c0 20 add_watcher() i=4 2024-09-14T11:41:48.801 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:48.801+0000 7f174e0aa9c0 20 add_watcher() i=5 2024-09-14T11:41:48.801 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:48.801+0000 7f174e0aa9c0 20 add_watcher() i=6 2024-09-14T11:41:48.802 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:48.801+0000 7f174e0aa9c0 20 add_watcher() i=7 2024-09-14T11:41:48.802 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:48.801+0000 7f174e0aa9c0 2 all 8 watchers are set, enabling cache 2024-09-14T11:41:48.807 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:48.805+0000 7f1601fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:41:48.808 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:48.805+0000 7f174e0aa9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:41:48.808 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:48.805+0000 7f174e0aa9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:41:48.808 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:48.809+0000 7f174e0aa9c0 5 note: GC not initialized 2024-09-14T11:41:48.809 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:48.809+0000 7f1600fe1640 20 reqs_thread_entry: start 2024-09-14T11:41:48.809 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:48.809+0000 7f174e0aa9c0 20 init_complete bucket index max shards: 11 2024-09-14T11:41:48.809 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:48.809+0000 7f174e0aa9c0 20 Filter name: none 2024-09-14T11:41:48.809 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:48.809+0000 7f157a7fc640 20 reqs_thread_entry: start 2024-09-14T11:41:48.809 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:48.809+0000 7f174e0aa9c0 20 rados->read ofs=0 len=0 2024-09-14T11:41:48.811 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:48.809+0000 7f174e0aa9c0 20 rados_obj.operate() r=0 bl.length=176 2024-09-14T11:41:48.811 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:48.809+0000 7f174e0aa9c0 20 rados->read ofs=0 len=0 2024-09-14T11:41:48.812 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:48.809+0000 7f174e0aa9c0 20 rados_obj.operate() r=0 bl.length=398 2024-09-14T11:41:48.812 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:48.809+0000 7f174e0aa9c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:41:48.812 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:48.809+0000 7f174e0aa9c0 20 INFO: main: max_entries=1000, index=gen=2, max_shards=13 2024-09-14T11:41:48.812 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:48.809+0000 7f174e0aa9c0 20 INFO: main: starting shard=0 2024-09-14T11:41:48.812 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:48.809+0000 7f174e0aa9c0 10 bucket_obj is .dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.17.2.0 2024-09-14T11:41:48.812 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:48.809+0000 7f174e0aa9c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.17.2.0 2024-09-14T11:41:48.813 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:48.813+0000 7f174e0aa9c0 20 INFO: main: bi_list() returned without error; entries.size()=1, is_truncated=0, marker= 2024-09-14T11:41:48.813 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:48.813+0000 7f174e0aa9c0 20 INFO: main: starting shard=1 2024-09-14T11:41:48.813 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:48.813+0000 7f174e0aa9c0 10 bucket_obj is .dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.17.2.1 2024-09-14T11:41:48.813 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:48.813+0000 7f174e0aa9c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.17.2.1 2024-09-14T11:41:48.815 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:48.813+0000 7f174e0aa9c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:41:48.815 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:48.813+0000 7f174e0aa9c0 20 INFO: main: starting shard=2 2024-09-14T11:41:48.815 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:48.813+0000 7f174e0aa9c0 10 bucket_obj is .dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.17.2.2 2024-09-14T11:41:48.815 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:48.813+0000 7f174e0aa9c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.17.2.2 2024-09-14T11:41:48.816 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:48.813+0000 7f174e0aa9c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:41:48.816 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:48.813+0000 7f174e0aa9c0 20 INFO: main: starting shard=3 2024-09-14T11:41:48.816 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:48.813+0000 7f174e0aa9c0 10 bucket_obj is .dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.17.2.3 2024-09-14T11:41:48.816 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:48.813+0000 7f174e0aa9c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.17.2.3 2024-09-14T11:41:48.817 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:48.817+0000 7f174e0aa9c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:41:48.817 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:48.817+0000 7f174e0aa9c0 20 INFO: main: starting shard=4 2024-09-14T11:41:48.817 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:48.817+0000 7f174e0aa9c0 10 bucket_obj is .dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.17.2.4 2024-09-14T11:41:48.817 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:48.817+0000 7f174e0aa9c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.17.2.4 2024-09-14T11:41:48.818 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:48.817+0000 7f174e0aa9c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:41:48.818 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:48.817+0000 7f174e0aa9c0 20 INFO: main: starting shard=5 2024-09-14T11:41:48.818 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:48.817+0000 7f174e0aa9c0 10 bucket_obj is .dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.17.2.5 2024-09-14T11:41:48.819 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:48.817+0000 7f174e0aa9c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.17.2.5 2024-09-14T11:41:48.819 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:48.817+0000 7f174e0aa9c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:41:48.819 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:48.817+0000 7f174e0aa9c0 20 INFO: main: starting shard=6 2024-09-14T11:41:48.819 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:48.817+0000 7f174e0aa9c0 10 bucket_obj is .dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.17.2.6 2024-09-14T11:41:48.819 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:48.817+0000 7f174e0aa9c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.17.2.6 2024-09-14T11:41:48.820 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:48.821+0000 7f174e0aa9c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:41:48.820 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:48.821+0000 7f174e0aa9c0 20 INFO: main: starting shard=7 2024-09-14T11:41:48.820 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:48.821+0000 7f174e0aa9c0 10 bucket_obj is .dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.17.2.7 2024-09-14T11:41:48.821 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:48.821+0000 7f174e0aa9c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.17.2.7 2024-09-14T11:41:48.821 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:48.821+0000 7f174e0aa9c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:41:48.821 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:48.821+0000 7f174e0aa9c0 20 INFO: main: starting shard=8 2024-09-14T11:41:48.821 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:48.821+0000 7f174e0aa9c0 10 bucket_obj is .dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.17.2.8 2024-09-14T11:41:48.821 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:48.821+0000 7f174e0aa9c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.17.2.8 2024-09-14T11:41:48.822 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:48.821+0000 7f174e0aa9c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:41:48.822 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:48.821+0000 7f174e0aa9c0 20 INFO: main: starting shard=9 2024-09-14T11:41:48.822 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:48.821+0000 7f174e0aa9c0 10 bucket_obj is .dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.17.2.9 2024-09-14T11:41:48.822 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:48.821+0000 7f174e0aa9c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.17.2.9 2024-09-14T11:41:48.824 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:48.821+0000 7f174e0aa9c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:41:48.824 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:48.821+0000 7f174e0aa9c0 20 INFO: main: starting shard=10 2024-09-14T11:41:48.824 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:48.821+0000 7f174e0aa9c0 10 bucket_obj is .dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.17.2.10 2024-09-14T11:41:48.824 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:48.821+0000 7f174e0aa9c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.17.2.10 2024-09-14T11:41:48.825 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:48.825+0000 7f174e0aa9c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:41:48.825 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:48.825+0000 7f174e0aa9c0 20 INFO: main: starting shard=11 2024-09-14T11:41:48.825 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:48.825+0000 7f174e0aa9c0 10 bucket_obj is .dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.17.2.11 2024-09-14T11:41:48.825 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:48.825+0000 7f174e0aa9c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.17.2.11 2024-09-14T11:41:48.826 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:48.825+0000 7f174e0aa9c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:41:48.826 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:48.825+0000 7f174e0aa9c0 20 INFO: main: starting shard=12 2024-09-14T11:41:48.826 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:48.825+0000 7f174e0aa9c0 10 bucket_obj is .dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.17.2.12 2024-09-14T11:41:48.826 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:48.825+0000 7f174e0aa9c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.17.2.12 2024-09-14T11:41:48.827 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:48.825+0000 7f174e0aa9c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:41:48.827 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:48.825+0000 7f174e0aa9c0 20 INFO: main: done 2024-09-14T11:41:48.828 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:48.829+0000 7f1601fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:41:48.834 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:48.833+0000 7f174e0aa9c0 20 remove_watcher() i=0 2024-09-14T11:41:48.834 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:48.833+0000 7f174e0aa9c0 2 removed watcher, disabling cache 2024-09-14T11:41:48.836 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:48.833+0000 7f174e0aa9c0 20 remove_watcher() i=1 2024-09-14T11:41:48.838 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:48.837+0000 7f174e0aa9c0 20 remove_watcher() i=2 2024-09-14T11:41:48.841 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:48.841+0000 7f174e0aa9c0 20 remove_watcher() i=3 2024-09-14T11:41:48.843 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:48.841+0000 7f174e0aa9c0 20 remove_watcher() i=4 2024-09-14T11:41:48.845 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:48.845+0000 7f174e0aa9c0 20 remove_watcher() i=5 2024-09-14T11:41:48.846 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:48.845+0000 7f174e0aa9c0 20 remove_watcher() i=6 2024-09-14T11:41:48.848 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:48.845+0000 7f174e0aa9c0 20 remove_watcher() i=7 2024-09-14T11:41:48.864 INFO:tasks.workunit.client.0.smithi138.stderr:radosgw-admin bucket reshard --bucket a-bucket --num-shards 1 --yes-i-really-mean-it 2024-09-14T11:41:48.894 INFO:tasks.workunit.client.0.smithi138.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:41:48.894 INFO:tasks.workunit.client.0.smithi138.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:41:48.940 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:48.937+0000 7fe7981809c0 20 rados->read ofs=0 len=0 2024-09-14T11:41:48.942 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:48.941+0000 7fe7981809c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:41:48.942 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:48.941+0000 7fe7981809c0 20 realm 2024-09-14T11:41:48.942 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:48.941+0000 7fe7981809c0 20 rados->read ofs=0 len=0 2024-09-14T11:41:48.942 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:48.941+0000 7fe7981809c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:41:48.942 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:48.941+0000 7fe7981809c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:41:48.942 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:48.941+0000 7fe7981809c0 20 rados->read ofs=0 len=0 2024-09-14T11:41:48.942 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:48.941+0000 7fe7981809c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:41:48.942 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:48.941+0000 7fe7981809c0 20 rados->read ofs=0 len=0 2024-09-14T11:41:48.943 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:48.941+0000 7fe7981809c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:41:48.944 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:48.941+0000 7fe7981809c0 20 rados->read ofs=0 len=0 2024-09-14T11:41:48.944 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:48.945+0000 7fe7981809c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:41:48.944 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:48.945+0000 7fe7981809c0 20 searching for the correct realm 2024-09-14T11:41:48.948 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:48.945+0000 7fe796487640 0 -- 172.21.15.138:0/2509314909 >> [v2:172.21.15.154:6824/416768175,v1:172.21.15.154:6825/416768175] conn(0x7fe790026070 msgr2=0x7fe790062700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:41:49.161 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:49.161+0000 7fe795485640 0 -- 172.21.15.138:0/2509314909 >> [v2:172.21.15.138:6816/326481658,v1:172.21.15.138:6817/326481658] conn(0x7fe7900987a0 msgr2=0x7fe79006b750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:41:49.380 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:49.377+0000 7fe7981809c0 20 RGWRados::pool_iterate: got zone_info.d9e72d30-c60b-4d0d-9267-fdc36392d5ad 2024-09-14T11:41:49.380 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:49.377+0000 7fe7981809c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:41:49.380 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:49.377+0000 7fe7981809c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:41:49.380 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:49.377+0000 7fe7981809c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:41:49.380 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:49.377+0000 7fe7981809c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:41:49.381 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:49.377+0000 7fe7981809c0 20 RGWRados::pool_iterate: got zonegroup_info.65ab941b-da8c-4160-94fb-3672b069d44f 2024-09-14T11:41:49.381 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:49.377+0000 7fe7981809c0 20 rados->read ofs=0 len=0 2024-09-14T11:41:49.381 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:49.381+0000 7fe7981809c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:41:49.381 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:49.381+0000 7fe7981809c0 20 rados->read ofs=0 len=0 2024-09-14T11:41:49.381 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:49.381+0000 7fe7981809c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:41:49.381 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:49.381+0000 7fe7981809c0 20 rados->read ofs=0 len=0 2024-09-14T11:41:49.382 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:49.381+0000 7fe7981809c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:41:49.382 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:49.381+0000 7fe7981809c0 20 zone default found 2024-09-14T11:41:49.382 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:49.381+0000 7fe7981809c0 4 Realm: () 2024-09-14T11:41:49.382 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:49.381+0000 7fe7981809c0 4 ZoneGroup: default (65ab941b-da8c-4160-94fb-3672b069d44f) 2024-09-14T11:41:49.383 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:49.381+0000 7fe7981809c0 4 Zone: default (d9e72d30-c60b-4d0d-9267-fdc36392d5ad) 2024-09-14T11:41:49.383 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:49.381+0000 7fe7981809c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:41:49.383 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:49.381+0000 7fe7981809c0 20 zonegroup default 2024-09-14T11:41:49.383 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:49.381+0000 7fe7981809c0 20 rados->read ofs=0 len=0 2024-09-14T11:41:49.383 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:49.381+0000 7fe7981809c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:41:49.383 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:49.381+0000 7fe7981809c0 20 rados->read ofs=0 len=0 2024-09-14T11:41:49.384 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:49.381+0000 7fe7981809c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:41:49.384 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:49.381+0000 7fe7981809c0 20 rados->read ofs=0 len=0 2024-09-14T11:41:49.384 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:49.385+0000 7fe7981809c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:41:49.385 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:49.385+0000 7fe7981809c0 20 started sync module instance, tier type = 2024-09-14T11:41:49.385 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:49.385+0000 7fe7981809c0 20 started zone id=d9e72d30-c60b-4d0d-9267-fdc36392d5ad (name=default) with tier type = 2024-09-14T11:41:49.406 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:49.405+0000 7fe7981809c0 20 add_watcher() i=0 2024-09-14T11:41:49.406 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:49.405+0000 7fe7981809c0 20 add_watcher() i=1 2024-09-14T11:41:49.406 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:49.405+0000 7fe7981809c0 20 add_watcher() i=2 2024-09-14T11:41:49.406 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:49.405+0000 7fe7981809c0 20 add_watcher() i=3 2024-09-14T11:41:49.406 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:49.405+0000 7fe7981809c0 20 add_watcher() i=4 2024-09-14T11:41:49.407 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:49.405+0000 7fe7981809c0 20 add_watcher() i=5 2024-09-14T11:41:49.407 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:49.405+0000 7fe7981809c0 20 add_watcher() i=6 2024-09-14T11:41:49.408 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:49.405+0000 7fe7981809c0 20 add_watcher() i=7 2024-09-14T11:41:49.408 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:49.405+0000 7fe7981809c0 2 all 8 watchers are set, enabling cache 2024-09-14T11:41:49.411 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:49.409+0000 7fe6477fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:41:49.412 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:49.413+0000 7fe7981809c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:41:49.412 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:49.413+0000 7fe7981809c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:41:49.412 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:49.413+0000 7fe7981809c0 5 note: GC not initialized 2024-09-14T11:41:49.413 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:49.413+0000 7fe6467fc640 20 reqs_thread_entry: start 2024-09-14T11:41:49.413 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:49.413+0000 7fe7981809c0 20 init_complete bucket index max shards: 11 2024-09-14T11:41:49.414 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:49.413+0000 7fe7981809c0 20 Filter name: none 2024-09-14T11:41:49.414 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:49.413+0000 7fe5b7fff640 20 reqs_thread_entry: start 2024-09-14T11:41:49.414 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:49.413+0000 7fe7981809c0 10 cache get: name=default.rgw.meta+root+a-bucket : miss 2024-09-14T11:41:49.414 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:49.413+0000 7fe7981809c0 20 rados->read ofs=0 len=0 2024-09-14T11:41:49.415 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:49.413+0000 7fe7981809c0 20 rados_obj.operate() r=0 bl.length=176 2024-09-14T11:41:49.415 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:49.413+0000 7fe7981809c0 10 cache put: name=default.rgw.meta+root+a-bucket info.flags=0x11 2024-09-14T11:41:49.415 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:49.413+0000 7fe7981809c0 10 adding default.rgw.meta+root+a-bucket to cache LRU end 2024-09-14T11:41:49.415 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:49.413+0000 7fe7981809c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.17 : miss 2024-09-14T11:41:49.415 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:49.413+0000 7fe7981809c0 20 rados->read ofs=0 len=0 2024-09-14T11:41:49.416 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:49.413+0000 7fe7981809c0 20 rados_obj.operate() r=0 bl.length=398 2024-09-14T11:41:49.416 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:49.413+0000 7fe7981809c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.17 info.flags=0x17 2024-09-14T11:41:49.416 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:49.413+0000 7fe7981809c0 10 adding default.rgw.meta+root+.bucket.meta.a-bucket:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.17 to cache LRU end 2024-09-14T11:41:49.416 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:49.413+0000 7fe7981809c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:41:49.416 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:49.413+0000 7fe7981809c0 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-14T11:41:49.416 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:49.413+0000 7fe7981809c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.17 2024-09-14T11:41:49.426 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:49.425+0000 7fe7981809c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.17 info.flags=0x17 2024-09-14T11:41:49.426 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:49.425+0000 7fe7981809c0 10 moving default.rgw.meta+root+.bucket.meta.a-bucket:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.17 to cache LRU end 2024-09-14T11:41:49.426 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:49.425+0000 7fe7981809c0 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-14T11:41:49.426 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:49.425+0000 7fe7981809c0 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.a-bucket:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.17, ofs0, ns] 2024-09-14T11:41:49.426 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:49.425+0000 7fe678ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366245 cookie 94770017979936 notifier 7904 bl.length()=827 2024-09-14T11:41:49.427 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:49.425+0000 7fe678ff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.17 info.flags=0x17 2024-09-14T11:41:49.427 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:49.425+0000 7fe678ff9640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.a-bucket:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.17 to cache LRU end 2024-09-14T11:41:49.427 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:49.425+0000 7fe678ff9640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=143 2024-09-14T11:41:49.429 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:49.429+0000 7fe7981809c0 20 handle_bi_update(): bucket=:a-bucket[d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.17]): orig_sources= new_sources= 2024-09-14T11:41:49.429 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:49.429+0000 7fe7981809c0 20 handle_bi_update(): bucket=:a-bucket[d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.17]): potential sources added=[] removed=[] 2024-09-14T11:41:49.429 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:49.429+0000 7fe7981809c0 20 handle_bi_update(): bucket=:a-bucket[d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.17]): orig_dests= new_dests= 2024-09-14T11:41:49.430 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:49.429+0000 7fe7981809c0 20 handle_bi_update(): bucket=:a-bucket[d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.17]): potential dests added=[] removed=[] 2024-09-14T11:41:49.444 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:49.445+0000 7fe7981809c0 10 bucket_obj is .dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.17.3.0 2024-09-14T11:41:49.444 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:49.445+0000 7fe7981809c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.17.3.0 2024-09-14T11:41:49.445 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:49.445+0000 7fe7981809c0 10 bucket_obj is .dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.17.2.0 2024-09-14T11:41:49.445 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:49.445+0000 7fe7981809c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.17.2.0 2024-09-14T11:41:49.445 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:49.445+0000 7fe7981809c0 10 Dropping entry with empty name, idx=�1001_04/57/0457f727ec113e418d5b16d206b200ed068c0533554883ce811df7c932a3df68/2018_12_11/2889999/3386469/metadata.gz 2024-09-14T11:41:49.446 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:49.445+0000 7fe7981809c0 10 bucket_obj is .dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.17.2.1 2024-09-14T11:41:49.446 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:49.445+0000 7fe7981809c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.17.2.1 2024-09-14T11:41:49.447 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:49.445+0000 7fe7981809c0 10 bucket_obj is .dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.17.2.2 2024-09-14T11:41:49.447 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:49.445+0000 7fe7981809c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.17.2.2 2024-09-14T11:41:49.448 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:49.449+0000 7fe7981809c0 10 bucket_obj is .dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.17.2.3 2024-09-14T11:41:49.448 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:49.449+0000 7fe7981809c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.17.2.3 2024-09-14T11:41:49.449 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:49.449+0000 7fe7981809c0 10 bucket_obj is .dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.17.2.4 2024-09-14T11:41:49.449 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:49.449+0000 7fe7981809c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.17.2.4 2024-09-14T11:41:49.450 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:49.449+0000 7fe7981809c0 10 bucket_obj is .dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.17.2.5 2024-09-14T11:41:49.450 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:49.449+0000 7fe7981809c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.17.2.5 2024-09-14T11:41:49.451 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:49.449+0000 7fe7981809c0 10 bucket_obj is .dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.17.2.6 2024-09-14T11:41:49.451 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:49.449+0000 7fe7981809c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.17.2.6 2024-09-14T11:41:49.452 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:49.453+0000 7fe7981809c0 10 bucket_obj is .dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.17.2.7 2024-09-14T11:41:49.452 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:49.453+0000 7fe7981809c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.17.2.7 2024-09-14T11:41:49.453 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:49.453+0000 7fe7981809c0 10 bucket_obj is .dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.17.2.8 2024-09-14T11:41:49.453 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:49.453+0000 7fe7981809c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.17.2.8 2024-09-14T11:41:49.453 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:49.453+0000 7fe7981809c0 10 bucket_obj is .dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.17.2.9 2024-09-14T11:41:49.453 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:49.453+0000 7fe7981809c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.17.2.9 2024-09-14T11:41:49.454 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:49.453+0000 7fe7981809c0 10 bucket_obj is .dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.17.2.10 2024-09-14T11:41:49.455 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:49.453+0000 7fe7981809c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.17.2.10 2024-09-14T11:41:49.455 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:49.453+0000 7fe7981809c0 10 bucket_obj is .dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.17.2.11 2024-09-14T11:41:49.455 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:49.453+0000 7fe7981809c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.17.2.11 2024-09-14T11:41:49.456 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:49.453+0000 7fe7981809c0 10 bucket_obj is .dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.17.2.12 2024-09-14T11:41:49.456 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:49.453+0000 7fe7981809c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.17.2.12 2024-09-14T11:41:49.457 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:49.457+0000 7fe7981809c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.17 : hit (requested=0x17, cached=0x17) 2024-09-14T11:41:49.457 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:49.457+0000 7fe7981809c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.17 2024-09-14T11:41:49.460 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:49.461+0000 7fe7981809c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.17 info.flags=0x17 2024-09-14T11:41:49.460 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:49.461+0000 7fe7981809c0 10 moving default.rgw.meta+root+.bucket.meta.a-bucket:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.17 to cache LRU end 2024-09-14T11:41:49.460 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:49.461+0000 7fe7981809c0 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-14T11:41:49.460 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:49.461+0000 7fe7981809c0 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.a-bucket:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.17, ofs0, ns] 2024-09-14T11:41:49.461 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:49.461+0000 7fe6797fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366246 cookie 94770017979936 notifier 7904 bl.length()=827 2024-09-14T11:41:49.461 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:49.461+0000 7fe6797fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.17 info.flags=0x17 2024-09-14T11:41:49.461 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:49.461+0000 7fe6797fa640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.a-bucket:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.17 to cache LRU end 2024-09-14T11:41:49.461 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:49.461+0000 7fe6797fa640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=143 2024-09-14T11:41:49.464 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:49.461+0000 7fe7981809c0 20 handle_bi_update(): bucket=:a-bucket[d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.17]): orig_sources= new_sources= 2024-09-14T11:41:49.464 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:49.461+0000 7fe7981809c0 20 handle_bi_update(): bucket=:a-bucket[d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.17]): potential sources added=[] removed=[] 2024-09-14T11:41:49.464 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:49.461+0000 7fe7981809c0 20 handle_bi_update(): bucket=:a-bucket[d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.17]): orig_dests= new_dests= 2024-09-14T11:41:49.464 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:49.461+0000 7fe7981809c0 20 handle_bi_update(): bucket=:a-bucket[d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.17]): potential dests added=[] removed=[] 2024-09-14T11:41:49.470 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:49.469+0000 7fe7981809c0 10 bucket_obj is .dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.17.2.0 2024-09-14T11:41:49.470 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:49.469+0000 7fe7981809c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.17.2.0 2024-09-14T11:41:49.471 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:49.469+0000 7fe7981809c0 10 bucket_obj is .dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.17.2.1 2024-09-14T11:41:49.471 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:49.469+0000 7fe7981809c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.17.2.1 2024-09-14T11:41:49.472 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:49.473+0000 7fe7981809c0 10 bucket_obj is .dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.17.2.2 2024-09-14T11:41:49.472 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:49.473+0000 7fe7981809c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.17.2.2 2024-09-14T11:41:49.472 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:49.473+0000 7fe7981809c0 10 bucket_obj is .dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.17.2.3 2024-09-14T11:41:49.473 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:49.473+0000 7fe7981809c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.17.2.3 2024-09-14T11:41:49.473 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:49.473+0000 7fe7981809c0 10 bucket_obj is .dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.17.2.4 2024-09-14T11:41:49.473 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:49.473+0000 7fe7981809c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.17.2.4 2024-09-14T11:41:49.475 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:49.473+0000 7fe7981809c0 10 bucket_obj is .dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.17.2.5 2024-09-14T11:41:49.475 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:49.473+0000 7fe7981809c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.17.2.5 2024-09-14T11:41:49.475 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:49.473+0000 7fe7981809c0 10 bucket_obj is .dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.17.2.6 2024-09-14T11:41:49.475 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:49.473+0000 7fe7981809c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.17.2.6 2024-09-14T11:41:49.476 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:49.477+0000 7fe7981809c0 10 bucket_obj is .dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.17.2.7 2024-09-14T11:41:49.476 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:49.477+0000 7fe7981809c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.17.2.7 2024-09-14T11:41:49.477 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:49.477+0000 7fe7981809c0 10 bucket_obj is .dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.17.2.8 2024-09-14T11:41:49.477 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:49.477+0000 7fe7981809c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.17.2.8 2024-09-14T11:41:49.477 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:49.477+0000 7fe7981809c0 10 bucket_obj is .dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.17.2.9 2024-09-14T11:41:49.477 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:49.477+0000 7fe7981809c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.17.2.9 2024-09-14T11:41:49.478 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:49.477+0000 7fe7981809c0 10 bucket_obj is .dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.17.2.10 2024-09-14T11:41:49.478 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:49.477+0000 7fe7981809c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.17.2.10 2024-09-14T11:41:49.478 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:49.477+0000 7fe7981809c0 10 bucket_obj is .dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.17.2.11 2024-09-14T11:41:49.479 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:49.477+0000 7fe7981809c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.17.2.11 2024-09-14T11:41:49.479 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:49.477+0000 7fe7981809c0 10 bucket_obj is .dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.17.2.12 2024-09-14T11:41:49.479 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:49.477+0000 7fe7981809c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.17.2.12 2024-09-14T11:41:49.480 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:49.481+0000 7fe7981809c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.17 : hit (requested=0x17, cached=0x17) 2024-09-14T11:41:49.480 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:49.481+0000 7fe7981809c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.17 2024-09-14T11:41:49.482 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:49.481+0000 7fe7981809c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.17 info.flags=0x17 2024-09-14T11:41:49.482 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:49.481+0000 7fe7981809c0 10 moving default.rgw.meta+root+.bucket.meta.a-bucket:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.17 to cache LRU end 2024-09-14T11:41:49.482 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:49.481+0000 7fe7981809c0 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-14T11:41:49.482 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:49.481+0000 7fe7981809c0 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.a-bucket:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.17, ofs0, ns] 2024-09-14T11:41:49.483 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:49.481+0000 7fe6797fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366247 cookie 94770017979936 notifier 7904 bl.length()=795 2024-09-14T11:41:49.483 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:49.481+0000 7fe6797fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.17 info.flags=0x17 2024-09-14T11:41:49.483 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:49.481+0000 7fe6797fa640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.a-bucket:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.17 to cache LRU end 2024-09-14T11:41:49.483 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:49.481+0000 7fe6797fa640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=143 2024-09-14T11:41:49.486 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:49.485+0000 7fe7981809c0 20 handle_bi_update(): bucket=:a-bucket[d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.17]): orig_sources= new_sources= 2024-09-14T11:41:49.486 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:49.485+0000 7fe7981809c0 20 handle_bi_update(): bucket=:a-bucket[d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.17]): potential sources added=[] removed=[] 2024-09-14T11:41:49.486 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:49.485+0000 7fe7981809c0 20 handle_bi_update(): bucket=:a-bucket[d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.17]): orig_dests= new_dests= 2024-09-14T11:41:49.486 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:49.485+0000 7fe7981809c0 20 handle_bi_update(): bucket=:a-bucket[d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.17]): potential dests added=[] removed=[] 2024-09-14T11:41:49.491 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:49.489+0000 7fe7981809c0 1 execute INFO: reshard of bucket "a-bucket" from 13 shards to 1 shards completed successfully 2024-09-14T11:41:49.494 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:49.493+0000 7fe6477fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:41:49.499 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:49.497+0000 7fe7981809c0 20 remove_watcher() i=0 2024-09-14T11:41:49.499 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:49.497+0000 7fe7981809c0 2 removed watcher, disabling cache 2024-09-14T11:41:49.501 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:49.501+0000 7fe7981809c0 20 remove_watcher() i=1 2024-09-14T11:41:49.503 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:49.501+0000 7fe7981809c0 20 remove_watcher() i=2 2024-09-14T11:41:49.505 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:49.505+0000 7fe7981809c0 20 remove_watcher() i=3 2024-09-14T11:41:49.508 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:49.505+0000 7fe7981809c0 20 remove_watcher() i=4 2024-09-14T11:41:49.509 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:49.509+0000 7fe7981809c0 20 remove_watcher() i=5 2024-09-14T11:41:49.510 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:49.509+0000 7fe7981809c0 20 remove_watcher() i=6 2024-09-14T11:41:49.511 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:49.509+0000 7fe7981809c0 20 remove_watcher() i=7 2024-09-14T11:41:49.526 INFO:tasks.workunit.client.0.smithi138.stderr:radosgw-admin bi list --bucket a-bucket 2024-09-14T11:41:49.552 INFO:tasks.workunit.client.0.smithi138.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:41:49.552 INFO:tasks.workunit.client.0.smithi138.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:41:49.596 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:49.593+0000 7f87a78f39c0 20 rados->read ofs=0 len=0 2024-09-14T11:41:49.598 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:49.597+0000 7f87a78f39c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:41:49.598 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:49.597+0000 7f87a78f39c0 20 realm 2024-09-14T11:41:49.598 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:49.597+0000 7f87a78f39c0 20 rados->read ofs=0 len=0 2024-09-14T11:41:49.598 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:49.597+0000 7f87a78f39c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:41:49.598 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:49.597+0000 7f87a78f39c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:41:49.598 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:49.597+0000 7f87a78f39c0 20 rados->read ofs=0 len=0 2024-09-14T11:41:49.598 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:49.597+0000 7f87a78f39c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:41:49.598 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:49.597+0000 7f87a78f39c0 20 rados->read ofs=0 len=0 2024-09-14T11:41:49.600 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:49.597+0000 7f87a78f39c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:41:49.600 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:49.597+0000 7f87a78f39c0 20 rados->read ofs=0 len=0 2024-09-14T11:41:49.601 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:49.601+0000 7f87a78f39c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:41:49.601 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:49.601+0000 7f87a78f39c0 20 searching for the correct realm 2024-09-14T11:41:49.606 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:49.605+0000 7f87a5bfa640 0 -- 172.21.15.138:0/2715130035 >> [v2:172.21.15.138:6800/1799335858,v1:172.21.15.138:6801/1799335858] conn(0x55d7011637b0 msgr2=0x55d701165c70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:41:49.611 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:49.609+0000 7f87a4bf8640 0 -- 172.21.15.138:0/2715130035 >> [v2:172.21.15.138:6816/326481658,v1:172.21.15.138:6817/326481658] conn(0x7f87a004f420 msgr2=0x7f87a004f8a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:41:49.619 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:49.617+0000 7f87a78f39c0 20 RGWRados::pool_iterate: got zone_info.d9e72d30-c60b-4d0d-9267-fdc36392d5ad 2024-09-14T11:41:49.619 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:49.617+0000 7f87a78f39c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:41:49.619 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:49.617+0000 7f87a78f39c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:41:49.619 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:49.617+0000 7f87a78f39c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:41:49.619 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:49.617+0000 7f87a78f39c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:41:49.619 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:49.617+0000 7f87a78f39c0 20 RGWRados::pool_iterate: got zonegroup_info.65ab941b-da8c-4160-94fb-3672b069d44f 2024-09-14T11:41:49.619 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:49.617+0000 7f87a78f39c0 20 rados->read ofs=0 len=0 2024-09-14T11:41:49.619 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:49.617+0000 7f87a78f39c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:41:49.620 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:49.617+0000 7f87a78f39c0 20 rados->read ofs=0 len=0 2024-09-14T11:41:49.620 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:49.617+0000 7f87a78f39c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:41:49.620 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:49.617+0000 7f87a78f39c0 20 rados->read ofs=0 len=0 2024-09-14T11:41:49.621 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:49.621+0000 7f87a78f39c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:41:49.621 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:49.621+0000 7f87a78f39c0 20 zone default found 2024-09-14T11:41:49.621 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:49.621+0000 7f87a78f39c0 4 Realm: () 2024-09-14T11:41:49.621 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:49.621+0000 7f87a78f39c0 4 ZoneGroup: default (65ab941b-da8c-4160-94fb-3672b069d44f) 2024-09-14T11:41:49.621 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:49.621+0000 7f87a78f39c0 4 Zone: default (d9e72d30-c60b-4d0d-9267-fdc36392d5ad) 2024-09-14T11:41:49.621 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:49.621+0000 7f87a78f39c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:41:49.621 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:49.621+0000 7f87a78f39c0 20 zonegroup default 2024-09-14T11:41:49.621 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:49.621+0000 7f87a78f39c0 20 rados->read ofs=0 len=0 2024-09-14T11:41:49.622 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:49.621+0000 7f87a78f39c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:41:49.622 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:49.621+0000 7f87a78f39c0 20 rados->read ofs=0 len=0 2024-09-14T11:41:49.622 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:49.621+0000 7f87a78f39c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:41:49.622 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:49.621+0000 7f87a78f39c0 20 rados->read ofs=0 len=0 2024-09-14T11:41:49.622 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:49.621+0000 7f87a78f39c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:41:49.622 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:49.621+0000 7f87a78f39c0 20 started sync module instance, tier type = 2024-09-14T11:41:49.622 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:49.621+0000 7f87a78f39c0 20 started zone id=d9e72d30-c60b-4d0d-9267-fdc36392d5ad (name=default) with tier type = 2024-09-14T11:41:49.638 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:49.637+0000 7f87a78f39c0 20 add_watcher() i=0 2024-09-14T11:41:49.638 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:49.637+0000 7f87a78f39c0 20 add_watcher() i=1 2024-09-14T11:41:49.638 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:49.637+0000 7f87a78f39c0 20 add_watcher() i=2 2024-09-14T11:41:49.638 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:49.637+0000 7f87a78f39c0 20 add_watcher() i=3 2024-09-14T11:41:49.638 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:49.637+0000 7f87a78f39c0 20 add_watcher() i=4 2024-09-14T11:41:49.638 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:49.637+0000 7f87a78f39c0 20 add_watcher() i=5 2024-09-14T11:41:49.638 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:49.637+0000 7f87a78f39c0 20 add_watcher() i=6 2024-09-14T11:41:49.639 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:49.637+0000 7f87a78f39c0 20 add_watcher() i=7 2024-09-14T11:41:49.639 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:49.637+0000 7f87a78f39c0 2 all 8 watchers are set, enabling cache 2024-09-14T11:41:49.641 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:49.641+0000 7f865b7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:41:49.642 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:49.641+0000 7f87a78f39c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:41:49.642 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:49.641+0000 7f87a78f39c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:41:49.642 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:49.641+0000 7f87a78f39c0 5 note: GC not initialized 2024-09-14T11:41:49.642 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:49.641+0000 7f865a7e4640 20 reqs_thread_entry: start 2024-09-14T11:41:49.642 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:49.641+0000 7f87a78f39c0 20 init_complete bucket index max shards: 11 2024-09-14T11:41:49.642 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:49.641+0000 7f87a78f39c0 20 Filter name: none 2024-09-14T11:41:49.642 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:49.641+0000 7f85cbfff640 20 reqs_thread_entry: start 2024-09-14T11:41:49.643 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:49.641+0000 7f87a78f39c0 20 rados->read ofs=0 len=0 2024-09-14T11:41:49.643 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:49.641+0000 7f87a78f39c0 20 rados_obj.operate() r=0 bl.length=176 2024-09-14T11:41:49.643 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:49.641+0000 7f87a78f39c0 20 rados->read ofs=0 len=0 2024-09-14T11:41:49.644 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:49.645+0000 7f87a78f39c0 20 rados_obj.operate() r=0 bl.length=398 2024-09-14T11:41:49.644 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:49.645+0000 7f87a78f39c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:41:49.644 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:49.645+0000 7f87a78f39c0 20 INFO: main: max_entries=1000, index=gen=3, max_shards=1 2024-09-14T11:41:49.644 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:49.645+0000 7f87a78f39c0 20 INFO: main: starting shard=0 2024-09-14T11:41:49.644 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:49.645+0000 7f87a78f39c0 10 bucket_obj is .dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.17.3.0 2024-09-14T11:41:49.644 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:49.645+0000 7f87a78f39c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.17.3.0 2024-09-14T11:41:49.645 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:49.645+0000 7f87a78f39c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:41:49.645 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:49.645+0000 7f87a78f39c0 20 INFO: main: done 2024-09-14T11:41:49.645 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:49.645+0000 7f865b7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:41:49.650 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:49.649+0000 7f87a78f39c0 20 remove_watcher() i=0 2024-09-14T11:41:49.650 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:49.649+0000 7f87a78f39c0 2 removed watcher, disabling cache 2024-09-14T11:41:49.653 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:49.653+0000 7f87a78f39c0 20 remove_watcher() i=1 2024-09-14T11:41:49.655 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:49.653+0000 7f87a78f39c0 20 remove_watcher() i=2 2024-09-14T11:41:49.657 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:49.657+0000 7f87a78f39c0 20 remove_watcher() i=3 2024-09-14T11:41:49.659 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:49.657+0000 7f87a78f39c0 20 remove_watcher() i=4 2024-09-14T11:41:49.661 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:49.661+0000 7f87a78f39c0 20 remove_watcher() i=5 2024-09-14T11:41:49.662 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:49.661+0000 7f87a78f39c0 20 remove_watcher() i=6 2024-09-14T11:41:49.663 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:49.661+0000 7f87a78f39c0 20 remove_watcher() i=7 2024-09-14T11:41:49.677 INFO:tasks.workunit.client.0.smithi138.stderr: test: PUT succeeds during reshard 2024-09-14T11:41:49.677 INFO:tasks.workunit.client.0.smithi138.stderr:radosgw-admin bucket stats --bucket myver 2024-09-14T11:41:49.703 INFO:tasks.workunit.client.0.smithi138.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:41:49.703 INFO:tasks.workunit.client.0.smithi138.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:41:49.746 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:49.745+0000 7fe748f149c0 20 rados->read ofs=0 len=0 2024-09-14T11:41:49.748 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:49.749+0000 7fe748f149c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:41:49.748 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:49.749+0000 7fe748f149c0 20 realm 2024-09-14T11:41:49.748 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:49.749+0000 7fe748f149c0 20 rados->read ofs=0 len=0 2024-09-14T11:41:49.748 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:49.749+0000 7fe748f149c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:41:49.748 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:49.749+0000 7fe748f149c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:41:49.748 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:49.749+0000 7fe748f149c0 20 rados->read ofs=0 len=0 2024-09-14T11:41:49.749 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:49.749+0000 7fe748f149c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:41:49.749 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:49.749+0000 7fe748f149c0 20 rados->read ofs=0 len=0 2024-09-14T11:41:49.750 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:49.749+0000 7fe748f149c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:41:49.750 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:49.749+0000 7fe748f149c0 20 rados->read ofs=0 len=0 2024-09-14T11:41:49.751 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:49.749+0000 7fe748f149c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:41:49.751 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:49.749+0000 7fe748f149c0 20 searching for the correct realm 2024-09-14T11:41:49.756 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:49.753+0000 7fe746219640 0 -- 172.21.15.138:0/2625601784 >> [v2:172.21.15.154:6808/1468088432,v1:172.21.15.154:6809/1468088432] conn(0x7fe738008040 msgr2=0x7fe7380153f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:41:49.761 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:49.761+0000 7fe746219640 0 -- 172.21.15.138:0/2625601784 >> [v2:172.21.15.138:6816/326481658,v1:172.21.15.138:6817/326481658] conn(0x7fe740108900 msgr2=0x7fe7401067a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:41:49.980 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:49.977+0000 7fe748f149c0 20 RGWRados::pool_iterate: got zone_info.d9e72d30-c60b-4d0d-9267-fdc36392d5ad 2024-09-14T11:41:49.980 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:49.977+0000 7fe748f149c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:41:49.980 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:49.977+0000 7fe748f149c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:41:49.980 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:49.977+0000 7fe748f149c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:41:49.980 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:49.977+0000 7fe748f149c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:41:49.980 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:49.977+0000 7fe748f149c0 20 RGWRados::pool_iterate: got zonegroup_info.65ab941b-da8c-4160-94fb-3672b069d44f 2024-09-14T11:41:49.980 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:49.977+0000 7fe748f149c0 20 rados->read ofs=0 len=0 2024-09-14T11:41:49.981 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:49.981+0000 7fe748f149c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:41:49.981 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:49.981+0000 7fe748f149c0 20 rados->read ofs=0 len=0 2024-09-14T11:41:49.981 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:49.981+0000 7fe748f149c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:41:49.981 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:49.981+0000 7fe748f149c0 20 rados->read ofs=0 len=0 2024-09-14T11:41:49.982 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:49.981+0000 7fe748f149c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:41:49.982 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:49.981+0000 7fe748f149c0 20 zone default found 2024-09-14T11:41:49.982 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:49.981+0000 7fe748f149c0 4 Realm: () 2024-09-14T11:41:49.982 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:49.981+0000 7fe748f149c0 4 ZoneGroup: default (65ab941b-da8c-4160-94fb-3672b069d44f) 2024-09-14T11:41:49.982 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:49.981+0000 7fe748f149c0 4 Zone: default (d9e72d30-c60b-4d0d-9267-fdc36392d5ad) 2024-09-14T11:41:49.982 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:49.981+0000 7fe748f149c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:41:49.983 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:49.981+0000 7fe748f149c0 20 zonegroup default 2024-09-14T11:41:49.983 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:49.981+0000 7fe748f149c0 20 rados->read ofs=0 len=0 2024-09-14T11:41:49.983 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:49.981+0000 7fe748f149c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:41:49.983 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:49.981+0000 7fe748f149c0 20 rados->read ofs=0 len=0 2024-09-14T11:41:49.984 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:49.981+0000 7fe748f149c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:41:49.984 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:49.981+0000 7fe748f149c0 20 rados->read ofs=0 len=0 2024-09-14T11:41:49.984 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:49.985+0000 7fe748f149c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:41:49.984 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:49.985+0000 7fe748f149c0 20 started sync module instance, tier type = 2024-09-14T11:41:49.984 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:49.985+0000 7fe748f149c0 20 started zone id=d9e72d30-c60b-4d0d-9267-fdc36392d5ad (name=default) with tier type = 2024-09-14T11:41:50.009 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:50.009+0000 7fe748f149c0 20 add_watcher() i=0 2024-09-14T11:41:50.009 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:50.009+0000 7fe748f149c0 20 add_watcher() i=1 2024-09-14T11:41:50.009 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:50.009+0000 7fe748f149c0 20 add_watcher() i=2 2024-09-14T11:41:50.009 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:50.009+0000 7fe748f149c0 20 add_watcher() i=3 2024-09-14T11:41:50.009 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:50.009+0000 7fe748f149c0 20 add_watcher() i=4 2024-09-14T11:41:50.009 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:50.009+0000 7fe748f149c0 20 add_watcher() i=5 2024-09-14T11:41:50.009 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:50.009+0000 7fe748f149c0 20 add_watcher() i=6 2024-09-14T11:41:50.011 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:50.009+0000 7fe748f149c0 20 add_watcher() i=7 2024-09-14T11:41:50.011 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:50.009+0000 7fe748f149c0 2 all 8 watchers are set, enabling cache 2024-09-14T11:41:50.015 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:50.013+0000 7fe5fd7e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:41:50.016 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:50.013+0000 7fe748f149c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:41:50.016 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:50.013+0000 7fe748f149c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:41:50.016 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:50.013+0000 7fe748f149c0 5 note: GC not initialized 2024-09-14T11:41:50.017 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:50.017+0000 7fe577fff640 20 reqs_thread_entry: start 2024-09-14T11:41:50.017 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:50.017+0000 7fe748f149c0 20 init_complete bucket index max shards: 11 2024-09-14T11:41:50.017 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:50.017+0000 7fe748f149c0 20 Filter name: none 2024-09-14T11:41:50.017 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:50.017+0000 7fe575ffb640 20 reqs_thread_entry: start 2024-09-14T11:41:50.017 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:50.017+0000 7fe748f149c0 20 rados->read ofs=0 len=0 2024-09-14T11:41:50.018 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:50.017+0000 7fe748f149c0 20 rados_obj.operate() r=0 bl.length=173 2024-09-14T11:41:50.018 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:50.017+0000 7fe748f149c0 20 rados->read ofs=0 len=0 2024-09-14T11:41:50.018 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:50.017+0000 7fe748f149c0 20 rados_obj.operate() r=0 bl.length=395 2024-09-14T11:41:50.019 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:50.017+0000 7fe748f149c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:41:50.019 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:50.017+0000 7fe748f149c0 20 rados->read ofs=0 len=0 2024-09-14T11:41:50.019 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:50.017+0000 7fe748f149c0 20 rados_obj.operate() r=0 bl.length=173 2024-09-14T11:41:50.019 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:50.017+0000 7fe748f149c0 20 rados->read ofs=0 len=0 2024-09-14T11:41:50.019 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:50.017+0000 7fe748f149c0 20 rados_obj.operate() r=0 bl.length=395 2024-09-14T11:41:50.019 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:50.017+0000 7fe748f149c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:41:50.025 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:50.025+0000 7fe5fd7e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:41:50.030 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:50.029+0000 7fe748f149c0 20 remove_watcher() i=0 2024-09-14T11:41:50.030 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:50.029+0000 7fe748f149c0 2 removed watcher, disabling cache 2024-09-14T11:41:50.033 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:50.033+0000 7fe748f149c0 20 remove_watcher() i=1 2024-09-14T11:41:50.036 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:50.037+0000 7fe748f149c0 20 remove_watcher() i=2 2024-09-14T11:41:50.038 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:50.037+0000 7fe748f149c0 20 remove_watcher() i=3 2024-09-14T11:41:50.040 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:50.041+0000 7fe748f149c0 20 remove_watcher() i=4 2024-09-14T11:41:50.042 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:50.041+0000 7fe748f149c0 20 remove_watcher() i=5 2024-09-14T11:41:50.044 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:50.041+0000 7fe748f149c0 20 remove_watcher() i=6 2024-09-14T11:41:50.046 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:50.045+0000 7fe748f149c0 20 remove_watcher() i=7 2024-09-14T11:41:50.063 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-14T11:41:50.063 INFO:tasks.workunit.client.0.smithi138.stderr:BUCKET_STATS: 2024-09-14T11:41:50.063 INFO:tasks.workunit.client.0.smithi138.stderr:bucket: myver id: d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.18 num_objects: 0 size_kb: 0 num_shards: 12 2024-09-14T11:41:50.063 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-14T11:41:50.064 INFO:tasks.workunit.client.0.smithi138.stderr:radosgw-admin --inject-delay-at=do_reshard --inject-delay-ms=5000 bucket reshard --bucket myver --num-shards 13 2024-09-14T11:41:50.099 INFO:tasks.workunit.client.0.smithi138.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:41:50.099 INFO:tasks.workunit.client.0.smithi138.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:41:50.144 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:50.145+0000 7fca7562f9c0 20 rados->read ofs=0 len=0 2024-09-14T11:41:50.146 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:50.145+0000 7fca7562f9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:41:50.146 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:50.145+0000 7fca7562f9c0 20 realm 2024-09-14T11:41:50.146 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:50.145+0000 7fca7562f9c0 20 rados->read ofs=0 len=0 2024-09-14T11:41:50.146 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:50.145+0000 7fca7562f9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:41:50.146 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:50.145+0000 7fca7562f9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:41:50.146 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:50.145+0000 7fca7562f9c0 20 rados->read ofs=0 len=0 2024-09-14T11:41:50.146 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:50.145+0000 7fca7562f9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:41:50.147 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:50.145+0000 7fca7562f9c0 20 rados->read ofs=0 len=0 2024-09-14T11:41:50.148 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:50.145+0000 7fca7562f9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:41:50.148 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:50.145+0000 7fca7562f9c0 20 rados->read ofs=0 len=0 2024-09-14T11:41:50.149 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:50.149+0000 7fca7562f9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:41:50.149 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:50.149+0000 7fca7562f9c0 20 searching for the correct realm 2024-09-14T11:41:50.152 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:50.153+0000 7fca73936640 0 -- 172.21.15.138:0/2483324638 >> [v2:172.21.15.154:6824/416768175,v1:172.21.15.154:6825/416768175] conn(0x7fca6c0684e0 msgr2=0x7fca6c05dcb0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:41:50.160 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:50.161+0000 7fca72934640 0 -- 172.21.15.138:0/2483324638 >> [v2:172.21.15.138:6816/326481658,v1:172.21.15.138:6817/326481658] conn(0x7fca6c05a470 msgr2=0x7fca6c063400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:41:50.379 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:50.377+0000 7fca7562f9c0 20 RGWRados::pool_iterate: got zone_info.d9e72d30-c60b-4d0d-9267-fdc36392d5ad 2024-09-14T11:41:50.379 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:50.377+0000 7fca7562f9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:41:50.379 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:50.377+0000 7fca7562f9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:41:50.379 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:50.377+0000 7fca7562f9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:41:50.379 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:50.377+0000 7fca7562f9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:41:50.379 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:50.377+0000 7fca7562f9c0 20 RGWRados::pool_iterate: got zonegroup_info.65ab941b-da8c-4160-94fb-3672b069d44f 2024-09-14T11:41:50.379 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:50.377+0000 7fca7562f9c0 20 rados->read ofs=0 len=0 2024-09-14T11:41:50.380 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:50.377+0000 7fca7562f9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:41:50.380 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:50.377+0000 7fca7562f9c0 20 rados->read ofs=0 len=0 2024-09-14T11:41:50.380 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:50.381+0000 7fca7562f9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:41:50.380 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:50.381+0000 7fca7562f9c0 20 rados->read ofs=0 len=0 2024-09-14T11:41:50.385 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:50.381+0000 7fca7562f9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:41:50.385 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:50.381+0000 7fca7562f9c0 20 zone default found 2024-09-14T11:41:50.385 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:50.381+0000 7fca7562f9c0 4 Realm: () 2024-09-14T11:41:50.385 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:50.381+0000 7fca7562f9c0 4 ZoneGroup: default (65ab941b-da8c-4160-94fb-3672b069d44f) 2024-09-14T11:41:50.385 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:50.381+0000 7fca7562f9c0 4 Zone: default (d9e72d30-c60b-4d0d-9267-fdc36392d5ad) 2024-09-14T11:41:50.385 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:50.381+0000 7fca7562f9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:41:50.385 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:50.381+0000 7fca7562f9c0 20 zonegroup default 2024-09-14T11:41:50.385 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:50.381+0000 7fca7562f9c0 20 rados->read ofs=0 len=0 2024-09-14T11:41:50.385 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:50.381+0000 7fca7562f9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:41:50.385 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:50.381+0000 7fca7562f9c0 20 rados->read ofs=0 len=0 2024-09-14T11:41:50.385 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:50.381+0000 7fca7562f9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:41:50.385 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:50.381+0000 7fca7562f9c0 20 rados->read ofs=0 len=0 2024-09-14T11:41:50.386 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:50.381+0000 7fca7562f9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:41:50.386 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:50.381+0000 7fca7562f9c0 20 started sync module instance, tier type = 2024-09-14T11:41:50.386 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:50.381+0000 7fca7562f9c0 20 started zone id=d9e72d30-c60b-4d0d-9267-fdc36392d5ad (name=default) with tier type = 2024-09-14T11:41:50.407 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:50.405+0000 7fca7562f9c0 20 add_watcher() i=0 2024-09-14T11:41:50.407 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:50.405+0000 7fca7562f9c0 20 add_watcher() i=1 2024-09-14T11:41:50.407 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:50.405+0000 7fca7562f9c0 20 add_watcher() i=2 2024-09-14T11:41:50.407 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:50.405+0000 7fca7562f9c0 20 add_watcher() i=3 2024-09-14T11:41:50.407 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:50.405+0000 7fca7562f9c0 20 add_watcher() i=4 2024-09-14T11:41:50.407 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:50.405+0000 7fca7562f9c0 20 add_watcher() i=5 2024-09-14T11:41:50.407 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:50.405+0000 7fca7562f9c0 20 add_watcher() i=6 2024-09-14T11:41:50.409 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:50.409+0000 7fca7562f9c0 20 add_watcher() i=7 2024-09-14T11:41:50.409 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:50.409+0000 7fca7562f9c0 2 all 8 watchers are set, enabling cache 2024-09-14T11:41:50.413 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:50.413+0000 7fc929fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:41:50.414 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:50.413+0000 7fca7562f9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:41:50.414 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:50.413+0000 7fca7562f9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:41:50.414 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:50.413+0000 7fca7562f9c0 5 note: GC not initialized 2024-09-14T11:41:50.414 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:50.413+0000 7fc928fe1640 20 reqs_thread_entry: start 2024-09-14T11:41:50.415 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:50.413+0000 7fca7562f9c0 20 init_complete bucket index max shards: 11 2024-09-14T11:41:50.415 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:50.413+0000 7fca7562f9c0 20 Filter name: none 2024-09-14T11:41:50.415 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:50.413+0000 7fc8a27fc640 20 reqs_thread_entry: start 2024-09-14T11:41:50.415 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:50.413+0000 7fca7562f9c0 10 cache get: name=default.rgw.meta+root+myver : miss 2024-09-14T11:41:50.415 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:50.413+0000 7fca7562f9c0 20 rados->read ofs=0 len=0 2024-09-14T11:41:50.416 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:50.413+0000 7fca7562f9c0 20 rados_obj.operate() r=0 bl.length=173 2024-09-14T11:41:50.417 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:50.413+0000 7fca7562f9c0 10 cache put: name=default.rgw.meta+root+myver info.flags=0x11 2024-09-14T11:41:50.417 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:50.413+0000 7fca7562f9c0 10 adding default.rgw.meta+root+myver to cache LRU end 2024-09-14T11:41:50.417 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:50.413+0000 7fca7562f9c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.myver:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.18 : miss 2024-09-14T11:41:50.417 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:50.413+0000 7fca7562f9c0 20 rados->read ofs=0 len=0 2024-09-14T11:41:50.417 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:50.417+0000 7fca7562f9c0 20 rados_obj.operate() r=0 bl.length=395 2024-09-14T11:41:50.417 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:50.417+0000 7fca7562f9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.myver:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.18 info.flags=0x17 2024-09-14T11:41:50.417 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:50.417+0000 7fca7562f9c0 10 adding default.rgw.meta+root+.bucket.meta.myver:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.18 to cache LRU end 2024-09-14T11:41:50.417 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:50.417+0000 7fca7562f9c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:41:50.417 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:50.417+0000 7fca7562f9c0 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-14T11:41:50.417 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:50.417+0000 7fca7562f9c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myver:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.18 2024-09-14T11:41:50.426 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:50.425+0000 7fca7562f9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.myver:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.18 info.flags=0x17 2024-09-14T11:41:50.426 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:50.425+0000 7fca7562f9c0 10 moving default.rgw.meta+root+.bucket.meta.myver:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.18 to cache LRU end 2024-09-14T11:41:50.426 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:50.425+0000 7fca7562f9c0 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-14T11:41:50.426 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:50.425+0000 7fca7562f9c0 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.myver:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.18, ofs0, ns] 2024-09-14T11:41:50.426 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:50.425+0000 7fc956ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366204 cookie 94583481095328 notifier 8526 bl.length()=821 2024-09-14T11:41:50.427 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:50.425+0000 7fc956ffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.myver:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.18 info.flags=0x17 2024-09-14T11:41:50.427 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:50.425+0000 7fc956ffd640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.myver:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.18 to cache LRU end 2024-09-14T11:41:50.427 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:50.425+0000 7fc956ffd640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=143 2024-09-14T11:41:50.429 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:50.429+0000 7fca7562f9c0 20 handle_bi_update(): bucket=:myver[d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.18]): orig_sources= new_sources= 2024-09-14T11:41:50.429 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:50.429+0000 7fca7562f9c0 20 handle_bi_update(): bucket=:myver[d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.18]): potential sources added=[] removed=[] 2024-09-14T11:41:50.429 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:50.429+0000 7fca7562f9c0 20 handle_bi_update(): bucket=:myver[d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.18]): orig_dests= new_dests= 2024-09-14T11:41:50.429 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:50.429+0000 7fca7562f9c0 20 handle_bi_update(): bucket=:myver[d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.18]): potential dests added=[] removed=[] 2024-09-14T11:41:50.437 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:50.437+0000 7fca7562f9c0 -1 Injecting delay=5.000000000s at location=do_reshard 2024-09-14T11:41:51.068 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:41:51.069 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-14T11:41:51.222 INFO:tasks.workunit.client.0.smithi138.stderr:put object successful 2024-09-14T11:41:55.438 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:55.437+0000 7fca7562f9c0 10 bucket_obj is .dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.18.2.0 2024-09-14T11:41:55.438 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:55.437+0000 7fca7562f9c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.18.2.0 2024-09-14T11:41:55.438 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:55.437+0000 7fca7562f9c0 10 bucket_obj is .dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.18.2.1 2024-09-14T11:41:55.439 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:55.437+0000 7fca7562f9c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.18.2.1 2024-09-14T11:41:55.439 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:55.437+0000 7fca7562f9c0 10 bucket_obj is .dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.18.2.2 2024-09-14T11:41:55.439 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:55.437+0000 7fca7562f9c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.18.2.2 2024-09-14T11:41:55.439 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:55.437+0000 7fca7562f9c0 10 bucket_obj is .dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.18.2.3 2024-09-14T11:41:55.439 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:55.437+0000 7fca7562f9c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.18.2.3 2024-09-14T11:41:55.439 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:55.437+0000 7fca7562f9c0 10 bucket_obj is .dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.18.2.4 2024-09-14T11:41:55.439 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:55.437+0000 7fca7562f9c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.18.2.4 2024-09-14T11:41:55.439 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:55.437+0000 7fca7562f9c0 10 bucket_obj is .dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.18.2.5 2024-09-14T11:41:55.439 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:55.437+0000 7fca7562f9c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.18.2.5 2024-09-14T11:41:55.439 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:55.437+0000 7fca7562f9c0 10 bucket_obj is .dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.18.2.6 2024-09-14T11:41:55.439 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:55.437+0000 7fca7562f9c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.18.2.6 2024-09-14T11:41:55.439 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:55.437+0000 7fca7562f9c0 10 bucket_obj is .dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.18.2.7 2024-09-14T11:41:55.440 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:55.437+0000 7fca7562f9c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.18.2.7 2024-09-14T11:41:55.440 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:55.437+0000 7fca7562f9c0 10 bucket_obj is .dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.18.2.8 2024-09-14T11:41:55.440 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:55.437+0000 7fca7562f9c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.18.2.8 2024-09-14T11:41:55.440 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:55.437+0000 7fca7562f9c0 10 bucket_obj is .dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.18.2.9 2024-09-14T11:41:55.440 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:55.437+0000 7fca7562f9c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.18.2.9 2024-09-14T11:41:55.440 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:55.437+0000 7fca7562f9c0 10 bucket_obj is .dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.18.2.10 2024-09-14T11:41:55.440 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:55.437+0000 7fca7562f9c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.18.2.10 2024-09-14T11:41:55.440 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:55.437+0000 7fca7562f9c0 10 bucket_obj is .dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.18.2.11 2024-09-14T11:41:55.440 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:55.437+0000 7fca7562f9c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.18.2.11 2024-09-14T11:41:55.440 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:55.437+0000 7fca7562f9c0 10 bucket_obj is .dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.18.2.12 2024-09-14T11:41:55.440 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:55.437+0000 7fca7562f9c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.18.2.12 2024-09-14T11:41:55.440 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:55.437+0000 7fca7562f9c0 10 bucket_obj is .dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.18.1.0 2024-09-14T11:41:55.441 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:55.437+0000 7fca7562f9c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.18.1.0 2024-09-14T11:41:55.441 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:55.437+0000 7fca7562f9c0 10 bucket_obj is .dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.18.1.1 2024-09-14T11:41:55.441 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:55.437+0000 7fca7562f9c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.18.1.1 2024-09-14T11:41:55.441 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:55.441+0000 7fca7562f9c0 10 bucket_obj is .dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.18.1.2 2024-09-14T11:41:55.441 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:55.441+0000 7fca7562f9c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.18.1.2 2024-09-14T11:41:55.442 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:55.441+0000 7fca7562f9c0 10 bucket_obj is .dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.18.1.3 2024-09-14T11:41:55.442 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:55.441+0000 7fca7562f9c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.18.1.3 2024-09-14T11:41:55.442 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:55.441+0000 7fca7562f9c0 10 bucket_obj is .dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.18.1.4 2024-09-14T11:41:55.443 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:55.441+0000 7fca7562f9c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.18.1.4 2024-09-14T11:41:55.445 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:55.445+0000 7fca7562f9c0 10 bucket_obj is .dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.18.1.5 2024-09-14T11:41:55.445 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:55.445+0000 7fca7562f9c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.18.1.5 2024-09-14T11:41:55.446 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:55.445+0000 7fca7562f9c0 10 bucket_obj is .dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.18.1.6 2024-09-14T11:41:55.446 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:55.445+0000 7fca7562f9c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.18.1.6 2024-09-14T11:41:55.448 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:55.445+0000 7fca7562f9c0 10 bucket_obj is .dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.18.1.7 2024-09-14T11:41:55.448 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:55.445+0000 7fca7562f9c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.18.1.7 2024-09-14T11:41:55.449 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:55.449+0000 7fca7562f9c0 10 bucket_obj is .dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.18.1.8 2024-09-14T11:41:55.449 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:55.449+0000 7fca7562f9c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.18.1.8 2024-09-14T11:41:55.450 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:55.449+0000 7fca7562f9c0 10 bucket_obj is .dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.18.1.9 2024-09-14T11:41:55.450 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:55.449+0000 7fca7562f9c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.18.1.9 2024-09-14T11:41:55.451 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:55.449+0000 7fca7562f9c0 10 bucket_obj is .dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.18.1.10 2024-09-14T11:41:55.451 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:55.449+0000 7fca7562f9c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.18.1.10 2024-09-14T11:41:55.452 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:55.453+0000 7fca7562f9c0 10 bucket_obj is .dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.18.1.11 2024-09-14T11:41:55.452 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:55.453+0000 7fca7562f9c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.18.1.11 2024-09-14T11:41:55.457 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:55.457+0000 7fca7562f9c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.myver:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.18 : hit (requested=0x17, cached=0x17) 2024-09-14T11:41:55.457 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:55.457+0000 7fca7562f9c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myver:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.18 2024-09-14T11:41:55.460 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:55.461+0000 7fca7562f9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.myver:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.18 info.flags=0x17 2024-09-14T11:41:55.460 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:55.461+0000 7fca7562f9c0 10 moving default.rgw.meta+root+.bucket.meta.myver:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.18 to cache LRU end 2024-09-14T11:41:55.461 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:55.461+0000 7fca7562f9c0 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-14T11:41:55.461 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:55.461+0000 7fca7562f9c0 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.myver:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.18, ofs0, ns] 2024-09-14T11:41:55.461 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:55.461+0000 7fc9567fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366205 cookie 94583481095328 notifier 8526 bl.length()=821 2024-09-14T11:41:55.461 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:55.461+0000 7fc9567fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.myver:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.18 info.flags=0x17 2024-09-14T11:41:55.461 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:55.461+0000 7fc9567fc640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.myver:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.18 to cache LRU end 2024-09-14T11:41:55.461 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:55.461+0000 7fc9567fc640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=143 2024-09-14T11:41:55.465 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:55.465+0000 7fca7562f9c0 20 handle_bi_update(): bucket=:myver[d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.18]): orig_sources= new_sources= 2024-09-14T11:41:55.465 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:55.465+0000 7fca7562f9c0 20 handle_bi_update(): bucket=:myver[d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.18]): potential sources added=[] removed=[] 2024-09-14T11:41:55.466 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:55.465+0000 7fca7562f9c0 20 handle_bi_update(): bucket=:myver[d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.18]): orig_dests= new_dests= 2024-09-14T11:41:55.466 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:55.465+0000 7fca7562f9c0 20 handle_bi_update(): bucket=:myver[d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.18]): potential dests added=[] removed=[] 2024-09-14T11:41:55.473 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:55.473+0000 7fca7562f9c0 10 bucket_obj is .dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.18.1.0 2024-09-14T11:41:55.473 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:55.473+0000 7fca7562f9c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.18.1.0 2024-09-14T11:41:55.474 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:55.473+0000 7fca7562f9c0 10 bucket_obj is .dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.18.1.1 2024-09-14T11:41:55.474 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:55.473+0000 7fca7562f9c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.18.1.1 2024-09-14T11:41:55.475 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:55.473+0000 7fca7562f9c0 10 bucket_obj is .dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.18.1.2 2024-09-14T11:41:55.475 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:55.473+0000 7fca7562f9c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.18.1.2 2024-09-14T11:41:55.476 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:55.477+0000 7fca7562f9c0 10 bucket_obj is .dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.18.1.3 2024-09-14T11:41:55.476 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:55.477+0000 7fca7562f9c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.18.1.3 2024-09-14T11:41:55.477 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:55.477+0000 7fca7562f9c0 10 bucket_obj is .dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.18.1.4 2024-09-14T11:41:55.477 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:55.477+0000 7fca7562f9c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.18.1.4 2024-09-14T11:41:55.478 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:55.477+0000 7fca7562f9c0 10 bucket_obj is .dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.18.1.5 2024-09-14T11:41:55.478 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:55.477+0000 7fca7562f9c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.18.1.5 2024-09-14T11:41:55.479 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:55.477+0000 7fca7562f9c0 10 bucket_obj is .dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.18.1.6 2024-09-14T11:41:55.479 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:55.477+0000 7fca7562f9c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.18.1.6 2024-09-14T11:41:55.480 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:55.481+0000 7fca7562f9c0 10 bucket_obj is .dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.18.1.7 2024-09-14T11:41:55.480 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:55.481+0000 7fca7562f9c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.18.1.7 2024-09-14T11:41:55.481 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:55.481+0000 7fca7562f9c0 10 bucket_obj is .dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.18.1.8 2024-09-14T11:41:55.481 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:55.481+0000 7fca7562f9c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.18.1.8 2024-09-14T11:41:55.481 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:55.481+0000 7fca7562f9c0 10 bucket_obj is .dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.18.1.9 2024-09-14T11:41:55.482 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:55.481+0000 7fca7562f9c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.18.1.9 2024-09-14T11:41:55.482 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:55.481+0000 7fca7562f9c0 10 bucket_obj is .dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.18.1.10 2024-09-14T11:41:55.482 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:55.481+0000 7fca7562f9c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.18.1.10 2024-09-14T11:41:55.483 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:55.481+0000 7fca7562f9c0 10 bucket_obj is .dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.18.1.11 2024-09-14T11:41:55.483 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:55.481+0000 7fca7562f9c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.18.1.11 2024-09-14T11:41:55.490 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:55.489+0000 7fca7562f9c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.myver:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.18 : hit (requested=0x17, cached=0x17) 2024-09-14T11:41:55.490 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:55.489+0000 7fca7562f9c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myver:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.18 2024-09-14T11:41:55.493 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:55.493+0000 7fca7562f9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.myver:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.18 info.flags=0x17 2024-09-14T11:41:55.493 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:55.493+0000 7fca7562f9c0 10 moving default.rgw.meta+root+.bucket.meta.myver:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.18 to cache LRU end 2024-09-14T11:41:55.493 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:55.493+0000 7fca7562f9c0 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-14T11:41:55.493 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:55.493+0000 7fca7562f9c0 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.myver:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.18, ofs0, ns] 2024-09-14T11:41:55.494 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:55.493+0000 7fc9567fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366206 cookie 94583481095328 notifier 8526 bl.length()=789 2024-09-14T11:41:55.494 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:55.493+0000 7fc9567fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.myver:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.18 info.flags=0x17 2024-09-14T11:41:55.494 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:55.493+0000 7fc9567fc640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.myver:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.18 to cache LRU end 2024-09-14T11:41:55.494 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:55.493+0000 7fc9567fc640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=143 2024-09-14T11:41:55.498 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:55.497+0000 7fca7562f9c0 20 handle_bi_update(): bucket=:myver[d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.18]): orig_sources= new_sources= 2024-09-14T11:41:55.498 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:55.497+0000 7fca7562f9c0 20 handle_bi_update(): bucket=:myver[d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.18]): potential sources added=[] removed=[] 2024-09-14T11:41:55.498 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:55.497+0000 7fca7562f9c0 20 handle_bi_update(): bucket=:myver[d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.18]): orig_dests= new_dests= 2024-09-14T11:41:55.498 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:55.497+0000 7fca7562f9c0 20 handle_bi_update(): bucket=:myver[d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.18]): potential dests added=[] removed=[] 2024-09-14T11:41:55.506 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:55.505+0000 7fca7562f9c0 1 execute INFO: reshard of bucket "myver" from 12 shards to 13 shards completed successfully 2024-09-14T11:41:55.511 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:55.509+0000 7fc929fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:41:55.516 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:55.517+0000 7fca7562f9c0 20 remove_watcher() i=0 2024-09-14T11:41:55.516 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:55.517+0000 7fca7562f9c0 2 removed watcher, disabling cache 2024-09-14T11:41:55.519 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:55.517+0000 7fca7562f9c0 20 remove_watcher() i=1 2024-09-14T11:41:55.521 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:55.521+0000 7fca7562f9c0 20 remove_watcher() i=2 2024-09-14T11:41:55.523 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:55.521+0000 7fca7562f9c0 20 remove_watcher() i=3 2024-09-14T11:41:55.526 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:55.525+0000 7fca7562f9c0 20 remove_watcher() i=4 2024-09-14T11:41:55.529 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:55.529+0000 7fca7562f9c0 20 remove_watcher() i=5 2024-09-14T11:41:55.531 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:55.529+0000 7fca7562f9c0 20 remove_watcher() i=6 2024-09-14T11:41:55.541 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:55.541+0000 7fca7562f9c0 20 remove_watcher() i=7 2024-09-14T11:41:56.227 INFO:tasks.workunit.client.0.smithi138.stderr:TEST: check that bucket stats are correct after reshard with unlinked entries 2024-09-14T11:41:56.227 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-14T11:41:56.232 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:41:56.232 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-14T11:41:56.354 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:41:56.354 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-14T11:41:56.515 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:41:56.515 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-14T11:41:56.654 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:41:56.654 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-14T11:41:56.733 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:41:56.734 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-14T11:41:56.870 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:41:56.870 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-14T11:41:56.945 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:41:56.945 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-14T11:41:57.091 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:41:57.091 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-14T11:41:57.169 INFO:tasks.workunit.client.0.smithi138.stderr:ceph config set client rgw_debug_inject_set_olh_err 2 2024-09-14T11:41:57.609 INFO:tasks.workunit.client.0.smithi138.stderr:ceph config set client rgw_debug_inject_olh_cancel_modification_err true 2024-09-14T11:41:59.072 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:41:59.072 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-14T11:41:59.229 INFO:tasks.workunit.client.0.smithi138.stderr:An error occurred (NoSuchKey) when calling the PutObject operation: None 2024-09-14T11:41:59.230 INFO:tasks.workunit.client.0.smithi138.stderr:radosgw-admin bi list --bucket myver --object x 2024-09-14T11:41:59.264 INFO:tasks.workunit.client.0.smithi138.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:41:59.264 INFO:tasks.workunit.client.0.smithi138.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:41:59.310 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:59.309+0000 7f35a35079c0 20 rados->read ofs=0 len=0 2024-09-14T11:41:59.313 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:59.313+0000 7f35a35079c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:41:59.313 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:59.313+0000 7f35a35079c0 20 realm 2024-09-14T11:41:59.313 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:59.313+0000 7f35a35079c0 20 rados->read ofs=0 len=0 2024-09-14T11:41:59.313 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:59.313+0000 7f35a35079c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:41:59.313 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:59.313+0000 7f35a35079c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:41:59.313 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:59.313+0000 7f35a35079c0 20 rados->read ofs=0 len=0 2024-09-14T11:41:59.313 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:59.313+0000 7f35a35079c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:41:59.313 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:59.313+0000 7f35a35079c0 20 rados->read ofs=0 len=0 2024-09-14T11:41:59.314 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:59.313+0000 7f35a35079c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:41:59.315 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:59.313+0000 7f35a35079c0 20 rados->read ofs=0 len=0 2024-09-14T11:41:59.315 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:59.313+0000 7f35a35079c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:41:59.315 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:59.313+0000 7f35a35079c0 20 searching for the correct realm 2024-09-14T11:41:59.320 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:59.317+0000 7f35a180e640 0 -- 172.21.15.138:0/4227937783 >> [v2:172.21.15.154:6824/416768175,v1:172.21.15.154:6825/416768175] conn(0x7f359c1363c0 msgr2=0x7f359c1094c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:41:59.326 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:59.325+0000 7f35a080c640 0 -- 172.21.15.138:0/4227937783 >> [v2:172.21.15.138:6816/326481658,v1:172.21.15.138:6817/326481658] conn(0x7f359c109af0 msgr2=0x7f359c0dc770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:41:59.544 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:59.541+0000 7f35a35079c0 20 RGWRados::pool_iterate: got zone_info.d9e72d30-c60b-4d0d-9267-fdc36392d5ad 2024-09-14T11:41:59.544 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:59.541+0000 7f35a35079c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:41:59.544 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:59.541+0000 7f35a35079c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:41:59.544 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:59.541+0000 7f35a35079c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:41:59.544 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:59.541+0000 7f35a35079c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:41:59.544 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:59.541+0000 7f35a35079c0 20 RGWRados::pool_iterate: got zonegroup_info.65ab941b-da8c-4160-94fb-3672b069d44f 2024-09-14T11:41:59.544 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:59.541+0000 7f35a35079c0 20 rados->read ofs=0 len=0 2024-09-14T11:41:59.545 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:59.545+0000 7f35a35079c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:41:59.545 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:59.545+0000 7f35a35079c0 20 rados->read ofs=0 len=0 2024-09-14T11:41:59.545 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:59.545+0000 7f35a35079c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:41:59.545 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:59.545+0000 7f35a35079c0 20 rados->read ofs=0 len=0 2024-09-14T11:41:59.546 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:59.545+0000 7f35a35079c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:41:59.546 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:59.545+0000 7f35a35079c0 20 zone default found 2024-09-14T11:41:59.546 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:59.545+0000 7f35a35079c0 4 Realm: () 2024-09-14T11:41:59.546 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:59.545+0000 7f35a35079c0 4 ZoneGroup: default (65ab941b-da8c-4160-94fb-3672b069d44f) 2024-09-14T11:41:59.546 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:59.545+0000 7f35a35079c0 4 Zone: default (d9e72d30-c60b-4d0d-9267-fdc36392d5ad) 2024-09-14T11:41:59.546 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:59.545+0000 7f35a35079c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:41:59.547 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:59.545+0000 7f35a35079c0 20 zonegroup default 2024-09-14T11:41:59.547 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:59.545+0000 7f35a35079c0 20 rados->read ofs=0 len=0 2024-09-14T11:41:59.547 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:59.545+0000 7f35a35079c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:41:59.547 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:59.545+0000 7f35a35079c0 20 rados->read ofs=0 len=0 2024-09-14T11:41:59.548 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:59.545+0000 7f35a35079c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:41:59.548 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:59.545+0000 7f35a35079c0 20 rados->read ofs=0 len=0 2024-09-14T11:41:59.548 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:59.549+0000 7f35a35079c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:41:59.548 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:59.549+0000 7f35a35079c0 20 started sync module instance, tier type = 2024-09-14T11:41:59.548 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:59.549+0000 7f35a35079c0 20 started zone id=d9e72d30-c60b-4d0d-9267-fdc36392d5ad (name=default) with tier type = 2024-09-14T11:41:59.571 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:59.569+0000 7f35a35079c0 20 add_watcher() i=0 2024-09-14T11:41:59.572 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:59.569+0000 7f35a35079c0 20 add_watcher() i=1 2024-09-14T11:41:59.572 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:59.569+0000 7f35a35079c0 20 add_watcher() i=2 2024-09-14T11:41:59.572 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:59.569+0000 7f35a35079c0 20 add_watcher() i=3 2024-09-14T11:41:59.572 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:59.569+0000 7f35a35079c0 20 add_watcher() i=4 2024-09-14T11:41:59.572 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:59.569+0000 7f35a35079c0 20 add_watcher() i=5 2024-09-14T11:41:59.572 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:59.569+0000 7f35a35079c0 20 add_watcher() i=6 2024-09-14T11:41:59.574 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:59.573+0000 7f35a35079c0 20 add_watcher() i=7 2024-09-14T11:41:59.574 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:59.573+0000 7f35a35079c0 2 all 8 watchers are set, enabling cache 2024-09-14T11:41:59.578 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:59.577+0000 7f34577e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:41:59.579 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:59.577+0000 7f35a35079c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:41:59.579 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:59.577+0000 7f35a35079c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:41:59.579 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:59.577+0000 7f35a35079c0 5 note: GC not initialized 2024-09-14T11:41:59.580 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:59.577+0000 7f34567e4640 20 reqs_thread_entry: start 2024-09-14T11:41:59.580 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:59.577+0000 7f35a35079c0 20 init_complete bucket index max shards: 11 2024-09-14T11:41:59.580 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:59.577+0000 7f35a35079c0 20 Filter name: none 2024-09-14T11:41:59.580 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:59.581+0000 7f33c7fff640 20 reqs_thread_entry: start 2024-09-14T11:41:59.581 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:59.581+0000 7f35a35079c0 20 rados->read ofs=0 len=0 2024-09-14T11:41:59.581 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:59.581+0000 7f35a35079c0 20 rados_obj.operate() r=0 bl.length=173 2024-09-14T11:41:59.581 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:59.581+0000 7f35a35079c0 20 rados->read ofs=0 len=0 2024-09-14T11:41:59.581 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:59.581+0000 7f35a35079c0 20 rados_obj.operate() r=0 bl.length=395 2024-09-14T11:41:59.582 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:59.581+0000 7f35a35079c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:41:59.582 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:59.581+0000 7f35a35079c0 20 INFO: main: max_entries=1000, index=gen=2, max_shards=13 2024-09-14T11:41:59.582 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:59.581+0000 7f35a35079c0 20 INFO: main: starting shard=0 2024-09-14T11:41:59.582 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:59.581+0000 7f35a35079c0 10 bucket_obj is .dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.18.2.0 2024-09-14T11:41:59.582 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:59.581+0000 7f35a35079c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.18.2.0 2024-09-14T11:41:59.583 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:59.581+0000 7f35a35079c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:41:59.583 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:59.581+0000 7f35a35079c0 20 INFO: main: starting shard=1 2024-09-14T11:41:59.583 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:59.581+0000 7f35a35079c0 10 bucket_obj is .dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.18.2.1 2024-09-14T11:41:59.583 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:59.581+0000 7f35a35079c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.18.2.1 2024-09-14T11:41:59.584 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:59.585+0000 7f35a35079c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:41:59.584 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:59.585+0000 7f35a35079c0 20 INFO: main: starting shard=2 2024-09-14T11:41:59.584 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:59.585+0000 7f35a35079c0 10 bucket_obj is .dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.18.2.2 2024-09-14T11:41:59.584 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:59.585+0000 7f35a35079c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.18.2.2 2024-09-14T11:41:59.585 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:59.585+0000 7f35a35079c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:41:59.586 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:59.585+0000 7f35a35079c0 20 INFO: main: starting shard=3 2024-09-14T11:41:59.586 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:59.585+0000 7f35a35079c0 10 bucket_obj is .dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.18.2.3 2024-09-14T11:41:59.586 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:59.585+0000 7f35a35079c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.18.2.3 2024-09-14T11:41:59.587 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:59.585+0000 7f35a35079c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:41:59.587 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:59.585+0000 7f35a35079c0 20 INFO: main: starting shard=4 2024-09-14T11:41:59.587 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:59.585+0000 7f35a35079c0 10 bucket_obj is .dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.18.2.4 2024-09-14T11:41:59.587 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:59.585+0000 7f35a35079c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.18.2.4 2024-09-14T11:41:59.588 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:59.589+0000 7f35a35079c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:41:59.588 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:59.589+0000 7f35a35079c0 20 INFO: main: starting shard=5 2024-09-14T11:41:59.588 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:59.589+0000 7f35a35079c0 10 bucket_obj is .dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.18.2.5 2024-09-14T11:41:59.588 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:59.589+0000 7f35a35079c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.18.2.5 2024-09-14T11:41:59.589 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:59.589+0000 7f35a35079c0 20 INFO: main: bi_list() returned without error; entries.size()=1, is_truncated=0, marker= 2024-09-14T11:41:59.589 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:59.589+0000 7f35a35079c0 20 INFO: main: starting shard=6 2024-09-14T11:41:59.589 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:59.589+0000 7f35a35079c0 10 bucket_obj is .dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.18.2.6 2024-09-14T11:41:59.589 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:59.589+0000 7f35a35079c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.18.2.6 2024-09-14T11:41:59.589 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:59.589+0000 7f35a35079c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:41:59.590 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:59.589+0000 7f35a35079c0 20 INFO: main: starting shard=7 2024-09-14T11:41:59.590 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:59.589+0000 7f35a35079c0 10 bucket_obj is .dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.18.2.7 2024-09-14T11:41:59.590 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:59.589+0000 7f35a35079c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.18.2.7 2024-09-14T11:41:59.590 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:59.589+0000 7f35a35079c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:41:59.590 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:59.589+0000 7f35a35079c0 20 INFO: main: starting shard=8 2024-09-14T11:41:59.590 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:59.589+0000 7f35a35079c0 10 bucket_obj is .dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.18.2.8 2024-09-14T11:41:59.590 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:59.589+0000 7f35a35079c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.18.2.8 2024-09-14T11:41:59.591 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:59.589+0000 7f35a35079c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:41:59.591 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:59.589+0000 7f35a35079c0 20 INFO: main: starting shard=9 2024-09-14T11:41:59.591 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:59.589+0000 7f35a35079c0 10 bucket_obj is .dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.18.2.9 2024-09-14T11:41:59.591 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:59.589+0000 7f35a35079c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.18.2.9 2024-09-14T11:41:59.591 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:59.589+0000 7f35a35079c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:41:59.591 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:59.589+0000 7f35a35079c0 20 INFO: main: starting shard=10 2024-09-14T11:41:59.592 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:59.589+0000 7f35a35079c0 10 bucket_obj is .dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.18.2.10 2024-09-14T11:41:59.592 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:59.589+0000 7f35a35079c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.18.2.10 2024-09-14T11:41:59.592 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:59.593+0000 7f35a35079c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:41:59.592 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:59.593+0000 7f35a35079c0 20 INFO: main: starting shard=11 2024-09-14T11:41:59.592 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:59.593+0000 7f35a35079c0 10 bucket_obj is .dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.18.2.11 2024-09-14T11:41:59.592 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:59.593+0000 7f35a35079c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.18.2.11 2024-09-14T11:41:59.593 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:59.593+0000 7f35a35079c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:41:59.594 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:59.593+0000 7f35a35079c0 20 INFO: main: starting shard=12 2024-09-14T11:41:59.594 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:59.593+0000 7f35a35079c0 10 bucket_obj is .dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.18.2.12 2024-09-14T11:41:59.594 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:59.593+0000 7f35a35079c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.18.2.12 2024-09-14T11:41:59.594 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:59.593+0000 7f35a35079c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:41:59.594 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:59.593+0000 7f35a35079c0 20 INFO: main: done 2024-09-14T11:41:59.595 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:59.593+0000 7f34577e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:41:59.600 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:59.601+0000 7f35a35079c0 20 remove_watcher() i=0 2024-09-14T11:41:59.601 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:59.601+0000 7f35a35079c0 2 removed watcher, disabling cache 2024-09-14T11:41:59.603 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:59.601+0000 7f35a35079c0 20 remove_watcher() i=1 2024-09-14T11:41:59.605 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:59.605+0000 7f35a35079c0 20 remove_watcher() i=2 2024-09-14T11:41:59.608 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:59.605+0000 7f35a35079c0 20 remove_watcher() i=3 2024-09-14T11:41:59.610 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:59.609+0000 7f35a35079c0 20 remove_watcher() i=4 2024-09-14T11:41:59.612 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:59.613+0000 7f35a35079c0 20 remove_watcher() i=5 2024-09-14T11:41:59.613 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:59.613+0000 7f35a35079c0 20 remove_watcher() i=6 2024-09-14T11:41:59.615 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:59.613+0000 7f35a35079c0 20 remove_watcher() i=7 2024-09-14T11:41:59.633 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:41:59.633 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-14T11:41:59.662 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:41:59.662 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-14T11:41:59.769 INFO:tasks.workunit.client.0.smithi138.stderr:An error occurred (NoSuchKey) when calling the PutObject operation: None 2024-09-14T11:41:59.769 INFO:tasks.workunit.client.0.smithi138.stderr:radosgw-admin bi list --bucket myver --object y 2024-09-14T11:41:59.806 INFO:tasks.workunit.client.0.smithi138.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:41:59.806 INFO:tasks.workunit.client.0.smithi138.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:41:59.859 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:59.857+0000 7ff88143a9c0 20 rados->read ofs=0 len=0 2024-09-14T11:41:59.861 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:59.861+0000 7ff88143a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:41:59.861 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:59.861+0000 7ff88143a9c0 20 realm 2024-09-14T11:41:59.862 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:59.861+0000 7ff88143a9c0 20 rados->read ofs=0 len=0 2024-09-14T11:41:59.862 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:59.861+0000 7ff88143a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:41:59.862 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:59.861+0000 7ff88143a9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:41:59.862 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:59.861+0000 7ff88143a9c0 20 rados->read ofs=0 len=0 2024-09-14T11:41:59.862 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:59.861+0000 7ff88143a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:41:59.862 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:59.861+0000 7ff88143a9c0 20 rados->read ofs=0 len=0 2024-09-14T11:41:59.863 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:59.861+0000 7ff88143a9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:41:59.863 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:59.861+0000 7ff88143a9c0 20 rados->read ofs=0 len=0 2024-09-14T11:41:59.864 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:59.861+0000 7ff88143a9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:41:59.864 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:59.861+0000 7ff88143a9c0 20 searching for the correct realm 2024-09-14T11:41:59.867 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:41:59.865+0000 7ff87f741640 0 -- 172.21.15.138:0/1620838336 >> [v2:172.21.15.154:6824/416768175,v1:172.21.15.154:6825/416768175] conn(0x7ff878018070 msgr2=0x7ff87806f530 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:42:00.081 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:42:00.081+0000 7ff87e73f640 0 -- 172.21.15.138:0/1620838336 >> [v2:172.21.15.138:6816/326481658,v1:172.21.15.138:6817/326481658] conn(0x7ff87803f2a0 msgr2=0x7ff8780668f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-14T11:42:00.300 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:42:00.297+0000 7ff88143a9c0 20 RGWRados::pool_iterate: got zone_info.d9e72d30-c60b-4d0d-9267-fdc36392d5ad 2024-09-14T11:42:00.300 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:42:00.297+0000 7ff88143a9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:42:00.300 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:42:00.297+0000 7ff88143a9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:42:00.300 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:42:00.297+0000 7ff88143a9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:42:00.300 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:42:00.297+0000 7ff88143a9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:42:00.300 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:42:00.297+0000 7ff88143a9c0 20 RGWRados::pool_iterate: got zonegroup_info.65ab941b-da8c-4160-94fb-3672b069d44f 2024-09-14T11:42:00.300 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:42:00.297+0000 7ff88143a9c0 20 rados->read ofs=0 len=0 2024-09-14T11:42:00.300 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:42:00.297+0000 7ff88143a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:42:00.301 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:42:00.297+0000 7ff88143a9c0 20 rados->read ofs=0 len=0 2024-09-14T11:42:00.301 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:42:00.301+0000 7ff88143a9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:42:00.301 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:42:00.301+0000 7ff88143a9c0 20 rados->read ofs=0 len=0 2024-09-14T11:42:00.302 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:42:00.301+0000 7ff88143a9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:42:00.302 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:42:00.301+0000 7ff88143a9c0 20 zone default found 2024-09-14T11:42:00.302 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:42:00.301+0000 7ff88143a9c0 4 Realm: () 2024-09-14T11:42:00.302 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:42:00.301+0000 7ff88143a9c0 4 ZoneGroup: default (65ab941b-da8c-4160-94fb-3672b069d44f) 2024-09-14T11:42:00.302 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:42:00.301+0000 7ff88143a9c0 4 Zone: default (d9e72d30-c60b-4d0d-9267-fdc36392d5ad) 2024-09-14T11:42:00.302 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:42:00.301+0000 7ff88143a9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:42:00.302 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:42:00.301+0000 7ff88143a9c0 20 zonegroup default 2024-09-14T11:42:00.302 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:42:00.301+0000 7ff88143a9c0 20 rados->read ofs=0 len=0 2024-09-14T11:42:00.303 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:42:00.301+0000 7ff88143a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:42:00.303 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:42:00.301+0000 7ff88143a9c0 20 rados->read ofs=0 len=0 2024-09-14T11:42:00.303 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:42:00.301+0000 7ff88143a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:42:00.303 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:42:00.301+0000 7ff88143a9c0 20 rados->read ofs=0 len=0 2024-09-14T11:42:00.304 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:42:00.301+0000 7ff88143a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:42:00.304 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:42:00.301+0000 7ff88143a9c0 20 started sync module instance, tier type = 2024-09-14T11:42:00.304 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:42:00.301+0000 7ff88143a9c0 20 started zone id=d9e72d30-c60b-4d0d-9267-fdc36392d5ad (name=default) with tier type = 2024-09-14T11:42:00.326 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:42:00.325+0000 7ff88143a9c0 20 add_watcher() i=0 2024-09-14T11:42:00.326 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:42:00.325+0000 7ff88143a9c0 20 add_watcher() i=1 2024-09-14T11:42:00.327 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:42:00.325+0000 7ff88143a9c0 20 add_watcher() i=2 2024-09-14T11:42:00.327 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:42:00.325+0000 7ff88143a9c0 20 add_watcher() i=3 2024-09-14T11:42:00.327 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:42:00.325+0000 7ff88143a9c0 20 add_watcher() i=4 2024-09-14T11:42:00.327 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:42:00.325+0000 7ff88143a9c0 20 add_watcher() i=5 2024-09-14T11:42:00.327 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:42:00.325+0000 7ff88143a9c0 20 add_watcher() i=6 2024-09-14T11:42:00.329 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:42:00.329+0000 7ff88143a9c0 20 add_watcher() i=7 2024-09-14T11:42:00.329 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:42:00.329+0000 7ff88143a9c0 2 all 8 watchers are set, enabling cache 2024-09-14T11:42:00.333 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:42:00.333+0000 7ff7357e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:42:00.334 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:42:00.333+0000 7ff88143a9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:42:00.334 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:42:00.333+0000 7ff88143a9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:42:00.334 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:42:00.333+0000 7ff88143a9c0 5 note: GC not initialized 2024-09-14T11:42:00.335 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:42:00.333+0000 7ff6affff640 20 reqs_thread_entry: start 2024-09-14T11:42:00.335 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:42:00.333+0000 7ff88143a9c0 20 init_complete bucket index max shards: 11 2024-09-14T11:42:00.335 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:42:00.333+0000 7ff88143a9c0 20 Filter name: none 2024-09-14T11:42:00.335 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:42:00.333+0000 7ff6adffb640 20 reqs_thread_entry: start 2024-09-14T11:42:00.335 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:42:00.333+0000 7ff88143a9c0 20 rados->read ofs=0 len=0 2024-09-14T11:42:00.336 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:42:00.333+0000 7ff88143a9c0 20 rados_obj.operate() r=0 bl.length=173 2024-09-14T11:42:00.336 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:42:00.333+0000 7ff88143a9c0 20 rados->read ofs=0 len=0 2024-09-14T11:42:00.337 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:42:00.337+0000 7ff88143a9c0 20 rados_obj.operate() r=0 bl.length=395 2024-09-14T11:42:00.337 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:42:00.337+0000 7ff88143a9c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:42:00.337 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:42:00.337+0000 7ff88143a9c0 20 INFO: main: max_entries=1000, index=gen=2, max_shards=13 2024-09-14T11:42:00.337 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:42:00.337+0000 7ff88143a9c0 20 INFO: main: starting shard=0 2024-09-14T11:42:00.337 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:42:00.337+0000 7ff88143a9c0 10 bucket_obj is .dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.18.2.0 2024-09-14T11:42:00.337 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:42:00.337+0000 7ff88143a9c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.18.2.0 2024-09-14T11:42:00.338 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:42:00.337+0000 7ff88143a9c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:42:00.338 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:42:00.337+0000 7ff88143a9c0 20 INFO: main: starting shard=1 2024-09-14T11:42:00.338 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:42:00.337+0000 7ff88143a9c0 10 bucket_obj is .dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.18.2.1 2024-09-14T11:42:00.338 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:42:00.337+0000 7ff88143a9c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.18.2.1 2024-09-14T11:42:00.339 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:42:00.337+0000 7ff88143a9c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:42:00.339 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:42:00.337+0000 7ff88143a9c0 20 INFO: main: starting shard=2 2024-09-14T11:42:00.339 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:42:00.337+0000 7ff88143a9c0 10 bucket_obj is .dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.18.2.2 2024-09-14T11:42:00.339 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:42:00.337+0000 7ff88143a9c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.18.2.2 2024-09-14T11:42:00.340 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:42:00.341+0000 7ff88143a9c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:42:00.341 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:42:00.341+0000 7ff88143a9c0 20 INFO: main: starting shard=3 2024-09-14T11:42:00.341 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:42:00.341+0000 7ff88143a9c0 10 bucket_obj is .dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.18.2.3 2024-09-14T11:42:00.341 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:42:00.341+0000 7ff88143a9c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.18.2.3 2024-09-14T11:42:00.342 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:42:00.341+0000 7ff88143a9c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:42:00.342 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:42:00.341+0000 7ff88143a9c0 20 INFO: main: starting shard=4 2024-09-14T11:42:00.342 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:42:00.341+0000 7ff88143a9c0 10 bucket_obj is .dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.18.2.4 2024-09-14T11:42:00.342 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:42:00.341+0000 7ff88143a9c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.18.2.4 2024-09-14T11:42:00.343 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:42:00.341+0000 7ff88143a9c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:42:00.343 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:42:00.341+0000 7ff88143a9c0 20 INFO: main: starting shard=5 2024-09-14T11:42:00.343 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:42:00.341+0000 7ff88143a9c0 10 bucket_obj is .dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.18.2.5 2024-09-14T11:42:00.343 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:42:00.341+0000 7ff88143a9c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.18.2.5 2024-09-14T11:42:00.344 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:42:00.345+0000 7ff88143a9c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:42:00.344 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:42:00.345+0000 7ff88143a9c0 20 INFO: main: starting shard=6 2024-09-14T11:42:00.344 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:42:00.345+0000 7ff88143a9c0 10 bucket_obj is .dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.18.2.6 2024-09-14T11:42:00.344 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:42:00.345+0000 7ff88143a9c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.18.2.6 2024-09-14T11:42:00.345 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:42:00.345+0000 7ff88143a9c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:42:00.345 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:42:00.345+0000 7ff88143a9c0 20 INFO: main: starting shard=7 2024-09-14T11:42:00.345 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:42:00.345+0000 7ff88143a9c0 10 bucket_obj is .dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.18.2.7 2024-09-14T11:42:00.345 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:42:00.345+0000 7ff88143a9c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.18.2.7 2024-09-14T11:42:00.345 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:42:00.345+0000 7ff88143a9c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:42:00.346 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:42:00.345+0000 7ff88143a9c0 20 INFO: main: starting shard=8 2024-09-14T11:42:00.346 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:42:00.345+0000 7ff88143a9c0 10 bucket_obj is .dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.18.2.8 2024-09-14T11:42:00.346 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:42:00.345+0000 7ff88143a9c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.18.2.8 2024-09-14T11:42:00.346 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:42:00.345+0000 7ff88143a9c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:42:00.346 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:42:00.345+0000 7ff88143a9c0 20 INFO: main: starting shard=9 2024-09-14T11:42:00.347 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:42:00.345+0000 7ff88143a9c0 10 bucket_obj is .dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.18.2.9 2024-09-14T11:42:00.347 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:42:00.345+0000 7ff88143a9c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.18.2.9 2024-09-14T11:42:00.347 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:42:00.345+0000 7ff88143a9c0 20 INFO: main: bi_list() returned without error; entries.size()=1, is_truncated=0, marker= 2024-09-14T11:42:00.347 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:42:00.345+0000 7ff88143a9c0 20 INFO: main: starting shard=10 2024-09-14T11:42:00.347 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:42:00.345+0000 7ff88143a9c0 10 bucket_obj is .dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.18.2.10 2024-09-14T11:42:00.348 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:42:00.345+0000 7ff88143a9c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.18.2.10 2024-09-14T11:42:00.348 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:42:00.349+0000 7ff88143a9c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:42:00.348 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:42:00.349+0000 7ff88143a9c0 20 INFO: main: starting shard=11 2024-09-14T11:42:00.348 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:42:00.349+0000 7ff88143a9c0 10 bucket_obj is .dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.18.2.11 2024-09-14T11:42:00.349 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:42:00.349+0000 7ff88143a9c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.18.2.11 2024-09-14T11:42:00.350 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:42:00.349+0000 7ff88143a9c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:42:00.350 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:42:00.349+0000 7ff88143a9c0 20 INFO: main: starting shard=12 2024-09-14T11:42:00.350 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:42:00.349+0000 7ff88143a9c0 10 bucket_obj is .dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.18.2.12 2024-09-14T11:42:00.350 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:42:00.349+0000 7ff88143a9c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.18.2.12 2024-09-14T11:42:00.351 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:42:00.349+0000 7ff88143a9c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:42:00.351 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:42:00.349+0000 7ff88143a9c0 20 INFO: main: done 2024-09-14T11:42:00.352 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:42:00.353+0000 7ff7357e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:42:00.360 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:42:00.361+0000 7ff88143a9c0 20 remove_watcher() i=0 2024-09-14T11:42:00.360 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:42:00.361+0000 7ff88143a9c0 2 removed watcher, disabling cache 2024-09-14T11:42:00.362 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:42:00.361+0000 7ff88143a9c0 20 remove_watcher() i=1 2024-09-14T11:42:00.364 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:42:00.365+0000 7ff88143a9c0 20 remove_watcher() i=2 2024-09-14T11:42:00.366 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:42:00.365+0000 7ff88143a9c0 20 remove_watcher() i=3 2024-09-14T11:42:00.369 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:42:00.369+0000 7ff88143a9c0 20 remove_watcher() i=4 2024-09-14T11:42:00.370 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:42:00.369+0000 7ff88143a9c0 20 remove_watcher() i=5 2024-09-14T11:42:00.372 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:42:00.369+0000 7ff88143a9c0 20 remove_watcher() i=6 2024-09-14T11:42:00.373 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:42:00.373+0000 7ff88143a9c0 20 remove_watcher() i=7 2024-09-14T11:42:00.391 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:42:00.392 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-14T11:42:00.422 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:42:00.422 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-14T11:42:00.549 INFO:tasks.workunit.client.0.smithi138.stderr:An error occurred (NoSuchKey) when calling the PutObject operation: None 2024-09-14T11:42:00.549 INFO:tasks.workunit.client.0.smithi138.stderr:radosgw-admin bi list --bucket myver --object z 2024-09-14T11:42:00.584 INFO:tasks.workunit.client.0.smithi138.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:42:00.584 INFO:tasks.workunit.client.0.smithi138.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:42:00.630 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:42:00.629+0000 7eff003419c0 20 rados->read ofs=0 len=0 2024-09-14T11:42:00.632 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:42:00.629+0000 7eff003419c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:42:00.632 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:42:00.629+0000 7eff003419c0 20 realm 2024-09-14T11:42:00.632 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:42:00.629+0000 7eff003419c0 20 rados->read ofs=0 len=0 2024-09-14T11:42:00.632 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:42:00.629+0000 7eff003419c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:42:00.632 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:42:00.629+0000 7eff003419c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:42:00.632 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:42:00.633+0000 7eff003419c0 20 rados->read ofs=0 len=0 2024-09-14T11:42:00.632 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:42:00.633+0000 7eff003419c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:42:00.632 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:42:00.633+0000 7eff003419c0 20 rados->read ofs=0 len=0 2024-09-14T11:42:00.634 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:42:00.633+0000 7eff003419c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:42:00.634 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:42:00.633+0000 7eff003419c0 20 rados->read ofs=0 len=0 2024-09-14T11:42:00.635 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:42:00.633+0000 7eff003419c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:42:00.635 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:42:00.633+0000 7eff003419c0 20 searching for the correct realm 2024-09-14T11:42:00.639 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:42:00.637+0000 7efef7fff640 0 -- 172.21.15.138:0/3325220030 >> [v2:172.21.15.154:6808/1468088432,v1:172.21.15.154:6809/1468088432] conn(0x7efef000cb70 msgr2=0x7efef0024400 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-14T11:42:00.646 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:42:00.645+0000 7efef7fff640 0 -- 172.21.15.138:0/3325220030 >> [v2:172.21.15.138:6816/326481658,v1:172.21.15.138:6817/326481658] conn(0x7efef8016b60 msgr2=0x7efef8041930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:42:00.865 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:42:00.865+0000 7eff003419c0 20 RGWRados::pool_iterate: got zone_info.d9e72d30-c60b-4d0d-9267-fdc36392d5ad 2024-09-14T11:42:00.865 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:42:00.865+0000 7eff003419c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:42:00.866 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:42:00.865+0000 7eff003419c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:42:00.866 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:42:00.865+0000 7eff003419c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:42:00.866 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:42:00.865+0000 7eff003419c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:42:00.866 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:42:00.865+0000 7eff003419c0 20 RGWRados::pool_iterate: got zonegroup_info.65ab941b-da8c-4160-94fb-3672b069d44f 2024-09-14T11:42:00.866 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:42:00.865+0000 7eff003419c0 20 rados->read ofs=0 len=0 2024-09-14T11:42:00.866 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:42:00.865+0000 7eff003419c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:42:00.866 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:42:00.865+0000 7eff003419c0 20 rados->read ofs=0 len=0 2024-09-14T11:42:00.867 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:42:00.865+0000 7eff003419c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:42:00.867 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:42:00.865+0000 7eff003419c0 20 rados->read ofs=0 len=0 2024-09-14T11:42:00.868 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:42:00.865+0000 7eff003419c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:42:00.868 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:42:00.865+0000 7eff003419c0 20 zone default found 2024-09-14T11:42:00.868 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:42:00.865+0000 7eff003419c0 4 Realm: () 2024-09-14T11:42:00.868 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:42:00.865+0000 7eff003419c0 4 ZoneGroup: default (65ab941b-da8c-4160-94fb-3672b069d44f) 2024-09-14T11:42:00.868 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:42:00.865+0000 7eff003419c0 4 Zone: default (d9e72d30-c60b-4d0d-9267-fdc36392d5ad) 2024-09-14T11:42:00.868 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:42:00.865+0000 7eff003419c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:42:00.868 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:42:00.865+0000 7eff003419c0 20 zonegroup default 2024-09-14T11:42:00.868 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:42:00.865+0000 7eff003419c0 20 rados->read ofs=0 len=0 2024-09-14T11:42:00.869 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:42:00.869+0000 7eff003419c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:42:00.869 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:42:00.869+0000 7eff003419c0 20 rados->read ofs=0 len=0 2024-09-14T11:42:00.869 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:42:00.869+0000 7eff003419c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:42:00.869 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:42:00.869+0000 7eff003419c0 20 rados->read ofs=0 len=0 2024-09-14T11:42:00.870 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:42:00.869+0000 7eff003419c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:42:00.870 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:42:00.869+0000 7eff003419c0 20 started sync module instance, tier type = 2024-09-14T11:42:00.870 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:42:00.869+0000 7eff003419c0 20 started zone id=d9e72d30-c60b-4d0d-9267-fdc36392d5ad (name=default) with tier type = 2024-09-14T11:42:00.892 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:42:00.893+0000 7eff003419c0 20 add_watcher() i=0 2024-09-14T11:42:00.892 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:42:00.893+0000 7eff003419c0 20 add_watcher() i=1 2024-09-14T11:42:00.892 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:42:00.893+0000 7eff003419c0 20 add_watcher() i=2 2024-09-14T11:42:00.892 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:42:00.893+0000 7eff003419c0 20 add_watcher() i=3 2024-09-14T11:42:00.892 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:42:00.893+0000 7eff003419c0 20 add_watcher() i=4 2024-09-14T11:42:00.892 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:42:00.893+0000 7eff003419c0 20 add_watcher() i=5 2024-09-14T11:42:00.893 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:42:00.893+0000 7eff003419c0 20 add_watcher() i=6 2024-09-14T11:42:00.894 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:42:00.893+0000 7eff003419c0 20 add_watcher() i=7 2024-09-14T11:42:00.895 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:42:00.893+0000 7eff003419c0 2 all 8 watchers are set, enabling cache 2024-09-14T11:42:00.898 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:42:00.897+0000 7efdaf7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:42:00.898 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:42:00.897+0000 7eff003419c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:42:00.898 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:42:00.897+0000 7eff003419c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:42:00.898 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:42:00.897+0000 7eff003419c0 5 note: GC not initialized 2024-09-14T11:42:00.899 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:42:00.897+0000 7efdae7fc640 20 reqs_thread_entry: start 2024-09-14T11:42:00.899 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:42:00.897+0000 7eff003419c0 20 init_complete bucket index max shards: 11 2024-09-14T11:42:00.899 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:42:00.897+0000 7eff003419c0 20 Filter name: none 2024-09-14T11:42:00.899 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:42:00.897+0000 7efd1ffff640 20 reqs_thread_entry: start 2024-09-14T11:42:00.900 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:42:00.897+0000 7eff003419c0 20 rados->read ofs=0 len=0 2024-09-14T11:42:00.900 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:42:00.897+0000 7eff003419c0 20 rados_obj.operate() r=0 bl.length=173 2024-09-14T11:42:00.900 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:42:00.897+0000 7eff003419c0 20 rados->read ofs=0 len=0 2024-09-14T11:42:00.901 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:42:00.901+0000 7eff003419c0 20 rados_obj.operate() r=0 bl.length=395 2024-09-14T11:42:00.901 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:42:00.901+0000 7eff003419c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:42:00.901 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:42:00.901+0000 7eff003419c0 20 INFO: main: max_entries=1000, index=gen=2, max_shards=13 2024-09-14T11:42:00.901 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:42:00.901+0000 7eff003419c0 20 INFO: main: starting shard=0 2024-09-14T11:42:00.901 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:42:00.901+0000 7eff003419c0 10 bucket_obj is .dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.18.2.0 2024-09-14T11:42:00.901 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:42:00.901+0000 7eff003419c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.18.2.0 2024-09-14T11:42:00.902 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:42:00.901+0000 7eff003419c0 20 INFO: main: bi_list() returned without error; entries.size()=1, is_truncated=0, marker= 2024-09-14T11:42:00.902 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:42:00.901+0000 7eff003419c0 20 INFO: main: starting shard=1 2024-09-14T11:42:00.902 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:42:00.901+0000 7eff003419c0 10 bucket_obj is .dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.18.2.1 2024-09-14T11:42:00.902 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:42:00.901+0000 7eff003419c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.18.2.1 2024-09-14T11:42:00.903 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:42:00.901+0000 7eff003419c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:42:00.904 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:42:00.901+0000 7eff003419c0 20 INFO: main: starting shard=2 2024-09-14T11:42:00.904 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:42:00.901+0000 7eff003419c0 10 bucket_obj is .dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.18.2.2 2024-09-14T11:42:00.904 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:42:00.901+0000 7eff003419c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.18.2.2 2024-09-14T11:42:00.905 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:42:00.905+0000 7eff003419c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:42:00.905 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:42:00.905+0000 7eff003419c0 20 INFO: main: starting shard=3 2024-09-14T11:42:00.905 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:42:00.905+0000 7eff003419c0 10 bucket_obj is .dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.18.2.3 2024-09-14T11:42:00.905 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:42:00.905+0000 7eff003419c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.18.2.3 2024-09-14T11:42:00.906 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:42:00.905+0000 7eff003419c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:42:00.906 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:42:00.905+0000 7eff003419c0 20 INFO: main: starting shard=4 2024-09-14T11:42:00.907 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:42:00.905+0000 7eff003419c0 10 bucket_obj is .dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.18.2.4 2024-09-14T11:42:00.907 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:42:00.905+0000 7eff003419c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.18.2.4 2024-09-14T11:42:00.908 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:42:00.905+0000 7eff003419c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:42:00.908 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:42:00.905+0000 7eff003419c0 20 INFO: main: starting shard=5 2024-09-14T11:42:00.908 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:42:00.905+0000 7eff003419c0 10 bucket_obj is .dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.18.2.5 2024-09-14T11:42:00.908 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:42:00.905+0000 7eff003419c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.18.2.5 2024-09-14T11:42:00.908 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:42:00.909+0000 7eff003419c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:42:00.908 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:42:00.909+0000 7eff003419c0 20 INFO: main: starting shard=6 2024-09-14T11:42:00.909 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:42:00.909+0000 7eff003419c0 10 bucket_obj is .dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.18.2.6 2024-09-14T11:42:00.909 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:42:00.909+0000 7eff003419c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.18.2.6 2024-09-14T11:42:00.909 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:42:00.909+0000 7eff003419c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:42:00.909 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:42:00.909+0000 7eff003419c0 20 INFO: main: starting shard=7 2024-09-14T11:42:00.909 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:42:00.909+0000 7eff003419c0 10 bucket_obj is .dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.18.2.7 2024-09-14T11:42:00.909 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:42:00.909+0000 7eff003419c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.18.2.7 2024-09-14T11:42:00.910 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:42:00.909+0000 7eff003419c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:42:00.910 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:42:00.909+0000 7eff003419c0 20 INFO: main: starting shard=8 2024-09-14T11:42:00.910 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:42:00.909+0000 7eff003419c0 10 bucket_obj is .dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.18.2.8 2024-09-14T11:42:00.910 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:42:00.909+0000 7eff003419c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.18.2.8 2024-09-14T11:42:00.910 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:42:00.909+0000 7eff003419c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:42:00.911 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:42:00.909+0000 7eff003419c0 20 INFO: main: starting shard=9 2024-09-14T11:42:00.911 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:42:00.909+0000 7eff003419c0 10 bucket_obj is .dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.18.2.9 2024-09-14T11:42:00.911 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:42:00.909+0000 7eff003419c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.18.2.9 2024-09-14T11:42:00.911 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:42:00.909+0000 7eff003419c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:42:00.911 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:42:00.909+0000 7eff003419c0 20 INFO: main: starting shard=10 2024-09-14T11:42:00.912 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:42:00.909+0000 7eff003419c0 10 bucket_obj is .dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.18.2.10 2024-09-14T11:42:00.912 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:42:00.909+0000 7eff003419c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.18.2.10 2024-09-14T11:42:00.912 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:42:00.909+0000 7eff003419c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:42:00.912 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:42:00.909+0000 7eff003419c0 20 INFO: main: starting shard=11 2024-09-14T11:42:00.912 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:42:00.909+0000 7eff003419c0 10 bucket_obj is .dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.18.2.11 2024-09-14T11:42:00.912 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:42:00.909+0000 7eff003419c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.18.2.11 2024-09-14T11:42:00.913 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:42:00.913+0000 7eff003419c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:42:00.913 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:42:00.913+0000 7eff003419c0 20 INFO: main: starting shard=12 2024-09-14T11:42:00.913 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:42:00.913+0000 7eff003419c0 10 bucket_obj is .dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.18.2.12 2024-09-14T11:42:00.913 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:42:00.913+0000 7eff003419c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.18.2.12 2024-09-14T11:42:00.914 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:42:00.913+0000 7eff003419c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:42:00.914 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:42:00.913+0000 7eff003419c0 20 INFO: main: done 2024-09-14T11:42:00.915 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:42:00.913+0000 7efdaf7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:42:00.920 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:42:00.917+0000 7eff003419c0 20 remove_watcher() i=0 2024-09-14T11:42:00.920 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:42:00.917+0000 7eff003419c0 2 removed watcher, disabling cache 2024-09-14T11:42:00.922 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:42:00.921+0000 7eff003419c0 20 remove_watcher() i=1 2024-09-14T11:42:00.924 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:42:00.925+0000 7eff003419c0 20 remove_watcher() i=2 2024-09-14T11:42:00.926 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:42:00.925+0000 7eff003419c0 20 remove_watcher() i=3 2024-09-14T11:42:00.928 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:42:00.929+0000 7eff003419c0 20 remove_watcher() i=4 2024-09-14T11:42:00.929 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:42:00.929+0000 7eff003419c0 20 remove_watcher() i=5 2024-09-14T11:42:00.931 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:42:00.929+0000 7eff003419c0 20 remove_watcher() i=6 2024-09-14T11:42:00.933 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:42:00.933+0000 7eff003419c0 20 remove_watcher() i=7 2024-09-14T11:42:00.950 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:42:00.951 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-14T11:42:00.981 INFO:tasks.workunit.client.0.smithi138.stderr:ceph config rm client rgw_debug_inject_set_olh_err 2024-09-14T11:42:01.406 INFO:tasks.workunit.client.0.smithi138.stderr:ceph config rm client rgw_debug_inject_olh_cancel_modification_err 2024-09-14T11:42:01.841 INFO:tasks.workunit.client.0.smithi138.stderr:radosgw-admin bucket reshard --bucket myver --num-shards 17 --yes-i-really-mean-it 2024-09-14T11:42:01.873 INFO:tasks.workunit.client.0.smithi138.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:42:01.874 INFO:tasks.workunit.client.0.smithi138.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:42:01.916 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:42:01.913+0000 7fe09cab49c0 20 rados->read ofs=0 len=0 2024-09-14T11:42:01.918 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:42:01.917+0000 7fe09cab49c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:42:01.918 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:42:01.917+0000 7fe09cab49c0 20 realm 2024-09-14T11:42:01.918 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:42:01.917+0000 7fe09cab49c0 20 rados->read ofs=0 len=0 2024-09-14T11:42:01.918 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:42:01.917+0000 7fe09cab49c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:42:01.918 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:42:01.917+0000 7fe09cab49c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:42:01.918 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:42:01.917+0000 7fe09cab49c0 20 rados->read ofs=0 len=0 2024-09-14T11:42:01.918 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:42:01.917+0000 7fe09cab49c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:42:01.918 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:42:01.917+0000 7fe09cab49c0 20 rados->read ofs=0 len=0 2024-09-14T11:42:01.919 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:42:01.917+0000 7fe09cab49c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:42:01.919 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:42:01.917+0000 7fe09cab49c0 20 rados->read ofs=0 len=0 2024-09-14T11:42:01.920 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:42:01.921+0000 7fe09cab49c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:42:01.920 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:42:01.921+0000 7fe09cab49c0 20 searching for the correct realm 2024-09-14T11:42:01.925 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:42:01.925+0000 7fe09a5ba640 0 -- 172.21.15.138:0/2477126113 >> [v2:172.21.15.138:6808/3258321916,v1:172.21.15.138:6809/3258321916] conn(0x5560040a4630 msgr2=0x5560040a6af0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:42:01.931 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:42:01.929+0000 7fe099db9640 0 -- 172.21.15.138:0/2477126113 >> [v2:172.21.15.138:6816/326481658,v1:172.21.15.138:6817/326481658] conn(0x7fe08c06e1d0 msgr2=0x7fe08c069050 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:42:01.938 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:42:01.937+0000 7fe09cab49c0 20 RGWRados::pool_iterate: got zone_info.d9e72d30-c60b-4d0d-9267-fdc36392d5ad 2024-09-14T11:42:01.938 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:42:01.937+0000 7fe09cab49c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:42:01.938 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:42:01.937+0000 7fe09cab49c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:42:01.938 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:42:01.937+0000 7fe09cab49c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:42:01.938 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:42:01.937+0000 7fe09cab49c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:42:01.938 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:42:01.937+0000 7fe09cab49c0 20 RGWRados::pool_iterate: got zonegroup_info.65ab941b-da8c-4160-94fb-3672b069d44f 2024-09-14T11:42:01.938 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:42:01.937+0000 7fe09cab49c0 20 rados->read ofs=0 len=0 2024-09-14T11:42:01.938 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:42:01.937+0000 7fe09cab49c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:42:01.938 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:42:01.937+0000 7fe09cab49c0 20 rados->read ofs=0 len=0 2024-09-14T11:42:01.939 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:42:01.937+0000 7fe09cab49c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:42:01.940 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:42:01.937+0000 7fe09cab49c0 20 rados->read ofs=0 len=0 2024-09-14T11:42:01.940 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:42:01.937+0000 7fe09cab49c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:42:01.940 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:42:01.937+0000 7fe09cab49c0 20 zone default found 2024-09-14T11:42:01.940 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:42:01.937+0000 7fe09cab49c0 4 Realm: () 2024-09-14T11:42:01.940 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:42:01.937+0000 7fe09cab49c0 4 ZoneGroup: default (65ab941b-da8c-4160-94fb-3672b069d44f) 2024-09-14T11:42:01.940 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:42:01.937+0000 7fe09cab49c0 4 Zone: default (d9e72d30-c60b-4d0d-9267-fdc36392d5ad) 2024-09-14T11:42:01.940 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:42:01.937+0000 7fe09cab49c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:42:01.940 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:42:01.937+0000 7fe09cab49c0 20 zonegroup default 2024-09-14T11:42:01.940 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:42:01.937+0000 7fe09cab49c0 20 rados->read ofs=0 len=0 2024-09-14T11:42:01.940 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:42:01.937+0000 7fe09cab49c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:42:01.940 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:42:01.937+0000 7fe09cab49c0 20 rados->read ofs=0 len=0 2024-09-14T11:42:01.941 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:42:01.941+0000 7fe09cab49c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:42:01.941 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:42:01.941+0000 7fe09cab49c0 20 rados->read ofs=0 len=0 2024-09-14T11:42:01.941 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:42:01.941+0000 7fe09cab49c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:42:01.941 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:42:01.941+0000 7fe09cab49c0 20 started sync module instance, tier type = 2024-09-14T11:42:01.941 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:42:01.941+0000 7fe09cab49c0 20 started zone id=d9e72d30-c60b-4d0d-9267-fdc36392d5ad (name=default) with tier type = 2024-09-14T11:42:01.955 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:42:01.953+0000 7fe09cab49c0 20 add_watcher() i=0 2024-09-14T11:42:01.955 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:42:01.953+0000 7fe09cab49c0 20 add_watcher() i=1 2024-09-14T11:42:01.955 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:42:01.953+0000 7fe09cab49c0 20 add_watcher() i=2 2024-09-14T11:42:01.955 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:42:01.953+0000 7fe09cab49c0 20 add_watcher() i=3 2024-09-14T11:42:01.955 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:42:01.953+0000 7fe09cab49c0 20 add_watcher() i=4 2024-09-14T11:42:01.955 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:42:01.953+0000 7fe09cab49c0 20 add_watcher() i=5 2024-09-14T11:42:01.955 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:42:01.953+0000 7fe09cab49c0 20 add_watcher() i=6 2024-09-14T11:42:01.956 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:42:01.953+0000 7fe09cab49c0 20 add_watcher() i=7 2024-09-14T11:42:01.956 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:42:01.953+0000 7fe09cab49c0 2 all 8 watchers are set, enabling cache 2024-09-14T11:42:01.958 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:42:01.957+0000 7fdf50fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:42:01.959 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:42:01.957+0000 7fe09cab49c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:42:01.959 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:42:01.957+0000 7fe09cab49c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:42:01.959 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:42:01.957+0000 7fe09cab49c0 5 note: GC not initialized 2024-09-14T11:42:01.959 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:42:01.957+0000 7fdecb7fe640 20 reqs_thread_entry: start 2024-09-14T11:42:01.959 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:42:01.957+0000 7fe09cab49c0 20 init_complete bucket index max shards: 11 2024-09-14T11:42:01.959 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:42:01.957+0000 7fe09cab49c0 20 Filter name: none 2024-09-14T11:42:01.959 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:42:01.957+0000 7fdec97fa640 20 reqs_thread_entry: start 2024-09-14T11:42:01.959 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:42:01.957+0000 7fe09cab49c0 10 cache get: name=default.rgw.meta+root+myver : miss 2024-09-14T11:42:01.960 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:42:01.957+0000 7fe09cab49c0 20 rados->read ofs=0 len=0 2024-09-14T11:42:01.960 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:42:01.957+0000 7fe09cab49c0 20 rados_obj.operate() r=0 bl.length=173 2024-09-14T11:42:01.960 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:42:01.957+0000 7fe09cab49c0 10 cache put: name=default.rgw.meta+root+myver info.flags=0x11 2024-09-14T11:42:01.960 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:42:01.957+0000 7fe09cab49c0 10 adding default.rgw.meta+root+myver to cache LRU end 2024-09-14T11:42:01.960 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:42:01.957+0000 7fe09cab49c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.myver:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.18 : miss 2024-09-14T11:42:01.960 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:42:01.957+0000 7fe09cab49c0 20 rados->read ofs=0 len=0 2024-09-14T11:42:01.960 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:42:01.957+0000 7fe09cab49c0 20 rados_obj.operate() r=0 bl.length=395 2024-09-14T11:42:01.961 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:42:01.957+0000 7fe09cab49c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.myver:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.18 info.flags=0x17 2024-09-14T11:42:01.961 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:42:01.957+0000 7fe09cab49c0 10 adding default.rgw.meta+root+.bucket.meta.myver:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.18 to cache LRU end 2024-09-14T11:42:01.961 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:42:01.957+0000 7fe09cab49c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:42:01.961 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:42:01.957+0000 7fe09cab49c0 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-14T11:42:01.961 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:42:01.957+0000 7fe09cab49c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myver:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.18 2024-09-14T11:42:01.971 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:42:01.969+0000 7fe09cab49c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.myver:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.18 info.flags=0x17 2024-09-14T11:42:01.971 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:42:01.969+0000 7fe09cab49c0 10 moving default.rgw.meta+root+.bucket.meta.myver:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.18 to cache LRU end 2024-09-14T11:42:01.971 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:42:01.969+0000 7fe09cab49c0 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-14T11:42:01.971 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:42:01.969+0000 7fe09cab49c0 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.myver:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.18, ofs0, ns] 2024-09-14T11:42:01.971 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:42:01.969+0000 7fdf7dffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366207 cookie 93870873025760 notifier 8628 bl.length()=821 2024-09-14T11:42:01.971 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:42:01.969+0000 7fdf7dffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.myver:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.18 info.flags=0x17 2024-09-14T11:42:01.972 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:42:01.969+0000 7fdf7dffb640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.myver:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.18 to cache LRU end 2024-09-14T11:42:01.972 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:42:01.969+0000 7fdf7dffb640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=143 2024-09-14T11:42:01.973 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:42:01.973+0000 7fe09cab49c0 20 handle_bi_update(): bucket=:myver[d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.18]): orig_sources= new_sources= 2024-09-14T11:42:01.973 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:42:01.973+0000 7fe09cab49c0 20 handle_bi_update(): bucket=:myver[d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.18]): potential sources added=[] removed=[] 2024-09-14T11:42:01.973 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:42:01.973+0000 7fe09cab49c0 20 handle_bi_update(): bucket=:myver[d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.18]): orig_dests= new_dests= 2024-09-14T11:42:01.973 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:42:01.973+0000 7fe09cab49c0 20 handle_bi_update(): bucket=:myver[d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.18]): potential dests added=[] removed=[] 2024-09-14T11:42:01.982 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:42:01.981+0000 7fe09cab49c0 10 bucket_obj is .dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.18.3.0 2024-09-14T11:42:01.982 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:42:01.981+0000 7fe09cab49c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.18.3.0 2024-09-14T11:42:01.982 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:42:01.981+0000 7fe09cab49c0 10 bucket_obj is .dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.18.3.1 2024-09-14T11:42:01.982 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:42:01.981+0000 7fe09cab49c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.18.3.1 2024-09-14T11:42:01.983 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:42:01.981+0000 7fe09cab49c0 10 bucket_obj is .dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.18.3.2 2024-09-14T11:42:01.983 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:42:01.981+0000 7fe09cab49c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.18.3.2 2024-09-14T11:42:01.983 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:42:01.981+0000 7fe09cab49c0 10 bucket_obj is .dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.18.3.3 2024-09-14T11:42:01.983 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:42:01.981+0000 7fe09cab49c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.18.3.3 2024-09-14T11:42:01.983 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:42:01.981+0000 7fe09cab49c0 10 bucket_obj is .dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.18.3.4 2024-09-14T11:42:01.983 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:42:01.981+0000 7fe09cab49c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.18.3.4 2024-09-14T11:42:01.983 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:42:01.981+0000 7fe09cab49c0 10 bucket_obj is .dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.18.3.5 2024-09-14T11:42:01.983 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:42:01.981+0000 7fe09cab49c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.18.3.5 2024-09-14T11:42:01.983 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:42:01.981+0000 7fe09cab49c0 10 bucket_obj is .dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.18.3.6 2024-09-14T11:42:01.983 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:42:01.981+0000 7fe09cab49c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.18.3.6 2024-09-14T11:42:01.983 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:42:01.981+0000 7fe09cab49c0 10 bucket_obj is .dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.18.3.7 2024-09-14T11:42:01.983 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:42:01.981+0000 7fe09cab49c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.18.3.7 2024-09-14T11:42:01.983 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:42:01.981+0000 7fe09cab49c0 10 bucket_obj is .dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.18.3.8 2024-09-14T11:42:01.983 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:42:01.981+0000 7fe09cab49c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.18.3.8 2024-09-14T11:42:01.984 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:42:01.981+0000 7fe09cab49c0 10 bucket_obj is .dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.18.3.9 2024-09-14T11:42:01.984 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:42:01.981+0000 7fe09cab49c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.18.3.9 2024-09-14T11:42:01.984 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:42:01.981+0000 7fe09cab49c0 10 bucket_obj is .dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.18.3.10 2024-09-14T11:42:01.984 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:42:01.981+0000 7fe09cab49c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.18.3.10 2024-09-14T11:42:01.984 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:42:01.981+0000 7fe09cab49c0 10 bucket_obj is .dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.18.3.11 2024-09-14T11:42:01.984 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:42:01.981+0000 7fe09cab49c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.18.3.11 2024-09-14T11:42:01.984 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:42:01.981+0000 7fe09cab49c0 10 bucket_obj is .dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.18.3.12 2024-09-14T11:42:01.984 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:42:01.981+0000 7fe09cab49c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.18.3.12 2024-09-14T11:42:01.984 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:42:01.981+0000 7fe09cab49c0 10 bucket_obj is .dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.18.3.13 2024-09-14T11:42:01.984 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:42:01.981+0000 7fe09cab49c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.18.3.13 2024-09-14T11:42:01.984 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:42:01.981+0000 7fe09cab49c0 10 bucket_obj is .dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.18.3.14 2024-09-14T11:42:01.984 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:42:01.981+0000 7fe09cab49c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.18.3.14 2024-09-14T11:42:01.984 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:42:01.981+0000 7fe09cab49c0 10 bucket_obj is .dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.18.3.15 2024-09-14T11:42:01.984 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:42:01.981+0000 7fe09cab49c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.18.3.15 2024-09-14T11:42:01.985 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:42:01.981+0000 7fe09cab49c0 10 bucket_obj is .dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.18.3.16 2024-09-14T11:42:01.985 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:42:01.981+0000 7fe09cab49c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.18.3.16 2024-09-14T11:42:01.985 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:42:01.981+0000 7fe09cab49c0 10 bucket_obj is .dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.18.2.0 2024-09-14T11:42:01.985 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:42:01.981+0000 7fe09cab49c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.18.2.0 2024-09-14T11:42:01.985 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:42:01.981+0000 7fe09cab49c0 10 bucket_obj is .dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.18.2.1 2024-09-14T11:42:01.985 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:42:01.981+0000 7fe09cab49c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.18.2.1 2024-09-14T11:42:01.985 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:42:01.985+0000 7fe09cab49c0 10 bucket_obj is .dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.18.2.2 2024-09-14T11:42:01.985 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:42:01.985+0000 7fe09cab49c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.18.2.2 2024-09-14T11:42:01.986 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:42:01.985+0000 7fe09cab49c0 10 bucket_obj is .dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.18.2.3 2024-09-14T11:42:01.986 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:42:01.985+0000 7fe09cab49c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.18.2.3 2024-09-14T11:42:01.987 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:42:01.985+0000 7fe09cab49c0 10 bucket_obj is .dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.18.2.4 2024-09-14T11:42:01.987 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:42:01.985+0000 7fe09cab49c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.18.2.4 2024-09-14T11:42:01.988 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:42:01.989+0000 7fe09cab49c0 10 bucket_obj is .dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.18.2.5 2024-09-14T11:42:01.988 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:42:01.989+0000 7fe09cab49c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.18.2.5 2024-09-14T11:42:01.988 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:42:01.989+0000 7fe09cab49c0 10 bucket_obj is .dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.18.2.6 2024-09-14T11:42:01.988 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:42:01.989+0000 7fe09cab49c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.18.2.6 2024-09-14T11:42:01.989 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:42:01.989+0000 7fe09cab49c0 10 bucket_obj is .dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.18.2.7 2024-09-14T11:42:01.989 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:42:01.989+0000 7fe09cab49c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.18.2.7 2024-09-14T11:42:01.989 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:42:01.989+0000 7fe09cab49c0 10 bucket_obj is .dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.18.2.8 2024-09-14T11:42:01.989 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:42:01.989+0000 7fe09cab49c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.18.2.8 2024-09-14T11:42:01.990 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:42:01.989+0000 7fe09cab49c0 10 bucket_obj is .dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.18.2.9 2024-09-14T11:42:01.990 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:42:01.989+0000 7fe09cab49c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.18.2.9 2024-09-14T11:42:01.990 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:42:01.989+0000 7fe09cab49c0 10 bucket_obj is .dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.18.2.10 2024-09-14T11:42:01.990 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:42:01.989+0000 7fe09cab49c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.18.2.10 2024-09-14T11:42:01.991 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:42:01.989+0000 7fe09cab49c0 10 bucket_obj is .dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.18.2.11 2024-09-14T11:42:01.991 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:42:01.989+0000 7fe09cab49c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.18.2.11 2024-09-14T11:42:01.992 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:42:01.989+0000 7fe09cab49c0 10 bucket_obj is .dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.18.2.12 2024-09-14T11:42:01.992 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:42:01.989+0000 7fe09cab49c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.18.2.12 2024-09-14T11:42:01.995 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:42:01.993+0000 7fe09cab49c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.myver:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.18 : hit (requested=0x17, cached=0x17) 2024-09-14T11:42:01.995 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:42:01.993+0000 7fe09cab49c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myver:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.18 2024-09-14T11:42:01.997 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:42:01.997+0000 7fe09cab49c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.myver:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.18 info.flags=0x17 2024-09-14T11:42:01.997 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:42:01.997+0000 7fe09cab49c0 10 moving default.rgw.meta+root+.bucket.meta.myver:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.18 to cache LRU end 2024-09-14T11:42:01.997 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:42:01.997+0000 7fe09cab49c0 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-14T11:42:01.997 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:42:01.997+0000 7fe09cab49c0 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.myver:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.18, ofs0, ns] 2024-09-14T11:42:01.997 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:42:01.997+0000 7fdf7d7fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366208 cookie 93870873025760 notifier 8628 bl.length()=821 2024-09-14T11:42:01.997 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:42:01.997+0000 7fdf7d7fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.myver:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.18 info.flags=0x17 2024-09-14T11:42:01.997 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:42:01.997+0000 7fdf7d7fa640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.myver:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.18 to cache LRU end 2024-09-14T11:42:01.997 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:42:01.997+0000 7fdf7d7fa640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=143 2024-09-14T11:42:01.998 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:42:01.997+0000 7fe09cab49c0 20 handle_bi_update(): bucket=:myver[d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.18]): orig_sources= new_sources= 2024-09-14T11:42:01.999 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:42:01.997+0000 7fe09cab49c0 20 handle_bi_update(): bucket=:myver[d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.18]): potential sources added=[] removed=[] 2024-09-14T11:42:01.999 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:42:01.997+0000 7fe09cab49c0 20 handle_bi_update(): bucket=:myver[d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.18]): orig_dests= new_dests= 2024-09-14T11:42:01.999 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:42:01.997+0000 7fe09cab49c0 20 handle_bi_update(): bucket=:myver[d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.18]): potential dests added=[] removed=[] 2024-09-14T11:42:02.003 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:42:02.001+0000 7fe09cab49c0 10 bucket_obj is .dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.18.2.0 2024-09-14T11:42:02.003 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:42:02.001+0000 7fe09cab49c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.18.2.0 2024-09-14T11:42:02.004 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:42:02.001+0000 7fe09cab49c0 10 bucket_obj is .dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.18.2.1 2024-09-14T11:42:02.004 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:42:02.001+0000 7fe09cab49c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.18.2.1 2024-09-14T11:42:02.005 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:42:02.005+0000 7fe09cab49c0 10 bucket_obj is .dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.18.2.2 2024-09-14T11:42:02.005 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:42:02.005+0000 7fe09cab49c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.18.2.2 2024-09-14T11:42:02.005 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:42:02.005+0000 7fe09cab49c0 10 bucket_obj is .dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.18.2.3 2024-09-14T11:42:02.006 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:42:02.005+0000 7fe09cab49c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.18.2.3 2024-09-14T11:42:02.006 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:42:02.005+0000 7fe09cab49c0 10 bucket_obj is .dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.18.2.4 2024-09-14T11:42:02.006 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:42:02.005+0000 7fe09cab49c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.18.2.4 2024-09-14T11:42:02.007 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:42:02.005+0000 7fe09cab49c0 10 bucket_obj is .dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.18.2.5 2024-09-14T11:42:02.007 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:42:02.005+0000 7fe09cab49c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.18.2.5 2024-09-14T11:42:02.007 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:42:02.005+0000 7fe09cab49c0 10 bucket_obj is .dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.18.2.6 2024-09-14T11:42:02.008 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:42:02.005+0000 7fe09cab49c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.18.2.6 2024-09-14T11:42:02.008 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:42:02.005+0000 7fe09cab49c0 10 bucket_obj is .dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.18.2.7 2024-09-14T11:42:02.008 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:42:02.005+0000 7fe09cab49c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.18.2.7 2024-09-14T11:42:02.008 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:42:02.009+0000 7fe09cab49c0 10 bucket_obj is .dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.18.2.8 2024-09-14T11:42:02.008 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:42:02.009+0000 7fe09cab49c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.18.2.8 2024-09-14T11:42:02.009 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:42:02.009+0000 7fe09cab49c0 10 bucket_obj is .dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.18.2.9 2024-09-14T11:42:02.009 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:42:02.009+0000 7fe09cab49c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.18.2.9 2024-09-14T11:42:02.009 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:42:02.009+0000 7fe09cab49c0 10 bucket_obj is .dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.18.2.10 2024-09-14T11:42:02.009 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:42:02.009+0000 7fe09cab49c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.18.2.10 2024-09-14T11:42:02.009 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:42:02.009+0000 7fe09cab49c0 10 bucket_obj is .dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.18.2.11 2024-09-14T11:42:02.009 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:42:02.009+0000 7fe09cab49c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.18.2.11 2024-09-14T11:42:02.010 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:42:02.009+0000 7fe09cab49c0 10 bucket_obj is .dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.18.2.12 2024-09-14T11:42:02.010 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:42:02.009+0000 7fe09cab49c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.18.2.12 2024-09-14T11:42:02.010 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:42:02.009+0000 7fe09cab49c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.myver:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.18 : hit (requested=0x17, cached=0x17) 2024-09-14T11:42:02.010 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:42:02.009+0000 7fe09cab49c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myver:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.18 2024-09-14T11:42:02.011 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:42:02.009+0000 7fe09cab49c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.myver:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.18 info.flags=0x17 2024-09-14T11:42:02.011 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:42:02.009+0000 7fe09cab49c0 10 moving default.rgw.meta+root+.bucket.meta.myver:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.18 to cache LRU end 2024-09-14T11:42:02.011 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:42:02.009+0000 7fe09cab49c0 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-14T11:42:02.011 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:42:02.009+0000 7fe09cab49c0 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.myver:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.18, ofs0, ns] 2024-09-14T11:42:02.012 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:42:02.009+0000 7fdf7d7fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366209 cookie 93870873025760 notifier 8628 bl.length()=789 2024-09-14T11:42:02.012 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:42:02.009+0000 7fdf7d7fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.myver:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.18 info.flags=0x17 2024-09-14T11:42:02.012 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:42:02.009+0000 7fdf7d7fa640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.myver:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.18 to cache LRU end 2024-09-14T11:42:02.012 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:42:02.009+0000 7fdf7d7fa640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=143 2024-09-14T11:42:02.013 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:42:02.013+0000 7fe09cab49c0 20 handle_bi_update(): bucket=:myver[d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.18]): orig_sources= new_sources= 2024-09-14T11:42:02.013 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:42:02.013+0000 7fe09cab49c0 20 handle_bi_update(): bucket=:myver[d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.18]): potential sources added=[] removed=[] 2024-09-14T11:42:02.013 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:42:02.013+0000 7fe09cab49c0 20 handle_bi_update(): bucket=:myver[d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.18]): orig_dests= new_dests= 2024-09-14T11:42:02.013 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:42:02.013+0000 7fe09cab49c0 20 handle_bi_update(): bucket=:myver[d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.18]): potential dests added=[] removed=[] 2024-09-14T11:42:02.018 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:42:02.017+0000 7fe09cab49c0 1 execute INFO: reshard of bucket "myver" from 13 shards to 17 shards completed successfully 2024-09-14T11:42:02.021 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:42:02.021+0000 7fdf50fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:42:02.026 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:42:02.025+0000 7fe09cab49c0 20 remove_watcher() i=0 2024-09-14T11:42:02.026 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:42:02.025+0000 7fe09cab49c0 2 removed watcher, disabling cache 2024-09-14T11:42:02.027 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:42:02.025+0000 7fe09cab49c0 20 remove_watcher() i=1 2024-09-14T11:42:02.030 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:42:02.029+0000 7fe09cab49c0 20 remove_watcher() i=2 2024-09-14T11:42:02.032 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:42:02.029+0000 7fe09cab49c0 20 remove_watcher() i=3 2024-09-14T11:42:02.034 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:42:02.033+0000 7fe09cab49c0 20 remove_watcher() i=4 2024-09-14T11:42:02.035 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:42:02.033+0000 7fe09cab49c0 20 remove_watcher() i=5 2024-09-14T11:42:02.036 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:42:02.037+0000 7fe09cab49c0 20 remove_watcher() i=6 2024-09-14T11:42:02.037 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:42:02.037+0000 7fe09cab49c0 20 remove_watcher() i=7 2024-09-14T11:42:02.048 INFO:tasks.workunit.client.0.smithi138.stderr:radosgw-admin bucket check unlinked --bucket myver --fix --min-age-hours 0 --rgw-olh-pending-timeout-sec 0 --dump-keys 2024-09-14T11:42:02.082 INFO:tasks.workunit.client.0.smithi138.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:42:02.082 INFO:tasks.workunit.client.0.smithi138.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:42:02.122 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:42:02.121+0000 7fba9de749c0 20 rados->read ofs=0 len=0 2024-09-14T11:42:02.125 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:42:02.125+0000 7fba9de749c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:42:02.125 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:42:02.125+0000 7fba9de749c0 20 realm 2024-09-14T11:42:02.125 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:42:02.125+0000 7fba9de749c0 20 rados->read ofs=0 len=0 2024-09-14T11:42:02.125 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:42:02.125+0000 7fba9de749c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:42:02.125 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:42:02.125+0000 7fba9de749c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:42:02.125 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:42:02.125+0000 7fba9de749c0 20 rados->read ofs=0 len=0 2024-09-14T11:42:02.125 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:42:02.125+0000 7fba9de749c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:42:02.125 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:42:02.125+0000 7fba9de749c0 20 rados->read ofs=0 len=0 2024-09-14T11:42:02.126 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:42:02.125+0000 7fba9de749c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:42:02.126 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:42:02.125+0000 7fba9de749c0 20 rados->read ofs=0 len=0 2024-09-14T11:42:02.127 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:42:02.125+0000 7fba9de749c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:42:02.127 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:42:02.125+0000 7fba9de749c0 20 searching for the correct realm 2024-09-14T11:42:02.129 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:42:02.129+0000 7fba9c17b640 0 -- 172.21.15.138:0/3402180756 >> [v2:172.21.15.138:6824/2633984942,v1:172.21.15.138:6825/2633984942] conn(0x555615887f20 msgr2=0x55561588a310 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-14T11:42:02.136 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:42:02.137+0000 7fba9b179640 0 -- 172.21.15.138:0/3402180756 >> [v2:172.21.15.154:6808/1468088432,v1:172.21.15.154:6809/1468088432] conn(0x7fba8c0dfce0 msgr2=0x7fba8c108040 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:42:02.145 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:42:02.145+0000 7fba9de749c0 20 RGWRados::pool_iterate: got zone_info.d9e72d30-c60b-4d0d-9267-fdc36392d5ad 2024-09-14T11:42:02.146 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:42:02.145+0000 7fba9de749c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:42:02.146 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:42:02.145+0000 7fba9de749c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:42:02.146 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:42:02.145+0000 7fba9de749c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:42:02.146 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:42:02.145+0000 7fba9de749c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:42:02.146 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:42:02.145+0000 7fba9de749c0 20 RGWRados::pool_iterate: got zonegroup_info.65ab941b-da8c-4160-94fb-3672b069d44f 2024-09-14T11:42:02.146 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:42:02.145+0000 7fba9de749c0 20 rados->read ofs=0 len=0 2024-09-14T11:42:02.146 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:42:02.145+0000 7fba9de749c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:42:02.146 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:42:02.145+0000 7fba9de749c0 20 rados->read ofs=0 len=0 2024-09-14T11:42:02.147 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:42:02.145+0000 7fba9de749c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:42:02.147 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:42:02.145+0000 7fba9de749c0 20 rados->read ofs=0 len=0 2024-09-14T11:42:02.147 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:42:02.145+0000 7fba9de749c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:42:02.147 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:42:02.145+0000 7fba9de749c0 20 zone default found 2024-09-14T11:42:02.148 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:42:02.145+0000 7fba9de749c0 4 Realm: () 2024-09-14T11:42:02.148 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:42:02.145+0000 7fba9de749c0 4 ZoneGroup: default (65ab941b-da8c-4160-94fb-3672b069d44f) 2024-09-14T11:42:02.148 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:42:02.145+0000 7fba9de749c0 4 Zone: default (d9e72d30-c60b-4d0d-9267-fdc36392d5ad) 2024-09-14T11:42:02.148 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:42:02.145+0000 7fba9de749c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:42:02.148 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:42:02.145+0000 7fba9de749c0 20 zonegroup default 2024-09-14T11:42:02.148 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:42:02.145+0000 7fba9de749c0 20 rados->read ofs=0 len=0 2024-09-14T11:42:02.148 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:42:02.145+0000 7fba9de749c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:42:02.148 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:42:02.145+0000 7fba9de749c0 20 rados->read ofs=0 len=0 2024-09-14T11:42:02.149 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:42:02.145+0000 7fba9de749c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:42:02.149 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:42:02.145+0000 7fba9de749c0 20 rados->read ofs=0 len=0 2024-09-14T11:42:02.149 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:42:02.149+0000 7fba9de749c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:42:02.149 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:42:02.149+0000 7fba9de749c0 20 started sync module instance, tier type = 2024-09-14T11:42:02.149 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:42:02.149+0000 7fba9de749c0 20 started zone id=d9e72d30-c60b-4d0d-9267-fdc36392d5ad (name=default) with tier type = 2024-09-14T11:42:02.163 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:42:02.161+0000 7fba9de749c0 20 add_watcher() i=0 2024-09-14T11:42:02.163 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:42:02.161+0000 7fba9de749c0 20 add_watcher() i=1 2024-09-14T11:42:02.163 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:42:02.161+0000 7fba9de749c0 20 add_watcher() i=2 2024-09-14T11:42:02.164 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:42:02.161+0000 7fba9de749c0 20 add_watcher() i=3 2024-09-14T11:42:02.164 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:42:02.161+0000 7fba9de749c0 20 add_watcher() i=4 2024-09-14T11:42:02.164 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:42:02.161+0000 7fba9de749c0 20 add_watcher() i=5 2024-09-14T11:42:02.164 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:42:02.161+0000 7fba9de749c0 20 add_watcher() i=6 2024-09-14T11:42:02.164 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:42:02.165+0000 7fba9de749c0 20 add_watcher() i=7 2024-09-14T11:42:02.164 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:42:02.165+0000 7fba9de749c0 2 all 8 watchers are set, enabling cache 2024-09-14T11:42:02.166 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:42:02.165+0000 7fb951fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:42:02.167 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:42:02.165+0000 7fba9de749c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:42:02.168 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:42:02.165+0000 7fba9de749c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:42:02.168 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:42:02.165+0000 7fba9de749c0 5 note: GC not initialized 2024-09-14T11:42:02.168 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:42:02.165+0000 7fb950fe1640 20 reqs_thread_entry: start 2024-09-14T11:42:02.168 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:42:02.165+0000 7fba9de749c0 20 init_complete bucket index max shards: 11 2024-09-14T11:42:02.168 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:42:02.165+0000 7fba9de749c0 20 Filter name: none 2024-09-14T11:42:02.168 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:42:02.165+0000 7fb8ca7fc640 20 reqs_thread_entry: start 2024-09-14T11:42:02.168 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:42:02.165+0000 7fba9de749c0 10 cache get: name=default.rgw.meta+root+myver : miss 2024-09-14T11:42:02.168 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:42:02.165+0000 7fba9de749c0 20 rados->read ofs=0 len=0 2024-09-14T11:42:02.168 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:42:02.165+0000 7fba9de749c0 20 rados_obj.operate() r=0 bl.length=173 2024-09-14T11:42:02.168 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:42:02.165+0000 7fba9de749c0 10 cache put: name=default.rgw.meta+root+myver info.flags=0x11 2024-09-14T11:42:02.168 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:42:02.165+0000 7fba9de749c0 10 adding default.rgw.meta+root+myver to cache LRU end 2024-09-14T11:42:02.168 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:42:02.165+0000 7fba9de749c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.myver:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.18 : miss 2024-09-14T11:42:02.169 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:42:02.165+0000 7fba9de749c0 20 rados->read ofs=0 len=0 2024-09-14T11:42:02.169 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:42:02.169+0000 7fba9de749c0 20 rados_obj.operate() r=0 bl.length=395 2024-09-14T11:42:02.170 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:42:02.169+0000 7fba9de749c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.myver:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.18 info.flags=0x17 2024-09-14T11:42:02.170 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:42:02.169+0000 7fba9de749c0 10 adding default.rgw.meta+root+.bucket.meta.myver:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.18 to cache LRU end 2024-09-14T11:42:02.170 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:42:02.169+0000 7fba9de749c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:42:02.170 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:42:02.169+0000 7fba9de749c0 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-14T11:42:02.170 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:42:02.169+0000 7fba9de749c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myver:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.18 2024-09-14T11:42:02.170 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:42:02.169+0000 7fba9de749c0 10 bucket_obj is .dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.18.3.0 2024-09-14T11:42:02.170 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:42:02.169+0000 7fba9de749c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.18.3.0 2024-09-14T11:42:02.170 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:42:02.169+0000 7fba9de749c0 1 NOTICE: finished shard 0 (0 entries removed) 2024-09-14T11:42:02.170 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:42:02.169+0000 7fba9de749c0 10 bucket_obj is .dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.18.3.1 2024-09-14T11:42:02.170 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:42:02.169+0000 7fba9de749c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.18.3.1 2024-09-14T11:42:02.171 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:42:02.169+0000 7fba9de749c0 1 NOTICE: finished shard 1 (0 entries removed) 2024-09-14T11:42:02.171 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:42:02.169+0000 7fba9de749c0 10 bucket_obj is .dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.18.3.2 2024-09-14T11:42:02.171 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:42:02.169+0000 7fba9de749c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.18.3.2 2024-09-14T11:42:02.171 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:42:02.169+0000 7fba9de749c0 1 NOTICE: finished shard 2 (0 entries removed) 2024-09-14T11:42:02.171 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:42:02.169+0000 7fba9de749c0 10 bucket_obj is .dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.18.3.3 2024-09-14T11:42:02.171 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:42:02.169+0000 7fba9de749c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.18.3.3 2024-09-14T11:42:02.173 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:42:02.173+0000 7fba9de749c0 1 NOTICE: finished shard 3 (0 entries removed) 2024-09-14T11:42:02.173 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:42:02.173+0000 7fba9de749c0 10 bucket_obj is .dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.18.3.4 2024-09-14T11:42:02.173 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:42:02.173+0000 7fba9de749c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.18.3.4 2024-09-14T11:42:02.174 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:42:02.173+0000 7fba9de749c0 1 NOTICE: finished shard 4 (0 entries removed) 2024-09-14T11:42:02.174 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:42:02.173+0000 7fba9de749c0 10 bucket_obj is .dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.18.3.5 2024-09-14T11:42:02.174 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:42:02.173+0000 7fba9de749c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.18.3.5 2024-09-14T11:42:02.175 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:42:02.173+0000 7fba9de749c0 1 NOTICE: finished shard 5 (0 entries removed) 2024-09-14T11:42:02.175 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:42:02.173+0000 7fba9de749c0 10 bucket_obj is .dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.18.3.6 2024-09-14T11:42:02.175 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:42:02.173+0000 7fba9de749c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.18.3.6 2024-09-14T11:42:02.176 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:42:02.177+0000 7fba9de749c0 1 NOTICE: finished shard 6 (0 entries removed) 2024-09-14T11:42:02.177 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:42:02.177+0000 7fba9de749c0 10 bucket_obj is .dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.18.3.7 2024-09-14T11:42:02.177 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:42:02.177+0000 7fba9de749c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.18.3.7 2024-09-14T11:42:02.178 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:42:02.177+0000 7fba9de749c0 1 NOTICE: finished shard 7 (0 entries removed) 2024-09-14T11:42:02.179 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:42:02.177+0000 7fba9de749c0 10 bucket_obj is .dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.18.3.8 2024-09-14T11:42:02.179 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:42:02.177+0000 7fba9de749c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.18.3.8 2024-09-14T11:42:02.180 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:42:02.177+0000 7fba9de749c0 1 NOTICE: finished shard 8 (0 entries removed) 2024-09-14T11:42:02.180 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:42:02.177+0000 7fba9de749c0 10 bucket_obj is .dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.18.3.9 2024-09-14T11:42:02.180 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:42:02.177+0000 7fba9de749c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.18.3.9 2024-09-14T11:42:02.180 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:42:02.181+0000 7fba9de749c0 10 bucket_obj is .dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.18.3.10 2024-09-14T11:42:02.180 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:42:02.181+0000 7fba9de749c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.18.3.10 2024-09-14T11:42:02.181 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:42:02.181+0000 7fba9de749c0 1 NOTICE: finished shard 10 (0 entries removed) 2024-09-14T11:42:02.182 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:42:02.181+0000 7fba9de749c0 10 bucket_obj is .dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.18.3.11 2024-09-14T11:42:02.182 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:42:02.181+0000 7fba9de749c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.18.3.11 2024-09-14T11:42:02.182 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:42:02.181+0000 7fba9de749c0 1 NOTICE: finished shard 11 (0 entries removed) 2024-09-14T11:42:02.182 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:42:02.181+0000 7fba9de749c0 10 bucket_obj is .dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.18.3.12 2024-09-14T11:42:02.183 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:42:02.181+0000 7fba9de749c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.18.3.12 2024-09-14T11:42:02.183 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:42:02.181+0000 7fba9de749c0 1 NOTICE: finished shard 12 (0 entries removed) 2024-09-14T11:42:02.183 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:42:02.181+0000 7fba9de749c0 10 bucket_obj is .dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.18.3.13 2024-09-14T11:42:02.183 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:42:02.181+0000 7fba9de749c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.18.3.13 2024-09-14T11:42:02.183 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:42:02.181+0000 7fba9de749c0 1 NOTICE: finished shard 13 (0 entries removed) 2024-09-14T11:42:02.183 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:42:02.181+0000 7fba9de749c0 10 bucket_obj is .dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.18.3.14 2024-09-14T11:42:02.183 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:42:02.181+0000 7fba9de749c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.18.3.14 2024-09-14T11:42:02.184 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:42:02.181+0000 7fba9de749c0 1 NOTICE: finished shard 14 (0 entries removed) 2024-09-14T11:42:02.184 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:42:02.181+0000 7fba9de749c0 10 bucket_obj is .dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.18.3.15 2024-09-14T11:42:02.184 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:42:02.181+0000 7fba9de749c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.18.3.15 2024-09-14T11:42:02.184 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:42:02.185+0000 7fba9de749c0 1 NOTICE: finished shard 15 (0 entries removed) 2024-09-14T11:42:02.184 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:42:02.185+0000 7fba9de749c0 10 bucket_obj is .dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.18.3.16 2024-09-14T11:42:02.185 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:42:02.185+0000 7fba9de749c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.18.3.16 2024-09-14T11:42:02.185 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:42:02.185+0000 7fba9de749c0 1 NOTICE: finished shard 16 (0 entries removed) 2024-09-14T11:42:02.185 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:42:02.185+0000 7fba9de749c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.18.3.9 2024-09-14T11:42:02.185 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:42:02.185+0000 7fba9de749c0 20 get_obj_state: octx=0x55561560e930 obj=myver:x state=0x5556158c3118 s->prefetch_data=0 2024-09-14T11:42:02.186 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:42:02.185+0000 7fba9de749c0 20 get_obj_state: setting s->obj_tag to v04tp410llwg4boeka3t8q1eeyhfcftv 2024-09-14T11:42:02.187 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:42:02.185+0000 7fba9de749c0 20 get_obj_state_impl: setting s->olh_tag to da0aacpu768veplkxo9vyu3i6k7xq7r3 2024-09-14T11:42:02.187 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:42:02.185+0000 7fba9de749c0 20 bucket_index_guard_olh_op(): olh_state.olh_tag=da0aacpu768veplkxo9vyu3i6k7xq7r3 2024-09-14T11:42:02.190 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:42:02.189+0000 7fba9de749c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.18.3.9 2024-09-14T11:42:02.192 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:42:02.189+0000 7fba9de749c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.18.3.9 2024-09-14T11:42:02.192 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:42:02.193+0000 7fba9de749c0 20 olh_log_entry: epoch=2 op=2 key=x[] 2024-09-14T11:42:02.193 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:42:02.193+0000 7fba9de749c0 20 olh_log_entry: epoch=2 op=3 key=x[FUX1A20IapugHMu0mW3MqGSdBpOzmH3] 2024-09-14T11:42:02.193 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:42:02.193+0000 7fba9de749c0 20 get_obj_state: octx=0x55561560e930 obj=myver:_:FUX1A20IapugHMu0mW3MqGSdBpOzmH3_x state=0x5556158ecc88 s->prefetch_data=0 2024-09-14T11:42:02.193 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:42:02.193+0000 7fba9de749c0 10 manifest: total_size = 12 2024-09-14T11:42:02.193 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:42:02.193+0000 7fba9de749c0 20 get_obj_state: setting s->obj_tag to d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.7223745544325392047 2024-09-14T11:42:02.193 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:42:02.193+0000 7fba9de749c0 20 get_obj_state: octx=0x55561560e930 obj=myver:_:FUX1A20IapugHMu0mW3MqGSdBpOzmH3_x state=0x5556158ecc88 s->prefetch_data=0 2024-09-14T11:42:02.193 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:42:02.193+0000 7fba9de749c0 20 prepare_atomic_modification: state is not atomic. state=0x5556158ecc88 2024-09-14T11:42:02.193 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:42:02.193+0000 7fba9de749c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.18.3.9 2024-09-14T11:42:02.197 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:42:02.197+0000 7fb97affd640 20 handle_completion(): completion ok for obj=x[FUX1A20IapugHMu0mW3MqGSdBpOzmH3] 2024-09-14T11:42:02.199 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:42:02.197+0000 7fba9de749c0 20 get_obj_state: octx=0x55561560e930 obj=myver:x state=0x5556158c3118 s->prefetch_data=0 2024-09-14T11:42:02.199 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:42:02.197+0000 7fba9de749c0 20 bucket_index_guard_olh_op(): olh_state.olh_tag=da0aacpu768veplkxo9vyu3i6k7xq7r3 2024-09-14T11:42:02.207 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:42:02.205+0000 7fba9de749c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.18.3.9 2024-09-14T11:42:02.208 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:42:02.209+0000 7fba9de749c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.18.3.9 2024-09-14T11:42:02.209 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:42:02.209+0000 7fba9de749c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.18.3.9 2024-09-14T11:42:02.209 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:42:02.209+0000 7fba9de749c0 20 get_obj_state: octx=0x55561560e930 obj=myver:y state=0x5556158c3118 s->prefetch_data=0 2024-09-14T11:42:02.210 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:42:02.209+0000 7fba9de749c0 20 get_obj_state: setting s->obj_tag to b9uy0b6023hiirqx4qlfvs7940j9u8ug 2024-09-14T11:42:02.210 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:42:02.209+0000 7fba9de749c0 20 get_obj_state_impl: setting s->olh_tag to 5qo5e8g404xb20tcvl3tpejtda5opato 2024-09-14T11:42:02.210 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:42:02.209+0000 7fba9de749c0 20 bucket_index_guard_olh_op(): olh_state.olh_tag=5qo5e8g404xb20tcvl3tpejtda5opato 2024-09-14T11:42:02.212 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:42:02.213+0000 7fba9de749c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.18.3.9 2024-09-14T11:42:02.213 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:42:02.213+0000 7fba9de749c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.18.3.9 2024-09-14T11:42:02.214 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:42:02.213+0000 7fba9de749c0 20 olh_log_entry: epoch=2 op=2 key=y[] 2024-09-14T11:42:02.214 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:42:02.213+0000 7fba9de749c0 20 olh_log_entry: epoch=2 op=3 key=y[tIbx1d7ZoDU6-yLnyjOPL-ma4CEIdUK] 2024-09-14T11:42:02.214 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:42:02.213+0000 7fba9de749c0 20 get_obj_state: octx=0x55561560e930 obj=myver:_:tIbx1d7ZoDU6-yLnyjOPL-ma4CEIdUK_y state=0x5556158eec58 s->prefetch_data=0 2024-09-14T11:42:02.215 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:42:02.213+0000 7fba9de749c0 10 manifest: total_size = 9 2024-09-14T11:42:02.215 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:42:02.213+0000 7fba9de749c0 20 get_obj_state: setting s->obj_tag to d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.11232592206336234831 2024-09-14T11:42:02.215 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:42:02.213+0000 7fba9de749c0 20 get_obj_state: octx=0x55561560e930 obj=myver:_:tIbx1d7ZoDU6-yLnyjOPL-ma4CEIdUK_y state=0x5556158eec58 s->prefetch_data=0 2024-09-14T11:42:02.215 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:42:02.213+0000 7fba9de749c0 20 prepare_atomic_modification: state is not atomic. state=0x5556158eec58 2024-09-14T11:42:02.215 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:42:02.213+0000 7fba9de749c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.18.3.9 2024-09-14T11:42:02.219 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:42:02.217+0000 7fb97a7fc640 20 handle_completion(): completion ok for obj=y[tIbx1d7ZoDU6-yLnyjOPL-ma4CEIdUK] 2024-09-14T11:42:02.221 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:42:02.221+0000 7fba9de749c0 20 get_obj_state: octx=0x55561560e930 obj=myver:y state=0x5556158c3118 s->prefetch_data=0 2024-09-14T11:42:02.221 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:42:02.221+0000 7fba9de749c0 20 bucket_index_guard_olh_op(): olh_state.olh_tag=5qo5e8g404xb20tcvl3tpejtda5opato 2024-09-14T11:42:02.226 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:42:02.225+0000 7fba9de749c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.18.3.9 2024-09-14T11:42:02.228 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:42:02.229+0000 7fba9de749c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.18.3.9 2024-09-14T11:42:02.228 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:42:02.229+0000 7fba9de749c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.18.3.9 2024-09-14T11:42:02.228 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:42:02.229+0000 7fba9de749c0 20 get_obj_state: octx=0x55561560e930 obj=myver:z state=0x5556158c3118 s->prefetch_data=0 2024-09-14T11:42:02.230 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:42:02.229+0000 7fba9de749c0 20 get_obj_state: setting s->obj_tag to 2ws4iurisw8kcdj0236u5bmem6aio9a7 2024-09-14T11:42:02.230 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:42:02.229+0000 7fba9de749c0 20 get_obj_state_impl: setting s->olh_tag to x3fyavyxlq95p0w60lbbu4jy315v1zfk 2024-09-14T11:42:02.230 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:42:02.229+0000 7fba9de749c0 20 bucket_index_guard_olh_op(): olh_state.olh_tag=x3fyavyxlq95p0w60lbbu4jy315v1zfk 2024-09-14T11:42:02.234 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:42:02.233+0000 7fba9de749c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.18.3.9 2024-09-14T11:42:02.236 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:42:02.233+0000 7fba9de749c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.18.3.9 2024-09-14T11:42:02.236 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:42:02.233+0000 7fba9de749c0 20 olh_log_entry: epoch=2 op=2 key=z[] 2024-09-14T11:42:02.236 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:42:02.233+0000 7fba9de749c0 20 olh_log_entry: epoch=2 op=3 key=z[1ZIHZB-h.K07WSOZmzqnKa96QMHAqAZ] 2024-09-14T11:42:02.236 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:42:02.233+0000 7fba9de749c0 20 get_obj_state: octx=0x55561560e930 obj=myver:_:1ZIHZB-h.K07WSOZmzqnKa96QMHAqAZ_z state=0x5556158efc68 s->prefetch_data=0 2024-09-14T11:42:02.236 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:42:02.237+0000 7fba9de749c0 10 manifest: total_size = 9 2024-09-14T11:42:02.236 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:42:02.237+0000 7fba9de749c0 20 get_obj_state: setting s->obj_tag to d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.2033784832307078634 2024-09-14T11:42:02.236 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:42:02.237+0000 7fba9de749c0 20 get_obj_state: octx=0x55561560e930 obj=myver:_:1ZIHZB-h.K07WSOZmzqnKa96QMHAqAZ_z state=0x5556158efc68 s->prefetch_data=0 2024-09-14T11:42:02.237 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:42:02.237+0000 7fba9de749c0 20 prepare_atomic_modification: state is not atomic. state=0x5556158efc68 2024-09-14T11:42:02.237 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:42:02.237+0000 7fba9de749c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.18.3.9 2024-09-14T11:42:02.241 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:42:02.241+0000 7fb97affd640 20 handle_completion(): completion ok for obj=z[1ZIHZB-h.K07WSOZmzqnKa96QMHAqAZ] 2024-09-14T11:42:02.243 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:42:02.241+0000 7fba9de749c0 20 get_obj_state: octx=0x55561560e930 obj=myver:z state=0x5556158c3118 s->prefetch_data=0 2024-09-14T11:42:02.243 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:42:02.241+0000 7fba9de749c0 20 bucket_index_guard_olh_op(): olh_state.olh_tag=x3fyavyxlq95p0w60lbbu4jy315v1zfk 2024-09-14T11:42:02.250 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:42:02.249+0000 7fba9de749c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.18.3.9 2024-09-14T11:42:02.251 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:42:02.249+0000 7fba9de749c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.18.3.9 2024-09-14T11:42:02.251 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:42:02.249+0000 7fba9de749c0 1 NOTICE: finished shard 9 (3 entries removed) 2024-09-14T11:42:02.251 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:42:02.249+0000 7fba9de749c0 1 NOTICE: finished all shards (3 entries removed) 2024-09-14T11:42:02.252 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:42:02.249+0000 7fb951fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:42:02.256 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:42:02.257+0000 7fba9de749c0 20 remove_watcher() i=0 2024-09-14T11:42:02.256 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:42:02.257+0000 7fba9de749c0 2 removed watcher, disabling cache 2024-09-14T11:42:02.259 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:42:02.257+0000 7fba9de749c0 20 remove_watcher() i=1 2024-09-14T11:42:02.261 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:42:02.261+0000 7fba9de749c0 20 remove_watcher() i=2 2024-09-14T11:42:02.263 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:42:02.261+0000 7fba9de749c0 20 remove_watcher() i=3 2024-09-14T11:42:02.265 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:42:02.265+0000 7fba9de749c0 20 remove_watcher() i=4 2024-09-14T11:42:02.266 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:42:02.265+0000 7fba9de749c0 20 remove_watcher() i=5 2024-09-14T11:42:02.267 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:42:02.265+0000 7fba9de749c0 20 remove_watcher() i=6 2024-09-14T11:42:02.268 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:42:02.269+0000 7fba9de749c0 20 remove_watcher() i=7 2024-09-14T11:42:02.285 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:42:02.285 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-14T11:42:02.340 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:42:02.340 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-14T11:42:02.565 INFO:tasks.workunit.client.0.smithi138.stderr:radosgw-admin bucket stats --bucket myver 2024-09-14T11:42:02.597 INFO:tasks.workunit.client.0.smithi138.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:42:02.598 INFO:tasks.workunit.client.0.smithi138.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:42:02.644 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:42:02.645+0000 7f8e5455e9c0 20 rados->read ofs=0 len=0 2024-09-14T11:42:02.646 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:42:02.645+0000 7f8e5455e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:42:02.646 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:42:02.645+0000 7f8e5455e9c0 20 realm 2024-09-14T11:42:02.646 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:42:02.645+0000 7f8e5455e9c0 20 rados->read ofs=0 len=0 2024-09-14T11:42:02.647 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:42:02.645+0000 7f8e5455e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:42:02.647 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:42:02.645+0000 7f8e5455e9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:42:02.647 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:42:02.645+0000 7f8e5455e9c0 20 rados->read ofs=0 len=0 2024-09-14T11:42:02.647 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:42:02.645+0000 7f8e5455e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:42:02.647 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:42:02.645+0000 7f8e5455e9c0 20 rados->read ofs=0 len=0 2024-09-14T11:42:02.648 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:42:02.649+0000 7f8e5455e9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:42:02.648 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:42:02.649+0000 7f8e5455e9c0 20 rados->read ofs=0 len=0 2024-09-14T11:42:02.649 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:42:02.649+0000 7f8e5455e9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:42:02.649 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:42:02.649+0000 7f8e5455e9c0 20 searching for the correct realm 2024-09-14T11:42:02.652 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:42:02.649+0000 7f8e52865640 0 -- 172.21.15.138:0/2662809458 >> [v2:172.21.15.154:6824/416768175,v1:172.21.15.154:6825/416768175] conn(0x7f8e4c109510 msgr2=0x7f8e4c108ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-14T11:42:02.865 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:42:02.865+0000 7f8e51863640 0 -- 172.21.15.138:0/2662809458 >> [v2:172.21.15.138:6816/326481658,v1:172.21.15.138:6817/326481658] conn(0x7f8e4c0cc6f0 msgr2=0x7f8e4c0fe3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-14T11:42:03.084 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:42:03.081+0000 7f8e5455e9c0 20 RGWRados::pool_iterate: got zone_info.d9e72d30-c60b-4d0d-9267-fdc36392d5ad 2024-09-14T11:42:03.084 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:42:03.081+0000 7f8e5455e9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:42:03.084 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:42:03.081+0000 7f8e5455e9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:42:03.084 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:42:03.081+0000 7f8e5455e9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:42:03.084 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:42:03.081+0000 7f8e5455e9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:42:03.084 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:42:03.081+0000 7f8e5455e9c0 20 RGWRados::pool_iterate: got zonegroup_info.65ab941b-da8c-4160-94fb-3672b069d44f 2024-09-14T11:42:03.084 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:42:03.081+0000 7f8e5455e9c0 20 rados->read ofs=0 len=0 2024-09-14T11:42:03.085 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:42:03.085+0000 7f8e5455e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:42:03.085 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:42:03.085+0000 7f8e5455e9c0 20 rados->read ofs=0 len=0 2024-09-14T11:42:03.085 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:42:03.085+0000 7f8e5455e9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:42:03.085 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:42:03.085+0000 7f8e5455e9c0 20 rados->read ofs=0 len=0 2024-09-14T11:42:03.087 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:42:03.085+0000 7f8e5455e9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:42:03.087 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:42:03.085+0000 7f8e5455e9c0 20 zone default found 2024-09-14T11:42:03.087 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:42:03.085+0000 7f8e5455e9c0 4 Realm: () 2024-09-14T11:42:03.087 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:42:03.085+0000 7f8e5455e9c0 4 ZoneGroup: default (65ab941b-da8c-4160-94fb-3672b069d44f) 2024-09-14T11:42:03.087 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:42:03.085+0000 7f8e5455e9c0 4 Zone: default (d9e72d30-c60b-4d0d-9267-fdc36392d5ad) 2024-09-14T11:42:03.087 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:42:03.085+0000 7f8e5455e9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:42:03.087 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:42:03.085+0000 7f8e5455e9c0 20 zonegroup default 2024-09-14T11:42:03.087 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:42:03.085+0000 7f8e5455e9c0 20 rados->read ofs=0 len=0 2024-09-14T11:42:03.088 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:42:03.085+0000 7f8e5455e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:42:03.088 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:42:03.085+0000 7f8e5455e9c0 20 rados->read ofs=0 len=0 2024-09-14T11:42:03.088 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:42:03.089+0000 7f8e5455e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:42:03.088 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:42:03.089+0000 7f8e5455e9c0 20 rados->read ofs=0 len=0 2024-09-14T11:42:03.089 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:42:03.089+0000 7f8e5455e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:42:03.089 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:42:03.089+0000 7f8e5455e9c0 20 started sync module instance, tier type = 2024-09-14T11:42:03.089 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:42:03.089+0000 7f8e5455e9c0 20 started zone id=d9e72d30-c60b-4d0d-9267-fdc36392d5ad (name=default) with tier type = 2024-09-14T11:42:03.115 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:42:03.113+0000 7f8e5455e9c0 20 add_watcher() i=0 2024-09-14T11:42:03.115 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:42:03.113+0000 7f8e5455e9c0 20 add_watcher() i=1 2024-09-14T11:42:03.115 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:42:03.113+0000 7f8e5455e9c0 20 add_watcher() i=2 2024-09-14T11:42:03.115 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:42:03.113+0000 7f8e5455e9c0 20 add_watcher() i=3 2024-09-14T11:42:03.115 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:42:03.113+0000 7f8e5455e9c0 20 add_watcher() i=4 2024-09-14T11:42:03.115 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:42:03.113+0000 7f8e5455e9c0 20 add_watcher() i=5 2024-09-14T11:42:03.115 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:42:03.113+0000 7f8e5455e9c0 20 add_watcher() i=6 2024-09-14T11:42:03.117 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:42:03.117+0000 7f8e5455e9c0 20 add_watcher() i=7 2024-09-14T11:42:03.117 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:42:03.117+0000 7f8e5455e9c0 2 all 8 watchers are set, enabling cache 2024-09-14T11:42:03.121 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:42:03.121+0000 7f8d08fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:42:03.122 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:42:03.121+0000 7f8e5455e9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:42:03.122 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:42:03.121+0000 7f8e5455e9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:42:03.122 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:42:03.121+0000 7f8e5455e9c0 5 note: GC not initialized 2024-09-14T11:42:03.123 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:42:03.121+0000 7f8c837fe640 20 reqs_thread_entry: start 2024-09-14T11:42:03.123 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:42:03.121+0000 7f8e5455e9c0 20 init_complete bucket index max shards: 11 2024-09-14T11:42:03.123 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:42:03.121+0000 7f8e5455e9c0 20 Filter name: none 2024-09-14T11:42:03.123 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:42:03.121+0000 7f8c817fa640 20 reqs_thread_entry: start 2024-09-14T11:42:03.123 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:42:03.121+0000 7f8e5455e9c0 20 rados->read ofs=0 len=0 2024-09-14T11:42:03.124 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:42:03.125+0000 7f8e5455e9c0 20 rados_obj.operate() r=0 bl.length=173 2024-09-14T11:42:03.124 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:42:03.125+0000 7f8e5455e9c0 20 rados->read ofs=0 len=0 2024-09-14T11:42:03.125 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:42:03.125+0000 7f8e5455e9c0 20 rados_obj.operate() r=0 bl.length=395 2024-09-14T11:42:03.125 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:42:03.125+0000 7f8e5455e9c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:42:03.125 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:42:03.125+0000 7f8e5455e9c0 20 rados->read ofs=0 len=0 2024-09-14T11:42:03.125 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:42:03.125+0000 7f8e5455e9c0 20 rados_obj.operate() r=0 bl.length=173 2024-09-14T11:42:03.125 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:42:03.125+0000 7f8e5455e9c0 20 rados->read ofs=0 len=0 2024-09-14T11:42:03.126 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:42:03.125+0000 7f8e5455e9c0 20 rados_obj.operate() r=0 bl.length=395 2024-09-14T11:42:03.126 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:42:03.125+0000 7f8e5455e9c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:42:03.130 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:42:03.129+0000 7f8d08fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:42:03.134 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:42:03.133+0000 7f8e5455e9c0 20 remove_watcher() i=0 2024-09-14T11:42:03.135 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:42:03.133+0000 7f8e5455e9c0 2 removed watcher, disabling cache 2024-09-14T11:42:03.136 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:42:03.137+0000 7f8e5455e9c0 20 remove_watcher() i=1 2024-09-14T11:42:03.139 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:42:03.137+0000 7f8e5455e9c0 20 remove_watcher() i=2 2024-09-14T11:42:03.141 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:42:03.141+0000 7f8e5455e9c0 20 remove_watcher() i=3 2024-09-14T11:42:03.144 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:42:03.145+0000 7f8e5455e9c0 20 remove_watcher() i=4 2024-09-14T11:42:03.145 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:42:03.145+0000 7f8e5455e9c0 20 remove_watcher() i=5 2024-09-14T11:42:03.147 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:42:03.145+0000 7f8e5455e9c0 20 remove_watcher() i=6 2024-09-14T11:42:03.148 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T11:42:03.149+0000 7f8e5455e9c0 20 remove_watcher() i=7 2024-09-14T11:42:03.162 INFO:tasks.workunit.client.0.smithi138.stderr:{'rgw.main': {'size': 0, 'size_actual': 0, 'size_utilized': 0, 'size_kb': 0, 'size_kb_actual': 0, 'size_kb_utilized': 0, 'num_objects': 0}} 2024-09-14T11:42:03.162 INFO:tasks.workunit.client.0.smithi138.stderr:Deleting bucket a-bucket 2024-09-14T11:42:03.163 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:42:03.163 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-14T11:42:03.191 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:42:03.191 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-14T11:42:03.338 INFO:tasks.workunit.client.0.smithi138.stderr:Deleting bucket myver 2024-09-14T11:42:03.340 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:42:03.340 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-14T11:42:03.480 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T11:42:03.480 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-14T11:42:03.941 INFO:tasks.workunit.client.0.smithi138.stderr:Completed resharding tests 2024-09-14T11:42:03.942 INFO:tasks.workunit.client.0.smithi138.stdout:Could not connect to the endpoint URL: "http://localhost:80/" 2024-09-14T11:42:03.942 INFO:tasks.workunit.client.0.smithi138.stdout:Could not connect to the endpoint URL: "http://localhost:8000/" 2024-09-14T11:42:03.942 INFO:tasks.workunit.client.0.smithi138.stdout:connected to https://localhost:443 2024-09-14T11:42:04.061 INFO:tasks.workunit.client.0.smithi138.stderr:+ deactivate 2024-09-14T11:42:04.062 INFO:tasks.workunit.client.0.smithi138.stderr:+ '[' -n /usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/usr/games:/usr/local/games:/snap/bin:/usr/sbin ']' 2024-09-14T11:42:04.062 INFO:tasks.workunit.client.0.smithi138.stderr:+ PATH=/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/usr/games:/usr/local/games:/snap/bin:/usr/sbin 2024-09-14T11:42:04.062 INFO:tasks.workunit.client.0.smithi138.stderr:+ export PATH 2024-09-14T11:42:04.062 INFO:tasks.workunit.client.0.smithi138.stderr:+ unset _OLD_VIRTUAL_PATH 2024-09-14T11:42:04.062 INFO:tasks.workunit.client.0.smithi138.stderr:+ '[' -n '' ']' 2024-09-14T11:42:04.062 INFO:tasks.workunit.client.0.smithi138.stderr:+ '[' -n /usr/bin/bash -o -n '' ']' 2024-09-14T11:42:04.062 INFO:tasks.workunit.client.0.smithi138.stderr:+ hash -r 2024-09-14T11:42:04.062 INFO:tasks.workunit.client.0.smithi138.stderr:+ '[' -n '' ']' 2024-09-14T11:42:04.062 INFO:tasks.workunit.client.0.smithi138.stderr:+ unset VIRTUAL_ENV 2024-09-14T11:42:04.062 INFO:tasks.workunit.client.0.smithi138.stderr:+ unset VIRTUAL_ENV_PROMPT 2024-09-14T11:42:04.063 INFO:tasks.workunit.client.0.smithi138.stdout:OK. 2024-09-14T11:42:04.063 INFO:tasks.workunit.client.0.smithi138.stderr:+ '[' '!' '' = nondestructive ']' 2024-09-14T11:42:04.064 INFO:tasks.workunit.client.0.smithi138.stderr:+ unset -f deactivate 2024-09-14T11:42:04.064 INFO:tasks.workunit.client.0.smithi138.stderr:+ echo OK. 2024-09-14T11:42:04.064 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-09-14T11:42:04.064 DEBUG:teuthology.orchestra.run.smithi138:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-09-14T11:42:04.118 INFO:tasks.workunit:Stopping ['rgw/run-reshard.sh'] on client.0... 2024-09-14T11:42:04.118 DEBUG:teuthology.orchestra.run.smithi138:> sudo rm -rf -- /home/ubuntu/cephtest/workunits.list.client.0 /home/ubuntu/cephtest/clone.client.0 2024-09-14T11:42:04.557 DEBUG:teuthology.parallel:result is None 2024-09-14T11:42:04.557 DEBUG:teuthology.orchestra.run.smithi138:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0 2024-09-14T11:42:04.568 INFO:tasks.workunit:Deleted dir /home/ubuntu/cephtest/mnt.0/client.0 2024-09-14T11:42:04.568 DEBUG:teuthology.orchestra.run.smithi138:> rmdir -- /home/ubuntu/cephtest/mnt.0 2024-09-14T11:42:04.616 INFO:tasks.workunit:Deleted artificial mount point /home/ubuntu/cephtest/mnt.0/client.0 2024-09-14T11:42:04.617 INFO:teuthology.run_tasks:Running task s3tests-java... 2024-09-14T11:42:04.632 DEBUG:tasks.s3tests_java:S3 Tests Java: __INIT__ 2024-09-14T11:42:04.633 DEBUG:tasks.s3tests_java:S3 Tests Java: SETUP 2024-09-14T11:42:04.633 INFO:tasks.s3tests_java:S3 Tests Java: Downloading test suite... 2024-09-14T11:42:04.633 DEBUG:teuthology.orchestra.run.smithi138:> git clone -b ceph-master https://github.com/ceph/java_s3tests.git /home/ubuntu/cephtest/s3-tests-java 2024-09-14T11:42:04.664 INFO:teuthology.orchestra.run.smithi138.stderr:Cloning into '/home/ubuntu/cephtest/s3-tests-java'... 2024-09-14T11:42:09.137 INFO:tasks.s3tests_java:S3 Tests Java: Installing required packages... 2024-09-14T11:42:09.137 DEBUG:teuthology.orchestra.run.smithi138:> /home/ubuntu/cephtest/s3-tests-java/bootstrap.sh 2024-09-14T11:42:09.222 INFO:teuthology.orchestra.run.smithi138.stderr:/home/ubuntu/cephtest/s3-tests-java/bootstrap.sh: missing required DEB packages. Installing via sudo. 2024-09-14T11:42:09.282 INFO:teuthology.orchestra.run.smithi138.stdout:Reading package lists... 2024-09-14T11:42:09.496 INFO:teuthology.orchestra.run.smithi138.stdout:Building dependency tree... 2024-09-14T11:42:09.497 INFO:teuthology.orchestra.run.smithi138.stdout:Reading state information... 2024-09-14T11:42:09.700 INFO:teuthology.orchestra.run.smithi138.stdout:The following packages were automatically installed and are no longer required: 2024-09-14T11:42:09.700 INFO:teuthology.orchestra.run.smithi138.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-09-14T11:42:09.700 INFO:teuthology.orchestra.run.smithi138.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-09-14T11:42:09.700 INFO:teuthology.orchestra.run.smithi138.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-09-14T11:42:09.700 INFO:teuthology.orchestra.run.smithi138.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2024-09-14T11:42:09.701 INFO:teuthology.orchestra.run.smithi138.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2024-09-14T11:42:09.701 INFO:teuthology.orchestra.run.smithi138.stdout:Use 'sudo apt autoremove' to remove them. 2024-09-14T11:42:09.702 INFO:teuthology.orchestra.run.smithi138.stdout:The following additional packages will be installed: 2024-09-14T11:42:09.702 INFO:teuthology.orchestra.run.smithi138.stdout: libgail-common libgail18 libgtk2.0-0 libgtk2.0-bin libgtk2.0-common 2024-09-14T11:42:09.702 INFO:teuthology.orchestra.run.smithi138.stdout: openjdk-8-jdk-headless openjdk-8-jre openjdk-8-jre-headless 2024-09-14T11:42:09.704 INFO:teuthology.orchestra.run.smithi138.stdout:Suggested packages: 2024-09-14T11:42:09.704 INFO:teuthology.orchestra.run.smithi138.stdout: gvfs openjdk-8-demo openjdk-8-source visualvm libnss-mdns fonts-nanum 2024-09-14T11:42:09.704 INFO:teuthology.orchestra.run.smithi138.stdout: fonts-ipafont-gothic fonts-ipafont-mincho fonts-wqy-microhei 2024-09-14T11:42:09.704 INFO:teuthology.orchestra.run.smithi138.stdout: fonts-wqy-zenhei fonts-indic 2024-09-14T11:42:09.739 INFO:teuthology.orchestra.run.smithi138.stdout:The following NEW packages will be installed: 2024-09-14T11:42:09.739 INFO:teuthology.orchestra.run.smithi138.stdout: libgail-common libgail18 libgtk2.0-0 libgtk2.0-bin libgtk2.0-common 2024-09-14T11:42:09.740 INFO:teuthology.orchestra.run.smithi138.stdout: openjdk-8-jdk openjdk-8-jdk-headless openjdk-8-jre openjdk-8-jre-headless 2024-09-14T11:42:09.811 INFO:teuthology.orchestra.run.smithi138.stdout:0 upgraded, 9 newly installed, 0 to remove and 331 not upgraded. 2024-09-14T11:42:09.811 INFO:teuthology.orchestra.run.smithi138.stdout:Need to get 46.0 MB of archives. 2024-09-14T11:42:09.811 INFO:teuthology.orchestra.run.smithi138.stdout:After this operation, 155 MB of additional disk space will be used. 2024-09-14T11:42:09.811 INFO:teuthology.orchestra.run.smithi138.stdout:Get:1 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libgtk2.0-common all 2.24.33-2ubuntu2.1 [125 kB] 2024-09-14T11:42:09.887 INFO:teuthology.orchestra.run.smithi138.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libgtk2.0-0 amd64 2.24.33-2ubuntu2.1 [2,038 kB] 2024-09-14T11:42:09.971 INFO:teuthology.orchestra.run.smithi138.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libgail18 amd64 2.24.33-2ubuntu2.1 [15.9 kB] 2024-09-14T11:42:09.971 INFO:teuthology.orchestra.run.smithi138.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libgail-common amd64 2.24.33-2ubuntu2.1 [132 kB] 2024-09-14T11:42:09.974 INFO:teuthology.orchestra.run.smithi138.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libgtk2.0-bin amd64 2.24.33-2ubuntu2.1 [7,936 B] 2024-09-14T11:42:09.975 INFO:teuthology.orchestra.run.smithi138.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 openjdk-8-jre-headless amd64 8u422-b05-1~22.04 [30.8 MB] 2024-09-14T11:42:10.416 INFO:teuthology.orchestra.run.smithi138.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 openjdk-8-jre amd64 8u422-b05-1~22.04 [75.5 kB] 2024-09-14T11:42:10.416 INFO:teuthology.orchestra.run.smithi138.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 openjdk-8-jdk-headless amd64 8u422-b05-1~22.04 [8,843 kB] 2024-09-14T11:42:10.503 INFO:teuthology.orchestra.run.smithi138.stdout:Get:9 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 openjdk-8-jdk amd64 8u422-b05-1~22.04 [4,012 kB] 2024-09-14T11:42:10.833 INFO:teuthology.orchestra.run.smithi138.stderr:debconf: unable to initialize frontend: Dialog 2024-09-14T11:42:10.833 INFO:teuthology.orchestra.run.smithi138.stderr:debconf: (Dialog frontend will not work on a dumb terminal, an emacs shell buffer, or without a controlling terminal.) 2024-09-14T11:42:10.833 INFO:teuthology.orchestra.run.smithi138.stderr:debconf: falling back to frontend: Readline 2024-09-14T11:42:10.843 INFO:teuthology.orchestra.run.smithi138.stderr:debconf: unable to initialize frontend: Readline 2024-09-14T11:42:10.843 INFO:teuthology.orchestra.run.smithi138.stderr:debconf: (This frontend requires a controlling tty.) 2024-09-14T11:42:10.843 INFO:teuthology.orchestra.run.smithi138.stderr:debconf: falling back to frontend: Teletype 2024-09-14T11:42:10.846 INFO:teuthology.orchestra.run.smithi138.stderr:dpkg-preconfigure: unable to re-open stdin: 2024-09-14T11:42:10.880 INFO:teuthology.orchestra.run.smithi138.stdout:Fetched 46.0 MB in 1s (58.5 MB/s) 2024-09-14T11:42:10.985 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package libgtk2.0-common. 2024-09-14T11:42:11.075 INFO:teuthology.orchestra.run.smithi138.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 177250 files and directories currently installed.) 2024-09-14T11:42:11.081 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../0-libgtk2.0-common_2.24.33-2ubuntu2.1_all.deb ... 2024-09-14T11:42:11.117 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking libgtk2.0-common (2.24.33-2ubuntu2.1) ... 2024-09-14T11:42:11.521 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package libgtk2.0-0:amd64. 2024-09-14T11:42:11.549 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../1-libgtk2.0-0_2.24.33-2ubuntu2.1_amd64.deb ... 2024-09-14T11:42:11.640 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking libgtk2.0-0:amd64 (2.24.33-2ubuntu2.1) ... 2024-09-14T11:42:12.067 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package libgail18:amd64. 2024-09-14T11:42:12.095 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../2-libgail18_2.24.33-2ubuntu2.1_amd64.deb ... 2024-09-14T11:42:12.133 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking libgail18:amd64 (2.24.33-2ubuntu2.1) ... 2024-09-14T11:42:12.386 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package libgail-common:amd64. 2024-09-14T11:42:12.402 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../3-libgail-common_2.24.33-2ubuntu2.1_amd64.deb ... 2024-09-14T11:42:12.444 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking libgail-common:amd64 (2.24.33-2ubuntu2.1) ... 2024-09-14T11:42:12.730 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package libgtk2.0-bin. 2024-09-14T11:42:12.747 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../4-libgtk2.0-bin_2.24.33-2ubuntu2.1_amd64.deb ... 2024-09-14T11:42:12.788 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking libgtk2.0-bin (2.24.33-2ubuntu2.1) ... 2024-09-14T11:42:13.150 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package openjdk-8-jre-headless:amd64. 2024-09-14T11:42:13.179 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../5-openjdk-8-jre-headless_8u422-b05-1~22.04_amd64.deb ... 2024-09-14T11:42:13.212 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking openjdk-8-jre-headless:amd64 (8u422-b05-1~22.04) ... 2024-09-14T11:42:14.847 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package openjdk-8-jre:amd64. 2024-09-14T11:42:14.875 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../6-openjdk-8-jre_8u422-b05-1~22.04_amd64.deb ... 2024-09-14T11:42:14.925 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking openjdk-8-jre:amd64 (8u422-b05-1~22.04) ... 2024-09-14T11:42:15.402 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package openjdk-8-jdk-headless:amd64. 2024-09-14T11:42:15.430 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../7-openjdk-8-jdk-headless_8u422-b05-1~22.04_amd64.deb ... 2024-09-14T11:42:15.480 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking openjdk-8-jdk-headless:amd64 (8u422-b05-1~22.04) ... 2024-09-14T11:42:16.233 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package openjdk-8-jdk:amd64. 2024-09-14T11:42:16.262 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../8-openjdk-8-jdk_8u422-b05-1~22.04_amd64.deb ... 2024-09-14T11:42:16.303 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking openjdk-8-jdk:amd64 (8u422-b05-1~22.04) ... 2024-09-14T11:42:16.654 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up openjdk-8-jre-headless:amd64 (8u422-b05-1~22.04) ... 2024-09-14T11:42:17.821 INFO:teuthology.orchestra.run.smithi138.stdout:update-alternatives: using /usr/lib/jvm/java-8-openjdk-amd64/jre/bin/orbd to provide /usr/bin/orbd (orbd) in auto mode 2024-09-14T11:42:17.845 INFO:teuthology.orchestra.run.smithi138.stdout:update-alternatives: using /usr/lib/jvm/java-8-openjdk-amd64/jre/bin/servertool to provide /usr/bin/servertool (servertool) in auto mode 2024-09-14T11:42:17.870 INFO:teuthology.orchestra.run.smithi138.stdout:update-alternatives: using /usr/lib/jvm/java-8-openjdk-amd64/jre/bin/tnameserv to provide /usr/bin/tnameserv (tnameserv) in auto mode 2024-09-14T11:42:18.237 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up libgtk2.0-common (2.24.33-2ubuntu2.1) ... 2024-09-14T11:42:18.405 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up libgtk2.0-0:amd64 (2.24.33-2ubuntu2.1) ... 2024-09-14T11:42:18.791 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up openjdk-8-jre:amd64 (8u422-b05-1~22.04) ... 2024-09-14T11:42:18.892 INFO:teuthology.orchestra.run.smithi138.stdout:update-alternatives: using /usr/lib/jvm/java-8-openjdk-amd64/jre/bin/policytool to provide /usr/bin/policytool (policytool) in auto mode 2024-09-14T11:42:18.959 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up openjdk-8-jdk-headless:amd64 (8u422-b05-1~22.04) ... 2024-09-14T11:42:19.051 INFO:teuthology.orchestra.run.smithi138.stdout:update-alternatives: using /usr/lib/jvm/java-8-openjdk-amd64/bin/clhsdb to provide /usr/bin/clhsdb (clhsdb) in auto mode 2024-09-14T11:42:19.081 INFO:teuthology.orchestra.run.smithi138.stdout:update-alternatives: using /usr/lib/jvm/java-8-openjdk-amd64/bin/extcheck to provide /usr/bin/extcheck (extcheck) in auto mode 2024-09-14T11:42:19.106 INFO:teuthology.orchestra.run.smithi138.stdout:update-alternatives: using /usr/lib/jvm/java-8-openjdk-amd64/bin/hsdb to provide /usr/bin/hsdb (hsdb) in auto mode 2024-09-14T11:42:19.141 INFO:teuthology.orchestra.run.smithi138.stdout:update-alternatives: using /usr/lib/jvm/java-8-openjdk-amd64/bin/idlj to provide /usr/bin/idlj (idlj) in auto mode 2024-09-14T11:42:19.266 INFO:teuthology.orchestra.run.smithi138.stdout:update-alternatives: using /usr/lib/jvm/java-8-openjdk-amd64/bin/javah to provide /usr/bin/javah (javah) in auto mode 2024-09-14T11:42:19.419 INFO:teuthology.orchestra.run.smithi138.stdout:update-alternatives: using /usr/lib/jvm/java-8-openjdk-amd64/bin/jhat to provide /usr/bin/jhat (jhat) in auto mode 2024-09-14T11:42:19.555 INFO:teuthology.orchestra.run.smithi138.stdout:update-alternatives: using /usr/lib/jvm/java-8-openjdk-amd64/bin/jsadebugd to provide /usr/bin/jsadebugd (jsadebugd) in auto mode 2024-09-14T11:42:19.658 INFO:teuthology.orchestra.run.smithi138.stdout:update-alternatives: using /usr/lib/jvm/java-8-openjdk-amd64/bin/native2ascii to provide /usr/bin/native2ascii (native2ascii) in auto mode 2024-09-14T11:42:19.710 INFO:teuthology.orchestra.run.smithi138.stdout:update-alternatives: using /usr/lib/jvm/java-8-openjdk-amd64/bin/schemagen to provide /usr/bin/schemagen (schemagen) in auto mode 2024-09-14T11:42:19.767 INFO:teuthology.orchestra.run.smithi138.stdout:update-alternatives: using /usr/lib/jvm/java-8-openjdk-amd64/bin/wsgen to provide /usr/bin/wsgen (wsgen) in auto mode 2024-09-14T11:42:19.793 INFO:teuthology.orchestra.run.smithi138.stdout:update-alternatives: using /usr/lib/jvm/java-8-openjdk-amd64/bin/wsimport to provide /usr/bin/wsimport (wsimport) in auto mode 2024-09-14T11:42:19.819 INFO:teuthology.orchestra.run.smithi138.stdout:update-alternatives: using /usr/lib/jvm/java-8-openjdk-amd64/bin/xjc to provide /usr/bin/xjc (xjc) in auto mode 2024-09-14T11:42:19.884 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up libgail18:amd64 (2.24.33-2ubuntu2.1) ... 2024-09-14T11:42:20.010 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up libgtk2.0-bin (2.24.33-2ubuntu2.1) ... 2024-09-14T11:42:20.136 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up openjdk-8-jdk:amd64 (8u422-b05-1~22.04) ... 2024-09-14T11:42:20.228 INFO:teuthology.orchestra.run.smithi138.stdout:update-alternatives: using /usr/lib/jvm/java-8-openjdk-amd64/bin/appletviewer to provide /usr/bin/appletviewer (appletviewer) in auto mode 2024-09-14T11:42:20.322 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up libgail-common:amd64 (2.24.33-2ubuntu2.1) ... 2024-09-14T11:42:20.424 INFO:teuthology.orchestra.run.smithi138.stdout:Processing triggers for man-db (2.10.2-1) ... 2024-09-14T11:42:21.503 INFO:teuthology.orchestra.run.smithi138.stdout:Processing triggers for mailcap (3.70+nmu1ubuntu1) ... 2024-09-14T11:42:21.612 INFO:teuthology.orchestra.run.smithi138.stdout:Processing triggers for hicolor-icon-theme (0.17-2) ... 2024-09-14T11:42:21.897 INFO:teuthology.orchestra.run.smithi138.stdout:Processing triggers for libc-bin (2.35-0ubuntu3.1) ... 2024-09-14T11:42:22.357 INFO:teuthology.orchestra.run.smithi138.stdout: Gradle will be installed under /opt/gradle 2024-09-14T11:42:22.380 INFO:teuthology.orchestra.run.smithi138.stderr:--2024-09-14 11:42:22-- https://services.gradle.org/distributions/gradle-6.0.1-bin.zip 2024-09-14T11:42:22.383 INFO:teuthology.orchestra.run.smithi138.stderr:Resolving services.gradle.org (services.gradle.org)... 104.16.73.101, 104.16.72.101, 2606:4700::6810:4965, ... 2024-09-14T11:42:22.396 INFO:teuthology.orchestra.run.smithi138.stderr:Connecting to services.gradle.org (services.gradle.org)|104.16.73.101|:443... connected. 2024-09-14T11:42:22.451 INFO:teuthology.orchestra.run.smithi138.stderr:HTTP request sent, awaiting response... 301 Moved Permanently 2024-09-14T11:42:22.452 INFO:teuthology.orchestra.run.smithi138.stderr:Location: https://github.com/gradle/gradle-distributions/releases/download/v6.0.1/gradle-6.0.1-bin.zip [following] 2024-09-14T11:42:22.452 INFO:teuthology.orchestra.run.smithi138.stderr:--2024-09-14 11:42:22-- https://github.com/gradle/gradle-distributions/releases/download/v6.0.1/gradle-6.0.1-bin.zip 2024-09-14T11:42:22.453 INFO:teuthology.orchestra.run.smithi138.stderr:Resolving github.com (github.com)... 140.82.113.4 2024-09-14T11:42:22.463 INFO:teuthology.orchestra.run.smithi138.stderr:Connecting to github.com (github.com)|140.82.113.4|:443... connected. 2024-09-14T11:42:22.501 INFO:teuthology.orchestra.run.smithi138.stderr:HTTP request sent, awaiting response... 302 Found 2024-09-14T11:42:22.501 INFO:teuthology.orchestra.run.smithi138.stderr:Location: https://objects.githubusercontent.com/github-production-release-asset-2e65be/696192900/8f418ba1-c336-448c-95c6-5180382113cb?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=releaseassetproduction%2F20240914%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20240914T114152Z&X-Amz-Expires=300&X-Amz-Signature=2645e71f6072cd98b11a18293cd2fa483754dd597f0a1b85dd24e0fc9ec38f8b&X-Amz-SignedHeaders=host&actor_id=0&key_id=0&repo_id=696192900&response-content-disposition=attachment%3B%20filename%3Dgradle-6.0.1-bin.zip&response-content-type=application%2Foctet-stream [following] 2024-09-14T11:42:22.501 INFO:teuthology.orchestra.run.smithi138.stderr:--2024-09-14 11:42:22-- https://objects.githubusercontent.com/github-production-release-asset-2e65be/696192900/8f418ba1-c336-448c-95c6-5180382113cb?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=releaseassetproduction%2F20240914%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20240914T114152Z&X-Amz-Expires=300&X-Amz-Signature=2645e71f6072cd98b11a18293cd2fa483754dd597f0a1b85dd24e0fc9ec38f8b&X-Amz-SignedHeaders=host&actor_id=0&key_id=0&repo_id=696192900&response-content-disposition=attachment%3B%20filename%3Dgradle-6.0.1-bin.zip&response-content-type=application%2Foctet-stream 2024-09-14T11:42:22.504 INFO:teuthology.orchestra.run.smithi138.stderr:Resolving objects.githubusercontent.com (objects.githubusercontent.com)... 185.199.110.133, 185.199.109.133, 185.199.108.133, ... 2024-09-14T11:42:22.516 INFO:teuthology.orchestra.run.smithi138.stderr:Connecting to objects.githubusercontent.com (objects.githubusercontent.com)|185.199.110.133|:443... connected. 2024-09-14T11:42:22.589 INFO:teuthology.orchestra.run.smithi138.stderr:HTTP request sent, awaiting response... 200 OK 2024-09-14T11:42:22.589 INFO:teuthology.orchestra.run.smithi138.stderr:Length: 95129672 (91M) [application/octet-stream] 2024-09-14T11:42:22.589 INFO:teuthology.orchestra.run.smithi138.stderr:Saving to: 'gradle-6.0.1-bin.zip' 2024-09-14T11:42:22.589 INFO:teuthology.orchestra.run.smithi138.stderr: 2024-09-14T11:42:22.601 INFO:teuthology.orchestra.run.smithi138.stderr: 0K .......... .......... .......... .......... .......... 0% 3.94M 23s 2024-09-14T11:42:22.612 INFO:teuthology.orchestra.run.smithi138.stderr: 50K .......... .......... .......... .......... .......... 0% 4.26M 22s 2024-09-14T11:42:22.615 INFO:teuthology.orchestra.run.smithi138.stderr: 100K .......... .......... .......... .......... .......... 0% 16.2M 17s 2024-09-14T11:42:22.618 INFO:teuthology.orchestra.run.smithi138.stderr: 150K .......... .......... .......... .......... .......... 0% 19.0M 14s 2024-09-14T11:42:22.624 INFO:teuthology.orchestra.run.smithi138.stderr: 200K .......... .......... .......... .......... .......... 0% 8.15M 13s 2024-09-14T11:42:22.625 INFO:teuthology.orchestra.run.smithi138.stderr: 250K .......... .......... .......... .......... .......... 0% 38.7M 11s 2024-09-14T11:42:22.627 INFO:teuthology.orchestra.run.smithi138.stderr: 300K .......... .......... .......... .......... .......... 0% 26.1M 10s 2024-09-14T11:42:22.629 INFO:teuthology.orchestra.run.smithi138.stderr: 350K .......... .......... .......... .......... .......... 0% 27.8M 9s 2024-09-14T11:42:22.630 INFO:teuthology.orchestra.run.smithi138.stderr: 400K .......... .......... .......... .......... .......... 0% 41.3M 9s 2024-09-14T11:42:22.636 INFO:teuthology.orchestra.run.smithi138.stderr: 450K .......... .......... .......... .......... .......... 0% 9.39M 9s 2024-09-14T11:42:22.636 INFO:teuthology.orchestra.run.smithi138.stderr: 500K .......... .......... .......... .......... .......... 0% 105M 8s 2024-09-14T11:42:22.638 INFO:teuthology.orchestra.run.smithi138.stderr: 550K .......... .......... .......... .......... .......... 0% 37.2M 7s 2024-09-14T11:42:22.638 INFO:teuthology.orchestra.run.smithi138.stderr: 600K .......... .......... .......... .......... .......... 0% 53.3M 7s 2024-09-14T11:42:22.641 INFO:teuthology.orchestra.run.smithi138.stderr: 650K .......... .......... .......... .......... .......... 0% 61.2M 7s 2024-09-14T11:42:22.641 INFO:teuthology.orchestra.run.smithi138.stderr: 700K .......... .......... .......... .......... .......... 0% 119M 6s 2024-09-14T11:42:22.641 INFO:teuthology.orchestra.run.smithi138.stderr: 750K .......... .......... .......... .......... .......... 0% 72.3M 6s 2024-09-14T11:42:22.641 INFO:teuthology.orchestra.run.smithi138.stderr: 800K .......... .......... .......... .......... .......... 0% 47.1M 6s 2024-09-14T11:42:22.643 INFO:teuthology.orchestra.run.smithi138.stderr: 850K .......... .......... .......... .......... .......... 0% 50.7M 5s 2024-09-14T11:42:22.643 INFO:teuthology.orchestra.run.smithi138.stderr: 900K .......... .......... .......... .......... .......... 1% 136M 5s 2024-09-14T11:42:22.643 INFO:teuthology.orchestra.run.smithi138.stderr: 950K .......... .......... .......... .......... .......... 1% 137M 5s 2024-09-14T11:42:23.763 INFO:teuthology.orchestra.run.smithi138.stderr: 1000K .......... .......... .......... .......... .......... 1% 10.6M 5s 2024-09-14T11:42:23.763 INFO:teuthology.orchestra.run.smithi138.stderr: 1050K .......... .......... .......... .......... .......... 1% 144M 5s 2024-09-14T11:42:23.763 INFO:teuthology.orchestra.run.smithi138.stderr: 1100K .......... .......... .......... .......... .......... 1% 48.2M 5s 2024-09-14T11:42:23.763 INFO:teuthology.orchestra.run.smithi138.stderr: 1150K .......... .......... .......... .......... .......... 1% 146M 5s 2024-09-14T11:42:23.763 INFO:teuthology.orchestra.run.smithi138.stderr: 1200K .......... .......... .......... .......... .......... 1% 133M 4s 2024-09-14T11:42:23.763 INFO:teuthology.orchestra.run.smithi138.stderr: 1250K .......... .......... .......... .......... .......... 1% 131M 4s 2024-09-14T11:42:23.763 INFO:teuthology.orchestra.run.smithi138.stderr: 1300K .......... .......... .......... .......... .......... 1% 155M 4s 2024-09-14T11:42:23.763 INFO:teuthology.orchestra.run.smithi138.stderr: 1350K .......... .......... .......... .......... .......... 1% 71.5M 4s 2024-09-14T11:42:23.763 INFO:teuthology.orchestra.run.smithi138.stderr: 1400K .......... .......... .......... .......... .......... 1% 125M 4s 2024-09-14T11:42:23.764 INFO:teuthology.orchestra.run.smithi138.stderr: 1450K .......... .......... .......... .......... .......... 1% 150M 4s 2024-09-14T11:42:23.764 INFO:teuthology.orchestra.run.smithi138.stderr: 1500K .......... .......... .......... .......... .......... 1% 151M 4s 2024-09-14T11:42:23.764 INFO:teuthology.orchestra.run.smithi138.stderr: 1550K .......... .......... .......... .......... .......... 1% 151M 4s 2024-09-14T11:42:23.764 INFO:teuthology.orchestra.run.smithi138.stderr: 1600K .......... .......... .......... .......... .......... 1% 140M 4s 2024-09-14T11:42:23.764 INFO:teuthology.orchestra.run.smithi138.stderr: 1650K .......... .......... .......... .......... .......... 1% 122M 3s 2024-09-14T11:42:23.764 INFO:teuthology.orchestra.run.smithi138.stderr: 1700K .......... .......... .......... .......... .......... 1% 154M 3s 2024-09-14T11:42:23.764 INFO:teuthology.orchestra.run.smithi138.stderr: 1750K .......... .......... .......... .......... .......... 1% 113M 3s 2024-09-14T11:42:23.764 INFO:teuthology.orchestra.run.smithi138.stderr: 1800K .......... .......... .......... .......... .......... 1% 155M 3s 2024-09-14T11:42:23.764 INFO:teuthology.orchestra.run.smithi138.stderr: 1850K .......... .......... .......... .......... .......... 2% 140M 3s 2024-09-14T11:42:23.764 INFO:teuthology.orchestra.run.smithi138.stderr: 1900K .......... .......... .......... .......... .......... 2% 151M 3s 2024-09-14T11:42:23.764 INFO:teuthology.orchestra.run.smithi138.stderr: 1950K .......... .......... .......... .......... .......... 2% 154M 3s 2024-09-14T11:42:23.764 INFO:teuthology.orchestra.run.smithi138.stderr: 2000K .......... .......... .......... .......... .......... 2% 12.6M 3s 2024-09-14T11:42:23.765 INFO:teuthology.orchestra.run.smithi138.stderr: 2050K .......... .......... .......... .......... .......... 2% 118M 3s 2024-09-14T11:42:23.765 INFO:teuthology.orchestra.run.smithi138.stderr: 2100K .......... .......... .......... .......... .......... 2% 124M 3s 2024-09-14T11:42:23.765 INFO:teuthology.orchestra.run.smithi138.stderr: 2150K .......... .......... .......... .......... .......... 2% 147M 3s 2024-09-14T11:42:23.765 INFO:teuthology.orchestra.run.smithi138.stderr: 2200K .......... .......... .......... .......... .......... 2% 145M 3s 2024-09-14T11:42:23.765 INFO:teuthology.orchestra.run.smithi138.stderr: 2250K .......... .......... .......... .......... .......... 2% 127M 3s 2024-09-14T11:42:23.765 INFO:teuthology.orchestra.run.smithi138.stderr: 2300K .......... .......... .......... .......... .......... 2% 140M 3s 2024-09-14T11:42:23.765 INFO:teuthology.orchestra.run.smithi138.stderr: 2350K .......... .......... .......... .......... .......... 2% 122M 3s 2024-09-14T11:42:23.765 INFO:teuthology.orchestra.run.smithi138.stderr: 2400K .......... .......... .......... .......... .......... 2% 143M 3s 2024-09-14T11:42:23.765 INFO:teuthology.orchestra.run.smithi138.stderr: 2450K .......... .......... .......... .......... .......... 2% 144M 3s 2024-09-14T11:42:23.765 INFO:teuthology.orchestra.run.smithi138.stderr: 2500K .......... .......... .......... .......... .......... 2% 151M 3s 2024-09-14T11:42:23.765 INFO:teuthology.orchestra.run.smithi138.stderr: 2550K .......... .......... .......... .......... .......... 2% 129M 3s 2024-09-14T11:42:23.765 INFO:teuthology.orchestra.run.smithi138.stderr: 2600K .......... .......... .......... .......... .......... 2% 149M 3s 2024-09-14T11:42:23.765 INFO:teuthology.orchestra.run.smithi138.stderr: 2650K .......... .......... .......... .......... .......... 2% 147M 2s 2024-09-14T11:42:23.765 INFO:teuthology.orchestra.run.smithi138.stderr: 2700K .......... .......... .......... .......... .......... 2% 142M 2s 2024-09-14T11:42:23.766 INFO:teuthology.orchestra.run.smithi138.stderr: 2750K .......... .......... .......... .......... .......... 3% 121M 2s 2024-09-14T11:42:23.766 INFO:teuthology.orchestra.run.smithi138.stderr: 2800K .......... .......... .......... .......... .......... 3% 120M 2s 2024-09-14T11:42:23.766 INFO:teuthology.orchestra.run.smithi138.stderr: 2850K .......... .......... .......... .......... .......... 3% 148M 2s 2024-09-14T11:42:23.766 INFO:teuthology.orchestra.run.smithi138.stderr: 2900K .......... .......... .......... .......... .......... 3% 141M 2s 2024-09-14T11:42:23.766 INFO:teuthology.orchestra.run.smithi138.stderr: 2950K .......... .......... .......... .......... .......... 3% 143M 2s 2024-09-14T11:42:23.766 INFO:teuthology.orchestra.run.smithi138.stderr: 3000K .......... .......... .......... .......... .......... 3% 119M 2s 2024-09-14T11:42:23.766 INFO:teuthology.orchestra.run.smithi138.stderr: 3050K .......... .......... .......... .......... .......... 3% 143M 2s 2024-09-14T11:42:23.766 INFO:teuthology.orchestra.run.smithi138.stderr: 3100K .......... .......... .......... .......... .......... 3% 151M 2s 2024-09-14T11:42:23.766 INFO:teuthology.orchestra.run.smithi138.stderr: 3150K .......... .......... .......... .......... .......... 3% 154M 2s 2024-09-14T11:42:23.766 INFO:teuthology.orchestra.run.smithi138.stderr: 3200K .......... .......... .......... .......... .......... 3% 139M 2s 2024-09-14T11:42:23.766 INFO:teuthology.orchestra.run.smithi138.stderr: 3250K .......... .......... .......... .......... .......... 3% 152M 2s 2024-09-14T11:42:23.766 INFO:teuthology.orchestra.run.smithi138.stderr: 3300K .......... .......... .......... .......... .......... 3% 139M 2s 2024-09-14T11:42:23.767 INFO:teuthology.orchestra.run.smithi138.stderr: 3350K .......... .......... .......... .......... .......... 3% 150M 2s 2024-09-14T11:42:23.767 INFO:teuthology.orchestra.run.smithi138.stderr: 3400K .......... .......... .......... .......... .......... 3% 149M 2s 2024-09-14T11:42:23.767 INFO:teuthology.orchestra.run.smithi138.stderr: 3450K .......... .......... .......... .......... .......... 3% 155M 2s 2024-09-14T11:42:23.767 INFO:teuthology.orchestra.run.smithi138.stderr: 3500K .......... .......... .......... .......... .......... 3% 138M 2s 2024-09-14T11:42:23.767 INFO:teuthology.orchestra.run.smithi138.stderr: 3550K .......... .......... .......... .......... .......... 3% 151M 2s 2024-09-14T11:42:23.767 INFO:teuthology.orchestra.run.smithi138.stderr: 3600K .......... .......... .......... .......... .......... 3% 153M 2s 2024-09-14T11:42:23.767 INFO:teuthology.orchestra.run.smithi138.stderr: 3650K .......... .......... .......... .......... .......... 3% 153M 2s 2024-09-14T11:42:23.767 INFO:teuthology.orchestra.run.smithi138.stderr: 3700K .......... .......... .......... .......... .......... 4% 112M 2s 2024-09-14T11:42:23.767 INFO:teuthology.orchestra.run.smithi138.stderr: 3750K .......... .......... .......... .......... .......... 4% 146M 2s 2024-09-14T11:42:23.767 INFO:teuthology.orchestra.run.smithi138.stderr: 3800K .......... .......... .......... .......... .......... 4% 148M 2s 2024-09-14T11:42:23.767 INFO:teuthology.orchestra.run.smithi138.stderr: 3850K .......... .......... .......... .......... .......... 4% 152M 2s 2024-09-14T11:42:23.767 INFO:teuthology.orchestra.run.smithi138.stderr: 3900K .......... .......... .......... .......... .......... 4% 145M 2s 2024-09-14T11:42:23.768 INFO:teuthology.orchestra.run.smithi138.stderr: 3950K .......... .......... .......... .......... .......... 4% 123M 2s 2024-09-14T11:42:23.768 INFO:teuthology.orchestra.run.smithi138.stderr: 4000K .......... .......... .......... .......... .......... 4% 150M 2s 2024-09-14T11:42:23.768 INFO:teuthology.orchestra.run.smithi138.stderr: 4050K .......... .......... .......... .......... .......... 4% 127M 2s 2024-09-14T11:42:23.768 INFO:teuthology.orchestra.run.smithi138.stderr: 4100K .......... .......... .......... .......... .......... 4% 121M 2s 2024-09-14T11:42:23.768 INFO:teuthology.orchestra.run.smithi138.stderr: 4150K .......... .......... .......... .......... .......... 4% 146M 2s 2024-09-14T11:42:23.768 INFO:teuthology.orchestra.run.smithi138.stderr: 4200K .......... .......... .......... .......... .......... 4% 120M 2s 2024-09-14T11:42:23.768 INFO:teuthology.orchestra.run.smithi138.stderr: 4250K .......... .......... .......... .......... .......... 4% 126M 2s 2024-09-14T11:42:23.768 INFO:teuthology.orchestra.run.smithi138.stderr: 4300K .......... .......... .......... .......... .......... 4% 143M 2s 2024-09-14T11:42:23.768 INFO:teuthology.orchestra.run.smithi138.stderr: 4350K .......... .......... .......... .......... .......... 4% 139M 2s 2024-09-14T11:42:23.768 INFO:teuthology.orchestra.run.smithi138.stderr: 4400K .......... .......... .......... .......... .......... 4% 155M 2s 2024-09-14T11:42:23.768 INFO:teuthology.orchestra.run.smithi138.stderr: 4450K .......... .......... .......... .......... .......... 4% 148M 2s 2024-09-14T11:42:23.768 INFO:teuthology.orchestra.run.smithi138.stderr: 4500K .......... .......... .......... .......... .......... 4% 130M 2s 2024-09-14T11:42:23.768 INFO:teuthology.orchestra.run.smithi138.stderr: 4550K .......... .......... .......... .......... .......... 4% 148M 2s 2024-09-14T11:42:23.769 INFO:teuthology.orchestra.run.smithi138.stderr: 4600K .......... .......... .......... .......... .......... 5% 137M 2s 2024-09-14T11:42:23.769 INFO:teuthology.orchestra.run.smithi138.stderr: 4650K .......... .......... .......... .......... .......... 5% 130M 2s 2024-09-14T11:42:23.769 INFO:teuthology.orchestra.run.smithi138.stderr: 4700K .......... .......... .......... .......... .......... 5% 141M 2s 2024-09-14T11:42:23.769 INFO:teuthology.orchestra.run.smithi138.stderr: 4750K .......... .......... .......... .......... .......... 5% 152M 2s 2024-09-14T11:42:23.769 INFO:teuthology.orchestra.run.smithi138.stderr: 4800K .......... .......... .......... .......... .......... 5% 151M 2s 2024-09-14T11:42:23.769 INFO:teuthology.orchestra.run.smithi138.stderr: 4850K .......... .......... .......... .......... .......... 5% 137M 2s 2024-09-14T11:42:23.769 INFO:teuthology.orchestra.run.smithi138.stderr: 4900K .......... .......... .......... .......... .......... 5% 138M 2s 2024-09-14T11:42:23.769 INFO:teuthology.orchestra.run.smithi138.stderr: 4950K .......... .......... .......... .......... .......... 5% 154M 2s 2024-09-14T11:42:23.769 INFO:teuthology.orchestra.run.smithi138.stderr: 5000K .......... .......... .......... .......... .......... 5% 151M 2s 2024-09-14T11:42:23.769 INFO:teuthology.orchestra.run.smithi138.stderr: 5050K .......... .......... .......... .......... .......... 5% 153M 2s 2024-09-14T11:42:23.769 INFO:teuthology.orchestra.run.smithi138.stderr: 5100K .......... .......... .......... .......... .......... 5% 129M 2s 2024-09-14T11:42:23.769 INFO:teuthology.orchestra.run.smithi138.stderr: 5150K .......... .......... .......... .......... .......... 5% 139M 2s 2024-09-14T11:42:23.769 INFO:teuthology.orchestra.run.smithi138.stderr: 5200K .......... .......... .......... .......... .......... 5% 156M 2s 2024-09-14T11:42:23.770 INFO:teuthology.orchestra.run.smithi138.stderr: 5250K .......... .......... .......... .......... .......... 5% 155M 2s 2024-09-14T11:42:23.770 INFO:teuthology.orchestra.run.smithi138.stderr: 5300K .......... .......... .......... .......... .......... 5% 155M 2s 2024-09-14T11:42:23.770 INFO:teuthology.orchestra.run.smithi138.stderr: 5350K .......... .......... .......... .......... .......... 5% 128M 2s 2024-09-14T11:42:23.770 INFO:teuthology.orchestra.run.smithi138.stderr: 5400K .......... .......... .......... .......... .......... 5% 125M 2s 2024-09-14T11:42:23.770 INFO:teuthology.orchestra.run.smithi138.stderr: 5450K .......... .......... .......... .......... .......... 5% 150M 1s 2024-09-14T11:42:23.770 INFO:teuthology.orchestra.run.smithi138.stderr: 5500K .......... .......... .......... .......... .......... 5% 148M 1s 2024-09-14T11:42:23.770 INFO:teuthology.orchestra.run.smithi138.stderr: 5550K .......... .......... .......... .......... .......... 6% 153M 1s 2024-09-14T11:42:23.770 INFO:teuthology.orchestra.run.smithi138.stderr: 5600K .......... .......... .......... .......... .......... 6% 130M 1s 2024-09-14T11:42:23.770 INFO:teuthology.orchestra.run.smithi138.stderr: 5650K .......... .......... .......... .......... .......... 6% 139M 1s 2024-09-14T11:42:23.770 INFO:teuthology.orchestra.run.smithi138.stderr: 5700K .......... .......... .......... .......... .......... 6% 138M 1s 2024-09-14T11:42:23.770 INFO:teuthology.orchestra.run.smithi138.stderr: 5750K .......... .......... .......... .......... .......... 6% 141M 1s 2024-09-14T11:42:23.770 INFO:teuthology.orchestra.run.smithi138.stderr: 5800K .......... .......... .......... .......... .......... 6% 151M 1s 2024-09-14T11:42:23.770 INFO:teuthology.orchestra.run.smithi138.stderr: 5850K .......... .......... .......... .......... .......... 6% 137M 1s 2024-09-14T11:42:23.771 INFO:teuthology.orchestra.run.smithi138.stderr: 5900K .......... .......... .......... .......... .......... 6% 149M 1s 2024-09-14T11:42:23.771 INFO:teuthology.orchestra.run.smithi138.stderr: 5950K .......... .......... .......... .......... .......... 6% 143M 1s 2024-09-14T11:42:23.771 INFO:teuthology.orchestra.run.smithi138.stderr: 6000K .......... .......... .......... .......... .......... 6% 141M 1s 2024-09-14T11:42:23.771 INFO:teuthology.orchestra.run.smithi138.stderr: 6050K .......... .......... .......... .......... .......... 6% 127M 1s 2024-09-14T11:42:23.771 INFO:teuthology.orchestra.run.smithi138.stderr: 6100K .......... .......... .......... .......... .......... 6% 147M 1s 2024-09-14T11:42:23.771 INFO:teuthology.orchestra.run.smithi138.stderr: 6150K .......... .......... .......... .......... .......... 6% 149M 1s 2024-09-14T11:42:23.771 INFO:teuthology.orchestra.run.smithi138.stderr: 6200K .......... .......... .......... .......... .......... 6% 146M 1s 2024-09-14T11:42:23.771 INFO:teuthology.orchestra.run.smithi138.stderr: 6250K .......... .......... .......... .......... .......... 6% 123M 1s 2024-09-14T11:42:23.771 INFO:teuthology.orchestra.run.smithi138.stderr: 6300K .......... .......... .......... .......... .......... 6% 158M 1s 2024-09-14T11:42:23.771 INFO:teuthology.orchestra.run.smithi138.stderr: 6350K .......... .......... .......... .......... .......... 6% 163M 1s 2024-09-14T11:42:23.771 INFO:teuthology.orchestra.run.smithi138.stderr: 6400K .......... .......... .......... .......... .......... 6% 142M 1s 2024-09-14T11:42:23.772 INFO:teuthology.orchestra.run.smithi138.stderr: 6450K .......... .......... .......... .......... .......... 6% 143M 1s 2024-09-14T11:42:23.772 INFO:teuthology.orchestra.run.smithi138.stderr: 6500K .......... .......... .......... .......... .......... 7% 145M 1s 2024-09-14T11:42:23.772 INFO:teuthology.orchestra.run.smithi138.stderr: 6550K .......... .......... .......... .......... .......... 7% 160M 1s 2024-09-14T11:42:23.772 INFO:teuthology.orchestra.run.smithi138.stderr: 6600K .......... .......... .......... .......... .......... 7% 155M 1s 2024-09-14T11:42:23.772 INFO:teuthology.orchestra.run.smithi138.stderr: 6650K .......... .......... .......... .......... .......... 7% 160M 1s 2024-09-14T11:42:23.772 INFO:teuthology.orchestra.run.smithi138.stderr: 6700K .......... .......... .......... .......... .......... 7% 110M 1s 2024-09-14T11:42:23.772 INFO:teuthology.orchestra.run.smithi138.stderr: 6750K .......... .......... .......... .......... .......... 7% 160M 1s 2024-09-14T11:42:23.772 INFO:teuthology.orchestra.run.smithi138.stderr: 6800K .......... .......... .......... .......... .......... 7% 166M 1s 2024-09-14T11:42:23.772 INFO:teuthology.orchestra.run.smithi138.stderr: 6850K .......... .......... .......... .......... .......... 7% 151M 1s 2024-09-14T11:42:23.772 INFO:teuthology.orchestra.run.smithi138.stderr: 6900K .......... .......... .......... .......... .......... 7% 144M 1s 2024-09-14T11:42:23.772 INFO:teuthology.orchestra.run.smithi138.stderr: 6950K .......... .......... .......... .......... .......... 7% 163M 1s 2024-09-14T11:42:23.772 INFO:teuthology.orchestra.run.smithi138.stderr: 7000K .......... .......... .......... .......... .......... 7% 146M 1s 2024-09-14T11:42:23.773 INFO:teuthology.orchestra.run.smithi138.stderr: 7050K .......... .......... .......... .......... .......... 7% 156M 1s 2024-09-14T11:42:23.773 INFO:teuthology.orchestra.run.smithi138.stderr: 7100K .......... .......... .......... .......... .......... 7% 161M 1s 2024-09-14T11:42:23.773 INFO:teuthology.orchestra.run.smithi138.stderr: 7150K .......... .......... .......... .......... .......... 7% 159M 1s 2024-09-14T11:42:23.773 INFO:teuthology.orchestra.run.smithi138.stderr: 7200K .......... .......... .......... .......... .......... 7% 146M 1s 2024-09-14T11:42:23.773 INFO:teuthology.orchestra.run.smithi138.stderr: 7250K .......... .......... .......... .......... .......... 7% 174M 1s 2024-09-14T11:42:23.773 INFO:teuthology.orchestra.run.smithi138.stderr: 7300K .......... .......... .......... .......... .......... 7% 170M 1s 2024-09-14T11:42:23.773 INFO:teuthology.orchestra.run.smithi138.stderr: 7350K .......... .......... .......... .......... .......... 7% 168M 1s 2024-09-14T11:42:23.773 INFO:teuthology.orchestra.run.smithi138.stderr: 7400K .......... .......... .......... .......... .......... 8% 141M 1s 2024-09-14T11:42:23.773 INFO:teuthology.orchestra.run.smithi138.stderr: 7450K .......... .......... .......... .......... .......... 8% 170M 1s 2024-09-14T11:42:23.773 INFO:teuthology.orchestra.run.smithi138.stderr: 7500K .......... .......... .......... .......... .......... 8% 155M 1s 2024-09-14T11:42:23.773 INFO:teuthology.orchestra.run.smithi138.stderr: 7550K .......... .......... .......... .......... .......... 8% 168M 1s 2024-09-14T11:42:23.773 INFO:teuthology.orchestra.run.smithi138.stderr: 7600K .......... .......... .......... .......... .......... 8% 176M 1s 2024-09-14T11:42:23.773 INFO:teuthology.orchestra.run.smithi138.stderr: 7650K .......... .......... .......... .......... .......... 8% 146M 1s 2024-09-14T11:42:23.774 INFO:teuthology.orchestra.run.smithi138.stderr: 7700K .......... .......... .......... .......... .......... 8% 176M 1s 2024-09-14T11:42:23.774 INFO:teuthology.orchestra.run.smithi138.stderr: 7750K .......... .......... .......... .......... .......... 8% 177M 1s 2024-09-14T11:42:23.774 INFO:teuthology.orchestra.run.smithi138.stderr: 7800K .......... .......... .......... .......... .......... 8% 172M 1s 2024-09-14T11:42:23.774 INFO:teuthology.orchestra.run.smithi138.stderr: 7850K .......... .......... .......... .......... .......... 8% 163M 1s 2024-09-14T11:42:23.774 INFO:teuthology.orchestra.run.smithi138.stderr: 7900K .......... .......... .......... .......... .......... 8% 181M 1s 2024-09-14T11:42:23.774 INFO:teuthology.orchestra.run.smithi138.stderr: 7950K .......... .......... .......... .......... .......... 8% 171M 1s 2024-09-14T11:42:23.774 INFO:teuthology.orchestra.run.smithi138.stderr: 8000K .......... .......... .......... .......... .......... 8% 175M 1s 2024-09-14T11:42:23.774 INFO:teuthology.orchestra.run.smithi138.stderr: 8050K .......... .......... .......... .......... .......... 8% 146M 1s 2024-09-14T11:42:23.774 INFO:teuthology.orchestra.run.smithi138.stderr: 8100K .......... .......... .......... .......... .......... 8% 192M 1s 2024-09-14T11:42:23.774 INFO:teuthology.orchestra.run.smithi138.stderr: 8150K .......... .......... .......... .......... .......... 8% 163M 1s 2024-09-14T11:42:23.774 INFO:teuthology.orchestra.run.smithi138.stderr: 8200K .......... .......... .......... .......... .......... 8% 163M 1s 2024-09-14T11:42:23.774 INFO:teuthology.orchestra.run.smithi138.stderr: 8250K .......... .......... .......... .......... .......... 8% 175M 1s 2024-09-14T11:42:23.774 INFO:teuthology.orchestra.run.smithi138.stderr: 8300K .......... .......... .......... .......... .......... 8% 148M 1s 2024-09-14T11:42:23.775 INFO:teuthology.orchestra.run.smithi138.stderr: 8350K .......... .......... .......... .......... .......... 9% 166M 1s 2024-09-14T11:42:23.775 INFO:teuthology.orchestra.run.smithi138.stderr: 8400K .......... .......... .......... .......... .......... 9% 192M 1s 2024-09-14T11:42:23.775 INFO:teuthology.orchestra.run.smithi138.stderr: 8450K .......... .......... .......... .......... .......... 9% 157M 1s 2024-09-14T11:42:23.775 INFO:teuthology.orchestra.run.smithi138.stderr: 8500K .......... .......... .......... .......... .......... 9% 195M 1s 2024-09-14T11:42:23.775 INFO:teuthology.orchestra.run.smithi138.stderr: 8550K .......... .......... .......... .......... .......... 9% 178M 1s 2024-09-14T11:42:23.775 INFO:teuthology.orchestra.run.smithi138.stderr: 8600K .......... .......... .......... .......... .......... 9% 188M 1s 2024-09-14T11:42:23.775 INFO:teuthology.orchestra.run.smithi138.stderr: 8650K .......... .......... .......... .......... .......... 9% 193M 1s 2024-09-14T11:42:23.775 INFO:teuthology.orchestra.run.smithi138.stderr: 8700K .......... .......... .......... .......... .......... 9% 152M 1s 2024-09-14T11:42:23.775 INFO:teuthology.orchestra.run.smithi138.stderr: 8750K .......... .......... .......... .......... .......... 9% 199M 1s 2024-09-14T11:42:23.775 INFO:teuthology.orchestra.run.smithi138.stderr: 8800K .......... .......... .......... .......... .......... 9% 200M 1s 2024-09-14T11:42:23.775 INFO:teuthology.orchestra.run.smithi138.stderr: 8850K .......... .......... .......... .......... .......... 9% 194M 1s 2024-09-14T11:42:23.775 INFO:teuthology.orchestra.run.smithi138.stderr: 8900K .......... .......... .......... .......... .......... 9% 199M 1s 2024-09-14T11:42:23.775 INFO:teuthology.orchestra.run.smithi138.stderr: 8950K .......... .......... .......... .......... .......... 9% 150M 1s 2024-09-14T11:42:23.776 INFO:teuthology.orchestra.run.smithi138.stderr: 9000K .......... .......... .......... .......... .......... 9% 206M 1s 2024-09-14T11:42:23.776 INFO:teuthology.orchestra.run.smithi138.stderr: 9050K .......... .......... .......... .......... .......... 9% 188M 1s 2024-09-14T11:42:23.776 INFO:teuthology.orchestra.run.smithi138.stderr: 9100K .......... .......... .......... .......... .......... 9% 194M 1s 2024-09-14T11:42:23.776 INFO:teuthology.orchestra.run.smithi138.stderr: 9150K .......... .......... .......... .......... .......... 9% 159M 1s 2024-09-14T11:42:23.776 INFO:teuthology.orchestra.run.smithi138.stderr: 9200K .......... .......... .......... .......... .......... 9% 205M 1s 2024-09-14T11:42:23.776 INFO:teuthology.orchestra.run.smithi138.stderr: 9250K .......... .......... .......... .......... .......... 10% 186M 1s 2024-09-14T11:42:23.776 INFO:teuthology.orchestra.run.smithi138.stderr: 9300K .......... .......... .......... .......... .......... 10% 203M 1s 2024-09-14T11:42:23.776 INFO:teuthology.orchestra.run.smithi138.stderr: 9350K .......... .......... .......... .......... .......... 10% 201M 1s 2024-09-14T11:42:23.776 INFO:teuthology.orchestra.run.smithi138.stderr: 9400K .......... .......... .......... .......... .......... 10% 167M 1s 2024-09-14T11:42:23.776 INFO:teuthology.orchestra.run.smithi138.stderr: 9450K .......... .......... .......... .......... .......... 10% 194M 1s 2024-09-14T11:42:23.776 INFO:teuthology.orchestra.run.smithi138.stderr: 9500K .......... .......... .......... .......... .......... 10% 201M 1s 2024-09-14T11:42:23.776 INFO:teuthology.orchestra.run.smithi138.stderr: 9550K .......... .......... .......... .......... .......... 10% 203M 1s 2024-09-14T11:42:23.776 INFO:teuthology.orchestra.run.smithi138.stderr: 9600K .......... .......... .......... .......... .......... 10% 200M 1s 2024-09-14T11:42:23.777 INFO:teuthology.orchestra.run.smithi138.stderr: 9650K .......... .......... .......... .......... .......... 10% 178M 1s 2024-09-14T11:42:23.777 INFO:teuthology.orchestra.run.smithi138.stderr: 9700K .......... .......... .......... .......... .......... 10% 189M 1s 2024-09-14T11:42:23.777 INFO:teuthology.orchestra.run.smithi138.stderr: 9750K .......... .......... .......... .......... .......... 10% 169M 1s 2024-09-14T11:42:23.777 INFO:teuthology.orchestra.run.smithi138.stderr: 9800K .......... .......... .......... .......... .......... 10% 211M 1s 2024-09-14T11:42:23.777 INFO:teuthology.orchestra.run.smithi138.stderr: 9850K .......... .......... .......... .......... .......... 10% 225M 1s 2024-09-14T11:42:23.777 INFO:teuthology.orchestra.run.smithi138.stderr: 9900K .......... .......... .......... .......... .......... 10% 197M 1s 2024-09-14T11:42:23.777 INFO:teuthology.orchestra.run.smithi138.stderr: 9950K .......... .......... .......... .......... .......... 10% 206M 1s 2024-09-14T11:42:23.777 INFO:teuthology.orchestra.run.smithi138.stderr: 10000K .......... .......... .......... .......... .......... 10% 176M 1s 2024-09-14T11:42:23.777 INFO:teuthology.orchestra.run.smithi138.stderr: 10050K .......... .......... .......... .......... .......... 10% 221M 1s 2024-09-14T11:42:23.777 INFO:teuthology.orchestra.run.smithi138.stderr: 10100K .......... .......... .......... .......... .......... 10% 219M 1s 2024-09-14T11:42:23.777 INFO:teuthology.orchestra.run.smithi138.stderr: 10150K .......... .......... .......... .......... .......... 10% 211M 1s 2024-09-14T11:42:23.777 INFO:teuthology.orchestra.run.smithi138.stderr: 10200K .......... .......... .......... .......... .......... 11% 182M 1s 2024-09-14T11:42:23.777 INFO:teuthology.orchestra.run.smithi138.stderr: 10250K .......... .......... .......... .......... .......... 11% 228M 1s 2024-09-14T11:42:23.777 INFO:teuthology.orchestra.run.smithi138.stderr: 10300K .......... .......... .......... .......... .......... 11% 186M 1s 2024-09-14T11:42:23.778 INFO:teuthology.orchestra.run.smithi138.stderr: 10350K .......... .......... .......... .......... .......... 11% 212M 1s 2024-09-14T11:42:23.778 INFO:teuthology.orchestra.run.smithi138.stderr: 10400K .......... .......... .......... .......... .......... 11% 203M 1s 2024-09-14T11:42:23.778 INFO:teuthology.orchestra.run.smithi138.stderr: 10450K .......... .......... .......... .......... .......... 11% 211M 1s 2024-09-14T11:42:23.778 INFO:teuthology.orchestra.run.smithi138.stderr: 10500K .......... .......... .......... .......... .......... 11% 182M 1s 2024-09-14T11:42:23.778 INFO:teuthology.orchestra.run.smithi138.stderr: 10550K .......... .......... .......... .......... .......... 11% 207M 1s 2024-09-14T11:42:23.778 INFO:teuthology.orchestra.run.smithi138.stderr: 10600K .......... .......... .......... .......... .......... 11% 198M 1s 2024-09-14T11:42:23.778 INFO:teuthology.orchestra.run.smithi138.stderr: 10650K .......... .......... .......... .......... .......... 11% 227M 1s 2024-09-14T11:42:23.778 INFO:teuthology.orchestra.run.smithi138.stderr: 10700K .......... .......... .......... .......... .......... 11% 189M 1s 2024-09-14T11:42:23.778 INFO:teuthology.orchestra.run.smithi138.stderr: 10750K .......... .......... .......... .......... .......... 11% 219M 1s 2024-09-14T11:42:23.778 INFO:teuthology.orchestra.run.smithi138.stderr: 10800K .......... .......... .......... .......... .......... 11% 231M 1s 2024-09-14T11:42:23.778 INFO:teuthology.orchestra.run.smithi138.stderr: 10850K .......... .......... .......... .......... .......... 11% 205M 1s 2024-09-14T11:42:23.778 INFO:teuthology.orchestra.run.smithi138.stderr: 10900K .......... .......... .......... .......... .......... 11% 192M 1s 2024-09-14T11:42:23.778 INFO:teuthology.orchestra.run.smithi138.stderr: 10950K .......... .......... .......... .......... .......... 11% 228M 1s 2024-09-14T11:42:23.779 INFO:teuthology.orchestra.run.smithi138.stderr: 11000K .......... .......... .......... .......... .......... 11% 206M 1s 2024-09-14T11:42:23.779 INFO:teuthology.orchestra.run.smithi138.stderr: 11050K .......... .......... .......... .......... .......... 11% 215M 1s 2024-09-14T11:42:23.779 INFO:teuthology.orchestra.run.smithi138.stderr: 11100K .......... .......... .......... .......... .......... 12% 191M 1s 2024-09-14T11:42:23.779 INFO:teuthology.orchestra.run.smithi138.stderr: 11150K .......... .......... .......... .......... .......... 12% 225M 1s 2024-09-14T11:42:23.779 INFO:teuthology.orchestra.run.smithi138.stderr: 11200K .......... .......... .......... .......... .......... 12% 228M 1s 2024-09-14T11:42:23.779 INFO:teuthology.orchestra.run.smithi138.stderr: 11250K .......... .......... .......... .......... .......... 12% 224M 1s 2024-09-14T11:42:23.779 INFO:teuthology.orchestra.run.smithi138.stderr: 11300K .......... .......... .......... .......... .......... 12% 206M 1s 2024-09-14T11:42:23.779 INFO:teuthology.orchestra.run.smithi138.stderr: 11350K .......... .......... .......... .......... .......... 12% 228M 1s 2024-09-14T11:42:23.779 INFO:teuthology.orchestra.run.smithi138.stderr: 11400K .......... .......... .......... .......... .......... 12% 206M 1s 2024-09-14T11:42:23.779 INFO:teuthology.orchestra.run.smithi138.stderr: 11450K .......... .......... .......... .......... .......... 12% 225M 1s 2024-09-14T11:42:23.779 INFO:teuthology.orchestra.run.smithi138.stderr: 11500K .......... .......... .......... .......... .......... 12% 182M 1s 2024-09-14T11:42:23.779 INFO:teuthology.orchestra.run.smithi138.stderr: 11550K .......... .......... .......... .......... .......... 12% 227M 1s 2024-09-14T11:42:23.779 INFO:teuthology.orchestra.run.smithi138.stderr: 11600K .......... .......... .......... .......... .......... 12% 238M 1s 2024-09-14T11:42:23.780 INFO:teuthology.orchestra.run.smithi138.stderr: 11650K .......... .......... .......... .......... .......... 12% 239M 1s 2024-09-14T11:42:23.780 INFO:teuthology.orchestra.run.smithi138.stderr: 11700K .......... .......... .......... .......... .......... 12% 215M 1s 2024-09-14T11:42:23.780 INFO:teuthology.orchestra.run.smithi138.stderr: 11750K .......... .......... .......... .......... .......... 12% 238M 1s 2024-09-14T11:42:23.780 INFO:teuthology.orchestra.run.smithi138.stderr: 11800K .......... .......... .......... .......... .......... 12% 238M 1s 2024-09-14T11:42:23.780 INFO:teuthology.orchestra.run.smithi138.stderr: 11850K .......... .......... .......... .......... .......... 12% 225M 1s 2024-09-14T11:42:23.780 INFO:teuthology.orchestra.run.smithi138.stderr: 11900K .......... .......... .......... .......... .......... 12% 196M 1s 2024-09-14T11:42:23.780 INFO:teuthology.orchestra.run.smithi138.stderr: 11950K .......... .......... .......... .......... .......... 12% 218M 1s 2024-09-14T11:42:23.780 INFO:teuthology.orchestra.run.smithi138.stderr: 12000K .......... .......... .......... .......... .......... 12% 227M 1s 2024-09-14T11:42:23.780 INFO:teuthology.orchestra.run.smithi138.stderr: 12050K .......... .......... .......... .......... .......... 13% 236M 1s 2024-09-14T11:42:23.780 INFO:teuthology.orchestra.run.smithi138.stderr: 12100K .......... .......... .......... .......... .......... 13% 182M 1s 2024-09-14T11:42:23.780 INFO:teuthology.orchestra.run.smithi138.stderr: 12150K .......... .......... .......... .......... .......... 13% 206M 1s 2024-09-14T11:42:23.780 INFO:teuthology.orchestra.run.smithi138.stderr: 12200K .......... .......... .......... .......... .......... 13% 248M 1s 2024-09-14T11:42:23.780 INFO:teuthology.orchestra.run.smithi138.stderr: 12250K .......... .......... .......... .......... .......... 13% 224M 1s 2024-09-14T11:42:23.781 INFO:teuthology.orchestra.run.smithi138.stderr: 12300K .......... .......... .......... .......... .......... 13% 196M 1s 2024-09-14T11:42:23.781 INFO:teuthology.orchestra.run.smithi138.stderr: 12350K .......... .......... .......... .......... .......... 13% 251M 1s 2024-09-14T11:42:23.781 INFO:teuthology.orchestra.run.smithi138.stderr: 12400K .......... .......... .......... .......... .......... 13% 185M 1s 2024-09-14T11:42:23.781 INFO:teuthology.orchestra.run.smithi138.stderr: 12450K .......... .......... .......... .......... .......... 13% 254M 1s 2024-09-14T11:42:23.781 INFO:teuthology.orchestra.run.smithi138.stderr: 12500K .......... .......... .......... .......... .......... 13% 212M 1s 2024-09-14T11:42:23.781 INFO:teuthology.orchestra.run.smithi138.stderr: 12550K .......... .......... .......... .......... .......... 13% 261M 1s 2024-09-14T11:42:23.781 INFO:teuthology.orchestra.run.smithi138.stderr: 12600K .......... .......... .......... .......... .......... 13% 255M 1s 2024-09-14T11:42:23.781 INFO:teuthology.orchestra.run.smithi138.stderr: 12650K .......... .......... .......... .......... .......... 13% 258M 1s 2024-09-14T11:42:23.781 INFO:teuthology.orchestra.run.smithi138.stderr: 12700K .......... .......... .......... .......... .......... 13% 219M 1s 2024-09-14T11:42:23.781 INFO:teuthology.orchestra.run.smithi138.stderr: 12750K .......... .......... .......... .......... .......... 13% 232M 1s 2024-09-14T11:42:23.781 INFO:teuthology.orchestra.run.smithi138.stderr: 12800K .......... .......... .......... .......... .......... 13% 249M 1s 2024-09-14T11:42:23.781 INFO:teuthology.orchestra.run.smithi138.stderr: 12850K .......... .......... .......... .......... .......... 13% 261M 1s 2024-09-14T11:42:23.782 INFO:teuthology.orchestra.run.smithi138.stderr: 12900K .......... .......... .......... .......... .......... 13% 215M 1s 2024-09-14T11:42:23.782 INFO:teuthology.orchestra.run.smithi138.stderr: 12950K .......... .......... .......... .......... .......... 13% 228M 1s 2024-09-14T11:42:23.782 INFO:teuthology.orchestra.run.smithi138.stderr: 13000K .......... .......... .......... .......... .......... 14% 250M 1s 2024-09-14T11:42:23.782 INFO:teuthology.orchestra.run.smithi138.stderr: 13050K .......... .......... .......... .......... .......... 14% 235M 1s 2024-09-14T11:42:23.782 INFO:teuthology.orchestra.run.smithi138.stderr: 13100K .......... .......... .......... .......... .......... 14% 238M 1s 2024-09-14T11:42:23.782 INFO:teuthology.orchestra.run.smithi138.stderr: 13150K .......... .......... .......... .......... .......... 14% 260M 1s 2024-09-14T11:42:23.782 INFO:teuthology.orchestra.run.smithi138.stderr: 13200K .......... .......... .......... .......... .......... 14% 240M 1s 2024-09-14T11:42:23.782 INFO:teuthology.orchestra.run.smithi138.stderr: 13250K .......... .......... .......... .......... .......... 14% 229M 1s 2024-09-14T11:42:23.782 INFO:teuthology.orchestra.run.smithi138.stderr: 13300K .......... .......... .......... .......... .......... 14% 204M 1s 2024-09-14T11:42:23.782 INFO:teuthology.orchestra.run.smithi138.stderr: 13350K .......... .......... .......... .......... .......... 14% 269M 1s 2024-09-14T11:42:23.782 INFO:teuthology.orchestra.run.smithi138.stderr: 13400K .......... .......... .......... .......... .......... 14% 269M 1s 2024-09-14T11:42:23.782 INFO:teuthology.orchestra.run.smithi138.stderr: 13450K .......... .......... .......... .......... .......... 14% 276M 1s 2024-09-14T11:42:23.782 INFO:teuthology.orchestra.run.smithi138.stderr: 13500K .......... .......... .......... .......... .......... 14% 222M 1s 2024-09-14T11:42:23.783 INFO:teuthology.orchestra.run.smithi138.stderr: 13550K .......... .......... .......... .......... .......... 14% 241M 1s 2024-09-14T11:42:23.783 INFO:teuthology.orchestra.run.smithi138.stderr: 13600K .......... .......... .......... .......... .......... 14% 256M 1s 2024-09-14T11:42:23.783 INFO:teuthology.orchestra.run.smithi138.stderr: 13650K .......... .......... .......... .......... .......... 14% 269M 1s 2024-09-14T11:42:23.783 INFO:teuthology.orchestra.run.smithi138.stderr: 13700K .......... .......... .......... .......... .......... 14% 216M 1s 2024-09-14T11:42:23.783 INFO:teuthology.orchestra.run.smithi138.stderr: 13750K .......... .......... .......... .......... .......... 14% 251M 1s 2024-09-14T11:42:23.783 INFO:teuthology.orchestra.run.smithi138.stderr: 13800K .......... .......... .......... .......... .......... 14% 268M 1s 2024-09-14T11:42:23.783 INFO:teuthology.orchestra.run.smithi138.stderr: 13850K .......... .......... .......... .......... .......... 14% 267M 1s 2024-09-14T11:42:23.783 INFO:teuthology.orchestra.run.smithi138.stderr: 13900K .......... .......... .......... .......... .......... 15% 240M 1s 2024-09-14T11:42:23.783 INFO:teuthology.orchestra.run.smithi138.stderr: 13950K .......... .......... .......... .......... .......... 15% 276M 1s 2024-09-14T11:42:23.783 INFO:teuthology.orchestra.run.smithi138.stderr: 14000K .......... .......... .......... .......... .......... 15% 257M 1s 2024-09-14T11:42:23.783 INFO:teuthology.orchestra.run.smithi138.stderr: 14050K .......... .......... .......... .......... .......... 15% 275M 1s 2024-09-14T11:42:23.783 INFO:teuthology.orchestra.run.smithi138.stderr: 14100K .......... .......... .......... .......... .......... 15% 227M 1s 2024-09-14T11:42:23.783 INFO:teuthology.orchestra.run.smithi138.stderr: 14150K .......... .......... .......... .......... .......... 15% 231M 1s 2024-09-14T11:42:23.784 INFO:teuthology.orchestra.run.smithi138.stderr: 14200K .......... .......... .......... .......... .......... 15% 267M 1s 2024-09-14T11:42:23.784 INFO:teuthology.orchestra.run.smithi138.stderr: 14250K .......... .......... .......... .......... .......... 15% 236M 1s 2024-09-14T11:42:23.784 INFO:teuthology.orchestra.run.smithi138.stderr: 14300K .......... .......... .......... .......... .......... 15% 210M 1s 2024-09-14T11:42:23.784 INFO:teuthology.orchestra.run.smithi138.stderr: 14350K .......... .......... .......... .......... .......... 15% 232M 1s 2024-09-14T11:42:23.784 INFO:teuthology.orchestra.run.smithi138.stderr: 14400K .......... .......... .......... .......... .......... 15% 264M 1s 2024-09-14T11:42:23.784 INFO:teuthology.orchestra.run.smithi138.stderr: 14450K .......... .......... .......... .......... .......... 15% 244M 1s 2024-09-14T11:42:23.784 INFO:teuthology.orchestra.run.smithi138.stderr: 14500K .......... .......... .......... .......... .......... 15% 204M 1s 2024-09-14T11:42:23.784 INFO:teuthology.orchestra.run.smithi138.stderr: 14550K .......... .......... .......... .......... .......... 15% 286M 1s 2024-09-14T11:42:23.784 INFO:teuthology.orchestra.run.smithi138.stderr: 14600K .......... .......... .......... .......... .......... 15% 288M 1s 2024-09-14T11:42:23.784 INFO:teuthology.orchestra.run.smithi138.stderr: 14650K .......... .......... .......... .......... .......... 15% 256M 1s 2024-09-14T11:42:23.784 INFO:teuthology.orchestra.run.smithi138.stderr: 14700K .......... .......... .......... .......... .......... 15% 217M 1s 2024-09-14T11:42:23.784 INFO:teuthology.orchestra.run.smithi138.stderr: 14750K .......... .......... .......... .......... .......... 15% 255M 1s 2024-09-14T11:42:23.784 INFO:teuthology.orchestra.run.smithi138.stderr: 14800K .......... .......... .......... .......... .......... 15% 270M 1s 2024-09-14T11:42:23.785 INFO:teuthology.orchestra.run.smithi138.stderr: 14850K .......... .......... .......... .......... .......... 16% 269M 1s 2024-09-14T11:42:23.785 INFO:teuthology.orchestra.run.smithi138.stderr: 14900K .......... .......... .......... .......... .......... 16% 250M 1s 2024-09-14T11:42:23.785 INFO:teuthology.orchestra.run.smithi138.stderr: 14950K .......... .......... .......... .......... .......... 16% 283M 1s 2024-09-14T11:42:23.785 INFO:teuthology.orchestra.run.smithi138.stderr: 15000K .......... .......... .......... .......... .......... 16% 271M 1s 2024-09-14T11:42:23.785 INFO:teuthology.orchestra.run.smithi138.stderr: 15050K .......... .......... .......... .......... .......... 16% 285M 1s 2024-09-14T11:42:23.785 INFO:teuthology.orchestra.run.smithi138.stderr: 15100K .......... .......... .......... .......... .......... 16% 222M 1s 2024-09-14T11:42:23.785 INFO:teuthology.orchestra.run.smithi138.stderr: 15150K .......... .......... .......... .......... .......... 16% 221M 1s 2024-09-14T11:42:23.785 INFO:teuthology.orchestra.run.smithi138.stderr: 15200K .......... .......... .......... .......... .......... 16% 264M 1s 2024-09-14T11:42:23.785 INFO:teuthology.orchestra.run.smithi138.stderr: 15250K .......... .......... .......... .......... .......... 16% 245M 1s 2024-09-14T11:42:23.785 INFO:teuthology.orchestra.run.smithi138.stderr: 15300K .......... .......... .......... .......... .......... 16% 222M 1s 2024-09-14T11:42:23.785 INFO:teuthology.orchestra.run.smithi138.stderr: 15350K .......... .......... .......... .......... .......... 16% 249M 1s 2024-09-14T11:42:23.785 INFO:teuthology.orchestra.run.smithi138.stderr: 15400K .......... .......... .......... .......... .......... 16% 269M 1s 2024-09-14T11:42:23.786 INFO:teuthology.orchestra.run.smithi138.stderr: 15450K .......... .......... .......... .......... .......... 16% 300M 1s 2024-09-14T11:42:23.786 INFO:teuthology.orchestra.run.smithi138.stderr: 15500K .......... .......... .......... .......... .......... 16% 250M 1s 2024-09-14T11:42:23.786 INFO:teuthology.orchestra.run.smithi138.stderr: 15550K .......... .......... .......... .......... .......... 16% 318M 1s 2024-09-14T11:42:23.786 INFO:teuthology.orchestra.run.smithi138.stderr: 15600K .......... .......... .......... .......... .......... 16% 270M 1s 2024-09-14T11:42:23.786 INFO:teuthology.orchestra.run.smithi138.stderr: 15650K .......... .......... .......... .......... .......... 16% 307M 1s 2024-09-14T11:42:23.786 INFO:teuthology.orchestra.run.smithi138.stderr: 15700K .......... .......... .......... .......... .......... 16% 277M 1s 2024-09-14T11:42:23.786 INFO:teuthology.orchestra.run.smithi138.stderr: 15750K .......... .......... .......... .......... .......... 17% 271M 1s 2024-09-14T11:42:23.786 INFO:teuthology.orchestra.run.smithi138.stderr: 15800K .......... .......... .......... .......... .......... 17% 230M 1s 2024-09-14T11:42:23.786 INFO:teuthology.orchestra.run.smithi138.stderr: 15850K .......... .......... .......... .......... .......... 17% 295M 1s 2024-09-14T11:42:23.786 INFO:teuthology.orchestra.run.smithi138.stderr: 15900K .......... .......... .......... .......... .......... 17% 291M 1s 2024-09-14T11:42:23.786 INFO:teuthology.orchestra.run.smithi138.stderr: 15950K .......... .......... .......... .......... .......... 17% 252M 1s 2024-09-14T11:42:23.786 INFO:teuthology.orchestra.run.smithi138.stderr: 16000K .......... .......... .......... .......... .......... 17% 242M 1s 2024-09-14T11:42:23.786 INFO:teuthology.orchestra.run.smithi138.stderr: 16050K .......... .......... .......... .......... .......... 17% 257M 1s 2024-09-14T11:42:23.787 INFO:teuthology.orchestra.run.smithi138.stderr: 16100K .......... .......... .......... .......... .......... 17% 262M 1s 2024-09-14T11:42:23.787 INFO:teuthology.orchestra.run.smithi138.stderr: 16150K .......... .......... .......... .......... .......... 17% 303M 1s 2024-09-14T11:42:23.787 INFO:teuthology.orchestra.run.smithi138.stderr: 16200K .......... .......... .......... .......... .......... 17% 287M 1s 2024-09-14T11:42:23.787 INFO:teuthology.orchestra.run.smithi138.stderr: 16250K .......... .......... .......... .......... .......... 17% 271M 1s 2024-09-14T11:42:23.787 INFO:teuthology.orchestra.run.smithi138.stderr: 16300K .......... .......... .......... .......... .......... 17% 251M 1s 2024-09-14T11:42:23.787 INFO:teuthology.orchestra.run.smithi138.stderr: 16350K .......... .......... .......... .......... .......... 17% 300M 1s 2024-09-14T11:42:23.787 INFO:teuthology.orchestra.run.smithi138.stderr: 16400K .......... .......... .......... .......... .......... 17% 286M 1s 2024-09-14T11:42:23.787 INFO:teuthology.orchestra.run.smithi138.stderr: 16450K .......... .......... .......... .......... .......... 17% 73.5M 1s 2024-09-14T11:42:23.787 INFO:teuthology.orchestra.run.smithi138.stderr: 16500K .......... .......... .......... .......... .......... 17% 186M 1s 2024-09-14T11:42:23.787 INFO:teuthology.orchestra.run.smithi138.stderr: 16550K .......... .......... .......... .......... .......... 17% 268M 1s 2024-09-14T11:42:23.787 INFO:teuthology.orchestra.run.smithi138.stderr: 16600K .......... .......... .......... .......... .......... 17% 264M 1s 2024-09-14T11:42:23.787 INFO:teuthology.orchestra.run.smithi138.stderr: 16650K .......... .......... .......... .......... .......... 17% 279M 1s 2024-09-14T11:42:23.788 INFO:teuthology.orchestra.run.smithi138.stderr: 16700K .......... .......... .......... .......... .......... 18% 291M 1s 2024-09-14T11:42:23.788 INFO:teuthology.orchestra.run.smithi138.stderr: 16750K .......... .......... .......... .......... .......... 18% 306M 1s 2024-09-14T11:42:23.788 INFO:teuthology.orchestra.run.smithi138.stderr: 16800K .......... .......... .......... .......... .......... 18% 239M 1s 2024-09-14T11:42:23.788 INFO:teuthology.orchestra.run.smithi138.stderr: 16850K .......... .......... .......... .......... .......... 18% 311M 1s 2024-09-14T11:42:23.788 INFO:teuthology.orchestra.run.smithi138.stderr: 16900K .......... .......... .......... .......... .......... 18% 316M 1s 2024-09-14T11:42:23.788 INFO:teuthology.orchestra.run.smithi138.stderr: 16950K .......... .......... .......... .......... .......... 18% 44.5M 1s 2024-09-14T11:42:23.788 INFO:teuthology.orchestra.run.smithi138.stderr: 17000K .......... .......... .......... .......... .......... 18% 176M 1s 2024-09-14T11:42:23.788 INFO:teuthology.orchestra.run.smithi138.stderr: 17050K .......... .......... .......... .......... .......... 18% 203M 1s 2024-09-14T11:42:23.788 INFO:teuthology.orchestra.run.smithi138.stderr: 17100K .......... .......... .......... .......... .......... 18% 225M 1s 2024-09-14T11:42:23.788 INFO:teuthology.orchestra.run.smithi138.stderr: 17150K .......... .......... .......... .......... .......... 18% 224M 1s 2024-09-14T11:42:23.788 INFO:teuthology.orchestra.run.smithi138.stderr: 17200K .......... .......... .......... .......... .......... 18% 201M 1s 2024-09-14T11:42:23.789 INFO:teuthology.orchestra.run.smithi138.stderr: 17250K .......... .......... .......... .......... .......... 18% 235M 1s 2024-09-14T11:42:23.789 INFO:teuthology.orchestra.run.smithi138.stderr: 17300K .......... .......... .......... .......... .......... 18% 225M 1s 2024-09-14T11:42:23.789 INFO:teuthology.orchestra.run.smithi138.stderr: 17350K .......... .......... .......... .......... .......... 18% 229M 1s 2024-09-14T11:42:23.789 INFO:teuthology.orchestra.run.smithi138.stderr: 17400K .......... .......... .......... .......... .......... 18% 198M 1s 2024-09-14T11:42:23.789 INFO:teuthology.orchestra.run.smithi138.stderr: 17450K .......... .......... .......... .......... .......... 18% 221M 1s 2024-09-14T11:42:23.789 INFO:teuthology.orchestra.run.smithi138.stderr: 17500K .......... .......... .......... .......... .......... 18% 230M 1s 2024-09-14T11:42:23.789 INFO:teuthology.orchestra.run.smithi138.stderr: 17550K .......... .......... .......... .......... .......... 18% 222M 1s 2024-09-14T11:42:23.789 INFO:teuthology.orchestra.run.smithi138.stderr: 17600K .......... .......... .......... .......... .......... 18% 199M 1s 2024-09-14T11:42:23.789 INFO:teuthology.orchestra.run.smithi138.stderr: 17650K .......... .......... .......... .......... .......... 19% 242M 1s 2024-09-14T11:42:23.789 INFO:teuthology.orchestra.run.smithi138.stderr: 17700K .......... .......... .......... .......... .......... 19% 243M 1s 2024-09-14T11:42:23.789 INFO:teuthology.orchestra.run.smithi138.stderr: 17750K .......... .......... .......... .......... .......... 19% 241M 1s 2024-09-14T11:42:23.789 INFO:teuthology.orchestra.run.smithi138.stderr: 17800K .......... .......... .......... .......... .......... 19% 196M 1s 2024-09-14T11:42:23.790 INFO:teuthology.orchestra.run.smithi138.stderr: 17850K .......... .......... .......... .......... .......... 19% 221M 1s 2024-09-14T11:42:23.790 INFO:teuthology.orchestra.run.smithi138.stderr: 17900K .......... .......... .......... .......... .......... 19% 229M 1s 2024-09-14T11:42:23.790 INFO:teuthology.orchestra.run.smithi138.stderr: 17950K .......... .......... .......... .......... .......... 19% 216M 1s 2024-09-14T11:42:23.790 INFO:teuthology.orchestra.run.smithi138.stderr: 18000K .......... .......... .......... .......... .......... 19% 190M 1s 2024-09-14T11:42:23.790 INFO:teuthology.orchestra.run.smithi138.stderr: 18050K .......... .......... .......... .......... .......... 19% 235M 1s 2024-09-14T11:42:23.790 INFO:teuthology.orchestra.run.smithi138.stderr: 18100K .......... .......... .......... .......... .......... 19% 243M 1s 2024-09-14T11:42:23.790 INFO:teuthology.orchestra.run.smithi138.stderr: 18150K .......... .......... .......... .......... .......... 19% 245M 1s 2024-09-14T11:42:23.790 INFO:teuthology.orchestra.run.smithi138.stderr: 18200K .......... .......... .......... .......... .......... 19% 204M 1s 2024-09-14T11:42:23.790 INFO:teuthology.orchestra.run.smithi138.stderr: 18250K .......... .......... .......... .......... .......... 19% 227M 1s 2024-09-14T11:42:23.790 INFO:teuthology.orchestra.run.smithi138.stderr: 18300K .......... .......... .......... .......... .......... 19% 217M 1s 2024-09-14T11:42:23.790 INFO:teuthology.orchestra.run.smithi138.stderr: 18350K .......... .......... .......... .......... .......... 19% 239M 1s 2024-09-14T11:42:23.791 INFO:teuthology.orchestra.run.smithi138.stderr: 18400K .......... .......... .......... .......... .......... 19% 170M 1s 2024-09-14T11:42:23.791 INFO:teuthology.orchestra.run.smithi138.stderr: 18450K .......... .......... .......... .......... .......... 19% 220M 1s 2024-09-14T11:42:23.791 INFO:teuthology.orchestra.run.smithi138.stderr: 18500K .......... .......... .......... .......... .......... 19% 232M 1s 2024-09-14T11:42:23.791 INFO:teuthology.orchestra.run.smithi138.stderr: 18550K .......... .......... .......... .......... .......... 20% 236M 1s 2024-09-14T11:42:23.791 INFO:teuthology.orchestra.run.smithi138.stderr: 18600K .......... .......... .......... .......... .......... 20% 219M 1s 2024-09-14T11:42:23.791 INFO:teuthology.orchestra.run.smithi138.stderr: 18650K .......... .......... .......... .......... .......... 20% 223M 1s 2024-09-14T11:42:23.791 INFO:teuthology.orchestra.run.smithi138.stderr: 18700K .......... .......... .......... .......... .......... 20% 238M 1s 2024-09-14T11:42:23.791 INFO:teuthology.orchestra.run.smithi138.stderr: 18750K .......... .......... .......... .......... .......... 20% 233M 1s 2024-09-14T11:42:23.791 INFO:teuthology.orchestra.run.smithi138.stderr: 18800K .......... .......... .......... .......... .......... 20% 198M 1s 2024-09-14T11:42:23.791 INFO:teuthology.orchestra.run.smithi138.stderr: 18850K .......... .......... .......... .......... .......... 20% 222M 1s 2024-09-14T11:42:23.791 INFO:teuthology.orchestra.run.smithi138.stderr: 18900K .......... .......... .......... .......... .......... 20% 216M 1s 2024-09-14T11:42:23.792 INFO:teuthology.orchestra.run.smithi138.stderr: 18950K .......... .......... .......... .......... .......... 20% 211M 1s 2024-09-14T11:42:23.792 INFO:teuthology.orchestra.run.smithi138.stderr: 19000K .......... .......... .......... .......... .......... 20% 206M 1s 2024-09-14T11:42:23.792 INFO:teuthology.orchestra.run.smithi138.stderr: 19050K .......... .......... .......... .......... .......... 20% 229M 1s 2024-09-14T11:42:23.792 INFO:teuthology.orchestra.run.smithi138.stderr: 19100K .......... .......... .......... .......... .......... 20% 233M 1s 2024-09-14T11:42:23.792 INFO:teuthology.orchestra.run.smithi138.stderr: 19150K .......... .......... .......... .......... .......... 20% 227M 1s 2024-09-14T11:42:23.792 INFO:teuthology.orchestra.run.smithi138.stderr: 19200K .......... .......... .......... .......... .......... 20% 174M 1s 2024-09-14T11:42:23.792 INFO:teuthology.orchestra.run.smithi138.stderr: 19250K .......... .......... .......... .......... .......... 20% 241M 1s 2024-09-14T11:42:23.792 INFO:teuthology.orchestra.run.smithi138.stderr: 19300K .......... .......... .......... .......... .......... 20% 232M 1s 2024-09-14T11:42:23.792 INFO:teuthology.orchestra.run.smithi138.stderr: 19350K .......... .......... .......... .......... .......... 20% 242M 1s 2024-09-14T11:42:23.792 INFO:teuthology.orchestra.run.smithi138.stderr: 19400K .......... .......... .......... .......... .......... 20% 201M 1s 2024-09-14T11:42:23.792 INFO:teuthology.orchestra.run.smithi138.stderr: 19450K .......... .......... .......... .......... .......... 20% 234M 1s 2024-09-14T11:42:23.792 INFO:teuthology.orchestra.run.smithi138.stderr: 19500K .......... .......... .......... .......... .......... 21% 236M 1s 2024-09-14T11:42:23.792 INFO:teuthology.orchestra.run.smithi138.stderr: 19550K .......... .......... .......... .......... .......... 21% 212M 1s 2024-09-14T11:42:23.793 INFO:teuthology.orchestra.run.smithi138.stderr: 19600K .......... .......... .......... .......... .......... 21% 176M 1s 2024-09-14T11:42:23.793 INFO:teuthology.orchestra.run.smithi138.stderr: 19650K .......... .......... .......... .......... .......... 21% 236M 1s 2024-09-14T11:42:23.793 INFO:teuthology.orchestra.run.smithi138.stderr: 19700K .......... .......... .......... .......... .......... 21% 214M 1s 2024-09-14T11:42:23.793 INFO:teuthology.orchestra.run.smithi138.stderr: 19750K .......... .......... .......... .......... .......... 21% 183M 1s 2024-09-14T11:42:23.793 INFO:teuthology.orchestra.run.smithi138.stderr: 19800K .......... .......... .......... .......... .......... 21% 192M 1s 2024-09-14T11:42:23.793 INFO:teuthology.orchestra.run.smithi138.stderr: 19850K .......... .......... .......... .......... .......... 21% 237M 1s 2024-09-14T11:42:23.793 INFO:teuthology.orchestra.run.smithi138.stderr: 19900K .......... .......... .......... .......... .......... 21% 222M 1s 2024-09-14T11:42:23.793 INFO:teuthology.orchestra.run.smithi138.stderr: 19950K .......... .......... .......... .......... .......... 21% 229M 1s 2024-09-14T11:42:23.793 INFO:teuthology.orchestra.run.smithi138.stderr: 20000K .......... .......... .......... .......... .......... 21% 183M 1s 2024-09-14T11:42:23.793 INFO:teuthology.orchestra.run.smithi138.stderr: 20050K .......... .......... .......... .......... .......... 21% 229M 1s 2024-09-14T11:42:23.793 INFO:teuthology.orchestra.run.smithi138.stderr: 20100K .......... .......... .......... .......... .......... 21% 222M 1s 2024-09-14T11:42:23.793 INFO:teuthology.orchestra.run.smithi138.stderr: 20150K .......... .......... .......... .......... .......... 21% 226M 1s 2024-09-14T11:42:23.794 INFO:teuthology.orchestra.run.smithi138.stderr: 20200K .......... .......... .......... .......... .......... 21% 215M 1s 2024-09-14T11:42:23.794 INFO:teuthology.orchestra.run.smithi138.stderr: 20250K .......... .......... .......... .......... .......... 21% 234M 1s 2024-09-14T11:42:23.794 INFO:teuthology.orchestra.run.smithi138.stderr: 20300K .......... .......... .......... .......... .......... 21% 233M 1s 2024-09-14T11:42:23.794 INFO:teuthology.orchestra.run.smithi138.stderr: 20350K .......... .......... .......... .......... .......... 21% 244M 1s 2024-09-14T11:42:23.794 INFO:teuthology.orchestra.run.smithi138.stderr: 20400K .......... .......... .......... .......... .......... 22% 176M 1s 2024-09-14T11:42:23.794 INFO:teuthology.orchestra.run.smithi138.stderr: 20450K .......... .......... .......... .......... .......... 22% 238M 1s 2024-09-14T11:42:23.794 INFO:teuthology.orchestra.run.smithi138.stderr: 20500K .......... .......... .......... .......... .......... 22% 223M 1s 2024-09-14T11:42:23.794 INFO:teuthology.orchestra.run.smithi138.stderr: 20550K .......... .......... .......... .......... .......... 22% 226M 1s 2024-09-14T11:42:23.794 INFO:teuthology.orchestra.run.smithi138.stderr: 20600K .......... .......... .......... .......... .......... 22% 193M 1s 2024-09-14T11:42:23.794 INFO:teuthology.orchestra.run.smithi138.stderr: 20650K .......... .......... .......... .......... .......... 22% 227M 1s 2024-09-14T11:42:23.794 INFO:teuthology.orchestra.run.smithi138.stderr: 20700K .......... .......... .......... .......... .......... 22% 195M 1s 2024-09-14T11:42:23.794 INFO:teuthology.orchestra.run.smithi138.stderr: 20750K .......... .......... .......... .......... .......... 22% 240M 1s 2024-09-14T11:42:23.794 INFO:teuthology.orchestra.run.smithi138.stderr: 20800K .......... .......... .......... .......... .......... 22% 201M 1s 2024-09-14T11:42:23.795 INFO:teuthology.orchestra.run.smithi138.stderr: 20850K .......... .......... .......... .......... .......... 22% 216M 1s 2024-09-14T11:42:23.795 INFO:teuthology.orchestra.run.smithi138.stderr: 20900K .......... .......... .......... .......... .......... 22% 214M 1s 2024-09-14T11:42:23.795 INFO:teuthology.orchestra.run.smithi138.stderr: 20950K .......... .......... .......... .......... .......... 22% 243M 1s 2024-09-14T11:42:23.795 INFO:teuthology.orchestra.run.smithi138.stderr: 21000K .......... .......... .......... .......... .......... 22% 186M 1s 2024-09-14T11:42:23.795 INFO:teuthology.orchestra.run.smithi138.stderr: 21050K .......... .......... .......... .......... .......... 22% 228M 1s 2024-09-14T11:42:23.795 INFO:teuthology.orchestra.run.smithi138.stderr: 21100K .......... .......... .......... .......... .......... 22% 240M 1s 2024-09-14T11:42:23.795 INFO:teuthology.orchestra.run.smithi138.stderr: 21150K .......... .......... .......... .......... .......... 22% 238M 1s 2024-09-14T11:42:23.795 INFO:teuthology.orchestra.run.smithi138.stderr: 21200K .......... .......... .......... .......... .......... 22% 216M 1s 2024-09-14T11:42:23.795 INFO:teuthology.orchestra.run.smithi138.stderr: 21250K .......... .......... .......... .......... .......... 22% 220M 1s 2024-09-14T11:42:23.795 INFO:teuthology.orchestra.run.smithi138.stderr: 21300K .......... .......... .......... .......... .......... 22% 214M 1s 2024-09-14T11:42:23.795 INFO:teuthology.orchestra.run.smithi138.stderr: 21350K .......... .......... .......... .......... .......... 23% 206M 1s 2024-09-14T11:42:23.795 INFO:teuthology.orchestra.run.smithi138.stderr: 21400K .......... .......... .......... .......... .......... 23% 244M 1s 2024-09-14T11:42:23.796 INFO:teuthology.orchestra.run.smithi138.stderr: 21450K .......... .......... .......... .......... .......... 23% 233M 1s 2024-09-14T11:42:23.796 INFO:teuthology.orchestra.run.smithi138.stderr: 21500K .......... .......... .......... .......... .......... 23% 176M 1s 2024-09-14T11:42:23.796 INFO:teuthology.orchestra.run.smithi138.stderr: 21550K .......... .......... .......... .......... .......... 23% 222M 1s 2024-09-14T11:42:23.796 INFO:teuthology.orchestra.run.smithi138.stderr: 21600K .......... .......... .......... .......... .......... 23% 218M 1s 2024-09-14T11:42:23.796 INFO:teuthology.orchestra.run.smithi138.stderr: 21650K .......... .......... .......... .......... .......... 23% 237M 1s 2024-09-14T11:42:23.796 INFO:teuthology.orchestra.run.smithi138.stderr: 21700K .......... .......... .......... .......... .......... 23% 208M 1s 2024-09-14T11:42:23.796 INFO:teuthology.orchestra.run.smithi138.stderr: 21750K .......... .......... .......... .......... .......... 23% 247M 1s 2024-09-14T11:42:23.796 INFO:teuthology.orchestra.run.smithi138.stderr: 21800K .......... .......... .......... .......... .......... 23% 238M 1s 2024-09-14T11:42:23.796 INFO:teuthology.orchestra.run.smithi138.stderr: 21850K .......... .......... .......... .......... .......... 23% 229M 1s 2024-09-14T11:42:23.796 INFO:teuthology.orchestra.run.smithi138.stderr: 21900K .......... .......... .......... .......... .......... 23% 199M 1s 2024-09-14T11:42:23.796 INFO:teuthology.orchestra.run.smithi138.stderr: 21950K .......... .......... .......... .......... .......... 23% 243M 1s 2024-09-14T11:42:23.796 INFO:teuthology.orchestra.run.smithi138.stderr: 22000K .......... .......... .......... .......... .......... 23% 247M 1s 2024-09-14T11:42:23.796 INFO:teuthology.orchestra.run.smithi138.stderr: 22050K .......... .......... .......... .......... .......... 23% 245M 1s 2024-09-14T11:42:23.797 INFO:teuthology.orchestra.run.smithi138.stderr: 22100K .......... .......... .......... .......... .......... 23% 199M 1s 2024-09-14T11:42:23.797 INFO:teuthology.orchestra.run.smithi138.stderr: 22150K .......... .......... .......... .......... .......... 23% 225M 1s 2024-09-14T11:42:23.797 INFO:teuthology.orchestra.run.smithi138.stderr: 22200K .......... .......... .......... .......... .......... 23% 221M 1s 2024-09-14T11:42:23.797 INFO:teuthology.orchestra.run.smithi138.stderr: 22250K .......... .......... .......... .......... .......... 24% 219M 1s 2024-09-14T11:42:23.797 INFO:teuthology.orchestra.run.smithi138.stderr: 22300K .......... .......... .......... .......... .......... 24% 192M 1s 2024-09-14T11:42:23.797 INFO:teuthology.orchestra.run.smithi138.stderr: 22350K .......... .......... .......... .......... .......... 24% 220M 1s 2024-09-14T11:42:23.797 INFO:teuthology.orchestra.run.smithi138.stderr: 22400K .......... .......... .......... .......... .......... 24% 229M 1s 2024-09-14T11:42:23.797 INFO:teuthology.orchestra.run.smithi138.stderr: 22450K .......... .......... .......... .......... .......... 24% 224M 1s 2024-09-14T11:42:23.797 INFO:teuthology.orchestra.run.smithi138.stderr: 22500K .......... .......... .......... .......... .......... 24% 224M 1s 2024-09-14T11:42:23.797 INFO:teuthology.orchestra.run.smithi138.stderr: 22550K .......... .......... .......... .......... .......... 24% 213M 1s 2024-09-14T11:42:23.797 INFO:teuthology.orchestra.run.smithi138.stderr: 22600K .......... .......... .......... .......... .......... 24% 254M 1s 2024-09-14T11:42:23.797 INFO:teuthology.orchestra.run.smithi138.stderr: 22650K .......... .......... .......... .......... .......... 24% 257M 1s 2024-09-14T11:42:23.797 INFO:teuthology.orchestra.run.smithi138.stderr: 22700K .......... .......... .......... .......... .......... 24% 258M 1s 2024-09-14T11:42:23.798 INFO:teuthology.orchestra.run.smithi138.stderr: 22750K .......... .......... .......... .......... .......... 24% 229M 1s 2024-09-14T11:42:23.798 INFO:teuthology.orchestra.run.smithi138.stderr: 22800K .......... .......... .......... .......... .......... 24% 241M 1s 2024-09-14T11:42:23.798 INFO:teuthology.orchestra.run.smithi138.stderr: 22850K .......... .......... .......... .......... .......... 24% 254M 1s 2024-09-14T11:42:23.798 INFO:teuthology.orchestra.run.smithi138.stderr: 22900K .......... .......... .......... .......... .......... 24% 259M 1s 2024-09-14T11:42:23.798 INFO:teuthology.orchestra.run.smithi138.stderr: 22950K .......... .......... .......... .......... .......... 24% 216M 1s 2024-09-14T11:42:23.798 INFO:teuthology.orchestra.run.smithi138.stderr: 23000K .......... .......... .......... .......... .......... 24% 254M 1s 2024-09-14T11:42:23.798 INFO:teuthology.orchestra.run.smithi138.stderr: 23050K .......... .......... .......... .......... .......... 24% 241M 1s 2024-09-14T11:42:23.798 INFO:teuthology.orchestra.run.smithi138.stderr: 23100K .......... .......... .......... .......... .......... 24% 206M 1s 2024-09-14T11:42:23.798 INFO:teuthology.orchestra.run.smithi138.stderr: 23150K .......... .......... .......... .......... .......... 24% 220M 1s 2024-09-14T11:42:23.798 INFO:teuthology.orchestra.run.smithi138.stderr: 23200K .......... .......... .......... .......... .......... 25% 206M 1s 2024-09-14T11:42:23.798 INFO:teuthology.orchestra.run.smithi138.stderr: 23250K .......... .......... .......... .......... .......... 25% 246M 1s 2024-09-14T11:42:23.798 INFO:teuthology.orchestra.run.smithi138.stderr: 23300K .......... .......... .......... .......... .......... 25% 247M 1s 2024-09-14T11:42:23.798 INFO:teuthology.orchestra.run.smithi138.stderr: 23350K .......... .......... .......... .......... .......... 25% 208M 1s 2024-09-14T11:42:23.799 INFO:teuthology.orchestra.run.smithi138.stderr: 23400K .......... .......... .......... .......... .......... 25% 239M 1s 2024-09-14T11:42:23.799 INFO:teuthology.orchestra.run.smithi138.stderr: 23450K .......... .......... .......... .......... .......... 25% 249M 1s 2024-09-14T11:42:23.799 INFO:teuthology.orchestra.run.smithi138.stderr: 23500K .......... .......... .......... .......... .......... 25% 237M 1s 2024-09-14T11:42:23.799 INFO:teuthology.orchestra.run.smithi138.stderr: 23550K .......... .......... .......... .......... .......... 25% 210M 1s 2024-09-14T11:42:23.799 INFO:teuthology.orchestra.run.smithi138.stderr: 23600K .......... .......... .......... .......... .......... 25% 257M 1s 2024-09-14T11:42:23.799 INFO:teuthology.orchestra.run.smithi138.stderr: 23650K .......... .......... .......... .......... .......... 25% 249M 1s 2024-09-14T11:42:23.799 INFO:teuthology.orchestra.run.smithi138.stderr: 23700K .......... .......... .......... .......... .......... 25% 252M 1s 2024-09-14T11:42:23.799 INFO:teuthology.orchestra.run.smithi138.stderr: 23750K .......... .......... .......... .......... .......... 25% 258M 1s 2024-09-14T11:42:23.799 INFO:teuthology.orchestra.run.smithi138.stderr: 23800K .......... .......... .......... .......... .......... 25% 201M 1s 2024-09-14T11:42:23.799 INFO:teuthology.orchestra.run.smithi138.stderr: 23850K .......... .......... .......... .......... .......... 25% 264M 1s 2024-09-14T11:42:23.799 INFO:teuthology.orchestra.run.smithi138.stderr: 23900K .......... .......... .......... .......... .......... 25% 275M 1s 2024-09-14T11:42:23.799 INFO:teuthology.orchestra.run.smithi138.stderr: 23950K .......... .......... .......... .......... .......... 25% 225M 1s 2024-09-14T11:42:23.799 INFO:teuthology.orchestra.run.smithi138.stderr: 24000K .......... .......... .......... .......... .......... 25% 263M 1s 2024-09-14T11:42:23.800 INFO:teuthology.orchestra.run.smithi138.stderr: 24050K .......... .......... .......... .......... .......... 25% 202M 1s 2024-09-14T11:42:23.800 INFO:teuthology.orchestra.run.smithi138.stderr: 24100K .......... .......... .......... .......... .......... 25% 263M 1s 2024-09-14T11:42:23.800 INFO:teuthology.orchestra.run.smithi138.stderr: 24150K .......... .......... .......... .......... .......... 26% 273M 1s 2024-09-14T11:42:23.800 INFO:teuthology.orchestra.run.smithi138.stderr: 24200K .......... .......... .......... .......... .......... 26% 244M 1s 2024-09-14T11:42:23.800 INFO:teuthology.orchestra.run.smithi138.stderr: 24250K .......... .......... .......... .......... .......... 26% 249M 1s 2024-09-14T11:42:23.800 INFO:teuthology.orchestra.run.smithi138.stderr: 24300K .......... .......... .......... .......... .......... 26% 210M 1s 2024-09-14T11:42:23.800 INFO:teuthology.orchestra.run.smithi138.stderr: 24350K .......... .......... .......... .......... .......... 26% 264M 1s 2024-09-14T11:42:23.800 INFO:teuthology.orchestra.run.smithi138.stderr: 24400K .......... .......... .......... .......... .......... 26% 226M 1s 2024-09-14T11:42:23.800 INFO:teuthology.orchestra.run.smithi138.stderr: 24450K .......... .......... .......... .......... .......... 26% 261M 1s 2024-09-14T11:42:23.800 INFO:teuthology.orchestra.run.smithi138.stderr: 24500K .......... .......... .......... .......... .......... 26% 244M 1s 2024-09-14T11:42:23.800 INFO:teuthology.orchestra.run.smithi138.stderr: 24550K .......... .......... .......... .......... .......... 26% 277M 1s 2024-09-14T11:42:23.800 INFO:teuthology.orchestra.run.smithi138.stderr: 24600K .......... .......... .......... .......... .......... 26% 278M 1s 2024-09-14T11:42:23.800 INFO:teuthology.orchestra.run.smithi138.stderr: 24650K .......... .......... .......... .......... .......... 26% 284M 1s 2024-09-14T11:42:23.801 INFO:teuthology.orchestra.run.smithi138.stderr: 24700K .......... .......... .......... .......... .......... 26% 201M 1s 2024-09-14T11:42:23.801 INFO:teuthology.orchestra.run.smithi138.stderr: 24750K .......... .......... .......... .......... .......... 26% 286M 1s 2024-09-14T11:42:23.801 INFO:teuthology.orchestra.run.smithi138.stderr: 24800K .......... .......... .......... .......... .......... 26% 285M 1s 2024-09-14T11:42:23.801 INFO:teuthology.orchestra.run.smithi138.stderr: 24850K .......... .......... .......... .......... .......... 26% 278M 1s 2024-09-14T11:42:23.801 INFO:teuthology.orchestra.run.smithi138.stderr: 24900K .......... .......... .......... .......... .......... 26% 108M 1s 2024-09-14T11:42:23.801 INFO:teuthology.orchestra.run.smithi138.stderr: 24950K .......... .......... .......... .......... .......... 26% 267M 1s 2024-09-14T11:42:23.801 INFO:teuthology.orchestra.run.smithi138.stderr: 25000K .......... .......... .......... .......... .......... 26% 207M 1s 2024-09-14T11:42:23.801 INFO:teuthology.orchestra.run.smithi138.stderr: 25050K .......... .......... .......... .......... .......... 27% 253M 1s 2024-09-14T11:42:23.801 INFO:teuthology.orchestra.run.smithi138.stderr: 25100K .......... .......... .......... .......... .......... 27% 271M 1s 2024-09-14T11:42:23.801 INFO:teuthology.orchestra.run.smithi138.stderr: 25150K .......... .......... .......... .......... .......... 27% 260M 1s 2024-09-14T11:42:23.801 INFO:teuthology.orchestra.run.smithi138.stderr: 25200K .......... .......... .......... .......... .......... 27% 236M 1s 2024-09-14T11:42:23.801 INFO:teuthology.orchestra.run.smithi138.stderr: 25250K .......... .......... .......... .......... .......... 27% 282M 1s 2024-09-14T11:42:23.802 INFO:teuthology.orchestra.run.smithi138.stderr: 25300K .......... .......... .......... .......... .......... 27% 267M 0s 2024-09-14T11:42:23.802 INFO:teuthology.orchestra.run.smithi138.stderr: 25350K .......... .......... .......... .......... .......... 27% 246M 0s 2024-09-14T11:42:23.802 INFO:teuthology.orchestra.run.smithi138.stderr: 25400K .......... .......... .......... .......... .......... 27% 220M 0s 2024-09-14T11:42:23.802 INFO:teuthology.orchestra.run.smithi138.stderr: 25450K .......... .......... .......... .......... .......... 27% 283M 0s 2024-09-14T11:42:23.802 INFO:teuthology.orchestra.run.smithi138.stderr: 25500K .......... .......... .......... .......... .......... 27% 282M 0s 2024-09-14T11:42:23.802 INFO:teuthology.orchestra.run.smithi138.stderr: 25550K .......... .......... .......... .......... .......... 27% 246M 0s 2024-09-14T11:42:23.802 INFO:teuthology.orchestra.run.smithi138.stderr: 25600K .......... .......... .......... .......... .......... 27% 259M 0s 2024-09-14T11:42:23.802 INFO:teuthology.orchestra.run.smithi138.stderr: 25650K .......... .......... .......... .......... .......... 27% 227M 0s 2024-09-14T11:42:23.802 INFO:teuthology.orchestra.run.smithi138.stderr: 25700K .......... .......... .......... .......... .......... 27% 254M 0s 2024-09-14T11:42:23.802 INFO:teuthology.orchestra.run.smithi138.stderr: 25750K .......... .......... .......... .......... .......... 27% 282M 0s 2024-09-14T11:42:23.802 INFO:teuthology.orchestra.run.smithi138.stderr: 25800K .......... .......... .......... .......... .......... 27% 285M 0s 2024-09-14T11:42:23.802 INFO:teuthology.orchestra.run.smithi138.stderr: 25850K .......... .......... .......... .......... .......... 27% 248M 0s 2024-09-14T11:42:23.802 INFO:teuthology.orchestra.run.smithi138.stderr: 25900K .......... .......... .......... .......... .......... 27% 279M 0s 2024-09-14T11:42:23.802 INFO:teuthology.orchestra.run.smithi138.stderr: 25950K .......... .......... .......... .......... .......... 27% 277M 0s 2024-09-14T11:42:23.803 INFO:teuthology.orchestra.run.smithi138.stderr: 26000K .......... .......... .......... .......... .......... 28% 274M 0s 2024-09-14T11:42:23.803 INFO:teuthology.orchestra.run.smithi138.stderr: 26050K .......... .......... .......... .......... .......... 28% 225M 0s 2024-09-14T11:42:23.803 INFO:teuthology.orchestra.run.smithi138.stderr: 26100K .......... .......... .......... .......... .......... 28% 274M 0s 2024-09-14T11:42:23.803 INFO:teuthology.orchestra.run.smithi138.stderr: 26150K .......... .......... .......... .......... .......... 28% 235M 0s 2024-09-14T11:42:23.803 INFO:teuthology.orchestra.run.smithi138.stderr: 26200K .......... .......... .......... .......... .......... 28% 288M 0s 2024-09-14T11:42:23.803 INFO:teuthology.orchestra.run.smithi138.stderr: 26250K .......... .......... .......... .......... .......... 28% 284M 0s 2024-09-14T11:42:23.803 INFO:teuthology.orchestra.run.smithi138.stderr: 26300K .......... .......... .......... .......... .......... 28% 239M 0s 2024-09-14T11:42:23.803 INFO:teuthology.orchestra.run.smithi138.stderr: 26350K .......... .......... .......... .......... .......... 28% 170M 0s 2024-09-14T11:42:23.803 INFO:teuthology.orchestra.run.smithi138.stderr: 26400K .......... .......... .......... .......... .......... 28% 195M 0s 2024-09-14T11:42:23.803 INFO:teuthology.orchestra.run.smithi138.stderr: 26450K .......... .......... .......... .......... .......... 28% 257M 0s 2024-09-14T11:42:23.803 INFO:teuthology.orchestra.run.smithi138.stderr: 26500K .......... .......... .......... .......... .......... 28% 267M 0s 2024-09-14T11:42:23.803 INFO:teuthology.orchestra.run.smithi138.stderr: 26550K .......... .......... .......... .......... .......... 28% 262M 0s 2024-09-14T11:42:23.804 INFO:teuthology.orchestra.run.smithi138.stderr: 26600K .......... .......... .......... .......... .......... 28% 270M 0s 2024-09-14T11:42:23.804 INFO:teuthology.orchestra.run.smithi138.stderr: 26650K .......... .......... .......... .......... .......... 28% 292M 0s 2024-09-14T11:42:23.804 INFO:teuthology.orchestra.run.smithi138.stderr: 26700K .......... .......... .......... .......... .......... 28% 271M 0s 2024-09-14T11:42:23.804 INFO:teuthology.orchestra.run.smithi138.stderr: 26750K .......... .......... .......... .......... .......... 28% 219M 0s 2024-09-14T11:42:23.804 INFO:teuthology.orchestra.run.smithi138.stderr: 26800K .......... .......... .......... .......... .......... 28% 291M 0s 2024-09-14T11:42:23.804 INFO:teuthology.orchestra.run.smithi138.stderr: 26850K .......... .......... .......... .......... .......... 28% 271M 0s 2024-09-14T11:42:23.804 INFO:teuthology.orchestra.run.smithi138.stderr: 26900K .......... .......... .......... .......... .......... 29% 284M 0s 2024-09-14T11:42:23.804 INFO:teuthology.orchestra.run.smithi138.stderr: 26950K .......... .......... .......... .......... .......... 29% 263M 0s 2024-09-14T11:42:23.804 INFO:teuthology.orchestra.run.smithi138.stderr: 27000K .......... .......... .......... .......... .......... 29% 234M 0s 2024-09-14T11:42:23.804 INFO:teuthology.orchestra.run.smithi138.stderr: 27050K .......... .......... .......... .......... .......... 29% 279M 0s 2024-09-14T11:42:23.804 INFO:teuthology.orchestra.run.smithi138.stderr: 27100K .......... .......... .......... .......... .......... 29% 284M 0s 2024-09-14T11:42:23.805 INFO:teuthology.orchestra.run.smithi138.stderr: 27150K .......... .......... .......... .......... .......... 29% 293M 0s 2024-09-14T11:42:23.805 INFO:teuthology.orchestra.run.smithi138.stderr: 27200K .......... .......... .......... .......... .......... 29% 251M 0s 2024-09-14T11:42:23.805 INFO:teuthology.orchestra.run.smithi138.stderr: 27250K .......... .......... .......... .......... .......... 29% 264M 0s 2024-09-14T11:42:23.805 INFO:teuthology.orchestra.run.smithi138.stderr: 27300K .......... .......... .......... .......... .......... 29% 270M 0s 2024-09-14T11:42:23.805 INFO:teuthology.orchestra.run.smithi138.stderr: 27350K .......... .......... .......... .......... .......... 29% 267M 0s 2024-09-14T11:42:23.805 INFO:teuthology.orchestra.run.smithi138.stderr: 27400K .......... .......... .......... .......... .......... 29% 227M 0s 2024-09-14T11:42:23.805 INFO:teuthology.orchestra.run.smithi138.stderr: 27450K .......... .......... .......... .......... .......... 29% 251M 0s 2024-09-14T11:42:23.805 INFO:teuthology.orchestra.run.smithi138.stderr: 27500K .......... .......... .......... .......... .......... 29% 229M 0s 2024-09-14T11:42:23.805 INFO:teuthology.orchestra.run.smithi138.stderr: 27550K .......... .......... .......... .......... .......... 29% 273M 0s 2024-09-14T11:42:23.805 INFO:teuthology.orchestra.run.smithi138.stderr: 27600K .......... .......... .......... .......... .......... 29% 287M 0s 2024-09-14T11:42:23.805 INFO:teuthology.orchestra.run.smithi138.stderr: 27650K .......... .......... .......... .......... .......... 29% 33.7M 0s 2024-09-14T11:42:23.806 INFO:teuthology.orchestra.run.smithi138.stderr: 27700K .......... .......... .......... .......... .......... 29% 252M 0s 2024-09-14T11:42:23.806 INFO:teuthology.orchestra.run.smithi138.stderr: 27750K .......... .......... .......... .......... .......... 29% 228M 0s 2024-09-14T11:42:23.806 INFO:teuthology.orchestra.run.smithi138.stderr: 27800K .......... .......... .......... .......... .......... 29% 262M 0s 2024-09-14T11:42:23.806 INFO:teuthology.orchestra.run.smithi138.stderr: 27850K .......... .......... .......... .......... .......... 30% 260M 0s 2024-09-14T11:42:23.806 INFO:teuthology.orchestra.run.smithi138.stderr: 27900K .......... .......... .......... .......... .......... 30% 242M 0s 2024-09-14T11:42:23.806 INFO:teuthology.orchestra.run.smithi138.stderr: 27950K .......... .......... .......... .......... .......... 30% 279M 0s 2024-09-14T11:42:23.806 INFO:teuthology.orchestra.run.smithi138.stderr: 28000K .......... .......... .......... .......... .......... 30% 258M 0s 2024-09-14T11:42:23.806 INFO:teuthology.orchestra.run.smithi138.stderr: 28050K .......... .......... .......... .......... .......... 30% 280M 0s 2024-09-14T11:42:23.806 INFO:teuthology.orchestra.run.smithi138.stderr: 28100K .......... .......... .......... .......... .......... 30% 286M 0s 2024-09-14T11:42:23.806 INFO:teuthology.orchestra.run.smithi138.stderr: 28150K .......... .......... .......... .......... .......... 30% 257M 0s 2024-09-14T11:42:23.806 INFO:teuthology.orchestra.run.smithi138.stderr: 28200K .......... .......... .......... .......... .......... 30% 202M 0s 2024-09-14T11:42:23.806 INFO:teuthology.orchestra.run.smithi138.stderr: 28250K .......... .......... .......... .......... .......... 30% 285M 0s 2024-09-14T11:42:23.807 INFO:teuthology.orchestra.run.smithi138.stderr: 28300K .......... .......... .......... .......... .......... 30% 269M 0s 2024-09-14T11:42:23.807 INFO:teuthology.orchestra.run.smithi138.stderr: 28350K .......... .......... .......... .......... .......... 30% 277M 0s 2024-09-14T11:42:23.807 INFO:teuthology.orchestra.run.smithi138.stderr: 28400K .......... .......... .......... .......... .......... 30% 221M 0s 2024-09-14T11:42:23.807 INFO:teuthology.orchestra.run.smithi138.stderr: 28450K .......... .......... .......... .......... .......... 30% 283M 0s 2024-09-14T11:42:23.807 INFO:teuthology.orchestra.run.smithi138.stderr: 28500K .......... .......... .......... .......... .......... 30% 258M 0s 2024-09-14T11:42:23.807 INFO:teuthology.orchestra.run.smithi138.stderr: 28550K .......... .......... .......... .......... .......... 30% 290M 0s 2024-09-14T11:42:23.807 INFO:teuthology.orchestra.run.smithi138.stderr: 28600K .......... .......... .......... .......... .......... 30% 294M 0s 2024-09-14T11:42:23.807 INFO:teuthology.orchestra.run.smithi138.stderr: 28650K .......... .......... .......... .......... .......... 30% 238M 0s 2024-09-14T11:42:23.807 INFO:teuthology.orchestra.run.smithi138.stderr: 28700K .......... .......... .......... .......... .......... 30% 235M 0s 2024-09-14T11:42:23.807 INFO:teuthology.orchestra.run.smithi138.stderr: 28750K .......... .......... .......... .......... .......... 31% 187M 0s 2024-09-14T11:42:23.807 INFO:teuthology.orchestra.run.smithi138.stderr: 28800K .......... .......... .......... .......... .......... 31% 258M 0s 2024-09-14T11:42:23.807 INFO:teuthology.orchestra.run.smithi138.stderr: 28850K .......... .......... .......... .......... .......... 31% 272M 0s 2024-09-14T11:42:23.808 INFO:teuthology.orchestra.run.smithi138.stderr: 28900K .......... .......... .......... .......... .......... 31% 286M 0s 2024-09-14T11:42:23.808 INFO:teuthology.orchestra.run.smithi138.stderr: 28950K .......... .......... .......... .......... .......... 31% 258M 0s 2024-09-14T11:42:23.808 INFO:teuthology.orchestra.run.smithi138.stderr: 29000K .......... .......... .......... .......... .......... 31% 260M 0s 2024-09-14T11:42:23.808 INFO:teuthology.orchestra.run.smithi138.stderr: 29050K .......... .......... .......... .......... .......... 31% 290M 0s 2024-09-14T11:42:23.808 INFO:teuthology.orchestra.run.smithi138.stderr: 29100K .......... .......... .......... .......... .......... 31% 250M 0s 2024-09-14T11:42:23.808 INFO:teuthology.orchestra.run.smithi138.stderr: 29150K .......... .......... .......... .......... .......... 31% 247M 0s 2024-09-14T11:42:23.808 INFO:teuthology.orchestra.run.smithi138.stderr: 29200K .......... .......... .......... .......... .......... 31% 210M 0s 2024-09-14T11:42:23.808 INFO:teuthology.orchestra.run.smithi138.stderr: 29250K .......... .......... .......... .......... .......... 31% 263M 0s 2024-09-14T11:42:23.808 INFO:teuthology.orchestra.run.smithi138.stderr: 29300K .......... .......... .......... .......... .......... 31% 275M 0s 2024-09-14T11:42:23.808 INFO:teuthology.orchestra.run.smithi138.stderr: 29350K .......... .......... .......... .......... .......... 31% 287M 0s 2024-09-14T11:42:23.808 INFO:teuthology.orchestra.run.smithi138.stderr: 29400K .......... .......... .......... .......... .......... 31% 246M 0s 2024-09-14T11:42:23.808 INFO:teuthology.orchestra.run.smithi138.stderr: 29450K .......... .......... .......... .......... .......... 31% 274M 0s 2024-09-14T11:42:23.809 INFO:teuthology.orchestra.run.smithi138.stderr: 29500K .......... .......... .......... .......... .......... 31% 293M 0s 2024-09-14T11:42:23.809 INFO:teuthology.orchestra.run.smithi138.stderr: 29550K .......... .......... .......... .......... .......... 31% 241M 0s 2024-09-14T11:42:23.809 INFO:teuthology.orchestra.run.smithi138.stderr: 29600K .......... .......... .......... .......... .......... 31% 265M 0s 2024-09-14T11:42:23.809 INFO:teuthology.orchestra.run.smithi138.stderr: 29650K .......... .......... .......... .......... .......... 31% 281M 0s 2024-09-14T11:42:23.809 INFO:teuthology.orchestra.run.smithi138.stderr: 29700K .......... .......... .......... .......... .......... 32% 262M 0s 2024-09-14T11:42:23.809 INFO:teuthology.orchestra.run.smithi138.stderr: 29750K .......... .......... .......... .......... .......... 32% 263M 0s 2024-09-14T11:42:23.809 INFO:teuthology.orchestra.run.smithi138.stderr: 29800K .......... .......... .......... .......... .......... 32% 264M 0s 2024-09-14T11:42:23.809 INFO:teuthology.orchestra.run.smithi138.stderr: 29850K .......... .......... .......... .......... .......... 32% 276M 0s 2024-09-14T11:42:23.809 INFO:teuthology.orchestra.run.smithi138.stderr: 29900K .......... .......... .......... .......... .......... 32% 220M 0s 2024-09-14T11:42:23.809 INFO:teuthology.orchestra.run.smithi138.stderr: 29950K .......... .......... .......... .......... .......... 32% 207M 0s 2024-09-14T11:42:23.809 INFO:teuthology.orchestra.run.smithi138.stderr: 30000K .......... .......... .......... .......... .......... 32% 266M 0s 2024-09-14T11:42:23.809 INFO:teuthology.orchestra.run.smithi138.stderr: 30050K .......... .......... .......... .......... .......... 32% 276M 0s 2024-09-14T11:42:23.809 INFO:teuthology.orchestra.run.smithi138.stderr: 30100K .......... .......... .......... .......... .......... 32% 219M 0s 2024-09-14T11:42:23.810 INFO:teuthology.orchestra.run.smithi138.stderr: 30150K .......... .......... .......... .......... .......... 32% 164M 0s 2024-09-14T11:42:23.810 INFO:teuthology.orchestra.run.smithi138.stderr: 30200K .......... .......... .......... .......... .......... 32% 261M 0s 2024-09-14T11:42:23.810 INFO:teuthology.orchestra.run.smithi138.stderr: 30250K .......... .......... .......... .......... .......... 32% 271M 0s 2024-09-14T11:42:23.810 INFO:teuthology.orchestra.run.smithi138.stderr: 30300K .......... .......... .......... .......... .......... 32% 293M 0s 2024-09-14T11:42:23.810 INFO:teuthology.orchestra.run.smithi138.stderr: 30350K .......... .......... .......... .......... .......... 32% 260M 0s 2024-09-14T11:42:23.810 INFO:teuthology.orchestra.run.smithi138.stderr: 30400K .......... .......... .......... .......... .......... 32% 295M 0s 2024-09-14T11:42:23.810 INFO:teuthology.orchestra.run.smithi138.stderr: 30450K .......... .......... .......... .......... .......... 32% 287M 0s 2024-09-14T11:42:23.810 INFO:teuthology.orchestra.run.smithi138.stderr: 30500K .......... .......... .......... .......... .......... 32% 290M 0s 2024-09-14T11:42:23.810 INFO:teuthology.orchestra.run.smithi138.stderr: 30550K .......... .......... .......... .......... .......... 32% 81.7M 0s 2024-09-14T11:42:23.810 INFO:teuthology.orchestra.run.smithi138.stderr: 30600K .......... .......... .......... .......... .......... 32% 258M 0s 2024-09-14T11:42:23.810 INFO:teuthology.orchestra.run.smithi138.stderr: 30650K .......... .......... .......... .......... .......... 33% 292M 0s 2024-09-14T11:42:23.811 INFO:teuthology.orchestra.run.smithi138.stderr: 30700K .......... .......... .......... .......... .......... 33% 237M 0s 2024-09-14T11:42:23.811 INFO:teuthology.orchestra.run.smithi138.stderr: 30750K .......... .......... .......... .......... .......... 33% 270M 0s 2024-09-14T11:42:23.811 INFO:teuthology.orchestra.run.smithi138.stderr: 30800K .......... .......... .......... .......... .......... 33% 290M 0s 2024-09-14T11:42:23.811 INFO:teuthology.orchestra.run.smithi138.stderr: 30850K .......... .......... .......... .......... .......... 33% 221M 0s 2024-09-14T11:42:23.811 INFO:teuthology.orchestra.run.smithi138.stderr: 30900K .......... .......... .......... .......... .......... 33% 280M 0s 2024-09-14T11:42:23.811 INFO:teuthology.orchestra.run.smithi138.stderr: 30950K .......... .......... .......... .......... .......... 33% 291M 0s 2024-09-14T11:42:23.811 INFO:teuthology.orchestra.run.smithi138.stderr: 31000K .......... .......... .......... .......... .......... 33% 268M 0s 2024-09-14T11:42:23.811 INFO:teuthology.orchestra.run.smithi138.stderr: 31050K .......... .......... .......... .......... .......... 33% 238M 0s 2024-09-14T11:42:23.811 INFO:teuthology.orchestra.run.smithi138.stderr: 31100K .......... .......... .......... .......... .......... 33% 290M 0s 2024-09-14T11:42:23.811 INFO:teuthology.orchestra.run.smithi138.stderr: 31150K .......... .......... .......... .......... .......... 33% 225M 0s 2024-09-14T11:42:23.811 INFO:teuthology.orchestra.run.smithi138.stderr: 31200K .......... .......... .......... .......... .......... 33% 287M 0s 2024-09-14T11:42:23.811 INFO:teuthology.orchestra.run.smithi138.stderr: 31250K .......... .......... .......... .......... .......... 33% 254M 0s 2024-09-14T11:42:23.812 INFO:teuthology.orchestra.run.smithi138.stderr: 31300K .......... .......... .......... .......... .......... 33% 261M 0s 2024-09-14T11:42:23.812 INFO:teuthology.orchestra.run.smithi138.stderr: 31350K .......... .......... .......... .......... .......... 33% 262M 0s 2024-09-14T11:42:23.812 INFO:teuthology.orchestra.run.smithi138.stderr: 31400K .......... .......... .......... .......... .......... 33% 267M 0s 2024-09-14T11:42:23.812 INFO:teuthology.orchestra.run.smithi138.stderr: 31450K .......... .......... .......... .......... .......... 33% 285M 0s 2024-09-14T11:42:23.812 INFO:teuthology.orchestra.run.smithi138.stderr: 31500K .......... .......... .......... .......... .......... 33% 100M 0s 2024-09-14T11:42:23.812 INFO:teuthology.orchestra.run.smithi138.stderr: 31550K .......... .......... .......... .......... .......... 34% 202M 0s 2024-09-14T11:42:23.812 INFO:teuthology.orchestra.run.smithi138.stderr: 31600K .......... .......... .......... .......... .......... 34% 253M 0s 2024-09-14T11:42:23.812 INFO:teuthology.orchestra.run.smithi138.stderr: 31650K .......... .......... .......... .......... .......... 34% 277M 0s 2024-09-14T11:42:23.812 INFO:teuthology.orchestra.run.smithi138.stderr: 31700K .......... .......... .......... .......... .......... 34% 274M 0s 2024-09-14T11:42:23.812 INFO:teuthology.orchestra.run.smithi138.stderr: 31750K .......... .......... .......... .......... .......... 34% 229M 0s 2024-09-14T11:42:23.812 INFO:teuthology.orchestra.run.smithi138.stderr: 31800K .......... .......... .......... .......... .......... 34% 278M 0s 2024-09-14T11:42:23.812 INFO:teuthology.orchestra.run.smithi138.stderr: 31850K .......... .......... .......... .......... .......... 34% 275M 0s 2024-09-14T11:42:23.812 INFO:teuthology.orchestra.run.smithi138.stderr: 31900K .......... .......... .......... .......... .......... 34% 254M 0s 2024-09-14T11:42:23.813 INFO:teuthology.orchestra.run.smithi138.stderr: 31950K .......... .......... .......... .......... .......... 34% 274M 0s 2024-09-14T11:42:23.813 INFO:teuthology.orchestra.run.smithi138.stderr: 32000K .......... .......... .......... .......... .......... 34% 262M 0s 2024-09-14T11:42:23.813 INFO:teuthology.orchestra.run.smithi138.stderr: 32050K .......... .......... .......... .......... .......... 34% 259M 0s 2024-09-14T11:42:23.813 INFO:teuthology.orchestra.run.smithi138.stderr: 32100K .......... .......... .......... .......... .......... 34% 249M 0s 2024-09-14T11:42:23.813 INFO:teuthology.orchestra.run.smithi138.stderr: 32150K .......... .......... .......... .......... .......... 34% 257M 0s 2024-09-14T11:42:23.813 INFO:teuthology.orchestra.run.smithi138.stderr: 32200K .......... .......... .......... .......... .......... 34% 265M 0s 2024-09-14T11:42:23.813 INFO:teuthology.orchestra.run.smithi138.stderr: 32250K .......... .......... .......... .......... .......... 34% 278M 0s 2024-09-14T11:42:23.813 INFO:teuthology.orchestra.run.smithi138.stderr: 32300K .......... .......... .......... .......... .......... 34% 287M 0s 2024-09-14T11:42:23.813 INFO:teuthology.orchestra.run.smithi138.stderr: 32350K .......... .......... .......... .......... .......... 34% 234M 0s 2024-09-14T11:42:23.813 INFO:teuthology.orchestra.run.smithi138.stderr: 32400K .......... .......... .......... .......... .......... 34% 281M 0s 2024-09-14T11:42:23.813 INFO:teuthology.orchestra.run.smithi138.stderr: 32450K .......... .......... .......... .......... .......... 34% 292M 0s 2024-09-14T11:42:23.813 INFO:teuthology.orchestra.run.smithi138.stderr: 32500K .......... .......... .......... .......... .......... 35% 277M 0s 2024-09-14T11:42:23.813 INFO:teuthology.orchestra.run.smithi138.stderr: 32550K .......... .......... .......... .......... .......... 35% 257M 0s 2024-09-14T11:42:23.813 INFO:teuthology.orchestra.run.smithi138.stderr: 32600K .......... .......... .......... .......... .......... 35% 291M 0s 2024-09-14T11:42:23.814 INFO:teuthology.orchestra.run.smithi138.stderr: 32650K .......... .......... .......... .......... .......... 35% 239M 0s 2024-09-14T11:42:23.814 INFO:teuthology.orchestra.run.smithi138.stderr: 32700K .......... .......... .......... .......... .......... 35% 274M 0s 2024-09-14T11:42:23.814 INFO:teuthology.orchestra.run.smithi138.stderr: 32750K .......... .......... .......... .......... .......... 35% 282M 0s 2024-09-14T11:42:23.814 INFO:teuthology.orchestra.run.smithi138.stderr: 32800K .......... .......... .......... .......... .......... 35% 291M 0s 2024-09-14T11:42:23.814 INFO:teuthology.orchestra.run.smithi138.stderr: 32850K .......... .......... .......... .......... .......... 35% 193M 0s 2024-09-14T11:42:23.814 INFO:teuthology.orchestra.run.smithi138.stderr: 32900K .......... .......... .......... .......... .......... 35% 254M 0s 2024-09-14T11:42:23.814 INFO:teuthology.orchestra.run.smithi138.stderr: 32950K .......... .......... .......... .......... .......... 35% 275M 0s 2024-09-14T11:42:23.814 INFO:teuthology.orchestra.run.smithi138.stderr: 33000K .......... .......... .......... .......... .......... 35% 281M 0s 2024-09-14T11:42:23.814 INFO:teuthology.orchestra.run.smithi138.stderr: 33050K .......... .......... .......... .......... .......... 35% 244M 0s 2024-09-14T11:42:23.814 INFO:teuthology.orchestra.run.smithi138.stderr: 33100K .......... .......... .......... .......... .......... 35% 270M 0s 2024-09-14T11:42:23.814 INFO:teuthology.orchestra.run.smithi138.stderr: 33150K .......... .......... .......... .......... .......... 35% 249M 0s 2024-09-14T11:42:23.814 INFO:teuthology.orchestra.run.smithi138.stderr: 33200K .......... .......... .......... .......... .......... 35% 287M 0s 2024-09-14T11:42:23.814 INFO:teuthology.orchestra.run.smithi138.stderr: 33250K .......... .......... .......... .......... .......... 35% 284M 0s 2024-09-14T11:42:23.815 INFO:teuthology.orchestra.run.smithi138.stderr: 33300K .......... .......... .......... .......... .......... 35% 37.7M 0s 2024-09-14T11:42:23.815 INFO:teuthology.orchestra.run.smithi138.stderr: 33350K .......... .......... .......... .......... .......... 35% 252M 0s 2024-09-14T11:42:23.815 INFO:teuthology.orchestra.run.smithi138.stderr: 33400K .......... .......... .......... .......... .......... 36% 260M 0s 2024-09-14T11:42:23.815 INFO:teuthology.orchestra.run.smithi138.stderr: 33450K .......... .......... .......... .......... .......... 36% 239M 0s 2024-09-14T11:42:23.815 INFO:teuthology.orchestra.run.smithi138.stderr: 33500K .......... .......... .......... .......... .......... 36% 281M 0s 2024-09-14T11:42:23.815 INFO:teuthology.orchestra.run.smithi138.stderr: 33550K .......... .......... .......... .......... .......... 36% 250M 0s 2024-09-14T11:42:23.815 INFO:teuthology.orchestra.run.smithi138.stderr: 33600K .......... .......... .......... .......... .......... 36% 289M 0s 2024-09-14T11:42:23.815 INFO:teuthology.orchestra.run.smithi138.stderr: 33650K .......... .......... .......... .......... .......... 36% 261M 0s 2024-09-14T11:42:23.815 INFO:teuthology.orchestra.run.smithi138.stderr: 33700K .......... .......... .......... .......... .......... 36% 267M 0s 2024-09-14T11:42:23.815 INFO:teuthology.orchestra.run.smithi138.stderr: 33750K .......... .......... .......... .......... .......... 36% 271M 0s 2024-09-14T11:42:23.815 INFO:teuthology.orchestra.run.smithi138.stderr: 33800K .......... .......... .......... .......... .......... 36% 278M 0s 2024-09-14T11:42:23.815 INFO:teuthology.orchestra.run.smithi138.stderr: 33850K .......... .......... .......... .......... .......... 36% 272M 0s 2024-09-14T11:42:23.815 INFO:teuthology.orchestra.run.smithi138.stderr: 33900K .......... .......... .......... .......... .......... 36% 240M 0s 2024-09-14T11:42:23.816 INFO:teuthology.orchestra.run.smithi138.stderr: 33950K .......... .......... .......... .......... .......... 36% 277M 0s 2024-09-14T11:42:23.816 INFO:teuthology.orchestra.run.smithi138.stderr: 34000K .......... .......... .......... .......... .......... 36% 252M 0s 2024-09-14T11:42:23.816 INFO:teuthology.orchestra.run.smithi138.stderr: 34050K .......... .......... .......... .......... .......... 36% 270M 0s 2024-09-14T11:42:23.816 INFO:teuthology.orchestra.run.smithi138.stderr: 34100K .......... .......... .......... .......... .......... 36% 281M 0s 2024-09-14T11:42:23.816 INFO:teuthology.orchestra.run.smithi138.stderr: 34150K .......... .......... .......... .......... .......... 36% 291M 0s 2024-09-14T11:42:23.816 INFO:teuthology.orchestra.run.smithi138.stderr: 34200K .......... .......... .......... .......... .......... 36% 246M 0s 2024-09-14T11:42:23.816 INFO:teuthology.orchestra.run.smithi138.stderr: 34250K .......... .......... .......... .......... .......... 36% 301M 0s 2024-09-14T11:42:23.816 INFO:teuthology.orchestra.run.smithi138.stderr: 34300K .......... .......... .......... .......... .......... 36% 306M 0s 2024-09-14T11:42:23.816 INFO:teuthology.orchestra.run.smithi138.stderr: 34350K .......... .......... .......... .......... .......... 37% 286M 0s 2024-09-14T11:42:23.816 INFO:teuthology.orchestra.run.smithi138.stderr: 34400K .......... .......... .......... .......... .......... 37% 248M 0s 2024-09-14T11:42:23.816 INFO:teuthology.orchestra.run.smithi138.stderr: 34450K .......... .......... .......... .......... .......... 37% 275M 0s 2024-09-14T11:42:23.816 INFO:teuthology.orchestra.run.smithi138.stderr: 34500K .......... .......... .......... .......... .......... 37% 269M 0s 2024-09-14T11:42:23.816 INFO:teuthology.orchestra.run.smithi138.stderr: 34550K .......... .......... .......... .......... .......... 37% 299M 0s 2024-09-14T11:42:23.817 INFO:teuthology.orchestra.run.smithi138.stderr: 34600K .......... .......... .......... .......... .......... 37% 286M 0s 2024-09-14T11:42:23.817 INFO:teuthology.orchestra.run.smithi138.stderr: 34650K .......... .......... .......... .......... .......... 37% 290M 0s 2024-09-14T11:42:23.817 INFO:teuthology.orchestra.run.smithi138.stderr: 34700K .......... .......... .......... .......... .......... 37% 264M 0s 2024-09-14T11:42:23.817 INFO:teuthology.orchestra.run.smithi138.stderr: 34750K .......... .......... .......... .......... .......... 37% 297M 0s 2024-09-14T11:42:23.817 INFO:teuthology.orchestra.run.smithi138.stderr: 34800K .......... .......... .......... .......... .......... 37% 303M 0s 2024-09-14T11:42:23.817 INFO:teuthology.orchestra.run.smithi138.stderr: 34850K .......... .......... .......... .......... .......... 37% 166M 0s 2024-09-14T11:42:23.817 INFO:teuthology.orchestra.run.smithi138.stderr: 34900K .......... .......... .......... .......... .......... 37% 222M 0s 2024-09-14T11:42:23.817 INFO:teuthology.orchestra.run.smithi138.stderr: 34950K .......... .......... .......... .......... .......... 37% 270M 0s 2024-09-14T11:42:23.817 INFO:teuthology.orchestra.run.smithi138.stderr: 35000K .......... .......... .......... .......... .......... 37% 289M 0s 2024-09-14T11:42:23.817 INFO:teuthology.orchestra.run.smithi138.stderr: 35050K .......... .......... .......... .......... .......... 37% 277M 0s 2024-09-14T11:42:23.817 INFO:teuthology.orchestra.run.smithi138.stderr: 35100K .......... .......... .......... .......... .......... 37% 262M 0s 2024-09-14T11:42:23.817 INFO:teuthology.orchestra.run.smithi138.stderr: 35150K .......... .......... .......... .......... .......... 37% 276M 0s 2024-09-14T11:42:23.817 INFO:teuthology.orchestra.run.smithi138.stderr: 35200K .......... .......... .......... .......... .......... 37% 279M 0s 2024-09-14T11:42:23.817 INFO:teuthology.orchestra.run.smithi138.stderr: 35250K .......... .......... .......... .......... .......... 37% 273M 0s 2024-09-14T11:42:23.818 INFO:teuthology.orchestra.run.smithi138.stderr: 35300K .......... .......... .......... .......... .......... 38% 298M 0s 2024-09-14T11:42:23.818 INFO:teuthology.orchestra.run.smithi138.stderr: 35350K .......... .......... .......... .......... .......... 38% 261M 0s 2024-09-14T11:42:23.818 INFO:teuthology.orchestra.run.smithi138.stderr: 35400K .......... .......... .......... .......... .......... 38% 292M 0s 2024-09-14T11:42:23.818 INFO:teuthology.orchestra.run.smithi138.stderr: 35450K .......... .......... .......... .......... .......... 38% 298M 0s 2024-09-14T11:42:23.818 INFO:teuthology.orchestra.run.smithi138.stderr: 35500K .......... .......... .......... .......... .......... 38% 288M 0s 2024-09-14T11:42:23.818 INFO:teuthology.orchestra.run.smithi138.stderr: 35550K .......... .......... .......... .......... .......... 38% 226M 0s 2024-09-14T11:42:23.818 INFO:teuthology.orchestra.run.smithi138.stderr: 35600K .......... .......... .......... .......... .......... 38% 280M 0s 2024-09-14T11:42:23.818 INFO:teuthology.orchestra.run.smithi138.stderr: 35650K .......... .......... .......... .......... .......... 38% 278M 0s 2024-09-14T11:42:23.818 INFO:teuthology.orchestra.run.smithi138.stderr: 35700K .......... .......... .......... .......... .......... 38% 280M 0s 2024-09-14T11:42:23.818 INFO:teuthology.orchestra.run.smithi138.stderr: 35750K .......... .......... .......... .......... .......... 38% 255M 0s 2024-09-14T11:42:23.818 INFO:teuthology.orchestra.run.smithi138.stderr: 35800K .......... .......... .......... .......... .......... 38% 290M 0s 2024-09-14T11:42:23.818 INFO:teuthology.orchestra.run.smithi138.stderr: 35850K .......... .......... .......... .......... .......... 38% 228M 0s 2024-09-14T11:42:23.818 INFO:teuthology.orchestra.run.smithi138.stderr: 35900K .......... .......... .......... .......... .......... 38% 279M 0s 2024-09-14T11:42:23.819 INFO:teuthology.orchestra.run.smithi138.stderr: 35950K .......... .......... .......... .......... .......... 38% 302M 0s 2024-09-14T11:42:23.819 INFO:teuthology.orchestra.run.smithi138.stderr: 36000K .......... .......... .......... .......... .......... 38% 293M 0s 2024-09-14T11:42:23.819 INFO:teuthology.orchestra.run.smithi138.stderr: 36050K .......... .......... .......... .......... .......... 38% 255M 0s 2024-09-14T11:42:23.819 INFO:teuthology.orchestra.run.smithi138.stderr: 36100K .......... .......... .......... .......... .......... 38% 308M 0s 2024-09-14T11:42:23.819 INFO:teuthology.orchestra.run.smithi138.stderr: 36150K .......... .......... .......... .......... .......... 38% 289M 0s 2024-09-14T11:42:23.819 INFO:teuthology.orchestra.run.smithi138.stderr: 36200K .......... .......... .......... .......... .......... 39% 296M 0s 2024-09-14T11:42:23.819 INFO:teuthology.orchestra.run.smithi138.stderr: 36250K .......... .......... .......... .......... .......... 39% 33.2M 0s 2024-09-14T11:42:23.819 INFO:teuthology.orchestra.run.smithi138.stderr: 36300K .......... .......... .......... .......... .......... 39% 291M 0s 2024-09-14T11:42:23.819 INFO:teuthology.orchestra.run.smithi138.stderr: 36350K .......... .......... .......... .......... .......... 39% 293M 0s 2024-09-14T11:42:23.819 INFO:teuthology.orchestra.run.smithi138.stderr: 36400K .......... .......... .......... .......... .......... 39% 286M 0s 2024-09-14T11:42:23.819 INFO:teuthology.orchestra.run.smithi138.stderr: 36450K .......... .......... .......... .......... .......... 39% 288M 0s 2024-09-14T11:42:23.819 INFO:teuthology.orchestra.run.smithi138.stderr: 36500K .......... .......... .......... .......... .......... 39% 246M 0s 2024-09-14T11:42:23.819 INFO:teuthology.orchestra.run.smithi138.stderr: 36550K .......... .......... .......... .......... .......... 39% 287M 0s 2024-09-14T11:42:23.820 INFO:teuthology.orchestra.run.smithi138.stderr: 36600K .......... .......... .......... .......... .......... 39% 173M 0s 2024-09-14T11:42:23.820 INFO:teuthology.orchestra.run.smithi138.stderr: 36650K .......... .......... .......... .......... .......... 39% 187M 0s 2024-09-14T11:42:23.820 INFO:teuthology.orchestra.run.smithi138.stderr: 36700K .......... .......... .......... .......... .......... 39% 265M 0s 2024-09-14T11:42:23.820 INFO:teuthology.orchestra.run.smithi138.stderr: 36750K .......... .......... .......... .......... .......... 39% 257M 0s 2024-09-14T11:42:23.820 INFO:teuthology.orchestra.run.smithi138.stderr: 36800K .......... .......... .......... .......... .......... 39% 109M 0s 2024-09-14T11:42:23.820 INFO:teuthology.orchestra.run.smithi138.stderr: 36850K .......... .......... .......... .......... .......... 39% 278M 0s 2024-09-14T11:42:23.820 INFO:teuthology.orchestra.run.smithi138.stderr: 36900K .......... .......... .......... .......... .......... 39% 271M 0s 2024-09-14T11:42:23.820 INFO:teuthology.orchestra.run.smithi138.stderr: 36950K .......... .......... .......... .......... .......... 39% 192M 0s 2024-09-14T11:42:23.820 INFO:teuthology.orchestra.run.smithi138.stderr: 37000K .......... .......... .......... .......... .......... 39% 296M 0s 2024-09-14T11:42:23.820 INFO:teuthology.orchestra.run.smithi138.stderr: 37050K .......... .......... .......... .......... .......... 39% 285M 0s 2024-09-14T11:42:23.820 INFO:teuthology.orchestra.run.smithi138.stderr: 37100K .......... .......... .......... .......... .......... 39% 234M 0s 2024-09-14T11:42:23.820 INFO:teuthology.orchestra.run.smithi138.stderr: 37150K .......... .......... .......... .......... .......... 40% 275M 0s 2024-09-14T11:42:23.820 INFO:teuthology.orchestra.run.smithi138.stderr: 37200K .......... .......... .......... .......... .......... 40% 240M 0s 2024-09-14T11:42:23.821 INFO:teuthology.orchestra.run.smithi138.stderr: 37250K .......... .......... .......... .......... .......... 40% 241M 0s 2024-09-14T11:42:23.821 INFO:teuthology.orchestra.run.smithi138.stderr: 37300K .......... .......... .......... .......... .......... 40% 284M 0s 2024-09-14T11:42:23.821 INFO:teuthology.orchestra.run.smithi138.stderr: 37350K .......... .......... .......... .......... .......... 40% 280M 0s 2024-09-14T11:42:23.821 INFO:teuthology.orchestra.run.smithi138.stderr: 37400K .......... .......... .......... .......... .......... 40% 242M 0s 2024-09-14T11:42:23.821 INFO:teuthology.orchestra.run.smithi138.stderr: 37450K .......... .......... .......... .......... .......... 40% 292M 0s 2024-09-14T11:42:23.821 INFO:teuthology.orchestra.run.smithi138.stderr: 37500K .......... .......... .......... .......... .......... 40% 297M 0s 2024-09-14T11:42:23.821 INFO:teuthology.orchestra.run.smithi138.stderr: 37550K .......... .......... .......... .......... .......... 40% 294M 0s 2024-09-14T11:42:23.821 INFO:teuthology.orchestra.run.smithi138.stderr: 37600K .......... .......... .......... .......... .......... 40% 233M 0s 2024-09-14T11:42:23.821 INFO:teuthology.orchestra.run.smithi138.stderr: 37650K .......... .......... .......... .......... .......... 40% 277M 0s 2024-09-14T11:42:23.821 INFO:teuthology.orchestra.run.smithi138.stderr: 37700K .......... .......... .......... .......... .......... 40% 211M 0s 2024-09-14T11:42:23.821 INFO:teuthology.orchestra.run.smithi138.stderr: 37750K .......... .......... .......... .......... .......... 40% 261M 0s 2024-09-14T11:42:23.821 INFO:teuthology.orchestra.run.smithi138.stderr: 37800K .......... .......... .......... .......... .......... 40% 277M 0s 2024-09-14T11:42:23.821 INFO:teuthology.orchestra.run.smithi138.stderr: 37850K .......... .......... .......... .......... .......... 40% 277M 0s 2024-09-14T11:42:23.822 INFO:teuthology.orchestra.run.smithi138.stderr: 37900K .......... .......... .......... .......... .......... 40% 269M 0s 2024-09-14T11:42:23.822 INFO:teuthology.orchestra.run.smithi138.stderr: 37950K .......... .......... .......... .......... .......... 40% 299M 0s 2024-09-14T11:42:23.822 INFO:teuthology.orchestra.run.smithi138.stderr: 38000K .......... .......... .......... .......... .......... 40% 277M 0s 2024-09-14T11:42:23.822 INFO:teuthology.orchestra.run.smithi138.stderr: 38050K .......... .......... .......... .......... .......... 41% 284M 0s 2024-09-14T11:42:23.822 INFO:teuthology.orchestra.run.smithi138.stderr: 38100K .......... .......... .......... .......... .......... 41% 234M 0s 2024-09-14T11:42:23.822 INFO:teuthology.orchestra.run.smithi138.stderr: 38150K .......... .......... .......... .......... .......... 41% 286M 0s 2024-09-14T11:42:23.822 INFO:teuthology.orchestra.run.smithi138.stderr: 38200K .......... .......... .......... .......... .......... 41% 299M 0s 2024-09-14T11:42:23.822 INFO:teuthology.orchestra.run.smithi138.stderr: 38250K .......... .......... .......... .......... .......... 41% 265M 0s 2024-09-14T11:42:23.822 INFO:teuthology.orchestra.run.smithi138.stderr: 38300K .......... .......... .......... .......... .......... 41% 297M 0s 2024-09-14T11:42:23.822 INFO:teuthology.orchestra.run.smithi138.stderr: 38350K .......... .......... .......... .......... .......... 41% 256M 0s 2024-09-14T11:42:23.822 INFO:teuthology.orchestra.run.smithi138.stderr: 38400K .......... .......... .......... .......... .......... 41% 287M 0s 2024-09-14T11:42:23.822 INFO:teuthology.orchestra.run.smithi138.stderr: 38450K .......... .......... .......... .......... .......... 41% 288M 0s 2024-09-14T11:42:23.822 INFO:teuthology.orchestra.run.smithi138.stderr: 38500K .......... .......... .......... .......... .......... 41% 305M 0s 2024-09-14T11:42:23.822 INFO:teuthology.orchestra.run.smithi138.stderr: 38550K .......... .......... .......... .......... .......... 41% 276M 0s 2024-09-14T11:42:23.823 INFO:teuthology.orchestra.run.smithi138.stderr: 38600K .......... .......... .......... .......... .......... 41% 295M 0s 2024-09-14T11:42:23.823 INFO:teuthology.orchestra.run.smithi138.stderr: 38650K .......... .......... .......... .......... .......... 41% 295M 0s 2024-09-14T11:42:23.823 INFO:teuthology.orchestra.run.smithi138.stderr: 38700K .......... .......... .......... .......... .......... 41% 270M 0s 2024-09-14T11:42:23.823 INFO:teuthology.orchestra.run.smithi138.stderr: 38750K .......... .......... .......... .......... .......... 41% 260M 0s 2024-09-14T11:42:23.823 INFO:teuthology.orchestra.run.smithi138.stderr: 38800K .......... .......... .......... .......... .......... 41% 323M 0s 2024-09-14T11:42:23.823 INFO:teuthology.orchestra.run.smithi138.stderr: 38850K .......... .......... .......... .......... .......... 41% 277M 0s 2024-09-14T11:42:23.823 INFO:teuthology.orchestra.run.smithi138.stderr: 38900K .......... .......... .......... .......... .......... 41% 312M 0s 2024-09-14T11:42:23.823 INFO:teuthology.orchestra.run.smithi138.stderr: 38950K .......... .......... .......... .......... .......... 41% 300M 0s 2024-09-14T11:42:23.823 INFO:teuthology.orchestra.run.smithi138.stderr: 39000K .......... .......... .......... .......... .......... 42% 316M 0s 2024-09-14T11:42:23.823 INFO:teuthology.orchestra.run.smithi138.stderr: 39050K .......... .......... .......... .......... .......... 42% 283M 0s 2024-09-14T11:42:23.823 INFO:teuthology.orchestra.run.smithi138.stderr: 39100K .......... .......... .......... .......... .......... 42% 49.9M 0s 2024-09-14T11:42:23.823 INFO:teuthology.orchestra.run.smithi138.stderr: 39150K .......... .......... .......... .......... .......... 42% 233M 0s 2024-09-14T11:42:23.823 INFO:teuthology.orchestra.run.smithi138.stderr: 39200K .......... .......... .......... .......... .......... 42% 278M 0s 2024-09-14T11:42:23.824 INFO:teuthology.orchestra.run.smithi138.stderr: 39250K .......... .......... .......... .......... .......... 42% 298M 0s 2024-09-14T11:42:23.824 INFO:teuthology.orchestra.run.smithi138.stderr: 39300K .......... .......... .......... .......... .......... 42% 295M 0s 2024-09-14T11:42:23.824 INFO:teuthology.orchestra.run.smithi138.stderr: 39350K .......... .......... .......... .......... .......... 42% 305M 0s 2024-09-14T11:42:23.824 INFO:teuthology.orchestra.run.smithi138.stderr: 39400K .......... .......... .......... .......... .......... 42% 162M 0s 2024-09-14T11:42:23.824 INFO:teuthology.orchestra.run.smithi138.stderr: 39450K .......... .......... .......... .......... .......... 42% 145M 0s 2024-09-14T11:42:23.824 INFO:teuthology.orchestra.run.smithi138.stderr: 39500K .......... .......... .......... .......... .......... 42% 170M 0s 2024-09-14T11:42:23.824 INFO:teuthology.orchestra.run.smithi138.stderr: 39550K .......... .......... .......... .......... .......... 42% 268M 0s 2024-09-14T11:42:23.824 INFO:teuthology.orchestra.run.smithi138.stderr: 39600K .......... .......... .......... .......... .......... 42% 303M 0s 2024-09-14T11:42:23.824 INFO:teuthology.orchestra.run.smithi138.stderr: 39650K .......... .......... .......... .......... .......... 42% 265M 0s 2024-09-14T11:42:23.824 INFO:teuthology.orchestra.run.smithi138.stderr: 39700K .......... .......... .......... .......... .......... 42% 319M 0s 2024-09-14T11:42:23.824 INFO:teuthology.orchestra.run.smithi138.stderr: 39750K .......... .......... .......... .......... .......... 42% 312M 0s 2024-09-14T11:42:23.824 INFO:teuthology.orchestra.run.smithi138.stderr: 39800K .......... .......... .......... .......... .......... 42% 285M 0s 2024-09-14T11:42:23.824 INFO:teuthology.orchestra.run.smithi138.stderr: 39850K .......... .......... .......... .......... .......... 42% 292M 0s 2024-09-14T11:42:23.825 INFO:teuthology.orchestra.run.smithi138.stderr: 39900K .......... .......... .......... .......... .......... 43% 170M 0s 2024-09-14T11:42:23.825 INFO:teuthology.orchestra.run.smithi138.stderr: 39950K .......... .......... .......... .......... .......... 43% 257M 0s 2024-09-14T11:42:23.825 INFO:teuthology.orchestra.run.smithi138.stderr: 40000K .......... .......... .......... .......... .......... 43% 289M 0s 2024-09-14T11:42:23.825 INFO:teuthology.orchestra.run.smithi138.stderr: 40050K .......... .......... .......... .......... .......... 43% 266M 0s 2024-09-14T11:42:23.825 INFO:teuthology.orchestra.run.smithi138.stderr: 40100K .......... .......... .......... .......... .......... 43% 292M 0s 2024-09-14T11:42:23.825 INFO:teuthology.orchestra.run.smithi138.stderr: 40150K .......... .......... .......... .......... .......... 43% 263M 0s 2024-09-14T11:42:23.825 INFO:teuthology.orchestra.run.smithi138.stderr: 40200K .......... .......... .......... .......... .......... 43% 298M 0s 2024-09-14T11:42:23.825 INFO:teuthology.orchestra.run.smithi138.stderr: 40250K .......... .......... .......... .......... .......... 43% 292M 0s 2024-09-14T11:42:23.825 INFO:teuthology.orchestra.run.smithi138.stderr: 40300K .......... .......... .......... .......... .......... 43% 295M 0s 2024-09-14T11:42:23.825 INFO:teuthology.orchestra.run.smithi138.stderr: 40350K .......... .......... .......... .......... .......... 43% 252M 0s 2024-09-14T11:42:23.825 INFO:teuthology.orchestra.run.smithi138.stderr: 40400K .......... .......... .......... .......... .......... 43% 313M 0s 2024-09-14T11:42:23.825 INFO:teuthology.orchestra.run.smithi138.stderr: 40450K .......... .......... .......... .......... .......... 43% 316M 0s 2024-09-14T11:42:23.825 INFO:teuthology.orchestra.run.smithi138.stderr: 40500K .......... .......... .......... .......... .......... 43% 115M 0s 2024-09-14T11:42:23.826 INFO:teuthology.orchestra.run.smithi138.stderr: 40550K .......... .......... .......... .......... .......... 43% 262M 0s 2024-09-14T11:42:23.826 INFO:teuthology.orchestra.run.smithi138.stderr: 40600K .......... .......... .......... .......... .......... 43% 257M 0s 2024-09-14T11:42:23.826 INFO:teuthology.orchestra.run.smithi138.stderr: 40650K .......... .......... .......... .......... .......... 43% 284M 0s 2024-09-14T11:42:23.826 INFO:teuthology.orchestra.run.smithi138.stderr: 40700K .......... .......... .......... .......... .......... 43% 271M 0s 2024-09-14T11:42:23.826 INFO:teuthology.orchestra.run.smithi138.stderr: 40750K .......... .......... .......... .......... .......... 43% 303M 0s 2024-09-14T11:42:23.826 INFO:teuthology.orchestra.run.smithi138.stderr: 40800K .......... .......... .......... .......... .......... 43% 257M 0s 2024-09-14T11:42:23.826 INFO:teuthology.orchestra.run.smithi138.stderr: 40850K .......... .......... .......... .......... .......... 44% 299M 0s 2024-09-14T11:42:23.826 INFO:teuthology.orchestra.run.smithi138.stderr: 40900K .......... .......... .......... .......... .......... 44% 298M 0s 2024-09-14T11:42:23.826 INFO:teuthology.orchestra.run.smithi138.stderr: 40950K .......... .......... .......... .......... .......... 44% 258M 0s 2024-09-14T11:42:23.826 INFO:teuthology.orchestra.run.smithi138.stderr: 41000K .......... .......... .......... .......... .......... 44% 271M 0s 2024-09-14T11:42:23.826 INFO:teuthology.orchestra.run.smithi138.stderr: 41050K .......... .......... .......... .......... .......... 44% 215M 0s 2024-09-14T11:42:23.826 INFO:teuthology.orchestra.run.smithi138.stderr: 41100K .......... .......... .......... .......... .......... 44% 240M 0s 2024-09-14T11:42:23.826 INFO:teuthology.orchestra.run.smithi138.stderr: 41150K .......... .......... .......... .......... .......... 44% 235M 0s 2024-09-14T11:42:23.826 INFO:teuthology.orchestra.run.smithi138.stderr: 41200K .......... .......... .......... .......... .......... 44% 296M 0s 2024-09-14T11:42:23.827 INFO:teuthology.orchestra.run.smithi138.stderr: 41250K .......... .......... .......... .......... .......... 44% 295M 0s 2024-09-14T11:42:23.827 INFO:teuthology.orchestra.run.smithi138.stderr: 41300K .......... .......... .......... .......... .......... 44% 302M 0s 2024-09-14T11:42:23.827 INFO:teuthology.orchestra.run.smithi138.stderr: 41350K .......... .......... .......... .......... .......... 44% 257M 0s 2024-09-14T11:42:23.827 INFO:teuthology.orchestra.run.smithi138.stderr: 41400K .......... .......... .......... .......... .......... 44% 286M 0s 2024-09-14T11:42:23.827 INFO:teuthology.orchestra.run.smithi138.stderr: 41450K .......... .......... .......... .......... .......... 44% 297M 0s 2024-09-14T11:42:23.827 INFO:teuthology.orchestra.run.smithi138.stderr: 41500K .......... .......... .......... .......... .......... 44% 295M 0s 2024-09-14T11:42:23.827 INFO:teuthology.orchestra.run.smithi138.stderr: 41550K .......... .......... .......... .......... .......... 44% 257M 0s 2024-09-14T11:42:23.827 INFO:teuthology.orchestra.run.smithi138.stderr: 41600K .......... .......... .......... .......... .......... 44% 294M 0s 2024-09-14T11:42:23.827 INFO:teuthology.orchestra.run.smithi138.stderr: 41650K .......... .......... .......... .......... .......... 44% 294M 0s 2024-09-14T11:42:23.827 INFO:teuthology.orchestra.run.smithi138.stderr: 41700K .......... .......... .......... .......... .......... 44% 310M 0s 2024-09-14T11:42:23.827 INFO:teuthology.orchestra.run.smithi138.stderr: 41750K .......... .......... .......... .......... .......... 44% 271M 0s 2024-09-14T11:42:23.827 INFO:teuthology.orchestra.run.smithi138.stderr: 41800K .......... .......... .......... .......... .......... 45% 325M 0s 2024-09-14T11:42:23.827 INFO:teuthology.orchestra.run.smithi138.stderr: 41850K .......... .......... .......... .......... .......... 45% 319M 0s 2024-09-14T11:42:23.828 INFO:teuthology.orchestra.run.smithi138.stderr: 41900K .......... .......... .......... .......... .......... 45% 36.3M 0s 2024-09-14T11:42:23.828 INFO:teuthology.orchestra.run.smithi138.stderr: 41950K .......... .......... .......... .......... .......... 45% 241M 0s 2024-09-14T11:42:23.828 INFO:teuthology.orchestra.run.smithi138.stderr: 42000K .......... .......... .......... .......... .......... 45% 292M 0s 2024-09-14T11:42:23.828 INFO:teuthology.orchestra.run.smithi138.stderr: 42050K .......... .......... .......... .......... .......... 45% 299M 0s 2024-09-14T11:42:23.828 INFO:teuthology.orchestra.run.smithi138.stderr: 42100K .......... .......... .......... .......... .......... 45% 305M 0s 2024-09-14T11:42:23.828 INFO:teuthology.orchestra.run.smithi138.stderr: 42150K .......... .......... .......... .......... .......... 45% 261M 0s 2024-09-14T11:42:23.828 INFO:teuthology.orchestra.run.smithi138.stderr: 42200K .......... .......... .......... .......... .......... 45% 315M 0s 2024-09-14T11:42:23.828 INFO:teuthology.orchestra.run.smithi138.stderr: 42250K .......... .......... .......... .......... .......... 45% 281M 0s 2024-09-14T11:42:23.828 INFO:teuthology.orchestra.run.smithi138.stderr: 42300K .......... .......... .......... .......... .......... 45% 289M 0s 2024-09-14T11:42:23.828 INFO:teuthology.orchestra.run.smithi138.stderr: 42350K .......... .......... .......... .......... .......... 45% 324M 0s 2024-09-14T11:42:23.828 INFO:teuthology.orchestra.run.smithi138.stderr: 42400K .......... .......... .......... .......... .......... 45% 308M 0s 2024-09-14T11:42:23.828 INFO:teuthology.orchestra.run.smithi138.stderr: 42450K .......... .......... .......... .......... .......... 45% 314M 0s 2024-09-14T11:42:23.828 INFO:teuthology.orchestra.run.smithi138.stderr: 42500K .......... .......... .......... .......... .......... 45% 293M 0s 2024-09-14T11:42:23.829 INFO:teuthology.orchestra.run.smithi138.stderr: 42550K .......... .......... .......... .......... .......... 45% 294M 0s 2024-09-14T11:42:23.829 INFO:teuthology.orchestra.run.smithi138.stderr: 42600K .......... .......... .......... .......... .......... 45% 334M 0s 2024-09-14T11:42:23.829 INFO:teuthology.orchestra.run.smithi138.stderr: 42650K .......... .......... .......... .......... .......... 45% 333M 0s 2024-09-14T11:42:23.829 INFO:teuthology.orchestra.run.smithi138.stderr: 42700K .......... .......... .......... .......... .......... 46% 305M 0s 2024-09-14T11:42:23.829 INFO:teuthology.orchestra.run.smithi138.stderr: 42750K .......... .......... .......... .......... .......... 46% 264M 0s 2024-09-14T11:42:23.829 INFO:teuthology.orchestra.run.smithi138.stderr: 42800K .......... .......... .......... .......... .......... 46% 314M 0s 2024-09-14T11:42:23.829 INFO:teuthology.orchestra.run.smithi138.stderr: 42850K .......... .......... .......... .......... .......... 46% 296M 0s 2024-09-14T11:42:23.829 INFO:teuthology.orchestra.run.smithi138.stderr: 42900K .......... .......... .......... .......... .......... 46% 319M 0s 2024-09-14T11:42:23.829 INFO:teuthology.orchestra.run.smithi138.stderr: 42950K .......... .......... .......... .......... .......... 46% 313M 0s 2024-09-14T11:42:23.829 INFO:teuthology.orchestra.run.smithi138.stderr: 43000K .......... .......... .......... .......... .......... 46% 325M 0s 2024-09-14T11:42:23.829 INFO:teuthology.orchestra.run.smithi138.stderr: 43050K .......... .......... .......... .......... .......... 46% 125M 0s 2024-09-14T11:42:23.829 INFO:teuthology.orchestra.run.smithi138.stderr: 43100K .......... .......... .......... .......... .......... 46% 267M 0s 2024-09-14T11:42:23.829 INFO:teuthology.orchestra.run.smithi138.stderr: 43150K .......... .......... .......... .......... .......... 46% 273M 0s 2024-09-14T11:42:23.829 INFO:teuthology.orchestra.run.smithi138.stderr: 43200K .......... .......... .......... .......... .......... 46% 301M 0s 2024-09-14T11:42:23.830 INFO:teuthology.orchestra.run.smithi138.stderr: 43250K .......... .......... .......... .......... .......... 46% 272M 0s 2024-09-14T11:42:23.830 INFO:teuthology.orchestra.run.smithi138.stderr: 43300K .......... .......... .......... .......... .......... 46% 314M 0s 2024-09-14T11:42:23.830 INFO:teuthology.orchestra.run.smithi138.stderr: 43350K .......... .......... .......... .......... .......... 46% 304M 0s 2024-09-14T11:42:23.830 INFO:teuthology.orchestra.run.smithi138.stderr: 43400K .......... .......... .......... .......... .......... 46% 120M 0s 2024-09-14T11:42:23.830 INFO:teuthology.orchestra.run.smithi138.stderr: 43450K .......... .......... .......... .......... .......... 46% 206M 0s 2024-09-14T11:42:23.830 INFO:teuthology.orchestra.run.smithi138.stderr: 43500K .......... .......... .......... .......... .......... 46% 270M 0s 2024-09-14T11:42:23.830 INFO:teuthology.orchestra.run.smithi138.stderr: 43550K .......... .......... .......... .......... .......... 46% 297M 0s 2024-09-14T11:42:23.830 INFO:teuthology.orchestra.run.smithi138.stderr: 43600K .......... .......... .......... .......... .......... 46% 292M 0s 2024-09-14T11:42:23.830 INFO:teuthology.orchestra.run.smithi138.stderr: 43650K .......... .......... .......... .......... .......... 47% 326M 0s 2024-09-14T11:42:23.830 INFO:teuthology.orchestra.run.smithi138.stderr: 43700K .......... .......... .......... .......... .......... 47% 258M 0s 2024-09-14T11:42:23.830 INFO:teuthology.orchestra.run.smithi138.stderr: 43750K .......... .......... .......... .......... .......... 47% 321M 0s 2024-09-14T11:42:23.830 INFO:teuthology.orchestra.run.smithi138.stderr: 43800K .......... .......... .......... .......... .......... 47% 310M 0s 2024-09-14T11:42:23.830 INFO:teuthology.orchestra.run.smithi138.stderr: 43850K .......... .......... .......... .......... .......... 47% 324M 0s 2024-09-14T11:42:23.831 INFO:teuthology.orchestra.run.smithi138.stderr: 43900K .......... .......... .......... .......... .......... 47% 333M 0s 2024-09-14T11:42:23.831 INFO:teuthology.orchestra.run.smithi138.stderr: 43950K .......... .......... .......... .......... .......... 47% 263M 0s 2024-09-14T11:42:23.831 INFO:teuthology.orchestra.run.smithi138.stderr: 44000K .......... .......... .......... .......... .......... 47% 309M 0s 2024-09-14T11:42:23.831 INFO:teuthology.orchestra.run.smithi138.stderr: 44050K .......... .......... .......... .......... .......... 47% 308M 0s 2024-09-14T11:42:23.831 INFO:teuthology.orchestra.run.smithi138.stderr: 44100K .......... .......... .......... .......... .......... 47% 306M 0s 2024-09-14T11:42:23.831 INFO:teuthology.orchestra.run.smithi138.stderr: 44150K .......... .......... .......... .......... .......... 47% 291M 0s 2024-09-14T11:42:23.831 INFO:teuthology.orchestra.run.smithi138.stderr: 44200K .......... .......... .......... .......... .......... 47% 316M 0s 2024-09-14T11:42:23.831 INFO:teuthology.orchestra.run.smithi138.stderr: 44250K .......... .......... .......... .......... .......... 47% 313M 0s 2024-09-14T11:42:23.831 INFO:teuthology.orchestra.run.smithi138.stderr: 44300K .......... .......... .......... .......... .......... 47% 234M 0s 2024-09-14T11:42:23.831 INFO:teuthology.orchestra.run.smithi138.stderr: 44350K .......... .......... .......... .......... .......... 47% 262M 0s 2024-09-14T11:42:23.831 INFO:teuthology.orchestra.run.smithi138.stderr: 44400K .......... .......... .......... .......... .......... 47% 304M 0s 2024-09-14T11:42:23.831 INFO:teuthology.orchestra.run.smithi138.stderr: 44450K .......... .......... .......... .......... .......... 47% 324M 0s 2024-09-14T11:42:23.831 INFO:teuthology.orchestra.run.smithi138.stderr: 44500K .......... .......... .......... .......... .......... 47% 308M 0s 2024-09-14T11:42:23.832 INFO:teuthology.orchestra.run.smithi138.stderr: 44550K .......... .......... .......... .......... .......... 48% 315M 0s 2024-09-14T11:42:23.832 INFO:teuthology.orchestra.run.smithi138.stderr: 44600K .......... .......... .......... .......... .......... 48% 287M 0s 2024-09-14T11:42:23.832 INFO:teuthology.orchestra.run.smithi138.stderr: 44650K .......... .......... .......... .......... .......... 48% 248M 0s 2024-09-14T11:42:23.832 INFO:teuthology.orchestra.run.smithi138.stderr: 44700K .......... .......... .......... .......... .......... 48% 335M 0s 2024-09-14T11:42:23.832 INFO:teuthology.orchestra.run.smithi138.stderr: 44750K .......... .......... .......... .......... .......... 48% 27.0M 0s 2024-09-14T11:42:23.832 INFO:teuthology.orchestra.run.smithi138.stderr: 44800K .......... .......... .......... .......... .......... 48% 277M 0s 2024-09-14T11:42:23.832 INFO:teuthology.orchestra.run.smithi138.stderr: 44850K .......... .......... .......... .......... .......... 48% 295M 0s 2024-09-14T11:42:23.832 INFO:teuthology.orchestra.run.smithi138.stderr: 44900K .......... .......... .......... .......... .......... 48% 328M 0s 2024-09-14T11:42:23.832 INFO:teuthology.orchestra.run.smithi138.stderr: 44950K .......... .......... .......... .......... .......... 48% 341M 0s 2024-09-14T11:42:23.832 INFO:teuthology.orchestra.run.smithi138.stderr: 45000K .......... .......... .......... .......... .......... 48% 296M 0s 2024-09-14T11:42:23.832 INFO:teuthology.orchestra.run.smithi138.stderr: 45050K .......... .......... .......... .......... .......... 48% 247M 0s 2024-09-14T11:42:23.832 INFO:teuthology.orchestra.run.smithi138.stderr: 45100K .......... .......... .......... .......... .......... 48% 315M 0s 2024-09-14T11:42:23.833 INFO:teuthology.orchestra.run.smithi138.stderr: 45150K .......... .......... .......... .......... .......... 48% 266M 0s 2024-09-14T11:42:23.833 INFO:teuthology.orchestra.run.smithi138.stderr: 45200K .......... .......... .......... .......... .......... 48% 331M 0s 2024-09-14T11:42:23.833 INFO:teuthology.orchestra.run.smithi138.stderr: 45250K .......... .......... .......... .......... .......... 48% 286M 0s 2024-09-14T11:42:23.833 INFO:teuthology.orchestra.run.smithi138.stderr: 45300K .......... .......... .......... .......... .......... 48% 185M 0s 2024-09-14T11:42:23.833 INFO:teuthology.orchestra.run.smithi138.stderr: 45350K .......... .......... .......... .......... .......... 48% 180M 0s 2024-09-14T11:42:23.833 INFO:teuthology.orchestra.run.smithi138.stderr: 45400K .......... .......... .......... .......... .......... 48% 359M 0s 2024-09-14T11:42:23.833 INFO:teuthology.orchestra.run.smithi138.stderr: 45450K .......... .......... .......... .......... .......... 48% 309M 0s 2024-09-14T11:42:23.833 INFO:teuthology.orchestra.run.smithi138.stderr: 45500K .......... .......... .......... .......... .......... 49% 368M 0s 2024-09-14T11:42:23.833 INFO:teuthology.orchestra.run.smithi138.stderr: 45550K .......... .......... .......... .......... .......... 49% 331M 0s 2024-09-14T11:42:23.833 INFO:teuthology.orchestra.run.smithi138.stderr: 45600K .......... .......... .......... .......... .......... 49% 360M 0s 2024-09-14T11:42:23.833 INFO:teuthology.orchestra.run.smithi138.stderr: 45650K .......... .......... .......... .......... .......... 49% 367M 0s 2024-09-14T11:42:23.833 INFO:teuthology.orchestra.run.smithi138.stderr: 45700K .......... .......... .......... .......... .......... 49% 399M 0s 2024-09-14T11:42:23.833 INFO:teuthology.orchestra.run.smithi138.stderr: 45750K .......... .......... .......... .......... .......... 49% 358M 0s 2024-09-14T11:42:23.834 INFO:teuthology.orchestra.run.smithi138.stderr: 45800K .......... .......... .......... .......... .......... 49% 318M 0s 2024-09-14T11:42:23.834 INFO:teuthology.orchestra.run.smithi138.stderr: 45850K .......... .......... .......... .......... .......... 49% 363M 0s 2024-09-14T11:42:23.834 INFO:teuthology.orchestra.run.smithi138.stderr: 45900K .......... .......... .......... .......... .......... 49% 400M 0s 2024-09-14T11:42:23.834 INFO:teuthology.orchestra.run.smithi138.stderr: 45950K .......... .......... .......... .......... .......... 49% 395M 0s 2024-09-14T11:42:23.834 INFO:teuthology.orchestra.run.smithi138.stderr: 46000K .......... .......... .......... .......... .......... 49% 324M 0s 2024-09-14T11:42:23.834 INFO:teuthology.orchestra.run.smithi138.stderr: 46050K .......... .......... .......... .......... .......... 49% 343M 0s 2024-09-14T11:42:23.834 INFO:teuthology.orchestra.run.smithi138.stderr: 46100K .......... .......... .......... .......... .......... 49% 388M 0s 2024-09-14T11:42:23.834 INFO:teuthology.orchestra.run.smithi138.stderr: 46150K .......... .......... .......... .......... .......... 49% 270M 0s 2024-09-14T11:42:23.834 INFO:teuthology.orchestra.run.smithi138.stderr: 46200K .......... .......... .......... .......... .......... 49% 139M 0s 2024-09-14T11:42:23.834 INFO:teuthology.orchestra.run.smithi138.stderr: 46250K .......... .......... .......... .......... .......... 49% 350M 0s 2024-09-14T11:42:23.834 INFO:teuthology.orchestra.run.smithi138.stderr: 46300K .......... .......... .......... .......... .......... 49% 371M 0s 2024-09-14T11:42:23.834 INFO:teuthology.orchestra.run.smithi138.stderr: 46350K .......... .......... .......... .......... .......... 49% 105M 0s 2024-09-14T11:42:23.834 INFO:teuthology.orchestra.run.smithi138.stderr: 46400K .......... .......... .......... .......... .......... 49% 304M 0s 2024-09-14T11:42:23.835 INFO:teuthology.orchestra.run.smithi138.stderr: 46450K .......... .......... .......... .......... .......... 50% 372M 0s 2024-09-14T11:42:23.835 INFO:teuthology.orchestra.run.smithi138.stderr: 46500K .......... .......... .......... .......... .......... 50% 315M 0s 2024-09-14T11:42:23.835 INFO:teuthology.orchestra.run.smithi138.stderr: 46550K .......... .......... .......... .......... .......... 50% 400M 0s 2024-09-14T11:42:23.835 INFO:teuthology.orchestra.run.smithi138.stderr: 46600K .......... .......... .......... .......... .......... 50% 278M 0s 2024-09-14T11:42:23.835 INFO:teuthology.orchestra.run.smithi138.stderr: 46650K .......... .......... .......... .......... .......... 50% 163M 0s 2024-09-14T11:42:23.835 INFO:teuthology.orchestra.run.smithi138.stderr: 46700K .......... .......... .......... .......... .......... 50% 318M 0s 2024-09-14T11:42:23.835 INFO:teuthology.orchestra.run.smithi138.stderr: 46750K .......... .......... .......... .......... .......... 50% 357M 0s 2024-09-14T11:42:23.835 INFO:teuthology.orchestra.run.smithi138.stderr: 46800K .......... .......... .......... .......... .......... 50% 383M 0s 2024-09-14T11:42:23.835 INFO:teuthology.orchestra.run.smithi138.stderr: 46850K .......... .......... .......... .......... .......... 50% 371M 0s 2024-09-14T11:42:23.835 INFO:teuthology.orchestra.run.smithi138.stderr: 46900K .......... .......... .......... .......... .......... 50% 142M 0s 2024-09-14T11:42:23.835 INFO:teuthology.orchestra.run.smithi138.stderr: 46950K .......... .......... .......... .......... .......... 50% 337M 0s 2024-09-14T11:42:23.835 INFO:teuthology.orchestra.run.smithi138.stderr: 47000K .......... .......... .......... .......... .......... 50% 357M 0s 2024-09-14T11:42:23.835 INFO:teuthology.orchestra.run.smithi138.stderr: 47050K .......... .......... .......... .......... .......... 50% 388M 0s 2024-09-14T11:42:23.836 INFO:teuthology.orchestra.run.smithi138.stderr: 47100K .......... .......... .......... .......... .......... 50% 346M 0s 2024-09-14T11:42:23.836 INFO:teuthology.orchestra.run.smithi138.stderr: 47150K .......... .......... .......... .......... .......... 50% 350M 0s 2024-09-14T11:42:23.836 INFO:teuthology.orchestra.run.smithi138.stderr: 47200K .......... .......... .......... .......... .......... 50% 329M 0s 2024-09-14T11:42:23.836 INFO:teuthology.orchestra.run.smithi138.stderr: 47250K .......... .......... .......... .......... .......... 50% 282M 0s 2024-09-14T11:42:23.836 INFO:teuthology.orchestra.run.smithi138.stderr: 47300K .......... .......... .......... .......... .......... 50% 376M 0s 2024-09-14T11:42:23.836 INFO:teuthology.orchestra.run.smithi138.stderr: 47350K .......... .......... .......... .......... .......... 51% 342M 0s 2024-09-14T11:42:23.836 INFO:teuthology.orchestra.run.smithi138.stderr: 47400K .......... .......... .......... .......... .......... 51% 393M 0s 2024-09-14T11:42:23.836 INFO:teuthology.orchestra.run.smithi138.stderr: 47450K .......... .......... .......... .......... .......... 51% 154M 0s 2024-09-14T11:42:23.836 INFO:teuthology.orchestra.run.smithi138.stderr: 47500K .......... .......... .......... .......... .......... 51% 309M 0s 2024-09-14T11:42:23.836 INFO:teuthology.orchestra.run.smithi138.stderr: 47550K .......... .......... .......... .......... .......... 51% 365M 0s 2024-09-14T11:42:23.836 INFO:teuthology.orchestra.run.smithi138.stderr: 47600K .......... .......... .......... .......... .......... 51% 393M 0s 2024-09-14T11:42:23.836 INFO:teuthology.orchestra.run.smithi138.stderr: 47650K .......... .......... .......... .......... .......... 51% 277M 0s 2024-09-14T11:42:23.836 INFO:teuthology.orchestra.run.smithi138.stderr: 47700K .......... .......... .......... .......... .......... 51% 372M 0s 2024-09-14T11:42:23.837 INFO:teuthology.orchestra.run.smithi138.stderr: 47750K .......... .......... .......... .......... .......... 51% 26.1M 0s 2024-09-14T11:42:23.837 INFO:teuthology.orchestra.run.smithi138.stderr: 47800K .......... .......... .......... .......... .......... 51% 359M 0s 2024-09-14T11:42:23.837 INFO:teuthology.orchestra.run.smithi138.stderr: 47850K .......... .......... .......... .......... .......... 51% 155M 0s 2024-09-14T11:42:23.837 INFO:teuthology.orchestra.run.smithi138.stderr: 47900K .......... .......... .......... .......... .......... 51% 362M 0s 2024-09-14T11:42:23.837 INFO:teuthology.orchestra.run.smithi138.stderr: 47950K .......... .......... .......... .......... .......... 51% 372M 0s 2024-09-14T11:42:23.837 INFO:teuthology.orchestra.run.smithi138.stderr: 48000K .......... .......... .......... .......... .......... 51% 285M 0s 2024-09-14T11:42:23.837 INFO:teuthology.orchestra.run.smithi138.stderr: 48050K .......... .......... .......... .......... .......... 51% 388M 0s 2024-09-14T11:42:23.837 INFO:teuthology.orchestra.run.smithi138.stderr: 48100K .......... .......... .......... .......... .......... 51% 361M 0s 2024-09-14T11:42:23.837 INFO:teuthology.orchestra.run.smithi138.stderr: 48150K .......... .......... .......... .......... .......... 51% 391M 0s 2024-09-14T11:42:23.837 INFO:teuthology.orchestra.run.smithi138.stderr: 48200K .......... .......... .......... .......... .......... 51% 267M 0s 2024-09-14T11:42:23.837 INFO:teuthology.orchestra.run.smithi138.stderr: 48250K .......... .......... .......... .......... .......... 51% 343M 0s 2024-09-14T11:42:23.837 INFO:teuthology.orchestra.run.smithi138.stderr: 48300K .......... .......... .......... .......... .......... 52% 352M 0s 2024-09-14T11:42:23.837 INFO:teuthology.orchestra.run.smithi138.stderr: 48350K .......... .......... .......... .......... .......... 52% 398M 0s 2024-09-14T11:42:23.837 INFO:teuthology.orchestra.run.smithi138.stderr: 48400K .......... .......... .......... .......... .......... 52% 123M 0s 2024-09-14T11:42:23.838 INFO:teuthology.orchestra.run.smithi138.stderr: 48450K .......... .......... .......... .......... .......... 52% 382M 0s 2024-09-14T11:42:23.838 INFO:teuthology.orchestra.run.smithi138.stderr: 48500K .......... .......... .......... .......... .......... 52% 328M 0s 2024-09-14T11:42:23.838 INFO:teuthology.orchestra.run.smithi138.stderr: 48550K .......... .......... .......... .......... .......... 52% 360M 0s 2024-09-14T11:42:23.838 INFO:teuthology.orchestra.run.smithi138.stderr: 48600K .......... .......... .......... .......... .......... 52% 254M 0s 2024-09-14T11:42:23.838 INFO:teuthology.orchestra.run.smithi138.stderr: 48650K .......... .......... .......... .......... .......... 52% 338M 0s 2024-09-14T11:42:23.838 INFO:teuthology.orchestra.run.smithi138.stderr: 48700K .......... .......... .......... .......... .......... 52% 296M 0s 2024-09-14T11:42:23.838 INFO:teuthology.orchestra.run.smithi138.stderr: 48750K .......... .......... .......... .......... .......... 52% 390M 0s 2024-09-14T11:42:23.838 INFO:teuthology.orchestra.run.smithi138.stderr: 48800K .......... .......... .......... .......... .......... 52% 347M 0s 2024-09-14T11:42:23.838 INFO:teuthology.orchestra.run.smithi138.stderr: 48850K .......... .......... .......... .......... .......... 52% 355M 0s 2024-09-14T11:42:23.838 INFO:teuthology.orchestra.run.smithi138.stderr: 48900K .......... .......... .......... .......... .......... 52% 360M 0s 2024-09-14T11:42:23.838 INFO:teuthology.orchestra.run.smithi138.stderr: 48950K .......... .......... .......... .......... .......... 52% 380M 0s 2024-09-14T11:42:23.838 INFO:teuthology.orchestra.run.smithi138.stderr: 49000K .......... .......... .......... .......... .......... 52% 341M 0s 2024-09-14T11:42:23.838 INFO:teuthology.orchestra.run.smithi138.stderr: 49050K .......... .......... .......... .......... .......... 52% 377M 0s 2024-09-14T11:42:23.838 INFO:teuthology.orchestra.run.smithi138.stderr: 49100K .......... .......... .......... .......... .......... 52% 148M 0s 2024-09-14T11:42:23.839 INFO:teuthology.orchestra.run.smithi138.stderr: 49150K .......... .......... .......... .......... .......... 52% 373M 0s 2024-09-14T11:42:23.839 INFO:teuthology.orchestra.run.smithi138.stderr: 49200K .......... .......... .......... .......... .......... 53% 386M 0s 2024-09-14T11:42:23.839 INFO:teuthology.orchestra.run.smithi138.stderr: 49250K .......... .......... .......... .......... .......... 53% 262M 0s 2024-09-14T11:42:23.839 INFO:teuthology.orchestra.run.smithi138.stderr: 49300K .......... .......... .......... .......... .......... 53% 320M 0s 2024-09-14T11:42:23.839 INFO:teuthology.orchestra.run.smithi138.stderr: 49350K .......... .......... .......... .......... .......... 53% 152M 0s 2024-09-14T11:42:23.839 INFO:teuthology.orchestra.run.smithi138.stderr: 49400K .......... .......... .......... .......... .......... 53% 284M 0s 2024-09-14T11:42:23.839 INFO:teuthology.orchestra.run.smithi138.stderr: 49450K .......... .......... .......... .......... .......... 53% 351M 0s 2024-09-14T11:42:23.839 INFO:teuthology.orchestra.run.smithi138.stderr: 49500K .......... .......... .......... .......... .......... 53% 286M 0s 2024-09-14T11:42:23.839 INFO:teuthology.orchestra.run.smithi138.stderr: 49550K .......... .......... .......... .......... .......... 53% 365M 0s 2024-09-14T11:42:23.839 INFO:teuthology.orchestra.run.smithi138.stderr: 49600K .......... .......... .......... .......... .......... 53% 128M 0s 2024-09-14T11:42:23.839 INFO:teuthology.orchestra.run.smithi138.stderr: 49650K .......... .......... .......... .......... .......... 53% 357M 0s 2024-09-14T11:42:23.839 INFO:teuthology.orchestra.run.smithi138.stderr: 49700K .......... .......... .......... .......... .......... 53% 180M 0s 2024-09-14T11:42:23.839 INFO:teuthology.orchestra.run.smithi138.stderr: 49750K .......... .......... .......... .......... .......... 53% 290M 0s 2024-09-14T11:42:23.840 INFO:teuthology.orchestra.run.smithi138.stderr: 49800K .......... .......... .......... .......... .......... 53% 289M 0s 2024-09-14T11:42:23.840 INFO:teuthology.orchestra.run.smithi138.stderr: 49850K .......... .......... .......... .......... .......... 53% 315M 0s 2024-09-14T11:42:23.840 INFO:teuthology.orchestra.run.smithi138.stderr: 49900K .......... .......... .......... .......... .......... 53% 334M 0s 2024-09-14T11:42:23.840 INFO:teuthology.orchestra.run.smithi138.stderr: 49950K .......... .......... .......... .......... .......... 53% 191M 0s 2024-09-14T11:42:23.840 INFO:teuthology.orchestra.run.smithi138.stderr: 50000K .......... .......... .......... .......... .......... 53% 272M 0s 2024-09-14T11:42:23.840 INFO:teuthology.orchestra.run.smithi138.stderr: 50050K .......... .......... .......... .......... .......... 53% 286M 0s 2024-09-14T11:42:23.840 INFO:teuthology.orchestra.run.smithi138.stderr: 50100K .......... .......... .......... .......... .......... 53% 396M 0s 2024-09-14T11:42:23.840 INFO:teuthology.orchestra.run.smithi138.stderr: 50150K .......... .......... .......... .......... .......... 54% 386M 0s 2024-09-14T11:42:23.840 INFO:teuthology.orchestra.run.smithi138.stderr: 50200K .......... .......... .......... .......... .......... 54% 350M 0s 2024-09-14T11:42:23.840 INFO:teuthology.orchestra.run.smithi138.stderr: 50250K .......... .......... .......... .......... .......... 54% 344M 0s 2024-09-14T11:42:23.840 INFO:teuthology.orchestra.run.smithi138.stderr: 50300K .......... .......... .......... .......... .......... 54% 393M 0s 2024-09-14T11:42:23.840 INFO:teuthology.orchestra.run.smithi138.stderr: 50350K .......... .......... .......... .......... .......... 54% 315M 0s 2024-09-14T11:42:23.841 INFO:teuthology.orchestra.run.smithi138.stderr: 50400K .......... .......... .......... .......... .......... 54% 380M 0s 2024-09-14T11:42:23.841 INFO:teuthology.orchestra.run.smithi138.stderr: 50450K .......... .......... .......... .......... .......... 54% 332M 0s 2024-09-14T11:42:23.841 INFO:teuthology.orchestra.run.smithi138.stderr: 50500K .......... .......... .......... .......... .......... 54% 220M 0s 2024-09-14T11:42:23.841 INFO:teuthology.orchestra.run.smithi138.stderr: 50550K .......... .......... .......... .......... .......... 54% 352M 0s 2024-09-14T11:42:23.841 INFO:teuthology.orchestra.run.smithi138.stderr: 50600K .......... .......... .......... .......... .......... 54% 367M 0s 2024-09-14T11:42:23.841 INFO:teuthology.orchestra.run.smithi138.stderr: 50650K .......... .......... .......... .......... .......... 54% 373M 0s 2024-09-14T11:42:23.841 INFO:teuthology.orchestra.run.smithi138.stderr: 50700K .......... .......... .......... .......... .......... 54% 30.0M 0s 2024-09-14T11:42:23.841 INFO:teuthology.orchestra.run.smithi138.stderr: 50750K .......... .......... .......... .......... .......... 54% 255M 0s 2024-09-14T11:42:23.841 INFO:teuthology.orchestra.run.smithi138.stderr: 50800K .......... .......... .......... .......... .......... 54% 159M 0s 2024-09-14T11:42:23.841 INFO:teuthology.orchestra.run.smithi138.stderr: 50850K .......... .......... .......... .......... .......... 54% 198M 0s 2024-09-14T11:42:23.841 INFO:teuthology.orchestra.run.smithi138.stderr: 50900K .......... .......... .......... .......... .......... 54% 380M 0s 2024-09-14T11:42:23.842 INFO:teuthology.orchestra.run.smithi138.stderr: 50950K .......... .......... .......... .......... .......... 54% 204M 0s 2024-09-14T11:42:23.842 INFO:teuthology.orchestra.run.smithi138.stderr: 51000K .......... .......... .......... .......... .......... 54% 250M 0s 2024-09-14T11:42:23.842 INFO:teuthology.orchestra.run.smithi138.stderr: 51050K .......... .......... .......... .......... .......... 55% 259M 0s 2024-09-14T11:42:23.842 INFO:teuthology.orchestra.run.smithi138.stderr: 51100K .......... .......... .......... .......... .......... 55% 368M 0s 2024-09-14T11:42:23.842 INFO:teuthology.orchestra.run.smithi138.stderr: 51150K .......... .......... .......... .......... .......... 55% 399M 0s 2024-09-14T11:42:23.842 INFO:teuthology.orchestra.run.smithi138.stderr: 51200K .......... .......... .......... .......... .......... 55% 375M 0s 2024-09-14T11:42:23.842 INFO:teuthology.orchestra.run.smithi138.stderr: 51250K .......... .......... .......... .......... .......... 55% 319M 0s 2024-09-14T11:42:23.842 INFO:teuthology.orchestra.run.smithi138.stderr: 51300K .......... .......... .......... .......... .......... 55% 326M 0s 2024-09-14T11:42:23.842 INFO:teuthology.orchestra.run.smithi138.stderr: 51350K .......... .......... .......... .......... .......... 55% 257M 0s 2024-09-14T11:42:23.842 INFO:teuthology.orchestra.run.smithi138.stderr: 51400K .......... .......... .......... .......... .......... 55% 310M 0s 2024-09-14T11:42:23.842 INFO:teuthology.orchestra.run.smithi138.stderr: 51450K .......... .......... .......... .......... .......... 55% 158M 0s 2024-09-14T11:42:23.842 INFO:teuthology.orchestra.run.smithi138.stderr: 51500K .......... .......... .......... .......... .......... 55% 306M 0s 2024-09-14T11:42:23.842 INFO:teuthology.orchestra.run.smithi138.stderr: 51550K .......... .......... .......... .......... .......... 55% 324M 0s 2024-09-14T11:42:23.843 INFO:teuthology.orchestra.run.smithi138.stderr: 51600K .......... .......... .......... .......... .......... 55% 127M 0s 2024-09-14T11:42:23.843 INFO:teuthology.orchestra.run.smithi138.stderr: 51650K .......... .......... .......... .......... .......... 55% 347M 0s 2024-09-14T11:42:23.843 INFO:teuthology.orchestra.run.smithi138.stderr: 51700K .......... .......... .......... .......... .......... 55% 319M 0s 2024-09-14T11:42:23.843 INFO:teuthology.orchestra.run.smithi138.stderr: 51750K .......... .......... .......... .......... .......... 55% 398M 0s 2024-09-14T11:42:23.843 INFO:teuthology.orchestra.run.smithi138.stderr: 51800K .......... .......... .......... .......... .......... 55% 362M 0s 2024-09-14T11:42:23.843 INFO:teuthology.orchestra.run.smithi138.stderr: 51850K .......... .......... .......... .......... .......... 55% 407M 0s 2024-09-14T11:42:23.843 INFO:teuthology.orchestra.run.smithi138.stderr: 51900K .......... .......... .......... .......... .......... 55% 324M 0s 2024-09-14T11:42:23.843 INFO:teuthology.orchestra.run.smithi138.stderr: 51950K .......... .......... .......... .......... .......... 55% 381M 0s 2024-09-14T11:42:23.843 INFO:teuthology.orchestra.run.smithi138.stderr: 52000K .......... .......... .......... .......... .......... 56% 396M 0s 2024-09-14T11:42:23.843 INFO:teuthology.orchestra.run.smithi138.stderr: 52050K .......... .......... .......... .......... .......... 56% 359M 0s 2024-09-14T11:42:23.843 INFO:teuthology.orchestra.run.smithi138.stderr: 52100K .......... .......... .......... .......... .......... 56% 351M 0s 2024-09-14T11:42:23.843 INFO:teuthology.orchestra.run.smithi138.stderr: 52150K .......... .......... .......... .......... .......... 56% 325M 0s 2024-09-14T11:42:23.843 INFO:teuthology.orchestra.run.smithi138.stderr: 52200K .......... .......... .......... .......... .......... 56% 365M 0s 2024-09-14T11:42:23.844 INFO:teuthology.orchestra.run.smithi138.stderr: 52250K .......... .......... .......... .......... .......... 56% 293M 0s 2024-09-14T11:42:23.844 INFO:teuthology.orchestra.run.smithi138.stderr: 52300K .......... .......... .......... .......... .......... 56% 380M 0s 2024-09-14T11:42:23.844 INFO:teuthology.orchestra.run.smithi138.stderr: 52350K .......... .......... .......... .......... .......... 56% 402M 0s 2024-09-14T11:42:23.844 INFO:teuthology.orchestra.run.smithi138.stderr: 52400K .......... .......... .......... .......... .......... 56% 97.8M 0s 2024-09-14T11:42:23.844 INFO:teuthology.orchestra.run.smithi138.stderr: 52450K .......... .......... .......... .......... .......... 56% 256M 0s 2024-09-14T11:42:23.844 INFO:teuthology.orchestra.run.smithi138.stderr: 52500K .......... .......... .......... .......... .......... 56% 372M 0s 2024-09-14T11:42:23.844 INFO:teuthology.orchestra.run.smithi138.stderr: 52550K .......... .......... .......... .......... .......... 56% 298M 0s 2024-09-14T11:42:23.844 INFO:teuthology.orchestra.run.smithi138.stderr: 52600K .......... .......... .......... .......... .......... 56% 296M 0s 2024-09-14T11:42:23.844 INFO:teuthology.orchestra.run.smithi138.stderr: 52650K .......... .......... .......... .......... .......... 56% 296M 0s 2024-09-14T11:42:23.844 INFO:teuthology.orchestra.run.smithi138.stderr: 52700K .......... .......... .......... .......... .......... 56% 361M 0s 2024-09-14T11:42:23.844 INFO:teuthology.orchestra.run.smithi138.stderr: 52750K .......... .......... .......... .......... .......... 56% 260M 0s 2024-09-14T11:42:23.844 INFO:teuthology.orchestra.run.smithi138.stderr: 52800K .......... .......... .......... .......... .......... 56% 106M 0s 2024-09-14T11:42:23.844 INFO:teuthology.orchestra.run.smithi138.stderr: 52850K .......... .......... .......... .......... .......... 56% 302M 0s 2024-09-14T11:42:23.845 INFO:teuthology.orchestra.run.smithi138.stderr: 52900K .......... .......... .......... .......... .......... 56% 359M 0s 2024-09-14T11:42:23.845 INFO:teuthology.orchestra.run.smithi138.stderr: 52950K .......... .......... .......... .......... .......... 57% 395M 0s 2024-09-14T11:42:23.845 INFO:teuthology.orchestra.run.smithi138.stderr: 53000K .......... .......... .......... .......... .......... 57% 302M 0s 2024-09-14T11:42:23.845 INFO:teuthology.orchestra.run.smithi138.stderr: 53050K .......... .......... .......... .......... .......... 57% 291M 0s 2024-09-14T11:42:23.845 INFO:teuthology.orchestra.run.smithi138.stderr: 53100K .......... .......... .......... .......... .......... 57% 323M 0s 2024-09-14T11:42:23.845 INFO:teuthology.orchestra.run.smithi138.stderr: 53150K .......... .......... .......... .......... .......... 57% 368M 0s 2024-09-14T11:42:23.845 INFO:teuthology.orchestra.run.smithi138.stderr: 53200K .......... .......... .......... .......... .......... 57% 383M 0s 2024-09-14T11:42:23.845 INFO:teuthology.orchestra.run.smithi138.stderr: 53250K .......... .......... .......... .......... .......... 57% 320M 0s 2024-09-14T11:42:23.845 INFO:teuthology.orchestra.run.smithi138.stderr: 53300K .......... .......... .......... .......... .......... 57% 324M 0s 2024-09-14T11:42:23.845 INFO:teuthology.orchestra.run.smithi138.stderr: 53350K .......... .......... .......... .......... .......... 57% 313M 0s 2024-09-14T11:42:23.845 INFO:teuthology.orchestra.run.smithi138.stderr: 53400K .......... .......... .......... .......... .......... 57% 385M 0s 2024-09-14T11:42:23.845 INFO:teuthology.orchestra.run.smithi138.stderr: 53450K .......... .......... .......... .......... .......... 57% 383M 0s 2024-09-14T11:42:23.846 INFO:teuthology.orchestra.run.smithi138.stderr: 53500K .......... .......... .......... .......... .......... 57% 215M 0s 2024-09-14T11:42:23.846 INFO:teuthology.orchestra.run.smithi138.stderr: 53550K .......... .......... .......... .......... .......... 57% 244M 0s 2024-09-14T11:42:23.846 INFO:teuthology.orchestra.run.smithi138.stderr: 53600K .......... .......... .......... .......... .......... 57% 367M 0s 2024-09-14T11:42:23.846 INFO:teuthology.orchestra.run.smithi138.stderr: 53650K .......... .......... .......... .......... .......... 57% 383M 0s 2024-09-14T11:42:23.846 INFO:teuthology.orchestra.run.smithi138.stderr: 53700K .......... .......... .......... .......... .......... 57% 55.2M 0s 2024-09-14T11:42:23.846 INFO:teuthology.orchestra.run.smithi138.stderr: 53750K .......... .......... .......... .......... .......... 57% 321M 0s 2024-09-14T11:42:23.846 INFO:teuthology.orchestra.run.smithi138.stderr: 53800K .......... .......... .......... .......... .......... 57% 61.6M 0s 2024-09-14T11:42:23.846 INFO:teuthology.orchestra.run.smithi138.stderr: 53850K .......... .......... .......... .......... .......... 58% 91.0M 0s 2024-09-14T11:42:23.846 INFO:teuthology.orchestra.run.smithi138.stderr: 53900K .......... .......... .......... .......... .......... 58% 333M 0s 2024-09-14T11:42:23.846 INFO:teuthology.orchestra.run.smithi138.stderr: 53950K .......... .......... .......... .......... .......... 58% 303M 0s 2024-09-14T11:42:23.846 INFO:teuthology.orchestra.run.smithi138.stderr: 54000K .......... .......... .......... .......... .......... 58% 348M 0s 2024-09-14T11:42:23.846 INFO:teuthology.orchestra.run.smithi138.stderr: 54050K .......... .......... .......... .......... .......... 58% 152M 0s 2024-09-14T11:42:23.846 INFO:teuthology.orchestra.run.smithi138.stderr: 54100K .......... .......... .......... .......... .......... 58% 347M 0s 2024-09-14T11:42:23.846 INFO:teuthology.orchestra.run.smithi138.stderr: 54150K .......... .......... .......... .......... .......... 58% 352M 0s 2024-09-14T11:42:23.847 INFO:teuthology.orchestra.run.smithi138.stderr: 54200K .......... .......... .......... .......... .......... 58% 388M 0s 2024-09-14T11:42:23.847 INFO:teuthology.orchestra.run.smithi138.stderr: 54250K .......... .......... .......... .......... .......... 58% 318M 0s 2024-09-14T11:42:23.847 INFO:teuthology.orchestra.run.smithi138.stderr: 54300K .......... .......... .......... .......... .......... 58% 387M 0s 2024-09-14T11:42:23.847 INFO:teuthology.orchestra.run.smithi138.stderr: 54350K .......... .......... .......... .......... .......... 58% 369M 0s 2024-09-14T11:42:23.847 INFO:teuthology.orchestra.run.smithi138.stderr: 54400K .......... .......... .......... .......... .......... 58% 354M 0s 2024-09-14T11:42:23.847 INFO:teuthology.orchestra.run.smithi138.stderr: 54450K .......... .......... .......... .......... .......... 58% 363M 0s 2024-09-14T11:42:23.847 INFO:teuthology.orchestra.run.smithi138.stderr: 54500K .......... .......... .......... .......... .......... 58% 247M 0s 2024-09-14T11:42:23.847 INFO:teuthology.orchestra.run.smithi138.stderr: 54550K .......... .......... .......... .......... .......... 58% 280M 0s 2024-09-14T11:42:23.847 INFO:teuthology.orchestra.run.smithi138.stderr: 54600K .......... .......... .......... .......... .......... 58% 145M 0s 2024-09-14T11:42:23.847 INFO:teuthology.orchestra.run.smithi138.stderr: 54650K .......... .......... .......... .......... .......... 58% 218M 0s 2024-09-14T11:42:23.847 INFO:teuthology.orchestra.run.smithi138.stderr: 54700K .......... .......... .......... .......... .......... 58% 292M 0s 2024-09-14T11:42:23.847 INFO:teuthology.orchestra.run.smithi138.stderr: 54750K .......... .......... .......... .......... .......... 58% 253M 0s 2024-09-14T11:42:23.847 INFO:teuthology.orchestra.run.smithi138.stderr: 54800K .......... .......... .......... .......... .......... 59% 227M 0s 2024-09-14T11:42:23.847 INFO:teuthology.orchestra.run.smithi138.stderr: 54850K .......... .......... .......... .......... .......... 59% 210M 0s 2024-09-14T11:42:23.848 INFO:teuthology.orchestra.run.smithi138.stderr: 54900K .......... .......... .......... .......... .......... 59% 231M 0s 2024-09-14T11:42:23.848 INFO:teuthology.orchestra.run.smithi138.stderr: 54950K .......... .......... .......... .......... .......... 59% 396M 0s 2024-09-14T11:42:23.848 INFO:teuthology.orchestra.run.smithi138.stderr: 55000K .......... .......... .......... .......... .......... 59% 345M 0s 2024-09-14T11:42:23.848 INFO:teuthology.orchestra.run.smithi138.stderr: 55050K .......... .......... .......... .......... .......... 59% 293M 0s 2024-09-14T11:42:23.848 INFO:teuthology.orchestra.run.smithi138.stderr: 55100K .......... .......... .......... .......... .......... 59% 293M 0s 2024-09-14T11:42:23.848 INFO:teuthology.orchestra.run.smithi138.stderr: 55150K .......... .......... .......... .......... .......... 59% 375M 0s 2024-09-14T11:42:23.848 INFO:teuthology.orchestra.run.smithi138.stderr: 55200K .......... .......... .......... .......... .......... 59% 377M 0s 2024-09-14T11:42:23.848 INFO:teuthology.orchestra.run.smithi138.stderr: 55250K .......... .......... .......... .......... .......... 59% 404M 0s 2024-09-14T11:42:23.848 INFO:teuthology.orchestra.run.smithi138.stderr: 55300K .......... .......... .......... .......... .......... 59% 308M 0s 2024-09-14T11:42:23.848 INFO:teuthology.orchestra.run.smithi138.stderr: 55350K .......... .......... .......... .......... .......... 59% 296M 0s 2024-09-14T11:42:23.848 INFO:teuthology.orchestra.run.smithi138.stderr: 55400K .......... .......... .......... .......... .......... 59% 366M 0s 2024-09-14T11:42:23.848 INFO:teuthology.orchestra.run.smithi138.stderr: 55450K .......... .......... .......... .......... .......... 59% 375M 0s 2024-09-14T11:42:23.849 INFO:teuthology.orchestra.run.smithi138.stderr: 55500K .......... .......... .......... .......... .......... 59% 300M 0s 2024-09-14T11:42:23.849 INFO:teuthology.orchestra.run.smithi138.stderr: 55550K .......... .......... .......... .......... .......... 59% 342M 0s 2024-09-14T11:42:23.849 INFO:teuthology.orchestra.run.smithi138.stderr: 55600K .......... .......... .......... .......... .......... 59% 317M 0s 2024-09-14T11:42:23.849 INFO:teuthology.orchestra.run.smithi138.stderr: 55650K .......... .......... .......... .......... .......... 59% 373M 0s 2024-09-14T11:42:23.849 INFO:teuthology.orchestra.run.smithi138.stderr: 55700K .......... .......... .......... .......... .......... 60% 96.4M 0s 2024-09-14T11:42:23.849 INFO:teuthology.orchestra.run.smithi138.stderr: 55750K .......... .......... .......... .......... .......... 60% 362M 0s 2024-09-14T11:42:23.849 INFO:teuthology.orchestra.run.smithi138.stderr: 55800K .......... .......... .......... .......... .......... 60% 328M 0s 2024-09-14T11:42:23.849 INFO:teuthology.orchestra.run.smithi138.stderr: 55850K .......... .......... .......... .......... .......... 60% 374M 0s 2024-09-14T11:42:23.849 INFO:teuthology.orchestra.run.smithi138.stderr: 55900K .......... .......... .......... .......... .......... 60% 383M 0s 2024-09-14T11:42:23.849 INFO:teuthology.orchestra.run.smithi138.stderr: 55950K .......... .......... .......... .......... .......... 60% 132M 0s 2024-09-14T11:42:23.849 INFO:teuthology.orchestra.run.smithi138.stderr: 56000K .......... .......... .......... .......... .......... 60% 302M 0s 2024-09-14T11:42:23.849 INFO:teuthology.orchestra.run.smithi138.stderr: 56050K .......... .......... .......... .......... .......... 60% 374M 0s 2024-09-14T11:42:23.849 INFO:teuthology.orchestra.run.smithi138.stderr: 56100K .......... .......... .......... .......... .......... 60% 376M 0s 2024-09-14T11:42:23.849 INFO:teuthology.orchestra.run.smithi138.stderr: 56150K .......... .......... .......... .......... .......... 60% 386M 0s 2024-09-14T11:42:23.850 INFO:teuthology.orchestra.run.smithi138.stderr: 56200K .......... .......... .......... .......... .......... 60% 366M 0s 2024-09-14T11:42:23.850 INFO:teuthology.orchestra.run.smithi138.stderr: 56250K .......... .......... .......... .......... .......... 60% 362M 0s 2024-09-14T11:42:23.850 INFO:teuthology.orchestra.run.smithi138.stderr: 56300K .......... .......... .......... .......... .......... 60% 231M 0s 2024-09-14T11:42:23.850 INFO:teuthology.orchestra.run.smithi138.stderr: 56350K .......... .......... .......... .......... .......... 60% 370M 0s 2024-09-14T11:42:23.850 INFO:teuthology.orchestra.run.smithi138.stderr: 56400K .......... .......... .......... .......... .......... 60% 400M 0s 2024-09-14T11:42:23.850 INFO:teuthology.orchestra.run.smithi138.stderr: 56450K .......... .......... .......... .......... .......... 60% 254M 0s 2024-09-14T11:42:23.850 INFO:teuthology.orchestra.run.smithi138.stderr: 56500K .......... .......... .......... .......... .......... 60% 333M 0s 2024-09-14T11:42:23.850 INFO:teuthology.orchestra.run.smithi138.stderr: 56550K .......... .......... .......... .......... .......... 60% 380M 0s 2024-09-14T11:42:23.850 INFO:teuthology.orchestra.run.smithi138.stderr: 56600K .......... .......... .......... .......... .......... 60% 390M 0s 2024-09-14T11:42:23.850 INFO:teuthology.orchestra.run.smithi138.stderr: 56650K .......... .......... .......... .......... .......... 61% 52.5M 0s 2024-09-14T11:42:23.850 INFO:teuthology.orchestra.run.smithi138.stderr: 56700K .......... .......... .......... .......... .......... 61% 280M 0s 2024-09-14T11:42:23.850 INFO:teuthology.orchestra.run.smithi138.stderr: 56750K .......... .......... .......... .......... .......... 61% 353M 0s 2024-09-14T11:42:23.850 INFO:teuthology.orchestra.run.smithi138.stderr: 56800K .......... .......... .......... .......... .......... 61% 396M 0s 2024-09-14T11:42:23.851 INFO:teuthology.orchestra.run.smithi138.stderr: 56850K .......... .......... .......... .......... .......... 61% 48.5M 0s 2024-09-14T11:42:23.851 INFO:teuthology.orchestra.run.smithi138.stderr: 56900K .......... .......... .......... .......... .......... 61% 346M 0s 2024-09-14T11:42:23.851 INFO:teuthology.orchestra.run.smithi138.stderr: 56950K .......... .......... .......... .......... .......... 61% 188M 0s 2024-09-14T11:42:23.851 INFO:teuthology.orchestra.run.smithi138.stderr: 57000K .......... .......... .......... .......... .......... 61% 144M 0s 2024-09-14T11:42:23.851 INFO:teuthology.orchestra.run.smithi138.stderr: 57050K .......... .......... .......... .......... .......... 61% 46.3M 0s 2024-09-14T11:42:23.851 INFO:teuthology.orchestra.run.smithi138.stderr: 57100K .......... .......... .......... .......... .......... 61% 85.0M 0s 2024-09-14T11:42:23.851 INFO:teuthology.orchestra.run.smithi138.stderr: 57150K .......... .......... .......... .......... .......... 61% 205M 0s 2024-09-14T11:42:23.851 INFO:teuthology.orchestra.run.smithi138.stderr: 57200K .......... .......... .......... .......... .......... 61% 342M 0s 2024-09-14T11:42:23.851 INFO:teuthology.orchestra.run.smithi138.stderr: 57250K .......... .......... .......... .......... .......... 61% 331M 0s 2024-09-14T11:42:23.851 INFO:teuthology.orchestra.run.smithi138.stderr: 57300K .......... .......... .......... .......... .......... 61% 303M 0s 2024-09-14T11:42:23.851 INFO:teuthology.orchestra.run.smithi138.stderr: 57350K .......... .......... .......... .......... .......... 61% 332M 0s 2024-09-14T11:42:23.851 INFO:teuthology.orchestra.run.smithi138.stderr: 57400K .......... .......... .......... .......... .......... 61% 348M 0s 2024-09-14T11:42:23.851 INFO:teuthology.orchestra.run.smithi138.stderr: 57450K .......... .......... .......... .......... .......... 61% 224M 0s 2024-09-14T11:42:23.852 INFO:teuthology.orchestra.run.smithi138.stderr: 57500K .......... .......... .......... .......... .......... 61% 340M 0s 2024-09-14T11:42:23.852 INFO:teuthology.orchestra.run.smithi138.stderr: 57550K .......... .......... .......... .......... .......... 62% 332M 0s 2024-09-14T11:42:23.852 INFO:teuthology.orchestra.run.smithi138.stderr: 57600K .......... .......... .......... .......... .......... 62% 345M 0s 2024-09-14T11:42:23.852 INFO:teuthology.orchestra.run.smithi138.stderr: 57650K .......... .......... .......... .......... .......... 62% 360M 0s 2024-09-14T11:42:23.852 INFO:teuthology.orchestra.run.smithi138.stderr: 57700K .......... .......... .......... .......... .......... 62% 352M 0s 2024-09-14T11:42:23.852 INFO:teuthology.orchestra.run.smithi138.stderr: 57750K .......... .......... .......... .......... .......... 62% 309M 0s 2024-09-14T11:42:23.852 INFO:teuthology.orchestra.run.smithi138.stderr: 57800K .......... .......... .......... .......... .......... 62% 344M 0s 2024-09-14T11:42:23.852 INFO:teuthology.orchestra.run.smithi138.stderr: 57850K .......... .......... .......... .......... .......... 62% 314M 0s 2024-09-14T11:42:23.852 INFO:teuthology.orchestra.run.smithi138.stderr: 57900K .......... .......... .......... .......... .......... 62% 355M 0s 2024-09-14T11:42:23.852 INFO:teuthology.orchestra.run.smithi138.stderr: 57950K .......... .......... .......... .......... .......... 62% 286M 0s 2024-09-14T11:42:23.852 INFO:teuthology.orchestra.run.smithi138.stderr: 58000K .......... .......... .......... .......... .......... 62% 368M 0s 2024-09-14T11:42:23.852 INFO:teuthology.orchestra.run.smithi138.stderr: 58050K .......... .......... .......... .......... .......... 62% 370M 0s 2024-09-14T11:42:23.853 INFO:teuthology.orchestra.run.smithi138.stderr: 58100K .......... .......... .......... .......... .......... 62% 342M 0s 2024-09-14T11:42:23.853 INFO:teuthology.orchestra.run.smithi138.stderr: 58150K .......... .......... .......... .......... .......... 62% 317M 0s 2024-09-14T11:42:23.853 INFO:teuthology.orchestra.run.smithi138.stderr: 58200K .......... .......... .......... .......... .......... 62% 375M 0s 2024-09-14T11:42:23.853 INFO:teuthology.orchestra.run.smithi138.stderr: 58250K .......... .......... .......... .......... .......... 62% 346M 0s 2024-09-14T11:42:23.853 INFO:teuthology.orchestra.run.smithi138.stderr: 58300K .......... .......... .......... .......... .......... 62% 328M 0s 2024-09-14T11:42:23.853 INFO:teuthology.orchestra.run.smithi138.stderr: 58350K .......... .......... .......... .......... .......... 62% 311M 0s 2024-09-14T11:42:23.853 INFO:teuthology.orchestra.run.smithi138.stderr: 58400K .......... .......... .......... .......... .......... 62% 372M 0s 2024-09-14T11:42:23.853 INFO:teuthology.orchestra.run.smithi138.stderr: 58450K .......... .......... .......... .......... .......... 62% 310M 0s 2024-09-14T11:42:23.853 INFO:teuthology.orchestra.run.smithi138.stderr: 58500K .......... .......... .......... .......... .......... 63% 355M 0s 2024-09-14T11:42:23.853 INFO:teuthology.orchestra.run.smithi138.stderr: 58550K .......... .......... .......... .......... .......... 63% 370M 0s 2024-09-14T11:42:23.853 INFO:teuthology.orchestra.run.smithi138.stderr: 58600K .......... .......... .......... .......... .......... 63% 355M 0s 2024-09-14T11:42:23.853 INFO:teuthology.orchestra.run.smithi138.stderr: 58650K .......... .......... .......... .......... .......... 63% 306M 0s 2024-09-14T11:42:23.853 INFO:teuthology.orchestra.run.smithi138.stderr: 58700K .......... .......... .......... .......... .......... 63% 369M 0s 2024-09-14T11:42:23.854 INFO:teuthology.orchestra.run.smithi138.stderr: 58750K .......... .......... .......... .......... .......... 63% 327M 0s 2024-09-14T11:42:23.854 INFO:teuthology.orchestra.run.smithi138.stderr: 58800K .......... .......... .......... .......... .......... 63% 341M 0s 2024-09-14T11:42:23.854 INFO:teuthology.orchestra.run.smithi138.stderr: 58850K .......... .......... .......... .......... .......... 63% 328M 0s 2024-09-14T11:42:23.854 INFO:teuthology.orchestra.run.smithi138.stderr: 58900K .......... .......... .......... .......... .......... 63% 332M 0s 2024-09-14T11:42:23.854 INFO:teuthology.orchestra.run.smithi138.stderr: 58950K .......... .......... .......... .......... .......... 63% 334M 0s 2024-09-14T11:42:23.854 INFO:teuthology.orchestra.run.smithi138.stderr: 59000K .......... .......... .......... .......... .......... 63% 362M 0s 2024-09-14T11:42:23.854 INFO:teuthology.orchestra.run.smithi138.stderr: 59050K .......... .......... .......... .......... .......... 63% 342M 0s 2024-09-14T11:42:23.854 INFO:teuthology.orchestra.run.smithi138.stderr: 59100K .......... .......... .......... .......... .......... 63% 298M 0s 2024-09-14T11:42:23.854 INFO:teuthology.orchestra.run.smithi138.stderr: 59150K .......... .......... .......... .......... .......... 63% 350M 0s 2024-09-14T11:42:23.854 INFO:teuthology.orchestra.run.smithi138.stderr: 59200K .......... .......... .......... .......... .......... 63% 366M 0s 2024-09-14T11:42:23.854 INFO:teuthology.orchestra.run.smithi138.stderr: 59250K .......... .......... .......... .......... .......... 63% 325M 0s 2024-09-14T11:42:23.854 INFO:teuthology.orchestra.run.smithi138.stderr: 59300K .......... .......... .......... .......... .......... 63% 288M 0s 2024-09-14T11:42:23.854 INFO:teuthology.orchestra.run.smithi138.stderr: 59350K .......... .......... .......... .......... .......... 63% 306M 0s 2024-09-14T11:42:23.855 INFO:teuthology.orchestra.run.smithi138.stderr: 59400K .......... .......... .......... .......... .......... 63% 361M 0s 2024-09-14T11:42:23.855 INFO:teuthology.orchestra.run.smithi138.stderr: 59450K .......... .......... .......... .......... .......... 64% 360M 0s 2024-09-14T11:42:23.855 INFO:teuthology.orchestra.run.smithi138.stderr: 59500K .......... .......... .......... .......... .......... 64% 347M 0s 2024-09-14T11:42:23.855 INFO:teuthology.orchestra.run.smithi138.stderr: 59550K .......... .......... .......... .......... .......... 64% 372M 0s 2024-09-14T11:42:23.855 INFO:teuthology.orchestra.run.smithi138.stderr: 59600K .......... .......... .......... .......... .......... 64% 386M 0s 2024-09-14T11:42:23.855 INFO:teuthology.orchestra.run.smithi138.stderr: 59650K .......... .......... .......... .......... .......... 64% 89.9M 0s 2024-09-14T11:42:23.855 INFO:teuthology.orchestra.run.smithi138.stderr: 59700K .......... .......... .......... .......... .......... 64% 308M 0s 2024-09-14T11:42:23.855 INFO:teuthology.orchestra.run.smithi138.stderr: 59750K .......... .......... .......... .......... .......... 64% 349M 0s 2024-09-14T11:42:23.855 INFO:teuthology.orchestra.run.smithi138.stderr: 59800K .......... .......... .......... .......... .......... 64% 337M 0s 2024-09-14T11:42:23.855 INFO:teuthology.orchestra.run.smithi138.stderr: 59850K .......... .......... .......... .......... .......... 64% 61.2M 0s 2024-09-14T11:42:23.855 INFO:teuthology.orchestra.run.smithi138.stderr: 59900K .......... .......... .......... .......... .......... 64% 246M 0s 2024-09-14T11:42:23.855 INFO:teuthology.orchestra.run.smithi138.stderr: 59950K .......... .......... .......... .......... .......... 64% 227M 0s 2024-09-14T11:42:23.856 INFO:teuthology.orchestra.run.smithi138.stderr: 60000K .......... .......... .......... .......... .......... 64% 25.0M 0s 2024-09-14T11:42:23.856 INFO:teuthology.orchestra.run.smithi138.stderr: 60050K .......... .......... .......... .......... .......... 64% 311M 0s 2024-09-14T11:42:23.856 INFO:teuthology.orchestra.run.smithi138.stderr: 60100K .......... .......... .......... .......... .......... 64% 46.9M 0s 2024-09-14T11:42:23.856 INFO:teuthology.orchestra.run.smithi138.stderr: 60150K .......... .......... .......... .......... .......... 64% 297M 0s 2024-09-14T11:42:23.856 INFO:teuthology.orchestra.run.smithi138.stderr: 60200K .......... .......... .......... .......... .......... 64% 313M 0s 2024-09-14T11:42:23.856 INFO:teuthology.orchestra.run.smithi138.stderr: 60250K .......... .......... .......... .......... .......... 64% 366M 0s 2024-09-14T11:42:23.856 INFO:teuthology.orchestra.run.smithi138.stderr: 60300K .......... .......... .......... .......... .......... 64% 286M 0s 2024-09-14T11:42:23.856 INFO:teuthology.orchestra.run.smithi138.stderr: 60350K .......... .......... .......... .......... .......... 65% 364M 0s 2024-09-14T11:42:23.856 INFO:teuthology.orchestra.run.smithi138.stderr: 60400K .......... .......... .......... .......... .......... 65% 167M 0s 2024-09-14T11:42:23.856 INFO:teuthology.orchestra.run.smithi138.stderr: 60450K .......... .......... .......... .......... .......... 65% 317M 0s 2024-09-14T11:42:23.856 INFO:teuthology.orchestra.run.smithi138.stderr: 60500K .......... .......... .......... .......... .......... 65% 300M 0s 2024-09-14T11:42:23.856 INFO:teuthology.orchestra.run.smithi138.stderr: 60550K .......... .......... .......... .......... .......... 65% 257M 0s 2024-09-14T11:42:23.856 INFO:teuthology.orchestra.run.smithi138.stderr: 60600K .......... .......... .......... .......... .......... 65% 272M 0s 2024-09-14T11:42:23.857 INFO:teuthology.orchestra.run.smithi138.stderr: 60650K .......... .......... .......... .......... .......... 65% 307M 0s 2024-09-14T11:42:23.857 INFO:teuthology.orchestra.run.smithi138.stderr: 60700K .......... .......... .......... .......... .......... 65% 271M 0s 2024-09-14T11:42:23.857 INFO:teuthology.orchestra.run.smithi138.stderr: 60750K .......... .......... .......... .......... .......... 65% 329M 0s 2024-09-14T11:42:23.857 INFO:teuthology.orchestra.run.smithi138.stderr: 60800K .......... .......... .......... .......... .......... 65% 350M 0s 2024-09-14T11:42:23.857 INFO:teuthology.orchestra.run.smithi138.stderr: 60850K .......... .......... .......... .......... .......... 65% 312M 0s 2024-09-14T11:42:23.857 INFO:teuthology.orchestra.run.smithi138.stderr: 60900K .......... .......... .......... .......... .......... 65% 360M 0s 2024-09-14T11:42:23.857 INFO:teuthology.orchestra.run.smithi138.stderr: 60950K .......... .......... .......... .......... .......... 65% 292M 0s 2024-09-14T11:42:23.857 INFO:teuthology.orchestra.run.smithi138.stderr: 61000K .......... .......... .......... .......... .......... 65% 365M 0s 2024-09-14T11:42:23.857 INFO:teuthology.orchestra.run.smithi138.stderr: 61050K .......... .......... .......... .......... .......... 65% 340M 0s 2024-09-14T11:42:23.857 INFO:teuthology.orchestra.run.smithi138.stderr: 61100K .......... .......... .......... .......... .......... 65% 356M 0s 2024-09-14T11:42:23.857 INFO:teuthology.orchestra.run.smithi138.stderr: 61150K .......... .......... .......... .......... .......... 65% 294M 0s 2024-09-14T11:42:23.857 INFO:teuthology.orchestra.run.smithi138.stderr: 61200K .......... .......... .......... .......... .......... 65% 344M 0s 2024-09-14T11:42:23.857 INFO:teuthology.orchestra.run.smithi138.stderr: 61250K .......... .......... .......... .......... .......... 65% 340M 0s 2024-09-14T11:42:23.857 INFO:teuthology.orchestra.run.smithi138.stderr: 61300K .......... .......... .......... .......... .......... 66% 361M 0s 2024-09-14T11:42:23.858 INFO:teuthology.orchestra.run.smithi138.stderr: 61350K .......... .......... .......... .......... .......... 66% 287M 0s 2024-09-14T11:42:23.858 INFO:teuthology.orchestra.run.smithi138.stderr: 61400K .......... .......... .......... .......... .......... 66% 356M 0s 2024-09-14T11:42:23.858 INFO:teuthology.orchestra.run.smithi138.stderr: 61450K .......... .......... .......... .......... .......... 66% 347M 0s 2024-09-14T11:42:23.858 INFO:teuthology.orchestra.run.smithi138.stderr: 61500K .......... .......... .......... .......... .......... 66% 324M 0s 2024-09-14T11:42:23.858 INFO:teuthology.orchestra.run.smithi138.stderr: 61550K .......... .......... .......... .......... .......... 66% 231M 0s 2024-09-14T11:42:23.858 INFO:teuthology.orchestra.run.smithi138.stderr: 61600K .......... .......... .......... .......... .......... 66% 328M 0s 2024-09-14T11:42:23.858 INFO:teuthology.orchestra.run.smithi138.stderr: 61650K .......... .......... .......... .......... .......... 66% 341M 0s 2024-09-14T11:42:23.858 INFO:teuthology.orchestra.run.smithi138.stderr: 61700K .......... .......... .......... .......... .......... 66% 349M 0s 2024-09-14T11:42:23.858 INFO:teuthology.orchestra.run.smithi138.stderr: 61750K .......... .......... .......... .......... .......... 66% 303M 0s 2024-09-14T11:42:23.858 INFO:teuthology.orchestra.run.smithi138.stderr: 61800K .......... .......... .......... .......... .......... 66% 350M 0s 2024-09-14T11:42:23.858 INFO:teuthology.orchestra.run.smithi138.stderr: 61850K .......... .......... .......... .......... .......... 66% 316M 0s 2024-09-14T11:42:23.858 INFO:teuthology.orchestra.run.smithi138.stderr: 61900K .......... .......... .......... .......... .......... 66% 267M 0s 2024-09-14T11:42:23.858 INFO:teuthology.orchestra.run.smithi138.stderr: 61950K .......... .......... .......... .......... .......... 66% 305M 0s 2024-09-14T11:42:23.859 INFO:teuthology.orchestra.run.smithi138.stderr: 62000K .......... .......... .......... .......... .......... 66% 326M 0s 2024-09-14T11:42:23.859 INFO:teuthology.orchestra.run.smithi138.stderr: 62050K .......... .......... .......... .......... .......... 66% 356M 0s 2024-09-14T11:42:23.859 INFO:teuthology.orchestra.run.smithi138.stderr: 62100K .......... .......... .......... .......... .......... 66% 365M 0s 2024-09-14T11:42:23.859 INFO:teuthology.orchestra.run.smithi138.stderr: 62150K .......... .......... .......... .......... .......... 66% 329M 0s 2024-09-14T11:42:23.859 INFO:teuthology.orchestra.run.smithi138.stderr: 62200K .......... .......... .......... .......... .......... 67% 348M 0s 2024-09-14T11:42:23.859 INFO:teuthology.orchestra.run.smithi138.stderr: 62250K .......... .......... .......... .......... .......... 67% 372M 0s 2024-09-14T11:42:23.859 INFO:teuthology.orchestra.run.smithi138.stderr: 62300K .......... .......... .......... .......... .......... 67% 341M 0s 2024-09-14T11:42:23.859 INFO:teuthology.orchestra.run.smithi138.stderr: 62350K .......... .......... .......... .......... .......... 67% 277M 0s 2024-09-14T11:42:23.859 INFO:teuthology.orchestra.run.smithi138.stderr: 62400K .......... .......... .......... .......... .......... 67% 364M 0s 2024-09-14T11:42:23.859 INFO:teuthology.orchestra.run.smithi138.stderr: 62450K .......... .......... .......... .......... .......... 67% 376M 0s 2024-09-14T11:42:23.859 INFO:teuthology.orchestra.run.smithi138.stderr: 62500K .......... .......... .......... .......... .......... 67% 373M 0s 2024-09-14T11:42:23.859 INFO:teuthology.orchestra.run.smithi138.stderr: 62550K .......... .......... .......... .......... .......... 67% 336M 0s 2024-09-14T11:42:23.859 INFO:teuthology.orchestra.run.smithi138.stderr: 62600K .......... .......... .......... .......... .......... 67% 378M 0s 2024-09-14T11:42:23.860 INFO:teuthology.orchestra.run.smithi138.stderr: 62650K .......... .......... .......... .......... .......... 67% 361M 0s 2024-09-14T11:42:23.860 INFO:teuthology.orchestra.run.smithi138.stderr: 62700K .......... .......... .......... .......... .......... 67% 352M 0s 2024-09-14T11:42:23.860 INFO:teuthology.orchestra.run.smithi138.stderr: 62750K .......... .......... .......... .......... .......... 67% 290M 0s 2024-09-14T11:42:23.860 INFO:teuthology.orchestra.run.smithi138.stderr: 62800K .......... .......... .......... .......... .......... 67% 352M 0s 2024-09-14T11:42:23.860 INFO:teuthology.orchestra.run.smithi138.stderr: 62850K .......... .......... .......... .......... .......... 67% 361M 0s 2024-09-14T11:42:23.860 INFO:teuthology.orchestra.run.smithi138.stderr: 62900K .......... .......... .......... .......... .......... 67% 363M 0s 2024-09-14T11:42:23.860 INFO:teuthology.orchestra.run.smithi138.stderr: 62950K .......... .......... .......... .......... .......... 67% 340M 0s 2024-09-14T11:42:23.860 INFO:teuthology.orchestra.run.smithi138.stderr: 63000K .......... .......... .......... .......... .......... 67% 27.6M 0s 2024-09-14T11:42:23.860 INFO:teuthology.orchestra.run.smithi138.stderr: 63050K .......... .......... .......... .......... .......... 67% 348M 0s 2024-09-14T11:42:23.860 INFO:teuthology.orchestra.run.smithi138.stderr: 63100K .......... .......... .......... .......... .......... 67% 56.2M 0s 2024-09-14T11:42:23.860 INFO:teuthology.orchestra.run.smithi138.stderr: 63150K .......... .......... .......... .......... .......... 68% 107M 0s 2024-09-14T11:42:23.860 INFO:teuthology.orchestra.run.smithi138.stderr: 63200K .......... .......... .......... .......... .......... 68% 177M 0s 2024-09-14T11:42:23.860 INFO:teuthology.orchestra.run.smithi138.stderr: 63250K .......... .......... .......... .......... .......... 68% 303M 0s 2024-09-14T11:42:23.861 INFO:teuthology.orchestra.run.smithi138.stderr: 63300K .......... .......... .......... .......... .......... 68% 337M 0s 2024-09-14T11:42:23.861 INFO:teuthology.orchestra.run.smithi138.stderr: 63350K .......... .......... .......... .......... .......... 68% 202M 0s 2024-09-14T11:42:23.861 INFO:teuthology.orchestra.run.smithi138.stderr: 63400K .......... .......... .......... .......... .......... 68% 281M 0s 2024-09-14T11:42:23.861 INFO:teuthology.orchestra.run.smithi138.stderr: 63450K .......... .......... .......... .......... .......... 68% 194M 0s 2024-09-14T11:42:23.861 INFO:teuthology.orchestra.run.smithi138.stderr: 63500K .......... .......... .......... .......... .......... 68% 282M 0s 2024-09-14T11:42:23.861 INFO:teuthology.orchestra.run.smithi138.stderr: 63550K .......... .......... .......... .......... .......... 68% 269M 0s 2024-09-14T11:42:23.861 INFO:teuthology.orchestra.run.smithi138.stderr: 63600K .......... .......... .......... .......... .......... 68% 305M 0s 2024-09-14T11:42:23.861 INFO:teuthology.orchestra.run.smithi138.stderr: 63650K .......... .......... .......... .......... .......... 68% 358M 0s 2024-09-14T11:42:23.861 INFO:teuthology.orchestra.run.smithi138.stderr: 63700K .......... .......... .......... .......... .......... 68% 396M 0s 2024-09-14T11:42:23.861 INFO:teuthology.orchestra.run.smithi138.stderr: 63750K .......... .......... .......... .......... .......... 68% 380M 0s 2024-09-14T11:42:23.861 INFO:teuthology.orchestra.run.smithi138.stderr: 63800K .......... .......... .......... .......... .......... 68% 294M 0s 2024-09-14T11:42:23.861 INFO:teuthology.orchestra.run.smithi138.stderr: 63850K .......... .......... .......... .......... .......... 68% 388M 0s 2024-09-14T11:42:23.861 INFO:teuthology.orchestra.run.smithi138.stderr: 63900K .......... .......... .......... .......... .......... 68% 392M 0s 2024-09-14T11:42:23.862 INFO:teuthology.orchestra.run.smithi138.stderr: 63950K .......... .......... .......... .......... .......... 68% 152M 0s 2024-09-14T11:42:23.862 INFO:teuthology.orchestra.run.smithi138.stderr: 64000K .......... .......... .......... .......... .......... 68% 182M 0s 2024-09-14T11:42:23.862 INFO:teuthology.orchestra.run.smithi138.stderr: 64050K .......... .......... .......... .......... .......... 68% 341M 0s 2024-09-14T11:42:23.862 INFO:teuthology.orchestra.run.smithi138.stderr: 64100K .......... .......... .......... .......... .......... 69% 364M 0s 2024-09-14T11:42:23.862 INFO:teuthology.orchestra.run.smithi138.stderr: 64150K .......... .......... .......... .......... .......... 69% 357M 0s 2024-09-14T11:42:23.862 INFO:teuthology.orchestra.run.smithi138.stderr: 64200K .......... .......... .......... .......... .......... 69% 192M 0s 2024-09-14T11:42:23.862 INFO:teuthology.orchestra.run.smithi138.stderr: 64250K .......... .......... .......... .......... .......... 69% 265M 0s 2024-09-14T11:42:23.862 INFO:teuthology.orchestra.run.smithi138.stderr: 64300K .......... .......... .......... .......... .......... 69% 296M 0s 2024-09-14T11:42:23.862 INFO:teuthology.orchestra.run.smithi138.stderr: 64350K .......... .......... .......... .......... .......... 69% 371M 0s 2024-09-14T11:42:23.862 INFO:teuthology.orchestra.run.smithi138.stderr: 64400K .......... .......... .......... .......... .......... 69% 339M 0s 2024-09-14T11:42:23.862 INFO:teuthology.orchestra.run.smithi138.stderr: 64450K .......... .......... .......... .......... .......... 69% 313M 0s 2024-09-14T11:42:23.862 INFO:teuthology.orchestra.run.smithi138.stderr: 64500K .......... .......... .......... .......... .......... 69% 378M 0s 2024-09-14T11:42:23.862 INFO:teuthology.orchestra.run.smithi138.stderr: 64550K .......... .......... .......... .......... .......... 69% 189M 0s 2024-09-14T11:42:23.863 INFO:teuthology.orchestra.run.smithi138.stderr: 64600K .......... .......... .......... .......... .......... 69% 305M 0s 2024-09-14T11:42:23.863 INFO:teuthology.orchestra.run.smithi138.stderr: 64650K .......... .......... .......... .......... .......... 69% 347M 0s 2024-09-14T11:42:23.863 INFO:teuthology.orchestra.run.smithi138.stderr: 64700K .......... .......... .......... .......... .......... 69% 342M 0s 2024-09-14T11:42:23.863 INFO:teuthology.orchestra.run.smithi138.stderr: 64750K .......... .......... .......... .......... .......... 69% 308M 0s 2024-09-14T11:42:23.863 INFO:teuthology.orchestra.run.smithi138.stderr: 64800K .......... .......... .......... .......... .......... 69% 336M 0s 2024-09-14T11:42:23.863 INFO:teuthology.orchestra.run.smithi138.stderr: 64850K .......... .......... .......... .......... .......... 69% 359M 0s 2024-09-14T11:42:23.863 INFO:teuthology.orchestra.run.smithi138.stderr: 64900K .......... .......... .......... .......... .......... 69% 330M 0s 2024-09-14T11:42:23.863 INFO:teuthology.orchestra.run.smithi138.stderr: 64950K .......... .......... .......... .......... .......... 69% 295M 0s 2024-09-14T11:42:23.863 INFO:teuthology.orchestra.run.smithi138.stderr: 65000K .......... .......... .......... .......... .......... 70% 347M 0s 2024-09-14T11:42:23.863 INFO:teuthology.orchestra.run.smithi138.stderr: 65050K .......... .......... .......... .......... .......... 70% 350M 0s 2024-09-14T11:42:23.863 INFO:teuthology.orchestra.run.smithi138.stderr: 65100K .......... .......... .......... .......... .......... 70% 364M 0s 2024-09-14T11:42:23.863 INFO:teuthology.orchestra.run.smithi138.stderr: 65150K .......... .......... .......... .......... .......... 70% 307M 0s 2024-09-14T11:42:23.863 INFO:teuthology.orchestra.run.smithi138.stderr: 65200K .......... .......... .......... .......... .......... 70% 307M 0s 2024-09-14T11:42:23.864 INFO:teuthology.orchestra.run.smithi138.stderr: 65250K .......... .......... .......... .......... .......... 70% 373M 0s 2024-09-14T11:42:23.864 INFO:teuthology.orchestra.run.smithi138.stderr: 65300K .......... .......... .......... .......... .......... 70% 370M 0s 2024-09-14T11:42:23.864 INFO:teuthology.orchestra.run.smithi138.stderr: 65350K .......... .......... .......... .......... .......... 70% 371M 0s 2024-09-14T11:42:23.864 INFO:teuthology.orchestra.run.smithi138.stderr: 65400K .......... .......... .......... .......... .......... 70% 334M 0s 2024-09-14T11:42:23.864 INFO:teuthology.orchestra.run.smithi138.stderr: 65450K .......... .......... .......... .......... .......... 70% 333M 0s 2024-09-14T11:42:23.864 INFO:teuthology.orchestra.run.smithi138.stderr: 65500K .......... .......... .......... .......... .......... 70% 331M 0s 2024-09-14T11:42:23.864 INFO:teuthology.orchestra.run.smithi138.stderr: 65550K .......... .......... .......... .......... .......... 70% 345M 0s 2024-09-14T11:42:23.864 INFO:teuthology.orchestra.run.smithi138.stderr: 65600K .......... .......... .......... .......... .......... 70% 276M 0s 2024-09-14T11:42:23.864 INFO:teuthology.orchestra.run.smithi138.stderr: 65650K .......... .......... .......... .......... .......... 70% 276M 0s 2024-09-14T11:42:23.864 INFO:teuthology.orchestra.run.smithi138.stderr: 65700K .......... .......... .......... .......... .......... 70% 355M 0s 2024-09-14T11:42:23.864 INFO:teuthology.orchestra.run.smithi138.stderr: 65750K .......... .......... .......... .......... .......... 70% 358M 0s 2024-09-14T11:42:23.864 INFO:teuthology.orchestra.run.smithi138.stderr: 65800K .......... .......... .......... .......... .......... 70% 331M 0s 2024-09-14T11:42:23.864 INFO:teuthology.orchestra.run.smithi138.stderr: 65850K .......... .......... .......... .......... .......... 70% 374M 0s 2024-09-14T11:42:23.865 INFO:teuthology.orchestra.run.smithi138.stderr: 65900K .......... .......... .......... .......... .......... 70% 379M 0s 2024-09-14T11:42:23.865 INFO:teuthology.orchestra.run.smithi138.stderr: 65950K .......... .......... .......... .......... .......... 71% 38.6M 0s 2024-09-14T11:42:23.865 INFO:teuthology.orchestra.run.smithi138.stderr: 66000K .......... .......... .......... .......... .......... 71% 331M 0s 2024-09-14T11:42:23.865 INFO:teuthology.orchestra.run.smithi138.stderr: 66050K .......... .......... .......... .......... .......... 71% 81.7M 0s 2024-09-14T11:42:23.865 INFO:teuthology.orchestra.run.smithi138.stderr: 66100K .......... .......... .......... .......... .......... 71% 291M 0s 2024-09-14T11:42:23.865 INFO:teuthology.orchestra.run.smithi138.stderr: 66150K .......... .......... .......... .......... .......... 71% 109M 0s 2024-09-14T11:42:23.865 INFO:teuthology.orchestra.run.smithi138.stderr: 66200K .......... .......... .......... .......... .......... 71% 149M 0s 2024-09-14T11:42:23.865 INFO:teuthology.orchestra.run.smithi138.stderr: 66250K .......... .......... .......... .......... .......... 71% 277M 0s 2024-09-14T11:42:23.865 INFO:teuthology.orchestra.run.smithi138.stderr: 66300K .......... .......... .......... .......... .......... 71% 290M 0s 2024-09-14T11:42:23.865 INFO:teuthology.orchestra.run.smithi138.stderr: 66350K .......... .......... .......... .......... .......... 71% 351M 0s 2024-09-14T11:42:23.865 INFO:teuthology.orchestra.run.smithi138.stderr: 66400K .......... .......... .......... .......... .......... 71% 347M 0s 2024-09-14T11:42:23.865 INFO:teuthology.orchestra.run.smithi138.stderr: 66450K .......... .......... .......... .......... .......... 71% 172M 0s 2024-09-14T11:42:23.865 INFO:teuthology.orchestra.run.smithi138.stderr: 66500K .......... .......... .......... .......... .......... 71% 100M 0s 2024-09-14T11:42:23.866 INFO:teuthology.orchestra.run.smithi138.stderr: 66550K .......... .......... .......... .......... .......... 71% 284M 0s 2024-09-14T11:42:23.866 INFO:teuthology.orchestra.run.smithi138.stderr: 66600K .......... .......... .......... .......... .......... 71% 378M 0s 2024-09-14T11:42:23.866 INFO:teuthology.orchestra.run.smithi138.stderr: 66650K .......... .......... .......... .......... .......... 71% 212M 0s 2024-09-14T11:42:23.866 INFO:teuthology.orchestra.run.smithi138.stderr: 66700K .......... .......... .......... .......... .......... 71% 330M 0s 2024-09-14T11:42:23.866 INFO:teuthology.orchestra.run.smithi138.stderr: 66750K .......... .......... .......... .......... .......... 71% 316M 0s 2024-09-14T11:42:23.866 INFO:teuthology.orchestra.run.smithi138.stderr: 66800K .......... .......... .......... .......... .......... 71% 350M 0s 2024-09-14T11:42:23.866 INFO:teuthology.orchestra.run.smithi138.stderr: 66850K .......... .......... .......... .......... .......... 72% 368M 0s 2024-09-14T11:42:23.866 INFO:teuthology.orchestra.run.smithi138.stderr: 66900K .......... .......... .......... .......... .......... 72% 352M 0s 2024-09-14T11:42:23.866 INFO:teuthology.orchestra.run.smithi138.stderr: 66950K .......... .......... .......... .......... .......... 72% 311M 0s 2024-09-14T11:42:23.866 INFO:teuthology.orchestra.run.smithi138.stderr: 67000K .......... .......... .......... .......... .......... 72% 368M 0s 2024-09-14T11:42:23.866 INFO:teuthology.orchestra.run.smithi138.stderr: 67050K .......... .......... .......... .......... .......... 72% 366M 0s 2024-09-14T11:42:23.866 INFO:teuthology.orchestra.run.smithi138.stderr: 67100K .......... .......... .......... .......... .......... 72% 361M 0s 2024-09-14T11:42:23.866 INFO:teuthology.orchestra.run.smithi138.stderr: 67150K .......... .......... .......... .......... .......... 72% 148M 0s 2024-09-14T11:42:23.867 INFO:teuthology.orchestra.run.smithi138.stderr: 67200K .......... .......... .......... .......... .......... 72% 318M 0s 2024-09-14T11:42:23.867 INFO:teuthology.orchestra.run.smithi138.stderr: 67250K .......... .......... .......... .......... .......... 72% 346M 0s 2024-09-14T11:42:23.867 INFO:teuthology.orchestra.run.smithi138.stderr: 67300K .......... .......... .......... .......... .......... 72% 359M 0s 2024-09-14T11:42:23.867 INFO:teuthology.orchestra.run.smithi138.stderr: 67350K .......... .......... .......... .......... .......... 72% 247M 0s 2024-09-14T11:42:23.867 INFO:teuthology.orchestra.run.smithi138.stderr: 67400K .......... .......... .......... .......... .......... 72% 194M 0s 2024-09-14T11:42:23.867 INFO:teuthology.orchestra.run.smithi138.stderr: 67450K .......... .......... .......... .......... .......... 72% 229M 0s 2024-09-14T11:42:23.867 INFO:teuthology.orchestra.run.smithi138.stderr: 67500K .......... .......... .......... .......... .......... 72% 326M 0s 2024-09-14T11:42:23.867 INFO:teuthology.orchestra.run.smithi138.stderr: 67550K .......... .......... .......... .......... .......... 72% 338M 0s 2024-09-14T11:42:23.867 INFO:teuthology.orchestra.run.smithi138.stderr: 67600K .......... .......... .......... .......... .......... 72% 275M 0s 2024-09-14T11:42:23.867 INFO:teuthology.orchestra.run.smithi138.stderr: 67650K .......... .......... .......... .......... .......... 72% 365M 0s 2024-09-14T11:42:23.867 INFO:teuthology.orchestra.run.smithi138.stderr: 67700K .......... .......... .......... .......... .......... 72% 341M 0s 2024-09-14T11:42:23.867 INFO:teuthology.orchestra.run.smithi138.stderr: 67750K .......... .......... .......... .......... .......... 72% 301M 0s 2024-09-14T11:42:23.867 INFO:teuthology.orchestra.run.smithi138.stderr: 67800K .......... .......... .......... .......... .......... 73% 332M 0s 2024-09-14T11:42:23.868 INFO:teuthology.orchestra.run.smithi138.stderr: 67850K .......... .......... .......... .......... .......... 73% 337M 0s 2024-09-14T11:42:23.868 INFO:teuthology.orchestra.run.smithi138.stderr: 67900K .......... .......... .......... .......... .......... 73% 273M 0s 2024-09-14T11:42:23.868 INFO:teuthology.orchestra.run.smithi138.stderr: 67950K .......... .......... .......... .......... .......... 73% 334M 0s 2024-09-14T11:42:23.868 INFO:teuthology.orchestra.run.smithi138.stderr: 68000K .......... .......... .......... .......... .......... 73% 339M 0s 2024-09-14T11:42:23.868 INFO:teuthology.orchestra.run.smithi138.stderr: 68050K .......... .......... .......... .......... .......... 73% 374M 0s 2024-09-14T11:42:23.868 INFO:teuthology.orchestra.run.smithi138.stderr: 68100K .......... .......... .......... .......... .......... 73% 332M 0s 2024-09-14T11:42:23.868 INFO:teuthology.orchestra.run.smithi138.stderr: 68150K .......... .......... .......... .......... .......... 73% 323M 0s 2024-09-14T11:42:23.868 INFO:teuthology.orchestra.run.smithi138.stderr: 68200K .......... .......... .......... .......... .......... 73% 342M 0s 2024-09-14T11:42:23.868 INFO:teuthology.orchestra.run.smithi138.stderr: 68250K .......... .......... .......... .......... .......... 73% 375M 0s 2024-09-14T11:42:23.868 INFO:teuthology.orchestra.run.smithi138.stderr: 68300K .......... .......... .......... .......... .......... 73% 207M 0s 2024-09-14T11:42:23.868 INFO:teuthology.orchestra.run.smithi138.stderr: 68350K .......... .......... .......... .......... .......... 73% 354M 0s 2024-09-14T11:42:23.868 INFO:teuthology.orchestra.run.smithi138.stderr: 68400K .......... .......... .......... .......... .......... 73% 342M 0s 2024-09-14T11:42:23.868 INFO:teuthology.orchestra.run.smithi138.stderr: 68450K .......... .......... .......... .......... .......... 73% 362M 0s 2024-09-14T11:42:23.868 INFO:teuthology.orchestra.run.smithi138.stderr: 68500K .......... .......... .......... .......... .......... 73% 354M 0s 2024-09-14T11:42:23.869 INFO:teuthology.orchestra.run.smithi138.stderr: 68550K .......... .......... .......... .......... .......... 73% 350M 0s 2024-09-14T11:42:23.869 INFO:teuthology.orchestra.run.smithi138.stderr: 68600K .......... .......... .......... .......... .......... 73% 278M 0s 2024-09-14T11:42:23.869 INFO:teuthology.orchestra.run.smithi138.stderr: 68650K .......... .......... .......... .......... .......... 73% 341M 0s 2024-09-14T11:42:23.869 INFO:teuthology.orchestra.run.smithi138.stderr: 68700K .......... .......... .......... .......... .......... 74% 353M 0s 2024-09-14T11:42:23.869 INFO:teuthology.orchestra.run.smithi138.stderr: 68750K .......... .......... .......... .......... .......... 74% 369M 0s 2024-09-14T11:42:23.869 INFO:teuthology.orchestra.run.smithi138.stderr: 68800K .......... .......... .......... .......... .......... 74% 37.0M 0s 2024-09-14T11:42:23.869 INFO:teuthology.orchestra.run.smithi138.stderr: 68850K .......... .......... .......... .......... .......... 74% 356M 0s 2024-09-14T11:42:23.869 INFO:teuthology.orchestra.run.smithi138.stderr: 68900K .......... .......... .......... .......... .......... 74% 343M 0s 2024-09-14T11:42:23.869 INFO:teuthology.orchestra.run.smithi138.stderr: 68950K .......... .......... .......... .......... .......... 74% 338M 0s 2024-09-14T11:42:23.869 INFO:teuthology.orchestra.run.smithi138.stderr: 69000K .......... .......... .......... .......... .......... 74% 325M 0s 2024-09-14T11:42:23.869 INFO:teuthology.orchestra.run.smithi138.stderr: 69050K .......... .......... .......... .......... .......... 74% 165M 0s 2024-09-14T11:42:23.869 INFO:teuthology.orchestra.run.smithi138.stderr: 69100K .......... .......... .......... .......... .......... 74% 130M 0s 2024-09-14T11:42:23.869 INFO:teuthology.orchestra.run.smithi138.stderr: 69150K .......... .......... .......... .......... .......... 74% 361M 0s 2024-09-14T11:42:23.870 INFO:teuthology.orchestra.run.smithi138.stderr: 69200K .......... .......... .......... .......... .......... 74% 189M 0s 2024-09-14T11:42:23.870 INFO:teuthology.orchestra.run.smithi138.stderr: 69250K .......... .......... .......... .......... .......... 74% 151M 0s 2024-09-14T11:42:23.870 INFO:teuthology.orchestra.run.smithi138.stderr: 69300K .......... .......... .......... .......... .......... 74% 327M 0s 2024-09-14T11:42:23.870 INFO:teuthology.orchestra.run.smithi138.stderr: 69350K .......... .......... .......... .......... .......... 74% 352M 0s 2024-09-14T11:42:23.870 INFO:teuthology.orchestra.run.smithi138.stderr: 69400K .......... .......... .......... .......... .......... 74% 343M 0s 2024-09-14T11:42:23.870 INFO:teuthology.orchestra.run.smithi138.stderr: 69450K .......... .......... .......... .......... .......... 74% 187M 0s 2024-09-14T11:42:23.870 INFO:teuthology.orchestra.run.smithi138.stderr: 69500K .......... .......... .......... .......... .......... 74% 111M 0s 2024-09-14T11:42:23.870 INFO:teuthology.orchestra.run.smithi138.stderr: 69550K .......... .......... .......... .......... .......... 74% 79.6M 0s 2024-09-14T11:42:23.870 INFO:teuthology.orchestra.run.smithi138.stderr: 69600K .......... .......... .......... .......... .......... 74% 319M 0s 2024-09-14T11:42:23.870 INFO:teuthology.orchestra.run.smithi138.stderr: 69650K .......... .......... .......... .......... .......... 75% 314M 0s 2024-09-14T11:42:23.870 INFO:teuthology.orchestra.run.smithi138.stderr: 69700K .......... .......... .......... .......... .......... 75% 338M 0s 2024-09-14T11:42:23.870 INFO:teuthology.orchestra.run.smithi138.stderr: 69750K .......... .......... .......... .......... .......... 75% 263M 0s 2024-09-14T11:42:23.870 INFO:teuthology.orchestra.run.smithi138.stderr: 69800K .......... .......... .......... .......... .......... 75% 375M 0s 2024-09-14T11:42:23.870 INFO:teuthology.orchestra.run.smithi138.stderr: 69850K .......... .......... .......... .......... .......... 75% 317M 0s 2024-09-14T11:42:23.871 INFO:teuthology.orchestra.run.smithi138.stderr: 69900K .......... .......... .......... .......... .......... 75% 352M 0s 2024-09-14T11:42:23.871 INFO:teuthology.orchestra.run.smithi138.stderr: 69950K .......... .......... .......... .......... .......... 75% 359M 0s 2024-09-14T11:42:23.871 INFO:teuthology.orchestra.run.smithi138.stderr: 70000K .......... .......... .......... .......... .......... 75% 350M 0s 2024-09-14T11:42:23.871 INFO:teuthology.orchestra.run.smithi138.stderr: 70050K .......... .......... .......... .......... .......... 75% 325M 0s 2024-09-14T11:42:23.871 INFO:teuthology.orchestra.run.smithi138.stderr: 70100K .......... .......... .......... .......... .......... 75% 336M 0s 2024-09-14T11:42:23.871 INFO:teuthology.orchestra.run.smithi138.stderr: 70150K .......... .......... .......... .......... .......... 75% 342M 0s 2024-09-14T11:42:23.871 INFO:teuthology.orchestra.run.smithi138.stderr: 70200K .......... .......... .......... .......... .......... 75% 345M 0s 2024-09-14T11:42:23.871 INFO:teuthology.orchestra.run.smithi138.stderr: 70250K .......... .......... .......... .......... .......... 75% 348M 0s 2024-09-14T11:42:23.871 INFO:teuthology.orchestra.run.smithi138.stderr: 70300K .......... .......... .......... .......... .......... 75% 328M 0s 2024-09-14T11:42:23.871 INFO:teuthology.orchestra.run.smithi138.stderr: 70350K .......... .......... .......... .......... .......... 75% 334M 0s 2024-09-14T11:42:23.871 INFO:teuthology.orchestra.run.smithi138.stderr: 70400K .......... .......... .......... .......... .......... 75% 222M 0s 2024-09-14T11:42:23.871 INFO:teuthology.orchestra.run.smithi138.stderr: 70450K .......... .......... .......... .......... .......... 75% 149M 0s 2024-09-14T11:42:23.872 INFO:teuthology.orchestra.run.smithi138.stderr: 70500K .......... .......... .......... .......... .......... 75% 334M 0s 2024-09-14T11:42:23.872 INFO:teuthology.orchestra.run.smithi138.stderr: 70550K .......... .......... .......... .......... .......... 75% 304M 0s 2024-09-14T11:42:23.872 INFO:teuthology.orchestra.run.smithi138.stderr: 70600K .......... .......... .......... .......... .......... 76% 356M 0s 2024-09-14T11:42:23.872 INFO:teuthology.orchestra.run.smithi138.stderr: 70650K .......... .......... .......... .......... .......... 76% 353M 0s 2024-09-14T11:42:23.872 INFO:teuthology.orchestra.run.smithi138.stderr: 70700K .......... .......... .......... .......... .......... 76% 318M 0s 2024-09-14T11:42:23.872 INFO:teuthology.orchestra.run.smithi138.stderr: 70750K .......... .......... .......... .......... .......... 76% 273M 0s 2024-09-14T11:42:23.872 INFO:teuthology.orchestra.run.smithi138.stderr: 70800K .......... .......... .......... .......... .......... 76% 370M 0s 2024-09-14T11:42:23.872 INFO:teuthology.orchestra.run.smithi138.stderr: 70850K .......... .......... .......... .......... .......... 76% 304M 0s 2024-09-14T11:42:23.872 INFO:teuthology.orchestra.run.smithi138.stderr: 70900K .......... .......... .......... .......... .......... 76% 166M 0s 2024-09-14T11:42:23.872 INFO:teuthology.orchestra.run.smithi138.stderr: 70950K .......... .......... .......... .......... .......... 76% 225M 0s 2024-09-14T11:42:23.872 INFO:teuthology.orchestra.run.smithi138.stderr: 71000K .......... .......... .......... .......... .......... 76% 337M 0s 2024-09-14T11:42:23.872 INFO:teuthology.orchestra.run.smithi138.stderr: 71050K .......... .......... .......... .......... .......... 76% 337M 0s 2024-09-14T11:42:23.873 INFO:teuthology.orchestra.run.smithi138.stderr: 71100K .......... .......... .......... .......... .......... 76% 267M 0s 2024-09-14T11:42:23.873 INFO:teuthology.orchestra.run.smithi138.stderr: 71150K .......... .......... .......... .......... .......... 76% 284M 0s 2024-09-14T11:42:23.873 INFO:teuthology.orchestra.run.smithi138.stderr: 71200K .......... .......... .......... .......... .......... 76% 351M 0s 2024-09-14T11:42:23.873 INFO:teuthology.orchestra.run.smithi138.stderr: 71250K .......... .......... .......... .......... .......... 76% 356M 0s 2024-09-14T11:42:23.873 INFO:teuthology.orchestra.run.smithi138.stderr: 71300K .......... .......... .......... .......... .......... 76% 361M 0s 2024-09-14T11:42:23.873 INFO:teuthology.orchestra.run.smithi138.stderr: 71350K .......... .......... .......... .......... .......... 76% 328M 0s 2024-09-14T11:42:23.873 INFO:teuthology.orchestra.run.smithi138.stderr: 71400K .......... .......... .......... .......... .......... 76% 287M 0s 2024-09-14T11:42:23.873 INFO:teuthology.orchestra.run.smithi138.stderr: 71450K .......... .......... .......... .......... .......... 76% 361M 0s 2024-09-14T11:42:23.873 INFO:teuthology.orchestra.run.smithi138.stderr: 71500K .......... .......... .......... .......... .......... 77% 363M 0s 2024-09-14T11:42:23.873 INFO:teuthology.orchestra.run.smithi138.stderr: 71550K .......... .......... .......... .......... .......... 77% 370M 0s 2024-09-14T11:42:23.873 INFO:teuthology.orchestra.run.smithi138.stderr: 71600K .......... .......... .......... .......... .......... 77% 331M 0s 2024-09-14T11:42:23.873 INFO:teuthology.orchestra.run.smithi138.stderr: 71650K .......... .......... .......... .......... .......... 77% 357M 0s 2024-09-14T11:42:23.873 INFO:teuthology.orchestra.run.smithi138.stderr: 71700K .......... .......... .......... .......... .......... 77% 43.5M 0s 2024-09-14T11:42:23.873 INFO:teuthology.orchestra.run.smithi138.stderr: 71750K .......... .......... .......... .......... .......... 77% 206M 0s 2024-09-14T11:42:23.874 INFO:teuthology.orchestra.run.smithi138.stderr: 71800K .......... .......... .......... .......... .......... 77% 362M 0s 2024-09-14T11:42:23.874 INFO:teuthology.orchestra.run.smithi138.stderr: 71850K .......... .......... .......... .......... .......... 77% 260M 0s 2024-09-14T11:42:23.874 INFO:teuthology.orchestra.run.smithi138.stderr: 71900K .......... .......... .......... .......... .......... 77% 335M 0s 2024-09-14T11:42:23.874 INFO:teuthology.orchestra.run.smithi138.stderr: 71950K .......... .......... .......... .......... .......... 77% 330M 0s 2024-09-14T11:42:23.874 INFO:teuthology.orchestra.run.smithi138.stderr: 72000K .......... .......... .......... .......... .......... 77% 356M 0s 2024-09-14T11:42:23.874 INFO:teuthology.orchestra.run.smithi138.stderr: 72050K .......... .......... .......... .......... .......... 77% 299M 0s 2024-09-14T11:42:23.874 INFO:teuthology.orchestra.run.smithi138.stderr: 72100K .......... .......... .......... .......... .......... 77% 355M 0s 2024-09-14T11:42:23.874 INFO:teuthology.orchestra.run.smithi138.stderr: 72150K .......... .......... .......... .......... .......... 77% 183M 0s 2024-09-14T11:42:23.874 INFO:teuthology.orchestra.run.smithi138.stderr: 72200K .......... .......... .......... .......... .......... 77% 279M 0s 2024-09-14T11:42:23.874 INFO:teuthology.orchestra.run.smithi138.stderr: 72250K .......... .......... .......... .......... .......... 77% 180M 0s 2024-09-14T11:42:23.874 INFO:teuthology.orchestra.run.smithi138.stderr: 72300K .......... .......... .......... .......... .......... 77% 137M 0s 2024-09-14T11:42:23.874 INFO:teuthology.orchestra.run.smithi138.stderr: 72350K .......... .......... .......... .......... .......... 77% 270M 0s 2024-09-14T11:42:23.875 INFO:teuthology.orchestra.run.smithi138.stderr: 72400K .......... .......... .......... .......... .......... 77% 343M 0s 2024-09-14T11:42:23.875 INFO:teuthology.orchestra.run.smithi138.stderr: 72450K .......... .......... .......... .......... .......... 78% 317M 0s 2024-09-14T11:42:23.875 INFO:teuthology.orchestra.run.smithi138.stderr: 72500K .......... .......... .......... .......... .......... 78% 132M 0s 2024-09-14T11:42:23.875 INFO:teuthology.orchestra.run.smithi138.stderr: 72550K .......... .......... .......... .......... .......... 78% 86.6M 0s 2024-09-14T11:42:23.875 INFO:teuthology.orchestra.run.smithi138.stderr: 72600K .......... .......... .......... .......... .......... 78% 173M 0s 2024-09-14T11:42:23.875 INFO:teuthology.orchestra.run.smithi138.stderr: 72650K .......... .......... .......... .......... .......... 78% 357M 0s 2024-09-14T11:42:23.875 INFO:teuthology.orchestra.run.smithi138.stderr: 72700K .......... .......... .......... .......... .......... 78% 247M 0s 2024-09-14T11:42:23.875 INFO:teuthology.orchestra.run.smithi138.stderr: 72750K .......... .......... .......... .......... .......... 78% 279M 0s 2024-09-14T11:42:23.875 INFO:teuthology.orchestra.run.smithi138.stderr: 72800K .......... .......... .......... .......... .......... 78% 354M 0s 2024-09-14T11:42:23.875 INFO:teuthology.orchestra.run.smithi138.stderr: 72850K .......... .......... .......... .......... .......... 78% 359M 0s 2024-09-14T11:42:23.875 INFO:teuthology.orchestra.run.smithi138.stderr: 72900K .......... .......... .......... .......... .......... 78% 379M 0s 2024-09-14T11:42:23.876 INFO:teuthology.orchestra.run.smithi138.stderr: 72950K .......... .......... .......... .......... .......... 78% 190M 0s 2024-09-14T11:42:23.876 INFO:teuthology.orchestra.run.smithi138.stderr: 73000K .......... .......... .......... .......... .......... 78% 353M 0s 2024-09-14T11:42:23.876 INFO:teuthology.orchestra.run.smithi138.stderr: 73050K .......... .......... .......... .......... .......... 78% 336M 0s 2024-09-14T11:42:23.876 INFO:teuthology.orchestra.run.smithi138.stderr: 73100K .......... .......... .......... .......... .......... 78% 366M 0s 2024-09-14T11:42:23.876 INFO:teuthology.orchestra.run.smithi138.stderr: 73150K .......... .......... .......... .......... .......... 78% 316M 0s 2024-09-14T11:42:23.876 INFO:teuthology.orchestra.run.smithi138.stderr: 73200K .......... .......... .......... .......... .......... 78% 356M 0s 2024-09-14T11:42:23.876 INFO:teuthology.orchestra.run.smithi138.stderr: 73250K .......... .......... .......... .......... .......... 78% 370M 0s 2024-09-14T11:42:23.876 INFO:teuthology.orchestra.run.smithi138.stderr: 73300K .......... .......... .......... .......... .......... 78% 305M 0s 2024-09-14T11:42:23.876 INFO:teuthology.orchestra.run.smithi138.stderr: 73350K .......... .......... .......... .......... .......... 79% 302M 0s 2024-09-14T11:42:23.876 INFO:teuthology.orchestra.run.smithi138.stderr: 73400K .......... .......... .......... .......... .......... 79% 362M 0s 2024-09-14T11:42:23.876 INFO:teuthology.orchestra.run.smithi138.stderr: 73450K .......... .......... .......... .......... .......... 79% 319M 0s 2024-09-14T11:42:23.876 INFO:teuthology.orchestra.run.smithi138.stderr: 73500K .......... .......... .......... .......... .......... 79% 158M 0s 2024-09-14T11:42:23.876 INFO:teuthology.orchestra.run.smithi138.stderr: 73550K .......... .......... .......... .......... .......... 79% 333M 0s 2024-09-14T11:42:23.877 INFO:teuthology.orchestra.run.smithi138.stderr: 73600K .......... .......... .......... .......... .......... 79% 368M 0s 2024-09-14T11:42:23.877 INFO:teuthology.orchestra.run.smithi138.stderr: 73650K .......... .......... .......... .......... .......... 79% 345M 0s 2024-09-14T11:42:23.877 INFO:teuthology.orchestra.run.smithi138.stderr: 73700K .......... .......... .......... .......... .......... 79% 208M 0s 2024-09-14T11:42:23.877 INFO:teuthology.orchestra.run.smithi138.stderr: 73750K .......... .......... .......... .......... .......... 79% 231M 0s 2024-09-14T11:42:23.877 INFO:teuthology.orchestra.run.smithi138.stderr: 73800K .......... .......... .......... .......... .......... 79% 304M 0s 2024-09-14T11:42:23.877 INFO:teuthology.orchestra.run.smithi138.stderr: 73850K .......... .......... .......... .......... .......... 79% 247M 0s 2024-09-14T11:42:23.877 INFO:teuthology.orchestra.run.smithi138.stderr: 73900K .......... .......... .......... .......... .......... 79% 360M 0s 2024-09-14T11:42:23.877 INFO:teuthology.orchestra.run.smithi138.stderr: 73950K .......... .......... .......... .......... .......... 79% 253M 0s 2024-09-14T11:42:23.877 INFO:teuthology.orchestra.run.smithi138.stderr: 74000K .......... .......... .......... .......... .......... 79% 215M 0s 2024-09-14T11:42:23.877 INFO:teuthology.orchestra.run.smithi138.stderr: 74050K .......... .......... .......... .......... .......... 79% 301M 0s 2024-09-14T11:42:23.877 INFO:teuthology.orchestra.run.smithi138.stderr: 74100K .......... .......... .......... .......... .......... 79% 355M 0s 2024-09-14T11:42:23.877 INFO:teuthology.orchestra.run.smithi138.stderr: 74150K .......... .......... .......... .......... .......... 79% 352M 0s 2024-09-14T11:42:23.878 INFO:teuthology.orchestra.run.smithi138.stderr: 74200K .......... .......... .......... .......... .......... 79% 330M 0s 2024-09-14T11:42:23.878 INFO:teuthology.orchestra.run.smithi138.stderr: 74250K .......... .......... .......... .......... .......... 79% 323M 0s 2024-09-14T11:42:23.878 INFO:teuthology.orchestra.run.smithi138.stderr: 74300K .......... .......... .......... .......... .......... 80% 392M 0s 2024-09-14T11:42:23.878 INFO:teuthology.orchestra.run.smithi138.stderr: 74350K .......... .......... .......... .......... .......... 80% 117M 0s 2024-09-14T11:42:23.878 INFO:teuthology.orchestra.run.smithi138.stderr: 74400K .......... .......... .......... .......... .......... 80% 348M 0s 2024-09-14T11:42:23.878 INFO:teuthology.orchestra.run.smithi138.stderr: 74450K .......... .......... .......... .......... .......... 80% 284M 0s 2024-09-14T11:42:23.878 INFO:teuthology.orchestra.run.smithi138.stderr: 74500K .......... .......... .......... .......... .......... 80% 355M 0s 2024-09-14T11:42:23.878 INFO:teuthology.orchestra.run.smithi138.stderr: 74550K .......... .......... .......... .......... .......... 80% 375M 0s 2024-09-14T11:42:23.878 INFO:teuthology.orchestra.run.smithi138.stderr: 74600K .......... .......... .......... .......... .......... 80% 388M 0s 2024-09-14T11:42:23.878 INFO:teuthology.orchestra.run.smithi138.stderr: 74650K .......... .......... .......... .......... .......... 80% 349M 0s 2024-09-14T11:42:23.878 INFO:teuthology.orchestra.run.smithi138.stderr: 74700K .......... .......... .......... .......... .......... 80% 49.3M 0s 2024-09-14T11:42:23.878 INFO:teuthology.orchestra.run.smithi138.stderr: 74750K .......... .......... .......... .......... .......... 80% 175M 0s 2024-09-14T11:42:23.879 INFO:teuthology.orchestra.run.smithi138.stderr: 74800K .......... .......... .......... .......... .......... 80% 351M 0s 2024-09-14T11:42:23.879 INFO:teuthology.orchestra.run.smithi138.stderr: 74850K .......... .......... .......... .......... .......... 80% 339M 0s 2024-09-14T11:42:23.879 INFO:teuthology.orchestra.run.smithi138.stderr: 74900K .......... .......... .......... .......... .......... 80% 362M 0s 2024-09-14T11:42:23.879 INFO:teuthology.orchestra.run.smithi138.stderr: 74950K .......... .......... .......... .......... .......... 80% 328M 0s 2024-09-14T11:42:23.879 INFO:teuthology.orchestra.run.smithi138.stderr: 75000K .......... .......... .......... .......... .......... 80% 379M 0s 2024-09-14T11:42:23.879 INFO:teuthology.orchestra.run.smithi138.stderr: 75050K .......... .......... .......... .......... .......... 80% 290M 0s 2024-09-14T11:42:23.879 INFO:teuthology.orchestra.run.smithi138.stderr: 75100K .......... .......... .......... .......... .......... 80% 348M 0s 2024-09-14T11:42:23.879 INFO:teuthology.orchestra.run.smithi138.stderr: 75150K .......... .......... .......... .......... .......... 80% 292M 0s 2024-09-14T11:42:23.879 INFO:teuthology.orchestra.run.smithi138.stderr: 75200K .......... .......... .......... .......... .......... 81% 361M 0s 2024-09-14T11:42:23.879 INFO:teuthology.orchestra.run.smithi138.stderr: 75250K .......... .......... .......... .......... .......... 81% 372M 0s 2024-09-14T11:42:23.879 INFO:teuthology.orchestra.run.smithi138.stderr: 75300K .......... .......... .......... .......... .......... 81% 114M 0s 2024-09-14T11:42:23.879 INFO:teuthology.orchestra.run.smithi138.stderr: 75350K .......... .......... .......... .......... .......... 81% 174M 0s 2024-09-14T11:42:23.879 INFO:teuthology.orchestra.run.smithi138.stderr: 75400K .......... .......... .......... .......... .......... 81% 291M 0s 2024-09-14T11:42:23.880 INFO:teuthology.orchestra.run.smithi138.stderr: 75450K .......... .......... .......... .......... .......... 81% 271M 0s 2024-09-14T11:42:23.880 INFO:teuthology.orchestra.run.smithi138.stderr: 75500K .......... .......... .......... .......... .......... 81% 261M 0s 2024-09-14T11:42:23.880 INFO:teuthology.orchestra.run.smithi138.stderr: 75550K .......... .......... .......... .......... .......... 81% 86.5M 0s 2024-09-14T11:42:23.880 INFO:teuthology.orchestra.run.smithi138.stderr: 75600K .......... .......... .......... .......... .......... 81% 219M 0s 2024-09-14T11:42:23.880 INFO:teuthology.orchestra.run.smithi138.stderr: 75650K .......... .......... .......... .......... .......... 81% 205M 0s 2024-09-14T11:42:23.880 INFO:teuthology.orchestra.run.smithi138.stderr: 75700K .......... .......... .......... .......... .......... 81% 361M 0s 2024-09-14T11:42:23.880 INFO:teuthology.orchestra.run.smithi138.stderr: 75750K .......... .......... .......... .......... .......... 81% 204M 0s 2024-09-14T11:42:23.880 INFO:teuthology.orchestra.run.smithi138.stderr: 75800K .......... .......... .......... .......... .......... 81% 304M 0s 2024-09-14T11:42:23.880 INFO:teuthology.orchestra.run.smithi138.stderr: 75850K .......... .......... .......... .......... .......... 81% 343M 0s 2024-09-14T11:42:23.880 INFO:teuthology.orchestra.run.smithi138.stderr: 75900K .......... .......... .......... .......... .......... 81% 278M 0s 2024-09-14T11:42:23.880 INFO:teuthology.orchestra.run.smithi138.stderr: 75950K .......... .......... .......... .......... .......... 81% 379M 0s 2024-09-14T11:42:23.880 INFO:teuthology.orchestra.run.smithi138.stderr: 76000K .......... .......... .......... .......... .......... 81% 290M 0s 2024-09-14T11:42:23.880 INFO:teuthology.orchestra.run.smithi138.stderr: 76050K .......... .......... .......... .......... .......... 81% 347M 0s 2024-09-14T11:42:23.881 INFO:teuthology.orchestra.run.smithi138.stderr: 76100K .......... .......... .......... .......... .......... 81% 252M 0s 2024-09-14T11:42:23.881 INFO:teuthology.orchestra.run.smithi138.stderr: 76150K .......... .......... .......... .......... .......... 82% 226M 0s 2024-09-14T11:42:23.881 INFO:teuthology.orchestra.run.smithi138.stderr: 76200K .......... .......... .......... .......... .......... 82% 381M 0s 2024-09-14T11:42:23.881 INFO:teuthology.orchestra.run.smithi138.stderr: 76250K .......... .......... .......... .......... .......... 82% 353M 0s 2024-09-14T11:42:23.881 INFO:teuthology.orchestra.run.smithi138.stderr: 76300K .......... .......... .......... .......... .......... 82% 279M 0s 2024-09-14T11:42:23.881 INFO:teuthology.orchestra.run.smithi138.stderr: 76350K .......... .......... .......... .......... .......... 82% 357M 0s 2024-09-14T11:42:23.881 INFO:teuthology.orchestra.run.smithi138.stderr: 76400K .......... .......... .......... .......... .......... 82% 364M 0s 2024-09-14T11:42:23.881 INFO:teuthology.orchestra.run.smithi138.stderr: 76450K .......... .......... .......... .......... .......... 82% 377M 0s 2024-09-14T11:42:23.881 INFO:teuthology.orchestra.run.smithi138.stderr: 76500K .......... .......... .......... .......... .......... 82% 226M 0s 2024-09-14T11:42:23.881 INFO:teuthology.orchestra.run.smithi138.stderr: 76550K .......... .......... .......... .......... .......... 82% 149M 0s 2024-09-14T11:42:23.881 INFO:teuthology.orchestra.run.smithi138.stderr: 76600K .......... .......... .......... .......... .......... 82% 241M 0s 2024-09-14T11:42:23.882 INFO:teuthology.orchestra.run.smithi138.stderr: 76650K .......... .......... .......... .......... .......... 82% 285M 0s 2024-09-14T11:42:23.882 INFO:teuthology.orchestra.run.smithi138.stderr: 76700K .......... .......... .......... .......... .......... 82% 317M 0s 2024-09-14T11:42:23.882 INFO:teuthology.orchestra.run.smithi138.stderr: 76750K .......... .......... .......... .......... .......... 82% 313M 0s 2024-09-14T11:42:23.882 INFO:teuthology.orchestra.run.smithi138.stderr: 76800K .......... .......... .......... .......... .......... 82% 359M 0s 2024-09-14T11:42:23.882 INFO:teuthology.orchestra.run.smithi138.stderr: 76850K .......... .......... .......... .......... .......... 82% 375M 0s 2024-09-14T11:42:23.882 INFO:teuthology.orchestra.run.smithi138.stderr: 76900K .......... .......... .......... .......... .......... 82% 288M 0s 2024-09-14T11:42:23.882 INFO:teuthology.orchestra.run.smithi138.stderr: 76950K .......... .......... .......... .......... .......... 82% 329M 0s 2024-09-14T11:42:23.882 INFO:teuthology.orchestra.run.smithi138.stderr: 77000K .......... .......... .......... .......... .......... 82% 173M 0s 2024-09-14T11:42:23.882 INFO:teuthology.orchestra.run.smithi138.stderr: 77050K .......... .......... .......... .......... .......... 82% 338M 0s 2024-09-14T11:42:23.882 INFO:teuthology.orchestra.run.smithi138.stderr: 77100K .......... .......... .......... .......... .......... 83% 344M 0s 2024-09-14T11:42:23.882 INFO:teuthology.orchestra.run.smithi138.stderr: 77150K .......... .......... .......... .......... .......... 83% 266M 0s 2024-09-14T11:42:23.882 INFO:teuthology.orchestra.run.smithi138.stderr: 77200K .......... .......... .......... .......... .......... 83% 116M 0s 2024-09-14T11:42:23.882 INFO:teuthology.orchestra.run.smithi138.stderr: 77250K .......... .......... .......... .......... .......... 83% 132M 0s 2024-09-14T11:42:23.883 INFO:teuthology.orchestra.run.smithi138.stderr: 77300K .......... .......... .......... .......... .......... 83% 359M 0s 2024-09-14T11:42:23.883 INFO:teuthology.orchestra.run.smithi138.stderr: 77350K .......... .......... .......... .......... .......... 83% 355M 0s 2024-09-14T11:42:23.883 INFO:teuthology.orchestra.run.smithi138.stderr: 77400K .......... .......... .......... .......... .......... 83% 365M 0s 2024-09-14T11:42:23.883 INFO:teuthology.orchestra.run.smithi138.stderr: 77450K .......... .......... .......... .......... .......... 83% 152M 0s 2024-09-14T11:42:23.883 INFO:teuthology.orchestra.run.smithi138.stderr: 77500K .......... .......... .......... .......... .......... 83% 346M 0s 2024-09-14T11:42:23.883 INFO:teuthology.orchestra.run.smithi138.stderr: 77550K .......... .......... .......... .......... .......... 83% 78.2M 0s 2024-09-14T11:42:23.883 INFO:teuthology.orchestra.run.smithi138.stderr: 77600K .......... .......... .......... .......... .......... 83% 206M 0s 2024-09-14T11:42:23.883 INFO:teuthology.orchestra.run.smithi138.stderr: 77650K .......... .......... .......... .......... .......... 83% 319M 0s 2024-09-14T11:42:23.883 INFO:teuthology.orchestra.run.smithi138.stderr: 77700K .......... .......... .......... .......... .......... 83% 349M 0s 2024-09-14T11:42:23.883 INFO:teuthology.orchestra.run.smithi138.stderr: 77750K .......... .......... .......... .......... .......... 83% 357M 0s 2024-09-14T11:42:23.883 INFO:teuthology.orchestra.run.smithi138.stderr: 77800K .......... .......... .......... .......... .......... 83% 363M 0s 2024-09-14T11:42:23.883 INFO:teuthology.orchestra.run.smithi138.stderr: 77850K .......... .......... .......... .......... .......... 83% 312M 0s 2024-09-14T11:42:23.883 INFO:teuthology.orchestra.run.smithi138.stderr: 77900K .......... .......... .......... .......... .......... 83% 379M 0s 2024-09-14T11:42:23.883 INFO:teuthology.orchestra.run.smithi138.stderr: 77950K .......... .......... .......... .......... .......... 83% 212M 0s 2024-09-14T11:42:23.884 INFO:teuthology.orchestra.run.smithi138.stderr: 78000K .......... .......... .......... .......... .......... 84% 328M 0s 2024-09-14T11:42:23.884 INFO:teuthology.orchestra.run.smithi138.stderr: 78050K .......... .......... .......... .......... .......... 84% 357M 0s 2024-09-14T11:42:23.884 INFO:teuthology.orchestra.run.smithi138.stderr: 78100K .......... .......... .......... .......... .......... 84% 364M 0s 2024-09-14T11:42:23.884 INFO:teuthology.orchestra.run.smithi138.stderr: 78150K .......... .......... .......... .......... .......... 84% 318M 0s 2024-09-14T11:42:23.884 INFO:teuthology.orchestra.run.smithi138.stderr: 78200K .......... .......... .......... .......... .......... 84% 372M 0s 2024-09-14T11:42:23.884 INFO:teuthology.orchestra.run.smithi138.stderr: 78250K .......... .......... .......... .......... .......... 84% 382M 0s 2024-09-14T11:42:23.884 INFO:teuthology.orchestra.run.smithi138.stderr: 78300K .......... .......... .......... .......... .......... 84% 277M 0s 2024-09-14T11:42:23.884 INFO:teuthology.orchestra.run.smithi138.stderr: 78350K .......... .......... .......... .......... .......... 84% 242M 0s 2024-09-14T11:42:23.884 INFO:teuthology.orchestra.run.smithi138.stderr: 78400K .......... .......... .......... .......... .......... 84% 136M 0s 2024-09-14T11:42:23.884 INFO:teuthology.orchestra.run.smithi138.stderr: 78450K .......... .......... .......... .......... .......... 84% 260M 0s 2024-09-14T11:42:23.884 INFO:teuthology.orchestra.run.smithi138.stderr: 78500K .......... .......... .......... .......... .......... 84% 391M 0s 2024-09-14T11:42:23.884 INFO:teuthology.orchestra.run.smithi138.stderr: 78550K .......... .......... .......... .......... .......... 84% 92.3M 0s 2024-09-14T11:42:23.885 INFO:teuthology.orchestra.run.smithi138.stderr: 78600K .......... .......... .......... .......... .......... 84% 130M 0s 2024-09-14T11:42:23.885 INFO:teuthology.orchestra.run.smithi138.stderr: 78650K .......... .......... .......... .......... .......... 84% 346M 0s 2024-09-14T11:42:23.885 INFO:teuthology.orchestra.run.smithi138.stderr: 78700K .......... .......... .......... .......... .......... 84% 389M 0s 2024-09-14T11:42:23.885 INFO:teuthology.orchestra.run.smithi138.stderr: 78750K .......... .......... .......... .......... .......... 84% 229M 0s 2024-09-14T11:42:23.885 INFO:teuthology.orchestra.run.smithi138.stderr: 78800K .......... .......... .......... .......... .......... 84% 147M 0s 2024-09-14T11:42:23.885 INFO:teuthology.orchestra.run.smithi138.stderr: 78850K .......... .......... .......... .......... .......... 84% 356M 0s 2024-09-14T11:42:23.885 INFO:teuthology.orchestra.run.smithi138.stderr: 78900K .......... .......... .......... .......... .......... 84% 335M 0s 2024-09-14T11:42:23.885 INFO:teuthology.orchestra.run.smithi138.stderr: 78950K .......... .......... .......... .......... .......... 85% 356M 0s 2024-09-14T11:42:23.885 INFO:teuthology.orchestra.run.smithi138.stderr: 79000K .......... .......... .......... .......... .......... 85% 331M 0s 2024-09-14T11:42:23.885 INFO:teuthology.orchestra.run.smithi138.stderr: 79050K .......... .......... .......... .......... .......... 85% 334M 0s 2024-09-14T11:42:23.885 INFO:teuthology.orchestra.run.smithi138.stderr: 79100K .......... .......... .......... .......... .......... 85% 381M 0s 2024-09-14T11:42:23.885 INFO:teuthology.orchestra.run.smithi138.stderr: 79150K .......... .......... .......... .......... .......... 85% 197M 0s 2024-09-14T11:42:23.886 INFO:teuthology.orchestra.run.smithi138.stderr: 79200K .......... .......... .......... .......... .......... 85% 171M 0s 2024-09-14T11:42:23.886 INFO:teuthology.orchestra.run.smithi138.stderr: 79250K .......... .......... .......... .......... .......... 85% 354M 0s 2024-09-14T11:42:23.886 INFO:teuthology.orchestra.run.smithi138.stderr: 79300K .......... .......... .......... .......... .......... 85% 316M 0s 2024-09-14T11:42:23.886 INFO:teuthology.orchestra.run.smithi138.stderr: 79350K .......... .......... .......... .......... .......... 85% 356M 0s 2024-09-14T11:42:23.886 INFO:teuthology.orchestra.run.smithi138.stderr: 79400K .......... .......... .......... .......... .......... 85% 377M 0s 2024-09-14T11:42:23.886 INFO:teuthology.orchestra.run.smithi138.stderr: 79450K .......... .......... .......... .......... .......... 85% 370M 0s 2024-09-14T11:42:23.886 INFO:teuthology.orchestra.run.smithi138.stderr: 79500K .......... .......... .......... .......... .......... 85% 313M 0s 2024-09-14T11:42:23.886 INFO:teuthology.orchestra.run.smithi138.stderr: 79550K .......... .......... .......... .......... .......... 85% 345M 0s 2024-09-14T11:42:23.886 INFO:teuthology.orchestra.run.smithi138.stderr: 79600K .......... .......... .......... .......... .......... 85% 220M 0s 2024-09-14T11:42:23.886 INFO:teuthology.orchestra.run.smithi138.stderr: 79650K .......... .......... .......... .......... .......... 85% 219M 0s 2024-09-14T11:42:23.886 INFO:teuthology.orchestra.run.smithi138.stderr: 79700K .......... .......... .......... .......... .......... 85% 184M 0s 2024-09-14T11:42:23.886 INFO:teuthology.orchestra.run.smithi138.stderr: 79750K .......... .......... .......... .......... .......... 85% 320M 0s 2024-09-14T11:42:23.887 INFO:teuthology.orchestra.run.smithi138.stderr: 79800K .......... .......... .......... .......... .......... 85% 348M 0s 2024-09-14T11:42:23.887 INFO:teuthology.orchestra.run.smithi138.stderr: 79850K .......... .......... .......... .......... .......... 86% 357M 0s 2024-09-14T11:42:23.887 INFO:teuthology.orchestra.run.smithi138.stderr: 79900K .......... .......... .......... .......... .......... 86% 355M 0s 2024-09-14T11:42:23.887 INFO:teuthology.orchestra.run.smithi138.stderr: 79950K .......... .......... .......... .......... .......... 86% 208M 0s 2024-09-14T11:42:23.887 INFO:teuthology.orchestra.run.smithi138.stderr: 80000K .......... .......... .......... .......... .......... 86% 329M 0s 2024-09-14T11:42:23.887 INFO:teuthology.orchestra.run.smithi138.stderr: 80050K .......... .......... .......... .......... .......... 86% 342M 0s 2024-09-14T11:42:23.887 INFO:teuthology.orchestra.run.smithi138.stderr: 80100K .......... .......... .......... .......... .......... 86% 337M 0s 2024-09-14T11:42:23.887 INFO:teuthology.orchestra.run.smithi138.stderr: 80150K .......... .......... .......... .......... .......... 86% 318M 0s 2024-09-14T11:42:23.887 INFO:teuthology.orchestra.run.smithi138.stderr: 80200K .......... .......... .......... .......... .......... 86% 94.2M 0s 2024-09-14T11:42:23.887 INFO:teuthology.orchestra.run.smithi138.stderr: 80250K .......... .......... .......... .......... .......... 86% 96.9M 0s 2024-09-14T11:42:23.887 INFO:teuthology.orchestra.run.smithi138.stderr: 80300K .......... .......... .......... .......... .......... 86% 122M 0s 2024-09-14T11:42:23.887 INFO:teuthology.orchestra.run.smithi138.stderr: 80350K .......... .......... .......... .......... .......... 86% 272M 0s 2024-09-14T11:42:23.887 INFO:teuthology.orchestra.run.smithi138.stderr: 80400K .......... .......... .......... .......... .......... 86% 326M 0s 2024-09-14T11:42:23.887 INFO:teuthology.orchestra.run.smithi138.stderr: 80450K .......... .......... .......... .......... .......... 86% 345M 0s 2024-09-14T11:42:23.888 INFO:teuthology.orchestra.run.smithi138.stderr: 80500K .......... .......... .......... .......... .......... 86% 354M 0s 2024-09-14T11:42:23.888 INFO:teuthology.orchestra.run.smithi138.stderr: 80550K .......... .......... .......... .......... .......... 86% 114M 0s 2024-09-14T11:42:23.888 INFO:teuthology.orchestra.run.smithi138.stderr: 80600K .......... .......... .......... .......... .......... 86% 347M 0s 2024-09-14T11:42:23.888 INFO:teuthology.orchestra.run.smithi138.stderr: 80650K .......... .......... .......... .......... .......... 86% 334M 0s 2024-09-14T11:42:23.888 INFO:teuthology.orchestra.run.smithi138.stderr: 80700K .......... .......... .......... .......... .......... 86% 382M 0s 2024-09-14T11:42:23.888 INFO:teuthology.orchestra.run.smithi138.stderr: 80750K .......... .......... .......... .......... .......... 86% 337M 0s 2024-09-14T11:42:23.888 INFO:teuthology.orchestra.run.smithi138.stderr: 80800K .......... .......... .......... .......... .......... 87% 341M 0s 2024-09-14T11:42:23.888 INFO:teuthology.orchestra.run.smithi138.stderr: 80850K .......... .......... .......... .......... .......... 87% 321M 0s 2024-09-14T11:42:23.888 INFO:teuthology.orchestra.run.smithi138.stderr: 80900K .......... .......... .......... .......... .......... 87% 215M 0s 2024-09-14T11:42:23.888 INFO:teuthology.orchestra.run.smithi138.stderr: 80950K .......... .......... .......... .......... .......... 87% 302M 0s 2024-09-14T11:42:23.888 INFO:teuthology.orchestra.run.smithi138.stderr: 81000K .......... .......... .......... .......... .......... 87% 273M 0s 2024-09-14T11:42:23.888 INFO:teuthology.orchestra.run.smithi138.stderr: 81050K .......... .......... .......... .......... .......... 87% 334M 0s 2024-09-14T11:42:23.888 INFO:teuthology.orchestra.run.smithi138.stderr: 81100K .......... .......... .......... .......... .......... 87% 365M 0s 2024-09-14T11:42:23.889 INFO:teuthology.orchestra.run.smithi138.stderr: 81150K .......... .......... .......... .......... .......... 87% 296M 0s 2024-09-14T11:42:23.889 INFO:teuthology.orchestra.run.smithi138.stderr: 81200K .......... .......... .......... .......... .......... 87% 382M 0s 2024-09-14T11:42:23.889 INFO:teuthology.orchestra.run.smithi138.stderr: 81250K .......... .......... .......... .......... .......... 87% 368M 0s 2024-09-14T11:42:23.889 INFO:teuthology.orchestra.run.smithi138.stderr: 81300K .......... .......... .......... .......... .......... 87% 357M 0s 2024-09-14T11:42:23.889 INFO:teuthology.orchestra.run.smithi138.stderr: 81350K .......... .......... .......... .......... .......... 87% 329M 0s 2024-09-14T11:42:23.889 INFO:teuthology.orchestra.run.smithi138.stderr: 81400K .......... .......... .......... .......... .......... 87% 260M 0s 2024-09-14T11:42:23.889 INFO:teuthology.orchestra.run.smithi138.stderr: 81450K .......... .......... .......... .......... .......... 87% 220M 0s 2024-09-14T11:42:23.889 INFO:teuthology.orchestra.run.smithi138.stderr: 81500K .......... .......... .......... .......... .......... 87% 267M 0s 2024-09-14T11:42:23.889 INFO:teuthology.orchestra.run.smithi138.stderr: 81550K .......... .......... .......... .......... .......... 87% 104M 0s 2024-09-14T11:42:23.889 INFO:teuthology.orchestra.run.smithi138.stderr: 81600K .......... .......... .......... .......... .......... 87% 155M 0s 2024-09-14T11:42:23.889 INFO:teuthology.orchestra.run.smithi138.stderr: 81650K .......... .......... .......... .......... .......... 87% 208M 0s 2024-09-14T11:42:23.889 INFO:teuthology.orchestra.run.smithi138.stderr: 81700K .......... .......... .......... .......... .......... 87% 311M 0s 2024-09-14T11:42:23.890 INFO:teuthology.orchestra.run.smithi138.stderr: 81750K .......... .......... .......... .......... .......... 88% 314M 0s 2024-09-14T11:42:23.890 INFO:teuthology.orchestra.run.smithi138.stderr: 81800K .......... .......... .......... .......... .......... 88% 213M 0s 2024-09-14T11:42:23.890 INFO:teuthology.orchestra.run.smithi138.stderr: 81850K .......... .......... .......... .......... .......... 88% 151M 0s 2024-09-14T11:42:23.890 INFO:teuthology.orchestra.run.smithi138.stderr: 81900K .......... .......... .......... .......... .......... 88% 367M 0s 2024-09-14T11:42:23.890 INFO:teuthology.orchestra.run.smithi138.stderr: 81950K .......... .......... .......... .......... .......... 88% 319M 0s 2024-09-14T11:42:23.890 INFO:teuthology.orchestra.run.smithi138.stderr: 82000K .......... .......... .......... .......... .......... 88% 264M 0s 2024-09-14T11:42:23.890 INFO:teuthology.orchestra.run.smithi138.stderr: 82050K .......... .......... .......... .......... .......... 88% 225M 0s 2024-09-14T11:42:23.890 INFO:teuthology.orchestra.run.smithi138.stderr: 82100K .......... .......... .......... .......... .......... 88% 347M 0s 2024-09-14T11:42:23.890 INFO:teuthology.orchestra.run.smithi138.stderr: 82150K .......... .......... .......... .......... .......... 88% 323M 0s 2024-09-14T11:42:23.890 INFO:teuthology.orchestra.run.smithi138.stderr: 82200K .......... .......... .......... .......... .......... 88% 295M 0s 2024-09-14T11:42:23.890 INFO:teuthology.orchestra.run.smithi138.stderr: 82250K .......... .......... .......... .......... .......... 88% 289M 0s 2024-09-14T11:42:23.891 INFO:teuthology.orchestra.run.smithi138.stderr: 82300K .......... .......... .......... .......... .......... 88% 228M 0s 2024-09-14T11:42:23.891 INFO:teuthology.orchestra.run.smithi138.stderr: 82350K .......... .......... .......... .......... .......... 88% 290M 0s 2024-09-14T11:42:23.891 INFO:teuthology.orchestra.run.smithi138.stderr: 82400K .......... .......... .......... .......... .......... 88% 360M 0s 2024-09-14T11:42:23.891 INFO:teuthology.orchestra.run.smithi138.stderr: 82450K .......... .......... .......... .......... .......... 88% 365M 0s 2024-09-14T11:42:23.891 INFO:teuthology.orchestra.run.smithi138.stderr: 82500K .......... .......... .......... .......... .......... 88% 353M 0s 2024-09-14T11:42:23.891 INFO:teuthology.orchestra.run.smithi138.stderr: 82550K .......... .......... .......... .......... .......... 88% 344M 0s 2024-09-14T11:42:23.891 INFO:teuthology.orchestra.run.smithi138.stderr: 82600K .......... .......... .......... .......... .......... 88% 279M 0s 2024-09-14T11:42:23.891 INFO:teuthology.orchestra.run.smithi138.stderr: 82650K .......... .......... .......... .......... .......... 89% 106M 0s 2024-09-14T11:42:23.891 INFO:teuthology.orchestra.run.smithi138.stderr: 82700K .......... .......... .......... .......... .......... 89% 287M 0s 2024-09-14T11:42:23.891 INFO:teuthology.orchestra.run.smithi138.stderr: 82750K .......... .......... .......... .......... .......... 89% 196M 0s 2024-09-14T11:42:23.891 INFO:teuthology.orchestra.run.smithi138.stderr: 82800K .......... .......... .......... .......... .......... 89% 351M 0s 2024-09-14T11:42:23.892 INFO:teuthology.orchestra.run.smithi138.stderr: 82850K .......... .......... .......... .......... .......... 89% 339M 0s 2024-09-14T11:42:23.892 INFO:teuthology.orchestra.run.smithi138.stderr: 82900K .......... .......... .......... .......... .......... 89% 311M 0s 2024-09-14T11:42:23.892 INFO:teuthology.orchestra.run.smithi138.stderr: 82950K .......... .......... .......... .......... .......... 89% 352M 0s 2024-09-14T11:42:23.892 INFO:teuthology.orchestra.run.smithi138.stderr: 83000K .......... .......... .......... .......... .......... 89% 331M 0s 2024-09-14T11:42:23.892 INFO:teuthology.orchestra.run.smithi138.stderr: 83050K .......... .......... .......... .......... .......... 89% 352M 0s 2024-09-14T11:42:23.892 INFO:teuthology.orchestra.run.smithi138.stderr: 83100K .......... .......... .......... .......... .......... 89% 335M 0s 2024-09-14T11:42:23.892 INFO:teuthology.orchestra.run.smithi138.stderr: 83150K .......... .......... .......... .......... .......... 89% 159M 0s 2024-09-14T11:42:23.892 INFO:teuthology.orchestra.run.smithi138.stderr: 83200K .......... .......... .......... .......... .......... 89% 385M 0s 2024-09-14T11:42:23.892 INFO:teuthology.orchestra.run.smithi138.stderr: 83250K .......... .......... .......... .......... .......... 89% 97.3M 0s 2024-09-14T11:42:23.892 INFO:teuthology.orchestra.run.smithi138.stderr: 83300K .......... .......... .......... .......... .......... 89% 98.4M 0s 2024-09-14T11:42:23.892 INFO:teuthology.orchestra.run.smithi138.stderr: 83350K .......... .......... .......... .......... .......... 89% 367M 0s 2024-09-14T11:42:23.892 INFO:teuthology.orchestra.run.smithi138.stderr: 83400K .......... .......... .......... .......... .......... 89% 345M 0s 2024-09-14T11:42:23.892 INFO:teuthology.orchestra.run.smithi138.stderr: 83450K .......... .......... .......... .......... .......... 89% 200M 0s 2024-09-14T11:42:23.893 INFO:teuthology.orchestra.run.smithi138.stderr: 83500K .......... .......... .......... .......... .......... 89% 102M 0s 2024-09-14T11:42:23.893 INFO:teuthology.orchestra.run.smithi138.stderr: 83550K .......... .......... .......... .......... .......... 89% 235M 0s 2024-09-14T11:42:23.893 INFO:teuthology.orchestra.run.smithi138.stderr: 83600K .......... .......... .......... .......... .......... 90% 350M 0s 2024-09-14T11:42:23.893 INFO:teuthology.orchestra.run.smithi138.stderr: 83650K .......... .......... .......... .......... .......... 90% 376M 0s 2024-09-14T11:42:23.893 INFO:teuthology.orchestra.run.smithi138.stderr: 83700K .......... .......... .......... .......... .......... 90% 373M 0s 2024-09-14T11:42:23.893 INFO:teuthology.orchestra.run.smithi138.stderr: 83750K .......... .......... .......... .......... .......... 90% 212M 0s 2024-09-14T11:42:23.893 INFO:teuthology.orchestra.run.smithi138.stderr: 83800K .......... .......... .......... .......... .......... 90% 344M 0s 2024-09-14T11:42:23.893 INFO:teuthology.orchestra.run.smithi138.stderr: 83850K .......... .......... .......... .......... .......... 90% 382M 0s 2024-09-14T11:42:23.893 INFO:teuthology.orchestra.run.smithi138.stderr: 83900K .......... .......... .......... .......... .......... 90% 377M 0s 2024-09-14T11:42:23.893 INFO:teuthology.orchestra.run.smithi138.stderr: 83950K .......... .......... .......... .......... .......... 90% 334M 0s 2024-09-14T11:42:23.893 INFO:teuthology.orchestra.run.smithi138.stderr: 84000K .......... .......... .......... .......... .......... 90% 336M 0s 2024-09-14T11:42:23.893 INFO:teuthology.orchestra.run.smithi138.stderr: 84050K .......... .......... .......... .......... .......... 90% 375M 0s 2024-09-14T11:42:23.894 INFO:teuthology.orchestra.run.smithi138.stderr: 84100K .......... .......... .......... .......... .......... 90% 260M 0s 2024-09-14T11:42:23.894 INFO:teuthology.orchestra.run.smithi138.stderr: 84150K .......... .......... .......... .......... .......... 90% 308M 0s 2024-09-14T11:42:23.894 INFO:teuthology.orchestra.run.smithi138.stderr: 84200K .......... .......... .......... .......... .......... 90% 377M 0s 2024-09-14T11:42:23.894 INFO:teuthology.orchestra.run.smithi138.stderr: 84250K .......... .......... .......... .......... .......... 90% 349M 0s 2024-09-14T11:42:23.894 INFO:teuthology.orchestra.run.smithi138.stderr: 84300K .......... .......... .......... .......... .......... 90% 322M 0s 2024-09-14T11:42:23.894 INFO:teuthology.orchestra.run.smithi138.stderr: 84350K .......... .......... .......... .......... .......... 90% 383M 0s 2024-09-14T11:42:23.894 INFO:teuthology.orchestra.run.smithi138.stderr: 84400K .......... .......... .......... .......... .......... 90% 358M 0s 2024-09-14T11:42:23.894 INFO:teuthology.orchestra.run.smithi138.stderr: 84450K .......... .......... .......... .......... .......... 90% 360M 0s 2024-09-14T11:42:23.894 INFO:teuthology.orchestra.run.smithi138.stderr: 84500K .......... .......... .......... .......... .......... 91% 110M 0s 2024-09-14T11:42:23.894 INFO:teuthology.orchestra.run.smithi138.stderr: 84550K .......... .......... .......... .......... .......... 91% 368M 0s 2024-09-14T11:42:23.894 INFO:teuthology.orchestra.run.smithi138.stderr: 84600K .......... .......... .......... .......... .......... 91% 135M 0s 2024-09-14T11:42:23.894 INFO:teuthology.orchestra.run.smithi138.stderr: 84650K .......... .......... .......... .......... .......... 91% 220M 0s 2024-09-14T11:42:23.894 INFO:teuthology.orchestra.run.smithi138.stderr: 84700K .......... .......... .......... .......... .......... 91% 137M 0s 2024-09-14T11:42:23.895 INFO:teuthology.orchestra.run.smithi138.stderr: 84750K .......... .......... .......... .......... .......... 91% 299M 0s 2024-09-14T11:42:23.895 INFO:teuthology.orchestra.run.smithi138.stderr: 84800K .......... .......... .......... .......... .......... 91% 386M 0s 2024-09-14T11:42:23.895 INFO:teuthology.orchestra.run.smithi138.stderr: 84850K .......... .......... .......... .......... .......... 91% 375M 0s 2024-09-14T11:42:23.895 INFO:teuthology.orchestra.run.smithi138.stderr: 84900K .......... .......... .......... .......... .......... 91% 169M 0s 2024-09-14T11:42:23.895 INFO:teuthology.orchestra.run.smithi138.stderr: 84950K .......... .......... .......... .......... .......... 91% 313M 0s 2024-09-14T11:42:23.895 INFO:teuthology.orchestra.run.smithi138.stderr: 85000K .......... .......... .......... .......... .......... 91% 251M 0s 2024-09-14T11:42:23.895 INFO:teuthology.orchestra.run.smithi138.stderr: 85050K .......... .......... .......... .......... .......... 91% 246M 0s 2024-09-14T11:42:23.895 INFO:teuthology.orchestra.run.smithi138.stderr: 85100K .......... .......... .......... .......... .......... 91% 140M 0s 2024-09-14T11:42:23.895 INFO:teuthology.orchestra.run.smithi138.stderr: 85150K .......... .......... .......... .......... .......... 91% 334M 0s 2024-09-14T11:42:23.895 INFO:teuthology.orchestra.run.smithi138.stderr: 85200K .......... .......... .......... .......... .......... 91% 317M 0s 2024-09-14T11:42:23.895 INFO:teuthology.orchestra.run.smithi138.stderr: 85250K .......... .......... .......... .......... .......... 91% 356M 0s 2024-09-14T11:42:23.896 INFO:teuthology.orchestra.run.smithi138.stderr: 85300K .......... .......... .......... .......... .......... 91% 347M 0s 2024-09-14T11:42:23.896 INFO:teuthology.orchestra.run.smithi138.stderr: 85350K .......... .......... .......... .......... .......... 91% 359M 0s 2024-09-14T11:42:23.896 INFO:teuthology.orchestra.run.smithi138.stderr: 85400K .......... .......... .......... .......... .......... 91% 310M 0s 2024-09-14T11:42:23.896 INFO:teuthology.orchestra.run.smithi138.stderr: 85450K .......... .......... .......... .......... .......... 92% 222M 0s 2024-09-14T11:42:23.896 INFO:teuthology.orchestra.run.smithi138.stderr: 85500K .......... .......... .......... .......... .......... 92% 344M 0s 2024-09-14T11:42:23.896 INFO:teuthology.orchestra.run.smithi138.stderr: 85550K .......... .......... .......... .......... .......... 92% 349M 0s 2024-09-14T11:42:23.896 INFO:teuthology.orchestra.run.smithi138.stderr: 85600K .......... .......... .......... .......... .......... 92% 336M 0s 2024-09-14T11:42:23.896 INFO:teuthology.orchestra.run.smithi138.stderr: 85650K .......... .......... .......... .......... .......... 92% 180M 0s 2024-09-14T11:42:23.896 INFO:teuthology.orchestra.run.smithi138.stderr: 85700K .......... .......... .......... .......... .......... 92% 167M 0s 2024-09-14T11:42:23.896 INFO:teuthology.orchestra.run.smithi138.stderr: 85750K .......... .......... .......... .......... .......... 92% 369M 0s 2024-09-14T11:42:23.896 INFO:teuthology.orchestra.run.smithi138.stderr: 85800K .......... .......... .......... .......... .......... 92% 262M 0s 2024-09-14T11:42:23.896 INFO:teuthology.orchestra.run.smithi138.stderr: 85850K .......... .......... .......... .......... .......... 92% 341M 0s 2024-09-14T11:42:23.896 INFO:teuthology.orchestra.run.smithi138.stderr: 85900K .......... .......... .......... .......... .......... 92% 325M 0s 2024-09-14T11:42:23.897 INFO:teuthology.orchestra.run.smithi138.stderr: 85950K .......... .......... .......... .......... .......... 92% 391M 0s 2024-09-14T11:42:23.897 INFO:teuthology.orchestra.run.smithi138.stderr: 86000K .......... .......... .......... .......... .......... 92% 256M 0s 2024-09-14T11:42:23.897 INFO:teuthology.orchestra.run.smithi138.stderr: 86050K .......... .......... .......... .......... .......... 92% 349M 0s 2024-09-14T11:42:23.897 INFO:teuthology.orchestra.run.smithi138.stderr: 86100K .......... .......... .......... .......... .......... 92% 173M 0s 2024-09-14T11:42:23.897 INFO:teuthology.orchestra.run.smithi138.stderr: 86150K .......... .......... .......... .......... .......... 92% 361M 0s 2024-09-14T11:42:23.897 INFO:teuthology.orchestra.run.smithi138.stderr: 86200K .......... .......... .......... .......... .......... 92% 391M 0s 2024-09-14T11:42:23.897 INFO:teuthology.orchestra.run.smithi138.stderr: 86250K .......... .......... .......... .......... .......... 92% 104M 0s 2024-09-14T11:42:23.897 INFO:teuthology.orchestra.run.smithi138.stderr: 86300K .......... .......... .......... .......... .......... 92% 94.3M 0s 2024-09-14T11:42:23.897 INFO:teuthology.orchestra.run.smithi138.stderr: 86350K .......... .......... .......... .......... .......... 93% 345M 0s 2024-09-14T11:42:23.897 INFO:teuthology.orchestra.run.smithi138.stderr: 86400K .......... .......... .......... .......... .......... 93% 374M 0s 2024-09-14T11:42:23.897 INFO:teuthology.orchestra.run.smithi138.stderr: 86450K .......... .......... .......... .......... .......... 93% 242M 0s 2024-09-14T11:42:23.897 INFO:teuthology.orchestra.run.smithi138.stderr: 86500K .......... .......... .......... .......... .......... 93% 80.0M 0s 2024-09-14T11:42:23.897 INFO:teuthology.orchestra.run.smithi138.stderr: 86550K .......... .......... .......... .......... .......... 93% 101M 0s 2024-09-14T11:42:23.898 INFO:teuthology.orchestra.run.smithi138.stderr: 86600K .......... .......... .......... .......... .......... 93% 301M 0s 2024-09-14T11:42:23.898 INFO:teuthology.orchestra.run.smithi138.stderr: 86650K .......... .......... .......... .......... .......... 93% 333M 0s 2024-09-14T11:42:23.898 INFO:teuthology.orchestra.run.smithi138.stderr: 86700K .......... .......... .......... .......... .......... 93% 365M 0s 2024-09-14T11:42:23.898 INFO:teuthology.orchestra.run.smithi138.stderr: 86750K .......... .......... .......... .......... .......... 93% 303M 0s 2024-09-14T11:42:23.898 INFO:teuthology.orchestra.run.smithi138.stderr: 86800K .......... .......... .......... .......... .......... 93% 367M 0s 2024-09-14T11:42:23.898 INFO:teuthology.orchestra.run.smithi138.stderr: 86850K .......... .......... .......... .......... .......... 93% 320M 0s 2024-09-14T11:42:23.898 INFO:teuthology.orchestra.run.smithi138.stderr: 86900K .......... .......... .......... .......... .......... 93% 345M 0s 2024-09-14T11:42:23.898 INFO:teuthology.orchestra.run.smithi138.stderr: 86950K .......... .......... .......... .......... .......... 93% 327M 0s 2024-09-14T11:42:23.898 INFO:teuthology.orchestra.run.smithi138.stderr: 87000K .......... .......... .......... .......... .......... 93% 366M 0s 2024-09-14T11:42:23.898 INFO:teuthology.orchestra.run.smithi138.stderr: 87050K .......... .......... .......... .......... .......... 93% 298M 0s 2024-09-14T11:42:23.898 INFO:teuthology.orchestra.run.smithi138.stderr: 87100K .......... .......... .......... .......... .......... 93% 305M 0s 2024-09-14T11:42:23.898 INFO:teuthology.orchestra.run.smithi138.stderr: 87150K .......... .......... .......... .......... .......... 93% 371M 0s 2024-09-14T11:42:23.899 INFO:teuthology.orchestra.run.smithi138.stderr: 87200K .......... .......... .......... .......... .......... 93% 390M 0s 2024-09-14T11:42:23.899 INFO:teuthology.orchestra.run.smithi138.stderr: 87250K .......... .......... .......... .......... .......... 93% 296M 0s 2024-09-14T11:42:23.899 INFO:teuthology.orchestra.run.smithi138.stderr: 87300K .......... .......... .......... .......... .......... 94% 341M 0s 2024-09-14T11:42:23.899 INFO:teuthology.orchestra.run.smithi138.stderr: 87350K .......... .......... .......... .......... .......... 94% 314M 0s 2024-09-14T11:42:23.899 INFO:teuthology.orchestra.run.smithi138.stderr: 87400K .......... .......... .......... .......... .......... 94% 378M 0s 2024-09-14T11:42:23.899 INFO:teuthology.orchestra.run.smithi138.stderr: 87450K .......... .......... .......... .......... .......... 94% 286M 0s 2024-09-14T11:42:23.899 INFO:teuthology.orchestra.run.smithi138.stderr: 87500K .......... .......... .......... .......... .......... 94% 381M 0s 2024-09-14T11:42:23.899 INFO:teuthology.orchestra.run.smithi138.stderr: 87550K .......... .......... .......... .......... .......... 94% 371M 0s 2024-09-14T11:42:23.899 INFO:teuthology.orchestra.run.smithi138.stderr: 87600K .......... .......... .......... .......... .......... 94% 343M 0s 2024-09-14T11:42:23.899 INFO:teuthology.orchestra.run.smithi138.stderr: 87650K .......... .......... .......... .......... .......... 94% 171M 0s 2024-09-14T11:42:23.899 INFO:teuthology.orchestra.run.smithi138.stderr: 87700K .......... .......... .......... .......... .......... 94% 136M 0s 2024-09-14T11:42:23.899 INFO:teuthology.orchestra.run.smithi138.stderr: 87750K .......... .......... .......... .......... .......... 94% 140M 0s 2024-09-14T11:42:23.900 INFO:teuthology.orchestra.run.smithi138.stderr: 87800K .......... .......... .......... .......... .......... 94% 331M 0s 2024-09-14T11:42:23.900 INFO:teuthology.orchestra.run.smithi138.stderr: 87850K .......... .......... .......... .......... .......... 94% 358M 0s 2024-09-14T11:42:23.900 INFO:teuthology.orchestra.run.smithi138.stderr: 87900K .......... .......... .......... .......... .......... 94% 351M 0s 2024-09-14T11:42:23.900 INFO:teuthology.orchestra.run.smithi138.stderr: 87950K .......... .......... .......... .......... .......... 94% 147M 0s 2024-09-14T11:42:23.900 INFO:teuthology.orchestra.run.smithi138.stderr: 88000K .......... .......... .......... .......... .......... 94% 342M 0s 2024-09-14T11:42:23.900 INFO:teuthology.orchestra.run.smithi138.stderr: 88050K .......... .......... .......... .......... .......... 94% 384M 0s 2024-09-14T11:42:23.900 INFO:teuthology.orchestra.run.smithi138.stderr: 88100K .......... .......... .......... .......... .......... 94% 262M 0s 2024-09-14T11:42:23.900 INFO:teuthology.orchestra.run.smithi138.stderr: 88150K .......... .......... .......... .......... .......... 94% 125M 0s 2024-09-14T11:42:23.900 INFO:teuthology.orchestra.run.smithi138.stderr: 88200K .......... .......... .......... .......... .......... 94% 280M 0s 2024-09-14T11:42:23.900 INFO:teuthology.orchestra.run.smithi138.stderr: 88250K .......... .......... .......... .......... .......... 95% 355M 0s 2024-09-14T11:42:23.900 INFO:teuthology.orchestra.run.smithi138.stderr: 88300K .......... .......... .......... .......... .......... 95% 304M 0s 2024-09-14T11:42:23.900 INFO:teuthology.orchestra.run.smithi138.stderr: 88350K .......... .......... .......... .......... .......... 95% 359M 0s 2024-09-14T11:42:23.900 INFO:teuthology.orchestra.run.smithi138.stderr: 88400K .......... .......... .......... .......... .......... 95% 311M 0s 2024-09-14T11:42:23.901 INFO:teuthology.orchestra.run.smithi138.stderr: 88450K .......... .......... .......... .......... .......... 95% 326M 0s 2024-09-14T11:42:23.901 INFO:teuthology.orchestra.run.smithi138.stderr: 88500K .......... .......... .......... .......... .......... 95% 378M 0s 2024-09-14T11:42:23.901 INFO:teuthology.orchestra.run.smithi138.stderr: 88550K .......... .......... .......... .......... .......... 95% 376M 0s 2024-09-14T11:42:23.901 INFO:teuthology.orchestra.run.smithi138.stderr: 88600K .......... .......... .......... .......... .......... 95% 127M 0s 2024-09-14T11:42:23.901 INFO:teuthology.orchestra.run.smithi138.stderr: 88650K .......... .......... .......... .......... .......... 95% 361M 0s 2024-09-14T11:42:23.901 INFO:teuthology.orchestra.run.smithi138.stderr: 88700K .......... .......... .......... .......... .......... 95% 356M 0s 2024-09-14T11:42:23.901 INFO:teuthology.orchestra.run.smithi138.stderr: 88750K .......... .......... .......... .......... .......... 95% 380M 0s 2024-09-14T11:42:23.901 INFO:teuthology.orchestra.run.smithi138.stderr: 88800K .......... .......... .......... .......... .......... 95% 302M 0s 2024-09-14T11:42:23.901 INFO:teuthology.orchestra.run.smithi138.stderr: 88850K .......... .......... .......... .......... .......... 95% 199M 0s 2024-09-14T11:42:23.901 INFO:teuthology.orchestra.run.smithi138.stderr: 88900K .......... .......... .......... .......... .......... 95% 200M 0s 2024-09-14T11:42:23.901 INFO:teuthology.orchestra.run.smithi138.stderr: 88950K .......... .......... .......... .......... .......... 95% 332M 0s 2024-09-14T11:42:23.901 INFO:teuthology.orchestra.run.smithi138.stderr: 89000K .......... .......... .......... .......... .......... 95% 364M 0s 2024-09-14T11:42:23.902 INFO:teuthology.orchestra.run.smithi138.stderr: 89050K .......... .......... .......... .......... .......... 95% 374M 0s 2024-09-14T11:42:23.902 INFO:teuthology.orchestra.run.smithi138.stderr: 89100K .......... .......... .......... .......... .......... 95% 304M 0s 2024-09-14T11:42:23.902 INFO:teuthology.orchestra.run.smithi138.stderr: 89150K .......... .......... .......... .......... .......... 96% 99.1M 0s 2024-09-14T11:42:23.902 INFO:teuthology.orchestra.run.smithi138.stderr: 89200K .......... .......... .......... .......... .......... 96% 345M 0s 2024-09-14T11:42:23.902 INFO:teuthology.orchestra.run.smithi138.stderr: 89250K .......... .......... .......... .......... .......... 96% 344M 0s 2024-09-14T11:42:23.902 INFO:teuthology.orchestra.run.smithi138.stderr: 89300K .......... .......... .......... .......... .......... 96% 157M 0s 2024-09-14T11:42:23.902 INFO:teuthology.orchestra.run.smithi138.stderr: 89350K .......... .......... .......... .......... .......... 96% 181M 0s 2024-09-14T11:42:23.902 INFO:teuthology.orchestra.run.smithi138.stderr: 89400K .......... .......... .......... .......... .......... 96% 284M 0s 2024-09-14T11:42:23.902 INFO:teuthology.orchestra.run.smithi138.stderr: 89450K .......... .......... .......... .......... .......... 96% 379M 0s 2024-09-14T11:42:23.902 INFO:teuthology.orchestra.run.smithi138.stderr: 89500K .......... .......... .......... .......... .......... 96% 89.6M 0s 2024-09-14T11:42:23.902 INFO:teuthology.orchestra.run.smithi138.stderr: 89550K .......... .......... .......... .......... .......... 96% 80.6M 0s 2024-09-14T11:42:23.902 INFO:teuthology.orchestra.run.smithi138.stderr: 89600K .......... .......... .......... .......... .......... 96% 320M 0s 2024-09-14T11:42:23.902 INFO:teuthology.orchestra.run.smithi138.stderr: 89650K .......... .......... .......... .......... .......... 96% 322M 0s 2024-09-14T11:42:23.903 INFO:teuthology.orchestra.run.smithi138.stderr: 89700K .......... .......... .......... .......... .......... 96% 277M 0s 2024-09-14T11:42:23.903 INFO:teuthology.orchestra.run.smithi138.stderr: 89750K .......... .......... .......... .......... .......... 96% 301M 0s 2024-09-14T11:42:23.903 INFO:teuthology.orchestra.run.smithi138.stderr: 89800K .......... .......... .......... .......... .......... 96% 141M 0s 2024-09-14T11:42:23.903 INFO:teuthology.orchestra.run.smithi138.stderr: 89850K .......... .......... .......... .......... .......... 96% 333M 0s 2024-09-14T11:42:23.903 INFO:teuthology.orchestra.run.smithi138.stderr: 89900K .......... .......... .......... .......... .......... 96% 355M 0s 2024-09-14T11:42:23.903 INFO:teuthology.orchestra.run.smithi138.stderr: 89950K .......... .......... .......... .......... .......... 96% 307M 0s 2024-09-14T11:42:23.903 INFO:teuthology.orchestra.run.smithi138.stderr: 90000K .......... .......... .......... .......... .......... 96% 386M 0s 2024-09-14T11:42:23.903 INFO:teuthology.orchestra.run.smithi138.stderr: 90050K .......... .......... .......... .......... .......... 96% 324M 0s 2024-09-14T11:42:23.903 INFO:teuthology.orchestra.run.smithi138.stderr: 90100K .......... .......... .......... .......... .......... 97% 377M 0s 2024-09-14T11:42:23.903 INFO:teuthology.orchestra.run.smithi138.stderr: 90150K .......... .......... .......... .......... .......... 97% 310M 0s 2024-09-14T11:42:23.903 INFO:teuthology.orchestra.run.smithi138.stderr: 90200K .......... .......... .......... .......... .......... 97% 308M 0s 2024-09-14T11:42:23.903 INFO:teuthology.orchestra.run.smithi138.stderr: 90250K .......... .......... .......... .......... .......... 97% 314M 0s 2024-09-14T11:42:23.903 INFO:teuthology.orchestra.run.smithi138.stderr: 90300K .......... .......... .......... .......... .......... 97% 380M 0s 2024-09-14T11:42:23.904 INFO:teuthology.orchestra.run.smithi138.stderr: 90350K .......... .......... .......... .......... .......... 97% 325M 0s 2024-09-14T11:42:23.904 INFO:teuthology.orchestra.run.smithi138.stderr: 90400K .......... .......... .......... .......... .......... 97% 373M 0s 2024-09-14T11:42:23.904 INFO:teuthology.orchestra.run.smithi138.stderr: 90450K .......... .......... .......... .......... .......... 97% 371M 0s 2024-09-14T11:42:23.904 INFO:teuthology.orchestra.run.smithi138.stderr: 90500K .......... .......... .......... .......... .......... 97% 364M 0s 2024-09-14T11:42:23.904 INFO:teuthology.orchestra.run.smithi138.stderr: 90550K .......... .......... .......... .......... .......... 97% 270M 0s 2024-09-14T11:42:23.904 INFO:teuthology.orchestra.run.smithi138.stderr: 90600K .......... .......... .......... .......... .......... 97% 365M 0s 2024-09-14T11:42:23.904 INFO:teuthology.orchestra.run.smithi138.stderr: 90650K .......... .......... .......... .......... .......... 97% 395M 0s 2024-09-14T11:42:23.904 INFO:teuthology.orchestra.run.smithi138.stderr: 90700K .......... .......... .......... .......... .......... 97% 213M 0s 2024-09-14T11:42:23.904 INFO:teuthology.orchestra.run.smithi138.stderr: 90750K .......... .......... .......... .......... .......... 97% 144M 0s 2024-09-14T11:42:23.904 INFO:teuthology.orchestra.run.smithi138.stderr: 90800K .......... .......... .......... .......... .......... 97% 212M 0s 2024-09-14T11:42:23.904 INFO:teuthology.orchestra.run.smithi138.stderr: 90850K .......... .......... .......... .......... .......... 97% 380M 0s 2024-09-14T11:42:23.904 INFO:teuthology.orchestra.run.smithi138.stderr: 90900K .......... .......... .......... .......... .......... 97% 98.4M 0s 2024-09-14T11:42:23.905 INFO:teuthology.orchestra.run.smithi138.stderr: 90950K .......... .......... .......... .......... .......... 97% 349M 0s 2024-09-14T11:42:23.905 INFO:teuthology.orchestra.run.smithi138.stderr: 91000K .......... .......... .......... .......... .......... 98% 307M 0s 2024-09-14T11:42:23.905 INFO:teuthology.orchestra.run.smithi138.stderr: 91050K .......... .......... .......... .......... .......... 98% 385M 0s 2024-09-14T11:42:23.905 INFO:teuthology.orchestra.run.smithi138.stderr: 91100K .......... .......... .......... .......... .......... 98% 382M 0s 2024-09-14T11:42:23.905 INFO:teuthology.orchestra.run.smithi138.stderr: 91150K .......... .......... .......... .......... .......... 98% 288M 0s 2024-09-14T11:42:23.905 INFO:teuthology.orchestra.run.smithi138.stderr: 91200K .......... .......... .......... .......... .......... 98% 140M 0s 2024-09-14T11:42:23.905 INFO:teuthology.orchestra.run.smithi138.stderr: 91250K .......... .......... .......... .......... .......... 98% 356M 0s 2024-09-14T11:42:23.905 INFO:teuthology.orchestra.run.smithi138.stderr: 91300K .......... .......... .......... .......... .......... 98% 398M 0s 2024-09-14T11:42:23.905 INFO:teuthology.orchestra.run.smithi138.stderr: 91350K .......... .......... .......... .......... .......... 98% 214M 0s 2024-09-14T11:42:23.905 INFO:teuthology.orchestra.run.smithi138.stderr: 91400K .......... .......... .......... .......... .......... 98% 383M 0s 2024-09-14T11:42:23.905 INFO:teuthology.orchestra.run.smithi138.stderr: 91450K .......... .......... .......... .......... .......... 98% 373M 0s 2024-09-14T11:42:23.905 INFO:teuthology.orchestra.run.smithi138.stderr: 91500K .......... .......... .......... .......... .......... 98% 134M 0s 2024-09-14T11:42:23.905 INFO:teuthology.orchestra.run.smithi138.stderr: 91550K .......... .......... .......... .......... .......... 98% 231M 0s 2024-09-14T11:42:23.906 INFO:teuthology.orchestra.run.smithi138.stderr: 91600K .......... .......... .......... .......... .......... 98% 396M 0s 2024-09-14T11:42:23.906 INFO:teuthology.orchestra.run.smithi138.stderr: 91650K .......... .......... .......... .......... .......... 98% 279M 0s 2024-09-14T11:42:23.906 INFO:teuthology.orchestra.run.smithi138.stderr: 91700K .......... .......... .......... .......... .......... 98% 291M 0s 2024-09-14T11:42:23.906 INFO:teuthology.orchestra.run.smithi138.stderr: 91750K .......... .......... .......... .......... .......... 98% 365M 0s 2024-09-14T11:42:23.906 INFO:teuthology.orchestra.run.smithi138.stderr: 91800K .......... .......... .......... .......... .......... 98% 391M 0s 2024-09-14T11:42:23.906 INFO:teuthology.orchestra.run.smithi138.stderr: 91850K .......... .......... .......... .......... .......... 98% 376M 0s 2024-09-14T11:42:23.906 INFO:teuthology.orchestra.run.smithi138.stderr: 91900K .......... .......... .......... .......... .......... 98% 322M 0s 2024-09-14T11:42:23.906 INFO:teuthology.orchestra.run.smithi138.stderr: 91950K .......... .......... .......... .......... .......... 99% 113M 0s 2024-09-14T11:42:23.906 INFO:teuthology.orchestra.run.smithi138.stderr: 92000K .......... .......... .......... .......... .......... 99% 311M 0s 2024-09-14T11:42:23.906 INFO:teuthology.orchestra.run.smithi138.stderr: 92050K .......... .......... .......... .......... .......... 99% 368M 0s 2024-09-14T11:42:23.906 INFO:teuthology.orchestra.run.smithi138.stderr: 92100K .......... .......... .......... .......... .......... 99% 396M 0s 2024-09-14T11:42:23.906 INFO:teuthology.orchestra.run.smithi138.stderr: 92150K .......... .......... .......... .......... .......... 99% 232M 0s 2024-09-14T11:42:23.906 INFO:teuthology.orchestra.run.smithi138.stderr: 92200K .......... .......... .......... .......... .......... 99% 359M 0s 2024-09-14T11:42:23.907 INFO:teuthology.orchestra.run.smithi138.stderr: 92250K .......... .......... .......... .......... .......... 99% 384M 0s 2024-09-14T11:42:23.907 INFO:teuthology.orchestra.run.smithi138.stderr: 92300K .......... .......... .......... .......... .......... 99% 150M 0s 2024-09-14T11:42:23.907 INFO:teuthology.orchestra.run.smithi138.stderr: 92350K .......... .......... .......... .......... .......... 99% 247M 0s 2024-09-14T11:42:23.907 INFO:teuthology.orchestra.run.smithi138.stderr: 92400K .......... .......... .......... .......... .......... 99% 129M 0s 2024-09-14T11:42:23.907 INFO:teuthology.orchestra.run.smithi138.stderr: 92450K .......... .......... .......... .......... .......... 99% 153M 0s 2024-09-14T11:42:23.907 INFO:teuthology.orchestra.run.smithi138.stderr: 92500K .......... .......... .......... .......... .......... 99% 300M 0s 2024-09-14T11:42:23.907 INFO:teuthology.orchestra.run.smithi138.stderr: 92550K .......... .......... .......... .......... .......... 99% 76.6M 0s 2024-09-14T11:42:23.907 INFO:teuthology.orchestra.run.smithi138.stderr: 92600K .......... .......... .......... .......... .......... 99% 365M 0s 2024-09-14T11:42:23.907 INFO:teuthology.orchestra.run.smithi138.stderr: 92650K .......... .......... .......... .......... .......... 99% 335M 0s 2024-09-14T11:42:23.907 INFO:teuthology.orchestra.run.smithi138.stderr: 92700K .......... .......... .......... .......... .......... 99% 208M 0s 2024-09-14T11:42:23.907 INFO:teuthology.orchestra.run.smithi138.stderr: 92750K .......... .......... .......... .......... .......... 99% 370M 0s 2024-09-14T11:42:23.907 INFO:teuthology.orchestra.run.smithi138.stderr: 92800K .......... .......... .......... .......... .......... 99% 132M 0s 2024-09-14T11:42:23.907 INFO:teuthology.orchestra.run.smithi138.stderr: 92850K .......... .......... .......... .......... .......... 99% 242M 0s 2024-09-14T11:42:23.908 INFO:teuthology.orchestra.run.smithi138.stderr: 92900K 100% 134G=0.5s 2024-09-14T11:42:23.908 INFO:teuthology.orchestra.run.smithi138.stderr: 2024-09-14T11:42:23.908 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14 11:42:23 (198 MB/s) - 'gradle-6.0.1-bin.zip' saved [95129672/95129672] 2024-09-14T11:42:23.908 INFO:teuthology.orchestra.run.smithi138.stderr: 2024-09-14T11:42:23.934 INFO:teuthology.orchestra.run.smithi138.stdout:Archive: gradle-6.0.1-bin.zip 2024-09-14T11:42:23.934 INFO:teuthology.orchestra.run.smithi138.stdout: creating: /opt/gradle/gradle-6.0.1/ 2024-09-14T11:42:23.934 INFO:teuthology.orchestra.run.smithi138.stdout: inflating: /opt/gradle/gradle-6.0.1/getting-started.html 2024-09-14T11:42:23.934 INFO:teuthology.orchestra.run.smithi138.stdout: inflating: /opt/gradle/gradle-6.0.1/LICENSE 2024-09-14T11:42:23.934 INFO:teuthology.orchestra.run.smithi138.stdout: inflating: /opt/gradle/gradle-6.0.1/NOTICE 2024-09-14T11:42:23.934 INFO:teuthology.orchestra.run.smithi138.stdout: creating: /opt/gradle/gradle-6.0.1/init.d/ 2024-09-14T11:42:23.934 INFO:teuthology.orchestra.run.smithi138.stdout: inflating: /opt/gradle/gradle-6.0.1/init.d/readme.txt 2024-09-14T11:42:23.935 INFO:teuthology.orchestra.run.smithi138.stdout: creating: /opt/gradle/gradle-6.0.1/bin/ 2024-09-14T11:42:23.935 INFO:teuthology.orchestra.run.smithi138.stdout: inflating: /opt/gradle/gradle-6.0.1/bin/gradle 2024-09-14T11:42:23.935 INFO:teuthology.orchestra.run.smithi138.stdout: inflating: /opt/gradle/gradle-6.0.1/bin/gradle.bat 2024-09-14T11:42:23.935 INFO:teuthology.orchestra.run.smithi138.stdout: creating: /opt/gradle/gradle-6.0.1/lib/ 2024-09-14T11:42:23.935 INFO:teuthology.orchestra.run.smithi138.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-api-metadata-6.0.1.jar 2024-09-14T11:42:23.935 INFO:teuthology.orchestra.run.smithi138.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-launcher-6.0.1.jar 2024-09-14T11:42:23.935 INFO:teuthology.orchestra.run.smithi138.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-runtime-api-info-6.0.1.jar 2024-09-14T11:42:23.935 INFO:teuthology.orchestra.run.smithi138.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-kotlin-dsl-6.0.1.jar 2024-09-14T11:42:23.935 INFO:teuthology.orchestra.run.smithi138.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-tooling-api-6.0.1.jar 2024-09-14T11:42:23.935 INFO:teuthology.orchestra.run.smithi138.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-wrapper-6.0.1.jar 2024-09-14T11:42:23.935 INFO:teuthology.orchestra.run.smithi138.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-installation-beacon-6.0.1.jar 2024-09-14T11:42:23.935 INFO:teuthology.orchestra.run.smithi138.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-bootstrap-6.0.1.jar 2024-09-14T11:42:23.936 INFO:teuthology.orchestra.run.smithi138.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-core-6.0.1.jar 2024-09-14T11:42:23.936 INFO:teuthology.orchestra.run.smithi138.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-file-collections-6.0.1.jar 2024-09-14T11:42:23.936 INFO:teuthology.orchestra.run.smithi138.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-model-groovy-6.0.1.jar 2024-09-14T11:42:23.936 INFO:teuthology.orchestra.run.smithi138.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-execution-6.0.1.jar 2024-09-14T11:42:23.936 INFO:teuthology.orchestra.run.smithi138.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-model-core-6.0.1.jar 2024-09-14T11:42:23.936 INFO:teuthology.orchestra.run.smithi138.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-build-cache-packaging-6.0.1.jar 2024-09-14T11:42:23.936 INFO:teuthology.orchestra.run.smithi138.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-build-cache-6.0.1.jar 2024-09-14T11:42:23.936 INFO:teuthology.orchestra.run.smithi138.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-core-api-6.0.1.jar 2024-09-14T11:42:23.936 INFO:teuthology.orchestra.run.smithi138.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-persistent-cache-6.0.1.jar 2024-09-14T11:42:23.936 INFO:teuthology.orchestra.run.smithi138.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-worker-processes-6.0.1.jar 2024-09-14T11:42:23.936 INFO:teuthology.orchestra.run.smithi138.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-logging-6.0.1.jar 2024-09-14T11:42:23.936 INFO:teuthology.orchestra.run.smithi138.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-jvm-services-6.0.1.jar 2024-09-14T11:42:23.936 INFO:teuthology.orchestra.run.smithi138.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-process-services-6.0.1.jar 2024-09-14T11:42:23.937 INFO:teuthology.orchestra.run.smithi138.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-resources-6.0.1.jar 2024-09-14T11:42:23.937 INFO:teuthology.orchestra.run.smithi138.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-messaging-6.0.1.jar 2024-09-14T11:42:23.937 INFO:teuthology.orchestra.run.smithi138.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-native-6.0.1.jar 2024-09-14T11:42:23.937 INFO:teuthology.orchestra.run.smithi138.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-base-services-groovy-6.0.1.jar 2024-09-14T11:42:23.937 INFO:teuthology.orchestra.run.smithi138.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-base-services-6.0.1.jar 2024-09-14T11:42:23.937 INFO:teuthology.orchestra.run.smithi138.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-build-option-6.0.1.jar 2024-09-14T11:42:23.937 INFO:teuthology.orchestra.run.smithi138.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-cli-6.0.1.jar 2024-09-14T11:42:23.937 INFO:teuthology.orchestra.run.smithi138.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-snapshots-6.0.1.jar 2024-09-14T11:42:23.937 INFO:teuthology.orchestra.run.smithi138.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-files-6.0.1.jar 2024-09-14T11:42:23.937 INFO:teuthology.orchestra.run.smithi138.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-kotlin-dsl-tooling-models-6.0.1.jar 2024-09-14T11:42:23.937 INFO:teuthology.orchestra.run.smithi138.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/kotlin-compiler-embeddable-1.3.50-patched-for-gradle-6.0.1.jar 2024-09-14T11:42:23.937 INFO:teuthology.orchestra.run.smithi138.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-hashing-6.0.1.jar 2024-09-14T11:42:23.938 INFO:teuthology.orchestra.run.smithi138.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-pineapple-6.0.1.jar 2024-09-14T11:42:23.938 INFO:teuthology.orchestra.run.smithi138.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-docs-6.0.1.jar 2024-09-14T11:42:23.938 INFO:teuthology.orchestra.run.smithi138.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/groovy-all-1.3-2.5.8.jar 2024-09-14T11:42:23.938 INFO:teuthology.orchestra.run.smithi138.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/jul-to-slf4j-1.7.28.jar 2024-09-14T11:42:23.938 INFO:teuthology.orchestra.run.smithi138.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/log4j-over-slf4j-1.7.28.jar 2024-09-14T11:42:23.938 INFO:teuthology.orchestra.run.smithi138.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/jcl-over-slf4j-1.7.28.jar 2024-09-14T11:42:23.938 INFO:teuthology.orchestra.run.smithi138.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/slf4j-api-1.7.28.jar 2024-09-14T11:42:23.938 INFO:teuthology.orchestra.run.smithi138.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/guava-27.1-android.jar 2024-09-14T11:42:23.938 INFO:teuthology.orchestra.run.smithi138.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/commons-io-2.6.jar 2024-09-14T11:42:23.938 INFO:teuthology.orchestra.run.smithi138.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/commons-lang-2.6.jar 2024-09-14T11:42:23.938 INFO:teuthology.orchestra.run.smithi138.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/asm-commons-7.1.jar 2024-09-14T11:42:23.938 INFO:teuthology.orchestra.run.smithi138.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/asm-analysis-7.1.jar 2024-09-14T11:42:23.939 INFO:teuthology.orchestra.run.smithi138.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/asm-tree-7.1.jar 2024-09-14T11:42:23.939 INFO:teuthology.orchestra.run.smithi138.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/asm-7.1.jar 2024-09-14T11:42:23.939 INFO:teuthology.orchestra.run.smithi138.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/ant-1.10.7.jar 2024-09-14T11:42:23.939 INFO:teuthology.orchestra.run.smithi138.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/kotlin-stdlib-jdk8-1.3.50.jar 2024-09-14T11:42:23.939 INFO:teuthology.orchestra.run.smithi138.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/javax.inject-1.jar 2024-09-14T11:42:23.939 INFO:teuthology.orchestra.run.smithi138.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/kotlin-scripting-common-1.3.50.jar 2024-09-14T11:42:23.939 INFO:teuthology.orchestra.run.smithi138.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/kotlin-scripting-jvm-1.3.50.jar 2024-09-14T11:42:23.939 INFO:teuthology.orchestra.run.smithi138.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/kotlin-scripting-jvm-host-embeddable-1.3.50.jar 2024-09-14T11:42:23.939 INFO:teuthology.orchestra.run.smithi138.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/kotlin-scripting-compiler-embeddable-1.3.50.jar 2024-09-14T11:42:23.939 INFO:teuthology.orchestra.run.smithi138.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/kotlin-scripting-compiler-impl-embeddable-1.3.50.jar 2024-09-14T11:42:23.939 INFO:teuthology.orchestra.run.smithi138.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/kotlin-sam-with-receiver-compiler-plugin-1.3.50.jar 2024-09-14T11:42:23.939 INFO:teuthology.orchestra.run.smithi138.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/kotlinx-metadata-jvm-0.1.0.jar 2024-09-14T11:42:23.940 INFO:teuthology.orchestra.run.smithi138.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/commons-compress-1.19.jar 2024-09-14T11:42:23.940 INFO:teuthology.orchestra.run.smithi138.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/fastutil-8.3.0-min.jar 2024-09-14T11:42:23.940 INFO:teuthology.orchestra.run.smithi138.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/jansi-1.18.jar 2024-09-14T11:42:23.940 INFO:teuthology.orchestra.run.smithi138.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/jsr305-3.0.2.jar 2024-09-14T11:42:23.940 INFO:teuthology.orchestra.run.smithi138.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/kryo-2.24.0.jar 2024-09-14T11:42:23.940 INFO:teuthology.orchestra.run.smithi138.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/native-platform-0.18.jar 2024-09-14T11:42:23.940 INFO:teuthology.orchestra.run.smithi138.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/objenesis-2.6.jar 2024-09-14T11:42:23.940 INFO:teuthology.orchestra.run.smithi138.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/trove4j-1.0.20181211.jar 2024-09-14T11:42:23.940 INFO:teuthology.orchestra.run.smithi138.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/xml-apis-1.4.01.jar 2024-09-14T11:42:23.940 INFO:teuthology.orchestra.run.smithi138.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/kotlin-reflect-1.3.50.jar 2024-09-14T11:42:23.940 INFO:teuthology.orchestra.run.smithi138.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/kotlin-stdlib-jdk7-1.3.50.jar 2024-09-14T11:42:23.940 INFO:teuthology.orchestra.run.smithi138.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/kotlin-stdlib-1.3.50.jar 2024-09-14T11:42:23.940 INFO:teuthology.orchestra.run.smithi138.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/annotations-13.0.jar 2024-09-14T11:42:23.941 INFO:teuthology.orchestra.run.smithi138.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/ant-launcher-1.10.7.jar 2024-09-14T11:42:23.941 INFO:teuthology.orchestra.run.smithi138.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/minlog-1.2.jar 2024-09-14T11:42:23.941 INFO:teuthology.orchestra.run.smithi138.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/kotlin-script-runtime-1.3.50.jar 2024-09-14T11:42:23.941 INFO:teuthology.orchestra.run.smithi138.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/kotlin-daemon-embeddable-1.3.50.jar 2024-09-14T11:42:23.941 INFO:teuthology.orchestra.run.smithi138.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/failureaccess-1.0.1.jar 2024-09-14T11:42:23.941 INFO:teuthology.orchestra.run.smithi138.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/kotlin-stdlib-common-1.3.50.jar 2024-09-14T11:42:23.941 INFO:teuthology.orchestra.run.smithi138.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/native-platform-freebsd-amd64-libcpp-0.18.jar 2024-09-14T11:42:23.941 INFO:teuthology.orchestra.run.smithi138.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/native-platform-freebsd-amd64-libstdcpp-0.18.jar 2024-09-14T11:42:23.941 INFO:teuthology.orchestra.run.smithi138.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/native-platform-freebsd-i386-libcpp-0.18.jar 2024-09-14T11:42:23.941 INFO:teuthology.orchestra.run.smithi138.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/native-platform-freebsd-i386-libstdcpp-0.18.jar 2024-09-14T11:42:23.941 INFO:teuthology.orchestra.run.smithi138.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/native-platform-linux-aarch64-0.18.jar 2024-09-14T11:42:23.941 INFO:teuthology.orchestra.run.smithi138.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/native-platform-linux-amd64-0.18.jar 2024-09-14T11:42:23.942 INFO:teuthology.orchestra.run.smithi138.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/native-platform-linux-i386-0.18.jar 2024-09-14T11:42:23.942 INFO:teuthology.orchestra.run.smithi138.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/native-platform-osx-amd64-0.18.jar 2024-09-14T11:42:23.942 INFO:teuthology.orchestra.run.smithi138.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/native-platform-windows-amd64-0.18.jar 2024-09-14T11:42:23.942 INFO:teuthology.orchestra.run.smithi138.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/native-platform-windows-amd64-min-0.18.jar 2024-09-14T11:42:23.942 INFO:teuthology.orchestra.run.smithi138.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/native-platform-windows-i386-0.18.jar 2024-09-14T11:42:23.942 INFO:teuthology.orchestra.run.smithi138.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/native-platform-windows-i386-min-0.18.jar 2024-09-14T11:42:23.942 INFO:teuthology.orchestra.run.smithi138.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/native-platform-linux-aarch64-ncurses5-0.18.jar 2024-09-14T11:42:23.942 INFO:teuthology.orchestra.run.smithi138.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/native-platform-linux-amd64-ncurses5-0.18.jar 2024-09-14T11:42:23.942 INFO:teuthology.orchestra.run.smithi138.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/native-platform-linux-amd64-ncurses6-0.18.jar 2024-09-14T11:42:23.942 INFO:teuthology.orchestra.run.smithi138.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/native-platform-linux-i386-ncurses5-0.18.jar 2024-09-14T11:42:23.942 INFO:teuthology.orchestra.run.smithi138.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/native-platform-linux-i386-ncurses6-0.18.jar 2024-09-14T11:42:23.942 INFO:teuthology.orchestra.run.smithi138.stdout: creating: /opt/gradle/gradle-6.0.1/lib/plugins/ 2024-09-14T11:42:23.942 INFO:teuthology.orchestra.run.smithi138.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-antlr-6.0.1.jar 2024-09-14T11:42:23.943 INFO:teuthology.orchestra.run.smithi138.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-code-quality-6.0.1.jar 2024-09-14T11:42:23.943 INFO:teuthology.orchestra.run.smithi138.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-signing-6.0.1.jar 2024-09-14T11:42:23.943 INFO:teuthology.orchestra.run.smithi138.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-tooling-native-6.0.1.jar 2024-09-14T11:42:23.943 INFO:teuthology.orchestra.run.smithi138.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-ide-native-6.0.1.jar 2024-09-14T11:42:23.943 INFO:teuthology.orchestra.run.smithi138.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-testing-native-6.0.1.jar 2024-09-14T11:42:23.943 INFO:teuthology.orchestra.run.smithi138.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-language-native-6.0.1.jar 2024-09-14T11:42:23.943 INFO:teuthology.orchestra.run.smithi138.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-kotlin-dsl-provider-plugins-6.0.1.jar 2024-09-14T11:42:23.943 INFO:teuthology.orchestra.run.smithi138.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-plugin-development-6.0.1.jar 2024-09-14T11:42:23.943 INFO:teuthology.orchestra.run.smithi138.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-maven-6.0.1.jar 2024-09-14T11:42:23.943 INFO:teuthology.orchestra.run.smithi138.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-ide-play-6.0.1.jar 2024-09-14T11:42:23.943 INFO:teuthology.orchestra.run.smithi138.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-ide-6.0.1.jar 2024-09-14T11:42:23.943 INFO:teuthology.orchestra.run.smithi138.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-scala-6.0.1.jar 2024-09-14T11:42:23.943 INFO:teuthology.orchestra.run.smithi138.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-ear-6.0.1.jar 2024-09-14T11:42:23.944 INFO:teuthology.orchestra.run.smithi138.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-platform-play-6.0.1.jar 2024-09-14T11:42:23.944 INFO:teuthology.orchestra.run.smithi138.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-javascript-6.0.1.jar 2024-09-14T11:42:23.944 INFO:teuthology.orchestra.run.smithi138.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-ivy-6.0.1.jar 2024-09-14T11:42:23.944 INFO:teuthology.orchestra.run.smithi138.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-jacoco-6.0.1.jar 2024-09-14T11:42:23.944 INFO:teuthology.orchestra.run.smithi138.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-build-init-6.0.1.jar 2024-09-14T11:42:23.944 INFO:teuthology.orchestra.run.smithi138.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-kotlin-dsl-tooling-builders-6.0.1.jar 2024-09-14T11:42:23.944 INFO:teuthology.orchestra.run.smithi138.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-plugins-6.0.1.jar 2024-09-14T11:42:23.944 INFO:teuthology.orchestra.run.smithi138.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-test-kit-6.0.1.jar 2024-09-14T11:42:23.944 INFO:teuthology.orchestra.run.smithi138.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-language-groovy-6.0.1.jar 2024-09-14T11:42:23.944 INFO:teuthology.orchestra.run.smithi138.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-language-scala-6.0.1.jar 2024-09-14T11:42:23.944 INFO:teuthology.orchestra.run.smithi138.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-testing-junit-platform-6.0.1.jar 2024-09-14T11:42:23.944 INFO:teuthology.orchestra.run.smithi138.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-tooling-api-builders-6.0.1.jar 2024-09-14T11:42:23.944 INFO:teuthology.orchestra.run.smithi138.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-testing-jvm-6.0.1.jar 2024-09-14T11:42:23.945 INFO:teuthology.orchestra.run.smithi138.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-language-java-6.0.1.jar 2024-09-14T11:42:23.945 INFO:teuthology.orchestra.run.smithi138.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-language-jvm-6.0.1.jar 2024-09-14T11:42:23.945 INFO:teuthology.orchestra.run.smithi138.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-platform-jvm-6.0.1.jar 2024-09-14T11:42:23.945 INFO:teuthology.orchestra.run.smithi138.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-platform-native-6.0.1.jar 2024-09-14T11:42:23.945 INFO:teuthology.orchestra.run.smithi138.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-diagnostics-6.0.1.jar 2024-09-14T11:42:23.945 INFO:teuthology.orchestra.run.smithi138.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-publish-6.0.1.jar 2024-09-14T11:42:23.945 INFO:teuthology.orchestra.run.smithi138.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-testing-base-6.0.1.jar 2024-09-14T11:42:23.945 INFO:teuthology.orchestra.run.smithi138.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-platform-base-6.0.1.jar 2024-09-14T11:42:23.945 INFO:teuthology.orchestra.run.smithi138.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-plugin-use-6.0.1.jar 2024-09-14T11:42:23.945 INFO:teuthology.orchestra.run.smithi138.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-instant-execution-6.0.1.jar 2024-09-14T11:42:23.945 INFO:teuthology.orchestra.run.smithi138.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-version-control-6.0.1.jar 2024-09-14T11:42:23.945 INFO:teuthology.orchestra.run.smithi138.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-dependency-management-6.0.1.jar 2024-09-14T11:42:23.945 INFO:teuthology.orchestra.run.smithi138.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-composite-builds-6.0.1.jar 2024-09-14T11:42:23.946 INFO:teuthology.orchestra.run.smithi138.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-reporting-6.0.1.jar 2024-09-14T11:42:23.946 INFO:teuthology.orchestra.run.smithi138.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-resources-s3-6.0.1.jar 2024-09-14T11:42:23.946 INFO:teuthology.orchestra.run.smithi138.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-resources-gcs-6.0.1.jar 2024-09-14T11:42:23.946 INFO:teuthology.orchestra.run.smithi138.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-build-cache-http-6.0.1.jar 2024-09-14T11:42:23.946 INFO:teuthology.orchestra.run.smithi138.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-resources-http-6.0.1.jar 2024-09-14T11:42:23.946 INFO:teuthology.orchestra.run.smithi138.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-resources-sftp-6.0.1.jar 2024-09-14T11:42:23.946 INFO:teuthology.orchestra.run.smithi138.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-build-profile-6.0.1.jar 2024-09-14T11:42:23.946 INFO:teuthology.orchestra.run.smithi138.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-workers-6.0.1.jar 2024-09-14T11:42:23.946 INFO:teuthology.orchestra.run.smithi138.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/org.eclipse.jgit-5.5.0.201909110433-r.jar 2024-09-14T11:42:23.946 INFO:teuthology.orchestra.run.smithi138.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/wagon-http-3.0.0.jar 2024-09-14T11:42:23.946 INFO:teuthology.orchestra.run.smithi138.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/wagon-http-shared-3.0.0.jar 2024-09-14T11:42:23.946 INFO:teuthology.orchestra.run.smithi138.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/google-api-services-storage-v1-rev136-1.25.0.jar 2024-09-14T11:42:23.946 INFO:teuthology.orchestra.run.smithi138.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/google-api-client-1.25.0.jar 2024-09-14T11:42:23.947 INFO:teuthology.orchestra.run.smithi138.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/asm-util-7.1.jar 2024-09-14T11:42:23.947 INFO:teuthology.orchestra.run.smithi138.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/ivy-2.3.0.jar 2024-09-14T11:42:23.947 INFO:teuthology.orchestra.run.smithi138.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/maven-compat-3.0.4.jar 2024-09-14T11:42:23.947 INFO:teuthology.orchestra.run.smithi138.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/maven-core-3.0.4.jar 2024-09-14T11:42:23.947 INFO:teuthology.orchestra.run.smithi138.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/pmaven-common-0.8-20100325.jar 2024-09-14T11:42:23.947 INFO:teuthology.orchestra.run.smithi138.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/pmaven-groovy-0.8-20100325.jar 2024-09-14T11:42:23.947 INFO:teuthology.orchestra.run.smithi138.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/wagon-file-3.0.0.jar 2024-09-14T11:42:23.947 INFO:teuthology.orchestra.run.smithi138.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/plexus-container-default-1.7.1.jar 2024-09-14T11:42:23.947 INFO:teuthology.orchestra.run.smithi138.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/aether-connector-wagon-1.13.1.jar 2024-09-14T11:42:23.947 INFO:teuthology.orchestra.run.smithi138.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/bcpg-jdk15on-1.63.jar 2024-09-14T11:42:23.947 INFO:teuthology.orchestra.run.smithi138.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/rhino-1.7.10.jar 2024-09-14T11:42:23.948 INFO:teuthology.orchestra.run.smithi138.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gson-2.8.5.jar 2024-09-14T11:42:23.948 INFO:teuthology.orchestra.run.smithi138.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/simple-4.1.21.jar 2024-09-14T11:42:23.948 INFO:teuthology.orchestra.run.smithi138.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/jatl-0.2.3.jar 2024-09-14T11:42:23.948 INFO:teuthology.orchestra.run.smithi138.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/maven-plugin-api-3.0.4.jar 2024-09-14T11:42:23.948 INFO:teuthology.orchestra.run.smithi138.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/google-oauth-client-1.25.0.jar 2024-09-14T11:42:23.948 INFO:teuthology.orchestra.run.smithi138.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/google-http-client-jackson2-1.25.0.jar 2024-09-14T11:42:23.948 INFO:teuthology.orchestra.run.smithi138.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/google-http-client-1.25.0.jar 2024-09-14T11:42:23.948 INFO:teuthology.orchestra.run.smithi138.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/testng-6.3.1.jar 2024-09-14T11:42:23.948 INFO:teuthology.orchestra.run.smithi138.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/snakeyaml-1.17.jar 2024-09-14T11:42:23.948 INFO:teuthology.orchestra.run.smithi138.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/dd-plist-1.21.jar 2024-09-14T11:42:23.948 INFO:teuthology.orchestra.run.smithi138.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/junit-4.12.jar 2024-09-14T11:42:23.948 INFO:teuthology.orchestra.run.smithi138.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/bsh-2.0b6.jar 2024-09-14T11:42:23.949 INFO:teuthology.orchestra.run.smithi138.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/junit-platform-launcher-1.3.1.jar 2024-09-14T11:42:23.949 INFO:teuthology.orchestra.run.smithi138.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/aws-java-sdk-s3-1.11.633.jar 2024-09-14T11:42:23.949 INFO:teuthology.orchestra.run.smithi138.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/aws-java-sdk-kms-1.11.633.jar 2024-09-14T11:42:23.949 INFO:teuthology.orchestra.run.smithi138.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/aws-java-sdk-core-1.11.633.jar 2024-09-14T11:42:23.949 INFO:teuthology.orchestra.run.smithi138.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/httpclient-4.5.10.jar 2024-09-14T11:42:23.949 INFO:teuthology.orchestra.run.smithi138.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/jcifs-1.3.17.jar 2024-09-14T11:42:23.949 INFO:teuthology.orchestra.run.smithi138.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/nekohtml-1.9.22.jar 2024-09-14T11:42:23.949 INFO:teuthology.orchestra.run.smithi138.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/xercesImpl-2.12.0.jar 2024-09-14T11:42:23.949 INFO:teuthology.orchestra.run.smithi138.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/jsch-0.1.55.jar 2024-09-14T11:42:23.949 INFO:teuthology.orchestra.run.smithi138.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/jaxb-impl-2.3.2.jar 2024-09-14T11:42:23.949 INFO:teuthology.orchestra.run.smithi138.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/jmespath-java-1.11.633.jar 2024-09-14T11:42:23.949 INFO:teuthology.orchestra.run.smithi138.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/jackson-databind-2.9.10.jar 2024-09-14T11:42:23.949 INFO:teuthology.orchestra.run.smithi138.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/jackson-core-2.9.10.jar 2024-09-14T11:42:23.950 INFO:teuthology.orchestra.run.smithi138.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/jackson-annotations-2.9.10.jar 2024-09-14T11:42:23.950 INFO:teuthology.orchestra.run.smithi138.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/joda-time-2.10.4.jar 2024-09-14T11:42:23.950 INFO:teuthology.orchestra.run.smithi138.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/bcpkix-jdk15on-1.61.jar 2024-09-14T11:42:23.950 INFO:teuthology.orchestra.run.smithi138.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/bcprov-jdk15on-1.63.jar 2024-09-14T11:42:23.950 INFO:teuthology.orchestra.run.smithi138.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/commons-codec-1.13.jar 2024-09-14T11:42:23.950 INFO:teuthology.orchestra.run.smithi138.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/maven-aether-provider-3.0.4.jar 2024-09-14T11:42:23.950 INFO:teuthology.orchestra.run.smithi138.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/aether-impl-1.13.1.jar 2024-09-14T11:42:23.950 INFO:teuthology.orchestra.run.smithi138.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/aether-util-1.13.1.jar 2024-09-14T11:42:23.950 INFO:teuthology.orchestra.run.smithi138.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/aether-spi-1.13.1.jar 2024-09-14T11:42:23.950 INFO:teuthology.orchestra.run.smithi138.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/aether-api-1.13.1.jar 2024-09-14T11:42:23.950 INFO:teuthology.orchestra.run.smithi138.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/hamcrest-core-1.3.jar 2024-09-14T11:42:23.950 INFO:teuthology.orchestra.run.smithi138.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/httpcore-4.4.12.jar 2024-09-14T11:42:23.950 INFO:teuthology.orchestra.run.smithi138.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/jcommander-1.72.jar 2024-09-14T11:42:23.951 INFO:teuthology.orchestra.run.smithi138.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/jzlib-1.1.3.jar 2024-09-14T11:42:23.951 INFO:teuthology.orchestra.run.smithi138.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/maven-artifact-3.0.4.jar 2024-09-14T11:42:23.951 INFO:teuthology.orchestra.run.smithi138.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/maven-model-builder-3.0.4.jar 2024-09-14T11:42:23.951 INFO:teuthology.orchestra.run.smithi138.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/maven-model-3.0.4.jar 2024-09-14T11:42:23.951 INFO:teuthology.orchestra.run.smithi138.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/maven-repository-metadata-3.0.4.jar 2024-09-14T11:42:23.951 INFO:teuthology.orchestra.run.smithi138.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/maven-settings-builder-3.0.4.jar 2024-09-14T11:42:23.951 INFO:teuthology.orchestra.run.smithi138.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/maven-settings-3.0.4.jar 2024-09-14T11:42:23.951 INFO:teuthology.orchestra.run.smithi138.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/plexus-sec-dispatcher-1.3.jar 2024-09-14T11:42:23.951 INFO:teuthology.orchestra.run.smithi138.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/plexus-cipher-1.7.jar 2024-09-14T11:42:23.951 INFO:teuthology.orchestra.run.smithi138.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/plexus-classworlds-2.5.1.jar 2024-09-14T11:42:23.951 INFO:teuthology.orchestra.run.smithi138.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/plexus-component-annotations-1.5.5.jar 2024-09-14T11:42:23.951 INFO:teuthology.orchestra.run.smithi138.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/plexus-interpolation-1.14.jar 2024-09-14T11:42:23.952 INFO:teuthology.orchestra.run.smithi138.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/wagon-provider-api-3.0.0.jar 2024-09-14T11:42:23.952 INFO:teuthology.orchestra.run.smithi138.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/plexus-utils-3.1.0.jar 2024-09-14T11:42:23.952 INFO:teuthology.orchestra.run.smithi138.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/xbean-reflect-3.7.jar 2024-09-14T11:42:23.952 INFO:teuthology.orchestra.run.smithi138.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/ion-java-1.0.2.jar 2024-09-14T11:42:23.952 INFO:teuthology.orchestra.run.smithi138.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/junit-platform-engine-1.3.1.jar 2024-09-14T11:42:23.952 INFO:teuthology.orchestra.run.smithi138.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/junit-platform-commons-1.3.1.jar 2024-09-14T11:42:23.952 INFO:teuthology.orchestra.run.smithi138.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/apiguardian-api-1.0.0.jar 2024-09-14T11:42:23.952 INFO:teuthology.orchestra.run.smithi138.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/opentest4j-1.1.1.jar 2024-09-14T11:42:23.952 INFO:teuthology.orchestra.run.smithi138.stdout:export PATH=/opt/gradle/gradle-6.0.1/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/usr/games:/usr/local/games:/snap/bin 2024-09-14T11:42:24.267 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-09-14T11:42:24.267 INFO:teuthology.orchestra.run.smithi138.stdout:Welcome to Gradle 6.0.1! 2024-09-14T11:42:24.267 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-09-14T11:42:24.267 INFO:teuthology.orchestra.run.smithi138.stdout:Here are the highlights of this release: 2024-09-14T11:42:24.267 INFO:teuthology.orchestra.run.smithi138.stdout: - Substantial improvements in dependency management, including 2024-09-14T11:42:24.267 INFO:teuthology.orchestra.run.smithi138.stdout: - Publishing Gradle Module Metadata in addition to pom.xml 2024-09-14T11:42:24.267 INFO:teuthology.orchestra.run.smithi138.stdout: - Advanced control of transitive versions 2024-09-14T11:42:24.267 INFO:teuthology.orchestra.run.smithi138.stdout: - Support for optional features and dependencies 2024-09-14T11:42:24.267 INFO:teuthology.orchestra.run.smithi138.stdout: - Rules to tweak published metadata 2024-09-14T11:42:24.267 INFO:teuthology.orchestra.run.smithi138.stdout: - Support for Java 13 2024-09-14T11:42:24.268 INFO:teuthology.orchestra.run.smithi138.stdout: - Faster incremental Java and Groovy compilation 2024-09-14T11:42:24.268 INFO:teuthology.orchestra.run.smithi138.stdout: - New Zinc compiler for Scala 2024-09-14T11:42:24.268 INFO:teuthology.orchestra.run.smithi138.stdout: - VS2019 support 2024-09-14T11:42:24.268 INFO:teuthology.orchestra.run.smithi138.stdout: - Support for Gradle Enterprise plugin 3.0 2024-09-14T11:42:24.268 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-09-14T11:42:24.270 INFO:teuthology.orchestra.run.smithi138.stdout:For more details see https://docs.gradle.org/6.0.1/release-notes.html 2024-09-14T11:42:24.271 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-09-14T11:42:24.271 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-09-14T11:42:24.271 INFO:teuthology.orchestra.run.smithi138.stdout:------------------------------------------------------------ 2024-09-14T11:42:24.271 INFO:teuthology.orchestra.run.smithi138.stdout:Gradle 6.0.1 2024-09-14T11:42:24.271 INFO:teuthology.orchestra.run.smithi138.stdout:------------------------------------------------------------ 2024-09-14T11:42:24.271 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-09-14T11:42:24.271 INFO:teuthology.orchestra.run.smithi138.stdout:Build time: 2019-11-18 20:25:01 UTC 2024-09-14T11:42:24.271 INFO:teuthology.orchestra.run.smithi138.stdout:Revision: fad121066a68c4701acd362daf4287a7c309a0f5 2024-09-14T11:42:24.271 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-09-14T11:42:24.271 INFO:teuthology.orchestra.run.smithi138.stdout:Kotlin: 1.3.50 2024-09-14T11:42:24.272 INFO:teuthology.orchestra.run.smithi138.stdout:Groovy: 2.5.8 2024-09-14T11:42:24.272 INFO:teuthology.orchestra.run.smithi138.stdout:Ant: Apache Ant(TM) version 1.10.7 compiled on September 1 2019 2024-09-14T11:42:24.272 INFO:teuthology.orchestra.run.smithi138.stdout:JVM: 11.0.17 (Ubuntu 11.0.17+8-post-Ubuntu-1ubuntu222.04) 2024-09-14T11:42:24.272 INFO:teuthology.orchestra.run.smithi138.stdout:OS: Linux 5.15.0-121-generic amd64 2024-09-14T11:42:24.272 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-09-14T11:42:24.277 DEBUG:tasks.s3tests_java:S3 Tests Java: BEGIN 2024-09-14T11:42:24.277 DEBUG:tasks.s3tests_java:S3 Tests Java: Cluster config is: ['mon.a', 'mon.c', 'mgr.y', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'node-exporter.a'] 2024-09-14T11:42:24.277 DEBUG:tasks.s3tests_java:S3 Tests Java: Host is: ubuntu@smithi138.front.sepia.ceph.com 2024-09-14T11:42:24.277 DEBUG:tasks.s3tests_java:S3 Tests Java: Cluster config is: ['mon.b', 'mgr.x', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'prometheus.a', 'node-exporter.b'] 2024-09-14T11:42:24.277 DEBUG:tasks.s3tests_java:S3 Tests Java: Host is: ubuntu@smithi154.front.sepia.ceph.com 2024-09-14T11:42:24.277 INFO:tasks.s3tests_java:S3 Tests Java: Creating S3 users... 2024-09-14T11:42:24.504 DEBUG:tasks.s3tests_java:S3 Tests Java: s3tests_conf is {'bucket_prefix': 'test-', 's3main': {'access_key': None, 'access_secret': None, 'region': 'mexico', 'endpoint': None, 'port': None, 'display_name': None, 'email': None, 'is_secure': None, 'SSE': 'AES256', 's3dir': 'folder', 'dir': '../data'}} 2024-09-14T11:42:24.504 DEBUG:tasks.s3tests_java:S3 Tests Java: Creating user tester.client.0 2024-09-14T11:42:24.504 DEBUG:tasks.s3tests_java:S3 Tests Java: s3tests_conf[s3main] is {'access_key': 'QNBMTGTGQQXWKIHKUVYV', 'access_secret': 'OInl3Ozauhg3MLVox1bVFHJ7uTroQxlR738olA49BxoNnOWsKbd1Bg==', 'region': 'mexico', 'endpoint': 'smithi138.front.sepia.ceph.com:443', 'port': 443, 'display_name': 'Ms. tester.client.0', 'email': 'tester.client.0_test@test.test', 'is_secure': True, 'SSE': 'AES256', 's3dir': 'folder', 'dir': '../data', 'user_id': 'tester.client.0', 'host': 'smithi138.front.sepia.ceph.com'} 2024-09-14T11:42:24.504 DEBUG:tasks.s3tests_java:S3 Tests Java: Setion, User = s3main, tester.client.0 2024-09-14T11:42:24.504 INFO:tasks.s3tests_java:['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '-n', 'client.0', 'user', 'create', '--uid', 'tester.client.0', '--display-name', 'Ms. tester.client.0', '--access-key', 'QNBMTGTGQQXWKIHKUVYV', '--secret', 'OInl3Ozauhg3MLVox1bVFHJ7uTroQxlR738olA49BxoNnOWsKbd1Bg==', '--email', 'tester.client.0_test@test.test', '--cluster', 'ceph'] 2024-09-14T11:42:24.505 DEBUG:teuthology.orchestra.run.smithi138:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 user create --uid tester.client.0 --display-name 'Ms. tester.client.0' --access-key QNBMTGTGQQXWKIHKUVYV --secret OInl3Ozauhg3MLVox1bVFHJ7uTroQxlR738olA49BxoNnOWsKbd1Bg== --email tester.client.0_test@test.test --cluster ceph 2024-09-14T11:42:24.545 INFO:teuthology.orchestra.run.smithi138.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:42:24.545 INFO:teuthology.orchestra.run.smithi138.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:42:24.587 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:42:24.585+0000 7f4439a529c0 20 rados->read ofs=0 len=0 2024-09-14T11:42:24.589 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:42:24.589+0000 7f4439a529c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:42:24.589 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:42:24.589+0000 7f4439a529c0 20 realm 2024-09-14T11:42:24.589 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:42:24.589+0000 7f4439a529c0 20 rados->read ofs=0 len=0 2024-09-14T11:42:24.589 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:42:24.589+0000 7f4439a529c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:42:24.589 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:42:24.589+0000 7f4439a529c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:42:24.589 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:42:24.589+0000 7f4439a529c0 20 rados->read ofs=0 len=0 2024-09-14T11:42:24.589 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:42:24.589+0000 7f4439a529c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:42:24.589 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:42:24.589+0000 7f4439a529c0 20 rados->read ofs=0 len=0 2024-09-14T11:42:24.591 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:42:24.589+0000 7f4439a529c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:42:24.591 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:42:24.589+0000 7f4439a529c0 20 rados->read ofs=0 len=0 2024-09-14T11:42:24.591 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:42:24.589+0000 7f4439a529c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:42:24.592 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:42:24.589+0000 7f4439a529c0 20 searching for the correct realm 2024-09-14T11:42:24.595 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:42:24.593+0000 7f4437d59640 0 -- 172.21.15.138:0/3844515052 >> [v2:172.21.15.154:6824/416768175,v1:172.21.15.154:6825/416768175] conn(0x7f443002c030 msgr2=0x7f4430063040 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:42:24.809 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:42:24.809+0000 7f4436d57640 0 -- 172.21.15.138:0/3844515052 >> [v2:172.21.15.138:6816/326481658,v1:172.21.15.138:6817/326481658] conn(0x7f443006b070 msgr2=0x7f4430064d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-14T11:42:25.028 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:42:25.029+0000 7f4439a529c0 20 RGWRados::pool_iterate: got zone_info.d9e72d30-c60b-4d0d-9267-fdc36392d5ad 2024-09-14T11:42:25.029 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:42:25.029+0000 7f4439a529c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:42:25.029 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:42:25.029+0000 7f4439a529c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:42:25.029 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:42:25.029+0000 7f4439a529c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:42:25.029 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:42:25.029+0000 7f4439a529c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:42:25.029 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:42:25.029+0000 7f4439a529c0 20 RGWRados::pool_iterate: got zonegroup_info.65ab941b-da8c-4160-94fb-3672b069d44f 2024-09-14T11:42:25.029 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:42:25.029+0000 7f4439a529c0 20 rados->read ofs=0 len=0 2024-09-14T11:42:25.029 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:42:25.029+0000 7f4439a529c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:42:25.029 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:42:25.029+0000 7f4439a529c0 20 rados->read ofs=0 len=0 2024-09-14T11:42:25.030 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:42:25.029+0000 7f4439a529c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:42:25.030 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:42:25.029+0000 7f4439a529c0 20 rados->read ofs=0 len=0 2024-09-14T11:42:25.031 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:42:25.029+0000 7f4439a529c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:42:25.031 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:42:25.029+0000 7f4439a529c0 20 zone default found 2024-09-14T11:42:25.031 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:42:25.029+0000 7f4439a529c0 4 Realm: () 2024-09-14T11:42:25.031 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:42:25.029+0000 7f4439a529c0 4 ZoneGroup: default (65ab941b-da8c-4160-94fb-3672b069d44f) 2024-09-14T11:42:25.031 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:42:25.029+0000 7f4439a529c0 4 Zone: default (d9e72d30-c60b-4d0d-9267-fdc36392d5ad) 2024-09-14T11:42:25.031 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:42:25.029+0000 7f4439a529c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:42:25.031 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:42:25.029+0000 7f4439a529c0 20 zonegroup default 2024-09-14T11:42:25.031 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:42:25.029+0000 7f4439a529c0 20 rados->read ofs=0 len=0 2024-09-14T11:42:25.032 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:42:25.029+0000 7f4439a529c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:42:25.032 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:42:25.029+0000 7f4439a529c0 20 rados->read ofs=0 len=0 2024-09-14T11:42:25.032 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:42:25.033+0000 7f4439a529c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:42:25.032 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:42:25.033+0000 7f4439a529c0 20 rados->read ofs=0 len=0 2024-09-14T11:42:25.033 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:42:25.033+0000 7f4439a529c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:42:25.033 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:42:25.033+0000 7f4439a529c0 20 started sync module instance, tier type = 2024-09-14T11:42:25.033 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:42:25.033+0000 7f4439a529c0 20 started zone id=d9e72d30-c60b-4d0d-9267-fdc36392d5ad (name=default) with tier type = 2024-09-14T11:42:25.056 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:42:25.057+0000 7f4439a529c0 20 add_watcher() i=0 2024-09-14T11:42:25.056 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:42:25.057+0000 7f4439a529c0 20 add_watcher() i=1 2024-09-14T11:42:25.056 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:42:25.057+0000 7f4439a529c0 20 add_watcher() i=2 2024-09-14T11:42:25.057 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:42:25.057+0000 7f4439a529c0 20 add_watcher() i=3 2024-09-14T11:42:25.057 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:42:25.057+0000 7f4439a529c0 20 add_watcher() i=4 2024-09-14T11:42:25.057 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:42:25.057+0000 7f4439a529c0 20 add_watcher() i=5 2024-09-14T11:42:25.057 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:42:25.057+0000 7f4439a529c0 20 add_watcher() i=6 2024-09-14T11:42:25.058 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:42:25.057+0000 7f4439a529c0 20 add_watcher() i=7 2024-09-14T11:42:25.058 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:42:25.057+0000 7f4439a529c0 2 all 8 watchers are set, enabling cache 2024-09-14T11:42:25.063 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:42:25.061+0000 7f42edfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:42:25.063 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:42:25.061+0000 7f4439a529c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:42:25.064 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:42:25.061+0000 7f4439a529c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:42:25.064 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:42:25.061+0000 7f4439a529c0 5 note: GC not initialized 2024-09-14T11:42:25.065 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:42:25.065+0000 7f42ecfe1640 20 reqs_thread_entry: start 2024-09-14T11:42:25.065 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:42:25.065+0000 7f4439a529c0 20 init_complete bucket index max shards: 11 2024-09-14T11:42:25.065 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:42:25.065+0000 7f4439a529c0 20 Filter name: none 2024-09-14T11:42:25.065 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:42:25.065+0000 7f42667fc640 20 reqs_thread_entry: start 2024-09-14T11:42:25.065 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:42:25.065+0000 7f4439a529c0 10 cache get: name=default.rgw.meta+users.uid+tester.client.0 : miss 2024-09-14T11:42:25.065 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:42:25.065+0000 7f4439a529c0 20 rados->read ofs=0 len=0 2024-09-14T11:42:25.065 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:42:25.065+0000 7f4439a529c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:42:25.066 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:42:25.065+0000 7f4439a529c0 10 cache put: name=default.rgw.meta+users.uid+tester.client.0 info.flags=0x0 2024-09-14T11:42:25.066 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:42:25.065+0000 7f4439a529c0 10 adding default.rgw.meta+users.uid+tester.client.0 to cache LRU end 2024-09-14T11:42:25.066 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:42:25.065+0000 7f4439a529c0 10 cache get: name=default.rgw.meta+users.email+tester.client.0_test@test.test : miss 2024-09-14T11:42:25.066 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:42:25.065+0000 7f4439a529c0 20 rados->read ofs=0 len=0 2024-09-14T11:42:25.066 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:42:25.065+0000 7f4439a529c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:42:25.066 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:42:25.065+0000 7f4439a529c0 10 cache put: name=default.rgw.meta+users.email+tester.client.0_test@test.test info.flags=0x0 2024-09-14T11:42:25.067 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:42:25.065+0000 7f4439a529c0 10 adding default.rgw.meta+users.email+tester.client.0_test@test.test to cache LRU end 2024-09-14T11:42:25.067 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:42:25.065+0000 7f4439a529c0 10 cache get: name=default.rgw.meta+users.keys+QNBMTGTGQQXWKIHKUVYV : miss 2024-09-14T11:42:25.067 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:42:25.065+0000 7f4439a529c0 20 rados->read ofs=0 len=0 2024-09-14T11:42:25.067 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:42:25.065+0000 7f4439a529c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:42:25.067 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:42:25.065+0000 7f4439a529c0 10 cache put: name=default.rgw.meta+users.keys+QNBMTGTGQQXWKIHKUVYV info.flags=0x0 2024-09-14T11:42:25.068 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:42:25.065+0000 7f4439a529c0 10 adding default.rgw.meta+users.keys+QNBMTGTGQQXWKIHKUVYV to cache LRU end 2024-09-14T11:42:25.068 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:42:25.065+0000 7f4439a529c0 10 cache get: name=default.rgw.meta+users.keys+QNBMTGTGQQXWKIHKUVYV : hit (negative entry) 2024-09-14T11:42:25.068 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:42:25.065+0000 7f4439a529c0 10 cache get: name=default.rgw.meta+users.keys+QNBMTGTGQQXWKIHKUVYV : hit (negative entry) 2024-09-14T11:42:25.070 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:42:25.069+0000 7f4439a529c0 10 cache put: name=default.rgw.meta+users.uid+tester.client.0 info.flags=0x17 2024-09-14T11:42:25.071 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:42:25.069+0000 7f4439a529c0 10 moving default.rgw.meta+users.uid+tester.client.0 to cache LRU end 2024-09-14T11:42:25.071 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:42:25.069+0000 7f4439a529c0 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:users.uid:tester.client.0, ofs0, ns] 2024-09-14T11:42:25.071 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:42:25.069+0000 7f431affd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366211 cookie 94888819839072 notifier 8685 bl.length()=670 2024-09-14T11:42:25.071 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:42:25.069+0000 7f431affd640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+tester.client.0 info.flags=0x17 2024-09-14T11:42:25.071 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:42:25.069+0000 7f431affd640 10 rgw watcher librados: moving default.rgw.meta+users.uid+tester.client.0 to cache LRU end 2024-09-14T11:42:25.075 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:42:25.073+0000 7f4439a529c0 10 cache put: name=default.rgw.meta+users.email+tester.client.0_test@test.test info.flags=0x7 2024-09-14T11:42:25.075 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:42:25.073+0000 7f4439a529c0 10 moving default.rgw.meta+users.email+tester.client.0_test@test.test to cache LRU end 2024-09-14T11:42:25.075 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:42:25.073+0000 7f4439a529c0 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 0, obj: default.rgw.meta:users.email:tester.client.0_test@test.test, ofs0, ns] 2024-09-14T11:42:25.076 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:42:25.077+0000 7f431a7fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366181 cookie 94888819835648 notifier 8685 bl.length()=200 2024-09-14T11:42:25.076 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:42:25.077+0000 7f431a7fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.email+tester.client.0_test@test.test info.flags=0x7 2024-09-14T11:42:25.076 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:42:25.077+0000 7f431a7fc640 10 rgw watcher librados: moving default.rgw.meta+users.email+tester.client.0_test@test.test to cache LRU end 2024-09-14T11:42:25.082 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:42:25.081+0000 7f4439a529c0 10 cache put: name=default.rgw.meta+users.keys+QNBMTGTGQQXWKIHKUVYV info.flags=0x7 2024-09-14T11:42:25.082 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:42:25.081+0000 7f4439a529c0 10 moving default.rgw.meta+users.keys+QNBMTGTGQQXWKIHKUVYV to cache LRU end 2024-09-14T11:42:25.082 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:42:25.081+0000 7f4439a529c0 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 0, obj: default.rgw.meta:users.keys:QNBMTGTGQQXWKIHKUVYV, ofs0, ns] 2024-09-14T11:42:25.082 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:42:25.081+0000 7f431affd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366250 cookie 94888819826528 notifier 8685 bl.length()=189 2024-09-14T11:42:25.082 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:42:25.081+0000 7f431affd640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.keys+QNBMTGTGQQXWKIHKUVYV info.flags=0x7 2024-09-14T11:42:25.082 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:42:25.081+0000 7f431affd640 10 rgw watcher librados: moving default.rgw.meta+users.keys+QNBMTGTGQQXWKIHKUVYV to cache LRU end 2024-09-14T11:42:25.084 INFO:teuthology.orchestra.run.smithi138.stdout:{ 2024-09-14T11:42:25.085 INFO:teuthology.orchestra.run.smithi138.stdout: "user_id": "tester.client.0", 2024-09-14T11:42:25.085 INFO:teuthology.orchestra.run.smithi138.stdout: "display_name": "Ms. tester.client.0", 2024-09-14T11:42:25.085 INFO:teuthology.orchestra.run.smithi138.stdout: "email": "tester.client.0_test@test.test", 2024-09-14T11:42:25.085 INFO:teuthology.orchestra.run.smithi138.stdout: "suspended": 0, 2024-09-14T11:42:25.085 INFO:teuthology.orchestra.run.smithi138.stdout: "max_buckets": 1000, 2024-09-14T11:42:25.085 INFO:teuthology.orchestra.run.smithi138.stdout: "subusers": [], 2024-09-14T11:42:25.085 INFO:teuthology.orchestra.run.smithi138.stdout: "keys": [ 2024-09-14T11:42:25.085 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-09-14T11:42:25.085 INFO:teuthology.orchestra.run.smithi138.stdout: "user": "tester.client.0", 2024-09-14T11:42:25.085 INFO:teuthology.orchestra.run.smithi138.stdout: "access_key": "QNBMTGTGQQXWKIHKUVYV", 2024-09-14T11:42:25.085 INFO:teuthology.orchestra.run.smithi138.stdout: "secret_key": "OInl3Ozauhg3MLVox1bVFHJ7uTroQxlR738olA49BxoNnOWsKbd1Bg==", 2024-09-14T11:42:25.085 INFO:teuthology.orchestra.run.smithi138.stdout: "active": true, 2024-09-14T11:42:25.085 INFO:teuthology.orchestra.run.smithi138.stdout: "create_date": "2024-09-14T11:42:25.072262Z" 2024-09-14T11:42:25.086 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-09-14T11:42:25.086 INFO:teuthology.orchestra.run.smithi138.stdout: ], 2024-09-14T11:42:25.086 INFO:teuthology.orchestra.run.smithi138.stdout: "swift_keys": [], 2024-09-14T11:42:25.086 INFO:teuthology.orchestra.run.smithi138.stdout: "caps": [], 2024-09-14T11:42:25.086 INFO:teuthology.orchestra.run.smithi138.stdout: "op_mask": "read, write, delete", 2024-09-14T11:42:25.086 INFO:teuthology.orchestra.run.smithi138.stdout: "default_placement": "", 2024-09-14T11:42:25.086 INFO:teuthology.orchestra.run.smithi138.stdout: "default_storage_class": "", 2024-09-14T11:42:25.086 INFO:teuthology.orchestra.run.smithi138.stdout: "placement_tags": [], 2024-09-14T11:42:25.086 INFO:teuthology.orchestra.run.smithi138.stdout: "bucket_quota": { 2024-09-14T11:42:25.086 INFO:teuthology.orchestra.run.smithi138.stdout: "enabled": false, 2024-09-14T11:42:25.086 INFO:teuthology.orchestra.run.smithi138.stdout: "check_on_raw": false, 2024-09-14T11:42:25.086 INFO:teuthology.orchestra.run.smithi138.stdout: "max_size": -1, 2024-09-14T11:42:25.086 INFO:teuthology.orchestra.run.smithi138.stdout: "max_size_kb": 0, 2024-09-14T11:42:25.086 INFO:teuthology.orchestra.run.smithi138.stdout: "max_objects": -1 2024-09-14T11:42:25.087 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-09-14T11:42:25.087 INFO:teuthology.orchestra.run.smithi138.stdout: "user_quota": { 2024-09-14T11:42:25.087 INFO:teuthology.orchestra.run.smithi138.stdout: "enabled": false, 2024-09-14T11:42:25.087 INFO:teuthology.orchestra.run.smithi138.stdout: "check_on_raw": false, 2024-09-14T11:42:25.087 INFO:teuthology.orchestra.run.smithi138.stdout: "max_size": -1, 2024-09-14T11:42:25.087 INFO:teuthology.orchestra.run.smithi138.stdout: "max_size_kb": 0, 2024-09-14T11:42:25.087 INFO:teuthology.orchestra.run.smithi138.stdout: "max_objects": -1 2024-09-14T11:42:25.087 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-09-14T11:42:25.087 INFO:teuthology.orchestra.run.smithi138.stdout: "temp_url_keys": [], 2024-09-14T11:42:25.087 INFO:teuthology.orchestra.run.smithi138.stdout: "type": "rgw", 2024-09-14T11:42:25.087 INFO:teuthology.orchestra.run.smithi138.stdout: "mfa_ids": [], 2024-09-14T11:42:25.087 INFO:teuthology.orchestra.run.smithi138.stdout: "account_id": "", 2024-09-14T11:42:25.087 INFO:teuthology.orchestra.run.smithi138.stdout: "path": "/", 2024-09-14T11:42:25.087 INFO:teuthology.orchestra.run.smithi138.stdout: "create_date": "2024-09-14T11:42:25.072224Z", 2024-09-14T11:42:25.088 INFO:teuthology.orchestra.run.smithi138.stdout: "tags": [], 2024-09-14T11:42:25.088 INFO:teuthology.orchestra.run.smithi138.stdout: "group_ids": [] 2024-09-14T11:42:25.088 INFO:teuthology.orchestra.run.smithi138.stdout:} 2024-09-14T11:42:25.088 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-09-14T11:42:25.088 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:42:25.085+0000 7f42edfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:42:25.091 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:42:25.089+0000 7f4439a529c0 20 remove_watcher() i=0 2024-09-14T11:42:25.091 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:42:25.089+0000 7f4439a529c0 2 removed watcher, disabling cache 2024-09-14T11:42:25.094 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:42:25.093+0000 7f4439a529c0 20 remove_watcher() i=1 2024-09-14T11:42:25.096 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:42:25.097+0000 7f4439a529c0 20 remove_watcher() i=2 2024-09-14T11:42:25.099 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:42:25.097+0000 7f4439a529c0 20 remove_watcher() i=3 2024-09-14T11:42:25.101 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:42:25.101+0000 7f4439a529c0 20 remove_watcher() i=4 2024-09-14T11:42:25.103 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:42:25.101+0000 7f4439a529c0 20 remove_watcher() i=5 2024-09-14T11:42:25.107 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:42:25.105+0000 7f4439a529c0 20 remove_watcher() i=6 2024-09-14T11:42:25.109 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:42:25.109+0000 7f4439a529c0 20 remove_watcher() i=7 2024-09-14T11:42:25.126 DEBUG:teuthology.orchestra.run.smithi138:> set -ex 2024-09-14T11:42:25.126 DEBUG:teuthology.orchestra.run.smithi138:> dd of=/home/ubuntu/cephtest/archive/s3-tests-java.client.0.conf 2024-09-14T11:42:25.175 INFO:tasks.s3tests_java:S3 Tests Java: Running tests... 2024-09-14T11:42:25.175 DEBUG:teuthology.orchestra.run.smithi138:> cp /home/ubuntu/cephtest/archive/s3-tests-java.client.0.conf /home/ubuntu/cephtest/s3-tests-java/config.properties 2024-09-14T11:42:25.221 DEBUG:teuthology.orchestra.run.smithi138:> radosgw-admin gc process --include-all 2024-09-14T11:42:25.294 INFO:teuthology.orchestra.run.smithi138.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:42:25.294 INFO:teuthology.orchestra.run.smithi138.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:42:25.341 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:42:25.341+0000 7f8f430319c0 20 rados->read ofs=0 len=0 2024-09-14T11:42:25.342 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:42:25.341+0000 7f8f430319c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:42:25.342 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:42:25.341+0000 7f8f430319c0 20 realm 2024-09-14T11:42:25.342 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:42:25.341+0000 7f8f430319c0 20 rados->read ofs=0 len=0 2024-09-14T11:42:25.342 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:42:25.341+0000 7f8f430319c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:42:25.342 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:42:25.341+0000 7f8f430319c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:42:25.343 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:42:25.341+0000 7f8f430319c0 20 rados->read ofs=0 len=0 2024-09-14T11:42:25.343 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:42:25.341+0000 7f8f430319c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:42:25.343 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:42:25.341+0000 7f8f430319c0 20 rados->read ofs=0 len=0 2024-09-14T11:42:25.344 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:42:25.345+0000 7f8f430319c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:42:25.344 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:42:25.345+0000 7f8f430319c0 20 rados->read ofs=0 len=0 2024-09-14T11:42:25.345 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:42:25.345+0000 7f8f430319c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:42:25.345 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:42:25.345+0000 7f8f430319c0 20 searching for the correct realm 2024-09-14T11:42:25.348 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:42:25.349+0000 7f8f41338640 0 -- 172.21.15.138:0/1972168659 >> [v2:172.21.15.154:6824/416768175,v1:172.21.15.154:6825/416768175] conn(0x7f8f30077030 msgr2=0x7f8f30063ed0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-14T11:42:25.565 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:42:25.565+0000 7f8f40336640 0 -- 172.21.15.138:0/1972168659 >> [v2:172.21.15.138:6816/326481658,v1:172.21.15.138:6817/326481658] conn(0x7f8f30017070 msgr2=0x7f8f3008b9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-14T11:42:25.783 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:42:25.781+0000 7f8f430319c0 20 RGWRados::pool_iterate: got zone_info.d9e72d30-c60b-4d0d-9267-fdc36392d5ad 2024-09-14T11:42:25.783 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:42:25.781+0000 7f8f430319c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:42:25.783 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:42:25.781+0000 7f8f430319c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:42:25.783 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:42:25.781+0000 7f8f430319c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:42:25.783 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:42:25.781+0000 7f8f430319c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:42:25.784 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:42:25.781+0000 7f8f430319c0 20 RGWRados::pool_iterate: got zonegroup_info.65ab941b-da8c-4160-94fb-3672b069d44f 2024-09-14T11:42:25.784 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:42:25.781+0000 7f8f430319c0 20 rados->read ofs=0 len=0 2024-09-14T11:42:25.784 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:42:25.781+0000 7f8f430319c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:42:25.784 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:42:25.781+0000 7f8f430319c0 20 rados->read ofs=0 len=0 2024-09-14T11:42:25.784 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:42:25.785+0000 7f8f430319c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:42:25.784 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:42:25.785+0000 7f8f430319c0 20 rados->read ofs=0 len=0 2024-09-14T11:42:25.785 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:42:25.785+0000 7f8f430319c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:42:25.785 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:42:25.785+0000 7f8f430319c0 20 zone default found 2024-09-14T11:42:25.786 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:42:25.785+0000 7f8f430319c0 4 Realm: () 2024-09-14T11:42:25.786 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:42:25.785+0000 7f8f430319c0 4 ZoneGroup: default (65ab941b-da8c-4160-94fb-3672b069d44f) 2024-09-14T11:42:25.786 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:42:25.785+0000 7f8f430319c0 4 Zone: default (d9e72d30-c60b-4d0d-9267-fdc36392d5ad) 2024-09-14T11:42:25.786 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:42:25.785+0000 7f8f430319c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:42:25.786 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:42:25.785+0000 7f8f430319c0 20 zonegroup default 2024-09-14T11:42:25.786 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:42:25.785+0000 7f8f430319c0 20 rados->read ofs=0 len=0 2024-09-14T11:42:25.786 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:42:25.785+0000 7f8f430319c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:42:25.786 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:42:25.785+0000 7f8f430319c0 20 rados->read ofs=0 len=0 2024-09-14T11:42:25.787 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:42:25.785+0000 7f8f430319c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:42:25.787 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:42:25.785+0000 7f8f430319c0 20 rados->read ofs=0 len=0 2024-09-14T11:42:25.787 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:42:25.785+0000 7f8f430319c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:42:25.787 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:42:25.785+0000 7f8f430319c0 20 started sync module instance, tier type = 2024-09-14T11:42:25.787 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:42:25.785+0000 7f8f430319c0 20 started zone id=d9e72d30-c60b-4d0d-9267-fdc36392d5ad (name=default) with tier type = 2024-09-14T11:42:25.811 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:42:25.809+0000 7f8f430319c0 20 add_watcher() i=0 2024-09-14T11:42:25.811 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:42:25.809+0000 7f8f430319c0 20 add_watcher() i=1 2024-09-14T11:42:25.812 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:42:25.809+0000 7f8f430319c0 20 add_watcher() i=2 2024-09-14T11:42:25.812 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:42:25.809+0000 7f8f430319c0 20 add_watcher() i=3 2024-09-14T11:42:25.812 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:42:25.809+0000 7f8f430319c0 20 add_watcher() i=4 2024-09-14T11:42:25.812 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:42:25.809+0000 7f8f430319c0 20 add_watcher() i=5 2024-09-14T11:42:25.812 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:42:25.809+0000 7f8f430319c0 20 add_watcher() i=6 2024-09-14T11:42:25.814 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:42:25.813+0000 7f8f430319c0 20 add_watcher() i=7 2024-09-14T11:42:25.814 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:42:25.813+0000 7f8f430319c0 2 all 8 watchers are set, enabling cache 2024-09-14T11:42:25.817 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:42:25.817+0000 7f8df77e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:42:25.818 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:42:25.817+0000 7f8f430319c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:42:25.818 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:42:25.817+0000 7f8f430319c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:42:25.908 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:42:25.905+0000 7f8df67e4640 20 reqs_thread_entry: start 2024-09-14T11:42:25.908 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:42:25.909+0000 7f8f430319c0 20 init_complete bucket index max shards: 11 2024-09-14T11:42:25.908 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:42:25.909+0000 7f8f430319c0 20 Filter name: none 2024-09-14T11:42:25.909 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:42:25.909+0000 7f8deffff640 20 reqs_thread_entry: start 2024-09-14T11:42:25.909 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:42:25.909+0000 7f8f430319c0 20 garbage collection: RGWGC::process entered with GC index_shard=12, max_secs=3600, expired_only=0 2024-09-14T11:42:25.913 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:42:25.913+0000 7f8f430319c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:42:25.914 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:42:25.913+0000 7f8f430319c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:42:25.915 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:42:25.913+0000 7f8f430319c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2024-09-14T11:42:25.915 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:42:25.913+0000 7f8f430319c0 20 garbage collection: RGWGC::process iterating over entry tag='_HfaNZJ74hLvyvytb4PiNa4Z5z9eegon', time=2024-09-14T13:32:05.735956+0000, chain.objs.size()=1 2024-09-14T11:42:25.915 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:42:25.913+0000 7f8f430319c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.16__shadow_.wvZTqCcbOhnlIHlWQVeUFe_NM92uHcY_0 2024-09-14T11:42:25.917 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:42:25.917+0000 7f8f430319c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T11:42:25.924 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:42:25.921+0000 7f8f430319c0 20 garbage collection: RGWGC::process entered with GC index_shard=13, max_secs=3600, expired_only=0 2024-09-14T11:42:25.926 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:42:25.925+0000 7f8f430319c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:42:25.926 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:42:25.925+0000 7f8f430319c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:42:25.927 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:42:25.925+0000 7f8f430319c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2024-09-14T11:42:25.927 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:42:25.925+0000 7f8f430319c0 20 garbage collection: RGWGC::process iterating over entry tag='_0dIBN0DJ8oV1Fl36FTpYRxqFDCuhAp9', time=2024-09-14T13:32:05.502574+0000, chain.objs.size()=1 2024-09-14T11:42:25.927 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:42:25.925+0000 7f8f430319c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.15__shadow_.8Sp_E5_mWwDyvaOHZQbi4GlGoQ6brPL_1 2024-09-14T11:42:25.930 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:42:25.929+0000 7f8f430319c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T11:42:25.934 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:42:25.933+0000 7f8f430319c0 20 garbage collection: RGWGC::process entered with GC index_shard=14, max_secs=3600, expired_only=0 2024-09-14T11:42:25.936 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:42:25.937+0000 7f8f430319c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:42:25.937 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:42:25.937+0000 7f8f430319c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:42:25.937 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:42:25.937+0000 7f8f430319c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:42:25.939 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:42:25.937+0000 7f8f430319c0 20 garbage collection: RGWGC::process entered with GC index_shard=15, max_secs=3600, expired_only=0 2024-09-14T11:42:25.942 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:42:25.941+0000 7f8f430319c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:42:25.944 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:42:25.945+0000 7f8f430319c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:42:25.945 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:42:25.945+0000 7f8f430319c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2024-09-14T11:42:25.945 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:42:25.945+0000 7f8f430319c0 20 garbage collection: RGWGC::process iterating over entry tag='d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.5211587471816669591', time=2024-09-14T13:32:05.702076+0000, chain.objs.size()=5 2024-09-14T11:42:25.945 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:42:25.945+0000 7f8f430319c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.16__multipart_foo-LUKEWARM.2~LvMwfRJXLK90wupfJ7HhQNqA4LPctM_.1 2024-09-14T11:42:25.945 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:42:25.945+0000 7f8f430319c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.16__shadow_foo-LUKEWARM.2~LvMwfRJXLK90wupfJ7HhQNqA4LPctM_.1_1 2024-09-14T11:42:25.945 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:42:25.945+0000 7f8f430319c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.16__multipart_foo-LUKEWARM.2~LvMwfRJXLK90wupfJ7HhQNqA4LPctM_.2 2024-09-14T11:42:25.945 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:42:25.945+0000 7f8f430319c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.16__shadow_foo-LUKEWARM.2~LvMwfRJXLK90wupfJ7HhQNqA4LPctM_.2_1 2024-09-14T11:42:25.946 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:42:25.945+0000 7f8f430319c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.16__multipart_foo-LUKEWARM.2~LvMwfRJXLK90wupfJ7HhQNqA4LPctM_.3 2024-09-14T11:42:25.948 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:42:25.949+0000 7f8f430319c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T11:42:25.952 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:42:25.953+0000 7f8f430319c0 20 garbage collection: RGWGC::process entered with GC index_shard=16, max_secs=3600, expired_only=0 2024-09-14T11:42:25.956 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:42:25.957+0000 7f8f430319c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:42:25.958 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:42:25.957+0000 7f8f430319c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:42:25.959 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:42:25.957+0000 7f8f430319c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=2, truncated=0, next_marker='' 2024-09-14T11:42:25.959 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:42:25.957+0000 7f8f430319c0 20 garbage collection: RGWGC::process iterating over entry tag='_Z15nhGlba6BoBntEjvtlAfnSMoTyNRh', time=2024-09-14T13:32:05.632682+0000, chain.objs.size()=2 2024-09-14T11:42:25.959 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:42:25.957+0000 7f8f430319c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.16__shadow_.9LXGF8eFC4rBgtAVqAyiH_tpMZBbhmA_1 2024-09-14T11:42:25.959 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:42:25.957+0000 7f8f430319c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.16__shadow_.9LXGF8eFC4rBgtAVqAyiH_tpMZBbhmA_2 2024-09-14T11:42:25.959 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:42:25.957+0000 7f8f430319c0 20 garbage collection: RGWGC::process iterating over entry tag='d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.12174749783492909916', time=2024-09-14T13:32:05.913347+0000, chain.objs.size()=3 2024-09-14T11:42:25.959 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:42:25.957+0000 7f8f430319c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.13__shadow_.IX-ntoTwzLNCH3WGpGAr4_hjLbKGG1n_0 2024-09-14T11:42:25.959 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:42:25.957+0000 7f8f430319c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.13__shadow_.IX-ntoTwzLNCH3WGpGAr4_hjLbKGG1n_1 2024-09-14T11:42:25.959 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:42:25.957+0000 7f8f430319c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.13__shadow_.IX-ntoTwzLNCH3WGpGAr4_hjLbKGG1n_2 2024-09-14T11:42:25.965 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:42:25.965+0000 7f8f430319c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T11:42:25.971 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:42:25.969+0000 7f8f430319c0 20 garbage collection: RGWGC::process entered with GC index_shard=17, max_secs=3600, expired_only=0 2024-09-14T11:42:25.977 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:42:25.977+0000 7f8f430319c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:42:25.978 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:42:25.977+0000 7f8f430319c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:42:25.979 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:42:25.977+0000 7f8f430319c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:42:25.982 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:42:25.981+0000 7f8f430319c0 20 garbage collection: RGWGC::process entered with GC index_shard=18, max_secs=3600, expired_only=0 2024-09-14T11:42:25.985 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:42:25.985+0000 7f8f430319c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:42:25.986 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:42:25.985+0000 7f8f430319c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:42:25.987 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:42:25.985+0000 7f8f430319c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:42:25.989 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:42:25.989+0000 7f8f430319c0 20 garbage collection: RGWGC::process entered with GC index_shard=19, max_secs=3600, expired_only=0 2024-09-14T11:42:25.992 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:42:25.993+0000 7f8f430319c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:42:25.993 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:42:25.993+0000 7f8f430319c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:42:25.994 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:42:25.993+0000 7f8f430319c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2024-09-14T11:42:25.994 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:42:25.993+0000 7f8f430319c0 20 garbage collection: RGWGC::process iterating over entry tag='d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.16950907896604654502', time=2024-09-14T13:32:05.828684+0000, chain.objs.size()=5 2024-09-14T11:42:25.994 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:42:25.993+0000 7f8f430319c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.14__multipart_foo-LUKEWARM.2~D3lXIzvsi9XIEl9vMQOxPIhNZUw6QEv.1 2024-09-14T11:42:25.994 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:42:25.993+0000 7f8f430319c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.14__shadow_foo-LUKEWARM.2~D3lXIzvsi9XIEl9vMQOxPIhNZUw6QEv.1_1 2024-09-14T11:42:25.994 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:42:25.993+0000 7f8f430319c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.14__multipart_foo-LUKEWARM.2~D3lXIzvsi9XIEl9vMQOxPIhNZUw6QEv.2 2024-09-14T11:42:25.994 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:42:25.993+0000 7f8f430319c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.14__shadow_foo-LUKEWARM.2~D3lXIzvsi9XIEl9vMQOxPIhNZUw6QEv.2_1 2024-09-14T11:42:25.994 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:42:25.993+0000 7f8f430319c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.14__multipart_foo-LUKEWARM.2~D3lXIzvsi9XIEl9vMQOxPIhNZUw6QEv.3 2024-09-14T11:42:25.999 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:42:25.997+0000 7f8f430319c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T11:42:26.004 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:42:26.001+0000 7f8f430319c0 20 garbage collection: RGWGC::process entered with GC index_shard=20, max_secs=3600, expired_only=0 2024-09-14T11:42:26.007 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:42:26.005+0000 7f8f430319c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:42:26.008 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:42:26.009+0000 7f8f430319c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:42:26.009 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:42:26.009+0000 7f8f430319c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2024-09-14T11:42:26.010 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:42:26.009+0000 7f8f430319c0 20 garbage collection: RGWGC::process iterating over entry tag='d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.11913213709187695776', time=2024-09-14T13:32:05.644704+0000, chain.objs.size()=5 2024-09-14T11:42:26.010 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:42:26.009+0000 7f8f430319c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.16__multipart_foo-FROZEN.2~SoLpOsEgNVUd6LOC83yZzuLMoUbW0AA.1 2024-09-14T11:42:26.010 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:42:26.009+0000 7f8f430319c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.16__shadow_foo-FROZEN.2~SoLpOsEgNVUd6LOC83yZzuLMoUbW0AA.1_1 2024-09-14T11:42:26.010 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:42:26.009+0000 7f8f430319c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.16__multipart_foo-FROZEN.2~SoLpOsEgNVUd6LOC83yZzuLMoUbW0AA.2 2024-09-14T11:42:26.010 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:42:26.009+0000 7f8f430319c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.16__shadow_foo-FROZEN.2~SoLpOsEgNVUd6LOC83yZzuLMoUbW0AA.2_1 2024-09-14T11:42:26.010 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:42:26.009+0000 7f8f430319c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.16__multipart_foo-FROZEN.2~SoLpOsEgNVUd6LOC83yZzuLMoUbW0AA.3 2024-09-14T11:42:26.012 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:42:26.013+0000 7f8f430319c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T11:42:26.016 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:42:26.017+0000 7f8f430319c0 20 garbage collection: RGWGC::process entered with GC index_shard=21, max_secs=3600, expired_only=0 2024-09-14T11:42:26.020 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:42:26.017+0000 7f8f430319c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:42:26.021 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:42:26.021+0000 7f8f430319c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:42:26.022 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:42:26.021+0000 7f8f430319c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=2, truncated=0, next_marker='' 2024-09-14T11:42:26.022 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:42:26.021+0000 7f8f430319c0 20 garbage collection: RGWGC::process iterating over entry tag='_VV5oprrI58RodPHmnKb3M8TbPGCNUOl', time=2024-09-14T13:32:05.549135+0000, chain.objs.size()=1 2024-09-14T11:42:26.022 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:42:26.021+0000 7f8f430319c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.15__shadow_.t6q27vNf47a4Wwk2lYF7Wcyf3Q46kT6_0 2024-09-14T11:42:26.022 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:42:26.021+0000 7f8f430319c0 20 garbage collection: RGWGC::process iterating over entry tag='_TRSLHVOwxjPvWni6sS2SxNXHdQhAkW2', time=2024-09-14T13:32:05.621690+0000, chain.objs.size()=1 2024-09-14T11:42:26.023 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:42:26.021+0000 7f8f430319c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.16__shadow_.GXU7BPamtOoGyr42xyRjpS_kU8QEUm7_0 2024-09-14T11:42:26.026 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:42:26.025+0000 7f8f430319c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T11:42:26.031 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:42:26.029+0000 7f8f430319c0 20 garbage collection: RGWGC::process entered with GC index_shard=22, max_secs=3600, expired_only=0 2024-09-14T11:42:26.034 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:42:26.033+0000 7f8f430319c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:42:26.035 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:42:26.033+0000 7f8f430319c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:42:26.036 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:42:26.033+0000 7f8f430319c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2024-09-14T11:42:26.036 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:42:26.033+0000 7f8f430319c0 20 garbage collection: RGWGC::process iterating over entry tag='d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.15326086721908118623', time=2024-09-14T13:32:05.380605+0000, chain.objs.size()=4 2024-09-14T11:42:26.036 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:42:26.033+0000 7f8f430319c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.9__multipart_foo.2~ZrfKU_tie4o4fTMusfwdbfW2krsD8OK.1 2024-09-14T11:42:26.036 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:42:26.033+0000 7f8f430319c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.9__multipart_foo.2~ZrfKU_tie4o4fTMusfwdbfW2krsD8OK.2 2024-09-14T11:42:26.036 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:42:26.033+0000 7f8f430319c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.9__multipart_foo.2~ZrfKU_tie4o4fTMusfwdbfW2krsD8OK.3 2024-09-14T11:42:26.036 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:42:26.033+0000 7f8f430319c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.9__multipart_foo.2~ZrfKU_tie4o4fTMusfwdbfW2krsD8OK.4 2024-09-14T11:42:26.041 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:42:26.041+0000 7f8f430319c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T11:42:26.044 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:42:26.045+0000 7f8f430319c0 20 garbage collection: RGWGC::process entered with GC index_shard=23, max_secs=3600, expired_only=0 2024-09-14T11:42:26.047 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:42:26.045+0000 7f8f430319c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:42:26.049 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:42:26.049+0000 7f8f430319c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:42:26.050 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:42:26.049+0000 7f8f430319c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:42:26.054 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:42:26.053+0000 7f8f430319c0 20 garbage collection: RGWGC::process entered with GC index_shard=24, max_secs=3600, expired_only=0 2024-09-14T11:42:26.056 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:42:26.057+0000 7f8f430319c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:42:26.057 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:42:26.057+0000 7f8f430319c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:42:26.057 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:42:26.057+0000 7f8f430319c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=2, truncated=0, next_marker='' 2024-09-14T11:42:26.057 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:42:26.057+0000 7f8f430319c0 20 garbage collection: RGWGC::process iterating over entry tag='d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.2124295278352644901', time=2024-09-14T13:32:05.514400+0000, chain.objs.size()=2 2024-09-14T11:42:26.057 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:42:26.057+0000 7f8f430319c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.15__shadow_.IouNIhFT_69g4e7E8oqCum2yFqK0-2h_0 2024-09-14T11:42:26.058 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:42:26.057+0000 7f8f430319c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.15__shadow_.IouNIhFT_69g4e7E8oqCum2yFqK0-2h_1 2024-09-14T11:42:26.058 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:42:26.057+0000 7f8f430319c0 20 garbage collection: RGWGC::process iterating over entry tag='_BKbzjxi6fWtUFrnSZkgaSvXrqX3Fxgb', time=2024-09-14T13:32:05.686657+0000, chain.objs.size()=2 2024-09-14T11:42:26.058 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:42:26.057+0000 7f8f430319c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.16__shadow_.hKkKEs8AcnuHUFUgGGtZyUbjpLOAuFb_1 2024-09-14T11:42:26.058 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:42:26.057+0000 7f8f430319c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.16__shadow_.hKkKEs8AcnuHUFUgGGtZyUbjpLOAuFb_2 2024-09-14T11:42:26.061 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:42:26.061+0000 7f8f430319c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T11:42:26.065 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:42:26.065+0000 7f8f430319c0 20 garbage collection: RGWGC::process entered with GC index_shard=25, max_secs=3600, expired_only=0 2024-09-14T11:42:26.068 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:42:26.065+0000 7f8f430319c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:42:26.069 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:42:26.069+0000 7f8f430319c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:42:26.069 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:42:26.069+0000 7f8f430319c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:42:26.071 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:42:26.069+0000 7f8f430319c0 20 garbage collection: RGWGC::process entered with GC index_shard=26, max_secs=3600, expired_only=0 2024-09-14T11:42:26.074 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:42:26.073+0000 7f8f430319c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:42:26.074 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:42:26.073+0000 7f8f430319c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:42:26.075 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:42:26.073+0000 7f8f430319c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=3, truncated=0, next_marker='' 2024-09-14T11:42:26.075 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:42:26.073+0000 7f8f430319c0 20 garbage collection: RGWGC::process iterating over entry tag='d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.11200633701597865269', time=2024-09-14T13:32:05.558131+0000, chain.objs.size()=2 2024-09-14T11:42:26.075 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:42:26.073+0000 7f8f430319c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.15__shadow_.czFV8GJIao5PhukAtzYwoL8Gui5OUKe_0 2024-09-14T11:42:26.075 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:42:26.073+0000 7f8f430319c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.15__shadow_.czFV8GJIao5PhukAtzYwoL8Gui5OUKe_1 2024-09-14T11:42:26.076 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:42:26.073+0000 7f8f430319c0 20 garbage collection: RGWGC::process iterating over entry tag='d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.1288807688716285185', time=2024-09-14T13:32:05.675330+0000, chain.objs.size()=3 2024-09-14T11:42:26.076 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:42:26.073+0000 7f8f430319c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.16__multipart_foo-STANDARD.2~fZQRTBOvoJi2GPy-KSPcRakKMfGaKPH.1 2024-09-14T11:42:26.076 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:42:26.073+0000 7f8f430319c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.16__multipart_foo-STANDARD.2~fZQRTBOvoJi2GPy-KSPcRakKMfGaKPH.2 2024-09-14T11:42:26.076 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:42:26.073+0000 7f8f430319c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.16__multipart_foo-STANDARD.2~fZQRTBOvoJi2GPy-KSPcRakKMfGaKPH.3 2024-09-14T11:42:26.076 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:42:26.073+0000 7f8f430319c0 20 garbage collection: RGWGC::process iterating over entry tag='d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.11085027627534491181', time=2024-09-14T13:32:05.709910+0000, chain.objs.size()=3 2024-09-14T11:42:26.076 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:42:26.073+0000 7f8f430319c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.16__multipart_foo-STANDARD.2~fZQRTBOvoJi2GPy-KSPcRakKMfGaKPH.1 2024-09-14T11:42:26.076 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:42:26.073+0000 7f8f430319c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.16__multipart_foo-STANDARD.2~fZQRTBOvoJi2GPy-KSPcRakKMfGaKPH.2 2024-09-14T11:42:26.076 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:42:26.073+0000 7f8f430319c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.16__multipart_foo-STANDARD.2~fZQRTBOvoJi2GPy-KSPcRakKMfGaKPH.3 2024-09-14T11:42:26.082 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:42:26.081+0000 7f8f430319c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T11:42:26.087 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:42:26.085+0000 7f8f430319c0 20 garbage collection: RGWGC::process entered with GC index_shard=27, max_secs=3600, expired_only=0 2024-09-14T11:42:26.090 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:42:26.089+0000 7f8f430319c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:42:26.092 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:42:26.089+0000 7f8f430319c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:42:26.093 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:42:26.093+0000 7f8f430319c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2024-09-14T11:42:26.093 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:42:26.093+0000 7f8f430319c0 20 garbage collection: RGWGC::process iterating over entry tag='d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.14334832967916961540', time=2024-09-14T13:32:05.748384+0000, chain.objs.size()=5 2024-09-14T11:42:26.093 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:42:26.093+0000 7f8f430319c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.16__multipart_foo-FROZEN.2~SoLpOsEgNVUd6LOC83yZzuLMoUbW0AA.1 2024-09-14T11:42:26.093 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:42:26.093+0000 7f8f430319c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.16__shadow_foo-FROZEN.2~SoLpOsEgNVUd6LOC83yZzuLMoUbW0AA.1_1 2024-09-14T11:42:26.093 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:42:26.093+0000 7f8f430319c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.16__multipart_foo-FROZEN.2~SoLpOsEgNVUd6LOC83yZzuLMoUbW0AA.2 2024-09-14T11:42:26.093 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:42:26.093+0000 7f8f430319c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.16__shadow_foo-FROZEN.2~SoLpOsEgNVUd6LOC83yZzuLMoUbW0AA.2_1 2024-09-14T11:42:26.093 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:42:26.093+0000 7f8f430319c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.16__multipart_foo-FROZEN.2~SoLpOsEgNVUd6LOC83yZzuLMoUbW0AA.3 2024-09-14T11:42:26.098 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:42:26.097+0000 7f8f430319c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T11:42:26.105 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:42:26.105+0000 7f8f430319c0 20 garbage collection: RGWGC::process entered with GC index_shard=28, max_secs=3600, expired_only=0 2024-09-14T11:42:26.108 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:42:26.105+0000 7f8f430319c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:42:26.109 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:42:26.109+0000 7f8f430319c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:42:26.110 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:42:26.109+0000 7f8f430319c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=2, truncated=0, next_marker='' 2024-09-14T11:42:26.110 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:42:26.109+0000 7f8f430319c0 20 garbage collection: RGWGC::process iterating over entry tag='_kaUOgclcxx79SXY_b85-vj5mh09AH-A', time=2024-09-14T13:32:05.664488+0000, chain.objs.size()=3 2024-09-14T11:42:26.110 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:42:26.109+0000 7f8f430319c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.16__shadow_.jyLdNCelA6Y5fG1DXxM1x0n-xXAZLr0_0 2024-09-14T11:42:26.110 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:42:26.109+0000 7f8f430319c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.16__shadow_.jyLdNCelA6Y5fG1DXxM1x0n-xXAZLr0_1 2024-09-14T11:42:26.110 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:42:26.109+0000 7f8f430319c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.16__shadow_.jyLdNCelA6Y5fG1DXxM1x0n-xXAZLr0_2 2024-09-14T11:42:26.110 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:42:26.109+0000 7f8f430319c0 20 garbage collection: RGWGC::process iterating over entry tag='d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.8743947693219366037', time=2024-09-14T13:32:05.816671+0000, chain.objs.size()=3 2024-09-14T11:42:26.110 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:42:26.109+0000 7f8f430319c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.14__multipart_foo-STANDARD.2~6c-KYIVqby5C83_JoX-1kVye5RRg4lx.1 2024-09-14T11:42:26.110 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:42:26.109+0000 7f8f430319c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.14__multipart_foo-STANDARD.2~6c-KYIVqby5C83_JoX-1kVye5RRg4lx.2 2024-09-14T11:42:26.111 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:42:26.109+0000 7f8f430319c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.14__multipart_foo-STANDARD.2~6c-KYIVqby5C83_JoX-1kVye5RRg4lx.3 2024-09-14T11:42:26.117 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:42:26.117+0000 7f8f430319c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T11:42:26.121 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:42:26.121+0000 7f8f430319c0 20 garbage collection: RGWGC::process entered with GC index_shard=29, max_secs=3600, expired_only=0 2024-09-14T11:42:26.124 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:42:26.125+0000 7f8f430319c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:42:26.125 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:42:26.125+0000 7f8f430319c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:42:26.127 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:42:26.125+0000 7f8f430319c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2024-09-14T11:42:26.127 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:42:26.125+0000 7f8f430319c0 20 garbage collection: RGWGC::process iterating over entry tag='_viD9dxe6cG9KwLNeFVgmZHFEj6p-inj', time=2024-09-14T13:32:05.485473+0000, chain.objs.size()=2 2024-09-14T11:42:26.127 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:42:26.125+0000 7f8f430319c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.15__shadow_.rUv-j407_YxEa1VdsJIBD76IFGVMaRU_0 2024-09-14T11:42:26.127 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:42:26.125+0000 7f8f430319c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.15__shadow_.rUv-j407_YxEa1VdsJIBD76IFGVMaRU_1 2024-09-14T11:42:26.131 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:42:26.129+0000 7f8f430319c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T11:42:26.138 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:42:26.137+0000 7f8f430319c0 20 garbage collection: RGWGC::process entered with GC index_shard=30, max_secs=3600, expired_only=0 2024-09-14T11:42:26.140 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:42:26.141+0000 7f8f430319c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:42:26.141 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:42:26.141+0000 7f8f430319c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:42:26.142 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:42:26.141+0000 7f8f430319c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=2, truncated=0, next_marker='' 2024-09-14T11:42:26.142 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:42:26.141+0000 7f8f430319c0 20 garbage collection: RGWGC::process iterating over entry tag='d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.13110476449350126498', time=2024-09-14T13:32:05.262535+0000, chain.objs.size()=4 2024-09-14T11:42:26.142 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:42:26.141+0000 7f8f430319c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.12__multipart_foo.2~4dVDGM3u1KgnsS33Ww3jPh32wuEAh-b.1 2024-09-14T11:42:26.142 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:42:26.141+0000 7f8f430319c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.12__multipart_foo.2~4dVDGM3u1KgnsS33Ww3jPh32wuEAh-b.2 2024-09-14T11:42:26.142 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:42:26.141+0000 7f8f430319c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.12__multipart_foo.2~4dVDGM3u1KgnsS33Ww3jPh32wuEAh-b.3 2024-09-14T11:42:26.142 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:42:26.141+0000 7f8f430319c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.12__multipart_foo.2~4dVDGM3u1KgnsS33Ww3jPh32wuEAh-b.4 2024-09-14T11:42:26.142 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:42:26.141+0000 7f8f430319c0 20 garbage collection: RGWGC::process iterating over entry tag='d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.8836751873761430593', time=2024-09-14T13:32:05.721129+0000, chain.objs.size()=5 2024-09-14T11:42:26.142 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:42:26.141+0000 7f8f430319c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.16__multipart_foo-LUKEWARM.2~LvMwfRJXLK90wupfJ7HhQNqA4LPctM_.1 2024-09-14T11:42:26.143 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:42:26.141+0000 7f8f430319c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.16__shadow_foo-LUKEWARM.2~LvMwfRJXLK90wupfJ7HhQNqA4LPctM_.1_1 2024-09-14T11:42:26.143 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:42:26.141+0000 7f8f430319c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.16__multipart_foo-LUKEWARM.2~LvMwfRJXLK90wupfJ7HhQNqA4LPctM_.2 2024-09-14T11:42:26.143 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:42:26.141+0000 7f8f430319c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.16__shadow_foo-LUKEWARM.2~LvMwfRJXLK90wupfJ7HhQNqA4LPctM_.2_1 2024-09-14T11:42:26.143 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:42:26.141+0000 7f8f430319c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.16__multipart_foo-LUKEWARM.2~LvMwfRJXLK90wupfJ7HhQNqA4LPctM_.3 2024-09-14T11:42:26.148 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:42:26.149+0000 7f8f430319c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T11:42:26.152 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:42:26.149+0000 7f8f430319c0 20 garbage collection: RGWGC::process entered with GC index_shard=31, max_secs=3600, expired_only=0 2024-09-14T11:42:26.154 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:42:26.153+0000 7f8f430319c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:42:26.155 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:42:26.153+0000 7f8f430319c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:42:26.155 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:42:26.153+0000 7f8f430319c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:42:26.157 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:42:26.157+0000 7f8f430319c0 20 garbage collection: RGWGC::process entered with GC index_shard=0, max_secs=3600, expired_only=0 2024-09-14T11:42:26.161 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:42:26.161+0000 7f8f430319c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:42:26.162 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:42:26.161+0000 7f8f430319c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:42:26.163 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:42:26.161+0000 7f8f430319c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2024-09-14T11:42:26.163 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:42:26.161+0000 7f8f430319c0 20 garbage collection: RGWGC::process iterating over entry tag='d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.14065569718826300884', time=2024-09-14T13:32:05.536903+0000, chain.objs.size()=2 2024-09-14T11:42:26.163 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:42:26.161+0000 7f8f430319c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.15__shadow_.IouNIhFT_69g4e7E8oqCum2yFqK0-2h_0 2024-09-14T11:42:26.163 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:42:26.161+0000 7f8f430319c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.15__shadow_.IouNIhFT_69g4e7E8oqCum2yFqK0-2h_1 2024-09-14T11:42:26.169 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:42:26.169+0000 7f8f430319c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T11:42:26.175 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:42:26.173+0000 7f8f430319c0 20 garbage collection: RGWGC::process entered with GC index_shard=1, max_secs=3600, expired_only=0 2024-09-14T11:42:26.178 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:42:26.177+0000 7f8f430319c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:42:26.180 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:42:26.181+0000 7f8f430319c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:42:26.181 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:42:26.181+0000 7f8f430319c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2024-09-14T11:42:26.181 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:42:26.181+0000 7f8f430319c0 20 garbage collection: RGWGC::process iterating over entry tag='d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.8257164539846096105', time=2024-09-14T13:32:05.213104+0000, chain.objs.size()=4 2024-09-14T11:42:26.181 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:42:26.181+0000 7f8f430319c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.11__multipart_foo.2~_SH76nfC0BLqVZctyBelg_j6CWd4ZOS.1 2024-09-14T11:42:26.181 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:42:26.181+0000 7f8f430319c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.11__multipart_foo.2~_SH76nfC0BLqVZctyBelg_j6CWd4ZOS.2 2024-09-14T11:42:26.182 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:42:26.181+0000 7f8f430319c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.11__multipart_foo.2~_SH76nfC0BLqVZctyBelg_j6CWd4ZOS.3 2024-09-14T11:42:26.182 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:42:26.181+0000 7f8f430319c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.11__multipart_foo.2~_SH76nfC0BLqVZctyBelg_j6CWd4ZOS.4 2024-09-14T11:42:26.187 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:42:26.185+0000 7f8f430319c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T11:42:26.193 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:42:26.193+0000 7f8f430319c0 20 garbage collection: RGWGC::process entered with GC index_shard=2, max_secs=3600, expired_only=0 2024-09-14T11:42:26.196 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:42:26.193+0000 7f8f430319c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:42:26.197 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:42:26.197+0000 7f8f430319c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:42:26.198 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:42:26.197+0000 7f8f430319c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=2, truncated=0, next_marker='' 2024-09-14T11:42:26.199 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:42:26.197+0000 7f8f430319c0 20 garbage collection: RGWGC::process iterating over entry tag='d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.5546280612240818718', time=2024-09-14T13:32:05.317906+0000, chain.objs.size()=4 2024-09-14T11:42:26.199 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:42:26.197+0000 7f8f430319c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.10__multipart_foo.2~hxXP3APPkpJDyLpiMGWUkxR-84eHuei.1 2024-09-14T11:42:26.199 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:42:26.197+0000 7f8f430319c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.10__multipart_foo.2~hxXP3APPkpJDyLpiMGWUkxR-84eHuei.2 2024-09-14T11:42:26.199 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:42:26.197+0000 7f8f430319c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.10__multipart_foo.2~hxXP3APPkpJDyLpiMGWUkxR-84eHuei.3 2024-09-14T11:42:26.199 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:42:26.197+0000 7f8f430319c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.10__multipart_foo.2~hxXP3APPkpJDyLpiMGWUkxR-84eHuei.4 2024-09-14T11:42:26.199 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:42:26.197+0000 7f8f430319c0 20 garbage collection: RGWGC::process iterating over entry tag='d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.9377879263429093203', time=2024-09-14T13:32:05.460810+0000, chain.objs.size()=2 2024-09-14T11:42:26.199 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:42:26.197+0000 7f8f430319c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.15__shadow_.czFV8GJIao5PhukAtzYwoL8Gui5OUKe_0 2024-09-14T11:42:26.199 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:42:26.197+0000 7f8f430319c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.15__shadow_.czFV8GJIao5PhukAtzYwoL8Gui5OUKe_1 2024-09-14T11:42:26.206 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:42:26.205+0000 7f8f430319c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T11:42:26.211 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:42:26.209+0000 7f8f430319c0 20 garbage collection: RGWGC::process entered with GC index_shard=3, max_secs=3600, expired_only=0 2024-09-14T11:42:26.214 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:42:26.213+0000 7f8f430319c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:42:26.215 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:42:26.213+0000 7f8f430319c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:42:26.216 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:42:26.217+0000 7f8f430319c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:42:26.219 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:42:26.217+0000 7f8f430319c0 20 garbage collection: RGWGC::process entered with GC index_shard=4, max_secs=3600, expired_only=0 2024-09-14T11:42:26.223 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:42:26.221+0000 7f8f430319c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:42:26.224 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:42:26.225+0000 7f8f430319c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:42:26.225 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:42:26.225+0000 7f8f430319c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:42:26.228 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:42:26.225+0000 7f8f430319c0 20 garbage collection: RGWGC::process entered with GC index_shard=5, max_secs=3600, expired_only=0 2024-09-14T11:42:26.231 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:42:26.229+0000 7f8f430319c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:42:26.233 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:42:26.233+0000 7f8f430319c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:42:26.234 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:42:26.233+0000 7f8f430319c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=3, truncated=0, next_marker='' 2024-09-14T11:42:26.234 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:42:26.233+0000 7f8f430319c0 20 garbage collection: RGWGC::process iterating over entry tag='__dLDhDrgFsWo7ZgUk9emBnKClNEEcyp', time=2024-09-14T13:32:05.450087+0000, chain.objs.size()=1 2024-09-14T11:42:26.234 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:42:26.233+0000 7f8f430319c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.15__shadow_.nvPx7fC7ILNKQdusLbhMLFmNY1Qy6js_1 2024-09-14T11:42:26.234 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:42:26.233+0000 7f8f430319c0 20 garbage collection: RGWGC::process iterating over entry tag='d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.916882130335952568', time=2024-09-14T13:32:05.804341+0000, chain.objs.size()=5 2024-09-14T11:42:26.234 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:42:26.233+0000 7f8f430319c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.14__multipart_foo-FROZEN.2~ltfDeJgWMr51pdmYKEkw1SuEYqzFW0v.1 2024-09-14T11:42:26.234 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:42:26.233+0000 7f8f430319c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.14__shadow_foo-FROZEN.2~ltfDeJgWMr51pdmYKEkw1SuEYqzFW0v.1_1 2024-09-14T11:42:26.234 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:42:26.233+0000 7f8f430319c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.14__multipart_foo-FROZEN.2~ltfDeJgWMr51pdmYKEkw1SuEYqzFW0v.2 2024-09-14T11:42:26.234 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:42:26.233+0000 7f8f430319c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.14__shadow_foo-FROZEN.2~ltfDeJgWMr51pdmYKEkw1SuEYqzFW0v.2_1 2024-09-14T11:42:26.234 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:42:26.233+0000 7f8f430319c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.14__multipart_foo-FROZEN.2~ltfDeJgWMr51pdmYKEkw1SuEYqzFW0v.3 2024-09-14T11:42:26.235 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:42:26.233+0000 7f8f430319c0 20 garbage collection: RGWGC::process iterating over entry tag='d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.1856814068088010347', time=2024-09-14T13:32:05.891710+0000, chain.objs.size()=3 2024-09-14T11:42:26.235 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:42:26.233+0000 7f8f430319c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.13__shadow_.eUaxoM6pljMkuIIpWyyY3O1A4AfBqzo_0 2024-09-14T11:42:26.235 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:42:26.233+0000 7f8f430319c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.13__shadow_.eUaxoM6pljMkuIIpWyyY3O1A4AfBqzo_1 2024-09-14T11:42:26.235 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:42:26.233+0000 7f8f430319c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.13__shadow_.eUaxoM6pljMkuIIpWyyY3O1A4AfBqzo_2 2024-09-14T11:42:26.241 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:42:26.241+0000 7f8f430319c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T11:42:26.247 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:42:26.245+0000 7f8f430319c0 20 garbage collection: RGWGC::process entered with GC index_shard=6, max_secs=3600, expired_only=0 2024-09-14T11:42:26.250 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:42:26.249+0000 7f8f430319c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:42:26.251 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:42:26.249+0000 7f8f430319c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:42:26.253 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:42:26.253+0000 7f8f430319c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:42:26.255 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:42:26.253+0000 7f8f430319c0 20 garbage collection: RGWGC::process entered with GC index_shard=7, max_secs=3600, expired_only=0 2024-09-14T11:42:26.259 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:42:26.257+0000 7f8f430319c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:42:26.260 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:42:26.261+0000 7f8f430319c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:42:26.261 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:42:26.261+0000 7f8f430319c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2024-09-14T11:42:26.261 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:42:26.261+0000 7f8f430319c0 20 garbage collection: RGWGC::process iterating over entry tag='_0XYeYc-pj73iGLs0k3jog2Jq7mlUGsH', time=2024-09-14T13:32:05.470963+0000, chain.objs.size()=2 2024-09-14T11:42:26.261 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:42:26.261+0000 7f8f430319c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.15__shadow_.Y62WBlZnIe4dOsazYGyZZczkQ5PNYez_0 2024-09-14T11:42:26.261 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:42:26.261+0000 7f8f430319c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.15__shadow_.Y62WBlZnIe4dOsazYGyZZczkQ5PNYez_1 2024-09-14T11:42:26.265 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:42:26.265+0000 7f8f430319c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T11:42:26.270 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:42:26.269+0000 7f8f430319c0 20 garbage collection: RGWGC::process entered with GC index_shard=8, max_secs=3600, expired_only=0 2024-09-14T11:42:26.274 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:42:26.273+0000 7f8f430319c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:42:26.275 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:42:26.273+0000 7f8f430319c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:42:26.275 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:42:26.273+0000 7f8f430319c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:42:26.278 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:42:26.277+0000 7f8f430319c0 20 garbage collection: RGWGC::process entered with GC index_shard=9, max_secs=3600, expired_only=0 2024-09-14T11:42:26.281 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:42:26.281+0000 7f8f430319c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:42:26.282 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:42:26.281+0000 7f8f430319c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:42:26.283 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:42:26.281+0000 7f8f430319c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:42:26.286 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:42:26.285+0000 7f8f430319c0 20 garbage collection: RGWGC::process entered with GC index_shard=10, max_secs=3600, expired_only=0 2024-09-14T11:42:26.290 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:42:26.289+0000 7f8f430319c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:42:26.291 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:42:26.289+0000 7f8f430319c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:42:26.292 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:42:26.289+0000 7f8f430319c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:42:26.294 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:42:26.293+0000 7f8f430319c0 20 garbage collection: RGWGC::process entered with GC index_shard=11, max_secs=3600, expired_only=0 2024-09-14T11:42:26.298 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:42:26.297+0000 7f8f430319c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:42:26.299 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:42:26.297+0000 7f8f430319c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:42:26.301 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:42:26.301+0000 7f8f430319c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=2, truncated=0, next_marker='' 2024-09-14T11:42:26.301 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:42:26.301+0000 7f8f430319c0 20 garbage collection: RGWGC::process iterating over entry tag='_PzMEvAfXaB-Z0ozvULi7dzkmJnNffDL', time=2024-09-14T13:32:05.439098+0000, chain.objs.size()=1 2024-09-14T11:42:26.301 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:42:26.301+0000 7f8f430319c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.15__shadow_.SQ-5na3U6zOsm3iPqR-dQaIbo9eBYo__0 2024-09-14T11:42:26.301 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:42:26.301+0000 7f8f430319c0 20 garbage collection: RGWGC::process iterating over entry tag='_bMOaMZ2WAKVh-YAFQSTcfPiIn2c0eGI', time=2024-09-14T13:32:05.653133+0000, chain.objs.size()=3 2024-09-14T11:42:26.301 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:42:26.301+0000 7f8f430319c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.16__shadow_.k0Sxb_xgDon1NP4g21LQ5xY4MpFdunV_0 2024-09-14T11:42:26.301 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:42:26.301+0000 7f8f430319c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.16__shadow_.k0Sxb_xgDon1NP4g21LQ5xY4MpFdunV_1 2024-09-14T11:42:26.301 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:42:26.301+0000 7f8f430319c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.16__shadow_.k0Sxb_xgDon1NP4g21LQ5xY4MpFdunV_2 2024-09-14T11:42:26.306 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:42:26.305+0000 7f8f430319c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T11:42:26.313 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:42:26.313+0000 7f8df77e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:42:26.319 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:42:26.317+0000 7f8f430319c0 20 remove_watcher() i=0 2024-09-14T11:42:26.319 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:42:26.317+0000 7f8f430319c0 2 removed watcher, disabling cache 2024-09-14T11:42:26.322 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:42:26.321+0000 7f8f430319c0 20 remove_watcher() i=1 2024-09-14T11:42:26.326 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:42:26.325+0000 7f8f430319c0 20 remove_watcher() i=2 2024-09-14T11:42:26.329 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:42:26.329+0000 7f8f430319c0 20 remove_watcher() i=3 2024-09-14T11:42:26.332 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:42:26.329+0000 7f8f430319c0 20 remove_watcher() i=4 2024-09-14T11:42:26.334 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:42:26.333+0000 7f8f430319c0 20 remove_watcher() i=5 2024-09-14T11:42:26.337 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:42:26.337+0000 7f8f430319c0 20 remove_watcher() i=6 2024-09-14T11:42:26.339 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:42:26.337+0000 7f8f430319c0 20 remove_watcher() i=7 2024-09-14T11:42:26.359 DEBUG:teuthology.orchestra.run.smithi138:> radosgw-admin gc process --include-all 2024-09-14T11:42:26.432 INFO:teuthology.orchestra.run.smithi138.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:42:26.432 INFO:teuthology.orchestra.run.smithi138.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:42:26.479 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:42:26.477+0000 7f0593acc9c0 20 rados->read ofs=0 len=0 2024-09-14T11:42:26.481 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:42:26.481+0000 7f0593acc9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:42:26.482 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:42:26.481+0000 7f0593acc9c0 20 realm 2024-09-14T11:42:26.482 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:42:26.481+0000 7f0593acc9c0 20 rados->read ofs=0 len=0 2024-09-14T11:42:26.482 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:42:26.481+0000 7f0593acc9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:42:26.482 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:42:26.481+0000 7f0593acc9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:42:26.482 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:42:26.481+0000 7f0593acc9c0 20 rados->read ofs=0 len=0 2024-09-14T11:42:26.482 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:42:26.481+0000 7f0593acc9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:42:26.482 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:42:26.481+0000 7f0593acc9c0 20 rados->read ofs=0 len=0 2024-09-14T11:42:26.483 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:42:26.481+0000 7f0593acc9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:42:26.483 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:42:26.481+0000 7f0593acc9c0 20 rados->read ofs=0 len=0 2024-09-14T11:42:26.484 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:42:26.485+0000 7f0593acc9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:42:26.484 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:42:26.485+0000 7f0593acc9c0 20 searching for the correct realm 2024-09-14T11:42:26.485 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:42:26.485+0000 7f0590dd1640 0 -- 172.21.15.138:0/3752131615 >> [v2:172.21.15.154:6808/1468088432,v1:172.21.15.154:6809/1468088432] conn(0x7f058c0b8070 msgr2=0x7f058c0b8450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:42:26.701 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:42:26.701+0000 7f0591dd3640 0 -- 172.21.15.138:0/3752131615 >> [v2:172.21.15.138:6824/2633984942,v1:172.21.15.138:6825/2633984942] conn(0x55ef56c8ef90 msgr2=0x55ef56c913a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:42:26.720 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:42:26.721+0000 7f0593acc9c0 20 RGWRados::pool_iterate: got zone_info.d9e72d30-c60b-4d0d-9267-fdc36392d5ad 2024-09-14T11:42:26.720 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:42:26.721+0000 7f0593acc9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:42:26.721 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:42:26.721+0000 7f0593acc9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:42:26.721 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:42:26.721+0000 7f0593acc9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:42:26.721 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:42:26.721+0000 7f0593acc9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:42:26.721 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:42:26.721+0000 7f0593acc9c0 20 RGWRados::pool_iterate: got zonegroup_info.65ab941b-da8c-4160-94fb-3672b069d44f 2024-09-14T11:42:26.721 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:42:26.721+0000 7f0593acc9c0 20 rados->read ofs=0 len=0 2024-09-14T11:42:26.721 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:42:26.721+0000 7f0593acc9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:42:26.721 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:42:26.721+0000 7f0593acc9c0 20 rados->read ofs=0 len=0 2024-09-14T11:42:26.722 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:42:26.721+0000 7f0593acc9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:42:26.722 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:42:26.721+0000 7f0593acc9c0 20 rados->read ofs=0 len=0 2024-09-14T11:42:26.723 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:42:26.721+0000 7f0593acc9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:42:26.723 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:42:26.721+0000 7f0593acc9c0 20 zone default found 2024-09-14T11:42:26.723 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:42:26.721+0000 7f0593acc9c0 4 Realm: () 2024-09-14T11:42:26.723 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:42:26.721+0000 7f0593acc9c0 4 ZoneGroup: default (65ab941b-da8c-4160-94fb-3672b069d44f) 2024-09-14T11:42:26.724 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:42:26.721+0000 7f0593acc9c0 4 Zone: default (d9e72d30-c60b-4d0d-9267-fdc36392d5ad) 2024-09-14T11:42:26.724 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:42:26.721+0000 7f0593acc9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:42:26.724 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:42:26.721+0000 7f0593acc9c0 20 zonegroup default 2024-09-14T11:42:26.724 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:42:26.721+0000 7f0593acc9c0 20 rados->read ofs=0 len=0 2024-09-14T11:42:26.724 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:42:26.721+0000 7f0593acc9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:42:26.724 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:42:26.721+0000 7f0593acc9c0 20 rados->read ofs=0 len=0 2024-09-14T11:42:26.725 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:42:26.725+0000 7f0593acc9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:42:26.725 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:42:26.725+0000 7f0593acc9c0 20 rados->read ofs=0 len=0 2024-09-14T11:42:26.725 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:42:26.725+0000 7f0593acc9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:42:26.725 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:42:26.725+0000 7f0593acc9c0 20 started sync module instance, tier type = 2024-09-14T11:42:26.725 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:42:26.725+0000 7f0593acc9c0 20 started zone id=d9e72d30-c60b-4d0d-9267-fdc36392d5ad (name=default) with tier type = 2024-09-14T11:42:26.752 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:42:26.749+0000 7f0593acc9c0 20 add_watcher() i=0 2024-09-14T11:42:26.752 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:42:26.749+0000 7f0593acc9c0 20 add_watcher() i=1 2024-09-14T11:42:26.752 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:42:26.749+0000 7f0593acc9c0 20 add_watcher() i=2 2024-09-14T11:42:26.752 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:42:26.749+0000 7f0593acc9c0 20 add_watcher() i=3 2024-09-14T11:42:26.752 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:42:26.749+0000 7f0593acc9c0 20 add_watcher() i=4 2024-09-14T11:42:26.752 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:42:26.749+0000 7f0593acc9c0 20 add_watcher() i=5 2024-09-14T11:42:26.752 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:42:26.749+0000 7f0593acc9c0 20 add_watcher() i=6 2024-09-14T11:42:26.754 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:42:26.753+0000 7f0593acc9c0 20 add_watcher() i=7 2024-09-14T11:42:26.754 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:42:26.753+0000 7f0593acc9c0 2 all 8 watchers are set, enabling cache 2024-09-14T11:42:26.758 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:42:26.757+0000 7f0447fe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:42:26.759 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:42:26.757+0000 7f0593acc9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:42:26.759 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:42:26.757+0000 7f0593acc9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:42:26.851 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:42:26.849+0000 7f0446fe5640 20 reqs_thread_entry: start 2024-09-14T11:42:26.851 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:42:26.849+0000 7f0593acc9c0 20 init_complete bucket index max shards: 11 2024-09-14T11:42:26.851 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:42:26.849+0000 7f0593acc9c0 20 Filter name: none 2024-09-14T11:42:26.851 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:42:26.849+0000 7f0444fe1640 20 reqs_thread_entry: start 2024-09-14T11:42:26.851 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:42:26.849+0000 7f0593acc9c0 20 garbage collection: RGWGC::process entered with GC index_shard=18, max_secs=3600, expired_only=0 2024-09-14T11:42:26.855 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:42:26.853+0000 7f0593acc9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:42:26.856 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:42:26.853+0000 7f0593acc9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:42:26.857 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:42:26.857+0000 7f0593acc9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:42:26.860 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:42:26.861+0000 7f0593acc9c0 20 garbage collection: RGWGC::process entered with GC index_shard=19, max_secs=3600, expired_only=0 2024-09-14T11:42:26.862 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:42:26.861+0000 7f0593acc9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:42:26.863 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:42:26.861+0000 7f0593acc9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:42:26.863 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:42:26.861+0000 7f0593acc9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:42:26.865 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:42:26.865+0000 7f0593acc9c0 20 garbage collection: RGWGC::process entered with GC index_shard=20, max_secs=3600, expired_only=0 2024-09-14T11:42:26.868 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:42:26.869+0000 7f0593acc9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:42:26.869 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:42:26.869+0000 7f0593acc9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:42:26.870 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:42:26.869+0000 7f0593acc9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:42:26.872 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:42:26.869+0000 7f0593acc9c0 20 garbage collection: RGWGC::process entered with GC index_shard=21, max_secs=3600, expired_only=0 2024-09-14T11:42:26.876 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:42:26.877+0000 7f0593acc9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:42:26.878 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:42:26.877+0000 7f0593acc9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:42:26.878 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:42:26.877+0000 7f0593acc9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:42:26.881 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:42:26.881+0000 7f0593acc9c0 20 garbage collection: RGWGC::process entered with GC index_shard=22, max_secs=3600, expired_only=0 2024-09-14T11:42:26.883 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:42:26.881+0000 7f0593acc9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:42:26.884 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:42:26.885+0000 7f0593acc9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:42:26.884 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:42:26.885+0000 7f0593acc9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:42:26.886 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:42:26.885+0000 7f0593acc9c0 20 garbage collection: RGWGC::process entered with GC index_shard=23, max_secs=3600, expired_only=0 2024-09-14T11:42:26.889 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:42:26.889+0000 7f0593acc9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:42:26.891 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:42:26.889+0000 7f0593acc9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:42:26.891 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:42:26.889+0000 7f0593acc9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:42:26.893 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:42:26.893+0000 7f0593acc9c0 20 garbage collection: RGWGC::process entered with GC index_shard=24, max_secs=3600, expired_only=0 2024-09-14T11:42:26.896 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:42:26.897+0000 7f0593acc9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:42:26.897 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:42:26.897+0000 7f0593acc9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:42:26.897 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:42:26.897+0000 7f0593acc9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:42:26.899 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:42:26.897+0000 7f0593acc9c0 20 garbage collection: RGWGC::process entered with GC index_shard=25, max_secs=3600, expired_only=0 2024-09-14T11:42:26.902 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:42:26.901+0000 7f0593acc9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:42:26.902 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:42:26.901+0000 7f0593acc9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:42:26.903 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:42:26.901+0000 7f0593acc9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:42:26.905 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:42:26.905+0000 7f0593acc9c0 20 garbage collection: RGWGC::process entered with GC index_shard=26, max_secs=3600, expired_only=0 2024-09-14T11:42:26.907 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:42:26.905+0000 7f0593acc9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:42:26.908 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:42:26.909+0000 7f0593acc9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:42:26.908 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:42:26.909+0000 7f0593acc9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:42:26.910 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:42:26.909+0000 7f0593acc9c0 20 garbage collection: RGWGC::process entered with GC index_shard=27, max_secs=3600, expired_only=0 2024-09-14T11:42:26.914 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:42:26.913+0000 7f0593acc9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:42:26.915 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:42:26.913+0000 7f0593acc9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:42:26.916 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:42:26.913+0000 7f0593acc9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:42:26.918 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:42:26.917+0000 7f0593acc9c0 20 garbage collection: RGWGC::process entered with GC index_shard=28, max_secs=3600, expired_only=0 2024-09-14T11:42:26.921 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:42:26.921+0000 7f0593acc9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:42:26.922 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:42:26.921+0000 7f0593acc9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:42:26.922 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:42:26.921+0000 7f0593acc9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:42:26.924 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:42:26.925+0000 7f0593acc9c0 20 garbage collection: RGWGC::process entered with GC index_shard=29, max_secs=3600, expired_only=0 2024-09-14T11:42:26.928 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:42:26.925+0000 7f0593acc9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:42:26.929 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:42:26.929+0000 7f0593acc9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:42:26.929 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:42:26.929+0000 7f0593acc9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:42:26.932 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:42:26.929+0000 7f0593acc9c0 20 garbage collection: RGWGC::process entered with GC index_shard=30, max_secs=3600, expired_only=0 2024-09-14T11:42:26.934 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:42:26.933+0000 7f0593acc9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:42:26.935 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:42:26.933+0000 7f0593acc9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:42:26.936 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:42:26.933+0000 7f0593acc9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:42:26.938 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:42:26.937+0000 7f0593acc9c0 20 garbage collection: RGWGC::process entered with GC index_shard=31, max_secs=3600, expired_only=0 2024-09-14T11:42:26.940 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:42:26.941+0000 7f0593acc9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:42:26.941 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:42:26.941+0000 7f0593acc9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:42:26.941 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:42:26.941+0000 7f0593acc9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:42:26.943 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:42:26.941+0000 7f0593acc9c0 20 garbage collection: RGWGC::process entered with GC index_shard=0, max_secs=3600, expired_only=0 2024-09-14T11:42:26.946 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:42:26.945+0000 7f0593acc9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:42:26.948 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:42:26.945+0000 7f0593acc9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:42:26.948 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:42:26.949+0000 7f0593acc9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:42:26.951 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:42:26.949+0000 7f0593acc9c0 20 garbage collection: RGWGC::process entered with GC index_shard=1, max_secs=3600, expired_only=0 2024-09-14T11:42:26.954 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:42:26.953+0000 7f0593acc9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:42:26.955 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:42:26.953+0000 7f0593acc9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:42:26.955 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:42:26.953+0000 7f0593acc9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:42:26.957 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:42:26.957+0000 7f0593acc9c0 20 garbage collection: RGWGC::process entered with GC index_shard=2, max_secs=3600, expired_only=0 2024-09-14T11:42:26.961 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:42:26.961+0000 7f0593acc9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:42:26.962 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:42:26.961+0000 7f0593acc9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:42:26.962 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:42:26.961+0000 7f0593acc9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:42:26.964 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:42:26.965+0000 7f0593acc9c0 20 garbage collection: RGWGC::process entered with GC index_shard=3, max_secs=3600, expired_only=0 2024-09-14T11:42:26.967 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:42:26.965+0000 7f0593acc9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:42:26.968 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:42:26.969+0000 7f0593acc9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:42:26.968 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:42:26.969+0000 7f0593acc9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:42:26.970 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:42:26.969+0000 7f0593acc9c0 20 garbage collection: RGWGC::process entered with GC index_shard=4, max_secs=3600, expired_only=0 2024-09-14T11:42:26.975 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:42:26.973+0000 7f0593acc9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:42:26.977 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:42:26.977+0000 7f0593acc9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:42:26.978 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:42:26.977+0000 7f0593acc9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:42:26.981 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:42:26.981+0000 7f0593acc9c0 20 garbage collection: RGWGC::process entered with GC index_shard=5, max_secs=3600, expired_only=0 2024-09-14T11:42:26.985 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:42:26.985+0000 7f0593acc9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:42:26.987 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:42:26.985+0000 7f0593acc9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:42:26.987 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:42:26.985+0000 7f0593acc9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:42:26.990 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:42:26.989+0000 7f0593acc9c0 20 garbage collection: RGWGC::process entered with GC index_shard=6, max_secs=3600, expired_only=0 2024-09-14T11:42:26.994 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:42:26.993+0000 7f0593acc9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:42:26.995 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:42:26.993+0000 7f0593acc9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:42:26.996 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:42:26.993+0000 7f0593acc9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:42:26.998 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:42:26.997+0000 7f0593acc9c0 20 garbage collection: RGWGC::process entered with GC index_shard=7, max_secs=3600, expired_only=0 2024-09-14T11:42:27.002 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:42:27.001+0000 7f0593acc9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:42:27.003 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:42:27.001+0000 7f0593acc9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:42:27.003 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:42:27.001+0000 7f0593acc9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:42:27.006 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:42:27.005+0000 7f0593acc9c0 20 garbage collection: RGWGC::process entered with GC index_shard=8, max_secs=3600, expired_only=0 2024-09-14T11:42:27.010 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:42:27.009+0000 7f0593acc9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:42:27.011 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:42:27.009+0000 7f0593acc9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:42:27.012 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:42:27.013+0000 7f0593acc9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:42:27.015 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:42:27.013+0000 7f0593acc9c0 20 garbage collection: RGWGC::process entered with GC index_shard=9, max_secs=3600, expired_only=0 2024-09-14T11:42:27.019 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:42:27.017+0000 7f0593acc9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:42:27.021 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:42:27.021+0000 7f0593acc9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:42:27.021 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:42:27.021+0000 7f0593acc9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:42:27.024 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:42:27.025+0000 7f0593acc9c0 20 garbage collection: RGWGC::process entered with GC index_shard=10, max_secs=3600, expired_only=0 2024-09-14T11:42:27.028 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:42:27.025+0000 7f0593acc9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:42:27.029 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:42:27.029+0000 7f0593acc9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:42:27.030 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:42:27.029+0000 7f0593acc9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:42:27.033 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:42:27.033+0000 7f0593acc9c0 20 garbage collection: RGWGC::process entered with GC index_shard=11, max_secs=3600, expired_only=0 2024-09-14T11:42:27.037 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:42:27.037+0000 7f0593acc9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:42:27.038 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:42:27.037+0000 7f0593acc9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:42:27.038 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:42:27.037+0000 7f0593acc9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:42:27.041 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:42:27.041+0000 7f0593acc9c0 20 garbage collection: RGWGC::process entered with GC index_shard=12, max_secs=3600, expired_only=0 2024-09-14T11:42:27.044 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:42:27.045+0000 7f0593acc9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:42:27.046 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:42:27.045+0000 7f0593acc9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:42:27.046 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:42:27.045+0000 7f0593acc9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:42:27.049 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:42:27.049+0000 7f0593acc9c0 20 garbage collection: RGWGC::process entered with GC index_shard=13, max_secs=3600, expired_only=0 2024-09-14T11:42:27.052 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:42:27.053+0000 7f0593acc9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:42:27.053 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:42:27.053+0000 7f0593acc9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:42:27.054 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:42:27.053+0000 7f0593acc9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:42:27.056 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:42:27.057+0000 7f0593acc9c0 20 garbage collection: RGWGC::process entered with GC index_shard=14, max_secs=3600, expired_only=0 2024-09-14T11:42:27.060 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:42:27.057+0000 7f0593acc9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:42:27.061 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:42:27.061+0000 7f0593acc9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:42:27.062 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:42:27.061+0000 7f0593acc9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:42:27.065 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:42:27.065+0000 7f0593acc9c0 20 garbage collection: RGWGC::process entered with GC index_shard=15, max_secs=3600, expired_only=0 2024-09-14T11:42:27.068 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:42:27.069+0000 7f0593acc9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:42:27.070 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:42:27.069+0000 7f0593acc9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:42:27.071 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:42:27.069+0000 7f0593acc9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:42:27.074 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:42:27.073+0000 7f0593acc9c0 20 garbage collection: RGWGC::process entered with GC index_shard=16, max_secs=3600, expired_only=0 2024-09-14T11:42:27.077 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:42:27.077+0000 7f0593acc9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:42:27.079 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:42:27.077+0000 7f0593acc9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:42:27.079 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:42:27.077+0000 7f0593acc9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:42:27.082 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:42:27.081+0000 7f0593acc9c0 20 garbage collection: RGWGC::process entered with GC index_shard=17, max_secs=3600, expired_only=0 2024-09-14T11:42:27.085 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:42:27.085+0000 7f0593acc9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:42:27.086 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:42:27.085+0000 7f0593acc9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:42:27.086 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:42:27.085+0000 7f0593acc9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:42:27.091 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:42:27.089+0000 7f0447fe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:42:27.097 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:42:27.097+0000 7f0593acc9c0 20 remove_watcher() i=0 2024-09-14T11:42:27.097 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:42:27.097+0000 7f0593acc9c0 2 removed watcher, disabling cache 2024-09-14T11:42:27.099 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:42:27.097+0000 7f0593acc9c0 20 remove_watcher() i=1 2024-09-14T11:42:27.101 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:42:27.101+0000 7f0593acc9c0 20 remove_watcher() i=2 2024-09-14T11:42:27.104 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:42:27.101+0000 7f0593acc9c0 20 remove_watcher() i=3 2024-09-14T11:42:27.106 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:42:27.105+0000 7f0593acc9c0 20 remove_watcher() i=4 2024-09-14T11:42:27.108 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:42:27.109+0000 7f0593acc9c0 20 remove_watcher() i=5 2024-09-14T11:42:27.110 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:42:27.109+0000 7f0593acc9c0 20 remove_watcher() i=6 2024-09-14T11:42:27.113 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:42:27.113+0000 7f0593acc9c0 20 remove_watcher() i=7 2024-09-14T11:42:27.133 DEBUG:teuthology.orchestra.run.smithi138:> cd /home/ubuntu/cephtest/s3-tests-java && /opt/gradle/gradle/bin/gradle clean test --rerun-tasks --no-build-cache --tests AWS4Test 2024-09-14T11:42:27.767 INFO:teuthology.orchestra.run.smithi138.stdout:Starting a Gradle Daemon (subsequent builds will be faster) 2024-09-14T11:42:32.168 INFO:teuthology.orchestra.run.smithi138.stdout:> Task :clean UP-TO-DATE 2024-09-14T11:42:50.166 INFO:teuthology.orchestra.run.smithi138.stdout:> Task :compileJava 2024-09-14T11:42:50.166 INFO:teuthology.orchestra.run.smithi138.stdout:> Task :processResources 2024-09-14T11:42:50.166 INFO:teuthology.orchestra.run.smithi138.stdout:> Task :classes 2024-09-14T11:42:51.065 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-09-14T11:42:51.066 INFO:teuthology.orchestra.run.smithi138.stdout:> Task :compileTestJava 2024-09-14T11:42:51.066 INFO:teuthology.orchestra.run.smithi138.stderr:Note: /home/ubuntu/cephtest/s3-tests-java/src/test/java/BucketTest.java uses or overrides a deprecated API. 2024-09-14T11:42:51.066 INFO:teuthology.orchestra.run.smithi138.stderr:Note: Recompile with -Xlint:deprecation for details. 2024-09-14T11:42:51.067 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-09-14T11:42:51.067 INFO:teuthology.orchestra.run.smithi138.stdout:> Task :processTestResources NO-SOURCE 2024-09-14T11:42:51.067 INFO:teuthology.orchestra.run.smithi138.stdout:> Task :testClasses 2024-09-14T11:42:57.266 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-09-14T11:42:57.266 INFO:teuthology.orchestra.run.smithi138.stdout:> Task :test 2024-09-14T11:42:57.266 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-09-14T11:42:57.266 INFO:teuthology.orchestra.run.smithi138.stdout:suite > AWS4 tests > AWS4Test.testAbortMultipartUploadLLAPIAWS4 STARTED 2024-09-14T11:43:09.466 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-09-14T11:43:09.466 INFO:teuthology.orchestra.run.smithi138.stdout:suite > AWS4 tests > AWS4Test.testAbortMultipartUploadLLAPIAWS4 PASSED 2024-09-14T11:43:10.265 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-09-14T11:43:10.266 INFO:teuthology.orchestra.run.smithi138.stdout:suite > AWS4 tests > AWS4Test.testAbortMultipartUploadNotFoundLLAPIAWS4 STARTED 2024-09-14T11:43:10.465 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-09-14T11:43:10.465 INFO:teuthology.orchestra.run.smithi138.stdout:suite > AWS4 tests > AWS4Test.testAbortMultipartUploadNotFoundLLAPIAWS4 PASSED 2024-09-14T11:43:11.365 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-09-14T11:43:11.366 INFO:teuthology.orchestra.run.smithi138.stdout:suite > AWS4 tests > AWS4Test.testDownloadHLAPIAWS4 STARTED 2024-09-14T11:43:32.566 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-09-14T11:43:32.566 INFO:teuthology.orchestra.run.smithi138.stdout:suite > AWS4 tests > AWS4Test.testDownloadHLAPIAWS4 PASSED 2024-09-14T11:43:33.365 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-09-14T11:43:33.365 INFO:teuthology.orchestra.run.smithi138.stdout:suite > AWS4 tests > AWS4Test.testDownloadNoBucketHLAPIAWS4 STARTED 2024-09-14T11:43:33.465 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-09-14T11:43:33.465 INFO:teuthology.orchestra.run.smithi138.stdout:suite > AWS4 tests > AWS4Test.testDownloadNoBucketHLAPIAWS4 PASSED 2024-09-14T11:43:33.665 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-09-14T11:43:33.665 INFO:teuthology.orchestra.run.smithi138.stdout:suite > AWS4 tests > AWS4Test.testDownloadNoKeyHLAPIAWS4 STARTED 2024-09-14T11:43:33.865 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-09-14T11:43:33.866 INFO:teuthology.orchestra.run.smithi138.stdout:suite > AWS4 tests > AWS4Test.testDownloadNoKeyHLAPIAWS4 PASSED 2024-09-14T11:43:34.665 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-09-14T11:43:34.666 INFO:teuthology.orchestra.run.smithi138.stdout:suite > AWS4 tests > AWS4Test.testMultipartCopyHLAPIAWS4 STARTED 2024-09-14T11:43:48.066 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-09-14T11:43:48.066 INFO:teuthology.orchestra.run.smithi138.stdout:suite > AWS4 tests > AWS4Test.testMultipartCopyHLAPIAWS4 PASSED 2024-09-14T11:43:49.665 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-09-14T11:43:49.666 INFO:teuthology.orchestra.run.smithi138.stdout:suite > AWS4 tests > AWS4Test.testMultipartCopyMultipleSizesLLAPIAWS4 STARTED 2024-09-14T11:43:50.165 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-09-14T11:43:50.165 INFO:teuthology.orchestra.run.smithi138.stdout:suite > AWS4 tests > AWS4Test.testMultipartCopyMultipleSizesLLAPIAWS4 STANDARD_OUT 2024-09-14T11:43:50.166 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-09-14 11:43:50,068 [Test worker] WARN com.amazonaws.util.Base64 - JAXB is unavailable. Will fallback to SDK implementation which may be less performant 2024-09-14T11:45:02.766 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-09-14T11:45:02.766 INFO:teuthology.orchestra.run.smithi138.stdout:suite > AWS4 tests > AWS4Test.testMultipartCopyMultipleSizesLLAPIAWS4 PASSED 2024-09-14T11:45:04.265 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-09-14T11:45:04.265 INFO:teuthology.orchestra.run.smithi138.stdout:suite > AWS4 tests > AWS4Test.testMultipartCopyNoSRCBucketHLAPIAWS4 STARTED 2024-09-14T11:45:04.465 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-09-14T11:45:04.465 INFO:teuthology.orchestra.run.smithi138.stdout:suite > AWS4 tests > AWS4Test.testMultipartCopyNoSRCBucketHLAPIAWS4 PASSED 2024-09-14T11:45:05.265 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-09-14T11:45:05.265 INFO:teuthology.orchestra.run.smithi138.stdout:suite > AWS4 tests > AWS4Test.testMultipartCopyNoSRCKeyHLAPIAWS4 STARTED 2024-09-14T11:45:05.565 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-09-14T11:45:05.565 INFO:teuthology.orchestra.run.smithi138.stdout:suite > AWS4 tests > AWS4Test.testMultipartCopyNoSRCKeyHLAPIAWS4 PASSED 2024-09-14T11:45:07.166 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-09-14T11:45:07.166 INFO:teuthology.orchestra.run.smithi138.stdout:suite > AWS4 tests > AWS4Test.testMultipartDownloadHLAPIAWS4 STARTED 2024-09-14T11:45:28.965 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-09-14T11:45:28.965 INFO:teuthology.orchestra.run.smithi138.stdout:suite > AWS4 tests > AWS4Test.testMultipartDownloadHLAPIAWS4 PASSED 2024-09-14T11:45:29.965 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-09-14T11:45:29.965 INFO:teuthology.orchestra.run.smithi138.stdout:suite > AWS4 tests > AWS4Test.testMultipartDownloadNoBucketHLAPIAWS4 STARTED 2024-09-14T11:45:29.965 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-09-14T11:45:29.965 INFO:teuthology.orchestra.run.smithi138.stdout:suite > AWS4 tests > AWS4Test.testMultipartDownloadNoBucketHLAPIAWS4 PASSED 2024-09-14T11:45:30.165 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-09-14T11:45:30.165 INFO:teuthology.orchestra.run.smithi138.stdout:suite > AWS4 tests > AWS4Test.testMultipartDownloadWithPauseHLAPIAWS4 STARTED 2024-09-14T11:45:45.066 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-09-14T11:45:45.066 INFO:teuthology.orchestra.run.smithi138.stdout:suite > AWS4 tests > AWS4Test.testMultipartDownloadWithPauseHLAPIAWS4 STANDARD_OUT 2024-09-14T11:45:45.066 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-09-14 11:45:44,979 [s3-transfer-manager-worker-2] WARN com.amazonaws.services.s3.internal.S3AbortableInputStream - Not all bytes were read from the S3ObjectInputStream, aborting HTTP connection. This is likely an error and may result in sub-optimal behavior. Request only the bytes you need via a ranged GET or drain the input stream after use. 2024-09-14T11:45:45.066 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-09-14 11:45:44,984 [s3-transfer-manager-worker-3] WARN com.amazonaws.services.s3.internal.S3AbortableInputStream - Not all bytes were read from the S3ObjectInputStream, aborting HTTP connection. This is likely an error and may result in sub-optimal behavior. Request only the bytes you need via a ranged GET or drain the input stream after use. 2024-09-14T11:45:45.066 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-09-14 11:45:45,019 [s3-transfer-manager-worker-4] WARN com.amazonaws.services.s3.internal.S3AbortableInputStream - Not all bytes were read from the S3ObjectInputStream, aborting HTTP connection. This is likely an error and may result in sub-optimal behavior. Request only the bytes you need via a ranged GET or drain the input stream after use. 2024-09-14T11:45:45.765 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-09-14T11:45:45.766 INFO:teuthology.orchestra.run.smithi138.stdout:suite > AWS4 tests > AWS4Test.testMultipartDownloadWithPauseHLAPIAWS4 PASSED 2024-09-14T11:45:47.566 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-09-14T11:45:47.566 INFO:teuthology.orchestra.run.smithi138.stdout:suite > AWS4 tests STANDARD_OUT 2024-09-14T11:45:47.566 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-09-14 11:45:47,533 [s3-transfer-manager-worker-8] WARN com.amazonaws.services.s3.internal.S3AbortableInputStream - Not all bytes were read from the S3ObjectInputStream, aborting HTTP connection. This is likely an error and may result in sub-optimal behavior. Request only the bytes you need via a ranged GET or drain the input stream after use. 2024-09-14T11:45:47.566 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-09-14 11:45:47,541 [s3-transfer-manager-worker-9] WARN com.amazonaws.services.s3.internal.S3AbortableInputStream - Not all bytes were read from the S3ObjectInputStream, aborting HTTP connection. This is likely an error and may result in sub-optimal behavior. Request only the bytes you need via a ranged GET or drain the input stream after use. 2024-09-14T11:45:48.265 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-09-14T11:45:48.265 INFO:teuthology.orchestra.run.smithi138.stdout:suite > AWS4 tests > AWS4Test.testMultipartUploadHLAPIAWS4 STARTED 2024-09-14T11:46:04.765 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-09-14T11:46:04.766 INFO:teuthology.orchestra.run.smithi138.stdout:suite > AWS4 tests > AWS4Test.testMultipartUploadHLAPIAWS4 PASSED 2024-09-14T11:46:05.965 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-09-14T11:46:05.965 INFO:teuthology.orchestra.run.smithi138.stdout:suite > AWS4 tests > AWS4Test.testMultipartUploadIncorrectMissingPartLLAPIAWS4 STARTED 2024-09-14T11:46:11.965 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-09-14T11:46:11.965 INFO:teuthology.orchestra.run.smithi138.stdout:suite > AWS4 tests > AWS4Test.testMultipartUploadIncorrectMissingPartLLAPIAWS4 PASSED 2024-09-14T11:46:12.965 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-09-14T11:46:12.965 INFO:teuthology.orchestra.run.smithi138.stdout:suite > AWS4 tests > AWS4Test.testMultipartUploadMultipleSizesLLAPIAWS4 STARTED 2024-09-14T11:48:45.165 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-09-14T11:48:45.166 INFO:teuthology.orchestra.run.smithi138.stdout:suite > AWS4 tests > AWS4Test.testMultipartUploadMultipleSizesLLAPIAWS4 PASSED 2024-09-14T11:48:46.064 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-09-14T11:48:46.064 INFO:teuthology.orchestra.run.smithi138.stdout:suite > AWS4 tests > AWS4Test.testMultipartUploadOverwriteExistingObjectLLAPIAWS4 STARTED 2024-09-14T11:49:11.464 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-09-14T11:49:11.464 INFO:teuthology.orchestra.run.smithi138.stdout:suite > AWS4 tests > AWS4Test.testMultipartUploadOverwriteExistingObjectLLAPIAWS4 PASSED 2024-09-14T11:49:12.364 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-09-14T11:49:12.364 INFO:teuthology.orchestra.run.smithi138.stdout:suite > AWS4 tests > AWS4Test.testMultipartUploadSmallLLAPIAWS4 STARTED 2024-09-14T11:49:24.164 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-09-14T11:49:24.165 INFO:teuthology.orchestra.run.smithi138.stdout:suite > AWS4 tests > AWS4Test.testMultipartUploadSmallLLAPIAWS4 PASSED 2024-09-14T11:49:24.964 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-09-14T11:49:24.964 INFO:teuthology.orchestra.run.smithi138.stdout:suite > AWS4 tests > AWS4Test.testMultipartUploadWithPauseAWS4 STARTED 2024-09-14T11:49:29.264 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-09-14T11:49:29.264 INFO:teuthology.orchestra.run.smithi138.stdout:suite > AWS4 tests > AWS4Test.testMultipartUploadWithPauseAWS4 PASSED 2024-09-14T11:49:51.664 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-09-14T11:49:51.664 INFO:teuthology.orchestra.run.smithi138.stdout:suite > AWS4 tests > AWS4Test.testObjectCreateBadDateAfterToday4AWS4 STARTED 2024-09-14T11:49:51.964 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-09-14T11:49:51.964 INFO:teuthology.orchestra.run.smithi138.stdout:suite > AWS4 tests > AWS4Test.testObjectCreateBadDateAfterToday4AWS4 PASSED 2024-09-14T11:49:52.864 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-09-14T11:49:52.864 INFO:teuthology.orchestra.run.smithi138.stdout:suite > AWS4 tests > AWS4Test.testObjectCreateBadDateBeforeEpochAWS4 STARTED 2024-09-14T11:49:53.064 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-09-14T11:49:53.064 INFO:teuthology.orchestra.run.smithi138.stdout:suite > AWS4 tests > AWS4Test.testObjectCreateBadDateBeforeEpochAWS4 PASSED 2024-09-14T11:49:53.964 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-09-14T11:49:53.965 INFO:teuthology.orchestra.run.smithi138.stdout:suite > AWS4 tests > AWS4Test.testObjectCreateBadDateBeforeToday4AWS4 STARTED 2024-09-14T11:49:54.164 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-09-14T11:49:54.164 INFO:teuthology.orchestra.run.smithi138.stdout:suite > AWS4 tests > AWS4Test.testObjectCreateBadDateBeforeToday4AWS4 PASSED 2024-09-14T11:49:55.164 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-09-14T11:49:55.164 INFO:teuthology.orchestra.run.smithi138.stdout:suite > AWS4 tests > AWS4Test.testObjectCreateBadDateEmptyAWS4 STARTED 2024-09-14T11:49:55.364 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-09-14T11:49:55.364 INFO:teuthology.orchestra.run.smithi138.stdout:suite > AWS4 tests > AWS4Test.testObjectCreateBadDateEmptyAWS4 PASSED 2024-09-14T11:49:56.264 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-09-14T11:49:56.264 INFO:teuthology.orchestra.run.smithi138.stdout:suite > AWS4 tests > AWS4Test.testObjectCreateBadDateInvalidAWS4 STARTED 2024-09-14T11:49:56.464 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-09-14T11:49:56.464 INFO:teuthology.orchestra.run.smithi138.stdout:suite > AWS4 tests > AWS4Test.testObjectCreateBadDateInvalidAWS4 PASSED 2024-09-14T11:49:57.364 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-09-14T11:49:57.364 INFO:teuthology.orchestra.run.smithi138.stdout:suite > AWS4 tests > AWS4Test.testObjectCreateBadDateNoneAWS4 STARTED 2024-09-14T11:49:57.564 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-09-14T11:49:57.565 INFO:teuthology.orchestra.run.smithi138.stdout:suite > AWS4 tests > AWS4Test.testObjectCreateBadDateNoneAWS4 PASSED 2024-09-14T11:49:58.464 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-09-14T11:49:58.464 INFO:teuthology.orchestra.run.smithi138.stdout:suite > AWS4 tests > AWS4Test.testObjectCreateBadMd5InvalidGarbageAWS4 STARTED 2024-09-14T11:49:58.764 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-09-14T11:49:58.764 INFO:teuthology.orchestra.run.smithi138.stdout:suite > AWS4 tests > AWS4Test.testObjectCreateBadMd5InvalidGarbageAWS4 PASSED 2024-09-14T11:49:59.564 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-09-14T11:49:59.564 INFO:teuthology.orchestra.run.smithi138.stdout:suite > AWS4 tests > AWS4Test.testUploadFileHLAPIBigFileAWS4 STARTED 2024-09-14T11:50:27.564 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-09-14T11:50:27.565 INFO:teuthology.orchestra.run.smithi138.stdout:suite > AWS4 tests > AWS4Test.testUploadFileHLAPIBigFileAWS4 PASSED 2024-09-14T11:50:28.564 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-09-14T11:50:28.564 INFO:teuthology.orchestra.run.smithi138.stdout:---------------------------------------------------------------------- 2024-09-14T11:50:28.564 INFO:teuthology.orchestra.run.smithi138.stdout:| Results: SUCCESS (26 tests, 26 successes, 0 failures, 0 skipped) | 2024-09-14T11:50:28.564 INFO:teuthology.orchestra.run.smithi138.stdout:---------------------------------------------------------------------- 2024-09-14T11:50:28.603 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-09-14T11:50:28.603 INFO:teuthology.orchestra.run.smithi138.stdout:Deprecated Gradle features were used in this build, making it incompatible with Gradle 7.0. 2024-09-14T11:50:28.603 INFO:teuthology.orchestra.run.smithi138.stdout:Use '--warning-mode all' to show the individual deprecation warnings. 2024-09-14T11:50:28.603 INFO:teuthology.orchestra.run.smithi138.stdout:See https://docs.gradle.org/6.0.1/userguide/command_line_interface.html#sec:command_line_warnings 2024-09-14T11:50:28.603 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-09-14T11:50:28.603 INFO:teuthology.orchestra.run.smithi138.stdout:BUILD SUCCESSFUL in 8m 1s 2024-09-14T11:50:28.604 INFO:teuthology.orchestra.run.smithi138.stdout:5 actionable tasks: 4 executed, 1 up-to-date 2024-09-14T11:50:28.932 DEBUG:teuthology.orchestra.run.smithi138:> radosgw-admin gc process --include-all 2024-09-14T11:50:28.964 INFO:teuthology.orchestra.run.smithi138.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:50:28.964 INFO:teuthology.orchestra.run.smithi138.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:50:29.010 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:29.012+0000 7ff9842539c0 20 rados->read ofs=0 len=0 2024-09-14T11:50:29.012 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:29.016+0000 7ff9842539c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:50:29.012 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:29.016+0000 7ff9842539c0 20 realm 2024-09-14T11:50:29.012 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:29.016+0000 7ff9842539c0 20 rados->read ofs=0 len=0 2024-09-14T11:50:29.012 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:29.016+0000 7ff9842539c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:50:29.012 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:29.016+0000 7ff9842539c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:50:29.012 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:29.016+0000 7ff9842539c0 20 rados->read ofs=0 len=0 2024-09-14T11:50:29.013 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:29.016+0000 7ff9842539c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:50:29.013 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:29.016+0000 7ff9842539c0 20 rados->read ofs=0 len=0 2024-09-14T11:50:29.014 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:29.016+0000 7ff9842539c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:50:29.014 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:29.016+0000 7ff9842539c0 20 rados->read ofs=0 len=0 2024-09-14T11:50:29.015 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:29.020+0000 7ff9842539c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:50:29.015 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:29.020+0000 7ff9842539c0 20 searching for the correct realm 2024-09-14T11:50:29.018 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:29.020+0000 7ff98255a640 0 -- 172.21.15.138:0/1137033349 >> [v2:172.21.15.154:6824/416768175,v1:172.21.15.154:6825/416768175] conn(0x7ff97c0749a0 msgr2=0x7ff97c05df70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-14T11:50:29.232 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:29.236+0000 7ff981558640 0 -- 172.21.15.138:0/1137033349 >> [v2:172.21.15.138:6816/326481658,v1:172.21.15.138:6817/326481658] conn(0x7ff97c091040 msgr2=0x7ff97c07a970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:50:29.450 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:29.452+0000 7ff9842539c0 20 RGWRados::pool_iterate: got zone_info.d9e72d30-c60b-4d0d-9267-fdc36392d5ad 2024-09-14T11:50:29.450 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:29.452+0000 7ff9842539c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:50:29.450 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:29.452+0000 7ff9842539c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:50:29.450 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:29.452+0000 7ff9842539c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:50:29.450 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:29.452+0000 7ff9842539c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:50:29.450 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:29.452+0000 7ff9842539c0 20 RGWRados::pool_iterate: got zonegroup_info.65ab941b-da8c-4160-94fb-3672b069d44f 2024-09-14T11:50:29.451 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:29.452+0000 7ff9842539c0 20 rados->read ofs=0 len=0 2024-09-14T11:50:29.451 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:29.452+0000 7ff9842539c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:50:29.451 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:29.452+0000 7ff9842539c0 20 rados->read ofs=0 len=0 2024-09-14T11:50:29.451 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:29.456+0000 7ff9842539c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:50:29.451 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:29.456+0000 7ff9842539c0 20 rados->read ofs=0 len=0 2024-09-14T11:50:29.452 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:29.456+0000 7ff9842539c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:50:29.452 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:29.456+0000 7ff9842539c0 20 zone default found 2024-09-14T11:50:29.453 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:29.456+0000 7ff9842539c0 4 Realm: () 2024-09-14T11:50:29.453 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:29.456+0000 7ff9842539c0 4 ZoneGroup: default (65ab941b-da8c-4160-94fb-3672b069d44f) 2024-09-14T11:50:29.453 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:29.456+0000 7ff9842539c0 4 Zone: default (d9e72d30-c60b-4d0d-9267-fdc36392d5ad) 2024-09-14T11:50:29.453 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:29.456+0000 7ff9842539c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:50:29.453 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:29.456+0000 7ff9842539c0 20 zonegroup default 2024-09-14T11:50:29.453 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:29.456+0000 7ff9842539c0 20 rados->read ofs=0 len=0 2024-09-14T11:50:29.453 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:29.456+0000 7ff9842539c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:50:29.453 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:29.456+0000 7ff9842539c0 20 rados->read ofs=0 len=0 2024-09-14T11:50:29.454 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:29.456+0000 7ff9842539c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:50:29.454 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:29.456+0000 7ff9842539c0 20 rados->read ofs=0 len=0 2024-09-14T11:50:29.455 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:29.460+0000 7ff9842539c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:50:29.455 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:29.460+0000 7ff9842539c0 20 started sync module instance, tier type = 2024-09-14T11:50:29.455 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:29.460+0000 7ff9842539c0 20 started zone id=d9e72d30-c60b-4d0d-9267-fdc36392d5ad (name=default) with tier type = 2024-09-14T11:50:29.479 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:29.484+0000 7ff9842539c0 20 add_watcher() i=0 2024-09-14T11:50:29.479 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:29.484+0000 7ff9842539c0 20 add_watcher() i=1 2024-09-14T11:50:29.479 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:29.484+0000 7ff9842539c0 20 add_watcher() i=2 2024-09-14T11:50:29.479 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:29.484+0000 7ff9842539c0 20 add_watcher() i=3 2024-09-14T11:50:29.479 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:29.484+0000 7ff9842539c0 20 add_watcher() i=4 2024-09-14T11:50:29.479 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:29.484+0000 7ff9842539c0 20 add_watcher() i=5 2024-09-14T11:50:29.479 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:29.484+0000 7ff9842539c0 20 add_watcher() i=6 2024-09-14T11:50:29.481 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:29.484+0000 7ff9842539c0 20 add_watcher() i=7 2024-09-14T11:50:29.481 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:29.484+0000 7ff9842539c0 2 all 8 watchers are set, enabling cache 2024-09-14T11:50:29.485 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:29.488+0000 7ff8337fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:50:29.486 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:29.488+0000 7ff9842539c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:50:29.486 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:29.488+0000 7ff9842539c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:50:29.580 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:29.584+0000 7ff8327fc640 20 reqs_thread_entry: start 2024-09-14T11:50:29.581 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:29.584+0000 7ff9842539c0 20 init_complete bucket index max shards: 11 2024-09-14T11:50:29.581 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:29.584+0000 7ff9842539c0 20 Filter name: none 2024-09-14T11:50:29.581 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:29.584+0000 7ff7a3fff640 20 reqs_thread_entry: start 2024-09-14T11:50:29.581 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:29.584+0000 7ff9842539c0 20 garbage collection: RGWGC::process entered with GC index_shard=5, max_secs=3600, expired_only=0 2024-09-14T11:50:29.584 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:29.588+0000 7ff9842539c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:50:29.585 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:29.588+0000 7ff9842539c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:50:29.587 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:29.588+0000 7ff9842539c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=3, truncated=0, next_marker='' 2024-09-14T11:50:29.587 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:29.588+0000 7ff9842539c0 20 garbage collection: RGWGC::process iterating over entry tag='d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.14376849993260226555', time=2024-09-14T13:43:48.308680+0000, chain.objs.size()=9 2024-09-14T11:50:29.587 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:29.588+0000 7ff9842539c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.44__multipart_key1.2~pkZ2M4SVLB2G2vs1JGdJ_SIovKCpfvp.1 2024-09-14T11:50:29.587 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:29.588+0000 7ff9842539c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.44__shadow_key1.2~pkZ2M4SVLB2G2vs1JGdJ_SIovKCpfvp.1_1 2024-09-14T11:50:29.587 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:29.588+0000 7ff9842539c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.44__multipart_key1.2~pkZ2M4SVLB2G2vs1JGdJ_SIovKCpfvp.2 2024-09-14T11:50:29.588 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:29.588+0000 7ff9842539c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.44__shadow_key1.2~pkZ2M4SVLB2G2vs1JGdJ_SIovKCpfvp.2_1 2024-09-14T11:50:29.588 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:29.588+0000 7ff9842539c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.44__multipart_key1.2~pkZ2M4SVLB2G2vs1JGdJ_SIovKCpfvp.3 2024-09-14T11:50:29.588 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:29.592+0000 7ff9842539c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.44__shadow_key1.2~pkZ2M4SVLB2G2vs1JGdJ_SIovKCpfvp.3_1 2024-09-14T11:50:29.588 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:29.592+0000 7ff9842539c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.44__multipart_key1.2~pkZ2M4SVLB2G2vs1JGdJ_SIovKCpfvp.4 2024-09-14T11:50:29.588 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:29.592+0000 7ff9842539c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.44__shadow_key1.2~pkZ2M4SVLB2G2vs1JGdJ_SIovKCpfvp.4_1 2024-09-14T11:50:29.588 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:29.592+0000 7ff9842539c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.44__multipart_key1.2~pkZ2M4SVLB2G2vs1JGdJ_SIovKCpfvp.5 2024-09-14T11:50:29.588 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:29.592+0000 7ff9842539c0 20 garbage collection: RGWGC::process iterating over entry tag='d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.16325946463705185630', time=2024-09-14T13:45:47.135063+0000, chain.objs.size()=9 2024-09-14T11:50:29.588 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:29.592+0000 7ff9842539c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.52__multipart_key1.2~eJoABawzD5rhbHKYc--FnJvB56oHrsG.1 2024-09-14T11:50:29.588 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:29.592+0000 7ff9842539c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.52__shadow_key1.2~eJoABawzD5rhbHKYc--FnJvB56oHrsG.1_1 2024-09-14T11:50:29.588 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:29.592+0000 7ff9842539c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.52__multipart_key1.2~eJoABawzD5rhbHKYc--FnJvB56oHrsG.2 2024-09-14T11:50:29.595 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:29.600+0000 7ff9842539c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.52__shadow_key1.2~eJoABawzD5rhbHKYc--FnJvB56oHrsG.2_1 2024-09-14T11:50:29.595 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:29.600+0000 7ff9842539c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.52__multipart_key1.2~eJoABawzD5rhbHKYc--FnJvB56oHrsG.3 2024-09-14T11:50:29.595 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:29.600+0000 7ff9842539c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.52__shadow_key1.2~eJoABawzD5rhbHKYc--FnJvB56oHrsG.3_1 2024-09-14T11:50:29.598 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:29.600+0000 7ff9842539c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.52__multipart_key1.2~eJoABawzD5rhbHKYc--FnJvB56oHrsG.4 2024-09-14T11:50:29.598 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:29.600+0000 7ff9842539c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.52__shadow_key1.2~eJoABawzD5rhbHKYc--FnJvB56oHrsG.4_1 2024-09-14T11:50:29.598 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:29.600+0000 7ff9842539c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.52__multipart_key1.2~eJoABawzD5rhbHKYc--FnJvB56oHrsG.5 2024-09-14T11:50:29.598 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:29.600+0000 7ff9842539c0 20 garbage collection: RGWGC::process iterating over entry tag='d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.17267753261695349530', time=2024-09-14T13:48:45.429742+0000, chain.objs.size()=16 2024-09-14T11:50:29.598 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:29.600+0000 7ff9842539c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.55__multipart_key1.2~7cSXs9-i3mghz07gmzApN904g7ZDRqT.1 2024-09-14T11:50:29.598 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:29.600+0000 7ff9842539c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.55__shadow_key1.2~7cSXs9-i3mghz07gmzApN904g7ZDRqT.1_1 2024-09-14T11:50:29.598 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:29.600+0000 7ff9842539c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.55__shadow_key1.2~7cSXs9-i3mghz07gmzApN904g7ZDRqT.1_2 2024-09-14T11:50:29.599 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:29.600+0000 7ff9842539c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.55__multipart_key1.2~7cSXs9-i3mghz07gmzApN904g7ZDRqT.2 2024-09-14T11:50:29.599 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:29.600+0000 7ff9842539c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.55__shadow_key1.2~7cSXs9-i3mghz07gmzApN904g7ZDRqT.2_1 2024-09-14T11:50:29.604 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:29.608+0000 7ff9842539c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.55__shadow_key1.2~7cSXs9-i3mghz07gmzApN904g7ZDRqT.2_2 2024-09-14T11:50:29.604 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:29.608+0000 7ff9842539c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.55__multipart_key1.2~7cSXs9-i3mghz07gmzApN904g7ZDRqT.3 2024-09-14T11:50:29.610 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:29.612+0000 7ff9842539c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.55__shadow_key1.2~7cSXs9-i3mghz07gmzApN904g7ZDRqT.3_1 2024-09-14T11:50:29.610 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:29.612+0000 7ff9842539c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.55__shadow_key1.2~7cSXs9-i3mghz07gmzApN904g7ZDRqT.3_2 2024-09-14T11:50:29.610 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:29.612+0000 7ff9842539c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.55__multipart_key1.2~7cSXs9-i3mghz07gmzApN904g7ZDRqT.4 2024-09-14T11:50:29.610 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:29.612+0000 7ff9842539c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.55__shadow_key1.2~7cSXs9-i3mghz07gmzApN904g7ZDRqT.4_1 2024-09-14T11:50:29.610 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:29.612+0000 7ff9842539c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.55__shadow_key1.2~7cSXs9-i3mghz07gmzApN904g7ZDRqT.4_2 2024-09-14T11:50:29.611 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:29.616+0000 7ff9842539c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.55__multipart_key1.2~7cSXs9-i3mghz07gmzApN904g7ZDRqT.5 2024-09-14T11:50:29.611 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:29.616+0000 7ff9842539c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.55__shadow_key1.2~7cSXs9-i3mghz07gmzApN904g7ZDRqT.5_1 2024-09-14T11:50:29.618 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:29.620+0000 7ff9842539c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.55__shadow_key1.2~7cSXs9-i3mghz07gmzApN904g7ZDRqT.5_2 2024-09-14T11:50:29.618 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:29.620+0000 7ff9842539c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.55__multipart_key1.2~7cSXs9-i3mghz07gmzApN904g7ZDRqT.6 2024-09-14T11:50:29.626 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:29.628+0000 7ff9842539c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T11:50:29.631 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:29.636+0000 7ff9842539c0 20 garbage collection: RGWGC::process entered with GC index_shard=6, max_secs=3600, expired_only=0 2024-09-14T11:50:29.633 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:29.636+0000 7ff9842539c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:50:29.635 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:29.640+0000 7ff9842539c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:50:29.635 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:29.640+0000 7ff9842539c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:50:29.637 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:29.640+0000 7ff9842539c0 20 garbage collection: RGWGC::process entered with GC index_shard=7, max_secs=3600, expired_only=0 2024-09-14T11:50:29.640 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:29.644+0000 7ff9842539c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:50:29.640 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:29.644+0000 7ff9842539c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:50:29.642 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:29.644+0000 7ff9842539c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=3, truncated=0, next_marker='' 2024-09-14T11:50:29.642 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:29.644+0000 7ff9842539c0 20 garbage collection: RGWGC::process iterating over entry tag='d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.7171944384510128195', time=2024-09-14T13:44:57.664373+0000, chain.objs.size()=7 2024-09-14T11:50:29.642 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:29.644+0000 7ff9842539c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.47__multipart_key1.2~3YcNvH-aLdQWAqKGUaX0EIMJFwOvtqr.1 2024-09-14T11:50:29.642 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:29.644+0000 7ff9842539c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.47__shadow_key1.2~3YcNvH-aLdQWAqKGUaX0EIMJFwOvtqr.1_1 2024-09-14T11:50:29.642 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:29.644+0000 7ff9842539c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.47__shadow_key1.2~3YcNvH-aLdQWAqKGUaX0EIMJFwOvtqr.1_2 2024-09-14T11:50:29.643 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:29.644+0000 7ff9842539c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.47__multipart_key1.2~3YcNvH-aLdQWAqKGUaX0EIMJFwOvtqr.2 2024-09-14T11:50:29.643 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:29.644+0000 7ff9842539c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.47__shadow_key1.2~3YcNvH-aLdQWAqKGUaX0EIMJFwOvtqr.2_1 2024-09-14T11:50:29.643 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:29.644+0000 7ff9842539c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.47__shadow_key1.2~3YcNvH-aLdQWAqKGUaX0EIMJFwOvtqr.2_2 2024-09-14T11:50:29.643 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:29.644+0000 7ff9842539c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.47__multipart_key1.2~3YcNvH-aLdQWAqKGUaX0EIMJFwOvtqr.3 2024-09-14T11:50:29.643 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:29.644+0000 7ff9842539c0 20 garbage collection: RGWGC::process iterating over entry tag='d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.17965845142445638454', time=2024-09-14T13:46:04.968834+0000, chain.objs.size()=9 2024-09-14T11:50:29.643 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:29.644+0000 7ff9842539c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.53__multipart_file.mpg.2~JvA0s6wzfNl-0ulUGBEHlQ433e8eUPB.1 2024-09-14T11:50:29.643 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:29.644+0000 7ff9842539c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.53__shadow_file.mpg.2~JvA0s6wzfNl-0ulUGBEHlQ433e8eUPB.1_1 2024-09-14T11:50:29.643 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:29.644+0000 7ff9842539c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.53__multipart_file.mpg.2~JvA0s6wzfNl-0ulUGBEHlQ433e8eUPB.2 2024-09-14T11:50:29.643 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:29.644+0000 7ff9842539c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.53__shadow_file.mpg.2~JvA0s6wzfNl-0ulUGBEHlQ433e8eUPB.2_1 2024-09-14T11:50:29.643 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:29.644+0000 7ff9842539c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.53__multipart_file.mpg.2~JvA0s6wzfNl-0ulUGBEHlQ433e8eUPB.3 2024-09-14T11:50:29.648 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:29.652+0000 7ff9842539c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.53__shadow_file.mpg.2~JvA0s6wzfNl-0ulUGBEHlQ433e8eUPB.3_1 2024-09-14T11:50:29.649 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:29.652+0000 7ff9842539c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.53__multipart_file.mpg.2~JvA0s6wzfNl-0ulUGBEHlQ433e8eUPB.4 2024-09-14T11:50:29.649 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:29.652+0000 7ff9842539c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.53__shadow_file.mpg.2~JvA0s6wzfNl-0ulUGBEHlQ433e8eUPB.4_1 2024-09-14T11:50:29.653 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:29.656+0000 7ff9842539c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.53__multipart_file.mpg.2~JvA0s6wzfNl-0ulUGBEHlQ433e8eUPB.5 2024-09-14T11:50:29.653 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:29.656+0000 7ff9842539c0 20 garbage collection: RGWGC::process iterating over entry tag='d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.9368516597396016952', time=2024-09-14T13:48:20.274802+0000, chain.objs.size()=16 2024-09-14T11:50:29.654 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:29.656+0000 7ff9842539c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.55__multipart_key1.2~6A7Y54qNgYem3J2Mx87ArVUKuM4P1fT.1 2024-09-14T11:50:29.654 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:29.656+0000 7ff9842539c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.55__shadow_key1.2~6A7Y54qNgYem3J2Mx87ArVUKuM4P1fT.1_1 2024-09-14T11:50:29.654 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:29.656+0000 7ff9842539c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.55__shadow_key1.2~6A7Y54qNgYem3J2Mx87ArVUKuM4P1fT.1_2 2024-09-14T11:50:29.654 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:29.656+0000 7ff9842539c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.55__multipart_key1.2~6A7Y54qNgYem3J2Mx87ArVUKuM4P1fT.2 2024-09-14T11:50:29.654 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:29.656+0000 7ff9842539c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.55__shadow_key1.2~6A7Y54qNgYem3J2Mx87ArVUKuM4P1fT.2_1 2024-09-14T11:50:29.654 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:29.656+0000 7ff9842539c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.55__shadow_key1.2~6A7Y54qNgYem3J2Mx87ArVUKuM4P1fT.2_2 2024-09-14T11:50:29.655 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:29.656+0000 7ff9842539c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.55__multipart_key1.2~6A7Y54qNgYem3J2Mx87ArVUKuM4P1fT.3 2024-09-14T11:50:29.655 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:29.660+0000 7ff9842539c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.55__shadow_key1.2~6A7Y54qNgYem3J2Mx87ArVUKuM4P1fT.3_1 2024-09-14T11:50:29.656 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:29.660+0000 7ff9842539c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.55__shadow_key1.2~6A7Y54qNgYem3J2Mx87ArVUKuM4P1fT.3_2 2024-09-14T11:50:29.656 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:29.660+0000 7ff9842539c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.55__multipart_key1.2~6A7Y54qNgYem3J2Mx87ArVUKuM4P1fT.4 2024-09-14T11:50:29.662 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:29.664+0000 7ff9842539c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.55__shadow_key1.2~6A7Y54qNgYem3J2Mx87ArVUKuM4P1fT.4_1 2024-09-14T11:50:29.663 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:29.664+0000 7ff9842539c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.55__shadow_key1.2~6A7Y54qNgYem3J2Mx87ArVUKuM4P1fT.4_2 2024-09-14T11:50:29.663 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:29.668+0000 7ff9842539c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.55__multipart_key1.2~6A7Y54qNgYem3J2Mx87ArVUKuM4P1fT.5 2024-09-14T11:50:29.665 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:29.668+0000 7ff9842539c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.55__shadow_key1.2~6A7Y54qNgYem3J2Mx87ArVUKuM4P1fT.5_1 2024-09-14T11:50:29.665 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:29.668+0000 7ff9842539c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.55__shadow_key1.2~6A7Y54qNgYem3J2Mx87ArVUKuM4P1fT.5_2 2024-09-14T11:50:29.666 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:29.668+0000 7ff9842539c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.55__multipart_key1.2~6A7Y54qNgYem3J2Mx87ArVUKuM4P1fT.6 2024-09-14T11:50:29.675 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:29.680+0000 7ff9842539c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T11:50:29.679 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:29.684+0000 7ff9842539c0 20 garbage collection: RGWGC::process entered with GC index_shard=8, max_secs=3600, expired_only=0 2024-09-14T11:50:29.682 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:29.684+0000 7ff9842539c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:50:29.683 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:29.688+0000 7ff9842539c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:50:29.684 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:29.688+0000 7ff9842539c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2024-09-14T11:50:29.684 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:29.688+0000 7ff9842539c0 20 garbage collection: RGWGC::process iterating over entry tag='d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.7360423968732606344', time=2024-09-14T13:49:24.366758+0000, chain.objs.size()=9 2024-09-14T11:50:29.684 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:29.688+0000 7ff9842539c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.57__multipart_key1.2~mdP6TiEXoNZKNrht5LlrGFxedcVkupf.1 2024-09-14T11:50:29.684 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:29.688+0000 7ff9842539c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.57__shadow_key1.2~mdP6TiEXoNZKNrht5LlrGFxedcVkupf.1_1 2024-09-14T11:50:29.684 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:29.688+0000 7ff9842539c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.57__multipart_key1.2~mdP6TiEXoNZKNrht5LlrGFxedcVkupf.2 2024-09-14T11:50:29.684 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:29.688+0000 7ff9842539c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.57__shadow_key1.2~mdP6TiEXoNZKNrht5LlrGFxedcVkupf.2_1 2024-09-14T11:50:29.684 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:29.688+0000 7ff9842539c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.57__multipart_key1.2~mdP6TiEXoNZKNrht5LlrGFxedcVkupf.3 2024-09-14T11:50:29.684 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:29.688+0000 7ff9842539c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.57__shadow_key1.2~mdP6TiEXoNZKNrht5LlrGFxedcVkupf.3_1 2024-09-14T11:50:29.684 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:29.688+0000 7ff9842539c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.57__multipart_key1.2~mdP6TiEXoNZKNrht5LlrGFxedcVkupf.4 2024-09-14T11:50:29.684 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:29.688+0000 7ff9842539c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.57__shadow_key1.2~mdP6TiEXoNZKNrht5LlrGFxedcVkupf.4_1 2024-09-14T11:50:29.684 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:29.688+0000 7ff9842539c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.57__multipart_key1.2~mdP6TiEXoNZKNrht5LlrGFxedcVkupf.5 2024-09-14T11:50:29.693 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:29.696+0000 7ff9842539c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T11:50:29.697 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:29.700+0000 7ff9842539c0 20 garbage collection: RGWGC::process entered with GC index_shard=9, max_secs=3600, expired_only=0 2024-09-14T11:50:29.700 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:29.704+0000 7ff9842539c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:50:29.701 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:29.704+0000 7ff9842539c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:50:29.703 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:29.704+0000 7ff9842539c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2024-09-14T11:50:29.703 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:29.704+0000 7ff9842539c0 20 garbage collection: RGWGC::process iterating over entry tag='d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.15837502184371412114', time=2024-09-14T13:49:11.587307+0000, chain.objs.size()=9 2024-09-14T11:50:29.703 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:29.704+0000 7ff9842539c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.56__multipart_key1.2~huQL22uOZb3QEns1Q37M0ksNfoBzyOx.1 2024-09-14T11:50:29.703 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:29.704+0000 7ff9842539c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.56__shadow_key1.2~huQL22uOZb3QEns1Q37M0ksNfoBzyOx.1_1 2024-09-14T11:50:29.703 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:29.704+0000 7ff9842539c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.56__multipart_key1.2~huQL22uOZb3QEns1Q37M0ksNfoBzyOx.2 2024-09-14T11:50:29.703 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:29.704+0000 7ff9842539c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.56__shadow_key1.2~huQL22uOZb3QEns1Q37M0ksNfoBzyOx.2_1 2024-09-14T11:50:29.703 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:29.704+0000 7ff9842539c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.56__multipart_key1.2~huQL22uOZb3QEns1Q37M0ksNfoBzyOx.3 2024-09-14T11:50:29.703 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:29.704+0000 7ff9842539c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.56__shadow_key1.2~huQL22uOZb3QEns1Q37M0ksNfoBzyOx.3_1 2024-09-14T11:50:29.703 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:29.704+0000 7ff9842539c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.56__multipart_key1.2~huQL22uOZb3QEns1Q37M0ksNfoBzyOx.4 2024-09-14T11:50:29.703 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:29.704+0000 7ff9842539c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.56__shadow_key1.2~huQL22uOZb3QEns1Q37M0ksNfoBzyOx.4_1 2024-09-14T11:50:29.703 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:29.704+0000 7ff9842539c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.56__multipart_key1.2~huQL22uOZb3QEns1Q37M0ksNfoBzyOx.5 2024-09-14T11:50:29.710 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:29.712+0000 7ff9842539c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T11:50:29.715 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:29.720+0000 7ff9842539c0 20 garbage collection: RGWGC::process entered with GC index_shard=10, max_secs=3600, expired_only=0 2024-09-14T11:50:29.717 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:29.720+0000 7ff9842539c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:50:29.718 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:29.720+0000 7ff9842539c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:50:29.718 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:29.720+0000 7ff9842539c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:50:29.720 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:29.724+0000 7ff9842539c0 20 garbage collection: RGWGC::process entered with GC index_shard=11, max_secs=3600, expired_only=0 2024-09-14T11:50:29.722 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:29.724+0000 7ff9842539c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:50:29.722 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:29.724+0000 7ff9842539c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:50:29.724 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:29.728+0000 7ff9842539c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=3, truncated=0, next_marker='' 2024-09-14T11:50:29.724 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:29.728+0000 7ff9842539c0 20 garbage collection: RGWGC::process iterating over entry tag='d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.3397765907530244943', time=2024-09-14T13:44:38.520002+0000, chain.objs.size()=9 2024-09-14T11:50:29.724 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:29.728+0000 7ff9842539c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.47__multipart_key1.2~MGI0h7xiKEsIk6WA4P7xAlCKeBFrZ9s.1 2024-09-14T11:50:29.724 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:29.728+0000 7ff9842539c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.47__shadow_key1.2~MGI0h7xiKEsIk6WA4P7xAlCKeBFrZ9s.1_1 2024-09-14T11:50:29.724 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:29.728+0000 7ff9842539c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.47__multipart_key1.2~MGI0h7xiKEsIk6WA4P7xAlCKeBFrZ9s.2 2024-09-14T11:50:29.724 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:29.728+0000 7ff9842539c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.47__shadow_key1.2~MGI0h7xiKEsIk6WA4P7xAlCKeBFrZ9s.2_1 2024-09-14T11:50:29.724 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:29.728+0000 7ff9842539c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.47__multipart_key1.2~MGI0h7xiKEsIk6WA4P7xAlCKeBFrZ9s.3 2024-09-14T11:50:29.724 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:29.728+0000 7ff9842539c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.47__shadow_key1.2~MGI0h7xiKEsIk6WA4P7xAlCKeBFrZ9s.3_1 2024-09-14T11:50:29.724 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:29.728+0000 7ff9842539c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.47__multipart_key1.2~MGI0h7xiKEsIk6WA4P7xAlCKeBFrZ9s.4 2024-09-14T11:50:29.724 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:29.728+0000 7ff9842539c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.47__shadow_key1.2~MGI0h7xiKEsIk6WA4P7xAlCKeBFrZ9s.4_1 2024-09-14T11:50:29.724 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:29.728+0000 7ff9842539c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.47__multipart_key1.2~MGI0h7xiKEsIk6WA4P7xAlCKeBFrZ9s.5 2024-09-14T11:50:29.724 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:29.728+0000 7ff9842539c0 20 garbage collection: RGWGC::process iterating over entry tag='d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.15342571360591461483', time=2024-09-14T13:47:30.632879+0000, chain.objs.size()=21 2024-09-14T11:50:29.725 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:29.728+0000 7ff9842539c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.55__multipart_key1.2~cJm-F262gkEaypa5RK34n_4mQqu9Coq.1 2024-09-14T11:50:29.725 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:29.728+0000 7ff9842539c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.55__shadow_key1.2~cJm-F262gkEaypa5RK34n_4mQqu9Coq.1_1 2024-09-14T11:50:29.725 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:29.728+0000 7ff9842539c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.55__multipart_key1.2~cJm-F262gkEaypa5RK34n_4mQqu9Coq.2 2024-09-14T11:50:29.728 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:29.732+0000 7ff9842539c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.55__shadow_key1.2~cJm-F262gkEaypa5RK34n_4mQqu9Coq.2_1 2024-09-14T11:50:29.728 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:29.732+0000 7ff9842539c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.55__multipart_key1.2~cJm-F262gkEaypa5RK34n_4mQqu9Coq.3 2024-09-14T11:50:29.728 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:29.732+0000 7ff9842539c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.55__shadow_key1.2~cJm-F262gkEaypa5RK34n_4mQqu9Coq.3_1 2024-09-14T11:50:29.734 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:29.736+0000 7ff9842539c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.55__multipart_key1.2~cJm-F262gkEaypa5RK34n_4mQqu9Coq.4 2024-09-14T11:50:29.734 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:29.736+0000 7ff9842539c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.55__shadow_key1.2~cJm-F262gkEaypa5RK34n_4mQqu9Coq.4_1 2024-09-14T11:50:29.734 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:29.736+0000 7ff9842539c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.55__multipart_key1.2~cJm-F262gkEaypa5RK34n_4mQqu9Coq.5 2024-09-14T11:50:29.734 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:29.736+0000 7ff9842539c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.55__shadow_key1.2~cJm-F262gkEaypa5RK34n_4mQqu9Coq.5_1 2024-09-14T11:50:29.734 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:29.736+0000 7ff9842539c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.55__multipart_key1.2~cJm-F262gkEaypa5RK34n_4mQqu9Coq.6 2024-09-14T11:50:29.734 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:29.736+0000 7ff9842539c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.55__shadow_key1.2~cJm-F262gkEaypa5RK34n_4mQqu9Coq.6_1 2024-09-14T11:50:29.734 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:29.736+0000 7ff9842539c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.55__multipart_key1.2~cJm-F262gkEaypa5RK34n_4mQqu9Coq.7 2024-09-14T11:50:29.734 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:29.736+0000 7ff9842539c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.55__shadow_key1.2~cJm-F262gkEaypa5RK34n_4mQqu9Coq.7_1 2024-09-14T11:50:29.737 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:29.740+0000 7ff9842539c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.55__multipart_key1.2~cJm-F262gkEaypa5RK34n_4mQqu9Coq.8 2024-09-14T11:50:29.737 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:29.740+0000 7ff9842539c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.55__shadow_key1.2~cJm-F262gkEaypa5RK34n_4mQqu9Coq.8_1 2024-09-14T11:50:29.737 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:29.740+0000 7ff9842539c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.55__multipart_key1.2~cJm-F262gkEaypa5RK34n_4mQqu9Coq.9 2024-09-14T11:50:29.742 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:29.744+0000 7ff9842539c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.55__shadow_key1.2~cJm-F262gkEaypa5RK34n_4mQqu9Coq.9_1 2024-09-14T11:50:29.742 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:29.744+0000 7ff9842539c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.55__multipart_key1.2~cJm-F262gkEaypa5RK34n_4mQqu9Coq.10 2024-09-14T11:50:29.742 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:29.744+0000 7ff9842539c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.55__shadow_key1.2~cJm-F262gkEaypa5RK34n_4mQqu9Coq.10_1 2024-09-14T11:50:29.742 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:29.744+0000 7ff9842539c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.55__multipart_key1.2~cJm-F262gkEaypa5RK34n_4mQqu9Coq.11 2024-09-14T11:50:29.742 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:29.744+0000 7ff9842539c0 20 garbage collection: RGWGC::process iterating over entry tag='d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.2671198172918945454', time=2024-09-14T13:47:55.317589+0000, chain.objs.size()=19 2024-09-14T11:50:29.742 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:29.744+0000 7ff9842539c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.55__multipart_key1.2~GMzBuO9wbTl99VqbUYuIE7NEkfaJbbs.1 2024-09-14T11:50:29.742 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:29.744+0000 7ff9842539c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.55__shadow_key1.2~GMzBuO9wbTl99VqbUYuIE7NEkfaJbbs.1_1 2024-09-14T11:50:29.743 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:29.748+0000 7ff9842539c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.55__multipart_key1.2~GMzBuO9wbTl99VqbUYuIE7NEkfaJbbs.2 2024-09-14T11:50:29.743 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:29.748+0000 7ff9842539c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.55__shadow_key1.2~GMzBuO9wbTl99VqbUYuIE7NEkfaJbbs.2_1 2024-09-14T11:50:29.743 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:29.748+0000 7ff9842539c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.55__multipart_key1.2~GMzBuO9wbTl99VqbUYuIE7NEkfaJbbs.3 2024-09-14T11:50:29.744 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:29.748+0000 7ff9842539c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.55__shadow_key1.2~GMzBuO9wbTl99VqbUYuIE7NEkfaJbbs.3_1 2024-09-14T11:50:29.744 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:29.748+0000 7ff9842539c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.55__multipart_key1.2~GMzBuO9wbTl99VqbUYuIE7NEkfaJbbs.4 2024-09-14T11:50:29.747 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:29.752+0000 7ff9842539c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.55__shadow_key1.2~GMzBuO9wbTl99VqbUYuIE7NEkfaJbbs.4_1 2024-09-14T11:50:29.747 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:29.752+0000 7ff9842539c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.55__multipart_key1.2~GMzBuO9wbTl99VqbUYuIE7NEkfaJbbs.5 2024-09-14T11:50:29.750 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:29.752+0000 7ff9842539c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.55__shadow_key1.2~GMzBuO9wbTl99VqbUYuIE7NEkfaJbbs.5_1 2024-09-14T11:50:29.750 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:29.752+0000 7ff9842539c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.55__multipart_key1.2~GMzBuO9wbTl99VqbUYuIE7NEkfaJbbs.6 2024-09-14T11:50:29.750 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:29.752+0000 7ff9842539c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.55__shadow_key1.2~GMzBuO9wbTl99VqbUYuIE7NEkfaJbbs.6_1 2024-09-14T11:50:29.750 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:29.752+0000 7ff9842539c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.55__multipart_key1.2~GMzBuO9wbTl99VqbUYuIE7NEkfaJbbs.7 2024-09-14T11:50:29.750 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:29.752+0000 7ff9842539c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.55__shadow_key1.2~GMzBuO9wbTl99VqbUYuIE7NEkfaJbbs.7_1 2024-09-14T11:50:29.750 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:29.752+0000 7ff9842539c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.55__multipart_key1.2~GMzBuO9wbTl99VqbUYuIE7NEkfaJbbs.8 2024-09-14T11:50:29.750 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:29.752+0000 7ff9842539c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.55__shadow_key1.2~GMzBuO9wbTl99VqbUYuIE7NEkfaJbbs.8_1 2024-09-14T11:50:29.751 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:29.756+0000 7ff9842539c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.55__multipart_key1.2~GMzBuO9wbTl99VqbUYuIE7NEkfaJbbs.9 2024-09-14T11:50:29.751 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:29.756+0000 7ff9842539c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.55__shadow_key1.2~GMzBuO9wbTl99VqbUYuIE7NEkfaJbbs.9_1 2024-09-14T11:50:29.754 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:29.756+0000 7ff9842539c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.55__multipart_key1.2~GMzBuO9wbTl99VqbUYuIE7NEkfaJbbs.10 2024-09-14T11:50:29.758 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:29.760+0000 7ff9842539c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T11:50:29.761 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:29.764+0000 7ff9842539c0 20 garbage collection: RGWGC::process entered with GC index_shard=12, max_secs=3600, expired_only=0 2024-09-14T11:50:29.763 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:29.768+0000 7ff9842539c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:50:29.764 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:29.768+0000 7ff9842539c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:50:29.765 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:29.768+0000 7ff9842539c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2024-09-14T11:50:29.765 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:29.768+0000 7ff9842539c0 20 garbage collection: RGWGC::process iterating over entry tag='2~Xh5_8G-vGUWIqpO1WVIIbKvtqLBU5Gj', time=2024-09-14T13:43:09.388143+0000, chain.objs.size()=9 2024-09-14T11:50:29.765 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:29.768+0000 7ff9842539c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.40__multipart_key1.2~Xh5_8G-vGUWIqpO1WVIIbKvtqLBU5Gj.1 2024-09-14T11:50:29.765 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:29.768+0000 7ff9842539c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.40__shadow_key1.2~Xh5_8G-vGUWIqpO1WVIIbKvtqLBU5Gj.1_1 2024-09-14T11:50:29.765 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:29.768+0000 7ff9842539c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.40__multipart_key1.2~Xh5_8G-vGUWIqpO1WVIIbKvtqLBU5Gj.2 2024-09-14T11:50:29.765 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:29.768+0000 7ff9842539c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.40__shadow_key1.2~Xh5_8G-vGUWIqpO1WVIIbKvtqLBU5Gj.2_1 2024-09-14T11:50:29.765 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:29.768+0000 7ff9842539c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.40__multipart_key1.2~Xh5_8G-vGUWIqpO1WVIIbKvtqLBU5Gj.3 2024-09-14T11:50:29.765 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:29.768+0000 7ff9842539c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.40__shadow_key1.2~Xh5_8G-vGUWIqpO1WVIIbKvtqLBU5Gj.3_1 2024-09-14T11:50:29.765 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:29.768+0000 7ff9842539c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.40__multipart_key1.2~Xh5_8G-vGUWIqpO1WVIIbKvtqLBU5Gj.4 2024-09-14T11:50:29.765 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:29.768+0000 7ff9842539c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.40__shadow_key1.2~Xh5_8G-vGUWIqpO1WVIIbKvtqLBU5Gj.4_1 2024-09-14T11:50:29.765 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:29.768+0000 7ff9842539c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.40__multipart_key1.2~Xh5_8G-vGUWIqpO1WVIIbKvtqLBU5Gj.5 2024-09-14T11:50:29.770 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:29.772+0000 7ff9842539c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T11:50:29.773 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:29.776+0000 7ff9842539c0 20 garbage collection: RGWGC::process entered with GC index_shard=13, max_secs=3600, expired_only=0 2024-09-14T11:50:29.775 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:29.780+0000 7ff9842539c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:50:29.776 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:29.780+0000 7ff9842539c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:50:29.776 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:29.780+0000 7ff9842539c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:50:29.777 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:29.780+0000 7ff9842539c0 20 garbage collection: RGWGC::process entered with GC index_shard=14, max_secs=3600, expired_only=0 2024-09-14T11:50:29.779 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:29.784+0000 7ff9842539c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:50:29.779 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:29.784+0000 7ff9842539c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:50:29.779 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:29.784+0000 7ff9842539c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:50:29.781 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:29.784+0000 7ff9842539c0 20 garbage collection: RGWGC::process entered with GC index_shard=15, max_secs=3600, expired_only=0 2024-09-14T11:50:29.782 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:29.788+0000 7ff9842539c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:50:29.783 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:29.788+0000 7ff9842539c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:50:29.783 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:29.788+0000 7ff9842539c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:50:29.785 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:29.788+0000 7ff9842539c0 20 garbage collection: RGWGC::process entered with GC index_shard=16, max_secs=3600, expired_only=0 2024-09-14T11:50:29.786 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:29.788+0000 7ff9842539c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:50:29.787 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:29.792+0000 7ff9842539c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:50:29.787 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:29.792+0000 7ff9842539c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:50:29.789 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:29.792+0000 7ff9842539c0 20 garbage collection: RGWGC::process entered with GC index_shard=17, max_secs=3600, expired_only=0 2024-09-14T11:50:29.791 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:29.796+0000 7ff9842539c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:50:29.791 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:29.796+0000 7ff9842539c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:50:29.791 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:29.796+0000 7ff9842539c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:50:29.793 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:29.796+0000 7ff9842539c0 20 garbage collection: RGWGC::process entered with GC index_shard=18, max_secs=3600, expired_only=0 2024-09-14T11:50:29.795 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:29.800+0000 7ff9842539c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:50:29.795 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:29.800+0000 7ff9842539c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:50:29.796 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:29.800+0000 7ff9842539c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:50:29.797 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:29.800+0000 7ff9842539c0 20 garbage collection: RGWGC::process entered with GC index_shard=19, max_secs=3600, expired_only=0 2024-09-14T11:50:29.799 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:29.804+0000 7ff9842539c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:50:29.799 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:29.804+0000 7ff9842539c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:50:29.800 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:29.804+0000 7ff9842539c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2024-09-14T11:50:29.800 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:29.804+0000 7ff9842539c0 20 garbage collection: RGWGC::process iterating over entry tag='d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.15709029900365729153', time=2024-09-14T13:50:27.816379+0000, chain.objs.size()=21 2024-09-14T11:50:29.800 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:29.804+0000 7ff9842539c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.66__multipart_key1.2~AgZm0lxk55371uifiYhQRa5Gg0uyld_.1 2024-09-14T11:50:29.800 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:29.804+0000 7ff9842539c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.66__shadow_key1.2~AgZm0lxk55371uifiYhQRa5Gg0uyld_.1_1 2024-09-14T11:50:29.800 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:29.804+0000 7ff9842539c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.66__multipart_key1.2~AgZm0lxk55371uifiYhQRa5Gg0uyld_.2 2024-09-14T11:50:29.801 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:29.804+0000 7ff9842539c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.66__shadow_key1.2~AgZm0lxk55371uifiYhQRa5Gg0uyld_.2_1 2024-09-14T11:50:29.801 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:29.804+0000 7ff9842539c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.66__multipart_key1.2~AgZm0lxk55371uifiYhQRa5Gg0uyld_.3 2024-09-14T11:50:29.801 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:29.804+0000 7ff9842539c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.66__shadow_key1.2~AgZm0lxk55371uifiYhQRa5Gg0uyld_.3_1 2024-09-14T11:50:29.801 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:29.804+0000 7ff9842539c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.66__multipart_key1.2~AgZm0lxk55371uifiYhQRa5Gg0uyld_.4 2024-09-14T11:50:29.801 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:29.804+0000 7ff9842539c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.66__shadow_key1.2~AgZm0lxk55371uifiYhQRa5Gg0uyld_.4_1 2024-09-14T11:50:29.801 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:29.804+0000 7ff9842539c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.66__multipart_key1.2~AgZm0lxk55371uifiYhQRa5Gg0uyld_.5 2024-09-14T11:50:29.801 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:29.804+0000 7ff9842539c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.66__shadow_key1.2~AgZm0lxk55371uifiYhQRa5Gg0uyld_.5_1 2024-09-14T11:50:29.801 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:29.804+0000 7ff9842539c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.66__multipart_key1.2~AgZm0lxk55371uifiYhQRa5Gg0uyld_.6 2024-09-14T11:50:29.801 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:29.804+0000 7ff9842539c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.66__shadow_key1.2~AgZm0lxk55371uifiYhQRa5Gg0uyld_.6_1 2024-09-14T11:50:29.807 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:29.808+0000 7ff9842539c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.66__multipart_key1.2~AgZm0lxk55371uifiYhQRa5Gg0uyld_.7 2024-09-14T11:50:29.807 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:29.808+0000 7ff9842539c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.66__shadow_key1.2~AgZm0lxk55371uifiYhQRa5Gg0uyld_.7_1 2024-09-14T11:50:29.807 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:29.808+0000 7ff9842539c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.66__multipart_key1.2~AgZm0lxk55371uifiYhQRa5Gg0uyld_.8 2024-09-14T11:50:29.807 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:29.808+0000 7ff9842539c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.66__shadow_key1.2~AgZm0lxk55371uifiYhQRa5Gg0uyld_.8_1 2024-09-14T11:50:29.807 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:29.808+0000 7ff9842539c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.66__multipart_key1.2~AgZm0lxk55371uifiYhQRa5Gg0uyld_.9 2024-09-14T11:50:29.807 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:29.808+0000 7ff9842539c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.66__shadow_key1.2~AgZm0lxk55371uifiYhQRa5Gg0uyld_.9_1 2024-09-14T11:50:29.807 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:29.808+0000 7ff9842539c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.66__multipart_key1.2~AgZm0lxk55371uifiYhQRa5Gg0uyld_.10 2024-09-14T11:50:29.807 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:29.808+0000 7ff9842539c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.66__shadow_key1.2~AgZm0lxk55371uifiYhQRa5Gg0uyld_.10_1 2024-09-14T11:50:29.807 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:29.808+0000 7ff9842539c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.66__multipart_key1.2~AgZm0lxk55371uifiYhQRa5Gg0uyld_.11 2024-09-14T11:50:29.813 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:29.816+0000 7ff9842539c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T11:50:29.816 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:29.820+0000 7ff9842539c0 20 garbage collection: RGWGC::process entered with GC index_shard=20, max_secs=3600, expired_only=0 2024-09-14T11:50:29.818 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:29.820+0000 7ff9842539c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:50:29.818 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:29.824+0000 7ff9842539c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:50:29.819 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:29.824+0000 7ff9842539c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:50:29.820 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:29.824+0000 7ff9842539c0 20 garbage collection: RGWGC::process entered with GC index_shard=21, max_secs=3600, expired_only=0 2024-09-14T11:50:29.822 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:29.824+0000 7ff9842539c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:50:29.822 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:29.824+0000 7ff9842539c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:50:29.823 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:29.828+0000 7ff9842539c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:50:29.824 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:29.828+0000 7ff9842539c0 20 garbage collection: RGWGC::process entered with GC index_shard=22, max_secs=3600, expired_only=0 2024-09-14T11:50:29.826 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:29.828+0000 7ff9842539c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:50:29.826 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:29.828+0000 7ff9842539c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:50:29.827 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:29.832+0000 7ff9842539c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2024-09-14T11:50:29.827 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:29.832+0000 7ff9842539c0 20 garbage collection: RGWGC::process iterating over entry tag='d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.7427369102025808397', time=2024-09-14T13:48:45.057096+0000, chain.objs.size()=16 2024-09-14T11:50:29.828 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:29.832+0000 7ff9842539c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.55__multipart_key1.2~49Wwp25z0uj2MmZeqsupZ3-sMF9HamV.1 2024-09-14T11:50:29.828 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:29.832+0000 7ff9842539c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.55__shadow_key1.2~49Wwp25z0uj2MmZeqsupZ3-sMF9HamV.1_1 2024-09-14T11:50:29.828 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:29.832+0000 7ff9842539c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.55__shadow_key1.2~49Wwp25z0uj2MmZeqsupZ3-sMF9HamV.1_2 2024-09-14T11:50:29.828 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:29.832+0000 7ff9842539c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.55__multipart_key1.2~49Wwp25z0uj2MmZeqsupZ3-sMF9HamV.2 2024-09-14T11:50:29.828 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:29.832+0000 7ff9842539c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.55__shadow_key1.2~49Wwp25z0uj2MmZeqsupZ3-sMF9HamV.2_1 2024-09-14T11:50:29.828 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:29.832+0000 7ff9842539c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.55__shadow_key1.2~49Wwp25z0uj2MmZeqsupZ3-sMF9HamV.2_2 2024-09-14T11:50:29.828 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:29.832+0000 7ff9842539c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.55__multipart_key1.2~49Wwp25z0uj2MmZeqsupZ3-sMF9HamV.3 2024-09-14T11:50:29.828 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:29.832+0000 7ff9842539c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.55__shadow_key1.2~49Wwp25z0uj2MmZeqsupZ3-sMF9HamV.3_1 2024-09-14T11:50:29.828 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:29.832+0000 7ff9842539c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.55__shadow_key1.2~49Wwp25z0uj2MmZeqsupZ3-sMF9HamV.3_2 2024-09-14T11:50:29.828 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:29.832+0000 7ff9842539c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.55__multipart_key1.2~49Wwp25z0uj2MmZeqsupZ3-sMF9HamV.4 2024-09-14T11:50:29.828 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:29.832+0000 7ff9842539c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.55__shadow_key1.2~49Wwp25z0uj2MmZeqsupZ3-sMF9HamV.4_1 2024-09-14T11:50:29.828 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:29.832+0000 7ff9842539c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.55__shadow_key1.2~49Wwp25z0uj2MmZeqsupZ3-sMF9HamV.4_2 2024-09-14T11:50:29.832 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:29.836+0000 7ff9842539c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.55__multipart_key1.2~49Wwp25z0uj2MmZeqsupZ3-sMF9HamV.5 2024-09-14T11:50:29.832 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:29.836+0000 7ff9842539c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.55__shadow_key1.2~49Wwp25z0uj2MmZeqsupZ3-sMF9HamV.5_1 2024-09-14T11:50:29.832 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:29.836+0000 7ff9842539c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.55__shadow_key1.2~49Wwp25z0uj2MmZeqsupZ3-sMF9HamV.5_2 2024-09-14T11:50:29.833 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:29.836+0000 7ff9842539c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.55__multipart_key1.2~49Wwp25z0uj2MmZeqsupZ3-sMF9HamV.6 2024-09-14T11:50:29.836 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:29.840+0000 7ff9842539c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T11:50:29.839 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:29.844+0000 7ff9842539c0 20 garbage collection: RGWGC::process entered with GC index_shard=23, max_secs=3600, expired_only=0 2024-09-14T11:50:29.841 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:29.844+0000 7ff9842539c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:50:29.842 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:29.844+0000 7ff9842539c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:50:29.842 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:29.844+0000 7ff9842539c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:50:29.843 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:29.848+0000 7ff9842539c0 20 garbage collection: RGWGC::process entered with GC index_shard=24, max_secs=3600, expired_only=0 2024-09-14T11:50:29.845 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:29.848+0000 7ff9842539c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:50:29.845 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:29.848+0000 7ff9842539c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:50:29.845 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:29.848+0000 7ff9842539c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:50:29.846 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:29.848+0000 7ff9842539c0 20 garbage collection: RGWGC::process entered with GC index_shard=25, max_secs=3600, expired_only=0 2024-09-14T11:50:29.848 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:29.852+0000 7ff9842539c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:50:29.848 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:29.852+0000 7ff9842539c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:50:29.849 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:29.852+0000 7ff9842539c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2024-09-14T11:50:29.849 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:29.852+0000 7ff9842539c0 20 garbage collection: RGWGC::process iterating over entry tag='d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.2528820378946636616', time=2024-09-14T13:44:23.160643+0000, chain.objs.size()=9 2024-09-14T11:50:29.849 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:29.852+0000 7ff9842539c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.47__multipart_key1.2~5KQUAA2tqT934a38ix55wswHkVc08WX.1 2024-09-14T11:50:29.849 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:29.852+0000 7ff9842539c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.47__shadow_key1.2~5KQUAA2tqT934a38ix55wswHkVc08WX.1_1 2024-09-14T11:50:29.849 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:29.852+0000 7ff9842539c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.47__multipart_key1.2~5KQUAA2tqT934a38ix55wswHkVc08WX.2 2024-09-14T11:50:29.850 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:29.852+0000 7ff9842539c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.47__shadow_key1.2~5KQUAA2tqT934a38ix55wswHkVc08WX.2_1 2024-09-14T11:50:29.850 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:29.852+0000 7ff9842539c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.47__multipart_key1.2~5KQUAA2tqT934a38ix55wswHkVc08WX.3 2024-09-14T11:50:29.850 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:29.852+0000 7ff9842539c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.47__shadow_key1.2~5KQUAA2tqT934a38ix55wswHkVc08WX.3_1 2024-09-14T11:50:29.850 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:29.852+0000 7ff9842539c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.47__multipart_key1.2~5KQUAA2tqT934a38ix55wswHkVc08WX.4 2024-09-14T11:50:29.850 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:29.852+0000 7ff9842539c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.47__shadow_key1.2~5KQUAA2tqT934a38ix55wswHkVc08WX.4_1 2024-09-14T11:50:29.850 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:29.852+0000 7ff9842539c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.47__multipart_key1.2~5KQUAA2tqT934a38ix55wswHkVc08WX.5 2024-09-14T11:50:29.853 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:29.856+0000 7ff9842539c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T11:50:29.857 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:29.860+0000 7ff9842539c0 20 garbage collection: RGWGC::process entered with GC index_shard=26, max_secs=3600, expired_only=0 2024-09-14T11:50:29.859 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:29.864+0000 7ff9842539c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:50:29.859 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:29.864+0000 7ff9842539c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:50:29.860 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:29.864+0000 7ff9842539c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:50:29.861 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:29.864+0000 7ff9842539c0 20 garbage collection: RGWGC::process entered with GC index_shard=27, max_secs=3600, expired_only=0 2024-09-14T11:50:29.863 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:29.868+0000 7ff9842539c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:50:29.863 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:29.868+0000 7ff9842539c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:50:29.863 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:29.868+0000 7ff9842539c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:50:29.865 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:29.868+0000 7ff9842539c0 20 garbage collection: RGWGC::process entered with GC index_shard=28, max_secs=3600, expired_only=0 2024-09-14T11:50:29.866 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:29.868+0000 7ff9842539c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:50:29.867 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:29.872+0000 7ff9842539c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:50:29.867 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:29.872+0000 7ff9842539c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:50:29.869 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:29.872+0000 7ff9842539c0 20 garbage collection: RGWGC::process entered with GC index_shard=29, max_secs=3600, expired_only=0 2024-09-14T11:50:29.870 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:29.872+0000 7ff9842539c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:50:29.871 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:29.876+0000 7ff9842539c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:50:29.871 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:29.876+0000 7ff9842539c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2024-09-14T11:50:29.872 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:29.876+0000 7ff9842539c0 20 garbage collection: RGWGC::process iterating over entry tag='d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.647348833063310356', time=2024-09-14T13:45:29.226860+0000, chain.objs.size()=9 2024-09-14T11:50:29.872 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:29.876+0000 7ff9842539c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.51__multipart_key1.2~sM3-9ifTTAT2JRUPGfH-zR_Wy7UFQ9x.1 2024-09-14T11:50:29.872 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:29.876+0000 7ff9842539c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.51__shadow_key1.2~sM3-9ifTTAT2JRUPGfH-zR_Wy7UFQ9x.1_1 2024-09-14T11:50:29.872 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:29.876+0000 7ff9842539c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.51__multipart_key1.2~sM3-9ifTTAT2JRUPGfH-zR_Wy7UFQ9x.2 2024-09-14T11:50:29.872 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:29.876+0000 7ff9842539c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.51__shadow_key1.2~sM3-9ifTTAT2JRUPGfH-zR_Wy7UFQ9x.2_1 2024-09-14T11:50:29.872 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:29.876+0000 7ff9842539c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.51__multipart_key1.2~sM3-9ifTTAT2JRUPGfH-zR_Wy7UFQ9x.3 2024-09-14T11:50:29.872 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:29.876+0000 7ff9842539c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.51__shadow_key1.2~sM3-9ifTTAT2JRUPGfH-zR_Wy7UFQ9x.3_1 2024-09-14T11:50:29.872 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:29.876+0000 7ff9842539c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.51__multipart_key1.2~sM3-9ifTTAT2JRUPGfH-zR_Wy7UFQ9x.4 2024-09-14T11:50:29.872 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:29.876+0000 7ff9842539c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.51__shadow_key1.2~sM3-9ifTTAT2JRUPGfH-zR_Wy7UFQ9x.4_1 2024-09-14T11:50:29.872 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:29.876+0000 7ff9842539c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.51__multipart_key1.2~sM3-9ifTTAT2JRUPGfH-zR_Wy7UFQ9x.5 2024-09-14T11:50:29.876 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:29.880+0000 7ff9842539c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T11:50:29.879 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:29.884+0000 7ff9842539c0 20 garbage collection: RGWGC::process entered with GC index_shard=30, max_secs=3600, expired_only=0 2024-09-14T11:50:29.881 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:29.884+0000 7ff9842539c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:50:29.881 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:29.884+0000 7ff9842539c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:50:29.882 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:29.884+0000 7ff9842539c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2024-09-14T11:50:29.882 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:29.884+0000 7ff9842539c0 20 garbage collection: RGWGC::process iterating over entry tag='d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.6807123182833846228', time=2024-09-14T13:43:32.773128+0000, chain.objs.size()=9 2024-09-14T11:50:29.882 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:29.884+0000 7ff9842539c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.42__multipart_key1.2~NOG3CWZCDsszuYcHqBFtS26LvbYbVaa.1 2024-09-14T11:50:29.882 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:29.884+0000 7ff9842539c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.42__shadow_key1.2~NOG3CWZCDsszuYcHqBFtS26LvbYbVaa.1_1 2024-09-14T11:50:29.882 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:29.884+0000 7ff9842539c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.42__multipart_key1.2~NOG3CWZCDsszuYcHqBFtS26LvbYbVaa.2 2024-09-14T11:50:29.882 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:29.884+0000 7ff9842539c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.42__shadow_key1.2~NOG3CWZCDsszuYcHqBFtS26LvbYbVaa.2_1 2024-09-14T11:50:29.882 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:29.884+0000 7ff9842539c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.42__multipart_key1.2~NOG3CWZCDsszuYcHqBFtS26LvbYbVaa.3 2024-09-14T11:50:29.882 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:29.884+0000 7ff9842539c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.42__shadow_key1.2~NOG3CWZCDsszuYcHqBFtS26LvbYbVaa.3_1 2024-09-14T11:50:29.882 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:29.884+0000 7ff9842539c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.42__multipart_key1.2~NOG3CWZCDsszuYcHqBFtS26LvbYbVaa.4 2024-09-14T11:50:29.882 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:29.884+0000 7ff9842539c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.42__shadow_key1.2~NOG3CWZCDsszuYcHqBFtS26LvbYbVaa.4_1 2024-09-14T11:50:29.882 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:29.884+0000 7ff9842539c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.42__multipart_key1.2~NOG3CWZCDsszuYcHqBFtS26LvbYbVaa.5 2024-09-14T11:50:29.887 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:29.892+0000 7ff9842539c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T11:50:29.890 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:29.892+0000 7ff9842539c0 20 garbage collection: RGWGC::process entered with GC index_shard=31, max_secs=3600, expired_only=0 2024-09-14T11:50:29.891 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:29.896+0000 7ff9842539c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:50:29.892 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:29.896+0000 7ff9842539c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:50:29.893 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:29.896+0000 7ff9842539c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=2, truncated=0, next_marker='' 2024-09-14T11:50:29.893 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:29.896+0000 7ff9842539c0 20 garbage collection: RGWGC::process iterating over entry tag='d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.10144406067256928806', time=2024-09-14T13:43:48.997302+0000, chain.objs.size()=9 2024-09-14T11:50:29.893 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:29.896+0000 7ff9842539c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.44__multipart_key1.2~pkZ2M4SVLB2G2vs1JGdJ_SIovKCpfvp.1 2024-09-14T11:50:29.893 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:29.896+0000 7ff9842539c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.44__shadow_key1.2~pkZ2M4SVLB2G2vs1JGdJ_SIovKCpfvp.1_1 2024-09-14T11:50:29.893 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:29.896+0000 7ff9842539c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.44__multipart_key1.2~pkZ2M4SVLB2G2vs1JGdJ_SIovKCpfvp.2 2024-09-14T11:50:29.893 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:29.896+0000 7ff9842539c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.44__shadow_key1.2~pkZ2M4SVLB2G2vs1JGdJ_SIovKCpfvp.2_1 2024-09-14T11:50:29.893 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:29.896+0000 7ff9842539c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.44__multipart_key1.2~pkZ2M4SVLB2G2vs1JGdJ_SIovKCpfvp.3 2024-09-14T11:50:29.893 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:29.896+0000 7ff9842539c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.44__shadow_key1.2~pkZ2M4SVLB2G2vs1JGdJ_SIovKCpfvp.3_1 2024-09-14T11:50:29.894 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:29.896+0000 7ff9842539c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.44__multipart_key1.2~pkZ2M4SVLB2G2vs1JGdJ_SIovKCpfvp.4 2024-09-14T11:50:29.894 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:29.896+0000 7ff9842539c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.44__shadow_key1.2~pkZ2M4SVLB2G2vs1JGdJ_SIovKCpfvp.4_1 2024-09-14T11:50:29.894 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:29.896+0000 7ff9842539c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.44__multipart_key1.2~pkZ2M4SVLB2G2vs1JGdJ_SIovKCpfvp.5 2024-09-14T11:50:29.894 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:29.896+0000 7ff9842539c0 20 garbage collection: RGWGC::process iterating over entry tag='2~AvzzM96kIgeJCT1__Y9R5GYlVvV-CBt', time=2024-09-14T13:46:12.662029+0000, chain.objs.size()=5 2024-09-14T11:50:29.894 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:29.896+0000 7ff9842539c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.54__multipart_key1.2~AvzzM96kIgeJCT1__Y9R5GYlVvV-CBt.7 2024-09-14T11:50:29.894 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:29.896+0000 7ff9842539c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.54__shadow_key1.2~AvzzM96kIgeJCT1__Y9R5GYlVvV-CBt.7_1 2024-09-14T11:50:29.894 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:29.896+0000 7ff9842539c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.54__multipart_key1.2~AvzzM96kIgeJCT1__Y9R5GYlVvV-CBt.10 2024-09-14T11:50:29.896 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:29.900+0000 7ff9842539c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.54__shadow_key1.2~AvzzM96kIgeJCT1__Y9R5GYlVvV-CBt.10_1 2024-09-14T11:50:29.896 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:29.900+0000 7ff9842539c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.54__multipart_key1.2~AvzzM96kIgeJCT1__Y9R5GYlVvV-CBt.13 2024-09-14T11:50:29.901 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:29.904+0000 7ff9842539c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T11:50:29.904 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:29.908+0000 7ff9842539c0 20 garbage collection: RGWGC::process entered with GC index_shard=0, max_secs=3600, expired_only=0 2024-09-14T11:50:29.905 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:29.908+0000 7ff9842539c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:50:29.906 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:29.908+0000 7ff9842539c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:50:29.907 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:29.912+0000 7ff9842539c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=2, truncated=0, next_marker='' 2024-09-14T11:50:29.907 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:29.912+0000 7ff9842539c0 20 garbage collection: RGWGC::process iterating over entry tag='d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.11615870991869656101', time=2024-09-14T13:45:02.619180+0000, chain.objs.size()=7 2024-09-14T11:50:29.907 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:29.912+0000 7ff9842539c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.47__multipart_key1.2~cFk6UerWc6OafHdzWcdYx2XWfGP6cNi.1 2024-09-14T11:50:29.907 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:29.912+0000 7ff9842539c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.47__shadow_key1.2~cFk6UerWc6OafHdzWcdYx2XWfGP6cNi.1_1 2024-09-14T11:50:29.907 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:29.912+0000 7ff9842539c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.47__shadow_key1.2~cFk6UerWc6OafHdzWcdYx2XWfGP6cNi.1_2 2024-09-14T11:50:29.907 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:29.912+0000 7ff9842539c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.47__multipart_key1.2~cFk6UerWc6OafHdzWcdYx2XWfGP6cNi.2 2024-09-14T11:50:29.907 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:29.912+0000 7ff9842539c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.47__shadow_key1.2~cFk6UerWc6OafHdzWcdYx2XWfGP6cNi.2_1 2024-09-14T11:50:29.908 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:29.912+0000 7ff9842539c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.47__shadow_key1.2~cFk6UerWc6OafHdzWcdYx2XWfGP6cNi.2_2 2024-09-14T11:50:29.908 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:29.912+0000 7ff9842539c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.47__multipart_key1.2~cFk6UerWc6OafHdzWcdYx2XWfGP6cNi.3 2024-09-14T11:50:29.908 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:29.912+0000 7ff9842539c0 20 garbage collection: RGWGC::process iterating over entry tag='d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.11114650555877553008', time=2024-09-14T13:47:05.102690+0000, chain.objs.size()=21 2024-09-14T11:50:29.908 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:29.912+0000 7ff9842539c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.55__multipart_key1.2~3PJzSKp4y-BL-XnBD5F3k62aMMlMYLm.1 2024-09-14T11:50:29.908 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:29.912+0000 7ff9842539c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.55__shadow_key1.2~3PJzSKp4y-BL-XnBD5F3k62aMMlMYLm.1_1 2024-09-14T11:50:29.908 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:29.912+0000 7ff9842539c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.55__multipart_key1.2~3PJzSKp4y-BL-XnBD5F3k62aMMlMYLm.2 2024-09-14T11:50:29.908 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:29.912+0000 7ff9842539c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.55__shadow_key1.2~3PJzSKp4y-BL-XnBD5F3k62aMMlMYLm.2_1 2024-09-14T11:50:29.908 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:29.912+0000 7ff9842539c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.55__multipart_key1.2~3PJzSKp4y-BL-XnBD5F3k62aMMlMYLm.3 2024-09-14T11:50:29.910 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:29.912+0000 7ff9842539c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.55__shadow_key1.2~3PJzSKp4y-BL-XnBD5F3k62aMMlMYLm.3_1 2024-09-14T11:50:29.910 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:29.912+0000 7ff9842539c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.55__multipart_key1.2~3PJzSKp4y-BL-XnBD5F3k62aMMlMYLm.4 2024-09-14T11:50:29.911 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:29.916+0000 7ff9842539c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.55__shadow_key1.2~3PJzSKp4y-BL-XnBD5F3k62aMMlMYLm.4_1 2024-09-14T11:50:29.911 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:29.916+0000 7ff9842539c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.55__multipart_key1.2~3PJzSKp4y-BL-XnBD5F3k62aMMlMYLm.5 2024-09-14T11:50:29.911 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:29.916+0000 7ff9842539c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.55__shadow_key1.2~3PJzSKp4y-BL-XnBD5F3k62aMMlMYLm.5_1 2024-09-14T11:50:29.912 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:29.916+0000 7ff9842539c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.55__multipart_key1.2~3PJzSKp4y-BL-XnBD5F3k62aMMlMYLm.6 2024-09-14T11:50:29.912 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:29.916+0000 7ff9842539c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.55__shadow_key1.2~3PJzSKp4y-BL-XnBD5F3k62aMMlMYLm.6_1 2024-09-14T11:50:29.914 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:29.916+0000 7ff9842539c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.55__multipart_key1.2~3PJzSKp4y-BL-XnBD5F3k62aMMlMYLm.7 2024-09-14T11:50:29.914 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:29.916+0000 7ff9842539c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.55__shadow_key1.2~3PJzSKp4y-BL-XnBD5F3k62aMMlMYLm.7_1 2024-09-14T11:50:29.914 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:29.916+0000 7ff9842539c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.55__multipart_key1.2~3PJzSKp4y-BL-XnBD5F3k62aMMlMYLm.8 2024-09-14T11:50:29.914 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:29.916+0000 7ff9842539c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.55__shadow_key1.2~3PJzSKp4y-BL-XnBD5F3k62aMMlMYLm.8_1 2024-09-14T11:50:29.916 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:29.920+0000 7ff9842539c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.55__multipart_key1.2~3PJzSKp4y-BL-XnBD5F3k62aMMlMYLm.9 2024-09-14T11:50:29.918 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:29.920+0000 7ff9842539c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.55__shadow_key1.2~3PJzSKp4y-BL-XnBD5F3k62aMMlMYLm.9_1 2024-09-14T11:50:29.918 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:29.920+0000 7ff9842539c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.55__multipart_key1.2~3PJzSKp4y-BL-XnBD5F3k62aMMlMYLm.10 2024-09-14T11:50:29.919 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:29.924+0000 7ff9842539c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.55__shadow_key1.2~3PJzSKp4y-BL-XnBD5F3k62aMMlMYLm.10_1 2024-09-14T11:50:29.920 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:29.924+0000 7ff9842539c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.55__multipart_key1.2~3PJzSKp4y-BL-XnBD5F3k62aMMlMYLm.11 2024-09-14T11:50:29.922 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:29.924+0000 7ff9842539c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T11:50:29.925 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:29.928+0000 7ff9842539c0 20 garbage collection: RGWGC::process entered with GC index_shard=1, max_secs=3600, expired_only=0 2024-09-14T11:50:29.926 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:29.932+0000 7ff9842539c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:50:29.928 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:29.932+0000 7ff9842539c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:50:29.928 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:29.932+0000 7ff9842539c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=8, truncated=0, next_marker='' 2024-09-14T11:50:29.928 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:29.932+0000 7ff9842539c0 20 garbage collection: RGWGC::process iterating over entry tag='d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.4265499470610647319', time=2024-09-14T13:44:52.759802+0000, chain.objs.size()=9 2024-09-14T11:50:29.928 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:29.932+0000 7ff9842539c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.47__multipart_key1.2~VpyZ2AmoelvB1TfPca_OrNzlfdV1_Om.1 2024-09-14T11:50:29.929 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:29.932+0000 7ff9842539c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.47__shadow_key1.2~VpyZ2AmoelvB1TfPca_OrNzlfdV1_Om.1_1 2024-09-14T11:50:29.929 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:29.932+0000 7ff9842539c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.47__multipart_key1.2~VpyZ2AmoelvB1TfPca_OrNzlfdV1_Om.2 2024-09-14T11:50:29.929 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:29.932+0000 7ff9842539c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.47__shadow_key1.2~VpyZ2AmoelvB1TfPca_OrNzlfdV1_Om.2_1 2024-09-14T11:50:29.929 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:29.932+0000 7ff9842539c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.47__multipart_key1.2~VpyZ2AmoelvB1TfPca_OrNzlfdV1_Om.3 2024-09-14T11:50:29.929 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:29.932+0000 7ff9842539c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.47__shadow_key1.2~VpyZ2AmoelvB1TfPca_OrNzlfdV1_Om.3_1 2024-09-14T11:50:29.929 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:29.932+0000 7ff9842539c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.47__multipart_key1.2~VpyZ2AmoelvB1TfPca_OrNzlfdV1_Om.4 2024-09-14T11:50:29.929 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:29.932+0000 7ff9842539c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.47__shadow_key1.2~VpyZ2AmoelvB1TfPca_OrNzlfdV1_Om.4_1 2024-09-14T11:50:29.929 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:29.932+0000 7ff9842539c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.47__multipart_key1.2~VpyZ2AmoelvB1TfPca_OrNzlfdV1_Om.5 2024-09-14T11:50:29.929 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:29.932+0000 7ff9842539c0 20 garbage collection: RGWGC::process iterating over entry tag='2~LdWvJATBs7AHwzp7jlosH1HGqu5Nsrq', time=2024-09-14T13:49:44.629619+0000, chain.objs.size()=1 2024-09-14T11:50:29.929 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:29.932+0000 7ff9842539c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.58__multipart_key1.2~LdWvJATBs7AHwzp7jlosH1HGqu5Nsrq.16 2024-09-14T11:50:29.929 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:29.932+0000 7ff9842539c0 20 garbage collection: RGWGC::process iterating over entry tag='2~LdWvJATBs7AHwzp7jlosH1HGqu5Nsrq', time=2024-09-14T13:49:44.964630+0000, chain.objs.size()=62 2024-09-14T11:50:29.929 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:29.932+0000 7ff9842539c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.58__multipart_key1.2~LdWvJATBs7AHwzp7jlosH1HGqu5Nsrq.1 2024-09-14T11:50:29.929 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:29.932+0000 7ff9842539c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.58__multipart_key1.2~LdWvJATBs7AHwzp7jlosH1HGqu5Nsrq.2 2024-09-14T11:50:29.933 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:29.936+0000 7ff9842539c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.58__multipart_key1.2~LdWvJATBs7AHwzp7jlosH1HGqu5Nsrq.3 2024-09-14T11:50:29.933 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:29.936+0000 7ff9842539c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.58__multipart_key1.2~LdWvJATBs7AHwzp7jlosH1HGqu5Nsrq.4 2024-09-14T11:50:29.933 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:29.936+0000 7ff9842539c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.58__multipart_key1.2~LdWvJATBs7AHwzp7jlosH1HGqu5Nsrq.5 2024-09-14T11:50:29.933 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:29.936+0000 7ff9842539c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.58__multipart_key1.2~LdWvJATBs7AHwzp7jlosH1HGqu5Nsrq.6 2024-09-14T11:50:29.933 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:29.936+0000 7ff9842539c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.58__multipart_key1.2~LdWvJATBs7AHwzp7jlosH1HGqu5Nsrq.7 2024-09-14T11:50:29.933 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:29.936+0000 7ff9842539c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.58__multipart_key1.2~LdWvJATBs7AHwzp7jlosH1HGqu5Nsrq.8 2024-09-14T11:50:29.933 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:29.936+0000 7ff9842539c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.58__multipart_key1.2~LdWvJATBs7AHwzp7jlosH1HGqu5Nsrq.9 2024-09-14T11:50:29.933 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:29.936+0000 7ff9842539c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.58__multipart_key1.2~LdWvJATBs7AHwzp7jlosH1HGqu5Nsrq.10 2024-09-14T11:50:29.933 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:29.936+0000 7ff9842539c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.58__multipart_key1.2~LdWvJATBs7AHwzp7jlosH1HGqu5Nsrq.11 2024-09-14T11:50:29.933 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:29.936+0000 7ff9842539c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.58__multipart_key1.2~LdWvJATBs7AHwzp7jlosH1HGqu5Nsrq.12 2024-09-14T11:50:29.934 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:29.936+0000 7ff9842539c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.58__multipart_key1.2~LdWvJATBs7AHwzp7jlosH1HGqu5Nsrq.13 2024-09-14T11:50:29.937 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:29.940+0000 7ff9842539c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.58__multipart_key1.2~LdWvJATBs7AHwzp7jlosH1HGqu5Nsrq.14 2024-09-14T11:50:29.937 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:29.940+0000 7ff9842539c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.58__multipart_key1.2~LdWvJATBs7AHwzp7jlosH1HGqu5Nsrq.15 2024-09-14T11:50:29.937 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:29.940+0000 7ff9842539c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.58__multipart_key1.rYqGGM57Y2ywjNAJXwVa50nmeUH_CNLf.16 2024-09-14T11:50:29.938 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:29.940+0000 7ff9842539c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.58__multipart_key1.2~LdWvJATBs7AHwzp7jlosH1HGqu5Nsrq.17 2024-09-14T11:50:29.938 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:29.940+0000 7ff9842539c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.58__multipart_key1.2~LdWvJATBs7AHwzp7jlosH1HGqu5Nsrq.18 2024-09-14T11:50:29.938 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:29.940+0000 7ff9842539c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.58__multipart_key1.2~LdWvJATBs7AHwzp7jlosH1HGqu5Nsrq.19 2024-09-14T11:50:29.938 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:29.940+0000 7ff9842539c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.58__multipart_key1.2~LdWvJATBs7AHwzp7jlosH1HGqu5Nsrq.20 2024-09-14T11:50:29.938 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:29.940+0000 7ff9842539c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.58__multipart_key1.2~LdWvJATBs7AHwzp7jlosH1HGqu5Nsrq.21 2024-09-14T11:50:29.938 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:29.940+0000 7ff9842539c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.58__multipart_key1.2~LdWvJATBs7AHwzp7jlosH1HGqu5Nsrq.22 2024-09-14T11:50:29.938 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:29.940+0000 7ff9842539c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.58__multipart_key1.2~LdWvJATBs7AHwzp7jlosH1HGqu5Nsrq.23 2024-09-14T11:50:29.938 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:29.940+0000 7ff9842539c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.58__multipart_key1.2~LdWvJATBs7AHwzp7jlosH1HGqu5Nsrq.24 2024-09-14T11:50:29.943 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:29.944+0000 7ff9842539c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.58__multipart_key1.2~LdWvJATBs7AHwzp7jlosH1HGqu5Nsrq.25 2024-09-14T11:50:29.943 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:29.948+0000 7ff9842539c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.58__multipart_key1.2~LdWvJATBs7AHwzp7jlosH1HGqu5Nsrq.26 2024-09-14T11:50:29.943 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:29.948+0000 7ff9842539c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.58__multipart_key1.2~LdWvJATBs7AHwzp7jlosH1HGqu5Nsrq.27 2024-09-14T11:50:29.943 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:29.948+0000 7ff9842539c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.58__multipart_key1.2~LdWvJATBs7AHwzp7jlosH1HGqu5Nsrq.28 2024-09-14T11:50:29.943 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:29.948+0000 7ff9842539c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.58__multipart_key1.2~LdWvJATBs7AHwzp7jlosH1HGqu5Nsrq.29 2024-09-14T11:50:29.943 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:29.948+0000 7ff9842539c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.58__multipart_key1.2~LdWvJATBs7AHwzp7jlosH1HGqu5Nsrq.30 2024-09-14T11:50:29.943 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:29.948+0000 7ff9842539c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.58__multipart_key1.2~LdWvJATBs7AHwzp7jlosH1HGqu5Nsrq.31 2024-09-14T11:50:29.944 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:29.948+0000 7ff9842539c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.58__multipart_key1.2~LdWvJATBs7AHwzp7jlosH1HGqu5Nsrq.32 2024-09-14T11:50:29.944 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:29.948+0000 7ff9842539c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.58__multipart_key1.2~LdWvJATBs7AHwzp7jlosH1HGqu5Nsrq.33 2024-09-14T11:50:29.944 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:29.948+0000 7ff9842539c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.58__multipart_key1.2~LdWvJATBs7AHwzp7jlosH1HGqu5Nsrq.34 2024-09-14T11:50:29.944 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:29.948+0000 7ff9842539c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.58__multipart_key1.2~LdWvJATBs7AHwzp7jlosH1HGqu5Nsrq.35 2024-09-14T11:50:29.946 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:29.948+0000 7ff9842539c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.58__multipart_key1.2~LdWvJATBs7AHwzp7jlosH1HGqu5Nsrq.36 2024-09-14T11:50:29.946 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:29.948+0000 7ff9842539c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.58__multipart_key1.2~LdWvJATBs7AHwzp7jlosH1HGqu5Nsrq.37 2024-09-14T11:50:29.946 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:29.948+0000 7ff9842539c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.58__multipart_key1.2~LdWvJATBs7AHwzp7jlosH1HGqu5Nsrq.38 2024-09-14T11:50:29.947 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:29.952+0000 7ff9842539c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.58__multipart_key1.2~LdWvJATBs7AHwzp7jlosH1HGqu5Nsrq.39 2024-09-14T11:50:29.949 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:29.952+0000 7ff9842539c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.58__multipart_key1.2~LdWvJATBs7AHwzp7jlosH1HGqu5Nsrq.40 2024-09-14T11:50:29.950 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:29.952+0000 7ff9842539c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.58__multipart_key1.2~LdWvJATBs7AHwzp7jlosH1HGqu5Nsrq.41 2024-09-14T11:50:29.950 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:29.952+0000 7ff9842539c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.58__multipart_key1.2~LdWvJATBs7AHwzp7jlosH1HGqu5Nsrq.42 2024-09-14T11:50:29.950 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:29.952+0000 7ff9842539c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.58__multipart_key1.2~LdWvJATBs7AHwzp7jlosH1HGqu5Nsrq.43 2024-09-14T11:50:29.950 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:29.952+0000 7ff9842539c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.58__multipart_key1.2~LdWvJATBs7AHwzp7jlosH1HGqu5Nsrq.44 2024-09-14T11:50:29.950 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:29.952+0000 7ff9842539c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.58__multipart_key1.2~LdWvJATBs7AHwzp7jlosH1HGqu5Nsrq.45 2024-09-14T11:50:29.950 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:29.952+0000 7ff9842539c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.58__multipart_key1.2~LdWvJATBs7AHwzp7jlosH1HGqu5Nsrq.46 2024-09-14T11:50:29.951 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:29.956+0000 7ff9842539c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.58__multipart_key1.2~LdWvJATBs7AHwzp7jlosH1HGqu5Nsrq.47 2024-09-14T11:50:29.951 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:29.956+0000 7ff9842539c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.58__multipart_key1.2~LdWvJATBs7AHwzp7jlosH1HGqu5Nsrq.48 2024-09-14T11:50:29.952 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:29.956+0000 7ff9842539c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.58__multipart_key1.2~LdWvJATBs7AHwzp7jlosH1HGqu5Nsrq.49 2024-09-14T11:50:29.952 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:29.956+0000 7ff9842539c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.58__multipart_key1.2~LdWvJATBs7AHwzp7jlosH1HGqu5Nsrq.50 2024-09-14T11:50:29.953 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:29.956+0000 7ff9842539c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.58__multipart_key1.2~LdWvJATBs7AHwzp7jlosH1HGqu5Nsrq.51 2024-09-14T11:50:29.953 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:29.956+0000 7ff9842539c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.58__multipart_key1.2~LdWvJATBs7AHwzp7jlosH1HGqu5Nsrq.52 2024-09-14T11:50:29.953 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:29.956+0000 7ff9842539c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.58__multipart_key1.2~LdWvJATBs7AHwzp7jlosH1HGqu5Nsrq.53 2024-09-14T11:50:29.955 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:29.960+0000 7ff9842539c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.58__multipart_key1.2~LdWvJATBs7AHwzp7jlosH1HGqu5Nsrq.54 2024-09-14T11:50:29.955 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:29.960+0000 7ff9842539c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.58__multipart_key1.2~LdWvJATBs7AHwzp7jlosH1HGqu5Nsrq.55 2024-09-14T11:50:29.955 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:29.960+0000 7ff9842539c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.58__multipart_key1.2~LdWvJATBs7AHwzp7jlosH1HGqu5Nsrq.56 2024-09-14T11:50:29.955 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:29.960+0000 7ff9842539c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.58__multipart_key1.2~LdWvJATBs7AHwzp7jlosH1HGqu5Nsrq.57 2024-09-14T11:50:29.955 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:29.960+0000 7ff9842539c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.58__multipart_key1.2~LdWvJATBs7AHwzp7jlosH1HGqu5Nsrq.58 2024-09-14T11:50:29.955 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:29.960+0000 7ff9842539c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.58__multipart_key1.2~LdWvJATBs7AHwzp7jlosH1HGqu5Nsrq.59 2024-09-14T11:50:29.957 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:29.960+0000 7ff9842539c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.58__multipart_key1.2~LdWvJATBs7AHwzp7jlosH1HGqu5Nsrq.60 2024-09-14T11:50:29.957 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:29.960+0000 7ff9842539c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.58__multipart_key1.2~LdWvJATBs7AHwzp7jlosH1HGqu5Nsrq.61 2024-09-14T11:50:29.957 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:29.960+0000 7ff9842539c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.58__multipart_key1.2~LdWvJATBs7AHwzp7jlosH1HGqu5Nsrq.62 2024-09-14T11:50:29.958 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:29.960+0000 7ff9842539c0 20 garbage collection: RGWGC::process iterating over entry tag='2~LdWvJATBs7AHwzp7jlosH1HGqu5Nsrq', time=2024-09-14T13:49:46.764986+0000, chain.objs.size()=8 2024-09-14T11:50:29.958 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:29.960+0000 7ff9842539c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.58__multipart_key1.2~LdWvJATBs7AHwzp7jlosH1HGqu5Nsrq.63 2024-09-14T11:50:29.959 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:29.964+0000 7ff9842539c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.58__multipart_key1.2~LdWvJATBs7AHwzp7jlosH1HGqu5Nsrq.64 2024-09-14T11:50:29.959 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:29.964+0000 7ff9842539c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.58__multipart_key1.2~LdWvJATBs7AHwzp7jlosH1HGqu5Nsrq.65 2024-09-14T11:50:29.959 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:29.964+0000 7ff9842539c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.58__multipart_key1.2~LdWvJATBs7AHwzp7jlosH1HGqu5Nsrq.66 2024-09-14T11:50:29.959 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:29.964+0000 7ff9842539c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.58__multipart_key1.2~LdWvJATBs7AHwzp7jlosH1HGqu5Nsrq.67 2024-09-14T11:50:29.959 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:29.964+0000 7ff9842539c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.58__multipart_key1.2~LdWvJATBs7AHwzp7jlosH1HGqu5Nsrq.68 2024-09-14T11:50:29.959 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:29.964+0000 7ff9842539c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.58__multipart_key1.2~LdWvJATBs7AHwzp7jlosH1HGqu5Nsrq.69 2024-09-14T11:50:29.960 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:29.964+0000 7ff9842539c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.58__multipart_key1.2~LdWvJATBs7AHwzp7jlosH1HGqu5Nsrq.72 2024-09-14T11:50:29.963 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:29.968+0000 7ff9842539c0 20 garbage collection: RGWGC::process iterating over entry tag='2~LdWvJATBs7AHwzp7jlosH1HGqu5Nsrq', time=2024-09-14T13:49:48.403013+0000, chain.objs.size()=6 2024-09-14T11:50:29.964 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:29.968+0000 7ff9842539c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.58__multipart_key1.2~LdWvJATBs7AHwzp7jlosH1HGqu5Nsrq.70 2024-09-14T11:50:29.964 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:29.968+0000 7ff9842539c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.58__multipart_key1.2~LdWvJATBs7AHwzp7jlosH1HGqu5Nsrq.71 2024-09-14T11:50:29.964 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:29.968+0000 7ff9842539c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.58__multipart_key1.2~LdWvJATBs7AHwzp7jlosH1HGqu5Nsrq.73 2024-09-14T11:50:29.964 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:29.968+0000 7ff9842539c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.58__multipart_key1.2~LdWvJATBs7AHwzp7jlosH1HGqu5Nsrq.74 2024-09-14T11:50:29.964 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:29.968+0000 7ff9842539c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.58__multipart_key1.2~LdWvJATBs7AHwzp7jlosH1HGqu5Nsrq.75 2024-09-14T11:50:29.964 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:29.968+0000 7ff9842539c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.58__multipart_key1.2~LdWvJATBs7AHwzp7jlosH1HGqu5Nsrq.76 2024-09-14T11:50:29.964 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:29.968+0000 7ff9842539c0 20 garbage collection: RGWGC::process iterating over entry tag='2~LdWvJATBs7AHwzp7jlosH1HGqu5Nsrq', time=2024-09-14T13:49:50.008481+0000, chain.objs.size()=6 2024-09-14T11:50:29.964 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:29.968+0000 7ff9842539c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.58__multipart_key1.2~LdWvJATBs7AHwzp7jlosH1HGqu5Nsrq.77 2024-09-14T11:50:29.964 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:29.968+0000 7ff9842539c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.58__multipart_key1.2~LdWvJATBs7AHwzp7jlosH1HGqu5Nsrq.78 2024-09-14T11:50:29.966 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:29.968+0000 7ff9842539c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.58__multipart_key1.2~LdWvJATBs7AHwzp7jlosH1HGqu5Nsrq.79 2024-09-14T11:50:29.966 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:29.968+0000 7ff9842539c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.58__multipart_key1.2~LdWvJATBs7AHwzp7jlosH1HGqu5Nsrq.80 2024-09-14T11:50:29.966 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:29.968+0000 7ff9842539c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.58__multipart_key1.2~LdWvJATBs7AHwzp7jlosH1HGqu5Nsrq.81 2024-09-14T11:50:29.967 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:29.968+0000 7ff9842539c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.58__multipart_key1.2~LdWvJATBs7AHwzp7jlosH1HGqu5Nsrq.82 2024-09-14T11:50:29.967 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:29.968+0000 7ff9842539c0 20 garbage collection: RGWGC::process iterating over entry tag='2~LdWvJATBs7AHwzp7jlosH1HGqu5Nsrq', time=2024-09-14T13:49:50.768096+0000, chain.objs.size()=5 2024-09-14T11:50:29.967 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:29.968+0000 7ff9842539c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.58__multipart_key1.2~LdWvJATBs7AHwzp7jlosH1HGqu5Nsrq.83 2024-09-14T11:50:29.967 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:29.968+0000 7ff9842539c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.58__multipart_key1.2~LdWvJATBs7AHwzp7jlosH1HGqu5Nsrq.84 2024-09-14T11:50:29.967 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:29.972+0000 7ff9842539c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.58__multipart_key1.2~LdWvJATBs7AHwzp7jlosH1HGqu5Nsrq.85 2024-09-14T11:50:29.967 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:29.972+0000 7ff9842539c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.58__multipart_key1.2~LdWvJATBs7AHwzp7jlosH1HGqu5Nsrq.86 2024-09-14T11:50:29.967 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:29.972+0000 7ff9842539c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.58__multipart_key1.2~LdWvJATBs7AHwzp7jlosH1HGqu5Nsrq.87 2024-09-14T11:50:29.968 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:29.972+0000 7ff9842539c0 20 garbage collection: RGWGC::process iterating over entry tag='2~LdWvJATBs7AHwzp7jlosH1HGqu5Nsrq', time=2024-09-14T13:49:51.182097+0000, chain.objs.size()=5 2024-09-14T11:50:29.968 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:29.972+0000 7ff9842539c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.58__multipart_key1.2~LdWvJATBs7AHwzp7jlosH1HGqu5Nsrq.88 2024-09-14T11:50:29.969 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:29.972+0000 7ff9842539c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.58__multipart_key1.2~LdWvJATBs7AHwzp7jlosH1HGqu5Nsrq.89 2024-09-14T11:50:29.971 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:29.976+0000 7ff9842539c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.58__multipart_key1.2~LdWvJATBs7AHwzp7jlosH1HGqu5Nsrq.90 2024-09-14T11:50:29.972 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:29.976+0000 7ff9842539c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.58__multipart_key1.2~LdWvJATBs7AHwzp7jlosH1HGqu5Nsrq.91 2024-09-14T11:50:29.972 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:29.976+0000 7ff9842539c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.58__multipart_key1.2~LdWvJATBs7AHwzp7jlosH1HGqu5Nsrq.92 2024-09-14T11:50:29.974 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:29.976+0000 7ff9842539c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T11:50:29.977 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:29.980+0000 7ff9842539c0 20 garbage collection: RGWGC::process entered with GC index_shard=2, max_secs=3600, expired_only=0 2024-09-14T11:50:29.978 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:29.980+0000 7ff9842539c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:50:29.978 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:29.984+0000 7ff9842539c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:50:29.979 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:29.984+0000 7ff9842539c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2024-09-14T11:50:29.979 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:29.984+0000 7ff9842539c0 20 garbage collection: RGWGC::process iterating over entry tag='d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.6995477385242359166', time=2024-09-14T13:45:02.985652+0000, chain.objs.size()=5 2024-09-14T11:50:29.979 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:29.984+0000 7ff9842539c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.46__shadow_.H0fqWv0gOnP7gmNFjIAZXvSG1pd5Y2-_1 2024-09-14T11:50:29.979 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:29.984+0000 7ff9842539c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.46__shadow_.H0fqWv0gOnP7gmNFjIAZXvSG1pd5Y2-_2 2024-09-14T11:50:29.979 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:29.984+0000 7ff9842539c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.46__shadow_.H0fqWv0gOnP7gmNFjIAZXvSG1pd5Y2-_3 2024-09-14T11:50:29.979 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:29.984+0000 7ff9842539c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.46__shadow_.H0fqWv0gOnP7gmNFjIAZXvSG1pd5Y2-_4 2024-09-14T11:50:29.979 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:29.984+0000 7ff9842539c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.46__shadow_.H0fqWv0gOnP7gmNFjIAZXvSG1pd5Y2-_5 2024-09-14T11:50:29.982 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:29.984+0000 7ff9842539c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T11:50:29.985 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:29.988+0000 7ff9842539c0 20 garbage collection: RGWGC::process entered with GC index_shard=3, max_secs=3600, expired_only=0 2024-09-14T11:50:29.986 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:29.988+0000 7ff9842539c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:50:29.986 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:29.988+0000 7ff9842539c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:50:29.987 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:29.992+0000 7ff9842539c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:50:29.988 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:29.992+0000 7ff9842539c0 20 garbage collection: RGWGC::process entered with GC index_shard=4, max_secs=3600, expired_only=0 2024-09-14T11:50:29.989 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:29.992+0000 7ff9842539c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:50:29.990 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:29.992+0000 7ff9842539c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:50:29.990 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:29.992+0000 7ff9842539c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2024-09-14T11:50:29.991 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:29.992+0000 7ff9842539c0 20 garbage collection: RGWGC::process iterating over entry tag='d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.16106037336318452226', time=2024-09-14T13:45:03.694917+0000, chain.objs.size()=7 2024-09-14T11:50:29.991 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:29.992+0000 7ff9842539c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.47__multipart_key1.2~YhzCus8m5TGOJ9mQJjaJc3k_oOYyGSD.1 2024-09-14T11:50:29.991 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:29.992+0000 7ff9842539c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.47__shadow_key1.2~YhzCus8m5TGOJ9mQJjaJc3k_oOYyGSD.1_1 2024-09-14T11:50:29.991 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:29.992+0000 7ff9842539c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.47__shadow_key1.2~YhzCus8m5TGOJ9mQJjaJc3k_oOYyGSD.1_2 2024-09-14T11:50:29.991 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:29.992+0000 7ff9842539c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.47__multipart_key1.2~YhzCus8m5TGOJ9mQJjaJc3k_oOYyGSD.2 2024-09-14T11:50:29.991 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:29.992+0000 7ff9842539c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.47__shadow_key1.2~YhzCus8m5TGOJ9mQJjaJc3k_oOYyGSD.2_1 2024-09-14T11:50:29.991 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:29.992+0000 7ff9842539c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.47__shadow_key1.2~YhzCus8m5TGOJ9mQJjaJc3k_oOYyGSD.2_2 2024-09-14T11:50:29.991 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:29.992+0000 7ff9842539c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.47__multipart_key1.2~YhzCus8m5TGOJ9mQJjaJc3k_oOYyGSD.3 2024-09-14T11:50:29.993 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:29.996+0000 7ff9842539c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T11:50:29.999 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:30.004+0000 7ff8337fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:50:30.002 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:30.004+0000 7ff9842539c0 20 remove_watcher() i=0 2024-09-14T11:50:30.002 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:30.004+0000 7ff9842539c0 2 removed watcher, disabling cache 2024-09-14T11:50:30.003 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:30.008+0000 7ff9842539c0 20 remove_watcher() i=1 2024-09-14T11:50:30.004 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:30.008+0000 7ff9842539c0 20 remove_watcher() i=2 2024-09-14T11:50:30.005 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:30.008+0000 7ff9842539c0 20 remove_watcher() i=3 2024-09-14T11:50:30.006 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:30.008+0000 7ff9842539c0 20 remove_watcher() i=4 2024-09-14T11:50:30.007 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:30.012+0000 7ff9842539c0 20 remove_watcher() i=5 2024-09-14T11:50:30.008 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:30.012+0000 7ff9842539c0 20 remove_watcher() i=6 2024-09-14T11:50:30.009 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:30.012+0000 7ff9842539c0 20 remove_watcher() i=7 2024-09-14T11:50:30.022 DEBUG:teuthology.orchestra.run.smithi138:> radosgw-admin gc process --include-all 2024-09-14T11:50:30.095 INFO:teuthology.orchestra.run.smithi138.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:50:30.095 INFO:teuthology.orchestra.run.smithi138.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:50:30.139 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:30.144+0000 7f53ce41a9c0 20 rados->read ofs=0 len=0 2024-09-14T11:50:30.141 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:30.144+0000 7f53ce41a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:50:30.141 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:30.144+0000 7f53ce41a9c0 20 realm 2024-09-14T11:50:30.141 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:30.144+0000 7f53ce41a9c0 20 rados->read ofs=0 len=0 2024-09-14T11:50:30.141 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:30.144+0000 7f53ce41a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:50:30.141 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:30.144+0000 7f53ce41a9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:50:30.141 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:30.144+0000 7f53ce41a9c0 20 rados->read ofs=0 len=0 2024-09-14T11:50:30.141 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:30.144+0000 7f53ce41a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:50:30.141 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:30.144+0000 7f53ce41a9c0 20 rados->read ofs=0 len=0 2024-09-14T11:50:30.143 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:30.148+0000 7f53ce41a9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:50:30.143 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:30.148+0000 7f53ce41a9c0 20 rados->read ofs=0 len=0 2024-09-14T11:50:30.143 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:30.148+0000 7f53ce41a9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:50:30.143 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:30.148+0000 7f53ce41a9c0 20 searching for the correct realm 2024-09-14T11:50:30.149 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:30.152+0000 7f53cbf20640 0 -- 172.21.15.138:0/4083565702 >> [v2:172.21.15.138:6808/3258321916,v1:172.21.15.138:6809/3258321916] conn(0x5633ed6210f0 msgr2=0x5633ed6235b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:50:30.155 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:30.160+0000 7f53cb71f640 0 -- 172.21.15.138:0/4083565702 >> [v2:172.21.15.138:6816/326481658,v1:172.21.15.138:6817/326481658] conn(0x7f53c4022950 msgr2=0x7f53c40103e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:50:30.374 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:30.376+0000 7f53ce41a9c0 20 RGWRados::pool_iterate: got zone_info.d9e72d30-c60b-4d0d-9267-fdc36392d5ad 2024-09-14T11:50:30.374 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:30.376+0000 7f53ce41a9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:50:30.375 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:30.376+0000 7f53ce41a9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:50:30.375 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:30.376+0000 7f53ce41a9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:50:30.375 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:30.376+0000 7f53ce41a9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:50:30.375 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:30.376+0000 7f53ce41a9c0 20 RGWRados::pool_iterate: got zonegroup_info.65ab941b-da8c-4160-94fb-3672b069d44f 2024-09-14T11:50:30.375 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:30.376+0000 7f53ce41a9c0 20 rados->read ofs=0 len=0 2024-09-14T11:50:30.375 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:30.380+0000 7f53ce41a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:50:30.375 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:30.380+0000 7f53ce41a9c0 20 rados->read ofs=0 len=0 2024-09-14T11:50:30.376 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:30.380+0000 7f53ce41a9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:50:30.376 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:30.380+0000 7f53ce41a9c0 20 rados->read ofs=0 len=0 2024-09-14T11:50:30.377 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:30.380+0000 7f53ce41a9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:50:30.377 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:30.380+0000 7f53ce41a9c0 20 zone default found 2024-09-14T11:50:30.377 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:30.380+0000 7f53ce41a9c0 4 Realm: () 2024-09-14T11:50:30.377 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:30.380+0000 7f53ce41a9c0 4 ZoneGroup: default (65ab941b-da8c-4160-94fb-3672b069d44f) 2024-09-14T11:50:30.377 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:30.380+0000 7f53ce41a9c0 4 Zone: default (d9e72d30-c60b-4d0d-9267-fdc36392d5ad) 2024-09-14T11:50:30.377 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:30.380+0000 7f53ce41a9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:50:30.377 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:30.380+0000 7f53ce41a9c0 20 zonegroup default 2024-09-14T11:50:30.378 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:30.380+0000 7f53ce41a9c0 20 rados->read ofs=0 len=0 2024-09-14T11:50:30.378 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:30.380+0000 7f53ce41a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:50:30.378 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:30.380+0000 7f53ce41a9c0 20 rados->read ofs=0 len=0 2024-09-14T11:50:30.378 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:30.380+0000 7f53ce41a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:50:30.378 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:30.380+0000 7f53ce41a9c0 20 rados->read ofs=0 len=0 2024-09-14T11:50:30.379 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:30.384+0000 7f53ce41a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:50:30.379 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:30.384+0000 7f53ce41a9c0 20 started sync module instance, tier type = 2024-09-14T11:50:30.379 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:30.384+0000 7f53ce41a9c0 20 started zone id=d9e72d30-c60b-4d0d-9267-fdc36392d5ad (name=default) with tier type = 2024-09-14T11:50:30.402 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:30.404+0000 7f53ce41a9c0 20 add_watcher() i=0 2024-09-14T11:50:30.402 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:30.404+0000 7f53ce41a9c0 20 add_watcher() i=1 2024-09-14T11:50:30.402 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:30.404+0000 7f53ce41a9c0 20 add_watcher() i=2 2024-09-14T11:50:30.402 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:30.404+0000 7f53ce41a9c0 20 add_watcher() i=3 2024-09-14T11:50:30.402 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:30.404+0000 7f53ce41a9c0 20 add_watcher() i=4 2024-09-14T11:50:30.402 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:30.404+0000 7f53ce41a9c0 20 add_watcher() i=5 2024-09-14T11:50:30.402 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:30.404+0000 7f53ce41a9c0 20 add_watcher() i=6 2024-09-14T11:50:30.404 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:30.408+0000 7f53ce41a9c0 20 add_watcher() i=7 2024-09-14T11:50:30.404 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:30.408+0000 7f53ce41a9c0 2 all 8 watchers are set, enabling cache 2024-09-14T11:50:30.407 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:30.412+0000 7f5281fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:50:30.408 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:30.412+0000 7f53ce41a9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:50:30.408 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:30.412+0000 7f53ce41a9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:50:30.495 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:30.496+0000 7f5280fe1640 20 reqs_thread_entry: start 2024-09-14T11:50:30.495 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:30.500+0000 7f53ce41a9c0 20 init_complete bucket index max shards: 11 2024-09-14T11:50:30.495 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:30.500+0000 7f53ce41a9c0 20 Filter name: none 2024-09-14T11:50:30.495 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:30.500+0000 7f51fa7fc640 20 reqs_thread_entry: start 2024-09-14T11:50:30.495 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:30.500+0000 7f53ce41a9c0 20 garbage collection: RGWGC::process entered with GC index_shard=24, max_secs=3600, expired_only=0 2024-09-14T11:50:30.498 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:30.500+0000 7f53ce41a9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:50:30.499 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:30.504+0000 7f53ce41a9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:50:30.499 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:30.504+0000 7f53ce41a9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:50:30.501 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:30.504+0000 7f53ce41a9c0 20 garbage collection: RGWGC::process entered with GC index_shard=25, max_secs=3600, expired_only=0 2024-09-14T11:50:30.504 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:30.508+0000 7f53ce41a9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:50:30.504 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:30.508+0000 7f53ce41a9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:50:30.505 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:30.508+0000 7f53ce41a9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:50:30.507 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:30.512+0000 7f53ce41a9c0 20 garbage collection: RGWGC::process entered with GC index_shard=26, max_secs=3600, expired_only=0 2024-09-14T11:50:30.509 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:30.512+0000 7f53ce41a9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:50:30.510 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:30.512+0000 7f53ce41a9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:50:30.510 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:30.516+0000 7f53ce41a9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:50:30.513 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:30.516+0000 7f53ce41a9c0 20 garbage collection: RGWGC::process entered with GC index_shard=27, max_secs=3600, expired_only=0 2024-09-14T11:50:30.516 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:30.520+0000 7f53ce41a9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:50:30.518 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:30.520+0000 7f53ce41a9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:50:30.519 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:30.524+0000 7f53ce41a9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:50:30.521 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:30.524+0000 7f53ce41a9c0 20 garbage collection: RGWGC::process entered with GC index_shard=28, max_secs=3600, expired_only=0 2024-09-14T11:50:30.524 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:30.528+0000 7f53ce41a9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:50:30.526 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:30.528+0000 7f53ce41a9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:50:30.526 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:30.528+0000 7f53ce41a9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:50:30.528 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:30.532+0000 7f53ce41a9c0 20 garbage collection: RGWGC::process entered with GC index_shard=29, max_secs=3600, expired_only=0 2024-09-14T11:50:30.531 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:30.536+0000 7f53ce41a9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:50:30.533 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:30.536+0000 7f53ce41a9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:50:30.535 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:30.540+0000 7f53ce41a9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:50:30.538 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:30.540+0000 7f53ce41a9c0 20 garbage collection: RGWGC::process entered with GC index_shard=30, max_secs=3600, expired_only=0 2024-09-14T11:50:30.539 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:30.544+0000 7f53ce41a9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:50:30.540 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:30.544+0000 7f53ce41a9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:50:30.540 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:30.544+0000 7f53ce41a9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:50:30.542 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:30.544+0000 7f53ce41a9c0 20 garbage collection: RGWGC::process entered with GC index_shard=31, max_secs=3600, expired_only=0 2024-09-14T11:50:30.544 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:30.548+0000 7f53ce41a9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:50:30.545 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:30.548+0000 7f53ce41a9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:50:30.545 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:30.548+0000 7f53ce41a9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:50:30.546 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:30.548+0000 7f53ce41a9c0 20 garbage collection: RGWGC::process entered with GC index_shard=0, max_secs=3600, expired_only=0 2024-09-14T11:50:30.549 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:30.552+0000 7f53ce41a9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:50:30.551 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:30.556+0000 7f53ce41a9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:50:30.551 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:30.556+0000 7f53ce41a9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:50:30.554 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:30.556+0000 7f53ce41a9c0 20 garbage collection: RGWGC::process entered with GC index_shard=1, max_secs=3600, expired_only=0 2024-09-14T11:50:30.556 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:30.560+0000 7f53ce41a9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:50:30.557 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:30.560+0000 7f53ce41a9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:50:30.557 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:30.560+0000 7f53ce41a9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:50:30.559 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:30.564+0000 7f53ce41a9c0 20 garbage collection: RGWGC::process entered with GC index_shard=2, max_secs=3600, expired_only=0 2024-09-14T11:50:30.562 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:30.564+0000 7f53ce41a9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:50:30.563 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:30.568+0000 7f53ce41a9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:50:30.564 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:30.568+0000 7f53ce41a9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:50:30.566 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:30.568+0000 7f53ce41a9c0 20 garbage collection: RGWGC::process entered with GC index_shard=3, max_secs=3600, expired_only=0 2024-09-14T11:50:30.569 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:30.572+0000 7f53ce41a9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:50:30.570 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:30.572+0000 7f53ce41a9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:50:30.570 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:30.572+0000 7f53ce41a9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:50:30.573 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:30.576+0000 7f53ce41a9c0 20 garbage collection: RGWGC::process entered with GC index_shard=4, max_secs=3600, expired_only=0 2024-09-14T11:50:30.576 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:30.580+0000 7f53ce41a9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:50:30.578 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:30.580+0000 7f53ce41a9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:50:30.579 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:30.584+0000 7f53ce41a9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:50:30.582 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:30.584+0000 7f53ce41a9c0 20 garbage collection: RGWGC::process entered with GC index_shard=5, max_secs=3600, expired_only=0 2024-09-14T11:50:30.585 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:30.588+0000 7f53ce41a9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:50:30.586 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:30.588+0000 7f53ce41a9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:50:30.587 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:30.592+0000 7f53ce41a9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:50:30.589 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:30.592+0000 7f53ce41a9c0 20 garbage collection: RGWGC::process entered with GC index_shard=6, max_secs=3600, expired_only=0 2024-09-14T11:50:30.593 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:30.596+0000 7f53ce41a9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:50:30.594 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:30.596+0000 7f53ce41a9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:50:30.594 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:30.596+0000 7f53ce41a9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:50:30.597 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:30.600+0000 7f53ce41a9c0 20 garbage collection: RGWGC::process entered with GC index_shard=7, max_secs=3600, expired_only=0 2024-09-14T11:50:30.600 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:30.604+0000 7f53ce41a9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:50:30.601 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:30.604+0000 7f53ce41a9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:50:30.602 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:30.604+0000 7f53ce41a9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:50:30.604 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:30.608+0000 7f53ce41a9c0 20 garbage collection: RGWGC::process entered with GC index_shard=8, max_secs=3600, expired_only=0 2024-09-14T11:50:30.607 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:30.612+0000 7f53ce41a9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:50:30.609 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:30.612+0000 7f53ce41a9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:50:30.609 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:30.612+0000 7f53ce41a9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:50:30.612 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:30.616+0000 7f53ce41a9c0 20 garbage collection: RGWGC::process entered with GC index_shard=9, max_secs=3600, expired_only=0 2024-09-14T11:50:30.616 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:30.620+0000 7f53ce41a9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:50:30.618 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:30.620+0000 7f53ce41a9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:50:30.618 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:30.620+0000 7f53ce41a9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:50:30.624 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:30.628+0000 7f53ce41a9c0 20 garbage collection: RGWGC::process entered with GC index_shard=10, max_secs=3600, expired_only=0 2024-09-14T11:50:30.628 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:30.632+0000 7f53ce41a9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:50:30.629 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:30.632+0000 7f53ce41a9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:50:30.630 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:30.632+0000 7f53ce41a9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:50:30.633 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:30.636+0000 7f53ce41a9c0 20 garbage collection: RGWGC::process entered with GC index_shard=11, max_secs=3600, expired_only=0 2024-09-14T11:50:30.638 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:30.640+0000 7f53ce41a9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:50:30.639 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:30.644+0000 7f53ce41a9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:50:30.640 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:30.644+0000 7f53ce41a9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:50:30.642 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:30.644+0000 7f53ce41a9c0 20 garbage collection: RGWGC::process entered with GC index_shard=12, max_secs=3600, expired_only=0 2024-09-14T11:50:30.645 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:30.648+0000 7f53ce41a9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:50:30.647 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:30.652+0000 7f53ce41a9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:50:30.647 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:30.652+0000 7f53ce41a9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:50:30.650 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:30.652+0000 7f53ce41a9c0 20 garbage collection: RGWGC::process entered with GC index_shard=13, max_secs=3600, expired_only=0 2024-09-14T11:50:30.653 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:30.656+0000 7f53ce41a9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:50:30.654 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:30.656+0000 7f53ce41a9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:50:30.654 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:30.656+0000 7f53ce41a9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:50:30.656 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:30.660+0000 7f53ce41a9c0 20 garbage collection: RGWGC::process entered with GC index_shard=14, max_secs=3600, expired_only=0 2024-09-14T11:50:30.659 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:30.664+0000 7f53ce41a9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:50:30.660 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:30.664+0000 7f53ce41a9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:50:30.661 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:30.664+0000 7f53ce41a9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:50:30.663 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:30.668+0000 7f53ce41a9c0 20 garbage collection: RGWGC::process entered with GC index_shard=15, max_secs=3600, expired_only=0 2024-09-14T11:50:30.668 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:30.672+0000 7f53ce41a9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:50:30.670 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:30.672+0000 7f53ce41a9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:50:30.671 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:30.676+0000 7f53ce41a9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:50:30.674 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:30.676+0000 7f53ce41a9c0 20 garbage collection: RGWGC::process entered with GC index_shard=16, max_secs=3600, expired_only=0 2024-09-14T11:50:30.678 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:30.680+0000 7f53ce41a9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:50:30.680 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:30.684+0000 7f53ce41a9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:50:30.681 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:30.684+0000 7f53ce41a9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:50:30.684 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:30.688+0000 7f53ce41a9c0 20 garbage collection: RGWGC::process entered with GC index_shard=17, max_secs=3600, expired_only=0 2024-09-14T11:50:30.687 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:30.692+0000 7f53ce41a9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:50:30.689 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:30.692+0000 7f53ce41a9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:50:30.690 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:30.692+0000 7f53ce41a9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:50:30.693 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:30.696+0000 7f53ce41a9c0 20 garbage collection: RGWGC::process entered with GC index_shard=18, max_secs=3600, expired_only=0 2024-09-14T11:50:30.696 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:30.700+0000 7f53ce41a9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:50:30.697 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:30.700+0000 7f53ce41a9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:50:30.699 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:30.700+0000 7f53ce41a9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:50:30.701 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:30.704+0000 7f53ce41a9c0 20 garbage collection: RGWGC::process entered with GC index_shard=19, max_secs=3600, expired_only=0 2024-09-14T11:50:30.705 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:30.708+0000 7f53ce41a9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:50:30.706 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:30.712+0000 7f53ce41a9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:50:30.707 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:30.712+0000 7f53ce41a9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:50:30.710 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:30.712+0000 7f53ce41a9c0 20 garbage collection: RGWGC::process entered with GC index_shard=20, max_secs=3600, expired_only=0 2024-09-14T11:50:30.715 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:30.720+0000 7f53ce41a9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:50:30.717 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:30.720+0000 7f53ce41a9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:50:30.718 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:30.720+0000 7f53ce41a9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:50:30.721 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:30.724+0000 7f53ce41a9c0 20 garbage collection: RGWGC::process entered with GC index_shard=21, max_secs=3600, expired_only=0 2024-09-14T11:50:30.725 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:30.728+0000 7f53ce41a9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:50:30.726 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:30.728+0000 7f53ce41a9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:50:30.727 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:30.732+0000 7f53ce41a9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:50:30.730 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:30.732+0000 7f53ce41a9c0 20 garbage collection: RGWGC::process entered with GC index_shard=22, max_secs=3600, expired_only=0 2024-09-14T11:50:30.733 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:30.736+0000 7f53ce41a9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:50:30.735 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:30.740+0000 7f53ce41a9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:50:30.736 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:30.740+0000 7f53ce41a9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:50:30.738 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:30.740+0000 7f53ce41a9c0 20 garbage collection: RGWGC::process entered with GC index_shard=23, max_secs=3600, expired_only=0 2024-09-14T11:50:30.742 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:30.744+0000 7f53ce41a9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:50:30.745 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:30.748+0000 7f53ce41a9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:50:30.746 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:30.748+0000 7f53ce41a9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:50:30.750 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:30.752+0000 7f5281fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:50:30.756 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:30.760+0000 7f53ce41a9c0 20 remove_watcher() i=0 2024-09-14T11:50:30.756 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:30.760+0000 7f53ce41a9c0 2 removed watcher, disabling cache 2024-09-14T11:50:30.759 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:30.764+0000 7f53ce41a9c0 20 remove_watcher() i=1 2024-09-14T11:50:30.762 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:30.764+0000 7f53ce41a9c0 20 remove_watcher() i=2 2024-09-14T11:50:30.764 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:30.768+0000 7f53ce41a9c0 20 remove_watcher() i=3 2024-09-14T11:50:30.766 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:30.768+0000 7f53ce41a9c0 20 remove_watcher() i=4 2024-09-14T11:50:30.768 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:30.772+0000 7f53ce41a9c0 20 remove_watcher() i=5 2024-09-14T11:50:30.771 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:30.776+0000 7f53ce41a9c0 20 remove_watcher() i=6 2024-09-14T11:50:30.773 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:30.776+0000 7f53ce41a9c0 20 remove_watcher() i=7 2024-09-14T11:50:30.794 DEBUG:teuthology.orchestra.run.smithi138:> radosgw-admin gc process --include-all 2024-09-14T11:50:30.865 INFO:teuthology.orchestra.run.smithi138.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:50:30.865 INFO:teuthology.orchestra.run.smithi138.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:50:30.913 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:30.916+0000 7f4c8a9e39c0 20 rados->read ofs=0 len=0 2024-09-14T11:50:30.914 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:30.916+0000 7f4c8a9e39c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:50:30.915 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:30.916+0000 7f4c8a9e39c0 20 realm 2024-09-14T11:50:30.915 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:30.916+0000 7f4c8a9e39c0 20 rados->read ofs=0 len=0 2024-09-14T11:50:30.915 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:30.916+0000 7f4c8a9e39c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:50:30.915 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:30.916+0000 7f4c8a9e39c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:50:30.915 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:30.916+0000 7f4c8a9e39c0 20 rados->read ofs=0 len=0 2024-09-14T11:50:30.915 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:30.920+0000 7f4c8a9e39c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:50:30.915 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:30.920+0000 7f4c8a9e39c0 20 rados->read ofs=0 len=0 2024-09-14T11:50:30.916 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:30.920+0000 7f4c8a9e39c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:50:30.916 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:30.920+0000 7f4c8a9e39c0 20 rados->read ofs=0 len=0 2024-09-14T11:50:30.917 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:30.920+0000 7f4c8a9e39c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:50:30.917 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:30.920+0000 7f4c8a9e39c0 20 searching for the correct realm 2024-09-14T11:50:30.920 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:30.924+0000 7f4c88cea640 0 -- 172.21.15.138:0/3378418935 >> [v2:172.21.15.154:6824/416768175,v1:172.21.15.154:6825/416768175] conn(0x7f4c80008040 msgr2=0x7f4c80066870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:50:31.136 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:31.140+0000 7f4c87ce8640 0 -- 172.21.15.138:0/3378418935 >> [v2:172.21.15.138:6816/326481658,v1:172.21.15.138:6817/326481658] conn(0x7f4c80063610 msgr2=0x7f4c80063a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:50:31.354 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:31.356+0000 7f4c8a9e39c0 20 RGWRados::pool_iterate: got zone_info.d9e72d30-c60b-4d0d-9267-fdc36392d5ad 2024-09-14T11:50:31.354 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:31.356+0000 7f4c8a9e39c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:50:31.354 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:31.356+0000 7f4c8a9e39c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:50:31.354 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:31.356+0000 7f4c8a9e39c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:50:31.355 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:31.356+0000 7f4c8a9e39c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:50:31.355 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:31.356+0000 7f4c8a9e39c0 20 RGWRados::pool_iterate: got zonegroup_info.65ab941b-da8c-4160-94fb-3672b069d44f 2024-09-14T11:50:31.355 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:31.356+0000 7f4c8a9e39c0 20 rados->read ofs=0 len=0 2024-09-14T11:50:31.355 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:31.360+0000 7f4c8a9e39c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:50:31.355 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:31.360+0000 7f4c8a9e39c0 20 rados->read ofs=0 len=0 2024-09-14T11:50:31.356 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:31.360+0000 7f4c8a9e39c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:50:31.356 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:31.360+0000 7f4c8a9e39c0 20 rados->read ofs=0 len=0 2024-09-14T11:50:31.357 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:31.360+0000 7f4c8a9e39c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:50:31.357 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:31.360+0000 7f4c8a9e39c0 20 zone default found 2024-09-14T11:50:31.357 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:31.360+0000 7f4c8a9e39c0 4 Realm: () 2024-09-14T11:50:31.357 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:31.360+0000 7f4c8a9e39c0 4 ZoneGroup: default (65ab941b-da8c-4160-94fb-3672b069d44f) 2024-09-14T11:50:31.357 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:31.360+0000 7f4c8a9e39c0 4 Zone: default (d9e72d30-c60b-4d0d-9267-fdc36392d5ad) 2024-09-14T11:50:31.357 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:31.360+0000 7f4c8a9e39c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:50:31.357 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:31.360+0000 7f4c8a9e39c0 20 zonegroup default 2024-09-14T11:50:31.357 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:31.360+0000 7f4c8a9e39c0 20 rados->read ofs=0 len=0 2024-09-14T11:50:31.358 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:31.360+0000 7f4c8a9e39c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:50:31.358 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:31.360+0000 7f4c8a9e39c0 20 rados->read ofs=0 len=0 2024-09-14T11:50:31.358 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:31.360+0000 7f4c8a9e39c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:50:31.358 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:31.360+0000 7f4c8a9e39c0 20 rados->read ofs=0 len=0 2024-09-14T11:50:31.359 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:31.364+0000 7f4c8a9e39c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:50:31.359 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:31.364+0000 7f4c8a9e39c0 20 started sync module instance, tier type = 2024-09-14T11:50:31.359 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:31.364+0000 7f4c8a9e39c0 20 started zone id=d9e72d30-c60b-4d0d-9267-fdc36392d5ad (name=default) with tier type = 2024-09-14T11:50:31.381 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:31.384+0000 7f4c8a9e39c0 20 add_watcher() i=0 2024-09-14T11:50:31.381 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:31.384+0000 7f4c8a9e39c0 20 add_watcher() i=1 2024-09-14T11:50:31.381 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:31.384+0000 7f4c8a9e39c0 20 add_watcher() i=2 2024-09-14T11:50:31.381 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:31.384+0000 7f4c8a9e39c0 20 add_watcher() i=3 2024-09-14T11:50:31.381 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:31.384+0000 7f4c8a9e39c0 20 add_watcher() i=4 2024-09-14T11:50:31.381 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:31.384+0000 7f4c8a9e39c0 20 add_watcher() i=5 2024-09-14T11:50:31.381 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:31.384+0000 7f4c8a9e39c0 20 add_watcher() i=6 2024-09-14T11:50:31.383 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:31.388+0000 7f4c8a9e39c0 20 add_watcher() i=7 2024-09-14T11:50:31.383 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:31.388+0000 7f4c8a9e39c0 2 all 8 watchers are set, enabling cache 2024-09-14T11:50:31.386 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:31.388+0000 7f4b3efdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:50:31.386 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:31.392+0000 7f4c8a9e39c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:50:31.386 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:31.392+0000 7f4c8a9e39c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:50:31.472 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:31.476+0000 7f4b3dfdb640 20 reqs_thread_entry: start 2024-09-14T11:50:31.473 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:31.476+0000 7f4c8a9e39c0 20 init_complete bucket index max shards: 11 2024-09-14T11:50:31.473 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:31.476+0000 7f4c8a9e39c0 20 Filter name: none 2024-09-14T11:50:31.473 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:31.476+0000 7f4aaf7fe640 20 reqs_thread_entry: start 2024-09-14T11:50:31.473 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:31.476+0000 7f4c8a9e39c0 20 garbage collection: RGWGC::process entered with GC index_shard=5, max_secs=3600, expired_only=0 2024-09-14T11:50:31.475 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:31.480+0000 7f4c8a9e39c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:50:31.475 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:31.480+0000 7f4c8a9e39c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:50:31.476 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:31.480+0000 7f4c8a9e39c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:50:31.478 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:31.480+0000 7f4c8a9e39c0 20 garbage collection: RGWGC::process entered with GC index_shard=6, max_secs=3600, expired_only=0 2024-09-14T11:50:31.481 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:31.484+0000 7f4c8a9e39c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:50:31.482 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:31.484+0000 7f4c8a9e39c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:50:31.482 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:31.488+0000 7f4c8a9e39c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:50:31.485 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:31.488+0000 7f4c8a9e39c0 20 garbage collection: RGWGC::process entered with GC index_shard=7, max_secs=3600, expired_only=0 2024-09-14T11:50:31.488 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:31.492+0000 7f4c8a9e39c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:50:31.489 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:31.492+0000 7f4c8a9e39c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:50:31.489 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:31.492+0000 7f4c8a9e39c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:50:31.491 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:31.496+0000 7f4c8a9e39c0 20 garbage collection: RGWGC::process entered with GC index_shard=8, max_secs=3600, expired_only=0 2024-09-14T11:50:31.494 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:31.496+0000 7f4c8a9e39c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:50:31.496 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:31.500+0000 7f4c8a9e39c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:50:31.497 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:31.500+0000 7f4c8a9e39c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:50:31.499 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:31.504+0000 7f4c8a9e39c0 20 garbage collection: RGWGC::process entered with GC index_shard=9, max_secs=3600, expired_only=0 2024-09-14T11:50:31.502 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:31.508+0000 7f4c8a9e39c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:50:31.504 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:31.508+0000 7f4c8a9e39c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:50:31.505 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:31.508+0000 7f4c8a9e39c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:50:31.508 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:31.512+0000 7f4c8a9e39c0 20 garbage collection: RGWGC::process entered with GC index_shard=10, max_secs=3600, expired_only=0 2024-09-14T11:50:31.511 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:31.516+0000 7f4c8a9e39c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:50:31.513 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:31.516+0000 7f4c8a9e39c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:50:31.514 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:31.516+0000 7f4c8a9e39c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:50:31.517 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:31.520+0000 7f4c8a9e39c0 20 garbage collection: RGWGC::process entered with GC index_shard=11, max_secs=3600, expired_only=0 2024-09-14T11:50:31.519 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:31.524+0000 7f4c8a9e39c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:50:31.519 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:31.524+0000 7f4c8a9e39c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:50:31.520 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:31.524+0000 7f4c8a9e39c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:50:31.521 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:31.524+0000 7f4c8a9e39c0 20 garbage collection: RGWGC::process entered with GC index_shard=12, max_secs=3600, expired_only=0 2024-09-14T11:50:31.525 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:31.528+0000 7f4c8a9e39c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:50:31.526 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:31.528+0000 7f4c8a9e39c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:50:31.526 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:31.532+0000 7f4c8a9e39c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:50:31.530 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:31.532+0000 7f4c8a9e39c0 20 garbage collection: RGWGC::process entered with GC index_shard=13, max_secs=3600, expired_only=0 2024-09-14T11:50:31.532 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:31.536+0000 7f4c8a9e39c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:50:31.533 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:31.536+0000 7f4c8a9e39c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:50:31.534 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:31.536+0000 7f4c8a9e39c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:50:31.536 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:31.540+0000 7f4c8a9e39c0 20 garbage collection: RGWGC::process entered with GC index_shard=14, max_secs=3600, expired_only=0 2024-09-14T11:50:31.539 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:31.544+0000 7f4c8a9e39c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:50:31.540 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:31.544+0000 7f4c8a9e39c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:50:31.541 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:31.544+0000 7f4c8a9e39c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:50:31.543 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:31.548+0000 7f4c8a9e39c0 20 garbage collection: RGWGC::process entered with GC index_shard=15, max_secs=3600, expired_only=0 2024-09-14T11:50:31.546 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:31.548+0000 7f4c8a9e39c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:50:31.548 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:31.552+0000 7f4c8a9e39c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:50:31.549 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:31.552+0000 7f4c8a9e39c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:50:31.552 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:31.556+0000 7f4c8a9e39c0 20 garbage collection: RGWGC::process entered with GC index_shard=16, max_secs=3600, expired_only=0 2024-09-14T11:50:31.556 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:31.560+0000 7f4c8a9e39c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:50:31.558 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:31.560+0000 7f4c8a9e39c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:50:31.559 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:31.564+0000 7f4c8a9e39c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:50:31.562 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:31.564+0000 7f4c8a9e39c0 20 garbage collection: RGWGC::process entered with GC index_shard=17, max_secs=3600, expired_only=0 2024-09-14T11:50:31.565 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:31.568+0000 7f4c8a9e39c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:50:31.567 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:31.572+0000 7f4c8a9e39c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:50:31.567 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:31.572+0000 7f4c8a9e39c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:50:31.570 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:31.572+0000 7f4c8a9e39c0 20 garbage collection: RGWGC::process entered with GC index_shard=18, max_secs=3600, expired_only=0 2024-09-14T11:50:31.573 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:31.576+0000 7f4c8a9e39c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:50:31.575 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:31.580+0000 7f4c8a9e39c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:50:31.576 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:31.580+0000 7f4c8a9e39c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:50:31.578 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:31.580+0000 7f4c8a9e39c0 20 garbage collection: RGWGC::process entered with GC index_shard=19, max_secs=3600, expired_only=0 2024-09-14T11:50:31.581 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:31.584+0000 7f4c8a9e39c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:50:31.582 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:31.584+0000 7f4c8a9e39c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:50:31.583 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:31.588+0000 7f4c8a9e39c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:50:31.585 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:31.588+0000 7f4c8a9e39c0 20 garbage collection: RGWGC::process entered with GC index_shard=20, max_secs=3600, expired_only=0 2024-09-14T11:50:31.589 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:31.592+0000 7f4c8a9e39c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:50:31.591 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:31.596+0000 7f4c8a9e39c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:50:31.592 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:31.596+0000 7f4c8a9e39c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:50:31.595 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:31.600+0000 7f4c8a9e39c0 20 garbage collection: RGWGC::process entered with GC index_shard=21, max_secs=3600, expired_only=0 2024-09-14T11:50:31.598 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:31.600+0000 7f4c8a9e39c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:50:31.600 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:31.604+0000 7f4c8a9e39c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:50:31.601 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:31.604+0000 7f4c8a9e39c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:50:31.604 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:31.608+0000 7f4c8a9e39c0 20 garbage collection: RGWGC::process entered with GC index_shard=22, max_secs=3600, expired_only=0 2024-09-14T11:50:31.607 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:31.612+0000 7f4c8a9e39c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:50:31.608 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:31.612+0000 7f4c8a9e39c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:50:31.609 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:31.612+0000 7f4c8a9e39c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:50:31.611 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:31.616+0000 7f4c8a9e39c0 20 garbage collection: RGWGC::process entered with GC index_shard=23, max_secs=3600, expired_only=0 2024-09-14T11:50:31.615 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:31.620+0000 7f4c8a9e39c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:50:31.617 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:31.620+0000 7f4c8a9e39c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:50:31.617 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:31.620+0000 7f4c8a9e39c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:50:31.620 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:31.624+0000 7f4c8a9e39c0 20 garbage collection: RGWGC::process entered with GC index_shard=24, max_secs=3600, expired_only=0 2024-09-14T11:50:31.624 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:31.628+0000 7f4c8a9e39c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:50:31.625 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:31.628+0000 7f4c8a9e39c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:50:31.626 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:31.628+0000 7f4c8a9e39c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:50:31.628 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:31.632+0000 7f4c8a9e39c0 20 garbage collection: RGWGC::process entered with GC index_shard=25, max_secs=3600, expired_only=0 2024-09-14T11:50:31.631 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:31.636+0000 7f4c8a9e39c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:50:31.633 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:31.636+0000 7f4c8a9e39c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:50:31.633 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:31.636+0000 7f4c8a9e39c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:50:31.636 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:31.640+0000 7f4c8a9e39c0 20 garbage collection: RGWGC::process entered with GC index_shard=26, max_secs=3600, expired_only=0 2024-09-14T11:50:31.640 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:31.644+0000 7f4c8a9e39c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:50:31.641 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:31.644+0000 7f4c8a9e39c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:50:31.644 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:31.648+0000 7f4c8a9e39c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:50:31.647 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:31.652+0000 7f4c8a9e39c0 20 garbage collection: RGWGC::process entered with GC index_shard=27, max_secs=3600, expired_only=0 2024-09-14T11:50:31.651 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:31.656+0000 7f4c8a9e39c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:50:31.652 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:31.656+0000 7f4c8a9e39c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:50:31.653 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:31.656+0000 7f4c8a9e39c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:50:31.656 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:31.660+0000 7f4c8a9e39c0 20 garbage collection: RGWGC::process entered with GC index_shard=28, max_secs=3600, expired_only=0 2024-09-14T11:50:31.660 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:31.664+0000 7f4c8a9e39c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:50:31.662 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:31.664+0000 7f4c8a9e39c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:50:31.663 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:31.668+0000 7f4c8a9e39c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:50:31.665 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:31.668+0000 7f4c8a9e39c0 20 garbage collection: RGWGC::process entered with GC index_shard=29, max_secs=3600, expired_only=0 2024-09-14T11:50:31.669 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:31.672+0000 7f4c8a9e39c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:50:31.671 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:31.676+0000 7f4c8a9e39c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:50:31.672 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:31.676+0000 7f4c8a9e39c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:50:31.675 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:31.680+0000 7f4c8a9e39c0 20 garbage collection: RGWGC::process entered with GC index_shard=30, max_secs=3600, expired_only=0 2024-09-14T11:50:31.678 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:31.680+0000 7f4c8a9e39c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:50:31.680 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:31.684+0000 7f4c8a9e39c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:50:31.680 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:31.684+0000 7f4c8a9e39c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:50:31.683 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:31.688+0000 7f4c8a9e39c0 20 garbage collection: RGWGC::process entered with GC index_shard=31, max_secs=3600, expired_only=0 2024-09-14T11:50:31.687 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:31.692+0000 7f4c8a9e39c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:50:31.688 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:31.692+0000 7f4c8a9e39c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:50:31.689 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:31.692+0000 7f4c8a9e39c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:50:31.691 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:31.696+0000 7f4c8a9e39c0 20 garbage collection: RGWGC::process entered with GC index_shard=0, max_secs=3600, expired_only=0 2024-09-14T11:50:31.695 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:31.700+0000 7f4c8a9e39c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:50:31.697 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:31.700+0000 7f4c8a9e39c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:50:31.698 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:31.700+0000 7f4c8a9e39c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:50:31.701 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:31.704+0000 7f4c8a9e39c0 20 garbage collection: RGWGC::process entered with GC index_shard=1, max_secs=3600, expired_only=0 2024-09-14T11:50:31.705 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:31.708+0000 7f4c8a9e39c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:50:31.706 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:31.708+0000 7f4c8a9e39c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:50:31.706 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:31.712+0000 7f4c8a9e39c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:50:31.709 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:31.712+0000 7f4c8a9e39c0 20 garbage collection: RGWGC::process entered with GC index_shard=2, max_secs=3600, expired_only=0 2024-09-14T11:50:31.712 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:31.716+0000 7f4c8a9e39c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:50:31.714 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:31.716+0000 7f4c8a9e39c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:50:31.715 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:31.720+0000 7f4c8a9e39c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:50:31.718 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:31.720+0000 7f4c8a9e39c0 20 garbage collection: RGWGC::process entered with GC index_shard=3, max_secs=3600, expired_only=0 2024-09-14T11:50:31.722 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:31.724+0000 7f4c8a9e39c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:50:31.723 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:31.728+0000 7f4c8a9e39c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:50:31.724 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:31.728+0000 7f4c8a9e39c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:50:31.727 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:31.732+0000 7f4c8a9e39c0 20 garbage collection: RGWGC::process entered with GC index_shard=4, max_secs=3600, expired_only=0 2024-09-14T11:50:31.731 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:31.736+0000 7f4c8a9e39c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:50:31.732 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:31.736+0000 7f4c8a9e39c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:50:31.734 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:31.736+0000 7f4c8a9e39c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:50:31.739 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:31.744+0000 7f4b3efdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:50:31.744 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:31.748+0000 7f4c8a9e39c0 20 remove_watcher() i=0 2024-09-14T11:50:31.744 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:31.748+0000 7f4c8a9e39c0 2 removed watcher, disabling cache 2024-09-14T11:50:31.747 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:31.752+0000 7f4c8a9e39c0 20 remove_watcher() i=1 2024-09-14T11:50:31.749 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:31.752+0000 7f4c8a9e39c0 20 remove_watcher() i=2 2024-09-14T11:50:31.752 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:31.756+0000 7f4c8a9e39c0 20 remove_watcher() i=3 2024-09-14T11:50:31.755 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:31.760+0000 7f4c8a9e39c0 20 remove_watcher() i=4 2024-09-14T11:50:31.757 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:31.760+0000 7f4c8a9e39c0 20 remove_watcher() i=5 2024-09-14T11:50:31.759 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:31.764+0000 7f4c8a9e39c0 20 remove_watcher() i=6 2024-09-14T11:50:31.761 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:31.764+0000 7f4c8a9e39c0 20 remove_watcher() i=7 2024-09-14T11:50:31.785 DEBUG:teuthology.orchestra.run.smithi138:> radosgw-admin gc process --include-all 2024-09-14T11:50:31.858 INFO:teuthology.orchestra.run.smithi138.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:50:31.858 INFO:teuthology.orchestra.run.smithi138.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:50:31.904 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:31.907+0000 7f5e9cee39c0 20 rados->read ofs=0 len=0 2024-09-14T11:50:31.907 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:31.907+0000 7f5e9cee39c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:50:31.907 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:31.907+0000 7f5e9cee39c0 20 realm 2024-09-14T11:50:31.907 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:31.907+0000 7f5e9cee39c0 20 rados->read ofs=0 len=0 2024-09-14T11:50:31.907 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:31.911+0000 7f5e9cee39c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:50:31.907 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:31.911+0000 7f5e9cee39c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:50:31.907 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:31.911+0000 7f5e9cee39c0 20 rados->read ofs=0 len=0 2024-09-14T11:50:31.907 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:31.911+0000 7f5e9cee39c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:50:31.907 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:31.911+0000 7f5e9cee39c0 20 rados->read ofs=0 len=0 2024-09-14T11:50:31.909 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:31.911+0000 7f5e9cee39c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:50:31.909 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:31.911+0000 7f5e9cee39c0 20 rados->read ofs=0 len=0 2024-09-14T11:50:31.909 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:31.911+0000 7f5e9cee39c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:50:31.910 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:31.911+0000 7f5e9cee39c0 20 searching for the correct realm 2024-09-14T11:50:31.913 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:31.915+0000 7f5e9b1ea640 0 -- 172.21.15.138:0/2366181710 >> [v2:172.21.15.154:6824/416768175,v1:172.21.15.154:6825/416768175] conn(0x7f5e94031060 msgr2=0x7f5e94062de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:50:32.128 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:32.131+0000 7f5e9a1e8640 0 -- 172.21.15.138:0/2366181710 >> [v2:172.21.15.138:6816/326481658,v1:172.21.15.138:6817/326481658] conn(0x7f5e940890c0 msgr2=0x7f5e94085130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-14T11:50:32.346 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:32.347+0000 7f5e9cee39c0 20 RGWRados::pool_iterate: got zone_info.d9e72d30-c60b-4d0d-9267-fdc36392d5ad 2024-09-14T11:50:32.346 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:32.347+0000 7f5e9cee39c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:50:32.347 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:32.347+0000 7f5e9cee39c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:50:32.347 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:32.347+0000 7f5e9cee39c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:50:32.347 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:32.347+0000 7f5e9cee39c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:50:32.347 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:32.347+0000 7f5e9cee39c0 20 RGWRados::pool_iterate: got zonegroup_info.65ab941b-da8c-4160-94fb-3672b069d44f 2024-09-14T11:50:32.347 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:32.347+0000 7f5e9cee39c0 20 rados->read ofs=0 len=0 2024-09-14T11:50:32.347 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:32.351+0000 7f5e9cee39c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:50:32.347 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:32.351+0000 7f5e9cee39c0 20 rados->read ofs=0 len=0 2024-09-14T11:50:32.348 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:32.351+0000 7f5e9cee39c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:50:32.348 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:32.351+0000 7f5e9cee39c0 20 rados->read ofs=0 len=0 2024-09-14T11:50:32.349 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:32.351+0000 7f5e9cee39c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:50:32.349 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:32.351+0000 7f5e9cee39c0 20 zone default found 2024-09-14T11:50:32.349 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:32.351+0000 7f5e9cee39c0 4 Realm: () 2024-09-14T11:50:32.349 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:32.351+0000 7f5e9cee39c0 4 ZoneGroup: default (65ab941b-da8c-4160-94fb-3672b069d44f) 2024-09-14T11:50:32.349 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:32.351+0000 7f5e9cee39c0 4 Zone: default (d9e72d30-c60b-4d0d-9267-fdc36392d5ad) 2024-09-14T11:50:32.350 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:32.351+0000 7f5e9cee39c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:50:32.350 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:32.351+0000 7f5e9cee39c0 20 zonegroup default 2024-09-14T11:50:32.350 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:32.351+0000 7f5e9cee39c0 20 rados->read ofs=0 len=0 2024-09-14T11:50:32.350 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:32.351+0000 7f5e9cee39c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:50:32.350 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:32.351+0000 7f5e9cee39c0 20 rados->read ofs=0 len=0 2024-09-14T11:50:32.351 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:32.351+0000 7f5e9cee39c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:50:32.351 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:32.351+0000 7f5e9cee39c0 20 rados->read ofs=0 len=0 2024-09-14T11:50:32.351 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:32.355+0000 7f5e9cee39c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:50:32.351 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:32.355+0000 7f5e9cee39c0 20 started sync module instance, tier type = 2024-09-14T11:50:32.351 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:32.355+0000 7f5e9cee39c0 20 started zone id=d9e72d30-c60b-4d0d-9267-fdc36392d5ad (name=default) with tier type = 2024-09-14T11:50:32.374 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:32.375+0000 7f5e9cee39c0 20 add_watcher() i=0 2024-09-14T11:50:32.374 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:32.375+0000 7f5e9cee39c0 20 add_watcher() i=1 2024-09-14T11:50:32.374 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:32.375+0000 7f5e9cee39c0 20 add_watcher() i=2 2024-09-14T11:50:32.374 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:32.375+0000 7f5e9cee39c0 20 add_watcher() i=3 2024-09-14T11:50:32.374 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:32.375+0000 7f5e9cee39c0 20 add_watcher() i=4 2024-09-14T11:50:32.374 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:32.375+0000 7f5e9cee39c0 20 add_watcher() i=5 2024-09-14T11:50:32.375 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:32.375+0000 7f5e9cee39c0 20 add_watcher() i=6 2024-09-14T11:50:32.376 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:32.379+0000 7f5e9cee39c0 20 add_watcher() i=7 2024-09-14T11:50:32.376 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:32.379+0000 7f5e9cee39c0 2 all 8 watchers are set, enabling cache 2024-09-14T11:50:32.379 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:32.383+0000 7f5d517e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:50:32.380 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:32.383+0000 7f5e9cee39c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:50:32.380 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:32.383+0000 7f5e9cee39c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:50:32.481 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:32.483+0000 7f5ccbfff640 20 reqs_thread_entry: start 2024-09-14T11:50:32.481 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:32.483+0000 7f5e9cee39c0 20 init_complete bucket index max shards: 11 2024-09-14T11:50:32.481 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:32.483+0000 7f5e9cee39c0 20 Filter name: none 2024-09-14T11:50:32.481 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:32.483+0000 7f5cc9ffb640 20 reqs_thread_entry: start 2024-09-14T11:50:32.481 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:32.483+0000 7f5e9cee39c0 20 garbage collection: RGWGC::process entered with GC index_shard=5, max_secs=3600, expired_only=0 2024-09-14T11:50:32.484 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:32.487+0000 7f5e9cee39c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:50:32.485 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:32.487+0000 7f5e9cee39c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:50:32.485 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:32.487+0000 7f5e9cee39c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:50:32.488 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:32.491+0000 7f5e9cee39c0 20 garbage collection: RGWGC::process entered with GC index_shard=6, max_secs=3600, expired_only=0 2024-09-14T11:50:32.491 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:32.495+0000 7f5e9cee39c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:50:32.493 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:32.495+0000 7f5e9cee39c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:50:32.493 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:32.495+0000 7f5e9cee39c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:50:32.496 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:32.499+0000 7f5e9cee39c0 20 garbage collection: RGWGC::process entered with GC index_shard=7, max_secs=3600, expired_only=0 2024-09-14T11:50:32.498 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:32.499+0000 7f5e9cee39c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:50:32.499 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:32.503+0000 7f5e9cee39c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:50:32.499 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:32.503+0000 7f5e9cee39c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:50:32.501 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:32.503+0000 7f5e9cee39c0 20 garbage collection: RGWGC::process entered with GC index_shard=8, max_secs=3600, expired_only=0 2024-09-14T11:50:32.504 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:32.507+0000 7f5e9cee39c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:50:32.506 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:32.507+0000 7f5e9cee39c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:50:32.507 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:32.511+0000 7f5e9cee39c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:50:32.509 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:32.511+0000 7f5e9cee39c0 20 garbage collection: RGWGC::process entered with GC index_shard=9, max_secs=3600, expired_only=0 2024-09-14T11:50:32.513 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:32.515+0000 7f5e9cee39c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:50:32.515 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:32.519+0000 7f5e9cee39c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:50:32.515 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:32.519+0000 7f5e9cee39c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:50:32.518 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:32.519+0000 7f5e9cee39c0 20 garbage collection: RGWGC::process entered with GC index_shard=10, max_secs=3600, expired_only=0 2024-09-14T11:50:32.521 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:32.523+0000 7f5e9cee39c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:50:32.523 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:32.527+0000 7f5e9cee39c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:50:32.524 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:32.527+0000 7f5e9cee39c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:50:32.527 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:32.531+0000 7f5e9cee39c0 20 garbage collection: RGWGC::process entered with GC index_shard=11, max_secs=3600, expired_only=0 2024-09-14T11:50:32.530 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:32.531+0000 7f5e9cee39c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:50:32.530 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:32.531+0000 7f5e9cee39c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:50:32.531 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:32.535+0000 7f5e9cee39c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:50:32.532 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:32.535+0000 7f5e9cee39c0 20 garbage collection: RGWGC::process entered with GC index_shard=12, max_secs=3600, expired_only=0 2024-09-14T11:50:32.536 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:32.539+0000 7f5e9cee39c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:50:32.538 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:32.539+0000 7f5e9cee39c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:50:32.538 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:32.539+0000 7f5e9cee39c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:50:32.541 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:32.543+0000 7f5e9cee39c0 20 garbage collection: RGWGC::process entered with GC index_shard=13, max_secs=3600, expired_only=0 2024-09-14T11:50:32.543 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:32.547+0000 7f5e9cee39c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:50:32.544 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:32.547+0000 7f5e9cee39c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:50:32.545 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:32.547+0000 7f5e9cee39c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:50:32.546 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:32.547+0000 7f5e9cee39c0 20 garbage collection: RGWGC::process entered with GC index_shard=14, max_secs=3600, expired_only=0 2024-09-14T11:50:32.549 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:32.551+0000 7f5e9cee39c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:50:32.549 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:32.551+0000 7f5e9cee39c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:50:32.550 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:32.551+0000 7f5e9cee39c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:50:32.552 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:32.555+0000 7f5e9cee39c0 20 garbage collection: RGWGC::process entered with GC index_shard=15, max_secs=3600, expired_only=0 2024-09-14T11:50:32.555 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:32.559+0000 7f5e9cee39c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:50:32.557 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:32.559+0000 7f5e9cee39c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:50:32.558 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:32.559+0000 7f5e9cee39c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:50:32.561 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:32.563+0000 7f5e9cee39c0 20 garbage collection: RGWGC::process entered with GC index_shard=16, max_secs=3600, expired_only=0 2024-09-14T11:50:32.568 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:32.571+0000 7f5e9cee39c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:50:32.570 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:32.571+0000 7f5e9cee39c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:50:32.570 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:32.575+0000 7f5e9cee39c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:50:32.574 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:32.575+0000 7f5e9cee39c0 20 garbage collection: RGWGC::process entered with GC index_shard=17, max_secs=3600, expired_only=0 2024-09-14T11:50:32.577 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:32.579+0000 7f5e9cee39c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:50:32.577 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:32.579+0000 7f5e9cee39c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:50:32.578 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:32.579+0000 7f5e9cee39c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:50:32.580 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:32.583+0000 7f5e9cee39c0 20 garbage collection: RGWGC::process entered with GC index_shard=18, max_secs=3600, expired_only=0 2024-09-14T11:50:32.583 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:32.587+0000 7f5e9cee39c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:50:32.585 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:32.587+0000 7f5e9cee39c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:50:32.586 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:32.587+0000 7f5e9cee39c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:50:32.589 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:32.591+0000 7f5e9cee39c0 20 garbage collection: RGWGC::process entered with GC index_shard=19, max_secs=3600, expired_only=0 2024-09-14T11:50:32.592 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:32.595+0000 7f5e9cee39c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:50:32.593 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:32.595+0000 7f5e9cee39c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:50:32.594 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:32.595+0000 7f5e9cee39c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:50:32.596 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:32.599+0000 7f5e9cee39c0 20 garbage collection: RGWGC::process entered with GC index_shard=20, max_secs=3600, expired_only=0 2024-09-14T11:50:32.599 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:32.603+0000 7f5e9cee39c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:50:32.601 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:32.603+0000 7f5e9cee39c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:50:32.602 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:32.603+0000 7f5e9cee39c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:50:32.604 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:32.607+0000 7f5e9cee39c0 20 garbage collection: RGWGC::process entered with GC index_shard=21, max_secs=3600, expired_only=0 2024-09-14T11:50:32.609 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:32.611+0000 7f5e9cee39c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:50:32.610 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:32.611+0000 7f5e9cee39c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:50:32.611 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:32.615+0000 7f5e9cee39c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:50:32.614 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:32.615+0000 7f5e9cee39c0 20 garbage collection: RGWGC::process entered with GC index_shard=22, max_secs=3600, expired_only=0 2024-09-14T11:50:32.616 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:32.619+0000 7f5e9cee39c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:50:32.616 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:32.619+0000 7f5e9cee39c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:50:32.617 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:32.619+0000 7f5e9cee39c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:50:32.618 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:32.619+0000 7f5e9cee39c0 20 garbage collection: RGWGC::process entered with GC index_shard=23, max_secs=3600, expired_only=0 2024-09-14T11:50:32.622 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:32.623+0000 7f5e9cee39c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:50:32.624 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:32.627+0000 7f5e9cee39c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:50:32.625 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:32.627+0000 7f5e9cee39c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:50:32.627 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:32.631+0000 7f5e9cee39c0 20 garbage collection: RGWGC::process entered with GC index_shard=24, max_secs=3600, expired_only=0 2024-09-14T11:50:32.630 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:32.631+0000 7f5e9cee39c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:50:32.630 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:32.631+0000 7f5e9cee39c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:50:32.631 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:32.635+0000 7f5e9cee39c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:50:32.633 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:32.635+0000 7f5e9cee39c0 20 garbage collection: RGWGC::process entered with GC index_shard=25, max_secs=3600, expired_only=0 2024-09-14T11:50:32.635 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:32.639+0000 7f5e9cee39c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:50:32.636 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:32.639+0000 7f5e9cee39c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:50:32.637 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:32.639+0000 7f5e9cee39c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:50:32.639 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:32.643+0000 7f5e9cee39c0 20 garbage collection: RGWGC::process entered with GC index_shard=26, max_secs=3600, expired_only=0 2024-09-14T11:50:32.641 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:32.643+0000 7f5e9cee39c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:50:32.642 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:32.643+0000 7f5e9cee39c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:50:32.642 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:32.643+0000 7f5e9cee39c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:50:32.644 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:32.647+0000 7f5e9cee39c0 20 garbage collection: RGWGC::process entered with GC index_shard=27, max_secs=3600, expired_only=0 2024-09-14T11:50:32.648 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:32.651+0000 7f5e9cee39c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:50:32.650 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:32.651+0000 7f5e9cee39c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:50:32.651 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:32.655+0000 7f5e9cee39c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:50:32.654 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:32.655+0000 7f5e9cee39c0 20 garbage collection: RGWGC::process entered with GC index_shard=28, max_secs=3600, expired_only=0 2024-09-14T11:50:32.656 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:32.659+0000 7f5e9cee39c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:50:32.657 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:32.659+0000 7f5e9cee39c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:50:32.657 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:32.659+0000 7f5e9cee39c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:50:32.659 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:32.663+0000 7f5e9cee39c0 20 garbage collection: RGWGC::process entered with GC index_shard=29, max_secs=3600, expired_only=0 2024-09-14T11:50:32.662 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:32.663+0000 7f5e9cee39c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:50:32.664 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:32.667+0000 7f5e9cee39c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:50:32.665 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:32.667+0000 7f5e9cee39c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:50:32.667 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:32.671+0000 7f5e9cee39c0 20 garbage collection: RGWGC::process entered with GC index_shard=30, max_secs=3600, expired_only=0 2024-09-14T11:50:32.669 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:32.671+0000 7f5e9cee39c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:50:32.670 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:32.671+0000 7f5e9cee39c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:50:32.671 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:32.675+0000 7f5e9cee39c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:50:32.673 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:32.675+0000 7f5e9cee39c0 20 garbage collection: RGWGC::process entered with GC index_shard=31, max_secs=3600, expired_only=0 2024-09-14T11:50:32.676 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:32.679+0000 7f5e9cee39c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:50:32.676 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:32.679+0000 7f5e9cee39c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:50:32.677 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:32.679+0000 7f5e9cee39c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:50:32.679 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:32.683+0000 7f5e9cee39c0 20 garbage collection: RGWGC::process entered with GC index_shard=0, max_secs=3600, expired_only=0 2024-09-14T11:50:32.682 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:32.683+0000 7f5e9cee39c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:50:32.683 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:32.687+0000 7f5e9cee39c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:50:32.683 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:32.687+0000 7f5e9cee39c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:50:32.686 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:32.687+0000 7f5e9cee39c0 20 garbage collection: RGWGC::process entered with GC index_shard=1, max_secs=3600, expired_only=0 2024-09-14T11:50:32.688 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:32.691+0000 7f5e9cee39c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:50:32.689 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:32.691+0000 7f5e9cee39c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:50:32.690 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:32.691+0000 7f5e9cee39c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:50:32.692 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:32.695+0000 7f5e9cee39c0 20 garbage collection: RGWGC::process entered with GC index_shard=2, max_secs=3600, expired_only=0 2024-09-14T11:50:32.694 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:32.695+0000 7f5e9cee39c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:50:32.695 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:32.699+0000 7f5e9cee39c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:50:32.695 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:32.699+0000 7f5e9cee39c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:50:32.698 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:32.699+0000 7f5e9cee39c0 20 garbage collection: RGWGC::process entered with GC index_shard=3, max_secs=3600, expired_only=0 2024-09-14T11:50:32.700 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:32.703+0000 7f5e9cee39c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:50:32.701 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:32.703+0000 7f5e9cee39c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:50:32.702 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:32.703+0000 7f5e9cee39c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:50:32.704 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:32.707+0000 7f5e9cee39c0 20 garbage collection: RGWGC::process entered with GC index_shard=4, max_secs=3600, expired_only=0 2024-09-14T11:50:32.708 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:32.711+0000 7f5e9cee39c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:50:32.709 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:32.711+0000 7f5e9cee39c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:50:32.710 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:32.711+0000 7f5e9cee39c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:50:32.714 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:32.715+0000 7f5d517e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:50:32.719 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:32.723+0000 7f5e9cee39c0 20 remove_watcher() i=0 2024-09-14T11:50:32.719 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:32.723+0000 7f5e9cee39c0 2 removed watcher, disabling cache 2024-09-14T11:50:32.721 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:32.723+0000 7f5e9cee39c0 20 remove_watcher() i=1 2024-09-14T11:50:32.723 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:32.727+0000 7f5e9cee39c0 20 remove_watcher() i=2 2024-09-14T11:50:32.725 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:32.727+0000 7f5e9cee39c0 20 remove_watcher() i=3 2024-09-14T11:50:32.728 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:32.731+0000 7f5e9cee39c0 20 remove_watcher() i=4 2024-09-14T11:50:32.729 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:32.731+0000 7f5e9cee39c0 20 remove_watcher() i=5 2024-09-14T11:50:32.731 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:32.735+0000 7f5e9cee39c0 20 remove_watcher() i=6 2024-09-14T11:50:32.732 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:32.735+0000 7f5e9cee39c0 20 remove_watcher() i=7 2024-09-14T11:50:32.749 DEBUG:teuthology.orchestra.run.smithi138:> cd /home/ubuntu/cephtest/s3-tests-java && /opt/gradle/gradle/bin/gradle clean test --rerun-tasks --no-build-cache --tests BucketTest 2024-09-14T11:50:33.466 INFO:teuthology.orchestra.run.smithi138.stdout:> Task :clean 2024-09-14T11:50:34.163 INFO:teuthology.orchestra.run.smithi138.stdout:> Task :compileJava 2024-09-14T11:50:34.164 INFO:teuthology.orchestra.run.smithi138.stdout:> Task :processResources 2024-09-14T11:50:34.164 INFO:teuthology.orchestra.run.smithi138.stdout:> Task :classes 2024-09-14T11:50:34.663 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-09-14T11:50:34.663 INFO:teuthology.orchestra.run.smithi138.stdout:> Task :compileTestJava 2024-09-14T11:50:34.664 INFO:teuthology.orchestra.run.smithi138.stderr:Note: /home/ubuntu/cephtest/s3-tests-java/src/test/java/BucketTest.java uses or overrides a deprecated API. 2024-09-14T11:50:34.664 INFO:teuthology.orchestra.run.smithi138.stderr:Note: Recompile with -Xlint:deprecation for details. 2024-09-14T11:50:34.665 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-09-14T11:50:34.665 INFO:teuthology.orchestra.run.smithi138.stdout:> Task :processTestResources NO-SOURCE 2024-09-14T11:50:34.665 INFO:teuthology.orchestra.run.smithi138.stdout:> Task :testClasses 2024-09-14T11:50:36.663 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-09-14T11:50:36.664 INFO:teuthology.orchestra.run.smithi138.stdout:> Task :test 2024-09-14T11:50:36.664 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-09-14T11:50:36.664 INFO:teuthology.orchestra.run.smithi138.stdout:suite > Bucket tests STANDARD_OUT 2024-09-14T11:50:36.665 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-09-14 11:50:36,024 [Test worker] WARN com.amazonaws.util.Base64 - JAXB is unavailable. Will fallback to SDK implementation which may be less performant 2024-09-14T11:50:36.665 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-09-14T11:50:36.665 INFO:teuthology.orchestra.run.smithi138.stdout:suite > Bucket tests > BucketTest.testBucketCreateBadExpectEmpty STARTED 2024-09-14T11:50:36.665 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-09-14T11:50:36.665 INFO:teuthology.orchestra.run.smithi138.stdout:suite > Bucket tests > BucketTest.testBucketCreateBadExpectEmpty PASSED 2024-09-14T11:50:37.163 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-09-14T11:50:37.164 INFO:teuthology.orchestra.run.smithi138.stdout:suite > Bucket tests > BucketTest.testBucketCreateBadExpectMismatch STARTED 2024-09-14T11:50:37.263 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-09-14T11:50:37.263 INFO:teuthology.orchestra.run.smithi138.stdout:suite > Bucket tests > BucketTest.testBucketCreateBadExpectMismatch PASSED 2024-09-14T11:50:37.963 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-09-14T11:50:37.964 INFO:teuthology.orchestra.run.smithi138.stdout:suite > Bucket tests > BucketTest.testBucketCreateBadExpectUnreadable STARTED 2024-09-14T11:50:38.163 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-09-14T11:50:38.163 INFO:teuthology.orchestra.run.smithi138.stdout:suite > Bucket tests > BucketTest.testBucketCreateBadExpectUnreadable PASSED 2024-09-14T11:50:38.863 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-09-14T11:50:38.863 INFO:teuthology.orchestra.run.smithi138.stdout:suite > Bucket tests > BucketTest.testBucketCreateReadDelete STARTED 2024-09-14T11:50:39.463 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-09-14T11:50:39.463 INFO:teuthology.orchestra.run.smithi138.stdout:suite > Bucket tests > BucketTest.testBucketCreateReadDelete PASSED 2024-09-14T11:50:39.563 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-09-14T11:50:39.563 INFO:teuthology.orchestra.run.smithi138.stdout:suite > Bucket tests > BucketTest.testBucketDeleteNonEmpty STARTED 2024-09-14T11:50:39.963 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-09-14T11:50:39.963 INFO:teuthology.orchestra.run.smithi138.stdout:suite > Bucket tests > BucketTest.testBucketDeleteNonEmpty PASSED 2024-09-14T11:50:40.763 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-09-14T11:50:40.763 INFO:teuthology.orchestra.run.smithi138.stdout:suite > Bucket tests > BucketTest.testBucketDeleteNotExist STARTED 2024-09-14T11:50:40.863 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-09-14T11:50:40.863 INFO:teuthology.orchestra.run.smithi138.stdout:suite > Bucket tests > BucketTest.testBucketDeleteNotExist PASSED 2024-09-14T11:50:41.063 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-09-14T11:50:41.063 INFO:teuthology.orchestra.run.smithi138.stdout:suite > Bucket tests > BucketTest.testBucketListDistinct STARTED 2024-09-14T11:50:41.463 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-09-14T11:50:41.463 INFO:teuthology.orchestra.run.smithi138.stdout:suite > Bucket tests > BucketTest.testBucketListDistinct PASSED 2024-09-14T11:50:42.663 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-09-14T11:50:42.664 INFO:teuthology.orchestra.run.smithi138.stdout:suite > Bucket tests > BucketTest.testBucketListEmpty STARTED 2024-09-14T11:50:42.963 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-09-14T11:50:42.963 INFO:teuthology.orchestra.run.smithi138.stdout:suite > Bucket tests > BucketTest.testBucketListEmpty PASSED 2024-09-14T11:50:43.663 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-09-14T11:50:43.663 INFO:teuthology.orchestra.run.smithi138.stdout:suite > Bucket tests > BucketTest.testBucketNotExist STARTED 2024-09-14T11:50:43.763 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-09-14T11:50:43.763 INFO:teuthology.orchestra.run.smithi138.stdout:suite > Bucket tests > BucketTest.testBucketNotExist PASSED 2024-09-14T11:50:43.863 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-09-14T11:50:43.863 INFO:teuthology.orchestra.run.smithi138.stdout:-------------------------------------------------------------------- 2024-09-14T11:50:43.863 INFO:teuthology.orchestra.run.smithi138.stdout:| Results: SUCCESS (9 tests, 9 successes, 0 failures, 0 skipped) | 2024-09-14T11:50:43.863 INFO:teuthology.orchestra.run.smithi138.stdout:-------------------------------------------------------------------- 2024-09-14T11:50:43.887 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-09-14T11:50:43.887 INFO:teuthology.orchestra.run.smithi138.stdout:Deprecated Gradle features were used in this build, making it incompatible with Gradle 7.0. 2024-09-14T11:50:43.887 INFO:teuthology.orchestra.run.smithi138.stdout:Use '--warning-mode all' to show the individual deprecation warnings. 2024-09-14T11:50:43.887 INFO:teuthology.orchestra.run.smithi138.stdout:See https://docs.gradle.org/6.0.1/userguide/command_line_interface.html#sec:command_line_warnings 2024-09-14T11:50:43.888 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-09-14T11:50:43.888 INFO:teuthology.orchestra.run.smithi138.stdout:BUILD SUCCESSFUL in 11s 2024-09-14T11:50:43.888 INFO:teuthology.orchestra.run.smithi138.stdout:5 actionable tasks: 5 executed 2024-09-14T11:50:43.897 DEBUG:teuthology.orchestra.run.smithi138:> radosgw-admin gc process --include-all 2024-09-14T11:50:43.922 INFO:teuthology.orchestra.run.smithi138.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:50:43.923 INFO:teuthology.orchestra.run.smithi138.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:50:43.967 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:43.971+0000 7fea5d2679c0 20 rados->read ofs=0 len=0 2024-09-14T11:50:43.969 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:43.971+0000 7fea5d2679c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:50:43.969 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:43.971+0000 7fea5d2679c0 20 realm 2024-09-14T11:50:43.969 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:43.971+0000 7fea5d2679c0 20 rados->read ofs=0 len=0 2024-09-14T11:50:43.969 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:43.971+0000 7fea5d2679c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:50:43.969 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:43.971+0000 7fea5d2679c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:50:43.970 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:43.971+0000 7fea5d2679c0 20 rados->read ofs=0 len=0 2024-09-14T11:50:43.970 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:43.971+0000 7fea5d2679c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:50:43.970 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:43.971+0000 7fea5d2679c0 20 rados->read ofs=0 len=0 2024-09-14T11:50:43.971 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:43.975+0000 7fea5d2679c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:50:43.971 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:43.975+0000 7fea5d2679c0 20 rados->read ofs=0 len=0 2024-09-14T11:50:43.972 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:43.975+0000 7fea5d2679c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:50:43.972 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:43.975+0000 7fea5d2679c0 20 searching for the correct realm 2024-09-14T11:50:43.973 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:43.975+0000 7fea5a56c640 0 -- 172.21.15.138:0/3784837309 >> [v2:172.21.15.154:6808/1468088432,v1:172.21.15.154:6809/1468088432] conn(0x7fea4c093370 msgr2=0x7fea4c05c150 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:50:43.981 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:43.983+0000 7fea5b56e640 0 -- 172.21.15.138:0/3784837309 >> [v2:172.21.15.138:6824/2633984942,v1:172.21.15.138:6825/2633984942] conn(0x564dec9fd390 msgr2=0x564dec9ff780 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:50:43.992 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:43.995+0000 7fea5d2679c0 20 RGWRados::pool_iterate: got zone_info.d9e72d30-c60b-4d0d-9267-fdc36392d5ad 2024-09-14T11:50:43.992 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:43.995+0000 7fea5d2679c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:50:43.992 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:43.995+0000 7fea5d2679c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:50:43.992 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:43.995+0000 7fea5d2679c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:50:43.992 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:43.995+0000 7fea5d2679c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:50:43.992 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:43.995+0000 7fea5d2679c0 20 RGWRados::pool_iterate: got zonegroup_info.65ab941b-da8c-4160-94fb-3672b069d44f 2024-09-14T11:50:43.992 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:43.995+0000 7fea5d2679c0 20 rados->read ofs=0 len=0 2024-09-14T11:50:43.992 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:43.995+0000 7fea5d2679c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:50:43.992 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:43.995+0000 7fea5d2679c0 20 rados->read ofs=0 len=0 2024-09-14T11:50:43.993 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:43.995+0000 7fea5d2679c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:50:43.993 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:43.995+0000 7fea5d2679c0 20 rados->read ofs=0 len=0 2024-09-14T11:50:43.993 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:43.995+0000 7fea5d2679c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:50:43.993 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:43.995+0000 7fea5d2679c0 20 zone default found 2024-09-14T11:50:43.993 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:43.995+0000 7fea5d2679c0 4 Realm: () 2024-09-14T11:50:43.993 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:43.995+0000 7fea5d2679c0 4 ZoneGroup: default (65ab941b-da8c-4160-94fb-3672b069d44f) 2024-09-14T11:50:43.994 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:43.995+0000 7fea5d2679c0 4 Zone: default (d9e72d30-c60b-4d0d-9267-fdc36392d5ad) 2024-09-14T11:50:43.994 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:43.995+0000 7fea5d2679c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:50:43.994 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:43.995+0000 7fea5d2679c0 20 zonegroup default 2024-09-14T11:50:43.994 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:43.995+0000 7fea5d2679c0 20 rados->read ofs=0 len=0 2024-09-14T11:50:43.995 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:43.995+0000 7fea5d2679c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:50:43.995 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:43.995+0000 7fea5d2679c0 20 rados->read ofs=0 len=0 2024-09-14T11:50:43.995 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:43.995+0000 7fea5d2679c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:50:43.995 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:43.995+0000 7fea5d2679c0 20 rados->read ofs=0 len=0 2024-09-14T11:50:43.995 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:43.995+0000 7fea5d2679c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:50:43.995 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:43.995+0000 7fea5d2679c0 20 started sync module instance, tier type = 2024-09-14T11:50:43.995 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:43.995+0000 7fea5d2679c0 20 started zone id=d9e72d30-c60b-4d0d-9267-fdc36392d5ad (name=default) with tier type = 2024-09-14T11:50:44.009 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:44.011+0000 7fea5d2679c0 20 add_watcher() i=0 2024-09-14T11:50:44.009 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:44.011+0000 7fea5d2679c0 20 add_watcher() i=1 2024-09-14T11:50:44.010 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:44.011+0000 7fea5d2679c0 20 add_watcher() i=2 2024-09-14T11:50:44.010 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:44.011+0000 7fea5d2679c0 20 add_watcher() i=3 2024-09-14T11:50:44.010 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:44.011+0000 7fea5d2679c0 20 add_watcher() i=4 2024-09-14T11:50:44.010 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:44.011+0000 7fea5d2679c0 20 add_watcher() i=5 2024-09-14T11:50:44.010 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:44.011+0000 7fea5d2679c0 20 add_watcher() i=6 2024-09-14T11:50:44.010 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:44.011+0000 7fea5d2679c0 20 add_watcher() i=7 2024-09-14T11:50:44.010 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:44.011+0000 7fea5d2679c0 2 all 8 watchers are set, enabling cache 2024-09-14T11:50:44.013 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:44.015+0000 7fe9117e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:50:44.013 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:44.015+0000 7fea5d2679c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:50:44.013 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:44.015+0000 7fea5d2679c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:50:44.096 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:44.099+0000 7fe88bfff640 20 reqs_thread_entry: start 2024-09-14T11:50:44.096 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:44.099+0000 7fea5d2679c0 20 init_complete bucket index max shards: 11 2024-09-14T11:50:44.096 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:44.099+0000 7fea5d2679c0 20 Filter name: none 2024-09-14T11:50:44.096 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:44.099+0000 7fe889ffb640 20 reqs_thread_entry: start 2024-09-14T11:50:44.096 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:44.099+0000 7fea5d2679c0 20 garbage collection: RGWGC::process entered with GC index_shard=30, max_secs=3600, expired_only=0 2024-09-14T11:50:44.099 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:44.103+0000 7fea5d2679c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:50:44.099 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:44.103+0000 7fea5d2679c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:50:44.100 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:44.103+0000 7fea5d2679c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:50:44.101 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:44.103+0000 7fea5d2679c0 20 garbage collection: RGWGC::process entered with GC index_shard=31, max_secs=3600, expired_only=0 2024-09-14T11:50:44.103 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:44.107+0000 7fea5d2679c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:50:44.104 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:44.107+0000 7fea5d2679c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:50:44.105 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:44.107+0000 7fea5d2679c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:50:44.106 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:44.107+0000 7fea5d2679c0 20 garbage collection: RGWGC::process entered with GC index_shard=0, max_secs=3600, expired_only=0 2024-09-14T11:50:44.109 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:44.111+0000 7fea5d2679c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:50:44.111 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:44.115+0000 7fea5d2679c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:50:44.112 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:44.115+0000 7fea5d2679c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:50:44.114 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:44.115+0000 7fea5d2679c0 20 garbage collection: RGWGC::process entered with GC index_shard=1, max_secs=3600, expired_only=0 2024-09-14T11:50:44.116 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:44.119+0000 7fea5d2679c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:50:44.117 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:44.119+0000 7fea5d2679c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:50:44.118 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:44.119+0000 7fea5d2679c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:50:44.119 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:44.123+0000 7fea5d2679c0 20 garbage collection: RGWGC::process entered with GC index_shard=2, max_secs=3600, expired_only=0 2024-09-14T11:50:44.122 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:44.123+0000 7fea5d2679c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:50:44.123 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:44.127+0000 7fea5d2679c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:50:44.123 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:44.127+0000 7fea5d2679c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:50:44.125 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:44.127+0000 7fea5d2679c0 20 garbage collection: RGWGC::process entered with GC index_shard=3, max_secs=3600, expired_only=0 2024-09-14T11:50:44.129 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:44.131+0000 7fea5d2679c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:50:44.130 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:44.131+0000 7fea5d2679c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:50:44.131 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:44.135+0000 7fea5d2679c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:50:44.133 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:44.135+0000 7fea5d2679c0 20 garbage collection: RGWGC::process entered with GC index_shard=4, max_secs=3600, expired_only=0 2024-09-14T11:50:44.137 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:44.139+0000 7fea5d2679c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:50:44.139 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:44.143+0000 7fea5d2679c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:50:44.141 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:44.143+0000 7fea5d2679c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:50:44.144 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:44.147+0000 7fea5d2679c0 20 garbage collection: RGWGC::process entered with GC index_shard=5, max_secs=3600, expired_only=0 2024-09-14T11:50:44.146 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:44.147+0000 7fea5d2679c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:50:44.147 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:44.151+0000 7fea5d2679c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:50:44.147 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:44.151+0000 7fea5d2679c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:50:44.149 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:44.151+0000 7fea5d2679c0 20 garbage collection: RGWGC::process entered with GC index_shard=6, max_secs=3600, expired_only=0 2024-09-14T11:50:44.152 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:44.155+0000 7fea5d2679c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:50:44.154 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:44.155+0000 7fea5d2679c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:50:44.155 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:44.159+0000 7fea5d2679c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:50:44.157 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:44.159+0000 7fea5d2679c0 20 garbage collection: RGWGC::process entered with GC index_shard=7, max_secs=3600, expired_only=0 2024-09-14T11:50:44.160 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:44.163+0000 7fea5d2679c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:50:44.161 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:44.163+0000 7fea5d2679c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:50:44.161 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:44.163+0000 7fea5d2679c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:50:44.163 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:44.167+0000 7fea5d2679c0 20 garbage collection: RGWGC::process entered with GC index_shard=8, max_secs=3600, expired_only=0 2024-09-14T11:50:44.166 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:44.167+0000 7fea5d2679c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:50:44.167 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:44.171+0000 7fea5d2679c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:50:44.168 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:44.171+0000 7fea5d2679c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:50:44.170 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:44.171+0000 7fea5d2679c0 20 garbage collection: RGWGC::process entered with GC index_shard=9, max_secs=3600, expired_only=0 2024-09-14T11:50:44.174 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:44.175+0000 7fea5d2679c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:50:44.176 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:44.179+0000 7fea5d2679c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:50:44.177 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:44.179+0000 7fea5d2679c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:50:44.180 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:44.183+0000 7fea5d2679c0 20 garbage collection: RGWGC::process entered with GC index_shard=10, max_secs=3600, expired_only=0 2024-09-14T11:50:44.183 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:44.187+0000 7fea5d2679c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:50:44.185 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:44.187+0000 7fea5d2679c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:50:44.186 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:44.187+0000 7fea5d2679c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:50:44.189 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:44.191+0000 7fea5d2679c0 20 garbage collection: RGWGC::process entered with GC index_shard=11, max_secs=3600, expired_only=0 2024-09-14T11:50:44.191 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:44.195+0000 7fea5d2679c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:50:44.192 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:44.195+0000 7fea5d2679c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:50:44.193 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:44.195+0000 7fea5d2679c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:50:44.194 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:44.195+0000 7fea5d2679c0 20 garbage collection: RGWGC::process entered with GC index_shard=12, max_secs=3600, expired_only=0 2024-09-14T11:50:44.198 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:44.199+0000 7fea5d2679c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:50:44.199 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:44.203+0000 7fea5d2679c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:50:44.200 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:44.203+0000 7fea5d2679c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:50:44.203 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:44.207+0000 7fea5d2679c0 20 garbage collection: RGWGC::process entered with GC index_shard=13, max_secs=3600, expired_only=0 2024-09-14T11:50:44.206 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:44.207+0000 7fea5d2679c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:50:44.207 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:44.211+0000 7fea5d2679c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:50:44.207 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:44.211+0000 7fea5d2679c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:50:44.209 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:44.211+0000 7fea5d2679c0 20 garbage collection: RGWGC::process entered with GC index_shard=14, max_secs=3600, expired_only=0 2024-09-14T11:50:44.212 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:44.215+0000 7fea5d2679c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:50:44.214 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:44.215+0000 7fea5d2679c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:50:44.214 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:44.215+0000 7fea5d2679c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:50:44.217 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:44.219+0000 7fea5d2679c0 20 garbage collection: RGWGC::process entered with GC index_shard=15, max_secs=3600, expired_only=0 2024-09-14T11:50:44.221 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:44.223+0000 7fea5d2679c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:50:44.223 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:44.227+0000 7fea5d2679c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:50:44.224 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:44.227+0000 7fea5d2679c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:50:44.228 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:44.231+0000 7fea5d2679c0 20 garbage collection: RGWGC::process entered with GC index_shard=16, max_secs=3600, expired_only=0 2024-09-14T11:50:44.232 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:44.235+0000 7fea5d2679c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:50:44.234 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:44.235+0000 7fea5d2679c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:50:44.235 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:44.239+0000 7fea5d2679c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:50:44.238 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:44.239+0000 7fea5d2679c0 20 garbage collection: RGWGC::process entered with GC index_shard=17, max_secs=3600, expired_only=0 2024-09-14T11:50:44.241 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:44.243+0000 7fea5d2679c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:50:44.243 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:44.247+0000 7fea5d2679c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:50:44.243 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:44.247+0000 7fea5d2679c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:50:44.246 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:44.247+0000 7fea5d2679c0 20 garbage collection: RGWGC::process entered with GC index_shard=18, max_secs=3600, expired_only=0 2024-09-14T11:50:44.250 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:44.251+0000 7fea5d2679c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:50:44.252 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:44.255+0000 7fea5d2679c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:50:44.254 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:44.255+0000 7fea5d2679c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:50:44.256 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:44.259+0000 7fea5d2679c0 20 garbage collection: RGWGC::process entered with GC index_shard=19, max_secs=3600, expired_only=0 2024-09-14T11:50:44.260 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:44.263+0000 7fea5d2679c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:50:44.261 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:44.263+0000 7fea5d2679c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:50:44.262 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:44.263+0000 7fea5d2679c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:50:44.265 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:44.267+0000 7fea5d2679c0 20 garbage collection: RGWGC::process entered with GC index_shard=20, max_secs=3600, expired_only=0 2024-09-14T11:50:44.270 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:44.271+0000 7fea5d2679c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:50:44.272 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:44.275+0000 7fea5d2679c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:50:44.272 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:44.275+0000 7fea5d2679c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:50:44.276 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:44.279+0000 7fea5d2679c0 20 garbage collection: RGWGC::process entered with GC index_shard=21, max_secs=3600, expired_only=0 2024-09-14T11:50:44.280 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:44.283+0000 7fea5d2679c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:50:44.282 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:44.283+0000 7fea5d2679c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:50:44.283 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:44.287+0000 7fea5d2679c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:50:44.286 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:44.287+0000 7fea5d2679c0 20 garbage collection: RGWGC::process entered with GC index_shard=22, max_secs=3600, expired_only=0 2024-09-14T11:50:44.289 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:44.291+0000 7fea5d2679c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:50:44.291 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:44.295+0000 7fea5d2679c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:50:44.291 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:44.295+0000 7fea5d2679c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:50:44.294 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:44.295+0000 7fea5d2679c0 20 garbage collection: RGWGC::process entered with GC index_shard=23, max_secs=3600, expired_only=0 2024-09-14T11:50:44.297 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:44.299+0000 7fea5d2679c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:50:44.299 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:44.303+0000 7fea5d2679c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:50:44.300 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:44.303+0000 7fea5d2679c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:50:44.302 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:44.303+0000 7fea5d2679c0 20 garbage collection: RGWGC::process entered with GC index_shard=24, max_secs=3600, expired_only=0 2024-09-14T11:50:44.305 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:44.307+0000 7fea5d2679c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:50:44.307 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:44.311+0000 7fea5d2679c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:50:44.307 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:44.311+0000 7fea5d2679c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:50:44.310 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:44.311+0000 7fea5d2679c0 20 garbage collection: RGWGC::process entered with GC index_shard=25, max_secs=3600, expired_only=0 2024-09-14T11:50:44.313 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:44.315+0000 7fea5d2679c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:50:44.314 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:44.315+0000 7fea5d2679c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:50:44.314 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:44.319+0000 7fea5d2679c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:50:44.317 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:44.319+0000 7fea5d2679c0 20 garbage collection: RGWGC::process entered with GC index_shard=26, max_secs=3600, expired_only=0 2024-09-14T11:50:44.321 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:44.323+0000 7fea5d2679c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:50:44.322 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:44.323+0000 7fea5d2679c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:50:44.322 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:44.323+0000 7fea5d2679c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:50:44.325 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:44.327+0000 7fea5d2679c0 20 garbage collection: RGWGC::process entered with GC index_shard=27, max_secs=3600, expired_only=0 2024-09-14T11:50:44.329 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:44.331+0000 7fea5d2679c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:50:44.330 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:44.331+0000 7fea5d2679c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:50:44.331 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:44.335+0000 7fea5d2679c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:50:44.333 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:44.335+0000 7fea5d2679c0 20 garbage collection: RGWGC::process entered with GC index_shard=28, max_secs=3600, expired_only=0 2024-09-14T11:50:44.337 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:44.339+0000 7fea5d2679c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:50:44.339 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:44.343+0000 7fea5d2679c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:50:44.340 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:44.343+0000 7fea5d2679c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:50:44.343 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:44.347+0000 7fea5d2679c0 20 garbage collection: RGWGC::process entered with GC index_shard=29, max_secs=3600, expired_only=0 2024-09-14T11:50:44.346 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:44.347+0000 7fea5d2679c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:50:44.348 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:44.351+0000 7fea5d2679c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:50:44.349 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:44.351+0000 7fea5d2679c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:50:44.353 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:44.355+0000 7fe9117e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:50:44.359 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:44.363+0000 7fea5d2679c0 20 remove_watcher() i=0 2024-09-14T11:50:44.359 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:44.363+0000 7fea5d2679c0 2 removed watcher, disabling cache 2024-09-14T11:50:44.361 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:44.363+0000 7fea5d2679c0 20 remove_watcher() i=1 2024-09-14T11:50:44.364 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:44.367+0000 7fea5d2679c0 20 remove_watcher() i=2 2024-09-14T11:50:44.366 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:44.367+0000 7fea5d2679c0 20 remove_watcher() i=3 2024-09-14T11:50:44.368 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:44.371+0000 7fea5d2679c0 20 remove_watcher() i=4 2024-09-14T11:50:44.370 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:44.371+0000 7fea5d2679c0 20 remove_watcher() i=5 2024-09-14T11:50:44.372 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:44.375+0000 7fea5d2679c0 20 remove_watcher() i=6 2024-09-14T11:50:44.374 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:44.375+0000 7fea5d2679c0 20 remove_watcher() i=7 2024-09-14T11:50:44.394 DEBUG:teuthology.orchestra.run.smithi138:> radosgw-admin gc process --include-all 2024-09-14T11:50:44.466 INFO:teuthology.orchestra.run.smithi138.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:50:44.467 INFO:teuthology.orchestra.run.smithi138.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:50:44.512 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:44.515+0000 7fab43bef9c0 20 rados->read ofs=0 len=0 2024-09-14T11:50:44.514 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:44.515+0000 7fab43bef9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:50:44.514 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:44.515+0000 7fab43bef9c0 20 realm 2024-09-14T11:50:44.514 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:44.515+0000 7fab43bef9c0 20 rados->read ofs=0 len=0 2024-09-14T11:50:44.514 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:44.515+0000 7fab43bef9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:50:44.514 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:44.515+0000 7fab43bef9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:50:44.514 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:44.515+0000 7fab43bef9c0 20 rados->read ofs=0 len=0 2024-09-14T11:50:44.515 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:44.515+0000 7fab43bef9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:50:44.515 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:44.515+0000 7fab43bef9c0 20 rados->read ofs=0 len=0 2024-09-14T11:50:44.516 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:44.519+0000 7fab43bef9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:50:44.516 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:44.519+0000 7fab43bef9c0 20 rados->read ofs=0 len=0 2024-09-14T11:50:44.517 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:44.519+0000 7fab43bef9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:50:44.517 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:44.519+0000 7fab43bef9c0 20 searching for the correct realm 2024-09-14T11:50:44.520 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:44.523+0000 7fab41ef6640 0 -- 172.21.15.138:0/864543280 >> [v2:172.21.15.154:6824/416768175,v1:172.21.15.154:6825/416768175] conn(0x7fab3c0d5040 msgr2=0x7fab3c0d5930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:50:44.735 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:44.739+0000 7fab40ef4640 0 -- 172.21.15.138:0/864543280 >> [v2:172.21.15.138:6816/326481658,v1:172.21.15.138:6817/326481658] conn(0x7fab3c0e1900 msgr2=0x7fab3c0c73a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:50:44.954 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:44.955+0000 7fab43bef9c0 20 RGWRados::pool_iterate: got zone_info.d9e72d30-c60b-4d0d-9267-fdc36392d5ad 2024-09-14T11:50:44.954 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:44.955+0000 7fab43bef9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:50:44.954 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:44.955+0000 7fab43bef9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:50:44.954 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:44.955+0000 7fab43bef9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:50:44.954 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:44.955+0000 7fab43bef9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:50:44.954 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:44.955+0000 7fab43bef9c0 20 RGWRados::pool_iterate: got zonegroup_info.65ab941b-da8c-4160-94fb-3672b069d44f 2024-09-14T11:50:44.954 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:44.955+0000 7fab43bef9c0 20 rados->read ofs=0 len=0 2024-09-14T11:50:44.954 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:44.955+0000 7fab43bef9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:50:44.955 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:44.955+0000 7fab43bef9c0 20 rados->read ofs=0 len=0 2024-09-14T11:50:44.955 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:44.959+0000 7fab43bef9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:50:44.955 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:44.959+0000 7fab43bef9c0 20 rados->read ofs=0 len=0 2024-09-14T11:50:44.956 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:44.959+0000 7fab43bef9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:50:44.956 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:44.959+0000 7fab43bef9c0 20 zone default found 2024-09-14T11:50:44.957 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:44.959+0000 7fab43bef9c0 4 Realm: () 2024-09-14T11:50:44.957 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:44.959+0000 7fab43bef9c0 4 ZoneGroup: default (65ab941b-da8c-4160-94fb-3672b069d44f) 2024-09-14T11:50:44.957 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:44.959+0000 7fab43bef9c0 4 Zone: default (d9e72d30-c60b-4d0d-9267-fdc36392d5ad) 2024-09-14T11:50:44.957 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:44.959+0000 7fab43bef9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:50:44.957 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:44.959+0000 7fab43bef9c0 20 zonegroup default 2024-09-14T11:50:44.957 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:44.959+0000 7fab43bef9c0 20 rados->read ofs=0 len=0 2024-09-14T11:50:44.957 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:44.959+0000 7fab43bef9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:50:44.957 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:44.959+0000 7fab43bef9c0 20 rados->read ofs=0 len=0 2024-09-14T11:50:44.958 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:44.959+0000 7fab43bef9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:50:44.958 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:44.959+0000 7fab43bef9c0 20 rados->read ofs=0 len=0 2024-09-14T11:50:44.958 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:44.963+0000 7fab43bef9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:50:44.958 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:44.963+0000 7fab43bef9c0 20 started sync module instance, tier type = 2024-09-14T11:50:44.959 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:44.963+0000 7fab43bef9c0 20 started zone id=d9e72d30-c60b-4d0d-9267-fdc36392d5ad (name=default) with tier type = 2024-09-14T11:50:44.982 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:44.983+0000 7fab43bef9c0 20 add_watcher() i=0 2024-09-14T11:50:44.982 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:44.983+0000 7fab43bef9c0 20 add_watcher() i=1 2024-09-14T11:50:44.982 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:44.983+0000 7fab43bef9c0 20 add_watcher() i=2 2024-09-14T11:50:44.982 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:44.983+0000 7fab43bef9c0 20 add_watcher() i=3 2024-09-14T11:50:44.982 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:44.983+0000 7fab43bef9c0 20 add_watcher() i=4 2024-09-14T11:50:44.982 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:44.983+0000 7fab43bef9c0 20 add_watcher() i=5 2024-09-14T11:50:44.982 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:44.983+0000 7fab43bef9c0 20 add_watcher() i=6 2024-09-14T11:50:44.984 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:44.987+0000 7fab43bef9c0 20 add_watcher() i=7 2024-09-14T11:50:44.984 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:44.987+0000 7fab43bef9c0 2 all 8 watchers are set, enabling cache 2024-09-14T11:50:44.989 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:44.991+0000 7fa9f7fe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:50:44.990 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:44.991+0000 7fab43bef9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:50:44.990 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:44.991+0000 7fab43bef9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:50:45.080 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:45.083+0000 7fa9f6fe5640 20 reqs_thread_entry: start 2024-09-14T11:50:45.080 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:45.083+0000 7fab43bef9c0 20 init_complete bucket index max shards: 11 2024-09-14T11:50:45.080 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:45.083+0000 7fab43bef9c0 20 Filter name: none 2024-09-14T11:50:45.081 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:45.083+0000 7fa9f4fe1640 20 reqs_thread_entry: start 2024-09-14T11:50:45.081 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:45.083+0000 7fab43bef9c0 20 garbage collection: RGWGC::process entered with GC index_shard=16, max_secs=3600, expired_only=0 2024-09-14T11:50:45.085 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:45.087+0000 7fab43bef9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:50:45.086 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:45.087+0000 7fab43bef9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:50:45.087 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:45.091+0000 7fab43bef9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:50:45.090 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:45.091+0000 7fab43bef9c0 20 garbage collection: RGWGC::process entered with GC index_shard=17, max_secs=3600, expired_only=0 2024-09-14T11:50:45.092 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:45.095+0000 7fab43bef9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:50:45.093 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:45.095+0000 7fab43bef9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:50:45.094 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:45.095+0000 7fab43bef9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:50:45.096 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:45.099+0000 7fab43bef9c0 20 garbage collection: RGWGC::process entered with GC index_shard=18, max_secs=3600, expired_only=0 2024-09-14T11:50:45.100 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:45.103+0000 7fab43bef9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:50:45.101 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:45.103+0000 7fab43bef9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:50:45.102 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:45.103+0000 7fab43bef9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:50:45.104 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:45.107+0000 7fab43bef9c0 20 garbage collection: RGWGC::process entered with GC index_shard=19, max_secs=3600, expired_only=0 2024-09-14T11:50:45.106 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:45.107+0000 7fab43bef9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:50:45.106 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:45.111+0000 7fab43bef9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:50:45.107 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:45.111+0000 7fab43bef9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:50:45.109 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:45.111+0000 7fab43bef9c0 20 garbage collection: RGWGC::process entered with GC index_shard=20, max_secs=3600, expired_only=0 2024-09-14T11:50:45.112 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:45.115+0000 7fab43bef9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:50:45.114 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:45.115+0000 7fab43bef9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:50:45.114 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:45.115+0000 7fab43bef9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:50:45.117 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:45.119+0000 7fab43bef9c0 20 garbage collection: RGWGC::process entered with GC index_shard=21, max_secs=3600, expired_only=0 2024-09-14T11:50:45.121 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:45.123+0000 7fab43bef9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:50:45.123 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:45.127+0000 7fab43bef9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:50:45.124 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:45.127+0000 7fab43bef9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:50:45.127 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:45.131+0000 7fab43bef9c0 20 garbage collection: RGWGC::process entered with GC index_shard=22, max_secs=3600, expired_only=0 2024-09-14T11:50:45.129 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:45.131+0000 7fab43bef9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:50:45.130 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:45.131+0000 7fab43bef9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:50:45.130 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:45.131+0000 7fab43bef9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:50:45.132 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:45.135+0000 7fab43bef9c0 20 garbage collection: RGWGC::process entered with GC index_shard=23, max_secs=3600, expired_only=0 2024-09-14T11:50:45.136 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:45.139+0000 7fab43bef9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:50:45.138 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:45.139+0000 7fab43bef9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:50:45.139 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:45.143+0000 7fab43bef9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:50:45.143 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:45.147+0000 7fab43bef9c0 20 garbage collection: RGWGC::process entered with GC index_shard=24, max_secs=3600, expired_only=0 2024-09-14T11:50:45.146 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:45.147+0000 7fab43bef9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:50:45.147 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:45.151+0000 7fab43bef9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:50:45.148 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:45.151+0000 7fab43bef9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:50:45.151 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:45.155+0000 7fab43bef9c0 20 garbage collection: RGWGC::process entered with GC index_shard=25, max_secs=3600, expired_only=0 2024-09-14T11:50:45.154 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:45.155+0000 7fab43bef9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:50:45.155 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:45.159+0000 7fab43bef9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:50:45.156 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:45.159+0000 7fab43bef9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:50:45.158 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:45.159+0000 7fab43bef9c0 20 garbage collection: RGWGC::process entered with GC index_shard=26, max_secs=3600, expired_only=0 2024-09-14T11:50:45.161 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:45.163+0000 7fab43bef9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:50:45.162 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:45.163+0000 7fab43bef9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:50:45.162 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:45.163+0000 7fab43bef9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:50:45.164 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:45.167+0000 7fab43bef9c0 20 garbage collection: RGWGC::process entered with GC index_shard=27, max_secs=3600, expired_only=0 2024-09-14T11:50:45.168 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:45.171+0000 7fab43bef9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:50:45.170 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:45.171+0000 7fab43bef9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:50:45.171 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:45.175+0000 7fab43bef9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:50:45.174 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:45.175+0000 7fab43bef9c0 20 garbage collection: RGWGC::process entered with GC index_shard=28, max_secs=3600, expired_only=0 2024-09-14T11:50:45.176 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:45.179+0000 7fab43bef9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:50:45.177 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:45.179+0000 7fab43bef9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:50:45.177 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:45.179+0000 7fab43bef9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:50:45.179 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:45.183+0000 7fab43bef9c0 20 garbage collection: RGWGC::process entered with GC index_shard=29, max_secs=3600, expired_only=0 2024-09-14T11:50:45.183 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:45.187+0000 7fab43bef9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:50:45.184 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:45.187+0000 7fab43bef9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:50:45.185 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:45.187+0000 7fab43bef9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:50:45.188 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:45.191+0000 7fab43bef9c0 20 garbage collection: RGWGC::process entered with GC index_shard=30, max_secs=3600, expired_only=0 2024-09-14T11:50:45.190 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:45.191+0000 7fab43bef9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:50:45.192 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:45.195+0000 7fab43bef9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:50:45.192 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:45.195+0000 7fab43bef9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:50:45.195 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:45.199+0000 7fab43bef9c0 20 garbage collection: RGWGC::process entered with GC index_shard=31, max_secs=3600, expired_only=0 2024-09-14T11:50:45.197 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:45.199+0000 7fab43bef9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:50:45.199 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:45.203+0000 7fab43bef9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:50:45.199 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:45.203+0000 7fab43bef9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:50:45.201 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:45.203+0000 7fab43bef9c0 20 garbage collection: RGWGC::process entered with GC index_shard=0, max_secs=3600, expired_only=0 2024-09-14T11:50:45.204 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:45.207+0000 7fab43bef9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:50:45.205 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:45.207+0000 7fab43bef9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:50:45.206 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:45.207+0000 7fab43bef9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:50:45.209 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:45.211+0000 7fab43bef9c0 20 garbage collection: RGWGC::process entered with GC index_shard=1, max_secs=3600, expired_only=0 2024-09-14T11:50:45.211 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:45.215+0000 7fab43bef9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:50:45.212 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:45.215+0000 7fab43bef9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:50:45.212 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:45.215+0000 7fab43bef9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:50:45.214 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:45.215+0000 7fab43bef9c0 20 garbage collection: RGWGC::process entered with GC index_shard=2, max_secs=3600, expired_only=0 2024-09-14T11:50:45.217 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:45.219+0000 7fab43bef9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:50:45.218 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:45.219+0000 7fab43bef9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:50:45.219 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:45.223+0000 7fab43bef9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:50:45.222 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:45.223+0000 7fab43bef9c0 20 garbage collection: RGWGC::process entered with GC index_shard=3, max_secs=3600, expired_only=0 2024-09-14T11:50:45.225 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:45.227+0000 7fab43bef9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:50:45.226 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:45.227+0000 7fab43bef9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:50:45.227 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:45.231+0000 7fab43bef9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:50:45.230 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:45.231+0000 7fab43bef9c0 20 garbage collection: RGWGC::process entered with GC index_shard=4, max_secs=3600, expired_only=0 2024-09-14T11:50:45.233 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:45.235+0000 7fab43bef9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:50:45.235 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:45.239+0000 7fab43bef9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:50:45.236 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:45.239+0000 7fab43bef9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:50:45.239 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:45.243+0000 7fab43bef9c0 20 garbage collection: RGWGC::process entered with GC index_shard=5, max_secs=3600, expired_only=0 2024-09-14T11:50:45.242 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:45.243+0000 7fab43bef9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:50:45.244 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:45.247+0000 7fab43bef9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:50:45.244 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:45.247+0000 7fab43bef9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:50:45.247 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:45.251+0000 7fab43bef9c0 20 garbage collection: RGWGC::process entered with GC index_shard=6, max_secs=3600, expired_only=0 2024-09-14T11:50:45.251 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:45.255+0000 7fab43bef9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:50:45.252 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:45.255+0000 7fab43bef9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:50:45.253 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:45.255+0000 7fab43bef9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:50:45.256 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:45.259+0000 7fab43bef9c0 20 garbage collection: RGWGC::process entered with GC index_shard=7, max_secs=3600, expired_only=0 2024-09-14T11:50:45.260 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:45.263+0000 7fab43bef9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:50:45.262 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:45.263+0000 7fab43bef9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:50:45.263 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:45.267+0000 7fab43bef9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:50:45.266 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:45.267+0000 7fab43bef9c0 20 garbage collection: RGWGC::process entered with GC index_shard=8, max_secs=3600, expired_only=0 2024-09-14T11:50:45.269 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:45.271+0000 7fab43bef9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:50:45.272 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:45.275+0000 7fab43bef9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:50:45.273 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:45.275+0000 7fab43bef9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:50:45.276 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:45.279+0000 7fab43bef9c0 20 garbage collection: RGWGC::process entered with GC index_shard=9, max_secs=3600, expired_only=0 2024-09-14T11:50:45.279 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:45.283+0000 7fab43bef9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:50:45.281 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:45.283+0000 7fab43bef9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:50:45.282 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:45.283+0000 7fab43bef9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:50:45.284 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:45.287+0000 7fab43bef9c0 20 garbage collection: RGWGC::process entered with GC index_shard=10, max_secs=3600, expired_only=0 2024-09-14T11:50:45.288 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:45.291+0000 7fab43bef9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:50:45.290 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:45.291+0000 7fab43bef9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:50:45.291 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:45.295+0000 7fab43bef9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:50:45.294 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:45.295+0000 7fab43bef9c0 20 garbage collection: RGWGC::process entered with GC index_shard=11, max_secs=3600, expired_only=0 2024-09-14T11:50:45.297 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:45.299+0000 7fab43bef9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:50:45.298 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:45.299+0000 7fab43bef9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:50:45.299 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:45.303+0000 7fab43bef9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:50:45.302 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:45.303+0000 7fab43bef9c0 20 garbage collection: RGWGC::process entered with GC index_shard=12, max_secs=3600, expired_only=0 2024-09-14T11:50:45.306 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:45.307+0000 7fab43bef9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:50:45.308 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:45.311+0000 7fab43bef9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:50:45.309 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:45.311+0000 7fab43bef9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:50:45.312 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:45.315+0000 7fab43bef9c0 20 garbage collection: RGWGC::process entered with GC index_shard=13, max_secs=3600, expired_only=0 2024-09-14T11:50:45.316 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:45.319+0000 7fab43bef9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:50:45.317 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:45.319+0000 7fab43bef9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:50:45.317 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:45.319+0000 7fab43bef9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:50:45.320 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:45.323+0000 7fab43bef9c0 20 garbage collection: RGWGC::process entered with GC index_shard=14, max_secs=3600, expired_only=0 2024-09-14T11:50:45.324 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:45.327+0000 7fab43bef9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:50:45.325 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:45.327+0000 7fab43bef9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:50:45.326 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:45.327+0000 7fab43bef9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:50:45.329 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:45.331+0000 7fab43bef9c0 20 garbage collection: RGWGC::process entered with GC index_shard=15, max_secs=3600, expired_only=0 2024-09-14T11:50:45.332 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:45.335+0000 7fab43bef9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:50:45.334 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:45.335+0000 7fab43bef9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:50:45.335 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:45.339+0000 7fab43bef9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:50:45.339 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:45.343+0000 7fa9f7fe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:50:45.345 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:45.347+0000 7fab43bef9c0 20 remove_watcher() i=0 2024-09-14T11:50:45.345 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:45.347+0000 7fab43bef9c0 2 removed watcher, disabling cache 2024-09-14T11:50:45.348 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:45.351+0000 7fab43bef9c0 20 remove_watcher() i=1 2024-09-14T11:50:45.350 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:45.351+0000 7fab43bef9c0 20 remove_watcher() i=2 2024-09-14T11:50:45.353 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:45.355+0000 7fab43bef9c0 20 remove_watcher() i=3 2024-09-14T11:50:45.356 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:45.359+0000 7fab43bef9c0 20 remove_watcher() i=4 2024-09-14T11:50:45.358 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:45.359+0000 7fab43bef9c0 20 remove_watcher() i=5 2024-09-14T11:50:45.360 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:45.363+0000 7fab43bef9c0 20 remove_watcher() i=6 2024-09-14T11:50:45.362 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:45.367+0000 7fab43bef9c0 20 remove_watcher() i=7 2024-09-14T11:50:45.383 DEBUG:teuthology.orchestra.run.smithi138:> radosgw-admin gc process --include-all 2024-09-14T11:50:45.457 INFO:teuthology.orchestra.run.smithi138.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:50:45.457 INFO:teuthology.orchestra.run.smithi138.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:50:45.503 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:45.507+0000 7fec2e7ea9c0 20 rados->read ofs=0 len=0 2024-09-14T11:50:45.505 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:45.507+0000 7fec2e7ea9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:50:45.505 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:45.507+0000 7fec2e7ea9c0 20 realm 2024-09-14T11:50:45.505 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:45.507+0000 7fec2e7ea9c0 20 rados->read ofs=0 len=0 2024-09-14T11:50:45.505 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:45.507+0000 7fec2e7ea9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:50:45.505 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:45.507+0000 7fec2e7ea9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:50:45.505 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:45.507+0000 7fec2e7ea9c0 20 rados->read ofs=0 len=0 2024-09-14T11:50:45.506 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:45.507+0000 7fec2e7ea9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:50:45.506 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:45.507+0000 7fec2e7ea9c0 20 rados->read ofs=0 len=0 2024-09-14T11:50:45.507 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:45.511+0000 7fec2e7ea9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:50:45.507 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:45.511+0000 7fec2e7ea9c0 20 rados->read ofs=0 len=0 2024-09-14T11:50:45.508 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:45.511+0000 7fec2e7ea9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:50:45.508 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:45.511+0000 7fec2e7ea9c0 20 searching for the correct realm 2024-09-14T11:50:45.512 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:45.515+0000 7fec2caf1640 0 -- 172.21.15.138:0/1902383940 >> [v2:172.21.15.154:6824/416768175,v1:172.21.15.154:6825/416768175] conn(0x7fec1c106b60 msgr2=0x7fec1c0fda60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-14T11:50:45.519 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:45.523+0000 7fec2baef640 0 -- 172.21.15.138:0/1902383940 >> [v2:172.21.15.138:6816/326481658,v1:172.21.15.138:6817/326481658] conn(0x7fec1c132970 msgr2=0x7fec1c108970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-14T11:50:45.738 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:45.739+0000 7fec2e7ea9c0 20 RGWRados::pool_iterate: got zone_info.d9e72d30-c60b-4d0d-9267-fdc36392d5ad 2024-09-14T11:50:45.738 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:45.739+0000 7fec2e7ea9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:50:45.738 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:45.739+0000 7fec2e7ea9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:50:45.738 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:45.739+0000 7fec2e7ea9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:50:45.738 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:45.739+0000 7fec2e7ea9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:50:45.738 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:45.739+0000 7fec2e7ea9c0 20 RGWRados::pool_iterate: got zonegroup_info.65ab941b-da8c-4160-94fb-3672b069d44f 2024-09-14T11:50:45.738 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:45.739+0000 7fec2e7ea9c0 20 rados->read ofs=0 len=0 2024-09-14T11:50:45.739 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:45.739+0000 7fec2e7ea9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:50:45.739 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:45.743+0000 7fec2e7ea9c0 20 rados->read ofs=0 len=0 2024-09-14T11:50:45.740 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:45.743+0000 7fec2e7ea9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:50:45.740 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:45.743+0000 7fec2e7ea9c0 20 rados->read ofs=0 len=0 2024-09-14T11:50:45.741 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:45.743+0000 7fec2e7ea9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:50:45.741 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:45.743+0000 7fec2e7ea9c0 20 zone default found 2024-09-14T11:50:45.741 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:45.743+0000 7fec2e7ea9c0 4 Realm: () 2024-09-14T11:50:45.741 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:45.743+0000 7fec2e7ea9c0 4 ZoneGroup: default (65ab941b-da8c-4160-94fb-3672b069d44f) 2024-09-14T11:50:45.741 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:45.743+0000 7fec2e7ea9c0 4 Zone: default (d9e72d30-c60b-4d0d-9267-fdc36392d5ad) 2024-09-14T11:50:45.741 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:45.743+0000 7fec2e7ea9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:50:45.741 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:45.743+0000 7fec2e7ea9c0 20 zonegroup default 2024-09-14T11:50:45.741 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:45.743+0000 7fec2e7ea9c0 20 rados->read ofs=0 len=0 2024-09-14T11:50:45.741 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:45.743+0000 7fec2e7ea9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:50:45.742 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:45.743+0000 7fec2e7ea9c0 20 rados->read ofs=0 len=0 2024-09-14T11:50:45.742 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:45.743+0000 7fec2e7ea9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:50:45.742 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:45.743+0000 7fec2e7ea9c0 20 rados->read ofs=0 len=0 2024-09-14T11:50:45.742 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:45.747+0000 7fec2e7ea9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:50:45.743 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:45.747+0000 7fec2e7ea9c0 20 started sync module instance, tier type = 2024-09-14T11:50:45.743 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:45.747+0000 7fec2e7ea9c0 20 started zone id=d9e72d30-c60b-4d0d-9267-fdc36392d5ad (name=default) with tier type = 2024-09-14T11:50:45.767 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:45.767+0000 7fec2e7ea9c0 20 add_watcher() i=0 2024-09-14T11:50:45.767 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:45.767+0000 7fec2e7ea9c0 20 add_watcher() i=1 2024-09-14T11:50:45.767 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:45.767+0000 7fec2e7ea9c0 20 add_watcher() i=2 2024-09-14T11:50:45.767 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:45.767+0000 7fec2e7ea9c0 20 add_watcher() i=3 2024-09-14T11:50:45.767 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:45.767+0000 7fec2e7ea9c0 20 add_watcher() i=4 2024-09-14T11:50:45.767 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:45.767+0000 7fec2e7ea9c0 20 add_watcher() i=5 2024-09-14T11:50:45.767 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:45.767+0000 7fec2e7ea9c0 20 add_watcher() i=6 2024-09-14T11:50:45.769 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:45.771+0000 7fec2e7ea9c0 20 add_watcher() i=7 2024-09-14T11:50:45.769 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:45.771+0000 7fec2e7ea9c0 2 all 8 watchers are set, enabling cache 2024-09-14T11:50:45.773 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:45.775+0000 7feae37de640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:50:45.774 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:45.775+0000 7fec2e7ea9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:50:45.774 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:45.775+0000 7fec2e7ea9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:50:45.874 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:45.875+0000 7feae27dc640 20 reqs_thread_entry: start 2024-09-14T11:50:45.875 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:45.875+0000 7fec2e7ea9c0 20 init_complete bucket index max shards: 11 2024-09-14T11:50:45.875 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:45.875+0000 7fec2e7ea9c0 20 Filter name: none 2024-09-14T11:50:45.875 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:45.875+0000 7feadb7fe640 20 reqs_thread_entry: start 2024-09-14T11:50:45.875 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:45.879+0000 7fec2e7ea9c0 20 garbage collection: RGWGC::process entered with GC index_shard=28, max_secs=3600, expired_only=0 2024-09-14T11:50:45.877 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:45.879+0000 7fec2e7ea9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:50:45.877 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:45.879+0000 7fec2e7ea9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:50:45.878 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:45.879+0000 7fec2e7ea9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:50:45.881 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:45.883+0000 7fec2e7ea9c0 20 garbage collection: RGWGC::process entered with GC index_shard=29, max_secs=3600, expired_only=0 2024-09-14T11:50:45.884 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:45.887+0000 7fec2e7ea9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:50:45.885 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:45.887+0000 7fec2e7ea9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:50:45.885 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:45.887+0000 7fec2e7ea9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:50:45.888 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:45.891+0000 7fec2e7ea9c0 20 garbage collection: RGWGC::process entered with GC index_shard=30, max_secs=3600, expired_only=0 2024-09-14T11:50:45.889 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:45.891+0000 7fec2e7ea9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:50:45.890 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:45.891+0000 7fec2e7ea9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:50:45.891 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:45.895+0000 7fec2e7ea9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:50:45.892 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:45.895+0000 7fec2e7ea9c0 20 garbage collection: RGWGC::process entered with GC index_shard=31, max_secs=3600, expired_only=0 2024-09-14T11:50:45.895 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:45.899+0000 7fec2e7ea9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:50:45.896 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:45.899+0000 7fec2e7ea9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:50:45.896 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:45.899+0000 7fec2e7ea9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:50:45.898 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:45.899+0000 7fec2e7ea9c0 20 garbage collection: RGWGC::process entered with GC index_shard=0, max_secs=3600, expired_only=0 2024-09-14T11:50:45.901 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:45.903+0000 7fec2e7ea9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:50:45.902 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:45.903+0000 7fec2e7ea9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:50:45.903 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:45.907+0000 7fec2e7ea9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:50:45.905 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:45.907+0000 7fec2e7ea9c0 20 garbage collection: RGWGC::process entered with GC index_shard=1, max_secs=3600, expired_only=0 2024-09-14T11:50:45.908 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:45.911+0000 7fec2e7ea9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:50:45.908 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:45.911+0000 7fec2e7ea9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:50:45.909 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:45.911+0000 7fec2e7ea9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:50:45.910 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:45.911+0000 7fec2e7ea9c0 20 garbage collection: RGWGC::process entered with GC index_shard=2, max_secs=3600, expired_only=0 2024-09-14T11:50:45.913 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:45.915+0000 7fec2e7ea9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:50:45.913 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:45.915+0000 7fec2e7ea9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:50:45.914 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:45.915+0000 7fec2e7ea9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:50:45.916 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:45.919+0000 7fec2e7ea9c0 20 garbage collection: RGWGC::process entered with GC index_shard=3, max_secs=3600, expired_only=0 2024-09-14T11:50:45.918 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:45.919+0000 7fec2e7ea9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:50:45.919 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:45.923+0000 7fec2e7ea9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:50:45.919 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:45.923+0000 7fec2e7ea9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:50:45.921 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:45.923+0000 7fec2e7ea9c0 20 garbage collection: RGWGC::process entered with GC index_shard=4, max_secs=3600, expired_only=0 2024-09-14T11:50:45.925 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:45.927+0000 7fec2e7ea9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:50:45.927 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:45.931+0000 7fec2e7ea9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:50:45.927 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:45.931+0000 7fec2e7ea9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:50:45.930 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:45.931+0000 7fec2e7ea9c0 20 garbage collection: RGWGC::process entered with GC index_shard=5, max_secs=3600, expired_only=0 2024-09-14T11:50:45.933 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:45.935+0000 7fec2e7ea9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:50:45.934 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:45.935+0000 7fec2e7ea9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:50:45.934 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:45.935+0000 7fec2e7ea9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:50:45.936 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:45.939+0000 7fec2e7ea9c0 20 garbage collection: RGWGC::process entered with GC index_shard=6, max_secs=3600, expired_only=0 2024-09-14T11:50:45.940 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:45.943+0000 7fec2e7ea9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:50:45.942 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:45.943+0000 7fec2e7ea9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:50:45.942 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:45.943+0000 7fec2e7ea9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:50:45.945 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:45.947+0000 7fec2e7ea9c0 20 garbage collection: RGWGC::process entered with GC index_shard=7, max_secs=3600, expired_only=0 2024-09-14T11:50:45.948 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:45.951+0000 7fec2e7ea9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:50:45.949 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:45.951+0000 7fec2e7ea9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:50:45.949 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:45.951+0000 7fec2e7ea9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:50:45.952 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:45.955+0000 7fec2e7ea9c0 20 garbage collection: RGWGC::process entered with GC index_shard=8, max_secs=3600, expired_only=0 2024-09-14T11:50:45.954 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:45.959+0000 7fec2e7ea9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:50:45.956 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:45.959+0000 7fec2e7ea9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:50:45.956 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:45.959+0000 7fec2e7ea9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:50:45.958 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:45.959+0000 7fec2e7ea9c0 20 garbage collection: RGWGC::process entered with GC index_shard=9, max_secs=3600, expired_only=0 2024-09-14T11:50:45.962 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:45.963+0000 7fec2e7ea9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:50:45.963 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:45.967+0000 7fec2e7ea9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:50:45.964 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:45.967+0000 7fec2e7ea9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:50:45.966 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:45.967+0000 7fec2e7ea9c0 20 garbage collection: RGWGC::process entered with GC index_shard=10, max_secs=3600, expired_only=0 2024-09-14T11:50:45.970 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:45.971+0000 7fec2e7ea9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:50:45.971 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:45.975+0000 7fec2e7ea9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:50:45.972 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:45.975+0000 7fec2e7ea9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:50:45.975 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:45.979+0000 7fec2e7ea9c0 20 garbage collection: RGWGC::process entered with GC index_shard=11, max_secs=3600, expired_only=0 2024-09-14T11:50:45.977 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:45.979+0000 7fec2e7ea9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:50:45.978 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:45.979+0000 7fec2e7ea9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:50:45.978 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:45.979+0000 7fec2e7ea9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:50:45.980 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:45.983+0000 7fec2e7ea9c0 20 garbage collection: RGWGC::process entered with GC index_shard=12, max_secs=3600, expired_only=0 2024-09-14T11:50:45.984 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:45.987+0000 7fec2e7ea9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:50:45.985 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:45.987+0000 7fec2e7ea9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:50:45.987 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:45.991+0000 7fec2e7ea9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:50:45.990 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:45.991+0000 7fec2e7ea9c0 20 garbage collection: RGWGC::process entered with GC index_shard=13, max_secs=3600, expired_only=0 2024-09-14T11:50:45.993 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:45.995+0000 7fec2e7ea9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:50:45.993 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:45.995+0000 7fec2e7ea9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:50:45.994 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:45.995+0000 7fec2e7ea9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:50:45.996 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:45.999+0000 7fec2e7ea9c0 20 garbage collection: RGWGC::process entered with GC index_shard=14, max_secs=3600, expired_only=0 2024-09-14T11:50:45.999 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:46.003+0000 7fec2e7ea9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:50:45.999 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:46.003+0000 7fec2e7ea9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:50:46.000 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:46.003+0000 7fec2e7ea9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:50:46.002 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:46.003+0000 7fec2e7ea9c0 20 garbage collection: RGWGC::process entered with GC index_shard=15, max_secs=3600, expired_only=0 2024-09-14T11:50:46.006 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:46.007+0000 7fec2e7ea9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:50:46.007 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:46.011+0000 7fec2e7ea9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:50:46.008 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:46.011+0000 7fec2e7ea9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:50:46.010 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:46.011+0000 7fec2e7ea9c0 20 garbage collection: RGWGC::process entered with GC index_shard=16, max_secs=3600, expired_only=0 2024-09-14T11:50:46.014 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:46.015+0000 7fec2e7ea9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:50:46.015 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:46.019+0000 7fec2e7ea9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:50:46.016 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:46.019+0000 7fec2e7ea9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:50:46.019 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:46.023+0000 7fec2e7ea9c0 20 garbage collection: RGWGC::process entered with GC index_shard=17, max_secs=3600, expired_only=0 2024-09-14T11:50:46.022 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:46.023+0000 7fec2e7ea9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:50:46.024 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:46.027+0000 7fec2e7ea9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:50:46.024 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:46.027+0000 7fec2e7ea9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:50:46.027 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:46.031+0000 7fec2e7ea9c0 20 garbage collection: RGWGC::process entered with GC index_shard=18, max_secs=3600, expired_only=0 2024-09-14T11:50:46.030 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:46.031+0000 7fec2e7ea9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:50:46.031 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:46.035+0000 7fec2e7ea9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:50:46.032 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:46.035+0000 7fec2e7ea9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:50:46.035 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:46.039+0000 7fec2e7ea9c0 20 garbage collection: RGWGC::process entered with GC index_shard=19, max_secs=3600, expired_only=0 2024-09-14T11:50:46.038 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:46.039+0000 7fec2e7ea9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:50:46.038 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:46.043+0000 7fec2e7ea9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:50:46.039 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:46.043+0000 7fec2e7ea9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:50:46.041 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:46.043+0000 7fec2e7ea9c0 20 garbage collection: RGWGC::process entered with GC index_shard=20, max_secs=3600, expired_only=0 2024-09-14T11:50:46.045 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:46.047+0000 7fec2e7ea9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:50:46.046 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:46.047+0000 7fec2e7ea9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:50:46.047 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:46.051+0000 7fec2e7ea9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:50:46.049 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:46.051+0000 7fec2e7ea9c0 20 garbage collection: RGWGC::process entered with GC index_shard=21, max_secs=3600, expired_only=0 2024-09-14T11:50:46.053 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:46.055+0000 7fec2e7ea9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:50:46.054 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:46.055+0000 7fec2e7ea9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:50:46.055 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:46.059+0000 7fec2e7ea9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:50:46.058 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:46.059+0000 7fec2e7ea9c0 20 garbage collection: RGWGC::process entered with GC index_shard=22, max_secs=3600, expired_only=0 2024-09-14T11:50:46.061 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:46.063+0000 7fec2e7ea9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:50:46.062 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:46.063+0000 7fec2e7ea9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:50:46.063 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:46.067+0000 7fec2e7ea9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:50:46.065 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:46.067+0000 7fec2e7ea9c0 20 garbage collection: RGWGC::process entered with GC index_shard=23, max_secs=3600, expired_only=0 2024-09-14T11:50:46.069 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:46.071+0000 7fec2e7ea9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:50:46.070 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:46.071+0000 7fec2e7ea9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:50:46.071 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:46.075+0000 7fec2e7ea9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:50:46.077 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:46.079+0000 7fec2e7ea9c0 20 garbage collection: RGWGC::process entered with GC index_shard=24, max_secs=3600, expired_only=0 2024-09-14T11:50:46.081 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:46.083+0000 7fec2e7ea9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:50:46.082 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:46.083+0000 7fec2e7ea9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:50:46.082 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:46.087+0000 7fec2e7ea9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:50:46.085 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:46.087+0000 7fec2e7ea9c0 20 garbage collection: RGWGC::process entered with GC index_shard=25, max_secs=3600, expired_only=0 2024-09-14T11:50:46.089 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:46.091+0000 7fec2e7ea9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:50:46.091 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:46.095+0000 7fec2e7ea9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:50:46.092 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:46.095+0000 7fec2e7ea9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:50:46.095 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:46.099+0000 7fec2e7ea9c0 20 garbage collection: RGWGC::process entered with GC index_shard=26, max_secs=3600, expired_only=0 2024-09-14T11:50:46.098 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:46.099+0000 7fec2e7ea9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:50:46.100 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:46.103+0000 7fec2e7ea9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:50:46.100 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:46.103+0000 7fec2e7ea9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:50:46.102 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:46.103+0000 7fec2e7ea9c0 20 garbage collection: RGWGC::process entered with GC index_shard=27, max_secs=3600, expired_only=0 2024-09-14T11:50:46.106 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:46.107+0000 7fec2e7ea9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:50:46.107 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:46.111+0000 7fec2e7ea9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:50:46.109 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:46.111+0000 7fec2e7ea9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:50:46.113 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:46.115+0000 7feae37de640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:50:46.118 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:46.119+0000 7fec2e7ea9c0 20 remove_watcher() i=0 2024-09-14T11:50:46.118 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:46.119+0000 7fec2e7ea9c0 2 removed watcher, disabling cache 2024-09-14T11:50:46.120 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:46.123+0000 7fec2e7ea9c0 20 remove_watcher() i=1 2024-09-14T11:50:46.122 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:46.123+0000 7fec2e7ea9c0 20 remove_watcher() i=2 2024-09-14T11:50:46.124 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:46.127+0000 7fec2e7ea9c0 20 remove_watcher() i=3 2024-09-14T11:50:46.127 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:46.131+0000 7fec2e7ea9c0 20 remove_watcher() i=4 2024-09-14T11:50:46.129 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:46.131+0000 7fec2e7ea9c0 20 remove_watcher() i=5 2024-09-14T11:50:46.130 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:46.135+0000 7fec2e7ea9c0 20 remove_watcher() i=6 2024-09-14T11:50:46.132 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:46.135+0000 7fec2e7ea9c0 20 remove_watcher() i=7 2024-09-14T11:50:46.150 DEBUG:teuthology.orchestra.run.smithi138:> radosgw-admin gc process --include-all 2024-09-14T11:50:46.225 INFO:teuthology.orchestra.run.smithi138.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:50:46.225 INFO:teuthology.orchestra.run.smithi138.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:50:46.272 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:46.275+0000 7f69a820d9c0 20 rados->read ofs=0 len=0 2024-09-14T11:50:46.274 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:46.275+0000 7f69a820d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:50:46.274 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:46.275+0000 7f69a820d9c0 20 realm 2024-09-14T11:50:46.274 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:46.275+0000 7f69a820d9c0 20 rados->read ofs=0 len=0 2024-09-14T11:50:46.274 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:46.275+0000 7f69a820d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:50:46.274 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:46.275+0000 7f69a820d9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:50:46.275 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:46.275+0000 7f69a820d9c0 20 rados->read ofs=0 len=0 2024-09-14T11:50:46.275 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:46.275+0000 7f69a820d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:50:46.275 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:46.275+0000 7f69a820d9c0 20 rados->read ofs=0 len=0 2024-09-14T11:50:46.276 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:46.279+0000 7f69a820d9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:50:46.276 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:46.279+0000 7f69a820d9c0 20 rados->read ofs=0 len=0 2024-09-14T11:50:46.277 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:46.279+0000 7f69a820d9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:50:46.277 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:46.279+0000 7f69a820d9c0 20 searching for the correct realm 2024-09-14T11:50:46.281 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:46.283+0000 7f69a5512640 0 -- 172.21.15.138:0/111908979 >> [v2:172.21.15.154:6824/416768175,v1:172.21.15.154:6825/416768175] conn(0x7f699c008040 msgr2=0x7f699c0015f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:50:46.496 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:46.499+0000 7f69a5d13640 0 -- 172.21.15.138:0/111908979 >> [v2:172.21.15.138:6816/326481658,v1:172.21.15.138:6817/326481658] conn(0x7f699c06c040 msgr2=0x7f699c003030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:50:46.716 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:46.715+0000 7f69a820d9c0 20 RGWRados::pool_iterate: got zone_info.d9e72d30-c60b-4d0d-9267-fdc36392d5ad 2024-09-14T11:50:46.716 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:46.715+0000 7f69a820d9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:50:46.716 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:46.715+0000 7f69a820d9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:50:46.717 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:46.715+0000 7f69a820d9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:50:46.717 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:46.715+0000 7f69a820d9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:50:46.717 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:46.715+0000 7f69a820d9c0 20 RGWRados::pool_iterate: got zonegroup_info.65ab941b-da8c-4160-94fb-3672b069d44f 2024-09-14T11:50:46.717 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:46.715+0000 7f69a820d9c0 20 rados->read ofs=0 len=0 2024-09-14T11:50:46.717 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:46.719+0000 7f69a820d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:50:46.717 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:46.719+0000 7f69a820d9c0 20 rados->read ofs=0 len=0 2024-09-14T11:50:46.717 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:46.719+0000 7f69a820d9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:50:46.717 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:46.719+0000 7f69a820d9c0 20 rados->read ofs=0 len=0 2024-09-14T11:50:46.718 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:46.719+0000 7f69a820d9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:50:46.718 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:46.719+0000 7f69a820d9c0 20 zone default found 2024-09-14T11:50:46.718 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:46.719+0000 7f69a820d9c0 4 Realm: () 2024-09-14T11:50:46.718 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:46.719+0000 7f69a820d9c0 4 ZoneGroup: default (65ab941b-da8c-4160-94fb-3672b069d44f) 2024-09-14T11:50:46.718 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:46.719+0000 7f69a820d9c0 4 Zone: default (d9e72d30-c60b-4d0d-9267-fdc36392d5ad) 2024-09-14T11:50:46.719 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:46.719+0000 7f69a820d9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:50:46.719 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:46.719+0000 7f69a820d9c0 20 zonegroup default 2024-09-14T11:50:46.719 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:46.719+0000 7f69a820d9c0 20 rados->read ofs=0 len=0 2024-09-14T11:50:46.719 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:46.719+0000 7f69a820d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:50:46.719 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:46.719+0000 7f69a820d9c0 20 rados->read ofs=0 len=0 2024-09-14T11:50:46.719 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:46.723+0000 7f69a820d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:50:46.720 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:46.723+0000 7f69a820d9c0 20 rados->read ofs=0 len=0 2024-09-14T11:50:46.720 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:46.723+0000 7f69a820d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:50:46.720 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:46.723+0000 7f69a820d9c0 20 started sync module instance, tier type = 2024-09-14T11:50:46.720 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:46.723+0000 7f69a820d9c0 20 started zone id=d9e72d30-c60b-4d0d-9267-fdc36392d5ad (name=default) with tier type = 2024-09-14T11:50:46.743 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:46.747+0000 7f69a820d9c0 20 add_watcher() i=0 2024-09-14T11:50:46.743 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:46.747+0000 7f69a820d9c0 20 add_watcher() i=1 2024-09-14T11:50:46.743 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:46.747+0000 7f69a820d9c0 20 add_watcher() i=2 2024-09-14T11:50:46.743 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:46.747+0000 7f69a820d9c0 20 add_watcher() i=3 2024-09-14T11:50:46.743 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:46.747+0000 7f69a820d9c0 20 add_watcher() i=4 2024-09-14T11:50:46.743 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:46.747+0000 7f69a820d9c0 20 add_watcher() i=5 2024-09-14T11:50:46.743 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:46.747+0000 7f69a820d9c0 20 add_watcher() i=6 2024-09-14T11:50:46.745 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:46.747+0000 7f69a820d9c0 20 add_watcher() i=7 2024-09-14T11:50:46.745 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:46.747+0000 7f69a820d9c0 2 all 8 watchers are set, enabling cache 2024-09-14T11:50:46.749 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:46.751+0000 7f68577fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:50:46.750 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:46.751+0000 7f69a820d9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:50:46.750 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:46.751+0000 7f69a820d9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:50:46.842 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:46.843+0000 7f68567fc640 20 reqs_thread_entry: start 2024-09-14T11:50:46.842 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:46.843+0000 7f69a820d9c0 20 init_complete bucket index max shards: 11 2024-09-14T11:50:46.842 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:46.843+0000 7f69a820d9c0 20 Filter name: none 2024-09-14T11:50:46.842 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:46.843+0000 7f67c7fff640 20 reqs_thread_entry: start 2024-09-14T11:50:46.842 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:46.843+0000 7f69a820d9c0 20 garbage collection: RGWGC::process entered with GC index_shard=30, max_secs=3600, expired_only=0 2024-09-14T11:50:46.844 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:46.847+0000 7f69a820d9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:50:46.845 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:46.847+0000 7f69a820d9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:50:46.846 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:46.847+0000 7f69a820d9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:50:46.847 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:46.851+0000 7f69a820d9c0 20 garbage collection: RGWGC::process entered with GC index_shard=31, max_secs=3600, expired_only=0 2024-09-14T11:50:46.850 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:46.851+0000 7f69a820d9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:50:46.851 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:46.855+0000 7f69a820d9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:50:46.851 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:46.855+0000 7f69a820d9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:50:46.853 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:46.855+0000 7f69a820d9c0 20 garbage collection: RGWGC::process entered with GC index_shard=0, max_secs=3600, expired_only=0 2024-09-14T11:50:46.857 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:46.859+0000 7f69a820d9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:50:46.858 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:46.859+0000 7f69a820d9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:50:46.860 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:46.863+0000 7f69a820d9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:50:46.863 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:46.867+0000 7f69a820d9c0 20 garbage collection: RGWGC::process entered with GC index_shard=1, max_secs=3600, expired_only=0 2024-09-14T11:50:46.865 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:46.867+0000 7f69a820d9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:50:46.865 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:46.867+0000 7f69a820d9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:50:46.866 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:46.867+0000 7f69a820d9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:50:46.868 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:46.871+0000 7f69a820d9c0 20 garbage collection: RGWGC::process entered with GC index_shard=2, max_secs=3600, expired_only=0 2024-09-14T11:50:46.870 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:46.871+0000 7f69a820d9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:50:46.871 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:46.875+0000 7f69a820d9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:50:46.871 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:46.875+0000 7f69a820d9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:50:46.874 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:46.875+0000 7f69a820d9c0 20 garbage collection: RGWGC::process entered with GC index_shard=3, max_secs=3600, expired_only=0 2024-09-14T11:50:46.876 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:46.879+0000 7f69a820d9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:50:46.877 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:46.879+0000 7f69a820d9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:50:46.878 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:46.879+0000 7f69a820d9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:50:46.880 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:46.883+0000 7f69a820d9c0 20 garbage collection: RGWGC::process entered with GC index_shard=4, max_secs=3600, expired_only=0 2024-09-14T11:50:46.883 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:46.887+0000 7f69a820d9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:50:46.885 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:46.887+0000 7f69a820d9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:50:46.886 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:46.887+0000 7f69a820d9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:50:46.889 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:46.891+0000 7f69a820d9c0 20 garbage collection: RGWGC::process entered with GC index_shard=5, max_secs=3600, expired_only=0 2024-09-14T11:50:46.892 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:46.895+0000 7f69a820d9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:50:46.893 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:46.895+0000 7f69a820d9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:50:46.893 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:46.895+0000 7f69a820d9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:50:46.895 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:46.899+0000 7f69a820d9c0 20 garbage collection: RGWGC::process entered with GC index_shard=6, max_secs=3600, expired_only=0 2024-09-14T11:50:46.901 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:46.903+0000 7f69a820d9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:50:46.902 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:46.907+0000 7f69a820d9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:50:46.903 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:46.907+0000 7f69a820d9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:50:46.906 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:46.907+0000 7f69a820d9c0 20 garbage collection: RGWGC::process entered with GC index_shard=7, max_secs=3600, expired_only=0 2024-09-14T11:50:46.909 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:46.911+0000 7f69a820d9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:50:46.909 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:46.911+0000 7f69a820d9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:50:46.910 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:46.911+0000 7f69a820d9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:50:46.912 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:46.915+0000 7f69a820d9c0 20 garbage collection: RGWGC::process entered with GC index_shard=8, max_secs=3600, expired_only=0 2024-09-14T11:50:46.916 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:46.919+0000 7f69a820d9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:50:46.917 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:46.919+0000 7f69a820d9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:50:46.918 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:46.919+0000 7f69a820d9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:50:46.921 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:46.923+0000 7f69a820d9c0 20 garbage collection: RGWGC::process entered with GC index_shard=9, max_secs=3600, expired_only=0 2024-09-14T11:50:46.925 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:46.927+0000 7f69a820d9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:50:46.926 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:46.927+0000 7f69a820d9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:50:46.927 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:46.931+0000 7f69a820d9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:50:46.930 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:46.931+0000 7f69a820d9c0 20 garbage collection: RGWGC::process entered with GC index_shard=10, max_secs=3600, expired_only=0 2024-09-14T11:50:46.934 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:46.935+0000 7f69a820d9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:50:46.936 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:46.939+0000 7f69a820d9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:50:46.936 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:46.939+0000 7f69a820d9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:50:46.940 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:46.943+0000 7f69a820d9c0 20 garbage collection: RGWGC::process entered with GC index_shard=11, max_secs=3600, expired_only=0 2024-09-14T11:50:46.943 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:46.947+0000 7f69a820d9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:50:46.945 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:46.947+0000 7f69a820d9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:50:46.945 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:46.947+0000 7f69a820d9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:50:46.948 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:46.951+0000 7f69a820d9c0 20 garbage collection: RGWGC::process entered with GC index_shard=12, max_secs=3600, expired_only=0 2024-09-14T11:50:46.952 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:46.955+0000 7f69a820d9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:50:46.954 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:46.955+0000 7f69a820d9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:50:46.954 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:46.955+0000 7f69a820d9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:50:46.957 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:46.959+0000 7f69a820d9c0 20 garbage collection: RGWGC::process entered with GC index_shard=13, max_secs=3600, expired_only=0 2024-09-14T11:50:46.960 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:46.963+0000 7f69a820d9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:50:46.961 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:46.963+0000 7f69a820d9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:50:46.961 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:46.963+0000 7f69a820d9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:50:46.964 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:46.967+0000 7f69a820d9c0 20 garbage collection: RGWGC::process entered with GC index_shard=14, max_secs=3600, expired_only=0 2024-09-14T11:50:46.968 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:46.971+0000 7f69a820d9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:50:46.969 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:46.971+0000 7f69a820d9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:50:46.970 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:46.971+0000 7f69a820d9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:50:46.973 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:46.975+0000 7f69a820d9c0 20 garbage collection: RGWGC::process entered with GC index_shard=15, max_secs=3600, expired_only=0 2024-09-14T11:50:46.977 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:46.979+0000 7f69a820d9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:50:46.979 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:46.983+0000 7f69a820d9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:50:46.980 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:46.983+0000 7f69a820d9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:50:46.983 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:46.987+0000 7f69a820d9c0 20 garbage collection: RGWGC::process entered with GC index_shard=16, max_secs=3600, expired_only=0 2024-09-14T11:50:46.987 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:46.991+0000 7f69a820d9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:50:46.989 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:46.991+0000 7f69a820d9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:50:46.990 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:46.991+0000 7f69a820d9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:50:46.993 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:46.995+0000 7f69a820d9c0 20 garbage collection: RGWGC::process entered with GC index_shard=17, max_secs=3600, expired_only=0 2024-09-14T11:50:46.996 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:46.999+0000 7f69a820d9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:50:46.997 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:46.999+0000 7f69a820d9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:50:46.999 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:47.003+0000 7f69a820d9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:50:47.002 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:47.003+0000 7f69a820d9c0 20 garbage collection: RGWGC::process entered with GC index_shard=18, max_secs=3600, expired_only=0 2024-09-14T11:50:47.006 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:47.007+0000 7f69a820d9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:50:47.007 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:47.011+0000 7f69a820d9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:50:47.008 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:47.011+0000 7f69a820d9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:50:47.010 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:47.011+0000 7f69a820d9c0 20 garbage collection: RGWGC::process entered with GC index_shard=19, max_secs=3600, expired_only=0 2024-09-14T11:50:47.014 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:47.015+0000 7f69a820d9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:50:47.015 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:47.019+0000 7f69a820d9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:50:47.016 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:47.019+0000 7f69a820d9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:50:47.019 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:47.023+0000 7f69a820d9c0 20 garbage collection: RGWGC::process entered with GC index_shard=20, max_secs=3600, expired_only=0 2024-09-14T11:50:47.024 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:47.027+0000 7f69a820d9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:50:47.025 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:47.027+0000 7f69a820d9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:50:47.027 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:47.031+0000 7f69a820d9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:50:47.030 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:47.031+0000 7f69a820d9c0 20 garbage collection: RGWGC::process entered with GC index_shard=21, max_secs=3600, expired_only=0 2024-09-14T11:50:47.033 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:47.035+0000 7f69a820d9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:50:47.035 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:47.039+0000 7f69a820d9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:50:47.036 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:47.039+0000 7f69a820d9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:50:47.039 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:47.043+0000 7f69a820d9c0 20 garbage collection: RGWGC::process entered with GC index_shard=22, max_secs=3600, expired_only=0 2024-09-14T11:50:47.042 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:47.043+0000 7f69a820d9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:50:47.042 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:47.043+0000 7f69a820d9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:50:47.043 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:47.047+0000 7f69a820d9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:50:47.045 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:47.047+0000 7f69a820d9c0 20 garbage collection: RGWGC::process entered with GC index_shard=23, max_secs=3600, expired_only=0 2024-09-14T11:50:47.049 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:47.051+0000 7f69a820d9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:50:47.051 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:47.055+0000 7f69a820d9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:50:47.051 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:47.055+0000 7f69a820d9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:50:47.054 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:47.055+0000 7f69a820d9c0 20 garbage collection: RGWGC::process entered with GC index_shard=24, max_secs=3600, expired_only=0 2024-09-14T11:50:47.058 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:47.059+0000 7f69a820d9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:50:47.059 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:47.063+0000 7f69a820d9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:50:47.059 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:47.063+0000 7f69a820d9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:50:47.062 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:47.063+0000 7f69a820d9c0 20 garbage collection: RGWGC::process entered with GC index_shard=25, max_secs=3600, expired_only=0 2024-09-14T11:50:47.065 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:47.067+0000 7f69a820d9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:50:47.066 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:47.067+0000 7f69a820d9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:50:47.067 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:47.071+0000 7f69a820d9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:50:47.070 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:47.071+0000 7f69a820d9c0 20 garbage collection: RGWGC::process entered with GC index_shard=26, max_secs=3600, expired_only=0 2024-09-14T11:50:47.073 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:47.075+0000 7f69a820d9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:50:47.074 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:47.075+0000 7f69a820d9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:50:47.074 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:47.079+0000 7f69a820d9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:50:47.077 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:47.079+0000 7f69a820d9c0 20 garbage collection: RGWGC::process entered with GC index_shard=27, max_secs=3600, expired_only=0 2024-09-14T11:50:47.081 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:47.083+0000 7f69a820d9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:50:47.082 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:47.083+0000 7f69a820d9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:50:47.083 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:47.087+0000 7f69a820d9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:50:47.086 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:47.087+0000 7f69a820d9c0 20 garbage collection: RGWGC::process entered with GC index_shard=28, max_secs=3600, expired_only=0 2024-09-14T11:50:47.090 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:47.091+0000 7f69a820d9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:50:47.091 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:47.095+0000 7f69a820d9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:50:47.091 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:47.095+0000 7f69a820d9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:50:47.094 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:47.095+0000 7f69a820d9c0 20 garbage collection: RGWGC::process entered with GC index_shard=29, max_secs=3600, expired_only=0 2024-09-14T11:50:47.099 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:47.103+0000 7f69a820d9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:50:47.101 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:47.103+0000 7f69a820d9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:50:47.102 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:47.103+0000 7f69a820d9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:50:47.106 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:47.107+0000 7f68577fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:50:47.112 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:47.115+0000 7f69a820d9c0 20 remove_watcher() i=0 2024-09-14T11:50:47.112 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:47.115+0000 7f69a820d9c0 2 removed watcher, disabling cache 2024-09-14T11:50:47.114 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:47.115+0000 7f69a820d9c0 20 remove_watcher() i=1 2024-09-14T11:50:47.117 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:47.119+0000 7f69a820d9c0 20 remove_watcher() i=2 2024-09-14T11:50:47.120 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:47.123+0000 7f69a820d9c0 20 remove_watcher() i=3 2024-09-14T11:50:47.122 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:47.123+0000 7f69a820d9c0 20 remove_watcher() i=4 2024-09-14T11:50:47.124 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:47.127+0000 7f69a820d9c0 20 remove_watcher() i=5 2024-09-14T11:50:47.126 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:47.127+0000 7f69a820d9c0 20 remove_watcher() i=6 2024-09-14T11:50:47.128 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:50:47.131+0000 7f69a820d9c0 20 remove_watcher() i=7 2024-09-14T11:50:47.146 DEBUG:teuthology.orchestra.run.smithi138:> cd /home/ubuntu/cephtest/s3-tests-java && /opt/gradle/gradle/bin/gradle clean test --rerun-tasks --no-build-cache --tests ObjectTest 2024-09-14T11:50:47.824 INFO:teuthology.orchestra.run.smithi138.stdout:> Task :clean 2024-09-14T11:50:48.621 INFO:teuthology.orchestra.run.smithi138.stdout:> Task :compileJava 2024-09-14T11:50:48.621 INFO:teuthology.orchestra.run.smithi138.stdout:> Task :processResources 2024-09-14T11:50:48.622 INFO:teuthology.orchestra.run.smithi138.stdout:> Task :classes 2024-09-14T11:50:49.121 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-09-14T11:50:49.121 INFO:teuthology.orchestra.run.smithi138.stdout:> Task :compileTestJava 2024-09-14T11:50:49.122 INFO:teuthology.orchestra.run.smithi138.stderr:Note: /home/ubuntu/cephtest/s3-tests-java/src/test/java/BucketTest.java uses or overrides a deprecated API. 2024-09-14T11:50:49.122 INFO:teuthology.orchestra.run.smithi138.stderr:Note: Recompile with -Xlint:deprecation for details. 2024-09-14T11:50:49.123 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-09-14T11:50:49.123 INFO:teuthology.orchestra.run.smithi138.stdout:> Task :processTestResources NO-SOURCE 2024-09-14T11:50:49.123 INFO:teuthology.orchestra.run.smithi138.stdout:> Task :testClasses 2024-09-14T11:50:51.122 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-09-14T11:50:51.123 INFO:teuthology.orchestra.run.smithi138.stdout:> Task :test 2024-09-14T11:50:51.123 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-09-14T11:50:51.123 INFO:teuthology.orchestra.run.smithi138.stdout:suite > Object tests STANDARD_OUT 2024-09-14T11:50:51.123 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-09-14 11:50:50,438 [Test worker] WARN com.amazonaws.util.Base64 - JAXB is unavailable. Will fallback to SDK implementation which may be less performant 2024-09-14T11:50:51.123 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-09-14T11:50:51.123 INFO:teuthology.orchestra.run.smithi138.stdout:suite > Object tests > ObjectTest.TestObjectCopyKeyNotFound STARTED 2024-09-14T11:50:51.123 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-09-14T11:50:51.124 INFO:teuthology.orchestra.run.smithi138.stdout:suite > Object tests > ObjectTest.TestObjectCopyKeyNotFound PASSED 2024-09-14T11:50:52.421 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-09-14T11:50:52.422 INFO:teuthology.orchestra.run.smithi138.stdout:suite > Object tests > ObjectTest.TestObjectCreateBadExpectNone STARTED 2024-09-14T11:50:52.621 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-09-14T11:50:52.622 INFO:teuthology.orchestra.run.smithi138.stdout:suite > Object tests > ObjectTest.TestObjectCreateBadExpectNone PASSED 2024-09-14T11:50:53.421 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-09-14T11:50:53.422 INFO:teuthology.orchestra.run.smithi138.stdout:suite > Object tests > ObjectTest.TestObjectCreateBadMd5Empty STARTED 2024-09-14T11:50:53.621 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-09-14T11:50:53.621 INFO:teuthology.orchestra.run.smithi138.stdout:suite > Object tests > ObjectTest.TestObjectCreateBadMd5Empty PASSED 2024-09-14T11:50:54.421 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-09-14T11:50:54.422 INFO:teuthology.orchestra.run.smithi138.stdout:suite > Object tests > ObjectTest.testAbortMultipartUploadLLAPI STARTED 2024-09-14T11:51:06.822 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-09-14T11:51:06.822 INFO:teuthology.orchestra.run.smithi138.stdout:suite > Object tests > ObjectTest.testAbortMultipartUploadLLAPI PASSED 2024-09-14T11:51:07.521 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-09-14T11:51:07.521 INFO:teuthology.orchestra.run.smithi138.stdout:suite > Object tests > ObjectTest.testAbortMultipartUploadNotFoundLLAPI STARTED 2024-09-14T11:51:07.721 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-09-14T11:51:07.722 INFO:teuthology.orchestra.run.smithi138.stdout:suite > Object tests > ObjectTest.testAbortMultipartUploadNotFoundLLAPI PASSED 2024-09-14T11:51:08.421 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-09-14T11:51:08.422 INFO:teuthology.orchestra.run.smithi138.stdout:suite > Object tests > ObjectTest.testDownloadHLAPI STARTED 2024-09-14T11:51:08.921 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-09-14T11:51:08.922 INFO:teuthology.orchestra.run.smithi138.stdout:suite > Object tests > ObjectTest.testDownloadHLAPI PASSED 2024-09-14T11:51:09.722 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-09-14T11:51:09.723 INFO:teuthology.orchestra.run.smithi138.stdout:suite > Object tests > ObjectTest.testDownloadNoBucketHLAPI STARTED 2024-09-14T11:51:09.723 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-09-14T11:51:09.723 INFO:teuthology.orchestra.run.smithi138.stdout:suite > Object tests > ObjectTest.testDownloadNoBucketHLAPI PASSED 2024-09-14T11:51:09.921 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-09-14T11:51:09.922 INFO:teuthology.orchestra.run.smithi138.stdout:suite > Object tests > ObjectTest.testDownloadNoKeyHLAPI STARTED 2024-09-14T11:51:10.022 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-09-14T11:51:10.022 INFO:teuthology.orchestra.run.smithi138.stdout:suite > Object tests > ObjectTest.testDownloadNoKeyHLAPI PASSED 2024-09-14T11:51:10.821 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-09-14T11:51:10.821 INFO:teuthology.orchestra.run.smithi138.stdout:suite > Object tests > ObjectTest.testEncryptedTransfer1MB STARTED 2024-09-14T11:51:19.421 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-09-14T11:51:19.421 INFO:teuthology.orchestra.run.smithi138.stdout:suite > Object tests > ObjectTest.testEncryptedTransfer1MB PASSED 2024-09-14T11:51:20.121 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-09-14T11:51:20.122 INFO:teuthology.orchestra.run.smithi138.stdout:suite > Object tests > ObjectTest.testEncryptedTransfer1b STARTED 2024-09-14T11:51:20.421 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-09-14T11:51:20.421 INFO:teuthology.orchestra.run.smithi138.stdout:suite > Object tests > ObjectTest.testEncryptedTransfer1b PASSED 2024-09-14T11:51:21.221 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-09-14T11:51:21.221 INFO:teuthology.orchestra.run.smithi138.stdout:suite > Object tests > ObjectTest.testEncryptedTransfer1kb STARTED 2024-09-14T11:51:21.521 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-09-14T11:51:21.521 INFO:teuthology.orchestra.run.smithi138.stdout:suite > Object tests > ObjectTest.testEncryptedTransfer1kb PASSED 2024-09-14T11:51:22.321 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-09-14T11:51:22.321 INFO:teuthology.orchestra.run.smithi138.stdout:suite > Object tests > ObjectTest.testEncryptionKeyNoSSEC STARTED 2024-09-14T11:51:22.521 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-09-14T11:51:22.521 INFO:teuthology.orchestra.run.smithi138.stdout:suite > Object tests > ObjectTest.testEncryptionKeyNoSSEC PASSED 2024-09-14T11:51:23.221 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-09-14T11:51:23.221 INFO:teuthology.orchestra.run.smithi138.stdout:suite > Object tests > ObjectTest.testEncryptionKeySSECInvalidMd5 STARTED 2024-09-14T11:51:23.421 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-09-14T11:51:23.421 INFO:teuthology.orchestra.run.smithi138.stdout:suite > Object tests > ObjectTest.testEncryptionKeySSECInvalidMd5 PASSED 2024-09-14T11:51:24.121 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-09-14T11:51:24.121 INFO:teuthology.orchestra.run.smithi138.stdout:suite > Object tests > ObjectTest.testEncryptionKeySSECNoKey STARTED 2024-09-14T11:51:24.321 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-09-14T11:51:24.321 INFO:teuthology.orchestra.run.smithi138.stdout:suite > Object tests > ObjectTest.testEncryptionKeySSECNoKey PASSED 2024-09-14T11:51:25.021 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-09-14T11:51:25.021 INFO:teuthology.orchestra.run.smithi138.stdout:suite > Object tests > ObjectTest.testEncryptionKeySSECNoMd5 STARTED 2024-09-14T11:51:25.321 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-09-14T11:51:25.321 INFO:teuthology.orchestra.run.smithi138.stdout:suite > Object tests > ObjectTest.testEncryptionKeySSECNoMd5 PASSED 2024-09-14T11:51:26.021 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-09-14T11:51:26.021 INFO:teuthology.orchestra.run.smithi138.stdout:suite > Object tests > ObjectTest.testMultiObjectDelete STARTED 2024-09-14T11:51:26.421 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-09-14T11:51:26.421 INFO:teuthology.orchestra.run.smithi138.stdout:suite > Object tests > ObjectTest.testMultiObjectDelete PASSED 2024-09-14T11:51:27.121 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-09-14T11:51:27.121 INFO:teuthology.orchestra.run.smithi138.stdout:suite > Object tests > ObjectTest.testMultipartCopyHLAPIA STARTED 2024-09-14T11:51:39.722 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-09-14T11:51:39.722 INFO:teuthology.orchestra.run.smithi138.stdout:suite > Object tests > ObjectTest.testMultipartCopyHLAPIA PASSED 2024-09-14T11:51:41.222 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-09-14T11:51:41.222 INFO:teuthology.orchestra.run.smithi138.stdout:suite > Object tests > ObjectTest.testMultipartCopyMultipleSizesLLAPI STARTED 2024-09-14T11:53:01.421 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-09-14T11:53:01.422 INFO:teuthology.orchestra.run.smithi138.stdout:suite > Object tests > ObjectTest.testMultipartCopyMultipleSizesLLAPI PASSED 2024-09-14T11:53:02.821 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-09-14T11:53:02.821 INFO:teuthology.orchestra.run.smithi138.stdout:suite > Object tests > ObjectTest.testMultipartCopyNoSRCBucketHLAPI STARTED 2024-09-14T11:53:02.921 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-09-14T11:53:02.921 INFO:teuthology.orchestra.run.smithi138.stdout:suite > Object tests > ObjectTest.testMultipartCopyNoSRCBucketHLAPI PASSED 2024-09-14T11:53:03.521 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-09-14T11:53:03.521 INFO:teuthology.orchestra.run.smithi138.stdout:suite > Object tests > ObjectTest.testMultipartCopyNoSRCKeyHLAPI STARTED 2024-09-14T11:53:03.821 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-09-14T11:53:03.821 INFO:teuthology.orchestra.run.smithi138.stdout:suite > Object tests > ObjectTest.testMultipartCopyNoSRCKeyHLAPI PASSED 2024-09-14T11:53:05.021 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-09-14T11:53:05.021 INFO:teuthology.orchestra.run.smithi138.stdout:suite > Object tests > ObjectTest.testMultipartDownloadHLAPI STARTED 2024-09-14T11:53:26.621 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-09-14T11:53:26.622 INFO:teuthology.orchestra.run.smithi138.stdout:suite > Object tests > ObjectTest.testMultipartDownloadHLAPI PASSED 2024-09-14T11:53:27.421 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-09-14T11:53:27.421 INFO:teuthology.orchestra.run.smithi138.stdout:suite > Object tests > ObjectTest.testMultipartDownloadNoBucketHLAPI STARTED 2024-09-14T11:53:27.521 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-09-14T11:53:27.521 INFO:teuthology.orchestra.run.smithi138.stdout:suite > Object tests > ObjectTest.testMultipartDownloadNoBucketHLAPI PASSED 2024-09-14T11:53:27.621 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-09-14T11:53:27.621 INFO:teuthology.orchestra.run.smithi138.stdout:suite > Object tests > ObjectTest.testMultipartDownloadWithPauseHLAPI STARTED 2024-09-14T11:53:45.821 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-09-14T11:53:45.821 INFO:teuthology.orchestra.run.smithi138.stdout:suite > Object tests > ObjectTest.testMultipartDownloadWithPauseHLAPI PASSED 2024-09-14T11:53:48.921 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-09-14T11:53:48.921 INFO:teuthology.orchestra.run.smithi138.stdout:suite > Object tests STANDARD_OUT 2024-09-14T11:53:48.921 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-09-14 11:53:48,912 [s3-transfer-manager-worker-9] WARN com.amazonaws.services.s3.internal.S3AbortableInputStream - Not all bytes were read from the S3ObjectInputStream, aborting HTTP connection. This is likely an error and may result in sub-optimal behavior. Request only the bytes you need via a ranged GET or drain the input stream after use. 2024-09-14T11:53:50.821 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-09-14T11:53:50.821 INFO:teuthology.orchestra.run.smithi138.stdout:suite > Object tests > ObjectTest.testMultipartUploadHLAPIAWS4 STARTED 2024-09-14T11:54:24.921 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-09-14T11:54:24.921 INFO:teuthology.orchestra.run.smithi138.stdout:suite > Object tests > ObjectTest.testMultipartUploadHLAPIAWS4 PASSED 2024-09-14T11:54:26.021 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-09-14T11:54:26.021 INFO:teuthology.orchestra.run.smithi138.stdout:suite > Object tests > ObjectTest.testMultipartUploadIncorrectMissingPartLLAPI STARTED 2024-09-14T11:54:37.821 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-09-14T11:54:37.821 INFO:teuthology.orchestra.run.smithi138.stdout:suite > Object tests > ObjectTest.testMultipartUploadIncorrectMissingPartLLAPI PASSED 2024-09-14T11:54:38.621 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-09-14T11:54:38.621 INFO:teuthology.orchestra.run.smithi138.stdout:suite > Object tests > ObjectTest.testMultipartUploadMultipleSizesLLAPI STARTED 2024-09-14T11:55:56.421 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-09-14T11:55:56.422 INFO:teuthology.orchestra.run.smithi138.stdout:suite > Object tests > ObjectTest.testMultipartUploadMultipleSizesLLAPI PASSED 2024-09-14T11:55:57.221 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-09-14T11:55:57.221 INFO:teuthology.orchestra.run.smithi138.stdout:suite > Object tests > ObjectTest.testMultipartUploadOverwriteExistingObjectLLAPI STARTED 2024-09-14T11:56:12.721 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-09-14T11:56:12.721 INFO:teuthology.orchestra.run.smithi138.stdout:suite > Object tests > ObjectTest.testMultipartUploadOverwriteExistingObjectLLAPI PASSED 2024-09-14T11:56:13.421 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-09-14T11:56:13.421 INFO:teuthology.orchestra.run.smithi138.stdout:suite > Object tests > ObjectTest.testMultipartUploadSmallLLAPI STARTED 2024-09-14T11:56:24.821 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-09-14T11:56:24.821 INFO:teuthology.orchestra.run.smithi138.stdout:suite > Object tests > ObjectTest.testMultipartUploadSmallLLAPI PASSED 2024-09-14T11:56:25.621 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-09-14T11:56:25.621 INFO:teuthology.orchestra.run.smithi138.stdout:suite > Object tests > ObjectTest.testMultipartUploadWithPause STARTED 2024-09-14T11:56:29.821 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-09-14T11:56:29.821 INFO:teuthology.orchestra.run.smithi138.stdout:suite > Object tests > ObjectTest.testMultipartUploadWithPause PASSED 2024-09-14T11:57:22.621 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-09-14T11:57:22.621 INFO:teuthology.orchestra.run.smithi138.stdout:suite > Object tests > ObjectTest.testObjectCopyBucketNotFound STARTED 2024-09-14T11:57:22.721 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-09-14T11:57:22.721 INFO:teuthology.orchestra.run.smithi138.stdout:suite > Object tests > ObjectTest.testObjectCopyBucketNotFound PASSED 2024-09-14T11:57:22.821 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-09-14T11:57:22.821 INFO:teuthology.orchestra.run.smithi138.stdout:suite > Object tests > ObjectTest.testObjectCreateBadExpectMismatch STARTED 2024-09-14T11:57:23.021 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-09-14T11:57:23.021 INFO:teuthology.orchestra.run.smithi138.stdout:suite > Object tests > ObjectTest.testObjectCreateBadExpectMismatch PASSED 2024-09-14T11:57:23.821 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-09-14T11:57:23.821 INFO:teuthology.orchestra.run.smithi138.stdout:suite > Object tests > ObjectTest.testObjectCreateBadMd5InvalidShort STARTED 2024-09-14T11:57:24.021 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-09-14T11:57:24.021 INFO:teuthology.orchestra.run.smithi138.stdout:suite > Object tests > ObjectTest.testObjectCreateBadMd5InvalidShort PASSED 2024-09-14T11:57:24.721 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-09-14T11:57:24.721 INFO:teuthology.orchestra.run.smithi138.stdout:suite > Object tests > ObjectTest.testObjectCreateBadMd5Ivalid STARTED 2024-09-14T11:57:24.921 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-09-14T11:57:24.921 INFO:teuthology.orchestra.run.smithi138.stdout:suite > Object tests > ObjectTest.testObjectCreateBadMd5Ivalid PASSED 2024-09-14T11:57:25.621 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-09-14T11:57:25.621 INFO:teuthology.orchestra.run.smithi138.stdout:suite > Object tests > ObjectTest.testObjectCreateBadMd5None STARTED 2024-09-14T11:57:25.821 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-09-14T11:57:25.821 INFO:teuthology.orchestra.run.smithi138.stdout:suite > Object tests > ObjectTest.testObjectCreateBadMd5None PASSED 2024-09-14T11:57:26.521 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-09-14T11:57:26.521 INFO:teuthology.orchestra.run.smithi138.stdout:suite > Object tests > ObjectTest.testObjectCreateBadMd5Unreadable STARTED 2024-09-14T11:57:26.721 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-09-14T11:57:26.721 INFO:teuthology.orchestra.run.smithi138.stdout:suite > Object tests > ObjectTest.testObjectCreateBadMd5Unreadable PASSED 2024-09-14T11:57:27.421 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-09-14T11:57:27.421 INFO:teuthology.orchestra.run.smithi138.stdout:suite > Object tests > ObjectTest.testObjectHeadZeroBytes STARTED 2024-09-14T11:57:27.721 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-09-14T11:57:27.721 INFO:teuthology.orchestra.run.smithi138.stdout:suite > Object tests > ObjectTest.testObjectHeadZeroBytes PASSED 2024-09-14T11:57:28.521 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-09-14T11:57:28.521 INFO:teuthology.orchestra.run.smithi138.stdout:suite > Object tests > ObjectTest.testObjectListDelimiterDot STARTED 2024-09-14T11:57:28.921 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-09-14T11:57:28.921 INFO:teuthology.orchestra.run.smithi138.stdout:suite > Object tests > ObjectTest.testObjectListDelimiterDot PASSED 2024-09-14T11:57:29.921 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-09-14T11:57:29.921 INFO:teuthology.orchestra.run.smithi138.stdout:suite > Object tests > ObjectTest.testObjectListDelimiterNotExist STARTED 2024-09-14T11:57:30.421 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-09-14T11:57:30.421 INFO:teuthology.orchestra.run.smithi138.stdout:suite > Object tests > ObjectTest.testObjectListDelimiterNotExist PASSED 2024-09-14T11:57:31.421 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-09-14T11:57:31.421 INFO:teuthology.orchestra.run.smithi138.stdout:suite > Object tests > ObjectTest.testObjectListDelimiterPercentage STARTED 2024-09-14T11:57:32.021 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-09-14T11:57:32.021 INFO:teuthology.orchestra.run.smithi138.stdout:suite > Object tests > ObjectTest.testObjectListDelimiterPercentage PASSED 2024-09-14T11:57:32.921 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-09-14T11:57:32.921 INFO:teuthology.orchestra.run.smithi138.stdout:suite > Object tests > ObjectTest.testObjectListMarkerAfterList STARTED 2024-09-14T11:57:33.521 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-09-14T11:57:33.521 INFO:teuthology.orchestra.run.smithi138.stdout:suite > Object tests > ObjectTest.testObjectListMarkerAfterList PASSED 2024-09-14T11:57:34.421 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-09-14T11:57:34.421 INFO:teuthology.orchestra.run.smithi138.stdout:suite > Object tests > ObjectTest.testObjectListMarkerBeforeList STARTED 2024-09-14T11:57:34.921 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-09-14T11:57:34.921 INFO:teuthology.orchestra.run.smithi138.stdout:suite > Object tests > ObjectTest.testObjectListMarkerBeforeList PASSED 2024-09-14T11:57:35.921 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-09-14T11:57:35.921 INFO:teuthology.orchestra.run.smithi138.stdout:suite > Object tests > ObjectTest.testObjectListMarkerNotInList STARTED 2024-09-14T11:57:36.521 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-09-14T11:57:36.521 INFO:teuthology.orchestra.run.smithi138.stdout:suite > Object tests > ObjectTest.testObjectListMarkerNotInList PASSED 2024-09-14T11:57:37.421 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-09-14T11:57:37.421 INFO:teuthology.orchestra.run.smithi138.stdout:suite > Object tests > ObjectTest.testObjectListMarkerUnreadable STARTED 2024-09-14T11:57:38.021 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-09-14T11:57:38.021 INFO:teuthology.orchestra.run.smithi138.stdout:suite > Object tests > ObjectTest.testObjectListMarkerUnreadable PASSED 2024-09-14T11:57:39.021 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-09-14T11:57:39.021 INFO:teuthology.orchestra.run.smithi138.stdout:suite > Object tests > ObjectTest.testObjectListMaxkeysNegative STARTED 2024-09-14T11:57:39.521 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-09-14T11:57:39.521 INFO:teuthology.orchestra.run.smithi138.stdout:suite > Object tests > ObjectTest.testObjectListMaxkeysNegative PASSED 2024-09-14T11:57:40.521 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-09-14T11:57:40.521 INFO:teuthology.orchestra.run.smithi138.stdout:suite > Object tests > ObjectTest.testObjectListMaxkeysNone STARTED 2024-09-14T11:57:41.021 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-09-14T11:57:41.021 INFO:teuthology.orchestra.run.smithi138.stdout:suite > Object tests > ObjectTest.testObjectListMaxkeysNone PASSED 2024-09-14T11:57:42.021 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-09-14T11:57:42.021 INFO:teuthology.orchestra.run.smithi138.stdout:suite > Object tests > ObjectTest.testObjectListMaxkeysOne STARTED 2024-09-14T11:57:42.621 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-09-14T11:57:42.621 INFO:teuthology.orchestra.run.smithi138.stdout:suite > Object tests > ObjectTest.testObjectListMaxkeysOne PASSED 2024-09-14T11:57:43.621 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-09-14T11:57:43.621 INFO:teuthology.orchestra.run.smithi138.stdout:suite > Object tests > ObjectTest.testObjectListMaxkeysZero STARTED 2024-09-14T11:57:44.120 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-09-14T11:57:44.121 INFO:teuthology.orchestra.run.smithi138.stdout:suite > Object tests > ObjectTest.testObjectListMaxkeysZero PASSED 2024-09-14T11:57:45.121 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-09-14T11:57:45.121 INFO:teuthology.orchestra.run.smithi138.stdout:suite > Object tests > ObjectTest.testObjectListPrefixAlt STARTED 2024-09-14T11:57:45.521 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-09-14T11:57:45.521 INFO:teuthology.orchestra.run.smithi138.stdout:suite > Object tests > ObjectTest.testObjectListPrefixAlt PASSED 2024-09-14T11:57:46.521 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-09-14T11:57:46.521 INFO:teuthology.orchestra.run.smithi138.stdout:suite > Object tests > ObjectTest.testObjectListPrefixBasic STARTED 2024-09-14T11:57:46.921 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-09-14T11:57:46.921 INFO:teuthology.orchestra.run.smithi138.stdout:suite > Object tests > ObjectTest.testObjectListPrefixBasic PASSED 2024-09-14T11:57:47.921 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-09-14T11:57:47.921 INFO:teuthology.orchestra.run.smithi138.stdout:suite > Object tests > ObjectTest.testObjectListPrefixDelimiterAlt STARTED 2024-09-14T11:57:48.421 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-09-14T11:57:48.421 INFO:teuthology.orchestra.run.smithi138.stdout:suite > Object tests > ObjectTest.testObjectListPrefixDelimiterAlt PASSED 2024-09-14T11:57:49.421 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-09-14T11:57:49.421 INFO:teuthology.orchestra.run.smithi138.stdout:suite > Object tests > ObjectTest.testObjectListPrefixDelimiterBasic STARTED 2024-09-14T11:57:50.021 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-09-14T11:57:50.021 INFO:teuthology.orchestra.run.smithi138.stdout:suite > Object tests > ObjectTest.testObjectListPrefixDelimiterBasic PASSED 2024-09-14T11:57:51.021 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-09-14T11:57:51.021 INFO:teuthology.orchestra.run.smithi138.stdout:suite > Object tests > ObjectTest.testObjectListPrefixDelimiterDelimiterNotExist STARTED 2024-09-14T11:57:51.521 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-09-14T11:57:51.521 INFO:teuthology.orchestra.run.smithi138.stdout:suite > Object tests > ObjectTest.testObjectListPrefixDelimiterDelimiterNotExist PASSED 2024-09-14T11:57:52.521 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-09-14T11:57:52.521 INFO:teuthology.orchestra.run.smithi138.stdout:suite > Object tests > ObjectTest.testObjectListPrefixDelimiterPrefixDelimiterNotExist STARTED 2024-09-14T11:57:53.121 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-09-14T11:57:53.121 INFO:teuthology.orchestra.run.smithi138.stdout:suite > Object tests > ObjectTest.testObjectListPrefixDelimiterPrefixDelimiterNotExist PASSED 2024-09-14T11:57:54.121 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-09-14T11:57:54.121 INFO:teuthology.orchestra.run.smithi138.stdout:suite > Object tests > ObjectTest.testObjectListPrefixDelimiterPrefixNotExist STARTED 2024-09-14T11:57:54.621 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-09-14T11:57:54.621 INFO:teuthology.orchestra.run.smithi138.stdout:suite > Object tests > ObjectTest.testObjectListPrefixDelimiterPrefixNotExist PASSED 2024-09-14T11:57:55.521 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-09-14T11:57:55.521 INFO:teuthology.orchestra.run.smithi138.stdout:suite > Object tests > ObjectTest.testObjectListPrefixEmpty STARTED 2024-09-14T11:57:56.021 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-09-14T11:57:56.021 INFO:teuthology.orchestra.run.smithi138.stdout:suite > Object tests > ObjectTest.testObjectListPrefixEmpty PASSED 2024-09-14T11:57:56.921 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-09-14T11:57:56.921 INFO:teuthology.orchestra.run.smithi138.stdout:suite > Object tests > ObjectTest.testObjectListPrefixNone STARTED 2024-09-14T11:57:57.421 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-09-14T11:57:57.421 INFO:teuthology.orchestra.run.smithi138.stdout:suite > Object tests > ObjectTest.testObjectListPrefixNone PASSED 2024-09-14T11:57:58.320 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-09-14T11:57:58.321 INFO:teuthology.orchestra.run.smithi138.stdout:suite > Object tests > ObjectTest.testObjectListPrefixNotExist STARTED 2024-09-14T11:57:58.821 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-09-14T11:57:58.821 INFO:teuthology.orchestra.run.smithi138.stdout:suite > Object tests > ObjectTest.testObjectListPrefixNotExist PASSED 2024-09-14T11:57:59.721 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-09-14T11:57:59.721 INFO:teuthology.orchestra.run.smithi138.stdout:suite > Object tests > ObjectTest.testObjectListPrefixUnreadable STARTED 2024-09-14T11:58:00.121 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-09-14T11:58:00.121 INFO:teuthology.orchestra.run.smithi138.stdout:suite > Object tests > ObjectTest.testObjectListPrefixUnreadable PASSED 2024-09-14T11:58:01.021 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-09-14T11:58:01.021 INFO:teuthology.orchestra.run.smithi138.stdout:suite > Object tests > ObjectTest.testObjectReadFromNonExistantBucket STARTED 2024-09-14T11:58:01.221 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-09-14T11:58:01.221 INFO:teuthology.orchestra.run.smithi138.stdout:suite > Object tests > ObjectTest.testObjectReadFromNonExistantBucket PASSED 2024-09-14T11:58:01.921 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-09-14T11:58:01.921 INFO:teuthology.orchestra.run.smithi138.stdout:suite > Object tests > ObjectTest.testObjectReadNotExist STARTED 2024-09-14T11:58:02.121 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-09-14T11:58:02.121 INFO:teuthology.orchestra.run.smithi138.stdout:suite > Object tests > ObjectTest.testObjectReadNotExist PASSED 2024-09-14T11:58:02.821 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-09-14T11:58:02.821 INFO:teuthology.orchestra.run.smithi138.stdout:suite > Object tests > ObjectTest.testObjectWriteCacheControl STARTED 2024-09-14T11:58:03.121 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-09-14T11:58:03.121 INFO:teuthology.orchestra.run.smithi138.stdout:suite > Object tests > ObjectTest.testObjectWriteCacheControl PASSED 2024-09-14T11:58:03.921 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-09-14T11:58:03.921 INFO:teuthology.orchestra.run.smithi138.stdout:suite > Object tests > ObjectTest.testObjectWriteCheckEtag STARTED 2024-09-14T11:58:04.121 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-09-14T11:58:04.121 INFO:teuthology.orchestra.run.smithi138.stdout:suite > Object tests > ObjectTest.testObjectWriteCheckEtag PASSED 2024-09-14T11:58:04.921 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-09-14T11:58:04.921 INFO:teuthology.orchestra.run.smithi138.stdout:suite > Object tests > ObjectTest.testObjectWriteReadUpdateReadDelete STARTED 2024-09-14T11:58:05.621 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-09-14T11:58:05.621 INFO:teuthology.orchestra.run.smithi138.stdout:suite > Object tests > ObjectTest.testObjectWriteReadUpdateReadDelete PASSED 2024-09-14T11:58:06.321 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-09-14T11:58:06.321 INFO:teuthology.orchestra.run.smithi138.stdout:suite > Object tests > ObjectTest.testObjectWriteToNonExistantBucket STARTED 2024-09-14T11:58:06.421 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-09-14T11:58:06.421 INFO:teuthology.orchestra.run.smithi138.stdout:suite > Object tests > ObjectTest.testObjectWriteToNonExistantBucket PASSED 2024-09-14T11:58:06.521 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-09-14T11:58:06.521 INFO:teuthology.orchestra.run.smithi138.stdout:suite > Object tests > ObjectTest.testRangedSkipLeadingBytesResponseCode STARTED 2024-09-14T11:58:06.821 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-09-14T11:58:06.821 INFO:teuthology.orchestra.run.smithi138.stdout:suite > Object tests > ObjectTest.testRangedSkipLeadingBytesResponseCode PASSED 2024-09-14T11:58:07.620 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-09-14T11:58:07.621 INFO:teuthology.orchestra.run.smithi138.stdout:suite > Object tests > ObjectTest.testRangedrequestResponseCode STARTED 2024-09-14T11:58:07.921 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-09-14T11:58:07.921 INFO:teuthology.orchestra.run.smithi138.stdout:suite > Object tests > ObjectTest.testRangedrequestResponseCode PASSED 2024-09-14T11:58:08.721 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-09-14T11:58:08.721 INFO:teuthology.orchestra.run.smithi138.stdout:suite > Object tests > ObjectTest.testSSEKMSNoKey STARTED 2024-09-14T11:58:09.021 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-09-14T11:58:09.021 INFO:teuthology.orchestra.run.smithi138.stdout:suite > Object tests > ObjectTest.testSSEKMSNoKey PASSED 2024-09-14T11:58:09.721 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-09-14T11:58:09.721 INFO:teuthology.orchestra.run.smithi138.stdout:suite > Object tests > ObjectTest.testSSEKMSNotDeclared STARTED 2024-09-14T11:58:09.920 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-09-14T11:58:09.920 INFO:teuthology.orchestra.run.smithi138.stdout:suite > Object tests > ObjectTest.testSSEKMSNotDeclared PASSED 2024-09-14T11:58:10.621 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-09-14T11:58:10.621 INFO:teuthology.orchestra.run.smithi138.stdout:suite > Object tests > ObjectTest.testUploadFileHLAPIBigFile STARTED 2024-09-14T11:58:23.921 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-09-14T11:58:23.921 INFO:teuthology.orchestra.run.smithi138.stdout:suite > Object tests > ObjectTest.testUploadFileHLAPIBigFile PASSED 2024-09-14T11:58:24.720 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-09-14T11:58:24.721 INFO:teuthology.orchestra.run.smithi138.stdout:suite > Object tests > ObjectTest.testUploadFileList STARTED 2024-09-14T11:58:37.321 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-09-14T11:58:37.321 INFO:teuthology.orchestra.run.smithi138.stdout:suite > Object tests > ObjectTest.testUploadFileList PASSED 2024-09-14T11:58:38.182 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-09-14T11:58:38.182 INFO:teuthology.orchestra.run.smithi138.stdout:---------------------------------------------------------------------- 2024-09-14T11:58:38.183 INFO:teuthology.orchestra.run.smithi138.stdout:| Results: SUCCESS (70 tests, 70 successes, 0 failures, 0 skipped) | 2024-09-14T11:58:38.183 INFO:teuthology.orchestra.run.smithi138.stdout:---------------------------------------------------------------------- 2024-09-14T11:58:38.183 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-09-14T11:58:38.183 INFO:teuthology.orchestra.run.smithi138.stdout:Deprecated Gradle features were used in this build, making it incompatible with Gradle 7.0. 2024-09-14T11:58:38.183 INFO:teuthology.orchestra.run.smithi138.stdout:Use '--warning-mode all' to show the individual deprecation warnings. 2024-09-14T11:58:38.183 INFO:teuthology.orchestra.run.smithi138.stdout:See https://docs.gradle.org/6.0.1/userguide/command_line_interface.html#sec:command_line_warnings 2024-09-14T11:58:38.183 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-09-14T11:58:38.183 INFO:teuthology.orchestra.run.smithi138.stdout:BUILD SUCCESSFUL in 7m 50s 2024-09-14T11:58:38.183 INFO:teuthology.orchestra.run.smithi138.stdout:5 actionable tasks: 5 executed 2024-09-14T11:58:38.202 DEBUG:teuthology.orchestra.run.smithi138:> radosgw-admin gc process --include-all 2024-09-14T11:58:38.230 INFO:teuthology.orchestra.run.smithi138.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:58:38.230 INFO:teuthology.orchestra.run.smithi138.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:58:38.274 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:38.274+0000 7fd5ad44a9c0 20 rados->read ofs=0 len=0 2024-09-14T11:58:38.276 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:38.278+0000 7fd5ad44a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:58:38.276 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:38.278+0000 7fd5ad44a9c0 20 realm 2024-09-14T11:58:38.276 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:38.278+0000 7fd5ad44a9c0 20 rados->read ofs=0 len=0 2024-09-14T11:58:38.277 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:38.278+0000 7fd5ad44a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:58:38.277 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:38.278+0000 7fd5ad44a9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:58:38.277 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:38.278+0000 7fd5ad44a9c0 20 rados->read ofs=0 len=0 2024-09-14T11:58:38.277 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:38.278+0000 7fd5ad44a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:58:38.277 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:38.278+0000 7fd5ad44a9c0 20 rados->read ofs=0 len=0 2024-09-14T11:58:38.278 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:38.282+0000 7fd5ad44a9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:58:38.278 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:38.282+0000 7fd5ad44a9c0 20 rados->read ofs=0 len=0 2024-09-14T11:58:38.279 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:38.282+0000 7fd5ad44a9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:58:38.279 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:38.282+0000 7fd5ad44a9c0 20 searching for the correct realm 2024-09-14T11:58:38.282 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:38.282+0000 7fd5aa74f640 0 -- 172.21.15.138:0/1426778602 >> [v2:172.21.15.154:6808/1468088432,v1:172.21.15.154:6809/1468088432] conn(0x7fd59c01a040 msgr2=0x7fd59c01b940 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:58:38.288 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:38.290+0000 7fd5aaf50640 0 -- 172.21.15.138:0/1426778602 >> [v2:172.21.15.138:6800/1799335858,v1:172.21.15.138:6801/1799335858] conn(0x5621cdb49500 msgr2=0x5621cdb4b990 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:58:38.300 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:38.302+0000 7fd5ad44a9c0 20 RGWRados::pool_iterate: got zone_info.d9e72d30-c60b-4d0d-9267-fdc36392d5ad 2024-09-14T11:58:38.300 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:38.302+0000 7fd5ad44a9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:58:38.301 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:38.302+0000 7fd5ad44a9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:58:38.301 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:38.302+0000 7fd5ad44a9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:58:38.301 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:38.302+0000 7fd5ad44a9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:58:38.301 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:38.302+0000 7fd5ad44a9c0 20 RGWRados::pool_iterate: got zonegroup_info.65ab941b-da8c-4160-94fb-3672b069d44f 2024-09-14T11:58:38.301 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:38.302+0000 7fd5ad44a9c0 20 rados->read ofs=0 len=0 2024-09-14T11:58:38.301 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:38.302+0000 7fd5ad44a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:58:38.301 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:38.302+0000 7fd5ad44a9c0 20 rados->read ofs=0 len=0 2024-09-14T11:58:38.302 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:38.302+0000 7fd5ad44a9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:58:38.302 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:38.302+0000 7fd5ad44a9c0 20 rados->read ofs=0 len=0 2024-09-14T11:58:38.302 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:38.302+0000 7fd5ad44a9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:58:38.302 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:38.302+0000 7fd5ad44a9c0 20 zone default found 2024-09-14T11:58:38.302 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:38.302+0000 7fd5ad44a9c0 4 Realm: () 2024-09-14T11:58:38.302 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:38.302+0000 7fd5ad44a9c0 4 ZoneGroup: default (65ab941b-da8c-4160-94fb-3672b069d44f) 2024-09-14T11:58:38.302 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:38.302+0000 7fd5ad44a9c0 4 Zone: default (d9e72d30-c60b-4d0d-9267-fdc36392d5ad) 2024-09-14T11:58:38.302 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:38.302+0000 7fd5ad44a9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:58:38.303 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:38.302+0000 7fd5ad44a9c0 20 zonegroup default 2024-09-14T11:58:38.303 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:38.302+0000 7fd5ad44a9c0 20 rados->read ofs=0 len=0 2024-09-14T11:58:38.303 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:38.302+0000 7fd5ad44a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:58:38.303 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:38.302+0000 7fd5ad44a9c0 20 rados->read ofs=0 len=0 2024-09-14T11:58:38.303 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:38.306+0000 7fd5ad44a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:58:38.303 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:38.306+0000 7fd5ad44a9c0 20 rados->read ofs=0 len=0 2024-09-14T11:58:38.303 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:38.306+0000 7fd5ad44a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:58:38.304 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:38.306+0000 7fd5ad44a9c0 20 started sync module instance, tier type = 2024-09-14T11:58:38.304 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:38.306+0000 7fd5ad44a9c0 20 started zone id=d9e72d30-c60b-4d0d-9267-fdc36392d5ad (name=default) with tier type = 2024-09-14T11:58:38.318 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:38.322+0000 7fd5ad44a9c0 20 add_watcher() i=0 2024-09-14T11:58:38.318 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:38.322+0000 7fd5ad44a9c0 20 add_watcher() i=1 2024-09-14T11:58:38.318 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:38.322+0000 7fd5ad44a9c0 20 add_watcher() i=2 2024-09-14T11:58:38.318 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:38.322+0000 7fd5ad44a9c0 20 add_watcher() i=3 2024-09-14T11:58:38.318 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:38.322+0000 7fd5ad44a9c0 20 add_watcher() i=4 2024-09-14T11:58:38.318 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:38.322+0000 7fd5ad44a9c0 20 add_watcher() i=5 2024-09-14T11:58:38.319 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:38.322+0000 7fd5ad44a9c0 20 add_watcher() i=6 2024-09-14T11:58:38.319 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:38.322+0000 7fd5ad44a9c0 20 add_watcher() i=7 2024-09-14T11:58:38.319 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:38.322+0000 7fd5ad44a9c0 2 all 8 watchers are set, enabling cache 2024-09-14T11:58:38.322 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:38.322+0000 7fd4617e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:58:38.322 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:38.326+0000 7fd5ad44a9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:58:38.322 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:38.326+0000 7fd5ad44a9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:58:38.392 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:38.394+0000 7fd3dbfff640 20 reqs_thread_entry: start 2024-09-14T11:58:38.392 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:38.394+0000 7fd5ad44a9c0 20 init_complete bucket index max shards: 11 2024-09-14T11:58:38.392 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:38.394+0000 7fd5ad44a9c0 20 Filter name: none 2024-09-14T11:58:38.392 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:38.394+0000 7fd3d9ffb640 20 reqs_thread_entry: start 2024-09-14T11:58:38.392 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:38.394+0000 7fd5ad44a9c0 20 garbage collection: RGWGC::process entered with GC index_shard=11, max_secs=3600, expired_only=0 2024-09-14T11:58:38.394 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:38.398+0000 7fd5ad44a9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:58:38.395 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:38.398+0000 7fd5ad44a9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:58:38.396 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:38.398+0000 7fd5ad44a9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2024-09-14T11:58:38.396 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:38.398+0000 7fd5ad44a9c0 20 garbage collection: RGWGC::process iterating over entry tag='d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.16406634042960599558', time=2024-09-14T13:53:26.820808+0000, chain.objs.size()=9 2024-09-14T11:58:38.396 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:38.398+0000 7fd5ad44a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.98__multipart_key1.2~plH2cKs605gHkzIIFTSowjRqo7zjW8W.1 2024-09-14T11:58:38.396 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:38.398+0000 7fd5ad44a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.98__shadow_key1.2~plH2cKs605gHkzIIFTSowjRqo7zjW8W.1_1 2024-09-14T11:58:38.396 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:38.398+0000 7fd5ad44a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.98__multipart_key1.2~plH2cKs605gHkzIIFTSowjRqo7zjW8W.2 2024-09-14T11:58:38.397 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:38.398+0000 7fd5ad44a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.98__shadow_key1.2~plH2cKs605gHkzIIFTSowjRqo7zjW8W.2_1 2024-09-14T11:58:38.397 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:38.398+0000 7fd5ad44a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.98__multipart_key1.2~plH2cKs605gHkzIIFTSowjRqo7zjW8W.3 2024-09-14T11:58:38.397 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:38.398+0000 7fd5ad44a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.98__shadow_key1.2~plH2cKs605gHkzIIFTSowjRqo7zjW8W.3_1 2024-09-14T11:58:38.397 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:38.398+0000 7fd5ad44a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.98__multipart_key1.2~plH2cKs605gHkzIIFTSowjRqo7zjW8W.4 2024-09-14T11:58:38.397 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:38.398+0000 7fd5ad44a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.98__shadow_key1.2~plH2cKs605gHkzIIFTSowjRqo7zjW8W.4_1 2024-09-14T11:58:38.397 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:38.398+0000 7fd5ad44a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.98__multipart_key1.2~plH2cKs605gHkzIIFTSowjRqo7zjW8W.5 2024-09-14T11:58:38.406 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:38.406+0000 7fd5ad44a9c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T11:58:38.409 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:38.410+0000 7fd5ad44a9c0 20 garbage collection: RGWGC::process entered with GC index_shard=12, max_secs=3600, expired_only=0 2024-09-14T11:58:38.412 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:38.414+0000 7fd5ad44a9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:58:38.414 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:38.414+0000 7fd5ad44a9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:58:38.414 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:38.418+0000 7fd5ad44a9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:58:38.417 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:38.418+0000 7fd5ad44a9c0 20 garbage collection: RGWGC::process entered with GC index_shard=13, max_secs=3600, expired_only=0 2024-09-14T11:58:38.419 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:38.422+0000 7fd5ad44a9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:58:38.420 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:38.422+0000 7fd5ad44a9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:58:38.420 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:38.422+0000 7fd5ad44a9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:58:38.422 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:38.422+0000 7fd5ad44a9c0 20 garbage collection: RGWGC::process entered with GC index_shard=14, max_secs=3600, expired_only=0 2024-09-14T11:58:38.424 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:38.426+0000 7fd5ad44a9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:58:38.425 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:38.426+0000 7fd5ad44a9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:58:38.425 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:38.426+0000 7fd5ad44a9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:58:38.427 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:38.430+0000 7fd5ad44a9c0 20 garbage collection: RGWGC::process entered with GC index_shard=15, max_secs=3600, expired_only=0 2024-09-14T11:58:38.430 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:38.434+0000 7fd5ad44a9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:58:38.431 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:38.434+0000 7fd5ad44a9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:58:38.432 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:38.434+0000 7fd5ad44a9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:58:38.434 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:38.438+0000 7fd5ad44a9c0 20 garbage collection: RGWGC::process entered with GC index_shard=16, max_secs=3600, expired_only=0 2024-09-14T11:58:38.438 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:38.438+0000 7fd5ad44a9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:58:38.439 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:38.442+0000 7fd5ad44a9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:58:38.441 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:38.442+0000 7fd5ad44a9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=2, truncated=0, next_marker='' 2024-09-14T11:58:38.441 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:38.442+0000 7fd5ad44a9c0 20 garbage collection: RGWGC::process iterating over entry tag='d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.5125387168703049517', time=2024-09-14T13:55:13.585390+0000, chain.objs.size()=9 2024-09-14T11:58:38.441 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:38.442+0000 7fd5ad44a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.102__multipart_key1.2~ylqIp0s0nESlX5T5Xsz7CbYeJfA3Y-z.1 2024-09-14T11:58:38.441 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:38.442+0000 7fd5ad44a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.102__shadow_key1.2~ylqIp0s0nESlX5T5Xsz7CbYeJfA3Y-z.1_1 2024-09-14T11:58:38.441 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:38.442+0000 7fd5ad44a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.102__multipart_key1.2~ylqIp0s0nESlX5T5Xsz7CbYeJfA3Y-z.2 2024-09-14T11:58:38.441 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:38.442+0000 7fd5ad44a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.102__shadow_key1.2~ylqIp0s0nESlX5T5Xsz7CbYeJfA3Y-z.2_1 2024-09-14T11:58:38.441 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:38.442+0000 7fd5ad44a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.102__multipart_key1.2~ylqIp0s0nESlX5T5Xsz7CbYeJfA3Y-z.3 2024-09-14T11:58:38.441 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:38.442+0000 7fd5ad44a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.102__shadow_key1.2~ylqIp0s0nESlX5T5Xsz7CbYeJfA3Y-z.3_1 2024-09-14T11:58:38.441 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:38.442+0000 7fd5ad44a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.102__multipart_key1.2~ylqIp0s0nESlX5T5Xsz7CbYeJfA3Y-z.4 2024-09-14T11:58:38.442 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:38.442+0000 7fd5ad44a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.102__shadow_key1.2~ylqIp0s0nESlX5T5Xsz7CbYeJfA3Y-z.4_1 2024-09-14T11:58:38.442 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:38.442+0000 7fd5ad44a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.102__multipart_key1.2~ylqIp0s0nESlX5T5Xsz7CbYeJfA3Y-z.5 2024-09-14T11:58:38.442 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:38.442+0000 7fd5ad44a9c0 20 garbage collection: RGWGC::process iterating over entry tag='d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.4948439320461315193', time=2024-09-14T13:55:45.398410+0000, chain.objs.size()=7 2024-09-14T11:58:38.442 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:38.442+0000 7fd5ad44a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.102__multipart_key1.2~AVEUPHLCm4GXNs-THNcZcGlATuDCGTd.1 2024-09-14T11:58:38.442 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:38.442+0000 7fd5ad44a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.102__shadow_key1.2~AVEUPHLCm4GXNs-THNcZcGlATuDCGTd.1_1 2024-09-14T11:58:38.442 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:38.442+0000 7fd5ad44a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.102__shadow_key1.2~AVEUPHLCm4GXNs-THNcZcGlATuDCGTd.1_2 2024-09-14T11:58:38.450 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:38.450+0000 7fd5ad44a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.102__multipart_key1.2~AVEUPHLCm4GXNs-THNcZcGlATuDCGTd.2 2024-09-14T11:58:38.450 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:38.450+0000 7fd5ad44a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.102__shadow_key1.2~AVEUPHLCm4GXNs-THNcZcGlATuDCGTd.2_1 2024-09-14T11:58:38.450 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:38.454+0000 7fd5ad44a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.102__shadow_key1.2~AVEUPHLCm4GXNs-THNcZcGlATuDCGTd.2_2 2024-09-14T11:58:38.450 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:38.454+0000 7fd5ad44a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.102__multipart_key1.2~AVEUPHLCm4GXNs-THNcZcGlATuDCGTd.3 2024-09-14T11:58:38.461 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:38.462+0000 7fd5ad44a9c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T11:58:38.468 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:38.470+0000 7fd5ad44a9c0 20 garbage collection: RGWGC::process entered with GC index_shard=17, max_secs=3600, expired_only=0 2024-09-14T11:58:38.471 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:38.474+0000 7fd5ad44a9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:58:38.472 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:38.474+0000 7fd5ad44a9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:58:38.472 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:38.474+0000 7fd5ad44a9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:58:38.473 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:38.474+0000 7fd5ad44a9c0 20 garbage collection: RGWGC::process entered with GC index_shard=18, max_secs=3600, expired_only=0 2024-09-14T11:58:38.477 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:38.478+0000 7fd5ad44a9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:58:38.478 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:38.482+0000 7fd5ad44a9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:58:38.479 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:38.482+0000 7fd5ad44a9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2024-09-14T11:58:38.480 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:38.482+0000 7fd5ad44a9c0 20 garbage collection: RGWGC::process iterating over entry tag='d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.13229996763899400352', time=2024-09-14T13:52:47.457691+0000, chain.objs.size()=7 2024-09-14T11:58:38.480 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:38.482+0000 7fd5ad44a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.94__multipart_key1.2~-3xYTPSsZSRu2XB7lWNwqlyuRy4myDp.1 2024-09-14T11:58:38.480 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:38.482+0000 7fd5ad44a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.94__shadow_key1.2~-3xYTPSsZSRu2XB7lWNwqlyuRy4myDp.1_1 2024-09-14T11:58:38.480 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:38.482+0000 7fd5ad44a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.94__shadow_key1.2~-3xYTPSsZSRu2XB7lWNwqlyuRy4myDp.1_2 2024-09-14T11:58:38.480 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:38.482+0000 7fd5ad44a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.94__multipart_key1.2~-3xYTPSsZSRu2XB7lWNwqlyuRy4myDp.2 2024-09-14T11:58:38.480 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:38.482+0000 7fd5ad44a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.94__shadow_key1.2~-3xYTPSsZSRu2XB7lWNwqlyuRy4myDp.2_1 2024-09-14T11:58:38.480 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:38.482+0000 7fd5ad44a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.94__shadow_key1.2~-3xYTPSsZSRu2XB7lWNwqlyuRy4myDp.2_2 2024-09-14T11:58:38.480 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:38.482+0000 7fd5ad44a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.94__multipart_key1.2~-3xYTPSsZSRu2XB7lWNwqlyuRy4myDp.3 2024-09-14T11:58:38.487 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:38.490+0000 7fd5ad44a9c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T11:58:38.492 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:38.494+0000 7fd5ad44a9c0 20 garbage collection: RGWGC::process entered with GC index_shard=19, max_secs=3600, expired_only=0 2024-09-14T11:58:38.494 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:38.498+0000 7fd5ad44a9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:58:38.495 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:38.498+0000 7fd5ad44a9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:58:38.496 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:38.498+0000 7fd5ad44a9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2024-09-14T11:58:38.496 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:38.498+0000 7fd5ad44a9c0 20 garbage collection: RGWGC::process iterating over entry tag='2~oxV3dkFjk8CIBu-8ohG9Wp10-jMEP_5', time=2024-09-14T13:54:38.302351+0000, chain.objs.size()=9 2024-09-14T11:58:38.496 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:38.498+0000 7fd5ad44a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.101__multipart_key1.2~oxV3dkFjk8CIBu-8ohG9Wp10-jMEP_5.7 2024-09-14T11:58:38.496 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:38.498+0000 7fd5ad44a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.101__shadow_key1.2~oxV3dkFjk8CIBu-8ohG9Wp10-jMEP_5.7_1 2024-09-14T11:58:38.496 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:38.498+0000 7fd5ad44a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.101__multipart_key1.2~oxV3dkFjk8CIBu-8ohG9Wp10-jMEP_5.8 2024-09-14T11:58:38.497 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:38.498+0000 7fd5ad44a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.101__shadow_key1.2~oxV3dkFjk8CIBu-8ohG9Wp10-jMEP_5.8_1 2024-09-14T11:58:38.497 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:38.498+0000 7fd5ad44a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.101__multipart_key1.2~oxV3dkFjk8CIBu-8ohG9Wp10-jMEP_5.9 2024-09-14T11:58:38.497 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:38.498+0000 7fd5ad44a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.101__shadow_key1.2~oxV3dkFjk8CIBu-8ohG9Wp10-jMEP_5.9_1 2024-09-14T11:58:38.497 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:38.498+0000 7fd5ad44a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.101__multipart_key1.2~oxV3dkFjk8CIBu-8ohG9Wp10-jMEP_5.10 2024-09-14T11:58:38.497 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:38.498+0000 7fd5ad44a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.101__shadow_key1.2~oxV3dkFjk8CIBu-8ohG9Wp10-jMEP_5.10_1 2024-09-14T11:58:38.497 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:38.498+0000 7fd5ad44a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.101__multipart_key1.2~oxV3dkFjk8CIBu-8ohG9Wp10-jMEP_5.11 2024-09-14T11:58:38.503 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:38.506+0000 7fd5ad44a9c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T11:58:38.509 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:38.510+0000 7fd5ad44a9c0 20 garbage collection: RGWGC::process entered with GC index_shard=20, max_secs=3600, expired_only=0 2024-09-14T11:58:38.512 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:38.514+0000 7fd5ad44a9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:58:38.513 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:38.514+0000 7fd5ad44a9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:58:38.515 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:38.518+0000 7fd5ad44a9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2024-09-14T11:58:38.515 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:38.518+0000 7fd5ad44a9c0 20 garbage collection: RGWGC::process iterating over entry tag='2~20kE_YctF9lUMZLr3sf-AhPKHp2fhG9', time=2024-09-14T13:51:06.759525+0000, chain.objs.size()=9 2024-09-14T11:58:38.515 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:38.518+0000 7fd5ad44a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.79__multipart_key1.2~20kE_YctF9lUMZLr3sf-AhPKHp2fhG9.1 2024-09-14T11:58:38.515 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:38.518+0000 7fd5ad44a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.79__shadow_key1.2~20kE_YctF9lUMZLr3sf-AhPKHp2fhG9.1_1 2024-09-14T11:58:38.515 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:38.518+0000 7fd5ad44a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.79__multipart_key1.2~20kE_YctF9lUMZLr3sf-AhPKHp2fhG9.2 2024-09-14T11:58:38.515 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:38.518+0000 7fd5ad44a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.79__shadow_key1.2~20kE_YctF9lUMZLr3sf-AhPKHp2fhG9.2_1 2024-09-14T11:58:38.515 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:38.518+0000 7fd5ad44a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.79__multipart_key1.2~20kE_YctF9lUMZLr3sf-AhPKHp2fhG9.3 2024-09-14T11:58:38.515 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:38.518+0000 7fd5ad44a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.79__shadow_key1.2~20kE_YctF9lUMZLr3sf-AhPKHp2fhG9.3_1 2024-09-14T11:58:38.515 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:38.518+0000 7fd5ad44a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.79__multipart_key1.2~20kE_YctF9lUMZLr3sf-AhPKHp2fhG9.4 2024-09-14T11:58:38.515 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:38.518+0000 7fd5ad44a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.79__shadow_key1.2~20kE_YctF9lUMZLr3sf-AhPKHp2fhG9.4_1 2024-09-14T11:58:38.515 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:38.518+0000 7fd5ad44a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.79__multipart_key1.2~20kE_YctF9lUMZLr3sf-AhPKHp2fhG9.5 2024-09-14T11:58:38.523 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:38.526+0000 7fd5ad44a9c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T11:58:38.528 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:38.530+0000 7fd5ad44a9c0 20 garbage collection: RGWGC::process entered with GC index_shard=21, max_secs=3600, expired_only=0 2024-09-14T11:58:38.531 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:38.534+0000 7fd5ad44a9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:58:38.532 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:38.534+0000 7fd5ad44a9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:58:38.533 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:38.534+0000 7fd5ad44a9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2024-09-14T11:58:38.533 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:38.534+0000 7fd5ad44a9c0 20 garbage collection: RGWGC::process iterating over entry tag='d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.748707839360475758', time=2024-09-14T13:55:56.295001+0000, chain.objs.size()=7 2024-09-14T11:58:38.533 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:38.534+0000 7fd5ad44a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.102__multipart_key1.2~NhtjG-zxCnlJQncWJPQ2PzzBcE_n0yE.1 2024-09-14T11:58:38.534 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:38.534+0000 7fd5ad44a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.102__shadow_key1.2~NhtjG-zxCnlJQncWJPQ2PzzBcE_n0yE.1_1 2024-09-14T11:58:38.534 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:38.534+0000 7fd5ad44a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.102__shadow_key1.2~NhtjG-zxCnlJQncWJPQ2PzzBcE_n0yE.1_2 2024-09-14T11:58:38.534 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:38.534+0000 7fd5ad44a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.102__multipart_key1.2~NhtjG-zxCnlJQncWJPQ2PzzBcE_n0yE.2 2024-09-14T11:58:38.534 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:38.534+0000 7fd5ad44a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.102__shadow_key1.2~NhtjG-zxCnlJQncWJPQ2PzzBcE_n0yE.2_1 2024-09-14T11:58:38.534 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:38.534+0000 7fd5ad44a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.102__shadow_key1.2~NhtjG-zxCnlJQncWJPQ2PzzBcE_n0yE.2_2 2024-09-14T11:58:38.534 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:38.534+0000 7fd5ad44a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.102__multipart_key1.2~NhtjG-zxCnlJQncWJPQ2PzzBcE_n0yE.3 2024-09-14T11:58:38.539 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:38.542+0000 7fd5ad44a9c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T11:58:38.545 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:38.546+0000 7fd5ad44a9c0 20 garbage collection: RGWGC::process entered with GC index_shard=22, max_secs=3600, expired_only=0 2024-09-14T11:58:38.547 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:38.550+0000 7fd5ad44a9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:58:38.548 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:38.550+0000 7fd5ad44a9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:58:38.548 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:38.550+0000 7fd5ad44a9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:58:38.549 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:38.550+0000 7fd5ad44a9c0 20 garbage collection: RGWGC::process entered with GC index_shard=23, max_secs=3600, expired_only=0 2024-09-14T11:58:38.552 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:38.554+0000 7fd5ad44a9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:58:38.554 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:38.558+0000 7fd5ad44a9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:58:38.555 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:38.558+0000 7fd5ad44a9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:58:38.557 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:38.558+0000 7fd5ad44a9c0 20 garbage collection: RGWGC::process entered with GC index_shard=24, max_secs=3600, expired_only=0 2024-09-14T11:58:38.559 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:38.562+0000 7fd5ad44a9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:58:38.560 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:38.562+0000 7fd5ad44a9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:58:38.561 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:38.562+0000 7fd5ad44a9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=2, truncated=0, next_marker='' 2024-09-14T11:58:38.561 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:38.562+0000 7fd5ad44a9c0 20 garbage collection: RGWGC::process iterating over entry tag='d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.15550027463565561379', time=2024-09-14T13:52:22.477580+0000, chain.objs.size()=9 2024-09-14T11:58:38.561 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:38.562+0000 7fd5ad44a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.94__multipart_key1.2~J05FX1O8hnc_W4Cq1wHNGwn_TB8MDks.1 2024-09-14T11:58:38.561 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:38.562+0000 7fd5ad44a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.94__shadow_key1.2~J05FX1O8hnc_W4Cq1wHNGwn_TB8MDks.1_1 2024-09-14T11:58:38.561 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:38.562+0000 7fd5ad44a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.94__multipart_key1.2~J05FX1O8hnc_W4Cq1wHNGwn_TB8MDks.2 2024-09-14T11:58:38.561 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:38.562+0000 7fd5ad44a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.94__shadow_key1.2~J05FX1O8hnc_W4Cq1wHNGwn_TB8MDks.2_1 2024-09-14T11:58:38.561 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:38.562+0000 7fd5ad44a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.94__multipart_key1.2~J05FX1O8hnc_W4Cq1wHNGwn_TB8MDks.3 2024-09-14T11:58:38.561 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:38.562+0000 7fd5ad44a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.94__shadow_key1.2~J05FX1O8hnc_W4Cq1wHNGwn_TB8MDks.3_1 2024-09-14T11:58:38.561 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:38.562+0000 7fd5ad44a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.94__multipart_key1.2~J05FX1O8hnc_W4Cq1wHNGwn_TB8MDks.4 2024-09-14T11:58:38.562 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:38.562+0000 7fd5ad44a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.94__shadow_key1.2~J05FX1O8hnc_W4Cq1wHNGwn_TB8MDks.4_1 2024-09-14T11:58:38.562 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:38.562+0000 7fd5ad44a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.94__multipart_key1.2~J05FX1O8hnc_W4Cq1wHNGwn_TB8MDks.5 2024-09-14T11:58:38.562 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:38.562+0000 7fd5ad44a9c0 20 garbage collection: RGWGC::process iterating over entry tag='d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.3337518871100379100', time=2024-09-14T13:56:12.832602+0000, chain.objs.size()=9 2024-09-14T11:58:38.562 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:38.562+0000 7fd5ad44a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.103__multipart_key1.2~y5ws7l0_BONFwbr63P0OjKICinFFs1Y.1 2024-09-14T11:58:38.562 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:38.562+0000 7fd5ad44a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.103__shadow_key1.2~y5ws7l0_BONFwbr63P0OjKICinFFs1Y.1_1 2024-09-14T11:58:38.562 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:38.562+0000 7fd5ad44a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.103__multipart_key1.2~y5ws7l0_BONFwbr63P0OjKICinFFs1Y.2 2024-09-14T11:58:38.568 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:38.570+0000 7fd5ad44a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.103__shadow_key1.2~y5ws7l0_BONFwbr63P0OjKICinFFs1Y.2_1 2024-09-14T11:58:38.568 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:38.570+0000 7fd5ad44a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.103__multipart_key1.2~y5ws7l0_BONFwbr63P0OjKICinFFs1Y.3 2024-09-14T11:58:38.568 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:38.570+0000 7fd5ad44a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.103__shadow_key1.2~y5ws7l0_BONFwbr63P0OjKICinFFs1Y.3_1 2024-09-14T11:58:38.569 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:38.570+0000 7fd5ad44a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.103__multipart_key1.2~y5ws7l0_BONFwbr63P0OjKICinFFs1Y.4 2024-09-14T11:58:38.569 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:38.570+0000 7fd5ad44a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.103__shadow_key1.2~y5ws7l0_BONFwbr63P0OjKICinFFs1Y.4_1 2024-09-14T11:58:38.570 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:38.570+0000 7fd5ad44a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.103__multipart_key1.2~y5ws7l0_BONFwbr63P0OjKICinFFs1Y.5 2024-09-14T11:58:38.577 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:38.578+0000 7fd5ad44a9c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T11:58:38.581 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:38.582+0000 7fd5ad44a9c0 20 garbage collection: RGWGC::process entered with GC index_shard=25, max_secs=3600, expired_only=0 2024-09-14T11:58:38.584 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:38.586+0000 7fd5ad44a9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:58:38.584 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:38.586+0000 7fd5ad44a9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:58:38.585 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:38.586+0000 7fd5ad44a9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:58:38.586 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:38.590+0000 7fd5ad44a9c0 20 garbage collection: RGWGC::process entered with GC index_shard=26, max_secs=3600, expired_only=0 2024-09-14T11:58:38.589 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:38.590+0000 7fd5ad44a9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:58:38.589 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:38.590+0000 7fd5ad44a9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:58:38.591 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:38.594+0000 7fd5ad44a9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=2, truncated=0, next_marker='' 2024-09-14T11:58:38.591 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:38.594+0000 7fd5ad44a9c0 20 garbage collection: RGWGC::process iterating over entry tag='d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.12520657961563463987', time=2024-09-14T13:52:42.618716+0000, chain.objs.size()=9 2024-09-14T11:58:38.591 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:38.594+0000 7fd5ad44a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.94__multipart_key1.2~YOWPuMtrnTEbS2dbOe2EM9BiK4CQikX.1 2024-09-14T11:58:38.591 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:38.594+0000 7fd5ad44a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.94__shadow_key1.2~YOWPuMtrnTEbS2dbOe2EM9BiK4CQikX.1_1 2024-09-14T11:58:38.591 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:38.594+0000 7fd5ad44a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.94__multipart_key1.2~YOWPuMtrnTEbS2dbOe2EM9BiK4CQikX.2 2024-09-14T11:58:38.591 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:38.594+0000 7fd5ad44a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.94__shadow_key1.2~YOWPuMtrnTEbS2dbOe2EM9BiK4CQikX.2_1 2024-09-14T11:58:38.591 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:38.594+0000 7fd5ad44a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.94__multipart_key1.2~YOWPuMtrnTEbS2dbOe2EM9BiK4CQikX.3 2024-09-14T11:58:38.591 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:38.594+0000 7fd5ad44a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.94__shadow_key1.2~YOWPuMtrnTEbS2dbOe2EM9BiK4CQikX.3_1 2024-09-14T11:58:38.591 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:38.594+0000 7fd5ad44a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.94__multipart_key1.2~YOWPuMtrnTEbS2dbOe2EM9BiK4CQikX.4 2024-09-14T11:58:38.591 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:38.594+0000 7fd5ad44a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.94__shadow_key1.2~YOWPuMtrnTEbS2dbOe2EM9BiK4CQikX.4_1 2024-09-14T11:58:38.591 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:38.594+0000 7fd5ad44a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.94__multipart_key1.2~YOWPuMtrnTEbS2dbOe2EM9BiK4CQikX.5 2024-09-14T11:58:38.591 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:38.594+0000 7fd5ad44a9c0 20 garbage collection: RGWGC::process iterating over entry tag='d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.15563438062725238911', time=2024-09-14T13:58:37.483670+0000, chain.objs.size()=9 2024-09-14T11:58:38.591 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:38.594+0000 7fd5ad44a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.144__multipart_key1/data/file.mpg.2~9qaLvyVzenMBsy1uzfyO2ODxdXs8NtB.1 2024-09-14T11:58:38.592 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:38.594+0000 7fd5ad44a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.144__shadow_key1/data/file.mpg.2~9qaLvyVzenMBsy1uzfyO2ODxdXs8NtB.1_1 2024-09-14T11:58:38.592 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:38.594+0000 7fd5ad44a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.144__multipart_key1/data/file.mpg.2~9qaLvyVzenMBsy1uzfyO2ODxdXs8NtB.2 2024-09-14T11:58:38.597 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:38.598+0000 7fd5ad44a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.144__shadow_key1/data/file.mpg.2~9qaLvyVzenMBsy1uzfyO2ODxdXs8NtB.2_1 2024-09-14T11:58:38.597 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:38.598+0000 7fd5ad44a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.144__multipart_key1/data/file.mpg.2~9qaLvyVzenMBsy1uzfyO2ODxdXs8NtB.3 2024-09-14T11:58:38.597 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:38.598+0000 7fd5ad44a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.144__shadow_key1/data/file.mpg.2~9qaLvyVzenMBsy1uzfyO2ODxdXs8NtB.3_1 2024-09-14T11:58:38.598 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:38.598+0000 7fd5ad44a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.144__multipart_key1/data/file.mpg.2~9qaLvyVzenMBsy1uzfyO2ODxdXs8NtB.4 2024-09-14T11:58:38.600 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:38.602+0000 7fd5ad44a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.144__shadow_key1/data/file.mpg.2~9qaLvyVzenMBsy1uzfyO2ODxdXs8NtB.4_1 2024-09-14T11:58:38.600 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:38.602+0000 7fd5ad44a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.144__multipart_key1/data/file.mpg.2~9qaLvyVzenMBsy1uzfyO2ODxdXs8NtB.5 2024-09-14T11:58:38.608 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:38.610+0000 7fd5ad44a9c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T11:58:38.612 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:38.614+0000 7fd5ad44a9c0 20 garbage collection: RGWGC::process entered with GC index_shard=27, max_secs=3600, expired_only=0 2024-09-14T11:58:38.615 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:38.618+0000 7fd5ad44a9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:58:38.616 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:38.618+0000 7fd5ad44a9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:58:38.616 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:38.618+0000 7fd5ad44a9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=2, truncated=0, next_marker='' 2024-09-14T11:58:38.616 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:38.618+0000 7fd5ad44a9c0 20 garbage collection: RGWGC::process iterating over entry tag='d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.10961831719929641739', time=2024-09-14T13:51:19.572613+0000, chain.objs.size()=2 2024-09-14T11:58:38.617 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:38.618+0000 7fd5ad44a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.83__shadow_.QH1pngTHuOjWCvAl9Ck_IMHIxh5IA0k_1 2024-09-14T11:58:38.617 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:38.618+0000 7fd5ad44a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.83__shadow_.QH1pngTHuOjWCvAl9Ck_IMHIxh5IA0k_2 2024-09-14T11:58:38.617 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:38.618+0000 7fd5ad44a9c0 20 garbage collection: RGWGC::process iterating over entry tag='d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.994635287662186122', time=2024-09-14T13:55:01.334047+0000, chain.objs.size()=9 2024-09-14T11:58:38.617 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:38.618+0000 7fd5ad44a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.102__multipart_key1.2~rONrtP5T_oT3TQOTW_4S7050_6J02Fa.1 2024-09-14T11:58:38.617 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:38.618+0000 7fd5ad44a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.102__shadow_key1.2~rONrtP5T_oT3TQOTW_4S7050_6J02Fa.1_1 2024-09-14T11:58:38.617 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:38.618+0000 7fd5ad44a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.102__multipart_key1.2~rONrtP5T_oT3TQOTW_4S7050_6J02Fa.2 2024-09-14T11:58:38.617 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:38.618+0000 7fd5ad44a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.102__shadow_key1.2~rONrtP5T_oT3TQOTW_4S7050_6J02Fa.2_1 2024-09-14T11:58:38.617 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:38.618+0000 7fd5ad44a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.102__multipart_key1.2~rONrtP5T_oT3TQOTW_4S7050_6J02Fa.3 2024-09-14T11:58:38.617 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:38.618+0000 7fd5ad44a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.102__shadow_key1.2~rONrtP5T_oT3TQOTW_4S7050_6J02Fa.3_1 2024-09-14T11:58:38.617 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:38.618+0000 7fd5ad44a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.102__multipart_key1.2~rONrtP5T_oT3TQOTW_4S7050_6J02Fa.4 2024-09-14T11:58:38.617 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:38.618+0000 7fd5ad44a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.102__shadow_key1.2~rONrtP5T_oT3TQOTW_4S7050_6J02Fa.4_1 2024-09-14T11:58:38.617 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:38.618+0000 7fd5ad44a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.102__multipart_key1.2~rONrtP5T_oT3TQOTW_4S7050_6J02Fa.5 2024-09-14T11:58:38.629 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:38.630+0000 7fd5ad44a9c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T11:58:38.633 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:38.634+0000 7fd5ad44a9c0 20 garbage collection: RGWGC::process entered with GC index_shard=28, max_secs=3600, expired_only=0 2024-09-14T11:58:38.635 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:38.638+0000 7fd5ad44a9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:58:38.635 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:38.638+0000 7fd5ad44a9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:58:38.636 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:38.638+0000 7fd5ad44a9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:58:38.637 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:38.638+0000 7fd5ad44a9c0 20 garbage collection: RGWGC::process entered with GC index_shard=29, max_secs=3600, expired_only=0 2024-09-14T11:58:38.639 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:38.642+0000 7fd5ad44a9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:58:38.640 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:38.642+0000 7fd5ad44a9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:58:38.640 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:38.642+0000 7fd5ad44a9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:58:38.641 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:38.642+0000 7fd5ad44a9c0 20 garbage collection: RGWGC::process entered with GC index_shard=30, max_secs=3600, expired_only=0 2024-09-14T11:58:38.643 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:38.646+0000 7fd5ad44a9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:58:38.644 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:38.646+0000 7fd5ad44a9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:58:38.645 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:38.646+0000 7fd5ad44a9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=3, truncated=0, next_marker='' 2024-09-14T11:58:38.645 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:38.646+0000 7fd5ad44a9c0 20 garbage collection: RGWGC::process iterating over entry tag='d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.8130577514275712691', time=2024-09-14T13:52:28.324420+0000, chain.objs.size()=9 2024-09-14T11:58:38.645 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:38.646+0000 7fd5ad44a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.94__multipart_key1.2~zwM1c10nsUBwJ8kZKunAR-JUiuL6GtT.1 2024-09-14T11:58:38.645 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:38.646+0000 7fd5ad44a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.94__shadow_key1.2~zwM1c10nsUBwJ8kZKunAR-JUiuL6GtT.1_1 2024-09-14T11:58:38.646 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:38.646+0000 7fd5ad44a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.94__multipart_key1.2~zwM1c10nsUBwJ8kZKunAR-JUiuL6GtT.2 2024-09-14T11:58:38.646 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:38.646+0000 7fd5ad44a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.94__shadow_key1.2~zwM1c10nsUBwJ8kZKunAR-JUiuL6GtT.2_1 2024-09-14T11:58:38.646 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:38.646+0000 7fd5ad44a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.94__multipart_key1.2~zwM1c10nsUBwJ8kZKunAR-JUiuL6GtT.3 2024-09-14T11:58:38.646 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:38.646+0000 7fd5ad44a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.94__shadow_key1.2~zwM1c10nsUBwJ8kZKunAR-JUiuL6GtT.3_1 2024-09-14T11:58:38.646 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:38.646+0000 7fd5ad44a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.94__multipart_key1.2~zwM1c10nsUBwJ8kZKunAR-JUiuL6GtT.4 2024-09-14T11:58:38.646 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:38.646+0000 7fd5ad44a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.94__shadow_key1.2~zwM1c10nsUBwJ8kZKunAR-JUiuL6GtT.4_1 2024-09-14T11:58:38.646 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:38.646+0000 7fd5ad44a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.94__multipart_key1.2~zwM1c10nsUBwJ8kZKunAR-JUiuL6GtT.5 2024-09-14T11:58:38.646 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:38.646+0000 7fd5ad44a9c0 20 garbage collection: RGWGC::process iterating over entry tag='d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.16861774930364725061', time=2024-09-14T13:53:02.242534+0000, chain.objs.size()=7 2024-09-14T11:58:38.646 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:38.646+0000 7fd5ad44a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.94__multipart_key1.2~Pj5bjTHabn_x-5bUyzwsfVczoVzO0CP.1 2024-09-14T11:58:38.646 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:38.646+0000 7fd5ad44a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.94__shadow_key1.2~Pj5bjTHabn_x-5bUyzwsfVczoVzO0CP.1_1 2024-09-14T11:58:38.646 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:38.646+0000 7fd5ad44a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.94__shadow_key1.2~Pj5bjTHabn_x-5bUyzwsfVczoVzO0CP.1_2 2024-09-14T11:58:38.649 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:38.650+0000 7fd5ad44a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.94__multipart_key1.2~Pj5bjTHabn_x-5bUyzwsfVczoVzO0CP.2 2024-09-14T11:58:38.652 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:38.654+0000 7fd5ad44a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.94__shadow_key1.2~Pj5bjTHabn_x-5bUyzwsfVczoVzO0CP.2_1 2024-09-14T11:58:38.652 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:38.654+0000 7fd5ad44a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.94__shadow_key1.2~Pj5bjTHabn_x-5bUyzwsfVczoVzO0CP.2_2 2024-09-14T11:58:38.652 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:38.654+0000 7fd5ad44a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.94__multipart_key1.2~Pj5bjTHabn_x-5bUyzwsfVczoVzO0CP.3 2024-09-14T11:58:38.653 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:38.654+0000 7fd5ad44a9c0 20 garbage collection: RGWGC::process iterating over entry tag='d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.6531753153277116977', time=2024-09-14T13:54:25.302365+0000, chain.objs.size()=9 2024-09-14T11:58:38.653 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:38.654+0000 7fd5ad44a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.100__multipart_file2.mpg.2~HANOytWaCZcBuR6iNd46gBXMNZXyiOr.1 2024-09-14T11:58:38.653 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:38.654+0000 7fd5ad44a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.100__shadow_file2.mpg.2~HANOytWaCZcBuR6iNd46gBXMNZXyiOr.1_1 2024-09-14T11:58:38.653 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:38.654+0000 7fd5ad44a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.100__multipart_file2.mpg.2~HANOytWaCZcBuR6iNd46gBXMNZXyiOr.2 2024-09-14T11:58:38.653 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:38.654+0000 7fd5ad44a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.100__shadow_file2.mpg.2~HANOytWaCZcBuR6iNd46gBXMNZXyiOr.2_1 2024-09-14T11:58:38.655 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:38.658+0000 7fd5ad44a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.100__multipart_file2.mpg.2~HANOytWaCZcBuR6iNd46gBXMNZXyiOr.3 2024-09-14T11:58:38.655 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:38.658+0000 7fd5ad44a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.100__shadow_file2.mpg.2~HANOytWaCZcBuR6iNd46gBXMNZXyiOr.3_1 2024-09-14T11:58:38.655 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:38.658+0000 7fd5ad44a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.100__multipart_file2.mpg.2~HANOytWaCZcBuR6iNd46gBXMNZXyiOr.4 2024-09-14T11:58:38.656 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:38.658+0000 7fd5ad44a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.100__shadow_file2.mpg.2~HANOytWaCZcBuR6iNd46gBXMNZXyiOr.4_1 2024-09-14T11:58:38.656 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:38.658+0000 7fd5ad44a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.100__multipart_file2.mpg.2~HANOytWaCZcBuR6iNd46gBXMNZXyiOr.5 2024-09-14T11:58:38.664 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:38.666+0000 7fd5ad44a9c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T11:58:38.667 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:38.670+0000 7fd5ad44a9c0 20 garbage collection: RGWGC::process entered with GC index_shard=31, max_secs=3600, expired_only=0 2024-09-14T11:58:38.669 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:38.670+0000 7fd5ad44a9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:58:38.669 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:38.670+0000 7fd5ad44a9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:58:38.670 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:38.670+0000 7fd5ad44a9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2024-09-14T11:58:38.670 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:38.670+0000 7fd5ad44a9c0 20 garbage collection: RGWGC::process iterating over entry tag='d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.10860132948995788589', time=2024-09-14T13:53:01.636151+0000, chain.objs.size()=5 2024-09-14T11:58:38.670 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:38.670+0000 7fd5ad44a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.93__shadow_.TQ8RyT4HQjQ7cIg61GplTZkZBgUuygn_1 2024-09-14T11:58:38.670 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:38.674+0000 7fd5ad44a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.93__shadow_.TQ8RyT4HQjQ7cIg61GplTZkZBgUuygn_2 2024-09-14T11:58:38.670 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:38.674+0000 7fd5ad44a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.93__shadow_.TQ8RyT4HQjQ7cIg61GplTZkZBgUuygn_3 2024-09-14T11:58:38.670 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:38.674+0000 7fd5ad44a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.93__shadow_.TQ8RyT4HQjQ7cIg61GplTZkZBgUuygn_4 2024-09-14T11:58:38.671 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:38.674+0000 7fd5ad44a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.93__shadow_.TQ8RyT4HQjQ7cIg61GplTZkZBgUuygn_5 2024-09-14T11:58:38.674 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:38.678+0000 7fd5ad44a9c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T11:58:38.677 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:38.678+0000 7fd5ad44a9c0 20 garbage collection: RGWGC::process entered with GC index_shard=0, max_secs=3600, expired_only=0 2024-09-14T11:58:38.680 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:38.682+0000 7fd5ad44a9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:58:38.681 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:38.682+0000 7fd5ad44a9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:58:38.681 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:38.682+0000 7fd5ad44a9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:58:38.683 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:38.686+0000 7fd5ad44a9c0 20 garbage collection: RGWGC::process entered with GC index_shard=1, max_secs=3600, expired_only=0 2024-09-14T11:58:38.684 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:38.686+0000 7fd5ad44a9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:58:38.685 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:38.686+0000 7fd5ad44a9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:58:38.685 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:38.686+0000 7fd5ad44a9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:58:38.687 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:38.690+0000 7fd5ad44a9c0 20 garbage collection: RGWGC::process entered with GC index_shard=2, max_secs=3600, expired_only=0 2024-09-14T11:58:38.689 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:38.690+0000 7fd5ad44a9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:58:38.689 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:38.690+0000 7fd5ad44a9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:58:38.690 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:38.690+0000 7fd5ad44a9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:58:38.691 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:38.694+0000 7fd5ad44a9c0 20 garbage collection: RGWGC::process entered with GC index_shard=3, max_secs=3600, expired_only=0 2024-09-14T11:58:38.693 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:38.694+0000 7fd5ad44a9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:58:38.694 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:38.694+0000 7fd5ad44a9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:58:38.694 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:38.694+0000 7fd5ad44a9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:58:38.695 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:38.698+0000 7fd5ad44a9c0 20 garbage collection: RGWGC::process entered with GC index_shard=4, max_secs=3600, expired_only=0 2024-09-14T11:58:38.698 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:38.698+0000 7fd5ad44a9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:58:38.698 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:38.702+0000 7fd5ad44a9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:58:38.699 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:38.702+0000 7fd5ad44a9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2024-09-14T11:58:38.699 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:38.702+0000 7fd5ad44a9c0 20 garbage collection: RGWGC::process iterating over entry tag='d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.14744980486692298641', time=2024-09-14T13:55:56.592235+0000, chain.objs.size()=7 2024-09-14T11:58:38.699 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:38.702+0000 7fd5ad44a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.102__multipart_key1.2~6PZrqXlLJXIj-zjA8H4-n5Nu0v4xLCq.1 2024-09-14T11:58:38.699 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:38.702+0000 7fd5ad44a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.102__shadow_key1.2~6PZrqXlLJXIj-zjA8H4-n5Nu0v4xLCq.1_1 2024-09-14T11:58:38.699 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:38.702+0000 7fd5ad44a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.102__shadow_key1.2~6PZrqXlLJXIj-zjA8H4-n5Nu0v4xLCq.1_2 2024-09-14T11:58:38.699 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:38.702+0000 7fd5ad44a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.102__multipart_key1.2~6PZrqXlLJXIj-zjA8H4-n5Nu0v4xLCq.2 2024-09-14T11:58:38.699 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:38.702+0000 7fd5ad44a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.102__shadow_key1.2~6PZrqXlLJXIj-zjA8H4-n5Nu0v4xLCq.2_1 2024-09-14T11:58:38.700 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:38.702+0000 7fd5ad44a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.102__shadow_key1.2~6PZrqXlLJXIj-zjA8H4-n5Nu0v4xLCq.2_2 2024-09-14T11:58:38.700 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:38.702+0000 7fd5ad44a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.102__multipart_key1.2~6PZrqXlLJXIj-zjA8H4-n5Nu0v4xLCq.3 2024-09-14T11:58:38.705 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:38.706+0000 7fd5ad44a9c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T11:58:38.708 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:38.710+0000 7fd5ad44a9c0 20 garbage collection: RGWGC::process entered with GC index_shard=5, max_secs=3600, expired_only=0 2024-09-14T11:58:38.710 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:38.710+0000 7fd5ad44a9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:58:38.711 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:38.714+0000 7fd5ad44a9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:58:38.712 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:38.714+0000 7fd5ad44a9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=2, truncated=0, next_marker='' 2024-09-14T11:58:38.712 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:38.714+0000 7fd5ad44a9c0 20 garbage collection: RGWGC::process iterating over entry tag='d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.3912795016251029978', time=2024-09-14T13:53:01.342394+0000, chain.objs.size()=7 2024-09-14T11:58:38.712 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:38.714+0000 7fd5ad44a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.94__multipart_key1.2~6qoSmbnUw2Z5FHNihjfHdCi1PO5obri.1 2024-09-14T11:58:38.712 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:38.714+0000 7fd5ad44a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.94__shadow_key1.2~6qoSmbnUw2Z5FHNihjfHdCi1PO5obri.1_1 2024-09-14T11:58:38.712 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:38.714+0000 7fd5ad44a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.94__shadow_key1.2~6qoSmbnUw2Z5FHNihjfHdCi1PO5obri.1_2 2024-09-14T11:58:38.712 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:38.714+0000 7fd5ad44a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.94__multipart_key1.2~6qoSmbnUw2Z5FHNihjfHdCi1PO5obri.2 2024-09-14T11:58:38.713 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:38.714+0000 7fd5ad44a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.94__shadow_key1.2~6qoSmbnUw2Z5FHNihjfHdCi1PO5obri.2_1 2024-09-14T11:58:38.713 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:38.714+0000 7fd5ad44a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.94__shadow_key1.2~6qoSmbnUw2Z5FHNihjfHdCi1PO5obri.2_2 2024-09-14T11:58:38.713 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:38.714+0000 7fd5ad44a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.94__multipart_key1.2~6qoSmbnUw2Z5FHNihjfHdCi1PO5obri.3 2024-09-14T11:58:38.713 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:38.714+0000 7fd5ad44a9c0 20 garbage collection: RGWGC::process iterating over entry tag='d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.8844556422988232311', time=2024-09-14T13:56:25.031423+0000, chain.objs.size()=9 2024-09-14T11:58:38.713 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:38.714+0000 7fd5ad44a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.104__multipart_key1.2~a4DDxXMziOFKPzMgrj893nk3Yu1oLAZ.1 2024-09-14T11:58:38.713 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:38.714+0000 7fd5ad44a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.104__shadow_key1.2~a4DDxXMziOFKPzMgrj893nk3Yu1oLAZ.1_1 2024-09-14T11:58:38.713 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:38.714+0000 7fd5ad44a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.104__multipart_key1.2~a4DDxXMziOFKPzMgrj893nk3Yu1oLAZ.2 2024-09-14T11:58:38.713 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:38.714+0000 7fd5ad44a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.104__shadow_key1.2~a4DDxXMziOFKPzMgrj893nk3Yu1oLAZ.2_1 2024-09-14T11:58:38.713 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:38.714+0000 7fd5ad44a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.104__multipart_key1.2~a4DDxXMziOFKPzMgrj893nk3Yu1oLAZ.3 2024-09-14T11:58:38.719 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:38.722+0000 7fd5ad44a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.104__shadow_key1.2~a4DDxXMziOFKPzMgrj893nk3Yu1oLAZ.3_1 2024-09-14T11:58:38.719 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:38.722+0000 7fd5ad44a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.104__multipart_key1.2~a4DDxXMziOFKPzMgrj893nk3Yu1oLAZ.4 2024-09-14T11:58:38.719 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:38.722+0000 7fd5ad44a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.104__shadow_key1.2~a4DDxXMziOFKPzMgrj893nk3Yu1oLAZ.4_1 2024-09-14T11:58:38.719 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:38.722+0000 7fd5ad44a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.104__multipart_key1.2~a4DDxXMziOFKPzMgrj893nk3Yu1oLAZ.5 2024-09-14T11:58:38.724 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:38.726+0000 7fd5ad44a9c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T11:58:38.727 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:38.730+0000 7fd5ad44a9c0 20 garbage collection: RGWGC::process entered with GC index_shard=6, max_secs=3600, expired_only=0 2024-09-14T11:58:38.729 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:38.730+0000 7fd5ad44a9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:58:38.730 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:38.730+0000 7fd5ad44a9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:58:38.731 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:38.734+0000 7fd5ad44a9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2024-09-14T11:58:38.731 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:38.734+0000 7fd5ad44a9c0 20 garbage collection: RGWGC::process iterating over entry tag='d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.5309092524408135490', time=2024-09-14T13:51:40.593626+0000, chain.objs.size()=9 2024-09-14T11:58:38.731 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:38.734+0000 7fd5ad44a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.91__multipart_key1.2~aDRd9nAx8BEvRvh69dvgHfe5c3f3tfD.1 2024-09-14T11:58:38.731 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:38.734+0000 7fd5ad44a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.91__shadow_key1.2~aDRd9nAx8BEvRvh69dvgHfe5c3f3tfD.1_1 2024-09-14T11:58:38.731 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:38.734+0000 7fd5ad44a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.91__multipart_key1.2~aDRd9nAx8BEvRvh69dvgHfe5c3f3tfD.2 2024-09-14T11:58:38.731 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:38.734+0000 7fd5ad44a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.91__shadow_key1.2~aDRd9nAx8BEvRvh69dvgHfe5c3f3tfD.2_1 2024-09-14T11:58:38.731 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:38.734+0000 7fd5ad44a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.91__multipart_key1.2~aDRd9nAx8BEvRvh69dvgHfe5c3f3tfD.3 2024-09-14T11:58:38.731 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:38.734+0000 7fd5ad44a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.91__shadow_key1.2~aDRd9nAx8BEvRvh69dvgHfe5c3f3tfD.3_1 2024-09-14T11:58:38.731 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:38.734+0000 7fd5ad44a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.91__multipart_key1.2~aDRd9nAx8BEvRvh69dvgHfe5c3f3tfD.4 2024-09-14T11:58:38.731 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:38.734+0000 7fd5ad44a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.91__shadow_key1.2~aDRd9nAx8BEvRvh69dvgHfe5c3f3tfD.4_1 2024-09-14T11:58:38.731 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:38.734+0000 7fd5ad44a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.91__multipart_key1.2~aDRd9nAx8BEvRvh69dvgHfe5c3f3tfD.5 2024-09-14T11:58:38.735 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:38.738+0000 7fd5ad44a9c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T11:58:38.739 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:38.742+0000 7fd5ad44a9c0 20 garbage collection: RGWGC::process entered with GC index_shard=7, max_secs=3600, expired_only=0 2024-09-14T11:58:38.741 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:38.742+0000 7fd5ad44a9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:58:38.741 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:38.742+0000 7fd5ad44a9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:58:38.742 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:38.742+0000 7fd5ad44a9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=2, truncated=0, next_marker='' 2024-09-14T11:58:38.742 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:38.742+0000 7fd5ad44a9c0 20 garbage collection: RGWGC::process iterating over entry tag='d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.12349007419261994926', time=2024-09-14T13:54:25.143431+0000, chain.objs.size()=9 2024-09-14T11:58:38.742 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:38.742+0000 7fd5ad44a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.100__multipart_file.mpg.2~b4-1_MiGzEwSEzLJibalEY7V6hPF-NC.1 2024-09-14T11:58:38.743 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:38.742+0000 7fd5ad44a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.100__shadow_file.mpg.2~b4-1_MiGzEwSEzLJibalEY7V6hPF-NC.1_1 2024-09-14T11:58:38.743 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:38.742+0000 7fd5ad44a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.100__multipart_file.mpg.2~b4-1_MiGzEwSEzLJibalEY7V6hPF-NC.2 2024-09-14T11:58:38.743 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:38.742+0000 7fd5ad44a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.100__shadow_file.mpg.2~b4-1_MiGzEwSEzLJibalEY7V6hPF-NC.2_1 2024-09-14T11:58:38.743 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:38.742+0000 7fd5ad44a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.100__multipart_file.mpg.2~b4-1_MiGzEwSEzLJibalEY7V6hPF-NC.3 2024-09-14T11:58:38.743 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:38.742+0000 7fd5ad44a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.100__shadow_file.mpg.2~b4-1_MiGzEwSEzLJibalEY7V6hPF-NC.3_1 2024-09-14T11:58:38.743 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:38.742+0000 7fd5ad44a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.100__multipart_file.mpg.2~b4-1_MiGzEwSEzLJibalEY7V6hPF-NC.4 2024-09-14T11:58:38.743 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:38.742+0000 7fd5ad44a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.100__shadow_file.mpg.2~b4-1_MiGzEwSEzLJibalEY7V6hPF-NC.4_1 2024-09-14T11:58:38.743 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:38.742+0000 7fd5ad44a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.100__multipart_file.mpg.2~b4-1_MiGzEwSEzLJibalEY7V6hPF-NC.5 2024-09-14T11:58:38.743 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:38.742+0000 7fd5ad44a9c0 20 garbage collection: RGWGC::process iterating over entry tag='d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.5839655805291701985', time=2024-09-14T13:55:33.842296+0000, chain.objs.size()=9 2024-09-14T11:58:38.743 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:38.742+0000 7fd5ad44a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.102__multipart_key1.2~LW8XYKNh1Fy8gTKtP6Wns0wA0DQah0g.1 2024-09-14T11:58:38.743 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:38.742+0000 7fd5ad44a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.102__shadow_key1.2~LW8XYKNh1Fy8gTKtP6Wns0wA0DQah0g.1_1 2024-09-14T11:58:38.743 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:38.742+0000 7fd5ad44a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.102__multipart_key1.2~LW8XYKNh1Fy8gTKtP6Wns0wA0DQah0g.2 2024-09-14T11:58:38.747 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:38.750+0000 7fd5ad44a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.102__shadow_key1.2~LW8XYKNh1Fy8gTKtP6Wns0wA0DQah0g.2_1 2024-09-14T11:58:38.747 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:38.750+0000 7fd5ad44a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.102__multipart_key1.2~LW8XYKNh1Fy8gTKtP6Wns0wA0DQah0g.3 2024-09-14T11:58:38.747 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:38.750+0000 7fd5ad44a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.102__shadow_key1.2~LW8XYKNh1Fy8gTKtP6Wns0wA0DQah0g.3_1 2024-09-14T11:58:38.747 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:38.750+0000 7fd5ad44a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.102__multipart_key1.2~LW8XYKNh1Fy8gTKtP6Wns0wA0DQah0g.4 2024-09-14T11:58:38.747 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:38.750+0000 7fd5ad44a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.102__shadow_key1.2~LW8XYKNh1Fy8gTKtP6Wns0wA0DQah0g.4_1 2024-09-14T11:58:38.748 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:38.750+0000 7fd5ad44a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.102__multipart_key1.2~LW8XYKNh1Fy8gTKtP6Wns0wA0DQah0g.5 2024-09-14T11:58:38.754 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:38.754+0000 7fd5ad44a9c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T11:58:38.757 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:38.758+0000 7fd5ad44a9c0 20 garbage collection: RGWGC::process entered with GC index_shard=8, max_secs=3600, expired_only=0 2024-09-14T11:58:38.759 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:38.762+0000 7fd5ad44a9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:58:38.759 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:38.762+0000 7fd5ad44a9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:58:38.760 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:38.762+0000 7fd5ad44a9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2024-09-14T11:58:38.760 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:38.762+0000 7fd5ad44a9c0 20 garbage collection: RGWGC::process iterating over entry tag='d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.8681080143591553448', time=2024-09-14T13:53:48.827385+0000, chain.objs.size()=9 2024-09-14T11:58:38.761 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:38.762+0000 7fd5ad44a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.99__multipart_key1.2~fo5AFwrlqkzFTnJB5JsNcBYfg2yLTUR.1 2024-09-14T11:58:38.761 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:38.762+0000 7fd5ad44a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.99__shadow_key1.2~fo5AFwrlqkzFTnJB5JsNcBYfg2yLTUR.1_1 2024-09-14T11:58:38.761 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:38.762+0000 7fd5ad44a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.99__multipart_key1.2~fo5AFwrlqkzFTnJB5JsNcBYfg2yLTUR.2 2024-09-14T11:58:38.761 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:38.762+0000 7fd5ad44a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.99__shadow_key1.2~fo5AFwrlqkzFTnJB5JsNcBYfg2yLTUR.2_1 2024-09-14T11:58:38.761 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:38.762+0000 7fd5ad44a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.99__multipart_key1.2~fo5AFwrlqkzFTnJB5JsNcBYfg2yLTUR.3 2024-09-14T11:58:38.761 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:38.762+0000 7fd5ad44a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.99__shadow_key1.2~fo5AFwrlqkzFTnJB5JsNcBYfg2yLTUR.3_1 2024-09-14T11:58:38.761 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:38.762+0000 7fd5ad44a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.99__multipart_key1.2~fo5AFwrlqkzFTnJB5JsNcBYfg2yLTUR.4 2024-09-14T11:58:38.761 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:38.762+0000 7fd5ad44a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.99__shadow_key1.2~fo5AFwrlqkzFTnJB5JsNcBYfg2yLTUR.4_1 2024-09-14T11:58:38.761 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:38.762+0000 7fd5ad44a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.99__multipart_key1.2~fo5AFwrlqkzFTnJB5JsNcBYfg2yLTUR.5 2024-09-14T11:58:38.766 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:38.766+0000 7fd5ad44a9c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T11:58:38.769 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:38.770+0000 7fd5ad44a9c0 20 garbage collection: RGWGC::process entered with GC index_shard=9, max_secs=3600, expired_only=0 2024-09-14T11:58:38.771 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:38.774+0000 7fd5ad44a9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:58:38.772 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:38.774+0000 7fd5ad44a9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:58:38.774 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:38.774+0000 7fd5ad44a9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=37, truncated=0, next_marker='' 2024-09-14T11:58:38.774 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:38.774+0000 7fd5ad44a9c0 20 garbage collection: RGWGC::process iterating over entry tag='2~FSwO5wOqwl0Xca1qY9I-WjiQ333ysUK', time=2024-09-14T13:56:41.772056+0000, chain.objs.size()=1 2024-09-14T11:58:38.774 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:38.774+0000 7fd5ad44a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.105__multipart_key1.2~FSwO5wOqwl0Xca1qY9I-WjiQ333ysUK.12 2024-09-14T11:58:38.774 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:38.774+0000 7fd5ad44a9c0 20 garbage collection: RGWGC::process iterating over entry tag='2~FSwO5wOqwl0Xca1qY9I-WjiQ333ysUK', time=2024-09-14T13:56:41.940592+0000, chain.objs.size()=1 2024-09-14T11:58:38.774 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:38.774+0000 7fd5ad44a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.105__multipart_key1.2~FSwO5wOqwl0Xca1qY9I-WjiQ333ysUK.13 2024-09-14T11:58:38.774 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:38.774+0000 7fd5ad44a9c0 20 garbage collection: RGWGC::process iterating over entry tag='2~FSwO5wOqwl0Xca1qY9I-WjiQ333ysUK', time=2024-09-14T13:56:42.093116+0000, chain.objs.size()=1 2024-09-14T11:58:38.774 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:38.774+0000 7fd5ad44a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.105__multipart_key1.2~FSwO5wOqwl0Xca1qY9I-WjiQ333ysUK.14 2024-09-14T11:58:38.774 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:38.774+0000 7fd5ad44a9c0 20 garbage collection: RGWGC::process iterating over entry tag='2~FSwO5wOqwl0Xca1qY9I-WjiQ333ysUK', time=2024-09-14T13:56:42.336945+0000, chain.objs.size()=1 2024-09-14T11:58:38.774 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:38.774+0000 7fd5ad44a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.105__multipart_key1.2~FSwO5wOqwl0Xca1qY9I-WjiQ333ysUK.15 2024-09-14T11:58:38.775 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:38.774+0000 7fd5ad44a9c0 20 garbage collection: RGWGC::process iterating over entry tag='2~FSwO5wOqwl0Xca1qY9I-WjiQ333ysUK', time=2024-09-14T13:56:42.546621+0000, chain.objs.size()=1 2024-09-14T11:58:38.775 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:38.774+0000 7fd5ad44a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.105__multipart_key1.2~FSwO5wOqwl0Xca1qY9I-WjiQ333ysUK.16 2024-09-14T11:58:38.775 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:38.774+0000 7fd5ad44a9c0 20 garbage collection: RGWGC::process iterating over entry tag='2~FSwO5wOqwl0Xca1qY9I-WjiQ333ysUK', time=2024-09-14T13:56:42.996170+0000, chain.objs.size()=1 2024-09-14T11:58:38.775 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:38.774+0000 7fd5ad44a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.105__multipart_key1.2~FSwO5wOqwl0Xca1qY9I-WjiQ333ysUK.17 2024-09-14T11:58:38.775 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:38.774+0000 7fd5ad44a9c0 20 garbage collection: RGWGC::process iterating over entry tag='2~FSwO5wOqwl0Xca1qY9I-WjiQ333ysUK', time=2024-09-14T13:56:43.446193+0000, chain.objs.size()=1 2024-09-14T11:58:38.775 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:38.774+0000 7fd5ad44a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.105__multipart_key1.2~FSwO5wOqwl0Xca1qY9I-WjiQ333ysUK.18 2024-09-14T11:58:38.775 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:38.774+0000 7fd5ad44a9c0 20 garbage collection: RGWGC::process iterating over entry tag='2~FSwO5wOqwl0Xca1qY9I-WjiQ333ysUK', time=2024-09-14T13:56:43.860516+0000, chain.objs.size()=1 2024-09-14T11:58:38.775 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:38.774+0000 7fd5ad44a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.105__multipart_key1.2~FSwO5wOqwl0Xca1qY9I-WjiQ333ysUK.19 2024-09-14T11:58:38.775 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:38.774+0000 7fd5ad44a9c0 20 garbage collection: RGWGC::process iterating over entry tag='2~FSwO5wOqwl0Xca1qY9I-WjiQ333ysUK', time=2024-09-14T13:56:44.060010+0000, chain.objs.size()=1 2024-09-14T11:58:38.775 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:38.774+0000 7fd5ad44a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.105__multipart_key1.2~FSwO5wOqwl0Xca1qY9I-WjiQ333ysUK.20 2024-09-14T11:58:38.775 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:38.774+0000 7fd5ad44a9c0 20 garbage collection: RGWGC::process iterating over entry tag='2~FSwO5wOqwl0Xca1qY9I-WjiQ333ysUK', time=2024-09-14T13:56:44.217635+0000, chain.objs.size()=42 2024-09-14T11:58:38.775 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:38.774+0000 7fd5ad44a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.105__multipart_key1.2~FSwO5wOqwl0Xca1qY9I-WjiQ333ysUK.1 2024-09-14T11:58:38.775 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:38.774+0000 7fd5ad44a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.105__multipart_key1.2~FSwO5wOqwl0Xca1qY9I-WjiQ333ysUK.2 2024-09-14T11:58:38.775 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:38.774+0000 7fd5ad44a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.105__multipart_key1.2~FSwO5wOqwl0Xca1qY9I-WjiQ333ysUK.3 2024-09-14T11:58:38.776 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:38.778+0000 7fd5ad44a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.105__multipart_key1.2~FSwO5wOqwl0Xca1qY9I-WjiQ333ysUK.4 2024-09-14T11:58:38.781 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:38.782+0000 7fd5ad44a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.105__multipart_key1.2~FSwO5wOqwl0Xca1qY9I-WjiQ333ysUK.5 2024-09-14T11:58:38.781 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:38.782+0000 7fd5ad44a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.105__multipart_key1.2~FSwO5wOqwl0Xca1qY9I-WjiQ333ysUK.6 2024-09-14T11:58:38.781 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:38.782+0000 7fd5ad44a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.105__multipart_key1.2~FSwO5wOqwl0Xca1qY9I-WjiQ333ysUK.7 2024-09-14T11:58:38.781 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:38.782+0000 7fd5ad44a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.105__multipart_key1.2~FSwO5wOqwl0Xca1qY9I-WjiQ333ysUK.8 2024-09-14T11:58:38.781 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:38.782+0000 7fd5ad44a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.105__multipart_key1.2~FSwO5wOqwl0Xca1qY9I-WjiQ333ysUK.9 2024-09-14T11:58:38.782 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:38.782+0000 7fd5ad44a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.105__multipart_key1.2~FSwO5wOqwl0Xca1qY9I-WjiQ333ysUK.10 2024-09-14T11:58:38.782 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:38.782+0000 7fd5ad44a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.105__multipart_key1.2~FSwO5wOqwl0Xca1qY9I-WjiQ333ysUK.11 2024-09-14T11:58:38.783 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:38.786+0000 7fd5ad44a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.105__multipart_key1.nl5gDL2PIoBk2ZRxClnLZaVvtqwZOYYi.12 2024-09-14T11:58:38.783 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:38.786+0000 7fd5ad44a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.105__multipart_key1.anD-6eBxqYYgnvOo-AEdvmfEXf5LrO7u.13 2024-09-14T11:58:38.783 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:38.786+0000 7fd5ad44a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.105__multipart_key1.VTixSmS49m0BVZ-VHSktr4e8J7rXl4s_.14 2024-09-14T11:58:38.784 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:38.786+0000 7fd5ad44a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.105__multipart_key1.PLi5vgatVfjI3uFK1-ZbX3AhJrIZf3wl.15 2024-09-14T11:58:38.785 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:38.786+0000 7fd5ad44a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.105__multipart_key1.450mz9wKTRJvZTOvD5ZVOltYonPkLQgg.16 2024-09-14T11:58:38.787 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:38.790+0000 7fd5ad44a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.105__multipart_key1.dJpzvMrORWbK7x7J_MS9gLjuZu9Q5ySI.17 2024-09-14T11:58:38.787 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:38.790+0000 7fd5ad44a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.105__multipart_key1.HKX39eqtdDNXhhbISly9lYS7i46vtt3-.18 2024-09-14T11:58:38.787 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:38.790+0000 7fd5ad44a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.105__multipart_key1.QTX0Cjc4DMizWbVU3S_WEQIJz8kAHVp7.19 2024-09-14T11:58:38.788 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:38.790+0000 7fd5ad44a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.105__multipart_key1.WdQ7yCivrJxNnbPyRFp1bOqRoNJNREey.20 2024-09-14T11:58:38.788 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:38.790+0000 7fd5ad44a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.105__multipart_key1.2~FSwO5wOqwl0Xca1qY9I-WjiQ333ysUK.21 2024-09-14T11:58:38.788 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:38.790+0000 7fd5ad44a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.105__multipart_key1.2~FSwO5wOqwl0Xca1qY9I-WjiQ333ysUK.22 2024-09-14T11:58:38.792 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:38.794+0000 7fd5ad44a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.105__multipart_key1.2~FSwO5wOqwl0Xca1qY9I-WjiQ333ysUK.23 2024-09-14T11:58:38.792 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:38.794+0000 7fd5ad44a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.105__multipart_key1.2~FSwO5wOqwl0Xca1qY9I-WjiQ333ysUK.24 2024-09-14T11:58:38.792 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:38.794+0000 7fd5ad44a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.105__multipart_key1.2~FSwO5wOqwl0Xca1qY9I-WjiQ333ysUK.25 2024-09-14T11:58:38.792 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:38.794+0000 7fd5ad44a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.105__multipart_key1.2~FSwO5wOqwl0Xca1qY9I-WjiQ333ysUK.26 2024-09-14T11:58:38.792 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:38.794+0000 7fd5ad44a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.105__multipart_key1.2~FSwO5wOqwl0Xca1qY9I-WjiQ333ysUK.27 2024-09-14T11:58:38.792 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:38.794+0000 7fd5ad44a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.105__multipart_key1.2~FSwO5wOqwl0Xca1qY9I-WjiQ333ysUK.28 2024-09-14T11:58:38.792 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:38.794+0000 7fd5ad44a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.105__multipart_key1.2~FSwO5wOqwl0Xca1qY9I-WjiQ333ysUK.29 2024-09-14T11:58:38.792 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:38.794+0000 7fd5ad44a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.105__multipart_key1.2~FSwO5wOqwl0Xca1qY9I-WjiQ333ysUK.30 2024-09-14T11:58:38.792 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:38.794+0000 7fd5ad44a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.105__multipart_key1.2~FSwO5wOqwl0Xca1qY9I-WjiQ333ysUK.31 2024-09-14T11:58:38.792 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:38.794+0000 7fd5ad44a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.105__multipart_key1.2~FSwO5wOqwl0Xca1qY9I-WjiQ333ysUK.32 2024-09-14T11:58:38.793 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:38.794+0000 7fd5ad44a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.105__multipart_key1.2~FSwO5wOqwl0Xca1qY9I-WjiQ333ysUK.33 2024-09-14T11:58:38.795 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:38.798+0000 7fd5ad44a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.105__multipart_key1.2~FSwO5wOqwl0Xca1qY9I-WjiQ333ysUK.34 2024-09-14T11:58:38.796 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:38.798+0000 7fd5ad44a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.105__multipart_key1.2~FSwO5wOqwl0Xca1qY9I-WjiQ333ysUK.35 2024-09-14T11:58:38.797 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:38.798+0000 7fd5ad44a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.105__multipart_key1.2~FSwO5wOqwl0Xca1qY9I-WjiQ333ysUK.36 2024-09-14T11:58:38.798 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:38.798+0000 7fd5ad44a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.105__multipart_key1.2~FSwO5wOqwl0Xca1qY9I-WjiQ333ysUK.37 2024-09-14T11:58:38.798 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:38.798+0000 7fd5ad44a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.105__multipart_key1.2~FSwO5wOqwl0Xca1qY9I-WjiQ333ysUK.38 2024-09-14T11:58:38.798 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:38.798+0000 7fd5ad44a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.105__multipart_key1.2~FSwO5wOqwl0Xca1qY9I-WjiQ333ysUK.39 2024-09-14T11:58:38.798 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:38.798+0000 7fd5ad44a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.105__multipart_key1.2~FSwO5wOqwl0Xca1qY9I-WjiQ333ysUK.40 2024-09-14T11:58:38.798 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:38.798+0000 7fd5ad44a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.105__multipart_key1.2~FSwO5wOqwl0Xca1qY9I-WjiQ333ysUK.41 2024-09-14T11:58:38.798 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:38.798+0000 7fd5ad44a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.105__multipart_key1.2~FSwO5wOqwl0Xca1qY9I-WjiQ333ysUK.42 2024-09-14T11:58:38.798 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:38.798+0000 7fd5ad44a9c0 20 garbage collection: RGWGC::process iterating over entry tag='2~FSwO5wOqwl0Xca1qY9I-WjiQ333ysUK', time=2024-09-14T13:56:45.402542+0000, chain.objs.size()=20 2024-09-14T11:58:38.798 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:38.798+0000 7fd5ad44a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.105__multipart_key1.2~FSwO5wOqwl0Xca1qY9I-WjiQ333ysUK.43 2024-09-14T11:58:38.798 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:38.798+0000 7fd5ad44a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.105__multipart_key1.2~FSwO5wOqwl0Xca1qY9I-WjiQ333ysUK.44 2024-09-14T11:58:38.799 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:38.802+0000 7fd5ad44a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.105__multipart_key1.2~FSwO5wOqwl0Xca1qY9I-WjiQ333ysUK.45 2024-09-14T11:58:38.800 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:38.802+0000 7fd5ad44a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.105__multipart_key1.2~FSwO5wOqwl0Xca1qY9I-WjiQ333ysUK.46 2024-09-14T11:58:38.801 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:38.802+0000 7fd5ad44a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.105__multipart_key1.2~FSwO5wOqwl0Xca1qY9I-WjiQ333ysUK.47 2024-09-14T11:58:38.801 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:38.802+0000 7fd5ad44a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.105__multipart_key1.2~FSwO5wOqwl0Xca1qY9I-WjiQ333ysUK.48 2024-09-14T11:58:38.803 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:38.806+0000 7fd5ad44a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.105__multipart_key1.2~FSwO5wOqwl0Xca1qY9I-WjiQ333ysUK.49 2024-09-14T11:58:38.803 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:38.806+0000 7fd5ad44a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.105__multipart_key1.2~FSwO5wOqwl0Xca1qY9I-WjiQ333ysUK.50 2024-09-14T11:58:38.803 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:38.806+0000 7fd5ad44a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.105__multipart_key1.2~FSwO5wOqwl0Xca1qY9I-WjiQ333ysUK.51 2024-09-14T11:58:38.804 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:38.806+0000 7fd5ad44a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.105__multipart_key1.2~FSwO5wOqwl0Xca1qY9I-WjiQ333ysUK.52 2024-09-14T11:58:38.804 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:38.806+0000 7fd5ad44a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.105__multipart_key1.2~FSwO5wOqwl0Xca1qY9I-WjiQ333ysUK.53 2024-09-14T11:58:38.805 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:38.806+0000 7fd5ad44a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.105__multipart_key1.2~FSwO5wOqwl0Xca1qY9I-WjiQ333ysUK.54 2024-09-14T11:58:38.805 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:38.806+0000 7fd5ad44a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.105__multipart_key1.2~FSwO5wOqwl0Xca1qY9I-WjiQ333ysUK.55 2024-09-14T11:58:38.805 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:38.806+0000 7fd5ad44a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.105__multipart_key1.2~FSwO5wOqwl0Xca1qY9I-WjiQ333ysUK.56 2024-09-14T11:58:38.805 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:38.806+0000 7fd5ad44a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.105__multipart_key1.2~FSwO5wOqwl0Xca1qY9I-WjiQ333ysUK.57 2024-09-14T11:58:38.805 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:38.806+0000 7fd5ad44a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.105__multipart_key1.2~FSwO5wOqwl0Xca1qY9I-WjiQ333ysUK.58 2024-09-14T11:58:38.805 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:38.806+0000 7fd5ad44a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.105__multipart_key1.2~FSwO5wOqwl0Xca1qY9I-WjiQ333ysUK.59 2024-09-14T11:58:38.806 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:38.806+0000 7fd5ad44a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.105__multipart_key1.2~FSwO5wOqwl0Xca1qY9I-WjiQ333ysUK.60 2024-09-14T11:58:38.806 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:38.810+0000 7fd5ad44a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.105__multipart_key1.2~FSwO5wOqwl0Xca1qY9I-WjiQ333ysUK.61 2024-09-14T11:58:38.808 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:38.810+0000 7fd5ad44a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.105__multipart_key1.2~FSwO5wOqwl0Xca1qY9I-WjiQ333ysUK.62 2024-09-14T11:58:38.808 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:38.810+0000 7fd5ad44a9c0 20 garbage collection: RGWGC::process iterating over entry tag='2~FSwO5wOqwl0Xca1qY9I-WjiQ333ysUK', time=2024-09-14T13:56:46.752711+0000, chain.objs.size()=1 2024-09-14T11:58:38.808 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:38.810+0000 7fd5ad44a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.105__multipart_key1.2~FSwO5wOqwl0Xca1qY9I-WjiQ333ysUK.63 2024-09-14T11:58:38.808 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:38.810+0000 7fd5ad44a9c0 20 garbage collection: RGWGC::process iterating over entry tag='2~FSwO5wOqwl0Xca1qY9I-WjiQ333ysUK', time=2024-09-14T13:56:48.374383+0000, chain.objs.size()=9 2024-09-14T11:58:38.808 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:38.810+0000 7fd5ad44a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.105__multipart_key1.2~FSwO5wOqwl0Xca1qY9I-WjiQ333ysUK.64 2024-09-14T11:58:38.811 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:38.814+0000 7fd5ad44a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.105__multipart_key1.2~FSwO5wOqwl0Xca1qY9I-WjiQ333ysUK.65 2024-09-14T11:58:38.811 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:38.814+0000 7fd5ad44a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.105__multipart_key1.2~FSwO5wOqwl0Xca1qY9I-WjiQ333ysUK.66 2024-09-14T11:58:38.812 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:38.814+0000 7fd5ad44a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.105__multipart_key1.2~FSwO5wOqwl0Xca1qY9I-WjiQ333ysUK.67 2024-09-14T11:58:38.812 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:38.814+0000 7fd5ad44a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.105__multipart_key1.2~FSwO5wOqwl0Xca1qY9I-WjiQ333ysUK.68 2024-09-14T11:58:38.812 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:38.814+0000 7fd5ad44a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.105__multipart_key1.2~FSwO5wOqwl0Xca1qY9I-WjiQ333ysUK.69 2024-09-14T11:58:38.812 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:38.814+0000 7fd5ad44a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.105__multipart_key1.2~FSwO5wOqwl0Xca1qY9I-WjiQ333ysUK.70 2024-09-14T11:58:38.812 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:38.814+0000 7fd5ad44a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.105__multipart_key1.2~FSwO5wOqwl0Xca1qY9I-WjiQ333ysUK.71 2024-09-14T11:58:38.812 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:38.814+0000 7fd5ad44a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.105__multipart_key1.2~FSwO5wOqwl0Xca1qY9I-WjiQ333ysUK.72 2024-09-14T11:58:38.812 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:38.814+0000 7fd5ad44a9c0 20 garbage collection: RGWGC::process iterating over entry tag='2~FSwO5wOqwl0Xca1qY9I-WjiQ333ysUK', time=2024-09-14T13:56:49.660246+0000, chain.objs.size()=5 2024-09-14T11:58:38.812 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:38.814+0000 7fd5ad44a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.105__multipart_key1.2~FSwO5wOqwl0Xca1qY9I-WjiQ333ysUK.73 2024-09-14T11:58:38.813 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:38.814+0000 7fd5ad44a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.105__multipart_key1.2~FSwO5wOqwl0Xca1qY9I-WjiQ333ysUK.74 2024-09-14T11:58:38.813 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:38.814+0000 7fd5ad44a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.105__multipart_key1.2~FSwO5wOqwl0Xca1qY9I-WjiQ333ysUK.75 2024-09-14T11:58:38.816 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:38.818+0000 7fd5ad44a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.105__multipart_key1.2~FSwO5wOqwl0Xca1qY9I-WjiQ333ysUK.76 2024-09-14T11:58:38.816 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:38.818+0000 7fd5ad44a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.105__multipart_key1.2~FSwO5wOqwl0Xca1qY9I-WjiQ333ysUK.77 2024-09-14T11:58:38.816 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:38.818+0000 7fd5ad44a9c0 20 garbage collection: RGWGC::process iterating over entry tag='2~FSwO5wOqwl0Xca1qY9I-WjiQ333ysUK', time=2024-09-14T13:56:51.550416+0000, chain.objs.size()=6 2024-09-14T11:58:38.816 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:38.818+0000 7fd5ad44a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.105__multipart_key1.2~FSwO5wOqwl0Xca1qY9I-WjiQ333ysUK.78 2024-09-14T11:58:38.816 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:38.818+0000 7fd5ad44a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.105__multipart_key1.2~FSwO5wOqwl0Xca1qY9I-WjiQ333ysUK.79 2024-09-14T11:58:38.817 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:38.818+0000 7fd5ad44a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.105__multipart_key1.2~FSwO5wOqwl0Xca1qY9I-WjiQ333ysUK.80 2024-09-14T11:58:38.817 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:38.818+0000 7fd5ad44a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.105__multipart_key1.2~FSwO5wOqwl0Xca1qY9I-WjiQ333ysUK.81 2024-09-14T11:58:38.818 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:38.818+0000 7fd5ad44a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.105__multipart_key1.2~FSwO5wOqwl0Xca1qY9I-WjiQ333ysUK.82 2024-09-14T11:58:38.818 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:38.818+0000 7fd5ad44a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.105__multipart_key1.2~FSwO5wOqwl0Xca1qY9I-WjiQ333ysUK.83 2024-09-14T11:58:38.818 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:38.818+0000 7fd5ad44a9c0 20 garbage collection: RGWGC::process iterating over entry tag='2~FSwO5wOqwl0Xca1qY9I-WjiQ333ysUK', time=2024-09-14T13:56:53.609164+0000, chain.objs.size()=10 2024-09-14T11:58:38.818 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:38.818+0000 7fd5ad44a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.105__multipart_key1.2~FSwO5wOqwl0Xca1qY9I-WjiQ333ysUK.84 2024-09-14T11:58:38.818 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:38.818+0000 7fd5ad44a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.105__multipart_key1.2~FSwO5wOqwl0Xca1qY9I-WjiQ333ysUK.85 2024-09-14T11:58:38.818 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:38.818+0000 7fd5ad44a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.105__multipart_key1.2~FSwO5wOqwl0Xca1qY9I-WjiQ333ysUK.86 2024-09-14T11:58:38.819 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:38.822+0000 7fd5ad44a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.105__multipart_key1.2~FSwO5wOqwl0Xca1qY9I-WjiQ333ysUK.87 2024-09-14T11:58:38.822 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:38.822+0000 7fd5ad44a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.105__multipart_key1.2~FSwO5wOqwl0Xca1qY9I-WjiQ333ysUK.88 2024-09-14T11:58:38.822 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:38.822+0000 7fd5ad44a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.105__multipart_key1.2~FSwO5wOqwl0Xca1qY9I-WjiQ333ysUK.89 2024-09-14T11:58:38.822 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:38.826+0000 7fd5ad44a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.105__multipart_key1.2~FSwO5wOqwl0Xca1qY9I-WjiQ333ysUK.90 2024-09-14T11:58:38.822 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:38.826+0000 7fd5ad44a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.105__multipart_key1.2~FSwO5wOqwl0Xca1qY9I-WjiQ333ysUK.91 2024-09-14T11:58:38.822 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:38.826+0000 7fd5ad44a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.105__multipart_key1.2~FSwO5wOqwl0Xca1qY9I-WjiQ333ysUK.92 2024-09-14T11:58:38.822 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:38.826+0000 7fd5ad44a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.105__multipart_key1.2~FSwO5wOqwl0Xca1qY9I-WjiQ333ysUK.93 2024-09-14T11:58:38.823 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:38.826+0000 7fd5ad44a9c0 20 garbage collection: RGWGC::process iterating over entry tag='2~FSwO5wOqwl0Xca1qY9I-WjiQ333ysUK', time=2024-09-14T13:56:54.864047+0000, chain.objs.size()=6 2024-09-14T11:58:38.823 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:38.826+0000 7fd5ad44a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.105__multipart_key1.2~FSwO5wOqwl0Xca1qY9I-WjiQ333ysUK.94 2024-09-14T11:58:38.823 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:38.826+0000 7fd5ad44a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.105__multipart_key1.2~FSwO5wOqwl0Xca1qY9I-WjiQ333ysUK.95 2024-09-14T11:58:38.823 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:38.826+0000 7fd5ad44a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.105__multipart_key1.2~FSwO5wOqwl0Xca1qY9I-WjiQ333ysUK.96 2024-09-14T11:58:38.823 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:38.826+0000 7fd5ad44a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.105__multipart_key1.2~FSwO5wOqwl0Xca1qY9I-WjiQ333ysUK.97 2024-09-14T11:58:38.823 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:38.826+0000 7fd5ad44a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.105__multipart_key1.2~FSwO5wOqwl0Xca1qY9I-WjiQ333ysUK.98 2024-09-14T11:58:38.826 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:38.830+0000 7fd5ad44a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.105__multipart_key1.2~FSwO5wOqwl0Xca1qY9I-WjiQ333ysUK.99 2024-09-14T11:58:38.827 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:38.830+0000 7fd5ad44a9c0 20 garbage collection: RGWGC::process iterating over entry tag='2~FSwO5wOqwl0Xca1qY9I-WjiQ333ysUK', time=2024-09-14T13:56:56.200692+0000, chain.objs.size()=4 2024-09-14T11:58:38.827 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:38.830+0000 7fd5ad44a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.105__multipart_key1.2~FSwO5wOqwl0Xca1qY9I-WjiQ333ysUK.100 2024-09-14T11:58:38.827 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:38.830+0000 7fd5ad44a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.105__multipart_key1.2~FSwO5wOqwl0Xca1qY9I-WjiQ333ysUK.101 2024-09-14T11:58:38.827 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:38.830+0000 7fd5ad44a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.105__multipart_key1.2~FSwO5wOqwl0Xca1qY9I-WjiQ333ysUK.102 2024-09-14T11:58:38.827 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:38.830+0000 7fd5ad44a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.105__multipart_key1.2~FSwO5wOqwl0Xca1qY9I-WjiQ333ysUK.103 2024-09-14T11:58:38.827 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:38.830+0000 7fd5ad44a9c0 20 garbage collection: RGWGC::process iterating over entry tag='2~FSwO5wOqwl0Xca1qY9I-WjiQ333ysUK', time=2024-09-14T13:56:57.801052+0000, chain.objs.size()=7 2024-09-14T11:58:38.827 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:38.830+0000 7fd5ad44a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.105__multipart_key1.2~FSwO5wOqwl0Xca1qY9I-WjiQ333ysUK.104 2024-09-14T11:58:38.827 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:38.830+0000 7fd5ad44a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.105__multipart_key1.2~FSwO5wOqwl0Xca1qY9I-WjiQ333ysUK.105 2024-09-14T11:58:38.827 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:38.830+0000 7fd5ad44a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.105__multipart_key1.2~FSwO5wOqwl0Xca1qY9I-WjiQ333ysUK.106 2024-09-14T11:58:38.828 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:38.830+0000 7fd5ad44a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.105__multipart_key1.2~FSwO5wOqwl0Xca1qY9I-WjiQ333ysUK.107 2024-09-14T11:58:38.828 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:38.830+0000 7fd5ad44a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.105__multipart_key1.2~FSwO5wOqwl0Xca1qY9I-WjiQ333ysUK.108 2024-09-14T11:58:38.828 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:38.830+0000 7fd5ad44a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.105__multipart_key1.2~FSwO5wOqwl0Xca1qY9I-WjiQ333ysUK.109 2024-09-14T11:58:38.830 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:38.834+0000 7fd5ad44a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.105__multipart_key1.2~FSwO5wOqwl0Xca1qY9I-WjiQ333ysUK.110 2024-09-14T11:58:38.832 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:38.834+0000 7fd5ad44a9c0 20 garbage collection: RGWGC::process iterating over entry tag='2~FSwO5wOqwl0Xca1qY9I-WjiQ333ysUK', time=2024-09-14T13:56:59.389571+0000, chain.objs.size()=4 2024-09-14T11:58:38.832 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:38.834+0000 7fd5ad44a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.105__multipart_key1.2~FSwO5wOqwl0Xca1qY9I-WjiQ333ysUK.111 2024-09-14T11:58:38.832 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:38.834+0000 7fd5ad44a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.105__multipart_key1.2~FSwO5wOqwl0Xca1qY9I-WjiQ333ysUK.112 2024-09-14T11:58:38.832 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:38.834+0000 7fd5ad44a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.105__multipart_key1.2~FSwO5wOqwl0Xca1qY9I-WjiQ333ysUK.113 2024-09-14T11:58:38.832 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:38.834+0000 7fd5ad44a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.105__multipart_key1.2~FSwO5wOqwl0Xca1qY9I-WjiQ333ysUK.114 2024-09-14T11:58:38.832 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:38.834+0000 7fd5ad44a9c0 20 garbage collection: RGWGC::process iterating over entry tag='2~FSwO5wOqwl0Xca1qY9I-WjiQ333ysUK', time=2024-09-14T13:57:01.079095+0000, chain.objs.size()=10 2024-09-14T11:58:38.832 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:38.834+0000 7fd5ad44a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.105__multipart_key1.2~FSwO5wOqwl0Xca1qY9I-WjiQ333ysUK.115 2024-09-14T11:58:38.832 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:38.834+0000 7fd5ad44a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.105__multipart_key1.2~FSwO5wOqwl0Xca1qY9I-WjiQ333ysUK.116 2024-09-14T11:58:38.832 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:38.834+0000 7fd5ad44a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.105__multipart_key1.2~FSwO5wOqwl0Xca1qY9I-WjiQ333ysUK.117 2024-09-14T11:58:38.833 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:38.834+0000 7fd5ad44a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.105__multipart_key1.2~FSwO5wOqwl0Xca1qY9I-WjiQ333ysUK.118 2024-09-14T11:58:38.833 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:38.834+0000 7fd5ad44a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.105__multipart_key1.2~FSwO5wOqwl0Xca1qY9I-WjiQ333ysUK.119 2024-09-14T11:58:38.833 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:38.834+0000 7fd5ad44a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.105__multipart_key1.2~FSwO5wOqwl0Xca1qY9I-WjiQ333ysUK.120 2024-09-14T11:58:38.834 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:38.838+0000 7fd5ad44a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.105__multipart_key1.2~FSwO5wOqwl0Xca1qY9I-WjiQ333ysUK.121 2024-09-14T11:58:38.836 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:38.838+0000 7fd5ad44a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.105__multipart_key1.2~FSwO5wOqwl0Xca1qY9I-WjiQ333ysUK.122 2024-09-14T11:58:38.836 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:38.838+0000 7fd5ad44a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.105__multipart_key1.2~FSwO5wOqwl0Xca1qY9I-WjiQ333ysUK.123 2024-09-14T11:58:38.836 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:38.838+0000 7fd5ad44a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.105__multipart_key1.2~FSwO5wOqwl0Xca1qY9I-WjiQ333ysUK.124 2024-09-14T11:58:38.837 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:38.838+0000 7fd5ad44a9c0 20 garbage collection: RGWGC::process iterating over entry tag='2~FSwO5wOqwl0Xca1qY9I-WjiQ333ysUK', time=2024-09-14T13:57:02.636104+0000, chain.objs.size()=5 2024-09-14T11:58:38.837 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:38.838+0000 7fd5ad44a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.105__multipart_key1.2~FSwO5wOqwl0Xca1qY9I-WjiQ333ysUK.125 2024-09-14T11:58:38.837 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:38.838+0000 7fd5ad44a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.105__multipart_key1.2~FSwO5wOqwl0Xca1qY9I-WjiQ333ysUK.126 2024-09-14T11:58:38.837 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:38.838+0000 7fd5ad44a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.105__multipart_key1.2~FSwO5wOqwl0Xca1qY9I-WjiQ333ysUK.127 2024-09-14T11:58:38.837 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:38.838+0000 7fd5ad44a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.105__multipart_key1.2~FSwO5wOqwl0Xca1qY9I-WjiQ333ysUK.128 2024-09-14T11:58:38.837 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:38.838+0000 7fd5ad44a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.105__multipart_key1.2~FSwO5wOqwl0Xca1qY9I-WjiQ333ysUK.129 2024-09-14T11:58:38.837 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:38.838+0000 7fd5ad44a9c0 20 garbage collection: RGWGC::process iterating over entry tag='2~FSwO5wOqwl0Xca1qY9I-WjiQ333ysUK', time=2024-09-14T13:57:03.974684+0000, chain.objs.size()=6 2024-09-14T11:58:38.837 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:38.838+0000 7fd5ad44a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.105__multipart_key1.2~FSwO5wOqwl0Xca1qY9I-WjiQ333ysUK.130 2024-09-14T11:58:38.838 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:38.838+0000 7fd5ad44a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.105__multipart_key1.2~FSwO5wOqwl0Xca1qY9I-WjiQ333ysUK.131 2024-09-14T11:58:38.839 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:38.842+0000 7fd5ad44a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.105__multipart_key1.2~FSwO5wOqwl0Xca1qY9I-WjiQ333ysUK.132 2024-09-14T11:58:38.839 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:38.842+0000 7fd5ad44a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.105__multipart_key1.2~FSwO5wOqwl0Xca1qY9I-WjiQ333ysUK.133 2024-09-14T11:58:38.840 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:38.842+0000 7fd5ad44a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.105__multipart_key1.2~FSwO5wOqwl0Xca1qY9I-WjiQ333ysUK.134 2024-09-14T11:58:38.840 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:38.842+0000 7fd5ad44a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.105__multipart_key1.2~FSwO5wOqwl0Xca1qY9I-WjiQ333ysUK.137 2024-09-14T11:58:38.841 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:38.842+0000 7fd5ad44a9c0 20 garbage collection: RGWGC::process iterating over entry tag='2~FSwO5wOqwl0Xca1qY9I-WjiQ333ysUK', time=2024-09-14T13:57:05.360221+0000, chain.objs.size()=5 2024-09-14T11:58:38.841 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:38.842+0000 7fd5ad44a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.105__multipart_key1.2~FSwO5wOqwl0Xca1qY9I-WjiQ333ysUK.135 2024-09-14T11:58:38.841 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:38.842+0000 7fd5ad44a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.105__multipart_key1.2~FSwO5wOqwl0Xca1qY9I-WjiQ333ysUK.136 2024-09-14T11:58:38.841 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:38.842+0000 7fd5ad44a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.105__multipart_key1.2~FSwO5wOqwl0Xca1qY9I-WjiQ333ysUK.138 2024-09-14T11:58:38.842 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:38.842+0000 7fd5ad44a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.105__multipart_key1.2~FSwO5wOqwl0Xca1qY9I-WjiQ333ysUK.139 2024-09-14T11:58:38.844 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:38.846+0000 7fd5ad44a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.105__multipart_key1.2~FSwO5wOqwl0Xca1qY9I-WjiQ333ysUK.140 2024-09-14T11:58:38.844 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:38.846+0000 7fd5ad44a9c0 20 garbage collection: RGWGC::process iterating over entry tag='2~FSwO5wOqwl0Xca1qY9I-WjiQ333ysUK', time=2024-09-14T13:57:18.548877+0000, chain.objs.size()=1 2024-09-14T11:58:38.844 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:38.846+0000 7fd5ad44a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.105__multipart_key1.2~FSwO5wOqwl0Xca1qY9I-WjiQ333ysUK.12 2024-09-14T11:58:38.844 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:38.846+0000 7fd5ad44a9c0 20 garbage collection: RGWGC::process iterating over entry tag='2~FSwO5wOqwl0Xca1qY9I-WjiQ333ysUK', time=2024-09-14T13:57:18.921849+0000, chain.objs.size()=1 2024-09-14T11:58:38.844 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:38.846+0000 7fd5ad44a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.105__multipart_key1.2~FSwO5wOqwl0Xca1qY9I-WjiQ333ysUK.13 2024-09-14T11:58:38.845 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:38.846+0000 7fd5ad44a9c0 20 garbage collection: RGWGC::process iterating over entry tag='2~FSwO5wOqwl0Xca1qY9I-WjiQ333ysUK', time=2024-09-14T13:57:19.171314+0000, chain.objs.size()=1 2024-09-14T11:58:38.845 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:38.846+0000 7fd5ad44a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.105__multipart_key1.2~FSwO5wOqwl0Xca1qY9I-WjiQ333ysUK.14 2024-09-14T11:58:38.845 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:38.846+0000 7fd5ad44a9c0 20 garbage collection: RGWGC::process iterating over entry tag='2~FSwO5wOqwl0Xca1qY9I-WjiQ333ysUK', time=2024-09-14T13:57:19.627742+0000, chain.objs.size()=1 2024-09-14T11:58:38.845 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:38.846+0000 7fd5ad44a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.105__multipart_key1.2~FSwO5wOqwl0Xca1qY9I-WjiQ333ysUK.15 2024-09-14T11:58:38.845 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:38.846+0000 7fd5ad44a9c0 20 garbage collection: RGWGC::process iterating over entry tag='2~FSwO5wOqwl0Xca1qY9I-WjiQ333ysUK', time=2024-09-14T13:57:19.714988+0000, chain.objs.size()=1 2024-09-14T11:58:38.845 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:38.846+0000 7fd5ad44a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.105__multipart_key1.2~FSwO5wOqwl0Xca1qY9I-WjiQ333ysUK.16 2024-09-14T11:58:38.846 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:38.846+0000 7fd5ad44a9c0 20 garbage collection: RGWGC::process iterating over entry tag='2~FSwO5wOqwl0Xca1qY9I-WjiQ333ysUK', time=2024-09-14T13:57:20.300286+0000, chain.objs.size()=1 2024-09-14T11:58:38.846 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:38.846+0000 7fd5ad44a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.105__multipart_key1.2~FSwO5wOqwl0Xca1qY9I-WjiQ333ysUK.17 2024-09-14T11:58:38.846 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:38.846+0000 7fd5ad44a9c0 20 garbage collection: RGWGC::process iterating over entry tag='2~FSwO5wOqwl0Xca1qY9I-WjiQ333ysUK', time=2024-09-14T13:57:20.343346+0000, chain.objs.size()=1 2024-09-14T11:58:38.846 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:38.846+0000 7fd5ad44a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.105__multipart_key1.2~FSwO5wOqwl0Xca1qY9I-WjiQ333ysUK.18 2024-09-14T11:58:38.846 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:38.846+0000 7fd5ad44a9c0 20 garbage collection: RGWGC::process iterating over entry tag='2~FSwO5wOqwl0Xca1qY9I-WjiQ333ysUK', time=2024-09-14T13:57:20.499954+0000, chain.objs.size()=1 2024-09-14T11:58:38.846 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:38.846+0000 7fd5ad44a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.105__multipart_key1.2~FSwO5wOqwl0Xca1qY9I-WjiQ333ysUK.19 2024-09-14T11:58:38.846 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:38.846+0000 7fd5ad44a9c0 20 garbage collection: RGWGC::process iterating over entry tag='2~FSwO5wOqwl0Xca1qY9I-WjiQ333ysUK', time=2024-09-14T13:57:20.596460+0000, chain.objs.size()=1 2024-09-14T11:58:38.846 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:38.846+0000 7fd5ad44a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.105__multipart_key1.2~FSwO5wOqwl0Xca1qY9I-WjiQ333ysUK.20 2024-09-14T11:58:38.846 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:38.846+0000 7fd5ad44a9c0 20 garbage collection: RGWGC::process iterating over entry tag='2~FSwO5wOqwl0Xca1qY9I-WjiQ333ysUK', time=2024-09-14T13:57:20.869048+0000, chain.objs.size()=192 2024-09-14T11:58:38.846 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:38.846+0000 7fd5ad44a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.105__multipart_key1.2~FSwO5wOqwl0Xca1qY9I-WjiQ333ysUK.1 2024-09-14T11:58:38.848 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:38.850+0000 7fd5ad44a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.105__multipart_key1.2~FSwO5wOqwl0Xca1qY9I-WjiQ333ysUK.2 2024-09-14T11:58:38.848 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:38.850+0000 7fd5ad44a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.105__multipart_key1.2~FSwO5wOqwl0Xca1qY9I-WjiQ333ysUK.3 2024-09-14T11:58:38.848 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:38.850+0000 7fd5ad44a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.105__multipart_key1.2~FSwO5wOqwl0Xca1qY9I-WjiQ333ysUK.4 2024-09-14T11:58:38.848 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:38.850+0000 7fd5ad44a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.105__multipart_key1.2~FSwO5wOqwl0Xca1qY9I-WjiQ333ysUK.5 2024-09-14T11:58:38.848 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:38.850+0000 7fd5ad44a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.105__multipart_key1.2~FSwO5wOqwl0Xca1qY9I-WjiQ333ysUK.6 2024-09-14T11:58:38.849 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:38.850+0000 7fd5ad44a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.105__multipart_key1.2~FSwO5wOqwl0Xca1qY9I-WjiQ333ysUK.7 2024-09-14T11:58:38.849 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:38.850+0000 7fd5ad44a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.105__multipart_key1.2~FSwO5wOqwl0Xca1qY9I-WjiQ333ysUK.8 2024-09-14T11:58:38.849 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:38.850+0000 7fd5ad44a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.105__multipart_key1.2~FSwO5wOqwl0Xca1qY9I-WjiQ333ysUK.9 2024-09-14T11:58:38.849 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:38.850+0000 7fd5ad44a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.105__multipart_key1.2~FSwO5wOqwl0Xca1qY9I-WjiQ333ysUK.10 2024-09-14T11:58:38.849 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:38.850+0000 7fd5ad44a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.105__multipart_key1.2~FSwO5wOqwl0Xca1qY9I-WjiQ333ysUK.11 2024-09-14T11:58:38.851 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:38.854+0000 7fd5ad44a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.105__multipart_key1.nl5gDL2PIoBk2ZRxClnLZaVvtqwZOYYi.12 2024-09-14T11:58:38.851 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:38.854+0000 7fd5ad44a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.105__multipart_key1.anD-6eBxqYYgnvOo-AEdvmfEXf5LrO7u.13 2024-09-14T11:58:38.851 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:38.854+0000 7fd5ad44a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.105__multipart_key1.VTixSmS49m0BVZ-VHSktr4e8J7rXl4s_.14 2024-09-14T11:58:38.851 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:38.854+0000 7fd5ad44a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.105__multipart_key1.PLi5vgatVfjI3uFK1-ZbX3AhJrIZf3wl.15 2024-09-14T11:58:38.851 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:38.854+0000 7fd5ad44a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.105__multipart_key1.450mz9wKTRJvZTOvD5ZVOltYonPkLQgg.16 2024-09-14T11:58:38.851 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:38.854+0000 7fd5ad44a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.105__multipart_key1.dJpzvMrORWbK7x7J_MS9gLjuZu9Q5ySI.17 2024-09-14T11:58:38.851 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:38.854+0000 7fd5ad44a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.105__multipart_key1.HKX39eqtdDNXhhbISly9lYS7i46vtt3-.18 2024-09-14T11:58:38.851 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:38.854+0000 7fd5ad44a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.105__multipart_key1.QTX0Cjc4DMizWbVU3S_WEQIJz8kAHVp7.19 2024-09-14T11:58:38.852 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:38.854+0000 7fd5ad44a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.105__multipart_key1.WdQ7yCivrJxNnbPyRFp1bOqRoNJNREey.20 2024-09-14T11:58:38.852 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:38.854+0000 7fd5ad44a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.105__multipart_key1.2~FSwO5wOqwl0Xca1qY9I-WjiQ333ysUK.21 2024-09-14T11:58:38.852 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:38.854+0000 7fd5ad44a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.105__multipart_key1.2~FSwO5wOqwl0Xca1qY9I-WjiQ333ysUK.22 2024-09-14T11:58:38.853 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:38.854+0000 7fd5ad44a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.105__multipart_key1.2~FSwO5wOqwl0Xca1qY9I-WjiQ333ysUK.23 2024-09-14T11:58:38.854 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:38.854+0000 7fd5ad44a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.105__multipart_key1.2~FSwO5wOqwl0Xca1qY9I-WjiQ333ysUK.24 2024-09-14T11:58:38.854 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:38.854+0000 7fd5ad44a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.105__multipart_key1.2~FSwO5wOqwl0Xca1qY9I-WjiQ333ysUK.25 2024-09-14T11:58:38.854 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:38.854+0000 7fd5ad44a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.105__multipart_key1.2~FSwO5wOqwl0Xca1qY9I-WjiQ333ysUK.26 2024-09-14T11:58:38.854 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:38.854+0000 7fd5ad44a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.105__multipart_key1.2~FSwO5wOqwl0Xca1qY9I-WjiQ333ysUK.27 2024-09-14T11:58:38.854 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:38.854+0000 7fd5ad44a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.105__multipart_key1.2~FSwO5wOqwl0Xca1qY9I-WjiQ333ysUK.28 2024-09-14T11:58:38.854 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:38.854+0000 7fd5ad44a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.105__multipart_key1.2~FSwO5wOqwl0Xca1qY9I-WjiQ333ysUK.29 2024-09-14T11:58:38.854 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:38.854+0000 7fd5ad44a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.105__multipart_key1.2~FSwO5wOqwl0Xca1qY9I-WjiQ333ysUK.30 2024-09-14T11:58:38.854 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:38.854+0000 7fd5ad44a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.105__multipart_key1.2~FSwO5wOqwl0Xca1qY9I-WjiQ333ysUK.31 2024-09-14T11:58:38.855 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:38.854+0000 7fd5ad44a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.105__multipart_key1.2~FSwO5wOqwl0Xca1qY9I-WjiQ333ysUK.32 2024-09-14T11:58:38.855 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:38.858+0000 7fd5ad44a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.105__multipart_key1.2~FSwO5wOqwl0Xca1qY9I-WjiQ333ysUK.33 2024-09-14T11:58:38.855 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:38.858+0000 7fd5ad44a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.105__multipart_key1.2~FSwO5wOqwl0Xca1qY9I-WjiQ333ysUK.34 2024-09-14T11:58:38.857 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:38.858+0000 7fd5ad44a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.105__multipart_key1.2~FSwO5wOqwl0Xca1qY9I-WjiQ333ysUK.35 2024-09-14T11:58:38.857 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:38.858+0000 7fd5ad44a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.105__multipart_key1.2~FSwO5wOqwl0Xca1qY9I-WjiQ333ysUK.36 2024-09-14T11:58:38.857 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:38.858+0000 7fd5ad44a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.105__multipart_key1.2~FSwO5wOqwl0Xca1qY9I-WjiQ333ysUK.37 2024-09-14T11:58:38.857 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:38.858+0000 7fd5ad44a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.105__multipart_key1.2~FSwO5wOqwl0Xca1qY9I-WjiQ333ysUK.38 2024-09-14T11:58:38.857 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:38.858+0000 7fd5ad44a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.105__multipart_key1.2~FSwO5wOqwl0Xca1qY9I-WjiQ333ysUK.39 2024-09-14T11:58:38.857 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:38.858+0000 7fd5ad44a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.105__multipart_key1.2~FSwO5wOqwl0Xca1qY9I-WjiQ333ysUK.40 2024-09-14T11:58:38.857 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:38.858+0000 7fd5ad44a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.105__multipart_key1.2~FSwO5wOqwl0Xca1qY9I-WjiQ333ysUK.41 2024-09-14T11:58:38.857 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:38.858+0000 7fd5ad44a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.105__multipart_key1.2~FSwO5wOqwl0Xca1qY9I-WjiQ333ysUK.42 2024-09-14T11:58:38.857 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:38.858+0000 7fd5ad44a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.105__multipart_key1.2~FSwO5wOqwl0Xca1qY9I-WjiQ333ysUK.43 2024-09-14T11:58:38.857 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:38.858+0000 7fd5ad44a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.105__multipart_key1.2~FSwO5wOqwl0Xca1qY9I-WjiQ333ysUK.44 2024-09-14T11:58:38.858 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:38.858+0000 7fd5ad44a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.105__multipart_key1.2~FSwO5wOqwl0Xca1qY9I-WjiQ333ysUK.45 2024-09-14T11:58:38.858 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:38.862+0000 7fd5ad44a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.105__multipart_key1.2~FSwO5wOqwl0Xca1qY9I-WjiQ333ysUK.46 2024-09-14T11:58:38.859 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:38.862+0000 7fd5ad44a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.105__multipart_key1.2~FSwO5wOqwl0Xca1qY9I-WjiQ333ysUK.47 2024-09-14T11:58:38.860 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:38.862+0000 7fd5ad44a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.105__multipart_key1.2~FSwO5wOqwl0Xca1qY9I-WjiQ333ysUK.48 2024-09-14T11:58:38.860 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:38.862+0000 7fd5ad44a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.105__multipart_key1.2~FSwO5wOqwl0Xca1qY9I-WjiQ333ysUK.49 2024-09-14T11:58:38.860 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:38.862+0000 7fd5ad44a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.105__multipart_key1.2~FSwO5wOqwl0Xca1qY9I-WjiQ333ysUK.50 2024-09-14T11:58:38.860 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:38.862+0000 7fd5ad44a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.105__multipart_key1.2~FSwO5wOqwl0Xca1qY9I-WjiQ333ysUK.51 2024-09-14T11:58:38.860 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:38.862+0000 7fd5ad44a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.105__multipart_key1.2~FSwO5wOqwl0Xca1qY9I-WjiQ333ysUK.52 2024-09-14T11:58:38.860 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:38.862+0000 7fd5ad44a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.105__multipart_key1.2~FSwO5wOqwl0Xca1qY9I-WjiQ333ysUK.53 2024-09-14T11:58:38.860 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:38.862+0000 7fd5ad44a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.105__multipart_key1.2~FSwO5wOqwl0Xca1qY9I-WjiQ333ysUK.54 2024-09-14T11:58:38.860 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:38.862+0000 7fd5ad44a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.105__multipart_key1.2~FSwO5wOqwl0Xca1qY9I-WjiQ333ysUK.55 2024-09-14T11:58:38.860 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:38.862+0000 7fd5ad44a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.105__multipart_key1.2~FSwO5wOqwl0Xca1qY9I-WjiQ333ysUK.56 2024-09-14T11:58:38.861 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:38.862+0000 7fd5ad44a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.105__multipart_key1.2~FSwO5wOqwl0Xca1qY9I-WjiQ333ysUK.57 2024-09-14T11:58:38.862 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:38.862+0000 7fd5ad44a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.105__multipart_key1.2~FSwO5wOqwl0Xca1qY9I-WjiQ333ysUK.58 2024-09-14T11:58:38.862 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:38.862+0000 7fd5ad44a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.105__multipart_key1.2~FSwO5wOqwl0Xca1qY9I-WjiQ333ysUK.59 2024-09-14T11:58:38.862 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:38.866+0000 7fd5ad44a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.105__multipart_key1.2~FSwO5wOqwl0Xca1qY9I-WjiQ333ysUK.60 2024-09-14T11:58:38.862 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:38.866+0000 7fd5ad44a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.105__multipart_key1.2~FSwO5wOqwl0Xca1qY9I-WjiQ333ysUK.61 2024-09-14T11:58:38.863 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:38.866+0000 7fd5ad44a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.105__multipart_key1.2~FSwO5wOqwl0Xca1qY9I-WjiQ333ysUK.62 2024-09-14T11:58:38.863 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:38.866+0000 7fd5ad44a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.105__multipart_key1.2~FSwO5wOqwl0Xca1qY9I-WjiQ333ysUK.63 2024-09-14T11:58:38.863 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:38.866+0000 7fd5ad44a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.105__multipart_key1.2~FSwO5wOqwl0Xca1qY9I-WjiQ333ysUK.64 2024-09-14T11:58:38.863 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:38.866+0000 7fd5ad44a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.105__multipart_key1.2~FSwO5wOqwl0Xca1qY9I-WjiQ333ysUK.65 2024-09-14T11:58:38.863 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:38.866+0000 7fd5ad44a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.105__multipart_key1.2~FSwO5wOqwl0Xca1qY9I-WjiQ333ysUK.66 2024-09-14T11:58:38.863 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:38.866+0000 7fd5ad44a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.105__multipart_key1.2~FSwO5wOqwl0Xca1qY9I-WjiQ333ysUK.67 2024-09-14T11:58:38.863 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:38.866+0000 7fd5ad44a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.105__multipart_key1.2~FSwO5wOqwl0Xca1qY9I-WjiQ333ysUK.68 2024-09-14T11:58:38.864 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:38.866+0000 7fd5ad44a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.105__multipart_key1.2~FSwO5wOqwl0Xca1qY9I-WjiQ333ysUK.69 2024-09-14T11:58:38.864 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:38.866+0000 7fd5ad44a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.105__multipart_key1.2~FSwO5wOqwl0Xca1qY9I-WjiQ333ysUK.70 2024-09-14T11:58:38.865 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:38.866+0000 7fd5ad44a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.105__multipart_key1.2~FSwO5wOqwl0Xca1qY9I-WjiQ333ysUK.71 2024-09-14T11:58:38.865 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:38.866+0000 7fd5ad44a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.105__multipart_key1.2~FSwO5wOqwl0Xca1qY9I-WjiQ333ysUK.72 2024-09-14T11:58:38.865 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:38.866+0000 7fd5ad44a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.105__multipart_key1.2~FSwO5wOqwl0Xca1qY9I-WjiQ333ysUK.73 2024-09-14T11:58:38.866 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:38.870+0000 7fd5ad44a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.105__multipart_key1.2~FSwO5wOqwl0Xca1qY9I-WjiQ333ysUK.74 2024-09-14T11:58:38.866 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:38.870+0000 7fd5ad44a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.105__multipart_key1.2~FSwO5wOqwl0Xca1qY9I-WjiQ333ysUK.75 2024-09-14T11:58:38.866 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:38.870+0000 7fd5ad44a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.105__multipart_key1.2~FSwO5wOqwl0Xca1qY9I-WjiQ333ysUK.76 2024-09-14T11:58:38.867 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:38.870+0000 7fd5ad44a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.105__multipart_key1.2~FSwO5wOqwl0Xca1qY9I-WjiQ333ysUK.77 2024-09-14T11:58:38.867 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:38.870+0000 7fd5ad44a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.105__multipart_key1.2~FSwO5wOqwl0Xca1qY9I-WjiQ333ysUK.78 2024-09-14T11:58:38.867 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:38.870+0000 7fd5ad44a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.105__multipart_key1.2~FSwO5wOqwl0Xca1qY9I-WjiQ333ysUK.79 2024-09-14T11:58:38.867 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:38.870+0000 7fd5ad44a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.105__multipart_key1.2~FSwO5wOqwl0Xca1qY9I-WjiQ333ysUK.80 2024-09-14T11:58:38.867 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:38.870+0000 7fd5ad44a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.105__multipart_key1.2~FSwO5wOqwl0Xca1qY9I-WjiQ333ysUK.81 2024-09-14T11:58:38.867 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:38.870+0000 7fd5ad44a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.105__multipart_key1.2~FSwO5wOqwl0Xca1qY9I-WjiQ333ysUK.82 2024-09-14T11:58:38.867 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:38.870+0000 7fd5ad44a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.105__multipart_key1.2~FSwO5wOqwl0Xca1qY9I-WjiQ333ysUK.83 2024-09-14T11:58:38.868 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:38.870+0000 7fd5ad44a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.105__multipart_key1.2~FSwO5wOqwl0Xca1qY9I-WjiQ333ysUK.84 2024-09-14T11:58:38.869 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:38.870+0000 7fd5ad44a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.105__multipart_key1.2~FSwO5wOqwl0Xca1qY9I-WjiQ333ysUK.85 2024-09-14T11:58:38.869 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:38.870+0000 7fd5ad44a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.105__multipart_key1.2~FSwO5wOqwl0Xca1qY9I-WjiQ333ysUK.86 2024-09-14T11:58:38.870 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:38.870+0000 7fd5ad44a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.105__multipart_key1.2~FSwO5wOqwl0Xca1qY9I-WjiQ333ysUK.87 2024-09-14T11:58:38.870 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:38.870+0000 7fd5ad44a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.105__multipart_key1.2~FSwO5wOqwl0Xca1qY9I-WjiQ333ysUK.88 2024-09-14T11:58:38.870 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:38.870+0000 7fd5ad44a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.105__multipart_key1.2~FSwO5wOqwl0Xca1qY9I-WjiQ333ysUK.89 2024-09-14T11:58:38.870 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:38.870+0000 7fd5ad44a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.105__multipart_key1.2~FSwO5wOqwl0Xca1qY9I-WjiQ333ysUK.90 2024-09-14T11:58:38.870 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:38.870+0000 7fd5ad44a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.105__multipart_key1.2~FSwO5wOqwl0Xca1qY9I-WjiQ333ysUK.91 2024-09-14T11:58:38.870 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:38.870+0000 7fd5ad44a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.105__multipart_key1.2~FSwO5wOqwl0Xca1qY9I-WjiQ333ysUK.92 2024-09-14T11:58:38.870 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:38.870+0000 7fd5ad44a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.105__multipart_key1.2~FSwO5wOqwl0Xca1qY9I-WjiQ333ysUK.93 2024-09-14T11:58:38.870 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:38.870+0000 7fd5ad44a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.105__multipart_key1.2~FSwO5wOqwl0Xca1qY9I-WjiQ333ysUK.94 2024-09-14T11:58:38.870 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:38.870+0000 7fd5ad44a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.105__multipart_key1.2~FSwO5wOqwl0Xca1qY9I-WjiQ333ysUK.95 2024-09-14T11:58:38.871 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:38.874+0000 7fd5ad44a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.105__multipart_key1.2~FSwO5wOqwl0Xca1qY9I-WjiQ333ysUK.96 2024-09-14T11:58:38.871 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:38.874+0000 7fd5ad44a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.105__multipart_key1.2~FSwO5wOqwl0Xca1qY9I-WjiQ333ysUK.97 2024-09-14T11:58:38.871 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:38.874+0000 7fd5ad44a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.105__multipart_key1.2~FSwO5wOqwl0Xca1qY9I-WjiQ333ysUK.98 2024-09-14T11:58:38.872 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:38.874+0000 7fd5ad44a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.105__multipart_key1.2~FSwO5wOqwl0Xca1qY9I-WjiQ333ysUK.99 2024-09-14T11:58:38.872 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:38.874+0000 7fd5ad44a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.105__multipart_key1.2~FSwO5wOqwl0Xca1qY9I-WjiQ333ysUK.100 2024-09-14T11:58:38.872 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:38.874+0000 7fd5ad44a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.105__multipart_key1.2~FSwO5wOqwl0Xca1qY9I-WjiQ333ysUK.101 2024-09-14T11:58:38.872 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:38.874+0000 7fd5ad44a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.105__multipart_key1.2~FSwO5wOqwl0Xca1qY9I-WjiQ333ysUK.102 2024-09-14T11:58:38.873 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:38.874+0000 7fd5ad44a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.105__multipart_key1.2~FSwO5wOqwl0Xca1qY9I-WjiQ333ysUK.103 2024-09-14T11:58:38.873 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:38.874+0000 7fd5ad44a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.105__multipart_key1.2~FSwO5wOqwl0Xca1qY9I-WjiQ333ysUK.104 2024-09-14T11:58:38.873 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:38.874+0000 7fd5ad44a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.105__multipart_key1.2~FSwO5wOqwl0Xca1qY9I-WjiQ333ysUK.105 2024-09-14T11:58:38.873 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:38.874+0000 7fd5ad44a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.105__multipart_key1.2~FSwO5wOqwl0Xca1qY9I-WjiQ333ysUK.106 2024-09-14T11:58:38.874 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:38.878+0000 7fd5ad44a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.105__multipart_key1.2~FSwO5wOqwl0Xca1qY9I-WjiQ333ysUK.107 2024-09-14T11:58:38.874 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:38.878+0000 7fd5ad44a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.105__multipart_key1.2~FSwO5wOqwl0Xca1qY9I-WjiQ333ysUK.108 2024-09-14T11:58:38.874 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:38.878+0000 7fd5ad44a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.105__multipart_key1.2~FSwO5wOqwl0Xca1qY9I-WjiQ333ysUK.109 2024-09-14T11:58:38.875 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:38.878+0000 7fd5ad44a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.105__multipart_key1.2~FSwO5wOqwl0Xca1qY9I-WjiQ333ysUK.110 2024-09-14T11:58:38.875 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:38.878+0000 7fd5ad44a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.105__multipart_key1.2~FSwO5wOqwl0Xca1qY9I-WjiQ333ysUK.111 2024-09-14T11:58:38.875 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:38.878+0000 7fd5ad44a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.105__multipart_key1.2~FSwO5wOqwl0Xca1qY9I-WjiQ333ysUK.112 2024-09-14T11:58:38.875 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:38.878+0000 7fd5ad44a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.105__multipart_key1.2~FSwO5wOqwl0Xca1qY9I-WjiQ333ysUK.113 2024-09-14T11:58:38.875 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:38.878+0000 7fd5ad44a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.105__multipart_key1.2~FSwO5wOqwl0Xca1qY9I-WjiQ333ysUK.114 2024-09-14T11:58:38.875 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:38.878+0000 7fd5ad44a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.105__multipart_key1.2~FSwO5wOqwl0Xca1qY9I-WjiQ333ysUK.115 2024-09-14T11:58:38.875 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:38.878+0000 7fd5ad44a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.105__multipart_key1.2~FSwO5wOqwl0Xca1qY9I-WjiQ333ysUK.116 2024-09-14T11:58:38.875 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:38.878+0000 7fd5ad44a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.105__multipart_key1.2~FSwO5wOqwl0Xca1qY9I-WjiQ333ysUK.117 2024-09-14T11:58:38.876 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:38.878+0000 7fd5ad44a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.105__multipart_key1.2~FSwO5wOqwl0Xca1qY9I-WjiQ333ysUK.118 2024-09-14T11:58:38.876 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:38.878+0000 7fd5ad44a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.105__multipart_key1.2~FSwO5wOqwl0Xca1qY9I-WjiQ333ysUK.119 2024-09-14T11:58:38.877 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:38.878+0000 7fd5ad44a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.105__multipart_key1.2~FSwO5wOqwl0Xca1qY9I-WjiQ333ysUK.120 2024-09-14T11:58:38.878 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:38.878+0000 7fd5ad44a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.105__multipart_key1.2~FSwO5wOqwl0Xca1qY9I-WjiQ333ysUK.121 2024-09-14T11:58:38.878 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:38.878+0000 7fd5ad44a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.105__multipart_key1.2~FSwO5wOqwl0Xca1qY9I-WjiQ333ysUK.122 2024-09-14T11:58:38.878 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:38.878+0000 7fd5ad44a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.105__multipart_key1.2~FSwO5wOqwl0Xca1qY9I-WjiQ333ysUK.123 2024-09-14T11:58:38.878 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:38.882+0000 7fd5ad44a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.105__multipart_key1.2~FSwO5wOqwl0Xca1qY9I-WjiQ333ysUK.124 2024-09-14T11:58:38.878 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:38.882+0000 7fd5ad44a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.105__multipart_key1.2~FSwO5wOqwl0Xca1qY9I-WjiQ333ysUK.125 2024-09-14T11:58:38.878 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:38.882+0000 7fd5ad44a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.105__multipart_key1.2~FSwO5wOqwl0Xca1qY9I-WjiQ333ysUK.126 2024-09-14T11:58:38.878 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:38.882+0000 7fd5ad44a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.105__multipart_key1.2~FSwO5wOqwl0Xca1qY9I-WjiQ333ysUK.127 2024-09-14T11:58:38.878 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:38.882+0000 7fd5ad44a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.105__multipart_key1.2~FSwO5wOqwl0Xca1qY9I-WjiQ333ysUK.128 2024-09-14T11:58:38.879 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:38.882+0000 7fd5ad44a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.105__multipart_key1.2~FSwO5wOqwl0Xca1qY9I-WjiQ333ysUK.129 2024-09-14T11:58:38.879 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:38.882+0000 7fd5ad44a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.105__multipart_key1.2~FSwO5wOqwl0Xca1qY9I-WjiQ333ysUK.130 2024-09-14T11:58:38.879 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:38.882+0000 7fd5ad44a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.105__multipart_key1.2~FSwO5wOqwl0Xca1qY9I-WjiQ333ysUK.131 2024-09-14T11:58:38.881 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:38.882+0000 7fd5ad44a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.105__multipart_key1.2~FSwO5wOqwl0Xca1qY9I-WjiQ333ysUK.132 2024-09-14T11:58:38.881 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:38.882+0000 7fd5ad44a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.105__multipart_key1.2~FSwO5wOqwl0Xca1qY9I-WjiQ333ysUK.133 2024-09-14T11:58:38.881 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:38.882+0000 7fd5ad44a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.105__multipart_key1.2~FSwO5wOqwl0Xca1qY9I-WjiQ333ysUK.134 2024-09-14T11:58:38.881 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:38.882+0000 7fd5ad44a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.105__multipart_key1.2~FSwO5wOqwl0Xca1qY9I-WjiQ333ysUK.135 2024-09-14T11:58:38.882 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:38.882+0000 7fd5ad44a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.105__multipart_key1.2~FSwO5wOqwl0Xca1qY9I-WjiQ333ysUK.136 2024-09-14T11:58:38.882 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:38.882+0000 7fd5ad44a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.105__multipart_key1.2~FSwO5wOqwl0Xca1qY9I-WjiQ333ysUK.137 2024-09-14T11:58:38.882 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:38.882+0000 7fd5ad44a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.105__multipart_key1.2~FSwO5wOqwl0Xca1qY9I-WjiQ333ysUK.138 2024-09-14T11:58:38.882 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:38.882+0000 7fd5ad44a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.105__multipart_key1.2~FSwO5wOqwl0Xca1qY9I-WjiQ333ysUK.139 2024-09-14T11:58:38.882 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:38.882+0000 7fd5ad44a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.105__multipart_key1.2~FSwO5wOqwl0Xca1qY9I-WjiQ333ysUK.140 2024-09-14T11:58:38.882 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:38.882+0000 7fd5ad44a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.105__multipart_key1.2~FSwO5wOqwl0Xca1qY9I-WjiQ333ysUK.141 2024-09-14T11:58:38.882 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:38.882+0000 7fd5ad44a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.105__multipart_key1.2~FSwO5wOqwl0Xca1qY9I-WjiQ333ysUK.142 2024-09-14T11:58:38.884 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:38.886+0000 7fd5ad44a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.105__multipart_key1.2~FSwO5wOqwl0Xca1qY9I-WjiQ333ysUK.143 2024-09-14T11:58:38.884 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:38.886+0000 7fd5ad44a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.105__multipart_key1.2~FSwO5wOqwl0Xca1qY9I-WjiQ333ysUK.144 2024-09-14T11:58:38.884 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:38.886+0000 7fd5ad44a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.105__multipart_key1.2~FSwO5wOqwl0Xca1qY9I-WjiQ333ysUK.145 2024-09-14T11:58:38.884 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:38.886+0000 7fd5ad44a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.105__multipart_key1.2~FSwO5wOqwl0Xca1qY9I-WjiQ333ysUK.146 2024-09-14T11:58:38.884 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:38.886+0000 7fd5ad44a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.105__multipart_key1.2~FSwO5wOqwl0Xca1qY9I-WjiQ333ysUK.147 2024-09-14T11:58:38.884 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:38.886+0000 7fd5ad44a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.105__multipart_key1.2~FSwO5wOqwl0Xca1qY9I-WjiQ333ysUK.148 2024-09-14T11:58:38.884 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:38.886+0000 7fd5ad44a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.105__multipart_key1.2~FSwO5wOqwl0Xca1qY9I-WjiQ333ysUK.149 2024-09-14T11:58:38.884 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:38.886+0000 7fd5ad44a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.105__multipart_key1.2~FSwO5wOqwl0Xca1qY9I-WjiQ333ysUK.150 2024-09-14T11:58:38.885 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:38.886+0000 7fd5ad44a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.105__multipart_key1.2~FSwO5wOqwl0Xca1qY9I-WjiQ333ysUK.151 2024-09-14T11:58:38.885 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:38.886+0000 7fd5ad44a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.105__multipart_key1.2~FSwO5wOqwl0Xca1qY9I-WjiQ333ysUK.152 2024-09-14T11:58:38.885 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:38.886+0000 7fd5ad44a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.105__multipart_key1.2~FSwO5wOqwl0Xca1qY9I-WjiQ333ysUK.153 2024-09-14T11:58:38.889 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:38.890+0000 7fd5ad44a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.105__multipart_key1.2~FSwO5wOqwl0Xca1qY9I-WjiQ333ysUK.154 2024-09-14T11:58:38.889 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:38.890+0000 7fd5ad44a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.105__multipart_key1.2~FSwO5wOqwl0Xca1qY9I-WjiQ333ysUK.155 2024-09-14T11:58:38.889 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:38.890+0000 7fd5ad44a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.105__multipart_key1.2~FSwO5wOqwl0Xca1qY9I-WjiQ333ysUK.156 2024-09-14T11:58:38.889 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:38.890+0000 7fd5ad44a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.105__multipart_key1.2~FSwO5wOqwl0Xca1qY9I-WjiQ333ysUK.157 2024-09-14T11:58:38.889 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:38.890+0000 7fd5ad44a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.105__multipart_key1.2~FSwO5wOqwl0Xca1qY9I-WjiQ333ysUK.158 2024-09-14T11:58:38.889 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:38.890+0000 7fd5ad44a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.105__multipart_key1.2~FSwO5wOqwl0Xca1qY9I-WjiQ333ysUK.159 2024-09-14T11:58:38.889 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:38.890+0000 7fd5ad44a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.105__multipart_key1.2~FSwO5wOqwl0Xca1qY9I-WjiQ333ysUK.160 2024-09-14T11:58:38.889 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:38.890+0000 7fd5ad44a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.105__multipart_key1.2~FSwO5wOqwl0Xca1qY9I-WjiQ333ysUK.161 2024-09-14T11:58:38.889 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:38.890+0000 7fd5ad44a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.105__multipart_key1.2~FSwO5wOqwl0Xca1qY9I-WjiQ333ysUK.162 2024-09-14T11:58:38.890 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:38.890+0000 7fd5ad44a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.105__multipart_key1.2~FSwO5wOqwl0Xca1qY9I-WjiQ333ysUK.163 2024-09-14T11:58:38.890 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:38.890+0000 7fd5ad44a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.105__multipart_key1.2~FSwO5wOqwl0Xca1qY9I-WjiQ333ysUK.164 2024-09-14T11:58:38.892 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:38.894+0000 7fd5ad44a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.105__multipart_key1.2~FSwO5wOqwl0Xca1qY9I-WjiQ333ysUK.165 2024-09-14T11:58:38.892 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:38.894+0000 7fd5ad44a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.105__multipart_key1.2~FSwO5wOqwl0Xca1qY9I-WjiQ333ysUK.166 2024-09-14T11:58:38.892 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:38.894+0000 7fd5ad44a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.105__multipart_key1.2~FSwO5wOqwl0Xca1qY9I-WjiQ333ysUK.167 2024-09-14T11:58:38.893 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:38.894+0000 7fd5ad44a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.105__multipart_key1.2~FSwO5wOqwl0Xca1qY9I-WjiQ333ysUK.168 2024-09-14T11:58:38.893 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:38.894+0000 7fd5ad44a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.105__multipart_key1.2~FSwO5wOqwl0Xca1qY9I-WjiQ333ysUK.169 2024-09-14T11:58:38.893 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:38.894+0000 7fd5ad44a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.105__multipart_key1.2~FSwO5wOqwl0Xca1qY9I-WjiQ333ysUK.170 2024-09-14T11:58:38.894 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:38.898+0000 7fd5ad44a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.105__multipart_key1.2~FSwO5wOqwl0Xca1qY9I-WjiQ333ysUK.171 2024-09-14T11:58:38.894 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:38.898+0000 7fd5ad44a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.105__multipart_key1.2~FSwO5wOqwl0Xca1qY9I-WjiQ333ysUK.172 2024-09-14T11:58:38.895 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:38.898+0000 7fd5ad44a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.105__multipart_key1.2~FSwO5wOqwl0Xca1qY9I-WjiQ333ysUK.173 2024-09-14T11:58:38.895 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:38.898+0000 7fd5ad44a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.105__multipart_key1.2~FSwO5wOqwl0Xca1qY9I-WjiQ333ysUK.174 2024-09-14T11:58:38.895 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:38.898+0000 7fd5ad44a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.105__multipart_key1.2~FSwO5wOqwl0Xca1qY9I-WjiQ333ysUK.175 2024-09-14T11:58:38.898 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:38.898+0000 7fd5ad44a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.105__multipart_key1.2~FSwO5wOqwl0Xca1qY9I-WjiQ333ysUK.176 2024-09-14T11:58:38.898 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:38.898+0000 7fd5ad44a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.105__multipart_key1.2~FSwO5wOqwl0Xca1qY9I-WjiQ333ysUK.177 2024-09-14T11:58:38.898 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:38.898+0000 7fd5ad44a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.105__multipart_key1.2~FSwO5wOqwl0Xca1qY9I-WjiQ333ysUK.178 2024-09-14T11:58:38.898 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:38.898+0000 7fd5ad44a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.105__multipart_key1.2~FSwO5wOqwl0Xca1qY9I-WjiQ333ysUK.179 2024-09-14T11:58:38.898 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:38.898+0000 7fd5ad44a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.105__multipart_key1.2~FSwO5wOqwl0Xca1qY9I-WjiQ333ysUK.180 2024-09-14T11:58:38.898 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:38.898+0000 7fd5ad44a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.105__multipart_key1.2~FSwO5wOqwl0Xca1qY9I-WjiQ333ysUK.181 2024-09-14T11:58:38.898 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:38.898+0000 7fd5ad44a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.105__multipart_key1.2~FSwO5wOqwl0Xca1qY9I-WjiQ333ysUK.182 2024-09-14T11:58:38.900 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:38.902+0000 7fd5ad44a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.105__multipart_key1.2~FSwO5wOqwl0Xca1qY9I-WjiQ333ysUK.183 2024-09-14T11:58:38.900 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:38.902+0000 7fd5ad44a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.105__multipart_key1.2~FSwO5wOqwl0Xca1qY9I-WjiQ333ysUK.184 2024-09-14T11:58:38.900 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:38.902+0000 7fd5ad44a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.105__multipart_key1.2~FSwO5wOqwl0Xca1qY9I-WjiQ333ysUK.185 2024-09-14T11:58:38.900 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:38.902+0000 7fd5ad44a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.105__multipart_key1.2~FSwO5wOqwl0Xca1qY9I-WjiQ333ysUK.186 2024-09-14T11:58:38.902 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:38.902+0000 7fd5ad44a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.105__multipart_key1.2~FSwO5wOqwl0Xca1qY9I-WjiQ333ysUK.187 2024-09-14T11:58:38.902 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:38.906+0000 7fd5ad44a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.105__multipart_key1.2~FSwO5wOqwl0Xca1qY9I-WjiQ333ysUK.188 2024-09-14T11:58:38.903 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:38.906+0000 7fd5ad44a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.105__multipart_key1.2~FSwO5wOqwl0Xca1qY9I-WjiQ333ysUK.189 2024-09-14T11:58:38.903 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:38.906+0000 7fd5ad44a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.105__multipart_key1.2~FSwO5wOqwl0Xca1qY9I-WjiQ333ysUK.190 2024-09-14T11:58:38.903 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:38.906+0000 7fd5ad44a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.105__multipart_key1.2~FSwO5wOqwl0Xca1qY9I-WjiQ333ysUK.191 2024-09-14T11:58:38.903 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:38.906+0000 7fd5ad44a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.105__multipart_key1.2~FSwO5wOqwl0Xca1qY9I-WjiQ333ysUK.192 2024-09-14T11:58:38.903 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:38.906+0000 7fd5ad44a9c0 20 garbage collection: RGWGC::process iterating over entry tag='2~FSwO5wOqwl0Xca1qY9I-WjiQ333ysUK', time=2024-09-14T13:57:21.862742+0000, chain.objs.size()=17 2024-09-14T11:58:38.903 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:38.906+0000 7fd5ad44a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.105__multipart_key1.2~FSwO5wOqwl0Xca1qY9I-WjiQ333ysUK.193 2024-09-14T11:58:38.903 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:38.906+0000 7fd5ad44a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.105__multipart_key1.2~FSwO5wOqwl0Xca1qY9I-WjiQ333ysUK.194 2024-09-14T11:58:38.903 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:38.906+0000 7fd5ad44a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.105__multipart_key1.2~FSwO5wOqwl0Xca1qY9I-WjiQ333ysUK.195 2024-09-14T11:58:38.904 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:38.906+0000 7fd5ad44a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.105__multipart_key1.2~FSwO5wOqwl0Xca1qY9I-WjiQ333ysUK.196 2024-09-14T11:58:38.904 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:38.906+0000 7fd5ad44a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.105__multipart_key1.2~FSwO5wOqwl0Xca1qY9I-WjiQ333ysUK.197 2024-09-14T11:58:38.906 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:38.910+0000 7fd5ad44a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.105__multipart_key1.2~FSwO5wOqwl0Xca1qY9I-WjiQ333ysUK.198 2024-09-14T11:58:38.906 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:38.910+0000 7fd5ad44a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.105__multipart_key1.2~FSwO5wOqwl0Xca1qY9I-WjiQ333ysUK.199 2024-09-14T11:58:38.907 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:38.910+0000 7fd5ad44a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.105__multipart_key1.2~FSwO5wOqwl0Xca1qY9I-WjiQ333ysUK.200 2024-09-14T11:58:38.907 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:38.910+0000 7fd5ad44a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.105__multipart_key1.2~FSwO5wOqwl0Xca1qY9I-WjiQ333ysUK.201 2024-09-14T11:58:38.908 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:38.910+0000 7fd5ad44a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.105__multipart_key1.2~FSwO5wOqwl0Xca1qY9I-WjiQ333ysUK.202 2024-09-14T11:58:38.908 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:38.910+0000 7fd5ad44a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.105__multipart_key1.2~FSwO5wOqwl0Xca1qY9I-WjiQ333ysUK.203 2024-09-14T11:58:38.908 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:38.910+0000 7fd5ad44a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.105__multipart_key1.2~FSwO5wOqwl0Xca1qY9I-WjiQ333ysUK.204 2024-09-14T11:58:38.909 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:38.910+0000 7fd5ad44a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.105__multipart_key1.2~FSwO5wOqwl0Xca1qY9I-WjiQ333ysUK.205 2024-09-14T11:58:38.909 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:38.910+0000 7fd5ad44a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.105__multipart_key1.2~FSwO5wOqwl0Xca1qY9I-WjiQ333ysUK.206 2024-09-14T11:58:38.910 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:38.910+0000 7fd5ad44a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.105__multipart_key1.2~FSwO5wOqwl0Xca1qY9I-WjiQ333ysUK.207 2024-09-14T11:58:38.910 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:38.910+0000 7fd5ad44a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.105__multipart_key1.2~FSwO5wOqwl0Xca1qY9I-WjiQ333ysUK.208 2024-09-14T11:58:38.912 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:38.914+0000 7fd5ad44a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.105__multipart_key1.2~FSwO5wOqwl0Xca1qY9I-WjiQ333ysUK.209 2024-09-14T11:58:38.912 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:38.914+0000 7fd5ad44a9c0 20 garbage collection: RGWGC::process iterating over entry tag='2~FSwO5wOqwl0Xca1qY9I-WjiQ333ysUK', time=2024-09-14T13:57:22.119898+0000, chain.objs.size()=3 2024-09-14T11:58:38.912 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:38.914+0000 7fd5ad44a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.105__multipart_key1.2~FSwO5wOqwl0Xca1qY9I-WjiQ333ysUK.210 2024-09-14T11:58:38.912 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:38.914+0000 7fd5ad44a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.105__multipart_key1.2~FSwO5wOqwl0Xca1qY9I-WjiQ333ysUK.211 2024-09-14T11:58:38.912 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:38.914+0000 7fd5ad44a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.105__multipart_key1.2~FSwO5wOqwl0Xca1qY9I-WjiQ333ysUK.212 2024-09-14T11:58:38.912 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:38.914+0000 7fd5ad44a9c0 20 garbage collection: RGWGC::process iterating over entry tag='d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.5353325265556424498', time=2024-09-14T13:58:24.098645+0000, chain.objs.size()=9 2024-09-14T11:58:38.912 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:38.914+0000 7fd5ad44a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.143__multipart_key1.2~06lPH6-LQzi_7SAGhXOSyGT80ik0KN7.1 2024-09-14T11:58:38.912 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:38.914+0000 7fd5ad44a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.143__shadow_key1.2~06lPH6-LQzi_7SAGhXOSyGT80ik0KN7.1_1 2024-09-14T11:58:38.913 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:38.914+0000 7fd5ad44a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.143__multipart_key1.2~06lPH6-LQzi_7SAGhXOSyGT80ik0KN7.2 2024-09-14T11:58:38.914 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:38.918+0000 7fd5ad44a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.143__shadow_key1.2~06lPH6-LQzi_7SAGhXOSyGT80ik0KN7.2_1 2024-09-14T11:58:38.914 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:38.918+0000 7fd5ad44a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.143__multipart_key1.2~06lPH6-LQzi_7SAGhXOSyGT80ik0KN7.3 2024-09-14T11:58:38.914 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:38.918+0000 7fd5ad44a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.143__shadow_key1.2~06lPH6-LQzi_7SAGhXOSyGT80ik0KN7.3_1 2024-09-14T11:58:38.914 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:38.918+0000 7fd5ad44a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.143__multipart_key1.2~06lPH6-LQzi_7SAGhXOSyGT80ik0KN7.4 2024-09-14T11:58:38.915 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:38.918+0000 7fd5ad44a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.143__shadow_key1.2~06lPH6-LQzi_7SAGhXOSyGT80ik0KN7.4_1 2024-09-14T11:58:38.916 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:38.918+0000 7fd5ad44a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.143__multipart_key1.2~06lPH6-LQzi_7SAGhXOSyGT80ik0KN7.5 2024-09-14T11:58:38.921 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:38.922+0000 7fd5ad44a9c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T11:58:38.924 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:38.926+0000 7fd5ad44a9c0 20 garbage collection: RGWGC::process entered with GC index_shard=10, max_secs=3600, expired_only=0 2024-09-14T11:58:38.925 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:38.926+0000 7fd5ad44a9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:58:38.926 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:38.926+0000 7fd5ad44a9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:58:38.926 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:38.930+0000 7fd5ad44a9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2024-09-14T11:58:38.927 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:38.930+0000 7fd5ad44a9c0 20 garbage collection: RGWGC::process iterating over entry tag='d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.14298329325714541742', time=2024-09-14T13:51:39.952326+0000, chain.objs.size()=9 2024-09-14T11:58:38.927 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:38.930+0000 7fd5ad44a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.91__multipart_key1.2~aDRd9nAx8BEvRvh69dvgHfe5c3f3tfD.1 2024-09-14T11:58:38.927 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:38.930+0000 7fd5ad44a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.91__shadow_key1.2~aDRd9nAx8BEvRvh69dvgHfe5c3f3tfD.1_1 2024-09-14T11:58:38.927 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:38.930+0000 7fd5ad44a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.91__multipart_key1.2~aDRd9nAx8BEvRvh69dvgHfe5c3f3tfD.2 2024-09-14T11:58:38.927 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:38.930+0000 7fd5ad44a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.91__shadow_key1.2~aDRd9nAx8BEvRvh69dvgHfe5c3f3tfD.2_1 2024-09-14T11:58:38.927 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:38.930+0000 7fd5ad44a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.91__multipart_key1.2~aDRd9nAx8BEvRvh69dvgHfe5c3f3tfD.3 2024-09-14T11:58:38.927 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:38.930+0000 7fd5ad44a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.91__shadow_key1.2~aDRd9nAx8BEvRvh69dvgHfe5c3f3tfD.3_1 2024-09-14T11:58:38.927 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:38.930+0000 7fd5ad44a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.91__multipart_key1.2~aDRd9nAx8BEvRvh69dvgHfe5c3f3tfD.4 2024-09-14T11:58:38.927 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:38.930+0000 7fd5ad44a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.91__shadow_key1.2~aDRd9nAx8BEvRvh69dvgHfe5c3f3tfD.4_1 2024-09-14T11:58:38.927 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:38.930+0000 7fd5ad44a9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.91__multipart_key1.2~aDRd9nAx8BEvRvh69dvgHfe5c3f3tfD.5 2024-09-14T11:58:38.931 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:38.934+0000 7fd5ad44a9c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T11:58:38.935 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:38.938+0000 7fd4617e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:58:38.937 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:38.938+0000 7fd5ad44a9c0 20 remove_watcher() i=0 2024-09-14T11:58:38.937 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:38.938+0000 7fd5ad44a9c0 2 removed watcher, disabling cache 2024-09-14T11:58:38.938 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:38.942+0000 7fd5ad44a9c0 20 remove_watcher() i=1 2024-09-14T11:58:38.939 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:38.942+0000 7fd5ad44a9c0 20 remove_watcher() i=2 2024-09-14T11:58:38.940 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:38.942+0000 7fd5ad44a9c0 20 remove_watcher() i=3 2024-09-14T11:58:38.941 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:38.942+0000 7fd5ad44a9c0 20 remove_watcher() i=4 2024-09-14T11:58:38.942 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:38.946+0000 7fd5ad44a9c0 20 remove_watcher() i=5 2024-09-14T11:58:38.943 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:38.946+0000 7fd5ad44a9c0 20 remove_watcher() i=6 2024-09-14T11:58:38.944 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:38.946+0000 7fd5ad44a9c0 20 remove_watcher() i=7 2024-09-14T11:58:38.957 DEBUG:teuthology.orchestra.run.smithi138:> radosgw-admin gc process --include-all 2024-09-14T11:58:39.030 INFO:teuthology.orchestra.run.smithi138.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:58:39.030 INFO:teuthology.orchestra.run.smithi138.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:58:39.074 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:39.074+0000 7f13f06d49c0 20 rados->read ofs=0 len=0 2024-09-14T11:58:39.076 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:39.078+0000 7f13f06d49c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:58:39.076 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:39.078+0000 7f13f06d49c0 20 realm 2024-09-14T11:58:39.076 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:39.078+0000 7f13f06d49c0 20 rados->read ofs=0 len=0 2024-09-14T11:58:39.076 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:39.078+0000 7f13f06d49c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:58:39.076 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:39.078+0000 7f13f06d49c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:58:39.076 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:39.078+0000 7f13f06d49c0 20 rados->read ofs=0 len=0 2024-09-14T11:58:39.076 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:39.078+0000 7f13f06d49c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:58:39.076 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:39.078+0000 7f13f06d49c0 20 rados->read ofs=0 len=0 2024-09-14T11:58:39.078 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:39.078+0000 7f13f06d49c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:58:39.078 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:39.078+0000 7f13f06d49c0 20 rados->read ofs=0 len=0 2024-09-14T11:58:39.079 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:39.082+0000 7f13f06d49c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:58:39.079 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:39.082+0000 7f13f06d49c0 20 searching for the correct realm 2024-09-14T11:58:39.084 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:39.086+0000 7f13ee1da640 0 -- 172.21.15.138:0/1612256187 >> [v2:172.21.15.138:6800/1799335858,v1:172.21.15.138:6801/1799335858] conn(0x55dc553d9fc0 msgr2=0x55dc553dc460 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:58:39.090 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:39.090+0000 7f13ed9d9640 0 -- 172.21.15.138:0/1612256187 >> [v2:172.21.15.138:6816/326481658,v1:172.21.15.138:6817/326481658] conn(0x7f13e80f7970 msgr2=0x7f13e80c2400 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:58:39.097 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:39.098+0000 7f13f06d49c0 20 RGWRados::pool_iterate: got zone_info.d9e72d30-c60b-4d0d-9267-fdc36392d5ad 2024-09-14T11:58:39.097 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:39.098+0000 7f13f06d49c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:58:39.098 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:39.098+0000 7f13f06d49c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:58:39.098 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:39.098+0000 7f13f06d49c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:58:39.098 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:39.098+0000 7f13f06d49c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:58:39.098 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:39.098+0000 7f13f06d49c0 20 RGWRados::pool_iterate: got zonegroup_info.65ab941b-da8c-4160-94fb-3672b069d44f 2024-09-14T11:58:39.098 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:39.098+0000 7f13f06d49c0 20 rados->read ofs=0 len=0 2024-09-14T11:58:39.098 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:39.098+0000 7f13f06d49c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:58:39.098 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:39.098+0000 7f13f06d49c0 20 rados->read ofs=0 len=0 2024-09-14T11:58:39.098 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:39.102+0000 7f13f06d49c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:58:39.098 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:39.102+0000 7f13f06d49c0 20 rados->read ofs=0 len=0 2024-09-14T11:58:39.099 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:39.102+0000 7f13f06d49c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:58:39.099 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:39.102+0000 7f13f06d49c0 20 zone default found 2024-09-14T11:58:39.100 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:39.102+0000 7f13f06d49c0 4 Realm: () 2024-09-14T11:58:39.100 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:39.102+0000 7f13f06d49c0 4 ZoneGroup: default (65ab941b-da8c-4160-94fb-3672b069d44f) 2024-09-14T11:58:39.100 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:39.102+0000 7f13f06d49c0 4 Zone: default (d9e72d30-c60b-4d0d-9267-fdc36392d5ad) 2024-09-14T11:58:39.100 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:39.102+0000 7f13f06d49c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:58:39.100 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:39.102+0000 7f13f06d49c0 20 zonegroup default 2024-09-14T11:58:39.100 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:39.102+0000 7f13f06d49c0 20 rados->read ofs=0 len=0 2024-09-14T11:58:39.100 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:39.102+0000 7f13f06d49c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:58:39.100 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:39.102+0000 7f13f06d49c0 20 rados->read ofs=0 len=0 2024-09-14T11:58:39.101 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:39.102+0000 7f13f06d49c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:58:39.101 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:39.102+0000 7f13f06d49c0 20 rados->read ofs=0 len=0 2024-09-14T11:58:39.101 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:39.102+0000 7f13f06d49c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:58:39.101 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:39.102+0000 7f13f06d49c0 20 started sync module instance, tier type = 2024-09-14T11:58:39.101 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:39.102+0000 7f13f06d49c0 20 started zone id=d9e72d30-c60b-4d0d-9267-fdc36392d5ad (name=default) with tier type = 2024-09-14T11:58:39.116 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:39.118+0000 7f13f06d49c0 20 add_watcher() i=0 2024-09-14T11:58:39.116 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:39.118+0000 7f13f06d49c0 20 add_watcher() i=1 2024-09-14T11:58:39.116 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:39.118+0000 7f13f06d49c0 20 add_watcher() i=2 2024-09-14T11:58:39.116 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:39.118+0000 7f13f06d49c0 20 add_watcher() i=3 2024-09-14T11:58:39.116 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:39.118+0000 7f13f06d49c0 20 add_watcher() i=4 2024-09-14T11:58:39.116 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:39.118+0000 7f13f06d49c0 20 add_watcher() i=5 2024-09-14T11:58:39.117 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:39.118+0000 7f13f06d49c0 20 add_watcher() i=6 2024-09-14T11:58:39.117 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:39.118+0000 7f13f06d49c0 20 add_watcher() i=7 2024-09-14T11:58:39.117 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:39.118+0000 7f13f06d49c0 2 all 8 watchers are set, enabling cache 2024-09-14T11:58:39.120 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:39.122+0000 7f12a4fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:58:39.120 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:39.122+0000 7f13f06d49c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:58:39.120 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:39.122+0000 7f13f06d49c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:58:39.193 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:39.194+0000 7f121f7fe640 20 reqs_thread_entry: start 2024-09-14T11:58:39.194 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:39.194+0000 7f13f06d49c0 20 init_complete bucket index max shards: 11 2024-09-14T11:58:39.194 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:39.194+0000 7f13f06d49c0 20 Filter name: none 2024-09-14T11:58:39.194 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:39.194+0000 7f121d7fa640 20 reqs_thread_entry: start 2024-09-14T11:58:39.194 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:39.194+0000 7f13f06d49c0 20 garbage collection: RGWGC::process entered with GC index_shard=31, max_secs=3600, expired_only=0 2024-09-14T11:58:39.195 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:39.198+0000 7f13f06d49c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:58:39.196 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:39.198+0000 7f13f06d49c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:58:39.196 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:39.198+0000 7f13f06d49c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:58:39.198 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:39.198+0000 7f13f06d49c0 20 garbage collection: RGWGC::process entered with GC index_shard=0, max_secs=3600, expired_only=0 2024-09-14T11:58:39.201 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:39.202+0000 7f13f06d49c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:58:39.202 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:39.206+0000 7f13f06d49c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:58:39.203 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:39.206+0000 7f13f06d49c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:58:39.206 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:39.206+0000 7f13f06d49c0 20 garbage collection: RGWGC::process entered with GC index_shard=1, max_secs=3600, expired_only=0 2024-09-14T11:58:39.207 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:39.210+0000 7f13f06d49c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:58:39.208 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:39.210+0000 7f13f06d49c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:58:39.208 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:39.210+0000 7f13f06d49c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:58:39.210 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:39.210+0000 7f13f06d49c0 20 garbage collection: RGWGC::process entered with GC index_shard=2, max_secs=3600, expired_only=0 2024-09-14T11:58:39.212 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:39.214+0000 7f13f06d49c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:58:39.212 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:39.214+0000 7f13f06d49c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:58:39.213 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:39.214+0000 7f13f06d49c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:58:39.215 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:39.218+0000 7f13f06d49c0 20 garbage collection: RGWGC::process entered with GC index_shard=3, max_secs=3600, expired_only=0 2024-09-14T11:58:39.217 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:39.218+0000 7f13f06d49c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:58:39.218 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:39.222+0000 7f13f06d49c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:58:39.218 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:39.222+0000 7f13f06d49c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:58:39.221 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:39.222+0000 7f13f06d49c0 20 garbage collection: RGWGC::process entered with GC index_shard=4, max_secs=3600, expired_only=0 2024-09-14T11:58:39.224 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:39.226+0000 7f13f06d49c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:58:39.225 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:39.226+0000 7f13f06d49c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:58:39.226 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:39.230+0000 7f13f06d49c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:58:39.229 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:39.230+0000 7f13f06d49c0 20 garbage collection: RGWGC::process entered with GC index_shard=5, max_secs=3600, expired_only=0 2024-09-14T11:58:39.231 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:39.234+0000 7f13f06d49c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:58:39.232 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:39.234+0000 7f13f06d49c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:58:39.232 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:39.234+0000 7f13f06d49c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:58:39.234 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:39.238+0000 7f13f06d49c0 20 garbage collection: RGWGC::process entered with GC index_shard=6, max_secs=3600, expired_only=0 2024-09-14T11:58:39.238 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:39.238+0000 7f13f06d49c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:58:39.239 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:39.242+0000 7f13f06d49c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:58:39.240 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:39.242+0000 7f13f06d49c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:58:39.242 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:39.242+0000 7f13f06d49c0 20 garbage collection: RGWGC::process entered with GC index_shard=7, max_secs=3600, expired_only=0 2024-09-14T11:58:39.245 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:39.246+0000 7f13f06d49c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:58:39.246 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:39.246+0000 7f13f06d49c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:58:39.246 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:39.250+0000 7f13f06d49c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:58:39.249 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:39.250+0000 7f13f06d49c0 20 garbage collection: RGWGC::process entered with GC index_shard=8, max_secs=3600, expired_only=0 2024-09-14T11:58:39.252 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:39.254+0000 7f13f06d49c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:58:39.253 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:39.254+0000 7f13f06d49c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:58:39.253 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:39.254+0000 7f13f06d49c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:58:39.255 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:39.258+0000 7f13f06d49c0 20 garbage collection: RGWGC::process entered with GC index_shard=9, max_secs=3600, expired_only=0 2024-09-14T11:58:39.259 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:39.262+0000 7f13f06d49c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:58:39.260 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:39.262+0000 7f13f06d49c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:58:39.261 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:39.262+0000 7f13f06d49c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:58:39.263 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:39.266+0000 7f13f06d49c0 20 garbage collection: RGWGC::process entered with GC index_shard=10, max_secs=3600, expired_only=0 2024-09-14T11:58:39.267 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:39.270+0000 7f13f06d49c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:58:39.268 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:39.270+0000 7f13f06d49c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:58:39.269 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:39.270+0000 7f13f06d49c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:58:39.272 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:39.274+0000 7f13f06d49c0 20 garbage collection: RGWGC::process entered with GC index_shard=11, max_secs=3600, expired_only=0 2024-09-14T11:58:39.276 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:39.278+0000 7f13f06d49c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:58:39.276 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:39.278+0000 7f13f06d49c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:58:39.276 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:39.278+0000 7f13f06d49c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:58:39.277 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:39.278+0000 7f13f06d49c0 20 garbage collection: RGWGC::process entered with GC index_shard=12, max_secs=3600, expired_only=0 2024-09-14T11:58:39.281 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:39.282+0000 7f13f06d49c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:58:39.282 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:39.282+0000 7f13f06d49c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:58:39.282 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:39.286+0000 7f13f06d49c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:58:39.285 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:39.286+0000 7f13f06d49c0 20 garbage collection: RGWGC::process entered with GC index_shard=13, max_secs=3600, expired_only=0 2024-09-14T11:58:39.287 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:39.290+0000 7f13f06d49c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:58:39.288 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:39.290+0000 7f13f06d49c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:58:39.289 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:39.290+0000 7f13f06d49c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:58:39.291 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:39.294+0000 7f13f06d49c0 20 garbage collection: RGWGC::process entered with GC index_shard=14, max_secs=3600, expired_only=0 2024-09-14T11:58:39.293 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:39.294+0000 7f13f06d49c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:58:39.294 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:39.298+0000 7f13f06d49c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:58:39.295 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:39.298+0000 7f13f06d49c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:58:39.297 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:39.298+0000 7f13f06d49c0 20 garbage collection: RGWGC::process entered with GC index_shard=15, max_secs=3600, expired_only=0 2024-09-14T11:58:39.301 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:39.302+0000 7f13f06d49c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:58:39.302 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:39.306+0000 7f13f06d49c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:58:39.303 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:39.306+0000 7f13f06d49c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:58:39.306 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:39.306+0000 7f13f06d49c0 20 garbage collection: RGWGC::process entered with GC index_shard=16, max_secs=3600, expired_only=0 2024-09-14T11:58:39.309 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:39.310+0000 7f13f06d49c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:58:39.311 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:39.314+0000 7f13f06d49c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:58:39.312 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:39.314+0000 7f13f06d49c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:58:39.315 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:39.318+0000 7f13f06d49c0 20 garbage collection: RGWGC::process entered with GC index_shard=17, max_secs=3600, expired_only=0 2024-09-14T11:58:39.318 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:39.322+0000 7f13f06d49c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:58:39.319 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:39.322+0000 7f13f06d49c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:58:39.320 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:39.322+0000 7f13f06d49c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:58:39.322 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:39.326+0000 7f13f06d49c0 20 garbage collection: RGWGC::process entered with GC index_shard=18, max_secs=3600, expired_only=0 2024-09-14T11:58:39.325 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:39.326+0000 7f13f06d49c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:58:39.327 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:39.330+0000 7f13f06d49c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:58:39.328 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:39.330+0000 7f13f06d49c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:58:39.331 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:39.334+0000 7f13f06d49c0 20 garbage collection: RGWGC::process entered with GC index_shard=19, max_secs=3600, expired_only=0 2024-09-14T11:58:39.333 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:39.334+0000 7f13f06d49c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:58:39.335 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:39.338+0000 7f13f06d49c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:58:39.335 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:39.338+0000 7f13f06d49c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:58:39.338 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:39.338+0000 7f13f06d49c0 20 garbage collection: RGWGC::process entered with GC index_shard=20, max_secs=3600, expired_only=0 2024-09-14T11:58:39.342 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:39.342+0000 7f13f06d49c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:58:39.343 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:39.346+0000 7f13f06d49c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:58:39.344 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:39.346+0000 7f13f06d49c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:58:39.347 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:39.350+0000 7f13f06d49c0 20 garbage collection: RGWGC::process entered with GC index_shard=21, max_secs=3600, expired_only=0 2024-09-14T11:58:39.351 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:39.354+0000 7f13f06d49c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:58:39.352 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:39.354+0000 7f13f06d49c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:58:39.353 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:39.354+0000 7f13f06d49c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:58:39.355 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:39.358+0000 7f13f06d49c0 20 garbage collection: RGWGC::process entered with GC index_shard=22, max_secs=3600, expired_only=0 2024-09-14T11:58:39.359 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:39.362+0000 7f13f06d49c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:58:39.360 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:39.362+0000 7f13f06d49c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:58:39.360 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:39.362+0000 7f13f06d49c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:58:39.363 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:39.366+0000 7f13f06d49c0 20 garbage collection: RGWGC::process entered with GC index_shard=23, max_secs=3600, expired_only=0 2024-09-14T11:58:39.366 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:39.370+0000 7f13f06d49c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:58:39.368 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:39.370+0000 7f13f06d49c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:58:39.369 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:39.370+0000 7f13f06d49c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:58:39.371 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:39.374+0000 7f13f06d49c0 20 garbage collection: RGWGC::process entered with GC index_shard=24, max_secs=3600, expired_only=0 2024-09-14T11:58:39.375 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:39.378+0000 7f13f06d49c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:58:39.376 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:39.378+0000 7f13f06d49c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:58:39.377 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:39.378+0000 7f13f06d49c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:58:39.380 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:39.382+0000 7f13f06d49c0 20 garbage collection: RGWGC::process entered with GC index_shard=25, max_secs=3600, expired_only=0 2024-09-14T11:58:39.383 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:39.386+0000 7f13f06d49c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:58:39.384 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:39.386+0000 7f13f06d49c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:58:39.385 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:39.386+0000 7f13f06d49c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:58:39.388 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:39.390+0000 7f13f06d49c0 20 garbage collection: RGWGC::process entered with GC index_shard=26, max_secs=3600, expired_only=0 2024-09-14T11:58:39.392 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:39.394+0000 7f13f06d49c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:58:39.393 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:39.394+0000 7f13f06d49c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:58:39.394 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:39.398+0000 7f13f06d49c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:58:39.398 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:39.398+0000 7f13f06d49c0 20 garbage collection: RGWGC::process entered with GC index_shard=27, max_secs=3600, expired_only=0 2024-09-14T11:58:39.404 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:39.406+0000 7f13f06d49c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:58:39.405 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:39.406+0000 7f13f06d49c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:58:39.406 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:39.406+0000 7f13f06d49c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:58:39.408 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:39.410+0000 7f13f06d49c0 20 garbage collection: RGWGC::process entered with GC index_shard=28, max_secs=3600, expired_only=0 2024-09-14T11:58:39.412 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:39.414+0000 7f13f06d49c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:58:39.414 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:39.414+0000 7f13f06d49c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:58:39.414 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:39.418+0000 7f13f06d49c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:58:39.417 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:39.418+0000 7f13f06d49c0 20 garbage collection: RGWGC::process entered with GC index_shard=29, max_secs=3600, expired_only=0 2024-09-14T11:58:39.421 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:39.422+0000 7f13f06d49c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:58:39.422 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:39.422+0000 7f13f06d49c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:58:39.423 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:39.426+0000 7f13f06d49c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:58:39.426 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:39.430+0000 7f13f06d49c0 20 garbage collection: RGWGC::process entered with GC index_shard=30, max_secs=3600, expired_only=0 2024-09-14T11:58:39.429 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:39.430+0000 7f13f06d49c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:58:39.430 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:39.434+0000 7f13f06d49c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:58:39.431 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:39.434+0000 7f13f06d49c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:58:39.435 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:39.438+0000 7f12a4fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:58:39.440 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:39.442+0000 7f13f06d49c0 20 remove_watcher() i=0 2024-09-14T11:58:39.440 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:39.442+0000 7f13f06d49c0 2 removed watcher, disabling cache 2024-09-14T11:58:39.442 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:39.446+0000 7f13f06d49c0 20 remove_watcher() i=1 2024-09-14T11:58:39.445 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:39.446+0000 7f13f06d49c0 20 remove_watcher() i=2 2024-09-14T11:58:39.448 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:39.450+0000 7f13f06d49c0 20 remove_watcher() i=3 2024-09-14T11:58:39.450 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:39.454+0000 7f13f06d49c0 20 remove_watcher() i=4 2024-09-14T11:58:39.452 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:39.454+0000 7f13f06d49c0 20 remove_watcher() i=5 2024-09-14T11:58:39.454 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:39.454+0000 7f13f06d49c0 20 remove_watcher() i=6 2024-09-14T11:58:39.456 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:39.458+0000 7f13f06d49c0 20 remove_watcher() i=7 2024-09-14T11:58:39.481 INFO:teuthology.run_tasks:Running task s3tests... 2024-09-14T11:58:39.497 DEBUG:tasks.s3tests:s3tests config is {'client.0': {'rgw_server': 'client.0', 'accounts': {'iam alt root': 'RGW99999999999999999', 'iam root': 'RGW88888888888888888', 's3 main': 'RGW11111111111111111'}, 'force-branch': 'ceph-master', 'slow_backend': True, 'storage classes': 'LUKEWARM, FROZEN'}} 2024-09-14T11:58:39.498 INFO:tasks.s3tests:Downloading s3-tests... 2024-09-14T11:58:39.498 INFO:tasks.s3tests:Using branch 'ceph-master' for s3tests 2024-09-14T11:58:39.498 DEBUG:teuthology.orchestra.run.smithi138:> git clone -b ceph-master https://git.ceph.com/s3-tests.git /home/ubuntu/cephtest/s3-tests-client.0 2024-09-14T11:58:39.527 INFO:teuthology.orchestra.run.smithi138.stderr:Cloning into '/home/ubuntu/cephtest/s3-tests-client.0'... 2024-09-14T11:58:40.442 INFO:tasks.s3tests:Creating rgw users... 2024-09-14T11:58:40.442 DEBUG:teuthology.orchestra.run.smithi138:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 --cluster ceph account create --account-id RGW11111111111111111 --account-name Mr.RGW11111111111111111 --email RGW11111111111111111+test@test.test 2024-09-14T11:58:40.530 INFO:teuthology.orchestra.run.smithi138.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:58:40.530 INFO:teuthology.orchestra.run.smithi138.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:58:40.572 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:40.574+0000 7f1db8f429c0 20 rados->read ofs=0 len=0 2024-09-14T11:58:40.574 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:40.578+0000 7f1db8f429c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:58:40.574 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:40.578+0000 7f1db8f429c0 20 realm 2024-09-14T11:58:40.574 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:40.578+0000 7f1db8f429c0 20 rados->read ofs=0 len=0 2024-09-14T11:58:40.574 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:40.578+0000 7f1db8f429c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:58:40.575 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:40.578+0000 7f1db8f429c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:58:40.575 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:40.578+0000 7f1db8f429c0 20 rados->read ofs=0 len=0 2024-09-14T11:58:40.575 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:40.578+0000 7f1db8f429c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:58:40.575 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:40.578+0000 7f1db8f429c0 20 rados->read ofs=0 len=0 2024-09-14T11:58:40.576 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:40.578+0000 7f1db8f429c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:58:40.576 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:40.578+0000 7f1db8f429c0 20 rados->read ofs=0 len=0 2024-09-14T11:58:40.577 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:40.578+0000 7f1db8f429c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:58:40.577 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:40.578+0000 7f1db8f429c0 20 searching for the correct realm 2024-09-14T11:58:40.581 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:40.582+0000 7f1db7249640 0 -- 172.21.15.138:0/1961168778 >> [v2:172.21.15.154:6824/416768175,v1:172.21.15.154:6825/416768175] conn(0x7f1db009a050 msgr2=0x7f1db0063200 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:58:40.796 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:40.798+0000 7f1db6247640 0 -- 172.21.15.138:0/1961168778 >> [v2:172.21.15.138:6816/326481658,v1:172.21.15.138:6817/326481658] conn(0x7f1db007e850 msgr2=0x7f1db0021800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-14T11:58:41.014 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:41.014+0000 7f1db8f429c0 20 RGWRados::pool_iterate: got zone_info.d9e72d30-c60b-4d0d-9267-fdc36392d5ad 2024-09-14T11:58:41.014 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:41.014+0000 7f1db8f429c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:58:41.014 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:41.014+0000 7f1db8f429c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:58:41.014 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:41.014+0000 7f1db8f429c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:58:41.014 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:41.014+0000 7f1db8f429c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:58:41.014 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:41.014+0000 7f1db8f429c0 20 RGWRados::pool_iterate: got zonegroup_info.65ab941b-da8c-4160-94fb-3672b069d44f 2024-09-14T11:58:41.014 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:41.014+0000 7f1db8f429c0 20 rados->read ofs=0 len=0 2024-09-14T11:58:41.014 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:41.014+0000 7f1db8f429c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:58:41.014 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:41.014+0000 7f1db8f429c0 20 rados->read ofs=0 len=0 2024-09-14T11:58:41.015 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:41.018+0000 7f1db8f429c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:58:41.015 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:41.018+0000 7f1db8f429c0 20 rados->read ofs=0 len=0 2024-09-14T11:58:41.016 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:41.018+0000 7f1db8f429c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:58:41.016 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:41.018+0000 7f1db8f429c0 20 zone default found 2024-09-14T11:58:41.016 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:41.018+0000 7f1db8f429c0 4 Realm: () 2024-09-14T11:58:41.016 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:41.018+0000 7f1db8f429c0 4 ZoneGroup: default (65ab941b-da8c-4160-94fb-3672b069d44f) 2024-09-14T11:58:41.016 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:41.018+0000 7f1db8f429c0 4 Zone: default (d9e72d30-c60b-4d0d-9267-fdc36392d5ad) 2024-09-14T11:58:41.016 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:41.018+0000 7f1db8f429c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:58:41.016 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:41.018+0000 7f1db8f429c0 20 zonegroup default 2024-09-14T11:58:41.016 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:41.018+0000 7f1db8f429c0 20 rados->read ofs=0 len=0 2024-09-14T11:58:41.017 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:41.018+0000 7f1db8f429c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:58:41.017 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:41.018+0000 7f1db8f429c0 20 rados->read ofs=0 len=0 2024-09-14T11:58:41.017 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:41.018+0000 7f1db8f429c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:58:41.017 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:41.018+0000 7f1db8f429c0 20 rados->read ofs=0 len=0 2024-09-14T11:58:41.018 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:41.022+0000 7f1db8f429c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:58:41.018 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:41.022+0000 7f1db8f429c0 20 started sync module instance, tier type = 2024-09-14T11:58:41.018 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:41.022+0000 7f1db8f429c0 20 started zone id=d9e72d30-c60b-4d0d-9267-fdc36392d5ad (name=default) with tier type = 2024-09-14T11:58:41.042 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:41.042+0000 7f1db8f429c0 20 add_watcher() i=0 2024-09-14T11:58:41.042 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:41.042+0000 7f1db8f429c0 20 add_watcher() i=1 2024-09-14T11:58:41.042 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:41.042+0000 7f1db8f429c0 20 add_watcher() i=2 2024-09-14T11:58:41.042 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:41.042+0000 7f1db8f429c0 20 add_watcher() i=3 2024-09-14T11:58:41.042 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:41.042+0000 7f1db8f429c0 20 add_watcher() i=4 2024-09-14T11:58:41.042 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:41.042+0000 7f1db8f429c0 20 add_watcher() i=5 2024-09-14T11:58:41.042 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:41.042+0000 7f1db8f429c0 20 add_watcher() i=6 2024-09-14T11:58:41.044 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:41.046+0000 7f1db8f429c0 20 add_watcher() i=7 2024-09-14T11:58:41.044 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:41.046+0000 7f1db8f429c0 2 all 8 watchers are set, enabling cache 2024-09-14T11:58:41.049 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:41.050+0000 7f1c6d7e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:58:41.049 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:41.050+0000 7f1db8f429c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:58:41.049 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:41.050+0000 7f1db8f429c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:58:41.049 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:41.050+0000 7f1db8f429c0 5 note: GC not initialized 2024-09-14T11:58:41.050 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:41.050+0000 7f1be7fff640 20 reqs_thread_entry: start 2024-09-14T11:58:41.050 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:41.050+0000 7f1db8f429c0 20 init_complete bucket index max shards: 11 2024-09-14T11:58:41.050 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:41.054+0000 7f1db8f429c0 20 Filter name: none 2024-09-14T11:58:41.050 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:41.054+0000 7f1be5ffb640 20 reqs_thread_entry: start 2024-09-14T11:58:41.051 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:41.054+0000 7f1db8f429c0 10 cache get: name=default.rgw.meta+accounts+name.$Mr.RGW11111111111111111 : miss 2024-09-14T11:58:41.051 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:41.054+0000 7f1db8f429c0 20 rados->read ofs=0 len=0 2024-09-14T11:58:41.051 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:41.054+0000 7f1db8f429c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:58:41.051 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:41.054+0000 7f1db8f429c0 10 cache put: name=default.rgw.meta+accounts+name.$Mr.RGW11111111111111111 info.flags=0x0 2024-09-14T11:58:41.051 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:41.054+0000 7f1db8f429c0 10 adding default.rgw.meta+accounts+name.$Mr.RGW11111111111111111 to cache LRU end 2024-09-14T11:58:41.051 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:41.054+0000 7f1db8f429c0 20 failed to read name.$Mr.RGW11111111111111111 with: (2) No such file or directory 2024-09-14T11:58:41.052 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:41.054+0000 7f1db8f429c0 10 cache get: name=default.rgw.meta+users.email+rgw11111111111111111+test@test.test : miss 2024-09-14T11:58:41.052 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:41.054+0000 7f1db8f429c0 20 rados->read ofs=0 len=0 2024-09-14T11:58:41.052 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:41.054+0000 7f1db8f429c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:58:41.052 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:41.054+0000 7f1db8f429c0 10 cache put: name=default.rgw.meta+users.email+rgw11111111111111111+test@test.test info.flags=0x0 2024-09-14T11:58:41.052 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:41.054+0000 7f1db8f429c0 10 adding default.rgw.meta+users.email+rgw11111111111111111+test@test.test to cache LRU end 2024-09-14T11:58:41.052 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:41.054+0000 7f1db8f429c0 20 failed to read rgw11111111111111111+test@test.test with: (2) No such file or directory 2024-09-14T11:58:41.053 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:41.054+0000 7f1db8f429c0 10 cache put: name=default.rgw.meta+accounts+account.RGW11111111111111111 info.flags=0x17 2024-09-14T11:58:41.054 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:41.054+0000 7f1db8f429c0 10 adding default.rgw.meta+accounts+account.RGW11111111111111111 to cache LRU end 2024-09-14T11:58:41.054 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:41.054+0000 7f1db8f429c0 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:accounts:account.RGW11111111111111111, ofs0, ns] 2024-09-14T11:58:41.055 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:41.058+0000 7f1c99ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366306 cookie 93839990434880 notifier 8306 bl.length()=384 2024-09-14T11:58:41.055 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:41.058+0000 7f1c99ffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+accounts+account.RGW11111111111111111 info.flags=0x17 2024-09-14T11:58:41.055 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:41.058+0000 7f1c99ffb640 10 rgw watcher librados: moving default.rgw.meta+accounts+account.RGW11111111111111111 to cache LRU end 2024-09-14T11:58:41.060 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:41.062+0000 7f1db8f429c0 10 cache put: name=default.rgw.meta+accounts+name.$Mr.RGW11111111111111111 info.flags=0x17 2024-09-14T11:58:41.060 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:41.062+0000 7f1db8f429c0 10 moving default.rgw.meta+accounts+name.$Mr.RGW11111111111111111 to cache LRU end 2024-09-14T11:58:41.060 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:41.062+0000 7f1db8f429c0 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:accounts:name.$Mr.RGW11111111111111111, ofs0, ns] 2024-09-14T11:58:41.061 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:41.062+0000 7f1c99ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366347 cookie 93839990446208 notifier 8306 bl.length()=225 2024-09-14T11:58:41.061 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:41.062+0000 7f1c99ffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+accounts+name.$Mr.RGW11111111111111111 info.flags=0x17 2024-09-14T11:58:41.061 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:41.062+0000 7f1c99ffb640 10 rgw watcher librados: moving default.rgw.meta+accounts+name.$Mr.RGW11111111111111111 to cache LRU end 2024-09-14T11:58:41.066 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:41.066+0000 7f1db8f429c0 10 cache put: name=default.rgw.meta+users.email+rgw11111111111111111+test@test.test info.flags=0x17 2024-09-14T11:58:41.066 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:41.066+0000 7f1db8f429c0 10 moving default.rgw.meta+users.email+rgw11111111111111111+test@test.test to cache LRU end 2024-09-14T11:58:41.066 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:41.066+0000 7f1db8f429c0 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 0, obj: default.rgw.meta:users.email:rgw11111111111111111+test@test.test, ofs0, ns] 2024-09-14T11:58:41.067 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:41.070+0000 7f1c99ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366234 cookie 93839990440784 notifier 8306 bl.length()=234 2024-09-14T11:58:41.067 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:41.070+0000 7f1c99ffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.email+rgw11111111111111111+test@test.test info.flags=0x17 2024-09-14T11:58:41.067 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:41.070+0000 7f1c99ffb640 10 rgw watcher librados: moving default.rgw.meta+users.email+rgw11111111111111111+test@test.test to cache LRU end 2024-09-14T11:58:41.070 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:41.070+0000 7f1c6d7e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:58:41.075 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:41.078+0000 7f1db8f429c0 20 remove_watcher() i=0 2024-09-14T11:58:41.075 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:41.078+0000 7f1db8f429c0 2 removed watcher, disabling cache 2024-09-14T11:58:41.077 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:41.078+0000 7f1db8f429c0 20 remove_watcher() i=1 2024-09-14T11:58:41.080 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:41.082+0000 7f1db8f429c0 20 remove_watcher() i=2 2024-09-14T11:58:41.081 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:41.082+0000 7f1db8f429c0 20 remove_watcher() i=3 2024-09-14T11:58:41.084 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:41.086+0000 7f1db8f429c0 20 remove_watcher() i=4 2024-09-14T11:58:41.085 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:41.086+0000 7f1db8f429c0 20 remove_watcher() i=5 2024-09-14T11:58:41.087 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:41.090+0000 7f1db8f429c0 20 remove_watcher() i=6 2024-09-14T11:58:41.089 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:41.090+0000 7f1db8f429c0 20 remove_watcher() i=7 2024-09-14T11:58:41.102 INFO:teuthology.orchestra.run.smithi138.stdout:{ 2024-09-14T11:58:41.102 INFO:teuthology.orchestra.run.smithi138.stdout: "id": "RGW11111111111111111", 2024-09-14T11:58:41.102 INFO:teuthology.orchestra.run.smithi138.stdout: "tenant": "", 2024-09-14T11:58:41.102 INFO:teuthology.orchestra.run.smithi138.stdout: "name": "Mr.RGW11111111111111111", 2024-09-14T11:58:41.102 INFO:teuthology.orchestra.run.smithi138.stdout: "email": "RGW11111111111111111+test@test.test", 2024-09-14T11:58:41.102 INFO:teuthology.orchestra.run.smithi138.stdout: "quota": { 2024-09-14T11:58:41.102 INFO:teuthology.orchestra.run.smithi138.stdout: "enabled": false, 2024-09-14T11:58:41.102 INFO:teuthology.orchestra.run.smithi138.stdout: "check_on_raw": false, 2024-09-14T11:58:41.102 INFO:teuthology.orchestra.run.smithi138.stdout: "max_size": -1, 2024-09-14T11:58:41.102 INFO:teuthology.orchestra.run.smithi138.stdout: "max_size_kb": 0, 2024-09-14T11:58:41.102 INFO:teuthology.orchestra.run.smithi138.stdout: "max_objects": -1 2024-09-14T11:58:41.103 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-09-14T11:58:41.103 INFO:teuthology.orchestra.run.smithi138.stdout: "bucket_quota": { 2024-09-14T11:58:41.103 INFO:teuthology.orchestra.run.smithi138.stdout: "enabled": false, 2024-09-14T11:58:41.103 INFO:teuthology.orchestra.run.smithi138.stdout: "check_on_raw": false, 2024-09-14T11:58:41.103 INFO:teuthology.orchestra.run.smithi138.stdout: "max_size": -1, 2024-09-14T11:58:41.103 INFO:teuthology.orchestra.run.smithi138.stdout: "max_size_kb": 0, 2024-09-14T11:58:41.103 INFO:teuthology.orchestra.run.smithi138.stdout: "max_objects": -1 2024-09-14T11:58:41.103 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-09-14T11:58:41.103 INFO:teuthology.orchestra.run.smithi138.stdout: "max_users": 1000, 2024-09-14T11:58:41.103 INFO:teuthology.orchestra.run.smithi138.stdout: "max_roles": 1000, 2024-09-14T11:58:41.103 INFO:teuthology.orchestra.run.smithi138.stdout: "max_groups": 1000, 2024-09-14T11:58:41.103 INFO:teuthology.orchestra.run.smithi138.stdout: "max_buckets": 1000, 2024-09-14T11:58:41.103 INFO:teuthology.orchestra.run.smithi138.stdout: "max_access_keys": 4 2024-09-14T11:58:41.103 INFO:teuthology.orchestra.run.smithi138.stdout:} 2024-09-14T11:58:41.104 DEBUG:tasks.s3tests:Creating user RGW11111111111111111 on client.0 2024-09-14T11:58:41.105 DEBUG:teuthology.orchestra.run.smithi138:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 user create --uid foo.client.0 --display-name Mr.RGW11111111111111111 --email foo+test@test.test --access-key MSYQVAQZWHSXVBROFMJB --secret Evi0o8lpVq/TwO25CO3dhzepAUARyl2K1VgwOCWYJXzZ02x/crslhQ== --cluster ceph --account-id RGW11111111111111111 --account-root 2024-09-14T11:58:41.193 INFO:teuthology.orchestra.run.smithi138.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:58:41.193 INFO:teuthology.orchestra.run.smithi138.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:58:41.235 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:41.238+0000 7ff97ecfc9c0 20 rados->read ofs=0 len=0 2024-09-14T11:58:41.237 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:41.238+0000 7ff97ecfc9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:58:41.237 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:41.238+0000 7ff97ecfc9c0 20 realm 2024-09-14T11:58:41.237 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:41.238+0000 7ff97ecfc9c0 20 rados->read ofs=0 len=0 2024-09-14T11:58:41.237 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:41.238+0000 7ff97ecfc9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:58:41.237 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:41.238+0000 7ff97ecfc9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:58:41.237 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:41.238+0000 7ff97ecfc9c0 20 rados->read ofs=0 len=0 2024-09-14T11:58:41.237 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:41.238+0000 7ff97ecfc9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:58:41.238 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:41.238+0000 7ff97ecfc9c0 20 rados->read ofs=0 len=0 2024-09-14T11:58:41.239 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:41.242+0000 7ff97ecfc9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:58:41.239 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:41.242+0000 7ff97ecfc9c0 20 rados->read ofs=0 len=0 2024-09-14T11:58:41.240 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:41.242+0000 7ff97ecfc9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:58:41.240 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:41.242+0000 7ff97ecfc9c0 20 searching for the correct realm 2024-09-14T11:58:41.244 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:41.246+0000 7ff97d003640 0 -- 172.21.15.138:0/628956342 >> [v2:172.21.15.154:6824/416768175,v1:172.21.15.154:6825/416768175] conn(0x7ff974018040 msgr2=0x7ff974070c40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:58:41.251 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:41.254+0000 7ff97c001640 0 -- 172.21.15.138:0/628956342 >> [v2:172.21.15.138:6816/326481658,v1:172.21.15.138:6817/326481658] conn(0x7ff974067fd0 msgr2=0x7ff974032950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:58:41.471 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:41.474+0000 7ff97ecfc9c0 20 RGWRados::pool_iterate: got zone_info.d9e72d30-c60b-4d0d-9267-fdc36392d5ad 2024-09-14T11:58:41.471 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:41.474+0000 7ff97ecfc9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:58:41.471 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:41.474+0000 7ff97ecfc9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:58:41.471 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:41.474+0000 7ff97ecfc9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:58:41.471 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:41.474+0000 7ff97ecfc9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:58:41.471 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:41.474+0000 7ff97ecfc9c0 20 RGWRados::pool_iterate: got zonegroup_info.65ab941b-da8c-4160-94fb-3672b069d44f 2024-09-14T11:58:41.471 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:41.474+0000 7ff97ecfc9c0 20 rados->read ofs=0 len=0 2024-09-14T11:58:41.472 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:41.474+0000 7ff97ecfc9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:58:41.472 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:41.474+0000 7ff97ecfc9c0 20 rados->read ofs=0 len=0 2024-09-14T11:58:41.473 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:41.474+0000 7ff97ecfc9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:58:41.473 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:41.474+0000 7ff97ecfc9c0 20 rados->read ofs=0 len=0 2024-09-14T11:58:41.474 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:41.474+0000 7ff97ecfc9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:58:41.474 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:41.474+0000 7ff97ecfc9c0 20 zone default found 2024-09-14T11:58:41.474 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:41.474+0000 7ff97ecfc9c0 4 Realm: () 2024-09-14T11:58:41.474 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:41.474+0000 7ff97ecfc9c0 4 ZoneGroup: default (65ab941b-da8c-4160-94fb-3672b069d44f) 2024-09-14T11:58:41.474 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:41.474+0000 7ff97ecfc9c0 4 Zone: default (d9e72d30-c60b-4d0d-9267-fdc36392d5ad) 2024-09-14T11:58:41.474 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:41.474+0000 7ff97ecfc9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:58:41.475 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:41.474+0000 7ff97ecfc9c0 20 zonegroup default 2024-09-14T11:58:41.475 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:41.474+0000 7ff97ecfc9c0 20 rados->read ofs=0 len=0 2024-09-14T11:58:41.475 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:41.478+0000 7ff97ecfc9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:58:41.475 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:41.478+0000 7ff97ecfc9c0 20 rados->read ofs=0 len=0 2024-09-14T11:58:41.475 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:41.478+0000 7ff97ecfc9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:58:41.475 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:41.478+0000 7ff97ecfc9c0 20 rados->read ofs=0 len=0 2024-09-14T11:58:41.476 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:41.478+0000 7ff97ecfc9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:58:41.476 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:41.478+0000 7ff97ecfc9c0 20 started sync module instance, tier type = 2024-09-14T11:58:41.476 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:41.478+0000 7ff97ecfc9c0 20 started zone id=d9e72d30-c60b-4d0d-9267-fdc36392d5ad (name=default) with tier type = 2024-09-14T11:58:41.500 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:41.502+0000 7ff97ecfc9c0 20 add_watcher() i=0 2024-09-14T11:58:41.500 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:41.502+0000 7ff97ecfc9c0 20 add_watcher() i=1 2024-09-14T11:58:41.500 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:41.502+0000 7ff97ecfc9c0 20 add_watcher() i=2 2024-09-14T11:58:41.500 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:41.502+0000 7ff97ecfc9c0 20 add_watcher() i=3 2024-09-14T11:58:41.501 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:41.502+0000 7ff97ecfc9c0 20 add_watcher() i=4 2024-09-14T11:58:41.501 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:41.502+0000 7ff97ecfc9c0 20 add_watcher() i=5 2024-09-14T11:58:41.501 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:41.502+0000 7ff97ecfc9c0 20 add_watcher() i=6 2024-09-14T11:58:41.502 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:41.506+0000 7ff97ecfc9c0 20 add_watcher() i=7 2024-09-14T11:58:41.503 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:41.506+0000 7ff97ecfc9c0 2 all 8 watchers are set, enabling cache 2024-09-14T11:58:41.507 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:41.510+0000 7ff832fdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:58:41.507 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:41.510+0000 7ff97ecfc9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:58:41.507 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:41.510+0000 7ff97ecfc9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:58:41.507 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:41.510+0000 7ff97ecfc9c0 5 note: GC not initialized 2024-09-14T11:58:41.508 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:41.510+0000 7ff831fdb640 20 reqs_thread_entry: start 2024-09-14T11:58:41.508 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:41.510+0000 7ff97ecfc9c0 20 init_complete bucket index max shards: 11 2024-09-14T11:58:41.508 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:41.510+0000 7ff97ecfc9c0 20 Filter name: none 2024-09-14T11:58:41.508 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:41.510+0000 7ff7a37fe640 20 reqs_thread_entry: start 2024-09-14T11:58:41.508 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:41.510+0000 7ff97ecfc9c0 10 cache get: name=default.rgw.meta+users.uid+foo.client.0 : miss 2024-09-14T11:58:41.508 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:41.510+0000 7ff97ecfc9c0 20 rados->read ofs=0 len=0 2024-09-14T11:58:41.509 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:41.510+0000 7ff97ecfc9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:58:41.509 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:41.510+0000 7ff97ecfc9c0 10 cache put: name=default.rgw.meta+users.uid+foo.client.0 info.flags=0x0 2024-09-14T11:58:41.509 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:41.510+0000 7ff97ecfc9c0 10 adding default.rgw.meta+users.uid+foo.client.0 to cache LRU end 2024-09-14T11:58:41.509 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:41.510+0000 7ff97ecfc9c0 10 cache get: name=default.rgw.meta+users.email+foo+test@test.test : miss 2024-09-14T11:58:41.509 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:41.510+0000 7ff97ecfc9c0 20 rados->read ofs=0 len=0 2024-09-14T11:58:41.510 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:41.510+0000 7ff97ecfc9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:58:41.510 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:41.510+0000 7ff97ecfc9c0 10 cache put: name=default.rgw.meta+users.email+foo+test@test.test info.flags=0x0 2024-09-14T11:58:41.510 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:41.510+0000 7ff97ecfc9c0 10 adding default.rgw.meta+users.email+foo+test@test.test to cache LRU end 2024-09-14T11:58:41.510 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:41.510+0000 7ff97ecfc9c0 10 cache get: name=default.rgw.meta+users.keys+MSYQVAQZWHSXVBROFMJB : miss 2024-09-14T11:58:41.510 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:41.510+0000 7ff97ecfc9c0 20 rados->read ofs=0 len=0 2024-09-14T11:58:41.511 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:41.514+0000 7ff97ecfc9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:58:41.511 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:41.514+0000 7ff97ecfc9c0 10 cache put: name=default.rgw.meta+users.keys+MSYQVAQZWHSXVBROFMJB info.flags=0x0 2024-09-14T11:58:41.511 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:41.514+0000 7ff97ecfc9c0 10 adding default.rgw.meta+users.keys+MSYQVAQZWHSXVBROFMJB to cache LRU end 2024-09-14T11:58:41.511 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:41.514+0000 7ff97ecfc9c0 10 cache get: name=default.rgw.meta+accounts+account.RGW11111111111111111 : miss 2024-09-14T11:58:41.511 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:41.514+0000 7ff97ecfc9c0 20 rados->read ofs=0 len=0 2024-09-14T11:58:41.512 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:41.514+0000 7ff97ecfc9c0 20 rados_obj.operate() r=0 bl.length=184 2024-09-14T11:58:41.512 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:41.514+0000 7ff97ecfc9c0 10 cache put: name=default.rgw.meta+accounts+account.RGW11111111111111111 info.flags=0x17 2024-09-14T11:58:41.512 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:41.514+0000 7ff97ecfc9c0 10 adding default.rgw.meta+accounts+account.RGW11111111111111111 to cache LRU end 2024-09-14T11:58:41.512 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:41.514+0000 7ff97ecfc9c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:58:41.512 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:41.514+0000 7ff97ecfc9c0 10 cache get: name=default.rgw.meta+users.keys+MSYQVAQZWHSXVBROFMJB : hit (negative entry) 2024-09-14T11:58:41.512 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:41.514+0000 7ff97ecfc9c0 10 cache get: name=default.rgw.meta+users.keys+MSYQVAQZWHSXVBROFMJB : hit (negative entry) 2024-09-14T11:58:41.514 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:41.518+0000 7ff97ecfc9c0 10 cache put: name=default.rgw.meta+users.uid+foo.client.0 info.flags=0x17 2024-09-14T11:58:41.514 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:41.518+0000 7ff97ecfc9c0 10 moving default.rgw.meta+users.uid+foo.client.0 to cache LRU end 2024-09-14T11:58:41.514 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:41.518+0000 7ff97ecfc9c0 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 0, obj: default.rgw.meta:users.uid:foo.client.0, ofs0, ns] 2024-09-14T11:58:41.515 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:41.518+0000 7ff8537fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366348 cookie 94471453868688 notifier 8934 bl.length()=673 2024-09-14T11:58:41.515 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:41.518+0000 7ff8537fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+foo.client.0 info.flags=0x17 2024-09-14T11:58:41.515 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:41.518+0000 7ff8537fe640 10 rgw watcher librados: moving default.rgw.meta+users.uid+foo.client.0 to cache LRU end 2024-09-14T11:58:41.520 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:41.522+0000 7ff97ecfc9c0 10 cache put: name=default.rgw.meta+users.email+foo+test@test.test info.flags=0x7 2024-09-14T11:58:41.520 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:41.522+0000 7ff97ecfc9c0 10 moving default.rgw.meta+users.email+foo+test@test.test to cache LRU end 2024-09-14T11:58:41.520 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:41.522+0000 7ff97ecfc9c0 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.email:foo+test@test.test, ofs0, ns] 2024-09-14T11:58:41.521 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:41.522+0000 7ff852ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366349 cookie 94471453880704 notifier 8934 bl.length()=185 2024-09-14T11:58:41.521 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:41.522+0000 7ff852ffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.email+foo+test@test.test info.flags=0x7 2024-09-14T11:58:41.521 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:41.522+0000 7ff852ffd640 10 rgw watcher librados: moving default.rgw.meta+users.email+foo+test@test.test to cache LRU end 2024-09-14T11:58:41.526 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:41.526+0000 7ff97ecfc9c0 10 cache put: name=default.rgw.meta+users.keys+MSYQVAQZWHSXVBROFMJB info.flags=0x7 2024-09-14T11:58:41.526 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:41.526+0000 7ff97ecfc9c0 10 moving default.rgw.meta+users.keys+MSYQVAQZWHSXVBROFMJB to cache LRU end 2024-09-14T11:58:41.526 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:41.526+0000 7ff97ecfc9c0 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 0, obj: default.rgw.meta:users.keys:MSYQVAQZWHSXVBROFMJB, ofs0, ns] 2024-09-14T11:58:41.526 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:41.530+0000 7ff8537fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366350 cookie 94471453868688 notifier 8934 bl.length()=186 2024-09-14T11:58:41.527 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:41.530+0000 7ff8537fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.keys+MSYQVAQZWHSXVBROFMJB info.flags=0x7 2024-09-14T11:58:41.527 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:41.530+0000 7ff8537fe640 10 rgw watcher librados: moving default.rgw.meta+users.keys+MSYQVAQZWHSXVBROFMJB to cache LRU end 2024-09-14T11:58:41.531 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:41.534+0000 7ff97ecfc9c0 20 linked user foo.client.0 to account RGW11111111111111111 2024-09-14T11:58:41.531 INFO:teuthology.orchestra.run.smithi138.stdout:{ 2024-09-14T11:58:41.531 INFO:teuthology.orchestra.run.smithi138.stdout: "user_id": "foo.client.0", 2024-09-14T11:58:41.531 INFO:teuthology.orchestra.run.smithi138.stdout: "display_name": "Mr.RGW11111111111111111", 2024-09-14T11:58:41.532 INFO:teuthology.orchestra.run.smithi138.stdout: "email": "foo+test@test.test", 2024-09-14T11:58:41.532 INFO:teuthology.orchestra.run.smithi138.stdout: "suspended": 0, 2024-09-14T11:58:41.532 INFO:teuthology.orchestra.run.smithi138.stdout: "max_buckets": 1000, 2024-09-14T11:58:41.532 INFO:teuthology.orchestra.run.smithi138.stdout: "subusers": [], 2024-09-14T11:58:41.532 INFO:teuthology.orchestra.run.smithi138.stdout: "keys": [ 2024-09-14T11:58:41.532 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-09-14T11:58:41.532 INFO:teuthology.orchestra.run.smithi138.stdout: "user": "foo.client.0", 2024-09-14T11:58:41.533 INFO:teuthology.orchestra.run.smithi138.stdout: "access_key": "MSYQVAQZWHSXVBROFMJB", 2024-09-14T11:58:41.533 INFO:teuthology.orchestra.run.smithi138.stdout: "secret_key": "Evi0o8lpVq/TwO25CO3dhzepAUARyl2K1VgwOCWYJXzZ02x/crslhQ==", 2024-09-14T11:58:41.533 INFO:teuthology.orchestra.run.smithi138.stdout: "active": true, 2024-09-14T11:58:41.533 INFO:teuthology.orchestra.run.smithi138.stdout: "create_date": "2024-09-14T11:58:41.518675Z" 2024-09-14T11:58:41.533 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-09-14T11:58:41.533 INFO:teuthology.orchestra.run.smithi138.stdout: ], 2024-09-14T11:58:41.533 INFO:teuthology.orchestra.run.smithi138.stdout: "swift_keys": [], 2024-09-14T11:58:41.533 INFO:teuthology.orchestra.run.smithi138.stdout: "caps": [], 2024-09-14T11:58:41.533 INFO:teuthology.orchestra.run.smithi138.stdout: "op_mask": "read, write, delete", 2024-09-14T11:58:41.533 INFO:teuthology.orchestra.run.smithi138.stdout: "default_placement": "", 2024-09-14T11:58:41.533 INFO:teuthology.orchestra.run.smithi138.stdout: "default_storage_class": "", 2024-09-14T11:58:41.533 INFO:teuthology.orchestra.run.smithi138.stdout: "placement_tags": [], 2024-09-14T11:58:41.533 INFO:teuthology.orchestra.run.smithi138.stdout: "bucket_quota": { 2024-09-14T11:58:41.534 INFO:teuthology.orchestra.run.smithi138.stdout: "enabled": false, 2024-09-14T11:58:41.534 INFO:teuthology.orchestra.run.smithi138.stdout: "check_on_raw": false, 2024-09-14T11:58:41.534 INFO:teuthology.orchestra.run.smithi138.stdout: "max_size": -1, 2024-09-14T11:58:41.534 INFO:teuthology.orchestra.run.smithi138.stdout: "max_size_kb": 0, 2024-09-14T11:58:41.534 INFO:teuthology.orchestra.run.smithi138.stdout: "max_objects": -1 2024-09-14T11:58:41.534 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-09-14T11:58:41.534 INFO:teuthology.orchestra.run.smithi138.stdout: "user_quota": { 2024-09-14T11:58:41.534 INFO:teuthology.orchestra.run.smithi138.stdout: "enabled": false, 2024-09-14T11:58:41.534 INFO:teuthology.orchestra.run.smithi138.stdout: "check_on_raw": false, 2024-09-14T11:58:41.534 INFO:teuthology.orchestra.run.smithi138.stdout: "max_size": -1, 2024-09-14T11:58:41.534 INFO:teuthology.orchestra.run.smithi138.stdout: "max_size_kb": 0, 2024-09-14T11:58:41.534 INFO:teuthology.orchestra.run.smithi138.stdout: "max_objects": -1 2024-09-14T11:58:41.534 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-09-14T11:58:41.534 INFO:teuthology.orchestra.run.smithi138.stdout: "temp_url_keys": [], 2024-09-14T11:58:41.534 INFO:teuthology.orchestra.run.smithi138.stdout: "type": "root", 2024-09-14T11:58:41.535 INFO:teuthology.orchestra.run.smithi138.stdout: "mfa_ids": [], 2024-09-14T11:58:41.535 INFO:teuthology.orchestra.run.smithi138.stdout: "account_id": "RGW11111111111111111", 2024-09-14T11:58:41.535 INFO:teuthology.orchestra.run.smithi138.stdout: "path": "/", 2024-09-14T11:58:41.535 INFO:teuthology.orchestra.run.smithi138.stdout: "create_date": "2024-09-14T11:58:41.518635Z", 2024-09-14T11:58:41.535 INFO:teuthology.orchestra.run.smithi138.stdout: "tags": [], 2024-09-14T11:58:41.535 INFO:teuthology.orchestra.run.smithi138.stdout: "group_ids": [] 2024-09-14T11:58:41.535 INFO:teuthology.orchestra.run.smithi138.stdout:} 2024-09-14T11:58:41.535 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-09-14T11:58:41.535 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:41.534+0000 7ff832fdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:58:41.537 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:41.538+0000 7ff97ecfc9c0 20 remove_watcher() i=0 2024-09-14T11:58:41.537 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:41.538+0000 7ff97ecfc9c0 2 removed watcher, disabling cache 2024-09-14T11:58:41.539 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:41.542+0000 7ff97ecfc9c0 20 remove_watcher() i=1 2024-09-14T11:58:41.541 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:41.542+0000 7ff97ecfc9c0 20 remove_watcher() i=2 2024-09-14T11:58:41.543 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:41.546+0000 7ff97ecfc9c0 20 remove_watcher() i=3 2024-09-14T11:58:41.545 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:41.546+0000 7ff97ecfc9c0 20 remove_watcher() i=4 2024-09-14T11:58:41.546 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:41.550+0000 7ff97ecfc9c0 20 remove_watcher() i=5 2024-09-14T11:58:41.548 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:41.550+0000 7ff97ecfc9c0 20 remove_watcher() i=6 2024-09-14T11:58:41.549 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:41.550+0000 7ff97ecfc9c0 20 remove_watcher() i=7 2024-09-14T11:58:41.564 DEBUG:teuthology.orchestra.run.smithi138:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 mfa create --uid foo.client.0 --totp-serial 8062718962 --totp-seed W76AHYV6D2EP74PLA53IIILXOZAWVHSYHSSSWDYGMFPQYUDZLJUBGQ2OFG33YG34 --totp-seconds 5 --totp-window 8 --totp-seed-type base32 --cluster ceph 2024-09-14T11:58:41.604 INFO:teuthology.orchestra.run.smithi138.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:58:41.604 INFO:teuthology.orchestra.run.smithi138.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:58:41.643 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:41.646+0000 7f9be8d539c0 20 rados->read ofs=0 len=0 2024-09-14T11:58:41.645 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:41.646+0000 7f9be8d539c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:58:41.645 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:41.646+0000 7f9be8d539c0 20 realm 2024-09-14T11:58:41.645 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:41.646+0000 7f9be8d539c0 20 rados->read ofs=0 len=0 2024-09-14T11:58:41.645 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:41.646+0000 7f9be8d539c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:58:41.645 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:41.646+0000 7f9be8d539c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:58:41.645 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:41.646+0000 7f9be8d539c0 20 rados->read ofs=0 len=0 2024-09-14T11:58:41.646 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:41.646+0000 7f9be8d539c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:58:41.646 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:41.646+0000 7f9be8d539c0 20 rados->read ofs=0 len=0 2024-09-14T11:58:41.647 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:41.650+0000 7f9be8d539c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:58:41.647 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:41.650+0000 7f9be8d539c0 20 rados->read ofs=0 len=0 2024-09-14T11:58:41.648 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:41.650+0000 7f9be8d539c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:58:41.648 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:41.650+0000 7f9be8d539c0 20 searching for the correct realm 2024-09-14T11:58:41.652 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:41.654+0000 7f9be705a640 0 -- 172.21.15.138:0/2623494814 >> [v2:172.21.15.154:6824/416768175,v1:172.21.15.154:6825/416768175] conn(0x7f9bd810d050 msgr2=0x7f9bd8009760 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:58:41.659 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:41.662+0000 7f9be6058640 0 -- 172.21.15.138:0/2623494814 >> [v2:172.21.15.138:6816/326481658,v1:172.21.15.138:6817/326481658] conn(0x7f9bd80ba110 msgr2=0x7f9bd810ed00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:58:41.878 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:41.878+0000 7f9be8d539c0 20 RGWRados::pool_iterate: got zone_info.d9e72d30-c60b-4d0d-9267-fdc36392d5ad 2024-09-14T11:58:41.878 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:41.878+0000 7f9be8d539c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:58:41.878 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:41.878+0000 7f9be8d539c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:58:41.878 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:41.878+0000 7f9be8d539c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:58:41.878 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:41.878+0000 7f9be8d539c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:58:41.878 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:41.878+0000 7f9be8d539c0 20 RGWRados::pool_iterate: got zonegroup_info.65ab941b-da8c-4160-94fb-3672b069d44f 2024-09-14T11:58:41.878 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:41.878+0000 7f9be8d539c0 20 rados->read ofs=0 len=0 2024-09-14T11:58:41.878 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:41.878+0000 7f9be8d539c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:58:41.878 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:41.878+0000 7f9be8d539c0 20 rados->read ofs=0 len=0 2024-09-14T11:58:41.879 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:41.882+0000 7f9be8d539c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:58:41.879 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:41.882+0000 7f9be8d539c0 20 rados->read ofs=0 len=0 2024-09-14T11:58:41.879 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:41.882+0000 7f9be8d539c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:58:41.880 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:41.882+0000 7f9be8d539c0 20 zone default found 2024-09-14T11:58:41.880 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:41.882+0000 7f9be8d539c0 4 Realm: () 2024-09-14T11:58:41.880 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:41.882+0000 7f9be8d539c0 4 ZoneGroup: default (65ab941b-da8c-4160-94fb-3672b069d44f) 2024-09-14T11:58:41.880 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:41.882+0000 7f9be8d539c0 4 Zone: default (d9e72d30-c60b-4d0d-9267-fdc36392d5ad) 2024-09-14T11:58:41.880 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:41.882+0000 7f9be8d539c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:58:41.880 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:41.882+0000 7f9be8d539c0 20 zonegroup default 2024-09-14T11:58:41.880 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:41.882+0000 7f9be8d539c0 20 rados->read ofs=0 len=0 2024-09-14T11:58:41.880 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:41.882+0000 7f9be8d539c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:58:41.880 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:41.882+0000 7f9be8d539c0 20 rados->read ofs=0 len=0 2024-09-14T11:58:41.881 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:41.882+0000 7f9be8d539c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:58:41.881 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:41.882+0000 7f9be8d539c0 20 rados->read ofs=0 len=0 2024-09-14T11:58:41.882 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:41.882+0000 7f9be8d539c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:58:41.882 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:41.882+0000 7f9be8d539c0 20 started sync module instance, tier type = 2024-09-14T11:58:41.882 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:41.882+0000 7f9be8d539c0 20 started zone id=d9e72d30-c60b-4d0d-9267-fdc36392d5ad (name=default) with tier type = 2024-09-14T11:58:41.905 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:41.906+0000 7f9be8d539c0 20 add_watcher() i=0 2024-09-14T11:58:41.905 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:41.906+0000 7f9be8d539c0 20 add_watcher() i=1 2024-09-14T11:58:41.905 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:41.906+0000 7f9be8d539c0 20 add_watcher() i=2 2024-09-14T11:58:41.905 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:41.906+0000 7f9be8d539c0 20 add_watcher() i=3 2024-09-14T11:58:41.905 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:41.906+0000 7f9be8d539c0 20 add_watcher() i=4 2024-09-14T11:58:41.905 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:41.906+0000 7f9be8d539c0 20 add_watcher() i=5 2024-09-14T11:58:41.905 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:41.906+0000 7f9be8d539c0 20 add_watcher() i=6 2024-09-14T11:58:41.907 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:41.910+0000 7f9be8d539c0 20 add_watcher() i=7 2024-09-14T11:58:41.907 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:41.910+0000 7f9be8d539c0 2 all 8 watchers are set, enabling cache 2024-09-14T11:58:41.911 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:41.914+0000 7f9a9d7e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:58:41.912 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:41.914+0000 7f9be8d539c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:58:41.912 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:41.914+0000 7f9be8d539c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:58:41.912 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:41.914+0000 7f9be8d539c0 5 note: GC not initialized 2024-09-14T11:58:41.912 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:41.914+0000 7f9a17fff640 20 reqs_thread_entry: start 2024-09-14T11:58:41.912 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:41.914+0000 7f9be8d539c0 20 init_complete bucket index max shards: 11 2024-09-14T11:58:41.913 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:41.914+0000 7f9be8d539c0 20 Filter name: none 2024-09-14T11:58:41.913 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:41.914+0000 7f9a15ffb640 20 reqs_thread_entry: start 2024-09-14T11:58:41.913 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:41.914+0000 7f9be8d539c0 10 cache get: name=default.rgw.meta+users.uid+foo.client.0 : miss 2024-09-14T11:58:41.913 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:41.914+0000 7f9be8d539c0 20 rados->read ofs=0 len=0 2024-09-14T11:58:41.914 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:41.914+0000 7f9be8d539c0 20 rados_obj.operate() r=0 bl.length=488 2024-09-14T11:58:41.914 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:41.914+0000 7f9be8d539c0 10 cache put: name=default.rgw.meta+users.uid+foo.client.0 info.flags=0x13 2024-09-14T11:58:41.914 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:41.914+0000 7f9be8d539c0 10 adding default.rgw.meta+users.uid+foo.client.0 to cache LRU end 2024-09-14T11:58:41.914 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:41.914+0000 7f9be8d539c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:58:43.698 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:43.698+0000 7f9be8d539c0 10 cache put: name=default.rgw.meta+users.uid+foo.client.0 info.flags=0x17 2024-09-14T11:58:43.698 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:43.698+0000 7f9be8d539c0 10 moving default.rgw.meta+users.uid+foo.client.0 to cache LRU end 2024-09-14T11:58:43.698 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:43.698+0000 7f9be8d539c0 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 0, obj: default.rgw.meta:users.uid:foo.client.0, ofs0, ns] 2024-09-14T11:58:43.698 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:43.702+0000 7f9ac9ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1142461300943 cookie 94711558587232 notifier 8342 bl.length()=687 2024-09-14T11:58:43.698 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:43.702+0000 7f9ac9ffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+foo.client.0 info.flags=0x17 2024-09-14T11:58:43.699 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:43.702+0000 7f9ac9ffb640 10 rgw watcher librados: moving default.rgw.meta+users.uid+foo.client.0 to cache LRU end 2024-09-14T11:58:43.704 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:43.706+0000 7f9a9d7e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:58:43.709 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:43.710+0000 7f9be8d539c0 20 remove_watcher() i=0 2024-09-14T11:58:43.709 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:43.710+0000 7f9be8d539c0 2 removed watcher, disabling cache 2024-09-14T11:58:43.711 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:43.714+0000 7f9be8d539c0 20 remove_watcher() i=1 2024-09-14T11:58:43.713 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:43.714+0000 7f9be8d539c0 20 remove_watcher() i=2 2024-09-14T11:58:43.716 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:43.718+0000 7f9be8d539c0 20 remove_watcher() i=3 2024-09-14T11:58:43.718 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:43.722+0000 7f9be8d539c0 20 remove_watcher() i=4 2024-09-14T11:58:43.721 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:43.722+0000 7f9be8d539c0 20 remove_watcher() i=5 2024-09-14T11:58:43.722 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:43.726+0000 7f9be8d539c0 20 remove_watcher() i=6 2024-09-14T11:58:43.724 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:43.726+0000 7f9be8d539c0 20 remove_watcher() i=7 2024-09-14T11:58:43.743 DEBUG:tasks.s3tests:Creating user bar.client.0 on client.0 2024-09-14T11:58:43.743 DEBUG:teuthology.orchestra.run.smithi138:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 user create --uid bar.client.0 --display-name Mr.bar.client.0 --email bar+test@test.test --access-key EMWZWNMHHLXRQEGJJIQA --secret jc4175PY8FBV7D3Qnfsgcbojaq7H/HdT6hfSXtjnb8qjd1cXkTEszQ== --cluster ceph 2024-09-14T11:58:43.831 INFO:teuthology.orchestra.run.smithi138.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:58:43.831 INFO:teuthology.orchestra.run.smithi138.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:58:43.873 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:43.873+0000 7f4e8d25c9c0 20 rados->read ofs=0 len=0 2024-09-14T11:58:43.875 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:43.877+0000 7f4e8d25c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:58:43.875 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:43.877+0000 7f4e8d25c9c0 20 realm 2024-09-14T11:58:43.875 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:43.877+0000 7f4e8d25c9c0 20 rados->read ofs=0 len=0 2024-09-14T11:58:43.875 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:43.877+0000 7f4e8d25c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:58:43.875 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:43.877+0000 7f4e8d25c9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:58:43.875 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:43.877+0000 7f4e8d25c9c0 20 rados->read ofs=0 len=0 2024-09-14T11:58:43.875 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:43.877+0000 7f4e8d25c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:58:43.875 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:43.877+0000 7f4e8d25c9c0 20 rados->read ofs=0 len=0 2024-09-14T11:58:43.877 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:43.877+0000 7f4e8d25c9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:58:43.877 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:43.877+0000 7f4e8d25c9c0 20 rados->read ofs=0 len=0 2024-09-14T11:58:43.878 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:43.877+0000 7f4e8d25c9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:58:43.878 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:43.877+0000 7f4e8d25c9c0 20 searching for the correct realm 2024-09-14T11:58:43.881 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:43.881+0000 7f4e8b563640 0 -- 172.21.15.138:0/1623613301 >> [v2:172.21.15.154:6824/416768175,v1:172.21.15.154:6825/416768175] conn(0x7f4e840c0020 msgr2=0x7f4e840f7ed0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:58:44.096 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:44.097+0000 7f4e8a561640 0 -- 172.21.15.138:0/1623613301 >> [v2:172.21.15.138:6816/326481658,v1:172.21.15.138:6817/326481658] conn(0x7f4e8411e0c0 msgr2=0x7f4e840f75d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:58:44.313 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:44.313+0000 7f4e8d25c9c0 20 RGWRados::pool_iterate: got zone_info.d9e72d30-c60b-4d0d-9267-fdc36392d5ad 2024-09-14T11:58:44.313 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:44.313+0000 7f4e8d25c9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:58:44.313 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:44.313+0000 7f4e8d25c9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:58:44.314 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:44.313+0000 7f4e8d25c9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:58:44.314 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:44.313+0000 7f4e8d25c9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:58:44.314 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:44.313+0000 7f4e8d25c9c0 20 RGWRados::pool_iterate: got zonegroup_info.65ab941b-da8c-4160-94fb-3672b069d44f 2024-09-14T11:58:44.314 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:44.313+0000 7f4e8d25c9c0 20 rados->read ofs=0 len=0 2024-09-14T11:58:44.314 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:44.313+0000 7f4e8d25c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:58:44.314 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:44.313+0000 7f4e8d25c9c0 20 rados->read ofs=0 len=0 2024-09-14T11:58:44.315 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:44.317+0000 7f4e8d25c9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:58:44.315 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:44.317+0000 7f4e8d25c9c0 20 rados->read ofs=0 len=0 2024-09-14T11:58:44.316 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:44.317+0000 7f4e8d25c9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:58:44.316 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:44.317+0000 7f4e8d25c9c0 20 zone default found 2024-09-14T11:58:44.316 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:44.317+0000 7f4e8d25c9c0 4 Realm: () 2024-09-14T11:58:44.316 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:44.317+0000 7f4e8d25c9c0 4 ZoneGroup: default (65ab941b-da8c-4160-94fb-3672b069d44f) 2024-09-14T11:58:44.316 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:44.317+0000 7f4e8d25c9c0 4 Zone: default (d9e72d30-c60b-4d0d-9267-fdc36392d5ad) 2024-09-14T11:58:44.316 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:44.317+0000 7f4e8d25c9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:58:44.316 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:44.317+0000 7f4e8d25c9c0 20 zonegroup default 2024-09-14T11:58:44.316 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:44.317+0000 7f4e8d25c9c0 20 rados->read ofs=0 len=0 2024-09-14T11:58:44.317 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:44.317+0000 7f4e8d25c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:58:44.317 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:44.317+0000 7f4e8d25c9c0 20 rados->read ofs=0 len=0 2024-09-14T11:58:44.317 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:44.317+0000 7f4e8d25c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:58:44.317 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:44.317+0000 7f4e8d25c9c0 20 rados->read ofs=0 len=0 2024-09-14T11:58:44.318 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:44.317+0000 7f4e8d25c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:58:44.318 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:44.317+0000 7f4e8d25c9c0 20 started sync module instance, tier type = 2024-09-14T11:58:44.318 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:44.317+0000 7f4e8d25c9c0 20 started zone id=d9e72d30-c60b-4d0d-9267-fdc36392d5ad (name=default) with tier type = 2024-09-14T11:58:44.339 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:44.341+0000 7f4e8d25c9c0 20 add_watcher() i=0 2024-09-14T11:58:44.339 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:44.341+0000 7f4e8d25c9c0 20 add_watcher() i=1 2024-09-14T11:58:44.339 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:44.341+0000 7f4e8d25c9c0 20 add_watcher() i=2 2024-09-14T11:58:44.339 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:44.341+0000 7f4e8d25c9c0 20 add_watcher() i=3 2024-09-14T11:58:44.339 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:44.341+0000 7f4e8d25c9c0 20 add_watcher() i=4 2024-09-14T11:58:44.339 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:44.341+0000 7f4e8d25c9c0 20 add_watcher() i=5 2024-09-14T11:58:44.339 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:44.341+0000 7f4e8d25c9c0 20 add_watcher() i=6 2024-09-14T11:58:44.341 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:44.341+0000 7f4e8d25c9c0 20 add_watcher() i=7 2024-09-14T11:58:44.341 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:44.341+0000 7f4e8d25c9c0 2 all 8 watchers are set, enabling cache 2024-09-14T11:58:44.345 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:44.345+0000 7f4d41fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:58:44.345 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:44.345+0000 7f4e8d25c9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:58:44.345 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:44.345+0000 7f4e8d25c9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:58:44.345 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:44.345+0000 7f4e8d25c9c0 5 note: GC not initialized 2024-09-14T11:58:44.345 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:44.345+0000 7f4d40fe1640 20 reqs_thread_entry: start 2024-09-14T11:58:44.345 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:44.345+0000 7f4e8d25c9c0 20 init_complete bucket index max shards: 11 2024-09-14T11:58:44.345 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:44.345+0000 7f4e8d25c9c0 20 Filter name: none 2024-09-14T11:58:44.346 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:44.345+0000 7f4d39ffb640 20 reqs_thread_entry: start 2024-09-14T11:58:44.346 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:44.345+0000 7f4e8d25c9c0 10 cache get: name=default.rgw.meta+users.uid+bar.client.0 : miss 2024-09-14T11:58:44.346 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:44.345+0000 7f4e8d25c9c0 20 rados->read ofs=0 len=0 2024-09-14T11:58:44.346 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:44.345+0000 7f4e8d25c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:58:44.346 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:44.345+0000 7f4e8d25c9c0 10 cache put: name=default.rgw.meta+users.uid+bar.client.0 info.flags=0x0 2024-09-14T11:58:44.346 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:44.345+0000 7f4e8d25c9c0 10 adding default.rgw.meta+users.uid+bar.client.0 to cache LRU end 2024-09-14T11:58:44.346 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:44.345+0000 7f4e8d25c9c0 10 cache get: name=default.rgw.meta+users.email+bar+test@test.test : miss 2024-09-14T11:58:44.346 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:44.345+0000 7f4e8d25c9c0 20 rados->read ofs=0 len=0 2024-09-14T11:58:44.347 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:44.349+0000 7f4e8d25c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:58:44.347 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:44.349+0000 7f4e8d25c9c0 10 cache put: name=default.rgw.meta+users.email+bar+test@test.test info.flags=0x0 2024-09-14T11:58:44.347 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:44.349+0000 7f4e8d25c9c0 10 adding default.rgw.meta+users.email+bar+test@test.test to cache LRU end 2024-09-14T11:58:44.347 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:44.349+0000 7f4e8d25c9c0 10 cache get: name=default.rgw.meta+users.keys+EMWZWNMHHLXRQEGJJIQA : miss 2024-09-14T11:58:44.347 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:44.349+0000 7f4e8d25c9c0 20 rados->read ofs=0 len=0 2024-09-14T11:58:44.348 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:44.349+0000 7f4e8d25c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:58:44.348 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:44.349+0000 7f4e8d25c9c0 10 cache put: name=default.rgw.meta+users.keys+EMWZWNMHHLXRQEGJJIQA info.flags=0x0 2024-09-14T11:58:44.348 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:44.349+0000 7f4e8d25c9c0 10 adding default.rgw.meta+users.keys+EMWZWNMHHLXRQEGJJIQA to cache LRU end 2024-09-14T11:58:44.348 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:44.349+0000 7f4e8d25c9c0 10 cache get: name=default.rgw.meta+users.keys+EMWZWNMHHLXRQEGJJIQA : hit (negative entry) 2024-09-14T11:58:44.348 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:44.349+0000 7f4e8d25c9c0 10 cache get: name=default.rgw.meta+users.keys+EMWZWNMHHLXRQEGJJIQA : hit (negative entry) 2024-09-14T11:58:44.350 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:44.353+0000 7f4e8d25c9c0 10 cache put: name=default.rgw.meta+users.uid+bar.client.0 info.flags=0x17 2024-09-14T11:58:44.351 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:44.353+0000 7f4e8d25c9c0 10 moving default.rgw.meta+users.uid+bar.client.0 to cache LRU end 2024-09-14T11:58:44.351 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:44.353+0000 7f4e8d25c9c0 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:users.uid:bar.client.0, ofs0, ns] 2024-09-14T11:58:44.351 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:44.353+0000 7f4d6e7fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1142461300899 cookie 94080192489216 notifier 8973 bl.length()=645 2024-09-14T11:58:44.351 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:44.353+0000 7f4d6e7fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+bar.client.0 info.flags=0x17 2024-09-14T11:58:44.352 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:44.353+0000 7f4d6e7fc640 10 rgw watcher librados: moving default.rgw.meta+users.uid+bar.client.0 to cache LRU end 2024-09-14T11:58:44.356 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:44.357+0000 7f4e8d25c9c0 10 cache put: name=default.rgw.meta+users.email+bar+test@test.test info.flags=0x7 2024-09-14T11:58:44.356 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:44.357+0000 7f4e8d25c9c0 10 moving default.rgw.meta+users.email+bar+test@test.test to cache LRU end 2024-09-14T11:58:44.356 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:44.357+0000 7f4e8d25c9c0 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:users.email:bar+test@test.test, ofs0, ns] 2024-09-14T11:58:44.356 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:44.357+0000 7f4d6dffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1142461300918 cookie 94080192504192 notifier 8973 bl.length()=185 2024-09-14T11:58:44.357 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:44.357+0000 7f4d6dffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.email+bar+test@test.test info.flags=0x7 2024-09-14T11:58:44.357 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:44.357+0000 7f4d6dffb640 10 rgw watcher librados: moving default.rgw.meta+users.email+bar+test@test.test to cache LRU end 2024-09-14T11:58:44.361 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:44.361+0000 7f4e8d25c9c0 10 cache put: name=default.rgw.meta+users.keys+EMWZWNMHHLXRQEGJJIQA info.flags=0x7 2024-09-14T11:58:44.361 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:44.361+0000 7f4e8d25c9c0 10 moving default.rgw.meta+users.keys+EMWZWNMHHLXRQEGJJIQA to cache LRU end 2024-09-14T11:58:44.361 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:44.361+0000 7f4e8d25c9c0 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 0, obj: default.rgw.meta:users.keys:EMWZWNMHHLXRQEGJJIQA, ofs0, ns] 2024-09-14T11:58:44.362 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:44.361+0000 7f4d6dffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1142461300944 cookie 94080192484928 notifier 8973 bl.length()=186 2024-09-14T11:58:44.362 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:44.361+0000 7f4d6dffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.keys+EMWZWNMHHLXRQEGJJIQA info.flags=0x7 2024-09-14T11:58:44.362 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:44.361+0000 7f4d6dffb640 10 rgw watcher librados: moving default.rgw.meta+users.keys+EMWZWNMHHLXRQEGJJIQA to cache LRU end 2024-09-14T11:58:44.364 INFO:teuthology.orchestra.run.smithi138.stdout:{ 2024-09-14T11:58:44.364 INFO:teuthology.orchestra.run.smithi138.stdout: "user_id": "bar.client.0", 2024-09-14T11:58:44.364 INFO:teuthology.orchestra.run.smithi138.stdout: "display_name": "Mr.bar.client.0", 2024-09-14T11:58:44.364 INFO:teuthology.orchestra.run.smithi138.stdout: "email": "bar+test@test.test", 2024-09-14T11:58:44.364 INFO:teuthology.orchestra.run.smithi138.stdout: "suspended": 0, 2024-09-14T11:58:44.364 INFO:teuthology.orchestra.run.smithi138.stdout: "max_buckets": 1000, 2024-09-14T11:58:44.364 INFO:teuthology.orchestra.run.smithi138.stdout: "subusers": [], 2024-09-14T11:58:44.365 INFO:teuthology.orchestra.run.smithi138.stdout: "keys": [ 2024-09-14T11:58:44.365 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-09-14T11:58:44.365 INFO:teuthology.orchestra.run.smithi138.stdout: "user": "bar.client.0", 2024-09-14T11:58:44.365 INFO:teuthology.orchestra.run.smithi138.stdout: "access_key": "EMWZWNMHHLXRQEGJJIQA", 2024-09-14T11:58:44.365 INFO:teuthology.orchestra.run.smithi138.stdout: "secret_key": "jc4175PY8FBV7D3Qnfsgcbojaq7H/HdT6hfSXtjnb8qjd1cXkTEszQ==", 2024-09-14T11:58:44.365 INFO:teuthology.orchestra.run.smithi138.stdout: "active": true, 2024-09-14T11:58:44.365 INFO:teuthology.orchestra.run.smithi138.stdout: "create_date": "2024-09-14T11:58:44.354227Z" 2024-09-14T11:58:44.365 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-09-14T11:58:44.365 INFO:teuthology.orchestra.run.smithi138.stdout: ], 2024-09-14T11:58:44.365 INFO:teuthology.orchestra.run.smithi138.stdout: "swift_keys": [], 2024-09-14T11:58:44.365 INFO:teuthology.orchestra.run.smithi138.stdout: "caps": [], 2024-09-14T11:58:44.365 INFO:teuthology.orchestra.run.smithi138.stdout: "op_mask": "read, write, delete", 2024-09-14T11:58:44.365 INFO:teuthology.orchestra.run.smithi138.stdout: "default_placement": "", 2024-09-14T11:58:44.365 INFO:teuthology.orchestra.run.smithi138.stdout: "default_storage_class": "", 2024-09-14T11:58:44.366 INFO:teuthology.orchestra.run.smithi138.stdout: "placement_tags": [], 2024-09-14T11:58:44.366 INFO:teuthology.orchestra.run.smithi138.stdout: "bucket_quota": { 2024-09-14T11:58:44.366 INFO:teuthology.orchestra.run.smithi138.stdout: "enabled": false, 2024-09-14T11:58:44.366 INFO:teuthology.orchestra.run.smithi138.stdout: "check_on_raw": false, 2024-09-14T11:58:44.366 INFO:teuthology.orchestra.run.smithi138.stdout: "max_size": -1, 2024-09-14T11:58:44.366 INFO:teuthology.orchestra.run.smithi138.stdout: "max_size_kb": 0, 2024-09-14T11:58:44.366 INFO:teuthology.orchestra.run.smithi138.stdout: "max_objects": -1 2024-09-14T11:58:44.366 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-09-14T11:58:44.366 INFO:teuthology.orchestra.run.smithi138.stdout: "user_quota": { 2024-09-14T11:58:44.366 INFO:teuthology.orchestra.run.smithi138.stdout: "enabled": false, 2024-09-14T11:58:44.366 INFO:teuthology.orchestra.run.smithi138.stdout: "check_on_raw": false, 2024-09-14T11:58:44.366 INFO:teuthology.orchestra.run.smithi138.stdout: "max_size": -1, 2024-09-14T11:58:44.366 INFO:teuthology.orchestra.run.smithi138.stdout: "max_size_kb": 0, 2024-09-14T11:58:44.366 INFO:teuthology.orchestra.run.smithi138.stdout: "max_objects": -1 2024-09-14T11:58:44.367 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-09-14T11:58:44.367 INFO:teuthology.orchestra.run.smithi138.stdout: "temp_url_keys": [], 2024-09-14T11:58:44.367 INFO:teuthology.orchestra.run.smithi138.stdout: "type": "rgw", 2024-09-14T11:58:44.367 INFO:teuthology.orchestra.run.smithi138.stdout: "mfa_ids": [], 2024-09-14T11:58:44.367 INFO:teuthology.orchestra.run.smithi138.stdout: "account_id": "", 2024-09-14T11:58:44.367 INFO:teuthology.orchestra.run.smithi138.stdout: "path": "/", 2024-09-14T11:58:44.367 INFO:teuthology.orchestra.run.smithi138.stdout: "create_date": "2024-09-14T11:58:44.354202Z", 2024-09-14T11:58:44.367 INFO:teuthology.orchestra.run.smithi138.stdout: "tags": [], 2024-09-14T11:58:44.367 INFO:teuthology.orchestra.run.smithi138.stdout: "group_ids": [] 2024-09-14T11:58:44.367 INFO:teuthology.orchestra.run.smithi138.stdout:} 2024-09-14T11:58:44.367 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-09-14T11:58:44.368 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:44.365+0000 7f4d41fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:58:44.371 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:44.373+0000 7f4e8d25c9c0 20 remove_watcher() i=0 2024-09-14T11:58:44.371 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:44.373+0000 7f4e8d25c9c0 2 removed watcher, disabling cache 2024-09-14T11:58:44.373 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:44.373+0000 7f4e8d25c9c0 20 remove_watcher() i=1 2024-09-14T11:58:44.375 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:44.377+0000 7f4e8d25c9c0 20 remove_watcher() i=2 2024-09-14T11:58:44.377 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:44.377+0000 7f4e8d25c9c0 20 remove_watcher() i=3 2024-09-14T11:58:44.380 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:44.381+0000 7f4e8d25c9c0 20 remove_watcher() i=4 2024-09-14T11:58:44.381 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:44.381+0000 7f4e8d25c9c0 20 remove_watcher() i=5 2024-09-14T11:58:44.383 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:44.385+0000 7f4e8d25c9c0 20 remove_watcher() i=6 2024-09-14T11:58:44.384 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:44.385+0000 7f4e8d25c9c0 20 remove_watcher() i=7 2024-09-14T11:58:44.402 DEBUG:teuthology.orchestra.run.smithi138:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 mfa create --uid bar.client.0 --totp-serial 4959345223 --totp-seed 77LAPKKPZ3LQQ2HHCJW54QKQZQ7K6TX6BTRJQIGSXTTNX3LBVBWJFYVSGN6X44ZJ --totp-seconds 5 --totp-window 8 --totp-seed-type base32 --cluster ceph 2024-09-14T11:58:44.447 INFO:teuthology.orchestra.run.smithi138.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:58:44.447 INFO:teuthology.orchestra.run.smithi138.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:58:44.488 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:44.489+0000 7f6870ccb9c0 20 rados->read ofs=0 len=0 2024-09-14T11:58:44.490 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:44.493+0000 7f6870ccb9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:58:44.490 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:44.493+0000 7f6870ccb9c0 20 realm 2024-09-14T11:58:44.490 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:44.493+0000 7f6870ccb9c0 20 rados->read ofs=0 len=0 2024-09-14T11:58:44.490 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:44.493+0000 7f6870ccb9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:58:44.490 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:44.493+0000 7f6870ccb9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:58:44.491 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:44.493+0000 7f6870ccb9c0 20 rados->read ofs=0 len=0 2024-09-14T11:58:44.491 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:44.493+0000 7f6870ccb9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:58:44.491 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:44.493+0000 7f6870ccb9c0 20 rados->read ofs=0 len=0 2024-09-14T11:58:44.492 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:44.493+0000 7f6870ccb9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:58:44.492 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:44.493+0000 7f6870ccb9c0 20 rados->read ofs=0 len=0 2024-09-14T11:58:44.493 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:44.493+0000 7f6870ccb9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:58:44.493 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:44.493+0000 7f6870ccb9c0 20 searching for the correct realm 2024-09-14T11:58:44.496 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:44.497+0000 7f686efd2640 0 -- 172.21.15.138:0/3539855630 >> [v2:172.21.15.154:6824/416768175,v1:172.21.15.154:6825/416768175] conn(0x7f686802c070 msgr2=0x7f68680637d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-14T11:58:44.745 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:44.745+0000 7f686dfd0640 0 -- 172.21.15.138:0/3539855630 >> [v2:172.21.15.138:6816/326481658,v1:172.21.15.138:6817/326481658] conn(0x7f6868008040 msgr2=0x7f6868098910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:58:44.969 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:44.969+0000 7f6870ccb9c0 20 RGWRados::pool_iterate: got zone_info.d9e72d30-c60b-4d0d-9267-fdc36392d5ad 2024-09-14T11:58:44.969 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:44.969+0000 7f6870ccb9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:58:44.969 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:44.969+0000 7f6870ccb9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:58:44.969 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:44.969+0000 7f6870ccb9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:58:44.969 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:44.969+0000 7f6870ccb9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:58:44.969 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:44.969+0000 7f6870ccb9c0 20 RGWRados::pool_iterate: got zonegroup_info.65ab941b-da8c-4160-94fb-3672b069d44f 2024-09-14T11:58:44.969 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:44.969+0000 7f6870ccb9c0 20 rados->read ofs=0 len=0 2024-09-14T11:58:44.969 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:44.969+0000 7f6870ccb9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:58:44.970 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:44.969+0000 7f6870ccb9c0 20 rados->read ofs=0 len=0 2024-09-14T11:58:44.970 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:44.969+0000 7f6870ccb9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:58:44.970 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:44.969+0000 7f6870ccb9c0 20 rados->read ofs=0 len=0 2024-09-14T11:58:44.971 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:44.973+0000 7f6870ccb9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:58:44.971 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:44.973+0000 7f6870ccb9c0 20 zone default found 2024-09-14T11:58:44.971 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:44.973+0000 7f6870ccb9c0 4 Realm: () 2024-09-14T11:58:44.971 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:44.973+0000 7f6870ccb9c0 4 ZoneGroup: default (65ab941b-da8c-4160-94fb-3672b069d44f) 2024-09-14T11:58:44.971 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:44.973+0000 7f6870ccb9c0 4 Zone: default (d9e72d30-c60b-4d0d-9267-fdc36392d5ad) 2024-09-14T11:58:44.971 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:44.973+0000 7f6870ccb9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:58:44.971 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:44.973+0000 7f6870ccb9c0 20 zonegroup default 2024-09-14T11:58:44.971 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:44.973+0000 7f6870ccb9c0 20 rados->read ofs=0 len=0 2024-09-14T11:58:44.972 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:44.973+0000 7f6870ccb9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:58:44.972 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:44.973+0000 7f6870ccb9c0 20 rados->read ofs=0 len=0 2024-09-14T11:58:44.972 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:44.973+0000 7f6870ccb9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:58:44.972 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:44.973+0000 7f6870ccb9c0 20 rados->read ofs=0 len=0 2024-09-14T11:58:44.973 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:44.973+0000 7f6870ccb9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:58:44.973 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:44.973+0000 7f6870ccb9c0 20 started sync module instance, tier type = 2024-09-14T11:58:44.973 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:44.973+0000 7f6870ccb9c0 20 started zone id=d9e72d30-c60b-4d0d-9267-fdc36392d5ad (name=default) with tier type = 2024-09-14T11:58:44.998 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:44.997+0000 7f6870ccb9c0 20 add_watcher() i=0 2024-09-14T11:58:44.998 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:44.997+0000 7f6870ccb9c0 20 add_watcher() i=1 2024-09-14T11:58:44.998 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:44.997+0000 7f6870ccb9c0 20 add_watcher() i=2 2024-09-14T11:58:44.998 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:44.997+0000 7f6870ccb9c0 20 add_watcher() i=3 2024-09-14T11:58:44.998 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:44.997+0000 7f6870ccb9c0 20 add_watcher() i=4 2024-09-14T11:58:44.998 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:44.997+0000 7f6870ccb9c0 20 add_watcher() i=5 2024-09-14T11:58:44.998 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:44.997+0000 7f6870ccb9c0 20 add_watcher() i=6 2024-09-14T11:58:45.000 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:45.001+0000 7f6870ccb9c0 20 add_watcher() i=7 2024-09-14T11:58:45.000 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:45.001+0000 7f6870ccb9c0 2 all 8 watchers are set, enabling cache 2024-09-14T11:58:45.005 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:45.005+0000 7f6724fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:58:45.005 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:45.005+0000 7f6870ccb9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:58:45.005 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:45.005+0000 7f6870ccb9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:58:45.005 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:45.005+0000 7f6870ccb9c0 5 note: GC not initialized 2024-09-14T11:58:45.006 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:45.005+0000 7f669f7fe640 20 reqs_thread_entry: start 2024-09-14T11:58:45.006 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:45.005+0000 7f6870ccb9c0 20 init_complete bucket index max shards: 11 2024-09-14T11:58:45.006 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:45.005+0000 7f6870ccb9c0 20 Filter name: none 2024-09-14T11:58:45.006 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:45.009+0000 7f669d7fa640 20 reqs_thread_entry: start 2024-09-14T11:58:45.006 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:45.009+0000 7f6870ccb9c0 10 cache get: name=default.rgw.meta+users.uid+bar.client.0 : miss 2024-09-14T11:58:45.007 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:45.009+0000 7f6870ccb9c0 20 rados->read ofs=0 len=0 2024-09-14T11:58:45.008 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:45.009+0000 7f6870ccb9c0 20 rados_obj.operate() r=0 bl.length=460 2024-09-14T11:58:45.008 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:45.009+0000 7f6870ccb9c0 10 cache put: name=default.rgw.meta+users.uid+bar.client.0 info.flags=0x13 2024-09-14T11:58:45.008 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:45.009+0000 7f6870ccb9c0 10 adding default.rgw.meta+users.uid+bar.client.0 to cache LRU end 2024-09-14T11:58:45.008 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:45.009+0000 7f6870ccb9c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:58:45.014 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:45.013+0000 7f6870ccb9c0 10 cache put: name=default.rgw.meta+users.uid+bar.client.0 info.flags=0x17 2024-09-14T11:58:45.014 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:45.013+0000 7f6870ccb9c0 10 moving default.rgw.meta+users.uid+bar.client.0 to cache LRU end 2024-09-14T11:58:45.014 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:45.013+0000 7f6870ccb9c0 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:users.uid:bar.client.0, ofs0, ns] 2024-09-14T11:58:45.015 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:45.017+0000 7f67517fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1146756268196 cookie 94552872744048 notifier 8991 bl.length()=659 2024-09-14T11:58:45.015 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:45.017+0000 7f67517fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+bar.client.0 info.flags=0x17 2024-09-14T11:58:45.015 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:45.017+0000 7f67517fa640 10 rgw watcher librados: moving default.rgw.meta+users.uid+bar.client.0 to cache LRU end 2024-09-14T11:58:45.019 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:45.021+0000 7f6724fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:58:45.024 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:45.025+0000 7f6870ccb9c0 20 remove_watcher() i=0 2024-09-14T11:58:45.024 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:45.025+0000 7f6870ccb9c0 2 removed watcher, disabling cache 2024-09-14T11:58:45.026 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:45.029+0000 7f6870ccb9c0 20 remove_watcher() i=1 2024-09-14T11:58:45.029 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:45.029+0000 7f6870ccb9c0 20 remove_watcher() i=2 2024-09-14T11:58:45.031 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:45.033+0000 7f6870ccb9c0 20 remove_watcher() i=3 2024-09-14T11:58:45.033 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:45.033+0000 7f6870ccb9c0 20 remove_watcher() i=4 2024-09-14T11:58:45.035 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:45.037+0000 7f6870ccb9c0 20 remove_watcher() i=5 2024-09-14T11:58:45.036 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:45.037+0000 7f6870ccb9c0 20 remove_watcher() i=6 2024-09-14T11:58:45.038 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:45.041+0000 7f6870ccb9c0 20 remove_watcher() i=7 2024-09-14T11:58:45.053 DEBUG:tasks.s3tests:Creating user testx$tenanteduser.client.0 on client.0 2024-09-14T11:58:45.054 DEBUG:teuthology.orchestra.run.smithi138:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 user create --uid 'testx$tenanteduser.client.0' --display-name 'Mr.testx$tenanteduser.client.0' --email 'testx$tenanteduser+test@test.test' --access-key VBYKFYWAVPVVQRSNUNBR --secret k683G6X/Kwj9Cfd/Bq0WCbz8BwDNbWlnUvvomlX60BRysuNOSbqH6g== --cluster ceph 2024-09-14T11:58:45.096 INFO:teuthology.orchestra.run.smithi138.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:58:45.096 INFO:teuthology.orchestra.run.smithi138.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:58:45.137 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:45.137+0000 7f6122c659c0 20 rados->read ofs=0 len=0 2024-09-14T11:58:45.139 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:45.141+0000 7f6122c659c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:58:45.140 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:45.141+0000 7f6122c659c0 20 realm 2024-09-14T11:58:45.140 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:45.141+0000 7f6122c659c0 20 rados->read ofs=0 len=0 2024-09-14T11:58:45.140 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:45.141+0000 7f6122c659c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:58:45.140 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:45.141+0000 7f6122c659c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:58:45.140 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:45.141+0000 7f6122c659c0 20 rados->read ofs=0 len=0 2024-09-14T11:58:45.140 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:45.141+0000 7f6122c659c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:58:45.140 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:45.141+0000 7f6122c659c0 20 rados->read ofs=0 len=0 2024-09-14T11:58:45.141 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:45.141+0000 7f6122c659c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:58:45.141 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:45.141+0000 7f6122c659c0 20 rados->read ofs=0 len=0 2024-09-14T11:58:45.142 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:45.145+0000 7f6122c659c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:58:45.142 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:45.145+0000 7f6122c659c0 20 searching for the correct realm 2024-09-14T11:58:45.146 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:45.149+0000 7f6120f6c640 0 -- 172.21.15.138:0/1587657082 >> [v2:172.21.15.154:6824/416768175,v1:172.21.15.154:6825/416768175] conn(0x7f61180f4130 msgr2=0x7f61180b7750 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:58:45.153 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:45.153+0000 7f611ff6a640 0 -- 172.21.15.138:0/1587657082 >> [v2:172.21.15.138:6816/326481658,v1:172.21.15.138:6817/326481658] conn(0x7f611810eba0 msgr2=0x7f61180b8a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:58:45.368 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:45.369+0000 7f6122c659c0 20 RGWRados::pool_iterate: got zone_info.d9e72d30-c60b-4d0d-9267-fdc36392d5ad 2024-09-14T11:58:45.369 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:45.369+0000 7f6122c659c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:58:45.369 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:45.369+0000 7f6122c659c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:58:45.369 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:45.369+0000 7f6122c659c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:58:45.369 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:45.369+0000 7f6122c659c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:58:45.369 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:45.369+0000 7f6122c659c0 20 RGWRados::pool_iterate: got zonegroup_info.65ab941b-da8c-4160-94fb-3672b069d44f 2024-09-14T11:58:45.369 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:45.369+0000 7f6122c659c0 20 rados->read ofs=0 len=0 2024-09-14T11:58:45.369 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:45.369+0000 7f6122c659c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:58:45.369 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:45.369+0000 7f6122c659c0 20 rados->read ofs=0 len=0 2024-09-14T11:58:45.370 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:45.373+0000 7f6122c659c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:58:45.370 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:45.373+0000 7f6122c659c0 20 rados->read ofs=0 len=0 2024-09-14T11:58:45.371 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:45.373+0000 7f6122c659c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:58:45.371 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:45.373+0000 7f6122c659c0 20 zone default found 2024-09-14T11:58:45.371 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:45.373+0000 7f6122c659c0 4 Realm: () 2024-09-14T11:58:45.371 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:45.373+0000 7f6122c659c0 4 ZoneGroup: default (65ab941b-da8c-4160-94fb-3672b069d44f) 2024-09-14T11:58:45.371 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:45.373+0000 7f6122c659c0 4 Zone: default (d9e72d30-c60b-4d0d-9267-fdc36392d5ad) 2024-09-14T11:58:45.371 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:45.373+0000 7f6122c659c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:58:45.372 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:45.373+0000 7f6122c659c0 20 zonegroup default 2024-09-14T11:58:45.372 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:45.373+0000 7f6122c659c0 20 rados->read ofs=0 len=0 2024-09-14T11:58:45.372 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:45.373+0000 7f6122c659c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:58:45.372 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:45.373+0000 7f6122c659c0 20 rados->read ofs=0 len=0 2024-09-14T11:58:45.373 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:45.373+0000 7f6122c659c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:58:45.373 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:45.373+0000 7f6122c659c0 20 rados->read ofs=0 len=0 2024-09-14T11:58:45.374 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:45.373+0000 7f6122c659c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:58:45.374 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:45.373+0000 7f6122c659c0 20 started sync module instance, tier type = 2024-09-14T11:58:45.374 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:45.373+0000 7f6122c659c0 20 started zone id=d9e72d30-c60b-4d0d-9267-fdc36392d5ad (name=default) with tier type = 2024-09-14T11:58:45.397 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:45.397+0000 7f6122c659c0 20 add_watcher() i=0 2024-09-14T11:58:45.398 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:45.397+0000 7f6122c659c0 20 add_watcher() i=1 2024-09-14T11:58:45.398 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:45.397+0000 7f6122c659c0 20 add_watcher() i=2 2024-09-14T11:58:45.398 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:45.397+0000 7f6122c659c0 20 add_watcher() i=3 2024-09-14T11:58:45.398 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:45.397+0000 7f6122c659c0 20 add_watcher() i=4 2024-09-14T11:58:45.398 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:45.397+0000 7f6122c659c0 20 add_watcher() i=5 2024-09-14T11:58:45.398 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:45.397+0000 7f6122c659c0 20 add_watcher() i=6 2024-09-14T11:58:45.400 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:45.401+0000 7f6122c659c0 20 add_watcher() i=7 2024-09-14T11:58:45.400 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:45.401+0000 7f6122c659c0 2 all 8 watchers are set, enabling cache 2024-09-14T11:58:45.404 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:45.405+0000 7f5fd6fdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:58:45.404 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:45.405+0000 7f6122c659c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:58:45.404 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:45.405+0000 7f6122c659c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:58:45.404 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:45.405+0000 7f6122c659c0 5 note: GC not initialized 2024-09-14T11:58:45.405 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:45.405+0000 7f5fd5fdb640 20 reqs_thread_entry: start 2024-09-14T11:58:45.405 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:45.405+0000 7f6122c659c0 20 init_complete bucket index max shards: 11 2024-09-14T11:58:45.405 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:45.405+0000 7f6122c659c0 20 Filter name: none 2024-09-14T11:58:45.406 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:45.405+0000 7f5f477fe640 20 reqs_thread_entry: start 2024-09-14T11:58:45.406 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:45.405+0000 7f6122c659c0 10 cache get: name=default.rgw.meta+users.uid+testx$tenanteduser.client.0 : miss 2024-09-14T11:58:45.406 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:45.405+0000 7f6122c659c0 20 rados->read ofs=0 len=0 2024-09-14T11:58:45.406 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:45.409+0000 7f6122c659c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:58:45.406 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:45.409+0000 7f6122c659c0 10 cache put: name=default.rgw.meta+users.uid+testx$tenanteduser.client.0 info.flags=0x0 2024-09-14T11:58:45.407 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:45.409+0000 7f6122c659c0 10 adding default.rgw.meta+users.uid+testx$tenanteduser.client.0 to cache LRU end 2024-09-14T11:58:45.407 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:45.409+0000 7f6122c659c0 10 cache get: name=default.rgw.meta+users.email+testx$tenanteduser+test@test.test : miss 2024-09-14T11:58:45.407 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:45.409+0000 7f6122c659c0 20 rados->read ofs=0 len=0 2024-09-14T11:58:45.407 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:45.409+0000 7f6122c659c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:58:45.407 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:45.409+0000 7f6122c659c0 10 cache put: name=default.rgw.meta+users.email+testx$tenanteduser+test@test.test info.flags=0x0 2024-09-14T11:58:45.408 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:45.409+0000 7f6122c659c0 10 adding default.rgw.meta+users.email+testx$tenanteduser+test@test.test to cache LRU end 2024-09-14T11:58:45.408 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:45.409+0000 7f6122c659c0 10 cache get: name=default.rgw.meta+users.keys+VBYKFYWAVPVVQRSNUNBR : miss 2024-09-14T11:58:45.408 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:45.409+0000 7f6122c659c0 20 rados->read ofs=0 len=0 2024-09-14T11:58:45.408 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:45.409+0000 7f6122c659c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:58:45.408 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:45.409+0000 7f6122c659c0 10 cache put: name=default.rgw.meta+users.keys+VBYKFYWAVPVVQRSNUNBR info.flags=0x0 2024-09-14T11:58:45.408 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:45.409+0000 7f6122c659c0 10 adding default.rgw.meta+users.keys+VBYKFYWAVPVVQRSNUNBR to cache LRU end 2024-09-14T11:58:45.408 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:45.409+0000 7f6122c659c0 10 cache get: name=default.rgw.meta+users.keys+VBYKFYWAVPVVQRSNUNBR : hit (negative entry) 2024-09-14T11:58:45.408 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:45.409+0000 7f6122c659c0 10 cache get: name=default.rgw.meta+users.keys+VBYKFYWAVPVVQRSNUNBR : hit (negative entry) 2024-09-14T11:58:45.410 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:45.409+0000 7f6122c659c0 10 cache put: name=default.rgw.meta+users.uid+testx$tenanteduser.client.0 info.flags=0x17 2024-09-14T11:58:45.410 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:45.409+0000 7f6122c659c0 10 moving default.rgw.meta+users.uid+testx$tenanteduser.client.0 to cache LRU end 2024-09-14T11:58:45.410 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:45.409+0000 7f6122c659c0 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:users.uid:testx$tenanteduser.client.0, ofs0, ns] 2024-09-14T11:58:45.410 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:45.413+0000 7f5ff77fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1146756268215 cookie 94584212922544 notifier 9012 bl.length()=719 2024-09-14T11:58:45.411 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:45.413+0000 7f5ff77fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+testx$tenanteduser.client.0 info.flags=0x17 2024-09-14T11:58:45.411 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:45.413+0000 7f5ff77fe640 10 rgw watcher librados: moving default.rgw.meta+users.uid+testx$tenanteduser.client.0 to cache LRU end 2024-09-14T11:58:45.416 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:45.417+0000 7f6122c659c0 10 cache put: name=default.rgw.meta+users.email+testx$tenanteduser+test@test.test info.flags=0x7 2024-09-14T11:58:45.416 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:45.417+0000 7f6122c659c0 10 moving default.rgw.meta+users.email+testx$tenanteduser+test@test.test to cache LRU end 2024-09-14T11:58:45.417 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:45.417+0000 7f6122c659c0 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 0, obj: default.rgw.meta:users.email:testx$tenanteduser+test@test.test, ofs0, ns] 2024-09-14T11:58:45.417 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:45.417+0000 7f5ff77fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1146756268144 cookie 94584212920048 notifier 9012 bl.length()=215 2024-09-14T11:58:45.417 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:45.417+0000 7f5ff77fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.email+testx$tenanteduser+test@test.test info.flags=0x7 2024-09-14T11:58:45.417 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:45.417+0000 7f5ff77fe640 10 rgw watcher librados: moving default.rgw.meta+users.email+testx$tenanteduser+test@test.test to cache LRU end 2024-09-14T11:58:45.421 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:45.421+0000 7f6122c659c0 10 cache put: name=default.rgw.meta+users.keys+VBYKFYWAVPVVQRSNUNBR info.flags=0x7 2024-09-14T11:58:45.421 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:45.421+0000 7f6122c659c0 10 moving default.rgw.meta+users.keys+VBYKFYWAVPVVQRSNUNBR to cache LRU end 2024-09-14T11:58:45.421 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:45.421+0000 7f6122c659c0 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.keys:VBYKFYWAVPVVQRSNUNBR, ofs0, ns] 2024-09-14T11:58:45.422 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:45.425+0000 7f5ff77fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1146756268241 cookie 94584212916608 notifier 9012 bl.length()=201 2024-09-14T11:58:45.422 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:45.425+0000 7f5ff77fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.keys+VBYKFYWAVPVVQRSNUNBR info.flags=0x7 2024-09-14T11:58:45.422 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:45.425+0000 7f5ff77fe640 10 rgw watcher librados: moving default.rgw.meta+users.keys+VBYKFYWAVPVVQRSNUNBR to cache LRU end 2024-09-14T11:58:45.425 INFO:teuthology.orchestra.run.smithi138.stdout:{ 2024-09-14T11:58:45.425 INFO:teuthology.orchestra.run.smithi138.stdout: "user_id": "testx$tenanteduser.client.0", 2024-09-14T11:58:45.425 INFO:teuthology.orchestra.run.smithi138.stdout: "display_name": "Mr.testx$tenanteduser.client.0", 2024-09-14T11:58:45.425 INFO:teuthology.orchestra.run.smithi138.stdout: "email": "testx$tenanteduser+test@test.test", 2024-09-14T11:58:45.425 INFO:teuthology.orchestra.run.smithi138.stdout: "suspended": 0, 2024-09-14T11:58:45.425 INFO:teuthology.orchestra.run.smithi138.stdout: "max_buckets": 1000, 2024-09-14T11:58:45.425 INFO:teuthology.orchestra.run.smithi138.stdout: "subusers": [], 2024-09-14T11:58:45.426 INFO:teuthology.orchestra.run.smithi138.stdout: "keys": [ 2024-09-14T11:58:45.426 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-09-14T11:58:45.426 INFO:teuthology.orchestra.run.smithi138.stdout: "user": "testx$tenanteduser.client.0", 2024-09-14T11:58:45.426 INFO:teuthology.orchestra.run.smithi138.stdout: "access_key": "VBYKFYWAVPVVQRSNUNBR", 2024-09-14T11:58:45.426 INFO:teuthology.orchestra.run.smithi138.stdout: "secret_key": "k683G6X/Kwj9Cfd/Bq0WCbz8BwDNbWlnUvvomlX60BRysuNOSbqH6g==", 2024-09-14T11:58:45.426 INFO:teuthology.orchestra.run.smithi138.stdout: "active": true, 2024-09-14T11:58:45.426 INFO:teuthology.orchestra.run.smithi138.stdout: "create_date": "2024-09-14T11:58:45.414566Z" 2024-09-14T11:58:45.426 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-09-14T11:58:45.426 INFO:teuthology.orchestra.run.smithi138.stdout: ], 2024-09-14T11:58:45.426 INFO:teuthology.orchestra.run.smithi138.stdout: "swift_keys": [], 2024-09-14T11:58:45.426 INFO:teuthology.orchestra.run.smithi138.stdout: "caps": [], 2024-09-14T11:58:45.426 INFO:teuthology.orchestra.run.smithi138.stdout: "op_mask": "read, write, delete", 2024-09-14T11:58:45.426 INFO:teuthology.orchestra.run.smithi138.stdout: "default_placement": "", 2024-09-14T11:58:45.427 INFO:teuthology.orchestra.run.smithi138.stdout: "default_storage_class": "", 2024-09-14T11:58:45.427 INFO:teuthology.orchestra.run.smithi138.stdout: "placement_tags": [], 2024-09-14T11:58:45.427 INFO:teuthology.orchestra.run.smithi138.stdout: "bucket_quota": { 2024-09-14T11:58:45.427 INFO:teuthology.orchestra.run.smithi138.stdout: "enabled": false, 2024-09-14T11:58:45.427 INFO:teuthology.orchestra.run.smithi138.stdout: "check_on_raw": false, 2024-09-14T11:58:45.427 INFO:teuthology.orchestra.run.smithi138.stdout: "max_size": -1, 2024-09-14T11:58:45.427 INFO:teuthology.orchestra.run.smithi138.stdout: "max_size_kb": 0, 2024-09-14T11:58:45.427 INFO:teuthology.orchestra.run.smithi138.stdout: "max_objects": -1 2024-09-14T11:58:45.427 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-09-14T11:58:45.427 INFO:teuthology.orchestra.run.smithi138.stdout: "user_quota": { 2024-09-14T11:58:45.427 INFO:teuthology.orchestra.run.smithi138.stdout: "enabled": false, 2024-09-14T11:58:45.427 INFO:teuthology.orchestra.run.smithi138.stdout: "check_on_raw": false, 2024-09-14T11:58:45.427 INFO:teuthology.orchestra.run.smithi138.stdout: "max_size": -1, 2024-09-14T11:58:45.428 INFO:teuthology.orchestra.run.smithi138.stdout: "max_size_kb": 0, 2024-09-14T11:58:45.428 INFO:teuthology.orchestra.run.smithi138.stdout: "max_objects": -1 2024-09-14T11:58:45.428 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-09-14T11:58:45.428 INFO:teuthology.orchestra.run.smithi138.stdout: "temp_url_keys": [], 2024-09-14T11:58:45.428 INFO:teuthology.orchestra.run.smithi138.stdout: "type": "rgw", 2024-09-14T11:58:45.428 INFO:teuthology.orchestra.run.smithi138.stdout: "mfa_ids": [], 2024-09-14T11:58:45.428 INFO:teuthology.orchestra.run.smithi138.stdout: "account_id": "", 2024-09-14T11:58:45.428 INFO:teuthology.orchestra.run.smithi138.stdout: "path": "/", 2024-09-14T11:58:45.428 INFO:teuthology.orchestra.run.smithi138.stdout: "create_date": "2024-09-14T11:58:45.414539Z", 2024-09-14T11:58:45.428 INFO:teuthology.orchestra.run.smithi138.stdout: "tags": [], 2024-09-14T11:58:45.428 INFO:teuthology.orchestra.run.smithi138.stdout: "group_ids": [] 2024-09-14T11:58:45.428 INFO:teuthology.orchestra.run.smithi138.stdout:} 2024-09-14T11:58:45.428 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-09-14T11:58:45.429 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:45.429+0000 7f5fd6fdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:58:45.431 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:45.433+0000 7f6122c659c0 20 remove_watcher() i=0 2024-09-14T11:58:45.431 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:45.433+0000 7f6122c659c0 2 removed watcher, disabling cache 2024-09-14T11:58:45.434 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:45.433+0000 7f6122c659c0 20 remove_watcher() i=1 2024-09-14T11:58:45.436 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:45.437+0000 7f6122c659c0 20 remove_watcher() i=2 2024-09-14T11:58:45.438 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:45.441+0000 7f6122c659c0 20 remove_watcher() i=3 2024-09-14T11:58:45.440 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:45.441+0000 7f6122c659c0 20 remove_watcher() i=4 2024-09-14T11:58:45.442 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:45.441+0000 7f6122c659c0 20 remove_watcher() i=5 2024-09-14T11:58:45.444 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:45.445+0000 7f6122c659c0 20 remove_watcher() i=6 2024-09-14T11:58:45.445 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:45.445+0000 7f6122c659c0 20 remove_watcher() i=7 2024-09-14T11:58:45.461 DEBUG:teuthology.orchestra.run.smithi138:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 mfa create --uid 'testx$tenanteduser.client.0' --totp-serial 1686560546 --totp-seed NS2HMCQPFV3IOD3HBKMGWRHEB2DRDWXC2BM3YLYZKOUF36ZE4HC4QLSTSGJFM6KA --totp-seconds 5 --totp-window 8 --totp-seed-type base32 --cluster ceph 2024-09-14T11:58:45.549 INFO:teuthology.orchestra.run.smithi138.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:58:45.549 INFO:teuthology.orchestra.run.smithi138.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:58:45.591 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:45.593+0000 7f548fd069c0 20 rados->read ofs=0 len=0 2024-09-14T11:58:45.593 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:45.593+0000 7f548fd069c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:58:45.593 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:45.593+0000 7f548fd069c0 20 realm 2024-09-14T11:58:45.594 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:45.593+0000 7f548fd069c0 20 rados->read ofs=0 len=0 2024-09-14T11:58:45.594 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:45.593+0000 7f548fd069c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:58:45.594 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:45.593+0000 7f548fd069c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:58:45.594 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:45.593+0000 7f548fd069c0 20 rados->read ofs=0 len=0 2024-09-14T11:58:45.594 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:45.593+0000 7f548fd069c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:58:45.594 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:45.593+0000 7f548fd069c0 20 rados->read ofs=0 len=0 2024-09-14T11:58:45.596 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:45.597+0000 7f548fd069c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:58:45.596 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:45.597+0000 7f548fd069c0 20 rados->read ofs=0 len=0 2024-09-14T11:58:45.597 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:45.597+0000 7f548fd069c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:58:45.597 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:45.597+0000 7f548fd069c0 20 searching for the correct realm 2024-09-14T11:58:45.600 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:45.601+0000 7f548e00d640 0 -- 172.21.15.138:0/3932369347 >> [v2:172.21.15.154:6824/416768175,v1:172.21.15.154:6825/416768175] conn(0x7f5480020030 msgr2=0x7f5480022440 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:58:45.608 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:45.609+0000 7f548d00b640 0 -- 172.21.15.138:0/3932369347 >> [v2:172.21.15.138:6816/326481658,v1:172.21.15.138:6817/326481658] conn(0x7f5480048910 msgr2=0x7f548002e400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:58:45.825 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:45.825+0000 7f548fd069c0 20 RGWRados::pool_iterate: got zone_info.d9e72d30-c60b-4d0d-9267-fdc36392d5ad 2024-09-14T11:58:45.826 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:45.825+0000 7f548fd069c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:58:45.826 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:45.825+0000 7f548fd069c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:58:45.826 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:45.825+0000 7f548fd069c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:58:45.826 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:45.825+0000 7f548fd069c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:58:45.826 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:45.825+0000 7f548fd069c0 20 RGWRados::pool_iterate: got zonegroup_info.65ab941b-da8c-4160-94fb-3672b069d44f 2024-09-14T11:58:45.826 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:45.825+0000 7f548fd069c0 20 rados->read ofs=0 len=0 2024-09-14T11:58:45.826 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:45.825+0000 7f548fd069c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:58:45.826 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:45.825+0000 7f548fd069c0 20 rados->read ofs=0 len=0 2024-09-14T11:58:45.827 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:45.829+0000 7f548fd069c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:58:45.827 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:45.829+0000 7f548fd069c0 20 rados->read ofs=0 len=0 2024-09-14T11:58:45.827 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:45.829+0000 7f548fd069c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:58:45.827 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:45.829+0000 7f548fd069c0 20 zone default found 2024-09-14T11:58:45.828 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:45.829+0000 7f548fd069c0 4 Realm: () 2024-09-14T11:58:45.828 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:45.829+0000 7f548fd069c0 4 ZoneGroup: default (65ab941b-da8c-4160-94fb-3672b069d44f) 2024-09-14T11:58:45.828 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:45.829+0000 7f548fd069c0 4 Zone: default (d9e72d30-c60b-4d0d-9267-fdc36392d5ad) 2024-09-14T11:58:45.828 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:45.829+0000 7f548fd069c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:58:45.828 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:45.829+0000 7f548fd069c0 20 zonegroup default 2024-09-14T11:58:45.828 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:45.829+0000 7f548fd069c0 20 rados->read ofs=0 len=0 2024-09-14T11:58:45.828 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:45.829+0000 7f548fd069c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:58:45.829 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:45.829+0000 7f548fd069c0 20 rados->read ofs=0 len=0 2024-09-14T11:58:45.829 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:45.829+0000 7f548fd069c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:58:45.829 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:45.829+0000 7f548fd069c0 20 rados->read ofs=0 len=0 2024-09-14T11:58:45.830 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:45.829+0000 7f548fd069c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:58:45.830 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:45.829+0000 7f548fd069c0 20 started sync module instance, tier type = 2024-09-14T11:58:45.830 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:45.829+0000 7f548fd069c0 20 started zone id=d9e72d30-c60b-4d0d-9267-fdc36392d5ad (name=default) with tier type = 2024-09-14T11:58:45.855 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:45.857+0000 7f548fd069c0 20 add_watcher() i=0 2024-09-14T11:58:45.855 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:45.857+0000 7f548fd069c0 20 add_watcher() i=1 2024-09-14T11:58:45.855 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:45.857+0000 7f548fd069c0 20 add_watcher() i=2 2024-09-14T11:58:45.856 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:45.857+0000 7f548fd069c0 20 add_watcher() i=3 2024-09-14T11:58:45.856 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:45.857+0000 7f548fd069c0 20 add_watcher() i=4 2024-09-14T11:58:45.856 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:45.857+0000 7f548fd069c0 20 add_watcher() i=5 2024-09-14T11:58:45.856 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:45.857+0000 7f548fd069c0 20 add_watcher() i=6 2024-09-14T11:58:45.857 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:45.857+0000 7f548fd069c0 20 add_watcher() i=7 2024-09-14T11:58:45.858 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:45.857+0000 7f548fd069c0 2 all 8 watchers are set, enabling cache 2024-09-14T11:58:45.863 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:45.865+0000 7f533f7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:58:45.863 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:45.865+0000 7f548fd069c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:58:45.863 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:45.865+0000 7f548fd069c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:58:45.863 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:45.865+0000 7f548fd069c0 5 note: GC not initialized 2024-09-14T11:58:45.864 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:45.865+0000 7f548fd069c0 20 init_complete bucket index max shards: 11 2024-09-14T11:58:45.864 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:45.865+0000 7f548fd069c0 20 Filter name: none 2024-09-14T11:58:45.864 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:45.865+0000 7f52b7fff640 20 reqs_thread_entry: start 2024-09-14T11:58:45.864 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:45.865+0000 7f533e7fc640 20 reqs_thread_entry: start 2024-09-14T11:58:45.864 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:45.865+0000 7f548fd069c0 10 cache get: name=default.rgw.meta+users.uid+testx$tenanteduser.client.0 : miss 2024-09-14T11:58:45.865 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:45.865+0000 7f548fd069c0 20 rados->read ofs=0 len=0 2024-09-14T11:58:45.865 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:45.865+0000 7f548fd069c0 20 rados_obj.operate() r=0 bl.length=519 2024-09-14T11:58:45.865 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:45.865+0000 7f548fd069c0 10 cache put: name=default.rgw.meta+users.uid+testx$tenanteduser.client.0 info.flags=0x13 2024-09-14T11:58:45.865 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:45.865+0000 7f548fd069c0 10 adding default.rgw.meta+users.uid+testx$tenanteduser.client.0 to cache LRU end 2024-09-14T11:58:45.865 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:45.865+0000 7f548fd069c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:58:45.870 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:45.873+0000 7f548fd069c0 10 cache put: name=default.rgw.meta+users.uid+testx$tenanteduser.client.0 info.flags=0x17 2024-09-14T11:58:45.870 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:45.873+0000 7f548fd069c0 10 moving default.rgw.meta+users.uid+testx$tenanteduser.client.0 to cache LRU end 2024-09-14T11:58:45.870 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:45.873+0000 7f548fd069c0 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:users.uid:testx$tenanteduser.client.0, ofs0, ns] 2024-09-14T11:58:45.871 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:45.873+0000 7f53717fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1146756268216 cookie 94831406191792 notifier 9033 bl.length()=733 2024-09-14T11:58:45.871 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:45.873+0000 7f53717fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+testx$tenanteduser.client.0 info.flags=0x17 2024-09-14T11:58:45.871 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:45.873+0000 7f53717fa640 10 rgw watcher librados: moving default.rgw.meta+users.uid+testx$tenanteduser.client.0 to cache LRU end 2024-09-14T11:58:45.875 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:45.877+0000 7f533f7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:58:45.880 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:45.881+0000 7f548fd069c0 20 remove_watcher() i=0 2024-09-14T11:58:45.880 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:45.881+0000 7f548fd069c0 2 removed watcher, disabling cache 2024-09-14T11:58:45.882 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:45.885+0000 7f548fd069c0 20 remove_watcher() i=1 2024-09-14T11:58:45.884 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:45.885+0000 7f548fd069c0 20 remove_watcher() i=2 2024-09-14T11:58:45.887 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:45.889+0000 7f548fd069c0 20 remove_watcher() i=3 2024-09-14T11:58:45.890 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:45.889+0000 7f548fd069c0 20 remove_watcher() i=4 2024-09-14T11:58:45.891 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:45.893+0000 7f548fd069c0 20 remove_watcher() i=5 2024-09-14T11:58:45.892 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:45.893+0000 7f548fd069c0 20 remove_watcher() i=6 2024-09-14T11:58:45.894 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:45.897+0000 7f548fd069c0 20 remove_watcher() i=7 2024-09-14T11:58:45.912 DEBUG:tasks.s3tests:Creating user foobar.client.0 on client.0 2024-09-14T11:58:45.913 DEBUG:teuthology.orchestra.run.smithi138:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 user create --uid foobar.client.0 --display-name Mr.foobar.client.0 --email foobar+test@test.test --access-key YVKBHZBVGHWYKEWGKCHY --secret WEIcTL2lCJi0TCiQjWDW4K31xpHG7BzvOiUTgik5RHCEFTkc/XqQXQ== --cluster ceph 2024-09-14T11:58:45.956 INFO:teuthology.orchestra.run.smithi138.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:58:45.957 INFO:teuthology.orchestra.run.smithi138.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:58:45.997 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:45.997+0000 7f9a666f09c0 20 rados->read ofs=0 len=0 2024-09-14T11:58:45.999 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:46.001+0000 7f9a666f09c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:58:45.999 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:46.001+0000 7f9a666f09c0 20 realm 2024-09-14T11:58:45.999 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:46.001+0000 7f9a666f09c0 20 rados->read ofs=0 len=0 2024-09-14T11:58:45.999 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:46.001+0000 7f9a666f09c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:58:46.000 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:46.001+0000 7f9a666f09c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:58:46.000 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:46.001+0000 7f9a666f09c0 20 rados->read ofs=0 len=0 2024-09-14T11:58:46.000 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:46.001+0000 7f9a666f09c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:58:46.000 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:46.001+0000 7f9a666f09c0 20 rados->read ofs=0 len=0 2024-09-14T11:58:46.001 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:46.001+0000 7f9a666f09c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:58:46.001 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:46.001+0000 7f9a666f09c0 20 rados->read ofs=0 len=0 2024-09-14T11:58:46.002 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:46.001+0000 7f9a666f09c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:58:46.002 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:46.001+0000 7f9a666f09c0 20 searching for the correct realm 2024-09-14T11:58:46.006 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:46.009+0000 7f9a649f7640 0 -- 172.21.15.138:0/1149719321 >> [v2:172.21.15.154:6824/416768175,v1:172.21.15.154:6825/416768175] conn(0x7f9a5c018040 msgr2=0x7f9a5c028950 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:58:46.012 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:46.013+0000 7f9a639f5640 0 -- 172.21.15.138:0/1149719321 >> [v2:172.21.15.138:6816/326481658,v1:172.21.15.138:6817/326481658] conn(0x7f9a5c03bbc0 msgr2=0x7f9a5c038410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-14T11:58:46.229 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:46.229+0000 7f9a666f09c0 20 RGWRados::pool_iterate: got zone_info.d9e72d30-c60b-4d0d-9267-fdc36392d5ad 2024-09-14T11:58:46.229 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:46.229+0000 7f9a666f09c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:58:46.229 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:46.229+0000 7f9a666f09c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:58:46.230 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:46.229+0000 7f9a666f09c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:58:46.230 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:46.229+0000 7f9a666f09c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:58:46.230 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:46.229+0000 7f9a666f09c0 20 RGWRados::pool_iterate: got zonegroup_info.65ab941b-da8c-4160-94fb-3672b069d44f 2024-09-14T11:58:46.230 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:46.229+0000 7f9a666f09c0 20 rados->read ofs=0 len=0 2024-09-14T11:58:46.230 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:46.229+0000 7f9a666f09c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:58:46.230 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:46.229+0000 7f9a666f09c0 20 rados->read ofs=0 len=0 2024-09-14T11:58:46.230 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:46.233+0000 7f9a666f09c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:58:46.230 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:46.233+0000 7f9a666f09c0 20 rados->read ofs=0 len=0 2024-09-14T11:58:46.231 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:46.233+0000 7f9a666f09c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:58:46.232 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:46.233+0000 7f9a666f09c0 20 zone default found 2024-09-14T11:58:46.232 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:46.233+0000 7f9a666f09c0 4 Realm: () 2024-09-14T11:58:46.232 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:46.233+0000 7f9a666f09c0 4 ZoneGroup: default (65ab941b-da8c-4160-94fb-3672b069d44f) 2024-09-14T11:58:46.232 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:46.233+0000 7f9a666f09c0 4 Zone: default (d9e72d30-c60b-4d0d-9267-fdc36392d5ad) 2024-09-14T11:58:46.232 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:46.233+0000 7f9a666f09c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:58:46.232 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:46.233+0000 7f9a666f09c0 20 zonegroup default 2024-09-14T11:58:46.232 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:46.233+0000 7f9a666f09c0 20 rados->read ofs=0 len=0 2024-09-14T11:58:46.232 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:46.233+0000 7f9a666f09c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:58:46.233 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:46.233+0000 7f9a666f09c0 20 rados->read ofs=0 len=0 2024-09-14T11:58:46.233 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:46.233+0000 7f9a666f09c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:58:46.233 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:46.233+0000 7f9a666f09c0 20 rados->read ofs=0 len=0 2024-09-14T11:58:46.234 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:46.237+0000 7f9a666f09c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:58:46.234 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:46.237+0000 7f9a666f09c0 20 started sync module instance, tier type = 2024-09-14T11:58:46.234 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:46.237+0000 7f9a666f09c0 20 started zone id=d9e72d30-c60b-4d0d-9267-fdc36392d5ad (name=default) with tier type = 2024-09-14T11:58:46.258 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:46.261+0000 7f9a666f09c0 20 add_watcher() i=0 2024-09-14T11:58:46.259 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:46.261+0000 7f9a666f09c0 20 add_watcher() i=1 2024-09-14T11:58:46.259 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:46.261+0000 7f9a666f09c0 20 add_watcher() i=2 2024-09-14T11:58:46.259 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:46.261+0000 7f9a666f09c0 20 add_watcher() i=3 2024-09-14T11:58:46.259 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:46.261+0000 7f9a666f09c0 20 add_watcher() i=4 2024-09-14T11:58:46.259 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:46.261+0000 7f9a666f09c0 20 add_watcher() i=5 2024-09-14T11:58:46.259 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:46.261+0000 7f9a666f09c0 20 add_watcher() i=6 2024-09-14T11:58:46.261 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:46.261+0000 7f9a666f09c0 20 add_watcher() i=7 2024-09-14T11:58:46.261 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:46.261+0000 7f9a666f09c0 2 all 8 watchers are set, enabling cache 2024-09-14T11:58:46.265 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:46.265+0000 7f991afdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:58:46.265 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:46.265+0000 7f9a666f09c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:58:46.265 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:46.265+0000 7f9a666f09c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:58:46.265 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:46.265+0000 7f9a666f09c0 5 note: GC not initialized 2024-09-14T11:58:46.266 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:46.265+0000 7f9919fdb640 20 reqs_thread_entry: start 2024-09-14T11:58:46.266 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:46.269+0000 7f9a666f09c0 20 init_complete bucket index max shards: 11 2024-09-14T11:58:46.267 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:46.269+0000 7f9a666f09c0 20 Filter name: none 2024-09-14T11:58:46.267 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:46.269+0000 7f988b7fe640 20 reqs_thread_entry: start 2024-09-14T11:58:46.267 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:46.269+0000 7f9a666f09c0 10 cache get: name=default.rgw.meta+users.uid+foobar.client.0 : miss 2024-09-14T11:58:46.267 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:46.269+0000 7f9a666f09c0 20 rados->read ofs=0 len=0 2024-09-14T11:58:46.267 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:46.269+0000 7f9a666f09c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:58:46.267 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:46.269+0000 7f9a666f09c0 10 cache put: name=default.rgw.meta+users.uid+foobar.client.0 info.flags=0x0 2024-09-14T11:58:46.268 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:46.269+0000 7f9a666f09c0 10 adding default.rgw.meta+users.uid+foobar.client.0 to cache LRU end 2024-09-14T11:58:46.268 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:46.269+0000 7f9a666f09c0 10 cache get: name=default.rgw.meta+users.email+foobar+test@test.test : miss 2024-09-14T11:58:46.268 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:46.269+0000 7f9a666f09c0 20 rados->read ofs=0 len=0 2024-09-14T11:58:46.268 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:46.269+0000 7f9a666f09c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:58:46.268 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:46.269+0000 7f9a666f09c0 10 cache put: name=default.rgw.meta+users.email+foobar+test@test.test info.flags=0x0 2024-09-14T11:58:46.268 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:46.269+0000 7f9a666f09c0 10 adding default.rgw.meta+users.email+foobar+test@test.test to cache LRU end 2024-09-14T11:58:46.268 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:46.269+0000 7f9a666f09c0 10 cache get: name=default.rgw.meta+users.keys+YVKBHZBVGHWYKEWGKCHY : miss 2024-09-14T11:58:46.268 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:46.269+0000 7f9a666f09c0 20 rados->read ofs=0 len=0 2024-09-14T11:58:46.269 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:46.269+0000 7f9a666f09c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:58:46.269 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:46.269+0000 7f9a666f09c0 10 cache put: name=default.rgw.meta+users.keys+YVKBHZBVGHWYKEWGKCHY info.flags=0x0 2024-09-14T11:58:46.269 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:46.269+0000 7f9a666f09c0 10 adding default.rgw.meta+users.keys+YVKBHZBVGHWYKEWGKCHY to cache LRU end 2024-09-14T11:58:46.269 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:46.269+0000 7f9a666f09c0 10 cache get: name=default.rgw.meta+users.keys+YVKBHZBVGHWYKEWGKCHY : hit (negative entry) 2024-09-14T11:58:46.269 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:46.269+0000 7f9a666f09c0 10 cache get: name=default.rgw.meta+users.keys+YVKBHZBVGHWYKEWGKCHY : hit (negative entry) 2024-09-14T11:58:46.271 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:46.273+0000 7f9a666f09c0 10 cache put: name=default.rgw.meta+users.uid+foobar.client.0 info.flags=0x17 2024-09-14T11:58:46.271 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:46.273+0000 7f9a666f09c0 10 moving default.rgw.meta+users.uid+foobar.client.0 to cache LRU end 2024-09-14T11:58:46.271 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:46.273+0000 7f9a666f09c0 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 0, obj: default.rgw.meta:users.uid:foobar.client.0, ofs0, ns] 2024-09-14T11:58:46.271 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:46.273+0000 7f993b7fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1146756268145 cookie 94641039521984 notifier 9054 bl.length()=660 2024-09-14T11:58:46.271 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:46.273+0000 7f993b7fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+foobar.client.0 info.flags=0x17 2024-09-14T11:58:46.271 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:46.273+0000 7f993b7fe640 10 rgw watcher librados: moving default.rgw.meta+users.uid+foobar.client.0 to cache LRU end 2024-09-14T11:58:46.276 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:46.277+0000 7f9a666f09c0 10 cache put: name=default.rgw.meta+users.email+foobar+test@test.test info.flags=0x7 2024-09-14T11:58:46.276 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:46.277+0000 7f9a666f09c0 10 moving default.rgw.meta+users.email+foobar+test@test.test to cache LRU end 2024-09-14T11:58:46.276 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:46.277+0000 7f9a666f09c0 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:users.email:foobar+test@test.test, ofs0, ns] 2024-09-14T11:58:46.277 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:46.277+0000 7f993b7fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1146756268197 cookie 94641039505744 notifier 9054 bl.length()=191 2024-09-14T11:58:46.277 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:46.277+0000 7f993b7fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.email+foobar+test@test.test info.flags=0x7 2024-09-14T11:58:46.277 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:46.277+0000 7f993b7fe640 10 rgw watcher librados: moving default.rgw.meta+users.email+foobar+test@test.test to cache LRU end 2024-09-14T11:58:46.282 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:46.281+0000 7f9a666f09c0 10 cache put: name=default.rgw.meta+users.keys+YVKBHZBVGHWYKEWGKCHY info.flags=0x7 2024-09-14T11:58:46.282 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:46.281+0000 7f9a666f09c0 10 moving default.rgw.meta+users.keys+YVKBHZBVGHWYKEWGKCHY to cache LRU end 2024-09-14T11:58:46.282 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:46.281+0000 7f9a666f09c0 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 0, obj: default.rgw.meta:users.keys:YVKBHZBVGHWYKEWGKCHY, ofs0, ns] 2024-09-14T11:58:46.282 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:46.285+0000 7f993b7fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1146756268146 cookie 94641039521984 notifier 9054 bl.length()=189 2024-09-14T11:58:46.282 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:46.285+0000 7f993b7fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.keys+YVKBHZBVGHWYKEWGKCHY info.flags=0x7 2024-09-14T11:58:46.283 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:46.285+0000 7f993b7fe640 10 rgw watcher librados: moving default.rgw.meta+users.keys+YVKBHZBVGHWYKEWGKCHY to cache LRU end 2024-09-14T11:58:46.284 INFO:teuthology.orchestra.run.smithi138.stdout:{ 2024-09-14T11:58:46.284 INFO:teuthology.orchestra.run.smithi138.stdout: "user_id": "foobar.client.0", 2024-09-14T11:58:46.284 INFO:teuthology.orchestra.run.smithi138.stdout: "display_name": "Mr.foobar.client.0", 2024-09-14T11:58:46.284 INFO:teuthology.orchestra.run.smithi138.stdout: "email": "foobar+test@test.test", 2024-09-14T11:58:46.284 INFO:teuthology.orchestra.run.smithi138.stdout: "suspended": 0, 2024-09-14T11:58:46.285 INFO:teuthology.orchestra.run.smithi138.stdout: "max_buckets": 1000, 2024-09-14T11:58:46.285 INFO:teuthology.orchestra.run.smithi138.stdout: "subusers": [], 2024-09-14T11:58:46.285 INFO:teuthology.orchestra.run.smithi138.stdout: "keys": [ 2024-09-14T11:58:46.285 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-09-14T11:58:46.285 INFO:teuthology.orchestra.run.smithi138.stdout: "user": "foobar.client.0", 2024-09-14T11:58:46.285 INFO:teuthology.orchestra.run.smithi138.stdout: "access_key": "YVKBHZBVGHWYKEWGKCHY", 2024-09-14T11:58:46.285 INFO:teuthology.orchestra.run.smithi138.stdout: "secret_key": "WEIcTL2lCJi0TCiQjWDW4K31xpHG7BzvOiUTgik5RHCEFTkc/XqQXQ==", 2024-09-14T11:58:46.285 INFO:teuthology.orchestra.run.smithi138.stdout: "active": true, 2024-09-14T11:58:46.285 INFO:teuthology.orchestra.run.smithi138.stdout: "create_date": "2024-09-14T11:58:46.275845Z" 2024-09-14T11:58:46.285 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-09-14T11:58:46.285 INFO:teuthology.orchestra.run.smithi138.stdout: ], 2024-09-14T11:58:46.285 INFO:teuthology.orchestra.run.smithi138.stdout: "swift_keys": [], 2024-09-14T11:58:46.285 INFO:teuthology.orchestra.run.smithi138.stdout: "caps": [], 2024-09-14T11:58:46.285 INFO:teuthology.orchestra.run.smithi138.stdout: "op_mask": "read, write, delete", 2024-09-14T11:58:46.286 INFO:teuthology.orchestra.run.smithi138.stdout: "default_placement": "", 2024-09-14T11:58:46.286 INFO:teuthology.orchestra.run.smithi138.stdout: "default_storage_class": "", 2024-09-14T11:58:46.286 INFO:teuthology.orchestra.run.smithi138.stdout: "placement_tags": [], 2024-09-14T11:58:46.286 INFO:teuthology.orchestra.run.smithi138.stdout: "bucket_quota": { 2024-09-14T11:58:46.286 INFO:teuthology.orchestra.run.smithi138.stdout: "enabled": false, 2024-09-14T11:58:46.286 INFO:teuthology.orchestra.run.smithi138.stdout: "check_on_raw": false, 2024-09-14T11:58:46.286 INFO:teuthology.orchestra.run.smithi138.stdout: "max_size": -1, 2024-09-14T11:58:46.286 INFO:teuthology.orchestra.run.smithi138.stdout: "max_size_kb": 0, 2024-09-14T11:58:46.286 INFO:teuthology.orchestra.run.smithi138.stdout: "max_objects": -1 2024-09-14T11:58:46.286 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-09-14T11:58:46.286 INFO:teuthology.orchestra.run.smithi138.stdout: "user_quota": { 2024-09-14T11:58:46.286 INFO:teuthology.orchestra.run.smithi138.stdout: "enabled": false, 2024-09-14T11:58:46.286 INFO:teuthology.orchestra.run.smithi138.stdout: "check_on_raw": false, 2024-09-14T11:58:46.286 INFO:teuthology.orchestra.run.smithi138.stdout: "max_size": -1, 2024-09-14T11:58:46.286 INFO:teuthology.orchestra.run.smithi138.stdout: "max_size_kb": 0, 2024-09-14T11:58:46.286 INFO:teuthology.orchestra.run.smithi138.stdout: "max_objects": -1 2024-09-14T11:58:46.287 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-09-14T11:58:46.287 INFO:teuthology.orchestra.run.smithi138.stdout: "temp_url_keys": [], 2024-09-14T11:58:46.287 INFO:teuthology.orchestra.run.smithi138.stdout: "type": "rgw", 2024-09-14T11:58:46.287 INFO:teuthology.orchestra.run.smithi138.stdout: "mfa_ids": [], 2024-09-14T11:58:46.287 INFO:teuthology.orchestra.run.smithi138.stdout: "account_id": "", 2024-09-14T11:58:46.287 INFO:teuthology.orchestra.run.smithi138.stdout: "path": "/", 2024-09-14T11:58:46.287 INFO:teuthology.orchestra.run.smithi138.stdout: "create_date": "2024-09-14T11:58:46.275829Z", 2024-09-14T11:58:46.287 INFO:teuthology.orchestra.run.smithi138.stdout: "tags": [], 2024-09-14T11:58:46.287 INFO:teuthology.orchestra.run.smithi138.stdout: "group_ids": [] 2024-09-14T11:58:46.287 INFO:teuthology.orchestra.run.smithi138.stdout:} 2024-09-14T11:58:46.287 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-09-14T11:58:46.288 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:46.285+0000 7f991afdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:58:46.290 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:46.293+0000 7f9a666f09c0 20 remove_watcher() i=0 2024-09-14T11:58:46.290 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:46.293+0000 7f9a666f09c0 2 removed watcher, disabling cache 2024-09-14T11:58:46.292 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:46.293+0000 7f9a666f09c0 20 remove_watcher() i=1 2024-09-14T11:58:46.295 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:46.297+0000 7f9a666f09c0 20 remove_watcher() i=2 2024-09-14T11:58:46.297 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:46.297+0000 7f9a666f09c0 20 remove_watcher() i=3 2024-09-14T11:58:46.299 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:46.301+0000 7f9a666f09c0 20 remove_watcher() i=4 2024-09-14T11:58:46.301 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:46.301+0000 7f9a666f09c0 20 remove_watcher() i=5 2024-09-14T11:58:46.302 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:46.305+0000 7f9a666f09c0 20 remove_watcher() i=6 2024-09-14T11:58:46.304 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:46.305+0000 7f9a666f09c0 20 remove_watcher() i=7 2024-09-14T11:58:46.321 DEBUG:teuthology.orchestra.run.smithi138:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 mfa create --uid foobar.client.0 --totp-serial 6440710422 --totp-seed 2TNQHGAWM4RVTWKJZA63UQ5M74KQCX3DMTWYOONBTHKI2SN4MJZFXRNHDX7LJNQR --totp-seconds 5 --totp-window 8 --totp-seed-type base32 --cluster ceph 2024-09-14T11:58:46.409 INFO:teuthology.orchestra.run.smithi138.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:58:46.409 INFO:teuthology.orchestra.run.smithi138.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:58:46.451 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:46.453+0000 7f6910efb9c0 20 rados->read ofs=0 len=0 2024-09-14T11:58:46.452 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:46.453+0000 7f6910efb9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:58:46.452 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:46.453+0000 7f6910efb9c0 20 realm 2024-09-14T11:58:46.453 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:46.453+0000 7f6910efb9c0 20 rados->read ofs=0 len=0 2024-09-14T11:58:46.453 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:46.453+0000 7f6910efb9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:58:46.453 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:46.453+0000 7f6910efb9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:58:46.453 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:46.453+0000 7f6910efb9c0 20 rados->read ofs=0 len=0 2024-09-14T11:58:46.453 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:46.453+0000 7f6910efb9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:58:46.453 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:46.453+0000 7f6910efb9c0 20 rados->read ofs=0 len=0 2024-09-14T11:58:46.455 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:46.457+0000 7f6910efb9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:58:46.455 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:46.457+0000 7f6910efb9c0 20 rados->read ofs=0 len=0 2024-09-14T11:58:46.455 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:46.457+0000 7f6910efb9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:58:46.455 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:46.457+0000 7f6910efb9c0 20 searching for the correct realm 2024-09-14T11:58:46.459 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:46.461+0000 7f690f202640 0 -- 172.21.15.138:0/3639605161 >> [v2:172.21.15.154:6824/416768175,v1:172.21.15.154:6825/416768175] conn(0x7f6908034070 msgr2=0x7f6908064d80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:58:46.466 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:46.469+0000 7f690e200640 0 -- 172.21.15.138:0/3639605161 >> [v2:172.21.15.138:6816/326481658,v1:172.21.15.138:6817/326481658] conn(0x7f6908066310 msgr2=0x7f69080871a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-14T11:58:46.686 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:46.685+0000 7f6910efb9c0 20 RGWRados::pool_iterate: got zone_info.d9e72d30-c60b-4d0d-9267-fdc36392d5ad 2024-09-14T11:58:46.686 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:46.685+0000 7f6910efb9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:58:46.686 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:46.685+0000 7f6910efb9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:58:46.686 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:46.685+0000 7f6910efb9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:58:46.687 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:46.685+0000 7f6910efb9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:58:46.687 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:46.685+0000 7f6910efb9c0 20 RGWRados::pool_iterate: got zonegroup_info.65ab941b-da8c-4160-94fb-3672b069d44f 2024-09-14T11:58:46.687 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:46.685+0000 7f6910efb9c0 20 rados->read ofs=0 len=0 2024-09-14T11:58:46.687 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:46.689+0000 7f6910efb9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:58:46.687 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:46.689+0000 7f6910efb9c0 20 rados->read ofs=0 len=0 2024-09-14T11:58:46.687 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:46.689+0000 7f6910efb9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:58:46.687 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:46.689+0000 7f6910efb9c0 20 rados->read ofs=0 len=0 2024-09-14T11:58:46.688 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:46.689+0000 7f6910efb9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:58:46.688 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:46.689+0000 7f6910efb9c0 20 zone default found 2024-09-14T11:58:46.689 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:46.689+0000 7f6910efb9c0 4 Realm: () 2024-09-14T11:58:46.689 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:46.689+0000 7f6910efb9c0 4 ZoneGroup: default (65ab941b-da8c-4160-94fb-3672b069d44f) 2024-09-14T11:58:46.689 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:46.689+0000 7f6910efb9c0 4 Zone: default (d9e72d30-c60b-4d0d-9267-fdc36392d5ad) 2024-09-14T11:58:46.689 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:46.689+0000 7f6910efb9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:58:46.689 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:46.689+0000 7f6910efb9c0 20 zonegroup default 2024-09-14T11:58:46.689 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:46.689+0000 7f6910efb9c0 20 rados->read ofs=0 len=0 2024-09-14T11:58:46.690 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:46.689+0000 7f6910efb9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:58:46.690 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:46.689+0000 7f6910efb9c0 20 rados->read ofs=0 len=0 2024-09-14T11:58:46.690 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:46.689+0000 7f6910efb9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:58:46.690 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:46.689+0000 7f6910efb9c0 20 rados->read ofs=0 len=0 2024-09-14T11:58:46.690 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:46.693+0000 7f6910efb9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:58:46.690 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:46.693+0000 7f6910efb9c0 20 started sync module instance, tier type = 2024-09-14T11:58:46.691 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:46.693+0000 7f6910efb9c0 20 started zone id=d9e72d30-c60b-4d0d-9267-fdc36392d5ad (name=default) with tier type = 2024-09-14T11:58:46.714 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:46.717+0000 7f6910efb9c0 20 add_watcher() i=0 2024-09-14T11:58:46.714 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:46.717+0000 7f6910efb9c0 20 add_watcher() i=1 2024-09-14T11:58:46.714 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:46.717+0000 7f6910efb9c0 20 add_watcher() i=2 2024-09-14T11:58:46.714 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:46.717+0000 7f6910efb9c0 20 add_watcher() i=3 2024-09-14T11:58:46.714 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:46.717+0000 7f6910efb9c0 20 add_watcher() i=4 2024-09-14T11:58:46.715 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:46.717+0000 7f6910efb9c0 20 add_watcher() i=5 2024-09-14T11:58:46.715 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:46.717+0000 7f6910efb9c0 20 add_watcher() i=6 2024-09-14T11:58:46.717 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:46.717+0000 7f6910efb9c0 20 add_watcher() i=7 2024-09-14T11:58:46.717 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:46.717+0000 7f6910efb9c0 2 all 8 watchers are set, enabling cache 2024-09-14T11:58:46.721 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:46.721+0000 7f67c57e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:58:46.721 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:46.721+0000 7f6910efb9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:58:46.721 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:46.721+0000 7f6910efb9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:58:46.721 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:46.721+0000 7f6910efb9c0 5 note: GC not initialized 2024-09-14T11:58:46.722 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:46.721+0000 7f673ffff640 20 reqs_thread_entry: start 2024-09-14T11:58:46.722 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:46.721+0000 7f6910efb9c0 20 init_complete bucket index max shards: 11 2024-09-14T11:58:46.722 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:46.725+0000 7f6910efb9c0 20 Filter name: none 2024-09-14T11:58:46.722 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:46.725+0000 7f673dffb640 20 reqs_thread_entry: start 2024-09-14T11:58:46.723 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:46.725+0000 7f6910efb9c0 10 cache get: name=default.rgw.meta+users.uid+foobar.client.0 : miss 2024-09-14T11:58:46.723 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:46.725+0000 7f6910efb9c0 20 rados->read ofs=0 len=0 2024-09-14T11:58:46.723 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:46.725+0000 7f6910efb9c0 20 rados_obj.operate() r=0 bl.length=472 2024-09-14T11:58:46.723 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:46.725+0000 7f6910efb9c0 10 cache put: name=default.rgw.meta+users.uid+foobar.client.0 info.flags=0x13 2024-09-14T11:58:46.724 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:46.725+0000 7f6910efb9c0 10 adding default.rgw.meta+users.uid+foobar.client.0 to cache LRU end 2024-09-14T11:58:46.724 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:46.725+0000 7f6910efb9c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:58:46.729 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:46.729+0000 7f6910efb9c0 10 cache put: name=default.rgw.meta+users.uid+foobar.client.0 info.flags=0x17 2024-09-14T11:58:46.729 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:46.729+0000 7f6910efb9c0 10 moving default.rgw.meta+users.uid+foobar.client.0 to cache LRU end 2024-09-14T11:58:46.729 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:46.729+0000 7f6910efb9c0 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 0, obj: default.rgw.meta:users.uid:foobar.client.0, ofs0, ns] 2024-09-14T11:58:46.729 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:46.729+0000 7f67f27fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1146756268147 cookie 94812206113456 notifier 9072 bl.length()=674 2024-09-14T11:58:46.730 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:46.729+0000 7f67f27fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+foobar.client.0 info.flags=0x17 2024-09-14T11:58:46.730 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:46.729+0000 7f67f27fc640 10 rgw watcher librados: moving default.rgw.meta+users.uid+foobar.client.0 to cache LRU end 2024-09-14T11:58:46.734 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:46.733+0000 7f67c57e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:58:46.738 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:46.741+0000 7f6910efb9c0 20 remove_watcher() i=0 2024-09-14T11:58:46.739 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:46.741+0000 7f6910efb9c0 2 removed watcher, disabling cache 2024-09-14T11:58:46.741 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:46.741+0000 7f6910efb9c0 20 remove_watcher() i=1 2024-09-14T11:58:46.744 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:46.745+0000 7f6910efb9c0 20 remove_watcher() i=2 2024-09-14T11:58:46.746 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:46.749+0000 7f6910efb9c0 20 remove_watcher() i=3 2024-09-14T11:58:46.749 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:46.749+0000 7f6910efb9c0 20 remove_watcher() i=4 2024-09-14T11:58:46.751 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:46.753+0000 7f6910efb9c0 20 remove_watcher() i=5 2024-09-14T11:58:46.753 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:46.753+0000 7f6910efb9c0 20 remove_watcher() i=6 2024-09-14T11:58:46.755 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:46.757+0000 7f6910efb9c0 20 remove_watcher() i=7 2024-09-14T11:58:46.771 DEBUG:teuthology.orchestra.run.smithi138:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 caps add --uid foobar.client.0 --caps 'oidc-provider=*;roles=*;user-policy=*' --cluster ceph 2024-09-14T11:58:46.803 INFO:teuthology.orchestra.run.smithi138.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:58:46.803 INFO:teuthology.orchestra.run.smithi138.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:58:47.052 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:47.053+0000 7f058b5939c0 20 rados->read ofs=0 len=0 2024-09-14T11:58:47.054 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:47.053+0000 7f058b5939c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:58:47.054 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:47.053+0000 7f058b5939c0 20 realm 2024-09-14T11:58:47.054 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:47.053+0000 7f058b5939c0 20 rados->read ofs=0 len=0 2024-09-14T11:58:47.054 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:47.057+0000 7f058b5939c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:58:47.054 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:47.057+0000 7f058b5939c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:58:47.055 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:47.057+0000 7f058b5939c0 20 rados->read ofs=0 len=0 2024-09-14T11:58:47.055 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:47.057+0000 7f058b5939c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:58:47.055 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:47.057+0000 7f058b5939c0 20 rados->read ofs=0 len=0 2024-09-14T11:58:47.056 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:47.057+0000 7f058b5939c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:58:47.056 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:47.057+0000 7f058b5939c0 20 rados->read ofs=0 len=0 2024-09-14T11:58:47.057 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:47.057+0000 7f058b5939c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:58:47.057 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:47.057+0000 7f058b5939c0 20 searching for the correct realm 2024-09-14T11:58:47.060 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:47.061+0000 7f058989a640 0 -- 172.21.15.138:0/2733440472 >> [v2:172.21.15.154:6824/416768175,v1:172.21.15.154:6825/416768175] conn(0x7f057c01b040 msgr2=0x7f057c064070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:58:47.275 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:47.277+0000 7f0588898640 0 -- 172.21.15.138:0/2733440472 >> [v2:172.21.15.138:6816/326481658,v1:172.21.15.138:6817/326481658] conn(0x7f057c008b80 msgr2=0x7f057c0862a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-14T11:58:47.494 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:47.497+0000 7f058b5939c0 20 RGWRados::pool_iterate: got zone_info.d9e72d30-c60b-4d0d-9267-fdc36392d5ad 2024-09-14T11:58:47.494 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:47.497+0000 7f058b5939c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:58:47.495 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:47.497+0000 7f058b5939c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:58:47.495 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:47.497+0000 7f058b5939c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:58:47.495 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:47.497+0000 7f058b5939c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:58:47.495 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:47.497+0000 7f058b5939c0 20 RGWRados::pool_iterate: got zonegroup_info.65ab941b-da8c-4160-94fb-3672b069d44f 2024-09-14T11:58:47.495 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:47.497+0000 7f058b5939c0 20 rados->read ofs=0 len=0 2024-09-14T11:58:47.495 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:47.497+0000 7f058b5939c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:58:47.495 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:47.497+0000 7f058b5939c0 20 rados->read ofs=0 len=0 2024-09-14T11:58:47.496 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:47.497+0000 7f058b5939c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:58:47.496 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:47.497+0000 7f058b5939c0 20 rados->read ofs=0 len=0 2024-09-14T11:58:47.497 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:47.497+0000 7f058b5939c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:58:47.497 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:47.497+0000 7f058b5939c0 20 zone default found 2024-09-14T11:58:47.497 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:47.497+0000 7f058b5939c0 4 Realm: () 2024-09-14T11:58:47.497 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:47.497+0000 7f058b5939c0 4 ZoneGroup: default (65ab941b-da8c-4160-94fb-3672b069d44f) 2024-09-14T11:58:47.497 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:47.497+0000 7f058b5939c0 4 Zone: default (d9e72d30-c60b-4d0d-9267-fdc36392d5ad) 2024-09-14T11:58:47.497 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:47.497+0000 7f058b5939c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:58:47.497 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:47.497+0000 7f058b5939c0 20 zonegroup default 2024-09-14T11:58:47.497 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:47.497+0000 7f058b5939c0 20 rados->read ofs=0 len=0 2024-09-14T11:58:47.498 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:47.497+0000 7f058b5939c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:58:47.498 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:47.497+0000 7f058b5939c0 20 rados->read ofs=0 len=0 2024-09-14T11:58:47.499 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:47.501+0000 7f058b5939c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:58:47.499 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:47.501+0000 7f058b5939c0 20 rados->read ofs=0 len=0 2024-09-14T11:58:47.499 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:47.501+0000 7f058b5939c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:58:47.499 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:47.501+0000 7f058b5939c0 20 started sync module instance, tier type = 2024-09-14T11:58:47.499 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:47.501+0000 7f058b5939c0 20 started zone id=d9e72d30-c60b-4d0d-9267-fdc36392d5ad (name=default) with tier type = 2024-09-14T11:58:47.523 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:47.525+0000 7f058b5939c0 20 add_watcher() i=0 2024-09-14T11:58:47.523 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:47.525+0000 7f058b5939c0 20 add_watcher() i=1 2024-09-14T11:58:47.523 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:47.525+0000 7f058b5939c0 20 add_watcher() i=2 2024-09-14T11:58:47.523 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:47.525+0000 7f058b5939c0 20 add_watcher() i=3 2024-09-14T11:58:47.523 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:47.525+0000 7f058b5939c0 20 add_watcher() i=4 2024-09-14T11:58:47.523 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:47.525+0000 7f058b5939c0 20 add_watcher() i=5 2024-09-14T11:58:47.523 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:47.525+0000 7f058b5939c0 20 add_watcher() i=6 2024-09-14T11:58:47.526 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:47.525+0000 7f058b5939c0 20 add_watcher() i=7 2024-09-14T11:58:47.526 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:47.525+0000 7f058b5939c0 2 all 8 watchers are set, enabling cache 2024-09-14T11:58:47.530 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:47.529+0000 7f043ffe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:58:47.530 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:47.529+0000 7f058b5939c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:58:47.530 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:47.529+0000 7f058b5939c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:58:47.530 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:47.533+0000 7f058b5939c0 5 note: GC not initialized 2024-09-14T11:58:47.530 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:47.533+0000 7f043efe5640 20 reqs_thread_entry: start 2024-09-14T11:58:47.531 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:47.533+0000 7f058b5939c0 20 init_complete bucket index max shards: 11 2024-09-14T11:58:47.531 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:47.533+0000 7f058b5939c0 20 Filter name: none 2024-09-14T11:58:47.531 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:47.533+0000 7f043cfe1640 20 reqs_thread_entry: start 2024-09-14T11:58:47.531 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:47.533+0000 7f058b5939c0 10 cache get: name=default.rgw.meta+users.uid+foobar.client.0 : miss 2024-09-14T11:58:47.531 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:47.533+0000 7f058b5939c0 20 rados->read ofs=0 len=0 2024-09-14T11:58:47.532 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:47.533+0000 7f058b5939c0 20 rados_obj.operate() r=0 bl.length=486 2024-09-14T11:58:47.532 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:47.533+0000 7f058b5939c0 10 cache put: name=default.rgw.meta+users.uid+foobar.client.0 info.flags=0x13 2024-09-14T11:58:47.532 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:47.533+0000 7f058b5939c0 10 adding default.rgw.meta+users.uid+foobar.client.0 to cache LRU end 2024-09-14T11:58:47.532 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:47.533+0000 7f058b5939c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:58:47.534 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:47.537+0000 7f058b5939c0 10 cache put: name=default.rgw.meta+users.uid+foobar.client.0 info.flags=0x17 2024-09-14T11:58:47.534 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:47.537+0000 7f058b5939c0 10 moving default.rgw.meta+users.uid+foobar.client.0 to cache LRU end 2024-09-14T11:58:47.534 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:47.537+0000 7f058b5939c0 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 0, obj: default.rgw.meta:users.uid:foobar.client.0, ofs0, ns] 2024-09-14T11:58:47.534 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:47.537+0000 7f046cff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1146756268148 cookie 94058604155456 notifier 9090 bl.length()=727 2024-09-14T11:58:47.535 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:47.537+0000 7f046cff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+foobar.client.0 info.flags=0x17 2024-09-14T11:58:47.535 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:47.537+0000 7f046cff9640 10 rgw watcher librados: moving default.rgw.meta+users.uid+foobar.client.0 to cache LRU end 2024-09-14T11:58:47.536 INFO:teuthology.orchestra.run.smithi138.stdout:{ 2024-09-14T11:58:47.536 INFO:teuthology.orchestra.run.smithi138.stdout: "user_id": "foobar.client.0", 2024-09-14T11:58:47.536 INFO:teuthology.orchestra.run.smithi138.stdout: "display_name": "Mr.foobar.client.0", 2024-09-14T11:58:47.536 INFO:teuthology.orchestra.run.smithi138.stdout: "email": "foobar+test@test.test", 2024-09-14T11:58:47.537 INFO:teuthology.orchestra.run.smithi138.stdout: "suspended": 0, 2024-09-14T11:58:47.537 INFO:teuthology.orchestra.run.smithi138.stdout: "max_buckets": 1000, 2024-09-14T11:58:47.537 INFO:teuthology.orchestra.run.smithi138.stdout: "subusers": [], 2024-09-14T11:58:47.537 INFO:teuthology.orchestra.run.smithi138.stdout: "keys": [ 2024-09-14T11:58:47.537 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-09-14T11:58:47.537 INFO:teuthology.orchestra.run.smithi138.stdout: "user": "foobar.client.0", 2024-09-14T11:58:47.537 INFO:teuthology.orchestra.run.smithi138.stdout: "access_key": "YVKBHZBVGHWYKEWGKCHY", 2024-09-14T11:58:47.537 INFO:teuthology.orchestra.run.smithi138.stdout: "secret_key": "WEIcTL2lCJi0TCiQjWDW4K31xpHG7BzvOiUTgik5RHCEFTkc/XqQXQ==", 2024-09-14T11:58:47.537 INFO:teuthology.orchestra.run.smithi138.stdout: "active": true, 2024-09-14T11:58:47.537 INFO:teuthology.orchestra.run.smithi138.stdout: "create_date": "2024-09-14T11:58:46.275845Z" 2024-09-14T11:58:47.537 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-09-14T11:58:47.537 INFO:teuthology.orchestra.run.smithi138.stdout: ], 2024-09-14T11:58:47.537 INFO:teuthology.orchestra.run.smithi138.stdout: "swift_keys": [], 2024-09-14T11:58:47.537 INFO:teuthology.orchestra.run.smithi138.stdout: "caps": [ 2024-09-14T11:58:47.537 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-09-14T11:58:47.538 INFO:teuthology.orchestra.run.smithi138.stdout: "type": "oidc-provider", 2024-09-14T11:58:47.538 INFO:teuthology.orchestra.run.smithi138.stdout: "perm": "*" 2024-09-14T11:58:47.538 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-09-14T11:58:47.538 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-09-14T11:58:47.538 INFO:teuthology.orchestra.run.smithi138.stdout: "type": "roles", 2024-09-14T11:58:47.538 INFO:teuthology.orchestra.run.smithi138.stdout: "perm": "*" 2024-09-14T11:58:47.538 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-09-14T11:58:47.538 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-09-14T11:58:47.538 INFO:teuthology.orchestra.run.smithi138.stdout: "type": "user-policy", 2024-09-14T11:58:47.538 INFO:teuthology.orchestra.run.smithi138.stdout: "perm": "*" 2024-09-14T11:58:47.538 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-09-14T11:58:47.538 INFO:teuthology.orchestra.run.smithi138.stdout: ], 2024-09-14T11:58:47.538 INFO:teuthology.orchestra.run.smithi138.stdout: "op_mask": "read, write, delete", 2024-09-14T11:58:47.538 INFO:teuthology.orchestra.run.smithi138.stdout: "default_placement": "", 2024-09-14T11:58:47.538 INFO:teuthology.orchestra.run.smithi138.stdout: "default_storage_class": "", 2024-09-14T11:58:47.539 INFO:teuthology.orchestra.run.smithi138.stdout: "placement_tags": [], 2024-09-14T11:58:47.539 INFO:teuthology.orchestra.run.smithi138.stdout: "bucket_quota": { 2024-09-14T11:58:47.539 INFO:teuthology.orchestra.run.smithi138.stdout: "enabled": false, 2024-09-14T11:58:47.539 INFO:teuthology.orchestra.run.smithi138.stdout: "check_on_raw": false, 2024-09-14T11:58:47.539 INFO:teuthology.orchestra.run.smithi138.stdout: "max_size": -1, 2024-09-14T11:58:47.539 INFO:teuthology.orchestra.run.smithi138.stdout: "max_size_kb": 0, 2024-09-14T11:58:47.539 INFO:teuthology.orchestra.run.smithi138.stdout: "max_objects": -1 2024-09-14T11:58:47.539 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-09-14T11:58:47.539 INFO:teuthology.orchestra.run.smithi138.stdout: "user_quota": { 2024-09-14T11:58:47.539 INFO:teuthology.orchestra.run.smithi138.stdout: "enabled": false, 2024-09-14T11:58:47.539 INFO:teuthology.orchestra.run.smithi138.stdout: "check_on_raw": false, 2024-09-14T11:58:47.540 INFO:teuthology.orchestra.run.smithi138.stdout: "max_size": -1, 2024-09-14T11:58:47.540 INFO:teuthology.orchestra.run.smithi138.stdout: "max_size_kb": 0, 2024-09-14T11:58:47.540 INFO:teuthology.orchestra.run.smithi138.stdout: "max_objects": -1 2024-09-14T11:58:47.540 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-09-14T11:58:47.540 INFO:teuthology.orchestra.run.smithi138.stdout: "temp_url_keys": [], 2024-09-14T11:58:47.540 INFO:teuthology.orchestra.run.smithi138.stdout: "type": "rgw", 2024-09-14T11:58:47.540 INFO:teuthology.orchestra.run.smithi138.stdout: "mfa_ids": [ 2024-09-14T11:58:47.540 INFO:teuthology.orchestra.run.smithi138.stdout: "6440710422" 2024-09-14T11:58:47.540 INFO:teuthology.orchestra.run.smithi138.stdout: ], 2024-09-14T11:58:47.540 INFO:teuthology.orchestra.run.smithi138.stdout: "account_id": "", 2024-09-14T11:58:47.540 INFO:teuthology.orchestra.run.smithi138.stdout: "path": "/", 2024-09-14T11:58:47.540 INFO:teuthology.orchestra.run.smithi138.stdout: "create_date": "2024-09-14T11:58:46.275829Z", 2024-09-14T11:58:47.540 INFO:teuthology.orchestra.run.smithi138.stdout: "tags": [], 2024-09-14T11:58:47.540 INFO:teuthology.orchestra.run.smithi138.stdout: "group_ids": [] 2024-09-14T11:58:47.540 INFO:teuthology.orchestra.run.smithi138.stdout:} 2024-09-14T11:58:47.540 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-09-14T11:58:47.541 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:47.541+0000 7f043ffe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:58:47.543 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:47.545+0000 7f058b5939c0 20 remove_watcher() i=0 2024-09-14T11:58:47.544 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:47.545+0000 7f058b5939c0 2 removed watcher, disabling cache 2024-09-14T11:58:47.546 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:47.549+0000 7f058b5939c0 20 remove_watcher() i=1 2024-09-14T11:58:47.548 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:47.549+0000 7f058b5939c0 20 remove_watcher() i=2 2024-09-14T11:58:47.551 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:47.553+0000 7f058b5939c0 20 remove_watcher() i=3 2024-09-14T11:58:47.553 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:47.553+0000 7f058b5939c0 20 remove_watcher() i=4 2024-09-14T11:58:47.555 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:47.557+0000 7f058b5939c0 20 remove_watcher() i=5 2024-09-14T11:58:47.556 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:47.557+0000 7f058b5939c0 20 remove_watcher() i=6 2024-09-14T11:58:47.558 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:47.561+0000 7f058b5939c0 20 remove_watcher() i=7 2024-09-14T11:58:47.582 DEBUG:teuthology.orchestra.run.smithi138:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 --cluster ceph account create --account-id RGW88888888888888888 --account-name Mr.RGW88888888888888888 --email RGW88888888888888888+test@test.test 2024-09-14T11:58:47.670 INFO:teuthology.orchestra.run.smithi138.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:58:47.670 INFO:teuthology.orchestra.run.smithi138.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:58:47.714 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:47.713+0000 7f7cea9809c0 20 rados->read ofs=0 len=0 2024-09-14T11:58:47.716 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:47.717+0000 7f7cea9809c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:58:47.716 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:47.717+0000 7f7cea9809c0 20 realm 2024-09-14T11:58:47.716 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:47.717+0000 7f7cea9809c0 20 rados->read ofs=0 len=0 2024-09-14T11:58:47.716 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:47.717+0000 7f7cea9809c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:58:47.716 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:47.717+0000 7f7cea9809c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:58:47.716 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:47.717+0000 7f7cea9809c0 20 rados->read ofs=0 len=0 2024-09-14T11:58:47.716 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:47.717+0000 7f7cea9809c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:58:47.716 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:47.717+0000 7f7cea9809c0 20 rados->read ofs=0 len=0 2024-09-14T11:58:47.718 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:47.717+0000 7f7cea9809c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:58:47.718 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:47.717+0000 7f7cea9809c0 20 rados->read ofs=0 len=0 2024-09-14T11:58:47.719 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:47.721+0000 7f7cea9809c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:58:47.719 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:47.721+0000 7f7cea9809c0 20 searching for the correct realm 2024-09-14T11:58:47.723 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:47.725+0000 7f7ce8c87640 0 -- 172.21.15.138:0/2564618094 >> [v2:172.21.15.154:6824/416768175,v1:172.21.15.154:6825/416768175] conn(0x7f7cd8008050 msgr2=0x7f7cd8063ff0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:58:47.729 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:47.729+0000 7f7ce7c85640 0 -- 172.21.15.138:0/2564618094 >> [v2:172.21.15.138:6816/326481658,v1:172.21.15.138:6817/326481658] conn(0x7f7cd806e770 msgr2=0x7f7cd80636f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:58:47.946 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:47.945+0000 7f7cea9809c0 20 RGWRados::pool_iterate: got zone_info.d9e72d30-c60b-4d0d-9267-fdc36392d5ad 2024-09-14T11:58:47.946 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:47.945+0000 7f7cea9809c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:58:47.946 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:47.945+0000 7f7cea9809c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:58:47.947 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:47.945+0000 7f7cea9809c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:58:47.947 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:47.945+0000 7f7cea9809c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:58:47.947 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:47.945+0000 7f7cea9809c0 20 RGWRados::pool_iterate: got zonegroup_info.65ab941b-da8c-4160-94fb-3672b069d44f 2024-09-14T11:58:47.947 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:47.945+0000 7f7cea9809c0 20 rados->read ofs=0 len=0 2024-09-14T11:58:47.947 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:47.949+0000 7f7cea9809c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:58:47.947 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:47.949+0000 7f7cea9809c0 20 rados->read ofs=0 len=0 2024-09-14T11:58:47.947 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:47.949+0000 7f7cea9809c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:58:47.948 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:47.949+0000 7f7cea9809c0 20 rados->read ofs=0 len=0 2024-09-14T11:58:47.948 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:47.949+0000 7f7cea9809c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:58:47.948 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:47.949+0000 7f7cea9809c0 20 zone default found 2024-09-14T11:58:47.949 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:47.949+0000 7f7cea9809c0 4 Realm: () 2024-09-14T11:58:47.949 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:47.949+0000 7f7cea9809c0 4 ZoneGroup: default (65ab941b-da8c-4160-94fb-3672b069d44f) 2024-09-14T11:58:47.949 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:47.949+0000 7f7cea9809c0 4 Zone: default (d9e72d30-c60b-4d0d-9267-fdc36392d5ad) 2024-09-14T11:58:47.949 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:47.949+0000 7f7cea9809c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:58:47.949 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:47.949+0000 7f7cea9809c0 20 zonegroup default 2024-09-14T11:58:47.949 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:47.949+0000 7f7cea9809c0 20 rados->read ofs=0 len=0 2024-09-14T11:58:47.949 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:47.949+0000 7f7cea9809c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:58:47.949 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:47.949+0000 7f7cea9809c0 20 rados->read ofs=0 len=0 2024-09-14T11:58:47.950 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:47.953+0000 7f7cea9809c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:58:47.950 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:47.953+0000 7f7cea9809c0 20 rados->read ofs=0 len=0 2024-09-14T11:58:47.951 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:47.953+0000 7f7cea9809c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:58:47.951 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:47.953+0000 7f7cea9809c0 20 started sync module instance, tier type = 2024-09-14T11:58:47.951 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:47.953+0000 7f7cea9809c0 20 started zone id=d9e72d30-c60b-4d0d-9267-fdc36392d5ad (name=default) with tier type = 2024-09-14T11:58:47.974 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:47.973+0000 7f7cea9809c0 20 add_watcher() i=0 2024-09-14T11:58:47.974 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:47.973+0000 7f7cea9809c0 20 add_watcher() i=1 2024-09-14T11:58:47.974 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:47.973+0000 7f7cea9809c0 20 add_watcher() i=2 2024-09-14T11:58:47.974 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:47.973+0000 7f7cea9809c0 20 add_watcher() i=3 2024-09-14T11:58:47.975 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:47.973+0000 7f7cea9809c0 20 add_watcher() i=4 2024-09-14T11:58:47.975 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:47.973+0000 7f7cea9809c0 20 add_watcher() i=5 2024-09-14T11:58:47.975 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:47.977+0000 7f7cea9809c0 20 add_watcher() i=6 2024-09-14T11:58:47.976 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:47.977+0000 7f7cea9809c0 20 add_watcher() i=7 2024-09-14T11:58:47.976 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:47.977+0000 7f7cea9809c0 2 all 8 watchers are set, enabling cache 2024-09-14T11:58:47.981 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:47.981+0000 7f7b9efdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:58:47.981 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:47.981+0000 7f7cea9809c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:58:47.981 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:47.981+0000 7f7cea9809c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:58:47.981 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:47.981+0000 7f7cea9809c0 5 note: GC not initialized 2024-09-14T11:58:47.981 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:47.981+0000 7f7b9dfdb640 20 reqs_thread_entry: start 2024-09-14T11:58:47.982 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:47.981+0000 7f7cea9809c0 20 init_complete bucket index max shards: 11 2024-09-14T11:58:47.982 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:47.981+0000 7f7cea9809c0 20 Filter name: none 2024-09-14T11:58:47.982 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:47.985+0000 7f7b0f7fe640 20 reqs_thread_entry: start 2024-09-14T11:58:47.982 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:47.985+0000 7f7cea9809c0 10 cache get: name=default.rgw.meta+accounts+name.$Mr.RGW88888888888888888 : miss 2024-09-14T11:58:47.982 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:47.985+0000 7f7cea9809c0 20 rados->read ofs=0 len=0 2024-09-14T11:58:47.983 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:47.985+0000 7f7cea9809c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:58:47.983 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:47.985+0000 7f7cea9809c0 10 cache put: name=default.rgw.meta+accounts+name.$Mr.RGW88888888888888888 info.flags=0x0 2024-09-14T11:58:47.983 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:47.985+0000 7f7cea9809c0 10 adding default.rgw.meta+accounts+name.$Mr.RGW88888888888888888 to cache LRU end 2024-09-14T11:58:47.983 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:47.985+0000 7f7cea9809c0 20 failed to read name.$Mr.RGW88888888888888888 with: (2) No such file or directory 2024-09-14T11:58:47.983 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:47.985+0000 7f7cea9809c0 10 cache get: name=default.rgw.meta+users.email+rgw88888888888888888+test@test.test : miss 2024-09-14T11:58:47.983 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:47.985+0000 7f7cea9809c0 20 rados->read ofs=0 len=0 2024-09-14T11:58:47.984 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:47.985+0000 7f7cea9809c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:58:47.984 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:47.985+0000 7f7cea9809c0 10 cache put: name=default.rgw.meta+users.email+rgw88888888888888888+test@test.test info.flags=0x0 2024-09-14T11:58:47.984 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:47.985+0000 7f7cea9809c0 10 adding default.rgw.meta+users.email+rgw88888888888888888+test@test.test to cache LRU end 2024-09-14T11:58:47.984 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:47.985+0000 7f7cea9809c0 20 failed to read rgw88888888888888888+test@test.test with: (2) No such file or directory 2024-09-14T11:58:47.986 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:47.989+0000 7f7cea9809c0 10 cache put: name=default.rgw.meta+accounts+account.RGW88888888888888888 info.flags=0x17 2024-09-14T11:58:47.986 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:47.989+0000 7f7cea9809c0 10 adding default.rgw.meta+accounts+account.RGW88888888888888888 to cache LRU end 2024-09-14T11:58:47.986 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:47.989+0000 7f7cea9809c0 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:accounts:account.RGW88888888888888888, ofs0, ns] 2024-09-14T11:58:47.987 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:47.989+0000 7f7bbf7fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1146756268198 cookie 94094019176976 notifier 8474 bl.length()=384 2024-09-14T11:58:47.987 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:47.989+0000 7f7bbf7fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+accounts+account.RGW88888888888888888 info.flags=0x17 2024-09-14T11:58:47.987 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:47.989+0000 7f7bbf7fe640 10 rgw watcher librados: moving default.rgw.meta+accounts+account.RGW88888888888888888 to cache LRU end 2024-09-14T11:58:47.993 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:47.993+0000 7f7cea9809c0 10 cache put: name=default.rgw.meta+accounts+name.$Mr.RGW88888888888888888 info.flags=0x17 2024-09-14T11:58:47.993 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:47.993+0000 7f7cea9809c0 10 moving default.rgw.meta+accounts+name.$Mr.RGW88888888888888888 to cache LRU end 2024-09-14T11:58:47.993 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:47.993+0000 7f7cea9809c0 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:accounts:name.$Mr.RGW88888888888888888, ofs0, ns] 2024-09-14T11:58:47.993 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:47.993+0000 7f7bbf7fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1146756268242 cookie 94094019184544 notifier 8474 bl.length()=225 2024-09-14T11:58:47.993 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:47.993+0000 7f7bbf7fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+accounts+name.$Mr.RGW88888888888888888 info.flags=0x17 2024-09-14T11:58:47.994 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:47.993+0000 7f7bbf7fe640 10 rgw watcher librados: moving default.rgw.meta+accounts+name.$Mr.RGW88888888888888888 to cache LRU end 2024-09-14T11:58:47.999 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:48.001+0000 7f7cea9809c0 10 cache put: name=default.rgw.meta+users.email+rgw88888888888888888+test@test.test info.flags=0x17 2024-09-14T11:58:47.999 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:48.001+0000 7f7cea9809c0 10 moving default.rgw.meta+users.email+rgw88888888888888888+test@test.test to cache LRU end 2024-09-14T11:58:47.999 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:48.001+0000 7f7cea9809c0 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 0, obj: default.rgw.meta:users.email:rgw88888888888888888+test@test.test, ofs0, ns] 2024-09-14T11:58:47.999 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:48.001+0000 7f7bbeffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1146756268123 cookie 94094019186112 notifier 8474 bl.length()=234 2024-09-14T11:58:47.999 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:48.001+0000 7f7bbeffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.email+rgw88888888888888888+test@test.test info.flags=0x17 2024-09-14T11:58:47.999 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:48.001+0000 7f7bbeffd640 10 rgw watcher librados: moving default.rgw.meta+users.email+rgw88888888888888888+test@test.test to cache LRU end 2024-09-14T11:58:48.003 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:48.005+0000 7f7b9efdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:58:48.008 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:48.009+0000 7f7cea9809c0 20 remove_watcher() i=0 2024-09-14T11:58:48.008 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:48.009+0000 7f7cea9809c0 2 removed watcher, disabling cache 2024-09-14T11:58:48.010 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:48.013+0000 7f7cea9809c0 20 remove_watcher() i=1 2024-09-14T11:58:48.013 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:48.013+0000 7f7cea9809c0 20 remove_watcher() i=2 2024-09-14T11:58:48.015 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:48.017+0000 7f7cea9809c0 20 remove_watcher() i=3 2024-09-14T11:58:48.017 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:48.017+0000 7f7cea9809c0 20 remove_watcher() i=4 2024-09-14T11:58:48.019 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:48.021+0000 7f7cea9809c0 20 remove_watcher() i=5 2024-09-14T11:58:48.021 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:48.021+0000 7f7cea9809c0 20 remove_watcher() i=6 2024-09-14T11:58:48.023 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:48.025+0000 7f7cea9809c0 20 remove_watcher() i=7 2024-09-14T11:58:48.036 INFO:teuthology.orchestra.run.smithi138.stdout:{ 2024-09-14T11:58:48.036 INFO:teuthology.orchestra.run.smithi138.stdout: "id": "RGW88888888888888888", 2024-09-14T11:58:48.036 INFO:teuthology.orchestra.run.smithi138.stdout: "tenant": "", 2024-09-14T11:58:48.037 INFO:teuthology.orchestra.run.smithi138.stdout: "name": "Mr.RGW88888888888888888", 2024-09-14T11:58:48.037 INFO:teuthology.orchestra.run.smithi138.stdout: "email": "RGW88888888888888888+test@test.test", 2024-09-14T11:58:48.037 INFO:teuthology.orchestra.run.smithi138.stdout: "quota": { 2024-09-14T11:58:48.037 INFO:teuthology.orchestra.run.smithi138.stdout: "enabled": false, 2024-09-14T11:58:48.037 INFO:teuthology.orchestra.run.smithi138.stdout: "check_on_raw": false, 2024-09-14T11:58:48.037 INFO:teuthology.orchestra.run.smithi138.stdout: "max_size": -1, 2024-09-14T11:58:48.037 INFO:teuthology.orchestra.run.smithi138.stdout: "max_size_kb": 0, 2024-09-14T11:58:48.037 INFO:teuthology.orchestra.run.smithi138.stdout: "max_objects": -1 2024-09-14T11:58:48.037 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-09-14T11:58:48.037 INFO:teuthology.orchestra.run.smithi138.stdout: "bucket_quota": { 2024-09-14T11:58:48.037 INFO:teuthology.orchestra.run.smithi138.stdout: "enabled": false, 2024-09-14T11:58:48.037 INFO:teuthology.orchestra.run.smithi138.stdout: "check_on_raw": false, 2024-09-14T11:58:48.038 INFO:teuthology.orchestra.run.smithi138.stdout: "max_size": -1, 2024-09-14T11:58:48.038 INFO:teuthology.orchestra.run.smithi138.stdout: "max_size_kb": 0, 2024-09-14T11:58:48.038 INFO:teuthology.orchestra.run.smithi138.stdout: "max_objects": -1 2024-09-14T11:58:48.038 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-09-14T11:58:48.038 INFO:teuthology.orchestra.run.smithi138.stdout: "max_users": 1000, 2024-09-14T11:58:48.038 INFO:teuthology.orchestra.run.smithi138.stdout: "max_roles": 1000, 2024-09-14T11:58:48.038 INFO:teuthology.orchestra.run.smithi138.stdout: "max_groups": 1000, 2024-09-14T11:58:48.038 INFO:teuthology.orchestra.run.smithi138.stdout: "max_buckets": 1000, 2024-09-14T11:58:48.038 INFO:teuthology.orchestra.run.smithi138.stdout: "max_access_keys": 4 2024-09-14T11:58:48.038 INFO:teuthology.orchestra.run.smithi138.stdout:} 2024-09-14T11:58:48.039 DEBUG:tasks.s3tests:Creating user RGW88888888888888888 on client.0 2024-09-14T11:58:48.039 DEBUG:teuthology.orchestra.run.smithi138:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 user create --uid root1.client.0 --display-name Mr.RGW88888888888888888 --email root1+test@test.test --access-key TUARXAQYLUARJEWZFHDQ --secret b9jCAeKaFKZQUGQXhbVt4EELxZepEfKdxaGXVdQjW/VUZTafdxgnoQ== --cluster ceph --account-id RGW88888888888888888 --account-root 2024-09-14T11:58:48.131 INFO:teuthology.orchestra.run.smithi138.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:58:48.131 INFO:teuthology.orchestra.run.smithi138.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:58:48.172 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:48.173+0000 7f14d6ef59c0 20 rados->read ofs=0 len=0 2024-09-14T11:58:48.174 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:48.173+0000 7f14d6ef59c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:58:48.174 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:48.173+0000 7f14d6ef59c0 20 realm 2024-09-14T11:58:48.174 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:48.173+0000 7f14d6ef59c0 20 rados->read ofs=0 len=0 2024-09-14T11:58:48.174 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:48.177+0000 7f14d6ef59c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:58:48.174 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:48.177+0000 7f14d6ef59c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:58:48.174 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:48.177+0000 7f14d6ef59c0 20 rados->read ofs=0 len=0 2024-09-14T11:58:48.175 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:48.177+0000 7f14d6ef59c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:58:48.175 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:48.177+0000 7f14d6ef59c0 20 rados->read ofs=0 len=0 2024-09-14T11:58:48.176 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:48.177+0000 7f14d6ef59c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:58:48.176 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:48.177+0000 7f14d6ef59c0 20 rados->read ofs=0 len=0 2024-09-14T11:58:48.177 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:48.177+0000 7f14d6ef59c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:58:48.177 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:48.177+0000 7f14d6ef59c0 20 searching for the correct realm 2024-09-14T11:58:48.180 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:48.181+0000 7f14d51fc640 0 -- 172.21.15.138:0/4260438860 >> [v2:172.21.15.154:6824/416768175,v1:172.21.15.154:6825/416768175] conn(0x7f14cc004040 msgr2=0x7f14cc0cea00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:58:48.396 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:48.397+0000 7f14d41fa640 0 -- 172.21.15.138:0/4260438860 >> [v2:172.21.15.138:6816/326481658,v1:172.21.15.138:6817/326481658] conn(0x7f14cc0d0540 msgr2=0x7f14cc119150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:58:48.614 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:48.613+0000 7f14d6ef59c0 20 RGWRados::pool_iterate: got zone_info.d9e72d30-c60b-4d0d-9267-fdc36392d5ad 2024-09-14T11:58:48.614 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:48.613+0000 7f14d6ef59c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:58:48.614 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:48.613+0000 7f14d6ef59c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:58:48.614 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:48.613+0000 7f14d6ef59c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:58:48.614 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:48.613+0000 7f14d6ef59c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:58:48.614 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:48.613+0000 7f14d6ef59c0 20 RGWRados::pool_iterate: got zonegroup_info.65ab941b-da8c-4160-94fb-3672b069d44f 2024-09-14T11:58:48.614 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:48.613+0000 7f14d6ef59c0 20 rados->read ofs=0 len=0 2024-09-14T11:58:48.614 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:48.613+0000 7f14d6ef59c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:58:48.614 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:48.613+0000 7f14d6ef59c0 20 rados->read ofs=0 len=0 2024-09-14T11:58:48.615 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:48.617+0000 7f14d6ef59c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:58:48.615 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:48.617+0000 7f14d6ef59c0 20 rados->read ofs=0 len=0 2024-09-14T11:58:48.615 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:48.617+0000 7f14d6ef59c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:58:48.616 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:48.617+0000 7f14d6ef59c0 20 zone default found 2024-09-14T11:58:48.616 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:48.617+0000 7f14d6ef59c0 4 Realm: () 2024-09-14T11:58:48.616 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:48.617+0000 7f14d6ef59c0 4 ZoneGroup: default (65ab941b-da8c-4160-94fb-3672b069d44f) 2024-09-14T11:58:48.616 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:48.617+0000 7f14d6ef59c0 4 Zone: default (d9e72d30-c60b-4d0d-9267-fdc36392d5ad) 2024-09-14T11:58:48.616 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:48.617+0000 7f14d6ef59c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:58:48.616 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:48.617+0000 7f14d6ef59c0 20 zonegroup default 2024-09-14T11:58:48.616 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:48.617+0000 7f14d6ef59c0 20 rados->read ofs=0 len=0 2024-09-14T11:58:48.617 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:48.617+0000 7f14d6ef59c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:58:48.617 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:48.617+0000 7f14d6ef59c0 20 rados->read ofs=0 len=0 2024-09-14T11:58:48.617 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:48.617+0000 7f14d6ef59c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:58:48.617 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:48.617+0000 7f14d6ef59c0 20 rados->read ofs=0 len=0 2024-09-14T11:58:48.618 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:48.617+0000 7f14d6ef59c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:58:48.618 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:48.617+0000 7f14d6ef59c0 20 started sync module instance, tier type = 2024-09-14T11:58:48.618 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:48.617+0000 7f14d6ef59c0 20 started zone id=d9e72d30-c60b-4d0d-9267-fdc36392d5ad (name=default) with tier type = 2024-09-14T11:58:48.641 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:48.641+0000 7f14d6ef59c0 20 add_watcher() i=0 2024-09-14T11:58:48.641 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:48.641+0000 7f14d6ef59c0 20 add_watcher() i=1 2024-09-14T11:58:48.641 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:48.641+0000 7f14d6ef59c0 20 add_watcher() i=2 2024-09-14T11:58:48.641 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:48.641+0000 7f14d6ef59c0 20 add_watcher() i=3 2024-09-14T11:58:48.641 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:48.641+0000 7f14d6ef59c0 20 add_watcher() i=4 2024-09-14T11:58:48.642 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:48.641+0000 7f14d6ef59c0 20 add_watcher() i=5 2024-09-14T11:58:48.642 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:48.641+0000 7f14d6ef59c0 20 add_watcher() i=6 2024-09-14T11:58:48.643 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:48.645+0000 7f14d6ef59c0 20 add_watcher() i=7 2024-09-14T11:58:48.644 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:48.645+0000 7f14d6ef59c0 2 all 8 watchers are set, enabling cache 2024-09-14T11:58:48.648 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:48.649+0000 7f138b7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:58:48.648 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:48.649+0000 7f14d6ef59c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:58:48.648 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:48.649+0000 7f14d6ef59c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:58:48.648 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:48.649+0000 7f14d6ef59c0 5 note: GC not initialized 2024-09-14T11:58:48.649 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:48.649+0000 7f138a7e4640 20 reqs_thread_entry: start 2024-09-14T11:58:48.649 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:48.649+0000 7f14d6ef59c0 20 init_complete bucket index max shards: 11 2024-09-14T11:58:48.649 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:48.649+0000 7f14d6ef59c0 20 Filter name: none 2024-09-14T11:58:48.650 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:48.649+0000 7f13837fe640 20 reqs_thread_entry: start 2024-09-14T11:58:48.650 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:48.649+0000 7f14d6ef59c0 10 cache get: name=default.rgw.meta+users.uid+root1.client.0 : miss 2024-09-14T11:58:48.650 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:48.649+0000 7f14d6ef59c0 20 rados->read ofs=0 len=0 2024-09-14T11:58:48.651 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:48.653+0000 7f14d6ef59c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:58:48.651 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:48.653+0000 7f14d6ef59c0 10 cache put: name=default.rgw.meta+users.uid+root1.client.0 info.flags=0x0 2024-09-14T11:58:48.651 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:48.653+0000 7f14d6ef59c0 10 adding default.rgw.meta+users.uid+root1.client.0 to cache LRU end 2024-09-14T11:58:48.651 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:48.653+0000 7f14d6ef59c0 10 cache get: name=default.rgw.meta+users.email+root1+test@test.test : miss 2024-09-14T11:58:48.651 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:48.653+0000 7f14d6ef59c0 20 rados->read ofs=0 len=0 2024-09-14T11:58:48.651 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:48.653+0000 7f14d6ef59c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:58:48.651 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:48.653+0000 7f14d6ef59c0 10 cache put: name=default.rgw.meta+users.email+root1+test@test.test info.flags=0x0 2024-09-14T11:58:48.651 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:48.653+0000 7f14d6ef59c0 10 adding default.rgw.meta+users.email+root1+test@test.test to cache LRU end 2024-09-14T11:58:48.651 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:48.653+0000 7f14d6ef59c0 10 cache get: name=default.rgw.meta+users.keys+TUARXAQYLUARJEWZFHDQ : miss 2024-09-14T11:58:48.651 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:48.653+0000 7f14d6ef59c0 20 rados->read ofs=0 len=0 2024-09-14T11:58:48.651 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:48.653+0000 7f14d6ef59c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:58:48.652 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:48.653+0000 7f14d6ef59c0 10 cache put: name=default.rgw.meta+users.keys+TUARXAQYLUARJEWZFHDQ info.flags=0x0 2024-09-14T11:58:48.652 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:48.653+0000 7f14d6ef59c0 10 adding default.rgw.meta+users.keys+TUARXAQYLUARJEWZFHDQ to cache LRU end 2024-09-14T11:58:48.652 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:48.653+0000 7f14d6ef59c0 10 cache get: name=default.rgw.meta+accounts+account.RGW88888888888888888 : miss 2024-09-14T11:58:48.652 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:48.653+0000 7f14d6ef59c0 20 rados->read ofs=0 len=0 2024-09-14T11:58:48.652 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:48.653+0000 7f14d6ef59c0 20 rados_obj.operate() r=0 bl.length=184 2024-09-14T11:58:48.653 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:48.653+0000 7f14d6ef59c0 10 cache put: name=default.rgw.meta+accounts+account.RGW88888888888888888 info.flags=0x17 2024-09-14T11:58:48.653 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:48.653+0000 7f14d6ef59c0 10 adding default.rgw.meta+accounts+account.RGW88888888888888888 to cache LRU end 2024-09-14T11:58:48.653 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:48.653+0000 7f14d6ef59c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:58:48.653 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:48.653+0000 7f14d6ef59c0 10 cache get: name=default.rgw.meta+users.keys+TUARXAQYLUARJEWZFHDQ : hit (negative entry) 2024-09-14T11:58:48.653 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:48.653+0000 7f14d6ef59c0 10 cache get: name=default.rgw.meta+users.keys+TUARXAQYLUARJEWZFHDQ : hit (negative entry) 2024-09-14T11:58:48.655 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:48.657+0000 7f14d6ef59c0 10 cache put: name=default.rgw.meta+users.uid+root1.client.0 info.flags=0x17 2024-09-14T11:58:48.655 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:48.657+0000 7f14d6ef59c0 10 moving default.rgw.meta+users.uid+root1.client.0 to cache LRU end 2024-09-14T11:58:48.655 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:48.657+0000 7f14d6ef59c0 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:users.uid:root1.client.0, ofs0, ns] 2024-09-14T11:58:48.656 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:48.657+0000 7f13abfff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1146756268199 cookie 94733852873824 notifier 9126 bl.length()=681 2024-09-14T11:58:48.656 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:48.657+0000 7f13abfff640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+root1.client.0 info.flags=0x17 2024-09-14T11:58:48.656 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:48.657+0000 7f13abfff640 10 rgw watcher librados: moving default.rgw.meta+users.uid+root1.client.0 to cache LRU end 2024-09-14T11:58:48.661 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:48.661+0000 7f14d6ef59c0 10 cache put: name=default.rgw.meta+users.email+root1+test@test.test info.flags=0x7 2024-09-14T11:58:48.662 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:48.661+0000 7f14d6ef59c0 10 moving default.rgw.meta+users.email+root1+test@test.test to cache LRU end 2024-09-14T11:58:48.662 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:48.661+0000 7f14d6ef59c0 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:users.email:root1+test@test.test, ofs0, ns] 2024-09-14T11:58:48.662 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:48.665+0000 7f13ab7fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1146756268217 cookie 94733852893664 notifier 9126 bl.length()=189 2024-09-14T11:58:48.662 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:48.665+0000 7f13ab7fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.email+root1+test@test.test info.flags=0x7 2024-09-14T11:58:48.662 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:48.665+0000 7f13ab7fe640 10 rgw watcher librados: moving default.rgw.meta+users.email+root1+test@test.test to cache LRU end 2024-09-14T11:58:48.667 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:48.669+0000 7f14d6ef59c0 10 cache put: name=default.rgw.meta+users.keys+TUARXAQYLUARJEWZFHDQ info.flags=0x7 2024-09-14T11:58:48.667 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:48.669+0000 7f14d6ef59c0 10 moving default.rgw.meta+users.keys+TUARXAQYLUARJEWZFHDQ to cache LRU end 2024-09-14T11:58:48.667 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:48.669+0000 7f14d6ef59c0 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:users.keys:TUARXAQYLUARJEWZFHDQ, ofs0, ns] 2024-09-14T11:58:48.667 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:48.669+0000 7f13ab7fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1146756268218 cookie 94733852891648 notifier 9126 bl.length()=188 2024-09-14T11:58:48.667 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:48.669+0000 7f13ab7fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.keys+TUARXAQYLUARJEWZFHDQ info.flags=0x7 2024-09-14T11:58:48.667 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:48.669+0000 7f13ab7fe640 10 rgw watcher librados: moving default.rgw.meta+users.keys+TUARXAQYLUARJEWZFHDQ to cache LRU end 2024-09-14T11:58:48.672 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:48.673+0000 7f14d6ef59c0 20 linked user root1.client.0 to account RGW88888888888888888 2024-09-14T11:58:48.672 INFO:teuthology.orchestra.run.smithi138.stdout:{ 2024-09-14T11:58:48.672 INFO:teuthology.orchestra.run.smithi138.stdout: "user_id": "root1.client.0", 2024-09-14T11:58:48.672 INFO:teuthology.orchestra.run.smithi138.stdout: "display_name": "Mr.RGW88888888888888888", 2024-09-14T11:58:48.673 INFO:teuthology.orchestra.run.smithi138.stdout: "email": "root1+test@test.test", 2024-09-14T11:58:48.673 INFO:teuthology.orchestra.run.smithi138.stdout: "suspended": 0, 2024-09-14T11:58:48.673 INFO:teuthology.orchestra.run.smithi138.stdout: "max_buckets": 1000, 2024-09-14T11:58:48.673 INFO:teuthology.orchestra.run.smithi138.stdout: "subusers": [], 2024-09-14T11:58:48.673 INFO:teuthology.orchestra.run.smithi138.stdout: "keys": [ 2024-09-14T11:58:48.673 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-09-14T11:58:48.673 INFO:teuthology.orchestra.run.smithi138.stdout: "user": "root1.client.0", 2024-09-14T11:58:48.673 INFO:teuthology.orchestra.run.smithi138.stdout: "access_key": "TUARXAQYLUARJEWZFHDQ", 2024-09-14T11:58:48.673 INFO:teuthology.orchestra.run.smithi138.stdout: "secret_key": "b9jCAeKaFKZQUGQXhbVt4EELxZepEfKdxaGXVdQjW/VUZTafdxgnoQ==", 2024-09-14T11:58:48.673 INFO:teuthology.orchestra.run.smithi138.stdout: "active": true, 2024-09-14T11:58:48.676 INFO:teuthology.orchestra.run.smithi138.stdout: "create_date": "2024-09-14T11:58:48.659356Z" 2024-09-14T11:58:48.676 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-09-14T11:58:48.677 INFO:teuthology.orchestra.run.smithi138.stdout: ], 2024-09-14T11:58:48.677 INFO:teuthology.orchestra.run.smithi138.stdout: "swift_keys": [], 2024-09-14T11:58:48.677 INFO:teuthology.orchestra.run.smithi138.stdout: "caps": [], 2024-09-14T11:58:48.677 INFO:teuthology.orchestra.run.smithi138.stdout: "op_mask": "read, write, delete", 2024-09-14T11:58:48.677 INFO:teuthology.orchestra.run.smithi138.stdout: "default_placement": "", 2024-09-14T11:58:48.677 INFO:teuthology.orchestra.run.smithi138.stdout: "default_storage_class": "", 2024-09-14T11:58:48.677 INFO:teuthology.orchestra.run.smithi138.stdout: "placement_tags": [], 2024-09-14T11:58:48.677 INFO:teuthology.orchestra.run.smithi138.stdout: "bucket_quota": { 2024-09-14T11:58:48.677 INFO:teuthology.orchestra.run.smithi138.stdout: "enabled": false, 2024-09-14T11:58:48.677 INFO:teuthology.orchestra.run.smithi138.stdout: "check_on_raw": false, 2024-09-14T11:58:48.677 INFO:teuthology.orchestra.run.smithi138.stdout: "max_size": -1, 2024-09-14T11:58:48.677 INFO:teuthology.orchestra.run.smithi138.stdout: "max_size_kb": 0, 2024-09-14T11:58:48.677 INFO:teuthology.orchestra.run.smithi138.stdout: "max_objects": -1 2024-09-14T11:58:48.678 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-09-14T11:58:48.678 INFO:teuthology.orchestra.run.smithi138.stdout: "user_quota": { 2024-09-14T11:58:48.678 INFO:teuthology.orchestra.run.smithi138.stdout: "enabled": false, 2024-09-14T11:58:48.678 INFO:teuthology.orchestra.run.smithi138.stdout: "check_on_raw": false, 2024-09-14T11:58:48.678 INFO:teuthology.orchestra.run.smithi138.stdout: "max_size": -1, 2024-09-14T11:58:48.678 INFO:teuthology.orchestra.run.smithi138.stdout: "max_size_kb": 0, 2024-09-14T11:58:48.678 INFO:teuthology.orchestra.run.smithi138.stdout: "max_objects": -1 2024-09-14T11:58:48.678 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-09-14T11:58:48.678 INFO:teuthology.orchestra.run.smithi138.stdout: "temp_url_keys": [], 2024-09-14T11:58:48.678 INFO:teuthology.orchestra.run.smithi138.stdout: "type": "root", 2024-09-14T11:58:48.678 INFO:teuthology.orchestra.run.smithi138.stdout: "mfa_ids": [], 2024-09-14T11:58:48.678 INFO:teuthology.orchestra.run.smithi138.stdout: "account_id": "RGW88888888888888888", 2024-09-14T11:58:48.678 INFO:teuthology.orchestra.run.smithi138.stdout: "path": "/", 2024-09-14T11:58:48.678 INFO:teuthology.orchestra.run.smithi138.stdout: "create_date": "2024-09-14T11:58:48.659317Z", 2024-09-14T11:58:48.678 INFO:teuthology.orchestra.run.smithi138.stdout: "tags": [], 2024-09-14T11:58:48.678 INFO:teuthology.orchestra.run.smithi138.stdout: "group_ids": [] 2024-09-14T11:58:48.679 INFO:teuthology.orchestra.run.smithi138.stdout:} 2024-09-14T11:58:48.679 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-09-14T11:58:48.679 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:48.673+0000 7f138b7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:58:48.679 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:48.681+0000 7f14d6ef59c0 20 remove_watcher() i=0 2024-09-14T11:58:48.679 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:48.681+0000 7f14d6ef59c0 2 removed watcher, disabling cache 2024-09-14T11:58:48.680 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:48.681+0000 7f14d6ef59c0 20 remove_watcher() i=1 2024-09-14T11:58:48.683 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:48.685+0000 7f14d6ef59c0 20 remove_watcher() i=2 2024-09-14T11:58:48.685 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:48.685+0000 7f14d6ef59c0 20 remove_watcher() i=3 2024-09-14T11:58:48.687 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:48.689+0000 7f14d6ef59c0 20 remove_watcher() i=4 2024-09-14T11:58:48.689 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:48.689+0000 7f14d6ef59c0 20 remove_watcher() i=5 2024-09-14T11:58:48.690 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:48.693+0000 7f14d6ef59c0 20 remove_watcher() i=6 2024-09-14T11:58:48.692 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:48.693+0000 7f14d6ef59c0 20 remove_watcher() i=7 2024-09-14T11:58:48.710 DEBUG:teuthology.orchestra.run.smithi138:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 mfa create --uid root1.client.0 --totp-serial 8740350600 --totp-seed DIBDCIM7WWARTUFSPF75TVQB6ZYYBRVQZTYO4FT2HJRWTIAMYGHBHFKGZGHBRVGR --totp-seconds 5 --totp-window 8 --totp-seed-type base32 --cluster ceph 2024-09-14T11:58:48.756 INFO:teuthology.orchestra.run.smithi138.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:58:48.756 INFO:teuthology.orchestra.run.smithi138.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:58:48.798 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:48.801+0000 7f9ada5699c0 20 rados->read ofs=0 len=0 2024-09-14T11:58:48.800 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:48.801+0000 7f9ada5699c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:58:48.800 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:48.801+0000 7f9ada5699c0 20 realm 2024-09-14T11:58:48.800 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:48.801+0000 7f9ada5699c0 20 rados->read ofs=0 len=0 2024-09-14T11:58:48.800 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:48.801+0000 7f9ada5699c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:58:48.800 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:48.801+0000 7f9ada5699c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:58:48.800 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:48.801+0000 7f9ada5699c0 20 rados->read ofs=0 len=0 2024-09-14T11:58:48.800 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:48.801+0000 7f9ada5699c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:58:48.800 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:48.801+0000 7f9ada5699c0 20 rados->read ofs=0 len=0 2024-09-14T11:58:48.802 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:48.801+0000 7f9ada5699c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:58:48.802 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:48.801+0000 7f9ada5699c0 20 rados->read ofs=0 len=0 2024-09-14T11:58:48.802 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:48.805+0000 7f9ada5699c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:58:48.802 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:48.805+0000 7f9ada5699c0 20 searching for the correct realm 2024-09-14T11:58:48.807 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:48.809+0000 7f9ad786e640 0 -- 172.21.15.138:0/3135569889 >> [v2:172.21.15.154:6808/1468088432,v1:172.21.15.154:6809/1468088432] conn(0x7f9ad005d130 msgr2=0x7f9ad005bba0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:58:48.813 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:48.813+0000 7f9ad786e640 0 -- 172.21.15.138:0/3135569889 >> [v2:172.21.15.138:6816/326481658,v1:172.21.15.138:6817/326481658] conn(0x7f9ac8102400 msgr2=0x7f9ac8102880 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:58:49.030 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:49.029+0000 7f9ada5699c0 20 RGWRados::pool_iterate: got zone_info.d9e72d30-c60b-4d0d-9267-fdc36392d5ad 2024-09-14T11:58:49.030 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:49.029+0000 7f9ada5699c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:58:49.030 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:49.029+0000 7f9ada5699c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:58:49.030 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:49.029+0000 7f9ada5699c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:58:49.031 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:49.029+0000 7f9ada5699c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:58:49.031 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:49.029+0000 7f9ada5699c0 20 RGWRados::pool_iterate: got zonegroup_info.65ab941b-da8c-4160-94fb-3672b069d44f 2024-09-14T11:58:49.031 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:49.029+0000 7f9ada5699c0 20 rados->read ofs=0 len=0 2024-09-14T11:58:49.031 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:49.033+0000 7f9ada5699c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:58:49.031 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:49.033+0000 7f9ada5699c0 20 rados->read ofs=0 len=0 2024-09-14T11:58:49.032 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:49.033+0000 7f9ada5699c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:58:49.032 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:49.033+0000 7f9ada5699c0 20 rados->read ofs=0 len=0 2024-09-14T11:58:49.033 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:49.033+0000 7f9ada5699c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:58:49.033 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:49.033+0000 7f9ada5699c0 20 zone default found 2024-09-14T11:58:49.033 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:49.033+0000 7f9ada5699c0 4 Realm: () 2024-09-14T11:58:49.033 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:49.033+0000 7f9ada5699c0 4 ZoneGroup: default (65ab941b-da8c-4160-94fb-3672b069d44f) 2024-09-14T11:58:49.033 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:49.033+0000 7f9ada5699c0 4 Zone: default (d9e72d30-c60b-4d0d-9267-fdc36392d5ad) 2024-09-14T11:58:49.033 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:49.033+0000 7f9ada5699c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:58:49.033 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:49.033+0000 7f9ada5699c0 20 zonegroup default 2024-09-14T11:58:49.033 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:49.033+0000 7f9ada5699c0 20 rados->read ofs=0 len=0 2024-09-14T11:58:49.034 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:49.033+0000 7f9ada5699c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:58:49.034 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:49.033+0000 7f9ada5699c0 20 rados->read ofs=0 len=0 2024-09-14T11:58:49.034 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:49.037+0000 7f9ada5699c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:58:49.035 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:49.037+0000 7f9ada5699c0 20 rados->read ofs=0 len=0 2024-09-14T11:58:49.035 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:49.037+0000 7f9ada5699c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:58:49.035 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:49.037+0000 7f9ada5699c0 20 started sync module instance, tier type = 2024-09-14T11:58:49.035 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:49.037+0000 7f9ada5699c0 20 started zone id=d9e72d30-c60b-4d0d-9267-fdc36392d5ad (name=default) with tier type = 2024-09-14T11:58:49.060 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:49.061+0000 7f9ada5699c0 20 add_watcher() i=0 2024-09-14T11:58:49.060 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:49.061+0000 7f9ada5699c0 20 add_watcher() i=1 2024-09-14T11:58:49.060 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:49.061+0000 7f9ada5699c0 20 add_watcher() i=2 2024-09-14T11:58:49.060 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:49.061+0000 7f9ada5699c0 20 add_watcher() i=3 2024-09-14T11:58:49.060 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:49.061+0000 7f9ada5699c0 20 add_watcher() i=4 2024-09-14T11:58:49.060 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:49.061+0000 7f9ada5699c0 20 add_watcher() i=5 2024-09-14T11:58:49.060 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:49.061+0000 7f9ada5699c0 20 add_watcher() i=6 2024-09-14T11:58:49.062 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:49.061+0000 7f9ada5699c0 20 add_watcher() i=7 2024-09-14T11:58:49.062 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:49.061+0000 7f9ada5699c0 2 all 8 watchers are set, enabling cache 2024-09-14T11:58:49.066 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:49.065+0000 7f998efdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:58:49.066 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:49.065+0000 7f9ada5699c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:58:49.066 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:49.065+0000 7f9ada5699c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:58:49.066 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:49.069+0000 7f9ada5699c0 5 note: GC not initialized 2024-09-14T11:58:49.067 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:49.069+0000 7f998dfdb640 20 reqs_thread_entry: start 2024-09-14T11:58:49.067 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:49.069+0000 7f9ada5699c0 20 init_complete bucket index max shards: 11 2024-09-14T11:58:49.067 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:49.069+0000 7f9ada5699c0 20 Filter name: none 2024-09-14T11:58:49.067 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:49.069+0000 7f98ff7fe640 20 reqs_thread_entry: start 2024-09-14T11:58:49.067 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:49.069+0000 7f9ada5699c0 10 cache get: name=default.rgw.meta+users.uid+root1.client.0 : miss 2024-09-14T11:58:49.067 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:49.069+0000 7f9ada5699c0 20 rados->read ofs=0 len=0 2024-09-14T11:58:49.068 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:49.069+0000 7f9ada5699c0 20 rados_obj.operate() r=0 bl.length=494 2024-09-14T11:58:49.068 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:49.069+0000 7f9ada5699c0 10 cache put: name=default.rgw.meta+users.uid+root1.client.0 info.flags=0x13 2024-09-14T11:58:49.068 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:49.069+0000 7f9ada5699c0 10 adding default.rgw.meta+users.uid+root1.client.0 to cache LRU end 2024-09-14T11:58:49.068 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:49.069+0000 7f9ada5699c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:58:49.072 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:49.073+0000 7f9ada5699c0 10 cache put: name=default.rgw.meta+users.uid+root1.client.0 info.flags=0x17 2024-09-14T11:58:49.072 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:49.073+0000 7f9ada5699c0 10 moving default.rgw.meta+users.uid+root1.client.0 to cache LRU end 2024-09-14T11:58:49.072 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:49.073+0000 7f9ada5699c0 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:users.uid:root1.client.0, ofs0, ns] 2024-09-14T11:58:49.073 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:49.073+0000 7f99af7fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1146756268200 cookie 94328093987168 notifier 8507 bl.length()=695 2024-09-14T11:58:49.073 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:49.073+0000 7f99af7fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+root1.client.0 info.flags=0x17 2024-09-14T11:58:49.073 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:49.073+0000 7f99af7fe640 10 rgw watcher librados: moving default.rgw.meta+users.uid+root1.client.0 to cache LRU end 2024-09-14T11:58:49.077 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:49.077+0000 7f998efdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:58:49.085 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:49.085+0000 7f9ada5699c0 20 remove_watcher() i=0 2024-09-14T11:58:49.085 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:49.085+0000 7f9ada5699c0 2 removed watcher, disabling cache 2024-09-14T11:58:49.085 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:49.085+0000 7f9ada5699c0 20 remove_watcher() i=1 2024-09-14T11:58:49.086 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:49.089+0000 7f9ada5699c0 20 remove_watcher() i=2 2024-09-14T11:58:49.088 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:49.089+0000 7f9ada5699c0 20 remove_watcher() i=3 2024-09-14T11:58:49.091 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:49.093+0000 7f9ada5699c0 20 remove_watcher() i=4 2024-09-14T11:58:49.092 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:49.093+0000 7f9ada5699c0 20 remove_watcher() i=5 2024-09-14T11:58:49.094 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:49.093+0000 7f9ada5699c0 20 remove_watcher() i=6 2024-09-14T11:58:49.095 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:49.097+0000 7f9ada5699c0 20 remove_watcher() i=7 2024-09-14T11:58:49.113 DEBUG:teuthology.orchestra.run.smithi138:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 --cluster ceph account create --account-id RGW99999999999999999 --account-name Mr.RGW99999999999999999 --email RGW99999999999999999+test@test.test 2024-09-14T11:58:49.198 INFO:teuthology.orchestra.run.smithi138.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:58:49.198 INFO:teuthology.orchestra.run.smithi138.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:58:49.240 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:49.241+0000 7fb2aff779c0 20 rados->read ofs=0 len=0 2024-09-14T11:58:49.242 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:49.241+0000 7fb2aff779c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:58:49.242 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:49.241+0000 7fb2aff779c0 20 realm 2024-09-14T11:58:49.242 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:49.241+0000 7fb2aff779c0 20 rados->read ofs=0 len=0 2024-09-14T11:58:49.242 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:49.245+0000 7fb2aff779c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:58:49.242 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:49.245+0000 7fb2aff779c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:58:49.242 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:49.245+0000 7fb2aff779c0 20 rados->read ofs=0 len=0 2024-09-14T11:58:49.243 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:49.245+0000 7fb2aff779c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:58:49.243 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:49.245+0000 7fb2aff779c0 20 rados->read ofs=0 len=0 2024-09-14T11:58:49.244 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:49.245+0000 7fb2aff779c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:58:49.244 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:49.245+0000 7fb2aff779c0 20 rados->read ofs=0 len=0 2024-09-14T11:58:49.245 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:49.245+0000 7fb2aff779c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:58:49.245 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:49.245+0000 7fb2aff779c0 20 searching for the correct realm 2024-09-14T11:58:49.248 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:49.249+0000 7fb2ae27e640 0 -- 172.21.15.138:0/416748099 >> [v2:172.21.15.154:6824/416768175,v1:172.21.15.154:6825/416768175] conn(0x7fb2a00890c0 msgr2=0x7fb2a0062a40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:58:49.463 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:49.465+0000 7fb2ad27c640 0 -- 172.21.15.138:0/416748099 >> [v2:172.21.15.138:6816/326481658,v1:172.21.15.138:6817/326481658] conn(0x7fb2a006d270 msgr2=0x7fb2a006d950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:58:49.683 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:49.685+0000 7fb2aff779c0 20 RGWRados::pool_iterate: got zone_info.d9e72d30-c60b-4d0d-9267-fdc36392d5ad 2024-09-14T11:58:49.683 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:49.685+0000 7fb2aff779c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:58:49.683 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:49.685+0000 7fb2aff779c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:58:49.683 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:49.685+0000 7fb2aff779c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:58:49.683 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:49.685+0000 7fb2aff779c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:58:49.683 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:49.685+0000 7fb2aff779c0 20 RGWRados::pool_iterate: got zonegroup_info.65ab941b-da8c-4160-94fb-3672b069d44f 2024-09-14T11:58:49.683 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:49.685+0000 7fb2aff779c0 20 rados->read ofs=0 len=0 2024-09-14T11:58:49.683 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:49.685+0000 7fb2aff779c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:58:49.683 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:49.685+0000 7fb2aff779c0 20 rados->read ofs=0 len=0 2024-09-14T11:58:49.684 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:49.685+0000 7fb2aff779c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:58:49.684 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:49.685+0000 7fb2aff779c0 20 rados->read ofs=0 len=0 2024-09-14T11:58:49.685 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:49.685+0000 7fb2aff779c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:58:49.685 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:49.685+0000 7fb2aff779c0 20 zone default found 2024-09-14T11:58:49.685 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:49.685+0000 7fb2aff779c0 4 Realm: () 2024-09-14T11:58:49.685 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:49.685+0000 7fb2aff779c0 4 ZoneGroup: default (65ab941b-da8c-4160-94fb-3672b069d44f) 2024-09-14T11:58:49.685 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:49.685+0000 7fb2aff779c0 4 Zone: default (d9e72d30-c60b-4d0d-9267-fdc36392d5ad) 2024-09-14T11:58:49.685 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:49.685+0000 7fb2aff779c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:58:49.685 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:49.685+0000 7fb2aff779c0 20 zonegroup default 2024-09-14T11:58:49.685 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:49.685+0000 7fb2aff779c0 20 rados->read ofs=0 len=0 2024-09-14T11:58:49.686 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:49.685+0000 7fb2aff779c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:58:49.686 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:49.685+0000 7fb2aff779c0 20 rados->read ofs=0 len=0 2024-09-14T11:58:49.686 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:49.689+0000 7fb2aff779c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:58:49.686 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:49.689+0000 7fb2aff779c0 20 rados->read ofs=0 len=0 2024-09-14T11:58:49.687 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:49.689+0000 7fb2aff779c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:58:49.687 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:49.689+0000 7fb2aff779c0 20 started sync module instance, tier type = 2024-09-14T11:58:49.687 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:49.689+0000 7fb2aff779c0 20 started zone id=d9e72d30-c60b-4d0d-9267-fdc36392d5ad (name=default) with tier type = 2024-09-14T11:58:49.711 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:49.713+0000 7fb2aff779c0 20 add_watcher() i=0 2024-09-14T11:58:49.711 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:49.713+0000 7fb2aff779c0 20 add_watcher() i=1 2024-09-14T11:58:49.711 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:49.713+0000 7fb2aff779c0 20 add_watcher() i=2 2024-09-14T11:58:49.711 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:49.713+0000 7fb2aff779c0 20 add_watcher() i=3 2024-09-14T11:58:49.711 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:49.713+0000 7fb2aff779c0 20 add_watcher() i=4 2024-09-14T11:58:49.711 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:49.713+0000 7fb2aff779c0 20 add_watcher() i=5 2024-09-14T11:58:49.711 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:49.713+0000 7fb2aff779c0 20 add_watcher() i=6 2024-09-14T11:58:49.714 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:49.713+0000 7fb2aff779c0 20 add_watcher() i=7 2024-09-14T11:58:49.714 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:49.713+0000 7fb2aff779c0 2 all 8 watchers are set, enabling cache 2024-09-14T11:58:49.718 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:49.717+0000 7fb15f7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:58:49.718 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:49.717+0000 7fb2aff779c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:58:49.718 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:49.717+0000 7fb2aff779c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:58:49.718 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:49.721+0000 7fb2aff779c0 5 note: GC not initialized 2024-09-14T11:58:49.719 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:49.721+0000 7fb15e7fc640 20 reqs_thread_entry: start 2024-09-14T11:58:49.719 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:49.721+0000 7fb2aff779c0 20 init_complete bucket index max shards: 11 2024-09-14T11:58:49.720 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:49.721+0000 7fb2aff779c0 20 Filter name: none 2024-09-14T11:58:49.720 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:49.721+0000 7fb0cffff640 20 reqs_thread_entry: start 2024-09-14T11:58:49.720 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:49.721+0000 7fb2aff779c0 10 cache get: name=default.rgw.meta+accounts+name.$Mr.RGW99999999999999999 : miss 2024-09-14T11:58:49.720 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:49.721+0000 7fb2aff779c0 20 rados->read ofs=0 len=0 2024-09-14T11:58:49.720 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:49.721+0000 7fb2aff779c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:58:49.721 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:49.721+0000 7fb2aff779c0 10 cache put: name=default.rgw.meta+accounts+name.$Mr.RGW99999999999999999 info.flags=0x0 2024-09-14T11:58:49.721 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:49.721+0000 7fb2aff779c0 10 adding default.rgw.meta+accounts+name.$Mr.RGW99999999999999999 to cache LRU end 2024-09-14T11:58:49.721 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:49.721+0000 7fb2aff779c0 20 failed to read name.$Mr.RGW99999999999999999 with: (2) No such file or directory 2024-09-14T11:58:49.721 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:49.721+0000 7fb2aff779c0 10 cache get: name=default.rgw.meta+users.email+rgw99999999999999999+test@test.test : miss 2024-09-14T11:58:49.721 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:49.721+0000 7fb2aff779c0 20 rados->read ofs=0 len=0 2024-09-14T11:58:49.721 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:49.721+0000 7fb2aff779c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:58:49.722 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:49.721+0000 7fb2aff779c0 10 cache put: name=default.rgw.meta+users.email+rgw99999999999999999+test@test.test info.flags=0x0 2024-09-14T11:58:49.722 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:49.721+0000 7fb2aff779c0 10 adding default.rgw.meta+users.email+rgw99999999999999999+test@test.test to cache LRU end 2024-09-14T11:58:49.722 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:49.721+0000 7fb2aff779c0 20 failed to read rgw99999999999999999+test@test.test with: (2) No such file or directory 2024-09-14T11:58:49.725 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:49.725+0000 7fb2aff779c0 10 cache put: name=default.rgw.meta+accounts+account.RGW99999999999999999 info.flags=0x17 2024-09-14T11:58:49.725 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:49.725+0000 7fb2aff779c0 10 adding default.rgw.meta+accounts+account.RGW99999999999999999 to cache LRU end 2024-09-14T11:58:49.725 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:49.725+0000 7fb2aff779c0 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:accounts:account.RGW99999999999999999, ofs0, ns] 2024-09-14T11:58:49.726 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:49.725+0000 7fb1917fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1146756268201 cookie 94679335642816 notifier 8525 bl.length()=384 2024-09-14T11:58:49.726 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:49.725+0000 7fb1917fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+accounts+account.RGW99999999999999999 info.flags=0x17 2024-09-14T11:58:49.726 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:49.725+0000 7fb1917fa640 10 rgw watcher librados: moving default.rgw.meta+accounts+account.RGW99999999999999999 to cache LRU end 2024-09-14T11:58:49.730 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:49.733+0000 7fb2aff779c0 10 cache put: name=default.rgw.meta+accounts+name.$Mr.RGW99999999999999999 info.flags=0x17 2024-09-14T11:58:49.730 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:49.733+0000 7fb2aff779c0 10 moving default.rgw.meta+accounts+name.$Mr.RGW99999999999999999 to cache LRU end 2024-09-14T11:58:49.730 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:49.733+0000 7fb2aff779c0 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:accounts:name.$Mr.RGW99999999999999999, ofs0, ns] 2024-09-14T11:58:49.731 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:49.733+0000 7fb1917fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1146756268243 cookie 94679335656208 notifier 8525 bl.length()=225 2024-09-14T11:58:49.731 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:49.733+0000 7fb1917fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+accounts+name.$Mr.RGW99999999999999999 info.flags=0x17 2024-09-14T11:58:49.731 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:49.733+0000 7fb1917fa640 10 rgw watcher librados: moving default.rgw.meta+accounts+name.$Mr.RGW99999999999999999 to cache LRU end 2024-09-14T11:58:49.737 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:49.737+0000 7fb2aff779c0 10 cache put: name=default.rgw.meta+users.email+rgw99999999999999999+test@test.test info.flags=0x17 2024-09-14T11:58:49.737 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:49.737+0000 7fb2aff779c0 10 moving default.rgw.meta+users.email+rgw99999999999999999+test@test.test to cache LRU end 2024-09-14T11:58:49.737 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:49.737+0000 7fb2aff779c0 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 0, obj: default.rgw.meta:users.email:rgw99999999999999999+test@test.test, ofs0, ns] 2024-09-14T11:58:49.737 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:49.737+0000 7fb1917fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1146756268124 cookie 94679335652368 notifier 8525 bl.length()=234 2024-09-14T11:58:49.738 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:49.737+0000 7fb1917fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.email+rgw99999999999999999+test@test.test info.flags=0x17 2024-09-14T11:58:49.738 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:49.737+0000 7fb1917fa640 10 rgw watcher librados: moving default.rgw.meta+users.email+rgw99999999999999999+test@test.test to cache LRU end 2024-09-14T11:58:49.740 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:49.741+0000 7fb15f7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:58:49.748 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:49.749+0000 7fb2aff779c0 20 remove_watcher() i=0 2024-09-14T11:58:49.748 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:49.749+0000 7fb2aff779c0 2 removed watcher, disabling cache 2024-09-14T11:58:49.750 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:49.749+0000 7fb2aff779c0 20 remove_watcher() i=1 2024-09-14T11:58:49.752 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:49.753+0000 7fb2aff779c0 20 remove_watcher() i=2 2024-09-14T11:58:49.754 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:49.757+0000 7fb2aff779c0 20 remove_watcher() i=3 2024-09-14T11:58:49.757 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:49.757+0000 7fb2aff779c0 20 remove_watcher() i=4 2024-09-14T11:58:49.759 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:49.761+0000 7fb2aff779c0 20 remove_watcher() i=5 2024-09-14T11:58:49.761 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:49.761+0000 7fb2aff779c0 20 remove_watcher() i=6 2024-09-14T11:58:49.762 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:49.765+0000 7fb2aff779c0 20 remove_watcher() i=7 2024-09-14T11:58:49.775 INFO:teuthology.orchestra.run.smithi138.stdout:{ 2024-09-14T11:58:49.775 INFO:teuthology.orchestra.run.smithi138.stdout: "id": "RGW99999999999999999", 2024-09-14T11:58:49.775 INFO:teuthology.orchestra.run.smithi138.stdout: "tenant": "", 2024-09-14T11:58:49.775 INFO:teuthology.orchestra.run.smithi138.stdout: "name": "Mr.RGW99999999999999999", 2024-09-14T11:58:49.775 INFO:teuthology.orchestra.run.smithi138.stdout: "email": "RGW99999999999999999+test@test.test", 2024-09-14T11:58:49.775 INFO:teuthology.orchestra.run.smithi138.stdout: "quota": { 2024-09-14T11:58:49.775 INFO:teuthology.orchestra.run.smithi138.stdout: "enabled": false, 2024-09-14T11:58:49.775 INFO:teuthology.orchestra.run.smithi138.stdout: "check_on_raw": false, 2024-09-14T11:58:49.776 INFO:teuthology.orchestra.run.smithi138.stdout: "max_size": -1, 2024-09-14T11:58:49.776 INFO:teuthology.orchestra.run.smithi138.stdout: "max_size_kb": 0, 2024-09-14T11:58:49.776 INFO:teuthology.orchestra.run.smithi138.stdout: "max_objects": -1 2024-09-14T11:58:49.776 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-09-14T11:58:49.776 INFO:teuthology.orchestra.run.smithi138.stdout: "bucket_quota": { 2024-09-14T11:58:49.776 INFO:teuthology.orchestra.run.smithi138.stdout: "enabled": false, 2024-09-14T11:58:49.776 INFO:teuthology.orchestra.run.smithi138.stdout: "check_on_raw": false, 2024-09-14T11:58:49.776 INFO:teuthology.orchestra.run.smithi138.stdout: "max_size": -1, 2024-09-14T11:58:49.776 INFO:teuthology.orchestra.run.smithi138.stdout: "max_size_kb": 0, 2024-09-14T11:58:49.776 INFO:teuthology.orchestra.run.smithi138.stdout: "max_objects": -1 2024-09-14T11:58:49.776 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-09-14T11:58:49.776 INFO:teuthology.orchestra.run.smithi138.stdout: "max_users": 1000, 2024-09-14T11:58:49.776 INFO:teuthology.orchestra.run.smithi138.stdout: "max_roles": 1000, 2024-09-14T11:58:49.776 INFO:teuthology.orchestra.run.smithi138.stdout: "max_groups": 1000, 2024-09-14T11:58:49.777 INFO:teuthology.orchestra.run.smithi138.stdout: "max_buckets": 1000, 2024-09-14T11:58:49.777 INFO:teuthology.orchestra.run.smithi138.stdout: "max_access_keys": 4 2024-09-14T11:58:49.777 INFO:teuthology.orchestra.run.smithi138.stdout:} 2024-09-14T11:58:49.778 DEBUG:tasks.s3tests:Creating user RGW99999999999999999 on client.0 2024-09-14T11:58:49.778 DEBUG:teuthology.orchestra.run.smithi138:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 user create --uid root2.client.0 --display-name Mr.RGW99999999999999999 --email root2+test@test.test --access-key XOTGMUSLAZJIXSZEAGES --secret K93D8I0ck2TK5NtlQFluP+/8fNqfFhnyxxeQaX0zg19zO0wv3Bs2jQ== --cluster ceph --account-id RGW99999999999999999 --account-root 2024-09-14T11:58:49.867 INFO:teuthology.orchestra.run.smithi138.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:58:49.868 INFO:teuthology.orchestra.run.smithi138.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:58:49.909 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:49.909+0000 7fb04c8cc9c0 20 rados->read ofs=0 len=0 2024-09-14T11:58:49.911 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:49.913+0000 7fb04c8cc9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:58:49.911 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:49.913+0000 7fb04c8cc9c0 20 realm 2024-09-14T11:58:49.911 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:49.913+0000 7fb04c8cc9c0 20 rados->read ofs=0 len=0 2024-09-14T11:58:49.911 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:49.913+0000 7fb04c8cc9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:58:49.911 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:49.913+0000 7fb04c8cc9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:58:49.911 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:49.913+0000 7fb04c8cc9c0 20 rados->read ofs=0 len=0 2024-09-14T11:58:49.911 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:49.913+0000 7fb04c8cc9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:58:49.911 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:49.913+0000 7fb04c8cc9c0 20 rados->read ofs=0 len=0 2024-09-14T11:58:49.912 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:49.913+0000 7fb04c8cc9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:58:49.913 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:49.913+0000 7fb04c8cc9c0 20 rados->read ofs=0 len=0 2024-09-14T11:58:49.913 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:49.913+0000 7fb04c8cc9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:58:49.913 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:49.913+0000 7fb04c8cc9c0 20 searching for the correct realm 2024-09-14T11:58:49.917 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:49.917+0000 7fb04abd3640 0 -- 172.21.15.138:0/1616280446 >> [v2:172.21.15.154:6824/416768175,v1:172.21.15.154:6825/416768175] conn(0x7fb04406e470 msgr2=0x7fb044063c40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:58:50.334 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:50.333+0000 7fb04abd3640 0 -- 172.21.15.138:0/1616280446 >> [v2:172.21.15.154:6824/416768175,v1:172.21.15.154:6825/416768175] conn(0x7fb04406e470 msgr2=0x7fb044063c40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:58:50.348 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:50.349+0000 7fb04c8cc9c0 20 RGWRados::pool_iterate: got zone_info.d9e72d30-c60b-4d0d-9267-fdc36392d5ad 2024-09-14T11:58:50.348 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:50.349+0000 7fb04c8cc9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:58:50.349 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:50.349+0000 7fb04c8cc9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:58:50.349 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:50.349+0000 7fb04c8cc9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:58:50.349 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:50.349+0000 7fb04c8cc9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:58:50.349 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:50.349+0000 7fb04c8cc9c0 20 RGWRados::pool_iterate: got zonegroup_info.65ab941b-da8c-4160-94fb-3672b069d44f 2024-09-14T11:58:50.349 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:50.349+0000 7fb04c8cc9c0 20 rados->read ofs=0 len=0 2024-09-14T11:58:50.349 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:50.349+0000 7fb04c8cc9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:58:50.349 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:50.349+0000 7fb04c8cc9c0 20 rados->read ofs=0 len=0 2024-09-14T11:58:50.350 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:50.349+0000 7fb04c8cc9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:58:50.350 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:50.349+0000 7fb04c8cc9c0 20 rados->read ofs=0 len=0 2024-09-14T11:58:50.351 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:50.353+0000 7fb04c8cc9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:58:50.351 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:50.353+0000 7fb04c8cc9c0 20 zone default found 2024-09-14T11:58:50.351 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:50.353+0000 7fb04c8cc9c0 4 Realm: () 2024-09-14T11:58:50.351 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:50.353+0000 7fb04c8cc9c0 4 ZoneGroup: default (65ab941b-da8c-4160-94fb-3672b069d44f) 2024-09-14T11:58:50.351 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:50.353+0000 7fb04c8cc9c0 4 Zone: default (d9e72d30-c60b-4d0d-9267-fdc36392d5ad) 2024-09-14T11:58:50.351 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:50.353+0000 7fb04c8cc9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:58:50.351 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:50.353+0000 7fb04c8cc9c0 20 zonegroup default 2024-09-14T11:58:50.351 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:50.353+0000 7fb04c8cc9c0 20 rados->read ofs=0 len=0 2024-09-14T11:58:50.352 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:50.353+0000 7fb04c8cc9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:58:50.352 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:50.353+0000 7fb04c8cc9c0 20 rados->read ofs=0 len=0 2024-09-14T11:58:50.352 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:50.353+0000 7fb04c8cc9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:58:50.353 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:50.353+0000 7fb04c8cc9c0 20 rados->read ofs=0 len=0 2024-09-14T11:58:50.353 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:50.353+0000 7fb04c8cc9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:58:50.353 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:50.353+0000 7fb04c8cc9c0 20 started sync module instance, tier type = 2024-09-14T11:58:50.353 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:50.353+0000 7fb04c8cc9c0 20 started zone id=d9e72d30-c60b-4d0d-9267-fdc36392d5ad (name=default) with tier type = 2024-09-14T11:58:50.375 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:50.377+0000 7fb04c8cc9c0 20 add_watcher() i=0 2024-09-14T11:58:50.375 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:50.377+0000 7fb04c8cc9c0 20 add_watcher() i=1 2024-09-14T11:58:50.375 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:50.377+0000 7fb04c8cc9c0 20 add_watcher() i=2 2024-09-14T11:58:50.375 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:50.377+0000 7fb04c8cc9c0 20 add_watcher() i=3 2024-09-14T11:58:50.376 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:50.377+0000 7fb04c8cc9c0 20 add_watcher() i=4 2024-09-14T11:58:50.376 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:50.377+0000 7fb04c8cc9c0 20 add_watcher() i=5 2024-09-14T11:58:50.376 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:50.377+0000 7fb04c8cc9c0 20 add_watcher() i=6 2024-09-14T11:58:50.377 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:50.377+0000 7fb04c8cc9c0 20 add_watcher() i=7 2024-09-14T11:58:50.377 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:50.377+0000 7fb04c8cc9c0 2 all 8 watchers are set, enabling cache 2024-09-14T11:58:50.380 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:50.381+0000 7faf00fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:58:50.380 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:50.381+0000 7fb04c8cc9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:58:50.380 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:50.381+0000 7fb04c8cc9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:58:50.380 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:50.381+0000 7fb04c8cc9c0 5 note: GC not initialized 2024-09-14T11:58:50.381 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:50.381+0000 7fae7b7fe640 20 reqs_thread_entry: start 2024-09-14T11:58:50.381 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:50.381+0000 7fb04c8cc9c0 20 init_complete bucket index max shards: 11 2024-09-14T11:58:50.381 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:50.381+0000 7fb04c8cc9c0 20 Filter name: none 2024-09-14T11:58:50.381 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:50.381+0000 7fae797fa640 20 reqs_thread_entry: start 2024-09-14T11:58:50.381 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:50.381+0000 7fb04c8cc9c0 10 cache get: name=default.rgw.meta+users.uid+root2.client.0 : miss 2024-09-14T11:58:50.382 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:50.381+0000 7fb04c8cc9c0 20 rados->read ofs=0 len=0 2024-09-14T11:58:50.382 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:50.381+0000 7fb04c8cc9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:58:50.382 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:50.381+0000 7fb04c8cc9c0 10 cache put: name=default.rgw.meta+users.uid+root2.client.0 info.flags=0x0 2024-09-14T11:58:50.383 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:50.381+0000 7fb04c8cc9c0 10 adding default.rgw.meta+users.uid+root2.client.0 to cache LRU end 2024-09-14T11:58:50.383 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:50.381+0000 7fb04c8cc9c0 10 cache get: name=default.rgw.meta+users.email+root2+test@test.test : miss 2024-09-14T11:58:50.383 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:50.381+0000 7fb04c8cc9c0 20 rados->read ofs=0 len=0 2024-09-14T11:58:50.383 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:50.385+0000 7fb04c8cc9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:58:50.383 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:50.385+0000 7fb04c8cc9c0 10 cache put: name=default.rgw.meta+users.email+root2+test@test.test info.flags=0x0 2024-09-14T11:58:50.383 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:50.385+0000 7fb04c8cc9c0 10 adding default.rgw.meta+users.email+root2+test@test.test to cache LRU end 2024-09-14T11:58:50.383 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:50.385+0000 7fb04c8cc9c0 10 cache get: name=default.rgw.meta+users.keys+XOTGMUSLAZJIXSZEAGES : miss 2024-09-14T11:58:50.383 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:50.385+0000 7fb04c8cc9c0 20 rados->read ofs=0 len=0 2024-09-14T11:58:50.383 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:50.385+0000 7fb04c8cc9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:58:50.383 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:50.385+0000 7fb04c8cc9c0 10 cache put: name=default.rgw.meta+users.keys+XOTGMUSLAZJIXSZEAGES info.flags=0x0 2024-09-14T11:58:50.383 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:50.385+0000 7fb04c8cc9c0 10 adding default.rgw.meta+users.keys+XOTGMUSLAZJIXSZEAGES to cache LRU end 2024-09-14T11:58:50.383 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:50.385+0000 7fb04c8cc9c0 10 cache get: name=default.rgw.meta+accounts+account.RGW99999999999999999 : miss 2024-09-14T11:58:50.383 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:50.385+0000 7fb04c8cc9c0 20 rados->read ofs=0 len=0 2024-09-14T11:58:50.384 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:50.385+0000 7fb04c8cc9c0 20 rados_obj.operate() r=0 bl.length=184 2024-09-14T11:58:50.384 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:50.385+0000 7fb04c8cc9c0 10 cache put: name=default.rgw.meta+accounts+account.RGW99999999999999999 info.flags=0x17 2024-09-14T11:58:50.384 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:50.385+0000 7fb04c8cc9c0 10 adding default.rgw.meta+accounts+account.RGW99999999999999999 to cache LRU end 2024-09-14T11:58:50.385 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:50.385+0000 7fb04c8cc9c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:58:50.385 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:50.385+0000 7fb04c8cc9c0 10 cache get: name=default.rgw.meta+users.keys+XOTGMUSLAZJIXSZEAGES : hit (negative entry) 2024-09-14T11:58:50.385 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:50.385+0000 7fb04c8cc9c0 10 cache get: name=default.rgw.meta+users.keys+XOTGMUSLAZJIXSZEAGES : hit (negative entry) 2024-09-14T11:58:50.386 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:50.389+0000 7fb04c8cc9c0 10 cache put: name=default.rgw.meta+users.uid+root2.client.0 info.flags=0x17 2024-09-14T11:58:50.386 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:50.389+0000 7fb04c8cc9c0 10 moving default.rgw.meta+users.uid+root2.client.0 to cache LRU end 2024-09-14T11:58:50.386 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:50.389+0000 7fb04c8cc9c0 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:users.uid:root2.client.0, ofs0, ns] 2024-09-14T11:58:50.387 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:50.389+0000 7faf2dffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1146756268202 cookie 93999937744768 notifier 9183 bl.length()=681 2024-09-14T11:58:50.387 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:50.389+0000 7faf2dffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+root2.client.0 info.flags=0x17 2024-09-14T11:58:50.387 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:50.389+0000 7faf2dffb640 10 rgw watcher librados: moving default.rgw.meta+users.uid+root2.client.0 to cache LRU end 2024-09-14T11:58:50.392 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:50.393+0000 7fb04c8cc9c0 10 cache put: name=default.rgw.meta+users.email+root2+test@test.test info.flags=0x7 2024-09-14T11:58:50.392 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:50.393+0000 7fb04c8cc9c0 10 moving default.rgw.meta+users.email+root2+test@test.test to cache LRU end 2024-09-14T11:58:50.392 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:50.393+0000 7fb04c8cc9c0 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:users.email:root2+test@test.test, ofs0, ns] 2024-09-14T11:58:50.393 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:50.393+0000 7faf2dffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1146756268219 cookie 93999937757808 notifier 9183 bl.length()=189 2024-09-14T11:58:50.393 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:50.393+0000 7faf2dffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.email+root2+test@test.test info.flags=0x7 2024-09-14T11:58:50.393 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:50.393+0000 7faf2dffb640 10 rgw watcher librados: moving default.rgw.meta+users.email+root2+test@test.test to cache LRU end 2024-09-14T11:58:50.396 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:50.397+0000 7fb04c8cc9c0 10 cache put: name=default.rgw.meta+users.keys+XOTGMUSLAZJIXSZEAGES info.flags=0x7 2024-09-14T11:58:50.396 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:50.397+0000 7fb04c8cc9c0 10 moving default.rgw.meta+users.keys+XOTGMUSLAZJIXSZEAGES to cache LRU end 2024-09-14T11:58:50.396 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:50.397+0000 7fb04c8cc9c0 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:users.keys:XOTGMUSLAZJIXSZEAGES, ofs0, ns] 2024-09-14T11:58:50.396 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:50.397+0000 7faf2dffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1146756268220 cookie 93999937756016 notifier 9183 bl.length()=188 2024-09-14T11:58:50.396 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:50.397+0000 7faf2dffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.keys+XOTGMUSLAZJIXSZEAGES info.flags=0x7 2024-09-14T11:58:50.397 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:50.397+0000 7faf2dffb640 10 rgw watcher librados: moving default.rgw.meta+users.keys+XOTGMUSLAZJIXSZEAGES to cache LRU end 2024-09-14T11:58:50.401 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:50.401+0000 7fb04c8cc9c0 20 linked user root2.client.0 to account RGW99999999999999999 2024-09-14T11:58:50.401 INFO:teuthology.orchestra.run.smithi138.stdout:{ 2024-09-14T11:58:50.401 INFO:teuthology.orchestra.run.smithi138.stdout: "user_id": "root2.client.0", 2024-09-14T11:58:50.401 INFO:teuthology.orchestra.run.smithi138.stdout: "display_name": "Mr.RGW99999999999999999", 2024-09-14T11:58:50.401 INFO:teuthology.orchestra.run.smithi138.stdout: "email": "root2+test@test.test", 2024-09-14T11:58:50.401 INFO:teuthology.orchestra.run.smithi138.stdout: "suspended": 0, 2024-09-14T11:58:50.401 INFO:teuthology.orchestra.run.smithi138.stdout: "max_buckets": 1000, 2024-09-14T11:58:50.401 INFO:teuthology.orchestra.run.smithi138.stdout: "subusers": [], 2024-09-14T11:58:50.402 INFO:teuthology.orchestra.run.smithi138.stdout: "keys": [ 2024-09-14T11:58:50.402 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-09-14T11:58:50.402 INFO:teuthology.orchestra.run.smithi138.stdout: "user": "root2.client.0", 2024-09-14T11:58:50.402 INFO:teuthology.orchestra.run.smithi138.stdout: "access_key": "XOTGMUSLAZJIXSZEAGES", 2024-09-14T11:58:50.402 INFO:teuthology.orchestra.run.smithi138.stdout: "secret_key": "K93D8I0ck2TK5NtlQFluP+/8fNqfFhnyxxeQaX0zg19zO0wv3Bs2jQ==", 2024-09-14T11:58:50.402 INFO:teuthology.orchestra.run.smithi138.stdout: "active": true, 2024-09-14T11:58:50.402 INFO:teuthology.orchestra.run.smithi138.stdout: "create_date": "2024-09-14T11:58:50.390797Z" 2024-09-14T11:58:50.402 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-09-14T11:58:50.402 INFO:teuthology.orchestra.run.smithi138.stdout: ], 2024-09-14T11:58:50.402 INFO:teuthology.orchestra.run.smithi138.stdout: "swift_keys": [], 2024-09-14T11:58:50.402 INFO:teuthology.orchestra.run.smithi138.stdout: "caps": [], 2024-09-14T11:58:50.402 INFO:teuthology.orchestra.run.smithi138.stdout: "op_mask": "read, write, delete", 2024-09-14T11:58:50.402 INFO:teuthology.orchestra.run.smithi138.stdout: "default_placement": "", 2024-09-14T11:58:50.403 INFO:teuthology.orchestra.run.smithi138.stdout: "default_storage_class": "", 2024-09-14T11:58:50.403 INFO:teuthology.orchestra.run.smithi138.stdout: "placement_tags": [], 2024-09-14T11:58:50.403 INFO:teuthology.orchestra.run.smithi138.stdout: "bucket_quota": { 2024-09-14T11:58:50.403 INFO:teuthology.orchestra.run.smithi138.stdout: "enabled": false, 2024-09-14T11:58:50.403 INFO:teuthology.orchestra.run.smithi138.stdout: "check_on_raw": false, 2024-09-14T11:58:50.403 INFO:teuthology.orchestra.run.smithi138.stdout: "max_size": -1, 2024-09-14T11:58:50.403 INFO:teuthology.orchestra.run.smithi138.stdout: "max_size_kb": 0, 2024-09-14T11:58:50.403 INFO:teuthology.orchestra.run.smithi138.stdout: "max_objects": -1 2024-09-14T11:58:50.403 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-09-14T11:58:50.403 INFO:teuthology.orchestra.run.smithi138.stdout: "user_quota": { 2024-09-14T11:58:50.403 INFO:teuthology.orchestra.run.smithi138.stdout: "enabled": false, 2024-09-14T11:58:50.403 INFO:teuthology.orchestra.run.smithi138.stdout: "check_on_raw": false, 2024-09-14T11:58:50.403 INFO:teuthology.orchestra.run.smithi138.stdout: "max_size": -1, 2024-09-14T11:58:50.403 INFO:teuthology.orchestra.run.smithi138.stdout: "max_size_kb": 0, 2024-09-14T11:58:50.403 INFO:teuthology.orchestra.run.smithi138.stdout: "max_objects": -1 2024-09-14T11:58:50.404 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-09-14T11:58:50.404 INFO:teuthology.orchestra.run.smithi138.stdout: "temp_url_keys": [], 2024-09-14T11:58:50.404 INFO:teuthology.orchestra.run.smithi138.stdout: "type": "root", 2024-09-14T11:58:50.404 INFO:teuthology.orchestra.run.smithi138.stdout: "mfa_ids": [], 2024-09-14T11:58:50.404 INFO:teuthology.orchestra.run.smithi138.stdout: "account_id": "RGW99999999999999999", 2024-09-14T11:58:50.404 INFO:teuthology.orchestra.run.smithi138.stdout: "path": "/", 2024-09-14T11:58:50.404 INFO:teuthology.orchestra.run.smithi138.stdout: "create_date": "2024-09-14T11:58:50.390773Z", 2024-09-14T11:58:50.404 INFO:teuthology.orchestra.run.smithi138.stdout: "tags": [], 2024-09-14T11:58:50.404 INFO:teuthology.orchestra.run.smithi138.stdout: "group_ids": [] 2024-09-14T11:58:50.404 INFO:teuthology.orchestra.run.smithi138.stdout:} 2024-09-14T11:58:50.404 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-09-14T11:58:50.404 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:50.405+0000 7faf00fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:58:50.407 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:50.409+0000 7fb04c8cc9c0 20 remove_watcher() i=0 2024-09-14T11:58:50.407 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:50.409+0000 7fb04c8cc9c0 2 removed watcher, disabling cache 2024-09-14T11:58:50.410 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:50.409+0000 7fb04c8cc9c0 20 remove_watcher() i=1 2024-09-14T11:58:50.412 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:50.413+0000 7fb04c8cc9c0 20 remove_watcher() i=2 2024-09-14T11:58:50.414 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:50.417+0000 7fb04c8cc9c0 20 remove_watcher() i=3 2024-09-14T11:58:50.416 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:50.417+0000 7fb04c8cc9c0 20 remove_watcher() i=4 2024-09-14T11:58:50.417 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:50.417+0000 7fb04c8cc9c0 20 remove_watcher() i=5 2024-09-14T11:58:50.419 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:50.421+0000 7fb04c8cc9c0 20 remove_watcher() i=6 2024-09-14T11:58:50.420 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:50.421+0000 7fb04c8cc9c0 20 remove_watcher() i=7 2024-09-14T11:58:50.437 DEBUG:teuthology.orchestra.run.smithi138:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 mfa create --uid root2.client.0 --totp-serial 4737556419 --totp-seed 5Z5BSLRK44GUUWNDI2HBB54DGPHKAIK3ISZMFV7HHVBW4STPSOZNBD3YJFOLPGOL --totp-seconds 5 --totp-window 8 --totp-seed-type base32 --cluster ceph 2024-09-14T11:58:50.524 INFO:teuthology.orchestra.run.smithi138.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:58:50.525 INFO:teuthology.orchestra.run.smithi138.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:58:50.566 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:50.569+0000 7f11353ef9c0 20 rados->read ofs=0 len=0 2024-09-14T11:58:50.568 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:50.569+0000 7f11353ef9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:58:50.568 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:50.569+0000 7f11353ef9c0 20 realm 2024-09-14T11:58:50.568 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:50.569+0000 7f11353ef9c0 20 rados->read ofs=0 len=0 2024-09-14T11:58:50.569 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:50.569+0000 7f11353ef9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:58:50.569 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:50.569+0000 7f11353ef9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:58:50.569 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:50.569+0000 7f11353ef9c0 20 rados->read ofs=0 len=0 2024-09-14T11:58:50.569 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:50.569+0000 7f11353ef9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:58:50.569 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:50.569+0000 7f11353ef9c0 20 rados->read ofs=0 len=0 2024-09-14T11:58:50.570 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:50.569+0000 7f11353ef9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:58:50.570 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:50.569+0000 7f11353ef9c0 20 rados->read ofs=0 len=0 2024-09-14T11:58:50.571 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:50.573+0000 7f11353ef9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:58:50.571 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:50.573+0000 7f11353ef9c0 20 searching for the correct realm 2024-09-14T11:58:50.573 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:50.573+0000 7f11336f6640 0 -- 172.21.15.138:0/906827203 >> [v2:172.21.15.138:6824/2633984942,v1:172.21.15.138:6825/2633984942] conn(0x55eed73f5290 msgr2=0x55eed73f7680 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:58:50.580 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:50.581+0000 7f11336f6640 0 -- 172.21.15.138:0/906827203 >> [v2:172.21.15.138:6824/2633984942,v1:172.21.15.138:6825/2633984942] conn(0x7f0ffc082db0 msgr2=0x7f0ffc0851e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-14T11:58:50.590 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:50.589+0000 7f11353ef9c0 20 RGWRados::pool_iterate: got zone_info.d9e72d30-c60b-4d0d-9267-fdc36392d5ad 2024-09-14T11:58:50.591 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:50.589+0000 7f11353ef9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:58:50.591 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:50.589+0000 7f11353ef9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:58:50.591 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:50.589+0000 7f11353ef9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:58:50.591 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:50.589+0000 7f11353ef9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:58:50.591 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:50.589+0000 7f11353ef9c0 20 RGWRados::pool_iterate: got zonegroup_info.65ab941b-da8c-4160-94fb-3672b069d44f 2024-09-14T11:58:50.591 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:50.589+0000 7f11353ef9c0 20 rados->read ofs=0 len=0 2024-09-14T11:58:50.591 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:50.593+0000 7f11353ef9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:58:50.591 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:50.593+0000 7f11353ef9c0 20 rados->read ofs=0 len=0 2024-09-14T11:58:50.591 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:50.593+0000 7f11353ef9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:58:50.591 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:50.593+0000 7f11353ef9c0 20 rados->read ofs=0 len=0 2024-09-14T11:58:50.592 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:50.593+0000 7f11353ef9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:58:50.592 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:50.593+0000 7f11353ef9c0 20 zone default found 2024-09-14T11:58:50.592 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:50.593+0000 7f11353ef9c0 4 Realm: () 2024-09-14T11:58:50.592 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:50.593+0000 7f11353ef9c0 4 ZoneGroup: default (65ab941b-da8c-4160-94fb-3672b069d44f) 2024-09-14T11:58:50.592 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:50.593+0000 7f11353ef9c0 4 Zone: default (d9e72d30-c60b-4d0d-9267-fdc36392d5ad) 2024-09-14T11:58:50.592 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:50.593+0000 7f11353ef9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:58:50.592 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:50.593+0000 7f11353ef9c0 20 zonegroup default 2024-09-14T11:58:50.592 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:50.593+0000 7f11353ef9c0 20 rados->read ofs=0 len=0 2024-09-14T11:58:50.592 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:50.593+0000 7f11353ef9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:58:50.593 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:50.593+0000 7f11353ef9c0 20 rados->read ofs=0 len=0 2024-09-14T11:58:50.593 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:50.593+0000 7f11353ef9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:58:50.593 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:50.593+0000 7f11353ef9c0 20 rados->read ofs=0 len=0 2024-09-14T11:58:50.593 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:50.593+0000 7f11353ef9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:58:50.593 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:50.593+0000 7f11353ef9c0 20 started sync module instance, tier type = 2024-09-14T11:58:50.593 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:50.593+0000 7f11353ef9c0 20 started zone id=d9e72d30-c60b-4d0d-9267-fdc36392d5ad (name=default) with tier type = 2024-09-14T11:58:50.608 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:50.609+0000 7f11353ef9c0 20 add_watcher() i=0 2024-09-14T11:58:50.608 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:50.609+0000 7f11353ef9c0 20 add_watcher() i=1 2024-09-14T11:58:50.608 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:50.609+0000 7f11353ef9c0 20 add_watcher() i=2 2024-09-14T11:58:50.608 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:50.609+0000 7f11353ef9c0 20 add_watcher() i=3 2024-09-14T11:58:50.608 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:50.609+0000 7f11353ef9c0 20 add_watcher() i=4 2024-09-14T11:58:50.609 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:50.609+0000 7f11353ef9c0 20 add_watcher() i=5 2024-09-14T11:58:50.609 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:50.609+0000 7f11353ef9c0 20 add_watcher() i=6 2024-09-14T11:58:50.609 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:50.609+0000 7f11353ef9c0 20 add_watcher() i=7 2024-09-14T11:58:50.609 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:50.609+0000 7f11353ef9c0 2 all 8 watchers are set, enabling cache 2024-09-14T11:58:50.612 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:50.613+0000 7f0fe97e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:58:50.612 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:50.613+0000 7f11353ef9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:58:50.612 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:50.613+0000 7f11353ef9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:58:50.612 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:50.613+0000 7f11353ef9c0 5 note: GC not initialized 2024-09-14T11:58:50.612 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:50.613+0000 7f0f63fff640 20 reqs_thread_entry: start 2024-09-14T11:58:50.612 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:50.613+0000 7f11353ef9c0 20 init_complete bucket index max shards: 11 2024-09-14T11:58:50.612 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:50.613+0000 7f11353ef9c0 20 Filter name: none 2024-09-14T11:58:50.613 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:50.613+0000 7f0f61ffb640 20 reqs_thread_entry: start 2024-09-14T11:58:50.613 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:50.613+0000 7f11353ef9c0 10 cache get: name=default.rgw.meta+users.uid+root2.client.0 : miss 2024-09-14T11:58:50.613 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:50.613+0000 7f11353ef9c0 20 rados->read ofs=0 len=0 2024-09-14T11:58:50.613 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:50.613+0000 7f11353ef9c0 20 rados_obj.operate() r=0 bl.length=494 2024-09-14T11:58:50.613 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:50.613+0000 7f11353ef9c0 10 cache put: name=default.rgw.meta+users.uid+root2.client.0 info.flags=0x13 2024-09-14T11:58:50.613 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:50.613+0000 7f11353ef9c0 10 adding default.rgw.meta+users.uid+root2.client.0 to cache LRU end 2024-09-14T11:58:50.613 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:50.613+0000 7f11353ef9c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:58:50.617 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:50.617+0000 7f11353ef9c0 10 cache put: name=default.rgw.meta+users.uid+root2.client.0 info.flags=0x17 2024-09-14T11:58:50.617 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:50.617+0000 7f11353ef9c0 10 moving default.rgw.meta+users.uid+root2.client.0 to cache LRU end 2024-09-14T11:58:50.617 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:50.617+0000 7f11353ef9c0 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:users.uid:root2.client.0, ofs0, ns] 2024-09-14T11:58:50.618 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:50.621+0000 7f10167fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1146756268203 cookie 94484301863824 notifier 8558 bl.length()=695 2024-09-14T11:58:50.618 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:50.621+0000 7f10167fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+root2.client.0 info.flags=0x17 2024-09-14T11:58:50.618 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:50.621+0000 7f10167fc640 10 rgw watcher librados: moving default.rgw.meta+users.uid+root2.client.0 to cache LRU end 2024-09-14T11:58:50.621 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:50.621+0000 7f0fe97e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:58:50.626 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:50.629+0000 7f11353ef9c0 20 remove_watcher() i=0 2024-09-14T11:58:50.626 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:50.629+0000 7f11353ef9c0 2 removed watcher, disabling cache 2024-09-14T11:58:50.628 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:50.629+0000 7f11353ef9c0 20 remove_watcher() i=1 2024-09-14T11:58:50.630 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:50.633+0000 7f11353ef9c0 20 remove_watcher() i=2 2024-09-14T11:58:50.632 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:50.633+0000 7f11353ef9c0 20 remove_watcher() i=3 2024-09-14T11:58:50.634 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:50.637+0000 7f11353ef9c0 20 remove_watcher() i=4 2024-09-14T11:58:50.636 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:50.637+0000 7f11353ef9c0 20 remove_watcher() i=5 2024-09-14T11:58:50.637 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:50.637+0000 7f11353ef9c0 20 remove_watcher() i=6 2024-09-14T11:58:50.638 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T11:58:50.641+0000 7f11353ef9c0 20 remove_watcher() i=7 2024-09-14T11:58:50.653 INFO:tasks.s3tests:Configuring s3-tests... 2024-09-14T11:58:50.654 DEBUG:teuthology.orchestra.run.smithi138:> set -ex 2024-09-14T11:58:50.654 DEBUG:teuthology.orchestra.run.smithi138:> dd of=/home/ubuntu/cephtest/archive/s3-tests.client.0.conf 2024-09-14T11:58:50.659 INFO:tasks.s3tests:Configuring boto... 2024-09-14T11:58:50.659 DEBUG:teuthology.orchestra.run.smithi138:> set -ex 2024-09-14T11:58:50.659 DEBUG:teuthology.orchestra.run.smithi138:> dd of=/home/ubuntu/cephtest/boto-client.0.cfg 2024-09-14T11:58:50.707 DEBUG:teuthology.orchestra.run.smithi138:s3 tests against rgw> source /home/ubuntu/cephtest/tox-venv/bin/activate && cd /home/ubuntu/cephtest/s3-tests-client.0 && S3TEST_CONF=/home/ubuntu/cephtest/archive/s3-tests.client.0.conf BOTO_CONFIG=/home/ubuntu/cephtest/boto-client.0.cfg REQUESTS_CA_BUNDLE=/etc/ssl/certs/ca-certificates.crt tox -- -v -m 'not fails_on_rgw and not lifecycle_expiration and not lifecycle_transition and not cloud_transition and not test_of_sts and not webidentity_test and not fails_with_subdomain and not sse_s3' 2024-09-14T11:58:50.881 INFO:teuthology.orchestra.run.smithi138.stdout:GLOB sdist-make: /home/ubuntu/cephtest/s3-tests-client.0/setup.py 2024-09-14T11:58:51.075 INFO:teuthology.orchestra.run.smithi138.stdout:py create: /home/ubuntu/cephtest/s3-tests-client.0/.tox/py 2024-09-14T11:58:51.416 INFO:teuthology.orchestra.run.smithi138.stdout:py installdeps: -rrequirements.txt 2024-09-14T12:00:45.525 INFO:teuthology.orchestra.run.smithi138.stdout:py inst: /home/ubuntu/cephtest/s3-tests-client.0/.tox/.tmp/package/1/s3tests-0.0.1.zip 2024-09-14T12:00:47.399 INFO:teuthology.orchestra.run.smithi138.stdout:py installed: boto==2.49.0,boto3==1.24.96,botocore==1.27.96,cachetools==5.5.0,certifi==2024.8.30,chardet==5.2.0,charset-normalizer==3.3.2,colorama==0.4.6,distlib==0.3.8,exceptiongroup==1.2.2,filelock==3.16.0,gevent==24.2.1,greenlet==3.1.0,httplib2==0.22.0,idna==3.9,iniconfig==2.0.0,isodate==0.6.1,jmespath==1.0.1,lxml==5.3.0,munch==4.0.0,packaging==24.1,platformdirs==4.3.3,pluggy==1.5.0,pyparsing==3.1.4,pyproject-api==1.7.1,pytest==8.3.3,python-dateutil==2.9.0.post0,pytz==2024.2,PyYAML==6.0.2,requests==2.32.3,s3tests @ file:///home/ubuntu/cephtest/s3-tests-client.0/.tox/.tmp/package/1/s3tests-0.0.1.zip#sha256=c8f49c6c39cb1cc92e07d4910238411db125b163dd88a00e43d80150793a71cc,s3transfer==0.6.2,six==1.16.0,tomli==2.0.1,tox==4.18.1,urllib3==1.26.20,virtualenv==20.26.4,zope.event==5.0,zope.interface==7.0.3 2024-09-14T12:00:47.400 INFO:teuthology.orchestra.run.smithi138.stdout:py run-test-pre: PYTHONHASHSEED='3863369404' 2024-09-14T12:00:47.400 INFO:teuthology.orchestra.run.smithi138.stdout:py run-test: commands[0] | pytest -v -m 'not fails_on_rgw and not lifecycle_expiration and not lifecycle_transition and not cloud_transition and not test_of_sts and not webidentity_test and not fails_with_subdomain and not sse_s3' 2024-09-14T12:00:47.581 INFO:teuthology.orchestra.run.smithi138.stdout:============================= test session starts ============================== 2024-09-14T12:00:47.581 INFO:teuthology.orchestra.run.smithi138.stdout:platform linux -- Python 3.10.6, pytest-8.3.3, pluggy-1.5.0 -- /home/ubuntu/cephtest/s3-tests-client.0/.tox/py/bin/python 2024-09-14T12:00:47.581 INFO:teuthology.orchestra.run.smithi138.stdout:cachedir: .tox/py/.pytest_cache 2024-09-14T12:00:47.581 INFO:teuthology.orchestra.run.smithi138.stdout:rootdir: /home/ubuntu/cephtest/s3-tests-client.0 2024-09-14T12:00:47.581 INFO:teuthology.orchestra.run.smithi138.stdout:configfile: pytest.ini 2024-09-14T12:00:49.432 INFO:teuthology.orchestra.run.smithi138.stdout:collecting ... collected 872 items / 126 deselected / 746 selected 2024-09-14T12:00:49.432 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-09-14T12:00:50.919 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests/functional/test_headers.py::test_object_create_bad_contentlength_none PASSED [ 0%] 2024-09-14T12:00:51.776 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests/functional/test_headers.py::test_object_create_bad_authorization_empty PASSED [ 0%] 2024-09-14T12:00:52.648 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests/functional/test_headers.py::test_object_create_date_and_amz_date PASSED [ 0%] 2024-09-14T12:00:53.526 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests/functional/test_headers.py::test_object_create_amz_date_and_no_date PASSED [ 0%] 2024-09-14T12:00:54.399 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests/functional/test_headers.py::test_object_create_bad_authorization_none PASSED [ 0%] 2024-09-14T12:00:55.124 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests/functional/test_headers.py::test_bucket_create_contentlength_none PASSED [ 0%] 2024-09-14T12:00:56.170 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests/functional/test_headers.py::test_object_acl_create_contentlength_none PASSED [ 0%] 2024-09-14T12:00:56.893 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests/functional/test_headers.py::test_bucket_create_bad_contentlength_none PASSED [ 1%] 2024-09-14T12:00:57.076 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests/functional/test_headers.py::test_bucket_create_bad_authorization_empty PASSED [ 1%] 2024-09-14T12:00:57.258 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests/functional/test_headers.py::test_bucket_create_bad_authorization_none PASSED [ 1%] 2024-09-14T12:00:58.158 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests/functional/test_headers.py::test_object_create_bad_contentlength_mismatch_below_aws2 PASSED [ 1%] 2024-09-14T12:00:59.052 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests/functional/test_headers.py::test_object_create_bad_authorization_incorrect_aws2 PASSED [ 1%] 2024-09-14T12:00:59.916 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests/functional/test_headers.py::test_object_create_bad_authorization_invalid_aws2 PASSED [ 1%] 2024-09-14T12:01:00.809 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests/functional/test_headers.py::test_object_create_bad_date_none_aws2 PASSED [ 1%] 2024-09-14T12:01:01.002 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests/functional/test_headers.py::test_bucket_create_bad_authorization_invalid_aws2 PASSED [ 2%] 2024-09-14T12:01:01.194 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests/functional/test_headers.py::test_bucket_create_bad_date_none_aws2 PASSED [ 2%] 2024-09-14T12:01:01.328 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests/functional/test_headers.py::test_object_create_bad_md5_invalid_garbage_aws4 SKIPPED [ 2%] 2024-09-14T12:01:01.455 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests/functional/test_headers.py::test_object_create_bad_contentlength_mismatch_below_aws4 SKIPPED [ 2%] 2024-09-14T12:01:01.590 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests/functional/test_headers.py::test_object_create_bad_authorization_incorrect_aws4 SKIPPED [ 2%] 2024-09-14T12:01:01.728 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests/functional/test_headers.py::test_object_create_bad_authorization_invalid_aws4 SKIPPED [ 2%] 2024-09-14T12:01:01.858 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests/functional/test_headers.py::test_object_create_bad_ua_empty_aws4 SKIPPED [ 2%] 2024-09-14T12:01:01.996 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests/functional/test_headers.py::test_object_create_bad_ua_none_aws4 SKIPPED [ 2%] 2024-09-14T12:01:02.129 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests/functional/test_headers.py::test_object_create_bad_date_invalid_aws4 SKIPPED [ 3%] 2024-09-14T12:01:02.261 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests/functional/test_headers.py::test_object_create_bad_amz_date_invalid_aws4 SKIPPED [ 3%] 2024-09-14T12:01:02.396 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests/functional/test_headers.py::test_object_create_bad_date_empty_aws4 SKIPPED [ 3%] 2024-09-14T12:01:02.529 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests/functional/test_headers.py::test_object_create_bad_amz_date_empty_aws4 SKIPPED [ 3%] 2024-09-14T12:01:02.656 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests/functional/test_headers.py::test_object_create_bad_date_none_aws4 SKIPPED [ 3%] 2024-09-14T12:01:02.790 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests/functional/test_headers.py::test_object_create_bad_amz_date_none_aws4 SKIPPED [ 3%] 2024-09-14T12:01:02.923 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests/functional/test_headers.py::test_object_create_bad_date_before_today_aws4 SKIPPED [ 3%] 2024-09-14T12:01:03.057 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests/functional/test_headers.py::test_object_create_bad_amz_date_before_today_aws4 SKIPPED [ 4%] 2024-09-14T12:01:03.189 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests/functional/test_headers.py::test_object_create_bad_date_after_today_aws4 SKIPPED [ 4%] 2024-09-14T12:01:03.334 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests/functional/test_headers.py::test_object_create_bad_amz_date_after_today_aws4 SKIPPED [ 4%] 2024-09-14T12:01:03.486 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests/functional/test_headers.py::test_object_create_bad_date_before_epoch_aws4 SKIPPED [ 4%] 2024-09-14T12:01:03.618 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests/functional/test_headers.py::test_object_create_bad_amz_date_before_epoch_aws4 SKIPPED [ 4%] 2024-09-14T12:01:03.746 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests/functional/test_headers.py::test_object_create_bad_date_after_end_aws4 SKIPPED [ 4%] 2024-09-14T12:01:03.879 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests/functional/test_headers.py::test_object_create_bad_amz_date_after_end_aws4 SKIPPED [ 4%] 2024-09-14T12:01:04.016 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests/functional/test_headers.py::test_object_create_missing_signed_custom_header_aws4 SKIPPED [ 4%] 2024-09-14T12:01:04.148 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests/functional/test_headers.py::test_object_create_missing_signed_header_aws4 SKIPPED [ 5%] 2024-09-14T12:01:04.281 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests/functional/test_headers.py::test_bucket_create_bad_authorization_invalid_aws4 SKIPPED [ 5%] 2024-09-14T12:01:04.414 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests/functional/test_headers.py::test_bucket_create_bad_ua_empty_aws4 SKIPPED [ 5%] 2024-09-14T12:01:04.545 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests/functional/test_headers.py::test_bucket_create_bad_ua_none_aws4 SKIPPED [ 5%] 2024-09-14T12:01:04.680 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests/functional/test_headers.py::test_bucket_create_bad_date_invalid_aws4 SKIPPED [ 5%] 2024-09-14T12:01:04.815 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests/functional/test_headers.py::test_bucket_create_bad_amz_date_invalid_aws4 SKIPPED [ 5%] 2024-09-14T12:01:04.947 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests/functional/test_headers.py::test_bucket_create_bad_date_empty_aws4 SKIPPED [ 5%] 2024-09-14T12:01:05.082 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests/functional/test_headers.py::test_bucket_create_bad_amz_date_empty_aws4 SKIPPED [ 6%] 2024-09-14T12:01:05.250 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests/functional/test_headers.py::test_bucket_create_bad_date_none_aws4 SKIPPED [ 6%] 2024-09-14T12:01:05.383 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests/functional/test_headers.py::test_bucket_create_bad_amz_date_none_aws4 SKIPPED [ 6%] 2024-09-14T12:01:05.517 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests/functional/test_headers.py::test_bucket_create_bad_date_before_today_aws4 SKIPPED [ 6%] 2024-09-14T12:01:05.650 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests/functional/test_headers.py::test_bucket_create_bad_amz_date_before_today_aws4 SKIPPED [ 6%] 2024-09-14T12:01:05.781 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests/functional/test_headers.py::test_bucket_create_bad_date_after_today_aws4 SKIPPED [ 6%] 2024-09-14T12:01:05.913 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests/functional/test_headers.py::test_bucket_create_bad_amz_date_after_today_aws4 SKIPPED [ 6%] 2024-09-14T12:01:06.051 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests/functional/test_headers.py::test_bucket_create_bad_date_before_epoch_aws4 SKIPPED [ 6%] 2024-09-14T12:01:06.182 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests/functional/test_headers.py::test_bucket_create_bad_amz_date_before_epoch_aws4 SKIPPED [ 7%] 2024-09-14T12:01:07.868 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests/functional/test_s3.py::test_versioning_obj_read_not_exist_null PASSED [ 7%] 2024-09-14T12:01:24.963 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests/functional/test_s3.py::test_object_storage_class PASSED [ 7%] 2024-09-14T12:01:44.424 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests/functional/test_s3.py::test_object_storage_class_multipart PASSED [ 7%] 2024-09-14T12:02:13.271 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests/functional/test_s3.py::test_object_modify_storage_class PASSED [ 7%] 2024-09-14T12:02:48.696 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests/functional/test_s3.py::test_object_modify_storage_class_multipart PASSED [ 7%] 2024-09-14T12:02:58.170 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests/functional/test_s3.py::test_object_storage_class_copy PASSED [ 7%] 2024-09-14T12:03:08.416 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests/functional/test_s3.py::test_object_storage_class_copy_multipart PASSED [ 8%] 2024-09-14T12:03:12.056 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests/functional/test_s3.py::test_atomic_dual_conditional_write_1mb PASSED [ 8%] 2024-09-14T12:03:13.160 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests/functional/test_s3.py::test_atomic_write_bucket_gone PASSED [ 8%] 2024-09-14T12:03:16.033 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests/functional/test_s3.py::test_encryption_sse_c_multipart_invalid_chunks_1 PASSED [ 8%] 2024-09-14T12:03:18.914 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests/functional/test_s3.py::test_encryption_sse_c_multipart_invalid_chunks_2 PASSED [ 8%] 2024-09-14T12:03:21.033 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests/functional/test_s3.py::test_bucket_policy_set_condition_operator_end_with_IfExists PASSED [ 8%] 2024-09-14T12:03:22.358 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests/functional/test_s3.py::test_bucket_policy_put_obj_request_obj_tag PASSED [ 8%] 2024-09-14T12:03:23.323 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests/functional/test_s3_website.py::test_website_nonexistant_bucket_rgw SKIPPED [ 8%] 2024-09-14T12:03:23.325 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests/functional/test_s3_website.py::test_website_public_bucket_list_public_index SKIPPED [ 9%] 2024-09-14T12:03:23.327 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests/functional/test_s3_website.py::test_website_private_bucket_list_public_index SKIPPED [ 9%] 2024-09-14T12:03:23.329 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests/functional/test_s3_website.py::test_website_private_bucket_list_empty SKIPPED [ 9%] 2024-09-14T12:03:23.336 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests/functional/test_s3_website.py::test_website_public_bucket_list_empty SKIPPED [ 9%] 2024-09-14T12:03:23.338 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests/functional/test_s3_website.py::test_website_public_bucket_list_private_index SKIPPED [ 9%] 2024-09-14T12:03:23.340 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests/functional/test_s3_website.py::test_website_private_bucket_list_private_index SKIPPED [ 9%] 2024-09-14T12:03:23.343 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests/functional/test_s3_website.py::test_website_private_bucket_list_empty_missingerrordoc SKIPPED [ 9%] 2024-09-14T12:03:23.346 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests/functional/test_s3_website.py::test_website_public_bucket_list_empty_missingerrordoc SKIPPED [ 10%] 2024-09-14T12:03:23.348 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests/functional/test_s3_website.py::test_website_public_bucket_list_private_index_missingerrordoc SKIPPED [ 10%] 2024-09-14T12:03:23.350 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests/functional/test_s3_website.py::test_website_private_bucket_list_private_index_missingerrordoc SKIPPED [ 10%] 2024-09-14T12:03:23.353 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests/functional/test_s3_website.py::test_website_private_bucket_list_empty_blockederrordoc SKIPPED [ 10%] 2024-09-14T12:03:23.355 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests/functional/test_s3_website.py::test_website_public_bucket_list_pubilc_errordoc SKIPPED [ 10%] 2024-09-14T12:03:23.358 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests/functional/test_s3_website.py::test_website_public_bucket_list_empty_blockederrordoc SKIPPED [ 10%] 2024-09-14T12:03:23.360 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests/functional/test_s3_website.py::test_website_public_bucket_list_private_index_blockederrordoc SKIPPED [ 10%] 2024-09-14T12:03:23.362 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests/functional/test_s3_website.py::test_website_private_bucket_list_private_index_blockederrordoc SKIPPED [ 10%] 2024-09-14T12:03:23.364 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests/functional/test_s3_website.py::test_website_private_bucket_list_empty_gooderrordoc SKIPPED [ 11%] 2024-09-14T12:03:23.366 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests/functional/test_s3_website.py::test_website_public_bucket_list_empty_gooderrordoc SKIPPED [ 11%] 2024-09-14T12:03:23.368 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests/functional/test_s3_website.py::test_website_public_bucket_list_private_index_gooderrordoc SKIPPED [ 11%] 2024-09-14T12:03:23.370 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests/functional/test_s3_website.py::test_website_private_bucket_list_private_index_gooderrordoc SKIPPED [ 11%] 2024-09-14T12:03:23.372 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests/functional/test_s3_website.py::test_website_bucket_private_redirectall_base SKIPPED [ 11%] 2024-09-14T12:03:23.374 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests/functional/test_s3_website.py::test_website_bucket_private_redirectall_path SKIPPED [ 11%] 2024-09-14T12:03:23.376 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests/functional/test_s3_website.py::test_website_bucket_private_redirectall_path_upgrade SKIPPED [ 11%] 2024-09-14T12:03:23.378 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests/functional/test_s3_website.py::test_website_xredirect_nonwebsite SKIPPED [ 12%] 2024-09-14T12:03:23.379 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests/functional/test_s3_website.py::test_website_xredirect_public_relative SKIPPED [ 12%] 2024-09-14T12:03:23.381 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests/functional/test_s3_website.py::test_website_xredirect_public_abs SKIPPED [ 12%] 2024-09-14T12:03:23.383 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests/functional/test_s3_website.py::test_website_xredirect_private_relative SKIPPED [ 12%] 2024-09-14T12:03:23.384 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests/functional/test_s3_website.py::test_website_xredirect_private_abs SKIPPED [ 12%] 2024-09-14T12:03:23.488 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests/functional/test_s3_website.py::test_routing_generator XFAIL [ 12%] 2024-09-14T12:03:23.501 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests/functional/test_utils.py::test_generate PASSED [ 12%] 2024-09-14T12:03:26.009 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests_boto3/functional/test_headers.py::test_object_create_bad_md5_invalid_short PASSED [ 13%] 2024-09-14T12:03:33.581 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests_boto3/functional/test_headers.py::test_object_create_bad_md5_bad PASSED [ 13%] 2024-09-14T12:03:35.425 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests_boto3/functional/test_headers.py::test_object_create_bad_md5_empty PASSED [ 13%] 2024-09-14T12:03:37.721 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests_boto3/functional/test_headers.py::test_object_create_bad_md5_none PASSED [ 13%] 2024-09-14T12:03:39.961 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests_boto3/functional/test_headers.py::test_object_create_bad_expect_mismatch PASSED [ 13%] 2024-09-14T12:03:42.230 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests_boto3/functional/test_headers.py::test_object_create_bad_expect_empty PASSED [ 13%] 2024-09-14T12:03:44.402 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests_boto3/functional/test_headers.py::test_object_create_bad_expect_none PASSED [ 13%] 2024-09-14T12:03:46.365 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests_boto3/functional/test_headers.py::test_object_create_bad_contentlength_negative PASSED [ 13%] 2024-09-14T12:03:48.745 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests_boto3/functional/test_headers.py::test_object_create_bad_contenttype_invalid PASSED [ 14%] 2024-09-14T12:03:50.777 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests_boto3/functional/test_headers.py::test_object_create_bad_contenttype_empty PASSED [ 14%] 2024-09-14T12:03:52.817 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests_boto3/functional/test_headers.py::test_object_create_bad_contenttype_none PASSED [ 14%] 2024-09-14T12:03:54.713 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests_boto3/functional/test_headers.py::test_bucket_put_bad_canned_acl PASSED [ 14%] 2024-09-14T12:03:56.409 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests_boto3/functional/test_headers.py::test_bucket_create_bad_expect_mismatch PASSED [ 14%] 2024-09-14T12:03:58.141 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests_boto3/functional/test_headers.py::test_bucket_create_bad_expect_empty PASSED [ 14%] 2024-09-14T12:03:59.306 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests_boto3/functional/test_headers.py::test_bucket_create_bad_contentlength_negative PASSED [ 14%] 2024-09-14T12:04:01.189 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests_boto3/functional/test_headers.py::test_object_create_bad_md5_invalid_garbage_aws2 PASSED [ 15%] 2024-09-14T12:04:03.285 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests_boto3/functional/test_headers.py::test_object_create_bad_ua_empty_aws2 PASSED [ 15%] 2024-09-14T12:04:05.413 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests_boto3/functional/test_headers.py::test_object_create_bad_ua_none_aws2 PASSED [ 15%] 2024-09-14T12:04:07.257 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests_boto3/functional/test_headers.py::test_object_create_bad_date_invalid_aws2 PASSED [ 15%] 2024-09-14T12:04:09.153 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests_boto3/functional/test_headers.py::test_object_create_bad_date_empty_aws2 PASSED [ 15%] 2024-09-14T12:04:11.022 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests_boto3/functional/test_headers.py::test_object_create_bad_date_before_today_aws2 PASSED [ 15%] 2024-09-14T12:04:12.897 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests_boto3/functional/test_headers.py::test_object_create_bad_date_before_epoch_aws2 PASSED [ 15%] 2024-09-14T12:04:14.753 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests_boto3/functional/test_headers.py::test_object_create_bad_date_after_end_aws2 PASSED [ 15%] 2024-09-14T12:04:16.437 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests_boto3/functional/test_headers.py::test_bucket_create_bad_ua_empty_aws2 PASSED [ 16%] 2024-09-14T12:04:18.169 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests_boto3/functional/test_headers.py::test_bucket_create_bad_ua_none_aws2 PASSED [ 16%] 2024-09-14T12:04:19.269 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests_boto3/functional/test_headers.py::test_bucket_create_bad_date_invalid_aws2 PASSED [ 16%] 2024-09-14T12:04:20.453 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests_boto3/functional/test_headers.py::test_bucket_create_bad_date_empty_aws2 PASSED [ 16%] 2024-09-14T12:04:21.565 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests_boto3/functional/test_headers.py::test_bucket_create_bad_date_before_today_aws2 PASSED [ 16%] 2024-09-14T12:04:22.709 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests_boto3/functional/test_headers.py::test_bucket_create_bad_date_after_today_aws2 PASSED [ 16%] 2024-09-14T12:04:23.825 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests_boto3/functional/test_headers.py::test_bucket_create_bad_date_before_epoch_aws2 PASSED [ 16%] 2024-09-14T12:04:25.833 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests_boto3/functional/test_iam.py::test_put_user_policy PASSED [ 17%] 2024-09-14T12:04:26.973 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests_boto3/functional/test_iam.py::test_put_user_policy_invalid_user PASSED [ 17%] 2024-09-14T12:04:28.261 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests_boto3/functional/test_iam.py::test_put_user_policy_parameter_limit PASSED [ 17%] 2024-09-14T12:04:29.781 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests_boto3/functional/test_iam.py::test_put_existing_user_policy PASSED [ 17%] 2024-09-14T12:04:31.269 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests_boto3/functional/test_iam.py::test_list_user_policy PASSED [ 17%] 2024-09-14T12:04:32.497 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests_boto3/functional/test_iam.py::test_list_user_policy_invalid_user PASSED [ 17%] 2024-09-14T12:04:33.969 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests_boto3/functional/test_iam.py::test_get_user_policy PASSED [ 17%] 2024-09-14T12:04:35.429 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests_boto3/functional/test_iam.py::test_get_user_policy_invalid_user PASSED [ 17%] 2024-09-14T12:04:37.169 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests_boto3/functional/test_iam.py::test_get_user_policy_from_multiple_policies PASSED [ 18%] 2024-09-14T12:04:38.509 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests_boto3/functional/test_iam.py::test_delete_user_policy PASSED [ 18%] 2024-09-14T12:04:39.985 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests_boto3/functional/test_iam.py::test_delete_user_policy_invalid_user PASSED [ 18%] 2024-09-14T12:04:41.441 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests_boto3/functional/test_iam.py::test_delete_user_policy_invalid_policy_name PASSED [ 18%] 2024-09-14T12:04:43.586 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests_boto3/functional/test_iam.py::test_delete_user_policy_from_multiple_policies PASSED [ 18%] 2024-09-14T12:04:46.029 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests_boto3/functional/test_iam.py::test_allow_bucket_actions_in_user_policy PASSED [ 18%] 2024-09-14T12:04:48.185 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests_boto3/functional/test_iam.py::test_deny_bucket_actions_in_user_policy PASSED [ 18%] 2024-09-14T12:04:50.602 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests_boto3/functional/test_iam.py::test_allow_object_actions_in_user_policy PASSED [ 19%] 2024-09-14T12:04:53.149 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests_boto3/functional/test_iam.py::test_deny_object_actions_in_user_policy PASSED [ 19%] 2024-09-14T12:04:58.021 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests_boto3/functional/test_iam.py::test_allow_multipart_actions_in_user_policy PASSED [ 19%] 2024-09-14T12:05:02.862 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests_boto3/functional/test_iam.py::test_deny_multipart_actions_in_user_policy PASSED [ 19%] 2024-09-14T12:05:05.601 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests_boto3/functional/test_iam.py::test_allow_tagging_actions_in_user_policy PASSED [ 19%] 2024-09-14T12:05:08.164 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests_boto3/functional/test_iam.py::test_deny_tagging_actions_in_user_policy PASSED [ 19%] 2024-09-14T12:05:10.377 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests_boto3/functional/test_iam.py::test_verify_conflicting_user_policy_statements PASSED [ 19%] 2024-09-14T12:05:12.857 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests_boto3/functional/test_iam.py::test_verify_conflicting_user_policies PASSED [ 19%] 2024-09-14T12:05:14.569 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests_boto3/functional/test_iam.py::test_verify_allow_iam_actions PASSED [ 20%] 2024-09-14T12:05:17.702 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests_boto3/functional/test_iam.py::test_account_user_create PASSED [ 20%] 2024-09-14T12:05:19.834 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests_boto3/functional/test_iam.py::test_account_user_case_insensitive_name PASSED [ 20%] 2024-09-14T12:05:22.325 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests_boto3/functional/test_iam.py::test_account_user_delete PASSED [ 20%] 2024-09-14T12:05:26.753 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests_boto3/functional/test_iam.py::test_account_user_list PASSED [ 20%] 2024-09-14T12:05:32.465 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests_boto3/functional/test_iam.py::test_account_user_list_path_prefix PASSED [ 20%] 2024-09-14T12:05:36.009 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests_boto3/functional/test_iam.py::test_account_user_update_name PASSED [ 20%] 2024-09-14T12:05:39.274 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests_boto3/functional/test_iam.py::test_account_user_update_path PASSED [ 21%] 2024-09-14T12:05:41.875 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests_boto3/functional/test_iam.py::test_account_user_access_key_create PASSED [ 21%] 2024-09-14T12:05:43.770 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests_boto3/functional/test_iam.py::test_account_current_user_access_key_create PASSED [ 21%] 2024-09-14T12:05:46.782 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests_boto3/functional/test_iam.py::test_account_user_access_key_update PASSED [ 21%] 2024-09-14T12:05:49.046 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests_boto3/functional/test_iam.py::test_account_current_user_access_key_update PASSED [ 21%] 2024-09-14T12:05:51.906 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests_boto3/functional/test_iam.py::test_account_user_access_key_delete PASSED [ 21%] 2024-09-14T12:05:54.086 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests_boto3/functional/test_iam.py::test_account_current_user_access_key_delete PASSED [ 21%] 2024-09-14T12:05:57.669 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests_boto3/functional/test_iam.py::test_account_user_access_key_list PASSED [ 21%] 2024-09-14T12:06:01.125 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests_boto3/functional/test_iam.py::test_account_user_bucket_policy_allow PASSED [ 22%] 2024-09-14T12:06:04.978 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests_boto3/functional/test_iam.py::test_account_user_policy PASSED [ 22%] 2024-09-14T12:06:08.790 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests_boto3/functional/test_iam.py::test_account_user_policy_managed PASSED [ 22%] 2024-09-14T12:06:11.798 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests_boto3/functional/test_iam.py::test_account_user_policy_allow PASSED [ 22%] 2024-09-14T12:06:14.473 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests_boto3/functional/test_iam.py::test_account_group_create PASSED [ 22%] 2024-09-14T12:06:16.694 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests_boto3/functional/test_iam.py::test_account_group_case_insensitive_name PASSED [ 22%] 2024-09-14T12:06:21.198 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests_boto3/functional/test_iam.py::test_account_group_list PASSED [ 22%] 2024-09-14T12:06:24.722 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests_boto3/functional/test_iam.py::test_account_group_update PASSED [ 23%] 2024-09-14T12:06:28.518 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests_boto3/functional/test_iam.py::test_account_inline_group_policy PASSED [ 23%] 2024-09-14T12:06:32.138 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests_boto3/functional/test_iam.py::test_account_managed_group_policy PASSED [ 23%] 2024-09-14T12:06:35.830 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests_boto3/functional/test_iam.py::test_account_inline_group_policy_allow PASSED [ 23%] 2024-09-14T12:06:39.482 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests_boto3/functional/test_iam.py::test_account_managed_group_policy_allow PASSED [ 23%] 2024-09-14T12:06:42.554 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests_boto3/functional/test_iam.py::test_account_role_create PASSED [ 23%] 2024-09-14T12:06:44.866 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests_boto3/functional/test_iam.py::test_account_role_case_insensitive_name PASSED [ 23%] 2024-09-14T12:06:47.442 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests_boto3/functional/test_iam.py::test_account_role_delete PASSED [ 23%] 2024-09-14T12:06:51.722 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests_boto3/functional/test_iam.py::test_account_role_list PASSED [ 24%] 2024-09-14T12:06:56.982 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests_boto3/functional/test_iam.py::test_account_role_list_path_prefix PASSED [ 24%] 2024-09-14T12:06:59.526 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests_boto3/functional/test_iam.py::test_account_role_update PASSED [ 24%] 2024-09-14T12:07:03.074 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests_boto3/functional/test_iam.py::test_account_role_policy PASSED [ 24%] 2024-09-14T12:07:06.674 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests_boto3/functional/test_iam.py::test_account_role_policy_managed PASSED [ 24%] 2024-09-14T12:07:10.394 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests_boto3/functional/test_iam.py::test_account_role_policy_allow PASSED [ 24%] 2024-09-14T12:07:14.570 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests_boto3/functional/test_iam.py::test_same_account_role_policy_allow PASSED [ 24%] 2024-09-14T12:07:18.914 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests_boto3/functional/test_iam.py::test_cross_account_role_policy_allow PASSED [ 25%] 2024-09-14T12:07:22.978 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests_boto3/functional/test_iam.py::test_account_role_policy_allow_create_bucket PASSED [ 25%] 2024-09-14T12:07:26.846 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests_boto3/functional/test_iam.py::test_account_role_policy_allow_get_role PASSED [ 25%] 2024-09-14T12:07:29.394 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests_boto3/functional/test_iam.py::test_account_oidc_provider PASSED [ 25%] 2024-09-14T12:07:31.554 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests_boto3/functional/test_iam.py::test_verify_add_new_client_id_to_oidc PASSED [ 25%] 2024-09-14T12:07:33.662 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests_boto3/functional/test_iam.py::test_verify_add_existing_client_id_to_oidc PASSED [ 25%] 2024-09-14T12:07:35.770 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests_boto3/functional/test_iam.py::test_verify_update_thumbprintlist_of_oidc PASSED [ 25%] 2024-09-14T12:07:39.794 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests_boto3/functional/test_iam.py::test_cross_account_bucket_user_policy_allow_user_arn PASSED [ 26%] 2024-09-14T12:07:43.851 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests_boto3/functional/test_iam.py::test_cross_account_user_bucket_policy_allow_user_arn PASSED [ 26%] 2024-09-14T12:07:47.834 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests_boto3/functional/test_iam.py::test_cross_account_user_bucket_policy_allow_account_arn PASSED [ 26%] 2024-09-14T12:07:51.810 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests_boto3/functional/test_iam.py::test_cross_account_bucket_user_policy_allow_account_arn PASSED [ 26%] 2024-09-14T12:07:55.871 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests_boto3/functional/test_iam.py::test_cross_account_user_bucket_policy_allow_account_id PASSED [ 26%] 2024-09-14T12:07:59.934 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests_boto3/functional/test_iam.py::test_cross_account_bucket_user_policy_allow_account_id PASSED [ 26%] 2024-09-14T12:08:03.954 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests_boto3/functional/test_iam.py::test_cross_account_bucket_acl_user_policy_grant_user_id PASSED [ 26%] 2024-09-14T12:08:07.922 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests_boto3/functional/test_iam.py::test_cross_account_user_policy_bucket_acl_grant_user_id PASSED [ 26%] 2024-09-14T12:08:11.954 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests_boto3/functional/test_iam.py::test_cross_account_bucket_acl_user_policy_grant_canonical_id PASSED [ 27%] 2024-09-14T12:08:15.998 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests_boto3/functional/test_iam.py::test_cross_account_user_policy_bucket_acl_grant_canonical_id PASSED [ 27%] 2024-09-14T12:08:20.034 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests_boto3/functional/test_iam.py::test_cross_account_bucket_acl_user_policy_grant_account_email PASSED [ 27%] 2024-09-14T12:08:24.030 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests_boto3/functional/test_iam.py::test_cross_account_user_policy_bucket_acl_grant_account_email PASSED [ 27%] 2024-09-14T12:08:26.998 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests_boto3/functional/test_iam.py::test_cross_account_root_bucket_policy_allow_account_arn PASSED [ 27%] 2024-09-14T12:08:29.934 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests_boto3/functional/test_iam.py::test_cross_account_root_bucket_policy_allow_account_id PASSED [ 27%] 2024-09-14T12:08:32.798 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests_boto3/functional/test_iam.py::test_cross_account_root_bucket_acl_grant_canonical_id PASSED [ 27%] 2024-09-14T12:08:35.622 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests_boto3/functional/test_iam.py::test_cross_account_root_bucket_acl_grant_account_email PASSED [ 28%] 2024-09-14T12:08:38.053 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_empty PASSED [ 28%] 2024-09-14T12:08:40.869 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_distinct PASSED [ 28%] 2024-09-14T12:08:43.389 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_many PASSED [ 28%] 2024-09-14T12:08:45.913 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_many PASSED [ 28%] 2024-09-14T12:08:48.381 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests_boto3/functional/test_s3.py::test_basic_key_count PASSED [ 28%] 2024-09-14T12:08:50.786 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_delimiter_basic PASSED [ 28%] 2024-09-14T12:08:53.281 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_delimiter_basic PASSED [ 28%] 2024-09-14T12:08:55.858 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_encoding_basic PASSED [ 29%] 2024-09-14T12:08:58.314 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_encoding_basic PASSED [ 29%] 2024-09-14T12:09:02.750 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_delimiter_prefix PASSED [ 29%] 2024-09-14T12:09:07.273 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_delimiter_prefix PASSED [ 29%] 2024-09-14T12:09:09.429 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_delimiter_prefix_ends_with_delimiter PASSED [ 29%] 2024-09-14T12:09:11.617 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_delimiter_prefix_ends_with_delimiter PASSED [ 29%] 2024-09-14T12:09:14.041 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_delimiter_alt PASSED [ 29%] 2024-09-14T12:09:16.485 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_delimiter_alt PASSED [ 30%] 2024-09-14T12:09:20.586 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_delimiter_prefix_underscore PASSED [ 30%] 2024-09-14T12:09:24.577 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_delimiter_prefix_underscore PASSED [ 30%] 2024-09-14T12:09:27.081 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_delimiter_percentage PASSED [ 30%] 2024-09-14T12:09:29.625 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_delimiter_percentage PASSED [ 30%] 2024-09-14T12:09:32.089 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_delimiter_whitespace PASSED [ 30%] 2024-09-14T12:09:34.545 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_delimiter_whitespace PASSED [ 30%] 2024-09-14T12:09:37.037 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_delimiter_dot PASSED [ 30%] 2024-09-14T12:09:39.457 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_delimiter_dot PASSED [ 31%] 2024-09-14T12:09:41.985 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_delimiter_unreadable PASSED [ 31%] 2024-09-14T12:09:44.474 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_delimiter_unreadable PASSED [ 31%] 2024-09-14T12:09:46.993 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_delimiter_empty PASSED [ 31%] 2024-09-14T12:09:49.421 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_delimiter_empty PASSED [ 31%] 2024-09-14T12:09:51.909 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_delimiter_none PASSED [ 31%] 2024-09-14T12:09:54.337 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_delimiter_none PASSED [ 31%] 2024-09-14T12:09:56.725 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_fetchowner_notempty PASSED [ 32%] 2024-09-14T12:09:59.025 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_fetchowner_defaultempty PASSED [ 32%] 2024-09-14T12:10:01.513 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_fetchowner_empty PASSED [ 32%] 2024-09-14T12:10:03.937 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_delimiter_not_exist PASSED [ 32%] 2024-09-14T12:10:06.369 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_delimiter_not_exist PASSED [ 32%] 2024-09-14T12:12:07.137 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_delimiter_not_skip_special PASSED [ 32%] 2024-09-14T12:12:09.466 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_prefix_basic PASSED [ 32%] 2024-09-14T12:12:11.850 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_prefix_basic PASSED [ 32%] 2024-09-14T12:12:14.314 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_prefix_alt PASSED [ 33%] 2024-09-14T12:12:16.677 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_prefix_alt PASSED [ 33%] 2024-09-14T12:12:18.981 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_prefix_empty PASSED [ 33%] 2024-09-14T12:12:21.361 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_prefix_empty PASSED [ 33%] 2024-09-14T12:12:23.801 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_prefix_none PASSED [ 33%] 2024-09-14T12:12:26.174 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_prefix_none PASSED [ 33%] 2024-09-14T12:12:28.498 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_prefix_not_exist PASSED [ 33%] 2024-09-14T12:12:30.765 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_prefix_not_exist PASSED [ 34%] 2024-09-14T12:12:33.165 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_prefix_unreadable PASSED [ 34%] 2024-09-14T12:12:35.482 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_prefix_unreadable PASSED [ 34%] 2024-09-14T12:12:37.982 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_prefix_delimiter_basic PASSED [ 34%] 2024-09-14T12:12:40.477 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_prefix_delimiter_basic PASSED [ 34%] 2024-09-14T12:12:43.002 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_prefix_delimiter_alt PASSED [ 34%] 2024-09-14T12:12:45.465 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_prefix_delimiter_alt PASSED [ 34%] 2024-09-14T12:12:47.953 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_prefix_delimiter_prefix_not_exist PASSED [ 34%] 2024-09-14T12:12:50.417 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_prefix_delimiter_prefix_not_exist PASSED [ 35%] 2024-09-14T12:12:52.901 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_prefix_delimiter_delimiter_not_exist PASSED [ 35%] 2024-09-14T12:12:55.365 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_prefix_delimiter_delimiter_not_exist PASSED [ 35%] 2024-09-14T12:12:57.853 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_prefix_delimiter_prefix_delimiter_not_exist PASSED [ 35%] 2024-09-14T12:13:00.290 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_prefix_delimiter_prefix_delimiter_not_exist PASSED [ 35%] 2024-09-14T12:13:02.881 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_maxkeys_one PASSED [ 35%] 2024-09-14T12:13:05.465 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_maxkeys_one PASSED [ 35%] 2024-09-14T12:13:07.941 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_maxkeys_zero PASSED [ 36%] 2024-09-14T12:13:10.361 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_maxkeys_zero PASSED [ 36%] 2024-09-14T12:13:12.969 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_maxkeys_none PASSED [ 36%] 2024-09-14T12:13:15.425 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_maxkeys_none PASSED [ 36%] 2024-09-14T12:13:16.617 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests_boto3/functional/test_s3.py::test_account_usage PASSED [ 36%] 2024-09-14T12:13:18.777 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests_boto3/functional/test_s3.py::test_head_bucket_usage PASSED [ 36%] 2024-09-14T12:13:24.213 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_unordered PASSED [ 36%] 2024-09-14T12:13:29.813 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_unordered PASSED [ 36%] 2024-09-14T12:13:32.249 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_maxkeys_invalid PASSED [ 37%] 2024-09-14T12:13:34.782 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_marker_none PASSED [ 37%] 2024-09-14T12:13:37.245 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_marker_empty PASSED [ 37%] 2024-09-14T12:13:39.778 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_continuationtoken_empty PASSED [ 37%] 2024-09-14T12:13:42.373 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_continuationtoken PASSED [ 37%] 2024-09-14T12:13:45.054 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_both_continuationtoken_startafter PASSED [ 37%] 2024-09-14T12:13:47.489 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_marker_unreadable PASSED [ 37%] 2024-09-14T12:13:50.041 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_startafter_unreadable PASSED [ 38%] 2024-09-14T12:13:52.497 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_marker_not_in_list PASSED [ 38%] 2024-09-14T12:13:55.009 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_startafter_not_in_list PASSED [ 38%] 2024-09-14T12:13:57.450 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_marker_after_list PASSED [ 38%] 2024-09-14T12:13:59.889 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_startafter_after_list PASSED [ 38%] 2024-09-14T12:14:02.661 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_return_data PASSED [ 38%] 2024-09-14T12:14:06.494 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_return_data_versioning PASSED [ 38%] 2024-09-14T12:14:08.626 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_objects_anonymous PASSED [ 39%] 2024-09-14T12:14:10.702 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_objects_anonymous PASSED [ 39%] 2024-09-14T12:14:12.609 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_objects_anonymous_fail PASSED [ 39%] 2024-09-14T12:14:14.502 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_objects_anonymous_fail PASSED [ 39%] 2024-09-14T12:14:15.634 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_notexist PASSED [ 39%] 2024-09-14T12:14:16.774 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests_boto3/functional/test_s3.py::test_bucketv2_notexist PASSED [ 39%] 2024-09-14T12:14:18.046 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_delete_notexist PASSED [ 39%] 2024-09-14T12:14:20.166 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_delete_nonempty PASSED [ 39%] 2024-09-14T12:14:29.501 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_concurrent_set_canned_acl PASSED [ 40%] 2024-09-14T12:14:30.682 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests_boto3/functional/test_s3.py::test_object_write_to_nonexist_bucket PASSED [ 40%] 2024-09-14T12:14:32.725 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests_boto3/functional/test_s3.py::test_object_write_with_chunked_transfer_encoding PASSED [ 40%] 2024-09-14T12:14:34.602 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_create_delete PASSED [ 40%] 2024-09-14T12:14:36.449 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests_boto3/functional/test_s3.py::test_object_read_not_exist PASSED [ 40%] 2024-09-14T12:14:38.426 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests_boto3/functional/test_s3.py::test_object_requestid_matches_header_on_error PASSED [ 40%] 2024-09-14T12:14:44.513 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests_boto3/functional/test_s3.py::test_versioning_concurrent_multi_object_delete PASSED [ 40%] 2024-09-14T12:14:47.313 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests_boto3/functional/test_s3.py::test_multi_object_delete PASSED [ 41%] 2024-09-14T12:14:50.038 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests_boto3/functional/test_s3.py::test_multi_objectv2_delete PASSED [ 41%] 2024-09-14T12:16:51.922 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests_boto3/functional/test_s3.py::test_multi_object_delete_key_limit PASSED [ 41%] 2024-09-14T12:18:53.314 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests_boto3/functional/test_s3.py::test_multi_objectv2_delete_key_limit PASSED [ 41%] 2024-09-14T12:18:55.438 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests_boto3/functional/test_s3.py::test_object_head_zero_bytes PASSED [ 41%] 2024-09-14T12:18:57.485 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests_boto3/functional/test_s3.py::test_object_write_check_etag PASSED [ 41%] 2024-09-14T12:18:59.582 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests_boto3/functional/test_s3.py::test_object_write_cache_control PASSED [ 41%] 2024-09-14T12:19:01.874 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests_boto3/functional/test_s3.py::test_object_write_expires PASSED [ 41%] 2024-09-14T12:19:04.474 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests_boto3/functional/test_s3.py::test_object_write_read_update_read_delete PASSED [ 42%] 2024-09-14T12:19:06.900 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests_boto3/functional/test_s3.py::test_object_set_get_metadata_none_to_good PASSED [ 42%] 2024-09-14T12:19:08.978 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests_boto3/functional/test_s3.py::test_object_set_get_metadata_none_to_empty PASSED [ 42%] 2024-09-14T12:19:11.386 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests_boto3/functional/test_s3.py::test_object_set_get_metadata_overwrite_to_empty PASSED [ 42%] 2024-09-14T12:19:13.713 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests_boto3/functional/test_s3.py::test_object_metadata_replaced_on_put PASSED [ 42%] 2024-09-14T12:19:15.881 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests_boto3/functional/test_s3.py::test_object_write_file PASSED [ 42%] 2024-09-14T12:19:18.066 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_anonymous_request PASSED [ 42%] 2024-09-14T12:19:20.409 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_authenticated_request PASSED [ 43%] 2024-09-14T12:19:22.490 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_authenticated_no_content_type PASSED [ 43%] 2024-09-14T12:19:24.346 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_authenticated_request_bad_access_key PASSED [ 43%] 2024-09-14T12:19:26.358 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_set_success_code PASSED [ 43%] 2024-09-14T12:19:28.381 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_set_invalid_success_code PASSED [ 43%] 2024-09-14T12:19:32.142 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_upload_larger_than_chunk PASSED [ 43%] 2024-09-14T12:19:34.357 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_set_key_from_filename PASSED [ 43%] 2024-09-14T12:19:36.374 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_ignored_header PASSED [ 43%] 2024-09-14T12:19:38.438 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_case_insensitive_condition_fields PASSED [ 44%] 2024-09-14T12:19:40.662 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_escaped_field_values PASSED [ 44%] 2024-09-14T12:19:42.861 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_success_redirect_action PASSED [ 44%] 2024-09-14T12:19:44.737 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_invalid_signature PASSED [ 44%] 2024-09-14T12:19:46.518 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_invalid_access_key PASSED [ 44%] 2024-09-14T12:19:48.442 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_invalid_date_format PASSED [ 44%] 2024-09-14T12:19:50.258 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_no_key_specified PASSED [ 44%] 2024-09-14T12:19:52.158 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_missing_signature PASSED [ 45%] 2024-09-14T12:19:54.034 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_missing_policy_condition PASSED [ 45%] 2024-09-14T12:19:56.290 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_user_specified_header PASSED [ 45%] 2024-09-14T12:19:58.225 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_request_missing_policy_specified_field PASSED [ 45%] 2024-09-14T12:20:00.066 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_condition_is_case_sensitive PASSED [ 45%] 2024-09-14T12:20:01.966 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_expires_is_case_sensitive PASSED [ 45%] 2024-09-14T12:20:03.921 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_expired_policy PASSED [ 45%] 2024-09-14T12:20:06.562 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_wrong_bucket PASSED [ 45%] 2024-09-14T12:20:08.394 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_invalid_request_field_value PASSED [ 46%] 2024-09-14T12:20:10.293 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_missing_expires_condition PASSED [ 46%] 2024-09-14T12:20:12.202 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_missing_conditions_list PASSED [ 46%] 2024-09-14T12:20:14.154 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_upload_size_limit_exceeded PASSED [ 46%] 2024-09-14T12:20:16.010 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_missing_content_length_argument PASSED [ 46%] 2024-09-14T12:20:17.897 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_invalid_content_length_argument PASSED [ 46%] 2024-09-14T12:20:19.802 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_upload_size_below_minimum PASSED [ 46%] 2024-09-14T12:20:23.933 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_upload_size_rgw_chunk_size_bug PASSED [ 47%] 2024-09-14T12:20:25.878 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_empty_conditions PASSED [ 47%] 2024-09-14T12:20:28.014 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests_boto3/functional/test_s3.py::test_get_object_ifmatch_good PASSED [ 47%] 2024-09-14T12:20:30.153 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests_boto3/functional/test_s3.py::test_get_object_ifmatch_failed PASSED [ 47%] 2024-09-14T12:20:32.334 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests_boto3/functional/test_s3.py::test_get_object_ifnonematch_good PASSED [ 47%] 2024-09-14T12:20:34.522 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests_boto3/functional/test_s3.py::test_get_object_ifnonematch_failed PASSED [ 47%] 2024-09-14T12:20:36.702 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests_boto3/functional/test_s3.py::test_get_object_ifmodifiedsince_good PASSED [ 47%] 2024-09-14T12:20:39.942 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests_boto3/functional/test_s3.py::test_get_object_ifmodifiedsince_failed PASSED [ 47%] 2024-09-14T12:20:42.036 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests_boto3/functional/test_s3.py::test_get_object_ifunmodifiedsince_good PASSED [ 48%] 2024-09-14T12:20:44.189 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests_boto3/functional/test_s3.py::test_get_object_ifunmodifiedsince_failed PASSED [ 48%] 2024-09-14T12:20:46.477 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests_boto3/functional/test_s3.py::test_put_object_ifmatch_good PASSED [ 48%] 2024-09-14T12:20:48.841 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests_boto3/functional/test_s3.py::test_put_object_ifmatch_failed PASSED [ 48%] 2024-09-14T12:20:51.170 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests_boto3/functional/test_s3.py::test_put_object_ifmatch_overwrite_existed_good PASSED [ 48%] 2024-09-14T12:20:53.326 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests_boto3/functional/test_s3.py::test_put_object_ifmatch_nonexisted_failed PASSED [ 48%] 2024-09-14T12:20:55.662 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests_boto3/functional/test_s3.py::test_put_object_ifnonmatch_good PASSED [ 48%] 2024-09-14T12:20:58.078 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests_boto3/functional/test_s3.py::test_put_object_ifnonmatch_failed PASSED [ 49%] 2024-09-14T12:21:00.221 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests_boto3/functional/test_s3.py::test_put_object_ifnonmatch_nonexisted_good PASSED [ 49%] 2024-09-14T12:21:02.582 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests_boto3/functional/test_s3.py::test_put_object_ifnonmatch_overwrite_existed_failed PASSED [ 49%] 2024-09-14T12:21:04.694 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests_boto3/functional/test_s3.py::test_object_raw_get PASSED [ 49%] 2024-09-14T12:21:06.717 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests_boto3/functional/test_s3.py::test_object_raw_get_bucket_gone PASSED [ 49%] 2024-09-14T12:21:08.765 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests_boto3/functional/test_s3.py::test_object_delete_key_bucket_gone PASSED [ 49%] 2024-09-14T12:21:10.946 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests_boto3/functional/test_s3.py::test_object_raw_get_object_gone PASSED [ 49%] 2024-09-14T12:21:12.838 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_head PASSED [ 50%] 2024-09-14T12:21:14.142 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_head_notexist PASSED [ 50%] 2024-09-14T12:21:16.898 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_head_extended PASSED [ 50%] 2024-09-14T12:21:19.014 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests_boto3/functional/test_s3.py::test_object_raw_get_bucket_acl PASSED [ 50%] 2024-09-14T12:21:21.069 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests_boto3/functional/test_s3.py::test_object_raw_get_object_acl PASSED [ 50%] 2024-09-14T12:21:26.190 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests_boto3/functional/test_s3.py::test_object_put_acl_mtime PASSED [ 50%] 2024-09-14T12:21:28.350 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests_boto3/functional/test_s3.py::test_object_raw_authenticated PASSED [ 50%] 2024-09-14T12:21:30.469 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests_boto3/functional/test_s3.py::test_object_raw_response_headers PASSED [ 50%] 2024-09-14T12:21:32.553 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests_boto3/functional/test_s3.py::test_object_raw_authenticated_bucket_acl PASSED [ 51%] 2024-09-14T12:21:34.718 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests_boto3/functional/test_s3.py::test_object_raw_authenticated_object_acl PASSED [ 51%] 2024-09-14T12:21:36.661 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests_boto3/functional/test_s3.py::test_object_raw_authenticated_bucket_gone PASSED [ 51%] 2024-09-14T12:21:38.821 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests_boto3/functional/test_s3.py::test_object_raw_authenticated_object_gone PASSED [ 51%] 2024-09-14T12:21:41.118 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests_boto3/functional/test_s3.py::test_object_raw_get_x_amz_expires_not_expired PASSED [ 51%] 2024-09-14T12:21:43.397 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests_boto3/functional/test_s3.py::test_object_raw_get_x_amz_expires_not_expired_tenant PASSED [ 51%] 2024-09-14T12:21:45.482 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests_boto3/functional/test_s3.py::test_object_raw_get_x_amz_expires_out_range_zero PASSED [ 51%] 2024-09-14T12:21:47.589 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests_boto3/functional/test_s3.py::test_object_raw_get_x_amz_expires_out_max_range PASSED [ 52%] 2024-09-14T12:21:49.710 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests_boto3/functional/test_s3.py::test_object_raw_get_x_amz_expires_out_positive_range PASSED [ 52%] 2024-09-14T12:21:51.922 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests_boto3/functional/test_s3.py::test_object_anon_put PASSED [ 52%] 2024-09-14T12:21:54.181 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests_boto3/functional/test_s3.py::test_object_anon_put_write_access PASSED [ 52%] 2024-09-14T12:21:55.957 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests_boto3/functional/test_s3.py::test_object_put_authenticated PASSED [ 52%] 2024-09-14T12:21:58.170 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests_boto3/functional/test_s3.py::test_object_presigned_put_object_with_acl PASSED [ 52%] 2024-09-14T12:22:00.406 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests_boto3/functional/test_s3.py::test_object_presigned_put_object_with_acl_tenant PASSED [ 52%] 2024-09-14T12:22:02.582 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests_boto3/functional/test_s3.py::test_object_raw_put_authenticated_expired PASSED [ 52%] 2024-09-14T12:22:03.741 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_create_naming_bad_starts_nonalpha PASSED [ 53%] 2024-09-14T12:22:04.873 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_create_naming_bad_short_one PASSED [ 53%] 2024-09-14T12:22:06.045 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_create_naming_bad_short_two PASSED [ 53%] 2024-09-14T12:22:07.849 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_create_naming_good_long_60 PASSED [ 53%] 2024-09-14T12:22:09.590 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_create_naming_good_long_61 PASSED [ 53%] 2024-09-14T12:22:11.294 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_create_naming_good_long_62 PASSED [ 53%] 2024-09-14T12:22:12.994 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_create_naming_good_long_63 PASSED [ 53%] 2024-09-14T12:22:14.869 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_long_name PASSED [ 54%] 2024-09-14T12:22:16.042 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_create_naming_bad_ip PASSED [ 54%] 2024-09-14T12:22:17.209 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_create_naming_dns_underscore PASSED [ 54%] 2024-09-14T12:22:18.962 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_create_naming_dns_long PASSED [ 54%] 2024-09-14T12:22:20.110 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_create_naming_dns_dash_at_end PASSED [ 54%] 2024-09-14T12:22:21.254 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_create_naming_dns_dot_dot PASSED [ 54%] 2024-09-14T12:22:22.398 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_create_naming_dns_dot_dash PASSED [ 54%] 2024-09-14T12:22:23.546 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_create_naming_dns_dash_dot PASSED [ 54%] 2024-09-14T12:22:25.486 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_create_exists PASSED [ 55%] 2024-09-14T12:22:27.306 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_get_location PASSED [ 55%] 2024-09-14T12:22:29.233 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_create_exists_nonowner PASSED [ 55%] 2024-09-14T12:22:31.013 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_recreate_overwrite_acl PASSED [ 55%] 2024-09-14T12:22:32.961 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_recreate_new_acl PASSED [ 55%] 2024-09-14T12:22:34.873 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_acl_default PASSED [ 55%] 2024-09-14T12:22:36.666 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_acl_canned_during_create PASSED [ 55%] 2024-09-14T12:22:38.653 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_acl_canned PASSED [ 56%] 2024-09-14T12:22:40.410 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_acl_canned_publicreadwrite PASSED [ 56%] 2024-09-14T12:22:42.174 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_acl_canned_authenticatedread PASSED [ 56%] 2024-09-14T12:22:44.386 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests_boto3/functional/test_s3.py::test_object_acl_default PASSED [ 56%] 2024-09-14T12:22:46.546 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests_boto3/functional/test_s3.py::test_object_acl_canned_during_create PASSED [ 56%] 2024-09-14T12:22:48.901 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests_boto3/functional/test_s3.py::test_object_acl_canned PASSED [ 56%] 2024-09-14T12:22:51.049 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests_boto3/functional/test_s3.py::test_object_acl_canned_publicreadwrite PASSED [ 56%] 2024-09-14T12:22:53.249 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests_boto3/functional/test_s3.py::test_object_acl_canned_authenticatedread PASSED [ 56%] 2024-09-14T12:22:55.565 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests_boto3/functional/test_s3.py::test_object_acl_canned_bucketownerread PASSED [ 57%] 2024-09-14T12:22:57.873 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests_boto3/functional/test_s3.py::test_object_acl_canned_bucketownerfullcontrol PASSED [ 57%] 2024-09-14T12:23:00.262 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests_boto3/functional/test_s3.py::test_object_acl_full_control_verify_owner PASSED [ 57%] 2024-09-14T12:23:02.690 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests_boto3/functional/test_s3.py::test_object_acl_full_control_verify_attributes PASSED [ 57%] 2024-09-14T12:23:04.593 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_acl_canned_private_to_private PASSED [ 57%] 2024-09-14T12:23:06.973 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests_boto3/functional/test_s3.py::test_object_acl PASSED [ 57%] 2024-09-14T12:23:09.306 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests_boto3/functional/test_s3.py::test_object_acl_write PASSED [ 57%] 2024-09-14T12:23:11.786 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests_boto3/functional/test_s3.py::test_object_acl_writeacp PASSED [ 58%] 2024-09-14T12:23:14.105 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests_boto3/functional/test_s3.py::test_object_acl_read PASSED [ 58%] 2024-09-14T12:23:16.469 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests_boto3/functional/test_s3.py::test_object_acl_readacp PASSED [ 58%] 2024-09-14T12:23:19.737 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_acl_grant_userid_fullcontrol PASSED [ 58%] 2024-09-14T12:23:22.625 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_acl_grant_userid_read PASSED [ 58%] 2024-09-14T12:23:25.494 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_acl_grant_userid_readacp PASSED [ 58%] 2024-09-14T12:23:28.514 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_acl_grant_userid_write PASSED [ 58%] 2024-09-14T12:23:31.457 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_acl_grant_userid_writeacp PASSED [ 58%] 2024-09-14T12:23:33.441 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_acl_grant_nonexist_user PASSED [ 59%] 2024-09-14T12:23:35.634 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests_boto3/functional/test_s3.py::test_object_header_acl_grants PASSED [ 59%] 2024-09-14T12:23:37.825 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_header_acl_grants PASSED [ 59%] 2024-09-14T12:23:40.058 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_acl_grant_email PASSED [ 59%] 2024-09-14T12:23:42.154 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_acl_grant_email_not_exist PASSED [ 59%] 2024-09-14T12:23:44.577 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_acl_revoke_all PASSED [ 59%] 2024-09-14T12:23:47.765 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests_boto3/functional/test_s3.py::test_access_bucket_private_object_private PASSED [ 59%] 2024-09-14T12:23:50.953 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests_boto3/functional/test_s3.py::test_access_bucket_private_objectv2_private PASSED [ 60%] 2024-09-14T12:23:54.098 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests_boto3/functional/test_s3.py::test_access_bucket_private_object_publicread PASSED [ 60%] 2024-09-14T12:23:57.310 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests_boto3/functional/test_s3.py::test_access_bucket_private_objectv2_publicread PASSED [ 60%] 2024-09-14T12:24:00.437 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests_boto3/functional/test_s3.py::test_access_bucket_private_object_publicreadwrite PASSED [ 60%] 2024-09-14T12:24:03.673 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests_boto3/functional/test_s3.py::test_access_bucket_private_objectv2_publicreadwrite PASSED [ 60%] 2024-09-14T12:24:06.973 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests_boto3/functional/test_s3.py::test_access_bucket_publicread_object_private PASSED [ 60%] 2024-09-14T12:24:10.109 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests_boto3/functional/test_s3.py::test_access_bucket_publicread_object_publicread PASSED [ 60%] 2024-09-14T12:24:13.302 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests_boto3/functional/test_s3.py::test_access_bucket_publicread_object_publicreadwrite PASSED [ 60%] 2024-09-14T12:24:16.609 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests_boto3/functional/test_s3.py::test_access_bucket_publicreadwrite_object_private PASSED [ 61%] 2024-09-14T12:24:19.714 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests_boto3/functional/test_s3.py::test_access_bucket_publicreadwrite_object_publicread PASSED [ 61%] 2024-09-14T12:24:22.817 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests_boto3/functional/test_s3.py::test_access_bucket_publicreadwrite_object_publicreadwrite PASSED [ 61%] 2024-09-14T12:24:27.337 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests_boto3/functional/test_s3.py::test_buckets_create_then_list PASSED [ 61%] 2024-09-14T12:24:31.674 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests_boto3/functional/test_s3.py::test_buckets_list_ctime PASSED [ 61%] 2024-09-14T12:24:32.813 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests_boto3/functional/test_s3.py::test_list_buckets_anonymous PASSED [ 61%] 2024-09-14T12:24:33.965 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests_boto3/functional/test_s3.py::test_list_buckets_invalid_auth PASSED [ 61%] 2024-09-14T12:24:35.133 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests_boto3/functional/test_s3.py::test_list_buckets_bad_auth PASSED [ 62%] 2024-09-14T12:24:37.226 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_create_naming_good_starts_alpha PASSED [ 62%] 2024-09-14T12:24:39.273 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_create_naming_good_starts_digit PASSED [ 62%] 2024-09-14T12:24:41.025 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_create_naming_good_contains_period PASSED [ 62%] 2024-09-14T12:24:42.722 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_create_naming_good_contains_hyphen PASSED [ 62%] 2024-09-14T12:24:45.438 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_recreate_not_overriding PASSED [ 62%] 2024-09-14T12:24:51.377 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_create_special_key_names PASSED [ 62%] 2024-09-14T12:24:54.173 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_special_prefix PASSED [ 63%] 2024-09-14T12:24:56.625 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests_boto3/functional/test_s3.py::test_object_copy_zero_size PASSED [ 63%] 2024-09-14T12:25:05.593 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests_boto3/functional/test_s3.py::test_object_copy_16m PASSED [ 63%] 2024-09-14T12:25:08.013 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests_boto3/functional/test_s3.py::test_object_copy_same_bucket PASSED [ 63%] 2024-09-14T12:25:10.393 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests_boto3/functional/test_s3.py::test_object_copy_verify_contenttype PASSED [ 63%] 2024-09-14T12:25:12.637 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests_boto3/functional/test_s3.py::test_object_copy_to_itself PASSED [ 63%] 2024-09-14T12:25:14.925 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests_boto3/functional/test_s3.py::test_object_copy_to_itself_with_metadata PASSED [ 63%] 2024-09-14T12:25:18.093 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests_boto3/functional/test_s3.py::test_object_copy_diff_bucket PASSED [ 63%] 2024-09-14T12:25:20.817 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests_boto3/functional/test_s3.py::test_object_copy_not_owned_bucket PASSED [ 64%] 2024-09-14T12:25:23.853 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests_boto3/functional/test_s3.py::test_object_copy_not_owned_object_bucket PASSED [ 64%] 2024-09-14T12:25:26.613 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests_boto3/functional/test_s3.py::test_object_copy_canned_acl PASSED [ 64%] 2024-09-14T12:25:30.913 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests_boto3/functional/test_s3.py::test_object_copy_retaining_metadata PASSED [ 64%] 2024-09-14T12:25:35.062 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests_boto3/functional/test_s3.py::test_object_copy_replacing_metadata PASSED [ 64%] 2024-09-14T12:25:36.977 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests_boto3/functional/test_s3.py::test_object_copy_bucket_not_found PASSED [ 64%] 2024-09-14T12:25:38.857 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests_boto3/functional/test_s3.py::test_object_copy_key_not_found PASSED [ 64%] 2024-09-14T12:25:45.145 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests_boto3/functional/test_s3.py::test_object_copy_versioned_bucket PASSED [ 65%] 2024-09-14T12:25:47.917 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests_boto3/functional/test_s3.py::test_object_copy_versioned_url_encoding PASSED [ 65%] 2024-09-14T12:26:31.617 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests_boto3/functional/test_s3.py::test_object_copy_versioning_multipart_upload PASSED [ 65%] 2024-09-14T12:26:33.773 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests_boto3/functional/test_s3.py::test_multipart_upload_empty PASSED [ 65%] 2024-09-14T12:26:36.493 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests_boto3/functional/test_s3.py::test_multipart_upload_small PASSED [ 65%] 2024-09-14T12:26:44.017 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests_boto3/functional/test_s3.py::test_multipart_copy_small PASSED [ 65%] 2024-09-14T12:26:46.449 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests_boto3/functional/test_s3.py::test_multipart_copy_invalid_range PASSED [ 65%] 2024-09-14T12:26:50.509 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests_boto3/functional/test_s3.py::test_multipart_copy_without_range PASSED [ 65%] 2024-09-14T12:27:13.953 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests_boto3/functional/test_s3.py::test_multipart_copy_special_names PASSED [ 66%] 2024-09-14T12:27:53.565 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests_boto3/functional/test_s3.py::test_multipart_upload PASSED [ 66%] 2024-09-14T12:28:42.162 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests_boto3/functional/test_s3.py::test_multipart_copy_versioned PASSED [ 66%] 2024-09-14T12:32:11.177 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests_boto3/functional/test_s3.py::test_multipart_upload_resend_part PASSED [ 66%] 2024-09-14T12:32:37.609 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests_boto3/functional/test_s3.py::test_multipart_upload_multiple_sizes PASSED [ 66%] 2024-09-14T12:33:16.153 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests_boto3/functional/test_s3.py::test_multipart_copy_multiple_sizes PASSED [ 66%] 2024-09-14T12:33:19.709 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests_boto3/functional/test_s3.py::test_multipart_upload_size_too_small PASSED [ 66%] 2024-09-14T12:33:32.269 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests_boto3/functional/test_s3.py::test_multipart_upload_contents PASSED [ 67%] 2024-09-14T12:33:43.313 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests_boto3/functional/test_s3.py::test_multipart_upload_overwrite_existing_object PASSED [ 67%] 2024-09-14T12:33:50.605 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests_boto3/functional/test_s3.py::test_abort_multipart_upload PASSED [ 67%] 2024-09-14T12:33:52.753 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests_boto3/functional/test_s3.py::test_abort_multipart_upload_not_found PASSED [ 67%] 2024-09-14T12:34:02.925 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests_boto3/functional/test_s3.py::test_list_multipart_upload PASSED [ 67%] 2024-09-14T12:34:05.589 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests_boto3/functional/test_s3.py::test_list_multipart_upload_owner PASSED [ 67%] 2024-09-14T12:34:07.861 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests_boto3/functional/test_s3.py::test_multipart_upload_missing_part PASSED [ 67%] 2024-09-14T12:34:10.085 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests_boto3/functional/test_s3.py::test_multipart_upload_incorrect_etag PASSED [ 67%] 2024-09-14T12:34:39.736 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests_boto3/functional/test_s3.py::test_multipart_get_part PASSED [ 68%] 2024-09-14T12:34:46.313 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests_boto3/functional/test_s3.py::test_multipart_single_get_part PASSED [ 68%] 2024-09-14T12:34:48.592 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests_boto3/functional/test_s3.py::test_non_multipart_get_part PASSED [ 68%] 2024-09-14T12:34:50.682 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests_boto3/functional/test_s3.py::test_100_continue PASSED [ 68%] 2024-09-14T12:34:53.008 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests_boto3/functional/test_s3.py::test_set_cors PASSED [ 68%] 2024-09-14T12:35:03.325 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests_boto3/functional/test_s3.py::test_cors_origin_response PASSED [ 68%] 2024-09-14T12:35:08.632 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests_boto3/functional/test_s3.py::test_cors_origin_wildcard PASSED [ 68%] 2024-09-14T12:35:13.732 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests_boto3/functional/test_s3.py::test_cors_header_option PASSED [ 69%] 2024-09-14T12:35:16.029 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests_boto3/functional/test_s3.py::test_cors_presigned_get_object PASSED [ 69%] 2024-09-14T12:35:18.408 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests_boto3/functional/test_s3.py::test_cors_presigned_get_object_tenant PASSED [ 69%] 2024-09-14T12:35:20.665 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests_boto3/functional/test_s3.py::test_cors_presigned_put_object PASSED [ 69%] 2024-09-14T12:35:22.968 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests_boto3/functional/test_s3.py::test_cors_presigned_put_object_with_acl PASSED [ 69%] 2024-09-14T12:35:25.269 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests_boto3/functional/test_s3.py::test_cors_presigned_put_object_tenant PASSED [ 69%] 2024-09-14T12:35:27.633 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests_boto3/functional/test_s3.py::test_cors_presigned_put_object_tenant_with_acl PASSED [ 69%] 2024-09-14T12:35:29.912 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests_boto3/functional/test_s3.py::test_set_bucket_tagging PASSED [ 69%] 2024-09-14T12:35:33.872 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests_boto3/functional/test_s3.py::test_atomic_read_1mb PASSED [ 70%] 2024-09-14T12:35:41.268 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests_boto3/functional/test_s3.py::test_atomic_read_4mb PASSED [ 70%] 2024-09-14T12:35:53.456 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests_boto3/functional/test_s3.py::test_atomic_read_8mb PASSED [ 70%] 2024-09-14T12:35:58.560 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests_boto3/functional/test_s3.py::test_atomic_write_1mb PASSED [ 70%] 2024-09-14T12:36:08.201 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests_boto3/functional/test_s3.py::test_atomic_write_4mb PASSED [ 70%] 2024-09-14T12:36:23.581 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests_boto3/functional/test_s3.py::test_atomic_write_8mb PASSED [ 70%] 2024-09-14T12:36:28.024 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests_boto3/functional/test_s3.py::test_atomic_dual_write_1mb PASSED [ 70%] 2024-09-14T12:36:36.824 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests_boto3/functional/test_s3.py::test_atomic_dual_write_4mb PASSED [ 71%] 2024-09-14T12:36:52.244 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests_boto3/functional/test_s3.py::test_atomic_dual_write_8mb PASSED [ 71%] 2024-09-14T12:36:56.781 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests_boto3/functional/test_s3.py::test_atomic_conditional_write_1mb PASSED [ 71%] 2024-09-14T12:36:59.232 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests_boto3/functional/test_s3.py::test_atomic_multipart_upload_write PASSED [ 71%] 2024-09-14T12:37:02.692 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests_boto3/functional/test_s3.py::test_multipart_resend_first_finishes_last PASSED [ 71%] 2024-09-14T12:37:04.832 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests_boto3/functional/test_s3.py::test_ranged_request_response_code PASSED [ 71%] 2024-09-14T12:37:15.080 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests_boto3/functional/test_s3.py::test_ranged_big_request_response_code PASSED [ 71%] 2024-09-14T12:37:17.268 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests_boto3/functional/test_s3.py::test_ranged_request_skip_leading_bytes_response_code PASSED [ 71%] 2024-09-14T12:37:19.496 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests_boto3/functional/test_s3.py::test_ranged_request_return_trailing_bytes_response_code PASSED [ 72%] 2024-09-14T12:37:21.656 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests_boto3/functional/test_s3.py::test_ranged_request_invalid_range PASSED [ 72%] 2024-09-14T12:37:23.844 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests_boto3/functional/test_s3.py::test_ranged_request_empty_object PASSED [ 72%] 2024-09-14T12:37:26.908 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests_boto3/functional/test_s3.py::test_versioning_bucket_create_suspend PASSED [ 72%] 2024-09-14T12:37:50.661 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests_boto3/functional/test_s3.py::test_versioning_obj_create_read_remove PASSED [ 72%] 2024-09-14T12:37:54.324 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests_boto3/functional/test_s3.py::test_versioning_obj_create_read_remove_head PASSED [ 72%] 2024-09-14T12:37:57.072 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests_boto3/functional/test_s3.py::test_versioning_obj_plain_null_version_removal PASSED [ 72%] 2024-09-14T12:38:00.400 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests_boto3/functional/test_s3.py::test_versioning_obj_plain_null_version_overwrite PASSED [ 73%] 2024-09-14T12:38:03.772 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests_boto3/functional/test_s3.py::test_versioning_obj_plain_null_version_overwrite_suspended PASSED [ 73%] 2024-09-14T12:38:14.600 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests_boto3/functional/test_s3.py::test_versioning_obj_suspend_versions PASSED [ 73%] 2024-09-14T12:38:18.140 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests_boto3/functional/test_s3.py::test_versioning_obj_suspended_copy PASSED [ 73%] 2024-09-14T12:38:30.164 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests_boto3/functional/test_s3.py::test_versioning_obj_create_versions_remove_all PASSED [ 73%] 2024-09-14T12:39:12.256 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests_boto3/functional/test_s3.py::test_versioning_obj_create_versions_remove_special_names PASSED [ 73%] 2024-09-14T12:40:11.604 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests_boto3/functional/test_s3.py::test_versioning_obj_create_overwrite_multipart PASSED [ 73%] 2024-09-14T12:40:17.684 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests_boto3/functional/test_s3.py::test_versioning_obj_list_marker PASSED [ 73%] 2024-09-14T12:40:23.740 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests_boto3/functional/test_s3.py::test_versioning_copy_obj_version PASSED [ 74%] 2024-09-14T12:40:26.772 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests_boto3/functional/test_s3.py::test_versioning_multi_object_delete PASSED [ 74%] 2024-09-14T12:40:30.020 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests_boto3/functional/test_s3.py::test_versioning_multi_object_delete_with_marker PASSED [ 74%] 2024-09-14T12:40:32.504 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests_boto3/functional/test_s3.py::test_versioning_multi_object_delete_with_marker_create PASSED [ 74%] 2024-09-14T12:40:36.100 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests_boto3/functional/test_s3.py::test_versioned_object_acl PASSED [ 74%] 2024-09-14T12:40:39.500 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests_boto3/functional/test_s3.py::test_versioned_object_acl_no_version_specified PASSED [ 74%] 2024-09-14T12:40:45.248 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests_boto3/functional/test_s3.py::test_versioned_concurrent_object_create_and_remove PASSED [ 74%] 2024-09-14T12:40:47.408 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests_boto3/functional/test_s3.py::test_lifecycle_set PASSED [ 75%] 2024-09-14T12:40:49.484 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests_boto3/functional/test_s3.py::test_lifecycle_get PASSED [ 75%] 2024-09-14T12:40:51.636 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests_boto3/functional/test_s3.py::test_lifecycle_get_no_id PASSED [ 75%] 2024-09-14T12:40:53.516 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests_boto3/functional/test_s3.py::test_lifecycle_id_too_long PASSED [ 75%] 2024-09-14T12:40:55.395 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests_boto3/functional/test_s3.py::test_lifecycle_same_id PASSED [ 75%] 2024-09-14T12:40:57.520 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests_boto3/functional/test_s3.py::test_lifecycle_invalid_status PASSED [ 75%] 2024-09-14T12:40:59.460 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests_boto3/functional/test_s3.py::test_lifecycle_set_date PASSED [ 75%] 2024-09-14T12:41:01.396 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests_boto3/functional/test_s3.py::test_lifecycle_set_invalid_date PASSED [ 76%] 2024-09-14T12:41:03.671 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests_boto3/functional/test_s3.py::test_lifecycle_set_noncurrent PASSED [ 76%] 2024-09-14T12:41:05.519 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests_boto3/functional/test_s3.py::test_lifecycle_set_deletemarker PASSED [ 76%] 2024-09-14T12:41:07.467 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests_boto3/functional/test_s3.py::test_lifecycle_set_filter PASSED [ 76%] 2024-09-14T12:41:09.367 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests_boto3/functional/test_s3.py::test_lifecycle_set_empty_filter PASSED [ 76%] 2024-09-14T12:41:11.348 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests_boto3/functional/test_s3.py::test_lifecycle_set_multipart PASSED [ 76%] 2024-09-14T12:41:13.256 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests_boto3/functional/test_s3.py::test_lifecycle_transition_set_invalid_date PASSED [ 76%] 2024-09-14T12:41:15.428 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests_boto3/functional/test_s3.py::test_encrypted_transfer_1b PASSED [ 76%] 2024-09-14T12:41:17.628 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests_boto3/functional/test_s3.py::test_encrypted_transfer_1kb PASSED [ 77%] 2024-09-14T12:41:20.644 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests_boto3/functional/test_s3.py::test_encrypted_transfer_1MB PASSED [ 77%] 2024-09-14T12:41:22.872 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests_boto3/functional/test_s3.py::test_encrypted_transfer_13b PASSED [ 77%] 2024-09-14T12:41:25.100 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests_boto3/functional/test_s3.py::test_encryption_sse_c_method_head PASSED [ 77%] 2024-09-14T12:41:27.320 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests_boto3/functional/test_s3.py::test_encryption_sse_c_present PASSED [ 77%] 2024-09-14T12:41:29.440 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests_boto3/functional/test_s3.py::test_encryption_sse_c_other_key PASSED [ 77%] 2024-09-14T12:41:31.356 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests_boto3/functional/test_s3.py::test_encryption_sse_c_invalid_md5 PASSED [ 77%] 2024-09-14T12:41:33.399 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests_boto3/functional/test_s3.py::test_encryption_sse_c_no_md5 PASSED [ 78%] 2024-09-14T12:41:35.332 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests_boto3/functional/test_s3.py::test_encryption_sse_c_no_key PASSED [ 78%] 2024-09-14T12:41:37.281 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests_boto3/functional/test_s3.py::test_encryption_key_no_sse_c PASSED [ 78%] 2024-09-14T12:42:47.687 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests_boto3/functional/test_s3.py::test_encryption_sse_c_multipart_upload PASSED [ 78%] 2024-09-14T12:43:56.500 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests_boto3/functional/test_s3.py::test_encryption_sse_c_unaligned_multipart_upload PASSED [ 78%] 2024-09-14T12:44:17.232 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests_boto3/functional/test_s3.py::test_encryption_sse_c_multipart_bad_download PASSED [ 78%] 2024-09-14T12:44:19.471 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests_boto3/functional/test_s3.py::test_encryption_sse_c_post_object_authenticated_request PASSED [ 78%] 2024-09-14T12:45:22.431 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests_boto3/functional/test_s3.py::test_encryption_sse_c_enforced_with_bucket_policy PASSED [ 78%] 2024-09-14T12:46:25.863 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests_boto3/functional/test_s3.py::test_encryption_sse_c_deny_algo_with_bucket_policy PASSED [ 79%] 2024-09-14T12:46:28.142 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests_boto3/functional/test_s3.py::test_sse_kms_method_head PASSED [ 79%] 2024-09-14T12:46:30.315 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests_boto3/functional/test_s3.py::test_sse_kms_present PASSED [ 79%] 2024-09-14T12:46:32.299 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests_boto3/functional/test_s3.py::test_sse_kms_no_key PASSED [ 79%] 2024-09-14T12:46:34.191 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests_boto3/functional/test_s3.py::test_sse_kms_not_declared PASSED [ 79%] 2024-09-14T12:47:23.771 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests_boto3/functional/test_s3.py::test_sse_kms_multipart_upload PASSED [ 79%] 2024-09-14T12:47:42.434 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests_boto3/functional/test_s3.py::test_sse_kms_multipart_invalid_chunks_1 PASSED [ 79%] 2024-09-14T12:48:01.435 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests_boto3/functional/test_s3.py::test_sse_kms_multipart_invalid_chunks_2 PASSED [ 80%] 2024-09-14T12:48:03.607 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests_boto3/functional/test_s3.py::test_sse_kms_post_object_authenticated_request PASSED [ 80%] 2024-09-14T12:48:05.859 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests_boto3/functional/test_s3.py::test_sse_kms_transfer_1b PASSED [ 80%] 2024-09-14T12:48:08.010 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests_boto3/functional/test_s3.py::test_sse_kms_transfer_1kb PASSED [ 80%] 2024-09-14T12:48:11.019 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests_boto3/functional/test_s3.py::test_sse_kms_transfer_1MB PASSED [ 80%] 2024-09-14T12:48:13.171 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests_boto3/functional/test_s3.py::test_sse_kms_transfer_13b PASSED [ 80%] 2024-09-14T12:48:15.339 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests_boto3/functional/test_s3.py::test_sse_kms_read_declare PASSED [ 80%] 2024-09-14T12:48:17.642 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_policy PASSED [ 80%] 2024-09-14T12:48:20.054 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests_boto3/functional/test_s3.py::test_bucketv2_policy PASSED [ 81%] 2024-09-14T12:48:22.606 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_policy_acl PASSED [ 81%] 2024-09-14T12:48:25.274 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests_boto3/functional/test_s3.py::test_bucketv2_policy_acl PASSED [ 81%] 2024-09-14T12:48:27.551 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_policy_different_tenant PASSED [ 81%] 2024-09-14T12:48:29.838 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_policy_tenanted_bucket PASSED [ 81%] 2024-09-14T12:48:33.462 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_policy_another_bucket PASSED [ 81%] 2024-09-14T12:48:37.158 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests_boto3/functional/test_s3.py::test_bucketv2_policy_another_bucket PASSED [ 81%] 2024-09-14T12:48:42.591 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests_boto3/functional/test_s3.py::test_get_obj_tagging PASSED [ 82%] 2024-09-14T12:48:47.718 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests_boto3/functional/test_s3.py::test_get_obj_head_tagging PASSED [ 82%] 2024-09-14T12:48:53.174 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests_boto3/functional/test_s3.py::test_put_max_tags PASSED [ 82%] 2024-09-14T12:48:58.979 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests_boto3/functional/test_s3.py::test_put_excess_tags PASSED [ 82%] 2024-09-14T12:49:04.903 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests_boto3/functional/test_s3.py::test_put_max_kvsize_tags PASSED [ 82%] 2024-09-14T12:49:10.755 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests_boto3/functional/test_s3.py::test_put_excess_key_tags PASSED [ 82%] 2024-09-14T12:49:16.110 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests_boto3/functional/test_s3.py::test_put_excess_val_tags PASSED [ 82%] 2024-09-14T12:49:21.906 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests_boto3/functional/test_s3.py::test_put_modify_tags PASSED [ 82%] 2024-09-14T12:49:27.439 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests_boto3/functional/test_s3.py::test_put_delete_tags PASSED [ 83%] 2024-09-14T12:49:29.615 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_tags_anonymous_request PASSED [ 83%] 2024-09-14T12:49:31.902 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_tags_authenticated_request PASSED [ 83%] 2024-09-14T12:49:34.099 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests_boto3/functional/test_s3.py::test_put_obj_with_tags PASSED [ 83%] 2024-09-14T12:49:40.138 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests_boto3/functional/test_s3.py::test_get_tags_acl_public PASSED [ 83%] 2024-09-14T12:49:46.270 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests_boto3/functional/test_s3.py::test_put_tags_acl_public PASSED [ 83%] 2024-09-14T12:49:52.206 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests_boto3/functional/test_s3.py::test_delete_tags_obj_public PASSED [ 83%] 2024-09-14T12:49:56.974 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests_boto3/functional/test_s3.py::test_versioning_bucket_atomic_upload_return_version_id PASSED [ 84%] 2024-09-14T12:50:43.154 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests_boto3/functional/test_s3.py::test_versioning_bucket_multipart_upload_return_version_id PASSED [ 84%] 2024-09-14T12:50:46.362 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_policy_get_obj_existing_tag PASSED [ 84%] 2024-09-14T12:50:49.678 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_policy_get_obj_tagging_existing_tag PASSED [ 84%] 2024-09-14T12:50:52.890 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_policy_put_obj_tagging_existing_tag PASSED [ 84%] 2024-09-14T12:50:57.030 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_policy_put_obj_copy_source PASSED [ 84%] 2024-09-14T12:51:00.742 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_policy_put_obj_copy_source_meta PASSED [ 84%] 2024-09-14T12:51:03.202 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_policy_put_obj_acl PASSED [ 84%] 2024-09-14T12:51:06.778 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_policy_put_obj_grant PASSED [ 85%] 2024-09-14T12:51:08.706 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests_boto3/functional/test_s3.py::test_put_obj_enc_conflict_c_s3 PASSED [ 85%] 2024-09-14T12:51:10.574 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests_boto3/functional/test_s3.py::test_put_obj_enc_conflict_c_kms PASSED [ 85%] 2024-09-14T12:51:12.478 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests_boto3/functional/test_s3.py::test_put_obj_enc_conflict_s3_kms PASSED [ 85%] 2024-09-14T12:51:14.358 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests_boto3/functional/test_s3.py::test_put_obj_enc_conflict_bad_enc_kms PASSED [ 85%] 2024-09-14T12:51:16.621 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_policy_put_obj_kms_noenc PASSED [ 85%] 2024-09-14T12:51:18.710 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_policy_put_obj_kms_s3 PASSED [ 85%] 2024-09-14T12:51:21.798 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_policy_get_obj_acl_existing_tag PASSED [ 86%] 2024-09-14T12:51:23.870 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_put_obj_lock PASSED [ 86%] 2024-09-14T12:51:25.782 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_put_obj_lock_invalid_bucket PASSED [ 86%] 2024-09-14T12:51:27.634 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_put_obj_lock_with_days_and_years PASSED [ 86%] 2024-09-14T12:51:29.474 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_put_obj_lock_invalid_days PASSED [ 86%] 2024-09-14T12:51:31.286 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_put_obj_lock_invalid_years PASSED [ 86%] 2024-09-14T12:51:33.182 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_put_obj_lock_invalid_mode PASSED [ 86%] 2024-09-14T12:51:35.074 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_put_obj_lock_invalid_status PASSED [ 86%] 2024-09-14T12:51:36.822 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_suspend_versioning PASSED [ 87%] 2024-09-14T12:51:38.798 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_get_obj_lock PASSED [ 87%] 2024-09-14T12:51:40.566 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_get_obj_lock_invalid_bucket PASSED [ 87%] 2024-09-14T12:51:42.850 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_put_obj_retention PASSED [ 87%] 2024-09-14T12:51:44.938 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_put_obj_retention_invalid_bucket PASSED [ 87%] 2024-09-14T12:51:47.210 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_put_obj_retention_invalid_mode PASSED [ 87%] 2024-09-14T12:51:49.418 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_get_obj_retention PASSED [ 87%] 2024-09-14T12:51:51.590 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_get_obj_retention_iso8601 PASSED [ 88%] 2024-09-14T12:51:53.710 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_get_obj_retention_invalid_bucket PASSED [ 88%] 2024-09-14T12:51:56.218 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_put_obj_retention_versionid PASSED [ 88%] 2024-09-14T12:51:58.514 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_put_obj_retention_override_default_retention PASSED [ 88%] 2024-09-14T12:52:00.869 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_put_obj_retention_increase_period PASSED [ 88%] 2024-09-14T12:52:03.054 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_put_obj_retention_shorten_period PASSED [ 88%] 2024-09-14T12:52:05.390 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_put_obj_retention_shorten_period_bypass PASSED [ 88%] 2024-09-14T12:52:07.610 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_delete_object_with_retention PASSED [ 89%] 2024-09-14T12:52:10.150 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_delete_multipart_object_with_retention PASSED [ 89%] 2024-09-14T12:52:12.689 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_delete_object_with_retention_and_marker PASSED [ 89%] 2024-09-14T12:52:15.182 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_multi_delete_object_with_retention PASSED [ 89%] 2024-09-14T12:52:17.422 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_put_legal_hold PASSED [ 89%] 2024-09-14T12:52:19.509 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_put_legal_hold_invalid_bucket PASSED [ 89%] 2024-09-14T12:52:21.709 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_put_legal_hold_invalid_status PASSED [ 89%] 2024-09-14T12:52:24.222 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_get_legal_hold PASSED [ 89%] 2024-09-14T12:52:26.221 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_get_legal_hold_invalid_bucket PASSED [ 90%] 2024-09-14T12:52:28.545 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_delete_object_with_legal_hold_on PASSED [ 90%] 2024-09-14T12:52:31.150 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_delete_multipart_object_with_legal_hold_on PASSED [ 90%] 2024-09-14T12:52:33.253 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_delete_object_with_legal_hold_off PASSED [ 90%] 2024-09-14T12:52:35.674 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_get_obj_metadata PASSED [ 90%] 2024-09-14T12:52:37.821 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_uploading_obj PASSED [ 90%] 2024-09-14T12:52:49.526 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_changing_mode_from_governance_with_bypass PASSED [ 90%] 2024-09-14T12:52:51.669 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_changing_mode_from_governance_without_bypass PASSED [ 91%] 2024-09-14T12:53:02.353 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_changing_mode_from_compliance PASSED [ 91%] 2024-09-14T12:53:04.718 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests_boto3/functional/test_s3.py::test_copy_object_ifmatch_good PASSED [ 91%] 2024-09-14T12:53:07.006 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests_boto3/functional/test_s3.py::test_copy_object_ifnonematch_failed PASSED [ 91%] 2024-09-14T12:53:08.849 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests_boto3/functional/test_s3.py::test_get_bucket_policy_status PASSED [ 91%] 2024-09-14T12:53:10.882 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests_boto3/functional/test_s3.py::test_get_public_acl_bucket_policy_status PASSED [ 91%] 2024-09-14T12:53:12.934 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests_boto3/functional/test_s3.py::test_get_authpublic_acl_bucket_policy_status PASSED [ 91%] 2024-09-14T12:53:15.081 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests_boto3/functional/test_s3.py::test_get_publicpolicy_acl_bucket_policy_status PASSED [ 91%] 2024-09-14T12:53:17.150 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests_boto3/functional/test_s3.py::test_get_nonpublicpolicy_acl_bucket_policy_status PASSED [ 92%] 2024-09-14T12:53:19.202 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests_boto3/functional/test_s3.py::test_get_nonpublicpolicy_principal_bucket_policy_status PASSED [ 92%] 2024-09-14T12:53:21.209 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_policy_allow_notprincipal PASSED [ 92%] 2024-09-14T12:53:23.186 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests_boto3/functional/test_s3.py::test_get_undefined_public_block PASSED [ 92%] 2024-09-14T12:53:25.441 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests_boto3/functional/test_s3.py::test_get_public_block_deny_bucket_policy PASSED [ 92%] 2024-09-14T12:53:27.426 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests_boto3/functional/test_s3.py::test_put_public_block PASSED [ 92%] 2024-09-14T12:53:29.697 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests_boto3/functional/test_s3.py::test_block_public_put_bucket_acls PASSED [ 92%] 2024-09-14T12:53:31.921 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests_boto3/functional/test_s3.py::test_block_public_object_canned_acls PASSED [ 93%] 2024-09-14T12:53:33.933 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests_boto3/functional/test_s3.py::test_block_public_policy PASSED [ 93%] 2024-09-14T12:53:35.917 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests_boto3/functional/test_s3.py::test_block_public_policy_with_principal PASSED [ 93%] 2024-09-14T12:53:38.625 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests_boto3/functional/test_s3.py::test_ignore_public_acls PASSED [ 93%] 2024-09-14T12:54:04.297 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests_boto3/functional/test_s3.py::test_multipart_upload_on_a_bucket_with_policy PASSED [ 93%] 2024-09-14T12:54:06.281 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests_boto3/functional/test_s3.py::test_put_bucket_encryption_kms PASSED [ 93%] 2024-09-14T12:54:08.349 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests_boto3/functional/test_s3.py::test_get_bucket_encryption_kms PASSED [ 93%] 2024-09-14T12:54:10.493 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests_boto3/functional/test_s3.py::test_delete_bucket_encryption_kms PASSED [ 93%] 2024-09-14T12:54:12.933 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests_boto3/functional/test_s3.py::test_sse_kms_default_post_object_authenticated_request PASSED [ 94%] 2024-09-14T12:54:17.741 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests_boto3/functional/test_s3.py::test_get_object_torrent PASSED [ 94%] 2024-09-14T12:54:20.065 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests_boto3/functional/test_s3.py::test_object_checksum_sha256 PASSED [ 94%] 2024-09-14T12:54:23.545 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests_boto3/functional/test_s3.py::test_multipart_checksum_sha256 PASSED [ 94%] 2024-09-14T12:54:35.885 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests_boto3/functional/test_s3.py::test_multipart_checksum_3parts PASSED [ 94%] 2024-09-14T12:54:39.821 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_upload_checksum PASSED [ 94%] 2024-09-14T12:55:04.341 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests_boto3/functional/test_s3select.py::test_generate_where_clause PASSED [ 94%] 2024-09-14T12:55:27.301 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests_boto3/functional/test_s3select.py::test_generate_projection PASSED [ 95%] 2024-09-14T12:55:29.754 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests_boto3/functional/test_s3select.py::test_count_operation PASSED [ 95%] 2024-09-14T12:55:33.153 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests_boto3/functional/test_s3select.py::test_count_json_operation PASSED [ 95%] 2024-09-14T12:55:51.621 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests_boto3/functional/test_s3select.py::test_json_column_sum_min_max PASSED [ 95%] 2024-09-14T12:56:18.653 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests_boto3/functional/test_s3select.py::test_json_nullif_expressions PASSED [ 95%] 2024-09-14T12:56:25.729 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests_boto3/functional/test_s3select.py::test_column_sum_min_max PASSED [ 95%] 2024-09-14T12:56:30.417 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests_boto3/functional/test_s3select.py::test_nullif_expressions PASSED [ 95%] 2024-09-14T12:56:35.433 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests_boto3/functional/test_s3select.py::test_nulliftrue_expressions PASSED [ 95%] 2024-09-14T12:56:39.793 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests_boto3/functional/test_s3select.py::test_is_not_null_expressions PASSED [ 96%] 2024-09-14T12:56:42.313 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests_boto3/functional/test_s3select.py::test_lowerupper_expressions PASSED [ 96%] 2024-09-14T12:56:49.733 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests_boto3/functional/test_s3select.py::test_in_expressions PASSED [ 96%] 2024-09-14T12:56:58.109 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests_boto3/functional/test_s3select.py::test_true_false_in_expressions PASSED [ 96%] 2024-09-14T12:57:21.241 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests_boto3/functional/test_s3select.py::test_like_expressions PASSED [ 96%] 2024-09-14T12:57:28.281 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests_boto3/functional/test_s3select.py::test_truefalselike_expressions PASSED [ 96%] 2024-09-14T12:57:32.657 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests_boto3/functional/test_s3select.py::test_complex_expressions PASSED [ 96%] 2024-09-14T12:57:36.773 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests_boto3/functional/test_s3select.py::test_alias PASSED [ 97%] 2024-09-14T12:57:39.773 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests_boto3/functional/test_s3select.py::test_alias_cyclic_refernce PASSED [ 97%] 2024-09-14T12:57:54.953 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests_boto3/functional/test_s3select.py::test_datetime PASSED [ 97%] 2024-09-14T12:58:05.153 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests_boto3/functional/test_s3select.py::test_true_false_datetime PASSED [ 97%] 2024-09-14T12:58:08.769 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests_boto3/functional/test_s3select.py::test_csv_parser PASSED [ 97%] 2024-09-14T12:58:12.092 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests_boto3/functional/test_s3select.py::test_csv_definition PASSED [ 97%] 2024-09-14T12:58:22.224 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests_boto3/functional/test_s3select.py::test_schema_definition PASSED [ 97%] 2024-09-14T12:58:28.704 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests_boto3/functional/test_s3select.py::test_when_then_else_expressions PASSED [ 97%] 2024-09-14T12:58:36.501 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests_boto3/functional/test_s3select.py::test_coalesce_expressions PASSED [ 98%] 2024-09-14T12:58:40.792 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests_boto3/functional/test_s3select.py::test_cast_expressions PASSED [ 98%] 2024-09-14T12:58:41.772 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests_boto3/functional/test_s3select.py::test_version PASSED [ 98%] 2024-09-14T12:58:49.153 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests_boto3/functional/test_s3select.py::test_trim_expressions PASSED [ 98%] 2024-09-14T12:58:56.672 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests_boto3/functional/test_s3select.py::test_truefalse_trim_expressions PASSED [ 98%] 2024-09-14T12:59:08.625 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests_boto3/functional/test_s3select.py::test_escape_expressions PASSED [ 98%] 2024-09-14T12:59:15.528 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests_boto3/functional/test_s3select.py::test_case_value_expressions PASSED [ 98%] 2024-09-14T12:59:19.153 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests_boto3/functional/test_s3select.py::test_bool_cast_expressions PASSED [ 99%] 2024-09-14T13:00:12.120 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests_boto3/functional/test_s3select.py::test_progress_expressions PASSED [ 99%] 2024-09-14T13:00:13.104 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests_boto3/functional/test_s3select.py::test_output_serial_expressions PASSED [ 99%] 2024-09-14T13:00:15.627 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests_boto3/functional/test_sns.py::test_account_topic PASSED [ 99%] 2024-09-14T13:00:17.480 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests_boto3/functional/test_sns.py::test_cross_account_topic PASSED [ 99%] 2024-09-14T13:00:19.524 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests_boto3/functional/test_sns.py::test_account_topic_publish PASSED [ 99%] 2024-09-14T13:00:22.063 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests_boto3/functional/test_sns.py::test_cross_account_topic_publish PASSED [ 99%] 2024-09-14T13:00:22.107 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests_boto3/functional/test_utils.py::test_generate PASSED [100%] 2024-09-14T13:00:22.107 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-09-14T13:00:22.107 INFO:teuthology.orchestra.run.smithi138.stdout:=============================== warnings summary =============================== 2024-09-14T13:00:22.107 INFO:teuthology.orchestra.run.smithi138.stdout:.tox/py/lib/python3.10/site-packages/boto/plugin.py:40 2024-09-14T13:00:22.107 INFO:teuthology.orchestra.run.smithi138.stdout: /home/ubuntu/cephtest/s3-tests-client.0/.tox/py/lib/python3.10/site-packages/boto/plugin.py:40: DeprecationWarning: the imp module is deprecated in favour of importlib and slated for removal in Python 3.12; see the module's documentation for alternative uses 2024-09-14T13:00:22.107 INFO:teuthology.orchestra.run.smithi138.stdout: import imp 2024-09-14T13:00:22.108 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-09-14T13:00:22.108 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests/functional/test_headers.py:120 2024-09-14T13:00:22.108 INFO:teuthology.orchestra.run.smithi138.stdout: /home/ubuntu/cephtest/s3-tests-client.0/s3tests/functional/test_headers.py:120: SyntaxWarning: "is" with a literal. Did you mean "=="? 2024-09-14T13:00:22.108 INFO:teuthology.orchestra.run.smithi138.stdout: if boto_type is 'S3Connection': 2024-09-14T13:00:22.108 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-09-14T13:00:22.108 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests/functional/test_headers.py:124 2024-09-14T13:00:22.108 INFO:teuthology.orchestra.run.smithi138.stdout: /home/ubuntu/cephtest/s3-tests-client.0/s3tests/functional/test_headers.py:124: SyntaxWarning: "is" with a literal. Did you mean "=="? 2024-09-14T13:00:22.108 INFO:teuthology.orchestra.run.smithi138.stdout: elif boto_type is 'HTTPRequest': 2024-09-14T13:00:22.109 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-09-14T13:00:22.109 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests/functional/test_s3.py:359 2024-09-14T13:00:22.109 INFO:teuthology.orchestra.run.smithi138.stdout: /home/ubuntu/cephtest/s3-tests-client.0/s3tests/functional/test_s3.py:359: DeprecationWarning: invalid escape sequence '\W' 2024-09-14T13:00:22.109 INFO:teuthology.orchestra.run.smithi138.stdout: extra_sc = re.split('\W+', config['main']['storage_classes']) 2024-09-14T13:00:22.109 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-09-14T13:00:22.109 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests/functional/test_s3_website.py:176 2024-09-14T13:00:22.109 INFO:teuthology.orchestra.run.smithi138.stdout: /home/ubuntu/cephtest/s3-tests-client.0/s3tests/functional/test_s3_website.py:176: SyntaxWarning: "is" with a literal. Did you mean "=="? 2024-09-14T13:00:22.109 INFO:teuthology.orchestra.run.smithi138.stdout: if k is 'BucketName': 2024-09-14T13:00:22.109 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-09-14T13:00:22.109 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests/functional/test_s3_website.py:253 2024-09-14T13:00:22.110 INFO:teuthology.orchestra.run.smithi138.stdout: /home/ubuntu/cephtest/s3-tests-client.0/s3tests/functional/test_s3_website.py:253: PytestUnknownMarkWarning: Unknown pytest.mark.timeout - is this a typo? You can register custom marks to avoid this warning - for details, see https://docs.pytest.org/en/stable/how-to/mark.html 2024-09-14T13:00:22.110 INFO:teuthology.orchestra.run.smithi138.stdout: @pytest.mark.timeout(10) 2024-09-14T13:00:22.110 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-09-14T13:00:22.110 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests/functional/test_s3_website.py:1077 2024-09-14T13:00:22.110 INFO:teuthology.orchestra.run.smithi138.stdout: s3tests/functional/test_s3_website.py:1077: PytestCollectionWarning: yield tests were removed in pytest 4.0 - test_routing_generator will be ignored 2024-09-14T13:00:22.110 INFO:teuthology.orchestra.run.smithi138.stdout: @pytest.mark.s3website_routing_rules 2024-09-14T13:00:22.110 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-09-14T13:00:22.110 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests_boto3/functional/test_s3.py:2214 2024-09-14T13:00:22.110 INFO:teuthology.orchestra.run.smithi138.stdout: /home/ubuntu/cephtest/s3-tests-client.0/s3tests_boto3/functional/test_s3.py:2214: DeprecationWarning: invalid escape sequence '\$' 2024-09-14T13:00:22.110 INFO:teuthology.orchestra.run.smithi138.stdout: ["starts-with", "$key", "\$foo"],\ 2024-09-14T13:00:22.110 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-09-14T13:00:22.111 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests_boto3/functional/test_s3.py:2229 2024-09-14T13:00:22.111 INFO:teuthology.orchestra.run.smithi138.stdout: /home/ubuntu/cephtest/s3-tests-client.0/s3tests_boto3/functional/test_s3.py:2229: DeprecationWarning: invalid escape sequence '\$' 2024-09-14T13:00:22.111 INFO:teuthology.orchestra.run.smithi138.stdout: payload = OrderedDict([ ("key" , "\$foo.txt"),("AWSAccessKeyId" , aws_access_key_id),\ 2024-09-14T13:00:22.111 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-09-14T13:00:22.111 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests_boto3/functional/test_s3.py:2235 2024-09-14T13:00:22.111 INFO:teuthology.orchestra.run.smithi138.stdout: /home/ubuntu/cephtest/s3-tests-client.0/s3tests_boto3/functional/test_s3.py:2235: DeprecationWarning: invalid escape sequence '\$' 2024-09-14T13:00:22.111 INFO:teuthology.orchestra.run.smithi138.stdout: response = client.get_object(Bucket=bucket_name, Key='\$foo.txt') 2024-09-14T13:00:22.111 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-09-14T13:00:22.111 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests_boto3/functional/test_s3.py:2292 2024-09-14T13:00:22.111 INFO:teuthology.orchestra.run.smithi138.stdout: /home/ubuntu/cephtest/s3-tests-client.0/s3tests_boto3/functional/test_s3.py:2292: DeprecationWarning: invalid escape sequence '\$' 2024-09-14T13:00:22.111 INFO:teuthology.orchestra.run.smithi138.stdout: ["starts-with", "$key", "\$foo"],\ 2024-09-14T13:00:22.111 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-09-14T13:00:22.112 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests_boto3/functional/test_s3.py:2307 2024-09-14T13:00:22.112 INFO:teuthology.orchestra.run.smithi138.stdout: /home/ubuntu/cephtest/s3-tests-client.0/s3tests_boto3/functional/test_s3.py:2307: DeprecationWarning: invalid escape sequence '\$' 2024-09-14T13:00:22.112 INFO:teuthology.orchestra.run.smithi138.stdout: payload = OrderedDict([ ("key" , "\$foo.txt"),("AWSAccessKeyId" , aws_access_key_id),\ 2024-09-14T13:00:22.112 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-09-14T13:00:22.112 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests_boto3/functional/test_s3.py:2325 2024-09-14T13:00:22.112 INFO:teuthology.orchestra.run.smithi138.stdout: /home/ubuntu/cephtest/s3-tests-client.0/s3tests_boto3/functional/test_s3.py:2325: DeprecationWarning: invalid escape sequence '\$' 2024-09-14T13:00:22.112 INFO:teuthology.orchestra.run.smithi138.stdout: ["starts-with", "$key", "\$foo"],\ 2024-09-14T13:00:22.112 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-09-14T13:00:22.112 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests_boto3/functional/test_s3.py:2340 2024-09-14T13:00:22.112 INFO:teuthology.orchestra.run.smithi138.stdout: /home/ubuntu/cephtest/s3-tests-client.0/s3tests_boto3/functional/test_s3.py:2340: DeprecationWarning: invalid escape sequence '\$' 2024-09-14T13:00:22.112 INFO:teuthology.orchestra.run.smithi138.stdout: payload = OrderedDict([ ("key" , "\$foo.txt"),("AWSAccessKeyId" , aws_access_key_id[::-1]),\ 2024-09-14T13:00:22.113 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-09-14T13:00:22.113 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests_boto3/functional/test_s3.py:2358 2024-09-14T13:00:22.113 INFO:teuthology.orchestra.run.smithi138.stdout: /home/ubuntu/cephtest/s3-tests-client.0/s3tests_boto3/functional/test_s3.py:2358: DeprecationWarning: invalid escape sequence '\$' 2024-09-14T13:00:22.113 INFO:teuthology.orchestra.run.smithi138.stdout: ["starts-with", "$key", "\$foo"],\ 2024-09-14T13:00:22.113 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-09-14T13:00:22.113 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests_boto3/functional/test_s3.py:2373 2024-09-14T13:00:22.113 INFO:teuthology.orchestra.run.smithi138.stdout: /home/ubuntu/cephtest/s3-tests-client.0/s3tests_boto3/functional/test_s3.py:2373: DeprecationWarning: invalid escape sequence '\$' 2024-09-14T13:00:22.113 INFO:teuthology.orchestra.run.smithi138.stdout: payload = OrderedDict([ ("key" , "\$foo.txt"),("AWSAccessKeyId" , aws_access_key_id),\ 2024-09-14T13:00:22.113 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-09-14T13:00:22.113 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests_boto3/functional/test_s3.py:2423 2024-09-14T13:00:22.114 INFO:teuthology.orchestra.run.smithi138.stdout: /home/ubuntu/cephtest/s3-tests-client.0/s3tests_boto3/functional/test_s3.py:2423: DeprecationWarning: invalid escape sequence '\$' 2024-09-14T13:00:22.114 INFO:teuthology.orchestra.run.smithi138.stdout: ["starts-with", "$key", "\$foo"],\ 2024-09-14T13:00:22.114 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-09-14T13:00:22.114 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests_boto3/functional/test_s3.py:2455 2024-09-14T13:00:22.114 INFO:teuthology.orchestra.run.smithi138.stdout: /home/ubuntu/cephtest/s3-tests-client.0/s3tests_boto3/functional/test_s3.py:2455: DeprecationWarning: invalid escape sequence '\$' 2024-09-14T13:00:22.114 INFO:teuthology.orchestra.run.smithi138.stdout: ["starts-with", "$key", "\$foo"],\ 2024-09-14T13:00:22.114 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-09-14T13:00:22.114 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests_boto3/functional/test_headers.py: 29 warnings 2024-09-14T13:00:22.114 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests_boto3/functional/test_iam.py: 82 warnings 2024-09-14T13:00:22.114 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests_boto3/functional/test_s3.py: 497 warnings 2024-09-14T13:00:22.114 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests_boto3/functional/test_s3select.py: 33 warnings 2024-09-14T13:00:22.115 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests_boto3/functional/test_sns.py: 3 warnings 2024-09-14T13:00:22.115 INFO:teuthology.orchestra.run.smithi138.stdout: /home/ubuntu/cephtest/s3-tests-client.0/.tox/py/lib/python3.10/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'smithi138.front.sepia.ceph.com'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T13:00:22.115 INFO:teuthology.orchestra.run.smithi138.stdout: warnings.warn( 2024-09-14T13:00:22.115 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-09-14T13:00:22.115 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests_boto3/functional/test_s3.py::test_100_continue 2024-09-14T13:00:22.115 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests_boto3/functional/test_s3.py::test_100_continue 2024-09-14T13:00:22.115 INFO:teuthology.orchestra.run.smithi138.stdout: /home/ubuntu/cephtest/s3-tests-client.0/s3tests_boto3/functional/test_s3.py:6540: DeprecationWarning: ssl.wrap_socket() is deprecated, use SSLContext.wrap_socket() 2024-09-14T13:00:22.115 INFO:teuthology.orchestra.run.smithi138.stdout: s = ssl.wrap_socket(s); 2024-09-14T13:00:22.115 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-09-14T13:00:22.115 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests_boto3/functional/test_s3.py::test_100_continue 2024-09-14T13:00:22.115 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests_boto3/functional/test_s3.py::test_100_continue 2024-09-14T13:00:22.116 INFO:teuthology.orchestra.run.smithi138.stdout: /usr/lib/python3.10/ssl.py:1434: DeprecationWarning: ssl.PROTOCOL_TLS is deprecated 2024-09-14T13:00:22.116 INFO:teuthology.orchestra.run.smithi138.stdout: context = SSLContext(ssl_version) 2024-09-14T13:00:22.116 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-09-14T13:00:22.116 INFO:teuthology.orchestra.run.smithi138.stdout:-- Docs: https://docs.pytest.org/en/stable/how-to/capture-warnings.html 2024-09-14T13:00:22.116 INFO:teuthology.orchestra.run.smithi138.stdout:= 680 passed, 65 skipped, 126 deselected, 1 xfailed, 666 warnings in 3574.53s (0:59:34) = 2024-09-14T13:00:22.294 INFO:teuthology.orchestra.run.smithi138.stdout:___________________________________ summary ____________________________________ 2024-09-14T13:00:22.294 INFO:teuthology.orchestra.run.smithi138.stdout: py: commands succeeded 2024-09-14T13:00:22.294 INFO:teuthology.orchestra.run.smithi138.stdout: congratulations :) 2024-09-14T13:00:22.334 DEBUG:tasks.s3tests:Scanning radosgw logs for leaked encryption keys... 2024-09-14T13:00:22.334 DEBUG:teuthology.orchestra.run.smithi138:> grep --binary-files=text pO3upElrwuEXSoFwCfnZPdSsmt/xWeFa0N9KgDijwVs= /var/log/ceph/rgw.ceph.client.0.log 2024-09-14T13:00:22.425 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-14T13:00:22.425 INFO:tasks.s3tests:Cleaning up boto... 2024-09-14T13:00:22.426 DEBUG:teuthology.orchestra.run.smithi138:> rm /home/ubuntu/cephtest/boto-client.0.cfg 2024-09-14T13:00:22.432 INFO:tasks.s3tests:Removing s3-tests... 2024-09-14T13:00:22.432 DEBUG:teuthology.orchestra.run.smithi138:> rm -rf /home/ubuntu/cephtest/s3-tests-client.0 2024-09-14T13:00:22.619 INFO:teuthology.run_tasks:Running task workunit... 2024-09-14T13:00:22.635 INFO:tasks.workunit:Pulling workunits from ref 1c941a66c1b420259b8fc5ac19e792dbbf60aded 2024-09-14T13:00:22.635 INFO:tasks.workunit:Making a separate scratch dir for every client... 2024-09-14T13:00:22.635 DEBUG:teuthology.orchestra.run.smithi138:> stat -- /home/ubuntu/cephtest/mnt.0 2024-09-14T13:00:22.640 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-14T13:00:22.641 INFO:teuthology.orchestra.run.smithi138.stderr:stat: cannot statx '/home/ubuntu/cephtest/mnt.0': No such file or directory 2024-09-14T13:00:22.642 DEBUG:teuthology.orchestra.run.smithi138:> mkdir -- /home/ubuntu/cephtest/mnt.0 2024-09-14T13:00:22.690 INFO:tasks.workunit:Created dir /home/ubuntu/cephtest/mnt.0 2024-09-14T13:00:22.690 DEBUG:teuthology.orchestra.run.smithi138:> cd -- /home/ubuntu/cephtest/mnt.0 && mkdir -- client.0 2024-09-14T13:00:22.737 INFO:tasks.workunit:timeout=3h 2024-09-14T13:00:22.737 INFO:tasks.workunit:cleanup=True 2024-09-14T13:00:22.738 DEBUG:teuthology.orchestra.run.smithi138:> rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone https://git.ceph.com/ceph.git /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 && git checkout 1c941a66c1b420259b8fc5ac19e792dbbf60aded 2024-09-14T13:00:22.787 INFO:tasks.workunit.client.0.smithi138.stderr:Cloning into '/home/ubuntu/cephtest/clone.client.0'... 2024-09-14T13:01:18.378 INFO:tasks.workunit.client.0.smithi138.stderr:Updating files: 98% (12669/12889) Updating files: 99% (12761/12889) Updating files: 100% (12889/12889) Updating files: 100% (12889/12889), done. 2024-09-14T13:01:18.827 INFO:tasks.workunit.client.0.smithi138.stderr:Note: switching to '1c941a66c1b420259b8fc5ac19e792dbbf60aded'. 2024-09-14T13:01:18.827 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-14T13:01:18.827 INFO:tasks.workunit.client.0.smithi138.stderr:You are in 'detached HEAD' state. You can look around, make experimental 2024-09-14T13:01:18.827 INFO:tasks.workunit.client.0.smithi138.stderr:changes and commit them, and you can discard any commits you make in this 2024-09-14T13:01:18.827 INFO:tasks.workunit.client.0.smithi138.stderr:state without impacting any branches by switching back to a branch. 2024-09-14T13:01:18.828 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-14T13:01:18.828 INFO:tasks.workunit.client.0.smithi138.stderr:If you want to create a new branch to retain commits you create, you may 2024-09-14T13:01:18.828 INFO:tasks.workunit.client.0.smithi138.stderr:do so (now or later) by using -c with the switch command. Example: 2024-09-14T13:01:18.828 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-14T13:01:18.828 INFO:tasks.workunit.client.0.smithi138.stderr: git switch -c 2024-09-14T13:01:18.828 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-14T13:01:18.828 INFO:tasks.workunit.client.0.smithi138.stderr:Or undo this operation with: 2024-09-14T13:01:18.828 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-14T13:01:18.828 INFO:tasks.workunit.client.0.smithi138.stderr: git switch - 2024-09-14T13:01:18.828 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-14T13:01:18.828 INFO:tasks.workunit.client.0.smithi138.stderr:Turn off this advice by setting config variable advice.detachedHead to false 2024-09-14T13:01:18.828 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-14T13:01:18.828 INFO:tasks.workunit.client.0.smithi138.stderr:HEAD is now at 1c941a66c1b Merge pull request #54777 from cbodley/wip-rgw-meta-handlers 2024-09-14T13:01:18.830 DEBUG:teuthology.orchestra.run.smithi138:> cd -- /home/ubuntu/cephtest/clone.client.0/qa/workunits && if test -e Makefile ; then make ; fi && find -executable -type f -printf '%P\0' >/home/ubuntu/cephtest/workunits.list.client.0 2024-09-14T13:01:18.879 INFO:tasks.workunit.client.0.smithi138.stdout:for d in direct_io fs ; do ( cd $d ; make all ) ; done 2024-09-14T13:01:18.882 INFO:tasks.workunit.client.0.smithi138.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-09-14T13:01:18.882 INFO:tasks.workunit.client.0.smithi138.stdout:cc -Wall -Wextra -D_GNU_SOURCE direct_io_test.c -o direct_io_test 2024-09-14T13:01:18.935 INFO:tasks.workunit.client.0.smithi138.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_sync_io.c -o test_sync_io 2024-09-14T13:01:18.989 INFO:tasks.workunit.client.0.smithi138.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_short_dio_read.c -o test_short_dio_read 2024-09-14T13:01:19.031 INFO:tasks.workunit.client.0.smithi138.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-09-14T13:01:19.033 INFO:tasks.workunit.client.0.smithi138.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-09-14T13:01:19.033 INFO:tasks.workunit.client.0.smithi138.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_o_trunc.c -o test_o_trunc 2024-09-14T13:01:19.075 INFO:tasks.workunit.client.0.smithi138.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-09-14T13:01:19.079 DEBUG:teuthology.orchestra.run.smithi138:> set -ex 2024-09-14T13:01:19.079 DEBUG:teuthology.orchestra.run.smithi138:> dd if=/home/ubuntu/cephtest/workunits.list.client.0 of=/dev/stdout 2024-09-14T13:01:19.124 INFO:tasks.workunit:Running workunits matching rgw/run-versioning.sh on client.0... 2024-09-14T13:01:19.125 INFO:tasks.workunit:Running workunit rgw/run-versioning.sh... 2024-09-14T13:01:19.125 DEBUG:teuthology.orchestra.run.smithi138:workunit test rgw/run-versioning.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=1c941a66c1b420259b8fc5ac19e792dbbf60aded TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/run-versioning.sh 2024-09-14T13:01:19.177 INFO:tasks.workunit.client.0.smithi138.stderr:++ dirname /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/run-versioning.sh 2024-09-14T13:01:19.178 INFO:tasks.workunit.client.0.smithi138.stderr:+ mydir=/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw 2024-09-14T13:01:19.178 INFO:tasks.workunit.client.0.smithi138.stderr:+ python3 -m venv /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw 2024-09-14T13:01:22.084 INFO:tasks.workunit.client.0.smithi138.stderr:+ source /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/bin/activate 2024-09-14T13:01:22.084 INFO:tasks.workunit.client.0.smithi138.stderr:++ deactivate nondestructive 2024-09-14T13:01:22.084 INFO:tasks.workunit.client.0.smithi138.stderr:++ '[' -n '' ']' 2024-09-14T13:01:22.084 INFO:tasks.workunit.client.0.smithi138.stderr:++ '[' -n '' ']' 2024-09-14T13:01:22.084 INFO:tasks.workunit.client.0.smithi138.stderr:++ '[' -n /usr/bin/bash -o -n '' ']' 2024-09-14T13:01:22.084 INFO:tasks.workunit.client.0.smithi138.stderr:++ hash -r 2024-09-14T13:01:22.084 INFO:tasks.workunit.client.0.smithi138.stderr:++ '[' -n '' ']' 2024-09-14T13:01:22.084 INFO:tasks.workunit.client.0.smithi138.stderr:++ unset VIRTUAL_ENV 2024-09-14T13:01:22.084 INFO:tasks.workunit.client.0.smithi138.stderr:++ unset VIRTUAL_ENV_PROMPT 2024-09-14T13:01:22.084 INFO:tasks.workunit.client.0.smithi138.stderr:++ '[' '!' nondestructive = nondestructive ']' 2024-09-14T13:01:22.084 INFO:tasks.workunit.client.0.smithi138.stderr:++ VIRTUAL_ENV=/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw 2024-09-14T13:01:22.086 INFO:tasks.workunit.client.0.smithi138.stderr:++ export VIRTUAL_ENV 2024-09-14T13:01:22.086 INFO:tasks.workunit.client.0.smithi138.stderr:++ _OLD_VIRTUAL_PATH=/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/usr/games:/usr/local/games:/snap/bin:/usr/sbin 2024-09-14T13:01:22.086 INFO:tasks.workunit.client.0.smithi138.stderr:++ PATH=/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/usr/games:/usr/local/games:/snap/bin:/usr/sbin 2024-09-14T13:01:22.086 INFO:tasks.workunit.client.0.smithi138.stderr:++ export PATH 2024-09-14T13:01:22.086 INFO:tasks.workunit.client.0.smithi138.stderr:++ '[' -n '' ']' 2024-09-14T13:01:22.086 INFO:tasks.workunit.client.0.smithi138.stderr:++ '[' -z '' ']' 2024-09-14T13:01:22.086 INFO:tasks.workunit.client.0.smithi138.stderr:++ _OLD_VIRTUAL_PS1= 2024-09-14T13:01:22.086 INFO:tasks.workunit.client.0.smithi138.stderr:++ PS1='(rgw) ' 2024-09-14T13:01:22.086 INFO:tasks.workunit.client.0.smithi138.stderr:++ export PS1 2024-09-14T13:01:22.086 INFO:tasks.workunit.client.0.smithi138.stderr:++ VIRTUAL_ENV_PROMPT='(rgw) ' 2024-09-14T13:01:22.086 INFO:tasks.workunit.client.0.smithi138.stderr:++ export VIRTUAL_ENV_PROMPT 2024-09-14T13:01:22.086 INFO:tasks.workunit.client.0.smithi138.stderr:++ '[' -n /usr/bin/bash -o -n '' ']' 2024-09-14T13:01:22.086 INFO:tasks.workunit.client.0.smithi138.stderr:++ hash -r 2024-09-14T13:01:22.086 INFO:tasks.workunit.client.0.smithi138.stderr:+ pip install pip --upgrade 2024-09-14T13:01:22.441 INFO:tasks.workunit.client.0.smithi138.stdout:Requirement already satisfied: pip in /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages (22.0.2) 2024-09-14T13:01:22.654 INFO:tasks.workunit.client.0.smithi138.stdout:Collecting pip 2024-09-14T13:01:22.660 INFO:tasks.workunit.client.0.smithi138.stdout: Using cached pip-24.2-py3-none-any.whl (1.8 MB) 2024-09-14T13:01:22.694 INFO:tasks.workunit.client.0.smithi138.stdout:Installing collected packages: pip 2024-09-14T13:01:22.695 INFO:tasks.workunit.client.0.smithi138.stdout: Attempting uninstall: pip 2024-09-14T13:01:22.695 INFO:tasks.workunit.client.0.smithi138.stdout: Found existing installation: pip 22.0.2 2024-09-14T13:01:22.952 INFO:tasks.workunit.client.0.smithi138.stdout: Uninstalling pip-22.0.2: 2024-09-14T13:01:22.958 INFO:tasks.workunit.client.0.smithi138.stdout: Successfully uninstalled pip-22.0.2 2024-09-14T13:01:23.989 INFO:tasks.workunit.client.0.smithi138.stdout:Successfully installed pip-24.2 2024-09-14T13:01:24.061 INFO:tasks.workunit.client.0.smithi138.stderr:+ pip install boto3 2024-09-14T13:01:25.010 INFO:tasks.workunit.client.0.smithi138.stdout:Collecting boto3 2024-09-14T13:01:25.011 INFO:tasks.workunit.client.0.smithi138.stdout: Using cached boto3-1.35.19-py3-none-any.whl.metadata (6.6 kB) 2024-09-14T13:01:25.554 INFO:tasks.workunit.client.0.smithi138.stdout:Collecting botocore<1.36.0,>=1.35.19 (from boto3) 2024-09-14T13:01:25.555 INFO:tasks.workunit.client.0.smithi138.stdout: Using cached botocore-1.35.19-py3-none-any.whl.metadata (5.7 kB) 2024-09-14T13:01:25.613 INFO:tasks.workunit.client.0.smithi138.stdout:Collecting jmespath<2.0.0,>=0.7.1 (from boto3) 2024-09-14T13:01:25.614 INFO:tasks.workunit.client.0.smithi138.stdout: Using cached jmespath-1.0.1-py3-none-any.whl.metadata (7.6 kB) 2024-09-14T13:01:25.687 INFO:tasks.workunit.client.0.smithi138.stdout:Collecting s3transfer<0.11.0,>=0.10.0 (from boto3) 2024-09-14T13:01:25.688 INFO:tasks.workunit.client.0.smithi138.stdout: Using cached s3transfer-0.10.2-py3-none-any.whl.metadata (1.7 kB) 2024-09-14T13:01:25.750 INFO:tasks.workunit.client.0.smithi138.stdout:Collecting python-dateutil<3.0.0,>=2.1 (from botocore<1.36.0,>=1.35.19->boto3) 2024-09-14T13:01:25.752 INFO:tasks.workunit.client.0.smithi138.stdout: Using cached python_dateutil-2.9.0.post0-py2.py3-none-any.whl.metadata (8.4 kB) 2024-09-14T13:01:25.854 INFO:tasks.workunit.client.0.smithi138.stdout:Collecting urllib3!=2.2.0,<3,>=1.25.4 (from botocore<1.36.0,>=1.35.19->boto3) 2024-09-14T13:01:25.856 INFO:tasks.workunit.client.0.smithi138.stdout: Using cached urllib3-2.2.3-py3-none-any.whl.metadata (6.5 kB) 2024-09-14T13:01:26.049 INFO:tasks.workunit.client.0.smithi138.stdout:Collecting six>=1.5 (from python-dateutil<3.0.0,>=2.1->botocore<1.36.0,>=1.35.19->boto3) 2024-09-14T13:01:26.050 INFO:tasks.workunit.client.0.smithi138.stdout: Using cached six-1.16.0-py2.py3-none-any.whl.metadata (1.8 kB) 2024-09-14T13:01:26.054 INFO:tasks.workunit.client.0.smithi138.stdout:Using cached boto3-1.35.19-py3-none-any.whl (139 kB) 2024-09-14T13:01:26.055 INFO:tasks.workunit.client.0.smithi138.stdout:Using cached botocore-1.35.19-py3-none-any.whl (12.5 MB) 2024-09-14T13:01:26.065 INFO:tasks.workunit.client.0.smithi138.stdout:Using cached jmespath-1.0.1-py3-none-any.whl (20 kB) 2024-09-14T13:01:26.065 INFO:tasks.workunit.client.0.smithi138.stdout:Using cached s3transfer-0.10.2-py3-none-any.whl (82 kB) 2024-09-14T13:01:26.067 INFO:tasks.workunit.client.0.smithi138.stdout:Using cached python_dateutil-2.9.0.post0-py2.py3-none-any.whl (229 kB) 2024-09-14T13:01:26.068 INFO:tasks.workunit.client.0.smithi138.stdout:Using cached urllib3-2.2.3-py3-none-any.whl (126 kB) 2024-09-14T13:01:26.069 INFO:tasks.workunit.client.0.smithi138.stdout:Using cached six-1.16.0-py2.py3-none-any.whl (11 kB) 2024-09-14T13:01:26.137 INFO:tasks.workunit.client.0.smithi138.stdout:Installing collected packages: urllib3, six, jmespath, python-dateutil, botocore, s3transfer, boto3 2024-09-14T13:01:27.215 INFO:tasks.workunit.client.0.smithi138.stdout:Successfully installed boto3-1.35.19 botocore-1.35.19 jmespath-1.0.1 python-dateutil-2.9.0.post0 s3transfer-0.10.2 six-1.16.0 urllib3-2.2.3 2024-09-14T13:01:27.419 INFO:tasks.workunit.client.0.smithi138.stderr:+ /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/bin/python3 /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/test_rgw_versioning.py 2024-09-14T13:01:27.561 INFO:tasks.workunit.client.0.smithi138.stderr:radosgw-admin user create --uid versioning-tester --display-name "Versioning Testing" --access-key LTA662PVVDTDWX6M2AB0 --secret pvtchqajgzqx5581t6qbddbkj0bgf3a69qdkjcea 2024-09-14T13:01:27.600 INFO:tasks.workunit.client.0.smithi138.stderr:ignoring --setuser ceph since I am not root 2024-09-14T13:01:27.600 INFO:tasks.workunit.client.0.smithi138.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T13:01:27.643 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T13:01:27.650+0000 7fd330eb49c0 20 rados->read ofs=0 len=0 2024-09-14T13:01:27.645 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T13:01:27.654+0000 7fd330eb49c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T13:01:27.645 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T13:01:27.654+0000 7fd330eb49c0 20 realm 2024-09-14T13:01:27.645 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T13:01:27.654+0000 7fd330eb49c0 20 rados->read ofs=0 len=0 2024-09-14T13:01:27.645 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T13:01:27.654+0000 7fd330eb49c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T13:01:27.645 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T13:01:27.654+0000 7fd330eb49c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T13:01:27.645 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T13:01:27.654+0000 7fd330eb49c0 20 rados->read ofs=0 len=0 2024-09-14T13:01:27.645 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T13:01:27.654+0000 7fd330eb49c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T13:01:27.645 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T13:01:27.654+0000 7fd330eb49c0 20 rados->read ofs=0 len=0 2024-09-14T13:01:27.646 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T13:01:27.654+0000 7fd330eb49c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T13:01:27.646 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T13:01:27.654+0000 7fd330eb49c0 20 rados->read ofs=0 len=0 2024-09-14T13:01:27.647 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T13:01:27.654+0000 7fd330eb49c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T13:01:27.647 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T13:01:27.654+0000 7fd330eb49c0 20 searching for the correct realm 2024-09-14T13:01:27.651 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T13:01:27.658+0000 7fd32f1bb640 0 -- 172.21.15.138:0/2777407550 >> [v2:172.21.15.154:6824/416768175,v1:172.21.15.154:6825/416768175] conn(0x7fd32806c600 msgr2=0x7fd328061e80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T13:01:27.658 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T13:01:27.666+0000 7fd32e1b9640 0 -- 172.21.15.138:0/2777407550 >> [v2:172.21.15.138:6816/326481658,v1:172.21.15.138:6817/326481658] conn(0x7fd328084330 msgr2=0x7fd3280881c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-14T13:01:27.876 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T13:01:27.886+0000 7fd330eb49c0 20 RGWRados::pool_iterate: got zone_info.d9e72d30-c60b-4d0d-9267-fdc36392d5ad 2024-09-14T13:01:27.876 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T13:01:27.886+0000 7fd330eb49c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T13:01:27.877 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T13:01:27.886+0000 7fd330eb49c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T13:01:27.877 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T13:01:27.886+0000 7fd330eb49c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T13:01:27.877 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T13:01:27.886+0000 7fd330eb49c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T13:01:27.877 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T13:01:27.886+0000 7fd330eb49c0 20 RGWRados::pool_iterate: got zonegroup_info.65ab941b-da8c-4160-94fb-3672b069d44f 2024-09-14T13:01:27.877 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T13:01:27.886+0000 7fd330eb49c0 20 rados->read ofs=0 len=0 2024-09-14T13:01:27.877 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T13:01:27.886+0000 7fd330eb49c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T13:01:27.877 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T13:01:27.886+0000 7fd330eb49c0 20 rados->read ofs=0 len=0 2024-09-14T13:01:27.878 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T13:01:27.886+0000 7fd330eb49c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T13:01:27.878 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T13:01:27.886+0000 7fd330eb49c0 20 rados->read ofs=0 len=0 2024-09-14T13:01:27.879 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T13:01:27.886+0000 7fd330eb49c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T13:01:27.879 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T13:01:27.886+0000 7fd330eb49c0 20 zone default found 2024-09-14T13:01:27.879 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T13:01:27.886+0000 7fd330eb49c0 4 Realm: () 2024-09-14T13:01:27.879 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T13:01:27.886+0000 7fd330eb49c0 4 ZoneGroup: default (65ab941b-da8c-4160-94fb-3672b069d44f) 2024-09-14T13:01:27.879 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T13:01:27.886+0000 7fd330eb49c0 4 Zone: default (d9e72d30-c60b-4d0d-9267-fdc36392d5ad) 2024-09-14T13:01:27.879 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T13:01:27.886+0000 7fd330eb49c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T13:01:27.879 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T13:01:27.886+0000 7fd330eb49c0 20 zonegroup default 2024-09-14T13:01:27.879 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T13:01:27.886+0000 7fd330eb49c0 20 rados->read ofs=0 len=0 2024-09-14T13:01:27.880 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T13:01:27.886+0000 7fd330eb49c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T13:01:27.880 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T13:01:27.886+0000 7fd330eb49c0 20 rados->read ofs=0 len=0 2024-09-14T13:01:27.880 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T13:01:27.890+0000 7fd330eb49c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T13:01:27.880 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T13:01:27.890+0000 7fd330eb49c0 20 rados->read ofs=0 len=0 2024-09-14T13:01:27.881 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T13:01:27.890+0000 7fd330eb49c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T13:01:27.881 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T13:01:27.890+0000 7fd330eb49c0 20 started sync module instance, tier type = 2024-09-14T13:01:27.881 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T13:01:27.890+0000 7fd330eb49c0 20 started zone id=d9e72d30-c60b-4d0d-9267-fdc36392d5ad (name=default) with tier type = 2024-09-14T13:01:27.907 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T13:01:27.914+0000 7fd330eb49c0 20 add_watcher() i=0 2024-09-14T13:01:27.907 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T13:01:27.914+0000 7fd330eb49c0 20 add_watcher() i=1 2024-09-14T13:01:27.907 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T13:01:27.914+0000 7fd330eb49c0 20 add_watcher() i=2 2024-09-14T13:01:27.907 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T13:01:27.914+0000 7fd330eb49c0 20 add_watcher() i=3 2024-09-14T13:01:27.907 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T13:01:27.914+0000 7fd330eb49c0 20 add_watcher() i=4 2024-09-14T13:01:27.908 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T13:01:27.914+0000 7fd330eb49c0 20 add_watcher() i=5 2024-09-14T13:01:27.908 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T13:01:27.914+0000 7fd330eb49c0 20 add_watcher() i=6 2024-09-14T13:01:27.911 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T13:01:27.918+0000 7fd330eb49c0 20 add_watcher() i=7 2024-09-14T13:01:27.911 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T13:01:27.918+0000 7fd330eb49c0 2 all 8 watchers are set, enabling cache 2024-09-14T13:01:27.914 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T13:01:27.922+0000 7fd1e57e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T13:01:27.916 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T13:01:27.922+0000 7fd330eb49c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T13:01:27.916 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T13:01:27.922+0000 7fd330eb49c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T13:01:27.916 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T13:01:27.922+0000 7fd330eb49c0 5 note: GC not initialized 2024-09-14T13:01:27.916 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T13:01:27.926+0000 7fd15ffff640 20 reqs_thread_entry: start 2024-09-14T13:01:27.916 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T13:01:27.926+0000 7fd330eb49c0 20 init_complete bucket index max shards: 11 2024-09-14T13:01:27.917 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T13:01:27.926+0000 7fd330eb49c0 20 Filter name: none 2024-09-14T13:01:27.917 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T13:01:27.926+0000 7fd15dffb640 20 reqs_thread_entry: start 2024-09-14T13:01:27.917 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T13:01:27.926+0000 7fd330eb49c0 10 cache get: name=default.rgw.meta+users.uid+versioning-tester : miss 2024-09-14T13:01:27.917 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T13:01:27.926+0000 7fd330eb49c0 20 rados->read ofs=0 len=0 2024-09-14T13:01:27.918 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T13:01:27.926+0000 7fd330eb49c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T13:01:27.918 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T13:01:27.926+0000 7fd330eb49c0 10 cache put: name=default.rgw.meta+users.uid+versioning-tester info.flags=0x0 2024-09-14T13:01:27.918 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T13:01:27.926+0000 7fd330eb49c0 10 adding default.rgw.meta+users.uid+versioning-tester to cache LRU end 2024-09-14T13:01:27.918 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T13:01:27.926+0000 7fd330eb49c0 10 cache get: name=default.rgw.meta+users.keys+LTA662PVVDTDWX6M2AB0 : miss 2024-09-14T13:01:27.918 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T13:01:27.926+0000 7fd330eb49c0 20 rados->read ofs=0 len=0 2024-09-14T13:01:27.919 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T13:01:27.926+0000 7fd330eb49c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T13:01:27.919 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T13:01:27.926+0000 7fd330eb49c0 10 cache put: name=default.rgw.meta+users.keys+LTA662PVVDTDWX6M2AB0 info.flags=0x0 2024-09-14T13:01:27.919 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T13:01:27.926+0000 7fd330eb49c0 10 adding default.rgw.meta+users.keys+LTA662PVVDTDWX6M2AB0 to cache LRU end 2024-09-14T13:01:27.919 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T13:01:27.926+0000 7fd330eb49c0 10 cache get: name=default.rgw.meta+users.keys+LTA662PVVDTDWX6M2AB0 : hit (negative entry) 2024-09-14T13:01:27.919 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T13:01:27.926+0000 7fd330eb49c0 10 cache get: name=default.rgw.meta+users.keys+LTA662PVVDTDWX6M2AB0 : hit (negative entry) 2024-09-14T13:01:27.924 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T13:01:27.930+0000 7fd330eb49c0 10 cache put: name=default.rgw.meta+users.uid+versioning-tester info.flags=0x17 2024-09-14T13:01:27.924 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T13:01:27.930+0000 7fd330eb49c0 10 moving default.rgw.meta+users.uid+versioning-tester to cache LRU end 2024-09-14T13:01:27.924 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T13:01:27.930+0000 7fd330eb49c0 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 0, obj: default.rgw.meta:users.uid:versioning-tester, ofs0, ns] 2024-09-14T13:01:27.924 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T13:01:27.934+0000 7fd2127fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1146756268410 cookie 94294580802320 notifier 9219 bl.length()=613 2024-09-14T13:01:27.924 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T13:01:27.934+0000 7fd2127fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+versioning-tester info.flags=0x17 2024-09-14T13:01:27.924 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T13:01:27.934+0000 7fd2127fc640 10 rgw watcher librados: moving default.rgw.meta+users.uid+versioning-tester to cache LRU end 2024-09-14T13:01:27.929 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T13:01:27.938+0000 7fd330eb49c0 10 cache put: name=default.rgw.meta+users.keys+LTA662PVVDTDWX6M2AB0 info.flags=0x7 2024-09-14T13:01:27.929 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T13:01:27.938+0000 7fd330eb49c0 10 moving default.rgw.meta+users.keys+LTA662PVVDTDWX6M2AB0 to cache LRU end 2024-09-14T13:01:27.929 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T13:01:27.938+0000 7fd330eb49c0 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:users.keys:LTA662PVVDTDWX6M2AB0, ofs0, ns] 2024-09-14T13:01:27.930 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T13:01:27.938+0000 7fd2127fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1146756269586 cookie 94294580796272 notifier 9219 bl.length()=191 2024-09-14T13:01:27.930 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T13:01:27.938+0000 7fd2127fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.keys+LTA662PVVDTDWX6M2AB0 info.flags=0x7 2024-09-14T13:01:27.930 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T13:01:27.938+0000 7fd2127fc640 10 rgw watcher librados: moving default.rgw.meta+users.keys+LTA662PVVDTDWX6M2AB0 to cache LRU end 2024-09-14T13:01:27.933 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T13:01:27.942+0000 7fd1e57e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T13:01:27.938 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T13:01:27.946+0000 7fd330eb49c0 20 remove_watcher() i=0 2024-09-14T13:01:27.938 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T13:01:27.946+0000 7fd330eb49c0 2 removed watcher, disabling cache 2024-09-14T13:01:27.940 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T13:01:27.950+0000 7fd330eb49c0 20 remove_watcher() i=1 2024-09-14T13:01:27.942 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T13:01:27.950+0000 7fd330eb49c0 20 remove_watcher() i=2 2024-09-14T13:01:27.945 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T13:01:27.954+0000 7fd330eb49c0 20 remove_watcher() i=3 2024-09-14T13:01:27.947 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T13:01:27.954+0000 7fd330eb49c0 20 remove_watcher() i=4 2024-09-14T13:01:27.948 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T13:01:27.958+0000 7fd330eb49c0 20 remove_watcher() i=5 2024-09-14T13:01:27.949 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T13:01:27.958+0000 7fd330eb49c0 20 remove_watcher() i=6 2024-09-14T13:01:27.951 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T13:01:27.958+0000 7fd330eb49c0 20 remove_watcher() i=7 2024-09-14T13:01:28.200 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T13:01:28.201 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-14T13:01:28.282 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T13:01:28.282 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-14T13:01:28.382 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T13:01:28.382 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-14T13:01:28.512 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T13:01:28.512 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-14T13:01:28.590 INFO:tasks.workunit.client.0.smithi138.stderr:TEST: verify that index entries and OLH objects are cleaned up after redundant deletes 2024-09-14T13:01:28.590 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-14T13:01:28.600 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T13:01:28.600 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-14T13:01:28.697 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T13:01:28.698 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-14T13:01:28.794 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T13:01:28.795 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-14T13:01:28.912 INFO:tasks.workunit.client.0.smithi138.stderr:radosgw-admin bi list --bucket versioning-bucket 2024-09-14T13:01:28.945 INFO:tasks.workunit.client.0.smithi138.stderr:ignoring --setuser ceph since I am not root 2024-09-14T13:01:28.945 INFO:tasks.workunit.client.0.smithi138.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T13:01:28.991 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T13:01:28.998+0000 7f28d623b9c0 20 rados->read ofs=0 len=0 2024-09-14T13:01:28.993 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T13:01:29.002+0000 7f28d623b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T13:01:28.993 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T13:01:29.002+0000 7f28d623b9c0 20 realm 2024-09-14T13:01:28.993 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T13:01:29.002+0000 7f28d623b9c0 20 rados->read ofs=0 len=0 2024-09-14T13:01:28.994 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T13:01:29.002+0000 7f28d623b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T13:01:28.994 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T13:01:29.002+0000 7f28d623b9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T13:01:28.994 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T13:01:29.002+0000 7f28d623b9c0 20 rados->read ofs=0 len=0 2024-09-14T13:01:28.994 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T13:01:29.002+0000 7f28d623b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T13:01:28.994 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T13:01:29.002+0000 7f28d623b9c0 20 rados->read ofs=0 len=0 2024-09-14T13:01:28.996 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T13:01:29.002+0000 7f28d623b9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T13:01:28.996 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T13:01:29.002+0000 7f28d623b9c0 20 rados->read ofs=0 len=0 2024-09-14T13:01:28.997 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T13:01:29.006+0000 7f28d623b9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T13:01:28.997 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T13:01:29.006+0000 7f28d623b9c0 20 searching for the correct realm 2024-09-14T13:01:29.000 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T13:01:29.010+0000 7f28d4542640 0 -- 172.21.15.138:0/1067344719 >> [v2:172.21.15.154:6824/416768175,v1:172.21.15.154:6825/416768175] conn(0x7f28cc0638f0 msgr2=0x7f28cc062360 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T13:01:29.008 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T13:01:29.014+0000 7f28d3540640 0 -- 172.21.15.138:0/1067344719 >> [v2:172.21.15.138:6816/326481658,v1:172.21.15.138:6817/326481658] conn(0x7f28cc06c040 msgr2=0x7f28cc0649c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T13:01:29.223 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T13:01:29.230+0000 7f28d623b9c0 20 RGWRados::pool_iterate: got zone_info.d9e72d30-c60b-4d0d-9267-fdc36392d5ad 2024-09-14T13:01:29.223 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T13:01:29.230+0000 7f28d623b9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T13:01:29.223 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T13:01:29.230+0000 7f28d623b9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T13:01:29.223 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T13:01:29.230+0000 7f28d623b9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T13:01:29.223 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T13:01:29.230+0000 7f28d623b9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T13:01:29.223 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T13:01:29.230+0000 7f28d623b9c0 20 RGWRados::pool_iterate: got zonegroup_info.65ab941b-da8c-4160-94fb-3672b069d44f 2024-09-14T13:01:29.223 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T13:01:29.230+0000 7f28d623b9c0 20 rados->read ofs=0 len=0 2024-09-14T13:01:29.224 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T13:01:29.230+0000 7f28d623b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T13:01:29.224 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T13:01:29.230+0000 7f28d623b9c0 20 rados->read ofs=0 len=0 2024-09-14T13:01:29.224 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T13:01:29.230+0000 7f28d623b9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T13:01:29.224 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T13:01:29.230+0000 7f28d623b9c0 20 rados->read ofs=0 len=0 2024-09-14T13:01:29.225 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T13:01:29.234+0000 7f28d623b9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T13:01:29.225 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T13:01:29.234+0000 7f28d623b9c0 20 zone default found 2024-09-14T13:01:29.225 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T13:01:29.234+0000 7f28d623b9c0 4 Realm: () 2024-09-14T13:01:29.225 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T13:01:29.234+0000 7f28d623b9c0 4 ZoneGroup: default (65ab941b-da8c-4160-94fb-3672b069d44f) 2024-09-14T13:01:29.225 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T13:01:29.234+0000 7f28d623b9c0 4 Zone: default (d9e72d30-c60b-4d0d-9267-fdc36392d5ad) 2024-09-14T13:01:29.225 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T13:01:29.234+0000 7f28d623b9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T13:01:29.225 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T13:01:29.234+0000 7f28d623b9c0 20 zonegroup default 2024-09-14T13:01:29.225 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T13:01:29.234+0000 7f28d623b9c0 20 rados->read ofs=0 len=0 2024-09-14T13:01:29.226 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T13:01:29.234+0000 7f28d623b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T13:01:29.226 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T13:01:29.234+0000 7f28d623b9c0 20 rados->read ofs=0 len=0 2024-09-14T13:01:29.226 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T13:01:29.234+0000 7f28d623b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T13:01:29.226 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T13:01:29.234+0000 7f28d623b9c0 20 rados->read ofs=0 len=0 2024-09-14T13:01:29.227 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T13:01:29.234+0000 7f28d623b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T13:01:29.227 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T13:01:29.234+0000 7f28d623b9c0 20 started sync module instance, tier type = 2024-09-14T13:01:29.227 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T13:01:29.234+0000 7f28d623b9c0 20 started zone id=d9e72d30-c60b-4d0d-9267-fdc36392d5ad (name=default) with tier type = 2024-09-14T13:01:29.251 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T13:01:29.258+0000 7f28d623b9c0 20 add_watcher() i=0 2024-09-14T13:01:29.251 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T13:01:29.258+0000 7f28d623b9c0 20 add_watcher() i=1 2024-09-14T13:01:29.251 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T13:01:29.258+0000 7f28d623b9c0 20 add_watcher() i=2 2024-09-14T13:01:29.251 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T13:01:29.258+0000 7f28d623b9c0 20 add_watcher() i=3 2024-09-14T13:01:29.251 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T13:01:29.258+0000 7f28d623b9c0 20 add_watcher() i=4 2024-09-14T13:01:29.251 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T13:01:29.258+0000 7f28d623b9c0 20 add_watcher() i=5 2024-09-14T13:01:29.251 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T13:01:29.258+0000 7f28d623b9c0 20 add_watcher() i=6 2024-09-14T13:01:29.253 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T13:01:29.262+0000 7f28d623b9c0 20 add_watcher() i=7 2024-09-14T13:01:29.253 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T13:01:29.262+0000 7f28d623b9c0 2 all 8 watchers are set, enabling cache 2024-09-14T13:01:29.257 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T13:01:29.266+0000 7f2789fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T13:01:29.258 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T13:01:29.266+0000 7f28d623b9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T13:01:29.258 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T13:01:29.266+0000 7f28d623b9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T13:01:29.258 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T13:01:29.266+0000 7f28d623b9c0 5 note: GC not initialized 2024-09-14T13:01:29.259 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T13:01:29.266+0000 7f2788fe1640 20 reqs_thread_entry: start 2024-09-14T13:01:29.259 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T13:01:29.266+0000 7f28d623b9c0 20 init_complete bucket index max shards: 11 2024-09-14T13:01:29.259 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T13:01:29.266+0000 7f28d623b9c0 20 Filter name: none 2024-09-14T13:01:29.260 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T13:01:29.266+0000 7f27027fc640 20 reqs_thread_entry: start 2024-09-14T13:01:29.260 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T13:01:29.266+0000 7f28d623b9c0 20 rados->read ofs=0 len=0 2024-09-14T13:01:29.260 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T13:01:29.270+0000 7f28d623b9c0 20 rados_obj.operate() r=0 bl.length=209 2024-09-14T13:01:29.260 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T13:01:29.270+0000 7f28d623b9c0 20 rados->read ofs=0 len=0 2024-09-14T13:01:29.261 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T13:01:29.270+0000 7f28d623b9c0 20 rados_obj.operate() r=0 bl.length=431 2024-09-14T13:01:29.261 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T13:01:29.270+0000 7f28d623b9c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T13:01:29.262 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T13:01:29.270+0000 7f28d623b9c0 20 INFO: main: max_entries=1000, index=gen=0, max_shards=11 2024-09-14T13:01:29.262 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T13:01:29.270+0000 7f28d623b9c0 20 INFO: main: starting shard=0 2024-09-14T13:01:29.262 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T13:01:29.270+0000 7f28d623b9c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.782.0 2024-09-14T13:01:29.263 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T13:01:29.270+0000 7f28d623b9c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T13:01:29.263 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T13:01:29.270+0000 7f28d623b9c0 20 INFO: main: starting shard=1 2024-09-14T13:01:29.263 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T13:01:29.270+0000 7f28d623b9c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.782.1 2024-09-14T13:01:29.263 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T13:01:29.270+0000 7f28d623b9c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T13:01:29.263 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T13:01:29.270+0000 7f28d623b9c0 20 INFO: main: starting shard=2 2024-09-14T13:01:29.263 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T13:01:29.270+0000 7f28d623b9c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.782.2 2024-09-14T13:01:29.264 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T13:01:29.274+0000 7f28d623b9c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T13:01:29.265 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T13:01:29.274+0000 7f28d623b9c0 20 INFO: main: starting shard=3 2024-09-14T13:01:29.265 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T13:01:29.274+0000 7f28d623b9c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.782.3 2024-09-14T13:01:29.265 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T13:01:29.274+0000 7f28d623b9c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T13:01:29.265 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T13:01:29.274+0000 7f28d623b9c0 20 INFO: main: starting shard=4 2024-09-14T13:01:29.265 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T13:01:29.274+0000 7f28d623b9c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.782.4 2024-09-14T13:01:29.266 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T13:01:29.274+0000 7f28d623b9c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T13:01:29.266 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T13:01:29.274+0000 7f28d623b9c0 20 INFO: main: starting shard=5 2024-09-14T13:01:29.266 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T13:01:29.274+0000 7f28d623b9c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.782.5 2024-09-14T13:01:29.267 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T13:01:29.274+0000 7f28d623b9c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T13:01:29.267 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T13:01:29.274+0000 7f28d623b9c0 20 INFO: main: starting shard=6 2024-09-14T13:01:29.267 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T13:01:29.274+0000 7f28d623b9c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.782.6 2024-09-14T13:01:29.268 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T13:01:29.274+0000 7f28d623b9c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T13:01:29.268 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T13:01:29.274+0000 7f28d623b9c0 20 INFO: main: starting shard=7 2024-09-14T13:01:29.268 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T13:01:29.278+0000 7f28d623b9c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.782.7 2024-09-14T13:01:29.269 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T13:01:29.278+0000 7f28d623b9c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T13:01:29.269 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T13:01:29.278+0000 7f28d623b9c0 20 INFO: main: starting shard=8 2024-09-14T13:01:29.269 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T13:01:29.278+0000 7f28d623b9c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.782.8 2024-09-14T13:01:29.271 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T13:01:29.278+0000 7f28d623b9c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T13:01:29.271 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T13:01:29.278+0000 7f28d623b9c0 20 INFO: main: starting shard=9 2024-09-14T13:01:29.271 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T13:01:29.278+0000 7f28d623b9c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.782.9 2024-09-14T13:01:29.272 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T13:01:29.278+0000 7f28d623b9c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T13:01:29.272 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T13:01:29.278+0000 7f28d623b9c0 20 INFO: main: starting shard=10 2024-09-14T13:01:29.272 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T13:01:29.278+0000 7f28d623b9c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.782.10 2024-09-14T13:01:29.273 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T13:01:29.282+0000 7f28d623b9c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T13:01:29.273 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T13:01:29.282+0000 7f28d623b9c0 20 INFO: main: done 2024-09-14T13:01:29.274 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T13:01:29.282+0000 7f2789fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T13:01:29.280 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T13:01:29.286+0000 7f28d623b9c0 20 remove_watcher() i=0 2024-09-14T13:01:29.280 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T13:01:29.286+0000 7f28d623b9c0 2 removed watcher, disabling cache 2024-09-14T13:01:29.282 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T13:01:29.290+0000 7f28d623b9c0 20 remove_watcher() i=1 2024-09-14T13:01:29.285 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T13:01:29.294+0000 7f28d623b9c0 20 remove_watcher() i=2 2024-09-14T13:01:29.287 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T13:01:29.294+0000 7f28d623b9c0 20 remove_watcher() i=3 2024-09-14T13:01:29.289 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T13:01:29.298+0000 7f28d623b9c0 20 remove_watcher() i=4 2024-09-14T13:01:29.291 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T13:01:29.298+0000 7f28d623b9c0 20 remove_watcher() i=5 2024-09-14T13:01:29.293 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T13:01:29.302+0000 7f28d623b9c0 20 remove_watcher() i=6 2024-09-14T13:01:29.295 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T13:01:29.302+0000 7f28d623b9c0 20 remove_watcher() i=7 2024-09-14T13:01:29.316 INFO:tasks.workunit.client.0.smithi138.stderr:rados -p default.rgw.buckets.data ls | grep be373b64-11fe-4c90-b056-d90fcd79bf3a 2024-09-14T13:01:29.344 INFO:tasks.workunit.client.0.smithi138.stderr:ignoring --setuser ceph since I am not root 2024-09-14T13:01:29.344 INFO:tasks.workunit.client.0.smithi138.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T13:01:29.417 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T13:01:29.426+0000 7f42f9f3e640 0 -- 172.21.15.138:0/3523216986 >> [v2:172.21.15.138:6808/3258321916,v1:172.21.15.138:6809/3258321916] conn(0x7f42f005ebd0 msgr2=0x7f42f005c570 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T13:01:29.430 INFO:tasks.workunit.client.0.smithi138.stderr:TEST: verify that index entries and OLH objects are cleaned up after index linking error 2024-09-14T13:01:29.430 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-14T13:01:29.430 INFO:tasks.workunit.client.0.smithi138.stderr:ceph config set client rgw_debug_inject_set_olh_err 2 2024-09-14T13:01:30.877 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T13:01:30.877 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-14T13:01:30.982 INFO:tasks.workunit.client.0.smithi138.stderr:ceph config rm client rgw_debug_inject_set_olh_err 2024-09-14T13:01:31.420 INFO:tasks.workunit.client.0.smithi138.stderr:radosgw-admin bi list --bucket versioning-bucket 2024-09-14T13:01:31.451 INFO:tasks.workunit.client.0.smithi138.stderr:ignoring --setuser ceph since I am not root 2024-09-14T13:01:31.451 INFO:tasks.workunit.client.0.smithi138.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T13:01:31.495 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T13:01:31.502+0000 7efff7bd59c0 20 rados->read ofs=0 len=0 2024-09-14T13:01:31.497 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T13:01:31.506+0000 7efff7bd59c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T13:01:31.497 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T13:01:31.506+0000 7efff7bd59c0 20 realm 2024-09-14T13:01:31.497 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T13:01:31.506+0000 7efff7bd59c0 20 rados->read ofs=0 len=0 2024-09-14T13:01:31.497 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T13:01:31.506+0000 7efff7bd59c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T13:01:31.498 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T13:01:31.506+0000 7efff7bd59c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T13:01:31.498 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T13:01:31.506+0000 7efff7bd59c0 20 rados->read ofs=0 len=0 2024-09-14T13:01:31.498 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T13:01:31.506+0000 7efff7bd59c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T13:01:31.498 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T13:01:31.506+0000 7efff7bd59c0 20 rados->read ofs=0 len=0 2024-09-14T13:01:31.499 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T13:01:31.506+0000 7efff7bd59c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T13:01:31.499 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T13:01:31.506+0000 7efff7bd59c0 20 rados->read ofs=0 len=0 2024-09-14T13:01:31.500 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T13:01:31.506+0000 7efff7bd59c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T13:01:31.500 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T13:01:31.506+0000 7efff7bd59c0 20 searching for the correct realm 2024-09-14T13:01:31.505 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T13:01:31.514+0000 7efff4eda640 0 -- 172.21.15.138:0/1473567786 >> [v2:172.21.15.154:6808/1468088432,v1:172.21.15.154:6809/1468088432] conn(0x7effe8020040 msgr2=0x7effe806d6b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T13:01:31.512 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T13:01:31.518+0000 7efff4eda640 0 -- 172.21.15.138:0/1473567786 >> [v2:172.21.15.138:6816/326481658,v1:172.21.15.138:6817/326481658] conn(0x7efff00e0940 msgr2=0x7efff0101a40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-14T13:01:31.728 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T13:01:31.734+0000 7efff7bd59c0 20 RGWRados::pool_iterate: got zone_info.d9e72d30-c60b-4d0d-9267-fdc36392d5ad 2024-09-14T13:01:31.728 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T13:01:31.734+0000 7efff7bd59c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T13:01:31.728 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T13:01:31.734+0000 7efff7bd59c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T13:01:31.729 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T13:01:31.734+0000 7efff7bd59c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T13:01:31.729 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T13:01:31.734+0000 7efff7bd59c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T13:01:31.729 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T13:01:31.734+0000 7efff7bd59c0 20 RGWRados::pool_iterate: got zonegroup_info.65ab941b-da8c-4160-94fb-3672b069d44f 2024-09-14T13:01:31.729 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T13:01:31.734+0000 7efff7bd59c0 20 rados->read ofs=0 len=0 2024-09-14T13:01:31.729 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T13:01:31.738+0000 7efff7bd59c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T13:01:31.729 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T13:01:31.738+0000 7efff7bd59c0 20 rados->read ofs=0 len=0 2024-09-14T13:01:31.730 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T13:01:31.738+0000 7efff7bd59c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T13:01:31.730 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T13:01:31.738+0000 7efff7bd59c0 20 rados->read ofs=0 len=0 2024-09-14T13:01:31.731 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T13:01:31.738+0000 7efff7bd59c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T13:01:31.731 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T13:01:31.738+0000 7efff7bd59c0 20 zone default found 2024-09-14T13:01:31.731 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T13:01:31.738+0000 7efff7bd59c0 4 Realm: () 2024-09-14T13:01:31.731 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T13:01:31.738+0000 7efff7bd59c0 4 ZoneGroup: default (65ab941b-da8c-4160-94fb-3672b069d44f) 2024-09-14T13:01:31.731 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T13:01:31.738+0000 7efff7bd59c0 4 Zone: default (d9e72d30-c60b-4d0d-9267-fdc36392d5ad) 2024-09-14T13:01:31.731 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T13:01:31.738+0000 7efff7bd59c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T13:01:31.731 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T13:01:31.738+0000 7efff7bd59c0 20 zonegroup default 2024-09-14T13:01:31.731 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T13:01:31.738+0000 7efff7bd59c0 20 rados->read ofs=0 len=0 2024-09-14T13:01:31.732 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T13:01:31.738+0000 7efff7bd59c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T13:01:31.732 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T13:01:31.738+0000 7efff7bd59c0 20 rados->read ofs=0 len=0 2024-09-14T13:01:31.732 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T13:01:31.742+0000 7efff7bd59c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T13:01:31.732 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T13:01:31.742+0000 7efff7bd59c0 20 rados->read ofs=0 len=0 2024-09-14T13:01:31.733 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T13:01:31.742+0000 7efff7bd59c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T13:01:31.733 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T13:01:31.742+0000 7efff7bd59c0 20 started sync module instance, tier type = 2024-09-14T13:01:31.733 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T13:01:31.742+0000 7efff7bd59c0 20 started zone id=d9e72d30-c60b-4d0d-9267-fdc36392d5ad (name=default) with tier type = 2024-09-14T13:01:31.755 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T13:01:31.762+0000 7efff7bd59c0 20 add_watcher() i=0 2024-09-14T13:01:31.755 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T13:01:31.762+0000 7efff7bd59c0 20 add_watcher() i=1 2024-09-14T13:01:31.755 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T13:01:31.762+0000 7efff7bd59c0 20 add_watcher() i=2 2024-09-14T13:01:31.756 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T13:01:31.762+0000 7efff7bd59c0 20 add_watcher() i=3 2024-09-14T13:01:31.756 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T13:01:31.762+0000 7efff7bd59c0 20 add_watcher() i=4 2024-09-14T13:01:31.756 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T13:01:31.762+0000 7efff7bd59c0 20 add_watcher() i=5 2024-09-14T13:01:31.756 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T13:01:31.762+0000 7efff7bd59c0 20 add_watcher() i=6 2024-09-14T13:01:31.757 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T13:01:31.766+0000 7efff7bd59c0 20 add_watcher() i=7 2024-09-14T13:01:31.757 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T13:01:31.766+0000 7efff7bd59c0 2 all 8 watchers are set, enabling cache 2024-09-14T13:01:31.761 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T13:01:31.770+0000 7efeab7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T13:01:31.762 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T13:01:31.770+0000 7efff7bd59c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T13:01:31.762 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T13:01:31.770+0000 7efff7bd59c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T13:01:31.762 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T13:01:31.770+0000 7efff7bd59c0 5 note: GC not initialized 2024-09-14T13:01:31.763 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T13:01:31.770+0000 7efeaa7e4640 20 reqs_thread_entry: start 2024-09-14T13:01:31.763 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T13:01:31.770+0000 7efff7bd59c0 20 init_complete bucket index max shards: 11 2024-09-14T13:01:31.763 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T13:01:31.770+0000 7efff7bd59c0 20 Filter name: none 2024-09-14T13:01:31.763 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T13:01:31.770+0000 7efe1bfff640 20 reqs_thread_entry: start 2024-09-14T13:01:31.763 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T13:01:31.770+0000 7efff7bd59c0 20 rados->read ofs=0 len=0 2024-09-14T13:01:31.764 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T13:01:31.770+0000 7efff7bd59c0 20 rados_obj.operate() r=0 bl.length=209 2024-09-14T13:01:31.764 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T13:01:31.770+0000 7efff7bd59c0 20 rados->read ofs=0 len=0 2024-09-14T13:01:31.765 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T13:01:31.774+0000 7efff7bd59c0 20 rados_obj.operate() r=0 bl.length=431 2024-09-14T13:01:31.765 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T13:01:31.774+0000 7efff7bd59c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T13:01:31.765 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T13:01:31.774+0000 7efff7bd59c0 20 INFO: main: max_entries=1000, index=gen=0, max_shards=11 2024-09-14T13:01:31.765 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T13:01:31.774+0000 7efff7bd59c0 20 INFO: main: starting shard=0 2024-09-14T13:01:31.765 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T13:01:31.774+0000 7efff7bd59c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.782.0 2024-09-14T13:01:31.766 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T13:01:31.774+0000 7efff7bd59c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T13:01:31.766 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T13:01:31.774+0000 7efff7bd59c0 20 INFO: main: starting shard=1 2024-09-14T13:01:31.766 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T13:01:31.774+0000 7efff7bd59c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.782.1 2024-09-14T13:01:31.767 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T13:01:31.774+0000 7efff7bd59c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T13:01:31.767 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T13:01:31.774+0000 7efff7bd59c0 20 INFO: main: starting shard=2 2024-09-14T13:01:31.767 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T13:01:31.774+0000 7efff7bd59c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.782.2 2024-09-14T13:01:31.768 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T13:01:31.774+0000 7efff7bd59c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T13:01:31.768 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T13:01:31.774+0000 7efff7bd59c0 20 INFO: main: starting shard=3 2024-09-14T13:01:31.768 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T13:01:31.774+0000 7efff7bd59c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.782.3 2024-09-14T13:01:31.769 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T13:01:31.778+0000 7efff7bd59c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T13:01:31.769 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T13:01:31.778+0000 7efff7bd59c0 20 INFO: main: starting shard=4 2024-09-14T13:01:31.769 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T13:01:31.778+0000 7efff7bd59c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.782.4 2024-09-14T13:01:31.770 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T13:01:31.778+0000 7efff7bd59c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T13:01:31.770 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T13:01:31.778+0000 7efff7bd59c0 20 INFO: main: starting shard=5 2024-09-14T13:01:31.770 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T13:01:31.778+0000 7efff7bd59c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.782.5 2024-09-14T13:01:31.771 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T13:01:31.778+0000 7efff7bd59c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T13:01:31.771 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T13:01:31.778+0000 7efff7bd59c0 20 INFO: main: starting shard=6 2024-09-14T13:01:31.771 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T13:01:31.778+0000 7efff7bd59c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.782.6 2024-09-14T13:01:31.772 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T13:01:31.782+0000 7efff7bd59c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T13:01:31.772 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T13:01:31.782+0000 7efff7bd59c0 20 INFO: main: starting shard=7 2024-09-14T13:01:31.773 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T13:01:31.782+0000 7efff7bd59c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.782.7 2024-09-14T13:01:31.774 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T13:01:31.782+0000 7efff7bd59c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T13:01:31.774 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T13:01:31.782+0000 7efff7bd59c0 20 INFO: main: starting shard=8 2024-09-14T13:01:31.774 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T13:01:31.782+0000 7efff7bd59c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.782.8 2024-09-14T13:01:31.776 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T13:01:31.782+0000 7efff7bd59c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T13:01:31.776 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T13:01:31.782+0000 7efff7bd59c0 20 INFO: main: starting shard=9 2024-09-14T13:01:31.776 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T13:01:31.782+0000 7efff7bd59c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.782.9 2024-09-14T13:01:31.776 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T13:01:31.786+0000 7efff7bd59c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T13:01:31.776 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T13:01:31.786+0000 7efff7bd59c0 20 INFO: main: starting shard=10 2024-09-14T13:01:31.776 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T13:01:31.786+0000 7efff7bd59c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.782.10 2024-09-14T13:01:31.778 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T13:01:31.786+0000 7efff7bd59c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T13:01:31.778 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T13:01:31.786+0000 7efff7bd59c0 20 INFO: main: done 2024-09-14T13:01:31.780 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T13:01:31.786+0000 7efeab7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T13:01:31.785 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T13:01:31.794+0000 7efff7bd59c0 20 remove_watcher() i=0 2024-09-14T13:01:31.785 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T13:01:31.794+0000 7efff7bd59c0 2 removed watcher, disabling cache 2024-09-14T13:01:31.788 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T13:01:31.794+0000 7efff7bd59c0 20 remove_watcher() i=1 2024-09-14T13:01:31.791 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T13:01:31.798+0000 7efff7bd59c0 20 remove_watcher() i=2 2024-09-14T13:01:31.793 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T13:01:31.802+0000 7efff7bd59c0 20 remove_watcher() i=3 2024-09-14T13:01:31.796 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T13:01:31.806+0000 7efff7bd59c0 20 remove_watcher() i=4 2024-09-14T13:01:31.798 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T13:01:31.806+0000 7efff7bd59c0 20 remove_watcher() i=5 2024-09-14T13:01:31.799 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T13:01:31.806+0000 7efff7bd59c0 20 remove_watcher() i=6 2024-09-14T13:01:31.802 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T13:01:31.810+0000 7efff7bd59c0 20 remove_watcher() i=7 2024-09-14T13:01:31.819 INFO:tasks.workunit.client.0.smithi138.stderr:rados -p default.rgw.buckets.data ls | grep f976c6b1-811b-44e0-92af-e2a43f784f82 2024-09-14T13:01:31.845 INFO:tasks.workunit.client.0.smithi138.stderr:ignoring --setuser ceph since I am not root 2024-09-14T13:01:31.846 INFO:tasks.workunit.client.0.smithi138.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T13:01:31.916 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T13:01:31.926+0000 7fc313d56640 0 -- 172.21.15.138:0/239286707 >> [v2:172.21.15.138:6816/326481658,v1:172.21.15.138:6817/326481658] conn(0x7fc30805be00 msgr2=0x7fc30805e3c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T13:01:31.926 INFO:tasks.workunit.client.0.smithi138.stderr:TEST: verify that original null object version is intact after failed olh upgrade 2024-09-14T13:01:31.926 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-14T13:01:31.928 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T13:01:31.928 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-14T13:01:31.966 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T13:01:31.966 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-14T13:01:32.017 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T13:01:32.017 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-14T13:01:32.064 INFO:tasks.workunit.client.0.smithi138.stderr:ceph config set client rgw_debug_inject_set_olh_err 2 2024-09-14T13:01:33.513 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T13:01:33.513 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-14T13:01:33.681 INFO:tasks.workunit.client.0.smithi138.stderr:An error occurred (NoSuchKey) when calling the PutObject operation: None 2024-09-14T13:01:33.682 INFO:tasks.workunit.client.0.smithi138.stderr:ceph config rm client rgw_debug_inject_set_olh_err 2024-09-14T13:01:34.127 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T13:01:34.127 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-14T13:01:34.271 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T13:01:34.271 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-14T13:01:34.344 INFO:tasks.workunit.client.0.smithi138.stderr:TEST: verify that concurrent delete requests do not leave behind olh entries 2024-09-14T13:01:34.344 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-14T13:01:34.350 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T13:01:34.350 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-14T13:01:34.480 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T13:01:34.481 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-14T13:01:34.648 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T13:01:34.648 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-14T13:01:34.747 INFO:tasks.workunit.client.0.smithi138.stderr:ceph config set client rgw_debug_inject_latency_bi_unlink 2 2024-09-14T13:01:36.196 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T13:01:36.196 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-14T13:01:36.333 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T13:01:36.334 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-14T13:01:38.500 INFO:tasks.workunit.client.0.smithi138.stderr:ceph config rm client rgw_debug_inject_latency_bi_unlink 2024-09-14T13:01:38.937 INFO:tasks.workunit.client.0.smithi138.stderr:radosgw-admin bucket check olh --bucket versioning-bucket --dump-keys 2024-09-14T13:01:38.962 INFO:tasks.workunit.client.0.smithi138.stderr:ignoring --setuser ceph since I am not root 2024-09-14T13:01:38.962 INFO:tasks.workunit.client.0.smithi138.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T13:01:39.002 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T13:01:39.010+0000 7f9898c8f9c0 20 rados->read ofs=0 len=0 2024-09-14T13:01:39.004 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T13:01:39.010+0000 7f9898c8f9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T13:01:39.004 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T13:01:39.010+0000 7f9898c8f9c0 20 realm 2024-09-14T13:01:39.004 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T13:01:39.010+0000 7f9898c8f9c0 20 rados->read ofs=0 len=0 2024-09-14T13:01:39.004 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T13:01:39.010+0000 7f9898c8f9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T13:01:39.004 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T13:01:39.010+0000 7f9898c8f9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T13:01:39.004 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T13:01:39.010+0000 7f9898c8f9c0 20 rados->read ofs=0 len=0 2024-09-14T13:01:39.004 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T13:01:39.014+0000 7f9898c8f9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T13:01:39.004 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T13:01:39.014+0000 7f9898c8f9c0 20 rados->read ofs=0 len=0 2024-09-14T13:01:39.005 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T13:01:39.014+0000 7f9898c8f9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T13:01:39.006 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T13:01:39.014+0000 7f9898c8f9c0 20 rados->read ofs=0 len=0 2024-09-14T13:01:39.006 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T13:01:39.014+0000 7f9898c8f9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T13:01:39.006 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T13:01:39.014+0000 7f9898c8f9c0 20 searching for the correct realm 2024-09-14T13:01:39.011 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T13:01:39.018+0000 7f9896795640 0 -- 172.21.15.138:0/3190330595 >> [v2:172.21.15.138:6808/3258321916,v1:172.21.15.138:6809/3258321916] conn(0x55cfd0a9c490 msgr2=0x55cfd0a9e950 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T13:01:39.016 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T13:01:39.026+0000 7f9895f94640 0 -- 172.21.15.138:0/3190330595 >> [v2:172.21.15.138:6816/326481658,v1:172.21.15.138:6817/326481658] conn(0x7f9890108000 msgr2=0x7f9890002ca0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T13:01:39.024 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T13:01:39.034+0000 7f9898c8f9c0 20 RGWRados::pool_iterate: got zone_info.d9e72d30-c60b-4d0d-9267-fdc36392d5ad 2024-09-14T13:01:39.024 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T13:01:39.034+0000 7f9898c8f9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T13:01:39.025 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T13:01:39.034+0000 7f9898c8f9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T13:01:39.025 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T13:01:39.034+0000 7f9898c8f9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T13:01:39.025 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T13:01:39.034+0000 7f9898c8f9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T13:01:39.025 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T13:01:39.034+0000 7f9898c8f9c0 20 RGWRados::pool_iterate: got zonegroup_info.65ab941b-da8c-4160-94fb-3672b069d44f 2024-09-14T13:01:39.025 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T13:01:39.034+0000 7f9898c8f9c0 20 rados->read ofs=0 len=0 2024-09-14T13:01:39.025 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T13:01:39.034+0000 7f9898c8f9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T13:01:39.025 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T13:01:39.034+0000 7f9898c8f9c0 20 rados->read ofs=0 len=0 2024-09-14T13:01:39.025 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T13:01:39.034+0000 7f9898c8f9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T13:01:39.025 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T13:01:39.034+0000 7f9898c8f9c0 20 rados->read ofs=0 len=0 2024-09-14T13:01:39.026 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T13:01:39.034+0000 7f9898c8f9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T13:01:39.026 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T13:01:39.034+0000 7f9898c8f9c0 20 zone default found 2024-09-14T13:01:39.026 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T13:01:39.034+0000 7f9898c8f9c0 4 Realm: () 2024-09-14T13:01:39.026 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T13:01:39.034+0000 7f9898c8f9c0 4 ZoneGroup: default (65ab941b-da8c-4160-94fb-3672b069d44f) 2024-09-14T13:01:39.027 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T13:01:39.034+0000 7f9898c8f9c0 4 Zone: default (d9e72d30-c60b-4d0d-9267-fdc36392d5ad) 2024-09-14T13:01:39.027 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T13:01:39.034+0000 7f9898c8f9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T13:01:39.027 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T13:01:39.034+0000 7f9898c8f9c0 20 zonegroup default 2024-09-14T13:01:39.027 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T13:01:39.034+0000 7f9898c8f9c0 20 rados->read ofs=0 len=0 2024-09-14T13:01:39.027 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T13:01:39.034+0000 7f9898c8f9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T13:01:39.027 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T13:01:39.034+0000 7f9898c8f9c0 20 rados->read ofs=0 len=0 2024-09-14T13:01:39.027 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T13:01:39.034+0000 7f9898c8f9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T13:01:39.027 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T13:01:39.034+0000 7f9898c8f9c0 20 rados->read ofs=0 len=0 2024-09-14T13:01:39.028 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T13:01:39.034+0000 7f9898c8f9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T13:01:39.028 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T13:01:39.034+0000 7f9898c8f9c0 20 started sync module instance, tier type = 2024-09-14T13:01:39.028 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T13:01:39.034+0000 7f9898c8f9c0 20 started zone id=d9e72d30-c60b-4d0d-9267-fdc36392d5ad (name=default) with tier type = 2024-09-14T13:01:39.042 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T13:01:39.050+0000 7f9898c8f9c0 20 add_watcher() i=0 2024-09-14T13:01:39.042 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T13:01:39.050+0000 7f9898c8f9c0 20 add_watcher() i=1 2024-09-14T13:01:39.042 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T13:01:39.050+0000 7f9898c8f9c0 20 add_watcher() i=2 2024-09-14T13:01:39.042 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T13:01:39.050+0000 7f9898c8f9c0 20 add_watcher() i=3 2024-09-14T13:01:39.042 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T13:01:39.050+0000 7f9898c8f9c0 20 add_watcher() i=4 2024-09-14T13:01:39.042 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T13:01:39.050+0000 7f9898c8f9c0 20 add_watcher() i=5 2024-09-14T13:01:39.042 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T13:01:39.050+0000 7f9898c8f9c0 20 add_watcher() i=6 2024-09-14T13:01:39.043 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T13:01:39.050+0000 7f9898c8f9c0 20 add_watcher() i=7 2024-09-14T13:01:39.043 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T13:01:39.050+0000 7f9898c8f9c0 2 all 8 watchers are set, enabling cache 2024-09-14T13:01:39.045 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T13:01:39.054+0000 7f974cfe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T13:01:39.046 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T13:01:39.054+0000 7f9898c8f9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T13:01:39.046 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T13:01:39.054+0000 7f9898c8f9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T13:01:39.046 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T13:01:39.054+0000 7f9898c8f9c0 5 note: GC not initialized 2024-09-14T13:01:39.046 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T13:01:39.054+0000 7f96c77fe640 20 reqs_thread_entry: start 2024-09-14T13:01:39.046 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T13:01:39.054+0000 7f9898c8f9c0 20 init_complete bucket index max shards: 11 2024-09-14T13:01:39.046 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T13:01:39.054+0000 7f9898c8f9c0 20 Filter name: none 2024-09-14T13:01:39.047 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T13:01:39.054+0000 7f96c57fa640 20 reqs_thread_entry: start 2024-09-14T13:01:39.047 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T13:01:39.054+0000 7f9898c8f9c0 10 cache get: name=default.rgw.meta+root+versioning-bucket : miss 2024-09-14T13:01:39.047 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T13:01:39.054+0000 7f9898c8f9c0 20 rados->read ofs=0 len=0 2024-09-14T13:01:39.048 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T13:01:39.054+0000 7f9898c8f9c0 20 rados_obj.operate() r=0 bl.length=209 2024-09-14T13:01:39.048 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T13:01:39.054+0000 7f9898c8f9c0 10 cache put: name=default.rgw.meta+root+versioning-bucket info.flags=0x11 2024-09-14T13:01:39.048 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T13:01:39.054+0000 7f9898c8f9c0 10 adding default.rgw.meta+root+versioning-bucket to cache LRU end 2024-09-14T13:01:39.048 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T13:01:39.054+0000 7f9898c8f9c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.versioning-bucket:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.782 : miss 2024-09-14T13:01:39.048 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T13:01:39.054+0000 7f9898c8f9c0 20 rados->read ofs=0 len=0 2024-09-14T13:01:39.048 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T13:01:39.054+0000 7f9898c8f9c0 20 rados_obj.operate() r=0 bl.length=431 2024-09-14T13:01:39.048 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T13:01:39.054+0000 7f9898c8f9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.versioning-bucket:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.782 info.flags=0x17 2024-09-14T13:01:39.048 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T13:01:39.054+0000 7f9898c8f9c0 10 adding default.rgw.meta+root+.bucket.meta.versioning-bucket:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.782 to cache LRU end 2024-09-14T13:01:39.048 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T13:01:39.054+0000 7f9898c8f9c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T13:01:39.048 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T13:01:39.054+0000 7f9898c8f9c0 10 updating xattr: name=user.rgw.acl bl.length()=209 2024-09-14T13:01:39.048 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T13:01:39.054+0000 7f9898c8f9c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.versioning-bucket:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.782 2024-09-14T13:01:39.048 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T13:01:39.054+0000 7f9898c8f9c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.782.0 2024-09-14T13:01:39.049 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T13:01:39.058+0000 7f9898c8f9c0 1 NOTICE: finished shard 0 (0 entries found) 2024-09-14T13:01:39.049 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T13:01:39.058+0000 7f9898c8f9c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.782.1 2024-09-14T13:01:39.049 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T13:01:39.058+0000 7f9898c8f9c0 1 NOTICE: finished shard 1 (0 entries found) 2024-09-14T13:01:39.049 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T13:01:39.058+0000 7f9898c8f9c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.782.2 2024-09-14T13:01:39.050 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T13:01:39.058+0000 7f9898c8f9c0 1 NOTICE: finished shard 2 (0 entries found) 2024-09-14T13:01:39.050 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T13:01:39.058+0000 7f9898c8f9c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.782.3 2024-09-14T13:01:39.050 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T13:01:39.058+0000 7f9898c8f9c0 1 NOTICE: finished shard 3 (0 entries found) 2024-09-14T13:01:39.051 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T13:01:39.058+0000 7f9898c8f9c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.782.4 2024-09-14T13:01:39.051 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T13:01:39.058+0000 7f9898c8f9c0 1 NOTICE: finished shard 4 (0 entries found) 2024-09-14T13:01:39.051 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T13:01:39.058+0000 7f9898c8f9c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.782.5 2024-09-14T13:01:39.051 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T13:01:39.058+0000 7f9898c8f9c0 1 NOTICE: finished shard 5 (0 entries found) 2024-09-14T13:01:39.051 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T13:01:39.058+0000 7f9898c8f9c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.782.6 2024-09-14T13:01:39.052 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T13:01:39.062+0000 7f9898c8f9c0 1 NOTICE: finished shard 6 (0 entries found) 2024-09-14T13:01:39.052 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T13:01:39.062+0000 7f9898c8f9c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.782.7 2024-09-14T13:01:39.053 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T13:01:39.062+0000 7f9898c8f9c0 1 NOTICE: finished shard 7 (0 entries found) 2024-09-14T13:01:39.053 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T13:01:39.062+0000 7f9898c8f9c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.782.8 2024-09-14T13:01:39.054 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T13:01:39.062+0000 7f9898c8f9c0 1 NOTICE: finished shard 8 (0 entries found) 2024-09-14T13:01:39.054 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T13:01:39.062+0000 7f9898c8f9c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.782.9 2024-09-14T13:01:39.055 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T13:01:39.062+0000 7f9898c8f9c0 1 NOTICE: finished shard 9 (0 entries found) 2024-09-14T13:01:39.055 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T13:01:39.062+0000 7f9898c8f9c0 20 bucket index object: :.dir.d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.782.10 2024-09-14T13:01:39.056 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T13:01:39.062+0000 7f9898c8f9c0 1 NOTICE: finished shard 10 (0 entries found) 2024-09-14T13:01:39.056 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T13:01:39.066+0000 7f9898c8f9c0 1 NOTICE: finished all shards (0 entries found) 2024-09-14T13:01:39.057 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T13:01:39.066+0000 7f974cfe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T13:01:39.061 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T13:01:39.070+0000 7f9898c8f9c0 20 remove_watcher() i=0 2024-09-14T13:01:39.062 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T13:01:39.070+0000 7f9898c8f9c0 2 removed watcher, disabling cache 2024-09-14T13:01:39.063 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T13:01:39.070+0000 7f9898c8f9c0 20 remove_watcher() i=1 2024-09-14T13:01:39.065 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T13:01:39.074+0000 7f9898c8f9c0 20 remove_watcher() i=2 2024-09-14T13:01:39.067 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T13:01:39.074+0000 7f9898c8f9c0 20 remove_watcher() i=3 2024-09-14T13:01:39.070 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T13:01:39.078+0000 7f9898c8f9c0 20 remove_watcher() i=4 2024-09-14T13:01:39.071 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T13:01:39.078+0000 7f9898c8f9c0 20 remove_watcher() i=5 2024-09-14T13:01:39.072 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T13:01:39.078+0000 7f9898c8f9c0 20 remove_watcher() i=6 2024-09-14T13:01:39.073 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-14T13:01:39.082+0000 7f9898c8f9c0 20 remove_watcher() i=7 2024-09-14T13:01:39.084 INFO:tasks.workunit.client.0.smithi138.stderr:Deleting bucket versioning-bucket 2024-09-14T13:01:39.085 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T13:01:39.085 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-14T13:01:39.119 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-14T13:01:39.119 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-14T13:01:39.438 INFO:tasks.workunit.client.0.smithi138.stderr:Completed bucket versioning tests 2024-09-14T13:01:39.438 INFO:tasks.workunit.client.0.smithi138.stdout:Could not connect to the endpoint URL: "http://localhost:80/" 2024-09-14T13:01:39.438 INFO:tasks.workunit.client.0.smithi138.stdout:Could not connect to the endpoint URL: "http://localhost:8000/" 2024-09-14T13:01:39.439 INFO:tasks.workunit.client.0.smithi138.stdout:connected to https://localhost:443 2024-09-14T13:01:39.539 INFO:tasks.workunit.client.0.smithi138.stderr:+ deactivate 2024-09-14T13:01:39.539 INFO:tasks.workunit.client.0.smithi138.stderr:+ '[' -n /usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/usr/games:/usr/local/games:/snap/bin:/usr/sbin ']' 2024-09-14T13:01:39.539 INFO:tasks.workunit.client.0.smithi138.stderr:+ PATH=/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/usr/games:/usr/local/games:/snap/bin:/usr/sbin 2024-09-14T13:01:39.539 INFO:tasks.workunit.client.0.smithi138.stderr:+ export PATH 2024-09-14T13:01:39.540 INFO:tasks.workunit.client.0.smithi138.stderr:+ unset _OLD_VIRTUAL_PATH 2024-09-14T13:01:39.540 INFO:tasks.workunit.client.0.smithi138.stderr:+ '[' -n '' ']' 2024-09-14T13:01:39.540 INFO:tasks.workunit.client.0.smithi138.stderr:+ '[' -n /usr/bin/bash -o -n '' ']' 2024-09-14T13:01:39.540 INFO:tasks.workunit.client.0.smithi138.stderr:+ hash -r 2024-09-14T13:01:39.540 INFO:tasks.workunit.client.0.smithi138.stderr:+ '[' -n '' ']' 2024-09-14T13:01:39.540 INFO:tasks.workunit.client.0.smithi138.stderr:+ unset VIRTUAL_ENV 2024-09-14T13:01:39.540 INFO:tasks.workunit.client.0.smithi138.stderr:+ unset VIRTUAL_ENV_PROMPT 2024-09-14T13:01:39.540 INFO:tasks.workunit.client.0.smithi138.stderr:+ '[' '!' '' = nondestructive ']' 2024-09-14T13:01:39.540 INFO:tasks.workunit.client.0.smithi138.stderr:+ unset -f deactivate 2024-09-14T13:01:39.540 INFO:tasks.workunit.client.0.smithi138.stderr:+ echo OK. 2024-09-14T13:01:39.541 INFO:tasks.workunit.client.0.smithi138.stdout:OK. 2024-09-14T13:01:39.541 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-09-14T13:01:39.541 DEBUG:teuthology.orchestra.run.smithi138:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-09-14T13:01:39.597 INFO:tasks.workunit:Stopping ['rgw/run-versioning.sh'] on client.0... 2024-09-14T13:01:39.597 DEBUG:teuthology.orchestra.run.smithi138:> sudo rm -rf -- /home/ubuntu/cephtest/workunits.list.client.0 /home/ubuntu/cephtest/clone.client.0 2024-09-14T13:01:39.999 DEBUG:teuthology.parallel:result is None 2024-09-14T13:01:39.999 DEBUG:teuthology.orchestra.run.smithi138:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0 2024-09-14T13:01:40.012 INFO:tasks.workunit:Deleted dir /home/ubuntu/cephtest/mnt.0/client.0 2024-09-14T13:01:40.012 DEBUG:teuthology.orchestra.run.smithi138:> rmdir -- /home/ubuntu/cephtest/mnt.0 2024-09-14T13:01:40.060 INFO:tasks.workunit:Deleted artificial mount point /home/ubuntu/cephtest/mnt.0/client.0 2024-09-14T13:01:40.060 DEBUG:teuthology.run_tasks:Unwinding manager s3tests 2024-09-14T13:01:40.070 DEBUG:teuthology.run_tasks:Unwinding manager s3tests-java 2024-09-14T13:01:40.127 DEBUG:tasks.s3tests_java:S3 Tests Java: END 2024-09-14T13:01:40.127 INFO:tasks.s3tests_java:S3 Tests Java: Cleaning up s3-tests-java... 2024-09-14T13:01:40.127 DEBUG:teuthology.orchestra.run.smithi138:> rm -rf /home/ubuntu/cephtest/s3-tests-java 2024-09-14T13:01:40.177 INFO:tasks.s3tests_java:S3 Tests Java: Deleting S3 users... 2024-09-14T13:01:40.177 DEBUG:teuthology.orchestra.run.smithi138:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 user rm --uid tester.client.0 --purge-data --cluster ceph 2024-09-14T13:01:40.212 INFO:teuthology.orchestra.run.smithi138.stderr:ignoring --setuser ceph since I am not root 2024-09-14T13:01:40.212 INFO:teuthology.orchestra.run.smithi138.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T13:01:40.254 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T13:01:40.262+0000 7f2fcdbd69c0 20 rados->read ofs=0 len=0 2024-09-14T13:01:40.256 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T13:01:40.266+0000 7f2fcdbd69c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T13:01:40.256 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T13:01:40.266+0000 7f2fcdbd69c0 20 realm 2024-09-14T13:01:40.256 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T13:01:40.266+0000 7f2fcdbd69c0 20 rados->read ofs=0 len=0 2024-09-14T13:01:40.257 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T13:01:40.266+0000 7f2fcdbd69c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T13:01:40.257 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T13:01:40.266+0000 7f2fcdbd69c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T13:01:40.257 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T13:01:40.266+0000 7f2fcdbd69c0 20 rados->read ofs=0 len=0 2024-09-14T13:01:40.257 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T13:01:40.266+0000 7f2fcdbd69c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T13:01:40.257 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T13:01:40.266+0000 7f2fcdbd69c0 20 rados->read ofs=0 len=0 2024-09-14T13:01:40.258 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T13:01:40.266+0000 7f2fcdbd69c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T13:01:40.258 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T13:01:40.266+0000 7f2fcdbd69c0 20 rados->read ofs=0 len=0 2024-09-14T13:01:40.259 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T13:01:40.266+0000 7f2fcdbd69c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T13:01:40.259 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T13:01:40.266+0000 7f2fcdbd69c0 20 searching for the correct realm 2024-09-14T13:01:40.264 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T13:01:40.270+0000 7f2fcaedb640 0 -- 172.21.15.138:0/3259644029 >> [v2:172.21.15.154:6808/1468088432,v1:172.21.15.154:6809/1468088432] conn(0x7f2fc4014470 msgr2=0x7f2fc40148f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T13:01:40.270 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T13:01:40.278+0000 7f2fcaedb640 0 -- 172.21.15.138:0/3259644029 >> [v2:172.21.15.138:6816/326481658,v1:172.21.15.138:6817/326481658] conn(0x7f2fbc0d6070 msgr2=0x7f2fbc100970 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-14T13:01:40.487 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T13:01:40.494+0000 7f2fcdbd69c0 20 RGWRados::pool_iterate: got zone_info.d9e72d30-c60b-4d0d-9267-fdc36392d5ad 2024-09-14T13:01:40.488 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T13:01:40.494+0000 7f2fcdbd69c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T13:01:40.488 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T13:01:40.494+0000 7f2fcdbd69c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T13:01:40.488 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T13:01:40.494+0000 7f2fcdbd69c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T13:01:40.488 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T13:01:40.494+0000 7f2fcdbd69c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T13:01:40.488 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T13:01:40.494+0000 7f2fcdbd69c0 20 RGWRados::pool_iterate: got zonegroup_info.65ab941b-da8c-4160-94fb-3672b069d44f 2024-09-14T13:01:40.488 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T13:01:40.494+0000 7f2fcdbd69c0 20 rados->read ofs=0 len=0 2024-09-14T13:01:40.488 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T13:01:40.494+0000 7f2fcdbd69c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T13:01:40.488 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T13:01:40.494+0000 7f2fcdbd69c0 20 rados->read ofs=0 len=0 2024-09-14T13:01:40.489 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T13:01:40.498+0000 7f2fcdbd69c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T13:01:40.489 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T13:01:40.498+0000 7f2fcdbd69c0 20 rados->read ofs=0 len=0 2024-09-14T13:01:40.489 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T13:01:40.498+0000 7f2fcdbd69c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T13:01:40.489 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T13:01:40.498+0000 7f2fcdbd69c0 20 zone default found 2024-09-14T13:01:40.490 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T13:01:40.498+0000 7f2fcdbd69c0 4 Realm: () 2024-09-14T13:01:40.490 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T13:01:40.498+0000 7f2fcdbd69c0 4 ZoneGroup: default (65ab941b-da8c-4160-94fb-3672b069d44f) 2024-09-14T13:01:40.490 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T13:01:40.498+0000 7f2fcdbd69c0 4 Zone: default (d9e72d30-c60b-4d0d-9267-fdc36392d5ad) 2024-09-14T13:01:40.490 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T13:01:40.498+0000 7f2fcdbd69c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T13:01:40.490 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T13:01:40.498+0000 7f2fcdbd69c0 20 zonegroup default 2024-09-14T13:01:40.490 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T13:01:40.498+0000 7f2fcdbd69c0 20 rados->read ofs=0 len=0 2024-09-14T13:01:40.490 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T13:01:40.498+0000 7f2fcdbd69c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T13:01:40.490 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T13:01:40.498+0000 7f2fcdbd69c0 20 rados->read ofs=0 len=0 2024-09-14T13:01:40.491 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T13:01:40.498+0000 7f2fcdbd69c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T13:01:40.491 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T13:01:40.498+0000 7f2fcdbd69c0 20 rados->read ofs=0 len=0 2024-09-14T13:01:40.491 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T13:01:40.498+0000 7f2fcdbd69c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T13:01:40.492 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T13:01:40.498+0000 7f2fcdbd69c0 20 started sync module instance, tier type = 2024-09-14T13:01:40.492 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T13:01:40.498+0000 7f2fcdbd69c0 20 started zone id=d9e72d30-c60b-4d0d-9267-fdc36392d5ad (name=default) with tier type = 2024-09-14T13:01:40.515 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T13:01:40.522+0000 7f2fcdbd69c0 20 add_watcher() i=0 2024-09-14T13:01:40.515 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T13:01:40.522+0000 7f2fcdbd69c0 20 add_watcher() i=1 2024-09-14T13:01:40.515 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T13:01:40.522+0000 7f2fcdbd69c0 20 add_watcher() i=2 2024-09-14T13:01:40.515 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T13:01:40.522+0000 7f2fcdbd69c0 20 add_watcher() i=3 2024-09-14T13:01:40.515 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T13:01:40.522+0000 7f2fcdbd69c0 20 add_watcher() i=4 2024-09-14T13:01:40.515 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T13:01:40.522+0000 7f2fcdbd69c0 20 add_watcher() i=5 2024-09-14T13:01:40.515 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T13:01:40.522+0000 7f2fcdbd69c0 20 add_watcher() i=6 2024-09-14T13:01:40.517 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T13:01:40.526+0000 7f2fcdbd69c0 20 add_watcher() i=7 2024-09-14T13:01:40.518 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T13:01:40.526+0000 7f2fcdbd69c0 2 all 8 watchers are set, enabling cache 2024-09-14T13:01:40.522 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T13:01:40.530+0000 7f2e81fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T13:01:40.522 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T13:01:40.530+0000 7f2fcdbd69c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T13:01:40.522 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T13:01:40.530+0000 7f2fcdbd69c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T13:01:40.613 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T13:01:40.622+0000 7f2e80fe1640 20 reqs_thread_entry: start 2024-09-14T13:01:40.613 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T13:01:40.622+0000 7f2fcdbd69c0 20 init_complete bucket index max shards: 11 2024-09-14T13:01:40.614 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T13:01:40.622+0000 7f2fcdbd69c0 20 Filter name: none 2024-09-14T13:01:40.614 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T13:01:40.622+0000 7f2dfa7fc640 20 reqs_thread_entry: start 2024-09-14T13:01:40.614 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T13:01:40.622+0000 7f2fcdbd69c0 10 cache get: name=default.rgw.meta+users.uid+tester.client.0 : miss 2024-09-14T13:01:40.614 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T13:01:40.622+0000 7f2fcdbd69c0 20 rados->read ofs=0 len=0 2024-09-14T13:01:40.614 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T13:01:40.622+0000 7f2fcdbd69c0 20 rados_obj.operate() r=0 bl.length=482 2024-09-14T13:01:40.614 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T13:01:40.622+0000 7f2fcdbd69c0 10 cache put: name=default.rgw.meta+users.uid+tester.client.0 info.flags=0x13 2024-09-14T13:01:40.615 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T13:01:40.622+0000 7f2fcdbd69c0 10 adding default.rgw.meta+users.uid+tester.client.0 to cache LRU end 2024-09-14T13:01:40.615 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T13:01:40.622+0000 7f2fcdbd69c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T13:01:40.616 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T13:01:40.622+0000 7f2fcdbd69c0 10 removing key index: QNBMTGTGQQXWKIHKUVYV 2024-09-14T13:01:40.618 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T13:01:40.626+0000 7f2fcdbd69c0 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 1, obj: default.rgw.meta:users.keys:QNBMTGTGQQXWKIHKUVYV, ofs0, ns] 2024-09-14T13:01:40.619 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T13:01:40.626+0000 7f2eaeffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1146756268524 cookie 94405942152400 notifier 8684 bl.length()=170 2024-09-14T13:01:40.657 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T13:01:40.666+0000 7f2fcdbd69c0 10 removing email index: tester.client.0_test@test.test 2024-09-14T13:01:40.659 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T13:01:40.666+0000 7f2fcdbd69c0 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 1, obj: default.rgw.meta:users.email:tester.client.0_test@test.test, ofs0, ns] 2024-09-14T13:01:40.660 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T13:01:40.666+0000 7f2eaeffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1146756268326 cookie 94405942162640 notifier 8684 bl.length()=181 2024-09-14T13:01:40.673 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T13:01:40.682+0000 7f2fcdbd69c0 10 removing user buckets index 2024-09-14T13:01:40.677 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T13:01:40.686+0000 7f2fcdbd69c0 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 1, obj: default.rgw.meta:users.uid:tester.client.0.buckets, ofs0, ns] 2024-09-14T13:01:40.677 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T13:01:40.686+0000 7f2eaeffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1146756268411 cookie 94405942174928 notifier 8684 bl.length()=172 2024-09-14T13:01:40.683 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T13:01:40.690+0000 7f2fcdbd69c0 10 removing user index: tester.client.0 2024-09-14T13:01:40.687 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T13:01:40.694+0000 7f2fcdbd69c0 10 removing default.rgw.meta+users.uid+tester.client.0 from cache 2024-09-14T13:01:40.687 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T13:01:40.694+0000 7f2fcdbd69c0 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 1, obj: default.rgw.meta:users.uid:tester.client.0, ofs0, ns] 2024-09-14T13:01:40.687 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T13:01:40.694+0000 7f2eae7fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1146756269589 cookie 94405942172368 notifier 8684 bl.length()=164 2024-09-14T13:01:40.694 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T13:01:40.702+0000 7f2e81fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T13:01:40.699 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T13:01:40.706+0000 7f2fcdbd69c0 20 remove_watcher() i=0 2024-09-14T13:01:40.699 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T13:01:40.706+0000 7f2fcdbd69c0 2 removed watcher, disabling cache 2024-09-14T13:01:40.702 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T13:01:40.710+0000 7f2fcdbd69c0 20 remove_watcher() i=1 2024-09-14T13:01:40.705 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T13:01:40.714+0000 7f2fcdbd69c0 20 remove_watcher() i=2 2024-09-14T13:01:40.708 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T13:01:40.714+0000 7f2fcdbd69c0 20 remove_watcher() i=3 2024-09-14T13:01:40.710 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T13:01:40.718+0000 7f2fcdbd69c0 20 remove_watcher() i=4 2024-09-14T13:01:40.712 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T13:01:40.718+0000 7f2fcdbd69c0 20 remove_watcher() i=5 2024-09-14T13:01:40.714 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T13:01:40.722+0000 7f2fcdbd69c0 20 remove_watcher() i=6 2024-09-14T13:01:40.716 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T13:01:40.722+0000 7f2fcdbd69c0 20 remove_watcher() i=7 2024-09-14T13:01:40.735 DEBUG:teuthology.run_tasks:Unwinding manager ragweed 2024-09-14T13:01:40.747 DEBUG:teuthology.run_tasks:Unwinding manager tox 2024-09-14T13:01:40.787 DEBUG:teuthology.orchestra.run.smithi138:> rm -rf /home/ubuntu/cephtest/tox-venv 2024-09-14T13:01:40.831 DEBUG:teuthology.run_tasks:Unwinding manager rgw 2024-09-14T13:01:40.842 DEBUG:tasks.rgw.client.0:waiting for process to exit 2024-09-14T13:01:40.842 INFO:teuthology.orchestra.run:waiting for 300 2024-09-14T13:01:40.881 INFO:tasks.rgw.client.0.smithi138.stdout:2024-09-14T13:01:40.886+0000 e574640 -1 received signal: Terminated from /usr/bin/python3 /usr/bin/daemon-helper term env OPENSSL_ia32cap=~0x1000000000000000 valgrind --trace-children=no --child-silent-after-fork=yes --soname-synonyms=somalloc=*tcmalloc* --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --gen-suppressions=all --xml=yes --xml-file=/var/log/ceph/valgrind/ceph.client.0.log --time-stamp=yes --vgdb=yes --tool=memcheck --max-threads=1024 radosgw --rgw-frontends beast ssl_certificate=/home/ubuntu/cephtest/ca/rgw.client.0.crt ssl_port=443 -n client.0 --cluster ceph -k /etc/ceph/ceph.client.0.keyring --log-file /var/log/ceph/rgw.ceph.client.0.log --rgw_ops_log_socket_path /home/ubuntu/cephtest/rgw.opslog.ceph.client.0.sock --foreground (PID: 38460) UID: 0 2024-09-14T13:01:40.881 INFO:tasks.rgw.client.0.smithi138.stdout:2024-09-14T13:01:40.890+0000 8edcf80 -1 shutting down 2024-09-14T13:01:56.473 INFO:tasks.rgw.client.0.smithi138.stderr:==00:01:53:21.460 38464== could not unlink /tmp/vgdb-pipe-from-vgdb-to-38464-by-root-on-??? 2024-09-14T13:01:56.473 INFO:tasks.rgw.client.0.smithi138.stderr:==00:01:53:21.460 38464== could not unlink /tmp/vgdb-pipe-to-vgdb-from-38464-by-root-on-??? 2024-09-14T13:01:56.473 INFO:tasks.rgw.client.0.smithi138.stderr:==00:01:53:21.460 38464== could not unlink /tmp/vgdb-pipe-shared-mem-vgdb-38464-by-root-on-??? 2024-09-14T13:01:59.146 INFO:tasks.rgw.client.0:Stopped 2024-09-14T13:01:59.147 DEBUG:teuthology.orchestra.run.smithi138:> rm -f /home/ubuntu/cephtest/rgw.opslog.ceph.client.0.sock 2024-09-14T13:01:59.155 DEBUG:teuthology.orchestra.run.smithi138:> sudo rm -f /etc/ceph/vault-root-token 2024-09-14T13:01:59.210 DEBUG:teuthology.orchestra.run.smithi138:> sudo rm -f /home/ubuntu/cephtest/url_file 2024-09-14T13:01:59.264 INFO:tasks.util.rgw:rgwadmin: client.0 : ['gc', 'process', '--include-all'] 2024-09-14T13:01:59.265 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'gc', 'process', '--include-all'] 2024-09-14T13:01:59.265 DEBUG:teuthology.orchestra.run.smithi138:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph gc process --include-all 2024-09-14T13:01:59.345 INFO:teuthology.orchestra.run.smithi138.stderr:ignoring --setuser ceph since I am not root 2024-09-14T13:01:59.345 INFO:teuthology.orchestra.run.smithi138.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T13:01:59.388 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T13:01:59.394+0000 7fe4c30a89c0 20 rados->read ofs=0 len=0 2024-09-14T13:01:59.390 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T13:01:59.398+0000 7fe4c30a89c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T13:01:59.390 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T13:01:59.398+0000 7fe4c30a89c0 20 realm 2024-09-14T13:01:59.390 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T13:01:59.398+0000 7fe4c30a89c0 20 rados->read ofs=0 len=0 2024-09-14T13:01:59.390 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T13:01:59.398+0000 7fe4c30a89c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T13:01:59.390 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T13:01:59.398+0000 7fe4c30a89c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T13:01:59.390 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T13:01:59.398+0000 7fe4c30a89c0 20 rados->read ofs=0 len=0 2024-09-14T13:01:59.390 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T13:01:59.398+0000 7fe4c30a89c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T13:01:59.390 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T13:01:59.398+0000 7fe4c30a89c0 20 rados->read ofs=0 len=0 2024-09-14T13:01:59.392 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T13:01:59.398+0000 7fe4c30a89c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T13:01:59.392 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T13:01:59.398+0000 7fe4c30a89c0 20 rados->read ofs=0 len=0 2024-09-14T13:01:59.392 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T13:01:59.402+0000 7fe4c30a89c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T13:01:59.392 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T13:01:59.402+0000 7fe4c30a89c0 20 searching for the correct realm 2024-09-14T13:01:59.396 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T13:01:59.406+0000 7fe4c13af640 0 -- 172.21.15.138:0/3789072194 >> [v2:172.21.15.154:6824/416768175,v1:172.21.15.154:6825/416768175] conn(0x7fe4b801e030 msgr2=0x7fe4b809a370 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-14T13:01:59.614 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T13:01:59.622+0000 7fe4c03ad640 0 -- 172.21.15.138:0/3789072194 >> [v2:172.21.15.138:6816/326481658,v1:172.21.15.138:6817/326481658] conn(0x7fe4b806b140 msgr2=0x7fe4b8065780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T13:01:59.832 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T13:01:59.838+0000 7fe4c30a89c0 20 RGWRados::pool_iterate: got zone_info.d9e72d30-c60b-4d0d-9267-fdc36392d5ad 2024-09-14T13:01:59.832 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T13:01:59.838+0000 7fe4c30a89c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T13:01:59.832 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T13:01:59.838+0000 7fe4c30a89c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T13:01:59.832 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T13:01:59.838+0000 7fe4c30a89c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T13:01:59.832 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T13:01:59.838+0000 7fe4c30a89c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T13:01:59.832 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T13:01:59.838+0000 7fe4c30a89c0 20 RGWRados::pool_iterate: got zonegroup_info.65ab941b-da8c-4160-94fb-3672b069d44f 2024-09-14T13:01:59.832 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T13:01:59.838+0000 7fe4c30a89c0 20 rados->read ofs=0 len=0 2024-09-14T13:01:59.833 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T13:01:59.842+0000 7fe4c30a89c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T13:01:59.833 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T13:01:59.842+0000 7fe4c30a89c0 20 rados->read ofs=0 len=0 2024-09-14T13:01:59.833 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T13:01:59.842+0000 7fe4c30a89c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T13:01:59.833 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T13:01:59.842+0000 7fe4c30a89c0 20 rados->read ofs=0 len=0 2024-09-14T13:01:59.834 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T13:01:59.842+0000 7fe4c30a89c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T13:01:59.834 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T13:01:59.842+0000 7fe4c30a89c0 20 zone default found 2024-09-14T13:01:59.834 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T13:01:59.842+0000 7fe4c30a89c0 4 Realm: () 2024-09-14T13:01:59.834 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T13:01:59.842+0000 7fe4c30a89c0 4 ZoneGroup: default (65ab941b-da8c-4160-94fb-3672b069d44f) 2024-09-14T13:01:59.835 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T13:01:59.842+0000 7fe4c30a89c0 4 Zone: default (d9e72d30-c60b-4d0d-9267-fdc36392d5ad) 2024-09-14T13:01:59.835 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T13:01:59.842+0000 7fe4c30a89c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T13:01:59.835 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T13:01:59.842+0000 7fe4c30a89c0 20 zonegroup default 2024-09-14T13:01:59.835 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T13:01:59.842+0000 7fe4c30a89c0 20 rados->read ofs=0 len=0 2024-09-14T13:01:59.835 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T13:01:59.842+0000 7fe4c30a89c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T13:01:59.835 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T13:01:59.842+0000 7fe4c30a89c0 20 rados->read ofs=0 len=0 2024-09-14T13:01:59.836 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T13:01:59.842+0000 7fe4c30a89c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T13:01:59.836 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T13:01:59.846+0000 7fe4c30a89c0 20 rados->read ofs=0 len=0 2024-09-14T13:01:59.837 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T13:01:59.846+0000 7fe4c30a89c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T13:01:59.837 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T13:01:59.846+0000 7fe4c30a89c0 20 started sync module instance, tier type = 2024-09-14T13:01:59.837 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T13:01:59.846+0000 7fe4c30a89c0 20 started zone id=d9e72d30-c60b-4d0d-9267-fdc36392d5ad (name=default) with tier type = 2024-09-14T13:01:59.861 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T13:01:59.870+0000 7fe4c30a89c0 20 add_watcher() i=0 2024-09-14T13:01:59.861 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T13:01:59.870+0000 7fe4c30a89c0 20 add_watcher() i=1 2024-09-14T13:01:59.861 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T13:01:59.870+0000 7fe4c30a89c0 20 add_watcher() i=2 2024-09-14T13:01:59.861 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T13:01:59.870+0000 7fe4c30a89c0 20 add_watcher() i=3 2024-09-14T13:01:59.861 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T13:01:59.870+0000 7fe4c30a89c0 20 add_watcher() i=4 2024-09-14T13:01:59.861 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T13:01:59.870+0000 7fe4c30a89c0 20 add_watcher() i=5 2024-09-14T13:01:59.861 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T13:01:59.870+0000 7fe4c30a89c0 20 add_watcher() i=6 2024-09-14T13:01:59.863 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T13:01:59.870+0000 7fe4c30a89c0 20 add_watcher() i=7 2024-09-14T13:01:59.863 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T13:01:59.870+0000 7fe4c30a89c0 2 all 8 watchers are set, enabling cache 2024-09-14T13:01:59.867 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T13:01:59.874+0000 7fe3777e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T13:01:59.867 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T13:01:59.874+0000 7fe4c30a89c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T13:01:59.867 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T13:01:59.874+0000 7fe4c30a89c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T13:01:59.964 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T13:01:59.970+0000 7fe3767e4640 20 reqs_thread_entry: start 2024-09-14T13:01:59.965 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T13:01:59.974+0000 7fe4c30a89c0 20 init_complete bucket index max shards: 11 2024-09-14T13:01:59.965 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T13:01:59.974+0000 7fe4c30a89c0 20 Filter name: none 2024-09-14T13:01:59.965 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T13:01:59.974+0000 7fe36f7fe640 20 reqs_thread_entry: start 2024-09-14T13:01:59.965 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T13:01:59.974+0000 7fe4c30a89c0 20 garbage collection: RGWGC::process entered with GC index_shard=14, max_secs=3600, expired_only=0 2024-09-14T13:01:59.967 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T13:01:59.974+0000 7fe4c30a89c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T13:01:59.968 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T13:01:59.978+0000 7fe4c30a89c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T13:01:59.970 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T13:01:59.978+0000 7fe4c30a89c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=3, truncated=0, next_marker='' 2024-09-14T13:01:59.970 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T13:01:59.978+0000 7fe4c30a89c0 20 garbage collection: RGWGC::process iterating over entry tag='d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.6469720281240424128', time=2024-09-14T14:33:15.054113+0000, chain.objs.size()=2 2024-09-14T13:01:59.970 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T13:01:59.978+0000 7fe4c30a89c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.525__multipart_mymultipart.2~i3TxRvVSlaPuYkl3oyyhYNvRyboZpGY.1 2024-09-14T13:01:59.970 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T13:01:59.978+0000 7fe4c30a89c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.525__multipart_mymultipart.2~i3TxRvVSlaPuYkl3oyyhYNvRyboZpGY.2 2024-09-14T13:01:59.970 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T13:01:59.978+0000 7fe4c30a89c0 20 garbage collection: RGWGC::process iterating over entry tag='d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.14018057027220911096', time=2024-09-14T14:50:41.906270+0000, chain.objs.size()=6 2024-09-14T13:01:59.970 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T13:01:59.978+0000 7fe4c30a89c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.662__multipart_foo.2~lWRKbmnzJhV572XiJmswBuzHamdXGv5.1 2024-09-14T13:01:59.970 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T13:01:59.978+0000 7fe4c30a89c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.662__multipart_foo.2~lWRKbmnzJhV572XiJmswBuzHamdXGv5.2 2024-09-14T13:01:59.970 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T13:01:59.978+0000 7fe4c30a89c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.662__multipart_foo.2~lWRKbmnzJhV572XiJmswBuzHamdXGv5.3 2024-09-14T13:01:59.970 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T13:01:59.978+0000 7fe4c30a89c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.662__multipart_foo.2~lWRKbmnzJhV572XiJmswBuzHamdXGv5.4 2024-09-14T13:01:59.971 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T13:01:59.978+0000 7fe4c30a89c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.662__multipart_foo.2~lWRKbmnzJhV572XiJmswBuzHamdXGv5.5 2024-09-14T13:01:59.971 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T13:01:59.978+0000 7fe4c30a89c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.662__multipart_foo.2~lWRKbmnzJhV572XiJmswBuzHamdXGv5.6 2024-09-14T13:01:59.971 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T13:01:59.978+0000 7fe4c30a89c0 20 garbage collection: RGWGC::process iterating over entry tag='d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.13495342259193403328', time=2024-09-14T14:54:03.151887+0000, chain.objs.size()=10 2024-09-14T13:01:59.971 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T13:01:59.978+0000 7fe4c30a89c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.735__multipart_foo.2~AWaEnu_15EuPQ_l6VaUMDEdo498AJkx.1 2024-09-14T13:01:59.971 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T13:01:59.978+0000 7fe4c30a89c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.735__multipart_foo.2~AWaEnu_15EuPQ_l6VaUMDEdo498AJkx.2 2024-09-14T13:01:59.971 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T13:01:59.978+0000 7fe4c30a89c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.735__multipart_foo.2~AWaEnu_15EuPQ_l6VaUMDEdo498AJkx.3 2024-09-14T13:01:59.971 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T13:01:59.978+0000 7fe4c30a89c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.735__multipart_foo.2~AWaEnu_15EuPQ_l6VaUMDEdo498AJkx.4 2024-09-14T13:01:59.979 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T13:01:59.986+0000 7fe4c30a89c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.735__multipart_foo.2~AWaEnu_15EuPQ_l6VaUMDEdo498AJkx.5 2024-09-14T13:01:59.979 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T13:01:59.986+0000 7fe4c30a89c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.735__multipart_foo.2~AWaEnu_15EuPQ_l6VaUMDEdo498AJkx.6 2024-09-14T13:01:59.979 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T13:01:59.986+0000 7fe4c30a89c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.735__multipart_foo.2~AWaEnu_15EuPQ_l6VaUMDEdo498AJkx.7 2024-09-14T13:01:59.981 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T13:01:59.990+0000 7fe4c30a89c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.735__multipart_foo.2~AWaEnu_15EuPQ_l6VaUMDEdo498AJkx.8 2024-09-14T13:01:59.981 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T13:01:59.990+0000 7fe4c30a89c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.735__multipart_foo.2~AWaEnu_15EuPQ_l6VaUMDEdo498AJkx.9 2024-09-14T13:01:59.981 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T13:01:59.990+0000 7fe4c30a89c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.735__multipart_foo.2~AWaEnu_15EuPQ_l6VaUMDEdo498AJkx.10 2024-09-14T13:01:59.990 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T13:01:59.998+0000 7fe4c30a89c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T13:01:59.997 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T13:02:00.006+0000 7fe4c30a89c0 20 garbage collection: RGWGC::process entered with GC index_shard=15, max_secs=3600, expired_only=0 2024-09-14T13:02:00.000 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T13:02:00.010+0000 7fe4c30a89c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T13:02:00.002 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T13:02:00.010+0000 7fe4c30a89c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T13:02:00.003 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T13:02:00.010+0000 7fe4c30a89c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=2, truncated=0, next_marker='' 2024-09-14T13:02:00.003 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T13:02:00.010+0000 7fe4c30a89c0 20 garbage collection: RGWGC::process iterating over entry tag='_HNHnzCOZ1nvVv5-wdpm7QFFb94agkYG', time=2024-09-14T14:02:12.767584+0000, chain.objs.size()=3 2024-09-14T13:02:00.003 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T13:02:00.010+0000 7fe4c30a89c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.160__shadow_.85tUFLFNP6X9-2nhtYP75vywFV9q-Y7_0 2024-09-14T13:02:00.003 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T13:02:00.010+0000 7fe4c30a89c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.160__shadow_.85tUFLFNP6X9-2nhtYP75vywFV9q-Y7_1 2024-09-14T13:02:00.003 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T13:02:00.010+0000 7fe4c30a89c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.160__shadow_.85tUFLFNP6X9-2nhtYP75vywFV9q-Y7_2 2024-09-14T13:02:00.003 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T13:02:00.010+0000 7fe4c30a89c0 20 garbage collection: RGWGC::process iterating over entry tag='_-c6MVw-eKi8frCqr8gRFM2lOVqkm6vc', time=2024-09-14T14:02:12.842274+0000, chain.objs.size()=3 2024-09-14T13:02:00.003 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T13:02:00.010+0000 7fe4c30a89c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.160__shadow_.tOyL-VySKhR9Y3XsbicSMtg61N9cktN_0 2024-09-14T13:02:00.003 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T13:02:00.010+0000 7fe4c30a89c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.160__shadow_.tOyL-VySKhR9Y3XsbicSMtg61N9cktN_1 2024-09-14T13:02:00.004 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T13:02:00.010+0000 7fe4c30a89c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.160__shadow_.tOyL-VySKhR9Y3XsbicSMtg61N9cktN_2 2024-09-14T13:02:00.010 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T13:02:00.018+0000 7fe4c30a89c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T13:02:00.015 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T13:02:00.022+0000 7fe4c30a89c0 20 garbage collection: RGWGC::process entered with GC index_shard=16, max_secs=3600, expired_only=0 2024-09-14T13:02:00.019 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T13:02:00.026+0000 7fe4c30a89c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T13:02:00.020 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T13:02:00.026+0000 7fe4c30a89c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T13:02:00.021 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T13:02:00.030+0000 7fe4c30a89c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=9, truncated=0, next_marker='' 2024-09-14T13:02:00.021 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T13:02:00.030+0000 7fe4c30a89c0 20 garbage collection: RGWGC::process iterating over entry tag='_g0GDcb171nVX5xo-31v7um6ThQUYei0', time=2024-09-14T14:01:52.236985+0000, chain.objs.size()=3 2024-09-14T13:02:00.021 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T13:02:00.030+0000 7fe4c30a89c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.160__shadow_.sGypgqvY7aPBwamJZpOFaibP3VpYIk6_0 2024-09-14T13:02:00.021 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T13:02:00.030+0000 7fe4c30a89c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.160__shadow_.sGypgqvY7aPBwamJZpOFaibP3VpYIk6_1 2024-09-14T13:02:00.022 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T13:02:00.030+0000 7fe4c30a89c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.160__shadow_.sGypgqvY7aPBwamJZpOFaibP3VpYIk6_2 2024-09-14T13:02:00.022 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T13:02:00.030+0000 7fe4c30a89c0 20 garbage collection: RGWGC::process iterating over entry tag='2~OZMNRpEpuqckheQ8fxSV2djwmFgVB-F', time=2024-09-14T14:31:46.690190+0000, chain.objs.size()=2 2024-09-14T13:02:00.022 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T13:02:00.030+0000 7fe4c30a89c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.522__multipart_mymultipart.2~OZMNRpEpuqckheQ8fxSV2djwmFgVB-F.1 2024-09-14T13:02:00.022 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T13:02:00.030+0000 7fe4c30a89c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.522__shadow_mymultipart.2~OZMNRpEpuqckheQ8fxSV2djwmFgVB-F.1_1 2024-09-14T13:02:00.022 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T13:02:00.030+0000 7fe4c30a89c0 20 garbage collection: RGWGC::process iterating over entry tag='2~OZMNRpEpuqckheQ8fxSV2djwmFgVB-F', time=2024-09-14T14:31:46.701334+0000, chain.objs.size()=2 2024-09-14T13:02:00.022 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T13:02:00.030+0000 7fe4c30a89c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.522__multipart_mymultipart.2~OZMNRpEpuqckheQ8fxSV2djwmFgVB-F.2 2024-09-14T13:02:00.022 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T13:02:00.030+0000 7fe4c30a89c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.522__shadow_mymultipart.2~OZMNRpEpuqckheQ8fxSV2djwmFgVB-F.2_1 2024-09-14T13:02:00.022 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T13:02:00.030+0000 7fe4c30a89c0 20 garbage collection: RGWGC::process iterating over entry tag='2~OZMNRpEpuqckheQ8fxSV2djwmFgVB-F', time=2024-09-14T14:31:46.712431+0000, chain.objs.size()=2 2024-09-14T13:02:00.022 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T13:02:00.030+0000 7fe4c30a89c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.522__multipart_mymultipart.2~OZMNRpEpuqckheQ8fxSV2djwmFgVB-F.3 2024-09-14T13:02:00.022 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T13:02:00.030+0000 7fe4c30a89c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.522__shadow_mymultipart.2~OZMNRpEpuqckheQ8fxSV2djwmFgVB-F.3_1 2024-09-14T13:02:00.022 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T13:02:00.030+0000 7fe4c30a89c0 20 garbage collection: RGWGC::process iterating over entry tag='2~OZMNRpEpuqckheQ8fxSV2djwmFgVB-F', time=2024-09-14T14:31:46.723926+0000, chain.objs.size()=2 2024-09-14T13:02:00.022 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T13:02:00.030+0000 7fe4c30a89c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.522__multipart_mymultipart.2~OZMNRpEpuqckheQ8fxSV2djwmFgVB-F.4 2024-09-14T13:02:00.022 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T13:02:00.030+0000 7fe4c30a89c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.522__shadow_mymultipart.2~OZMNRpEpuqckheQ8fxSV2djwmFgVB-F.4_1 2024-09-14T13:02:00.022 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T13:02:00.030+0000 7fe4c30a89c0 20 garbage collection: RGWGC::process iterating over entry tag='2~OZMNRpEpuqckheQ8fxSV2djwmFgVB-F', time=2024-09-14T14:31:46.735101+0000, chain.objs.size()=2 2024-09-14T13:02:00.023 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T13:02:00.030+0000 7fe4c30a89c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.522__multipart_mymultipart.2~OZMNRpEpuqckheQ8fxSV2djwmFgVB-F.5 2024-09-14T13:02:00.024 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T13:02:00.034+0000 7fe4c30a89c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.522__shadow_mymultipart.2~OZMNRpEpuqckheQ8fxSV2djwmFgVB-F.5_1 2024-09-14T13:02:00.026 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T13:02:00.034+0000 7fe4c30a89c0 20 garbage collection: RGWGC::process iterating over entry tag='2~OZMNRpEpuqckheQ8fxSV2djwmFgVB-F', time=2024-09-14T14:31:46.746308+0000, chain.objs.size()=2 2024-09-14T13:02:00.026 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T13:02:00.034+0000 7fe4c30a89c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.522__multipart_mymultipart.2~OZMNRpEpuqckheQ8fxSV2djwmFgVB-F.6 2024-09-14T13:02:00.031 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T13:02:00.038+0000 7fe4c30a89c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.522__shadow_mymultipart.2~OZMNRpEpuqckheQ8fxSV2djwmFgVB-F.6_1 2024-09-14T13:02:00.031 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T13:02:00.038+0000 7fe4c30a89c0 20 garbage collection: RGWGC::process iterating over entry tag='d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.1618013102187501086', time=2024-09-14T14:40:05.158980+0000, chain.objs.size()=4 2024-09-14T13:02:00.031 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T13:02:00.038+0000 7fe4c30a89c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.578__multipart_testobj.2~JHjGrvC7Bd69h3YuQWf436irvJ-r3UX.1 2024-09-14T13:02:00.031 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T13:02:00.038+0000 7fe4c30a89c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.578__multipart_testobj.2~JHjGrvC7Bd69h3YuQWf436irvJ-r3UX.2 2024-09-14T13:02:00.031 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T13:02:00.038+0000 7fe4c30a89c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.578__multipart_testobj.2~JHjGrvC7Bd69h3YuQWf436irvJ-r3UX.3 2024-09-14T13:02:00.032 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T13:02:00.038+0000 7fe4c30a89c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.578__multipart_testobj.2~JHjGrvC7Bd69h3YuQWf436irvJ-r3UX.4 2024-09-14T13:02:00.032 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T13:02:00.038+0000 7fe4c30a89c0 20 garbage collection: RGWGC::process iterating over entry tag='d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.7951811108962749000', time=2024-09-14T14:49:03.478888+0000, chain.objs.size()=1 2024-09-14T13:02:00.032 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T13:02:00.038+0000 7fe4c30a89c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.646__shadow_.KMlxiLwi6_WQleaZ4PtFNUEUfHSPQST_1 2024-09-14T13:02:00.043 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T13:02:00.050+0000 7fe4c30a89c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T13:02:00.050 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T13:02:00.058+0000 7fe4c30a89c0 20 garbage collection: RGWGC::process entered with GC index_shard=17, max_secs=3600, expired_only=0 2024-09-14T13:02:00.052 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T13:02:00.058+0000 7fe4c30a89c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T13:02:00.052 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T13:02:00.062+0000 7fe4c30a89c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T13:02:00.053 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T13:02:00.062+0000 7fe4c30a89c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=4, truncated=0, next_marker='' 2024-09-14T13:02:00.053 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T13:02:00.062+0000 7fe4c30a89c0 20 garbage collection: RGWGC::process iterating over entry tag='d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.3934147926791585984', time=2024-09-14T14:26:49.364611+0000, chain.objs.size()=1 2024-09-14T13:02:00.054 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T13:02:00.062+0000 7fe4c30a89c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.516__multipart_mymultipartcopy.2~-S8buqHxRrF1sYA86R3ekQvtP5dJ8o5.1 2024-09-14T13:02:00.054 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T13:02:00.062+0000 7fe4c30a89c0 20 garbage collection: RGWGC::process iterating over entry tag='d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.4955322321408655609', time=2024-09-14T14:32:35.989620+0000, chain.objs.size()=3 2024-09-14T13:02:00.054 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T13:02:00.062+0000 7fe4c30a89c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.523__multipart_mymultipart.2~vyRU8TWkaZOA2okZamo8wgWg1ehx6DN.1 2024-09-14T13:02:00.054 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T13:02:00.062+0000 7fe4c30a89c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.523__multipart_mymultipart.2~vyRU8TWkaZOA2okZamo8wgWg1ehx6DN.2 2024-09-14T13:02:00.054 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T13:02:00.062+0000 7fe4c30a89c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.523__multipart_mymultipart.2~vyRU8TWkaZOA2okZamo8wgWg1ehx6DN.3 2024-09-14T13:02:00.054 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T13:02:00.062+0000 7fe4c30a89c0 20 garbage collection: RGWGC::process iterating over entry tag='d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.10314036848874726024', time=2024-09-14T14:32:53.746152+0000, chain.objs.size()=2 2024-09-14T13:02:00.054 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T13:02:00.062+0000 7fe4c30a89c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.525__multipart_mymultipart.2~WqWW2em1ItR-DQBjV40w09sHH0bY5MZ.1 2024-09-14T13:02:00.054 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T13:02:00.062+0000 7fe4c30a89c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.525__multipart_mymultipart.2~WqWW2em1ItR-DQBjV40w09sHH0bY5MZ.2 2024-09-14T13:02:00.054 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T13:02:00.062+0000 7fe4c30a89c0 20 garbage collection: RGWGC::process iterating over entry tag='d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.14083352996131132775', time=2024-09-14T14:50:40.652233+0000, chain.objs.size()=6 2024-09-14T13:02:00.054 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T13:02:00.062+0000 7fe4c30a89c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.660__multipart_bar.2~5KZsNFbGxBu64kVN8-BY1GsXjVIqurP.1 2024-09-14T13:02:00.054 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T13:02:00.062+0000 7fe4c30a89c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.660__multipart_bar.2~5KZsNFbGxBu64kVN8-BY1GsXjVIqurP.2 2024-09-14T13:02:00.054 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T13:02:00.062+0000 7fe4c30a89c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.660__multipart_bar.2~5KZsNFbGxBu64kVN8-BY1GsXjVIqurP.3 2024-09-14T13:02:00.054 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T13:02:00.062+0000 7fe4c30a89c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.660__multipart_bar.2~5KZsNFbGxBu64kVN8-BY1GsXjVIqurP.4 2024-09-14T13:02:00.055 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T13:02:00.062+0000 7fe4c30a89c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.660__multipart_bar.2~5KZsNFbGxBu64kVN8-BY1GsXjVIqurP.5 2024-09-14T13:02:00.055 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T13:02:00.062+0000 7fe4c30a89c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.660__multipart_bar.2~5KZsNFbGxBu64kVN8-BY1GsXjVIqurP.6 2024-09-14T13:02:00.065 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T13:02:00.074+0000 7fe4c30a89c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T13:02:00.069 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T13:02:00.078+0000 7fe4c30a89c0 20 garbage collection: RGWGC::process entered with GC index_shard=18, max_secs=3600, expired_only=0 2024-09-14T13:02:00.072 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T13:02:00.078+0000 7fe4c30a89c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T13:02:00.073 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T13:02:00.082+0000 7fe4c30a89c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T13:02:00.075 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T13:02:00.082+0000 7fe4c30a89c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=5, truncated=0, next_marker='' 2024-09-14T13:02:00.075 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T13:02:00.082+0000 7fe4c30a89c0 20 garbage collection: RGWGC::process iterating over entry tag='d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.18420486841221930042', time=2024-09-14T14:26:29.111510+0000, chain.objs.size()=12 2024-09-14T13:02:00.075 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T13:02:00.082+0000 7fe4c30a89c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.507__multipart_srcmultipart.2~EXHW4d-FcaQlnuv8jNuqvzTN8Oi9YbR.1 2024-09-14T13:02:00.075 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T13:02:00.082+0000 7fe4c30a89c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.507__shadow_srcmultipart.2~EXHW4d-FcaQlnuv8jNuqvzTN8Oi9YbR.1_1 2024-09-14T13:02:00.075 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T13:02:00.082+0000 7fe4c30a89c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.507__multipart_srcmultipart.2~EXHW4d-FcaQlnuv8jNuqvzTN8Oi9YbR.2 2024-09-14T13:02:00.075 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T13:02:00.082+0000 7fe4c30a89c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.507__shadow_srcmultipart.2~EXHW4d-FcaQlnuv8jNuqvzTN8Oi9YbR.2_1 2024-09-14T13:02:00.075 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T13:02:00.082+0000 7fe4c30a89c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.507__multipart_srcmultipart.2~EXHW4d-FcaQlnuv8jNuqvzTN8Oi9YbR.3 2024-09-14T13:02:00.075 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T13:02:00.082+0000 7fe4c30a89c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.507__shadow_srcmultipart.2~EXHW4d-FcaQlnuv8jNuqvzTN8Oi9YbR.3_1 2024-09-14T13:02:00.075 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T13:02:00.082+0000 7fe4c30a89c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.507__multipart_srcmultipart.2~EXHW4d-FcaQlnuv8jNuqvzTN8Oi9YbR.4 2024-09-14T13:02:00.075 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T13:02:00.082+0000 7fe4c30a89c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.507__shadow_srcmultipart.2~EXHW4d-FcaQlnuv8jNuqvzTN8Oi9YbR.4_1 2024-09-14T13:02:00.075 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T13:02:00.082+0000 7fe4c30a89c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.507__multipart_srcmultipart.2~EXHW4d-FcaQlnuv8jNuqvzTN8Oi9YbR.5 2024-09-14T13:02:00.076 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T13:02:00.082+0000 7fe4c30a89c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.507__shadow_srcmultipart.2~EXHW4d-FcaQlnuv8jNuqvzTN8Oi9YbR.5_1 2024-09-14T13:02:00.076 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T13:02:00.082+0000 7fe4c30a89c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.507__multipart_srcmultipart.2~EXHW4d-FcaQlnuv8jNuqvzTN8Oi9YbR.6 2024-09-14T13:02:00.076 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T13:02:00.082+0000 7fe4c30a89c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.507__shadow_srcmultipart.2~EXHW4d-FcaQlnuv8jNuqvzTN8Oi9YbR.6_1 2024-09-14T13:02:00.081 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T13:02:00.090+0000 7fe4c30a89c0 20 garbage collection: RGWGC::process iterating over entry tag='d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.3942483514225440060', time=2024-09-14T14:28:41.104594+0000, chain.objs.size()=6 2024-09-14T13:02:00.081 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T13:02:00.090+0000 7fe4c30a89c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.521__multipart_mymultipart.2~e98imWUl4oD5VIL-6AyOacymq2WxnCU.1 2024-09-14T13:02:00.086 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T13:02:00.094+0000 7fe4c30a89c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.521__shadow_mymultipart.2~e98imWUl4oD5VIL-6AyOacymq2WxnCU.1_1 2024-09-14T13:02:00.086 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T13:02:00.094+0000 7fe4c30a89c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.521__multipart_mymultipart.2~e98imWUl4oD5VIL-6AyOacymq2WxnCU.2 2024-09-14T13:02:00.086 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T13:02:00.094+0000 7fe4c30a89c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.521__shadow_mymultipart.2~e98imWUl4oD5VIL-6AyOacymq2WxnCU.2_1 2024-09-14T13:02:00.086 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T13:02:00.094+0000 7fe4c30a89c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.521__multipart_mymultipart.2~e98imWUl4oD5VIL-6AyOacymq2WxnCU.3 2024-09-14T13:02:00.086 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T13:02:00.094+0000 7fe4c30a89c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.521__shadow_mymultipart.2~e98imWUl4oD5VIL-6AyOacymq2WxnCU.3_1 2024-09-14T13:02:00.087 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T13:02:00.094+0000 7fe4c30a89c0 20 garbage collection: RGWGC::process iterating over entry tag='d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.11914345867131600500', time=2024-09-14T14:32:25.554212+0000, chain.objs.size()=2 2024-09-14T13:02:00.087 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T13:02:00.094+0000 7fe4c30a89c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.523__multipart_mymultipart.2~SSiMTq3wrUzyAB4b4H_3pud0mM7x6IK.1 2024-09-14T13:02:00.087 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T13:02:00.094+0000 7fe4c30a89c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.523__multipart_mymultipart.2~SSiMTq3wrUzyAB4b4H_3pud0mM7x6IK.2 2024-09-14T13:02:00.087 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T13:02:00.094+0000 7fe4c30a89c0 20 garbage collection: RGWGC::process iterating over entry tag='d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.8047384094051558117', time=2024-09-14T14:32:58.803644+0000, chain.objs.size()=2 2024-09-14T13:02:00.087 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T13:02:00.094+0000 7fe4c30a89c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.525__multipart_mymultipart.2~F-NTrXsld0YsUeZYHiVl2q5K9duJGzE.1 2024-09-14T13:02:00.087 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T13:02:00.094+0000 7fe4c30a89c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.525__multipart_mymultipart.2~F-NTrXsld0YsUeZYHiVl2q5K9duJGzE.2 2024-09-14T13:02:00.087 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T13:02:00.094+0000 7fe4c30a89c0 20 garbage collection: RGWGC::process iterating over entry tag='2~pwX9cFSaeeGITboa75mE85TrNMYg1fR', time=2024-09-14T14:33:48.946469+0000, chain.objs.size()=4 2024-09-14T13:02:00.087 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T13:02:00.094+0000 7fe4c30a89c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.529__multipart_mymultipart.2~pwX9cFSaeeGITboa75mE85TrNMYg1fR.1 2024-09-14T13:02:00.087 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T13:02:00.094+0000 7fe4c30a89c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.529__shadow_mymultipart.2~pwX9cFSaeeGITboa75mE85TrNMYg1fR.1_1 2024-09-14T13:02:00.095 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T13:02:00.102+0000 7fe4c30a89c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.529__multipart_mymultipart.2~pwX9cFSaeeGITboa75mE85TrNMYg1fR.2 2024-09-14T13:02:00.096 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T13:02:00.106+0000 7fe4c30a89c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.529__shadow_mymultipart.2~pwX9cFSaeeGITboa75mE85TrNMYg1fR.2_1 2024-09-14T13:02:00.103 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T13:02:00.110+0000 7fe4c30a89c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T13:02:00.107 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T13:02:00.114+0000 7fe4c30a89c0 20 garbage collection: RGWGC::process entered with GC index_shard=19, max_secs=3600, expired_only=0 2024-09-14T13:02:00.109 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T13:02:00.118+0000 7fe4c30a89c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T13:02:00.110 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T13:02:00.118+0000 7fe4c30a89c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T13:02:00.111 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T13:02:00.118+0000 7fe4c30a89c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=4, truncated=0, next_marker='' 2024-09-14T13:02:00.111 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T13:02:00.118+0000 7fe4c30a89c0 20 garbage collection: RGWGC::process iterating over entry tag='_WbvsjziCj5hA1Mn0N7wyzlqKwvpEJnk', time=2024-09-14T14:02:34.284008+0000, chain.objs.size()=2 2024-09-14T13:02:00.111 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T13:02:00.118+0000 7fe4c30a89c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.161__shadow_.JroXpFOz7KkL8wdCSFMQiV56_oEK9iz_1 2024-09-14T13:02:00.111 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T13:02:00.118+0000 7fe4c30a89c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.161__shadow_.JroXpFOz7KkL8wdCSFMQiV56_oEK9iz_2 2024-09-14T13:02:00.111 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T13:02:00.118+0000 7fe4c30a89c0 20 garbage collection: RGWGC::process iterating over entry tag='d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.13339115486056410191', time=2024-09-14T14:27:12.785068+0000, chain.objs.size()=1 2024-09-14T13:02:00.111 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T13:02:00.118+0000 7fe4c30a89c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.518__multipart_mymultipart.2~Sh-AjLwmYmA8iLQGmj4Z_oXTPwtlNu_.1 2024-09-14T13:02:00.111 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T13:02:00.118+0000 7fe4c30a89c0 20 garbage collection: RGWGC::process iterating over entry tag='2~xCpBozn4Ni21Q24Pdm0rAeISYkDjIIT', time=2024-09-14T14:30:14.045985+0000, chain.objs.size()=1 2024-09-14T13:02:00.111 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T13:02:00.118+0000 7fe4c30a89c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.522__multipart_mymultipart.2~xCpBozn4Ni21Q24Pdm0rAeISYkDjIIT.3 2024-09-14T13:02:00.111 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T13:02:00.118+0000 7fe4c30a89c0 20 garbage collection: RGWGC::process iterating over entry tag='d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.10446146713030466020', time=2024-09-14T14:37:13.940775+0000, chain.objs.size()=2 2024-09-14T13:02:00.112 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T13:02:00.118+0000 7fe4c30a89c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.563__shadow_.yZwKj1axzOlKhYXjpBv08am9gr61esL_1 2024-09-14T13:02:00.112 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T13:02:00.118+0000 7fe4c30a89c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.563__shadow_.yZwKj1axzOlKhYXjpBv08am9gr61esL_2 2024-09-14T13:02:00.115 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T13:02:00.122+0000 7fe4c30a89c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T13:02:00.119 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T13:02:00.126+0000 7fe4c30a89c0 20 garbage collection: RGWGC::process entered with GC index_shard=20, max_secs=3600, expired_only=0 2024-09-14T13:02:00.121 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T13:02:00.130+0000 7fe4c30a89c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T13:02:00.122 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T13:02:00.130+0000 7fe4c30a89c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T13:02:00.123 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T13:02:00.130+0000 7fe4c30a89c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=6, truncated=0, next_marker='' 2024-09-14T13:02:00.123 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T13:02:00.130+0000 7fe4c30a89c0 20 garbage collection: RGWGC::process iterating over entry tag='_nC-a-SPkCatG96M6aU5Uqu_LMqJHnDQ', time=2024-09-14T14:02:01.696679+0000, chain.objs.size()=2 2024-09-14T13:02:00.123 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T13:02:00.130+0000 7fe4c30a89c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.160__shadow_.smshoyCwvgyZN_6hTO9Strf4LykWC51_1 2024-09-14T13:02:00.123 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T13:02:00.130+0000 7fe4c30a89c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.160__shadow_.smshoyCwvgyZN_6hTO9Strf4LykWC51_2 2024-09-14T13:02:00.123 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T13:02:00.130+0000 7fe4c30a89c0 20 garbage collection: RGWGC::process iterating over entry tag='d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.6760619062668774661', time=2024-09-14T14:03:07.398489+0000, chain.objs.size()=2 2024-09-14T13:02:00.123 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T13:02:00.130+0000 7fe4c30a89c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.164__multipart_foo.2~Gl2kuMCChlNXceOg3lqlYiiArF1SNZZ.1 2024-09-14T13:02:00.123 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T13:02:00.130+0000 7fe4c30a89c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.164__multipart_foo.2~Gl2kuMCChlNXceOg3lqlYiiArF1SNZZ.2 2024-09-14T13:02:00.123 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T13:02:00.130+0000 7fe4c30a89c0 20 garbage collection: RGWGC::process iterating over entry tag='d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.12256098640415349293', time=2024-09-14T14:32:30.966288+0000, chain.objs.size()=3 2024-09-14T13:02:00.123 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T13:02:00.130+0000 7fe4c30a89c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.523__multipart_mymultipart.2~r6PY9lLZ8LPxTzsPz6DwKvn0Qjqq_e_.1 2024-09-14T13:02:00.123 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T13:02:00.130+0000 7fe4c30a89c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.523__multipart_mymultipart.2~r6PY9lLZ8LPxTzsPz6DwKvn0Qjqq_e_.2 2024-09-14T13:02:00.123 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T13:02:00.130+0000 7fe4c30a89c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.523__multipart_mymultipart.2~r6PY9lLZ8LPxTzsPz6DwKvn0Qjqq_e_.3 2024-09-14T13:02:00.124 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T13:02:00.130+0000 7fe4c30a89c0 20 garbage collection: RGWGC::process iterating over entry tag='d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.3916404221477601524', time=2024-09-14T14:33:14.468844+0000, chain.objs.size()=2 2024-09-14T13:02:00.124 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T13:02:00.130+0000 7fe4c30a89c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.524__shadow_.Z2bu04jJyfXOwOmzrYPKocx7TijqKGk_1 2024-09-14T13:02:00.124 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T13:02:00.130+0000 7fe4c30a89c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.524__shadow_.Z2bu04jJyfXOwOmzrYPKocx7TijqKGk_2 2024-09-14T13:02:00.124 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T13:02:00.130+0000 7fe4c30a89c0 20 garbage collection: RGWGC::process iterating over entry tag='d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.11292273159499155809', time=2024-09-14T14:36:22.442759+0000, chain.objs.size()=1 2024-09-14T13:02:00.124 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T13:02:00.130+0000 7fe4c30a89c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.555__shadow_.ajATF6U9XbLnECoVPHBOjrX6cR17TVe_1 2024-09-14T13:02:00.124 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T13:02:00.130+0000 7fe4c30a89c0 20 garbage collection: RGWGC::process iterating over entry tag='d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.10614709566295424097', time=2024-09-14T14:49:20.733429+0000, chain.objs.size()=1 2024-09-14T13:02:00.124 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T13:02:00.130+0000 7fe4c30a89c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.649__shadow_.BgImpkHtFBIeSx1EVWyzTBXoOGfLFg__1 2024-09-14T13:02:00.131 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T13:02:00.138+0000 7fe4c30a89c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T13:02:00.136 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T13:02:00.146+0000 7fe4c30a89c0 20 garbage collection: RGWGC::process entered with GC index_shard=21, max_secs=3600, expired_only=0 2024-09-14T13:02:00.139 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T13:02:00.146+0000 7fe4c30a89c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T13:02:00.139 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T13:02:00.146+0000 7fe4c30a89c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T13:02:00.140 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T13:02:00.150+0000 7fe4c30a89c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=3, truncated=0, next_marker='' 2024-09-14T13:02:00.140 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T13:02:00.150+0000 7fe4c30a89c0 20 garbage collection: RGWGC::process iterating over entry tag='2~YOVlFNvJeMhXInzy_5HdDavigQM-NtU', time=2024-09-14T14:34:22.134306+0000, chain.objs.size()=1 2024-09-14T13:02:00.140 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T13:02:00.150+0000 7fe4c30a89c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.535__multipart_mymultipart.2~YOVlFNvJeMhXInzy_5HdDavigQM-NtU.3 2024-09-14T13:02:00.141 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T13:02:00.150+0000 7fe4c30a89c0 20 garbage collection: RGWGC::process iterating over entry tag='d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.10836496309163344821', time=2024-09-14T14:49:50.972873+0000, chain.objs.size()=1 2024-09-14T13:02:00.141 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T13:02:00.150+0000 7fe4c30a89c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.656__shadow_.6UVdYRbdmjIcu7HFti3-NN9eTe-XAQJ_1 2024-09-14T13:02:00.141 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T13:02:00.150+0000 7fe4c30a89c0 20 garbage collection: RGWGC::process iterating over entry tag='d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.4212015707682849430', time=2024-09-14T14:50:41.281103+0000, chain.objs.size()=6 2024-09-14T13:02:00.141 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T13:02:00.150+0000 7fe4c30a89c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.661__multipart_baz.2~etTJOtkt5UMCRatlGlECtLMi2FQ1fVp.1 2024-09-14T13:02:00.141 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T13:02:00.150+0000 7fe4c30a89c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.661__multipart_baz.2~etTJOtkt5UMCRatlGlECtLMi2FQ1fVp.2 2024-09-14T13:02:00.141 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T13:02:00.150+0000 7fe4c30a89c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.661__multipart_baz.2~etTJOtkt5UMCRatlGlECtLMi2FQ1fVp.3 2024-09-14T13:02:00.141 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T13:02:00.150+0000 7fe4c30a89c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.661__multipart_baz.2~etTJOtkt5UMCRatlGlECtLMi2FQ1fVp.4 2024-09-14T13:02:00.141 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T13:02:00.150+0000 7fe4c30a89c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.661__multipart_baz.2~etTJOtkt5UMCRatlGlECtLMi2FQ1fVp.5 2024-09-14T13:02:00.141 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T13:02:00.150+0000 7fe4c30a89c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.661__multipart_baz.2~etTJOtkt5UMCRatlGlECtLMi2FQ1fVp.6 2024-09-14T13:02:00.146 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T13:02:00.154+0000 7fe4c30a89c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T13:02:00.149 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T13:02:00.158+0000 7fe4c30a89c0 20 garbage collection: RGWGC::process entered with GC index_shard=22, max_secs=3600, expired_only=0 2024-09-14T13:02:00.151 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T13:02:00.158+0000 7fe4c30a89c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T13:02:00.152 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T13:02:00.162+0000 7fe4c30a89c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T13:02:00.153 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T13:02:00.162+0000 7fe4c30a89c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=4, truncated=0, next_marker='' 2024-09-14T13:02:00.153 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T13:02:00.162+0000 7fe4c30a89c0 20 garbage collection: RGWGC::process iterating over entry tag='d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.8723770287919358560', time=2024-09-14T14:01:24.477399+0000, chain.objs.size()=3 2024-09-14T13:02:00.153 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T13:02:00.162+0000 7fe4c30a89c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.158__shadow_.jbQr_1q1w96tMZzlz1Y_jN9R8seHshL_0 2024-09-14T13:02:00.153 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T13:02:00.162+0000 7fe4c30a89c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.158__shadow_.jbQr_1q1w96tMZzlz1Y_jN9R8seHshL_1 2024-09-14T13:02:00.153 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T13:02:00.162+0000 7fe4c30a89c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.158__shadow_.jbQr_1q1w96tMZzlz1Y_jN9R8seHshL_2 2024-09-14T13:02:00.153 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T13:02:00.162+0000 7fe4c30a89c0 20 garbage collection: RGWGC::process iterating over entry tag='d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.6328508925761734447', time=2024-09-14T14:02:20.521885+0000, chain.objs.size()=3 2024-09-14T13:02:00.153 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T13:02:00.162+0000 7fe4c30a89c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.161__multipart_foo-STANDARD.2~lrMfOzD-jZfKh1_aTHyF5nHnH4TUYPf.1 2024-09-14T13:02:00.153 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T13:02:00.162+0000 7fe4c30a89c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.161__multipart_foo-STANDARD.2~lrMfOzD-jZfKh1_aTHyF5nHnH4TUYPf.2 2024-09-14T13:02:00.154 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T13:02:00.162+0000 7fe4c30a89c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.161__multipart_foo-STANDARD.2~lrMfOzD-jZfKh1_aTHyF5nHnH4TUYPf.3 2024-09-14T13:02:00.154 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T13:02:00.162+0000 7fe4c30a89c0 20 garbage collection: RGWGC::process iterating over entry tag='_NjCow80BPfKRzEB8UKezU1c1sXgm8bj', time=2024-09-14T14:03:07.983776+0000, chain.objs.size()=1 2024-09-14T13:02:00.154 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T13:02:00.162+0000 7fe4c30a89c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.165__shadow_.vlyDwxomZcPpKf6eseasqY9_PGrU6Xh_0 2024-09-14T13:02:00.154 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T13:02:00.162+0000 7fe4c30a89c0 20 garbage collection: RGWGC::process iterating over entry tag='d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.6131244782628178065', time=2024-09-14T14:27:00.305422+0000, chain.objs.size()=1 2024-09-14T13:02:00.154 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T13:02:00.162+0000 7fe4c30a89c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.518__multipart_mymultipart.2~IAR8rCEQ27lUAxzLwGz7KjQ26F_96fW.1 2024-09-14T13:02:00.157 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T13:02:00.166+0000 7fe4c30a89c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T13:02:00.161 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T13:02:00.170+0000 7fe4c30a89c0 20 garbage collection: RGWGC::process entered with GC index_shard=23, max_secs=3600, expired_only=0 2024-09-14T13:02:00.163 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T13:02:00.170+0000 7fe4c30a89c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T13:02:00.163 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T13:02:00.170+0000 7fe4c30a89c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T13:02:00.164 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T13:02:00.170+0000 7fe4c30a89c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=3, truncated=0, next_marker='' 2024-09-14T13:02:00.164 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T13:02:00.170+0000 7fe4c30a89c0 20 garbage collection: RGWGC::process iterating over entry tag='2~ertgY3X7JE7HgLbkz6vrNlTPpy8VlN2', time=2024-09-14T14:34:09.135011+0000, chain.objs.size()=1 2024-09-14T13:02:00.164 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T13:02:00.170+0000 7fe4c30a89c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.534__multipart_mymultipart.2~ertgY3X7JE7HgLbkz6vrNlTPpy8VlN2.1 2024-09-14T13:02:00.164 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T13:02:00.170+0000 7fe4c30a89c0 20 garbage collection: RGWGC::process iterating over entry tag='d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.9396872569191756051', time=2024-09-14T14:40:10.057251+0000, chain.objs.size()=4 2024-09-14T13:02:00.164 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T13:02:00.170+0000 7fe4c30a89c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.578__multipart_testobj.2~TyqlWAFtO0qyoWTxNGv3k8aphfvzpyg.1 2024-09-14T13:02:00.165 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T13:02:00.170+0000 7fe4c30a89c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.578__multipart_testobj.2~TyqlWAFtO0qyoWTxNGv3k8aphfvzpyg.2 2024-09-14T13:02:00.165 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T13:02:00.170+0000 7fe4c30a89c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.578__multipart_testobj.2~TyqlWAFtO0qyoWTxNGv3k8aphfvzpyg.3 2024-09-14T13:02:00.165 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T13:02:00.170+0000 7fe4c30a89c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.578__multipart_testobj.2~TyqlWAFtO0qyoWTxNGv3k8aphfvzpyg.4 2024-09-14T13:02:00.165 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T13:02:00.170+0000 7fe4c30a89c0 20 garbage collection: RGWGC::process iterating over entry tag='d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.2873377429189595818', time=2024-09-14T15:00:10.983287+0000, chain.objs.size()=4 2024-09-14T13:02:00.165 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T13:02:00.170+0000 7fe4c30a89c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.779__shadow_.f8fSEoQU_g2DLOjTd9BVsViBQ2bFQAP_1 2024-09-14T13:02:00.165 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T13:02:00.174+0000 7fe4c30a89c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.779__shadow_.f8fSEoQU_g2DLOjTd9BVsViBQ2bFQAP_2 2024-09-14T13:02:00.165 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T13:02:00.174+0000 7fe4c30a89c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.779__shadow_.f8fSEoQU_g2DLOjTd9BVsViBQ2bFQAP_3 2024-09-14T13:02:00.165 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T13:02:00.174+0000 7fe4c30a89c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.779__shadow_.f8fSEoQU_g2DLOjTd9BVsViBQ2bFQAP_4 2024-09-14T13:02:00.170 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T13:02:00.178+0000 7fe4c30a89c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T13:02:00.174 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T13:02:00.182+0000 7fe4c30a89c0 20 garbage collection: RGWGC::process entered with GC index_shard=24, max_secs=3600, expired_only=0 2024-09-14T13:02:00.176 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T13:02:00.182+0000 7fe4c30a89c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T13:02:00.176 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T13:02:00.186+0000 7fe4c30a89c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T13:02:00.177 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T13:02:00.186+0000 7fe4c30a89c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=2, truncated=0, next_marker='' 2024-09-14T13:02:00.177 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T13:02:00.186+0000 7fe4c30a89c0 20 garbage collection: RGWGC::process iterating over entry tag='d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.4005021104703633299', time=2024-09-14T14:01:24.404195+0000, chain.objs.size()=3 2024-09-14T13:02:00.177 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T13:02:00.186+0000 7fe4c30a89c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.158__shadow_.Wvi5P5tmyKQdhpojWFqH6MX0SK3ix4M_0 2024-09-14T13:02:00.178 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T13:02:00.186+0000 7fe4c30a89c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.158__shadow_.Wvi5P5tmyKQdhpojWFqH6MX0SK3ix4M_1 2024-09-14T13:02:00.178 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T13:02:00.186+0000 7fe4c30a89c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.158__shadow_.Wvi5P5tmyKQdhpojWFqH6MX0SK3ix4M_2 2024-09-14T13:02:00.178 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T13:02:00.186+0000 7fe4c30a89c0 20 garbage collection: RGWGC::process iterating over entry tag='d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.13743748311715625745', time=2024-09-14T14:32:20.475669+0000, chain.objs.size()=2 2024-09-14T13:02:00.178 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T13:02:00.186+0000 7fe4c30a89c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.523__multipart_mymultipart.2~pGH5bjTFzQF5kAcejk9h5J-jMvcUoLY.1 2024-09-14T13:02:00.178 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T13:02:00.186+0000 7fe4c30a89c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.523__multipart_mymultipart.2~pGH5bjTFzQF5kAcejk9h5J-jMvcUoLY.2 2024-09-14T13:02:00.180 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T13:02:00.190+0000 7fe4c30a89c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T13:02:00.183 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T13:02:00.190+0000 7fe4c30a89c0 20 garbage collection: RGWGC::process entered with GC index_shard=25, max_secs=3600, expired_only=0 2024-09-14T13:02:00.185 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T13:02:00.194+0000 7fe4c30a89c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T13:02:00.186 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T13:02:00.194+0000 7fe4c30a89c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T13:02:00.187 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T13:02:00.194+0000 7fe4c30a89c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=4, truncated=0, next_marker='' 2024-09-14T13:02:00.187 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T13:02:00.194+0000 7fe4c30a89c0 20 garbage collection: RGWGC::process iterating over entry tag='d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.14679255002658940179', time=2024-09-14T14:01:50.559080+0000, chain.objs.size()=2 2024-09-14T13:02:00.187 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T13:02:00.194+0000 7fe4c30a89c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.160__shadow_.GR0s5Ec_XQl-T7G6d8ZN_hHqtZnXhGM_1 2024-09-14T13:02:00.187 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T13:02:00.194+0000 7fe4c30a89c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.160__shadow_.GR0s5Ec_XQl-T7G6d8ZN_hHqtZnXhGM_2 2024-09-14T13:02:00.187 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T13:02:00.194+0000 7fe4c30a89c0 20 garbage collection: RGWGC::process iterating over entry tag='_owCiDONB9dNLPziGfEysOJ68Ey2U_BP', time=2024-09-14T14:02:11.040231+0000, chain.objs.size()=2 2024-09-14T13:02:00.187 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T13:02:00.194+0000 7fe4c30a89c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.160__shadow_.nawBpaGcmpzT8eQ98jQK8bYHKkI8YjO_1 2024-09-14T13:02:00.188 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T13:02:00.194+0000 7fe4c30a89c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.160__shadow_.nawBpaGcmpzT8eQ98jQK8bYHKkI8YjO_2 2024-09-14T13:02:00.188 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T13:02:00.194+0000 7fe4c30a89c0 20 garbage collection: RGWGC::process iterating over entry tag='d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.17988266455936633714', time=2024-09-14T14:28:33.648780+0000, chain.objs.size()=3 2024-09-14T13:02:00.188 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T13:02:00.194+0000 7fe4c30a89c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.521__multipart_mymultipart.2~FarxFPN4ycXQzwHAjFOLarcO_IBMaw_.1 2024-09-14T13:02:00.188 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T13:02:00.194+0000 7fe4c30a89c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.521__multipart_mymultipart.2~FarxFPN4ycXQzwHAjFOLarcO_IBMaw_.2 2024-09-14T13:02:00.188 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T13:02:00.194+0000 7fe4c30a89c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.521__multipart_mymultipart.2~FarxFPN4ycXQzwHAjFOLarcO_IBMaw_.3 2024-09-14T13:02:00.188 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T13:02:00.194+0000 7fe4c30a89c0 20 garbage collection: RGWGC::process iterating over entry tag='d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.18119870761978179391', time=2024-09-14T14:32:17.286339+0000, chain.objs.size()=1 2024-09-14T13:02:00.188 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T13:02:00.194+0000 7fe4c30a89c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.523__multipart_mymultipart.2~pRGbKD-Fp-n8psqo1wBBkFW7W2WW-Ut.1 2024-09-14T13:02:00.191 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T13:02:00.198+0000 7fe4c30a89c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T13:02:00.195 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T13:02:00.202+0000 7fe4c30a89c0 20 garbage collection: RGWGC::process entered with GC index_shard=26, max_secs=3600, expired_only=0 2024-09-14T13:02:00.197 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T13:02:00.206+0000 7fe4c30a89c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T13:02:00.197 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T13:02:00.206+0000 7fe4c30a89c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T13:02:00.198 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T13:02:00.206+0000 7fe4c30a89c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=2, truncated=0, next_marker='' 2024-09-14T13:02:00.198 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T13:02:00.206+0000 7fe4c30a89c0 20 garbage collection: RGWGC::process iterating over entry tag='d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.10574141856795466017', time=2024-09-14T14:47:22.600807+0000, chain.objs.size()=12 2024-09-14T13:02:00.198 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T13:02:00.206+0000 7fe4c30a89c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.623__multipart_multipart_enc.2~VQEmKpqtY9yZGd-1yn6zHCvMvjH_5qt.1 2024-09-14T13:02:00.199 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T13:02:00.206+0000 7fe4c30a89c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.623__shadow_multipart_enc.2~VQEmKpqtY9yZGd-1yn6zHCvMvjH_5qt.1_1 2024-09-14T13:02:00.199 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T13:02:00.206+0000 7fe4c30a89c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.623__multipart_multipart_enc.2~VQEmKpqtY9yZGd-1yn6zHCvMvjH_5qt.2 2024-09-14T13:02:00.199 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T13:02:00.206+0000 7fe4c30a89c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.623__shadow_multipart_enc.2~VQEmKpqtY9yZGd-1yn6zHCvMvjH_5qt.2_1 2024-09-14T13:02:00.199 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T13:02:00.206+0000 7fe4c30a89c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.623__multipart_multipart_enc.2~VQEmKpqtY9yZGd-1yn6zHCvMvjH_5qt.3 2024-09-14T13:02:00.199 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T13:02:00.206+0000 7fe4c30a89c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.623__shadow_multipart_enc.2~VQEmKpqtY9yZGd-1yn6zHCvMvjH_5qt.3_1 2024-09-14T13:02:00.199 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T13:02:00.206+0000 7fe4c30a89c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.623__multipart_multipart_enc.2~VQEmKpqtY9yZGd-1yn6zHCvMvjH_5qt.4 2024-09-14T13:02:00.199 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T13:02:00.206+0000 7fe4c30a89c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.623__shadow_multipart_enc.2~VQEmKpqtY9yZGd-1yn6zHCvMvjH_5qt.4_1 2024-09-14T13:02:00.199 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T13:02:00.206+0000 7fe4c30a89c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.623__multipart_multipart_enc.2~VQEmKpqtY9yZGd-1yn6zHCvMvjH_5qt.5 2024-09-14T13:02:00.199 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T13:02:00.206+0000 7fe4c30a89c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.623__shadow_multipart_enc.2~VQEmKpqtY9yZGd-1yn6zHCvMvjH_5qt.5_1 2024-09-14T13:02:00.199 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T13:02:00.206+0000 7fe4c30a89c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.623__multipart_multipart_enc.2~VQEmKpqtY9yZGd-1yn6zHCvMvjH_5qt.6 2024-09-14T13:02:00.199 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T13:02:00.206+0000 7fe4c30a89c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.623__shadow_multipart_enc.2~VQEmKpqtY9yZGd-1yn6zHCvMvjH_5qt.6_1 2024-09-14T13:02:00.203 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T13:02:00.210+0000 7fe4c30a89c0 20 garbage collection: RGWGC::process iterating over entry tag='d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.12741640843471782327', time=2024-09-14T14:52:30.013242+0000, chain.objs.size()=1 2024-09-14T13:02:00.203 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T13:02:00.210+0000 7fe4c30a89c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.711__multipart_file1.2~bGFlMRMcftOrYMDbZXHuLP8m87RYnsz.1 2024-09-14T13:02:00.208 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T13:02:00.214+0000 7fe4c30a89c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T13:02:00.211 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T13:02:00.218+0000 7fe4c30a89c0 20 garbage collection: RGWGC::process entered with GC index_shard=27, max_secs=3600, expired_only=0 2024-09-14T13:02:00.213 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T13:02:00.222+0000 7fe4c30a89c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T13:02:00.214 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T13:02:00.222+0000 7fe4c30a89c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T13:02:00.214 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T13:02:00.222+0000 7fe4c30a89c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=3, truncated=0, next_marker='' 2024-09-14T13:02:00.214 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T13:02:00.222+0000 7fe4c30a89c0 20 garbage collection: RGWGC::process iterating over entry tag='d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.9345018733337880562', time=2024-09-14T14:33:10.575115+0000, chain.objs.size()=3 2024-09-14T13:02:00.214 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T13:02:00.222+0000 7fe4c30a89c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.525__multipart_mymultipart.2~zbkMgeMiJcdTx0tVuNO5VZZ1O6LnTVH.1 2024-09-14T13:02:00.214 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T13:02:00.222+0000 7fe4c30a89c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.525__multipart_mymultipart.2~zbkMgeMiJcdTx0tVuNO5VZZ1O6LnTVH.2 2024-09-14T13:02:00.214 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T13:02:00.222+0000 7fe4c30a89c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.525__multipart_mymultipart.2~zbkMgeMiJcdTx0tVuNO5VZZ1O6LnTVH.3 2024-09-14T13:02:00.215 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T13:02:00.222+0000 7fe4c30a89c0 20 garbage collection: RGWGC::process iterating over entry tag='2~76Wh-LI5JWTnQQUE_IerqrTLy-FrZwa', time=2024-09-14T14:34:01.465931+0000, chain.objs.size()=1 2024-09-14T13:02:00.215 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T13:02:00.222+0000 7fe4c30a89c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.531__multipart_mymultipart2.2~76Wh-LI5JWTnQQUE_IerqrTLy-FrZwa.1 2024-09-14T13:02:00.215 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T13:02:00.222+0000 7fe4c30a89c0 20 garbage collection: RGWGC::process iterating over entry tag='d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.14082326894644633521', time=2024-09-14T14:34:45.112040+0000, chain.objs.size()=1 2024-09-14T13:02:00.215 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T13:02:00.222+0000 7fe4c30a89c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.536__multipart_mymultipart.2~m6WQHZXidOMq4djRE-sdVRO1LNMjoWs.1 2024-09-14T13:02:00.217 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T13:02:00.226+0000 7fe4c30a89c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T13:02:00.221 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T13:02:00.230+0000 7fe4c30a89c0 20 garbage collection: RGWGC::process entered with GC index_shard=28, max_secs=3600, expired_only=0 2024-09-14T13:02:00.223 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T13:02:00.230+0000 7fe4c30a89c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T13:02:00.223 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T13:02:00.230+0000 7fe4c30a89c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T13:02:00.224 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T13:02:00.230+0000 7fe4c30a89c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=4, truncated=0, next_marker='' 2024-09-14T13:02:00.224 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T13:02:00.230+0000 7fe4c30a89c0 20 garbage collection: RGWGC::process iterating over entry tag='d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.12394111704141680325', time=2024-09-14T14:26:30.459139+0000, chain.objs.size()=12 2024-09-14T13:02:00.224 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T13:02:00.230+0000 7fe4c30a89c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.507__multipart_srcmultipart.2~EXHW4d-FcaQlnuv8jNuqvzTN8Oi9YbR.1 2024-09-14T13:02:00.225 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T13:02:00.230+0000 7fe4c30a89c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.507__shadow_srcmultipart.2~EXHW4d-FcaQlnuv8jNuqvzTN8Oi9YbR.1_1 2024-09-14T13:02:00.225 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T13:02:00.230+0000 7fe4c30a89c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.507__multipart_srcmultipart.2~EXHW4d-FcaQlnuv8jNuqvzTN8Oi9YbR.2 2024-09-14T13:02:00.225 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T13:02:00.230+0000 7fe4c30a89c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.507__shadow_srcmultipart.2~EXHW4d-FcaQlnuv8jNuqvzTN8Oi9YbR.2_1 2024-09-14T13:02:00.225 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T13:02:00.230+0000 7fe4c30a89c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.507__multipart_srcmultipart.2~EXHW4d-FcaQlnuv8jNuqvzTN8Oi9YbR.3 2024-09-14T13:02:00.225 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T13:02:00.230+0000 7fe4c30a89c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.507__shadow_srcmultipart.2~EXHW4d-FcaQlnuv8jNuqvzTN8Oi9YbR.3_1 2024-09-14T13:02:00.225 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T13:02:00.230+0000 7fe4c30a89c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.507__multipart_srcmultipart.2~EXHW4d-FcaQlnuv8jNuqvzTN8Oi9YbR.4 2024-09-14T13:02:00.225 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T13:02:00.230+0000 7fe4c30a89c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.507__shadow_srcmultipart.2~EXHW4d-FcaQlnuv8jNuqvzTN8Oi9YbR.4_1 2024-09-14T13:02:00.225 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T13:02:00.230+0000 7fe4c30a89c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.507__multipart_srcmultipart.2~EXHW4d-FcaQlnuv8jNuqvzTN8Oi9YbR.5 2024-09-14T13:02:00.225 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T13:02:00.230+0000 7fe4c30a89c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.507__shadow_srcmultipart.2~EXHW4d-FcaQlnuv8jNuqvzTN8Oi9YbR.5_1 2024-09-14T13:02:00.225 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T13:02:00.230+0000 7fe4c30a89c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.507__multipart_srcmultipart.2~EXHW4d-FcaQlnuv8jNuqvzTN8Oi9YbR.6 2024-09-14T13:02:00.225 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T13:02:00.234+0000 7fe4c30a89c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.507__shadow_srcmultipart.2~EXHW4d-FcaQlnuv8jNuqvzTN8Oi9YbR.6_1 2024-09-14T13:02:00.229 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T13:02:00.238+0000 7fe4c30a89c0 20 garbage collection: RGWGC::process iterating over entry tag='d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.2020318189828045549', time=2024-09-14T14:39:58.290418+0000, chain.objs.size()=7 2024-09-14T13:02:00.229 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T13:02:00.238+0000 7fe4c30a89c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.578__multipart_testobj.2~HdPXCrpRu3x3ZhKpI7Ub6PGxh8os3k1.1 2024-09-14T13:02:00.230 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T13:02:00.238+0000 7fe4c30a89c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.578__shadow_testobj.2~HdPXCrpRu3x3ZhKpI7Ub6PGxh8os3k1.1_1 2024-09-14T13:02:00.230 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T13:02:00.238+0000 7fe4c30a89c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.578__multipart_testobj.2~HdPXCrpRu3x3ZhKpI7Ub6PGxh8os3k1.2 2024-09-14T13:02:00.230 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T13:02:00.238+0000 7fe4c30a89c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.578__shadow_testobj.2~HdPXCrpRu3x3ZhKpI7Ub6PGxh8os3k1.2_1 2024-09-14T13:02:00.230 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T13:02:00.238+0000 7fe4c30a89c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.578__multipart_testobj.2~HdPXCrpRu3x3ZhKpI7Ub6PGxh8os3k1.3 2024-09-14T13:02:00.230 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T13:02:00.238+0000 7fe4c30a89c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.578__shadow_testobj.2~HdPXCrpRu3x3ZhKpI7Ub6PGxh8os3k1.3_1 2024-09-14T13:02:00.230 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T13:02:00.238+0000 7fe4c30a89c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.578__multipart_testobj.2~HdPXCrpRu3x3ZhKpI7Ub6PGxh8os3k1.4 2024-09-14T13:02:00.231 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T13:02:00.238+0000 7fe4c30a89c0 20 garbage collection: RGWGC::process iterating over entry tag='d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.9500625920381642792', time=2024-09-14T14:54:22.290635+0000, chain.objs.size()=1 2024-09-14T13:02:00.231 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T13:02:00.238+0000 7fe4c30a89c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.742__multipart_mymultipart3.2~mqYChFhbXcbOQtGtGr0ySI4gXcUQBsL.1 2024-09-14T13:02:00.231 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T13:02:00.238+0000 7fe4c30a89c0 20 garbage collection: RGWGC::process iterating over entry tag='2~QVqVKJ0XNJ7HuQp3hCz0Lu8dtrTF6i7', time=2024-09-14T14:54:22.547061+0000, chain.objs.size()=1 2024-09-14T13:02:00.231 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T13:02:00.238+0000 7fe4c30a89c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.742__multipart_mymultipart.2~QVqVKJ0XNJ7HuQp3hCz0Lu8dtrTF6i7.1 2024-09-14T13:02:00.237 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T13:02:00.246+0000 7fe4c30a89c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T13:02:00.241 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T13:02:00.250+0000 7fe4c30a89c0 20 garbage collection: RGWGC::process entered with GC index_shard=29, max_secs=3600, expired_only=0 2024-09-14T13:02:00.242 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T13:02:00.250+0000 7fe4c30a89c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T13:02:00.243 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T13:02:00.250+0000 7fe4c30a89c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T13:02:00.244 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T13:02:00.250+0000 7fe4c30a89c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=5, truncated=0, next_marker='' 2024-09-14T13:02:00.244 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T13:02:00.250+0000 7fe4c30a89c0 20 garbage collection: RGWGC::process iterating over entry tag='2~y5QMyTpVwJPOauphOqH8GSXP5TzrE21', time=2024-09-14T14:04:56.479847+0000, chain.objs.size()=2 2024-09-14T13:02:00.244 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T13:02:00.250+0000 7fe4c30a89c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.201__multipart_mymultipart.2~y5QMyTpVwJPOauphOqH8GSXP5TzrE21.1 2024-09-14T13:02:00.245 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T13:02:00.250+0000 7fe4c30a89c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.201__shadow_mymultipart.2~y5QMyTpVwJPOauphOqH8GSXP5TzrE21.1_1 2024-09-14T13:02:00.245 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T13:02:00.250+0000 7fe4c30a89c0 20 garbage collection: RGWGC::process iterating over entry tag='d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.8880425809521826759', time=2024-09-14T14:26:29.186507+0000, chain.objs.size()=12 2024-09-14T13:02:00.245 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T13:02:00.250+0000 7fe4c30a89c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.507__multipart_srcmultipart.2~EXHW4d-FcaQlnuv8jNuqvzTN8Oi9YbR.1 2024-09-14T13:02:00.245 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T13:02:00.250+0000 7fe4c30a89c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.507__shadow_srcmultipart.2~EXHW4d-FcaQlnuv8jNuqvzTN8Oi9YbR.1_1 2024-09-14T13:02:00.245 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T13:02:00.250+0000 7fe4c30a89c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.507__multipart_srcmultipart.2~EXHW4d-FcaQlnuv8jNuqvzTN8Oi9YbR.2 2024-09-14T13:02:00.245 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T13:02:00.250+0000 7fe4c30a89c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.507__shadow_srcmultipart.2~EXHW4d-FcaQlnuv8jNuqvzTN8Oi9YbR.2_1 2024-09-14T13:02:00.245 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T13:02:00.250+0000 7fe4c30a89c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.507__multipart_srcmultipart.2~EXHW4d-FcaQlnuv8jNuqvzTN8Oi9YbR.3 2024-09-14T13:02:00.245 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T13:02:00.250+0000 7fe4c30a89c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.507__shadow_srcmultipart.2~EXHW4d-FcaQlnuv8jNuqvzTN8Oi9YbR.3_1 2024-09-14T13:02:00.245 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T13:02:00.250+0000 7fe4c30a89c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.507__multipart_srcmultipart.2~EXHW4d-FcaQlnuv8jNuqvzTN8Oi9YbR.4 2024-09-14T13:02:00.245 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T13:02:00.250+0000 7fe4c30a89c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.507__shadow_srcmultipart.2~EXHW4d-FcaQlnuv8jNuqvzTN8Oi9YbR.4_1 2024-09-14T13:02:00.245 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T13:02:00.250+0000 7fe4c30a89c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.507__multipart_srcmultipart.2~EXHW4d-FcaQlnuv8jNuqvzTN8Oi9YbR.5 2024-09-14T13:02:00.245 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T13:02:00.250+0000 7fe4c30a89c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.507__shadow_srcmultipart.2~EXHW4d-FcaQlnuv8jNuqvzTN8Oi9YbR.5_1 2024-09-14T13:02:00.247 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T13:02:00.254+0000 7fe4c30a89c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.507__multipart_srcmultipart.2~EXHW4d-FcaQlnuv8jNuqvzTN8Oi9YbR.6 2024-09-14T13:02:00.247 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T13:02:00.254+0000 7fe4c30a89c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.507__shadow_srcmultipart.2~EXHW4d-FcaQlnuv8jNuqvzTN8Oi9YbR.6_1 2024-09-14T13:02:00.248 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T13:02:00.258+0000 7fe4c30a89c0 20 garbage collection: RGWGC::process iterating over entry tag='d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.868912811414223678', time=2024-09-14T14:26:35.323480+0000, chain.objs.size()=1 2024-09-14T13:02:00.248 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T13:02:00.258+0000 7fe4c30a89c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.511__multipart_mymultipart.2~qVycjkePCeATWB8DtU9N5208mOVZpdr.1 2024-09-14T13:02:00.248 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T13:02:00.258+0000 7fe4c30a89c0 20 garbage collection: RGWGC::process iterating over entry tag='d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.6681701829099420250', time=2024-09-14T14:29:38.041154+0000, chain.objs.size()=6 2024-09-14T13:02:00.248 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T13:02:00.258+0000 7fe4c30a89c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.522__multipart_mymultipart.6Nul0yPnPlGu0DraFajgE5lNmAxXiRFw.1 2024-09-14T13:02:00.250 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T13:02:00.258+0000 7fe4c30a89c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.522__multipart_mymultipart.2~R9CU5WanuaHkPsvEqq17udmt9CZiIZy.2 2024-09-14T13:02:00.250 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T13:02:00.258+0000 7fe4c30a89c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.522__multipart_mymultipart.2~R9CU5WanuaHkPsvEqq17udmt9CZiIZy.3 2024-09-14T13:02:00.250 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T13:02:00.258+0000 7fe4c30a89c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.522__multipart_mymultipart.2~R9CU5WanuaHkPsvEqq17udmt9CZiIZy.4 2024-09-14T13:02:00.250 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T13:02:00.258+0000 7fe4c30a89c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.522__multipart_mymultipart.2~R9CU5WanuaHkPsvEqq17udmt9CZiIZy.5 2024-09-14T13:02:00.250 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T13:02:00.258+0000 7fe4c30a89c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.522__multipart_mymultipart.2~R9CU5WanuaHkPsvEqq17udmt9CZiIZy.6 2024-09-14T13:02:00.250 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T13:02:00.258+0000 7fe4c30a89c0 20 garbage collection: RGWGC::process iterating over entry tag='d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.13395627662713215358', time=2024-09-14T14:31:46.804222+0000, chain.objs.size()=12 2024-09-14T13:02:00.250 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T13:02:00.258+0000 7fe4c30a89c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.522__multipart_mymultipart.2~LK60zXpfH2lVh4NgTLWO7i_X8DMEf5O.1 2024-09-14T13:02:00.250 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T13:02:00.258+0000 7fe4c30a89c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.522__shadow_mymultipart.2~LK60zXpfH2lVh4NgTLWO7i_X8DMEf5O.1_1 2024-09-14T13:02:00.252 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T13:02:00.258+0000 7fe4c30a89c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.522__multipart_mymultipart.-TgC1shrArTk6oBvZuvX802YCBFK0OdG.2 2024-09-14T13:02:00.252 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T13:02:00.258+0000 7fe4c30a89c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.522__shadow_mymultipart.-TgC1shrArTk6oBvZuvX802YCBFK0OdG.2_1 2024-09-14T13:02:00.253 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T13:02:00.262+0000 7fe4c30a89c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.522__multipart_mymultipart.wQ7i8EX3KDYjnfOCnPMUgPW4K37w2sGM.3 2024-09-14T13:02:00.254 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T13:02:00.262+0000 7fe4c30a89c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.522__shadow_mymultipart.wQ7i8EX3KDYjnfOCnPMUgPW4K37w2sGM.3_1 2024-09-14T13:02:00.254 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T13:02:00.262+0000 7fe4c30a89c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.522__multipart_mymultipart.2~LK60zXpfH2lVh4NgTLWO7i_X8DMEf5O.4 2024-09-14T13:02:00.254 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T13:02:00.262+0000 7fe4c30a89c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.522__shadow_mymultipart.2~LK60zXpfH2lVh4NgTLWO7i_X8DMEf5O.4_1 2024-09-14T13:02:00.255 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T13:02:00.262+0000 7fe4c30a89c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.522__multipart_mymultipart.2~LK60zXpfH2lVh4NgTLWO7i_X8DMEf5O.5 2024-09-14T13:02:00.258 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T13:02:00.266+0000 7fe4c30a89c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.522__shadow_mymultipart.2~LK60zXpfH2lVh4NgTLWO7i_X8DMEf5O.5_1 2024-09-14T13:02:00.258 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T13:02:00.266+0000 7fe4c30a89c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.522__multipart_mymultipart.2~LK60zXpfH2lVh4NgTLWO7i_X8DMEf5O.6 2024-09-14T13:02:00.258 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T13:02:00.266+0000 7fe4c30a89c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.522__shadow_mymultipart.2~LK60zXpfH2lVh4NgTLWO7i_X8DMEf5O.6_1 2024-09-14T13:02:00.262 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T13:02:00.270+0000 7fe4c30a89c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T13:02:00.265 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T13:02:00.274+0000 7fe4c30a89c0 20 garbage collection: RGWGC::process entered with GC index_shard=30, max_secs=3600, expired_only=0 2024-09-14T13:02:00.267 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T13:02:00.274+0000 7fe4c30a89c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T13:02:00.268 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T13:02:00.274+0000 7fe4c30a89c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T13:02:00.269 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T13:02:00.278+0000 7fe4c30a89c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=4, truncated=0, next_marker='' 2024-09-14T13:02:00.269 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T13:02:00.278+0000 7fe4c30a89c0 20 garbage collection: RGWGC::process iterating over entry tag='d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.8633597259292468106', time=2024-09-14T14:01:43.839852+0000, chain.objs.size()=5 2024-09-14T13:02:00.269 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T13:02:00.278+0000 7fe4c30a89c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.159__multipart_mymultipart-FROZEN.2~6l6-MDKxin77xXRMAvlR42da5wmKV9J.1 2024-09-14T13:02:00.269 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T13:02:00.278+0000 7fe4c30a89c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.159__shadow_mymultipart-FROZEN.2~6l6-MDKxin77xXRMAvlR42da5wmKV9J.1_1 2024-09-14T13:02:00.269 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T13:02:00.278+0000 7fe4c30a89c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.159__multipart_mymultipart-FROZEN.2~6l6-MDKxin77xXRMAvlR42da5wmKV9J.2 2024-09-14T13:02:00.269 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T13:02:00.278+0000 7fe4c30a89c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.159__shadow_mymultipart-FROZEN.2~6l6-MDKxin77xXRMAvlR42da5wmKV9J.2_1 2024-09-14T13:02:00.269 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T13:02:00.278+0000 7fe4c30a89c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.159__multipart_mymultipart-FROZEN.2~6l6-MDKxin77xXRMAvlR42da5wmKV9J.3 2024-09-14T13:02:00.269 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T13:02:00.278+0000 7fe4c30a89c0 20 garbage collection: RGWGC::process iterating over entry tag='2~umBOJ8yb7Br9VpQSq7a0gARp2eLD9kB', time=2024-09-14T14:34:01.364850+0000, chain.objs.size()=2 2024-09-14T13:02:00.269 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T13:02:00.278+0000 7fe4c30a89c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.531__multipart_mymultipart.2~umBOJ8yb7Br9VpQSq7a0gARp2eLD9kB.1 2024-09-14T13:02:00.269 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T13:02:00.278+0000 7fe4c30a89c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.531__multipart_mymultipart.2~umBOJ8yb7Br9VpQSq7a0gARp2eLD9kB.2 2024-09-14T13:02:00.270 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T13:02:00.278+0000 7fe4c30a89c0 20 garbage collection: RGWGC::process iterating over entry tag='d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.1110215261005054448', time=2024-09-14T14:44:16.087784+0000, chain.objs.size()=12 2024-09-14T13:02:00.270 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T13:02:00.278+0000 7fe4c30a89c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.615__multipart_multipart_enc.2~C4MKHXJ_tGBHZR6dpiV9qElwQR423Uw.1 2024-09-14T13:02:00.270 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T13:02:00.278+0000 7fe4c30a89c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.615__shadow_multipart_enc.2~C4MKHXJ_tGBHZR6dpiV9qElwQR423Uw.1_1 2024-09-14T13:02:00.270 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T13:02:00.278+0000 7fe4c30a89c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.615__multipart_multipart_enc.2~C4MKHXJ_tGBHZR6dpiV9qElwQR423Uw.2 2024-09-14T13:02:00.270 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T13:02:00.278+0000 7fe4c30a89c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.615__shadow_multipart_enc.2~C4MKHXJ_tGBHZR6dpiV9qElwQR423Uw.2_1 2024-09-14T13:02:00.270 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T13:02:00.278+0000 7fe4c30a89c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.615__multipart_multipart_enc.2~C4MKHXJ_tGBHZR6dpiV9qElwQR423Uw.3 2024-09-14T13:02:00.272 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T13:02:00.278+0000 7fe4c30a89c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.615__shadow_multipart_enc.2~C4MKHXJ_tGBHZR6dpiV9qElwQR423Uw.3_1 2024-09-14T13:02:00.272 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T13:02:00.278+0000 7fe4c30a89c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.615__multipart_multipart_enc.2~C4MKHXJ_tGBHZR6dpiV9qElwQR423Uw.4 2024-09-14T13:02:00.272 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T13:02:00.278+0000 7fe4c30a89c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.615__shadow_multipart_enc.2~C4MKHXJ_tGBHZR6dpiV9qElwQR423Uw.4_1 2024-09-14T13:02:00.272 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T13:02:00.282+0000 7fe4c30a89c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.615__multipart_multipart_enc.2~C4MKHXJ_tGBHZR6dpiV9qElwQR423Uw.5 2024-09-14T13:02:00.274 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T13:02:00.282+0000 7fe4c30a89c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.615__shadow_multipart_enc.2~C4MKHXJ_tGBHZR6dpiV9qElwQR423Uw.5_1 2024-09-14T13:02:00.275 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T13:02:00.282+0000 7fe4c30a89c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.615__multipart_multipart_enc.2~C4MKHXJ_tGBHZR6dpiV9qElwQR423Uw.6 2024-09-14T13:02:00.275 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T13:02:00.282+0000 7fe4c30a89c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.615__shadow_multipart_enc.2~C4MKHXJ_tGBHZR6dpiV9qElwQR423Uw.6_1 2024-09-14T13:02:00.275 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T13:02:00.282+0000 7fe4c30a89c0 20 garbage collection: RGWGC::process iterating over entry tag='2~CLMXwV0GhsuZDwlH1PdPtRWnK3h3LIJ', time=2024-09-14T14:47:41.492563+0000, chain.objs.size()=12 2024-09-14T13:02:00.275 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T13:02:00.282+0000 7fe4c30a89c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.624__multipart_multipart_enc.2~CLMXwV0GhsuZDwlH1PdPtRWnK3h3LIJ.1 2024-09-14T13:02:00.275 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T13:02:00.282+0000 7fe4c30a89c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.624__shadow_multipart_enc.2~CLMXwV0GhsuZDwlH1PdPtRWnK3h3LIJ.1_1 2024-09-14T13:02:00.275 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T13:02:00.282+0000 7fe4c30a89c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.624__multipart_multipart_enc.2~CLMXwV0GhsuZDwlH1PdPtRWnK3h3LIJ.2 2024-09-14T13:02:00.275 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T13:02:00.282+0000 7fe4c30a89c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.624__shadow_multipart_enc.2~CLMXwV0GhsuZDwlH1PdPtRWnK3h3LIJ.2_1 2024-09-14T13:02:00.276 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T13:02:00.286+0000 7fe4c30a89c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.624__multipart_multipart_enc.2~CLMXwV0GhsuZDwlH1PdPtRWnK3h3LIJ.3 2024-09-14T13:02:00.276 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T13:02:00.286+0000 7fe4c30a89c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.624__shadow_multipart_enc.2~CLMXwV0GhsuZDwlH1PdPtRWnK3h3LIJ.3_1 2024-09-14T13:02:00.276 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T13:02:00.286+0000 7fe4c30a89c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.624__multipart_multipart_enc.2~CLMXwV0GhsuZDwlH1PdPtRWnK3h3LIJ.4 2024-09-14T13:02:00.278 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T13:02:00.286+0000 7fe4c30a89c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.624__shadow_multipart_enc.2~CLMXwV0GhsuZDwlH1PdPtRWnK3h3LIJ.4_1 2024-09-14T13:02:00.278 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T13:02:00.286+0000 7fe4c30a89c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.624__multipart_multipart_enc.2~CLMXwV0GhsuZDwlH1PdPtRWnK3h3LIJ.5 2024-09-14T13:02:00.281 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T13:02:00.290+0000 7fe4c30a89c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.624__shadow_multipart_enc.2~CLMXwV0GhsuZDwlH1PdPtRWnK3h3LIJ.5_1 2024-09-14T13:02:00.281 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T13:02:00.290+0000 7fe4c30a89c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.624__multipart_multipart_enc.2~CLMXwV0GhsuZDwlH1PdPtRWnK3h3LIJ.6 2024-09-14T13:02:00.281 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T13:02:00.290+0000 7fe4c30a89c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.624__shadow_multipart_enc.2~CLMXwV0GhsuZDwlH1PdPtRWnK3h3LIJ.6_1 2024-09-14T13:02:00.286 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T13:02:00.294+0000 7fe4c30a89c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T13:02:00.289 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T13:02:00.298+0000 7fe4c30a89c0 20 garbage collection: RGWGC::process entered with GC index_shard=31, max_secs=3600, expired_only=0 2024-09-14T13:02:00.290 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T13:02:00.298+0000 7fe4c30a89c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T13:02:00.291 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T13:02:00.298+0000 7fe4c30a89c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T13:02:00.292 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T13:02:00.298+0000 7fe4c30a89c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=2, truncated=0, next_marker='' 2024-09-14T13:02:00.292 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T13:02:00.298+0000 7fe4c30a89c0 20 garbage collection: RGWGC::process iterating over entry tag='_AxOJK4BHaBnWwu1wDtGz3HfSaD0MLLY', time=2024-09-14T14:02:12.690241+0000, chain.objs.size()=3 2024-09-14T13:02:00.292 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T13:02:00.298+0000 7fe4c30a89c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.160__shadow_.H4H6h6ounuQQKHNu3j3R_wHp7JSDwTI_0 2024-09-14T13:02:00.292 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T13:02:00.298+0000 7fe4c30a89c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.160__shadow_.H4H6h6ounuQQKHNu3j3R_wHp7JSDwTI_1 2024-09-14T13:02:00.292 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T13:02:00.298+0000 7fe4c30a89c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.160__shadow_.H4H6h6ounuQQKHNu3j3R_wHp7JSDwTI_2 2024-09-14T13:02:00.292 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T13:02:00.298+0000 7fe4c30a89c0 20 garbage collection: RGWGC::process iterating over entry tag='d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.6246156554762543664', time=2024-09-14T14:26:30.489542+0000, chain.objs.size()=12 2024-09-14T13:02:00.293 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T13:02:00.298+0000 7fe4c30a89c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.507__multipart_srcmultipart.2~EXHW4d-FcaQlnuv8jNuqvzTN8Oi9YbR.1 2024-09-14T13:02:00.293 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T13:02:00.298+0000 7fe4c30a89c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.507__shadow_srcmultipart.2~EXHW4d-FcaQlnuv8jNuqvzTN8Oi9YbR.1_1 2024-09-14T13:02:00.293 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T13:02:00.298+0000 7fe4c30a89c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.507__multipart_srcmultipart.2~EXHW4d-FcaQlnuv8jNuqvzTN8Oi9YbR.2 2024-09-14T13:02:00.293 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T13:02:00.298+0000 7fe4c30a89c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.507__shadow_srcmultipart.2~EXHW4d-FcaQlnuv8jNuqvzTN8Oi9YbR.2_1 2024-09-14T13:02:00.293 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T13:02:00.298+0000 7fe4c30a89c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.507__multipart_srcmultipart.2~EXHW4d-FcaQlnuv8jNuqvzTN8Oi9YbR.3 2024-09-14T13:02:00.293 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T13:02:00.298+0000 7fe4c30a89c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.507__shadow_srcmultipart.2~EXHW4d-FcaQlnuv8jNuqvzTN8Oi9YbR.3_1 2024-09-14T13:02:00.293 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T13:02:00.298+0000 7fe4c30a89c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.507__multipart_srcmultipart.2~EXHW4d-FcaQlnuv8jNuqvzTN8Oi9YbR.4 2024-09-14T13:02:00.293 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T13:02:00.298+0000 7fe4c30a89c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.507__shadow_srcmultipart.2~EXHW4d-FcaQlnuv8jNuqvzTN8Oi9YbR.4_1 2024-09-14T13:02:00.293 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T13:02:00.298+0000 7fe4c30a89c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.507__multipart_srcmultipart.2~EXHW4d-FcaQlnuv8jNuqvzTN8Oi9YbR.5 2024-09-14T13:02:00.294 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T13:02:00.302+0000 7fe4c30a89c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.507__shadow_srcmultipart.2~EXHW4d-FcaQlnuv8jNuqvzTN8Oi9YbR.5_1 2024-09-14T13:02:00.295 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T13:02:00.302+0000 7fe4c30a89c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.507__multipart_srcmultipart.2~EXHW4d-FcaQlnuv8jNuqvzTN8Oi9YbR.6 2024-09-14T13:02:00.295 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T13:02:00.302+0000 7fe4c30a89c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.507__shadow_srcmultipart.2~EXHW4d-FcaQlnuv8jNuqvzTN8Oi9YbR.6_1 2024-09-14T13:02:00.298 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T13:02:00.306+0000 7fe4c30a89c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T13:02:00.301 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T13:02:00.310+0000 7fe4c30a89c0 20 garbage collection: RGWGC::process entered with GC index_shard=0, max_secs=3600, expired_only=0 2024-09-14T13:02:00.302 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T13:02:00.310+0000 7fe4c30a89c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T13:02:00.303 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T13:02:00.310+0000 7fe4c30a89c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T13:02:00.305 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T13:02:00.310+0000 7fe4c30a89c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=5, truncated=0, next_marker='' 2024-09-14T13:02:00.305 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T13:02:00.310+0000 7fe4c30a89c0 20 garbage collection: RGWGC::process iterating over entry tag='_5_E18TP-Kww_AfgZdgv9bzI1hWAtk5A', time=2024-09-14T14:02:48.111418+0000, chain.objs.size()=3 2024-09-14T13:02:00.305 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T13:02:00.310+0000 7fe4c30a89c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.161__shadow_.pMIJWEXZG8GXgAQVWgRxy0xEflahvG__0 2024-09-14T13:02:00.305 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T13:02:00.310+0000 7fe4c30a89c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.161__shadow_.pMIJWEXZG8GXgAQVWgRxy0xEflahvG__1 2024-09-14T13:02:00.305 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T13:02:00.310+0000 7fe4c30a89c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.161__shadow_.pMIJWEXZG8GXgAQVWgRxy0xEflahvG__2 2024-09-14T13:02:00.305 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T13:02:00.314+0000 7fe4c30a89c0 20 garbage collection: RGWGC::process iterating over entry tag='d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.12001068760185490830', time=2024-09-14T14:30:14.101974+0000, chain.objs.size()=6 2024-09-14T13:02:00.305 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T13:02:00.314+0000 7fe4c30a89c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.522__multipart_mymultipart.2~Xc9u-3DiJXF2Kbbig-ctTZUKjYiNmD2.1 2024-09-14T13:02:00.305 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T13:02:00.314+0000 7fe4c30a89c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.522__multipart_mymultipart.5t7c6LDpP09E4Aipmd90GiYnfrmERi4F.2 2024-09-14T13:02:00.305 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T13:02:00.314+0000 7fe4c30a89c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.522__multipart_mymultipart.2~Xc9u-3DiJXF2Kbbig-ctTZUKjYiNmD2.3 2024-09-14T13:02:00.305 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T13:02:00.314+0000 7fe4c30a89c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.522__multipart_mymultipart.2~Xc9u-3DiJXF2Kbbig-ctTZUKjYiNmD2.4 2024-09-14T13:02:00.305 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T13:02:00.314+0000 7fe4c30a89c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.522__multipart_mymultipart.2~Xc9u-3DiJXF2Kbbig-ctTZUKjYiNmD2.5 2024-09-14T13:02:00.306 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T13:02:00.314+0000 7fe4c30a89c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.522__multipart_mymultipart.2~Xc9u-3DiJXF2Kbbig-ctTZUKjYiNmD2.6 2024-09-14T13:02:00.306 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T13:02:00.314+0000 7fe4c30a89c0 20 garbage collection: RGWGC::process iterating over entry tag='d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.16802471849234030316', time=2024-09-14T14:32:36.460999+0000, chain.objs.size()=2 2024-09-14T13:02:00.306 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T13:02:00.314+0000 7fe4c30a89c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.523__multipart_mymultipart.2~0WVP3MOuTatzBNp9hBWODgWlTs7b9O-.1 2024-09-14T13:02:00.306 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T13:02:00.314+0000 7fe4c30a89c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.523__multipart_mymultipart.2~0WVP3MOuTatzBNp9hBWODgWlTs7b9O-.2 2024-09-14T13:02:00.306 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T13:02:00.314+0000 7fe4c30a89c0 20 garbage collection: RGWGC::process iterating over entry tag='d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.13427548888991221293', time=2024-09-14T14:33:42.185404+0000, chain.objs.size()=4 2024-09-14T13:02:00.306 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T13:02:00.314+0000 7fe4c30a89c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.528__multipart_mymultipart.2~lmlLS0RG9oGZ6sP-MJuEWoOC40dbqbO.1 2024-09-14T13:02:00.309 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T13:02:00.318+0000 7fe4c30a89c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.528__shadow_mymultipart.2~lmlLS0RG9oGZ6sP-MJuEWoOC40dbqbO.1_1 2024-09-14T13:02:00.309 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T13:02:00.318+0000 7fe4c30a89c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.528__multipart_mymultipart.2~lmlLS0RG9oGZ6sP-MJuEWoOC40dbqbO.2 2024-09-14T13:02:00.309 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T13:02:00.318+0000 7fe4c30a89c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.528__shadow_mymultipart.2~lmlLS0RG9oGZ6sP-MJuEWoOC40dbqbO.2_1 2024-09-14T13:02:00.309 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T13:02:00.318+0000 7fe4c30a89c0 20 garbage collection: RGWGC::process iterating over entry tag='d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.15263622429915403986', time=2024-09-14T14:52:08.583305+0000, chain.objs.size()=1 2024-09-14T13:02:00.309 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T13:02:00.318+0000 7fe4c30a89c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.702__multipart_file1.2~pDJbQv8c7lQZUlsjy2GREQ8ghKUvV8K.1 2024-09-14T13:02:00.311 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T13:02:00.318+0000 7fe4c30a89c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T13:02:00.315 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T13:02:00.322+0000 7fe4c30a89c0 20 garbage collection: RGWGC::process entered with GC index_shard=1, max_secs=3600, expired_only=0 2024-09-14T13:02:00.316 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T13:02:00.326+0000 7fe4c30a89c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T13:02:00.317 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T13:02:00.326+0000 7fe4c30a89c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T13:02:00.317 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T13:02:00.326+0000 7fe4c30a89c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=4, truncated=0, next_marker='' 2024-09-14T13:02:00.317 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T13:02:00.326+0000 7fe4c30a89c0 20 garbage collection: RGWGC::process iterating over entry tag='_-8VPLRGR4JoGF57zL6HoN_DnFYjh0ya', time=2024-09-14T14:02:22.219841+0000, chain.objs.size()=1 2024-09-14T13:02:00.317 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T13:02:00.326+0000 7fe4c30a89c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.161__shadow_.nwhY02mm_hzK7OIK7dqufHHfHNLbCjg_0 2024-09-14T13:02:00.318 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T13:02:00.326+0000 7fe4c30a89c0 20 garbage collection: RGWGC::process iterating over entry tag='d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.5291052292231567178', time=2024-09-14T14:28:25.984674+0000, chain.objs.size()=3 2024-09-14T13:02:00.318 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T13:02:00.326+0000 7fe4c30a89c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.521__multipart_mymultipart.2~o8r1DtnrMkp_R7imgE2xDLi7VoPAu2O.1 2024-09-14T13:02:00.318 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T13:02:00.326+0000 7fe4c30a89c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.521__multipart_mymultipart.2~o8r1DtnrMkp_R7imgE2xDLi7VoPAu2O.2 2024-09-14T13:02:00.318 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T13:02:00.326+0000 7fe4c30a89c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.521__multipart_mymultipart.2~o8r1DtnrMkp_R7imgE2xDLi7VoPAu2O.3 2024-09-14T13:02:00.318 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T13:02:00.326+0000 7fe4c30a89c0 20 garbage collection: RGWGC::process iterating over entry tag='d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.3393518106536449340', time=2024-09-14T14:33:04.759688+0000, chain.objs.size()=3 2024-09-14T13:02:00.318 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T13:02:00.326+0000 7fe4c30a89c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.525__multipart_mymultipart.2~r3h5NSOIQ8yA67SozxE12qHSfBa_2Mc.1 2024-09-14T13:02:00.318 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T13:02:00.326+0000 7fe4c30a89c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.525__multipart_mymultipart.2~r3h5NSOIQ8yA67SozxE12qHSfBa_2Mc.2 2024-09-14T13:02:00.318 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T13:02:00.326+0000 7fe4c30a89c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.525__multipart_mymultipart.2~r3h5NSOIQ8yA67SozxE12qHSfBa_2Mc.3 2024-09-14T13:02:00.318 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T13:02:00.326+0000 7fe4c30a89c0 20 garbage collection: RGWGC::process iterating over entry tag='2~kRkcM_uXBpqrfHO9bPn59KS8dPBQcjF', time=2024-09-14T14:37:00.739230+0000, chain.objs.size()=1 2024-09-14T13:02:00.318 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T13:02:00.326+0000 7fe4c30a89c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.561__multipart_mymultipart.2~kRkcM_uXBpqrfHO9bPn59KS8dPBQcjF.1 2024-09-14T13:02:00.320 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T13:02:00.330+0000 7fe4c30a89c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T13:02:00.323 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T13:02:00.330+0000 7fe4c30a89c0 20 garbage collection: RGWGC::process entered with GC index_shard=2, max_secs=3600, expired_only=0 2024-09-14T13:02:00.324 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T13:02:00.334+0000 7fe4c30a89c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T13:02:00.325 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T13:02:00.334+0000 7fe4c30a89c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T13:02:00.326 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T13:02:00.334+0000 7fe4c30a89c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=5, truncated=0, next_marker='' 2024-09-14T13:02:00.326 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T13:02:00.334+0000 7fe4c30a89c0 20 garbage collection: RGWGC::process iterating over entry tag='d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.9038023583455606827', time=2024-09-14T14:02:31.880505+0000, chain.objs.size()=5 2024-09-14T13:02:00.326 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T13:02:00.334+0000 7fe4c30a89c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.161__multipart_foo-LUKEWARM.2~P-ZdgbJoLxt-RYec1Dm5q9XPHBilktc.1 2024-09-14T13:02:00.326 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T13:02:00.334+0000 7fe4c30a89c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.161__shadow_foo-LUKEWARM.2~P-ZdgbJoLxt-RYec1Dm5q9XPHBilktc.1_1 2024-09-14T13:02:00.326 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T13:02:00.334+0000 7fe4c30a89c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.161__multipart_foo-LUKEWARM.2~P-ZdgbJoLxt-RYec1Dm5q9XPHBilktc.2 2024-09-14T13:02:00.326 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T13:02:00.334+0000 7fe4c30a89c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.161__shadow_foo-LUKEWARM.2~P-ZdgbJoLxt-RYec1Dm5q9XPHBilktc.2_1 2024-09-14T13:02:00.326 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T13:02:00.334+0000 7fe4c30a89c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.161__multipart_foo-LUKEWARM.2~P-ZdgbJoLxt-RYec1Dm5q9XPHBilktc.3 2024-09-14T13:02:00.326 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T13:02:00.334+0000 7fe4c30a89c0 20 garbage collection: RGWGC::process iterating over entry tag='2~LK60zXpfH2lVh4NgTLWO7i_X8DMEf5O', time=2024-09-14T14:30:54.600179+0000, chain.objs.size()=2 2024-09-14T13:02:00.326 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T13:02:00.334+0000 7fe4c30a89c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.522__multipart_mymultipart.2~LK60zXpfH2lVh4NgTLWO7i_X8DMEf5O.2 2024-09-14T13:02:00.326 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T13:02:00.334+0000 7fe4c30a89c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.522__shadow_mymultipart.2~LK60zXpfH2lVh4NgTLWO7i_X8DMEf5O.2_1 2024-09-14T13:02:00.326 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T13:02:00.334+0000 7fe4c30a89c0 20 garbage collection: RGWGC::process iterating over entry tag='2~LK60zXpfH2lVh4NgTLWO7i_X8DMEf5O', time=2024-09-14T14:30:54.611944+0000, chain.objs.size()=2 2024-09-14T13:02:00.326 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T13:02:00.334+0000 7fe4c30a89c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.522__multipart_mymultipart.2~LK60zXpfH2lVh4NgTLWO7i_X8DMEf5O.3 2024-09-14T13:02:00.326 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T13:02:00.334+0000 7fe4c30a89c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.522__shadow_mymultipart.2~LK60zXpfH2lVh4NgTLWO7i_X8DMEf5O.3_1 2024-09-14T13:02:00.327 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T13:02:00.334+0000 7fe4c30a89c0 20 garbage collection: RGWGC::process iterating over entry tag='d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.12219791818776964204', time=2024-09-14T14:37:00.136073+0000, chain.objs.size()=1 2024-09-14T13:02:00.327 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T13:02:00.334+0000 7fe4c30a89c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.561__multipart_mymultipart.2~nJZpKN8kUzMsiL-X_49qoMRRjA2qIib.1 2024-09-14T13:02:00.327 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T13:02:00.334+0000 7fe4c30a89c0 20 garbage collection: RGWGC::process iterating over entry tag='2~NKLDMkdHsecbQhZAAJRDn2XX4DtFlRq', time=2024-09-14T14:54:22.588952+0000, chain.objs.size()=1 2024-09-14T13:02:00.327 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T13:02:00.334+0000 7fe4c30a89c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.742__multipart_mymultipart2.2~NKLDMkdHsecbQhZAAJRDn2XX4DtFlRq.1 2024-09-14T13:02:00.331 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T13:02:00.338+0000 7fe4c30a89c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T13:02:00.333 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T13:02:00.342+0000 7fe4c30a89c0 20 garbage collection: RGWGC::process entered with GC index_shard=3, max_secs=3600, expired_only=0 2024-09-14T13:02:00.334 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T13:02:00.342+0000 7fe4c30a89c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T13:02:00.335 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T13:02:00.342+0000 7fe4c30a89c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T13:02:00.335 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T13:02:00.342+0000 7fe4c30a89c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=4, truncated=0, next_marker='' 2024-09-14T13:02:00.336 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T13:02:00.342+0000 7fe4c30a89c0 20 garbage collection: RGWGC::process iterating over entry tag='d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.9650053058538897779', time=2024-09-14T14:01:59.737405+0000, chain.objs.size()=3 2024-09-14T13:02:00.336 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T13:02:00.342+0000 7fe4c30a89c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.160__shadow_.EXFaF6OvMzLQ7N_uaiFvMkoShYTaLpO_0 2024-09-14T13:02:00.336 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T13:02:00.342+0000 7fe4c30a89c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.160__shadow_.EXFaF6OvMzLQ7N_uaiFvMkoShYTaLpO_1 2024-09-14T13:02:00.336 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T13:02:00.342+0000 7fe4c30a89c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.160__shadow_.EXFaF6OvMzLQ7N_uaiFvMkoShYTaLpO_2 2024-09-14T13:02:00.336 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T13:02:00.342+0000 7fe4c30a89c0 20 garbage collection: RGWGC::process iterating over entry tag='2~3CIIn0aj6yab3D_62qAkTidVPrXrMK0', time=2024-09-14T14:05:01.610847+0000, chain.objs.size()=1 2024-09-14T13:02:00.336 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T13:02:00.342+0000 7fe4c30a89c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.202__multipart_mymultipart.2~3CIIn0aj6yab3D_62qAkTidVPrXrMK0.1 2024-09-14T13:02:00.336 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T13:02:00.342+0000 7fe4c30a89c0 20 garbage collection: RGWGC::process iterating over entry tag='d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.4662554995541031228', time=2024-09-14T14:25:04.427875+0000, chain.objs.size()=3 2024-09-14T13:02:00.336 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T13:02:00.342+0000 7fe4c30a89c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.486__shadow_.iqjIi12BpLhP3y7cnIFWFypL9X2RdmS_1 2024-09-14T13:02:00.336 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T13:02:00.342+0000 7fe4c30a89c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.486__shadow_.iqjIi12BpLhP3y7cnIFWFypL9X2RdmS_2 2024-09-14T13:02:00.336 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T13:02:00.342+0000 7fe4c30a89c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.486__shadow_.iqjIi12BpLhP3y7cnIFWFypL9X2RdmS_3 2024-09-14T13:02:00.336 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T13:02:00.342+0000 7fe4c30a89c0 20 garbage collection: RGWGC::process iterating over entry tag='2~LrwMl6M6BJjZRQ0_QxQM2h4YBmUtaSK', time=2024-09-14T14:34:06.949418+0000, chain.objs.size()=1 2024-09-14T13:02:00.336 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T13:02:00.342+0000 7fe4c30a89c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.533__multipart_mymultipart.2~LrwMl6M6BJjZRQ0_QxQM2h4YBmUtaSK.1 2024-09-14T13:02:00.338 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T13:02:00.346+0000 7fe4c30a89c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T13:02:00.341 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T13:02:00.350+0000 7fe4c30a89c0 20 garbage collection: RGWGC::process entered with GC index_shard=4, max_secs=3600, expired_only=0 2024-09-14T13:02:00.342 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T13:02:00.350+0000 7fe4c30a89c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T13:02:00.343 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T13:02:00.350+0000 7fe4c30a89c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T13:02:00.344 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T13:02:00.350+0000 7fe4c30a89c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=7, truncated=0, next_marker='' 2024-09-14T13:02:00.344 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T13:02:00.350+0000 7fe4c30a89c0 20 garbage collection: RGWGC::process iterating over entry tag='_tpZK7EnOQBZ6omRtVRgYHw0nrRgpzu3', time=2024-09-14T14:03:07.911821+0000, chain.objs.size()=1 2024-09-14T13:02:00.344 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T13:02:00.350+0000 7fe4c30a89c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.165__shadow_.I1Nq5ffHISgak3SAGOVz-aUGd9nmdjj_0 2024-09-14T13:02:00.344 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T13:02:00.350+0000 7fe4c30a89c0 20 garbage collection: RGWGC::process iterating over entry tag='d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.1832223356081761398', time=2024-09-14T14:25:04.418129+0000, chain.objs.size()=3 2024-09-14T13:02:00.344 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T13:02:00.350+0000 7fe4c30a89c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.486__shadow_.iqjIi12BpLhP3y7cnIFWFypL9X2RdmS_1 2024-09-14T13:02:00.344 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T13:02:00.350+0000 7fe4c30a89c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.486__shadow_.iqjIi12BpLhP3y7cnIFWFypL9X2RdmS_2 2024-09-14T13:02:00.344 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T13:02:00.350+0000 7fe4c30a89c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.486__shadow_.iqjIi12BpLhP3y7cnIFWFypL9X2RdmS_3 2024-09-14T13:02:00.344 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T13:02:00.350+0000 7fe4c30a89c0 20 garbage collection: RGWGC::process iterating over entry tag='d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.6842386793849606206', time=2024-09-14T14:26:42.903806+0000, chain.objs.size()=1 2024-09-14T13:02:00.344 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T13:02:00.350+0000 7fe4c30a89c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.513__multipart_mymultipart.2~4IoS0gm6jZdMPuC8810SsGankwW8cee.1 2024-09-14T13:02:00.344 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T13:02:00.350+0000 7fe4c30a89c0 20 garbage collection: RGWGC::process iterating over entry tag='d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.411898240602257104', time=2024-09-14T14:27:12.131526+0000, chain.objs.size()=1 2024-09-14T13:02:00.344 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T13:02:00.350+0000 7fe4c30a89c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.517__shadow_.yBVCfCpi9XJnjWqt8E5nmgTWhLMMP_O_1 2024-09-14T13:02:00.345 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T13:02:00.350+0000 7fe4c30a89c0 20 garbage collection: RGWGC::process iterating over entry tag='2~Xc9u-3DiJXF2Kbbig-ctTZUKjYiNmD2', time=2024-09-14T14:29:37.986465+0000, chain.objs.size()=1 2024-09-14T13:02:00.345 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T13:02:00.350+0000 7fe4c30a89c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.522__multipart_mymultipart.2~Xc9u-3DiJXF2Kbbig-ctTZUKjYiNmD2.2 2024-09-14T13:02:00.345 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T13:02:00.350+0000 7fe4c30a89c0 20 garbage collection: RGWGC::process iterating over entry tag='d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.13169300801089803059', time=2024-09-14T14:32:10.074398+0000, chain.objs.size()=12 2024-09-14T13:02:00.345 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T13:02:00.350+0000 7fe4c30a89c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.522__multipart_mymultipart.vsHBGGRKXKeGHEdV_PEHb5RUytfHec5E.1 2024-09-14T13:02:00.345 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T13:02:00.350+0000 7fe4c30a89c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.522__shadow_mymultipart.vsHBGGRKXKeGHEdV_PEHb5RUytfHec5E.1_1 2024-09-14T13:02:00.345 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T13:02:00.350+0000 7fe4c30a89c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.522__multipart_mymultipart.uE6ouiD6RMr5wAnUDgKMQrbaZNVg26BW.2 2024-09-14T13:02:00.345 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T13:02:00.350+0000 7fe4c30a89c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.522__shadow_mymultipart.uE6ouiD6RMr5wAnUDgKMQrbaZNVg26BW.2_1 2024-09-14T13:02:00.345 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T13:02:00.350+0000 7fe4c30a89c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.522__multipart_mymultipart.kcHf0idQsLXL2qRm1kUIUeSbvC_XZxc4.3 2024-09-14T13:02:00.345 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T13:02:00.354+0000 7fe4c30a89c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.522__shadow_mymultipart.kcHf0idQsLXL2qRm1kUIUeSbvC_XZxc4.3_1 2024-09-14T13:02:00.348 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T13:02:00.354+0000 7fe4c30a89c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.522__multipart_mymultipart.bT1nrNRYbxGMP5LWNvSWNNx8Xd3-FEo6.4 2024-09-14T13:02:00.348 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T13:02:00.354+0000 7fe4c30a89c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.522__shadow_mymultipart.bT1nrNRYbxGMP5LWNvSWNNx8Xd3-FEo6.4_1 2024-09-14T13:02:00.348 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T13:02:00.354+0000 7fe4c30a89c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.522__multipart_mymultipart.L6vvUSx0AGcVUJ5SVW7O5pW7haaE02KN.5 2024-09-14T13:02:00.348 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T13:02:00.354+0000 7fe4c30a89c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.522__shadow_mymultipart.L6vvUSx0AGcVUJ5SVW7O5pW7haaE02KN.5_1 2024-09-14T13:02:00.348 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T13:02:00.354+0000 7fe4c30a89c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.522__multipart_mymultipart.4VMWp3IRCyT7VYVBzA_I61rY9wMqn3ng.6 2024-09-14T13:02:00.348 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T13:02:00.354+0000 7fe4c30a89c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.522__shadow_mymultipart.4VMWp3IRCyT7VYVBzA_I61rY9wMqn3ng.6_1 2024-09-14T13:02:00.348 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T13:02:00.354+0000 7fe4c30a89c0 20 garbage collection: RGWGC::process iterating over entry tag='2~oRmm1Bp_-lwL6HS7S7OyhmVuRu6hYgb', time=2024-09-14T14:34:01.264833+0000, chain.objs.size()=1 2024-09-14T13:02:00.348 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T13:02:00.354+0000 7fe4c30a89c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.531__multipart_mymultipart.2~oRmm1Bp_-lwL6HS7S7OyhmVuRu6hYgb.1 2024-09-14T13:02:00.354 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T13:02:00.362+0000 7fe4c30a89c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T13:02:00.357 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T13:02:00.366+0000 7fe4c30a89c0 20 garbage collection: RGWGC::process entered with GC index_shard=5, max_secs=3600, expired_only=0 2024-09-14T13:02:00.358 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T13:02:00.366+0000 7fe4c30a89c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T13:02:00.359 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T13:02:00.366+0000 7fe4c30a89c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T13:02:00.359 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T13:02:00.366+0000 7fe4c30a89c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2024-09-14T13:02:00.359 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T13:02:00.366+0000 7fe4c30a89c0 20 garbage collection: RGWGC::process iterating over entry tag='d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.13899271763421741406', time=2024-09-14T14:27:10.579159+0000, chain.objs.size()=1 2024-09-14T13:02:00.359 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T13:02:00.366+0000 7fe4c30a89c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.518__multipart_mymultipart.2~o6LPh25Jbk4zWhNv-DYyJXjph_BNLLe.1 2024-09-14T13:02:00.361 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T13:02:00.370+0000 7fe4c30a89c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T13:02:00.363 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T13:02:00.370+0000 7fe4c30a89c0 20 garbage collection: RGWGC::process entered with GC index_shard=6, max_secs=3600, expired_only=0 2024-09-14T13:02:00.365 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T13:02:00.374+0000 7fe4c30a89c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T13:02:00.365 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T13:02:00.374+0000 7fe4c30a89c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T13:02:00.366 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T13:02:00.374+0000 7fe4c30a89c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=2, truncated=0, next_marker='' 2024-09-14T13:02:00.366 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T13:02:00.374+0000 7fe4c30a89c0 20 garbage collection: RGWGC::process iterating over entry tag='d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.16892879331222893851', time=2024-09-14T14:28:40.461117+0000, chain.objs.size()=3 2024-09-14T13:02:00.366 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T13:02:00.374+0000 7fe4c30a89c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.520__shadow:Stue42U82uq97Flns1oIq762xI2GMiS_.zH-30syA2k7ALiTA2Z2RLroTgi27OSi_1 2024-09-14T13:02:00.366 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T13:02:00.374+0000 7fe4c30a89c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.520__shadow:Stue42U82uq97Flns1oIq762xI2GMiS_.zH-30syA2k7ALiTA2Z2RLroTgi27OSi_2 2024-09-14T13:02:00.366 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T13:02:00.374+0000 7fe4c30a89c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.520__shadow:Stue42U82uq97Flns1oIq762xI2GMiS_.zH-30syA2k7ALiTA2Z2RLroTgi27OSi_3 2024-09-14T13:02:00.366 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T13:02:00.374+0000 7fe4c30a89c0 20 garbage collection: RGWGC::process iterating over entry tag='d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.2071770821057272960', time=2024-09-14T14:43:55.415324+0000, chain.objs.size()=12 2024-09-14T13:02:00.366 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T13:02:00.374+0000 7fe4c30a89c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.614__multipart_multipart_enc.2~ve8EI9JpTqIlDpqBbd7bOiBwwkohCe1.1 2024-09-14T13:02:00.367 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T13:02:00.374+0000 7fe4c30a89c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.614__shadow_multipart_enc.2~ve8EI9JpTqIlDpqBbd7bOiBwwkohCe1.1_1 2024-09-14T13:02:00.367 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T13:02:00.374+0000 7fe4c30a89c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.614__multipart_multipart_enc.2~ve8EI9JpTqIlDpqBbd7bOiBwwkohCe1.2 2024-09-14T13:02:00.367 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T13:02:00.374+0000 7fe4c30a89c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.614__shadow_multipart_enc.2~ve8EI9JpTqIlDpqBbd7bOiBwwkohCe1.2_1 2024-09-14T13:02:00.367 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T13:02:00.374+0000 7fe4c30a89c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.614__multipart_multipart_enc.2~ve8EI9JpTqIlDpqBbd7bOiBwwkohCe1.3 2024-09-14T13:02:00.367 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T13:02:00.374+0000 7fe4c30a89c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.614__shadow_multipart_enc.2~ve8EI9JpTqIlDpqBbd7bOiBwwkohCe1.3_1 2024-09-14T13:02:00.367 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T13:02:00.374+0000 7fe4c30a89c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.614__multipart_multipart_enc.2~ve8EI9JpTqIlDpqBbd7bOiBwwkohCe1.4 2024-09-14T13:02:00.367 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T13:02:00.374+0000 7fe4c30a89c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.614__shadow_multipart_enc.2~ve8EI9JpTqIlDpqBbd7bOiBwwkohCe1.4_1 2024-09-14T13:02:00.367 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T13:02:00.374+0000 7fe4c30a89c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.614__multipart_multipart_enc.2~ve8EI9JpTqIlDpqBbd7bOiBwwkohCe1.5 2024-09-14T13:02:00.370 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T13:02:00.378+0000 7fe4c30a89c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.614__shadow_multipart_enc.2~ve8EI9JpTqIlDpqBbd7bOiBwwkohCe1.5_1 2024-09-14T13:02:00.370 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T13:02:00.378+0000 7fe4c30a89c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.614__multipart_multipart_enc.2~ve8EI9JpTqIlDpqBbd7bOiBwwkohCe1.6 2024-09-14T13:02:00.370 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T13:02:00.378+0000 7fe4c30a89c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.614__shadow_multipart_enc.2~ve8EI9JpTqIlDpqBbd7bOiBwwkohCe1.6_1 2024-09-14T13:02:00.374 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T13:02:00.382+0000 7fe4c30a89c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T13:02:00.377 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T13:02:00.386+0000 7fe4c30a89c0 20 garbage collection: RGWGC::process entered with GC index_shard=7, max_secs=3600, expired_only=0 2024-09-14T13:02:00.379 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T13:02:00.386+0000 7fe4c30a89c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T13:02:00.379 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T13:02:00.386+0000 7fe4c30a89c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T13:02:00.380 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T13:02:00.386+0000 7fe4c30a89c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=5, truncated=0, next_marker='' 2024-09-14T13:02:00.381 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T13:02:00.386+0000 7fe4c30a89c0 20 garbage collection: RGWGC::process iterating over entry tag='d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.2833181110565513623', time=2024-09-14T14:02:09.270910+0000, chain.objs.size()=3 2024-09-14T13:02:00.381 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T13:02:00.386+0000 7fe4c30a89c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.160__shadow_.LBWfmzahemueJdOqgG6FMSW6lOQaGAb_0 2024-09-14T13:02:00.381 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T13:02:00.386+0000 7fe4c30a89c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.160__shadow_.LBWfmzahemueJdOqgG6FMSW6lOQaGAb_1 2024-09-14T13:02:00.381 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T13:02:00.386+0000 7fe4c30a89c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.160__shadow_.LBWfmzahemueJdOqgG6FMSW6lOQaGAb_2 2024-09-14T13:02:00.381 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T13:02:00.390+0000 7fe4c30a89c0 20 garbage collection: RGWGC::process iterating over entry tag='_nJfWKQXfbyZFwx3FQzGu8RcIlT28Zz_', time=2024-09-14T14:02:48.270928+0000, chain.objs.size()=1 2024-09-14T13:02:00.381 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T13:02:00.390+0000 7fe4c30a89c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.161__shadow_.MdliNs5ZKcDXXgOYBMHN5dhI8gzhPCY_0 2024-09-14T13:02:00.381 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T13:02:00.390+0000 7fe4c30a89c0 20 garbage collection: RGWGC::process iterating over entry tag='d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.213810140199842358', time=2024-09-14T14:26:29.134163+0000, chain.objs.size()=12 2024-09-14T13:02:00.381 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T13:02:00.390+0000 7fe4c30a89c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.507__multipart_srcmultipart.2~EXHW4d-FcaQlnuv8jNuqvzTN8Oi9YbR.1 2024-09-14T13:02:00.381 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T13:02:00.390+0000 7fe4c30a89c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.507__shadow_srcmultipart.2~EXHW4d-FcaQlnuv8jNuqvzTN8Oi9YbR.1_1 2024-09-14T13:02:00.381 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T13:02:00.390+0000 7fe4c30a89c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.507__multipart_srcmultipart.2~EXHW4d-FcaQlnuv8jNuqvzTN8Oi9YbR.2 2024-09-14T13:02:00.381 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T13:02:00.390+0000 7fe4c30a89c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.507__shadow_srcmultipart.2~EXHW4d-FcaQlnuv8jNuqvzTN8Oi9YbR.2_1 2024-09-14T13:02:00.381 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T13:02:00.390+0000 7fe4c30a89c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.507__multipart_srcmultipart.2~EXHW4d-FcaQlnuv8jNuqvzTN8Oi9YbR.3 2024-09-14T13:02:00.381 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T13:02:00.390+0000 7fe4c30a89c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.507__shadow_srcmultipart.2~EXHW4d-FcaQlnuv8jNuqvzTN8Oi9YbR.3_1 2024-09-14T13:02:00.381 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T13:02:00.390+0000 7fe4c30a89c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.507__multipart_srcmultipart.2~EXHW4d-FcaQlnuv8jNuqvzTN8Oi9YbR.4 2024-09-14T13:02:00.382 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T13:02:00.390+0000 7fe4c30a89c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.507__shadow_srcmultipart.2~EXHW4d-FcaQlnuv8jNuqvzTN8Oi9YbR.4_1 2024-09-14T13:02:00.384 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T13:02:00.390+0000 7fe4c30a89c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.507__multipart_srcmultipart.2~EXHW4d-FcaQlnuv8jNuqvzTN8Oi9YbR.5 2024-09-14T13:02:00.384 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T13:02:00.390+0000 7fe4c30a89c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.507__shadow_srcmultipart.2~EXHW4d-FcaQlnuv8jNuqvzTN8Oi9YbR.5_1 2024-09-14T13:02:00.384 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T13:02:00.394+0000 7fe4c30a89c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.507__multipart_srcmultipart.2~EXHW4d-FcaQlnuv8jNuqvzTN8Oi9YbR.6 2024-09-14T13:02:00.384 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T13:02:00.394+0000 7fe4c30a89c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.507__shadow_srcmultipart.2~EXHW4d-FcaQlnuv8jNuqvzTN8Oi9YbR.6_1 2024-09-14T13:02:00.384 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T13:02:00.394+0000 7fe4c30a89c0 20 garbage collection: RGWGC::process iterating over entry tag='d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.7691044705262458643', time=2024-09-14T14:27:52.422091+0000, chain.objs.size()=12 2024-09-14T13:02:00.384 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T13:02:00.394+0000 7fe4c30a89c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.519__multipart_mymultipart.2~3Ap0ZTCkl3AFdDQhL9mjirqK34obHlF.1 2024-09-14T13:02:00.385 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T13:02:00.394+0000 7fe4c30a89c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.519__shadow_mymultipart.2~3Ap0ZTCkl3AFdDQhL9mjirqK34obHlF.1_1 2024-09-14T13:02:00.385 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T13:02:00.394+0000 7fe4c30a89c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.519__multipart_mymultipart.2~3Ap0ZTCkl3AFdDQhL9mjirqK34obHlF.2 2024-09-14T13:02:00.385 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T13:02:00.394+0000 7fe4c30a89c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.519__shadow_mymultipart.2~3Ap0ZTCkl3AFdDQhL9mjirqK34obHlF.2_1 2024-09-14T13:02:00.385 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T13:02:00.394+0000 7fe4c30a89c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.519__multipart_mymultipart.2~3Ap0ZTCkl3AFdDQhL9mjirqK34obHlF.3 2024-09-14T13:02:00.385 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T13:02:00.394+0000 7fe4c30a89c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.519__shadow_mymultipart.2~3Ap0ZTCkl3AFdDQhL9mjirqK34obHlF.3_1 2024-09-14T13:02:00.386 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T13:02:00.394+0000 7fe4c30a89c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.519__multipart_mymultipart.2~3Ap0ZTCkl3AFdDQhL9mjirqK34obHlF.4 2024-09-14T13:02:00.388 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T13:02:00.394+0000 7fe4c30a89c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.519__shadow_mymultipart.2~3Ap0ZTCkl3AFdDQhL9mjirqK34obHlF.4_1 2024-09-14T13:02:00.388 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T13:02:00.394+0000 7fe4c30a89c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.519__multipart_mymultipart.2~3Ap0ZTCkl3AFdDQhL9mjirqK34obHlF.5 2024-09-14T13:02:00.388 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T13:02:00.398+0000 7fe4c30a89c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.519__shadow_mymultipart.2~3Ap0ZTCkl3AFdDQhL9mjirqK34obHlF.5_1 2024-09-14T13:02:00.389 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T13:02:00.398+0000 7fe4c30a89c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.519__multipart_mymultipart.2~3Ap0ZTCkl3AFdDQhL9mjirqK34obHlF.6 2024-09-14T13:02:00.389 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T13:02:00.398+0000 7fe4c30a89c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.519__shadow_mymultipart.2~3Ap0ZTCkl3AFdDQhL9mjirqK34obHlF.6_1 2024-09-14T13:02:00.390 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T13:02:00.398+0000 7fe4c30a89c0 20 garbage collection: RGWGC::process iterating over entry tag='d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.17906707191214776691', time=2024-09-14T14:54:34.770696+0000, chain.objs.size()=3 2024-09-14T13:02:00.391 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T13:02:00.398+0000 7fe4c30a89c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.743__multipart_mymultipart3.2~JOxoAhQE7Vzl7NffaZLCk8izYLBV3vr.1 2024-09-14T13:02:00.391 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T13:02:00.398+0000 7fe4c30a89c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.743__multipart_mymultipart3.2~JOxoAhQE7Vzl7NffaZLCk8izYLBV3vr.2 2024-09-14T13:02:00.391 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T13:02:00.398+0000 7fe4c30a89c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.743__multipart_mymultipart3.2~JOxoAhQE7Vzl7NffaZLCk8izYLBV3vr.3 2024-09-14T13:02:00.395 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T13:02:00.402+0000 7fe4c30a89c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T13:02:00.397 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T13:02:00.406+0000 7fe4c30a89c0 20 garbage collection: RGWGC::process entered with GC index_shard=8, max_secs=3600, expired_only=0 2024-09-14T13:02:00.399 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T13:02:00.406+0000 7fe4c30a89c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T13:02:00.399 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T13:02:00.406+0000 7fe4c30a89c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T13:02:00.400 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T13:02:00.406+0000 7fe4c30a89c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=2, truncated=0, next_marker='' 2024-09-14T13:02:00.400 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T13:02:00.406+0000 7fe4c30a89c0 20 garbage collection: RGWGC::process iterating over entry tag='d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.470159126878041007', time=2024-09-14T14:26:29.854443+0000, chain.objs.size()=12 2024-09-14T13:02:00.400 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T13:02:00.406+0000 7fe4c30a89c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.507__multipart_srcmultipart.2~EXHW4d-FcaQlnuv8jNuqvzTN8Oi9YbR.1 2024-09-14T13:02:00.400 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T13:02:00.406+0000 7fe4c30a89c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.507__shadow_srcmultipart.2~EXHW4d-FcaQlnuv8jNuqvzTN8Oi9YbR.1_1 2024-09-14T13:02:00.400 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T13:02:00.406+0000 7fe4c30a89c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.507__multipart_srcmultipart.2~EXHW4d-FcaQlnuv8jNuqvzTN8Oi9YbR.2 2024-09-14T13:02:00.401 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T13:02:00.406+0000 7fe4c30a89c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.507__shadow_srcmultipart.2~EXHW4d-FcaQlnuv8jNuqvzTN8Oi9YbR.2_1 2024-09-14T13:02:00.401 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T13:02:00.406+0000 7fe4c30a89c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.507__multipart_srcmultipart.2~EXHW4d-FcaQlnuv8jNuqvzTN8Oi9YbR.3 2024-09-14T13:02:00.401 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T13:02:00.406+0000 7fe4c30a89c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.507__shadow_srcmultipart.2~EXHW4d-FcaQlnuv8jNuqvzTN8Oi9YbR.3_1 2024-09-14T13:02:00.401 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T13:02:00.406+0000 7fe4c30a89c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.507__multipart_srcmultipart.2~EXHW4d-FcaQlnuv8jNuqvzTN8Oi9YbR.4 2024-09-14T13:02:00.401 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T13:02:00.406+0000 7fe4c30a89c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.507__shadow_srcmultipart.2~EXHW4d-FcaQlnuv8jNuqvzTN8Oi9YbR.4_1 2024-09-14T13:02:00.401 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T13:02:00.410+0000 7fe4c30a89c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.507__multipart_srcmultipart.2~EXHW4d-FcaQlnuv8jNuqvzTN8Oi9YbR.5 2024-09-14T13:02:00.401 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T13:02:00.410+0000 7fe4c30a89c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.507__shadow_srcmultipart.2~EXHW4d-FcaQlnuv8jNuqvzTN8Oi9YbR.5_1 2024-09-14T13:02:00.401 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T13:02:00.410+0000 7fe4c30a89c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.507__multipart_srcmultipart.2~EXHW4d-FcaQlnuv8jNuqvzTN8Oi9YbR.6 2024-09-14T13:02:00.401 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T13:02:00.410+0000 7fe4c30a89c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.507__shadow_srcmultipart.2~EXHW4d-FcaQlnuv8jNuqvzTN8Oi9YbR.6_1 2024-09-14T13:02:00.404 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T13:02:00.410+0000 7fe4c30a89c0 20 garbage collection: RGWGC::process iterating over entry tag='d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.3384881939906673407', time=2024-09-14T14:37:01.556872+0000, chain.objs.size()=1 2024-09-14T13:02:00.404 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T13:02:00.410+0000 7fe4c30a89c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.561__multipart_mymultipart.Rfg8JSCWrNU4dluPHvL1dmlsuxzxRIQm.1 2024-09-14T13:02:00.408 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T13:02:00.418+0000 7fe4c30a89c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T13:02:00.411 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T13:02:00.418+0000 7fe4c30a89c0 20 garbage collection: RGWGC::process entered with GC index_shard=9, max_secs=3600, expired_only=0 2024-09-14T13:02:00.412 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T13:02:00.422+0000 7fe4c30a89c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T13:02:00.412 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T13:02:00.422+0000 7fe4c30a89c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T13:02:00.413 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T13:02:00.422+0000 7fe4c30a89c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2024-09-14T13:02:00.413 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T13:02:00.422+0000 7fe4c30a89c0 20 garbage collection: RGWGC::process iterating over entry tag='_VcFyVw0zQ9M0RyEGYnJNuYRNaTx2tbM', time=2024-09-14T14:02:48.187374+0000, chain.objs.size()=3 2024-09-14T13:02:00.413 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T13:02:00.422+0000 7fe4c30a89c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.161__shadow_.-rtnQwg6m3_XhVnv_bNZYGuIPLNk3et_0 2024-09-14T13:02:00.413 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T13:02:00.422+0000 7fe4c30a89c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.161__shadow_.-rtnQwg6m3_XhVnv_bNZYGuIPLNk3et_1 2024-09-14T13:02:00.413 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T13:02:00.422+0000 7fe4c30a89c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.161__shadow_.-rtnQwg6m3_XhVnv_bNZYGuIPLNk3et_2 2024-09-14T13:02:00.415 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T13:02:00.422+0000 7fe4c30a89c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T13:02:00.418 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T13:02:00.426+0000 7fe4c30a89c0 20 garbage collection: RGWGC::process entered with GC index_shard=10, max_secs=3600, expired_only=0 2024-09-14T13:02:00.419 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T13:02:00.426+0000 7fe4c30a89c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T13:02:00.420 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T13:02:00.426+0000 7fe4c30a89c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T13:02:00.421 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T13:02:00.430+0000 7fe4c30a89c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=4, truncated=0, next_marker='' 2024-09-14T13:02:00.421 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T13:02:00.430+0000 7fe4c30a89c0 20 garbage collection: RGWGC::process iterating over entry tag='_5T2qL4ktFmRHpChqJrYDXcMC1wj4WIa', time=2024-09-14T14:02:46.321189+0000, chain.objs.size()=2 2024-09-14T13:02:00.421 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T13:02:00.430+0000 7fe4c30a89c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.161__shadow_.-41jYHPoY6YJT7YoQ_PL93AZwuJvah-_1 2024-09-14T13:02:00.421 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T13:02:00.430+0000 7fe4c30a89c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.161__shadow_.-41jYHPoY6YJT7YoQ_PL93AZwuJvah-_2 2024-09-14T13:02:00.421 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T13:02:00.430+0000 7fe4c30a89c0 20 garbage collection: RGWGC::process iterating over entry tag='d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.3261225844429733789', time=2024-09-14T14:30:54.665788+0000, chain.objs.size()=6 2024-09-14T13:02:00.421 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T13:02:00.430+0000 7fe4c30a89c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.522__multipart_mymultipart.2~xCpBozn4Ni21Q24Pdm0rAeISYkDjIIT.1 2024-09-14T13:02:00.421 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T13:02:00.430+0000 7fe4c30a89c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.522__multipart_mymultipart.2~xCpBozn4Ni21Q24Pdm0rAeISYkDjIIT.2 2024-09-14T13:02:00.421 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T13:02:00.430+0000 7fe4c30a89c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.522__multipart_mymultipart.LG0oQbA1igDqQstuViO0d8C-57c1dqHC.3 2024-09-14T13:02:00.421 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T13:02:00.430+0000 7fe4c30a89c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.522__multipart_mymultipart.2~xCpBozn4Ni21Q24Pdm0rAeISYkDjIIT.4 2024-09-14T13:02:00.421 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T13:02:00.430+0000 7fe4c30a89c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.522__multipart_mymultipart.2~xCpBozn4Ni21Q24Pdm0rAeISYkDjIIT.5 2024-09-14T13:02:00.421 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T13:02:00.430+0000 7fe4c30a89c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.522__multipart_mymultipart.2~xCpBozn4Ni21Q24Pdm0rAeISYkDjIIT.6 2024-09-14T13:02:00.421 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T13:02:00.430+0000 7fe4c30a89c0 20 garbage collection: RGWGC::process iterating over entry tag='2~5G1qK_mfgtcEa-9teeDRQCKBnf0fT8Z', time=2024-09-14T14:33:18.723009+0000, chain.objs.size()=10 2024-09-14T13:02:00.421 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T13:02:00.430+0000 7fe4c30a89c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.526__multipart_mymultipart.2~5G1qK_mfgtcEa-9teeDRQCKBnf0fT8Z.1 2024-09-14T13:02:00.422 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T13:02:00.430+0000 7fe4c30a89c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.526__multipart_mymultipart.2~5G1qK_mfgtcEa-9teeDRQCKBnf0fT8Z.2 2024-09-14T13:02:00.422 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T13:02:00.430+0000 7fe4c30a89c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.526__multipart_mymultipart.2~5G1qK_mfgtcEa-9teeDRQCKBnf0fT8Z.3 2024-09-14T13:02:00.422 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T13:02:00.430+0000 7fe4c30a89c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.526__multipart_mymultipart.2~5G1qK_mfgtcEa-9teeDRQCKBnf0fT8Z.4 2024-09-14T13:02:00.424 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T13:02:00.434+0000 7fe4c30a89c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.526__multipart_mymultipart.2~5G1qK_mfgtcEa-9teeDRQCKBnf0fT8Z.5 2024-09-14T13:02:00.424 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T13:02:00.434+0000 7fe4c30a89c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.526__multipart_mymultipart.2~5G1qK_mfgtcEa-9teeDRQCKBnf0fT8Z.6 2024-09-14T13:02:00.426 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T13:02:00.434+0000 7fe4c30a89c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.526__multipart_mymultipart.2~5G1qK_mfgtcEa-9teeDRQCKBnf0fT8Z.7 2024-09-14T13:02:00.426 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T13:02:00.434+0000 7fe4c30a89c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.526__multipart_mymultipart.2~5G1qK_mfgtcEa-9teeDRQCKBnf0fT8Z.8 2024-09-14T13:02:00.426 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T13:02:00.434+0000 7fe4c30a89c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.526__multipart_mymultipart.2~5G1qK_mfgtcEa-9teeDRQCKBnf0fT8Z.9 2024-09-14T13:02:00.426 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T13:02:00.434+0000 7fe4c30a89c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.526__multipart_mymultipart.2~5G1qK_mfgtcEa-9teeDRQCKBnf0fT8Z.10 2024-09-14T13:02:00.426 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T13:02:00.434+0000 7fe4c30a89c0 20 garbage collection: RGWGC::process iterating over entry tag='d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.5158671355536146351', time=2024-09-14T14:34:38.583595+0000, chain.objs.size()=4 2024-09-14T13:02:00.426 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T13:02:00.434+0000 7fe4c30a89c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.535__multipart_mymultipart.2~YOVlFNvJeMhXInzy_5HdDavigQM-NtU.1 2024-09-14T13:02:00.426 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T13:02:00.434+0000 7fe4c30a89c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.535__multipart_mymultipart.2~YOVlFNvJeMhXInzy_5HdDavigQM-NtU.2 2024-09-14T13:02:00.426 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T13:02:00.434+0000 7fe4c30a89c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.535__multipart_mymultipart.1MWoZaralWzyOt6mXy1HNvd5NQK16zYt.3 2024-09-14T13:02:00.426 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T13:02:00.434+0000 7fe4c30a89c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.535__multipart_mymultipart.2~YOVlFNvJeMhXInzy_5HdDavigQM-NtU.4 2024-09-14T13:02:00.430 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T13:02:00.438+0000 7fe4c30a89c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T13:02:00.433 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T13:02:00.442+0000 7fe4c30a89c0 20 garbage collection: RGWGC::process entered with GC index_shard=11, max_secs=3600, expired_only=0 2024-09-14T13:02:00.435 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T13:02:00.442+0000 7fe4c30a89c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T13:02:00.436 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T13:02:00.442+0000 7fe4c30a89c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T13:02:00.436 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T13:02:00.446+0000 7fe4c30a89c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=4, truncated=0, next_marker='' 2024-09-14T13:02:00.437 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T13:02:00.446+0000 7fe4c30a89c0 20 garbage collection: RGWGC::process iterating over entry tag='d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.17901904622133923080', time=2024-09-14T14:01:43.923053+0000, chain.objs.size()=5 2024-09-14T13:02:00.437 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T13:02:00.446+0000 7fe4c30a89c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.159__multipart_mymultipart-LUKEWARM.2~8ppOQI2D9i9hMUkewkw-zs-46vKHsv_.1 2024-09-14T13:02:00.437 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T13:02:00.446+0000 7fe4c30a89c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.159__shadow_mymultipart-LUKEWARM.2~8ppOQI2D9i9hMUkewkw-zs-46vKHsv_.1_1 2024-09-14T13:02:00.437 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T13:02:00.446+0000 7fe4c30a89c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.159__multipart_mymultipart-LUKEWARM.2~8ppOQI2D9i9hMUkewkw-zs-46vKHsv_.2 2024-09-14T13:02:00.437 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T13:02:00.446+0000 7fe4c30a89c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.159__shadow_mymultipart-LUKEWARM.2~8ppOQI2D9i9hMUkewkw-zs-46vKHsv_.2_1 2024-09-14T13:02:00.437 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T13:02:00.446+0000 7fe4c30a89c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.159__multipart_mymultipart-LUKEWARM.2~8ppOQI2D9i9hMUkewkw-zs-46vKHsv_.3 2024-09-14T13:02:00.437 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T13:02:00.446+0000 7fe4c30a89c0 20 garbage collection: RGWGC::process iterating over entry tag='2~R9CU5WanuaHkPsvEqq17udmt9CZiIZy', time=2024-09-14T14:29:01.444050+0000, chain.objs.size()=1 2024-09-14T13:02:00.437 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T13:02:00.446+0000 7fe4c30a89c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.522__multipart_mymultipart.2~R9CU5WanuaHkPsvEqq17udmt9CZiIZy.1 2024-09-14T13:02:00.437 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T13:02:00.446+0000 7fe4c30a89c0 20 garbage collection: RGWGC::process iterating over entry tag='d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.4397873842397183325', time=2024-09-14T14:33:31.154365+0000, chain.objs.size()=4 2024-09-14T13:02:00.437 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T13:02:00.446+0000 7fe4c30a89c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.527__multipart_mymultipart.2~lXa5Tjo5pPSatDkw-Cx_HiMnOJutcH0.1 2024-09-14T13:02:00.437 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T13:02:00.446+0000 7fe4c30a89c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.527__multipart_mymultipart.2~lXa5Tjo5pPSatDkw-Cx_HiMnOJutcH0.2 2024-09-14T13:02:00.437 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T13:02:00.446+0000 7fe4c30a89c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.527__multipart_mymultipart.2~lXa5Tjo5pPSatDkw-Cx_HiMnOJutcH0.3 2024-09-14T13:02:00.437 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T13:02:00.446+0000 7fe4c30a89c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.527__multipart_mymultipart.2~lXa5Tjo5pPSatDkw-Cx_HiMnOJutcH0.4 2024-09-14T13:02:00.437 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T13:02:00.446+0000 7fe4c30a89c0 20 garbage collection: RGWGC::process iterating over entry tag='d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.1647745142881096196', time=2024-09-14T14:42:46.548713+0000, chain.objs.size()=12 2024-09-14T13:02:00.438 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T13:02:00.446+0000 7fe4c30a89c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.613__multipart_multipart_enc.2~ZQUtoWshSBiPFbQ4dz9dxDBSZQBoNEs.1 2024-09-14T13:02:00.438 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T13:02:00.446+0000 7fe4c30a89c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.613__shadow_multipart_enc.2~ZQUtoWshSBiPFbQ4dz9dxDBSZQBoNEs.1_1 2024-09-14T13:02:00.441 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T13:02:00.450+0000 7fe4c30a89c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.613__multipart_multipart_enc.2~ZQUtoWshSBiPFbQ4dz9dxDBSZQBoNEs.2 2024-09-14T13:02:00.441 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T13:02:00.450+0000 7fe4c30a89c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.613__shadow_multipart_enc.2~ZQUtoWshSBiPFbQ4dz9dxDBSZQBoNEs.2_1 2024-09-14T13:02:00.441 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T13:02:00.450+0000 7fe4c30a89c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.613__multipart_multipart_enc.2~ZQUtoWshSBiPFbQ4dz9dxDBSZQBoNEs.3 2024-09-14T13:02:00.441 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T13:02:00.450+0000 7fe4c30a89c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.613__shadow_multipart_enc.2~ZQUtoWshSBiPFbQ4dz9dxDBSZQBoNEs.3_1 2024-09-14T13:02:00.441 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T13:02:00.450+0000 7fe4c30a89c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.613__multipart_multipart_enc.2~ZQUtoWshSBiPFbQ4dz9dxDBSZQBoNEs.4 2024-09-14T13:02:00.441 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T13:02:00.450+0000 7fe4c30a89c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.613__shadow_multipart_enc.2~ZQUtoWshSBiPFbQ4dz9dxDBSZQBoNEs.4_1 2024-09-14T13:02:00.442 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T13:02:00.450+0000 7fe4c30a89c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.613__multipart_multipart_enc.2~ZQUtoWshSBiPFbQ4dz9dxDBSZQBoNEs.5 2024-09-14T13:02:00.442 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T13:02:00.450+0000 7fe4c30a89c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.613__shadow_multipart_enc.2~ZQUtoWshSBiPFbQ4dz9dxDBSZQBoNEs.5_1 2024-09-14T13:02:00.442 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T13:02:00.450+0000 7fe4c30a89c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.613__multipart_multipart_enc.2~ZQUtoWshSBiPFbQ4dz9dxDBSZQBoNEs.6 2024-09-14T13:02:00.442 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T13:02:00.450+0000 7fe4c30a89c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.613__shadow_multipart_enc.2~ZQUtoWshSBiPFbQ4dz9dxDBSZQBoNEs.6_1 2024-09-14T13:02:00.447 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T13:02:00.454+0000 7fe4c30a89c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T13:02:00.450 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T13:02:00.458+0000 7fe4c30a89c0 20 garbage collection: RGWGC::process entered with GC index_shard=12, max_secs=3600, expired_only=0 2024-09-14T13:02:00.451 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T13:02:00.458+0000 7fe4c30a89c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T13:02:00.452 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T13:02:00.462+0000 7fe4c30a89c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T13:02:00.453 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T13:02:00.462+0000 7fe4c30a89c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=4, truncated=0, next_marker='' 2024-09-14T13:02:00.453 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T13:02:00.462+0000 7fe4c30a89c0 20 garbage collection: RGWGC::process iterating over entry tag='d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.10231956731540482028', time=2024-09-14T14:01:44.000878+0000, chain.objs.size()=3 2024-09-14T13:02:00.453 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T13:02:00.462+0000 7fe4c30a89c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.159__multipart_mymultipart-STANDARD.2~25exWmb843FDjrCgGD3bs0MKk7Kf6Q7.1 2024-09-14T13:02:00.453 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T13:02:00.462+0000 7fe4c30a89c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.159__multipart_mymultipart-STANDARD.2~25exWmb843FDjrCgGD3bs0MKk7Kf6Q7.2 2024-09-14T13:02:00.453 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T13:02:00.462+0000 7fe4c30a89c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.159__multipart_mymultipart-STANDARD.2~25exWmb843FDjrCgGD3bs0MKk7Kf6Q7.3 2024-09-14T13:02:00.453 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T13:02:00.462+0000 7fe4c30a89c0 20 garbage collection: RGWGC::process iterating over entry tag='d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.1016866762113119376', time=2024-09-14T14:02:43.774621+0000, chain.objs.size()=5 2024-09-14T13:02:00.453 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T13:02:00.462+0000 7fe4c30a89c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.161__multipart_foo-FROZEN.2~7iCbjNkwSgJgCiJDy5hUBEIAa5ya3mF.1 2024-09-14T13:02:00.453 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T13:02:00.462+0000 7fe4c30a89c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.161__shadow_foo-FROZEN.2~7iCbjNkwSgJgCiJDy5hUBEIAa5ya3mF.1_1 2024-09-14T13:02:00.454 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T13:02:00.462+0000 7fe4c30a89c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.161__multipart_foo-FROZEN.2~7iCbjNkwSgJgCiJDy5hUBEIAa5ya3mF.2 2024-09-14T13:02:00.454 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T13:02:00.462+0000 7fe4c30a89c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.161__shadow_foo-FROZEN.2~7iCbjNkwSgJgCiJDy5hUBEIAa5ya3mF.2_1 2024-09-14T13:02:00.454 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T13:02:00.462+0000 7fe4c30a89c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.161__multipart_foo-FROZEN.2~7iCbjNkwSgJgCiJDy5hUBEIAa5ya3mF.3 2024-09-14T13:02:00.454 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T13:02:00.462+0000 7fe4c30a89c0 20 garbage collection: RGWGC::process iterating over entry tag='_AAWtXpnSrgvvrTLQqD9fl4xUp5zHMJy', time=2024-09-14T14:02:57.761898+0000, chain.objs.size()=1 2024-09-14T13:02:00.454 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T13:02:00.462+0000 7fe4c30a89c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.163__shadow_.yishH9Cpg-CQOHaU19i4NvPZdLpd6hL_0 2024-09-14T13:02:00.454 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T13:02:00.462+0000 7fe4c30a89c0 20 garbage collection: RGWGC::process iterating over entry tag='d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.12169452310047609319', time=2024-09-14T14:32:49.540569+0000, chain.objs.size()=2 2024-09-14T13:02:00.454 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T13:02:00.462+0000 7fe4c30a89c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.525__multipart_mymultipart.2~yFOabXq2ZrNikq5kZenS-MXRTTAodVU.1 2024-09-14T13:02:00.454 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T13:02:00.462+0000 7fe4c30a89c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.525__shadow_mymultipart.2~yFOabXq2ZrNikq5kZenS-MXRTTAodVU.1_1 2024-09-14T13:02:00.456 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T13:02:00.466+0000 7fe4c30a89c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T13:02:00.459 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T13:02:00.466+0000 7fe4c30a89c0 20 garbage collection: RGWGC::process entered with GC index_shard=13, max_secs=3600, expired_only=0 2024-09-14T13:02:00.460 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T13:02:00.470+0000 7fe4c30a89c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T13:02:00.461 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T13:02:00.470+0000 7fe4c30a89c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T13:02:00.462 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T13:02:00.470+0000 7fe4c30a89c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=3, truncated=0, next_marker='' 2024-09-14T13:02:00.462 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T13:02:00.470+0000 7fe4c30a89c0 20 garbage collection: RGWGC::process iterating over entry tag='_qS_OV-kov_xG1X5Qyj-QmQlHPjgu5oe', time=2024-09-14T14:02:57.683824+0000, chain.objs.size()=1 2024-09-14T13:02:00.462 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T13:02:00.470+0000 7fe4c30a89c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.163__shadow_.B8We8oc3fOp_RTWNXFs5p5FW_CGUDux_0 2024-09-14T13:02:00.462 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T13:02:00.470+0000 7fe4c30a89c0 20 garbage collection: RGWGC::process iterating over entry tag='d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.1454488237740573551', time=2024-09-14T14:27:05.348674+0000, chain.objs.size()=1 2024-09-14T13:02:00.462 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T13:02:00.470+0000 7fe4c30a89c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.518__multipart_mymultipart.2~MHgLUKbJtFFFA0pHHnUYkCT0JCkR3Ef.1 2024-09-14T13:02:00.462 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T13:02:00.470+0000 7fe4c30a89c0 20 garbage collection: RGWGC::process iterating over entry tag='2~dm00NXGTflxGeH3XyV4_I-u7TQGKsC5', time=2024-09-14T14:48:00.436647+0000, chain.objs.size()=12 2024-09-14T13:02:00.462 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T13:02:00.470+0000 7fe4c30a89c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.625__multipart_multipart_enc.2~dm00NXGTflxGeH3XyV4_I-u7TQGKsC5.1 2024-09-14T13:02:00.462 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T13:02:00.470+0000 7fe4c30a89c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.625__shadow_multipart_enc.2~dm00NXGTflxGeH3XyV4_I-u7TQGKsC5.1_1 2024-09-14T13:02:00.463 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T13:02:00.470+0000 7fe4c30a89c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.625__multipart_multipart_enc.2~dm00NXGTflxGeH3XyV4_I-u7TQGKsC5.2 2024-09-14T13:02:00.463 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T13:02:00.470+0000 7fe4c30a89c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.625__shadow_multipart_enc.2~dm00NXGTflxGeH3XyV4_I-u7TQGKsC5.2_1 2024-09-14T13:02:00.463 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T13:02:00.470+0000 7fe4c30a89c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.625__multipart_multipart_enc.2~dm00NXGTflxGeH3XyV4_I-u7TQGKsC5.3 2024-09-14T13:02:00.463 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T13:02:00.470+0000 7fe4c30a89c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.625__shadow_multipart_enc.2~dm00NXGTflxGeH3XyV4_I-u7TQGKsC5.3_1 2024-09-14T13:02:00.463 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T13:02:00.470+0000 7fe4c30a89c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.625__multipart_multipart_enc.2~dm00NXGTflxGeH3XyV4_I-u7TQGKsC5.4 2024-09-14T13:02:00.463 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T13:02:00.470+0000 7fe4c30a89c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.625__shadow_multipart_enc.2~dm00NXGTflxGeH3XyV4_I-u7TQGKsC5.4_1 2024-09-14T13:02:00.463 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T13:02:00.470+0000 7fe4c30a89c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.625__multipart_multipart_enc.2~dm00NXGTflxGeH3XyV4_I-u7TQGKsC5.5 2024-09-14T13:02:00.463 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T13:02:00.470+0000 7fe4c30a89c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.625__shadow_multipart_enc.2~dm00NXGTflxGeH3XyV4_I-u7TQGKsC5.5_1 2024-09-14T13:02:00.464 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T13:02:00.470+0000 7fe4c30a89c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.625__multipart_multipart_enc.2~dm00NXGTflxGeH3XyV4_I-u7TQGKsC5.6 2024-09-14T13:02:00.464 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T13:02:00.474+0000 7fe4c30a89c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:d9e72d30-c60b-4d0d-9267-fdc36392d5ad.4454.625__shadow_multipart_enc.2~dm00NXGTflxGeH3XyV4_I-u7TQGKsC5.6_1 2024-09-14T13:02:00.471 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T13:02:00.478+0000 7fe4c30a89c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T13:02:00.474 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T13:02:00.482+0000 7fe3777e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T13:02:00.476 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T13:02:00.486+0000 7fe4c30a89c0 20 remove_watcher() i=0 2024-09-14T13:02:00.476 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T13:02:00.486+0000 7fe4c30a89c0 2 removed watcher, disabling cache 2024-09-14T13:02:00.477 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T13:02:00.486+0000 7fe4c30a89c0 20 remove_watcher() i=1 2024-09-14T13:02:00.479 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T13:02:00.486+0000 7fe4c30a89c0 20 remove_watcher() i=2 2024-09-14T13:02:00.480 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T13:02:00.486+0000 7fe4c30a89c0 20 remove_watcher() i=3 2024-09-14T13:02:00.481 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T13:02:00.490+0000 7fe4c30a89c0 20 remove_watcher() i=4 2024-09-14T13:02:00.482 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T13:02:00.490+0000 7fe4c30a89c0 20 remove_watcher() i=5 2024-09-14T13:02:00.483 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T13:02:00.490+0000 7fe4c30a89c0 20 remove_watcher() i=6 2024-09-14T13:02:00.484 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-14T13:02:00.494+0000 7fe4c30a89c0 20 remove_watcher() i=7 2024-09-14T13:02:00.497 DEBUG:teuthology.run_tasks:Unwinding manager openssl_keys 2024-09-14T13:02:00.506 DEBUG:teuthology.orchestra.run.smithi138:> rm -f /home/ubuntu/cephtest/ca/root.crt /home/ubuntu/cephtest/ca/root.key 2024-09-14T13:02:00.544 DEBUG:teuthology.orchestra.run.smithi138:> rmdir --ignore-fail-on-non-empty /home/ubuntu/cephtest/ca 2024-09-14T13:02:00.592 DEBUG:teuthology.orchestra.run.smithi138:> rm -f /home/ubuntu/cephtest/ca/rgw.client.0.crt /home/ubuntu/cephtest/ca/rgw.client.0.key 2024-09-14T13:02:00.641 DEBUG:teuthology.orchestra.run.smithi138:> rmdir --ignore-fail-on-non-empty /home/ubuntu/cephtest/ca 2024-09-14T13:02:00.688 DEBUG:teuthology.orchestra.run.smithi138:> sudo rm /usr/local/share/ca-certificates/root.crt 2024-09-14T13:02:00.744 DEBUG:teuthology.orchestra.run.smithi138:> sudo update-ca-certificates 2024-09-14T13:02:00.802 INFO:teuthology.orchestra.run.smithi138.stdout:Updating certificates in /etc/ssl/certs... 2024-09-14T13:02:01.168 INFO:teuthology.orchestra.run.smithi138.stdout:0 added, 0 removed; done. 2024-09-14T13:02:01.168 INFO:teuthology.orchestra.run.smithi138.stdout:Running hooks in /etc/ca-certificates/update.d... 2024-09-14T13:02:01.170 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-09-14T13:02:01.367 INFO:teuthology.orchestra.run.smithi138.stdout:done. 2024-09-14T13:02:01.368 INFO:teuthology.orchestra.run.smithi138.stdout:done. 2024-09-14T13:02:01.371 DEBUG:teuthology.run_tasks:Unwinding manager ceph 2024-09-14T13:02:01.381 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-09-14T13:02:01.381 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-14T13:02:01.767 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-09-14T13:02:01.779 INFO:teuthology.orchestra.run.smithi138.stderr:dumped all 2024-09-14T13:02:01.787 INFO:teuthology.orchestra.run.smithi138.stdout:{"pg_ready":true,"pg_map":{"version":3677,"stamp":"2024-09-14T13:02:01.293466+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":713319548,"num_objects":1006,"num_object_clones":0,"num_object_copies":2509,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1006,"num_whiteouts":0,"num_read":304962,"num_read_kb":3450897,"num_write":149497,"num_write_kb":2498419,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":191,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":12949,"ondisk_log_size":12949,"up":850,"acting":850,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":850,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2488432,"kb_used_data":1153392,"kb_used_omap":12,"kb_used_meta":1334899,"kb_avail":752486288,"statfs":{"total":773094113280,"available":770545958912,"internally_reserved":0,"allocated":1181073408,"data_stored":1163932612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":1366937136},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.009529"},"pg_stats":[{"pgid":"68.1a","version":"0'0","reported_seq":38,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:58:43.044370+0000","last_change":"2024-09-14T11:58:43.698171+0000","last_active":"2024-09-14T12:58:43.044370+0000","last_peered":"2024-09-14T12:58:43.044370+0000","last_clean":"2024-09-14T12:58:43.044370+0000","last_became_active":"2024-09-14T11:58:43.694936+0000","last_became_peered":"2024-09-14T11:58:43.694936+0000","last_unstale":"2024-09-14T12:58:43.044370+0000","last_undegraded":"2024-09-14T12:58:43.044370+0000","last_fullsized":"2024-09-14T12:58:43.044370+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:58:42.635024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:58:42.635024+0000","last_clean_scrub_stamp":"2024-09-14T11:58:42.635024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:02:52.327879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.1d","version":"264'2","reported_seq":63,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:57:48.032148+0000","last_change":"2024-09-14T11:30:17.527028+0000","last_active":"2024-09-14T12:57:48.032148+0000","last_peered":"2024-09-14T12:57:48.032148+0000","last_clean":"2024-09-14T12:57:48.032148+0000","last_became_active":"2024-09-14T11:30:17.525157+0000","last_became_peered":"2024-09-14T11:30:17.525157+0000","last_unstale":"2024-09-14T12:57:48.032148+0000","last_undegraded":"2024-09-14T12:57:48.032148+0000","last_fullsized":"2024-09-14T12:57:48.032148+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:30:16.474654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:30:16.474654+0000","last_clean_scrub_stamp":"2024-09-14T11:30:16.474654+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:14:59.272162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":4096,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.1c","version":"267'4","reported_seq":74,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:57:43.449013+0000","last_change":"2024-09-14T11:30:10.466403+0000","last_active":"2024-09-14T12:57:43.449013+0000","last_peered":"2024-09-14T12:57:43.449013+0000","last_clean":"2024-09-14T12:57:43.449013+0000","last_became_active":"2024-09-14T11:30:10.460441+0000","last_became_peered":"2024-09-14T11:30:10.460441+0000","last_unstale":"2024-09-14T12:57:43.449013+0000","last_undegraded":"2024-09-14T12:57:43.449013+0000","last_fullsized":"2024-09-14T12:57:43.449013+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:30:09.411354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:30:09.411354+0000","last_clean_scrub_stamp":"2024-09-14T11:30:09.411354+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:47:20.165693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5242880,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":6,"num_read_kb":6189,"num_write":4,"num_write_kb":5165,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.1f","version":"267'84","reported_seq":312,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:57:58.447987+0000","last_change":"2024-09-14T11:24:10.106139+0000","last_active":"2024-09-14T12:57:58.447987+0000","last_peered":"2024-09-14T12:57:58.447987+0000","last_clean":"2024-09-14T12:57:58.447987+0000","last_became_active":"2024-09-14T11:24:10.104105+0000","last_became_peered":"2024-09-14T11:24:10.104105+0000","last_unstale":"2024-09-14T12:57:58.447987+0000","last_undegraded":"2024-09-14T12:57:58.447987+0000","last_fullsized":"2024-09-14T12:57:58.447987+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:24:09.066501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:24:09.066501+0000","last_clean_scrub_stamp":"2024-09-14T11:24:09.066501+0000","objects_scrubbed":0,"log_size":84,"log_dups_size":0,"ondisk_log_size":84,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:25:27.324710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":704,"num_read_kb":504,"num_write":208,"num_write_kb":68,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.1b","version":"0'0","reported_seq":38,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:58:42.823851+0000","last_change":"2024-09-14T11:58:43.694459+0000","last_active":"2024-09-14T12:58:42.823851+0000","last_peered":"2024-09-14T12:58:42.823851+0000","last_clean":"2024-09-14T12:58:42.823851+0000","last_became_active":"2024-09-14T11:58:43.693847+0000","last_became_peered":"2024-09-14T11:58:43.693847+0000","last_unstale":"2024-09-14T12:58:42.823851+0000","last_undegraded":"2024-09-14T12:58:42.823851+0000","last_fullsized":"2024-09-14T12:58:42.823851+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:58:42.635024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:58:42.635024+0000","last_clean_scrub_stamp":"2024-09-14T11:58:42.635024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:49:04.187747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.1c","version":"267'5","reported_seq":70,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:57:48.216115+0000","last_change":"2024-09-14T11:30:17.525550+0000","last_active":"2024-09-14T12:57:48.216115+0000","last_peered":"2024-09-14T12:57:48.216115+0000","last_clean":"2024-09-14T12:57:48.216115+0000","last_became_active":"2024-09-14T11:30:17.524810+0000","last_became_peered":"2024-09-14T11:30:17.524810+0000","last_unstale":"2024-09-14T12:57:48.216115+0000","last_undegraded":"2024-09-14T12:57:48.216115+0000","last_fullsized":"2024-09-14T12:57:48.216115+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:30:16.474654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:30:16.474654+0000","last_clean_scrub_stamp":"2024-09-14T11:30:16.474654+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:05:01.153652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7005681,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":6,"num_read_kb":11636,"num_write":10,"num_write_kb":6842,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.1d","version":"0'0","reported_seq":65,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:57:43.447885+0000","last_change":"2024-09-14T11:30:10.475624+0000","last_active":"2024-09-14T12:57:43.447885+0000","last_peered":"2024-09-14T12:57:43.447885+0000","last_clean":"2024-09-14T12:57:43.447885+0000","last_became_active":"2024-09-14T11:30:10.474889+0000","last_became_peered":"2024-09-14T11:30:10.474889+0000","last_unstale":"2024-09-14T12:57:43.447885+0000","last_undegraded":"2024-09-14T12:57:43.447885+0000","last_fullsized":"2024-09-14T12:57:43.447885+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:30:09.411354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:30:09.411354+0000","last_clean_scrub_stamp":"2024-09-14T11:30:09.411354+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:14:21.245898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.1e","version":"267'279","reported_seq":912,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:58:42.824027+0000","last_change":"2024-09-14T11:24:10.091187+0000","last_active":"2024-09-14T12:58:42.824027+0000","last_peered":"2024-09-14T12:58:42.824027+0000","last_clean":"2024-09-14T12:58:42.824027+0000","last_became_active":"2024-09-14T11:24:10.090434+0000","last_became_peered":"2024-09-14T11:24:10.090434+0000","last_unstale":"2024-09-14T12:58:42.824027+0000","last_undegraded":"2024-09-14T12:58:42.824027+0000","last_fullsized":"2024-09-14T12:58:42.824027+0000","mapping_epoch":254,"log_start":"264'200","ondisk_log_start":"264'200","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:24:09.066501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:24:09.066501+0000","last_clean_scrub_stamp":"2024-09-14T11:24:09.066501+0000","objects_scrubbed":0,"log_size":79,"log_dups_size":200,"ondisk_log_size":79,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:12:05.681242+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2587,"num_read_kb":3188,"num_write":542,"num_write_kb":246,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.18","version":"0'0","reported_seq":39,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:59:08.431805+0000","last_change":"2024-09-14T11:58:43.686083+0000","last_active":"2024-09-14T12:59:08.431805+0000","last_peered":"2024-09-14T12:59:08.431805+0000","last_clean":"2024-09-14T12:59:08.431805+0000","last_became_active":"2024-09-14T11:58:43.685333+0000","last_became_peered":"2024-09-14T11:58:43.685333+0000","last_unstale":"2024-09-14T12:59:08.431805+0000","last_undegraded":"2024-09-14T12:59:08.431805+0000","last_fullsized":"2024-09-14T12:59:08.431805+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:58:42.635024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:58:42.635024+0000","last_clean_scrub_stamp":"2024-09-14T11:58:42.635024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:32:25.076693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"67.1f","version":"267'3","reported_seq":73,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:59:53.257511+0000","last_change":"2024-09-14T11:30:17.501198+0000","last_active":"2024-09-14T12:59:53.257511+0000","last_peered":"2024-09-14T12:59:53.257511+0000","last_clean":"2024-09-14T12:59:53.257511+0000","last_became_active":"2024-09-14T11:30:17.500369+0000","last_became_peered":"2024-09-14T11:30:17.500369+0000","last_unstale":"2024-09-14T12:59:53.257511+0000","last_undegraded":"2024-09-14T12:59:53.257511+0000","last_fullsized":"2024-09-14T12:59:53.257511+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:30:16.474654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:30:16.474654+0000","last_clean_scrub_stamp":"2024-09-14T11:30:16.474654+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:11:41.361082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4,"num_read_kb":8192,"num_write":3,"num_write_kb":8192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.1e","version":"264'4","reported_seq":84,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:58:42.824072+0000","last_change":"2024-09-14T11:30:10.446414+0000","last_active":"2024-09-14T12:58:42.824072+0000","last_peered":"2024-09-14T12:58:42.824072+0000","last_clean":"2024-09-14T12:58:42.824072+0000","last_became_active":"2024-09-14T11:30:10.445613+0000","last_became_peered":"2024-09-14T11:30:10.445613+0000","last_unstale":"2024-09-14T12:58:42.824072+0000","last_undegraded":"2024-09-14T12:58:42.824072+0000","last_fullsized":"2024-09-14T12:58:42.824072+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:30:09.411354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:30:09.411354+0000","last_clean_scrub_stamp":"2024-09-14T11:30:09.411354+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:21:50.415695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":4098,"num_write":4,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.1d","version":"267'16","reported_seq":119,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:59:13.248167+0000","last_change":"2024-09-14T11:24:10.112019+0000","last_active":"2024-09-14T12:59:13.248167+0000","last_peered":"2024-09-14T12:59:13.248167+0000","last_clean":"2024-09-14T12:59:13.248167+0000","last_became_active":"2024-09-14T11:24:10.111323+0000","last_became_peered":"2024-09-14T11:24:10.111323+0000","last_unstale":"2024-09-14T12:59:13.248167+0000","last_undegraded":"2024-09-14T12:59:13.248167+0000","last_fullsized":"2024-09-14T12:59:13.248167+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:24:09.066501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:24:09.066501+0000","last_clean_scrub_stamp":"2024-09-14T11:24:09.066501+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:39:25.435594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":134,"num_read_kb":93,"num_write":40,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.19","version":"0'0","reported_seq":39,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:59:18.471470+0000","last_change":"2024-09-14T11:58:43.701511+0000","last_active":"2024-09-14T12:59:18.471470+0000","last_peered":"2024-09-14T12:59:18.471470+0000","last_clean":"2024-09-14T12:59:18.471470+0000","last_became_active":"2024-09-14T11:58:43.700281+0000","last_became_peered":"2024-09-14T11:58:43.700281+0000","last_unstale":"2024-09-14T12:59:18.471470+0000","last_undegraded":"2024-09-14T12:59:18.471470+0000","last_fullsized":"2024-09-14T12:59:18.471470+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:58:42.635024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:58:42.635024+0000","last_clean_scrub_stamp":"2024-09-14T11:58:42.635024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:42:11.274748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.1e","version":"267'4","reported_seq":75,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:58:38.461692+0000","last_change":"2024-09-14T11:30:17.539744+0000","last_active":"2024-09-14T12:58:38.461692+0000","last_peered":"2024-09-14T12:58:38.461692+0000","last_clean":"2024-09-14T12:58:38.461692+0000","last_became_active":"2024-09-14T11:30:17.534642+0000","last_became_peered":"2024-09-14T11:30:17.534642+0000","last_unstale":"2024-09-14T12:58:38.461692+0000","last_undegraded":"2024-09-14T12:58:38.461692+0000","last_fullsized":"2024-09-14T12:58:38.461692+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:30:16.474654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:30:16.474654+0000","last_clean_scrub_stamp":"2024-09-14T11:30:16.474654+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:11:49.468312+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1088721,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":4,"num_read_kb":1064,"num_write":4,"num_write_kb":2088,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.1f","version":"267'1","reported_seq":74,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:59:48.243696+0000","last_change":"2024-09-14T11:30:10.443371+0000","last_active":"2024-09-14T12:59:48.243696+0000","last_peered":"2024-09-14T12:59:48.243696+0000","last_clean":"2024-09-14T12:59:48.243696+0000","last_became_active":"2024-09-14T11:30:10.442597+0000","last_became_peered":"2024-09-14T11:30:10.442597+0000","last_unstale":"2024-09-14T12:59:48.243696+0000","last_undegraded":"2024-09-14T12:59:48.243696+0000","last_fullsized":"2024-09-14T12:59:48.243696+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:30:09.411354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:30:09.411354+0000","last_clean_scrub_stamp":"2024-09-14T11:30:09.411354+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:25:51.419864+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1048576,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.1c","version":"267'41","reported_seq":188,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:59:13.470500+0000","last_change":"2024-09-14T11:24:10.128607+0000","last_active":"2024-09-14T12:59:13.470500+0000","last_peered":"2024-09-14T12:59:13.470500+0000","last_clean":"2024-09-14T12:59:13.470500+0000","last_became_active":"2024-09-14T11:24:10.124422+0000","last_became_peered":"2024-09-14T11:24:10.124422+0000","last_unstale":"2024-09-14T12:59:13.470500+0000","last_undegraded":"2024-09-14T12:59:13.470500+0000","last_fullsized":"2024-09-14T12:59:13.470500+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:24:09.066501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:24:09.066501+0000","last_clean_scrub_stamp":"2024-09-14T11:24:09.066501+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":0,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:13:03.605737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":350,"num_read_kb":247,"num_write":96,"num_write_kb":33,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.1e","version":"0'0","reported_seq":44,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:58:53.465451+0000","last_change":"2024-09-14T11:58:43.694842+0000","last_active":"2024-09-14T12:58:53.465451+0000","last_peered":"2024-09-14T12:58:53.465451+0000","last_clean":"2024-09-14T12:58:53.465451+0000","last_became_active":"2024-09-14T11:58:43.693760+0000","last_became_peered":"2024-09-14T11:58:43.693760+0000","last_unstale":"2024-09-14T12:58:53.465451+0000","last_undegraded":"2024-09-14T12:58:53.465451+0000","last_fullsized":"2024-09-14T12:58:53.465451+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:58:42.635024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:58:42.635024+0000","last_clean_scrub_stamp":"2024-09-14T11:58:42.635024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:18:34.791994+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.19","version":"0'0","reported_seq":60,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:57:43.030891+0000","last_change":"2024-09-14T11:30:17.531794+0000","last_active":"2024-09-14T12:57:43.030891+0000","last_peered":"2024-09-14T12:57:43.030891+0000","last_clean":"2024-09-14T12:57:43.030891+0000","last_became_active":"2024-09-14T11:30:17.531325+0000","last_became_peered":"2024-09-14T11:30:17.531325+0000","last_unstale":"2024-09-14T12:57:43.030891+0000","last_undegraded":"2024-09-14T12:57:43.030891+0000","last_fullsized":"2024-09-14T12:57:43.030891+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:30:16.474654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:30:16.474654+0000","last_clean_scrub_stamp":"2024-09-14T11:30:16.474654+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:04:12.434378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.18","version":"264'8","reported_seq":82,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:57:13.436998+0000","last_change":"2024-09-14T11:30:10.461819+0000","last_active":"2024-09-14T12:57:13.436998+0000","last_peered":"2024-09-14T12:57:13.436998+0000","last_clean":"2024-09-14T12:57:13.436998+0000","last_became_active":"2024-09-14T11:30:10.461101+0000","last_became_peered":"2024-09-14T11:30:10.461101+0000","last_unstale":"2024-09-14T12:57:13.436998+0000","last_undegraded":"2024-09-14T12:57:13.436998+0000","last_fullsized":"2024-09-14T12:57:13.436998+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:30:09.411354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:30:09.411354+0000","last_clean_scrub_stamp":"2024-09-14T11:30:09.411354+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:19:37.256749+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":8194,"num_write":18,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.1b","version":"264'28","reported_seq":149,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:59:13.470382+0000","last_change":"2024-09-14T11:24:10.130205+0000","last_active":"2024-09-14T12:59:13.470382+0000","last_peered":"2024-09-14T12:59:13.470382+0000","last_clean":"2024-09-14T12:59:13.470382+0000","last_became_active":"2024-09-14T11:24:10.129087+0000","last_became_peered":"2024-09-14T11:24:10.129087+0000","last_unstale":"2024-09-14T12:59:13.470382+0000","last_undegraded":"2024-09-14T12:59:13.470382+0000","last_fullsized":"2024-09-14T12:59:13.470382+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:24:09.066501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:24:09.066501+0000","last_clean_scrub_stamp":"2024-09-14T11:24:09.066501+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:55:41.881393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":229,"num_read_kb":159,"num_write":68,"num_write_kb":22,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.1f","version":"0'0","reported_seq":43,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:59:08.466883+0000","last_change":"2024-09-14T11:58:43.686856+0000","last_active":"2024-09-14T12:59:08.466883+0000","last_peered":"2024-09-14T12:59:08.466883+0000","last_clean":"2024-09-14T12:59:08.466883+0000","last_became_active":"2024-09-14T11:58:43.676679+0000","last_became_peered":"2024-09-14T11:58:43.676679+0000","last_unstale":"2024-09-14T12:59:08.466883+0000","last_undegraded":"2024-09-14T12:59:08.466883+0000","last_fullsized":"2024-09-14T12:59:08.466883+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:58:42.635024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:58:42.635024+0000","last_clean_scrub_stamp":"2024-09-14T11:58:42.635024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:32:45.311295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"67.18","version":"264'8","reported_seq":78,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:57:18.599896+0000","last_change":"2024-09-14T11:30:17.546333+0000","last_active":"2024-09-14T12:57:18.599896+0000","last_peered":"2024-09-14T12:57:18.599896+0000","last_clean":"2024-09-14T12:57:18.599896+0000","last_became_active":"2024-09-14T11:30:17.545478+0000","last_became_peered":"2024-09-14T11:30:17.545478+0000","last_unstale":"2024-09-14T12:57:18.599896+0000","last_undegraded":"2024-09-14T12:57:18.599896+0000","last_fullsized":"2024-09-14T12:57:18.599896+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:30:16.474654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:30:16.474654+0000","last_clean_scrub_stamp":"2024-09-14T11:30:16.474654+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:21:51.712103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":4166,"num_write":8,"num_write_kb":1092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"66.19","version":"267'5","reported_seq":74,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:57:33.212757+0000","last_change":"2024-09-14T11:30:10.467953+0000","last_active":"2024-09-14T12:57:33.212757+0000","last_peered":"2024-09-14T12:57:33.212757+0000","last_clean":"2024-09-14T12:57:33.212757+0000","last_became_active":"2024-09-14T11:30:10.467266+0000","last_became_peered":"2024-09-14T11:30:10.467266+0000","last_unstale":"2024-09-14T12:57:33.212757+0000","last_undegraded":"2024-09-14T12:57:33.212757+0000","last_fullsized":"2024-09-14T12:57:33.212757+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:30:09.411354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:30:09.411354+0000","last_clean_scrub_stamp":"2024-09-14T11:30:09.411354+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:25:57.710422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2097152,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":4,"num_read_kb":1047,"num_write":10,"num_write_kb":2071,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.1a","version":"267'87","reported_seq":314,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:59:13.433017+0000","last_change":"2024-09-14T11:24:10.121775+0000","last_active":"2024-09-14T12:59:13.433017+0000","last_peered":"2024-09-14T12:59:13.433017+0000","last_clean":"2024-09-14T12:59:13.433017+0000","last_became_active":"2024-09-14T11:24:10.121048+0000","last_became_peered":"2024-09-14T11:24:10.121048+0000","last_unstale":"2024-09-14T12:59:13.433017+0000","last_undegraded":"2024-09-14T12:59:13.433017+0000","last_fullsized":"2024-09-14T12:59:13.433017+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:24:09.066501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:24:09.066501+0000","last_clean_scrub_stamp":"2024-09-14T11:24:09.066501+0000","objects_scrubbed":0,"log_size":87,"log_dups_size":0,"ondisk_log_size":87,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:56:22.236572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":696,"num_read_kb":437,"num_write":216,"num_write_kb":62,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.1c","version":"267'1","reported_seq":39,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:58:47.835392+0000","last_change":"2024-09-14T11:58:43.685706+0000","last_active":"2024-09-14T12:58:47.835392+0000","last_peered":"2024-09-14T12:58:47.835392+0000","last_clean":"2024-09-14T12:58:47.835392+0000","last_became_active":"2024-09-14T11:58:43.684984+0000","last_became_peered":"2024-09-14T11:58:43.684984+0000","last_unstale":"2024-09-14T12:58:47.835392+0000","last_undegraded":"2024-09-14T12:58:47.835392+0000","last_fullsized":"2024-09-14T12:58:47.835392+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:58:42.635024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:58:42.635024+0000","last_clean_scrub_stamp":"2024-09-14T11:58:42.635024+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:29:12.171056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.1b","version":"0'0","reported_seq":59,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:57:48.606470+0000","last_change":"2024-09-14T11:30:17.527032+0000","last_active":"2024-09-14T12:57:48.606470+0000","last_peered":"2024-09-14T12:57:48.606470+0000","last_clean":"2024-09-14T12:57:48.606470+0000","last_became_active":"2024-09-14T11:30:17.526195+0000","last_became_peered":"2024-09-14T11:30:17.526195+0000","last_unstale":"2024-09-14T12:57:48.606470+0000","last_undegraded":"2024-09-14T12:57:48.606470+0000","last_fullsized":"2024-09-14T12:57:48.606470+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:30:16.474654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:30:16.474654+0000","last_clean_scrub_stamp":"2024-09-14T11:30:16.474654+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:49:29.835475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"66.1a","version":"264'2","reported_seq":69,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:57:43.214859+0000","last_change":"2024-09-14T11:30:10.443423+0000","last_active":"2024-09-14T12:57:43.214859+0000","last_peered":"2024-09-14T12:57:43.214859+0000","last_clean":"2024-09-14T12:57:43.214859+0000","last_became_active":"2024-09-14T11:30:10.442753+0000","last_became_peered":"2024-09-14T11:30:10.442753+0000","last_unstale":"2024-09-14T12:57:43.214859+0000","last_undegraded":"2024-09-14T12:57:43.214859+0000","last_fullsized":"2024-09-14T12:57:43.214859+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:30:09.411354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:30:09.411354+0000","last_clean_scrub_stamp":"2024-09-14T11:30:09.411354+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:17:07.453981+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":4096,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.19","version":"267'12","reported_seq":105,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:58:53.242473+0000","last_change":"2024-09-14T11:24:10.099618+0000","last_active":"2024-09-14T12:58:53.242473+0000","last_peered":"2024-09-14T12:58:53.242473+0000","last_clean":"2024-09-14T12:58:53.242473+0000","last_became_active":"2024-09-14T11:24:10.098890+0000","last_became_peered":"2024-09-14T11:24:10.098890+0000","last_unstale":"2024-09-14T12:58:53.242473+0000","last_undegraded":"2024-09-14T12:58:53.242473+0000","last_fullsized":"2024-09-14T12:58:53.242473+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:24:09.066501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:24:09.066501+0000","last_clean_scrub_stamp":"2024-09-14T11:24:09.066501+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:33:18.468820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":81,"num_read_kb":53,"num_write":29,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.1d","version":"0'0","reported_seq":38,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:58:47.835476+0000","last_change":"2024-09-14T11:58:43.688034+0000","last_active":"2024-09-14T12:58:47.835476+0000","last_peered":"2024-09-14T12:58:47.835476+0000","last_clean":"2024-09-14T12:58:47.835476+0000","last_became_active":"2024-09-14T11:58:43.687072+0000","last_became_peered":"2024-09-14T11:58:43.687072+0000","last_unstale":"2024-09-14T12:58:47.835476+0000","last_undegraded":"2024-09-14T12:58:47.835476+0000","last_fullsized":"2024-09-14T12:58:47.835476+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:58:42.635024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:58:42.635024+0000","last_clean_scrub_stamp":"2024-09-14T11:58:42.635024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:54:30.111603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.1a","version":"0'0","reported_seq":59,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:57:48.450199+0000","last_change":"2024-09-14T11:30:17.535485+0000","last_active":"2024-09-14T12:57:48.450199+0000","last_peered":"2024-09-14T12:57:48.450199+0000","last_clean":"2024-09-14T12:57:48.450199+0000","last_became_active":"2024-09-14T11:30:17.534937+0000","last_became_peered":"2024-09-14T11:30:17.534937+0000","last_unstale":"2024-09-14T12:57:48.450199+0000","last_undegraded":"2024-09-14T12:57:48.450199+0000","last_fullsized":"2024-09-14T12:57:48.450199+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:30:16.474654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:30:16.474654+0000","last_clean_scrub_stamp":"2024-09-14T11:30:16.474654+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:48:56.727170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.1b","version":"267'4","reported_seq":74,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:57:43.444836+0000","last_change":"2024-09-14T11:30:10.461481+0000","last_active":"2024-09-14T12:57:43.444836+0000","last_peered":"2024-09-14T12:57:43.444836+0000","last_clean":"2024-09-14T12:57:43.444836+0000","last_became_active":"2024-09-14T11:30:10.460666+0000","last_became_peered":"2024-09-14T11:30:10.460666+0000","last_unstale":"2024-09-14T12:57:43.444836+0000","last_undegraded":"2024-09-14T12:57:43.444836+0000","last_fullsized":"2024-09-14T12:57:43.444836+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:30:09.411354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:30:09.411354+0000","last_clean_scrub_stamp":"2024-09-14T11:30:09.411354+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:56:08.121178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":6,"num_read_kb":14336,"num_write":4,"num_write_kb":10240,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.18","version":"267'142","reported_seq":495,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:58:28.457825+0000","last_change":"2024-09-14T11:24:10.121116+0000","last_active":"2024-09-14T12:58:28.457825+0000","last_peered":"2024-09-14T12:58:28.457825+0000","last_clean":"2024-09-14T12:58:28.457825+0000","last_became_active":"2024-09-14T11:24:10.117854+0000","last_became_peered":"2024-09-14T11:24:10.117854+0000","last_unstale":"2024-09-14T12:58:28.457825+0000","last_undegraded":"2024-09-14T12:58:28.457825+0000","last_fullsized":"2024-09-14T12:58:28.457825+0000","mapping_epoch":254,"log_start":"264'100","ondisk_log_start":"264'100","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:24:09.066501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:24:09.066501+0000","last_clean_scrub_stamp":"2024-09-14T11:24:09.066501+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":100,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:44:16.667239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1285,"num_read_kb":1365,"num_write":297,"num_write_kb":120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"68.12","version":"0'0","reported_seq":40,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:59:23.469971+0000","last_change":"2024-09-14T11:58:43.678310+0000","last_active":"2024-09-14T12:59:23.469971+0000","last_peered":"2024-09-14T12:59:23.469971+0000","last_clean":"2024-09-14T12:59:23.469971+0000","last_became_active":"2024-09-14T11:58:43.675254+0000","last_became_peered":"2024-09-14T11:58:43.675254+0000","last_unstale":"2024-09-14T12:59:23.469971+0000","last_undegraded":"2024-09-14T12:59:23.469971+0000","last_fullsized":"2024-09-14T12:59:23.469971+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:58:42.635024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:58:42.635024+0000","last_clean_scrub_stamp":"2024-09-14T11:58:42.635024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:53:22.218376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"67.15","version":"267'1","reported_seq":63,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:57:18.439393+0000","last_change":"2024-09-14T11:30:17.539875+0000","last_active":"2024-09-14T12:57:18.439393+0000","last_peered":"2024-09-14T12:57:18.439393+0000","last_clean":"2024-09-14T12:57:18.439393+0000","last_became_active":"2024-09-14T11:30:17.536010+0000","last_became_peered":"2024-09-14T11:30:17.536010+0000","last_unstale":"2024-09-14T12:57:18.439393+0000","last_undegraded":"2024-09-14T12:57:18.439393+0000","last_fullsized":"2024-09-14T12:57:18.439393+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:30:16.474654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:30:16.474654+0000","last_clean_scrub_stamp":"2024-09-14T11:30:16.474654+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:50:45.649965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":8192,"num_write":1,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.14","version":"267'4","reported_seq":75,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:59:18.052199+0000","last_change":"2024-09-14T11:30:10.463826+0000","last_active":"2024-09-14T12:59:18.052199+0000","last_peered":"2024-09-14T12:59:18.052199+0000","last_clean":"2024-09-14T12:59:18.052199+0000","last_became_active":"2024-09-14T11:30:10.462605+0000","last_became_peered":"2024-09-14T11:30:10.462605+0000","last_unstale":"2024-09-14T12:59:18.052199+0000","last_undegraded":"2024-09-14T12:59:18.052199+0000","last_fullsized":"2024-09-14T12:59:18.052199+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:30:09.411354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:30:09.411354+0000","last_clean_scrub_stamp":"2024-09-14T11:30:09.411354+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:10:34.672801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4,"num_read_kb":5120,"num_write":9,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.17","version":"267'12","reported_seq":105,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:58:28.236663+0000","last_change":"2024-09-14T11:24:10.104884+0000","last_active":"2024-09-14T12:58:28.236663+0000","last_peered":"2024-09-14T12:58:28.236663+0000","last_clean":"2024-09-14T12:58:28.236663+0000","last_became_active":"2024-09-14T11:24:10.101934+0000","last_became_peered":"2024-09-14T11:24:10.101934+0000","last_unstale":"2024-09-14T12:58:28.236663+0000","last_undegraded":"2024-09-14T12:58:28.236663+0000","last_fullsized":"2024-09-14T12:58:28.236663+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:24:09.066501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:24:09.066501+0000","last_clean_scrub_stamp":"2024-09-14T11:24:09.066501+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:18:41.803884+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":86,"num_read_kb":56,"num_write":31,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.13","version":"267'1","reported_seq":41,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:59:22.832843+0000","last_change":"2024-09-14T11:58:43.676310+0000","last_active":"2024-09-14T12:59:22.832843+0000","last_peered":"2024-09-14T12:59:22.832843+0000","last_clean":"2024-09-14T12:59:22.832843+0000","last_became_active":"2024-09-14T11:58:43.675526+0000","last_became_peered":"2024-09-14T11:58:43.675526+0000","last_unstale":"2024-09-14T12:59:22.832843+0000","last_undegraded":"2024-09-14T12:59:22.832843+0000","last_fullsized":"2024-09-14T12:59:22.832843+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:58:42.635024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:58:42.635024+0000","last_clean_scrub_stamp":"2024-09-14T11:58:42.635024+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:44:06.879207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.14","version":"267'6","reported_seq":75,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:59:18.471550+0000","last_change":"2024-09-14T11:30:17.544306+0000","last_active":"2024-09-14T12:59:18.471550+0000","last_peered":"2024-09-14T12:59:18.471550+0000","last_clean":"2024-09-14T12:59:18.471550+0000","last_became_active":"2024-09-14T11:30:17.543741+0000","last_became_peered":"2024-09-14T11:30:17.543741+0000","last_unstale":"2024-09-14T12:59:18.471550+0000","last_undegraded":"2024-09-14T12:59:18.471550+0000","last_fullsized":"2024-09-14T12:59:18.471550+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:30:16.474654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:30:16.474654+0000","last_clean_scrub_stamp":"2024-09-14T11:30:16.474654+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:33:14.837541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":10,"num_read_kb":20482,"num_write":11,"num_write_kb":8192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.15","version":"267'2","reported_seq":70,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:57:12.813093+0000","last_change":"2024-09-14T11:30:10.468990+0000","last_active":"2024-09-14T12:57:12.813093+0000","last_peered":"2024-09-14T12:57:12.813093+0000","last_clean":"2024-09-14T12:57:12.813093+0000","last_became_active":"2024-09-14T11:30:10.468238+0000","last_became_peered":"2024-09-14T11:30:10.468238+0000","last_unstale":"2024-09-14T12:57:12.813093+0000","last_undegraded":"2024-09-14T12:57:12.813093+0000","last_fullsized":"2024-09-14T12:57:12.813093+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:30:09.411354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:30:09.411354+0000","last_clean_scrub_stamp":"2024-09-14T11:30:09.411354+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:48:16.808159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1048576,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2048,"num_write":7,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.16","version":"267'33","reported_seq":168,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:58:28.459408+0000","last_change":"2024-09-14T11:24:10.129833+0000","last_active":"2024-09-14T12:58:28.459408+0000","last_peered":"2024-09-14T12:58:28.459408+0000","last_clean":"2024-09-14T12:58:28.459408+0000","last_became_active":"2024-09-14T11:24:10.128354+0000","last_became_peered":"2024-09-14T11:24:10.128354+0000","last_unstale":"2024-09-14T12:58:28.459408+0000","last_undegraded":"2024-09-14T12:58:28.459408+0000","last_fullsized":"2024-09-14T12:58:28.459408+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:24:09.066501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:24:09.066501+0000","last_clean_scrub_stamp":"2024-09-14T11:24:09.066501+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:04:36.875537+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":269,"num_read_kb":173,"num_write":83,"num_write_kb":23,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.10","version":"0'0","reported_seq":40,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:59:27.844631+0000","last_change":"2024-09-14T11:58:43.689414+0000","last_active":"2024-09-14T12:59:27.844631+0000","last_peered":"2024-09-14T12:59:27.844631+0000","last_clean":"2024-09-14T12:59:27.844631+0000","last_became_active":"2024-09-14T11:58:43.688698+0000","last_became_peered":"2024-09-14T11:58:43.688698+0000","last_unstale":"2024-09-14T12:59:27.844631+0000","last_undegraded":"2024-09-14T12:59:27.844631+0000","last_fullsized":"2024-09-14T12:59:27.844631+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:58:42.635024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:58:42.635024+0000","last_clean_scrub_stamp":"2024-09-14T11:58:42.635024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:13:07.184551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.17","version":"267'3","reported_seq":68,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:57:18.439507+0000","last_change":"2024-09-14T11:30:17.544374+0000","last_active":"2024-09-14T12:57:18.439507+0000","last_peered":"2024-09-14T12:57:18.439507+0000","last_clean":"2024-09-14T12:57:18.439507+0000","last_became_active":"2024-09-14T11:30:17.543802+0000","last_became_peered":"2024-09-14T11:30:17.543802+0000","last_unstale":"2024-09-14T12:57:18.439507+0000","last_undegraded":"2024-09-14T12:57:18.439507+0000","last_fullsized":"2024-09-14T12:57:18.439507+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:30:16.474654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:30:16.474654+0000","last_clean_scrub_stamp":"2024-09-14T11:30:16.474654+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:16:04.970158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":5,"num_read_kb":20480,"num_write":8,"num_write_kb":8192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.16","version":"264'4","reported_seq":76,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:57:12.805460+0000","last_change":"2024-09-14T11:30:10.472659+0000","last_active":"2024-09-14T12:57:12.805460+0000","last_peered":"2024-09-14T12:57:12.805460+0000","last_clean":"2024-09-14T12:57:12.805460+0000","last_became_active":"2024-09-14T11:30:10.471956+0000","last_became_peered":"2024-09-14T11:30:10.471956+0000","last_unstale":"2024-09-14T12:57:12.805460+0000","last_undegraded":"2024-09-14T12:57:12.805460+0000","last_fullsized":"2024-09-14T12:57:12.805460+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:30:09.411354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:30:09.411354+0000","last_clean_scrub_stamp":"2024-09-14T11:30:09.411354+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:46:34.361903+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":4098,"num_write":4,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.15","version":"267'34","reported_seq":165,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:58:27.820574+0000","last_change":"2024-09-14T11:24:10.097703+0000","last_active":"2024-09-14T12:58:27.820574+0000","last_peered":"2024-09-14T12:58:27.820574+0000","last_clean":"2024-09-14T12:58:27.820574+0000","last_became_active":"2024-09-14T11:24:10.097011+0000","last_became_peered":"2024-09-14T11:24:10.097011+0000","last_unstale":"2024-09-14T12:58:27.820574+0000","last_undegraded":"2024-09-14T12:58:27.820574+0000","last_fullsized":"2024-09-14T12:58:27.820574+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:24:09.066501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:24:09.066501+0000","last_clean_scrub_stamp":"2024-09-14T11:24:09.066501+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:37:34.066370+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":263,"num_read_kb":166,"num_write":89,"num_write_kb":24,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.11","version":"0'0","reported_seq":40,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:59:23.053229+0000","last_change":"2024-09-14T11:58:43.689926+0000","last_active":"2024-09-14T12:59:23.053229+0000","last_peered":"2024-09-14T12:59:23.053229+0000","last_clean":"2024-09-14T12:59:23.053229+0000","last_became_active":"2024-09-14T11:58:43.688315+0000","last_became_peered":"2024-09-14T11:58:43.688315+0000","last_unstale":"2024-09-14T12:59:23.053229+0000","last_undegraded":"2024-09-14T12:59:23.053229+0000","last_fullsized":"2024-09-14T12:59:23.053229+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:58:42.635024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:58:42.635024+0000","last_clean_scrub_stamp":"2024-09-14T11:58:42.635024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:41:40.616158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.16","version":"0'0","reported_seq":60,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:57:18.209507+0000","last_change":"2024-09-14T11:30:17.529543+0000","last_active":"2024-09-14T12:57:18.209507+0000","last_peered":"2024-09-14T12:57:18.209507+0000","last_clean":"2024-09-14T12:57:18.209507+0000","last_became_active":"2024-09-14T11:30:17.528777+0000","last_became_peered":"2024-09-14T11:30:17.528777+0000","last_unstale":"2024-09-14T12:57:18.209507+0000","last_undegraded":"2024-09-14T12:57:18.209507+0000","last_fullsized":"2024-09-14T12:57:18.209507+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:30:16.474654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:30:16.474654+0000","last_clean_scrub_stamp":"2024-09-14T11:30:16.474654+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:39:05.624425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.17","version":"267'2","reported_seq":70,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:57:13.437466+0000","last_change":"2024-09-14T11:30:10.473815+0000","last_active":"2024-09-14T12:57:13.437466+0000","last_peered":"2024-09-14T12:57:13.437466+0000","last_clean":"2024-09-14T12:57:13.437466+0000","last_became_active":"2024-09-14T11:30:10.469237+0000","last_became_peered":"2024-09-14T11:30:10.469237+0000","last_unstale":"2024-09-14T12:57:13.437466+0000","last_undegraded":"2024-09-14T12:57:13.437466+0000","last_fullsized":"2024-09-14T12:57:13.437466+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:30:09.411354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:30:09.411354+0000","last_clean_scrub_stamp":"2024-09-14T11:30:09.411354+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:02:16.697692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4908529,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":4794,"num_write":2,"num_write_kb":4794,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.14","version":"267'34","reported_seq":163,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:58:02.824925+0000","last_change":"2024-09-14T11:24:10.120917+0000","last_active":"2024-09-14T12:58:02.824925+0000","last_peered":"2024-09-14T12:58:02.824925+0000","last_clean":"2024-09-14T12:58:02.824925+0000","last_became_active":"2024-09-14T11:24:10.120143+0000","last_became_peered":"2024-09-14T11:24:10.120143+0000","last_unstale":"2024-09-14T12:58:02.824925+0000","last_undegraded":"2024-09-14T12:58:02.824925+0000","last_fullsized":"2024-09-14T12:58:02.824925+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:24:09.066501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:24:09.066501+0000","last_clean_scrub_stamp":"2024-09-14T11:24:09.066501+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:47:01.835320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":239,"num_read_kb":157,"num_write":95,"num_write_kb":23,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.16","version":"0'0","reported_seq":39,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:59:08.469272+0000","last_change":"2024-09-14T11:58:43.687060+0000","last_active":"2024-09-14T12:59:08.469272+0000","last_peered":"2024-09-14T12:59:08.469272+0000","last_clean":"2024-09-14T12:59:08.469272+0000","last_became_active":"2024-09-14T11:58:43.685594+0000","last_became_peered":"2024-09-14T11:58:43.685594+0000","last_unstale":"2024-09-14T12:59:08.469272+0000","last_undegraded":"2024-09-14T12:59:08.469272+0000","last_fullsized":"2024-09-14T12:59:08.469272+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:58:42.635024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:58:42.635024+0000","last_clean_scrub_stamp":"2024-09-14T11:58:42.635024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:15:01.961069+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.11","version":"264'4","reported_seq":72,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:58:58.464568+0000","last_change":"2024-09-14T11:30:17.524449+0000","last_active":"2024-09-14T12:58:58.464568+0000","last_peered":"2024-09-14T12:58:58.464568+0000","last_clean":"2024-09-14T12:58:58.464568+0000","last_became_active":"2024-09-14T11:30:17.523720+0000","last_became_peered":"2024-09-14T11:30:17.523720+0000","last_unstale":"2024-09-14T12:58:58.464568+0000","last_undegraded":"2024-09-14T12:58:58.464568+0000","last_fullsized":"2024-09-14T12:58:58.464568+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:30:16.474654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:30:16.474654+0000","last_clean_scrub_stamp":"2024-09-14T11:30:16.474654+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:47:46.829903+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":4098,"num_write":4,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.10","version":"264'2","reported_seq":72,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:58:53.231284+0000","last_change":"2024-09-14T11:30:10.464461+0000","last_active":"2024-09-14T12:58:53.231284+0000","last_peered":"2024-09-14T12:58:53.231284+0000","last_clean":"2024-09-14T12:58:53.231284+0000","last_became_active":"2024-09-14T11:30:10.463671+0000","last_became_peered":"2024-09-14T11:30:10.463671+0000","last_unstale":"2024-09-14T12:58:53.231284+0000","last_undegraded":"2024-09-14T12:58:53.231284+0000","last_fullsized":"2024-09-14T12:58:53.231284+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:30:09.411354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:30:09.411354+0000","last_clean_scrub_stamp":"2024-09-14T11:30:09.411354+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:20:15.603839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":4096,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.13","version":"267'23","reported_seq":139,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:57:32.817933+0000","last_change":"2024-09-14T11:24:10.121802+0000","last_active":"2024-09-14T12:57:32.817933+0000","last_peered":"2024-09-14T12:57:32.817933+0000","last_clean":"2024-09-14T12:57:32.817933+0000","last_became_active":"2024-09-14T11:24:10.120764+0000","last_became_peered":"2024-09-14T11:24:10.120764+0000","last_unstale":"2024-09-14T12:57:32.817933+0000","last_undegraded":"2024-09-14T12:57:32.817933+0000","last_fullsized":"2024-09-14T12:57:32.817933+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:24:09.066501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:24:09.066501+0000","last_clean_scrub_stamp":"2024-09-14T11:24:09.066501+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:38:35.957872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":187,"num_read_kb":128,"num_write":64,"num_write_kb":17,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.17","version":"0'0","reported_seq":39,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:59:08.247094+0000","last_change":"2024-09-14T11:58:43.677764+0000","last_active":"2024-09-14T12:59:08.247094+0000","last_peered":"2024-09-14T12:59:08.247094+0000","last_clean":"2024-09-14T12:59:08.247094+0000","last_became_active":"2024-09-14T11:58:43.677005+0000","last_became_peered":"2024-09-14T11:58:43.677005+0000","last_unstale":"2024-09-14T12:59:08.247094+0000","last_undegraded":"2024-09-14T12:59:08.247094+0000","last_fullsized":"2024-09-14T12:59:08.247094+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:58:42.635024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:58:42.635024+0000","last_clean_scrub_stamp":"2024-09-14T11:58:42.635024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:38:06.608929+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.10","version":"267'2","reported_seq":66,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:58:58.464483+0000","last_change":"2024-09-14T11:30:17.510820+0000","last_active":"2024-09-14T12:58:58.464483+0000","last_peered":"2024-09-14T12:58:58.464483+0000","last_clean":"2024-09-14T12:58:58.464483+0000","last_became_active":"2024-09-14T11:30:17.510031+0000","last_became_peered":"2024-09-14T11:30:17.510031+0000","last_unstale":"2024-09-14T12:58:58.464483+0000","last_undegraded":"2024-09-14T12:58:58.464483+0000","last_fullsized":"2024-09-14T12:58:58.464483+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:30:16.474654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:30:16.474654+0000","last_clean_scrub_stamp":"2024-09-14T11:30:16.474654+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:53:33.188778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2097152,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2048,"num_write":2,"num_write_kb":2048,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.11","version":"0'0","reported_seq":68,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:58:53.465194+0000","last_change":"2024-09-14T11:30:10.468119+0000","last_active":"2024-09-14T12:58:53.465194+0000","last_peered":"2024-09-14T12:58:53.465194+0000","last_clean":"2024-09-14T12:58:53.465194+0000","last_became_active":"2024-09-14T11:30:10.459020+0000","last_became_peered":"2024-09-14T11:30:10.459020+0000","last_unstale":"2024-09-14T12:58:53.465194+0000","last_undegraded":"2024-09-14T12:58:53.465194+0000","last_fullsized":"2024-09-14T12:58:53.465194+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:30:09.411354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:30:09.411354+0000","last_clean_scrub_stamp":"2024-09-14T11:30:09.411354+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:19:33.421651+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.12","version":"267'21","reported_seq":135,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:57:33.442363+0000","last_change":"2024-09-14T11:24:10.125240+0000","last_active":"2024-09-14T12:57:33.442363+0000","last_peered":"2024-09-14T12:57:33.442363+0000","last_clean":"2024-09-14T12:57:33.442363+0000","last_became_active":"2024-09-14T11:24:10.124482+0000","last_became_peered":"2024-09-14T11:24:10.124482+0000","last_unstale":"2024-09-14T12:57:33.442363+0000","last_undegraded":"2024-09-14T12:57:33.442363+0000","last_fullsized":"2024-09-14T12:57:33.442363+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:24:09.066501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:24:09.066501+0000","last_clean_scrub_stamp":"2024-09-14T11:24:09.066501+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:42:43.834915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":165,"num_read_kb":113,"num_write":54,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.14","version":"266'1","reported_seq":40,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:57:18.438576+0000","last_change":"2024-09-14T11:58:43.676454+0000","last_active":"2024-09-14T12:57:18.438576+0000","last_peered":"2024-09-14T12:57:18.438576+0000","last_clean":"2024-09-14T12:57:18.438576+0000","last_became_active":"2024-09-14T11:58:43.675734+0000","last_became_peered":"2024-09-14T11:58:43.675734+0000","last_unstale":"2024-09-14T12:57:18.438576+0000","last_undegraded":"2024-09-14T12:57:18.438576+0000","last_fullsized":"2024-09-14T12:57:18.438576+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:58:42.635024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:58:42.635024+0000","last_clean_scrub_stamp":"2024-09-14T11:58:42.635024+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:41:40.899244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.13","version":"267'6","reported_seq":72,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:58:58.466747+0000","last_change":"2024-09-14T11:30:17.546653+0000","last_active":"2024-09-14T12:58:58.466747+0000","last_peered":"2024-09-14T12:58:58.466747+0000","last_clean":"2024-09-14T12:58:58.466747+0000","last_became_active":"2024-09-14T11:30:17.545560+0000","last_became_peered":"2024-09-14T11:30:17.545560+0000","last_unstale":"2024-09-14T12:58:58.466747+0000","last_undegraded":"2024-09-14T12:58:58.466747+0000","last_fullsized":"2024-09-14T12:58:58.466747+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:30:16.474654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:30:16.474654+0000","last_clean_scrub_stamp":"2024-09-14T11:30:16.474654+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:05:50.325352+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":5,"num_read_kb":9216,"num_write":16,"num_write_kb":9216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.12","version":"267'7","reported_seq":81,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:58:53.428614+0000","last_change":"2024-09-14T11:30:10.475068+0000","last_active":"2024-09-14T12:58:53.428614+0000","last_peered":"2024-09-14T12:58:53.428614+0000","last_clean":"2024-09-14T12:58:53.428614+0000","last_became_active":"2024-09-14T11:30:10.474328+0000","last_became_peered":"2024-09-14T11:30:10.474328+0000","last_unstale":"2024-09-14T12:58:53.428614+0000","last_undegraded":"2024-09-14T12:58:53.428614+0000","last_fullsized":"2024-09-14T12:58:53.428614+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:30:09.411354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:30:09.411354+0000","last_clean_scrub_stamp":"2024-09-14T11:30:09.411354+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:23:43.643876+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":9,"num_read_kb":16386,"num_write":17,"num_write_kb":8192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"65.11","version":"267'78","reported_seq":292,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:57:33.212715+0000","last_change":"2024-09-14T11:24:10.107937+0000","last_active":"2024-09-14T12:57:33.212715+0000","last_peered":"2024-09-14T12:57:33.212715+0000","last_clean":"2024-09-14T12:57:33.212715+0000","last_became_active":"2024-09-14T11:24:10.107177+0000","last_became_peered":"2024-09-14T11:24:10.107177+0000","last_unstale":"2024-09-14T12:57:33.212715+0000","last_undegraded":"2024-09-14T12:57:33.212715+0000","last_fullsized":"2024-09-14T12:57:33.212715+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:24:09.066501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:24:09.066501+0000","last_clean_scrub_stamp":"2024-09-14T11:24:09.066501+0000","objects_scrubbed":0,"log_size":78,"log_dups_size":0,"ondisk_log_size":78,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:27:38.912018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":655,"num_read_kb":451,"num_write":184,"num_write_kb":61,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"68.15","version":"267'1","reported_seq":40,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:59:08.469167+0000","last_change":"2024-09-14T11:58:43.694184+0000","last_active":"2024-09-14T12:59:08.469167+0000","last_peered":"2024-09-14T12:59:08.469167+0000","last_clean":"2024-09-14T12:59:08.469167+0000","last_became_active":"2024-09-14T11:58:43.692552+0000","last_became_peered":"2024-09-14T11:58:43.692552+0000","last_unstale":"2024-09-14T12:59:08.469167+0000","last_undegraded":"2024-09-14T12:59:08.469167+0000","last_fullsized":"2024-09-14T12:59:08.469167+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:58:42.635024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:58:42.635024+0000","last_clean_scrub_stamp":"2024-09-14T11:58:42.635024+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:25:30.983665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.12","version":"267'2","reported_seq":64,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:58:58.429703+0000","last_change":"2024-09-14T11:30:17.524803+0000","last_active":"2024-09-14T12:58:58.429703+0000","last_peered":"2024-09-14T12:58:58.429703+0000","last_clean":"2024-09-14T12:58:58.429703+0000","last_became_active":"2024-09-14T11:30:17.523975+0000","last_became_peered":"2024-09-14T11:30:17.523975+0000","last_unstale":"2024-09-14T12:58:58.429703+0000","last_undegraded":"2024-09-14T12:58:58.429703+0000","last_fullsized":"2024-09-14T12:58:58.429703+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:30:16.474654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:30:16.474654+0000","last_clean_scrub_stamp":"2024-09-14T11:30:16.474654+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:12:00.068952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1048576,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"66.13","version":"267'1","reported_seq":69,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:58:53.046680+0000","last_change":"2024-09-14T11:30:10.470996+0000","last_active":"2024-09-14T12:58:53.046680+0000","last_peered":"2024-09-14T12:58:53.046680+0000","last_clean":"2024-09-14T12:58:53.046680+0000","last_became_active":"2024-09-14T11:30:10.467218+0000","last_became_peered":"2024-09-14T11:30:10.467218+0000","last_unstale":"2024-09-14T12:58:53.046680+0000","last_undegraded":"2024-09-14T12:58:53.046680+0000","last_fullsized":"2024-09-14T12:58:53.046680+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:30:09.411354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:30:09.411354+0000","last_clean_scrub_stamp":"2024-09-14T11:30:09.411354+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:14:13.258206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1048576,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.10","version":"267'25","reported_seq":142,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:57:33.446193+0000","last_change":"2024-09-14T11:24:10.128983+0000","last_active":"2024-09-14T12:57:33.446193+0000","last_peered":"2024-09-14T12:57:33.446193+0000","last_clean":"2024-09-14T12:57:33.446193+0000","last_became_active":"2024-09-14T11:24:10.124485+0000","last_became_peered":"2024-09-14T11:24:10.124485+0000","last_unstale":"2024-09-14T12:57:33.446193+0000","last_undegraded":"2024-09-14T12:57:33.446193+0000","last_fullsized":"2024-09-14T12:57:33.446193+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:24:09.066501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:24:09.066501+0000","last_clean_scrub_stamp":"2024-09-14T11:24:09.066501+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:05:55.111756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":199,"num_read_kb":137,"num_write":62,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.a","version":"0'0","reported_seq":42,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:59:42.836938+0000","last_change":"2024-09-14T11:58:43.665808+0000","last_active":"2024-09-14T12:59:42.836938+0000","last_peered":"2024-09-14T12:59:42.836938+0000","last_clean":"2024-09-14T12:59:42.836938+0000","last_became_active":"2024-09-14T11:58:43.665150+0000","last_became_peered":"2024-09-14T11:58:43.665150+0000","last_unstale":"2024-09-14T12:59:42.836938+0000","last_undegraded":"2024-09-14T12:59:42.836938+0000","last_fullsized":"2024-09-14T12:59:42.836938+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:58:42.635024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:58:42.635024+0000","last_clean_scrub_stamp":"2024-09-14T11:58:42.635024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:47:00.404652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.d","version":"0'0","reported_seq":63,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:58:03.453801+0000","last_change":"2024-09-14T11:30:17.541032+0000","last_active":"2024-09-14T12:58:03.453801+0000","last_peered":"2024-09-14T12:58:03.453801+0000","last_clean":"2024-09-14T12:58:03.453801+0000","last_became_active":"2024-09-14T11:30:17.540505+0000","last_became_peered":"2024-09-14T11:30:17.540505+0000","last_unstale":"2024-09-14T12:58:03.453801+0000","last_undegraded":"2024-09-14T12:58:03.453801+0000","last_fullsized":"2024-09-14T12:58:03.453801+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:30:16.474654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:30:16.474654+0000","last_clean_scrub_stamp":"2024-09-14T11:30:16.474654+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:19:58.382345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.c","version":"264'2","reported_seq":73,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:57:57.823794+0000","last_change":"2024-09-14T11:30:10.465578+0000","last_active":"2024-09-14T12:57:57.823794+0000","last_peered":"2024-09-14T12:57:57.823794+0000","last_clean":"2024-09-14T12:57:57.823794+0000","last_became_active":"2024-09-14T11:30:10.464846+0000","last_became_peered":"2024-09-14T11:30:10.464846+0000","last_unstale":"2024-09-14T12:57:57.823794+0000","last_undegraded":"2024-09-14T12:57:57.823794+0000","last_fullsized":"2024-09-14T12:57:57.823794+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:30:09.411354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:30:09.411354+0000","last_clean_scrub_stamp":"2024-09-14T11:30:09.411354+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:16:48.115696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":4096,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.f","version":"267'23","reported_seq":140,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:59:03.468003+0000","last_change":"2024-09-14T11:24:10.122374+0000","last_active":"2024-09-14T12:59:03.468003+0000","last_peered":"2024-09-14T12:59:03.468003+0000","last_clean":"2024-09-14T12:59:03.468003+0000","last_became_active":"2024-09-14T11:24:10.121456+0000","last_became_peered":"2024-09-14T11:24:10.121456+0000","last_unstale":"2024-09-14T12:59:03.468003+0000","last_undegraded":"2024-09-14T12:59:03.468003+0000","last_fullsized":"2024-09-14T12:59:03.468003+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:24:09.066501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:24:09.066501+0000","last_clean_scrub_stamp":"2024-09-14T11:24:09.066501+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:09:06.754571+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":176,"num_read_kb":127,"num_write":57,"num_write_kb":16,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.b","version":"0'0","reported_seq":41,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:59:32.845960+0000","last_change":"2024-09-14T11:58:43.685677+0000","last_active":"2024-09-14T12:59:32.845960+0000","last_peered":"2024-09-14T12:59:32.845960+0000","last_clean":"2024-09-14T12:59:32.845960+0000","last_became_active":"2024-09-14T11:58:43.684927+0000","last_became_peered":"2024-09-14T11:58:43.684927+0000","last_unstale":"2024-09-14T12:59:32.845960+0000","last_undegraded":"2024-09-14T12:59:32.845960+0000","last_fullsized":"2024-09-14T12:59:32.845960+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:58:42.635024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:58:42.635024+0000","last_clean_scrub_stamp":"2024-09-14T11:58:42.635024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:58:14.472771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.c","version":"267'7","reported_seq":76,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:58:03.453730+0000","last_change":"2024-09-14T11:30:17.535765+0000","last_active":"2024-09-14T12:58:03.453730+0000","last_peered":"2024-09-14T12:58:03.453730+0000","last_clean":"2024-09-14T12:58:03.453730+0000","last_became_active":"2024-09-14T11:30:17.535131+0000","last_became_peered":"2024-09-14T11:30:17.535131+0000","last_unstale":"2024-09-14T12:58:03.453730+0000","last_undegraded":"2024-09-14T12:58:03.453730+0000","last_fullsized":"2024-09-14T12:58:03.453730+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:30:16.474654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:30:16.474654+0000","last_clean_scrub_stamp":"2024-09-14T11:30:16.474654+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:06:05.667984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":8,"num_read_kb":16384,"num_write":12,"num_write_kb":16384,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.d","version":"0'0","reported_seq":69,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:57:57.814167+0000","last_change":"2024-09-14T11:30:10.476534+0000","last_active":"2024-09-14T12:57:57.814167+0000","last_peered":"2024-09-14T12:57:57.814167+0000","last_clean":"2024-09-14T12:57:57.814167+0000","last_became_active":"2024-09-14T11:30:10.475862+0000","last_became_peered":"2024-09-14T11:30:10.475862+0000","last_unstale":"2024-09-14T12:57:57.814167+0000","last_undegraded":"2024-09-14T12:57:57.814167+0000","last_fullsized":"2024-09-14T12:57:57.814167+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:30:09.411354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:30:09.411354+0000","last_clean_scrub_stamp":"2024-09-14T11:30:09.411354+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:09:25.660215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.e","version":"267'20","reported_seq":131,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:58:43.044517+0000","last_change":"2024-09-14T11:24:10.116821+0000","last_active":"2024-09-14T12:58:43.044517+0000","last_peered":"2024-09-14T12:58:43.044517+0000","last_clean":"2024-09-14T12:58:43.044517+0000","last_became_active":"2024-09-14T11:24:10.116115+0000","last_became_peered":"2024-09-14T11:24:10.116115+0000","last_unstale":"2024-09-14T12:58:43.044517+0000","last_undegraded":"2024-09-14T12:58:43.044517+0000","last_fullsized":"2024-09-14T12:58:43.044517+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:24:09.066501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:24:09.066501+0000","last_clean_scrub_stamp":"2024-09-14T11:24:09.066501+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:27:31.737225+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":147,"num_read_kb":99,"num_write":62,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"68.8","version":"0'0","reported_seq":42,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:59:23.435157+0000","last_change":"2024-09-14T11:58:43.689938+0000","last_active":"2024-09-14T12:59:23.435157+0000","last_peered":"2024-09-14T12:59:23.435157+0000","last_clean":"2024-09-14T12:59:23.435157+0000","last_became_active":"2024-09-14T11:58:43.689083+0000","last_became_peered":"2024-09-14T11:58:43.689083+0000","last_unstale":"2024-09-14T12:59:23.435157+0000","last_undegraded":"2024-09-14T12:59:23.435157+0000","last_fullsized":"2024-09-14T12:59:23.435157+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:58:42.635024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:58:42.635024+0000","last_clean_scrub_stamp":"2024-09-14T11:58:42.635024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:56:39.956267+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"67.f","version":"267'5","reported_seq":72,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:58:18.455799+0000","last_change":"2024-09-14T11:30:17.516991+0000","last_active":"2024-09-14T12:58:18.455799+0000","last_peered":"2024-09-14T12:58:18.455799+0000","last_clean":"2024-09-14T12:58:18.455799+0000","last_became_active":"2024-09-14T11:30:17.514381+0000","last_became_peered":"2024-09-14T11:30:17.514381+0000","last_unstale":"2024-09-14T12:58:18.455799+0000","last_undegraded":"2024-09-14T12:58:18.455799+0000","last_fullsized":"2024-09-14T12:58:18.455799+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:30:16.474654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:30:16.474654+0000","last_clean_scrub_stamp":"2024-09-14T11:30:16.474654+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:49:08.984359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5242880,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":5,"num_read_kb":3072,"num_write":10,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.e","version":"267'5","reported_seq":81,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:57:58.447906+0000","last_change":"2024-09-14T11:30:10.479004+0000","last_active":"2024-09-14T12:57:58.447906+0000","last_peered":"2024-09-14T12:57:58.447906+0000","last_clean":"2024-09-14T12:57:58.447906+0000","last_became_active":"2024-09-14T11:30:10.473586+0000","last_became_peered":"2024-09-14T11:30:10.473586+0000","last_unstale":"2024-09-14T12:57:58.447906+0000","last_undegraded":"2024-09-14T12:57:58.447906+0000","last_fullsized":"2024-09-14T12:57:58.447906+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:30:09.411354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:30:09.411354+0000","last_clean_scrub_stamp":"2024-09-14T11:30:09.411354+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:24:05.113372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3145728,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":10,"num_read_kb":7170,"num_write":5,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.d","version":"267'29","reported_seq":159,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:58:43.426273+0000","last_change":"2024-09-14T11:24:10.116568+0000","last_active":"2024-09-14T12:58:43.426273+0000","last_peered":"2024-09-14T12:58:43.426273+0000","last_clean":"2024-09-14T12:58:43.426273+0000","last_became_active":"2024-09-14T11:24:10.115813+0000","last_became_peered":"2024-09-14T11:24:10.115813+0000","last_unstale":"2024-09-14T12:58:43.426273+0000","last_undegraded":"2024-09-14T12:58:43.426273+0000","last_fullsized":"2024-09-14T12:58:43.426273+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:24:09.066501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:24:09.066501+0000","last_clean_scrub_stamp":"2024-09-14T11:24:09.066501+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:26:27.897672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":238,"num_read_kb":154,"num_write":72,"num_write_kb":21,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.9","version":"0'0","reported_seq":42,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:59:27.844748+0000","last_change":"2024-09-14T11:58:43.692113+0000","last_active":"2024-09-14T12:59:27.844748+0000","last_peered":"2024-09-14T12:59:27.844748+0000","last_clean":"2024-09-14T12:59:27.844748+0000","last_became_active":"2024-09-14T11:58:43.691369+0000","last_became_peered":"2024-09-14T11:58:43.691369+0000","last_unstale":"2024-09-14T12:59:27.844748+0000","last_undegraded":"2024-09-14T12:59:27.844748+0000","last_fullsized":"2024-09-14T12:59:27.844748+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:58:42.635024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:58:42.635024+0000","last_clean_scrub_stamp":"2024-09-14T11:58:42.635024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:30:13.996741+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.e","version":"0'0","reported_seq":63,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:58:03.453841+0000","last_change":"2024-09-14T11:30:17.530775+0000","last_active":"2024-09-14T12:58:03.453841+0000","last_peered":"2024-09-14T12:58:03.453841+0000","last_clean":"2024-09-14T12:58:03.453841+0000","last_became_active":"2024-09-14T11:30:17.529982+0000","last_became_peered":"2024-09-14T11:30:17.529982+0000","last_unstale":"2024-09-14T12:58:03.453841+0000","last_undegraded":"2024-09-14T12:58:03.453841+0000","last_fullsized":"2024-09-14T12:58:03.453841+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:30:16.474654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:30:16.474654+0000","last_clean_scrub_stamp":"2024-09-14T11:30:16.474654+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:45:22.253630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.f","version":"267'2","reported_seq":73,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:58:13.454641+0000","last_change":"2024-09-14T11:30:10.466282+0000","last_active":"2024-09-14T12:58:13.454641+0000","last_peered":"2024-09-14T12:58:13.454641+0000","last_clean":"2024-09-14T12:58:13.454641+0000","last_became_active":"2024-09-14T11:30:10.465658+0000","last_became_peered":"2024-09-14T11:30:10.465658+0000","last_unstale":"2024-09-14T12:58:13.454641+0000","last_undegraded":"2024-09-14T12:58:13.454641+0000","last_fullsized":"2024-09-14T12:58:13.454641+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:30:09.411354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:30:09.411354+0000","last_clean_scrub_stamp":"2024-09-14T11:30:09.411354+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:30:10.626929+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":8192,"num_write":7,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.c","version":"267'13","reported_seq":112,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:58:42.823918+0000","last_change":"2024-09-14T11:24:10.125876+0000","last_active":"2024-09-14T12:58:42.823918+0000","last_peered":"2024-09-14T12:58:42.823918+0000","last_clean":"2024-09-14T12:58:42.823918+0000","last_became_active":"2024-09-14T11:24:10.125123+0000","last_became_peered":"2024-09-14T11:24:10.125123+0000","last_unstale":"2024-09-14T12:58:42.823918+0000","last_undegraded":"2024-09-14T12:58:42.823918+0000","last_fullsized":"2024-09-14T12:58:42.823918+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:24:09.066501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:24:09.066501+0000","last_clean_scrub_stamp":"2024-09-14T11:24:09.066501+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:00:51.281778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":97,"num_read_kb":65,"num_write":32,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.e","version":"0'0","reported_seq":41,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:59:28.473804+0000","last_change":"2024-09-14T11:58:43.687782+0000","last_active":"2024-09-14T12:59:28.473804+0000","last_peered":"2024-09-14T12:59:28.473804+0000","last_clean":"2024-09-14T12:59:28.473804+0000","last_became_active":"2024-09-14T11:58:43.686619+0000","last_became_peered":"2024-09-14T11:58:43.686619+0000","last_unstale":"2024-09-14T12:59:28.473804+0000","last_undegraded":"2024-09-14T12:59:28.473804+0000","last_fullsized":"2024-09-14T12:59:28.473804+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:58:42.635024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:58:42.635024+0000","last_clean_scrub_stamp":"2024-09-14T11:58:42.635024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:28:38.861564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.9","version":"264'3","reported_seq":70,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:59:08.234745+0000","last_change":"2024-09-14T11:30:17.539804+0000","last_active":"2024-09-14T12:59:08.234745+0000","last_peered":"2024-09-14T12:59:08.234745+0000","last_clean":"2024-09-14T12:59:08.234745+0000","last_became_active":"2024-09-14T11:30:17.539102+0000","last_became_peered":"2024-09-14T11:30:17.539102+0000","last_unstale":"2024-09-14T12:59:08.234745+0000","last_undegraded":"2024-09-14T12:59:08.234745+0000","last_fullsized":"2024-09-14T12:59:08.234745+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:30:16.474654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:30:16.474654+0000","last_clean_scrub_stamp":"2024-09-14T11:30:16.474654+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:50:58.476074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":4096,"num_write":8,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.8","version":"267'3","reported_seq":77,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:59:03.245405+0000","last_change":"2024-09-14T11:30:10.460045+0000","last_active":"2024-09-14T12:59:03.245405+0000","last_peered":"2024-09-14T12:59:03.245405+0000","last_clean":"2024-09-14T12:59:03.245405+0000","last_became_active":"2024-09-14T11:30:10.452160+0000","last_became_peered":"2024-09-14T11:30:10.452160+0000","last_unstale":"2024-09-14T12:59:03.245405+0000","last_undegraded":"2024-09-14T12:59:03.245405+0000","last_fullsized":"2024-09-14T12:59:03.245405+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:30:09.411354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:30:09.411354+0000","last_clean_scrub_stamp":"2024-09-14T11:30:09.411354+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:23:05.788859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1048576,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4,"num_read_kb":5120,"num_write":3,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.b","version":"267'29","reported_seq":156,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:58:43.240104+0000","last_change":"2024-09-14T11:24:10.106828+0000","last_active":"2024-09-14T12:58:43.240104+0000","last_peered":"2024-09-14T12:58:43.240104+0000","last_clean":"2024-09-14T12:58:43.240104+0000","last_became_active":"2024-09-14T11:24:10.106068+0000","last_became_peered":"2024-09-14T11:24:10.106068+0000","last_unstale":"2024-09-14T12:58:43.240104+0000","last_undegraded":"2024-09-14T12:58:43.240104+0000","last_fullsized":"2024-09-14T12:58:43.240104+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:24:09.066501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:24:09.066501+0000","last_clean_scrub_stamp":"2024-09-14T11:24:09.066501+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:05:03.080475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":230,"num_read_kb":146,"num_write":73,"num_write_kb":21,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.f","version":"0'0","reported_seq":40,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:57:37.819234+0000","last_change":"2024-09-14T11:58:43.692112+0000","last_active":"2024-09-14T12:57:37.819234+0000","last_peered":"2024-09-14T12:57:37.819234+0000","last_clean":"2024-09-14T12:57:37.819234+0000","last_became_active":"2024-09-14T11:58:43.691307+0000","last_became_peered":"2024-09-14T11:58:43.691307+0000","last_unstale":"2024-09-14T12:57:37.819234+0000","last_undegraded":"2024-09-14T12:57:37.819234+0000","last_fullsized":"2024-09-14T12:57:37.819234+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:58:42.635024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:58:42.635024+0000","last_clean_scrub_stamp":"2024-09-14T11:58:42.635024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:28:43.404907+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.8","version":"267'2","reported_seq":71,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:59:07.839977+0000","last_change":"2024-09-14T11:30:17.506927+0000","last_active":"2024-09-14T12:59:07.839977+0000","last_peered":"2024-09-14T12:59:07.839977+0000","last_clean":"2024-09-14T12:59:07.839977+0000","last_became_active":"2024-09-14T11:30:17.506181+0000","last_became_peered":"2024-09-14T11:30:17.506181+0000","last_unstale":"2024-09-14T12:59:07.839977+0000","last_undegraded":"2024-09-14T12:59:07.839977+0000","last_fullsized":"2024-09-14T12:59:07.839977+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:30:16.474654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:30:16.474654+0000","last_clean_scrub_stamp":"2024-09-14T11:30:16.474654+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:25:09.709853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5242880,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":4,"num_read_kb":10240,"num_write":2,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.9","version":"267'11","reported_seq":93,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:59:03.465657+0000","last_change":"2024-09-14T11:30:10.470957+0000","last_active":"2024-09-14T12:59:03.465657+0000","last_peered":"2024-09-14T12:59:03.465657+0000","last_clean":"2024-09-14T12:59:03.465657+0000","last_became_active":"2024-09-14T11:30:10.470179+0000","last_became_peered":"2024-09-14T11:30:10.470179+0000","last_unstale":"2024-09-14T12:59:03.465657+0000","last_undegraded":"2024-09-14T12:59:03.465657+0000","last_fullsized":"2024-09-14T12:59:03.465657+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:30:09.411354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:30:09.411354+0000","last_clean_scrub_stamp":"2024-09-14T11:30:09.411354+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:18:43.600381+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8391814,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":15,"num_read_kb":28678,"num_write":21,"num_write_kb":16388,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.a","version":"267'15","reported_seq":117,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:57:52.822597+0000","last_change":"2024-09-14T11:24:10.103674+0000","last_active":"2024-09-14T12:57:52.822597+0000","last_peered":"2024-09-14T12:57:52.822597+0000","last_clean":"2024-09-14T12:57:52.822597+0000","last_became_active":"2024-09-14T11:24:10.102918+0000","last_became_peered":"2024-09-14T11:24:10.102918+0000","last_unstale":"2024-09-14T12:57:52.822597+0000","last_undegraded":"2024-09-14T12:57:52.822597+0000","last_fullsized":"2024-09-14T12:57:52.822597+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:24:09.066501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:24:09.066501+0000","last_clean_scrub_stamp":"2024-09-14T11:24:09.066501+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:26:42.141598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":107,"num_read_kb":71,"num_write":42,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.c","version":"267'1","reported_seq":42,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:59:32.846025+0000","last_change":"2024-09-14T11:58:43.674524+0000","last_active":"2024-09-14T12:59:32.846025+0000","last_peered":"2024-09-14T12:59:32.846025+0000","last_clean":"2024-09-14T12:59:32.846025+0000","last_became_active":"2024-09-14T11:58:43.671065+0000","last_became_peered":"2024-09-14T11:58:43.671065+0000","last_unstale":"2024-09-14T12:59:32.846025+0000","last_undegraded":"2024-09-14T12:59:32.846025+0000","last_fullsized":"2024-09-14T12:59:32.846025+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:58:42.635024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:58:42.635024+0000","last_clean_scrub_stamp":"2024-09-14T11:58:42.635024+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:00:34.168002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.b","version":"267'10","reported_seq":84,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:58:03.452301+0000","last_change":"2024-09-14T11:30:17.517039+0000","last_active":"2024-09-14T12:58:03.452301+0000","last_peered":"2024-09-14T12:58:03.452301+0000","last_clean":"2024-09-14T12:58:03.452301+0000","last_became_active":"2024-09-14T11:30:17.516646+0000","last_became_peered":"2024-09-14T11:30:17.516646+0000","last_unstale":"2024-09-14T12:58:03.452301+0000","last_undegraded":"2024-09-14T12:58:03.452301+0000","last_fullsized":"2024-09-14T12:58:03.452301+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:30:16.474654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:30:16.474654+0000","last_clean_scrub_stamp":"2024-09-14T11:30:16.474654+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:51:29.231639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":16,"num_read_kb":13314,"num_write":15,"num_write_kb":10240,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.a","version":"264'2","reported_seq":75,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:59:28.251530+0000","last_change":"2024-09-14T11:30:10.473981+0000","last_active":"2024-09-14T12:59:28.251530+0000","last_peered":"2024-09-14T12:59:28.251530+0000","last_clean":"2024-09-14T12:59:28.251530+0000","last_became_active":"2024-09-14T11:30:10.473149+0000","last_became_peered":"2024-09-14T11:30:10.473149+0000","last_unstale":"2024-09-14T12:59:28.251530+0000","last_undegraded":"2024-09-14T12:59:28.251530+0000","last_fullsized":"2024-09-14T12:59:28.251530+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:30:09.411354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:30:09.411354+0000","last_clean_scrub_stamp":"2024-09-14T11:30:09.411354+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:31:29.150405+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":1024,"num_write":2,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.9","version":"267'22","reported_seq":138,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:59:33.474897+0000","last_change":"2024-09-14T11:24:10.122150+0000","last_active":"2024-09-14T12:59:33.474897+0000","last_peered":"2024-09-14T12:59:33.474897+0000","last_clean":"2024-09-14T12:59:33.474897+0000","last_became_active":"2024-09-14T11:24:10.121442+0000","last_became_peered":"2024-09-14T11:24:10.121442+0000","last_unstale":"2024-09-14T12:59:33.474897+0000","last_undegraded":"2024-09-14T12:59:33.474897+0000","last_fullsized":"2024-09-14T12:59:33.474897+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:24:09.066501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:24:09.066501+0000","last_clean_scrub_stamp":"2024-09-14T11:24:09.066501+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:07:27.847069+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":163,"num_read_kb":99,"num_write":58,"num_write_kb":15,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.d","version":"0'0","reported_seq":41,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:59:28.251656+0000","last_change":"2024-09-14T11:58:43.694247+0000","last_active":"2024-09-14T12:59:28.251656+0000","last_peered":"2024-09-14T12:59:28.251656+0000","last_clean":"2024-09-14T12:59:28.251656+0000","last_became_active":"2024-09-14T11:58:43.693568+0000","last_became_peered":"2024-09-14T11:58:43.693568+0000","last_unstale":"2024-09-14T12:59:28.251656+0000","last_undegraded":"2024-09-14T12:59:28.251656+0000","last_fullsized":"2024-09-14T12:59:28.251656+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:58:42.635024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:58:42.635024+0000","last_clean_scrub_stamp":"2024-09-14T11:58:42.635024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:56:07.440496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.a","version":"0'0","reported_seq":71,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:59:37.847095+0000","last_change":"2024-09-14T11:30:57.858852+0000","last_active":"2024-09-14T12:59:37.847095+0000","last_peered":"2024-09-14T12:59:37.847095+0000","last_clean":"2024-09-14T12:59:37.847095+0000","last_became_active":"2024-09-14T11:30:57.858040+0000","last_became_peered":"2024-09-14T11:30:57.858040+0000","last_unstale":"2024-09-14T12:59:37.847095+0000","last_undegraded":"2024-09-14T12:59:37.847095+0000","last_fullsized":"2024-09-14T12:59:37.847095+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:30:16.474654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:30:16.474654+0000","last_clean_scrub_stamp":"2024-09-14T11:30:16.474654+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:54:14.176092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.b","version":"267'2","reported_seq":73,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:57:58.218262+0000","last_change":"2024-09-14T11:30:10.446339+0000","last_active":"2024-09-14T12:57:58.218262+0000","last_peered":"2024-09-14T12:57:58.218262+0000","last_clean":"2024-09-14T12:57:58.218262+0000","last_became_active":"2024-09-14T11:30:10.442635+0000","last_became_peered":"2024-09-14T11:30:10.442635+0000","last_unstale":"2024-09-14T12:57:58.218262+0000","last_undegraded":"2024-09-14T12:57:58.218262+0000","last_fullsized":"2024-09-14T12:57:58.218262+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:30:09.411354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:30:09.411354+0000","last_clean_scrub_stamp":"2024-09-14T11:30:09.411354+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:51:37.757665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":8192,"num_write":2,"num_write_kb":8192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.8","version":"267'20","reported_seq":132,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:59:33.437339+0000","last_change":"2024-09-14T11:24:10.116682+0000","last_active":"2024-09-14T12:59:33.437339+0000","last_peered":"2024-09-14T12:59:33.437339+0000","last_clean":"2024-09-14T12:59:33.437339+0000","last_became_active":"2024-09-14T11:24:10.115856+0000","last_became_peered":"2024-09-14T11:24:10.115856+0000","last_unstale":"2024-09-14T12:59:33.437339+0000","last_undegraded":"2024-09-14T12:59:33.437339+0000","last_fullsized":"2024-09-14T12:59:33.437339+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:24:09.066501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:24:09.066501+0000","last_clean_scrub_stamp":"2024-09-14T11:24:09.066501+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:44:11.185471+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":144,"num_read_kb":94,"num_write":54,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.2","version":"0'0","reported_seq":43,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:59:12.841261+0000","last_change":"2024-09-14T11:58:43.696428+0000","last_active":"2024-09-14T12:59:12.841261+0000","last_peered":"2024-09-14T12:59:12.841261+0000","last_clean":"2024-09-14T12:59:12.841261+0000","last_became_active":"2024-09-14T11:58:43.695896+0000","last_became_peered":"2024-09-14T11:58:43.695896+0000","last_unstale":"2024-09-14T12:59:12.841261+0000","last_undegraded":"2024-09-14T12:59:12.841261+0000","last_fullsized":"2024-09-14T12:59:12.841261+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:58:42.635024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:58:42.635024+0000","last_clean_scrub_stamp":"2024-09-14T11:58:42.635024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:00:52.004945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.5","version":"0'0","reported_seq":66,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:58:08.450363+0000","last_change":"2024-09-14T11:30:17.520310+0000","last_active":"2024-09-14T12:58:08.450363+0000","last_peered":"2024-09-14T12:58:08.450363+0000","last_clean":"2024-09-14T12:58:08.450363+0000","last_became_active":"2024-09-14T11:30:17.519903+0000","last_became_peered":"2024-09-14T11:30:17.519903+0000","last_unstale":"2024-09-14T12:58:08.450363+0000","last_undegraded":"2024-09-14T12:58:08.450363+0000","last_fullsized":"2024-09-14T12:58:08.450363+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:30:16.474654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:30:16.474654+0000","last_clean_scrub_stamp":"2024-09-14T11:30:16.474654+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:24:33.274962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.4","version":"264'4","reported_seq":82,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:59:47.849496+0000","last_change":"2024-09-14T11:30:10.469781+0000","last_active":"2024-09-14T12:59:47.849496+0000","last_peered":"2024-09-14T12:59:47.849496+0000","last_clean":"2024-09-14T12:59:47.849496+0000","last_became_active":"2024-09-14T11:30:10.468287+0000","last_became_peered":"2024-09-14T11:30:10.468287+0000","last_unstale":"2024-09-14T12:59:47.849496+0000","last_undegraded":"2024-09-14T12:59:47.849496+0000","last_fullsized":"2024-09-14T12:59:47.849496+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:30:09.411354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:30:09.411354+0000","last_clean_scrub_stamp":"2024-09-14T11:30:09.411354+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:43:03.239163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":11264,"num_write":4,"num_write_kb":7168,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.7","version":"267'11","reported_seq":111,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:59:33.252891+0000","last_change":"2024-09-14T11:24:10.097912+0000","last_active":"2024-09-14T12:59:33.252891+0000","last_peered":"2024-09-14T12:59:33.252891+0000","last_clean":"2024-09-14T12:59:33.252891+0000","last_became_active":"2024-09-14T11:24:10.097206+0000","last_became_peered":"2024-09-14T11:24:10.097206+0000","last_unstale":"2024-09-14T12:59:33.252891+0000","last_undegraded":"2024-09-14T12:59:33.252891+0000","last_fullsized":"2024-09-14T12:59:33.252891+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:24:09.066501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:24:09.066501+0000","last_clean_scrub_stamp":"2024-09-14T11:24:09.066501+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:05:42.905472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":88,"num_read_kb":49,"num_write":30,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.3","version":"0'0","reported_seq":43,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:59:08.049987+0000","last_change":"2024-09-14T11:58:43.693608+0000","last_active":"2024-09-14T12:59:08.049987+0000","last_peered":"2024-09-14T12:59:08.049987+0000","last_clean":"2024-09-14T12:59:08.049987+0000","last_became_active":"2024-09-14T11:58:43.689661+0000","last_became_peered":"2024-09-14T11:58:43.689661+0000","last_unstale":"2024-09-14T12:59:08.049987+0000","last_undegraded":"2024-09-14T12:59:08.049987+0000","last_fullsized":"2024-09-14T12:59:08.049987+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:58:42.635024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:58:42.635024+0000","last_clean_scrub_stamp":"2024-09-14T11:58:42.635024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:26:59.844029+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.4","version":"267'3","reported_seq":73,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:59:53.257452+0000","last_change":"2024-09-14T11:30:17.501104+0000","last_active":"2024-09-14T12:59:53.257452+0000","last_peered":"2024-09-14T12:59:53.257452+0000","last_clean":"2024-09-14T12:59:53.257452+0000","last_became_active":"2024-09-14T11:30:17.500215+0000","last_became_peered":"2024-09-14T11:30:17.500215+0000","last_unstale":"2024-09-14T12:59:53.257452+0000","last_undegraded":"2024-09-14T12:59:53.257452+0000","last_fullsized":"2024-09-14T12:59:53.257452+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:30:16.474654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:30:16.474654+0000","last_clean_scrub_stamp":"2024-09-14T11:30:16.474654+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:46:20.398415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1051782,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3,"num_read_kb":2052,"num_write":8,"num_write_kb":1028,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.5","version":"267'3","reported_seq":79,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:58:12.817408+0000","last_change":"2024-09-14T11:30:10.465224+0000","last_active":"2024-09-14T12:58:12.817408+0000","last_peered":"2024-09-14T12:58:12.817408+0000","last_clean":"2024-09-14T12:58:12.817408+0000","last_became_active":"2024-09-14T11:30:10.464076+0000","last_became_peered":"2024-09-14T11:30:10.464076+0000","last_unstale":"2024-09-14T12:58:12.817408+0000","last_undegraded":"2024-09-14T12:58:12.817408+0000","last_fullsized":"2024-09-14T12:58:12.817408+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:30:09.411354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:30:09.411354+0000","last_clean_scrub_stamp":"2024-09-14T11:30:09.411354+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:08:03.701354+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":4,"num_read_kb":16384,"num_write":8,"num_write_kb":8192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.6","version":"267'17","reported_seq":129,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:59:33.437504+0000","last_change":"2024-09-14T11:24:10.123893+0000","last_active":"2024-09-14T12:59:33.437504+0000","last_peered":"2024-09-14T12:59:33.437504+0000","last_clean":"2024-09-14T12:59:33.437504+0000","last_became_active":"2024-09-14T11:24:10.123193+0000","last_became_peered":"2024-09-14T11:24:10.123193+0000","last_unstale":"2024-09-14T12:59:33.437504+0000","last_undegraded":"2024-09-14T12:59:33.437504+0000","last_fullsized":"2024-09-14T12:59:33.437504+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:24:09.066501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:24:09.066501+0000","last_clean_scrub_stamp":"2024-09-14T11:24:09.066501+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:45:11.702555+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":141,"num_read_kb":98,"num_write":56,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.0","version":"0'0","reported_seq":44,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:58:48.462247+0000","last_change":"2024-09-14T11:58:43.690698+0000","last_active":"2024-09-14T12:58:48.462247+0000","last_peered":"2024-09-14T12:58:48.462247+0000","last_clean":"2024-09-14T12:58:48.462247+0000","last_became_active":"2024-09-14T11:58:43.690036+0000","last_became_peered":"2024-09-14T11:58:43.690036+0000","last_unstale":"2024-09-14T12:58:48.462247+0000","last_undegraded":"2024-09-14T12:58:48.462247+0000","last_fullsized":"2024-09-14T12:58:48.462247+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:58:42.635024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:58:42.635024+0000","last_clean_scrub_stamp":"2024-09-14T11:58:42.635024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:02:37.171544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"67.7","version":"0'0","reported_seq":65,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:59:07.840222+0000","last_change":"2024-09-14T11:30:17.504824+0000","last_active":"2024-09-14T12:59:07.840222+0000","last_peered":"2024-09-14T12:59:07.840222+0000","last_clean":"2024-09-14T12:59:07.840222+0000","last_became_active":"2024-09-14T11:30:17.503548+0000","last_became_peered":"2024-09-14T11:30:17.503548+0000","last_unstale":"2024-09-14T12:59:07.840222+0000","last_undegraded":"2024-09-14T12:59:07.840222+0000","last_fullsized":"2024-09-14T12:59:07.840222+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:30:16.474654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:30:16.474654+0000","last_clean_scrub_stamp":"2024-09-14T11:30:16.474654+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:04:54.678316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.6","version":"264'4","reported_seq":81,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:59:03.048985+0000","last_change":"2024-09-14T11:30:10.463753+0000","last_active":"2024-09-14T12:59:03.048985+0000","last_peered":"2024-09-14T12:59:03.048985+0000","last_clean":"2024-09-14T12:59:03.048985+0000","last_became_active":"2024-09-14T11:30:10.462971+0000","last_became_peered":"2024-09-14T11:30:10.462971+0000","last_unstale":"2024-09-14T12:59:03.048985+0000","last_undegraded":"2024-09-14T12:59:03.048985+0000","last_fullsized":"2024-09-14T12:59:03.048985+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:30:09.411354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:30:09.411354+0000","last_clean_scrub_stamp":"2024-09-14T11:30:09.411354+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:28:19.411905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":16386,"num_write":4,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.5","version":"267'29","reported_seq":156,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:58:27.830841+0000","last_change":"2024-09-14T11:24:10.105209+0000","last_active":"2024-09-14T12:58:27.830841+0000","last_peered":"2024-09-14T12:58:27.830841+0000","last_clean":"2024-09-14T12:58:27.830841+0000","last_became_active":"2024-09-14T11:24:10.104277+0000","last_became_peered":"2024-09-14T11:24:10.104277+0000","last_unstale":"2024-09-14T12:58:27.830841+0000","last_undegraded":"2024-09-14T12:58:27.830841+0000","last_fullsized":"2024-09-14T12:58:27.830841+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:24:09.066501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:24:09.066501+0000","last_clean_scrub_stamp":"2024-09-14T11:24:09.066501+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:27:20.344282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":210,"num_read_kb":138,"num_write":78,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.1","version":"0'0","reported_seq":43,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:59:08.234700+0000","last_change":"2024-09-14T11:58:43.675560+0000","last_active":"2024-09-14T12:59:08.234700+0000","last_peered":"2024-09-14T12:59:08.234700+0000","last_clean":"2024-09-14T12:59:08.234700+0000","last_became_active":"2024-09-14T11:58:43.674870+0000","last_became_peered":"2024-09-14T11:58:43.674870+0000","last_unstale":"2024-09-14T12:59:08.234700+0000","last_undegraded":"2024-09-14T12:59:08.234700+0000","last_fullsized":"2024-09-14T12:59:08.234700+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:58:42.635024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:58:42.635024+0000","last_clean_scrub_stamp":"2024-09-14T11:58:42.635024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:17:48.384984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"67.6","version":"267'1","reported_seq":67,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:59:08.234954+0000","last_change":"2024-09-14T11:30:17.521153+0000","last_active":"2024-09-14T12:59:08.234954+0000","last_peered":"2024-09-14T12:59:08.234954+0000","last_clean":"2024-09-14T12:59:08.234954+0000","last_became_active":"2024-09-14T11:30:17.520433+0000","last_became_peered":"2024-09-14T11:30:17.520433+0000","last_unstale":"2024-09-14T12:59:08.234954+0000","last_undegraded":"2024-09-14T12:59:08.234954+0000","last_fullsized":"2024-09-14T12:59:08.234954+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:30:16.474654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:30:16.474654+0000","last_clean_scrub_stamp":"2024-09-14T11:30:16.474654+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:46:08.197483+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":4096,"num_write":1,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.7","version":"267'2","reported_seq":76,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:59:02.839045+0000","last_change":"2024-09-14T11:30:10.475293+0000","last_active":"2024-09-14T12:59:02.839045+0000","last_peered":"2024-09-14T12:59:02.839045+0000","last_clean":"2024-09-14T12:59:02.839045+0000","last_became_active":"2024-09-14T11:30:10.474546+0000","last_became_peered":"2024-09-14T11:30:10.474546+0000","last_unstale":"2024-09-14T12:59:02.839045+0000","last_undegraded":"2024-09-14T12:59:02.839045+0000","last_fullsized":"2024-09-14T12:59:02.839045+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:30:09.411354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:30:09.411354+0000","last_clean_scrub_stamp":"2024-09-14T11:30:09.411354+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:09:53.059916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2097152,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3,"num_read_kb":3072,"num_write":2,"num_write_kb":2048,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.4","version":"267'33","reported_seq":160,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:57:58.451122+0000","last_change":"2024-09-14T11:24:10.118920+0000","last_active":"2024-09-14T12:57:58.451122+0000","last_peered":"2024-09-14T12:57:58.451122+0000","last_clean":"2024-09-14T12:57:58.451122+0000","last_became_active":"2024-09-14T11:24:10.118333+0000","last_became_peered":"2024-09-14T11:24:10.118333+0000","last_unstale":"2024-09-14T12:57:58.451122+0000","last_undegraded":"2024-09-14T12:57:58.451122+0000","last_fullsized":"2024-09-14T12:57:58.451122+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:24:09.066501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:24:09.066501+0000","last_clean_scrub_stamp":"2024-09-14T11:24:09.066501+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:28:26.888200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":218,"num_read_kb":138,"num_write":85,"num_write_kb":20,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"68.6","version":"267'1","reported_seq":43,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:59:22.832926+0000","last_change":"2024-09-14T11:58:43.688943+0000","last_active":"2024-09-14T12:59:22.832926+0000","last_peered":"2024-09-14T12:59:22.832926+0000","last_clean":"2024-09-14T12:59:22.832926+0000","last_became_active":"2024-09-14T11:58:43.688251+0000","last_became_peered":"2024-09-14T11:58:43.688251+0000","last_unstale":"2024-09-14T12:59:22.832926+0000","last_undegraded":"2024-09-14T12:59:22.832926+0000","last_fullsized":"2024-09-14T12:59:22.832926+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:58:42.635024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:58:42.635024+0000","last_clean_scrub_stamp":"2024-09-14T11:58:42.635024+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:15:08.766031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.1","version":"267'6","reported_seq":80,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:59:53.476435+0000","last_change":"2024-09-14T11:30:17.519203+0000","last_active":"2024-09-14T12:59:53.476435+0000","last_peered":"2024-09-14T12:59:53.476435+0000","last_clean":"2024-09-14T12:59:53.476435+0000","last_became_active":"2024-09-14T11:30:17.518890+0000","last_became_peered":"2024-09-14T11:30:17.518890+0000","last_unstale":"2024-09-14T12:59:53.476435+0000","last_undegraded":"2024-09-14T12:59:53.476435+0000","last_fullsized":"2024-09-14T12:59:53.476435+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:30:16.474654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:30:16.474654+0000","last_clean_scrub_stamp":"2024-09-14T11:30:16.474654+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:51:39.220265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3145728,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":10,"num_read_kb":19458,"num_write":11,"num_write_kb":7168,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.0","version":"267'1","reported_seq":76,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:58:42.834093+0000","last_change":"2024-09-14T11:30:10.467502+0000","last_active":"2024-09-14T12:58:42.834093+0000","last_peered":"2024-09-14T12:58:42.834093+0000","last_clean":"2024-09-14T12:58:42.834093+0000","last_became_active":"2024-09-14T11:30:10.466391+0000","last_became_peered":"2024-09-14T11:30:10.466391+0000","last_unstale":"2024-09-14T12:58:42.834093+0000","last_undegraded":"2024-09-14T12:58:42.834093+0000","last_fullsized":"2024-09-14T12:58:42.834093+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:30:09.411354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:30:09.411354+0000","last_clean_scrub_stamp":"2024-09-14T11:30:09.411354+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:32:45.732767+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":40145,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":40,"num_write":1,"num_write_kb":40,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.3","version":"267'41","reported_seq":190,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:57:58.034292+0000","last_change":"2024-09-14T11:24:10.095296+0000","last_active":"2024-09-14T12:57:58.034292+0000","last_peered":"2024-09-14T12:57:58.034292+0000","last_clean":"2024-09-14T12:57:58.034292+0000","last_became_active":"2024-09-14T11:24:10.094515+0000","last_became_peered":"2024-09-14T11:24:10.094515+0000","last_unstale":"2024-09-14T12:57:58.034292+0000","last_undegraded":"2024-09-14T12:57:58.034292+0000","last_fullsized":"2024-09-14T12:57:58.034292+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:24:09.066501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:24:09.066501+0000","last_clean_scrub_stamp":"2024-09-14T11:24:09.066501+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":0,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:59:26.331974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":311,"num_read_kb":196,"num_write":106,"num_write_kb":28,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"68.7","version":"0'0","reported_seq":42,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:59:23.250462+0000","last_change":"2024-09-14T11:58:43.681439+0000","last_active":"2024-09-14T12:59:23.250462+0000","last_peered":"2024-09-14T12:59:23.250462+0000","last_clean":"2024-09-14T12:59:23.250462+0000","last_became_active":"2024-09-14T11:58:43.680569+0000","last_became_peered":"2024-09-14T11:58:43.680569+0000","last_unstale":"2024-09-14T12:59:23.250462+0000","last_undegraded":"2024-09-14T12:59:23.250462+0000","last_fullsized":"2024-09-14T12:59:23.250462+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:58:42.635024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:58:42.635024+0000","last_clean_scrub_stamp":"2024-09-14T11:58:42.635024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:50:38.486174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.0","version":"267'3","reported_seq":75,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:58:43.044284+0000","last_change":"2024-09-14T11:30:17.519289+0000","last_active":"2024-09-14T12:58:43.044284+0000","last_peered":"2024-09-14T12:58:43.044284+0000","last_clean":"2024-09-14T12:58:43.044284+0000","last_became_active":"2024-09-14T11:30:17.518524+0000","last_became_peered":"2024-09-14T11:30:17.518524+0000","last_unstale":"2024-09-14T12:58:43.044284+0000","last_undegraded":"2024-09-14T12:58:43.044284+0000","last_fullsized":"2024-09-14T12:58:43.044284+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:30:16.474654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:30:16.474654+0000","last_clean_scrub_stamp":"2024-09-14T11:30:16.474654+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:59:22.405921+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1048576,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":5,"num_read_kb":6144,"num_write":3,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.1","version":"267'4","reported_seq":79,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:59:47.849395+0000","last_change":"2024-09-14T11:30:10.465435+0000","last_active":"2024-09-14T12:59:47.849395+0000","last_peered":"2024-09-14T12:59:47.849395+0000","last_clean":"2024-09-14T12:59:47.849395+0000","last_became_active":"2024-09-14T11:30:10.464696+0000","last_became_peered":"2024-09-14T11:30:10.464696+0000","last_unstale":"2024-09-14T12:59:47.849395+0000","last_undegraded":"2024-09-14T12:59:47.849395+0000","last_fullsized":"2024-09-14T12:59:47.849395+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:30:09.411354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:30:09.411354+0000","last_clean_scrub_stamp":"2024-09-14T11:30:09.411354+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:34:28.871663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3,"num_read_kb":1024,"num_write":9,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.2","version":"267'34","reported_seq":175,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:57:58.218176+0000","last_change":"2024-09-14T11:24:10.126827+0000","last_active":"2024-09-14T12:57:58.218176+0000","last_peered":"2024-09-14T12:57:58.218176+0000","last_clean":"2024-09-14T12:57:58.218176+0000","last_became_active":"2024-09-14T11:24:10.125885+0000","last_became_peered":"2024-09-14T11:24:10.125885+0000","last_unstale":"2024-09-14T12:57:58.218176+0000","last_undegraded":"2024-09-14T12:57:58.218176+0000","last_fullsized":"2024-09-14T12:57:58.218176+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:24:09.066501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:24:09.066501+0000","last_clean_scrub_stamp":"2024-09-14T11:24:09.066501+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:23:21.772883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":284,"num_read_kb":180,"num_write":83,"num_write_kb":28,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"68.4","version":"0'0","reported_seq":43,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:59:08.246950+0000","last_change":"2024-09-14T11:58:43.663976+0000","last_active":"2024-09-14T12:59:08.246950+0000","last_peered":"2024-09-14T12:59:08.246950+0000","last_clean":"2024-09-14T12:59:08.246950+0000","last_became_active":"2024-09-14T11:58:43.662916+0000","last_became_peered":"2024-09-14T11:58:43.662916+0000","last_unstale":"2024-09-14T12:59:08.246950+0000","last_undegraded":"2024-09-14T12:59:08.246950+0000","last_fullsized":"2024-09-14T12:59:08.246950+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:58:42.635024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:58:42.635024+0000","last_clean_scrub_stamp":"2024-09-14T11:58:42.635024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:29:35.878769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.3","version":"264'4","reported_seq":77,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:59:53.441619+0000","last_change":"2024-09-14T11:30:17.549596+0000","last_active":"2024-09-14T12:59:53.441619+0000","last_peered":"2024-09-14T12:59:53.441619+0000","last_clean":"2024-09-14T12:59:53.441619+0000","last_became_active":"2024-09-14T11:30:17.549019+0000","last_became_peered":"2024-09-14T11:30:17.549019+0000","last_unstale":"2024-09-14T12:59:53.441619+0000","last_undegraded":"2024-09-14T12:59:53.441619+0000","last_fullsized":"2024-09-14T12:59:53.441619+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:30:16.474654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:30:16.474654+0000","last_clean_scrub_stamp":"2024-09-14T11:30:16.474654+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:25:28.016466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":4098,"num_write":4,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"66.2","version":"267'3","reported_seq":80,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:59:48.475431+0000","last_change":"2024-09-14T11:30:10.461463+0000","last_active":"2024-09-14T12:59:48.475431+0000","last_peered":"2024-09-14T12:59:48.475431+0000","last_clean":"2024-09-14T12:59:48.475431+0000","last_became_active":"2024-09-14T11:30:10.460643+0000","last_became_peered":"2024-09-14T11:30:10.460643+0000","last_unstale":"2024-09-14T12:59:48.475431+0000","last_undegraded":"2024-09-14T12:59:48.475431+0000","last_fullsized":"2024-09-14T12:59:48.475431+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:30:09.411354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:30:09.411354+0000","last_clean_scrub_stamp":"2024-09-14T11:30:09.411354+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:37:10.801240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1048576,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":5,"num_read_kb":3072,"num_write":3,"num_write_kb":2048,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.1","version":"267'13","reported_seq":114,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:57:58.608535+0000","last_change":"2024-09-14T11:24:10.117369+0000","last_active":"2024-09-14T12:57:58.608535+0000","last_peered":"2024-09-14T12:57:58.608535+0000","last_clean":"2024-09-14T12:57:58.608535+0000","last_became_active":"2024-09-14T11:24:10.116627+0000","last_became_peered":"2024-09-14T11:24:10.116627+0000","last_unstale":"2024-09-14T12:57:58.608535+0000","last_undegraded":"2024-09-14T12:57:58.608535+0000","last_fullsized":"2024-09-14T12:57:58.608535+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:24:09.066501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:24:09.066501+0000","last_clean_scrub_stamp":"2024-09-14T11:24:09.066501+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:17:32.530599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":96,"num_read_kb":63,"num_write":36,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.5","version":"0'0","reported_seq":43,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:59:32.846067+0000","last_change":"2024-09-14T11:58:43.696722+0000","last_active":"2024-09-14T12:59:32.846067+0000","last_peered":"2024-09-14T12:59:32.846067+0000","last_clean":"2024-09-14T12:59:32.846067+0000","last_became_active":"2024-09-14T11:58:43.695982+0000","last_became_peered":"2024-09-14T11:58:43.695982+0000","last_unstale":"2024-09-14T12:59:32.846067+0000","last_undegraded":"2024-09-14T12:59:32.846067+0000","last_fullsized":"2024-09-14T12:59:32.846067+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:58:42.635024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:58:42.635024+0000","last_clean_scrub_stamp":"2024-09-14T11:58:42.635024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:04:33.126348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.2","version":"264'8","reported_seq":85,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:59:53.244786+0000","last_change":"2024-09-14T11:30:17.513530+0000","last_active":"2024-09-14T12:59:53.244786+0000","last_peered":"2024-09-14T12:59:53.244786+0000","last_clean":"2024-09-14T12:59:53.244786+0000","last_became_active":"2024-09-14T11:30:17.512689+0000","last_became_peered":"2024-09-14T11:30:17.512689+0000","last_unstale":"2024-09-14T12:59:53.244786+0000","last_undegraded":"2024-09-14T12:59:53.244786+0000","last_fullsized":"2024-09-14T12:59:53.244786+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:30:16.474654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:30:16.474654+0000","last_clean_scrub_stamp":"2024-09-14T11:30:16.474654+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:38:38.268473+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":21506,"num_write":8,"num_write_kb":9216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.3","version":"0'0","reported_seq":73,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:59:48.440576+0000","last_change":"2024-09-14T11:30:10.474713+0000","last_active":"2024-09-14T12:59:48.440576+0000","last_peered":"2024-09-14T12:59:48.440576+0000","last_clean":"2024-09-14T12:59:48.440576+0000","last_became_active":"2024-09-14T11:30:10.473880+0000","last_became_peered":"2024-09-14T11:30:10.473880+0000","last_unstale":"2024-09-14T12:59:48.440576+0000","last_undegraded":"2024-09-14T12:59:48.440576+0000","last_fullsized":"2024-09-14T12:59:48.440576+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:30:09.411354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:30:09.411354+0000","last_clean_scrub_stamp":"2024-09-14T11:30:09.411354+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:44:00.695204+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"65.0","version":"264'14","reported_seq":122,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:58:42.834131+0000","last_change":"2024-09-14T11:24:10.116538+0000","last_active":"2024-09-14T12:58:42.834131+0000","last_peered":"2024-09-14T12:58:42.834131+0000","last_clean":"2024-09-14T12:58:42.834131+0000","last_became_active":"2024-09-14T11:24:10.115799+0000","last_became_peered":"2024-09-14T11:24:10.115799+0000","last_unstale":"2024-09-14T12:58:42.834131+0000","last_undegraded":"2024-09-14T12:58:42.834131+0000","last_fullsized":"2024-09-14T12:58:42.834131+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:24:09.066501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:24:09.066501+0000","last_clean_scrub_stamp":"2024-09-14T11:24:09.066501+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:53:06.539792+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":114,"num_read_kb":78,"num_write":35,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3f","version":"267'198","reported_seq":868,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:58:47.835532+0000","last_change":"2024-09-14T11:08:21.831355+0000","last_active":"2024-09-14T12:58:47.835532+0000","last_peered":"2024-09-14T12:58:47.835532+0000","last_clean":"2024-09-14T12:58:47.835532+0000","last_became_active":"2024-09-14T11:08:21.829676+0000","last_became_peered":"2024-09-14T11:08:21.829676+0000","last_unstale":"2024-09-14T12:58:47.835532+0000","last_undegraded":"2024-09-14T12:58:47.835532+0000","last_fullsized":"2024-09-14T12:58:47.835532+0000","mapping_epoch":24,"log_start":"267'100","ondisk_log_start":"267'100","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:08:20.733145+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:08:20.733145+0000","last_clean_scrub_stamp":"2024-09-14T11:08:20.733145+0000","objects_scrubbed":0,"log_size":98,"log_dups_size":100,"ondisk_log_size":98,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:36:16.240993+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":11861059,"num_objects":10,"num_object_clones":0,"num_object_copies":30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":566,"num_read_kb":18432,"num_write":885,"num_write_kb":26168,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,0],"acting":[7,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.38","version":"267'461","reported_seq":2067,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:59:14.735536+0000","last_change":"2024-09-14T11:08:23.801607+0000","last_active":"2024-09-14T12:59:14.735536+0000","last_peered":"2024-09-14T12:59:14.735536+0000","last_clean":"2024-09-14T12:59:14.735536+0000","last_became_active":"2024-09-14T11:08:23.800936+0000","last_became_peered":"2024-09-14T11:08:23.800936+0000","last_unstale":"2024-09-14T12:59:14.735536+0000","last_undegraded":"2024-09-14T12:59:14.735536+0000","last_fullsized":"2024-09-14T12:59:14.735536+0000","mapping_epoch":26,"log_start":"267'400","ondisk_log_start":"267'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:08:22.750609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:08:22.750609+0000","last_clean_scrub_stamp":"2024-09-14T11:08:22.750609+0000","objects_scrubbed":0,"log_size":61,"log_dups_size":400,"ondisk_log_size":61,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:16:00.073851+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":2476,"num_read_kb":2325,"num_write":550,"num_write_kb":127,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3e","version":"267'223","reported_seq":930,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:58:48.462460+0000","last_change":"2024-09-14T11:08:21.810078+0000","last_active":"2024-09-14T12:58:48.462460+0000","last_peered":"2024-09-14T12:58:48.462460+0000","last_clean":"2024-09-14T12:58:48.462460+0000","last_became_active":"2024-09-14T11:08:21.808315+0000","last_became_peered":"2024-09-14T11:08:21.808315+0000","last_unstale":"2024-09-14T12:58:48.462460+0000","last_undegraded":"2024-09-14T12:58:48.462460+0000","last_fullsized":"2024-09-14T12:58:48.462460+0000","mapping_epoch":24,"log_start":"267'200","ondisk_log_start":"267'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:08:20.733145+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:08:20.733145+0000","last_clean_scrub_stamp":"2024-09-14T11:08:20.733145+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":200,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:01:33.622838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8326349,"num_objects":9,"num_object_clones":0,"num_object_copies":27,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":599,"num_read_kb":113994,"num_write":1039,"num_write_kb":54817,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,6],"acting":[1,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.39","version":"267'896","reported_seq":2642,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:59:07.757541+0000","last_change":"2024-09-14T11:08:23.802023+0000","last_active":"2024-09-14T12:59:07.757541+0000","last_peered":"2024-09-14T12:59:07.757541+0000","last_clean":"2024-09-14T12:59:07.757541+0000","last_became_active":"2024-09-14T11:08:23.801320+0000","last_became_peered":"2024-09-14T11:08:23.801320+0000","last_unstale":"2024-09-14T12:59:07.757541+0000","last_undegraded":"2024-09-14T12:59:07.757541+0000","last_fullsized":"2024-09-14T12:59:07.757541+0000","mapping_epoch":26,"log_start":"267'800","ondisk_log_start":"267'800","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:08:22.750609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:08:22.750609+0000","last_clean_scrub_stamp":"2024-09-14T11:08:22.750609+0000","objects_scrubbed":0,"log_size":96,"log_dups_size":800,"ondisk_log_size":96,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:41:31.186802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":4549,"num_read_kb":4112,"num_write":1219,"num_write_kb":503,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3d","version":"267'199","reported_seq":846,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:58:48.241280+0000","last_change":"2024-09-14T11:08:21.776968+0000","last_active":"2024-09-14T12:58:48.241280+0000","last_peered":"2024-09-14T12:58:48.241280+0000","last_clean":"2024-09-14T12:58:48.241280+0000","last_became_active":"2024-09-14T11:08:21.776255+0000","last_became_peered":"2024-09-14T11:08:21.776255+0000","last_unstale":"2024-09-14T12:58:48.241280+0000","last_undegraded":"2024-09-14T12:58:48.241280+0000","last_fullsized":"2024-09-14T12:58:48.241280+0000","mapping_epoch":24,"log_start":"267'100","ondisk_log_start":"267'100","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:08:20.733145+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:08:20.733145+0000","last_clean_scrub_stamp":"2024-09-14T11:08:20.733145+0000","objects_scrubbed":0,"log_size":99,"log_dups_size":100,"ondisk_log_size":99,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:55:21.434023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":840651,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":485,"num_read_kb":4028,"num_write":959,"num_write_kb":22458,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"267'468","reported_seq":2120,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:59:07.754233+0000","last_change":"2024-09-14T11:08:23.787232+0000","last_active":"2024-09-14T12:59:07.754233+0000","last_peered":"2024-09-14T12:59:07.754233+0000","last_clean":"2024-09-14T12:59:07.754233+0000","last_became_active":"2024-09-14T11:08:23.786481+0000","last_became_peered":"2024-09-14T11:08:23.786481+0000","last_unstale":"2024-09-14T12:59:07.754233+0000","last_undegraded":"2024-09-14T12:59:07.754233+0000","last_fullsized":"2024-09-14T12:59:07.754233+0000","mapping_epoch":26,"log_start":"267'400","ondisk_log_start":"267'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:08:22.750609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:08:22.750609+0000","last_clean_scrub_stamp":"2024-09-14T11:08:22.750609+0000","objects_scrubbed":0,"log_size":68,"log_dups_size":400,"ondisk_log_size":68,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:00:38.268952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2493,"num_read_kb":2352,"num_write":540,"num_write_kb":121,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3c","version":"267'342","reported_seq":1083,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:58:53.046745+0000","last_change":"2024-09-14T11:08:21.802797+0000","last_active":"2024-09-14T12:58:53.046745+0000","last_peered":"2024-09-14T12:58:53.046745+0000","last_clean":"2024-09-14T12:58:53.046745+0000","last_became_active":"2024-09-14T11:08:21.801787+0000","last_became_peered":"2024-09-14T11:08:21.801787+0000","last_unstale":"2024-09-14T12:58:53.046745+0000","last_undegraded":"2024-09-14T12:58:53.046745+0000","last_fullsized":"2024-09-14T12:58:53.046745+0000","mapping_epoch":24,"log_start":"267'300","ondisk_log_start":"267'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:08:20.733145+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:08:20.733145+0000","last_clean_scrub_stamp":"2024-09-14T11:08:20.733145+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":300,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:42:26.197796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12932840,"num_objects":11,"num_object_clones":0,"num_object_copies":33,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":1003,"num_read_kb":46020,"num_write":1378,"num_write_kb":39725,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3b","version":"267'448","reported_seq":1981,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:58:28.236458+0000","last_change":"2024-09-14T11:08:23.783446+0000","last_active":"2024-09-14T12:58:28.236458+0000","last_peered":"2024-09-14T12:58:28.236458+0000","last_clean":"2024-09-14T12:58:28.236458+0000","last_became_active":"2024-09-14T11:08:23.783162+0000","last_became_peered":"2024-09-14T11:08:23.783162+0000","last_unstale":"2024-09-14T12:58:28.236458+0000","last_undegraded":"2024-09-14T12:58:28.236458+0000","last_fullsized":"2024-09-14T12:58:28.236458+0000","mapping_epoch":26,"log_start":"267'400","ondisk_log_start":"267'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:08:22.750609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:08:22.750609+0000","last_clean_scrub_stamp":"2024-09-14T11:08:22.750609+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":400,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:56:25.662634+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2320,"num_read_kb":2170,"num_write":502,"num_write_kb":112,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3b","version":"267'203","reported_seq":884,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:58:22.829701+0000","last_change":"2024-09-14T11:08:21.842866+0000","last_active":"2024-09-14T12:58:22.829701+0000","last_peered":"2024-09-14T12:58:22.829701+0000","last_clean":"2024-09-14T12:58:22.829701+0000","last_became_active":"2024-09-14T11:08:21.842260+0000","last_became_peered":"2024-09-14T11:08:21.842260+0000","last_unstale":"2024-09-14T12:58:22.829701+0000","last_undegraded":"2024-09-14T12:58:22.829701+0000","last_fullsized":"2024-09-14T12:58:22.829701+0000","mapping_epoch":24,"log_start":"267'100","ondisk_log_start":"267'100","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:08:20.733145+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:08:20.733145+0000","last_clean_scrub_stamp":"2024-09-14T11:08:20.733145+0000","objects_scrubbed":0,"log_size":103,"log_dups_size":100,"ondisk_log_size":103,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:22:55.165506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":14390472,"num_objects":10,"num_object_clones":0,"num_object_copies":30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":558,"num_read_kb":28109,"num_write":982,"num_write_kb":35425,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,4],"acting":[7,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3c","version":"267'413","reported_seq":2185,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:00:21.249733+0000","last_change":"2024-09-14T11:08:23.805016+0000","last_active":"2024-09-14T13:00:21.249733+0000","last_peered":"2024-09-14T13:00:21.249733+0000","last_clean":"2024-09-14T13:00:21.249733+0000","last_became_active":"2024-09-14T11:08:23.804142+0000","last_became_peered":"2024-09-14T11:08:23.804142+0000","last_unstale":"2024-09-14T13:00:21.249733+0000","last_undegraded":"2024-09-14T13:00:21.249733+0000","last_fullsized":"2024-09-14T13:00:21.249733+0000","mapping_epoch":26,"log_start":"267'400","ondisk_log_start":"267'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:08:22.750609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:08:22.750609+0000","last_clean_scrub_stamp":"2024-09-14T11:08:22.750609+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":400,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:55:23.451486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":2567,"num_read_kb":2469,"num_write":470,"num_write_kb":86,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.3a","version":"267'150","reported_seq":774,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:58:23.039736+0000","last_change":"2024-09-14T11:08:21.794493+0000","last_active":"2024-09-14T12:58:23.039736+0000","last_peered":"2024-09-14T12:58:23.039736+0000","last_clean":"2024-09-14T12:58:23.039736+0000","last_became_active":"2024-09-14T11:08:21.791801+0000","last_became_peered":"2024-09-14T11:08:21.791801+0000","last_unstale":"2024-09-14T12:58:23.039736+0000","last_undegraded":"2024-09-14T12:58:23.039736+0000","last_fullsized":"2024-09-14T12:58:23.039736+0000","mapping_epoch":24,"log_start":"267'100","ondisk_log_start":"267'100","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:08:20.733145+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:08:20.733145+0000","last_clean_scrub_stamp":"2024-09-14T11:08:20.733145+0000","objects_scrubbed":0,"log_size":50,"log_dups_size":100,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:05:17.496109+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9789060,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":408,"num_read_kb":24131,"num_write":675,"num_write_kb":32915,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,3],"acting":[5,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3d","version":"267'393","reported_seq":1933,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:00:21.252531+0000","last_change":"2024-09-14T11:08:23.787239+0000","last_active":"2024-09-14T13:00:21.252531+0000","last_peered":"2024-09-14T13:00:21.252531+0000","last_clean":"2024-09-14T13:00:21.252531+0000","last_became_active":"2024-09-14T11:08:23.786522+0000","last_became_peered":"2024-09-14T11:08:23.786522+0000","last_unstale":"2024-09-14T13:00:21.252531+0000","last_undegraded":"2024-09-14T13:00:21.252531+0000","last_fullsized":"2024-09-14T13:00:21.252531+0000","mapping_epoch":26,"log_start":"267'300","ondisk_log_start":"267'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:08:22.750609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:08:22.750609+0000","last_clean_scrub_stamp":"2024-09-14T11:08:22.750609+0000","objects_scrubbed":0,"log_size":93,"log_dups_size":300,"ondisk_log_size":93,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:53:44.242192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2147,"num_read_kb":2043,"num_write":454,"num_write_kb":90,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.39","version":"267'263","reported_seq":1028,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:58:22.829604+0000","last_change":"2024-09-14T11:08:21.837745+0000","last_active":"2024-09-14T12:58:22.829604+0000","last_peered":"2024-09-14T12:58:22.829604+0000","last_clean":"2024-09-14T12:58:22.829604+0000","last_became_active":"2024-09-14T11:08:21.837147+0000","last_became_peered":"2024-09-14T11:08:21.837147+0000","last_unstale":"2024-09-14T12:58:22.829604+0000","last_undegraded":"2024-09-14T12:58:22.829604+0000","last_fullsized":"2024-09-14T12:58:22.829604+0000","mapping_epoch":24,"log_start":"267'200","ondisk_log_start":"267'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:08:20.733145+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:08:20.733145+0000","last_clean_scrub_stamp":"2024-09-14T11:08:20.733145+0000","objects_scrubbed":0,"log_size":63,"log_dups_size":200,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:35:30.293697+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5878766,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":1265,"num_read_kb":31286,"num_write":1151,"num_write_kb":25837,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0,4],"acting":[7,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3e","version":"267'508","reported_seq":2123,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:00:11.324764+0000","last_change":"2024-09-14T11:08:23.801317+0000","last_active":"2024-09-14T13:00:11.324764+0000","last_peered":"2024-09-14T13:00:11.324764+0000","last_clean":"2024-09-14T13:00:11.324764+0000","last_became_active":"2024-09-14T11:08:23.800621+0000","last_became_peered":"2024-09-14T11:08:23.800621+0000","last_unstale":"2024-09-14T13:00:11.324764+0000","last_undegraded":"2024-09-14T13:00:11.324764+0000","last_fullsized":"2024-09-14T13:00:11.324764+0000","mapping_epoch":26,"log_start":"267'400","ondisk_log_start":"267'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:08:22.750609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:08:22.750609+0000","last_clean_scrub_stamp":"2024-09-14T11:08:22.750609+0000","objects_scrubbed":0,"log_size":108,"log_dups_size":400,"ondisk_log_size":108,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:34:14.386345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2676,"num_read_kb":2481,"num_write":623,"num_write_kb":172,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.38","version":"267'206","reported_seq":872,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:59:07.321553+0000","last_change":"2024-09-14T11:08:21.819323+0000","last_active":"2024-09-14T12:59:07.321553+0000","last_peered":"2024-09-14T12:59:07.321553+0000","last_clean":"2024-09-14T12:59:07.321553+0000","last_became_active":"2024-09-14T11:08:21.819029+0000","last_became_peered":"2024-09-14T11:08:21.819029+0000","last_unstale":"2024-09-14T12:59:07.321553+0000","last_undegraded":"2024-09-14T12:59:07.321553+0000","last_fullsized":"2024-09-14T12:59:07.321553+0000","mapping_epoch":24,"log_start":"267'100","ondisk_log_start":"267'100","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:08:20.733145+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:08:20.733145+0000","last_clean_scrub_stamp":"2024-09-14T11:08:20.733145+0000","objects_scrubbed":0,"log_size":106,"log_dups_size":100,"ondisk_log_size":106,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:51:45.031916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12593222,"num_objects":11,"num_object_clones":0,"num_object_copies":33,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":520,"num_read_kb":44666,"num_write":924,"num_write_kb":39932,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,6],"acting":[3,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3f","version":"267'916","reported_seq":2562,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:59:18.403546+0000","last_change":"2024-09-14T11:08:23.786220+0000","last_active":"2024-09-14T12:59:18.403546+0000","last_peered":"2024-09-14T12:59:18.403546+0000","last_clean":"2024-09-14T12:59:18.403546+0000","last_became_active":"2024-09-14T11:08:23.785941+0000","last_became_peered":"2024-09-14T11:08:23.785941+0000","last_unstale":"2024-09-14T12:59:18.403546+0000","last_undegraded":"2024-09-14T12:59:18.403546+0000","last_fullsized":"2024-09-14T12:59:18.403546+0000","mapping_epoch":26,"log_start":"267'900","ondisk_log_start":"267'900","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:08:22.750609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:08:22.750609+0000","last_clean_scrub_stamp":"2024-09-14T11:08:22.750609+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":900,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:26:08.067752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":4272,"num_read_kb":3805,"num_write":1224,"num_write_kb":476,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"267'397","reported_seq":1969,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:00:21.252799+0000","last_change":"2024-09-14T11:08:23.786268+0000","last_active":"2024-09-14T13:00:21.252799+0000","last_peered":"2024-09-14T13:00:21.252799+0000","last_clean":"2024-09-14T13:00:21.252799+0000","last_became_active":"2024-09-14T11:08:23.785439+0000","last_became_peered":"2024-09-14T11:08:23.785439+0000","last_unstale":"2024-09-14T13:00:21.252799+0000","last_undegraded":"2024-09-14T13:00:21.252799+0000","last_fullsized":"2024-09-14T13:00:21.252799+0000","mapping_epoch":26,"log_start":"267'300","ondisk_log_start":"267'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:08:22.750609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:08:22.750609+0000","last_clean_scrub_stamp":"2024-09-14T11:08:22.750609+0000","objects_scrubbed":0,"log_size":97,"log_dups_size":300,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:49:38.056814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2124,"num_read_kb":2036,"num_write":427,"num_write_kb":63,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.37","version":"267'271","reported_seq":1003,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:57:42.820443+0000","last_change":"2024-09-14T11:08:21.806356+0000","last_active":"2024-09-14T12:57:42.820443+0000","last_peered":"2024-09-14T12:57:42.820443+0000","last_clean":"2024-09-14T12:57:42.820443+0000","last_became_active":"2024-09-14T11:08:21.805293+0000","last_became_peered":"2024-09-14T11:08:21.805293+0000","last_unstale":"2024-09-14T12:57:42.820443+0000","last_undegraded":"2024-09-14T12:57:42.820443+0000","last_fullsized":"2024-09-14T12:57:42.820443+0000","mapping_epoch":24,"log_start":"267'200","ondisk_log_start":"267'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:08:20.733145+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:08:20.733145+0000","last_clean_scrub_stamp":"2024-09-14T11:08:20.733145+0000","objects_scrubbed":0,"log_size":71,"log_dups_size":200,"ondisk_log_size":71,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:37:18.597607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10071722,"num_objects":9,"num_object_clones":0,"num_object_copies":27,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":1081,"num_read_kb":13085,"num_write":1145,"num_write_kb":51014,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,0],"acting":[7,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.31","version":"267'698","reported_seq":2408,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:00:21.250245+0000","last_change":"2024-09-14T11:08:23.808916+0000","last_active":"2024-09-14T13:00:21.250245+0000","last_peered":"2024-09-14T13:00:21.250245+0000","last_clean":"2024-09-14T13:00:21.250245+0000","last_became_active":"2024-09-14T11:08:23.808090+0000","last_became_peered":"2024-09-14T11:08:23.808090+0000","last_unstale":"2024-09-14T13:00:21.250245+0000","last_undegraded":"2024-09-14T13:00:21.250245+0000","last_fullsized":"2024-09-14T13:00:21.250245+0000","mapping_epoch":26,"log_start":"267'600","ondisk_log_start":"267'600","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:08:22.750609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:08:22.750609+0000","last_clean_scrub_stamp":"2024-09-14T11:08:22.750609+0000","objects_scrubbed":0,"log_size":98,"log_dups_size":600,"ondisk_log_size":98,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:17:11.316389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":3652,"num_read_kb":3296,"num_write":1024,"num_write_kb":466,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"267'178","reported_seq":813,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:59:33.437531+0000","last_change":"2024-09-14T11:08:21.825717+0000","last_active":"2024-09-14T12:59:33.437531+0000","last_peered":"2024-09-14T12:59:33.437531+0000","last_clean":"2024-09-14T12:59:33.437531+0000","last_became_active":"2024-09-14T11:08:21.824907+0000","last_became_peered":"2024-09-14T11:08:21.824907+0000","last_unstale":"2024-09-14T12:59:33.437531+0000","last_undegraded":"2024-09-14T12:59:33.437531+0000","last_fullsized":"2024-09-14T12:59:33.437531+0000","mapping_epoch":24,"log_start":"267'100","ondisk_log_start":"267'100","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:08:20.733145+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:08:20.733145+0000","last_clean_scrub_stamp":"2024-09-14T11:08:20.733145+0000","objects_scrubbed":0,"log_size":78,"log_dups_size":100,"ondisk_log_size":78,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:24:44.159796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6291524,"num_objects":9,"num_object_clones":0,"num_object_copies":27,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":503,"num_read_kb":17557,"num_write":871,"num_write_kb":17084,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,4],"acting":[6,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.32","version":"267'540","reported_seq":2172,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:58:38.043258+0000","last_change":"2024-09-14T11:08:23.804611+0000","last_active":"2024-09-14T12:58:38.043258+0000","last_peered":"2024-09-14T12:58:38.043258+0000","last_clean":"2024-09-14T12:58:38.043258+0000","last_became_active":"2024-09-14T11:08:23.801090+0000","last_became_peered":"2024-09-14T11:08:23.801090+0000","last_unstale":"2024-09-14T12:58:38.043258+0000","last_undegraded":"2024-09-14T12:58:38.043258+0000","last_fullsized":"2024-09-14T12:58:38.043258+0000","mapping_epoch":26,"log_start":"267'500","ondisk_log_start":"267'500","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:08:22.750609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:08:22.750609+0000","last_clean_scrub_stamp":"2024-09-14T11:08:22.750609+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":500,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:20:59.798401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2832,"num_read_kb":2611,"num_write":684,"num_write_kb":208,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.35","version":"267'226","reported_seq":896,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:59:33.437462+0000","last_change":"2024-09-14T11:08:21.817869+0000","last_active":"2024-09-14T12:59:33.437462+0000","last_peered":"2024-09-14T12:59:33.437462+0000","last_clean":"2024-09-14T12:59:33.437462+0000","last_became_active":"2024-09-14T11:08:21.817113+0000","last_became_peered":"2024-09-14T11:08:21.817113+0000","last_unstale":"2024-09-14T12:59:33.437462+0000","last_undegraded":"2024-09-14T12:59:33.437462+0000","last_fullsized":"2024-09-14T12:59:33.437462+0000","mapping_epoch":24,"log_start":"267'200","ondisk_log_start":"267'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:08:20.733145+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:08:20.733145+0000","last_clean_scrub_stamp":"2024-09-14T11:08:20.733145+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":200,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:19:02.887954+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5850197,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":572,"num_read_kb":71773,"num_write":1061,"num_write_kb":34768,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,0],"acting":[6,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.33","version":"267'480","reported_seq":2201,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:59:14.731435+0000","last_change":"2024-09-14T11:08:23.782419+0000","last_active":"2024-09-14T12:59:14.731435+0000","last_peered":"2024-09-14T12:59:14.731435+0000","last_clean":"2024-09-14T12:59:14.731435+0000","last_became_active":"2024-09-14T11:08:23.782135+0000","last_became_peered":"2024-09-14T11:08:23.782135+0000","last_unstale":"2024-09-14T12:59:14.731435+0000","last_undegraded":"2024-09-14T12:59:14.731435+0000","last_fullsized":"2024-09-14T12:59:14.731435+0000","mapping_epoch":26,"log_start":"267'400","ondisk_log_start":"267'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:08:22.750609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:08:22.750609+0000","last_clean_scrub_stamp":"2024-09-14T11:08:22.750609+0000","objects_scrubbed":0,"log_size":80,"log_dups_size":400,"ondisk_log_size":80,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:10:45.724644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2660,"num_read_kb":2528,"num_write":519,"num_write_kb":93,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.34","version":"267'243","reported_seq":897,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:59:33.240274+0000","last_change":"2024-09-14T11:08:21.837036+0000","last_active":"2024-09-14T12:59:33.240274+0000","last_peered":"2024-09-14T12:59:33.240274+0000","last_clean":"2024-09-14T12:59:33.240274+0000","last_became_active":"2024-09-14T11:08:21.835636+0000","last_became_peered":"2024-09-14T11:08:21.835636+0000","last_unstale":"2024-09-14T12:59:33.240274+0000","last_undegraded":"2024-09-14T12:59:33.240274+0000","last_fullsized":"2024-09-14T12:59:33.240274+0000","mapping_epoch":24,"log_start":"267'200","ondisk_log_start":"267'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:08:20.733145+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:08:20.733145+0000","last_clean_scrub_stamp":"2024-09-14T11:08:20.733145+0000","objects_scrubbed":0,"log_size":43,"log_dups_size":200,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:36:27.787998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4436620,"num_objects":9,"num_object_clones":0,"num_object_copies":27,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":568,"num_read_kb":3577,"num_write":1178,"num_write_kb":25395,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6],"acting":[4,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.34","version":"267'553","reported_seq":2210,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:58:07.979376+0000","last_change":"2024-09-14T11:08:23.784471+0000","last_active":"2024-09-14T12:58:07.979376+0000","last_peered":"2024-09-14T12:58:07.979376+0000","last_clean":"2024-09-14T12:58:07.979376+0000","last_became_active":"2024-09-14T11:08:23.784078+0000","last_became_peered":"2024-09-14T11:08:23.784078+0000","last_unstale":"2024-09-14T12:58:07.979376+0000","last_undegraded":"2024-09-14T12:58:07.979376+0000","last_fullsized":"2024-09-14T12:58:07.979376+0000","mapping_epoch":26,"log_start":"267'500","ondisk_log_start":"267'500","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:08:22.750609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:08:22.750609+0000","last_clean_scrub_stamp":"2024-09-14T11:08:22.750609+0000","objects_scrubbed":0,"log_size":53,"log_dups_size":500,"ondisk_log_size":53,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:53:20.985980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3071,"num_read_kb":2852,"num_write":734,"num_write_kb":256,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.33","version":"267'233","reported_seq":867,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:59:33.474985+0000","last_change":"2024-09-14T11:08:21.809864+0000","last_active":"2024-09-14T12:59:33.474985+0000","last_peered":"2024-09-14T12:59:33.474985+0000","last_clean":"2024-09-14T12:59:33.474985+0000","last_became_active":"2024-09-14T11:08:21.809526+0000","last_became_peered":"2024-09-14T11:08:21.809526+0000","last_unstale":"2024-09-14T12:59:33.474985+0000","last_undegraded":"2024-09-14T12:59:33.474985+0000","last_fullsized":"2024-09-14T12:59:33.474985+0000","mapping_epoch":24,"log_start":"267'200","ondisk_log_start":"267'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:08:20.733145+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:08:20.733145+0000","last_clean_scrub_stamp":"2024-09-14T11:08:20.733145+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":200,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:48:26.943407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4221511,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":493,"num_read_kb":25002,"num_write":1052,"num_write_kb":23085,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6,1],"acting":[3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.35","version":"267'800","reported_seq":2455,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:00:11.251816+0000","last_change":"2024-09-14T11:08:23.786757+0000","last_active":"2024-09-14T13:00:11.251816+0000","last_peered":"2024-09-14T13:00:11.251816+0000","last_clean":"2024-09-14T13:00:11.251816+0000","last_became_active":"2024-09-14T11:08:23.785540+0000","last_became_peered":"2024-09-14T11:08:23.785540+0000","last_unstale":"2024-09-14T13:00:11.251816+0000","last_undegraded":"2024-09-14T13:00:11.251816+0000","last_fullsized":"2024-09-14T13:00:11.251816+0000","mapping_epoch":26,"log_start":"267'700","ondisk_log_start":"267'700","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:08:22.750609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:08:22.750609+0000","last_clean_scrub_stamp":"2024-09-14T11:08:22.750609+0000","objects_scrubbed":0,"log_size":100,"log_dups_size":700,"ondisk_log_size":100,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:29:32.957124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3845,"num_read_kb":3496,"num_write":1039,"num_write_kb":364,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.32","version":"267'213","reported_seq":1002,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:58:23.453514+0000","last_change":"2024-09-14T11:08:21.781133+0000","last_active":"2024-09-14T12:58:23.453514+0000","last_peered":"2024-09-14T12:58:23.453514+0000","last_clean":"2024-09-14T12:58:23.453514+0000","last_became_active":"2024-09-14T11:08:21.780800+0000","last_became_peered":"2024-09-14T11:08:21.780800+0000","last_unstale":"2024-09-14T12:58:23.453514+0000","last_undegraded":"2024-09-14T12:58:23.453514+0000","last_fullsized":"2024-09-14T12:58:23.453514+0000","mapping_epoch":24,"log_start":"267'200","ondisk_log_start":"267'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:08:20.733145+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:08:20.733145+0000","last_clean_scrub_stamp":"2024-09-14T11:08:20.733145+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":200,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:07:51.388416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":13282806,"num_objects":13,"num_object_clones":0,"num_object_copies":39,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":13,"num_whiteouts":0,"num_read":1390,"num_read_kb":21343,"num_write":1076,"num_write_kb":34809,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,1],"acting":[0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.18","version":"267'195","reported_seq":738,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:00:21.491522+0000","last_change":"2024-09-14T11:08:31.851342+0000","last_active":"2024-09-14T13:00:21.491522+0000","last_peered":"2024-09-14T13:00:21.491522+0000","last_clean":"2024-09-14T13:00:21.491522+0000","last_became_active":"2024-09-14T11:08:31.850605+0000","last_became_peered":"2024-09-14T11:08:31.850605+0000","last_unstale":"2024-09-14T13:00:21.491522+0000","last_undegraded":"2024-09-14T13:00:21.491522+0000","last_fullsized":"2024-09-14T13:00:21.491522+0000","mapping_epoch":34,"log_start":"267'100","ondisk_log_start":"267'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:08:30.789404+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:08:30.789404+0000","last_clean_scrub_stamp":"2024-09-14T11:08:30.789404+0000","objects_scrubbed":0,"log_size":95,"log_dups_size":100,"ondisk_log_size":95,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:48:10.230125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":204,"num_read_kb":191,"num_write":376,"num_write_kb":86,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.14","version":"267'865","reported_seq":2388,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:00:18.886532+0000","last_change":"2024-09-14T11:08:23.780134+0000","last_active":"2024-09-14T13:00:18.886532+0000","last_peered":"2024-09-14T13:00:18.886532+0000","last_clean":"2024-09-14T13:00:18.886532+0000","last_became_active":"2024-09-14T11:08:23.779822+0000","last_became_peered":"2024-09-14T11:08:23.779822+0000","last_unstale":"2024-09-14T13:00:18.886532+0000","last_undegraded":"2024-09-14T13:00:18.886532+0000","last_fullsized":"2024-09-14T13:00:18.886532+0000","mapping_epoch":26,"log_start":"267'800","ondisk_log_start":"267'800","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:08:22.750609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:08:22.750609+0000","last_clean_scrub_stamp":"2024-09-14T11:08:22.750609+0000","objects_scrubbed":0,"log_size":65,"log_dups_size":800,"ondisk_log_size":65,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:33:11.558147+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":4044,"num_read_kb":3595,"num_write":1182,"num_write_kb":452,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"267'233","reported_seq":1001,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:59:18.105681+0000","last_change":"2024-09-14T11:08:21.843849+0000","last_active":"2024-09-14T12:59:18.105681+0000","last_peered":"2024-09-14T12:59:18.105681+0000","last_clean":"2024-09-14T12:59:18.105681+0000","last_became_active":"2024-09-14T11:08:21.843212+0000","last_became_peered":"2024-09-14T11:08:21.843212+0000","last_unstale":"2024-09-14T12:59:18.105681+0000","last_undegraded":"2024-09-14T12:59:18.105681+0000","last_fullsized":"2024-09-14T12:59:18.105681+0000","mapping_epoch":24,"log_start":"267'200","ondisk_log_start":"267'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:08:20.733145+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:08:20.733145+0000","last_clean_scrub_stamp":"2024-09-14T11:08:20.733145+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":200,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:37:14.565663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9776683,"num_objects":9,"num_object_clones":0,"num_object_copies":27,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":1009,"num_read_kb":177065,"num_write":1096,"num_write_kb":33961,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,4],"acting":[7,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":525,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:57:13.024031+0000","last_change":"2024-09-14T11:08:25.814095+0000","last_active":"2024-09-14T12:57:13.024031+0000","last_peered":"2024-09-14T12:57:13.024031+0000","last_clean":"2024-09-14T12:57:13.024031+0000","last_became_active":"2024-09-14T11:08:25.803311+0000","last_became_peered":"2024-09-14T11:08:25.803311+0000","last_unstale":"2024-09-14T12:57:13.024031+0000","last_undegraded":"2024-09-14T12:57:13.024031+0000","last_fullsized":"2024-09-14T12:57:13.024031+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:08:24.757170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:08:24.757170+0000","last_clean_scrub_stamp":"2024-09-14T11:08:24.757170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:07:56.109258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.16","version":"267'224","reported_seq":877,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:59:38.254173+0000","last_change":"2024-09-14T11:08:27.809396+0000","last_active":"2024-09-14T12:59:38.254173+0000","last_peered":"2024-09-14T12:59:38.254173+0000","last_clean":"2024-09-14T12:59:38.254173+0000","last_became_active":"2024-09-14T11:08:27.808834+0000","last_became_peered":"2024-09-14T11:08:27.808834+0000","last_unstale":"2024-09-14T12:59:38.254173+0000","last_undegraded":"2024-09-14T12:59:38.254173+0000","last_fullsized":"2024-09-14T12:59:38.254173+0000","mapping_epoch":30,"log_start":"267'200","ondisk_log_start":"267'200","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:08:26.771628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:08:26.771628+0000","last_clean_scrub_stamp":"2024-09-14T11:08:26.771628+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":200,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:33:46.586543+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7578,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":299,"num_read_kb":302,"num_write":176,"num_write_kb":15,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":518,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:57:17.814599+0000","last_change":"2024-09-14T11:08:29.834235+0000","last_active":"2024-09-14T12:57:17.814599+0000","last_peered":"2024-09-14T12:57:17.814599+0000","last_clean":"2024-09-14T12:57:17.814599+0000","last_became_active":"2024-09-14T11:08:29.833332+0000","last_became_peered":"2024-09-14T11:08:29.833332+0000","last_unstale":"2024-09-14T12:57:17.814599+0000","last_undegraded":"2024-09-14T12:57:17.814599+0000","last_fullsized":"2024-09-14T12:57:17.814599+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:08:28.783586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:08:28.783586+0000","last_clean_scrub_stamp":"2024-09-14T11:08:28.783586+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:59:44.395012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.19","version":"267'122","reported_seq":639,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:57:48.032017+0000","last_change":"2024-09-14T11:08:31.844405+0000","last_active":"2024-09-14T12:57:48.032017+0000","last_peered":"2024-09-14T12:57:48.032017+0000","last_clean":"2024-09-14T12:57:48.032017+0000","last_became_active":"2024-09-14T11:08:31.843645+0000","last_became_peered":"2024-09-14T11:08:31.843645+0000","last_unstale":"2024-09-14T12:57:48.032017+0000","last_undegraded":"2024-09-14T12:57:48.032017+0000","last_fullsized":"2024-09-14T12:57:48.032017+0000","mapping_epoch":34,"log_start":"267'100","ondisk_log_start":"267'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:08:30.789404+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:08:30.789404+0000","last_clean_scrub_stamp":"2024-09-14T11:08:30.789404+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":100,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:14:31.616675+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":100,"num_read_kb":97,"num_write":289,"num_write_kb":65,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.15","version":"267'1234","reported_seq":3011,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:00:18.829256+0000","last_change":"2024-09-14T11:08:23.809577+0000","last_active":"2024-09-14T13:00:18.829256+0000","last_peered":"2024-09-14T13:00:18.829256+0000","last_clean":"2024-09-14T13:00:18.829256+0000","last_became_active":"2024-09-14T11:08:23.808015+0000","last_became_peered":"2024-09-14T11:08:23.808015+0000","last_unstale":"2024-09-14T13:00:18.829256+0000","last_undegraded":"2024-09-14T13:00:18.829256+0000","last_fullsized":"2024-09-14T13:00:18.829256+0000","mapping_epoch":26,"log_start":"267'1200","ondisk_log_start":"267'1200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:08:22.750609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:08:22.750609+0000","last_clean_scrub_stamp":"2024-09-14T11:08:22.750609+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":1200,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:00:36.480612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":5778,"num_read_kb":5143,"num_write":1691,"num_write_kb":698,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.12","version":"267'226","reported_seq":943,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:01:28.902381+0000","last_change":"2024-09-14T11:08:21.787689+0000","last_active":"2024-09-14T13:01:28.902381+0000","last_peered":"2024-09-14T13:01:28.902381+0000","last_clean":"2024-09-14T13:01:28.902381+0000","last_became_active":"2024-09-14T11:08:21.787257+0000","last_became_peered":"2024-09-14T11:08:21.787257+0000","last_unstale":"2024-09-14T13:01:28.902381+0000","last_undegraded":"2024-09-14T13:01:28.902381+0000","last_fullsized":"2024-09-14T13:01:28.902381+0000","mapping_epoch":24,"log_start":"267'200","ondisk_log_start":"267'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:08:20.733145+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:08:20.733145+0000","last_clean_scrub_stamp":"2024-09-14T11:08:20.733145+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":200,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:56:32.268492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10812449,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":654,"num_read_kb":98910,"num_write":976,"num_write_kb":32453,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3],"acting":[0,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":527,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:58:28.459329+0000","last_change":"2024-09-14T11:08:25.804425+0000","last_active":"2024-09-14T12:58:28.459329+0000","last_peered":"2024-09-14T12:58:28.459329+0000","last_clean":"2024-09-14T12:58:28.459329+0000","last_became_active":"2024-09-14T11:08:25.804100+0000","last_became_peered":"2024-09-14T11:08:25.804100+0000","last_unstale":"2024-09-14T12:58:28.459329+0000","last_undegraded":"2024-09-14T12:58:28.459329+0000","last_fullsized":"2024-09-14T12:58:28.459329+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:08:24.757170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:08:24.757170+0000","last_clean_scrub_stamp":"2024-09-14T11:08:24.757170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:44:03.143728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.17","version":"267'129","reported_seq":704,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:59:18.421604+0000","last_change":"2024-09-14T11:08:27.831807+0000","last_active":"2024-09-14T12:59:18.421604+0000","last_peered":"2024-09-14T12:59:18.421604+0000","last_clean":"2024-09-14T12:59:18.421604+0000","last_became_active":"2024-09-14T11:08:27.831010+0000","last_became_peered":"2024-09-14T11:08:27.831010+0000","last_unstale":"2024-09-14T12:59:18.421604+0000","last_undegraded":"2024-09-14T12:59:18.421604+0000","last_fullsized":"2024-09-14T12:59:18.421604+0000","mapping_epoch":30,"log_start":"267'100","ondisk_log_start":"267'100","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:08:26.771628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:08:26.771628+0000","last_clean_scrub_stamp":"2024-09-14T11:08:26.771628+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":100,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:48:05.929304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":152,"num_read_kb":149,"num_write":100,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":519,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:57:18.209572+0000","last_change":"2024-09-14T11:08:29.810149+0000","last_active":"2024-09-14T12:57:18.209572+0000","last_peered":"2024-09-14T12:57:18.209572+0000","last_clean":"2024-09-14T12:57:18.209572+0000","last_became_active":"2024-09-14T11:08:29.809568+0000","last_became_peered":"2024-09-14T11:08:29.809568+0000","last_unstale":"2024-09-14T12:57:18.209572+0000","last_undegraded":"2024-09-14T12:57:18.209572+0000","last_fullsized":"2024-09-14T12:57:18.209572+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:08:28.783586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:08:28.783586+0000","last_clean_scrub_stamp":"2024-09-14T11:08:28.783586+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:07:09.977514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.1a","version":"267'137","reported_seq":722,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:58:33.237668+0000","last_change":"2024-09-14T11:08:31.846263+0000","last_active":"2024-09-14T12:58:33.237668+0000","last_peered":"2024-09-14T12:58:33.237668+0000","last_clean":"2024-09-14T12:58:33.237668+0000","last_became_active":"2024-09-14T11:08:31.845634+0000","last_became_peered":"2024-09-14T11:08:31.845634+0000","last_unstale":"2024-09-14T12:58:33.237668+0000","last_undegraded":"2024-09-14T12:58:33.237668+0000","last_fullsized":"2024-09-14T12:58:33.237668+0000","mapping_epoch":34,"log_start":"267'100","ondisk_log_start":"267'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:08:30.789404+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:08:30.789404+0000","last_clean_scrub_stamp":"2024-09-14T11:08:30.789404+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":100,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:44:18.672749+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":271,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":347,"num_read_kb":294,"num_write":357,"num_write_kb":85,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"267'409","reported_seq":1926,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:01:39.333037+0000","last_change":"2024-09-14T11:08:23.780617+0000","last_active":"2024-09-14T13:01:39.333037+0000","last_peered":"2024-09-14T13:01:39.333037+0000","last_clean":"2024-09-14T13:01:39.333037+0000","last_became_active":"2024-09-14T11:08:23.780326+0000","last_became_peered":"2024-09-14T11:08:23.780326+0000","last_unstale":"2024-09-14T13:01:39.333037+0000","last_undegraded":"2024-09-14T13:01:39.333037+0000","last_fullsized":"2024-09-14T13:01:39.333037+0000","mapping_epoch":26,"log_start":"267'300","ondisk_log_start":"267'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:08:22.750609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:08:22.750609+0000","last_clean_scrub_stamp":"2024-09-14T11:08:22.750609+0000","objects_scrubbed":0,"log_size":109,"log_dups_size":300,"ondisk_log_size":109,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:31:39.789906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2172,"num_read_kb":2053,"num_write":475,"num_write_kb":100,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.11","version":"267'223","reported_seq":849,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:58:37.822725+0000","last_change":"2024-09-14T11:08:56.039243+0000","last_active":"2024-09-14T12:58:37.822725+0000","last_peered":"2024-09-14T12:58:37.822725+0000","last_clean":"2024-09-14T12:58:37.822725+0000","last_became_active":"2024-09-14T11:08:56.038815+0000","last_became_peered":"2024-09-14T11:08:56.038815+0000","last_unstale":"2024-09-14T12:58:37.822725+0000","last_undegraded":"2024-09-14T12:58:37.822725+0000","last_fullsized":"2024-09-14T12:58:37.822725+0000","mapping_epoch":37,"log_start":"267'200","ondisk_log_start":"267'200","created":24,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:08:20.733145+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:08:20.733145+0000","last_clean_scrub_stamp":"2024-09-14T11:08:20.733145+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":200,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:21:36.040245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7368155,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":502,"num_read_kb":22051,"num_write":990,"num_write_kb":45213,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4,6],"acting":[2,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":525,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:57:13.438368+0000","last_change":"2024-09-14T11:08:25.798412+0000","last_active":"2024-09-14T12:57:13.438368+0000","last_peered":"2024-09-14T12:57:13.438368+0000","last_clean":"2024-09-14T12:57:13.438368+0000","last_became_active":"2024-09-14T11:08:25.798008+0000","last_became_peered":"2024-09-14T11:08:25.798008+0000","last_unstale":"2024-09-14T12:57:13.438368+0000","last_undegraded":"2024-09-14T12:57:13.438368+0000","last_fullsized":"2024-09-14T12:57:13.438368+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:08:24.757170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:08:24.757170+0000","last_clean_scrub_stamp":"2024-09-14T11:08:24.757170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:17:44.680400+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.14","version":"267'180","reported_seq":783,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:00:11.342120+0000","last_change":"2024-09-14T11:08:27.821531+0000","last_active":"2024-09-14T13:00:11.342120+0000","last_peered":"2024-09-14T13:00:11.342120+0000","last_clean":"2024-09-14T13:00:11.342120+0000","last_became_active":"2024-09-14T11:08:27.820627+0000","last_became_peered":"2024-09-14T11:08:27.820627+0000","last_unstale":"2024-09-14T13:00:11.342120+0000","last_undegraded":"2024-09-14T13:00:11.342120+0000","last_fullsized":"2024-09-14T13:00:11.342120+0000","mapping_epoch":30,"log_start":"267'100","ondisk_log_start":"267'100","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:08:26.771628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:08:26.771628+0000","last_clean_scrub_stamp":"2024-09-14T11:08:26.771628+0000","objects_scrubbed":0,"log_size":80,"log_dups_size":100,"ondisk_log_size":80,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:00:26.336465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":232,"num_read_kb":224,"num_write":158,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.15","version":"267'772","reported_seq":3168,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:01:40.716321+0000","last_change":"2024-09-14T11:08:29.838884+0000","last_active":"2024-09-14T13:01:40.716321+0000","last_peered":"2024-09-14T13:01:40.716321+0000","last_clean":"2024-09-14T13:01:40.716321+0000","last_became_active":"2024-09-14T11:08:29.838193+0000","last_became_peered":"2024-09-14T11:08:29.838193+0000","last_unstale":"2024-09-14T13:01:40.716321+0000","last_undegraded":"2024-09-14T13:01:40.716321+0000","last_fullsized":"2024-09-14T13:01:40.716321+0000","mapping_epoch":32,"log_start":"267'701","ondisk_log_start":"267'701","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:08:28.783586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:08:28.783586+0000","last_clean_scrub_stamp":"2024-09-14T11:08:28.783586+0000","objects_scrubbed":0,"log_size":71,"log_dups_size":701,"ondisk_log_size":71,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:51:08.846542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1b","version":"267'210","reported_seq":1068,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:00:21.684009+0000","last_change":"2024-09-14T11:08:31.844271+0000","last_active":"2024-09-14T13:00:21.684009+0000","last_peered":"2024-09-14T13:00:21.684009+0000","last_clean":"2024-09-14T13:00:21.684009+0000","last_became_active":"2024-09-14T11:08:31.843385+0000","last_became_peered":"2024-09-14T11:08:31.843385+0000","last_unstale":"2024-09-14T13:00:21.684009+0000","last_undegraded":"2024-09-14T13:00:21.684009+0000","last_fullsized":"2024-09-14T13:00:21.684009+0000","mapping_epoch":34,"log_start":"267'100","ondisk_log_start":"267'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:08:30.789404+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:08:30.789404+0000","last_clean_scrub_stamp":"2024-09-14T11:08:30.789404+0000","objects_scrubbed":0,"log_size":110,"log_dups_size":100,"ondisk_log_size":110,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:50:52.716773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":642,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":623,"num_read_kb":612,"num_write":468,"num_write_kb":119,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.17","version":"267'420","reported_seq":1909,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:58:42.824128+0000","last_change":"2024-09-14T11:09:57.239996+0000","last_active":"2024-09-14T12:58:42.824128+0000","last_peered":"2024-09-14T12:58:42.824128+0000","last_clean":"2024-09-14T12:58:42.824128+0000","last_became_active":"2024-09-14T11:09:57.239636+0000","last_became_peered":"2024-09-14T11:09:57.239636+0000","last_unstale":"2024-09-14T12:58:42.824128+0000","last_undegraded":"2024-09-14T12:58:42.824128+0000","last_fullsized":"2024-09-14T12:58:42.824128+0000","mapping_epoch":39,"log_start":"267'400","ondisk_log_start":"267'400","created":26,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:08:22.750609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:08:22.750609+0000","last_clean_scrub_stamp":"2024-09-14T11:08:22.750609+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":400,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:53:58.019330+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2202,"num_read_kb":2076,"num_write":491,"num_write_kb":104,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.10","version":"267'245","reported_seq":913,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:58:03.417656+0000","last_change":"2024-09-14T11:08:21.826810+0000","last_active":"2024-09-14T12:58:03.417656+0000","last_peered":"2024-09-14T12:58:03.417656+0000","last_clean":"2024-09-14T12:58:03.417656+0000","last_became_active":"2024-09-14T11:08:21.817332+0000","last_became_peered":"2024-09-14T11:08:21.817332+0000","last_unstale":"2024-09-14T12:58:03.417656+0000","last_undegraded":"2024-09-14T12:58:03.417656+0000","last_fullsized":"2024-09-14T12:58:03.417656+0000","mapping_epoch":24,"log_start":"267'200","ondisk_log_start":"267'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:08:20.733145+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:08:20.733145+0000","last_clean_scrub_stamp":"2024-09-14T11:08:20.733145+0000","objects_scrubbed":0,"log_size":45,"log_dups_size":200,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:58:18.952310+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8403965,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":646,"num_read_kb":50041,"num_write":1005,"num_write_kb":23458,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,5],"acting":[6,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":525,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:57:13.024092+0000","last_change":"2024-09-14T11:08:25.815329+0000","last_active":"2024-09-14T12:57:13.024092+0000","last_peered":"2024-09-14T12:57:13.024092+0000","last_clean":"2024-09-14T12:57:13.024092+0000","last_became_active":"2024-09-14T11:08:25.814645+0000","last_became_peered":"2024-09-14T11:08:25.814645+0000","last_unstale":"2024-09-14T12:57:13.024092+0000","last_undegraded":"2024-09-14T12:57:13.024092+0000","last_fullsized":"2024-09-14T12:57:13.024092+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:08:24.757170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:08:24.757170+0000","last_clean_scrub_stamp":"2024-09-14T11:08:24.757170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:04:57.817252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.15","version":"267'175","reported_seq":790,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:59:37.847250+0000","last_change":"2024-09-14T11:08:27.828686+0000","last_active":"2024-09-14T12:59:37.847250+0000","last_peered":"2024-09-14T12:59:37.847250+0000","last_clean":"2024-09-14T12:59:37.847250+0000","last_became_active":"2024-09-14T11:08:27.827940+0000","last_became_peered":"2024-09-14T11:08:27.827940+0000","last_unstale":"2024-09-14T12:59:37.847250+0000","last_undegraded":"2024-09-14T12:59:37.847250+0000","last_fullsized":"2024-09-14T12:59:37.847250+0000","mapping_epoch":30,"log_start":"267'100","ondisk_log_start":"267'100","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:08:26.771628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:08:26.771628+0000","last_clean_scrub_stamp":"2024-09-14T11:08:26.771628+0000","objects_scrubbed":0,"log_size":75,"log_dups_size":100,"ondisk_log_size":75,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:53:17.553624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10026,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":220,"num_read_kb":279,"num_write":126,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.14","version":"267'811","reported_seq":2982,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:01:40.726705+0000","last_change":"2024-09-14T11:08:29.832482+0000","last_active":"2024-09-14T13:01:40.726705+0000","last_peered":"2024-09-14T13:01:40.726705+0000","last_clean":"2024-09-14T13:01:40.726705+0000","last_became_active":"2024-09-14T11:08:29.831198+0000","last_became_peered":"2024-09-14T11:08:29.831198+0000","last_unstale":"2024-09-14T13:01:40.726705+0000","last_undegraded":"2024-09-14T13:01:40.726705+0000","last_fullsized":"2024-09-14T13:01:40.726705+0000","mapping_epoch":32,"log_start":"267'800","ondisk_log_start":"267'800","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:08:28.783586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:08:28.783586+0000","last_clean_scrub_stamp":"2024-09-14T11:08:28.783586+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":800,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:32:21.362746+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.8","version":"267'440","reported_seq":1985,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:59:07.757910+0000","last_change":"2024-09-14T11:08:23.812057+0000","last_active":"2024-09-14T12:59:07.757910+0000","last_peered":"2024-09-14T12:59:07.757910+0000","last_clean":"2024-09-14T12:59:07.757910+0000","last_became_active":"2024-09-14T11:08:23.811325+0000","last_became_peered":"2024-09-14T11:08:23.811325+0000","last_unstale":"2024-09-14T12:59:07.757910+0000","last_undegraded":"2024-09-14T12:59:07.757910+0000","last_fullsized":"2024-09-14T12:59:07.757910+0000","mapping_epoch":26,"log_start":"267'400","ondisk_log_start":"267'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:08:22.750609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:08:22.750609+0000","last_clean_scrub_stamp":"2024-09-14T11:08:22.750609+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":400,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:31:01.004270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2277,"num_read_kb":2143,"num_write":513,"num_write_kb":125,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.f","version":"267'236","reported_seq":920,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:59:12.841498+0000","last_change":"2024-09-14T11:08:21.846294+0000","last_active":"2024-09-14T12:59:12.841498+0000","last_peered":"2024-09-14T12:59:12.841498+0000","last_clean":"2024-09-14T12:59:12.841498+0000","last_became_active":"2024-09-14T11:08:21.845618+0000","last_became_peered":"2024-09-14T11:08:21.845618+0000","last_unstale":"2024-09-14T12:59:12.841498+0000","last_undegraded":"2024-09-14T12:59:12.841498+0000","last_fullsized":"2024-09-14T12:59:12.841498+0000","mapping_epoch":24,"log_start":"267'200","ondisk_log_start":"267'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:08:20.733145+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:08:20.733145+0000","last_clean_scrub_stamp":"2024-09-14T11:08:20.733145+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":200,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:11:01.806580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9485601,"num_objects":9,"num_object_clones":0,"num_object_copies":27,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":671,"num_read_kb":36003,"num_write":1070,"num_write_kb":30861,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,0],"acting":[7,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":532,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:58:57.837680+0000","last_change":"2024-09-14T11:08:25.807559+0000","last_active":"2024-09-14T12:58:57.837680+0000","last_peered":"2024-09-14T12:58:57.837680+0000","last_clean":"2024-09-14T12:58:57.837680+0000","last_became_active":"2024-09-14T11:08:25.806427+0000","last_became_peered":"2024-09-14T11:08:25.806427+0000","last_unstale":"2024-09-14T12:58:57.837680+0000","last_undegraded":"2024-09-14T12:58:57.837680+0000","last_fullsized":"2024-09-14T12:58:57.837680+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:08:24.757170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:08:24.757170+0000","last_clean_scrub_stamp":"2024-09-14T11:08:24.757170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:32:34.612298+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.a","version":"267'318","reported_seq":1014,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:01:38.083943+0000","last_change":"2024-09-14T11:08:27.825865+0000","last_active":"2024-09-14T13:01:38.083943+0000","last_peered":"2024-09-14T13:01:38.083943+0000","last_clean":"2024-09-14T13:01:38.083943+0000","last_became_active":"2024-09-14T11:08:27.825133+0000","last_became_peered":"2024-09-14T11:08:27.825133+0000","last_unstale":"2024-09-14T13:01:38.083943+0000","last_undegraded":"2024-09-14T13:01:38.083943+0000","last_fullsized":"2024-09-14T13:01:38.083943+0000","mapping_epoch":30,"log_start":"267'300","ondisk_log_start":"267'300","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:08:26.771628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:08:26.771628+0000","last_clean_scrub_stamp":"2024-09-14T11:08:26.771628+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":300,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:21:39.269871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8811,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":443,"num_read_kb":493,"num_write":274,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":519,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:58:48.462360+0000","last_change":"2024-09-14T11:08:29.816572+0000","last_active":"2024-09-14T12:58:48.462360+0000","last_peered":"2024-09-14T12:58:48.462360+0000","last_clean":"2024-09-14T12:58:48.462360+0000","last_became_active":"2024-09-14T11:08:29.815620+0000","last_became_peered":"2024-09-14T11:08:29.815620+0000","last_unstale":"2024-09-14T12:58:48.462360+0000","last_undegraded":"2024-09-14T12:58:48.462360+0000","last_fullsized":"2024-09-14T12:58:48.462360+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:08:28.783586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:08:28.783586+0000","last_clean_scrub_stamp":"2024-09-14T11:08:28.783586+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:55:41.020963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.4","version":"267'569","reported_seq":1413,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:01:40.627106+0000","last_change":"2024-09-14T11:08:31.844680+0000","last_active":"2024-09-14T13:01:40.627106+0000","last_peered":"2024-09-14T13:01:40.627106+0000","last_clean":"2024-09-14T13:01:40.627106+0000","last_became_active":"2024-09-14T11:08:31.843834+0000","last_became_peered":"2024-09-14T11:08:31.843834+0000","last_unstale":"2024-09-14T13:01:40.627106+0000","last_undegraded":"2024-09-14T13:01:40.627106+0000","last_fullsized":"2024-09-14T13:01:40.627106+0000","mapping_epoch":34,"log_start":"267'500","ondisk_log_start":"267'500","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:08:30.789404+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:08:30.789404+0000","last_clean_scrub_stamp":"2024-09-14T11:08:30.789404+0000","objects_scrubbed":0,"log_size":69,"log_dups_size":500,"ondisk_log_size":69,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:11:32.026053+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1277,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":1293,"num_read_kb":1292,"num_write":1202,"num_write_kb":404,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.9","version":"267'1166","reported_seq":2698,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:58:58.232539+0000","last_change":"2024-09-14T11:08:23.779276+0000","last_active":"2024-09-14T12:58:58.232539+0000","last_peered":"2024-09-14T12:58:58.232539+0000","last_clean":"2024-09-14T12:58:58.232539+0000","last_became_active":"2024-09-14T11:08:23.778539+0000","last_became_peered":"2024-09-14T11:08:23.778539+0000","last_unstale":"2024-09-14T12:58:58.232539+0000","last_undegraded":"2024-09-14T12:58:58.232539+0000","last_fullsized":"2024-09-14T12:58:58.232539+0000","mapping_epoch":26,"log_start":"267'1100","ondisk_log_start":"267'1100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:08:22.750609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:08:22.750609+0000","last_clean_scrub_stamp":"2024-09-14T11:08:22.750609+0000","objects_scrubbed":0,"log_size":66,"log_dups_size":1100,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:37:56.213667+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":5272,"num_read_kb":4639,"num_write":1605,"num_write_kb":663,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"267'230","reported_seq":875,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:01:30.957938+0000","last_change":"2024-09-14T11:08:21.837563+0000","last_active":"2024-09-14T13:01:30.957938+0000","last_peered":"2024-09-14T13:01:30.957938+0000","last_clean":"2024-09-14T13:01:30.957938+0000","last_became_active":"2024-09-14T11:08:21.836948+0000","last_became_peered":"2024-09-14T11:08:21.836948+0000","last_unstale":"2024-09-14T13:01:30.957938+0000","last_undegraded":"2024-09-14T13:01:30.957938+0000","last_fullsized":"2024-09-14T13:01:30.957938+0000","mapping_epoch":24,"log_start":"267'200","ondisk_log_start":"267'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:08:20.733145+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:08:20.733145+0000","last_clean_scrub_stamp":"2024-09-14T11:08:20.733145+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":200,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:41:03.647233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8758677,"num_objects":9,"num_object_clones":0,"num_object_copies":27,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":539,"num_read_kb":30597,"num_write":996,"num_write_kb":48772,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,1],"acting":[7,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.8","version":"36'4","reported_seq":1009,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:01:40.255874+0000","last_change":"2024-09-14T11:08:25.787348+0000","last_active":"2024-09-14T13:01:40.255874+0000","last_peered":"2024-09-14T13:01:40.255874+0000","last_clean":"2024-09-14T13:01:40.255874+0000","last_became_active":"2024-09-14T11:08:25.786631+0000","last_became_peered":"2024-09-14T11:08:25.786631+0000","last_unstale":"2024-09-14T13:01:40.255874+0000","last_undegraded":"2024-09-14T13:01:40.255874+0000","last_fullsized":"2024-09-14T13:01:40.255874+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:08:24.757170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:08:24.757170+0000","last_clean_scrub_stamp":"2024-09-14T11:08:24.757170+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:53:18.472903+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1139,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":715,"num_read_kb":1177,"num_write":8,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.b","version":"267'173","reported_seq":791,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:00:58.494459+0000","last_change":"2024-09-14T11:08:27.822261+0000","last_active":"2024-09-14T13:00:58.494459+0000","last_peered":"2024-09-14T13:00:58.494459+0000","last_clean":"2024-09-14T13:00:58.494459+0000","last_became_active":"2024-09-14T11:08:27.821051+0000","last_became_peered":"2024-09-14T11:08:27.821051+0000","last_unstale":"2024-09-14T13:00:58.494459+0000","last_undegraded":"2024-09-14T13:00:58.494459+0000","last_fullsized":"2024-09-14T13:00:58.494459+0000","mapping_epoch":30,"log_start":"267'100","ondisk_log_start":"267'100","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:08:26.771628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:08:26.771628+0000","last_clean_scrub_stamp":"2024-09-14T11:08:26.771628+0000","objects_scrubbed":0,"log_size":73,"log_dups_size":100,"ondisk_log_size":73,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:27:12.003430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10996,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":225,"num_read_kb":299,"num_write":128,"num_write_kb":25,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":523,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:59:23.472522+0000","last_change":"2024-09-14T11:08:29.836035+0000","last_active":"2024-09-14T12:59:23.472522+0000","last_peered":"2024-09-14T12:59:23.472522+0000","last_clean":"2024-09-14T12:59:23.472522+0000","last_became_active":"2024-09-14T11:08:29.835446+0000","last_became_peered":"2024-09-14T11:08:29.835446+0000","last_unstale":"2024-09-14T12:59:23.472522+0000","last_undegraded":"2024-09-14T12:59:23.472522+0000","last_fullsized":"2024-09-14T12:59:23.472522+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:08:28.783586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:08:28.783586+0000","last_clean_scrub_stamp":"2024-09-14T11:08:28.783586+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:36:19.782325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.5","version":"267'2490","reported_seq":4358,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:01:27.935148+0000","last_change":"2024-09-14T11:08:31.849687+0000","last_active":"2024-09-14T13:01:27.935148+0000","last_peered":"2024-09-14T13:01:27.935148+0000","last_clean":"2024-09-14T13:01:27.935148+0000","last_became_active":"2024-09-14T11:08:31.848959+0000","last_became_peered":"2024-09-14T11:08:31.848959+0000","last_unstale":"2024-09-14T13:01:27.935148+0000","last_undegraded":"2024-09-14T13:01:27.935148+0000","last_fullsized":"2024-09-14T13:01:27.935148+0000","mapping_epoch":34,"log_start":"267'2400","ondisk_log_start":"267'2400","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:08:30.789404+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:08:30.789404+0000","last_clean_scrub_stamp":"2024-09-14T11:08:30.789404+0000","objects_scrubbed":0,"log_size":90,"log_dups_size":2400,"ondisk_log_size":90,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:50:52.716773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":423,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":6223,"num_read_kb":6216,"num_write":5015,"num_write_kb":1852,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.a","version":"267'866","reported_seq":2677,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:01:39.416327+0000","last_change":"2024-09-14T11:08:23.812059+0000","last_active":"2024-09-14T13:01:39.416327+0000","last_peered":"2024-09-14T13:01:39.416327+0000","last_clean":"2024-09-14T13:01:39.416327+0000","last_became_active":"2024-09-14T11:08:23.811255+0000","last_became_peered":"2024-09-14T11:08:23.811255+0000","last_unstale":"2024-09-14T13:01:39.416327+0000","last_undegraded":"2024-09-14T13:01:39.416327+0000","last_fullsized":"2024-09-14T13:01:39.416327+0000","mapping_epoch":26,"log_start":"267'800","ondisk_log_start":"267'800","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:08:22.750609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:08:22.750609+0000","last_clean_scrub_stamp":"2024-09-14T11:08:22.750609+0000","objects_scrubbed":0,"log_size":66,"log_dups_size":800,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:59:11.000027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":4399,"num_read_kb":3998,"num_write":1156,"num_write_kb":415,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"267'202","reported_seq":874,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:58:37.833064+0000","last_change":"2024-09-14T11:08:21.805672+0000","last_active":"2024-09-14T12:58:37.833064+0000","last_peered":"2024-09-14T12:58:37.833064+0000","last_clean":"2024-09-14T12:58:37.833064+0000","last_became_active":"2024-09-14T11:08:21.804566+0000","last_became_peered":"2024-09-14T11:08:21.804566+0000","last_unstale":"2024-09-14T12:58:37.833064+0000","last_undegraded":"2024-09-14T12:58:37.833064+0000","last_fullsized":"2024-09-14T12:58:37.833064+0000","mapping_epoch":24,"log_start":"267'100","ondisk_log_start":"267'100","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:08:20.733145+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:08:20.733145+0000","last_clean_scrub_stamp":"2024-09-14T11:08:20.733145+0000","objects_scrubbed":0,"log_size":102,"log_dups_size":100,"ondisk_log_size":102,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:32:47.003209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12777436,"num_objects":12,"num_object_clones":0,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":0,"num_read":547,"num_read_kb":39817,"num_write":944,"num_write_kb":36124,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,3],"acting":[7,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":533,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:58:42.823897+0000","last_change":"2024-09-14T11:08:25.789785+0000","last_active":"2024-09-14T12:58:42.823897+0000","last_peered":"2024-09-14T12:58:42.823897+0000","last_clean":"2024-09-14T12:58:42.823897+0000","last_became_active":"2024-09-14T11:08:25.789075+0000","last_became_peered":"2024-09-14T11:08:25.789075+0000","last_unstale":"2024-09-14T12:58:42.823897+0000","last_undegraded":"2024-09-14T12:58:42.823897+0000","last_fullsized":"2024-09-14T12:58:42.823897+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:08:24.757170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:08:24.757170+0000","last_clean_scrub_stamp":"2024-09-14T11:08:24.757170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:02:16.864399+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.8","version":"267'229","reported_seq":886,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:01:07.868354+0000","last_change":"2024-09-14T11:08:27.831643+0000","last_active":"2024-09-14T13:01:07.868354+0000","last_peered":"2024-09-14T13:01:07.868354+0000","last_clean":"2024-09-14T13:01:07.868354+0000","last_became_active":"2024-09-14T11:08:27.830862+0000","last_became_peered":"2024-09-14T11:08:27.830862+0000","last_unstale":"2024-09-14T13:01:07.868354+0000","last_undegraded":"2024-09-14T13:01:07.868354+0000","last_fullsized":"2024-09-14T13:01:07.868354+0000","mapping_epoch":30,"log_start":"267'200","ondisk_log_start":"267'200","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:08:26.771628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:08:26.771628+0000","last_clean_scrub_stamp":"2024-09-14T11:08:26.771628+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":200,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:28:29.317319+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6583,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":311,"num_read_kb":308,"num_write":182,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.9","version":"267'782","reported_seq":3470,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:01:40.728572+0000","last_change":"2024-09-14T11:08:29.822652+0000","last_active":"2024-09-14T13:01:40.728572+0000","last_peered":"2024-09-14T13:01:40.728572+0000","last_clean":"2024-09-14T13:01:40.728572+0000","last_became_active":"2024-09-14T11:08:29.821920+0000","last_became_peered":"2024-09-14T11:08:29.821920+0000","last_unstale":"2024-09-14T13:01:40.728572+0000","last_undegraded":"2024-09-14T13:01:40.728572+0000","last_fullsized":"2024-09-14T13:01:40.728572+0000","mapping_epoch":32,"log_start":"267'700","ondisk_log_start":"267'700","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:08:28.783586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:08:28.783586+0000","last_clean_scrub_stamp":"2024-09-14T11:08:28.783586+0000","objects_scrubbed":0,"log_size":82,"log_dups_size":700,"ondisk_log_size":82,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:48:48.100097+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.6","version":"267'126","reported_seq":663,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:01:39.376250+0000","last_change":"2024-09-14T11:08:31.848848+0000","last_active":"2024-09-14T13:01:39.376250+0000","last_peered":"2024-09-14T13:01:39.376250+0000","last_clean":"2024-09-14T13:01:39.376250+0000","last_became_active":"2024-09-14T11:08:31.846373+0000","last_became_peered":"2024-09-14T11:08:31.846373+0000","last_unstale":"2024-09-14T13:01:39.376250+0000","last_undegraded":"2024-09-14T13:01:39.376250+0000","last_fullsized":"2024-09-14T13:01:39.376250+0000","mapping_epoch":34,"log_start":"267'100","ondisk_log_start":"267'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:08:30.789404+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:08:30.789404+0000","last_clean_scrub_stamp":"2024-09-14T11:08:30.789404+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":100,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:47:54.026151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":575,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":123,"num_write":296,"num_write_kb":71,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"267'1040","reported_seq":2676,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:58:43.240136+0000","last_change":"2024-09-14T11:08:23.777370+0000","last_active":"2024-09-14T12:58:43.240136+0000","last_peered":"2024-09-14T12:58:43.240136+0000","last_clean":"2024-09-14T12:58:43.240136+0000","last_became_active":"2024-09-14T11:08:23.777032+0000","last_became_peered":"2024-09-14T11:08:23.777032+0000","last_unstale":"2024-09-14T12:58:43.240136+0000","last_undegraded":"2024-09-14T12:58:43.240136+0000","last_fullsized":"2024-09-14T12:58:43.240136+0000","mapping_epoch":26,"log_start":"267'1000","ondisk_log_start":"267'1000","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:08:22.750609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:08:22.750609+0000","last_clean_scrub_stamp":"2024-09-14T11:08:22.750609+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":1000,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:49:19.371576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":7372,"num_read_kb":6755,"num_write":1704,"num_write_kb":754,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.c","version":"267'182","reported_seq":822,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:58:38.043346+0000","last_change":"2024-09-14T11:08:21.828750+0000","last_active":"2024-09-14T12:58:38.043346+0000","last_peered":"2024-09-14T12:58:38.043346+0000","last_clean":"2024-09-14T12:58:38.043346+0000","last_became_active":"2024-09-14T11:08:21.828010+0000","last_became_peered":"2024-09-14T11:08:21.828010+0000","last_unstale":"2024-09-14T12:58:38.043346+0000","last_undegraded":"2024-09-14T12:58:38.043346+0000","last_fullsized":"2024-09-14T12:58:38.043346+0000","mapping_epoch":24,"log_start":"267'100","ondisk_log_start":"267'100","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:08:20.733145+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:08:20.733145+0000","last_clean_scrub_stamp":"2024-09-14T11:08:20.733145+0000","objects_scrubbed":0,"log_size":82,"log_dups_size":100,"ondisk_log_size":82,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:37:57.066174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":11803263,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":461,"num_read_kb":18086,"num_write":814,"num_write_kb":39275,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,6],"acting":[5,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":535,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:59:32.834776+0000","last_change":"2024-09-14T11:08:25.805942+0000","last_active":"2024-09-14T12:59:32.834776+0000","last_peered":"2024-09-14T12:59:32.834776+0000","last_clean":"2024-09-14T12:59:32.834776+0000","last_became_active":"2024-09-14T11:08:25.805415+0000","last_became_peered":"2024-09-14T11:08:25.805415+0000","last_unstale":"2024-09-14T12:59:32.834776+0000","last_undegraded":"2024-09-14T12:59:32.834776+0000","last_fullsized":"2024-09-14T12:59:32.834776+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:08:24.757170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:08:24.757170+0000","last_clean_scrub_stamp":"2024-09-14T11:08:24.757170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:04:41.418486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"267'240","reported_seq":922,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:01:40.550793+0000","last_change":"2024-09-14T11:08:27.812358+0000","last_active":"2024-09-14T13:01:40.550793+0000","last_peered":"2024-09-14T13:01:40.550793+0000","last_clean":"2024-09-14T13:01:40.550793+0000","last_became_active":"2024-09-14T11:08:27.811687+0000","last_became_peered":"2024-09-14T11:08:27.811687+0000","last_unstale":"2024-09-14T13:01:40.550793+0000","last_undegraded":"2024-09-14T13:01:40.550793+0000","last_fullsized":"2024-09-14T13:01:40.550793+0000","mapping_epoch":30,"log_start":"267'200","ondisk_log_start":"267'200","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:08:26.771628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:08:26.771628+0000","last_clean_scrub_stamp":"2024-09-14T11:08:26.771628+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":200,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:53:33.661450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":28650,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":331,"num_read_kb":474,"num_write":178,"num_write_kb":48,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":527,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:59:02.829095+0000","last_change":"2024-09-14T11:08:29.822875+0000","last_active":"2024-09-14T12:59:02.829095+0000","last_peered":"2024-09-14T12:59:02.829095+0000","last_clean":"2024-09-14T12:59:02.829095+0000","last_became_active":"2024-09-14T11:08:29.821747+0000","last_became_peered":"2024-09-14T11:08:29.821747+0000","last_unstale":"2024-09-14T12:59:02.829095+0000","last_undegraded":"2024-09-14T12:59:02.829095+0000","last_fullsized":"2024-09-14T12:59:02.829095+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:08:28.783586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:08:28.783586+0000","last_clean_scrub_stamp":"2024-09-14T11:08:28.783586+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:24:23.302821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.7","version":"267'148","reported_seq":694,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:00:15.969897+0000","last_change":"2024-09-14T11:08:31.839098+0000","last_active":"2024-09-14T13:00:15.969897+0000","last_peered":"2024-09-14T13:00:15.969897+0000","last_clean":"2024-09-14T13:00:15.969897+0000","last_became_active":"2024-09-14T11:08:31.838392+0000","last_became_peered":"2024-09-14T11:08:31.838392+0000","last_unstale":"2024-09-14T13:00:15.969897+0000","last_undegraded":"2024-09-14T13:00:15.969897+0000","last_fullsized":"2024-09-14T13:00:15.969897+0000","mapping_epoch":34,"log_start":"267'100","ondisk_log_start":"267'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:08:30.789404+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:08:30.789404+0000","last_clean_scrub_stamp":"2024-09-14T11:08:30.789404+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":100,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:19:04.951364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":722,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":177,"num_read_kb":165,"num_write":335,"num_write_kb":82,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"267'557","reported_seq":2159,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:59:14.732479+0000","last_change":"2024-09-14T11:08:23.789049+0000","last_active":"2024-09-14T12:59:14.732479+0000","last_peered":"2024-09-14T12:59:14.732479+0000","last_clean":"2024-09-14T12:59:14.732479+0000","last_became_active":"2024-09-14T11:08:23.788219+0000","last_became_peered":"2024-09-14T11:08:23.788219+0000","last_unstale":"2024-09-14T12:59:14.732479+0000","last_undegraded":"2024-09-14T12:59:14.732479+0000","last_fullsized":"2024-09-14T12:59:14.732479+0000","mapping_epoch":26,"log_start":"267'500","ondisk_log_start":"267'500","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:08:22.750609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:08:22.750609+0000","last_clean_scrub_stamp":"2024-09-14T11:08:22.750609+0000","objects_scrubbed":0,"log_size":57,"log_dups_size":500,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:01:08.503596+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2903,"num_read_kb":2651,"num_write":738,"num_write_kb":289,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"267'312","reported_seq":1059,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:58:38.461550+0000","last_change":"2024-09-14T11:08:21.827864+0000","last_active":"2024-09-14T12:58:38.461550+0000","last_peered":"2024-09-14T12:58:38.461550+0000","last_clean":"2024-09-14T12:58:38.461550+0000","last_became_active":"2024-09-14T11:08:21.827553+0000","last_became_peered":"2024-09-14T11:08:21.827553+0000","last_unstale":"2024-09-14T12:58:38.461550+0000","last_undegraded":"2024-09-14T12:58:38.461550+0000","last_fullsized":"2024-09-14T12:58:38.461550+0000","mapping_epoch":24,"log_start":"267'300","ondisk_log_start":"267'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:08:20.733145+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:08:20.733145+0000","last_clean_scrub_stamp":"2024-09-14T11:08:20.733145+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":300,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:57:45.527676+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":11090148,"num_objects":12,"num_object_clones":0,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":0,"num_read":993,"num_read_kb":39840,"num_write":1268,"num_write_kb":27597,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,4],"acting":[3,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":533,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:58:42.823983+0000","last_change":"2024-09-14T11:08:25.799438+0000","last_active":"2024-09-14T12:58:42.823983+0000","last_peered":"2024-09-14T12:58:42.823983+0000","last_clean":"2024-09-14T12:58:42.823983+0000","last_became_active":"2024-09-14T11:08:25.798931+0000","last_became_peered":"2024-09-14T11:08:25.798931+0000","last_unstale":"2024-09-14T12:58:42.823983+0000","last_undegraded":"2024-09-14T12:58:42.823983+0000","last_fullsized":"2024-09-14T12:58:42.823983+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:08:24.757170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:08:24.757170+0000","last_clean_scrub_stamp":"2024-09-14T11:08:24.757170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:52:24.718713+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.e","version":"267'200","reported_seq":832,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:00:58.260088+0000","last_change":"2024-09-14T11:08:27.818990+0000","last_active":"2024-09-14T13:00:58.260088+0000","last_peered":"2024-09-14T13:00:58.260088+0000","last_clean":"2024-09-14T13:00:58.260088+0000","last_became_active":"2024-09-14T11:08:27.818219+0000","last_became_peered":"2024-09-14T11:08:27.818219+0000","last_unstale":"2024-09-14T13:00:58.260088+0000","last_undegraded":"2024-09-14T13:00:58.260088+0000","last_fullsized":"2024-09-14T13:00:58.260088+0000","mapping_epoch":30,"log_start":"264'100","ondisk_log_start":"264'100","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:08:26.771628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:08:26.771628+0000","last_clean_scrub_stamp":"2024-09-14T11:08:26.771628+0000","objects_scrubbed":0,"log_size":100,"log_dups_size":100,"ondisk_log_size":100,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:11:59.445867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10713,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":285,"num_read_kb":297,"num_write":216,"num_write_kb":85,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":526,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:59:13.248309+0000","last_change":"2024-09-14T11:08:29.824808+0000","last_active":"2024-09-14T12:59:13.248309+0000","last_peered":"2024-09-14T12:59:13.248309+0000","last_clean":"2024-09-14T12:59:13.248309+0000","last_became_active":"2024-09-14T11:08:29.824057+0000","last_became_peered":"2024-09-14T11:08:29.824057+0000","last_unstale":"2024-09-14T12:59:13.248309+0000","last_undegraded":"2024-09-14T12:59:13.248309+0000","last_fullsized":"2024-09-14T12:59:13.248309+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:08:28.783586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:08:28.783586+0000","last_clean_scrub_stamp":"2024-09-14T11:08:28.783586+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:42:11.422635+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.0","version":"267'127","reported_seq":651,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:00:53.493597+0000","last_change":"2024-09-14T11:08:31.845590+0000","last_active":"2024-09-14T13:00:53.493597+0000","last_peered":"2024-09-14T13:00:53.493597+0000","last_clean":"2024-09-14T13:00:53.493597+0000","last_became_active":"2024-09-14T11:08:31.844832+0000","last_became_peered":"2024-09-14T11:08:31.844832+0000","last_unstale":"2024-09-14T13:00:53.493597+0000","last_undegraded":"2024-09-14T13:00:53.493597+0000","last_fullsized":"2024-09-14T13:00:53.493597+0000","mapping_epoch":34,"log_start":"267'100","ondisk_log_start":"267'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:08:30.789404+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:08:30.789404+0000","last_clean_scrub_stamp":"2024-09-14T11:08:30.789404+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":100,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:04:19.552267+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":910,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":99,"num_read_kb":98,"num_write":310,"num_write_kb":70,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"267'807","reported_seq":2439,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:59:14.732420+0000","last_change":"2024-09-14T11:08:23.794254+0000","last_active":"2024-09-14T12:59:14.732420+0000","last_peered":"2024-09-14T12:59:14.732420+0000","last_clean":"2024-09-14T12:59:14.732420+0000","last_became_active":"2024-09-14T11:08:23.791966+0000","last_became_peered":"2024-09-14T11:08:23.791966+0000","last_unstale":"2024-09-14T12:59:14.732420+0000","last_undegraded":"2024-09-14T12:59:14.732420+0000","last_fullsized":"2024-09-14T12:59:14.732420+0000","mapping_epoch":26,"log_start":"267'700","ondisk_log_start":"267'700","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:08:22.750609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:08:22.750609+0000","last_clean_scrub_stamp":"2024-09-14T11:08:22.750609+0000","objects_scrubbed":0,"log_size":107,"log_dups_size":700,"ondisk_log_size":107,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:23:14.308345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3905,"num_read_kb":3535,"num_write":1083,"num_write_kb":396,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"267'229","reported_seq":904,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:59:13.433073+0000","last_change":"2024-09-14T11:08:21.836998+0000","last_active":"2024-09-14T12:59:13.433073+0000","last_peered":"2024-09-14T12:59:13.433073+0000","last_clean":"2024-09-14T12:59:13.433073+0000","last_became_active":"2024-09-14T11:08:21.836346+0000","last_became_peered":"2024-09-14T11:08:21.836346+0000","last_unstale":"2024-09-14T12:59:13.433073+0000","last_undegraded":"2024-09-14T12:59:13.433073+0000","last_fullsized":"2024-09-14T12:59:13.433073+0000","mapping_epoch":24,"log_start":"267'200","ondisk_log_start":"267'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:08:20.733145+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:08:20.733145+0000","last_clean_scrub_stamp":"2024-09-14T11:08:20.733145+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":200,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:01:21.741877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7321958,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":603,"num_read_kb":23439,"num_write":1078,"num_write_kb":33198,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,1],"acting":[6,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":527,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:58:43.461228+0000","last_change":"2024-09-14T11:08:25.807312+0000","last_active":"2024-09-14T12:58:43.461228+0000","last_peered":"2024-09-14T12:58:43.461228+0000","last_clean":"2024-09-14T12:58:43.461228+0000","last_became_active":"2024-09-14T11:08:25.806502+0000","last_became_peered":"2024-09-14T11:08:25.806502+0000","last_unstale":"2024-09-14T12:58:43.461228+0000","last_undegraded":"2024-09-14T12:58:43.461228+0000","last_fullsized":"2024-09-14T12:58:43.461228+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:08:24.757170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:08:24.757170+0000","last_clean_scrub_stamp":"2024-09-14T11:08:24.757170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:32:51.027233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.f","version":"267'236","reported_seq":894,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:01:32.858133+0000","last_change":"2024-09-14T11:08:27.819376+0000","last_active":"2024-09-14T13:01:32.858133+0000","last_peered":"2024-09-14T13:01:32.858133+0000","last_clean":"2024-09-14T13:01:32.858133+0000","last_became_active":"2024-09-14T11:08:27.817904+0000","last_became_peered":"2024-09-14T11:08:27.817904+0000","last_unstale":"2024-09-14T13:01:32.858133+0000","last_undegraded":"2024-09-14T13:01:32.858133+0000","last_fullsized":"2024-09-14T13:01:32.858133+0000","mapping_epoch":30,"log_start":"267'200","ondisk_log_start":"267'200","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:08:26.771628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:08:26.771628+0000","last_clean_scrub_stamp":"2024-09-14T11:08:26.771628+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":200,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:38:45.116571+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":13059,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":322,"num_read_kb":372,"num_write":190,"num_write_kb":20,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.e","version":"267'760","reported_seq":3232,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:01:40.720358+0000","last_change":"2024-09-14T11:08:29.818281+0000","last_active":"2024-09-14T13:01:40.720358+0000","last_peered":"2024-09-14T13:01:40.720358+0000","last_clean":"2024-09-14T13:01:40.720358+0000","last_became_active":"2024-09-14T11:08:29.817475+0000","last_became_peered":"2024-09-14T11:08:29.817475+0000","last_unstale":"2024-09-14T13:01:40.720358+0000","last_undegraded":"2024-09-14T13:01:40.720358+0000","last_fullsized":"2024-09-14T13:01:40.720358+0000","mapping_epoch":32,"log_start":"267'700","ondisk_log_start":"267'700","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:08:28.783586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:08:28.783586+0000","last_clean_scrub_stamp":"2024-09-14T11:08:28.783586+0000","objects_scrubbed":0,"log_size":60,"log_dups_size":700,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:02:09.839019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1","version":"267'130","reported_seq":668,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:00:15.977882+0000","last_change":"2024-09-14T11:08:31.848332+0000","last_active":"2024-09-14T13:00:15.977882+0000","last_peered":"2024-09-14T13:00:15.977882+0000","last_clean":"2024-09-14T13:00:15.977882+0000","last_became_active":"2024-09-14T11:08:31.847603+0000","last_became_peered":"2024-09-14T11:08:31.847603+0000","last_unstale":"2024-09-14T13:00:15.977882+0000","last_undegraded":"2024-09-14T13:00:15.977882+0000","last_fullsized":"2024-09-14T13:00:15.977882+0000","mapping_epoch":34,"log_start":"267'100","ondisk_log_start":"267'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:08:30.789404+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:08:30.789404+0000","last_clean_scrub_stamp":"2024-09-14T11:08:30.789404+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":100,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:48:10.041330+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1261,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":168,"num_read_kb":154,"num_write":334,"num_write_kb":78,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"267'385","reported_seq":1931,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:00:18.881431+0000","last_change":"2024-09-14T11:08:23.815282+0000","last_active":"2024-09-14T13:00:18.881431+0000","last_peered":"2024-09-14T13:00:18.881431+0000","last_clean":"2024-09-14T13:00:18.881431+0000","last_became_active":"2024-09-14T11:08:23.814578+0000","last_became_peered":"2024-09-14T11:08:23.814578+0000","last_unstale":"2024-09-14T13:00:18.881431+0000","last_undegraded":"2024-09-14T13:00:18.881431+0000","last_fullsized":"2024-09-14T13:00:18.881431+0000","mapping_epoch":26,"log_start":"267'300","ondisk_log_start":"267'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:08:22.750609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:08:22.750609+0000","last_clean_scrub_stamp":"2024-09-14T11:08:22.750609+0000","objects_scrubbed":0,"log_size":85,"log_dups_size":300,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:17:18.348356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2178,"num_read_kb":2072,"num_write":449,"num_write_kb":92,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.9","version":"267'202","reported_seq":858,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:58:53.231353+0000","last_change":"2024-09-14T11:08:21.831392+0000","last_active":"2024-09-14T12:58:53.231353+0000","last_peered":"2024-09-14T12:58:53.231353+0000","last_clean":"2024-09-14T12:58:53.231353+0000","last_became_active":"2024-09-14T11:08:21.824109+0000","last_became_peered":"2024-09-14T11:08:21.824109+0000","last_unstale":"2024-09-14T12:58:53.231353+0000","last_undegraded":"2024-09-14T12:58:53.231353+0000","last_fullsized":"2024-09-14T12:58:53.231353+0000","mapping_epoch":24,"log_start":"267'100","ondisk_log_start":"267'100","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:08:20.733145+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:08:20.733145+0000","last_clean_scrub_stamp":"2024-09-14T11:08:20.733145+0000","objects_scrubbed":0,"log_size":102,"log_dups_size":100,"ondisk_log_size":102,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:40:02.893514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7548026,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":548,"num_read_kb":13686,"num_write":955,"num_write_kb":41004,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,7],"acting":[4,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.f","version":"29'2","reported_seq":1473,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:01:40.269842+0000","last_change":"2024-09-14T11:08:25.815830+0000","last_active":"2024-09-14T13:01:40.269842+0000","last_peered":"2024-09-14T13:01:40.269842+0000","last_clean":"2024-09-14T13:01:40.269842+0000","last_became_active":"2024-09-14T11:08:25.815109+0000","last_became_peered":"2024-09-14T11:08:25.815109+0000","last_unstale":"2024-09-14T13:01:40.269842+0000","last_undegraded":"2024-09-14T13:01:40.269842+0000","last_fullsized":"2024-09-14T13:01:40.269842+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:08:24.757170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:08:24.757170+0000","last_clean_scrub_stamp":"2024-09-14T11:08:24.757170+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:31:30.285811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":942,"num_read_kb":942,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.c","version":"267'152","reported_seq":738,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:59:07.715136+0000","last_change":"2024-09-14T11:08:27.799995+0000","last_active":"2024-09-14T12:59:07.715136+0000","last_peered":"2024-09-14T12:59:07.715136+0000","last_clean":"2024-09-14T12:59:07.715136+0000","last_became_active":"2024-09-14T11:08:27.799244+0000","last_became_peered":"2024-09-14T11:08:27.799244+0000","last_unstale":"2024-09-14T12:59:07.715136+0000","last_undegraded":"2024-09-14T12:59:07.715136+0000","last_fullsized":"2024-09-14T12:59:07.715136+0000","mapping_epoch":30,"log_start":"267'100","ondisk_log_start":"267'100","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:08:26.771628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:08:26.771628+0000","last_clean_scrub_stamp":"2024-09-14T11:08:26.771628+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":100,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:30:47.475696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":184,"num_read_kb":178,"num_write":124,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.d","version":"267'766","reported_seq":3161,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:01:40.721294+0000","last_change":"2024-09-14T11:08:29.829055+0000","last_active":"2024-09-14T13:01:40.721294+0000","last_peered":"2024-09-14T13:01:40.721294+0000","last_clean":"2024-09-14T13:01:40.721294+0000","last_became_active":"2024-09-14T11:08:29.828249+0000","last_became_peered":"2024-09-14T11:08:29.828249+0000","last_unstale":"2024-09-14T13:01:40.721294+0000","last_undegraded":"2024-09-14T13:01:40.721294+0000","last_fullsized":"2024-09-14T13:01:40.721294+0000","mapping_epoch":32,"log_start":"267'701","ondisk_log_start":"267'701","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:08:28.783586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:08:28.783586+0000","last_clean_scrub_stamp":"2024-09-14T11:08:28.783586+0000","objects_scrubbed":0,"log_size":65,"log_dups_size":701,"ondisk_log_size":65,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:02:41.662311+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.2","version":"267'160","reported_seq":694,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:58:58.232642+0000","last_change":"2024-09-14T11:08:31.850208+0000","last_active":"2024-09-14T12:58:58.232642+0000","last_peered":"2024-09-14T12:58:58.232642+0000","last_clean":"2024-09-14T12:58:58.232642+0000","last_became_active":"2024-09-14T11:08:31.849463+0000","last_became_peered":"2024-09-14T11:08:31.849463+0000","last_unstale":"2024-09-14T12:58:58.232642+0000","last_undegraded":"2024-09-14T12:58:58.232642+0000","last_fullsized":"2024-09-14T12:58:58.232642+0000","mapping_epoch":34,"log_start":"267'100","ondisk_log_start":"267'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:08:30.789404+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:08:30.789404+0000","last_clean_scrub_stamp":"2024-09-14T11:08:30.789404+0000","objects_scrubbed":0,"log_size":60,"log_dups_size":100,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:42:03.964124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":154,"num_read_kb":144,"num_write":375,"num_write_kb":85,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"267'382","reported_seq":1872,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:00:21.259274+0000","last_change":"2024-09-14T11:08:23.783772+0000","last_active":"2024-09-14T13:00:21.259274+0000","last_peered":"2024-09-14T13:00:21.259274+0000","last_clean":"2024-09-14T13:00:21.259274+0000","last_became_active":"2024-09-14T11:08:23.783481+0000","last_became_peered":"2024-09-14T11:08:23.783481+0000","last_unstale":"2024-09-14T13:00:21.259274+0000","last_undegraded":"2024-09-14T13:00:21.259274+0000","last_fullsized":"2024-09-14T13:00:21.259274+0000","mapping_epoch":26,"log_start":"267'300","ondisk_log_start":"267'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:08:22.750609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:08:22.750609+0000","last_clean_scrub_stamp":"2024-09-14T11:08:22.750609+0000","objects_scrubbed":0,"log_size":82,"log_dups_size":300,"ondisk_log_size":82,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:20:59.558430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":2050,"num_read_kb":1948,"num_write":423,"num_write_kb":74,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"267'175","reported_seq":828,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:58:53.465094+0000","last_change":"2024-09-14T11:08:21.787051+0000","last_active":"2024-09-14T12:58:53.465094+0000","last_peered":"2024-09-14T12:58:53.465094+0000","last_clean":"2024-09-14T12:58:53.465094+0000","last_became_active":"2024-09-14T11:08:21.786611+0000","last_became_peered":"2024-09-14T11:08:21.786611+0000","last_unstale":"2024-09-14T12:58:53.465094+0000","last_undegraded":"2024-09-14T12:58:53.465094+0000","last_fullsized":"2024-09-14T12:58:53.465094+0000","mapping_epoch":24,"log_start":"267'100","ondisk_log_start":"267'100","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:08:20.733145+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:08:20.733145+0000","last_clean_scrub_stamp":"2024-09-14T11:08:20.733145+0000","objects_scrubbed":0,"log_size":75,"log_dups_size":100,"ondisk_log_size":75,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:20:16.450782+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3029091,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":448,"num_read_kb":66993,"num_write":848,"num_write_kb":21210,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7],"acting":[3,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":531,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:58:43.229298+0000","last_change":"2024-09-14T11:08:25.818495+0000","last_active":"2024-09-14T12:58:43.229298+0000","last_peered":"2024-09-14T12:58:43.229298+0000","last_clean":"2024-09-14T12:58:43.229298+0000","last_became_active":"2024-09-14T11:08:25.817491+0000","last_became_peered":"2024-09-14T11:08:25.817491+0000","last_unstale":"2024-09-14T12:58:43.229298+0000","last_undegraded":"2024-09-14T12:58:43.229298+0000","last_fullsized":"2024-09-14T12:58:43.229298+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:08:24.757170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:08:24.757170+0000","last_clean_scrub_stamp":"2024-09-14T11:08:24.757170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:04:21.111837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.d","version":"267'291","reported_seq":973,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:00:58.075026+0000","last_change":"2024-09-14T11:08:27.829834+0000","last_active":"2024-09-14T13:00:58.075026+0000","last_peered":"2024-09-14T13:00:58.075026+0000","last_clean":"2024-09-14T13:00:58.075026+0000","last_became_active":"2024-09-14T11:08:27.829060+0000","last_became_peered":"2024-09-14T11:08:27.829060+0000","last_unstale":"2024-09-14T13:00:58.075026+0000","last_undegraded":"2024-09-14T13:00:58.075026+0000","last_fullsized":"2024-09-14T13:00:58.075026+0000","mapping_epoch":30,"log_start":"267'200","ondisk_log_start":"267'200","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:08:26.771628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:08:26.771628+0000","last_clean_scrub_stamp":"2024-09-14T11:08:26.771628+0000","objects_scrubbed":0,"log_size":91,"log_dups_size":200,"ondisk_log_size":91,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:11:07.685536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":13264,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":404,"num_read_kb":421,"num_write":246,"num_write_kb":20,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":520,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:58:48.427540+0000","last_change":"2024-09-14T11:08:29.845124+0000","last_active":"2024-09-14T12:58:48.427540+0000","last_peered":"2024-09-14T12:58:48.427540+0000","last_clean":"2024-09-14T12:58:48.427540+0000","last_became_active":"2024-09-14T11:08:29.844374+0000","last_became_peered":"2024-09-14T11:08:29.844374+0000","last_unstale":"2024-09-14T12:58:48.427540+0000","last_undegraded":"2024-09-14T12:58:48.427540+0000","last_fullsized":"2024-09-14T12:58:48.427540+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:08:28.783586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:08:28.783586+0000","last_clean_scrub_stamp":"2024-09-14T11:08:28.783586+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:58:42.113010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.3","version":"267'105","reported_seq":628,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:00:21.230827+0000","last_change":"2024-09-14T11:08:31.836429+0000","last_active":"2024-09-14T13:00:21.230827+0000","last_peered":"2024-09-14T13:00:21.230827+0000","last_clean":"2024-09-14T13:00:21.230827+0000","last_became_active":"2024-09-14T11:08:31.835753+0000","last_became_peered":"2024-09-14T11:08:31.835753+0000","last_unstale":"2024-09-14T13:00:21.230827+0000","last_undegraded":"2024-09-14T13:00:21.230827+0000","last_fullsized":"2024-09-14T13:00:21.230827+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:08:30.789404+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:08:30.789404+0000","last_clean_scrub_stamp":"2024-09-14T11:08:30.789404+0000","objects_scrubbed":0,"log_size":105,"log_dups_size":0,"ondisk_log_size":105,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:10:45.802301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":24,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":102,"num_read_kb":102,"num_write":245,"num_write_kb":60,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"267'865","reported_seq":2543,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:59:13.433148+0000","last_change":"2024-09-14T11:08:23.807298+0000","last_active":"2024-09-14T12:59:13.433148+0000","last_peered":"2024-09-14T12:59:13.433148+0000","last_clean":"2024-09-14T12:59:13.433148+0000","last_became_active":"2024-09-14T11:08:23.806515+0000","last_became_peered":"2024-09-14T11:08:23.806515+0000","last_unstale":"2024-09-14T12:59:13.433148+0000","last_undegraded":"2024-09-14T12:59:13.433148+0000","last_fullsized":"2024-09-14T12:59:13.433148+0000","mapping_epoch":26,"log_start":"267'800","ondisk_log_start":"267'800","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:08:22.750609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:08:22.750609+0000","last_clean_scrub_stamp":"2024-09-14T11:08:22.750609+0000","objects_scrubbed":0,"log_size":65,"log_dups_size":800,"ondisk_log_size":65,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:53:43.658780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":4146,"num_read_kb":3734,"num_write":1154,"num_write_kb":420,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"15'72","reported_seq":654,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:58:42.834156+0000","last_change":"2024-09-14T11:08:03.882483+0000","last_active":"2024-09-14T12:58:42.834156+0000","last_peered":"2024-09-14T12:58:42.834156+0000","last_clean":"2024-09-14T12:58:42.834156+0000","last_became_active":"2024-09-14T11:08:03.877126+0000","last_became_peered":"2024-09-14T11:08:03.877126+0000","last_unstale":"2024-09-14T12:58:42.834156+0000","last_undegraded":"2024-09-14T12:58:42.834156+0000","last_fullsized":"2024-09-14T12:58:42.834156+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:08:02.835447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:08:02.835447+0000","last_clean_scrub_stamp":"2024-09-14T11:08:02.835447+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:04:38.793105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"18'1","reported_seq":561,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:58:38.043302+0000","last_change":"2024-09-14T11:08:10.932779+0000","last_active":"2024-09-14T12:58:38.043302+0000","last_peered":"2024-09-14T12:58:38.043302+0000","last_clean":"2024-09-14T12:58:38.043302+0000","last_became_active":"2024-09-14T11:08:08.902043+0000","last_became_peered":"2024-09-14T11:08:08.902043+0000","last_unstale":"2024-09-14T12:58:38.043302+0000","last_undegraded":"2024-09-14T12:58:38.043302+0000","last_fullsized":"2024-09-14T12:58:38.043302+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:08:07.870014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:08:07.870014+0000","last_clean_scrub_stamp":"2024-09-14T11:08:07.870014+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:04:35.417543+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0011624509999999999,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"267'371","reported_seq":1092,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:01:34.627751+0000","last_change":"2024-09-14T11:08:21.809930+0000","last_active":"2024-09-14T13:01:34.627751+0000","last_peered":"2024-09-14T13:01:34.627751+0000","last_clean":"2024-09-14T13:01:34.627751+0000","last_became_active":"2024-09-14T11:08:21.809523+0000","last_became_peered":"2024-09-14T11:08:21.809523+0000","last_unstale":"2024-09-14T13:01:34.627751+0000","last_undegraded":"2024-09-14T13:01:34.627751+0000","last_fullsized":"2024-09-14T13:01:34.627751+0000","mapping_epoch":24,"log_start":"267'300","ondisk_log_start":"267'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:08:20.733145+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:08:20.733145+0000","last_clean_scrub_stamp":"2024-09-14T11:08:20.733145+0000","objects_scrubbed":0,"log_size":71,"log_dups_size":300,"ondisk_log_size":71,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:35:38.345862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6537749,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":1021,"num_read_kb":10697,"num_write":1395,"num_write_kb":52429,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,6],"acting":[3,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":534,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:58:52.836590+0000","last_change":"2024-09-14T11:08:25.808691+0000","last_active":"2024-09-14T12:58:52.836590+0000","last_peered":"2024-09-14T12:58:52.836590+0000","last_clean":"2024-09-14T12:58:52.836590+0000","last_became_active":"2024-09-14T11:08:25.807851+0000","last_became_peered":"2024-09-14T11:08:25.807851+0000","last_unstale":"2024-09-14T12:58:52.836590+0000","last_undegraded":"2024-09-14T12:58:52.836590+0000","last_fullsized":"2024-09-14T12:58:52.836590+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:08:24.757170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:08:24.757170+0000","last_clean_scrub_stamp":"2024-09-14T11:08:24.757170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:56:51.066419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.7","version":"267'336","reported_seq":1074,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:01:40.592306+0000","last_change":"2024-09-14T11:08:27.834071+0000","last_active":"2024-09-14T13:01:40.592306+0000","last_peered":"2024-09-14T13:01:40.592306+0000","last_clean":"2024-09-14T13:01:40.592306+0000","last_became_active":"2024-09-14T11:08:27.829359+0000","last_became_peered":"2024-09-14T11:08:27.829359+0000","last_unstale":"2024-09-14T13:01:40.592306+0000","last_undegraded":"2024-09-14T13:01:40.592306+0000","last_fullsized":"2024-09-14T13:01:40.592306+0000","mapping_epoch":30,"log_start":"267'300","ondisk_log_start":"267'300","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:08:26.771628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:08:26.771628+0000","last_clean_scrub_stamp":"2024-09-14T11:08:26.771628+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":300,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:44:51.169189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":35130,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":624,"num_read_kb":810,"num_write":580,"num_write_kb":409,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":528,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:59:03.245682+0000","last_change":"2024-09-14T11:08:29.827169+0000","last_active":"2024-09-14T12:59:03.245682+0000","last_peered":"2024-09-14T12:59:03.245682+0000","last_clean":"2024-09-14T12:59:03.245682+0000","last_became_active":"2024-09-14T11:08:29.826367+0000","last_became_peered":"2024-09-14T11:08:29.826367+0000","last_unstale":"2024-09-14T12:59:03.245682+0000","last_undegraded":"2024-09-14T12:59:03.245682+0000","last_fullsized":"2024-09-14T12:59:03.245682+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:08:28.783586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:08:28.783586+0000","last_clean_scrub_stamp":"2024-09-14T11:08:28.783586+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:19:54.618304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.9","version":"267'212","reported_seq":968,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:00:21.334917+0000","last_change":"2024-09-14T11:08:31.849513+0000","last_active":"2024-09-14T13:00:21.334917+0000","last_peered":"2024-09-14T13:00:21.334917+0000","last_clean":"2024-09-14T13:00:21.334917+0000","last_became_active":"2024-09-14T11:08:31.848763+0000","last_became_peered":"2024-09-14T11:08:31.848763+0000","last_unstale":"2024-09-14T13:00:21.334917+0000","last_undegraded":"2024-09-14T13:00:21.334917+0000","last_fullsized":"2024-09-14T13:00:21.334917+0000","mapping_epoch":34,"log_start":"267'200","ondisk_log_start":"267'200","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:08:30.789404+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:08:30.789404+0000","last_clean_scrub_stamp":"2024-09-14T11:08:30.789404+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":200,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:22:19.969967+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":408,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":546,"num_read_kb":516,"num_write":465,"num_write_kb":130,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.6","version":"267'595","reported_seq":2273,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:58:58.244065+0000","last_change":"2024-09-14T11:08:23.776991+0000","last_active":"2024-09-14T12:58:58.244065+0000","last_peered":"2024-09-14T12:58:58.244065+0000","last_clean":"2024-09-14T12:58:58.244065+0000","last_became_active":"2024-09-14T11:08:23.776564+0000","last_became_peered":"2024-09-14T11:08:23.776564+0000","last_unstale":"2024-09-14T12:58:58.244065+0000","last_undegraded":"2024-09-14T12:58:58.244065+0000","last_fullsized":"2024-09-14T12:58:58.244065+0000","mapping_epoch":26,"log_start":"267'500","ondisk_log_start":"267'500","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:08:22.750609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:08:22.750609+0000","last_clean_scrub_stamp":"2024-09-14T11:08:22.750609+0000","objects_scrubbed":0,"log_size":95,"log_dups_size":500,"ondisk_log_size":95,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:02:21.308539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":3171,"num_read_kb":2898,"num_write":783,"num_write_kb":298,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":563,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:58:47.835277+0000","last_change":"2024-09-14T11:08:11.214664+0000","last_active":"2024-09-14T12:58:47.835277+0000","last_peered":"2024-09-14T12:58:47.835277+0000","last_clean":"2024-09-14T12:58:47.835277+0000","last_became_active":"2024-09-14T11:08:08.903386+0000","last_became_peered":"2024-09-14T11:08:08.903386+0000","last_unstale":"2024-09-14T12:58:47.835277+0000","last_undegraded":"2024-09-14T12:58:47.835277+0000","last_fullsized":"2024-09-14T12:58:47.835277+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:08:07.870014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:08:07.870014+0000","last_clean_scrub_stamp":"2024-09-14T11:08:07.870014+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:55:07.449307+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001192558,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"267'175","reported_seq":865,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:58:48.241117+0000","last_change":"2024-09-14T11:08:21.815829+0000","last_active":"2024-09-14T12:58:48.241117+0000","last_peered":"2024-09-14T12:58:48.241117+0000","last_clean":"2024-09-14T12:58:48.241117+0000","last_became_active":"2024-09-14T11:08:21.815453+0000","last_became_peered":"2024-09-14T11:08:21.815453+0000","last_unstale":"2024-09-14T12:58:48.241117+0000","last_undegraded":"2024-09-14T12:58:48.241117+0000","last_fullsized":"2024-09-14T12:58:48.241117+0000","mapping_epoch":24,"log_start":"267'100","ondisk_log_start":"267'100","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:08:20.733145+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:08:20.733145+0000","last_clean_scrub_stamp":"2024-09-14T11:08:20.733145+0000","objects_scrubbed":0,"log_size":75,"log_dups_size":100,"ondisk_log_size":75,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:34:32.758328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10512963,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":652,"num_read_kb":79122,"num_write":840,"num_write_kb":40267,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,3],"acting":[0,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":531,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:58:58.047972+0000","last_change":"2024-09-14T11:08:25.802329+0000","last_active":"2024-09-14T12:58:58.047972+0000","last_peered":"2024-09-14T12:58:58.047972+0000","last_clean":"2024-09-14T12:58:58.047972+0000","last_became_active":"2024-09-14T11:08:25.801580+0000","last_became_peered":"2024-09-14T11:08:25.801580+0000","last_unstale":"2024-09-14T12:58:58.047972+0000","last_undegraded":"2024-09-14T12:58:58.047972+0000","last_fullsized":"2024-09-14T12:58:58.047972+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:08:24.757170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:08:24.757170+0000","last_clean_scrub_stamp":"2024-09-14T11:08:24.757170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:41:07.671257+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.4","version":"267'1006","reported_seq":3348,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:01:40.709142+0000","last_change":"2024-09-14T11:08:27.825306+0000","last_active":"2024-09-14T13:01:40.709142+0000","last_peered":"2024-09-14T13:01:40.709142+0000","last_clean":"2024-09-14T13:01:40.709142+0000","last_became_active":"2024-09-14T11:08:27.824703+0000","last_became_peered":"2024-09-14T11:08:27.824703+0000","last_unstale":"2024-09-14T13:01:40.709142+0000","last_undegraded":"2024-09-14T13:01:40.709142+0000","last_fullsized":"2024-09-14T13:01:40.709142+0000","mapping_epoch":30,"log_start":"267'901","ondisk_log_start":"267'901","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:08:26.771628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:08:26.771628+0000","last_clean_scrub_stamp":"2024-09-14T11:08:26.771628+0000","objects_scrubbed":0,"log_size":105,"log_dups_size":901,"ondisk_log_size":105,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:45:52.681555+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":30281,"num_objects":12,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":0,"num_read":1335,"num_read_kb":1419,"num_write":488,"num_write_kb":251,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":526,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:59:32.846140+0000","last_change":"2024-09-14T11:08:29.837085+0000","last_active":"2024-09-14T12:59:32.846140+0000","last_peered":"2024-09-14T12:59:32.846140+0000","last_clean":"2024-09-14T12:59:32.846140+0000","last_became_active":"2024-09-14T11:08:29.836253+0000","last_became_peered":"2024-09-14T11:08:29.836253+0000","last_unstale":"2024-09-14T12:59:32.846140+0000","last_undegraded":"2024-09-14T12:59:32.846140+0000","last_fullsized":"2024-09-14T12:59:32.846140+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:08:28.783586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:08:28.783586+0000","last_clean_scrub_stamp":"2024-09-14T11:08:28.783586+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:19:31.677337+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.a","version":"267'224","reported_seq":783,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:59:18.468936+0000","last_change":"2024-09-14T11:08:31.836526+0000","last_active":"2024-09-14T12:59:18.468936+0000","last_peered":"2024-09-14T12:59:18.468936+0000","last_clean":"2024-09-14T12:59:18.468936+0000","last_became_active":"2024-09-14T11:08:31.835700+0000","last_became_peered":"2024-09-14T11:08:31.835700+0000","last_unstale":"2024-09-14T12:59:18.468936+0000","last_undegraded":"2024-09-14T12:59:18.468936+0000","last_fullsized":"2024-09-14T12:59:18.468936+0000","mapping_epoch":34,"log_start":"267'200","ondisk_log_start":"267'200","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:08:30.789404+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:08:30.789404+0000","last_clean_scrub_stamp":"2024-09-14T11:08:30.789404+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":200,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:45:49.838871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":435,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":369,"num_read_kb":358,"num_write":505,"num_write_kb":147,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"267'413","reported_seq":2031,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:00:21.260118+0000","last_change":"2024-09-14T11:09:57.243473+0000","last_active":"2024-09-14T13:00:21.260118+0000","last_peered":"2024-09-14T13:00:21.260118+0000","last_clean":"2024-09-14T13:00:21.260118+0000","last_became_active":"2024-09-14T11:09:57.243168+0000","last_became_peered":"2024-09-14T11:09:57.243168+0000","last_unstale":"2024-09-14T13:00:21.260118+0000","last_undegraded":"2024-09-14T13:00:21.260118+0000","last_fullsized":"2024-09-14T13:00:21.260118+0000","mapping_epoch":39,"log_start":"267'400","ondisk_log_start":"267'400","created":26,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:08:22.750609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:08:22.750609+0000","last_clean_scrub_stamp":"2024-09-14T11:08:22.750609+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":400,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:03:03.902658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2397,"num_read_kb":2278,"num_write":464,"num_write_kb":90,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":564,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:58:37.822791+0000","last_change":"2024-09-14T11:08:10.911966+0000","last_active":"2024-09-14T12:58:37.822791+0000","last_peered":"2024-09-14T12:58:37.822791+0000","last_clean":"2024-09-14T12:58:37.822791+0000","last_became_active":"2024-09-14T11:08:08.957848+0000","last_became_peered":"2024-09-14T11:08:08.957848+0000","last_unstale":"2024-09-14T12:58:37.822791+0000","last_undegraded":"2024-09-14T12:58:37.822791+0000","last_fullsized":"2024-09-14T12:58:37.822791+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:08:07.870014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:08:07.870014+0000","last_clean_scrub_stamp":"2024-09-14T11:08:07.870014+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:21:50.090415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001143142,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"267'230","reported_seq":913,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:58:38.459976+0000","last_change":"2024-09-14T11:08:21.817844+0000","last_active":"2024-09-14T12:58:38.459976+0000","last_peered":"2024-09-14T12:58:38.459976+0000","last_clean":"2024-09-14T12:58:38.459976+0000","last_became_active":"2024-09-14T11:08:21.817523+0000","last_became_peered":"2024-09-14T11:08:21.817523+0000","last_unstale":"2024-09-14T12:58:38.459976+0000","last_undegraded":"2024-09-14T12:58:38.459976+0000","last_fullsized":"2024-09-14T12:58:38.459976+0000","mapping_epoch":24,"log_start":"267'200","ondisk_log_start":"267'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:08:20.733145+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:08:20.733145+0000","last_clean_scrub_stamp":"2024-09-14T11:08:20.733145+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":200,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:40:59.452110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12940502,"num_objects":9,"num_object_clones":0,"num_object_copies":27,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":624,"num_read_kb":70142,"num_write":1040,"num_write_kb":36042,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,6],"acting":[1,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.6","version":"29'1","reported_seq":536,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:58:57.827977+0000","last_change":"2024-09-14T11:08:25.807394+0000","last_active":"2024-09-14T12:58:57.827977+0000","last_peered":"2024-09-14T12:58:57.827977+0000","last_clean":"2024-09-14T12:58:57.827977+0000","last_became_active":"2024-09-14T11:08:25.807070+0000","last_became_peered":"2024-09-14T11:08:25.807070+0000","last_unstale":"2024-09-14T12:58:57.827977+0000","last_undegraded":"2024-09-14T12:58:57.827977+0000","last_fullsized":"2024-09-14T12:58:57.827977+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:08:24.757170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:08:24.757170+0000","last_clean_scrub_stamp":"2024-09-14T11:08:24.757170+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:08:45.157565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.5","version":"267'402","reported_seq":2364,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:01:40.687724+0000","last_change":"2024-09-14T11:08:27.831350+0000","last_active":"2024-09-14T13:01:40.687724+0000","last_peered":"2024-09-14T13:01:40.687724+0000","last_clean":"2024-09-14T13:01:40.687724+0000","last_became_active":"2024-09-14T11:08:27.830644+0000","last_became_peered":"2024-09-14T11:08:27.830644+0000","last_unstale":"2024-09-14T13:01:40.687724+0000","last_undegraded":"2024-09-14T13:01:40.687724+0000","last_fullsized":"2024-09-14T13:01:40.687724+0000","mapping_epoch":30,"log_start":"267'300","ondisk_log_start":"267'300","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:08:26.771628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:08:26.771628+0000","last_clean_scrub_stamp":"2024-09-14T11:08:26.771628+0000","objects_scrubbed":0,"log_size":102,"log_dups_size":300,"ondisk_log_size":102,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:05:03.898449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":154,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":380,"num_read_kb":368,"num_write":375,"num_write_kb":193,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":530,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:58:58.243958+0000","last_change":"2024-09-14T11:08:29.802462+0000","last_active":"2024-09-14T12:58:58.243958+0000","last_peered":"2024-09-14T12:58:58.243958+0000","last_clean":"2024-09-14T12:58:58.243958+0000","last_became_active":"2024-09-14T11:08:29.801661+0000","last_became_peered":"2024-09-14T11:08:29.801661+0000","last_unstale":"2024-09-14T12:58:58.243958+0000","last_undegraded":"2024-09-14T12:58:58.243958+0000","last_fullsized":"2024-09-14T12:58:58.243958+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:08:28.783586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:08:28.783586+0000","last_clean_scrub_stamp":"2024-09-14T11:08:28.783586+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:32:48.426887+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.b","version":"267'248","reported_seq":876,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:00:21.845348+0000","last_change":"2024-09-14T11:08:31.842253+0000","last_active":"2024-09-14T13:00:21.845348+0000","last_peered":"2024-09-14T13:00:21.845348+0000","last_clean":"2024-09-14T13:00:21.845348+0000","last_became_active":"2024-09-14T11:08:31.841552+0000","last_became_peered":"2024-09-14T11:08:31.841552+0000","last_unstale":"2024-09-14T13:00:21.845348+0000","last_undegraded":"2024-09-14T13:00:21.845348+0000","last_fullsized":"2024-09-14T13:00:21.845348+0000","mapping_epoch":34,"log_start":"267'200","ondisk_log_start":"267'200","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:08:30.789404+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:08:30.789404+0000","last_clean_scrub_stamp":"2024-09-14T11:08:30.789404+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":200,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:30:40.287699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":202,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":474,"num_read_kb":499,"num_write":548,"num_write_kb":158,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"267'1115","reported_seq":2640,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:01:39.340538+0000","last_change":"2024-09-14T11:08:23.777840+0000","last_active":"2024-09-14T13:01:39.340538+0000","last_peered":"2024-09-14T13:01:39.340538+0000","last_clean":"2024-09-14T13:01:39.340538+0000","last_became_active":"2024-09-14T11:08:23.777511+0000","last_became_peered":"2024-09-14T11:08:23.777511+0000","last_unstale":"2024-09-14T13:01:39.340538+0000","last_undegraded":"2024-09-14T13:01:39.340538+0000","last_fullsized":"2024-09-14T13:01:39.340538+0000","mapping_epoch":26,"log_start":"267'1100","ondisk_log_start":"267'1100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:08:22.750609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:08:22.750609+0000","last_clean_scrub_stamp":"2024-09-14T11:08:22.750609+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":1100,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:04:58.735646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5086,"num_read_kb":4484,"num_write":1533,"num_write_kb":642,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"20'2","reported_seq":562,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:58:38.043188+0000","last_change":"2024-09-14T11:08:10.933870+0000","last_active":"2024-09-14T12:58:38.043188+0000","last_peered":"2024-09-14T12:58:38.043188+0000","last_clean":"2024-09-14T12:58:38.043188+0000","last_became_active":"2024-09-14T11:08:08.903062+0000","last_became_peered":"2024-09-14T11:08:08.903062+0000","last_unstale":"2024-09-14T12:58:38.043188+0000","last_undegraded":"2024-09-14T12:58:38.043188+0000","last_fullsized":"2024-09-14T12:58:38.043188+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:08:07.870014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:08:07.870014+0000","last_clean_scrub_stamp":"2024-09-14T11:08:07.870014+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:50:59.568798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0022728420000000002,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"267'175","reported_seq":862,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:58:48.230287+0000","last_change":"2024-09-14T11:08:21.830653+0000","last_active":"2024-09-14T12:58:48.230287+0000","last_peered":"2024-09-14T12:58:48.230287+0000","last_clean":"2024-09-14T12:58:48.230287+0000","last_became_active":"2024-09-14T11:08:21.823121+0000","last_became_peered":"2024-09-14T11:08:21.823121+0000","last_unstale":"2024-09-14T12:58:48.230287+0000","last_undegraded":"2024-09-14T12:58:48.230287+0000","last_fullsized":"2024-09-14T12:58:48.230287+0000","mapping_epoch":24,"log_start":"267'100","ondisk_log_start":"267'100","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:08:20.733145+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:08:20.733145+0000","last_clean_scrub_stamp":"2024-09-14T11:08:20.733145+0000","objects_scrubbed":0,"log_size":75,"log_dups_size":100,"ondisk_log_size":75,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:49:22.239894+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8336652,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":551,"num_read_kb":32204,"num_write":875,"num_write_kb":26671,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,0],"acting":[4,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":538,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:59:18.249303+0000","last_change":"2024-09-14T11:08:25.797249+0000","last_active":"2024-09-14T12:59:18.249303+0000","last_peered":"2024-09-14T12:59:18.249303+0000","last_clean":"2024-09-14T12:59:18.249303+0000","last_became_active":"2024-09-14T11:08:25.796526+0000","last_became_peered":"2024-09-14T11:08:25.796526+0000","last_unstale":"2024-09-14T12:59:18.249303+0000","last_undegraded":"2024-09-14T12:59:18.249303+0000","last_fullsized":"2024-09-14T12:59:18.249303+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:08:24.757170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:08:24.757170+0000","last_clean_scrub_stamp":"2024-09-14T11:08:24.757170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:18:24.235208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.6","version":"267'234","reported_seq":849,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:01:28.385849+0000","last_change":"2024-09-14T11:08:27.819232+0000","last_active":"2024-09-14T13:01:28.385849+0000","last_peered":"2024-09-14T13:01:28.385849+0000","last_clean":"2024-09-14T13:01:28.385849+0000","last_became_active":"2024-09-14T11:08:27.818482+0000","last_became_peered":"2024-09-14T11:08:27.818482+0000","last_unstale":"2024-09-14T13:01:28.385849+0000","last_undegraded":"2024-09-14T13:01:28.385849+0000","last_fullsized":"2024-09-14T13:01:28.385849+0000","mapping_epoch":30,"log_start":"267'200","ondisk_log_start":"267'200","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:08:26.771628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:08:26.771628+0000","last_clean_scrub_stamp":"2024-09-14T11:08:26.771628+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":200,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:12:06.477100+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":286,"num_read_kb":275,"num_write":214,"num_write_kb":24,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":522,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:59:03.430911+0000","last_change":"2024-09-14T11:08:29.839536+0000","last_active":"2024-09-14T12:59:03.430911+0000","last_peered":"2024-09-14T12:59:03.430911+0000","last_clean":"2024-09-14T12:59:03.430911+0000","last_became_active":"2024-09-14T11:08:29.837840+0000","last_became_peered":"2024-09-14T11:08:29.837840+0000","last_unstale":"2024-09-14T12:59:03.430911+0000","last_undegraded":"2024-09-14T12:59:03.430911+0000","last_fullsized":"2024-09-14T12:59:03.430911+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:08:28.783586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:08:28.783586+0000","last_clean_scrub_stamp":"2024-09-14T11:08:28.783586+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:39:33.744929+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.8","version":"267'111","reported_seq":687,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:00:18.844178+0000","last_change":"2024-09-14T11:08:31.852081+0000","last_active":"2024-09-14T13:00:18.844178+0000","last_peered":"2024-09-14T13:00:18.844178+0000","last_clean":"2024-09-14T13:00:18.844178+0000","last_became_active":"2024-09-14T11:08:31.851269+0000","last_became_peered":"2024-09-14T11:08:31.851269+0000","last_unstale":"2024-09-14T13:00:18.844178+0000","last_undegraded":"2024-09-14T13:00:18.844178+0000","last_fullsized":"2024-09-14T13:00:18.844178+0000","mapping_epoch":34,"log_start":"267'100","ondisk_log_start":"267'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:08:30.789404+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:08:30.789404+0000","last_clean_scrub_stamp":"2024-09-14T11:08:30.789404+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":100,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:52:29.862548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":188,"num_read_kb":187,"num_write":249,"num_write_kb":58,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"267'517","reported_seq":2228,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:00:18.884304+0000","last_change":"2024-09-14T11:08:23.794201+0000","last_active":"2024-09-14T13:00:18.884304+0000","last_peered":"2024-09-14T13:00:18.884304+0000","last_clean":"2024-09-14T13:00:18.884304+0000","last_became_active":"2024-09-14T11:08:23.793860+0000","last_became_peered":"2024-09-14T11:08:23.793860+0000","last_unstale":"2024-09-14T13:00:18.884304+0000","last_undegraded":"2024-09-14T13:00:18.884304+0000","last_fullsized":"2024-09-14T13:00:18.884304+0000","mapping_epoch":26,"log_start":"267'500","ondisk_log_start":"267'500","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:08:22.750609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:08:22.750609+0000","last_clean_scrub_stamp":"2024-09-14T11:08:22.750609+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":500,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:09:26.531607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3013,"num_read_kb":2819,"num_write":641,"num_write_kb":178,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"267'194","reported_seq":873,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:59:18.052260+0000","last_change":"2024-09-14T11:08:21.792555+0000","last_active":"2024-09-14T12:59:18.052260+0000","last_peered":"2024-09-14T12:59:18.052260+0000","last_clean":"2024-09-14T12:59:18.052260+0000","last_became_active":"2024-09-14T11:08:21.791679+0000","last_became_peered":"2024-09-14T11:08:21.791679+0000","last_unstale":"2024-09-14T12:59:18.052260+0000","last_undegraded":"2024-09-14T12:59:18.052260+0000","last_fullsized":"2024-09-14T12:59:18.052260+0000","mapping_epoch":24,"log_start":"267'100","ondisk_log_start":"267'100","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:08:20.733145+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:08:20.733145+0000","last_clean_scrub_stamp":"2024-09-14T11:08:20.733145+0000","objects_scrubbed":0,"log_size":94,"log_dups_size":100,"ondisk_log_size":94,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:33:56.588522+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10547089,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":641,"num_read_kb":55282,"num_write":896,"num_write_kb":39262,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,2],"acting":[5,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":558,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:58:38.460088+0000","last_change":"2024-09-14T11:08:10.911600+0000","last_active":"2024-09-14T12:58:38.460088+0000","last_peered":"2024-09-14T12:58:38.460088+0000","last_clean":"2024-09-14T12:58:38.460088+0000","last_became_active":"2024-09-14T11:08:08.888921+0000","last_became_peered":"2024-09-14T11:08:08.888921+0000","last_unstale":"2024-09-14T12:58:38.460088+0000","last_undegraded":"2024-09-14T12:58:38.460088+0000","last_fullsized":"2024-09-14T12:58:38.460088+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:08:07.870014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:08:07.870014+0000","last_clean_scrub_stamp":"2024-09-14T11:08:07.870014+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:29:02.760571+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001198714,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":538,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:58:53.242581+0000","last_change":"2024-09-14T11:08:25.801820+0000","last_active":"2024-09-14T12:58:53.242581+0000","last_peered":"2024-09-14T12:58:53.242581+0000","last_clean":"2024-09-14T12:58:53.242581+0000","last_became_active":"2024-09-14T11:08:25.792863+0000","last_became_peered":"2024-09-14T11:08:25.792863+0000","last_unstale":"2024-09-14T12:58:53.242581+0000","last_undegraded":"2024-09-14T12:58:53.242581+0000","last_fullsized":"2024-09-14T12:58:53.242581+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:08:24.757170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:08:24.757170+0000","last_clean_scrub_stamp":"2024-09-14T11:08:24.757170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:55:17.257027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"267'454","reported_seq":1193,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:01:40.574099+0000","last_change":"2024-09-14T11:08:27.803952+0000","last_active":"2024-09-14T13:01:40.574099+0000","last_peered":"2024-09-14T13:01:40.574099+0000","last_clean":"2024-09-14T13:01:40.574099+0000","last_became_active":"2024-09-14T11:08:27.803324+0000","last_became_peered":"2024-09-14T11:08:27.803324+0000","last_unstale":"2024-09-14T13:01:40.574099+0000","last_undegraded":"2024-09-14T13:01:40.574099+0000","last_fullsized":"2024-09-14T13:01:40.574099+0000","mapping_epoch":30,"log_start":"267'400","ondisk_log_start":"267'400","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:08:26.771628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:08:26.771628+0000","last_clean_scrub_stamp":"2024-09-14T11:08:26.771628+0000","objects_scrubbed":0,"log_size":54,"log_dups_size":400,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:06:41.976461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":32596,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":1287,"num_read_kb":1421,"num_write":1882,"num_write_kb":1658,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":527,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:58:58.232580+0000","last_change":"2024-09-14T11:08:29.831130+0000","last_active":"2024-09-14T12:58:58.232580+0000","last_peered":"2024-09-14T12:58:58.232580+0000","last_clean":"2024-09-14T12:58:58.232580+0000","last_became_active":"2024-09-14T11:08:29.830303+0000","last_became_peered":"2024-09-14T11:08:29.830303+0000","last_unstale":"2024-09-14T12:58:58.232580+0000","last_undegraded":"2024-09-14T12:58:58.232580+0000","last_fullsized":"2024-09-14T12:58:58.232580+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:08:28.783586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:08:28.783586+0000","last_clean_scrub_stamp":"2024-09-14T11:08:28.783586+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:22:47.627433+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.e","version":"267'153","reported_seq":717,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:00:13.798032+0000","last_change":"2024-09-14T11:08:31.836009+0000","last_active":"2024-09-14T13:00:13.798032+0000","last_peered":"2024-09-14T13:00:13.798032+0000","last_clean":"2024-09-14T13:00:13.798032+0000","last_became_active":"2024-09-14T11:08:31.835335+0000","last_became_peered":"2024-09-14T11:08:31.835335+0000","last_unstale":"2024-09-14T13:00:13.798032+0000","last_undegraded":"2024-09-14T13:00:13.798032+0000","last_fullsized":"2024-09-14T13:00:13.798032+0000","mapping_epoch":34,"log_start":"267'100","ondisk_log_start":"267'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:08:30.789404+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:08:30.789404+0000","last_clean_scrub_stamp":"2024-09-14T11:08:30.789404+0000","objects_scrubbed":0,"log_size":53,"log_dups_size":100,"ondisk_log_size":53,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:46:41.088012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":736,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":226,"num_read_kb":194,"num_write":381,"num_write_kb":93,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"267'734","reported_seq":2282,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:58:53.242555+0000","last_change":"2024-09-14T11:08:23.792522+0000","last_active":"2024-09-14T12:58:53.242555+0000","last_peered":"2024-09-14T12:58:53.242555+0000","last_clean":"2024-09-14T12:58:53.242555+0000","last_became_active":"2024-09-14T11:08:23.792144+0000","last_became_peered":"2024-09-14T11:08:23.792144+0000","last_unstale":"2024-09-14T12:58:53.242555+0000","last_undegraded":"2024-09-14T12:58:53.242555+0000","last_fullsized":"2024-09-14T12:58:53.242555+0000","mapping_epoch":26,"log_start":"267'700","ondisk_log_start":"267'700","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:08:22.750609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:08:22.750609+0000","last_clean_scrub_stamp":"2024-09-14T11:08:22.750609+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":700,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:27:19.107022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":3573,"num_read_kb":3234,"num_write":954,"num_write_kb":344,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.4","version":"267'257","reported_seq":975,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:58:48.462398+0000","last_change":"2024-09-14T11:08:21.808706+0000","last_active":"2024-09-14T12:58:48.462398+0000","last_peered":"2024-09-14T12:58:48.462398+0000","last_clean":"2024-09-14T12:58:48.462398+0000","last_became_active":"2024-09-14T11:08:21.808278+0000","last_became_peered":"2024-09-14T11:08:21.808278+0000","last_unstale":"2024-09-14T12:58:48.462398+0000","last_undegraded":"2024-09-14T12:58:48.462398+0000","last_fullsized":"2024-09-14T12:58:48.462398+0000","mapping_epoch":24,"log_start":"267'200","ondisk_log_start":"267'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:08:20.733145+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:08:20.733145+0000","last_clean_scrub_stamp":"2024-09-14T11:08:20.733145+0000","objects_scrubbed":0,"log_size":57,"log_dups_size":200,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:56:37.903249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194409,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":847,"num_read_kb":29775,"num_write":1316,"num_write_kb":30049,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,6],"acting":[1,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":561,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:59:12.841357+0000","last_change":"2024-09-14T11:08:11.214796+0000","last_active":"2024-09-14T12:59:12.841357+0000","last_peered":"2024-09-14T12:59:12.841357+0000","last_clean":"2024-09-14T12:59:12.841357+0000","last_became_active":"2024-09-14T11:08:08.903905+0000","last_became_peered":"2024-09-14T11:08:08.903905+0000","last_unstale":"2024-09-14T12:59:12.841357+0000","last_undegraded":"2024-09-14T12:59:12.841357+0000","last_fullsized":"2024-09-14T12:59:12.841357+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:08:07.870014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:08:07.870014+0000","last_clean_scrub_stamp":"2024-09-14T11:08:07.870014+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:58:06.786050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001173377,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":532,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:58:53.428640+0000","last_change":"2024-09-14T11:08:25.801438+0000","last_active":"2024-09-14T12:58:53.428640+0000","last_peered":"2024-09-14T12:58:53.428640+0000","last_clean":"2024-09-14T12:58:53.428640+0000","last_became_active":"2024-09-14T11:08:25.800695+0000","last_became_peered":"2024-09-14T11:08:25.800695+0000","last_unstale":"2024-09-14T12:58:53.428640+0000","last_undegraded":"2024-09-14T12:58:53.428640+0000","last_fullsized":"2024-09-14T12:58:53.428640+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:08:24.757170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:08:24.757170+0000","last_clean_scrub_stamp":"2024-09-14T11:08:24.757170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:42:30.211985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1","version":"267'350","reported_seq":993,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:00:28.372671+0000","last_change":"2024-09-14T11:08:27.814544+0000","last_active":"2024-09-14T13:00:28.372671+0000","last_peered":"2024-09-14T13:00:28.372671+0000","last_clean":"2024-09-14T13:00:28.372671+0000","last_became_active":"2024-09-14T11:08:27.813857+0000","last_became_peered":"2024-09-14T11:08:27.813857+0000","last_unstale":"2024-09-14T13:00:28.372671+0000","last_undegraded":"2024-09-14T13:00:28.372671+0000","last_fullsized":"2024-09-14T13:00:28.372671+0000","mapping_epoch":30,"log_start":"267'300","ondisk_log_start":"267'300","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:08:26.771628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:08:26.771628+0000","last_clean_scrub_stamp":"2024-09-14T11:08:26.771628+0000","objects_scrubbed":0,"log_size":50,"log_dups_size":300,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:41:50.966231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":441,"num_read_kb":434,"num_write":426,"num_write_kb":202,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.0","version":"267'776","reported_seq":5194,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:01:40.713682+0000","last_change":"2024-09-14T11:08:29.824227+0000","last_active":"2024-09-14T13:01:40.713682+0000","last_peered":"2024-09-14T13:01:40.713682+0000","last_clean":"2024-09-14T13:01:40.713682+0000","last_became_active":"2024-09-14T11:08:29.823513+0000","last_became_peered":"2024-09-14T11:08:29.823513+0000","last_unstale":"2024-09-14T13:01:40.713682+0000","last_undegraded":"2024-09-14T13:01:40.713682+0000","last_fullsized":"2024-09-14T13:01:40.713682+0000","mapping_epoch":32,"log_start":"267'700","ondisk_log_start":"267'700","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:08:28.783586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:08:28.783586+0000","last_clean_scrub_stamp":"2024-09-14T11:08:28.783586+0000","objects_scrubbed":0,"log_size":76,"log_dups_size":700,"ondisk_log_size":76,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:12:27.111650+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.f","version":"267'148","reported_seq":702,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:01:23.499170+0000","last_change":"2024-09-14T11:08:31.831263+0000","last_active":"2024-09-14T13:01:23.499170+0000","last_peered":"2024-09-14T13:01:23.499170+0000","last_clean":"2024-09-14T13:01:23.499170+0000","last_became_active":"2024-09-14T11:08:31.825708+0000","last_became_peered":"2024-09-14T11:08:31.825708+0000","last_unstale":"2024-09-14T13:01:23.499170+0000","last_undegraded":"2024-09-14T13:01:23.499170+0000","last_fullsized":"2024-09-14T13:01:23.499170+0000","mapping_epoch":34,"log_start":"267'100","ondisk_log_start":"267'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:08:30.789404+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:08:30.789404+0000","last_clean_scrub_stamp":"2024-09-14T11:08:30.789404+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":100,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:10:09.371769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1096,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":219,"num_read_kb":197,"num_write":351,"num_write_kb":86,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"267'1021","reported_seq":2906,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:59:18.397637+0000","last_change":"2024-09-14T11:08:23.800778+0000","last_active":"2024-09-14T12:59:18.397637+0000","last_peered":"2024-09-14T12:59:18.397637+0000","last_clean":"2024-09-14T12:59:18.397637+0000","last_became_active":"2024-09-14T11:08:23.800388+0000","last_became_peered":"2024-09-14T11:08:23.800388+0000","last_unstale":"2024-09-14T12:59:18.397637+0000","last_undegraded":"2024-09-14T12:59:18.397637+0000","last_fullsized":"2024-09-14T12:59:18.397637+0000","mapping_epoch":26,"log_start":"267'1000","ondisk_log_start":"267'1000","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:08:22.750609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:08:22.750609+0000","last_clean_scrub_stamp":"2024-09-14T11:08:22.750609+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":1000,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:13:46.545106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":5094,"num_read_kb":4556,"num_write":1418,"num_write_kb":544,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.7","version":"267'184","reported_seq":826,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:58:53.465571+0000","last_change":"2024-09-14T11:08:21.798122+0000","last_active":"2024-09-14T12:58:53.465571+0000","last_peered":"2024-09-14T12:58:53.465571+0000","last_clean":"2024-09-14T12:58:53.465571+0000","last_became_active":"2024-09-14T11:08:21.797297+0000","last_became_peered":"2024-09-14T11:08:21.797297+0000","last_unstale":"2024-09-14T12:58:53.465571+0000","last_undegraded":"2024-09-14T12:58:53.465571+0000","last_fullsized":"2024-09-14T12:58:53.465571+0000","mapping_epoch":24,"log_start":"267'100","ondisk_log_start":"267'100","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:08:20.733145+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:08:20.733145+0000","last_clean_scrub_stamp":"2024-09-14T11:08:20.733145+0000","objects_scrubbed":0,"log_size":84,"log_dups_size":100,"ondisk_log_size":84,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:30:27.067493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":11093052,"num_objects":10,"num_object_clones":0,"num_object_copies":30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":468,"num_read_kb":20434,"num_write":849,"num_write_kb":40195,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,7],"acting":[3,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":556,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:58:43.461294+0000","last_change":"2024-09-14T11:08:10.911600+0000","last_active":"2024-09-14T12:58:43.461294+0000","last_peered":"2024-09-14T12:58:43.461294+0000","last_clean":"2024-09-14T12:58:43.461294+0000","last_became_active":"2024-09-14T11:08:08.891458+0000","last_became_peered":"2024-09-14T11:08:08.891458+0000","last_unstale":"2024-09-14T12:58:43.461294+0000","last_undegraded":"2024-09-14T12:58:43.461294+0000","last_fullsized":"2024-09-14T12:58:43.461294+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:08:07.870014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:08:07.870014+0000","last_clean_scrub_stamp":"2024-09-14T11:08:07.870014+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:05:05.170921+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0011468940000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":535,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:58:53.231411+0000","last_change":"2024-09-14T11:08:25.808446+0000","last_active":"2024-09-14T12:58:53.231411+0000","last_peered":"2024-09-14T12:58:53.231411+0000","last_clean":"2024-09-14T12:58:53.231411+0000","last_became_active":"2024-09-14T11:08:25.807555+0000","last_became_peered":"2024-09-14T11:08:25.807555+0000","last_unstale":"2024-09-14T12:58:53.231411+0000","last_undegraded":"2024-09-14T12:58:53.231411+0000","last_fullsized":"2024-09-14T12:58:53.231411+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:08:24.757170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:08:24.757170+0000","last_clean_scrub_stamp":"2024-09-14T11:08:24.757170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:45:14.993273+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.2","version":"267'172","reported_seq":779,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:59:08.517056+0000","last_change":"2024-09-14T11:08:27.826108+0000","last_active":"2024-09-14T12:59:08.517056+0000","last_peered":"2024-09-14T12:59:08.517056+0000","last_clean":"2024-09-14T12:59:08.517056+0000","last_became_active":"2024-09-14T11:08:27.825292+0000","last_became_peered":"2024-09-14T11:08:27.825292+0000","last_unstale":"2024-09-14T12:59:08.517056+0000","last_undegraded":"2024-09-14T12:59:08.517056+0000","last_fullsized":"2024-09-14T12:59:08.517056+0000","mapping_epoch":30,"log_start":"267'100","ondisk_log_start":"267'100","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:08:26.771628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:08:26.771628+0000","last_clean_scrub_stamp":"2024-09-14T11:08:26.771628+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":100,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:07:03.156677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":226,"num_read_kb":221,"num_write":150,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.3","version":"267'811","reported_seq":5530,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:01:40.724601+0000","last_change":"2024-09-14T11:08:29.826625+0000","last_active":"2024-09-14T13:01:40.724601+0000","last_peered":"2024-09-14T13:01:40.724601+0000","last_clean":"2024-09-14T13:01:40.724601+0000","last_became_active":"2024-09-14T11:08:29.824268+0000","last_became_peered":"2024-09-14T11:08:29.824268+0000","last_unstale":"2024-09-14T13:01:40.724601+0000","last_undegraded":"2024-09-14T13:01:40.724601+0000","last_fullsized":"2024-09-14T13:01:40.724601+0000","mapping_epoch":32,"log_start":"267'701","ondisk_log_start":"267'701","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:08:28.783586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:08:28.783586+0000","last_clean_scrub_stamp":"2024-09-14T11:08:28.783586+0000","objects_scrubbed":0,"log_size":110,"log_dups_size":701,"ondisk_log_size":110,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:53:34.571934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.c","version":"267'177","reported_seq":726,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:58:48.241226+0000","last_change":"2024-09-14T11:08:31.845141+0000","last_active":"2024-09-14T12:58:48.241226+0000","last_peered":"2024-09-14T12:58:48.241226+0000","last_clean":"2024-09-14T12:58:48.241226+0000","last_became_active":"2024-09-14T11:08:31.844329+0000","last_became_peered":"2024-09-14T11:08:31.844329+0000","last_unstale":"2024-09-14T12:58:48.241226+0000","last_undegraded":"2024-09-14T12:58:48.241226+0000","last_fullsized":"2024-09-14T12:58:48.241226+0000","mapping_epoch":34,"log_start":"267'100","ondisk_log_start":"267'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:08:30.789404+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:08:30.789404+0000","last_clean_scrub_stamp":"2024-09-14T11:08:30.789404+0000","objects_scrubbed":0,"log_size":77,"log_dups_size":100,"ondisk_log_size":77,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:04:50.705908+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":58,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":178,"num_read_kb":162,"num_write":419,"num_write_kb":126,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"267'732","reported_seq":2204,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:00:11.324270+0000","last_change":"2024-09-14T11:08:23.801660+0000","last_active":"2024-09-14T13:00:11.324270+0000","last_peered":"2024-09-14T13:00:11.324270+0000","last_clean":"2024-09-14T13:00:11.324270+0000","last_became_active":"2024-09-14T11:08:23.800918+0000","last_became_peered":"2024-09-14T11:08:23.800918+0000","last_unstale":"2024-09-14T13:00:11.324270+0000","last_undegraded":"2024-09-14T13:00:11.324270+0000","last_fullsized":"2024-09-14T13:00:11.324270+0000","mapping_epoch":26,"log_start":"267'700","ondisk_log_start":"267'700","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:08:22.750609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:08:22.750609+0000","last_clean_scrub_stamp":"2024-09-14T11:08:22.750609+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":700,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:49:04.627652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3552,"num_read_kb":3200,"num_write":979,"num_write_kb":380,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"267'258","reported_seq":958,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:01:33.607989+0000","last_change":"2024-09-14T11:08:56.035136+0000","last_active":"2024-09-14T13:01:33.607989+0000","last_peered":"2024-09-14T13:01:33.607989+0000","last_clean":"2024-09-14T13:01:33.607989+0000","last_became_active":"2024-09-14T11:08:56.034426+0000","last_became_peered":"2024-09-14T11:08:56.034426+0000","last_unstale":"2024-09-14T13:01:33.607989+0000","last_undegraded":"2024-09-14T13:01:33.607989+0000","last_fullsized":"2024-09-14T13:01:33.607989+0000","mapping_epoch":37,"log_start":"267'200","ondisk_log_start":"267'200","created":24,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:08:20.733145+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:08:20.733145+0000","last_clean_scrub_stamp":"2024-09-14T11:08:20.733145+0000","objects_scrubbed":0,"log_size":58,"log_dups_size":200,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:00:24.358863+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":13820112,"num_objects":13,"num_object_clones":0,"num_object_copies":39,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":13,"num_whiteouts":0,"num_read":730,"num_read_kb":100890,"num_write":1095,"num_write_kb":33821,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,4],"acting":[2,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":557,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:58:43.426370+0000","last_change":"2024-09-14T11:08:11.214692+0000","last_active":"2024-09-14T12:58:43.426370+0000","last_peered":"2024-09-14T12:58:43.426370+0000","last_clean":"2024-09-14T12:58:43.426370+0000","last_became_active":"2024-09-14T11:08:08.905736+0000","last_became_peered":"2024-09-14T11:08:08.905736+0000","last_unstale":"2024-09-14T12:58:43.426370+0000","last_undegraded":"2024-09-14T12:58:43.426370+0000","last_fullsized":"2024-09-14T12:58:43.426370+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:08:07.870014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:08:07.870014+0000","last_clean_scrub_stamp":"2024-09-14T11:08:07.870014+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:16:43.551707+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0012835290000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":535,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:58:48.463988+0000","last_change":"2024-09-14T11:08:25.803022+0000","last_active":"2024-09-14T12:58:48.463988+0000","last_peered":"2024-09-14T12:58:48.463988+0000","last_clean":"2024-09-14T12:58:48.463988+0000","last_became_active":"2024-09-14T11:08:25.801554+0000","last_became_peered":"2024-09-14T11:08:25.801554+0000","last_unstale":"2024-09-14T12:58:48.463988+0000","last_undegraded":"2024-09-14T12:58:48.463988+0000","last_fullsized":"2024-09-14T12:58:48.463988+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:08:24.757170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:08:24.757170+0000","last_clean_scrub_stamp":"2024-09-14T11:08:24.757170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:30:31.481284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"267'392","reported_seq":1169,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:01:40.563995+0000","last_change":"2024-09-14T11:08:27.836312+0000","last_active":"2024-09-14T13:01:40.563995+0000","last_peered":"2024-09-14T13:01:40.563995+0000","last_clean":"2024-09-14T13:01:40.563995+0000","last_became_active":"2024-09-14T11:08:27.831653+0000","last_became_peered":"2024-09-14T11:08:27.831653+0000","last_unstale":"2024-09-14T13:01:40.563995+0000","last_undegraded":"2024-09-14T13:01:40.563995+0000","last_fullsized":"2024-09-14T13:01:40.563995+0000","mapping_epoch":30,"log_start":"267'300","ondisk_log_start":"267'300","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:08:26.771628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:08:26.771628+0000","last_clean_scrub_stamp":"2024-09-14T11:08:26.771628+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":300,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:26:55.360414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":48790,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":583,"num_read_kb":815,"num_write":328,"num_write_kb":91,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":525,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:58:58.466673+0000","last_change":"2024-09-14T11:08:29.826424+0000","last_active":"2024-09-14T12:58:58.466673+0000","last_peered":"2024-09-14T12:58:58.466673+0000","last_clean":"2024-09-14T12:58:58.466673+0000","last_became_active":"2024-09-14T11:08:29.825186+0000","last_became_peered":"2024-09-14T11:08:29.825186+0000","last_unstale":"2024-09-14T12:58:58.466673+0000","last_undegraded":"2024-09-14T12:58:58.466673+0000","last_fullsized":"2024-09-14T12:58:58.466673+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:08:28.783586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:08:28.783586+0000","last_clean_scrub_stamp":"2024-09-14T11:08:28.783586+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:49:23.866313+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.d","version":"267'138","reported_seq":663,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:58:48.045619+0000","last_change":"2024-09-14T11:08:31.838408+0000","last_active":"2024-09-14T12:58:48.045619+0000","last_peered":"2024-09-14T12:58:48.045619+0000","last_clean":"2024-09-14T12:58:48.045619+0000","last_became_active":"2024-09-14T11:08:31.837649+0000","last_became_peered":"2024-09-14T11:08:31.837649+0000","last_unstale":"2024-09-14T12:58:48.045619+0000","last_undegraded":"2024-09-14T12:58:48.045619+0000","last_fullsized":"2024-09-14T12:58:48.045619+0000","mapping_epoch":34,"log_start":"267'100","ondisk_log_start":"267'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:08:30.789404+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:08:30.789404+0000","last_clean_scrub_stamp":"2024-09-14T11:08:30.789404+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":100,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:22:41.759152+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":204,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":124,"num_read_kb":124,"num_write":321,"num_write_kb":75,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.1f","version":"267'141","reported_seq":733,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:00:21.741622+0000","last_change":"2024-09-14T11:08:31.854083+0000","last_active":"2024-09-14T13:00:21.741622+0000","last_peered":"2024-09-14T13:00:21.741622+0000","last_clean":"2024-09-14T13:00:21.741622+0000","last_became_active":"2024-09-14T11:08:31.849681+0000","last_became_peered":"2024-09-14T11:08:31.849681+0000","last_unstale":"2024-09-14T13:00:21.741622+0000","last_undegraded":"2024-09-14T13:00:21.741622+0000","last_fullsized":"2024-09-14T13:00:21.741622+0000","mapping_epoch":34,"log_start":"267'100","ondisk_log_start":"267'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:08:30.789404+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:08:30.789404+0000","last_clean_scrub_stamp":"2024-09-14T11:08:30.789404+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":100,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:48:25.310770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":202,"num_read_kb":202,"num_write":327,"num_write_kb":74,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.13","version":"267'450","reported_seq":2149,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:00:11.323966+0000","last_change":"2024-09-14T11:08:23.807515+0000","last_active":"2024-09-14T13:00:11.323966+0000","last_peered":"2024-09-14T13:00:11.323966+0000","last_clean":"2024-09-14T13:00:11.323966+0000","last_became_active":"2024-09-14T11:08:23.806746+0000","last_became_peered":"2024-09-14T11:08:23.806746+0000","last_unstale":"2024-09-14T13:00:11.323966+0000","last_undegraded":"2024-09-14T13:00:11.323966+0000","last_fullsized":"2024-09-14T13:00:11.323966+0000","mapping_epoch":26,"log_start":"267'400","ondisk_log_start":"267'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:08:22.750609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:08:22.750609+0000","last_clean_scrub_stamp":"2024-09-14T11:08:22.750609+0000","objects_scrubbed":0,"log_size":50,"log_dups_size":400,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:59:49.178094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2482,"num_read_kb":2367,"num_write":499,"num_write_kb":86,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.14","version":"267'190","reported_seq":813,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:59:12.831154+0000","last_change":"2024-09-14T11:08:56.029416+0000","last_active":"2024-09-14T12:59:12.831154+0000","last_peered":"2024-09-14T12:59:12.831154+0000","last_clean":"2024-09-14T12:59:12.831154+0000","last_became_active":"2024-09-14T11:08:56.028924+0000","last_became_peered":"2024-09-14T11:08:56.028924+0000","last_unstale":"2024-09-14T12:59:12.831154+0000","last_undegraded":"2024-09-14T12:59:12.831154+0000","last_fullsized":"2024-09-14T12:59:12.831154+0000","mapping_epoch":37,"log_start":"267'100","ondisk_log_start":"267'100","created":24,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:08:20.733145+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:08:20.733145+0000","last_clean_scrub_stamp":"2024-09-14T11:08:20.733145+0000","objects_scrubbed":0,"log_size":90,"log_dups_size":100,"ondisk_log_size":90,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:13:29.739250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5594740,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":484,"num_read_kb":9162,"num_write":887,"num_write_kb":17219,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7,6],"acting":[2,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":525,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:58:08.453389+0000","last_change":"2024-09-14T11:08:25.807119+0000","last_active":"2024-09-14T12:58:08.453389+0000","last_peered":"2024-09-14T12:58:08.453389+0000","last_clean":"2024-09-14T12:58:08.453389+0000","last_became_active":"2024-09-14T11:08:25.806778+0000","last_became_peered":"2024-09-14T11:08:25.806778+0000","last_unstale":"2024-09-14T12:58:08.453389+0000","last_undegraded":"2024-09-14T12:58:08.453389+0000","last_fullsized":"2024-09-14T12:58:08.453389+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:08:24.757170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:08:24.757170+0000","last_clean_scrub_stamp":"2024-09-14T11:08:24.757170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:11:05.830604+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.11","version":"267'189","reported_seq":817,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:00:28.488041+0000","last_change":"2024-09-14T11:08:27.803446+0000","last_active":"2024-09-14T13:00:28.488041+0000","last_peered":"2024-09-14T13:00:28.488041+0000","last_clean":"2024-09-14T13:00:28.488041+0000","last_became_active":"2024-09-14T11:08:27.802742+0000","last_became_peered":"2024-09-14T11:08:27.802742+0000","last_unstale":"2024-09-14T13:00:28.488041+0000","last_undegraded":"2024-09-14T13:00:28.488041+0000","last_fullsized":"2024-09-14T13:00:28.488041+0000","mapping_epoch":30,"log_start":"264'100","ondisk_log_start":"264'100","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:08:26.771628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:08:26.771628+0000","last_clean_scrub_stamp":"2024-09-14T11:08:26.771628+0000","objects_scrubbed":0,"log_size":89,"log_dups_size":100,"ondisk_log_size":89,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:28:41.473997+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16980,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":257,"num_read_kb":338,"num_write":148,"num_write_kb":27,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":519,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:58:13.455830+0000","last_change":"2024-09-14T11:08:29.833602+0000","last_active":"2024-09-14T12:58:13.455830+0000","last_peered":"2024-09-14T12:58:13.455830+0000","last_clean":"2024-09-14T12:58:13.455830+0000","last_became_active":"2024-09-14T11:08:29.832866+0000","last_became_peered":"2024-09-14T11:08:29.832866+0000","last_unstale":"2024-09-14T12:58:13.455830+0000","last_undegraded":"2024-09-14T12:58:13.455830+0000","last_fullsized":"2024-09-14T12:58:13.455830+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:08:28.783586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:08:28.783586+0000","last_clean_scrub_stamp":"2024-09-14T11:08:28.783586+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:47:19.171157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1e","version":"267'153","reported_seq":732,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:00:21.213723+0000","last_change":"2024-09-14T11:08:31.838160+0000","last_active":"2024-09-14T13:00:21.213723+0000","last_peered":"2024-09-14T13:00:21.213723+0000","last_clean":"2024-09-14T13:00:21.213723+0000","last_became_active":"2024-09-14T11:08:31.837431+0000","last_became_peered":"2024-09-14T11:08:31.837431+0000","last_unstale":"2024-09-14T13:00:21.213723+0000","last_undegraded":"2024-09-14T13:00:21.213723+0000","last_fullsized":"2024-09-14T13:00:21.213723+0000","mapping_epoch":34,"log_start":"267'100","ondisk_log_start":"267'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:08:30.789404+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:08:30.789404+0000","last_clean_scrub_stamp":"2024-09-14T11:08:30.789404+0000","objects_scrubbed":0,"log_size":53,"log_dups_size":100,"ondisk_log_size":53,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:03:00.723612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":449,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":316,"num_read_kb":262,"num_write":344,"num_write_kb":81,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.12","version":"267'842","reported_seq":2487,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:00:18.885098+0000","last_change":"2024-09-14T11:08:23.805988+0000","last_active":"2024-09-14T13:00:18.885098+0000","last_peered":"2024-09-14T13:00:18.885098+0000","last_clean":"2024-09-14T13:00:18.885098+0000","last_became_active":"2024-09-14T11:08:23.805773+0000","last_became_peered":"2024-09-14T11:08:23.805773+0000","last_unstale":"2024-09-14T13:00:18.885098+0000","last_undegraded":"2024-09-14T13:00:18.885098+0000","last_fullsized":"2024-09-14T13:00:18.885098+0000","mapping_epoch":26,"log_start":"267'800","ondisk_log_start":"267'800","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:08:22.750609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:08:22.750609+0000","last_clean_scrub_stamp":"2024-09-14T11:08:22.750609+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":800,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:04:02.649234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":4345,"num_read_kb":3935,"num_write":1136,"num_write_kb":447,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"267'272","reported_seq":985,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:59:32.846092+0000","last_change":"2024-09-14T11:08:21.830655+0000","last_active":"2024-09-14T12:59:32.846092+0000","last_peered":"2024-09-14T12:59:32.846092+0000","last_clean":"2024-09-14T12:59:32.846092+0000","last_became_active":"2024-09-14T11:08:21.829412+0000","last_became_peered":"2024-09-14T11:08:21.829412+0000","last_unstale":"2024-09-14T12:59:32.846092+0000","last_undegraded":"2024-09-14T12:59:32.846092+0000","last_fullsized":"2024-09-14T12:59:32.846092+0000","mapping_epoch":24,"log_start":"267'200","ondisk_log_start":"267'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:08:20.733145+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:08:20.733145+0000","last_clean_scrub_stamp":"2024-09-14T11:08:20.733145+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":200,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:31:08.044755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":18530687,"num_objects":17,"num_object_clones":0,"num_object_copies":51,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":17,"num_whiteouts":0,"num_read":832,"num_read_kb":41720,"num_write":1207,"num_write_kb":52852,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,6],"acting":[7,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":527,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:58:08.454944+0000","last_change":"2024-09-14T11:08:25.800314+0000","last_active":"2024-09-14T12:58:08.454944+0000","last_peered":"2024-09-14T12:58:08.454944+0000","last_clean":"2024-09-14T12:58:08.454944+0000","last_became_active":"2024-09-14T11:08:25.799473+0000","last_became_peered":"2024-09-14T11:08:25.799473+0000","last_unstale":"2024-09-14T12:58:08.454944+0000","last_undegraded":"2024-09-14T12:58:08.454944+0000","last_fullsized":"2024-09-14T12:58:08.454944+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:08:24.757170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:08:24.757170+0000","last_clean_scrub_stamp":"2024-09-14T11:08:24.757170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:39:41.634975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"267'93","reported_seq":645,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:59:05.331375+0000","last_change":"2024-09-14T11:08:27.824140+0000","last_active":"2024-09-14T12:59:05.331375+0000","last_peered":"2024-09-14T12:59:05.331375+0000","last_clean":"2024-09-14T12:59:05.331375+0000","last_became_active":"2024-09-14T11:08:27.822933+0000","last_became_peered":"2024-09-14T11:08:27.822933+0000","last_unstale":"2024-09-14T12:59:05.331375+0000","last_undegraded":"2024-09-14T12:59:05.331375+0000","last_fullsized":"2024-09-14T12:59:05.331375+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:08:26.771628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:08:26.771628+0000","last_clean_scrub_stamp":"2024-09-14T11:08:26.771628+0000","objects_scrubbed":0,"log_size":93,"log_dups_size":0,"ondisk_log_size":93,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:18:09.511324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":83,"num_read_kb":77,"num_write":62,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":520,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:58:12.827302+0000","last_change":"2024-09-14T11:08:29.839496+0000","last_active":"2024-09-14T12:58:12.827302+0000","last_peered":"2024-09-14T12:58:12.827302+0000","last_clean":"2024-09-14T12:58:12.827302+0000","last_became_active":"2024-09-14T11:08:29.838784+0000","last_became_peered":"2024-09-14T11:08:29.838784+0000","last_unstale":"2024-09-14T12:58:12.827302+0000","last_undegraded":"2024-09-14T12:58:12.827302+0000","last_fullsized":"2024-09-14T12:58:12.827302+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:08:28.783586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:08:28.783586+0000","last_clean_scrub_stamp":"2024-09-14T11:08:28.783586+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:24:04.303207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1d","version":"267'173","reported_seq":722,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:00:18.909877+0000","last_change":"2024-09-14T11:08:31.835747+0000","last_active":"2024-09-14T13:00:18.909877+0000","last_peered":"2024-09-14T13:00:18.909877+0000","last_clean":"2024-09-14T13:00:18.909877+0000","last_became_active":"2024-09-14T11:08:31.835061+0000","last_became_peered":"2024-09-14T11:08:31.835061+0000","last_unstale":"2024-09-14T13:00:18.909877+0000","last_undegraded":"2024-09-14T13:00:18.909877+0000","last_fullsized":"2024-09-14T13:00:18.909877+0000","mapping_epoch":34,"log_start":"267'100","ondisk_log_start":"267'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:08:30.789404+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:08:30.789404+0000","last_clean_scrub_stamp":"2024-09-14T11:08:30.789404+0000","objects_scrubbed":0,"log_size":73,"log_dups_size":100,"ondisk_log_size":73,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:44:11.300438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":257,"num_read_kb":254,"num_write":377,"num_write_kb":108,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"267'371","reported_seq":1937,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:58:55.756948+0000","last_change":"2024-09-14T11:08:23.804035+0000","last_active":"2024-09-14T12:58:55.756948+0000","last_peered":"2024-09-14T12:58:55.756948+0000","last_clean":"2024-09-14T12:58:55.756948+0000","last_became_active":"2024-09-14T11:08:23.803793+0000","last_became_peered":"2024-09-14T11:08:23.803793+0000","last_unstale":"2024-09-14T12:58:55.756948+0000","last_undegraded":"2024-09-14T12:58:55.756948+0000","last_fullsized":"2024-09-14T12:58:55.756948+0000","mapping_epoch":26,"log_start":"267'300","ondisk_log_start":"267'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:08:22.750609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:08:22.750609+0000","last_clean_scrub_stamp":"2024-09-14T11:08:22.750609+0000","objects_scrubbed":0,"log_size":71,"log_dups_size":300,"ondisk_log_size":71,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:22:29.624328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":2158,"num_read_kb":2067,"num_write":426,"num_write_kb":77,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"267'195","reported_seq":845,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:59:33.055545+0000","last_change":"2024-09-14T11:08:21.797622+0000","last_active":"2024-09-14T12:59:33.055545+0000","last_peered":"2024-09-14T12:59:33.055545+0000","last_clean":"2024-09-14T12:59:33.055545+0000","last_became_active":"2024-09-14T11:08:21.796544+0000","last_became_peered":"2024-09-14T11:08:21.796544+0000","last_unstale":"2024-09-14T12:59:33.055545+0000","last_undegraded":"2024-09-14T12:59:33.055545+0000","last_fullsized":"2024-09-14T12:59:33.055545+0000","mapping_epoch":24,"log_start":"267'100","ondisk_log_start":"267'100","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:08:20.733145+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:08:20.733145+0000","last_clean_scrub_stamp":"2024-09-14T11:08:20.733145+0000","objects_scrubbed":0,"log_size":95,"log_dups_size":100,"ondisk_log_size":95,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:27:03.875493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":13958202,"num_objects":9,"num_object_clones":0,"num_object_copies":27,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":499,"num_read_kb":19523,"num_write":840,"num_write_kb":34711,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,1],"acting":[5,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":528,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:58:07.825909+0000","last_change":"2024-09-14T11:08:25.812807+0000","last_active":"2024-09-14T12:58:07.825909+0000","last_peered":"2024-09-14T12:58:07.825909+0000","last_clean":"2024-09-14T12:58:07.825909+0000","last_became_active":"2024-09-14T11:08:25.812065+0000","last_became_peered":"2024-09-14T11:08:25.812065+0000","last_unstale":"2024-09-14T12:58:07.825909+0000","last_undegraded":"2024-09-14T12:58:07.825909+0000","last_fullsized":"2024-09-14T12:58:07.825909+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:08:24.757170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:08:24.757170+0000","last_clean_scrub_stamp":"2024-09-14T11:08:24.757170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:55:26.884251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.13","version":"267'221","reported_seq":865,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:00:28.488111+0000","last_change":"2024-09-14T11:08:27.804649+0000","last_active":"2024-09-14T13:00:28.488111+0000","last_peered":"2024-09-14T13:00:28.488111+0000","last_clean":"2024-09-14T13:00:28.488111+0000","last_became_active":"2024-09-14T11:08:27.803857+0000","last_became_peered":"2024-09-14T11:08:27.803857+0000","last_unstale":"2024-09-14T13:00:28.488111+0000","last_undegraded":"2024-09-14T13:00:28.488111+0000","last_fullsized":"2024-09-14T13:00:28.488111+0000","mapping_epoch":30,"log_start":"267'200","ondisk_log_start":"267'200","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:08:26.771628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:08:26.771628+0000","last_clean_scrub_stamp":"2024-09-14T11:08:26.771628+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":200,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:04:38.254088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":26644,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":312,"num_read_kb":420,"num_write":186,"num_write_kb":45,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":518,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:58:13.419845+0000","last_change":"2024-09-14T11:08:29.831255+0000","last_active":"2024-09-14T12:58:13.419845+0000","last_peered":"2024-09-14T12:58:13.419845+0000","last_clean":"2024-09-14T12:58:13.419845+0000","last_became_active":"2024-09-14T11:08:29.830498+0000","last_became_peered":"2024-09-14T11:08:29.830498+0000","last_unstale":"2024-09-14T12:58:13.419845+0000","last_undegraded":"2024-09-14T12:58:13.419845+0000","last_fullsized":"2024-09-14T12:58:13.419845+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:08:28.783586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:08:28.783586+0000","last_clean_scrub_stamp":"2024-09-14T11:08:28.783586+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:03:30.379314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.1c","version":"267'123","reported_seq":663,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:00:18.860887+0000","last_change":"2024-09-14T11:08:31.830626+0000","last_active":"2024-09-14T13:00:18.860887+0000","last_peered":"2024-09-14T13:00:18.860887+0000","last_clean":"2024-09-14T13:00:18.860887+0000","last_became_active":"2024-09-14T11:08:31.829826+0000","last_became_peered":"2024-09-14T11:08:31.829826+0000","last_unstale":"2024-09-14T13:00:18.860887+0000","last_undegraded":"2024-09-14T13:00:18.860887+0000","last_fullsized":"2024-09-14T13:00:18.860887+0000","mapping_epoch":34,"log_start":"267'100","ondisk_log_start":"267'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:08:30.789404+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:08:30.789404+0000","last_clean_scrub_stamp":"2024-09-14T11:08:30.789404+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":100,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:25:54.911452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":861,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":146,"num_read_kb":140,"num_write":284,"num_write_kb":67,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"267'865","reported_seq":2531,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:59:18.397352+0000","last_change":"2024-09-14T11:08:23.781946+0000","last_active":"2024-09-14T12:59:18.397352+0000","last_peered":"2024-09-14T12:59:18.397352+0000","last_clean":"2024-09-14T12:59:18.397352+0000","last_became_active":"2024-09-14T11:08:23.781565+0000","last_became_peered":"2024-09-14T11:08:23.781565+0000","last_unstale":"2024-09-14T12:59:18.397352+0000","last_undegraded":"2024-09-14T12:59:18.397352+0000","last_fullsized":"2024-09-14T12:59:18.397352+0000","mapping_epoch":26,"log_start":"267'800","ondisk_log_start":"267'800","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:08:22.750609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:08:22.750609+0000","last_clean_scrub_stamp":"2024-09-14T11:08:22.750609+0000","objects_scrubbed":0,"log_size":65,"log_dups_size":800,"ondisk_log_size":65,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:59:20.533859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":4353,"num_read_kb":3923,"num_write":1159,"num_write_kb":442,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"267'270","reported_seq":947,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:59:33.252975+0000","last_change":"2024-09-14T11:08:21.781005+0000","last_active":"2024-09-14T12:59:33.252975+0000","last_peered":"2024-09-14T12:59:33.252975+0000","last_clean":"2024-09-14T12:59:33.252975+0000","last_became_active":"2024-09-14T11:08:21.780624+0000","last_became_peered":"2024-09-14T11:08:21.780624+0000","last_unstale":"2024-09-14T12:59:33.252975+0000","last_undegraded":"2024-09-14T12:59:33.252975+0000","last_fullsized":"2024-09-14T12:59:33.252975+0000","mapping_epoch":24,"log_start":"267'200","ondisk_log_start":"267'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:08:20.733145+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:08:20.733145+0000","last_clean_scrub_stamp":"2024-09-14T11:08:20.733145+0000","objects_scrubbed":0,"log_size":70,"log_dups_size":200,"ondisk_log_size":70,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:08:38.775663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9437199,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":684,"num_read_kb":19614,"num_write":1222,"num_write_kb":48256,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,3],"acting":[0,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":526,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:58:08.418774+0000","last_change":"2024-09-14T11:08:25.815688+0000","last_active":"2024-09-14T12:58:08.418774+0000","last_peered":"2024-09-14T12:58:08.418774+0000","last_clean":"2024-09-14T12:58:08.418774+0000","last_became_active":"2024-09-14T11:08:25.812705+0000","last_became_peered":"2024-09-14T11:08:25.812705+0000","last_unstale":"2024-09-14T12:58:08.418774+0000","last_undegraded":"2024-09-14T12:58:08.418774+0000","last_fullsized":"2024-09-14T12:58:08.418774+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:08:24.757170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:08:24.757170+0000","last_clean_scrub_stamp":"2024-09-14T11:08:24.757170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:14:07.091473+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.12","version":"267'165","reported_seq":782,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:00:27.858784+0000","last_change":"2024-09-14T11:08:27.828831+0000","last_active":"2024-09-14T13:00:27.858784+0000","last_peered":"2024-09-14T13:00:27.858784+0000","last_clean":"2024-09-14T13:00:27.858784+0000","last_became_active":"2024-09-14T11:08:27.828095+0000","last_became_peered":"2024-09-14T11:08:27.828095+0000","last_unstale":"2024-09-14T13:00:27.858784+0000","last_undegraded":"2024-09-14T13:00:27.858784+0000","last_fullsized":"2024-09-14T13:00:27.858784+0000","mapping_epoch":30,"log_start":"267'100","ondisk_log_start":"267'100","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:08:26.771628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:08:26.771628+0000","last_clean_scrub_stamp":"2024-09-14T11:08:26.771628+0000","objects_scrubbed":0,"log_size":65,"log_dups_size":100,"ondisk_log_size":65,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:20:07.611701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12385,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":216,"num_read_kb":264,"num_write":122,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":524,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:58:13.451397+0000","last_change":"2024-09-14T11:08:29.820892+0000","last_active":"2024-09-14T12:58:13.451397+0000","last_peered":"2024-09-14T12:58:13.451397+0000","last_clean":"2024-09-14T12:58:13.451397+0000","last_became_active":"2024-09-14T11:08:29.820211+0000","last_became_peered":"2024-09-14T11:08:29.820211+0000","last_unstale":"2024-09-14T12:58:13.451397+0000","last_undegraded":"2024-09-14T12:58:13.451397+0000","last_fullsized":"2024-09-14T12:58:13.451397+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:08:28.783586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:08:28.783586+0000","last_clean_scrub_stamp":"2024-09-14T11:08:28.783586+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:44:35.393022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"267'407","reported_seq":1915,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:58:53.428747+0000","last_change":"2024-09-14T11:08:23.812883+0000","last_active":"2024-09-14T12:58:53.428747+0000","last_peered":"2024-09-14T12:58:53.428747+0000","last_clean":"2024-09-14T12:58:53.428747+0000","last_became_active":"2024-09-14T11:08:23.812148+0000","last_became_peered":"2024-09-14T11:08:23.812148+0000","last_unstale":"2024-09-14T12:58:53.428747+0000","last_undegraded":"2024-09-14T12:58:53.428747+0000","last_fullsized":"2024-09-14T12:58:53.428747+0000","mapping_epoch":26,"log_start":"267'300","ondisk_log_start":"267'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:08:22.750609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:08:22.750609+0000","last_clean_scrub_stamp":"2024-09-14T11:08:22.750609+0000","objects_scrubbed":0,"log_size":107,"log_dups_size":300,"ondisk_log_size":107,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:08:40.793127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2189,"num_read_kb":2068,"num_write":470,"num_write_kb":97,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"267'245","reported_seq":1141,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:59:33.474826+0000","last_change":"2024-09-14T11:08:21.779317+0000","last_active":"2024-09-14T12:59:33.474826+0000","last_peered":"2024-09-14T12:59:33.474826+0000","last_clean":"2024-09-14T12:59:33.474826+0000","last_became_active":"2024-09-14T11:08:21.778733+0000","last_became_peered":"2024-09-14T11:08:21.778733+0000","last_unstale":"2024-09-14T12:59:33.474826+0000","last_undegraded":"2024-09-14T12:59:33.474826+0000","last_fullsized":"2024-09-14T12:59:33.474826+0000","mapping_epoch":24,"log_start":"267'200","ondisk_log_start":"267'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:08:20.733145+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:08:20.733145+0000","last_clean_scrub_stamp":"2024-09-14T11:08:20.733145+0000","objects_scrubbed":0,"log_size":45,"log_dups_size":200,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:00:30.423894+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1056249,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1355,"num_read_kb":10917,"num_write":1155,"num_write_kb":41642,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":540,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:58:53.242713+0000","last_change":"2024-09-14T11:08:25.800737+0000","last_active":"2024-09-14T12:58:53.242713+0000","last_peered":"2024-09-14T12:58:53.242713+0000","last_clean":"2024-09-14T12:58:53.242713+0000","last_became_active":"2024-09-14T11:08:25.799108+0000","last_became_peered":"2024-09-14T11:08:25.799108+0000","last_unstale":"2024-09-14T12:58:53.242713+0000","last_undegraded":"2024-09-14T12:58:53.242713+0000","last_fullsized":"2024-09-14T12:58:53.242713+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:08:24.757170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:08:24.757170+0000","last_clean_scrub_stamp":"2024-09-14T11:08:24.757170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:38:33.841462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1d","version":"267'244","reported_seq":911,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:01:40.556399+0000","last_change":"2024-09-14T11:08:27.831458+0000","last_active":"2024-09-14T13:01:40.556399+0000","last_peered":"2024-09-14T13:01:40.556399+0000","last_clean":"2024-09-14T13:01:40.556399+0000","last_became_active":"2024-09-14T11:08:27.830985+0000","last_became_peered":"2024-09-14T11:08:27.830985+0000","last_unstale":"2024-09-14T13:01:40.556399+0000","last_undegraded":"2024-09-14T13:01:40.556399+0000","last_fullsized":"2024-09-14T13:01:40.556399+0000","mapping_epoch":30,"log_start":"267'200","ondisk_log_start":"267'200","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:08:26.771628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:08:26.771628+0000","last_clean_scrub_stamp":"2024-09-14T11:08:26.771628+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":200,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:41:33.796426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":37874,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":369,"num_read_kb":532,"num_write":248,"num_write_kb":156,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":516,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:58:33.042183+0000","last_change":"2024-09-14T11:08:29.835460+0000","last_active":"2024-09-14T12:58:33.042183+0000","last_peered":"2024-09-14T12:58:33.042183+0000","last_clean":"2024-09-14T12:58:33.042183+0000","last_became_active":"2024-09-14T11:08:29.834723+0000","last_became_peered":"2024-09-14T11:08:29.834723+0000","last_unstale":"2024-09-14T12:58:33.042183+0000","last_undegraded":"2024-09-14T12:58:33.042183+0000","last_fullsized":"2024-09-14T12:58:33.042183+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:08:28.783586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:08:28.783586+0000","last_clean_scrub_stamp":"2024-09-14T11:08:28.783586+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:14:47.793017+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.13","version":"267'169","reported_seq":705,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:00:21.576865+0000","last_change":"2024-09-14T11:08:31.838236+0000","last_active":"2024-09-14T13:00:21.576865+0000","last_peered":"2024-09-14T13:00:21.576865+0000","last_clean":"2024-09-14T13:00:21.576865+0000","last_became_active":"2024-09-14T11:08:31.832337+0000","last_became_peered":"2024-09-14T11:08:31.832337+0000","last_unstale":"2024-09-14T13:00:21.576865+0000","last_undegraded":"2024-09-14T13:00:21.576865+0000","last_fullsized":"2024-09-14T13:00:21.576865+0000","mapping_epoch":34,"log_start":"267'100","ondisk_log_start":"267'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:08:30.789404+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:08:30.789404+0000","last_clean_scrub_stamp":"2024-09-14T11:08:30.789404+0000","objects_scrubbed":0,"log_size":69,"log_dups_size":100,"ondisk_log_size":69,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:59:18.877729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":643,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":222,"num_read_kb":226,"num_write":392,"num_write_kb":102,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"267'412","reported_seq":2030,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:00:18.882268+0000","last_change":"2024-09-14T11:08:23.800932+0000","last_active":"2024-09-14T13:00:18.882268+0000","last_peered":"2024-09-14T13:00:18.882268+0000","last_clean":"2024-09-14T13:00:18.882268+0000","last_became_active":"2024-09-14T11:08:23.800615+0000","last_became_peered":"2024-09-14T11:08:23.800615+0000","last_unstale":"2024-09-14T13:00:18.882268+0000","last_undegraded":"2024-09-14T13:00:18.882268+0000","last_fullsized":"2024-09-14T13:00:18.882268+0000","mapping_epoch":26,"log_start":"267'400","ondisk_log_start":"267'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:08:22.750609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:08:22.750609+0000","last_clean_scrub_stamp":"2024-09-14T11:08:22.750609+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":400,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:50:24.635644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2239,"num_read_kb":2142,"num_write":466,"num_write_kb":81,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"267'237","reported_seq":915,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:57:23.443592+0000","last_change":"2024-09-14T11:08:56.037070+0000","last_active":"2024-09-14T12:57:23.443592+0000","last_peered":"2024-09-14T12:57:23.443592+0000","last_clean":"2024-09-14T12:57:23.443592+0000","last_became_active":"2024-09-14T11:08:56.036673+0000","last_became_peered":"2024-09-14T11:08:56.036673+0000","last_unstale":"2024-09-14T12:57:23.443592+0000","last_undegraded":"2024-09-14T12:57:23.443592+0000","last_fullsized":"2024-09-14T12:57:23.443592+0000","mapping_epoch":37,"log_start":"267'200","ondisk_log_start":"267'200","created":24,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:08:20.733145+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:08:20.733145+0000","last_clean_scrub_stamp":"2024-09-14T11:08:20.733145+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":200,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:53:45.772203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":13956195,"num_objects":9,"num_object_clones":0,"num_object_copies":27,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":561,"num_read_kb":38876,"num_write":1046,"num_write_kb":52722,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,4],"acting":[1,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1f","version":"36'3","reported_seq":1007,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:01:40.257081+0000","last_change":"2024-09-14T11:08:25.812880+0000","last_active":"2024-09-14T13:01:40.257081+0000","last_peered":"2024-09-14T13:01:40.257081+0000","last_clean":"2024-09-14T13:01:40.257081+0000","last_became_active":"2024-09-14T11:08:25.812070+0000","last_became_peered":"2024-09-14T11:08:25.812070+0000","last_unstale":"2024-09-14T13:01:40.257081+0000","last_undegraded":"2024-09-14T13:01:40.257081+0000","last_fullsized":"2024-09-14T13:01:40.257081+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:08:24.757170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:08:24.757170+0000","last_clean_scrub_stamp":"2024-09-14T11:08:24.757170+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:17:44.680400+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":470,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":716,"num_read_kb":714,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1c","version":"267'278","reported_seq":928,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:00:57.866110+0000","last_change":"2024-09-14T11:08:27.839908+0000","last_active":"2024-09-14T13:00:57.866110+0000","last_peered":"2024-09-14T13:00:57.866110+0000","last_clean":"2024-09-14T13:00:57.866110+0000","last_became_active":"2024-09-14T11:08:27.839087+0000","last_became_peered":"2024-09-14T11:08:27.839087+0000","last_unstale":"2024-09-14T13:00:57.866110+0000","last_undegraded":"2024-09-14T13:00:57.866110+0000","last_fullsized":"2024-09-14T13:00:57.866110+0000","mapping_epoch":30,"log_start":"267'200","ondisk_log_start":"267'200","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:08:26.771628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:08:26.771628+0000","last_clean_scrub_stamp":"2024-09-14T11:08:26.771628+0000","objects_scrubbed":0,"log_size":78,"log_dups_size":200,"ondisk_log_size":78,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:00:36.558492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":105945,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":422,"num_read_kb":775,"num_write":312,"num_write_kb":214,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":514,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:58:33.459006+0000","last_change":"2024-09-14T11:08:29.829340+0000","last_active":"2024-09-14T12:58:33.459006+0000","last_peered":"2024-09-14T12:58:33.459006+0000","last_clean":"2024-09-14T12:58:33.459006+0000","last_became_active":"2024-09-14T11:08:29.828451+0000","last_became_peered":"2024-09-14T11:08:29.828451+0000","last_unstale":"2024-09-14T12:58:33.459006+0000","last_undegraded":"2024-09-14T12:58:33.459006+0000","last_fullsized":"2024-09-14T12:58:33.459006+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:08:28.783586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:08:28.783586+0000","last_clean_scrub_stamp":"2024-09-14T11:08:28.783586+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:33:41.255469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.12","version":"267'201","reported_seq":1100,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:00:21.559424+0000","last_change":"2024-09-14T11:08:31.855543+0000","last_active":"2024-09-14T13:00:21.559424+0000","last_peered":"2024-09-14T13:00:21.559424+0000","last_clean":"2024-09-14T13:00:21.559424+0000","last_became_active":"2024-09-14T11:08:31.854650+0000","last_became_peered":"2024-09-14T11:08:31.854650+0000","last_unstale":"2024-09-14T13:00:21.559424+0000","last_undegraded":"2024-09-14T13:00:21.559424+0000","last_fullsized":"2024-09-14T13:00:21.559424+0000","mapping_epoch":34,"log_start":"267'100","ondisk_log_start":"267'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:08:30.789404+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:08:30.789404+0000","last_clean_scrub_stamp":"2024-09-14T11:08:30.789404+0000","objects_scrubbed":0,"log_size":101,"log_dups_size":100,"ondisk_log_size":101,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:48:10.230125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1218,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":620,"num_read_kb":614,"num_write":555,"num_write_kb":141,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1d","version":"267'642","reported_seq":2438,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:00:21.249855+0000","last_change":"2024-09-14T11:08:23.779484+0000","last_active":"2024-09-14T13:00:21.249855+0000","last_peered":"2024-09-14T13:00:21.249855+0000","last_clean":"2024-09-14T13:00:21.249855+0000","last_became_active":"2024-09-14T11:08:23.779099+0000","last_became_peered":"2024-09-14T11:08:23.779099+0000","last_unstale":"2024-09-14T13:00:21.249855+0000","last_undegraded":"2024-09-14T13:00:21.249855+0000","last_fullsized":"2024-09-14T13:00:21.249855+0000","mapping_epoch":26,"log_start":"267'600","ondisk_log_start":"267'600","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:08:22.750609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:08:22.750609+0000","last_clean_scrub_stamp":"2024-09-14T11:08:22.750609+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":600,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:46:50.857933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3438,"num_read_kb":3161,"num_write":830,"num_write_kb":293,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"267'240","reported_seq":1020,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:58:23.224184+0000","last_change":"2024-09-14T11:08:21.824714+0000","last_active":"2024-09-14T12:58:23.224184+0000","last_peered":"2024-09-14T12:58:23.224184+0000","last_clean":"2024-09-14T12:58:23.224184+0000","last_became_active":"2024-09-14T11:08:21.822349+0000","last_became_peered":"2024-09-14T11:08:21.822349+0000","last_unstale":"2024-09-14T12:58:23.224184+0000","last_undegraded":"2024-09-14T12:58:23.224184+0000","last_fullsized":"2024-09-14T12:58:23.224184+0000","mapping_epoch":24,"log_start":"267'200","ondisk_log_start":"267'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:08:20.733145+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:08:20.733145+0000","last_clean_scrub_stamp":"2024-09-14T11:08:20.733145+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":200,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:37:27.709472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9045724,"num_objects":9,"num_object_clones":0,"num_object_copies":27,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":1326,"num_read_kb":40981,"num_write":1067,"num_write_kb":33045,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,5],"acting":[4,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":526,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:58:28.225640+0000","last_change":"2024-09-14T11:08:25.808861+0000","last_active":"2024-09-14T12:58:28.225640+0000","last_peered":"2024-09-14T12:58:28.225640+0000","last_clean":"2024-09-14T12:58:28.225640+0000","last_became_active":"2024-09-14T11:08:25.807820+0000","last_became_peered":"2024-09-14T11:08:25.807820+0000","last_unstale":"2024-09-14T12:58:28.225640+0000","last_undegraded":"2024-09-14T12:58:28.225640+0000","last_fullsized":"2024-09-14T12:58:28.225640+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:08:24.757170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:08:24.757170+0000","last_clean_scrub_stamp":"2024-09-14T11:08:24.757170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:21:06.537600+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1f","version":"267'197","reported_seq":832,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:00:58.494549+0000","last_change":"2024-09-14T11:08:27.799774+0000","last_active":"2024-09-14T13:00:58.494549+0000","last_peered":"2024-09-14T13:00:58.494549+0000","last_clean":"2024-09-14T13:00:58.494549+0000","last_became_active":"2024-09-14T11:08:27.799019+0000","last_became_peered":"2024-09-14T11:08:27.799019+0000","last_unstale":"2024-09-14T13:00:58.494549+0000","last_undegraded":"2024-09-14T13:00:58.494549+0000","last_fullsized":"2024-09-14T13:00:58.494549+0000","mapping_epoch":30,"log_start":"264'100","ondisk_log_start":"264'100","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:08:26.771628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:08:26.771628+0000","last_clean_scrub_stamp":"2024-09-14T11:08:26.771628+0000","objects_scrubbed":0,"log_size":97,"log_dups_size":100,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:29:21.400017+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":15034,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":258,"num_read_kb":328,"num_write":152,"num_write_kb":25,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":525,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:58:48.462484+0000","last_change":"2024-09-14T11:08:29.821376+0000","last_active":"2024-09-14T12:58:48.462484+0000","last_peered":"2024-09-14T12:58:48.462484+0000","last_clean":"2024-09-14T12:58:48.462484+0000","last_became_active":"2024-09-14T11:08:29.820658+0000","last_became_peered":"2024-09-14T11:08:29.820658+0000","last_unstale":"2024-09-14T12:58:48.462484+0000","last_undegraded":"2024-09-14T12:58:48.462484+0000","last_fullsized":"2024-09-14T12:58:48.462484+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:08:28.783586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:08:28.783586+0000","last_clean_scrub_stamp":"2024-09-14T11:08:28.783586+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:41:05.714746+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.11","version":"267'134","reported_seq":664,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:01:40.625798+0000","last_change":"2024-09-14T11:08:31.837211+0000","last_active":"2024-09-14T13:01:40.625798+0000","last_peered":"2024-09-14T13:01:40.625798+0000","last_clean":"2024-09-14T13:01:40.625798+0000","last_became_active":"2024-09-14T11:08:31.836424+0000","last_became_peered":"2024-09-14T11:08:31.836424+0000","last_unstale":"2024-09-14T13:01:40.625798+0000","last_undegraded":"2024-09-14T13:01:40.625798+0000","last_fullsized":"2024-09-14T13:01:40.625798+0000","mapping_epoch":34,"log_start":"267'100","ondisk_log_start":"267'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:08:30.789404+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:08:30.789404+0000","last_clean_scrub_stamp":"2024-09-14T11:08:30.789404+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":100,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:24:20.926458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":383,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":163,"num_read_kb":148,"num_write":342,"num_write_kb":82,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1c","version":"267'437","reported_seq":2094,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:00:21.259107+0000","last_change":"2024-09-14T11:08:23.775989+0000","last_active":"2024-09-14T13:00:21.259107+0000","last_peered":"2024-09-14T13:00:21.259107+0000","last_clean":"2024-09-14T13:00:21.259107+0000","last_became_active":"2024-09-14T11:08:23.775491+0000","last_became_peered":"2024-09-14T11:08:23.775491+0000","last_unstale":"2024-09-14T13:00:21.259107+0000","last_undegraded":"2024-09-14T13:00:21.259107+0000","last_fullsized":"2024-09-14T13:00:21.259107+0000","mapping_epoch":26,"log_start":"267'400","ondisk_log_start":"267'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:08:22.750609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:08:22.750609+0000","last_clean_scrub_stamp":"2024-09-14T11:08:22.750609+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":400,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:48:28.960871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2479,"num_read_kb":2350,"num_write":502,"num_write_kb":107,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"267'217","reported_seq":844,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:58:57.827849+0000","last_change":"2024-09-14T11:08:56.034799+0000","last_active":"2024-09-14T12:58:57.827849+0000","last_peered":"2024-09-14T12:58:57.827849+0000","last_clean":"2024-09-14T12:58:57.827849+0000","last_became_active":"2024-09-14T11:08:56.033894+0000","last_became_peered":"2024-09-14T11:08:56.033894+0000","last_unstale":"2024-09-14T12:58:57.827849+0000","last_undegraded":"2024-09-14T12:58:57.827849+0000","last_fullsized":"2024-09-14T12:58:57.827849+0000","mapping_epoch":37,"log_start":"267'200","ondisk_log_start":"267'200","created":24,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:08:20.733145+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:08:20.733145+0000","last_clean_scrub_stamp":"2024-09-14T11:08:20.733145+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":200,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:50:48.318805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10489866,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":535,"num_read_kb":17888,"num_write":1017,"num_write_kb":32755,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4,7],"acting":[2,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":521,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:58:28.457976+0000","last_change":"2024-09-14T11:08:25.804776+0000","last_active":"2024-09-14T12:58:28.457976+0000","last_peered":"2024-09-14T12:58:28.457976+0000","last_clean":"2024-09-14T12:58:28.457976+0000","last_became_active":"2024-09-14T11:08:25.804388+0000","last_became_peered":"2024-09-14T11:08:25.804388+0000","last_unstale":"2024-09-14T12:58:28.457976+0000","last_undegraded":"2024-09-14T12:58:28.457976+0000","last_fullsized":"2024-09-14T12:58:28.457976+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:08:24.757170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:08:24.757170+0000","last_clean_scrub_stamp":"2024-09-14T11:08:24.757170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:03:59.400683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1e","version":"267'168","reported_seq":761,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:59:08.616998+0000","last_change":"2024-09-14T11:08:27.832039+0000","last_active":"2024-09-14T12:59:08.616998+0000","last_peered":"2024-09-14T12:59:08.616998+0000","last_clean":"2024-09-14T12:59:08.616998+0000","last_became_active":"2024-09-14T11:08:27.830708+0000","last_became_peered":"2024-09-14T11:08:27.830708+0000","last_unstale":"2024-09-14T12:59:08.616998+0000","last_undegraded":"2024-09-14T12:59:08.616998+0000","last_fullsized":"2024-09-14T12:59:08.616998+0000","mapping_epoch":30,"log_start":"267'100","ondisk_log_start":"267'100","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:08:26.771628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:08:26.771628+0000","last_clean_scrub_stamp":"2024-09-14T11:08:26.771628+0000","objects_scrubbed":0,"log_size":68,"log_dups_size":100,"ondisk_log_size":68,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:26:51.532445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":224,"num_read_kb":219,"num_write":208,"num_write_kb":88,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1f","version":"267'766","reported_seq":3154,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:01:40.710554+0000","last_change":"2024-09-14T11:08:29.842740+0000","last_active":"2024-09-14T13:01:40.710554+0000","last_peered":"2024-09-14T13:01:40.710554+0000","last_clean":"2024-09-14T13:01:40.710554+0000","last_became_active":"2024-09-14T11:08:29.840179+0000","last_became_peered":"2024-09-14T11:08:29.840179+0000","last_unstale":"2024-09-14T13:01:40.710554+0000","last_undegraded":"2024-09-14T13:01:40.710554+0000","last_fullsized":"2024-09-14T13:01:40.710554+0000","mapping_epoch":32,"log_start":"267'701","ondisk_log_start":"267'701","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:08:28.783586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:08:28.783586+0000","last_clean_scrub_stamp":"2024-09-14T11:08:28.783586+0000","objects_scrubbed":0,"log_size":65,"log_dups_size":701,"ondisk_log_size":65,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:13:51.334108+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.10","version":"267'110","reported_seq":636,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:00:11.280385+0000","last_change":"2024-09-14T11:08:31.839459+0000","last_active":"2024-09-14T13:00:11.280385+0000","last_peered":"2024-09-14T13:00:11.280385+0000","last_clean":"2024-09-14T13:00:11.280385+0000","last_became_active":"2024-09-14T11:08:31.838761+0000","last_became_peered":"2024-09-14T11:08:31.838761+0000","last_unstale":"2024-09-14T13:00:11.280385+0000","last_undegraded":"2024-09-14T13:00:11.280385+0000","last_fullsized":"2024-09-14T13:00:11.280385+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:08:30.789404+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:08:30.789404+0000","last_clean_scrub_stamp":"2024-09-14T11:08:30.789404+0000","objects_scrubbed":0,"log_size":110,"log_dups_size":0,"ondisk_log_size":110,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:37:29.125988+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":418,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":108,"num_read_kb":106,"num_write":270,"num_write_kb":60,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1b","version":"267'384","reported_seq":1848,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:00:21.253052+0000","last_change":"2024-09-14T11:08:23.793363+0000","last_active":"2024-09-14T13:00:21.253052+0000","last_peered":"2024-09-14T13:00:21.253052+0000","last_clean":"2024-09-14T13:00:21.253052+0000","last_became_active":"2024-09-14T11:08:23.791753+0000","last_became_peered":"2024-09-14T11:08:23.791753+0000","last_unstale":"2024-09-14T13:00:21.253052+0000","last_undegraded":"2024-09-14T13:00:21.253052+0000","last_fullsized":"2024-09-14T13:00:21.253052+0000","mapping_epoch":26,"log_start":"267'300","ondisk_log_start":"267'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:08:22.750609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:08:22.750609+0000","last_clean_scrub_stamp":"2024-09-14T11:08:22.750609+0000","objects_scrubbed":0,"log_size":84,"log_dups_size":300,"ondisk_log_size":84,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:05:59.318543+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2049,"num_read_kb":1937,"num_write":432,"num_write_kb":84,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1c","version":"267'208","reported_seq":864,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:01:38.481476+0000","last_change":"2024-09-14T11:08:21.826647+0000","last_active":"2024-09-14T13:01:38.481476+0000","last_peered":"2024-09-14T13:01:38.481476+0000","last_clean":"2024-09-14T13:01:38.481476+0000","last_became_active":"2024-09-14T11:08:21.825881+0000","last_became_peered":"2024-09-14T11:08:21.825881+0000","last_unstale":"2024-09-14T13:01:38.481476+0000","last_undegraded":"2024-09-14T13:01:38.481476+0000","last_fullsized":"2024-09-14T13:01:38.481476+0000","mapping_epoch":24,"log_start":"267'100","ondisk_log_start":"267'100","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:08:20.733145+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:08:20.733145+0000","last_clean_scrub_stamp":"2024-09-14T11:08:20.733145+0000","objects_scrubbed":0,"log_size":108,"log_dups_size":100,"ondisk_log_size":108,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:50:22.513817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":14568498,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":550,"num_read_kb":34621,"num_write":944,"num_write_kb":21560,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":525,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:58:27.830750+0000","last_change":"2024-09-14T11:08:25.822606+0000","last_active":"2024-09-14T12:58:27.830750+0000","last_peered":"2024-09-14T12:58:27.830750+0000","last_clean":"2024-09-14T12:58:27.830750+0000","last_became_active":"2024-09-14T11:08:25.822047+0000","last_became_peered":"2024-09-14T11:08:25.822047+0000","last_unstale":"2024-09-14T12:58:27.830750+0000","last_undegraded":"2024-09-14T12:58:27.830750+0000","last_fullsized":"2024-09-14T12:58:27.830750+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:08:24.757170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:08:24.757170+0000","last_clean_scrub_stamp":"2024-09-14T11:08:24.757170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:17:43.121390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.19","version":"267'258","reported_seq":908,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:01:39.437504+0000","last_change":"2024-09-14T11:08:27.825245+0000","last_active":"2024-09-14T13:01:39.437504+0000","last_peered":"2024-09-14T13:01:39.437504+0000","last_clean":"2024-09-14T13:01:39.437504+0000","last_became_active":"2024-09-14T11:08:27.824464+0000","last_became_peered":"2024-09-14T11:08:27.824464+0000","last_unstale":"2024-09-14T13:01:39.437504+0000","last_undegraded":"2024-09-14T13:01:39.437504+0000","last_fullsized":"2024-09-14T13:01:39.437504+0000","mapping_epoch":30,"log_start":"267'200","ondisk_log_start":"267'200","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:08:26.771628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:08:26.771628+0000","last_clean_scrub_stamp":"2024-09-14T11:08:26.771628+0000","objects_scrubbed":0,"log_size":58,"log_dups_size":200,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:54:45.692895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":17424,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":341,"num_read_kb":416,"num_write":210,"num_write_kb":31,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":522,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:57:18.438460+0000","last_change":"2024-09-14T11:08:29.823349+0000","last_active":"2024-09-14T12:57:18.438460+0000","last_peered":"2024-09-14T12:57:18.438460+0000","last_clean":"2024-09-14T12:57:18.438460+0000","last_became_active":"2024-09-14T11:08:29.822623+0000","last_became_peered":"2024-09-14T11:08:29.822623+0000","last_unstale":"2024-09-14T12:57:18.438460+0000","last_undegraded":"2024-09-14T12:57:18.438460+0000","last_fullsized":"2024-09-14T12:57:18.438460+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:08:28.783586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:08:28.783586+0000","last_clean_scrub_stamp":"2024-09-14T11:08:28.783586+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:00:40.714545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.17","version":"267'127","reported_seq":653,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:59:42.848452+0000","last_change":"2024-09-14T11:08:31.859123+0000","last_active":"2024-09-14T12:59:42.848452+0000","last_peered":"2024-09-14T12:59:42.848452+0000","last_clean":"2024-09-14T12:59:42.848452+0000","last_became_active":"2024-09-14T11:08:31.858388+0000","last_became_peered":"2024-09-14T11:08:31.858388+0000","last_unstale":"2024-09-14T12:59:42.848452+0000","last_undegraded":"2024-09-14T12:59:42.848452+0000","last_fullsized":"2024-09-14T12:59:42.848452+0000","mapping_epoch":34,"log_start":"267'100","ondisk_log_start":"267'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:08:30.789404+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:08:30.789404+0000","last_clean_scrub_stamp":"2024-09-14T11:08:30.789404+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":100,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:58:20.561191+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":200,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":125,"num_read_kb":119,"num_write":310,"num_write_kb":73,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1a","version":"267'851","reported_seq":2570,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:59:14.733144+0000","last_change":"2024-09-14T11:08:23.794792+0000","last_active":"2024-09-14T12:59:14.733144+0000","last_peered":"2024-09-14T12:59:14.733144+0000","last_clean":"2024-09-14T12:59:14.733144+0000","last_became_active":"2024-09-14T11:08:23.793908+0000","last_became_peered":"2024-09-14T11:08:23.793908+0000","last_unstale":"2024-09-14T12:59:14.733144+0000","last_undegraded":"2024-09-14T12:59:14.733144+0000","last_fullsized":"2024-09-14T12:59:14.733144+0000","mapping_epoch":26,"log_start":"267'800","ondisk_log_start":"267'800","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:08:22.750609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:08:22.750609+0000","last_clean_scrub_stamp":"2024-09-14T11:08:22.750609+0000","objects_scrubbed":0,"log_size":51,"log_dups_size":800,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:05:29.558132+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":4233,"num_read_kb":3837,"num_write":1135,"num_write_kb":419,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1d","version":"267'244","reported_seq":925,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:58:23.039867+0000","last_change":"2024-09-14T11:08:21.821524+0000","last_active":"2024-09-14T12:58:23.039867+0000","last_peered":"2024-09-14T12:58:23.039867+0000","last_clean":"2024-09-14T12:58:23.039867+0000","last_became_active":"2024-09-14T11:08:21.820805+0000","last_became_peered":"2024-09-14T11:08:21.820805+0000","last_unstale":"2024-09-14T12:58:23.039867+0000","last_undegraded":"2024-09-14T12:58:23.039867+0000","last_fullsized":"2024-09-14T12:58:23.039867+0000","mapping_epoch":24,"log_start":"267'200","ondisk_log_start":"267'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:08:20.733145+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:08:20.733145+0000","last_clean_scrub_stamp":"2024-09-14T11:08:20.733145+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":200,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:37:46.552173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6301751,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":692,"num_read_kb":13918,"num_write":1165,"num_write_kb":29151,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":524,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:58:28.040986+0000","last_change":"2024-09-14T11:08:25.802519+0000","last_active":"2024-09-14T12:58:28.040986+0000","last_peered":"2024-09-14T12:58:28.040986+0000","last_clean":"2024-09-14T12:58:28.040986+0000","last_became_active":"2024-09-14T11:08:25.801548+0000","last_became_peered":"2024-09-14T11:08:25.801548+0000","last_unstale":"2024-09-14T12:58:28.040986+0000","last_undegraded":"2024-09-14T12:58:28.040986+0000","last_fullsized":"2024-09-14T12:58:28.040986+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:08:24.757170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:08:24.757170+0000","last_clean_scrub_stamp":"2024-09-14T11:08:24.757170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:47:07.228076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.18","version":"267'176","reported_seq":795,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:59:38.254026+0000","last_change":"2024-09-14T11:08:27.815657+0000","last_active":"2024-09-14T12:59:38.254026+0000","last_peered":"2024-09-14T12:59:38.254026+0000","last_clean":"2024-09-14T12:59:38.254026+0000","last_became_active":"2024-09-14T11:08:27.814938+0000","last_became_peered":"2024-09-14T11:08:27.814938+0000","last_unstale":"2024-09-14T12:59:38.254026+0000","last_undegraded":"2024-09-14T12:59:38.254026+0000","last_fullsized":"2024-09-14T12:59:38.254026+0000","mapping_epoch":30,"log_start":"264'100","ondisk_log_start":"264'100","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:08:26.771628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:08:26.771628+0000","last_clean_scrub_stamp":"2024-09-14T11:08:26.771628+0000","objects_scrubbed":0,"log_size":76,"log_dups_size":100,"ondisk_log_size":76,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:15:03.277896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":33662,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":230,"num_read_kb":357,"num_write":134,"num_write_kb":53,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":516,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:57:33.603105+0000","last_change":"2024-09-14T11:08:29.836990+0000","last_active":"2024-09-14T12:57:33.603105+0000","last_peered":"2024-09-14T12:57:33.603105+0000","last_clean":"2024-09-14T12:57:33.603105+0000","last_became_active":"2024-09-14T11:08:29.829491+0000","last_became_peered":"2024-09-14T11:08:29.829491+0000","last_unstale":"2024-09-14T12:57:33.603105+0000","last_undegraded":"2024-09-14T12:57:33.603105+0000","last_fullsized":"2024-09-14T12:57:33.603105+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:08:28.783586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:08:28.783586+0000","last_clean_scrub_stamp":"2024-09-14T11:08:28.783586+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:58:11.838583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.16","version":"267'128","reported_seq":682,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:58:21.393905+0000","last_change":"2024-09-14T11:08:31.838739+0000","last_active":"2024-09-14T12:58:21.393905+0000","last_peered":"2024-09-14T12:58:21.393905+0000","last_clean":"2024-09-14T12:58:21.393905+0000","last_became_active":"2024-09-14T11:08:31.832264+0000","last_became_peered":"2024-09-14T11:08:31.832264+0000","last_unstale":"2024-09-14T12:58:21.393905+0000","last_undegraded":"2024-09-14T12:58:21.393905+0000","last_fullsized":"2024-09-14T12:58:21.393905+0000","mapping_epoch":34,"log_start":"267'100","ondisk_log_start":"267'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:08:30.789404+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:08:30.789404+0000","last_clean_scrub_stamp":"2024-09-14T11:08:30.789404+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":100,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:40:25.298343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":539,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":196,"num_read_kb":188,"num_write":306,"num_write_kb":70,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"267'841","reported_seq":2516,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:00:18.822903+0000","last_change":"2024-09-14T11:08:23.782031+0000","last_active":"2024-09-14T13:00:18.822903+0000","last_peered":"2024-09-14T13:00:18.822903+0000","last_clean":"2024-09-14T13:00:18.822903+0000","last_became_active":"2024-09-14T11:08:23.781730+0000","last_became_peered":"2024-09-14T11:08:23.781730+0000","last_unstale":"2024-09-14T13:00:18.822903+0000","last_undegraded":"2024-09-14T13:00:18.822903+0000","last_fullsized":"2024-09-14T13:00:18.822903+0000","mapping_epoch":26,"log_start":"267'800","ondisk_log_start":"267'800","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:08:22.750609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:08:22.750609+0000","last_clean_scrub_stamp":"2024-09-14T11:08:22.750609+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":800,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:42:43.466791+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3990,"num_read_kb":3619,"num_write":1102,"num_write_kb":388,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"267'184","reported_seq":824,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:58:43.462923+0000","last_change":"2024-09-14T11:08:21.809882+0000","last_active":"2024-09-14T12:58:43.462923+0000","last_peered":"2024-09-14T12:58:43.462923+0000","last_clean":"2024-09-14T12:58:43.462923+0000","last_became_active":"2024-09-14T11:08:21.809457+0000","last_became_peered":"2024-09-14T11:08:21.809457+0000","last_unstale":"2024-09-14T12:58:43.462923+0000","last_undegraded":"2024-09-14T12:58:43.462923+0000","last_fullsized":"2024-09-14T12:58:43.462923+0000","mapping_epoch":24,"log_start":"267'100","ondisk_log_start":"267'100","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:08:20.733145+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:08:20.733145+0000","last_clean_scrub_stamp":"2024-09-14T11:08:20.733145+0000","objects_scrubbed":0,"log_size":84,"log_dups_size":100,"ondisk_log_size":84,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:01:09.631980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3145754,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":449,"num_read_kb":5598,"num_write":895,"num_write_kb":20482,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6,7],"acting":[3,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":527,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:57:13.208161+0000","last_change":"2024-09-14T11:08:25.806603+0000","last_active":"2024-09-14T12:57:13.208161+0000","last_peered":"2024-09-14T12:57:13.208161+0000","last_clean":"2024-09-14T12:57:13.208161+0000","last_became_active":"2024-09-14T11:08:25.805777+0000","last_became_peered":"2024-09-14T11:08:25.805777+0000","last_unstale":"2024-09-14T12:57:13.208161+0000","last_undegraded":"2024-09-14T12:57:13.208161+0000","last_fullsized":"2024-09-14T12:57:13.208161+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:08:24.757170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:08:24.757170+0000","last_clean_scrub_stamp":"2024-09-14T11:08:24.757170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:54:18.701609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1b","version":"267'119","reported_seq":708,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:00:58.494482+0000","last_change":"2024-09-14T11:08:27.823209+0000","last_active":"2024-09-14T13:00:58.494482+0000","last_peered":"2024-09-14T13:00:58.494482+0000","last_clean":"2024-09-14T13:00:58.494482+0000","last_became_active":"2024-09-14T11:08:27.822465+0000","last_became_peered":"2024-09-14T11:08:27.822465+0000","last_unstale":"2024-09-14T13:00:58.494482+0000","last_undegraded":"2024-09-14T13:00:58.494482+0000","last_fullsized":"2024-09-14T13:00:58.494482+0000","mapping_epoch":30,"log_start":"267'100","ondisk_log_start":"267'100","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:08:26.771628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:08:26.771628+0000","last_clean_scrub_stamp":"2024-09-14T11:08:26.771628+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":100,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:13:30.608378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":11318,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":153,"num_read_kb":215,"num_write":82,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":518,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:58:33.226817+0000","last_change":"2024-09-14T11:08:29.832131+0000","last_active":"2024-09-14T12:58:33.226817+0000","last_peered":"2024-09-14T12:58:33.226817+0000","last_clean":"2024-09-14T12:58:33.226817+0000","last_became_active":"2024-09-14T11:08:29.831394+0000","last_became_peered":"2024-09-14T11:08:29.831394+0000","last_unstale":"2024-09-14T12:58:33.226817+0000","last_undegraded":"2024-09-14T12:58:33.226817+0000","last_fullsized":"2024-09-14T12:58:33.226817+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:08:28.783586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:08:28.783586+0000","last_clean_scrub_stamp":"2024-09-14T11:08:28.783586+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:19:42.017615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.15","version":"267'186","reported_seq":1322,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:00:12.482492+0000","last_change":"2024-09-14T11:08:31.838090+0000","last_active":"2024-09-14T13:00:12.482492+0000","last_peered":"2024-09-14T13:00:12.482492+0000","last_clean":"2024-09-14T13:00:12.482492+0000","last_became_active":"2024-09-14T11:08:31.837288+0000","last_became_peered":"2024-09-14T11:08:31.837288+0000","last_unstale":"2024-09-14T13:00:12.482492+0000","last_undegraded":"2024-09-14T13:00:12.482492+0000","last_fullsized":"2024-09-14T13:00:12.482492+0000","mapping_epoch":34,"log_start":"267'100","ondisk_log_start":"267'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:08:30.789404+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:08:30.789404+0000","last_clean_scrub_stamp":"2024-09-14T11:08:30.789404+0000","objects_scrubbed":0,"log_size":86,"log_dups_size":100,"ondisk_log_size":86,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:18:38.098740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":649,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":776,"num_read_kb":767,"num_write":406,"num_write_kb":131,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.18","version":"267'750","reported_seq":2353,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:59:18.400946+0000","last_change":"2024-09-14T11:08:23.807715+0000","last_active":"2024-09-14T12:59:18.400946+0000","last_peered":"2024-09-14T12:59:18.400946+0000","last_clean":"2024-09-14T12:59:18.400946+0000","last_became_active":"2024-09-14T11:08:23.806640+0000","last_became_peered":"2024-09-14T11:08:23.806640+0000","last_unstale":"2024-09-14T12:59:18.400946+0000","last_undegraded":"2024-09-14T12:59:18.400946+0000","last_fullsized":"2024-09-14T12:59:18.400946+0000","mapping_epoch":26,"log_start":"267'700","ondisk_log_start":"267'700","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:08:22.750609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:08:22.750609+0000","last_clean_scrub_stamp":"2024-09-14T11:08:22.750609+0000","objects_scrubbed":0,"log_size":50,"log_dups_size":700,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:13:39.042733+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3938,"num_read_kb":3591,"num_write":982,"num_write_kb":355,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1f","version":"267'163","reported_seq":832,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:59:58.476796+0000","last_change":"2024-09-14T11:08:21.801365+0000","last_active":"2024-09-14T12:59:58.476796+0000","last_peered":"2024-09-14T12:59:58.476796+0000","last_clean":"2024-09-14T12:59:58.476796+0000","last_became_active":"2024-09-14T11:08:21.801111+0000","last_became_peered":"2024-09-14T11:08:21.801111+0000","last_unstale":"2024-09-14T12:59:58.476796+0000","last_undegraded":"2024-09-14T12:59:58.476796+0000","last_fullsized":"2024-09-14T12:59:58.476796+0000","mapping_epoch":24,"log_start":"267'100","ondisk_log_start":"267'100","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:08:20.733145+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:08:20.733145+0000","last_clean_scrub_stamp":"2024-09-14T11:08:20.733145+0000","objects_scrubbed":0,"log_size":63,"log_dups_size":100,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:46:15.553454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16777242,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":482,"num_read_kb":60837,"num_write":753,"num_write_kb":39194,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,6],"acting":[0,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.19","version":"29'1","reported_seq":524,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:57:28.444602+0000","last_change":"2024-09-14T11:08:25.800454+0000","last_active":"2024-09-14T12:57:28.444602+0000","last_peered":"2024-09-14T12:57:28.444602+0000","last_clean":"2024-09-14T12:57:28.444602+0000","last_became_active":"2024-09-14T11:08:25.799872+0000","last_became_peered":"2024-09-14T11:08:25.799872+0000","last_unstale":"2024-09-14T12:57:28.444602+0000","last_undegraded":"2024-09-14T12:57:28.444602+0000","last_fullsized":"2024-09-14T12:57:28.444602+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:08:24.757170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:08:24.757170+0000","last_clean_scrub_stamp":"2024-09-14T11:08:24.757170+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:22:33.868316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1a","version":"267'184","reported_seq":815,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:00:58.259901+0000","last_change":"2024-09-14T11:08:27.831489+0000","last_active":"2024-09-14T13:00:58.259901+0000","last_peered":"2024-09-14T13:00:58.259901+0000","last_clean":"2024-09-14T13:00:58.259901+0000","last_became_active":"2024-09-14T11:08:27.830707+0000","last_became_peered":"2024-09-14T11:08:27.830707+0000","last_unstale":"2024-09-14T13:00:58.259901+0000","last_undegraded":"2024-09-14T13:00:58.259901+0000","last_fullsized":"2024-09-14T13:00:58.259901+0000","mapping_epoch":30,"log_start":"264'100","ondisk_log_start":"264'100","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:08:26.771628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:08:26.771628+0000","last_clean_scrub_stamp":"2024-09-14T11:08:26.771628+0000","objects_scrubbed":0,"log_size":84,"log_dups_size":100,"ondisk_log_size":84,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:02:06.941247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10024,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":259,"num_read_kb":319,"num_write":148,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":521,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:58:33.237720+0000","last_change":"2024-09-14T11:08:29.811093+0000","last_active":"2024-09-14T12:58:33.237720+0000","last_peered":"2024-09-14T12:58:33.237720+0000","last_clean":"2024-09-14T12:58:33.237720+0000","last_became_active":"2024-09-14T11:08:29.810292+0000","last_became_peered":"2024-09-14T11:08:29.810292+0000","last_unstale":"2024-09-14T12:58:33.237720+0000","last_undegraded":"2024-09-14T12:58:33.237720+0000","last_fullsized":"2024-09-14T12:58:33.237720+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:08:28.783586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:08:28.783586+0000","last_clean_scrub_stamp":"2024-09-14T11:08:28.783586+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:29:49.706509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.14","version":"267'133","reported_seq":660,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:01:39.322888+0000","last_change":"2024-09-14T11:08:31.852213+0000","last_active":"2024-09-14T13:01:39.322888+0000","last_peered":"2024-09-14T13:01:39.322888+0000","last_clean":"2024-09-14T13:01:39.322888+0000","last_became_active":"2024-09-14T11:08:31.851483+0000","last_became_peered":"2024-09-14T11:08:31.851483+0000","last_unstale":"2024-09-14T13:01:39.322888+0000","last_undegraded":"2024-09-14T13:01:39.322888+0000","last_fullsized":"2024-09-14T13:01:39.322888+0000","mapping_epoch":34,"log_start":"267'100","ondisk_log_start":"267'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:08:30.789404+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:08:30.789404+0000","last_clean_scrub_stamp":"2024-09-14T11:08:30.789404+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":100,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:20:02.893934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":227,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":142,"num_read_kb":127,"num_write":323,"num_write_kb":76,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.27","version":"267'1174","reported_seq":2953,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:58:58.464754+0000","last_change":"2024-09-14T11:08:23.798559+0000","last_active":"2024-09-14T12:58:58.464754+0000","last_peered":"2024-09-14T12:58:58.464754+0000","last_clean":"2024-09-14T12:58:58.464754+0000","last_became_active":"2024-09-14T11:08:23.798225+0000","last_became_peered":"2024-09-14T11:08:23.798225+0000","last_unstale":"2024-09-14T12:58:58.464754+0000","last_undegraded":"2024-09-14T12:58:58.464754+0000","last_fullsized":"2024-09-14T12:58:58.464754+0000","mapping_epoch":26,"log_start":"267'1100","ondisk_log_start":"267'1100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:08:22.750609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:08:22.750609+0000","last_clean_scrub_stamp":"2024-09-14T11:08:22.750609+0000","objects_scrubbed":0,"log_size":74,"log_dups_size":1100,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:51:37.923488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":5564,"num_read_kb":4974,"num_write":1578,"num_write_kb":634,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.20","version":"267'236","reported_seq":989,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:58:48.427401+0000","last_change":"2024-09-14T11:08:21.818419+0000","last_active":"2024-09-14T12:58:48.427401+0000","last_peered":"2024-09-14T12:58:48.427401+0000","last_clean":"2024-09-14T12:58:48.427401+0000","last_became_active":"2024-09-14T11:08:21.816270+0000","last_became_peered":"2024-09-14T11:08:21.816270+0000","last_unstale":"2024-09-14T12:58:48.427401+0000","last_undegraded":"2024-09-14T12:58:48.427401+0000","last_fullsized":"2024-09-14T12:58:48.427401+0000","mapping_epoch":24,"log_start":"267'200","ondisk_log_start":"267'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:08:20.733145+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:08:20.733145+0000","last_clean_scrub_stamp":"2024-09-14T11:08:20.733145+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":200,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:09:57.961085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2438293,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":890,"num_read_kb":196583,"num_write":959,"num_write_kb":33610,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,7],"acting":[6,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.26","version":"267'1292","reported_seq":2902,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:00:11.320785+0000","last_change":"2024-09-14T11:08:23.776608+0000","last_active":"2024-09-14T13:00:11.320785+0000","last_peered":"2024-09-14T13:00:11.320785+0000","last_clean":"2024-09-14T13:00:11.320785+0000","last_became_active":"2024-09-14T11:08:23.776349+0000","last_became_peered":"2024-09-14T11:08:23.776349+0000","last_unstale":"2024-09-14T13:00:11.320785+0000","last_undegraded":"2024-09-14T13:00:11.320785+0000","last_fullsized":"2024-09-14T13:00:11.320785+0000","mapping_epoch":26,"log_start":"267'1200","ondisk_log_start":"267'1200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:08:22.750609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:08:22.750609+0000","last_clean_scrub_stamp":"2024-09-14T11:08:22.750609+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":1200,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:56:10.344959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":5862,"num_read_kb":5174,"num_write":1823,"num_write_kb":798,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.21","version":"267'158","reported_seq":796,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:58:47.825408+0000","last_change":"2024-09-14T11:08:21.779309+0000","last_active":"2024-09-14T12:58:47.825408+0000","last_peered":"2024-09-14T12:58:47.825408+0000","last_clean":"2024-09-14T12:58:47.825408+0000","last_became_active":"2024-09-14T11:08:21.778857+0000","last_became_peered":"2024-09-14T11:08:21.778857+0000","last_unstale":"2024-09-14T12:58:47.825408+0000","last_undegraded":"2024-09-14T12:58:47.825408+0000","last_fullsized":"2024-09-14T12:58:47.825408+0000","mapping_epoch":24,"log_start":"267'100","ondisk_log_start":"267'100","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:08:20.733145+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:08:20.733145+0000","last_clean_scrub_stamp":"2024-09-14T11:08:20.733145+0000","objects_scrubbed":0,"log_size":58,"log_dups_size":100,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:35:37.196078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":436,"num_read_kb":8582,"num_write":806,"num_write_kb":19268,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,6],"acting":[2,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.25","version":"267'856","reported_seq":2578,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:58:58.047892+0000","last_change":"2024-09-14T11:08:23.810261+0000","last_active":"2024-09-14T12:58:58.047892+0000","last_peered":"2024-09-14T12:58:58.047892+0000","last_clean":"2024-09-14T12:58:58.047892+0000","last_became_active":"2024-09-14T11:08:23.808906+0000","last_became_peered":"2024-09-14T11:08:23.808906+0000","last_unstale":"2024-09-14T12:58:58.047892+0000","last_undegraded":"2024-09-14T12:58:58.047892+0000","last_fullsized":"2024-09-14T12:58:58.047892+0000","mapping_epoch":26,"log_start":"267'800","ondisk_log_start":"267'800","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:08:22.750609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:08:22.750609+0000","last_clean_scrub_stamp":"2024-09-14T11:08:22.750609+0000","objects_scrubbed":0,"log_size":56,"log_dups_size":800,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:40:05.413028+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":4244,"num_read_kb":3835,"num_write":1129,"num_write_kb":418,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.22","version":"267'241","reported_seq":950,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:58:48.045508+0000","last_change":"2024-09-14T11:08:21.797624+0000","last_active":"2024-09-14T12:58:48.045508+0000","last_peered":"2024-09-14T12:58:48.045508+0000","last_clean":"2024-09-14T12:58:48.045508+0000","last_became_active":"2024-09-14T11:08:21.795735+0000","last_became_peered":"2024-09-14T11:08:21.795735+0000","last_unstale":"2024-09-14T12:58:48.045508+0000","last_undegraded":"2024-09-14T12:58:48.045508+0000","last_fullsized":"2024-09-14T12:58:48.045508+0000","mapping_epoch":24,"log_start":"267'200","ondisk_log_start":"267'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:08:20.733145+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:08:20.733145+0000","last_clean_scrub_stamp":"2024-09-14T11:08:20.733145+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":200,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:10:17.606566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12586780,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":699,"num_read_kb":92954,"num_write":1115,"num_write_kb":50908,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,0],"acting":[5,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.24","version":"267'424","reported_seq":2053,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:58:58.464653+0000","last_change":"2024-09-14T11:08:23.801087+0000","last_active":"2024-09-14T12:58:58.464653+0000","last_peered":"2024-09-14T12:58:58.464653+0000","last_clean":"2024-09-14T12:58:58.464653+0000","last_became_active":"2024-09-14T11:08:23.800722+0000","last_became_peered":"2024-09-14T11:08:23.800722+0000","last_unstale":"2024-09-14T12:58:58.464653+0000","last_undegraded":"2024-09-14T12:58:58.464653+0000","last_fullsized":"2024-09-14T12:58:58.464653+0000","mapping_epoch":26,"log_start":"267'400","ondisk_log_start":"267'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:08:22.750609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:08:22.750609+0000","last_clean_scrub_stamp":"2024-09-14T11:08:22.750609+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":400,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:30:04.827083+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2360,"num_read_kb":2243,"num_write":502,"num_write_kb":106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.23","version":"267'214","reported_seq":888,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:59:13.248088+0000","last_change":"2024-09-14T11:08:21.816021+0000","last_active":"2024-09-14T12:59:13.248088+0000","last_peered":"2024-09-14T12:59:13.248088+0000","last_clean":"2024-09-14T12:59:13.248088+0000","last_became_active":"2024-09-14T11:08:21.815676+0000","last_became_peered":"2024-09-14T11:08:21.815676+0000","last_unstale":"2024-09-14T12:59:13.248088+0000","last_undegraded":"2024-09-14T12:59:13.248088+0000","last_fullsized":"2024-09-14T12:59:13.248088+0000","mapping_epoch":24,"log_start":"267'200","ondisk_log_start":"267'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:08:20.733145+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:08:20.733145+0000","last_clean_scrub_stamp":"2024-09-14T11:08:20.733145+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":200,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:59:08.982564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6998409,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":593,"num_read_kb":27875,"num_write":898,"num_write_kb":22739,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"267'894","reported_seq":2678,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:01:39.418707+0000","last_change":"2024-09-14T11:08:23.801739+0000","last_active":"2024-09-14T13:01:39.418707+0000","last_peered":"2024-09-14T13:01:39.418707+0000","last_clean":"2024-09-14T13:01:39.418707+0000","last_became_active":"2024-09-14T11:08:23.801373+0000","last_became_peered":"2024-09-14T11:08:23.801373+0000","last_unstale":"2024-09-14T13:01:39.418707+0000","last_undegraded":"2024-09-14T13:01:39.418707+0000","last_fullsized":"2024-09-14T13:01:39.418707+0000","mapping_epoch":26,"log_start":"267'800","ondisk_log_start":"267'800","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:08:22.750609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:08:22.750609+0000","last_clean_scrub_stamp":"2024-09-14T11:08:22.750609+0000","objects_scrubbed":0,"log_size":94,"log_dups_size":800,"ondisk_log_size":94,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:42:48.834357+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":4489,"num_read_kb":4053,"num_write":1182,"num_write_kb":453,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.24","version":"267'179","reported_seq":854,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:58:53.465379+0000","last_change":"2024-09-14T11:08:21.816168+0000","last_active":"2024-09-14T12:58:53.465379+0000","last_peered":"2024-09-14T12:58:53.465379+0000","last_clean":"2024-09-14T12:58:53.465379+0000","last_became_active":"2024-09-14T11:08:21.815768+0000","last_became_peered":"2024-09-14T11:08:21.815768+0000","last_unstale":"2024-09-14T12:58:53.465379+0000","last_undegraded":"2024-09-14T12:58:53.465379+0000","last_fullsized":"2024-09-14T12:58:53.465379+0000","mapping_epoch":24,"log_start":"267'100","ondisk_log_start":"267'100","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:08:20.733145+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:08:20.733145+0000","last_clean_scrub_stamp":"2024-09-14T11:08:20.733145+0000","objects_scrubbed":0,"log_size":79,"log_dups_size":100,"ondisk_log_size":79,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:26:06.050289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4196396,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":598,"num_read_kb":27323,"num_write":895,"num_write_kb":11503,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,0],"acting":[3,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"267'441","reported_seq":1997,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:01:39.358812+0000","last_change":"2024-09-14T11:08:23.815380+0000","last_active":"2024-09-14T13:01:39.358812+0000","last_peered":"2024-09-14T13:01:39.358812+0000","last_clean":"2024-09-14T13:01:39.358812+0000","last_became_active":"2024-09-14T11:08:23.814703+0000","last_became_peered":"2024-09-14T11:08:23.814703+0000","last_unstale":"2024-09-14T13:01:39.358812+0000","last_undegraded":"2024-09-14T13:01:39.358812+0000","last_fullsized":"2024-09-14T13:01:39.358812+0000","mapping_epoch":26,"log_start":"267'400","ondisk_log_start":"267'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:08:22.750609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:08:22.750609+0000","last_clean_scrub_stamp":"2024-09-14T11:08:22.750609+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":400,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:10:53.366615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2315,"num_read_kb":2173,"num_write":509,"num_write_kb":111,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.25","version":"267'222","reported_seq":870,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:58:53.463561+0000","last_change":"2024-09-14T11:08:21.783168+0000","last_active":"2024-09-14T12:58:53.463561+0000","last_peered":"2024-09-14T12:58:53.463561+0000","last_clean":"2024-09-14T12:58:53.463561+0000","last_became_active":"2024-09-14T11:08:21.782389+0000","last_became_peered":"2024-09-14T11:08:21.782389+0000","last_unstale":"2024-09-14T12:58:53.463561+0000","last_undegraded":"2024-09-14T12:58:53.463561+0000","last_fullsized":"2024-09-14T12:58:53.463561+0000","mapping_epoch":24,"log_start":"267'200","ondisk_log_start":"267'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:08:20.733145+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:08:20.733145+0000","last_clean_scrub_stamp":"2024-09-14T11:08:20.733145+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":200,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:56:33.696993+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5607002,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":465,"num_read_kb":9844,"num_write":864,"num_write_kb":38372,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"267'1241","reported_seq":2966,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:58:53.465249+0000","last_change":"2024-09-14T11:08:23.786227+0000","last_active":"2024-09-14T12:58:53.465249+0000","last_peered":"2024-09-14T12:58:53.465249+0000","last_clean":"2024-09-14T12:58:53.465249+0000","last_became_active":"2024-09-14T11:08:23.785820+0000","last_became_peered":"2024-09-14T11:08:23.785820+0000","last_unstale":"2024-09-14T12:58:53.465249+0000","last_undegraded":"2024-09-14T12:58:53.465249+0000","last_fullsized":"2024-09-14T12:58:53.465249+0000","mapping_epoch":26,"log_start":"267'1200","ondisk_log_start":"267'1200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:08:22.750609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:08:22.750609+0000","last_clean_scrub_stamp":"2024-09-14T11:08:22.750609+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":1200,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:03:47.638628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":5731,"num_read_kb":5079,"num_write":1712,"num_write_kb":696,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"267'209","reported_seq":925,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:58:53.428713+0000","last_change":"2024-09-14T11:08:21.825788+0000","last_active":"2024-09-14T12:58:53.428713+0000","last_peered":"2024-09-14T12:58:53.428713+0000","last_clean":"2024-09-14T12:58:53.428713+0000","last_became_active":"2024-09-14T11:08:21.824946+0000","last_became_peered":"2024-09-14T11:08:21.824946+0000","last_unstale":"2024-09-14T12:58:53.428713+0000","last_undegraded":"2024-09-14T12:58:53.428713+0000","last_fullsized":"2024-09-14T12:58:53.428713+0000","mapping_epoch":24,"log_start":"267'100","ondisk_log_start":"267'100","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:08:20.733145+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:08:20.733145+0000","last_clean_scrub_stamp":"2024-09-14T11:08:20.733145+0000","objects_scrubbed":0,"log_size":109,"log_dups_size":100,"ondisk_log_size":109,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:23:39.096969+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":11093103,"num_objects":9,"num_object_clones":0,"num_object_copies":27,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":765,"num_read_kb":179397,"num_write":974,"num_write_kb":35238,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,4],"acting":[6,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.20","version":"267'1214","reported_seq":2936,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:00:11.316393+0000","last_change":"2024-09-14T11:08:23.805571+0000","last_active":"2024-09-14T13:00:11.316393+0000","last_peered":"2024-09-14T13:00:11.316393+0000","last_clean":"2024-09-14T13:00:11.316393+0000","last_became_active":"2024-09-14T11:08:23.803960+0000","last_became_peered":"2024-09-14T11:08:23.803960+0000","last_unstale":"2024-09-14T13:00:11.316393+0000","last_undegraded":"2024-09-14T13:00:11.316393+0000","last_fullsized":"2024-09-14T13:00:11.316393+0000","mapping_epoch":26,"log_start":"267'1200","ondisk_log_start":"267'1200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:08:22.750609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:08:22.750609+0000","last_clean_scrub_stamp":"2024-09-14T11:08:22.750609+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":1200,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:56:34.285956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":5500,"num_read_kb":4892,"num_write":1634,"num_write_kb":643,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"267'216","reported_seq":867,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:59:28.471054+0000","last_change":"2024-09-14T11:08:56.034603+0000","last_active":"2024-09-14T12:59:28.471054+0000","last_peered":"2024-09-14T12:59:28.471054+0000","last_clean":"2024-09-14T12:59:28.471054+0000","last_became_active":"2024-09-14T11:08:56.033948+0000","last_became_peered":"2024-09-14T11:08:56.033948+0000","last_unstale":"2024-09-14T12:59:28.471054+0000","last_undegraded":"2024-09-14T12:59:28.471054+0000","last_fullsized":"2024-09-14T12:59:28.471054+0000","mapping_epoch":37,"log_start":"267'200","ondisk_log_start":"267'200","created":24,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:08:20.733145+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:08:20.733145+0000","last_clean_scrub_stamp":"2024-09-14T11:08:20.733145+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":200,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:23:47.919671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4553958,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":566,"num_read_kb":57833,"num_write":1045,"num_write_kb":21583,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,2],"acting":[1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2f","version":"267'433","reported_seq":2044,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:58:21.423865+0000","last_change":"2024-09-14T11:08:23.786774+0000","last_active":"2024-09-14T12:58:21.423865+0000","last_peered":"2024-09-14T12:58:21.423865+0000","last_clean":"2024-09-14T12:58:21.423865+0000","last_became_active":"2024-09-14T11:08:23.786094+0000","last_became_peered":"2024-09-14T11:08:23.786094+0000","last_unstale":"2024-09-14T12:58:21.423865+0000","last_undegraded":"2024-09-14T12:58:21.423865+0000","last_fullsized":"2024-09-14T12:58:21.423865+0000","mapping_epoch":26,"log_start":"267'400","ondisk_log_start":"267'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:08:22.750609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:08:22.750609+0000","last_clean_scrub_stamp":"2024-09-14T11:08:22.750609+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":400,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:20:24.340919+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2284,"num_read_kb":2174,"num_write":475,"num_write_kb":81,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.28","version":"267'233","reported_seq":905,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:59:23.053130+0000","last_change":"2024-09-14T11:08:21.790090+0000","last_active":"2024-09-14T12:59:23.053130+0000","last_peered":"2024-09-14T12:59:23.053130+0000","last_clean":"2024-09-14T12:59:23.053130+0000","last_became_active":"2024-09-14T11:08:21.789114+0000","last_became_peered":"2024-09-14T11:08:21.789114+0000","last_unstale":"2024-09-14T12:59:23.053130+0000","last_undegraded":"2024-09-14T12:59:23.053130+0000","last_fullsized":"2024-09-14T12:59:23.053130+0000","mapping_epoch":24,"log_start":"267'200","ondisk_log_start":"267'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:08:20.733145+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:08:20.733145+0000","last_clean_scrub_stamp":"2024-09-14T11:08:20.733145+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":200,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:25:30.193731+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9761881,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":587,"num_read_kb":44666,"num_write":1098,"num_write_kb":41456,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,2],"acting":[5,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2e","version":"267'451","reported_seq":2209,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:59:07.754306+0000","last_change":"2024-09-14T11:08:23.793709+0000","last_active":"2024-09-14T12:59:07.754306+0000","last_peered":"2024-09-14T12:59:07.754306+0000","last_clean":"2024-09-14T12:59:07.754306+0000","last_became_active":"2024-09-14T11:08:23.792081+0000","last_became_peered":"2024-09-14T11:08:23.792081+0000","last_unstale":"2024-09-14T12:59:07.754306+0000","last_undegraded":"2024-09-14T12:59:07.754306+0000","last_fullsized":"2024-09-14T12:59:07.754306+0000","mapping_epoch":26,"log_start":"267'400","ondisk_log_start":"267'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:08:22.750609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:08:22.750609+0000","last_clean_scrub_stamp":"2024-09-14T11:08:22.750609+0000","objects_scrubbed":0,"log_size":51,"log_dups_size":400,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:10:19.755636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2579,"num_read_kb":2481,"num_write":491,"num_write_kb":76,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.29","version":"267'198","reported_seq":894,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:59:12.831088+0000","last_change":"2024-09-14T11:08:56.039919+0000","last_active":"2024-09-14T12:59:12.831088+0000","last_peered":"2024-09-14T12:59:12.831088+0000","last_clean":"2024-09-14T12:59:12.831088+0000","last_became_active":"2024-09-14T11:08:56.039007+0000","last_became_peered":"2024-09-14T11:08:56.039007+0000","last_unstale":"2024-09-14T12:59:12.831088+0000","last_undegraded":"2024-09-14T12:59:12.831088+0000","last_fullsized":"2024-09-14T12:59:12.831088+0000","mapping_epoch":37,"log_start":"267'100","ondisk_log_start":"267'100","created":24,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:08:20.733145+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:08:20.733145+0000","last_clean_scrub_stamp":"2024-09-14T11:08:20.733145+0000","objects_scrubbed":0,"log_size":98,"log_dups_size":100,"ondisk_log_size":98,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:34:15.824951+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":325166,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":674,"num_read_kb":34418,"num_write":909,"num_write_kb":30711,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4,1],"acting":[2,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2d","version":"267'382","reported_seq":1944,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:01:39.348450+0000","last_change":"2024-09-14T11:08:23.806935+0000","last_active":"2024-09-14T13:01:39.348450+0000","last_peered":"2024-09-14T13:01:39.348450+0000","last_clean":"2024-09-14T13:01:39.348450+0000","last_became_active":"2024-09-14T11:08:23.806568+0000","last_became_peered":"2024-09-14T11:08:23.806568+0000","last_unstale":"2024-09-14T13:01:39.348450+0000","last_undegraded":"2024-09-14T13:01:39.348450+0000","last_fullsized":"2024-09-14T13:01:39.348450+0000","mapping_epoch":26,"log_start":"267'300","ondisk_log_start":"267'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:08:22.750609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:08:22.750609+0000","last_clean_scrub_stamp":"2024-09-14T11:08:22.750609+0000","objects_scrubbed":0,"log_size":82,"log_dups_size":300,"ondisk_log_size":82,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:57:47.545139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2181,"num_read_kb":2088,"num_write":442,"num_write_kb":83,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2a","version":"267'209","reported_seq":845,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:00:10.971402+0000","last_change":"2024-09-14T11:08:55.884603+0000","last_active":"2024-09-14T13:00:10.971402+0000","last_peered":"2024-09-14T13:00:10.971402+0000","last_clean":"2024-09-14T13:00:10.971402+0000","last_became_active":"2024-09-14T11:08:55.882680+0000","last_became_peered":"2024-09-14T11:08:55.882680+0000","last_unstale":"2024-09-14T13:00:10.971402+0000","last_undegraded":"2024-09-14T13:00:10.971402+0000","last_fullsized":"2024-09-14T13:00:10.971402+0000","mapping_epoch":37,"log_start":"267'100","ondisk_log_start":"267'100","created":24,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:08:20.733145+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:08:20.733145+0000","last_clean_scrub_stamp":"2024-09-14T11:08:20.733145+0000","objects_scrubbed":0,"log_size":109,"log_dups_size":100,"ondisk_log_size":109,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:49:48.418255+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6908983,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":486,"num_read_kb":10243,"num_write":959,"num_write_kb":42313,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,1],"acting":[5,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2c","version":"267'617","reported_seq":2458,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:59:18.400789+0000","last_change":"2024-09-14T11:08:23.815717+0000","last_active":"2024-09-14T12:59:18.400789+0000","last_peered":"2024-09-14T12:59:18.400789+0000","last_clean":"2024-09-14T12:59:18.400789+0000","last_became_active":"2024-09-14T11:08:23.815121+0000","last_became_peered":"2024-09-14T11:08:23.815121+0000","last_unstale":"2024-09-14T12:59:18.400789+0000","last_undegraded":"2024-09-14T12:59:18.400789+0000","last_fullsized":"2024-09-14T12:59:18.400789+0000","mapping_epoch":26,"log_start":"267'600","ondisk_log_start":"267'600","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:08:22.750609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:08:22.750609+0000","last_clean_scrub_stamp":"2024-09-14T11:08:22.750609+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":600,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:28:06.102937+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3483,"num_read_kb":3244,"num_write":793,"num_write_kb":264,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2b","version":"267'197","reported_seq":843,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:58:38.239023+0000","last_change":"2024-09-14T11:08:21.788931+0000","last_active":"2024-09-14T12:58:38.239023+0000","last_peered":"2024-09-14T12:58:38.239023+0000","last_clean":"2024-09-14T12:58:38.239023+0000","last_became_active":"2024-09-14T11:08:21.788281+0000","last_became_peered":"2024-09-14T11:08:21.788281+0000","last_unstale":"2024-09-14T12:58:38.239023+0000","last_undegraded":"2024-09-14T12:58:38.239023+0000","last_fullsized":"2024-09-14T12:58:38.239023+0000","mapping_epoch":24,"log_start":"267'100","ondisk_log_start":"267'100","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:08:20.733145+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:08:20.733145+0000","last_clean_scrub_stamp":"2024-09-14T11:08:20.733145+0000","objects_scrubbed":0,"log_size":97,"log_dups_size":100,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:28:36.822887+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388661,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":433,"num_read_kb":38929,"num_write":897,"num_write_kb":25858,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,1],"acting":[0,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2b","version":"267'912","reported_seq":2513,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:01:39.366882+0000","last_change":"2024-09-14T11:08:23.807651+0000","last_active":"2024-09-14T13:01:39.366882+0000","last_peered":"2024-09-14T13:01:39.366882+0000","last_clean":"2024-09-14T13:01:39.366882+0000","last_became_active":"2024-09-14T11:08:23.806952+0000","last_became_peered":"2024-09-14T11:08:23.806952+0000","last_unstale":"2024-09-14T13:01:39.366882+0000","last_undegraded":"2024-09-14T13:01:39.366882+0000","last_fullsized":"2024-09-14T13:01:39.366882+0000","mapping_epoch":26,"log_start":"267'900","ondisk_log_start":"267'900","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:08:22.750609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:08:22.750609+0000","last_clean_scrub_stamp":"2024-09-14T11:08:22.750609+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":900,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:04:05.268211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":4419,"num_read_kb":3921,"num_write":1287,"num_write_kb":515,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"267'227","reported_seq":901,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:58:38.425180+0000","last_change":"2024-09-14T11:08:21.838035+0000","last_active":"2024-09-14T12:58:38.425180+0000","last_peered":"2024-09-14T12:58:38.425180+0000","last_clean":"2024-09-14T12:58:38.425180+0000","last_became_active":"2024-09-14T11:08:21.836420+0000","last_became_peered":"2024-09-14T11:08:21.836420+0000","last_unstale":"2024-09-14T12:58:38.425180+0000","last_undegraded":"2024-09-14T12:58:38.425180+0000","last_fullsized":"2024-09-14T12:58:38.425180+0000","mapping_epoch":24,"log_start":"267'200","ondisk_log_start":"267'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:08:20.733145+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:08:20.733145+0000","last_clean_scrub_stamp":"2024-09-14T11:08:20.733145+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":200,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:52:49.496464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7394423,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":674,"num_read_kb":43780,"num_write":1050,"num_write_kb":42822,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.2a","version":"267'457","reported_seq":2086,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:58:43.240063+0000","last_change":"2024-09-14T11:08:23.777007+0000","last_active":"2024-09-14T12:58:43.240063+0000","last_peered":"2024-09-14T12:58:43.240063+0000","last_clean":"2024-09-14T12:58:43.240063+0000","last_became_active":"2024-09-14T11:08:23.776554+0000","last_became_peered":"2024-09-14T11:08:23.776554+0000","last_unstale":"2024-09-14T12:58:43.240063+0000","last_undegraded":"2024-09-14T12:58:43.240063+0000","last_fullsized":"2024-09-14T12:58:43.240063+0000","mapping_epoch":26,"log_start":"267'400","ondisk_log_start":"267'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:08:22.750609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:08:22.750609+0000","last_clean_scrub_stamp":"2024-09-14T11:08:22.750609+0000","objects_scrubbed":0,"log_size":57,"log_dups_size":400,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:54:36.353928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2491,"num_read_kb":2349,"num_write":540,"num_write_kb":122,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2d","version":"267'204","reported_seq":852,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:59:58.479560+0000","last_change":"2024-09-14T11:08:21.829298+0000","last_active":"2024-09-14T12:59:58.479560+0000","last_peered":"2024-09-14T12:59:58.479560+0000","last_clean":"2024-09-14T12:59:58.479560+0000","last_became_active":"2024-09-14T11:08:21.828333+0000","last_became_peered":"2024-09-14T11:08:21.828333+0000","last_unstale":"2024-09-14T12:59:58.479560+0000","last_undegraded":"2024-09-14T12:59:58.479560+0000","last_fullsized":"2024-09-14T12:59:58.479560+0000","mapping_epoch":24,"log_start":"267'100","ondisk_log_start":"267'100","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:08:20.733145+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:08:20.733145+0000","last_clean_scrub_stamp":"2024-09-14T11:08:20.733145+0000","objects_scrubbed":0,"log_size":104,"log_dups_size":100,"ondisk_log_size":104,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:49:17.354112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9037928,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":510,"num_read_kb":35640,"num_write":900,"num_write_kb":31502,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,6],"acting":[7,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.29","version":"267'783","reported_seq":2506,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:58:48.349738+0000","last_change":"2024-09-14T11:08:23.784873+0000","last_active":"2024-09-14T12:58:48.349738+0000","last_peered":"2024-09-14T12:58:48.349738+0000","last_clean":"2024-09-14T12:58:48.349738+0000","last_became_active":"2024-09-14T11:08:23.783522+0000","last_became_peered":"2024-09-14T11:08:23.783522+0000","last_unstale":"2024-09-14T12:58:48.349738+0000","last_undegraded":"2024-09-14T12:58:48.349738+0000","last_fullsized":"2024-09-14T12:58:48.349738+0000","mapping_epoch":26,"log_start":"267'700","ondisk_log_start":"267'700","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:08:22.750609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:08:22.750609+0000","last_clean_scrub_stamp":"2024-09-14T11:08:22.750609+0000","objects_scrubbed":0,"log_size":83,"log_dups_size":700,"ondisk_log_size":83,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:15:28.048272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":4481,"num_read_kb":4083,"num_write":1109,"num_write_kb":423,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"267'181","reported_seq":866,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:59:58.479319+0000","last_change":"2024-09-14T11:08:21.809060+0000","last_active":"2024-09-14T12:59:58.479319+0000","last_peered":"2024-09-14T12:59:58.479319+0000","last_clean":"2024-09-14T12:59:58.479319+0000","last_became_active":"2024-09-14T11:08:21.808348+0000","last_became_peered":"2024-09-14T11:08:21.808348+0000","last_unstale":"2024-09-14T12:59:58.479319+0000","last_undegraded":"2024-09-14T12:59:58.479319+0000","last_fullsized":"2024-09-14T12:59:58.479319+0000","mapping_epoch":24,"log_start":"267'100","ondisk_log_start":"267'100","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:08:20.733145+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:08:20.733145+0000","last_clean_scrub_stamp":"2024-09-14T11:08:20.733145+0000","objects_scrubbed":0,"log_size":81,"log_dups_size":100,"ondisk_log_size":81,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:06:38.749956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":15303696,"num_objects":10,"num_object_clones":0,"num_object_copies":30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":608,"num_read_kb":79965,"num_write":844,"num_write_kb":37043,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,1],"acting":[2,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"267'411","reported_seq":2113,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:01:39.424555+0000","last_change":"2024-09-14T11:08:23.803099+0000","last_active":"2024-09-14T13:01:39.424555+0000","last_peered":"2024-09-14T13:01:39.424555+0000","last_clean":"2024-09-14T13:01:39.424555+0000","last_became_active":"2024-09-14T11:08:23.802357+0000","last_became_peered":"2024-09-14T11:08:23.802357+0000","last_unstale":"2024-09-14T13:01:39.424555+0000","last_undegraded":"2024-09-14T13:01:39.424555+0000","last_fullsized":"2024-09-14T13:01:39.424555+0000","mapping_epoch":26,"log_start":"267'400","ondisk_log_start":"267'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:08:22.750609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:08:22.750609+0000","last_clean_scrub_stamp":"2024-09-14T11:08:22.750609+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":400,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:31:47.027216+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2549,"num_read_kb":2448,"num_write":474,"num_write_kb":95,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2f","version":"267'222","reported_seq":946,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:58:03.035502+0000","last_change":"2024-09-14T11:08:55.885757+0000","last_active":"2024-09-14T12:58:03.035502+0000","last_peered":"2024-09-14T12:58:03.035502+0000","last_clean":"2024-09-14T12:58:03.035502+0000","last_became_active":"2024-09-14T11:08:55.884851+0000","last_became_peered":"2024-09-14T11:08:55.884851+0000","last_unstale":"2024-09-14T12:58:03.035502+0000","last_undegraded":"2024-09-14T12:58:03.035502+0000","last_fullsized":"2024-09-14T12:58:03.035502+0000","mapping_epoch":37,"log_start":"267'200","ondisk_log_start":"267'200","created":24,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:08:20.733145+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:08:20.733145+0000","last_clean_scrub_stamp":"2024-09-14T11:08:20.733145+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":200,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:34:33.364323+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5281584,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":796,"num_read_kb":23166,"num_write":997,"num_write_kb":40111,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,1],"acting":[5,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"267'224","reported_seq":911,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:58:39.623527+0000","last_change":"2024-09-14T11:08:56.035003+0000","last_active":"2024-09-14T12:58:39.623527+0000","last_peered":"2024-09-14T12:58:39.623527+0000","last_clean":"2024-09-14T12:58:39.623527+0000","last_became_active":"2024-09-14T11:08:56.033792+0000","last_became_peered":"2024-09-14T11:08:56.033792+0000","last_unstale":"2024-09-14T12:58:39.623527+0000","last_undegraded":"2024-09-14T12:58:39.623527+0000","last_fullsized":"2024-09-14T12:58:39.623527+0000","mapping_epoch":37,"log_start":"267'200","ondisk_log_start":"267'200","created":24,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:08:20.733145+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:08:20.733145+0000","last_clean_scrub_stamp":"2024-09-14T11:08:20.733145+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":200,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:06:53.712379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19922970,"num_objects":12,"num_object_clones":0,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":0,"num_read":569,"num_read_kb":92149,"num_write":1009,"num_write_kb":50173,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,0],"acting":[5,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.37","version":"267'500","reported_seq":2175,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:00:18.795316+0000","last_change":"2024-09-14T11:08:23.787116+0000","last_active":"2024-09-14T13:00:18.795316+0000","last_peered":"2024-09-14T13:00:18.795316+0000","last_clean":"2024-09-14T13:00:18.795316+0000","last_became_active":"2024-09-14T11:08:23.786473+0000","last_became_peered":"2024-09-14T11:08:23.786473+0000","last_unstale":"2024-09-14T13:00:18.795316+0000","last_undegraded":"2024-09-14T13:00:18.795316+0000","last_fullsized":"2024-09-14T13:00:18.795316+0000","mapping_epoch":26,"log_start":"267'400","ondisk_log_start":"267'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:08:22.750609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:08:22.750609+0000","last_clean_scrub_stamp":"2024-09-14T11:08:22.750609+0000","objects_scrubbed":0,"log_size":100,"log_dups_size":400,"ondisk_log_size":100,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:50:27.775627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2870,"num_read_kb":2681,"num_write":627,"num_write_kb":170,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"267'220","reported_seq":890,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:59:58.484286+0000","last_change":"2024-09-14T11:08:21.816970+0000","last_active":"2024-09-14T12:59:58.484286+0000","last_peered":"2024-09-14T12:59:58.484286+0000","last_clean":"2024-09-14T12:59:58.484286+0000","last_became_active":"2024-09-14T11:08:21.815731+0000","last_became_peered":"2024-09-14T11:08:21.815731+0000","last_unstale":"2024-09-14T12:59:58.484286+0000","last_undegraded":"2024-09-14T12:59:58.484286+0000","last_fullsized":"2024-09-14T12:59:58.484286+0000","mapping_epoch":24,"log_start":"267'200","ondisk_log_start":"267'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:08:20.733145+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:08:20.733145+0000","last_clean_scrub_stamp":"2024-09-14T11:08:20.733145+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":200,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:24:40.198696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6363857,"num_objects":12,"num_object_clones":0,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":0,"num_read":588,"num_read_kb":25561,"num_write":997,"num_write_kb":42149,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,5],"acting":[1,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.36","version":"267'907","reported_seq":2493,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:58:11.332731+0000","last_change":"2024-09-14T11:08:23.797836+0000","last_active":"2024-09-14T12:58:11.332731+0000","last_peered":"2024-09-14T12:58:11.332731+0000","last_clean":"2024-09-14T12:58:11.332731+0000","last_became_active":"2024-09-14T11:08:23.797135+0000","last_became_peered":"2024-09-14T11:08:23.797135+0000","last_unstale":"2024-09-14T12:58:11.332731+0000","last_undegraded":"2024-09-14T12:58:11.332731+0000","last_fullsized":"2024-09-14T12:58:11.332731+0000","mapping_epoch":26,"log_start":"267'800","ondisk_log_start":"267'800","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:08:22.750609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:08:22.750609+0000","last_clean_scrub_stamp":"2024-09-14T11:08:22.750609+0000","objects_scrubbed":0,"log_size":107,"log_dups_size":800,"ondisk_log_size":107,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:35:11.421873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4302,"num_read_kb":3816,"num_write":1266,"num_write_kb":491,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]}],"pool_stats":[{"poolid":65,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10893,"num_read_kb":9222,"num_write":3117,"num_write_kb":1014,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1012,"ondisk_log_size":1012,"up":64,"acting":64,"num_store_stats":8},{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":14831,"num_objects":87,"num_object_clones":0,"num_object_copies":174,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":87,"num_whiteouts":0,"num_read":15223,"num_read_kb":14878,"num_write":17077,"num_write_kb":4995,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":19,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":557056,"data_stored":29662,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1708,"ondisk_log_size":1708,"up":64,"acting":64,"num_store_stats":8},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":540,"ondisk_log_size":540,"up":64,"acting":64,"num_store_stats":8},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":543921,"num_objects":199,"num_object_clones":0,"num_object_copies":398,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":199,"num_whiteouts":0,"num_read":11694,"num_read_kb":13819,"num_write":8553,"num_write_kb":3787,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":23,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":786432,"data_stored":263102,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1984,"ondisk_log_size":1984,"up":64,"acting":64,"num_store_stats":8},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":1793,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":2373,"num_read_kb":2833,"num_write":20,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":3586,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":11,"ondisk_log_size":11,"up":64,"acting":64,"num_store_stats":8},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":143,"num_object_clones":0,"num_object_copies":286,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":143,"num_whiteouts":0,"num_read":221865,"num_read_kb":203092,"num_write":56157,"num_write_kb":19250,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":143,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3675,"ondisk_log_size":3675,"up":128,"acting":128,"num_store_stats":8},{"poolid":68,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":12,"num_read_kb":12,"num_write":18,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":6,"ondisk_log_size":6,"up":64,"acting":64,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":565949976,"num_objects":497,"num_object_clones":0,"num_object_copies":1491,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":497,"num_whiteouts":0,"num_read":42552,"num_read_kb":2820640,"num_write":64136,"num_write_kb":2216242,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":851558400,"data_stored":851558400,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3742,"ondisk_log_size":3742,"up":192,"acting":192,"num_store_stats":8},{"poolid":67,"num_pg":32,"stat_sum":{"num_bytes":73109320,"num_objects":28,"num_object_clones":0,"num_object_copies":56,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":28,"num_whiteouts":0,"num_read":144,"num_read_kb":198130,"num_write":158,"num_write_kb":125738,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":146227200,"data_stored":146218640,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":98,"ondisk_log_size":98,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":7},{"poolid":66,"num_pg":32,"stat_sum":{"num_bytes":73109320,"num_objects":28,"num_object_clones":0,"num_object_copies":56,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":28,"num_whiteouts":0,"num_read":140,"num_read_kb":188216,"num_write":158,"num_write_kb":125738,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":146227200,"data_stored":146218640,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":98,"ondisk_log_size":98,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834576217,"num_pgs":106,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":369872,"kb_used_data":131840,"kb_used_omap":1,"kb_used_meta":238014,"kb_avail":94001968,"statfs":{"total":96636764160,"available":96258015232,"internally_reserved":0,"allocated":135004160,"data_stored":132821830,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":243726794},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":13,"seq":55834576223,"num_pgs":99,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":378220,"kb_used_data":144348,"kb_used_omap":1,"kb_used_meta":233854,"kb_avail":93993620,"statfs":{"total":96636764160,"available":96249466880,"internally_reserved":0,"allocated":147812352,"data_stored":145699147,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":239466950},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":13,"seq":55834576221,"num_pgs":103,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":226132,"kb_used_data":132484,"kb_used_omap":1,"kb_used_meta":93630,"kb_avail":94145708,"statfs":{"total":96636764160,"available":96405204992,"internally_reserved":0,"allocated":135663616,"data_stored":133464106,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":95877573},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834576222,"num_pgs":105,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":253236,"kb_used_data":145700,"kb_used_omap":1,"kb_used_meta":107518,"kb_avail":94118604,"statfs":{"total":96636764160,"available":96377450496,"internally_reserved":0,"allocated":149196800,"data_stored":147124325,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":110098885},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":13,"seq":55834576224,"num_pgs":124,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":396684,"kb_used_data":166972,"kb_used_omap":1,"kb_used_meta":229694,"kb_avail":93975156,"statfs":{"total":96636764160,"available":96230559744,"internally_reserved":0,"allocated":170979328,"data_stored":168801388,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":235207111},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834576221,"num_pgs":92,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":195020,"kb_used_data":127740,"kb_used_omap":1,"kb_used_meta":67262,"kb_avail":94176820,"statfs":{"total":96636764160,"available":96437063680,"internally_reserved":0,"allocated":130805760,"data_stored":128711851,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":68876741},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834576224,"num_pgs":112,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":281780,"kb_used_data":146532,"kb_used_omap":1,"kb_used_meta":135230,"kb_avail":94090060,"statfs":{"total":96636764160,"available":96348221440,"internally_reserved":0,"allocated":150048768,"data_stored":147909730,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":138475973},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834576222,"num_pgs":109,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":387488,"kb_used_data":157776,"kb_used_omap":1,"kb_used_meta":229694,"kb_avail":93984352,"statfs":{"total":96636764160,"available":96239976448,"internally_reserved":0,"allocated":161562624,"data_stored":159400235,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":235207109},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":112717824,"data_stored":112717824,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":95555584,"data_stored":95555584,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":83353600,"data_stored":83353600,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":111874048,"data_stored":111874048,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":110538752,"data_stored":110538752,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":119562240,"data_stored":119562240,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":105943040,"data_stored":105943040,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":112013312,"data_stored":112013312,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":1139,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":46,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":1185,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":562,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":184,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":470,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":98304,"data_stored":30908,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":114688,"data_stored":43011,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":10532,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":143360,"data_stored":49148,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":6107,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":159744,"data_stored":55366,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":81920,"data_stored":27675,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":135168,"data_stored":40355,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":86016,"data_stored":3328,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":3091,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4091,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":86016,"data_stored":4619,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":2771,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":77824,"data_stored":4485,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":2895,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":86016,"data_stored":4382,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":25923584,"data_stored":25920194,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":27267072,"data_stored":27266182,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":9437184,"data_stored":9437184,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":19922944,"data_stored":19922944,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20971520,"data_stored":20971520,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":10485760,"data_stored":10485760,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":23789568,"data_stored":23786103,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8429568,"data_stored":8428753,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":17829888,"data_stored":17828998,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":22736896,"data_stored":22734321,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":33599488,"data_stored":33597783,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":34643968,"data_stored":34643153,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":13299712,"data_stored":13297137,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":1048576,"data_stored":1048576,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":13631488,"data_stored":13631488,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":9437184,"data_stored":9437184,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-14T13:02:01.803 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-14T13:02:02.164 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-09-14T13:02:02.179 INFO:teuthology.orchestra.run.smithi138.stderr:dumped all 2024-09-14T13:02:02.191 INFO:teuthology.orchestra.run.smithi138.stdout:{"pg_ready":true,"pg_map":{"version":3677,"stamp":"2024-09-14T13:02:01.293466+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":713319548,"num_objects":1006,"num_object_clones":0,"num_object_copies":2509,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1006,"num_whiteouts":0,"num_read":304962,"num_read_kb":3450897,"num_write":149497,"num_write_kb":2498419,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":191,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":12949,"ondisk_log_size":12949,"up":850,"acting":850,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":850,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2488432,"kb_used_data":1153392,"kb_used_omap":12,"kb_used_meta":1334899,"kb_avail":752486288,"statfs":{"total":773094113280,"available":770545958912,"internally_reserved":0,"allocated":1181073408,"data_stored":1163932612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":1366937136},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.009529"},"pg_stats":[{"pgid":"68.1a","version":"0'0","reported_seq":38,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:58:43.044370+0000","last_change":"2024-09-14T11:58:43.698171+0000","last_active":"2024-09-14T12:58:43.044370+0000","last_peered":"2024-09-14T12:58:43.044370+0000","last_clean":"2024-09-14T12:58:43.044370+0000","last_became_active":"2024-09-14T11:58:43.694936+0000","last_became_peered":"2024-09-14T11:58:43.694936+0000","last_unstale":"2024-09-14T12:58:43.044370+0000","last_undegraded":"2024-09-14T12:58:43.044370+0000","last_fullsized":"2024-09-14T12:58:43.044370+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:58:42.635024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:58:42.635024+0000","last_clean_scrub_stamp":"2024-09-14T11:58:42.635024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:02:52.327879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.1d","version":"264'2","reported_seq":63,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:57:48.032148+0000","last_change":"2024-09-14T11:30:17.527028+0000","last_active":"2024-09-14T12:57:48.032148+0000","last_peered":"2024-09-14T12:57:48.032148+0000","last_clean":"2024-09-14T12:57:48.032148+0000","last_became_active":"2024-09-14T11:30:17.525157+0000","last_became_peered":"2024-09-14T11:30:17.525157+0000","last_unstale":"2024-09-14T12:57:48.032148+0000","last_undegraded":"2024-09-14T12:57:48.032148+0000","last_fullsized":"2024-09-14T12:57:48.032148+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:30:16.474654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:30:16.474654+0000","last_clean_scrub_stamp":"2024-09-14T11:30:16.474654+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:14:59.272162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":4096,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.1c","version":"267'4","reported_seq":74,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:57:43.449013+0000","last_change":"2024-09-14T11:30:10.466403+0000","last_active":"2024-09-14T12:57:43.449013+0000","last_peered":"2024-09-14T12:57:43.449013+0000","last_clean":"2024-09-14T12:57:43.449013+0000","last_became_active":"2024-09-14T11:30:10.460441+0000","last_became_peered":"2024-09-14T11:30:10.460441+0000","last_unstale":"2024-09-14T12:57:43.449013+0000","last_undegraded":"2024-09-14T12:57:43.449013+0000","last_fullsized":"2024-09-14T12:57:43.449013+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:30:09.411354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:30:09.411354+0000","last_clean_scrub_stamp":"2024-09-14T11:30:09.411354+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:47:20.165693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5242880,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":6,"num_read_kb":6189,"num_write":4,"num_write_kb":5165,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.1f","version":"267'84","reported_seq":312,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:57:58.447987+0000","last_change":"2024-09-14T11:24:10.106139+0000","last_active":"2024-09-14T12:57:58.447987+0000","last_peered":"2024-09-14T12:57:58.447987+0000","last_clean":"2024-09-14T12:57:58.447987+0000","last_became_active":"2024-09-14T11:24:10.104105+0000","last_became_peered":"2024-09-14T11:24:10.104105+0000","last_unstale":"2024-09-14T12:57:58.447987+0000","last_undegraded":"2024-09-14T12:57:58.447987+0000","last_fullsized":"2024-09-14T12:57:58.447987+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:24:09.066501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:24:09.066501+0000","last_clean_scrub_stamp":"2024-09-14T11:24:09.066501+0000","objects_scrubbed":0,"log_size":84,"log_dups_size":0,"ondisk_log_size":84,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:25:27.324710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":704,"num_read_kb":504,"num_write":208,"num_write_kb":68,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.1b","version":"0'0","reported_seq":38,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:58:42.823851+0000","last_change":"2024-09-14T11:58:43.694459+0000","last_active":"2024-09-14T12:58:42.823851+0000","last_peered":"2024-09-14T12:58:42.823851+0000","last_clean":"2024-09-14T12:58:42.823851+0000","last_became_active":"2024-09-14T11:58:43.693847+0000","last_became_peered":"2024-09-14T11:58:43.693847+0000","last_unstale":"2024-09-14T12:58:42.823851+0000","last_undegraded":"2024-09-14T12:58:42.823851+0000","last_fullsized":"2024-09-14T12:58:42.823851+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:58:42.635024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:58:42.635024+0000","last_clean_scrub_stamp":"2024-09-14T11:58:42.635024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:49:04.187747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.1c","version":"267'5","reported_seq":70,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:57:48.216115+0000","last_change":"2024-09-14T11:30:17.525550+0000","last_active":"2024-09-14T12:57:48.216115+0000","last_peered":"2024-09-14T12:57:48.216115+0000","last_clean":"2024-09-14T12:57:48.216115+0000","last_became_active":"2024-09-14T11:30:17.524810+0000","last_became_peered":"2024-09-14T11:30:17.524810+0000","last_unstale":"2024-09-14T12:57:48.216115+0000","last_undegraded":"2024-09-14T12:57:48.216115+0000","last_fullsized":"2024-09-14T12:57:48.216115+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:30:16.474654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:30:16.474654+0000","last_clean_scrub_stamp":"2024-09-14T11:30:16.474654+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:05:01.153652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7005681,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":6,"num_read_kb":11636,"num_write":10,"num_write_kb":6842,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.1d","version":"0'0","reported_seq":65,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:57:43.447885+0000","last_change":"2024-09-14T11:30:10.475624+0000","last_active":"2024-09-14T12:57:43.447885+0000","last_peered":"2024-09-14T12:57:43.447885+0000","last_clean":"2024-09-14T12:57:43.447885+0000","last_became_active":"2024-09-14T11:30:10.474889+0000","last_became_peered":"2024-09-14T11:30:10.474889+0000","last_unstale":"2024-09-14T12:57:43.447885+0000","last_undegraded":"2024-09-14T12:57:43.447885+0000","last_fullsized":"2024-09-14T12:57:43.447885+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:30:09.411354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:30:09.411354+0000","last_clean_scrub_stamp":"2024-09-14T11:30:09.411354+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:14:21.245898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.1e","version":"267'279","reported_seq":912,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:58:42.824027+0000","last_change":"2024-09-14T11:24:10.091187+0000","last_active":"2024-09-14T12:58:42.824027+0000","last_peered":"2024-09-14T12:58:42.824027+0000","last_clean":"2024-09-14T12:58:42.824027+0000","last_became_active":"2024-09-14T11:24:10.090434+0000","last_became_peered":"2024-09-14T11:24:10.090434+0000","last_unstale":"2024-09-14T12:58:42.824027+0000","last_undegraded":"2024-09-14T12:58:42.824027+0000","last_fullsized":"2024-09-14T12:58:42.824027+0000","mapping_epoch":254,"log_start":"264'200","ondisk_log_start":"264'200","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:24:09.066501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:24:09.066501+0000","last_clean_scrub_stamp":"2024-09-14T11:24:09.066501+0000","objects_scrubbed":0,"log_size":79,"log_dups_size":200,"ondisk_log_size":79,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:12:05.681242+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2587,"num_read_kb":3188,"num_write":542,"num_write_kb":246,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.18","version":"0'0","reported_seq":39,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:59:08.431805+0000","last_change":"2024-09-14T11:58:43.686083+0000","last_active":"2024-09-14T12:59:08.431805+0000","last_peered":"2024-09-14T12:59:08.431805+0000","last_clean":"2024-09-14T12:59:08.431805+0000","last_became_active":"2024-09-14T11:58:43.685333+0000","last_became_peered":"2024-09-14T11:58:43.685333+0000","last_unstale":"2024-09-14T12:59:08.431805+0000","last_undegraded":"2024-09-14T12:59:08.431805+0000","last_fullsized":"2024-09-14T12:59:08.431805+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:58:42.635024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:58:42.635024+0000","last_clean_scrub_stamp":"2024-09-14T11:58:42.635024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:32:25.076693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"67.1f","version":"267'3","reported_seq":73,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:59:53.257511+0000","last_change":"2024-09-14T11:30:17.501198+0000","last_active":"2024-09-14T12:59:53.257511+0000","last_peered":"2024-09-14T12:59:53.257511+0000","last_clean":"2024-09-14T12:59:53.257511+0000","last_became_active":"2024-09-14T11:30:17.500369+0000","last_became_peered":"2024-09-14T11:30:17.500369+0000","last_unstale":"2024-09-14T12:59:53.257511+0000","last_undegraded":"2024-09-14T12:59:53.257511+0000","last_fullsized":"2024-09-14T12:59:53.257511+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:30:16.474654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:30:16.474654+0000","last_clean_scrub_stamp":"2024-09-14T11:30:16.474654+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:11:41.361082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4,"num_read_kb":8192,"num_write":3,"num_write_kb":8192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.1e","version":"264'4","reported_seq":84,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:58:42.824072+0000","last_change":"2024-09-14T11:30:10.446414+0000","last_active":"2024-09-14T12:58:42.824072+0000","last_peered":"2024-09-14T12:58:42.824072+0000","last_clean":"2024-09-14T12:58:42.824072+0000","last_became_active":"2024-09-14T11:30:10.445613+0000","last_became_peered":"2024-09-14T11:30:10.445613+0000","last_unstale":"2024-09-14T12:58:42.824072+0000","last_undegraded":"2024-09-14T12:58:42.824072+0000","last_fullsized":"2024-09-14T12:58:42.824072+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:30:09.411354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:30:09.411354+0000","last_clean_scrub_stamp":"2024-09-14T11:30:09.411354+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:21:50.415695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":4098,"num_write":4,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.1d","version":"267'16","reported_seq":119,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:59:13.248167+0000","last_change":"2024-09-14T11:24:10.112019+0000","last_active":"2024-09-14T12:59:13.248167+0000","last_peered":"2024-09-14T12:59:13.248167+0000","last_clean":"2024-09-14T12:59:13.248167+0000","last_became_active":"2024-09-14T11:24:10.111323+0000","last_became_peered":"2024-09-14T11:24:10.111323+0000","last_unstale":"2024-09-14T12:59:13.248167+0000","last_undegraded":"2024-09-14T12:59:13.248167+0000","last_fullsized":"2024-09-14T12:59:13.248167+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:24:09.066501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:24:09.066501+0000","last_clean_scrub_stamp":"2024-09-14T11:24:09.066501+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:39:25.435594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":134,"num_read_kb":93,"num_write":40,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.19","version":"0'0","reported_seq":39,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:59:18.471470+0000","last_change":"2024-09-14T11:58:43.701511+0000","last_active":"2024-09-14T12:59:18.471470+0000","last_peered":"2024-09-14T12:59:18.471470+0000","last_clean":"2024-09-14T12:59:18.471470+0000","last_became_active":"2024-09-14T11:58:43.700281+0000","last_became_peered":"2024-09-14T11:58:43.700281+0000","last_unstale":"2024-09-14T12:59:18.471470+0000","last_undegraded":"2024-09-14T12:59:18.471470+0000","last_fullsized":"2024-09-14T12:59:18.471470+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:58:42.635024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:58:42.635024+0000","last_clean_scrub_stamp":"2024-09-14T11:58:42.635024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:42:11.274748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.1e","version":"267'4","reported_seq":75,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:58:38.461692+0000","last_change":"2024-09-14T11:30:17.539744+0000","last_active":"2024-09-14T12:58:38.461692+0000","last_peered":"2024-09-14T12:58:38.461692+0000","last_clean":"2024-09-14T12:58:38.461692+0000","last_became_active":"2024-09-14T11:30:17.534642+0000","last_became_peered":"2024-09-14T11:30:17.534642+0000","last_unstale":"2024-09-14T12:58:38.461692+0000","last_undegraded":"2024-09-14T12:58:38.461692+0000","last_fullsized":"2024-09-14T12:58:38.461692+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:30:16.474654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:30:16.474654+0000","last_clean_scrub_stamp":"2024-09-14T11:30:16.474654+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:11:49.468312+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1088721,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":4,"num_read_kb":1064,"num_write":4,"num_write_kb":2088,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.1f","version":"267'1","reported_seq":74,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:59:48.243696+0000","last_change":"2024-09-14T11:30:10.443371+0000","last_active":"2024-09-14T12:59:48.243696+0000","last_peered":"2024-09-14T12:59:48.243696+0000","last_clean":"2024-09-14T12:59:48.243696+0000","last_became_active":"2024-09-14T11:30:10.442597+0000","last_became_peered":"2024-09-14T11:30:10.442597+0000","last_unstale":"2024-09-14T12:59:48.243696+0000","last_undegraded":"2024-09-14T12:59:48.243696+0000","last_fullsized":"2024-09-14T12:59:48.243696+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:30:09.411354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:30:09.411354+0000","last_clean_scrub_stamp":"2024-09-14T11:30:09.411354+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:25:51.419864+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1048576,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.1c","version":"267'41","reported_seq":188,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:59:13.470500+0000","last_change":"2024-09-14T11:24:10.128607+0000","last_active":"2024-09-14T12:59:13.470500+0000","last_peered":"2024-09-14T12:59:13.470500+0000","last_clean":"2024-09-14T12:59:13.470500+0000","last_became_active":"2024-09-14T11:24:10.124422+0000","last_became_peered":"2024-09-14T11:24:10.124422+0000","last_unstale":"2024-09-14T12:59:13.470500+0000","last_undegraded":"2024-09-14T12:59:13.470500+0000","last_fullsized":"2024-09-14T12:59:13.470500+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:24:09.066501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:24:09.066501+0000","last_clean_scrub_stamp":"2024-09-14T11:24:09.066501+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":0,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:13:03.605737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":350,"num_read_kb":247,"num_write":96,"num_write_kb":33,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.1e","version":"0'0","reported_seq":44,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:58:53.465451+0000","last_change":"2024-09-14T11:58:43.694842+0000","last_active":"2024-09-14T12:58:53.465451+0000","last_peered":"2024-09-14T12:58:53.465451+0000","last_clean":"2024-09-14T12:58:53.465451+0000","last_became_active":"2024-09-14T11:58:43.693760+0000","last_became_peered":"2024-09-14T11:58:43.693760+0000","last_unstale":"2024-09-14T12:58:53.465451+0000","last_undegraded":"2024-09-14T12:58:53.465451+0000","last_fullsized":"2024-09-14T12:58:53.465451+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:58:42.635024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:58:42.635024+0000","last_clean_scrub_stamp":"2024-09-14T11:58:42.635024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:18:34.791994+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.19","version":"0'0","reported_seq":60,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:57:43.030891+0000","last_change":"2024-09-14T11:30:17.531794+0000","last_active":"2024-09-14T12:57:43.030891+0000","last_peered":"2024-09-14T12:57:43.030891+0000","last_clean":"2024-09-14T12:57:43.030891+0000","last_became_active":"2024-09-14T11:30:17.531325+0000","last_became_peered":"2024-09-14T11:30:17.531325+0000","last_unstale":"2024-09-14T12:57:43.030891+0000","last_undegraded":"2024-09-14T12:57:43.030891+0000","last_fullsized":"2024-09-14T12:57:43.030891+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:30:16.474654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:30:16.474654+0000","last_clean_scrub_stamp":"2024-09-14T11:30:16.474654+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:04:12.434378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.18","version":"264'8","reported_seq":82,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:57:13.436998+0000","last_change":"2024-09-14T11:30:10.461819+0000","last_active":"2024-09-14T12:57:13.436998+0000","last_peered":"2024-09-14T12:57:13.436998+0000","last_clean":"2024-09-14T12:57:13.436998+0000","last_became_active":"2024-09-14T11:30:10.461101+0000","last_became_peered":"2024-09-14T11:30:10.461101+0000","last_unstale":"2024-09-14T12:57:13.436998+0000","last_undegraded":"2024-09-14T12:57:13.436998+0000","last_fullsized":"2024-09-14T12:57:13.436998+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:30:09.411354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:30:09.411354+0000","last_clean_scrub_stamp":"2024-09-14T11:30:09.411354+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:19:37.256749+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":8194,"num_write":18,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.1b","version":"264'28","reported_seq":149,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:59:13.470382+0000","last_change":"2024-09-14T11:24:10.130205+0000","last_active":"2024-09-14T12:59:13.470382+0000","last_peered":"2024-09-14T12:59:13.470382+0000","last_clean":"2024-09-14T12:59:13.470382+0000","last_became_active":"2024-09-14T11:24:10.129087+0000","last_became_peered":"2024-09-14T11:24:10.129087+0000","last_unstale":"2024-09-14T12:59:13.470382+0000","last_undegraded":"2024-09-14T12:59:13.470382+0000","last_fullsized":"2024-09-14T12:59:13.470382+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:24:09.066501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:24:09.066501+0000","last_clean_scrub_stamp":"2024-09-14T11:24:09.066501+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:55:41.881393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":229,"num_read_kb":159,"num_write":68,"num_write_kb":22,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.1f","version":"0'0","reported_seq":43,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:59:08.466883+0000","last_change":"2024-09-14T11:58:43.686856+0000","last_active":"2024-09-14T12:59:08.466883+0000","last_peered":"2024-09-14T12:59:08.466883+0000","last_clean":"2024-09-14T12:59:08.466883+0000","last_became_active":"2024-09-14T11:58:43.676679+0000","last_became_peered":"2024-09-14T11:58:43.676679+0000","last_unstale":"2024-09-14T12:59:08.466883+0000","last_undegraded":"2024-09-14T12:59:08.466883+0000","last_fullsized":"2024-09-14T12:59:08.466883+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:58:42.635024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:58:42.635024+0000","last_clean_scrub_stamp":"2024-09-14T11:58:42.635024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:32:45.311295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"67.18","version":"264'8","reported_seq":78,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:57:18.599896+0000","last_change":"2024-09-14T11:30:17.546333+0000","last_active":"2024-09-14T12:57:18.599896+0000","last_peered":"2024-09-14T12:57:18.599896+0000","last_clean":"2024-09-14T12:57:18.599896+0000","last_became_active":"2024-09-14T11:30:17.545478+0000","last_became_peered":"2024-09-14T11:30:17.545478+0000","last_unstale":"2024-09-14T12:57:18.599896+0000","last_undegraded":"2024-09-14T12:57:18.599896+0000","last_fullsized":"2024-09-14T12:57:18.599896+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:30:16.474654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:30:16.474654+0000","last_clean_scrub_stamp":"2024-09-14T11:30:16.474654+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:21:51.712103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":4166,"num_write":8,"num_write_kb":1092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"66.19","version":"267'5","reported_seq":74,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:57:33.212757+0000","last_change":"2024-09-14T11:30:10.467953+0000","last_active":"2024-09-14T12:57:33.212757+0000","last_peered":"2024-09-14T12:57:33.212757+0000","last_clean":"2024-09-14T12:57:33.212757+0000","last_became_active":"2024-09-14T11:30:10.467266+0000","last_became_peered":"2024-09-14T11:30:10.467266+0000","last_unstale":"2024-09-14T12:57:33.212757+0000","last_undegraded":"2024-09-14T12:57:33.212757+0000","last_fullsized":"2024-09-14T12:57:33.212757+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:30:09.411354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:30:09.411354+0000","last_clean_scrub_stamp":"2024-09-14T11:30:09.411354+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:25:57.710422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2097152,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":4,"num_read_kb":1047,"num_write":10,"num_write_kb":2071,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.1a","version":"267'87","reported_seq":314,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:59:13.433017+0000","last_change":"2024-09-14T11:24:10.121775+0000","last_active":"2024-09-14T12:59:13.433017+0000","last_peered":"2024-09-14T12:59:13.433017+0000","last_clean":"2024-09-14T12:59:13.433017+0000","last_became_active":"2024-09-14T11:24:10.121048+0000","last_became_peered":"2024-09-14T11:24:10.121048+0000","last_unstale":"2024-09-14T12:59:13.433017+0000","last_undegraded":"2024-09-14T12:59:13.433017+0000","last_fullsized":"2024-09-14T12:59:13.433017+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:24:09.066501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:24:09.066501+0000","last_clean_scrub_stamp":"2024-09-14T11:24:09.066501+0000","objects_scrubbed":0,"log_size":87,"log_dups_size":0,"ondisk_log_size":87,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:56:22.236572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":696,"num_read_kb":437,"num_write":216,"num_write_kb":62,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.1c","version":"267'1","reported_seq":39,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:58:47.835392+0000","last_change":"2024-09-14T11:58:43.685706+0000","last_active":"2024-09-14T12:58:47.835392+0000","last_peered":"2024-09-14T12:58:47.835392+0000","last_clean":"2024-09-14T12:58:47.835392+0000","last_became_active":"2024-09-14T11:58:43.684984+0000","last_became_peered":"2024-09-14T11:58:43.684984+0000","last_unstale":"2024-09-14T12:58:47.835392+0000","last_undegraded":"2024-09-14T12:58:47.835392+0000","last_fullsized":"2024-09-14T12:58:47.835392+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:58:42.635024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:58:42.635024+0000","last_clean_scrub_stamp":"2024-09-14T11:58:42.635024+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:29:12.171056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.1b","version":"0'0","reported_seq":59,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:57:48.606470+0000","last_change":"2024-09-14T11:30:17.527032+0000","last_active":"2024-09-14T12:57:48.606470+0000","last_peered":"2024-09-14T12:57:48.606470+0000","last_clean":"2024-09-14T12:57:48.606470+0000","last_became_active":"2024-09-14T11:30:17.526195+0000","last_became_peered":"2024-09-14T11:30:17.526195+0000","last_unstale":"2024-09-14T12:57:48.606470+0000","last_undegraded":"2024-09-14T12:57:48.606470+0000","last_fullsized":"2024-09-14T12:57:48.606470+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:30:16.474654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:30:16.474654+0000","last_clean_scrub_stamp":"2024-09-14T11:30:16.474654+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:49:29.835475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"66.1a","version":"264'2","reported_seq":69,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:57:43.214859+0000","last_change":"2024-09-14T11:30:10.443423+0000","last_active":"2024-09-14T12:57:43.214859+0000","last_peered":"2024-09-14T12:57:43.214859+0000","last_clean":"2024-09-14T12:57:43.214859+0000","last_became_active":"2024-09-14T11:30:10.442753+0000","last_became_peered":"2024-09-14T11:30:10.442753+0000","last_unstale":"2024-09-14T12:57:43.214859+0000","last_undegraded":"2024-09-14T12:57:43.214859+0000","last_fullsized":"2024-09-14T12:57:43.214859+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:30:09.411354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:30:09.411354+0000","last_clean_scrub_stamp":"2024-09-14T11:30:09.411354+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:17:07.453981+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":4096,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.19","version":"267'12","reported_seq":105,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:58:53.242473+0000","last_change":"2024-09-14T11:24:10.099618+0000","last_active":"2024-09-14T12:58:53.242473+0000","last_peered":"2024-09-14T12:58:53.242473+0000","last_clean":"2024-09-14T12:58:53.242473+0000","last_became_active":"2024-09-14T11:24:10.098890+0000","last_became_peered":"2024-09-14T11:24:10.098890+0000","last_unstale":"2024-09-14T12:58:53.242473+0000","last_undegraded":"2024-09-14T12:58:53.242473+0000","last_fullsized":"2024-09-14T12:58:53.242473+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:24:09.066501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:24:09.066501+0000","last_clean_scrub_stamp":"2024-09-14T11:24:09.066501+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:33:18.468820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":81,"num_read_kb":53,"num_write":29,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.1d","version":"0'0","reported_seq":38,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:58:47.835476+0000","last_change":"2024-09-14T11:58:43.688034+0000","last_active":"2024-09-14T12:58:47.835476+0000","last_peered":"2024-09-14T12:58:47.835476+0000","last_clean":"2024-09-14T12:58:47.835476+0000","last_became_active":"2024-09-14T11:58:43.687072+0000","last_became_peered":"2024-09-14T11:58:43.687072+0000","last_unstale":"2024-09-14T12:58:47.835476+0000","last_undegraded":"2024-09-14T12:58:47.835476+0000","last_fullsized":"2024-09-14T12:58:47.835476+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:58:42.635024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:58:42.635024+0000","last_clean_scrub_stamp":"2024-09-14T11:58:42.635024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:54:30.111603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.1a","version":"0'0","reported_seq":59,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:57:48.450199+0000","last_change":"2024-09-14T11:30:17.535485+0000","last_active":"2024-09-14T12:57:48.450199+0000","last_peered":"2024-09-14T12:57:48.450199+0000","last_clean":"2024-09-14T12:57:48.450199+0000","last_became_active":"2024-09-14T11:30:17.534937+0000","last_became_peered":"2024-09-14T11:30:17.534937+0000","last_unstale":"2024-09-14T12:57:48.450199+0000","last_undegraded":"2024-09-14T12:57:48.450199+0000","last_fullsized":"2024-09-14T12:57:48.450199+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:30:16.474654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:30:16.474654+0000","last_clean_scrub_stamp":"2024-09-14T11:30:16.474654+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:48:56.727170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.1b","version":"267'4","reported_seq":74,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:57:43.444836+0000","last_change":"2024-09-14T11:30:10.461481+0000","last_active":"2024-09-14T12:57:43.444836+0000","last_peered":"2024-09-14T12:57:43.444836+0000","last_clean":"2024-09-14T12:57:43.444836+0000","last_became_active":"2024-09-14T11:30:10.460666+0000","last_became_peered":"2024-09-14T11:30:10.460666+0000","last_unstale":"2024-09-14T12:57:43.444836+0000","last_undegraded":"2024-09-14T12:57:43.444836+0000","last_fullsized":"2024-09-14T12:57:43.444836+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:30:09.411354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:30:09.411354+0000","last_clean_scrub_stamp":"2024-09-14T11:30:09.411354+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:56:08.121178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":6,"num_read_kb":14336,"num_write":4,"num_write_kb":10240,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.18","version":"267'142","reported_seq":495,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:58:28.457825+0000","last_change":"2024-09-14T11:24:10.121116+0000","last_active":"2024-09-14T12:58:28.457825+0000","last_peered":"2024-09-14T12:58:28.457825+0000","last_clean":"2024-09-14T12:58:28.457825+0000","last_became_active":"2024-09-14T11:24:10.117854+0000","last_became_peered":"2024-09-14T11:24:10.117854+0000","last_unstale":"2024-09-14T12:58:28.457825+0000","last_undegraded":"2024-09-14T12:58:28.457825+0000","last_fullsized":"2024-09-14T12:58:28.457825+0000","mapping_epoch":254,"log_start":"264'100","ondisk_log_start":"264'100","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:24:09.066501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:24:09.066501+0000","last_clean_scrub_stamp":"2024-09-14T11:24:09.066501+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":100,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:44:16.667239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1285,"num_read_kb":1365,"num_write":297,"num_write_kb":120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"68.12","version":"0'0","reported_seq":40,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:59:23.469971+0000","last_change":"2024-09-14T11:58:43.678310+0000","last_active":"2024-09-14T12:59:23.469971+0000","last_peered":"2024-09-14T12:59:23.469971+0000","last_clean":"2024-09-14T12:59:23.469971+0000","last_became_active":"2024-09-14T11:58:43.675254+0000","last_became_peered":"2024-09-14T11:58:43.675254+0000","last_unstale":"2024-09-14T12:59:23.469971+0000","last_undegraded":"2024-09-14T12:59:23.469971+0000","last_fullsized":"2024-09-14T12:59:23.469971+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:58:42.635024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:58:42.635024+0000","last_clean_scrub_stamp":"2024-09-14T11:58:42.635024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:53:22.218376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"67.15","version":"267'1","reported_seq":63,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:57:18.439393+0000","last_change":"2024-09-14T11:30:17.539875+0000","last_active":"2024-09-14T12:57:18.439393+0000","last_peered":"2024-09-14T12:57:18.439393+0000","last_clean":"2024-09-14T12:57:18.439393+0000","last_became_active":"2024-09-14T11:30:17.536010+0000","last_became_peered":"2024-09-14T11:30:17.536010+0000","last_unstale":"2024-09-14T12:57:18.439393+0000","last_undegraded":"2024-09-14T12:57:18.439393+0000","last_fullsized":"2024-09-14T12:57:18.439393+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:30:16.474654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:30:16.474654+0000","last_clean_scrub_stamp":"2024-09-14T11:30:16.474654+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:50:45.649965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":8192,"num_write":1,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.14","version":"267'4","reported_seq":75,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:59:18.052199+0000","last_change":"2024-09-14T11:30:10.463826+0000","last_active":"2024-09-14T12:59:18.052199+0000","last_peered":"2024-09-14T12:59:18.052199+0000","last_clean":"2024-09-14T12:59:18.052199+0000","last_became_active":"2024-09-14T11:30:10.462605+0000","last_became_peered":"2024-09-14T11:30:10.462605+0000","last_unstale":"2024-09-14T12:59:18.052199+0000","last_undegraded":"2024-09-14T12:59:18.052199+0000","last_fullsized":"2024-09-14T12:59:18.052199+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:30:09.411354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:30:09.411354+0000","last_clean_scrub_stamp":"2024-09-14T11:30:09.411354+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:10:34.672801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4,"num_read_kb":5120,"num_write":9,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.17","version":"267'12","reported_seq":105,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:58:28.236663+0000","last_change":"2024-09-14T11:24:10.104884+0000","last_active":"2024-09-14T12:58:28.236663+0000","last_peered":"2024-09-14T12:58:28.236663+0000","last_clean":"2024-09-14T12:58:28.236663+0000","last_became_active":"2024-09-14T11:24:10.101934+0000","last_became_peered":"2024-09-14T11:24:10.101934+0000","last_unstale":"2024-09-14T12:58:28.236663+0000","last_undegraded":"2024-09-14T12:58:28.236663+0000","last_fullsized":"2024-09-14T12:58:28.236663+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:24:09.066501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:24:09.066501+0000","last_clean_scrub_stamp":"2024-09-14T11:24:09.066501+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:18:41.803884+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":86,"num_read_kb":56,"num_write":31,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.13","version":"267'1","reported_seq":41,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:59:22.832843+0000","last_change":"2024-09-14T11:58:43.676310+0000","last_active":"2024-09-14T12:59:22.832843+0000","last_peered":"2024-09-14T12:59:22.832843+0000","last_clean":"2024-09-14T12:59:22.832843+0000","last_became_active":"2024-09-14T11:58:43.675526+0000","last_became_peered":"2024-09-14T11:58:43.675526+0000","last_unstale":"2024-09-14T12:59:22.832843+0000","last_undegraded":"2024-09-14T12:59:22.832843+0000","last_fullsized":"2024-09-14T12:59:22.832843+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:58:42.635024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:58:42.635024+0000","last_clean_scrub_stamp":"2024-09-14T11:58:42.635024+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:44:06.879207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.14","version":"267'6","reported_seq":75,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:59:18.471550+0000","last_change":"2024-09-14T11:30:17.544306+0000","last_active":"2024-09-14T12:59:18.471550+0000","last_peered":"2024-09-14T12:59:18.471550+0000","last_clean":"2024-09-14T12:59:18.471550+0000","last_became_active":"2024-09-14T11:30:17.543741+0000","last_became_peered":"2024-09-14T11:30:17.543741+0000","last_unstale":"2024-09-14T12:59:18.471550+0000","last_undegraded":"2024-09-14T12:59:18.471550+0000","last_fullsized":"2024-09-14T12:59:18.471550+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:30:16.474654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:30:16.474654+0000","last_clean_scrub_stamp":"2024-09-14T11:30:16.474654+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:33:14.837541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":10,"num_read_kb":20482,"num_write":11,"num_write_kb":8192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.15","version":"267'2","reported_seq":70,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:57:12.813093+0000","last_change":"2024-09-14T11:30:10.468990+0000","last_active":"2024-09-14T12:57:12.813093+0000","last_peered":"2024-09-14T12:57:12.813093+0000","last_clean":"2024-09-14T12:57:12.813093+0000","last_became_active":"2024-09-14T11:30:10.468238+0000","last_became_peered":"2024-09-14T11:30:10.468238+0000","last_unstale":"2024-09-14T12:57:12.813093+0000","last_undegraded":"2024-09-14T12:57:12.813093+0000","last_fullsized":"2024-09-14T12:57:12.813093+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:30:09.411354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:30:09.411354+0000","last_clean_scrub_stamp":"2024-09-14T11:30:09.411354+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:48:16.808159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1048576,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2048,"num_write":7,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.16","version":"267'33","reported_seq":168,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:58:28.459408+0000","last_change":"2024-09-14T11:24:10.129833+0000","last_active":"2024-09-14T12:58:28.459408+0000","last_peered":"2024-09-14T12:58:28.459408+0000","last_clean":"2024-09-14T12:58:28.459408+0000","last_became_active":"2024-09-14T11:24:10.128354+0000","last_became_peered":"2024-09-14T11:24:10.128354+0000","last_unstale":"2024-09-14T12:58:28.459408+0000","last_undegraded":"2024-09-14T12:58:28.459408+0000","last_fullsized":"2024-09-14T12:58:28.459408+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:24:09.066501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:24:09.066501+0000","last_clean_scrub_stamp":"2024-09-14T11:24:09.066501+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:04:36.875537+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":269,"num_read_kb":173,"num_write":83,"num_write_kb":23,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.10","version":"0'0","reported_seq":40,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:59:27.844631+0000","last_change":"2024-09-14T11:58:43.689414+0000","last_active":"2024-09-14T12:59:27.844631+0000","last_peered":"2024-09-14T12:59:27.844631+0000","last_clean":"2024-09-14T12:59:27.844631+0000","last_became_active":"2024-09-14T11:58:43.688698+0000","last_became_peered":"2024-09-14T11:58:43.688698+0000","last_unstale":"2024-09-14T12:59:27.844631+0000","last_undegraded":"2024-09-14T12:59:27.844631+0000","last_fullsized":"2024-09-14T12:59:27.844631+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:58:42.635024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:58:42.635024+0000","last_clean_scrub_stamp":"2024-09-14T11:58:42.635024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:13:07.184551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.17","version":"267'3","reported_seq":68,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:57:18.439507+0000","last_change":"2024-09-14T11:30:17.544374+0000","last_active":"2024-09-14T12:57:18.439507+0000","last_peered":"2024-09-14T12:57:18.439507+0000","last_clean":"2024-09-14T12:57:18.439507+0000","last_became_active":"2024-09-14T11:30:17.543802+0000","last_became_peered":"2024-09-14T11:30:17.543802+0000","last_unstale":"2024-09-14T12:57:18.439507+0000","last_undegraded":"2024-09-14T12:57:18.439507+0000","last_fullsized":"2024-09-14T12:57:18.439507+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:30:16.474654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:30:16.474654+0000","last_clean_scrub_stamp":"2024-09-14T11:30:16.474654+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:16:04.970158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":5,"num_read_kb":20480,"num_write":8,"num_write_kb":8192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.16","version":"264'4","reported_seq":76,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:57:12.805460+0000","last_change":"2024-09-14T11:30:10.472659+0000","last_active":"2024-09-14T12:57:12.805460+0000","last_peered":"2024-09-14T12:57:12.805460+0000","last_clean":"2024-09-14T12:57:12.805460+0000","last_became_active":"2024-09-14T11:30:10.471956+0000","last_became_peered":"2024-09-14T11:30:10.471956+0000","last_unstale":"2024-09-14T12:57:12.805460+0000","last_undegraded":"2024-09-14T12:57:12.805460+0000","last_fullsized":"2024-09-14T12:57:12.805460+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:30:09.411354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:30:09.411354+0000","last_clean_scrub_stamp":"2024-09-14T11:30:09.411354+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:46:34.361903+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":4098,"num_write":4,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.15","version":"267'34","reported_seq":165,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:58:27.820574+0000","last_change":"2024-09-14T11:24:10.097703+0000","last_active":"2024-09-14T12:58:27.820574+0000","last_peered":"2024-09-14T12:58:27.820574+0000","last_clean":"2024-09-14T12:58:27.820574+0000","last_became_active":"2024-09-14T11:24:10.097011+0000","last_became_peered":"2024-09-14T11:24:10.097011+0000","last_unstale":"2024-09-14T12:58:27.820574+0000","last_undegraded":"2024-09-14T12:58:27.820574+0000","last_fullsized":"2024-09-14T12:58:27.820574+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:24:09.066501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:24:09.066501+0000","last_clean_scrub_stamp":"2024-09-14T11:24:09.066501+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:37:34.066370+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":263,"num_read_kb":166,"num_write":89,"num_write_kb":24,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.11","version":"0'0","reported_seq":40,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:59:23.053229+0000","last_change":"2024-09-14T11:58:43.689926+0000","last_active":"2024-09-14T12:59:23.053229+0000","last_peered":"2024-09-14T12:59:23.053229+0000","last_clean":"2024-09-14T12:59:23.053229+0000","last_became_active":"2024-09-14T11:58:43.688315+0000","last_became_peered":"2024-09-14T11:58:43.688315+0000","last_unstale":"2024-09-14T12:59:23.053229+0000","last_undegraded":"2024-09-14T12:59:23.053229+0000","last_fullsized":"2024-09-14T12:59:23.053229+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:58:42.635024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:58:42.635024+0000","last_clean_scrub_stamp":"2024-09-14T11:58:42.635024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:41:40.616158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.16","version":"0'0","reported_seq":60,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:57:18.209507+0000","last_change":"2024-09-14T11:30:17.529543+0000","last_active":"2024-09-14T12:57:18.209507+0000","last_peered":"2024-09-14T12:57:18.209507+0000","last_clean":"2024-09-14T12:57:18.209507+0000","last_became_active":"2024-09-14T11:30:17.528777+0000","last_became_peered":"2024-09-14T11:30:17.528777+0000","last_unstale":"2024-09-14T12:57:18.209507+0000","last_undegraded":"2024-09-14T12:57:18.209507+0000","last_fullsized":"2024-09-14T12:57:18.209507+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:30:16.474654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:30:16.474654+0000","last_clean_scrub_stamp":"2024-09-14T11:30:16.474654+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:39:05.624425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.17","version":"267'2","reported_seq":70,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:57:13.437466+0000","last_change":"2024-09-14T11:30:10.473815+0000","last_active":"2024-09-14T12:57:13.437466+0000","last_peered":"2024-09-14T12:57:13.437466+0000","last_clean":"2024-09-14T12:57:13.437466+0000","last_became_active":"2024-09-14T11:30:10.469237+0000","last_became_peered":"2024-09-14T11:30:10.469237+0000","last_unstale":"2024-09-14T12:57:13.437466+0000","last_undegraded":"2024-09-14T12:57:13.437466+0000","last_fullsized":"2024-09-14T12:57:13.437466+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:30:09.411354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:30:09.411354+0000","last_clean_scrub_stamp":"2024-09-14T11:30:09.411354+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:02:16.697692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4908529,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":4794,"num_write":2,"num_write_kb":4794,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.14","version":"267'34","reported_seq":163,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:58:02.824925+0000","last_change":"2024-09-14T11:24:10.120917+0000","last_active":"2024-09-14T12:58:02.824925+0000","last_peered":"2024-09-14T12:58:02.824925+0000","last_clean":"2024-09-14T12:58:02.824925+0000","last_became_active":"2024-09-14T11:24:10.120143+0000","last_became_peered":"2024-09-14T11:24:10.120143+0000","last_unstale":"2024-09-14T12:58:02.824925+0000","last_undegraded":"2024-09-14T12:58:02.824925+0000","last_fullsized":"2024-09-14T12:58:02.824925+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:24:09.066501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:24:09.066501+0000","last_clean_scrub_stamp":"2024-09-14T11:24:09.066501+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:47:01.835320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":239,"num_read_kb":157,"num_write":95,"num_write_kb":23,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.16","version":"0'0","reported_seq":39,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:59:08.469272+0000","last_change":"2024-09-14T11:58:43.687060+0000","last_active":"2024-09-14T12:59:08.469272+0000","last_peered":"2024-09-14T12:59:08.469272+0000","last_clean":"2024-09-14T12:59:08.469272+0000","last_became_active":"2024-09-14T11:58:43.685594+0000","last_became_peered":"2024-09-14T11:58:43.685594+0000","last_unstale":"2024-09-14T12:59:08.469272+0000","last_undegraded":"2024-09-14T12:59:08.469272+0000","last_fullsized":"2024-09-14T12:59:08.469272+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:58:42.635024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:58:42.635024+0000","last_clean_scrub_stamp":"2024-09-14T11:58:42.635024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:15:01.961069+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.11","version":"264'4","reported_seq":72,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:58:58.464568+0000","last_change":"2024-09-14T11:30:17.524449+0000","last_active":"2024-09-14T12:58:58.464568+0000","last_peered":"2024-09-14T12:58:58.464568+0000","last_clean":"2024-09-14T12:58:58.464568+0000","last_became_active":"2024-09-14T11:30:17.523720+0000","last_became_peered":"2024-09-14T11:30:17.523720+0000","last_unstale":"2024-09-14T12:58:58.464568+0000","last_undegraded":"2024-09-14T12:58:58.464568+0000","last_fullsized":"2024-09-14T12:58:58.464568+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:30:16.474654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:30:16.474654+0000","last_clean_scrub_stamp":"2024-09-14T11:30:16.474654+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:47:46.829903+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":4098,"num_write":4,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.10","version":"264'2","reported_seq":72,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:58:53.231284+0000","last_change":"2024-09-14T11:30:10.464461+0000","last_active":"2024-09-14T12:58:53.231284+0000","last_peered":"2024-09-14T12:58:53.231284+0000","last_clean":"2024-09-14T12:58:53.231284+0000","last_became_active":"2024-09-14T11:30:10.463671+0000","last_became_peered":"2024-09-14T11:30:10.463671+0000","last_unstale":"2024-09-14T12:58:53.231284+0000","last_undegraded":"2024-09-14T12:58:53.231284+0000","last_fullsized":"2024-09-14T12:58:53.231284+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:30:09.411354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:30:09.411354+0000","last_clean_scrub_stamp":"2024-09-14T11:30:09.411354+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:20:15.603839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":4096,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.13","version":"267'23","reported_seq":139,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:57:32.817933+0000","last_change":"2024-09-14T11:24:10.121802+0000","last_active":"2024-09-14T12:57:32.817933+0000","last_peered":"2024-09-14T12:57:32.817933+0000","last_clean":"2024-09-14T12:57:32.817933+0000","last_became_active":"2024-09-14T11:24:10.120764+0000","last_became_peered":"2024-09-14T11:24:10.120764+0000","last_unstale":"2024-09-14T12:57:32.817933+0000","last_undegraded":"2024-09-14T12:57:32.817933+0000","last_fullsized":"2024-09-14T12:57:32.817933+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:24:09.066501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:24:09.066501+0000","last_clean_scrub_stamp":"2024-09-14T11:24:09.066501+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:38:35.957872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":187,"num_read_kb":128,"num_write":64,"num_write_kb":17,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.17","version":"0'0","reported_seq":39,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:59:08.247094+0000","last_change":"2024-09-14T11:58:43.677764+0000","last_active":"2024-09-14T12:59:08.247094+0000","last_peered":"2024-09-14T12:59:08.247094+0000","last_clean":"2024-09-14T12:59:08.247094+0000","last_became_active":"2024-09-14T11:58:43.677005+0000","last_became_peered":"2024-09-14T11:58:43.677005+0000","last_unstale":"2024-09-14T12:59:08.247094+0000","last_undegraded":"2024-09-14T12:59:08.247094+0000","last_fullsized":"2024-09-14T12:59:08.247094+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:58:42.635024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:58:42.635024+0000","last_clean_scrub_stamp":"2024-09-14T11:58:42.635024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:38:06.608929+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.10","version":"267'2","reported_seq":66,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:58:58.464483+0000","last_change":"2024-09-14T11:30:17.510820+0000","last_active":"2024-09-14T12:58:58.464483+0000","last_peered":"2024-09-14T12:58:58.464483+0000","last_clean":"2024-09-14T12:58:58.464483+0000","last_became_active":"2024-09-14T11:30:17.510031+0000","last_became_peered":"2024-09-14T11:30:17.510031+0000","last_unstale":"2024-09-14T12:58:58.464483+0000","last_undegraded":"2024-09-14T12:58:58.464483+0000","last_fullsized":"2024-09-14T12:58:58.464483+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:30:16.474654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:30:16.474654+0000","last_clean_scrub_stamp":"2024-09-14T11:30:16.474654+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:53:33.188778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2097152,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2048,"num_write":2,"num_write_kb":2048,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.11","version":"0'0","reported_seq":68,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:58:53.465194+0000","last_change":"2024-09-14T11:30:10.468119+0000","last_active":"2024-09-14T12:58:53.465194+0000","last_peered":"2024-09-14T12:58:53.465194+0000","last_clean":"2024-09-14T12:58:53.465194+0000","last_became_active":"2024-09-14T11:30:10.459020+0000","last_became_peered":"2024-09-14T11:30:10.459020+0000","last_unstale":"2024-09-14T12:58:53.465194+0000","last_undegraded":"2024-09-14T12:58:53.465194+0000","last_fullsized":"2024-09-14T12:58:53.465194+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:30:09.411354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:30:09.411354+0000","last_clean_scrub_stamp":"2024-09-14T11:30:09.411354+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:19:33.421651+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.12","version":"267'21","reported_seq":135,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:57:33.442363+0000","last_change":"2024-09-14T11:24:10.125240+0000","last_active":"2024-09-14T12:57:33.442363+0000","last_peered":"2024-09-14T12:57:33.442363+0000","last_clean":"2024-09-14T12:57:33.442363+0000","last_became_active":"2024-09-14T11:24:10.124482+0000","last_became_peered":"2024-09-14T11:24:10.124482+0000","last_unstale":"2024-09-14T12:57:33.442363+0000","last_undegraded":"2024-09-14T12:57:33.442363+0000","last_fullsized":"2024-09-14T12:57:33.442363+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:24:09.066501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:24:09.066501+0000","last_clean_scrub_stamp":"2024-09-14T11:24:09.066501+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:42:43.834915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":165,"num_read_kb":113,"num_write":54,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.14","version":"266'1","reported_seq":40,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:57:18.438576+0000","last_change":"2024-09-14T11:58:43.676454+0000","last_active":"2024-09-14T12:57:18.438576+0000","last_peered":"2024-09-14T12:57:18.438576+0000","last_clean":"2024-09-14T12:57:18.438576+0000","last_became_active":"2024-09-14T11:58:43.675734+0000","last_became_peered":"2024-09-14T11:58:43.675734+0000","last_unstale":"2024-09-14T12:57:18.438576+0000","last_undegraded":"2024-09-14T12:57:18.438576+0000","last_fullsized":"2024-09-14T12:57:18.438576+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:58:42.635024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:58:42.635024+0000","last_clean_scrub_stamp":"2024-09-14T11:58:42.635024+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:41:40.899244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.13","version":"267'6","reported_seq":72,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:58:58.466747+0000","last_change":"2024-09-14T11:30:17.546653+0000","last_active":"2024-09-14T12:58:58.466747+0000","last_peered":"2024-09-14T12:58:58.466747+0000","last_clean":"2024-09-14T12:58:58.466747+0000","last_became_active":"2024-09-14T11:30:17.545560+0000","last_became_peered":"2024-09-14T11:30:17.545560+0000","last_unstale":"2024-09-14T12:58:58.466747+0000","last_undegraded":"2024-09-14T12:58:58.466747+0000","last_fullsized":"2024-09-14T12:58:58.466747+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:30:16.474654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:30:16.474654+0000","last_clean_scrub_stamp":"2024-09-14T11:30:16.474654+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:05:50.325352+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":5,"num_read_kb":9216,"num_write":16,"num_write_kb":9216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.12","version":"267'7","reported_seq":81,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:58:53.428614+0000","last_change":"2024-09-14T11:30:10.475068+0000","last_active":"2024-09-14T12:58:53.428614+0000","last_peered":"2024-09-14T12:58:53.428614+0000","last_clean":"2024-09-14T12:58:53.428614+0000","last_became_active":"2024-09-14T11:30:10.474328+0000","last_became_peered":"2024-09-14T11:30:10.474328+0000","last_unstale":"2024-09-14T12:58:53.428614+0000","last_undegraded":"2024-09-14T12:58:53.428614+0000","last_fullsized":"2024-09-14T12:58:53.428614+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:30:09.411354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:30:09.411354+0000","last_clean_scrub_stamp":"2024-09-14T11:30:09.411354+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:23:43.643876+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":9,"num_read_kb":16386,"num_write":17,"num_write_kb":8192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"65.11","version":"267'78","reported_seq":292,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:57:33.212715+0000","last_change":"2024-09-14T11:24:10.107937+0000","last_active":"2024-09-14T12:57:33.212715+0000","last_peered":"2024-09-14T12:57:33.212715+0000","last_clean":"2024-09-14T12:57:33.212715+0000","last_became_active":"2024-09-14T11:24:10.107177+0000","last_became_peered":"2024-09-14T11:24:10.107177+0000","last_unstale":"2024-09-14T12:57:33.212715+0000","last_undegraded":"2024-09-14T12:57:33.212715+0000","last_fullsized":"2024-09-14T12:57:33.212715+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:24:09.066501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:24:09.066501+0000","last_clean_scrub_stamp":"2024-09-14T11:24:09.066501+0000","objects_scrubbed":0,"log_size":78,"log_dups_size":0,"ondisk_log_size":78,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:27:38.912018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":655,"num_read_kb":451,"num_write":184,"num_write_kb":61,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"68.15","version":"267'1","reported_seq":40,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:59:08.469167+0000","last_change":"2024-09-14T11:58:43.694184+0000","last_active":"2024-09-14T12:59:08.469167+0000","last_peered":"2024-09-14T12:59:08.469167+0000","last_clean":"2024-09-14T12:59:08.469167+0000","last_became_active":"2024-09-14T11:58:43.692552+0000","last_became_peered":"2024-09-14T11:58:43.692552+0000","last_unstale":"2024-09-14T12:59:08.469167+0000","last_undegraded":"2024-09-14T12:59:08.469167+0000","last_fullsized":"2024-09-14T12:59:08.469167+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:58:42.635024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:58:42.635024+0000","last_clean_scrub_stamp":"2024-09-14T11:58:42.635024+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:25:30.983665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.12","version":"267'2","reported_seq":64,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:58:58.429703+0000","last_change":"2024-09-14T11:30:17.524803+0000","last_active":"2024-09-14T12:58:58.429703+0000","last_peered":"2024-09-14T12:58:58.429703+0000","last_clean":"2024-09-14T12:58:58.429703+0000","last_became_active":"2024-09-14T11:30:17.523975+0000","last_became_peered":"2024-09-14T11:30:17.523975+0000","last_unstale":"2024-09-14T12:58:58.429703+0000","last_undegraded":"2024-09-14T12:58:58.429703+0000","last_fullsized":"2024-09-14T12:58:58.429703+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:30:16.474654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:30:16.474654+0000","last_clean_scrub_stamp":"2024-09-14T11:30:16.474654+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:12:00.068952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1048576,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"66.13","version":"267'1","reported_seq":69,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:58:53.046680+0000","last_change":"2024-09-14T11:30:10.470996+0000","last_active":"2024-09-14T12:58:53.046680+0000","last_peered":"2024-09-14T12:58:53.046680+0000","last_clean":"2024-09-14T12:58:53.046680+0000","last_became_active":"2024-09-14T11:30:10.467218+0000","last_became_peered":"2024-09-14T11:30:10.467218+0000","last_unstale":"2024-09-14T12:58:53.046680+0000","last_undegraded":"2024-09-14T12:58:53.046680+0000","last_fullsized":"2024-09-14T12:58:53.046680+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:30:09.411354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:30:09.411354+0000","last_clean_scrub_stamp":"2024-09-14T11:30:09.411354+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:14:13.258206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1048576,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.10","version":"267'25","reported_seq":142,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:57:33.446193+0000","last_change":"2024-09-14T11:24:10.128983+0000","last_active":"2024-09-14T12:57:33.446193+0000","last_peered":"2024-09-14T12:57:33.446193+0000","last_clean":"2024-09-14T12:57:33.446193+0000","last_became_active":"2024-09-14T11:24:10.124485+0000","last_became_peered":"2024-09-14T11:24:10.124485+0000","last_unstale":"2024-09-14T12:57:33.446193+0000","last_undegraded":"2024-09-14T12:57:33.446193+0000","last_fullsized":"2024-09-14T12:57:33.446193+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:24:09.066501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:24:09.066501+0000","last_clean_scrub_stamp":"2024-09-14T11:24:09.066501+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:05:55.111756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":199,"num_read_kb":137,"num_write":62,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.a","version":"0'0","reported_seq":42,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:59:42.836938+0000","last_change":"2024-09-14T11:58:43.665808+0000","last_active":"2024-09-14T12:59:42.836938+0000","last_peered":"2024-09-14T12:59:42.836938+0000","last_clean":"2024-09-14T12:59:42.836938+0000","last_became_active":"2024-09-14T11:58:43.665150+0000","last_became_peered":"2024-09-14T11:58:43.665150+0000","last_unstale":"2024-09-14T12:59:42.836938+0000","last_undegraded":"2024-09-14T12:59:42.836938+0000","last_fullsized":"2024-09-14T12:59:42.836938+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:58:42.635024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:58:42.635024+0000","last_clean_scrub_stamp":"2024-09-14T11:58:42.635024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:47:00.404652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.d","version":"0'0","reported_seq":63,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:58:03.453801+0000","last_change":"2024-09-14T11:30:17.541032+0000","last_active":"2024-09-14T12:58:03.453801+0000","last_peered":"2024-09-14T12:58:03.453801+0000","last_clean":"2024-09-14T12:58:03.453801+0000","last_became_active":"2024-09-14T11:30:17.540505+0000","last_became_peered":"2024-09-14T11:30:17.540505+0000","last_unstale":"2024-09-14T12:58:03.453801+0000","last_undegraded":"2024-09-14T12:58:03.453801+0000","last_fullsized":"2024-09-14T12:58:03.453801+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:30:16.474654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:30:16.474654+0000","last_clean_scrub_stamp":"2024-09-14T11:30:16.474654+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:19:58.382345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.c","version":"264'2","reported_seq":73,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:57:57.823794+0000","last_change":"2024-09-14T11:30:10.465578+0000","last_active":"2024-09-14T12:57:57.823794+0000","last_peered":"2024-09-14T12:57:57.823794+0000","last_clean":"2024-09-14T12:57:57.823794+0000","last_became_active":"2024-09-14T11:30:10.464846+0000","last_became_peered":"2024-09-14T11:30:10.464846+0000","last_unstale":"2024-09-14T12:57:57.823794+0000","last_undegraded":"2024-09-14T12:57:57.823794+0000","last_fullsized":"2024-09-14T12:57:57.823794+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:30:09.411354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:30:09.411354+0000","last_clean_scrub_stamp":"2024-09-14T11:30:09.411354+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:16:48.115696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":4096,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.f","version":"267'23","reported_seq":140,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:59:03.468003+0000","last_change":"2024-09-14T11:24:10.122374+0000","last_active":"2024-09-14T12:59:03.468003+0000","last_peered":"2024-09-14T12:59:03.468003+0000","last_clean":"2024-09-14T12:59:03.468003+0000","last_became_active":"2024-09-14T11:24:10.121456+0000","last_became_peered":"2024-09-14T11:24:10.121456+0000","last_unstale":"2024-09-14T12:59:03.468003+0000","last_undegraded":"2024-09-14T12:59:03.468003+0000","last_fullsized":"2024-09-14T12:59:03.468003+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:24:09.066501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:24:09.066501+0000","last_clean_scrub_stamp":"2024-09-14T11:24:09.066501+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:09:06.754571+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":176,"num_read_kb":127,"num_write":57,"num_write_kb":16,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.b","version":"0'0","reported_seq":41,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:59:32.845960+0000","last_change":"2024-09-14T11:58:43.685677+0000","last_active":"2024-09-14T12:59:32.845960+0000","last_peered":"2024-09-14T12:59:32.845960+0000","last_clean":"2024-09-14T12:59:32.845960+0000","last_became_active":"2024-09-14T11:58:43.684927+0000","last_became_peered":"2024-09-14T11:58:43.684927+0000","last_unstale":"2024-09-14T12:59:32.845960+0000","last_undegraded":"2024-09-14T12:59:32.845960+0000","last_fullsized":"2024-09-14T12:59:32.845960+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:58:42.635024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:58:42.635024+0000","last_clean_scrub_stamp":"2024-09-14T11:58:42.635024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:58:14.472771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.c","version":"267'7","reported_seq":76,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:58:03.453730+0000","last_change":"2024-09-14T11:30:17.535765+0000","last_active":"2024-09-14T12:58:03.453730+0000","last_peered":"2024-09-14T12:58:03.453730+0000","last_clean":"2024-09-14T12:58:03.453730+0000","last_became_active":"2024-09-14T11:30:17.535131+0000","last_became_peered":"2024-09-14T11:30:17.535131+0000","last_unstale":"2024-09-14T12:58:03.453730+0000","last_undegraded":"2024-09-14T12:58:03.453730+0000","last_fullsized":"2024-09-14T12:58:03.453730+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:30:16.474654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:30:16.474654+0000","last_clean_scrub_stamp":"2024-09-14T11:30:16.474654+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:06:05.667984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":8,"num_read_kb":16384,"num_write":12,"num_write_kb":16384,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.d","version":"0'0","reported_seq":69,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:57:57.814167+0000","last_change":"2024-09-14T11:30:10.476534+0000","last_active":"2024-09-14T12:57:57.814167+0000","last_peered":"2024-09-14T12:57:57.814167+0000","last_clean":"2024-09-14T12:57:57.814167+0000","last_became_active":"2024-09-14T11:30:10.475862+0000","last_became_peered":"2024-09-14T11:30:10.475862+0000","last_unstale":"2024-09-14T12:57:57.814167+0000","last_undegraded":"2024-09-14T12:57:57.814167+0000","last_fullsized":"2024-09-14T12:57:57.814167+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:30:09.411354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:30:09.411354+0000","last_clean_scrub_stamp":"2024-09-14T11:30:09.411354+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:09:25.660215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.e","version":"267'20","reported_seq":131,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:58:43.044517+0000","last_change":"2024-09-14T11:24:10.116821+0000","last_active":"2024-09-14T12:58:43.044517+0000","last_peered":"2024-09-14T12:58:43.044517+0000","last_clean":"2024-09-14T12:58:43.044517+0000","last_became_active":"2024-09-14T11:24:10.116115+0000","last_became_peered":"2024-09-14T11:24:10.116115+0000","last_unstale":"2024-09-14T12:58:43.044517+0000","last_undegraded":"2024-09-14T12:58:43.044517+0000","last_fullsized":"2024-09-14T12:58:43.044517+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:24:09.066501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:24:09.066501+0000","last_clean_scrub_stamp":"2024-09-14T11:24:09.066501+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:27:31.737225+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":147,"num_read_kb":99,"num_write":62,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"68.8","version":"0'0","reported_seq":42,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:59:23.435157+0000","last_change":"2024-09-14T11:58:43.689938+0000","last_active":"2024-09-14T12:59:23.435157+0000","last_peered":"2024-09-14T12:59:23.435157+0000","last_clean":"2024-09-14T12:59:23.435157+0000","last_became_active":"2024-09-14T11:58:43.689083+0000","last_became_peered":"2024-09-14T11:58:43.689083+0000","last_unstale":"2024-09-14T12:59:23.435157+0000","last_undegraded":"2024-09-14T12:59:23.435157+0000","last_fullsized":"2024-09-14T12:59:23.435157+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:58:42.635024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:58:42.635024+0000","last_clean_scrub_stamp":"2024-09-14T11:58:42.635024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:56:39.956267+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"67.f","version":"267'5","reported_seq":72,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:58:18.455799+0000","last_change":"2024-09-14T11:30:17.516991+0000","last_active":"2024-09-14T12:58:18.455799+0000","last_peered":"2024-09-14T12:58:18.455799+0000","last_clean":"2024-09-14T12:58:18.455799+0000","last_became_active":"2024-09-14T11:30:17.514381+0000","last_became_peered":"2024-09-14T11:30:17.514381+0000","last_unstale":"2024-09-14T12:58:18.455799+0000","last_undegraded":"2024-09-14T12:58:18.455799+0000","last_fullsized":"2024-09-14T12:58:18.455799+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:30:16.474654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:30:16.474654+0000","last_clean_scrub_stamp":"2024-09-14T11:30:16.474654+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:49:08.984359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5242880,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":5,"num_read_kb":3072,"num_write":10,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.e","version":"267'5","reported_seq":81,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:57:58.447906+0000","last_change":"2024-09-14T11:30:10.479004+0000","last_active":"2024-09-14T12:57:58.447906+0000","last_peered":"2024-09-14T12:57:58.447906+0000","last_clean":"2024-09-14T12:57:58.447906+0000","last_became_active":"2024-09-14T11:30:10.473586+0000","last_became_peered":"2024-09-14T11:30:10.473586+0000","last_unstale":"2024-09-14T12:57:58.447906+0000","last_undegraded":"2024-09-14T12:57:58.447906+0000","last_fullsized":"2024-09-14T12:57:58.447906+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:30:09.411354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:30:09.411354+0000","last_clean_scrub_stamp":"2024-09-14T11:30:09.411354+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:24:05.113372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3145728,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":10,"num_read_kb":7170,"num_write":5,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.d","version":"267'29","reported_seq":159,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:58:43.426273+0000","last_change":"2024-09-14T11:24:10.116568+0000","last_active":"2024-09-14T12:58:43.426273+0000","last_peered":"2024-09-14T12:58:43.426273+0000","last_clean":"2024-09-14T12:58:43.426273+0000","last_became_active":"2024-09-14T11:24:10.115813+0000","last_became_peered":"2024-09-14T11:24:10.115813+0000","last_unstale":"2024-09-14T12:58:43.426273+0000","last_undegraded":"2024-09-14T12:58:43.426273+0000","last_fullsized":"2024-09-14T12:58:43.426273+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:24:09.066501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:24:09.066501+0000","last_clean_scrub_stamp":"2024-09-14T11:24:09.066501+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:26:27.897672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":238,"num_read_kb":154,"num_write":72,"num_write_kb":21,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.9","version":"0'0","reported_seq":42,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:59:27.844748+0000","last_change":"2024-09-14T11:58:43.692113+0000","last_active":"2024-09-14T12:59:27.844748+0000","last_peered":"2024-09-14T12:59:27.844748+0000","last_clean":"2024-09-14T12:59:27.844748+0000","last_became_active":"2024-09-14T11:58:43.691369+0000","last_became_peered":"2024-09-14T11:58:43.691369+0000","last_unstale":"2024-09-14T12:59:27.844748+0000","last_undegraded":"2024-09-14T12:59:27.844748+0000","last_fullsized":"2024-09-14T12:59:27.844748+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:58:42.635024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:58:42.635024+0000","last_clean_scrub_stamp":"2024-09-14T11:58:42.635024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:30:13.996741+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.e","version":"0'0","reported_seq":63,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:58:03.453841+0000","last_change":"2024-09-14T11:30:17.530775+0000","last_active":"2024-09-14T12:58:03.453841+0000","last_peered":"2024-09-14T12:58:03.453841+0000","last_clean":"2024-09-14T12:58:03.453841+0000","last_became_active":"2024-09-14T11:30:17.529982+0000","last_became_peered":"2024-09-14T11:30:17.529982+0000","last_unstale":"2024-09-14T12:58:03.453841+0000","last_undegraded":"2024-09-14T12:58:03.453841+0000","last_fullsized":"2024-09-14T12:58:03.453841+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:30:16.474654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:30:16.474654+0000","last_clean_scrub_stamp":"2024-09-14T11:30:16.474654+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:45:22.253630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.f","version":"267'2","reported_seq":73,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:58:13.454641+0000","last_change":"2024-09-14T11:30:10.466282+0000","last_active":"2024-09-14T12:58:13.454641+0000","last_peered":"2024-09-14T12:58:13.454641+0000","last_clean":"2024-09-14T12:58:13.454641+0000","last_became_active":"2024-09-14T11:30:10.465658+0000","last_became_peered":"2024-09-14T11:30:10.465658+0000","last_unstale":"2024-09-14T12:58:13.454641+0000","last_undegraded":"2024-09-14T12:58:13.454641+0000","last_fullsized":"2024-09-14T12:58:13.454641+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:30:09.411354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:30:09.411354+0000","last_clean_scrub_stamp":"2024-09-14T11:30:09.411354+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:30:10.626929+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":8192,"num_write":7,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.c","version":"267'13","reported_seq":112,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:58:42.823918+0000","last_change":"2024-09-14T11:24:10.125876+0000","last_active":"2024-09-14T12:58:42.823918+0000","last_peered":"2024-09-14T12:58:42.823918+0000","last_clean":"2024-09-14T12:58:42.823918+0000","last_became_active":"2024-09-14T11:24:10.125123+0000","last_became_peered":"2024-09-14T11:24:10.125123+0000","last_unstale":"2024-09-14T12:58:42.823918+0000","last_undegraded":"2024-09-14T12:58:42.823918+0000","last_fullsized":"2024-09-14T12:58:42.823918+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:24:09.066501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:24:09.066501+0000","last_clean_scrub_stamp":"2024-09-14T11:24:09.066501+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:00:51.281778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":97,"num_read_kb":65,"num_write":32,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.e","version":"0'0","reported_seq":41,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:59:28.473804+0000","last_change":"2024-09-14T11:58:43.687782+0000","last_active":"2024-09-14T12:59:28.473804+0000","last_peered":"2024-09-14T12:59:28.473804+0000","last_clean":"2024-09-14T12:59:28.473804+0000","last_became_active":"2024-09-14T11:58:43.686619+0000","last_became_peered":"2024-09-14T11:58:43.686619+0000","last_unstale":"2024-09-14T12:59:28.473804+0000","last_undegraded":"2024-09-14T12:59:28.473804+0000","last_fullsized":"2024-09-14T12:59:28.473804+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:58:42.635024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:58:42.635024+0000","last_clean_scrub_stamp":"2024-09-14T11:58:42.635024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:28:38.861564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.9","version":"264'3","reported_seq":70,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:59:08.234745+0000","last_change":"2024-09-14T11:30:17.539804+0000","last_active":"2024-09-14T12:59:08.234745+0000","last_peered":"2024-09-14T12:59:08.234745+0000","last_clean":"2024-09-14T12:59:08.234745+0000","last_became_active":"2024-09-14T11:30:17.539102+0000","last_became_peered":"2024-09-14T11:30:17.539102+0000","last_unstale":"2024-09-14T12:59:08.234745+0000","last_undegraded":"2024-09-14T12:59:08.234745+0000","last_fullsized":"2024-09-14T12:59:08.234745+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:30:16.474654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:30:16.474654+0000","last_clean_scrub_stamp":"2024-09-14T11:30:16.474654+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:50:58.476074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":4096,"num_write":8,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.8","version":"267'3","reported_seq":77,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:59:03.245405+0000","last_change":"2024-09-14T11:30:10.460045+0000","last_active":"2024-09-14T12:59:03.245405+0000","last_peered":"2024-09-14T12:59:03.245405+0000","last_clean":"2024-09-14T12:59:03.245405+0000","last_became_active":"2024-09-14T11:30:10.452160+0000","last_became_peered":"2024-09-14T11:30:10.452160+0000","last_unstale":"2024-09-14T12:59:03.245405+0000","last_undegraded":"2024-09-14T12:59:03.245405+0000","last_fullsized":"2024-09-14T12:59:03.245405+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:30:09.411354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:30:09.411354+0000","last_clean_scrub_stamp":"2024-09-14T11:30:09.411354+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:23:05.788859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1048576,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4,"num_read_kb":5120,"num_write":3,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.b","version":"267'29","reported_seq":156,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:58:43.240104+0000","last_change":"2024-09-14T11:24:10.106828+0000","last_active":"2024-09-14T12:58:43.240104+0000","last_peered":"2024-09-14T12:58:43.240104+0000","last_clean":"2024-09-14T12:58:43.240104+0000","last_became_active":"2024-09-14T11:24:10.106068+0000","last_became_peered":"2024-09-14T11:24:10.106068+0000","last_unstale":"2024-09-14T12:58:43.240104+0000","last_undegraded":"2024-09-14T12:58:43.240104+0000","last_fullsized":"2024-09-14T12:58:43.240104+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:24:09.066501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:24:09.066501+0000","last_clean_scrub_stamp":"2024-09-14T11:24:09.066501+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:05:03.080475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":230,"num_read_kb":146,"num_write":73,"num_write_kb":21,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.f","version":"0'0","reported_seq":40,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:57:37.819234+0000","last_change":"2024-09-14T11:58:43.692112+0000","last_active":"2024-09-14T12:57:37.819234+0000","last_peered":"2024-09-14T12:57:37.819234+0000","last_clean":"2024-09-14T12:57:37.819234+0000","last_became_active":"2024-09-14T11:58:43.691307+0000","last_became_peered":"2024-09-14T11:58:43.691307+0000","last_unstale":"2024-09-14T12:57:37.819234+0000","last_undegraded":"2024-09-14T12:57:37.819234+0000","last_fullsized":"2024-09-14T12:57:37.819234+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:58:42.635024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:58:42.635024+0000","last_clean_scrub_stamp":"2024-09-14T11:58:42.635024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:28:43.404907+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.8","version":"267'2","reported_seq":71,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:59:07.839977+0000","last_change":"2024-09-14T11:30:17.506927+0000","last_active":"2024-09-14T12:59:07.839977+0000","last_peered":"2024-09-14T12:59:07.839977+0000","last_clean":"2024-09-14T12:59:07.839977+0000","last_became_active":"2024-09-14T11:30:17.506181+0000","last_became_peered":"2024-09-14T11:30:17.506181+0000","last_unstale":"2024-09-14T12:59:07.839977+0000","last_undegraded":"2024-09-14T12:59:07.839977+0000","last_fullsized":"2024-09-14T12:59:07.839977+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:30:16.474654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:30:16.474654+0000","last_clean_scrub_stamp":"2024-09-14T11:30:16.474654+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:25:09.709853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5242880,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":4,"num_read_kb":10240,"num_write":2,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.9","version":"267'11","reported_seq":93,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:59:03.465657+0000","last_change":"2024-09-14T11:30:10.470957+0000","last_active":"2024-09-14T12:59:03.465657+0000","last_peered":"2024-09-14T12:59:03.465657+0000","last_clean":"2024-09-14T12:59:03.465657+0000","last_became_active":"2024-09-14T11:30:10.470179+0000","last_became_peered":"2024-09-14T11:30:10.470179+0000","last_unstale":"2024-09-14T12:59:03.465657+0000","last_undegraded":"2024-09-14T12:59:03.465657+0000","last_fullsized":"2024-09-14T12:59:03.465657+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:30:09.411354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:30:09.411354+0000","last_clean_scrub_stamp":"2024-09-14T11:30:09.411354+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:18:43.600381+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8391814,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":15,"num_read_kb":28678,"num_write":21,"num_write_kb":16388,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.a","version":"267'15","reported_seq":117,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:57:52.822597+0000","last_change":"2024-09-14T11:24:10.103674+0000","last_active":"2024-09-14T12:57:52.822597+0000","last_peered":"2024-09-14T12:57:52.822597+0000","last_clean":"2024-09-14T12:57:52.822597+0000","last_became_active":"2024-09-14T11:24:10.102918+0000","last_became_peered":"2024-09-14T11:24:10.102918+0000","last_unstale":"2024-09-14T12:57:52.822597+0000","last_undegraded":"2024-09-14T12:57:52.822597+0000","last_fullsized":"2024-09-14T12:57:52.822597+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:24:09.066501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:24:09.066501+0000","last_clean_scrub_stamp":"2024-09-14T11:24:09.066501+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:26:42.141598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":107,"num_read_kb":71,"num_write":42,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.c","version":"267'1","reported_seq":42,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:59:32.846025+0000","last_change":"2024-09-14T11:58:43.674524+0000","last_active":"2024-09-14T12:59:32.846025+0000","last_peered":"2024-09-14T12:59:32.846025+0000","last_clean":"2024-09-14T12:59:32.846025+0000","last_became_active":"2024-09-14T11:58:43.671065+0000","last_became_peered":"2024-09-14T11:58:43.671065+0000","last_unstale":"2024-09-14T12:59:32.846025+0000","last_undegraded":"2024-09-14T12:59:32.846025+0000","last_fullsized":"2024-09-14T12:59:32.846025+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:58:42.635024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:58:42.635024+0000","last_clean_scrub_stamp":"2024-09-14T11:58:42.635024+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:00:34.168002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.b","version":"267'10","reported_seq":84,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:58:03.452301+0000","last_change":"2024-09-14T11:30:17.517039+0000","last_active":"2024-09-14T12:58:03.452301+0000","last_peered":"2024-09-14T12:58:03.452301+0000","last_clean":"2024-09-14T12:58:03.452301+0000","last_became_active":"2024-09-14T11:30:17.516646+0000","last_became_peered":"2024-09-14T11:30:17.516646+0000","last_unstale":"2024-09-14T12:58:03.452301+0000","last_undegraded":"2024-09-14T12:58:03.452301+0000","last_fullsized":"2024-09-14T12:58:03.452301+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:30:16.474654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:30:16.474654+0000","last_clean_scrub_stamp":"2024-09-14T11:30:16.474654+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:51:29.231639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":16,"num_read_kb":13314,"num_write":15,"num_write_kb":10240,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.a","version":"264'2","reported_seq":75,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:59:28.251530+0000","last_change":"2024-09-14T11:30:10.473981+0000","last_active":"2024-09-14T12:59:28.251530+0000","last_peered":"2024-09-14T12:59:28.251530+0000","last_clean":"2024-09-14T12:59:28.251530+0000","last_became_active":"2024-09-14T11:30:10.473149+0000","last_became_peered":"2024-09-14T11:30:10.473149+0000","last_unstale":"2024-09-14T12:59:28.251530+0000","last_undegraded":"2024-09-14T12:59:28.251530+0000","last_fullsized":"2024-09-14T12:59:28.251530+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:30:09.411354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:30:09.411354+0000","last_clean_scrub_stamp":"2024-09-14T11:30:09.411354+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:31:29.150405+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":1024,"num_write":2,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.9","version":"267'22","reported_seq":138,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:59:33.474897+0000","last_change":"2024-09-14T11:24:10.122150+0000","last_active":"2024-09-14T12:59:33.474897+0000","last_peered":"2024-09-14T12:59:33.474897+0000","last_clean":"2024-09-14T12:59:33.474897+0000","last_became_active":"2024-09-14T11:24:10.121442+0000","last_became_peered":"2024-09-14T11:24:10.121442+0000","last_unstale":"2024-09-14T12:59:33.474897+0000","last_undegraded":"2024-09-14T12:59:33.474897+0000","last_fullsized":"2024-09-14T12:59:33.474897+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:24:09.066501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:24:09.066501+0000","last_clean_scrub_stamp":"2024-09-14T11:24:09.066501+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:07:27.847069+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":163,"num_read_kb":99,"num_write":58,"num_write_kb":15,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.d","version":"0'0","reported_seq":41,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:59:28.251656+0000","last_change":"2024-09-14T11:58:43.694247+0000","last_active":"2024-09-14T12:59:28.251656+0000","last_peered":"2024-09-14T12:59:28.251656+0000","last_clean":"2024-09-14T12:59:28.251656+0000","last_became_active":"2024-09-14T11:58:43.693568+0000","last_became_peered":"2024-09-14T11:58:43.693568+0000","last_unstale":"2024-09-14T12:59:28.251656+0000","last_undegraded":"2024-09-14T12:59:28.251656+0000","last_fullsized":"2024-09-14T12:59:28.251656+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:58:42.635024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:58:42.635024+0000","last_clean_scrub_stamp":"2024-09-14T11:58:42.635024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:56:07.440496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.a","version":"0'0","reported_seq":71,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:59:37.847095+0000","last_change":"2024-09-14T11:30:57.858852+0000","last_active":"2024-09-14T12:59:37.847095+0000","last_peered":"2024-09-14T12:59:37.847095+0000","last_clean":"2024-09-14T12:59:37.847095+0000","last_became_active":"2024-09-14T11:30:57.858040+0000","last_became_peered":"2024-09-14T11:30:57.858040+0000","last_unstale":"2024-09-14T12:59:37.847095+0000","last_undegraded":"2024-09-14T12:59:37.847095+0000","last_fullsized":"2024-09-14T12:59:37.847095+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:30:16.474654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:30:16.474654+0000","last_clean_scrub_stamp":"2024-09-14T11:30:16.474654+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:54:14.176092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.b","version":"267'2","reported_seq":73,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:57:58.218262+0000","last_change":"2024-09-14T11:30:10.446339+0000","last_active":"2024-09-14T12:57:58.218262+0000","last_peered":"2024-09-14T12:57:58.218262+0000","last_clean":"2024-09-14T12:57:58.218262+0000","last_became_active":"2024-09-14T11:30:10.442635+0000","last_became_peered":"2024-09-14T11:30:10.442635+0000","last_unstale":"2024-09-14T12:57:58.218262+0000","last_undegraded":"2024-09-14T12:57:58.218262+0000","last_fullsized":"2024-09-14T12:57:58.218262+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:30:09.411354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:30:09.411354+0000","last_clean_scrub_stamp":"2024-09-14T11:30:09.411354+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:51:37.757665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":8192,"num_write":2,"num_write_kb":8192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.8","version":"267'20","reported_seq":132,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:59:33.437339+0000","last_change":"2024-09-14T11:24:10.116682+0000","last_active":"2024-09-14T12:59:33.437339+0000","last_peered":"2024-09-14T12:59:33.437339+0000","last_clean":"2024-09-14T12:59:33.437339+0000","last_became_active":"2024-09-14T11:24:10.115856+0000","last_became_peered":"2024-09-14T11:24:10.115856+0000","last_unstale":"2024-09-14T12:59:33.437339+0000","last_undegraded":"2024-09-14T12:59:33.437339+0000","last_fullsized":"2024-09-14T12:59:33.437339+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:24:09.066501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:24:09.066501+0000","last_clean_scrub_stamp":"2024-09-14T11:24:09.066501+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:44:11.185471+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":144,"num_read_kb":94,"num_write":54,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.2","version":"0'0","reported_seq":43,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:59:12.841261+0000","last_change":"2024-09-14T11:58:43.696428+0000","last_active":"2024-09-14T12:59:12.841261+0000","last_peered":"2024-09-14T12:59:12.841261+0000","last_clean":"2024-09-14T12:59:12.841261+0000","last_became_active":"2024-09-14T11:58:43.695896+0000","last_became_peered":"2024-09-14T11:58:43.695896+0000","last_unstale":"2024-09-14T12:59:12.841261+0000","last_undegraded":"2024-09-14T12:59:12.841261+0000","last_fullsized":"2024-09-14T12:59:12.841261+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:58:42.635024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:58:42.635024+0000","last_clean_scrub_stamp":"2024-09-14T11:58:42.635024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:00:52.004945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.5","version":"0'0","reported_seq":66,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:58:08.450363+0000","last_change":"2024-09-14T11:30:17.520310+0000","last_active":"2024-09-14T12:58:08.450363+0000","last_peered":"2024-09-14T12:58:08.450363+0000","last_clean":"2024-09-14T12:58:08.450363+0000","last_became_active":"2024-09-14T11:30:17.519903+0000","last_became_peered":"2024-09-14T11:30:17.519903+0000","last_unstale":"2024-09-14T12:58:08.450363+0000","last_undegraded":"2024-09-14T12:58:08.450363+0000","last_fullsized":"2024-09-14T12:58:08.450363+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:30:16.474654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:30:16.474654+0000","last_clean_scrub_stamp":"2024-09-14T11:30:16.474654+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:24:33.274962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.4","version":"264'4","reported_seq":82,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:59:47.849496+0000","last_change":"2024-09-14T11:30:10.469781+0000","last_active":"2024-09-14T12:59:47.849496+0000","last_peered":"2024-09-14T12:59:47.849496+0000","last_clean":"2024-09-14T12:59:47.849496+0000","last_became_active":"2024-09-14T11:30:10.468287+0000","last_became_peered":"2024-09-14T11:30:10.468287+0000","last_unstale":"2024-09-14T12:59:47.849496+0000","last_undegraded":"2024-09-14T12:59:47.849496+0000","last_fullsized":"2024-09-14T12:59:47.849496+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:30:09.411354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:30:09.411354+0000","last_clean_scrub_stamp":"2024-09-14T11:30:09.411354+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:43:03.239163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":11264,"num_write":4,"num_write_kb":7168,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.7","version":"267'11","reported_seq":111,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:59:33.252891+0000","last_change":"2024-09-14T11:24:10.097912+0000","last_active":"2024-09-14T12:59:33.252891+0000","last_peered":"2024-09-14T12:59:33.252891+0000","last_clean":"2024-09-14T12:59:33.252891+0000","last_became_active":"2024-09-14T11:24:10.097206+0000","last_became_peered":"2024-09-14T11:24:10.097206+0000","last_unstale":"2024-09-14T12:59:33.252891+0000","last_undegraded":"2024-09-14T12:59:33.252891+0000","last_fullsized":"2024-09-14T12:59:33.252891+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:24:09.066501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:24:09.066501+0000","last_clean_scrub_stamp":"2024-09-14T11:24:09.066501+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:05:42.905472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":88,"num_read_kb":49,"num_write":30,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.3","version":"0'0","reported_seq":43,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:59:08.049987+0000","last_change":"2024-09-14T11:58:43.693608+0000","last_active":"2024-09-14T12:59:08.049987+0000","last_peered":"2024-09-14T12:59:08.049987+0000","last_clean":"2024-09-14T12:59:08.049987+0000","last_became_active":"2024-09-14T11:58:43.689661+0000","last_became_peered":"2024-09-14T11:58:43.689661+0000","last_unstale":"2024-09-14T12:59:08.049987+0000","last_undegraded":"2024-09-14T12:59:08.049987+0000","last_fullsized":"2024-09-14T12:59:08.049987+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:58:42.635024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:58:42.635024+0000","last_clean_scrub_stamp":"2024-09-14T11:58:42.635024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:26:59.844029+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.4","version":"267'3","reported_seq":73,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:59:53.257452+0000","last_change":"2024-09-14T11:30:17.501104+0000","last_active":"2024-09-14T12:59:53.257452+0000","last_peered":"2024-09-14T12:59:53.257452+0000","last_clean":"2024-09-14T12:59:53.257452+0000","last_became_active":"2024-09-14T11:30:17.500215+0000","last_became_peered":"2024-09-14T11:30:17.500215+0000","last_unstale":"2024-09-14T12:59:53.257452+0000","last_undegraded":"2024-09-14T12:59:53.257452+0000","last_fullsized":"2024-09-14T12:59:53.257452+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:30:16.474654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:30:16.474654+0000","last_clean_scrub_stamp":"2024-09-14T11:30:16.474654+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:46:20.398415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1051782,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3,"num_read_kb":2052,"num_write":8,"num_write_kb":1028,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.5","version":"267'3","reported_seq":79,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:58:12.817408+0000","last_change":"2024-09-14T11:30:10.465224+0000","last_active":"2024-09-14T12:58:12.817408+0000","last_peered":"2024-09-14T12:58:12.817408+0000","last_clean":"2024-09-14T12:58:12.817408+0000","last_became_active":"2024-09-14T11:30:10.464076+0000","last_became_peered":"2024-09-14T11:30:10.464076+0000","last_unstale":"2024-09-14T12:58:12.817408+0000","last_undegraded":"2024-09-14T12:58:12.817408+0000","last_fullsized":"2024-09-14T12:58:12.817408+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:30:09.411354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:30:09.411354+0000","last_clean_scrub_stamp":"2024-09-14T11:30:09.411354+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:08:03.701354+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":4,"num_read_kb":16384,"num_write":8,"num_write_kb":8192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.6","version":"267'17","reported_seq":129,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:59:33.437504+0000","last_change":"2024-09-14T11:24:10.123893+0000","last_active":"2024-09-14T12:59:33.437504+0000","last_peered":"2024-09-14T12:59:33.437504+0000","last_clean":"2024-09-14T12:59:33.437504+0000","last_became_active":"2024-09-14T11:24:10.123193+0000","last_became_peered":"2024-09-14T11:24:10.123193+0000","last_unstale":"2024-09-14T12:59:33.437504+0000","last_undegraded":"2024-09-14T12:59:33.437504+0000","last_fullsized":"2024-09-14T12:59:33.437504+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:24:09.066501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:24:09.066501+0000","last_clean_scrub_stamp":"2024-09-14T11:24:09.066501+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:45:11.702555+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":141,"num_read_kb":98,"num_write":56,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.0","version":"0'0","reported_seq":44,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:58:48.462247+0000","last_change":"2024-09-14T11:58:43.690698+0000","last_active":"2024-09-14T12:58:48.462247+0000","last_peered":"2024-09-14T12:58:48.462247+0000","last_clean":"2024-09-14T12:58:48.462247+0000","last_became_active":"2024-09-14T11:58:43.690036+0000","last_became_peered":"2024-09-14T11:58:43.690036+0000","last_unstale":"2024-09-14T12:58:48.462247+0000","last_undegraded":"2024-09-14T12:58:48.462247+0000","last_fullsized":"2024-09-14T12:58:48.462247+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:58:42.635024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:58:42.635024+0000","last_clean_scrub_stamp":"2024-09-14T11:58:42.635024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:02:37.171544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"67.7","version":"0'0","reported_seq":65,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:59:07.840222+0000","last_change":"2024-09-14T11:30:17.504824+0000","last_active":"2024-09-14T12:59:07.840222+0000","last_peered":"2024-09-14T12:59:07.840222+0000","last_clean":"2024-09-14T12:59:07.840222+0000","last_became_active":"2024-09-14T11:30:17.503548+0000","last_became_peered":"2024-09-14T11:30:17.503548+0000","last_unstale":"2024-09-14T12:59:07.840222+0000","last_undegraded":"2024-09-14T12:59:07.840222+0000","last_fullsized":"2024-09-14T12:59:07.840222+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:30:16.474654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:30:16.474654+0000","last_clean_scrub_stamp":"2024-09-14T11:30:16.474654+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:04:54.678316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.6","version":"264'4","reported_seq":81,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:59:03.048985+0000","last_change":"2024-09-14T11:30:10.463753+0000","last_active":"2024-09-14T12:59:03.048985+0000","last_peered":"2024-09-14T12:59:03.048985+0000","last_clean":"2024-09-14T12:59:03.048985+0000","last_became_active":"2024-09-14T11:30:10.462971+0000","last_became_peered":"2024-09-14T11:30:10.462971+0000","last_unstale":"2024-09-14T12:59:03.048985+0000","last_undegraded":"2024-09-14T12:59:03.048985+0000","last_fullsized":"2024-09-14T12:59:03.048985+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:30:09.411354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:30:09.411354+0000","last_clean_scrub_stamp":"2024-09-14T11:30:09.411354+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:28:19.411905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":16386,"num_write":4,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.5","version":"267'29","reported_seq":156,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:58:27.830841+0000","last_change":"2024-09-14T11:24:10.105209+0000","last_active":"2024-09-14T12:58:27.830841+0000","last_peered":"2024-09-14T12:58:27.830841+0000","last_clean":"2024-09-14T12:58:27.830841+0000","last_became_active":"2024-09-14T11:24:10.104277+0000","last_became_peered":"2024-09-14T11:24:10.104277+0000","last_unstale":"2024-09-14T12:58:27.830841+0000","last_undegraded":"2024-09-14T12:58:27.830841+0000","last_fullsized":"2024-09-14T12:58:27.830841+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:24:09.066501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:24:09.066501+0000","last_clean_scrub_stamp":"2024-09-14T11:24:09.066501+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:27:20.344282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":210,"num_read_kb":138,"num_write":78,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.1","version":"0'0","reported_seq":43,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:59:08.234700+0000","last_change":"2024-09-14T11:58:43.675560+0000","last_active":"2024-09-14T12:59:08.234700+0000","last_peered":"2024-09-14T12:59:08.234700+0000","last_clean":"2024-09-14T12:59:08.234700+0000","last_became_active":"2024-09-14T11:58:43.674870+0000","last_became_peered":"2024-09-14T11:58:43.674870+0000","last_unstale":"2024-09-14T12:59:08.234700+0000","last_undegraded":"2024-09-14T12:59:08.234700+0000","last_fullsized":"2024-09-14T12:59:08.234700+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:58:42.635024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:58:42.635024+0000","last_clean_scrub_stamp":"2024-09-14T11:58:42.635024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:17:48.384984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"67.6","version":"267'1","reported_seq":67,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:59:08.234954+0000","last_change":"2024-09-14T11:30:17.521153+0000","last_active":"2024-09-14T12:59:08.234954+0000","last_peered":"2024-09-14T12:59:08.234954+0000","last_clean":"2024-09-14T12:59:08.234954+0000","last_became_active":"2024-09-14T11:30:17.520433+0000","last_became_peered":"2024-09-14T11:30:17.520433+0000","last_unstale":"2024-09-14T12:59:08.234954+0000","last_undegraded":"2024-09-14T12:59:08.234954+0000","last_fullsized":"2024-09-14T12:59:08.234954+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:30:16.474654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:30:16.474654+0000","last_clean_scrub_stamp":"2024-09-14T11:30:16.474654+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:46:08.197483+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":4096,"num_write":1,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.7","version":"267'2","reported_seq":76,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:59:02.839045+0000","last_change":"2024-09-14T11:30:10.475293+0000","last_active":"2024-09-14T12:59:02.839045+0000","last_peered":"2024-09-14T12:59:02.839045+0000","last_clean":"2024-09-14T12:59:02.839045+0000","last_became_active":"2024-09-14T11:30:10.474546+0000","last_became_peered":"2024-09-14T11:30:10.474546+0000","last_unstale":"2024-09-14T12:59:02.839045+0000","last_undegraded":"2024-09-14T12:59:02.839045+0000","last_fullsized":"2024-09-14T12:59:02.839045+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:30:09.411354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:30:09.411354+0000","last_clean_scrub_stamp":"2024-09-14T11:30:09.411354+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:09:53.059916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2097152,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3,"num_read_kb":3072,"num_write":2,"num_write_kb":2048,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.4","version":"267'33","reported_seq":160,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:57:58.451122+0000","last_change":"2024-09-14T11:24:10.118920+0000","last_active":"2024-09-14T12:57:58.451122+0000","last_peered":"2024-09-14T12:57:58.451122+0000","last_clean":"2024-09-14T12:57:58.451122+0000","last_became_active":"2024-09-14T11:24:10.118333+0000","last_became_peered":"2024-09-14T11:24:10.118333+0000","last_unstale":"2024-09-14T12:57:58.451122+0000","last_undegraded":"2024-09-14T12:57:58.451122+0000","last_fullsized":"2024-09-14T12:57:58.451122+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:24:09.066501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:24:09.066501+0000","last_clean_scrub_stamp":"2024-09-14T11:24:09.066501+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:28:26.888200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":218,"num_read_kb":138,"num_write":85,"num_write_kb":20,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"68.6","version":"267'1","reported_seq":43,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:59:22.832926+0000","last_change":"2024-09-14T11:58:43.688943+0000","last_active":"2024-09-14T12:59:22.832926+0000","last_peered":"2024-09-14T12:59:22.832926+0000","last_clean":"2024-09-14T12:59:22.832926+0000","last_became_active":"2024-09-14T11:58:43.688251+0000","last_became_peered":"2024-09-14T11:58:43.688251+0000","last_unstale":"2024-09-14T12:59:22.832926+0000","last_undegraded":"2024-09-14T12:59:22.832926+0000","last_fullsized":"2024-09-14T12:59:22.832926+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:58:42.635024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:58:42.635024+0000","last_clean_scrub_stamp":"2024-09-14T11:58:42.635024+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:15:08.766031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.1","version":"267'6","reported_seq":80,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:59:53.476435+0000","last_change":"2024-09-14T11:30:17.519203+0000","last_active":"2024-09-14T12:59:53.476435+0000","last_peered":"2024-09-14T12:59:53.476435+0000","last_clean":"2024-09-14T12:59:53.476435+0000","last_became_active":"2024-09-14T11:30:17.518890+0000","last_became_peered":"2024-09-14T11:30:17.518890+0000","last_unstale":"2024-09-14T12:59:53.476435+0000","last_undegraded":"2024-09-14T12:59:53.476435+0000","last_fullsized":"2024-09-14T12:59:53.476435+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:30:16.474654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:30:16.474654+0000","last_clean_scrub_stamp":"2024-09-14T11:30:16.474654+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:51:39.220265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3145728,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":10,"num_read_kb":19458,"num_write":11,"num_write_kb":7168,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.0","version":"267'1","reported_seq":76,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:58:42.834093+0000","last_change":"2024-09-14T11:30:10.467502+0000","last_active":"2024-09-14T12:58:42.834093+0000","last_peered":"2024-09-14T12:58:42.834093+0000","last_clean":"2024-09-14T12:58:42.834093+0000","last_became_active":"2024-09-14T11:30:10.466391+0000","last_became_peered":"2024-09-14T11:30:10.466391+0000","last_unstale":"2024-09-14T12:58:42.834093+0000","last_undegraded":"2024-09-14T12:58:42.834093+0000","last_fullsized":"2024-09-14T12:58:42.834093+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:30:09.411354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:30:09.411354+0000","last_clean_scrub_stamp":"2024-09-14T11:30:09.411354+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:32:45.732767+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":40145,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":40,"num_write":1,"num_write_kb":40,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.3","version":"267'41","reported_seq":190,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:57:58.034292+0000","last_change":"2024-09-14T11:24:10.095296+0000","last_active":"2024-09-14T12:57:58.034292+0000","last_peered":"2024-09-14T12:57:58.034292+0000","last_clean":"2024-09-14T12:57:58.034292+0000","last_became_active":"2024-09-14T11:24:10.094515+0000","last_became_peered":"2024-09-14T11:24:10.094515+0000","last_unstale":"2024-09-14T12:57:58.034292+0000","last_undegraded":"2024-09-14T12:57:58.034292+0000","last_fullsized":"2024-09-14T12:57:58.034292+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:24:09.066501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:24:09.066501+0000","last_clean_scrub_stamp":"2024-09-14T11:24:09.066501+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":0,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:59:26.331974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":311,"num_read_kb":196,"num_write":106,"num_write_kb":28,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"68.7","version":"0'0","reported_seq":42,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:59:23.250462+0000","last_change":"2024-09-14T11:58:43.681439+0000","last_active":"2024-09-14T12:59:23.250462+0000","last_peered":"2024-09-14T12:59:23.250462+0000","last_clean":"2024-09-14T12:59:23.250462+0000","last_became_active":"2024-09-14T11:58:43.680569+0000","last_became_peered":"2024-09-14T11:58:43.680569+0000","last_unstale":"2024-09-14T12:59:23.250462+0000","last_undegraded":"2024-09-14T12:59:23.250462+0000","last_fullsized":"2024-09-14T12:59:23.250462+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:58:42.635024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:58:42.635024+0000","last_clean_scrub_stamp":"2024-09-14T11:58:42.635024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:50:38.486174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.0","version":"267'3","reported_seq":75,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:58:43.044284+0000","last_change":"2024-09-14T11:30:17.519289+0000","last_active":"2024-09-14T12:58:43.044284+0000","last_peered":"2024-09-14T12:58:43.044284+0000","last_clean":"2024-09-14T12:58:43.044284+0000","last_became_active":"2024-09-14T11:30:17.518524+0000","last_became_peered":"2024-09-14T11:30:17.518524+0000","last_unstale":"2024-09-14T12:58:43.044284+0000","last_undegraded":"2024-09-14T12:58:43.044284+0000","last_fullsized":"2024-09-14T12:58:43.044284+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:30:16.474654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:30:16.474654+0000","last_clean_scrub_stamp":"2024-09-14T11:30:16.474654+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:59:22.405921+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1048576,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":5,"num_read_kb":6144,"num_write":3,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.1","version":"267'4","reported_seq":79,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:59:47.849395+0000","last_change":"2024-09-14T11:30:10.465435+0000","last_active":"2024-09-14T12:59:47.849395+0000","last_peered":"2024-09-14T12:59:47.849395+0000","last_clean":"2024-09-14T12:59:47.849395+0000","last_became_active":"2024-09-14T11:30:10.464696+0000","last_became_peered":"2024-09-14T11:30:10.464696+0000","last_unstale":"2024-09-14T12:59:47.849395+0000","last_undegraded":"2024-09-14T12:59:47.849395+0000","last_fullsized":"2024-09-14T12:59:47.849395+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:30:09.411354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:30:09.411354+0000","last_clean_scrub_stamp":"2024-09-14T11:30:09.411354+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:34:28.871663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3,"num_read_kb":1024,"num_write":9,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.2","version":"267'34","reported_seq":175,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:57:58.218176+0000","last_change":"2024-09-14T11:24:10.126827+0000","last_active":"2024-09-14T12:57:58.218176+0000","last_peered":"2024-09-14T12:57:58.218176+0000","last_clean":"2024-09-14T12:57:58.218176+0000","last_became_active":"2024-09-14T11:24:10.125885+0000","last_became_peered":"2024-09-14T11:24:10.125885+0000","last_unstale":"2024-09-14T12:57:58.218176+0000","last_undegraded":"2024-09-14T12:57:58.218176+0000","last_fullsized":"2024-09-14T12:57:58.218176+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:24:09.066501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:24:09.066501+0000","last_clean_scrub_stamp":"2024-09-14T11:24:09.066501+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:23:21.772883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":284,"num_read_kb":180,"num_write":83,"num_write_kb":28,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"68.4","version":"0'0","reported_seq":43,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:59:08.246950+0000","last_change":"2024-09-14T11:58:43.663976+0000","last_active":"2024-09-14T12:59:08.246950+0000","last_peered":"2024-09-14T12:59:08.246950+0000","last_clean":"2024-09-14T12:59:08.246950+0000","last_became_active":"2024-09-14T11:58:43.662916+0000","last_became_peered":"2024-09-14T11:58:43.662916+0000","last_unstale":"2024-09-14T12:59:08.246950+0000","last_undegraded":"2024-09-14T12:59:08.246950+0000","last_fullsized":"2024-09-14T12:59:08.246950+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:58:42.635024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:58:42.635024+0000","last_clean_scrub_stamp":"2024-09-14T11:58:42.635024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:29:35.878769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.3","version":"264'4","reported_seq":77,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:59:53.441619+0000","last_change":"2024-09-14T11:30:17.549596+0000","last_active":"2024-09-14T12:59:53.441619+0000","last_peered":"2024-09-14T12:59:53.441619+0000","last_clean":"2024-09-14T12:59:53.441619+0000","last_became_active":"2024-09-14T11:30:17.549019+0000","last_became_peered":"2024-09-14T11:30:17.549019+0000","last_unstale":"2024-09-14T12:59:53.441619+0000","last_undegraded":"2024-09-14T12:59:53.441619+0000","last_fullsized":"2024-09-14T12:59:53.441619+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:30:16.474654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:30:16.474654+0000","last_clean_scrub_stamp":"2024-09-14T11:30:16.474654+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:25:28.016466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":4098,"num_write":4,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"66.2","version":"267'3","reported_seq":80,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:59:48.475431+0000","last_change":"2024-09-14T11:30:10.461463+0000","last_active":"2024-09-14T12:59:48.475431+0000","last_peered":"2024-09-14T12:59:48.475431+0000","last_clean":"2024-09-14T12:59:48.475431+0000","last_became_active":"2024-09-14T11:30:10.460643+0000","last_became_peered":"2024-09-14T11:30:10.460643+0000","last_unstale":"2024-09-14T12:59:48.475431+0000","last_undegraded":"2024-09-14T12:59:48.475431+0000","last_fullsized":"2024-09-14T12:59:48.475431+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:30:09.411354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:30:09.411354+0000","last_clean_scrub_stamp":"2024-09-14T11:30:09.411354+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:37:10.801240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1048576,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":5,"num_read_kb":3072,"num_write":3,"num_write_kb":2048,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.1","version":"267'13","reported_seq":114,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:57:58.608535+0000","last_change":"2024-09-14T11:24:10.117369+0000","last_active":"2024-09-14T12:57:58.608535+0000","last_peered":"2024-09-14T12:57:58.608535+0000","last_clean":"2024-09-14T12:57:58.608535+0000","last_became_active":"2024-09-14T11:24:10.116627+0000","last_became_peered":"2024-09-14T11:24:10.116627+0000","last_unstale":"2024-09-14T12:57:58.608535+0000","last_undegraded":"2024-09-14T12:57:58.608535+0000","last_fullsized":"2024-09-14T12:57:58.608535+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:24:09.066501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:24:09.066501+0000","last_clean_scrub_stamp":"2024-09-14T11:24:09.066501+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:17:32.530599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":96,"num_read_kb":63,"num_write":36,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.5","version":"0'0","reported_seq":43,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:59:32.846067+0000","last_change":"2024-09-14T11:58:43.696722+0000","last_active":"2024-09-14T12:59:32.846067+0000","last_peered":"2024-09-14T12:59:32.846067+0000","last_clean":"2024-09-14T12:59:32.846067+0000","last_became_active":"2024-09-14T11:58:43.695982+0000","last_became_peered":"2024-09-14T11:58:43.695982+0000","last_unstale":"2024-09-14T12:59:32.846067+0000","last_undegraded":"2024-09-14T12:59:32.846067+0000","last_fullsized":"2024-09-14T12:59:32.846067+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:58:42.635024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:58:42.635024+0000","last_clean_scrub_stamp":"2024-09-14T11:58:42.635024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:04:33.126348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.2","version":"264'8","reported_seq":85,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:59:53.244786+0000","last_change":"2024-09-14T11:30:17.513530+0000","last_active":"2024-09-14T12:59:53.244786+0000","last_peered":"2024-09-14T12:59:53.244786+0000","last_clean":"2024-09-14T12:59:53.244786+0000","last_became_active":"2024-09-14T11:30:17.512689+0000","last_became_peered":"2024-09-14T11:30:17.512689+0000","last_unstale":"2024-09-14T12:59:53.244786+0000","last_undegraded":"2024-09-14T12:59:53.244786+0000","last_fullsized":"2024-09-14T12:59:53.244786+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:30:16.474654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:30:16.474654+0000","last_clean_scrub_stamp":"2024-09-14T11:30:16.474654+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:38:38.268473+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":21506,"num_write":8,"num_write_kb":9216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.3","version":"0'0","reported_seq":73,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:59:48.440576+0000","last_change":"2024-09-14T11:30:10.474713+0000","last_active":"2024-09-14T12:59:48.440576+0000","last_peered":"2024-09-14T12:59:48.440576+0000","last_clean":"2024-09-14T12:59:48.440576+0000","last_became_active":"2024-09-14T11:30:10.473880+0000","last_became_peered":"2024-09-14T11:30:10.473880+0000","last_unstale":"2024-09-14T12:59:48.440576+0000","last_undegraded":"2024-09-14T12:59:48.440576+0000","last_fullsized":"2024-09-14T12:59:48.440576+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:30:09.411354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:30:09.411354+0000","last_clean_scrub_stamp":"2024-09-14T11:30:09.411354+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:44:00.695204+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"65.0","version":"264'14","reported_seq":122,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:58:42.834131+0000","last_change":"2024-09-14T11:24:10.116538+0000","last_active":"2024-09-14T12:58:42.834131+0000","last_peered":"2024-09-14T12:58:42.834131+0000","last_clean":"2024-09-14T12:58:42.834131+0000","last_became_active":"2024-09-14T11:24:10.115799+0000","last_became_peered":"2024-09-14T11:24:10.115799+0000","last_unstale":"2024-09-14T12:58:42.834131+0000","last_undegraded":"2024-09-14T12:58:42.834131+0000","last_fullsized":"2024-09-14T12:58:42.834131+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:24:09.066501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:24:09.066501+0000","last_clean_scrub_stamp":"2024-09-14T11:24:09.066501+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:53:06.539792+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":114,"num_read_kb":78,"num_write":35,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3f","version":"267'198","reported_seq":868,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:58:47.835532+0000","last_change":"2024-09-14T11:08:21.831355+0000","last_active":"2024-09-14T12:58:47.835532+0000","last_peered":"2024-09-14T12:58:47.835532+0000","last_clean":"2024-09-14T12:58:47.835532+0000","last_became_active":"2024-09-14T11:08:21.829676+0000","last_became_peered":"2024-09-14T11:08:21.829676+0000","last_unstale":"2024-09-14T12:58:47.835532+0000","last_undegraded":"2024-09-14T12:58:47.835532+0000","last_fullsized":"2024-09-14T12:58:47.835532+0000","mapping_epoch":24,"log_start":"267'100","ondisk_log_start":"267'100","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:08:20.733145+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:08:20.733145+0000","last_clean_scrub_stamp":"2024-09-14T11:08:20.733145+0000","objects_scrubbed":0,"log_size":98,"log_dups_size":100,"ondisk_log_size":98,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:36:16.240993+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":11861059,"num_objects":10,"num_object_clones":0,"num_object_copies":30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":566,"num_read_kb":18432,"num_write":885,"num_write_kb":26168,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,0],"acting":[7,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.38","version":"267'461","reported_seq":2067,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:59:14.735536+0000","last_change":"2024-09-14T11:08:23.801607+0000","last_active":"2024-09-14T12:59:14.735536+0000","last_peered":"2024-09-14T12:59:14.735536+0000","last_clean":"2024-09-14T12:59:14.735536+0000","last_became_active":"2024-09-14T11:08:23.800936+0000","last_became_peered":"2024-09-14T11:08:23.800936+0000","last_unstale":"2024-09-14T12:59:14.735536+0000","last_undegraded":"2024-09-14T12:59:14.735536+0000","last_fullsized":"2024-09-14T12:59:14.735536+0000","mapping_epoch":26,"log_start":"267'400","ondisk_log_start":"267'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:08:22.750609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:08:22.750609+0000","last_clean_scrub_stamp":"2024-09-14T11:08:22.750609+0000","objects_scrubbed":0,"log_size":61,"log_dups_size":400,"ondisk_log_size":61,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:16:00.073851+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":2476,"num_read_kb":2325,"num_write":550,"num_write_kb":127,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3e","version":"267'223","reported_seq":930,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:58:48.462460+0000","last_change":"2024-09-14T11:08:21.810078+0000","last_active":"2024-09-14T12:58:48.462460+0000","last_peered":"2024-09-14T12:58:48.462460+0000","last_clean":"2024-09-14T12:58:48.462460+0000","last_became_active":"2024-09-14T11:08:21.808315+0000","last_became_peered":"2024-09-14T11:08:21.808315+0000","last_unstale":"2024-09-14T12:58:48.462460+0000","last_undegraded":"2024-09-14T12:58:48.462460+0000","last_fullsized":"2024-09-14T12:58:48.462460+0000","mapping_epoch":24,"log_start":"267'200","ondisk_log_start":"267'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:08:20.733145+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:08:20.733145+0000","last_clean_scrub_stamp":"2024-09-14T11:08:20.733145+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":200,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:01:33.622838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8326349,"num_objects":9,"num_object_clones":0,"num_object_copies":27,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":599,"num_read_kb":113994,"num_write":1039,"num_write_kb":54817,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,6],"acting":[1,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.39","version":"267'896","reported_seq":2642,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:59:07.757541+0000","last_change":"2024-09-14T11:08:23.802023+0000","last_active":"2024-09-14T12:59:07.757541+0000","last_peered":"2024-09-14T12:59:07.757541+0000","last_clean":"2024-09-14T12:59:07.757541+0000","last_became_active":"2024-09-14T11:08:23.801320+0000","last_became_peered":"2024-09-14T11:08:23.801320+0000","last_unstale":"2024-09-14T12:59:07.757541+0000","last_undegraded":"2024-09-14T12:59:07.757541+0000","last_fullsized":"2024-09-14T12:59:07.757541+0000","mapping_epoch":26,"log_start":"267'800","ondisk_log_start":"267'800","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:08:22.750609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:08:22.750609+0000","last_clean_scrub_stamp":"2024-09-14T11:08:22.750609+0000","objects_scrubbed":0,"log_size":96,"log_dups_size":800,"ondisk_log_size":96,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:41:31.186802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":4549,"num_read_kb":4112,"num_write":1219,"num_write_kb":503,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3d","version":"267'199","reported_seq":846,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:58:48.241280+0000","last_change":"2024-09-14T11:08:21.776968+0000","last_active":"2024-09-14T12:58:48.241280+0000","last_peered":"2024-09-14T12:58:48.241280+0000","last_clean":"2024-09-14T12:58:48.241280+0000","last_became_active":"2024-09-14T11:08:21.776255+0000","last_became_peered":"2024-09-14T11:08:21.776255+0000","last_unstale":"2024-09-14T12:58:48.241280+0000","last_undegraded":"2024-09-14T12:58:48.241280+0000","last_fullsized":"2024-09-14T12:58:48.241280+0000","mapping_epoch":24,"log_start":"267'100","ondisk_log_start":"267'100","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:08:20.733145+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:08:20.733145+0000","last_clean_scrub_stamp":"2024-09-14T11:08:20.733145+0000","objects_scrubbed":0,"log_size":99,"log_dups_size":100,"ondisk_log_size":99,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:55:21.434023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":840651,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":485,"num_read_kb":4028,"num_write":959,"num_write_kb":22458,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"267'468","reported_seq":2120,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:59:07.754233+0000","last_change":"2024-09-14T11:08:23.787232+0000","last_active":"2024-09-14T12:59:07.754233+0000","last_peered":"2024-09-14T12:59:07.754233+0000","last_clean":"2024-09-14T12:59:07.754233+0000","last_became_active":"2024-09-14T11:08:23.786481+0000","last_became_peered":"2024-09-14T11:08:23.786481+0000","last_unstale":"2024-09-14T12:59:07.754233+0000","last_undegraded":"2024-09-14T12:59:07.754233+0000","last_fullsized":"2024-09-14T12:59:07.754233+0000","mapping_epoch":26,"log_start":"267'400","ondisk_log_start":"267'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:08:22.750609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:08:22.750609+0000","last_clean_scrub_stamp":"2024-09-14T11:08:22.750609+0000","objects_scrubbed":0,"log_size":68,"log_dups_size":400,"ondisk_log_size":68,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:00:38.268952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2493,"num_read_kb":2352,"num_write":540,"num_write_kb":121,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3c","version":"267'342","reported_seq":1083,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:58:53.046745+0000","last_change":"2024-09-14T11:08:21.802797+0000","last_active":"2024-09-14T12:58:53.046745+0000","last_peered":"2024-09-14T12:58:53.046745+0000","last_clean":"2024-09-14T12:58:53.046745+0000","last_became_active":"2024-09-14T11:08:21.801787+0000","last_became_peered":"2024-09-14T11:08:21.801787+0000","last_unstale":"2024-09-14T12:58:53.046745+0000","last_undegraded":"2024-09-14T12:58:53.046745+0000","last_fullsized":"2024-09-14T12:58:53.046745+0000","mapping_epoch":24,"log_start":"267'300","ondisk_log_start":"267'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:08:20.733145+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:08:20.733145+0000","last_clean_scrub_stamp":"2024-09-14T11:08:20.733145+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":300,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:42:26.197796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12932840,"num_objects":11,"num_object_clones":0,"num_object_copies":33,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":1003,"num_read_kb":46020,"num_write":1378,"num_write_kb":39725,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3b","version":"267'448","reported_seq":1981,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:58:28.236458+0000","last_change":"2024-09-14T11:08:23.783446+0000","last_active":"2024-09-14T12:58:28.236458+0000","last_peered":"2024-09-14T12:58:28.236458+0000","last_clean":"2024-09-14T12:58:28.236458+0000","last_became_active":"2024-09-14T11:08:23.783162+0000","last_became_peered":"2024-09-14T11:08:23.783162+0000","last_unstale":"2024-09-14T12:58:28.236458+0000","last_undegraded":"2024-09-14T12:58:28.236458+0000","last_fullsized":"2024-09-14T12:58:28.236458+0000","mapping_epoch":26,"log_start":"267'400","ondisk_log_start":"267'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:08:22.750609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:08:22.750609+0000","last_clean_scrub_stamp":"2024-09-14T11:08:22.750609+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":400,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:56:25.662634+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2320,"num_read_kb":2170,"num_write":502,"num_write_kb":112,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3b","version":"267'203","reported_seq":884,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:58:22.829701+0000","last_change":"2024-09-14T11:08:21.842866+0000","last_active":"2024-09-14T12:58:22.829701+0000","last_peered":"2024-09-14T12:58:22.829701+0000","last_clean":"2024-09-14T12:58:22.829701+0000","last_became_active":"2024-09-14T11:08:21.842260+0000","last_became_peered":"2024-09-14T11:08:21.842260+0000","last_unstale":"2024-09-14T12:58:22.829701+0000","last_undegraded":"2024-09-14T12:58:22.829701+0000","last_fullsized":"2024-09-14T12:58:22.829701+0000","mapping_epoch":24,"log_start":"267'100","ondisk_log_start":"267'100","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:08:20.733145+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:08:20.733145+0000","last_clean_scrub_stamp":"2024-09-14T11:08:20.733145+0000","objects_scrubbed":0,"log_size":103,"log_dups_size":100,"ondisk_log_size":103,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:22:55.165506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":14390472,"num_objects":10,"num_object_clones":0,"num_object_copies":30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":558,"num_read_kb":28109,"num_write":982,"num_write_kb":35425,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,4],"acting":[7,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3c","version":"267'413","reported_seq":2185,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:00:21.249733+0000","last_change":"2024-09-14T11:08:23.805016+0000","last_active":"2024-09-14T13:00:21.249733+0000","last_peered":"2024-09-14T13:00:21.249733+0000","last_clean":"2024-09-14T13:00:21.249733+0000","last_became_active":"2024-09-14T11:08:23.804142+0000","last_became_peered":"2024-09-14T11:08:23.804142+0000","last_unstale":"2024-09-14T13:00:21.249733+0000","last_undegraded":"2024-09-14T13:00:21.249733+0000","last_fullsized":"2024-09-14T13:00:21.249733+0000","mapping_epoch":26,"log_start":"267'400","ondisk_log_start":"267'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:08:22.750609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:08:22.750609+0000","last_clean_scrub_stamp":"2024-09-14T11:08:22.750609+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":400,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:55:23.451486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":2567,"num_read_kb":2469,"num_write":470,"num_write_kb":86,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.3a","version":"267'150","reported_seq":774,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:58:23.039736+0000","last_change":"2024-09-14T11:08:21.794493+0000","last_active":"2024-09-14T12:58:23.039736+0000","last_peered":"2024-09-14T12:58:23.039736+0000","last_clean":"2024-09-14T12:58:23.039736+0000","last_became_active":"2024-09-14T11:08:21.791801+0000","last_became_peered":"2024-09-14T11:08:21.791801+0000","last_unstale":"2024-09-14T12:58:23.039736+0000","last_undegraded":"2024-09-14T12:58:23.039736+0000","last_fullsized":"2024-09-14T12:58:23.039736+0000","mapping_epoch":24,"log_start":"267'100","ondisk_log_start":"267'100","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:08:20.733145+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:08:20.733145+0000","last_clean_scrub_stamp":"2024-09-14T11:08:20.733145+0000","objects_scrubbed":0,"log_size":50,"log_dups_size":100,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:05:17.496109+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9789060,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":408,"num_read_kb":24131,"num_write":675,"num_write_kb":32915,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,3],"acting":[5,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3d","version":"267'393","reported_seq":1933,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:00:21.252531+0000","last_change":"2024-09-14T11:08:23.787239+0000","last_active":"2024-09-14T13:00:21.252531+0000","last_peered":"2024-09-14T13:00:21.252531+0000","last_clean":"2024-09-14T13:00:21.252531+0000","last_became_active":"2024-09-14T11:08:23.786522+0000","last_became_peered":"2024-09-14T11:08:23.786522+0000","last_unstale":"2024-09-14T13:00:21.252531+0000","last_undegraded":"2024-09-14T13:00:21.252531+0000","last_fullsized":"2024-09-14T13:00:21.252531+0000","mapping_epoch":26,"log_start":"267'300","ondisk_log_start":"267'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:08:22.750609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:08:22.750609+0000","last_clean_scrub_stamp":"2024-09-14T11:08:22.750609+0000","objects_scrubbed":0,"log_size":93,"log_dups_size":300,"ondisk_log_size":93,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:53:44.242192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2147,"num_read_kb":2043,"num_write":454,"num_write_kb":90,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.39","version":"267'263","reported_seq":1028,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:58:22.829604+0000","last_change":"2024-09-14T11:08:21.837745+0000","last_active":"2024-09-14T12:58:22.829604+0000","last_peered":"2024-09-14T12:58:22.829604+0000","last_clean":"2024-09-14T12:58:22.829604+0000","last_became_active":"2024-09-14T11:08:21.837147+0000","last_became_peered":"2024-09-14T11:08:21.837147+0000","last_unstale":"2024-09-14T12:58:22.829604+0000","last_undegraded":"2024-09-14T12:58:22.829604+0000","last_fullsized":"2024-09-14T12:58:22.829604+0000","mapping_epoch":24,"log_start":"267'200","ondisk_log_start":"267'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:08:20.733145+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:08:20.733145+0000","last_clean_scrub_stamp":"2024-09-14T11:08:20.733145+0000","objects_scrubbed":0,"log_size":63,"log_dups_size":200,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:35:30.293697+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5878766,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":1265,"num_read_kb":31286,"num_write":1151,"num_write_kb":25837,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0,4],"acting":[7,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3e","version":"267'508","reported_seq":2123,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:00:11.324764+0000","last_change":"2024-09-14T11:08:23.801317+0000","last_active":"2024-09-14T13:00:11.324764+0000","last_peered":"2024-09-14T13:00:11.324764+0000","last_clean":"2024-09-14T13:00:11.324764+0000","last_became_active":"2024-09-14T11:08:23.800621+0000","last_became_peered":"2024-09-14T11:08:23.800621+0000","last_unstale":"2024-09-14T13:00:11.324764+0000","last_undegraded":"2024-09-14T13:00:11.324764+0000","last_fullsized":"2024-09-14T13:00:11.324764+0000","mapping_epoch":26,"log_start":"267'400","ondisk_log_start":"267'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:08:22.750609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:08:22.750609+0000","last_clean_scrub_stamp":"2024-09-14T11:08:22.750609+0000","objects_scrubbed":0,"log_size":108,"log_dups_size":400,"ondisk_log_size":108,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:34:14.386345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2676,"num_read_kb":2481,"num_write":623,"num_write_kb":172,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.38","version":"267'206","reported_seq":872,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:59:07.321553+0000","last_change":"2024-09-14T11:08:21.819323+0000","last_active":"2024-09-14T12:59:07.321553+0000","last_peered":"2024-09-14T12:59:07.321553+0000","last_clean":"2024-09-14T12:59:07.321553+0000","last_became_active":"2024-09-14T11:08:21.819029+0000","last_became_peered":"2024-09-14T11:08:21.819029+0000","last_unstale":"2024-09-14T12:59:07.321553+0000","last_undegraded":"2024-09-14T12:59:07.321553+0000","last_fullsized":"2024-09-14T12:59:07.321553+0000","mapping_epoch":24,"log_start":"267'100","ondisk_log_start":"267'100","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:08:20.733145+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:08:20.733145+0000","last_clean_scrub_stamp":"2024-09-14T11:08:20.733145+0000","objects_scrubbed":0,"log_size":106,"log_dups_size":100,"ondisk_log_size":106,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:51:45.031916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12593222,"num_objects":11,"num_object_clones":0,"num_object_copies":33,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":520,"num_read_kb":44666,"num_write":924,"num_write_kb":39932,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,6],"acting":[3,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3f","version":"267'916","reported_seq":2562,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:59:18.403546+0000","last_change":"2024-09-14T11:08:23.786220+0000","last_active":"2024-09-14T12:59:18.403546+0000","last_peered":"2024-09-14T12:59:18.403546+0000","last_clean":"2024-09-14T12:59:18.403546+0000","last_became_active":"2024-09-14T11:08:23.785941+0000","last_became_peered":"2024-09-14T11:08:23.785941+0000","last_unstale":"2024-09-14T12:59:18.403546+0000","last_undegraded":"2024-09-14T12:59:18.403546+0000","last_fullsized":"2024-09-14T12:59:18.403546+0000","mapping_epoch":26,"log_start":"267'900","ondisk_log_start":"267'900","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:08:22.750609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:08:22.750609+0000","last_clean_scrub_stamp":"2024-09-14T11:08:22.750609+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":900,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:26:08.067752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":4272,"num_read_kb":3805,"num_write":1224,"num_write_kb":476,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"267'397","reported_seq":1969,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:00:21.252799+0000","last_change":"2024-09-14T11:08:23.786268+0000","last_active":"2024-09-14T13:00:21.252799+0000","last_peered":"2024-09-14T13:00:21.252799+0000","last_clean":"2024-09-14T13:00:21.252799+0000","last_became_active":"2024-09-14T11:08:23.785439+0000","last_became_peered":"2024-09-14T11:08:23.785439+0000","last_unstale":"2024-09-14T13:00:21.252799+0000","last_undegraded":"2024-09-14T13:00:21.252799+0000","last_fullsized":"2024-09-14T13:00:21.252799+0000","mapping_epoch":26,"log_start":"267'300","ondisk_log_start":"267'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:08:22.750609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:08:22.750609+0000","last_clean_scrub_stamp":"2024-09-14T11:08:22.750609+0000","objects_scrubbed":0,"log_size":97,"log_dups_size":300,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:49:38.056814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2124,"num_read_kb":2036,"num_write":427,"num_write_kb":63,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.37","version":"267'271","reported_seq":1003,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:57:42.820443+0000","last_change":"2024-09-14T11:08:21.806356+0000","last_active":"2024-09-14T12:57:42.820443+0000","last_peered":"2024-09-14T12:57:42.820443+0000","last_clean":"2024-09-14T12:57:42.820443+0000","last_became_active":"2024-09-14T11:08:21.805293+0000","last_became_peered":"2024-09-14T11:08:21.805293+0000","last_unstale":"2024-09-14T12:57:42.820443+0000","last_undegraded":"2024-09-14T12:57:42.820443+0000","last_fullsized":"2024-09-14T12:57:42.820443+0000","mapping_epoch":24,"log_start":"267'200","ondisk_log_start":"267'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:08:20.733145+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:08:20.733145+0000","last_clean_scrub_stamp":"2024-09-14T11:08:20.733145+0000","objects_scrubbed":0,"log_size":71,"log_dups_size":200,"ondisk_log_size":71,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:37:18.597607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10071722,"num_objects":9,"num_object_clones":0,"num_object_copies":27,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":1081,"num_read_kb":13085,"num_write":1145,"num_write_kb":51014,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,0],"acting":[7,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.31","version":"267'698","reported_seq":2408,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:00:21.250245+0000","last_change":"2024-09-14T11:08:23.808916+0000","last_active":"2024-09-14T13:00:21.250245+0000","last_peered":"2024-09-14T13:00:21.250245+0000","last_clean":"2024-09-14T13:00:21.250245+0000","last_became_active":"2024-09-14T11:08:23.808090+0000","last_became_peered":"2024-09-14T11:08:23.808090+0000","last_unstale":"2024-09-14T13:00:21.250245+0000","last_undegraded":"2024-09-14T13:00:21.250245+0000","last_fullsized":"2024-09-14T13:00:21.250245+0000","mapping_epoch":26,"log_start":"267'600","ondisk_log_start":"267'600","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:08:22.750609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:08:22.750609+0000","last_clean_scrub_stamp":"2024-09-14T11:08:22.750609+0000","objects_scrubbed":0,"log_size":98,"log_dups_size":600,"ondisk_log_size":98,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:17:11.316389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":3652,"num_read_kb":3296,"num_write":1024,"num_write_kb":466,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"267'178","reported_seq":813,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:59:33.437531+0000","last_change":"2024-09-14T11:08:21.825717+0000","last_active":"2024-09-14T12:59:33.437531+0000","last_peered":"2024-09-14T12:59:33.437531+0000","last_clean":"2024-09-14T12:59:33.437531+0000","last_became_active":"2024-09-14T11:08:21.824907+0000","last_became_peered":"2024-09-14T11:08:21.824907+0000","last_unstale":"2024-09-14T12:59:33.437531+0000","last_undegraded":"2024-09-14T12:59:33.437531+0000","last_fullsized":"2024-09-14T12:59:33.437531+0000","mapping_epoch":24,"log_start":"267'100","ondisk_log_start":"267'100","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:08:20.733145+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:08:20.733145+0000","last_clean_scrub_stamp":"2024-09-14T11:08:20.733145+0000","objects_scrubbed":0,"log_size":78,"log_dups_size":100,"ondisk_log_size":78,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:24:44.159796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6291524,"num_objects":9,"num_object_clones":0,"num_object_copies":27,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":503,"num_read_kb":17557,"num_write":871,"num_write_kb":17084,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,4],"acting":[6,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.32","version":"267'540","reported_seq":2172,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:58:38.043258+0000","last_change":"2024-09-14T11:08:23.804611+0000","last_active":"2024-09-14T12:58:38.043258+0000","last_peered":"2024-09-14T12:58:38.043258+0000","last_clean":"2024-09-14T12:58:38.043258+0000","last_became_active":"2024-09-14T11:08:23.801090+0000","last_became_peered":"2024-09-14T11:08:23.801090+0000","last_unstale":"2024-09-14T12:58:38.043258+0000","last_undegraded":"2024-09-14T12:58:38.043258+0000","last_fullsized":"2024-09-14T12:58:38.043258+0000","mapping_epoch":26,"log_start":"267'500","ondisk_log_start":"267'500","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:08:22.750609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:08:22.750609+0000","last_clean_scrub_stamp":"2024-09-14T11:08:22.750609+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":500,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:20:59.798401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2832,"num_read_kb":2611,"num_write":684,"num_write_kb":208,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.35","version":"267'226","reported_seq":896,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:59:33.437462+0000","last_change":"2024-09-14T11:08:21.817869+0000","last_active":"2024-09-14T12:59:33.437462+0000","last_peered":"2024-09-14T12:59:33.437462+0000","last_clean":"2024-09-14T12:59:33.437462+0000","last_became_active":"2024-09-14T11:08:21.817113+0000","last_became_peered":"2024-09-14T11:08:21.817113+0000","last_unstale":"2024-09-14T12:59:33.437462+0000","last_undegraded":"2024-09-14T12:59:33.437462+0000","last_fullsized":"2024-09-14T12:59:33.437462+0000","mapping_epoch":24,"log_start":"267'200","ondisk_log_start":"267'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:08:20.733145+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:08:20.733145+0000","last_clean_scrub_stamp":"2024-09-14T11:08:20.733145+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":200,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:19:02.887954+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5850197,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":572,"num_read_kb":71773,"num_write":1061,"num_write_kb":34768,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,0],"acting":[6,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.33","version":"267'480","reported_seq":2201,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:59:14.731435+0000","last_change":"2024-09-14T11:08:23.782419+0000","last_active":"2024-09-14T12:59:14.731435+0000","last_peered":"2024-09-14T12:59:14.731435+0000","last_clean":"2024-09-14T12:59:14.731435+0000","last_became_active":"2024-09-14T11:08:23.782135+0000","last_became_peered":"2024-09-14T11:08:23.782135+0000","last_unstale":"2024-09-14T12:59:14.731435+0000","last_undegraded":"2024-09-14T12:59:14.731435+0000","last_fullsized":"2024-09-14T12:59:14.731435+0000","mapping_epoch":26,"log_start":"267'400","ondisk_log_start":"267'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:08:22.750609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:08:22.750609+0000","last_clean_scrub_stamp":"2024-09-14T11:08:22.750609+0000","objects_scrubbed":0,"log_size":80,"log_dups_size":400,"ondisk_log_size":80,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:10:45.724644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2660,"num_read_kb":2528,"num_write":519,"num_write_kb":93,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.34","version":"267'243","reported_seq":897,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:59:33.240274+0000","last_change":"2024-09-14T11:08:21.837036+0000","last_active":"2024-09-14T12:59:33.240274+0000","last_peered":"2024-09-14T12:59:33.240274+0000","last_clean":"2024-09-14T12:59:33.240274+0000","last_became_active":"2024-09-14T11:08:21.835636+0000","last_became_peered":"2024-09-14T11:08:21.835636+0000","last_unstale":"2024-09-14T12:59:33.240274+0000","last_undegraded":"2024-09-14T12:59:33.240274+0000","last_fullsized":"2024-09-14T12:59:33.240274+0000","mapping_epoch":24,"log_start":"267'200","ondisk_log_start":"267'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:08:20.733145+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:08:20.733145+0000","last_clean_scrub_stamp":"2024-09-14T11:08:20.733145+0000","objects_scrubbed":0,"log_size":43,"log_dups_size":200,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:36:27.787998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4436620,"num_objects":9,"num_object_clones":0,"num_object_copies":27,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":568,"num_read_kb":3577,"num_write":1178,"num_write_kb":25395,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6],"acting":[4,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.34","version":"267'553","reported_seq":2210,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:58:07.979376+0000","last_change":"2024-09-14T11:08:23.784471+0000","last_active":"2024-09-14T12:58:07.979376+0000","last_peered":"2024-09-14T12:58:07.979376+0000","last_clean":"2024-09-14T12:58:07.979376+0000","last_became_active":"2024-09-14T11:08:23.784078+0000","last_became_peered":"2024-09-14T11:08:23.784078+0000","last_unstale":"2024-09-14T12:58:07.979376+0000","last_undegraded":"2024-09-14T12:58:07.979376+0000","last_fullsized":"2024-09-14T12:58:07.979376+0000","mapping_epoch":26,"log_start":"267'500","ondisk_log_start":"267'500","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:08:22.750609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:08:22.750609+0000","last_clean_scrub_stamp":"2024-09-14T11:08:22.750609+0000","objects_scrubbed":0,"log_size":53,"log_dups_size":500,"ondisk_log_size":53,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:53:20.985980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3071,"num_read_kb":2852,"num_write":734,"num_write_kb":256,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.33","version":"267'233","reported_seq":867,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:59:33.474985+0000","last_change":"2024-09-14T11:08:21.809864+0000","last_active":"2024-09-14T12:59:33.474985+0000","last_peered":"2024-09-14T12:59:33.474985+0000","last_clean":"2024-09-14T12:59:33.474985+0000","last_became_active":"2024-09-14T11:08:21.809526+0000","last_became_peered":"2024-09-14T11:08:21.809526+0000","last_unstale":"2024-09-14T12:59:33.474985+0000","last_undegraded":"2024-09-14T12:59:33.474985+0000","last_fullsized":"2024-09-14T12:59:33.474985+0000","mapping_epoch":24,"log_start":"267'200","ondisk_log_start":"267'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:08:20.733145+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:08:20.733145+0000","last_clean_scrub_stamp":"2024-09-14T11:08:20.733145+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":200,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:48:26.943407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4221511,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":493,"num_read_kb":25002,"num_write":1052,"num_write_kb":23085,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6,1],"acting":[3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.35","version":"267'800","reported_seq":2455,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:00:11.251816+0000","last_change":"2024-09-14T11:08:23.786757+0000","last_active":"2024-09-14T13:00:11.251816+0000","last_peered":"2024-09-14T13:00:11.251816+0000","last_clean":"2024-09-14T13:00:11.251816+0000","last_became_active":"2024-09-14T11:08:23.785540+0000","last_became_peered":"2024-09-14T11:08:23.785540+0000","last_unstale":"2024-09-14T13:00:11.251816+0000","last_undegraded":"2024-09-14T13:00:11.251816+0000","last_fullsized":"2024-09-14T13:00:11.251816+0000","mapping_epoch":26,"log_start":"267'700","ondisk_log_start":"267'700","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:08:22.750609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:08:22.750609+0000","last_clean_scrub_stamp":"2024-09-14T11:08:22.750609+0000","objects_scrubbed":0,"log_size":100,"log_dups_size":700,"ondisk_log_size":100,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:29:32.957124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3845,"num_read_kb":3496,"num_write":1039,"num_write_kb":364,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.32","version":"267'213","reported_seq":1002,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:58:23.453514+0000","last_change":"2024-09-14T11:08:21.781133+0000","last_active":"2024-09-14T12:58:23.453514+0000","last_peered":"2024-09-14T12:58:23.453514+0000","last_clean":"2024-09-14T12:58:23.453514+0000","last_became_active":"2024-09-14T11:08:21.780800+0000","last_became_peered":"2024-09-14T11:08:21.780800+0000","last_unstale":"2024-09-14T12:58:23.453514+0000","last_undegraded":"2024-09-14T12:58:23.453514+0000","last_fullsized":"2024-09-14T12:58:23.453514+0000","mapping_epoch":24,"log_start":"267'200","ondisk_log_start":"267'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:08:20.733145+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:08:20.733145+0000","last_clean_scrub_stamp":"2024-09-14T11:08:20.733145+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":200,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:07:51.388416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":13282806,"num_objects":13,"num_object_clones":0,"num_object_copies":39,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":13,"num_whiteouts":0,"num_read":1390,"num_read_kb":21343,"num_write":1076,"num_write_kb":34809,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,1],"acting":[0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.18","version":"267'195","reported_seq":738,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:00:21.491522+0000","last_change":"2024-09-14T11:08:31.851342+0000","last_active":"2024-09-14T13:00:21.491522+0000","last_peered":"2024-09-14T13:00:21.491522+0000","last_clean":"2024-09-14T13:00:21.491522+0000","last_became_active":"2024-09-14T11:08:31.850605+0000","last_became_peered":"2024-09-14T11:08:31.850605+0000","last_unstale":"2024-09-14T13:00:21.491522+0000","last_undegraded":"2024-09-14T13:00:21.491522+0000","last_fullsized":"2024-09-14T13:00:21.491522+0000","mapping_epoch":34,"log_start":"267'100","ondisk_log_start":"267'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:08:30.789404+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:08:30.789404+0000","last_clean_scrub_stamp":"2024-09-14T11:08:30.789404+0000","objects_scrubbed":0,"log_size":95,"log_dups_size":100,"ondisk_log_size":95,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:48:10.230125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":204,"num_read_kb":191,"num_write":376,"num_write_kb":86,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.14","version":"267'865","reported_seq":2388,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:00:18.886532+0000","last_change":"2024-09-14T11:08:23.780134+0000","last_active":"2024-09-14T13:00:18.886532+0000","last_peered":"2024-09-14T13:00:18.886532+0000","last_clean":"2024-09-14T13:00:18.886532+0000","last_became_active":"2024-09-14T11:08:23.779822+0000","last_became_peered":"2024-09-14T11:08:23.779822+0000","last_unstale":"2024-09-14T13:00:18.886532+0000","last_undegraded":"2024-09-14T13:00:18.886532+0000","last_fullsized":"2024-09-14T13:00:18.886532+0000","mapping_epoch":26,"log_start":"267'800","ondisk_log_start":"267'800","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:08:22.750609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:08:22.750609+0000","last_clean_scrub_stamp":"2024-09-14T11:08:22.750609+0000","objects_scrubbed":0,"log_size":65,"log_dups_size":800,"ondisk_log_size":65,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:33:11.558147+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":4044,"num_read_kb":3595,"num_write":1182,"num_write_kb":452,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"267'233","reported_seq":1001,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:59:18.105681+0000","last_change":"2024-09-14T11:08:21.843849+0000","last_active":"2024-09-14T12:59:18.105681+0000","last_peered":"2024-09-14T12:59:18.105681+0000","last_clean":"2024-09-14T12:59:18.105681+0000","last_became_active":"2024-09-14T11:08:21.843212+0000","last_became_peered":"2024-09-14T11:08:21.843212+0000","last_unstale":"2024-09-14T12:59:18.105681+0000","last_undegraded":"2024-09-14T12:59:18.105681+0000","last_fullsized":"2024-09-14T12:59:18.105681+0000","mapping_epoch":24,"log_start":"267'200","ondisk_log_start":"267'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:08:20.733145+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:08:20.733145+0000","last_clean_scrub_stamp":"2024-09-14T11:08:20.733145+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":200,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:37:14.565663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9776683,"num_objects":9,"num_object_clones":0,"num_object_copies":27,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":1009,"num_read_kb":177065,"num_write":1096,"num_write_kb":33961,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,4],"acting":[7,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":525,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:57:13.024031+0000","last_change":"2024-09-14T11:08:25.814095+0000","last_active":"2024-09-14T12:57:13.024031+0000","last_peered":"2024-09-14T12:57:13.024031+0000","last_clean":"2024-09-14T12:57:13.024031+0000","last_became_active":"2024-09-14T11:08:25.803311+0000","last_became_peered":"2024-09-14T11:08:25.803311+0000","last_unstale":"2024-09-14T12:57:13.024031+0000","last_undegraded":"2024-09-14T12:57:13.024031+0000","last_fullsized":"2024-09-14T12:57:13.024031+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:08:24.757170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:08:24.757170+0000","last_clean_scrub_stamp":"2024-09-14T11:08:24.757170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:07:56.109258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.16","version":"267'224","reported_seq":877,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:59:38.254173+0000","last_change":"2024-09-14T11:08:27.809396+0000","last_active":"2024-09-14T12:59:38.254173+0000","last_peered":"2024-09-14T12:59:38.254173+0000","last_clean":"2024-09-14T12:59:38.254173+0000","last_became_active":"2024-09-14T11:08:27.808834+0000","last_became_peered":"2024-09-14T11:08:27.808834+0000","last_unstale":"2024-09-14T12:59:38.254173+0000","last_undegraded":"2024-09-14T12:59:38.254173+0000","last_fullsized":"2024-09-14T12:59:38.254173+0000","mapping_epoch":30,"log_start":"267'200","ondisk_log_start":"267'200","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:08:26.771628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:08:26.771628+0000","last_clean_scrub_stamp":"2024-09-14T11:08:26.771628+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":200,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:33:46.586543+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7578,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":299,"num_read_kb":302,"num_write":176,"num_write_kb":15,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":518,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:57:17.814599+0000","last_change":"2024-09-14T11:08:29.834235+0000","last_active":"2024-09-14T12:57:17.814599+0000","last_peered":"2024-09-14T12:57:17.814599+0000","last_clean":"2024-09-14T12:57:17.814599+0000","last_became_active":"2024-09-14T11:08:29.833332+0000","last_became_peered":"2024-09-14T11:08:29.833332+0000","last_unstale":"2024-09-14T12:57:17.814599+0000","last_undegraded":"2024-09-14T12:57:17.814599+0000","last_fullsized":"2024-09-14T12:57:17.814599+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:08:28.783586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:08:28.783586+0000","last_clean_scrub_stamp":"2024-09-14T11:08:28.783586+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:59:44.395012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.19","version":"267'122","reported_seq":639,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:57:48.032017+0000","last_change":"2024-09-14T11:08:31.844405+0000","last_active":"2024-09-14T12:57:48.032017+0000","last_peered":"2024-09-14T12:57:48.032017+0000","last_clean":"2024-09-14T12:57:48.032017+0000","last_became_active":"2024-09-14T11:08:31.843645+0000","last_became_peered":"2024-09-14T11:08:31.843645+0000","last_unstale":"2024-09-14T12:57:48.032017+0000","last_undegraded":"2024-09-14T12:57:48.032017+0000","last_fullsized":"2024-09-14T12:57:48.032017+0000","mapping_epoch":34,"log_start":"267'100","ondisk_log_start":"267'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:08:30.789404+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:08:30.789404+0000","last_clean_scrub_stamp":"2024-09-14T11:08:30.789404+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":100,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:14:31.616675+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":100,"num_read_kb":97,"num_write":289,"num_write_kb":65,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.15","version":"267'1234","reported_seq":3011,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:00:18.829256+0000","last_change":"2024-09-14T11:08:23.809577+0000","last_active":"2024-09-14T13:00:18.829256+0000","last_peered":"2024-09-14T13:00:18.829256+0000","last_clean":"2024-09-14T13:00:18.829256+0000","last_became_active":"2024-09-14T11:08:23.808015+0000","last_became_peered":"2024-09-14T11:08:23.808015+0000","last_unstale":"2024-09-14T13:00:18.829256+0000","last_undegraded":"2024-09-14T13:00:18.829256+0000","last_fullsized":"2024-09-14T13:00:18.829256+0000","mapping_epoch":26,"log_start":"267'1200","ondisk_log_start":"267'1200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:08:22.750609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:08:22.750609+0000","last_clean_scrub_stamp":"2024-09-14T11:08:22.750609+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":1200,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:00:36.480612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":5778,"num_read_kb":5143,"num_write":1691,"num_write_kb":698,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.12","version":"267'226","reported_seq":943,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:01:28.902381+0000","last_change":"2024-09-14T11:08:21.787689+0000","last_active":"2024-09-14T13:01:28.902381+0000","last_peered":"2024-09-14T13:01:28.902381+0000","last_clean":"2024-09-14T13:01:28.902381+0000","last_became_active":"2024-09-14T11:08:21.787257+0000","last_became_peered":"2024-09-14T11:08:21.787257+0000","last_unstale":"2024-09-14T13:01:28.902381+0000","last_undegraded":"2024-09-14T13:01:28.902381+0000","last_fullsized":"2024-09-14T13:01:28.902381+0000","mapping_epoch":24,"log_start":"267'200","ondisk_log_start":"267'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:08:20.733145+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:08:20.733145+0000","last_clean_scrub_stamp":"2024-09-14T11:08:20.733145+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":200,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:56:32.268492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10812449,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":654,"num_read_kb":98910,"num_write":976,"num_write_kb":32453,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3],"acting":[0,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":527,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:58:28.459329+0000","last_change":"2024-09-14T11:08:25.804425+0000","last_active":"2024-09-14T12:58:28.459329+0000","last_peered":"2024-09-14T12:58:28.459329+0000","last_clean":"2024-09-14T12:58:28.459329+0000","last_became_active":"2024-09-14T11:08:25.804100+0000","last_became_peered":"2024-09-14T11:08:25.804100+0000","last_unstale":"2024-09-14T12:58:28.459329+0000","last_undegraded":"2024-09-14T12:58:28.459329+0000","last_fullsized":"2024-09-14T12:58:28.459329+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:08:24.757170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:08:24.757170+0000","last_clean_scrub_stamp":"2024-09-14T11:08:24.757170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:44:03.143728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.17","version":"267'129","reported_seq":704,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:59:18.421604+0000","last_change":"2024-09-14T11:08:27.831807+0000","last_active":"2024-09-14T12:59:18.421604+0000","last_peered":"2024-09-14T12:59:18.421604+0000","last_clean":"2024-09-14T12:59:18.421604+0000","last_became_active":"2024-09-14T11:08:27.831010+0000","last_became_peered":"2024-09-14T11:08:27.831010+0000","last_unstale":"2024-09-14T12:59:18.421604+0000","last_undegraded":"2024-09-14T12:59:18.421604+0000","last_fullsized":"2024-09-14T12:59:18.421604+0000","mapping_epoch":30,"log_start":"267'100","ondisk_log_start":"267'100","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:08:26.771628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:08:26.771628+0000","last_clean_scrub_stamp":"2024-09-14T11:08:26.771628+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":100,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:48:05.929304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":152,"num_read_kb":149,"num_write":100,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":519,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:57:18.209572+0000","last_change":"2024-09-14T11:08:29.810149+0000","last_active":"2024-09-14T12:57:18.209572+0000","last_peered":"2024-09-14T12:57:18.209572+0000","last_clean":"2024-09-14T12:57:18.209572+0000","last_became_active":"2024-09-14T11:08:29.809568+0000","last_became_peered":"2024-09-14T11:08:29.809568+0000","last_unstale":"2024-09-14T12:57:18.209572+0000","last_undegraded":"2024-09-14T12:57:18.209572+0000","last_fullsized":"2024-09-14T12:57:18.209572+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:08:28.783586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:08:28.783586+0000","last_clean_scrub_stamp":"2024-09-14T11:08:28.783586+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:07:09.977514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.1a","version":"267'137","reported_seq":722,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:58:33.237668+0000","last_change":"2024-09-14T11:08:31.846263+0000","last_active":"2024-09-14T12:58:33.237668+0000","last_peered":"2024-09-14T12:58:33.237668+0000","last_clean":"2024-09-14T12:58:33.237668+0000","last_became_active":"2024-09-14T11:08:31.845634+0000","last_became_peered":"2024-09-14T11:08:31.845634+0000","last_unstale":"2024-09-14T12:58:33.237668+0000","last_undegraded":"2024-09-14T12:58:33.237668+0000","last_fullsized":"2024-09-14T12:58:33.237668+0000","mapping_epoch":34,"log_start":"267'100","ondisk_log_start":"267'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:08:30.789404+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:08:30.789404+0000","last_clean_scrub_stamp":"2024-09-14T11:08:30.789404+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":100,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:44:18.672749+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":271,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":347,"num_read_kb":294,"num_write":357,"num_write_kb":85,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"267'409","reported_seq":1926,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:01:39.333037+0000","last_change":"2024-09-14T11:08:23.780617+0000","last_active":"2024-09-14T13:01:39.333037+0000","last_peered":"2024-09-14T13:01:39.333037+0000","last_clean":"2024-09-14T13:01:39.333037+0000","last_became_active":"2024-09-14T11:08:23.780326+0000","last_became_peered":"2024-09-14T11:08:23.780326+0000","last_unstale":"2024-09-14T13:01:39.333037+0000","last_undegraded":"2024-09-14T13:01:39.333037+0000","last_fullsized":"2024-09-14T13:01:39.333037+0000","mapping_epoch":26,"log_start":"267'300","ondisk_log_start":"267'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:08:22.750609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:08:22.750609+0000","last_clean_scrub_stamp":"2024-09-14T11:08:22.750609+0000","objects_scrubbed":0,"log_size":109,"log_dups_size":300,"ondisk_log_size":109,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:31:39.789906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2172,"num_read_kb":2053,"num_write":475,"num_write_kb":100,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.11","version":"267'223","reported_seq":849,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:58:37.822725+0000","last_change":"2024-09-14T11:08:56.039243+0000","last_active":"2024-09-14T12:58:37.822725+0000","last_peered":"2024-09-14T12:58:37.822725+0000","last_clean":"2024-09-14T12:58:37.822725+0000","last_became_active":"2024-09-14T11:08:56.038815+0000","last_became_peered":"2024-09-14T11:08:56.038815+0000","last_unstale":"2024-09-14T12:58:37.822725+0000","last_undegraded":"2024-09-14T12:58:37.822725+0000","last_fullsized":"2024-09-14T12:58:37.822725+0000","mapping_epoch":37,"log_start":"267'200","ondisk_log_start":"267'200","created":24,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:08:20.733145+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:08:20.733145+0000","last_clean_scrub_stamp":"2024-09-14T11:08:20.733145+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":200,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:21:36.040245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7368155,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":502,"num_read_kb":22051,"num_write":990,"num_write_kb":45213,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4,6],"acting":[2,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":525,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:57:13.438368+0000","last_change":"2024-09-14T11:08:25.798412+0000","last_active":"2024-09-14T12:57:13.438368+0000","last_peered":"2024-09-14T12:57:13.438368+0000","last_clean":"2024-09-14T12:57:13.438368+0000","last_became_active":"2024-09-14T11:08:25.798008+0000","last_became_peered":"2024-09-14T11:08:25.798008+0000","last_unstale":"2024-09-14T12:57:13.438368+0000","last_undegraded":"2024-09-14T12:57:13.438368+0000","last_fullsized":"2024-09-14T12:57:13.438368+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:08:24.757170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:08:24.757170+0000","last_clean_scrub_stamp":"2024-09-14T11:08:24.757170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:17:44.680400+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.14","version":"267'180","reported_seq":783,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:00:11.342120+0000","last_change":"2024-09-14T11:08:27.821531+0000","last_active":"2024-09-14T13:00:11.342120+0000","last_peered":"2024-09-14T13:00:11.342120+0000","last_clean":"2024-09-14T13:00:11.342120+0000","last_became_active":"2024-09-14T11:08:27.820627+0000","last_became_peered":"2024-09-14T11:08:27.820627+0000","last_unstale":"2024-09-14T13:00:11.342120+0000","last_undegraded":"2024-09-14T13:00:11.342120+0000","last_fullsized":"2024-09-14T13:00:11.342120+0000","mapping_epoch":30,"log_start":"267'100","ondisk_log_start":"267'100","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:08:26.771628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:08:26.771628+0000","last_clean_scrub_stamp":"2024-09-14T11:08:26.771628+0000","objects_scrubbed":0,"log_size":80,"log_dups_size":100,"ondisk_log_size":80,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:00:26.336465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":232,"num_read_kb":224,"num_write":158,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.15","version":"267'772","reported_seq":3168,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:01:40.716321+0000","last_change":"2024-09-14T11:08:29.838884+0000","last_active":"2024-09-14T13:01:40.716321+0000","last_peered":"2024-09-14T13:01:40.716321+0000","last_clean":"2024-09-14T13:01:40.716321+0000","last_became_active":"2024-09-14T11:08:29.838193+0000","last_became_peered":"2024-09-14T11:08:29.838193+0000","last_unstale":"2024-09-14T13:01:40.716321+0000","last_undegraded":"2024-09-14T13:01:40.716321+0000","last_fullsized":"2024-09-14T13:01:40.716321+0000","mapping_epoch":32,"log_start":"267'701","ondisk_log_start":"267'701","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:08:28.783586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:08:28.783586+0000","last_clean_scrub_stamp":"2024-09-14T11:08:28.783586+0000","objects_scrubbed":0,"log_size":71,"log_dups_size":701,"ondisk_log_size":71,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:51:08.846542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1b","version":"267'210","reported_seq":1068,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:00:21.684009+0000","last_change":"2024-09-14T11:08:31.844271+0000","last_active":"2024-09-14T13:00:21.684009+0000","last_peered":"2024-09-14T13:00:21.684009+0000","last_clean":"2024-09-14T13:00:21.684009+0000","last_became_active":"2024-09-14T11:08:31.843385+0000","last_became_peered":"2024-09-14T11:08:31.843385+0000","last_unstale":"2024-09-14T13:00:21.684009+0000","last_undegraded":"2024-09-14T13:00:21.684009+0000","last_fullsized":"2024-09-14T13:00:21.684009+0000","mapping_epoch":34,"log_start":"267'100","ondisk_log_start":"267'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:08:30.789404+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:08:30.789404+0000","last_clean_scrub_stamp":"2024-09-14T11:08:30.789404+0000","objects_scrubbed":0,"log_size":110,"log_dups_size":100,"ondisk_log_size":110,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:50:52.716773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":642,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":623,"num_read_kb":612,"num_write":468,"num_write_kb":119,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.17","version":"267'420","reported_seq":1909,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:58:42.824128+0000","last_change":"2024-09-14T11:09:57.239996+0000","last_active":"2024-09-14T12:58:42.824128+0000","last_peered":"2024-09-14T12:58:42.824128+0000","last_clean":"2024-09-14T12:58:42.824128+0000","last_became_active":"2024-09-14T11:09:57.239636+0000","last_became_peered":"2024-09-14T11:09:57.239636+0000","last_unstale":"2024-09-14T12:58:42.824128+0000","last_undegraded":"2024-09-14T12:58:42.824128+0000","last_fullsized":"2024-09-14T12:58:42.824128+0000","mapping_epoch":39,"log_start":"267'400","ondisk_log_start":"267'400","created":26,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:08:22.750609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:08:22.750609+0000","last_clean_scrub_stamp":"2024-09-14T11:08:22.750609+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":400,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:53:58.019330+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2202,"num_read_kb":2076,"num_write":491,"num_write_kb":104,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.10","version":"267'245","reported_seq":913,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:58:03.417656+0000","last_change":"2024-09-14T11:08:21.826810+0000","last_active":"2024-09-14T12:58:03.417656+0000","last_peered":"2024-09-14T12:58:03.417656+0000","last_clean":"2024-09-14T12:58:03.417656+0000","last_became_active":"2024-09-14T11:08:21.817332+0000","last_became_peered":"2024-09-14T11:08:21.817332+0000","last_unstale":"2024-09-14T12:58:03.417656+0000","last_undegraded":"2024-09-14T12:58:03.417656+0000","last_fullsized":"2024-09-14T12:58:03.417656+0000","mapping_epoch":24,"log_start":"267'200","ondisk_log_start":"267'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:08:20.733145+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:08:20.733145+0000","last_clean_scrub_stamp":"2024-09-14T11:08:20.733145+0000","objects_scrubbed":0,"log_size":45,"log_dups_size":200,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:58:18.952310+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8403965,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":646,"num_read_kb":50041,"num_write":1005,"num_write_kb":23458,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,5],"acting":[6,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":525,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:57:13.024092+0000","last_change":"2024-09-14T11:08:25.815329+0000","last_active":"2024-09-14T12:57:13.024092+0000","last_peered":"2024-09-14T12:57:13.024092+0000","last_clean":"2024-09-14T12:57:13.024092+0000","last_became_active":"2024-09-14T11:08:25.814645+0000","last_became_peered":"2024-09-14T11:08:25.814645+0000","last_unstale":"2024-09-14T12:57:13.024092+0000","last_undegraded":"2024-09-14T12:57:13.024092+0000","last_fullsized":"2024-09-14T12:57:13.024092+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:08:24.757170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:08:24.757170+0000","last_clean_scrub_stamp":"2024-09-14T11:08:24.757170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:04:57.817252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.15","version":"267'175","reported_seq":790,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:59:37.847250+0000","last_change":"2024-09-14T11:08:27.828686+0000","last_active":"2024-09-14T12:59:37.847250+0000","last_peered":"2024-09-14T12:59:37.847250+0000","last_clean":"2024-09-14T12:59:37.847250+0000","last_became_active":"2024-09-14T11:08:27.827940+0000","last_became_peered":"2024-09-14T11:08:27.827940+0000","last_unstale":"2024-09-14T12:59:37.847250+0000","last_undegraded":"2024-09-14T12:59:37.847250+0000","last_fullsized":"2024-09-14T12:59:37.847250+0000","mapping_epoch":30,"log_start":"267'100","ondisk_log_start":"267'100","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:08:26.771628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:08:26.771628+0000","last_clean_scrub_stamp":"2024-09-14T11:08:26.771628+0000","objects_scrubbed":0,"log_size":75,"log_dups_size":100,"ondisk_log_size":75,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:53:17.553624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10026,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":220,"num_read_kb":279,"num_write":126,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.14","version":"267'811","reported_seq":2982,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:01:40.726705+0000","last_change":"2024-09-14T11:08:29.832482+0000","last_active":"2024-09-14T13:01:40.726705+0000","last_peered":"2024-09-14T13:01:40.726705+0000","last_clean":"2024-09-14T13:01:40.726705+0000","last_became_active":"2024-09-14T11:08:29.831198+0000","last_became_peered":"2024-09-14T11:08:29.831198+0000","last_unstale":"2024-09-14T13:01:40.726705+0000","last_undegraded":"2024-09-14T13:01:40.726705+0000","last_fullsized":"2024-09-14T13:01:40.726705+0000","mapping_epoch":32,"log_start":"267'800","ondisk_log_start":"267'800","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:08:28.783586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:08:28.783586+0000","last_clean_scrub_stamp":"2024-09-14T11:08:28.783586+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":800,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:32:21.362746+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.8","version":"267'440","reported_seq":1985,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:59:07.757910+0000","last_change":"2024-09-14T11:08:23.812057+0000","last_active":"2024-09-14T12:59:07.757910+0000","last_peered":"2024-09-14T12:59:07.757910+0000","last_clean":"2024-09-14T12:59:07.757910+0000","last_became_active":"2024-09-14T11:08:23.811325+0000","last_became_peered":"2024-09-14T11:08:23.811325+0000","last_unstale":"2024-09-14T12:59:07.757910+0000","last_undegraded":"2024-09-14T12:59:07.757910+0000","last_fullsized":"2024-09-14T12:59:07.757910+0000","mapping_epoch":26,"log_start":"267'400","ondisk_log_start":"267'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:08:22.750609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:08:22.750609+0000","last_clean_scrub_stamp":"2024-09-14T11:08:22.750609+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":400,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:31:01.004270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2277,"num_read_kb":2143,"num_write":513,"num_write_kb":125,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.f","version":"267'236","reported_seq":920,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:59:12.841498+0000","last_change":"2024-09-14T11:08:21.846294+0000","last_active":"2024-09-14T12:59:12.841498+0000","last_peered":"2024-09-14T12:59:12.841498+0000","last_clean":"2024-09-14T12:59:12.841498+0000","last_became_active":"2024-09-14T11:08:21.845618+0000","last_became_peered":"2024-09-14T11:08:21.845618+0000","last_unstale":"2024-09-14T12:59:12.841498+0000","last_undegraded":"2024-09-14T12:59:12.841498+0000","last_fullsized":"2024-09-14T12:59:12.841498+0000","mapping_epoch":24,"log_start":"267'200","ondisk_log_start":"267'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:08:20.733145+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:08:20.733145+0000","last_clean_scrub_stamp":"2024-09-14T11:08:20.733145+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":200,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:11:01.806580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9485601,"num_objects":9,"num_object_clones":0,"num_object_copies":27,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":671,"num_read_kb":36003,"num_write":1070,"num_write_kb":30861,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,0],"acting":[7,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":532,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:58:57.837680+0000","last_change":"2024-09-14T11:08:25.807559+0000","last_active":"2024-09-14T12:58:57.837680+0000","last_peered":"2024-09-14T12:58:57.837680+0000","last_clean":"2024-09-14T12:58:57.837680+0000","last_became_active":"2024-09-14T11:08:25.806427+0000","last_became_peered":"2024-09-14T11:08:25.806427+0000","last_unstale":"2024-09-14T12:58:57.837680+0000","last_undegraded":"2024-09-14T12:58:57.837680+0000","last_fullsized":"2024-09-14T12:58:57.837680+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:08:24.757170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:08:24.757170+0000","last_clean_scrub_stamp":"2024-09-14T11:08:24.757170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:32:34.612298+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.a","version":"267'318","reported_seq":1014,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:01:38.083943+0000","last_change":"2024-09-14T11:08:27.825865+0000","last_active":"2024-09-14T13:01:38.083943+0000","last_peered":"2024-09-14T13:01:38.083943+0000","last_clean":"2024-09-14T13:01:38.083943+0000","last_became_active":"2024-09-14T11:08:27.825133+0000","last_became_peered":"2024-09-14T11:08:27.825133+0000","last_unstale":"2024-09-14T13:01:38.083943+0000","last_undegraded":"2024-09-14T13:01:38.083943+0000","last_fullsized":"2024-09-14T13:01:38.083943+0000","mapping_epoch":30,"log_start":"267'300","ondisk_log_start":"267'300","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:08:26.771628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:08:26.771628+0000","last_clean_scrub_stamp":"2024-09-14T11:08:26.771628+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":300,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:21:39.269871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8811,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":443,"num_read_kb":493,"num_write":274,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":519,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:58:48.462360+0000","last_change":"2024-09-14T11:08:29.816572+0000","last_active":"2024-09-14T12:58:48.462360+0000","last_peered":"2024-09-14T12:58:48.462360+0000","last_clean":"2024-09-14T12:58:48.462360+0000","last_became_active":"2024-09-14T11:08:29.815620+0000","last_became_peered":"2024-09-14T11:08:29.815620+0000","last_unstale":"2024-09-14T12:58:48.462360+0000","last_undegraded":"2024-09-14T12:58:48.462360+0000","last_fullsized":"2024-09-14T12:58:48.462360+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:08:28.783586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:08:28.783586+0000","last_clean_scrub_stamp":"2024-09-14T11:08:28.783586+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:55:41.020963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.4","version":"267'569","reported_seq":1413,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:01:40.627106+0000","last_change":"2024-09-14T11:08:31.844680+0000","last_active":"2024-09-14T13:01:40.627106+0000","last_peered":"2024-09-14T13:01:40.627106+0000","last_clean":"2024-09-14T13:01:40.627106+0000","last_became_active":"2024-09-14T11:08:31.843834+0000","last_became_peered":"2024-09-14T11:08:31.843834+0000","last_unstale":"2024-09-14T13:01:40.627106+0000","last_undegraded":"2024-09-14T13:01:40.627106+0000","last_fullsized":"2024-09-14T13:01:40.627106+0000","mapping_epoch":34,"log_start":"267'500","ondisk_log_start":"267'500","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:08:30.789404+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:08:30.789404+0000","last_clean_scrub_stamp":"2024-09-14T11:08:30.789404+0000","objects_scrubbed":0,"log_size":69,"log_dups_size":500,"ondisk_log_size":69,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:11:32.026053+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1277,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":1293,"num_read_kb":1292,"num_write":1202,"num_write_kb":404,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.9","version":"267'1166","reported_seq":2698,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:58:58.232539+0000","last_change":"2024-09-14T11:08:23.779276+0000","last_active":"2024-09-14T12:58:58.232539+0000","last_peered":"2024-09-14T12:58:58.232539+0000","last_clean":"2024-09-14T12:58:58.232539+0000","last_became_active":"2024-09-14T11:08:23.778539+0000","last_became_peered":"2024-09-14T11:08:23.778539+0000","last_unstale":"2024-09-14T12:58:58.232539+0000","last_undegraded":"2024-09-14T12:58:58.232539+0000","last_fullsized":"2024-09-14T12:58:58.232539+0000","mapping_epoch":26,"log_start":"267'1100","ondisk_log_start":"267'1100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:08:22.750609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:08:22.750609+0000","last_clean_scrub_stamp":"2024-09-14T11:08:22.750609+0000","objects_scrubbed":0,"log_size":66,"log_dups_size":1100,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:37:56.213667+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":5272,"num_read_kb":4639,"num_write":1605,"num_write_kb":663,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"267'230","reported_seq":875,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:01:30.957938+0000","last_change":"2024-09-14T11:08:21.837563+0000","last_active":"2024-09-14T13:01:30.957938+0000","last_peered":"2024-09-14T13:01:30.957938+0000","last_clean":"2024-09-14T13:01:30.957938+0000","last_became_active":"2024-09-14T11:08:21.836948+0000","last_became_peered":"2024-09-14T11:08:21.836948+0000","last_unstale":"2024-09-14T13:01:30.957938+0000","last_undegraded":"2024-09-14T13:01:30.957938+0000","last_fullsized":"2024-09-14T13:01:30.957938+0000","mapping_epoch":24,"log_start":"267'200","ondisk_log_start":"267'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:08:20.733145+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:08:20.733145+0000","last_clean_scrub_stamp":"2024-09-14T11:08:20.733145+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":200,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:41:03.647233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8758677,"num_objects":9,"num_object_clones":0,"num_object_copies":27,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":539,"num_read_kb":30597,"num_write":996,"num_write_kb":48772,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,1],"acting":[7,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.8","version":"36'4","reported_seq":1009,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:01:40.255874+0000","last_change":"2024-09-14T11:08:25.787348+0000","last_active":"2024-09-14T13:01:40.255874+0000","last_peered":"2024-09-14T13:01:40.255874+0000","last_clean":"2024-09-14T13:01:40.255874+0000","last_became_active":"2024-09-14T11:08:25.786631+0000","last_became_peered":"2024-09-14T11:08:25.786631+0000","last_unstale":"2024-09-14T13:01:40.255874+0000","last_undegraded":"2024-09-14T13:01:40.255874+0000","last_fullsized":"2024-09-14T13:01:40.255874+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:08:24.757170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:08:24.757170+0000","last_clean_scrub_stamp":"2024-09-14T11:08:24.757170+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:53:18.472903+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1139,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":715,"num_read_kb":1177,"num_write":8,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.b","version":"267'173","reported_seq":791,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:00:58.494459+0000","last_change":"2024-09-14T11:08:27.822261+0000","last_active":"2024-09-14T13:00:58.494459+0000","last_peered":"2024-09-14T13:00:58.494459+0000","last_clean":"2024-09-14T13:00:58.494459+0000","last_became_active":"2024-09-14T11:08:27.821051+0000","last_became_peered":"2024-09-14T11:08:27.821051+0000","last_unstale":"2024-09-14T13:00:58.494459+0000","last_undegraded":"2024-09-14T13:00:58.494459+0000","last_fullsized":"2024-09-14T13:00:58.494459+0000","mapping_epoch":30,"log_start":"267'100","ondisk_log_start":"267'100","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:08:26.771628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:08:26.771628+0000","last_clean_scrub_stamp":"2024-09-14T11:08:26.771628+0000","objects_scrubbed":0,"log_size":73,"log_dups_size":100,"ondisk_log_size":73,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:27:12.003430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10996,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":225,"num_read_kb":299,"num_write":128,"num_write_kb":25,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":523,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:59:23.472522+0000","last_change":"2024-09-14T11:08:29.836035+0000","last_active":"2024-09-14T12:59:23.472522+0000","last_peered":"2024-09-14T12:59:23.472522+0000","last_clean":"2024-09-14T12:59:23.472522+0000","last_became_active":"2024-09-14T11:08:29.835446+0000","last_became_peered":"2024-09-14T11:08:29.835446+0000","last_unstale":"2024-09-14T12:59:23.472522+0000","last_undegraded":"2024-09-14T12:59:23.472522+0000","last_fullsized":"2024-09-14T12:59:23.472522+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:08:28.783586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:08:28.783586+0000","last_clean_scrub_stamp":"2024-09-14T11:08:28.783586+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:36:19.782325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.5","version":"267'2490","reported_seq":4358,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:01:27.935148+0000","last_change":"2024-09-14T11:08:31.849687+0000","last_active":"2024-09-14T13:01:27.935148+0000","last_peered":"2024-09-14T13:01:27.935148+0000","last_clean":"2024-09-14T13:01:27.935148+0000","last_became_active":"2024-09-14T11:08:31.848959+0000","last_became_peered":"2024-09-14T11:08:31.848959+0000","last_unstale":"2024-09-14T13:01:27.935148+0000","last_undegraded":"2024-09-14T13:01:27.935148+0000","last_fullsized":"2024-09-14T13:01:27.935148+0000","mapping_epoch":34,"log_start":"267'2400","ondisk_log_start":"267'2400","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:08:30.789404+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:08:30.789404+0000","last_clean_scrub_stamp":"2024-09-14T11:08:30.789404+0000","objects_scrubbed":0,"log_size":90,"log_dups_size":2400,"ondisk_log_size":90,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:50:52.716773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":423,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":6223,"num_read_kb":6216,"num_write":5015,"num_write_kb":1852,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.a","version":"267'866","reported_seq":2677,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:01:39.416327+0000","last_change":"2024-09-14T11:08:23.812059+0000","last_active":"2024-09-14T13:01:39.416327+0000","last_peered":"2024-09-14T13:01:39.416327+0000","last_clean":"2024-09-14T13:01:39.416327+0000","last_became_active":"2024-09-14T11:08:23.811255+0000","last_became_peered":"2024-09-14T11:08:23.811255+0000","last_unstale":"2024-09-14T13:01:39.416327+0000","last_undegraded":"2024-09-14T13:01:39.416327+0000","last_fullsized":"2024-09-14T13:01:39.416327+0000","mapping_epoch":26,"log_start":"267'800","ondisk_log_start":"267'800","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:08:22.750609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:08:22.750609+0000","last_clean_scrub_stamp":"2024-09-14T11:08:22.750609+0000","objects_scrubbed":0,"log_size":66,"log_dups_size":800,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:59:11.000027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":4399,"num_read_kb":3998,"num_write":1156,"num_write_kb":415,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"267'202","reported_seq":874,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:58:37.833064+0000","last_change":"2024-09-14T11:08:21.805672+0000","last_active":"2024-09-14T12:58:37.833064+0000","last_peered":"2024-09-14T12:58:37.833064+0000","last_clean":"2024-09-14T12:58:37.833064+0000","last_became_active":"2024-09-14T11:08:21.804566+0000","last_became_peered":"2024-09-14T11:08:21.804566+0000","last_unstale":"2024-09-14T12:58:37.833064+0000","last_undegraded":"2024-09-14T12:58:37.833064+0000","last_fullsized":"2024-09-14T12:58:37.833064+0000","mapping_epoch":24,"log_start":"267'100","ondisk_log_start":"267'100","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:08:20.733145+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:08:20.733145+0000","last_clean_scrub_stamp":"2024-09-14T11:08:20.733145+0000","objects_scrubbed":0,"log_size":102,"log_dups_size":100,"ondisk_log_size":102,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:32:47.003209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12777436,"num_objects":12,"num_object_clones":0,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":0,"num_read":547,"num_read_kb":39817,"num_write":944,"num_write_kb":36124,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,3],"acting":[7,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":533,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:58:42.823897+0000","last_change":"2024-09-14T11:08:25.789785+0000","last_active":"2024-09-14T12:58:42.823897+0000","last_peered":"2024-09-14T12:58:42.823897+0000","last_clean":"2024-09-14T12:58:42.823897+0000","last_became_active":"2024-09-14T11:08:25.789075+0000","last_became_peered":"2024-09-14T11:08:25.789075+0000","last_unstale":"2024-09-14T12:58:42.823897+0000","last_undegraded":"2024-09-14T12:58:42.823897+0000","last_fullsized":"2024-09-14T12:58:42.823897+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:08:24.757170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:08:24.757170+0000","last_clean_scrub_stamp":"2024-09-14T11:08:24.757170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:02:16.864399+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.8","version":"267'229","reported_seq":886,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:01:07.868354+0000","last_change":"2024-09-14T11:08:27.831643+0000","last_active":"2024-09-14T13:01:07.868354+0000","last_peered":"2024-09-14T13:01:07.868354+0000","last_clean":"2024-09-14T13:01:07.868354+0000","last_became_active":"2024-09-14T11:08:27.830862+0000","last_became_peered":"2024-09-14T11:08:27.830862+0000","last_unstale":"2024-09-14T13:01:07.868354+0000","last_undegraded":"2024-09-14T13:01:07.868354+0000","last_fullsized":"2024-09-14T13:01:07.868354+0000","mapping_epoch":30,"log_start":"267'200","ondisk_log_start":"267'200","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:08:26.771628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:08:26.771628+0000","last_clean_scrub_stamp":"2024-09-14T11:08:26.771628+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":200,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:28:29.317319+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6583,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":311,"num_read_kb":308,"num_write":182,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.9","version":"267'782","reported_seq":3470,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:01:40.728572+0000","last_change":"2024-09-14T11:08:29.822652+0000","last_active":"2024-09-14T13:01:40.728572+0000","last_peered":"2024-09-14T13:01:40.728572+0000","last_clean":"2024-09-14T13:01:40.728572+0000","last_became_active":"2024-09-14T11:08:29.821920+0000","last_became_peered":"2024-09-14T11:08:29.821920+0000","last_unstale":"2024-09-14T13:01:40.728572+0000","last_undegraded":"2024-09-14T13:01:40.728572+0000","last_fullsized":"2024-09-14T13:01:40.728572+0000","mapping_epoch":32,"log_start":"267'700","ondisk_log_start":"267'700","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:08:28.783586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:08:28.783586+0000","last_clean_scrub_stamp":"2024-09-14T11:08:28.783586+0000","objects_scrubbed":0,"log_size":82,"log_dups_size":700,"ondisk_log_size":82,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:48:48.100097+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.6","version":"267'126","reported_seq":663,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:01:39.376250+0000","last_change":"2024-09-14T11:08:31.848848+0000","last_active":"2024-09-14T13:01:39.376250+0000","last_peered":"2024-09-14T13:01:39.376250+0000","last_clean":"2024-09-14T13:01:39.376250+0000","last_became_active":"2024-09-14T11:08:31.846373+0000","last_became_peered":"2024-09-14T11:08:31.846373+0000","last_unstale":"2024-09-14T13:01:39.376250+0000","last_undegraded":"2024-09-14T13:01:39.376250+0000","last_fullsized":"2024-09-14T13:01:39.376250+0000","mapping_epoch":34,"log_start":"267'100","ondisk_log_start":"267'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:08:30.789404+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:08:30.789404+0000","last_clean_scrub_stamp":"2024-09-14T11:08:30.789404+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":100,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:47:54.026151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":575,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":123,"num_write":296,"num_write_kb":71,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"267'1040","reported_seq":2676,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:58:43.240136+0000","last_change":"2024-09-14T11:08:23.777370+0000","last_active":"2024-09-14T12:58:43.240136+0000","last_peered":"2024-09-14T12:58:43.240136+0000","last_clean":"2024-09-14T12:58:43.240136+0000","last_became_active":"2024-09-14T11:08:23.777032+0000","last_became_peered":"2024-09-14T11:08:23.777032+0000","last_unstale":"2024-09-14T12:58:43.240136+0000","last_undegraded":"2024-09-14T12:58:43.240136+0000","last_fullsized":"2024-09-14T12:58:43.240136+0000","mapping_epoch":26,"log_start":"267'1000","ondisk_log_start":"267'1000","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:08:22.750609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:08:22.750609+0000","last_clean_scrub_stamp":"2024-09-14T11:08:22.750609+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":1000,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:49:19.371576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":7372,"num_read_kb":6755,"num_write":1704,"num_write_kb":754,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.c","version":"267'182","reported_seq":822,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:58:38.043346+0000","last_change":"2024-09-14T11:08:21.828750+0000","last_active":"2024-09-14T12:58:38.043346+0000","last_peered":"2024-09-14T12:58:38.043346+0000","last_clean":"2024-09-14T12:58:38.043346+0000","last_became_active":"2024-09-14T11:08:21.828010+0000","last_became_peered":"2024-09-14T11:08:21.828010+0000","last_unstale":"2024-09-14T12:58:38.043346+0000","last_undegraded":"2024-09-14T12:58:38.043346+0000","last_fullsized":"2024-09-14T12:58:38.043346+0000","mapping_epoch":24,"log_start":"267'100","ondisk_log_start":"267'100","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:08:20.733145+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:08:20.733145+0000","last_clean_scrub_stamp":"2024-09-14T11:08:20.733145+0000","objects_scrubbed":0,"log_size":82,"log_dups_size":100,"ondisk_log_size":82,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:37:57.066174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":11803263,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":461,"num_read_kb":18086,"num_write":814,"num_write_kb":39275,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,6],"acting":[5,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":535,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:59:32.834776+0000","last_change":"2024-09-14T11:08:25.805942+0000","last_active":"2024-09-14T12:59:32.834776+0000","last_peered":"2024-09-14T12:59:32.834776+0000","last_clean":"2024-09-14T12:59:32.834776+0000","last_became_active":"2024-09-14T11:08:25.805415+0000","last_became_peered":"2024-09-14T11:08:25.805415+0000","last_unstale":"2024-09-14T12:59:32.834776+0000","last_undegraded":"2024-09-14T12:59:32.834776+0000","last_fullsized":"2024-09-14T12:59:32.834776+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:08:24.757170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:08:24.757170+0000","last_clean_scrub_stamp":"2024-09-14T11:08:24.757170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:04:41.418486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"267'240","reported_seq":922,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:01:40.550793+0000","last_change":"2024-09-14T11:08:27.812358+0000","last_active":"2024-09-14T13:01:40.550793+0000","last_peered":"2024-09-14T13:01:40.550793+0000","last_clean":"2024-09-14T13:01:40.550793+0000","last_became_active":"2024-09-14T11:08:27.811687+0000","last_became_peered":"2024-09-14T11:08:27.811687+0000","last_unstale":"2024-09-14T13:01:40.550793+0000","last_undegraded":"2024-09-14T13:01:40.550793+0000","last_fullsized":"2024-09-14T13:01:40.550793+0000","mapping_epoch":30,"log_start":"267'200","ondisk_log_start":"267'200","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:08:26.771628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:08:26.771628+0000","last_clean_scrub_stamp":"2024-09-14T11:08:26.771628+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":200,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:53:33.661450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":28650,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":331,"num_read_kb":474,"num_write":178,"num_write_kb":48,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":527,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:59:02.829095+0000","last_change":"2024-09-14T11:08:29.822875+0000","last_active":"2024-09-14T12:59:02.829095+0000","last_peered":"2024-09-14T12:59:02.829095+0000","last_clean":"2024-09-14T12:59:02.829095+0000","last_became_active":"2024-09-14T11:08:29.821747+0000","last_became_peered":"2024-09-14T11:08:29.821747+0000","last_unstale":"2024-09-14T12:59:02.829095+0000","last_undegraded":"2024-09-14T12:59:02.829095+0000","last_fullsized":"2024-09-14T12:59:02.829095+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:08:28.783586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:08:28.783586+0000","last_clean_scrub_stamp":"2024-09-14T11:08:28.783586+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:24:23.302821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.7","version":"267'148","reported_seq":694,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:00:15.969897+0000","last_change":"2024-09-14T11:08:31.839098+0000","last_active":"2024-09-14T13:00:15.969897+0000","last_peered":"2024-09-14T13:00:15.969897+0000","last_clean":"2024-09-14T13:00:15.969897+0000","last_became_active":"2024-09-14T11:08:31.838392+0000","last_became_peered":"2024-09-14T11:08:31.838392+0000","last_unstale":"2024-09-14T13:00:15.969897+0000","last_undegraded":"2024-09-14T13:00:15.969897+0000","last_fullsized":"2024-09-14T13:00:15.969897+0000","mapping_epoch":34,"log_start":"267'100","ondisk_log_start":"267'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:08:30.789404+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:08:30.789404+0000","last_clean_scrub_stamp":"2024-09-14T11:08:30.789404+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":100,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:19:04.951364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":722,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":177,"num_read_kb":165,"num_write":335,"num_write_kb":82,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"267'557","reported_seq":2159,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:59:14.732479+0000","last_change":"2024-09-14T11:08:23.789049+0000","last_active":"2024-09-14T12:59:14.732479+0000","last_peered":"2024-09-14T12:59:14.732479+0000","last_clean":"2024-09-14T12:59:14.732479+0000","last_became_active":"2024-09-14T11:08:23.788219+0000","last_became_peered":"2024-09-14T11:08:23.788219+0000","last_unstale":"2024-09-14T12:59:14.732479+0000","last_undegraded":"2024-09-14T12:59:14.732479+0000","last_fullsized":"2024-09-14T12:59:14.732479+0000","mapping_epoch":26,"log_start":"267'500","ondisk_log_start":"267'500","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:08:22.750609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:08:22.750609+0000","last_clean_scrub_stamp":"2024-09-14T11:08:22.750609+0000","objects_scrubbed":0,"log_size":57,"log_dups_size":500,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:01:08.503596+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2903,"num_read_kb":2651,"num_write":738,"num_write_kb":289,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"267'312","reported_seq":1059,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:58:38.461550+0000","last_change":"2024-09-14T11:08:21.827864+0000","last_active":"2024-09-14T12:58:38.461550+0000","last_peered":"2024-09-14T12:58:38.461550+0000","last_clean":"2024-09-14T12:58:38.461550+0000","last_became_active":"2024-09-14T11:08:21.827553+0000","last_became_peered":"2024-09-14T11:08:21.827553+0000","last_unstale":"2024-09-14T12:58:38.461550+0000","last_undegraded":"2024-09-14T12:58:38.461550+0000","last_fullsized":"2024-09-14T12:58:38.461550+0000","mapping_epoch":24,"log_start":"267'300","ondisk_log_start":"267'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:08:20.733145+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:08:20.733145+0000","last_clean_scrub_stamp":"2024-09-14T11:08:20.733145+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":300,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:57:45.527676+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":11090148,"num_objects":12,"num_object_clones":0,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":0,"num_read":993,"num_read_kb":39840,"num_write":1268,"num_write_kb":27597,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,4],"acting":[3,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":533,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:58:42.823983+0000","last_change":"2024-09-14T11:08:25.799438+0000","last_active":"2024-09-14T12:58:42.823983+0000","last_peered":"2024-09-14T12:58:42.823983+0000","last_clean":"2024-09-14T12:58:42.823983+0000","last_became_active":"2024-09-14T11:08:25.798931+0000","last_became_peered":"2024-09-14T11:08:25.798931+0000","last_unstale":"2024-09-14T12:58:42.823983+0000","last_undegraded":"2024-09-14T12:58:42.823983+0000","last_fullsized":"2024-09-14T12:58:42.823983+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:08:24.757170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:08:24.757170+0000","last_clean_scrub_stamp":"2024-09-14T11:08:24.757170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:52:24.718713+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.e","version":"267'200","reported_seq":832,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:00:58.260088+0000","last_change":"2024-09-14T11:08:27.818990+0000","last_active":"2024-09-14T13:00:58.260088+0000","last_peered":"2024-09-14T13:00:58.260088+0000","last_clean":"2024-09-14T13:00:58.260088+0000","last_became_active":"2024-09-14T11:08:27.818219+0000","last_became_peered":"2024-09-14T11:08:27.818219+0000","last_unstale":"2024-09-14T13:00:58.260088+0000","last_undegraded":"2024-09-14T13:00:58.260088+0000","last_fullsized":"2024-09-14T13:00:58.260088+0000","mapping_epoch":30,"log_start":"264'100","ondisk_log_start":"264'100","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:08:26.771628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:08:26.771628+0000","last_clean_scrub_stamp":"2024-09-14T11:08:26.771628+0000","objects_scrubbed":0,"log_size":100,"log_dups_size":100,"ondisk_log_size":100,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:11:59.445867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10713,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":285,"num_read_kb":297,"num_write":216,"num_write_kb":85,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":526,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:59:13.248309+0000","last_change":"2024-09-14T11:08:29.824808+0000","last_active":"2024-09-14T12:59:13.248309+0000","last_peered":"2024-09-14T12:59:13.248309+0000","last_clean":"2024-09-14T12:59:13.248309+0000","last_became_active":"2024-09-14T11:08:29.824057+0000","last_became_peered":"2024-09-14T11:08:29.824057+0000","last_unstale":"2024-09-14T12:59:13.248309+0000","last_undegraded":"2024-09-14T12:59:13.248309+0000","last_fullsized":"2024-09-14T12:59:13.248309+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:08:28.783586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:08:28.783586+0000","last_clean_scrub_stamp":"2024-09-14T11:08:28.783586+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:42:11.422635+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.0","version":"267'127","reported_seq":651,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:00:53.493597+0000","last_change":"2024-09-14T11:08:31.845590+0000","last_active":"2024-09-14T13:00:53.493597+0000","last_peered":"2024-09-14T13:00:53.493597+0000","last_clean":"2024-09-14T13:00:53.493597+0000","last_became_active":"2024-09-14T11:08:31.844832+0000","last_became_peered":"2024-09-14T11:08:31.844832+0000","last_unstale":"2024-09-14T13:00:53.493597+0000","last_undegraded":"2024-09-14T13:00:53.493597+0000","last_fullsized":"2024-09-14T13:00:53.493597+0000","mapping_epoch":34,"log_start":"267'100","ondisk_log_start":"267'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:08:30.789404+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:08:30.789404+0000","last_clean_scrub_stamp":"2024-09-14T11:08:30.789404+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":100,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:04:19.552267+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":910,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":99,"num_read_kb":98,"num_write":310,"num_write_kb":70,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"267'807","reported_seq":2439,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:59:14.732420+0000","last_change":"2024-09-14T11:08:23.794254+0000","last_active":"2024-09-14T12:59:14.732420+0000","last_peered":"2024-09-14T12:59:14.732420+0000","last_clean":"2024-09-14T12:59:14.732420+0000","last_became_active":"2024-09-14T11:08:23.791966+0000","last_became_peered":"2024-09-14T11:08:23.791966+0000","last_unstale":"2024-09-14T12:59:14.732420+0000","last_undegraded":"2024-09-14T12:59:14.732420+0000","last_fullsized":"2024-09-14T12:59:14.732420+0000","mapping_epoch":26,"log_start":"267'700","ondisk_log_start":"267'700","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:08:22.750609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:08:22.750609+0000","last_clean_scrub_stamp":"2024-09-14T11:08:22.750609+0000","objects_scrubbed":0,"log_size":107,"log_dups_size":700,"ondisk_log_size":107,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:23:14.308345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3905,"num_read_kb":3535,"num_write":1083,"num_write_kb":396,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"267'229","reported_seq":904,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:59:13.433073+0000","last_change":"2024-09-14T11:08:21.836998+0000","last_active":"2024-09-14T12:59:13.433073+0000","last_peered":"2024-09-14T12:59:13.433073+0000","last_clean":"2024-09-14T12:59:13.433073+0000","last_became_active":"2024-09-14T11:08:21.836346+0000","last_became_peered":"2024-09-14T11:08:21.836346+0000","last_unstale":"2024-09-14T12:59:13.433073+0000","last_undegraded":"2024-09-14T12:59:13.433073+0000","last_fullsized":"2024-09-14T12:59:13.433073+0000","mapping_epoch":24,"log_start":"267'200","ondisk_log_start":"267'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:08:20.733145+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:08:20.733145+0000","last_clean_scrub_stamp":"2024-09-14T11:08:20.733145+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":200,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:01:21.741877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7321958,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":603,"num_read_kb":23439,"num_write":1078,"num_write_kb":33198,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,1],"acting":[6,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":527,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:58:43.461228+0000","last_change":"2024-09-14T11:08:25.807312+0000","last_active":"2024-09-14T12:58:43.461228+0000","last_peered":"2024-09-14T12:58:43.461228+0000","last_clean":"2024-09-14T12:58:43.461228+0000","last_became_active":"2024-09-14T11:08:25.806502+0000","last_became_peered":"2024-09-14T11:08:25.806502+0000","last_unstale":"2024-09-14T12:58:43.461228+0000","last_undegraded":"2024-09-14T12:58:43.461228+0000","last_fullsized":"2024-09-14T12:58:43.461228+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:08:24.757170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:08:24.757170+0000","last_clean_scrub_stamp":"2024-09-14T11:08:24.757170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:32:51.027233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.f","version":"267'236","reported_seq":894,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:01:32.858133+0000","last_change":"2024-09-14T11:08:27.819376+0000","last_active":"2024-09-14T13:01:32.858133+0000","last_peered":"2024-09-14T13:01:32.858133+0000","last_clean":"2024-09-14T13:01:32.858133+0000","last_became_active":"2024-09-14T11:08:27.817904+0000","last_became_peered":"2024-09-14T11:08:27.817904+0000","last_unstale":"2024-09-14T13:01:32.858133+0000","last_undegraded":"2024-09-14T13:01:32.858133+0000","last_fullsized":"2024-09-14T13:01:32.858133+0000","mapping_epoch":30,"log_start":"267'200","ondisk_log_start":"267'200","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:08:26.771628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:08:26.771628+0000","last_clean_scrub_stamp":"2024-09-14T11:08:26.771628+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":200,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:38:45.116571+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":13059,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":322,"num_read_kb":372,"num_write":190,"num_write_kb":20,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.e","version":"267'760","reported_seq":3232,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:01:40.720358+0000","last_change":"2024-09-14T11:08:29.818281+0000","last_active":"2024-09-14T13:01:40.720358+0000","last_peered":"2024-09-14T13:01:40.720358+0000","last_clean":"2024-09-14T13:01:40.720358+0000","last_became_active":"2024-09-14T11:08:29.817475+0000","last_became_peered":"2024-09-14T11:08:29.817475+0000","last_unstale":"2024-09-14T13:01:40.720358+0000","last_undegraded":"2024-09-14T13:01:40.720358+0000","last_fullsized":"2024-09-14T13:01:40.720358+0000","mapping_epoch":32,"log_start":"267'700","ondisk_log_start":"267'700","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:08:28.783586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:08:28.783586+0000","last_clean_scrub_stamp":"2024-09-14T11:08:28.783586+0000","objects_scrubbed":0,"log_size":60,"log_dups_size":700,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:02:09.839019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1","version":"267'130","reported_seq":668,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:00:15.977882+0000","last_change":"2024-09-14T11:08:31.848332+0000","last_active":"2024-09-14T13:00:15.977882+0000","last_peered":"2024-09-14T13:00:15.977882+0000","last_clean":"2024-09-14T13:00:15.977882+0000","last_became_active":"2024-09-14T11:08:31.847603+0000","last_became_peered":"2024-09-14T11:08:31.847603+0000","last_unstale":"2024-09-14T13:00:15.977882+0000","last_undegraded":"2024-09-14T13:00:15.977882+0000","last_fullsized":"2024-09-14T13:00:15.977882+0000","mapping_epoch":34,"log_start":"267'100","ondisk_log_start":"267'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:08:30.789404+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:08:30.789404+0000","last_clean_scrub_stamp":"2024-09-14T11:08:30.789404+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":100,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:48:10.041330+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1261,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":168,"num_read_kb":154,"num_write":334,"num_write_kb":78,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"267'385","reported_seq":1931,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:00:18.881431+0000","last_change":"2024-09-14T11:08:23.815282+0000","last_active":"2024-09-14T13:00:18.881431+0000","last_peered":"2024-09-14T13:00:18.881431+0000","last_clean":"2024-09-14T13:00:18.881431+0000","last_became_active":"2024-09-14T11:08:23.814578+0000","last_became_peered":"2024-09-14T11:08:23.814578+0000","last_unstale":"2024-09-14T13:00:18.881431+0000","last_undegraded":"2024-09-14T13:00:18.881431+0000","last_fullsized":"2024-09-14T13:00:18.881431+0000","mapping_epoch":26,"log_start":"267'300","ondisk_log_start":"267'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:08:22.750609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:08:22.750609+0000","last_clean_scrub_stamp":"2024-09-14T11:08:22.750609+0000","objects_scrubbed":0,"log_size":85,"log_dups_size":300,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:17:18.348356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2178,"num_read_kb":2072,"num_write":449,"num_write_kb":92,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.9","version":"267'202","reported_seq":858,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:58:53.231353+0000","last_change":"2024-09-14T11:08:21.831392+0000","last_active":"2024-09-14T12:58:53.231353+0000","last_peered":"2024-09-14T12:58:53.231353+0000","last_clean":"2024-09-14T12:58:53.231353+0000","last_became_active":"2024-09-14T11:08:21.824109+0000","last_became_peered":"2024-09-14T11:08:21.824109+0000","last_unstale":"2024-09-14T12:58:53.231353+0000","last_undegraded":"2024-09-14T12:58:53.231353+0000","last_fullsized":"2024-09-14T12:58:53.231353+0000","mapping_epoch":24,"log_start":"267'100","ondisk_log_start":"267'100","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:08:20.733145+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:08:20.733145+0000","last_clean_scrub_stamp":"2024-09-14T11:08:20.733145+0000","objects_scrubbed":0,"log_size":102,"log_dups_size":100,"ondisk_log_size":102,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:40:02.893514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7548026,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":548,"num_read_kb":13686,"num_write":955,"num_write_kb":41004,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,7],"acting":[4,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.f","version":"29'2","reported_seq":1473,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:01:40.269842+0000","last_change":"2024-09-14T11:08:25.815830+0000","last_active":"2024-09-14T13:01:40.269842+0000","last_peered":"2024-09-14T13:01:40.269842+0000","last_clean":"2024-09-14T13:01:40.269842+0000","last_became_active":"2024-09-14T11:08:25.815109+0000","last_became_peered":"2024-09-14T11:08:25.815109+0000","last_unstale":"2024-09-14T13:01:40.269842+0000","last_undegraded":"2024-09-14T13:01:40.269842+0000","last_fullsized":"2024-09-14T13:01:40.269842+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:08:24.757170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:08:24.757170+0000","last_clean_scrub_stamp":"2024-09-14T11:08:24.757170+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:31:30.285811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":942,"num_read_kb":942,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.c","version":"267'152","reported_seq":738,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:59:07.715136+0000","last_change":"2024-09-14T11:08:27.799995+0000","last_active":"2024-09-14T12:59:07.715136+0000","last_peered":"2024-09-14T12:59:07.715136+0000","last_clean":"2024-09-14T12:59:07.715136+0000","last_became_active":"2024-09-14T11:08:27.799244+0000","last_became_peered":"2024-09-14T11:08:27.799244+0000","last_unstale":"2024-09-14T12:59:07.715136+0000","last_undegraded":"2024-09-14T12:59:07.715136+0000","last_fullsized":"2024-09-14T12:59:07.715136+0000","mapping_epoch":30,"log_start":"267'100","ondisk_log_start":"267'100","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:08:26.771628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:08:26.771628+0000","last_clean_scrub_stamp":"2024-09-14T11:08:26.771628+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":100,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:30:47.475696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":184,"num_read_kb":178,"num_write":124,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.d","version":"267'766","reported_seq":3161,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:01:40.721294+0000","last_change":"2024-09-14T11:08:29.829055+0000","last_active":"2024-09-14T13:01:40.721294+0000","last_peered":"2024-09-14T13:01:40.721294+0000","last_clean":"2024-09-14T13:01:40.721294+0000","last_became_active":"2024-09-14T11:08:29.828249+0000","last_became_peered":"2024-09-14T11:08:29.828249+0000","last_unstale":"2024-09-14T13:01:40.721294+0000","last_undegraded":"2024-09-14T13:01:40.721294+0000","last_fullsized":"2024-09-14T13:01:40.721294+0000","mapping_epoch":32,"log_start":"267'701","ondisk_log_start":"267'701","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:08:28.783586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:08:28.783586+0000","last_clean_scrub_stamp":"2024-09-14T11:08:28.783586+0000","objects_scrubbed":0,"log_size":65,"log_dups_size":701,"ondisk_log_size":65,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:02:41.662311+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.2","version":"267'160","reported_seq":694,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:58:58.232642+0000","last_change":"2024-09-14T11:08:31.850208+0000","last_active":"2024-09-14T12:58:58.232642+0000","last_peered":"2024-09-14T12:58:58.232642+0000","last_clean":"2024-09-14T12:58:58.232642+0000","last_became_active":"2024-09-14T11:08:31.849463+0000","last_became_peered":"2024-09-14T11:08:31.849463+0000","last_unstale":"2024-09-14T12:58:58.232642+0000","last_undegraded":"2024-09-14T12:58:58.232642+0000","last_fullsized":"2024-09-14T12:58:58.232642+0000","mapping_epoch":34,"log_start":"267'100","ondisk_log_start":"267'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:08:30.789404+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:08:30.789404+0000","last_clean_scrub_stamp":"2024-09-14T11:08:30.789404+0000","objects_scrubbed":0,"log_size":60,"log_dups_size":100,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:42:03.964124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":154,"num_read_kb":144,"num_write":375,"num_write_kb":85,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"267'382","reported_seq":1872,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:00:21.259274+0000","last_change":"2024-09-14T11:08:23.783772+0000","last_active":"2024-09-14T13:00:21.259274+0000","last_peered":"2024-09-14T13:00:21.259274+0000","last_clean":"2024-09-14T13:00:21.259274+0000","last_became_active":"2024-09-14T11:08:23.783481+0000","last_became_peered":"2024-09-14T11:08:23.783481+0000","last_unstale":"2024-09-14T13:00:21.259274+0000","last_undegraded":"2024-09-14T13:00:21.259274+0000","last_fullsized":"2024-09-14T13:00:21.259274+0000","mapping_epoch":26,"log_start":"267'300","ondisk_log_start":"267'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:08:22.750609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:08:22.750609+0000","last_clean_scrub_stamp":"2024-09-14T11:08:22.750609+0000","objects_scrubbed":0,"log_size":82,"log_dups_size":300,"ondisk_log_size":82,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:20:59.558430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":2050,"num_read_kb":1948,"num_write":423,"num_write_kb":74,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"267'175","reported_seq":828,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:58:53.465094+0000","last_change":"2024-09-14T11:08:21.787051+0000","last_active":"2024-09-14T12:58:53.465094+0000","last_peered":"2024-09-14T12:58:53.465094+0000","last_clean":"2024-09-14T12:58:53.465094+0000","last_became_active":"2024-09-14T11:08:21.786611+0000","last_became_peered":"2024-09-14T11:08:21.786611+0000","last_unstale":"2024-09-14T12:58:53.465094+0000","last_undegraded":"2024-09-14T12:58:53.465094+0000","last_fullsized":"2024-09-14T12:58:53.465094+0000","mapping_epoch":24,"log_start":"267'100","ondisk_log_start":"267'100","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:08:20.733145+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:08:20.733145+0000","last_clean_scrub_stamp":"2024-09-14T11:08:20.733145+0000","objects_scrubbed":0,"log_size":75,"log_dups_size":100,"ondisk_log_size":75,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:20:16.450782+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3029091,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":448,"num_read_kb":66993,"num_write":848,"num_write_kb":21210,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7],"acting":[3,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":531,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:58:43.229298+0000","last_change":"2024-09-14T11:08:25.818495+0000","last_active":"2024-09-14T12:58:43.229298+0000","last_peered":"2024-09-14T12:58:43.229298+0000","last_clean":"2024-09-14T12:58:43.229298+0000","last_became_active":"2024-09-14T11:08:25.817491+0000","last_became_peered":"2024-09-14T11:08:25.817491+0000","last_unstale":"2024-09-14T12:58:43.229298+0000","last_undegraded":"2024-09-14T12:58:43.229298+0000","last_fullsized":"2024-09-14T12:58:43.229298+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:08:24.757170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:08:24.757170+0000","last_clean_scrub_stamp":"2024-09-14T11:08:24.757170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:04:21.111837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.d","version":"267'291","reported_seq":973,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:00:58.075026+0000","last_change":"2024-09-14T11:08:27.829834+0000","last_active":"2024-09-14T13:00:58.075026+0000","last_peered":"2024-09-14T13:00:58.075026+0000","last_clean":"2024-09-14T13:00:58.075026+0000","last_became_active":"2024-09-14T11:08:27.829060+0000","last_became_peered":"2024-09-14T11:08:27.829060+0000","last_unstale":"2024-09-14T13:00:58.075026+0000","last_undegraded":"2024-09-14T13:00:58.075026+0000","last_fullsized":"2024-09-14T13:00:58.075026+0000","mapping_epoch":30,"log_start":"267'200","ondisk_log_start":"267'200","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:08:26.771628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:08:26.771628+0000","last_clean_scrub_stamp":"2024-09-14T11:08:26.771628+0000","objects_scrubbed":0,"log_size":91,"log_dups_size":200,"ondisk_log_size":91,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:11:07.685536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":13264,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":404,"num_read_kb":421,"num_write":246,"num_write_kb":20,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":520,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:58:48.427540+0000","last_change":"2024-09-14T11:08:29.845124+0000","last_active":"2024-09-14T12:58:48.427540+0000","last_peered":"2024-09-14T12:58:48.427540+0000","last_clean":"2024-09-14T12:58:48.427540+0000","last_became_active":"2024-09-14T11:08:29.844374+0000","last_became_peered":"2024-09-14T11:08:29.844374+0000","last_unstale":"2024-09-14T12:58:48.427540+0000","last_undegraded":"2024-09-14T12:58:48.427540+0000","last_fullsized":"2024-09-14T12:58:48.427540+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:08:28.783586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:08:28.783586+0000","last_clean_scrub_stamp":"2024-09-14T11:08:28.783586+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:58:42.113010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.3","version":"267'105","reported_seq":628,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:00:21.230827+0000","last_change":"2024-09-14T11:08:31.836429+0000","last_active":"2024-09-14T13:00:21.230827+0000","last_peered":"2024-09-14T13:00:21.230827+0000","last_clean":"2024-09-14T13:00:21.230827+0000","last_became_active":"2024-09-14T11:08:31.835753+0000","last_became_peered":"2024-09-14T11:08:31.835753+0000","last_unstale":"2024-09-14T13:00:21.230827+0000","last_undegraded":"2024-09-14T13:00:21.230827+0000","last_fullsized":"2024-09-14T13:00:21.230827+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:08:30.789404+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:08:30.789404+0000","last_clean_scrub_stamp":"2024-09-14T11:08:30.789404+0000","objects_scrubbed":0,"log_size":105,"log_dups_size":0,"ondisk_log_size":105,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:10:45.802301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":24,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":102,"num_read_kb":102,"num_write":245,"num_write_kb":60,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"267'865","reported_seq":2543,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:59:13.433148+0000","last_change":"2024-09-14T11:08:23.807298+0000","last_active":"2024-09-14T12:59:13.433148+0000","last_peered":"2024-09-14T12:59:13.433148+0000","last_clean":"2024-09-14T12:59:13.433148+0000","last_became_active":"2024-09-14T11:08:23.806515+0000","last_became_peered":"2024-09-14T11:08:23.806515+0000","last_unstale":"2024-09-14T12:59:13.433148+0000","last_undegraded":"2024-09-14T12:59:13.433148+0000","last_fullsized":"2024-09-14T12:59:13.433148+0000","mapping_epoch":26,"log_start":"267'800","ondisk_log_start":"267'800","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:08:22.750609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:08:22.750609+0000","last_clean_scrub_stamp":"2024-09-14T11:08:22.750609+0000","objects_scrubbed":0,"log_size":65,"log_dups_size":800,"ondisk_log_size":65,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:53:43.658780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":4146,"num_read_kb":3734,"num_write":1154,"num_write_kb":420,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"15'72","reported_seq":654,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:58:42.834156+0000","last_change":"2024-09-14T11:08:03.882483+0000","last_active":"2024-09-14T12:58:42.834156+0000","last_peered":"2024-09-14T12:58:42.834156+0000","last_clean":"2024-09-14T12:58:42.834156+0000","last_became_active":"2024-09-14T11:08:03.877126+0000","last_became_peered":"2024-09-14T11:08:03.877126+0000","last_unstale":"2024-09-14T12:58:42.834156+0000","last_undegraded":"2024-09-14T12:58:42.834156+0000","last_fullsized":"2024-09-14T12:58:42.834156+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:08:02.835447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:08:02.835447+0000","last_clean_scrub_stamp":"2024-09-14T11:08:02.835447+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:04:38.793105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"18'1","reported_seq":561,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:58:38.043302+0000","last_change":"2024-09-14T11:08:10.932779+0000","last_active":"2024-09-14T12:58:38.043302+0000","last_peered":"2024-09-14T12:58:38.043302+0000","last_clean":"2024-09-14T12:58:38.043302+0000","last_became_active":"2024-09-14T11:08:08.902043+0000","last_became_peered":"2024-09-14T11:08:08.902043+0000","last_unstale":"2024-09-14T12:58:38.043302+0000","last_undegraded":"2024-09-14T12:58:38.043302+0000","last_fullsized":"2024-09-14T12:58:38.043302+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:08:07.870014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:08:07.870014+0000","last_clean_scrub_stamp":"2024-09-14T11:08:07.870014+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:04:35.417543+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0011624509999999999,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"267'371","reported_seq":1092,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:01:34.627751+0000","last_change":"2024-09-14T11:08:21.809930+0000","last_active":"2024-09-14T13:01:34.627751+0000","last_peered":"2024-09-14T13:01:34.627751+0000","last_clean":"2024-09-14T13:01:34.627751+0000","last_became_active":"2024-09-14T11:08:21.809523+0000","last_became_peered":"2024-09-14T11:08:21.809523+0000","last_unstale":"2024-09-14T13:01:34.627751+0000","last_undegraded":"2024-09-14T13:01:34.627751+0000","last_fullsized":"2024-09-14T13:01:34.627751+0000","mapping_epoch":24,"log_start":"267'300","ondisk_log_start":"267'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:08:20.733145+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:08:20.733145+0000","last_clean_scrub_stamp":"2024-09-14T11:08:20.733145+0000","objects_scrubbed":0,"log_size":71,"log_dups_size":300,"ondisk_log_size":71,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:35:38.345862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6537749,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":1021,"num_read_kb":10697,"num_write":1395,"num_write_kb":52429,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,6],"acting":[3,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":534,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:58:52.836590+0000","last_change":"2024-09-14T11:08:25.808691+0000","last_active":"2024-09-14T12:58:52.836590+0000","last_peered":"2024-09-14T12:58:52.836590+0000","last_clean":"2024-09-14T12:58:52.836590+0000","last_became_active":"2024-09-14T11:08:25.807851+0000","last_became_peered":"2024-09-14T11:08:25.807851+0000","last_unstale":"2024-09-14T12:58:52.836590+0000","last_undegraded":"2024-09-14T12:58:52.836590+0000","last_fullsized":"2024-09-14T12:58:52.836590+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:08:24.757170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:08:24.757170+0000","last_clean_scrub_stamp":"2024-09-14T11:08:24.757170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:56:51.066419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.7","version":"267'336","reported_seq":1074,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:01:40.592306+0000","last_change":"2024-09-14T11:08:27.834071+0000","last_active":"2024-09-14T13:01:40.592306+0000","last_peered":"2024-09-14T13:01:40.592306+0000","last_clean":"2024-09-14T13:01:40.592306+0000","last_became_active":"2024-09-14T11:08:27.829359+0000","last_became_peered":"2024-09-14T11:08:27.829359+0000","last_unstale":"2024-09-14T13:01:40.592306+0000","last_undegraded":"2024-09-14T13:01:40.592306+0000","last_fullsized":"2024-09-14T13:01:40.592306+0000","mapping_epoch":30,"log_start":"267'300","ondisk_log_start":"267'300","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:08:26.771628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:08:26.771628+0000","last_clean_scrub_stamp":"2024-09-14T11:08:26.771628+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":300,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:44:51.169189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":35130,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":624,"num_read_kb":810,"num_write":580,"num_write_kb":409,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":528,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:59:03.245682+0000","last_change":"2024-09-14T11:08:29.827169+0000","last_active":"2024-09-14T12:59:03.245682+0000","last_peered":"2024-09-14T12:59:03.245682+0000","last_clean":"2024-09-14T12:59:03.245682+0000","last_became_active":"2024-09-14T11:08:29.826367+0000","last_became_peered":"2024-09-14T11:08:29.826367+0000","last_unstale":"2024-09-14T12:59:03.245682+0000","last_undegraded":"2024-09-14T12:59:03.245682+0000","last_fullsized":"2024-09-14T12:59:03.245682+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:08:28.783586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:08:28.783586+0000","last_clean_scrub_stamp":"2024-09-14T11:08:28.783586+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:19:54.618304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.9","version":"267'212","reported_seq":968,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:00:21.334917+0000","last_change":"2024-09-14T11:08:31.849513+0000","last_active":"2024-09-14T13:00:21.334917+0000","last_peered":"2024-09-14T13:00:21.334917+0000","last_clean":"2024-09-14T13:00:21.334917+0000","last_became_active":"2024-09-14T11:08:31.848763+0000","last_became_peered":"2024-09-14T11:08:31.848763+0000","last_unstale":"2024-09-14T13:00:21.334917+0000","last_undegraded":"2024-09-14T13:00:21.334917+0000","last_fullsized":"2024-09-14T13:00:21.334917+0000","mapping_epoch":34,"log_start":"267'200","ondisk_log_start":"267'200","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:08:30.789404+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:08:30.789404+0000","last_clean_scrub_stamp":"2024-09-14T11:08:30.789404+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":200,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:22:19.969967+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":408,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":546,"num_read_kb":516,"num_write":465,"num_write_kb":130,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.6","version":"267'595","reported_seq":2273,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:58:58.244065+0000","last_change":"2024-09-14T11:08:23.776991+0000","last_active":"2024-09-14T12:58:58.244065+0000","last_peered":"2024-09-14T12:58:58.244065+0000","last_clean":"2024-09-14T12:58:58.244065+0000","last_became_active":"2024-09-14T11:08:23.776564+0000","last_became_peered":"2024-09-14T11:08:23.776564+0000","last_unstale":"2024-09-14T12:58:58.244065+0000","last_undegraded":"2024-09-14T12:58:58.244065+0000","last_fullsized":"2024-09-14T12:58:58.244065+0000","mapping_epoch":26,"log_start":"267'500","ondisk_log_start":"267'500","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:08:22.750609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:08:22.750609+0000","last_clean_scrub_stamp":"2024-09-14T11:08:22.750609+0000","objects_scrubbed":0,"log_size":95,"log_dups_size":500,"ondisk_log_size":95,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:02:21.308539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":3171,"num_read_kb":2898,"num_write":783,"num_write_kb":298,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":563,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:58:47.835277+0000","last_change":"2024-09-14T11:08:11.214664+0000","last_active":"2024-09-14T12:58:47.835277+0000","last_peered":"2024-09-14T12:58:47.835277+0000","last_clean":"2024-09-14T12:58:47.835277+0000","last_became_active":"2024-09-14T11:08:08.903386+0000","last_became_peered":"2024-09-14T11:08:08.903386+0000","last_unstale":"2024-09-14T12:58:47.835277+0000","last_undegraded":"2024-09-14T12:58:47.835277+0000","last_fullsized":"2024-09-14T12:58:47.835277+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:08:07.870014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:08:07.870014+0000","last_clean_scrub_stamp":"2024-09-14T11:08:07.870014+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:55:07.449307+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001192558,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"267'175","reported_seq":865,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:58:48.241117+0000","last_change":"2024-09-14T11:08:21.815829+0000","last_active":"2024-09-14T12:58:48.241117+0000","last_peered":"2024-09-14T12:58:48.241117+0000","last_clean":"2024-09-14T12:58:48.241117+0000","last_became_active":"2024-09-14T11:08:21.815453+0000","last_became_peered":"2024-09-14T11:08:21.815453+0000","last_unstale":"2024-09-14T12:58:48.241117+0000","last_undegraded":"2024-09-14T12:58:48.241117+0000","last_fullsized":"2024-09-14T12:58:48.241117+0000","mapping_epoch":24,"log_start":"267'100","ondisk_log_start":"267'100","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:08:20.733145+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:08:20.733145+0000","last_clean_scrub_stamp":"2024-09-14T11:08:20.733145+0000","objects_scrubbed":0,"log_size":75,"log_dups_size":100,"ondisk_log_size":75,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:34:32.758328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10512963,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":652,"num_read_kb":79122,"num_write":840,"num_write_kb":40267,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,3],"acting":[0,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":531,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:58:58.047972+0000","last_change":"2024-09-14T11:08:25.802329+0000","last_active":"2024-09-14T12:58:58.047972+0000","last_peered":"2024-09-14T12:58:58.047972+0000","last_clean":"2024-09-14T12:58:58.047972+0000","last_became_active":"2024-09-14T11:08:25.801580+0000","last_became_peered":"2024-09-14T11:08:25.801580+0000","last_unstale":"2024-09-14T12:58:58.047972+0000","last_undegraded":"2024-09-14T12:58:58.047972+0000","last_fullsized":"2024-09-14T12:58:58.047972+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:08:24.757170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:08:24.757170+0000","last_clean_scrub_stamp":"2024-09-14T11:08:24.757170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:41:07.671257+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.4","version":"267'1006","reported_seq":3348,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:01:40.709142+0000","last_change":"2024-09-14T11:08:27.825306+0000","last_active":"2024-09-14T13:01:40.709142+0000","last_peered":"2024-09-14T13:01:40.709142+0000","last_clean":"2024-09-14T13:01:40.709142+0000","last_became_active":"2024-09-14T11:08:27.824703+0000","last_became_peered":"2024-09-14T11:08:27.824703+0000","last_unstale":"2024-09-14T13:01:40.709142+0000","last_undegraded":"2024-09-14T13:01:40.709142+0000","last_fullsized":"2024-09-14T13:01:40.709142+0000","mapping_epoch":30,"log_start":"267'901","ondisk_log_start":"267'901","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:08:26.771628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:08:26.771628+0000","last_clean_scrub_stamp":"2024-09-14T11:08:26.771628+0000","objects_scrubbed":0,"log_size":105,"log_dups_size":901,"ondisk_log_size":105,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:45:52.681555+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":30281,"num_objects":12,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":0,"num_read":1335,"num_read_kb":1419,"num_write":488,"num_write_kb":251,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":526,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:59:32.846140+0000","last_change":"2024-09-14T11:08:29.837085+0000","last_active":"2024-09-14T12:59:32.846140+0000","last_peered":"2024-09-14T12:59:32.846140+0000","last_clean":"2024-09-14T12:59:32.846140+0000","last_became_active":"2024-09-14T11:08:29.836253+0000","last_became_peered":"2024-09-14T11:08:29.836253+0000","last_unstale":"2024-09-14T12:59:32.846140+0000","last_undegraded":"2024-09-14T12:59:32.846140+0000","last_fullsized":"2024-09-14T12:59:32.846140+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:08:28.783586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:08:28.783586+0000","last_clean_scrub_stamp":"2024-09-14T11:08:28.783586+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:19:31.677337+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.a","version":"267'224","reported_seq":783,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:59:18.468936+0000","last_change":"2024-09-14T11:08:31.836526+0000","last_active":"2024-09-14T12:59:18.468936+0000","last_peered":"2024-09-14T12:59:18.468936+0000","last_clean":"2024-09-14T12:59:18.468936+0000","last_became_active":"2024-09-14T11:08:31.835700+0000","last_became_peered":"2024-09-14T11:08:31.835700+0000","last_unstale":"2024-09-14T12:59:18.468936+0000","last_undegraded":"2024-09-14T12:59:18.468936+0000","last_fullsized":"2024-09-14T12:59:18.468936+0000","mapping_epoch":34,"log_start":"267'200","ondisk_log_start":"267'200","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:08:30.789404+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:08:30.789404+0000","last_clean_scrub_stamp":"2024-09-14T11:08:30.789404+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":200,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:45:49.838871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":435,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":369,"num_read_kb":358,"num_write":505,"num_write_kb":147,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"267'413","reported_seq":2031,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:00:21.260118+0000","last_change":"2024-09-14T11:09:57.243473+0000","last_active":"2024-09-14T13:00:21.260118+0000","last_peered":"2024-09-14T13:00:21.260118+0000","last_clean":"2024-09-14T13:00:21.260118+0000","last_became_active":"2024-09-14T11:09:57.243168+0000","last_became_peered":"2024-09-14T11:09:57.243168+0000","last_unstale":"2024-09-14T13:00:21.260118+0000","last_undegraded":"2024-09-14T13:00:21.260118+0000","last_fullsized":"2024-09-14T13:00:21.260118+0000","mapping_epoch":39,"log_start":"267'400","ondisk_log_start":"267'400","created":26,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:08:22.750609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:08:22.750609+0000","last_clean_scrub_stamp":"2024-09-14T11:08:22.750609+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":400,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:03:03.902658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2397,"num_read_kb":2278,"num_write":464,"num_write_kb":90,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":564,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:58:37.822791+0000","last_change":"2024-09-14T11:08:10.911966+0000","last_active":"2024-09-14T12:58:37.822791+0000","last_peered":"2024-09-14T12:58:37.822791+0000","last_clean":"2024-09-14T12:58:37.822791+0000","last_became_active":"2024-09-14T11:08:08.957848+0000","last_became_peered":"2024-09-14T11:08:08.957848+0000","last_unstale":"2024-09-14T12:58:37.822791+0000","last_undegraded":"2024-09-14T12:58:37.822791+0000","last_fullsized":"2024-09-14T12:58:37.822791+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:08:07.870014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:08:07.870014+0000","last_clean_scrub_stamp":"2024-09-14T11:08:07.870014+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:21:50.090415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001143142,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"267'230","reported_seq":913,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:58:38.459976+0000","last_change":"2024-09-14T11:08:21.817844+0000","last_active":"2024-09-14T12:58:38.459976+0000","last_peered":"2024-09-14T12:58:38.459976+0000","last_clean":"2024-09-14T12:58:38.459976+0000","last_became_active":"2024-09-14T11:08:21.817523+0000","last_became_peered":"2024-09-14T11:08:21.817523+0000","last_unstale":"2024-09-14T12:58:38.459976+0000","last_undegraded":"2024-09-14T12:58:38.459976+0000","last_fullsized":"2024-09-14T12:58:38.459976+0000","mapping_epoch":24,"log_start":"267'200","ondisk_log_start":"267'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:08:20.733145+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:08:20.733145+0000","last_clean_scrub_stamp":"2024-09-14T11:08:20.733145+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":200,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:40:59.452110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12940502,"num_objects":9,"num_object_clones":0,"num_object_copies":27,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":624,"num_read_kb":70142,"num_write":1040,"num_write_kb":36042,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,6],"acting":[1,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.6","version":"29'1","reported_seq":536,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:58:57.827977+0000","last_change":"2024-09-14T11:08:25.807394+0000","last_active":"2024-09-14T12:58:57.827977+0000","last_peered":"2024-09-14T12:58:57.827977+0000","last_clean":"2024-09-14T12:58:57.827977+0000","last_became_active":"2024-09-14T11:08:25.807070+0000","last_became_peered":"2024-09-14T11:08:25.807070+0000","last_unstale":"2024-09-14T12:58:57.827977+0000","last_undegraded":"2024-09-14T12:58:57.827977+0000","last_fullsized":"2024-09-14T12:58:57.827977+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:08:24.757170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:08:24.757170+0000","last_clean_scrub_stamp":"2024-09-14T11:08:24.757170+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:08:45.157565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.5","version":"267'402","reported_seq":2364,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:01:40.687724+0000","last_change":"2024-09-14T11:08:27.831350+0000","last_active":"2024-09-14T13:01:40.687724+0000","last_peered":"2024-09-14T13:01:40.687724+0000","last_clean":"2024-09-14T13:01:40.687724+0000","last_became_active":"2024-09-14T11:08:27.830644+0000","last_became_peered":"2024-09-14T11:08:27.830644+0000","last_unstale":"2024-09-14T13:01:40.687724+0000","last_undegraded":"2024-09-14T13:01:40.687724+0000","last_fullsized":"2024-09-14T13:01:40.687724+0000","mapping_epoch":30,"log_start":"267'300","ondisk_log_start":"267'300","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:08:26.771628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:08:26.771628+0000","last_clean_scrub_stamp":"2024-09-14T11:08:26.771628+0000","objects_scrubbed":0,"log_size":102,"log_dups_size":300,"ondisk_log_size":102,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:05:03.898449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":154,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":380,"num_read_kb":368,"num_write":375,"num_write_kb":193,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":530,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:58:58.243958+0000","last_change":"2024-09-14T11:08:29.802462+0000","last_active":"2024-09-14T12:58:58.243958+0000","last_peered":"2024-09-14T12:58:58.243958+0000","last_clean":"2024-09-14T12:58:58.243958+0000","last_became_active":"2024-09-14T11:08:29.801661+0000","last_became_peered":"2024-09-14T11:08:29.801661+0000","last_unstale":"2024-09-14T12:58:58.243958+0000","last_undegraded":"2024-09-14T12:58:58.243958+0000","last_fullsized":"2024-09-14T12:58:58.243958+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:08:28.783586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:08:28.783586+0000","last_clean_scrub_stamp":"2024-09-14T11:08:28.783586+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:32:48.426887+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.b","version":"267'248","reported_seq":876,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:00:21.845348+0000","last_change":"2024-09-14T11:08:31.842253+0000","last_active":"2024-09-14T13:00:21.845348+0000","last_peered":"2024-09-14T13:00:21.845348+0000","last_clean":"2024-09-14T13:00:21.845348+0000","last_became_active":"2024-09-14T11:08:31.841552+0000","last_became_peered":"2024-09-14T11:08:31.841552+0000","last_unstale":"2024-09-14T13:00:21.845348+0000","last_undegraded":"2024-09-14T13:00:21.845348+0000","last_fullsized":"2024-09-14T13:00:21.845348+0000","mapping_epoch":34,"log_start":"267'200","ondisk_log_start":"267'200","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:08:30.789404+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:08:30.789404+0000","last_clean_scrub_stamp":"2024-09-14T11:08:30.789404+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":200,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:30:40.287699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":202,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":474,"num_read_kb":499,"num_write":548,"num_write_kb":158,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"267'1115","reported_seq":2640,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:01:39.340538+0000","last_change":"2024-09-14T11:08:23.777840+0000","last_active":"2024-09-14T13:01:39.340538+0000","last_peered":"2024-09-14T13:01:39.340538+0000","last_clean":"2024-09-14T13:01:39.340538+0000","last_became_active":"2024-09-14T11:08:23.777511+0000","last_became_peered":"2024-09-14T11:08:23.777511+0000","last_unstale":"2024-09-14T13:01:39.340538+0000","last_undegraded":"2024-09-14T13:01:39.340538+0000","last_fullsized":"2024-09-14T13:01:39.340538+0000","mapping_epoch":26,"log_start":"267'1100","ondisk_log_start":"267'1100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:08:22.750609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:08:22.750609+0000","last_clean_scrub_stamp":"2024-09-14T11:08:22.750609+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":1100,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:04:58.735646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5086,"num_read_kb":4484,"num_write":1533,"num_write_kb":642,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"20'2","reported_seq":562,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:58:38.043188+0000","last_change":"2024-09-14T11:08:10.933870+0000","last_active":"2024-09-14T12:58:38.043188+0000","last_peered":"2024-09-14T12:58:38.043188+0000","last_clean":"2024-09-14T12:58:38.043188+0000","last_became_active":"2024-09-14T11:08:08.903062+0000","last_became_peered":"2024-09-14T11:08:08.903062+0000","last_unstale":"2024-09-14T12:58:38.043188+0000","last_undegraded":"2024-09-14T12:58:38.043188+0000","last_fullsized":"2024-09-14T12:58:38.043188+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:08:07.870014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:08:07.870014+0000","last_clean_scrub_stamp":"2024-09-14T11:08:07.870014+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:50:59.568798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0022728420000000002,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"267'175","reported_seq":862,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:58:48.230287+0000","last_change":"2024-09-14T11:08:21.830653+0000","last_active":"2024-09-14T12:58:48.230287+0000","last_peered":"2024-09-14T12:58:48.230287+0000","last_clean":"2024-09-14T12:58:48.230287+0000","last_became_active":"2024-09-14T11:08:21.823121+0000","last_became_peered":"2024-09-14T11:08:21.823121+0000","last_unstale":"2024-09-14T12:58:48.230287+0000","last_undegraded":"2024-09-14T12:58:48.230287+0000","last_fullsized":"2024-09-14T12:58:48.230287+0000","mapping_epoch":24,"log_start":"267'100","ondisk_log_start":"267'100","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:08:20.733145+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:08:20.733145+0000","last_clean_scrub_stamp":"2024-09-14T11:08:20.733145+0000","objects_scrubbed":0,"log_size":75,"log_dups_size":100,"ondisk_log_size":75,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:49:22.239894+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8336652,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":551,"num_read_kb":32204,"num_write":875,"num_write_kb":26671,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,0],"acting":[4,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":538,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:59:18.249303+0000","last_change":"2024-09-14T11:08:25.797249+0000","last_active":"2024-09-14T12:59:18.249303+0000","last_peered":"2024-09-14T12:59:18.249303+0000","last_clean":"2024-09-14T12:59:18.249303+0000","last_became_active":"2024-09-14T11:08:25.796526+0000","last_became_peered":"2024-09-14T11:08:25.796526+0000","last_unstale":"2024-09-14T12:59:18.249303+0000","last_undegraded":"2024-09-14T12:59:18.249303+0000","last_fullsized":"2024-09-14T12:59:18.249303+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:08:24.757170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:08:24.757170+0000","last_clean_scrub_stamp":"2024-09-14T11:08:24.757170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:18:24.235208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.6","version":"267'234","reported_seq":849,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:01:28.385849+0000","last_change":"2024-09-14T11:08:27.819232+0000","last_active":"2024-09-14T13:01:28.385849+0000","last_peered":"2024-09-14T13:01:28.385849+0000","last_clean":"2024-09-14T13:01:28.385849+0000","last_became_active":"2024-09-14T11:08:27.818482+0000","last_became_peered":"2024-09-14T11:08:27.818482+0000","last_unstale":"2024-09-14T13:01:28.385849+0000","last_undegraded":"2024-09-14T13:01:28.385849+0000","last_fullsized":"2024-09-14T13:01:28.385849+0000","mapping_epoch":30,"log_start":"267'200","ondisk_log_start":"267'200","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:08:26.771628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:08:26.771628+0000","last_clean_scrub_stamp":"2024-09-14T11:08:26.771628+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":200,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:12:06.477100+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":286,"num_read_kb":275,"num_write":214,"num_write_kb":24,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":522,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:59:03.430911+0000","last_change":"2024-09-14T11:08:29.839536+0000","last_active":"2024-09-14T12:59:03.430911+0000","last_peered":"2024-09-14T12:59:03.430911+0000","last_clean":"2024-09-14T12:59:03.430911+0000","last_became_active":"2024-09-14T11:08:29.837840+0000","last_became_peered":"2024-09-14T11:08:29.837840+0000","last_unstale":"2024-09-14T12:59:03.430911+0000","last_undegraded":"2024-09-14T12:59:03.430911+0000","last_fullsized":"2024-09-14T12:59:03.430911+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:08:28.783586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:08:28.783586+0000","last_clean_scrub_stamp":"2024-09-14T11:08:28.783586+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:39:33.744929+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.8","version":"267'111","reported_seq":687,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:00:18.844178+0000","last_change":"2024-09-14T11:08:31.852081+0000","last_active":"2024-09-14T13:00:18.844178+0000","last_peered":"2024-09-14T13:00:18.844178+0000","last_clean":"2024-09-14T13:00:18.844178+0000","last_became_active":"2024-09-14T11:08:31.851269+0000","last_became_peered":"2024-09-14T11:08:31.851269+0000","last_unstale":"2024-09-14T13:00:18.844178+0000","last_undegraded":"2024-09-14T13:00:18.844178+0000","last_fullsized":"2024-09-14T13:00:18.844178+0000","mapping_epoch":34,"log_start":"267'100","ondisk_log_start":"267'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:08:30.789404+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:08:30.789404+0000","last_clean_scrub_stamp":"2024-09-14T11:08:30.789404+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":100,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:52:29.862548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":188,"num_read_kb":187,"num_write":249,"num_write_kb":58,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"267'517","reported_seq":2228,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:00:18.884304+0000","last_change":"2024-09-14T11:08:23.794201+0000","last_active":"2024-09-14T13:00:18.884304+0000","last_peered":"2024-09-14T13:00:18.884304+0000","last_clean":"2024-09-14T13:00:18.884304+0000","last_became_active":"2024-09-14T11:08:23.793860+0000","last_became_peered":"2024-09-14T11:08:23.793860+0000","last_unstale":"2024-09-14T13:00:18.884304+0000","last_undegraded":"2024-09-14T13:00:18.884304+0000","last_fullsized":"2024-09-14T13:00:18.884304+0000","mapping_epoch":26,"log_start":"267'500","ondisk_log_start":"267'500","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:08:22.750609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:08:22.750609+0000","last_clean_scrub_stamp":"2024-09-14T11:08:22.750609+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":500,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:09:26.531607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3013,"num_read_kb":2819,"num_write":641,"num_write_kb":178,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"267'194","reported_seq":873,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:59:18.052260+0000","last_change":"2024-09-14T11:08:21.792555+0000","last_active":"2024-09-14T12:59:18.052260+0000","last_peered":"2024-09-14T12:59:18.052260+0000","last_clean":"2024-09-14T12:59:18.052260+0000","last_became_active":"2024-09-14T11:08:21.791679+0000","last_became_peered":"2024-09-14T11:08:21.791679+0000","last_unstale":"2024-09-14T12:59:18.052260+0000","last_undegraded":"2024-09-14T12:59:18.052260+0000","last_fullsized":"2024-09-14T12:59:18.052260+0000","mapping_epoch":24,"log_start":"267'100","ondisk_log_start":"267'100","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:08:20.733145+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:08:20.733145+0000","last_clean_scrub_stamp":"2024-09-14T11:08:20.733145+0000","objects_scrubbed":0,"log_size":94,"log_dups_size":100,"ondisk_log_size":94,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:33:56.588522+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10547089,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":641,"num_read_kb":55282,"num_write":896,"num_write_kb":39262,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,2],"acting":[5,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":558,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:58:38.460088+0000","last_change":"2024-09-14T11:08:10.911600+0000","last_active":"2024-09-14T12:58:38.460088+0000","last_peered":"2024-09-14T12:58:38.460088+0000","last_clean":"2024-09-14T12:58:38.460088+0000","last_became_active":"2024-09-14T11:08:08.888921+0000","last_became_peered":"2024-09-14T11:08:08.888921+0000","last_unstale":"2024-09-14T12:58:38.460088+0000","last_undegraded":"2024-09-14T12:58:38.460088+0000","last_fullsized":"2024-09-14T12:58:38.460088+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:08:07.870014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:08:07.870014+0000","last_clean_scrub_stamp":"2024-09-14T11:08:07.870014+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:29:02.760571+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001198714,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":538,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:58:53.242581+0000","last_change":"2024-09-14T11:08:25.801820+0000","last_active":"2024-09-14T12:58:53.242581+0000","last_peered":"2024-09-14T12:58:53.242581+0000","last_clean":"2024-09-14T12:58:53.242581+0000","last_became_active":"2024-09-14T11:08:25.792863+0000","last_became_peered":"2024-09-14T11:08:25.792863+0000","last_unstale":"2024-09-14T12:58:53.242581+0000","last_undegraded":"2024-09-14T12:58:53.242581+0000","last_fullsized":"2024-09-14T12:58:53.242581+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:08:24.757170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:08:24.757170+0000","last_clean_scrub_stamp":"2024-09-14T11:08:24.757170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:55:17.257027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"267'454","reported_seq":1193,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:01:40.574099+0000","last_change":"2024-09-14T11:08:27.803952+0000","last_active":"2024-09-14T13:01:40.574099+0000","last_peered":"2024-09-14T13:01:40.574099+0000","last_clean":"2024-09-14T13:01:40.574099+0000","last_became_active":"2024-09-14T11:08:27.803324+0000","last_became_peered":"2024-09-14T11:08:27.803324+0000","last_unstale":"2024-09-14T13:01:40.574099+0000","last_undegraded":"2024-09-14T13:01:40.574099+0000","last_fullsized":"2024-09-14T13:01:40.574099+0000","mapping_epoch":30,"log_start":"267'400","ondisk_log_start":"267'400","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:08:26.771628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:08:26.771628+0000","last_clean_scrub_stamp":"2024-09-14T11:08:26.771628+0000","objects_scrubbed":0,"log_size":54,"log_dups_size":400,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:06:41.976461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":32596,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":1287,"num_read_kb":1421,"num_write":1882,"num_write_kb":1658,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":527,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:58:58.232580+0000","last_change":"2024-09-14T11:08:29.831130+0000","last_active":"2024-09-14T12:58:58.232580+0000","last_peered":"2024-09-14T12:58:58.232580+0000","last_clean":"2024-09-14T12:58:58.232580+0000","last_became_active":"2024-09-14T11:08:29.830303+0000","last_became_peered":"2024-09-14T11:08:29.830303+0000","last_unstale":"2024-09-14T12:58:58.232580+0000","last_undegraded":"2024-09-14T12:58:58.232580+0000","last_fullsized":"2024-09-14T12:58:58.232580+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:08:28.783586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:08:28.783586+0000","last_clean_scrub_stamp":"2024-09-14T11:08:28.783586+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:22:47.627433+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.e","version":"267'153","reported_seq":717,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:00:13.798032+0000","last_change":"2024-09-14T11:08:31.836009+0000","last_active":"2024-09-14T13:00:13.798032+0000","last_peered":"2024-09-14T13:00:13.798032+0000","last_clean":"2024-09-14T13:00:13.798032+0000","last_became_active":"2024-09-14T11:08:31.835335+0000","last_became_peered":"2024-09-14T11:08:31.835335+0000","last_unstale":"2024-09-14T13:00:13.798032+0000","last_undegraded":"2024-09-14T13:00:13.798032+0000","last_fullsized":"2024-09-14T13:00:13.798032+0000","mapping_epoch":34,"log_start":"267'100","ondisk_log_start":"267'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:08:30.789404+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:08:30.789404+0000","last_clean_scrub_stamp":"2024-09-14T11:08:30.789404+0000","objects_scrubbed":0,"log_size":53,"log_dups_size":100,"ondisk_log_size":53,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:46:41.088012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":736,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":226,"num_read_kb":194,"num_write":381,"num_write_kb":93,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"267'734","reported_seq":2282,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:58:53.242555+0000","last_change":"2024-09-14T11:08:23.792522+0000","last_active":"2024-09-14T12:58:53.242555+0000","last_peered":"2024-09-14T12:58:53.242555+0000","last_clean":"2024-09-14T12:58:53.242555+0000","last_became_active":"2024-09-14T11:08:23.792144+0000","last_became_peered":"2024-09-14T11:08:23.792144+0000","last_unstale":"2024-09-14T12:58:53.242555+0000","last_undegraded":"2024-09-14T12:58:53.242555+0000","last_fullsized":"2024-09-14T12:58:53.242555+0000","mapping_epoch":26,"log_start":"267'700","ondisk_log_start":"267'700","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:08:22.750609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:08:22.750609+0000","last_clean_scrub_stamp":"2024-09-14T11:08:22.750609+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":700,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:27:19.107022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":3573,"num_read_kb":3234,"num_write":954,"num_write_kb":344,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.4","version":"267'257","reported_seq":975,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:58:48.462398+0000","last_change":"2024-09-14T11:08:21.808706+0000","last_active":"2024-09-14T12:58:48.462398+0000","last_peered":"2024-09-14T12:58:48.462398+0000","last_clean":"2024-09-14T12:58:48.462398+0000","last_became_active":"2024-09-14T11:08:21.808278+0000","last_became_peered":"2024-09-14T11:08:21.808278+0000","last_unstale":"2024-09-14T12:58:48.462398+0000","last_undegraded":"2024-09-14T12:58:48.462398+0000","last_fullsized":"2024-09-14T12:58:48.462398+0000","mapping_epoch":24,"log_start":"267'200","ondisk_log_start":"267'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:08:20.733145+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:08:20.733145+0000","last_clean_scrub_stamp":"2024-09-14T11:08:20.733145+0000","objects_scrubbed":0,"log_size":57,"log_dups_size":200,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:56:37.903249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194409,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":847,"num_read_kb":29775,"num_write":1316,"num_write_kb":30049,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,6],"acting":[1,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":561,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:59:12.841357+0000","last_change":"2024-09-14T11:08:11.214796+0000","last_active":"2024-09-14T12:59:12.841357+0000","last_peered":"2024-09-14T12:59:12.841357+0000","last_clean":"2024-09-14T12:59:12.841357+0000","last_became_active":"2024-09-14T11:08:08.903905+0000","last_became_peered":"2024-09-14T11:08:08.903905+0000","last_unstale":"2024-09-14T12:59:12.841357+0000","last_undegraded":"2024-09-14T12:59:12.841357+0000","last_fullsized":"2024-09-14T12:59:12.841357+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:08:07.870014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:08:07.870014+0000","last_clean_scrub_stamp":"2024-09-14T11:08:07.870014+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:58:06.786050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001173377,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":532,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:58:53.428640+0000","last_change":"2024-09-14T11:08:25.801438+0000","last_active":"2024-09-14T12:58:53.428640+0000","last_peered":"2024-09-14T12:58:53.428640+0000","last_clean":"2024-09-14T12:58:53.428640+0000","last_became_active":"2024-09-14T11:08:25.800695+0000","last_became_peered":"2024-09-14T11:08:25.800695+0000","last_unstale":"2024-09-14T12:58:53.428640+0000","last_undegraded":"2024-09-14T12:58:53.428640+0000","last_fullsized":"2024-09-14T12:58:53.428640+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:08:24.757170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:08:24.757170+0000","last_clean_scrub_stamp":"2024-09-14T11:08:24.757170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:42:30.211985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1","version":"267'350","reported_seq":993,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:00:28.372671+0000","last_change":"2024-09-14T11:08:27.814544+0000","last_active":"2024-09-14T13:00:28.372671+0000","last_peered":"2024-09-14T13:00:28.372671+0000","last_clean":"2024-09-14T13:00:28.372671+0000","last_became_active":"2024-09-14T11:08:27.813857+0000","last_became_peered":"2024-09-14T11:08:27.813857+0000","last_unstale":"2024-09-14T13:00:28.372671+0000","last_undegraded":"2024-09-14T13:00:28.372671+0000","last_fullsized":"2024-09-14T13:00:28.372671+0000","mapping_epoch":30,"log_start":"267'300","ondisk_log_start":"267'300","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:08:26.771628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:08:26.771628+0000","last_clean_scrub_stamp":"2024-09-14T11:08:26.771628+0000","objects_scrubbed":0,"log_size":50,"log_dups_size":300,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:41:50.966231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":441,"num_read_kb":434,"num_write":426,"num_write_kb":202,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.0","version":"267'776","reported_seq":5194,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:01:40.713682+0000","last_change":"2024-09-14T11:08:29.824227+0000","last_active":"2024-09-14T13:01:40.713682+0000","last_peered":"2024-09-14T13:01:40.713682+0000","last_clean":"2024-09-14T13:01:40.713682+0000","last_became_active":"2024-09-14T11:08:29.823513+0000","last_became_peered":"2024-09-14T11:08:29.823513+0000","last_unstale":"2024-09-14T13:01:40.713682+0000","last_undegraded":"2024-09-14T13:01:40.713682+0000","last_fullsized":"2024-09-14T13:01:40.713682+0000","mapping_epoch":32,"log_start":"267'700","ondisk_log_start":"267'700","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:08:28.783586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:08:28.783586+0000","last_clean_scrub_stamp":"2024-09-14T11:08:28.783586+0000","objects_scrubbed":0,"log_size":76,"log_dups_size":700,"ondisk_log_size":76,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:12:27.111650+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.f","version":"267'148","reported_seq":702,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:01:23.499170+0000","last_change":"2024-09-14T11:08:31.831263+0000","last_active":"2024-09-14T13:01:23.499170+0000","last_peered":"2024-09-14T13:01:23.499170+0000","last_clean":"2024-09-14T13:01:23.499170+0000","last_became_active":"2024-09-14T11:08:31.825708+0000","last_became_peered":"2024-09-14T11:08:31.825708+0000","last_unstale":"2024-09-14T13:01:23.499170+0000","last_undegraded":"2024-09-14T13:01:23.499170+0000","last_fullsized":"2024-09-14T13:01:23.499170+0000","mapping_epoch":34,"log_start":"267'100","ondisk_log_start":"267'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:08:30.789404+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:08:30.789404+0000","last_clean_scrub_stamp":"2024-09-14T11:08:30.789404+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":100,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:10:09.371769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1096,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":219,"num_read_kb":197,"num_write":351,"num_write_kb":86,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"267'1021","reported_seq":2906,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:59:18.397637+0000","last_change":"2024-09-14T11:08:23.800778+0000","last_active":"2024-09-14T12:59:18.397637+0000","last_peered":"2024-09-14T12:59:18.397637+0000","last_clean":"2024-09-14T12:59:18.397637+0000","last_became_active":"2024-09-14T11:08:23.800388+0000","last_became_peered":"2024-09-14T11:08:23.800388+0000","last_unstale":"2024-09-14T12:59:18.397637+0000","last_undegraded":"2024-09-14T12:59:18.397637+0000","last_fullsized":"2024-09-14T12:59:18.397637+0000","mapping_epoch":26,"log_start":"267'1000","ondisk_log_start":"267'1000","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:08:22.750609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:08:22.750609+0000","last_clean_scrub_stamp":"2024-09-14T11:08:22.750609+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":1000,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:13:46.545106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":5094,"num_read_kb":4556,"num_write":1418,"num_write_kb":544,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.7","version":"267'184","reported_seq":826,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:58:53.465571+0000","last_change":"2024-09-14T11:08:21.798122+0000","last_active":"2024-09-14T12:58:53.465571+0000","last_peered":"2024-09-14T12:58:53.465571+0000","last_clean":"2024-09-14T12:58:53.465571+0000","last_became_active":"2024-09-14T11:08:21.797297+0000","last_became_peered":"2024-09-14T11:08:21.797297+0000","last_unstale":"2024-09-14T12:58:53.465571+0000","last_undegraded":"2024-09-14T12:58:53.465571+0000","last_fullsized":"2024-09-14T12:58:53.465571+0000","mapping_epoch":24,"log_start":"267'100","ondisk_log_start":"267'100","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:08:20.733145+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:08:20.733145+0000","last_clean_scrub_stamp":"2024-09-14T11:08:20.733145+0000","objects_scrubbed":0,"log_size":84,"log_dups_size":100,"ondisk_log_size":84,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:30:27.067493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":11093052,"num_objects":10,"num_object_clones":0,"num_object_copies":30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":468,"num_read_kb":20434,"num_write":849,"num_write_kb":40195,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,7],"acting":[3,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":556,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:58:43.461294+0000","last_change":"2024-09-14T11:08:10.911600+0000","last_active":"2024-09-14T12:58:43.461294+0000","last_peered":"2024-09-14T12:58:43.461294+0000","last_clean":"2024-09-14T12:58:43.461294+0000","last_became_active":"2024-09-14T11:08:08.891458+0000","last_became_peered":"2024-09-14T11:08:08.891458+0000","last_unstale":"2024-09-14T12:58:43.461294+0000","last_undegraded":"2024-09-14T12:58:43.461294+0000","last_fullsized":"2024-09-14T12:58:43.461294+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:08:07.870014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:08:07.870014+0000","last_clean_scrub_stamp":"2024-09-14T11:08:07.870014+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:05:05.170921+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0011468940000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":535,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:58:53.231411+0000","last_change":"2024-09-14T11:08:25.808446+0000","last_active":"2024-09-14T12:58:53.231411+0000","last_peered":"2024-09-14T12:58:53.231411+0000","last_clean":"2024-09-14T12:58:53.231411+0000","last_became_active":"2024-09-14T11:08:25.807555+0000","last_became_peered":"2024-09-14T11:08:25.807555+0000","last_unstale":"2024-09-14T12:58:53.231411+0000","last_undegraded":"2024-09-14T12:58:53.231411+0000","last_fullsized":"2024-09-14T12:58:53.231411+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:08:24.757170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:08:24.757170+0000","last_clean_scrub_stamp":"2024-09-14T11:08:24.757170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:45:14.993273+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.2","version":"267'172","reported_seq":779,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:59:08.517056+0000","last_change":"2024-09-14T11:08:27.826108+0000","last_active":"2024-09-14T12:59:08.517056+0000","last_peered":"2024-09-14T12:59:08.517056+0000","last_clean":"2024-09-14T12:59:08.517056+0000","last_became_active":"2024-09-14T11:08:27.825292+0000","last_became_peered":"2024-09-14T11:08:27.825292+0000","last_unstale":"2024-09-14T12:59:08.517056+0000","last_undegraded":"2024-09-14T12:59:08.517056+0000","last_fullsized":"2024-09-14T12:59:08.517056+0000","mapping_epoch":30,"log_start":"267'100","ondisk_log_start":"267'100","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:08:26.771628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:08:26.771628+0000","last_clean_scrub_stamp":"2024-09-14T11:08:26.771628+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":100,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:07:03.156677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":226,"num_read_kb":221,"num_write":150,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.3","version":"267'811","reported_seq":5530,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:01:40.724601+0000","last_change":"2024-09-14T11:08:29.826625+0000","last_active":"2024-09-14T13:01:40.724601+0000","last_peered":"2024-09-14T13:01:40.724601+0000","last_clean":"2024-09-14T13:01:40.724601+0000","last_became_active":"2024-09-14T11:08:29.824268+0000","last_became_peered":"2024-09-14T11:08:29.824268+0000","last_unstale":"2024-09-14T13:01:40.724601+0000","last_undegraded":"2024-09-14T13:01:40.724601+0000","last_fullsized":"2024-09-14T13:01:40.724601+0000","mapping_epoch":32,"log_start":"267'701","ondisk_log_start":"267'701","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:08:28.783586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:08:28.783586+0000","last_clean_scrub_stamp":"2024-09-14T11:08:28.783586+0000","objects_scrubbed":0,"log_size":110,"log_dups_size":701,"ondisk_log_size":110,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:53:34.571934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.c","version":"267'177","reported_seq":726,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:58:48.241226+0000","last_change":"2024-09-14T11:08:31.845141+0000","last_active":"2024-09-14T12:58:48.241226+0000","last_peered":"2024-09-14T12:58:48.241226+0000","last_clean":"2024-09-14T12:58:48.241226+0000","last_became_active":"2024-09-14T11:08:31.844329+0000","last_became_peered":"2024-09-14T11:08:31.844329+0000","last_unstale":"2024-09-14T12:58:48.241226+0000","last_undegraded":"2024-09-14T12:58:48.241226+0000","last_fullsized":"2024-09-14T12:58:48.241226+0000","mapping_epoch":34,"log_start":"267'100","ondisk_log_start":"267'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:08:30.789404+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:08:30.789404+0000","last_clean_scrub_stamp":"2024-09-14T11:08:30.789404+0000","objects_scrubbed":0,"log_size":77,"log_dups_size":100,"ondisk_log_size":77,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:04:50.705908+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":58,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":178,"num_read_kb":162,"num_write":419,"num_write_kb":126,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"267'732","reported_seq":2204,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:00:11.324270+0000","last_change":"2024-09-14T11:08:23.801660+0000","last_active":"2024-09-14T13:00:11.324270+0000","last_peered":"2024-09-14T13:00:11.324270+0000","last_clean":"2024-09-14T13:00:11.324270+0000","last_became_active":"2024-09-14T11:08:23.800918+0000","last_became_peered":"2024-09-14T11:08:23.800918+0000","last_unstale":"2024-09-14T13:00:11.324270+0000","last_undegraded":"2024-09-14T13:00:11.324270+0000","last_fullsized":"2024-09-14T13:00:11.324270+0000","mapping_epoch":26,"log_start":"267'700","ondisk_log_start":"267'700","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:08:22.750609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:08:22.750609+0000","last_clean_scrub_stamp":"2024-09-14T11:08:22.750609+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":700,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:49:04.627652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3552,"num_read_kb":3200,"num_write":979,"num_write_kb":380,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"267'258","reported_seq":958,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:01:33.607989+0000","last_change":"2024-09-14T11:08:56.035136+0000","last_active":"2024-09-14T13:01:33.607989+0000","last_peered":"2024-09-14T13:01:33.607989+0000","last_clean":"2024-09-14T13:01:33.607989+0000","last_became_active":"2024-09-14T11:08:56.034426+0000","last_became_peered":"2024-09-14T11:08:56.034426+0000","last_unstale":"2024-09-14T13:01:33.607989+0000","last_undegraded":"2024-09-14T13:01:33.607989+0000","last_fullsized":"2024-09-14T13:01:33.607989+0000","mapping_epoch":37,"log_start":"267'200","ondisk_log_start":"267'200","created":24,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:08:20.733145+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:08:20.733145+0000","last_clean_scrub_stamp":"2024-09-14T11:08:20.733145+0000","objects_scrubbed":0,"log_size":58,"log_dups_size":200,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:00:24.358863+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":13820112,"num_objects":13,"num_object_clones":0,"num_object_copies":39,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":13,"num_whiteouts":0,"num_read":730,"num_read_kb":100890,"num_write":1095,"num_write_kb":33821,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,4],"acting":[2,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":557,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:58:43.426370+0000","last_change":"2024-09-14T11:08:11.214692+0000","last_active":"2024-09-14T12:58:43.426370+0000","last_peered":"2024-09-14T12:58:43.426370+0000","last_clean":"2024-09-14T12:58:43.426370+0000","last_became_active":"2024-09-14T11:08:08.905736+0000","last_became_peered":"2024-09-14T11:08:08.905736+0000","last_unstale":"2024-09-14T12:58:43.426370+0000","last_undegraded":"2024-09-14T12:58:43.426370+0000","last_fullsized":"2024-09-14T12:58:43.426370+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:08:07.870014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:08:07.870014+0000","last_clean_scrub_stamp":"2024-09-14T11:08:07.870014+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:16:43.551707+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0012835290000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":535,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:58:48.463988+0000","last_change":"2024-09-14T11:08:25.803022+0000","last_active":"2024-09-14T12:58:48.463988+0000","last_peered":"2024-09-14T12:58:48.463988+0000","last_clean":"2024-09-14T12:58:48.463988+0000","last_became_active":"2024-09-14T11:08:25.801554+0000","last_became_peered":"2024-09-14T11:08:25.801554+0000","last_unstale":"2024-09-14T12:58:48.463988+0000","last_undegraded":"2024-09-14T12:58:48.463988+0000","last_fullsized":"2024-09-14T12:58:48.463988+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:08:24.757170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:08:24.757170+0000","last_clean_scrub_stamp":"2024-09-14T11:08:24.757170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:30:31.481284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"267'392","reported_seq":1169,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:01:40.563995+0000","last_change":"2024-09-14T11:08:27.836312+0000","last_active":"2024-09-14T13:01:40.563995+0000","last_peered":"2024-09-14T13:01:40.563995+0000","last_clean":"2024-09-14T13:01:40.563995+0000","last_became_active":"2024-09-14T11:08:27.831653+0000","last_became_peered":"2024-09-14T11:08:27.831653+0000","last_unstale":"2024-09-14T13:01:40.563995+0000","last_undegraded":"2024-09-14T13:01:40.563995+0000","last_fullsized":"2024-09-14T13:01:40.563995+0000","mapping_epoch":30,"log_start":"267'300","ondisk_log_start":"267'300","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:08:26.771628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:08:26.771628+0000","last_clean_scrub_stamp":"2024-09-14T11:08:26.771628+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":300,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:26:55.360414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":48790,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":583,"num_read_kb":815,"num_write":328,"num_write_kb":91,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":525,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:58:58.466673+0000","last_change":"2024-09-14T11:08:29.826424+0000","last_active":"2024-09-14T12:58:58.466673+0000","last_peered":"2024-09-14T12:58:58.466673+0000","last_clean":"2024-09-14T12:58:58.466673+0000","last_became_active":"2024-09-14T11:08:29.825186+0000","last_became_peered":"2024-09-14T11:08:29.825186+0000","last_unstale":"2024-09-14T12:58:58.466673+0000","last_undegraded":"2024-09-14T12:58:58.466673+0000","last_fullsized":"2024-09-14T12:58:58.466673+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:08:28.783586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:08:28.783586+0000","last_clean_scrub_stamp":"2024-09-14T11:08:28.783586+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:49:23.866313+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.d","version":"267'138","reported_seq":663,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:58:48.045619+0000","last_change":"2024-09-14T11:08:31.838408+0000","last_active":"2024-09-14T12:58:48.045619+0000","last_peered":"2024-09-14T12:58:48.045619+0000","last_clean":"2024-09-14T12:58:48.045619+0000","last_became_active":"2024-09-14T11:08:31.837649+0000","last_became_peered":"2024-09-14T11:08:31.837649+0000","last_unstale":"2024-09-14T12:58:48.045619+0000","last_undegraded":"2024-09-14T12:58:48.045619+0000","last_fullsized":"2024-09-14T12:58:48.045619+0000","mapping_epoch":34,"log_start":"267'100","ondisk_log_start":"267'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:08:30.789404+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:08:30.789404+0000","last_clean_scrub_stamp":"2024-09-14T11:08:30.789404+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":100,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:22:41.759152+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":204,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":124,"num_read_kb":124,"num_write":321,"num_write_kb":75,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.1f","version":"267'141","reported_seq":733,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:00:21.741622+0000","last_change":"2024-09-14T11:08:31.854083+0000","last_active":"2024-09-14T13:00:21.741622+0000","last_peered":"2024-09-14T13:00:21.741622+0000","last_clean":"2024-09-14T13:00:21.741622+0000","last_became_active":"2024-09-14T11:08:31.849681+0000","last_became_peered":"2024-09-14T11:08:31.849681+0000","last_unstale":"2024-09-14T13:00:21.741622+0000","last_undegraded":"2024-09-14T13:00:21.741622+0000","last_fullsized":"2024-09-14T13:00:21.741622+0000","mapping_epoch":34,"log_start":"267'100","ondisk_log_start":"267'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:08:30.789404+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:08:30.789404+0000","last_clean_scrub_stamp":"2024-09-14T11:08:30.789404+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":100,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:48:25.310770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":202,"num_read_kb":202,"num_write":327,"num_write_kb":74,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.13","version":"267'450","reported_seq":2149,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:00:11.323966+0000","last_change":"2024-09-14T11:08:23.807515+0000","last_active":"2024-09-14T13:00:11.323966+0000","last_peered":"2024-09-14T13:00:11.323966+0000","last_clean":"2024-09-14T13:00:11.323966+0000","last_became_active":"2024-09-14T11:08:23.806746+0000","last_became_peered":"2024-09-14T11:08:23.806746+0000","last_unstale":"2024-09-14T13:00:11.323966+0000","last_undegraded":"2024-09-14T13:00:11.323966+0000","last_fullsized":"2024-09-14T13:00:11.323966+0000","mapping_epoch":26,"log_start":"267'400","ondisk_log_start":"267'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:08:22.750609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:08:22.750609+0000","last_clean_scrub_stamp":"2024-09-14T11:08:22.750609+0000","objects_scrubbed":0,"log_size":50,"log_dups_size":400,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:59:49.178094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2482,"num_read_kb":2367,"num_write":499,"num_write_kb":86,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.14","version":"267'190","reported_seq":813,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:59:12.831154+0000","last_change":"2024-09-14T11:08:56.029416+0000","last_active":"2024-09-14T12:59:12.831154+0000","last_peered":"2024-09-14T12:59:12.831154+0000","last_clean":"2024-09-14T12:59:12.831154+0000","last_became_active":"2024-09-14T11:08:56.028924+0000","last_became_peered":"2024-09-14T11:08:56.028924+0000","last_unstale":"2024-09-14T12:59:12.831154+0000","last_undegraded":"2024-09-14T12:59:12.831154+0000","last_fullsized":"2024-09-14T12:59:12.831154+0000","mapping_epoch":37,"log_start":"267'100","ondisk_log_start":"267'100","created":24,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:08:20.733145+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:08:20.733145+0000","last_clean_scrub_stamp":"2024-09-14T11:08:20.733145+0000","objects_scrubbed":0,"log_size":90,"log_dups_size":100,"ondisk_log_size":90,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:13:29.739250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5594740,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":484,"num_read_kb":9162,"num_write":887,"num_write_kb":17219,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7,6],"acting":[2,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":525,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:58:08.453389+0000","last_change":"2024-09-14T11:08:25.807119+0000","last_active":"2024-09-14T12:58:08.453389+0000","last_peered":"2024-09-14T12:58:08.453389+0000","last_clean":"2024-09-14T12:58:08.453389+0000","last_became_active":"2024-09-14T11:08:25.806778+0000","last_became_peered":"2024-09-14T11:08:25.806778+0000","last_unstale":"2024-09-14T12:58:08.453389+0000","last_undegraded":"2024-09-14T12:58:08.453389+0000","last_fullsized":"2024-09-14T12:58:08.453389+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:08:24.757170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:08:24.757170+0000","last_clean_scrub_stamp":"2024-09-14T11:08:24.757170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:11:05.830604+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.11","version":"267'189","reported_seq":817,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:00:28.488041+0000","last_change":"2024-09-14T11:08:27.803446+0000","last_active":"2024-09-14T13:00:28.488041+0000","last_peered":"2024-09-14T13:00:28.488041+0000","last_clean":"2024-09-14T13:00:28.488041+0000","last_became_active":"2024-09-14T11:08:27.802742+0000","last_became_peered":"2024-09-14T11:08:27.802742+0000","last_unstale":"2024-09-14T13:00:28.488041+0000","last_undegraded":"2024-09-14T13:00:28.488041+0000","last_fullsized":"2024-09-14T13:00:28.488041+0000","mapping_epoch":30,"log_start":"264'100","ondisk_log_start":"264'100","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:08:26.771628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:08:26.771628+0000","last_clean_scrub_stamp":"2024-09-14T11:08:26.771628+0000","objects_scrubbed":0,"log_size":89,"log_dups_size":100,"ondisk_log_size":89,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:28:41.473997+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16980,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":257,"num_read_kb":338,"num_write":148,"num_write_kb":27,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":519,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:58:13.455830+0000","last_change":"2024-09-14T11:08:29.833602+0000","last_active":"2024-09-14T12:58:13.455830+0000","last_peered":"2024-09-14T12:58:13.455830+0000","last_clean":"2024-09-14T12:58:13.455830+0000","last_became_active":"2024-09-14T11:08:29.832866+0000","last_became_peered":"2024-09-14T11:08:29.832866+0000","last_unstale":"2024-09-14T12:58:13.455830+0000","last_undegraded":"2024-09-14T12:58:13.455830+0000","last_fullsized":"2024-09-14T12:58:13.455830+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:08:28.783586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:08:28.783586+0000","last_clean_scrub_stamp":"2024-09-14T11:08:28.783586+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:47:19.171157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1e","version":"267'153","reported_seq":732,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:00:21.213723+0000","last_change":"2024-09-14T11:08:31.838160+0000","last_active":"2024-09-14T13:00:21.213723+0000","last_peered":"2024-09-14T13:00:21.213723+0000","last_clean":"2024-09-14T13:00:21.213723+0000","last_became_active":"2024-09-14T11:08:31.837431+0000","last_became_peered":"2024-09-14T11:08:31.837431+0000","last_unstale":"2024-09-14T13:00:21.213723+0000","last_undegraded":"2024-09-14T13:00:21.213723+0000","last_fullsized":"2024-09-14T13:00:21.213723+0000","mapping_epoch":34,"log_start":"267'100","ondisk_log_start":"267'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:08:30.789404+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:08:30.789404+0000","last_clean_scrub_stamp":"2024-09-14T11:08:30.789404+0000","objects_scrubbed":0,"log_size":53,"log_dups_size":100,"ondisk_log_size":53,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:03:00.723612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":449,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":316,"num_read_kb":262,"num_write":344,"num_write_kb":81,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.12","version":"267'842","reported_seq":2487,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:00:18.885098+0000","last_change":"2024-09-14T11:08:23.805988+0000","last_active":"2024-09-14T13:00:18.885098+0000","last_peered":"2024-09-14T13:00:18.885098+0000","last_clean":"2024-09-14T13:00:18.885098+0000","last_became_active":"2024-09-14T11:08:23.805773+0000","last_became_peered":"2024-09-14T11:08:23.805773+0000","last_unstale":"2024-09-14T13:00:18.885098+0000","last_undegraded":"2024-09-14T13:00:18.885098+0000","last_fullsized":"2024-09-14T13:00:18.885098+0000","mapping_epoch":26,"log_start":"267'800","ondisk_log_start":"267'800","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:08:22.750609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:08:22.750609+0000","last_clean_scrub_stamp":"2024-09-14T11:08:22.750609+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":800,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:04:02.649234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":4345,"num_read_kb":3935,"num_write":1136,"num_write_kb":447,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"267'272","reported_seq":985,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:59:32.846092+0000","last_change":"2024-09-14T11:08:21.830655+0000","last_active":"2024-09-14T12:59:32.846092+0000","last_peered":"2024-09-14T12:59:32.846092+0000","last_clean":"2024-09-14T12:59:32.846092+0000","last_became_active":"2024-09-14T11:08:21.829412+0000","last_became_peered":"2024-09-14T11:08:21.829412+0000","last_unstale":"2024-09-14T12:59:32.846092+0000","last_undegraded":"2024-09-14T12:59:32.846092+0000","last_fullsized":"2024-09-14T12:59:32.846092+0000","mapping_epoch":24,"log_start":"267'200","ondisk_log_start":"267'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:08:20.733145+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:08:20.733145+0000","last_clean_scrub_stamp":"2024-09-14T11:08:20.733145+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":200,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:31:08.044755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":18530687,"num_objects":17,"num_object_clones":0,"num_object_copies":51,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":17,"num_whiteouts":0,"num_read":832,"num_read_kb":41720,"num_write":1207,"num_write_kb":52852,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,6],"acting":[7,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":527,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:58:08.454944+0000","last_change":"2024-09-14T11:08:25.800314+0000","last_active":"2024-09-14T12:58:08.454944+0000","last_peered":"2024-09-14T12:58:08.454944+0000","last_clean":"2024-09-14T12:58:08.454944+0000","last_became_active":"2024-09-14T11:08:25.799473+0000","last_became_peered":"2024-09-14T11:08:25.799473+0000","last_unstale":"2024-09-14T12:58:08.454944+0000","last_undegraded":"2024-09-14T12:58:08.454944+0000","last_fullsized":"2024-09-14T12:58:08.454944+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:08:24.757170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:08:24.757170+0000","last_clean_scrub_stamp":"2024-09-14T11:08:24.757170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:39:41.634975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"267'93","reported_seq":645,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:59:05.331375+0000","last_change":"2024-09-14T11:08:27.824140+0000","last_active":"2024-09-14T12:59:05.331375+0000","last_peered":"2024-09-14T12:59:05.331375+0000","last_clean":"2024-09-14T12:59:05.331375+0000","last_became_active":"2024-09-14T11:08:27.822933+0000","last_became_peered":"2024-09-14T11:08:27.822933+0000","last_unstale":"2024-09-14T12:59:05.331375+0000","last_undegraded":"2024-09-14T12:59:05.331375+0000","last_fullsized":"2024-09-14T12:59:05.331375+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:08:26.771628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:08:26.771628+0000","last_clean_scrub_stamp":"2024-09-14T11:08:26.771628+0000","objects_scrubbed":0,"log_size":93,"log_dups_size":0,"ondisk_log_size":93,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:18:09.511324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":83,"num_read_kb":77,"num_write":62,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":520,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:58:12.827302+0000","last_change":"2024-09-14T11:08:29.839496+0000","last_active":"2024-09-14T12:58:12.827302+0000","last_peered":"2024-09-14T12:58:12.827302+0000","last_clean":"2024-09-14T12:58:12.827302+0000","last_became_active":"2024-09-14T11:08:29.838784+0000","last_became_peered":"2024-09-14T11:08:29.838784+0000","last_unstale":"2024-09-14T12:58:12.827302+0000","last_undegraded":"2024-09-14T12:58:12.827302+0000","last_fullsized":"2024-09-14T12:58:12.827302+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:08:28.783586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:08:28.783586+0000","last_clean_scrub_stamp":"2024-09-14T11:08:28.783586+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:24:04.303207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1d","version":"267'173","reported_seq":722,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:00:18.909877+0000","last_change":"2024-09-14T11:08:31.835747+0000","last_active":"2024-09-14T13:00:18.909877+0000","last_peered":"2024-09-14T13:00:18.909877+0000","last_clean":"2024-09-14T13:00:18.909877+0000","last_became_active":"2024-09-14T11:08:31.835061+0000","last_became_peered":"2024-09-14T11:08:31.835061+0000","last_unstale":"2024-09-14T13:00:18.909877+0000","last_undegraded":"2024-09-14T13:00:18.909877+0000","last_fullsized":"2024-09-14T13:00:18.909877+0000","mapping_epoch":34,"log_start":"267'100","ondisk_log_start":"267'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:08:30.789404+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:08:30.789404+0000","last_clean_scrub_stamp":"2024-09-14T11:08:30.789404+0000","objects_scrubbed":0,"log_size":73,"log_dups_size":100,"ondisk_log_size":73,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:44:11.300438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":257,"num_read_kb":254,"num_write":377,"num_write_kb":108,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"267'371","reported_seq":1937,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:58:55.756948+0000","last_change":"2024-09-14T11:08:23.804035+0000","last_active":"2024-09-14T12:58:55.756948+0000","last_peered":"2024-09-14T12:58:55.756948+0000","last_clean":"2024-09-14T12:58:55.756948+0000","last_became_active":"2024-09-14T11:08:23.803793+0000","last_became_peered":"2024-09-14T11:08:23.803793+0000","last_unstale":"2024-09-14T12:58:55.756948+0000","last_undegraded":"2024-09-14T12:58:55.756948+0000","last_fullsized":"2024-09-14T12:58:55.756948+0000","mapping_epoch":26,"log_start":"267'300","ondisk_log_start":"267'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:08:22.750609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:08:22.750609+0000","last_clean_scrub_stamp":"2024-09-14T11:08:22.750609+0000","objects_scrubbed":0,"log_size":71,"log_dups_size":300,"ondisk_log_size":71,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:22:29.624328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":2158,"num_read_kb":2067,"num_write":426,"num_write_kb":77,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"267'195","reported_seq":845,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:59:33.055545+0000","last_change":"2024-09-14T11:08:21.797622+0000","last_active":"2024-09-14T12:59:33.055545+0000","last_peered":"2024-09-14T12:59:33.055545+0000","last_clean":"2024-09-14T12:59:33.055545+0000","last_became_active":"2024-09-14T11:08:21.796544+0000","last_became_peered":"2024-09-14T11:08:21.796544+0000","last_unstale":"2024-09-14T12:59:33.055545+0000","last_undegraded":"2024-09-14T12:59:33.055545+0000","last_fullsized":"2024-09-14T12:59:33.055545+0000","mapping_epoch":24,"log_start":"267'100","ondisk_log_start":"267'100","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:08:20.733145+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:08:20.733145+0000","last_clean_scrub_stamp":"2024-09-14T11:08:20.733145+0000","objects_scrubbed":0,"log_size":95,"log_dups_size":100,"ondisk_log_size":95,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:27:03.875493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":13958202,"num_objects":9,"num_object_clones":0,"num_object_copies":27,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":499,"num_read_kb":19523,"num_write":840,"num_write_kb":34711,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,1],"acting":[5,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":528,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:58:07.825909+0000","last_change":"2024-09-14T11:08:25.812807+0000","last_active":"2024-09-14T12:58:07.825909+0000","last_peered":"2024-09-14T12:58:07.825909+0000","last_clean":"2024-09-14T12:58:07.825909+0000","last_became_active":"2024-09-14T11:08:25.812065+0000","last_became_peered":"2024-09-14T11:08:25.812065+0000","last_unstale":"2024-09-14T12:58:07.825909+0000","last_undegraded":"2024-09-14T12:58:07.825909+0000","last_fullsized":"2024-09-14T12:58:07.825909+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:08:24.757170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:08:24.757170+0000","last_clean_scrub_stamp":"2024-09-14T11:08:24.757170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:55:26.884251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.13","version":"267'221","reported_seq":865,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:00:28.488111+0000","last_change":"2024-09-14T11:08:27.804649+0000","last_active":"2024-09-14T13:00:28.488111+0000","last_peered":"2024-09-14T13:00:28.488111+0000","last_clean":"2024-09-14T13:00:28.488111+0000","last_became_active":"2024-09-14T11:08:27.803857+0000","last_became_peered":"2024-09-14T11:08:27.803857+0000","last_unstale":"2024-09-14T13:00:28.488111+0000","last_undegraded":"2024-09-14T13:00:28.488111+0000","last_fullsized":"2024-09-14T13:00:28.488111+0000","mapping_epoch":30,"log_start":"267'200","ondisk_log_start":"267'200","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:08:26.771628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:08:26.771628+0000","last_clean_scrub_stamp":"2024-09-14T11:08:26.771628+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":200,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:04:38.254088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":26644,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":312,"num_read_kb":420,"num_write":186,"num_write_kb":45,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":518,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:58:13.419845+0000","last_change":"2024-09-14T11:08:29.831255+0000","last_active":"2024-09-14T12:58:13.419845+0000","last_peered":"2024-09-14T12:58:13.419845+0000","last_clean":"2024-09-14T12:58:13.419845+0000","last_became_active":"2024-09-14T11:08:29.830498+0000","last_became_peered":"2024-09-14T11:08:29.830498+0000","last_unstale":"2024-09-14T12:58:13.419845+0000","last_undegraded":"2024-09-14T12:58:13.419845+0000","last_fullsized":"2024-09-14T12:58:13.419845+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:08:28.783586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:08:28.783586+0000","last_clean_scrub_stamp":"2024-09-14T11:08:28.783586+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:03:30.379314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.1c","version":"267'123","reported_seq":663,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:00:18.860887+0000","last_change":"2024-09-14T11:08:31.830626+0000","last_active":"2024-09-14T13:00:18.860887+0000","last_peered":"2024-09-14T13:00:18.860887+0000","last_clean":"2024-09-14T13:00:18.860887+0000","last_became_active":"2024-09-14T11:08:31.829826+0000","last_became_peered":"2024-09-14T11:08:31.829826+0000","last_unstale":"2024-09-14T13:00:18.860887+0000","last_undegraded":"2024-09-14T13:00:18.860887+0000","last_fullsized":"2024-09-14T13:00:18.860887+0000","mapping_epoch":34,"log_start":"267'100","ondisk_log_start":"267'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:08:30.789404+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:08:30.789404+0000","last_clean_scrub_stamp":"2024-09-14T11:08:30.789404+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":100,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:25:54.911452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":861,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":146,"num_read_kb":140,"num_write":284,"num_write_kb":67,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"267'865","reported_seq":2531,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:59:18.397352+0000","last_change":"2024-09-14T11:08:23.781946+0000","last_active":"2024-09-14T12:59:18.397352+0000","last_peered":"2024-09-14T12:59:18.397352+0000","last_clean":"2024-09-14T12:59:18.397352+0000","last_became_active":"2024-09-14T11:08:23.781565+0000","last_became_peered":"2024-09-14T11:08:23.781565+0000","last_unstale":"2024-09-14T12:59:18.397352+0000","last_undegraded":"2024-09-14T12:59:18.397352+0000","last_fullsized":"2024-09-14T12:59:18.397352+0000","mapping_epoch":26,"log_start":"267'800","ondisk_log_start":"267'800","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:08:22.750609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:08:22.750609+0000","last_clean_scrub_stamp":"2024-09-14T11:08:22.750609+0000","objects_scrubbed":0,"log_size":65,"log_dups_size":800,"ondisk_log_size":65,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:59:20.533859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":4353,"num_read_kb":3923,"num_write":1159,"num_write_kb":442,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"267'270","reported_seq":947,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:59:33.252975+0000","last_change":"2024-09-14T11:08:21.781005+0000","last_active":"2024-09-14T12:59:33.252975+0000","last_peered":"2024-09-14T12:59:33.252975+0000","last_clean":"2024-09-14T12:59:33.252975+0000","last_became_active":"2024-09-14T11:08:21.780624+0000","last_became_peered":"2024-09-14T11:08:21.780624+0000","last_unstale":"2024-09-14T12:59:33.252975+0000","last_undegraded":"2024-09-14T12:59:33.252975+0000","last_fullsized":"2024-09-14T12:59:33.252975+0000","mapping_epoch":24,"log_start":"267'200","ondisk_log_start":"267'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:08:20.733145+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:08:20.733145+0000","last_clean_scrub_stamp":"2024-09-14T11:08:20.733145+0000","objects_scrubbed":0,"log_size":70,"log_dups_size":200,"ondisk_log_size":70,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:08:38.775663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9437199,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":684,"num_read_kb":19614,"num_write":1222,"num_write_kb":48256,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,3],"acting":[0,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":526,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:58:08.418774+0000","last_change":"2024-09-14T11:08:25.815688+0000","last_active":"2024-09-14T12:58:08.418774+0000","last_peered":"2024-09-14T12:58:08.418774+0000","last_clean":"2024-09-14T12:58:08.418774+0000","last_became_active":"2024-09-14T11:08:25.812705+0000","last_became_peered":"2024-09-14T11:08:25.812705+0000","last_unstale":"2024-09-14T12:58:08.418774+0000","last_undegraded":"2024-09-14T12:58:08.418774+0000","last_fullsized":"2024-09-14T12:58:08.418774+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:08:24.757170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:08:24.757170+0000","last_clean_scrub_stamp":"2024-09-14T11:08:24.757170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:14:07.091473+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.12","version":"267'165","reported_seq":782,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:00:27.858784+0000","last_change":"2024-09-14T11:08:27.828831+0000","last_active":"2024-09-14T13:00:27.858784+0000","last_peered":"2024-09-14T13:00:27.858784+0000","last_clean":"2024-09-14T13:00:27.858784+0000","last_became_active":"2024-09-14T11:08:27.828095+0000","last_became_peered":"2024-09-14T11:08:27.828095+0000","last_unstale":"2024-09-14T13:00:27.858784+0000","last_undegraded":"2024-09-14T13:00:27.858784+0000","last_fullsized":"2024-09-14T13:00:27.858784+0000","mapping_epoch":30,"log_start":"267'100","ondisk_log_start":"267'100","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:08:26.771628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:08:26.771628+0000","last_clean_scrub_stamp":"2024-09-14T11:08:26.771628+0000","objects_scrubbed":0,"log_size":65,"log_dups_size":100,"ondisk_log_size":65,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:20:07.611701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12385,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":216,"num_read_kb":264,"num_write":122,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":524,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:58:13.451397+0000","last_change":"2024-09-14T11:08:29.820892+0000","last_active":"2024-09-14T12:58:13.451397+0000","last_peered":"2024-09-14T12:58:13.451397+0000","last_clean":"2024-09-14T12:58:13.451397+0000","last_became_active":"2024-09-14T11:08:29.820211+0000","last_became_peered":"2024-09-14T11:08:29.820211+0000","last_unstale":"2024-09-14T12:58:13.451397+0000","last_undegraded":"2024-09-14T12:58:13.451397+0000","last_fullsized":"2024-09-14T12:58:13.451397+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:08:28.783586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:08:28.783586+0000","last_clean_scrub_stamp":"2024-09-14T11:08:28.783586+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:44:35.393022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"267'407","reported_seq":1915,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:58:53.428747+0000","last_change":"2024-09-14T11:08:23.812883+0000","last_active":"2024-09-14T12:58:53.428747+0000","last_peered":"2024-09-14T12:58:53.428747+0000","last_clean":"2024-09-14T12:58:53.428747+0000","last_became_active":"2024-09-14T11:08:23.812148+0000","last_became_peered":"2024-09-14T11:08:23.812148+0000","last_unstale":"2024-09-14T12:58:53.428747+0000","last_undegraded":"2024-09-14T12:58:53.428747+0000","last_fullsized":"2024-09-14T12:58:53.428747+0000","mapping_epoch":26,"log_start":"267'300","ondisk_log_start":"267'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:08:22.750609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:08:22.750609+0000","last_clean_scrub_stamp":"2024-09-14T11:08:22.750609+0000","objects_scrubbed":0,"log_size":107,"log_dups_size":300,"ondisk_log_size":107,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:08:40.793127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2189,"num_read_kb":2068,"num_write":470,"num_write_kb":97,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"267'245","reported_seq":1141,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:59:33.474826+0000","last_change":"2024-09-14T11:08:21.779317+0000","last_active":"2024-09-14T12:59:33.474826+0000","last_peered":"2024-09-14T12:59:33.474826+0000","last_clean":"2024-09-14T12:59:33.474826+0000","last_became_active":"2024-09-14T11:08:21.778733+0000","last_became_peered":"2024-09-14T11:08:21.778733+0000","last_unstale":"2024-09-14T12:59:33.474826+0000","last_undegraded":"2024-09-14T12:59:33.474826+0000","last_fullsized":"2024-09-14T12:59:33.474826+0000","mapping_epoch":24,"log_start":"267'200","ondisk_log_start":"267'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:08:20.733145+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:08:20.733145+0000","last_clean_scrub_stamp":"2024-09-14T11:08:20.733145+0000","objects_scrubbed":0,"log_size":45,"log_dups_size":200,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:00:30.423894+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1056249,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1355,"num_read_kb":10917,"num_write":1155,"num_write_kb":41642,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":540,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:58:53.242713+0000","last_change":"2024-09-14T11:08:25.800737+0000","last_active":"2024-09-14T12:58:53.242713+0000","last_peered":"2024-09-14T12:58:53.242713+0000","last_clean":"2024-09-14T12:58:53.242713+0000","last_became_active":"2024-09-14T11:08:25.799108+0000","last_became_peered":"2024-09-14T11:08:25.799108+0000","last_unstale":"2024-09-14T12:58:53.242713+0000","last_undegraded":"2024-09-14T12:58:53.242713+0000","last_fullsized":"2024-09-14T12:58:53.242713+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:08:24.757170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:08:24.757170+0000","last_clean_scrub_stamp":"2024-09-14T11:08:24.757170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:38:33.841462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1d","version":"267'244","reported_seq":911,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:01:40.556399+0000","last_change":"2024-09-14T11:08:27.831458+0000","last_active":"2024-09-14T13:01:40.556399+0000","last_peered":"2024-09-14T13:01:40.556399+0000","last_clean":"2024-09-14T13:01:40.556399+0000","last_became_active":"2024-09-14T11:08:27.830985+0000","last_became_peered":"2024-09-14T11:08:27.830985+0000","last_unstale":"2024-09-14T13:01:40.556399+0000","last_undegraded":"2024-09-14T13:01:40.556399+0000","last_fullsized":"2024-09-14T13:01:40.556399+0000","mapping_epoch":30,"log_start":"267'200","ondisk_log_start":"267'200","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:08:26.771628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:08:26.771628+0000","last_clean_scrub_stamp":"2024-09-14T11:08:26.771628+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":200,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:41:33.796426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":37874,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":369,"num_read_kb":532,"num_write":248,"num_write_kb":156,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":516,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:58:33.042183+0000","last_change":"2024-09-14T11:08:29.835460+0000","last_active":"2024-09-14T12:58:33.042183+0000","last_peered":"2024-09-14T12:58:33.042183+0000","last_clean":"2024-09-14T12:58:33.042183+0000","last_became_active":"2024-09-14T11:08:29.834723+0000","last_became_peered":"2024-09-14T11:08:29.834723+0000","last_unstale":"2024-09-14T12:58:33.042183+0000","last_undegraded":"2024-09-14T12:58:33.042183+0000","last_fullsized":"2024-09-14T12:58:33.042183+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:08:28.783586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:08:28.783586+0000","last_clean_scrub_stamp":"2024-09-14T11:08:28.783586+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:14:47.793017+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.13","version":"267'169","reported_seq":705,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:00:21.576865+0000","last_change":"2024-09-14T11:08:31.838236+0000","last_active":"2024-09-14T13:00:21.576865+0000","last_peered":"2024-09-14T13:00:21.576865+0000","last_clean":"2024-09-14T13:00:21.576865+0000","last_became_active":"2024-09-14T11:08:31.832337+0000","last_became_peered":"2024-09-14T11:08:31.832337+0000","last_unstale":"2024-09-14T13:00:21.576865+0000","last_undegraded":"2024-09-14T13:00:21.576865+0000","last_fullsized":"2024-09-14T13:00:21.576865+0000","mapping_epoch":34,"log_start":"267'100","ondisk_log_start":"267'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:08:30.789404+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:08:30.789404+0000","last_clean_scrub_stamp":"2024-09-14T11:08:30.789404+0000","objects_scrubbed":0,"log_size":69,"log_dups_size":100,"ondisk_log_size":69,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:59:18.877729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":643,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":222,"num_read_kb":226,"num_write":392,"num_write_kb":102,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"267'412","reported_seq":2030,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:00:18.882268+0000","last_change":"2024-09-14T11:08:23.800932+0000","last_active":"2024-09-14T13:00:18.882268+0000","last_peered":"2024-09-14T13:00:18.882268+0000","last_clean":"2024-09-14T13:00:18.882268+0000","last_became_active":"2024-09-14T11:08:23.800615+0000","last_became_peered":"2024-09-14T11:08:23.800615+0000","last_unstale":"2024-09-14T13:00:18.882268+0000","last_undegraded":"2024-09-14T13:00:18.882268+0000","last_fullsized":"2024-09-14T13:00:18.882268+0000","mapping_epoch":26,"log_start":"267'400","ondisk_log_start":"267'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:08:22.750609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:08:22.750609+0000","last_clean_scrub_stamp":"2024-09-14T11:08:22.750609+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":400,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:50:24.635644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2239,"num_read_kb":2142,"num_write":466,"num_write_kb":81,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"267'237","reported_seq":915,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:57:23.443592+0000","last_change":"2024-09-14T11:08:56.037070+0000","last_active":"2024-09-14T12:57:23.443592+0000","last_peered":"2024-09-14T12:57:23.443592+0000","last_clean":"2024-09-14T12:57:23.443592+0000","last_became_active":"2024-09-14T11:08:56.036673+0000","last_became_peered":"2024-09-14T11:08:56.036673+0000","last_unstale":"2024-09-14T12:57:23.443592+0000","last_undegraded":"2024-09-14T12:57:23.443592+0000","last_fullsized":"2024-09-14T12:57:23.443592+0000","mapping_epoch":37,"log_start":"267'200","ondisk_log_start":"267'200","created":24,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:08:20.733145+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:08:20.733145+0000","last_clean_scrub_stamp":"2024-09-14T11:08:20.733145+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":200,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:53:45.772203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":13956195,"num_objects":9,"num_object_clones":0,"num_object_copies":27,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":561,"num_read_kb":38876,"num_write":1046,"num_write_kb":52722,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,4],"acting":[1,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1f","version":"36'3","reported_seq":1007,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:01:40.257081+0000","last_change":"2024-09-14T11:08:25.812880+0000","last_active":"2024-09-14T13:01:40.257081+0000","last_peered":"2024-09-14T13:01:40.257081+0000","last_clean":"2024-09-14T13:01:40.257081+0000","last_became_active":"2024-09-14T11:08:25.812070+0000","last_became_peered":"2024-09-14T11:08:25.812070+0000","last_unstale":"2024-09-14T13:01:40.257081+0000","last_undegraded":"2024-09-14T13:01:40.257081+0000","last_fullsized":"2024-09-14T13:01:40.257081+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:08:24.757170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:08:24.757170+0000","last_clean_scrub_stamp":"2024-09-14T11:08:24.757170+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:17:44.680400+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":470,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":716,"num_read_kb":714,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1c","version":"267'278","reported_seq":928,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:00:57.866110+0000","last_change":"2024-09-14T11:08:27.839908+0000","last_active":"2024-09-14T13:00:57.866110+0000","last_peered":"2024-09-14T13:00:57.866110+0000","last_clean":"2024-09-14T13:00:57.866110+0000","last_became_active":"2024-09-14T11:08:27.839087+0000","last_became_peered":"2024-09-14T11:08:27.839087+0000","last_unstale":"2024-09-14T13:00:57.866110+0000","last_undegraded":"2024-09-14T13:00:57.866110+0000","last_fullsized":"2024-09-14T13:00:57.866110+0000","mapping_epoch":30,"log_start":"267'200","ondisk_log_start":"267'200","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:08:26.771628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:08:26.771628+0000","last_clean_scrub_stamp":"2024-09-14T11:08:26.771628+0000","objects_scrubbed":0,"log_size":78,"log_dups_size":200,"ondisk_log_size":78,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:00:36.558492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":105945,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":422,"num_read_kb":775,"num_write":312,"num_write_kb":214,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":514,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:58:33.459006+0000","last_change":"2024-09-14T11:08:29.829340+0000","last_active":"2024-09-14T12:58:33.459006+0000","last_peered":"2024-09-14T12:58:33.459006+0000","last_clean":"2024-09-14T12:58:33.459006+0000","last_became_active":"2024-09-14T11:08:29.828451+0000","last_became_peered":"2024-09-14T11:08:29.828451+0000","last_unstale":"2024-09-14T12:58:33.459006+0000","last_undegraded":"2024-09-14T12:58:33.459006+0000","last_fullsized":"2024-09-14T12:58:33.459006+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:08:28.783586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:08:28.783586+0000","last_clean_scrub_stamp":"2024-09-14T11:08:28.783586+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:33:41.255469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.12","version":"267'201","reported_seq":1100,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:00:21.559424+0000","last_change":"2024-09-14T11:08:31.855543+0000","last_active":"2024-09-14T13:00:21.559424+0000","last_peered":"2024-09-14T13:00:21.559424+0000","last_clean":"2024-09-14T13:00:21.559424+0000","last_became_active":"2024-09-14T11:08:31.854650+0000","last_became_peered":"2024-09-14T11:08:31.854650+0000","last_unstale":"2024-09-14T13:00:21.559424+0000","last_undegraded":"2024-09-14T13:00:21.559424+0000","last_fullsized":"2024-09-14T13:00:21.559424+0000","mapping_epoch":34,"log_start":"267'100","ondisk_log_start":"267'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:08:30.789404+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:08:30.789404+0000","last_clean_scrub_stamp":"2024-09-14T11:08:30.789404+0000","objects_scrubbed":0,"log_size":101,"log_dups_size":100,"ondisk_log_size":101,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:48:10.230125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1218,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":620,"num_read_kb":614,"num_write":555,"num_write_kb":141,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1d","version":"267'642","reported_seq":2438,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:00:21.249855+0000","last_change":"2024-09-14T11:08:23.779484+0000","last_active":"2024-09-14T13:00:21.249855+0000","last_peered":"2024-09-14T13:00:21.249855+0000","last_clean":"2024-09-14T13:00:21.249855+0000","last_became_active":"2024-09-14T11:08:23.779099+0000","last_became_peered":"2024-09-14T11:08:23.779099+0000","last_unstale":"2024-09-14T13:00:21.249855+0000","last_undegraded":"2024-09-14T13:00:21.249855+0000","last_fullsized":"2024-09-14T13:00:21.249855+0000","mapping_epoch":26,"log_start":"267'600","ondisk_log_start":"267'600","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:08:22.750609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:08:22.750609+0000","last_clean_scrub_stamp":"2024-09-14T11:08:22.750609+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":600,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:46:50.857933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3438,"num_read_kb":3161,"num_write":830,"num_write_kb":293,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"267'240","reported_seq":1020,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:58:23.224184+0000","last_change":"2024-09-14T11:08:21.824714+0000","last_active":"2024-09-14T12:58:23.224184+0000","last_peered":"2024-09-14T12:58:23.224184+0000","last_clean":"2024-09-14T12:58:23.224184+0000","last_became_active":"2024-09-14T11:08:21.822349+0000","last_became_peered":"2024-09-14T11:08:21.822349+0000","last_unstale":"2024-09-14T12:58:23.224184+0000","last_undegraded":"2024-09-14T12:58:23.224184+0000","last_fullsized":"2024-09-14T12:58:23.224184+0000","mapping_epoch":24,"log_start":"267'200","ondisk_log_start":"267'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:08:20.733145+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:08:20.733145+0000","last_clean_scrub_stamp":"2024-09-14T11:08:20.733145+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":200,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:37:27.709472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9045724,"num_objects":9,"num_object_clones":0,"num_object_copies":27,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":1326,"num_read_kb":40981,"num_write":1067,"num_write_kb":33045,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,5],"acting":[4,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":526,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:58:28.225640+0000","last_change":"2024-09-14T11:08:25.808861+0000","last_active":"2024-09-14T12:58:28.225640+0000","last_peered":"2024-09-14T12:58:28.225640+0000","last_clean":"2024-09-14T12:58:28.225640+0000","last_became_active":"2024-09-14T11:08:25.807820+0000","last_became_peered":"2024-09-14T11:08:25.807820+0000","last_unstale":"2024-09-14T12:58:28.225640+0000","last_undegraded":"2024-09-14T12:58:28.225640+0000","last_fullsized":"2024-09-14T12:58:28.225640+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:08:24.757170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:08:24.757170+0000","last_clean_scrub_stamp":"2024-09-14T11:08:24.757170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:21:06.537600+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1f","version":"267'197","reported_seq":832,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:00:58.494549+0000","last_change":"2024-09-14T11:08:27.799774+0000","last_active":"2024-09-14T13:00:58.494549+0000","last_peered":"2024-09-14T13:00:58.494549+0000","last_clean":"2024-09-14T13:00:58.494549+0000","last_became_active":"2024-09-14T11:08:27.799019+0000","last_became_peered":"2024-09-14T11:08:27.799019+0000","last_unstale":"2024-09-14T13:00:58.494549+0000","last_undegraded":"2024-09-14T13:00:58.494549+0000","last_fullsized":"2024-09-14T13:00:58.494549+0000","mapping_epoch":30,"log_start":"264'100","ondisk_log_start":"264'100","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:08:26.771628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:08:26.771628+0000","last_clean_scrub_stamp":"2024-09-14T11:08:26.771628+0000","objects_scrubbed":0,"log_size":97,"log_dups_size":100,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:29:21.400017+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":15034,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":258,"num_read_kb":328,"num_write":152,"num_write_kb":25,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":525,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:58:48.462484+0000","last_change":"2024-09-14T11:08:29.821376+0000","last_active":"2024-09-14T12:58:48.462484+0000","last_peered":"2024-09-14T12:58:48.462484+0000","last_clean":"2024-09-14T12:58:48.462484+0000","last_became_active":"2024-09-14T11:08:29.820658+0000","last_became_peered":"2024-09-14T11:08:29.820658+0000","last_unstale":"2024-09-14T12:58:48.462484+0000","last_undegraded":"2024-09-14T12:58:48.462484+0000","last_fullsized":"2024-09-14T12:58:48.462484+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:08:28.783586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:08:28.783586+0000","last_clean_scrub_stamp":"2024-09-14T11:08:28.783586+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:41:05.714746+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.11","version":"267'134","reported_seq":664,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:01:40.625798+0000","last_change":"2024-09-14T11:08:31.837211+0000","last_active":"2024-09-14T13:01:40.625798+0000","last_peered":"2024-09-14T13:01:40.625798+0000","last_clean":"2024-09-14T13:01:40.625798+0000","last_became_active":"2024-09-14T11:08:31.836424+0000","last_became_peered":"2024-09-14T11:08:31.836424+0000","last_unstale":"2024-09-14T13:01:40.625798+0000","last_undegraded":"2024-09-14T13:01:40.625798+0000","last_fullsized":"2024-09-14T13:01:40.625798+0000","mapping_epoch":34,"log_start":"267'100","ondisk_log_start":"267'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:08:30.789404+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:08:30.789404+0000","last_clean_scrub_stamp":"2024-09-14T11:08:30.789404+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":100,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:24:20.926458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":383,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":163,"num_read_kb":148,"num_write":342,"num_write_kb":82,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1c","version":"267'437","reported_seq":2094,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:00:21.259107+0000","last_change":"2024-09-14T11:08:23.775989+0000","last_active":"2024-09-14T13:00:21.259107+0000","last_peered":"2024-09-14T13:00:21.259107+0000","last_clean":"2024-09-14T13:00:21.259107+0000","last_became_active":"2024-09-14T11:08:23.775491+0000","last_became_peered":"2024-09-14T11:08:23.775491+0000","last_unstale":"2024-09-14T13:00:21.259107+0000","last_undegraded":"2024-09-14T13:00:21.259107+0000","last_fullsized":"2024-09-14T13:00:21.259107+0000","mapping_epoch":26,"log_start":"267'400","ondisk_log_start":"267'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:08:22.750609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:08:22.750609+0000","last_clean_scrub_stamp":"2024-09-14T11:08:22.750609+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":400,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:48:28.960871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2479,"num_read_kb":2350,"num_write":502,"num_write_kb":107,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"267'217","reported_seq":844,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:58:57.827849+0000","last_change":"2024-09-14T11:08:56.034799+0000","last_active":"2024-09-14T12:58:57.827849+0000","last_peered":"2024-09-14T12:58:57.827849+0000","last_clean":"2024-09-14T12:58:57.827849+0000","last_became_active":"2024-09-14T11:08:56.033894+0000","last_became_peered":"2024-09-14T11:08:56.033894+0000","last_unstale":"2024-09-14T12:58:57.827849+0000","last_undegraded":"2024-09-14T12:58:57.827849+0000","last_fullsized":"2024-09-14T12:58:57.827849+0000","mapping_epoch":37,"log_start":"267'200","ondisk_log_start":"267'200","created":24,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:08:20.733145+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:08:20.733145+0000","last_clean_scrub_stamp":"2024-09-14T11:08:20.733145+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":200,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:50:48.318805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10489866,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":535,"num_read_kb":17888,"num_write":1017,"num_write_kb":32755,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4,7],"acting":[2,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":521,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:58:28.457976+0000","last_change":"2024-09-14T11:08:25.804776+0000","last_active":"2024-09-14T12:58:28.457976+0000","last_peered":"2024-09-14T12:58:28.457976+0000","last_clean":"2024-09-14T12:58:28.457976+0000","last_became_active":"2024-09-14T11:08:25.804388+0000","last_became_peered":"2024-09-14T11:08:25.804388+0000","last_unstale":"2024-09-14T12:58:28.457976+0000","last_undegraded":"2024-09-14T12:58:28.457976+0000","last_fullsized":"2024-09-14T12:58:28.457976+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:08:24.757170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:08:24.757170+0000","last_clean_scrub_stamp":"2024-09-14T11:08:24.757170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:03:59.400683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1e","version":"267'168","reported_seq":761,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:59:08.616998+0000","last_change":"2024-09-14T11:08:27.832039+0000","last_active":"2024-09-14T12:59:08.616998+0000","last_peered":"2024-09-14T12:59:08.616998+0000","last_clean":"2024-09-14T12:59:08.616998+0000","last_became_active":"2024-09-14T11:08:27.830708+0000","last_became_peered":"2024-09-14T11:08:27.830708+0000","last_unstale":"2024-09-14T12:59:08.616998+0000","last_undegraded":"2024-09-14T12:59:08.616998+0000","last_fullsized":"2024-09-14T12:59:08.616998+0000","mapping_epoch":30,"log_start":"267'100","ondisk_log_start":"267'100","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:08:26.771628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:08:26.771628+0000","last_clean_scrub_stamp":"2024-09-14T11:08:26.771628+0000","objects_scrubbed":0,"log_size":68,"log_dups_size":100,"ondisk_log_size":68,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:26:51.532445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":224,"num_read_kb":219,"num_write":208,"num_write_kb":88,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1f","version":"267'766","reported_seq":3154,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:01:40.710554+0000","last_change":"2024-09-14T11:08:29.842740+0000","last_active":"2024-09-14T13:01:40.710554+0000","last_peered":"2024-09-14T13:01:40.710554+0000","last_clean":"2024-09-14T13:01:40.710554+0000","last_became_active":"2024-09-14T11:08:29.840179+0000","last_became_peered":"2024-09-14T11:08:29.840179+0000","last_unstale":"2024-09-14T13:01:40.710554+0000","last_undegraded":"2024-09-14T13:01:40.710554+0000","last_fullsized":"2024-09-14T13:01:40.710554+0000","mapping_epoch":32,"log_start":"267'701","ondisk_log_start":"267'701","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:08:28.783586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:08:28.783586+0000","last_clean_scrub_stamp":"2024-09-14T11:08:28.783586+0000","objects_scrubbed":0,"log_size":65,"log_dups_size":701,"ondisk_log_size":65,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:13:51.334108+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.10","version":"267'110","reported_seq":636,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:00:11.280385+0000","last_change":"2024-09-14T11:08:31.839459+0000","last_active":"2024-09-14T13:00:11.280385+0000","last_peered":"2024-09-14T13:00:11.280385+0000","last_clean":"2024-09-14T13:00:11.280385+0000","last_became_active":"2024-09-14T11:08:31.838761+0000","last_became_peered":"2024-09-14T11:08:31.838761+0000","last_unstale":"2024-09-14T13:00:11.280385+0000","last_undegraded":"2024-09-14T13:00:11.280385+0000","last_fullsized":"2024-09-14T13:00:11.280385+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:08:30.789404+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:08:30.789404+0000","last_clean_scrub_stamp":"2024-09-14T11:08:30.789404+0000","objects_scrubbed":0,"log_size":110,"log_dups_size":0,"ondisk_log_size":110,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:37:29.125988+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":418,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":108,"num_read_kb":106,"num_write":270,"num_write_kb":60,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1b","version":"267'384","reported_seq":1848,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:00:21.253052+0000","last_change":"2024-09-14T11:08:23.793363+0000","last_active":"2024-09-14T13:00:21.253052+0000","last_peered":"2024-09-14T13:00:21.253052+0000","last_clean":"2024-09-14T13:00:21.253052+0000","last_became_active":"2024-09-14T11:08:23.791753+0000","last_became_peered":"2024-09-14T11:08:23.791753+0000","last_unstale":"2024-09-14T13:00:21.253052+0000","last_undegraded":"2024-09-14T13:00:21.253052+0000","last_fullsized":"2024-09-14T13:00:21.253052+0000","mapping_epoch":26,"log_start":"267'300","ondisk_log_start":"267'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:08:22.750609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:08:22.750609+0000","last_clean_scrub_stamp":"2024-09-14T11:08:22.750609+0000","objects_scrubbed":0,"log_size":84,"log_dups_size":300,"ondisk_log_size":84,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:05:59.318543+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2049,"num_read_kb":1937,"num_write":432,"num_write_kb":84,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1c","version":"267'208","reported_seq":864,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:01:38.481476+0000","last_change":"2024-09-14T11:08:21.826647+0000","last_active":"2024-09-14T13:01:38.481476+0000","last_peered":"2024-09-14T13:01:38.481476+0000","last_clean":"2024-09-14T13:01:38.481476+0000","last_became_active":"2024-09-14T11:08:21.825881+0000","last_became_peered":"2024-09-14T11:08:21.825881+0000","last_unstale":"2024-09-14T13:01:38.481476+0000","last_undegraded":"2024-09-14T13:01:38.481476+0000","last_fullsized":"2024-09-14T13:01:38.481476+0000","mapping_epoch":24,"log_start":"267'100","ondisk_log_start":"267'100","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:08:20.733145+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:08:20.733145+0000","last_clean_scrub_stamp":"2024-09-14T11:08:20.733145+0000","objects_scrubbed":0,"log_size":108,"log_dups_size":100,"ondisk_log_size":108,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:50:22.513817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":14568498,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":550,"num_read_kb":34621,"num_write":944,"num_write_kb":21560,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":525,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:58:27.830750+0000","last_change":"2024-09-14T11:08:25.822606+0000","last_active":"2024-09-14T12:58:27.830750+0000","last_peered":"2024-09-14T12:58:27.830750+0000","last_clean":"2024-09-14T12:58:27.830750+0000","last_became_active":"2024-09-14T11:08:25.822047+0000","last_became_peered":"2024-09-14T11:08:25.822047+0000","last_unstale":"2024-09-14T12:58:27.830750+0000","last_undegraded":"2024-09-14T12:58:27.830750+0000","last_fullsized":"2024-09-14T12:58:27.830750+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:08:24.757170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:08:24.757170+0000","last_clean_scrub_stamp":"2024-09-14T11:08:24.757170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:17:43.121390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.19","version":"267'258","reported_seq":908,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:01:39.437504+0000","last_change":"2024-09-14T11:08:27.825245+0000","last_active":"2024-09-14T13:01:39.437504+0000","last_peered":"2024-09-14T13:01:39.437504+0000","last_clean":"2024-09-14T13:01:39.437504+0000","last_became_active":"2024-09-14T11:08:27.824464+0000","last_became_peered":"2024-09-14T11:08:27.824464+0000","last_unstale":"2024-09-14T13:01:39.437504+0000","last_undegraded":"2024-09-14T13:01:39.437504+0000","last_fullsized":"2024-09-14T13:01:39.437504+0000","mapping_epoch":30,"log_start":"267'200","ondisk_log_start":"267'200","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:08:26.771628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:08:26.771628+0000","last_clean_scrub_stamp":"2024-09-14T11:08:26.771628+0000","objects_scrubbed":0,"log_size":58,"log_dups_size":200,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:54:45.692895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":17424,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":341,"num_read_kb":416,"num_write":210,"num_write_kb":31,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":522,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:57:18.438460+0000","last_change":"2024-09-14T11:08:29.823349+0000","last_active":"2024-09-14T12:57:18.438460+0000","last_peered":"2024-09-14T12:57:18.438460+0000","last_clean":"2024-09-14T12:57:18.438460+0000","last_became_active":"2024-09-14T11:08:29.822623+0000","last_became_peered":"2024-09-14T11:08:29.822623+0000","last_unstale":"2024-09-14T12:57:18.438460+0000","last_undegraded":"2024-09-14T12:57:18.438460+0000","last_fullsized":"2024-09-14T12:57:18.438460+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:08:28.783586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:08:28.783586+0000","last_clean_scrub_stamp":"2024-09-14T11:08:28.783586+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:00:40.714545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.17","version":"267'127","reported_seq":653,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:59:42.848452+0000","last_change":"2024-09-14T11:08:31.859123+0000","last_active":"2024-09-14T12:59:42.848452+0000","last_peered":"2024-09-14T12:59:42.848452+0000","last_clean":"2024-09-14T12:59:42.848452+0000","last_became_active":"2024-09-14T11:08:31.858388+0000","last_became_peered":"2024-09-14T11:08:31.858388+0000","last_unstale":"2024-09-14T12:59:42.848452+0000","last_undegraded":"2024-09-14T12:59:42.848452+0000","last_fullsized":"2024-09-14T12:59:42.848452+0000","mapping_epoch":34,"log_start":"267'100","ondisk_log_start":"267'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:08:30.789404+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:08:30.789404+0000","last_clean_scrub_stamp":"2024-09-14T11:08:30.789404+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":100,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:58:20.561191+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":200,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":125,"num_read_kb":119,"num_write":310,"num_write_kb":73,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1a","version":"267'851","reported_seq":2570,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:59:14.733144+0000","last_change":"2024-09-14T11:08:23.794792+0000","last_active":"2024-09-14T12:59:14.733144+0000","last_peered":"2024-09-14T12:59:14.733144+0000","last_clean":"2024-09-14T12:59:14.733144+0000","last_became_active":"2024-09-14T11:08:23.793908+0000","last_became_peered":"2024-09-14T11:08:23.793908+0000","last_unstale":"2024-09-14T12:59:14.733144+0000","last_undegraded":"2024-09-14T12:59:14.733144+0000","last_fullsized":"2024-09-14T12:59:14.733144+0000","mapping_epoch":26,"log_start":"267'800","ondisk_log_start":"267'800","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:08:22.750609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:08:22.750609+0000","last_clean_scrub_stamp":"2024-09-14T11:08:22.750609+0000","objects_scrubbed":0,"log_size":51,"log_dups_size":800,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:05:29.558132+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":4233,"num_read_kb":3837,"num_write":1135,"num_write_kb":419,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1d","version":"267'244","reported_seq":925,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:58:23.039867+0000","last_change":"2024-09-14T11:08:21.821524+0000","last_active":"2024-09-14T12:58:23.039867+0000","last_peered":"2024-09-14T12:58:23.039867+0000","last_clean":"2024-09-14T12:58:23.039867+0000","last_became_active":"2024-09-14T11:08:21.820805+0000","last_became_peered":"2024-09-14T11:08:21.820805+0000","last_unstale":"2024-09-14T12:58:23.039867+0000","last_undegraded":"2024-09-14T12:58:23.039867+0000","last_fullsized":"2024-09-14T12:58:23.039867+0000","mapping_epoch":24,"log_start":"267'200","ondisk_log_start":"267'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:08:20.733145+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:08:20.733145+0000","last_clean_scrub_stamp":"2024-09-14T11:08:20.733145+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":200,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:37:46.552173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6301751,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":692,"num_read_kb":13918,"num_write":1165,"num_write_kb":29151,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":524,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:58:28.040986+0000","last_change":"2024-09-14T11:08:25.802519+0000","last_active":"2024-09-14T12:58:28.040986+0000","last_peered":"2024-09-14T12:58:28.040986+0000","last_clean":"2024-09-14T12:58:28.040986+0000","last_became_active":"2024-09-14T11:08:25.801548+0000","last_became_peered":"2024-09-14T11:08:25.801548+0000","last_unstale":"2024-09-14T12:58:28.040986+0000","last_undegraded":"2024-09-14T12:58:28.040986+0000","last_fullsized":"2024-09-14T12:58:28.040986+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:08:24.757170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:08:24.757170+0000","last_clean_scrub_stamp":"2024-09-14T11:08:24.757170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:47:07.228076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.18","version":"267'176","reported_seq":795,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:59:38.254026+0000","last_change":"2024-09-14T11:08:27.815657+0000","last_active":"2024-09-14T12:59:38.254026+0000","last_peered":"2024-09-14T12:59:38.254026+0000","last_clean":"2024-09-14T12:59:38.254026+0000","last_became_active":"2024-09-14T11:08:27.814938+0000","last_became_peered":"2024-09-14T11:08:27.814938+0000","last_unstale":"2024-09-14T12:59:38.254026+0000","last_undegraded":"2024-09-14T12:59:38.254026+0000","last_fullsized":"2024-09-14T12:59:38.254026+0000","mapping_epoch":30,"log_start":"264'100","ondisk_log_start":"264'100","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:08:26.771628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:08:26.771628+0000","last_clean_scrub_stamp":"2024-09-14T11:08:26.771628+0000","objects_scrubbed":0,"log_size":76,"log_dups_size":100,"ondisk_log_size":76,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:15:03.277896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":33662,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":230,"num_read_kb":357,"num_write":134,"num_write_kb":53,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":516,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:57:33.603105+0000","last_change":"2024-09-14T11:08:29.836990+0000","last_active":"2024-09-14T12:57:33.603105+0000","last_peered":"2024-09-14T12:57:33.603105+0000","last_clean":"2024-09-14T12:57:33.603105+0000","last_became_active":"2024-09-14T11:08:29.829491+0000","last_became_peered":"2024-09-14T11:08:29.829491+0000","last_unstale":"2024-09-14T12:57:33.603105+0000","last_undegraded":"2024-09-14T12:57:33.603105+0000","last_fullsized":"2024-09-14T12:57:33.603105+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:08:28.783586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:08:28.783586+0000","last_clean_scrub_stamp":"2024-09-14T11:08:28.783586+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:58:11.838583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.16","version":"267'128","reported_seq":682,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:58:21.393905+0000","last_change":"2024-09-14T11:08:31.838739+0000","last_active":"2024-09-14T12:58:21.393905+0000","last_peered":"2024-09-14T12:58:21.393905+0000","last_clean":"2024-09-14T12:58:21.393905+0000","last_became_active":"2024-09-14T11:08:31.832264+0000","last_became_peered":"2024-09-14T11:08:31.832264+0000","last_unstale":"2024-09-14T12:58:21.393905+0000","last_undegraded":"2024-09-14T12:58:21.393905+0000","last_fullsized":"2024-09-14T12:58:21.393905+0000","mapping_epoch":34,"log_start":"267'100","ondisk_log_start":"267'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:08:30.789404+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:08:30.789404+0000","last_clean_scrub_stamp":"2024-09-14T11:08:30.789404+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":100,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:40:25.298343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":539,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":196,"num_read_kb":188,"num_write":306,"num_write_kb":70,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"267'841","reported_seq":2516,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:00:18.822903+0000","last_change":"2024-09-14T11:08:23.782031+0000","last_active":"2024-09-14T13:00:18.822903+0000","last_peered":"2024-09-14T13:00:18.822903+0000","last_clean":"2024-09-14T13:00:18.822903+0000","last_became_active":"2024-09-14T11:08:23.781730+0000","last_became_peered":"2024-09-14T11:08:23.781730+0000","last_unstale":"2024-09-14T13:00:18.822903+0000","last_undegraded":"2024-09-14T13:00:18.822903+0000","last_fullsized":"2024-09-14T13:00:18.822903+0000","mapping_epoch":26,"log_start":"267'800","ondisk_log_start":"267'800","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:08:22.750609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:08:22.750609+0000","last_clean_scrub_stamp":"2024-09-14T11:08:22.750609+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":800,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:42:43.466791+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3990,"num_read_kb":3619,"num_write":1102,"num_write_kb":388,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"267'184","reported_seq":824,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:58:43.462923+0000","last_change":"2024-09-14T11:08:21.809882+0000","last_active":"2024-09-14T12:58:43.462923+0000","last_peered":"2024-09-14T12:58:43.462923+0000","last_clean":"2024-09-14T12:58:43.462923+0000","last_became_active":"2024-09-14T11:08:21.809457+0000","last_became_peered":"2024-09-14T11:08:21.809457+0000","last_unstale":"2024-09-14T12:58:43.462923+0000","last_undegraded":"2024-09-14T12:58:43.462923+0000","last_fullsized":"2024-09-14T12:58:43.462923+0000","mapping_epoch":24,"log_start":"267'100","ondisk_log_start":"267'100","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:08:20.733145+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:08:20.733145+0000","last_clean_scrub_stamp":"2024-09-14T11:08:20.733145+0000","objects_scrubbed":0,"log_size":84,"log_dups_size":100,"ondisk_log_size":84,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:01:09.631980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3145754,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":449,"num_read_kb":5598,"num_write":895,"num_write_kb":20482,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6,7],"acting":[3,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":527,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:57:13.208161+0000","last_change":"2024-09-14T11:08:25.806603+0000","last_active":"2024-09-14T12:57:13.208161+0000","last_peered":"2024-09-14T12:57:13.208161+0000","last_clean":"2024-09-14T12:57:13.208161+0000","last_became_active":"2024-09-14T11:08:25.805777+0000","last_became_peered":"2024-09-14T11:08:25.805777+0000","last_unstale":"2024-09-14T12:57:13.208161+0000","last_undegraded":"2024-09-14T12:57:13.208161+0000","last_fullsized":"2024-09-14T12:57:13.208161+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:08:24.757170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:08:24.757170+0000","last_clean_scrub_stamp":"2024-09-14T11:08:24.757170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:54:18.701609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1b","version":"267'119","reported_seq":708,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:00:58.494482+0000","last_change":"2024-09-14T11:08:27.823209+0000","last_active":"2024-09-14T13:00:58.494482+0000","last_peered":"2024-09-14T13:00:58.494482+0000","last_clean":"2024-09-14T13:00:58.494482+0000","last_became_active":"2024-09-14T11:08:27.822465+0000","last_became_peered":"2024-09-14T11:08:27.822465+0000","last_unstale":"2024-09-14T13:00:58.494482+0000","last_undegraded":"2024-09-14T13:00:58.494482+0000","last_fullsized":"2024-09-14T13:00:58.494482+0000","mapping_epoch":30,"log_start":"267'100","ondisk_log_start":"267'100","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:08:26.771628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:08:26.771628+0000","last_clean_scrub_stamp":"2024-09-14T11:08:26.771628+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":100,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:13:30.608378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":11318,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":153,"num_read_kb":215,"num_write":82,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":518,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:58:33.226817+0000","last_change":"2024-09-14T11:08:29.832131+0000","last_active":"2024-09-14T12:58:33.226817+0000","last_peered":"2024-09-14T12:58:33.226817+0000","last_clean":"2024-09-14T12:58:33.226817+0000","last_became_active":"2024-09-14T11:08:29.831394+0000","last_became_peered":"2024-09-14T11:08:29.831394+0000","last_unstale":"2024-09-14T12:58:33.226817+0000","last_undegraded":"2024-09-14T12:58:33.226817+0000","last_fullsized":"2024-09-14T12:58:33.226817+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:08:28.783586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:08:28.783586+0000","last_clean_scrub_stamp":"2024-09-14T11:08:28.783586+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:19:42.017615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.15","version":"267'186","reported_seq":1322,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:00:12.482492+0000","last_change":"2024-09-14T11:08:31.838090+0000","last_active":"2024-09-14T13:00:12.482492+0000","last_peered":"2024-09-14T13:00:12.482492+0000","last_clean":"2024-09-14T13:00:12.482492+0000","last_became_active":"2024-09-14T11:08:31.837288+0000","last_became_peered":"2024-09-14T11:08:31.837288+0000","last_unstale":"2024-09-14T13:00:12.482492+0000","last_undegraded":"2024-09-14T13:00:12.482492+0000","last_fullsized":"2024-09-14T13:00:12.482492+0000","mapping_epoch":34,"log_start":"267'100","ondisk_log_start":"267'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:08:30.789404+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:08:30.789404+0000","last_clean_scrub_stamp":"2024-09-14T11:08:30.789404+0000","objects_scrubbed":0,"log_size":86,"log_dups_size":100,"ondisk_log_size":86,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:18:38.098740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":649,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":776,"num_read_kb":767,"num_write":406,"num_write_kb":131,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.18","version":"267'750","reported_seq":2353,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:59:18.400946+0000","last_change":"2024-09-14T11:08:23.807715+0000","last_active":"2024-09-14T12:59:18.400946+0000","last_peered":"2024-09-14T12:59:18.400946+0000","last_clean":"2024-09-14T12:59:18.400946+0000","last_became_active":"2024-09-14T11:08:23.806640+0000","last_became_peered":"2024-09-14T11:08:23.806640+0000","last_unstale":"2024-09-14T12:59:18.400946+0000","last_undegraded":"2024-09-14T12:59:18.400946+0000","last_fullsized":"2024-09-14T12:59:18.400946+0000","mapping_epoch":26,"log_start":"267'700","ondisk_log_start":"267'700","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:08:22.750609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:08:22.750609+0000","last_clean_scrub_stamp":"2024-09-14T11:08:22.750609+0000","objects_scrubbed":0,"log_size":50,"log_dups_size":700,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:13:39.042733+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3938,"num_read_kb":3591,"num_write":982,"num_write_kb":355,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1f","version":"267'163","reported_seq":832,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:59:58.476796+0000","last_change":"2024-09-14T11:08:21.801365+0000","last_active":"2024-09-14T12:59:58.476796+0000","last_peered":"2024-09-14T12:59:58.476796+0000","last_clean":"2024-09-14T12:59:58.476796+0000","last_became_active":"2024-09-14T11:08:21.801111+0000","last_became_peered":"2024-09-14T11:08:21.801111+0000","last_unstale":"2024-09-14T12:59:58.476796+0000","last_undegraded":"2024-09-14T12:59:58.476796+0000","last_fullsized":"2024-09-14T12:59:58.476796+0000","mapping_epoch":24,"log_start":"267'100","ondisk_log_start":"267'100","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:08:20.733145+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:08:20.733145+0000","last_clean_scrub_stamp":"2024-09-14T11:08:20.733145+0000","objects_scrubbed":0,"log_size":63,"log_dups_size":100,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:46:15.553454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16777242,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":482,"num_read_kb":60837,"num_write":753,"num_write_kb":39194,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,6],"acting":[0,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.19","version":"29'1","reported_seq":524,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:57:28.444602+0000","last_change":"2024-09-14T11:08:25.800454+0000","last_active":"2024-09-14T12:57:28.444602+0000","last_peered":"2024-09-14T12:57:28.444602+0000","last_clean":"2024-09-14T12:57:28.444602+0000","last_became_active":"2024-09-14T11:08:25.799872+0000","last_became_peered":"2024-09-14T11:08:25.799872+0000","last_unstale":"2024-09-14T12:57:28.444602+0000","last_undegraded":"2024-09-14T12:57:28.444602+0000","last_fullsized":"2024-09-14T12:57:28.444602+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:08:24.757170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:08:24.757170+0000","last_clean_scrub_stamp":"2024-09-14T11:08:24.757170+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:22:33.868316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1a","version":"267'184","reported_seq":815,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:00:58.259901+0000","last_change":"2024-09-14T11:08:27.831489+0000","last_active":"2024-09-14T13:00:58.259901+0000","last_peered":"2024-09-14T13:00:58.259901+0000","last_clean":"2024-09-14T13:00:58.259901+0000","last_became_active":"2024-09-14T11:08:27.830707+0000","last_became_peered":"2024-09-14T11:08:27.830707+0000","last_unstale":"2024-09-14T13:00:58.259901+0000","last_undegraded":"2024-09-14T13:00:58.259901+0000","last_fullsized":"2024-09-14T13:00:58.259901+0000","mapping_epoch":30,"log_start":"264'100","ondisk_log_start":"264'100","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:08:26.771628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:08:26.771628+0000","last_clean_scrub_stamp":"2024-09-14T11:08:26.771628+0000","objects_scrubbed":0,"log_size":84,"log_dups_size":100,"ondisk_log_size":84,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:02:06.941247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10024,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":259,"num_read_kb":319,"num_write":148,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":521,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:58:33.237720+0000","last_change":"2024-09-14T11:08:29.811093+0000","last_active":"2024-09-14T12:58:33.237720+0000","last_peered":"2024-09-14T12:58:33.237720+0000","last_clean":"2024-09-14T12:58:33.237720+0000","last_became_active":"2024-09-14T11:08:29.810292+0000","last_became_peered":"2024-09-14T11:08:29.810292+0000","last_unstale":"2024-09-14T12:58:33.237720+0000","last_undegraded":"2024-09-14T12:58:33.237720+0000","last_fullsized":"2024-09-14T12:58:33.237720+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:08:28.783586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:08:28.783586+0000","last_clean_scrub_stamp":"2024-09-14T11:08:28.783586+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:29:49.706509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.14","version":"267'133","reported_seq":660,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:01:39.322888+0000","last_change":"2024-09-14T11:08:31.852213+0000","last_active":"2024-09-14T13:01:39.322888+0000","last_peered":"2024-09-14T13:01:39.322888+0000","last_clean":"2024-09-14T13:01:39.322888+0000","last_became_active":"2024-09-14T11:08:31.851483+0000","last_became_peered":"2024-09-14T11:08:31.851483+0000","last_unstale":"2024-09-14T13:01:39.322888+0000","last_undegraded":"2024-09-14T13:01:39.322888+0000","last_fullsized":"2024-09-14T13:01:39.322888+0000","mapping_epoch":34,"log_start":"267'100","ondisk_log_start":"267'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:08:30.789404+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:08:30.789404+0000","last_clean_scrub_stamp":"2024-09-14T11:08:30.789404+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":100,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:20:02.893934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":227,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":142,"num_read_kb":127,"num_write":323,"num_write_kb":76,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.27","version":"267'1174","reported_seq":2953,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:58:58.464754+0000","last_change":"2024-09-14T11:08:23.798559+0000","last_active":"2024-09-14T12:58:58.464754+0000","last_peered":"2024-09-14T12:58:58.464754+0000","last_clean":"2024-09-14T12:58:58.464754+0000","last_became_active":"2024-09-14T11:08:23.798225+0000","last_became_peered":"2024-09-14T11:08:23.798225+0000","last_unstale":"2024-09-14T12:58:58.464754+0000","last_undegraded":"2024-09-14T12:58:58.464754+0000","last_fullsized":"2024-09-14T12:58:58.464754+0000","mapping_epoch":26,"log_start":"267'1100","ondisk_log_start":"267'1100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:08:22.750609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:08:22.750609+0000","last_clean_scrub_stamp":"2024-09-14T11:08:22.750609+0000","objects_scrubbed":0,"log_size":74,"log_dups_size":1100,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:51:37.923488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":5564,"num_read_kb":4974,"num_write":1578,"num_write_kb":634,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.20","version":"267'236","reported_seq":989,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:58:48.427401+0000","last_change":"2024-09-14T11:08:21.818419+0000","last_active":"2024-09-14T12:58:48.427401+0000","last_peered":"2024-09-14T12:58:48.427401+0000","last_clean":"2024-09-14T12:58:48.427401+0000","last_became_active":"2024-09-14T11:08:21.816270+0000","last_became_peered":"2024-09-14T11:08:21.816270+0000","last_unstale":"2024-09-14T12:58:48.427401+0000","last_undegraded":"2024-09-14T12:58:48.427401+0000","last_fullsized":"2024-09-14T12:58:48.427401+0000","mapping_epoch":24,"log_start":"267'200","ondisk_log_start":"267'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:08:20.733145+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:08:20.733145+0000","last_clean_scrub_stamp":"2024-09-14T11:08:20.733145+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":200,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:09:57.961085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2438293,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":890,"num_read_kb":196583,"num_write":959,"num_write_kb":33610,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,7],"acting":[6,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.26","version":"267'1292","reported_seq":2902,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:00:11.320785+0000","last_change":"2024-09-14T11:08:23.776608+0000","last_active":"2024-09-14T13:00:11.320785+0000","last_peered":"2024-09-14T13:00:11.320785+0000","last_clean":"2024-09-14T13:00:11.320785+0000","last_became_active":"2024-09-14T11:08:23.776349+0000","last_became_peered":"2024-09-14T11:08:23.776349+0000","last_unstale":"2024-09-14T13:00:11.320785+0000","last_undegraded":"2024-09-14T13:00:11.320785+0000","last_fullsized":"2024-09-14T13:00:11.320785+0000","mapping_epoch":26,"log_start":"267'1200","ondisk_log_start":"267'1200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:08:22.750609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:08:22.750609+0000","last_clean_scrub_stamp":"2024-09-14T11:08:22.750609+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":1200,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:56:10.344959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":5862,"num_read_kb":5174,"num_write":1823,"num_write_kb":798,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.21","version":"267'158","reported_seq":796,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:58:47.825408+0000","last_change":"2024-09-14T11:08:21.779309+0000","last_active":"2024-09-14T12:58:47.825408+0000","last_peered":"2024-09-14T12:58:47.825408+0000","last_clean":"2024-09-14T12:58:47.825408+0000","last_became_active":"2024-09-14T11:08:21.778857+0000","last_became_peered":"2024-09-14T11:08:21.778857+0000","last_unstale":"2024-09-14T12:58:47.825408+0000","last_undegraded":"2024-09-14T12:58:47.825408+0000","last_fullsized":"2024-09-14T12:58:47.825408+0000","mapping_epoch":24,"log_start":"267'100","ondisk_log_start":"267'100","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:08:20.733145+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:08:20.733145+0000","last_clean_scrub_stamp":"2024-09-14T11:08:20.733145+0000","objects_scrubbed":0,"log_size":58,"log_dups_size":100,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:35:37.196078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":436,"num_read_kb":8582,"num_write":806,"num_write_kb":19268,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,6],"acting":[2,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.25","version":"267'856","reported_seq":2578,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:58:58.047892+0000","last_change":"2024-09-14T11:08:23.810261+0000","last_active":"2024-09-14T12:58:58.047892+0000","last_peered":"2024-09-14T12:58:58.047892+0000","last_clean":"2024-09-14T12:58:58.047892+0000","last_became_active":"2024-09-14T11:08:23.808906+0000","last_became_peered":"2024-09-14T11:08:23.808906+0000","last_unstale":"2024-09-14T12:58:58.047892+0000","last_undegraded":"2024-09-14T12:58:58.047892+0000","last_fullsized":"2024-09-14T12:58:58.047892+0000","mapping_epoch":26,"log_start":"267'800","ondisk_log_start":"267'800","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:08:22.750609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:08:22.750609+0000","last_clean_scrub_stamp":"2024-09-14T11:08:22.750609+0000","objects_scrubbed":0,"log_size":56,"log_dups_size":800,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:40:05.413028+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":4244,"num_read_kb":3835,"num_write":1129,"num_write_kb":418,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.22","version":"267'241","reported_seq":950,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:58:48.045508+0000","last_change":"2024-09-14T11:08:21.797624+0000","last_active":"2024-09-14T12:58:48.045508+0000","last_peered":"2024-09-14T12:58:48.045508+0000","last_clean":"2024-09-14T12:58:48.045508+0000","last_became_active":"2024-09-14T11:08:21.795735+0000","last_became_peered":"2024-09-14T11:08:21.795735+0000","last_unstale":"2024-09-14T12:58:48.045508+0000","last_undegraded":"2024-09-14T12:58:48.045508+0000","last_fullsized":"2024-09-14T12:58:48.045508+0000","mapping_epoch":24,"log_start":"267'200","ondisk_log_start":"267'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:08:20.733145+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:08:20.733145+0000","last_clean_scrub_stamp":"2024-09-14T11:08:20.733145+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":200,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:10:17.606566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12586780,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":699,"num_read_kb":92954,"num_write":1115,"num_write_kb":50908,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,0],"acting":[5,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.24","version":"267'424","reported_seq":2053,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:58:58.464653+0000","last_change":"2024-09-14T11:08:23.801087+0000","last_active":"2024-09-14T12:58:58.464653+0000","last_peered":"2024-09-14T12:58:58.464653+0000","last_clean":"2024-09-14T12:58:58.464653+0000","last_became_active":"2024-09-14T11:08:23.800722+0000","last_became_peered":"2024-09-14T11:08:23.800722+0000","last_unstale":"2024-09-14T12:58:58.464653+0000","last_undegraded":"2024-09-14T12:58:58.464653+0000","last_fullsized":"2024-09-14T12:58:58.464653+0000","mapping_epoch":26,"log_start":"267'400","ondisk_log_start":"267'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:08:22.750609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:08:22.750609+0000","last_clean_scrub_stamp":"2024-09-14T11:08:22.750609+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":400,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:30:04.827083+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2360,"num_read_kb":2243,"num_write":502,"num_write_kb":106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.23","version":"267'214","reported_seq":888,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:59:13.248088+0000","last_change":"2024-09-14T11:08:21.816021+0000","last_active":"2024-09-14T12:59:13.248088+0000","last_peered":"2024-09-14T12:59:13.248088+0000","last_clean":"2024-09-14T12:59:13.248088+0000","last_became_active":"2024-09-14T11:08:21.815676+0000","last_became_peered":"2024-09-14T11:08:21.815676+0000","last_unstale":"2024-09-14T12:59:13.248088+0000","last_undegraded":"2024-09-14T12:59:13.248088+0000","last_fullsized":"2024-09-14T12:59:13.248088+0000","mapping_epoch":24,"log_start":"267'200","ondisk_log_start":"267'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:08:20.733145+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:08:20.733145+0000","last_clean_scrub_stamp":"2024-09-14T11:08:20.733145+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":200,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:59:08.982564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6998409,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":593,"num_read_kb":27875,"num_write":898,"num_write_kb":22739,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"267'894","reported_seq":2678,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:01:39.418707+0000","last_change":"2024-09-14T11:08:23.801739+0000","last_active":"2024-09-14T13:01:39.418707+0000","last_peered":"2024-09-14T13:01:39.418707+0000","last_clean":"2024-09-14T13:01:39.418707+0000","last_became_active":"2024-09-14T11:08:23.801373+0000","last_became_peered":"2024-09-14T11:08:23.801373+0000","last_unstale":"2024-09-14T13:01:39.418707+0000","last_undegraded":"2024-09-14T13:01:39.418707+0000","last_fullsized":"2024-09-14T13:01:39.418707+0000","mapping_epoch":26,"log_start":"267'800","ondisk_log_start":"267'800","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:08:22.750609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:08:22.750609+0000","last_clean_scrub_stamp":"2024-09-14T11:08:22.750609+0000","objects_scrubbed":0,"log_size":94,"log_dups_size":800,"ondisk_log_size":94,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:42:48.834357+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":4489,"num_read_kb":4053,"num_write":1182,"num_write_kb":453,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.24","version":"267'179","reported_seq":854,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:58:53.465379+0000","last_change":"2024-09-14T11:08:21.816168+0000","last_active":"2024-09-14T12:58:53.465379+0000","last_peered":"2024-09-14T12:58:53.465379+0000","last_clean":"2024-09-14T12:58:53.465379+0000","last_became_active":"2024-09-14T11:08:21.815768+0000","last_became_peered":"2024-09-14T11:08:21.815768+0000","last_unstale":"2024-09-14T12:58:53.465379+0000","last_undegraded":"2024-09-14T12:58:53.465379+0000","last_fullsized":"2024-09-14T12:58:53.465379+0000","mapping_epoch":24,"log_start":"267'100","ondisk_log_start":"267'100","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:08:20.733145+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:08:20.733145+0000","last_clean_scrub_stamp":"2024-09-14T11:08:20.733145+0000","objects_scrubbed":0,"log_size":79,"log_dups_size":100,"ondisk_log_size":79,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:26:06.050289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4196396,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":598,"num_read_kb":27323,"num_write":895,"num_write_kb":11503,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,0],"acting":[3,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"267'441","reported_seq":1997,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:01:39.358812+0000","last_change":"2024-09-14T11:08:23.815380+0000","last_active":"2024-09-14T13:01:39.358812+0000","last_peered":"2024-09-14T13:01:39.358812+0000","last_clean":"2024-09-14T13:01:39.358812+0000","last_became_active":"2024-09-14T11:08:23.814703+0000","last_became_peered":"2024-09-14T11:08:23.814703+0000","last_unstale":"2024-09-14T13:01:39.358812+0000","last_undegraded":"2024-09-14T13:01:39.358812+0000","last_fullsized":"2024-09-14T13:01:39.358812+0000","mapping_epoch":26,"log_start":"267'400","ondisk_log_start":"267'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:08:22.750609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:08:22.750609+0000","last_clean_scrub_stamp":"2024-09-14T11:08:22.750609+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":400,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:10:53.366615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2315,"num_read_kb":2173,"num_write":509,"num_write_kb":111,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.25","version":"267'222","reported_seq":870,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:58:53.463561+0000","last_change":"2024-09-14T11:08:21.783168+0000","last_active":"2024-09-14T12:58:53.463561+0000","last_peered":"2024-09-14T12:58:53.463561+0000","last_clean":"2024-09-14T12:58:53.463561+0000","last_became_active":"2024-09-14T11:08:21.782389+0000","last_became_peered":"2024-09-14T11:08:21.782389+0000","last_unstale":"2024-09-14T12:58:53.463561+0000","last_undegraded":"2024-09-14T12:58:53.463561+0000","last_fullsized":"2024-09-14T12:58:53.463561+0000","mapping_epoch":24,"log_start":"267'200","ondisk_log_start":"267'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:08:20.733145+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:08:20.733145+0000","last_clean_scrub_stamp":"2024-09-14T11:08:20.733145+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":200,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:56:33.696993+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5607002,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":465,"num_read_kb":9844,"num_write":864,"num_write_kb":38372,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"267'1241","reported_seq":2966,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:58:53.465249+0000","last_change":"2024-09-14T11:08:23.786227+0000","last_active":"2024-09-14T12:58:53.465249+0000","last_peered":"2024-09-14T12:58:53.465249+0000","last_clean":"2024-09-14T12:58:53.465249+0000","last_became_active":"2024-09-14T11:08:23.785820+0000","last_became_peered":"2024-09-14T11:08:23.785820+0000","last_unstale":"2024-09-14T12:58:53.465249+0000","last_undegraded":"2024-09-14T12:58:53.465249+0000","last_fullsized":"2024-09-14T12:58:53.465249+0000","mapping_epoch":26,"log_start":"267'1200","ondisk_log_start":"267'1200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:08:22.750609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:08:22.750609+0000","last_clean_scrub_stamp":"2024-09-14T11:08:22.750609+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":1200,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:03:47.638628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":5731,"num_read_kb":5079,"num_write":1712,"num_write_kb":696,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"267'209","reported_seq":925,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:58:53.428713+0000","last_change":"2024-09-14T11:08:21.825788+0000","last_active":"2024-09-14T12:58:53.428713+0000","last_peered":"2024-09-14T12:58:53.428713+0000","last_clean":"2024-09-14T12:58:53.428713+0000","last_became_active":"2024-09-14T11:08:21.824946+0000","last_became_peered":"2024-09-14T11:08:21.824946+0000","last_unstale":"2024-09-14T12:58:53.428713+0000","last_undegraded":"2024-09-14T12:58:53.428713+0000","last_fullsized":"2024-09-14T12:58:53.428713+0000","mapping_epoch":24,"log_start":"267'100","ondisk_log_start":"267'100","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:08:20.733145+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:08:20.733145+0000","last_clean_scrub_stamp":"2024-09-14T11:08:20.733145+0000","objects_scrubbed":0,"log_size":109,"log_dups_size":100,"ondisk_log_size":109,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:23:39.096969+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":11093103,"num_objects":9,"num_object_clones":0,"num_object_copies":27,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":765,"num_read_kb":179397,"num_write":974,"num_write_kb":35238,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,4],"acting":[6,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.20","version":"267'1214","reported_seq":2936,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:00:11.316393+0000","last_change":"2024-09-14T11:08:23.805571+0000","last_active":"2024-09-14T13:00:11.316393+0000","last_peered":"2024-09-14T13:00:11.316393+0000","last_clean":"2024-09-14T13:00:11.316393+0000","last_became_active":"2024-09-14T11:08:23.803960+0000","last_became_peered":"2024-09-14T11:08:23.803960+0000","last_unstale":"2024-09-14T13:00:11.316393+0000","last_undegraded":"2024-09-14T13:00:11.316393+0000","last_fullsized":"2024-09-14T13:00:11.316393+0000","mapping_epoch":26,"log_start":"267'1200","ondisk_log_start":"267'1200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:08:22.750609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:08:22.750609+0000","last_clean_scrub_stamp":"2024-09-14T11:08:22.750609+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":1200,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:56:34.285956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":5500,"num_read_kb":4892,"num_write":1634,"num_write_kb":643,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"267'216","reported_seq":867,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:59:28.471054+0000","last_change":"2024-09-14T11:08:56.034603+0000","last_active":"2024-09-14T12:59:28.471054+0000","last_peered":"2024-09-14T12:59:28.471054+0000","last_clean":"2024-09-14T12:59:28.471054+0000","last_became_active":"2024-09-14T11:08:56.033948+0000","last_became_peered":"2024-09-14T11:08:56.033948+0000","last_unstale":"2024-09-14T12:59:28.471054+0000","last_undegraded":"2024-09-14T12:59:28.471054+0000","last_fullsized":"2024-09-14T12:59:28.471054+0000","mapping_epoch":37,"log_start":"267'200","ondisk_log_start":"267'200","created":24,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:08:20.733145+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:08:20.733145+0000","last_clean_scrub_stamp":"2024-09-14T11:08:20.733145+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":200,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:23:47.919671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4553958,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":566,"num_read_kb":57833,"num_write":1045,"num_write_kb":21583,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,2],"acting":[1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2f","version":"267'433","reported_seq":2044,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:58:21.423865+0000","last_change":"2024-09-14T11:08:23.786774+0000","last_active":"2024-09-14T12:58:21.423865+0000","last_peered":"2024-09-14T12:58:21.423865+0000","last_clean":"2024-09-14T12:58:21.423865+0000","last_became_active":"2024-09-14T11:08:23.786094+0000","last_became_peered":"2024-09-14T11:08:23.786094+0000","last_unstale":"2024-09-14T12:58:21.423865+0000","last_undegraded":"2024-09-14T12:58:21.423865+0000","last_fullsized":"2024-09-14T12:58:21.423865+0000","mapping_epoch":26,"log_start":"267'400","ondisk_log_start":"267'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:08:22.750609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:08:22.750609+0000","last_clean_scrub_stamp":"2024-09-14T11:08:22.750609+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":400,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:20:24.340919+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2284,"num_read_kb":2174,"num_write":475,"num_write_kb":81,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.28","version":"267'233","reported_seq":905,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:59:23.053130+0000","last_change":"2024-09-14T11:08:21.790090+0000","last_active":"2024-09-14T12:59:23.053130+0000","last_peered":"2024-09-14T12:59:23.053130+0000","last_clean":"2024-09-14T12:59:23.053130+0000","last_became_active":"2024-09-14T11:08:21.789114+0000","last_became_peered":"2024-09-14T11:08:21.789114+0000","last_unstale":"2024-09-14T12:59:23.053130+0000","last_undegraded":"2024-09-14T12:59:23.053130+0000","last_fullsized":"2024-09-14T12:59:23.053130+0000","mapping_epoch":24,"log_start":"267'200","ondisk_log_start":"267'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:08:20.733145+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:08:20.733145+0000","last_clean_scrub_stamp":"2024-09-14T11:08:20.733145+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":200,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:25:30.193731+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9761881,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":587,"num_read_kb":44666,"num_write":1098,"num_write_kb":41456,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,2],"acting":[5,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2e","version":"267'451","reported_seq":2209,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:59:07.754306+0000","last_change":"2024-09-14T11:08:23.793709+0000","last_active":"2024-09-14T12:59:07.754306+0000","last_peered":"2024-09-14T12:59:07.754306+0000","last_clean":"2024-09-14T12:59:07.754306+0000","last_became_active":"2024-09-14T11:08:23.792081+0000","last_became_peered":"2024-09-14T11:08:23.792081+0000","last_unstale":"2024-09-14T12:59:07.754306+0000","last_undegraded":"2024-09-14T12:59:07.754306+0000","last_fullsized":"2024-09-14T12:59:07.754306+0000","mapping_epoch":26,"log_start":"267'400","ondisk_log_start":"267'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:08:22.750609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:08:22.750609+0000","last_clean_scrub_stamp":"2024-09-14T11:08:22.750609+0000","objects_scrubbed":0,"log_size":51,"log_dups_size":400,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:10:19.755636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2579,"num_read_kb":2481,"num_write":491,"num_write_kb":76,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.29","version":"267'198","reported_seq":894,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:59:12.831088+0000","last_change":"2024-09-14T11:08:56.039919+0000","last_active":"2024-09-14T12:59:12.831088+0000","last_peered":"2024-09-14T12:59:12.831088+0000","last_clean":"2024-09-14T12:59:12.831088+0000","last_became_active":"2024-09-14T11:08:56.039007+0000","last_became_peered":"2024-09-14T11:08:56.039007+0000","last_unstale":"2024-09-14T12:59:12.831088+0000","last_undegraded":"2024-09-14T12:59:12.831088+0000","last_fullsized":"2024-09-14T12:59:12.831088+0000","mapping_epoch":37,"log_start":"267'100","ondisk_log_start":"267'100","created":24,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:08:20.733145+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:08:20.733145+0000","last_clean_scrub_stamp":"2024-09-14T11:08:20.733145+0000","objects_scrubbed":0,"log_size":98,"log_dups_size":100,"ondisk_log_size":98,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:34:15.824951+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":325166,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":674,"num_read_kb":34418,"num_write":909,"num_write_kb":30711,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4,1],"acting":[2,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2d","version":"267'382","reported_seq":1944,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:01:39.348450+0000","last_change":"2024-09-14T11:08:23.806935+0000","last_active":"2024-09-14T13:01:39.348450+0000","last_peered":"2024-09-14T13:01:39.348450+0000","last_clean":"2024-09-14T13:01:39.348450+0000","last_became_active":"2024-09-14T11:08:23.806568+0000","last_became_peered":"2024-09-14T11:08:23.806568+0000","last_unstale":"2024-09-14T13:01:39.348450+0000","last_undegraded":"2024-09-14T13:01:39.348450+0000","last_fullsized":"2024-09-14T13:01:39.348450+0000","mapping_epoch":26,"log_start":"267'300","ondisk_log_start":"267'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:08:22.750609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:08:22.750609+0000","last_clean_scrub_stamp":"2024-09-14T11:08:22.750609+0000","objects_scrubbed":0,"log_size":82,"log_dups_size":300,"ondisk_log_size":82,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:57:47.545139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2181,"num_read_kb":2088,"num_write":442,"num_write_kb":83,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2a","version":"267'209","reported_seq":845,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:00:10.971402+0000","last_change":"2024-09-14T11:08:55.884603+0000","last_active":"2024-09-14T13:00:10.971402+0000","last_peered":"2024-09-14T13:00:10.971402+0000","last_clean":"2024-09-14T13:00:10.971402+0000","last_became_active":"2024-09-14T11:08:55.882680+0000","last_became_peered":"2024-09-14T11:08:55.882680+0000","last_unstale":"2024-09-14T13:00:10.971402+0000","last_undegraded":"2024-09-14T13:00:10.971402+0000","last_fullsized":"2024-09-14T13:00:10.971402+0000","mapping_epoch":37,"log_start":"267'100","ondisk_log_start":"267'100","created":24,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:08:20.733145+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:08:20.733145+0000","last_clean_scrub_stamp":"2024-09-14T11:08:20.733145+0000","objects_scrubbed":0,"log_size":109,"log_dups_size":100,"ondisk_log_size":109,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:49:48.418255+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6908983,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":486,"num_read_kb":10243,"num_write":959,"num_write_kb":42313,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,1],"acting":[5,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2c","version":"267'617","reported_seq":2458,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:59:18.400789+0000","last_change":"2024-09-14T11:08:23.815717+0000","last_active":"2024-09-14T12:59:18.400789+0000","last_peered":"2024-09-14T12:59:18.400789+0000","last_clean":"2024-09-14T12:59:18.400789+0000","last_became_active":"2024-09-14T11:08:23.815121+0000","last_became_peered":"2024-09-14T11:08:23.815121+0000","last_unstale":"2024-09-14T12:59:18.400789+0000","last_undegraded":"2024-09-14T12:59:18.400789+0000","last_fullsized":"2024-09-14T12:59:18.400789+0000","mapping_epoch":26,"log_start":"267'600","ondisk_log_start":"267'600","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:08:22.750609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:08:22.750609+0000","last_clean_scrub_stamp":"2024-09-14T11:08:22.750609+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":600,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:28:06.102937+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3483,"num_read_kb":3244,"num_write":793,"num_write_kb":264,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2b","version":"267'197","reported_seq":843,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:58:38.239023+0000","last_change":"2024-09-14T11:08:21.788931+0000","last_active":"2024-09-14T12:58:38.239023+0000","last_peered":"2024-09-14T12:58:38.239023+0000","last_clean":"2024-09-14T12:58:38.239023+0000","last_became_active":"2024-09-14T11:08:21.788281+0000","last_became_peered":"2024-09-14T11:08:21.788281+0000","last_unstale":"2024-09-14T12:58:38.239023+0000","last_undegraded":"2024-09-14T12:58:38.239023+0000","last_fullsized":"2024-09-14T12:58:38.239023+0000","mapping_epoch":24,"log_start":"267'100","ondisk_log_start":"267'100","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:08:20.733145+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:08:20.733145+0000","last_clean_scrub_stamp":"2024-09-14T11:08:20.733145+0000","objects_scrubbed":0,"log_size":97,"log_dups_size":100,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:28:36.822887+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388661,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":433,"num_read_kb":38929,"num_write":897,"num_write_kb":25858,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,1],"acting":[0,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2b","version":"267'912","reported_seq":2513,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:01:39.366882+0000","last_change":"2024-09-14T11:08:23.807651+0000","last_active":"2024-09-14T13:01:39.366882+0000","last_peered":"2024-09-14T13:01:39.366882+0000","last_clean":"2024-09-14T13:01:39.366882+0000","last_became_active":"2024-09-14T11:08:23.806952+0000","last_became_peered":"2024-09-14T11:08:23.806952+0000","last_unstale":"2024-09-14T13:01:39.366882+0000","last_undegraded":"2024-09-14T13:01:39.366882+0000","last_fullsized":"2024-09-14T13:01:39.366882+0000","mapping_epoch":26,"log_start":"267'900","ondisk_log_start":"267'900","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:08:22.750609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:08:22.750609+0000","last_clean_scrub_stamp":"2024-09-14T11:08:22.750609+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":900,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:04:05.268211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":4419,"num_read_kb":3921,"num_write":1287,"num_write_kb":515,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"267'227","reported_seq":901,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:58:38.425180+0000","last_change":"2024-09-14T11:08:21.838035+0000","last_active":"2024-09-14T12:58:38.425180+0000","last_peered":"2024-09-14T12:58:38.425180+0000","last_clean":"2024-09-14T12:58:38.425180+0000","last_became_active":"2024-09-14T11:08:21.836420+0000","last_became_peered":"2024-09-14T11:08:21.836420+0000","last_unstale":"2024-09-14T12:58:38.425180+0000","last_undegraded":"2024-09-14T12:58:38.425180+0000","last_fullsized":"2024-09-14T12:58:38.425180+0000","mapping_epoch":24,"log_start":"267'200","ondisk_log_start":"267'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:08:20.733145+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:08:20.733145+0000","last_clean_scrub_stamp":"2024-09-14T11:08:20.733145+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":200,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:52:49.496464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7394423,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":674,"num_read_kb":43780,"num_write":1050,"num_write_kb":42822,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.2a","version":"267'457","reported_seq":2086,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:58:43.240063+0000","last_change":"2024-09-14T11:08:23.777007+0000","last_active":"2024-09-14T12:58:43.240063+0000","last_peered":"2024-09-14T12:58:43.240063+0000","last_clean":"2024-09-14T12:58:43.240063+0000","last_became_active":"2024-09-14T11:08:23.776554+0000","last_became_peered":"2024-09-14T11:08:23.776554+0000","last_unstale":"2024-09-14T12:58:43.240063+0000","last_undegraded":"2024-09-14T12:58:43.240063+0000","last_fullsized":"2024-09-14T12:58:43.240063+0000","mapping_epoch":26,"log_start":"267'400","ondisk_log_start":"267'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:08:22.750609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:08:22.750609+0000","last_clean_scrub_stamp":"2024-09-14T11:08:22.750609+0000","objects_scrubbed":0,"log_size":57,"log_dups_size":400,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:54:36.353928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2491,"num_read_kb":2349,"num_write":540,"num_write_kb":122,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2d","version":"267'204","reported_seq":852,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:59:58.479560+0000","last_change":"2024-09-14T11:08:21.829298+0000","last_active":"2024-09-14T12:59:58.479560+0000","last_peered":"2024-09-14T12:59:58.479560+0000","last_clean":"2024-09-14T12:59:58.479560+0000","last_became_active":"2024-09-14T11:08:21.828333+0000","last_became_peered":"2024-09-14T11:08:21.828333+0000","last_unstale":"2024-09-14T12:59:58.479560+0000","last_undegraded":"2024-09-14T12:59:58.479560+0000","last_fullsized":"2024-09-14T12:59:58.479560+0000","mapping_epoch":24,"log_start":"267'100","ondisk_log_start":"267'100","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:08:20.733145+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:08:20.733145+0000","last_clean_scrub_stamp":"2024-09-14T11:08:20.733145+0000","objects_scrubbed":0,"log_size":104,"log_dups_size":100,"ondisk_log_size":104,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:49:17.354112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9037928,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":510,"num_read_kb":35640,"num_write":900,"num_write_kb":31502,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,6],"acting":[7,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.29","version":"267'783","reported_seq":2506,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:58:48.349738+0000","last_change":"2024-09-14T11:08:23.784873+0000","last_active":"2024-09-14T12:58:48.349738+0000","last_peered":"2024-09-14T12:58:48.349738+0000","last_clean":"2024-09-14T12:58:48.349738+0000","last_became_active":"2024-09-14T11:08:23.783522+0000","last_became_peered":"2024-09-14T11:08:23.783522+0000","last_unstale":"2024-09-14T12:58:48.349738+0000","last_undegraded":"2024-09-14T12:58:48.349738+0000","last_fullsized":"2024-09-14T12:58:48.349738+0000","mapping_epoch":26,"log_start":"267'700","ondisk_log_start":"267'700","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:08:22.750609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:08:22.750609+0000","last_clean_scrub_stamp":"2024-09-14T11:08:22.750609+0000","objects_scrubbed":0,"log_size":83,"log_dups_size":700,"ondisk_log_size":83,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:15:28.048272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":4481,"num_read_kb":4083,"num_write":1109,"num_write_kb":423,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"267'181","reported_seq":866,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:59:58.479319+0000","last_change":"2024-09-14T11:08:21.809060+0000","last_active":"2024-09-14T12:59:58.479319+0000","last_peered":"2024-09-14T12:59:58.479319+0000","last_clean":"2024-09-14T12:59:58.479319+0000","last_became_active":"2024-09-14T11:08:21.808348+0000","last_became_peered":"2024-09-14T11:08:21.808348+0000","last_unstale":"2024-09-14T12:59:58.479319+0000","last_undegraded":"2024-09-14T12:59:58.479319+0000","last_fullsized":"2024-09-14T12:59:58.479319+0000","mapping_epoch":24,"log_start":"267'100","ondisk_log_start":"267'100","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:08:20.733145+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:08:20.733145+0000","last_clean_scrub_stamp":"2024-09-14T11:08:20.733145+0000","objects_scrubbed":0,"log_size":81,"log_dups_size":100,"ondisk_log_size":81,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:06:38.749956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":15303696,"num_objects":10,"num_object_clones":0,"num_object_copies":30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":608,"num_read_kb":79965,"num_write":844,"num_write_kb":37043,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,1],"acting":[2,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"267'411","reported_seq":2113,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:01:39.424555+0000","last_change":"2024-09-14T11:08:23.803099+0000","last_active":"2024-09-14T13:01:39.424555+0000","last_peered":"2024-09-14T13:01:39.424555+0000","last_clean":"2024-09-14T13:01:39.424555+0000","last_became_active":"2024-09-14T11:08:23.802357+0000","last_became_peered":"2024-09-14T11:08:23.802357+0000","last_unstale":"2024-09-14T13:01:39.424555+0000","last_undegraded":"2024-09-14T13:01:39.424555+0000","last_fullsized":"2024-09-14T13:01:39.424555+0000","mapping_epoch":26,"log_start":"267'400","ondisk_log_start":"267'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:08:22.750609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:08:22.750609+0000","last_clean_scrub_stamp":"2024-09-14T11:08:22.750609+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":400,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:31:47.027216+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2549,"num_read_kb":2448,"num_write":474,"num_write_kb":95,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2f","version":"267'222","reported_seq":946,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:58:03.035502+0000","last_change":"2024-09-14T11:08:55.885757+0000","last_active":"2024-09-14T12:58:03.035502+0000","last_peered":"2024-09-14T12:58:03.035502+0000","last_clean":"2024-09-14T12:58:03.035502+0000","last_became_active":"2024-09-14T11:08:55.884851+0000","last_became_peered":"2024-09-14T11:08:55.884851+0000","last_unstale":"2024-09-14T12:58:03.035502+0000","last_undegraded":"2024-09-14T12:58:03.035502+0000","last_fullsized":"2024-09-14T12:58:03.035502+0000","mapping_epoch":37,"log_start":"267'200","ondisk_log_start":"267'200","created":24,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:08:20.733145+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:08:20.733145+0000","last_clean_scrub_stamp":"2024-09-14T11:08:20.733145+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":200,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:34:33.364323+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5281584,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":796,"num_read_kb":23166,"num_write":997,"num_write_kb":40111,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,1],"acting":[5,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"267'224","reported_seq":911,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:58:39.623527+0000","last_change":"2024-09-14T11:08:56.035003+0000","last_active":"2024-09-14T12:58:39.623527+0000","last_peered":"2024-09-14T12:58:39.623527+0000","last_clean":"2024-09-14T12:58:39.623527+0000","last_became_active":"2024-09-14T11:08:56.033792+0000","last_became_peered":"2024-09-14T11:08:56.033792+0000","last_unstale":"2024-09-14T12:58:39.623527+0000","last_undegraded":"2024-09-14T12:58:39.623527+0000","last_fullsized":"2024-09-14T12:58:39.623527+0000","mapping_epoch":37,"log_start":"267'200","ondisk_log_start":"267'200","created":24,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:08:20.733145+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:08:20.733145+0000","last_clean_scrub_stamp":"2024-09-14T11:08:20.733145+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":200,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:06:53.712379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19922970,"num_objects":12,"num_object_clones":0,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":0,"num_read":569,"num_read_kb":92149,"num_write":1009,"num_write_kb":50173,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,0],"acting":[5,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.37","version":"267'500","reported_seq":2175,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:00:18.795316+0000","last_change":"2024-09-14T11:08:23.787116+0000","last_active":"2024-09-14T13:00:18.795316+0000","last_peered":"2024-09-14T13:00:18.795316+0000","last_clean":"2024-09-14T13:00:18.795316+0000","last_became_active":"2024-09-14T11:08:23.786473+0000","last_became_peered":"2024-09-14T11:08:23.786473+0000","last_unstale":"2024-09-14T13:00:18.795316+0000","last_undegraded":"2024-09-14T13:00:18.795316+0000","last_fullsized":"2024-09-14T13:00:18.795316+0000","mapping_epoch":26,"log_start":"267'400","ondisk_log_start":"267'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:08:22.750609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:08:22.750609+0000","last_clean_scrub_stamp":"2024-09-14T11:08:22.750609+0000","objects_scrubbed":0,"log_size":100,"log_dups_size":400,"ondisk_log_size":100,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:50:27.775627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2870,"num_read_kb":2681,"num_write":627,"num_write_kb":170,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"267'220","reported_seq":890,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:59:58.484286+0000","last_change":"2024-09-14T11:08:21.816970+0000","last_active":"2024-09-14T12:59:58.484286+0000","last_peered":"2024-09-14T12:59:58.484286+0000","last_clean":"2024-09-14T12:59:58.484286+0000","last_became_active":"2024-09-14T11:08:21.815731+0000","last_became_peered":"2024-09-14T11:08:21.815731+0000","last_unstale":"2024-09-14T12:59:58.484286+0000","last_undegraded":"2024-09-14T12:59:58.484286+0000","last_fullsized":"2024-09-14T12:59:58.484286+0000","mapping_epoch":24,"log_start":"267'200","ondisk_log_start":"267'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:08:20.733145+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:08:20.733145+0000","last_clean_scrub_stamp":"2024-09-14T11:08:20.733145+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":200,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:24:40.198696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6363857,"num_objects":12,"num_object_clones":0,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":0,"num_read":588,"num_read_kb":25561,"num_write":997,"num_write_kb":42149,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,5],"acting":[1,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.36","version":"267'907","reported_seq":2493,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:58:11.332731+0000","last_change":"2024-09-14T11:08:23.797836+0000","last_active":"2024-09-14T12:58:11.332731+0000","last_peered":"2024-09-14T12:58:11.332731+0000","last_clean":"2024-09-14T12:58:11.332731+0000","last_became_active":"2024-09-14T11:08:23.797135+0000","last_became_peered":"2024-09-14T11:08:23.797135+0000","last_unstale":"2024-09-14T12:58:11.332731+0000","last_undegraded":"2024-09-14T12:58:11.332731+0000","last_fullsized":"2024-09-14T12:58:11.332731+0000","mapping_epoch":26,"log_start":"267'800","ondisk_log_start":"267'800","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:08:22.750609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:08:22.750609+0000","last_clean_scrub_stamp":"2024-09-14T11:08:22.750609+0000","objects_scrubbed":0,"log_size":107,"log_dups_size":800,"ondisk_log_size":107,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:35:11.421873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4302,"num_read_kb":3816,"num_write":1266,"num_write_kb":491,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]}],"pool_stats":[{"poolid":65,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10893,"num_read_kb":9222,"num_write":3117,"num_write_kb":1014,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1012,"ondisk_log_size":1012,"up":64,"acting":64,"num_store_stats":8},{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":14831,"num_objects":87,"num_object_clones":0,"num_object_copies":174,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":87,"num_whiteouts":0,"num_read":15223,"num_read_kb":14878,"num_write":17077,"num_write_kb":4995,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":19,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":557056,"data_stored":29662,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1708,"ondisk_log_size":1708,"up":64,"acting":64,"num_store_stats":8},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":540,"ondisk_log_size":540,"up":64,"acting":64,"num_store_stats":8},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":543921,"num_objects":199,"num_object_clones":0,"num_object_copies":398,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":199,"num_whiteouts":0,"num_read":11694,"num_read_kb":13819,"num_write":8553,"num_write_kb":3787,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":23,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":786432,"data_stored":263102,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1984,"ondisk_log_size":1984,"up":64,"acting":64,"num_store_stats":8},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":1793,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":2373,"num_read_kb":2833,"num_write":20,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":3586,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":11,"ondisk_log_size":11,"up":64,"acting":64,"num_store_stats":8},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":143,"num_object_clones":0,"num_object_copies":286,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":143,"num_whiteouts":0,"num_read":221865,"num_read_kb":203092,"num_write":56157,"num_write_kb":19250,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":143,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3675,"ondisk_log_size":3675,"up":128,"acting":128,"num_store_stats":8},{"poolid":68,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":12,"num_read_kb":12,"num_write":18,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":6,"ondisk_log_size":6,"up":64,"acting":64,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":565949976,"num_objects":497,"num_object_clones":0,"num_object_copies":1491,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":497,"num_whiteouts":0,"num_read":42552,"num_read_kb":2820640,"num_write":64136,"num_write_kb":2216242,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":851558400,"data_stored":851558400,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3742,"ondisk_log_size":3742,"up":192,"acting":192,"num_store_stats":8},{"poolid":67,"num_pg":32,"stat_sum":{"num_bytes":73109320,"num_objects":28,"num_object_clones":0,"num_object_copies":56,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":28,"num_whiteouts":0,"num_read":144,"num_read_kb":198130,"num_write":158,"num_write_kb":125738,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":146227200,"data_stored":146218640,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":98,"ondisk_log_size":98,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":7},{"poolid":66,"num_pg":32,"stat_sum":{"num_bytes":73109320,"num_objects":28,"num_object_clones":0,"num_object_copies":56,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":28,"num_whiteouts":0,"num_read":140,"num_read_kb":188216,"num_write":158,"num_write_kb":125738,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":146227200,"data_stored":146218640,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":98,"ondisk_log_size":98,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834576217,"num_pgs":106,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":369872,"kb_used_data":131840,"kb_used_omap":1,"kb_used_meta":238014,"kb_avail":94001968,"statfs":{"total":96636764160,"available":96258015232,"internally_reserved":0,"allocated":135004160,"data_stored":132821830,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":243726794},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":13,"seq":55834576223,"num_pgs":99,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":378220,"kb_used_data":144348,"kb_used_omap":1,"kb_used_meta":233854,"kb_avail":93993620,"statfs":{"total":96636764160,"available":96249466880,"internally_reserved":0,"allocated":147812352,"data_stored":145699147,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":239466950},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":13,"seq":55834576221,"num_pgs":103,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":226132,"kb_used_data":132484,"kb_used_omap":1,"kb_used_meta":93630,"kb_avail":94145708,"statfs":{"total":96636764160,"available":96405204992,"internally_reserved":0,"allocated":135663616,"data_stored":133464106,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":95877573},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834576222,"num_pgs":105,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":253236,"kb_used_data":145700,"kb_used_omap":1,"kb_used_meta":107518,"kb_avail":94118604,"statfs":{"total":96636764160,"available":96377450496,"internally_reserved":0,"allocated":149196800,"data_stored":147124325,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":110098885},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":13,"seq":55834576224,"num_pgs":124,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":396684,"kb_used_data":166972,"kb_used_omap":1,"kb_used_meta":229694,"kb_avail":93975156,"statfs":{"total":96636764160,"available":96230559744,"internally_reserved":0,"allocated":170979328,"data_stored":168801388,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":235207111},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834576221,"num_pgs":92,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":195020,"kb_used_data":127740,"kb_used_omap":1,"kb_used_meta":67262,"kb_avail":94176820,"statfs":{"total":96636764160,"available":96437063680,"internally_reserved":0,"allocated":130805760,"data_stored":128711851,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":68876741},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834576224,"num_pgs":112,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":281780,"kb_used_data":146532,"kb_used_omap":1,"kb_used_meta":135230,"kb_avail":94090060,"statfs":{"total":96636764160,"available":96348221440,"internally_reserved":0,"allocated":150048768,"data_stored":147909730,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":138475973},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834576222,"num_pgs":109,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":387488,"kb_used_data":157776,"kb_used_omap":1,"kb_used_meta":229694,"kb_avail":93984352,"statfs":{"total":96636764160,"available":96239976448,"internally_reserved":0,"allocated":161562624,"data_stored":159400235,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":235207109},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":112717824,"data_stored":112717824,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":95555584,"data_stored":95555584,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":83353600,"data_stored":83353600,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":111874048,"data_stored":111874048,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":110538752,"data_stored":110538752,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":119562240,"data_stored":119562240,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":105943040,"data_stored":105943040,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":112013312,"data_stored":112013312,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":1139,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":46,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":1185,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":562,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":184,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":470,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":98304,"data_stored":30908,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":114688,"data_stored":43011,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":10532,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":143360,"data_stored":49148,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":6107,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":159744,"data_stored":55366,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":81920,"data_stored":27675,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":135168,"data_stored":40355,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":86016,"data_stored":3328,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":3091,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4091,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":86016,"data_stored":4619,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":2771,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":77824,"data_stored":4485,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":2895,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":86016,"data_stored":4382,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":25923584,"data_stored":25920194,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":27267072,"data_stored":27266182,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":9437184,"data_stored":9437184,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":19922944,"data_stored":19922944,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20971520,"data_stored":20971520,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":10485760,"data_stored":10485760,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":23789568,"data_stored":23786103,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8429568,"data_stored":8428753,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":17829888,"data_stored":17828998,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":22736896,"data_stored":22734321,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":33599488,"data_stored":33597783,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":34643968,"data_stored":34643153,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":13299712,"data_stored":13297137,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":1048576,"data_stored":1048576,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":13631488,"data_stored":13631488,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":9437184,"data_stored":9437184,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-14T13:02:02.205 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-09-14T13:02:02.205 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-14T13:02:02.587 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-09-14T13:02:02.598 INFO:teuthology.orchestra.run.smithi138.stderr:dumped all 2024-09-14T13:02:02.603 INFO:teuthology.orchestra.run.smithi138.stdout:{"pg_ready":true,"pg_map":{"version":3677,"stamp":"2024-09-14T13:02:01.293466+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":713319548,"num_objects":1006,"num_object_clones":0,"num_object_copies":2509,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1006,"num_whiteouts":0,"num_read":304962,"num_read_kb":3450897,"num_write":149497,"num_write_kb":2498419,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":191,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":12949,"ondisk_log_size":12949,"up":850,"acting":850,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":850,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2488432,"kb_used_data":1153392,"kb_used_omap":12,"kb_used_meta":1334899,"kb_avail":752486288,"statfs":{"total":773094113280,"available":770545958912,"internally_reserved":0,"allocated":1181073408,"data_stored":1163932612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":1366937136},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.009529"},"pg_stats":[{"pgid":"68.1a","version":"0'0","reported_seq":38,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:58:43.044370+0000","last_change":"2024-09-14T11:58:43.698171+0000","last_active":"2024-09-14T12:58:43.044370+0000","last_peered":"2024-09-14T12:58:43.044370+0000","last_clean":"2024-09-14T12:58:43.044370+0000","last_became_active":"2024-09-14T11:58:43.694936+0000","last_became_peered":"2024-09-14T11:58:43.694936+0000","last_unstale":"2024-09-14T12:58:43.044370+0000","last_undegraded":"2024-09-14T12:58:43.044370+0000","last_fullsized":"2024-09-14T12:58:43.044370+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:58:42.635024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:58:42.635024+0000","last_clean_scrub_stamp":"2024-09-14T11:58:42.635024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:02:52.327879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.1d","version":"264'2","reported_seq":63,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:57:48.032148+0000","last_change":"2024-09-14T11:30:17.527028+0000","last_active":"2024-09-14T12:57:48.032148+0000","last_peered":"2024-09-14T12:57:48.032148+0000","last_clean":"2024-09-14T12:57:48.032148+0000","last_became_active":"2024-09-14T11:30:17.525157+0000","last_became_peered":"2024-09-14T11:30:17.525157+0000","last_unstale":"2024-09-14T12:57:48.032148+0000","last_undegraded":"2024-09-14T12:57:48.032148+0000","last_fullsized":"2024-09-14T12:57:48.032148+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:30:16.474654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:30:16.474654+0000","last_clean_scrub_stamp":"2024-09-14T11:30:16.474654+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:14:59.272162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":4096,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.1c","version":"267'4","reported_seq":74,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:57:43.449013+0000","last_change":"2024-09-14T11:30:10.466403+0000","last_active":"2024-09-14T12:57:43.449013+0000","last_peered":"2024-09-14T12:57:43.449013+0000","last_clean":"2024-09-14T12:57:43.449013+0000","last_became_active":"2024-09-14T11:30:10.460441+0000","last_became_peered":"2024-09-14T11:30:10.460441+0000","last_unstale":"2024-09-14T12:57:43.449013+0000","last_undegraded":"2024-09-14T12:57:43.449013+0000","last_fullsized":"2024-09-14T12:57:43.449013+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:30:09.411354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:30:09.411354+0000","last_clean_scrub_stamp":"2024-09-14T11:30:09.411354+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:47:20.165693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5242880,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":6,"num_read_kb":6189,"num_write":4,"num_write_kb":5165,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.1f","version":"267'84","reported_seq":312,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:57:58.447987+0000","last_change":"2024-09-14T11:24:10.106139+0000","last_active":"2024-09-14T12:57:58.447987+0000","last_peered":"2024-09-14T12:57:58.447987+0000","last_clean":"2024-09-14T12:57:58.447987+0000","last_became_active":"2024-09-14T11:24:10.104105+0000","last_became_peered":"2024-09-14T11:24:10.104105+0000","last_unstale":"2024-09-14T12:57:58.447987+0000","last_undegraded":"2024-09-14T12:57:58.447987+0000","last_fullsized":"2024-09-14T12:57:58.447987+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:24:09.066501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:24:09.066501+0000","last_clean_scrub_stamp":"2024-09-14T11:24:09.066501+0000","objects_scrubbed":0,"log_size":84,"log_dups_size":0,"ondisk_log_size":84,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:25:27.324710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":704,"num_read_kb":504,"num_write":208,"num_write_kb":68,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.1b","version":"0'0","reported_seq":38,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:58:42.823851+0000","last_change":"2024-09-14T11:58:43.694459+0000","last_active":"2024-09-14T12:58:42.823851+0000","last_peered":"2024-09-14T12:58:42.823851+0000","last_clean":"2024-09-14T12:58:42.823851+0000","last_became_active":"2024-09-14T11:58:43.693847+0000","last_became_peered":"2024-09-14T11:58:43.693847+0000","last_unstale":"2024-09-14T12:58:42.823851+0000","last_undegraded":"2024-09-14T12:58:42.823851+0000","last_fullsized":"2024-09-14T12:58:42.823851+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:58:42.635024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:58:42.635024+0000","last_clean_scrub_stamp":"2024-09-14T11:58:42.635024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:49:04.187747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.1c","version":"267'5","reported_seq":70,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:57:48.216115+0000","last_change":"2024-09-14T11:30:17.525550+0000","last_active":"2024-09-14T12:57:48.216115+0000","last_peered":"2024-09-14T12:57:48.216115+0000","last_clean":"2024-09-14T12:57:48.216115+0000","last_became_active":"2024-09-14T11:30:17.524810+0000","last_became_peered":"2024-09-14T11:30:17.524810+0000","last_unstale":"2024-09-14T12:57:48.216115+0000","last_undegraded":"2024-09-14T12:57:48.216115+0000","last_fullsized":"2024-09-14T12:57:48.216115+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:30:16.474654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:30:16.474654+0000","last_clean_scrub_stamp":"2024-09-14T11:30:16.474654+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:05:01.153652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7005681,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":6,"num_read_kb":11636,"num_write":10,"num_write_kb":6842,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.1d","version":"0'0","reported_seq":65,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:57:43.447885+0000","last_change":"2024-09-14T11:30:10.475624+0000","last_active":"2024-09-14T12:57:43.447885+0000","last_peered":"2024-09-14T12:57:43.447885+0000","last_clean":"2024-09-14T12:57:43.447885+0000","last_became_active":"2024-09-14T11:30:10.474889+0000","last_became_peered":"2024-09-14T11:30:10.474889+0000","last_unstale":"2024-09-14T12:57:43.447885+0000","last_undegraded":"2024-09-14T12:57:43.447885+0000","last_fullsized":"2024-09-14T12:57:43.447885+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:30:09.411354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:30:09.411354+0000","last_clean_scrub_stamp":"2024-09-14T11:30:09.411354+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:14:21.245898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.1e","version":"267'279","reported_seq":912,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:58:42.824027+0000","last_change":"2024-09-14T11:24:10.091187+0000","last_active":"2024-09-14T12:58:42.824027+0000","last_peered":"2024-09-14T12:58:42.824027+0000","last_clean":"2024-09-14T12:58:42.824027+0000","last_became_active":"2024-09-14T11:24:10.090434+0000","last_became_peered":"2024-09-14T11:24:10.090434+0000","last_unstale":"2024-09-14T12:58:42.824027+0000","last_undegraded":"2024-09-14T12:58:42.824027+0000","last_fullsized":"2024-09-14T12:58:42.824027+0000","mapping_epoch":254,"log_start":"264'200","ondisk_log_start":"264'200","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:24:09.066501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:24:09.066501+0000","last_clean_scrub_stamp":"2024-09-14T11:24:09.066501+0000","objects_scrubbed":0,"log_size":79,"log_dups_size":200,"ondisk_log_size":79,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:12:05.681242+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2587,"num_read_kb":3188,"num_write":542,"num_write_kb":246,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.18","version":"0'0","reported_seq":39,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:59:08.431805+0000","last_change":"2024-09-14T11:58:43.686083+0000","last_active":"2024-09-14T12:59:08.431805+0000","last_peered":"2024-09-14T12:59:08.431805+0000","last_clean":"2024-09-14T12:59:08.431805+0000","last_became_active":"2024-09-14T11:58:43.685333+0000","last_became_peered":"2024-09-14T11:58:43.685333+0000","last_unstale":"2024-09-14T12:59:08.431805+0000","last_undegraded":"2024-09-14T12:59:08.431805+0000","last_fullsized":"2024-09-14T12:59:08.431805+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:58:42.635024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:58:42.635024+0000","last_clean_scrub_stamp":"2024-09-14T11:58:42.635024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:32:25.076693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"67.1f","version":"267'3","reported_seq":73,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:59:53.257511+0000","last_change":"2024-09-14T11:30:17.501198+0000","last_active":"2024-09-14T12:59:53.257511+0000","last_peered":"2024-09-14T12:59:53.257511+0000","last_clean":"2024-09-14T12:59:53.257511+0000","last_became_active":"2024-09-14T11:30:17.500369+0000","last_became_peered":"2024-09-14T11:30:17.500369+0000","last_unstale":"2024-09-14T12:59:53.257511+0000","last_undegraded":"2024-09-14T12:59:53.257511+0000","last_fullsized":"2024-09-14T12:59:53.257511+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:30:16.474654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:30:16.474654+0000","last_clean_scrub_stamp":"2024-09-14T11:30:16.474654+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:11:41.361082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4,"num_read_kb":8192,"num_write":3,"num_write_kb":8192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.1e","version":"264'4","reported_seq":84,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:58:42.824072+0000","last_change":"2024-09-14T11:30:10.446414+0000","last_active":"2024-09-14T12:58:42.824072+0000","last_peered":"2024-09-14T12:58:42.824072+0000","last_clean":"2024-09-14T12:58:42.824072+0000","last_became_active":"2024-09-14T11:30:10.445613+0000","last_became_peered":"2024-09-14T11:30:10.445613+0000","last_unstale":"2024-09-14T12:58:42.824072+0000","last_undegraded":"2024-09-14T12:58:42.824072+0000","last_fullsized":"2024-09-14T12:58:42.824072+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:30:09.411354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:30:09.411354+0000","last_clean_scrub_stamp":"2024-09-14T11:30:09.411354+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:21:50.415695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":4098,"num_write":4,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.1d","version":"267'16","reported_seq":119,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:59:13.248167+0000","last_change":"2024-09-14T11:24:10.112019+0000","last_active":"2024-09-14T12:59:13.248167+0000","last_peered":"2024-09-14T12:59:13.248167+0000","last_clean":"2024-09-14T12:59:13.248167+0000","last_became_active":"2024-09-14T11:24:10.111323+0000","last_became_peered":"2024-09-14T11:24:10.111323+0000","last_unstale":"2024-09-14T12:59:13.248167+0000","last_undegraded":"2024-09-14T12:59:13.248167+0000","last_fullsized":"2024-09-14T12:59:13.248167+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:24:09.066501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:24:09.066501+0000","last_clean_scrub_stamp":"2024-09-14T11:24:09.066501+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:39:25.435594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":134,"num_read_kb":93,"num_write":40,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.19","version":"0'0","reported_seq":39,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:59:18.471470+0000","last_change":"2024-09-14T11:58:43.701511+0000","last_active":"2024-09-14T12:59:18.471470+0000","last_peered":"2024-09-14T12:59:18.471470+0000","last_clean":"2024-09-14T12:59:18.471470+0000","last_became_active":"2024-09-14T11:58:43.700281+0000","last_became_peered":"2024-09-14T11:58:43.700281+0000","last_unstale":"2024-09-14T12:59:18.471470+0000","last_undegraded":"2024-09-14T12:59:18.471470+0000","last_fullsized":"2024-09-14T12:59:18.471470+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:58:42.635024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:58:42.635024+0000","last_clean_scrub_stamp":"2024-09-14T11:58:42.635024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:42:11.274748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.1e","version":"267'4","reported_seq":75,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:58:38.461692+0000","last_change":"2024-09-14T11:30:17.539744+0000","last_active":"2024-09-14T12:58:38.461692+0000","last_peered":"2024-09-14T12:58:38.461692+0000","last_clean":"2024-09-14T12:58:38.461692+0000","last_became_active":"2024-09-14T11:30:17.534642+0000","last_became_peered":"2024-09-14T11:30:17.534642+0000","last_unstale":"2024-09-14T12:58:38.461692+0000","last_undegraded":"2024-09-14T12:58:38.461692+0000","last_fullsized":"2024-09-14T12:58:38.461692+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:30:16.474654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:30:16.474654+0000","last_clean_scrub_stamp":"2024-09-14T11:30:16.474654+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:11:49.468312+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1088721,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":4,"num_read_kb":1064,"num_write":4,"num_write_kb":2088,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.1f","version":"267'1","reported_seq":74,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:59:48.243696+0000","last_change":"2024-09-14T11:30:10.443371+0000","last_active":"2024-09-14T12:59:48.243696+0000","last_peered":"2024-09-14T12:59:48.243696+0000","last_clean":"2024-09-14T12:59:48.243696+0000","last_became_active":"2024-09-14T11:30:10.442597+0000","last_became_peered":"2024-09-14T11:30:10.442597+0000","last_unstale":"2024-09-14T12:59:48.243696+0000","last_undegraded":"2024-09-14T12:59:48.243696+0000","last_fullsized":"2024-09-14T12:59:48.243696+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:30:09.411354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:30:09.411354+0000","last_clean_scrub_stamp":"2024-09-14T11:30:09.411354+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:25:51.419864+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1048576,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.1c","version":"267'41","reported_seq":188,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:59:13.470500+0000","last_change":"2024-09-14T11:24:10.128607+0000","last_active":"2024-09-14T12:59:13.470500+0000","last_peered":"2024-09-14T12:59:13.470500+0000","last_clean":"2024-09-14T12:59:13.470500+0000","last_became_active":"2024-09-14T11:24:10.124422+0000","last_became_peered":"2024-09-14T11:24:10.124422+0000","last_unstale":"2024-09-14T12:59:13.470500+0000","last_undegraded":"2024-09-14T12:59:13.470500+0000","last_fullsized":"2024-09-14T12:59:13.470500+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:24:09.066501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:24:09.066501+0000","last_clean_scrub_stamp":"2024-09-14T11:24:09.066501+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":0,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:13:03.605737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":350,"num_read_kb":247,"num_write":96,"num_write_kb":33,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.1e","version":"0'0","reported_seq":44,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:58:53.465451+0000","last_change":"2024-09-14T11:58:43.694842+0000","last_active":"2024-09-14T12:58:53.465451+0000","last_peered":"2024-09-14T12:58:53.465451+0000","last_clean":"2024-09-14T12:58:53.465451+0000","last_became_active":"2024-09-14T11:58:43.693760+0000","last_became_peered":"2024-09-14T11:58:43.693760+0000","last_unstale":"2024-09-14T12:58:53.465451+0000","last_undegraded":"2024-09-14T12:58:53.465451+0000","last_fullsized":"2024-09-14T12:58:53.465451+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:58:42.635024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:58:42.635024+0000","last_clean_scrub_stamp":"2024-09-14T11:58:42.635024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:18:34.791994+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.19","version":"0'0","reported_seq":60,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:57:43.030891+0000","last_change":"2024-09-14T11:30:17.531794+0000","last_active":"2024-09-14T12:57:43.030891+0000","last_peered":"2024-09-14T12:57:43.030891+0000","last_clean":"2024-09-14T12:57:43.030891+0000","last_became_active":"2024-09-14T11:30:17.531325+0000","last_became_peered":"2024-09-14T11:30:17.531325+0000","last_unstale":"2024-09-14T12:57:43.030891+0000","last_undegraded":"2024-09-14T12:57:43.030891+0000","last_fullsized":"2024-09-14T12:57:43.030891+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:30:16.474654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:30:16.474654+0000","last_clean_scrub_stamp":"2024-09-14T11:30:16.474654+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:04:12.434378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.18","version":"264'8","reported_seq":82,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:57:13.436998+0000","last_change":"2024-09-14T11:30:10.461819+0000","last_active":"2024-09-14T12:57:13.436998+0000","last_peered":"2024-09-14T12:57:13.436998+0000","last_clean":"2024-09-14T12:57:13.436998+0000","last_became_active":"2024-09-14T11:30:10.461101+0000","last_became_peered":"2024-09-14T11:30:10.461101+0000","last_unstale":"2024-09-14T12:57:13.436998+0000","last_undegraded":"2024-09-14T12:57:13.436998+0000","last_fullsized":"2024-09-14T12:57:13.436998+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:30:09.411354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:30:09.411354+0000","last_clean_scrub_stamp":"2024-09-14T11:30:09.411354+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:19:37.256749+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":8194,"num_write":18,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.1b","version":"264'28","reported_seq":149,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:59:13.470382+0000","last_change":"2024-09-14T11:24:10.130205+0000","last_active":"2024-09-14T12:59:13.470382+0000","last_peered":"2024-09-14T12:59:13.470382+0000","last_clean":"2024-09-14T12:59:13.470382+0000","last_became_active":"2024-09-14T11:24:10.129087+0000","last_became_peered":"2024-09-14T11:24:10.129087+0000","last_unstale":"2024-09-14T12:59:13.470382+0000","last_undegraded":"2024-09-14T12:59:13.470382+0000","last_fullsized":"2024-09-14T12:59:13.470382+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:24:09.066501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:24:09.066501+0000","last_clean_scrub_stamp":"2024-09-14T11:24:09.066501+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:55:41.881393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":229,"num_read_kb":159,"num_write":68,"num_write_kb":22,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.1f","version":"0'0","reported_seq":43,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:59:08.466883+0000","last_change":"2024-09-14T11:58:43.686856+0000","last_active":"2024-09-14T12:59:08.466883+0000","last_peered":"2024-09-14T12:59:08.466883+0000","last_clean":"2024-09-14T12:59:08.466883+0000","last_became_active":"2024-09-14T11:58:43.676679+0000","last_became_peered":"2024-09-14T11:58:43.676679+0000","last_unstale":"2024-09-14T12:59:08.466883+0000","last_undegraded":"2024-09-14T12:59:08.466883+0000","last_fullsized":"2024-09-14T12:59:08.466883+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:58:42.635024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:58:42.635024+0000","last_clean_scrub_stamp":"2024-09-14T11:58:42.635024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:32:45.311295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"67.18","version":"264'8","reported_seq":78,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:57:18.599896+0000","last_change":"2024-09-14T11:30:17.546333+0000","last_active":"2024-09-14T12:57:18.599896+0000","last_peered":"2024-09-14T12:57:18.599896+0000","last_clean":"2024-09-14T12:57:18.599896+0000","last_became_active":"2024-09-14T11:30:17.545478+0000","last_became_peered":"2024-09-14T11:30:17.545478+0000","last_unstale":"2024-09-14T12:57:18.599896+0000","last_undegraded":"2024-09-14T12:57:18.599896+0000","last_fullsized":"2024-09-14T12:57:18.599896+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:30:16.474654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:30:16.474654+0000","last_clean_scrub_stamp":"2024-09-14T11:30:16.474654+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:21:51.712103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":4166,"num_write":8,"num_write_kb":1092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"66.19","version":"267'5","reported_seq":74,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:57:33.212757+0000","last_change":"2024-09-14T11:30:10.467953+0000","last_active":"2024-09-14T12:57:33.212757+0000","last_peered":"2024-09-14T12:57:33.212757+0000","last_clean":"2024-09-14T12:57:33.212757+0000","last_became_active":"2024-09-14T11:30:10.467266+0000","last_became_peered":"2024-09-14T11:30:10.467266+0000","last_unstale":"2024-09-14T12:57:33.212757+0000","last_undegraded":"2024-09-14T12:57:33.212757+0000","last_fullsized":"2024-09-14T12:57:33.212757+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:30:09.411354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:30:09.411354+0000","last_clean_scrub_stamp":"2024-09-14T11:30:09.411354+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:25:57.710422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2097152,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":4,"num_read_kb":1047,"num_write":10,"num_write_kb":2071,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.1a","version":"267'87","reported_seq":314,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:59:13.433017+0000","last_change":"2024-09-14T11:24:10.121775+0000","last_active":"2024-09-14T12:59:13.433017+0000","last_peered":"2024-09-14T12:59:13.433017+0000","last_clean":"2024-09-14T12:59:13.433017+0000","last_became_active":"2024-09-14T11:24:10.121048+0000","last_became_peered":"2024-09-14T11:24:10.121048+0000","last_unstale":"2024-09-14T12:59:13.433017+0000","last_undegraded":"2024-09-14T12:59:13.433017+0000","last_fullsized":"2024-09-14T12:59:13.433017+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:24:09.066501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:24:09.066501+0000","last_clean_scrub_stamp":"2024-09-14T11:24:09.066501+0000","objects_scrubbed":0,"log_size":87,"log_dups_size":0,"ondisk_log_size":87,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:56:22.236572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":696,"num_read_kb":437,"num_write":216,"num_write_kb":62,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.1c","version":"267'1","reported_seq":39,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:58:47.835392+0000","last_change":"2024-09-14T11:58:43.685706+0000","last_active":"2024-09-14T12:58:47.835392+0000","last_peered":"2024-09-14T12:58:47.835392+0000","last_clean":"2024-09-14T12:58:47.835392+0000","last_became_active":"2024-09-14T11:58:43.684984+0000","last_became_peered":"2024-09-14T11:58:43.684984+0000","last_unstale":"2024-09-14T12:58:47.835392+0000","last_undegraded":"2024-09-14T12:58:47.835392+0000","last_fullsized":"2024-09-14T12:58:47.835392+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:58:42.635024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:58:42.635024+0000","last_clean_scrub_stamp":"2024-09-14T11:58:42.635024+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:29:12.171056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.1b","version":"0'0","reported_seq":59,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:57:48.606470+0000","last_change":"2024-09-14T11:30:17.527032+0000","last_active":"2024-09-14T12:57:48.606470+0000","last_peered":"2024-09-14T12:57:48.606470+0000","last_clean":"2024-09-14T12:57:48.606470+0000","last_became_active":"2024-09-14T11:30:17.526195+0000","last_became_peered":"2024-09-14T11:30:17.526195+0000","last_unstale":"2024-09-14T12:57:48.606470+0000","last_undegraded":"2024-09-14T12:57:48.606470+0000","last_fullsized":"2024-09-14T12:57:48.606470+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:30:16.474654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:30:16.474654+0000","last_clean_scrub_stamp":"2024-09-14T11:30:16.474654+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:49:29.835475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"66.1a","version":"264'2","reported_seq":69,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:57:43.214859+0000","last_change":"2024-09-14T11:30:10.443423+0000","last_active":"2024-09-14T12:57:43.214859+0000","last_peered":"2024-09-14T12:57:43.214859+0000","last_clean":"2024-09-14T12:57:43.214859+0000","last_became_active":"2024-09-14T11:30:10.442753+0000","last_became_peered":"2024-09-14T11:30:10.442753+0000","last_unstale":"2024-09-14T12:57:43.214859+0000","last_undegraded":"2024-09-14T12:57:43.214859+0000","last_fullsized":"2024-09-14T12:57:43.214859+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:30:09.411354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:30:09.411354+0000","last_clean_scrub_stamp":"2024-09-14T11:30:09.411354+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:17:07.453981+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":4096,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.19","version":"267'12","reported_seq":105,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:58:53.242473+0000","last_change":"2024-09-14T11:24:10.099618+0000","last_active":"2024-09-14T12:58:53.242473+0000","last_peered":"2024-09-14T12:58:53.242473+0000","last_clean":"2024-09-14T12:58:53.242473+0000","last_became_active":"2024-09-14T11:24:10.098890+0000","last_became_peered":"2024-09-14T11:24:10.098890+0000","last_unstale":"2024-09-14T12:58:53.242473+0000","last_undegraded":"2024-09-14T12:58:53.242473+0000","last_fullsized":"2024-09-14T12:58:53.242473+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:24:09.066501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:24:09.066501+0000","last_clean_scrub_stamp":"2024-09-14T11:24:09.066501+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:33:18.468820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":81,"num_read_kb":53,"num_write":29,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.1d","version":"0'0","reported_seq":38,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:58:47.835476+0000","last_change":"2024-09-14T11:58:43.688034+0000","last_active":"2024-09-14T12:58:47.835476+0000","last_peered":"2024-09-14T12:58:47.835476+0000","last_clean":"2024-09-14T12:58:47.835476+0000","last_became_active":"2024-09-14T11:58:43.687072+0000","last_became_peered":"2024-09-14T11:58:43.687072+0000","last_unstale":"2024-09-14T12:58:47.835476+0000","last_undegraded":"2024-09-14T12:58:47.835476+0000","last_fullsized":"2024-09-14T12:58:47.835476+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:58:42.635024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:58:42.635024+0000","last_clean_scrub_stamp":"2024-09-14T11:58:42.635024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:54:30.111603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.1a","version":"0'0","reported_seq":59,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:57:48.450199+0000","last_change":"2024-09-14T11:30:17.535485+0000","last_active":"2024-09-14T12:57:48.450199+0000","last_peered":"2024-09-14T12:57:48.450199+0000","last_clean":"2024-09-14T12:57:48.450199+0000","last_became_active":"2024-09-14T11:30:17.534937+0000","last_became_peered":"2024-09-14T11:30:17.534937+0000","last_unstale":"2024-09-14T12:57:48.450199+0000","last_undegraded":"2024-09-14T12:57:48.450199+0000","last_fullsized":"2024-09-14T12:57:48.450199+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:30:16.474654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:30:16.474654+0000","last_clean_scrub_stamp":"2024-09-14T11:30:16.474654+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:48:56.727170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.1b","version":"267'4","reported_seq":74,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:57:43.444836+0000","last_change":"2024-09-14T11:30:10.461481+0000","last_active":"2024-09-14T12:57:43.444836+0000","last_peered":"2024-09-14T12:57:43.444836+0000","last_clean":"2024-09-14T12:57:43.444836+0000","last_became_active":"2024-09-14T11:30:10.460666+0000","last_became_peered":"2024-09-14T11:30:10.460666+0000","last_unstale":"2024-09-14T12:57:43.444836+0000","last_undegraded":"2024-09-14T12:57:43.444836+0000","last_fullsized":"2024-09-14T12:57:43.444836+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:30:09.411354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:30:09.411354+0000","last_clean_scrub_stamp":"2024-09-14T11:30:09.411354+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:56:08.121178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":6,"num_read_kb":14336,"num_write":4,"num_write_kb":10240,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.18","version":"267'142","reported_seq":495,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:58:28.457825+0000","last_change":"2024-09-14T11:24:10.121116+0000","last_active":"2024-09-14T12:58:28.457825+0000","last_peered":"2024-09-14T12:58:28.457825+0000","last_clean":"2024-09-14T12:58:28.457825+0000","last_became_active":"2024-09-14T11:24:10.117854+0000","last_became_peered":"2024-09-14T11:24:10.117854+0000","last_unstale":"2024-09-14T12:58:28.457825+0000","last_undegraded":"2024-09-14T12:58:28.457825+0000","last_fullsized":"2024-09-14T12:58:28.457825+0000","mapping_epoch":254,"log_start":"264'100","ondisk_log_start":"264'100","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:24:09.066501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:24:09.066501+0000","last_clean_scrub_stamp":"2024-09-14T11:24:09.066501+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":100,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:44:16.667239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1285,"num_read_kb":1365,"num_write":297,"num_write_kb":120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"68.12","version":"0'0","reported_seq":40,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:59:23.469971+0000","last_change":"2024-09-14T11:58:43.678310+0000","last_active":"2024-09-14T12:59:23.469971+0000","last_peered":"2024-09-14T12:59:23.469971+0000","last_clean":"2024-09-14T12:59:23.469971+0000","last_became_active":"2024-09-14T11:58:43.675254+0000","last_became_peered":"2024-09-14T11:58:43.675254+0000","last_unstale":"2024-09-14T12:59:23.469971+0000","last_undegraded":"2024-09-14T12:59:23.469971+0000","last_fullsized":"2024-09-14T12:59:23.469971+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:58:42.635024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:58:42.635024+0000","last_clean_scrub_stamp":"2024-09-14T11:58:42.635024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:53:22.218376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"67.15","version":"267'1","reported_seq":63,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:57:18.439393+0000","last_change":"2024-09-14T11:30:17.539875+0000","last_active":"2024-09-14T12:57:18.439393+0000","last_peered":"2024-09-14T12:57:18.439393+0000","last_clean":"2024-09-14T12:57:18.439393+0000","last_became_active":"2024-09-14T11:30:17.536010+0000","last_became_peered":"2024-09-14T11:30:17.536010+0000","last_unstale":"2024-09-14T12:57:18.439393+0000","last_undegraded":"2024-09-14T12:57:18.439393+0000","last_fullsized":"2024-09-14T12:57:18.439393+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:30:16.474654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:30:16.474654+0000","last_clean_scrub_stamp":"2024-09-14T11:30:16.474654+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:50:45.649965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":8192,"num_write":1,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.14","version":"267'4","reported_seq":75,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:59:18.052199+0000","last_change":"2024-09-14T11:30:10.463826+0000","last_active":"2024-09-14T12:59:18.052199+0000","last_peered":"2024-09-14T12:59:18.052199+0000","last_clean":"2024-09-14T12:59:18.052199+0000","last_became_active":"2024-09-14T11:30:10.462605+0000","last_became_peered":"2024-09-14T11:30:10.462605+0000","last_unstale":"2024-09-14T12:59:18.052199+0000","last_undegraded":"2024-09-14T12:59:18.052199+0000","last_fullsized":"2024-09-14T12:59:18.052199+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:30:09.411354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:30:09.411354+0000","last_clean_scrub_stamp":"2024-09-14T11:30:09.411354+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:10:34.672801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4,"num_read_kb":5120,"num_write":9,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.17","version":"267'12","reported_seq":105,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:58:28.236663+0000","last_change":"2024-09-14T11:24:10.104884+0000","last_active":"2024-09-14T12:58:28.236663+0000","last_peered":"2024-09-14T12:58:28.236663+0000","last_clean":"2024-09-14T12:58:28.236663+0000","last_became_active":"2024-09-14T11:24:10.101934+0000","last_became_peered":"2024-09-14T11:24:10.101934+0000","last_unstale":"2024-09-14T12:58:28.236663+0000","last_undegraded":"2024-09-14T12:58:28.236663+0000","last_fullsized":"2024-09-14T12:58:28.236663+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:24:09.066501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:24:09.066501+0000","last_clean_scrub_stamp":"2024-09-14T11:24:09.066501+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:18:41.803884+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":86,"num_read_kb":56,"num_write":31,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.13","version":"267'1","reported_seq":41,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:59:22.832843+0000","last_change":"2024-09-14T11:58:43.676310+0000","last_active":"2024-09-14T12:59:22.832843+0000","last_peered":"2024-09-14T12:59:22.832843+0000","last_clean":"2024-09-14T12:59:22.832843+0000","last_became_active":"2024-09-14T11:58:43.675526+0000","last_became_peered":"2024-09-14T11:58:43.675526+0000","last_unstale":"2024-09-14T12:59:22.832843+0000","last_undegraded":"2024-09-14T12:59:22.832843+0000","last_fullsized":"2024-09-14T12:59:22.832843+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:58:42.635024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:58:42.635024+0000","last_clean_scrub_stamp":"2024-09-14T11:58:42.635024+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:44:06.879207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.14","version":"267'6","reported_seq":75,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:59:18.471550+0000","last_change":"2024-09-14T11:30:17.544306+0000","last_active":"2024-09-14T12:59:18.471550+0000","last_peered":"2024-09-14T12:59:18.471550+0000","last_clean":"2024-09-14T12:59:18.471550+0000","last_became_active":"2024-09-14T11:30:17.543741+0000","last_became_peered":"2024-09-14T11:30:17.543741+0000","last_unstale":"2024-09-14T12:59:18.471550+0000","last_undegraded":"2024-09-14T12:59:18.471550+0000","last_fullsized":"2024-09-14T12:59:18.471550+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:30:16.474654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:30:16.474654+0000","last_clean_scrub_stamp":"2024-09-14T11:30:16.474654+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:33:14.837541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":10,"num_read_kb":20482,"num_write":11,"num_write_kb":8192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.15","version":"267'2","reported_seq":70,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:57:12.813093+0000","last_change":"2024-09-14T11:30:10.468990+0000","last_active":"2024-09-14T12:57:12.813093+0000","last_peered":"2024-09-14T12:57:12.813093+0000","last_clean":"2024-09-14T12:57:12.813093+0000","last_became_active":"2024-09-14T11:30:10.468238+0000","last_became_peered":"2024-09-14T11:30:10.468238+0000","last_unstale":"2024-09-14T12:57:12.813093+0000","last_undegraded":"2024-09-14T12:57:12.813093+0000","last_fullsized":"2024-09-14T12:57:12.813093+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:30:09.411354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:30:09.411354+0000","last_clean_scrub_stamp":"2024-09-14T11:30:09.411354+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:48:16.808159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1048576,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2048,"num_write":7,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.16","version":"267'33","reported_seq":168,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:58:28.459408+0000","last_change":"2024-09-14T11:24:10.129833+0000","last_active":"2024-09-14T12:58:28.459408+0000","last_peered":"2024-09-14T12:58:28.459408+0000","last_clean":"2024-09-14T12:58:28.459408+0000","last_became_active":"2024-09-14T11:24:10.128354+0000","last_became_peered":"2024-09-14T11:24:10.128354+0000","last_unstale":"2024-09-14T12:58:28.459408+0000","last_undegraded":"2024-09-14T12:58:28.459408+0000","last_fullsized":"2024-09-14T12:58:28.459408+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:24:09.066501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:24:09.066501+0000","last_clean_scrub_stamp":"2024-09-14T11:24:09.066501+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:04:36.875537+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":269,"num_read_kb":173,"num_write":83,"num_write_kb":23,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.10","version":"0'0","reported_seq":40,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:59:27.844631+0000","last_change":"2024-09-14T11:58:43.689414+0000","last_active":"2024-09-14T12:59:27.844631+0000","last_peered":"2024-09-14T12:59:27.844631+0000","last_clean":"2024-09-14T12:59:27.844631+0000","last_became_active":"2024-09-14T11:58:43.688698+0000","last_became_peered":"2024-09-14T11:58:43.688698+0000","last_unstale":"2024-09-14T12:59:27.844631+0000","last_undegraded":"2024-09-14T12:59:27.844631+0000","last_fullsized":"2024-09-14T12:59:27.844631+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:58:42.635024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:58:42.635024+0000","last_clean_scrub_stamp":"2024-09-14T11:58:42.635024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:13:07.184551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.17","version":"267'3","reported_seq":68,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:57:18.439507+0000","last_change":"2024-09-14T11:30:17.544374+0000","last_active":"2024-09-14T12:57:18.439507+0000","last_peered":"2024-09-14T12:57:18.439507+0000","last_clean":"2024-09-14T12:57:18.439507+0000","last_became_active":"2024-09-14T11:30:17.543802+0000","last_became_peered":"2024-09-14T11:30:17.543802+0000","last_unstale":"2024-09-14T12:57:18.439507+0000","last_undegraded":"2024-09-14T12:57:18.439507+0000","last_fullsized":"2024-09-14T12:57:18.439507+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:30:16.474654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:30:16.474654+0000","last_clean_scrub_stamp":"2024-09-14T11:30:16.474654+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:16:04.970158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":5,"num_read_kb":20480,"num_write":8,"num_write_kb":8192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.16","version":"264'4","reported_seq":76,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:57:12.805460+0000","last_change":"2024-09-14T11:30:10.472659+0000","last_active":"2024-09-14T12:57:12.805460+0000","last_peered":"2024-09-14T12:57:12.805460+0000","last_clean":"2024-09-14T12:57:12.805460+0000","last_became_active":"2024-09-14T11:30:10.471956+0000","last_became_peered":"2024-09-14T11:30:10.471956+0000","last_unstale":"2024-09-14T12:57:12.805460+0000","last_undegraded":"2024-09-14T12:57:12.805460+0000","last_fullsized":"2024-09-14T12:57:12.805460+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:30:09.411354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:30:09.411354+0000","last_clean_scrub_stamp":"2024-09-14T11:30:09.411354+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:46:34.361903+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":4098,"num_write":4,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.15","version":"267'34","reported_seq":165,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:58:27.820574+0000","last_change":"2024-09-14T11:24:10.097703+0000","last_active":"2024-09-14T12:58:27.820574+0000","last_peered":"2024-09-14T12:58:27.820574+0000","last_clean":"2024-09-14T12:58:27.820574+0000","last_became_active":"2024-09-14T11:24:10.097011+0000","last_became_peered":"2024-09-14T11:24:10.097011+0000","last_unstale":"2024-09-14T12:58:27.820574+0000","last_undegraded":"2024-09-14T12:58:27.820574+0000","last_fullsized":"2024-09-14T12:58:27.820574+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:24:09.066501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:24:09.066501+0000","last_clean_scrub_stamp":"2024-09-14T11:24:09.066501+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:37:34.066370+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":263,"num_read_kb":166,"num_write":89,"num_write_kb":24,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.11","version":"0'0","reported_seq":40,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:59:23.053229+0000","last_change":"2024-09-14T11:58:43.689926+0000","last_active":"2024-09-14T12:59:23.053229+0000","last_peered":"2024-09-14T12:59:23.053229+0000","last_clean":"2024-09-14T12:59:23.053229+0000","last_became_active":"2024-09-14T11:58:43.688315+0000","last_became_peered":"2024-09-14T11:58:43.688315+0000","last_unstale":"2024-09-14T12:59:23.053229+0000","last_undegraded":"2024-09-14T12:59:23.053229+0000","last_fullsized":"2024-09-14T12:59:23.053229+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:58:42.635024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:58:42.635024+0000","last_clean_scrub_stamp":"2024-09-14T11:58:42.635024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:41:40.616158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.16","version":"0'0","reported_seq":60,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:57:18.209507+0000","last_change":"2024-09-14T11:30:17.529543+0000","last_active":"2024-09-14T12:57:18.209507+0000","last_peered":"2024-09-14T12:57:18.209507+0000","last_clean":"2024-09-14T12:57:18.209507+0000","last_became_active":"2024-09-14T11:30:17.528777+0000","last_became_peered":"2024-09-14T11:30:17.528777+0000","last_unstale":"2024-09-14T12:57:18.209507+0000","last_undegraded":"2024-09-14T12:57:18.209507+0000","last_fullsized":"2024-09-14T12:57:18.209507+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:30:16.474654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:30:16.474654+0000","last_clean_scrub_stamp":"2024-09-14T11:30:16.474654+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:39:05.624425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.17","version":"267'2","reported_seq":70,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:57:13.437466+0000","last_change":"2024-09-14T11:30:10.473815+0000","last_active":"2024-09-14T12:57:13.437466+0000","last_peered":"2024-09-14T12:57:13.437466+0000","last_clean":"2024-09-14T12:57:13.437466+0000","last_became_active":"2024-09-14T11:30:10.469237+0000","last_became_peered":"2024-09-14T11:30:10.469237+0000","last_unstale":"2024-09-14T12:57:13.437466+0000","last_undegraded":"2024-09-14T12:57:13.437466+0000","last_fullsized":"2024-09-14T12:57:13.437466+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:30:09.411354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:30:09.411354+0000","last_clean_scrub_stamp":"2024-09-14T11:30:09.411354+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:02:16.697692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4908529,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":4794,"num_write":2,"num_write_kb":4794,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.14","version":"267'34","reported_seq":163,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:58:02.824925+0000","last_change":"2024-09-14T11:24:10.120917+0000","last_active":"2024-09-14T12:58:02.824925+0000","last_peered":"2024-09-14T12:58:02.824925+0000","last_clean":"2024-09-14T12:58:02.824925+0000","last_became_active":"2024-09-14T11:24:10.120143+0000","last_became_peered":"2024-09-14T11:24:10.120143+0000","last_unstale":"2024-09-14T12:58:02.824925+0000","last_undegraded":"2024-09-14T12:58:02.824925+0000","last_fullsized":"2024-09-14T12:58:02.824925+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:24:09.066501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:24:09.066501+0000","last_clean_scrub_stamp":"2024-09-14T11:24:09.066501+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:47:01.835320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":239,"num_read_kb":157,"num_write":95,"num_write_kb":23,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.16","version":"0'0","reported_seq":39,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:59:08.469272+0000","last_change":"2024-09-14T11:58:43.687060+0000","last_active":"2024-09-14T12:59:08.469272+0000","last_peered":"2024-09-14T12:59:08.469272+0000","last_clean":"2024-09-14T12:59:08.469272+0000","last_became_active":"2024-09-14T11:58:43.685594+0000","last_became_peered":"2024-09-14T11:58:43.685594+0000","last_unstale":"2024-09-14T12:59:08.469272+0000","last_undegraded":"2024-09-14T12:59:08.469272+0000","last_fullsized":"2024-09-14T12:59:08.469272+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:58:42.635024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:58:42.635024+0000","last_clean_scrub_stamp":"2024-09-14T11:58:42.635024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:15:01.961069+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.11","version":"264'4","reported_seq":72,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:58:58.464568+0000","last_change":"2024-09-14T11:30:17.524449+0000","last_active":"2024-09-14T12:58:58.464568+0000","last_peered":"2024-09-14T12:58:58.464568+0000","last_clean":"2024-09-14T12:58:58.464568+0000","last_became_active":"2024-09-14T11:30:17.523720+0000","last_became_peered":"2024-09-14T11:30:17.523720+0000","last_unstale":"2024-09-14T12:58:58.464568+0000","last_undegraded":"2024-09-14T12:58:58.464568+0000","last_fullsized":"2024-09-14T12:58:58.464568+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:30:16.474654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:30:16.474654+0000","last_clean_scrub_stamp":"2024-09-14T11:30:16.474654+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:47:46.829903+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":4098,"num_write":4,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.10","version":"264'2","reported_seq":72,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:58:53.231284+0000","last_change":"2024-09-14T11:30:10.464461+0000","last_active":"2024-09-14T12:58:53.231284+0000","last_peered":"2024-09-14T12:58:53.231284+0000","last_clean":"2024-09-14T12:58:53.231284+0000","last_became_active":"2024-09-14T11:30:10.463671+0000","last_became_peered":"2024-09-14T11:30:10.463671+0000","last_unstale":"2024-09-14T12:58:53.231284+0000","last_undegraded":"2024-09-14T12:58:53.231284+0000","last_fullsized":"2024-09-14T12:58:53.231284+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:30:09.411354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:30:09.411354+0000","last_clean_scrub_stamp":"2024-09-14T11:30:09.411354+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:20:15.603839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":4096,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.13","version":"267'23","reported_seq":139,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:57:32.817933+0000","last_change":"2024-09-14T11:24:10.121802+0000","last_active":"2024-09-14T12:57:32.817933+0000","last_peered":"2024-09-14T12:57:32.817933+0000","last_clean":"2024-09-14T12:57:32.817933+0000","last_became_active":"2024-09-14T11:24:10.120764+0000","last_became_peered":"2024-09-14T11:24:10.120764+0000","last_unstale":"2024-09-14T12:57:32.817933+0000","last_undegraded":"2024-09-14T12:57:32.817933+0000","last_fullsized":"2024-09-14T12:57:32.817933+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:24:09.066501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:24:09.066501+0000","last_clean_scrub_stamp":"2024-09-14T11:24:09.066501+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:38:35.957872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":187,"num_read_kb":128,"num_write":64,"num_write_kb":17,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.17","version":"0'0","reported_seq":39,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:59:08.247094+0000","last_change":"2024-09-14T11:58:43.677764+0000","last_active":"2024-09-14T12:59:08.247094+0000","last_peered":"2024-09-14T12:59:08.247094+0000","last_clean":"2024-09-14T12:59:08.247094+0000","last_became_active":"2024-09-14T11:58:43.677005+0000","last_became_peered":"2024-09-14T11:58:43.677005+0000","last_unstale":"2024-09-14T12:59:08.247094+0000","last_undegraded":"2024-09-14T12:59:08.247094+0000","last_fullsized":"2024-09-14T12:59:08.247094+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:58:42.635024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:58:42.635024+0000","last_clean_scrub_stamp":"2024-09-14T11:58:42.635024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:38:06.608929+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.10","version":"267'2","reported_seq":66,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:58:58.464483+0000","last_change":"2024-09-14T11:30:17.510820+0000","last_active":"2024-09-14T12:58:58.464483+0000","last_peered":"2024-09-14T12:58:58.464483+0000","last_clean":"2024-09-14T12:58:58.464483+0000","last_became_active":"2024-09-14T11:30:17.510031+0000","last_became_peered":"2024-09-14T11:30:17.510031+0000","last_unstale":"2024-09-14T12:58:58.464483+0000","last_undegraded":"2024-09-14T12:58:58.464483+0000","last_fullsized":"2024-09-14T12:58:58.464483+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:30:16.474654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:30:16.474654+0000","last_clean_scrub_stamp":"2024-09-14T11:30:16.474654+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:53:33.188778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2097152,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2048,"num_write":2,"num_write_kb":2048,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.11","version":"0'0","reported_seq":68,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:58:53.465194+0000","last_change":"2024-09-14T11:30:10.468119+0000","last_active":"2024-09-14T12:58:53.465194+0000","last_peered":"2024-09-14T12:58:53.465194+0000","last_clean":"2024-09-14T12:58:53.465194+0000","last_became_active":"2024-09-14T11:30:10.459020+0000","last_became_peered":"2024-09-14T11:30:10.459020+0000","last_unstale":"2024-09-14T12:58:53.465194+0000","last_undegraded":"2024-09-14T12:58:53.465194+0000","last_fullsized":"2024-09-14T12:58:53.465194+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:30:09.411354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:30:09.411354+0000","last_clean_scrub_stamp":"2024-09-14T11:30:09.411354+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:19:33.421651+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.12","version":"267'21","reported_seq":135,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:57:33.442363+0000","last_change":"2024-09-14T11:24:10.125240+0000","last_active":"2024-09-14T12:57:33.442363+0000","last_peered":"2024-09-14T12:57:33.442363+0000","last_clean":"2024-09-14T12:57:33.442363+0000","last_became_active":"2024-09-14T11:24:10.124482+0000","last_became_peered":"2024-09-14T11:24:10.124482+0000","last_unstale":"2024-09-14T12:57:33.442363+0000","last_undegraded":"2024-09-14T12:57:33.442363+0000","last_fullsized":"2024-09-14T12:57:33.442363+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:24:09.066501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:24:09.066501+0000","last_clean_scrub_stamp":"2024-09-14T11:24:09.066501+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:42:43.834915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":165,"num_read_kb":113,"num_write":54,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.14","version":"266'1","reported_seq":40,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:57:18.438576+0000","last_change":"2024-09-14T11:58:43.676454+0000","last_active":"2024-09-14T12:57:18.438576+0000","last_peered":"2024-09-14T12:57:18.438576+0000","last_clean":"2024-09-14T12:57:18.438576+0000","last_became_active":"2024-09-14T11:58:43.675734+0000","last_became_peered":"2024-09-14T11:58:43.675734+0000","last_unstale":"2024-09-14T12:57:18.438576+0000","last_undegraded":"2024-09-14T12:57:18.438576+0000","last_fullsized":"2024-09-14T12:57:18.438576+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:58:42.635024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:58:42.635024+0000","last_clean_scrub_stamp":"2024-09-14T11:58:42.635024+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:41:40.899244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.13","version":"267'6","reported_seq":72,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:58:58.466747+0000","last_change":"2024-09-14T11:30:17.546653+0000","last_active":"2024-09-14T12:58:58.466747+0000","last_peered":"2024-09-14T12:58:58.466747+0000","last_clean":"2024-09-14T12:58:58.466747+0000","last_became_active":"2024-09-14T11:30:17.545560+0000","last_became_peered":"2024-09-14T11:30:17.545560+0000","last_unstale":"2024-09-14T12:58:58.466747+0000","last_undegraded":"2024-09-14T12:58:58.466747+0000","last_fullsized":"2024-09-14T12:58:58.466747+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:30:16.474654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:30:16.474654+0000","last_clean_scrub_stamp":"2024-09-14T11:30:16.474654+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:05:50.325352+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":5,"num_read_kb":9216,"num_write":16,"num_write_kb":9216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.12","version":"267'7","reported_seq":81,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:58:53.428614+0000","last_change":"2024-09-14T11:30:10.475068+0000","last_active":"2024-09-14T12:58:53.428614+0000","last_peered":"2024-09-14T12:58:53.428614+0000","last_clean":"2024-09-14T12:58:53.428614+0000","last_became_active":"2024-09-14T11:30:10.474328+0000","last_became_peered":"2024-09-14T11:30:10.474328+0000","last_unstale":"2024-09-14T12:58:53.428614+0000","last_undegraded":"2024-09-14T12:58:53.428614+0000","last_fullsized":"2024-09-14T12:58:53.428614+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:30:09.411354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:30:09.411354+0000","last_clean_scrub_stamp":"2024-09-14T11:30:09.411354+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:23:43.643876+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":9,"num_read_kb":16386,"num_write":17,"num_write_kb":8192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"65.11","version":"267'78","reported_seq":292,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:57:33.212715+0000","last_change":"2024-09-14T11:24:10.107937+0000","last_active":"2024-09-14T12:57:33.212715+0000","last_peered":"2024-09-14T12:57:33.212715+0000","last_clean":"2024-09-14T12:57:33.212715+0000","last_became_active":"2024-09-14T11:24:10.107177+0000","last_became_peered":"2024-09-14T11:24:10.107177+0000","last_unstale":"2024-09-14T12:57:33.212715+0000","last_undegraded":"2024-09-14T12:57:33.212715+0000","last_fullsized":"2024-09-14T12:57:33.212715+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:24:09.066501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:24:09.066501+0000","last_clean_scrub_stamp":"2024-09-14T11:24:09.066501+0000","objects_scrubbed":0,"log_size":78,"log_dups_size":0,"ondisk_log_size":78,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:27:38.912018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":655,"num_read_kb":451,"num_write":184,"num_write_kb":61,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"68.15","version":"267'1","reported_seq":40,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:59:08.469167+0000","last_change":"2024-09-14T11:58:43.694184+0000","last_active":"2024-09-14T12:59:08.469167+0000","last_peered":"2024-09-14T12:59:08.469167+0000","last_clean":"2024-09-14T12:59:08.469167+0000","last_became_active":"2024-09-14T11:58:43.692552+0000","last_became_peered":"2024-09-14T11:58:43.692552+0000","last_unstale":"2024-09-14T12:59:08.469167+0000","last_undegraded":"2024-09-14T12:59:08.469167+0000","last_fullsized":"2024-09-14T12:59:08.469167+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:58:42.635024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:58:42.635024+0000","last_clean_scrub_stamp":"2024-09-14T11:58:42.635024+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:25:30.983665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.12","version":"267'2","reported_seq":64,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:58:58.429703+0000","last_change":"2024-09-14T11:30:17.524803+0000","last_active":"2024-09-14T12:58:58.429703+0000","last_peered":"2024-09-14T12:58:58.429703+0000","last_clean":"2024-09-14T12:58:58.429703+0000","last_became_active":"2024-09-14T11:30:17.523975+0000","last_became_peered":"2024-09-14T11:30:17.523975+0000","last_unstale":"2024-09-14T12:58:58.429703+0000","last_undegraded":"2024-09-14T12:58:58.429703+0000","last_fullsized":"2024-09-14T12:58:58.429703+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:30:16.474654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:30:16.474654+0000","last_clean_scrub_stamp":"2024-09-14T11:30:16.474654+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:12:00.068952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1048576,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"66.13","version":"267'1","reported_seq":69,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:58:53.046680+0000","last_change":"2024-09-14T11:30:10.470996+0000","last_active":"2024-09-14T12:58:53.046680+0000","last_peered":"2024-09-14T12:58:53.046680+0000","last_clean":"2024-09-14T12:58:53.046680+0000","last_became_active":"2024-09-14T11:30:10.467218+0000","last_became_peered":"2024-09-14T11:30:10.467218+0000","last_unstale":"2024-09-14T12:58:53.046680+0000","last_undegraded":"2024-09-14T12:58:53.046680+0000","last_fullsized":"2024-09-14T12:58:53.046680+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:30:09.411354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:30:09.411354+0000","last_clean_scrub_stamp":"2024-09-14T11:30:09.411354+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:14:13.258206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1048576,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.10","version":"267'25","reported_seq":142,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:57:33.446193+0000","last_change":"2024-09-14T11:24:10.128983+0000","last_active":"2024-09-14T12:57:33.446193+0000","last_peered":"2024-09-14T12:57:33.446193+0000","last_clean":"2024-09-14T12:57:33.446193+0000","last_became_active":"2024-09-14T11:24:10.124485+0000","last_became_peered":"2024-09-14T11:24:10.124485+0000","last_unstale":"2024-09-14T12:57:33.446193+0000","last_undegraded":"2024-09-14T12:57:33.446193+0000","last_fullsized":"2024-09-14T12:57:33.446193+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:24:09.066501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:24:09.066501+0000","last_clean_scrub_stamp":"2024-09-14T11:24:09.066501+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:05:55.111756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":199,"num_read_kb":137,"num_write":62,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.a","version":"0'0","reported_seq":42,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:59:42.836938+0000","last_change":"2024-09-14T11:58:43.665808+0000","last_active":"2024-09-14T12:59:42.836938+0000","last_peered":"2024-09-14T12:59:42.836938+0000","last_clean":"2024-09-14T12:59:42.836938+0000","last_became_active":"2024-09-14T11:58:43.665150+0000","last_became_peered":"2024-09-14T11:58:43.665150+0000","last_unstale":"2024-09-14T12:59:42.836938+0000","last_undegraded":"2024-09-14T12:59:42.836938+0000","last_fullsized":"2024-09-14T12:59:42.836938+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:58:42.635024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:58:42.635024+0000","last_clean_scrub_stamp":"2024-09-14T11:58:42.635024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:47:00.404652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.d","version":"0'0","reported_seq":63,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:58:03.453801+0000","last_change":"2024-09-14T11:30:17.541032+0000","last_active":"2024-09-14T12:58:03.453801+0000","last_peered":"2024-09-14T12:58:03.453801+0000","last_clean":"2024-09-14T12:58:03.453801+0000","last_became_active":"2024-09-14T11:30:17.540505+0000","last_became_peered":"2024-09-14T11:30:17.540505+0000","last_unstale":"2024-09-14T12:58:03.453801+0000","last_undegraded":"2024-09-14T12:58:03.453801+0000","last_fullsized":"2024-09-14T12:58:03.453801+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:30:16.474654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:30:16.474654+0000","last_clean_scrub_stamp":"2024-09-14T11:30:16.474654+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:19:58.382345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.c","version":"264'2","reported_seq":73,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:57:57.823794+0000","last_change":"2024-09-14T11:30:10.465578+0000","last_active":"2024-09-14T12:57:57.823794+0000","last_peered":"2024-09-14T12:57:57.823794+0000","last_clean":"2024-09-14T12:57:57.823794+0000","last_became_active":"2024-09-14T11:30:10.464846+0000","last_became_peered":"2024-09-14T11:30:10.464846+0000","last_unstale":"2024-09-14T12:57:57.823794+0000","last_undegraded":"2024-09-14T12:57:57.823794+0000","last_fullsized":"2024-09-14T12:57:57.823794+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:30:09.411354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:30:09.411354+0000","last_clean_scrub_stamp":"2024-09-14T11:30:09.411354+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:16:48.115696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":4096,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.f","version":"267'23","reported_seq":140,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:59:03.468003+0000","last_change":"2024-09-14T11:24:10.122374+0000","last_active":"2024-09-14T12:59:03.468003+0000","last_peered":"2024-09-14T12:59:03.468003+0000","last_clean":"2024-09-14T12:59:03.468003+0000","last_became_active":"2024-09-14T11:24:10.121456+0000","last_became_peered":"2024-09-14T11:24:10.121456+0000","last_unstale":"2024-09-14T12:59:03.468003+0000","last_undegraded":"2024-09-14T12:59:03.468003+0000","last_fullsized":"2024-09-14T12:59:03.468003+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:24:09.066501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:24:09.066501+0000","last_clean_scrub_stamp":"2024-09-14T11:24:09.066501+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:09:06.754571+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":176,"num_read_kb":127,"num_write":57,"num_write_kb":16,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.b","version":"0'0","reported_seq":41,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:59:32.845960+0000","last_change":"2024-09-14T11:58:43.685677+0000","last_active":"2024-09-14T12:59:32.845960+0000","last_peered":"2024-09-14T12:59:32.845960+0000","last_clean":"2024-09-14T12:59:32.845960+0000","last_became_active":"2024-09-14T11:58:43.684927+0000","last_became_peered":"2024-09-14T11:58:43.684927+0000","last_unstale":"2024-09-14T12:59:32.845960+0000","last_undegraded":"2024-09-14T12:59:32.845960+0000","last_fullsized":"2024-09-14T12:59:32.845960+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:58:42.635024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:58:42.635024+0000","last_clean_scrub_stamp":"2024-09-14T11:58:42.635024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:58:14.472771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.c","version":"267'7","reported_seq":76,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:58:03.453730+0000","last_change":"2024-09-14T11:30:17.535765+0000","last_active":"2024-09-14T12:58:03.453730+0000","last_peered":"2024-09-14T12:58:03.453730+0000","last_clean":"2024-09-14T12:58:03.453730+0000","last_became_active":"2024-09-14T11:30:17.535131+0000","last_became_peered":"2024-09-14T11:30:17.535131+0000","last_unstale":"2024-09-14T12:58:03.453730+0000","last_undegraded":"2024-09-14T12:58:03.453730+0000","last_fullsized":"2024-09-14T12:58:03.453730+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:30:16.474654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:30:16.474654+0000","last_clean_scrub_stamp":"2024-09-14T11:30:16.474654+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:06:05.667984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":8,"num_read_kb":16384,"num_write":12,"num_write_kb":16384,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.d","version":"0'0","reported_seq":69,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:57:57.814167+0000","last_change":"2024-09-14T11:30:10.476534+0000","last_active":"2024-09-14T12:57:57.814167+0000","last_peered":"2024-09-14T12:57:57.814167+0000","last_clean":"2024-09-14T12:57:57.814167+0000","last_became_active":"2024-09-14T11:30:10.475862+0000","last_became_peered":"2024-09-14T11:30:10.475862+0000","last_unstale":"2024-09-14T12:57:57.814167+0000","last_undegraded":"2024-09-14T12:57:57.814167+0000","last_fullsized":"2024-09-14T12:57:57.814167+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:30:09.411354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:30:09.411354+0000","last_clean_scrub_stamp":"2024-09-14T11:30:09.411354+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:09:25.660215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.e","version":"267'20","reported_seq":131,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:58:43.044517+0000","last_change":"2024-09-14T11:24:10.116821+0000","last_active":"2024-09-14T12:58:43.044517+0000","last_peered":"2024-09-14T12:58:43.044517+0000","last_clean":"2024-09-14T12:58:43.044517+0000","last_became_active":"2024-09-14T11:24:10.116115+0000","last_became_peered":"2024-09-14T11:24:10.116115+0000","last_unstale":"2024-09-14T12:58:43.044517+0000","last_undegraded":"2024-09-14T12:58:43.044517+0000","last_fullsized":"2024-09-14T12:58:43.044517+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:24:09.066501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:24:09.066501+0000","last_clean_scrub_stamp":"2024-09-14T11:24:09.066501+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:27:31.737225+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":147,"num_read_kb":99,"num_write":62,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"68.8","version":"0'0","reported_seq":42,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:59:23.435157+0000","last_change":"2024-09-14T11:58:43.689938+0000","last_active":"2024-09-14T12:59:23.435157+0000","last_peered":"2024-09-14T12:59:23.435157+0000","last_clean":"2024-09-14T12:59:23.435157+0000","last_became_active":"2024-09-14T11:58:43.689083+0000","last_became_peered":"2024-09-14T11:58:43.689083+0000","last_unstale":"2024-09-14T12:59:23.435157+0000","last_undegraded":"2024-09-14T12:59:23.435157+0000","last_fullsized":"2024-09-14T12:59:23.435157+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:58:42.635024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:58:42.635024+0000","last_clean_scrub_stamp":"2024-09-14T11:58:42.635024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:56:39.956267+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"67.f","version":"267'5","reported_seq":72,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:58:18.455799+0000","last_change":"2024-09-14T11:30:17.516991+0000","last_active":"2024-09-14T12:58:18.455799+0000","last_peered":"2024-09-14T12:58:18.455799+0000","last_clean":"2024-09-14T12:58:18.455799+0000","last_became_active":"2024-09-14T11:30:17.514381+0000","last_became_peered":"2024-09-14T11:30:17.514381+0000","last_unstale":"2024-09-14T12:58:18.455799+0000","last_undegraded":"2024-09-14T12:58:18.455799+0000","last_fullsized":"2024-09-14T12:58:18.455799+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:30:16.474654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:30:16.474654+0000","last_clean_scrub_stamp":"2024-09-14T11:30:16.474654+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:49:08.984359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5242880,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":5,"num_read_kb":3072,"num_write":10,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.e","version":"267'5","reported_seq":81,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:57:58.447906+0000","last_change":"2024-09-14T11:30:10.479004+0000","last_active":"2024-09-14T12:57:58.447906+0000","last_peered":"2024-09-14T12:57:58.447906+0000","last_clean":"2024-09-14T12:57:58.447906+0000","last_became_active":"2024-09-14T11:30:10.473586+0000","last_became_peered":"2024-09-14T11:30:10.473586+0000","last_unstale":"2024-09-14T12:57:58.447906+0000","last_undegraded":"2024-09-14T12:57:58.447906+0000","last_fullsized":"2024-09-14T12:57:58.447906+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:30:09.411354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:30:09.411354+0000","last_clean_scrub_stamp":"2024-09-14T11:30:09.411354+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:24:05.113372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3145728,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":10,"num_read_kb":7170,"num_write":5,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.d","version":"267'29","reported_seq":159,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:58:43.426273+0000","last_change":"2024-09-14T11:24:10.116568+0000","last_active":"2024-09-14T12:58:43.426273+0000","last_peered":"2024-09-14T12:58:43.426273+0000","last_clean":"2024-09-14T12:58:43.426273+0000","last_became_active":"2024-09-14T11:24:10.115813+0000","last_became_peered":"2024-09-14T11:24:10.115813+0000","last_unstale":"2024-09-14T12:58:43.426273+0000","last_undegraded":"2024-09-14T12:58:43.426273+0000","last_fullsized":"2024-09-14T12:58:43.426273+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:24:09.066501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:24:09.066501+0000","last_clean_scrub_stamp":"2024-09-14T11:24:09.066501+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:26:27.897672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":238,"num_read_kb":154,"num_write":72,"num_write_kb":21,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.9","version":"0'0","reported_seq":42,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:59:27.844748+0000","last_change":"2024-09-14T11:58:43.692113+0000","last_active":"2024-09-14T12:59:27.844748+0000","last_peered":"2024-09-14T12:59:27.844748+0000","last_clean":"2024-09-14T12:59:27.844748+0000","last_became_active":"2024-09-14T11:58:43.691369+0000","last_became_peered":"2024-09-14T11:58:43.691369+0000","last_unstale":"2024-09-14T12:59:27.844748+0000","last_undegraded":"2024-09-14T12:59:27.844748+0000","last_fullsized":"2024-09-14T12:59:27.844748+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:58:42.635024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:58:42.635024+0000","last_clean_scrub_stamp":"2024-09-14T11:58:42.635024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:30:13.996741+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.e","version":"0'0","reported_seq":63,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:58:03.453841+0000","last_change":"2024-09-14T11:30:17.530775+0000","last_active":"2024-09-14T12:58:03.453841+0000","last_peered":"2024-09-14T12:58:03.453841+0000","last_clean":"2024-09-14T12:58:03.453841+0000","last_became_active":"2024-09-14T11:30:17.529982+0000","last_became_peered":"2024-09-14T11:30:17.529982+0000","last_unstale":"2024-09-14T12:58:03.453841+0000","last_undegraded":"2024-09-14T12:58:03.453841+0000","last_fullsized":"2024-09-14T12:58:03.453841+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:30:16.474654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:30:16.474654+0000","last_clean_scrub_stamp":"2024-09-14T11:30:16.474654+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:45:22.253630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.f","version":"267'2","reported_seq":73,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:58:13.454641+0000","last_change":"2024-09-14T11:30:10.466282+0000","last_active":"2024-09-14T12:58:13.454641+0000","last_peered":"2024-09-14T12:58:13.454641+0000","last_clean":"2024-09-14T12:58:13.454641+0000","last_became_active":"2024-09-14T11:30:10.465658+0000","last_became_peered":"2024-09-14T11:30:10.465658+0000","last_unstale":"2024-09-14T12:58:13.454641+0000","last_undegraded":"2024-09-14T12:58:13.454641+0000","last_fullsized":"2024-09-14T12:58:13.454641+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:30:09.411354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:30:09.411354+0000","last_clean_scrub_stamp":"2024-09-14T11:30:09.411354+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:30:10.626929+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":8192,"num_write":7,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.c","version":"267'13","reported_seq":112,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:58:42.823918+0000","last_change":"2024-09-14T11:24:10.125876+0000","last_active":"2024-09-14T12:58:42.823918+0000","last_peered":"2024-09-14T12:58:42.823918+0000","last_clean":"2024-09-14T12:58:42.823918+0000","last_became_active":"2024-09-14T11:24:10.125123+0000","last_became_peered":"2024-09-14T11:24:10.125123+0000","last_unstale":"2024-09-14T12:58:42.823918+0000","last_undegraded":"2024-09-14T12:58:42.823918+0000","last_fullsized":"2024-09-14T12:58:42.823918+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:24:09.066501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:24:09.066501+0000","last_clean_scrub_stamp":"2024-09-14T11:24:09.066501+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:00:51.281778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":97,"num_read_kb":65,"num_write":32,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.e","version":"0'0","reported_seq":41,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:59:28.473804+0000","last_change":"2024-09-14T11:58:43.687782+0000","last_active":"2024-09-14T12:59:28.473804+0000","last_peered":"2024-09-14T12:59:28.473804+0000","last_clean":"2024-09-14T12:59:28.473804+0000","last_became_active":"2024-09-14T11:58:43.686619+0000","last_became_peered":"2024-09-14T11:58:43.686619+0000","last_unstale":"2024-09-14T12:59:28.473804+0000","last_undegraded":"2024-09-14T12:59:28.473804+0000","last_fullsized":"2024-09-14T12:59:28.473804+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:58:42.635024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:58:42.635024+0000","last_clean_scrub_stamp":"2024-09-14T11:58:42.635024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:28:38.861564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.9","version":"264'3","reported_seq":70,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:59:08.234745+0000","last_change":"2024-09-14T11:30:17.539804+0000","last_active":"2024-09-14T12:59:08.234745+0000","last_peered":"2024-09-14T12:59:08.234745+0000","last_clean":"2024-09-14T12:59:08.234745+0000","last_became_active":"2024-09-14T11:30:17.539102+0000","last_became_peered":"2024-09-14T11:30:17.539102+0000","last_unstale":"2024-09-14T12:59:08.234745+0000","last_undegraded":"2024-09-14T12:59:08.234745+0000","last_fullsized":"2024-09-14T12:59:08.234745+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:30:16.474654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:30:16.474654+0000","last_clean_scrub_stamp":"2024-09-14T11:30:16.474654+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:50:58.476074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":4096,"num_write":8,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.8","version":"267'3","reported_seq":77,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:59:03.245405+0000","last_change":"2024-09-14T11:30:10.460045+0000","last_active":"2024-09-14T12:59:03.245405+0000","last_peered":"2024-09-14T12:59:03.245405+0000","last_clean":"2024-09-14T12:59:03.245405+0000","last_became_active":"2024-09-14T11:30:10.452160+0000","last_became_peered":"2024-09-14T11:30:10.452160+0000","last_unstale":"2024-09-14T12:59:03.245405+0000","last_undegraded":"2024-09-14T12:59:03.245405+0000","last_fullsized":"2024-09-14T12:59:03.245405+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:30:09.411354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:30:09.411354+0000","last_clean_scrub_stamp":"2024-09-14T11:30:09.411354+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:23:05.788859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1048576,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4,"num_read_kb":5120,"num_write":3,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.b","version":"267'29","reported_seq":156,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:58:43.240104+0000","last_change":"2024-09-14T11:24:10.106828+0000","last_active":"2024-09-14T12:58:43.240104+0000","last_peered":"2024-09-14T12:58:43.240104+0000","last_clean":"2024-09-14T12:58:43.240104+0000","last_became_active":"2024-09-14T11:24:10.106068+0000","last_became_peered":"2024-09-14T11:24:10.106068+0000","last_unstale":"2024-09-14T12:58:43.240104+0000","last_undegraded":"2024-09-14T12:58:43.240104+0000","last_fullsized":"2024-09-14T12:58:43.240104+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:24:09.066501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:24:09.066501+0000","last_clean_scrub_stamp":"2024-09-14T11:24:09.066501+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:05:03.080475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":230,"num_read_kb":146,"num_write":73,"num_write_kb":21,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.f","version":"0'0","reported_seq":40,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:57:37.819234+0000","last_change":"2024-09-14T11:58:43.692112+0000","last_active":"2024-09-14T12:57:37.819234+0000","last_peered":"2024-09-14T12:57:37.819234+0000","last_clean":"2024-09-14T12:57:37.819234+0000","last_became_active":"2024-09-14T11:58:43.691307+0000","last_became_peered":"2024-09-14T11:58:43.691307+0000","last_unstale":"2024-09-14T12:57:37.819234+0000","last_undegraded":"2024-09-14T12:57:37.819234+0000","last_fullsized":"2024-09-14T12:57:37.819234+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:58:42.635024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:58:42.635024+0000","last_clean_scrub_stamp":"2024-09-14T11:58:42.635024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:28:43.404907+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.8","version":"267'2","reported_seq":71,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:59:07.839977+0000","last_change":"2024-09-14T11:30:17.506927+0000","last_active":"2024-09-14T12:59:07.839977+0000","last_peered":"2024-09-14T12:59:07.839977+0000","last_clean":"2024-09-14T12:59:07.839977+0000","last_became_active":"2024-09-14T11:30:17.506181+0000","last_became_peered":"2024-09-14T11:30:17.506181+0000","last_unstale":"2024-09-14T12:59:07.839977+0000","last_undegraded":"2024-09-14T12:59:07.839977+0000","last_fullsized":"2024-09-14T12:59:07.839977+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:30:16.474654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:30:16.474654+0000","last_clean_scrub_stamp":"2024-09-14T11:30:16.474654+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:25:09.709853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5242880,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":4,"num_read_kb":10240,"num_write":2,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.9","version":"267'11","reported_seq":93,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:59:03.465657+0000","last_change":"2024-09-14T11:30:10.470957+0000","last_active":"2024-09-14T12:59:03.465657+0000","last_peered":"2024-09-14T12:59:03.465657+0000","last_clean":"2024-09-14T12:59:03.465657+0000","last_became_active":"2024-09-14T11:30:10.470179+0000","last_became_peered":"2024-09-14T11:30:10.470179+0000","last_unstale":"2024-09-14T12:59:03.465657+0000","last_undegraded":"2024-09-14T12:59:03.465657+0000","last_fullsized":"2024-09-14T12:59:03.465657+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:30:09.411354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:30:09.411354+0000","last_clean_scrub_stamp":"2024-09-14T11:30:09.411354+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:18:43.600381+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8391814,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":15,"num_read_kb":28678,"num_write":21,"num_write_kb":16388,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.a","version":"267'15","reported_seq":117,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:57:52.822597+0000","last_change":"2024-09-14T11:24:10.103674+0000","last_active":"2024-09-14T12:57:52.822597+0000","last_peered":"2024-09-14T12:57:52.822597+0000","last_clean":"2024-09-14T12:57:52.822597+0000","last_became_active":"2024-09-14T11:24:10.102918+0000","last_became_peered":"2024-09-14T11:24:10.102918+0000","last_unstale":"2024-09-14T12:57:52.822597+0000","last_undegraded":"2024-09-14T12:57:52.822597+0000","last_fullsized":"2024-09-14T12:57:52.822597+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:24:09.066501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:24:09.066501+0000","last_clean_scrub_stamp":"2024-09-14T11:24:09.066501+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:26:42.141598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":107,"num_read_kb":71,"num_write":42,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.c","version":"267'1","reported_seq":42,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:59:32.846025+0000","last_change":"2024-09-14T11:58:43.674524+0000","last_active":"2024-09-14T12:59:32.846025+0000","last_peered":"2024-09-14T12:59:32.846025+0000","last_clean":"2024-09-14T12:59:32.846025+0000","last_became_active":"2024-09-14T11:58:43.671065+0000","last_became_peered":"2024-09-14T11:58:43.671065+0000","last_unstale":"2024-09-14T12:59:32.846025+0000","last_undegraded":"2024-09-14T12:59:32.846025+0000","last_fullsized":"2024-09-14T12:59:32.846025+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:58:42.635024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:58:42.635024+0000","last_clean_scrub_stamp":"2024-09-14T11:58:42.635024+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:00:34.168002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.b","version":"267'10","reported_seq":84,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:58:03.452301+0000","last_change":"2024-09-14T11:30:17.517039+0000","last_active":"2024-09-14T12:58:03.452301+0000","last_peered":"2024-09-14T12:58:03.452301+0000","last_clean":"2024-09-14T12:58:03.452301+0000","last_became_active":"2024-09-14T11:30:17.516646+0000","last_became_peered":"2024-09-14T11:30:17.516646+0000","last_unstale":"2024-09-14T12:58:03.452301+0000","last_undegraded":"2024-09-14T12:58:03.452301+0000","last_fullsized":"2024-09-14T12:58:03.452301+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:30:16.474654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:30:16.474654+0000","last_clean_scrub_stamp":"2024-09-14T11:30:16.474654+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:51:29.231639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":16,"num_read_kb":13314,"num_write":15,"num_write_kb":10240,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.a","version":"264'2","reported_seq":75,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:59:28.251530+0000","last_change":"2024-09-14T11:30:10.473981+0000","last_active":"2024-09-14T12:59:28.251530+0000","last_peered":"2024-09-14T12:59:28.251530+0000","last_clean":"2024-09-14T12:59:28.251530+0000","last_became_active":"2024-09-14T11:30:10.473149+0000","last_became_peered":"2024-09-14T11:30:10.473149+0000","last_unstale":"2024-09-14T12:59:28.251530+0000","last_undegraded":"2024-09-14T12:59:28.251530+0000","last_fullsized":"2024-09-14T12:59:28.251530+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:30:09.411354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:30:09.411354+0000","last_clean_scrub_stamp":"2024-09-14T11:30:09.411354+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:31:29.150405+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":1024,"num_write":2,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.9","version":"267'22","reported_seq":138,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:59:33.474897+0000","last_change":"2024-09-14T11:24:10.122150+0000","last_active":"2024-09-14T12:59:33.474897+0000","last_peered":"2024-09-14T12:59:33.474897+0000","last_clean":"2024-09-14T12:59:33.474897+0000","last_became_active":"2024-09-14T11:24:10.121442+0000","last_became_peered":"2024-09-14T11:24:10.121442+0000","last_unstale":"2024-09-14T12:59:33.474897+0000","last_undegraded":"2024-09-14T12:59:33.474897+0000","last_fullsized":"2024-09-14T12:59:33.474897+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:24:09.066501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:24:09.066501+0000","last_clean_scrub_stamp":"2024-09-14T11:24:09.066501+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:07:27.847069+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":163,"num_read_kb":99,"num_write":58,"num_write_kb":15,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.d","version":"0'0","reported_seq":41,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:59:28.251656+0000","last_change":"2024-09-14T11:58:43.694247+0000","last_active":"2024-09-14T12:59:28.251656+0000","last_peered":"2024-09-14T12:59:28.251656+0000","last_clean":"2024-09-14T12:59:28.251656+0000","last_became_active":"2024-09-14T11:58:43.693568+0000","last_became_peered":"2024-09-14T11:58:43.693568+0000","last_unstale":"2024-09-14T12:59:28.251656+0000","last_undegraded":"2024-09-14T12:59:28.251656+0000","last_fullsized":"2024-09-14T12:59:28.251656+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:58:42.635024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:58:42.635024+0000","last_clean_scrub_stamp":"2024-09-14T11:58:42.635024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:56:07.440496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.a","version":"0'0","reported_seq":71,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:59:37.847095+0000","last_change":"2024-09-14T11:30:57.858852+0000","last_active":"2024-09-14T12:59:37.847095+0000","last_peered":"2024-09-14T12:59:37.847095+0000","last_clean":"2024-09-14T12:59:37.847095+0000","last_became_active":"2024-09-14T11:30:57.858040+0000","last_became_peered":"2024-09-14T11:30:57.858040+0000","last_unstale":"2024-09-14T12:59:37.847095+0000","last_undegraded":"2024-09-14T12:59:37.847095+0000","last_fullsized":"2024-09-14T12:59:37.847095+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:30:16.474654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:30:16.474654+0000","last_clean_scrub_stamp":"2024-09-14T11:30:16.474654+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:54:14.176092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.b","version":"267'2","reported_seq":73,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:57:58.218262+0000","last_change":"2024-09-14T11:30:10.446339+0000","last_active":"2024-09-14T12:57:58.218262+0000","last_peered":"2024-09-14T12:57:58.218262+0000","last_clean":"2024-09-14T12:57:58.218262+0000","last_became_active":"2024-09-14T11:30:10.442635+0000","last_became_peered":"2024-09-14T11:30:10.442635+0000","last_unstale":"2024-09-14T12:57:58.218262+0000","last_undegraded":"2024-09-14T12:57:58.218262+0000","last_fullsized":"2024-09-14T12:57:58.218262+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:30:09.411354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:30:09.411354+0000","last_clean_scrub_stamp":"2024-09-14T11:30:09.411354+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:51:37.757665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":8192,"num_write":2,"num_write_kb":8192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.8","version":"267'20","reported_seq":132,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:59:33.437339+0000","last_change":"2024-09-14T11:24:10.116682+0000","last_active":"2024-09-14T12:59:33.437339+0000","last_peered":"2024-09-14T12:59:33.437339+0000","last_clean":"2024-09-14T12:59:33.437339+0000","last_became_active":"2024-09-14T11:24:10.115856+0000","last_became_peered":"2024-09-14T11:24:10.115856+0000","last_unstale":"2024-09-14T12:59:33.437339+0000","last_undegraded":"2024-09-14T12:59:33.437339+0000","last_fullsized":"2024-09-14T12:59:33.437339+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:24:09.066501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:24:09.066501+0000","last_clean_scrub_stamp":"2024-09-14T11:24:09.066501+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:44:11.185471+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":144,"num_read_kb":94,"num_write":54,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.2","version":"0'0","reported_seq":43,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:59:12.841261+0000","last_change":"2024-09-14T11:58:43.696428+0000","last_active":"2024-09-14T12:59:12.841261+0000","last_peered":"2024-09-14T12:59:12.841261+0000","last_clean":"2024-09-14T12:59:12.841261+0000","last_became_active":"2024-09-14T11:58:43.695896+0000","last_became_peered":"2024-09-14T11:58:43.695896+0000","last_unstale":"2024-09-14T12:59:12.841261+0000","last_undegraded":"2024-09-14T12:59:12.841261+0000","last_fullsized":"2024-09-14T12:59:12.841261+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:58:42.635024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:58:42.635024+0000","last_clean_scrub_stamp":"2024-09-14T11:58:42.635024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:00:52.004945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.5","version":"0'0","reported_seq":66,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:58:08.450363+0000","last_change":"2024-09-14T11:30:17.520310+0000","last_active":"2024-09-14T12:58:08.450363+0000","last_peered":"2024-09-14T12:58:08.450363+0000","last_clean":"2024-09-14T12:58:08.450363+0000","last_became_active":"2024-09-14T11:30:17.519903+0000","last_became_peered":"2024-09-14T11:30:17.519903+0000","last_unstale":"2024-09-14T12:58:08.450363+0000","last_undegraded":"2024-09-14T12:58:08.450363+0000","last_fullsized":"2024-09-14T12:58:08.450363+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:30:16.474654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:30:16.474654+0000","last_clean_scrub_stamp":"2024-09-14T11:30:16.474654+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:24:33.274962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.4","version":"264'4","reported_seq":82,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:59:47.849496+0000","last_change":"2024-09-14T11:30:10.469781+0000","last_active":"2024-09-14T12:59:47.849496+0000","last_peered":"2024-09-14T12:59:47.849496+0000","last_clean":"2024-09-14T12:59:47.849496+0000","last_became_active":"2024-09-14T11:30:10.468287+0000","last_became_peered":"2024-09-14T11:30:10.468287+0000","last_unstale":"2024-09-14T12:59:47.849496+0000","last_undegraded":"2024-09-14T12:59:47.849496+0000","last_fullsized":"2024-09-14T12:59:47.849496+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:30:09.411354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:30:09.411354+0000","last_clean_scrub_stamp":"2024-09-14T11:30:09.411354+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:43:03.239163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":11264,"num_write":4,"num_write_kb":7168,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.7","version":"267'11","reported_seq":111,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:59:33.252891+0000","last_change":"2024-09-14T11:24:10.097912+0000","last_active":"2024-09-14T12:59:33.252891+0000","last_peered":"2024-09-14T12:59:33.252891+0000","last_clean":"2024-09-14T12:59:33.252891+0000","last_became_active":"2024-09-14T11:24:10.097206+0000","last_became_peered":"2024-09-14T11:24:10.097206+0000","last_unstale":"2024-09-14T12:59:33.252891+0000","last_undegraded":"2024-09-14T12:59:33.252891+0000","last_fullsized":"2024-09-14T12:59:33.252891+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:24:09.066501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:24:09.066501+0000","last_clean_scrub_stamp":"2024-09-14T11:24:09.066501+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:05:42.905472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":88,"num_read_kb":49,"num_write":30,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.3","version":"0'0","reported_seq":43,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:59:08.049987+0000","last_change":"2024-09-14T11:58:43.693608+0000","last_active":"2024-09-14T12:59:08.049987+0000","last_peered":"2024-09-14T12:59:08.049987+0000","last_clean":"2024-09-14T12:59:08.049987+0000","last_became_active":"2024-09-14T11:58:43.689661+0000","last_became_peered":"2024-09-14T11:58:43.689661+0000","last_unstale":"2024-09-14T12:59:08.049987+0000","last_undegraded":"2024-09-14T12:59:08.049987+0000","last_fullsized":"2024-09-14T12:59:08.049987+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:58:42.635024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:58:42.635024+0000","last_clean_scrub_stamp":"2024-09-14T11:58:42.635024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:26:59.844029+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.4","version":"267'3","reported_seq":73,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:59:53.257452+0000","last_change":"2024-09-14T11:30:17.501104+0000","last_active":"2024-09-14T12:59:53.257452+0000","last_peered":"2024-09-14T12:59:53.257452+0000","last_clean":"2024-09-14T12:59:53.257452+0000","last_became_active":"2024-09-14T11:30:17.500215+0000","last_became_peered":"2024-09-14T11:30:17.500215+0000","last_unstale":"2024-09-14T12:59:53.257452+0000","last_undegraded":"2024-09-14T12:59:53.257452+0000","last_fullsized":"2024-09-14T12:59:53.257452+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:30:16.474654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:30:16.474654+0000","last_clean_scrub_stamp":"2024-09-14T11:30:16.474654+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:46:20.398415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1051782,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3,"num_read_kb":2052,"num_write":8,"num_write_kb":1028,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.5","version":"267'3","reported_seq":79,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:58:12.817408+0000","last_change":"2024-09-14T11:30:10.465224+0000","last_active":"2024-09-14T12:58:12.817408+0000","last_peered":"2024-09-14T12:58:12.817408+0000","last_clean":"2024-09-14T12:58:12.817408+0000","last_became_active":"2024-09-14T11:30:10.464076+0000","last_became_peered":"2024-09-14T11:30:10.464076+0000","last_unstale":"2024-09-14T12:58:12.817408+0000","last_undegraded":"2024-09-14T12:58:12.817408+0000","last_fullsized":"2024-09-14T12:58:12.817408+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:30:09.411354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:30:09.411354+0000","last_clean_scrub_stamp":"2024-09-14T11:30:09.411354+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:08:03.701354+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":4,"num_read_kb":16384,"num_write":8,"num_write_kb":8192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.6","version":"267'17","reported_seq":129,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:59:33.437504+0000","last_change":"2024-09-14T11:24:10.123893+0000","last_active":"2024-09-14T12:59:33.437504+0000","last_peered":"2024-09-14T12:59:33.437504+0000","last_clean":"2024-09-14T12:59:33.437504+0000","last_became_active":"2024-09-14T11:24:10.123193+0000","last_became_peered":"2024-09-14T11:24:10.123193+0000","last_unstale":"2024-09-14T12:59:33.437504+0000","last_undegraded":"2024-09-14T12:59:33.437504+0000","last_fullsized":"2024-09-14T12:59:33.437504+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:24:09.066501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:24:09.066501+0000","last_clean_scrub_stamp":"2024-09-14T11:24:09.066501+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:45:11.702555+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":141,"num_read_kb":98,"num_write":56,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.0","version":"0'0","reported_seq":44,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:58:48.462247+0000","last_change":"2024-09-14T11:58:43.690698+0000","last_active":"2024-09-14T12:58:48.462247+0000","last_peered":"2024-09-14T12:58:48.462247+0000","last_clean":"2024-09-14T12:58:48.462247+0000","last_became_active":"2024-09-14T11:58:43.690036+0000","last_became_peered":"2024-09-14T11:58:43.690036+0000","last_unstale":"2024-09-14T12:58:48.462247+0000","last_undegraded":"2024-09-14T12:58:48.462247+0000","last_fullsized":"2024-09-14T12:58:48.462247+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:58:42.635024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:58:42.635024+0000","last_clean_scrub_stamp":"2024-09-14T11:58:42.635024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:02:37.171544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"67.7","version":"0'0","reported_seq":65,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:59:07.840222+0000","last_change":"2024-09-14T11:30:17.504824+0000","last_active":"2024-09-14T12:59:07.840222+0000","last_peered":"2024-09-14T12:59:07.840222+0000","last_clean":"2024-09-14T12:59:07.840222+0000","last_became_active":"2024-09-14T11:30:17.503548+0000","last_became_peered":"2024-09-14T11:30:17.503548+0000","last_unstale":"2024-09-14T12:59:07.840222+0000","last_undegraded":"2024-09-14T12:59:07.840222+0000","last_fullsized":"2024-09-14T12:59:07.840222+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:30:16.474654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:30:16.474654+0000","last_clean_scrub_stamp":"2024-09-14T11:30:16.474654+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:04:54.678316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.6","version":"264'4","reported_seq":81,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:59:03.048985+0000","last_change":"2024-09-14T11:30:10.463753+0000","last_active":"2024-09-14T12:59:03.048985+0000","last_peered":"2024-09-14T12:59:03.048985+0000","last_clean":"2024-09-14T12:59:03.048985+0000","last_became_active":"2024-09-14T11:30:10.462971+0000","last_became_peered":"2024-09-14T11:30:10.462971+0000","last_unstale":"2024-09-14T12:59:03.048985+0000","last_undegraded":"2024-09-14T12:59:03.048985+0000","last_fullsized":"2024-09-14T12:59:03.048985+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:30:09.411354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:30:09.411354+0000","last_clean_scrub_stamp":"2024-09-14T11:30:09.411354+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:28:19.411905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":16386,"num_write":4,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.5","version":"267'29","reported_seq":156,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:58:27.830841+0000","last_change":"2024-09-14T11:24:10.105209+0000","last_active":"2024-09-14T12:58:27.830841+0000","last_peered":"2024-09-14T12:58:27.830841+0000","last_clean":"2024-09-14T12:58:27.830841+0000","last_became_active":"2024-09-14T11:24:10.104277+0000","last_became_peered":"2024-09-14T11:24:10.104277+0000","last_unstale":"2024-09-14T12:58:27.830841+0000","last_undegraded":"2024-09-14T12:58:27.830841+0000","last_fullsized":"2024-09-14T12:58:27.830841+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:24:09.066501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:24:09.066501+0000","last_clean_scrub_stamp":"2024-09-14T11:24:09.066501+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:27:20.344282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":210,"num_read_kb":138,"num_write":78,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.1","version":"0'0","reported_seq":43,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:59:08.234700+0000","last_change":"2024-09-14T11:58:43.675560+0000","last_active":"2024-09-14T12:59:08.234700+0000","last_peered":"2024-09-14T12:59:08.234700+0000","last_clean":"2024-09-14T12:59:08.234700+0000","last_became_active":"2024-09-14T11:58:43.674870+0000","last_became_peered":"2024-09-14T11:58:43.674870+0000","last_unstale":"2024-09-14T12:59:08.234700+0000","last_undegraded":"2024-09-14T12:59:08.234700+0000","last_fullsized":"2024-09-14T12:59:08.234700+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:58:42.635024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:58:42.635024+0000","last_clean_scrub_stamp":"2024-09-14T11:58:42.635024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:17:48.384984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"67.6","version":"267'1","reported_seq":67,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:59:08.234954+0000","last_change":"2024-09-14T11:30:17.521153+0000","last_active":"2024-09-14T12:59:08.234954+0000","last_peered":"2024-09-14T12:59:08.234954+0000","last_clean":"2024-09-14T12:59:08.234954+0000","last_became_active":"2024-09-14T11:30:17.520433+0000","last_became_peered":"2024-09-14T11:30:17.520433+0000","last_unstale":"2024-09-14T12:59:08.234954+0000","last_undegraded":"2024-09-14T12:59:08.234954+0000","last_fullsized":"2024-09-14T12:59:08.234954+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:30:16.474654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:30:16.474654+0000","last_clean_scrub_stamp":"2024-09-14T11:30:16.474654+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:46:08.197483+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":4096,"num_write":1,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.7","version":"267'2","reported_seq":76,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:59:02.839045+0000","last_change":"2024-09-14T11:30:10.475293+0000","last_active":"2024-09-14T12:59:02.839045+0000","last_peered":"2024-09-14T12:59:02.839045+0000","last_clean":"2024-09-14T12:59:02.839045+0000","last_became_active":"2024-09-14T11:30:10.474546+0000","last_became_peered":"2024-09-14T11:30:10.474546+0000","last_unstale":"2024-09-14T12:59:02.839045+0000","last_undegraded":"2024-09-14T12:59:02.839045+0000","last_fullsized":"2024-09-14T12:59:02.839045+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:30:09.411354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:30:09.411354+0000","last_clean_scrub_stamp":"2024-09-14T11:30:09.411354+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:09:53.059916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2097152,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3,"num_read_kb":3072,"num_write":2,"num_write_kb":2048,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.4","version":"267'33","reported_seq":160,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:57:58.451122+0000","last_change":"2024-09-14T11:24:10.118920+0000","last_active":"2024-09-14T12:57:58.451122+0000","last_peered":"2024-09-14T12:57:58.451122+0000","last_clean":"2024-09-14T12:57:58.451122+0000","last_became_active":"2024-09-14T11:24:10.118333+0000","last_became_peered":"2024-09-14T11:24:10.118333+0000","last_unstale":"2024-09-14T12:57:58.451122+0000","last_undegraded":"2024-09-14T12:57:58.451122+0000","last_fullsized":"2024-09-14T12:57:58.451122+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:24:09.066501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:24:09.066501+0000","last_clean_scrub_stamp":"2024-09-14T11:24:09.066501+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:28:26.888200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":218,"num_read_kb":138,"num_write":85,"num_write_kb":20,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"68.6","version":"267'1","reported_seq":43,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:59:22.832926+0000","last_change":"2024-09-14T11:58:43.688943+0000","last_active":"2024-09-14T12:59:22.832926+0000","last_peered":"2024-09-14T12:59:22.832926+0000","last_clean":"2024-09-14T12:59:22.832926+0000","last_became_active":"2024-09-14T11:58:43.688251+0000","last_became_peered":"2024-09-14T11:58:43.688251+0000","last_unstale":"2024-09-14T12:59:22.832926+0000","last_undegraded":"2024-09-14T12:59:22.832926+0000","last_fullsized":"2024-09-14T12:59:22.832926+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:58:42.635024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:58:42.635024+0000","last_clean_scrub_stamp":"2024-09-14T11:58:42.635024+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:15:08.766031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.1","version":"267'6","reported_seq":80,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:59:53.476435+0000","last_change":"2024-09-14T11:30:17.519203+0000","last_active":"2024-09-14T12:59:53.476435+0000","last_peered":"2024-09-14T12:59:53.476435+0000","last_clean":"2024-09-14T12:59:53.476435+0000","last_became_active":"2024-09-14T11:30:17.518890+0000","last_became_peered":"2024-09-14T11:30:17.518890+0000","last_unstale":"2024-09-14T12:59:53.476435+0000","last_undegraded":"2024-09-14T12:59:53.476435+0000","last_fullsized":"2024-09-14T12:59:53.476435+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:30:16.474654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:30:16.474654+0000","last_clean_scrub_stamp":"2024-09-14T11:30:16.474654+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:51:39.220265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3145728,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":10,"num_read_kb":19458,"num_write":11,"num_write_kb":7168,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.0","version":"267'1","reported_seq":76,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:58:42.834093+0000","last_change":"2024-09-14T11:30:10.467502+0000","last_active":"2024-09-14T12:58:42.834093+0000","last_peered":"2024-09-14T12:58:42.834093+0000","last_clean":"2024-09-14T12:58:42.834093+0000","last_became_active":"2024-09-14T11:30:10.466391+0000","last_became_peered":"2024-09-14T11:30:10.466391+0000","last_unstale":"2024-09-14T12:58:42.834093+0000","last_undegraded":"2024-09-14T12:58:42.834093+0000","last_fullsized":"2024-09-14T12:58:42.834093+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:30:09.411354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:30:09.411354+0000","last_clean_scrub_stamp":"2024-09-14T11:30:09.411354+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:32:45.732767+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":40145,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":40,"num_write":1,"num_write_kb":40,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.3","version":"267'41","reported_seq":190,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:57:58.034292+0000","last_change":"2024-09-14T11:24:10.095296+0000","last_active":"2024-09-14T12:57:58.034292+0000","last_peered":"2024-09-14T12:57:58.034292+0000","last_clean":"2024-09-14T12:57:58.034292+0000","last_became_active":"2024-09-14T11:24:10.094515+0000","last_became_peered":"2024-09-14T11:24:10.094515+0000","last_unstale":"2024-09-14T12:57:58.034292+0000","last_undegraded":"2024-09-14T12:57:58.034292+0000","last_fullsized":"2024-09-14T12:57:58.034292+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:24:09.066501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:24:09.066501+0000","last_clean_scrub_stamp":"2024-09-14T11:24:09.066501+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":0,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:59:26.331974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":311,"num_read_kb":196,"num_write":106,"num_write_kb":28,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"68.7","version":"0'0","reported_seq":42,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:59:23.250462+0000","last_change":"2024-09-14T11:58:43.681439+0000","last_active":"2024-09-14T12:59:23.250462+0000","last_peered":"2024-09-14T12:59:23.250462+0000","last_clean":"2024-09-14T12:59:23.250462+0000","last_became_active":"2024-09-14T11:58:43.680569+0000","last_became_peered":"2024-09-14T11:58:43.680569+0000","last_unstale":"2024-09-14T12:59:23.250462+0000","last_undegraded":"2024-09-14T12:59:23.250462+0000","last_fullsized":"2024-09-14T12:59:23.250462+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:58:42.635024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:58:42.635024+0000","last_clean_scrub_stamp":"2024-09-14T11:58:42.635024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:50:38.486174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.0","version":"267'3","reported_seq":75,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:58:43.044284+0000","last_change":"2024-09-14T11:30:17.519289+0000","last_active":"2024-09-14T12:58:43.044284+0000","last_peered":"2024-09-14T12:58:43.044284+0000","last_clean":"2024-09-14T12:58:43.044284+0000","last_became_active":"2024-09-14T11:30:17.518524+0000","last_became_peered":"2024-09-14T11:30:17.518524+0000","last_unstale":"2024-09-14T12:58:43.044284+0000","last_undegraded":"2024-09-14T12:58:43.044284+0000","last_fullsized":"2024-09-14T12:58:43.044284+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:30:16.474654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:30:16.474654+0000","last_clean_scrub_stamp":"2024-09-14T11:30:16.474654+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:59:22.405921+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1048576,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":5,"num_read_kb":6144,"num_write":3,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.1","version":"267'4","reported_seq":79,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:59:47.849395+0000","last_change":"2024-09-14T11:30:10.465435+0000","last_active":"2024-09-14T12:59:47.849395+0000","last_peered":"2024-09-14T12:59:47.849395+0000","last_clean":"2024-09-14T12:59:47.849395+0000","last_became_active":"2024-09-14T11:30:10.464696+0000","last_became_peered":"2024-09-14T11:30:10.464696+0000","last_unstale":"2024-09-14T12:59:47.849395+0000","last_undegraded":"2024-09-14T12:59:47.849395+0000","last_fullsized":"2024-09-14T12:59:47.849395+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:30:09.411354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:30:09.411354+0000","last_clean_scrub_stamp":"2024-09-14T11:30:09.411354+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:34:28.871663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3,"num_read_kb":1024,"num_write":9,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.2","version":"267'34","reported_seq":175,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:57:58.218176+0000","last_change":"2024-09-14T11:24:10.126827+0000","last_active":"2024-09-14T12:57:58.218176+0000","last_peered":"2024-09-14T12:57:58.218176+0000","last_clean":"2024-09-14T12:57:58.218176+0000","last_became_active":"2024-09-14T11:24:10.125885+0000","last_became_peered":"2024-09-14T11:24:10.125885+0000","last_unstale":"2024-09-14T12:57:58.218176+0000","last_undegraded":"2024-09-14T12:57:58.218176+0000","last_fullsized":"2024-09-14T12:57:58.218176+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:24:09.066501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:24:09.066501+0000","last_clean_scrub_stamp":"2024-09-14T11:24:09.066501+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:23:21.772883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":284,"num_read_kb":180,"num_write":83,"num_write_kb":28,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"68.4","version":"0'0","reported_seq":43,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:59:08.246950+0000","last_change":"2024-09-14T11:58:43.663976+0000","last_active":"2024-09-14T12:59:08.246950+0000","last_peered":"2024-09-14T12:59:08.246950+0000","last_clean":"2024-09-14T12:59:08.246950+0000","last_became_active":"2024-09-14T11:58:43.662916+0000","last_became_peered":"2024-09-14T11:58:43.662916+0000","last_unstale":"2024-09-14T12:59:08.246950+0000","last_undegraded":"2024-09-14T12:59:08.246950+0000","last_fullsized":"2024-09-14T12:59:08.246950+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:58:42.635024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:58:42.635024+0000","last_clean_scrub_stamp":"2024-09-14T11:58:42.635024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:29:35.878769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.3","version":"264'4","reported_seq":77,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:59:53.441619+0000","last_change":"2024-09-14T11:30:17.549596+0000","last_active":"2024-09-14T12:59:53.441619+0000","last_peered":"2024-09-14T12:59:53.441619+0000","last_clean":"2024-09-14T12:59:53.441619+0000","last_became_active":"2024-09-14T11:30:17.549019+0000","last_became_peered":"2024-09-14T11:30:17.549019+0000","last_unstale":"2024-09-14T12:59:53.441619+0000","last_undegraded":"2024-09-14T12:59:53.441619+0000","last_fullsized":"2024-09-14T12:59:53.441619+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:30:16.474654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:30:16.474654+0000","last_clean_scrub_stamp":"2024-09-14T11:30:16.474654+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:25:28.016466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":4098,"num_write":4,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"66.2","version":"267'3","reported_seq":80,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:59:48.475431+0000","last_change":"2024-09-14T11:30:10.461463+0000","last_active":"2024-09-14T12:59:48.475431+0000","last_peered":"2024-09-14T12:59:48.475431+0000","last_clean":"2024-09-14T12:59:48.475431+0000","last_became_active":"2024-09-14T11:30:10.460643+0000","last_became_peered":"2024-09-14T11:30:10.460643+0000","last_unstale":"2024-09-14T12:59:48.475431+0000","last_undegraded":"2024-09-14T12:59:48.475431+0000","last_fullsized":"2024-09-14T12:59:48.475431+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:30:09.411354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:30:09.411354+0000","last_clean_scrub_stamp":"2024-09-14T11:30:09.411354+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:37:10.801240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1048576,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":5,"num_read_kb":3072,"num_write":3,"num_write_kb":2048,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.1","version":"267'13","reported_seq":114,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:57:58.608535+0000","last_change":"2024-09-14T11:24:10.117369+0000","last_active":"2024-09-14T12:57:58.608535+0000","last_peered":"2024-09-14T12:57:58.608535+0000","last_clean":"2024-09-14T12:57:58.608535+0000","last_became_active":"2024-09-14T11:24:10.116627+0000","last_became_peered":"2024-09-14T11:24:10.116627+0000","last_unstale":"2024-09-14T12:57:58.608535+0000","last_undegraded":"2024-09-14T12:57:58.608535+0000","last_fullsized":"2024-09-14T12:57:58.608535+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:24:09.066501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:24:09.066501+0000","last_clean_scrub_stamp":"2024-09-14T11:24:09.066501+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:17:32.530599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":96,"num_read_kb":63,"num_write":36,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.5","version":"0'0","reported_seq":43,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:59:32.846067+0000","last_change":"2024-09-14T11:58:43.696722+0000","last_active":"2024-09-14T12:59:32.846067+0000","last_peered":"2024-09-14T12:59:32.846067+0000","last_clean":"2024-09-14T12:59:32.846067+0000","last_became_active":"2024-09-14T11:58:43.695982+0000","last_became_peered":"2024-09-14T11:58:43.695982+0000","last_unstale":"2024-09-14T12:59:32.846067+0000","last_undegraded":"2024-09-14T12:59:32.846067+0000","last_fullsized":"2024-09-14T12:59:32.846067+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:58:42.635024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:58:42.635024+0000","last_clean_scrub_stamp":"2024-09-14T11:58:42.635024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:04:33.126348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.2","version":"264'8","reported_seq":85,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:59:53.244786+0000","last_change":"2024-09-14T11:30:17.513530+0000","last_active":"2024-09-14T12:59:53.244786+0000","last_peered":"2024-09-14T12:59:53.244786+0000","last_clean":"2024-09-14T12:59:53.244786+0000","last_became_active":"2024-09-14T11:30:17.512689+0000","last_became_peered":"2024-09-14T11:30:17.512689+0000","last_unstale":"2024-09-14T12:59:53.244786+0000","last_undegraded":"2024-09-14T12:59:53.244786+0000","last_fullsized":"2024-09-14T12:59:53.244786+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:30:16.474654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:30:16.474654+0000","last_clean_scrub_stamp":"2024-09-14T11:30:16.474654+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:38:38.268473+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":21506,"num_write":8,"num_write_kb":9216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.3","version":"0'0","reported_seq":73,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:59:48.440576+0000","last_change":"2024-09-14T11:30:10.474713+0000","last_active":"2024-09-14T12:59:48.440576+0000","last_peered":"2024-09-14T12:59:48.440576+0000","last_clean":"2024-09-14T12:59:48.440576+0000","last_became_active":"2024-09-14T11:30:10.473880+0000","last_became_peered":"2024-09-14T11:30:10.473880+0000","last_unstale":"2024-09-14T12:59:48.440576+0000","last_undegraded":"2024-09-14T12:59:48.440576+0000","last_fullsized":"2024-09-14T12:59:48.440576+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:30:09.411354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:30:09.411354+0000","last_clean_scrub_stamp":"2024-09-14T11:30:09.411354+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:44:00.695204+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"65.0","version":"264'14","reported_seq":122,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:58:42.834131+0000","last_change":"2024-09-14T11:24:10.116538+0000","last_active":"2024-09-14T12:58:42.834131+0000","last_peered":"2024-09-14T12:58:42.834131+0000","last_clean":"2024-09-14T12:58:42.834131+0000","last_became_active":"2024-09-14T11:24:10.115799+0000","last_became_peered":"2024-09-14T11:24:10.115799+0000","last_unstale":"2024-09-14T12:58:42.834131+0000","last_undegraded":"2024-09-14T12:58:42.834131+0000","last_fullsized":"2024-09-14T12:58:42.834131+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:24:09.066501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:24:09.066501+0000","last_clean_scrub_stamp":"2024-09-14T11:24:09.066501+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:53:06.539792+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":114,"num_read_kb":78,"num_write":35,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3f","version":"267'198","reported_seq":868,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:58:47.835532+0000","last_change":"2024-09-14T11:08:21.831355+0000","last_active":"2024-09-14T12:58:47.835532+0000","last_peered":"2024-09-14T12:58:47.835532+0000","last_clean":"2024-09-14T12:58:47.835532+0000","last_became_active":"2024-09-14T11:08:21.829676+0000","last_became_peered":"2024-09-14T11:08:21.829676+0000","last_unstale":"2024-09-14T12:58:47.835532+0000","last_undegraded":"2024-09-14T12:58:47.835532+0000","last_fullsized":"2024-09-14T12:58:47.835532+0000","mapping_epoch":24,"log_start":"267'100","ondisk_log_start":"267'100","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:08:20.733145+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:08:20.733145+0000","last_clean_scrub_stamp":"2024-09-14T11:08:20.733145+0000","objects_scrubbed":0,"log_size":98,"log_dups_size":100,"ondisk_log_size":98,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:36:16.240993+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":11861059,"num_objects":10,"num_object_clones":0,"num_object_copies":30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":566,"num_read_kb":18432,"num_write":885,"num_write_kb":26168,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,0],"acting":[7,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.38","version":"267'461","reported_seq":2067,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:59:14.735536+0000","last_change":"2024-09-14T11:08:23.801607+0000","last_active":"2024-09-14T12:59:14.735536+0000","last_peered":"2024-09-14T12:59:14.735536+0000","last_clean":"2024-09-14T12:59:14.735536+0000","last_became_active":"2024-09-14T11:08:23.800936+0000","last_became_peered":"2024-09-14T11:08:23.800936+0000","last_unstale":"2024-09-14T12:59:14.735536+0000","last_undegraded":"2024-09-14T12:59:14.735536+0000","last_fullsized":"2024-09-14T12:59:14.735536+0000","mapping_epoch":26,"log_start":"267'400","ondisk_log_start":"267'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:08:22.750609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:08:22.750609+0000","last_clean_scrub_stamp":"2024-09-14T11:08:22.750609+0000","objects_scrubbed":0,"log_size":61,"log_dups_size":400,"ondisk_log_size":61,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:16:00.073851+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":2476,"num_read_kb":2325,"num_write":550,"num_write_kb":127,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3e","version":"267'223","reported_seq":930,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:58:48.462460+0000","last_change":"2024-09-14T11:08:21.810078+0000","last_active":"2024-09-14T12:58:48.462460+0000","last_peered":"2024-09-14T12:58:48.462460+0000","last_clean":"2024-09-14T12:58:48.462460+0000","last_became_active":"2024-09-14T11:08:21.808315+0000","last_became_peered":"2024-09-14T11:08:21.808315+0000","last_unstale":"2024-09-14T12:58:48.462460+0000","last_undegraded":"2024-09-14T12:58:48.462460+0000","last_fullsized":"2024-09-14T12:58:48.462460+0000","mapping_epoch":24,"log_start":"267'200","ondisk_log_start":"267'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:08:20.733145+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:08:20.733145+0000","last_clean_scrub_stamp":"2024-09-14T11:08:20.733145+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":200,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:01:33.622838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8326349,"num_objects":9,"num_object_clones":0,"num_object_copies":27,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":599,"num_read_kb":113994,"num_write":1039,"num_write_kb":54817,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,6],"acting":[1,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.39","version":"267'896","reported_seq":2642,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:59:07.757541+0000","last_change":"2024-09-14T11:08:23.802023+0000","last_active":"2024-09-14T12:59:07.757541+0000","last_peered":"2024-09-14T12:59:07.757541+0000","last_clean":"2024-09-14T12:59:07.757541+0000","last_became_active":"2024-09-14T11:08:23.801320+0000","last_became_peered":"2024-09-14T11:08:23.801320+0000","last_unstale":"2024-09-14T12:59:07.757541+0000","last_undegraded":"2024-09-14T12:59:07.757541+0000","last_fullsized":"2024-09-14T12:59:07.757541+0000","mapping_epoch":26,"log_start":"267'800","ondisk_log_start":"267'800","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:08:22.750609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:08:22.750609+0000","last_clean_scrub_stamp":"2024-09-14T11:08:22.750609+0000","objects_scrubbed":0,"log_size":96,"log_dups_size":800,"ondisk_log_size":96,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:41:31.186802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":4549,"num_read_kb":4112,"num_write":1219,"num_write_kb":503,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3d","version":"267'199","reported_seq":846,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:58:48.241280+0000","last_change":"2024-09-14T11:08:21.776968+0000","last_active":"2024-09-14T12:58:48.241280+0000","last_peered":"2024-09-14T12:58:48.241280+0000","last_clean":"2024-09-14T12:58:48.241280+0000","last_became_active":"2024-09-14T11:08:21.776255+0000","last_became_peered":"2024-09-14T11:08:21.776255+0000","last_unstale":"2024-09-14T12:58:48.241280+0000","last_undegraded":"2024-09-14T12:58:48.241280+0000","last_fullsized":"2024-09-14T12:58:48.241280+0000","mapping_epoch":24,"log_start":"267'100","ondisk_log_start":"267'100","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:08:20.733145+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:08:20.733145+0000","last_clean_scrub_stamp":"2024-09-14T11:08:20.733145+0000","objects_scrubbed":0,"log_size":99,"log_dups_size":100,"ondisk_log_size":99,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:55:21.434023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":840651,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":485,"num_read_kb":4028,"num_write":959,"num_write_kb":22458,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"267'468","reported_seq":2120,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:59:07.754233+0000","last_change":"2024-09-14T11:08:23.787232+0000","last_active":"2024-09-14T12:59:07.754233+0000","last_peered":"2024-09-14T12:59:07.754233+0000","last_clean":"2024-09-14T12:59:07.754233+0000","last_became_active":"2024-09-14T11:08:23.786481+0000","last_became_peered":"2024-09-14T11:08:23.786481+0000","last_unstale":"2024-09-14T12:59:07.754233+0000","last_undegraded":"2024-09-14T12:59:07.754233+0000","last_fullsized":"2024-09-14T12:59:07.754233+0000","mapping_epoch":26,"log_start":"267'400","ondisk_log_start":"267'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:08:22.750609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:08:22.750609+0000","last_clean_scrub_stamp":"2024-09-14T11:08:22.750609+0000","objects_scrubbed":0,"log_size":68,"log_dups_size":400,"ondisk_log_size":68,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:00:38.268952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2493,"num_read_kb":2352,"num_write":540,"num_write_kb":121,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3c","version":"267'342","reported_seq":1083,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:58:53.046745+0000","last_change":"2024-09-14T11:08:21.802797+0000","last_active":"2024-09-14T12:58:53.046745+0000","last_peered":"2024-09-14T12:58:53.046745+0000","last_clean":"2024-09-14T12:58:53.046745+0000","last_became_active":"2024-09-14T11:08:21.801787+0000","last_became_peered":"2024-09-14T11:08:21.801787+0000","last_unstale":"2024-09-14T12:58:53.046745+0000","last_undegraded":"2024-09-14T12:58:53.046745+0000","last_fullsized":"2024-09-14T12:58:53.046745+0000","mapping_epoch":24,"log_start":"267'300","ondisk_log_start":"267'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:08:20.733145+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:08:20.733145+0000","last_clean_scrub_stamp":"2024-09-14T11:08:20.733145+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":300,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:42:26.197796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12932840,"num_objects":11,"num_object_clones":0,"num_object_copies":33,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":1003,"num_read_kb":46020,"num_write":1378,"num_write_kb":39725,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3b","version":"267'448","reported_seq":1981,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:58:28.236458+0000","last_change":"2024-09-14T11:08:23.783446+0000","last_active":"2024-09-14T12:58:28.236458+0000","last_peered":"2024-09-14T12:58:28.236458+0000","last_clean":"2024-09-14T12:58:28.236458+0000","last_became_active":"2024-09-14T11:08:23.783162+0000","last_became_peered":"2024-09-14T11:08:23.783162+0000","last_unstale":"2024-09-14T12:58:28.236458+0000","last_undegraded":"2024-09-14T12:58:28.236458+0000","last_fullsized":"2024-09-14T12:58:28.236458+0000","mapping_epoch":26,"log_start":"267'400","ondisk_log_start":"267'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:08:22.750609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:08:22.750609+0000","last_clean_scrub_stamp":"2024-09-14T11:08:22.750609+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":400,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:56:25.662634+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2320,"num_read_kb":2170,"num_write":502,"num_write_kb":112,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3b","version":"267'203","reported_seq":884,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:58:22.829701+0000","last_change":"2024-09-14T11:08:21.842866+0000","last_active":"2024-09-14T12:58:22.829701+0000","last_peered":"2024-09-14T12:58:22.829701+0000","last_clean":"2024-09-14T12:58:22.829701+0000","last_became_active":"2024-09-14T11:08:21.842260+0000","last_became_peered":"2024-09-14T11:08:21.842260+0000","last_unstale":"2024-09-14T12:58:22.829701+0000","last_undegraded":"2024-09-14T12:58:22.829701+0000","last_fullsized":"2024-09-14T12:58:22.829701+0000","mapping_epoch":24,"log_start":"267'100","ondisk_log_start":"267'100","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:08:20.733145+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:08:20.733145+0000","last_clean_scrub_stamp":"2024-09-14T11:08:20.733145+0000","objects_scrubbed":0,"log_size":103,"log_dups_size":100,"ondisk_log_size":103,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:22:55.165506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":14390472,"num_objects":10,"num_object_clones":0,"num_object_copies":30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":558,"num_read_kb":28109,"num_write":982,"num_write_kb":35425,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,4],"acting":[7,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3c","version":"267'413","reported_seq":2185,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:00:21.249733+0000","last_change":"2024-09-14T11:08:23.805016+0000","last_active":"2024-09-14T13:00:21.249733+0000","last_peered":"2024-09-14T13:00:21.249733+0000","last_clean":"2024-09-14T13:00:21.249733+0000","last_became_active":"2024-09-14T11:08:23.804142+0000","last_became_peered":"2024-09-14T11:08:23.804142+0000","last_unstale":"2024-09-14T13:00:21.249733+0000","last_undegraded":"2024-09-14T13:00:21.249733+0000","last_fullsized":"2024-09-14T13:00:21.249733+0000","mapping_epoch":26,"log_start":"267'400","ondisk_log_start":"267'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:08:22.750609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:08:22.750609+0000","last_clean_scrub_stamp":"2024-09-14T11:08:22.750609+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":400,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:55:23.451486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":2567,"num_read_kb":2469,"num_write":470,"num_write_kb":86,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.3a","version":"267'150","reported_seq":774,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:58:23.039736+0000","last_change":"2024-09-14T11:08:21.794493+0000","last_active":"2024-09-14T12:58:23.039736+0000","last_peered":"2024-09-14T12:58:23.039736+0000","last_clean":"2024-09-14T12:58:23.039736+0000","last_became_active":"2024-09-14T11:08:21.791801+0000","last_became_peered":"2024-09-14T11:08:21.791801+0000","last_unstale":"2024-09-14T12:58:23.039736+0000","last_undegraded":"2024-09-14T12:58:23.039736+0000","last_fullsized":"2024-09-14T12:58:23.039736+0000","mapping_epoch":24,"log_start":"267'100","ondisk_log_start":"267'100","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:08:20.733145+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:08:20.733145+0000","last_clean_scrub_stamp":"2024-09-14T11:08:20.733145+0000","objects_scrubbed":0,"log_size":50,"log_dups_size":100,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:05:17.496109+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9789060,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":408,"num_read_kb":24131,"num_write":675,"num_write_kb":32915,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,3],"acting":[5,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3d","version":"267'393","reported_seq":1933,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:00:21.252531+0000","last_change":"2024-09-14T11:08:23.787239+0000","last_active":"2024-09-14T13:00:21.252531+0000","last_peered":"2024-09-14T13:00:21.252531+0000","last_clean":"2024-09-14T13:00:21.252531+0000","last_became_active":"2024-09-14T11:08:23.786522+0000","last_became_peered":"2024-09-14T11:08:23.786522+0000","last_unstale":"2024-09-14T13:00:21.252531+0000","last_undegraded":"2024-09-14T13:00:21.252531+0000","last_fullsized":"2024-09-14T13:00:21.252531+0000","mapping_epoch":26,"log_start":"267'300","ondisk_log_start":"267'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:08:22.750609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:08:22.750609+0000","last_clean_scrub_stamp":"2024-09-14T11:08:22.750609+0000","objects_scrubbed":0,"log_size":93,"log_dups_size":300,"ondisk_log_size":93,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:53:44.242192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2147,"num_read_kb":2043,"num_write":454,"num_write_kb":90,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.39","version":"267'263","reported_seq":1028,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:58:22.829604+0000","last_change":"2024-09-14T11:08:21.837745+0000","last_active":"2024-09-14T12:58:22.829604+0000","last_peered":"2024-09-14T12:58:22.829604+0000","last_clean":"2024-09-14T12:58:22.829604+0000","last_became_active":"2024-09-14T11:08:21.837147+0000","last_became_peered":"2024-09-14T11:08:21.837147+0000","last_unstale":"2024-09-14T12:58:22.829604+0000","last_undegraded":"2024-09-14T12:58:22.829604+0000","last_fullsized":"2024-09-14T12:58:22.829604+0000","mapping_epoch":24,"log_start":"267'200","ondisk_log_start":"267'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:08:20.733145+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:08:20.733145+0000","last_clean_scrub_stamp":"2024-09-14T11:08:20.733145+0000","objects_scrubbed":0,"log_size":63,"log_dups_size":200,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:35:30.293697+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5878766,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":1265,"num_read_kb":31286,"num_write":1151,"num_write_kb":25837,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0,4],"acting":[7,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3e","version":"267'508","reported_seq":2123,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:00:11.324764+0000","last_change":"2024-09-14T11:08:23.801317+0000","last_active":"2024-09-14T13:00:11.324764+0000","last_peered":"2024-09-14T13:00:11.324764+0000","last_clean":"2024-09-14T13:00:11.324764+0000","last_became_active":"2024-09-14T11:08:23.800621+0000","last_became_peered":"2024-09-14T11:08:23.800621+0000","last_unstale":"2024-09-14T13:00:11.324764+0000","last_undegraded":"2024-09-14T13:00:11.324764+0000","last_fullsized":"2024-09-14T13:00:11.324764+0000","mapping_epoch":26,"log_start":"267'400","ondisk_log_start":"267'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:08:22.750609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:08:22.750609+0000","last_clean_scrub_stamp":"2024-09-14T11:08:22.750609+0000","objects_scrubbed":0,"log_size":108,"log_dups_size":400,"ondisk_log_size":108,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:34:14.386345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2676,"num_read_kb":2481,"num_write":623,"num_write_kb":172,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.38","version":"267'206","reported_seq":872,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:59:07.321553+0000","last_change":"2024-09-14T11:08:21.819323+0000","last_active":"2024-09-14T12:59:07.321553+0000","last_peered":"2024-09-14T12:59:07.321553+0000","last_clean":"2024-09-14T12:59:07.321553+0000","last_became_active":"2024-09-14T11:08:21.819029+0000","last_became_peered":"2024-09-14T11:08:21.819029+0000","last_unstale":"2024-09-14T12:59:07.321553+0000","last_undegraded":"2024-09-14T12:59:07.321553+0000","last_fullsized":"2024-09-14T12:59:07.321553+0000","mapping_epoch":24,"log_start":"267'100","ondisk_log_start":"267'100","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:08:20.733145+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:08:20.733145+0000","last_clean_scrub_stamp":"2024-09-14T11:08:20.733145+0000","objects_scrubbed":0,"log_size":106,"log_dups_size":100,"ondisk_log_size":106,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:51:45.031916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12593222,"num_objects":11,"num_object_clones":0,"num_object_copies":33,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":520,"num_read_kb":44666,"num_write":924,"num_write_kb":39932,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,6],"acting":[3,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3f","version":"267'916","reported_seq":2562,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:59:18.403546+0000","last_change":"2024-09-14T11:08:23.786220+0000","last_active":"2024-09-14T12:59:18.403546+0000","last_peered":"2024-09-14T12:59:18.403546+0000","last_clean":"2024-09-14T12:59:18.403546+0000","last_became_active":"2024-09-14T11:08:23.785941+0000","last_became_peered":"2024-09-14T11:08:23.785941+0000","last_unstale":"2024-09-14T12:59:18.403546+0000","last_undegraded":"2024-09-14T12:59:18.403546+0000","last_fullsized":"2024-09-14T12:59:18.403546+0000","mapping_epoch":26,"log_start":"267'900","ondisk_log_start":"267'900","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:08:22.750609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:08:22.750609+0000","last_clean_scrub_stamp":"2024-09-14T11:08:22.750609+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":900,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:26:08.067752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":4272,"num_read_kb":3805,"num_write":1224,"num_write_kb":476,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"267'397","reported_seq":1969,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:00:21.252799+0000","last_change":"2024-09-14T11:08:23.786268+0000","last_active":"2024-09-14T13:00:21.252799+0000","last_peered":"2024-09-14T13:00:21.252799+0000","last_clean":"2024-09-14T13:00:21.252799+0000","last_became_active":"2024-09-14T11:08:23.785439+0000","last_became_peered":"2024-09-14T11:08:23.785439+0000","last_unstale":"2024-09-14T13:00:21.252799+0000","last_undegraded":"2024-09-14T13:00:21.252799+0000","last_fullsized":"2024-09-14T13:00:21.252799+0000","mapping_epoch":26,"log_start":"267'300","ondisk_log_start":"267'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:08:22.750609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:08:22.750609+0000","last_clean_scrub_stamp":"2024-09-14T11:08:22.750609+0000","objects_scrubbed":0,"log_size":97,"log_dups_size":300,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:49:38.056814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2124,"num_read_kb":2036,"num_write":427,"num_write_kb":63,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.37","version":"267'271","reported_seq":1003,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:57:42.820443+0000","last_change":"2024-09-14T11:08:21.806356+0000","last_active":"2024-09-14T12:57:42.820443+0000","last_peered":"2024-09-14T12:57:42.820443+0000","last_clean":"2024-09-14T12:57:42.820443+0000","last_became_active":"2024-09-14T11:08:21.805293+0000","last_became_peered":"2024-09-14T11:08:21.805293+0000","last_unstale":"2024-09-14T12:57:42.820443+0000","last_undegraded":"2024-09-14T12:57:42.820443+0000","last_fullsized":"2024-09-14T12:57:42.820443+0000","mapping_epoch":24,"log_start":"267'200","ondisk_log_start":"267'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:08:20.733145+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:08:20.733145+0000","last_clean_scrub_stamp":"2024-09-14T11:08:20.733145+0000","objects_scrubbed":0,"log_size":71,"log_dups_size":200,"ondisk_log_size":71,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:37:18.597607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10071722,"num_objects":9,"num_object_clones":0,"num_object_copies":27,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":1081,"num_read_kb":13085,"num_write":1145,"num_write_kb":51014,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,0],"acting":[7,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.31","version":"267'698","reported_seq":2408,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:00:21.250245+0000","last_change":"2024-09-14T11:08:23.808916+0000","last_active":"2024-09-14T13:00:21.250245+0000","last_peered":"2024-09-14T13:00:21.250245+0000","last_clean":"2024-09-14T13:00:21.250245+0000","last_became_active":"2024-09-14T11:08:23.808090+0000","last_became_peered":"2024-09-14T11:08:23.808090+0000","last_unstale":"2024-09-14T13:00:21.250245+0000","last_undegraded":"2024-09-14T13:00:21.250245+0000","last_fullsized":"2024-09-14T13:00:21.250245+0000","mapping_epoch":26,"log_start":"267'600","ondisk_log_start":"267'600","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:08:22.750609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:08:22.750609+0000","last_clean_scrub_stamp":"2024-09-14T11:08:22.750609+0000","objects_scrubbed":0,"log_size":98,"log_dups_size":600,"ondisk_log_size":98,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:17:11.316389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":3652,"num_read_kb":3296,"num_write":1024,"num_write_kb":466,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"267'178","reported_seq":813,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:59:33.437531+0000","last_change":"2024-09-14T11:08:21.825717+0000","last_active":"2024-09-14T12:59:33.437531+0000","last_peered":"2024-09-14T12:59:33.437531+0000","last_clean":"2024-09-14T12:59:33.437531+0000","last_became_active":"2024-09-14T11:08:21.824907+0000","last_became_peered":"2024-09-14T11:08:21.824907+0000","last_unstale":"2024-09-14T12:59:33.437531+0000","last_undegraded":"2024-09-14T12:59:33.437531+0000","last_fullsized":"2024-09-14T12:59:33.437531+0000","mapping_epoch":24,"log_start":"267'100","ondisk_log_start":"267'100","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:08:20.733145+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:08:20.733145+0000","last_clean_scrub_stamp":"2024-09-14T11:08:20.733145+0000","objects_scrubbed":0,"log_size":78,"log_dups_size":100,"ondisk_log_size":78,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:24:44.159796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6291524,"num_objects":9,"num_object_clones":0,"num_object_copies":27,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":503,"num_read_kb":17557,"num_write":871,"num_write_kb":17084,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,4],"acting":[6,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.32","version":"267'540","reported_seq":2172,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:58:38.043258+0000","last_change":"2024-09-14T11:08:23.804611+0000","last_active":"2024-09-14T12:58:38.043258+0000","last_peered":"2024-09-14T12:58:38.043258+0000","last_clean":"2024-09-14T12:58:38.043258+0000","last_became_active":"2024-09-14T11:08:23.801090+0000","last_became_peered":"2024-09-14T11:08:23.801090+0000","last_unstale":"2024-09-14T12:58:38.043258+0000","last_undegraded":"2024-09-14T12:58:38.043258+0000","last_fullsized":"2024-09-14T12:58:38.043258+0000","mapping_epoch":26,"log_start":"267'500","ondisk_log_start":"267'500","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:08:22.750609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:08:22.750609+0000","last_clean_scrub_stamp":"2024-09-14T11:08:22.750609+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":500,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:20:59.798401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2832,"num_read_kb":2611,"num_write":684,"num_write_kb":208,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.35","version":"267'226","reported_seq":896,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:59:33.437462+0000","last_change":"2024-09-14T11:08:21.817869+0000","last_active":"2024-09-14T12:59:33.437462+0000","last_peered":"2024-09-14T12:59:33.437462+0000","last_clean":"2024-09-14T12:59:33.437462+0000","last_became_active":"2024-09-14T11:08:21.817113+0000","last_became_peered":"2024-09-14T11:08:21.817113+0000","last_unstale":"2024-09-14T12:59:33.437462+0000","last_undegraded":"2024-09-14T12:59:33.437462+0000","last_fullsized":"2024-09-14T12:59:33.437462+0000","mapping_epoch":24,"log_start":"267'200","ondisk_log_start":"267'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:08:20.733145+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:08:20.733145+0000","last_clean_scrub_stamp":"2024-09-14T11:08:20.733145+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":200,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:19:02.887954+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5850197,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":572,"num_read_kb":71773,"num_write":1061,"num_write_kb":34768,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,0],"acting":[6,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.33","version":"267'480","reported_seq":2201,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:59:14.731435+0000","last_change":"2024-09-14T11:08:23.782419+0000","last_active":"2024-09-14T12:59:14.731435+0000","last_peered":"2024-09-14T12:59:14.731435+0000","last_clean":"2024-09-14T12:59:14.731435+0000","last_became_active":"2024-09-14T11:08:23.782135+0000","last_became_peered":"2024-09-14T11:08:23.782135+0000","last_unstale":"2024-09-14T12:59:14.731435+0000","last_undegraded":"2024-09-14T12:59:14.731435+0000","last_fullsized":"2024-09-14T12:59:14.731435+0000","mapping_epoch":26,"log_start":"267'400","ondisk_log_start":"267'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:08:22.750609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:08:22.750609+0000","last_clean_scrub_stamp":"2024-09-14T11:08:22.750609+0000","objects_scrubbed":0,"log_size":80,"log_dups_size":400,"ondisk_log_size":80,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:10:45.724644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2660,"num_read_kb":2528,"num_write":519,"num_write_kb":93,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.34","version":"267'243","reported_seq":897,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:59:33.240274+0000","last_change":"2024-09-14T11:08:21.837036+0000","last_active":"2024-09-14T12:59:33.240274+0000","last_peered":"2024-09-14T12:59:33.240274+0000","last_clean":"2024-09-14T12:59:33.240274+0000","last_became_active":"2024-09-14T11:08:21.835636+0000","last_became_peered":"2024-09-14T11:08:21.835636+0000","last_unstale":"2024-09-14T12:59:33.240274+0000","last_undegraded":"2024-09-14T12:59:33.240274+0000","last_fullsized":"2024-09-14T12:59:33.240274+0000","mapping_epoch":24,"log_start":"267'200","ondisk_log_start":"267'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:08:20.733145+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:08:20.733145+0000","last_clean_scrub_stamp":"2024-09-14T11:08:20.733145+0000","objects_scrubbed":0,"log_size":43,"log_dups_size":200,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:36:27.787998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4436620,"num_objects":9,"num_object_clones":0,"num_object_copies":27,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":568,"num_read_kb":3577,"num_write":1178,"num_write_kb":25395,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6],"acting":[4,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.34","version":"267'553","reported_seq":2210,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:58:07.979376+0000","last_change":"2024-09-14T11:08:23.784471+0000","last_active":"2024-09-14T12:58:07.979376+0000","last_peered":"2024-09-14T12:58:07.979376+0000","last_clean":"2024-09-14T12:58:07.979376+0000","last_became_active":"2024-09-14T11:08:23.784078+0000","last_became_peered":"2024-09-14T11:08:23.784078+0000","last_unstale":"2024-09-14T12:58:07.979376+0000","last_undegraded":"2024-09-14T12:58:07.979376+0000","last_fullsized":"2024-09-14T12:58:07.979376+0000","mapping_epoch":26,"log_start":"267'500","ondisk_log_start":"267'500","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:08:22.750609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:08:22.750609+0000","last_clean_scrub_stamp":"2024-09-14T11:08:22.750609+0000","objects_scrubbed":0,"log_size":53,"log_dups_size":500,"ondisk_log_size":53,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:53:20.985980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3071,"num_read_kb":2852,"num_write":734,"num_write_kb":256,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.33","version":"267'233","reported_seq":867,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:59:33.474985+0000","last_change":"2024-09-14T11:08:21.809864+0000","last_active":"2024-09-14T12:59:33.474985+0000","last_peered":"2024-09-14T12:59:33.474985+0000","last_clean":"2024-09-14T12:59:33.474985+0000","last_became_active":"2024-09-14T11:08:21.809526+0000","last_became_peered":"2024-09-14T11:08:21.809526+0000","last_unstale":"2024-09-14T12:59:33.474985+0000","last_undegraded":"2024-09-14T12:59:33.474985+0000","last_fullsized":"2024-09-14T12:59:33.474985+0000","mapping_epoch":24,"log_start":"267'200","ondisk_log_start":"267'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:08:20.733145+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:08:20.733145+0000","last_clean_scrub_stamp":"2024-09-14T11:08:20.733145+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":200,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:48:26.943407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4221511,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":493,"num_read_kb":25002,"num_write":1052,"num_write_kb":23085,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6,1],"acting":[3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.35","version":"267'800","reported_seq":2455,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:00:11.251816+0000","last_change":"2024-09-14T11:08:23.786757+0000","last_active":"2024-09-14T13:00:11.251816+0000","last_peered":"2024-09-14T13:00:11.251816+0000","last_clean":"2024-09-14T13:00:11.251816+0000","last_became_active":"2024-09-14T11:08:23.785540+0000","last_became_peered":"2024-09-14T11:08:23.785540+0000","last_unstale":"2024-09-14T13:00:11.251816+0000","last_undegraded":"2024-09-14T13:00:11.251816+0000","last_fullsized":"2024-09-14T13:00:11.251816+0000","mapping_epoch":26,"log_start":"267'700","ondisk_log_start":"267'700","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:08:22.750609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:08:22.750609+0000","last_clean_scrub_stamp":"2024-09-14T11:08:22.750609+0000","objects_scrubbed":0,"log_size":100,"log_dups_size":700,"ondisk_log_size":100,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:29:32.957124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3845,"num_read_kb":3496,"num_write":1039,"num_write_kb":364,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.32","version":"267'213","reported_seq":1002,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:58:23.453514+0000","last_change":"2024-09-14T11:08:21.781133+0000","last_active":"2024-09-14T12:58:23.453514+0000","last_peered":"2024-09-14T12:58:23.453514+0000","last_clean":"2024-09-14T12:58:23.453514+0000","last_became_active":"2024-09-14T11:08:21.780800+0000","last_became_peered":"2024-09-14T11:08:21.780800+0000","last_unstale":"2024-09-14T12:58:23.453514+0000","last_undegraded":"2024-09-14T12:58:23.453514+0000","last_fullsized":"2024-09-14T12:58:23.453514+0000","mapping_epoch":24,"log_start":"267'200","ondisk_log_start":"267'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:08:20.733145+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:08:20.733145+0000","last_clean_scrub_stamp":"2024-09-14T11:08:20.733145+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":200,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:07:51.388416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":13282806,"num_objects":13,"num_object_clones":0,"num_object_copies":39,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":13,"num_whiteouts":0,"num_read":1390,"num_read_kb":21343,"num_write":1076,"num_write_kb":34809,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,1],"acting":[0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.18","version":"267'195","reported_seq":738,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:00:21.491522+0000","last_change":"2024-09-14T11:08:31.851342+0000","last_active":"2024-09-14T13:00:21.491522+0000","last_peered":"2024-09-14T13:00:21.491522+0000","last_clean":"2024-09-14T13:00:21.491522+0000","last_became_active":"2024-09-14T11:08:31.850605+0000","last_became_peered":"2024-09-14T11:08:31.850605+0000","last_unstale":"2024-09-14T13:00:21.491522+0000","last_undegraded":"2024-09-14T13:00:21.491522+0000","last_fullsized":"2024-09-14T13:00:21.491522+0000","mapping_epoch":34,"log_start":"267'100","ondisk_log_start":"267'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:08:30.789404+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:08:30.789404+0000","last_clean_scrub_stamp":"2024-09-14T11:08:30.789404+0000","objects_scrubbed":0,"log_size":95,"log_dups_size":100,"ondisk_log_size":95,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:48:10.230125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":204,"num_read_kb":191,"num_write":376,"num_write_kb":86,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.14","version":"267'865","reported_seq":2388,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:00:18.886532+0000","last_change":"2024-09-14T11:08:23.780134+0000","last_active":"2024-09-14T13:00:18.886532+0000","last_peered":"2024-09-14T13:00:18.886532+0000","last_clean":"2024-09-14T13:00:18.886532+0000","last_became_active":"2024-09-14T11:08:23.779822+0000","last_became_peered":"2024-09-14T11:08:23.779822+0000","last_unstale":"2024-09-14T13:00:18.886532+0000","last_undegraded":"2024-09-14T13:00:18.886532+0000","last_fullsized":"2024-09-14T13:00:18.886532+0000","mapping_epoch":26,"log_start":"267'800","ondisk_log_start":"267'800","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:08:22.750609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:08:22.750609+0000","last_clean_scrub_stamp":"2024-09-14T11:08:22.750609+0000","objects_scrubbed":0,"log_size":65,"log_dups_size":800,"ondisk_log_size":65,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:33:11.558147+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":4044,"num_read_kb":3595,"num_write":1182,"num_write_kb":452,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"267'233","reported_seq":1001,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:59:18.105681+0000","last_change":"2024-09-14T11:08:21.843849+0000","last_active":"2024-09-14T12:59:18.105681+0000","last_peered":"2024-09-14T12:59:18.105681+0000","last_clean":"2024-09-14T12:59:18.105681+0000","last_became_active":"2024-09-14T11:08:21.843212+0000","last_became_peered":"2024-09-14T11:08:21.843212+0000","last_unstale":"2024-09-14T12:59:18.105681+0000","last_undegraded":"2024-09-14T12:59:18.105681+0000","last_fullsized":"2024-09-14T12:59:18.105681+0000","mapping_epoch":24,"log_start":"267'200","ondisk_log_start":"267'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:08:20.733145+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:08:20.733145+0000","last_clean_scrub_stamp":"2024-09-14T11:08:20.733145+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":200,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:37:14.565663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9776683,"num_objects":9,"num_object_clones":0,"num_object_copies":27,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":1009,"num_read_kb":177065,"num_write":1096,"num_write_kb":33961,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,4],"acting":[7,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":525,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:57:13.024031+0000","last_change":"2024-09-14T11:08:25.814095+0000","last_active":"2024-09-14T12:57:13.024031+0000","last_peered":"2024-09-14T12:57:13.024031+0000","last_clean":"2024-09-14T12:57:13.024031+0000","last_became_active":"2024-09-14T11:08:25.803311+0000","last_became_peered":"2024-09-14T11:08:25.803311+0000","last_unstale":"2024-09-14T12:57:13.024031+0000","last_undegraded":"2024-09-14T12:57:13.024031+0000","last_fullsized":"2024-09-14T12:57:13.024031+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:08:24.757170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:08:24.757170+0000","last_clean_scrub_stamp":"2024-09-14T11:08:24.757170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:07:56.109258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.16","version":"267'224","reported_seq":877,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:59:38.254173+0000","last_change":"2024-09-14T11:08:27.809396+0000","last_active":"2024-09-14T12:59:38.254173+0000","last_peered":"2024-09-14T12:59:38.254173+0000","last_clean":"2024-09-14T12:59:38.254173+0000","last_became_active":"2024-09-14T11:08:27.808834+0000","last_became_peered":"2024-09-14T11:08:27.808834+0000","last_unstale":"2024-09-14T12:59:38.254173+0000","last_undegraded":"2024-09-14T12:59:38.254173+0000","last_fullsized":"2024-09-14T12:59:38.254173+0000","mapping_epoch":30,"log_start":"267'200","ondisk_log_start":"267'200","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:08:26.771628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:08:26.771628+0000","last_clean_scrub_stamp":"2024-09-14T11:08:26.771628+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":200,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:33:46.586543+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7578,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":299,"num_read_kb":302,"num_write":176,"num_write_kb":15,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":518,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:57:17.814599+0000","last_change":"2024-09-14T11:08:29.834235+0000","last_active":"2024-09-14T12:57:17.814599+0000","last_peered":"2024-09-14T12:57:17.814599+0000","last_clean":"2024-09-14T12:57:17.814599+0000","last_became_active":"2024-09-14T11:08:29.833332+0000","last_became_peered":"2024-09-14T11:08:29.833332+0000","last_unstale":"2024-09-14T12:57:17.814599+0000","last_undegraded":"2024-09-14T12:57:17.814599+0000","last_fullsized":"2024-09-14T12:57:17.814599+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:08:28.783586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:08:28.783586+0000","last_clean_scrub_stamp":"2024-09-14T11:08:28.783586+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:59:44.395012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.19","version":"267'122","reported_seq":639,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:57:48.032017+0000","last_change":"2024-09-14T11:08:31.844405+0000","last_active":"2024-09-14T12:57:48.032017+0000","last_peered":"2024-09-14T12:57:48.032017+0000","last_clean":"2024-09-14T12:57:48.032017+0000","last_became_active":"2024-09-14T11:08:31.843645+0000","last_became_peered":"2024-09-14T11:08:31.843645+0000","last_unstale":"2024-09-14T12:57:48.032017+0000","last_undegraded":"2024-09-14T12:57:48.032017+0000","last_fullsized":"2024-09-14T12:57:48.032017+0000","mapping_epoch":34,"log_start":"267'100","ondisk_log_start":"267'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:08:30.789404+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:08:30.789404+0000","last_clean_scrub_stamp":"2024-09-14T11:08:30.789404+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":100,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:14:31.616675+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":100,"num_read_kb":97,"num_write":289,"num_write_kb":65,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.15","version":"267'1234","reported_seq":3011,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:00:18.829256+0000","last_change":"2024-09-14T11:08:23.809577+0000","last_active":"2024-09-14T13:00:18.829256+0000","last_peered":"2024-09-14T13:00:18.829256+0000","last_clean":"2024-09-14T13:00:18.829256+0000","last_became_active":"2024-09-14T11:08:23.808015+0000","last_became_peered":"2024-09-14T11:08:23.808015+0000","last_unstale":"2024-09-14T13:00:18.829256+0000","last_undegraded":"2024-09-14T13:00:18.829256+0000","last_fullsized":"2024-09-14T13:00:18.829256+0000","mapping_epoch":26,"log_start":"267'1200","ondisk_log_start":"267'1200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:08:22.750609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:08:22.750609+0000","last_clean_scrub_stamp":"2024-09-14T11:08:22.750609+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":1200,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:00:36.480612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":5778,"num_read_kb":5143,"num_write":1691,"num_write_kb":698,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.12","version":"267'226","reported_seq":943,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:01:28.902381+0000","last_change":"2024-09-14T11:08:21.787689+0000","last_active":"2024-09-14T13:01:28.902381+0000","last_peered":"2024-09-14T13:01:28.902381+0000","last_clean":"2024-09-14T13:01:28.902381+0000","last_became_active":"2024-09-14T11:08:21.787257+0000","last_became_peered":"2024-09-14T11:08:21.787257+0000","last_unstale":"2024-09-14T13:01:28.902381+0000","last_undegraded":"2024-09-14T13:01:28.902381+0000","last_fullsized":"2024-09-14T13:01:28.902381+0000","mapping_epoch":24,"log_start":"267'200","ondisk_log_start":"267'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:08:20.733145+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:08:20.733145+0000","last_clean_scrub_stamp":"2024-09-14T11:08:20.733145+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":200,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:56:32.268492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10812449,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":654,"num_read_kb":98910,"num_write":976,"num_write_kb":32453,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3],"acting":[0,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":527,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:58:28.459329+0000","last_change":"2024-09-14T11:08:25.804425+0000","last_active":"2024-09-14T12:58:28.459329+0000","last_peered":"2024-09-14T12:58:28.459329+0000","last_clean":"2024-09-14T12:58:28.459329+0000","last_became_active":"2024-09-14T11:08:25.804100+0000","last_became_peered":"2024-09-14T11:08:25.804100+0000","last_unstale":"2024-09-14T12:58:28.459329+0000","last_undegraded":"2024-09-14T12:58:28.459329+0000","last_fullsized":"2024-09-14T12:58:28.459329+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:08:24.757170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:08:24.757170+0000","last_clean_scrub_stamp":"2024-09-14T11:08:24.757170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:44:03.143728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.17","version":"267'129","reported_seq":704,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:59:18.421604+0000","last_change":"2024-09-14T11:08:27.831807+0000","last_active":"2024-09-14T12:59:18.421604+0000","last_peered":"2024-09-14T12:59:18.421604+0000","last_clean":"2024-09-14T12:59:18.421604+0000","last_became_active":"2024-09-14T11:08:27.831010+0000","last_became_peered":"2024-09-14T11:08:27.831010+0000","last_unstale":"2024-09-14T12:59:18.421604+0000","last_undegraded":"2024-09-14T12:59:18.421604+0000","last_fullsized":"2024-09-14T12:59:18.421604+0000","mapping_epoch":30,"log_start":"267'100","ondisk_log_start":"267'100","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:08:26.771628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:08:26.771628+0000","last_clean_scrub_stamp":"2024-09-14T11:08:26.771628+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":100,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:48:05.929304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":152,"num_read_kb":149,"num_write":100,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":519,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:57:18.209572+0000","last_change":"2024-09-14T11:08:29.810149+0000","last_active":"2024-09-14T12:57:18.209572+0000","last_peered":"2024-09-14T12:57:18.209572+0000","last_clean":"2024-09-14T12:57:18.209572+0000","last_became_active":"2024-09-14T11:08:29.809568+0000","last_became_peered":"2024-09-14T11:08:29.809568+0000","last_unstale":"2024-09-14T12:57:18.209572+0000","last_undegraded":"2024-09-14T12:57:18.209572+0000","last_fullsized":"2024-09-14T12:57:18.209572+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:08:28.783586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:08:28.783586+0000","last_clean_scrub_stamp":"2024-09-14T11:08:28.783586+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:07:09.977514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.1a","version":"267'137","reported_seq":722,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:58:33.237668+0000","last_change":"2024-09-14T11:08:31.846263+0000","last_active":"2024-09-14T12:58:33.237668+0000","last_peered":"2024-09-14T12:58:33.237668+0000","last_clean":"2024-09-14T12:58:33.237668+0000","last_became_active":"2024-09-14T11:08:31.845634+0000","last_became_peered":"2024-09-14T11:08:31.845634+0000","last_unstale":"2024-09-14T12:58:33.237668+0000","last_undegraded":"2024-09-14T12:58:33.237668+0000","last_fullsized":"2024-09-14T12:58:33.237668+0000","mapping_epoch":34,"log_start":"267'100","ondisk_log_start":"267'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:08:30.789404+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:08:30.789404+0000","last_clean_scrub_stamp":"2024-09-14T11:08:30.789404+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":100,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:44:18.672749+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":271,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":347,"num_read_kb":294,"num_write":357,"num_write_kb":85,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"267'409","reported_seq":1926,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:01:39.333037+0000","last_change":"2024-09-14T11:08:23.780617+0000","last_active":"2024-09-14T13:01:39.333037+0000","last_peered":"2024-09-14T13:01:39.333037+0000","last_clean":"2024-09-14T13:01:39.333037+0000","last_became_active":"2024-09-14T11:08:23.780326+0000","last_became_peered":"2024-09-14T11:08:23.780326+0000","last_unstale":"2024-09-14T13:01:39.333037+0000","last_undegraded":"2024-09-14T13:01:39.333037+0000","last_fullsized":"2024-09-14T13:01:39.333037+0000","mapping_epoch":26,"log_start":"267'300","ondisk_log_start":"267'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:08:22.750609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:08:22.750609+0000","last_clean_scrub_stamp":"2024-09-14T11:08:22.750609+0000","objects_scrubbed":0,"log_size":109,"log_dups_size":300,"ondisk_log_size":109,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:31:39.789906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2172,"num_read_kb":2053,"num_write":475,"num_write_kb":100,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.11","version":"267'223","reported_seq":849,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:58:37.822725+0000","last_change":"2024-09-14T11:08:56.039243+0000","last_active":"2024-09-14T12:58:37.822725+0000","last_peered":"2024-09-14T12:58:37.822725+0000","last_clean":"2024-09-14T12:58:37.822725+0000","last_became_active":"2024-09-14T11:08:56.038815+0000","last_became_peered":"2024-09-14T11:08:56.038815+0000","last_unstale":"2024-09-14T12:58:37.822725+0000","last_undegraded":"2024-09-14T12:58:37.822725+0000","last_fullsized":"2024-09-14T12:58:37.822725+0000","mapping_epoch":37,"log_start":"267'200","ondisk_log_start":"267'200","created":24,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:08:20.733145+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:08:20.733145+0000","last_clean_scrub_stamp":"2024-09-14T11:08:20.733145+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":200,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:21:36.040245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7368155,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":502,"num_read_kb":22051,"num_write":990,"num_write_kb":45213,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4,6],"acting":[2,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":525,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:57:13.438368+0000","last_change":"2024-09-14T11:08:25.798412+0000","last_active":"2024-09-14T12:57:13.438368+0000","last_peered":"2024-09-14T12:57:13.438368+0000","last_clean":"2024-09-14T12:57:13.438368+0000","last_became_active":"2024-09-14T11:08:25.798008+0000","last_became_peered":"2024-09-14T11:08:25.798008+0000","last_unstale":"2024-09-14T12:57:13.438368+0000","last_undegraded":"2024-09-14T12:57:13.438368+0000","last_fullsized":"2024-09-14T12:57:13.438368+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:08:24.757170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:08:24.757170+0000","last_clean_scrub_stamp":"2024-09-14T11:08:24.757170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:17:44.680400+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.14","version":"267'180","reported_seq":783,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:00:11.342120+0000","last_change":"2024-09-14T11:08:27.821531+0000","last_active":"2024-09-14T13:00:11.342120+0000","last_peered":"2024-09-14T13:00:11.342120+0000","last_clean":"2024-09-14T13:00:11.342120+0000","last_became_active":"2024-09-14T11:08:27.820627+0000","last_became_peered":"2024-09-14T11:08:27.820627+0000","last_unstale":"2024-09-14T13:00:11.342120+0000","last_undegraded":"2024-09-14T13:00:11.342120+0000","last_fullsized":"2024-09-14T13:00:11.342120+0000","mapping_epoch":30,"log_start":"267'100","ondisk_log_start":"267'100","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:08:26.771628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:08:26.771628+0000","last_clean_scrub_stamp":"2024-09-14T11:08:26.771628+0000","objects_scrubbed":0,"log_size":80,"log_dups_size":100,"ondisk_log_size":80,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:00:26.336465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":232,"num_read_kb":224,"num_write":158,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.15","version":"267'772","reported_seq":3168,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:01:40.716321+0000","last_change":"2024-09-14T11:08:29.838884+0000","last_active":"2024-09-14T13:01:40.716321+0000","last_peered":"2024-09-14T13:01:40.716321+0000","last_clean":"2024-09-14T13:01:40.716321+0000","last_became_active":"2024-09-14T11:08:29.838193+0000","last_became_peered":"2024-09-14T11:08:29.838193+0000","last_unstale":"2024-09-14T13:01:40.716321+0000","last_undegraded":"2024-09-14T13:01:40.716321+0000","last_fullsized":"2024-09-14T13:01:40.716321+0000","mapping_epoch":32,"log_start":"267'701","ondisk_log_start":"267'701","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:08:28.783586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:08:28.783586+0000","last_clean_scrub_stamp":"2024-09-14T11:08:28.783586+0000","objects_scrubbed":0,"log_size":71,"log_dups_size":701,"ondisk_log_size":71,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:51:08.846542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1b","version":"267'210","reported_seq":1068,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:00:21.684009+0000","last_change":"2024-09-14T11:08:31.844271+0000","last_active":"2024-09-14T13:00:21.684009+0000","last_peered":"2024-09-14T13:00:21.684009+0000","last_clean":"2024-09-14T13:00:21.684009+0000","last_became_active":"2024-09-14T11:08:31.843385+0000","last_became_peered":"2024-09-14T11:08:31.843385+0000","last_unstale":"2024-09-14T13:00:21.684009+0000","last_undegraded":"2024-09-14T13:00:21.684009+0000","last_fullsized":"2024-09-14T13:00:21.684009+0000","mapping_epoch":34,"log_start":"267'100","ondisk_log_start":"267'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:08:30.789404+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:08:30.789404+0000","last_clean_scrub_stamp":"2024-09-14T11:08:30.789404+0000","objects_scrubbed":0,"log_size":110,"log_dups_size":100,"ondisk_log_size":110,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:50:52.716773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":642,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":623,"num_read_kb":612,"num_write":468,"num_write_kb":119,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.17","version":"267'420","reported_seq":1909,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:58:42.824128+0000","last_change":"2024-09-14T11:09:57.239996+0000","last_active":"2024-09-14T12:58:42.824128+0000","last_peered":"2024-09-14T12:58:42.824128+0000","last_clean":"2024-09-14T12:58:42.824128+0000","last_became_active":"2024-09-14T11:09:57.239636+0000","last_became_peered":"2024-09-14T11:09:57.239636+0000","last_unstale":"2024-09-14T12:58:42.824128+0000","last_undegraded":"2024-09-14T12:58:42.824128+0000","last_fullsized":"2024-09-14T12:58:42.824128+0000","mapping_epoch":39,"log_start":"267'400","ondisk_log_start":"267'400","created":26,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:08:22.750609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:08:22.750609+0000","last_clean_scrub_stamp":"2024-09-14T11:08:22.750609+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":400,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:53:58.019330+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2202,"num_read_kb":2076,"num_write":491,"num_write_kb":104,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.10","version":"267'245","reported_seq":913,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:58:03.417656+0000","last_change":"2024-09-14T11:08:21.826810+0000","last_active":"2024-09-14T12:58:03.417656+0000","last_peered":"2024-09-14T12:58:03.417656+0000","last_clean":"2024-09-14T12:58:03.417656+0000","last_became_active":"2024-09-14T11:08:21.817332+0000","last_became_peered":"2024-09-14T11:08:21.817332+0000","last_unstale":"2024-09-14T12:58:03.417656+0000","last_undegraded":"2024-09-14T12:58:03.417656+0000","last_fullsized":"2024-09-14T12:58:03.417656+0000","mapping_epoch":24,"log_start":"267'200","ondisk_log_start":"267'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:08:20.733145+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:08:20.733145+0000","last_clean_scrub_stamp":"2024-09-14T11:08:20.733145+0000","objects_scrubbed":0,"log_size":45,"log_dups_size":200,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:58:18.952310+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8403965,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":646,"num_read_kb":50041,"num_write":1005,"num_write_kb":23458,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,5],"acting":[6,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":525,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:57:13.024092+0000","last_change":"2024-09-14T11:08:25.815329+0000","last_active":"2024-09-14T12:57:13.024092+0000","last_peered":"2024-09-14T12:57:13.024092+0000","last_clean":"2024-09-14T12:57:13.024092+0000","last_became_active":"2024-09-14T11:08:25.814645+0000","last_became_peered":"2024-09-14T11:08:25.814645+0000","last_unstale":"2024-09-14T12:57:13.024092+0000","last_undegraded":"2024-09-14T12:57:13.024092+0000","last_fullsized":"2024-09-14T12:57:13.024092+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:08:24.757170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:08:24.757170+0000","last_clean_scrub_stamp":"2024-09-14T11:08:24.757170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:04:57.817252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.15","version":"267'175","reported_seq":790,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:59:37.847250+0000","last_change":"2024-09-14T11:08:27.828686+0000","last_active":"2024-09-14T12:59:37.847250+0000","last_peered":"2024-09-14T12:59:37.847250+0000","last_clean":"2024-09-14T12:59:37.847250+0000","last_became_active":"2024-09-14T11:08:27.827940+0000","last_became_peered":"2024-09-14T11:08:27.827940+0000","last_unstale":"2024-09-14T12:59:37.847250+0000","last_undegraded":"2024-09-14T12:59:37.847250+0000","last_fullsized":"2024-09-14T12:59:37.847250+0000","mapping_epoch":30,"log_start":"267'100","ondisk_log_start":"267'100","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:08:26.771628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:08:26.771628+0000","last_clean_scrub_stamp":"2024-09-14T11:08:26.771628+0000","objects_scrubbed":0,"log_size":75,"log_dups_size":100,"ondisk_log_size":75,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:53:17.553624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10026,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":220,"num_read_kb":279,"num_write":126,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.14","version":"267'811","reported_seq":2982,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:01:40.726705+0000","last_change":"2024-09-14T11:08:29.832482+0000","last_active":"2024-09-14T13:01:40.726705+0000","last_peered":"2024-09-14T13:01:40.726705+0000","last_clean":"2024-09-14T13:01:40.726705+0000","last_became_active":"2024-09-14T11:08:29.831198+0000","last_became_peered":"2024-09-14T11:08:29.831198+0000","last_unstale":"2024-09-14T13:01:40.726705+0000","last_undegraded":"2024-09-14T13:01:40.726705+0000","last_fullsized":"2024-09-14T13:01:40.726705+0000","mapping_epoch":32,"log_start":"267'800","ondisk_log_start":"267'800","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:08:28.783586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:08:28.783586+0000","last_clean_scrub_stamp":"2024-09-14T11:08:28.783586+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":800,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:32:21.362746+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.8","version":"267'440","reported_seq":1985,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:59:07.757910+0000","last_change":"2024-09-14T11:08:23.812057+0000","last_active":"2024-09-14T12:59:07.757910+0000","last_peered":"2024-09-14T12:59:07.757910+0000","last_clean":"2024-09-14T12:59:07.757910+0000","last_became_active":"2024-09-14T11:08:23.811325+0000","last_became_peered":"2024-09-14T11:08:23.811325+0000","last_unstale":"2024-09-14T12:59:07.757910+0000","last_undegraded":"2024-09-14T12:59:07.757910+0000","last_fullsized":"2024-09-14T12:59:07.757910+0000","mapping_epoch":26,"log_start":"267'400","ondisk_log_start":"267'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:08:22.750609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:08:22.750609+0000","last_clean_scrub_stamp":"2024-09-14T11:08:22.750609+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":400,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:31:01.004270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2277,"num_read_kb":2143,"num_write":513,"num_write_kb":125,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.f","version":"267'236","reported_seq":920,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:59:12.841498+0000","last_change":"2024-09-14T11:08:21.846294+0000","last_active":"2024-09-14T12:59:12.841498+0000","last_peered":"2024-09-14T12:59:12.841498+0000","last_clean":"2024-09-14T12:59:12.841498+0000","last_became_active":"2024-09-14T11:08:21.845618+0000","last_became_peered":"2024-09-14T11:08:21.845618+0000","last_unstale":"2024-09-14T12:59:12.841498+0000","last_undegraded":"2024-09-14T12:59:12.841498+0000","last_fullsized":"2024-09-14T12:59:12.841498+0000","mapping_epoch":24,"log_start":"267'200","ondisk_log_start":"267'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:08:20.733145+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:08:20.733145+0000","last_clean_scrub_stamp":"2024-09-14T11:08:20.733145+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":200,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:11:01.806580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9485601,"num_objects":9,"num_object_clones":0,"num_object_copies":27,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":671,"num_read_kb":36003,"num_write":1070,"num_write_kb":30861,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,0],"acting":[7,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":532,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:58:57.837680+0000","last_change":"2024-09-14T11:08:25.807559+0000","last_active":"2024-09-14T12:58:57.837680+0000","last_peered":"2024-09-14T12:58:57.837680+0000","last_clean":"2024-09-14T12:58:57.837680+0000","last_became_active":"2024-09-14T11:08:25.806427+0000","last_became_peered":"2024-09-14T11:08:25.806427+0000","last_unstale":"2024-09-14T12:58:57.837680+0000","last_undegraded":"2024-09-14T12:58:57.837680+0000","last_fullsized":"2024-09-14T12:58:57.837680+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:08:24.757170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:08:24.757170+0000","last_clean_scrub_stamp":"2024-09-14T11:08:24.757170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:32:34.612298+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.a","version":"267'318","reported_seq":1014,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:01:38.083943+0000","last_change":"2024-09-14T11:08:27.825865+0000","last_active":"2024-09-14T13:01:38.083943+0000","last_peered":"2024-09-14T13:01:38.083943+0000","last_clean":"2024-09-14T13:01:38.083943+0000","last_became_active":"2024-09-14T11:08:27.825133+0000","last_became_peered":"2024-09-14T11:08:27.825133+0000","last_unstale":"2024-09-14T13:01:38.083943+0000","last_undegraded":"2024-09-14T13:01:38.083943+0000","last_fullsized":"2024-09-14T13:01:38.083943+0000","mapping_epoch":30,"log_start":"267'300","ondisk_log_start":"267'300","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:08:26.771628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:08:26.771628+0000","last_clean_scrub_stamp":"2024-09-14T11:08:26.771628+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":300,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:21:39.269871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8811,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":443,"num_read_kb":493,"num_write":274,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":519,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:58:48.462360+0000","last_change":"2024-09-14T11:08:29.816572+0000","last_active":"2024-09-14T12:58:48.462360+0000","last_peered":"2024-09-14T12:58:48.462360+0000","last_clean":"2024-09-14T12:58:48.462360+0000","last_became_active":"2024-09-14T11:08:29.815620+0000","last_became_peered":"2024-09-14T11:08:29.815620+0000","last_unstale":"2024-09-14T12:58:48.462360+0000","last_undegraded":"2024-09-14T12:58:48.462360+0000","last_fullsized":"2024-09-14T12:58:48.462360+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:08:28.783586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:08:28.783586+0000","last_clean_scrub_stamp":"2024-09-14T11:08:28.783586+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:55:41.020963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.4","version":"267'569","reported_seq":1413,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:01:40.627106+0000","last_change":"2024-09-14T11:08:31.844680+0000","last_active":"2024-09-14T13:01:40.627106+0000","last_peered":"2024-09-14T13:01:40.627106+0000","last_clean":"2024-09-14T13:01:40.627106+0000","last_became_active":"2024-09-14T11:08:31.843834+0000","last_became_peered":"2024-09-14T11:08:31.843834+0000","last_unstale":"2024-09-14T13:01:40.627106+0000","last_undegraded":"2024-09-14T13:01:40.627106+0000","last_fullsized":"2024-09-14T13:01:40.627106+0000","mapping_epoch":34,"log_start":"267'500","ondisk_log_start":"267'500","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:08:30.789404+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:08:30.789404+0000","last_clean_scrub_stamp":"2024-09-14T11:08:30.789404+0000","objects_scrubbed":0,"log_size":69,"log_dups_size":500,"ondisk_log_size":69,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:11:32.026053+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1277,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":1293,"num_read_kb":1292,"num_write":1202,"num_write_kb":404,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.9","version":"267'1166","reported_seq":2698,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:58:58.232539+0000","last_change":"2024-09-14T11:08:23.779276+0000","last_active":"2024-09-14T12:58:58.232539+0000","last_peered":"2024-09-14T12:58:58.232539+0000","last_clean":"2024-09-14T12:58:58.232539+0000","last_became_active":"2024-09-14T11:08:23.778539+0000","last_became_peered":"2024-09-14T11:08:23.778539+0000","last_unstale":"2024-09-14T12:58:58.232539+0000","last_undegraded":"2024-09-14T12:58:58.232539+0000","last_fullsized":"2024-09-14T12:58:58.232539+0000","mapping_epoch":26,"log_start":"267'1100","ondisk_log_start":"267'1100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:08:22.750609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:08:22.750609+0000","last_clean_scrub_stamp":"2024-09-14T11:08:22.750609+0000","objects_scrubbed":0,"log_size":66,"log_dups_size":1100,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:37:56.213667+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":5272,"num_read_kb":4639,"num_write":1605,"num_write_kb":663,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"267'230","reported_seq":875,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:01:30.957938+0000","last_change":"2024-09-14T11:08:21.837563+0000","last_active":"2024-09-14T13:01:30.957938+0000","last_peered":"2024-09-14T13:01:30.957938+0000","last_clean":"2024-09-14T13:01:30.957938+0000","last_became_active":"2024-09-14T11:08:21.836948+0000","last_became_peered":"2024-09-14T11:08:21.836948+0000","last_unstale":"2024-09-14T13:01:30.957938+0000","last_undegraded":"2024-09-14T13:01:30.957938+0000","last_fullsized":"2024-09-14T13:01:30.957938+0000","mapping_epoch":24,"log_start":"267'200","ondisk_log_start":"267'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:08:20.733145+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:08:20.733145+0000","last_clean_scrub_stamp":"2024-09-14T11:08:20.733145+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":200,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:41:03.647233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8758677,"num_objects":9,"num_object_clones":0,"num_object_copies":27,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":539,"num_read_kb":30597,"num_write":996,"num_write_kb":48772,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,1],"acting":[7,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.8","version":"36'4","reported_seq":1009,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:01:40.255874+0000","last_change":"2024-09-14T11:08:25.787348+0000","last_active":"2024-09-14T13:01:40.255874+0000","last_peered":"2024-09-14T13:01:40.255874+0000","last_clean":"2024-09-14T13:01:40.255874+0000","last_became_active":"2024-09-14T11:08:25.786631+0000","last_became_peered":"2024-09-14T11:08:25.786631+0000","last_unstale":"2024-09-14T13:01:40.255874+0000","last_undegraded":"2024-09-14T13:01:40.255874+0000","last_fullsized":"2024-09-14T13:01:40.255874+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:08:24.757170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:08:24.757170+0000","last_clean_scrub_stamp":"2024-09-14T11:08:24.757170+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:53:18.472903+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1139,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":715,"num_read_kb":1177,"num_write":8,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.b","version":"267'173","reported_seq":791,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:00:58.494459+0000","last_change":"2024-09-14T11:08:27.822261+0000","last_active":"2024-09-14T13:00:58.494459+0000","last_peered":"2024-09-14T13:00:58.494459+0000","last_clean":"2024-09-14T13:00:58.494459+0000","last_became_active":"2024-09-14T11:08:27.821051+0000","last_became_peered":"2024-09-14T11:08:27.821051+0000","last_unstale":"2024-09-14T13:00:58.494459+0000","last_undegraded":"2024-09-14T13:00:58.494459+0000","last_fullsized":"2024-09-14T13:00:58.494459+0000","mapping_epoch":30,"log_start":"267'100","ondisk_log_start":"267'100","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:08:26.771628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:08:26.771628+0000","last_clean_scrub_stamp":"2024-09-14T11:08:26.771628+0000","objects_scrubbed":0,"log_size":73,"log_dups_size":100,"ondisk_log_size":73,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:27:12.003430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10996,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":225,"num_read_kb":299,"num_write":128,"num_write_kb":25,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":523,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:59:23.472522+0000","last_change":"2024-09-14T11:08:29.836035+0000","last_active":"2024-09-14T12:59:23.472522+0000","last_peered":"2024-09-14T12:59:23.472522+0000","last_clean":"2024-09-14T12:59:23.472522+0000","last_became_active":"2024-09-14T11:08:29.835446+0000","last_became_peered":"2024-09-14T11:08:29.835446+0000","last_unstale":"2024-09-14T12:59:23.472522+0000","last_undegraded":"2024-09-14T12:59:23.472522+0000","last_fullsized":"2024-09-14T12:59:23.472522+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:08:28.783586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:08:28.783586+0000","last_clean_scrub_stamp":"2024-09-14T11:08:28.783586+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:36:19.782325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.5","version":"267'2490","reported_seq":4358,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:01:27.935148+0000","last_change":"2024-09-14T11:08:31.849687+0000","last_active":"2024-09-14T13:01:27.935148+0000","last_peered":"2024-09-14T13:01:27.935148+0000","last_clean":"2024-09-14T13:01:27.935148+0000","last_became_active":"2024-09-14T11:08:31.848959+0000","last_became_peered":"2024-09-14T11:08:31.848959+0000","last_unstale":"2024-09-14T13:01:27.935148+0000","last_undegraded":"2024-09-14T13:01:27.935148+0000","last_fullsized":"2024-09-14T13:01:27.935148+0000","mapping_epoch":34,"log_start":"267'2400","ondisk_log_start":"267'2400","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:08:30.789404+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:08:30.789404+0000","last_clean_scrub_stamp":"2024-09-14T11:08:30.789404+0000","objects_scrubbed":0,"log_size":90,"log_dups_size":2400,"ondisk_log_size":90,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:50:52.716773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":423,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":6223,"num_read_kb":6216,"num_write":5015,"num_write_kb":1852,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.a","version":"267'866","reported_seq":2677,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:01:39.416327+0000","last_change":"2024-09-14T11:08:23.812059+0000","last_active":"2024-09-14T13:01:39.416327+0000","last_peered":"2024-09-14T13:01:39.416327+0000","last_clean":"2024-09-14T13:01:39.416327+0000","last_became_active":"2024-09-14T11:08:23.811255+0000","last_became_peered":"2024-09-14T11:08:23.811255+0000","last_unstale":"2024-09-14T13:01:39.416327+0000","last_undegraded":"2024-09-14T13:01:39.416327+0000","last_fullsized":"2024-09-14T13:01:39.416327+0000","mapping_epoch":26,"log_start":"267'800","ondisk_log_start":"267'800","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:08:22.750609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:08:22.750609+0000","last_clean_scrub_stamp":"2024-09-14T11:08:22.750609+0000","objects_scrubbed":0,"log_size":66,"log_dups_size":800,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:59:11.000027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":4399,"num_read_kb":3998,"num_write":1156,"num_write_kb":415,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"267'202","reported_seq":874,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:58:37.833064+0000","last_change":"2024-09-14T11:08:21.805672+0000","last_active":"2024-09-14T12:58:37.833064+0000","last_peered":"2024-09-14T12:58:37.833064+0000","last_clean":"2024-09-14T12:58:37.833064+0000","last_became_active":"2024-09-14T11:08:21.804566+0000","last_became_peered":"2024-09-14T11:08:21.804566+0000","last_unstale":"2024-09-14T12:58:37.833064+0000","last_undegraded":"2024-09-14T12:58:37.833064+0000","last_fullsized":"2024-09-14T12:58:37.833064+0000","mapping_epoch":24,"log_start":"267'100","ondisk_log_start":"267'100","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:08:20.733145+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:08:20.733145+0000","last_clean_scrub_stamp":"2024-09-14T11:08:20.733145+0000","objects_scrubbed":0,"log_size":102,"log_dups_size":100,"ondisk_log_size":102,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:32:47.003209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12777436,"num_objects":12,"num_object_clones":0,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":0,"num_read":547,"num_read_kb":39817,"num_write":944,"num_write_kb":36124,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,3],"acting":[7,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":533,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:58:42.823897+0000","last_change":"2024-09-14T11:08:25.789785+0000","last_active":"2024-09-14T12:58:42.823897+0000","last_peered":"2024-09-14T12:58:42.823897+0000","last_clean":"2024-09-14T12:58:42.823897+0000","last_became_active":"2024-09-14T11:08:25.789075+0000","last_became_peered":"2024-09-14T11:08:25.789075+0000","last_unstale":"2024-09-14T12:58:42.823897+0000","last_undegraded":"2024-09-14T12:58:42.823897+0000","last_fullsized":"2024-09-14T12:58:42.823897+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:08:24.757170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:08:24.757170+0000","last_clean_scrub_stamp":"2024-09-14T11:08:24.757170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:02:16.864399+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.8","version":"267'229","reported_seq":886,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:01:07.868354+0000","last_change":"2024-09-14T11:08:27.831643+0000","last_active":"2024-09-14T13:01:07.868354+0000","last_peered":"2024-09-14T13:01:07.868354+0000","last_clean":"2024-09-14T13:01:07.868354+0000","last_became_active":"2024-09-14T11:08:27.830862+0000","last_became_peered":"2024-09-14T11:08:27.830862+0000","last_unstale":"2024-09-14T13:01:07.868354+0000","last_undegraded":"2024-09-14T13:01:07.868354+0000","last_fullsized":"2024-09-14T13:01:07.868354+0000","mapping_epoch":30,"log_start":"267'200","ondisk_log_start":"267'200","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:08:26.771628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:08:26.771628+0000","last_clean_scrub_stamp":"2024-09-14T11:08:26.771628+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":200,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:28:29.317319+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6583,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":311,"num_read_kb":308,"num_write":182,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.9","version":"267'782","reported_seq":3470,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:01:40.728572+0000","last_change":"2024-09-14T11:08:29.822652+0000","last_active":"2024-09-14T13:01:40.728572+0000","last_peered":"2024-09-14T13:01:40.728572+0000","last_clean":"2024-09-14T13:01:40.728572+0000","last_became_active":"2024-09-14T11:08:29.821920+0000","last_became_peered":"2024-09-14T11:08:29.821920+0000","last_unstale":"2024-09-14T13:01:40.728572+0000","last_undegraded":"2024-09-14T13:01:40.728572+0000","last_fullsized":"2024-09-14T13:01:40.728572+0000","mapping_epoch":32,"log_start":"267'700","ondisk_log_start":"267'700","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:08:28.783586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:08:28.783586+0000","last_clean_scrub_stamp":"2024-09-14T11:08:28.783586+0000","objects_scrubbed":0,"log_size":82,"log_dups_size":700,"ondisk_log_size":82,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:48:48.100097+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.6","version":"267'126","reported_seq":663,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:01:39.376250+0000","last_change":"2024-09-14T11:08:31.848848+0000","last_active":"2024-09-14T13:01:39.376250+0000","last_peered":"2024-09-14T13:01:39.376250+0000","last_clean":"2024-09-14T13:01:39.376250+0000","last_became_active":"2024-09-14T11:08:31.846373+0000","last_became_peered":"2024-09-14T11:08:31.846373+0000","last_unstale":"2024-09-14T13:01:39.376250+0000","last_undegraded":"2024-09-14T13:01:39.376250+0000","last_fullsized":"2024-09-14T13:01:39.376250+0000","mapping_epoch":34,"log_start":"267'100","ondisk_log_start":"267'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:08:30.789404+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:08:30.789404+0000","last_clean_scrub_stamp":"2024-09-14T11:08:30.789404+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":100,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:47:54.026151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":575,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":123,"num_write":296,"num_write_kb":71,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"267'1040","reported_seq":2676,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:58:43.240136+0000","last_change":"2024-09-14T11:08:23.777370+0000","last_active":"2024-09-14T12:58:43.240136+0000","last_peered":"2024-09-14T12:58:43.240136+0000","last_clean":"2024-09-14T12:58:43.240136+0000","last_became_active":"2024-09-14T11:08:23.777032+0000","last_became_peered":"2024-09-14T11:08:23.777032+0000","last_unstale":"2024-09-14T12:58:43.240136+0000","last_undegraded":"2024-09-14T12:58:43.240136+0000","last_fullsized":"2024-09-14T12:58:43.240136+0000","mapping_epoch":26,"log_start":"267'1000","ondisk_log_start":"267'1000","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:08:22.750609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:08:22.750609+0000","last_clean_scrub_stamp":"2024-09-14T11:08:22.750609+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":1000,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:49:19.371576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":7372,"num_read_kb":6755,"num_write":1704,"num_write_kb":754,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.c","version":"267'182","reported_seq":822,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:58:38.043346+0000","last_change":"2024-09-14T11:08:21.828750+0000","last_active":"2024-09-14T12:58:38.043346+0000","last_peered":"2024-09-14T12:58:38.043346+0000","last_clean":"2024-09-14T12:58:38.043346+0000","last_became_active":"2024-09-14T11:08:21.828010+0000","last_became_peered":"2024-09-14T11:08:21.828010+0000","last_unstale":"2024-09-14T12:58:38.043346+0000","last_undegraded":"2024-09-14T12:58:38.043346+0000","last_fullsized":"2024-09-14T12:58:38.043346+0000","mapping_epoch":24,"log_start":"267'100","ondisk_log_start":"267'100","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:08:20.733145+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:08:20.733145+0000","last_clean_scrub_stamp":"2024-09-14T11:08:20.733145+0000","objects_scrubbed":0,"log_size":82,"log_dups_size":100,"ondisk_log_size":82,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:37:57.066174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":11803263,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":461,"num_read_kb":18086,"num_write":814,"num_write_kb":39275,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,6],"acting":[5,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":535,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:59:32.834776+0000","last_change":"2024-09-14T11:08:25.805942+0000","last_active":"2024-09-14T12:59:32.834776+0000","last_peered":"2024-09-14T12:59:32.834776+0000","last_clean":"2024-09-14T12:59:32.834776+0000","last_became_active":"2024-09-14T11:08:25.805415+0000","last_became_peered":"2024-09-14T11:08:25.805415+0000","last_unstale":"2024-09-14T12:59:32.834776+0000","last_undegraded":"2024-09-14T12:59:32.834776+0000","last_fullsized":"2024-09-14T12:59:32.834776+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:08:24.757170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:08:24.757170+0000","last_clean_scrub_stamp":"2024-09-14T11:08:24.757170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:04:41.418486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"267'240","reported_seq":922,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:01:40.550793+0000","last_change":"2024-09-14T11:08:27.812358+0000","last_active":"2024-09-14T13:01:40.550793+0000","last_peered":"2024-09-14T13:01:40.550793+0000","last_clean":"2024-09-14T13:01:40.550793+0000","last_became_active":"2024-09-14T11:08:27.811687+0000","last_became_peered":"2024-09-14T11:08:27.811687+0000","last_unstale":"2024-09-14T13:01:40.550793+0000","last_undegraded":"2024-09-14T13:01:40.550793+0000","last_fullsized":"2024-09-14T13:01:40.550793+0000","mapping_epoch":30,"log_start":"267'200","ondisk_log_start":"267'200","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:08:26.771628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:08:26.771628+0000","last_clean_scrub_stamp":"2024-09-14T11:08:26.771628+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":200,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:53:33.661450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":28650,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":331,"num_read_kb":474,"num_write":178,"num_write_kb":48,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":527,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:59:02.829095+0000","last_change":"2024-09-14T11:08:29.822875+0000","last_active":"2024-09-14T12:59:02.829095+0000","last_peered":"2024-09-14T12:59:02.829095+0000","last_clean":"2024-09-14T12:59:02.829095+0000","last_became_active":"2024-09-14T11:08:29.821747+0000","last_became_peered":"2024-09-14T11:08:29.821747+0000","last_unstale":"2024-09-14T12:59:02.829095+0000","last_undegraded":"2024-09-14T12:59:02.829095+0000","last_fullsized":"2024-09-14T12:59:02.829095+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:08:28.783586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:08:28.783586+0000","last_clean_scrub_stamp":"2024-09-14T11:08:28.783586+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:24:23.302821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.7","version":"267'148","reported_seq":694,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:00:15.969897+0000","last_change":"2024-09-14T11:08:31.839098+0000","last_active":"2024-09-14T13:00:15.969897+0000","last_peered":"2024-09-14T13:00:15.969897+0000","last_clean":"2024-09-14T13:00:15.969897+0000","last_became_active":"2024-09-14T11:08:31.838392+0000","last_became_peered":"2024-09-14T11:08:31.838392+0000","last_unstale":"2024-09-14T13:00:15.969897+0000","last_undegraded":"2024-09-14T13:00:15.969897+0000","last_fullsized":"2024-09-14T13:00:15.969897+0000","mapping_epoch":34,"log_start":"267'100","ondisk_log_start":"267'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:08:30.789404+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:08:30.789404+0000","last_clean_scrub_stamp":"2024-09-14T11:08:30.789404+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":100,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:19:04.951364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":722,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":177,"num_read_kb":165,"num_write":335,"num_write_kb":82,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"267'557","reported_seq":2159,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:59:14.732479+0000","last_change":"2024-09-14T11:08:23.789049+0000","last_active":"2024-09-14T12:59:14.732479+0000","last_peered":"2024-09-14T12:59:14.732479+0000","last_clean":"2024-09-14T12:59:14.732479+0000","last_became_active":"2024-09-14T11:08:23.788219+0000","last_became_peered":"2024-09-14T11:08:23.788219+0000","last_unstale":"2024-09-14T12:59:14.732479+0000","last_undegraded":"2024-09-14T12:59:14.732479+0000","last_fullsized":"2024-09-14T12:59:14.732479+0000","mapping_epoch":26,"log_start":"267'500","ondisk_log_start":"267'500","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:08:22.750609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:08:22.750609+0000","last_clean_scrub_stamp":"2024-09-14T11:08:22.750609+0000","objects_scrubbed":0,"log_size":57,"log_dups_size":500,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:01:08.503596+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2903,"num_read_kb":2651,"num_write":738,"num_write_kb":289,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"267'312","reported_seq":1059,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:58:38.461550+0000","last_change":"2024-09-14T11:08:21.827864+0000","last_active":"2024-09-14T12:58:38.461550+0000","last_peered":"2024-09-14T12:58:38.461550+0000","last_clean":"2024-09-14T12:58:38.461550+0000","last_became_active":"2024-09-14T11:08:21.827553+0000","last_became_peered":"2024-09-14T11:08:21.827553+0000","last_unstale":"2024-09-14T12:58:38.461550+0000","last_undegraded":"2024-09-14T12:58:38.461550+0000","last_fullsized":"2024-09-14T12:58:38.461550+0000","mapping_epoch":24,"log_start":"267'300","ondisk_log_start":"267'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:08:20.733145+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:08:20.733145+0000","last_clean_scrub_stamp":"2024-09-14T11:08:20.733145+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":300,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:57:45.527676+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":11090148,"num_objects":12,"num_object_clones":0,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":0,"num_read":993,"num_read_kb":39840,"num_write":1268,"num_write_kb":27597,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,4],"acting":[3,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":533,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:58:42.823983+0000","last_change":"2024-09-14T11:08:25.799438+0000","last_active":"2024-09-14T12:58:42.823983+0000","last_peered":"2024-09-14T12:58:42.823983+0000","last_clean":"2024-09-14T12:58:42.823983+0000","last_became_active":"2024-09-14T11:08:25.798931+0000","last_became_peered":"2024-09-14T11:08:25.798931+0000","last_unstale":"2024-09-14T12:58:42.823983+0000","last_undegraded":"2024-09-14T12:58:42.823983+0000","last_fullsized":"2024-09-14T12:58:42.823983+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:08:24.757170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:08:24.757170+0000","last_clean_scrub_stamp":"2024-09-14T11:08:24.757170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:52:24.718713+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.e","version":"267'200","reported_seq":832,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:00:58.260088+0000","last_change":"2024-09-14T11:08:27.818990+0000","last_active":"2024-09-14T13:00:58.260088+0000","last_peered":"2024-09-14T13:00:58.260088+0000","last_clean":"2024-09-14T13:00:58.260088+0000","last_became_active":"2024-09-14T11:08:27.818219+0000","last_became_peered":"2024-09-14T11:08:27.818219+0000","last_unstale":"2024-09-14T13:00:58.260088+0000","last_undegraded":"2024-09-14T13:00:58.260088+0000","last_fullsized":"2024-09-14T13:00:58.260088+0000","mapping_epoch":30,"log_start":"264'100","ondisk_log_start":"264'100","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:08:26.771628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:08:26.771628+0000","last_clean_scrub_stamp":"2024-09-14T11:08:26.771628+0000","objects_scrubbed":0,"log_size":100,"log_dups_size":100,"ondisk_log_size":100,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:11:59.445867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10713,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":285,"num_read_kb":297,"num_write":216,"num_write_kb":85,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":526,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:59:13.248309+0000","last_change":"2024-09-14T11:08:29.824808+0000","last_active":"2024-09-14T12:59:13.248309+0000","last_peered":"2024-09-14T12:59:13.248309+0000","last_clean":"2024-09-14T12:59:13.248309+0000","last_became_active":"2024-09-14T11:08:29.824057+0000","last_became_peered":"2024-09-14T11:08:29.824057+0000","last_unstale":"2024-09-14T12:59:13.248309+0000","last_undegraded":"2024-09-14T12:59:13.248309+0000","last_fullsized":"2024-09-14T12:59:13.248309+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:08:28.783586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:08:28.783586+0000","last_clean_scrub_stamp":"2024-09-14T11:08:28.783586+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:42:11.422635+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.0","version":"267'127","reported_seq":651,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:00:53.493597+0000","last_change":"2024-09-14T11:08:31.845590+0000","last_active":"2024-09-14T13:00:53.493597+0000","last_peered":"2024-09-14T13:00:53.493597+0000","last_clean":"2024-09-14T13:00:53.493597+0000","last_became_active":"2024-09-14T11:08:31.844832+0000","last_became_peered":"2024-09-14T11:08:31.844832+0000","last_unstale":"2024-09-14T13:00:53.493597+0000","last_undegraded":"2024-09-14T13:00:53.493597+0000","last_fullsized":"2024-09-14T13:00:53.493597+0000","mapping_epoch":34,"log_start":"267'100","ondisk_log_start":"267'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:08:30.789404+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:08:30.789404+0000","last_clean_scrub_stamp":"2024-09-14T11:08:30.789404+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":100,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:04:19.552267+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":910,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":99,"num_read_kb":98,"num_write":310,"num_write_kb":70,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"267'807","reported_seq":2439,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:59:14.732420+0000","last_change":"2024-09-14T11:08:23.794254+0000","last_active":"2024-09-14T12:59:14.732420+0000","last_peered":"2024-09-14T12:59:14.732420+0000","last_clean":"2024-09-14T12:59:14.732420+0000","last_became_active":"2024-09-14T11:08:23.791966+0000","last_became_peered":"2024-09-14T11:08:23.791966+0000","last_unstale":"2024-09-14T12:59:14.732420+0000","last_undegraded":"2024-09-14T12:59:14.732420+0000","last_fullsized":"2024-09-14T12:59:14.732420+0000","mapping_epoch":26,"log_start":"267'700","ondisk_log_start":"267'700","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:08:22.750609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:08:22.750609+0000","last_clean_scrub_stamp":"2024-09-14T11:08:22.750609+0000","objects_scrubbed":0,"log_size":107,"log_dups_size":700,"ondisk_log_size":107,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:23:14.308345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3905,"num_read_kb":3535,"num_write":1083,"num_write_kb":396,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"267'229","reported_seq":904,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:59:13.433073+0000","last_change":"2024-09-14T11:08:21.836998+0000","last_active":"2024-09-14T12:59:13.433073+0000","last_peered":"2024-09-14T12:59:13.433073+0000","last_clean":"2024-09-14T12:59:13.433073+0000","last_became_active":"2024-09-14T11:08:21.836346+0000","last_became_peered":"2024-09-14T11:08:21.836346+0000","last_unstale":"2024-09-14T12:59:13.433073+0000","last_undegraded":"2024-09-14T12:59:13.433073+0000","last_fullsized":"2024-09-14T12:59:13.433073+0000","mapping_epoch":24,"log_start":"267'200","ondisk_log_start":"267'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:08:20.733145+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:08:20.733145+0000","last_clean_scrub_stamp":"2024-09-14T11:08:20.733145+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":200,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:01:21.741877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7321958,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":603,"num_read_kb":23439,"num_write":1078,"num_write_kb":33198,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,1],"acting":[6,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":527,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:58:43.461228+0000","last_change":"2024-09-14T11:08:25.807312+0000","last_active":"2024-09-14T12:58:43.461228+0000","last_peered":"2024-09-14T12:58:43.461228+0000","last_clean":"2024-09-14T12:58:43.461228+0000","last_became_active":"2024-09-14T11:08:25.806502+0000","last_became_peered":"2024-09-14T11:08:25.806502+0000","last_unstale":"2024-09-14T12:58:43.461228+0000","last_undegraded":"2024-09-14T12:58:43.461228+0000","last_fullsized":"2024-09-14T12:58:43.461228+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:08:24.757170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:08:24.757170+0000","last_clean_scrub_stamp":"2024-09-14T11:08:24.757170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:32:51.027233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.f","version":"267'236","reported_seq":894,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:01:32.858133+0000","last_change":"2024-09-14T11:08:27.819376+0000","last_active":"2024-09-14T13:01:32.858133+0000","last_peered":"2024-09-14T13:01:32.858133+0000","last_clean":"2024-09-14T13:01:32.858133+0000","last_became_active":"2024-09-14T11:08:27.817904+0000","last_became_peered":"2024-09-14T11:08:27.817904+0000","last_unstale":"2024-09-14T13:01:32.858133+0000","last_undegraded":"2024-09-14T13:01:32.858133+0000","last_fullsized":"2024-09-14T13:01:32.858133+0000","mapping_epoch":30,"log_start":"267'200","ondisk_log_start":"267'200","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:08:26.771628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:08:26.771628+0000","last_clean_scrub_stamp":"2024-09-14T11:08:26.771628+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":200,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:38:45.116571+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":13059,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":322,"num_read_kb":372,"num_write":190,"num_write_kb":20,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.e","version":"267'760","reported_seq":3232,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:01:40.720358+0000","last_change":"2024-09-14T11:08:29.818281+0000","last_active":"2024-09-14T13:01:40.720358+0000","last_peered":"2024-09-14T13:01:40.720358+0000","last_clean":"2024-09-14T13:01:40.720358+0000","last_became_active":"2024-09-14T11:08:29.817475+0000","last_became_peered":"2024-09-14T11:08:29.817475+0000","last_unstale":"2024-09-14T13:01:40.720358+0000","last_undegraded":"2024-09-14T13:01:40.720358+0000","last_fullsized":"2024-09-14T13:01:40.720358+0000","mapping_epoch":32,"log_start":"267'700","ondisk_log_start":"267'700","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:08:28.783586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:08:28.783586+0000","last_clean_scrub_stamp":"2024-09-14T11:08:28.783586+0000","objects_scrubbed":0,"log_size":60,"log_dups_size":700,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:02:09.839019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1","version":"267'130","reported_seq":668,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:00:15.977882+0000","last_change":"2024-09-14T11:08:31.848332+0000","last_active":"2024-09-14T13:00:15.977882+0000","last_peered":"2024-09-14T13:00:15.977882+0000","last_clean":"2024-09-14T13:00:15.977882+0000","last_became_active":"2024-09-14T11:08:31.847603+0000","last_became_peered":"2024-09-14T11:08:31.847603+0000","last_unstale":"2024-09-14T13:00:15.977882+0000","last_undegraded":"2024-09-14T13:00:15.977882+0000","last_fullsized":"2024-09-14T13:00:15.977882+0000","mapping_epoch":34,"log_start":"267'100","ondisk_log_start":"267'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:08:30.789404+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:08:30.789404+0000","last_clean_scrub_stamp":"2024-09-14T11:08:30.789404+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":100,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:48:10.041330+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1261,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":168,"num_read_kb":154,"num_write":334,"num_write_kb":78,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"267'385","reported_seq":1931,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:00:18.881431+0000","last_change":"2024-09-14T11:08:23.815282+0000","last_active":"2024-09-14T13:00:18.881431+0000","last_peered":"2024-09-14T13:00:18.881431+0000","last_clean":"2024-09-14T13:00:18.881431+0000","last_became_active":"2024-09-14T11:08:23.814578+0000","last_became_peered":"2024-09-14T11:08:23.814578+0000","last_unstale":"2024-09-14T13:00:18.881431+0000","last_undegraded":"2024-09-14T13:00:18.881431+0000","last_fullsized":"2024-09-14T13:00:18.881431+0000","mapping_epoch":26,"log_start":"267'300","ondisk_log_start":"267'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:08:22.750609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:08:22.750609+0000","last_clean_scrub_stamp":"2024-09-14T11:08:22.750609+0000","objects_scrubbed":0,"log_size":85,"log_dups_size":300,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:17:18.348356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2178,"num_read_kb":2072,"num_write":449,"num_write_kb":92,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.9","version":"267'202","reported_seq":858,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:58:53.231353+0000","last_change":"2024-09-14T11:08:21.831392+0000","last_active":"2024-09-14T12:58:53.231353+0000","last_peered":"2024-09-14T12:58:53.231353+0000","last_clean":"2024-09-14T12:58:53.231353+0000","last_became_active":"2024-09-14T11:08:21.824109+0000","last_became_peered":"2024-09-14T11:08:21.824109+0000","last_unstale":"2024-09-14T12:58:53.231353+0000","last_undegraded":"2024-09-14T12:58:53.231353+0000","last_fullsized":"2024-09-14T12:58:53.231353+0000","mapping_epoch":24,"log_start":"267'100","ondisk_log_start":"267'100","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:08:20.733145+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:08:20.733145+0000","last_clean_scrub_stamp":"2024-09-14T11:08:20.733145+0000","objects_scrubbed":0,"log_size":102,"log_dups_size":100,"ondisk_log_size":102,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:40:02.893514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7548026,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":548,"num_read_kb":13686,"num_write":955,"num_write_kb":41004,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,7],"acting":[4,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.f","version":"29'2","reported_seq":1473,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:01:40.269842+0000","last_change":"2024-09-14T11:08:25.815830+0000","last_active":"2024-09-14T13:01:40.269842+0000","last_peered":"2024-09-14T13:01:40.269842+0000","last_clean":"2024-09-14T13:01:40.269842+0000","last_became_active":"2024-09-14T11:08:25.815109+0000","last_became_peered":"2024-09-14T11:08:25.815109+0000","last_unstale":"2024-09-14T13:01:40.269842+0000","last_undegraded":"2024-09-14T13:01:40.269842+0000","last_fullsized":"2024-09-14T13:01:40.269842+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:08:24.757170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:08:24.757170+0000","last_clean_scrub_stamp":"2024-09-14T11:08:24.757170+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:31:30.285811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":942,"num_read_kb":942,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.c","version":"267'152","reported_seq":738,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:59:07.715136+0000","last_change":"2024-09-14T11:08:27.799995+0000","last_active":"2024-09-14T12:59:07.715136+0000","last_peered":"2024-09-14T12:59:07.715136+0000","last_clean":"2024-09-14T12:59:07.715136+0000","last_became_active":"2024-09-14T11:08:27.799244+0000","last_became_peered":"2024-09-14T11:08:27.799244+0000","last_unstale":"2024-09-14T12:59:07.715136+0000","last_undegraded":"2024-09-14T12:59:07.715136+0000","last_fullsized":"2024-09-14T12:59:07.715136+0000","mapping_epoch":30,"log_start":"267'100","ondisk_log_start":"267'100","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:08:26.771628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:08:26.771628+0000","last_clean_scrub_stamp":"2024-09-14T11:08:26.771628+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":100,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:30:47.475696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":184,"num_read_kb":178,"num_write":124,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.d","version":"267'766","reported_seq":3161,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:01:40.721294+0000","last_change":"2024-09-14T11:08:29.829055+0000","last_active":"2024-09-14T13:01:40.721294+0000","last_peered":"2024-09-14T13:01:40.721294+0000","last_clean":"2024-09-14T13:01:40.721294+0000","last_became_active":"2024-09-14T11:08:29.828249+0000","last_became_peered":"2024-09-14T11:08:29.828249+0000","last_unstale":"2024-09-14T13:01:40.721294+0000","last_undegraded":"2024-09-14T13:01:40.721294+0000","last_fullsized":"2024-09-14T13:01:40.721294+0000","mapping_epoch":32,"log_start":"267'701","ondisk_log_start":"267'701","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:08:28.783586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:08:28.783586+0000","last_clean_scrub_stamp":"2024-09-14T11:08:28.783586+0000","objects_scrubbed":0,"log_size":65,"log_dups_size":701,"ondisk_log_size":65,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:02:41.662311+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.2","version":"267'160","reported_seq":694,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:58:58.232642+0000","last_change":"2024-09-14T11:08:31.850208+0000","last_active":"2024-09-14T12:58:58.232642+0000","last_peered":"2024-09-14T12:58:58.232642+0000","last_clean":"2024-09-14T12:58:58.232642+0000","last_became_active":"2024-09-14T11:08:31.849463+0000","last_became_peered":"2024-09-14T11:08:31.849463+0000","last_unstale":"2024-09-14T12:58:58.232642+0000","last_undegraded":"2024-09-14T12:58:58.232642+0000","last_fullsized":"2024-09-14T12:58:58.232642+0000","mapping_epoch":34,"log_start":"267'100","ondisk_log_start":"267'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:08:30.789404+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:08:30.789404+0000","last_clean_scrub_stamp":"2024-09-14T11:08:30.789404+0000","objects_scrubbed":0,"log_size":60,"log_dups_size":100,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:42:03.964124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":154,"num_read_kb":144,"num_write":375,"num_write_kb":85,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"267'382","reported_seq":1872,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:00:21.259274+0000","last_change":"2024-09-14T11:08:23.783772+0000","last_active":"2024-09-14T13:00:21.259274+0000","last_peered":"2024-09-14T13:00:21.259274+0000","last_clean":"2024-09-14T13:00:21.259274+0000","last_became_active":"2024-09-14T11:08:23.783481+0000","last_became_peered":"2024-09-14T11:08:23.783481+0000","last_unstale":"2024-09-14T13:00:21.259274+0000","last_undegraded":"2024-09-14T13:00:21.259274+0000","last_fullsized":"2024-09-14T13:00:21.259274+0000","mapping_epoch":26,"log_start":"267'300","ondisk_log_start":"267'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:08:22.750609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:08:22.750609+0000","last_clean_scrub_stamp":"2024-09-14T11:08:22.750609+0000","objects_scrubbed":0,"log_size":82,"log_dups_size":300,"ondisk_log_size":82,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:20:59.558430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":2050,"num_read_kb":1948,"num_write":423,"num_write_kb":74,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"267'175","reported_seq":828,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:58:53.465094+0000","last_change":"2024-09-14T11:08:21.787051+0000","last_active":"2024-09-14T12:58:53.465094+0000","last_peered":"2024-09-14T12:58:53.465094+0000","last_clean":"2024-09-14T12:58:53.465094+0000","last_became_active":"2024-09-14T11:08:21.786611+0000","last_became_peered":"2024-09-14T11:08:21.786611+0000","last_unstale":"2024-09-14T12:58:53.465094+0000","last_undegraded":"2024-09-14T12:58:53.465094+0000","last_fullsized":"2024-09-14T12:58:53.465094+0000","mapping_epoch":24,"log_start":"267'100","ondisk_log_start":"267'100","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:08:20.733145+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:08:20.733145+0000","last_clean_scrub_stamp":"2024-09-14T11:08:20.733145+0000","objects_scrubbed":0,"log_size":75,"log_dups_size":100,"ondisk_log_size":75,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:20:16.450782+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3029091,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":448,"num_read_kb":66993,"num_write":848,"num_write_kb":21210,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7],"acting":[3,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":531,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:58:43.229298+0000","last_change":"2024-09-14T11:08:25.818495+0000","last_active":"2024-09-14T12:58:43.229298+0000","last_peered":"2024-09-14T12:58:43.229298+0000","last_clean":"2024-09-14T12:58:43.229298+0000","last_became_active":"2024-09-14T11:08:25.817491+0000","last_became_peered":"2024-09-14T11:08:25.817491+0000","last_unstale":"2024-09-14T12:58:43.229298+0000","last_undegraded":"2024-09-14T12:58:43.229298+0000","last_fullsized":"2024-09-14T12:58:43.229298+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:08:24.757170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:08:24.757170+0000","last_clean_scrub_stamp":"2024-09-14T11:08:24.757170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:04:21.111837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.d","version":"267'291","reported_seq":973,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:00:58.075026+0000","last_change":"2024-09-14T11:08:27.829834+0000","last_active":"2024-09-14T13:00:58.075026+0000","last_peered":"2024-09-14T13:00:58.075026+0000","last_clean":"2024-09-14T13:00:58.075026+0000","last_became_active":"2024-09-14T11:08:27.829060+0000","last_became_peered":"2024-09-14T11:08:27.829060+0000","last_unstale":"2024-09-14T13:00:58.075026+0000","last_undegraded":"2024-09-14T13:00:58.075026+0000","last_fullsized":"2024-09-14T13:00:58.075026+0000","mapping_epoch":30,"log_start":"267'200","ondisk_log_start":"267'200","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:08:26.771628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:08:26.771628+0000","last_clean_scrub_stamp":"2024-09-14T11:08:26.771628+0000","objects_scrubbed":0,"log_size":91,"log_dups_size":200,"ondisk_log_size":91,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:11:07.685536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":13264,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":404,"num_read_kb":421,"num_write":246,"num_write_kb":20,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":520,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:58:48.427540+0000","last_change":"2024-09-14T11:08:29.845124+0000","last_active":"2024-09-14T12:58:48.427540+0000","last_peered":"2024-09-14T12:58:48.427540+0000","last_clean":"2024-09-14T12:58:48.427540+0000","last_became_active":"2024-09-14T11:08:29.844374+0000","last_became_peered":"2024-09-14T11:08:29.844374+0000","last_unstale":"2024-09-14T12:58:48.427540+0000","last_undegraded":"2024-09-14T12:58:48.427540+0000","last_fullsized":"2024-09-14T12:58:48.427540+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:08:28.783586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:08:28.783586+0000","last_clean_scrub_stamp":"2024-09-14T11:08:28.783586+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:58:42.113010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.3","version":"267'105","reported_seq":628,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:00:21.230827+0000","last_change":"2024-09-14T11:08:31.836429+0000","last_active":"2024-09-14T13:00:21.230827+0000","last_peered":"2024-09-14T13:00:21.230827+0000","last_clean":"2024-09-14T13:00:21.230827+0000","last_became_active":"2024-09-14T11:08:31.835753+0000","last_became_peered":"2024-09-14T11:08:31.835753+0000","last_unstale":"2024-09-14T13:00:21.230827+0000","last_undegraded":"2024-09-14T13:00:21.230827+0000","last_fullsized":"2024-09-14T13:00:21.230827+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:08:30.789404+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:08:30.789404+0000","last_clean_scrub_stamp":"2024-09-14T11:08:30.789404+0000","objects_scrubbed":0,"log_size":105,"log_dups_size":0,"ondisk_log_size":105,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:10:45.802301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":24,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":102,"num_read_kb":102,"num_write":245,"num_write_kb":60,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"267'865","reported_seq":2543,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:59:13.433148+0000","last_change":"2024-09-14T11:08:23.807298+0000","last_active":"2024-09-14T12:59:13.433148+0000","last_peered":"2024-09-14T12:59:13.433148+0000","last_clean":"2024-09-14T12:59:13.433148+0000","last_became_active":"2024-09-14T11:08:23.806515+0000","last_became_peered":"2024-09-14T11:08:23.806515+0000","last_unstale":"2024-09-14T12:59:13.433148+0000","last_undegraded":"2024-09-14T12:59:13.433148+0000","last_fullsized":"2024-09-14T12:59:13.433148+0000","mapping_epoch":26,"log_start":"267'800","ondisk_log_start":"267'800","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:08:22.750609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:08:22.750609+0000","last_clean_scrub_stamp":"2024-09-14T11:08:22.750609+0000","objects_scrubbed":0,"log_size":65,"log_dups_size":800,"ondisk_log_size":65,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:53:43.658780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":4146,"num_read_kb":3734,"num_write":1154,"num_write_kb":420,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"15'72","reported_seq":654,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:58:42.834156+0000","last_change":"2024-09-14T11:08:03.882483+0000","last_active":"2024-09-14T12:58:42.834156+0000","last_peered":"2024-09-14T12:58:42.834156+0000","last_clean":"2024-09-14T12:58:42.834156+0000","last_became_active":"2024-09-14T11:08:03.877126+0000","last_became_peered":"2024-09-14T11:08:03.877126+0000","last_unstale":"2024-09-14T12:58:42.834156+0000","last_undegraded":"2024-09-14T12:58:42.834156+0000","last_fullsized":"2024-09-14T12:58:42.834156+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:08:02.835447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:08:02.835447+0000","last_clean_scrub_stamp":"2024-09-14T11:08:02.835447+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:04:38.793105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"18'1","reported_seq":561,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:58:38.043302+0000","last_change":"2024-09-14T11:08:10.932779+0000","last_active":"2024-09-14T12:58:38.043302+0000","last_peered":"2024-09-14T12:58:38.043302+0000","last_clean":"2024-09-14T12:58:38.043302+0000","last_became_active":"2024-09-14T11:08:08.902043+0000","last_became_peered":"2024-09-14T11:08:08.902043+0000","last_unstale":"2024-09-14T12:58:38.043302+0000","last_undegraded":"2024-09-14T12:58:38.043302+0000","last_fullsized":"2024-09-14T12:58:38.043302+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:08:07.870014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:08:07.870014+0000","last_clean_scrub_stamp":"2024-09-14T11:08:07.870014+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:04:35.417543+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0011624509999999999,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"267'371","reported_seq":1092,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:01:34.627751+0000","last_change":"2024-09-14T11:08:21.809930+0000","last_active":"2024-09-14T13:01:34.627751+0000","last_peered":"2024-09-14T13:01:34.627751+0000","last_clean":"2024-09-14T13:01:34.627751+0000","last_became_active":"2024-09-14T11:08:21.809523+0000","last_became_peered":"2024-09-14T11:08:21.809523+0000","last_unstale":"2024-09-14T13:01:34.627751+0000","last_undegraded":"2024-09-14T13:01:34.627751+0000","last_fullsized":"2024-09-14T13:01:34.627751+0000","mapping_epoch":24,"log_start":"267'300","ondisk_log_start":"267'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:08:20.733145+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:08:20.733145+0000","last_clean_scrub_stamp":"2024-09-14T11:08:20.733145+0000","objects_scrubbed":0,"log_size":71,"log_dups_size":300,"ondisk_log_size":71,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:35:38.345862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6537749,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":1021,"num_read_kb":10697,"num_write":1395,"num_write_kb":52429,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,6],"acting":[3,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":534,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:58:52.836590+0000","last_change":"2024-09-14T11:08:25.808691+0000","last_active":"2024-09-14T12:58:52.836590+0000","last_peered":"2024-09-14T12:58:52.836590+0000","last_clean":"2024-09-14T12:58:52.836590+0000","last_became_active":"2024-09-14T11:08:25.807851+0000","last_became_peered":"2024-09-14T11:08:25.807851+0000","last_unstale":"2024-09-14T12:58:52.836590+0000","last_undegraded":"2024-09-14T12:58:52.836590+0000","last_fullsized":"2024-09-14T12:58:52.836590+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:08:24.757170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:08:24.757170+0000","last_clean_scrub_stamp":"2024-09-14T11:08:24.757170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:56:51.066419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.7","version":"267'336","reported_seq":1074,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:01:40.592306+0000","last_change":"2024-09-14T11:08:27.834071+0000","last_active":"2024-09-14T13:01:40.592306+0000","last_peered":"2024-09-14T13:01:40.592306+0000","last_clean":"2024-09-14T13:01:40.592306+0000","last_became_active":"2024-09-14T11:08:27.829359+0000","last_became_peered":"2024-09-14T11:08:27.829359+0000","last_unstale":"2024-09-14T13:01:40.592306+0000","last_undegraded":"2024-09-14T13:01:40.592306+0000","last_fullsized":"2024-09-14T13:01:40.592306+0000","mapping_epoch":30,"log_start":"267'300","ondisk_log_start":"267'300","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:08:26.771628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:08:26.771628+0000","last_clean_scrub_stamp":"2024-09-14T11:08:26.771628+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":300,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:44:51.169189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":35130,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":624,"num_read_kb":810,"num_write":580,"num_write_kb":409,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":528,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:59:03.245682+0000","last_change":"2024-09-14T11:08:29.827169+0000","last_active":"2024-09-14T12:59:03.245682+0000","last_peered":"2024-09-14T12:59:03.245682+0000","last_clean":"2024-09-14T12:59:03.245682+0000","last_became_active":"2024-09-14T11:08:29.826367+0000","last_became_peered":"2024-09-14T11:08:29.826367+0000","last_unstale":"2024-09-14T12:59:03.245682+0000","last_undegraded":"2024-09-14T12:59:03.245682+0000","last_fullsized":"2024-09-14T12:59:03.245682+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:08:28.783586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:08:28.783586+0000","last_clean_scrub_stamp":"2024-09-14T11:08:28.783586+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:19:54.618304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.9","version":"267'212","reported_seq":968,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:00:21.334917+0000","last_change":"2024-09-14T11:08:31.849513+0000","last_active":"2024-09-14T13:00:21.334917+0000","last_peered":"2024-09-14T13:00:21.334917+0000","last_clean":"2024-09-14T13:00:21.334917+0000","last_became_active":"2024-09-14T11:08:31.848763+0000","last_became_peered":"2024-09-14T11:08:31.848763+0000","last_unstale":"2024-09-14T13:00:21.334917+0000","last_undegraded":"2024-09-14T13:00:21.334917+0000","last_fullsized":"2024-09-14T13:00:21.334917+0000","mapping_epoch":34,"log_start":"267'200","ondisk_log_start":"267'200","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:08:30.789404+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:08:30.789404+0000","last_clean_scrub_stamp":"2024-09-14T11:08:30.789404+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":200,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:22:19.969967+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":408,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":546,"num_read_kb":516,"num_write":465,"num_write_kb":130,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.6","version":"267'595","reported_seq":2273,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:58:58.244065+0000","last_change":"2024-09-14T11:08:23.776991+0000","last_active":"2024-09-14T12:58:58.244065+0000","last_peered":"2024-09-14T12:58:58.244065+0000","last_clean":"2024-09-14T12:58:58.244065+0000","last_became_active":"2024-09-14T11:08:23.776564+0000","last_became_peered":"2024-09-14T11:08:23.776564+0000","last_unstale":"2024-09-14T12:58:58.244065+0000","last_undegraded":"2024-09-14T12:58:58.244065+0000","last_fullsized":"2024-09-14T12:58:58.244065+0000","mapping_epoch":26,"log_start":"267'500","ondisk_log_start":"267'500","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:08:22.750609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:08:22.750609+0000","last_clean_scrub_stamp":"2024-09-14T11:08:22.750609+0000","objects_scrubbed":0,"log_size":95,"log_dups_size":500,"ondisk_log_size":95,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:02:21.308539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":3171,"num_read_kb":2898,"num_write":783,"num_write_kb":298,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":563,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:58:47.835277+0000","last_change":"2024-09-14T11:08:11.214664+0000","last_active":"2024-09-14T12:58:47.835277+0000","last_peered":"2024-09-14T12:58:47.835277+0000","last_clean":"2024-09-14T12:58:47.835277+0000","last_became_active":"2024-09-14T11:08:08.903386+0000","last_became_peered":"2024-09-14T11:08:08.903386+0000","last_unstale":"2024-09-14T12:58:47.835277+0000","last_undegraded":"2024-09-14T12:58:47.835277+0000","last_fullsized":"2024-09-14T12:58:47.835277+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:08:07.870014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:08:07.870014+0000","last_clean_scrub_stamp":"2024-09-14T11:08:07.870014+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:55:07.449307+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001192558,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"267'175","reported_seq":865,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:58:48.241117+0000","last_change":"2024-09-14T11:08:21.815829+0000","last_active":"2024-09-14T12:58:48.241117+0000","last_peered":"2024-09-14T12:58:48.241117+0000","last_clean":"2024-09-14T12:58:48.241117+0000","last_became_active":"2024-09-14T11:08:21.815453+0000","last_became_peered":"2024-09-14T11:08:21.815453+0000","last_unstale":"2024-09-14T12:58:48.241117+0000","last_undegraded":"2024-09-14T12:58:48.241117+0000","last_fullsized":"2024-09-14T12:58:48.241117+0000","mapping_epoch":24,"log_start":"267'100","ondisk_log_start":"267'100","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:08:20.733145+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:08:20.733145+0000","last_clean_scrub_stamp":"2024-09-14T11:08:20.733145+0000","objects_scrubbed":0,"log_size":75,"log_dups_size":100,"ondisk_log_size":75,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:34:32.758328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10512963,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":652,"num_read_kb":79122,"num_write":840,"num_write_kb":40267,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,3],"acting":[0,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":531,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:58:58.047972+0000","last_change":"2024-09-14T11:08:25.802329+0000","last_active":"2024-09-14T12:58:58.047972+0000","last_peered":"2024-09-14T12:58:58.047972+0000","last_clean":"2024-09-14T12:58:58.047972+0000","last_became_active":"2024-09-14T11:08:25.801580+0000","last_became_peered":"2024-09-14T11:08:25.801580+0000","last_unstale":"2024-09-14T12:58:58.047972+0000","last_undegraded":"2024-09-14T12:58:58.047972+0000","last_fullsized":"2024-09-14T12:58:58.047972+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:08:24.757170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:08:24.757170+0000","last_clean_scrub_stamp":"2024-09-14T11:08:24.757170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:41:07.671257+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.4","version":"267'1006","reported_seq":3348,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:01:40.709142+0000","last_change":"2024-09-14T11:08:27.825306+0000","last_active":"2024-09-14T13:01:40.709142+0000","last_peered":"2024-09-14T13:01:40.709142+0000","last_clean":"2024-09-14T13:01:40.709142+0000","last_became_active":"2024-09-14T11:08:27.824703+0000","last_became_peered":"2024-09-14T11:08:27.824703+0000","last_unstale":"2024-09-14T13:01:40.709142+0000","last_undegraded":"2024-09-14T13:01:40.709142+0000","last_fullsized":"2024-09-14T13:01:40.709142+0000","mapping_epoch":30,"log_start":"267'901","ondisk_log_start":"267'901","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:08:26.771628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:08:26.771628+0000","last_clean_scrub_stamp":"2024-09-14T11:08:26.771628+0000","objects_scrubbed":0,"log_size":105,"log_dups_size":901,"ondisk_log_size":105,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:45:52.681555+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":30281,"num_objects":12,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":0,"num_read":1335,"num_read_kb":1419,"num_write":488,"num_write_kb":251,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":526,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:59:32.846140+0000","last_change":"2024-09-14T11:08:29.837085+0000","last_active":"2024-09-14T12:59:32.846140+0000","last_peered":"2024-09-14T12:59:32.846140+0000","last_clean":"2024-09-14T12:59:32.846140+0000","last_became_active":"2024-09-14T11:08:29.836253+0000","last_became_peered":"2024-09-14T11:08:29.836253+0000","last_unstale":"2024-09-14T12:59:32.846140+0000","last_undegraded":"2024-09-14T12:59:32.846140+0000","last_fullsized":"2024-09-14T12:59:32.846140+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:08:28.783586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:08:28.783586+0000","last_clean_scrub_stamp":"2024-09-14T11:08:28.783586+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:19:31.677337+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.a","version":"267'224","reported_seq":783,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:59:18.468936+0000","last_change":"2024-09-14T11:08:31.836526+0000","last_active":"2024-09-14T12:59:18.468936+0000","last_peered":"2024-09-14T12:59:18.468936+0000","last_clean":"2024-09-14T12:59:18.468936+0000","last_became_active":"2024-09-14T11:08:31.835700+0000","last_became_peered":"2024-09-14T11:08:31.835700+0000","last_unstale":"2024-09-14T12:59:18.468936+0000","last_undegraded":"2024-09-14T12:59:18.468936+0000","last_fullsized":"2024-09-14T12:59:18.468936+0000","mapping_epoch":34,"log_start":"267'200","ondisk_log_start":"267'200","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:08:30.789404+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:08:30.789404+0000","last_clean_scrub_stamp":"2024-09-14T11:08:30.789404+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":200,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:45:49.838871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":435,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":369,"num_read_kb":358,"num_write":505,"num_write_kb":147,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"267'413","reported_seq":2031,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:00:21.260118+0000","last_change":"2024-09-14T11:09:57.243473+0000","last_active":"2024-09-14T13:00:21.260118+0000","last_peered":"2024-09-14T13:00:21.260118+0000","last_clean":"2024-09-14T13:00:21.260118+0000","last_became_active":"2024-09-14T11:09:57.243168+0000","last_became_peered":"2024-09-14T11:09:57.243168+0000","last_unstale":"2024-09-14T13:00:21.260118+0000","last_undegraded":"2024-09-14T13:00:21.260118+0000","last_fullsized":"2024-09-14T13:00:21.260118+0000","mapping_epoch":39,"log_start":"267'400","ondisk_log_start":"267'400","created":26,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:08:22.750609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:08:22.750609+0000","last_clean_scrub_stamp":"2024-09-14T11:08:22.750609+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":400,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:03:03.902658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2397,"num_read_kb":2278,"num_write":464,"num_write_kb":90,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":564,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:58:37.822791+0000","last_change":"2024-09-14T11:08:10.911966+0000","last_active":"2024-09-14T12:58:37.822791+0000","last_peered":"2024-09-14T12:58:37.822791+0000","last_clean":"2024-09-14T12:58:37.822791+0000","last_became_active":"2024-09-14T11:08:08.957848+0000","last_became_peered":"2024-09-14T11:08:08.957848+0000","last_unstale":"2024-09-14T12:58:37.822791+0000","last_undegraded":"2024-09-14T12:58:37.822791+0000","last_fullsized":"2024-09-14T12:58:37.822791+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:08:07.870014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:08:07.870014+0000","last_clean_scrub_stamp":"2024-09-14T11:08:07.870014+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:21:50.090415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001143142,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"267'230","reported_seq":913,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:58:38.459976+0000","last_change":"2024-09-14T11:08:21.817844+0000","last_active":"2024-09-14T12:58:38.459976+0000","last_peered":"2024-09-14T12:58:38.459976+0000","last_clean":"2024-09-14T12:58:38.459976+0000","last_became_active":"2024-09-14T11:08:21.817523+0000","last_became_peered":"2024-09-14T11:08:21.817523+0000","last_unstale":"2024-09-14T12:58:38.459976+0000","last_undegraded":"2024-09-14T12:58:38.459976+0000","last_fullsized":"2024-09-14T12:58:38.459976+0000","mapping_epoch":24,"log_start":"267'200","ondisk_log_start":"267'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:08:20.733145+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:08:20.733145+0000","last_clean_scrub_stamp":"2024-09-14T11:08:20.733145+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":200,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:40:59.452110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12940502,"num_objects":9,"num_object_clones":0,"num_object_copies":27,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":624,"num_read_kb":70142,"num_write":1040,"num_write_kb":36042,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,6],"acting":[1,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.6","version":"29'1","reported_seq":536,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:58:57.827977+0000","last_change":"2024-09-14T11:08:25.807394+0000","last_active":"2024-09-14T12:58:57.827977+0000","last_peered":"2024-09-14T12:58:57.827977+0000","last_clean":"2024-09-14T12:58:57.827977+0000","last_became_active":"2024-09-14T11:08:25.807070+0000","last_became_peered":"2024-09-14T11:08:25.807070+0000","last_unstale":"2024-09-14T12:58:57.827977+0000","last_undegraded":"2024-09-14T12:58:57.827977+0000","last_fullsized":"2024-09-14T12:58:57.827977+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:08:24.757170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:08:24.757170+0000","last_clean_scrub_stamp":"2024-09-14T11:08:24.757170+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:08:45.157565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.5","version":"267'402","reported_seq":2364,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:01:40.687724+0000","last_change":"2024-09-14T11:08:27.831350+0000","last_active":"2024-09-14T13:01:40.687724+0000","last_peered":"2024-09-14T13:01:40.687724+0000","last_clean":"2024-09-14T13:01:40.687724+0000","last_became_active":"2024-09-14T11:08:27.830644+0000","last_became_peered":"2024-09-14T11:08:27.830644+0000","last_unstale":"2024-09-14T13:01:40.687724+0000","last_undegraded":"2024-09-14T13:01:40.687724+0000","last_fullsized":"2024-09-14T13:01:40.687724+0000","mapping_epoch":30,"log_start":"267'300","ondisk_log_start":"267'300","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:08:26.771628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:08:26.771628+0000","last_clean_scrub_stamp":"2024-09-14T11:08:26.771628+0000","objects_scrubbed":0,"log_size":102,"log_dups_size":300,"ondisk_log_size":102,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:05:03.898449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":154,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":380,"num_read_kb":368,"num_write":375,"num_write_kb":193,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":530,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:58:58.243958+0000","last_change":"2024-09-14T11:08:29.802462+0000","last_active":"2024-09-14T12:58:58.243958+0000","last_peered":"2024-09-14T12:58:58.243958+0000","last_clean":"2024-09-14T12:58:58.243958+0000","last_became_active":"2024-09-14T11:08:29.801661+0000","last_became_peered":"2024-09-14T11:08:29.801661+0000","last_unstale":"2024-09-14T12:58:58.243958+0000","last_undegraded":"2024-09-14T12:58:58.243958+0000","last_fullsized":"2024-09-14T12:58:58.243958+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:08:28.783586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:08:28.783586+0000","last_clean_scrub_stamp":"2024-09-14T11:08:28.783586+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:32:48.426887+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.b","version":"267'248","reported_seq":876,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:00:21.845348+0000","last_change":"2024-09-14T11:08:31.842253+0000","last_active":"2024-09-14T13:00:21.845348+0000","last_peered":"2024-09-14T13:00:21.845348+0000","last_clean":"2024-09-14T13:00:21.845348+0000","last_became_active":"2024-09-14T11:08:31.841552+0000","last_became_peered":"2024-09-14T11:08:31.841552+0000","last_unstale":"2024-09-14T13:00:21.845348+0000","last_undegraded":"2024-09-14T13:00:21.845348+0000","last_fullsized":"2024-09-14T13:00:21.845348+0000","mapping_epoch":34,"log_start":"267'200","ondisk_log_start":"267'200","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:08:30.789404+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:08:30.789404+0000","last_clean_scrub_stamp":"2024-09-14T11:08:30.789404+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":200,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:30:40.287699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":202,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":474,"num_read_kb":499,"num_write":548,"num_write_kb":158,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"267'1115","reported_seq":2640,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:01:39.340538+0000","last_change":"2024-09-14T11:08:23.777840+0000","last_active":"2024-09-14T13:01:39.340538+0000","last_peered":"2024-09-14T13:01:39.340538+0000","last_clean":"2024-09-14T13:01:39.340538+0000","last_became_active":"2024-09-14T11:08:23.777511+0000","last_became_peered":"2024-09-14T11:08:23.777511+0000","last_unstale":"2024-09-14T13:01:39.340538+0000","last_undegraded":"2024-09-14T13:01:39.340538+0000","last_fullsized":"2024-09-14T13:01:39.340538+0000","mapping_epoch":26,"log_start":"267'1100","ondisk_log_start":"267'1100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:08:22.750609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:08:22.750609+0000","last_clean_scrub_stamp":"2024-09-14T11:08:22.750609+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":1100,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:04:58.735646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5086,"num_read_kb":4484,"num_write":1533,"num_write_kb":642,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"20'2","reported_seq":562,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:58:38.043188+0000","last_change":"2024-09-14T11:08:10.933870+0000","last_active":"2024-09-14T12:58:38.043188+0000","last_peered":"2024-09-14T12:58:38.043188+0000","last_clean":"2024-09-14T12:58:38.043188+0000","last_became_active":"2024-09-14T11:08:08.903062+0000","last_became_peered":"2024-09-14T11:08:08.903062+0000","last_unstale":"2024-09-14T12:58:38.043188+0000","last_undegraded":"2024-09-14T12:58:38.043188+0000","last_fullsized":"2024-09-14T12:58:38.043188+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:08:07.870014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:08:07.870014+0000","last_clean_scrub_stamp":"2024-09-14T11:08:07.870014+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:50:59.568798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0022728420000000002,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"267'175","reported_seq":862,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:58:48.230287+0000","last_change":"2024-09-14T11:08:21.830653+0000","last_active":"2024-09-14T12:58:48.230287+0000","last_peered":"2024-09-14T12:58:48.230287+0000","last_clean":"2024-09-14T12:58:48.230287+0000","last_became_active":"2024-09-14T11:08:21.823121+0000","last_became_peered":"2024-09-14T11:08:21.823121+0000","last_unstale":"2024-09-14T12:58:48.230287+0000","last_undegraded":"2024-09-14T12:58:48.230287+0000","last_fullsized":"2024-09-14T12:58:48.230287+0000","mapping_epoch":24,"log_start":"267'100","ondisk_log_start":"267'100","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:08:20.733145+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:08:20.733145+0000","last_clean_scrub_stamp":"2024-09-14T11:08:20.733145+0000","objects_scrubbed":0,"log_size":75,"log_dups_size":100,"ondisk_log_size":75,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:49:22.239894+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8336652,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":551,"num_read_kb":32204,"num_write":875,"num_write_kb":26671,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,0],"acting":[4,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":538,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:59:18.249303+0000","last_change":"2024-09-14T11:08:25.797249+0000","last_active":"2024-09-14T12:59:18.249303+0000","last_peered":"2024-09-14T12:59:18.249303+0000","last_clean":"2024-09-14T12:59:18.249303+0000","last_became_active":"2024-09-14T11:08:25.796526+0000","last_became_peered":"2024-09-14T11:08:25.796526+0000","last_unstale":"2024-09-14T12:59:18.249303+0000","last_undegraded":"2024-09-14T12:59:18.249303+0000","last_fullsized":"2024-09-14T12:59:18.249303+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:08:24.757170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:08:24.757170+0000","last_clean_scrub_stamp":"2024-09-14T11:08:24.757170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:18:24.235208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.6","version":"267'234","reported_seq":849,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:01:28.385849+0000","last_change":"2024-09-14T11:08:27.819232+0000","last_active":"2024-09-14T13:01:28.385849+0000","last_peered":"2024-09-14T13:01:28.385849+0000","last_clean":"2024-09-14T13:01:28.385849+0000","last_became_active":"2024-09-14T11:08:27.818482+0000","last_became_peered":"2024-09-14T11:08:27.818482+0000","last_unstale":"2024-09-14T13:01:28.385849+0000","last_undegraded":"2024-09-14T13:01:28.385849+0000","last_fullsized":"2024-09-14T13:01:28.385849+0000","mapping_epoch":30,"log_start":"267'200","ondisk_log_start":"267'200","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:08:26.771628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:08:26.771628+0000","last_clean_scrub_stamp":"2024-09-14T11:08:26.771628+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":200,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:12:06.477100+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":286,"num_read_kb":275,"num_write":214,"num_write_kb":24,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":522,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:59:03.430911+0000","last_change":"2024-09-14T11:08:29.839536+0000","last_active":"2024-09-14T12:59:03.430911+0000","last_peered":"2024-09-14T12:59:03.430911+0000","last_clean":"2024-09-14T12:59:03.430911+0000","last_became_active":"2024-09-14T11:08:29.837840+0000","last_became_peered":"2024-09-14T11:08:29.837840+0000","last_unstale":"2024-09-14T12:59:03.430911+0000","last_undegraded":"2024-09-14T12:59:03.430911+0000","last_fullsized":"2024-09-14T12:59:03.430911+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:08:28.783586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:08:28.783586+0000","last_clean_scrub_stamp":"2024-09-14T11:08:28.783586+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:39:33.744929+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.8","version":"267'111","reported_seq":687,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:00:18.844178+0000","last_change":"2024-09-14T11:08:31.852081+0000","last_active":"2024-09-14T13:00:18.844178+0000","last_peered":"2024-09-14T13:00:18.844178+0000","last_clean":"2024-09-14T13:00:18.844178+0000","last_became_active":"2024-09-14T11:08:31.851269+0000","last_became_peered":"2024-09-14T11:08:31.851269+0000","last_unstale":"2024-09-14T13:00:18.844178+0000","last_undegraded":"2024-09-14T13:00:18.844178+0000","last_fullsized":"2024-09-14T13:00:18.844178+0000","mapping_epoch":34,"log_start":"267'100","ondisk_log_start":"267'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:08:30.789404+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:08:30.789404+0000","last_clean_scrub_stamp":"2024-09-14T11:08:30.789404+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":100,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:52:29.862548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":188,"num_read_kb":187,"num_write":249,"num_write_kb":58,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"267'517","reported_seq":2228,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:00:18.884304+0000","last_change":"2024-09-14T11:08:23.794201+0000","last_active":"2024-09-14T13:00:18.884304+0000","last_peered":"2024-09-14T13:00:18.884304+0000","last_clean":"2024-09-14T13:00:18.884304+0000","last_became_active":"2024-09-14T11:08:23.793860+0000","last_became_peered":"2024-09-14T11:08:23.793860+0000","last_unstale":"2024-09-14T13:00:18.884304+0000","last_undegraded":"2024-09-14T13:00:18.884304+0000","last_fullsized":"2024-09-14T13:00:18.884304+0000","mapping_epoch":26,"log_start":"267'500","ondisk_log_start":"267'500","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:08:22.750609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:08:22.750609+0000","last_clean_scrub_stamp":"2024-09-14T11:08:22.750609+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":500,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:09:26.531607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3013,"num_read_kb":2819,"num_write":641,"num_write_kb":178,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"267'194","reported_seq":873,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:59:18.052260+0000","last_change":"2024-09-14T11:08:21.792555+0000","last_active":"2024-09-14T12:59:18.052260+0000","last_peered":"2024-09-14T12:59:18.052260+0000","last_clean":"2024-09-14T12:59:18.052260+0000","last_became_active":"2024-09-14T11:08:21.791679+0000","last_became_peered":"2024-09-14T11:08:21.791679+0000","last_unstale":"2024-09-14T12:59:18.052260+0000","last_undegraded":"2024-09-14T12:59:18.052260+0000","last_fullsized":"2024-09-14T12:59:18.052260+0000","mapping_epoch":24,"log_start":"267'100","ondisk_log_start":"267'100","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:08:20.733145+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:08:20.733145+0000","last_clean_scrub_stamp":"2024-09-14T11:08:20.733145+0000","objects_scrubbed":0,"log_size":94,"log_dups_size":100,"ondisk_log_size":94,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:33:56.588522+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10547089,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":641,"num_read_kb":55282,"num_write":896,"num_write_kb":39262,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,2],"acting":[5,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":558,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:58:38.460088+0000","last_change":"2024-09-14T11:08:10.911600+0000","last_active":"2024-09-14T12:58:38.460088+0000","last_peered":"2024-09-14T12:58:38.460088+0000","last_clean":"2024-09-14T12:58:38.460088+0000","last_became_active":"2024-09-14T11:08:08.888921+0000","last_became_peered":"2024-09-14T11:08:08.888921+0000","last_unstale":"2024-09-14T12:58:38.460088+0000","last_undegraded":"2024-09-14T12:58:38.460088+0000","last_fullsized":"2024-09-14T12:58:38.460088+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:08:07.870014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:08:07.870014+0000","last_clean_scrub_stamp":"2024-09-14T11:08:07.870014+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:29:02.760571+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001198714,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":538,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:58:53.242581+0000","last_change":"2024-09-14T11:08:25.801820+0000","last_active":"2024-09-14T12:58:53.242581+0000","last_peered":"2024-09-14T12:58:53.242581+0000","last_clean":"2024-09-14T12:58:53.242581+0000","last_became_active":"2024-09-14T11:08:25.792863+0000","last_became_peered":"2024-09-14T11:08:25.792863+0000","last_unstale":"2024-09-14T12:58:53.242581+0000","last_undegraded":"2024-09-14T12:58:53.242581+0000","last_fullsized":"2024-09-14T12:58:53.242581+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:08:24.757170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:08:24.757170+0000","last_clean_scrub_stamp":"2024-09-14T11:08:24.757170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:55:17.257027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"267'454","reported_seq":1193,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:01:40.574099+0000","last_change":"2024-09-14T11:08:27.803952+0000","last_active":"2024-09-14T13:01:40.574099+0000","last_peered":"2024-09-14T13:01:40.574099+0000","last_clean":"2024-09-14T13:01:40.574099+0000","last_became_active":"2024-09-14T11:08:27.803324+0000","last_became_peered":"2024-09-14T11:08:27.803324+0000","last_unstale":"2024-09-14T13:01:40.574099+0000","last_undegraded":"2024-09-14T13:01:40.574099+0000","last_fullsized":"2024-09-14T13:01:40.574099+0000","mapping_epoch":30,"log_start":"267'400","ondisk_log_start":"267'400","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:08:26.771628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:08:26.771628+0000","last_clean_scrub_stamp":"2024-09-14T11:08:26.771628+0000","objects_scrubbed":0,"log_size":54,"log_dups_size":400,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:06:41.976461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":32596,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":1287,"num_read_kb":1421,"num_write":1882,"num_write_kb":1658,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":527,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:58:58.232580+0000","last_change":"2024-09-14T11:08:29.831130+0000","last_active":"2024-09-14T12:58:58.232580+0000","last_peered":"2024-09-14T12:58:58.232580+0000","last_clean":"2024-09-14T12:58:58.232580+0000","last_became_active":"2024-09-14T11:08:29.830303+0000","last_became_peered":"2024-09-14T11:08:29.830303+0000","last_unstale":"2024-09-14T12:58:58.232580+0000","last_undegraded":"2024-09-14T12:58:58.232580+0000","last_fullsized":"2024-09-14T12:58:58.232580+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:08:28.783586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:08:28.783586+0000","last_clean_scrub_stamp":"2024-09-14T11:08:28.783586+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:22:47.627433+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.e","version":"267'153","reported_seq":717,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:00:13.798032+0000","last_change":"2024-09-14T11:08:31.836009+0000","last_active":"2024-09-14T13:00:13.798032+0000","last_peered":"2024-09-14T13:00:13.798032+0000","last_clean":"2024-09-14T13:00:13.798032+0000","last_became_active":"2024-09-14T11:08:31.835335+0000","last_became_peered":"2024-09-14T11:08:31.835335+0000","last_unstale":"2024-09-14T13:00:13.798032+0000","last_undegraded":"2024-09-14T13:00:13.798032+0000","last_fullsized":"2024-09-14T13:00:13.798032+0000","mapping_epoch":34,"log_start":"267'100","ondisk_log_start":"267'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:08:30.789404+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:08:30.789404+0000","last_clean_scrub_stamp":"2024-09-14T11:08:30.789404+0000","objects_scrubbed":0,"log_size":53,"log_dups_size":100,"ondisk_log_size":53,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:46:41.088012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":736,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":226,"num_read_kb":194,"num_write":381,"num_write_kb":93,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"267'734","reported_seq":2282,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:58:53.242555+0000","last_change":"2024-09-14T11:08:23.792522+0000","last_active":"2024-09-14T12:58:53.242555+0000","last_peered":"2024-09-14T12:58:53.242555+0000","last_clean":"2024-09-14T12:58:53.242555+0000","last_became_active":"2024-09-14T11:08:23.792144+0000","last_became_peered":"2024-09-14T11:08:23.792144+0000","last_unstale":"2024-09-14T12:58:53.242555+0000","last_undegraded":"2024-09-14T12:58:53.242555+0000","last_fullsized":"2024-09-14T12:58:53.242555+0000","mapping_epoch":26,"log_start":"267'700","ondisk_log_start":"267'700","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:08:22.750609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:08:22.750609+0000","last_clean_scrub_stamp":"2024-09-14T11:08:22.750609+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":700,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:27:19.107022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":3573,"num_read_kb":3234,"num_write":954,"num_write_kb":344,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.4","version":"267'257","reported_seq":975,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:58:48.462398+0000","last_change":"2024-09-14T11:08:21.808706+0000","last_active":"2024-09-14T12:58:48.462398+0000","last_peered":"2024-09-14T12:58:48.462398+0000","last_clean":"2024-09-14T12:58:48.462398+0000","last_became_active":"2024-09-14T11:08:21.808278+0000","last_became_peered":"2024-09-14T11:08:21.808278+0000","last_unstale":"2024-09-14T12:58:48.462398+0000","last_undegraded":"2024-09-14T12:58:48.462398+0000","last_fullsized":"2024-09-14T12:58:48.462398+0000","mapping_epoch":24,"log_start":"267'200","ondisk_log_start":"267'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:08:20.733145+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:08:20.733145+0000","last_clean_scrub_stamp":"2024-09-14T11:08:20.733145+0000","objects_scrubbed":0,"log_size":57,"log_dups_size":200,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:56:37.903249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194409,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":847,"num_read_kb":29775,"num_write":1316,"num_write_kb":30049,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,6],"acting":[1,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":561,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:59:12.841357+0000","last_change":"2024-09-14T11:08:11.214796+0000","last_active":"2024-09-14T12:59:12.841357+0000","last_peered":"2024-09-14T12:59:12.841357+0000","last_clean":"2024-09-14T12:59:12.841357+0000","last_became_active":"2024-09-14T11:08:08.903905+0000","last_became_peered":"2024-09-14T11:08:08.903905+0000","last_unstale":"2024-09-14T12:59:12.841357+0000","last_undegraded":"2024-09-14T12:59:12.841357+0000","last_fullsized":"2024-09-14T12:59:12.841357+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:08:07.870014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:08:07.870014+0000","last_clean_scrub_stamp":"2024-09-14T11:08:07.870014+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:58:06.786050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001173377,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":532,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:58:53.428640+0000","last_change":"2024-09-14T11:08:25.801438+0000","last_active":"2024-09-14T12:58:53.428640+0000","last_peered":"2024-09-14T12:58:53.428640+0000","last_clean":"2024-09-14T12:58:53.428640+0000","last_became_active":"2024-09-14T11:08:25.800695+0000","last_became_peered":"2024-09-14T11:08:25.800695+0000","last_unstale":"2024-09-14T12:58:53.428640+0000","last_undegraded":"2024-09-14T12:58:53.428640+0000","last_fullsized":"2024-09-14T12:58:53.428640+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:08:24.757170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:08:24.757170+0000","last_clean_scrub_stamp":"2024-09-14T11:08:24.757170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:42:30.211985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1","version":"267'350","reported_seq":993,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:00:28.372671+0000","last_change":"2024-09-14T11:08:27.814544+0000","last_active":"2024-09-14T13:00:28.372671+0000","last_peered":"2024-09-14T13:00:28.372671+0000","last_clean":"2024-09-14T13:00:28.372671+0000","last_became_active":"2024-09-14T11:08:27.813857+0000","last_became_peered":"2024-09-14T11:08:27.813857+0000","last_unstale":"2024-09-14T13:00:28.372671+0000","last_undegraded":"2024-09-14T13:00:28.372671+0000","last_fullsized":"2024-09-14T13:00:28.372671+0000","mapping_epoch":30,"log_start":"267'300","ondisk_log_start":"267'300","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:08:26.771628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:08:26.771628+0000","last_clean_scrub_stamp":"2024-09-14T11:08:26.771628+0000","objects_scrubbed":0,"log_size":50,"log_dups_size":300,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:41:50.966231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":441,"num_read_kb":434,"num_write":426,"num_write_kb":202,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.0","version":"267'776","reported_seq":5194,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:01:40.713682+0000","last_change":"2024-09-14T11:08:29.824227+0000","last_active":"2024-09-14T13:01:40.713682+0000","last_peered":"2024-09-14T13:01:40.713682+0000","last_clean":"2024-09-14T13:01:40.713682+0000","last_became_active":"2024-09-14T11:08:29.823513+0000","last_became_peered":"2024-09-14T11:08:29.823513+0000","last_unstale":"2024-09-14T13:01:40.713682+0000","last_undegraded":"2024-09-14T13:01:40.713682+0000","last_fullsized":"2024-09-14T13:01:40.713682+0000","mapping_epoch":32,"log_start":"267'700","ondisk_log_start":"267'700","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:08:28.783586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:08:28.783586+0000","last_clean_scrub_stamp":"2024-09-14T11:08:28.783586+0000","objects_scrubbed":0,"log_size":76,"log_dups_size":700,"ondisk_log_size":76,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:12:27.111650+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.f","version":"267'148","reported_seq":702,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:01:23.499170+0000","last_change":"2024-09-14T11:08:31.831263+0000","last_active":"2024-09-14T13:01:23.499170+0000","last_peered":"2024-09-14T13:01:23.499170+0000","last_clean":"2024-09-14T13:01:23.499170+0000","last_became_active":"2024-09-14T11:08:31.825708+0000","last_became_peered":"2024-09-14T11:08:31.825708+0000","last_unstale":"2024-09-14T13:01:23.499170+0000","last_undegraded":"2024-09-14T13:01:23.499170+0000","last_fullsized":"2024-09-14T13:01:23.499170+0000","mapping_epoch":34,"log_start":"267'100","ondisk_log_start":"267'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:08:30.789404+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:08:30.789404+0000","last_clean_scrub_stamp":"2024-09-14T11:08:30.789404+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":100,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:10:09.371769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1096,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":219,"num_read_kb":197,"num_write":351,"num_write_kb":86,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"267'1021","reported_seq":2906,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:59:18.397637+0000","last_change":"2024-09-14T11:08:23.800778+0000","last_active":"2024-09-14T12:59:18.397637+0000","last_peered":"2024-09-14T12:59:18.397637+0000","last_clean":"2024-09-14T12:59:18.397637+0000","last_became_active":"2024-09-14T11:08:23.800388+0000","last_became_peered":"2024-09-14T11:08:23.800388+0000","last_unstale":"2024-09-14T12:59:18.397637+0000","last_undegraded":"2024-09-14T12:59:18.397637+0000","last_fullsized":"2024-09-14T12:59:18.397637+0000","mapping_epoch":26,"log_start":"267'1000","ondisk_log_start":"267'1000","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:08:22.750609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:08:22.750609+0000","last_clean_scrub_stamp":"2024-09-14T11:08:22.750609+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":1000,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:13:46.545106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":5094,"num_read_kb":4556,"num_write":1418,"num_write_kb":544,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.7","version":"267'184","reported_seq":826,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:58:53.465571+0000","last_change":"2024-09-14T11:08:21.798122+0000","last_active":"2024-09-14T12:58:53.465571+0000","last_peered":"2024-09-14T12:58:53.465571+0000","last_clean":"2024-09-14T12:58:53.465571+0000","last_became_active":"2024-09-14T11:08:21.797297+0000","last_became_peered":"2024-09-14T11:08:21.797297+0000","last_unstale":"2024-09-14T12:58:53.465571+0000","last_undegraded":"2024-09-14T12:58:53.465571+0000","last_fullsized":"2024-09-14T12:58:53.465571+0000","mapping_epoch":24,"log_start":"267'100","ondisk_log_start":"267'100","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:08:20.733145+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:08:20.733145+0000","last_clean_scrub_stamp":"2024-09-14T11:08:20.733145+0000","objects_scrubbed":0,"log_size":84,"log_dups_size":100,"ondisk_log_size":84,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:30:27.067493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":11093052,"num_objects":10,"num_object_clones":0,"num_object_copies":30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":468,"num_read_kb":20434,"num_write":849,"num_write_kb":40195,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,7],"acting":[3,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":556,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:58:43.461294+0000","last_change":"2024-09-14T11:08:10.911600+0000","last_active":"2024-09-14T12:58:43.461294+0000","last_peered":"2024-09-14T12:58:43.461294+0000","last_clean":"2024-09-14T12:58:43.461294+0000","last_became_active":"2024-09-14T11:08:08.891458+0000","last_became_peered":"2024-09-14T11:08:08.891458+0000","last_unstale":"2024-09-14T12:58:43.461294+0000","last_undegraded":"2024-09-14T12:58:43.461294+0000","last_fullsized":"2024-09-14T12:58:43.461294+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:08:07.870014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:08:07.870014+0000","last_clean_scrub_stamp":"2024-09-14T11:08:07.870014+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:05:05.170921+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0011468940000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":535,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:58:53.231411+0000","last_change":"2024-09-14T11:08:25.808446+0000","last_active":"2024-09-14T12:58:53.231411+0000","last_peered":"2024-09-14T12:58:53.231411+0000","last_clean":"2024-09-14T12:58:53.231411+0000","last_became_active":"2024-09-14T11:08:25.807555+0000","last_became_peered":"2024-09-14T11:08:25.807555+0000","last_unstale":"2024-09-14T12:58:53.231411+0000","last_undegraded":"2024-09-14T12:58:53.231411+0000","last_fullsized":"2024-09-14T12:58:53.231411+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:08:24.757170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:08:24.757170+0000","last_clean_scrub_stamp":"2024-09-14T11:08:24.757170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:45:14.993273+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.2","version":"267'172","reported_seq":779,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:59:08.517056+0000","last_change":"2024-09-14T11:08:27.826108+0000","last_active":"2024-09-14T12:59:08.517056+0000","last_peered":"2024-09-14T12:59:08.517056+0000","last_clean":"2024-09-14T12:59:08.517056+0000","last_became_active":"2024-09-14T11:08:27.825292+0000","last_became_peered":"2024-09-14T11:08:27.825292+0000","last_unstale":"2024-09-14T12:59:08.517056+0000","last_undegraded":"2024-09-14T12:59:08.517056+0000","last_fullsized":"2024-09-14T12:59:08.517056+0000","mapping_epoch":30,"log_start":"267'100","ondisk_log_start":"267'100","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:08:26.771628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:08:26.771628+0000","last_clean_scrub_stamp":"2024-09-14T11:08:26.771628+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":100,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:07:03.156677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":226,"num_read_kb":221,"num_write":150,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.3","version":"267'811","reported_seq":5530,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:01:40.724601+0000","last_change":"2024-09-14T11:08:29.826625+0000","last_active":"2024-09-14T13:01:40.724601+0000","last_peered":"2024-09-14T13:01:40.724601+0000","last_clean":"2024-09-14T13:01:40.724601+0000","last_became_active":"2024-09-14T11:08:29.824268+0000","last_became_peered":"2024-09-14T11:08:29.824268+0000","last_unstale":"2024-09-14T13:01:40.724601+0000","last_undegraded":"2024-09-14T13:01:40.724601+0000","last_fullsized":"2024-09-14T13:01:40.724601+0000","mapping_epoch":32,"log_start":"267'701","ondisk_log_start":"267'701","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:08:28.783586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:08:28.783586+0000","last_clean_scrub_stamp":"2024-09-14T11:08:28.783586+0000","objects_scrubbed":0,"log_size":110,"log_dups_size":701,"ondisk_log_size":110,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:53:34.571934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.c","version":"267'177","reported_seq":726,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:58:48.241226+0000","last_change":"2024-09-14T11:08:31.845141+0000","last_active":"2024-09-14T12:58:48.241226+0000","last_peered":"2024-09-14T12:58:48.241226+0000","last_clean":"2024-09-14T12:58:48.241226+0000","last_became_active":"2024-09-14T11:08:31.844329+0000","last_became_peered":"2024-09-14T11:08:31.844329+0000","last_unstale":"2024-09-14T12:58:48.241226+0000","last_undegraded":"2024-09-14T12:58:48.241226+0000","last_fullsized":"2024-09-14T12:58:48.241226+0000","mapping_epoch":34,"log_start":"267'100","ondisk_log_start":"267'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:08:30.789404+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:08:30.789404+0000","last_clean_scrub_stamp":"2024-09-14T11:08:30.789404+0000","objects_scrubbed":0,"log_size":77,"log_dups_size":100,"ondisk_log_size":77,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:04:50.705908+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":58,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":178,"num_read_kb":162,"num_write":419,"num_write_kb":126,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"267'732","reported_seq":2204,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:00:11.324270+0000","last_change":"2024-09-14T11:08:23.801660+0000","last_active":"2024-09-14T13:00:11.324270+0000","last_peered":"2024-09-14T13:00:11.324270+0000","last_clean":"2024-09-14T13:00:11.324270+0000","last_became_active":"2024-09-14T11:08:23.800918+0000","last_became_peered":"2024-09-14T11:08:23.800918+0000","last_unstale":"2024-09-14T13:00:11.324270+0000","last_undegraded":"2024-09-14T13:00:11.324270+0000","last_fullsized":"2024-09-14T13:00:11.324270+0000","mapping_epoch":26,"log_start":"267'700","ondisk_log_start":"267'700","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:08:22.750609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:08:22.750609+0000","last_clean_scrub_stamp":"2024-09-14T11:08:22.750609+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":700,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:49:04.627652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3552,"num_read_kb":3200,"num_write":979,"num_write_kb":380,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"267'258","reported_seq":958,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:01:33.607989+0000","last_change":"2024-09-14T11:08:56.035136+0000","last_active":"2024-09-14T13:01:33.607989+0000","last_peered":"2024-09-14T13:01:33.607989+0000","last_clean":"2024-09-14T13:01:33.607989+0000","last_became_active":"2024-09-14T11:08:56.034426+0000","last_became_peered":"2024-09-14T11:08:56.034426+0000","last_unstale":"2024-09-14T13:01:33.607989+0000","last_undegraded":"2024-09-14T13:01:33.607989+0000","last_fullsized":"2024-09-14T13:01:33.607989+0000","mapping_epoch":37,"log_start":"267'200","ondisk_log_start":"267'200","created":24,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:08:20.733145+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:08:20.733145+0000","last_clean_scrub_stamp":"2024-09-14T11:08:20.733145+0000","objects_scrubbed":0,"log_size":58,"log_dups_size":200,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:00:24.358863+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":13820112,"num_objects":13,"num_object_clones":0,"num_object_copies":39,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":13,"num_whiteouts":0,"num_read":730,"num_read_kb":100890,"num_write":1095,"num_write_kb":33821,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,4],"acting":[2,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":557,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:58:43.426370+0000","last_change":"2024-09-14T11:08:11.214692+0000","last_active":"2024-09-14T12:58:43.426370+0000","last_peered":"2024-09-14T12:58:43.426370+0000","last_clean":"2024-09-14T12:58:43.426370+0000","last_became_active":"2024-09-14T11:08:08.905736+0000","last_became_peered":"2024-09-14T11:08:08.905736+0000","last_unstale":"2024-09-14T12:58:43.426370+0000","last_undegraded":"2024-09-14T12:58:43.426370+0000","last_fullsized":"2024-09-14T12:58:43.426370+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:08:07.870014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:08:07.870014+0000","last_clean_scrub_stamp":"2024-09-14T11:08:07.870014+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:16:43.551707+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0012835290000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":535,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:58:48.463988+0000","last_change":"2024-09-14T11:08:25.803022+0000","last_active":"2024-09-14T12:58:48.463988+0000","last_peered":"2024-09-14T12:58:48.463988+0000","last_clean":"2024-09-14T12:58:48.463988+0000","last_became_active":"2024-09-14T11:08:25.801554+0000","last_became_peered":"2024-09-14T11:08:25.801554+0000","last_unstale":"2024-09-14T12:58:48.463988+0000","last_undegraded":"2024-09-14T12:58:48.463988+0000","last_fullsized":"2024-09-14T12:58:48.463988+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:08:24.757170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:08:24.757170+0000","last_clean_scrub_stamp":"2024-09-14T11:08:24.757170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:30:31.481284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"267'392","reported_seq":1169,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:01:40.563995+0000","last_change":"2024-09-14T11:08:27.836312+0000","last_active":"2024-09-14T13:01:40.563995+0000","last_peered":"2024-09-14T13:01:40.563995+0000","last_clean":"2024-09-14T13:01:40.563995+0000","last_became_active":"2024-09-14T11:08:27.831653+0000","last_became_peered":"2024-09-14T11:08:27.831653+0000","last_unstale":"2024-09-14T13:01:40.563995+0000","last_undegraded":"2024-09-14T13:01:40.563995+0000","last_fullsized":"2024-09-14T13:01:40.563995+0000","mapping_epoch":30,"log_start":"267'300","ondisk_log_start":"267'300","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:08:26.771628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:08:26.771628+0000","last_clean_scrub_stamp":"2024-09-14T11:08:26.771628+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":300,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:26:55.360414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":48790,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":583,"num_read_kb":815,"num_write":328,"num_write_kb":91,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":525,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:58:58.466673+0000","last_change":"2024-09-14T11:08:29.826424+0000","last_active":"2024-09-14T12:58:58.466673+0000","last_peered":"2024-09-14T12:58:58.466673+0000","last_clean":"2024-09-14T12:58:58.466673+0000","last_became_active":"2024-09-14T11:08:29.825186+0000","last_became_peered":"2024-09-14T11:08:29.825186+0000","last_unstale":"2024-09-14T12:58:58.466673+0000","last_undegraded":"2024-09-14T12:58:58.466673+0000","last_fullsized":"2024-09-14T12:58:58.466673+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:08:28.783586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:08:28.783586+0000","last_clean_scrub_stamp":"2024-09-14T11:08:28.783586+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:49:23.866313+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.d","version":"267'138","reported_seq":663,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:58:48.045619+0000","last_change":"2024-09-14T11:08:31.838408+0000","last_active":"2024-09-14T12:58:48.045619+0000","last_peered":"2024-09-14T12:58:48.045619+0000","last_clean":"2024-09-14T12:58:48.045619+0000","last_became_active":"2024-09-14T11:08:31.837649+0000","last_became_peered":"2024-09-14T11:08:31.837649+0000","last_unstale":"2024-09-14T12:58:48.045619+0000","last_undegraded":"2024-09-14T12:58:48.045619+0000","last_fullsized":"2024-09-14T12:58:48.045619+0000","mapping_epoch":34,"log_start":"267'100","ondisk_log_start":"267'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:08:30.789404+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:08:30.789404+0000","last_clean_scrub_stamp":"2024-09-14T11:08:30.789404+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":100,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:22:41.759152+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":204,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":124,"num_read_kb":124,"num_write":321,"num_write_kb":75,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.1f","version":"267'141","reported_seq":733,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:00:21.741622+0000","last_change":"2024-09-14T11:08:31.854083+0000","last_active":"2024-09-14T13:00:21.741622+0000","last_peered":"2024-09-14T13:00:21.741622+0000","last_clean":"2024-09-14T13:00:21.741622+0000","last_became_active":"2024-09-14T11:08:31.849681+0000","last_became_peered":"2024-09-14T11:08:31.849681+0000","last_unstale":"2024-09-14T13:00:21.741622+0000","last_undegraded":"2024-09-14T13:00:21.741622+0000","last_fullsized":"2024-09-14T13:00:21.741622+0000","mapping_epoch":34,"log_start":"267'100","ondisk_log_start":"267'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:08:30.789404+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:08:30.789404+0000","last_clean_scrub_stamp":"2024-09-14T11:08:30.789404+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":100,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:48:25.310770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":202,"num_read_kb":202,"num_write":327,"num_write_kb":74,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.13","version":"267'450","reported_seq":2149,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:00:11.323966+0000","last_change":"2024-09-14T11:08:23.807515+0000","last_active":"2024-09-14T13:00:11.323966+0000","last_peered":"2024-09-14T13:00:11.323966+0000","last_clean":"2024-09-14T13:00:11.323966+0000","last_became_active":"2024-09-14T11:08:23.806746+0000","last_became_peered":"2024-09-14T11:08:23.806746+0000","last_unstale":"2024-09-14T13:00:11.323966+0000","last_undegraded":"2024-09-14T13:00:11.323966+0000","last_fullsized":"2024-09-14T13:00:11.323966+0000","mapping_epoch":26,"log_start":"267'400","ondisk_log_start":"267'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:08:22.750609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:08:22.750609+0000","last_clean_scrub_stamp":"2024-09-14T11:08:22.750609+0000","objects_scrubbed":0,"log_size":50,"log_dups_size":400,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:59:49.178094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2482,"num_read_kb":2367,"num_write":499,"num_write_kb":86,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.14","version":"267'190","reported_seq":813,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:59:12.831154+0000","last_change":"2024-09-14T11:08:56.029416+0000","last_active":"2024-09-14T12:59:12.831154+0000","last_peered":"2024-09-14T12:59:12.831154+0000","last_clean":"2024-09-14T12:59:12.831154+0000","last_became_active":"2024-09-14T11:08:56.028924+0000","last_became_peered":"2024-09-14T11:08:56.028924+0000","last_unstale":"2024-09-14T12:59:12.831154+0000","last_undegraded":"2024-09-14T12:59:12.831154+0000","last_fullsized":"2024-09-14T12:59:12.831154+0000","mapping_epoch":37,"log_start":"267'100","ondisk_log_start":"267'100","created":24,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:08:20.733145+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:08:20.733145+0000","last_clean_scrub_stamp":"2024-09-14T11:08:20.733145+0000","objects_scrubbed":0,"log_size":90,"log_dups_size":100,"ondisk_log_size":90,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:13:29.739250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5594740,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":484,"num_read_kb":9162,"num_write":887,"num_write_kb":17219,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7,6],"acting":[2,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":525,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:58:08.453389+0000","last_change":"2024-09-14T11:08:25.807119+0000","last_active":"2024-09-14T12:58:08.453389+0000","last_peered":"2024-09-14T12:58:08.453389+0000","last_clean":"2024-09-14T12:58:08.453389+0000","last_became_active":"2024-09-14T11:08:25.806778+0000","last_became_peered":"2024-09-14T11:08:25.806778+0000","last_unstale":"2024-09-14T12:58:08.453389+0000","last_undegraded":"2024-09-14T12:58:08.453389+0000","last_fullsized":"2024-09-14T12:58:08.453389+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:08:24.757170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:08:24.757170+0000","last_clean_scrub_stamp":"2024-09-14T11:08:24.757170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:11:05.830604+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.11","version":"267'189","reported_seq":817,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:00:28.488041+0000","last_change":"2024-09-14T11:08:27.803446+0000","last_active":"2024-09-14T13:00:28.488041+0000","last_peered":"2024-09-14T13:00:28.488041+0000","last_clean":"2024-09-14T13:00:28.488041+0000","last_became_active":"2024-09-14T11:08:27.802742+0000","last_became_peered":"2024-09-14T11:08:27.802742+0000","last_unstale":"2024-09-14T13:00:28.488041+0000","last_undegraded":"2024-09-14T13:00:28.488041+0000","last_fullsized":"2024-09-14T13:00:28.488041+0000","mapping_epoch":30,"log_start":"264'100","ondisk_log_start":"264'100","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:08:26.771628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:08:26.771628+0000","last_clean_scrub_stamp":"2024-09-14T11:08:26.771628+0000","objects_scrubbed":0,"log_size":89,"log_dups_size":100,"ondisk_log_size":89,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:28:41.473997+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16980,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":257,"num_read_kb":338,"num_write":148,"num_write_kb":27,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":519,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:58:13.455830+0000","last_change":"2024-09-14T11:08:29.833602+0000","last_active":"2024-09-14T12:58:13.455830+0000","last_peered":"2024-09-14T12:58:13.455830+0000","last_clean":"2024-09-14T12:58:13.455830+0000","last_became_active":"2024-09-14T11:08:29.832866+0000","last_became_peered":"2024-09-14T11:08:29.832866+0000","last_unstale":"2024-09-14T12:58:13.455830+0000","last_undegraded":"2024-09-14T12:58:13.455830+0000","last_fullsized":"2024-09-14T12:58:13.455830+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:08:28.783586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:08:28.783586+0000","last_clean_scrub_stamp":"2024-09-14T11:08:28.783586+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:47:19.171157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1e","version":"267'153","reported_seq":732,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:00:21.213723+0000","last_change":"2024-09-14T11:08:31.838160+0000","last_active":"2024-09-14T13:00:21.213723+0000","last_peered":"2024-09-14T13:00:21.213723+0000","last_clean":"2024-09-14T13:00:21.213723+0000","last_became_active":"2024-09-14T11:08:31.837431+0000","last_became_peered":"2024-09-14T11:08:31.837431+0000","last_unstale":"2024-09-14T13:00:21.213723+0000","last_undegraded":"2024-09-14T13:00:21.213723+0000","last_fullsized":"2024-09-14T13:00:21.213723+0000","mapping_epoch":34,"log_start":"267'100","ondisk_log_start":"267'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:08:30.789404+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:08:30.789404+0000","last_clean_scrub_stamp":"2024-09-14T11:08:30.789404+0000","objects_scrubbed":0,"log_size":53,"log_dups_size":100,"ondisk_log_size":53,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:03:00.723612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":449,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":316,"num_read_kb":262,"num_write":344,"num_write_kb":81,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.12","version":"267'842","reported_seq":2487,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:00:18.885098+0000","last_change":"2024-09-14T11:08:23.805988+0000","last_active":"2024-09-14T13:00:18.885098+0000","last_peered":"2024-09-14T13:00:18.885098+0000","last_clean":"2024-09-14T13:00:18.885098+0000","last_became_active":"2024-09-14T11:08:23.805773+0000","last_became_peered":"2024-09-14T11:08:23.805773+0000","last_unstale":"2024-09-14T13:00:18.885098+0000","last_undegraded":"2024-09-14T13:00:18.885098+0000","last_fullsized":"2024-09-14T13:00:18.885098+0000","mapping_epoch":26,"log_start":"267'800","ondisk_log_start":"267'800","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:08:22.750609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:08:22.750609+0000","last_clean_scrub_stamp":"2024-09-14T11:08:22.750609+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":800,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:04:02.649234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":4345,"num_read_kb":3935,"num_write":1136,"num_write_kb":447,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"267'272","reported_seq":985,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:59:32.846092+0000","last_change":"2024-09-14T11:08:21.830655+0000","last_active":"2024-09-14T12:59:32.846092+0000","last_peered":"2024-09-14T12:59:32.846092+0000","last_clean":"2024-09-14T12:59:32.846092+0000","last_became_active":"2024-09-14T11:08:21.829412+0000","last_became_peered":"2024-09-14T11:08:21.829412+0000","last_unstale":"2024-09-14T12:59:32.846092+0000","last_undegraded":"2024-09-14T12:59:32.846092+0000","last_fullsized":"2024-09-14T12:59:32.846092+0000","mapping_epoch":24,"log_start":"267'200","ondisk_log_start":"267'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:08:20.733145+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:08:20.733145+0000","last_clean_scrub_stamp":"2024-09-14T11:08:20.733145+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":200,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:31:08.044755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":18530687,"num_objects":17,"num_object_clones":0,"num_object_copies":51,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":17,"num_whiteouts":0,"num_read":832,"num_read_kb":41720,"num_write":1207,"num_write_kb":52852,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,6],"acting":[7,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":527,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:58:08.454944+0000","last_change":"2024-09-14T11:08:25.800314+0000","last_active":"2024-09-14T12:58:08.454944+0000","last_peered":"2024-09-14T12:58:08.454944+0000","last_clean":"2024-09-14T12:58:08.454944+0000","last_became_active":"2024-09-14T11:08:25.799473+0000","last_became_peered":"2024-09-14T11:08:25.799473+0000","last_unstale":"2024-09-14T12:58:08.454944+0000","last_undegraded":"2024-09-14T12:58:08.454944+0000","last_fullsized":"2024-09-14T12:58:08.454944+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:08:24.757170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:08:24.757170+0000","last_clean_scrub_stamp":"2024-09-14T11:08:24.757170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:39:41.634975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"267'93","reported_seq":645,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:59:05.331375+0000","last_change":"2024-09-14T11:08:27.824140+0000","last_active":"2024-09-14T12:59:05.331375+0000","last_peered":"2024-09-14T12:59:05.331375+0000","last_clean":"2024-09-14T12:59:05.331375+0000","last_became_active":"2024-09-14T11:08:27.822933+0000","last_became_peered":"2024-09-14T11:08:27.822933+0000","last_unstale":"2024-09-14T12:59:05.331375+0000","last_undegraded":"2024-09-14T12:59:05.331375+0000","last_fullsized":"2024-09-14T12:59:05.331375+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:08:26.771628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:08:26.771628+0000","last_clean_scrub_stamp":"2024-09-14T11:08:26.771628+0000","objects_scrubbed":0,"log_size":93,"log_dups_size":0,"ondisk_log_size":93,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:18:09.511324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":83,"num_read_kb":77,"num_write":62,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":520,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:58:12.827302+0000","last_change":"2024-09-14T11:08:29.839496+0000","last_active":"2024-09-14T12:58:12.827302+0000","last_peered":"2024-09-14T12:58:12.827302+0000","last_clean":"2024-09-14T12:58:12.827302+0000","last_became_active":"2024-09-14T11:08:29.838784+0000","last_became_peered":"2024-09-14T11:08:29.838784+0000","last_unstale":"2024-09-14T12:58:12.827302+0000","last_undegraded":"2024-09-14T12:58:12.827302+0000","last_fullsized":"2024-09-14T12:58:12.827302+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:08:28.783586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:08:28.783586+0000","last_clean_scrub_stamp":"2024-09-14T11:08:28.783586+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:24:04.303207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1d","version":"267'173","reported_seq":722,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:00:18.909877+0000","last_change":"2024-09-14T11:08:31.835747+0000","last_active":"2024-09-14T13:00:18.909877+0000","last_peered":"2024-09-14T13:00:18.909877+0000","last_clean":"2024-09-14T13:00:18.909877+0000","last_became_active":"2024-09-14T11:08:31.835061+0000","last_became_peered":"2024-09-14T11:08:31.835061+0000","last_unstale":"2024-09-14T13:00:18.909877+0000","last_undegraded":"2024-09-14T13:00:18.909877+0000","last_fullsized":"2024-09-14T13:00:18.909877+0000","mapping_epoch":34,"log_start":"267'100","ondisk_log_start":"267'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:08:30.789404+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:08:30.789404+0000","last_clean_scrub_stamp":"2024-09-14T11:08:30.789404+0000","objects_scrubbed":0,"log_size":73,"log_dups_size":100,"ondisk_log_size":73,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:44:11.300438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":257,"num_read_kb":254,"num_write":377,"num_write_kb":108,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"267'371","reported_seq":1937,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:58:55.756948+0000","last_change":"2024-09-14T11:08:23.804035+0000","last_active":"2024-09-14T12:58:55.756948+0000","last_peered":"2024-09-14T12:58:55.756948+0000","last_clean":"2024-09-14T12:58:55.756948+0000","last_became_active":"2024-09-14T11:08:23.803793+0000","last_became_peered":"2024-09-14T11:08:23.803793+0000","last_unstale":"2024-09-14T12:58:55.756948+0000","last_undegraded":"2024-09-14T12:58:55.756948+0000","last_fullsized":"2024-09-14T12:58:55.756948+0000","mapping_epoch":26,"log_start":"267'300","ondisk_log_start":"267'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:08:22.750609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:08:22.750609+0000","last_clean_scrub_stamp":"2024-09-14T11:08:22.750609+0000","objects_scrubbed":0,"log_size":71,"log_dups_size":300,"ondisk_log_size":71,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:22:29.624328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":2158,"num_read_kb":2067,"num_write":426,"num_write_kb":77,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"267'195","reported_seq":845,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:59:33.055545+0000","last_change":"2024-09-14T11:08:21.797622+0000","last_active":"2024-09-14T12:59:33.055545+0000","last_peered":"2024-09-14T12:59:33.055545+0000","last_clean":"2024-09-14T12:59:33.055545+0000","last_became_active":"2024-09-14T11:08:21.796544+0000","last_became_peered":"2024-09-14T11:08:21.796544+0000","last_unstale":"2024-09-14T12:59:33.055545+0000","last_undegraded":"2024-09-14T12:59:33.055545+0000","last_fullsized":"2024-09-14T12:59:33.055545+0000","mapping_epoch":24,"log_start":"267'100","ondisk_log_start":"267'100","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:08:20.733145+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:08:20.733145+0000","last_clean_scrub_stamp":"2024-09-14T11:08:20.733145+0000","objects_scrubbed":0,"log_size":95,"log_dups_size":100,"ondisk_log_size":95,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:27:03.875493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":13958202,"num_objects":9,"num_object_clones":0,"num_object_copies":27,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":499,"num_read_kb":19523,"num_write":840,"num_write_kb":34711,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,1],"acting":[5,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":528,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:58:07.825909+0000","last_change":"2024-09-14T11:08:25.812807+0000","last_active":"2024-09-14T12:58:07.825909+0000","last_peered":"2024-09-14T12:58:07.825909+0000","last_clean":"2024-09-14T12:58:07.825909+0000","last_became_active":"2024-09-14T11:08:25.812065+0000","last_became_peered":"2024-09-14T11:08:25.812065+0000","last_unstale":"2024-09-14T12:58:07.825909+0000","last_undegraded":"2024-09-14T12:58:07.825909+0000","last_fullsized":"2024-09-14T12:58:07.825909+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:08:24.757170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:08:24.757170+0000","last_clean_scrub_stamp":"2024-09-14T11:08:24.757170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:55:26.884251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.13","version":"267'221","reported_seq":865,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:00:28.488111+0000","last_change":"2024-09-14T11:08:27.804649+0000","last_active":"2024-09-14T13:00:28.488111+0000","last_peered":"2024-09-14T13:00:28.488111+0000","last_clean":"2024-09-14T13:00:28.488111+0000","last_became_active":"2024-09-14T11:08:27.803857+0000","last_became_peered":"2024-09-14T11:08:27.803857+0000","last_unstale":"2024-09-14T13:00:28.488111+0000","last_undegraded":"2024-09-14T13:00:28.488111+0000","last_fullsized":"2024-09-14T13:00:28.488111+0000","mapping_epoch":30,"log_start":"267'200","ondisk_log_start":"267'200","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:08:26.771628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:08:26.771628+0000","last_clean_scrub_stamp":"2024-09-14T11:08:26.771628+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":200,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:04:38.254088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":26644,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":312,"num_read_kb":420,"num_write":186,"num_write_kb":45,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":518,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:58:13.419845+0000","last_change":"2024-09-14T11:08:29.831255+0000","last_active":"2024-09-14T12:58:13.419845+0000","last_peered":"2024-09-14T12:58:13.419845+0000","last_clean":"2024-09-14T12:58:13.419845+0000","last_became_active":"2024-09-14T11:08:29.830498+0000","last_became_peered":"2024-09-14T11:08:29.830498+0000","last_unstale":"2024-09-14T12:58:13.419845+0000","last_undegraded":"2024-09-14T12:58:13.419845+0000","last_fullsized":"2024-09-14T12:58:13.419845+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:08:28.783586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:08:28.783586+0000","last_clean_scrub_stamp":"2024-09-14T11:08:28.783586+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:03:30.379314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.1c","version":"267'123","reported_seq":663,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:00:18.860887+0000","last_change":"2024-09-14T11:08:31.830626+0000","last_active":"2024-09-14T13:00:18.860887+0000","last_peered":"2024-09-14T13:00:18.860887+0000","last_clean":"2024-09-14T13:00:18.860887+0000","last_became_active":"2024-09-14T11:08:31.829826+0000","last_became_peered":"2024-09-14T11:08:31.829826+0000","last_unstale":"2024-09-14T13:00:18.860887+0000","last_undegraded":"2024-09-14T13:00:18.860887+0000","last_fullsized":"2024-09-14T13:00:18.860887+0000","mapping_epoch":34,"log_start":"267'100","ondisk_log_start":"267'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:08:30.789404+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:08:30.789404+0000","last_clean_scrub_stamp":"2024-09-14T11:08:30.789404+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":100,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:25:54.911452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":861,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":146,"num_read_kb":140,"num_write":284,"num_write_kb":67,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"267'865","reported_seq":2531,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:59:18.397352+0000","last_change":"2024-09-14T11:08:23.781946+0000","last_active":"2024-09-14T12:59:18.397352+0000","last_peered":"2024-09-14T12:59:18.397352+0000","last_clean":"2024-09-14T12:59:18.397352+0000","last_became_active":"2024-09-14T11:08:23.781565+0000","last_became_peered":"2024-09-14T11:08:23.781565+0000","last_unstale":"2024-09-14T12:59:18.397352+0000","last_undegraded":"2024-09-14T12:59:18.397352+0000","last_fullsized":"2024-09-14T12:59:18.397352+0000","mapping_epoch":26,"log_start":"267'800","ondisk_log_start":"267'800","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:08:22.750609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:08:22.750609+0000","last_clean_scrub_stamp":"2024-09-14T11:08:22.750609+0000","objects_scrubbed":0,"log_size":65,"log_dups_size":800,"ondisk_log_size":65,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:59:20.533859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":4353,"num_read_kb":3923,"num_write":1159,"num_write_kb":442,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"267'270","reported_seq":947,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:59:33.252975+0000","last_change":"2024-09-14T11:08:21.781005+0000","last_active":"2024-09-14T12:59:33.252975+0000","last_peered":"2024-09-14T12:59:33.252975+0000","last_clean":"2024-09-14T12:59:33.252975+0000","last_became_active":"2024-09-14T11:08:21.780624+0000","last_became_peered":"2024-09-14T11:08:21.780624+0000","last_unstale":"2024-09-14T12:59:33.252975+0000","last_undegraded":"2024-09-14T12:59:33.252975+0000","last_fullsized":"2024-09-14T12:59:33.252975+0000","mapping_epoch":24,"log_start":"267'200","ondisk_log_start":"267'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:08:20.733145+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:08:20.733145+0000","last_clean_scrub_stamp":"2024-09-14T11:08:20.733145+0000","objects_scrubbed":0,"log_size":70,"log_dups_size":200,"ondisk_log_size":70,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:08:38.775663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9437199,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":684,"num_read_kb":19614,"num_write":1222,"num_write_kb":48256,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,3],"acting":[0,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":526,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:58:08.418774+0000","last_change":"2024-09-14T11:08:25.815688+0000","last_active":"2024-09-14T12:58:08.418774+0000","last_peered":"2024-09-14T12:58:08.418774+0000","last_clean":"2024-09-14T12:58:08.418774+0000","last_became_active":"2024-09-14T11:08:25.812705+0000","last_became_peered":"2024-09-14T11:08:25.812705+0000","last_unstale":"2024-09-14T12:58:08.418774+0000","last_undegraded":"2024-09-14T12:58:08.418774+0000","last_fullsized":"2024-09-14T12:58:08.418774+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:08:24.757170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:08:24.757170+0000","last_clean_scrub_stamp":"2024-09-14T11:08:24.757170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:14:07.091473+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.12","version":"267'165","reported_seq":782,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:00:27.858784+0000","last_change":"2024-09-14T11:08:27.828831+0000","last_active":"2024-09-14T13:00:27.858784+0000","last_peered":"2024-09-14T13:00:27.858784+0000","last_clean":"2024-09-14T13:00:27.858784+0000","last_became_active":"2024-09-14T11:08:27.828095+0000","last_became_peered":"2024-09-14T11:08:27.828095+0000","last_unstale":"2024-09-14T13:00:27.858784+0000","last_undegraded":"2024-09-14T13:00:27.858784+0000","last_fullsized":"2024-09-14T13:00:27.858784+0000","mapping_epoch":30,"log_start":"267'100","ondisk_log_start":"267'100","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:08:26.771628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:08:26.771628+0000","last_clean_scrub_stamp":"2024-09-14T11:08:26.771628+0000","objects_scrubbed":0,"log_size":65,"log_dups_size":100,"ondisk_log_size":65,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:20:07.611701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12385,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":216,"num_read_kb":264,"num_write":122,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":524,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:58:13.451397+0000","last_change":"2024-09-14T11:08:29.820892+0000","last_active":"2024-09-14T12:58:13.451397+0000","last_peered":"2024-09-14T12:58:13.451397+0000","last_clean":"2024-09-14T12:58:13.451397+0000","last_became_active":"2024-09-14T11:08:29.820211+0000","last_became_peered":"2024-09-14T11:08:29.820211+0000","last_unstale":"2024-09-14T12:58:13.451397+0000","last_undegraded":"2024-09-14T12:58:13.451397+0000","last_fullsized":"2024-09-14T12:58:13.451397+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:08:28.783586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:08:28.783586+0000","last_clean_scrub_stamp":"2024-09-14T11:08:28.783586+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:44:35.393022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"267'407","reported_seq":1915,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:58:53.428747+0000","last_change":"2024-09-14T11:08:23.812883+0000","last_active":"2024-09-14T12:58:53.428747+0000","last_peered":"2024-09-14T12:58:53.428747+0000","last_clean":"2024-09-14T12:58:53.428747+0000","last_became_active":"2024-09-14T11:08:23.812148+0000","last_became_peered":"2024-09-14T11:08:23.812148+0000","last_unstale":"2024-09-14T12:58:53.428747+0000","last_undegraded":"2024-09-14T12:58:53.428747+0000","last_fullsized":"2024-09-14T12:58:53.428747+0000","mapping_epoch":26,"log_start":"267'300","ondisk_log_start":"267'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:08:22.750609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:08:22.750609+0000","last_clean_scrub_stamp":"2024-09-14T11:08:22.750609+0000","objects_scrubbed":0,"log_size":107,"log_dups_size":300,"ondisk_log_size":107,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:08:40.793127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2189,"num_read_kb":2068,"num_write":470,"num_write_kb":97,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"267'245","reported_seq":1141,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:59:33.474826+0000","last_change":"2024-09-14T11:08:21.779317+0000","last_active":"2024-09-14T12:59:33.474826+0000","last_peered":"2024-09-14T12:59:33.474826+0000","last_clean":"2024-09-14T12:59:33.474826+0000","last_became_active":"2024-09-14T11:08:21.778733+0000","last_became_peered":"2024-09-14T11:08:21.778733+0000","last_unstale":"2024-09-14T12:59:33.474826+0000","last_undegraded":"2024-09-14T12:59:33.474826+0000","last_fullsized":"2024-09-14T12:59:33.474826+0000","mapping_epoch":24,"log_start":"267'200","ondisk_log_start":"267'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:08:20.733145+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:08:20.733145+0000","last_clean_scrub_stamp":"2024-09-14T11:08:20.733145+0000","objects_scrubbed":0,"log_size":45,"log_dups_size":200,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:00:30.423894+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1056249,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1355,"num_read_kb":10917,"num_write":1155,"num_write_kb":41642,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":540,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:58:53.242713+0000","last_change":"2024-09-14T11:08:25.800737+0000","last_active":"2024-09-14T12:58:53.242713+0000","last_peered":"2024-09-14T12:58:53.242713+0000","last_clean":"2024-09-14T12:58:53.242713+0000","last_became_active":"2024-09-14T11:08:25.799108+0000","last_became_peered":"2024-09-14T11:08:25.799108+0000","last_unstale":"2024-09-14T12:58:53.242713+0000","last_undegraded":"2024-09-14T12:58:53.242713+0000","last_fullsized":"2024-09-14T12:58:53.242713+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:08:24.757170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:08:24.757170+0000","last_clean_scrub_stamp":"2024-09-14T11:08:24.757170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:38:33.841462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1d","version":"267'244","reported_seq":911,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:01:40.556399+0000","last_change":"2024-09-14T11:08:27.831458+0000","last_active":"2024-09-14T13:01:40.556399+0000","last_peered":"2024-09-14T13:01:40.556399+0000","last_clean":"2024-09-14T13:01:40.556399+0000","last_became_active":"2024-09-14T11:08:27.830985+0000","last_became_peered":"2024-09-14T11:08:27.830985+0000","last_unstale":"2024-09-14T13:01:40.556399+0000","last_undegraded":"2024-09-14T13:01:40.556399+0000","last_fullsized":"2024-09-14T13:01:40.556399+0000","mapping_epoch":30,"log_start":"267'200","ondisk_log_start":"267'200","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:08:26.771628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:08:26.771628+0000","last_clean_scrub_stamp":"2024-09-14T11:08:26.771628+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":200,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:41:33.796426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":37874,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":369,"num_read_kb":532,"num_write":248,"num_write_kb":156,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":516,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:58:33.042183+0000","last_change":"2024-09-14T11:08:29.835460+0000","last_active":"2024-09-14T12:58:33.042183+0000","last_peered":"2024-09-14T12:58:33.042183+0000","last_clean":"2024-09-14T12:58:33.042183+0000","last_became_active":"2024-09-14T11:08:29.834723+0000","last_became_peered":"2024-09-14T11:08:29.834723+0000","last_unstale":"2024-09-14T12:58:33.042183+0000","last_undegraded":"2024-09-14T12:58:33.042183+0000","last_fullsized":"2024-09-14T12:58:33.042183+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:08:28.783586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:08:28.783586+0000","last_clean_scrub_stamp":"2024-09-14T11:08:28.783586+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:14:47.793017+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.13","version":"267'169","reported_seq":705,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:00:21.576865+0000","last_change":"2024-09-14T11:08:31.838236+0000","last_active":"2024-09-14T13:00:21.576865+0000","last_peered":"2024-09-14T13:00:21.576865+0000","last_clean":"2024-09-14T13:00:21.576865+0000","last_became_active":"2024-09-14T11:08:31.832337+0000","last_became_peered":"2024-09-14T11:08:31.832337+0000","last_unstale":"2024-09-14T13:00:21.576865+0000","last_undegraded":"2024-09-14T13:00:21.576865+0000","last_fullsized":"2024-09-14T13:00:21.576865+0000","mapping_epoch":34,"log_start":"267'100","ondisk_log_start":"267'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:08:30.789404+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:08:30.789404+0000","last_clean_scrub_stamp":"2024-09-14T11:08:30.789404+0000","objects_scrubbed":0,"log_size":69,"log_dups_size":100,"ondisk_log_size":69,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:59:18.877729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":643,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":222,"num_read_kb":226,"num_write":392,"num_write_kb":102,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"267'412","reported_seq":2030,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:00:18.882268+0000","last_change":"2024-09-14T11:08:23.800932+0000","last_active":"2024-09-14T13:00:18.882268+0000","last_peered":"2024-09-14T13:00:18.882268+0000","last_clean":"2024-09-14T13:00:18.882268+0000","last_became_active":"2024-09-14T11:08:23.800615+0000","last_became_peered":"2024-09-14T11:08:23.800615+0000","last_unstale":"2024-09-14T13:00:18.882268+0000","last_undegraded":"2024-09-14T13:00:18.882268+0000","last_fullsized":"2024-09-14T13:00:18.882268+0000","mapping_epoch":26,"log_start":"267'400","ondisk_log_start":"267'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:08:22.750609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:08:22.750609+0000","last_clean_scrub_stamp":"2024-09-14T11:08:22.750609+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":400,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:50:24.635644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2239,"num_read_kb":2142,"num_write":466,"num_write_kb":81,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"267'237","reported_seq":915,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:57:23.443592+0000","last_change":"2024-09-14T11:08:56.037070+0000","last_active":"2024-09-14T12:57:23.443592+0000","last_peered":"2024-09-14T12:57:23.443592+0000","last_clean":"2024-09-14T12:57:23.443592+0000","last_became_active":"2024-09-14T11:08:56.036673+0000","last_became_peered":"2024-09-14T11:08:56.036673+0000","last_unstale":"2024-09-14T12:57:23.443592+0000","last_undegraded":"2024-09-14T12:57:23.443592+0000","last_fullsized":"2024-09-14T12:57:23.443592+0000","mapping_epoch":37,"log_start":"267'200","ondisk_log_start":"267'200","created":24,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:08:20.733145+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:08:20.733145+0000","last_clean_scrub_stamp":"2024-09-14T11:08:20.733145+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":200,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:53:45.772203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":13956195,"num_objects":9,"num_object_clones":0,"num_object_copies":27,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":561,"num_read_kb":38876,"num_write":1046,"num_write_kb":52722,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,4],"acting":[1,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1f","version":"36'3","reported_seq":1007,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:01:40.257081+0000","last_change":"2024-09-14T11:08:25.812880+0000","last_active":"2024-09-14T13:01:40.257081+0000","last_peered":"2024-09-14T13:01:40.257081+0000","last_clean":"2024-09-14T13:01:40.257081+0000","last_became_active":"2024-09-14T11:08:25.812070+0000","last_became_peered":"2024-09-14T11:08:25.812070+0000","last_unstale":"2024-09-14T13:01:40.257081+0000","last_undegraded":"2024-09-14T13:01:40.257081+0000","last_fullsized":"2024-09-14T13:01:40.257081+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:08:24.757170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:08:24.757170+0000","last_clean_scrub_stamp":"2024-09-14T11:08:24.757170+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:17:44.680400+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":470,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":716,"num_read_kb":714,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1c","version":"267'278","reported_seq":928,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:00:57.866110+0000","last_change":"2024-09-14T11:08:27.839908+0000","last_active":"2024-09-14T13:00:57.866110+0000","last_peered":"2024-09-14T13:00:57.866110+0000","last_clean":"2024-09-14T13:00:57.866110+0000","last_became_active":"2024-09-14T11:08:27.839087+0000","last_became_peered":"2024-09-14T11:08:27.839087+0000","last_unstale":"2024-09-14T13:00:57.866110+0000","last_undegraded":"2024-09-14T13:00:57.866110+0000","last_fullsized":"2024-09-14T13:00:57.866110+0000","mapping_epoch":30,"log_start":"267'200","ondisk_log_start":"267'200","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:08:26.771628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:08:26.771628+0000","last_clean_scrub_stamp":"2024-09-14T11:08:26.771628+0000","objects_scrubbed":0,"log_size":78,"log_dups_size":200,"ondisk_log_size":78,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:00:36.558492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":105945,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":422,"num_read_kb":775,"num_write":312,"num_write_kb":214,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":514,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:58:33.459006+0000","last_change":"2024-09-14T11:08:29.829340+0000","last_active":"2024-09-14T12:58:33.459006+0000","last_peered":"2024-09-14T12:58:33.459006+0000","last_clean":"2024-09-14T12:58:33.459006+0000","last_became_active":"2024-09-14T11:08:29.828451+0000","last_became_peered":"2024-09-14T11:08:29.828451+0000","last_unstale":"2024-09-14T12:58:33.459006+0000","last_undegraded":"2024-09-14T12:58:33.459006+0000","last_fullsized":"2024-09-14T12:58:33.459006+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:08:28.783586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:08:28.783586+0000","last_clean_scrub_stamp":"2024-09-14T11:08:28.783586+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:33:41.255469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.12","version":"267'201","reported_seq":1100,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:00:21.559424+0000","last_change":"2024-09-14T11:08:31.855543+0000","last_active":"2024-09-14T13:00:21.559424+0000","last_peered":"2024-09-14T13:00:21.559424+0000","last_clean":"2024-09-14T13:00:21.559424+0000","last_became_active":"2024-09-14T11:08:31.854650+0000","last_became_peered":"2024-09-14T11:08:31.854650+0000","last_unstale":"2024-09-14T13:00:21.559424+0000","last_undegraded":"2024-09-14T13:00:21.559424+0000","last_fullsized":"2024-09-14T13:00:21.559424+0000","mapping_epoch":34,"log_start":"267'100","ondisk_log_start":"267'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:08:30.789404+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:08:30.789404+0000","last_clean_scrub_stamp":"2024-09-14T11:08:30.789404+0000","objects_scrubbed":0,"log_size":101,"log_dups_size":100,"ondisk_log_size":101,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:48:10.230125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1218,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":620,"num_read_kb":614,"num_write":555,"num_write_kb":141,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1d","version":"267'642","reported_seq":2438,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:00:21.249855+0000","last_change":"2024-09-14T11:08:23.779484+0000","last_active":"2024-09-14T13:00:21.249855+0000","last_peered":"2024-09-14T13:00:21.249855+0000","last_clean":"2024-09-14T13:00:21.249855+0000","last_became_active":"2024-09-14T11:08:23.779099+0000","last_became_peered":"2024-09-14T11:08:23.779099+0000","last_unstale":"2024-09-14T13:00:21.249855+0000","last_undegraded":"2024-09-14T13:00:21.249855+0000","last_fullsized":"2024-09-14T13:00:21.249855+0000","mapping_epoch":26,"log_start":"267'600","ondisk_log_start":"267'600","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:08:22.750609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:08:22.750609+0000","last_clean_scrub_stamp":"2024-09-14T11:08:22.750609+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":600,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:46:50.857933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3438,"num_read_kb":3161,"num_write":830,"num_write_kb":293,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"267'240","reported_seq":1020,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:58:23.224184+0000","last_change":"2024-09-14T11:08:21.824714+0000","last_active":"2024-09-14T12:58:23.224184+0000","last_peered":"2024-09-14T12:58:23.224184+0000","last_clean":"2024-09-14T12:58:23.224184+0000","last_became_active":"2024-09-14T11:08:21.822349+0000","last_became_peered":"2024-09-14T11:08:21.822349+0000","last_unstale":"2024-09-14T12:58:23.224184+0000","last_undegraded":"2024-09-14T12:58:23.224184+0000","last_fullsized":"2024-09-14T12:58:23.224184+0000","mapping_epoch":24,"log_start":"267'200","ondisk_log_start":"267'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:08:20.733145+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:08:20.733145+0000","last_clean_scrub_stamp":"2024-09-14T11:08:20.733145+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":200,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:37:27.709472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9045724,"num_objects":9,"num_object_clones":0,"num_object_copies":27,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":1326,"num_read_kb":40981,"num_write":1067,"num_write_kb":33045,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,5],"acting":[4,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":526,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:58:28.225640+0000","last_change":"2024-09-14T11:08:25.808861+0000","last_active":"2024-09-14T12:58:28.225640+0000","last_peered":"2024-09-14T12:58:28.225640+0000","last_clean":"2024-09-14T12:58:28.225640+0000","last_became_active":"2024-09-14T11:08:25.807820+0000","last_became_peered":"2024-09-14T11:08:25.807820+0000","last_unstale":"2024-09-14T12:58:28.225640+0000","last_undegraded":"2024-09-14T12:58:28.225640+0000","last_fullsized":"2024-09-14T12:58:28.225640+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:08:24.757170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:08:24.757170+0000","last_clean_scrub_stamp":"2024-09-14T11:08:24.757170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:21:06.537600+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1f","version":"267'197","reported_seq":832,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:00:58.494549+0000","last_change":"2024-09-14T11:08:27.799774+0000","last_active":"2024-09-14T13:00:58.494549+0000","last_peered":"2024-09-14T13:00:58.494549+0000","last_clean":"2024-09-14T13:00:58.494549+0000","last_became_active":"2024-09-14T11:08:27.799019+0000","last_became_peered":"2024-09-14T11:08:27.799019+0000","last_unstale":"2024-09-14T13:00:58.494549+0000","last_undegraded":"2024-09-14T13:00:58.494549+0000","last_fullsized":"2024-09-14T13:00:58.494549+0000","mapping_epoch":30,"log_start":"264'100","ondisk_log_start":"264'100","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:08:26.771628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:08:26.771628+0000","last_clean_scrub_stamp":"2024-09-14T11:08:26.771628+0000","objects_scrubbed":0,"log_size":97,"log_dups_size":100,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:29:21.400017+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":15034,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":258,"num_read_kb":328,"num_write":152,"num_write_kb":25,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":525,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:58:48.462484+0000","last_change":"2024-09-14T11:08:29.821376+0000","last_active":"2024-09-14T12:58:48.462484+0000","last_peered":"2024-09-14T12:58:48.462484+0000","last_clean":"2024-09-14T12:58:48.462484+0000","last_became_active":"2024-09-14T11:08:29.820658+0000","last_became_peered":"2024-09-14T11:08:29.820658+0000","last_unstale":"2024-09-14T12:58:48.462484+0000","last_undegraded":"2024-09-14T12:58:48.462484+0000","last_fullsized":"2024-09-14T12:58:48.462484+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:08:28.783586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:08:28.783586+0000","last_clean_scrub_stamp":"2024-09-14T11:08:28.783586+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:41:05.714746+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.11","version":"267'134","reported_seq":664,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:01:40.625798+0000","last_change":"2024-09-14T11:08:31.837211+0000","last_active":"2024-09-14T13:01:40.625798+0000","last_peered":"2024-09-14T13:01:40.625798+0000","last_clean":"2024-09-14T13:01:40.625798+0000","last_became_active":"2024-09-14T11:08:31.836424+0000","last_became_peered":"2024-09-14T11:08:31.836424+0000","last_unstale":"2024-09-14T13:01:40.625798+0000","last_undegraded":"2024-09-14T13:01:40.625798+0000","last_fullsized":"2024-09-14T13:01:40.625798+0000","mapping_epoch":34,"log_start":"267'100","ondisk_log_start":"267'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:08:30.789404+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:08:30.789404+0000","last_clean_scrub_stamp":"2024-09-14T11:08:30.789404+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":100,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:24:20.926458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":383,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":163,"num_read_kb":148,"num_write":342,"num_write_kb":82,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1c","version":"267'437","reported_seq":2094,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:00:21.259107+0000","last_change":"2024-09-14T11:08:23.775989+0000","last_active":"2024-09-14T13:00:21.259107+0000","last_peered":"2024-09-14T13:00:21.259107+0000","last_clean":"2024-09-14T13:00:21.259107+0000","last_became_active":"2024-09-14T11:08:23.775491+0000","last_became_peered":"2024-09-14T11:08:23.775491+0000","last_unstale":"2024-09-14T13:00:21.259107+0000","last_undegraded":"2024-09-14T13:00:21.259107+0000","last_fullsized":"2024-09-14T13:00:21.259107+0000","mapping_epoch":26,"log_start":"267'400","ondisk_log_start":"267'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:08:22.750609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:08:22.750609+0000","last_clean_scrub_stamp":"2024-09-14T11:08:22.750609+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":400,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:48:28.960871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2479,"num_read_kb":2350,"num_write":502,"num_write_kb":107,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"267'217","reported_seq":844,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:58:57.827849+0000","last_change":"2024-09-14T11:08:56.034799+0000","last_active":"2024-09-14T12:58:57.827849+0000","last_peered":"2024-09-14T12:58:57.827849+0000","last_clean":"2024-09-14T12:58:57.827849+0000","last_became_active":"2024-09-14T11:08:56.033894+0000","last_became_peered":"2024-09-14T11:08:56.033894+0000","last_unstale":"2024-09-14T12:58:57.827849+0000","last_undegraded":"2024-09-14T12:58:57.827849+0000","last_fullsized":"2024-09-14T12:58:57.827849+0000","mapping_epoch":37,"log_start":"267'200","ondisk_log_start":"267'200","created":24,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:08:20.733145+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:08:20.733145+0000","last_clean_scrub_stamp":"2024-09-14T11:08:20.733145+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":200,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:50:48.318805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10489866,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":535,"num_read_kb":17888,"num_write":1017,"num_write_kb":32755,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4,7],"acting":[2,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":521,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:58:28.457976+0000","last_change":"2024-09-14T11:08:25.804776+0000","last_active":"2024-09-14T12:58:28.457976+0000","last_peered":"2024-09-14T12:58:28.457976+0000","last_clean":"2024-09-14T12:58:28.457976+0000","last_became_active":"2024-09-14T11:08:25.804388+0000","last_became_peered":"2024-09-14T11:08:25.804388+0000","last_unstale":"2024-09-14T12:58:28.457976+0000","last_undegraded":"2024-09-14T12:58:28.457976+0000","last_fullsized":"2024-09-14T12:58:28.457976+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:08:24.757170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:08:24.757170+0000","last_clean_scrub_stamp":"2024-09-14T11:08:24.757170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:03:59.400683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1e","version":"267'168","reported_seq":761,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:59:08.616998+0000","last_change":"2024-09-14T11:08:27.832039+0000","last_active":"2024-09-14T12:59:08.616998+0000","last_peered":"2024-09-14T12:59:08.616998+0000","last_clean":"2024-09-14T12:59:08.616998+0000","last_became_active":"2024-09-14T11:08:27.830708+0000","last_became_peered":"2024-09-14T11:08:27.830708+0000","last_unstale":"2024-09-14T12:59:08.616998+0000","last_undegraded":"2024-09-14T12:59:08.616998+0000","last_fullsized":"2024-09-14T12:59:08.616998+0000","mapping_epoch":30,"log_start":"267'100","ondisk_log_start":"267'100","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:08:26.771628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:08:26.771628+0000","last_clean_scrub_stamp":"2024-09-14T11:08:26.771628+0000","objects_scrubbed":0,"log_size":68,"log_dups_size":100,"ondisk_log_size":68,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:26:51.532445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":224,"num_read_kb":219,"num_write":208,"num_write_kb":88,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1f","version":"267'766","reported_seq":3154,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:01:40.710554+0000","last_change":"2024-09-14T11:08:29.842740+0000","last_active":"2024-09-14T13:01:40.710554+0000","last_peered":"2024-09-14T13:01:40.710554+0000","last_clean":"2024-09-14T13:01:40.710554+0000","last_became_active":"2024-09-14T11:08:29.840179+0000","last_became_peered":"2024-09-14T11:08:29.840179+0000","last_unstale":"2024-09-14T13:01:40.710554+0000","last_undegraded":"2024-09-14T13:01:40.710554+0000","last_fullsized":"2024-09-14T13:01:40.710554+0000","mapping_epoch":32,"log_start":"267'701","ondisk_log_start":"267'701","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:08:28.783586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:08:28.783586+0000","last_clean_scrub_stamp":"2024-09-14T11:08:28.783586+0000","objects_scrubbed":0,"log_size":65,"log_dups_size":701,"ondisk_log_size":65,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:13:51.334108+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.10","version":"267'110","reported_seq":636,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:00:11.280385+0000","last_change":"2024-09-14T11:08:31.839459+0000","last_active":"2024-09-14T13:00:11.280385+0000","last_peered":"2024-09-14T13:00:11.280385+0000","last_clean":"2024-09-14T13:00:11.280385+0000","last_became_active":"2024-09-14T11:08:31.838761+0000","last_became_peered":"2024-09-14T11:08:31.838761+0000","last_unstale":"2024-09-14T13:00:11.280385+0000","last_undegraded":"2024-09-14T13:00:11.280385+0000","last_fullsized":"2024-09-14T13:00:11.280385+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:08:30.789404+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:08:30.789404+0000","last_clean_scrub_stamp":"2024-09-14T11:08:30.789404+0000","objects_scrubbed":0,"log_size":110,"log_dups_size":0,"ondisk_log_size":110,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:37:29.125988+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":418,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":108,"num_read_kb":106,"num_write":270,"num_write_kb":60,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1b","version":"267'384","reported_seq":1848,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:00:21.253052+0000","last_change":"2024-09-14T11:08:23.793363+0000","last_active":"2024-09-14T13:00:21.253052+0000","last_peered":"2024-09-14T13:00:21.253052+0000","last_clean":"2024-09-14T13:00:21.253052+0000","last_became_active":"2024-09-14T11:08:23.791753+0000","last_became_peered":"2024-09-14T11:08:23.791753+0000","last_unstale":"2024-09-14T13:00:21.253052+0000","last_undegraded":"2024-09-14T13:00:21.253052+0000","last_fullsized":"2024-09-14T13:00:21.253052+0000","mapping_epoch":26,"log_start":"267'300","ondisk_log_start":"267'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:08:22.750609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:08:22.750609+0000","last_clean_scrub_stamp":"2024-09-14T11:08:22.750609+0000","objects_scrubbed":0,"log_size":84,"log_dups_size":300,"ondisk_log_size":84,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:05:59.318543+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2049,"num_read_kb":1937,"num_write":432,"num_write_kb":84,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1c","version":"267'208","reported_seq":864,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:01:38.481476+0000","last_change":"2024-09-14T11:08:21.826647+0000","last_active":"2024-09-14T13:01:38.481476+0000","last_peered":"2024-09-14T13:01:38.481476+0000","last_clean":"2024-09-14T13:01:38.481476+0000","last_became_active":"2024-09-14T11:08:21.825881+0000","last_became_peered":"2024-09-14T11:08:21.825881+0000","last_unstale":"2024-09-14T13:01:38.481476+0000","last_undegraded":"2024-09-14T13:01:38.481476+0000","last_fullsized":"2024-09-14T13:01:38.481476+0000","mapping_epoch":24,"log_start":"267'100","ondisk_log_start":"267'100","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:08:20.733145+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:08:20.733145+0000","last_clean_scrub_stamp":"2024-09-14T11:08:20.733145+0000","objects_scrubbed":0,"log_size":108,"log_dups_size":100,"ondisk_log_size":108,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:50:22.513817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":14568498,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":550,"num_read_kb":34621,"num_write":944,"num_write_kb":21560,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":525,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:58:27.830750+0000","last_change":"2024-09-14T11:08:25.822606+0000","last_active":"2024-09-14T12:58:27.830750+0000","last_peered":"2024-09-14T12:58:27.830750+0000","last_clean":"2024-09-14T12:58:27.830750+0000","last_became_active":"2024-09-14T11:08:25.822047+0000","last_became_peered":"2024-09-14T11:08:25.822047+0000","last_unstale":"2024-09-14T12:58:27.830750+0000","last_undegraded":"2024-09-14T12:58:27.830750+0000","last_fullsized":"2024-09-14T12:58:27.830750+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:08:24.757170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:08:24.757170+0000","last_clean_scrub_stamp":"2024-09-14T11:08:24.757170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:17:43.121390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.19","version":"267'258","reported_seq":908,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:01:39.437504+0000","last_change":"2024-09-14T11:08:27.825245+0000","last_active":"2024-09-14T13:01:39.437504+0000","last_peered":"2024-09-14T13:01:39.437504+0000","last_clean":"2024-09-14T13:01:39.437504+0000","last_became_active":"2024-09-14T11:08:27.824464+0000","last_became_peered":"2024-09-14T11:08:27.824464+0000","last_unstale":"2024-09-14T13:01:39.437504+0000","last_undegraded":"2024-09-14T13:01:39.437504+0000","last_fullsized":"2024-09-14T13:01:39.437504+0000","mapping_epoch":30,"log_start":"267'200","ondisk_log_start":"267'200","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:08:26.771628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:08:26.771628+0000","last_clean_scrub_stamp":"2024-09-14T11:08:26.771628+0000","objects_scrubbed":0,"log_size":58,"log_dups_size":200,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:54:45.692895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":17424,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":341,"num_read_kb":416,"num_write":210,"num_write_kb":31,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":522,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:57:18.438460+0000","last_change":"2024-09-14T11:08:29.823349+0000","last_active":"2024-09-14T12:57:18.438460+0000","last_peered":"2024-09-14T12:57:18.438460+0000","last_clean":"2024-09-14T12:57:18.438460+0000","last_became_active":"2024-09-14T11:08:29.822623+0000","last_became_peered":"2024-09-14T11:08:29.822623+0000","last_unstale":"2024-09-14T12:57:18.438460+0000","last_undegraded":"2024-09-14T12:57:18.438460+0000","last_fullsized":"2024-09-14T12:57:18.438460+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:08:28.783586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:08:28.783586+0000","last_clean_scrub_stamp":"2024-09-14T11:08:28.783586+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:00:40.714545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.17","version":"267'127","reported_seq":653,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:59:42.848452+0000","last_change":"2024-09-14T11:08:31.859123+0000","last_active":"2024-09-14T12:59:42.848452+0000","last_peered":"2024-09-14T12:59:42.848452+0000","last_clean":"2024-09-14T12:59:42.848452+0000","last_became_active":"2024-09-14T11:08:31.858388+0000","last_became_peered":"2024-09-14T11:08:31.858388+0000","last_unstale":"2024-09-14T12:59:42.848452+0000","last_undegraded":"2024-09-14T12:59:42.848452+0000","last_fullsized":"2024-09-14T12:59:42.848452+0000","mapping_epoch":34,"log_start":"267'100","ondisk_log_start":"267'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:08:30.789404+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:08:30.789404+0000","last_clean_scrub_stamp":"2024-09-14T11:08:30.789404+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":100,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:58:20.561191+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":200,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":125,"num_read_kb":119,"num_write":310,"num_write_kb":73,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1a","version":"267'851","reported_seq":2570,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:59:14.733144+0000","last_change":"2024-09-14T11:08:23.794792+0000","last_active":"2024-09-14T12:59:14.733144+0000","last_peered":"2024-09-14T12:59:14.733144+0000","last_clean":"2024-09-14T12:59:14.733144+0000","last_became_active":"2024-09-14T11:08:23.793908+0000","last_became_peered":"2024-09-14T11:08:23.793908+0000","last_unstale":"2024-09-14T12:59:14.733144+0000","last_undegraded":"2024-09-14T12:59:14.733144+0000","last_fullsized":"2024-09-14T12:59:14.733144+0000","mapping_epoch":26,"log_start":"267'800","ondisk_log_start":"267'800","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:08:22.750609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:08:22.750609+0000","last_clean_scrub_stamp":"2024-09-14T11:08:22.750609+0000","objects_scrubbed":0,"log_size":51,"log_dups_size":800,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:05:29.558132+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":4233,"num_read_kb":3837,"num_write":1135,"num_write_kb":419,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1d","version":"267'244","reported_seq":925,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:58:23.039867+0000","last_change":"2024-09-14T11:08:21.821524+0000","last_active":"2024-09-14T12:58:23.039867+0000","last_peered":"2024-09-14T12:58:23.039867+0000","last_clean":"2024-09-14T12:58:23.039867+0000","last_became_active":"2024-09-14T11:08:21.820805+0000","last_became_peered":"2024-09-14T11:08:21.820805+0000","last_unstale":"2024-09-14T12:58:23.039867+0000","last_undegraded":"2024-09-14T12:58:23.039867+0000","last_fullsized":"2024-09-14T12:58:23.039867+0000","mapping_epoch":24,"log_start":"267'200","ondisk_log_start":"267'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:08:20.733145+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:08:20.733145+0000","last_clean_scrub_stamp":"2024-09-14T11:08:20.733145+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":200,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:37:46.552173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6301751,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":692,"num_read_kb":13918,"num_write":1165,"num_write_kb":29151,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":524,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:58:28.040986+0000","last_change":"2024-09-14T11:08:25.802519+0000","last_active":"2024-09-14T12:58:28.040986+0000","last_peered":"2024-09-14T12:58:28.040986+0000","last_clean":"2024-09-14T12:58:28.040986+0000","last_became_active":"2024-09-14T11:08:25.801548+0000","last_became_peered":"2024-09-14T11:08:25.801548+0000","last_unstale":"2024-09-14T12:58:28.040986+0000","last_undegraded":"2024-09-14T12:58:28.040986+0000","last_fullsized":"2024-09-14T12:58:28.040986+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:08:24.757170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:08:24.757170+0000","last_clean_scrub_stamp":"2024-09-14T11:08:24.757170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:47:07.228076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.18","version":"267'176","reported_seq":795,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:59:38.254026+0000","last_change":"2024-09-14T11:08:27.815657+0000","last_active":"2024-09-14T12:59:38.254026+0000","last_peered":"2024-09-14T12:59:38.254026+0000","last_clean":"2024-09-14T12:59:38.254026+0000","last_became_active":"2024-09-14T11:08:27.814938+0000","last_became_peered":"2024-09-14T11:08:27.814938+0000","last_unstale":"2024-09-14T12:59:38.254026+0000","last_undegraded":"2024-09-14T12:59:38.254026+0000","last_fullsized":"2024-09-14T12:59:38.254026+0000","mapping_epoch":30,"log_start":"264'100","ondisk_log_start":"264'100","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:08:26.771628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:08:26.771628+0000","last_clean_scrub_stamp":"2024-09-14T11:08:26.771628+0000","objects_scrubbed":0,"log_size":76,"log_dups_size":100,"ondisk_log_size":76,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:15:03.277896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":33662,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":230,"num_read_kb":357,"num_write":134,"num_write_kb":53,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":516,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:57:33.603105+0000","last_change":"2024-09-14T11:08:29.836990+0000","last_active":"2024-09-14T12:57:33.603105+0000","last_peered":"2024-09-14T12:57:33.603105+0000","last_clean":"2024-09-14T12:57:33.603105+0000","last_became_active":"2024-09-14T11:08:29.829491+0000","last_became_peered":"2024-09-14T11:08:29.829491+0000","last_unstale":"2024-09-14T12:57:33.603105+0000","last_undegraded":"2024-09-14T12:57:33.603105+0000","last_fullsized":"2024-09-14T12:57:33.603105+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:08:28.783586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:08:28.783586+0000","last_clean_scrub_stamp":"2024-09-14T11:08:28.783586+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:58:11.838583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.16","version":"267'128","reported_seq":682,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:58:21.393905+0000","last_change":"2024-09-14T11:08:31.838739+0000","last_active":"2024-09-14T12:58:21.393905+0000","last_peered":"2024-09-14T12:58:21.393905+0000","last_clean":"2024-09-14T12:58:21.393905+0000","last_became_active":"2024-09-14T11:08:31.832264+0000","last_became_peered":"2024-09-14T11:08:31.832264+0000","last_unstale":"2024-09-14T12:58:21.393905+0000","last_undegraded":"2024-09-14T12:58:21.393905+0000","last_fullsized":"2024-09-14T12:58:21.393905+0000","mapping_epoch":34,"log_start":"267'100","ondisk_log_start":"267'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:08:30.789404+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:08:30.789404+0000","last_clean_scrub_stamp":"2024-09-14T11:08:30.789404+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":100,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:40:25.298343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":539,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":196,"num_read_kb":188,"num_write":306,"num_write_kb":70,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"267'841","reported_seq":2516,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:00:18.822903+0000","last_change":"2024-09-14T11:08:23.782031+0000","last_active":"2024-09-14T13:00:18.822903+0000","last_peered":"2024-09-14T13:00:18.822903+0000","last_clean":"2024-09-14T13:00:18.822903+0000","last_became_active":"2024-09-14T11:08:23.781730+0000","last_became_peered":"2024-09-14T11:08:23.781730+0000","last_unstale":"2024-09-14T13:00:18.822903+0000","last_undegraded":"2024-09-14T13:00:18.822903+0000","last_fullsized":"2024-09-14T13:00:18.822903+0000","mapping_epoch":26,"log_start":"267'800","ondisk_log_start":"267'800","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:08:22.750609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:08:22.750609+0000","last_clean_scrub_stamp":"2024-09-14T11:08:22.750609+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":800,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:42:43.466791+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3990,"num_read_kb":3619,"num_write":1102,"num_write_kb":388,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"267'184","reported_seq":824,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:58:43.462923+0000","last_change":"2024-09-14T11:08:21.809882+0000","last_active":"2024-09-14T12:58:43.462923+0000","last_peered":"2024-09-14T12:58:43.462923+0000","last_clean":"2024-09-14T12:58:43.462923+0000","last_became_active":"2024-09-14T11:08:21.809457+0000","last_became_peered":"2024-09-14T11:08:21.809457+0000","last_unstale":"2024-09-14T12:58:43.462923+0000","last_undegraded":"2024-09-14T12:58:43.462923+0000","last_fullsized":"2024-09-14T12:58:43.462923+0000","mapping_epoch":24,"log_start":"267'100","ondisk_log_start":"267'100","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:08:20.733145+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:08:20.733145+0000","last_clean_scrub_stamp":"2024-09-14T11:08:20.733145+0000","objects_scrubbed":0,"log_size":84,"log_dups_size":100,"ondisk_log_size":84,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:01:09.631980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3145754,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":449,"num_read_kb":5598,"num_write":895,"num_write_kb":20482,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6,7],"acting":[3,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":527,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:57:13.208161+0000","last_change":"2024-09-14T11:08:25.806603+0000","last_active":"2024-09-14T12:57:13.208161+0000","last_peered":"2024-09-14T12:57:13.208161+0000","last_clean":"2024-09-14T12:57:13.208161+0000","last_became_active":"2024-09-14T11:08:25.805777+0000","last_became_peered":"2024-09-14T11:08:25.805777+0000","last_unstale":"2024-09-14T12:57:13.208161+0000","last_undegraded":"2024-09-14T12:57:13.208161+0000","last_fullsized":"2024-09-14T12:57:13.208161+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:08:24.757170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:08:24.757170+0000","last_clean_scrub_stamp":"2024-09-14T11:08:24.757170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:54:18.701609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1b","version":"267'119","reported_seq":708,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:00:58.494482+0000","last_change":"2024-09-14T11:08:27.823209+0000","last_active":"2024-09-14T13:00:58.494482+0000","last_peered":"2024-09-14T13:00:58.494482+0000","last_clean":"2024-09-14T13:00:58.494482+0000","last_became_active":"2024-09-14T11:08:27.822465+0000","last_became_peered":"2024-09-14T11:08:27.822465+0000","last_unstale":"2024-09-14T13:00:58.494482+0000","last_undegraded":"2024-09-14T13:00:58.494482+0000","last_fullsized":"2024-09-14T13:00:58.494482+0000","mapping_epoch":30,"log_start":"267'100","ondisk_log_start":"267'100","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:08:26.771628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:08:26.771628+0000","last_clean_scrub_stamp":"2024-09-14T11:08:26.771628+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":100,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:13:30.608378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":11318,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":153,"num_read_kb":215,"num_write":82,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":518,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:58:33.226817+0000","last_change":"2024-09-14T11:08:29.832131+0000","last_active":"2024-09-14T12:58:33.226817+0000","last_peered":"2024-09-14T12:58:33.226817+0000","last_clean":"2024-09-14T12:58:33.226817+0000","last_became_active":"2024-09-14T11:08:29.831394+0000","last_became_peered":"2024-09-14T11:08:29.831394+0000","last_unstale":"2024-09-14T12:58:33.226817+0000","last_undegraded":"2024-09-14T12:58:33.226817+0000","last_fullsized":"2024-09-14T12:58:33.226817+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:08:28.783586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:08:28.783586+0000","last_clean_scrub_stamp":"2024-09-14T11:08:28.783586+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:19:42.017615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.15","version":"267'186","reported_seq":1322,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:00:12.482492+0000","last_change":"2024-09-14T11:08:31.838090+0000","last_active":"2024-09-14T13:00:12.482492+0000","last_peered":"2024-09-14T13:00:12.482492+0000","last_clean":"2024-09-14T13:00:12.482492+0000","last_became_active":"2024-09-14T11:08:31.837288+0000","last_became_peered":"2024-09-14T11:08:31.837288+0000","last_unstale":"2024-09-14T13:00:12.482492+0000","last_undegraded":"2024-09-14T13:00:12.482492+0000","last_fullsized":"2024-09-14T13:00:12.482492+0000","mapping_epoch":34,"log_start":"267'100","ondisk_log_start":"267'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:08:30.789404+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:08:30.789404+0000","last_clean_scrub_stamp":"2024-09-14T11:08:30.789404+0000","objects_scrubbed":0,"log_size":86,"log_dups_size":100,"ondisk_log_size":86,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:18:38.098740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":649,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":776,"num_read_kb":767,"num_write":406,"num_write_kb":131,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.18","version":"267'750","reported_seq":2353,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:59:18.400946+0000","last_change":"2024-09-14T11:08:23.807715+0000","last_active":"2024-09-14T12:59:18.400946+0000","last_peered":"2024-09-14T12:59:18.400946+0000","last_clean":"2024-09-14T12:59:18.400946+0000","last_became_active":"2024-09-14T11:08:23.806640+0000","last_became_peered":"2024-09-14T11:08:23.806640+0000","last_unstale":"2024-09-14T12:59:18.400946+0000","last_undegraded":"2024-09-14T12:59:18.400946+0000","last_fullsized":"2024-09-14T12:59:18.400946+0000","mapping_epoch":26,"log_start":"267'700","ondisk_log_start":"267'700","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:08:22.750609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:08:22.750609+0000","last_clean_scrub_stamp":"2024-09-14T11:08:22.750609+0000","objects_scrubbed":0,"log_size":50,"log_dups_size":700,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:13:39.042733+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3938,"num_read_kb":3591,"num_write":982,"num_write_kb":355,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1f","version":"267'163","reported_seq":832,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:59:58.476796+0000","last_change":"2024-09-14T11:08:21.801365+0000","last_active":"2024-09-14T12:59:58.476796+0000","last_peered":"2024-09-14T12:59:58.476796+0000","last_clean":"2024-09-14T12:59:58.476796+0000","last_became_active":"2024-09-14T11:08:21.801111+0000","last_became_peered":"2024-09-14T11:08:21.801111+0000","last_unstale":"2024-09-14T12:59:58.476796+0000","last_undegraded":"2024-09-14T12:59:58.476796+0000","last_fullsized":"2024-09-14T12:59:58.476796+0000","mapping_epoch":24,"log_start":"267'100","ondisk_log_start":"267'100","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:08:20.733145+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:08:20.733145+0000","last_clean_scrub_stamp":"2024-09-14T11:08:20.733145+0000","objects_scrubbed":0,"log_size":63,"log_dups_size":100,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:46:15.553454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16777242,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":482,"num_read_kb":60837,"num_write":753,"num_write_kb":39194,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,6],"acting":[0,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.19","version":"29'1","reported_seq":524,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:57:28.444602+0000","last_change":"2024-09-14T11:08:25.800454+0000","last_active":"2024-09-14T12:57:28.444602+0000","last_peered":"2024-09-14T12:57:28.444602+0000","last_clean":"2024-09-14T12:57:28.444602+0000","last_became_active":"2024-09-14T11:08:25.799872+0000","last_became_peered":"2024-09-14T11:08:25.799872+0000","last_unstale":"2024-09-14T12:57:28.444602+0000","last_undegraded":"2024-09-14T12:57:28.444602+0000","last_fullsized":"2024-09-14T12:57:28.444602+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:08:24.757170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:08:24.757170+0000","last_clean_scrub_stamp":"2024-09-14T11:08:24.757170+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:22:33.868316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1a","version":"267'184","reported_seq":815,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:00:58.259901+0000","last_change":"2024-09-14T11:08:27.831489+0000","last_active":"2024-09-14T13:00:58.259901+0000","last_peered":"2024-09-14T13:00:58.259901+0000","last_clean":"2024-09-14T13:00:58.259901+0000","last_became_active":"2024-09-14T11:08:27.830707+0000","last_became_peered":"2024-09-14T11:08:27.830707+0000","last_unstale":"2024-09-14T13:00:58.259901+0000","last_undegraded":"2024-09-14T13:00:58.259901+0000","last_fullsized":"2024-09-14T13:00:58.259901+0000","mapping_epoch":30,"log_start":"264'100","ondisk_log_start":"264'100","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:08:26.771628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:08:26.771628+0000","last_clean_scrub_stamp":"2024-09-14T11:08:26.771628+0000","objects_scrubbed":0,"log_size":84,"log_dups_size":100,"ondisk_log_size":84,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:02:06.941247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10024,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":259,"num_read_kb":319,"num_write":148,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":521,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:58:33.237720+0000","last_change":"2024-09-14T11:08:29.811093+0000","last_active":"2024-09-14T12:58:33.237720+0000","last_peered":"2024-09-14T12:58:33.237720+0000","last_clean":"2024-09-14T12:58:33.237720+0000","last_became_active":"2024-09-14T11:08:29.810292+0000","last_became_peered":"2024-09-14T11:08:29.810292+0000","last_unstale":"2024-09-14T12:58:33.237720+0000","last_undegraded":"2024-09-14T12:58:33.237720+0000","last_fullsized":"2024-09-14T12:58:33.237720+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:08:28.783586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:08:28.783586+0000","last_clean_scrub_stamp":"2024-09-14T11:08:28.783586+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:29:49.706509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.14","version":"267'133","reported_seq":660,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:01:39.322888+0000","last_change":"2024-09-14T11:08:31.852213+0000","last_active":"2024-09-14T13:01:39.322888+0000","last_peered":"2024-09-14T13:01:39.322888+0000","last_clean":"2024-09-14T13:01:39.322888+0000","last_became_active":"2024-09-14T11:08:31.851483+0000","last_became_peered":"2024-09-14T11:08:31.851483+0000","last_unstale":"2024-09-14T13:01:39.322888+0000","last_undegraded":"2024-09-14T13:01:39.322888+0000","last_fullsized":"2024-09-14T13:01:39.322888+0000","mapping_epoch":34,"log_start":"267'100","ondisk_log_start":"267'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:08:30.789404+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:08:30.789404+0000","last_clean_scrub_stamp":"2024-09-14T11:08:30.789404+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":100,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:20:02.893934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":227,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":142,"num_read_kb":127,"num_write":323,"num_write_kb":76,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.27","version":"267'1174","reported_seq":2953,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:58:58.464754+0000","last_change":"2024-09-14T11:08:23.798559+0000","last_active":"2024-09-14T12:58:58.464754+0000","last_peered":"2024-09-14T12:58:58.464754+0000","last_clean":"2024-09-14T12:58:58.464754+0000","last_became_active":"2024-09-14T11:08:23.798225+0000","last_became_peered":"2024-09-14T11:08:23.798225+0000","last_unstale":"2024-09-14T12:58:58.464754+0000","last_undegraded":"2024-09-14T12:58:58.464754+0000","last_fullsized":"2024-09-14T12:58:58.464754+0000","mapping_epoch":26,"log_start":"267'1100","ondisk_log_start":"267'1100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:08:22.750609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:08:22.750609+0000","last_clean_scrub_stamp":"2024-09-14T11:08:22.750609+0000","objects_scrubbed":0,"log_size":74,"log_dups_size":1100,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:51:37.923488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":5564,"num_read_kb":4974,"num_write":1578,"num_write_kb":634,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.20","version":"267'236","reported_seq":989,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:58:48.427401+0000","last_change":"2024-09-14T11:08:21.818419+0000","last_active":"2024-09-14T12:58:48.427401+0000","last_peered":"2024-09-14T12:58:48.427401+0000","last_clean":"2024-09-14T12:58:48.427401+0000","last_became_active":"2024-09-14T11:08:21.816270+0000","last_became_peered":"2024-09-14T11:08:21.816270+0000","last_unstale":"2024-09-14T12:58:48.427401+0000","last_undegraded":"2024-09-14T12:58:48.427401+0000","last_fullsized":"2024-09-14T12:58:48.427401+0000","mapping_epoch":24,"log_start":"267'200","ondisk_log_start":"267'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:08:20.733145+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:08:20.733145+0000","last_clean_scrub_stamp":"2024-09-14T11:08:20.733145+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":200,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:09:57.961085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2438293,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":890,"num_read_kb":196583,"num_write":959,"num_write_kb":33610,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,7],"acting":[6,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.26","version":"267'1292","reported_seq":2902,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:00:11.320785+0000","last_change":"2024-09-14T11:08:23.776608+0000","last_active":"2024-09-14T13:00:11.320785+0000","last_peered":"2024-09-14T13:00:11.320785+0000","last_clean":"2024-09-14T13:00:11.320785+0000","last_became_active":"2024-09-14T11:08:23.776349+0000","last_became_peered":"2024-09-14T11:08:23.776349+0000","last_unstale":"2024-09-14T13:00:11.320785+0000","last_undegraded":"2024-09-14T13:00:11.320785+0000","last_fullsized":"2024-09-14T13:00:11.320785+0000","mapping_epoch":26,"log_start":"267'1200","ondisk_log_start":"267'1200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:08:22.750609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:08:22.750609+0000","last_clean_scrub_stamp":"2024-09-14T11:08:22.750609+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":1200,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:56:10.344959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":5862,"num_read_kb":5174,"num_write":1823,"num_write_kb":798,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.21","version":"267'158","reported_seq":796,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:58:47.825408+0000","last_change":"2024-09-14T11:08:21.779309+0000","last_active":"2024-09-14T12:58:47.825408+0000","last_peered":"2024-09-14T12:58:47.825408+0000","last_clean":"2024-09-14T12:58:47.825408+0000","last_became_active":"2024-09-14T11:08:21.778857+0000","last_became_peered":"2024-09-14T11:08:21.778857+0000","last_unstale":"2024-09-14T12:58:47.825408+0000","last_undegraded":"2024-09-14T12:58:47.825408+0000","last_fullsized":"2024-09-14T12:58:47.825408+0000","mapping_epoch":24,"log_start":"267'100","ondisk_log_start":"267'100","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:08:20.733145+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:08:20.733145+0000","last_clean_scrub_stamp":"2024-09-14T11:08:20.733145+0000","objects_scrubbed":0,"log_size":58,"log_dups_size":100,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:35:37.196078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":436,"num_read_kb":8582,"num_write":806,"num_write_kb":19268,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,6],"acting":[2,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.25","version":"267'856","reported_seq":2578,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:58:58.047892+0000","last_change":"2024-09-14T11:08:23.810261+0000","last_active":"2024-09-14T12:58:58.047892+0000","last_peered":"2024-09-14T12:58:58.047892+0000","last_clean":"2024-09-14T12:58:58.047892+0000","last_became_active":"2024-09-14T11:08:23.808906+0000","last_became_peered":"2024-09-14T11:08:23.808906+0000","last_unstale":"2024-09-14T12:58:58.047892+0000","last_undegraded":"2024-09-14T12:58:58.047892+0000","last_fullsized":"2024-09-14T12:58:58.047892+0000","mapping_epoch":26,"log_start":"267'800","ondisk_log_start":"267'800","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:08:22.750609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:08:22.750609+0000","last_clean_scrub_stamp":"2024-09-14T11:08:22.750609+0000","objects_scrubbed":0,"log_size":56,"log_dups_size":800,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:40:05.413028+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":4244,"num_read_kb":3835,"num_write":1129,"num_write_kb":418,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.22","version":"267'241","reported_seq":950,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:58:48.045508+0000","last_change":"2024-09-14T11:08:21.797624+0000","last_active":"2024-09-14T12:58:48.045508+0000","last_peered":"2024-09-14T12:58:48.045508+0000","last_clean":"2024-09-14T12:58:48.045508+0000","last_became_active":"2024-09-14T11:08:21.795735+0000","last_became_peered":"2024-09-14T11:08:21.795735+0000","last_unstale":"2024-09-14T12:58:48.045508+0000","last_undegraded":"2024-09-14T12:58:48.045508+0000","last_fullsized":"2024-09-14T12:58:48.045508+0000","mapping_epoch":24,"log_start":"267'200","ondisk_log_start":"267'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:08:20.733145+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:08:20.733145+0000","last_clean_scrub_stamp":"2024-09-14T11:08:20.733145+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":200,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:10:17.606566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12586780,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":699,"num_read_kb":92954,"num_write":1115,"num_write_kb":50908,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,0],"acting":[5,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.24","version":"267'424","reported_seq":2053,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:58:58.464653+0000","last_change":"2024-09-14T11:08:23.801087+0000","last_active":"2024-09-14T12:58:58.464653+0000","last_peered":"2024-09-14T12:58:58.464653+0000","last_clean":"2024-09-14T12:58:58.464653+0000","last_became_active":"2024-09-14T11:08:23.800722+0000","last_became_peered":"2024-09-14T11:08:23.800722+0000","last_unstale":"2024-09-14T12:58:58.464653+0000","last_undegraded":"2024-09-14T12:58:58.464653+0000","last_fullsized":"2024-09-14T12:58:58.464653+0000","mapping_epoch":26,"log_start":"267'400","ondisk_log_start":"267'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:08:22.750609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:08:22.750609+0000","last_clean_scrub_stamp":"2024-09-14T11:08:22.750609+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":400,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:30:04.827083+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2360,"num_read_kb":2243,"num_write":502,"num_write_kb":106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.23","version":"267'214","reported_seq":888,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:59:13.248088+0000","last_change":"2024-09-14T11:08:21.816021+0000","last_active":"2024-09-14T12:59:13.248088+0000","last_peered":"2024-09-14T12:59:13.248088+0000","last_clean":"2024-09-14T12:59:13.248088+0000","last_became_active":"2024-09-14T11:08:21.815676+0000","last_became_peered":"2024-09-14T11:08:21.815676+0000","last_unstale":"2024-09-14T12:59:13.248088+0000","last_undegraded":"2024-09-14T12:59:13.248088+0000","last_fullsized":"2024-09-14T12:59:13.248088+0000","mapping_epoch":24,"log_start":"267'200","ondisk_log_start":"267'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:08:20.733145+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:08:20.733145+0000","last_clean_scrub_stamp":"2024-09-14T11:08:20.733145+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":200,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:59:08.982564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6998409,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":593,"num_read_kb":27875,"num_write":898,"num_write_kb":22739,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"267'894","reported_seq":2678,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:01:39.418707+0000","last_change":"2024-09-14T11:08:23.801739+0000","last_active":"2024-09-14T13:01:39.418707+0000","last_peered":"2024-09-14T13:01:39.418707+0000","last_clean":"2024-09-14T13:01:39.418707+0000","last_became_active":"2024-09-14T11:08:23.801373+0000","last_became_peered":"2024-09-14T11:08:23.801373+0000","last_unstale":"2024-09-14T13:01:39.418707+0000","last_undegraded":"2024-09-14T13:01:39.418707+0000","last_fullsized":"2024-09-14T13:01:39.418707+0000","mapping_epoch":26,"log_start":"267'800","ondisk_log_start":"267'800","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:08:22.750609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:08:22.750609+0000","last_clean_scrub_stamp":"2024-09-14T11:08:22.750609+0000","objects_scrubbed":0,"log_size":94,"log_dups_size":800,"ondisk_log_size":94,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:42:48.834357+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":4489,"num_read_kb":4053,"num_write":1182,"num_write_kb":453,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.24","version":"267'179","reported_seq":854,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:58:53.465379+0000","last_change":"2024-09-14T11:08:21.816168+0000","last_active":"2024-09-14T12:58:53.465379+0000","last_peered":"2024-09-14T12:58:53.465379+0000","last_clean":"2024-09-14T12:58:53.465379+0000","last_became_active":"2024-09-14T11:08:21.815768+0000","last_became_peered":"2024-09-14T11:08:21.815768+0000","last_unstale":"2024-09-14T12:58:53.465379+0000","last_undegraded":"2024-09-14T12:58:53.465379+0000","last_fullsized":"2024-09-14T12:58:53.465379+0000","mapping_epoch":24,"log_start":"267'100","ondisk_log_start":"267'100","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:08:20.733145+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:08:20.733145+0000","last_clean_scrub_stamp":"2024-09-14T11:08:20.733145+0000","objects_scrubbed":0,"log_size":79,"log_dups_size":100,"ondisk_log_size":79,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:26:06.050289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4196396,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":598,"num_read_kb":27323,"num_write":895,"num_write_kb":11503,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,0],"acting":[3,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"267'441","reported_seq":1997,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:01:39.358812+0000","last_change":"2024-09-14T11:08:23.815380+0000","last_active":"2024-09-14T13:01:39.358812+0000","last_peered":"2024-09-14T13:01:39.358812+0000","last_clean":"2024-09-14T13:01:39.358812+0000","last_became_active":"2024-09-14T11:08:23.814703+0000","last_became_peered":"2024-09-14T11:08:23.814703+0000","last_unstale":"2024-09-14T13:01:39.358812+0000","last_undegraded":"2024-09-14T13:01:39.358812+0000","last_fullsized":"2024-09-14T13:01:39.358812+0000","mapping_epoch":26,"log_start":"267'400","ondisk_log_start":"267'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:08:22.750609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:08:22.750609+0000","last_clean_scrub_stamp":"2024-09-14T11:08:22.750609+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":400,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:10:53.366615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2315,"num_read_kb":2173,"num_write":509,"num_write_kb":111,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.25","version":"267'222","reported_seq":870,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:58:53.463561+0000","last_change":"2024-09-14T11:08:21.783168+0000","last_active":"2024-09-14T12:58:53.463561+0000","last_peered":"2024-09-14T12:58:53.463561+0000","last_clean":"2024-09-14T12:58:53.463561+0000","last_became_active":"2024-09-14T11:08:21.782389+0000","last_became_peered":"2024-09-14T11:08:21.782389+0000","last_unstale":"2024-09-14T12:58:53.463561+0000","last_undegraded":"2024-09-14T12:58:53.463561+0000","last_fullsized":"2024-09-14T12:58:53.463561+0000","mapping_epoch":24,"log_start":"267'200","ondisk_log_start":"267'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:08:20.733145+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:08:20.733145+0000","last_clean_scrub_stamp":"2024-09-14T11:08:20.733145+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":200,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:56:33.696993+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5607002,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":465,"num_read_kb":9844,"num_write":864,"num_write_kb":38372,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"267'1241","reported_seq":2966,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:58:53.465249+0000","last_change":"2024-09-14T11:08:23.786227+0000","last_active":"2024-09-14T12:58:53.465249+0000","last_peered":"2024-09-14T12:58:53.465249+0000","last_clean":"2024-09-14T12:58:53.465249+0000","last_became_active":"2024-09-14T11:08:23.785820+0000","last_became_peered":"2024-09-14T11:08:23.785820+0000","last_unstale":"2024-09-14T12:58:53.465249+0000","last_undegraded":"2024-09-14T12:58:53.465249+0000","last_fullsized":"2024-09-14T12:58:53.465249+0000","mapping_epoch":26,"log_start":"267'1200","ondisk_log_start":"267'1200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:08:22.750609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:08:22.750609+0000","last_clean_scrub_stamp":"2024-09-14T11:08:22.750609+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":1200,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:03:47.638628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":5731,"num_read_kb":5079,"num_write":1712,"num_write_kb":696,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"267'209","reported_seq":925,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:58:53.428713+0000","last_change":"2024-09-14T11:08:21.825788+0000","last_active":"2024-09-14T12:58:53.428713+0000","last_peered":"2024-09-14T12:58:53.428713+0000","last_clean":"2024-09-14T12:58:53.428713+0000","last_became_active":"2024-09-14T11:08:21.824946+0000","last_became_peered":"2024-09-14T11:08:21.824946+0000","last_unstale":"2024-09-14T12:58:53.428713+0000","last_undegraded":"2024-09-14T12:58:53.428713+0000","last_fullsized":"2024-09-14T12:58:53.428713+0000","mapping_epoch":24,"log_start":"267'100","ondisk_log_start":"267'100","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:08:20.733145+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:08:20.733145+0000","last_clean_scrub_stamp":"2024-09-14T11:08:20.733145+0000","objects_scrubbed":0,"log_size":109,"log_dups_size":100,"ondisk_log_size":109,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:23:39.096969+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":11093103,"num_objects":9,"num_object_clones":0,"num_object_copies":27,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":765,"num_read_kb":179397,"num_write":974,"num_write_kb":35238,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,4],"acting":[6,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.20","version":"267'1214","reported_seq":2936,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:00:11.316393+0000","last_change":"2024-09-14T11:08:23.805571+0000","last_active":"2024-09-14T13:00:11.316393+0000","last_peered":"2024-09-14T13:00:11.316393+0000","last_clean":"2024-09-14T13:00:11.316393+0000","last_became_active":"2024-09-14T11:08:23.803960+0000","last_became_peered":"2024-09-14T11:08:23.803960+0000","last_unstale":"2024-09-14T13:00:11.316393+0000","last_undegraded":"2024-09-14T13:00:11.316393+0000","last_fullsized":"2024-09-14T13:00:11.316393+0000","mapping_epoch":26,"log_start":"267'1200","ondisk_log_start":"267'1200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:08:22.750609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:08:22.750609+0000","last_clean_scrub_stamp":"2024-09-14T11:08:22.750609+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":1200,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:56:34.285956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":5500,"num_read_kb":4892,"num_write":1634,"num_write_kb":643,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"267'216","reported_seq":867,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:59:28.471054+0000","last_change":"2024-09-14T11:08:56.034603+0000","last_active":"2024-09-14T12:59:28.471054+0000","last_peered":"2024-09-14T12:59:28.471054+0000","last_clean":"2024-09-14T12:59:28.471054+0000","last_became_active":"2024-09-14T11:08:56.033948+0000","last_became_peered":"2024-09-14T11:08:56.033948+0000","last_unstale":"2024-09-14T12:59:28.471054+0000","last_undegraded":"2024-09-14T12:59:28.471054+0000","last_fullsized":"2024-09-14T12:59:28.471054+0000","mapping_epoch":37,"log_start":"267'200","ondisk_log_start":"267'200","created":24,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:08:20.733145+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:08:20.733145+0000","last_clean_scrub_stamp":"2024-09-14T11:08:20.733145+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":200,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:23:47.919671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4553958,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":566,"num_read_kb":57833,"num_write":1045,"num_write_kb":21583,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,2],"acting":[1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2f","version":"267'433","reported_seq":2044,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:58:21.423865+0000","last_change":"2024-09-14T11:08:23.786774+0000","last_active":"2024-09-14T12:58:21.423865+0000","last_peered":"2024-09-14T12:58:21.423865+0000","last_clean":"2024-09-14T12:58:21.423865+0000","last_became_active":"2024-09-14T11:08:23.786094+0000","last_became_peered":"2024-09-14T11:08:23.786094+0000","last_unstale":"2024-09-14T12:58:21.423865+0000","last_undegraded":"2024-09-14T12:58:21.423865+0000","last_fullsized":"2024-09-14T12:58:21.423865+0000","mapping_epoch":26,"log_start":"267'400","ondisk_log_start":"267'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:08:22.750609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:08:22.750609+0000","last_clean_scrub_stamp":"2024-09-14T11:08:22.750609+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":400,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:20:24.340919+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2284,"num_read_kb":2174,"num_write":475,"num_write_kb":81,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.28","version":"267'233","reported_seq":905,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:59:23.053130+0000","last_change":"2024-09-14T11:08:21.790090+0000","last_active":"2024-09-14T12:59:23.053130+0000","last_peered":"2024-09-14T12:59:23.053130+0000","last_clean":"2024-09-14T12:59:23.053130+0000","last_became_active":"2024-09-14T11:08:21.789114+0000","last_became_peered":"2024-09-14T11:08:21.789114+0000","last_unstale":"2024-09-14T12:59:23.053130+0000","last_undegraded":"2024-09-14T12:59:23.053130+0000","last_fullsized":"2024-09-14T12:59:23.053130+0000","mapping_epoch":24,"log_start":"267'200","ondisk_log_start":"267'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:08:20.733145+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:08:20.733145+0000","last_clean_scrub_stamp":"2024-09-14T11:08:20.733145+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":200,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:25:30.193731+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9761881,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":587,"num_read_kb":44666,"num_write":1098,"num_write_kb":41456,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,2],"acting":[5,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2e","version":"267'451","reported_seq":2209,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:59:07.754306+0000","last_change":"2024-09-14T11:08:23.793709+0000","last_active":"2024-09-14T12:59:07.754306+0000","last_peered":"2024-09-14T12:59:07.754306+0000","last_clean":"2024-09-14T12:59:07.754306+0000","last_became_active":"2024-09-14T11:08:23.792081+0000","last_became_peered":"2024-09-14T11:08:23.792081+0000","last_unstale":"2024-09-14T12:59:07.754306+0000","last_undegraded":"2024-09-14T12:59:07.754306+0000","last_fullsized":"2024-09-14T12:59:07.754306+0000","mapping_epoch":26,"log_start":"267'400","ondisk_log_start":"267'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:08:22.750609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:08:22.750609+0000","last_clean_scrub_stamp":"2024-09-14T11:08:22.750609+0000","objects_scrubbed":0,"log_size":51,"log_dups_size":400,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:10:19.755636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2579,"num_read_kb":2481,"num_write":491,"num_write_kb":76,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.29","version":"267'198","reported_seq":894,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:59:12.831088+0000","last_change":"2024-09-14T11:08:56.039919+0000","last_active":"2024-09-14T12:59:12.831088+0000","last_peered":"2024-09-14T12:59:12.831088+0000","last_clean":"2024-09-14T12:59:12.831088+0000","last_became_active":"2024-09-14T11:08:56.039007+0000","last_became_peered":"2024-09-14T11:08:56.039007+0000","last_unstale":"2024-09-14T12:59:12.831088+0000","last_undegraded":"2024-09-14T12:59:12.831088+0000","last_fullsized":"2024-09-14T12:59:12.831088+0000","mapping_epoch":37,"log_start":"267'100","ondisk_log_start":"267'100","created":24,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:08:20.733145+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:08:20.733145+0000","last_clean_scrub_stamp":"2024-09-14T11:08:20.733145+0000","objects_scrubbed":0,"log_size":98,"log_dups_size":100,"ondisk_log_size":98,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:34:15.824951+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":325166,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":674,"num_read_kb":34418,"num_write":909,"num_write_kb":30711,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4,1],"acting":[2,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2d","version":"267'382","reported_seq":1944,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:01:39.348450+0000","last_change":"2024-09-14T11:08:23.806935+0000","last_active":"2024-09-14T13:01:39.348450+0000","last_peered":"2024-09-14T13:01:39.348450+0000","last_clean":"2024-09-14T13:01:39.348450+0000","last_became_active":"2024-09-14T11:08:23.806568+0000","last_became_peered":"2024-09-14T11:08:23.806568+0000","last_unstale":"2024-09-14T13:01:39.348450+0000","last_undegraded":"2024-09-14T13:01:39.348450+0000","last_fullsized":"2024-09-14T13:01:39.348450+0000","mapping_epoch":26,"log_start":"267'300","ondisk_log_start":"267'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:08:22.750609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:08:22.750609+0000","last_clean_scrub_stamp":"2024-09-14T11:08:22.750609+0000","objects_scrubbed":0,"log_size":82,"log_dups_size":300,"ondisk_log_size":82,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:57:47.545139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2181,"num_read_kb":2088,"num_write":442,"num_write_kb":83,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2a","version":"267'209","reported_seq":845,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:00:10.971402+0000","last_change":"2024-09-14T11:08:55.884603+0000","last_active":"2024-09-14T13:00:10.971402+0000","last_peered":"2024-09-14T13:00:10.971402+0000","last_clean":"2024-09-14T13:00:10.971402+0000","last_became_active":"2024-09-14T11:08:55.882680+0000","last_became_peered":"2024-09-14T11:08:55.882680+0000","last_unstale":"2024-09-14T13:00:10.971402+0000","last_undegraded":"2024-09-14T13:00:10.971402+0000","last_fullsized":"2024-09-14T13:00:10.971402+0000","mapping_epoch":37,"log_start":"267'100","ondisk_log_start":"267'100","created":24,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:08:20.733145+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:08:20.733145+0000","last_clean_scrub_stamp":"2024-09-14T11:08:20.733145+0000","objects_scrubbed":0,"log_size":109,"log_dups_size":100,"ondisk_log_size":109,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:49:48.418255+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6908983,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":486,"num_read_kb":10243,"num_write":959,"num_write_kb":42313,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,1],"acting":[5,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2c","version":"267'617","reported_seq":2458,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:59:18.400789+0000","last_change":"2024-09-14T11:08:23.815717+0000","last_active":"2024-09-14T12:59:18.400789+0000","last_peered":"2024-09-14T12:59:18.400789+0000","last_clean":"2024-09-14T12:59:18.400789+0000","last_became_active":"2024-09-14T11:08:23.815121+0000","last_became_peered":"2024-09-14T11:08:23.815121+0000","last_unstale":"2024-09-14T12:59:18.400789+0000","last_undegraded":"2024-09-14T12:59:18.400789+0000","last_fullsized":"2024-09-14T12:59:18.400789+0000","mapping_epoch":26,"log_start":"267'600","ondisk_log_start":"267'600","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:08:22.750609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:08:22.750609+0000","last_clean_scrub_stamp":"2024-09-14T11:08:22.750609+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":600,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:28:06.102937+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3483,"num_read_kb":3244,"num_write":793,"num_write_kb":264,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2b","version":"267'197","reported_seq":843,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:58:38.239023+0000","last_change":"2024-09-14T11:08:21.788931+0000","last_active":"2024-09-14T12:58:38.239023+0000","last_peered":"2024-09-14T12:58:38.239023+0000","last_clean":"2024-09-14T12:58:38.239023+0000","last_became_active":"2024-09-14T11:08:21.788281+0000","last_became_peered":"2024-09-14T11:08:21.788281+0000","last_unstale":"2024-09-14T12:58:38.239023+0000","last_undegraded":"2024-09-14T12:58:38.239023+0000","last_fullsized":"2024-09-14T12:58:38.239023+0000","mapping_epoch":24,"log_start":"267'100","ondisk_log_start":"267'100","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:08:20.733145+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:08:20.733145+0000","last_clean_scrub_stamp":"2024-09-14T11:08:20.733145+0000","objects_scrubbed":0,"log_size":97,"log_dups_size":100,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:28:36.822887+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388661,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":433,"num_read_kb":38929,"num_write":897,"num_write_kb":25858,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,1],"acting":[0,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2b","version":"267'912","reported_seq":2513,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:01:39.366882+0000","last_change":"2024-09-14T11:08:23.807651+0000","last_active":"2024-09-14T13:01:39.366882+0000","last_peered":"2024-09-14T13:01:39.366882+0000","last_clean":"2024-09-14T13:01:39.366882+0000","last_became_active":"2024-09-14T11:08:23.806952+0000","last_became_peered":"2024-09-14T11:08:23.806952+0000","last_unstale":"2024-09-14T13:01:39.366882+0000","last_undegraded":"2024-09-14T13:01:39.366882+0000","last_fullsized":"2024-09-14T13:01:39.366882+0000","mapping_epoch":26,"log_start":"267'900","ondisk_log_start":"267'900","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:08:22.750609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:08:22.750609+0000","last_clean_scrub_stamp":"2024-09-14T11:08:22.750609+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":900,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:04:05.268211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":4419,"num_read_kb":3921,"num_write":1287,"num_write_kb":515,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"267'227","reported_seq":901,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:58:38.425180+0000","last_change":"2024-09-14T11:08:21.838035+0000","last_active":"2024-09-14T12:58:38.425180+0000","last_peered":"2024-09-14T12:58:38.425180+0000","last_clean":"2024-09-14T12:58:38.425180+0000","last_became_active":"2024-09-14T11:08:21.836420+0000","last_became_peered":"2024-09-14T11:08:21.836420+0000","last_unstale":"2024-09-14T12:58:38.425180+0000","last_undegraded":"2024-09-14T12:58:38.425180+0000","last_fullsized":"2024-09-14T12:58:38.425180+0000","mapping_epoch":24,"log_start":"267'200","ondisk_log_start":"267'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:08:20.733145+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:08:20.733145+0000","last_clean_scrub_stamp":"2024-09-14T11:08:20.733145+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":200,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:52:49.496464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7394423,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":674,"num_read_kb":43780,"num_write":1050,"num_write_kb":42822,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.2a","version":"267'457","reported_seq":2086,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:58:43.240063+0000","last_change":"2024-09-14T11:08:23.777007+0000","last_active":"2024-09-14T12:58:43.240063+0000","last_peered":"2024-09-14T12:58:43.240063+0000","last_clean":"2024-09-14T12:58:43.240063+0000","last_became_active":"2024-09-14T11:08:23.776554+0000","last_became_peered":"2024-09-14T11:08:23.776554+0000","last_unstale":"2024-09-14T12:58:43.240063+0000","last_undegraded":"2024-09-14T12:58:43.240063+0000","last_fullsized":"2024-09-14T12:58:43.240063+0000","mapping_epoch":26,"log_start":"267'400","ondisk_log_start":"267'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:08:22.750609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:08:22.750609+0000","last_clean_scrub_stamp":"2024-09-14T11:08:22.750609+0000","objects_scrubbed":0,"log_size":57,"log_dups_size":400,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:54:36.353928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2491,"num_read_kb":2349,"num_write":540,"num_write_kb":122,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2d","version":"267'204","reported_seq":852,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:59:58.479560+0000","last_change":"2024-09-14T11:08:21.829298+0000","last_active":"2024-09-14T12:59:58.479560+0000","last_peered":"2024-09-14T12:59:58.479560+0000","last_clean":"2024-09-14T12:59:58.479560+0000","last_became_active":"2024-09-14T11:08:21.828333+0000","last_became_peered":"2024-09-14T11:08:21.828333+0000","last_unstale":"2024-09-14T12:59:58.479560+0000","last_undegraded":"2024-09-14T12:59:58.479560+0000","last_fullsized":"2024-09-14T12:59:58.479560+0000","mapping_epoch":24,"log_start":"267'100","ondisk_log_start":"267'100","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:08:20.733145+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:08:20.733145+0000","last_clean_scrub_stamp":"2024-09-14T11:08:20.733145+0000","objects_scrubbed":0,"log_size":104,"log_dups_size":100,"ondisk_log_size":104,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:49:17.354112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9037928,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":510,"num_read_kb":35640,"num_write":900,"num_write_kb":31502,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,6],"acting":[7,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.29","version":"267'783","reported_seq":2506,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:58:48.349738+0000","last_change":"2024-09-14T11:08:23.784873+0000","last_active":"2024-09-14T12:58:48.349738+0000","last_peered":"2024-09-14T12:58:48.349738+0000","last_clean":"2024-09-14T12:58:48.349738+0000","last_became_active":"2024-09-14T11:08:23.783522+0000","last_became_peered":"2024-09-14T11:08:23.783522+0000","last_unstale":"2024-09-14T12:58:48.349738+0000","last_undegraded":"2024-09-14T12:58:48.349738+0000","last_fullsized":"2024-09-14T12:58:48.349738+0000","mapping_epoch":26,"log_start":"267'700","ondisk_log_start":"267'700","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:08:22.750609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:08:22.750609+0000","last_clean_scrub_stamp":"2024-09-14T11:08:22.750609+0000","objects_scrubbed":0,"log_size":83,"log_dups_size":700,"ondisk_log_size":83,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:15:28.048272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":4481,"num_read_kb":4083,"num_write":1109,"num_write_kb":423,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"267'181","reported_seq":866,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:59:58.479319+0000","last_change":"2024-09-14T11:08:21.809060+0000","last_active":"2024-09-14T12:59:58.479319+0000","last_peered":"2024-09-14T12:59:58.479319+0000","last_clean":"2024-09-14T12:59:58.479319+0000","last_became_active":"2024-09-14T11:08:21.808348+0000","last_became_peered":"2024-09-14T11:08:21.808348+0000","last_unstale":"2024-09-14T12:59:58.479319+0000","last_undegraded":"2024-09-14T12:59:58.479319+0000","last_fullsized":"2024-09-14T12:59:58.479319+0000","mapping_epoch":24,"log_start":"267'100","ondisk_log_start":"267'100","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:08:20.733145+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:08:20.733145+0000","last_clean_scrub_stamp":"2024-09-14T11:08:20.733145+0000","objects_scrubbed":0,"log_size":81,"log_dups_size":100,"ondisk_log_size":81,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:06:38.749956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":15303696,"num_objects":10,"num_object_clones":0,"num_object_copies":30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":608,"num_read_kb":79965,"num_write":844,"num_write_kb":37043,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,1],"acting":[2,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"267'411","reported_seq":2113,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:01:39.424555+0000","last_change":"2024-09-14T11:08:23.803099+0000","last_active":"2024-09-14T13:01:39.424555+0000","last_peered":"2024-09-14T13:01:39.424555+0000","last_clean":"2024-09-14T13:01:39.424555+0000","last_became_active":"2024-09-14T11:08:23.802357+0000","last_became_peered":"2024-09-14T11:08:23.802357+0000","last_unstale":"2024-09-14T13:01:39.424555+0000","last_undegraded":"2024-09-14T13:01:39.424555+0000","last_fullsized":"2024-09-14T13:01:39.424555+0000","mapping_epoch":26,"log_start":"267'400","ondisk_log_start":"267'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:08:22.750609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:08:22.750609+0000","last_clean_scrub_stamp":"2024-09-14T11:08:22.750609+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":400,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:31:47.027216+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2549,"num_read_kb":2448,"num_write":474,"num_write_kb":95,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2f","version":"267'222","reported_seq":946,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:58:03.035502+0000","last_change":"2024-09-14T11:08:55.885757+0000","last_active":"2024-09-14T12:58:03.035502+0000","last_peered":"2024-09-14T12:58:03.035502+0000","last_clean":"2024-09-14T12:58:03.035502+0000","last_became_active":"2024-09-14T11:08:55.884851+0000","last_became_peered":"2024-09-14T11:08:55.884851+0000","last_unstale":"2024-09-14T12:58:03.035502+0000","last_undegraded":"2024-09-14T12:58:03.035502+0000","last_fullsized":"2024-09-14T12:58:03.035502+0000","mapping_epoch":37,"log_start":"267'200","ondisk_log_start":"267'200","created":24,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:08:20.733145+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:08:20.733145+0000","last_clean_scrub_stamp":"2024-09-14T11:08:20.733145+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":200,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:34:33.364323+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5281584,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":796,"num_read_kb":23166,"num_write":997,"num_write_kb":40111,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,1],"acting":[5,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"267'224","reported_seq":911,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:58:39.623527+0000","last_change":"2024-09-14T11:08:56.035003+0000","last_active":"2024-09-14T12:58:39.623527+0000","last_peered":"2024-09-14T12:58:39.623527+0000","last_clean":"2024-09-14T12:58:39.623527+0000","last_became_active":"2024-09-14T11:08:56.033792+0000","last_became_peered":"2024-09-14T11:08:56.033792+0000","last_unstale":"2024-09-14T12:58:39.623527+0000","last_undegraded":"2024-09-14T12:58:39.623527+0000","last_fullsized":"2024-09-14T12:58:39.623527+0000","mapping_epoch":37,"log_start":"267'200","ondisk_log_start":"267'200","created":24,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:08:20.733145+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:08:20.733145+0000","last_clean_scrub_stamp":"2024-09-14T11:08:20.733145+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":200,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:06:53.712379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19922970,"num_objects":12,"num_object_clones":0,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":0,"num_read":569,"num_read_kb":92149,"num_write":1009,"num_write_kb":50173,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,0],"acting":[5,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.37","version":"267'500","reported_seq":2175,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:00:18.795316+0000","last_change":"2024-09-14T11:08:23.787116+0000","last_active":"2024-09-14T13:00:18.795316+0000","last_peered":"2024-09-14T13:00:18.795316+0000","last_clean":"2024-09-14T13:00:18.795316+0000","last_became_active":"2024-09-14T11:08:23.786473+0000","last_became_peered":"2024-09-14T11:08:23.786473+0000","last_unstale":"2024-09-14T13:00:18.795316+0000","last_undegraded":"2024-09-14T13:00:18.795316+0000","last_fullsized":"2024-09-14T13:00:18.795316+0000","mapping_epoch":26,"log_start":"267'400","ondisk_log_start":"267'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:08:22.750609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:08:22.750609+0000","last_clean_scrub_stamp":"2024-09-14T11:08:22.750609+0000","objects_scrubbed":0,"log_size":100,"log_dups_size":400,"ondisk_log_size":100,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:50:27.775627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2870,"num_read_kb":2681,"num_write":627,"num_write_kb":170,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"267'220","reported_seq":890,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:59:58.484286+0000","last_change":"2024-09-14T11:08:21.816970+0000","last_active":"2024-09-14T12:59:58.484286+0000","last_peered":"2024-09-14T12:59:58.484286+0000","last_clean":"2024-09-14T12:59:58.484286+0000","last_became_active":"2024-09-14T11:08:21.815731+0000","last_became_peered":"2024-09-14T11:08:21.815731+0000","last_unstale":"2024-09-14T12:59:58.484286+0000","last_undegraded":"2024-09-14T12:59:58.484286+0000","last_fullsized":"2024-09-14T12:59:58.484286+0000","mapping_epoch":24,"log_start":"267'200","ondisk_log_start":"267'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:08:20.733145+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:08:20.733145+0000","last_clean_scrub_stamp":"2024-09-14T11:08:20.733145+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":200,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:24:40.198696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6363857,"num_objects":12,"num_object_clones":0,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":0,"num_read":588,"num_read_kb":25561,"num_write":997,"num_write_kb":42149,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,5],"acting":[1,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.36","version":"267'907","reported_seq":2493,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:58:11.332731+0000","last_change":"2024-09-14T11:08:23.797836+0000","last_active":"2024-09-14T12:58:11.332731+0000","last_peered":"2024-09-14T12:58:11.332731+0000","last_clean":"2024-09-14T12:58:11.332731+0000","last_became_active":"2024-09-14T11:08:23.797135+0000","last_became_peered":"2024-09-14T11:08:23.797135+0000","last_unstale":"2024-09-14T12:58:11.332731+0000","last_undegraded":"2024-09-14T12:58:11.332731+0000","last_fullsized":"2024-09-14T12:58:11.332731+0000","mapping_epoch":26,"log_start":"267'800","ondisk_log_start":"267'800","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:08:22.750609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:08:22.750609+0000","last_clean_scrub_stamp":"2024-09-14T11:08:22.750609+0000","objects_scrubbed":0,"log_size":107,"log_dups_size":800,"ondisk_log_size":107,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:35:11.421873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4302,"num_read_kb":3816,"num_write":1266,"num_write_kb":491,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]}],"pool_stats":[{"poolid":65,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10893,"num_read_kb":9222,"num_write":3117,"num_write_kb":1014,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1012,"ondisk_log_size":1012,"up":64,"acting":64,"num_store_stats":8},{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":14831,"num_objects":87,"num_object_clones":0,"num_object_copies":174,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":87,"num_whiteouts":0,"num_read":15223,"num_read_kb":14878,"num_write":17077,"num_write_kb":4995,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":19,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":557056,"data_stored":29662,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1708,"ondisk_log_size":1708,"up":64,"acting":64,"num_store_stats":8},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":540,"ondisk_log_size":540,"up":64,"acting":64,"num_store_stats":8},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":543921,"num_objects":199,"num_object_clones":0,"num_object_copies":398,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":199,"num_whiteouts":0,"num_read":11694,"num_read_kb":13819,"num_write":8553,"num_write_kb":3787,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":23,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":786432,"data_stored":263102,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1984,"ondisk_log_size":1984,"up":64,"acting":64,"num_store_stats":8},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":1793,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":2373,"num_read_kb":2833,"num_write":20,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":3586,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":11,"ondisk_log_size":11,"up":64,"acting":64,"num_store_stats":8},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":143,"num_object_clones":0,"num_object_copies":286,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":143,"num_whiteouts":0,"num_read":221865,"num_read_kb":203092,"num_write":56157,"num_write_kb":19250,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":143,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3675,"ondisk_log_size":3675,"up":128,"acting":128,"num_store_stats":8},{"poolid":68,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":12,"num_read_kb":12,"num_write":18,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":6,"ondisk_log_size":6,"up":64,"acting":64,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":565949976,"num_objects":497,"num_object_clones":0,"num_object_copies":1491,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":497,"num_whiteouts":0,"num_read":42552,"num_read_kb":2820640,"num_write":64136,"num_write_kb":2216242,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":851558400,"data_stored":851558400,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3742,"ondisk_log_size":3742,"up":192,"acting":192,"num_store_stats":8},{"poolid":67,"num_pg":32,"stat_sum":{"num_bytes":73109320,"num_objects":28,"num_object_clones":0,"num_object_copies":56,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":28,"num_whiteouts":0,"num_read":144,"num_read_kb":198130,"num_write":158,"num_write_kb":125738,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":146227200,"data_stored":146218640,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":98,"ondisk_log_size":98,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":7},{"poolid":66,"num_pg":32,"stat_sum":{"num_bytes":73109320,"num_objects":28,"num_object_clones":0,"num_object_copies":56,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":28,"num_whiteouts":0,"num_read":140,"num_read_kb":188216,"num_write":158,"num_write_kb":125738,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":146227200,"data_stored":146218640,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":98,"ondisk_log_size":98,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834576217,"num_pgs":106,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":369872,"kb_used_data":131840,"kb_used_omap":1,"kb_used_meta":238014,"kb_avail":94001968,"statfs":{"total":96636764160,"available":96258015232,"internally_reserved":0,"allocated":135004160,"data_stored":132821830,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":243726794},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":13,"seq":55834576223,"num_pgs":99,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":378220,"kb_used_data":144348,"kb_used_omap":1,"kb_used_meta":233854,"kb_avail":93993620,"statfs":{"total":96636764160,"available":96249466880,"internally_reserved":0,"allocated":147812352,"data_stored":145699147,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":239466950},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":13,"seq":55834576221,"num_pgs":103,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":226132,"kb_used_data":132484,"kb_used_omap":1,"kb_used_meta":93630,"kb_avail":94145708,"statfs":{"total":96636764160,"available":96405204992,"internally_reserved":0,"allocated":135663616,"data_stored":133464106,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":95877573},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834576222,"num_pgs":105,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":253236,"kb_used_data":145700,"kb_used_omap":1,"kb_used_meta":107518,"kb_avail":94118604,"statfs":{"total":96636764160,"available":96377450496,"internally_reserved":0,"allocated":149196800,"data_stored":147124325,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":110098885},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":13,"seq":55834576224,"num_pgs":124,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":396684,"kb_used_data":166972,"kb_used_omap":1,"kb_used_meta":229694,"kb_avail":93975156,"statfs":{"total":96636764160,"available":96230559744,"internally_reserved":0,"allocated":170979328,"data_stored":168801388,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":235207111},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834576221,"num_pgs":92,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":195020,"kb_used_data":127740,"kb_used_omap":1,"kb_used_meta":67262,"kb_avail":94176820,"statfs":{"total":96636764160,"available":96437063680,"internally_reserved":0,"allocated":130805760,"data_stored":128711851,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":68876741},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834576224,"num_pgs":112,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":281780,"kb_used_data":146532,"kb_used_omap":1,"kb_used_meta":135230,"kb_avail":94090060,"statfs":{"total":96636764160,"available":96348221440,"internally_reserved":0,"allocated":150048768,"data_stored":147909730,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":138475973},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834576222,"num_pgs":109,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":387488,"kb_used_data":157776,"kb_used_omap":1,"kb_used_meta":229694,"kb_avail":93984352,"statfs":{"total":96636764160,"available":96239976448,"internally_reserved":0,"allocated":161562624,"data_stored":159400235,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":235207109},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":112717824,"data_stored":112717824,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":95555584,"data_stored":95555584,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":83353600,"data_stored":83353600,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":111874048,"data_stored":111874048,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":110538752,"data_stored":110538752,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":119562240,"data_stored":119562240,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":105943040,"data_stored":105943040,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":112013312,"data_stored":112013312,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":1139,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":46,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":1185,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":562,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":184,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":470,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":98304,"data_stored":30908,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":114688,"data_stored":43011,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":10532,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":143360,"data_stored":49148,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":6107,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":159744,"data_stored":55366,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":81920,"data_stored":27675,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":135168,"data_stored":40355,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":86016,"data_stored":3328,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":3091,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4091,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":86016,"data_stored":4619,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":2771,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":77824,"data_stored":4485,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":2895,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":86016,"data_stored":4382,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":25923584,"data_stored":25920194,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":27267072,"data_stored":27266182,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":9437184,"data_stored":9437184,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":19922944,"data_stored":19922944,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20971520,"data_stored":20971520,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":10485760,"data_stored":10485760,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":23789568,"data_stored":23786103,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8429568,"data_stored":8428753,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":17829888,"data_stored":17828998,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":22736896,"data_stored":22734321,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":33599488,"data_stored":33597783,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":34643968,"data_stored":34643153,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":13299712,"data_stored":13297137,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":1048576,"data_stored":1048576,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":13631488,"data_stored":13631488,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":9437184,"data_stored":9437184,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-14T13:02:02.616 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-14T13:02:02.927 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-09-14T13:02:02.928 INFO:teuthology.orchestra.run.smithi138.stdout:{"epoch":267,"fsid":"3f225f43-83a6-4aeb-b798-1f04bb49d597","created":"2024-09-14T11:07:49.131734+0000","modified":"2024-09-14T11:58:44.641586+0000","last_up_change":"2024-09-14T11:08:01.813597+0000","last_in_change":"2024-09-14T11:07:51.476209+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":15,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":68,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-14T11:08:02.694350+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2024-09-14T11:08:07.362288+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":2,"snap_epoch":20,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"default.rgw.buckets.data","create_time":"2024-09-14T11:08:19.737797+0000","flags":1,"flags_names":"hashpspool","type":3,"size":3,"min_size":2,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"26","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"client.0","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}}},{"pool":4,"pool_name":"default.rgw.buckets.index","create_time":"2024-09-14T11:08:22.118794+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"28","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}},"read_balance":{"score_type":"Fair distribution","score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":".rgw.root","create_time":"2024-09-14T11:08:23.890036+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"30","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"default.rgw.log","create_time":"2024-09-14T11:08:25.898912+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"32","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"default.rgw.control","create_time":"2024-09-14T11:08:27.824213+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"34","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"default.rgw.meta","create_time":"2024-09-14T11:08:29.963470+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"36","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4},"application_metadata":{"rgw":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":65,"pool_name":"default.rgw.buckets.non-ec","create_time":"2024-09-14T11:24:08.482830+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"256","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":66,"pool_name":"default.rgw.buckets.data.frozen","create_time":"2024-09-14T11:30:09.364129+0000","flags":131073,"flags_names":"hashpspool,bulk","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"259","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":67,"pool_name":"default.rgw.buckets.data.lukewarm","create_time":"2024-09-14T11:30:15.939497+0000","flags":131073,"flags_names":"hashpspool,bulk","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"262","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":68,"pool_name":"default.rgw.otp","create_time":"2024-09-14T11:58:41.921756+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"267","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"947de938-c674-418d-972a-cff0472a9a26","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":265,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6816","nonce":326481658},{"type":"v1","addr":"172.21.15.138:6817","nonce":326481658}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6818","nonce":326481658},{"type":"v1","addr":"172.21.15.138:6819","nonce":326481658}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6822","nonce":326481658},{"type":"v1","addr":"172.21.15.138:6823","nonce":326481658}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6820","nonce":326481658},{"type":"v1","addr":"172.21.15.138:6821","nonce":326481658}]},"public_addr":"172.21.15.138:6817/326481658","cluster_addr":"172.21.15.138:6819/326481658","heartbeat_back_addr":"172.21.15.138:6823/326481658","heartbeat_front_addr":"172.21.15.138:6821/326481658","state":["exists","up"]},{"osd":1,"uuid":"7ac84832-0a45-44f5-81fb-e1b7242c6a8f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":265,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6800","nonce":1799335858},{"type":"v1","addr":"172.21.15.138:6801","nonce":1799335858}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6802","nonce":1799335858},{"type":"v1","addr":"172.21.15.138:6803","nonce":1799335858}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6806","nonce":1799335858},{"type":"v1","addr":"172.21.15.138:6807","nonce":1799335858}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6804","nonce":1799335858},{"type":"v1","addr":"172.21.15.138:6805","nonce":1799335858}]},"public_addr":"172.21.15.138:6801/1799335858","cluster_addr":"172.21.15.138:6803/1799335858","heartbeat_back_addr":"172.21.15.138:6807/1799335858","heartbeat_front_addr":"172.21.15.138:6805/1799335858","state":["exists","up"]},{"osd":2,"uuid":"ef3e736d-f269-4fca-8ccf-f803d70c763f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":265,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6824","nonce":2633984942},{"type":"v1","addr":"172.21.15.138:6825","nonce":2633984942}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6826","nonce":2633984942},{"type":"v1","addr":"172.21.15.138:6827","nonce":2633984942}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6830","nonce":2633984942},{"type":"v1","addr":"172.21.15.138:6831","nonce":2633984942}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6828","nonce":2633984942},{"type":"v1","addr":"172.21.15.138:6829","nonce":2633984942}]},"public_addr":"172.21.15.138:6825/2633984942","cluster_addr":"172.21.15.138:6827/2633984942","heartbeat_back_addr":"172.21.15.138:6831/2633984942","heartbeat_front_addr":"172.21.15.138:6829/2633984942","state":["exists","up"]},{"osd":3,"uuid":"5462705a-cf30-4d3f-88d7-f9ae0ed6e95a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":265,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6808","nonce":3258321916},{"type":"v1","addr":"172.21.15.138:6809","nonce":3258321916}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6810","nonce":3258321916},{"type":"v1","addr":"172.21.15.138:6811","nonce":3258321916}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6814","nonce":3258321916},{"type":"v1","addr":"172.21.15.138:6815","nonce":3258321916}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6812","nonce":3258321916},{"type":"v1","addr":"172.21.15.138:6813","nonce":3258321916}]},"public_addr":"172.21.15.138:6809/3258321916","cluster_addr":"172.21.15.138:6811/3258321916","heartbeat_back_addr":"172.21.15.138:6815/3258321916","heartbeat_front_addr":"172.21.15.138:6813/3258321916","state":["exists","up"]},{"osd":4,"uuid":"22e8be21-7053-4e2f-9c88-a250c5e33e7a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":265,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6824","nonce":416768175},{"type":"v1","addr":"172.21.15.154:6825","nonce":416768175}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6826","nonce":416768175},{"type":"v1","addr":"172.21.15.154:6827","nonce":416768175}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6830","nonce":416768175},{"type":"v1","addr":"172.21.15.154:6831","nonce":416768175}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6828","nonce":416768175},{"type":"v1","addr":"172.21.15.154:6829","nonce":416768175}]},"public_addr":"172.21.15.154:6825/416768175","cluster_addr":"172.21.15.154:6827/416768175","heartbeat_back_addr":"172.21.15.154:6831/416768175","heartbeat_front_addr":"172.21.15.154:6829/416768175","state":["exists","up"]},{"osd":5,"uuid":"2335b408-831d-400d-bf15-1942f44cfaef","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":265,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6800","nonce":3926081546},{"type":"v1","addr":"172.21.15.154:6801","nonce":3926081546}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6802","nonce":3926081546},{"type":"v1","addr":"172.21.15.154:6803","nonce":3926081546}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6806","nonce":3926081546},{"type":"v1","addr":"172.21.15.154:6807","nonce":3926081546}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6804","nonce":3926081546},{"type":"v1","addr":"172.21.15.154:6805","nonce":3926081546}]},"public_addr":"172.21.15.154:6801/3926081546","cluster_addr":"172.21.15.154:6803/3926081546","heartbeat_back_addr":"172.21.15.154:6807/3926081546","heartbeat_front_addr":"172.21.15.154:6805/3926081546","state":["exists","up"]},{"osd":6,"uuid":"54ab7858-af15-486f-9cfb-626e1541c86d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":265,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6816","nonce":1950550278},{"type":"v1","addr":"172.21.15.154:6817","nonce":1950550278}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6818","nonce":1950550278},{"type":"v1","addr":"172.21.15.154:6819","nonce":1950550278}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6822","nonce":1950550278},{"type":"v1","addr":"172.21.15.154:6823","nonce":1950550278}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6820","nonce":1950550278},{"type":"v1","addr":"172.21.15.154:6821","nonce":1950550278}]},"public_addr":"172.21.15.154:6817/1950550278","cluster_addr":"172.21.15.154:6819/1950550278","heartbeat_back_addr":"172.21.15.154:6823/1950550278","heartbeat_front_addr":"172.21.15.154:6821/1950550278","state":["exists","up"]},{"osd":7,"uuid":"a28d625e-6b5e-4a31-a651-dc89943d6a84","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":265,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6808","nonce":1468088432},{"type":"v1","addr":"172.21.15.154:6809","nonce":1468088432}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6810","nonce":1468088432},{"type":"v1","addr":"172.21.15.154:6811","nonce":1468088432}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6814","nonce":1468088432},{"type":"v1","addr":"172.21.15.154:6815","nonce":1468088432}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6812","nonce":1468088432},{"type":"v1","addr":"172.21.15.154:6813","nonce":1468088432}]},"public_addr":"172.21.15.154:6809/1468088432","cluster_addr":"172.21.15.154:6811/1468088432","heartbeat_back_addr":"172.21.15.154:6815/1468088432","heartbeat_front_addr":"172.21.15.154:6813/1468088432","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-14T11:07:58.266821+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-14T11:07:58.079344+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-14T11:07:58.300648+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-14T11:07:58.103923+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-14T11:07:58.446255+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-14T11:07:58.417224+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-14T11:07:58.686449+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-14T11:07:58.283669+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.6","mappings":[{"from":0,"to":2}]},{"pgid":"3.11","mappings":[{"from":7,"to":2}]},{"pgid":"3.14","mappings":[{"from":4,"to":2}]},{"pgid":"3.19","mappings":[{"from":3,"to":2}]},{"pgid":"3.1b","mappings":[{"from":0,"to":2}]},{"pgid":"3.27","mappings":[{"from":3,"to":1}]},{"pgid":"3.29","mappings":[{"from":3,"to":2}]},{"pgid":"3.2a","mappings":[{"from":6,"to":1}]},{"pgid":"3.2f","mappings":[{"from":4,"to":1}]},{"pgid":"3.30","mappings":[{"from":4,"to":2}]},{"pgid":"4.7","mappings":[{"from":1,"to":2}]},{"pgid":"4.17","mappings":[{"from":3,"to":2}]},{"pgid":"67.a","mappings":[{"from":3,"to":0}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"client.0":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":26,"snaps":[{"begin":1,"length":2}]},{"pool":31,"snaps":[{"begin":1,"length":2}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-14T13:02:03.947 INFO:tasks.ceph:Scrubbing osd.0 2024-09-14T13:02:03.947 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 config set osd_debug_deep_scrub_sleep 0 2024-09-14T13:02:04.113 INFO:teuthology.orchestra.run.smithi138.stdout:{ 2024-09-14T13:02:04.114 INFO:teuthology.orchestra.run.smithi138.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-14T13:02:04.114 INFO:teuthology.orchestra.run.smithi138.stdout:} 2024-09-14T13:02:04.131 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 0 2024-09-14T13:02:04.437 INFO:teuthology.orchestra.run.smithi138.stderr:instructed osd(s) 0 to deep-scrub 2024-09-14T13:02:04.458 INFO:tasks.ceph:Scrubbing osd.1 2024-09-14T13:02:04.458 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 config set osd_debug_deep_scrub_sleep 0 2024-09-14T13:02:04.610 INFO:teuthology.orchestra.run.smithi138.stdout:{ 2024-09-14T13:02:04.611 INFO:teuthology.orchestra.run.smithi138.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-14T13:02:04.611 INFO:teuthology.orchestra.run.smithi138.stdout:} 2024-09-14T13:02:04.628 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 1 2024-09-14T13:02:04.922 INFO:teuthology.orchestra.run.smithi138.stderr:instructed osd(s) 1 to deep-scrub 2024-09-14T13:02:04.941 INFO:tasks.ceph:Scrubbing osd.2 2024-09-14T13:02:04.942 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 config set osd_debug_deep_scrub_sleep 0 2024-09-14T13:02:05.087 INFO:teuthology.orchestra.run.smithi138.stdout:{ 2024-09-14T13:02:05.088 INFO:teuthology.orchestra.run.smithi138.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-14T13:02:05.088 INFO:teuthology.orchestra.run.smithi138.stdout:} 2024-09-14T13:02:05.104 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 2 2024-09-14T13:02:05.389 INFO:teuthology.orchestra.run.smithi138.stderr:instructed osd(s) 2 to deep-scrub 2024-09-14T13:02:05.408 INFO:tasks.ceph:Scrubbing osd.3 2024-09-14T13:02:05.408 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 config set osd_debug_deep_scrub_sleep 0 2024-09-14T13:02:05.545 INFO:teuthology.orchestra.run.smithi138.stdout:{ 2024-09-14T13:02:05.545 INFO:teuthology.orchestra.run.smithi138.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-14T13:02:05.545 INFO:teuthology.orchestra.run.smithi138.stdout:} 2024-09-14T13:02:05.560 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 3 2024-09-14T13:02:05.843 INFO:teuthology.orchestra.run.smithi138.stderr:instructed osd(s) 3 to deep-scrub 2024-09-14T13:02:05.861 INFO:tasks.ceph:Scrubbing osd.4 2024-09-14T13:02:05.861 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 config set osd_debug_deep_scrub_sleep 0 2024-09-14T13:02:06.002 INFO:teuthology.orchestra.run.smithi138.stdout:{ 2024-09-14T13:02:06.002 INFO:teuthology.orchestra.run.smithi138.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-14T13:02:06.002 INFO:teuthology.orchestra.run.smithi138.stdout:} 2024-09-14T13:02:06.017 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 4 2024-09-14T13:02:06.317 INFO:teuthology.orchestra.run.smithi138.stderr:instructed osd(s) 4 to deep-scrub 2024-09-14T13:02:06.336 INFO:tasks.ceph:Scrubbing osd.5 2024-09-14T13:02:06.336 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 config set osd_debug_deep_scrub_sleep 0 2024-09-14T13:02:06.478 INFO:teuthology.orchestra.run.smithi138.stdout:{ 2024-09-14T13:02:06.478 INFO:teuthology.orchestra.run.smithi138.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-14T13:02:06.478 INFO:teuthology.orchestra.run.smithi138.stdout:} 2024-09-14T13:02:06.493 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 5 2024-09-14T13:02:06.767 INFO:teuthology.orchestra.run.smithi138.stderr:instructed osd(s) 5 to deep-scrub 2024-09-14T13:02:06.786 INFO:tasks.ceph:Scrubbing osd.6 2024-09-14T13:02:06.786 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 config set osd_debug_deep_scrub_sleep 0 2024-09-14T13:02:06.923 INFO:teuthology.orchestra.run.smithi138.stdout:{ 2024-09-14T13:02:06.923 INFO:teuthology.orchestra.run.smithi138.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-14T13:02:06.923 INFO:teuthology.orchestra.run.smithi138.stdout:} 2024-09-14T13:02:06.938 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 6 2024-09-14T13:02:07.235 INFO:teuthology.orchestra.run.smithi138.stderr:instructed osd(s) 6 to deep-scrub 2024-09-14T13:02:07.254 INFO:tasks.ceph:Scrubbing osd.7 2024-09-14T13:02:07.254 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 config set osd_debug_deep_scrub_sleep 0 2024-09-14T13:02:07.400 INFO:teuthology.orchestra.run.smithi138.stdout:{ 2024-09-14T13:02:07.400 INFO:teuthology.orchestra.run.smithi138.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-14T13:02:07.400 INFO:teuthology.orchestra.run.smithi138.stdout:} 2024-09-14T13:02:07.415 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 7 2024-09-14T13:02:07.698 INFO:teuthology.orchestra.run.smithi138.stderr:instructed osd(s) 7 to deep-scrub 2024-09-14T13:02:07.718 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-14T13:02:08.036 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-09-14T13:02:08.048 INFO:teuthology.orchestra.run.smithi138.stderr:dumped all 2024-09-14T13:02:08.050 INFO:teuthology.orchestra.run.smithi138.stdout:{"pg_ready":true,"pg_map":{"version":3680,"stamp":"2024-09-14T13:02:07.296781+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":35056180,"num_objects":619,"num_object_clones":0,"num_object_copies":1404,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":619,"num_whiteouts":0,"num_read":305713,"num_read_kb":3451688,"num_write":150075,"num_write_kb":2498451,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":191,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":12756,"ondisk_log_size":12756,"up":850,"acting":850,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":850,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":1426776,"kb_used_data":87080,"kb_used_omap":12,"kb_used_meta":1339059,"kb_avail":753547944,"statfs":{"total":773094113280,"available":771633094656,"internally_reserved":0,"allocated":89169920,"data_stored":72298450,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":1371196976},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,1,1,0,1],"upper_bound":32},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-678263368,"num_objects":-387,"num_object_clones":0,"num_object_copies":-1105,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-387,"num_whiteouts":0,"num_read":751,"num_read_kb":791,"num_write":578,"num_write_kb":32,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.007823"},"pg_stats":[{"pgid":"68.1a","version":"0'0","reported_seq":38,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:58:43.044370+0000","last_change":"2024-09-14T11:58:43.698171+0000","last_active":"2024-09-14T12:58:43.044370+0000","last_peered":"2024-09-14T12:58:43.044370+0000","last_clean":"2024-09-14T12:58:43.044370+0000","last_became_active":"2024-09-14T11:58:43.694936+0000","last_became_peered":"2024-09-14T11:58:43.694936+0000","last_unstale":"2024-09-14T12:58:43.044370+0000","last_undegraded":"2024-09-14T12:58:43.044370+0000","last_fullsized":"2024-09-14T12:58:43.044370+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:58:42.635024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:58:42.635024+0000","last_clean_scrub_stamp":"2024-09-14T11:58:42.635024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:02:52.327879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.1d","version":"264'2","reported_seq":63,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:57:48.032148+0000","last_change":"2024-09-14T11:30:17.527028+0000","last_active":"2024-09-14T12:57:48.032148+0000","last_peered":"2024-09-14T12:57:48.032148+0000","last_clean":"2024-09-14T12:57:48.032148+0000","last_became_active":"2024-09-14T11:30:17.525157+0000","last_became_peered":"2024-09-14T11:30:17.525157+0000","last_unstale":"2024-09-14T12:57:48.032148+0000","last_undegraded":"2024-09-14T12:57:48.032148+0000","last_fullsized":"2024-09-14T12:57:48.032148+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:30:16.474654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:30:16.474654+0000","last_clean_scrub_stamp":"2024-09-14T11:30:16.474654+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:14:59.272162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":4096,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.1c","version":"267'6","reported_seq":76,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:00.023046+0000","last_change":"2024-09-14T11:30:10.466403+0000","last_active":"2024-09-14T13:02:00.023046+0000","last_peered":"2024-09-14T13:02:00.023046+0000","last_clean":"2024-09-14T13:02:00.023046+0000","last_became_active":"2024-09-14T11:30:10.460441+0000","last_became_peered":"2024-09-14T11:30:10.460441+0000","last_unstale":"2024-09-14T13:02:00.023046+0000","last_undegraded":"2024-09-14T13:02:00.023046+0000","last_fullsized":"2024-09-14T13:02:00.023046+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:30:09.411354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:30:09.411354+0000","last_clean_scrub_stamp":"2024-09-14T11:30:09.411354+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:47:20.165693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":6189,"num_write":6,"num_write_kb":5165,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.1f","version":"267'84","reported_seq":312,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:57:58.447987+0000","last_change":"2024-09-14T11:24:10.106139+0000","last_active":"2024-09-14T12:57:58.447987+0000","last_peered":"2024-09-14T12:57:58.447987+0000","last_clean":"2024-09-14T12:57:58.447987+0000","last_became_active":"2024-09-14T11:24:10.104105+0000","last_became_peered":"2024-09-14T11:24:10.104105+0000","last_unstale":"2024-09-14T12:57:58.447987+0000","last_undegraded":"2024-09-14T12:57:58.447987+0000","last_fullsized":"2024-09-14T12:57:58.447987+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:24:09.066501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:24:09.066501+0000","last_clean_scrub_stamp":"2024-09-14T11:24:09.066501+0000","objects_scrubbed":0,"log_size":84,"log_dups_size":0,"ondisk_log_size":84,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:25:27.324710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":704,"num_read_kb":504,"num_write":208,"num_write_kb":68,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.1b","version":"0'0","reported_seq":38,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:58:42.823851+0000","last_change":"2024-09-14T11:58:43.694459+0000","last_active":"2024-09-14T12:58:42.823851+0000","last_peered":"2024-09-14T12:58:42.823851+0000","last_clean":"2024-09-14T12:58:42.823851+0000","last_became_active":"2024-09-14T11:58:43.693847+0000","last_became_peered":"2024-09-14T11:58:43.693847+0000","last_unstale":"2024-09-14T12:58:42.823851+0000","last_undegraded":"2024-09-14T12:58:42.823851+0000","last_fullsized":"2024-09-14T12:58:42.823851+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:58:42.635024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:58:42.635024+0000","last_clean_scrub_stamp":"2024-09-14T11:58:42.635024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:49:04.187747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.1c","version":"267'9","reported_seq":74,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:00.330927+0000","last_change":"2024-09-14T11:30:17.525550+0000","last_active":"2024-09-14T13:02:00.330927+0000","last_peered":"2024-09-14T13:02:00.330927+0000","last_clean":"2024-09-14T13:02:00.330927+0000","last_became_active":"2024-09-14T11:30:17.524810+0000","last_became_peered":"2024-09-14T11:30:17.524810+0000","last_unstale":"2024-09-14T13:02:00.330927+0000","last_undegraded":"2024-09-14T13:02:00.330927+0000","last_fullsized":"2024-09-14T13:02:00.330927+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:30:16.474654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:30:16.474654+0000","last_clean_scrub_stamp":"2024-09-14T11:30:16.474654+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:05:01.153652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":11636,"num_write":14,"num_write_kb":6842,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.1d","version":"0'0","reported_seq":65,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:57:43.447885+0000","last_change":"2024-09-14T11:30:10.475624+0000","last_active":"2024-09-14T12:57:43.447885+0000","last_peered":"2024-09-14T12:57:43.447885+0000","last_clean":"2024-09-14T12:57:43.447885+0000","last_became_active":"2024-09-14T11:30:10.474889+0000","last_became_peered":"2024-09-14T11:30:10.474889+0000","last_unstale":"2024-09-14T12:57:43.447885+0000","last_undegraded":"2024-09-14T12:57:43.447885+0000","last_fullsized":"2024-09-14T12:57:43.447885+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:30:09.411354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:30:09.411354+0000","last_clean_scrub_stamp":"2024-09-14T11:30:09.411354+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:14:21.245898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.1e","version":"267'279","reported_seq":912,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:58:42.824027+0000","last_change":"2024-09-14T11:24:10.091187+0000","last_active":"2024-09-14T12:58:42.824027+0000","last_peered":"2024-09-14T12:58:42.824027+0000","last_clean":"2024-09-14T12:58:42.824027+0000","last_became_active":"2024-09-14T11:24:10.090434+0000","last_became_peered":"2024-09-14T11:24:10.090434+0000","last_unstale":"2024-09-14T12:58:42.824027+0000","last_undegraded":"2024-09-14T12:58:42.824027+0000","last_fullsized":"2024-09-14T12:58:42.824027+0000","mapping_epoch":254,"log_start":"264'200","ondisk_log_start":"264'200","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:24:09.066501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:24:09.066501+0000","last_clean_scrub_stamp":"2024-09-14T11:24:09.066501+0000","objects_scrubbed":0,"log_size":79,"log_dups_size":200,"ondisk_log_size":79,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:12:05.681242+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2587,"num_read_kb":3188,"num_write":542,"num_write_kb":246,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.18","version":"0'0","reported_seq":39,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:59:08.431805+0000","last_change":"2024-09-14T11:58:43.686083+0000","last_active":"2024-09-14T12:59:08.431805+0000","last_peered":"2024-09-14T12:59:08.431805+0000","last_clean":"2024-09-14T12:59:08.431805+0000","last_became_active":"2024-09-14T11:58:43.685333+0000","last_became_peered":"2024-09-14T11:58:43.685333+0000","last_unstale":"2024-09-14T12:59:08.431805+0000","last_undegraded":"2024-09-14T12:59:08.431805+0000","last_fullsized":"2024-09-14T12:59:08.431805+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:58:42.635024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:58:42.635024+0000","last_clean_scrub_stamp":"2024-09-14T11:58:42.635024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:32:25.076693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"67.1f","version":"267'4","reported_seq":74,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:01:58.286722+0000","last_change":"2024-09-14T11:30:17.501198+0000","last_active":"2024-09-14T13:01:58.286722+0000","last_peered":"2024-09-14T13:01:58.286722+0000","last_clean":"2024-09-14T13:01:58.286722+0000","last_became_active":"2024-09-14T11:30:17.500369+0000","last_became_peered":"2024-09-14T11:30:17.500369+0000","last_unstale":"2024-09-14T13:01:58.286722+0000","last_undegraded":"2024-09-14T13:01:58.286722+0000","last_fullsized":"2024-09-14T13:01:58.286722+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:30:16.474654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:30:16.474654+0000","last_clean_scrub_stamp":"2024-09-14T11:30:16.474654+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:11:41.361082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":8192,"num_write":4,"num_write_kb":8192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.1e","version":"264'4","reported_seq":84,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:58:42.824072+0000","last_change":"2024-09-14T11:30:10.446414+0000","last_active":"2024-09-14T12:58:42.824072+0000","last_peered":"2024-09-14T12:58:42.824072+0000","last_clean":"2024-09-14T12:58:42.824072+0000","last_became_active":"2024-09-14T11:30:10.445613+0000","last_became_peered":"2024-09-14T11:30:10.445613+0000","last_unstale":"2024-09-14T12:58:42.824072+0000","last_undegraded":"2024-09-14T12:58:42.824072+0000","last_fullsized":"2024-09-14T12:58:42.824072+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:30:09.411354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:30:09.411354+0000","last_clean_scrub_stamp":"2024-09-14T11:30:09.411354+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:21:50.415695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":4098,"num_write":4,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.1d","version":"267'16","reported_seq":119,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:59:13.248167+0000","last_change":"2024-09-14T11:24:10.112019+0000","last_active":"2024-09-14T12:59:13.248167+0000","last_peered":"2024-09-14T12:59:13.248167+0000","last_clean":"2024-09-14T12:59:13.248167+0000","last_became_active":"2024-09-14T11:24:10.111323+0000","last_became_peered":"2024-09-14T11:24:10.111323+0000","last_unstale":"2024-09-14T12:59:13.248167+0000","last_undegraded":"2024-09-14T12:59:13.248167+0000","last_fullsized":"2024-09-14T12:59:13.248167+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:24:09.066501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:24:09.066501+0000","last_clean_scrub_stamp":"2024-09-14T11:24:09.066501+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:39:25.435594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":134,"num_read_kb":93,"num_write":40,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.19","version":"0'0","reported_seq":39,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:59:18.471470+0000","last_change":"2024-09-14T11:58:43.701511+0000","last_active":"2024-09-14T12:59:18.471470+0000","last_peered":"2024-09-14T12:59:18.471470+0000","last_clean":"2024-09-14T12:59:18.471470+0000","last_became_active":"2024-09-14T11:58:43.700281+0000","last_became_peered":"2024-09-14T11:58:43.700281+0000","last_unstale":"2024-09-14T12:59:18.471470+0000","last_undegraded":"2024-09-14T12:59:18.471470+0000","last_fullsized":"2024-09-14T12:59:18.471470+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:58:42.635024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:58:42.635024+0000","last_clean_scrub_stamp":"2024-09-14T11:58:42.635024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:42:11.274748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.1e","version":"267'6","reported_seq":77,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:00.453729+0000","last_change":"2024-09-14T11:30:17.539744+0000","last_active":"2024-09-14T13:02:00.453729+0000","last_peered":"2024-09-14T13:02:00.453729+0000","last_clean":"2024-09-14T13:02:00.453729+0000","last_became_active":"2024-09-14T11:30:17.534642+0000","last_became_peered":"2024-09-14T11:30:17.534642+0000","last_unstale":"2024-09-14T13:02:00.453729+0000","last_undegraded":"2024-09-14T13:02:00.453729+0000","last_fullsized":"2024-09-14T13:02:00.453729+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:30:16.474654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:30:16.474654+0000","last_clean_scrub_stamp":"2024-09-14T11:30:16.474654+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:11:49.468312+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":1064,"num_write":6,"num_write_kb":2088,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.1f","version":"267'2","reported_seq":75,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:01:53.070938+0000","last_change":"2024-09-14T11:30:10.443371+0000","last_active":"2024-09-14T13:01:53.070938+0000","last_peered":"2024-09-14T13:01:53.070938+0000","last_clean":"2024-09-14T13:01:53.070938+0000","last_became_active":"2024-09-14T11:30:10.442597+0000","last_became_peered":"2024-09-14T11:30:10.442597+0000","last_unstale":"2024-09-14T13:01:53.070938+0000","last_undegraded":"2024-09-14T13:01:53.070938+0000","last_fullsized":"2024-09-14T13:01:53.070938+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:30:09.411354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:30:09.411354+0000","last_clean_scrub_stamp":"2024-09-14T11:30:09.411354+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:25:51.419864+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.1c","version":"267'41","reported_seq":188,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:59:13.470500+0000","last_change":"2024-09-14T11:24:10.128607+0000","last_active":"2024-09-14T12:59:13.470500+0000","last_peered":"2024-09-14T12:59:13.470500+0000","last_clean":"2024-09-14T12:59:13.470500+0000","last_became_active":"2024-09-14T11:24:10.124422+0000","last_became_peered":"2024-09-14T11:24:10.124422+0000","last_unstale":"2024-09-14T12:59:13.470500+0000","last_undegraded":"2024-09-14T12:59:13.470500+0000","last_fullsized":"2024-09-14T12:59:13.470500+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:24:09.066501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:24:09.066501+0000","last_clean_scrub_stamp":"2024-09-14T11:24:09.066501+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":0,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:13:03.605737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":350,"num_read_kb":247,"num_write":96,"num_write_kb":33,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.1e","version":"0'0","reported_seq":44,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:58:53.465451+0000","last_change":"2024-09-14T11:58:43.694842+0000","last_active":"2024-09-14T12:58:53.465451+0000","last_peered":"2024-09-14T12:58:53.465451+0000","last_clean":"2024-09-14T12:58:53.465451+0000","last_became_active":"2024-09-14T11:58:43.693760+0000","last_became_peered":"2024-09-14T11:58:43.693760+0000","last_unstale":"2024-09-14T12:58:53.465451+0000","last_undegraded":"2024-09-14T12:58:53.465451+0000","last_fullsized":"2024-09-14T12:58:53.465451+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:58:42.635024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:58:42.635024+0000","last_clean_scrub_stamp":"2024-09-14T11:58:42.635024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:18:34.791994+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.19","version":"0'0","reported_seq":60,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:57:43.030891+0000","last_change":"2024-09-14T11:30:17.531794+0000","last_active":"2024-09-14T12:57:43.030891+0000","last_peered":"2024-09-14T12:57:43.030891+0000","last_clean":"2024-09-14T12:57:43.030891+0000","last_became_active":"2024-09-14T11:30:17.531325+0000","last_became_peered":"2024-09-14T11:30:17.531325+0000","last_unstale":"2024-09-14T12:57:43.030891+0000","last_undegraded":"2024-09-14T12:57:43.030891+0000","last_fullsized":"2024-09-14T12:57:43.030891+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:30:16.474654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:30:16.474654+0000","last_clean_scrub_stamp":"2024-09-14T11:30:16.474654+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:04:12.434378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.18","version":"264'8","reported_seq":83,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:59:38.253969+0000","last_change":"2024-09-14T11:30:10.461819+0000","last_active":"2024-09-14T12:59:38.253969+0000","last_peered":"2024-09-14T12:59:38.253969+0000","last_clean":"2024-09-14T12:59:38.253969+0000","last_became_active":"2024-09-14T11:30:10.461101+0000","last_became_peered":"2024-09-14T11:30:10.461101+0000","last_unstale":"2024-09-14T12:59:38.253969+0000","last_undegraded":"2024-09-14T12:59:38.253969+0000","last_fullsized":"2024-09-14T12:59:38.253969+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:30:09.411354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:30:09.411354+0000","last_clean_scrub_stamp":"2024-09-14T11:30:09.411354+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:19:37.256749+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":8194,"num_write":18,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.1b","version":"264'28","reported_seq":149,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:59:13.470382+0000","last_change":"2024-09-14T11:24:10.130205+0000","last_active":"2024-09-14T12:59:13.470382+0000","last_peered":"2024-09-14T12:59:13.470382+0000","last_clean":"2024-09-14T12:59:13.470382+0000","last_became_active":"2024-09-14T11:24:10.129087+0000","last_became_peered":"2024-09-14T11:24:10.129087+0000","last_unstale":"2024-09-14T12:59:13.470382+0000","last_undegraded":"2024-09-14T12:59:13.470382+0000","last_fullsized":"2024-09-14T12:59:13.470382+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:24:09.066501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:24:09.066501+0000","last_clean_scrub_stamp":"2024-09-14T11:24:09.066501+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:55:41.881393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":229,"num_read_kb":159,"num_write":68,"num_write_kb":22,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.1f","version":"0'0","reported_seq":43,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:59:08.466883+0000","last_change":"2024-09-14T11:58:43.686856+0000","last_active":"2024-09-14T12:59:08.466883+0000","last_peered":"2024-09-14T12:59:08.466883+0000","last_clean":"2024-09-14T12:59:08.466883+0000","last_became_active":"2024-09-14T11:58:43.676679+0000","last_became_peered":"2024-09-14T11:58:43.676679+0000","last_unstale":"2024-09-14T12:59:08.466883+0000","last_undegraded":"2024-09-14T12:59:08.466883+0000","last_fullsized":"2024-09-14T12:59:08.466883+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:58:42.635024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:58:42.635024+0000","last_clean_scrub_stamp":"2024-09-14T11:58:42.635024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:32:45.311295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"67.18","version":"264'8","reported_seq":78,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:57:18.599896+0000","last_change":"2024-09-14T11:30:17.546333+0000","last_active":"2024-09-14T12:57:18.599896+0000","last_peered":"2024-09-14T12:57:18.599896+0000","last_clean":"2024-09-14T12:57:18.599896+0000","last_became_active":"2024-09-14T11:30:17.545478+0000","last_became_peered":"2024-09-14T11:30:17.545478+0000","last_unstale":"2024-09-14T12:57:18.599896+0000","last_undegraded":"2024-09-14T12:57:18.599896+0000","last_fullsized":"2024-09-14T12:57:18.599896+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:30:16.474654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:30:16.474654+0000","last_clean_scrub_stamp":"2024-09-14T11:30:16.474654+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:21:51.712103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":4166,"num_write":8,"num_write_kb":1092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"66.19","version":"267'7","reported_seq":76,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:00.190828+0000","last_change":"2024-09-14T11:30:10.467953+0000","last_active":"2024-09-14T13:02:00.190828+0000","last_peered":"2024-09-14T13:02:00.190828+0000","last_clean":"2024-09-14T13:02:00.190828+0000","last_became_active":"2024-09-14T11:30:10.467266+0000","last_became_peered":"2024-09-14T11:30:10.467266+0000","last_unstale":"2024-09-14T13:02:00.190828+0000","last_undegraded":"2024-09-14T13:02:00.190828+0000","last_fullsized":"2024-09-14T13:02:00.190828+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:30:09.411354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:30:09.411354+0000","last_clean_scrub_stamp":"2024-09-14T11:30:09.411354+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:25:57.710422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":1047,"num_write":12,"num_write_kb":2071,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.1a","version":"267'87","reported_seq":314,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:59:13.433017+0000","last_change":"2024-09-14T11:24:10.121775+0000","last_active":"2024-09-14T12:59:13.433017+0000","last_peered":"2024-09-14T12:59:13.433017+0000","last_clean":"2024-09-14T12:59:13.433017+0000","last_became_active":"2024-09-14T11:24:10.121048+0000","last_became_peered":"2024-09-14T11:24:10.121048+0000","last_unstale":"2024-09-14T12:59:13.433017+0000","last_undegraded":"2024-09-14T12:59:13.433017+0000","last_fullsized":"2024-09-14T12:59:13.433017+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:24:09.066501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:24:09.066501+0000","last_clean_scrub_stamp":"2024-09-14T11:24:09.066501+0000","objects_scrubbed":0,"log_size":87,"log_dups_size":0,"ondisk_log_size":87,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:56:22.236572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":696,"num_read_kb":437,"num_write":216,"num_write_kb":62,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.1c","version":"267'1","reported_seq":39,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:58:47.835392+0000","last_change":"2024-09-14T11:58:43.685706+0000","last_active":"2024-09-14T12:58:47.835392+0000","last_peered":"2024-09-14T12:58:47.835392+0000","last_clean":"2024-09-14T12:58:47.835392+0000","last_became_active":"2024-09-14T11:58:43.684984+0000","last_became_peered":"2024-09-14T11:58:43.684984+0000","last_unstale":"2024-09-14T12:58:47.835392+0000","last_undegraded":"2024-09-14T12:58:47.835392+0000","last_fullsized":"2024-09-14T12:58:47.835392+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:58:42.635024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:58:42.635024+0000","last_clean_scrub_stamp":"2024-09-14T11:58:42.635024+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:29:12.171056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.1b","version":"0'0","reported_seq":59,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:57:48.606470+0000","last_change":"2024-09-14T11:30:17.527032+0000","last_active":"2024-09-14T12:57:48.606470+0000","last_peered":"2024-09-14T12:57:48.606470+0000","last_clean":"2024-09-14T12:57:48.606470+0000","last_became_active":"2024-09-14T11:30:17.526195+0000","last_became_peered":"2024-09-14T11:30:17.526195+0000","last_unstale":"2024-09-14T12:57:48.606470+0000","last_undegraded":"2024-09-14T12:57:48.606470+0000","last_fullsized":"2024-09-14T12:57:48.606470+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:30:16.474654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:30:16.474654+0000","last_clean_scrub_stamp":"2024-09-14T11:30:16.474654+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:49:29.835475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"66.1a","version":"264'2","reported_seq":69,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:57:43.214859+0000","last_change":"2024-09-14T11:30:10.443423+0000","last_active":"2024-09-14T12:57:43.214859+0000","last_peered":"2024-09-14T12:57:43.214859+0000","last_clean":"2024-09-14T12:57:43.214859+0000","last_became_active":"2024-09-14T11:30:10.442753+0000","last_became_peered":"2024-09-14T11:30:10.442753+0000","last_unstale":"2024-09-14T12:57:43.214859+0000","last_undegraded":"2024-09-14T12:57:43.214859+0000","last_fullsized":"2024-09-14T12:57:43.214859+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:30:09.411354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:30:09.411354+0000","last_clean_scrub_stamp":"2024-09-14T11:30:09.411354+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:17:07.453981+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":4096,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.19","version":"267'12","reported_seq":105,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:58:53.242473+0000","last_change":"2024-09-14T11:24:10.099618+0000","last_active":"2024-09-14T12:58:53.242473+0000","last_peered":"2024-09-14T12:58:53.242473+0000","last_clean":"2024-09-14T12:58:53.242473+0000","last_became_active":"2024-09-14T11:24:10.098890+0000","last_became_peered":"2024-09-14T11:24:10.098890+0000","last_unstale":"2024-09-14T12:58:53.242473+0000","last_undegraded":"2024-09-14T12:58:53.242473+0000","last_fullsized":"2024-09-14T12:58:53.242473+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:24:09.066501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:24:09.066501+0000","last_clean_scrub_stamp":"2024-09-14T11:24:09.066501+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:33:18.468820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":81,"num_read_kb":53,"num_write":29,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.1d","version":"0'0","reported_seq":38,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:58:47.835476+0000","last_change":"2024-09-14T11:58:43.688034+0000","last_active":"2024-09-14T12:58:47.835476+0000","last_peered":"2024-09-14T12:58:47.835476+0000","last_clean":"2024-09-14T12:58:47.835476+0000","last_became_active":"2024-09-14T11:58:43.687072+0000","last_became_peered":"2024-09-14T11:58:43.687072+0000","last_unstale":"2024-09-14T12:58:47.835476+0000","last_undegraded":"2024-09-14T12:58:47.835476+0000","last_fullsized":"2024-09-14T12:58:47.835476+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:58:42.635024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:58:42.635024+0000","last_clean_scrub_stamp":"2024-09-14T11:58:42.635024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:54:30.111603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.1a","version":"0'0","reported_seq":59,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:57:48.450199+0000","last_change":"2024-09-14T11:30:17.535485+0000","last_active":"2024-09-14T12:57:48.450199+0000","last_peered":"2024-09-14T12:57:48.450199+0000","last_clean":"2024-09-14T12:57:48.450199+0000","last_became_active":"2024-09-14T11:30:17.534937+0000","last_became_peered":"2024-09-14T11:30:17.534937+0000","last_unstale":"2024-09-14T12:57:48.450199+0000","last_undegraded":"2024-09-14T12:57:48.450199+0000","last_fullsized":"2024-09-14T12:57:48.450199+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:30:16.474654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:30:16.474654+0000","last_clean_scrub_stamp":"2024-09-14T11:30:16.474654+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:48:56.727170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.1b","version":"267'6","reported_seq":76,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:00.396483+0000","last_change":"2024-09-14T11:30:10.461481+0000","last_active":"2024-09-14T13:02:00.396483+0000","last_peered":"2024-09-14T13:02:00.396483+0000","last_clean":"2024-09-14T13:02:00.396483+0000","last_became_active":"2024-09-14T11:30:10.460666+0000","last_became_peered":"2024-09-14T11:30:10.460666+0000","last_unstale":"2024-09-14T13:02:00.396483+0000","last_undegraded":"2024-09-14T13:02:00.396483+0000","last_fullsized":"2024-09-14T13:02:00.396483+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:30:09.411354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:30:09.411354+0000","last_clean_scrub_stamp":"2024-09-14T11:30:09.411354+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:56:08.121178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":14336,"num_write":6,"num_write_kb":10240,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.18","version":"267'142","reported_seq":495,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:58:28.457825+0000","last_change":"2024-09-14T11:24:10.121116+0000","last_active":"2024-09-14T12:58:28.457825+0000","last_peered":"2024-09-14T12:58:28.457825+0000","last_clean":"2024-09-14T12:58:28.457825+0000","last_became_active":"2024-09-14T11:24:10.117854+0000","last_became_peered":"2024-09-14T11:24:10.117854+0000","last_unstale":"2024-09-14T12:58:28.457825+0000","last_undegraded":"2024-09-14T12:58:28.457825+0000","last_fullsized":"2024-09-14T12:58:28.457825+0000","mapping_epoch":254,"log_start":"264'100","ondisk_log_start":"264'100","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:24:09.066501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:24:09.066501+0000","last_clean_scrub_stamp":"2024-09-14T11:24:09.066501+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":100,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:44:16.667239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1285,"num_read_kb":1365,"num_write":297,"num_write_kb":120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"68.12","version":"0'0","reported_seq":40,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:59:23.469971+0000","last_change":"2024-09-14T11:58:43.678310+0000","last_active":"2024-09-14T12:59:23.469971+0000","last_peered":"2024-09-14T12:59:23.469971+0000","last_clean":"2024-09-14T12:59:23.469971+0000","last_became_active":"2024-09-14T11:58:43.675254+0000","last_became_peered":"2024-09-14T11:58:43.675254+0000","last_unstale":"2024-09-14T12:59:23.469971+0000","last_undegraded":"2024-09-14T12:59:23.469971+0000","last_fullsized":"2024-09-14T12:59:23.469971+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:58:42.635024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:58:42.635024+0000","last_clean_scrub_stamp":"2024-09-14T11:58:42.635024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:53:22.218376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"67.15","version":"267'2","reported_seq":64,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:59:43.477265+0000","last_change":"2024-09-14T11:30:17.539875+0000","last_active":"2024-09-14T12:59:43.477265+0000","last_peered":"2024-09-14T12:59:43.477265+0000","last_clean":"2024-09-14T12:59:43.477265+0000","last_became_active":"2024-09-14T11:30:17.536010+0000","last_became_peered":"2024-09-14T11:30:17.536010+0000","last_unstale":"2024-09-14T12:59:43.477265+0000","last_undegraded":"2024-09-14T12:59:43.477265+0000","last_fullsized":"2024-09-14T12:59:43.477265+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:30:16.474654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:30:16.474654+0000","last_clean_scrub_stamp":"2024-09-14T11:30:16.474654+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:50:45.649965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":8192,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.14","version":"267'5","reported_seq":76,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:01:38.084001+0000","last_change":"2024-09-14T11:30:10.463826+0000","last_active":"2024-09-14T13:01:38.084001+0000","last_peered":"2024-09-14T13:01:38.084001+0000","last_clean":"2024-09-14T13:01:38.084001+0000","last_became_active":"2024-09-14T11:30:10.462605+0000","last_became_peered":"2024-09-14T11:30:10.462605+0000","last_unstale":"2024-09-14T13:01:38.084001+0000","last_undegraded":"2024-09-14T13:01:38.084001+0000","last_fullsized":"2024-09-14T13:01:38.084001+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:30:09.411354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:30:09.411354+0000","last_clean_scrub_stamp":"2024-09-14T11:30:09.411354+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:10:34.672801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5120,"num_write":10,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.17","version":"267'12","reported_seq":105,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:58:28.236663+0000","last_change":"2024-09-14T11:24:10.104884+0000","last_active":"2024-09-14T12:58:28.236663+0000","last_peered":"2024-09-14T12:58:28.236663+0000","last_clean":"2024-09-14T12:58:28.236663+0000","last_became_active":"2024-09-14T11:24:10.101934+0000","last_became_peered":"2024-09-14T11:24:10.101934+0000","last_unstale":"2024-09-14T12:58:28.236663+0000","last_undegraded":"2024-09-14T12:58:28.236663+0000","last_fullsized":"2024-09-14T12:58:28.236663+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:24:09.066501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:24:09.066501+0000","last_clean_scrub_stamp":"2024-09-14T11:24:09.066501+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:18:41.803884+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":86,"num_read_kb":56,"num_write":31,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.13","version":"267'1","reported_seq":41,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:59:22.832843+0000","last_change":"2024-09-14T11:58:43.676310+0000","last_active":"2024-09-14T12:59:22.832843+0000","last_peered":"2024-09-14T12:59:22.832843+0000","last_clean":"2024-09-14T12:59:22.832843+0000","last_became_active":"2024-09-14T11:58:43.675526+0000","last_became_peered":"2024-09-14T11:58:43.675526+0000","last_unstale":"2024-09-14T12:59:22.832843+0000","last_undegraded":"2024-09-14T12:59:22.832843+0000","last_fullsized":"2024-09-14T12:59:22.832843+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:58:42.635024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:58:42.635024+0000","last_clean_scrub_stamp":"2024-09-14T11:58:42.635024+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:44:06.879207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.14","version":"267'7","reported_seq":76,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:01:38.503480+0000","last_change":"2024-09-14T11:30:17.544306+0000","last_active":"2024-09-14T13:01:38.503480+0000","last_peered":"2024-09-14T13:01:38.503480+0000","last_clean":"2024-09-14T13:01:38.503480+0000","last_became_active":"2024-09-14T11:30:17.543741+0000","last_became_peered":"2024-09-14T11:30:17.543741+0000","last_unstale":"2024-09-14T13:01:38.503480+0000","last_undegraded":"2024-09-14T13:01:38.503480+0000","last_fullsized":"2024-09-14T13:01:38.503480+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:30:16.474654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:30:16.474654+0000","last_clean_scrub_stamp":"2024-09-14T11:30:16.474654+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:33:14.837541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":20482,"num_write":12,"num_write_kb":8192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.15","version":"267'3","reported_seq":72,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:00.466429+0000","last_change":"2024-09-14T11:30:10.468990+0000","last_active":"2024-09-14T13:02:00.466429+0000","last_peered":"2024-09-14T13:02:00.466429+0000","last_clean":"2024-09-14T13:02:00.466429+0000","last_became_active":"2024-09-14T11:30:10.468238+0000","last_became_peered":"2024-09-14T11:30:10.468238+0000","last_unstale":"2024-09-14T13:02:00.466429+0000","last_undegraded":"2024-09-14T13:02:00.466429+0000","last_fullsized":"2024-09-14T13:02:00.466429+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:30:09.411354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:30:09.411354+0000","last_clean_scrub_stamp":"2024-09-14T11:30:09.411354+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:48:16.808159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2048,"num_write":8,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.16","version":"267'33","reported_seq":168,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:58:28.459408+0000","last_change":"2024-09-14T11:24:10.129833+0000","last_active":"2024-09-14T12:58:28.459408+0000","last_peered":"2024-09-14T12:58:28.459408+0000","last_clean":"2024-09-14T12:58:28.459408+0000","last_became_active":"2024-09-14T11:24:10.128354+0000","last_became_peered":"2024-09-14T11:24:10.128354+0000","last_unstale":"2024-09-14T12:58:28.459408+0000","last_undegraded":"2024-09-14T12:58:28.459408+0000","last_fullsized":"2024-09-14T12:58:28.459408+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:24:09.066501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:24:09.066501+0000","last_clean_scrub_stamp":"2024-09-14T11:24:09.066501+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:04:36.875537+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":269,"num_read_kb":173,"num_write":83,"num_write_kb":23,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.10","version":"0'0","reported_seq":40,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:59:27.844631+0000","last_change":"2024-09-14T11:58:43.689414+0000","last_active":"2024-09-14T12:59:27.844631+0000","last_peered":"2024-09-14T12:59:27.844631+0000","last_clean":"2024-09-14T12:59:27.844631+0000","last_became_active":"2024-09-14T11:58:43.688698+0000","last_became_peered":"2024-09-14T11:58:43.688698+0000","last_unstale":"2024-09-14T12:59:27.844631+0000","last_undegraded":"2024-09-14T12:59:27.844631+0000","last_fullsized":"2024-09-14T12:59:27.844631+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:58:42.635024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:58:42.635024+0000","last_clean_scrub_stamp":"2024-09-14T11:58:42.635024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:13:07.184551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.17","version":"267'5","reported_seq":70,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:00.037269+0000","last_change":"2024-09-14T11:30:17.544374+0000","last_active":"2024-09-14T13:02:00.037269+0000","last_peered":"2024-09-14T13:02:00.037269+0000","last_clean":"2024-09-14T13:02:00.037269+0000","last_became_active":"2024-09-14T11:30:17.543802+0000","last_became_peered":"2024-09-14T11:30:17.543802+0000","last_unstale":"2024-09-14T13:02:00.037269+0000","last_undegraded":"2024-09-14T13:02:00.037269+0000","last_fullsized":"2024-09-14T13:02:00.037269+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:30:16.474654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:30:16.474654+0000","last_clean_scrub_stamp":"2024-09-14T11:30:16.474654+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:16:04.970158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":20480,"num_write":10,"num_write_kb":8192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.16","version":"264'4","reported_seq":77,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:59:37.836003+0000","last_change":"2024-09-14T11:30:10.472659+0000","last_active":"2024-09-14T12:59:37.836003+0000","last_peered":"2024-09-14T12:59:37.836003+0000","last_clean":"2024-09-14T12:59:37.836003+0000","last_became_active":"2024-09-14T11:30:10.471956+0000","last_became_peered":"2024-09-14T11:30:10.471956+0000","last_unstale":"2024-09-14T12:59:37.836003+0000","last_undegraded":"2024-09-14T12:59:37.836003+0000","last_fullsized":"2024-09-14T12:59:37.836003+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:30:09.411354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:30:09.411354+0000","last_clean_scrub_stamp":"2024-09-14T11:30:09.411354+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:46:34.361903+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":4098,"num_write":4,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.15","version":"267'34","reported_seq":165,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:58:27.820574+0000","last_change":"2024-09-14T11:24:10.097703+0000","last_active":"2024-09-14T12:58:27.820574+0000","last_peered":"2024-09-14T12:58:27.820574+0000","last_clean":"2024-09-14T12:58:27.820574+0000","last_became_active":"2024-09-14T11:24:10.097011+0000","last_became_peered":"2024-09-14T11:24:10.097011+0000","last_unstale":"2024-09-14T12:58:27.820574+0000","last_undegraded":"2024-09-14T12:58:27.820574+0000","last_fullsized":"2024-09-14T12:58:27.820574+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:24:09.066501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:24:09.066501+0000","last_clean_scrub_stamp":"2024-09-14T11:24:09.066501+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:37:34.066370+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":263,"num_read_kb":166,"num_write":89,"num_write_kb":24,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.11","version":"0'0","reported_seq":40,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:59:23.053229+0000","last_change":"2024-09-14T11:58:43.689926+0000","last_active":"2024-09-14T12:59:23.053229+0000","last_peered":"2024-09-14T12:59:23.053229+0000","last_clean":"2024-09-14T12:59:23.053229+0000","last_became_active":"2024-09-14T11:58:43.688315+0000","last_became_peered":"2024-09-14T11:58:43.688315+0000","last_unstale":"2024-09-14T12:59:23.053229+0000","last_undegraded":"2024-09-14T12:59:23.053229+0000","last_fullsized":"2024-09-14T12:59:23.053229+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:58:42.635024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:58:42.635024+0000","last_clean_scrub_stamp":"2024-09-14T11:58:42.635024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:41:40.616158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.16","version":"0'0","reported_seq":60,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:57:18.209507+0000","last_change":"2024-09-14T11:30:17.529543+0000","last_active":"2024-09-14T12:57:18.209507+0000","last_peered":"2024-09-14T12:57:18.209507+0000","last_clean":"2024-09-14T12:57:18.209507+0000","last_became_active":"2024-09-14T11:30:17.528777+0000","last_became_peered":"2024-09-14T11:30:17.528777+0000","last_unstale":"2024-09-14T12:57:18.209507+0000","last_undegraded":"2024-09-14T12:57:18.209507+0000","last_fullsized":"2024-09-14T12:57:18.209507+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:30:16.474654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:30:16.474654+0000","last_clean_scrub_stamp":"2024-09-14T11:30:16.474654+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:39:05.624425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.17","version":"267'4","reported_seq":73,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:00.395180+0000","last_change":"2024-09-14T11:30:10.473815+0000","last_active":"2024-09-14T13:02:00.395180+0000","last_peered":"2024-09-14T13:02:00.395180+0000","last_clean":"2024-09-14T13:02:00.395180+0000","last_became_active":"2024-09-14T11:30:10.469237+0000","last_became_peered":"2024-09-14T11:30:10.469237+0000","last_unstale":"2024-09-14T13:02:00.395180+0000","last_undegraded":"2024-09-14T13:02:00.395180+0000","last_fullsized":"2024-09-14T13:02:00.395180+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:30:09.411354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:30:09.411354+0000","last_clean_scrub_stamp":"2024-09-14T11:30:09.411354+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:02:16.697692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":4794,"num_write":4,"num_write_kb":4794,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.14","version":"267'34","reported_seq":163,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:58:02.824925+0000","last_change":"2024-09-14T11:24:10.120917+0000","last_active":"2024-09-14T12:58:02.824925+0000","last_peered":"2024-09-14T12:58:02.824925+0000","last_clean":"2024-09-14T12:58:02.824925+0000","last_became_active":"2024-09-14T11:24:10.120143+0000","last_became_peered":"2024-09-14T11:24:10.120143+0000","last_unstale":"2024-09-14T12:58:02.824925+0000","last_undegraded":"2024-09-14T12:58:02.824925+0000","last_fullsized":"2024-09-14T12:58:02.824925+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:24:09.066501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:24:09.066501+0000","last_clean_scrub_stamp":"2024-09-14T11:24:09.066501+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:47:01.835320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":239,"num_read_kb":157,"num_write":95,"num_write_kb":23,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.16","version":"0'0","reported_seq":39,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:59:08.469272+0000","last_change":"2024-09-14T11:58:43.687060+0000","last_active":"2024-09-14T12:59:08.469272+0000","last_peered":"2024-09-14T12:59:08.469272+0000","last_clean":"2024-09-14T12:59:08.469272+0000","last_became_active":"2024-09-14T11:58:43.685594+0000","last_became_peered":"2024-09-14T11:58:43.685594+0000","last_unstale":"2024-09-14T12:59:08.469272+0000","last_undegraded":"2024-09-14T12:59:08.469272+0000","last_fullsized":"2024-09-14T12:59:08.469272+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:58:42.635024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:58:42.635024+0000","last_clean_scrub_stamp":"2024-09-14T11:58:42.635024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:15:01.961069+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.11","version":"264'4","reported_seq":72,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:58:58.464568+0000","last_change":"2024-09-14T11:30:17.524449+0000","last_active":"2024-09-14T12:58:58.464568+0000","last_peered":"2024-09-14T12:58:58.464568+0000","last_clean":"2024-09-14T12:58:58.464568+0000","last_became_active":"2024-09-14T11:30:17.523720+0000","last_became_peered":"2024-09-14T11:30:17.523720+0000","last_unstale":"2024-09-14T12:58:58.464568+0000","last_undegraded":"2024-09-14T12:58:58.464568+0000","last_fullsized":"2024-09-14T12:58:58.464568+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:30:16.474654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:30:16.474654+0000","last_clean_scrub_stamp":"2024-09-14T11:30:16.474654+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:47:46.829903+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":4098,"num_write":4,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.10","version":"264'2","reported_seq":72,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:58:53.231284+0000","last_change":"2024-09-14T11:30:10.464461+0000","last_active":"2024-09-14T12:58:53.231284+0000","last_peered":"2024-09-14T12:58:53.231284+0000","last_clean":"2024-09-14T12:58:53.231284+0000","last_became_active":"2024-09-14T11:30:10.463671+0000","last_became_peered":"2024-09-14T11:30:10.463671+0000","last_unstale":"2024-09-14T12:58:53.231284+0000","last_undegraded":"2024-09-14T12:58:53.231284+0000","last_fullsized":"2024-09-14T12:58:53.231284+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:30:09.411354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:30:09.411354+0000","last_clean_scrub_stamp":"2024-09-14T11:30:09.411354+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:20:15.603839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":4096,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.13","version":"267'23","reported_seq":139,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:57:32.817933+0000","last_change":"2024-09-14T11:24:10.121802+0000","last_active":"2024-09-14T12:57:32.817933+0000","last_peered":"2024-09-14T12:57:32.817933+0000","last_clean":"2024-09-14T12:57:32.817933+0000","last_became_active":"2024-09-14T11:24:10.120764+0000","last_became_peered":"2024-09-14T11:24:10.120764+0000","last_unstale":"2024-09-14T12:57:32.817933+0000","last_undegraded":"2024-09-14T12:57:32.817933+0000","last_fullsized":"2024-09-14T12:57:32.817933+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:24:09.066501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:24:09.066501+0000","last_clean_scrub_stamp":"2024-09-14T11:24:09.066501+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:38:35.957872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":187,"num_read_kb":128,"num_write":64,"num_write_kb":17,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.17","version":"0'0","reported_seq":39,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:59:08.247094+0000","last_change":"2024-09-14T11:58:43.677764+0000","last_active":"2024-09-14T12:59:08.247094+0000","last_peered":"2024-09-14T12:59:08.247094+0000","last_clean":"2024-09-14T12:59:08.247094+0000","last_became_active":"2024-09-14T11:58:43.677005+0000","last_became_peered":"2024-09-14T11:58:43.677005+0000","last_unstale":"2024-09-14T12:59:08.247094+0000","last_undegraded":"2024-09-14T12:59:08.247094+0000","last_fullsized":"2024-09-14T12:59:08.247094+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:58:42.635024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:58:42.635024+0000","last_clean_scrub_stamp":"2024-09-14T11:58:42.635024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:38:06.608929+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.10","version":"267'4","reported_seq":68,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:00.350273+0000","last_change":"2024-09-14T11:30:17.510820+0000","last_active":"2024-09-14T13:02:00.350273+0000","last_peered":"2024-09-14T13:02:00.350273+0000","last_clean":"2024-09-14T13:02:00.350273+0000","last_became_active":"2024-09-14T11:30:17.510031+0000","last_became_peered":"2024-09-14T11:30:17.510031+0000","last_unstale":"2024-09-14T13:02:00.350273+0000","last_undegraded":"2024-09-14T13:02:00.350273+0000","last_fullsized":"2024-09-14T13:02:00.350273+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:30:16.474654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:30:16.474654+0000","last_clean_scrub_stamp":"2024-09-14T11:30:16.474654+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:53:33.188778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":2048,"num_write":4,"num_write_kb":2048,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.11","version":"0'0","reported_seq":68,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:58:53.465194+0000","last_change":"2024-09-14T11:30:10.468119+0000","last_active":"2024-09-14T12:58:53.465194+0000","last_peered":"2024-09-14T12:58:53.465194+0000","last_clean":"2024-09-14T12:58:53.465194+0000","last_became_active":"2024-09-14T11:30:10.459020+0000","last_became_peered":"2024-09-14T11:30:10.459020+0000","last_unstale":"2024-09-14T12:58:53.465194+0000","last_undegraded":"2024-09-14T12:58:53.465194+0000","last_fullsized":"2024-09-14T12:58:53.465194+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:30:09.411354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:30:09.411354+0000","last_clean_scrub_stamp":"2024-09-14T11:30:09.411354+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:19:33.421651+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.12","version":"267'21","reported_seq":135,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:57:33.442363+0000","last_change":"2024-09-14T11:24:10.125240+0000","last_active":"2024-09-14T12:57:33.442363+0000","last_peered":"2024-09-14T12:57:33.442363+0000","last_clean":"2024-09-14T12:57:33.442363+0000","last_became_active":"2024-09-14T11:24:10.124482+0000","last_became_peered":"2024-09-14T11:24:10.124482+0000","last_unstale":"2024-09-14T12:57:33.442363+0000","last_undegraded":"2024-09-14T12:57:33.442363+0000","last_fullsized":"2024-09-14T12:57:33.442363+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:24:09.066501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:24:09.066501+0000","last_clean_scrub_stamp":"2024-09-14T11:24:09.066501+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:42:43.834915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":165,"num_read_kb":113,"num_write":54,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.14","version":"266'1","reported_seq":41,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:59:43.255487+0000","last_change":"2024-09-14T11:58:43.676454+0000","last_active":"2024-09-14T12:59:43.255487+0000","last_peered":"2024-09-14T12:59:43.255487+0000","last_clean":"2024-09-14T12:59:43.255487+0000","last_became_active":"2024-09-14T11:58:43.675734+0000","last_became_peered":"2024-09-14T11:58:43.675734+0000","last_unstale":"2024-09-14T12:59:43.255487+0000","last_undegraded":"2024-09-14T12:59:43.255487+0000","last_fullsized":"2024-09-14T12:59:43.255487+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:58:42.635024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:58:42.635024+0000","last_clean_scrub_stamp":"2024-09-14T11:58:42.635024+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:41:40.899244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.13","version":"267'8","reported_seq":74,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:00.350845+0000","last_change":"2024-09-14T11:30:17.546653+0000","last_active":"2024-09-14T13:02:00.350845+0000","last_peered":"2024-09-14T13:02:00.350845+0000","last_clean":"2024-09-14T13:02:00.350845+0000","last_became_active":"2024-09-14T11:30:17.545560+0000","last_became_peered":"2024-09-14T11:30:17.545560+0000","last_unstale":"2024-09-14T13:02:00.350845+0000","last_undegraded":"2024-09-14T13:02:00.350845+0000","last_fullsized":"2024-09-14T13:02:00.350845+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:30:16.474654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:30:16.474654+0000","last_clean_scrub_stamp":"2024-09-14T11:30:16.474654+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:05:50.325352+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":9216,"num_write":18,"num_write_kb":9216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.12","version":"267'8","reported_seq":82,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:01:13.459469+0000","last_change":"2024-09-14T11:30:10.475068+0000","last_active":"2024-09-14T13:01:13.459469+0000","last_peered":"2024-09-14T13:01:13.459469+0000","last_clean":"2024-09-14T13:01:13.459469+0000","last_became_active":"2024-09-14T11:30:10.474328+0000","last_became_peered":"2024-09-14T11:30:10.474328+0000","last_unstale":"2024-09-14T13:01:13.459469+0000","last_undegraded":"2024-09-14T13:01:13.459469+0000","last_fullsized":"2024-09-14T13:01:13.459469+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:30:09.411354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:30:09.411354+0000","last_clean_scrub_stamp":"2024-09-14T11:30:09.411354+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:23:43.643876+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":16386,"num_write":18,"num_write_kb":8192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"65.11","version":"267'78","reported_seq":292,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:57:33.212715+0000","last_change":"2024-09-14T11:24:10.107937+0000","last_active":"2024-09-14T12:57:33.212715+0000","last_peered":"2024-09-14T12:57:33.212715+0000","last_clean":"2024-09-14T12:57:33.212715+0000","last_became_active":"2024-09-14T11:24:10.107177+0000","last_became_peered":"2024-09-14T11:24:10.107177+0000","last_unstale":"2024-09-14T12:57:33.212715+0000","last_undegraded":"2024-09-14T12:57:33.212715+0000","last_fullsized":"2024-09-14T12:57:33.212715+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:24:09.066501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:24:09.066501+0000","last_clean_scrub_stamp":"2024-09-14T11:24:09.066501+0000","objects_scrubbed":0,"log_size":78,"log_dups_size":0,"ondisk_log_size":78,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:27:38.912018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":655,"num_read_kb":451,"num_write":184,"num_write_kb":61,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"68.15","version":"267'1","reported_seq":40,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:59:08.469167+0000","last_change":"2024-09-14T11:58:43.694184+0000","last_active":"2024-09-14T12:59:08.469167+0000","last_peered":"2024-09-14T12:59:08.469167+0000","last_clean":"2024-09-14T12:59:08.469167+0000","last_became_active":"2024-09-14T11:58:43.692552+0000","last_became_peered":"2024-09-14T11:58:43.692552+0000","last_unstale":"2024-09-14T12:59:08.469167+0000","last_undegraded":"2024-09-14T12:59:08.469167+0000","last_fullsized":"2024-09-14T12:59:08.469167+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:58:42.635024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:58:42.635024+0000","last_clean_scrub_stamp":"2024-09-14T11:58:42.635024+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:25:30.983665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.12","version":"267'3","reported_seq":65,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:01:18.460519+0000","last_change":"2024-09-14T11:30:17.524803+0000","last_active":"2024-09-14T13:01:18.460519+0000","last_peered":"2024-09-14T13:01:18.460519+0000","last_clean":"2024-09-14T13:01:18.460519+0000","last_became_active":"2024-09-14T11:30:17.523975+0000","last_became_peered":"2024-09-14T11:30:17.523975+0000","last_unstale":"2024-09-14T13:01:18.460519+0000","last_undegraded":"2024-09-14T13:01:18.460519+0000","last_fullsized":"2024-09-14T13:01:18.460519+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:30:16.474654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:30:16.474654+0000","last_clean_scrub_stamp":"2024-09-14T11:30:16.474654+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:12:00.068952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":8,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"66.13","version":"267'2","reported_seq":70,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:01:13.078527+0000","last_change":"2024-09-14T11:30:10.470996+0000","last_active":"2024-09-14T13:01:13.078527+0000","last_peered":"2024-09-14T13:01:13.078527+0000","last_clean":"2024-09-14T13:01:13.078527+0000","last_became_active":"2024-09-14T11:30:10.467218+0000","last_became_peered":"2024-09-14T11:30:10.467218+0000","last_unstale":"2024-09-14T13:01:13.078527+0000","last_undegraded":"2024-09-14T13:01:13.078527+0000","last_fullsized":"2024-09-14T13:01:13.078527+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:30:09.411354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:30:09.411354+0000","last_clean_scrub_stamp":"2024-09-14T11:30:09.411354+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:14:13.258206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.10","version":"267'25","reported_seq":142,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:57:33.446193+0000","last_change":"2024-09-14T11:24:10.128983+0000","last_active":"2024-09-14T12:57:33.446193+0000","last_peered":"2024-09-14T12:57:33.446193+0000","last_clean":"2024-09-14T12:57:33.446193+0000","last_became_active":"2024-09-14T11:24:10.124485+0000","last_became_peered":"2024-09-14T11:24:10.124485+0000","last_unstale":"2024-09-14T12:57:33.446193+0000","last_undegraded":"2024-09-14T12:57:33.446193+0000","last_fullsized":"2024-09-14T12:57:33.446193+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:24:09.066501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:24:09.066501+0000","last_clean_scrub_stamp":"2024-09-14T11:24:09.066501+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:05:55.111756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":199,"num_read_kb":137,"num_write":62,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.a","version":"0'0","reported_seq":42,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:59:42.836938+0000","last_change":"2024-09-14T11:58:43.665808+0000","last_active":"2024-09-14T12:59:42.836938+0000","last_peered":"2024-09-14T12:59:42.836938+0000","last_clean":"2024-09-14T12:59:42.836938+0000","last_became_active":"2024-09-14T11:58:43.665150+0000","last_became_peered":"2024-09-14T11:58:43.665150+0000","last_unstale":"2024-09-14T12:59:42.836938+0000","last_undegraded":"2024-09-14T12:59:42.836938+0000","last_fullsized":"2024-09-14T12:59:42.836938+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:58:42.635024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:58:42.635024+0000","last_clean_scrub_stamp":"2024-09-14T11:58:42.635024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:47:00.404652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.d","version":"0'0","reported_seq":63,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:58:03.453801+0000","last_change":"2024-09-14T11:30:17.541032+0000","last_active":"2024-09-14T12:58:03.453801+0000","last_peered":"2024-09-14T12:58:03.453801+0000","last_clean":"2024-09-14T12:58:03.453801+0000","last_became_active":"2024-09-14T11:30:17.540505+0000","last_became_peered":"2024-09-14T11:30:17.540505+0000","last_unstale":"2024-09-14T12:58:03.453801+0000","last_undegraded":"2024-09-14T12:58:03.453801+0000","last_fullsized":"2024-09-14T12:58:03.453801+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:30:16.474654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:30:16.474654+0000","last_clean_scrub_stamp":"2024-09-14T11:30:16.474654+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:19:58.382345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.c","version":"264'2","reported_seq":73,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:57:57.823794+0000","last_change":"2024-09-14T11:30:10.465578+0000","last_active":"2024-09-14T12:57:57.823794+0000","last_peered":"2024-09-14T12:57:57.823794+0000","last_clean":"2024-09-14T12:57:57.823794+0000","last_became_active":"2024-09-14T11:30:10.464846+0000","last_became_peered":"2024-09-14T11:30:10.464846+0000","last_unstale":"2024-09-14T12:57:57.823794+0000","last_undegraded":"2024-09-14T12:57:57.823794+0000","last_fullsized":"2024-09-14T12:57:57.823794+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:30:09.411354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:30:09.411354+0000","last_clean_scrub_stamp":"2024-09-14T11:30:09.411354+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:16:48.115696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":4096,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.f","version":"267'23","reported_seq":140,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:59:03.468003+0000","last_change":"2024-09-14T11:24:10.122374+0000","last_active":"2024-09-14T12:59:03.468003+0000","last_peered":"2024-09-14T12:59:03.468003+0000","last_clean":"2024-09-14T12:59:03.468003+0000","last_became_active":"2024-09-14T11:24:10.121456+0000","last_became_peered":"2024-09-14T11:24:10.121456+0000","last_unstale":"2024-09-14T12:59:03.468003+0000","last_undegraded":"2024-09-14T12:59:03.468003+0000","last_fullsized":"2024-09-14T12:59:03.468003+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:24:09.066501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:24:09.066501+0000","last_clean_scrub_stamp":"2024-09-14T11:24:09.066501+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:09:06.754571+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":176,"num_read_kb":127,"num_write":57,"num_write_kb":16,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.b","version":"0'0","reported_seq":41,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:59:32.845960+0000","last_change":"2024-09-14T11:58:43.685677+0000","last_active":"2024-09-14T12:59:32.845960+0000","last_peered":"2024-09-14T12:59:32.845960+0000","last_clean":"2024-09-14T12:59:32.845960+0000","last_became_active":"2024-09-14T11:58:43.684927+0000","last_became_peered":"2024-09-14T11:58:43.684927+0000","last_unstale":"2024-09-14T12:59:32.845960+0000","last_undegraded":"2024-09-14T12:59:32.845960+0000","last_fullsized":"2024-09-14T12:59:32.845960+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:58:42.635024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:58:42.635024+0000","last_clean_scrub_stamp":"2024-09-14T11:58:42.635024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:58:14.472771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.c","version":"267'9","reported_seq":78,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:00.307406+0000","last_change":"2024-09-14T11:30:17.535765+0000","last_active":"2024-09-14T13:02:00.307406+0000","last_peered":"2024-09-14T13:02:00.307406+0000","last_clean":"2024-09-14T13:02:00.307406+0000","last_became_active":"2024-09-14T11:30:17.535131+0000","last_became_peered":"2024-09-14T11:30:17.535131+0000","last_unstale":"2024-09-14T13:02:00.307406+0000","last_undegraded":"2024-09-14T13:02:00.307406+0000","last_fullsized":"2024-09-14T13:02:00.307406+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:30:16.474654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:30:16.474654+0000","last_clean_scrub_stamp":"2024-09-14T11:30:16.474654+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:06:05.667984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":16384,"num_write":14,"num_write_kb":16384,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.d","version":"0'0","reported_seq":69,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:57:57.814167+0000","last_change":"2024-09-14T11:30:10.476534+0000","last_active":"2024-09-14T12:57:57.814167+0000","last_peered":"2024-09-14T12:57:57.814167+0000","last_clean":"2024-09-14T12:57:57.814167+0000","last_became_active":"2024-09-14T11:30:10.475862+0000","last_became_peered":"2024-09-14T11:30:10.475862+0000","last_unstale":"2024-09-14T12:57:57.814167+0000","last_undegraded":"2024-09-14T12:57:57.814167+0000","last_fullsized":"2024-09-14T12:57:57.814167+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:30:09.411354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:30:09.411354+0000","last_clean_scrub_stamp":"2024-09-14T11:30:09.411354+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:09:25.660215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.e","version":"267'20","reported_seq":131,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:58:43.044517+0000","last_change":"2024-09-14T11:24:10.116821+0000","last_active":"2024-09-14T12:58:43.044517+0000","last_peered":"2024-09-14T12:58:43.044517+0000","last_clean":"2024-09-14T12:58:43.044517+0000","last_became_active":"2024-09-14T11:24:10.116115+0000","last_became_peered":"2024-09-14T11:24:10.116115+0000","last_unstale":"2024-09-14T12:58:43.044517+0000","last_undegraded":"2024-09-14T12:58:43.044517+0000","last_fullsized":"2024-09-14T12:58:43.044517+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:24:09.066501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:24:09.066501+0000","last_clean_scrub_stamp":"2024-09-14T11:24:09.066501+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:27:31.737225+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":147,"num_read_kb":99,"num_write":62,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"68.8","version":"0'0","reported_seq":42,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:59:23.435157+0000","last_change":"2024-09-14T11:58:43.689938+0000","last_active":"2024-09-14T12:59:23.435157+0000","last_peered":"2024-09-14T12:59:23.435157+0000","last_clean":"2024-09-14T12:59:23.435157+0000","last_became_active":"2024-09-14T11:58:43.689083+0000","last_became_peered":"2024-09-14T11:58:43.689083+0000","last_unstale":"2024-09-14T12:59:23.435157+0000","last_undegraded":"2024-09-14T12:59:23.435157+0000","last_fullsized":"2024-09-14T12:59:23.435157+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:58:42.635024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:58:42.635024+0000","last_clean_scrub_stamp":"2024-09-14T11:58:42.635024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:56:39.956267+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"67.f","version":"267'7","reported_seq":74,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:00.341402+0000","last_change":"2024-09-14T11:30:17.516991+0000","last_active":"2024-09-14T13:02:00.341402+0000","last_peered":"2024-09-14T13:02:00.341402+0000","last_clean":"2024-09-14T13:02:00.341402+0000","last_became_active":"2024-09-14T11:30:17.514381+0000","last_became_peered":"2024-09-14T11:30:17.514381+0000","last_unstale":"2024-09-14T13:02:00.341402+0000","last_undegraded":"2024-09-14T13:02:00.341402+0000","last_fullsized":"2024-09-14T13:02:00.341402+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:30:16.474654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:30:16.474654+0000","last_clean_scrub_stamp":"2024-09-14T11:30:16.474654+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:49:08.984359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":3072,"num_write":12,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.e","version":"267'6","reported_seq":82,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:00:13.261894+0000","last_change":"2024-09-14T11:30:10.479004+0000","last_active":"2024-09-14T13:00:13.261894+0000","last_peered":"2024-09-14T13:00:13.261894+0000","last_clean":"2024-09-14T13:00:13.261894+0000","last_became_active":"2024-09-14T11:30:10.473586+0000","last_became_peered":"2024-09-14T11:30:10.473586+0000","last_unstale":"2024-09-14T13:00:13.261894+0000","last_undegraded":"2024-09-14T13:00:13.261894+0000","last_fullsized":"2024-09-14T13:00:13.261894+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:30:09.411354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:30:09.411354+0000","last_clean_scrub_stamp":"2024-09-14T11:30:09.411354+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:24:05.113372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":7170,"num_write":6,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.d","version":"267'29","reported_seq":159,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:58:43.426273+0000","last_change":"2024-09-14T11:24:10.116568+0000","last_active":"2024-09-14T12:58:43.426273+0000","last_peered":"2024-09-14T12:58:43.426273+0000","last_clean":"2024-09-14T12:58:43.426273+0000","last_became_active":"2024-09-14T11:24:10.115813+0000","last_became_peered":"2024-09-14T11:24:10.115813+0000","last_unstale":"2024-09-14T12:58:43.426273+0000","last_undegraded":"2024-09-14T12:58:43.426273+0000","last_fullsized":"2024-09-14T12:58:43.426273+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:24:09.066501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:24:09.066501+0000","last_clean_scrub_stamp":"2024-09-14T11:24:09.066501+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:26:27.897672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":238,"num_read_kb":154,"num_write":72,"num_write_kb":21,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.9","version":"0'0","reported_seq":42,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:59:27.844748+0000","last_change":"2024-09-14T11:58:43.692113+0000","last_active":"2024-09-14T12:59:27.844748+0000","last_peered":"2024-09-14T12:59:27.844748+0000","last_clean":"2024-09-14T12:59:27.844748+0000","last_became_active":"2024-09-14T11:58:43.691369+0000","last_became_peered":"2024-09-14T11:58:43.691369+0000","last_unstale":"2024-09-14T12:59:27.844748+0000","last_undegraded":"2024-09-14T12:59:27.844748+0000","last_fullsized":"2024-09-14T12:59:27.844748+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:58:42.635024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:58:42.635024+0000","last_clean_scrub_stamp":"2024-09-14T11:58:42.635024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:30:13.996741+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.e","version":"0'0","reported_seq":63,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:58:03.453841+0000","last_change":"2024-09-14T11:30:17.530775+0000","last_active":"2024-09-14T12:58:03.453841+0000","last_peered":"2024-09-14T12:58:03.453841+0000","last_clean":"2024-09-14T12:58:03.453841+0000","last_became_active":"2024-09-14T11:30:17.529982+0000","last_became_peered":"2024-09-14T11:30:17.529982+0000","last_unstale":"2024-09-14T12:58:03.453841+0000","last_undegraded":"2024-09-14T12:58:03.453841+0000","last_fullsized":"2024-09-14T12:58:03.453841+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:30:16.474654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:30:16.474654+0000","last_clean_scrub_stamp":"2024-09-14T11:30:16.474654+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:45:22.253630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.f","version":"267'3","reported_seq":74,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:00:28.487301+0000","last_change":"2024-09-14T11:30:10.466282+0000","last_active":"2024-09-14T13:00:28.487301+0000","last_peered":"2024-09-14T13:00:28.487301+0000","last_clean":"2024-09-14T13:00:28.487301+0000","last_became_active":"2024-09-14T11:30:10.465658+0000","last_became_peered":"2024-09-14T11:30:10.465658+0000","last_unstale":"2024-09-14T13:00:28.487301+0000","last_undegraded":"2024-09-14T13:00:28.487301+0000","last_fullsized":"2024-09-14T13:00:28.487301+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:30:09.411354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:30:09.411354+0000","last_clean_scrub_stamp":"2024-09-14T11:30:09.411354+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:30:10.626929+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":8192,"num_write":8,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.c","version":"267'13","reported_seq":112,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:58:42.823918+0000","last_change":"2024-09-14T11:24:10.125876+0000","last_active":"2024-09-14T12:58:42.823918+0000","last_peered":"2024-09-14T12:58:42.823918+0000","last_clean":"2024-09-14T12:58:42.823918+0000","last_became_active":"2024-09-14T11:24:10.125123+0000","last_became_peered":"2024-09-14T11:24:10.125123+0000","last_unstale":"2024-09-14T12:58:42.823918+0000","last_undegraded":"2024-09-14T12:58:42.823918+0000","last_fullsized":"2024-09-14T12:58:42.823918+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:24:09.066501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:24:09.066501+0000","last_clean_scrub_stamp":"2024-09-14T11:24:09.066501+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:00:51.281778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":97,"num_read_kb":65,"num_write":32,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.e","version":"0'0","reported_seq":41,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:59:28.473804+0000","last_change":"2024-09-14T11:58:43.687782+0000","last_active":"2024-09-14T12:59:28.473804+0000","last_peered":"2024-09-14T12:59:28.473804+0000","last_clean":"2024-09-14T12:59:28.473804+0000","last_became_active":"2024-09-14T11:58:43.686619+0000","last_became_peered":"2024-09-14T11:58:43.686619+0000","last_unstale":"2024-09-14T12:59:28.473804+0000","last_undegraded":"2024-09-14T12:59:28.473804+0000","last_fullsized":"2024-09-14T12:59:28.473804+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:58:42.635024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:58:42.635024+0000","last_clean_scrub_stamp":"2024-09-14T11:58:42.635024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:28:38.861564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.9","version":"264'3","reported_seq":70,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:59:08.234745+0000","last_change":"2024-09-14T11:30:17.539804+0000","last_active":"2024-09-14T12:59:08.234745+0000","last_peered":"2024-09-14T12:59:08.234745+0000","last_clean":"2024-09-14T12:59:08.234745+0000","last_became_active":"2024-09-14T11:30:17.539102+0000","last_became_peered":"2024-09-14T11:30:17.539102+0000","last_unstale":"2024-09-14T12:59:08.234745+0000","last_undegraded":"2024-09-14T12:59:08.234745+0000","last_fullsized":"2024-09-14T12:59:08.234745+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:30:16.474654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:30:16.474654+0000","last_clean_scrub_stamp":"2024-09-14T11:30:16.474654+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:50:58.476074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":4096,"num_write":8,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.8","version":"267'4","reported_seq":78,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:01:13.275300+0000","last_change":"2024-09-14T11:30:10.460045+0000","last_active":"2024-09-14T13:01:13.275300+0000","last_peered":"2024-09-14T13:01:13.275300+0000","last_clean":"2024-09-14T13:01:13.275300+0000","last_became_active":"2024-09-14T11:30:10.452160+0000","last_became_peered":"2024-09-14T11:30:10.452160+0000","last_unstale":"2024-09-14T13:01:13.275300+0000","last_undegraded":"2024-09-14T13:01:13.275300+0000","last_fullsized":"2024-09-14T13:01:13.275300+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:30:09.411354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:30:09.411354+0000","last_clean_scrub_stamp":"2024-09-14T11:30:09.411354+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:23:05.788859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5120,"num_write":4,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.b","version":"267'29","reported_seq":156,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:58:43.240104+0000","last_change":"2024-09-14T11:24:10.106828+0000","last_active":"2024-09-14T12:58:43.240104+0000","last_peered":"2024-09-14T12:58:43.240104+0000","last_clean":"2024-09-14T12:58:43.240104+0000","last_became_active":"2024-09-14T11:24:10.106068+0000","last_became_peered":"2024-09-14T11:24:10.106068+0000","last_unstale":"2024-09-14T12:58:43.240104+0000","last_undegraded":"2024-09-14T12:58:43.240104+0000","last_fullsized":"2024-09-14T12:58:43.240104+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:24:09.066501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:24:09.066501+0000","last_clean_scrub_stamp":"2024-09-14T11:24:09.066501+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:05:03.080475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":230,"num_read_kb":146,"num_write":73,"num_write_kb":21,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.f","version":"0'0","reported_seq":40,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:57:37.819234+0000","last_change":"2024-09-14T11:58:43.692112+0000","last_active":"2024-09-14T12:57:37.819234+0000","last_peered":"2024-09-14T12:57:37.819234+0000","last_clean":"2024-09-14T12:57:37.819234+0000","last_became_active":"2024-09-14T11:58:43.691307+0000","last_became_peered":"2024-09-14T11:58:43.691307+0000","last_unstale":"2024-09-14T12:57:37.819234+0000","last_undegraded":"2024-09-14T12:57:37.819234+0000","last_fullsized":"2024-09-14T12:57:37.819234+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:58:42.635024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:58:42.635024+0000","last_clean_scrub_stamp":"2024-09-14T11:58:42.635024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:28:43.404907+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.8","version":"267'4","reported_seq":73,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:00.039409+0000","last_change":"2024-09-14T11:30:17.506927+0000","last_active":"2024-09-14T13:02:00.039409+0000","last_peered":"2024-09-14T13:02:00.039409+0000","last_clean":"2024-09-14T13:02:00.039409+0000","last_became_active":"2024-09-14T11:30:17.506181+0000","last_became_peered":"2024-09-14T11:30:17.506181+0000","last_unstale":"2024-09-14T13:02:00.039409+0000","last_undegraded":"2024-09-14T13:02:00.039409+0000","last_fullsized":"2024-09-14T13:02:00.039409+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:30:16.474654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:30:16.474654+0000","last_clean_scrub_stamp":"2024-09-14T11:30:16.474654+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:25:09.709853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":10240,"num_write":4,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.9","version":"267'14","reported_seq":96,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:00.358482+0000","last_change":"2024-09-14T11:30:10.470957+0000","last_active":"2024-09-14T13:02:00.358482+0000","last_peered":"2024-09-14T13:02:00.358482+0000","last_clean":"2024-09-14T13:02:00.358482+0000","last_became_active":"2024-09-14T11:30:10.470179+0000","last_became_peered":"2024-09-14T11:30:10.470179+0000","last_unstale":"2024-09-14T13:02:00.358482+0000","last_undegraded":"2024-09-14T13:02:00.358482+0000","last_fullsized":"2024-09-14T13:02:00.358482+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:30:09.411354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:30:09.411354+0000","last_clean_scrub_stamp":"2024-09-14T11:30:09.411354+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:18:43.600381+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":18,"num_read_kb":28678,"num_write":24,"num_write_kb":16388,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.a","version":"267'15","reported_seq":117,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:57:52.822597+0000","last_change":"2024-09-14T11:24:10.103674+0000","last_active":"2024-09-14T12:57:52.822597+0000","last_peered":"2024-09-14T12:57:52.822597+0000","last_clean":"2024-09-14T12:57:52.822597+0000","last_became_active":"2024-09-14T11:24:10.102918+0000","last_became_peered":"2024-09-14T11:24:10.102918+0000","last_unstale":"2024-09-14T12:57:52.822597+0000","last_undegraded":"2024-09-14T12:57:52.822597+0000","last_fullsized":"2024-09-14T12:57:52.822597+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:24:09.066501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:24:09.066501+0000","last_clean_scrub_stamp":"2024-09-14T11:24:09.066501+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:26:42.141598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":107,"num_read_kb":71,"num_write":42,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.c","version":"267'1","reported_seq":42,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:59:32.846025+0000","last_change":"2024-09-14T11:58:43.674524+0000","last_active":"2024-09-14T12:59:32.846025+0000","last_peered":"2024-09-14T12:59:32.846025+0000","last_clean":"2024-09-14T12:59:32.846025+0000","last_became_active":"2024-09-14T11:58:43.671065+0000","last_became_peered":"2024-09-14T11:58:43.671065+0000","last_unstale":"2024-09-14T12:59:32.846025+0000","last_undegraded":"2024-09-14T12:59:32.846025+0000","last_fullsized":"2024-09-14T12:59:32.846025+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:58:42.635024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:58:42.635024+0000","last_clean_scrub_stamp":"2024-09-14T11:58:42.635024+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:00:34.168002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.b","version":"267'11","reported_seq":85,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:00:18.482221+0000","last_change":"2024-09-14T11:30:17.517039+0000","last_active":"2024-09-14T13:00:18.482221+0000","last_peered":"2024-09-14T13:00:18.482221+0000","last_clean":"2024-09-14T13:00:18.482221+0000","last_became_active":"2024-09-14T11:30:17.516646+0000","last_became_peered":"2024-09-14T11:30:17.516646+0000","last_unstale":"2024-09-14T13:00:18.482221+0000","last_undegraded":"2024-09-14T13:00:18.482221+0000","last_fullsized":"2024-09-14T13:00:18.482221+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:30:16.474654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:30:16.474654+0000","last_clean_scrub_stamp":"2024-09-14T11:30:16.474654+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:51:29.231639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":17,"num_read_kb":13314,"num_write":16,"num_write_kb":10240,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.a","version":"264'2","reported_seq":75,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:59:28.251530+0000","last_change":"2024-09-14T11:30:10.473981+0000","last_active":"2024-09-14T12:59:28.251530+0000","last_peered":"2024-09-14T12:59:28.251530+0000","last_clean":"2024-09-14T12:59:28.251530+0000","last_became_active":"2024-09-14T11:30:10.473149+0000","last_became_peered":"2024-09-14T11:30:10.473149+0000","last_unstale":"2024-09-14T12:59:28.251530+0000","last_undegraded":"2024-09-14T12:59:28.251530+0000","last_fullsized":"2024-09-14T12:59:28.251530+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:30:09.411354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:30:09.411354+0000","last_clean_scrub_stamp":"2024-09-14T11:30:09.411354+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:31:29.150405+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":1024,"num_write":2,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.9","version":"267'22","reported_seq":138,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:59:33.474897+0000","last_change":"2024-09-14T11:24:10.122150+0000","last_active":"2024-09-14T12:59:33.474897+0000","last_peered":"2024-09-14T12:59:33.474897+0000","last_clean":"2024-09-14T12:59:33.474897+0000","last_became_active":"2024-09-14T11:24:10.121442+0000","last_became_peered":"2024-09-14T11:24:10.121442+0000","last_unstale":"2024-09-14T12:59:33.474897+0000","last_undegraded":"2024-09-14T12:59:33.474897+0000","last_fullsized":"2024-09-14T12:59:33.474897+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:24:09.066501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:24:09.066501+0000","last_clean_scrub_stamp":"2024-09-14T11:24:09.066501+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:07:27.847069+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":163,"num_read_kb":99,"num_write":58,"num_write_kb":15,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.d","version":"0'0","reported_seq":41,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:59:28.251656+0000","last_change":"2024-09-14T11:58:43.694247+0000","last_active":"2024-09-14T12:59:28.251656+0000","last_peered":"2024-09-14T12:59:28.251656+0000","last_clean":"2024-09-14T12:59:28.251656+0000","last_became_active":"2024-09-14T11:58:43.693568+0000","last_became_peered":"2024-09-14T11:58:43.693568+0000","last_unstale":"2024-09-14T12:59:28.251656+0000","last_undegraded":"2024-09-14T12:59:28.251656+0000","last_fullsized":"2024-09-14T12:59:28.251656+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:58:42.635024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:58:42.635024+0000","last_clean_scrub_stamp":"2024-09-14T11:58:42.635024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:56:07.440496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.a","version":"0'0","reported_seq":71,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:59:37.847095+0000","last_change":"2024-09-14T11:30:57.858852+0000","last_active":"2024-09-14T12:59:37.847095+0000","last_peered":"2024-09-14T12:59:37.847095+0000","last_clean":"2024-09-14T12:59:37.847095+0000","last_became_active":"2024-09-14T11:30:57.858040+0000","last_became_peered":"2024-09-14T11:30:57.858040+0000","last_unstale":"2024-09-14T12:59:37.847095+0000","last_undegraded":"2024-09-14T12:59:37.847095+0000","last_fullsized":"2024-09-14T12:59:37.847095+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:30:16.474654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:30:16.474654+0000","last_clean_scrub_stamp":"2024-09-14T11:30:16.474654+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:54:14.176092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.b","version":"267'4","reported_seq":75,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:00.020394+0000","last_change":"2024-09-14T11:30:10.446339+0000","last_active":"2024-09-14T13:02:00.020394+0000","last_peered":"2024-09-14T13:02:00.020394+0000","last_clean":"2024-09-14T13:02:00.020394+0000","last_became_active":"2024-09-14T11:30:10.442635+0000","last_became_peered":"2024-09-14T11:30:10.442635+0000","last_unstale":"2024-09-14T13:02:00.020394+0000","last_undegraded":"2024-09-14T13:02:00.020394+0000","last_fullsized":"2024-09-14T13:02:00.020394+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:30:09.411354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:30:09.411354+0000","last_clean_scrub_stamp":"2024-09-14T11:30:09.411354+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:51:37.757665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":8192,"num_write":4,"num_write_kb":8192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.8","version":"267'20","reported_seq":132,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:59:33.437339+0000","last_change":"2024-09-14T11:24:10.116682+0000","last_active":"2024-09-14T12:59:33.437339+0000","last_peered":"2024-09-14T12:59:33.437339+0000","last_clean":"2024-09-14T12:59:33.437339+0000","last_became_active":"2024-09-14T11:24:10.115856+0000","last_became_peered":"2024-09-14T11:24:10.115856+0000","last_unstale":"2024-09-14T12:59:33.437339+0000","last_undegraded":"2024-09-14T12:59:33.437339+0000","last_fullsized":"2024-09-14T12:59:33.437339+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:24:09.066501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:24:09.066501+0000","last_clean_scrub_stamp":"2024-09-14T11:24:09.066501+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:44:11.185471+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":144,"num_read_kb":94,"num_write":54,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.2","version":"0'0","reported_seq":43,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:59:12.841261+0000","last_change":"2024-09-14T11:58:43.696428+0000","last_active":"2024-09-14T12:59:12.841261+0000","last_peered":"2024-09-14T12:59:12.841261+0000","last_clean":"2024-09-14T12:59:12.841261+0000","last_became_active":"2024-09-14T11:58:43.695896+0000","last_became_peered":"2024-09-14T11:58:43.695896+0000","last_unstale":"2024-09-14T12:59:12.841261+0000","last_undegraded":"2024-09-14T12:59:12.841261+0000","last_fullsized":"2024-09-14T12:59:12.841261+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:58:42.635024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:58:42.635024+0000","last_clean_scrub_stamp":"2024-09-14T11:58:42.635024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:00:52.004945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.5","version":"0'0","reported_seq":66,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:58:08.450363+0000","last_change":"2024-09-14T11:30:17.520310+0000","last_active":"2024-09-14T12:58:08.450363+0000","last_peered":"2024-09-14T12:58:08.450363+0000","last_clean":"2024-09-14T12:58:08.450363+0000","last_became_active":"2024-09-14T11:30:17.519903+0000","last_became_peered":"2024-09-14T11:30:17.519903+0000","last_unstale":"2024-09-14T12:58:08.450363+0000","last_undegraded":"2024-09-14T12:58:08.450363+0000","last_fullsized":"2024-09-14T12:58:08.450363+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:30:16.474654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:30:16.474654+0000","last_clean_scrub_stamp":"2024-09-14T11:30:16.474654+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:24:33.274962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.4","version":"264'4","reported_seq":82,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:59:47.849496+0000","last_change":"2024-09-14T11:30:10.469781+0000","last_active":"2024-09-14T12:59:47.849496+0000","last_peered":"2024-09-14T12:59:47.849496+0000","last_clean":"2024-09-14T12:59:47.849496+0000","last_became_active":"2024-09-14T11:30:10.468287+0000","last_became_peered":"2024-09-14T11:30:10.468287+0000","last_unstale":"2024-09-14T12:59:47.849496+0000","last_undegraded":"2024-09-14T12:59:47.849496+0000","last_fullsized":"2024-09-14T12:59:47.849496+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:30:09.411354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:30:09.411354+0000","last_clean_scrub_stamp":"2024-09-14T11:30:09.411354+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:43:03.239163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":11264,"num_write":4,"num_write_kb":7168,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.7","version":"267'11","reported_seq":111,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:59:33.252891+0000","last_change":"2024-09-14T11:24:10.097912+0000","last_active":"2024-09-14T12:59:33.252891+0000","last_peered":"2024-09-14T12:59:33.252891+0000","last_clean":"2024-09-14T12:59:33.252891+0000","last_became_active":"2024-09-14T11:24:10.097206+0000","last_became_peered":"2024-09-14T11:24:10.097206+0000","last_unstale":"2024-09-14T12:59:33.252891+0000","last_undegraded":"2024-09-14T12:59:33.252891+0000","last_fullsized":"2024-09-14T12:59:33.252891+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:24:09.066501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:24:09.066501+0000","last_clean_scrub_stamp":"2024-09-14T11:24:09.066501+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:05:42.905472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":88,"num_read_kb":49,"num_write":30,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.3","version":"0'0","reported_seq":43,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:59:08.049987+0000","last_change":"2024-09-14T11:58:43.693608+0000","last_active":"2024-09-14T12:59:08.049987+0000","last_peered":"2024-09-14T12:59:08.049987+0000","last_clean":"2024-09-14T12:59:08.049987+0000","last_became_active":"2024-09-14T11:58:43.689661+0000","last_became_peered":"2024-09-14T11:58:43.689661+0000","last_unstale":"2024-09-14T12:59:08.049987+0000","last_undegraded":"2024-09-14T12:59:08.049987+0000","last_fullsized":"2024-09-14T12:59:08.049987+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:58:42.635024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:58:42.635024+0000","last_clean_scrub_stamp":"2024-09-14T11:58:42.635024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:26:59.844029+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.4","version":"267'5","reported_seq":75,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:00.168550+0000","last_change":"2024-09-14T11:30:17.501104+0000","last_active":"2024-09-14T13:02:00.168550+0000","last_peered":"2024-09-14T13:02:00.168550+0000","last_clean":"2024-09-14T13:02:00.168550+0000","last_became_active":"2024-09-14T11:30:17.500215+0000","last_became_peered":"2024-09-14T11:30:17.500215+0000","last_unstale":"2024-09-14T13:02:00.168550+0000","last_undegraded":"2024-09-14T13:02:00.168550+0000","last_fullsized":"2024-09-14T13:02:00.168550+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:30:16.474654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:30:16.474654+0000","last_clean_scrub_stamp":"2024-09-14T11:30:16.474654+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:46:20.398415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":2052,"num_write":10,"num_write_kb":1028,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.5","version":"267'5","reported_seq":81,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:00.395831+0000","last_change":"2024-09-14T11:30:10.465224+0000","last_active":"2024-09-14T13:02:00.395831+0000","last_peered":"2024-09-14T13:02:00.395831+0000","last_clean":"2024-09-14T13:02:00.395831+0000","last_became_active":"2024-09-14T11:30:10.464076+0000","last_became_peered":"2024-09-14T11:30:10.464076+0000","last_unstale":"2024-09-14T13:02:00.395831+0000","last_undegraded":"2024-09-14T13:02:00.395831+0000","last_fullsized":"2024-09-14T13:02:00.395831+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:30:09.411354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:30:09.411354+0000","last_clean_scrub_stamp":"2024-09-14T11:30:09.411354+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:08:03.701354+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":16384,"num_write":10,"num_write_kb":8192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.6","version":"267'17","reported_seq":129,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:59:33.437504+0000","last_change":"2024-09-14T11:24:10.123893+0000","last_active":"2024-09-14T12:59:33.437504+0000","last_peered":"2024-09-14T12:59:33.437504+0000","last_clean":"2024-09-14T12:59:33.437504+0000","last_became_active":"2024-09-14T11:24:10.123193+0000","last_became_peered":"2024-09-14T11:24:10.123193+0000","last_unstale":"2024-09-14T12:59:33.437504+0000","last_undegraded":"2024-09-14T12:59:33.437504+0000","last_fullsized":"2024-09-14T12:59:33.437504+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:24:09.066501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:24:09.066501+0000","last_clean_scrub_stamp":"2024-09-14T11:24:09.066501+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:45:11.702555+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":141,"num_read_kb":98,"num_write":56,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.0","version":"0'0","reported_seq":44,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:58:48.462247+0000","last_change":"2024-09-14T11:58:43.690698+0000","last_active":"2024-09-14T12:58:48.462247+0000","last_peered":"2024-09-14T12:58:48.462247+0000","last_clean":"2024-09-14T12:58:48.462247+0000","last_became_active":"2024-09-14T11:58:43.690036+0000","last_became_peered":"2024-09-14T11:58:43.690036+0000","last_unstale":"2024-09-14T12:58:48.462247+0000","last_undegraded":"2024-09-14T12:58:48.462247+0000","last_fullsized":"2024-09-14T12:58:48.462247+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:58:42.635024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:58:42.635024+0000","last_clean_scrub_stamp":"2024-09-14T11:58:42.635024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:02:37.171544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"67.7","version":"0'0","reported_seq":65,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:59:07.840222+0000","last_change":"2024-09-14T11:30:17.504824+0000","last_active":"2024-09-14T12:59:07.840222+0000","last_peered":"2024-09-14T12:59:07.840222+0000","last_clean":"2024-09-14T12:59:07.840222+0000","last_became_active":"2024-09-14T11:30:17.503548+0000","last_became_peered":"2024-09-14T11:30:17.503548+0000","last_unstale":"2024-09-14T12:59:07.840222+0000","last_undegraded":"2024-09-14T12:59:07.840222+0000","last_fullsized":"2024-09-14T12:59:07.840222+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:30:16.474654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:30:16.474654+0000","last_clean_scrub_stamp":"2024-09-14T11:30:16.474654+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:04:54.678316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.6","version":"264'4","reported_seq":81,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:59:03.048985+0000","last_change":"2024-09-14T11:30:10.463753+0000","last_active":"2024-09-14T12:59:03.048985+0000","last_peered":"2024-09-14T12:59:03.048985+0000","last_clean":"2024-09-14T12:59:03.048985+0000","last_became_active":"2024-09-14T11:30:10.462971+0000","last_became_peered":"2024-09-14T11:30:10.462971+0000","last_unstale":"2024-09-14T12:59:03.048985+0000","last_undegraded":"2024-09-14T12:59:03.048985+0000","last_fullsized":"2024-09-14T12:59:03.048985+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:30:09.411354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:30:09.411354+0000","last_clean_scrub_stamp":"2024-09-14T11:30:09.411354+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:28:19.411905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":16386,"num_write":4,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.5","version":"267'29","reported_seq":156,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:58:27.830841+0000","last_change":"2024-09-14T11:24:10.105209+0000","last_active":"2024-09-14T12:58:27.830841+0000","last_peered":"2024-09-14T12:58:27.830841+0000","last_clean":"2024-09-14T12:58:27.830841+0000","last_became_active":"2024-09-14T11:24:10.104277+0000","last_became_peered":"2024-09-14T11:24:10.104277+0000","last_unstale":"2024-09-14T12:58:27.830841+0000","last_undegraded":"2024-09-14T12:58:27.830841+0000","last_fullsized":"2024-09-14T12:58:27.830841+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:24:09.066501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:24:09.066501+0000","last_clean_scrub_stamp":"2024-09-14T11:24:09.066501+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:27:20.344282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":210,"num_read_kb":138,"num_write":78,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.1","version":"0'0","reported_seq":43,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:59:08.234700+0000","last_change":"2024-09-14T11:58:43.675560+0000","last_active":"2024-09-14T12:59:08.234700+0000","last_peered":"2024-09-14T12:59:08.234700+0000","last_clean":"2024-09-14T12:59:08.234700+0000","last_became_active":"2024-09-14T11:58:43.674870+0000","last_became_peered":"2024-09-14T11:58:43.674870+0000","last_unstale":"2024-09-14T12:59:08.234700+0000","last_undegraded":"2024-09-14T12:59:08.234700+0000","last_fullsized":"2024-09-14T12:59:08.234700+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:58:42.635024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:58:42.635024+0000","last_clean_scrub_stamp":"2024-09-14T11:58:42.635024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:17:48.384984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"67.6","version":"267'2","reported_seq":68,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:01:18.264763+0000","last_change":"2024-09-14T11:30:17.521153+0000","last_active":"2024-09-14T13:01:18.264763+0000","last_peered":"2024-09-14T13:01:18.264763+0000","last_clean":"2024-09-14T13:01:18.264763+0000","last_became_active":"2024-09-14T11:30:17.520433+0000","last_became_peered":"2024-09-14T11:30:17.520433+0000","last_unstale":"2024-09-14T13:01:18.264763+0000","last_undegraded":"2024-09-14T13:01:18.264763+0000","last_fullsized":"2024-09-14T13:01:18.264763+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:30:16.474654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:30:16.474654+0000","last_clean_scrub_stamp":"2024-09-14T11:30:16.474654+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:46:08.197483+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":4096,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.7","version":"267'4","reported_seq":78,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:00.017794+0000","last_change":"2024-09-14T11:30:10.475293+0000","last_active":"2024-09-14T13:02:00.017794+0000","last_peered":"2024-09-14T13:02:00.017794+0000","last_clean":"2024-09-14T13:02:00.017794+0000","last_became_active":"2024-09-14T11:30:10.474546+0000","last_became_peered":"2024-09-14T11:30:10.474546+0000","last_unstale":"2024-09-14T13:02:00.017794+0000","last_undegraded":"2024-09-14T13:02:00.017794+0000","last_fullsized":"2024-09-14T13:02:00.017794+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:30:09.411354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:30:09.411354+0000","last_clean_scrub_stamp":"2024-09-14T11:30:09.411354+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:09:53.059916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":3072,"num_write":4,"num_write_kb":2048,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.4","version":"267'33","reported_seq":160,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:57:58.451122+0000","last_change":"2024-09-14T11:24:10.118920+0000","last_active":"2024-09-14T12:57:58.451122+0000","last_peered":"2024-09-14T12:57:58.451122+0000","last_clean":"2024-09-14T12:57:58.451122+0000","last_became_active":"2024-09-14T11:24:10.118333+0000","last_became_peered":"2024-09-14T11:24:10.118333+0000","last_unstale":"2024-09-14T12:57:58.451122+0000","last_undegraded":"2024-09-14T12:57:58.451122+0000","last_fullsized":"2024-09-14T12:57:58.451122+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:24:09.066501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:24:09.066501+0000","last_clean_scrub_stamp":"2024-09-14T11:24:09.066501+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:28:26.888200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":218,"num_read_kb":138,"num_write":85,"num_write_kb":20,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"68.6","version":"267'1","reported_seq":43,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:59:22.832926+0000","last_change":"2024-09-14T11:58:43.688943+0000","last_active":"2024-09-14T12:59:22.832926+0000","last_peered":"2024-09-14T12:59:22.832926+0000","last_clean":"2024-09-14T12:59:22.832926+0000","last_became_active":"2024-09-14T11:58:43.688251+0000","last_became_peered":"2024-09-14T11:58:43.688251+0000","last_unstale":"2024-09-14T12:59:22.832926+0000","last_undegraded":"2024-09-14T12:59:22.832926+0000","last_fullsized":"2024-09-14T12:59:22.832926+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:58:42.635024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:58:42.635024+0000","last_clean_scrub_stamp":"2024-09-14T11:58:42.635024+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:15:08.766031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.1","version":"267'7","reported_seq":81,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:01:58.505864+0000","last_change":"2024-09-14T11:30:17.519203+0000","last_active":"2024-09-14T13:01:58.505864+0000","last_peered":"2024-09-14T13:01:58.505864+0000","last_clean":"2024-09-14T13:01:58.505864+0000","last_became_active":"2024-09-14T11:30:17.518890+0000","last_became_peered":"2024-09-14T11:30:17.518890+0000","last_unstale":"2024-09-14T13:01:58.505864+0000","last_undegraded":"2024-09-14T13:01:58.505864+0000","last_fullsized":"2024-09-14T13:01:58.505864+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:30:16.474654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:30:16.474654+0000","last_clean_scrub_stamp":"2024-09-14T11:30:16.474654+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:51:39.220265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":19458,"num_write":12,"num_write_kb":7168,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.0","version":"267'2","reported_seq":77,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:00:42.862192+0000","last_change":"2024-09-14T11:30:10.467502+0000","last_active":"2024-09-14T13:00:42.862192+0000","last_peered":"2024-09-14T13:00:42.862192+0000","last_clean":"2024-09-14T13:00:42.862192+0000","last_became_active":"2024-09-14T11:30:10.466391+0000","last_became_peered":"2024-09-14T11:30:10.466391+0000","last_unstale":"2024-09-14T13:00:42.862192+0000","last_undegraded":"2024-09-14T13:00:42.862192+0000","last_fullsized":"2024-09-14T13:00:42.862192+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:30:09.411354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:30:09.411354+0000","last_clean_scrub_stamp":"2024-09-14T11:30:09.411354+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:32:45.732767+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":40,"num_write":2,"num_write_kb":40,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.3","version":"267'41","reported_seq":190,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:57:58.034292+0000","last_change":"2024-09-14T11:24:10.095296+0000","last_active":"2024-09-14T12:57:58.034292+0000","last_peered":"2024-09-14T12:57:58.034292+0000","last_clean":"2024-09-14T12:57:58.034292+0000","last_became_active":"2024-09-14T11:24:10.094515+0000","last_became_peered":"2024-09-14T11:24:10.094515+0000","last_unstale":"2024-09-14T12:57:58.034292+0000","last_undegraded":"2024-09-14T12:57:58.034292+0000","last_fullsized":"2024-09-14T12:57:58.034292+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:24:09.066501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:24:09.066501+0000","last_clean_scrub_stamp":"2024-09-14T11:24:09.066501+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":0,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:59:26.331974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":311,"num_read_kb":196,"num_write":106,"num_write_kb":28,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"68.7","version":"0'0","reported_seq":42,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:59:23.250462+0000","last_change":"2024-09-14T11:58:43.681439+0000","last_active":"2024-09-14T12:59:23.250462+0000","last_peered":"2024-09-14T12:59:23.250462+0000","last_clean":"2024-09-14T12:59:23.250462+0000","last_became_active":"2024-09-14T11:58:43.680569+0000","last_became_peered":"2024-09-14T11:58:43.680569+0000","last_unstale":"2024-09-14T12:59:23.250462+0000","last_undegraded":"2024-09-14T12:59:23.250462+0000","last_fullsized":"2024-09-14T12:59:23.250462+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:58:42.635024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:58:42.635024+0000","last_clean_scrub_stamp":"2024-09-14T11:58:42.635024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:50:38.486174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.0","version":"267'4","reported_seq":76,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:00:43.071448+0000","last_change":"2024-09-14T11:30:17.519289+0000","last_active":"2024-09-14T13:00:43.071448+0000","last_peered":"2024-09-14T13:00:43.071448+0000","last_clean":"2024-09-14T13:00:43.071448+0000","last_became_active":"2024-09-14T11:30:17.518524+0000","last_became_peered":"2024-09-14T11:30:17.518524+0000","last_unstale":"2024-09-14T13:00:43.071448+0000","last_undegraded":"2024-09-14T13:00:43.071448+0000","last_fullsized":"2024-09-14T13:00:43.071448+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:30:16.474654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:30:16.474654+0000","last_clean_scrub_stamp":"2024-09-14T11:30:16.474654+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:59:22.405921+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":6144,"num_write":4,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.1","version":"267'5","reported_seq":80,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:01:52.878597+0000","last_change":"2024-09-14T11:30:10.465435+0000","last_active":"2024-09-14T13:01:52.878597+0000","last_peered":"2024-09-14T13:01:52.878597+0000","last_clean":"2024-09-14T13:01:52.878597+0000","last_became_active":"2024-09-14T11:30:10.464696+0000","last_became_peered":"2024-09-14T11:30:10.464696+0000","last_unstale":"2024-09-14T13:01:52.878597+0000","last_undegraded":"2024-09-14T13:01:52.878597+0000","last_fullsized":"2024-09-14T13:01:52.878597+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:30:09.411354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:30:09.411354+0000","last_clean_scrub_stamp":"2024-09-14T11:30:09.411354+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:34:28.871663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":1024,"num_write":10,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.2","version":"267'34","reported_seq":175,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:57:58.218176+0000","last_change":"2024-09-14T11:24:10.126827+0000","last_active":"2024-09-14T12:57:58.218176+0000","last_peered":"2024-09-14T12:57:58.218176+0000","last_clean":"2024-09-14T12:57:58.218176+0000","last_became_active":"2024-09-14T11:24:10.125885+0000","last_became_peered":"2024-09-14T11:24:10.125885+0000","last_unstale":"2024-09-14T12:57:58.218176+0000","last_undegraded":"2024-09-14T12:57:58.218176+0000","last_fullsized":"2024-09-14T12:57:58.218176+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:24:09.066501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:24:09.066501+0000","last_clean_scrub_stamp":"2024-09-14T11:24:09.066501+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:23:21.772883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":284,"num_read_kb":180,"num_write":83,"num_write_kb":28,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"68.4","version":"0'0","reported_seq":43,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:59:08.246950+0000","last_change":"2024-09-14T11:58:43.663976+0000","last_active":"2024-09-14T12:59:08.246950+0000","last_peered":"2024-09-14T12:59:08.246950+0000","last_clean":"2024-09-14T12:59:08.246950+0000","last_became_active":"2024-09-14T11:58:43.662916+0000","last_became_peered":"2024-09-14T11:58:43.662916+0000","last_unstale":"2024-09-14T12:59:08.246950+0000","last_undegraded":"2024-09-14T12:59:08.246950+0000","last_fullsized":"2024-09-14T12:59:08.246950+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:58:42.635024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:58:42.635024+0000","last_clean_scrub_stamp":"2024-09-14T11:58:42.635024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:29:35.878769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.3","version":"264'4","reported_seq":77,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:59:53.441619+0000","last_change":"2024-09-14T11:30:17.549596+0000","last_active":"2024-09-14T12:59:53.441619+0000","last_peered":"2024-09-14T12:59:53.441619+0000","last_clean":"2024-09-14T12:59:53.441619+0000","last_became_active":"2024-09-14T11:30:17.549019+0000","last_became_peered":"2024-09-14T11:30:17.549019+0000","last_unstale":"2024-09-14T12:59:53.441619+0000","last_undegraded":"2024-09-14T12:59:53.441619+0000","last_fullsized":"2024-09-14T12:59:53.441619+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:30:16.474654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:30:16.474654+0000","last_clean_scrub_stamp":"2024-09-14T11:30:16.474654+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:25:28.016466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":4098,"num_write":4,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"66.2","version":"267'4","reported_seq":81,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:01:53.504635+0000","last_change":"2024-09-14T11:30:10.461463+0000","last_active":"2024-09-14T13:01:53.504635+0000","last_peered":"2024-09-14T13:01:53.504635+0000","last_clean":"2024-09-14T13:01:53.504635+0000","last_became_active":"2024-09-14T11:30:10.460643+0000","last_became_peered":"2024-09-14T11:30:10.460643+0000","last_unstale":"2024-09-14T13:01:53.504635+0000","last_undegraded":"2024-09-14T13:01:53.504635+0000","last_fullsized":"2024-09-14T13:01:53.504635+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:30:09.411354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:30:09.411354+0000","last_clean_scrub_stamp":"2024-09-14T11:30:09.411354+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:37:10.801240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":3072,"num_write":4,"num_write_kb":2048,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.1","version":"267'13","reported_seq":114,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:57:58.608535+0000","last_change":"2024-09-14T11:24:10.117369+0000","last_active":"2024-09-14T12:57:58.608535+0000","last_peered":"2024-09-14T12:57:58.608535+0000","last_clean":"2024-09-14T12:57:58.608535+0000","last_became_active":"2024-09-14T11:24:10.116627+0000","last_became_peered":"2024-09-14T11:24:10.116627+0000","last_unstale":"2024-09-14T12:57:58.608535+0000","last_undegraded":"2024-09-14T12:57:58.608535+0000","last_fullsized":"2024-09-14T12:57:58.608535+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:24:09.066501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:24:09.066501+0000","last_clean_scrub_stamp":"2024-09-14T11:24:09.066501+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:17:32.530599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":96,"num_read_kb":63,"num_write":36,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.5","version":"0'0","reported_seq":43,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:59:32.846067+0000","last_change":"2024-09-14T11:58:43.696722+0000","last_active":"2024-09-14T12:59:32.846067+0000","last_peered":"2024-09-14T12:59:32.846067+0000","last_clean":"2024-09-14T12:59:32.846067+0000","last_became_active":"2024-09-14T11:58:43.695982+0000","last_became_peered":"2024-09-14T11:58:43.695982+0000","last_unstale":"2024-09-14T12:59:32.846067+0000","last_undegraded":"2024-09-14T12:59:32.846067+0000","last_fullsized":"2024-09-14T12:59:32.846067+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:58:42.635024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:58:42.635024+0000","last_clean_scrub_stamp":"2024-09-14T11:58:42.635024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:04:33.126348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.2","version":"264'8","reported_seq":85,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:59:53.244786+0000","last_change":"2024-09-14T11:30:17.513530+0000","last_active":"2024-09-14T12:59:53.244786+0000","last_peered":"2024-09-14T12:59:53.244786+0000","last_clean":"2024-09-14T12:59:53.244786+0000","last_became_active":"2024-09-14T11:30:17.512689+0000","last_became_peered":"2024-09-14T11:30:17.512689+0000","last_unstale":"2024-09-14T12:59:53.244786+0000","last_undegraded":"2024-09-14T12:59:53.244786+0000","last_fullsized":"2024-09-14T12:59:53.244786+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:30:16.474654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:30:16.474654+0000","last_clean_scrub_stamp":"2024-09-14T11:30:16.474654+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:38:38.268473+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":21506,"num_write":8,"num_write_kb":9216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.3","version":"0'0","reported_seq":73,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:59:48.440576+0000","last_change":"2024-09-14T11:30:10.474713+0000","last_active":"2024-09-14T12:59:48.440576+0000","last_peered":"2024-09-14T12:59:48.440576+0000","last_clean":"2024-09-14T12:59:48.440576+0000","last_became_active":"2024-09-14T11:30:10.473880+0000","last_became_peered":"2024-09-14T11:30:10.473880+0000","last_unstale":"2024-09-14T12:59:48.440576+0000","last_undegraded":"2024-09-14T12:59:48.440576+0000","last_fullsized":"2024-09-14T12:59:48.440576+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:30:09.411354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:30:09.411354+0000","last_clean_scrub_stamp":"2024-09-14T11:30:09.411354+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:44:00.695204+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"65.0","version":"264'14","reported_seq":122,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:58:42.834131+0000","last_change":"2024-09-14T11:24:10.116538+0000","last_active":"2024-09-14T12:58:42.834131+0000","last_peered":"2024-09-14T12:58:42.834131+0000","last_clean":"2024-09-14T12:58:42.834131+0000","last_became_active":"2024-09-14T11:24:10.115799+0000","last_became_peered":"2024-09-14T11:24:10.115799+0000","last_unstale":"2024-09-14T12:58:42.834131+0000","last_undegraded":"2024-09-14T12:58:42.834131+0000","last_fullsized":"2024-09-14T12:58:42.834131+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:24:09.066501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:24:09.066501+0000","last_clean_scrub_stamp":"2024-09-14T11:24:09.066501+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:53:06.539792+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":114,"num_read_kb":78,"num_write":35,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3f","version":"267'205","reported_seq":875,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:00.403791+0000","last_change":"2024-09-14T11:08:21.831355+0000","last_active":"2024-09-14T13:02:00.403791+0000","last_peered":"2024-09-14T13:02:00.403791+0000","last_clean":"2024-09-14T13:02:00.403791+0000","last_became_active":"2024-09-14T11:08:21.829676+0000","last_became_peered":"2024-09-14T11:08:21.829676+0000","last_unstale":"2024-09-14T13:02:00.403791+0000","last_undegraded":"2024-09-14T13:02:00.403791+0000","last_fullsized":"2024-09-14T13:02:00.403791+0000","mapping_epoch":24,"log_start":"267'100","ondisk_log_start":"267'100","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:08:20.733145+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:08:20.733145+0000","last_clean_scrub_stamp":"2024-09-14T11:08:20.733145+0000","objects_scrubbed":0,"log_size":105,"log_dups_size":100,"ondisk_log_size":105,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:36:16.240993+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":30,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":573,"num_read_kb":18432,"num_write":892,"num_write_kb":26168,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,0],"acting":[7,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.38","version":"267'461","reported_seq":2067,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:59:14.735536+0000","last_change":"2024-09-14T11:08:23.801607+0000","last_active":"2024-09-14T12:59:14.735536+0000","last_peered":"2024-09-14T12:59:14.735536+0000","last_clean":"2024-09-14T12:59:14.735536+0000","last_became_active":"2024-09-14T11:08:23.800936+0000","last_became_peered":"2024-09-14T11:08:23.800936+0000","last_unstale":"2024-09-14T12:59:14.735536+0000","last_undegraded":"2024-09-14T12:59:14.735536+0000","last_fullsized":"2024-09-14T12:59:14.735536+0000","mapping_epoch":26,"log_start":"267'400","ondisk_log_start":"267'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:08:22.750609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:08:22.750609+0000","last_clean_scrub_stamp":"2024-09-14T11:08:22.750609+0000","objects_scrubbed":0,"log_size":61,"log_dups_size":400,"ondisk_log_size":61,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:16:00.073851+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":2476,"num_read_kb":2325,"num_write":550,"num_write_kb":127,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3e","version":"267'229","reported_seq":936,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:00.387084+0000","last_change":"2024-09-14T11:08:21.810078+0000","last_active":"2024-09-14T13:02:00.387084+0000","last_peered":"2024-09-14T13:02:00.387084+0000","last_clean":"2024-09-14T13:02:00.387084+0000","last_became_active":"2024-09-14T11:08:21.808315+0000","last_became_peered":"2024-09-14T11:08:21.808315+0000","last_unstale":"2024-09-14T13:02:00.387084+0000","last_undegraded":"2024-09-14T13:02:00.387084+0000","last_fullsized":"2024-09-14T13:02:00.387084+0000","mapping_epoch":24,"log_start":"267'200","ondisk_log_start":"267'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:08:20.733145+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:08:20.733145+0000","last_clean_scrub_stamp":"2024-09-14T11:08:20.733145+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":200,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:01:33.622838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1655861,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":605,"num_read_kb":113994,"num_write":1045,"num_write_kb":54817,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,6],"acting":[1,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.39","version":"267'896","reported_seq":2642,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:59:07.757541+0000","last_change":"2024-09-14T11:08:23.802023+0000","last_active":"2024-09-14T12:59:07.757541+0000","last_peered":"2024-09-14T12:59:07.757541+0000","last_clean":"2024-09-14T12:59:07.757541+0000","last_became_active":"2024-09-14T11:08:23.801320+0000","last_became_peered":"2024-09-14T11:08:23.801320+0000","last_unstale":"2024-09-14T12:59:07.757541+0000","last_undegraded":"2024-09-14T12:59:07.757541+0000","last_fullsized":"2024-09-14T12:59:07.757541+0000","mapping_epoch":26,"log_start":"267'800","ondisk_log_start":"267'800","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:08:22.750609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:08:22.750609+0000","last_clean_scrub_stamp":"2024-09-14T11:08:22.750609+0000","objects_scrubbed":0,"log_size":96,"log_dups_size":800,"ondisk_log_size":96,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:41:31.186802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":4549,"num_read_kb":4112,"num_write":1219,"num_write_kb":503,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3d","version":"267'201","reported_seq":848,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:01:59.995562+0000","last_change":"2024-09-14T11:08:21.776968+0000","last_active":"2024-09-14T13:01:59.995562+0000","last_peered":"2024-09-14T13:01:59.995562+0000","last_clean":"2024-09-14T13:01:59.995562+0000","last_became_active":"2024-09-14T11:08:21.776255+0000","last_became_peered":"2024-09-14T11:08:21.776255+0000","last_unstale":"2024-09-14T13:01:59.995562+0000","last_undegraded":"2024-09-14T13:01:59.995562+0000","last_fullsized":"2024-09-14T13:01:59.995562+0000","mapping_epoch":24,"log_start":"267'100","ondisk_log_start":"267'100","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:08:20.733145+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:08:20.733145+0000","last_clean_scrub_stamp":"2024-09-14T11:08:20.733145+0000","objects_scrubbed":0,"log_size":101,"log_dups_size":100,"ondisk_log_size":101,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:55:21.434023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":515488,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":487,"num_read_kb":4028,"num_write":961,"num_write_kb":22458,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"267'468","reported_seq":2120,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:59:07.754233+0000","last_change":"2024-09-14T11:08:23.787232+0000","last_active":"2024-09-14T12:59:07.754233+0000","last_peered":"2024-09-14T12:59:07.754233+0000","last_clean":"2024-09-14T12:59:07.754233+0000","last_became_active":"2024-09-14T11:08:23.786481+0000","last_became_peered":"2024-09-14T11:08:23.786481+0000","last_unstale":"2024-09-14T12:59:07.754233+0000","last_undegraded":"2024-09-14T12:59:07.754233+0000","last_fullsized":"2024-09-14T12:59:07.754233+0000","mapping_epoch":26,"log_start":"267'400","ondisk_log_start":"267'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:08:22.750609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:08:22.750609+0000","last_clean_scrub_stamp":"2024-09-14T11:08:22.750609+0000","objects_scrubbed":0,"log_size":68,"log_dups_size":400,"ondisk_log_size":68,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:00:38.268952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2493,"num_read_kb":2352,"num_write":540,"num_write_kb":121,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3c","version":"267'354","reported_seq":1095,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:00.415604+0000","last_change":"2024-09-14T11:08:21.802797+0000","last_active":"2024-09-14T13:02:00.415604+0000","last_peered":"2024-09-14T13:02:00.415604+0000","last_clean":"2024-09-14T13:02:00.415604+0000","last_became_active":"2024-09-14T11:08:21.801787+0000","last_became_peered":"2024-09-14T11:08:21.801787+0000","last_unstale":"2024-09-14T13:02:00.415604+0000","last_undegraded":"2024-09-14T13:02:00.415604+0000","last_fullsized":"2024-09-14T13:02:00.415604+0000","mapping_epoch":24,"log_start":"267'300","ondisk_log_start":"267'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:08:20.733145+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:08:20.733145+0000","last_clean_scrub_stamp":"2024-09-14T11:08:20.733145+0000","objects_scrubbed":0,"log_size":54,"log_dups_size":300,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:42:26.197796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":72,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1015,"num_read_kb":46026,"num_write":1390,"num_write_kb":39725,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3b","version":"267'448","reported_seq":1981,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:58:28.236458+0000","last_change":"2024-09-14T11:08:23.783446+0000","last_active":"2024-09-14T12:58:28.236458+0000","last_peered":"2024-09-14T12:58:28.236458+0000","last_clean":"2024-09-14T12:58:28.236458+0000","last_became_active":"2024-09-14T11:08:23.783162+0000","last_became_peered":"2024-09-14T11:08:23.783162+0000","last_unstale":"2024-09-14T12:58:28.236458+0000","last_undegraded":"2024-09-14T12:58:28.236458+0000","last_fullsized":"2024-09-14T12:58:28.236458+0000","mapping_epoch":26,"log_start":"267'400","ondisk_log_start":"267'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:08:22.750609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:08:22.750609+0000","last_clean_scrub_stamp":"2024-09-14T11:08:22.750609+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":400,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:56:25.662634+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2320,"num_read_kb":2170,"num_write":502,"num_write_kb":112,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3b","version":"267'212","reported_seq":893,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:00.458282+0000","last_change":"2024-09-14T11:08:21.842866+0000","last_active":"2024-09-14T13:02:00.458282+0000","last_peered":"2024-09-14T13:02:00.458282+0000","last_clean":"2024-09-14T13:02:00.458282+0000","last_became_active":"2024-09-14T11:08:21.842260+0000","last_became_peered":"2024-09-14T11:08:21.842260+0000","last_unstale":"2024-09-14T13:02:00.458282+0000","last_undegraded":"2024-09-14T13:02:00.458282+0000","last_fullsized":"2024-09-14T13:02:00.458282+0000","mapping_epoch":24,"log_start":"267'200","ondisk_log_start":"267'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:08:20.733145+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:08:20.733145+0000","last_clean_scrub_stamp":"2024-09-14T11:08:20.733145+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":200,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:22:55.165506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1655822,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":567,"num_read_kb":28109,"num_write":991,"num_write_kb":35425,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,4],"acting":[7,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3c","version":"267'413","reported_seq":2185,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:00:21.249733+0000","last_change":"2024-09-14T11:08:23.805016+0000","last_active":"2024-09-14T13:00:21.249733+0000","last_peered":"2024-09-14T13:00:21.249733+0000","last_clean":"2024-09-14T13:00:21.249733+0000","last_became_active":"2024-09-14T11:08:23.804142+0000","last_became_peered":"2024-09-14T11:08:23.804142+0000","last_unstale":"2024-09-14T13:00:21.249733+0000","last_undegraded":"2024-09-14T13:00:21.249733+0000","last_fullsized":"2024-09-14T13:00:21.249733+0000","mapping_epoch":26,"log_start":"267'400","ondisk_log_start":"267'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:08:22.750609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:08:22.750609+0000","last_clean_scrub_stamp":"2024-09-14T11:08:22.750609+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":400,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:55:23.451486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":2567,"num_read_kb":2469,"num_write":470,"num_write_kb":86,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.3a","version":"267'155","reported_seq":779,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:00.266088+0000","last_change":"2024-09-14T11:08:21.794493+0000","last_active":"2024-09-14T13:02:00.266088+0000","last_peered":"2024-09-14T13:02:00.266088+0000","last_clean":"2024-09-14T13:02:00.266088+0000","last_became_active":"2024-09-14T11:08:21.791801+0000","last_became_peered":"2024-09-14T11:08:21.791801+0000","last_unstale":"2024-09-14T13:02:00.266088+0000","last_undegraded":"2024-09-14T13:02:00.266088+0000","last_fullsized":"2024-09-14T13:02:00.266088+0000","mapping_epoch":24,"log_start":"267'100","ondisk_log_start":"267'100","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:08:20.733145+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:08:20.733145+0000","last_clean_scrub_stamp":"2024-09-14T11:08:20.733145+0000","objects_scrubbed":0,"log_size":55,"log_dups_size":100,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:05:17.496109+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":30,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":413,"num_read_kb":24131,"num_write":680,"num_write_kb":32915,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,3],"acting":[5,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3d","version":"267'393","reported_seq":1933,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:00:21.252531+0000","last_change":"2024-09-14T11:08:23.787239+0000","last_active":"2024-09-14T13:00:21.252531+0000","last_peered":"2024-09-14T13:00:21.252531+0000","last_clean":"2024-09-14T13:00:21.252531+0000","last_became_active":"2024-09-14T11:08:23.786522+0000","last_became_peered":"2024-09-14T11:08:23.786522+0000","last_unstale":"2024-09-14T13:00:21.252531+0000","last_undegraded":"2024-09-14T13:00:21.252531+0000","last_fullsized":"2024-09-14T13:00:21.252531+0000","mapping_epoch":26,"log_start":"267'300","ondisk_log_start":"267'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:08:22.750609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:08:22.750609+0000","last_clean_scrub_stamp":"2024-09-14T11:08:22.750609+0000","objects_scrubbed":0,"log_size":93,"log_dups_size":300,"ondisk_log_size":93,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:53:44.242192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2147,"num_read_kb":2043,"num_write":454,"num_write_kb":90,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.39","version":"267'266","reported_seq":1031,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:00.401231+0000","last_change":"2024-09-14T11:08:21.837745+0000","last_active":"2024-09-14T13:02:00.401231+0000","last_peered":"2024-09-14T13:02:00.401231+0000","last_clean":"2024-09-14T13:02:00.401231+0000","last_became_active":"2024-09-14T11:08:21.837147+0000","last_became_peered":"2024-09-14T11:08:21.837147+0000","last_unstale":"2024-09-14T13:02:00.401231+0000","last_undegraded":"2024-09-14T13:02:00.401231+0000","last_fullsized":"2024-09-14T13:02:00.401231+0000","mapping_epoch":24,"log_start":"267'200","ondisk_log_start":"267'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:08:20.733145+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:08:20.733145+0000","last_clean_scrub_stamp":"2024-09-14T11:08:20.733145+0000","objects_scrubbed":0,"log_size":66,"log_dups_size":200,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:35:30.293697+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1655838,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1268,"num_read_kb":31286,"num_write":1154,"num_write_kb":25837,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0,4],"acting":[7,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3e","version":"267'508","reported_seq":2123,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:00:11.324764+0000","last_change":"2024-09-14T11:08:23.801317+0000","last_active":"2024-09-14T13:00:11.324764+0000","last_peered":"2024-09-14T13:00:11.324764+0000","last_clean":"2024-09-14T13:00:11.324764+0000","last_became_active":"2024-09-14T11:08:23.800621+0000","last_became_peered":"2024-09-14T11:08:23.800621+0000","last_unstale":"2024-09-14T13:00:11.324764+0000","last_undegraded":"2024-09-14T13:00:11.324764+0000","last_fullsized":"2024-09-14T13:00:11.324764+0000","mapping_epoch":26,"log_start":"267'400","ondisk_log_start":"267'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:08:22.750609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:08:22.750609+0000","last_clean_scrub_stamp":"2024-09-14T11:08:22.750609+0000","objects_scrubbed":0,"log_size":108,"log_dups_size":400,"ondisk_log_size":108,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:34:14.386345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2676,"num_read_kb":2481,"num_write":623,"num_write_kb":172,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.38","version":"267'224","reported_seq":890,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:00.418336+0000","last_change":"2024-09-14T11:08:21.819323+0000","last_active":"2024-09-14T13:02:00.418336+0000","last_peered":"2024-09-14T13:02:00.418336+0000","last_clean":"2024-09-14T13:02:00.418336+0000","last_became_active":"2024-09-14T11:08:21.819029+0000","last_became_peered":"2024-09-14T11:08:21.819029+0000","last_unstale":"2024-09-14T13:02:00.418336+0000","last_undegraded":"2024-09-14T13:02:00.418336+0000","last_fullsized":"2024-09-14T13:02:00.418336+0000","mapping_epoch":24,"log_start":"267'200","ondisk_log_start":"267'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:08:20.733145+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:08:20.733145+0000","last_clean_scrub_stamp":"2024-09-14T11:08:20.733145+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":200,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:51:45.031916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":66,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":538,"num_read_kb":44678,"num_write":942,"num_write_kb":39932,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,6],"acting":[3,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3f","version":"267'916","reported_seq":2562,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:59:18.403546+0000","last_change":"2024-09-14T11:08:23.786220+0000","last_active":"2024-09-14T12:59:18.403546+0000","last_peered":"2024-09-14T12:59:18.403546+0000","last_clean":"2024-09-14T12:59:18.403546+0000","last_became_active":"2024-09-14T11:08:23.785941+0000","last_became_peered":"2024-09-14T11:08:23.785941+0000","last_unstale":"2024-09-14T12:59:18.403546+0000","last_undegraded":"2024-09-14T12:59:18.403546+0000","last_fullsized":"2024-09-14T12:59:18.403546+0000","mapping_epoch":26,"log_start":"267'900","ondisk_log_start":"267'900","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:08:22.750609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:08:22.750609+0000","last_clean_scrub_stamp":"2024-09-14T11:08:22.750609+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":900,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:26:08.067752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":4272,"num_read_kb":3805,"num_write":1224,"num_write_kb":476,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"267'397","reported_seq":1969,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:00:21.252799+0000","last_change":"2024-09-14T11:08:23.786268+0000","last_active":"2024-09-14T13:00:21.252799+0000","last_peered":"2024-09-14T13:00:21.252799+0000","last_clean":"2024-09-14T13:00:21.252799+0000","last_became_active":"2024-09-14T11:08:23.785439+0000","last_became_peered":"2024-09-14T11:08:23.785439+0000","last_unstale":"2024-09-14T13:00:21.252799+0000","last_undegraded":"2024-09-14T13:00:21.252799+0000","last_fullsized":"2024-09-14T13:00:21.252799+0000","mapping_epoch":26,"log_start":"267'300","ondisk_log_start":"267'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:08:22.750609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:08:22.750609+0000","last_clean_scrub_stamp":"2024-09-14T11:08:22.750609+0000","objects_scrubbed":0,"log_size":97,"log_dups_size":300,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:49:38.056814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2124,"num_read_kb":2036,"num_write":427,"num_write_kb":63,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.37","version":"267'275","reported_seq":1007,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:00.331464+0000","last_change":"2024-09-14T11:08:21.806356+0000","last_active":"2024-09-14T13:02:00.331464+0000","last_peered":"2024-09-14T13:02:00.331464+0000","last_clean":"2024-09-14T13:02:00.331464+0000","last_became_active":"2024-09-14T11:08:21.805293+0000","last_became_peered":"2024-09-14T11:08:21.805293+0000","last_unstale":"2024-09-14T13:02:00.331464+0000","last_undegraded":"2024-09-14T13:02:00.331464+0000","last_fullsized":"2024-09-14T13:02:00.331464+0000","mapping_epoch":24,"log_start":"267'200","ondisk_log_start":"267'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:08:20.733145+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:08:20.733145+0000","last_clean_scrub_stamp":"2024-09-14T11:08:20.733145+0000","objects_scrubbed":0,"log_size":75,"log_dups_size":200,"ondisk_log_size":75,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:37:18.597607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1655894,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":1085,"num_read_kb":13085,"num_write":1149,"num_write_kb":51014,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,0],"acting":[7,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.31","version":"267'698","reported_seq":2408,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:00:21.250245+0000","last_change":"2024-09-14T11:08:23.808916+0000","last_active":"2024-09-14T13:00:21.250245+0000","last_peered":"2024-09-14T13:00:21.250245+0000","last_clean":"2024-09-14T13:00:21.250245+0000","last_became_active":"2024-09-14T11:08:23.808090+0000","last_became_peered":"2024-09-14T11:08:23.808090+0000","last_unstale":"2024-09-14T13:00:21.250245+0000","last_undegraded":"2024-09-14T13:00:21.250245+0000","last_fullsized":"2024-09-14T13:00:21.250245+0000","mapping_epoch":26,"log_start":"267'600","ondisk_log_start":"267'600","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:08:22.750609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:08:22.750609+0000","last_clean_scrub_stamp":"2024-09-14T11:08:22.750609+0000","objects_scrubbed":0,"log_size":98,"log_dups_size":600,"ondisk_log_size":98,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:17:11.316389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":3652,"num_read_kb":3296,"num_write":1024,"num_write_kb":466,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"267'186","reported_seq":821,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:00.393653+0000","last_change":"2024-09-14T11:08:21.825717+0000","last_active":"2024-09-14T13:02:00.393653+0000","last_peered":"2024-09-14T13:02:00.393653+0000","last_clean":"2024-09-14T13:02:00.393653+0000","last_became_active":"2024-09-14T11:08:21.824907+0000","last_became_peered":"2024-09-14T11:08:21.824907+0000","last_unstale":"2024-09-14T13:02:00.393653+0000","last_undegraded":"2024-09-14T13:02:00.393653+0000","last_fullsized":"2024-09-14T13:02:00.393653+0000","mapping_epoch":24,"log_start":"267'100","ondisk_log_start":"267'100","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:08:20.733145+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:08:20.733145+0000","last_clean_scrub_stamp":"2024-09-14T11:08:20.733145+0000","objects_scrubbed":0,"log_size":86,"log_dups_size":100,"ondisk_log_size":86,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:24:44.159796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":511,"num_read_kb":17563,"num_write":879,"num_write_kb":17084,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,4],"acting":[6,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.32","version":"267'540","reported_seq":2172,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:58:38.043258+0000","last_change":"2024-09-14T11:08:23.804611+0000","last_active":"2024-09-14T12:58:38.043258+0000","last_peered":"2024-09-14T12:58:38.043258+0000","last_clean":"2024-09-14T12:58:38.043258+0000","last_became_active":"2024-09-14T11:08:23.801090+0000","last_became_peered":"2024-09-14T11:08:23.801090+0000","last_unstale":"2024-09-14T12:58:38.043258+0000","last_undegraded":"2024-09-14T12:58:38.043258+0000","last_fullsized":"2024-09-14T12:58:38.043258+0000","mapping_epoch":26,"log_start":"267'500","ondisk_log_start":"267'500","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:08:22.750609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:08:22.750609+0000","last_clean_scrub_stamp":"2024-09-14T11:08:22.750609+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":500,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:20:59.798401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2832,"num_read_kb":2611,"num_write":684,"num_write_kb":208,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.35","version":"267'227","reported_seq":897,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:01:58.469404+0000","last_change":"2024-09-14T11:08:21.817869+0000","last_active":"2024-09-14T13:01:58.469404+0000","last_peered":"2024-09-14T13:01:58.469404+0000","last_clean":"2024-09-14T13:01:58.469404+0000","last_became_active":"2024-09-14T11:08:21.817113+0000","last_became_peered":"2024-09-14T11:08:21.817113+0000","last_unstale":"2024-09-14T13:01:58.469404+0000","last_undegraded":"2024-09-14T13:01:58.469404+0000","last_fullsized":"2024-09-14T13:01:58.469404+0000","mapping_epoch":24,"log_start":"267'200","ondisk_log_start":"267'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:08:20.733145+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:08:20.733145+0000","last_clean_scrub_stamp":"2024-09-14T11:08:20.733145+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":200,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:19:02.887954+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1655893,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":573,"num_read_kb":71773,"num_write":1062,"num_write_kb":34768,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,0],"acting":[6,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.33","version":"267'480","reported_seq":2202,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:59:37.835877+0000","last_change":"2024-09-14T11:08:23.782419+0000","last_active":"2024-09-14T12:59:37.835877+0000","last_peered":"2024-09-14T12:59:37.835877+0000","last_clean":"2024-09-14T12:59:37.835877+0000","last_became_active":"2024-09-14T11:08:23.782135+0000","last_became_peered":"2024-09-14T11:08:23.782135+0000","last_unstale":"2024-09-14T12:59:37.835877+0000","last_undegraded":"2024-09-14T12:59:37.835877+0000","last_fullsized":"2024-09-14T12:59:37.835877+0000","mapping_epoch":26,"log_start":"267'400","ondisk_log_start":"267'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:08:22.750609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:08:22.750609+0000","last_clean_scrub_stamp":"2024-09-14T11:08:22.750609+0000","objects_scrubbed":0,"log_size":80,"log_dups_size":400,"ondisk_log_size":80,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:10:45.724644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2660,"num_read_kb":2528,"num_write":519,"num_write_kb":93,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.34","version":"267'250","reported_seq":904,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:00.331529+0000","last_change":"2024-09-14T11:08:21.837036+0000","last_active":"2024-09-14T13:02:00.331529+0000","last_peered":"2024-09-14T13:02:00.331529+0000","last_clean":"2024-09-14T13:02:00.331529+0000","last_became_active":"2024-09-14T11:08:21.835636+0000","last_became_peered":"2024-09-14T11:08:21.835636+0000","last_unstale":"2024-09-14T13:02:00.331529+0000","last_undegraded":"2024-09-14T13:02:00.331529+0000","last_fullsized":"2024-09-14T13:02:00.331529+0000","mapping_epoch":24,"log_start":"267'200","ondisk_log_start":"267'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:08:20.733145+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:08:20.733145+0000","last_clean_scrub_stamp":"2024-09-14T11:08:20.733145+0000","objects_scrubbed":0,"log_size":50,"log_dups_size":200,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:36:27.787998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1655836,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":575,"num_read_kb":3577,"num_write":1185,"num_write_kb":25395,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6],"acting":[4,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.34","version":"267'553","reported_seq":2211,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:59:37.835931+0000","last_change":"2024-09-14T11:08:23.784471+0000","last_active":"2024-09-14T12:59:37.835931+0000","last_peered":"2024-09-14T12:59:37.835931+0000","last_clean":"2024-09-14T12:59:37.835931+0000","last_became_active":"2024-09-14T11:08:23.784078+0000","last_became_peered":"2024-09-14T11:08:23.784078+0000","last_unstale":"2024-09-14T12:59:37.835931+0000","last_undegraded":"2024-09-14T12:59:37.835931+0000","last_fullsized":"2024-09-14T12:59:37.835931+0000","mapping_epoch":26,"log_start":"267'500","ondisk_log_start":"267'500","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:08:22.750609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:08:22.750609+0000","last_clean_scrub_stamp":"2024-09-14T11:08:22.750609+0000","objects_scrubbed":0,"log_size":53,"log_dups_size":500,"ondisk_log_size":53,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:53:20.985980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3071,"num_read_kb":2852,"num_write":734,"num_write_kb":256,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.33","version":"267'240","reported_seq":874,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:00.415888+0000","last_change":"2024-09-14T11:08:21.809864+0000","last_active":"2024-09-14T13:02:00.415888+0000","last_peered":"2024-09-14T13:02:00.415888+0000","last_clean":"2024-09-14T13:02:00.415888+0000","last_became_active":"2024-09-14T11:08:21.809526+0000","last_became_peered":"2024-09-14T11:08:21.809526+0000","last_unstale":"2024-09-14T13:02:00.415888+0000","last_undegraded":"2024-09-14T13:02:00.415888+0000","last_fullsized":"2024-09-14T13:02:00.415888+0000","mapping_epoch":24,"log_start":"267'200","ondisk_log_start":"267'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:08:20.733145+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:08:20.733145+0000","last_clean_scrub_stamp":"2024-09-14T11:08:20.733145+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":200,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:48:26.943407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":500,"num_read_kb":25008,"num_write":1059,"num_write_kb":23085,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6,1],"acting":[3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.35","version":"267'800","reported_seq":2456,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:00:11.323529+0000","last_change":"2024-09-14T11:08:23.786757+0000","last_active":"2024-09-14T13:00:11.323529+0000","last_peered":"2024-09-14T13:00:11.323529+0000","last_clean":"2024-09-14T13:00:11.323529+0000","last_became_active":"2024-09-14T11:08:23.785540+0000","last_became_peered":"2024-09-14T11:08:23.785540+0000","last_unstale":"2024-09-14T13:00:11.323529+0000","last_undegraded":"2024-09-14T13:00:11.323529+0000","last_fullsized":"2024-09-14T13:00:11.323529+0000","mapping_epoch":26,"log_start":"267'700","ondisk_log_start":"267'700","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:08:22.750609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:08:22.750609+0000","last_clean_scrub_stamp":"2024-09-14T11:08:22.750609+0000","objects_scrubbed":0,"log_size":100,"log_dups_size":700,"ondisk_log_size":100,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:29:32.957124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3845,"num_read_kb":3496,"num_write":1039,"num_write_kb":364,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.32","version":"267'223","reported_seq":1012,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:00.287867+0000","last_change":"2024-09-14T11:08:21.781133+0000","last_active":"2024-09-14T13:02:00.287867+0000","last_peered":"2024-09-14T13:02:00.287867+0000","last_clean":"2024-09-14T13:02:00.287867+0000","last_became_active":"2024-09-14T11:08:21.780800+0000","last_became_peered":"2024-09-14T11:08:21.780800+0000","last_unstale":"2024-09-14T13:02:00.287867+0000","last_undegraded":"2024-09-14T13:02:00.287867+0000","last_fullsized":"2024-09-14T13:02:00.287867+0000","mapping_epoch":24,"log_start":"267'200","ondisk_log_start":"267'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:08:20.733145+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:08:20.733145+0000","last_clean_scrub_stamp":"2024-09-14T11:08:20.733145+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":200,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:07:51.388416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1655860,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1400,"num_read_kb":21343,"num_write":1086,"num_write_kb":34809,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,1],"acting":[0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.18","version":"267'195","reported_seq":738,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:00:21.491522+0000","last_change":"2024-09-14T11:08:31.851342+0000","last_active":"2024-09-14T13:00:21.491522+0000","last_peered":"2024-09-14T13:00:21.491522+0000","last_clean":"2024-09-14T13:00:21.491522+0000","last_became_active":"2024-09-14T11:08:31.850605+0000","last_became_peered":"2024-09-14T11:08:31.850605+0000","last_unstale":"2024-09-14T13:00:21.491522+0000","last_undegraded":"2024-09-14T13:00:21.491522+0000","last_fullsized":"2024-09-14T13:00:21.491522+0000","mapping_epoch":34,"log_start":"267'100","ondisk_log_start":"267'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:08:30.789404+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:08:30.789404+0000","last_clean_scrub_stamp":"2024-09-14T11:08:30.789404+0000","objects_scrubbed":0,"log_size":95,"log_dups_size":100,"ondisk_log_size":95,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:48:10.230125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":204,"num_read_kb":191,"num_write":376,"num_write_kb":86,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.14","version":"267'865","reported_seq":2388,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:00:18.886532+0000","last_change":"2024-09-14T11:08:23.780134+0000","last_active":"2024-09-14T13:00:18.886532+0000","last_peered":"2024-09-14T13:00:18.886532+0000","last_clean":"2024-09-14T13:00:18.886532+0000","last_became_active":"2024-09-14T11:08:23.779822+0000","last_became_peered":"2024-09-14T11:08:23.779822+0000","last_unstale":"2024-09-14T13:00:18.886532+0000","last_undegraded":"2024-09-14T13:00:18.886532+0000","last_fullsized":"2024-09-14T13:00:18.886532+0000","mapping_epoch":26,"log_start":"267'800","ondisk_log_start":"267'800","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:08:22.750609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:08:22.750609+0000","last_clean_scrub_stamp":"2024-09-14T11:08:22.750609+0000","objects_scrubbed":0,"log_size":65,"log_dups_size":800,"ondisk_log_size":65,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:33:11.558147+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":4044,"num_read_kb":3595,"num_write":1182,"num_write_kb":452,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"267'245","reported_seq":1013,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:00.404866+0000","last_change":"2024-09-14T11:08:21.843849+0000","last_active":"2024-09-14T13:02:00.404866+0000","last_peered":"2024-09-14T13:02:00.404866+0000","last_clean":"2024-09-14T13:02:00.404866+0000","last_became_active":"2024-09-14T11:08:21.843212+0000","last_became_peered":"2024-09-14T11:08:21.843212+0000","last_unstale":"2024-09-14T13:02:00.404866+0000","last_undegraded":"2024-09-14T13:02:00.404866+0000","last_fullsized":"2024-09-14T13:02:00.404866+0000","mapping_epoch":24,"log_start":"267'200","ondisk_log_start":"267'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:08:20.733145+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:08:20.733145+0000","last_clean_scrub_stamp":"2024-09-14T11:08:20.733145+0000","objects_scrubbed":0,"log_size":45,"log_dups_size":200,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:37:14.565663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":15,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1021,"num_read_kb":177071,"num_write":1108,"num_write_kb":33961,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,4],"acting":[7,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":526,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:59:38.056657+0000","last_change":"2024-09-14T11:08:25.814095+0000","last_active":"2024-09-14T12:59:38.056657+0000","last_peered":"2024-09-14T12:59:38.056657+0000","last_clean":"2024-09-14T12:59:38.056657+0000","last_became_active":"2024-09-14T11:08:25.803311+0000","last_became_peered":"2024-09-14T11:08:25.803311+0000","last_unstale":"2024-09-14T12:59:38.056657+0000","last_undegraded":"2024-09-14T12:59:38.056657+0000","last_fullsized":"2024-09-14T12:59:38.056657+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:08:24.757170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:08:24.757170+0000","last_clean_scrub_stamp":"2024-09-14T11:08:24.757170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:07:56.109258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.16","version":"267'228","reported_seq":886,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:00.082194+0000","last_change":"2024-09-14T11:08:27.809396+0000","last_active":"2024-09-14T13:02:00.082194+0000","last_peered":"2024-09-14T13:02:00.082194+0000","last_clean":"2024-09-14T13:02:00.082194+0000","last_became_active":"2024-09-14T11:08:27.808834+0000","last_became_peered":"2024-09-14T11:08:27.808834+0000","last_unstale":"2024-09-14T13:02:00.082194+0000","last_undegraded":"2024-09-14T13:02:00.082194+0000","last_fullsized":"2024-09-14T13:02:00.082194+0000","mapping_epoch":30,"log_start":"267'200","ondisk_log_start":"267'200","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:08:26.771628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:08:26.771628+0000","last_clean_scrub_stamp":"2024-09-14T11:08:26.771628+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":200,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:33:46.586543+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4096,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":308,"num_read_kb":323,"num_write":180,"num_write_kb":16,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":518,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:57:17.814599+0000","last_change":"2024-09-14T11:08:29.834235+0000","last_active":"2024-09-14T12:57:17.814599+0000","last_peered":"2024-09-14T12:57:17.814599+0000","last_clean":"2024-09-14T12:57:17.814599+0000","last_became_active":"2024-09-14T11:08:29.833332+0000","last_became_peered":"2024-09-14T11:08:29.833332+0000","last_unstale":"2024-09-14T12:57:17.814599+0000","last_undegraded":"2024-09-14T12:57:17.814599+0000","last_fullsized":"2024-09-14T12:57:17.814599+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:08:28.783586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:08:28.783586+0000","last_clean_scrub_stamp":"2024-09-14T11:08:28.783586+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:59:44.395012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.19","version":"267'122","reported_seq":639,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:57:48.032017+0000","last_change":"2024-09-14T11:08:31.844405+0000","last_active":"2024-09-14T12:57:48.032017+0000","last_peered":"2024-09-14T12:57:48.032017+0000","last_clean":"2024-09-14T12:57:48.032017+0000","last_became_active":"2024-09-14T11:08:31.843645+0000","last_became_peered":"2024-09-14T11:08:31.843645+0000","last_unstale":"2024-09-14T12:57:48.032017+0000","last_undegraded":"2024-09-14T12:57:48.032017+0000","last_fullsized":"2024-09-14T12:57:48.032017+0000","mapping_epoch":34,"log_start":"267'100","ondisk_log_start":"267'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:08:30.789404+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:08:30.789404+0000","last_clean_scrub_stamp":"2024-09-14T11:08:30.789404+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":100,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:14:31.616675+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":100,"num_read_kb":97,"num_write":289,"num_write_kb":65,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.15","version":"267'1234","reported_seq":3012,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:00:18.884904+0000","last_change":"2024-09-14T11:08:23.809577+0000","last_active":"2024-09-14T13:00:18.884904+0000","last_peered":"2024-09-14T13:00:18.884904+0000","last_clean":"2024-09-14T13:00:18.884904+0000","last_became_active":"2024-09-14T11:08:23.808015+0000","last_became_peered":"2024-09-14T11:08:23.808015+0000","last_unstale":"2024-09-14T13:00:18.884904+0000","last_undegraded":"2024-09-14T13:00:18.884904+0000","last_fullsized":"2024-09-14T13:00:18.884904+0000","mapping_epoch":26,"log_start":"267'1200","ondisk_log_start":"267'1200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:08:22.750609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:08:22.750609+0000","last_clean_scrub_stamp":"2024-09-14T11:08:22.750609+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":1200,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:00:36.480612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":5778,"num_read_kb":5143,"num_write":1691,"num_write_kb":698,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.12","version":"267'232","reported_seq":949,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:00.406149+0000","last_change":"2024-09-14T11:08:21.787689+0000","last_active":"2024-09-14T13:02:00.406149+0000","last_peered":"2024-09-14T13:02:00.406149+0000","last_clean":"2024-09-14T13:02:00.406149+0000","last_became_active":"2024-09-14T11:08:21.787257+0000","last_became_peered":"2024-09-14T11:08:21.787257+0000","last_unstale":"2024-09-14T13:02:00.406149+0000","last_undegraded":"2024-09-14T13:02:00.406149+0000","last_fullsized":"2024-09-14T13:02:00.406149+0000","mapping_epoch":24,"log_start":"267'200","ondisk_log_start":"267'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:08:20.733145+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:08:20.733145+0000","last_clean_scrub_stamp":"2024-09-14T11:08:20.733145+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":200,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:56:32.268492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":660,"num_read_kb":98910,"num_write":982,"num_write_kb":32453,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3],"acting":[0,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":527,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:58:28.459329+0000","last_change":"2024-09-14T11:08:25.804425+0000","last_active":"2024-09-14T12:58:28.459329+0000","last_peered":"2024-09-14T12:58:28.459329+0000","last_clean":"2024-09-14T12:58:28.459329+0000","last_became_active":"2024-09-14T11:08:25.804100+0000","last_became_peered":"2024-09-14T11:08:25.804100+0000","last_unstale":"2024-09-14T12:58:28.459329+0000","last_undegraded":"2024-09-14T12:58:28.459329+0000","last_fullsized":"2024-09-14T12:58:28.459329+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:08:24.757170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:08:24.757170+0000","last_clean_scrub_stamp":"2024-09-14T11:08:24.757170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:44:03.143728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.17","version":"267'129","reported_seq":705,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:59:38.241474+0000","last_change":"2024-09-14T11:08:27.831807+0000","last_active":"2024-09-14T12:59:38.241474+0000","last_peered":"2024-09-14T12:59:38.241474+0000","last_clean":"2024-09-14T12:59:38.241474+0000","last_became_active":"2024-09-14T11:08:27.831010+0000","last_became_peered":"2024-09-14T11:08:27.831010+0000","last_unstale":"2024-09-14T12:59:38.241474+0000","last_undegraded":"2024-09-14T12:59:38.241474+0000","last_fullsized":"2024-09-14T12:59:38.241474+0000","mapping_epoch":30,"log_start":"267'100","ondisk_log_start":"267'100","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:08:26.771628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:08:26.771628+0000","last_clean_scrub_stamp":"2024-09-14T11:08:26.771628+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":100,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:48:05.929304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":152,"num_read_kb":149,"num_write":100,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":519,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:57:18.209572+0000","last_change":"2024-09-14T11:08:29.810149+0000","last_active":"2024-09-14T12:57:18.209572+0000","last_peered":"2024-09-14T12:57:18.209572+0000","last_clean":"2024-09-14T12:57:18.209572+0000","last_became_active":"2024-09-14T11:08:29.809568+0000","last_became_peered":"2024-09-14T11:08:29.809568+0000","last_unstale":"2024-09-14T12:57:18.209572+0000","last_undegraded":"2024-09-14T12:57:18.209572+0000","last_fullsized":"2024-09-14T12:57:18.209572+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:08:28.783586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:08:28.783586+0000","last_clean_scrub_stamp":"2024-09-14T11:08:28.783586+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:07:09.977514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.1a","version":"267'137","reported_seq":722,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:58:33.237668+0000","last_change":"2024-09-14T11:08:31.846263+0000","last_active":"2024-09-14T12:58:33.237668+0000","last_peered":"2024-09-14T12:58:33.237668+0000","last_clean":"2024-09-14T12:58:33.237668+0000","last_became_active":"2024-09-14T11:08:31.845634+0000","last_became_peered":"2024-09-14T11:08:31.845634+0000","last_unstale":"2024-09-14T12:58:33.237668+0000","last_undegraded":"2024-09-14T12:58:33.237668+0000","last_fullsized":"2024-09-14T12:58:33.237668+0000","mapping_epoch":34,"log_start":"267'100","ondisk_log_start":"267'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:08:30.789404+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:08:30.789404+0000","last_clean_scrub_stamp":"2024-09-14T11:08:30.789404+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":100,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:44:18.672749+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":271,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":347,"num_read_kb":294,"num_write":357,"num_write_kb":85,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"267'409","reported_seq":1927,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:01:39.413241+0000","last_change":"2024-09-14T11:08:23.780617+0000","last_active":"2024-09-14T13:01:39.413241+0000","last_peered":"2024-09-14T13:01:39.413241+0000","last_clean":"2024-09-14T13:01:39.413241+0000","last_became_active":"2024-09-14T11:08:23.780326+0000","last_became_peered":"2024-09-14T11:08:23.780326+0000","last_unstale":"2024-09-14T13:01:39.413241+0000","last_undegraded":"2024-09-14T13:01:39.413241+0000","last_fullsized":"2024-09-14T13:01:39.413241+0000","mapping_epoch":26,"log_start":"267'300","ondisk_log_start":"267'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:08:22.750609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:08:22.750609+0000","last_clean_scrub_stamp":"2024-09-14T11:08:22.750609+0000","objects_scrubbed":0,"log_size":109,"log_dups_size":300,"ondisk_log_size":109,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:31:39.789906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2172,"num_read_kb":2053,"num_write":475,"num_write_kb":100,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.11","version":"267'229","reported_seq":855,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:00.381726+0000","last_change":"2024-09-14T11:08:56.039243+0000","last_active":"2024-09-14T13:02:00.381726+0000","last_peered":"2024-09-14T13:02:00.381726+0000","last_clean":"2024-09-14T13:02:00.381726+0000","last_became_active":"2024-09-14T11:08:56.038815+0000","last_became_peered":"2024-09-14T11:08:56.038815+0000","last_unstale":"2024-09-14T13:02:00.381726+0000","last_undegraded":"2024-09-14T13:02:00.381726+0000","last_fullsized":"2024-09-14T13:02:00.381726+0000","mapping_epoch":37,"log_start":"267'200","ondisk_log_start":"267'200","created":24,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:08:20.733145+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:08:20.733145+0000","last_clean_scrub_stamp":"2024-09-14T11:08:20.733145+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":200,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:21:36.040245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":52,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":508,"num_read_kb":22051,"num_write":996,"num_write_kb":45213,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4,6],"acting":[2,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":526,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:59:38.476225+0000","last_change":"2024-09-14T11:08:25.798412+0000","last_active":"2024-09-14T12:59:38.476225+0000","last_peered":"2024-09-14T12:59:38.476225+0000","last_clean":"2024-09-14T12:59:38.476225+0000","last_became_active":"2024-09-14T11:08:25.798008+0000","last_became_peered":"2024-09-14T11:08:25.798008+0000","last_unstale":"2024-09-14T12:59:38.476225+0000","last_undegraded":"2024-09-14T12:59:38.476225+0000","last_fullsized":"2024-09-14T12:59:38.476225+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:08:24.757170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:08:24.757170+0000","last_clean_scrub_stamp":"2024-09-14T11:08:24.757170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:17:44.680400+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.14","version":"267'180","reported_seq":783,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:00:11.342120+0000","last_change":"2024-09-14T11:08:27.821531+0000","last_active":"2024-09-14T13:00:11.342120+0000","last_peered":"2024-09-14T13:00:11.342120+0000","last_clean":"2024-09-14T13:00:11.342120+0000","last_became_active":"2024-09-14T11:08:27.820627+0000","last_became_peered":"2024-09-14T11:08:27.820627+0000","last_unstale":"2024-09-14T13:00:11.342120+0000","last_undegraded":"2024-09-14T13:00:11.342120+0000","last_fullsized":"2024-09-14T13:00:11.342120+0000","mapping_epoch":30,"log_start":"267'100","ondisk_log_start":"267'100","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:08:26.771628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:08:26.771628+0000","last_clean_scrub_stamp":"2024-09-14T11:08:26.771628+0000","objects_scrubbed":0,"log_size":80,"log_dups_size":100,"ondisk_log_size":80,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:00:26.336465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":232,"num_read_kb":224,"num_write":158,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.15","version":"267'775","reported_seq":3171,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:01:59.859456+0000","last_change":"2024-09-14T11:08:29.838884+0000","last_active":"2024-09-14T13:01:59.859456+0000","last_peered":"2024-09-14T13:01:59.859456+0000","last_clean":"2024-09-14T13:01:59.859456+0000","last_became_active":"2024-09-14T11:08:29.838193+0000","last_became_peered":"2024-09-14T11:08:29.838193+0000","last_unstale":"2024-09-14T13:01:59.859456+0000","last_undegraded":"2024-09-14T13:01:59.859456+0000","last_fullsized":"2024-09-14T13:01:59.859456+0000","mapping_epoch":32,"log_start":"267'701","ondisk_log_start":"267'701","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:08:28.783586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:08:28.783586+0000","last_clean_scrub_stamp":"2024-09-14T11:08:28.783586+0000","objects_scrubbed":0,"log_size":74,"log_dups_size":701,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:51:08.846542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1b","version":"267'210","reported_seq":1068,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:00:21.684009+0000","last_change":"2024-09-14T11:08:31.844271+0000","last_active":"2024-09-14T13:00:21.684009+0000","last_peered":"2024-09-14T13:00:21.684009+0000","last_clean":"2024-09-14T13:00:21.684009+0000","last_became_active":"2024-09-14T11:08:31.843385+0000","last_became_peered":"2024-09-14T11:08:31.843385+0000","last_unstale":"2024-09-14T13:00:21.684009+0000","last_undegraded":"2024-09-14T13:00:21.684009+0000","last_fullsized":"2024-09-14T13:00:21.684009+0000","mapping_epoch":34,"log_start":"267'100","ondisk_log_start":"267'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:08:30.789404+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:08:30.789404+0000","last_clean_scrub_stamp":"2024-09-14T11:08:30.789404+0000","objects_scrubbed":0,"log_size":110,"log_dups_size":100,"ondisk_log_size":110,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:50:52.716773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":642,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":623,"num_read_kb":612,"num_write":468,"num_write_kb":119,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.17","version":"267'420","reported_seq":1909,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:58:42.824128+0000","last_change":"2024-09-14T11:09:57.239996+0000","last_active":"2024-09-14T12:58:42.824128+0000","last_peered":"2024-09-14T12:58:42.824128+0000","last_clean":"2024-09-14T12:58:42.824128+0000","last_became_active":"2024-09-14T11:09:57.239636+0000","last_became_peered":"2024-09-14T11:09:57.239636+0000","last_unstale":"2024-09-14T12:58:42.824128+0000","last_undegraded":"2024-09-14T12:58:42.824128+0000","last_fullsized":"2024-09-14T12:58:42.824128+0000","mapping_epoch":39,"log_start":"267'400","ondisk_log_start":"267'400","created":26,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:08:22.750609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:08:22.750609+0000","last_clean_scrub_stamp":"2024-09-14T11:08:22.750609+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":400,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:53:58.019330+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2202,"num_read_kb":2076,"num_write":491,"num_write_kb":104,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.10","version":"267'249","reported_seq":917,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:00.405746+0000","last_change":"2024-09-14T11:08:21.826810+0000","last_active":"2024-09-14T13:02:00.405746+0000","last_peered":"2024-09-14T13:02:00.405746+0000","last_clean":"2024-09-14T13:02:00.405746+0000","last_became_active":"2024-09-14T11:08:21.817332+0000","last_became_peered":"2024-09-14T11:08:21.817332+0000","last_unstale":"2024-09-14T13:02:00.405746+0000","last_undegraded":"2024-09-14T13:02:00.405746+0000","last_fullsized":"2024-09-14T13:02:00.405746+0000","mapping_epoch":24,"log_start":"267'200","ondisk_log_start":"267'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:08:20.733145+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:08:20.733145+0000","last_clean_scrub_stamp":"2024-09-14T11:08:20.733145+0000","objects_scrubbed":0,"log_size":49,"log_dups_size":200,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:58:18.952310+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":650,"num_read_kb":50041,"num_write":1009,"num_write_kb":23458,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,5],"acting":[6,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":526,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:59:38.056717+0000","last_change":"2024-09-14T11:08:25.815329+0000","last_active":"2024-09-14T12:59:38.056717+0000","last_peered":"2024-09-14T12:59:38.056717+0000","last_clean":"2024-09-14T12:59:38.056717+0000","last_became_active":"2024-09-14T11:08:25.814645+0000","last_became_peered":"2024-09-14T11:08:25.814645+0000","last_unstale":"2024-09-14T12:59:38.056717+0000","last_undegraded":"2024-09-14T12:59:38.056717+0000","last_fullsized":"2024-09-14T12:59:38.056717+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:08:24.757170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:08:24.757170+0000","last_clean_scrub_stamp":"2024-09-14T11:08:24.757170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:04:57.817252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.15","version":"267'179","reported_seq":799,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:00.470671+0000","last_change":"2024-09-14T11:08:27.828686+0000","last_active":"2024-09-14T13:02:00.470671+0000","last_peered":"2024-09-14T13:02:00.470671+0000","last_clean":"2024-09-14T13:02:00.470671+0000","last_became_active":"2024-09-14T11:08:27.827940+0000","last_became_peered":"2024-09-14T11:08:27.827940+0000","last_unstale":"2024-09-14T13:02:00.470671+0000","last_undegraded":"2024-09-14T13:02:00.470671+0000","last_fullsized":"2024-09-14T13:02:00.470671+0000","mapping_epoch":30,"log_start":"267'100","ondisk_log_start":"267'100","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:08:26.771628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:08:26.771628+0000","last_clean_scrub_stamp":"2024-09-14T11:08:26.771628+0000","objects_scrubbed":0,"log_size":79,"log_dups_size":100,"ondisk_log_size":79,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:53:17.553624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6699,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":229,"num_read_kb":300,"num_write":130,"num_write_kb":20,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.14","version":"267'815","reported_seq":2986,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:00.447904+0000","last_change":"2024-09-14T11:08:29.832482+0000","last_active":"2024-09-14T13:02:00.447904+0000","last_peered":"2024-09-14T13:02:00.447904+0000","last_clean":"2024-09-14T13:02:00.447904+0000","last_became_active":"2024-09-14T11:08:29.831198+0000","last_became_peered":"2024-09-14T11:08:29.831198+0000","last_unstale":"2024-09-14T13:02:00.447904+0000","last_undegraded":"2024-09-14T13:02:00.447904+0000","last_fullsized":"2024-09-14T13:02:00.447904+0000","mapping_epoch":32,"log_start":"267'800","ondisk_log_start":"267'800","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:08:28.783586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:08:28.783586+0000","last_clean_scrub_stamp":"2024-09-14T11:08:28.783586+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":800,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:32:21.362746+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.8","version":"267'440","reported_seq":1985,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:59:07.757910+0000","last_change":"2024-09-14T11:08:23.812057+0000","last_active":"2024-09-14T12:59:07.757910+0000","last_peered":"2024-09-14T12:59:07.757910+0000","last_clean":"2024-09-14T12:59:07.757910+0000","last_became_active":"2024-09-14T11:08:23.811325+0000","last_became_peered":"2024-09-14T11:08:23.811325+0000","last_unstale":"2024-09-14T12:59:07.757910+0000","last_undegraded":"2024-09-14T12:59:07.757910+0000","last_fullsized":"2024-09-14T12:59:07.757910+0000","mapping_epoch":26,"log_start":"267'400","ondisk_log_start":"267'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:08:22.750609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:08:22.750609+0000","last_clean_scrub_stamp":"2024-09-14T11:08:22.750609+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":400,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:31:01.004270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2277,"num_read_kb":2143,"num_write":513,"num_write_kb":125,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.f","version":"267'247","reported_seq":931,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:00.415049+0000","last_change":"2024-09-14T11:08:21.846294+0000","last_active":"2024-09-14T13:02:00.415049+0000","last_peered":"2024-09-14T13:02:00.415049+0000","last_clean":"2024-09-14T13:02:00.415049+0000","last_became_active":"2024-09-14T11:08:21.845618+0000","last_became_peered":"2024-09-14T11:08:21.845618+0000","last_unstale":"2024-09-14T13:02:00.415049+0000","last_undegraded":"2024-09-14T13:02:00.415049+0000","last_fullsized":"2024-09-14T13:02:00.415049+0000","mapping_epoch":24,"log_start":"267'200","ondisk_log_start":"267'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:08:20.733145+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:08:20.733145+0000","last_clean_scrub_stamp":"2024-09-14T11:08:20.733145+0000","objects_scrubbed":0,"log_size":47,"log_dups_size":200,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:11:01.806580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":682,"num_read_kb":36009,"num_write":1081,"num_write_kb":30861,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,0],"acting":[7,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":532,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:58:57.837680+0000","last_change":"2024-09-14T11:08:25.807559+0000","last_active":"2024-09-14T12:58:57.837680+0000","last_peered":"2024-09-14T12:58:57.837680+0000","last_clean":"2024-09-14T12:58:57.837680+0000","last_became_active":"2024-09-14T11:08:25.806427+0000","last_became_peered":"2024-09-14T11:08:25.806427+0000","last_unstale":"2024-09-14T12:58:57.837680+0000","last_undegraded":"2024-09-14T12:58:57.837680+0000","last_fullsized":"2024-09-14T12:58:57.837680+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:08:24.757170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:08:24.757170+0000","last_clean_scrub_stamp":"2024-09-14T11:08:24.757170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:32:34.612298+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.a","version":"267'322","reported_seq":1022,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:00.159114+0000","last_change":"2024-09-14T11:08:27.825865+0000","last_active":"2024-09-14T13:02:00.159114+0000","last_peered":"2024-09-14T13:02:00.159114+0000","last_clean":"2024-09-14T13:02:00.159114+0000","last_became_active":"2024-09-14T11:08:27.825133+0000","last_became_peered":"2024-09-14T11:08:27.825133+0000","last_unstale":"2024-09-14T13:02:00.159114+0000","last_undegraded":"2024-09-14T13:02:00.159114+0000","last_fullsized":"2024-09-14T13:02:00.159114+0000","mapping_epoch":30,"log_start":"267'300","ondisk_log_start":"267'300","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:08:26.771628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:08:26.771628+0000","last_clean_scrub_stamp":"2024-09-14T11:08:26.771628+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":300,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:21:39.269871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6555,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":452,"num_read_kb":512,"num_write":278,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":519,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:58:48.462360+0000","last_change":"2024-09-14T11:08:29.816572+0000","last_active":"2024-09-14T12:58:48.462360+0000","last_peered":"2024-09-14T12:58:48.462360+0000","last_clean":"2024-09-14T12:58:48.462360+0000","last_became_active":"2024-09-14T11:08:29.815620+0000","last_became_peered":"2024-09-14T11:08:29.815620+0000","last_unstale":"2024-09-14T12:58:48.462360+0000","last_undegraded":"2024-09-14T12:58:48.462360+0000","last_fullsized":"2024-09-14T12:58:48.462360+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:08:28.783586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:08:28.783586+0000","last_clean_scrub_stamp":"2024-09-14T11:08:28.783586+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:55:41.020963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.4","version":"267'569","reported_seq":1413,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:01:40.627106+0000","last_change":"2024-09-14T11:08:31.844680+0000","last_active":"2024-09-14T13:01:40.627106+0000","last_peered":"2024-09-14T13:01:40.627106+0000","last_clean":"2024-09-14T13:01:40.627106+0000","last_became_active":"2024-09-14T11:08:31.843834+0000","last_became_peered":"2024-09-14T11:08:31.843834+0000","last_unstale":"2024-09-14T13:01:40.627106+0000","last_undegraded":"2024-09-14T13:01:40.627106+0000","last_fullsized":"2024-09-14T13:01:40.627106+0000","mapping_epoch":34,"log_start":"267'500","ondisk_log_start":"267'500","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:08:30.789404+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:08:30.789404+0000","last_clean_scrub_stamp":"2024-09-14T11:08:30.789404+0000","objects_scrubbed":0,"log_size":69,"log_dups_size":500,"ondisk_log_size":69,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:11:32.026053+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1277,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":1293,"num_read_kb":1292,"num_write":1202,"num_write_kb":404,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.9","version":"267'1166","reported_seq":2698,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:58:58.232539+0000","last_change":"2024-09-14T11:08:23.779276+0000","last_active":"2024-09-14T12:58:58.232539+0000","last_peered":"2024-09-14T12:58:58.232539+0000","last_clean":"2024-09-14T12:58:58.232539+0000","last_became_active":"2024-09-14T11:08:23.778539+0000","last_became_peered":"2024-09-14T11:08:23.778539+0000","last_unstale":"2024-09-14T12:58:58.232539+0000","last_undegraded":"2024-09-14T12:58:58.232539+0000","last_fullsized":"2024-09-14T12:58:58.232539+0000","mapping_epoch":26,"log_start":"267'1100","ondisk_log_start":"267'1100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:08:22.750609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:08:22.750609+0000","last_clean_scrub_stamp":"2024-09-14T11:08:22.750609+0000","objects_scrubbed":0,"log_size":66,"log_dups_size":1100,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:37:56.213667+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":5272,"num_read_kb":4639,"num_write":1605,"num_write_kb":663,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"267'241","reported_seq":886,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:00.394758+0000","last_change":"2024-09-14T11:08:21.837563+0000","last_active":"2024-09-14T13:02:00.394758+0000","last_peered":"2024-09-14T13:02:00.394758+0000","last_clean":"2024-09-14T13:02:00.394758+0000","last_became_active":"2024-09-14T11:08:21.836948+0000","last_became_peered":"2024-09-14T11:08:21.836948+0000","last_unstale":"2024-09-14T13:02:00.394758+0000","last_undegraded":"2024-09-14T13:02:00.394758+0000","last_fullsized":"2024-09-14T13:02:00.394758+0000","mapping_epoch":24,"log_start":"267'200","ondisk_log_start":"267'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:08:20.733145+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:08:20.733145+0000","last_clean_scrub_stamp":"2024-09-14T11:08:20.733145+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":200,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:41:03.647233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":550,"num_read_kb":30603,"num_write":1007,"num_write_kb":48772,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,1],"acting":[7,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.8","version":"36'4","reported_seq":1011,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:01:59.388644+0000","last_change":"2024-09-14T11:08:25.787348+0000","last_active":"2024-09-14T13:01:59.388644+0000","last_peered":"2024-09-14T13:01:59.388644+0000","last_clean":"2024-09-14T13:01:59.388644+0000","last_became_active":"2024-09-14T11:08:25.786631+0000","last_became_peered":"2024-09-14T11:08:25.786631+0000","last_unstale":"2024-09-14T13:01:59.388644+0000","last_undegraded":"2024-09-14T13:01:59.388644+0000","last_fullsized":"2024-09-14T13:01:59.388644+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:08:24.757170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:08:24.757170+0000","last_clean_scrub_stamp":"2024-09-14T11:08:24.757170+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:53:18.472903+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1139,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":718,"num_read_kb":1182,"num_write":8,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.b","version":"267'177","reported_seq":799,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:00.345029+0000","last_change":"2024-09-14T11:08:27.822261+0000","last_active":"2024-09-14T13:02:00.345029+0000","last_peered":"2024-09-14T13:02:00.345029+0000","last_clean":"2024-09-14T13:02:00.345029+0000","last_became_active":"2024-09-14T11:08:27.821051+0000","last_became_peered":"2024-09-14T11:08:27.821051+0000","last_unstale":"2024-09-14T13:02:00.345029+0000","last_undegraded":"2024-09-14T13:02:00.345029+0000","last_fullsized":"2024-09-14T13:02:00.345029+0000","mapping_epoch":30,"log_start":"267'100","ondisk_log_start":"267'100","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:08:26.771628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:08:26.771628+0000","last_clean_scrub_stamp":"2024-09-14T11:08:26.771628+0000","objects_scrubbed":0,"log_size":77,"log_dups_size":100,"ondisk_log_size":77,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:27:12.003430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7629,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":234,"num_read_kb":320,"num_write":132,"num_write_kb":26,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":523,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:59:23.472522+0000","last_change":"2024-09-14T11:08:29.836035+0000","last_active":"2024-09-14T12:59:23.472522+0000","last_peered":"2024-09-14T12:59:23.472522+0000","last_clean":"2024-09-14T12:59:23.472522+0000","last_became_active":"2024-09-14T11:08:29.835446+0000","last_became_peered":"2024-09-14T11:08:29.835446+0000","last_unstale":"2024-09-14T12:59:23.472522+0000","last_undegraded":"2024-09-14T12:59:23.472522+0000","last_fullsized":"2024-09-14T12:59:23.472522+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:08:28.783586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:08:28.783586+0000","last_clean_scrub_stamp":"2024-09-14T11:08:28.783586+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:36:19.782325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.5","version":"267'2490","reported_seq":4358,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:01:27.935148+0000","last_change":"2024-09-14T11:08:31.849687+0000","last_active":"2024-09-14T13:01:27.935148+0000","last_peered":"2024-09-14T13:01:27.935148+0000","last_clean":"2024-09-14T13:01:27.935148+0000","last_became_active":"2024-09-14T11:08:31.848959+0000","last_became_peered":"2024-09-14T11:08:31.848959+0000","last_unstale":"2024-09-14T13:01:27.935148+0000","last_undegraded":"2024-09-14T13:01:27.935148+0000","last_fullsized":"2024-09-14T13:01:27.935148+0000","mapping_epoch":34,"log_start":"267'2400","ondisk_log_start":"267'2400","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:08:30.789404+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:08:30.789404+0000","last_clean_scrub_stamp":"2024-09-14T11:08:30.789404+0000","objects_scrubbed":0,"log_size":90,"log_dups_size":2400,"ondisk_log_size":90,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:50:52.716773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":423,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":6223,"num_read_kb":6216,"num_write":5015,"num_write_kb":1852,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.a","version":"267'866","reported_seq":2677,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:01:39.416327+0000","last_change":"2024-09-14T11:08:23.812059+0000","last_active":"2024-09-14T13:01:39.416327+0000","last_peered":"2024-09-14T13:01:39.416327+0000","last_clean":"2024-09-14T13:01:39.416327+0000","last_became_active":"2024-09-14T11:08:23.811255+0000","last_became_peered":"2024-09-14T11:08:23.811255+0000","last_unstale":"2024-09-14T13:01:39.416327+0000","last_undegraded":"2024-09-14T13:01:39.416327+0000","last_fullsized":"2024-09-14T13:01:39.416327+0000","mapping_epoch":26,"log_start":"267'800","ondisk_log_start":"267'800","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:08:22.750609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:08:22.750609+0000","last_clean_scrub_stamp":"2024-09-14T11:08:22.750609+0000","objects_scrubbed":0,"log_size":66,"log_dups_size":800,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:59:11.000027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":4399,"num_read_kb":3998,"num_write":1156,"num_write_kb":415,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"267'213","reported_seq":885,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:00.399352+0000","last_change":"2024-09-14T11:08:21.805672+0000","last_active":"2024-09-14T13:02:00.399352+0000","last_peered":"2024-09-14T13:02:00.399352+0000","last_clean":"2024-09-14T13:02:00.399352+0000","last_became_active":"2024-09-14T11:08:21.804566+0000","last_became_peered":"2024-09-14T11:08:21.804566+0000","last_unstale":"2024-09-14T13:02:00.399352+0000","last_undegraded":"2024-09-14T13:02:00.399352+0000","last_fullsized":"2024-09-14T13:02:00.399352+0000","mapping_epoch":24,"log_start":"267'200","ondisk_log_start":"267'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:08:20.733145+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:08:20.733145+0000","last_clean_scrub_stamp":"2024-09-14T11:08:20.733145+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":200,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:32:47.003209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3311695,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":558,"num_read_kb":39823,"num_write":955,"num_write_kb":36124,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,3],"acting":[7,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":533,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:58:42.823897+0000","last_change":"2024-09-14T11:08:25.789785+0000","last_active":"2024-09-14T12:58:42.823897+0000","last_peered":"2024-09-14T12:58:42.823897+0000","last_clean":"2024-09-14T12:58:42.823897+0000","last_became_active":"2024-09-14T11:08:25.789075+0000","last_became_peered":"2024-09-14T11:08:25.789075+0000","last_unstale":"2024-09-14T12:58:42.823897+0000","last_undegraded":"2024-09-14T12:58:42.823897+0000","last_fullsized":"2024-09-14T12:58:42.823897+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:08:24.757170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:08:24.757170+0000","last_clean_scrub_stamp":"2024-09-14T11:08:24.757170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:02:16.864399+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.8","version":"267'233","reported_seq":894,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:00.183952+0000","last_change":"2024-09-14T11:08:27.831643+0000","last_active":"2024-09-14T13:02:00.183952+0000","last_peered":"2024-09-14T13:02:00.183952+0000","last_clean":"2024-09-14T13:02:00.183952+0000","last_became_active":"2024-09-14T11:08:27.830862+0000","last_became_peered":"2024-09-14T11:08:27.830862+0000","last_unstale":"2024-09-14T13:02:00.183952+0000","last_undegraded":"2024-09-14T13:02:00.183952+0000","last_fullsized":"2024-09-14T13:02:00.183952+0000","mapping_epoch":30,"log_start":"267'200","ondisk_log_start":"267'200","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:08:26.771628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:08:26.771628+0000","last_clean_scrub_stamp":"2024-09-14T11:08:26.771628+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":200,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:28:29.317319+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4096,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":320,"num_read_kb":327,"num_write":186,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.9","version":"267'785","reported_seq":3473,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:01:59.875618+0000","last_change":"2024-09-14T11:08:29.822652+0000","last_active":"2024-09-14T13:01:59.875618+0000","last_peered":"2024-09-14T13:01:59.875618+0000","last_clean":"2024-09-14T13:01:59.875618+0000","last_became_active":"2024-09-14T11:08:29.821920+0000","last_became_peered":"2024-09-14T11:08:29.821920+0000","last_unstale":"2024-09-14T13:01:59.875618+0000","last_undegraded":"2024-09-14T13:01:59.875618+0000","last_fullsized":"2024-09-14T13:01:59.875618+0000","mapping_epoch":32,"log_start":"267'700","ondisk_log_start":"267'700","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:08:28.783586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:08:28.783586+0000","last_clean_scrub_stamp":"2024-09-14T11:08:28.783586+0000","objects_scrubbed":0,"log_size":85,"log_dups_size":700,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:48:48.100097+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.6","version":"267'126","reported_seq":663,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:01:39.376250+0000","last_change":"2024-09-14T11:08:31.848848+0000","last_active":"2024-09-14T13:01:39.376250+0000","last_peered":"2024-09-14T13:01:39.376250+0000","last_clean":"2024-09-14T13:01:39.376250+0000","last_became_active":"2024-09-14T11:08:31.846373+0000","last_became_peered":"2024-09-14T11:08:31.846373+0000","last_unstale":"2024-09-14T13:01:39.376250+0000","last_undegraded":"2024-09-14T13:01:39.376250+0000","last_fullsized":"2024-09-14T13:01:39.376250+0000","mapping_epoch":34,"log_start":"267'100","ondisk_log_start":"267'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:08:30.789404+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:08:30.789404+0000","last_clean_scrub_stamp":"2024-09-14T11:08:30.789404+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":100,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:47:54.026151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":575,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":123,"num_write":296,"num_write_kb":71,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"267'1040","reported_seq":2676,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:58:43.240136+0000","last_change":"2024-09-14T11:08:23.777370+0000","last_active":"2024-09-14T12:58:43.240136+0000","last_peered":"2024-09-14T12:58:43.240136+0000","last_clean":"2024-09-14T12:58:43.240136+0000","last_became_active":"2024-09-14T11:08:23.777032+0000","last_became_peered":"2024-09-14T11:08:23.777032+0000","last_unstale":"2024-09-14T12:58:43.240136+0000","last_undegraded":"2024-09-14T12:58:43.240136+0000","last_fullsized":"2024-09-14T12:58:43.240136+0000","mapping_epoch":26,"log_start":"267'1000","ondisk_log_start":"267'1000","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:08:22.750609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:08:22.750609+0000","last_clean_scrub_stamp":"2024-09-14T11:08:22.750609+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":1000,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:49:19.371576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":7372,"num_read_kb":6755,"num_write":1704,"num_write_kb":754,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.c","version":"267'187","reported_seq":827,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:00.451148+0000","last_change":"2024-09-14T11:08:21.828750+0000","last_active":"2024-09-14T13:02:00.451148+0000","last_peered":"2024-09-14T13:02:00.451148+0000","last_clean":"2024-09-14T13:02:00.451148+0000","last_became_active":"2024-09-14T11:08:21.828010+0000","last_became_peered":"2024-09-14T11:08:21.828010+0000","last_unstale":"2024-09-14T13:02:00.451148+0000","last_undegraded":"2024-09-14T13:02:00.451148+0000","last_fullsized":"2024-09-14T13:02:00.451148+0000","mapping_epoch":24,"log_start":"267'100","ondisk_log_start":"267'100","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:08:20.733145+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:08:20.733145+0000","last_clean_scrub_stamp":"2024-09-14T11:08:20.733145+0000","objects_scrubbed":0,"log_size":87,"log_dups_size":100,"ondisk_log_size":87,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:37:57.066174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":29,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":466,"num_read_kb":18086,"num_write":819,"num_write_kb":39275,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,6],"acting":[5,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":535,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:59:32.834776+0000","last_change":"2024-09-14T11:08:25.805942+0000","last_active":"2024-09-14T12:59:32.834776+0000","last_peered":"2024-09-14T12:59:32.834776+0000","last_clean":"2024-09-14T12:59:32.834776+0000","last_became_active":"2024-09-14T11:08:25.805415+0000","last_became_peered":"2024-09-14T11:08:25.805415+0000","last_unstale":"2024-09-14T12:59:32.834776+0000","last_undegraded":"2024-09-14T12:59:32.834776+0000","last_fullsized":"2024-09-14T12:59:32.834776+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:08:24.757170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:08:24.757170+0000","last_clean_scrub_stamp":"2024-09-14T11:08:24.757170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:04:41.418486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"267'248","reported_seq":938,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:00.375155+0000","last_change":"2024-09-14T11:08:27.812358+0000","last_active":"2024-09-14T13:02:00.375155+0000","last_peered":"2024-09-14T13:02:00.375155+0000","last_clean":"2024-09-14T13:02:00.375155+0000","last_became_active":"2024-09-14T11:08:27.811687+0000","last_became_peered":"2024-09-14T11:08:27.811687+0000","last_unstale":"2024-09-14T13:02:00.375155+0000","last_undegraded":"2024-09-14T13:02:00.375155+0000","last_fullsized":"2024-09-14T13:02:00.375155+0000","mapping_epoch":30,"log_start":"267'200","ondisk_log_start":"267'200","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:08:26.771628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:08:26.771628+0000","last_clean_scrub_stamp":"2024-09-14T11:08:26.771628+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":200,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:53:33.661450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":25927,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":349,"num_read_kb":508,"num_write":186,"num_write_kb":50,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":527,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:59:02.829095+0000","last_change":"2024-09-14T11:08:29.822875+0000","last_active":"2024-09-14T12:59:02.829095+0000","last_peered":"2024-09-14T12:59:02.829095+0000","last_clean":"2024-09-14T12:59:02.829095+0000","last_became_active":"2024-09-14T11:08:29.821747+0000","last_became_peered":"2024-09-14T11:08:29.821747+0000","last_unstale":"2024-09-14T12:59:02.829095+0000","last_undegraded":"2024-09-14T12:59:02.829095+0000","last_fullsized":"2024-09-14T12:59:02.829095+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:08:28.783586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:08:28.783586+0000","last_clean_scrub_stamp":"2024-09-14T11:08:28.783586+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:24:23.302821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.7","version":"267'148","reported_seq":694,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:00:15.969897+0000","last_change":"2024-09-14T11:08:31.839098+0000","last_active":"2024-09-14T13:00:15.969897+0000","last_peered":"2024-09-14T13:00:15.969897+0000","last_clean":"2024-09-14T13:00:15.969897+0000","last_became_active":"2024-09-14T11:08:31.838392+0000","last_became_peered":"2024-09-14T11:08:31.838392+0000","last_unstale":"2024-09-14T13:00:15.969897+0000","last_undegraded":"2024-09-14T13:00:15.969897+0000","last_fullsized":"2024-09-14T13:00:15.969897+0000","mapping_epoch":34,"log_start":"267'100","ondisk_log_start":"267'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:08:30.789404+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:08:30.789404+0000","last_clean_scrub_stamp":"2024-09-14T11:08:30.789404+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":100,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:19:04.951364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":722,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":177,"num_read_kb":165,"num_write":335,"num_write_kb":82,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"267'557","reported_seq":2159,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:59:14.732479+0000","last_change":"2024-09-14T11:08:23.789049+0000","last_active":"2024-09-14T12:59:14.732479+0000","last_peered":"2024-09-14T12:59:14.732479+0000","last_clean":"2024-09-14T12:59:14.732479+0000","last_became_active":"2024-09-14T11:08:23.788219+0000","last_became_peered":"2024-09-14T11:08:23.788219+0000","last_unstale":"2024-09-14T12:59:14.732479+0000","last_undegraded":"2024-09-14T12:59:14.732479+0000","last_fullsized":"2024-09-14T12:59:14.732479+0000","mapping_epoch":26,"log_start":"267'500","ondisk_log_start":"267'500","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:08:22.750609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:08:22.750609+0000","last_clean_scrub_stamp":"2024-09-14T11:08:22.750609+0000","objects_scrubbed":0,"log_size":57,"log_dups_size":500,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:01:08.503596+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2903,"num_read_kb":2651,"num_write":738,"num_write_kb":289,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"267'322","reported_seq":1069,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:00.441780+0000","last_change":"2024-09-14T11:08:21.827864+0000","last_active":"2024-09-14T13:02:00.441780+0000","last_peered":"2024-09-14T13:02:00.441780+0000","last_clean":"2024-09-14T13:02:00.441780+0000","last_became_active":"2024-09-14T11:08:21.827553+0000","last_became_peered":"2024-09-14T11:08:21.827553+0000","last_unstale":"2024-09-14T13:02:00.441780+0000","last_undegraded":"2024-09-14T13:02:00.441780+0000","last_fullsized":"2024-09-14T13:02:00.441780+0000","mapping_epoch":24,"log_start":"267'300","ondisk_log_start":"267'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:08:20.733145+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:08:20.733145+0000","last_clean_scrub_stamp":"2024-09-14T11:08:20.733145+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":300,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:57:45.527676+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1003,"num_read_kb":39840,"num_write":1278,"num_write_kb":27597,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,4],"acting":[3,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":533,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:58:42.823983+0000","last_change":"2024-09-14T11:08:25.799438+0000","last_active":"2024-09-14T12:58:42.823983+0000","last_peered":"2024-09-14T12:58:42.823983+0000","last_clean":"2024-09-14T12:58:42.823983+0000","last_became_active":"2024-09-14T11:08:25.798931+0000","last_became_peered":"2024-09-14T11:08:25.798931+0000","last_unstale":"2024-09-14T12:58:42.823983+0000","last_undegraded":"2024-09-14T12:58:42.823983+0000","last_fullsized":"2024-09-14T12:58:42.823983+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:08:24.757170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:08:24.757170+0000","last_clean_scrub_stamp":"2024-09-14T11:08:24.757170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:52:24.718713+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.e","version":"267'204","reported_seq":840,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:00.387859+0000","last_change":"2024-09-14T11:08:27.818990+0000","last_active":"2024-09-14T13:02:00.387859+0000","last_peered":"2024-09-14T13:02:00.387859+0000","last_clean":"2024-09-14T13:02:00.387859+0000","last_became_active":"2024-09-14T11:08:27.818219+0000","last_became_peered":"2024-09-14T11:08:27.818219+0000","last_unstale":"2024-09-14T13:02:00.387859+0000","last_undegraded":"2024-09-14T13:02:00.387859+0000","last_fullsized":"2024-09-14T13:02:00.387859+0000","mapping_epoch":30,"log_start":"264'100","ondisk_log_start":"264'100","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:08:26.771628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:08:26.771628+0000","last_clean_scrub_stamp":"2024-09-14T11:08:26.771628+0000","objects_scrubbed":0,"log_size":104,"log_dups_size":100,"ondisk_log_size":104,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:11:59.445867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6420,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":294,"num_read_kb":320,"num_write":220,"num_write_kb":86,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":526,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:59:13.248309+0000","last_change":"2024-09-14T11:08:29.824808+0000","last_active":"2024-09-14T12:59:13.248309+0000","last_peered":"2024-09-14T12:59:13.248309+0000","last_clean":"2024-09-14T12:59:13.248309+0000","last_became_active":"2024-09-14T11:08:29.824057+0000","last_became_peered":"2024-09-14T11:08:29.824057+0000","last_unstale":"2024-09-14T12:59:13.248309+0000","last_undegraded":"2024-09-14T12:59:13.248309+0000","last_fullsized":"2024-09-14T12:59:13.248309+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:08:28.783586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:08:28.783586+0000","last_clean_scrub_stamp":"2024-09-14T11:08:28.783586+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:42:11.422635+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.0","version":"267'127","reported_seq":651,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:00:53.493597+0000","last_change":"2024-09-14T11:08:31.845590+0000","last_active":"2024-09-14T13:00:53.493597+0000","last_peered":"2024-09-14T13:00:53.493597+0000","last_clean":"2024-09-14T13:00:53.493597+0000","last_became_active":"2024-09-14T11:08:31.844832+0000","last_became_peered":"2024-09-14T11:08:31.844832+0000","last_unstale":"2024-09-14T13:00:53.493597+0000","last_undegraded":"2024-09-14T13:00:53.493597+0000","last_fullsized":"2024-09-14T13:00:53.493597+0000","mapping_epoch":34,"log_start":"267'100","ondisk_log_start":"267'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:08:30.789404+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:08:30.789404+0000","last_clean_scrub_stamp":"2024-09-14T11:08:30.789404+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":100,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:04:19.552267+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":910,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":99,"num_read_kb":98,"num_write":310,"num_write_kb":70,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"267'807","reported_seq":2439,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:59:14.732420+0000","last_change":"2024-09-14T11:08:23.794254+0000","last_active":"2024-09-14T12:59:14.732420+0000","last_peered":"2024-09-14T12:59:14.732420+0000","last_clean":"2024-09-14T12:59:14.732420+0000","last_became_active":"2024-09-14T11:08:23.791966+0000","last_became_peered":"2024-09-14T11:08:23.791966+0000","last_unstale":"2024-09-14T12:59:14.732420+0000","last_undegraded":"2024-09-14T12:59:14.732420+0000","last_fullsized":"2024-09-14T12:59:14.732420+0000","mapping_epoch":26,"log_start":"267'700","ondisk_log_start":"267'700","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:08:22.750609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:08:22.750609+0000","last_clean_scrub_stamp":"2024-09-14T11:08:22.750609+0000","objects_scrubbed":0,"log_size":107,"log_dups_size":700,"ondisk_log_size":107,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:23:14.308345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3905,"num_read_kb":3535,"num_write":1083,"num_write_kb":396,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"267'233","reported_seq":908,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:00.330887+0000","last_change":"2024-09-14T11:08:21.836998+0000","last_active":"2024-09-14T13:02:00.330887+0000","last_peered":"2024-09-14T13:02:00.330887+0000","last_clean":"2024-09-14T13:02:00.330887+0000","last_became_active":"2024-09-14T11:08:21.836346+0000","last_became_peered":"2024-09-14T11:08:21.836346+0000","last_unstale":"2024-09-14T13:02:00.330887+0000","last_undegraded":"2024-09-14T13:02:00.330887+0000","last_fullsized":"2024-09-14T13:02:00.330887+0000","mapping_epoch":24,"log_start":"267'200","ondisk_log_start":"267'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:08:20.733145+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:08:20.733145+0000","last_clean_scrub_stamp":"2024-09-14T11:08:20.733145+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":200,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:01:21.741877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2055072,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":607,"num_read_kb":23439,"num_write":1082,"num_write_kb":33198,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,1],"acting":[6,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":527,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:58:43.461228+0000","last_change":"2024-09-14T11:08:25.807312+0000","last_active":"2024-09-14T12:58:43.461228+0000","last_peered":"2024-09-14T12:58:43.461228+0000","last_clean":"2024-09-14T12:58:43.461228+0000","last_became_active":"2024-09-14T11:08:25.806502+0000","last_became_peered":"2024-09-14T11:08:25.806502+0000","last_unstale":"2024-09-14T12:58:43.461228+0000","last_undegraded":"2024-09-14T12:58:43.461228+0000","last_fullsized":"2024-09-14T12:58:43.461228+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:08:24.757170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:08:24.757170+0000","last_clean_scrub_stamp":"2024-09-14T11:08:24.757170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:32:51.027233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.f","version":"267'240","reported_seq":902,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:00.312298+0000","last_change":"2024-09-14T11:08:27.819376+0000","last_active":"2024-09-14T13:02:00.312298+0000","last_peered":"2024-09-14T13:02:00.312298+0000","last_clean":"2024-09-14T13:02:00.312298+0000","last_became_active":"2024-09-14T11:08:27.817904+0000","last_became_peered":"2024-09-14T11:08:27.817904+0000","last_unstale":"2024-09-14T13:02:00.312298+0000","last_undegraded":"2024-09-14T13:02:00.312298+0000","last_fullsized":"2024-09-14T13:02:00.312298+0000","mapping_epoch":30,"log_start":"267'200","ondisk_log_start":"267'200","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:08:26.771628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:08:26.771628+0000","last_clean_scrub_stamp":"2024-09-14T11:08:26.771628+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":200,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:38:45.116571+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8985,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":331,"num_read_kb":393,"num_write":194,"num_write_kb":21,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.e","version":"267'763","reported_seq":3235,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:01:59.863086+0000","last_change":"2024-09-14T11:08:29.818281+0000","last_active":"2024-09-14T13:01:59.863086+0000","last_peered":"2024-09-14T13:01:59.863086+0000","last_clean":"2024-09-14T13:01:59.863086+0000","last_became_active":"2024-09-14T11:08:29.817475+0000","last_became_peered":"2024-09-14T11:08:29.817475+0000","last_unstale":"2024-09-14T13:01:59.863086+0000","last_undegraded":"2024-09-14T13:01:59.863086+0000","last_fullsized":"2024-09-14T13:01:59.863086+0000","mapping_epoch":32,"log_start":"267'700","ondisk_log_start":"267'700","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:08:28.783586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:08:28.783586+0000","last_clean_scrub_stamp":"2024-09-14T11:08:28.783586+0000","objects_scrubbed":0,"log_size":63,"log_dups_size":700,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:02:09.839019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1","version":"267'130","reported_seq":668,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:00:15.977882+0000","last_change":"2024-09-14T11:08:31.848332+0000","last_active":"2024-09-14T13:00:15.977882+0000","last_peered":"2024-09-14T13:00:15.977882+0000","last_clean":"2024-09-14T13:00:15.977882+0000","last_became_active":"2024-09-14T11:08:31.847603+0000","last_became_peered":"2024-09-14T11:08:31.847603+0000","last_unstale":"2024-09-14T13:00:15.977882+0000","last_undegraded":"2024-09-14T13:00:15.977882+0000","last_fullsized":"2024-09-14T13:00:15.977882+0000","mapping_epoch":34,"log_start":"267'100","ondisk_log_start":"267'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:08:30.789404+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:08:30.789404+0000","last_clean_scrub_stamp":"2024-09-14T11:08:30.789404+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":100,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:48:10.041330+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1261,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":168,"num_read_kb":154,"num_write":334,"num_write_kb":78,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"267'385","reported_seq":1931,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:00:18.881431+0000","last_change":"2024-09-14T11:08:23.815282+0000","last_active":"2024-09-14T13:00:18.881431+0000","last_peered":"2024-09-14T13:00:18.881431+0000","last_clean":"2024-09-14T13:00:18.881431+0000","last_became_active":"2024-09-14T11:08:23.814578+0000","last_became_peered":"2024-09-14T11:08:23.814578+0000","last_unstale":"2024-09-14T13:00:18.881431+0000","last_undegraded":"2024-09-14T13:00:18.881431+0000","last_fullsized":"2024-09-14T13:00:18.881431+0000","mapping_epoch":26,"log_start":"267'300","ondisk_log_start":"267'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:08:22.750609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:08:22.750609+0000","last_clean_scrub_stamp":"2024-09-14T11:08:22.750609+0000","objects_scrubbed":0,"log_size":85,"log_dups_size":300,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:17:18.348356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2178,"num_read_kb":2072,"num_write":449,"num_write_kb":92,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.9","version":"267'206","reported_seq":862,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:00.296396+0000","last_change":"2024-09-14T11:08:21.831392+0000","last_active":"2024-09-14T13:02:00.296396+0000","last_peered":"2024-09-14T13:02:00.296396+0000","last_clean":"2024-09-14T13:02:00.296396+0000","last_became_active":"2024-09-14T11:08:21.824109+0000","last_became_peered":"2024-09-14T11:08:21.824109+0000","last_unstale":"2024-09-14T13:02:00.296396+0000","last_undegraded":"2024-09-14T13:02:00.296396+0000","last_fullsized":"2024-09-14T13:02:00.296396+0000","mapping_epoch":24,"log_start":"267'100","ondisk_log_start":"267'100","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:08:20.733145+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:08:20.733145+0000","last_clean_scrub_stamp":"2024-09-14T11:08:20.733145+0000","objects_scrubbed":0,"log_size":106,"log_dups_size":100,"ondisk_log_size":106,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:40:02.893514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1655851,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":552,"num_read_kb":13686,"num_write":959,"num_write_kb":41004,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,7],"acting":[4,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.f","version":"29'2","reported_seq":1477,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:01:59.403010+0000","last_change":"2024-09-14T11:08:25.815830+0000","last_active":"2024-09-14T13:01:59.403010+0000","last_peered":"2024-09-14T13:01:59.403010+0000","last_clean":"2024-09-14T13:01:59.403010+0000","last_became_active":"2024-09-14T11:08:25.815109+0000","last_became_peered":"2024-09-14T11:08:25.815109+0000","last_unstale":"2024-09-14T13:01:59.403010+0000","last_undegraded":"2024-09-14T13:01:59.403010+0000","last_fullsized":"2024-09-14T13:01:59.403010+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:08:24.757170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:08:24.757170+0000","last_clean_scrub_stamp":"2024-09-14T11:08:24.757170+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:31:30.285811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":946,"num_read_kb":946,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.c","version":"267'152","reported_seq":738,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:59:07.715136+0000","last_change":"2024-09-14T11:08:27.799995+0000","last_active":"2024-09-14T12:59:07.715136+0000","last_peered":"2024-09-14T12:59:07.715136+0000","last_clean":"2024-09-14T12:59:07.715136+0000","last_became_active":"2024-09-14T11:08:27.799244+0000","last_became_peered":"2024-09-14T11:08:27.799244+0000","last_unstale":"2024-09-14T12:59:07.715136+0000","last_undegraded":"2024-09-14T12:59:07.715136+0000","last_fullsized":"2024-09-14T12:59:07.715136+0000","mapping_epoch":30,"log_start":"267'100","ondisk_log_start":"267'100","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:08:26.771628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:08:26.771628+0000","last_clean_scrub_stamp":"2024-09-14T11:08:26.771628+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":100,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:30:47.475696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":184,"num_read_kb":178,"num_write":124,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.d","version":"267'769","reported_seq":3164,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:01:59.865013+0000","last_change":"2024-09-14T11:08:29.829055+0000","last_active":"2024-09-14T13:01:59.865013+0000","last_peered":"2024-09-14T13:01:59.865013+0000","last_clean":"2024-09-14T13:01:59.865013+0000","last_became_active":"2024-09-14T11:08:29.828249+0000","last_became_peered":"2024-09-14T11:08:29.828249+0000","last_unstale":"2024-09-14T13:01:59.865013+0000","last_undegraded":"2024-09-14T13:01:59.865013+0000","last_fullsized":"2024-09-14T13:01:59.865013+0000","mapping_epoch":32,"log_start":"267'701","ondisk_log_start":"267'701","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:08:28.783586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:08:28.783586+0000","last_clean_scrub_stamp":"2024-09-14T11:08:28.783586+0000","objects_scrubbed":0,"log_size":68,"log_dups_size":701,"ondisk_log_size":68,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:02:41.662311+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.2","version":"267'160","reported_seq":694,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:58:58.232642+0000","last_change":"2024-09-14T11:08:31.850208+0000","last_active":"2024-09-14T12:58:58.232642+0000","last_peered":"2024-09-14T12:58:58.232642+0000","last_clean":"2024-09-14T12:58:58.232642+0000","last_became_active":"2024-09-14T11:08:31.849463+0000","last_became_peered":"2024-09-14T11:08:31.849463+0000","last_unstale":"2024-09-14T12:58:58.232642+0000","last_undegraded":"2024-09-14T12:58:58.232642+0000","last_fullsized":"2024-09-14T12:58:58.232642+0000","mapping_epoch":34,"log_start":"267'100","ondisk_log_start":"267'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:08:30.789404+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:08:30.789404+0000","last_clean_scrub_stamp":"2024-09-14T11:08:30.789404+0000","objects_scrubbed":0,"log_size":60,"log_dups_size":100,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:42:03.964124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":154,"num_read_kb":144,"num_write":375,"num_write_kb":85,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"267'382","reported_seq":1872,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:00:21.259274+0000","last_change":"2024-09-14T11:08:23.783772+0000","last_active":"2024-09-14T13:00:21.259274+0000","last_peered":"2024-09-14T13:00:21.259274+0000","last_clean":"2024-09-14T13:00:21.259274+0000","last_became_active":"2024-09-14T11:08:23.783481+0000","last_became_peered":"2024-09-14T11:08:23.783481+0000","last_unstale":"2024-09-14T13:00:21.259274+0000","last_undegraded":"2024-09-14T13:00:21.259274+0000","last_fullsized":"2024-09-14T13:00:21.259274+0000","mapping_epoch":26,"log_start":"267'300","ondisk_log_start":"267'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:08:22.750609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:08:22.750609+0000","last_clean_scrub_stamp":"2024-09-14T11:08:22.750609+0000","objects_scrubbed":0,"log_size":82,"log_dups_size":300,"ondisk_log_size":82,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:20:59.558430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":2050,"num_read_kb":1948,"num_write":423,"num_write_kb":74,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"267'177","reported_seq":830,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:01:59.990205+0000","last_change":"2024-09-14T11:08:21.787051+0000","last_active":"2024-09-14T13:01:59.990205+0000","last_peered":"2024-09-14T13:01:59.990205+0000","last_clean":"2024-09-14T13:01:59.990205+0000","last_became_active":"2024-09-14T11:08:21.786611+0000","last_became_peered":"2024-09-14T11:08:21.786611+0000","last_unstale":"2024-09-14T13:01:59.990205+0000","last_undegraded":"2024-09-14T13:01:59.990205+0000","last_fullsized":"2024-09-14T13:01:59.990205+0000","mapping_epoch":24,"log_start":"267'100","ondisk_log_start":"267'100","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:08:20.733145+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:08:20.733145+0000","last_clean_scrub_stamp":"2024-09-14T11:08:20.733145+0000","objects_scrubbed":0,"log_size":77,"log_dups_size":100,"ondisk_log_size":77,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:20:16.450782+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1655868,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":450,"num_read_kb":66993,"num_write":850,"num_write_kb":21210,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7],"acting":[3,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":531,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:58:43.229298+0000","last_change":"2024-09-14T11:08:25.818495+0000","last_active":"2024-09-14T12:58:43.229298+0000","last_peered":"2024-09-14T12:58:43.229298+0000","last_clean":"2024-09-14T12:58:43.229298+0000","last_became_active":"2024-09-14T11:08:25.817491+0000","last_became_peered":"2024-09-14T11:08:25.817491+0000","last_unstale":"2024-09-14T12:58:43.229298+0000","last_undegraded":"2024-09-14T12:58:43.229298+0000","last_fullsized":"2024-09-14T12:58:43.229298+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:08:24.757170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:08:24.757170+0000","last_clean_scrub_stamp":"2024-09-14T11:08:24.757170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:04:21.111837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.d","version":"267'295","reported_seq":981,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:00.116891+0000","last_change":"2024-09-14T11:08:27.829834+0000","last_active":"2024-09-14T13:02:00.116891+0000","last_peered":"2024-09-14T13:02:00.116891+0000","last_clean":"2024-09-14T13:02:00.116891+0000","last_became_active":"2024-09-14T11:08:27.829060+0000","last_became_peered":"2024-09-14T11:08:27.829060+0000","last_unstale":"2024-09-14T13:02:00.116891+0000","last_undegraded":"2024-09-14T13:02:00.116891+0000","last_fullsized":"2024-09-14T13:02:00.116891+0000","mapping_epoch":30,"log_start":"267'200","ondisk_log_start":"267'200","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:08:26.771628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:08:26.771628+0000","last_clean_scrub_stamp":"2024-09-14T11:08:26.771628+0000","objects_scrubbed":0,"log_size":95,"log_dups_size":200,"ondisk_log_size":95,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:11:07.685536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5925,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":413,"num_read_kb":450,"num_write":250,"num_write_kb":21,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":520,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:58:48.427540+0000","last_change":"2024-09-14T11:08:29.845124+0000","last_active":"2024-09-14T12:58:48.427540+0000","last_peered":"2024-09-14T12:58:48.427540+0000","last_clean":"2024-09-14T12:58:48.427540+0000","last_became_active":"2024-09-14T11:08:29.844374+0000","last_became_peered":"2024-09-14T11:08:29.844374+0000","last_unstale":"2024-09-14T12:58:48.427540+0000","last_undegraded":"2024-09-14T12:58:48.427540+0000","last_fullsized":"2024-09-14T12:58:48.427540+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:08:28.783586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:08:28.783586+0000","last_clean_scrub_stamp":"2024-09-14T11:08:28.783586+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:58:42.113010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.3","version":"267'105","reported_seq":628,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:00:21.230827+0000","last_change":"2024-09-14T11:08:31.836429+0000","last_active":"2024-09-14T13:00:21.230827+0000","last_peered":"2024-09-14T13:00:21.230827+0000","last_clean":"2024-09-14T13:00:21.230827+0000","last_became_active":"2024-09-14T11:08:31.835753+0000","last_became_peered":"2024-09-14T11:08:31.835753+0000","last_unstale":"2024-09-14T13:00:21.230827+0000","last_undegraded":"2024-09-14T13:00:21.230827+0000","last_fullsized":"2024-09-14T13:00:21.230827+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:08:30.789404+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:08:30.789404+0000","last_clean_scrub_stamp":"2024-09-14T11:08:30.789404+0000","objects_scrubbed":0,"log_size":105,"log_dups_size":0,"ondisk_log_size":105,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:10:45.802301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":24,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":102,"num_read_kb":102,"num_write":245,"num_write_kb":60,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"267'865","reported_seq":2543,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:59:13.433148+0000","last_change":"2024-09-14T11:08:23.807298+0000","last_active":"2024-09-14T12:59:13.433148+0000","last_peered":"2024-09-14T12:59:13.433148+0000","last_clean":"2024-09-14T12:59:13.433148+0000","last_became_active":"2024-09-14T11:08:23.806515+0000","last_became_peered":"2024-09-14T11:08:23.806515+0000","last_unstale":"2024-09-14T12:59:13.433148+0000","last_undegraded":"2024-09-14T12:59:13.433148+0000","last_fullsized":"2024-09-14T12:59:13.433148+0000","mapping_epoch":26,"log_start":"267'800","ondisk_log_start":"267'800","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:08:22.750609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:08:22.750609+0000","last_clean_scrub_stamp":"2024-09-14T11:08:22.750609+0000","objects_scrubbed":0,"log_size":65,"log_dups_size":800,"ondisk_log_size":65,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:53:43.658780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":4146,"num_read_kb":3734,"num_write":1154,"num_write_kb":420,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"15'72","reported_seq":654,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:58:42.834156+0000","last_change":"2024-09-14T11:08:03.882483+0000","last_active":"2024-09-14T12:58:42.834156+0000","last_peered":"2024-09-14T12:58:42.834156+0000","last_clean":"2024-09-14T12:58:42.834156+0000","last_became_active":"2024-09-14T11:08:03.877126+0000","last_became_peered":"2024-09-14T11:08:03.877126+0000","last_unstale":"2024-09-14T12:58:42.834156+0000","last_undegraded":"2024-09-14T12:58:42.834156+0000","last_fullsized":"2024-09-14T12:58:42.834156+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:08:02.835447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:08:02.835447+0000","last_clean_scrub_stamp":"2024-09-14T11:08:02.835447+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:04:38.793105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"18'1","reported_seq":561,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:58:38.043302+0000","last_change":"2024-09-14T11:08:10.932779+0000","last_active":"2024-09-14T12:58:38.043302+0000","last_peered":"2024-09-14T12:58:38.043302+0000","last_clean":"2024-09-14T12:58:38.043302+0000","last_became_active":"2024-09-14T11:08:08.902043+0000","last_became_peered":"2024-09-14T11:08:08.902043+0000","last_unstale":"2024-09-14T12:58:38.043302+0000","last_undegraded":"2024-09-14T12:58:38.043302+0000","last_fullsized":"2024-09-14T12:58:38.043302+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:08:07.870014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:08:07.870014+0000","last_clean_scrub_stamp":"2024-09-14T11:08:07.870014+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:04:35.417543+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0011624509999999999,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"267'380","reported_seq":1101,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:00.420490+0000","last_change":"2024-09-14T11:08:21.809930+0000","last_active":"2024-09-14T13:02:00.420490+0000","last_peered":"2024-09-14T13:02:00.420490+0000","last_clean":"2024-09-14T13:02:00.420490+0000","last_became_active":"2024-09-14T11:08:21.809523+0000","last_became_peered":"2024-09-14T11:08:21.809523+0000","last_unstale":"2024-09-14T13:02:00.420490+0000","last_undegraded":"2024-09-14T13:02:00.420490+0000","last_fullsized":"2024-09-14T13:02:00.420490+0000","mapping_epoch":24,"log_start":"267'300","ondisk_log_start":"267'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:08:20.733145+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:08:20.733145+0000","last_clean_scrub_stamp":"2024-09-14T11:08:20.733145+0000","objects_scrubbed":0,"log_size":80,"log_dups_size":300,"ondisk_log_size":80,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:35:38.345862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1030,"num_read_kb":10703,"num_write":1404,"num_write_kb":52429,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,6],"acting":[3,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":534,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:58:52.836590+0000","last_change":"2024-09-14T11:08:25.808691+0000","last_active":"2024-09-14T12:58:52.836590+0000","last_peered":"2024-09-14T12:58:52.836590+0000","last_clean":"2024-09-14T12:58:52.836590+0000","last_became_active":"2024-09-14T11:08:25.807851+0000","last_became_peered":"2024-09-14T11:08:25.807851+0000","last_unstale":"2024-09-14T12:58:52.836590+0000","last_undegraded":"2024-09-14T12:58:52.836590+0000","last_fullsized":"2024-09-14T12:58:52.836590+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:08:24.757170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:08:24.757170+0000","last_clean_scrub_stamp":"2024-09-14T11:08:24.757170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:56:51.066419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.7","version":"267'348","reported_seq":1098,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:00.275733+0000","last_change":"2024-09-14T11:08:27.834071+0000","last_active":"2024-09-14T13:02:00.275733+0000","last_peered":"2024-09-14T13:02:00.275733+0000","last_clean":"2024-09-14T13:02:00.275733+0000","last_became_active":"2024-09-14T11:08:27.829359+0000","last_became_peered":"2024-09-14T11:08:27.829359+0000","last_unstale":"2024-09-14T13:02:00.275733+0000","last_undegraded":"2024-09-14T13:02:00.275733+0000","last_fullsized":"2024-09-14T13:02:00.275733+0000","mapping_epoch":30,"log_start":"267'300","ondisk_log_start":"267'300","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:08:26.771628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:08:26.771628+0000","last_clean_scrub_stamp":"2024-09-14T11:08:26.771628+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":300,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:44:51.169189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":21129,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":651,"num_read_kb":879,"num_write":592,"num_write_kb":412,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":528,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:59:03.245682+0000","last_change":"2024-09-14T11:08:29.827169+0000","last_active":"2024-09-14T12:59:03.245682+0000","last_peered":"2024-09-14T12:59:03.245682+0000","last_clean":"2024-09-14T12:59:03.245682+0000","last_became_active":"2024-09-14T11:08:29.826367+0000","last_became_peered":"2024-09-14T11:08:29.826367+0000","last_unstale":"2024-09-14T12:59:03.245682+0000","last_undegraded":"2024-09-14T12:59:03.245682+0000","last_fullsized":"2024-09-14T12:59:03.245682+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:08:28.783586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:08:28.783586+0000","last_clean_scrub_stamp":"2024-09-14T11:08:28.783586+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:19:54.618304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.9","version":"267'212","reported_seq":968,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:00:21.334917+0000","last_change":"2024-09-14T11:08:31.849513+0000","last_active":"2024-09-14T13:00:21.334917+0000","last_peered":"2024-09-14T13:00:21.334917+0000","last_clean":"2024-09-14T13:00:21.334917+0000","last_became_active":"2024-09-14T11:08:31.848763+0000","last_became_peered":"2024-09-14T11:08:31.848763+0000","last_unstale":"2024-09-14T13:00:21.334917+0000","last_undegraded":"2024-09-14T13:00:21.334917+0000","last_fullsized":"2024-09-14T13:00:21.334917+0000","mapping_epoch":34,"log_start":"267'200","ondisk_log_start":"267'200","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:08:30.789404+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:08:30.789404+0000","last_clean_scrub_stamp":"2024-09-14T11:08:30.789404+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":200,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:22:19.969967+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":408,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":546,"num_read_kb":516,"num_write":465,"num_write_kb":130,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.6","version":"267'595","reported_seq":2273,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:58:58.244065+0000","last_change":"2024-09-14T11:08:23.776991+0000","last_active":"2024-09-14T12:58:58.244065+0000","last_peered":"2024-09-14T12:58:58.244065+0000","last_clean":"2024-09-14T12:58:58.244065+0000","last_became_active":"2024-09-14T11:08:23.776564+0000","last_became_peered":"2024-09-14T11:08:23.776564+0000","last_unstale":"2024-09-14T12:58:58.244065+0000","last_undegraded":"2024-09-14T12:58:58.244065+0000","last_fullsized":"2024-09-14T12:58:58.244065+0000","mapping_epoch":26,"log_start":"267'500","ondisk_log_start":"267'500","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:08:22.750609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:08:22.750609+0000","last_clean_scrub_stamp":"2024-09-14T11:08:22.750609+0000","objects_scrubbed":0,"log_size":95,"log_dups_size":500,"ondisk_log_size":95,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:02:21.308539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":3171,"num_read_kb":2898,"num_write":783,"num_write_kb":298,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":563,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:58:47.835277+0000","last_change":"2024-09-14T11:08:11.214664+0000","last_active":"2024-09-14T12:58:47.835277+0000","last_peered":"2024-09-14T12:58:47.835277+0000","last_clean":"2024-09-14T12:58:47.835277+0000","last_became_active":"2024-09-14T11:08:08.903386+0000","last_became_peered":"2024-09-14T11:08:08.903386+0000","last_unstale":"2024-09-14T12:58:47.835277+0000","last_undegraded":"2024-09-14T12:58:47.835277+0000","last_fullsized":"2024-09-14T12:58:47.835277+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:08:07.870014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:08:07.870014+0000","last_clean_scrub_stamp":"2024-09-14T11:08:07.870014+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:55:07.449307+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001192558,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"267'181","reported_seq":871,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:00.468666+0000","last_change":"2024-09-14T11:08:21.815829+0000","last_active":"2024-09-14T13:02:00.468666+0000","last_peered":"2024-09-14T13:02:00.468666+0000","last_clean":"2024-09-14T13:02:00.468666+0000","last_became_active":"2024-09-14T11:08:21.815453+0000","last_became_peered":"2024-09-14T11:08:21.815453+0000","last_unstale":"2024-09-14T13:02:00.468666+0000","last_undegraded":"2024-09-14T13:02:00.468666+0000","last_fullsized":"2024-09-14T13:02:00.468666+0000","mapping_epoch":24,"log_start":"267'100","ondisk_log_start":"267'100","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:08:20.733145+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:08:20.733145+0000","last_clean_scrub_stamp":"2024-09-14T11:08:20.733145+0000","objects_scrubbed":0,"log_size":81,"log_dups_size":100,"ondisk_log_size":81,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:34:32.758328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":658,"num_read_kb":79122,"num_write":846,"num_write_kb":40267,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,3],"acting":[0,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":531,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:58:58.047972+0000","last_change":"2024-09-14T11:08:25.802329+0000","last_active":"2024-09-14T12:58:58.047972+0000","last_peered":"2024-09-14T12:58:58.047972+0000","last_clean":"2024-09-14T12:58:58.047972+0000","last_became_active":"2024-09-14T11:08:25.801580+0000","last_became_peered":"2024-09-14T11:08:25.801580+0000","last_unstale":"2024-09-14T12:58:58.047972+0000","last_undegraded":"2024-09-14T12:58:58.047972+0000","last_fullsized":"2024-09-14T12:58:58.047972+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:08:24.757170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:08:24.757170+0000","last_clean_scrub_stamp":"2024-09-14T11:08:24.757170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:41:07.671257+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.4","version":"267'1020","reported_seq":3375,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:00.353757+0000","last_change":"2024-09-14T11:08:27.825306+0000","last_active":"2024-09-14T13:02:00.353757+0000","last_peered":"2024-09-14T13:02:00.353757+0000","last_clean":"2024-09-14T13:02:00.353757+0000","last_became_active":"2024-09-14T11:08:27.824703+0000","last_became_peered":"2024-09-14T11:08:27.824703+0000","last_unstale":"2024-09-14T13:02:00.353757+0000","last_undegraded":"2024-09-14T13:02:00.353757+0000","last_fullsized":"2024-09-14T13:02:00.353757+0000","mapping_epoch":30,"log_start":"267'1001","ondisk_log_start":"267'1001","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:08:26.771628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:08:26.771628+0000","last_clean_scrub_stamp":"2024-09-14T11:08:26.771628+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":1001,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:45:52.681555+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":21392,"num_objects":12,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":0,"num_read":1365,"num_read_kb":1481,"num_write":500,"num_write_kb":254,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":526,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:59:32.846140+0000","last_change":"2024-09-14T11:08:29.837085+0000","last_active":"2024-09-14T12:59:32.846140+0000","last_peered":"2024-09-14T12:59:32.846140+0000","last_clean":"2024-09-14T12:59:32.846140+0000","last_became_active":"2024-09-14T11:08:29.836253+0000","last_became_peered":"2024-09-14T11:08:29.836253+0000","last_unstale":"2024-09-14T12:59:32.846140+0000","last_undegraded":"2024-09-14T12:59:32.846140+0000","last_fullsized":"2024-09-14T12:59:32.846140+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:08:28.783586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:08:28.783586+0000","last_clean_scrub_stamp":"2024-09-14T11:08:28.783586+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:19:31.677337+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.a","version":"267'224","reported_seq":783,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:59:18.468936+0000","last_change":"2024-09-14T11:08:31.836526+0000","last_active":"2024-09-14T12:59:18.468936+0000","last_peered":"2024-09-14T12:59:18.468936+0000","last_clean":"2024-09-14T12:59:18.468936+0000","last_became_active":"2024-09-14T11:08:31.835700+0000","last_became_peered":"2024-09-14T11:08:31.835700+0000","last_unstale":"2024-09-14T12:59:18.468936+0000","last_undegraded":"2024-09-14T12:59:18.468936+0000","last_fullsized":"2024-09-14T12:59:18.468936+0000","mapping_epoch":34,"log_start":"267'200","ondisk_log_start":"267'200","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:08:30.789404+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:08:30.789404+0000","last_clean_scrub_stamp":"2024-09-14T11:08:30.789404+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":200,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:45:49.838871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":435,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":369,"num_read_kb":358,"num_write":505,"num_write_kb":147,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"267'413","reported_seq":2031,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:00:21.260118+0000","last_change":"2024-09-14T11:09:57.243473+0000","last_active":"2024-09-14T13:00:21.260118+0000","last_peered":"2024-09-14T13:00:21.260118+0000","last_clean":"2024-09-14T13:00:21.260118+0000","last_became_active":"2024-09-14T11:09:57.243168+0000","last_became_peered":"2024-09-14T11:09:57.243168+0000","last_unstale":"2024-09-14T13:00:21.260118+0000","last_undegraded":"2024-09-14T13:00:21.260118+0000","last_fullsized":"2024-09-14T13:00:21.260118+0000","mapping_epoch":39,"log_start":"267'400","ondisk_log_start":"267'400","created":26,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:08:22.750609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:08:22.750609+0000","last_clean_scrub_stamp":"2024-09-14T11:08:22.750609+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":400,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:03:03.902658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2397,"num_read_kb":2278,"num_write":464,"num_write_kb":90,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":564,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:58:37.822791+0000","last_change":"2024-09-14T11:08:10.911966+0000","last_active":"2024-09-14T12:58:37.822791+0000","last_peered":"2024-09-14T12:58:37.822791+0000","last_clean":"2024-09-14T12:58:37.822791+0000","last_became_active":"2024-09-14T11:08:08.957848+0000","last_became_peered":"2024-09-14T11:08:08.957848+0000","last_unstale":"2024-09-14T12:58:37.822791+0000","last_undegraded":"2024-09-14T12:58:37.822791+0000","last_fullsized":"2024-09-14T12:58:37.822791+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:08:07.870014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:08:07.870014+0000","last_clean_scrub_stamp":"2024-09-14T11:08:07.870014+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:21:50.090415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001143142,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"267'236","reported_seq":919,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:00.441375+0000","last_change":"2024-09-14T11:08:21.817844+0000","last_active":"2024-09-14T13:02:00.441375+0000","last_peered":"2024-09-14T13:02:00.441375+0000","last_clean":"2024-09-14T13:02:00.441375+0000","last_became_active":"2024-09-14T11:08:21.817523+0000","last_became_peered":"2024-09-14T11:08:21.817523+0000","last_unstale":"2024-09-14T13:02:00.441375+0000","last_undegraded":"2024-09-14T13:02:00.441375+0000","last_fullsized":"2024-09-14T13:02:00.441375+0000","mapping_epoch":24,"log_start":"267'200","ondisk_log_start":"267'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:08:20.733145+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:08:20.733145+0000","last_clean_scrub_stamp":"2024-09-14T11:08:20.733145+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":200,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:40:59.452110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":52,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":630,"num_read_kb":70142,"num_write":1046,"num_write_kb":36042,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,6],"acting":[1,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.6","version":"29'1","reported_seq":536,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:58:57.827977+0000","last_change":"2024-09-14T11:08:25.807394+0000","last_active":"2024-09-14T12:58:57.827977+0000","last_peered":"2024-09-14T12:58:57.827977+0000","last_clean":"2024-09-14T12:58:57.827977+0000","last_became_active":"2024-09-14T11:08:25.807070+0000","last_became_peered":"2024-09-14T11:08:25.807070+0000","last_unstale":"2024-09-14T12:58:57.827977+0000","last_undegraded":"2024-09-14T12:58:57.827977+0000","last_fullsized":"2024-09-14T12:58:57.827977+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:08:24.757170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:08:24.757170+0000","last_clean_scrub_stamp":"2024-09-14T11:08:24.757170+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:08:45.157565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.5","version":"267'402","reported_seq":2364,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:01:40.687724+0000","last_change":"2024-09-14T11:08:27.831350+0000","last_active":"2024-09-14T13:01:40.687724+0000","last_peered":"2024-09-14T13:01:40.687724+0000","last_clean":"2024-09-14T13:01:40.687724+0000","last_became_active":"2024-09-14T11:08:27.830644+0000","last_became_peered":"2024-09-14T11:08:27.830644+0000","last_unstale":"2024-09-14T13:01:40.687724+0000","last_undegraded":"2024-09-14T13:01:40.687724+0000","last_fullsized":"2024-09-14T13:01:40.687724+0000","mapping_epoch":30,"log_start":"267'300","ondisk_log_start":"267'300","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:08:26.771628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:08:26.771628+0000","last_clean_scrub_stamp":"2024-09-14T11:08:26.771628+0000","objects_scrubbed":0,"log_size":102,"log_dups_size":300,"ondisk_log_size":102,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:05:03.898449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":154,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":380,"num_read_kb":368,"num_write":375,"num_write_kb":193,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":530,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:58:58.243958+0000","last_change":"2024-09-14T11:08:29.802462+0000","last_active":"2024-09-14T12:58:58.243958+0000","last_peered":"2024-09-14T12:58:58.243958+0000","last_clean":"2024-09-14T12:58:58.243958+0000","last_became_active":"2024-09-14T11:08:29.801661+0000","last_became_peered":"2024-09-14T11:08:29.801661+0000","last_unstale":"2024-09-14T12:58:58.243958+0000","last_undegraded":"2024-09-14T12:58:58.243958+0000","last_fullsized":"2024-09-14T12:58:58.243958+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:08:28.783586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:08:28.783586+0000","last_clean_scrub_stamp":"2024-09-14T11:08:28.783586+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:32:48.426887+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.b","version":"267'248","reported_seq":876,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:00:21.845348+0000","last_change":"2024-09-14T11:08:31.842253+0000","last_active":"2024-09-14T13:00:21.845348+0000","last_peered":"2024-09-14T13:00:21.845348+0000","last_clean":"2024-09-14T13:00:21.845348+0000","last_became_active":"2024-09-14T11:08:31.841552+0000","last_became_peered":"2024-09-14T11:08:31.841552+0000","last_unstale":"2024-09-14T13:00:21.845348+0000","last_undegraded":"2024-09-14T13:00:21.845348+0000","last_fullsized":"2024-09-14T13:00:21.845348+0000","mapping_epoch":34,"log_start":"267'200","ondisk_log_start":"267'200","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:08:30.789404+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:08:30.789404+0000","last_clean_scrub_stamp":"2024-09-14T11:08:30.789404+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":200,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:30:40.287699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":202,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":474,"num_read_kb":499,"num_write":548,"num_write_kb":158,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"267'1115","reported_seq":2640,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:01:39.340538+0000","last_change":"2024-09-14T11:08:23.777840+0000","last_active":"2024-09-14T13:01:39.340538+0000","last_peered":"2024-09-14T13:01:39.340538+0000","last_clean":"2024-09-14T13:01:39.340538+0000","last_became_active":"2024-09-14T11:08:23.777511+0000","last_became_peered":"2024-09-14T11:08:23.777511+0000","last_unstale":"2024-09-14T13:01:39.340538+0000","last_undegraded":"2024-09-14T13:01:39.340538+0000","last_fullsized":"2024-09-14T13:01:39.340538+0000","mapping_epoch":26,"log_start":"267'1100","ondisk_log_start":"267'1100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:08:22.750609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:08:22.750609+0000","last_clean_scrub_stamp":"2024-09-14T11:08:22.750609+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":1100,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:04:58.735646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5086,"num_read_kb":4484,"num_write":1533,"num_write_kb":642,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"20'2","reported_seq":562,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:58:38.043188+0000","last_change":"2024-09-14T11:08:10.933870+0000","last_active":"2024-09-14T12:58:38.043188+0000","last_peered":"2024-09-14T12:58:38.043188+0000","last_clean":"2024-09-14T12:58:38.043188+0000","last_became_active":"2024-09-14T11:08:08.903062+0000","last_became_peered":"2024-09-14T11:08:08.903062+0000","last_unstale":"2024-09-14T12:58:38.043188+0000","last_undegraded":"2024-09-14T12:58:38.043188+0000","last_fullsized":"2024-09-14T12:58:38.043188+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:08:07.870014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:08:07.870014+0000","last_clean_scrub_stamp":"2024-09-14T11:08:07.870014+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:50:59.568798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0022728420000000002,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"267'181","reported_seq":868,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:00.435866+0000","last_change":"2024-09-14T11:08:21.830653+0000","last_active":"2024-09-14T13:02:00.435866+0000","last_peered":"2024-09-14T13:02:00.435866+0000","last_clean":"2024-09-14T13:02:00.435866+0000","last_became_active":"2024-09-14T11:08:21.823121+0000","last_became_peered":"2024-09-14T11:08:21.823121+0000","last_unstale":"2024-09-14T13:02:00.435866+0000","last_undegraded":"2024-09-14T13:02:00.435866+0000","last_fullsized":"2024-09-14T13:02:00.435866+0000","mapping_epoch":24,"log_start":"267'100","ondisk_log_start":"267'100","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:08:20.733145+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:08:20.733145+0000","last_clean_scrub_stamp":"2024-09-14T11:08:20.733145+0000","objects_scrubbed":0,"log_size":81,"log_dups_size":100,"ondisk_log_size":81,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:49:22.239894+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":28,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":557,"num_read_kb":32204,"num_write":881,"num_write_kb":26671,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,0],"acting":[4,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":538,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:59:18.249303+0000","last_change":"2024-09-14T11:08:25.797249+0000","last_active":"2024-09-14T12:59:18.249303+0000","last_peered":"2024-09-14T12:59:18.249303+0000","last_clean":"2024-09-14T12:59:18.249303+0000","last_became_active":"2024-09-14T11:08:25.796526+0000","last_became_peered":"2024-09-14T11:08:25.796526+0000","last_unstale":"2024-09-14T12:59:18.249303+0000","last_undegraded":"2024-09-14T12:59:18.249303+0000","last_fullsized":"2024-09-14T12:59:18.249303+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:08:24.757170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:08:24.757170+0000","last_clean_scrub_stamp":"2024-09-14T11:08:24.757170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:18:24.235208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.6","version":"267'234","reported_seq":849,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:01:28.385849+0000","last_change":"2024-09-14T11:08:27.819232+0000","last_active":"2024-09-14T13:01:28.385849+0000","last_peered":"2024-09-14T13:01:28.385849+0000","last_clean":"2024-09-14T13:01:28.385849+0000","last_became_active":"2024-09-14T11:08:27.818482+0000","last_became_peered":"2024-09-14T11:08:27.818482+0000","last_unstale":"2024-09-14T13:01:28.385849+0000","last_undegraded":"2024-09-14T13:01:28.385849+0000","last_fullsized":"2024-09-14T13:01:28.385849+0000","mapping_epoch":30,"log_start":"267'200","ondisk_log_start":"267'200","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:08:26.771628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:08:26.771628+0000","last_clean_scrub_stamp":"2024-09-14T11:08:26.771628+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":200,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:12:06.477100+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":286,"num_read_kb":275,"num_write":214,"num_write_kb":24,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":522,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:59:03.430911+0000","last_change":"2024-09-14T11:08:29.839536+0000","last_active":"2024-09-14T12:59:03.430911+0000","last_peered":"2024-09-14T12:59:03.430911+0000","last_clean":"2024-09-14T12:59:03.430911+0000","last_became_active":"2024-09-14T11:08:29.837840+0000","last_became_peered":"2024-09-14T11:08:29.837840+0000","last_unstale":"2024-09-14T12:59:03.430911+0000","last_undegraded":"2024-09-14T12:59:03.430911+0000","last_fullsized":"2024-09-14T12:59:03.430911+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:08:28.783586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:08:28.783586+0000","last_clean_scrub_stamp":"2024-09-14T11:08:28.783586+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:39:33.744929+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.8","version":"267'111","reported_seq":687,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:00:18.844178+0000","last_change":"2024-09-14T11:08:31.852081+0000","last_active":"2024-09-14T13:00:18.844178+0000","last_peered":"2024-09-14T13:00:18.844178+0000","last_clean":"2024-09-14T13:00:18.844178+0000","last_became_active":"2024-09-14T11:08:31.851269+0000","last_became_peered":"2024-09-14T11:08:31.851269+0000","last_unstale":"2024-09-14T13:00:18.844178+0000","last_undegraded":"2024-09-14T13:00:18.844178+0000","last_fullsized":"2024-09-14T13:00:18.844178+0000","mapping_epoch":34,"log_start":"267'100","ondisk_log_start":"267'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:08:30.789404+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:08:30.789404+0000","last_clean_scrub_stamp":"2024-09-14T11:08:30.789404+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":100,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:52:29.862548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":188,"num_read_kb":187,"num_write":249,"num_write_kb":58,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"267'517","reported_seq":2228,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:00:18.884304+0000","last_change":"2024-09-14T11:08:23.794201+0000","last_active":"2024-09-14T13:00:18.884304+0000","last_peered":"2024-09-14T13:00:18.884304+0000","last_clean":"2024-09-14T13:00:18.884304+0000","last_became_active":"2024-09-14T11:08:23.793860+0000","last_became_peered":"2024-09-14T11:08:23.793860+0000","last_unstale":"2024-09-14T13:00:18.884304+0000","last_undegraded":"2024-09-14T13:00:18.884304+0000","last_fullsized":"2024-09-14T13:00:18.884304+0000","mapping_epoch":26,"log_start":"267'500","ondisk_log_start":"267'500","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:08:22.750609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:08:22.750609+0000","last_clean_scrub_stamp":"2024-09-14T11:08:22.750609+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":500,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:09:26.531607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3013,"num_read_kb":2819,"num_write":641,"num_write_kb":178,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"267'200","reported_seq":879,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:00.364413+0000","last_change":"2024-09-14T11:08:21.792555+0000","last_active":"2024-09-14T13:02:00.364413+0000","last_peered":"2024-09-14T13:02:00.364413+0000","last_clean":"2024-09-14T13:02:00.364413+0000","last_became_active":"2024-09-14T11:08:21.791679+0000","last_became_peered":"2024-09-14T11:08:21.791679+0000","last_unstale":"2024-09-14T13:02:00.364413+0000","last_undegraded":"2024-09-14T13:02:00.364413+0000","last_fullsized":"2024-09-14T13:02:00.364413+0000","mapping_epoch":24,"log_start":"267'100","ondisk_log_start":"267'100","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:08:20.733145+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:08:20.733145+0000","last_clean_scrub_stamp":"2024-09-14T11:08:20.733145+0000","objects_scrubbed":0,"log_size":100,"log_dups_size":100,"ondisk_log_size":100,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:33:56.588522+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":15,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":647,"num_read_kb":55282,"num_write":902,"num_write_kb":39262,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,2],"acting":[5,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":558,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:58:38.460088+0000","last_change":"2024-09-14T11:08:10.911600+0000","last_active":"2024-09-14T12:58:38.460088+0000","last_peered":"2024-09-14T12:58:38.460088+0000","last_clean":"2024-09-14T12:58:38.460088+0000","last_became_active":"2024-09-14T11:08:08.888921+0000","last_became_peered":"2024-09-14T11:08:08.888921+0000","last_unstale":"2024-09-14T12:58:38.460088+0000","last_undegraded":"2024-09-14T12:58:38.460088+0000","last_fullsized":"2024-09-14T12:58:38.460088+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:08:07.870014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:08:07.870014+0000","last_clean_scrub_stamp":"2024-09-14T11:08:07.870014+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:29:02.760571+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001198714,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":538,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:58:53.242581+0000","last_change":"2024-09-14T11:08:25.801820+0000","last_active":"2024-09-14T12:58:53.242581+0000","last_peered":"2024-09-14T12:58:53.242581+0000","last_clean":"2024-09-14T12:58:53.242581+0000","last_became_active":"2024-09-14T11:08:25.792863+0000","last_became_peered":"2024-09-14T11:08:25.792863+0000","last_unstale":"2024-09-14T12:58:53.242581+0000","last_undegraded":"2024-09-14T12:58:53.242581+0000","last_fullsized":"2024-09-14T12:58:53.242581+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:08:24.757170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:08:24.757170+0000","last_clean_scrub_stamp":"2024-09-14T11:08:24.757170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:55:17.257027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"267'462","reported_seq":1209,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:00.484966+0000","last_change":"2024-09-14T11:08:27.803952+0000","last_active":"2024-09-14T13:02:00.484966+0000","last_peered":"2024-09-14T13:02:00.484966+0000","last_clean":"2024-09-14T13:02:00.484966+0000","last_became_active":"2024-09-14T11:08:27.803324+0000","last_became_peered":"2024-09-14T11:08:27.803324+0000","last_unstale":"2024-09-14T13:02:00.484966+0000","last_undegraded":"2024-09-14T13:02:00.484966+0000","last_fullsized":"2024-09-14T13:02:00.484966+0000","mapping_epoch":30,"log_start":"267'400","ondisk_log_start":"267'400","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:08:26.771628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:08:26.771628+0000","last_clean_scrub_stamp":"2024-09-14T11:08:26.771628+0000","objects_scrubbed":0,"log_size":62,"log_dups_size":400,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:06:41.976461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19948,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":1305,"num_read_kb":1473,"num_write":1890,"num_write_kb":1660,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":527,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:58:58.232580+0000","last_change":"2024-09-14T11:08:29.831130+0000","last_active":"2024-09-14T12:58:58.232580+0000","last_peered":"2024-09-14T12:58:58.232580+0000","last_clean":"2024-09-14T12:58:58.232580+0000","last_became_active":"2024-09-14T11:08:29.830303+0000","last_became_peered":"2024-09-14T11:08:29.830303+0000","last_unstale":"2024-09-14T12:58:58.232580+0000","last_undegraded":"2024-09-14T12:58:58.232580+0000","last_fullsized":"2024-09-14T12:58:58.232580+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:08:28.783586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:08:28.783586+0000","last_clean_scrub_stamp":"2024-09-14T11:08:28.783586+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:22:47.627433+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.e","version":"267'153","reported_seq":717,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:00:13.798032+0000","last_change":"2024-09-14T11:08:31.836009+0000","last_active":"2024-09-14T13:00:13.798032+0000","last_peered":"2024-09-14T13:00:13.798032+0000","last_clean":"2024-09-14T13:00:13.798032+0000","last_became_active":"2024-09-14T11:08:31.835335+0000","last_became_peered":"2024-09-14T11:08:31.835335+0000","last_unstale":"2024-09-14T13:00:13.798032+0000","last_undegraded":"2024-09-14T13:00:13.798032+0000","last_fullsized":"2024-09-14T13:00:13.798032+0000","mapping_epoch":34,"log_start":"267'100","ondisk_log_start":"267'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:08:30.789404+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:08:30.789404+0000","last_clean_scrub_stamp":"2024-09-14T11:08:30.789404+0000","objects_scrubbed":0,"log_size":53,"log_dups_size":100,"ondisk_log_size":53,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:46:41.088012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":736,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":226,"num_read_kb":194,"num_write":381,"num_write_kb":93,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"267'734","reported_seq":2282,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:58:53.242555+0000","last_change":"2024-09-14T11:08:23.792522+0000","last_active":"2024-09-14T12:58:53.242555+0000","last_peered":"2024-09-14T12:58:53.242555+0000","last_clean":"2024-09-14T12:58:53.242555+0000","last_became_active":"2024-09-14T11:08:23.792144+0000","last_became_peered":"2024-09-14T11:08:23.792144+0000","last_unstale":"2024-09-14T12:58:53.242555+0000","last_undegraded":"2024-09-14T12:58:53.242555+0000","last_fullsized":"2024-09-14T12:58:53.242555+0000","mapping_epoch":26,"log_start":"267'700","ondisk_log_start":"267'700","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:08:22.750609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:08:22.750609+0000","last_clean_scrub_stamp":"2024-09-14T11:08:22.750609+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":700,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:27:19.107022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":3573,"num_read_kb":3234,"num_write":954,"num_write_kb":344,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.4","version":"267'263","reported_seq":981,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:00.399138+0000","last_change":"2024-09-14T11:08:21.808706+0000","last_active":"2024-09-14T13:02:00.399138+0000","last_peered":"2024-09-14T13:02:00.399138+0000","last_clean":"2024-09-14T13:02:00.399138+0000","last_became_active":"2024-09-14T11:08:21.808278+0000","last_became_peered":"2024-09-14T11:08:21.808278+0000","last_unstale":"2024-09-14T13:02:00.399138+0000","last_undegraded":"2024-09-14T13:02:00.399138+0000","last_fullsized":"2024-09-14T13:02:00.399138+0000","mapping_epoch":24,"log_start":"267'200","ondisk_log_start":"267'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:08:20.733145+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:08:20.733145+0000","last_clean_scrub_stamp":"2024-09-14T11:08:20.733145+0000","objects_scrubbed":0,"log_size":63,"log_dups_size":200,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:56:37.903249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":105,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":853,"num_read_kb":29781,"num_write":1322,"num_write_kb":30049,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,6],"acting":[1,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":561,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:59:12.841357+0000","last_change":"2024-09-14T11:08:11.214796+0000","last_active":"2024-09-14T12:59:12.841357+0000","last_peered":"2024-09-14T12:59:12.841357+0000","last_clean":"2024-09-14T12:59:12.841357+0000","last_became_active":"2024-09-14T11:08:08.903905+0000","last_became_peered":"2024-09-14T11:08:08.903905+0000","last_unstale":"2024-09-14T12:59:12.841357+0000","last_undegraded":"2024-09-14T12:59:12.841357+0000","last_fullsized":"2024-09-14T12:59:12.841357+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:08:07.870014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:08:07.870014+0000","last_clean_scrub_stamp":"2024-09-14T11:08:07.870014+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:58:06.786050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001173377,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":532,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:58:53.428640+0000","last_change":"2024-09-14T11:08:25.801438+0000","last_active":"2024-09-14T12:58:53.428640+0000","last_peered":"2024-09-14T12:58:53.428640+0000","last_clean":"2024-09-14T12:58:53.428640+0000","last_became_active":"2024-09-14T11:08:25.800695+0000","last_became_peered":"2024-09-14T11:08:25.800695+0000","last_unstale":"2024-09-14T12:58:53.428640+0000","last_undegraded":"2024-09-14T12:58:53.428640+0000","last_fullsized":"2024-09-14T12:58:53.428640+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:08:24.757170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:08:24.757170+0000","last_clean_scrub_stamp":"2024-09-14T11:08:24.757170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:42:30.211985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1","version":"267'350","reported_seq":993,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:00:28.372671+0000","last_change":"2024-09-14T11:08:27.814544+0000","last_active":"2024-09-14T13:00:28.372671+0000","last_peered":"2024-09-14T13:00:28.372671+0000","last_clean":"2024-09-14T13:00:28.372671+0000","last_became_active":"2024-09-14T11:08:27.813857+0000","last_became_peered":"2024-09-14T11:08:27.813857+0000","last_unstale":"2024-09-14T13:00:28.372671+0000","last_undegraded":"2024-09-14T13:00:28.372671+0000","last_fullsized":"2024-09-14T13:00:28.372671+0000","mapping_epoch":30,"log_start":"267'300","ondisk_log_start":"267'300","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:08:26.771628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:08:26.771628+0000","last_clean_scrub_stamp":"2024-09-14T11:08:26.771628+0000","objects_scrubbed":0,"log_size":50,"log_dups_size":300,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:41:50.966231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":441,"num_read_kb":434,"num_write":426,"num_write_kb":202,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.0","version":"267'780","reported_seq":5198,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:00.315663+0000","last_change":"2024-09-14T11:08:29.824227+0000","last_active":"2024-09-14T13:02:00.315663+0000","last_peered":"2024-09-14T13:02:00.315663+0000","last_clean":"2024-09-14T13:02:00.315663+0000","last_became_active":"2024-09-14T11:08:29.823513+0000","last_became_peered":"2024-09-14T11:08:29.823513+0000","last_unstale":"2024-09-14T13:02:00.315663+0000","last_undegraded":"2024-09-14T13:02:00.315663+0000","last_fullsized":"2024-09-14T13:02:00.315663+0000","mapping_epoch":32,"log_start":"267'700","ondisk_log_start":"267'700","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:08:28.783586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:08:28.783586+0000","last_clean_scrub_stamp":"2024-09-14T11:08:28.783586+0000","objects_scrubbed":0,"log_size":80,"log_dups_size":700,"ondisk_log_size":80,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:12:27.111650+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.f","version":"267'148","reported_seq":702,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:01:23.499170+0000","last_change":"2024-09-14T11:08:31.831263+0000","last_active":"2024-09-14T13:01:23.499170+0000","last_peered":"2024-09-14T13:01:23.499170+0000","last_clean":"2024-09-14T13:01:23.499170+0000","last_became_active":"2024-09-14T11:08:31.825708+0000","last_became_peered":"2024-09-14T11:08:31.825708+0000","last_unstale":"2024-09-14T13:01:23.499170+0000","last_undegraded":"2024-09-14T13:01:23.499170+0000","last_fullsized":"2024-09-14T13:01:23.499170+0000","mapping_epoch":34,"log_start":"267'100","ondisk_log_start":"267'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:08:30.789404+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:08:30.789404+0000","last_clean_scrub_stamp":"2024-09-14T11:08:30.789404+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":100,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:10:09.371769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1096,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":219,"num_read_kb":197,"num_write":351,"num_write_kb":86,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"267'1021","reported_seq":2906,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:59:18.397637+0000","last_change":"2024-09-14T11:08:23.800778+0000","last_active":"2024-09-14T12:59:18.397637+0000","last_peered":"2024-09-14T12:59:18.397637+0000","last_clean":"2024-09-14T12:59:18.397637+0000","last_became_active":"2024-09-14T11:08:23.800388+0000","last_became_peered":"2024-09-14T11:08:23.800388+0000","last_unstale":"2024-09-14T12:59:18.397637+0000","last_undegraded":"2024-09-14T12:59:18.397637+0000","last_fullsized":"2024-09-14T12:59:18.397637+0000","mapping_epoch":26,"log_start":"267'1000","ondisk_log_start":"267'1000","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:08:22.750609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:08:22.750609+0000","last_clean_scrub_stamp":"2024-09-14T11:08:22.750609+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":1000,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:13:46.545106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":5094,"num_read_kb":4556,"num_write":1418,"num_write_kb":544,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.7","version":"267'189","reported_seq":831,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:00.477845+0000","last_change":"2024-09-14T11:08:21.798122+0000","last_active":"2024-09-14T13:02:00.477845+0000","last_peered":"2024-09-14T13:02:00.477845+0000","last_clean":"2024-09-14T13:02:00.477845+0000","last_became_active":"2024-09-14T11:08:21.797297+0000","last_became_peered":"2024-09-14T11:08:21.797297+0000","last_unstale":"2024-09-14T13:02:00.477845+0000","last_undegraded":"2024-09-14T13:02:00.477845+0000","last_fullsized":"2024-09-14T13:02:00.477845+0000","mapping_epoch":24,"log_start":"267'100","ondisk_log_start":"267'100","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:08:20.733145+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:08:20.733145+0000","last_clean_scrub_stamp":"2024-09-14T11:08:20.733145+0000","objects_scrubbed":0,"log_size":89,"log_dups_size":100,"ondisk_log_size":89,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:30:27.067493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1655854,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":473,"num_read_kb":20434,"num_write":854,"num_write_kb":40195,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,7],"acting":[3,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":556,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:58:43.461294+0000","last_change":"2024-09-14T11:08:10.911600+0000","last_active":"2024-09-14T12:58:43.461294+0000","last_peered":"2024-09-14T12:58:43.461294+0000","last_clean":"2024-09-14T12:58:43.461294+0000","last_became_active":"2024-09-14T11:08:08.891458+0000","last_became_peered":"2024-09-14T11:08:08.891458+0000","last_unstale":"2024-09-14T12:58:43.461294+0000","last_undegraded":"2024-09-14T12:58:43.461294+0000","last_fullsized":"2024-09-14T12:58:43.461294+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:08:07.870014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:08:07.870014+0000","last_clean_scrub_stamp":"2024-09-14T11:08:07.870014+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:05:05.170921+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0011468940000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":535,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:58:53.231411+0000","last_change":"2024-09-14T11:08:25.808446+0000","last_active":"2024-09-14T12:58:53.231411+0000","last_peered":"2024-09-14T12:58:53.231411+0000","last_clean":"2024-09-14T12:58:53.231411+0000","last_became_active":"2024-09-14T11:08:25.807555+0000","last_became_peered":"2024-09-14T11:08:25.807555+0000","last_unstale":"2024-09-14T12:58:53.231411+0000","last_undegraded":"2024-09-14T12:58:53.231411+0000","last_fullsized":"2024-09-14T12:58:53.231411+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:08:24.757170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:08:24.757170+0000","last_clean_scrub_stamp":"2024-09-14T11:08:24.757170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:45:14.993273+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.2","version":"267'172","reported_seq":779,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:59:08.517056+0000","last_change":"2024-09-14T11:08:27.826108+0000","last_active":"2024-09-14T12:59:08.517056+0000","last_peered":"2024-09-14T12:59:08.517056+0000","last_clean":"2024-09-14T12:59:08.517056+0000","last_became_active":"2024-09-14T11:08:27.825292+0000","last_became_peered":"2024-09-14T11:08:27.825292+0000","last_unstale":"2024-09-14T12:59:08.517056+0000","last_undegraded":"2024-09-14T12:59:08.517056+0000","last_fullsized":"2024-09-14T12:59:08.517056+0000","mapping_epoch":30,"log_start":"267'100","ondisk_log_start":"267'100","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:08:26.771628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:08:26.771628+0000","last_clean_scrub_stamp":"2024-09-14T11:08:26.771628+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":100,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:07:03.156677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":226,"num_read_kb":221,"num_write":150,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.3","version":"267'815","reported_seq":5534,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:00.447764+0000","last_change":"2024-09-14T11:08:29.826625+0000","last_active":"2024-09-14T13:02:00.447764+0000","last_peered":"2024-09-14T13:02:00.447764+0000","last_clean":"2024-09-14T13:02:00.447764+0000","last_became_active":"2024-09-14T11:08:29.824268+0000","last_became_peered":"2024-09-14T11:08:29.824268+0000","last_unstale":"2024-09-14T13:02:00.447764+0000","last_undegraded":"2024-09-14T13:02:00.447764+0000","last_fullsized":"2024-09-14T13:02:00.447764+0000","mapping_epoch":32,"log_start":"267'801","ondisk_log_start":"267'801","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:08:28.783586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:08:28.783586+0000","last_clean_scrub_stamp":"2024-09-14T11:08:28.783586+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":801,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:53:34.571934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.c","version":"267'177","reported_seq":726,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:58:48.241226+0000","last_change":"2024-09-14T11:08:31.845141+0000","last_active":"2024-09-14T12:58:48.241226+0000","last_peered":"2024-09-14T12:58:48.241226+0000","last_clean":"2024-09-14T12:58:48.241226+0000","last_became_active":"2024-09-14T11:08:31.844329+0000","last_became_peered":"2024-09-14T11:08:31.844329+0000","last_unstale":"2024-09-14T12:58:48.241226+0000","last_undegraded":"2024-09-14T12:58:48.241226+0000","last_fullsized":"2024-09-14T12:58:48.241226+0000","mapping_epoch":34,"log_start":"267'100","ondisk_log_start":"267'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:08:30.789404+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:08:30.789404+0000","last_clean_scrub_stamp":"2024-09-14T11:08:30.789404+0000","objects_scrubbed":0,"log_size":77,"log_dups_size":100,"ondisk_log_size":77,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:04:50.705908+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":58,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":178,"num_read_kb":162,"num_write":419,"num_write_kb":126,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"267'732","reported_seq":2204,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:00:11.324270+0000","last_change":"2024-09-14T11:08:23.801660+0000","last_active":"2024-09-14T13:00:11.324270+0000","last_peered":"2024-09-14T13:00:11.324270+0000","last_clean":"2024-09-14T13:00:11.324270+0000","last_became_active":"2024-09-14T11:08:23.800918+0000","last_became_peered":"2024-09-14T11:08:23.800918+0000","last_unstale":"2024-09-14T13:00:11.324270+0000","last_undegraded":"2024-09-14T13:00:11.324270+0000","last_fullsized":"2024-09-14T13:00:11.324270+0000","mapping_epoch":26,"log_start":"267'700","ondisk_log_start":"267'700","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:08:22.750609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:08:22.750609+0000","last_clean_scrub_stamp":"2024-09-14T11:08:22.750609+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":700,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:49:04.627652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3552,"num_read_kb":3200,"num_write":979,"num_write_kb":380,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"267'264","reported_seq":964,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:00.458766+0000","last_change":"2024-09-14T11:08:56.035136+0000","last_active":"2024-09-14T13:02:00.458766+0000","last_peered":"2024-09-14T13:02:00.458766+0000","last_clean":"2024-09-14T13:02:00.458766+0000","last_became_active":"2024-09-14T11:08:56.034426+0000","last_became_peered":"2024-09-14T11:08:56.034426+0000","last_unstale":"2024-09-14T13:02:00.458766+0000","last_undegraded":"2024-09-14T13:02:00.458766+0000","last_fullsized":"2024-09-14T13:02:00.458766+0000","mapping_epoch":37,"log_start":"267'200","ondisk_log_start":"267'200","created":24,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:08:20.733145+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:08:20.733145+0000","last_clean_scrub_stamp":"2024-09-14T11:08:20.733145+0000","objects_scrubbed":0,"log_size":64,"log_dups_size":200,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:00:24.358863+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3311697,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":736,"num_read_kb":100890,"num_write":1101,"num_write_kb":33821,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,4],"acting":[2,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":557,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:58:43.426370+0000","last_change":"2024-09-14T11:08:11.214692+0000","last_active":"2024-09-14T12:58:43.426370+0000","last_peered":"2024-09-14T12:58:43.426370+0000","last_clean":"2024-09-14T12:58:43.426370+0000","last_became_active":"2024-09-14T11:08:08.905736+0000","last_became_peered":"2024-09-14T11:08:08.905736+0000","last_unstale":"2024-09-14T12:58:43.426370+0000","last_undegraded":"2024-09-14T12:58:43.426370+0000","last_fullsized":"2024-09-14T12:58:43.426370+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:08:07.870014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:08:07.870014+0000","last_clean_scrub_stamp":"2024-09-14T11:08:07.870014+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:16:43.551707+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0012835290000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":535,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:58:48.463988+0000","last_change":"2024-09-14T11:08:25.803022+0000","last_active":"2024-09-14T12:58:48.463988+0000","last_peered":"2024-09-14T12:58:48.463988+0000","last_clean":"2024-09-14T12:58:48.463988+0000","last_became_active":"2024-09-14T11:08:25.801554+0000","last_became_peered":"2024-09-14T11:08:25.801554+0000","last_unstale":"2024-09-14T12:58:48.463988+0000","last_undegraded":"2024-09-14T12:58:48.463988+0000","last_fullsized":"2024-09-14T12:58:48.463988+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:08:24.757170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:08:24.757170+0000","last_clean_scrub_stamp":"2024-09-14T11:08:24.757170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:30:31.481284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"267'404","reported_seq":1193,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:00.443695+0000","last_change":"2024-09-14T11:08:27.836312+0000","last_active":"2024-09-14T13:02:00.443695+0000","last_peered":"2024-09-14T13:02:00.443695+0000","last_clean":"2024-09-14T13:02:00.443695+0000","last_became_active":"2024-09-14T11:08:27.831653+0000","last_became_peered":"2024-09-14T11:08:27.831653+0000","last_unstale":"2024-09-14T13:02:00.443695+0000","last_undegraded":"2024-09-14T13:02:00.443695+0000","last_fullsized":"2024-09-14T13:02:00.443695+0000","mapping_epoch":30,"log_start":"267'300","ondisk_log_start":"267'300","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:08:26.771628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:08:26.771628+0000","last_clean_scrub_stamp":"2024-09-14T11:08:26.771628+0000","objects_scrubbed":0,"log_size":104,"log_dups_size":300,"ondisk_log_size":104,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:26:55.360414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":31170,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":610,"num_read_kb":890,"num_write":340,"num_write_kb":94,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":525,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:58:58.466673+0000","last_change":"2024-09-14T11:08:29.826424+0000","last_active":"2024-09-14T12:58:58.466673+0000","last_peered":"2024-09-14T12:58:58.466673+0000","last_clean":"2024-09-14T12:58:58.466673+0000","last_became_active":"2024-09-14T11:08:29.825186+0000","last_became_peered":"2024-09-14T11:08:29.825186+0000","last_unstale":"2024-09-14T12:58:58.466673+0000","last_undegraded":"2024-09-14T12:58:58.466673+0000","last_fullsized":"2024-09-14T12:58:58.466673+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:08:28.783586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:08:28.783586+0000","last_clean_scrub_stamp":"2024-09-14T11:08:28.783586+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:49:23.866313+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.d","version":"267'138","reported_seq":663,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:58:48.045619+0000","last_change":"2024-09-14T11:08:31.838408+0000","last_active":"2024-09-14T12:58:48.045619+0000","last_peered":"2024-09-14T12:58:48.045619+0000","last_clean":"2024-09-14T12:58:48.045619+0000","last_became_active":"2024-09-14T11:08:31.837649+0000","last_became_peered":"2024-09-14T11:08:31.837649+0000","last_unstale":"2024-09-14T12:58:48.045619+0000","last_undegraded":"2024-09-14T12:58:48.045619+0000","last_fullsized":"2024-09-14T12:58:48.045619+0000","mapping_epoch":34,"log_start":"267'100","ondisk_log_start":"267'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:08:30.789404+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:08:30.789404+0000","last_clean_scrub_stamp":"2024-09-14T11:08:30.789404+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":100,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:22:41.759152+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":204,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":124,"num_read_kb":124,"num_write":321,"num_write_kb":75,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.1f","version":"267'141","reported_seq":733,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:00:21.741622+0000","last_change":"2024-09-14T11:08:31.854083+0000","last_active":"2024-09-14T13:00:21.741622+0000","last_peered":"2024-09-14T13:00:21.741622+0000","last_clean":"2024-09-14T13:00:21.741622+0000","last_became_active":"2024-09-14T11:08:31.849681+0000","last_became_peered":"2024-09-14T11:08:31.849681+0000","last_unstale":"2024-09-14T13:00:21.741622+0000","last_undegraded":"2024-09-14T13:00:21.741622+0000","last_fullsized":"2024-09-14T13:00:21.741622+0000","mapping_epoch":34,"log_start":"267'100","ondisk_log_start":"267'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:08:30.789404+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:08:30.789404+0000","last_clean_scrub_stamp":"2024-09-14T11:08:30.789404+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":100,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:48:25.310770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":202,"num_read_kb":202,"num_write":327,"num_write_kb":74,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.13","version":"267'450","reported_seq":2149,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:00:11.323966+0000","last_change":"2024-09-14T11:08:23.807515+0000","last_active":"2024-09-14T13:00:11.323966+0000","last_peered":"2024-09-14T13:00:11.323966+0000","last_clean":"2024-09-14T13:00:11.323966+0000","last_became_active":"2024-09-14T11:08:23.806746+0000","last_became_peered":"2024-09-14T11:08:23.806746+0000","last_unstale":"2024-09-14T13:00:11.323966+0000","last_undegraded":"2024-09-14T13:00:11.323966+0000","last_fullsized":"2024-09-14T13:00:11.323966+0000","mapping_epoch":26,"log_start":"267'400","ondisk_log_start":"267'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:08:22.750609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:08:22.750609+0000","last_clean_scrub_stamp":"2024-09-14T11:08:22.750609+0000","objects_scrubbed":0,"log_size":50,"log_dups_size":400,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:59:49.178094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2482,"num_read_kb":2367,"num_write":499,"num_write_kb":86,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.14","version":"267'194","reported_seq":817,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:00.266123+0000","last_change":"2024-09-14T11:08:56.029416+0000","last_active":"2024-09-14T13:02:00.266123+0000","last_peered":"2024-09-14T13:02:00.266123+0000","last_clean":"2024-09-14T13:02:00.266123+0000","last_became_active":"2024-09-14T11:08:56.028924+0000","last_became_peered":"2024-09-14T11:08:56.028924+0000","last_unstale":"2024-09-14T13:02:00.266123+0000","last_undegraded":"2024-09-14T13:02:00.266123+0000","last_fullsized":"2024-09-14T13:02:00.266123+0000","mapping_epoch":37,"log_start":"267'100","ondisk_log_start":"267'100","created":24,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:08:20.733145+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:08:20.733145+0000","last_clean_scrub_stamp":"2024-09-14T11:08:20.733145+0000","objects_scrubbed":0,"log_size":94,"log_dups_size":100,"ondisk_log_size":94,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:13:29.739250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":18,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":488,"num_read_kb":9162,"num_write":891,"num_write_kb":17219,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7,6],"acting":[2,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":525,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:58:08.453389+0000","last_change":"2024-09-14T11:08:25.807119+0000","last_active":"2024-09-14T12:58:08.453389+0000","last_peered":"2024-09-14T12:58:08.453389+0000","last_clean":"2024-09-14T12:58:08.453389+0000","last_became_active":"2024-09-14T11:08:25.806778+0000","last_became_peered":"2024-09-14T11:08:25.806778+0000","last_unstale":"2024-09-14T12:58:08.453389+0000","last_undegraded":"2024-09-14T12:58:08.453389+0000","last_fullsized":"2024-09-14T12:58:08.453389+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:08:24.757170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:08:24.757170+0000","last_clean_scrub_stamp":"2024-09-14T11:08:24.757170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:11:05.830604+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.11","version":"267'193","reported_seq":825,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:00.171900+0000","last_change":"2024-09-14T11:08:27.803446+0000","last_active":"2024-09-14T13:02:00.171900+0000","last_peered":"2024-09-14T13:02:00.171900+0000","last_clean":"2024-09-14T13:02:00.171900+0000","last_became_active":"2024-09-14T11:08:27.802742+0000","last_became_peered":"2024-09-14T11:08:27.802742+0000","last_unstale":"2024-09-14T13:02:00.171900+0000","last_undegraded":"2024-09-14T13:02:00.171900+0000","last_fullsized":"2024-09-14T13:02:00.171900+0000","mapping_epoch":30,"log_start":"264'100","ondisk_log_start":"264'100","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:08:26.771628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:08:26.771628+0000","last_clean_scrub_stamp":"2024-09-14T11:08:26.771628+0000","objects_scrubbed":0,"log_size":93,"log_dups_size":100,"ondisk_log_size":93,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:28:41.473997+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":14583,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":266,"num_read_kb":357,"num_write":152,"num_write_kb":28,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":519,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:58:13.455830+0000","last_change":"2024-09-14T11:08:29.833602+0000","last_active":"2024-09-14T12:58:13.455830+0000","last_peered":"2024-09-14T12:58:13.455830+0000","last_clean":"2024-09-14T12:58:13.455830+0000","last_became_active":"2024-09-14T11:08:29.832866+0000","last_became_peered":"2024-09-14T11:08:29.832866+0000","last_unstale":"2024-09-14T12:58:13.455830+0000","last_undegraded":"2024-09-14T12:58:13.455830+0000","last_fullsized":"2024-09-14T12:58:13.455830+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:08:28.783586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:08:28.783586+0000","last_clean_scrub_stamp":"2024-09-14T11:08:28.783586+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:47:19.171157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1e","version":"267'153","reported_seq":732,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:00:21.213723+0000","last_change":"2024-09-14T11:08:31.838160+0000","last_active":"2024-09-14T13:00:21.213723+0000","last_peered":"2024-09-14T13:00:21.213723+0000","last_clean":"2024-09-14T13:00:21.213723+0000","last_became_active":"2024-09-14T11:08:31.837431+0000","last_became_peered":"2024-09-14T11:08:31.837431+0000","last_unstale":"2024-09-14T13:00:21.213723+0000","last_undegraded":"2024-09-14T13:00:21.213723+0000","last_fullsized":"2024-09-14T13:00:21.213723+0000","mapping_epoch":34,"log_start":"267'100","ondisk_log_start":"267'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:08:30.789404+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:08:30.789404+0000","last_clean_scrub_stamp":"2024-09-14T11:08:30.789404+0000","objects_scrubbed":0,"log_size":53,"log_dups_size":100,"ondisk_log_size":53,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:03:00.723612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":449,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":316,"num_read_kb":262,"num_write":344,"num_write_kb":81,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.12","version":"267'842","reported_seq":2487,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:00:18.885098+0000","last_change":"2024-09-14T11:08:23.805988+0000","last_active":"2024-09-14T13:00:18.885098+0000","last_peered":"2024-09-14T13:00:18.885098+0000","last_clean":"2024-09-14T13:00:18.885098+0000","last_became_active":"2024-09-14T11:08:23.805773+0000","last_became_peered":"2024-09-14T11:08:23.805773+0000","last_unstale":"2024-09-14T13:00:18.885098+0000","last_undegraded":"2024-09-14T13:00:18.885098+0000","last_fullsized":"2024-09-14T13:00:18.885098+0000","mapping_epoch":26,"log_start":"267'800","ondisk_log_start":"267'800","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:08:22.750609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:08:22.750609+0000","last_clean_scrub_stamp":"2024-09-14T11:08:22.750609+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":800,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:04:02.649234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":4345,"num_read_kb":3935,"num_write":1136,"num_write_kb":447,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"267'286","reported_seq":999,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:00.439979+0000","last_change":"2024-09-14T11:08:21.830655+0000","last_active":"2024-09-14T13:02:00.439979+0000","last_peered":"2024-09-14T13:02:00.439979+0000","last_clean":"2024-09-14T13:02:00.439979+0000","last_became_active":"2024-09-14T11:08:21.829412+0000","last_became_peered":"2024-09-14T11:08:21.829412+0000","last_unstale":"2024-09-14T13:02:00.439979+0000","last_undegraded":"2024-09-14T13:02:00.439979+0000","last_fullsized":"2024-09-14T13:02:00.439979+0000","mapping_epoch":24,"log_start":"267'200","ondisk_log_start":"267'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:08:20.733145+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:08:20.733145+0000","last_clean_scrub_stamp":"2024-09-14T11:08:20.733145+0000","objects_scrubbed":0,"log_size":86,"log_dups_size":200,"ondisk_log_size":86,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:31:08.044755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":54,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":846,"num_read_kb":41720,"num_write":1221,"num_write_kb":52852,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,6],"acting":[7,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":527,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:58:08.454944+0000","last_change":"2024-09-14T11:08:25.800314+0000","last_active":"2024-09-14T12:58:08.454944+0000","last_peered":"2024-09-14T12:58:08.454944+0000","last_clean":"2024-09-14T12:58:08.454944+0000","last_became_active":"2024-09-14T11:08:25.799473+0000","last_became_peered":"2024-09-14T11:08:25.799473+0000","last_unstale":"2024-09-14T12:58:08.454944+0000","last_undegraded":"2024-09-14T12:58:08.454944+0000","last_fullsized":"2024-09-14T12:58:08.454944+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:08:24.757170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:08:24.757170+0000","last_clean_scrub_stamp":"2024-09-14T11:08:24.757170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:39:41.634975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"267'93","reported_seq":645,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:59:05.331375+0000","last_change":"2024-09-14T11:08:27.824140+0000","last_active":"2024-09-14T12:59:05.331375+0000","last_peered":"2024-09-14T12:59:05.331375+0000","last_clean":"2024-09-14T12:59:05.331375+0000","last_became_active":"2024-09-14T11:08:27.822933+0000","last_became_peered":"2024-09-14T11:08:27.822933+0000","last_unstale":"2024-09-14T12:59:05.331375+0000","last_undegraded":"2024-09-14T12:59:05.331375+0000","last_fullsized":"2024-09-14T12:59:05.331375+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:08:26.771628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:08:26.771628+0000","last_clean_scrub_stamp":"2024-09-14T11:08:26.771628+0000","objects_scrubbed":0,"log_size":93,"log_dups_size":0,"ondisk_log_size":93,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:18:09.511324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":83,"num_read_kb":77,"num_write":62,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":520,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:58:12.827302+0000","last_change":"2024-09-14T11:08:29.839496+0000","last_active":"2024-09-14T12:58:12.827302+0000","last_peered":"2024-09-14T12:58:12.827302+0000","last_clean":"2024-09-14T12:58:12.827302+0000","last_became_active":"2024-09-14T11:08:29.838784+0000","last_became_peered":"2024-09-14T11:08:29.838784+0000","last_unstale":"2024-09-14T12:58:12.827302+0000","last_undegraded":"2024-09-14T12:58:12.827302+0000","last_fullsized":"2024-09-14T12:58:12.827302+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:08:28.783586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:08:28.783586+0000","last_clean_scrub_stamp":"2024-09-14T11:08:28.783586+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:24:04.303207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1d","version":"267'173","reported_seq":722,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:00:18.909877+0000","last_change":"2024-09-14T11:08:31.835747+0000","last_active":"2024-09-14T13:00:18.909877+0000","last_peered":"2024-09-14T13:00:18.909877+0000","last_clean":"2024-09-14T13:00:18.909877+0000","last_became_active":"2024-09-14T11:08:31.835061+0000","last_became_peered":"2024-09-14T11:08:31.835061+0000","last_unstale":"2024-09-14T13:00:18.909877+0000","last_undegraded":"2024-09-14T13:00:18.909877+0000","last_fullsized":"2024-09-14T13:00:18.909877+0000","mapping_epoch":34,"log_start":"267'100","ondisk_log_start":"267'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:08:30.789404+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:08:30.789404+0000","last_clean_scrub_stamp":"2024-09-14T11:08:30.789404+0000","objects_scrubbed":0,"log_size":73,"log_dups_size":100,"ondisk_log_size":73,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:44:11.300438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":257,"num_read_kb":254,"num_write":377,"num_write_kb":108,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"267'371","reported_seq":1937,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:58:55.756948+0000","last_change":"2024-09-14T11:08:23.804035+0000","last_active":"2024-09-14T12:58:55.756948+0000","last_peered":"2024-09-14T12:58:55.756948+0000","last_clean":"2024-09-14T12:58:55.756948+0000","last_became_active":"2024-09-14T11:08:23.803793+0000","last_became_peered":"2024-09-14T11:08:23.803793+0000","last_unstale":"2024-09-14T12:58:55.756948+0000","last_undegraded":"2024-09-14T12:58:55.756948+0000","last_fullsized":"2024-09-14T12:58:55.756948+0000","mapping_epoch":26,"log_start":"267'300","ondisk_log_start":"267'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:08:22.750609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:08:22.750609+0000","last_clean_scrub_stamp":"2024-09-14T11:08:22.750609+0000","objects_scrubbed":0,"log_size":71,"log_dups_size":300,"ondisk_log_size":71,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:22:29.624328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":2158,"num_read_kb":2067,"num_write":426,"num_write_kb":77,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"267'203","reported_seq":853,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:00.357984+0000","last_change":"2024-09-14T11:08:21.797622+0000","last_active":"2024-09-14T13:02:00.357984+0000","last_peered":"2024-09-14T13:02:00.357984+0000","last_clean":"2024-09-14T13:02:00.357984+0000","last_became_active":"2024-09-14T11:08:21.796544+0000","last_became_peered":"2024-09-14T11:08:21.796544+0000","last_unstale":"2024-09-14T13:02:00.357984+0000","last_undegraded":"2024-09-14T13:02:00.357984+0000","last_fullsized":"2024-09-14T13:02:00.357984+0000","mapping_epoch":24,"log_start":"267'100","ondisk_log_start":"267'100","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:08:20.733145+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:08:20.733145+0000","last_clean_scrub_stamp":"2024-09-14T11:08:20.733145+0000","objects_scrubbed":0,"log_size":103,"log_dups_size":100,"ondisk_log_size":103,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:27:03.875493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":13,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":507,"num_read_kb":19523,"num_write":848,"num_write_kb":34711,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,1],"acting":[5,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":528,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:58:07.825909+0000","last_change":"2024-09-14T11:08:25.812807+0000","last_active":"2024-09-14T12:58:07.825909+0000","last_peered":"2024-09-14T12:58:07.825909+0000","last_clean":"2024-09-14T12:58:07.825909+0000","last_became_active":"2024-09-14T11:08:25.812065+0000","last_became_peered":"2024-09-14T11:08:25.812065+0000","last_unstale":"2024-09-14T12:58:07.825909+0000","last_undegraded":"2024-09-14T12:58:07.825909+0000","last_fullsized":"2024-09-14T12:58:07.825909+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:08:24.757170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:08:24.757170+0000","last_clean_scrub_stamp":"2024-09-14T11:08:24.757170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:55:26.884251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.13","version":"267'225","reported_seq":873,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:00.461643+0000","last_change":"2024-09-14T11:08:27.804649+0000","last_active":"2024-09-14T13:02:00.461643+0000","last_peered":"2024-09-14T13:02:00.461643+0000","last_clean":"2024-09-14T13:02:00.461643+0000","last_became_active":"2024-09-14T11:08:27.803857+0000","last_became_peered":"2024-09-14T11:08:27.803857+0000","last_unstale":"2024-09-14T13:02:00.461643+0000","last_undegraded":"2024-09-14T13:02:00.461643+0000","last_fullsized":"2024-09-14T13:02:00.461643+0000","mapping_epoch":30,"log_start":"267'200","ondisk_log_start":"267'200","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:08:26.771628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:08:26.771628+0000","last_clean_scrub_stamp":"2024-09-14T11:08:26.771628+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":200,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:04:38.254088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":20297,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":321,"num_read_kb":447,"num_write":190,"num_write_kb":46,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":518,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:58:13.419845+0000","last_change":"2024-09-14T11:08:29.831255+0000","last_active":"2024-09-14T12:58:13.419845+0000","last_peered":"2024-09-14T12:58:13.419845+0000","last_clean":"2024-09-14T12:58:13.419845+0000","last_became_active":"2024-09-14T11:08:29.830498+0000","last_became_peered":"2024-09-14T11:08:29.830498+0000","last_unstale":"2024-09-14T12:58:13.419845+0000","last_undegraded":"2024-09-14T12:58:13.419845+0000","last_fullsized":"2024-09-14T12:58:13.419845+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:08:28.783586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:08:28.783586+0000","last_clean_scrub_stamp":"2024-09-14T11:08:28.783586+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:03:30.379314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.1c","version":"267'123","reported_seq":663,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:00:18.860887+0000","last_change":"2024-09-14T11:08:31.830626+0000","last_active":"2024-09-14T13:00:18.860887+0000","last_peered":"2024-09-14T13:00:18.860887+0000","last_clean":"2024-09-14T13:00:18.860887+0000","last_became_active":"2024-09-14T11:08:31.829826+0000","last_became_peered":"2024-09-14T11:08:31.829826+0000","last_unstale":"2024-09-14T13:00:18.860887+0000","last_undegraded":"2024-09-14T13:00:18.860887+0000","last_fullsized":"2024-09-14T13:00:18.860887+0000","mapping_epoch":34,"log_start":"267'100","ondisk_log_start":"267'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:08:30.789404+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:08:30.789404+0000","last_clean_scrub_stamp":"2024-09-14T11:08:30.789404+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":100,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:25:54.911452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":861,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":146,"num_read_kb":140,"num_write":284,"num_write_kb":67,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"267'865","reported_seq":2531,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:59:18.397352+0000","last_change":"2024-09-14T11:08:23.781946+0000","last_active":"2024-09-14T12:59:18.397352+0000","last_peered":"2024-09-14T12:59:18.397352+0000","last_clean":"2024-09-14T12:59:18.397352+0000","last_became_active":"2024-09-14T11:08:23.781565+0000","last_became_peered":"2024-09-14T11:08:23.781565+0000","last_unstale":"2024-09-14T12:59:18.397352+0000","last_undegraded":"2024-09-14T12:59:18.397352+0000","last_fullsized":"2024-09-14T12:59:18.397352+0000","mapping_epoch":26,"log_start":"267'800","ondisk_log_start":"267'800","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:08:22.750609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:08:22.750609+0000","last_clean_scrub_stamp":"2024-09-14T11:08:22.750609+0000","objects_scrubbed":0,"log_size":65,"log_dups_size":800,"ondisk_log_size":65,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:59:20.533859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":4353,"num_read_kb":3923,"num_write":1159,"num_write_kb":442,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"267'273","reported_seq":950,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:00.143362+0000","last_change":"2024-09-14T11:08:21.781005+0000","last_active":"2024-09-14T13:02:00.143362+0000","last_peered":"2024-09-14T13:02:00.143362+0000","last_clean":"2024-09-14T13:02:00.143362+0000","last_became_active":"2024-09-14T11:08:21.780624+0000","last_became_peered":"2024-09-14T11:08:21.780624+0000","last_unstale":"2024-09-14T13:02:00.143362+0000","last_undegraded":"2024-09-14T13:02:00.143362+0000","last_fullsized":"2024-09-14T13:02:00.143362+0000","mapping_epoch":24,"log_start":"267'200","ondisk_log_start":"267'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:08:20.733145+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:08:20.733145+0000","last_clean_scrub_stamp":"2024-09-14T11:08:20.733145+0000","objects_scrubbed":0,"log_size":73,"log_dups_size":200,"ondisk_log_size":73,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:08:38.775663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":15,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":687,"num_read_kb":19614,"num_write":1225,"num_write_kb":48256,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,3],"acting":[0,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":526,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:58:08.418774+0000","last_change":"2024-09-14T11:08:25.815688+0000","last_active":"2024-09-14T12:58:08.418774+0000","last_peered":"2024-09-14T12:58:08.418774+0000","last_clean":"2024-09-14T12:58:08.418774+0000","last_became_active":"2024-09-14T11:08:25.812705+0000","last_became_peered":"2024-09-14T11:08:25.812705+0000","last_unstale":"2024-09-14T12:58:08.418774+0000","last_undegraded":"2024-09-14T12:58:08.418774+0000","last_fullsized":"2024-09-14T12:58:08.418774+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:08:24.757170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:08:24.757170+0000","last_clean_scrub_stamp":"2024-09-14T11:08:24.757170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:14:07.091473+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.12","version":"267'169","reported_seq":790,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:00.421357+0000","last_change":"2024-09-14T11:08:27.828831+0000","last_active":"2024-09-14T13:02:00.421357+0000","last_peered":"2024-09-14T13:02:00.421357+0000","last_clean":"2024-09-14T13:02:00.421357+0000","last_became_active":"2024-09-14T11:08:27.828095+0000","last_became_peered":"2024-09-14T11:08:27.828095+0000","last_unstale":"2024-09-14T13:02:00.421357+0000","last_undegraded":"2024-09-14T13:02:00.421357+0000","last_fullsized":"2024-09-14T13:02:00.421357+0000","mapping_epoch":30,"log_start":"267'100","ondisk_log_start":"267'100","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:08:26.771628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:08:26.771628+0000","last_clean_scrub_stamp":"2024-09-14T11:08:26.771628+0000","objects_scrubbed":0,"log_size":69,"log_dups_size":100,"ondisk_log_size":69,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:20:07.611701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8744,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":225,"num_read_kb":285,"num_write":126,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":524,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:58:13.451397+0000","last_change":"2024-09-14T11:08:29.820892+0000","last_active":"2024-09-14T12:58:13.451397+0000","last_peered":"2024-09-14T12:58:13.451397+0000","last_clean":"2024-09-14T12:58:13.451397+0000","last_became_active":"2024-09-14T11:08:29.820211+0000","last_became_peered":"2024-09-14T11:08:29.820211+0000","last_unstale":"2024-09-14T12:58:13.451397+0000","last_undegraded":"2024-09-14T12:58:13.451397+0000","last_fullsized":"2024-09-14T12:58:13.451397+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:08:28.783586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:08:28.783586+0000","last_clean_scrub_stamp":"2024-09-14T11:08:28.783586+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:44:35.393022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"267'407","reported_seq":1915,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:58:53.428747+0000","last_change":"2024-09-14T11:08:23.812883+0000","last_active":"2024-09-14T12:58:53.428747+0000","last_peered":"2024-09-14T12:58:53.428747+0000","last_clean":"2024-09-14T12:58:53.428747+0000","last_became_active":"2024-09-14T11:08:23.812148+0000","last_became_peered":"2024-09-14T11:08:23.812148+0000","last_unstale":"2024-09-14T12:58:53.428747+0000","last_undegraded":"2024-09-14T12:58:53.428747+0000","last_fullsized":"2024-09-14T12:58:53.428747+0000","mapping_epoch":26,"log_start":"267'300","ondisk_log_start":"267'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:08:22.750609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:08:22.750609+0000","last_clean_scrub_stamp":"2024-09-14T11:08:22.750609+0000","objects_scrubbed":0,"log_size":107,"log_dups_size":300,"ondisk_log_size":107,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:08:40.793127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2189,"num_read_kb":2068,"num_write":470,"num_write_kb":97,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"267'247","reported_seq":1143,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:00.181172+0000","last_change":"2024-09-14T11:08:21.779317+0000","last_active":"2024-09-14T13:02:00.181172+0000","last_peered":"2024-09-14T13:02:00.181172+0000","last_clean":"2024-09-14T13:02:00.181172+0000","last_became_active":"2024-09-14T11:08:21.778733+0000","last_became_peered":"2024-09-14T11:08:21.778733+0000","last_unstale":"2024-09-14T13:02:00.181172+0000","last_undegraded":"2024-09-14T13:02:00.181172+0000","last_fullsized":"2024-09-14T13:02:00.181172+0000","mapping_epoch":24,"log_start":"267'200","ondisk_log_start":"267'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:08:20.733145+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:08:20.733145+0000","last_clean_scrub_stamp":"2024-09-14T11:08:20.733145+0000","objects_scrubbed":0,"log_size":47,"log_dups_size":200,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:00:30.423894+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1357,"num_read_kb":10917,"num_write":1157,"num_write_kb":41642,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":540,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:58:53.242713+0000","last_change":"2024-09-14T11:08:25.800737+0000","last_active":"2024-09-14T12:58:53.242713+0000","last_peered":"2024-09-14T12:58:53.242713+0000","last_clean":"2024-09-14T12:58:53.242713+0000","last_became_active":"2024-09-14T11:08:25.799108+0000","last_became_peered":"2024-09-14T11:08:25.799108+0000","last_unstale":"2024-09-14T12:58:53.242713+0000","last_undegraded":"2024-09-14T12:58:53.242713+0000","last_fullsized":"2024-09-14T12:58:53.242713+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:08:24.757170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:08:24.757170+0000","last_clean_scrub_stamp":"2024-09-14T11:08:24.757170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:38:33.841462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1d","version":"267'252","reported_seq":927,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:00.409214+0000","last_change":"2024-09-14T11:08:27.831458+0000","last_active":"2024-09-14T13:02:00.409214+0000","last_peered":"2024-09-14T13:02:00.409214+0000","last_clean":"2024-09-14T13:02:00.409214+0000","last_became_active":"2024-09-14T11:08:27.830985+0000","last_became_peered":"2024-09-14T11:08:27.830985+0000","last_unstale":"2024-09-14T13:02:00.409214+0000","last_undegraded":"2024-09-14T13:02:00.409214+0000","last_fullsized":"2024-09-14T13:02:00.409214+0000","mapping_epoch":30,"log_start":"267'200","ondisk_log_start":"267'200","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:08:26.771628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:08:26.771628+0000","last_clean_scrub_stamp":"2024-09-14T11:08:26.771628+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":200,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:41:33.796426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":23445,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":387,"num_read_kb":588,"num_write":256,"num_write_kb":158,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":516,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:58:33.042183+0000","last_change":"2024-09-14T11:08:29.835460+0000","last_active":"2024-09-14T12:58:33.042183+0000","last_peered":"2024-09-14T12:58:33.042183+0000","last_clean":"2024-09-14T12:58:33.042183+0000","last_became_active":"2024-09-14T11:08:29.834723+0000","last_became_peered":"2024-09-14T11:08:29.834723+0000","last_unstale":"2024-09-14T12:58:33.042183+0000","last_undegraded":"2024-09-14T12:58:33.042183+0000","last_fullsized":"2024-09-14T12:58:33.042183+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:08:28.783586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:08:28.783586+0000","last_clean_scrub_stamp":"2024-09-14T11:08:28.783586+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:14:47.793017+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.13","version":"267'169","reported_seq":705,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:00:21.576865+0000","last_change":"2024-09-14T11:08:31.838236+0000","last_active":"2024-09-14T13:00:21.576865+0000","last_peered":"2024-09-14T13:00:21.576865+0000","last_clean":"2024-09-14T13:00:21.576865+0000","last_became_active":"2024-09-14T11:08:31.832337+0000","last_became_peered":"2024-09-14T11:08:31.832337+0000","last_unstale":"2024-09-14T13:00:21.576865+0000","last_undegraded":"2024-09-14T13:00:21.576865+0000","last_fullsized":"2024-09-14T13:00:21.576865+0000","mapping_epoch":34,"log_start":"267'100","ondisk_log_start":"267'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:08:30.789404+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:08:30.789404+0000","last_clean_scrub_stamp":"2024-09-14T11:08:30.789404+0000","objects_scrubbed":0,"log_size":69,"log_dups_size":100,"ondisk_log_size":69,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:59:18.877729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":643,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":222,"num_read_kb":226,"num_write":392,"num_write_kb":102,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"267'412","reported_seq":2030,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:00:18.882268+0000","last_change":"2024-09-14T11:08:23.800932+0000","last_active":"2024-09-14T13:00:18.882268+0000","last_peered":"2024-09-14T13:00:18.882268+0000","last_clean":"2024-09-14T13:00:18.882268+0000","last_became_active":"2024-09-14T11:08:23.800615+0000","last_became_peered":"2024-09-14T11:08:23.800615+0000","last_unstale":"2024-09-14T13:00:18.882268+0000","last_undegraded":"2024-09-14T13:00:18.882268+0000","last_fullsized":"2024-09-14T13:00:18.882268+0000","mapping_epoch":26,"log_start":"267'400","ondisk_log_start":"267'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:08:22.750609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:08:22.750609+0000","last_clean_scrub_stamp":"2024-09-14T11:08:22.750609+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":400,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:50:24.635644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2239,"num_read_kb":2142,"num_write":466,"num_write_kb":81,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"267'242","reported_seq":920,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:00.341571+0000","last_change":"2024-09-14T11:08:56.037070+0000","last_active":"2024-09-14T13:02:00.341571+0000","last_peered":"2024-09-14T13:02:00.341571+0000","last_clean":"2024-09-14T13:02:00.341571+0000","last_became_active":"2024-09-14T11:08:56.036673+0000","last_became_peered":"2024-09-14T11:08:56.036673+0000","last_unstale":"2024-09-14T13:02:00.341571+0000","last_undegraded":"2024-09-14T13:02:00.341571+0000","last_fullsized":"2024-09-14T13:02:00.341571+0000","mapping_epoch":37,"log_start":"267'200","ondisk_log_start":"267'200","created":24,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:08:20.733145+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:08:20.733145+0000","last_clean_scrub_stamp":"2024-09-14T11:08:20.733145+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":200,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:53:45.772203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":60,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":566,"num_read_kb":38876,"num_write":1051,"num_write_kb":52722,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,4],"acting":[1,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1f","version":"36'3","reported_seq":1009,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:01:59.390201+0000","last_change":"2024-09-14T11:08:25.812880+0000","last_active":"2024-09-14T13:01:59.390201+0000","last_peered":"2024-09-14T13:01:59.390201+0000","last_clean":"2024-09-14T13:01:59.390201+0000","last_became_active":"2024-09-14T11:08:25.812070+0000","last_became_peered":"2024-09-14T11:08:25.812070+0000","last_unstale":"2024-09-14T13:01:59.390201+0000","last_undegraded":"2024-09-14T13:01:59.390201+0000","last_fullsized":"2024-09-14T13:01:59.390201+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:08:24.757170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:08:24.757170+0000","last_clean_scrub_stamp":"2024-09-14T11:08:24.757170+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:17:44.680400+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":470,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":719,"num_read_kb":717,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1c","version":"267'282","reported_seq":936,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:00.428365+0000","last_change":"2024-09-14T11:08:27.839908+0000","last_active":"2024-09-14T13:02:00.428365+0000","last_peered":"2024-09-14T13:02:00.428365+0000","last_clean":"2024-09-14T13:02:00.428365+0000","last_became_active":"2024-09-14T11:08:27.839087+0000","last_became_peered":"2024-09-14T11:08:27.839087+0000","last_unstale":"2024-09-14T13:02:00.428365+0000","last_undegraded":"2024-09-14T13:02:00.428365+0000","last_fullsized":"2024-09-14T13:02:00.428365+0000","mapping_epoch":30,"log_start":"267'200","ondisk_log_start":"267'200","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:08:26.771628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:08:26.771628+0000","last_clean_scrub_stamp":"2024-09-14T11:08:26.771628+0000","objects_scrubbed":0,"log_size":82,"log_dups_size":200,"ondisk_log_size":82,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:00:36.558492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":105157,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":431,"num_read_kb":790,"num_write":316,"num_write_kb":215,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":514,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:58:33.459006+0000","last_change":"2024-09-14T11:08:29.829340+0000","last_active":"2024-09-14T12:58:33.459006+0000","last_peered":"2024-09-14T12:58:33.459006+0000","last_clean":"2024-09-14T12:58:33.459006+0000","last_became_active":"2024-09-14T11:08:29.828451+0000","last_became_peered":"2024-09-14T11:08:29.828451+0000","last_unstale":"2024-09-14T12:58:33.459006+0000","last_undegraded":"2024-09-14T12:58:33.459006+0000","last_fullsized":"2024-09-14T12:58:33.459006+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:08:28.783586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:08:28.783586+0000","last_clean_scrub_stamp":"2024-09-14T11:08:28.783586+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:33:41.255469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.12","version":"267'201","reported_seq":1100,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:00:21.559424+0000","last_change":"2024-09-14T11:08:31.855543+0000","last_active":"2024-09-14T13:00:21.559424+0000","last_peered":"2024-09-14T13:00:21.559424+0000","last_clean":"2024-09-14T13:00:21.559424+0000","last_became_active":"2024-09-14T11:08:31.854650+0000","last_became_peered":"2024-09-14T11:08:31.854650+0000","last_unstale":"2024-09-14T13:00:21.559424+0000","last_undegraded":"2024-09-14T13:00:21.559424+0000","last_fullsized":"2024-09-14T13:00:21.559424+0000","mapping_epoch":34,"log_start":"267'100","ondisk_log_start":"267'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:08:30.789404+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:08:30.789404+0000","last_clean_scrub_stamp":"2024-09-14T11:08:30.789404+0000","objects_scrubbed":0,"log_size":101,"log_dups_size":100,"ondisk_log_size":101,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:48:10.230125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1218,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":620,"num_read_kb":614,"num_write":555,"num_write_kb":141,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1d","version":"267'642","reported_seq":2438,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:00:21.249855+0000","last_change":"2024-09-14T11:08:23.779484+0000","last_active":"2024-09-14T13:00:21.249855+0000","last_peered":"2024-09-14T13:00:21.249855+0000","last_clean":"2024-09-14T13:00:21.249855+0000","last_became_active":"2024-09-14T11:08:23.779099+0000","last_became_peered":"2024-09-14T11:08:23.779099+0000","last_unstale":"2024-09-14T13:00:21.249855+0000","last_undegraded":"2024-09-14T13:00:21.249855+0000","last_fullsized":"2024-09-14T13:00:21.249855+0000","mapping_epoch":26,"log_start":"267'600","ondisk_log_start":"267'600","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:08:22.750609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:08:22.750609+0000","last_clean_scrub_stamp":"2024-09-14T11:08:22.750609+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":600,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:46:50.857933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3438,"num_read_kb":3161,"num_write":830,"num_write_kb":293,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"267'251","reported_seq":1031,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:00.414172+0000","last_change":"2024-09-14T11:08:21.824714+0000","last_active":"2024-09-14T13:02:00.414172+0000","last_peered":"2024-09-14T13:02:00.414172+0000","last_clean":"2024-09-14T13:02:00.414172+0000","last_became_active":"2024-09-14T11:08:21.822349+0000","last_became_peered":"2024-09-14T11:08:21.822349+0000","last_unstale":"2024-09-14T13:02:00.414172+0000","last_undegraded":"2024-09-14T13:02:00.414172+0000","last_fullsized":"2024-09-14T13:02:00.414172+0000","mapping_epoch":24,"log_start":"267'200","ondisk_log_start":"267'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:08:20.733145+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:08:20.733145+0000","last_clean_scrub_stamp":"2024-09-14T11:08:20.733145+0000","objects_scrubbed":0,"log_size":51,"log_dups_size":200,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:37:27.709472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1655848,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1337,"num_read_kb":40987,"num_write":1078,"num_write_kb":33045,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,5],"acting":[4,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":526,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:58:28.225640+0000","last_change":"2024-09-14T11:08:25.808861+0000","last_active":"2024-09-14T12:58:28.225640+0000","last_peered":"2024-09-14T12:58:28.225640+0000","last_clean":"2024-09-14T12:58:28.225640+0000","last_became_active":"2024-09-14T11:08:25.807820+0000","last_became_peered":"2024-09-14T11:08:25.807820+0000","last_unstale":"2024-09-14T12:58:28.225640+0000","last_undegraded":"2024-09-14T12:58:28.225640+0000","last_fullsized":"2024-09-14T12:58:28.225640+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:08:24.757170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:08:24.757170+0000","last_clean_scrub_stamp":"2024-09-14T11:08:24.757170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:21:06.537600+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1f","version":"267'201","reported_seq":840,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:00.222727+0000","last_change":"2024-09-14T11:08:27.799774+0000","last_active":"2024-09-14T13:02:00.222727+0000","last_peered":"2024-09-14T13:02:00.222727+0000","last_clean":"2024-09-14T13:02:00.222727+0000","last_became_active":"2024-09-14T11:08:27.799019+0000","last_became_peered":"2024-09-14T11:08:27.799019+0000","last_unstale":"2024-09-14T13:02:00.222727+0000","last_undegraded":"2024-09-14T13:02:00.222727+0000","last_fullsized":"2024-09-14T13:02:00.222727+0000","mapping_epoch":30,"log_start":"264'100","ondisk_log_start":"264'100","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:08:26.771628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:08:26.771628+0000","last_clean_scrub_stamp":"2024-09-14T11:08:26.771628+0000","objects_scrubbed":0,"log_size":101,"log_dups_size":100,"ondisk_log_size":101,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:29:21.400017+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":11376,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":267,"num_read_kb":349,"num_write":156,"num_write_kb":26,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":525,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:58:48.462484+0000","last_change":"2024-09-14T11:08:29.821376+0000","last_active":"2024-09-14T12:58:48.462484+0000","last_peered":"2024-09-14T12:58:48.462484+0000","last_clean":"2024-09-14T12:58:48.462484+0000","last_became_active":"2024-09-14T11:08:29.820658+0000","last_became_peered":"2024-09-14T11:08:29.820658+0000","last_unstale":"2024-09-14T12:58:48.462484+0000","last_undegraded":"2024-09-14T12:58:48.462484+0000","last_fullsized":"2024-09-14T12:58:48.462484+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:08:28.783586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:08:28.783586+0000","last_clean_scrub_stamp":"2024-09-14T11:08:28.783586+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:41:05.714746+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.11","version":"267'134","reported_seq":664,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:01:40.625798+0000","last_change":"2024-09-14T11:08:31.837211+0000","last_active":"2024-09-14T13:01:40.625798+0000","last_peered":"2024-09-14T13:01:40.625798+0000","last_clean":"2024-09-14T13:01:40.625798+0000","last_became_active":"2024-09-14T11:08:31.836424+0000","last_became_peered":"2024-09-14T11:08:31.836424+0000","last_unstale":"2024-09-14T13:01:40.625798+0000","last_undegraded":"2024-09-14T13:01:40.625798+0000","last_fullsized":"2024-09-14T13:01:40.625798+0000","mapping_epoch":34,"log_start":"267'100","ondisk_log_start":"267'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:08:30.789404+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:08:30.789404+0000","last_clean_scrub_stamp":"2024-09-14T11:08:30.789404+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":100,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:24:20.926458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":383,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":163,"num_read_kb":148,"num_write":342,"num_write_kb":82,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1c","version":"267'437","reported_seq":2094,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:00:21.259107+0000","last_change":"2024-09-14T11:08:23.775989+0000","last_active":"2024-09-14T13:00:21.259107+0000","last_peered":"2024-09-14T13:00:21.259107+0000","last_clean":"2024-09-14T13:00:21.259107+0000","last_became_active":"2024-09-14T11:08:23.775491+0000","last_became_peered":"2024-09-14T11:08:23.775491+0000","last_unstale":"2024-09-14T13:00:21.259107+0000","last_undegraded":"2024-09-14T13:00:21.259107+0000","last_fullsized":"2024-09-14T13:00:21.259107+0000","mapping_epoch":26,"log_start":"267'400","ondisk_log_start":"267'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:08:22.750609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:08:22.750609+0000","last_clean_scrub_stamp":"2024-09-14T11:08:22.750609+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":400,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:48:28.960871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2479,"num_read_kb":2350,"num_write":502,"num_write_kb":107,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"267'223","reported_seq":850,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:00.290466+0000","last_change":"2024-09-14T11:08:56.034799+0000","last_active":"2024-09-14T13:02:00.290466+0000","last_peered":"2024-09-14T13:02:00.290466+0000","last_clean":"2024-09-14T13:02:00.290466+0000","last_became_active":"2024-09-14T11:08:56.033894+0000","last_became_peered":"2024-09-14T11:08:56.033894+0000","last_unstale":"2024-09-14T13:02:00.290466+0000","last_undegraded":"2024-09-14T13:02:00.290466+0000","last_fullsized":"2024-09-14T13:02:00.290466+0000","mapping_epoch":37,"log_start":"267'200","ondisk_log_start":"267'200","created":24,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:08:20.733145+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:08:20.733145+0000","last_clean_scrub_stamp":"2024-09-14T11:08:20.733145+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":200,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:50:48.318805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":541,"num_read_kb":17888,"num_write":1023,"num_write_kb":32755,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4,7],"acting":[2,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":521,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:58:28.457976+0000","last_change":"2024-09-14T11:08:25.804776+0000","last_active":"2024-09-14T12:58:28.457976+0000","last_peered":"2024-09-14T12:58:28.457976+0000","last_clean":"2024-09-14T12:58:28.457976+0000","last_became_active":"2024-09-14T11:08:25.804388+0000","last_became_peered":"2024-09-14T11:08:25.804388+0000","last_unstale":"2024-09-14T12:58:28.457976+0000","last_undegraded":"2024-09-14T12:58:28.457976+0000","last_fullsized":"2024-09-14T12:58:28.457976+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:08:24.757170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:08:24.757170+0000","last_clean_scrub_stamp":"2024-09-14T11:08:24.757170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:03:59.400683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1e","version":"267'168","reported_seq":761,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:59:08.616998+0000","last_change":"2024-09-14T11:08:27.832039+0000","last_active":"2024-09-14T12:59:08.616998+0000","last_peered":"2024-09-14T12:59:08.616998+0000","last_clean":"2024-09-14T12:59:08.616998+0000","last_became_active":"2024-09-14T11:08:27.830708+0000","last_became_peered":"2024-09-14T11:08:27.830708+0000","last_unstale":"2024-09-14T12:59:08.616998+0000","last_undegraded":"2024-09-14T12:59:08.616998+0000","last_fullsized":"2024-09-14T12:59:08.616998+0000","mapping_epoch":30,"log_start":"267'100","ondisk_log_start":"267'100","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:08:26.771628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:08:26.771628+0000","last_clean_scrub_stamp":"2024-09-14T11:08:26.771628+0000","objects_scrubbed":0,"log_size":68,"log_dups_size":100,"ondisk_log_size":68,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:26:51.532445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":224,"num_read_kb":219,"num_write":208,"num_write_kb":88,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1f","version":"267'769","reported_seq":3157,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:01:59.853910+0000","last_change":"2024-09-14T11:08:29.842740+0000","last_active":"2024-09-14T13:01:59.853910+0000","last_peered":"2024-09-14T13:01:59.853910+0000","last_clean":"2024-09-14T13:01:59.853910+0000","last_became_active":"2024-09-14T11:08:29.840179+0000","last_became_peered":"2024-09-14T11:08:29.840179+0000","last_unstale":"2024-09-14T13:01:59.853910+0000","last_undegraded":"2024-09-14T13:01:59.853910+0000","last_fullsized":"2024-09-14T13:01:59.853910+0000","mapping_epoch":32,"log_start":"267'701","ondisk_log_start":"267'701","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:08:28.783586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:08:28.783586+0000","last_clean_scrub_stamp":"2024-09-14T11:08:28.783586+0000","objects_scrubbed":0,"log_size":68,"log_dups_size":701,"ondisk_log_size":68,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:13:51.334108+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.10","version":"267'110","reported_seq":636,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:00:11.280385+0000","last_change":"2024-09-14T11:08:31.839459+0000","last_active":"2024-09-14T13:00:11.280385+0000","last_peered":"2024-09-14T13:00:11.280385+0000","last_clean":"2024-09-14T13:00:11.280385+0000","last_became_active":"2024-09-14T11:08:31.838761+0000","last_became_peered":"2024-09-14T11:08:31.838761+0000","last_unstale":"2024-09-14T13:00:11.280385+0000","last_undegraded":"2024-09-14T13:00:11.280385+0000","last_fullsized":"2024-09-14T13:00:11.280385+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:08:30.789404+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:08:30.789404+0000","last_clean_scrub_stamp":"2024-09-14T11:08:30.789404+0000","objects_scrubbed":0,"log_size":110,"log_dups_size":0,"ondisk_log_size":110,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:37:29.125988+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":418,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":108,"num_read_kb":106,"num_write":270,"num_write_kb":60,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1b","version":"267'384","reported_seq":1848,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:00:21.253052+0000","last_change":"2024-09-14T11:08:23.793363+0000","last_active":"2024-09-14T13:00:21.253052+0000","last_peered":"2024-09-14T13:00:21.253052+0000","last_clean":"2024-09-14T13:00:21.253052+0000","last_became_active":"2024-09-14T11:08:23.791753+0000","last_became_peered":"2024-09-14T11:08:23.791753+0000","last_unstale":"2024-09-14T13:00:21.253052+0000","last_undegraded":"2024-09-14T13:00:21.253052+0000","last_fullsized":"2024-09-14T13:00:21.253052+0000","mapping_epoch":26,"log_start":"267'300","ondisk_log_start":"267'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:08:22.750609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:08:22.750609+0000","last_clean_scrub_stamp":"2024-09-14T11:08:22.750609+0000","objects_scrubbed":0,"log_size":84,"log_dups_size":300,"ondisk_log_size":84,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:05:59.318543+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2049,"num_read_kb":1937,"num_write":432,"num_write_kb":84,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1c","version":"267'213","reported_seq":869,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:00.456288+0000","last_change":"2024-09-14T11:08:21.826647+0000","last_active":"2024-09-14T13:02:00.456288+0000","last_peered":"2024-09-14T13:02:00.456288+0000","last_clean":"2024-09-14T13:02:00.456288+0000","last_became_active":"2024-09-14T11:08:21.825881+0000","last_became_peered":"2024-09-14T11:08:21.825881+0000","last_unstale":"2024-09-14T13:02:00.456288+0000","last_undegraded":"2024-09-14T13:02:00.456288+0000","last_fullsized":"2024-09-14T13:02:00.456288+0000","mapping_epoch":24,"log_start":"267'200","ondisk_log_start":"267'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:08:20.733145+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:08:20.733145+0000","last_clean_scrub_stamp":"2024-09-14T11:08:20.733145+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":200,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:50:22.513817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1655822,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":555,"num_read_kb":34621,"num_write":949,"num_write_kb":21560,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":525,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:58:27.830750+0000","last_change":"2024-09-14T11:08:25.822606+0000","last_active":"2024-09-14T12:58:27.830750+0000","last_peered":"2024-09-14T12:58:27.830750+0000","last_clean":"2024-09-14T12:58:27.830750+0000","last_became_active":"2024-09-14T11:08:25.822047+0000","last_became_peered":"2024-09-14T11:08:25.822047+0000","last_unstale":"2024-09-14T12:58:27.830750+0000","last_undegraded":"2024-09-14T12:58:27.830750+0000","last_fullsized":"2024-09-14T12:58:27.830750+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:08:24.757170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:08:24.757170+0000","last_clean_scrub_stamp":"2024-09-14T11:08:24.757170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:17:43.121390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.19","version":"267'262","reported_seq":916,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:00.325275+0000","last_change":"2024-09-14T11:08:27.825245+0000","last_active":"2024-09-14T13:02:00.325275+0000","last_peered":"2024-09-14T13:02:00.325275+0000","last_clean":"2024-09-14T13:02:00.325275+0000","last_became_active":"2024-09-14T11:08:27.824464+0000","last_became_peered":"2024-09-14T11:08:27.824464+0000","last_unstale":"2024-09-14T13:02:00.325275+0000","last_undegraded":"2024-09-14T13:02:00.325275+0000","last_fullsized":"2024-09-14T13:02:00.325275+0000","mapping_epoch":30,"log_start":"267'200","ondisk_log_start":"267'200","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:08:26.771628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:08:26.771628+0000","last_clean_scrub_stamp":"2024-09-14T11:08:26.771628+0000","objects_scrubbed":0,"log_size":62,"log_dups_size":200,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:54:45.692895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12812,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":350,"num_read_kb":439,"num_write":214,"num_write_kb":32,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":522,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:57:18.438460+0000","last_change":"2024-09-14T11:08:29.823349+0000","last_active":"2024-09-14T12:57:18.438460+0000","last_peered":"2024-09-14T12:57:18.438460+0000","last_clean":"2024-09-14T12:57:18.438460+0000","last_became_active":"2024-09-14T11:08:29.822623+0000","last_became_peered":"2024-09-14T11:08:29.822623+0000","last_unstale":"2024-09-14T12:57:18.438460+0000","last_undegraded":"2024-09-14T12:57:18.438460+0000","last_fullsized":"2024-09-14T12:57:18.438460+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:08:28.783586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:08:28.783586+0000","last_clean_scrub_stamp":"2024-09-14T11:08:28.783586+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:00:40.714545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.17","version":"267'127","reported_seq":653,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:59:42.848452+0000","last_change":"2024-09-14T11:08:31.859123+0000","last_active":"2024-09-14T12:59:42.848452+0000","last_peered":"2024-09-14T12:59:42.848452+0000","last_clean":"2024-09-14T12:59:42.848452+0000","last_became_active":"2024-09-14T11:08:31.858388+0000","last_became_peered":"2024-09-14T11:08:31.858388+0000","last_unstale":"2024-09-14T12:59:42.848452+0000","last_undegraded":"2024-09-14T12:59:42.848452+0000","last_fullsized":"2024-09-14T12:59:42.848452+0000","mapping_epoch":34,"log_start":"267'100","ondisk_log_start":"267'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:08:30.789404+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:08:30.789404+0000","last_clean_scrub_stamp":"2024-09-14T11:08:30.789404+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":100,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:58:20.561191+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":200,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":125,"num_read_kb":119,"num_write":310,"num_write_kb":73,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1a","version":"267'851","reported_seq":2570,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:59:14.733144+0000","last_change":"2024-09-14T11:08:23.794792+0000","last_active":"2024-09-14T12:59:14.733144+0000","last_peered":"2024-09-14T12:59:14.733144+0000","last_clean":"2024-09-14T12:59:14.733144+0000","last_became_active":"2024-09-14T11:08:23.793908+0000","last_became_peered":"2024-09-14T11:08:23.793908+0000","last_unstale":"2024-09-14T12:59:14.733144+0000","last_undegraded":"2024-09-14T12:59:14.733144+0000","last_fullsized":"2024-09-14T12:59:14.733144+0000","mapping_epoch":26,"log_start":"267'800","ondisk_log_start":"267'800","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:08:22.750609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:08:22.750609+0000","last_clean_scrub_stamp":"2024-09-14T11:08:22.750609+0000","objects_scrubbed":0,"log_size":51,"log_dups_size":800,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:05:29.558132+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":4233,"num_read_kb":3837,"num_write":1135,"num_write_kb":419,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1d","version":"267'248","reported_seq":929,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:00.357762+0000","last_change":"2024-09-14T11:08:21.821524+0000","last_active":"2024-09-14T13:02:00.357762+0000","last_peered":"2024-09-14T13:02:00.357762+0000","last_clean":"2024-09-14T13:02:00.357762+0000","last_became_active":"2024-09-14T11:08:21.820805+0000","last_became_peered":"2024-09-14T11:08:21.820805+0000","last_unstale":"2024-09-14T13:02:00.357762+0000","last_undegraded":"2024-09-14T13:02:00.357762+0000","last_fullsized":"2024-09-14T13:02:00.357762+0000","mapping_epoch":24,"log_start":"267'200","ondisk_log_start":"267'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:08:20.733145+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:08:20.733145+0000","last_clean_scrub_stamp":"2024-09-14T11:08:20.733145+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":200,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:37:46.552173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":55,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":696,"num_read_kb":13918,"num_write":1169,"num_write_kb":29151,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":524,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:58:28.040986+0000","last_change":"2024-09-14T11:08:25.802519+0000","last_active":"2024-09-14T12:58:28.040986+0000","last_peered":"2024-09-14T12:58:28.040986+0000","last_clean":"2024-09-14T12:58:28.040986+0000","last_became_active":"2024-09-14T11:08:25.801548+0000","last_became_peered":"2024-09-14T11:08:25.801548+0000","last_unstale":"2024-09-14T12:58:28.040986+0000","last_undegraded":"2024-09-14T12:58:28.040986+0000","last_fullsized":"2024-09-14T12:58:28.040986+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:08:24.757170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:08:24.757170+0000","last_clean_scrub_stamp":"2024-09-14T11:08:24.757170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:47:07.228076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.18","version":"267'180","reported_seq":804,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:00.335791+0000","last_change":"2024-09-14T11:08:27.815657+0000","last_active":"2024-09-14T13:02:00.335791+0000","last_peered":"2024-09-14T13:02:00.335791+0000","last_clean":"2024-09-14T13:02:00.335791+0000","last_became_active":"2024-09-14T11:08:27.814938+0000","last_became_peered":"2024-09-14T11:08:27.814938+0000","last_unstale":"2024-09-14T13:02:00.335791+0000","last_undegraded":"2024-09-14T13:02:00.335791+0000","last_fullsized":"2024-09-14T13:02:00.335791+0000","mapping_epoch":30,"log_start":"264'100","ondisk_log_start":"264'100","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:08:26.771628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:08:26.771628+0000","last_clean_scrub_stamp":"2024-09-14T11:08:26.771628+0000","objects_scrubbed":0,"log_size":80,"log_dups_size":100,"ondisk_log_size":80,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:15:03.277896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":31231,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":239,"num_read_kb":376,"num_write":138,"num_write_kb":54,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":516,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:57:33.603105+0000","last_change":"2024-09-14T11:08:29.836990+0000","last_active":"2024-09-14T12:57:33.603105+0000","last_peered":"2024-09-14T12:57:33.603105+0000","last_clean":"2024-09-14T12:57:33.603105+0000","last_became_active":"2024-09-14T11:08:29.829491+0000","last_became_peered":"2024-09-14T11:08:29.829491+0000","last_unstale":"2024-09-14T12:57:33.603105+0000","last_undegraded":"2024-09-14T12:57:33.603105+0000","last_fullsized":"2024-09-14T12:57:33.603105+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:08:28.783586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:08:28.783586+0000","last_clean_scrub_stamp":"2024-09-14T11:08:28.783586+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:58:11.838583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.16","version":"267'128","reported_seq":682,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:58:21.393905+0000","last_change":"2024-09-14T11:08:31.838739+0000","last_active":"2024-09-14T12:58:21.393905+0000","last_peered":"2024-09-14T12:58:21.393905+0000","last_clean":"2024-09-14T12:58:21.393905+0000","last_became_active":"2024-09-14T11:08:31.832264+0000","last_became_peered":"2024-09-14T11:08:31.832264+0000","last_unstale":"2024-09-14T12:58:21.393905+0000","last_undegraded":"2024-09-14T12:58:21.393905+0000","last_fullsized":"2024-09-14T12:58:21.393905+0000","mapping_epoch":34,"log_start":"267'100","ondisk_log_start":"267'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:08:30.789404+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:08:30.789404+0000","last_clean_scrub_stamp":"2024-09-14T11:08:30.789404+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":100,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:40:25.298343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":539,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":196,"num_read_kb":188,"num_write":306,"num_write_kb":70,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"267'841","reported_seq":2516,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:00:18.822903+0000","last_change":"2024-09-14T11:08:23.782031+0000","last_active":"2024-09-14T13:00:18.822903+0000","last_peered":"2024-09-14T13:00:18.822903+0000","last_clean":"2024-09-14T13:00:18.822903+0000","last_became_active":"2024-09-14T11:08:23.781730+0000","last_became_peered":"2024-09-14T11:08:23.781730+0000","last_unstale":"2024-09-14T13:00:18.822903+0000","last_undegraded":"2024-09-14T13:00:18.822903+0000","last_fullsized":"2024-09-14T13:00:18.822903+0000","mapping_epoch":26,"log_start":"267'800","ondisk_log_start":"267'800","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:08:22.750609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:08:22.750609+0000","last_clean_scrub_stamp":"2024-09-14T11:08:22.750609+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":800,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:42:43.466791+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3990,"num_read_kb":3619,"num_write":1102,"num_write_kb":388,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"267'187","reported_seq":827,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:00.479213+0000","last_change":"2024-09-14T11:08:21.809882+0000","last_active":"2024-09-14T13:02:00.479213+0000","last_peered":"2024-09-14T13:02:00.479213+0000","last_clean":"2024-09-14T13:02:00.479213+0000","last_became_active":"2024-09-14T11:08:21.809457+0000","last_became_peered":"2024-09-14T11:08:21.809457+0000","last_unstale":"2024-09-14T13:02:00.479213+0000","last_undegraded":"2024-09-14T13:02:00.479213+0000","last_fullsized":"2024-09-14T13:02:00.479213+0000","mapping_epoch":24,"log_start":"267'100","ondisk_log_start":"267'100","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:08:20.733145+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:08:20.733145+0000","last_clean_scrub_stamp":"2024-09-14T11:08:20.733145+0000","objects_scrubbed":0,"log_size":87,"log_dups_size":100,"ondisk_log_size":87,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:01:09.631980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":26,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":452,"num_read_kb":5598,"num_write":898,"num_write_kb":20482,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6,7],"acting":[3,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":528,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:59:38.241230+0000","last_change":"2024-09-14T11:08:25.806603+0000","last_active":"2024-09-14T12:59:38.241230+0000","last_peered":"2024-09-14T12:59:38.241230+0000","last_clean":"2024-09-14T12:59:38.241230+0000","last_became_active":"2024-09-14T11:08:25.805777+0000","last_became_peered":"2024-09-14T11:08:25.805777+0000","last_unstale":"2024-09-14T12:59:38.241230+0000","last_undegraded":"2024-09-14T12:59:38.241230+0000","last_fullsized":"2024-09-14T12:59:38.241230+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:08:24.757170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:08:24.757170+0000","last_clean_scrub_stamp":"2024-09-14T11:08:24.757170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:54:18.701609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1b","version":"267'123","reported_seq":716,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:00.194995+0000","last_change":"2024-09-14T11:08:27.823209+0000","last_active":"2024-09-14T13:02:00.194995+0000","last_peered":"2024-09-14T13:02:00.194995+0000","last_clean":"2024-09-14T13:02:00.194995+0000","last_became_active":"2024-09-14T11:08:27.822465+0000","last_became_peered":"2024-09-14T11:08:27.822465+0000","last_unstale":"2024-09-14T13:02:00.194995+0000","last_undegraded":"2024-09-14T13:02:00.194995+0000","last_fullsized":"2024-09-14T13:02:00.194995+0000","mapping_epoch":30,"log_start":"267'100","ondisk_log_start":"267'100","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:08:26.771628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:08:26.771628+0000","last_clean_scrub_stamp":"2024-09-14T11:08:26.771628+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":100,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:13:30.608378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9872,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":162,"num_read_kb":232,"num_write":86,"num_write_kb":20,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":518,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:58:33.226817+0000","last_change":"2024-09-14T11:08:29.832131+0000","last_active":"2024-09-14T12:58:33.226817+0000","last_peered":"2024-09-14T12:58:33.226817+0000","last_clean":"2024-09-14T12:58:33.226817+0000","last_became_active":"2024-09-14T11:08:29.831394+0000","last_became_peered":"2024-09-14T11:08:29.831394+0000","last_unstale":"2024-09-14T12:58:33.226817+0000","last_undegraded":"2024-09-14T12:58:33.226817+0000","last_fullsized":"2024-09-14T12:58:33.226817+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:08:28.783586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:08:28.783586+0000","last_clean_scrub_stamp":"2024-09-14T11:08:28.783586+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:19:42.017615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.15","version":"267'186","reported_seq":1322,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:00:12.482492+0000","last_change":"2024-09-14T11:08:31.838090+0000","last_active":"2024-09-14T13:00:12.482492+0000","last_peered":"2024-09-14T13:00:12.482492+0000","last_clean":"2024-09-14T13:00:12.482492+0000","last_became_active":"2024-09-14T11:08:31.837288+0000","last_became_peered":"2024-09-14T11:08:31.837288+0000","last_unstale":"2024-09-14T13:00:12.482492+0000","last_undegraded":"2024-09-14T13:00:12.482492+0000","last_fullsized":"2024-09-14T13:00:12.482492+0000","mapping_epoch":34,"log_start":"267'100","ondisk_log_start":"267'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:08:30.789404+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:08:30.789404+0000","last_clean_scrub_stamp":"2024-09-14T11:08:30.789404+0000","objects_scrubbed":0,"log_size":86,"log_dups_size":100,"ondisk_log_size":86,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:18:38.098740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":649,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":776,"num_read_kb":767,"num_write":406,"num_write_kb":131,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.18","version":"267'750","reported_seq":2354,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:59:38.241271+0000","last_change":"2024-09-14T11:08:23.807715+0000","last_active":"2024-09-14T12:59:38.241271+0000","last_peered":"2024-09-14T12:59:38.241271+0000","last_clean":"2024-09-14T12:59:38.241271+0000","last_became_active":"2024-09-14T11:08:23.806640+0000","last_became_peered":"2024-09-14T11:08:23.806640+0000","last_unstale":"2024-09-14T12:59:38.241271+0000","last_undegraded":"2024-09-14T12:59:38.241271+0000","last_fullsized":"2024-09-14T12:59:38.241271+0000","mapping_epoch":26,"log_start":"267'700","ondisk_log_start":"267'700","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:08:22.750609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:08:22.750609+0000","last_clean_scrub_stamp":"2024-09-14T11:08:22.750609+0000","objects_scrubbed":0,"log_size":50,"log_dups_size":700,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:13:39.042733+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3938,"num_read_kb":3591,"num_write":982,"num_write_kb":355,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1f","version":"267'170","reported_seq":839,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:00.365765+0000","last_change":"2024-09-14T11:08:21.801365+0000","last_active":"2024-09-14T13:02:00.365765+0000","last_peered":"2024-09-14T13:02:00.365765+0000","last_clean":"2024-09-14T13:02:00.365765+0000","last_became_active":"2024-09-14T11:08:21.801111+0000","last_became_peered":"2024-09-14T11:08:21.801111+0000","last_unstale":"2024-09-14T13:02:00.365765+0000","last_undegraded":"2024-09-14T13:02:00.365765+0000","last_fullsized":"2024-09-14T13:02:00.365765+0000","mapping_epoch":24,"log_start":"267'100","ondisk_log_start":"267'100","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:08:20.733145+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:08:20.733145+0000","last_clean_scrub_stamp":"2024-09-14T11:08:20.733145+0000","objects_scrubbed":0,"log_size":70,"log_dups_size":100,"ondisk_log_size":70,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:46:15.553454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":26,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":489,"num_read_kb":60837,"num_write":760,"num_write_kb":39194,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,6],"acting":[0,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.19","version":"29'1","reported_seq":524,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:57:28.444602+0000","last_change":"2024-09-14T11:08:25.800454+0000","last_active":"2024-09-14T12:57:28.444602+0000","last_peered":"2024-09-14T12:57:28.444602+0000","last_clean":"2024-09-14T12:57:28.444602+0000","last_became_active":"2024-09-14T11:08:25.799872+0000","last_became_peered":"2024-09-14T11:08:25.799872+0000","last_unstale":"2024-09-14T12:57:28.444602+0000","last_undegraded":"2024-09-14T12:57:28.444602+0000","last_fullsized":"2024-09-14T12:57:28.444602+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:08:24.757170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:08:24.757170+0000","last_clean_scrub_stamp":"2024-09-14T11:08:24.757170+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:22:33.868316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1a","version":"267'188","reported_seq":823,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:00.231029+0000","last_change":"2024-09-14T11:08:27.831489+0000","last_active":"2024-09-14T13:02:00.231029+0000","last_peered":"2024-09-14T13:02:00.231029+0000","last_clean":"2024-09-14T13:02:00.231029+0000","last_became_active":"2024-09-14T11:08:27.830707+0000","last_became_peered":"2024-09-14T11:08:27.830707+0000","last_unstale":"2024-09-14T13:02:00.231029+0000","last_undegraded":"2024-09-14T13:02:00.231029+0000","last_fullsized":"2024-09-14T13:02:00.231029+0000","mapping_epoch":30,"log_start":"264'100","ondisk_log_start":"264'100","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:08:26.771628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:08:26.771628+0000","last_clean_scrub_stamp":"2024-09-14T11:08:26.771628+0000","objects_scrubbed":0,"log_size":88,"log_dups_size":100,"ondisk_log_size":88,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:02:06.941247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8430,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":268,"num_read_kb":336,"num_write":152,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":521,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:58:33.237720+0000","last_change":"2024-09-14T11:08:29.811093+0000","last_active":"2024-09-14T12:58:33.237720+0000","last_peered":"2024-09-14T12:58:33.237720+0000","last_clean":"2024-09-14T12:58:33.237720+0000","last_became_active":"2024-09-14T11:08:29.810292+0000","last_became_peered":"2024-09-14T11:08:29.810292+0000","last_unstale":"2024-09-14T12:58:33.237720+0000","last_undegraded":"2024-09-14T12:58:33.237720+0000","last_fullsized":"2024-09-14T12:58:33.237720+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:08:28.783586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:08:28.783586+0000","last_clean_scrub_stamp":"2024-09-14T11:08:28.783586+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:29:49.706509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.14","version":"267'133","reported_seq":660,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:01:39.322888+0000","last_change":"2024-09-14T11:08:31.852213+0000","last_active":"2024-09-14T13:01:39.322888+0000","last_peered":"2024-09-14T13:01:39.322888+0000","last_clean":"2024-09-14T13:01:39.322888+0000","last_became_active":"2024-09-14T11:08:31.851483+0000","last_became_peered":"2024-09-14T11:08:31.851483+0000","last_unstale":"2024-09-14T13:01:39.322888+0000","last_undegraded":"2024-09-14T13:01:39.322888+0000","last_fullsized":"2024-09-14T13:01:39.322888+0000","mapping_epoch":34,"log_start":"267'100","ondisk_log_start":"267'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:08:30.789404+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:08:30.789404+0000","last_clean_scrub_stamp":"2024-09-14T11:08:30.789404+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":100,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:20:02.893934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":227,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":142,"num_read_kb":127,"num_write":323,"num_write_kb":76,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.27","version":"267'1174","reported_seq":2953,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:58:58.464754+0000","last_change":"2024-09-14T11:08:23.798559+0000","last_active":"2024-09-14T12:58:58.464754+0000","last_peered":"2024-09-14T12:58:58.464754+0000","last_clean":"2024-09-14T12:58:58.464754+0000","last_became_active":"2024-09-14T11:08:23.798225+0000","last_became_peered":"2024-09-14T11:08:23.798225+0000","last_unstale":"2024-09-14T12:58:58.464754+0000","last_undegraded":"2024-09-14T12:58:58.464754+0000","last_fullsized":"2024-09-14T12:58:58.464754+0000","mapping_epoch":26,"log_start":"267'1100","ondisk_log_start":"267'1100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:08:22.750609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:08:22.750609+0000","last_clean_scrub_stamp":"2024-09-14T11:08:22.750609+0000","objects_scrubbed":0,"log_size":74,"log_dups_size":1100,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:51:37.923488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":5564,"num_read_kb":4974,"num_write":1578,"num_write_kb":634,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.20","version":"267'242","reported_seq":995,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:00.179359+0000","last_change":"2024-09-14T11:08:21.818419+0000","last_active":"2024-09-14T13:02:00.179359+0000","last_peered":"2024-09-14T13:02:00.179359+0000","last_clean":"2024-09-14T13:02:00.179359+0000","last_became_active":"2024-09-14T11:08:21.816270+0000","last_became_peered":"2024-09-14T11:08:21.816270+0000","last_unstale":"2024-09-14T13:02:00.179359+0000","last_undegraded":"2024-09-14T13:02:00.179359+0000","last_fullsized":"2024-09-14T13:02:00.179359+0000","mapping_epoch":24,"log_start":"267'200","ondisk_log_start":"267'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:08:20.733145+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:08:20.733145+0000","last_clean_scrub_stamp":"2024-09-14T11:08:20.733145+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":200,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:09:57.961085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":896,"num_read_kb":196583,"num_write":965,"num_write_kb":33610,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,7],"acting":[6,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.26","version":"267'1292","reported_seq":2902,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:00:11.320785+0000","last_change":"2024-09-14T11:08:23.776608+0000","last_active":"2024-09-14T13:00:11.320785+0000","last_peered":"2024-09-14T13:00:11.320785+0000","last_clean":"2024-09-14T13:00:11.320785+0000","last_became_active":"2024-09-14T11:08:23.776349+0000","last_became_peered":"2024-09-14T11:08:23.776349+0000","last_unstale":"2024-09-14T13:00:11.320785+0000","last_undegraded":"2024-09-14T13:00:11.320785+0000","last_fullsized":"2024-09-14T13:00:11.320785+0000","mapping_epoch":26,"log_start":"267'1200","ondisk_log_start":"267'1200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:08:22.750609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:08:22.750609+0000","last_clean_scrub_stamp":"2024-09-14T11:08:22.750609+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":1200,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:56:10.344959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":5862,"num_read_kb":5174,"num_write":1823,"num_write_kb":798,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.21","version":"267'158","reported_seq":796,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:58:47.825408+0000","last_change":"2024-09-14T11:08:21.779309+0000","last_active":"2024-09-14T12:58:47.825408+0000","last_peered":"2024-09-14T12:58:47.825408+0000","last_clean":"2024-09-14T12:58:47.825408+0000","last_became_active":"2024-09-14T11:08:21.778857+0000","last_became_peered":"2024-09-14T11:08:21.778857+0000","last_unstale":"2024-09-14T12:58:47.825408+0000","last_undegraded":"2024-09-14T12:58:47.825408+0000","last_fullsized":"2024-09-14T12:58:47.825408+0000","mapping_epoch":24,"log_start":"267'100","ondisk_log_start":"267'100","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:08:20.733145+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:08:20.733145+0000","last_clean_scrub_stamp":"2024-09-14T11:08:20.733145+0000","objects_scrubbed":0,"log_size":58,"log_dups_size":100,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:35:37.196078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":436,"num_read_kb":8582,"num_write":806,"num_write_kb":19268,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,6],"acting":[2,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.25","version":"267'856","reported_seq":2578,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:58:58.047892+0000","last_change":"2024-09-14T11:08:23.810261+0000","last_active":"2024-09-14T12:58:58.047892+0000","last_peered":"2024-09-14T12:58:58.047892+0000","last_clean":"2024-09-14T12:58:58.047892+0000","last_became_active":"2024-09-14T11:08:23.808906+0000","last_became_peered":"2024-09-14T11:08:23.808906+0000","last_unstale":"2024-09-14T12:58:58.047892+0000","last_undegraded":"2024-09-14T12:58:58.047892+0000","last_fullsized":"2024-09-14T12:58:58.047892+0000","mapping_epoch":26,"log_start":"267'800","ondisk_log_start":"267'800","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:08:22.750609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:08:22.750609+0000","last_clean_scrub_stamp":"2024-09-14T11:08:22.750609+0000","objects_scrubbed":0,"log_size":56,"log_dups_size":800,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:40:05.413028+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":4244,"num_read_kb":3835,"num_write":1129,"num_write_kb":418,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.22","version":"267'246","reported_seq":955,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:00.350175+0000","last_change":"2024-09-14T11:08:21.797624+0000","last_active":"2024-09-14T13:02:00.350175+0000","last_peered":"2024-09-14T13:02:00.350175+0000","last_clean":"2024-09-14T13:02:00.350175+0000","last_became_active":"2024-09-14T11:08:21.795735+0000","last_became_peered":"2024-09-14T11:08:21.795735+0000","last_unstale":"2024-09-14T13:02:00.350175+0000","last_undegraded":"2024-09-14T13:02:00.350175+0000","last_fullsized":"2024-09-14T13:02:00.350175+0000","mapping_epoch":24,"log_start":"267'200","ondisk_log_start":"267'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:08:20.733145+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:08:20.733145+0000","last_clean_scrub_stamp":"2024-09-14T11:08:20.733145+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":200,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:10:17.606566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":704,"num_read_kb":92956,"num_write":1120,"num_write_kb":50908,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,0],"acting":[5,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.24","version":"267'424","reported_seq":2053,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:58:58.464653+0000","last_change":"2024-09-14T11:08:23.801087+0000","last_active":"2024-09-14T12:58:58.464653+0000","last_peered":"2024-09-14T12:58:58.464653+0000","last_clean":"2024-09-14T12:58:58.464653+0000","last_became_active":"2024-09-14T11:08:23.800722+0000","last_became_peered":"2024-09-14T11:08:23.800722+0000","last_unstale":"2024-09-14T12:58:58.464653+0000","last_undegraded":"2024-09-14T12:58:58.464653+0000","last_fullsized":"2024-09-14T12:58:58.464653+0000","mapping_epoch":26,"log_start":"267'400","ondisk_log_start":"267'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:08:22.750609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:08:22.750609+0000","last_clean_scrub_stamp":"2024-09-14T11:08:22.750609+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":400,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:30:04.827083+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2360,"num_read_kb":2243,"num_write":502,"num_write_kb":106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.23","version":"267'220","reported_seq":894,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:00.331807+0000","last_change":"2024-09-14T11:08:21.816021+0000","last_active":"2024-09-14T13:02:00.331807+0000","last_peered":"2024-09-14T13:02:00.331807+0000","last_clean":"2024-09-14T13:02:00.331807+0000","last_became_active":"2024-09-14T11:08:21.815676+0000","last_became_peered":"2024-09-14T11:08:21.815676+0000","last_unstale":"2024-09-14T13:02:00.331807+0000","last_undegraded":"2024-09-14T13:02:00.331807+0000","last_fullsized":"2024-09-14T13:02:00.331807+0000","mapping_epoch":24,"log_start":"267'200","ondisk_log_start":"267'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:08:20.733145+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:08:20.733145+0000","last_clean_scrub_stamp":"2024-09-14T11:08:20.733145+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":200,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:59:08.982564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1655835,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":599,"num_read_kb":27875,"num_write":904,"num_write_kb":22739,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"267'894","reported_seq":2678,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:01:39.418707+0000","last_change":"2024-09-14T11:08:23.801739+0000","last_active":"2024-09-14T13:01:39.418707+0000","last_peered":"2024-09-14T13:01:39.418707+0000","last_clean":"2024-09-14T13:01:39.418707+0000","last_became_active":"2024-09-14T11:08:23.801373+0000","last_became_peered":"2024-09-14T11:08:23.801373+0000","last_unstale":"2024-09-14T13:01:39.418707+0000","last_undegraded":"2024-09-14T13:01:39.418707+0000","last_fullsized":"2024-09-14T13:01:39.418707+0000","mapping_epoch":26,"log_start":"267'800","ondisk_log_start":"267'800","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:08:22.750609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:08:22.750609+0000","last_clean_scrub_stamp":"2024-09-14T11:08:22.750609+0000","objects_scrubbed":0,"log_size":94,"log_dups_size":800,"ondisk_log_size":94,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:42:48.834357+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":4489,"num_read_kb":4053,"num_write":1182,"num_write_kb":453,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.24","version":"267'181","reported_seq":856,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:00.320888+0000","last_change":"2024-09-14T11:08:21.816168+0000","last_active":"2024-09-14T13:02:00.320888+0000","last_peered":"2024-09-14T13:02:00.320888+0000","last_clean":"2024-09-14T13:02:00.320888+0000","last_became_active":"2024-09-14T11:08:21.815768+0000","last_became_peered":"2024-09-14T11:08:21.815768+0000","last_unstale":"2024-09-14T13:02:00.320888+0000","last_undegraded":"2024-09-14T13:02:00.320888+0000","last_fullsized":"2024-09-14T13:02:00.320888+0000","mapping_epoch":24,"log_start":"267'100","ondisk_log_start":"267'100","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:08:20.733145+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:08:20.733145+0000","last_clean_scrub_stamp":"2024-09-14T11:08:20.733145+0000","objects_scrubbed":0,"log_size":81,"log_dups_size":100,"ondisk_log_size":81,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:26:06.050289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":52,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":600,"num_read_kb":27323,"num_write":897,"num_write_kb":11503,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,0],"acting":[3,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"267'441","reported_seq":1997,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:01:39.358812+0000","last_change":"2024-09-14T11:08:23.815380+0000","last_active":"2024-09-14T13:01:39.358812+0000","last_peered":"2024-09-14T13:01:39.358812+0000","last_clean":"2024-09-14T13:01:39.358812+0000","last_became_active":"2024-09-14T11:08:23.814703+0000","last_became_peered":"2024-09-14T11:08:23.814703+0000","last_unstale":"2024-09-14T13:01:39.358812+0000","last_undegraded":"2024-09-14T13:01:39.358812+0000","last_fullsized":"2024-09-14T13:01:39.358812+0000","mapping_epoch":26,"log_start":"267'400","ondisk_log_start":"267'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:08:22.750609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:08:22.750609+0000","last_clean_scrub_stamp":"2024-09-14T11:08:22.750609+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":400,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:10:53.366615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2315,"num_read_kb":2173,"num_write":509,"num_write_kb":111,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.25","version":"267'228","reported_seq":876,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:00.320453+0000","last_change":"2024-09-14T11:08:21.783168+0000","last_active":"2024-09-14T13:02:00.320453+0000","last_peered":"2024-09-14T13:02:00.320453+0000","last_clean":"2024-09-14T13:02:00.320453+0000","last_became_active":"2024-09-14T11:08:21.782389+0000","last_became_peered":"2024-09-14T11:08:21.782389+0000","last_unstale":"2024-09-14T13:02:00.320453+0000","last_undegraded":"2024-09-14T13:02:00.320453+0000","last_fullsized":"2024-09-14T13:02:00.320453+0000","mapping_epoch":24,"log_start":"267'200","ondisk_log_start":"267'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:08:20.733145+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:08:20.733145+0000","last_clean_scrub_stamp":"2024-09-14T11:08:20.733145+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":200,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:56:33.696993+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":471,"num_read_kb":9844,"num_write":870,"num_write_kb":38372,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"267'1241","reported_seq":2966,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:58:53.465249+0000","last_change":"2024-09-14T11:08:23.786227+0000","last_active":"2024-09-14T12:58:53.465249+0000","last_peered":"2024-09-14T12:58:53.465249+0000","last_clean":"2024-09-14T12:58:53.465249+0000","last_became_active":"2024-09-14T11:08:23.785820+0000","last_became_peered":"2024-09-14T11:08:23.785820+0000","last_unstale":"2024-09-14T12:58:53.465249+0000","last_undegraded":"2024-09-14T12:58:53.465249+0000","last_fullsized":"2024-09-14T12:58:53.465249+0000","mapping_epoch":26,"log_start":"267'1200","ondisk_log_start":"267'1200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:08:22.750609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:08:22.750609+0000","last_clean_scrub_stamp":"2024-09-14T11:08:22.750609+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":1200,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:03:47.638628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":5731,"num_read_kb":5079,"num_write":1712,"num_write_kb":696,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"267'214","reported_seq":930,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:00.386058+0000","last_change":"2024-09-14T11:08:21.825788+0000","last_active":"2024-09-14T13:02:00.386058+0000","last_peered":"2024-09-14T13:02:00.386058+0000","last_clean":"2024-09-14T13:02:00.386058+0000","last_became_active":"2024-09-14T11:08:21.824946+0000","last_became_peered":"2024-09-14T11:08:21.824946+0000","last_unstale":"2024-09-14T13:02:00.386058+0000","last_undegraded":"2024-09-14T13:02:00.386058+0000","last_fullsized":"2024-09-14T13:02:00.386058+0000","mapping_epoch":24,"log_start":"267'200","ondisk_log_start":"267'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:08:20.733145+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:08:20.733145+0000","last_clean_scrub_stamp":"2024-09-14T11:08:20.733145+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":200,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:23:39.096969+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1655864,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":770,"num_read_kb":179397,"num_write":979,"num_write_kb":35238,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,4],"acting":[6,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.20","version":"267'1214","reported_seq":2936,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:00:11.316393+0000","last_change":"2024-09-14T11:08:23.805571+0000","last_active":"2024-09-14T13:00:11.316393+0000","last_peered":"2024-09-14T13:00:11.316393+0000","last_clean":"2024-09-14T13:00:11.316393+0000","last_became_active":"2024-09-14T11:08:23.803960+0000","last_became_peered":"2024-09-14T11:08:23.803960+0000","last_unstale":"2024-09-14T13:00:11.316393+0000","last_undegraded":"2024-09-14T13:00:11.316393+0000","last_fullsized":"2024-09-14T13:00:11.316393+0000","mapping_epoch":26,"log_start":"267'1200","ondisk_log_start":"267'1200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:08:22.750609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:08:22.750609+0000","last_clean_scrub_stamp":"2024-09-14T11:08:22.750609+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":1200,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:56:34.285956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":5500,"num_read_kb":4892,"num_write":1634,"num_write_kb":643,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"267'220","reported_seq":871,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:00.156805+0000","last_change":"2024-09-14T11:08:56.034603+0000","last_active":"2024-09-14T13:02:00.156805+0000","last_peered":"2024-09-14T13:02:00.156805+0000","last_clean":"2024-09-14T13:02:00.156805+0000","last_became_active":"2024-09-14T11:08:56.033948+0000","last_became_peered":"2024-09-14T11:08:56.033948+0000","last_unstale":"2024-09-14T13:02:00.156805+0000","last_undegraded":"2024-09-14T13:02:00.156805+0000","last_fullsized":"2024-09-14T13:02:00.156805+0000","mapping_epoch":37,"log_start":"267'200","ondisk_log_start":"267'200","created":24,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:08:20.733145+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:08:20.733145+0000","last_clean_scrub_stamp":"2024-09-14T11:08:20.733145+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":200,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:23:47.919671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":41,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":570,"num_read_kb":57833,"num_write":1049,"num_write_kb":21583,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,2],"acting":[1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2f","version":"267'433","reported_seq":2044,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:58:21.423865+0000","last_change":"2024-09-14T11:08:23.786774+0000","last_active":"2024-09-14T12:58:21.423865+0000","last_peered":"2024-09-14T12:58:21.423865+0000","last_clean":"2024-09-14T12:58:21.423865+0000","last_became_active":"2024-09-14T11:08:23.786094+0000","last_became_peered":"2024-09-14T11:08:23.786094+0000","last_unstale":"2024-09-14T12:58:21.423865+0000","last_undegraded":"2024-09-14T12:58:21.423865+0000","last_fullsized":"2024-09-14T12:58:21.423865+0000","mapping_epoch":26,"log_start":"267'400","ondisk_log_start":"267'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:08:22.750609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:08:22.750609+0000","last_clean_scrub_stamp":"2024-09-14T11:08:22.750609+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":400,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:20:24.340919+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2284,"num_read_kb":2174,"num_write":475,"num_write_kb":81,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.28","version":"267'239","reported_seq":911,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:00.372605+0000","last_change":"2024-09-14T11:08:21.790090+0000","last_active":"2024-09-14T13:02:00.372605+0000","last_peered":"2024-09-14T13:02:00.372605+0000","last_clean":"2024-09-14T13:02:00.372605+0000","last_became_active":"2024-09-14T11:08:21.789114+0000","last_became_peered":"2024-09-14T11:08:21.789114+0000","last_unstale":"2024-09-14T13:02:00.372605+0000","last_undegraded":"2024-09-14T13:02:00.372605+0000","last_fullsized":"2024-09-14T13:02:00.372605+0000","mapping_epoch":24,"log_start":"267'200","ondisk_log_start":"267'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:08:20.733145+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:08:20.733145+0000","last_clean_scrub_stamp":"2024-09-14T11:08:20.733145+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":200,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:25:30.193731+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":15,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":593,"num_read_kb":44666,"num_write":1104,"num_write_kb":41456,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,2],"acting":[5,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2e","version":"267'451","reported_seq":2209,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:59:07.754306+0000","last_change":"2024-09-14T11:08:23.793709+0000","last_active":"2024-09-14T12:59:07.754306+0000","last_peered":"2024-09-14T12:59:07.754306+0000","last_clean":"2024-09-14T12:59:07.754306+0000","last_became_active":"2024-09-14T11:08:23.792081+0000","last_became_peered":"2024-09-14T11:08:23.792081+0000","last_unstale":"2024-09-14T12:59:07.754306+0000","last_undegraded":"2024-09-14T12:59:07.754306+0000","last_fullsized":"2024-09-14T12:59:07.754306+0000","mapping_epoch":26,"log_start":"267'400","ondisk_log_start":"267'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:08:22.750609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:08:22.750609+0000","last_clean_scrub_stamp":"2024-09-14T11:08:22.750609+0000","objects_scrubbed":0,"log_size":51,"log_dups_size":400,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:10:19.755636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2579,"num_read_kb":2481,"num_write":491,"num_write_kb":76,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.29","version":"267'201","reported_seq":897,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:00.126596+0000","last_change":"2024-09-14T11:08:56.039919+0000","last_active":"2024-09-14T13:02:00.126596+0000","last_peered":"2024-09-14T13:02:00.126596+0000","last_clean":"2024-09-14T13:02:00.126596+0000","last_became_active":"2024-09-14T11:08:56.039007+0000","last_became_peered":"2024-09-14T11:08:56.039007+0000","last_unstale":"2024-09-14T13:02:00.126596+0000","last_undegraded":"2024-09-14T13:02:00.126596+0000","last_fullsized":"2024-09-14T13:02:00.126596+0000","mapping_epoch":37,"log_start":"267'100","ondisk_log_start":"267'100","created":24,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:08:20.733145+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:08:20.733145+0000","last_clean_scrub_stamp":"2024-09-14T11:08:20.733145+0000","objects_scrubbed":0,"log_size":101,"log_dups_size":100,"ondisk_log_size":101,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:34:15.824951+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":677,"num_read_kb":34418,"num_write":912,"num_write_kb":30711,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4,1],"acting":[2,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2d","version":"267'382","reported_seq":1944,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:01:39.348450+0000","last_change":"2024-09-14T11:08:23.806935+0000","last_active":"2024-09-14T13:01:39.348450+0000","last_peered":"2024-09-14T13:01:39.348450+0000","last_clean":"2024-09-14T13:01:39.348450+0000","last_became_active":"2024-09-14T11:08:23.806568+0000","last_became_peered":"2024-09-14T11:08:23.806568+0000","last_unstale":"2024-09-14T13:01:39.348450+0000","last_undegraded":"2024-09-14T13:01:39.348450+0000","last_fullsized":"2024-09-14T13:01:39.348450+0000","mapping_epoch":26,"log_start":"267'300","ondisk_log_start":"267'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:08:22.750609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:08:22.750609+0000","last_clean_scrub_stamp":"2024-09-14T11:08:22.750609+0000","objects_scrubbed":0,"log_size":82,"log_dups_size":300,"ondisk_log_size":82,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:57:47.545139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2181,"num_read_kb":2088,"num_write":442,"num_write_kb":83,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2a","version":"267'214","reported_seq":850,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:00.359205+0000","last_change":"2024-09-14T11:08:55.884603+0000","last_active":"2024-09-14T13:02:00.359205+0000","last_peered":"2024-09-14T13:02:00.359205+0000","last_clean":"2024-09-14T13:02:00.359205+0000","last_became_active":"2024-09-14T11:08:55.882680+0000","last_became_peered":"2024-09-14T11:08:55.882680+0000","last_unstale":"2024-09-14T13:02:00.359205+0000","last_undegraded":"2024-09-14T13:02:00.359205+0000","last_fullsized":"2024-09-14T13:02:00.359205+0000","mapping_epoch":37,"log_start":"267'200","ondisk_log_start":"267'200","created":24,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:08:20.733145+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:08:20.733145+0000","last_clean_scrub_stamp":"2024-09-14T11:08:20.733145+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":200,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:49:48.418255+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1655850,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":491,"num_read_kb":10245,"num_write":964,"num_write_kb":42313,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,1],"acting":[5,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2c","version":"267'617","reported_seq":2458,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:59:18.400789+0000","last_change":"2024-09-14T11:08:23.815717+0000","last_active":"2024-09-14T12:59:18.400789+0000","last_peered":"2024-09-14T12:59:18.400789+0000","last_clean":"2024-09-14T12:59:18.400789+0000","last_became_active":"2024-09-14T11:08:23.815121+0000","last_became_peered":"2024-09-14T11:08:23.815121+0000","last_unstale":"2024-09-14T12:59:18.400789+0000","last_undegraded":"2024-09-14T12:59:18.400789+0000","last_fullsized":"2024-09-14T12:59:18.400789+0000","mapping_epoch":26,"log_start":"267'600","ondisk_log_start":"267'600","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:08:22.750609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:08:22.750609+0000","last_clean_scrub_stamp":"2024-09-14T11:08:22.750609+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":600,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:28:06.102937+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3483,"num_read_kb":3244,"num_write":793,"num_write_kb":264,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2b","version":"267'200","reported_seq":846,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:00.381962+0000","last_change":"2024-09-14T11:08:21.788931+0000","last_active":"2024-09-14T13:02:00.381962+0000","last_peered":"2024-09-14T13:02:00.381962+0000","last_clean":"2024-09-14T13:02:00.381962+0000","last_became_active":"2024-09-14T11:08:21.788281+0000","last_became_peered":"2024-09-14T11:08:21.788281+0000","last_unstale":"2024-09-14T13:02:00.381962+0000","last_undegraded":"2024-09-14T13:02:00.381962+0000","last_fullsized":"2024-09-14T13:02:00.381962+0000","mapping_epoch":24,"log_start":"267'100","ondisk_log_start":"267'100","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:08:20.733145+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:08:20.733145+0000","last_clean_scrub_stamp":"2024-09-14T11:08:20.733145+0000","objects_scrubbed":0,"log_size":100,"log_dups_size":100,"ondisk_log_size":100,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:28:36.822887+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":52,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":436,"num_read_kb":38929,"num_write":900,"num_write_kb":25858,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,1],"acting":[0,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2b","version":"267'912","reported_seq":2513,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:01:39.366882+0000","last_change":"2024-09-14T11:08:23.807651+0000","last_active":"2024-09-14T13:01:39.366882+0000","last_peered":"2024-09-14T13:01:39.366882+0000","last_clean":"2024-09-14T13:01:39.366882+0000","last_became_active":"2024-09-14T11:08:23.806952+0000","last_became_peered":"2024-09-14T11:08:23.806952+0000","last_unstale":"2024-09-14T13:01:39.366882+0000","last_undegraded":"2024-09-14T13:01:39.366882+0000","last_fullsized":"2024-09-14T13:01:39.366882+0000","mapping_epoch":26,"log_start":"267'900","ondisk_log_start":"267'900","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:08:22.750609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:08:22.750609+0000","last_clean_scrub_stamp":"2024-09-14T11:08:22.750609+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":900,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:04:05.268211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":4419,"num_read_kb":3921,"num_write":1287,"num_write_kb":515,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"267'231","reported_seq":905,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:00.272842+0000","last_change":"2024-09-14T11:08:21.838035+0000","last_active":"2024-09-14T13:02:00.272842+0000","last_peered":"2024-09-14T13:02:00.272842+0000","last_clean":"2024-09-14T13:02:00.272842+0000","last_became_active":"2024-09-14T11:08:21.836420+0000","last_became_peered":"2024-09-14T11:08:21.836420+0000","last_unstale":"2024-09-14T13:02:00.272842+0000","last_undegraded":"2024-09-14T13:02:00.272842+0000","last_fullsized":"2024-09-14T13:02:00.272842+0000","mapping_epoch":24,"log_start":"267'200","ondisk_log_start":"267'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:08:20.733145+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:08:20.733145+0000","last_clean_scrub_stamp":"2024-09-14T11:08:20.733145+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":200,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:52:49.496464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":678,"num_read_kb":43780,"num_write":1054,"num_write_kb":42822,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.2a","version":"267'457","reported_seq":2086,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:58:43.240063+0000","last_change":"2024-09-14T11:08:23.777007+0000","last_active":"2024-09-14T12:58:43.240063+0000","last_peered":"2024-09-14T12:58:43.240063+0000","last_clean":"2024-09-14T12:58:43.240063+0000","last_became_active":"2024-09-14T11:08:23.776554+0000","last_became_peered":"2024-09-14T11:08:23.776554+0000","last_unstale":"2024-09-14T12:58:43.240063+0000","last_undegraded":"2024-09-14T12:58:43.240063+0000","last_fullsized":"2024-09-14T12:58:43.240063+0000","mapping_epoch":26,"log_start":"267'400","ondisk_log_start":"267'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:08:22.750609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:08:22.750609+0000","last_clean_scrub_stamp":"2024-09-14T11:08:22.750609+0000","objects_scrubbed":0,"log_size":57,"log_dups_size":400,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:54:36.353928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2491,"num_read_kb":2349,"num_write":540,"num_write_kb":122,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2d","version":"267'208","reported_seq":856,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:00.181438+0000","last_change":"2024-09-14T11:08:21.829298+0000","last_active":"2024-09-14T13:02:00.181438+0000","last_peered":"2024-09-14T13:02:00.181438+0000","last_clean":"2024-09-14T13:02:00.181438+0000","last_became_active":"2024-09-14T11:08:21.828333+0000","last_became_peered":"2024-09-14T11:08:21.828333+0000","last_unstale":"2024-09-14T13:02:00.181438+0000","last_undegraded":"2024-09-14T13:02:00.181438+0000","last_fullsized":"2024-09-14T13:02:00.181438+0000","mapping_epoch":24,"log_start":"267'100","ondisk_log_start":"267'100","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:08:20.733145+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:08:20.733145+0000","last_clean_scrub_stamp":"2024-09-14T11:08:20.733145+0000","objects_scrubbed":0,"log_size":108,"log_dups_size":100,"ondisk_log_size":108,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:49:17.354112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":26,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":514,"num_read_kb":35640,"num_write":904,"num_write_kb":31502,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,6],"acting":[7,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.29","version":"267'783","reported_seq":2506,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:58:48.349738+0000","last_change":"2024-09-14T11:08:23.784873+0000","last_active":"2024-09-14T12:58:48.349738+0000","last_peered":"2024-09-14T12:58:48.349738+0000","last_clean":"2024-09-14T12:58:48.349738+0000","last_became_active":"2024-09-14T11:08:23.783522+0000","last_became_peered":"2024-09-14T11:08:23.783522+0000","last_unstale":"2024-09-14T12:58:48.349738+0000","last_undegraded":"2024-09-14T12:58:48.349738+0000","last_fullsized":"2024-09-14T12:58:48.349738+0000","mapping_epoch":26,"log_start":"267'700","ondisk_log_start":"267'700","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:08:22.750609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:08:22.750609+0000","last_clean_scrub_stamp":"2024-09-14T11:08:22.750609+0000","objects_scrubbed":0,"log_size":83,"log_dups_size":700,"ondisk_log_size":83,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:15:28.048272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":4481,"num_read_kb":4083,"num_write":1109,"num_write_kb":423,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"267'190","reported_seq":875,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:00.468322+0000","last_change":"2024-09-14T11:08:21.809060+0000","last_active":"2024-09-14T13:02:00.468322+0000","last_peered":"2024-09-14T13:02:00.468322+0000","last_clean":"2024-09-14T13:02:00.468322+0000","last_became_active":"2024-09-14T11:08:21.808348+0000","last_became_peered":"2024-09-14T11:08:21.808348+0000","last_unstale":"2024-09-14T13:02:00.468322+0000","last_undegraded":"2024-09-14T13:02:00.468322+0000","last_fullsized":"2024-09-14T13:02:00.468322+0000","mapping_epoch":24,"log_start":"267'100","ondisk_log_start":"267'100","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:08:20.733145+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:08:20.733145+0000","last_clean_scrub_stamp":"2024-09-14T11:08:20.733145+0000","objects_scrubbed":0,"log_size":90,"log_dups_size":100,"ondisk_log_size":90,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:06:38.749956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":26,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":617,"num_read_kb":79967,"num_write":853,"num_write_kb":37043,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,1],"acting":[2,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"267'411","reported_seq":2113,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:01:39.424555+0000","last_change":"2024-09-14T11:08:23.803099+0000","last_active":"2024-09-14T13:01:39.424555+0000","last_peered":"2024-09-14T13:01:39.424555+0000","last_clean":"2024-09-14T13:01:39.424555+0000","last_became_active":"2024-09-14T11:08:23.802357+0000","last_became_peered":"2024-09-14T11:08:23.802357+0000","last_unstale":"2024-09-14T13:01:39.424555+0000","last_undegraded":"2024-09-14T13:01:39.424555+0000","last_fullsized":"2024-09-14T13:01:39.424555+0000","mapping_epoch":26,"log_start":"267'400","ondisk_log_start":"267'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:08:22.750609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:08:22.750609+0000","last_clean_scrub_stamp":"2024-09-14T11:08:22.750609+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":400,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:31:47.027216+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2549,"num_read_kb":2448,"num_write":474,"num_write_kb":95,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2f","version":"267'225","reported_seq":949,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:00.104523+0000","last_change":"2024-09-14T11:08:55.885757+0000","last_active":"2024-09-14T13:02:00.104523+0000","last_peered":"2024-09-14T13:02:00.104523+0000","last_clean":"2024-09-14T13:02:00.104523+0000","last_became_active":"2024-09-14T11:08:55.884851+0000","last_became_peered":"2024-09-14T11:08:55.884851+0000","last_unstale":"2024-09-14T13:02:00.104523+0000","last_undegraded":"2024-09-14T13:02:00.104523+0000","last_fullsized":"2024-09-14T13:02:00.104523+0000","mapping_epoch":37,"log_start":"267'200","ondisk_log_start":"267'200","created":24,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:08:20.733145+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:08:20.733145+0000","last_clean_scrub_stamp":"2024-09-14T11:08:20.733145+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":200,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:34:33.364323+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":41,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":799,"num_read_kb":23166,"num_write":1000,"num_write_kb":40111,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,1],"acting":[5,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"267'231","reported_seq":918,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:00.384604+0000","last_change":"2024-09-14T11:08:56.035003+0000","last_active":"2024-09-14T13:02:00.384604+0000","last_peered":"2024-09-14T13:02:00.384604+0000","last_clean":"2024-09-14T13:02:00.384604+0000","last_became_active":"2024-09-14T11:08:56.033792+0000","last_became_peered":"2024-09-14T11:08:56.033792+0000","last_unstale":"2024-09-14T13:02:00.384604+0000","last_undegraded":"2024-09-14T13:02:00.384604+0000","last_fullsized":"2024-09-14T13:02:00.384604+0000","mapping_epoch":37,"log_start":"267'200","ondisk_log_start":"267'200","created":24,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:08:20.733145+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:08:20.733145+0000","last_clean_scrub_stamp":"2024-09-14T11:08:20.733145+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":200,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:06:53.712379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":26,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":576,"num_read_kb":92149,"num_write":1016,"num_write_kb":50173,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,0],"acting":[5,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.37","version":"267'500","reported_seq":2175,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:00:18.795316+0000","last_change":"2024-09-14T11:08:23.787116+0000","last_active":"2024-09-14T13:00:18.795316+0000","last_peered":"2024-09-14T13:00:18.795316+0000","last_clean":"2024-09-14T13:00:18.795316+0000","last_became_active":"2024-09-14T11:08:23.786473+0000","last_became_peered":"2024-09-14T11:08:23.786473+0000","last_unstale":"2024-09-14T13:00:18.795316+0000","last_undegraded":"2024-09-14T13:00:18.795316+0000","last_fullsized":"2024-09-14T13:00:18.795316+0000","mapping_epoch":26,"log_start":"267'400","ondisk_log_start":"267'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:08:22.750609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:08:22.750609+0000","last_clean_scrub_stamp":"2024-09-14T11:08:22.750609+0000","objects_scrubbed":0,"log_size":100,"log_dups_size":400,"ondisk_log_size":100,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:50:27.775627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2870,"num_read_kb":2681,"num_write":627,"num_write_kb":170,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"267'229","reported_seq":899,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:00.442894+0000","last_change":"2024-09-14T11:08:21.816970+0000","last_active":"2024-09-14T13:02:00.442894+0000","last_peered":"2024-09-14T13:02:00.442894+0000","last_clean":"2024-09-14T13:02:00.442894+0000","last_became_active":"2024-09-14T11:08:21.815731+0000","last_became_peered":"2024-09-14T11:08:21.815731+0000","last_unstale":"2024-09-14T13:02:00.442894+0000","last_undegraded":"2024-09-14T13:02:00.442894+0000","last_fullsized":"2024-09-14T13:02:00.442894+0000","mapping_epoch":24,"log_start":"267'200","ondisk_log_start":"267'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:08:20.733145+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:08:20.733145+0000","last_clean_scrub_stamp":"2024-09-14T11:08:20.733145+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":200,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:24:40.198696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":31,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":597,"num_read_kb":25561,"num_write":1006,"num_write_kb":42149,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,5],"acting":[1,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.36","version":"267'907","reported_seq":2494,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:59:38.056689+0000","last_change":"2024-09-14T11:08:23.797836+0000","last_active":"2024-09-14T12:59:38.056689+0000","last_peered":"2024-09-14T12:59:38.056689+0000","last_clean":"2024-09-14T12:59:38.056689+0000","last_became_active":"2024-09-14T11:08:23.797135+0000","last_became_peered":"2024-09-14T11:08:23.797135+0000","last_unstale":"2024-09-14T12:59:38.056689+0000","last_undegraded":"2024-09-14T12:59:38.056689+0000","last_fullsized":"2024-09-14T12:59:38.056689+0000","mapping_epoch":26,"log_start":"267'800","ondisk_log_start":"267'800","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:08:22.750609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:08:22.750609+0000","last_clean_scrub_stamp":"2024-09-14T11:08:22.750609+0000","objects_scrubbed":0,"log_size":107,"log_dups_size":800,"ondisk_log_size":107,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:35:11.421873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4302,"num_read_kb":3816,"num_write":1266,"num_write_kb":491,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]}],"pool_stats":[{"poolid":65,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10893,"num_read_kb":9222,"num_write":3117,"num_write_kb":1014,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1012,"ondisk_log_size":1012,"up":64,"acting":64,"num_store_stats":8},{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":14831,"num_objects":87,"num_object_clones":0,"num_object_copies":174,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":87,"num_whiteouts":0,"num_read":15223,"num_read_kb":14878,"num_write":17077,"num_write_kb":4995,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":19,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":557056,"data_stored":29662,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1708,"ondisk_log_size":1708,"up":64,"acting":64,"num_store_stats":8},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":467,"ondisk_log_size":467,"up":64,"acting":64,"num_store_stats":8},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":416072,"num_objects":199,"num_object_clones":0,"num_object_copies":398,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":199,"num_whiteouts":0,"num_read":11985,"num_read_kb":14520,"num_write":8681,"num_write_kb":3819,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":23,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":278528,"data_stored":7404,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2014,"ondisk_log_size":2014,"up":64,"acting":64,"num_store_stats":8},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":1793,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":2383,"num_read_kb":2845,"num_write":20,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":3586,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":11,"ondisk_log_size":11,"up":64,"acting":64,"num_store_stats":8},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":143,"num_object_clones":0,"num_object_copies":286,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":143,"num_whiteouts":0,"num_read":221865,"num_read_kb":203092,"num_write":56157,"num_write_kb":19250,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":143,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3675,"ondisk_log_size":3675,"up":128,"acting":128,"num_store_stats":8},{"poolid":68,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":12,"num_read_kb":12,"num_write":18,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":6,"ondisk_log_size":6,"up":64,"acting":64,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":34033097,"num_objects":166,"num_object_clones":0,"num_object_copies":498,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":166,"num_whiteouts":0,"num_read":42946,"num_read_kb":2820718,"num_write":64530,"num_write_kb":2216242,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":52617216,"data_stored":52617216,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3536,"ondisk_log_size":3536,"up":192,"acting":192,"num_store_stats":8},{"poolid":67,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":172,"num_read_kb":198130,"num_write":186,"num_write_kb":125738,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":126,"ondisk_log_size":126,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":7},{"poolid":66,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":168,"num_read_kb":188216,"num_write":186,"num_write_kb":125738,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":126,"ondisk_log_size":126,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834576218,"num_pgs":106,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":251344,"kb_used_data":13232,"kb_used_omap":1,"kb_used_meta":238014,"kb_avail":94120496,"statfs":{"total":96636764160,"available":96379387904,"internally_reserved":0,"allocated":13549568,"data_stored":11411092,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":243726794},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,1,1,0,1],"upper_bound":32},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":6,"up_from":13,"seq":55834576224,"num_pgs":99,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":242648,"kb_used_data":8724,"kb_used_omap":1,"kb_used_meta":233854,"kb_avail":94129192,"statfs":{"total":96636764160,"available":96388292608,"internally_reserved":0,"allocated":8933376,"data_stored":6850023,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":239466950},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834576222,"num_pgs":103,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":108124,"kb_used_data":10216,"kb_used_omap":1,"kb_used_meta":97790,"kb_avail":94263716,"statfs":{"total":96636764160,"available":96526045184,"internally_reserved":0,"allocated":10461184,"data_stored":8310166,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":100137413},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834576223,"num_pgs":105,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":121112,"kb_used_data":13564,"kb_used_omap":1,"kb_used_meta":107518,"kb_avail":94250728,"statfs":{"total":96636764160,"available":96512745472,"internally_reserved":0,"allocated":13889536,"data_stored":11826037,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":110098885},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834576225,"num_pgs":124,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":239980,"kb_used_data":10172,"kb_used_omap":1,"kb_used_meta":229694,"kb_avail":94131860,"statfs":{"total":96636764160,"available":96391024640,"internally_reserved":0,"allocated":10416128,"data_stored":8289369,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":235207111},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834576222,"num_pgs":92,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":75224,"kb_used_data":7924,"kb_used_omap":1,"kb_used_meta":67262,"kb_avail":94296616,"statfs":{"total":96636764160,"available":96559734784,"internally_reserved":0,"allocated":8114176,"data_stored":6032250,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":68876741},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834576225,"num_pgs":112,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":147572,"kb_used_data":12252,"kb_used_omap":1,"kb_used_meta":135230,"kb_avail":94224268,"statfs":{"total":96636764160,"available":96485650432,"internally_reserved":0,"allocated":12546048,"data_stored":10442210,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":138475973},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834576223,"num_pgs":109,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":240772,"kb_used_data":10996,"kb_used_omap":1,"kb_used_meta":229694,"kb_avail":94131068,"statfs":{"total":96636764160,"available":96390213632,"internally_reserved":0,"allocated":11259904,"data_stored":9137303,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":235207109},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":6234112,"data_stored":6234112,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8130560,"data_stored":8130560,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":3719168,"data_stored":3719168,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":5976064,"data_stored":5976064,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":9515008,"data_stored":9515008,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":5996544,"data_stored":5996544,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4538368,"data_stored":4538368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8507392,"data_stored":8507392,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":1139,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":46,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":1185,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":562,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":184,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":470,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":880,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":1018,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":330,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":1210,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":220,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":1458,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":814,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":1474,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":86016,"data_stored":3328,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":3091,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4091,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":86016,"data_stored":4619,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":2771,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":77824,"data_stored":4485,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":2895,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":86016,"data_stored":4382,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-14T13:02:08.115 INFO:tasks.ceph:pgid 68.1a last_scrub_stamp 2024-09-14T11:58:42.635024+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=42, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=2, tm_sec=2, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:02:08.115 INFO:tasks.ceph:pgid 67.1d last_scrub_stamp 2024-09-14T11:30:16.474654+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=30, tm_sec=16, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=2, tm_sec=2, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:02:08.115 INFO:tasks.ceph:pgid 66.1c last_scrub_stamp 2024-09-14T11:30:09.411354+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=30, tm_sec=9, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=2, tm_sec=2, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:02:08.115 INFO:tasks.ceph:pgid 65.1f last_scrub_stamp 2024-09-14T11:24:09.066501+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=24, tm_sec=9, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=2, tm_sec=2, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:02:08.115 INFO:tasks.ceph:pgid 68.1b last_scrub_stamp 2024-09-14T11:58:42.635024+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=42, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=2, tm_sec=2, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:02:08.115 INFO:tasks.ceph:pgid 67.1c last_scrub_stamp 2024-09-14T11:30:16.474654+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=30, tm_sec=16, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=2, tm_sec=2, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:02:08.116 INFO:tasks.ceph:pgid 66.1d last_scrub_stamp 2024-09-14T11:30:09.411354+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=30, tm_sec=9, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=2, tm_sec=2, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:02:08.116 INFO:tasks.ceph:pgid 65.1e last_scrub_stamp 2024-09-14T11:24:09.066501+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=24, tm_sec=9, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=2, tm_sec=2, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:02:08.116 INFO:tasks.ceph:pgid 68.18 last_scrub_stamp 2024-09-14T11:58:42.635024+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=42, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=2, tm_sec=2, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:02:08.116 INFO:tasks.ceph:pgid 67.1f last_scrub_stamp 2024-09-14T11:30:16.474654+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=30, tm_sec=16, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=2, tm_sec=2, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:02:08.116 INFO:tasks.ceph:pgid 66.1e last_scrub_stamp 2024-09-14T11:30:09.411354+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=30, tm_sec=9, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=2, tm_sec=2, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:02:08.116 INFO:tasks.ceph:pgid 65.1d last_scrub_stamp 2024-09-14T11:24:09.066501+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=24, tm_sec=9, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=2, tm_sec=2, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:02:08.116 INFO:tasks.ceph:pgid 68.19 last_scrub_stamp 2024-09-14T11:58:42.635024+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=42, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=2, tm_sec=2, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:02:08.116 INFO:tasks.ceph:pgid 67.1e last_scrub_stamp 2024-09-14T11:30:16.474654+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=30, tm_sec=16, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=2, tm_sec=2, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:02:08.116 INFO:tasks.ceph:pgid 66.1f last_scrub_stamp 2024-09-14T11:30:09.411354+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=30, tm_sec=9, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=2, tm_sec=2, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:02:08.117 INFO:tasks.ceph:pgid 65.1c last_scrub_stamp 2024-09-14T11:24:09.066501+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=24, tm_sec=9, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=2, tm_sec=2, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:02:08.117 INFO:tasks.ceph:pgid 68.1e last_scrub_stamp 2024-09-14T11:58:42.635024+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=42, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=2, tm_sec=2, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:02:08.117 INFO:tasks.ceph:pgid 67.19 last_scrub_stamp 2024-09-14T11:30:16.474654+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=30, tm_sec=16, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=2, tm_sec=2, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:02:08.117 INFO:tasks.ceph:pgid 66.18 last_scrub_stamp 2024-09-14T11:30:09.411354+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=30, tm_sec=9, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=2, tm_sec=2, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:02:08.117 INFO:tasks.ceph:pgid 65.1b last_scrub_stamp 2024-09-14T11:24:09.066501+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=24, tm_sec=9, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=2, tm_sec=2, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:02:08.117 INFO:tasks.ceph:pgid 68.1f last_scrub_stamp 2024-09-14T11:58:42.635024+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=42, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=2, tm_sec=2, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:02:08.117 INFO:tasks.ceph:pgid 67.18 last_scrub_stamp 2024-09-14T11:30:16.474654+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=30, tm_sec=16, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=2, tm_sec=2, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:02:08.117 INFO:tasks.ceph:pgid 66.19 last_scrub_stamp 2024-09-14T11:30:09.411354+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=30, tm_sec=9, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=2, tm_sec=2, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:02:08.117 INFO:tasks.ceph:pgid 65.1a last_scrub_stamp 2024-09-14T11:24:09.066501+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=24, tm_sec=9, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=2, tm_sec=2, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:02:08.118 INFO:tasks.ceph:pgid 68.1c last_scrub_stamp 2024-09-14T11:58:42.635024+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=42, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=2, tm_sec=2, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:02:08.118 INFO:tasks.ceph:pgid 67.1b last_scrub_stamp 2024-09-14T11:30:16.474654+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=30, tm_sec=16, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=2, tm_sec=2, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:02:08.118 INFO:tasks.ceph:pgid 66.1a last_scrub_stamp 2024-09-14T11:30:09.411354+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=30, tm_sec=9, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=2, tm_sec=2, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:02:08.118 INFO:tasks.ceph:pgid 65.19 last_scrub_stamp 2024-09-14T11:24:09.066501+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=24, tm_sec=9, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=2, tm_sec=2, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:02:08.118 INFO:tasks.ceph:pgid 68.1d last_scrub_stamp 2024-09-14T11:58:42.635024+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=42, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=2, tm_sec=2, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:02:08.118 INFO:tasks.ceph:pgid 67.1a last_scrub_stamp 2024-09-14T11:30:16.474654+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=30, tm_sec=16, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=2, tm_sec=2, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:02:08.118 INFO:tasks.ceph:pgid 66.1b last_scrub_stamp 2024-09-14T11:30:09.411354+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=30, tm_sec=9, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=2, tm_sec=2, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:02:08.118 INFO:tasks.ceph:pgid 65.18 last_scrub_stamp 2024-09-14T11:24:09.066501+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=24, tm_sec=9, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=2, tm_sec=2, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:02:08.118 INFO:tasks.ceph:pgid 68.12 last_scrub_stamp 2024-09-14T11:58:42.635024+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=42, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=2, tm_sec=2, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:02:08.118 INFO:tasks.ceph:pgid 67.15 last_scrub_stamp 2024-09-14T11:30:16.474654+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=30, tm_sec=16, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=2, tm_sec=2, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:02:08.119 INFO:tasks.ceph:pgid 66.14 last_scrub_stamp 2024-09-14T11:30:09.411354+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=30, tm_sec=9, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=2, tm_sec=2, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:02:08.119 INFO:tasks.ceph:pgid 65.17 last_scrub_stamp 2024-09-14T11:24:09.066501+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=24, tm_sec=9, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=2, tm_sec=2, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:02:08.119 INFO:tasks.ceph:pgid 68.13 last_scrub_stamp 2024-09-14T11:58:42.635024+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=42, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=2, tm_sec=2, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:02:08.119 INFO:tasks.ceph:pgid 67.14 last_scrub_stamp 2024-09-14T11:30:16.474654+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=30, tm_sec=16, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=2, tm_sec=2, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:02:08.119 INFO:tasks.ceph:pgid 66.15 last_scrub_stamp 2024-09-14T11:30:09.411354+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=30, tm_sec=9, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=2, tm_sec=2, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:02:08.119 INFO:tasks.ceph:pgid 65.16 last_scrub_stamp 2024-09-14T11:24:09.066501+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=24, tm_sec=9, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=2, tm_sec=2, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:02:08.119 INFO:tasks.ceph:pgid 68.10 last_scrub_stamp 2024-09-14T11:58:42.635024+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=42, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=2, tm_sec=2, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:02:08.119 INFO:tasks.ceph:pgid 67.17 last_scrub_stamp 2024-09-14T11:30:16.474654+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=30, tm_sec=16, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=2, tm_sec=2, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:02:08.119 INFO:tasks.ceph:pgid 66.16 last_scrub_stamp 2024-09-14T11:30:09.411354+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=30, tm_sec=9, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=2, tm_sec=2, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:02:08.120 INFO:tasks.ceph:pgid 65.15 last_scrub_stamp 2024-09-14T11:24:09.066501+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=24, tm_sec=9, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=2, tm_sec=2, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:02:08.120 INFO:tasks.ceph:pgid 68.11 last_scrub_stamp 2024-09-14T11:58:42.635024+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=42, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=2, tm_sec=2, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:02:08.120 INFO:tasks.ceph:pgid 67.16 last_scrub_stamp 2024-09-14T11:30:16.474654+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=30, tm_sec=16, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=2, tm_sec=2, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:02:08.120 INFO:tasks.ceph:pgid 66.17 last_scrub_stamp 2024-09-14T11:30:09.411354+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=30, tm_sec=9, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=2, tm_sec=2, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:02:08.120 INFO:tasks.ceph:pgid 65.14 last_scrub_stamp 2024-09-14T11:24:09.066501+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=24, tm_sec=9, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=2, tm_sec=2, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:02:08.120 INFO:tasks.ceph:pgid 68.16 last_scrub_stamp 2024-09-14T11:58:42.635024+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=42, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=2, tm_sec=2, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:02:08.120 INFO:tasks.ceph:pgid 67.11 last_scrub_stamp 2024-09-14T11:30:16.474654+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=30, tm_sec=16, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=2, tm_sec=2, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:02:08.120 INFO:tasks.ceph:pgid 66.10 last_scrub_stamp 2024-09-14T11:30:09.411354+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=30, tm_sec=9, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=2, tm_sec=2, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:02:08.120 INFO:tasks.ceph:pgid 65.13 last_scrub_stamp 2024-09-14T11:24:09.066501+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=24, tm_sec=9, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=2, tm_sec=2, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:02:08.120 INFO:tasks.ceph:pgid 68.17 last_scrub_stamp 2024-09-14T11:58:42.635024+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=42, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=2, tm_sec=2, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:02:08.121 INFO:tasks.ceph:pgid 67.10 last_scrub_stamp 2024-09-14T11:30:16.474654+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=30, tm_sec=16, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=2, tm_sec=2, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:02:08.121 INFO:tasks.ceph:pgid 66.11 last_scrub_stamp 2024-09-14T11:30:09.411354+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=30, tm_sec=9, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=2, tm_sec=2, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:02:08.121 INFO:tasks.ceph:pgid 65.12 last_scrub_stamp 2024-09-14T11:24:09.066501+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=24, tm_sec=9, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=2, tm_sec=2, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:02:08.121 INFO:tasks.ceph:pgid 68.14 last_scrub_stamp 2024-09-14T11:58:42.635024+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=42, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=2, tm_sec=2, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:02:08.121 INFO:tasks.ceph:pgid 67.13 last_scrub_stamp 2024-09-14T11:30:16.474654+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=30, tm_sec=16, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=2, tm_sec=2, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:02:08.121 INFO:tasks.ceph:pgid 66.12 last_scrub_stamp 2024-09-14T11:30:09.411354+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=30, tm_sec=9, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=2, tm_sec=2, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:02:08.121 INFO:tasks.ceph:pgid 65.11 last_scrub_stamp 2024-09-14T11:24:09.066501+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=24, tm_sec=9, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=2, tm_sec=2, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:02:08.121 INFO:tasks.ceph:pgid 68.15 last_scrub_stamp 2024-09-14T11:58:42.635024+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=42, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=2, tm_sec=2, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:02:08.121 INFO:tasks.ceph:pgid 67.12 last_scrub_stamp 2024-09-14T11:30:16.474654+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=30, tm_sec=16, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=2, tm_sec=2, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:02:08.121 INFO:tasks.ceph:pgid 66.13 last_scrub_stamp 2024-09-14T11:30:09.411354+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=30, tm_sec=9, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=2, tm_sec=2, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:02:08.122 INFO:tasks.ceph:pgid 65.10 last_scrub_stamp 2024-09-14T11:24:09.066501+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=24, tm_sec=9, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=2, tm_sec=2, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:02:08.122 INFO:tasks.ceph:pgid 68.a last_scrub_stamp 2024-09-14T11:58:42.635024+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=42, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=2, tm_sec=2, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:02:08.122 INFO:tasks.ceph:pgid 67.d last_scrub_stamp 2024-09-14T11:30:16.474654+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=30, tm_sec=16, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=2, tm_sec=2, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:02:08.122 INFO:tasks.ceph:pgid 66.c last_scrub_stamp 2024-09-14T11:30:09.411354+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=30, tm_sec=9, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=2, tm_sec=2, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:02:08.122 INFO:tasks.ceph:pgid 65.f last_scrub_stamp 2024-09-14T11:24:09.066501+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=24, tm_sec=9, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=2, tm_sec=2, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:02:08.122 INFO:tasks.ceph:pgid 68.b last_scrub_stamp 2024-09-14T11:58:42.635024+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=42, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=2, tm_sec=2, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:02:08.122 INFO:tasks.ceph:pgid 67.c last_scrub_stamp 2024-09-14T11:30:16.474654+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=30, tm_sec=16, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=2, tm_sec=2, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:02:08.122 INFO:tasks.ceph:pgid 66.d last_scrub_stamp 2024-09-14T11:30:09.411354+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=30, tm_sec=9, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=2, tm_sec=2, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:02:08.122 INFO:tasks.ceph:pgid 65.e last_scrub_stamp 2024-09-14T11:24:09.066501+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=24, tm_sec=9, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=2, tm_sec=2, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:02:08.122 INFO:tasks.ceph:pgid 68.8 last_scrub_stamp 2024-09-14T11:58:42.635024+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=42, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=2, tm_sec=2, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:02:08.123 INFO:tasks.ceph:pgid 67.f last_scrub_stamp 2024-09-14T11:30:16.474654+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=30, tm_sec=16, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=2, tm_sec=2, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:02:08.123 INFO:tasks.ceph:pgid 66.e last_scrub_stamp 2024-09-14T11:30:09.411354+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=30, tm_sec=9, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=2, tm_sec=2, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:02:08.123 INFO:tasks.ceph:pgid 65.d last_scrub_stamp 2024-09-14T11:24:09.066501+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=24, tm_sec=9, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=2, tm_sec=2, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:02:08.123 INFO:tasks.ceph:pgid 68.9 last_scrub_stamp 2024-09-14T11:58:42.635024+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=42, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=2, tm_sec=2, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:02:08.123 INFO:tasks.ceph:pgid 67.e last_scrub_stamp 2024-09-14T11:30:16.474654+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=30, tm_sec=16, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=2, tm_sec=2, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:02:08.123 INFO:tasks.ceph:pgid 66.f last_scrub_stamp 2024-09-14T11:30:09.411354+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=30, tm_sec=9, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=2, tm_sec=2, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:02:08.123 INFO:tasks.ceph:pgid 65.c last_scrub_stamp 2024-09-14T11:24:09.066501+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=24, tm_sec=9, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=2, tm_sec=2, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:02:08.123 INFO:tasks.ceph:pgid 68.e last_scrub_stamp 2024-09-14T11:58:42.635024+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=42, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=2, tm_sec=2, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:02:08.123 INFO:tasks.ceph:pgid 67.9 last_scrub_stamp 2024-09-14T11:30:16.474654+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=30, tm_sec=16, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=2, tm_sec=2, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:02:08.123 INFO:tasks.ceph:pgid 66.8 last_scrub_stamp 2024-09-14T11:30:09.411354+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=30, tm_sec=9, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=2, tm_sec=2, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:02:08.124 INFO:tasks.ceph:pgid 65.b last_scrub_stamp 2024-09-14T11:24:09.066501+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=24, tm_sec=9, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=2, tm_sec=2, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:02:08.124 INFO:tasks.ceph:pgid 68.f last_scrub_stamp 2024-09-14T11:58:42.635024+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=42, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=2, tm_sec=2, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:02:08.124 INFO:tasks.ceph:pgid 67.8 last_scrub_stamp 2024-09-14T11:30:16.474654+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=30, tm_sec=16, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=2, tm_sec=2, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:02:08.124 INFO:tasks.ceph:pgid 66.9 last_scrub_stamp 2024-09-14T11:30:09.411354+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=30, tm_sec=9, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=2, tm_sec=2, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:02:08.124 INFO:tasks.ceph:pgid 65.a last_scrub_stamp 2024-09-14T11:24:09.066501+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=24, tm_sec=9, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=2, tm_sec=2, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:02:08.124 INFO:tasks.ceph:pgid 68.c last_scrub_stamp 2024-09-14T11:58:42.635024+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=42, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=2, tm_sec=2, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:02:08.124 INFO:tasks.ceph:pgid 67.b last_scrub_stamp 2024-09-14T11:30:16.474654+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=30, tm_sec=16, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=2, tm_sec=2, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:02:08.124 INFO:tasks.ceph:pgid 66.a last_scrub_stamp 2024-09-14T11:30:09.411354+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=30, tm_sec=9, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=2, tm_sec=2, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:02:08.124 INFO:tasks.ceph:pgid 65.9 last_scrub_stamp 2024-09-14T11:24:09.066501+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=24, tm_sec=9, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=2, tm_sec=2, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:02:08.124 INFO:tasks.ceph:pgid 68.d last_scrub_stamp 2024-09-14T11:58:42.635024+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=42, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=2, tm_sec=2, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:02:08.125 INFO:tasks.ceph:pgid 67.a last_scrub_stamp 2024-09-14T11:30:16.474654+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=30, tm_sec=16, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=2, tm_sec=2, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:02:08.125 INFO:tasks.ceph:pgid 66.b last_scrub_stamp 2024-09-14T11:30:09.411354+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=30, tm_sec=9, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=2, tm_sec=2, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:02:08.125 INFO:tasks.ceph:pgid 65.8 last_scrub_stamp 2024-09-14T11:24:09.066501+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=24, tm_sec=9, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=2, tm_sec=2, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:02:08.125 INFO:tasks.ceph:pgid 68.2 last_scrub_stamp 2024-09-14T11:58:42.635024+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=42, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=2, tm_sec=2, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:02:08.125 INFO:tasks.ceph:pgid 67.5 last_scrub_stamp 2024-09-14T11:30:16.474654+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=30, tm_sec=16, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=2, tm_sec=2, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:02:08.125 INFO:tasks.ceph:pgid 66.4 last_scrub_stamp 2024-09-14T11:30:09.411354+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=30, tm_sec=9, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=2, tm_sec=2, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:02:08.125 INFO:tasks.ceph:pgid 65.7 last_scrub_stamp 2024-09-14T11:24:09.066501+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=24, tm_sec=9, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=2, tm_sec=2, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:02:08.125 INFO:tasks.ceph:pgid 68.3 last_scrub_stamp 2024-09-14T11:58:42.635024+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=42, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=2, tm_sec=2, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:02:08.125 INFO:tasks.ceph:pgid 67.4 last_scrub_stamp 2024-09-14T11:30:16.474654+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=30, tm_sec=16, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=2, tm_sec=2, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:02:08.126 INFO:tasks.ceph:pgid 66.5 last_scrub_stamp 2024-09-14T11:30:09.411354+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=30, tm_sec=9, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=2, tm_sec=2, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:02:08.126 INFO:tasks.ceph:pgid 65.6 last_scrub_stamp 2024-09-14T11:24:09.066501+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=24, tm_sec=9, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=2, tm_sec=2, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:02:08.126 INFO:tasks.ceph:pgid 68.0 last_scrub_stamp 2024-09-14T11:58:42.635024+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=42, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=2, tm_sec=2, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:02:08.126 INFO:tasks.ceph:pgid 67.7 last_scrub_stamp 2024-09-14T11:30:16.474654+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=30, tm_sec=16, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=2, tm_sec=2, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:02:08.126 INFO:tasks.ceph:pgid 66.6 last_scrub_stamp 2024-09-14T11:30:09.411354+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=30, tm_sec=9, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=2, tm_sec=2, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:02:08.126 INFO:tasks.ceph:pgid 65.5 last_scrub_stamp 2024-09-14T11:24:09.066501+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=24, tm_sec=9, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=2, tm_sec=2, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:02:08.126 INFO:tasks.ceph:pgid 68.1 last_scrub_stamp 2024-09-14T11:58:42.635024+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=42, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=2, tm_sec=2, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:02:08.126 INFO:tasks.ceph:pgid 67.6 last_scrub_stamp 2024-09-14T11:30:16.474654+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=30, tm_sec=16, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=2, tm_sec=2, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:02:08.126 INFO:tasks.ceph:pgid 66.7 last_scrub_stamp 2024-09-14T11:30:09.411354+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=30, tm_sec=9, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=2, tm_sec=2, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:02:08.127 INFO:tasks.ceph:pgid 65.4 last_scrub_stamp 2024-09-14T11:24:09.066501+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=24, tm_sec=9, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=2, tm_sec=2, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:02:08.127 INFO:tasks.ceph:pgid 68.6 last_scrub_stamp 2024-09-14T11:58:42.635024+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=42, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=2, tm_sec=2, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:02:08.127 INFO:tasks.ceph:pgid 67.1 last_scrub_stamp 2024-09-14T11:30:16.474654+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=30, tm_sec=16, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=2, tm_sec=2, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:02:08.127 INFO:tasks.ceph:pgid 66.0 last_scrub_stamp 2024-09-14T11:30:09.411354+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=30, tm_sec=9, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=2, tm_sec=2, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:02:08.127 INFO:tasks.ceph:pgid 65.3 last_scrub_stamp 2024-09-14T11:24:09.066501+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=24, tm_sec=9, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=2, tm_sec=2, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:02:08.127 INFO:tasks.ceph:pgid 68.7 last_scrub_stamp 2024-09-14T11:58:42.635024+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=42, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=2, tm_sec=2, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:02:08.127 INFO:tasks.ceph:pgid 67.0 last_scrub_stamp 2024-09-14T11:30:16.474654+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=30, tm_sec=16, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=2, tm_sec=2, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:02:08.127 INFO:tasks.ceph:pgid 66.1 last_scrub_stamp 2024-09-14T11:30:09.411354+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=30, tm_sec=9, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=2, tm_sec=2, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:02:08.127 INFO:tasks.ceph:pgid 65.2 last_scrub_stamp 2024-09-14T11:24:09.066501+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=24, tm_sec=9, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=2, tm_sec=2, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:02:08.127 INFO:tasks.ceph:pgid 68.4 last_scrub_stamp 2024-09-14T11:58:42.635024+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=42, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=2, tm_sec=2, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:02:08.128 INFO:tasks.ceph:pgid 67.3 last_scrub_stamp 2024-09-14T11:30:16.474654+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=30, tm_sec=16, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=2, tm_sec=2, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:02:08.128 INFO:tasks.ceph:pgid 66.2 last_scrub_stamp 2024-09-14T11:30:09.411354+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=30, tm_sec=9, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=2, tm_sec=2, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:02:08.128 INFO:tasks.ceph:pgid 65.1 last_scrub_stamp 2024-09-14T11:24:09.066501+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=24, tm_sec=9, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=2, tm_sec=2, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:02:08.128 INFO:tasks.ceph:pgid 68.5 last_scrub_stamp 2024-09-14T11:58:42.635024+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=42, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=2, tm_sec=2, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:02:08.128 INFO:tasks.ceph:pgid 67.2 last_scrub_stamp 2024-09-14T11:30:16.474654+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=30, tm_sec=16, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=2, tm_sec=2, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:02:08.128 INFO:tasks.ceph:pgid 66.3 last_scrub_stamp 2024-09-14T11:30:09.411354+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=30, tm_sec=9, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=2, tm_sec=2, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:02:08.128 INFO:tasks.ceph:pgid 65.0 last_scrub_stamp 2024-09-14T11:24:09.066501+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=24, tm_sec=9, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=2, tm_sec=2, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:02:08.128 INFO:tasks.ceph:pgid 3.3f last_scrub_stamp 2024-09-14T11:08:20.733145+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=8, tm_sec=20, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=2, tm_sec=2, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:02:08.129 INFO:tasks.ceph:pgid 4.38 last_scrub_stamp 2024-09-14T11:08:22.750609+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=8, tm_sec=22, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=2, tm_sec=2, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:02:08.129 INFO:tasks.ceph:pgid 3.3e last_scrub_stamp 2024-09-14T11:08:20.733145+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=8, tm_sec=20, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=2, tm_sec=2, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:02:08.129 INFO:tasks.ceph:pgid 4.39 last_scrub_stamp 2024-09-14T11:08:22.750609+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=8, tm_sec=22, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=2, tm_sec=2, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:02:08.129 INFO:tasks.ceph:pgid 3.3d last_scrub_stamp 2024-09-14T11:08:20.733145+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=8, tm_sec=20, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=2, tm_sec=2, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:02:08.129 INFO:tasks.ceph:pgid 4.3a last_scrub_stamp 2024-09-14T11:08:22.750609+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=8, tm_sec=22, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=2, tm_sec=2, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:02:08.129 INFO:tasks.ceph:pgid 3.3c last_scrub_stamp 2024-09-14T11:08:20.733145+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=8, tm_sec=20, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=2, tm_sec=2, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:02:08.129 INFO:tasks.ceph:pgid 4.3b last_scrub_stamp 2024-09-14T11:08:22.750609+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=8, tm_sec=22, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=2, tm_sec=2, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:02:08.129 INFO:tasks.ceph:pgid 3.3b last_scrub_stamp 2024-09-14T11:08:20.733145+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=8, tm_sec=20, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=2, tm_sec=2, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:02:08.129 INFO:tasks.ceph:pgid 4.3c last_scrub_stamp 2024-09-14T11:08:22.750609+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=8, tm_sec=22, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=2, tm_sec=2, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:02:08.129 INFO:tasks.ceph:pgid 3.3a last_scrub_stamp 2024-09-14T11:08:20.733145+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=8, tm_sec=20, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=2, tm_sec=2, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:02:08.130 INFO:tasks.ceph:pgid 4.3d last_scrub_stamp 2024-09-14T11:08:22.750609+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=8, tm_sec=22, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=2, tm_sec=2, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:02:08.130 INFO:tasks.ceph:pgid 3.39 last_scrub_stamp 2024-09-14T11:08:20.733145+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=8, tm_sec=20, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=2, tm_sec=2, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:02:08.130 INFO:tasks.ceph:pgid 4.3e last_scrub_stamp 2024-09-14T11:08:22.750609+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=8, tm_sec=22, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=2, tm_sec=2, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:02:08.130 INFO:tasks.ceph:pgid 3.38 last_scrub_stamp 2024-09-14T11:08:20.733145+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=8, tm_sec=20, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=2, tm_sec=2, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:02:08.130 INFO:tasks.ceph:pgid 4.3f last_scrub_stamp 2024-09-14T11:08:22.750609+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=8, tm_sec=22, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=2, tm_sec=2, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:02:08.130 INFO:tasks.ceph:pgid 4.30 last_scrub_stamp 2024-09-14T11:08:22.750609+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=8, tm_sec=22, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=2, tm_sec=2, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:02:08.130 INFO:tasks.ceph:pgid 3.37 last_scrub_stamp 2024-09-14T11:08:20.733145+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=8, tm_sec=20, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=2, tm_sec=2, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:02:08.130 INFO:tasks.ceph:pgid 4.31 last_scrub_stamp 2024-09-14T11:08:22.750609+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=8, tm_sec=22, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=2, tm_sec=2, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:02:08.130 INFO:tasks.ceph:pgid 3.36 last_scrub_stamp 2024-09-14T11:08:20.733145+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=8, tm_sec=20, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=2, tm_sec=2, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:02:08.130 INFO:tasks.ceph:pgid 4.32 last_scrub_stamp 2024-09-14T11:08:22.750609+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=8, tm_sec=22, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=2, tm_sec=2, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:02:08.131 INFO:tasks.ceph:pgid 3.35 last_scrub_stamp 2024-09-14T11:08:20.733145+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=8, tm_sec=20, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=2, tm_sec=2, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:02:08.131 INFO:tasks.ceph:pgid 4.33 last_scrub_stamp 2024-09-14T11:08:22.750609+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=8, tm_sec=22, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=2, tm_sec=2, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:02:08.131 INFO:tasks.ceph:pgid 3.34 last_scrub_stamp 2024-09-14T11:08:20.733145+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=8, tm_sec=20, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=2, tm_sec=2, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:02:08.131 INFO:tasks.ceph:pgid 4.34 last_scrub_stamp 2024-09-14T11:08:22.750609+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=8, tm_sec=22, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=2, tm_sec=2, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:02:08.131 INFO:tasks.ceph:pgid 3.33 last_scrub_stamp 2024-09-14T11:08:20.733145+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=8, tm_sec=20, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=2, tm_sec=2, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:02:08.131 INFO:tasks.ceph:pgid 4.35 last_scrub_stamp 2024-09-14T11:08:22.750609+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=8, tm_sec=22, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=2, tm_sec=2, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:02:08.131 INFO:tasks.ceph:pgid 3.32 last_scrub_stamp 2024-09-14T11:08:20.733145+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=8, tm_sec=20, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=2, tm_sec=2, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:02:08.131 INFO:tasks.ceph:pgid 8.18 last_scrub_stamp 2024-09-14T11:08:30.789404+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=8, tm_sec=30, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=2, tm_sec=2, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:02:08.131 INFO:tasks.ceph:pgid 4.14 last_scrub_stamp 2024-09-14T11:08:22.750609+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=8, tm_sec=22, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=2, tm_sec=2, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:02:08.131 INFO:tasks.ceph:pgid 3.13 last_scrub_stamp 2024-09-14T11:08:20.733145+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=8, tm_sec=20, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=2, tm_sec=2, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:02:08.131 INFO:tasks.ceph:pgid 5.15 last_scrub_stamp 2024-09-14T11:08:24.757170+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=8, tm_sec=24, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=2, tm_sec=2, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:02:08.132 INFO:tasks.ceph:pgid 6.16 last_scrub_stamp 2024-09-14T11:08:26.771628+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=8, tm_sec=26, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=2, tm_sec=2, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:02:08.132 INFO:tasks.ceph:pgid 7.17 last_scrub_stamp 2024-09-14T11:08:28.783586+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=8, tm_sec=28, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=2, tm_sec=2, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:02:08.132 INFO:tasks.ceph:pgid 8.19 last_scrub_stamp 2024-09-14T11:08:30.789404+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=8, tm_sec=30, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=2, tm_sec=2, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:02:08.132 INFO:tasks.ceph:pgid 4.15 last_scrub_stamp 2024-09-14T11:08:22.750609+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=8, tm_sec=22, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=2, tm_sec=2, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:02:08.132 INFO:tasks.ceph:pgid 3.12 last_scrub_stamp 2024-09-14T11:08:20.733145+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=8, tm_sec=20, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=2, tm_sec=2, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:02:08.132 INFO:tasks.ceph:pgid 5.14 last_scrub_stamp 2024-09-14T11:08:24.757170+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=8, tm_sec=24, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=2, tm_sec=2, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:02:08.132 INFO:tasks.ceph:pgid 6.17 last_scrub_stamp 2024-09-14T11:08:26.771628+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=8, tm_sec=26, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=2, tm_sec=2, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:02:08.132 INFO:tasks.ceph:pgid 7.16 last_scrub_stamp 2024-09-14T11:08:28.783586+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=8, tm_sec=28, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=2, tm_sec=2, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:02:08.132 INFO:tasks.ceph:pgid 8.1a last_scrub_stamp 2024-09-14T11:08:30.789404+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=8, tm_sec=30, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=2, tm_sec=2, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:02:08.132 INFO:tasks.ceph:pgid 4.16 last_scrub_stamp 2024-09-14T11:08:22.750609+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=8, tm_sec=22, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=2, tm_sec=2, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:02:08.133 INFO:tasks.ceph:pgid 3.11 last_scrub_stamp 2024-09-14T11:08:20.733145+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=8, tm_sec=20, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=2, tm_sec=2, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:02:08.133 INFO:tasks.ceph:pgid 5.17 last_scrub_stamp 2024-09-14T11:08:24.757170+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=8, tm_sec=24, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=2, tm_sec=2, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:02:08.133 INFO:tasks.ceph:pgid 6.14 last_scrub_stamp 2024-09-14T11:08:26.771628+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=8, tm_sec=26, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=2, tm_sec=2, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:02:08.133 INFO:tasks.ceph:pgid 7.15 last_scrub_stamp 2024-09-14T11:08:28.783586+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=8, tm_sec=28, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=2, tm_sec=2, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:02:08.133 INFO:tasks.ceph:pgid 8.1b last_scrub_stamp 2024-09-14T11:08:30.789404+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=8, tm_sec=30, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=2, tm_sec=2, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:02:08.133 INFO:tasks.ceph:pgid 4.17 last_scrub_stamp 2024-09-14T11:08:22.750609+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=8, tm_sec=22, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=2, tm_sec=2, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:02:08.133 INFO:tasks.ceph:pgid 3.10 last_scrub_stamp 2024-09-14T11:08:20.733145+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=8, tm_sec=20, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=2, tm_sec=2, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:02:08.133 INFO:tasks.ceph:pgid 5.16 last_scrub_stamp 2024-09-14T11:08:24.757170+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=8, tm_sec=24, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=2, tm_sec=2, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:02:08.133 INFO:tasks.ceph:pgid 6.15 last_scrub_stamp 2024-09-14T11:08:26.771628+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=8, tm_sec=26, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=2, tm_sec=2, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:02:08.134 INFO:tasks.ceph:pgid 7.14 last_scrub_stamp 2024-09-14T11:08:28.783586+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=8, tm_sec=28, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=2, tm_sec=2, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:02:08.134 INFO:tasks.ceph:pgid 4.8 last_scrub_stamp 2024-09-14T11:08:22.750609+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=8, tm_sec=22, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=2, tm_sec=2, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:02:08.134 INFO:tasks.ceph:pgid 3.f last_scrub_stamp 2024-09-14T11:08:20.733145+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=8, tm_sec=20, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=2, tm_sec=2, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:02:08.134 INFO:tasks.ceph:pgid 5.9 last_scrub_stamp 2024-09-14T11:08:24.757170+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=8, tm_sec=24, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=2, tm_sec=2, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:02:08.134 INFO:tasks.ceph:pgid 6.a last_scrub_stamp 2024-09-14T11:08:26.771628+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=8, tm_sec=26, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=2, tm_sec=2, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:02:08.134 INFO:tasks.ceph:pgid 7.b last_scrub_stamp 2024-09-14T11:08:28.783586+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=8, tm_sec=28, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=2, tm_sec=2, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:02:08.134 INFO:tasks.ceph:pgid 8.4 last_scrub_stamp 2024-09-14T11:08:30.789404+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=8, tm_sec=30, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=2, tm_sec=2, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:02:08.134 INFO:tasks.ceph:pgid 4.9 last_scrub_stamp 2024-09-14T11:08:22.750609+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=8, tm_sec=22, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=2, tm_sec=2, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:02:08.134 INFO:tasks.ceph:pgid 3.e last_scrub_stamp 2024-09-14T11:08:20.733145+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=8, tm_sec=20, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=2, tm_sec=2, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:02:08.134 INFO:tasks.ceph:pgid 5.8 last_scrub_stamp 2024-09-14T11:08:24.757170+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=8, tm_sec=24, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=2, tm_sec=2, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:02:08.134 INFO:tasks.ceph:pgid 6.b last_scrub_stamp 2024-09-14T11:08:26.771628+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=8, tm_sec=26, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=2, tm_sec=2, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:02:08.135 INFO:tasks.ceph:pgid 7.a last_scrub_stamp 2024-09-14T11:08:28.783586+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=8, tm_sec=28, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=2, tm_sec=2, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:02:08.135 INFO:tasks.ceph:pgid 8.5 last_scrub_stamp 2024-09-14T11:08:30.789404+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=8, tm_sec=30, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=2, tm_sec=2, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:02:08.135 INFO:tasks.ceph:pgid 4.a last_scrub_stamp 2024-09-14T11:08:22.750609+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=8, tm_sec=22, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=2, tm_sec=2, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:02:08.135 INFO:tasks.ceph:pgid 3.d last_scrub_stamp 2024-09-14T11:08:20.733145+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=8, tm_sec=20, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=2, tm_sec=2, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:02:08.135 INFO:tasks.ceph:pgid 5.b last_scrub_stamp 2024-09-14T11:08:24.757170+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=8, tm_sec=24, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=2, tm_sec=2, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:02:08.135 INFO:tasks.ceph:pgid 6.8 last_scrub_stamp 2024-09-14T11:08:26.771628+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=8, tm_sec=26, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=2, tm_sec=2, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:02:08.135 INFO:tasks.ceph:pgid 7.9 last_scrub_stamp 2024-09-14T11:08:28.783586+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=8, tm_sec=28, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=2, tm_sec=2, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:02:08.135 INFO:tasks.ceph:pgid 8.6 last_scrub_stamp 2024-09-14T11:08:30.789404+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=8, tm_sec=30, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=2, tm_sec=2, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:02:08.135 INFO:tasks.ceph:pgid 4.b last_scrub_stamp 2024-09-14T11:08:22.750609+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=8, tm_sec=22, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=2, tm_sec=2, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:02:08.136 INFO:tasks.ceph:pgid 3.c last_scrub_stamp 2024-09-14T11:08:20.733145+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=8, tm_sec=20, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=2, tm_sec=2, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:02:08.136 INFO:tasks.ceph:pgid 5.a last_scrub_stamp 2024-09-14T11:08:24.757170+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=8, tm_sec=24, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=2, tm_sec=2, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:02:08.136 INFO:tasks.ceph:pgid 6.9 last_scrub_stamp 2024-09-14T11:08:26.771628+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=8, tm_sec=26, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=2, tm_sec=2, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:02:08.136 INFO:tasks.ceph:pgid 7.8 last_scrub_stamp 2024-09-14T11:08:28.783586+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=8, tm_sec=28, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=2, tm_sec=2, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:02:08.136 INFO:tasks.ceph:pgid 8.7 last_scrub_stamp 2024-09-14T11:08:30.789404+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=8, tm_sec=30, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=2, tm_sec=2, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:02:08.136 INFO:tasks.ceph:pgid 4.c last_scrub_stamp 2024-09-14T11:08:22.750609+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=8, tm_sec=22, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=2, tm_sec=2, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:02:08.136 INFO:tasks.ceph:pgid 3.b last_scrub_stamp 2024-09-14T11:08:20.733145+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=8, tm_sec=20, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=2, tm_sec=2, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:02:08.136 INFO:tasks.ceph:pgid 5.d last_scrub_stamp 2024-09-14T11:08:24.757170+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=8, tm_sec=24, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=2, tm_sec=2, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:02:08.136 INFO:tasks.ceph:pgid 6.e last_scrub_stamp 2024-09-14T11:08:26.771628+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=8, tm_sec=26, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=2, tm_sec=2, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:02:08.136 INFO:tasks.ceph:pgid 7.f last_scrub_stamp 2024-09-14T11:08:28.783586+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=8, tm_sec=28, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=2, tm_sec=2, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:02:08.136 INFO:tasks.ceph:pgid 8.0 last_scrub_stamp 2024-09-14T11:08:30.789404+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=8, tm_sec=30, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=2, tm_sec=2, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:02:08.137 INFO:tasks.ceph:pgid 4.d last_scrub_stamp 2024-09-14T11:08:22.750609+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=8, tm_sec=22, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=2, tm_sec=2, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:02:08.137 INFO:tasks.ceph:pgid 3.a last_scrub_stamp 2024-09-14T11:08:20.733145+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=8, tm_sec=20, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=2, tm_sec=2, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:02:08.137 INFO:tasks.ceph:pgid 5.c last_scrub_stamp 2024-09-14T11:08:24.757170+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=8, tm_sec=24, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=2, tm_sec=2, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:02:08.137 INFO:tasks.ceph:pgid 6.f last_scrub_stamp 2024-09-14T11:08:26.771628+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=8, tm_sec=26, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=2, tm_sec=2, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:02:08.137 INFO:tasks.ceph:pgid 7.e last_scrub_stamp 2024-09-14T11:08:28.783586+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=8, tm_sec=28, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=2, tm_sec=2, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:02:08.137 INFO:tasks.ceph:pgid 8.1 last_scrub_stamp 2024-09-14T11:08:30.789404+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=8, tm_sec=30, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=2, tm_sec=2, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:02:08.137 INFO:tasks.ceph:pgid 4.e last_scrub_stamp 2024-09-14T11:08:22.750609+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=8, tm_sec=22, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=2, tm_sec=2, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:02:08.137 INFO:tasks.ceph:pgid 3.9 last_scrub_stamp 2024-09-14T11:08:20.733145+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=8, tm_sec=20, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=2, tm_sec=2, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:02:08.137 INFO:tasks.ceph:pgid 5.f last_scrub_stamp 2024-09-14T11:08:24.757170+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=8, tm_sec=24, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=2, tm_sec=2, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:02:08.138 INFO:tasks.ceph:pgid 6.c last_scrub_stamp 2024-09-14T11:08:26.771628+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=8, tm_sec=26, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=2, tm_sec=2, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:02:08.138 INFO:tasks.ceph:pgid 7.d last_scrub_stamp 2024-09-14T11:08:28.783586+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=8, tm_sec=28, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=2, tm_sec=2, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:02:08.138 INFO:tasks.ceph:pgid 8.2 last_scrub_stamp 2024-09-14T11:08:30.789404+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=8, tm_sec=30, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=2, tm_sec=2, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:02:08.138 INFO:tasks.ceph:pgid 4.f last_scrub_stamp 2024-09-14T11:08:22.750609+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=8, tm_sec=22, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=2, tm_sec=2, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:02:08.138 INFO:tasks.ceph:pgid 3.8 last_scrub_stamp 2024-09-14T11:08:20.733145+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=8, tm_sec=20, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=2, tm_sec=2, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:02:08.138 INFO:tasks.ceph:pgid 5.e last_scrub_stamp 2024-09-14T11:08:24.757170+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=8, tm_sec=24, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=2, tm_sec=2, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:02:08.138 INFO:tasks.ceph:pgid 6.d last_scrub_stamp 2024-09-14T11:08:26.771628+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=8, tm_sec=26, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=2, tm_sec=2, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:02:08.138 INFO:tasks.ceph:pgid 7.c last_scrub_stamp 2024-09-14T11:08:28.783586+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=8, tm_sec=28, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=2, tm_sec=2, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:02:08.138 INFO:tasks.ceph:pgid 8.3 last_scrub_stamp 2024-09-14T11:08:30.789404+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=8, tm_sec=30, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=2, tm_sec=2, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:02:08.139 INFO:tasks.ceph:pgid 4.5 last_scrub_stamp 2024-09-14T11:08:22.750609+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=8, tm_sec=22, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=2, tm_sec=2, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:02:08.139 INFO:tasks.ceph:pgid 1.0 last_scrub_stamp 2024-09-14T11:08:02.835447+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=8, tm_sec=2, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=2, tm_sec=2, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:02:08.139 INFO:tasks.ceph:pgid 2.3 last_scrub_stamp 2024-09-14T11:08:07.870014+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=8, tm_sec=7, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=2, tm_sec=2, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:02:08.139 INFO:tasks.ceph:pgid 3.2 last_scrub_stamp 2024-09-14T11:08:20.733145+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=8, tm_sec=20, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=2, tm_sec=2, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:02:08.139 INFO:tasks.ceph:pgid 5.4 last_scrub_stamp 2024-09-14T11:08:24.757170+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=8, tm_sec=24, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=2, tm_sec=2, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:02:08.139 INFO:tasks.ceph:pgid 6.7 last_scrub_stamp 2024-09-14T11:08:26.771628+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=8, tm_sec=26, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=2, tm_sec=2, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:02:08.139 INFO:tasks.ceph:pgid 7.6 last_scrub_stamp 2024-09-14T11:08:28.783586+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=8, tm_sec=28, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=2, tm_sec=2, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:02:08.139 INFO:tasks.ceph:pgid 8.9 last_scrub_stamp 2024-09-14T11:08:30.789404+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=8, tm_sec=30, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=2, tm_sec=2, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:02:08.139 INFO:tasks.ceph:pgid 4.6 last_scrub_stamp 2024-09-14T11:08:22.750609+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=8, tm_sec=22, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=2, tm_sec=2, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:02:08.139 INFO:tasks.ceph:pgid 2.0 last_scrub_stamp 2024-09-14T11:08:07.870014+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=8, tm_sec=7, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=2, tm_sec=2, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:02:08.140 INFO:tasks.ceph:pgid 3.1 last_scrub_stamp 2024-09-14T11:08:20.733145+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=8, tm_sec=20, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=2, tm_sec=2, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:02:08.140 INFO:tasks.ceph:pgid 5.7 last_scrub_stamp 2024-09-14T11:08:24.757170+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=8, tm_sec=24, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=2, tm_sec=2, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:02:08.140 INFO:tasks.ceph:pgid 6.4 last_scrub_stamp 2024-09-14T11:08:26.771628+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=8, tm_sec=26, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=2, tm_sec=2, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:02:08.140 INFO:tasks.ceph:pgid 7.5 last_scrub_stamp 2024-09-14T11:08:28.783586+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=8, tm_sec=28, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=2, tm_sec=2, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:02:08.140 INFO:tasks.ceph:pgid 8.a last_scrub_stamp 2024-09-14T11:08:30.789404+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=8, tm_sec=30, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=2, tm_sec=2, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:02:08.140 INFO:tasks.ceph:pgid 4.7 last_scrub_stamp 2024-09-14T11:08:22.750609+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=8, tm_sec=22, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=2, tm_sec=2, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:02:08.140 INFO:tasks.ceph:pgid 2.1 last_scrub_stamp 2024-09-14T11:08:07.870014+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=8, tm_sec=7, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=2, tm_sec=2, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:02:08.140 INFO:tasks.ceph:pgid 3.0 last_scrub_stamp 2024-09-14T11:08:20.733145+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=8, tm_sec=20, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=2, tm_sec=2, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:02:08.140 INFO:tasks.ceph:pgid 5.6 last_scrub_stamp 2024-09-14T11:08:24.757170+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=8, tm_sec=24, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=2, tm_sec=2, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:02:08.140 INFO:tasks.ceph:pgid 6.5 last_scrub_stamp 2024-09-14T11:08:26.771628+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=8, tm_sec=26, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=2, tm_sec=2, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:02:08.141 INFO:tasks.ceph:pgid 7.4 last_scrub_stamp 2024-09-14T11:08:28.783586+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=8, tm_sec=28, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=2, tm_sec=2, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:02:08.141 INFO:tasks.ceph:pgid 8.b last_scrub_stamp 2024-09-14T11:08:30.789404+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=8, tm_sec=30, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=2, tm_sec=2, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:02:08.141 INFO:tasks.ceph:pgid 4.4 last_scrub_stamp 2024-09-14T11:08:22.750609+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=8, tm_sec=22, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=2, tm_sec=2, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:02:08.141 INFO:tasks.ceph:pgid 2.2 last_scrub_stamp 2024-09-14T11:08:07.870014+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=8, tm_sec=7, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=2, tm_sec=2, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:02:08.141 INFO:tasks.ceph:pgid 3.3 last_scrub_stamp 2024-09-14T11:08:20.733145+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=8, tm_sec=20, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=2, tm_sec=2, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:02:08.141 INFO:tasks.ceph:pgid 5.5 last_scrub_stamp 2024-09-14T11:08:24.757170+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=8, tm_sec=24, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=2, tm_sec=2, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:02:08.141 INFO:tasks.ceph:pgid 6.6 last_scrub_stamp 2024-09-14T11:08:26.771628+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=8, tm_sec=26, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=2, tm_sec=2, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:02:08.141 INFO:tasks.ceph:pgid 7.7 last_scrub_stamp 2024-09-14T11:08:28.783586+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=8, tm_sec=28, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=2, tm_sec=2, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:02:08.142 INFO:tasks.ceph:pgid 8.8 last_scrub_stamp 2024-09-14T11:08:30.789404+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=8, tm_sec=30, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=2, tm_sec=2, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:02:08.142 INFO:tasks.ceph:pgid 4.2 last_scrub_stamp 2024-09-14T11:08:22.750609+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=8, tm_sec=22, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=2, tm_sec=2, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:02:08.142 INFO:tasks.ceph:pgid 3.5 last_scrub_stamp 2024-09-14T11:08:20.733145+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=8, tm_sec=20, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=2, tm_sec=2, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:02:08.142 INFO:tasks.ceph:pgid 2.4 last_scrub_stamp 2024-09-14T11:08:07.870014+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=8, tm_sec=7, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=2, tm_sec=2, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:02:08.142 INFO:tasks.ceph:pgid 5.3 last_scrub_stamp 2024-09-14T11:08:24.757170+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=8, tm_sec=24, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=2, tm_sec=2, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:02:08.142 INFO:tasks.ceph:pgid 6.0 last_scrub_stamp 2024-09-14T11:08:26.771628+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=8, tm_sec=26, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=2, tm_sec=2, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:02:08.142 INFO:tasks.ceph:pgid 7.1 last_scrub_stamp 2024-09-14T11:08:28.783586+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=8, tm_sec=28, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=2, tm_sec=2, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:02:08.142 INFO:tasks.ceph:pgid 8.e last_scrub_stamp 2024-09-14T11:08:30.789404+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=8, tm_sec=30, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=2, tm_sec=2, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:02:08.142 INFO:tasks.ceph:pgid 4.3 last_scrub_stamp 2024-09-14T11:08:22.750609+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=8, tm_sec=22, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=2, tm_sec=2, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:02:08.142 INFO:tasks.ceph:pgid 3.4 last_scrub_stamp 2024-09-14T11:08:20.733145+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=8, tm_sec=20, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=2, tm_sec=2, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:02:08.143 INFO:tasks.ceph:pgid 2.5 last_scrub_stamp 2024-09-14T11:08:07.870014+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=8, tm_sec=7, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=2, tm_sec=2, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:02:08.143 INFO:tasks.ceph:pgid 5.2 last_scrub_stamp 2024-09-14T11:08:24.757170+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=8, tm_sec=24, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=2, tm_sec=2, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:02:08.143 INFO:tasks.ceph:pgid 6.1 last_scrub_stamp 2024-09-14T11:08:26.771628+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=8, tm_sec=26, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=2, tm_sec=2, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:02:08.143 INFO:tasks.ceph:pgid 7.0 last_scrub_stamp 2024-09-14T11:08:28.783586+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=8, tm_sec=28, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=2, tm_sec=2, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:02:08.143 INFO:tasks.ceph:pgid 8.f last_scrub_stamp 2024-09-14T11:08:30.789404+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=8, tm_sec=30, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=2, tm_sec=2, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:02:08.143 INFO:tasks.ceph:pgid 4.0 last_scrub_stamp 2024-09-14T11:08:22.750609+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=8, tm_sec=22, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=2, tm_sec=2, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:02:08.143 INFO:tasks.ceph:pgid 3.7 last_scrub_stamp 2024-09-14T11:08:20.733145+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=8, tm_sec=20, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=2, tm_sec=2, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:02:08.143 INFO:tasks.ceph:pgid 2.6 last_scrub_stamp 2024-09-14T11:08:07.870014+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=8, tm_sec=7, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=2, tm_sec=2, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:02:08.143 INFO:tasks.ceph:pgid 5.1 last_scrub_stamp 2024-09-14T11:08:24.757170+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=8, tm_sec=24, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=2, tm_sec=2, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:02:08.143 INFO:tasks.ceph:pgid 6.2 last_scrub_stamp 2024-09-14T11:08:26.771628+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=8, tm_sec=26, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=2, tm_sec=2, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:02:08.144 INFO:tasks.ceph:pgid 7.3 last_scrub_stamp 2024-09-14T11:08:28.783586+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=8, tm_sec=28, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=2, tm_sec=2, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:02:08.144 INFO:tasks.ceph:pgid 8.c last_scrub_stamp 2024-09-14T11:08:30.789404+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=8, tm_sec=30, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=2, tm_sec=2, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:02:08.144 INFO:tasks.ceph:pgid 4.1 last_scrub_stamp 2024-09-14T11:08:22.750609+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=8, tm_sec=22, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=2, tm_sec=2, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:02:08.144 INFO:tasks.ceph:pgid 3.6 last_scrub_stamp 2024-09-14T11:08:20.733145+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=8, tm_sec=20, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=2, tm_sec=2, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:02:08.144 INFO:tasks.ceph:pgid 2.7 last_scrub_stamp 2024-09-14T11:08:07.870014+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=8, tm_sec=7, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=2, tm_sec=2, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:02:08.144 INFO:tasks.ceph:pgid 5.0 last_scrub_stamp 2024-09-14T11:08:24.757170+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=8, tm_sec=24, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=2, tm_sec=2, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:02:08.144 INFO:tasks.ceph:pgid 6.3 last_scrub_stamp 2024-09-14T11:08:26.771628+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=8, tm_sec=26, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=2, tm_sec=2, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:02:08.144 INFO:tasks.ceph:pgid 7.2 last_scrub_stamp 2024-09-14T11:08:28.783586+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=8, tm_sec=28, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=2, tm_sec=2, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:02:08.144 INFO:tasks.ceph:pgid 8.d last_scrub_stamp 2024-09-14T11:08:30.789404+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=8, tm_sec=30, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=2, tm_sec=2, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:02:08.144 INFO:tasks.ceph:pgid 8.1f last_scrub_stamp 2024-09-14T11:08:30.789404+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=8, tm_sec=30, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=2, tm_sec=2, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:02:08.145 INFO:tasks.ceph:pgid 4.13 last_scrub_stamp 2024-09-14T11:08:22.750609+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=8, tm_sec=22, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=2, tm_sec=2, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:02:08.145 INFO:tasks.ceph:pgid 3.14 last_scrub_stamp 2024-09-14T11:08:20.733145+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=8, tm_sec=20, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=2, tm_sec=2, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:02:08.145 INFO:tasks.ceph:pgid 5.12 last_scrub_stamp 2024-09-14T11:08:24.757170+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=8, tm_sec=24, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=2, tm_sec=2, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:02:08.145 INFO:tasks.ceph:pgid 6.11 last_scrub_stamp 2024-09-14T11:08:26.771628+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=8, tm_sec=26, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=2, tm_sec=2, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:02:08.145 INFO:tasks.ceph:pgid 7.10 last_scrub_stamp 2024-09-14T11:08:28.783586+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=8, tm_sec=28, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=2, tm_sec=2, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:02:08.145 INFO:tasks.ceph:pgid 8.1e last_scrub_stamp 2024-09-14T11:08:30.789404+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=8, tm_sec=30, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=2, tm_sec=2, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:02:08.145 INFO:tasks.ceph:pgid 4.12 last_scrub_stamp 2024-09-14T11:08:22.750609+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=8, tm_sec=22, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=2, tm_sec=2, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:02:08.145 INFO:tasks.ceph:pgid 3.15 last_scrub_stamp 2024-09-14T11:08:20.733145+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=8, tm_sec=20, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=2, tm_sec=2, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:02:08.145 INFO:tasks.ceph:pgid 5.13 last_scrub_stamp 2024-09-14T11:08:24.757170+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=8, tm_sec=24, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=2, tm_sec=2, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:02:08.146 INFO:tasks.ceph:pgid 6.10 last_scrub_stamp 2024-09-14T11:08:26.771628+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=8, tm_sec=26, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=2, tm_sec=2, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:02:08.146 INFO:tasks.ceph:pgid 7.11 last_scrub_stamp 2024-09-14T11:08:28.783586+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=8, tm_sec=28, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=2, tm_sec=2, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:02:08.146 INFO:tasks.ceph:pgid 8.1d last_scrub_stamp 2024-09-14T11:08:30.789404+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=8, tm_sec=30, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=2, tm_sec=2, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:02:08.146 INFO:tasks.ceph:pgid 4.11 last_scrub_stamp 2024-09-14T11:08:22.750609+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=8, tm_sec=22, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=2, tm_sec=2, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:02:08.146 INFO:tasks.ceph:pgid 3.16 last_scrub_stamp 2024-09-14T11:08:20.733145+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=8, tm_sec=20, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=2, tm_sec=2, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:02:08.146 INFO:tasks.ceph:pgid 5.10 last_scrub_stamp 2024-09-14T11:08:24.757170+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=8, tm_sec=24, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=2, tm_sec=2, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:02:08.146 INFO:tasks.ceph:pgid 6.13 last_scrub_stamp 2024-09-14T11:08:26.771628+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=8, tm_sec=26, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=2, tm_sec=2, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:02:08.146 INFO:tasks.ceph:pgid 7.12 last_scrub_stamp 2024-09-14T11:08:28.783586+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=8, tm_sec=28, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=2, tm_sec=2, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:02:08.146 INFO:tasks.ceph:pgid 8.1c last_scrub_stamp 2024-09-14T11:08:30.789404+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=8, tm_sec=30, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=2, tm_sec=2, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:02:08.146 INFO:tasks.ceph:pgid 4.10 last_scrub_stamp 2024-09-14T11:08:22.750609+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=8, tm_sec=22, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=2, tm_sec=2, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:02:08.146 INFO:tasks.ceph:pgid 3.17 last_scrub_stamp 2024-09-14T11:08:20.733145+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=8, tm_sec=20, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=2, tm_sec=2, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:02:08.147 INFO:tasks.ceph:pgid 5.11 last_scrub_stamp 2024-09-14T11:08:24.757170+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=8, tm_sec=24, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=2, tm_sec=2, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:02:08.147 INFO:tasks.ceph:pgid 6.12 last_scrub_stamp 2024-09-14T11:08:26.771628+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=8, tm_sec=26, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=2, tm_sec=2, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:02:08.147 INFO:tasks.ceph:pgid 7.13 last_scrub_stamp 2024-09-14T11:08:28.783586+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=8, tm_sec=28, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=2, tm_sec=2, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:02:08.147 INFO:tasks.ceph:pgid 4.1f last_scrub_stamp 2024-09-14T11:08:22.750609+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=8, tm_sec=22, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=2, tm_sec=2, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:02:08.147 INFO:tasks.ceph:pgid 3.18 last_scrub_stamp 2024-09-14T11:08:20.733145+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=8, tm_sec=20, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=2, tm_sec=2, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:02:08.147 INFO:tasks.ceph:pgid 5.1e last_scrub_stamp 2024-09-14T11:08:24.757170+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=8, tm_sec=24, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=2, tm_sec=2, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:02:08.147 INFO:tasks.ceph:pgid 6.1d last_scrub_stamp 2024-09-14T11:08:26.771628+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=8, tm_sec=26, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=2, tm_sec=2, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:02:08.147 INFO:tasks.ceph:pgid 7.1c last_scrub_stamp 2024-09-14T11:08:28.783586+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=8, tm_sec=28, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=2, tm_sec=2, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:02:08.147 INFO:tasks.ceph:pgid 8.13 last_scrub_stamp 2024-09-14T11:08:30.789404+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=8, tm_sec=30, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=2, tm_sec=2, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:02:08.148 INFO:tasks.ceph:pgid 4.1e last_scrub_stamp 2024-09-14T11:08:22.750609+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=8, tm_sec=22, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=2, tm_sec=2, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:02:08.148 INFO:tasks.ceph:pgid 3.19 last_scrub_stamp 2024-09-14T11:08:20.733145+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=8, tm_sec=20, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=2, tm_sec=2, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:02:08.148 INFO:tasks.ceph:pgid 5.1f last_scrub_stamp 2024-09-14T11:08:24.757170+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=8, tm_sec=24, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=2, tm_sec=2, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:02:08.148 INFO:tasks.ceph:pgid 6.1c last_scrub_stamp 2024-09-14T11:08:26.771628+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=8, tm_sec=26, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=2, tm_sec=2, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:02:08.148 INFO:tasks.ceph:pgid 7.1d last_scrub_stamp 2024-09-14T11:08:28.783586+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=8, tm_sec=28, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=2, tm_sec=2, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:02:08.148 INFO:tasks.ceph:pgid 8.12 last_scrub_stamp 2024-09-14T11:08:30.789404+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=8, tm_sec=30, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=2, tm_sec=2, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:02:08.148 INFO:tasks.ceph:pgid 4.1d last_scrub_stamp 2024-09-14T11:08:22.750609+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=8, tm_sec=22, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=2, tm_sec=2, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:02:08.148 INFO:tasks.ceph:pgid 3.1a last_scrub_stamp 2024-09-14T11:08:20.733145+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=8, tm_sec=20, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=2, tm_sec=2, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:02:08.148 INFO:tasks.ceph:pgid 5.1c last_scrub_stamp 2024-09-14T11:08:24.757170+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=8, tm_sec=24, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=2, tm_sec=2, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:02:08.148 INFO:tasks.ceph:pgid 6.1f last_scrub_stamp 2024-09-14T11:08:26.771628+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=8, tm_sec=26, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=2, tm_sec=2, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:02:08.149 INFO:tasks.ceph:pgid 7.1e last_scrub_stamp 2024-09-14T11:08:28.783586+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=8, tm_sec=28, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=2, tm_sec=2, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:02:08.149 INFO:tasks.ceph:pgid 8.11 last_scrub_stamp 2024-09-14T11:08:30.789404+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=8, tm_sec=30, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=2, tm_sec=2, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:02:08.149 INFO:tasks.ceph:pgid 4.1c last_scrub_stamp 2024-09-14T11:08:22.750609+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=8, tm_sec=22, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=2, tm_sec=2, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:02:08.149 INFO:tasks.ceph:pgid 3.1b last_scrub_stamp 2024-09-14T11:08:20.733145+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=8, tm_sec=20, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=2, tm_sec=2, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:02:08.149 INFO:tasks.ceph:pgid 5.1d last_scrub_stamp 2024-09-14T11:08:24.757170+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=8, tm_sec=24, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=2, tm_sec=2, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:02:08.149 INFO:tasks.ceph:pgid 6.1e last_scrub_stamp 2024-09-14T11:08:26.771628+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=8, tm_sec=26, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=2, tm_sec=2, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:02:08.149 INFO:tasks.ceph:pgid 7.1f last_scrub_stamp 2024-09-14T11:08:28.783586+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=8, tm_sec=28, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=2, tm_sec=2, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:02:08.149 INFO:tasks.ceph:pgid 8.10 last_scrub_stamp 2024-09-14T11:08:30.789404+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=8, tm_sec=30, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=2, tm_sec=2, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:02:08.149 INFO:tasks.ceph:pgid 4.1b last_scrub_stamp 2024-09-14T11:08:22.750609+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=8, tm_sec=22, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=2, tm_sec=2, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:02:08.149 INFO:tasks.ceph:pgid 3.1c last_scrub_stamp 2024-09-14T11:08:20.733145+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=8, tm_sec=20, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=2, tm_sec=2, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:02:08.150 INFO:tasks.ceph:pgid 5.1a last_scrub_stamp 2024-09-14T11:08:24.757170+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=8, tm_sec=24, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=2, tm_sec=2, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:02:08.150 INFO:tasks.ceph:pgid 6.19 last_scrub_stamp 2024-09-14T11:08:26.771628+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=8, tm_sec=26, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=2, tm_sec=2, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:02:08.150 INFO:tasks.ceph:pgid 7.18 last_scrub_stamp 2024-09-14T11:08:28.783586+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=8, tm_sec=28, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=2, tm_sec=2, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:02:08.150 INFO:tasks.ceph:pgid 8.17 last_scrub_stamp 2024-09-14T11:08:30.789404+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=8, tm_sec=30, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=2, tm_sec=2, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:02:08.150 INFO:tasks.ceph:pgid 4.1a last_scrub_stamp 2024-09-14T11:08:22.750609+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=8, tm_sec=22, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=2, tm_sec=2, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:02:08.150 INFO:tasks.ceph:pgid 3.1d last_scrub_stamp 2024-09-14T11:08:20.733145+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=8, tm_sec=20, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=2, tm_sec=2, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:02:08.150 INFO:tasks.ceph:pgid 5.1b last_scrub_stamp 2024-09-14T11:08:24.757170+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=8, tm_sec=24, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=2, tm_sec=2, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:02:08.150 INFO:tasks.ceph:pgid 6.18 last_scrub_stamp 2024-09-14T11:08:26.771628+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=8, tm_sec=26, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=2, tm_sec=2, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:02:08.150 INFO:tasks.ceph:pgid 7.19 last_scrub_stamp 2024-09-14T11:08:28.783586+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=8, tm_sec=28, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=2, tm_sec=2, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:02:08.151 INFO:tasks.ceph:pgid 8.16 last_scrub_stamp 2024-09-14T11:08:30.789404+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=8, tm_sec=30, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=2, tm_sec=2, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:02:08.151 INFO:tasks.ceph:pgid 4.19 last_scrub_stamp 2024-09-14T11:08:22.750609+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=8, tm_sec=22, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=2, tm_sec=2, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:02:08.151 INFO:tasks.ceph:pgid 3.1e last_scrub_stamp 2024-09-14T11:08:20.733145+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=8, tm_sec=20, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=2, tm_sec=2, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:02:08.151 INFO:tasks.ceph:pgid 5.18 last_scrub_stamp 2024-09-14T11:08:24.757170+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=8, tm_sec=24, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=2, tm_sec=2, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:02:08.151 INFO:tasks.ceph:pgid 6.1b last_scrub_stamp 2024-09-14T11:08:26.771628+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=8, tm_sec=26, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=2, tm_sec=2, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:02:08.151 INFO:tasks.ceph:pgid 7.1a last_scrub_stamp 2024-09-14T11:08:28.783586+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=8, tm_sec=28, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=2, tm_sec=2, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:02:08.151 INFO:tasks.ceph:pgid 8.15 last_scrub_stamp 2024-09-14T11:08:30.789404+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=8, tm_sec=30, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=2, tm_sec=2, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:02:08.151 INFO:tasks.ceph:pgid 4.18 last_scrub_stamp 2024-09-14T11:08:22.750609+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=8, tm_sec=22, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=2, tm_sec=2, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:02:08.151 INFO:tasks.ceph:pgid 3.1f last_scrub_stamp 2024-09-14T11:08:20.733145+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=8, tm_sec=20, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=2, tm_sec=2, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:02:08.152 INFO:tasks.ceph:pgid 5.19 last_scrub_stamp 2024-09-14T11:08:24.757170+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=8, tm_sec=24, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=2, tm_sec=2, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:02:08.152 INFO:tasks.ceph:pgid 6.1a last_scrub_stamp 2024-09-14T11:08:26.771628+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=8, tm_sec=26, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=2, tm_sec=2, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:02:08.152 INFO:tasks.ceph:pgid 7.1b last_scrub_stamp 2024-09-14T11:08:28.783586+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=8, tm_sec=28, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=2, tm_sec=2, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:02:08.152 INFO:tasks.ceph:pgid 8.14 last_scrub_stamp 2024-09-14T11:08:30.789404+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=8, tm_sec=30, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=2, tm_sec=2, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:02:08.152 INFO:tasks.ceph:pgid 4.27 last_scrub_stamp 2024-09-14T11:08:22.750609+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=8, tm_sec=22, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=2, tm_sec=2, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:02:08.152 INFO:tasks.ceph:pgid 3.20 last_scrub_stamp 2024-09-14T11:08:20.733145+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=8, tm_sec=20, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=2, tm_sec=2, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:02:08.152 INFO:tasks.ceph:pgid 4.26 last_scrub_stamp 2024-09-14T11:08:22.750609+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=8, tm_sec=22, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=2, tm_sec=2, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:02:08.152 INFO:tasks.ceph:pgid 3.21 last_scrub_stamp 2024-09-14T11:08:20.733145+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=8, tm_sec=20, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=2, tm_sec=2, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:02:08.152 INFO:tasks.ceph:pgid 4.25 last_scrub_stamp 2024-09-14T11:08:22.750609+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=8, tm_sec=22, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=2, tm_sec=2, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:02:08.152 INFO:tasks.ceph:pgid 3.22 last_scrub_stamp 2024-09-14T11:08:20.733145+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=8, tm_sec=20, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=2, tm_sec=2, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:02:08.153 INFO:tasks.ceph:pgid 4.24 last_scrub_stamp 2024-09-14T11:08:22.750609+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=8, tm_sec=22, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=2, tm_sec=2, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:02:08.153 INFO:tasks.ceph:pgid 3.23 last_scrub_stamp 2024-09-14T11:08:20.733145+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=8, tm_sec=20, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=2, tm_sec=2, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:02:08.153 INFO:tasks.ceph:pgid 4.23 last_scrub_stamp 2024-09-14T11:08:22.750609+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=8, tm_sec=22, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=2, tm_sec=2, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:02:08.153 INFO:tasks.ceph:pgid 3.24 last_scrub_stamp 2024-09-14T11:08:20.733145+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=8, tm_sec=20, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=2, tm_sec=2, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:02:08.153 INFO:tasks.ceph:pgid 4.22 last_scrub_stamp 2024-09-14T11:08:22.750609+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=8, tm_sec=22, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=2, tm_sec=2, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:02:08.153 INFO:tasks.ceph:pgid 3.25 last_scrub_stamp 2024-09-14T11:08:20.733145+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=8, tm_sec=20, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=2, tm_sec=2, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:02:08.153 INFO:tasks.ceph:pgid 4.21 last_scrub_stamp 2024-09-14T11:08:22.750609+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=8, tm_sec=22, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=2, tm_sec=2, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:02:08.153 INFO:tasks.ceph:pgid 3.26 last_scrub_stamp 2024-09-14T11:08:20.733145+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=8, tm_sec=20, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=2, tm_sec=2, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:02:08.153 INFO:tasks.ceph:pgid 4.20 last_scrub_stamp 2024-09-14T11:08:22.750609+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=8, tm_sec=22, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=2, tm_sec=2, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:02:08.153 INFO:tasks.ceph:pgid 3.27 last_scrub_stamp 2024-09-14T11:08:20.733145+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=8, tm_sec=20, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=2, tm_sec=2, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:02:08.154 INFO:tasks.ceph:pgid 4.2f last_scrub_stamp 2024-09-14T11:08:22.750609+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=8, tm_sec=22, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=2, tm_sec=2, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:02:08.154 INFO:tasks.ceph:pgid 3.28 last_scrub_stamp 2024-09-14T11:08:20.733145+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=8, tm_sec=20, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=2, tm_sec=2, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:02:08.154 INFO:tasks.ceph:pgid 4.2e last_scrub_stamp 2024-09-14T11:08:22.750609+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=8, tm_sec=22, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=2, tm_sec=2, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:02:08.154 INFO:tasks.ceph:pgid 3.29 last_scrub_stamp 2024-09-14T11:08:20.733145+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=8, tm_sec=20, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=2, tm_sec=2, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:02:08.154 INFO:tasks.ceph:pgid 4.2d last_scrub_stamp 2024-09-14T11:08:22.750609+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=8, tm_sec=22, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=2, tm_sec=2, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:02:08.154 INFO:tasks.ceph:pgid 3.2a last_scrub_stamp 2024-09-14T11:08:20.733145+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=8, tm_sec=20, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=2, tm_sec=2, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:02:08.154 INFO:tasks.ceph:pgid 4.2c last_scrub_stamp 2024-09-14T11:08:22.750609+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=8, tm_sec=22, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=2, tm_sec=2, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:02:08.154 INFO:tasks.ceph:pgid 3.2b last_scrub_stamp 2024-09-14T11:08:20.733145+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=8, tm_sec=20, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=2, tm_sec=2, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:02:08.154 INFO:tasks.ceph:pgid 4.2b last_scrub_stamp 2024-09-14T11:08:22.750609+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=8, tm_sec=22, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=2, tm_sec=2, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:02:08.154 INFO:tasks.ceph:pgid 3.2c last_scrub_stamp 2024-09-14T11:08:20.733145+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=8, tm_sec=20, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=2, tm_sec=2, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:02:08.154 INFO:tasks.ceph:pgid 4.2a last_scrub_stamp 2024-09-14T11:08:22.750609+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=8, tm_sec=22, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=2, tm_sec=2, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:02:08.155 INFO:tasks.ceph:pgid 3.2d last_scrub_stamp 2024-09-14T11:08:20.733145+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=8, tm_sec=20, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=2, tm_sec=2, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:02:08.155 INFO:tasks.ceph:pgid 4.29 last_scrub_stamp 2024-09-14T11:08:22.750609+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=8, tm_sec=22, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=2, tm_sec=2, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:02:08.155 INFO:tasks.ceph:pgid 3.2e last_scrub_stamp 2024-09-14T11:08:20.733145+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=8, tm_sec=20, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=2, tm_sec=2, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:02:08.155 INFO:tasks.ceph:pgid 4.28 last_scrub_stamp 2024-09-14T11:08:22.750609+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=8, tm_sec=22, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=2, tm_sec=2, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:02:08.155 INFO:tasks.ceph:pgid 3.2f last_scrub_stamp 2024-09-14T11:08:20.733145+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=8, tm_sec=20, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=2, tm_sec=2, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:02:08.155 INFO:tasks.ceph:pgid 3.30 last_scrub_stamp 2024-09-14T11:08:20.733145+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=8, tm_sec=20, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=2, tm_sec=2, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:02:08.155 INFO:tasks.ceph:pgid 4.37 last_scrub_stamp 2024-09-14T11:08:22.750609+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=8, tm_sec=22, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=2, tm_sec=2, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:02:08.155 INFO:tasks.ceph:pgid 3.31 last_scrub_stamp 2024-09-14T11:08:20.733145+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=8, tm_sec=20, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=2, tm_sec=2, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:02:08.155 INFO:tasks.ceph:pgid 4.36 last_scrub_stamp 2024-09-14T11:08:22.750609+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=8, tm_sec=22, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=2, tm_sec=2, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:02:08.155 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-09-14T13:02:28.157 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-14T13:02:28.500 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-09-14T13:02:28.517 INFO:teuthology.orchestra.run.smithi138.stderr:dumped all 2024-09-14T13:02:28.521 INFO:teuthology.orchestra.run.smithi138.stdout:{"pg_ready":true,"pg_map":{"version":3690,"stamp":"2024-09-14T13:02:27.311735+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":35056180,"num_objects":619,"num_object_clones":0,"num_object_copies":1404,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":619,"num_whiteouts":0,"num_read":305713,"num_read_kb":3451688,"num_write":150075,"num_write_kb":2498451,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":191,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":566069,"num_omap_keys":1335,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":12793,"ondisk_log_size":12793,"up":850,"acting":850,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":850,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":1434600,"kb_used_data":87080,"kb_used_omap":12,"kb_used_meta":1347379,"kb_avail":753540120,"statfs":{"total":773094113280,"available":771625082880,"internally_reserved":0,"allocated":89169920,"data_stored":72298450,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":1379716656},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":561892,"num_omap_keys":1318,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.009203"},"pg_stats":[{"pgid":"68.1a","version":"0'0","reported_seq":38,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:58:43.044370+0000","last_change":"2024-09-14T11:58:43.698171+0000","last_active":"2024-09-14T12:58:43.044370+0000","last_peered":"2024-09-14T12:58:43.044370+0000","last_clean":"2024-09-14T12:58:43.044370+0000","last_became_active":"2024-09-14T11:58:43.694936+0000","last_became_peered":"2024-09-14T11:58:43.694936+0000","last_unstale":"2024-09-14T12:58:43.044370+0000","last_undegraded":"2024-09-14T12:58:43.044370+0000","last_fullsized":"2024-09-14T12:58:43.044370+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:58:42.635024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:58:42.635024+0000","last_clean_scrub_stamp":"2024-09-14T11:58:42.635024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:02:52.327879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.1d","version":"264'2","reported_seq":63,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:57:48.032148+0000","last_change":"2024-09-14T11:30:17.527028+0000","last_active":"2024-09-14T12:57:48.032148+0000","last_peered":"2024-09-14T12:57:48.032148+0000","last_clean":"2024-09-14T12:57:48.032148+0000","last_became_active":"2024-09-14T11:30:17.525157+0000","last_became_peered":"2024-09-14T11:30:17.525157+0000","last_unstale":"2024-09-14T12:57:48.032148+0000","last_undegraded":"2024-09-14T12:57:48.032148+0000","last_fullsized":"2024-09-14T12:57:48.032148+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:30:16.474654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:30:16.474654+0000","last_clean_scrub_stamp":"2024-09-14T11:30:16.474654+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:14:59.272162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":4096,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.1c","version":"267'6","reported_seq":76,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:00.023046+0000","last_change":"2024-09-14T11:30:10.466403+0000","last_active":"2024-09-14T13:02:00.023046+0000","last_peered":"2024-09-14T13:02:00.023046+0000","last_clean":"2024-09-14T13:02:00.023046+0000","last_became_active":"2024-09-14T11:30:10.460441+0000","last_became_peered":"2024-09-14T11:30:10.460441+0000","last_unstale":"2024-09-14T13:02:00.023046+0000","last_undegraded":"2024-09-14T13:02:00.023046+0000","last_fullsized":"2024-09-14T13:02:00.023046+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:30:09.411354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:30:09.411354+0000","last_clean_scrub_stamp":"2024-09-14T11:30:09.411354+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:47:20.165693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":6189,"num_write":6,"num_write_kb":5165,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.1f","version":"267'84","reported_seq":313,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:00:03.259594+0000","last_change":"2024-09-14T11:24:10.106139+0000","last_active":"2024-09-14T13:00:03.259594+0000","last_peered":"2024-09-14T13:00:03.259594+0000","last_clean":"2024-09-14T13:00:03.259594+0000","last_became_active":"2024-09-14T11:24:10.104105+0000","last_became_peered":"2024-09-14T11:24:10.104105+0000","last_unstale":"2024-09-14T13:00:03.259594+0000","last_undegraded":"2024-09-14T13:00:03.259594+0000","last_fullsized":"2024-09-14T13:00:03.259594+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:24:09.066501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:24:09.066501+0000","last_clean_scrub_stamp":"2024-09-14T11:24:09.066501+0000","objects_scrubbed":0,"log_size":84,"log_dups_size":0,"ondisk_log_size":84,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":704,"num_read_kb":504,"num_write":208,"num_write_kb":68,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.1b","version":"0'0","reported_seq":38,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:58:42.823851+0000","last_change":"2024-09-14T11:58:43.694459+0000","last_active":"2024-09-14T12:58:42.823851+0000","last_peered":"2024-09-14T12:58:42.823851+0000","last_clean":"2024-09-14T12:58:42.823851+0000","last_became_active":"2024-09-14T11:58:43.693847+0000","last_became_peered":"2024-09-14T11:58:43.693847+0000","last_unstale":"2024-09-14T12:58:42.823851+0000","last_undegraded":"2024-09-14T12:58:42.823851+0000","last_fullsized":"2024-09-14T12:58:42.823851+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:58:42.635024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:58:42.635024+0000","last_clean_scrub_stamp":"2024-09-14T11:58:42.635024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:49:04.187747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.1c","version":"267'9","reported_seq":74,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:00.330927+0000","last_change":"2024-09-14T11:30:17.525550+0000","last_active":"2024-09-14T13:02:00.330927+0000","last_peered":"2024-09-14T13:02:00.330927+0000","last_clean":"2024-09-14T13:02:00.330927+0000","last_became_active":"2024-09-14T11:30:17.524810+0000","last_became_peered":"2024-09-14T11:30:17.524810+0000","last_unstale":"2024-09-14T13:02:00.330927+0000","last_undegraded":"2024-09-14T13:02:00.330927+0000","last_fullsized":"2024-09-14T13:02:00.330927+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:30:16.474654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:30:16.474654+0000","last_clean_scrub_stamp":"2024-09-14T11:30:16.474654+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:05:01.153652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":11636,"num_write":14,"num_write_kb":6842,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.1d","version":"0'0","reported_seq":65,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:57:43.447885+0000","last_change":"2024-09-14T11:30:10.475624+0000","last_active":"2024-09-14T12:57:43.447885+0000","last_peered":"2024-09-14T12:57:43.447885+0000","last_clean":"2024-09-14T12:57:43.447885+0000","last_became_active":"2024-09-14T11:30:10.474889+0000","last_became_peered":"2024-09-14T11:30:10.474889+0000","last_unstale":"2024-09-14T12:57:43.447885+0000","last_undegraded":"2024-09-14T12:57:43.447885+0000","last_fullsized":"2024-09-14T12:57:43.447885+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:30:09.411354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:30:09.411354+0000","last_clean_scrub_stamp":"2024-09-14T11:30:09.411354+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:14:21.245898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.1e","version":"267'279","reported_seq":912,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:58:42.824027+0000","last_change":"2024-09-14T11:24:10.091187+0000","last_active":"2024-09-14T12:58:42.824027+0000","last_peered":"2024-09-14T12:58:42.824027+0000","last_clean":"2024-09-14T12:58:42.824027+0000","last_became_active":"2024-09-14T11:24:10.090434+0000","last_became_peered":"2024-09-14T11:24:10.090434+0000","last_unstale":"2024-09-14T12:58:42.824027+0000","last_undegraded":"2024-09-14T12:58:42.824027+0000","last_fullsized":"2024-09-14T12:58:42.824027+0000","mapping_epoch":254,"log_start":"264'200","ondisk_log_start":"264'200","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:24:09.066501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:24:09.066501+0000","last_clean_scrub_stamp":"2024-09-14T11:24:09.066501+0000","objects_scrubbed":0,"log_size":79,"log_dups_size":200,"ondisk_log_size":79,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:12:05.681242+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2587,"num_read_kb":3188,"num_write":542,"num_write_kb":246,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.18","version":"0'0","reported_seq":39,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:59:08.431805+0000","last_change":"2024-09-14T11:58:43.686083+0000","last_active":"2024-09-14T12:59:08.431805+0000","last_peered":"2024-09-14T12:59:08.431805+0000","last_clean":"2024-09-14T12:59:08.431805+0000","last_became_active":"2024-09-14T11:58:43.685333+0000","last_became_peered":"2024-09-14T11:58:43.685333+0000","last_unstale":"2024-09-14T12:59:08.431805+0000","last_undegraded":"2024-09-14T12:59:08.431805+0000","last_fullsized":"2024-09-14T12:59:08.431805+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:58:42.635024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:58:42.635024+0000","last_clean_scrub_stamp":"2024-09-14T11:58:42.635024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:32:25.076693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"67.1f","version":"267'4","reported_seq":74,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:01:58.286722+0000","last_change":"2024-09-14T11:30:17.501198+0000","last_active":"2024-09-14T13:01:58.286722+0000","last_peered":"2024-09-14T13:01:58.286722+0000","last_clean":"2024-09-14T13:01:58.286722+0000","last_became_active":"2024-09-14T11:30:17.500369+0000","last_became_peered":"2024-09-14T11:30:17.500369+0000","last_unstale":"2024-09-14T13:01:58.286722+0000","last_undegraded":"2024-09-14T13:01:58.286722+0000","last_fullsized":"2024-09-14T13:01:58.286722+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:30:16.474654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:30:16.474654+0000","last_clean_scrub_stamp":"2024-09-14T11:30:16.474654+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:11:41.361082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":8192,"num_write":4,"num_write_kb":8192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.1e","version":"264'4","reported_seq":84,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:58:42.824072+0000","last_change":"2024-09-14T11:30:10.446414+0000","last_active":"2024-09-14T12:58:42.824072+0000","last_peered":"2024-09-14T12:58:42.824072+0000","last_clean":"2024-09-14T12:58:42.824072+0000","last_became_active":"2024-09-14T11:30:10.445613+0000","last_became_peered":"2024-09-14T11:30:10.445613+0000","last_unstale":"2024-09-14T12:58:42.824072+0000","last_undegraded":"2024-09-14T12:58:42.824072+0000","last_fullsized":"2024-09-14T12:58:42.824072+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:30:09.411354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:30:09.411354+0000","last_clean_scrub_stamp":"2024-09-14T11:30:09.411354+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:21:50.415695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":4098,"num_write":4,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.1d","version":"267'16","reported_seq":119,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:59:13.248167+0000","last_change":"2024-09-14T11:24:10.112019+0000","last_active":"2024-09-14T12:59:13.248167+0000","last_peered":"2024-09-14T12:59:13.248167+0000","last_clean":"2024-09-14T12:59:13.248167+0000","last_became_active":"2024-09-14T11:24:10.111323+0000","last_became_peered":"2024-09-14T11:24:10.111323+0000","last_unstale":"2024-09-14T12:59:13.248167+0000","last_undegraded":"2024-09-14T12:59:13.248167+0000","last_fullsized":"2024-09-14T12:59:13.248167+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:24:09.066501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:24:09.066501+0000","last_clean_scrub_stamp":"2024-09-14T11:24:09.066501+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:39:25.435594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":134,"num_read_kb":93,"num_write":40,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.19","version":"0'0","reported_seq":39,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:59:18.471470+0000","last_change":"2024-09-14T11:58:43.701511+0000","last_active":"2024-09-14T12:59:18.471470+0000","last_peered":"2024-09-14T12:59:18.471470+0000","last_clean":"2024-09-14T12:59:18.471470+0000","last_became_active":"2024-09-14T11:58:43.700281+0000","last_became_peered":"2024-09-14T11:58:43.700281+0000","last_unstale":"2024-09-14T12:59:18.471470+0000","last_undegraded":"2024-09-14T12:59:18.471470+0000","last_fullsized":"2024-09-14T12:59:18.471470+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:58:42.635024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:58:42.635024+0000","last_clean_scrub_stamp":"2024-09-14T11:58:42.635024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:42:11.274748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.1e","version":"267'6","reported_seq":77,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:00.453729+0000","last_change":"2024-09-14T11:30:17.539744+0000","last_active":"2024-09-14T13:02:00.453729+0000","last_peered":"2024-09-14T13:02:00.453729+0000","last_clean":"2024-09-14T13:02:00.453729+0000","last_became_active":"2024-09-14T11:30:17.534642+0000","last_became_peered":"2024-09-14T11:30:17.534642+0000","last_unstale":"2024-09-14T13:02:00.453729+0000","last_undegraded":"2024-09-14T13:02:00.453729+0000","last_fullsized":"2024-09-14T13:02:00.453729+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:30:16.474654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:30:16.474654+0000","last_clean_scrub_stamp":"2024-09-14T11:30:16.474654+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:11:49.468312+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":1064,"num_write":6,"num_write_kb":2088,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.1f","version":"267'2","reported_seq":75,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:01:53.070938+0000","last_change":"2024-09-14T11:30:10.443371+0000","last_active":"2024-09-14T13:01:53.070938+0000","last_peered":"2024-09-14T13:01:53.070938+0000","last_clean":"2024-09-14T13:01:53.070938+0000","last_became_active":"2024-09-14T11:30:10.442597+0000","last_became_peered":"2024-09-14T11:30:10.442597+0000","last_unstale":"2024-09-14T13:01:53.070938+0000","last_undegraded":"2024-09-14T13:01:53.070938+0000","last_fullsized":"2024-09-14T13:01:53.070938+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:30:09.411354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:30:09.411354+0000","last_clean_scrub_stamp":"2024-09-14T11:30:09.411354+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:25:51.419864+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.1c","version":"267'41","reported_seq":188,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:59:13.470500+0000","last_change":"2024-09-14T11:24:10.128607+0000","last_active":"2024-09-14T12:59:13.470500+0000","last_peered":"2024-09-14T12:59:13.470500+0000","last_clean":"2024-09-14T12:59:13.470500+0000","last_became_active":"2024-09-14T11:24:10.124422+0000","last_became_peered":"2024-09-14T11:24:10.124422+0000","last_unstale":"2024-09-14T12:59:13.470500+0000","last_undegraded":"2024-09-14T12:59:13.470500+0000","last_fullsized":"2024-09-14T12:59:13.470500+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:24:09.066501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:24:09.066501+0000","last_clean_scrub_stamp":"2024-09-14T11:24:09.066501+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":0,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:13:03.605737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":350,"num_read_kb":247,"num_write":96,"num_write_kb":33,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.1e","version":"0'0","reported_seq":44,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:58:53.465451+0000","last_change":"2024-09-14T11:58:43.694842+0000","last_active":"2024-09-14T12:58:53.465451+0000","last_peered":"2024-09-14T12:58:53.465451+0000","last_clean":"2024-09-14T12:58:53.465451+0000","last_became_active":"2024-09-14T11:58:43.693760+0000","last_became_peered":"2024-09-14T11:58:43.693760+0000","last_unstale":"2024-09-14T12:58:53.465451+0000","last_undegraded":"2024-09-14T12:58:53.465451+0000","last_fullsized":"2024-09-14T12:58:53.465451+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:58:42.635024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:58:42.635024+0000","last_clean_scrub_stamp":"2024-09-14T11:58:42.635024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:18:34.791994+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.19","version":"0'0","reported_seq":60,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:57:43.030891+0000","last_change":"2024-09-14T11:30:17.531794+0000","last_active":"2024-09-14T12:57:43.030891+0000","last_peered":"2024-09-14T12:57:43.030891+0000","last_clean":"2024-09-14T12:57:43.030891+0000","last_became_active":"2024-09-14T11:30:17.531325+0000","last_became_peered":"2024-09-14T11:30:17.531325+0000","last_unstale":"2024-09-14T12:57:43.030891+0000","last_undegraded":"2024-09-14T12:57:43.030891+0000","last_fullsized":"2024-09-14T12:57:43.030891+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:30:16.474654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:30:16.474654+0000","last_clean_scrub_stamp":"2024-09-14T11:30:16.474654+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:04:12.434378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.18","version":"264'8","reported_seq":83,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:59:38.253969+0000","last_change":"2024-09-14T11:30:10.461819+0000","last_active":"2024-09-14T12:59:38.253969+0000","last_peered":"2024-09-14T12:59:38.253969+0000","last_clean":"2024-09-14T12:59:38.253969+0000","last_became_active":"2024-09-14T11:30:10.461101+0000","last_became_peered":"2024-09-14T11:30:10.461101+0000","last_unstale":"2024-09-14T12:59:38.253969+0000","last_undegraded":"2024-09-14T12:59:38.253969+0000","last_fullsized":"2024-09-14T12:59:38.253969+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:30:09.411354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:30:09.411354+0000","last_clean_scrub_stamp":"2024-09-14T11:30:09.411354+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:19:37.256749+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":8194,"num_write":18,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.1b","version":"264'28","reported_seq":149,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:59:13.470382+0000","last_change":"2024-09-14T11:24:10.130205+0000","last_active":"2024-09-14T12:59:13.470382+0000","last_peered":"2024-09-14T12:59:13.470382+0000","last_clean":"2024-09-14T12:59:13.470382+0000","last_became_active":"2024-09-14T11:24:10.129087+0000","last_became_peered":"2024-09-14T11:24:10.129087+0000","last_unstale":"2024-09-14T12:59:13.470382+0000","last_undegraded":"2024-09-14T12:59:13.470382+0000","last_fullsized":"2024-09-14T12:59:13.470382+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:24:09.066501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:24:09.066501+0000","last_clean_scrub_stamp":"2024-09-14T11:24:09.066501+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:55:41.881393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":229,"num_read_kb":159,"num_write":68,"num_write_kb":22,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.1f","version":"0'0","reported_seq":43,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:59:08.466883+0000","last_change":"2024-09-14T11:58:43.686856+0000","last_active":"2024-09-14T12:59:08.466883+0000","last_peered":"2024-09-14T12:59:08.466883+0000","last_clean":"2024-09-14T12:59:08.466883+0000","last_became_active":"2024-09-14T11:58:43.676679+0000","last_became_peered":"2024-09-14T11:58:43.676679+0000","last_unstale":"2024-09-14T12:59:08.466883+0000","last_undegraded":"2024-09-14T12:59:08.466883+0000","last_fullsized":"2024-09-14T12:59:08.466883+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:58:42.635024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:58:42.635024+0000","last_clean_scrub_stamp":"2024-09-14T11:58:42.635024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:32:45.311295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"67.18","version":"264'8","reported_seq":79,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:59:43.439486+0000","last_change":"2024-09-14T11:30:17.546333+0000","last_active":"2024-09-14T12:59:43.439486+0000","last_peered":"2024-09-14T12:59:43.439486+0000","last_clean":"2024-09-14T12:59:43.439486+0000","last_became_active":"2024-09-14T11:30:17.545478+0000","last_became_peered":"2024-09-14T11:30:17.545478+0000","last_unstale":"2024-09-14T12:59:43.439486+0000","last_undegraded":"2024-09-14T12:59:43.439486+0000","last_fullsized":"2024-09-14T12:59:43.439486+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:30:16.474654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:30:16.474654+0000","last_clean_scrub_stamp":"2024-09-14T11:30:16.474654+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":4166,"num_write":8,"num_write_kb":1092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"66.19","version":"267'7","reported_seq":76,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:00.190828+0000","last_change":"2024-09-14T11:30:10.467953+0000","last_active":"2024-09-14T13:02:00.190828+0000","last_peered":"2024-09-14T13:02:00.190828+0000","last_clean":"2024-09-14T13:02:00.190828+0000","last_became_active":"2024-09-14T11:30:10.467266+0000","last_became_peered":"2024-09-14T11:30:10.467266+0000","last_unstale":"2024-09-14T13:02:00.190828+0000","last_undegraded":"2024-09-14T13:02:00.190828+0000","last_fullsized":"2024-09-14T13:02:00.190828+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:30:09.411354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:30:09.411354+0000","last_clean_scrub_stamp":"2024-09-14T11:30:09.411354+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:25:57.710422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":1047,"num_write":12,"num_write_kb":2071,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.1a","version":"267'87","reported_seq":314,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:59:13.433017+0000","last_change":"2024-09-14T11:24:10.121775+0000","last_active":"2024-09-14T12:59:13.433017+0000","last_peered":"2024-09-14T12:59:13.433017+0000","last_clean":"2024-09-14T12:59:13.433017+0000","last_became_active":"2024-09-14T11:24:10.121048+0000","last_became_peered":"2024-09-14T11:24:10.121048+0000","last_unstale":"2024-09-14T12:59:13.433017+0000","last_undegraded":"2024-09-14T12:59:13.433017+0000","last_fullsized":"2024-09-14T12:59:13.433017+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:24:09.066501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:24:09.066501+0000","last_clean_scrub_stamp":"2024-09-14T11:24:09.066501+0000","objects_scrubbed":0,"log_size":87,"log_dups_size":0,"ondisk_log_size":87,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:56:22.236572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":696,"num_read_kb":437,"num_write":216,"num_write_kb":62,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.1c","version":"267'1","reported_seq":39,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:58:47.835392+0000","last_change":"2024-09-14T11:58:43.685706+0000","last_active":"2024-09-14T12:58:47.835392+0000","last_peered":"2024-09-14T12:58:47.835392+0000","last_clean":"2024-09-14T12:58:47.835392+0000","last_became_active":"2024-09-14T11:58:43.684984+0000","last_became_peered":"2024-09-14T11:58:43.684984+0000","last_unstale":"2024-09-14T12:58:47.835392+0000","last_undegraded":"2024-09-14T12:58:47.835392+0000","last_fullsized":"2024-09-14T12:58:47.835392+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:58:42.635024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:58:42.635024+0000","last_clean_scrub_stamp":"2024-09-14T11:58:42.635024+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:29:12.171056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.1b","version":"0'0","reported_seq":59,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:57:48.606470+0000","last_change":"2024-09-14T11:30:17.527032+0000","last_active":"2024-09-14T12:57:48.606470+0000","last_peered":"2024-09-14T12:57:48.606470+0000","last_clean":"2024-09-14T12:57:48.606470+0000","last_became_active":"2024-09-14T11:30:17.526195+0000","last_became_peered":"2024-09-14T11:30:17.526195+0000","last_unstale":"2024-09-14T12:57:48.606470+0000","last_undegraded":"2024-09-14T12:57:48.606470+0000","last_fullsized":"2024-09-14T12:57:48.606470+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:30:16.474654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:30:16.474654+0000","last_clean_scrub_stamp":"2024-09-14T11:30:16.474654+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:49:29.835475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"66.1a","version":"264'2","reported_seq":69,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:57:43.214859+0000","last_change":"2024-09-14T11:30:10.443423+0000","last_active":"2024-09-14T12:57:43.214859+0000","last_peered":"2024-09-14T12:57:43.214859+0000","last_clean":"2024-09-14T12:57:43.214859+0000","last_became_active":"2024-09-14T11:30:10.442753+0000","last_became_peered":"2024-09-14T11:30:10.442753+0000","last_unstale":"2024-09-14T12:57:43.214859+0000","last_undegraded":"2024-09-14T12:57:43.214859+0000","last_fullsized":"2024-09-14T12:57:43.214859+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:30:09.411354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:30:09.411354+0000","last_clean_scrub_stamp":"2024-09-14T11:30:09.411354+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:17:07.453981+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":4096,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.19","version":"267'12","reported_seq":105,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:58:53.242473+0000","last_change":"2024-09-14T11:24:10.099618+0000","last_active":"2024-09-14T12:58:53.242473+0000","last_peered":"2024-09-14T12:58:53.242473+0000","last_clean":"2024-09-14T12:58:53.242473+0000","last_became_active":"2024-09-14T11:24:10.098890+0000","last_became_peered":"2024-09-14T11:24:10.098890+0000","last_unstale":"2024-09-14T12:58:53.242473+0000","last_undegraded":"2024-09-14T12:58:53.242473+0000","last_fullsized":"2024-09-14T12:58:53.242473+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:24:09.066501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:24:09.066501+0000","last_clean_scrub_stamp":"2024-09-14T11:24:09.066501+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:33:18.468820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":81,"num_read_kb":53,"num_write":29,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.1d","version":"0'0","reported_seq":38,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:58:47.835476+0000","last_change":"2024-09-14T11:58:43.688034+0000","last_active":"2024-09-14T12:58:47.835476+0000","last_peered":"2024-09-14T12:58:47.835476+0000","last_clean":"2024-09-14T12:58:47.835476+0000","last_became_active":"2024-09-14T11:58:43.687072+0000","last_became_peered":"2024-09-14T11:58:43.687072+0000","last_unstale":"2024-09-14T12:58:47.835476+0000","last_undegraded":"2024-09-14T12:58:47.835476+0000","last_fullsized":"2024-09-14T12:58:47.835476+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:58:42.635024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:58:42.635024+0000","last_clean_scrub_stamp":"2024-09-14T11:58:42.635024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:54:30.111603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.1a","version":"0'0","reported_seq":59,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:57:48.450199+0000","last_change":"2024-09-14T11:30:17.535485+0000","last_active":"2024-09-14T12:57:48.450199+0000","last_peered":"2024-09-14T12:57:48.450199+0000","last_clean":"2024-09-14T12:57:48.450199+0000","last_became_active":"2024-09-14T11:30:17.534937+0000","last_became_peered":"2024-09-14T11:30:17.534937+0000","last_unstale":"2024-09-14T12:57:48.450199+0000","last_undegraded":"2024-09-14T12:57:48.450199+0000","last_fullsized":"2024-09-14T12:57:48.450199+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:30:16.474654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:30:16.474654+0000","last_clean_scrub_stamp":"2024-09-14T11:30:16.474654+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:48:56.727170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.1b","version":"267'6","reported_seq":76,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:00.396483+0000","last_change":"2024-09-14T11:30:10.461481+0000","last_active":"2024-09-14T13:02:00.396483+0000","last_peered":"2024-09-14T13:02:00.396483+0000","last_clean":"2024-09-14T13:02:00.396483+0000","last_became_active":"2024-09-14T11:30:10.460666+0000","last_became_peered":"2024-09-14T11:30:10.460666+0000","last_unstale":"2024-09-14T13:02:00.396483+0000","last_undegraded":"2024-09-14T13:02:00.396483+0000","last_fullsized":"2024-09-14T13:02:00.396483+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:30:09.411354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:30:09.411354+0000","last_clean_scrub_stamp":"2024-09-14T11:30:09.411354+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:56:08.121178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":14336,"num_write":6,"num_write_kb":10240,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.18","version":"267'142","reported_seq":495,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:58:28.457825+0000","last_change":"2024-09-14T11:24:10.121116+0000","last_active":"2024-09-14T12:58:28.457825+0000","last_peered":"2024-09-14T12:58:28.457825+0000","last_clean":"2024-09-14T12:58:28.457825+0000","last_became_active":"2024-09-14T11:24:10.117854+0000","last_became_peered":"2024-09-14T11:24:10.117854+0000","last_unstale":"2024-09-14T12:58:28.457825+0000","last_undegraded":"2024-09-14T12:58:28.457825+0000","last_fullsized":"2024-09-14T12:58:28.457825+0000","mapping_epoch":254,"log_start":"264'100","ondisk_log_start":"264'100","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:24:09.066501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:24:09.066501+0000","last_clean_scrub_stamp":"2024-09-14T11:24:09.066501+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":100,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:44:16.667239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1285,"num_read_kb":1365,"num_write":297,"num_write_kb":120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"68.12","version":"0'0","reported_seq":40,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:59:23.469971+0000","last_change":"2024-09-14T11:58:43.678310+0000","last_active":"2024-09-14T12:59:23.469971+0000","last_peered":"2024-09-14T12:59:23.469971+0000","last_clean":"2024-09-14T12:59:23.469971+0000","last_became_active":"2024-09-14T11:58:43.675254+0000","last_became_peered":"2024-09-14T11:58:43.675254+0000","last_unstale":"2024-09-14T12:59:23.469971+0000","last_undegraded":"2024-09-14T12:59:23.469971+0000","last_fullsized":"2024-09-14T12:59:23.469971+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:58:42.635024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:58:42.635024+0000","last_clean_scrub_stamp":"2024-09-14T11:58:42.635024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:53:22.218376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"67.15","version":"267'2","reported_seq":65,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:00.038220+0000","last_change":"2024-09-14T11:30:17.539875+0000","last_active":"2024-09-14T13:02:00.038220+0000","last_peered":"2024-09-14T13:02:00.038220+0000","last_clean":"2024-09-14T13:02:00.038220+0000","last_became_active":"2024-09-14T11:30:17.536010+0000","last_became_peered":"2024-09-14T11:30:17.536010+0000","last_unstale":"2024-09-14T13:02:00.038220+0000","last_undegraded":"2024-09-14T13:02:00.038220+0000","last_fullsized":"2024-09-14T13:02:00.038220+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:30:16.474654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:30:16.474654+0000","last_clean_scrub_stamp":"2024-09-14T11:30:16.474654+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":8192,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.14","version":"267'5","reported_seq":76,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:01:38.084001+0000","last_change":"2024-09-14T11:30:10.463826+0000","last_active":"2024-09-14T13:01:38.084001+0000","last_peered":"2024-09-14T13:01:38.084001+0000","last_clean":"2024-09-14T13:01:38.084001+0000","last_became_active":"2024-09-14T11:30:10.462605+0000","last_became_peered":"2024-09-14T11:30:10.462605+0000","last_unstale":"2024-09-14T13:01:38.084001+0000","last_undegraded":"2024-09-14T13:01:38.084001+0000","last_fullsized":"2024-09-14T13:01:38.084001+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:30:09.411354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:30:09.411354+0000","last_clean_scrub_stamp":"2024-09-14T11:30:09.411354+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:10:34.672801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5120,"num_write":10,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.17","version":"267'12","reported_seq":105,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:58:28.236663+0000","last_change":"2024-09-14T11:24:10.104884+0000","last_active":"2024-09-14T12:58:28.236663+0000","last_peered":"2024-09-14T12:58:28.236663+0000","last_clean":"2024-09-14T12:58:28.236663+0000","last_became_active":"2024-09-14T11:24:10.101934+0000","last_became_peered":"2024-09-14T11:24:10.101934+0000","last_unstale":"2024-09-14T12:58:28.236663+0000","last_undegraded":"2024-09-14T12:58:28.236663+0000","last_fullsized":"2024-09-14T12:58:28.236663+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:24:09.066501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:24:09.066501+0000","last_clean_scrub_stamp":"2024-09-14T11:24:09.066501+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:18:41.803884+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":86,"num_read_kb":56,"num_write":31,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.13","version":"267'1","reported_seq":41,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:59:22.832843+0000","last_change":"2024-09-14T11:58:43.676310+0000","last_active":"2024-09-14T12:59:22.832843+0000","last_peered":"2024-09-14T12:59:22.832843+0000","last_clean":"2024-09-14T12:59:22.832843+0000","last_became_active":"2024-09-14T11:58:43.675526+0000","last_became_peered":"2024-09-14T11:58:43.675526+0000","last_unstale":"2024-09-14T12:59:22.832843+0000","last_undegraded":"2024-09-14T12:59:22.832843+0000","last_fullsized":"2024-09-14T12:59:22.832843+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:58:42.635024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:58:42.635024+0000","last_clean_scrub_stamp":"2024-09-14T11:58:42.635024+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:44:06.879207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.14","version":"267'7","reported_seq":76,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:01:38.503480+0000","last_change":"2024-09-14T11:30:17.544306+0000","last_active":"2024-09-14T13:01:38.503480+0000","last_peered":"2024-09-14T13:01:38.503480+0000","last_clean":"2024-09-14T13:01:38.503480+0000","last_became_active":"2024-09-14T11:30:17.543741+0000","last_became_peered":"2024-09-14T11:30:17.543741+0000","last_unstale":"2024-09-14T13:01:38.503480+0000","last_undegraded":"2024-09-14T13:01:38.503480+0000","last_fullsized":"2024-09-14T13:01:38.503480+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:30:16.474654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:30:16.474654+0000","last_clean_scrub_stamp":"2024-09-14T11:30:16.474654+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:33:14.837541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":20482,"num_write":12,"num_write_kb":8192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.15","version":"267'3","reported_seq":72,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:00.466429+0000","last_change":"2024-09-14T11:30:10.468990+0000","last_active":"2024-09-14T13:02:00.466429+0000","last_peered":"2024-09-14T13:02:00.466429+0000","last_clean":"2024-09-14T13:02:00.466429+0000","last_became_active":"2024-09-14T11:30:10.468238+0000","last_became_peered":"2024-09-14T11:30:10.468238+0000","last_unstale":"2024-09-14T13:02:00.466429+0000","last_undegraded":"2024-09-14T13:02:00.466429+0000","last_fullsized":"2024-09-14T13:02:00.466429+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:30:09.411354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:30:09.411354+0000","last_clean_scrub_stamp":"2024-09-14T11:30:09.411354+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:48:16.808159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2048,"num_write":8,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.16","version":"267'33","reported_seq":168,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:58:28.459408+0000","last_change":"2024-09-14T11:24:10.129833+0000","last_active":"2024-09-14T12:58:28.459408+0000","last_peered":"2024-09-14T12:58:28.459408+0000","last_clean":"2024-09-14T12:58:28.459408+0000","last_became_active":"2024-09-14T11:24:10.128354+0000","last_became_peered":"2024-09-14T11:24:10.128354+0000","last_unstale":"2024-09-14T12:58:28.459408+0000","last_undegraded":"2024-09-14T12:58:28.459408+0000","last_fullsized":"2024-09-14T12:58:28.459408+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:24:09.066501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:24:09.066501+0000","last_clean_scrub_stamp":"2024-09-14T11:24:09.066501+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:04:36.875537+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":269,"num_read_kb":173,"num_write":83,"num_write_kb":23,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.10","version":"0'0","reported_seq":40,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:59:27.844631+0000","last_change":"2024-09-14T11:58:43.689414+0000","last_active":"2024-09-14T12:59:27.844631+0000","last_peered":"2024-09-14T12:59:27.844631+0000","last_clean":"2024-09-14T12:59:27.844631+0000","last_became_active":"2024-09-14T11:58:43.688698+0000","last_became_peered":"2024-09-14T11:58:43.688698+0000","last_unstale":"2024-09-14T12:59:27.844631+0000","last_undegraded":"2024-09-14T12:59:27.844631+0000","last_fullsized":"2024-09-14T12:59:27.844631+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:58:42.635024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:58:42.635024+0000","last_clean_scrub_stamp":"2024-09-14T11:58:42.635024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:13:07.184551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.17","version":"267'5","reported_seq":71,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:00.341066+0000","last_change":"2024-09-14T11:30:17.544374+0000","last_active":"2024-09-14T13:02:00.341066+0000","last_peered":"2024-09-14T13:02:00.341066+0000","last_clean":"2024-09-14T13:02:00.341066+0000","last_became_active":"2024-09-14T11:30:17.543802+0000","last_became_peered":"2024-09-14T11:30:17.543802+0000","last_unstale":"2024-09-14T13:02:00.341066+0000","last_undegraded":"2024-09-14T13:02:00.341066+0000","last_fullsized":"2024-09-14T13:02:00.341066+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:30:16.474654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:30:16.474654+0000","last_clean_scrub_stamp":"2024-09-14T11:30:16.474654+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":20480,"num_write":10,"num_write_kb":8192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.16","version":"264'4","reported_seq":77,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:59:37.836003+0000","last_change":"2024-09-14T11:30:10.472659+0000","last_active":"2024-09-14T12:59:37.836003+0000","last_peered":"2024-09-14T12:59:37.836003+0000","last_clean":"2024-09-14T12:59:37.836003+0000","last_became_active":"2024-09-14T11:30:10.471956+0000","last_became_peered":"2024-09-14T11:30:10.471956+0000","last_unstale":"2024-09-14T12:59:37.836003+0000","last_undegraded":"2024-09-14T12:59:37.836003+0000","last_fullsized":"2024-09-14T12:59:37.836003+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:30:09.411354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:30:09.411354+0000","last_clean_scrub_stamp":"2024-09-14T11:30:09.411354+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:46:34.361903+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":4098,"num_write":4,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.15","version":"267'34","reported_seq":165,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:58:27.820574+0000","last_change":"2024-09-14T11:24:10.097703+0000","last_active":"2024-09-14T12:58:27.820574+0000","last_peered":"2024-09-14T12:58:27.820574+0000","last_clean":"2024-09-14T12:58:27.820574+0000","last_became_active":"2024-09-14T11:24:10.097011+0000","last_became_peered":"2024-09-14T11:24:10.097011+0000","last_unstale":"2024-09-14T12:58:27.820574+0000","last_undegraded":"2024-09-14T12:58:27.820574+0000","last_fullsized":"2024-09-14T12:58:27.820574+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:24:09.066501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:24:09.066501+0000","last_clean_scrub_stamp":"2024-09-14T11:24:09.066501+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:37:34.066370+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":263,"num_read_kb":166,"num_write":89,"num_write_kb":24,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.11","version":"0'0","reported_seq":40,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:59:23.053229+0000","last_change":"2024-09-14T11:58:43.689926+0000","last_active":"2024-09-14T12:59:23.053229+0000","last_peered":"2024-09-14T12:59:23.053229+0000","last_clean":"2024-09-14T12:59:23.053229+0000","last_became_active":"2024-09-14T11:58:43.688315+0000","last_became_peered":"2024-09-14T11:58:43.688315+0000","last_unstale":"2024-09-14T12:59:23.053229+0000","last_undegraded":"2024-09-14T12:59:23.053229+0000","last_fullsized":"2024-09-14T12:59:23.053229+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:58:42.635024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:58:42.635024+0000","last_clean_scrub_stamp":"2024-09-14T11:58:42.635024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:41:40.616158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.16","version":"0'0","reported_seq":61,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:59:43.242563+0000","last_change":"2024-09-14T11:30:17.529543+0000","last_active":"2024-09-14T12:59:43.242563+0000","last_peered":"2024-09-14T12:59:43.242563+0000","last_clean":"2024-09-14T12:59:43.242563+0000","last_became_active":"2024-09-14T11:30:17.528777+0000","last_became_peered":"2024-09-14T11:30:17.528777+0000","last_unstale":"2024-09-14T12:59:43.242563+0000","last_undegraded":"2024-09-14T12:59:43.242563+0000","last_fullsized":"2024-09-14T12:59:43.242563+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:30:16.474654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:30:16.474654+0000","last_clean_scrub_stamp":"2024-09-14T11:30:16.474654+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.17","version":"267'4","reported_seq":73,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:00.395180+0000","last_change":"2024-09-14T11:30:10.473815+0000","last_active":"2024-09-14T13:02:00.395180+0000","last_peered":"2024-09-14T13:02:00.395180+0000","last_clean":"2024-09-14T13:02:00.395180+0000","last_became_active":"2024-09-14T11:30:10.469237+0000","last_became_peered":"2024-09-14T11:30:10.469237+0000","last_unstale":"2024-09-14T13:02:00.395180+0000","last_undegraded":"2024-09-14T13:02:00.395180+0000","last_fullsized":"2024-09-14T13:02:00.395180+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:30:09.411354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:30:09.411354+0000","last_clean_scrub_stamp":"2024-09-14T11:30:09.411354+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:02:16.697692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":4794,"num_write":4,"num_write_kb":4794,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.14","version":"267'34","reported_seq":163,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:58:02.824925+0000","last_change":"2024-09-14T11:24:10.120917+0000","last_active":"2024-09-14T12:58:02.824925+0000","last_peered":"2024-09-14T12:58:02.824925+0000","last_clean":"2024-09-14T12:58:02.824925+0000","last_became_active":"2024-09-14T11:24:10.120143+0000","last_became_peered":"2024-09-14T11:24:10.120143+0000","last_unstale":"2024-09-14T12:58:02.824925+0000","last_undegraded":"2024-09-14T12:58:02.824925+0000","last_fullsized":"2024-09-14T12:58:02.824925+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:24:09.066501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:24:09.066501+0000","last_clean_scrub_stamp":"2024-09-14T11:24:09.066501+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:47:01.835320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":239,"num_read_kb":157,"num_write":95,"num_write_kb":23,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.16","version":"0'0","reported_seq":39,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:59:08.469272+0000","last_change":"2024-09-14T11:58:43.687060+0000","last_active":"2024-09-14T12:59:08.469272+0000","last_peered":"2024-09-14T12:59:08.469272+0000","last_clean":"2024-09-14T12:59:08.469272+0000","last_became_active":"2024-09-14T11:58:43.685594+0000","last_became_peered":"2024-09-14T11:58:43.685594+0000","last_unstale":"2024-09-14T12:59:08.469272+0000","last_undegraded":"2024-09-14T12:59:08.469272+0000","last_fullsized":"2024-09-14T12:59:08.469272+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:58:42.635024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:58:42.635024+0000","last_clean_scrub_stamp":"2024-09-14T11:58:42.635024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:15:01.961069+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.11","version":"264'4","reported_seq":72,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:58:58.464568+0000","last_change":"2024-09-14T11:30:17.524449+0000","last_active":"2024-09-14T12:58:58.464568+0000","last_peered":"2024-09-14T12:58:58.464568+0000","last_clean":"2024-09-14T12:58:58.464568+0000","last_became_active":"2024-09-14T11:30:17.523720+0000","last_became_peered":"2024-09-14T11:30:17.523720+0000","last_unstale":"2024-09-14T12:58:58.464568+0000","last_undegraded":"2024-09-14T12:58:58.464568+0000","last_fullsized":"2024-09-14T12:58:58.464568+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:30:16.474654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:30:16.474654+0000","last_clean_scrub_stamp":"2024-09-14T11:30:16.474654+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:47:46.829903+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":4098,"num_write":4,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.10","version":"264'2","reported_seq":72,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:58:53.231284+0000","last_change":"2024-09-14T11:30:10.464461+0000","last_active":"2024-09-14T12:58:53.231284+0000","last_peered":"2024-09-14T12:58:53.231284+0000","last_clean":"2024-09-14T12:58:53.231284+0000","last_became_active":"2024-09-14T11:30:10.463671+0000","last_became_peered":"2024-09-14T11:30:10.463671+0000","last_unstale":"2024-09-14T12:58:53.231284+0000","last_undegraded":"2024-09-14T12:58:53.231284+0000","last_fullsized":"2024-09-14T12:58:53.231284+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:30:09.411354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:30:09.411354+0000","last_clean_scrub_stamp":"2024-09-14T11:30:09.411354+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:20:15.603839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":4096,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.13","version":"267'23","reported_seq":140,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:59:52.850626+0000","last_change":"2024-09-14T11:24:10.121802+0000","last_active":"2024-09-14T12:59:52.850626+0000","last_peered":"2024-09-14T12:59:52.850626+0000","last_clean":"2024-09-14T12:59:52.850626+0000","last_became_active":"2024-09-14T11:24:10.120764+0000","last_became_peered":"2024-09-14T11:24:10.120764+0000","last_unstale":"2024-09-14T12:59:52.850626+0000","last_undegraded":"2024-09-14T12:59:52.850626+0000","last_fullsized":"2024-09-14T12:59:52.850626+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:24:09.066501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:24:09.066501+0000","last_clean_scrub_stamp":"2024-09-14T11:24:09.066501+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":187,"num_read_kb":128,"num_write":64,"num_write_kb":17,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.17","version":"0'0","reported_seq":39,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:59:08.247094+0000","last_change":"2024-09-14T11:58:43.677764+0000","last_active":"2024-09-14T12:59:08.247094+0000","last_peered":"2024-09-14T12:59:08.247094+0000","last_clean":"2024-09-14T12:59:08.247094+0000","last_became_active":"2024-09-14T11:58:43.677005+0000","last_became_peered":"2024-09-14T11:58:43.677005+0000","last_unstale":"2024-09-14T12:59:08.247094+0000","last_undegraded":"2024-09-14T12:59:08.247094+0000","last_fullsized":"2024-09-14T12:59:08.247094+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:58:42.635024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:58:42.635024+0000","last_clean_scrub_stamp":"2024-09-14T11:58:42.635024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:38:06.608929+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.10","version":"267'4","reported_seq":68,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:00.350273+0000","last_change":"2024-09-14T11:30:17.510820+0000","last_active":"2024-09-14T13:02:00.350273+0000","last_peered":"2024-09-14T13:02:00.350273+0000","last_clean":"2024-09-14T13:02:00.350273+0000","last_became_active":"2024-09-14T11:30:17.510031+0000","last_became_peered":"2024-09-14T11:30:17.510031+0000","last_unstale":"2024-09-14T13:02:00.350273+0000","last_undegraded":"2024-09-14T13:02:00.350273+0000","last_fullsized":"2024-09-14T13:02:00.350273+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:30:16.474654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:30:16.474654+0000","last_clean_scrub_stamp":"2024-09-14T11:30:16.474654+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:53:33.188778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":2048,"num_write":4,"num_write_kb":2048,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.11","version":"0'0","reported_seq":68,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:58:53.465194+0000","last_change":"2024-09-14T11:30:10.468119+0000","last_active":"2024-09-14T12:58:53.465194+0000","last_peered":"2024-09-14T12:58:53.465194+0000","last_clean":"2024-09-14T12:58:53.465194+0000","last_became_active":"2024-09-14T11:30:10.459020+0000","last_became_peered":"2024-09-14T11:30:10.459020+0000","last_unstale":"2024-09-14T12:58:53.465194+0000","last_undegraded":"2024-09-14T12:58:53.465194+0000","last_fullsized":"2024-09-14T12:58:53.465194+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:30:09.411354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:30:09.411354+0000","last_clean_scrub_stamp":"2024-09-14T11:30:09.411354+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:19:33.421651+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.12","version":"267'21","reported_seq":136,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:59:53.257375+0000","last_change":"2024-09-14T11:24:10.125240+0000","last_active":"2024-09-14T12:59:53.257375+0000","last_peered":"2024-09-14T12:59:53.257375+0000","last_clean":"2024-09-14T12:59:53.257375+0000","last_became_active":"2024-09-14T11:24:10.124482+0000","last_became_peered":"2024-09-14T11:24:10.124482+0000","last_unstale":"2024-09-14T12:59:53.257375+0000","last_undegraded":"2024-09-14T12:59:53.257375+0000","last_fullsized":"2024-09-14T12:59:53.257375+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:24:09.066501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:24:09.066501+0000","last_clean_scrub_stamp":"2024-09-14T11:24:09.066501+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":165,"num_read_kb":113,"num_write":54,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.14","version":"266'1","reported_seq":41,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:59:43.255487+0000","last_change":"2024-09-14T11:58:43.676454+0000","last_active":"2024-09-14T12:59:43.255487+0000","last_peered":"2024-09-14T12:59:43.255487+0000","last_clean":"2024-09-14T12:59:43.255487+0000","last_became_active":"2024-09-14T11:58:43.675734+0000","last_became_peered":"2024-09-14T11:58:43.675734+0000","last_unstale":"2024-09-14T12:59:43.255487+0000","last_undegraded":"2024-09-14T12:59:43.255487+0000","last_fullsized":"2024-09-14T12:59:43.255487+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:58:42.635024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:58:42.635024+0000","last_clean_scrub_stamp":"2024-09-14T11:58:42.635024+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:41:40.899244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.13","version":"267'8","reported_seq":74,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:00.350845+0000","last_change":"2024-09-14T11:30:17.546653+0000","last_active":"2024-09-14T13:02:00.350845+0000","last_peered":"2024-09-14T13:02:00.350845+0000","last_clean":"2024-09-14T13:02:00.350845+0000","last_became_active":"2024-09-14T11:30:17.545560+0000","last_became_peered":"2024-09-14T11:30:17.545560+0000","last_unstale":"2024-09-14T13:02:00.350845+0000","last_undegraded":"2024-09-14T13:02:00.350845+0000","last_fullsized":"2024-09-14T13:02:00.350845+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:30:16.474654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:30:16.474654+0000","last_clean_scrub_stamp":"2024-09-14T11:30:16.474654+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:05:50.325352+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":9216,"num_write":18,"num_write_kb":9216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.12","version":"267'8","reported_seq":82,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:01:13.459469+0000","last_change":"2024-09-14T11:30:10.475068+0000","last_active":"2024-09-14T13:01:13.459469+0000","last_peered":"2024-09-14T13:01:13.459469+0000","last_clean":"2024-09-14T13:01:13.459469+0000","last_became_active":"2024-09-14T11:30:10.474328+0000","last_became_peered":"2024-09-14T11:30:10.474328+0000","last_unstale":"2024-09-14T13:01:13.459469+0000","last_undegraded":"2024-09-14T13:01:13.459469+0000","last_fullsized":"2024-09-14T13:01:13.459469+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:30:09.411354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:30:09.411354+0000","last_clean_scrub_stamp":"2024-09-14T11:30:09.411354+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:23:43.643876+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":16386,"num_write":18,"num_write_kb":8192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"65.11","version":"267'78","reported_seq":293,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:59:53.244704+0000","last_change":"2024-09-14T11:24:10.107937+0000","last_active":"2024-09-14T12:59:53.244704+0000","last_peered":"2024-09-14T12:59:53.244704+0000","last_clean":"2024-09-14T12:59:53.244704+0000","last_became_active":"2024-09-14T11:24:10.107177+0000","last_became_peered":"2024-09-14T11:24:10.107177+0000","last_unstale":"2024-09-14T12:59:53.244704+0000","last_undegraded":"2024-09-14T12:59:53.244704+0000","last_fullsized":"2024-09-14T12:59:53.244704+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:24:09.066501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:24:09.066501+0000","last_clean_scrub_stamp":"2024-09-14T11:24:09.066501+0000","objects_scrubbed":0,"log_size":78,"log_dups_size":0,"ondisk_log_size":78,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":655,"num_read_kb":451,"num_write":184,"num_write_kb":61,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"68.15","version":"267'1","reported_seq":40,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:59:08.469167+0000","last_change":"2024-09-14T11:58:43.694184+0000","last_active":"2024-09-14T12:59:08.469167+0000","last_peered":"2024-09-14T12:59:08.469167+0000","last_clean":"2024-09-14T12:59:08.469167+0000","last_became_active":"2024-09-14T11:58:43.692552+0000","last_became_peered":"2024-09-14T11:58:43.692552+0000","last_unstale":"2024-09-14T12:59:08.469167+0000","last_undegraded":"2024-09-14T12:59:08.469167+0000","last_fullsized":"2024-09-14T12:59:08.469167+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:58:42.635024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:58:42.635024+0000","last_clean_scrub_stamp":"2024-09-14T11:58:42.635024+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:25:30.983665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.12","version":"267'3","reported_seq":65,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:01:18.460519+0000","last_change":"2024-09-14T11:30:17.524803+0000","last_active":"2024-09-14T13:01:18.460519+0000","last_peered":"2024-09-14T13:01:18.460519+0000","last_clean":"2024-09-14T13:01:18.460519+0000","last_became_active":"2024-09-14T11:30:17.523975+0000","last_became_peered":"2024-09-14T11:30:17.523975+0000","last_unstale":"2024-09-14T13:01:18.460519+0000","last_undegraded":"2024-09-14T13:01:18.460519+0000","last_fullsized":"2024-09-14T13:01:18.460519+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:30:16.474654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:30:16.474654+0000","last_clean_scrub_stamp":"2024-09-14T11:30:16.474654+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:12:00.068952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":8,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"66.13","version":"267'2","reported_seq":70,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:01:13.078527+0000","last_change":"2024-09-14T11:30:10.470996+0000","last_active":"2024-09-14T13:01:13.078527+0000","last_peered":"2024-09-14T13:01:13.078527+0000","last_clean":"2024-09-14T13:01:13.078527+0000","last_became_active":"2024-09-14T11:30:10.467218+0000","last_became_peered":"2024-09-14T11:30:10.467218+0000","last_unstale":"2024-09-14T13:01:13.078527+0000","last_undegraded":"2024-09-14T13:01:13.078527+0000","last_fullsized":"2024-09-14T13:01:13.078527+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:30:09.411354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:30:09.411354+0000","last_clean_scrub_stamp":"2024-09-14T11:30:09.411354+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:14:13.258206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.10","version":"267'25","reported_seq":143,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:59:53.479361+0000","last_change":"2024-09-14T11:24:10.128983+0000","last_active":"2024-09-14T12:59:53.479361+0000","last_peered":"2024-09-14T12:59:53.479361+0000","last_clean":"2024-09-14T12:59:53.479361+0000","last_became_active":"2024-09-14T11:24:10.124485+0000","last_became_peered":"2024-09-14T11:24:10.124485+0000","last_unstale":"2024-09-14T12:59:53.479361+0000","last_undegraded":"2024-09-14T12:59:53.479361+0000","last_fullsized":"2024-09-14T12:59:53.479361+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:24:09.066501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:24:09.066501+0000","last_clean_scrub_stamp":"2024-09-14T11:24:09.066501+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":199,"num_read_kb":137,"num_write":62,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.a","version":"0'0","reported_seq":42,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:59:42.836938+0000","last_change":"2024-09-14T11:58:43.665808+0000","last_active":"2024-09-14T12:59:42.836938+0000","last_peered":"2024-09-14T12:59:42.836938+0000","last_clean":"2024-09-14T12:59:42.836938+0000","last_became_active":"2024-09-14T11:58:43.665150+0000","last_became_peered":"2024-09-14T11:58:43.665150+0000","last_unstale":"2024-09-14T12:59:42.836938+0000","last_undegraded":"2024-09-14T12:59:42.836938+0000","last_fullsized":"2024-09-14T12:59:42.836938+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:58:42.635024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:58:42.635024+0000","last_clean_scrub_stamp":"2024-09-14T11:58:42.635024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:47:00.404652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.d","version":"0'0","reported_seq":63,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:58:03.453801+0000","last_change":"2024-09-14T11:30:17.541032+0000","last_active":"2024-09-14T12:58:03.453801+0000","last_peered":"2024-09-14T12:58:03.453801+0000","last_clean":"2024-09-14T12:58:03.453801+0000","last_became_active":"2024-09-14T11:30:17.540505+0000","last_became_peered":"2024-09-14T11:30:17.540505+0000","last_unstale":"2024-09-14T12:58:03.453801+0000","last_undegraded":"2024-09-14T12:58:03.453801+0000","last_fullsized":"2024-09-14T12:58:03.453801+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:30:16.474654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:30:16.474654+0000","last_clean_scrub_stamp":"2024-09-14T11:30:16.474654+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:19:58.382345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.c","version":"264'2","reported_seq":73,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:57:57.823794+0000","last_change":"2024-09-14T11:30:10.465578+0000","last_active":"2024-09-14T12:57:57.823794+0000","last_peered":"2024-09-14T12:57:57.823794+0000","last_clean":"2024-09-14T12:57:57.823794+0000","last_became_active":"2024-09-14T11:30:10.464846+0000","last_became_peered":"2024-09-14T11:30:10.464846+0000","last_unstale":"2024-09-14T12:57:57.823794+0000","last_undegraded":"2024-09-14T12:57:57.823794+0000","last_fullsized":"2024-09-14T12:57:57.823794+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:30:09.411354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:30:09.411354+0000","last_clean_scrub_stamp":"2024-09-14T11:30:09.411354+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:16:48.115696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":4096,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.f","version":"267'23","reported_seq":140,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:59:03.468003+0000","last_change":"2024-09-14T11:24:10.122374+0000","last_active":"2024-09-14T12:59:03.468003+0000","last_peered":"2024-09-14T12:59:03.468003+0000","last_clean":"2024-09-14T12:59:03.468003+0000","last_became_active":"2024-09-14T11:24:10.121456+0000","last_became_peered":"2024-09-14T11:24:10.121456+0000","last_unstale":"2024-09-14T12:59:03.468003+0000","last_undegraded":"2024-09-14T12:59:03.468003+0000","last_fullsized":"2024-09-14T12:59:03.468003+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:24:09.066501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:24:09.066501+0000","last_clean_scrub_stamp":"2024-09-14T11:24:09.066501+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:09:06.754571+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":176,"num_read_kb":127,"num_write":57,"num_write_kb":16,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.b","version":"0'0","reported_seq":41,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:59:32.845960+0000","last_change":"2024-09-14T11:58:43.685677+0000","last_active":"2024-09-14T12:59:32.845960+0000","last_peered":"2024-09-14T12:59:32.845960+0000","last_clean":"2024-09-14T12:59:32.845960+0000","last_became_active":"2024-09-14T11:58:43.684927+0000","last_became_peered":"2024-09-14T11:58:43.684927+0000","last_unstale":"2024-09-14T12:59:32.845960+0000","last_undegraded":"2024-09-14T12:59:32.845960+0000","last_fullsized":"2024-09-14T12:59:32.845960+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:58:42.635024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:58:42.635024+0000","last_clean_scrub_stamp":"2024-09-14T11:58:42.635024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:58:14.472771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.c","version":"267'9","reported_seq":78,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:00.307406+0000","last_change":"2024-09-14T11:30:17.535765+0000","last_active":"2024-09-14T13:02:00.307406+0000","last_peered":"2024-09-14T13:02:00.307406+0000","last_clean":"2024-09-14T13:02:00.307406+0000","last_became_active":"2024-09-14T11:30:17.535131+0000","last_became_peered":"2024-09-14T11:30:17.535131+0000","last_unstale":"2024-09-14T13:02:00.307406+0000","last_undegraded":"2024-09-14T13:02:00.307406+0000","last_fullsized":"2024-09-14T13:02:00.307406+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:30:16.474654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:30:16.474654+0000","last_clean_scrub_stamp":"2024-09-14T11:30:16.474654+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:06:05.667984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":16384,"num_write":14,"num_write_kb":16384,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.d","version":"0'0","reported_seq":69,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:57:57.814167+0000","last_change":"2024-09-14T11:30:10.476534+0000","last_active":"2024-09-14T12:57:57.814167+0000","last_peered":"2024-09-14T12:57:57.814167+0000","last_clean":"2024-09-14T12:57:57.814167+0000","last_became_active":"2024-09-14T11:30:10.475862+0000","last_became_peered":"2024-09-14T11:30:10.475862+0000","last_unstale":"2024-09-14T12:57:57.814167+0000","last_undegraded":"2024-09-14T12:57:57.814167+0000","last_fullsized":"2024-09-14T12:57:57.814167+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:30:09.411354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:30:09.411354+0000","last_clean_scrub_stamp":"2024-09-14T11:30:09.411354+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:09:25.660215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.e","version":"267'20","reported_seq":131,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:58:43.044517+0000","last_change":"2024-09-14T11:24:10.116821+0000","last_active":"2024-09-14T12:58:43.044517+0000","last_peered":"2024-09-14T12:58:43.044517+0000","last_clean":"2024-09-14T12:58:43.044517+0000","last_became_active":"2024-09-14T11:24:10.116115+0000","last_became_peered":"2024-09-14T11:24:10.116115+0000","last_unstale":"2024-09-14T12:58:43.044517+0000","last_undegraded":"2024-09-14T12:58:43.044517+0000","last_fullsized":"2024-09-14T12:58:43.044517+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:24:09.066501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:24:09.066501+0000","last_clean_scrub_stamp":"2024-09-14T11:24:09.066501+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:27:31.737225+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":147,"num_read_kb":99,"num_write":62,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"68.8","version":"0'0","reported_seq":42,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:59:23.435157+0000","last_change":"2024-09-14T11:58:43.689938+0000","last_active":"2024-09-14T12:59:23.435157+0000","last_peered":"2024-09-14T12:59:23.435157+0000","last_clean":"2024-09-14T12:59:23.435157+0000","last_became_active":"2024-09-14T11:58:43.689083+0000","last_became_peered":"2024-09-14T11:58:43.689083+0000","last_unstale":"2024-09-14T12:59:23.435157+0000","last_undegraded":"2024-09-14T12:59:23.435157+0000","last_fullsized":"2024-09-14T12:59:23.435157+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:58:42.635024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:58:42.635024+0000","last_clean_scrub_stamp":"2024-09-14T11:58:42.635024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:56:39.956267+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"67.f","version":"267'7","reported_seq":74,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:00.341402+0000","last_change":"2024-09-14T11:30:17.516991+0000","last_active":"2024-09-14T13:02:00.341402+0000","last_peered":"2024-09-14T13:02:00.341402+0000","last_clean":"2024-09-14T13:02:00.341402+0000","last_became_active":"2024-09-14T11:30:17.514381+0000","last_became_peered":"2024-09-14T11:30:17.514381+0000","last_unstale":"2024-09-14T13:02:00.341402+0000","last_undegraded":"2024-09-14T13:02:00.341402+0000","last_fullsized":"2024-09-14T13:02:00.341402+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:30:16.474654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:30:16.474654+0000","last_clean_scrub_stamp":"2024-09-14T11:30:16.474654+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:49:08.984359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":3072,"num_write":12,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.e","version":"267'6","reported_seq":82,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:00:13.261894+0000","last_change":"2024-09-14T11:30:10.479004+0000","last_active":"2024-09-14T13:00:13.261894+0000","last_peered":"2024-09-14T13:00:13.261894+0000","last_clean":"2024-09-14T13:00:13.261894+0000","last_became_active":"2024-09-14T11:30:10.473586+0000","last_became_peered":"2024-09-14T11:30:10.473586+0000","last_unstale":"2024-09-14T13:00:13.261894+0000","last_undegraded":"2024-09-14T13:00:13.261894+0000","last_fullsized":"2024-09-14T13:00:13.261894+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:30:09.411354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:30:09.411354+0000","last_clean_scrub_stamp":"2024-09-14T11:30:09.411354+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:24:05.113372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":7170,"num_write":6,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.d","version":"267'29","reported_seq":159,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:58:43.426273+0000","last_change":"2024-09-14T11:24:10.116568+0000","last_active":"2024-09-14T12:58:43.426273+0000","last_peered":"2024-09-14T12:58:43.426273+0000","last_clean":"2024-09-14T12:58:43.426273+0000","last_became_active":"2024-09-14T11:24:10.115813+0000","last_became_peered":"2024-09-14T11:24:10.115813+0000","last_unstale":"2024-09-14T12:58:43.426273+0000","last_undegraded":"2024-09-14T12:58:43.426273+0000","last_fullsized":"2024-09-14T12:58:43.426273+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:24:09.066501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:24:09.066501+0000","last_clean_scrub_stamp":"2024-09-14T11:24:09.066501+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:26:27.897672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":238,"num_read_kb":154,"num_write":72,"num_write_kb":21,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.9","version":"0'0","reported_seq":42,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:59:27.844748+0000","last_change":"2024-09-14T11:58:43.692113+0000","last_active":"2024-09-14T12:59:27.844748+0000","last_peered":"2024-09-14T12:59:27.844748+0000","last_clean":"2024-09-14T12:59:27.844748+0000","last_became_active":"2024-09-14T11:58:43.691369+0000","last_became_peered":"2024-09-14T11:58:43.691369+0000","last_unstale":"2024-09-14T12:59:27.844748+0000","last_undegraded":"2024-09-14T12:59:27.844748+0000","last_fullsized":"2024-09-14T12:59:27.844748+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:58:42.635024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:58:42.635024+0000","last_clean_scrub_stamp":"2024-09-14T11:58:42.635024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:30:13.996741+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.e","version":"0'0","reported_seq":63,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:58:03.453841+0000","last_change":"2024-09-14T11:30:17.530775+0000","last_active":"2024-09-14T12:58:03.453841+0000","last_peered":"2024-09-14T12:58:03.453841+0000","last_clean":"2024-09-14T12:58:03.453841+0000","last_became_active":"2024-09-14T11:30:17.529982+0000","last_became_peered":"2024-09-14T11:30:17.529982+0000","last_unstale":"2024-09-14T12:58:03.453841+0000","last_undegraded":"2024-09-14T12:58:03.453841+0000","last_fullsized":"2024-09-14T12:58:03.453841+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:30:16.474654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:30:16.474654+0000","last_clean_scrub_stamp":"2024-09-14T11:30:16.474654+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:45:22.253630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.f","version":"267'3","reported_seq":74,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:00:28.487301+0000","last_change":"2024-09-14T11:30:10.466282+0000","last_active":"2024-09-14T13:00:28.487301+0000","last_peered":"2024-09-14T13:00:28.487301+0000","last_clean":"2024-09-14T13:00:28.487301+0000","last_became_active":"2024-09-14T11:30:10.465658+0000","last_became_peered":"2024-09-14T11:30:10.465658+0000","last_unstale":"2024-09-14T13:00:28.487301+0000","last_undegraded":"2024-09-14T13:00:28.487301+0000","last_fullsized":"2024-09-14T13:00:28.487301+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:30:09.411354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:30:09.411354+0000","last_clean_scrub_stamp":"2024-09-14T11:30:09.411354+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:30:10.626929+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":8192,"num_write":8,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.c","version":"267'13","reported_seq":112,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:58:42.823918+0000","last_change":"2024-09-14T11:24:10.125876+0000","last_active":"2024-09-14T12:58:42.823918+0000","last_peered":"2024-09-14T12:58:42.823918+0000","last_clean":"2024-09-14T12:58:42.823918+0000","last_became_active":"2024-09-14T11:24:10.125123+0000","last_became_peered":"2024-09-14T11:24:10.125123+0000","last_unstale":"2024-09-14T12:58:42.823918+0000","last_undegraded":"2024-09-14T12:58:42.823918+0000","last_fullsized":"2024-09-14T12:58:42.823918+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:24:09.066501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:24:09.066501+0000","last_clean_scrub_stamp":"2024-09-14T11:24:09.066501+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:00:51.281778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":97,"num_read_kb":65,"num_write":32,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.e","version":"0'0","reported_seq":41,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:59:28.473804+0000","last_change":"2024-09-14T11:58:43.687782+0000","last_active":"2024-09-14T12:59:28.473804+0000","last_peered":"2024-09-14T12:59:28.473804+0000","last_clean":"2024-09-14T12:59:28.473804+0000","last_became_active":"2024-09-14T11:58:43.686619+0000","last_became_peered":"2024-09-14T11:58:43.686619+0000","last_unstale":"2024-09-14T12:59:28.473804+0000","last_undegraded":"2024-09-14T12:59:28.473804+0000","last_fullsized":"2024-09-14T12:59:28.473804+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:58:42.635024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:58:42.635024+0000","last_clean_scrub_stamp":"2024-09-14T11:58:42.635024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:28:38.861564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.9","version":"264'3","reported_seq":70,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:59:08.234745+0000","last_change":"2024-09-14T11:30:17.539804+0000","last_active":"2024-09-14T12:59:08.234745+0000","last_peered":"2024-09-14T12:59:08.234745+0000","last_clean":"2024-09-14T12:59:08.234745+0000","last_became_active":"2024-09-14T11:30:17.539102+0000","last_became_peered":"2024-09-14T11:30:17.539102+0000","last_unstale":"2024-09-14T12:59:08.234745+0000","last_undegraded":"2024-09-14T12:59:08.234745+0000","last_fullsized":"2024-09-14T12:59:08.234745+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:30:16.474654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:30:16.474654+0000","last_clean_scrub_stamp":"2024-09-14T11:30:16.474654+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:50:58.476074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":4096,"num_write":8,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.8","version":"267'4","reported_seq":78,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:01:13.275300+0000","last_change":"2024-09-14T11:30:10.460045+0000","last_active":"2024-09-14T13:01:13.275300+0000","last_peered":"2024-09-14T13:01:13.275300+0000","last_clean":"2024-09-14T13:01:13.275300+0000","last_became_active":"2024-09-14T11:30:10.452160+0000","last_became_peered":"2024-09-14T11:30:10.452160+0000","last_unstale":"2024-09-14T13:01:13.275300+0000","last_undegraded":"2024-09-14T13:01:13.275300+0000","last_fullsized":"2024-09-14T13:01:13.275300+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:30:09.411354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:30:09.411354+0000","last_clean_scrub_stamp":"2024-09-14T11:30:09.411354+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:23:05.788859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5120,"num_write":4,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.b","version":"267'29","reported_seq":156,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:58:43.240104+0000","last_change":"2024-09-14T11:24:10.106828+0000","last_active":"2024-09-14T12:58:43.240104+0000","last_peered":"2024-09-14T12:58:43.240104+0000","last_clean":"2024-09-14T12:58:43.240104+0000","last_became_active":"2024-09-14T11:24:10.106068+0000","last_became_peered":"2024-09-14T11:24:10.106068+0000","last_unstale":"2024-09-14T12:58:43.240104+0000","last_undegraded":"2024-09-14T12:58:43.240104+0000","last_fullsized":"2024-09-14T12:58:43.240104+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:24:09.066501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:24:09.066501+0000","last_clean_scrub_stamp":"2024-09-14T11:24:09.066501+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:05:03.080475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":230,"num_read_kb":146,"num_write":73,"num_write_kb":21,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.f","version":"0'0","reported_seq":41,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:59:52.850758+0000","last_change":"2024-09-14T11:58:43.692112+0000","last_active":"2024-09-14T12:59:52.850758+0000","last_peered":"2024-09-14T12:59:52.850758+0000","last_clean":"2024-09-14T12:59:52.850758+0000","last_became_active":"2024-09-14T11:58:43.691307+0000","last_became_peered":"2024-09-14T11:58:43.691307+0000","last_unstale":"2024-09-14T12:59:52.850758+0000","last_undegraded":"2024-09-14T12:59:52.850758+0000","last_fullsized":"2024-09-14T12:59:52.850758+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:58:42.635024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:58:42.635024+0000","last_clean_scrub_stamp":"2024-09-14T11:58:42.635024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.8","version":"267'4","reported_seq":73,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:00.039409+0000","last_change":"2024-09-14T11:30:17.506927+0000","last_active":"2024-09-14T13:02:00.039409+0000","last_peered":"2024-09-14T13:02:00.039409+0000","last_clean":"2024-09-14T13:02:00.039409+0000","last_became_active":"2024-09-14T11:30:17.506181+0000","last_became_peered":"2024-09-14T11:30:17.506181+0000","last_unstale":"2024-09-14T13:02:00.039409+0000","last_undegraded":"2024-09-14T13:02:00.039409+0000","last_fullsized":"2024-09-14T13:02:00.039409+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:30:16.474654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:30:16.474654+0000","last_clean_scrub_stamp":"2024-09-14T11:30:16.474654+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:25:09.709853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":10240,"num_write":4,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.9","version":"267'14","reported_seq":96,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:00.358482+0000","last_change":"2024-09-14T11:30:10.470957+0000","last_active":"2024-09-14T13:02:00.358482+0000","last_peered":"2024-09-14T13:02:00.358482+0000","last_clean":"2024-09-14T13:02:00.358482+0000","last_became_active":"2024-09-14T11:30:10.470179+0000","last_became_peered":"2024-09-14T11:30:10.470179+0000","last_unstale":"2024-09-14T13:02:00.358482+0000","last_undegraded":"2024-09-14T13:02:00.358482+0000","last_fullsized":"2024-09-14T13:02:00.358482+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:30:09.411354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:30:09.411354+0000","last_clean_scrub_stamp":"2024-09-14T11:30:09.411354+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:18:43.600381+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":18,"num_read_kb":28678,"num_write":24,"num_write_kb":16388,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.a","version":"267'15","reported_seq":118,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:00:02.852840+0000","last_change":"2024-09-14T11:24:10.103674+0000","last_active":"2024-09-14T13:00:02.852840+0000","last_peered":"2024-09-14T13:00:02.852840+0000","last_clean":"2024-09-14T13:00:02.852840+0000","last_became_active":"2024-09-14T11:24:10.102918+0000","last_became_peered":"2024-09-14T11:24:10.102918+0000","last_unstale":"2024-09-14T13:00:02.852840+0000","last_undegraded":"2024-09-14T13:00:02.852840+0000","last_fullsized":"2024-09-14T13:00:02.852840+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:24:09.066501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:24:09.066501+0000","last_clean_scrub_stamp":"2024-09-14T11:24:09.066501+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":107,"num_read_kb":71,"num_write":42,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.c","version":"267'1","reported_seq":42,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:59:32.846025+0000","last_change":"2024-09-14T11:58:43.674524+0000","last_active":"2024-09-14T12:59:32.846025+0000","last_peered":"2024-09-14T12:59:32.846025+0000","last_clean":"2024-09-14T12:59:32.846025+0000","last_became_active":"2024-09-14T11:58:43.671065+0000","last_became_peered":"2024-09-14T11:58:43.671065+0000","last_unstale":"2024-09-14T12:59:32.846025+0000","last_undegraded":"2024-09-14T12:59:32.846025+0000","last_fullsized":"2024-09-14T12:59:32.846025+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:58:42.635024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:58:42.635024+0000","last_clean_scrub_stamp":"2024-09-14T11:58:42.635024+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:00:34.168002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.b","version":"267'11","reported_seq":85,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:00:18.482221+0000","last_change":"2024-09-14T11:30:17.517039+0000","last_active":"2024-09-14T13:00:18.482221+0000","last_peered":"2024-09-14T13:00:18.482221+0000","last_clean":"2024-09-14T13:00:18.482221+0000","last_became_active":"2024-09-14T11:30:17.516646+0000","last_became_peered":"2024-09-14T11:30:17.516646+0000","last_unstale":"2024-09-14T13:00:18.482221+0000","last_undegraded":"2024-09-14T13:00:18.482221+0000","last_fullsized":"2024-09-14T13:00:18.482221+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:30:16.474654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:30:16.474654+0000","last_clean_scrub_stamp":"2024-09-14T11:30:16.474654+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:51:29.231639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":17,"num_read_kb":13314,"num_write":16,"num_write_kb":10240,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.a","version":"264'2","reported_seq":75,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:59:28.251530+0000","last_change":"2024-09-14T11:30:10.473981+0000","last_active":"2024-09-14T12:59:28.251530+0000","last_peered":"2024-09-14T12:59:28.251530+0000","last_clean":"2024-09-14T12:59:28.251530+0000","last_became_active":"2024-09-14T11:30:10.473149+0000","last_became_peered":"2024-09-14T11:30:10.473149+0000","last_unstale":"2024-09-14T12:59:28.251530+0000","last_undegraded":"2024-09-14T12:59:28.251530+0000","last_fullsized":"2024-09-14T12:59:28.251530+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:30:09.411354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:30:09.411354+0000","last_clean_scrub_stamp":"2024-09-14T11:30:09.411354+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:31:29.150405+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":1024,"num_write":2,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.9","version":"267'22","reported_seq":138,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:59:33.474897+0000","last_change":"2024-09-14T11:24:10.122150+0000","last_active":"2024-09-14T12:59:33.474897+0000","last_peered":"2024-09-14T12:59:33.474897+0000","last_clean":"2024-09-14T12:59:33.474897+0000","last_became_active":"2024-09-14T11:24:10.121442+0000","last_became_peered":"2024-09-14T11:24:10.121442+0000","last_unstale":"2024-09-14T12:59:33.474897+0000","last_undegraded":"2024-09-14T12:59:33.474897+0000","last_fullsized":"2024-09-14T12:59:33.474897+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:24:09.066501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:24:09.066501+0000","last_clean_scrub_stamp":"2024-09-14T11:24:09.066501+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:07:27.847069+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":163,"num_read_kb":99,"num_write":58,"num_write_kb":15,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.d","version":"0'0","reported_seq":41,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:59:28.251656+0000","last_change":"2024-09-14T11:58:43.694247+0000","last_active":"2024-09-14T12:59:28.251656+0000","last_peered":"2024-09-14T12:59:28.251656+0000","last_clean":"2024-09-14T12:59:28.251656+0000","last_became_active":"2024-09-14T11:58:43.693568+0000","last_became_peered":"2024-09-14T11:58:43.693568+0000","last_unstale":"2024-09-14T12:59:28.251656+0000","last_undegraded":"2024-09-14T12:59:28.251656+0000","last_fullsized":"2024-09-14T12:59:28.251656+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:58:42.635024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:58:42.635024+0000","last_clean_scrub_stamp":"2024-09-14T11:58:42.635024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:56:07.440496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.a","version":"0'0","reported_seq":71,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:59:37.847095+0000","last_change":"2024-09-14T11:30:57.858852+0000","last_active":"2024-09-14T12:59:37.847095+0000","last_peered":"2024-09-14T12:59:37.847095+0000","last_clean":"2024-09-14T12:59:37.847095+0000","last_became_active":"2024-09-14T11:30:57.858040+0000","last_became_peered":"2024-09-14T11:30:57.858040+0000","last_unstale":"2024-09-14T12:59:37.847095+0000","last_undegraded":"2024-09-14T12:59:37.847095+0000","last_fullsized":"2024-09-14T12:59:37.847095+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:30:16.474654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:30:16.474654+0000","last_clean_scrub_stamp":"2024-09-14T11:30:16.474654+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:54:14.176092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.b","version":"267'4","reported_seq":75,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:00.020394+0000","last_change":"2024-09-14T11:30:10.446339+0000","last_active":"2024-09-14T13:02:00.020394+0000","last_peered":"2024-09-14T13:02:00.020394+0000","last_clean":"2024-09-14T13:02:00.020394+0000","last_became_active":"2024-09-14T11:30:10.442635+0000","last_became_peered":"2024-09-14T11:30:10.442635+0000","last_unstale":"2024-09-14T13:02:00.020394+0000","last_undegraded":"2024-09-14T13:02:00.020394+0000","last_fullsized":"2024-09-14T13:02:00.020394+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:30:09.411354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:30:09.411354+0000","last_clean_scrub_stamp":"2024-09-14T11:30:09.411354+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:51:37.757665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":8192,"num_write":4,"num_write_kb":8192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.8","version":"267'20","reported_seq":132,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:59:33.437339+0000","last_change":"2024-09-14T11:24:10.116682+0000","last_active":"2024-09-14T12:59:33.437339+0000","last_peered":"2024-09-14T12:59:33.437339+0000","last_clean":"2024-09-14T12:59:33.437339+0000","last_became_active":"2024-09-14T11:24:10.115856+0000","last_became_peered":"2024-09-14T11:24:10.115856+0000","last_unstale":"2024-09-14T12:59:33.437339+0000","last_undegraded":"2024-09-14T12:59:33.437339+0000","last_fullsized":"2024-09-14T12:59:33.437339+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:24:09.066501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:24:09.066501+0000","last_clean_scrub_stamp":"2024-09-14T11:24:09.066501+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:44:11.185471+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":144,"num_read_kb":94,"num_write":54,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.2","version":"0'0","reported_seq":43,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:59:12.841261+0000","last_change":"2024-09-14T11:58:43.696428+0000","last_active":"2024-09-14T12:59:12.841261+0000","last_peered":"2024-09-14T12:59:12.841261+0000","last_clean":"2024-09-14T12:59:12.841261+0000","last_became_active":"2024-09-14T11:58:43.695896+0000","last_became_peered":"2024-09-14T11:58:43.695896+0000","last_unstale":"2024-09-14T12:59:12.841261+0000","last_undegraded":"2024-09-14T12:59:12.841261+0000","last_fullsized":"2024-09-14T12:59:12.841261+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:58:42.635024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:58:42.635024+0000","last_clean_scrub_stamp":"2024-09-14T11:58:42.635024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:00:52.004945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.5","version":"0'0","reported_seq":67,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:00:18.263426+0000","last_change":"2024-09-14T11:30:17.520310+0000","last_active":"2024-09-14T13:00:18.263426+0000","last_peered":"2024-09-14T13:00:18.263426+0000","last_clean":"2024-09-14T13:00:18.263426+0000","last_became_active":"2024-09-14T11:30:17.519903+0000","last_became_peered":"2024-09-14T11:30:17.519903+0000","last_unstale":"2024-09-14T13:00:18.263426+0000","last_undegraded":"2024-09-14T13:00:18.263426+0000","last_fullsized":"2024-09-14T13:00:18.263426+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:30:16.474654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:30:16.474654+0000","last_clean_scrub_stamp":"2024-09-14T11:30:16.474654+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.4","version":"264'4","reported_seq":82,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:59:47.849496+0000","last_change":"2024-09-14T11:30:10.469781+0000","last_active":"2024-09-14T12:59:47.849496+0000","last_peered":"2024-09-14T12:59:47.849496+0000","last_clean":"2024-09-14T12:59:47.849496+0000","last_became_active":"2024-09-14T11:30:10.468287+0000","last_became_peered":"2024-09-14T11:30:10.468287+0000","last_unstale":"2024-09-14T12:59:47.849496+0000","last_undegraded":"2024-09-14T12:59:47.849496+0000","last_fullsized":"2024-09-14T12:59:47.849496+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:30:09.411354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:30:09.411354+0000","last_clean_scrub_stamp":"2024-09-14T11:30:09.411354+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:43:03.239163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":11264,"num_write":4,"num_write_kb":7168,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.7","version":"267'11","reported_seq":111,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:59:33.252891+0000","last_change":"2024-09-14T11:24:10.097912+0000","last_active":"2024-09-14T12:59:33.252891+0000","last_peered":"2024-09-14T12:59:33.252891+0000","last_clean":"2024-09-14T12:59:33.252891+0000","last_became_active":"2024-09-14T11:24:10.097206+0000","last_became_peered":"2024-09-14T11:24:10.097206+0000","last_unstale":"2024-09-14T12:59:33.252891+0000","last_undegraded":"2024-09-14T12:59:33.252891+0000","last_fullsized":"2024-09-14T12:59:33.252891+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:24:09.066501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:24:09.066501+0000","last_clean_scrub_stamp":"2024-09-14T11:24:09.066501+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:05:42.905472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":88,"num_read_kb":49,"num_write":30,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.3","version":"0'0","reported_seq":43,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:59:08.049987+0000","last_change":"2024-09-14T11:58:43.693608+0000","last_active":"2024-09-14T12:59:08.049987+0000","last_peered":"2024-09-14T12:59:08.049987+0000","last_clean":"2024-09-14T12:59:08.049987+0000","last_became_active":"2024-09-14T11:58:43.689661+0000","last_became_peered":"2024-09-14T11:58:43.689661+0000","last_unstale":"2024-09-14T12:59:08.049987+0000","last_undegraded":"2024-09-14T12:59:08.049987+0000","last_fullsized":"2024-09-14T12:59:08.049987+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:58:42.635024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:58:42.635024+0000","last_clean_scrub_stamp":"2024-09-14T11:58:42.635024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:26:59.844029+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.4","version":"267'5","reported_seq":75,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:00.168550+0000","last_change":"2024-09-14T11:30:17.501104+0000","last_active":"2024-09-14T13:02:00.168550+0000","last_peered":"2024-09-14T13:02:00.168550+0000","last_clean":"2024-09-14T13:02:00.168550+0000","last_became_active":"2024-09-14T11:30:17.500215+0000","last_became_peered":"2024-09-14T11:30:17.500215+0000","last_unstale":"2024-09-14T13:02:00.168550+0000","last_undegraded":"2024-09-14T13:02:00.168550+0000","last_fullsized":"2024-09-14T13:02:00.168550+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:30:16.474654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:30:16.474654+0000","last_clean_scrub_stamp":"2024-09-14T11:30:16.474654+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:46:20.398415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":2052,"num_write":10,"num_write_kb":1028,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.5","version":"267'5","reported_seq":82,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:00.468628+0000","last_change":"2024-09-14T11:30:10.465224+0000","last_active":"2024-09-14T13:02:00.468628+0000","last_peered":"2024-09-14T13:02:00.468628+0000","last_clean":"2024-09-14T13:02:00.468628+0000","last_became_active":"2024-09-14T11:30:10.464076+0000","last_became_peered":"2024-09-14T11:30:10.464076+0000","last_unstale":"2024-09-14T13:02:00.468628+0000","last_undegraded":"2024-09-14T13:02:00.468628+0000","last_fullsized":"2024-09-14T13:02:00.468628+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:30:09.411354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:30:09.411354+0000","last_clean_scrub_stamp":"2024-09-14T11:30:09.411354+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":16384,"num_write":10,"num_write_kb":8192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.6","version":"267'17","reported_seq":129,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:59:33.437504+0000","last_change":"2024-09-14T11:24:10.123893+0000","last_active":"2024-09-14T12:59:33.437504+0000","last_peered":"2024-09-14T12:59:33.437504+0000","last_clean":"2024-09-14T12:59:33.437504+0000","last_became_active":"2024-09-14T11:24:10.123193+0000","last_became_peered":"2024-09-14T11:24:10.123193+0000","last_unstale":"2024-09-14T12:59:33.437504+0000","last_undegraded":"2024-09-14T12:59:33.437504+0000","last_fullsized":"2024-09-14T12:59:33.437504+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:24:09.066501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:24:09.066501+0000","last_clean_scrub_stamp":"2024-09-14T11:24:09.066501+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:45:11.702555+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":141,"num_read_kb":98,"num_write":56,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.0","version":"0'0","reported_seq":44,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:58:48.462247+0000","last_change":"2024-09-14T11:58:43.690698+0000","last_active":"2024-09-14T12:58:48.462247+0000","last_peered":"2024-09-14T12:58:48.462247+0000","last_clean":"2024-09-14T12:58:48.462247+0000","last_became_active":"2024-09-14T11:58:43.690036+0000","last_became_peered":"2024-09-14T11:58:43.690036+0000","last_unstale":"2024-09-14T12:58:48.462247+0000","last_undegraded":"2024-09-14T12:58:48.462247+0000","last_fullsized":"2024-09-14T12:58:48.462247+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:58:42.635024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:58:42.635024+0000","last_clean_scrub_stamp":"2024-09-14T11:58:42.635024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:02:37.171544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"67.7","version":"0'0","reported_seq":65,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:59:07.840222+0000","last_change":"2024-09-14T11:30:17.504824+0000","last_active":"2024-09-14T12:59:07.840222+0000","last_peered":"2024-09-14T12:59:07.840222+0000","last_clean":"2024-09-14T12:59:07.840222+0000","last_became_active":"2024-09-14T11:30:17.503548+0000","last_became_peered":"2024-09-14T11:30:17.503548+0000","last_unstale":"2024-09-14T12:59:07.840222+0000","last_undegraded":"2024-09-14T12:59:07.840222+0000","last_fullsized":"2024-09-14T12:59:07.840222+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:30:16.474654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:30:16.474654+0000","last_clean_scrub_stamp":"2024-09-14T11:30:16.474654+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:04:54.678316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.6","version":"264'4","reported_seq":81,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:59:03.048985+0000","last_change":"2024-09-14T11:30:10.463753+0000","last_active":"2024-09-14T12:59:03.048985+0000","last_peered":"2024-09-14T12:59:03.048985+0000","last_clean":"2024-09-14T12:59:03.048985+0000","last_became_active":"2024-09-14T11:30:10.462971+0000","last_became_peered":"2024-09-14T11:30:10.462971+0000","last_unstale":"2024-09-14T12:59:03.048985+0000","last_undegraded":"2024-09-14T12:59:03.048985+0000","last_fullsized":"2024-09-14T12:59:03.048985+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:30:09.411354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:30:09.411354+0000","last_clean_scrub_stamp":"2024-09-14T11:30:09.411354+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:28:19.411905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":16386,"num_write":4,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.5","version":"267'29","reported_seq":156,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:58:27.830841+0000","last_change":"2024-09-14T11:24:10.105209+0000","last_active":"2024-09-14T12:58:27.830841+0000","last_peered":"2024-09-14T12:58:27.830841+0000","last_clean":"2024-09-14T12:58:27.830841+0000","last_became_active":"2024-09-14T11:24:10.104277+0000","last_became_peered":"2024-09-14T11:24:10.104277+0000","last_unstale":"2024-09-14T12:58:27.830841+0000","last_undegraded":"2024-09-14T12:58:27.830841+0000","last_fullsized":"2024-09-14T12:58:27.830841+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:24:09.066501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:24:09.066501+0000","last_clean_scrub_stamp":"2024-09-14T11:24:09.066501+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:27:20.344282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":210,"num_read_kb":138,"num_write":78,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.1","version":"0'0","reported_seq":43,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:59:08.234700+0000","last_change":"2024-09-14T11:58:43.675560+0000","last_active":"2024-09-14T12:59:08.234700+0000","last_peered":"2024-09-14T12:59:08.234700+0000","last_clean":"2024-09-14T12:59:08.234700+0000","last_became_active":"2024-09-14T11:58:43.674870+0000","last_became_peered":"2024-09-14T11:58:43.674870+0000","last_unstale":"2024-09-14T12:59:08.234700+0000","last_undegraded":"2024-09-14T12:59:08.234700+0000","last_fullsized":"2024-09-14T12:59:08.234700+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:58:42.635024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:58:42.635024+0000","last_clean_scrub_stamp":"2024-09-14T11:58:42.635024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:17:48.384984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"67.6","version":"267'2","reported_seq":68,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:01:18.264763+0000","last_change":"2024-09-14T11:30:17.521153+0000","last_active":"2024-09-14T13:01:18.264763+0000","last_peered":"2024-09-14T13:01:18.264763+0000","last_clean":"2024-09-14T13:01:18.264763+0000","last_became_active":"2024-09-14T11:30:17.520433+0000","last_became_peered":"2024-09-14T11:30:17.520433+0000","last_unstale":"2024-09-14T13:01:18.264763+0000","last_undegraded":"2024-09-14T13:01:18.264763+0000","last_fullsized":"2024-09-14T13:01:18.264763+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:30:16.474654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:30:16.474654+0000","last_clean_scrub_stamp":"2024-09-14T11:30:16.474654+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:46:08.197483+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":4096,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.7","version":"267'4","reported_seq":78,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:00.017794+0000","last_change":"2024-09-14T11:30:10.475293+0000","last_active":"2024-09-14T13:02:00.017794+0000","last_peered":"2024-09-14T13:02:00.017794+0000","last_clean":"2024-09-14T13:02:00.017794+0000","last_became_active":"2024-09-14T11:30:10.474546+0000","last_became_peered":"2024-09-14T11:30:10.474546+0000","last_unstale":"2024-09-14T13:02:00.017794+0000","last_undegraded":"2024-09-14T13:02:00.017794+0000","last_fullsized":"2024-09-14T13:02:00.017794+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:30:09.411354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:30:09.411354+0000","last_clean_scrub_stamp":"2024-09-14T11:30:09.411354+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:09:53.059916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":3072,"num_write":4,"num_write_kb":2048,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.4","version":"267'33","reported_seq":161,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:00:03.478989+0000","last_change":"2024-09-14T11:24:10.118920+0000","last_active":"2024-09-14T13:00:03.478989+0000","last_peered":"2024-09-14T13:00:03.478989+0000","last_clean":"2024-09-14T13:00:03.478989+0000","last_became_active":"2024-09-14T11:24:10.118333+0000","last_became_peered":"2024-09-14T11:24:10.118333+0000","last_unstale":"2024-09-14T13:00:03.478989+0000","last_undegraded":"2024-09-14T13:00:03.478989+0000","last_fullsized":"2024-09-14T13:00:03.478989+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:24:09.066501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:24:09.066501+0000","last_clean_scrub_stamp":"2024-09-14T11:24:09.066501+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":218,"num_read_kb":138,"num_write":85,"num_write_kb":20,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"68.6","version":"267'1","reported_seq":43,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:59:22.832926+0000","last_change":"2024-09-14T11:58:43.688943+0000","last_active":"2024-09-14T12:59:22.832926+0000","last_peered":"2024-09-14T12:59:22.832926+0000","last_clean":"2024-09-14T12:59:22.832926+0000","last_became_active":"2024-09-14T11:58:43.688251+0000","last_became_peered":"2024-09-14T11:58:43.688251+0000","last_unstale":"2024-09-14T12:59:22.832926+0000","last_undegraded":"2024-09-14T12:59:22.832926+0000","last_fullsized":"2024-09-14T12:59:22.832926+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:58:42.635024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:58:42.635024+0000","last_clean_scrub_stamp":"2024-09-14T11:58:42.635024+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:15:08.766031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.1","version":"267'7","reported_seq":81,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:01:58.505864+0000","last_change":"2024-09-14T11:30:17.519203+0000","last_active":"2024-09-14T13:01:58.505864+0000","last_peered":"2024-09-14T13:01:58.505864+0000","last_clean":"2024-09-14T13:01:58.505864+0000","last_became_active":"2024-09-14T11:30:17.518890+0000","last_became_peered":"2024-09-14T11:30:17.518890+0000","last_unstale":"2024-09-14T13:01:58.505864+0000","last_undegraded":"2024-09-14T13:01:58.505864+0000","last_fullsized":"2024-09-14T13:01:58.505864+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:30:16.474654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:30:16.474654+0000","last_clean_scrub_stamp":"2024-09-14T11:30:16.474654+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:51:39.220265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":19458,"num_write":12,"num_write_kb":7168,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.0","version":"267'2","reported_seq":77,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:00:42.862192+0000","last_change":"2024-09-14T11:30:10.467502+0000","last_active":"2024-09-14T13:00:42.862192+0000","last_peered":"2024-09-14T13:00:42.862192+0000","last_clean":"2024-09-14T13:00:42.862192+0000","last_became_active":"2024-09-14T11:30:10.466391+0000","last_became_peered":"2024-09-14T11:30:10.466391+0000","last_unstale":"2024-09-14T13:00:42.862192+0000","last_undegraded":"2024-09-14T13:00:42.862192+0000","last_fullsized":"2024-09-14T13:00:42.862192+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:30:09.411354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:30:09.411354+0000","last_clean_scrub_stamp":"2024-09-14T11:30:09.411354+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:32:45.732767+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":40,"num_write":2,"num_write_kb":40,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.3","version":"267'41","reported_seq":191,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:00:03.061879+0000","last_change":"2024-09-14T11:24:10.095296+0000","last_active":"2024-09-14T13:00:03.061879+0000","last_peered":"2024-09-14T13:00:03.061879+0000","last_clean":"2024-09-14T13:00:03.061879+0000","last_became_active":"2024-09-14T11:24:10.094515+0000","last_became_peered":"2024-09-14T11:24:10.094515+0000","last_unstale":"2024-09-14T13:00:03.061879+0000","last_undegraded":"2024-09-14T13:00:03.061879+0000","last_fullsized":"2024-09-14T13:00:03.061879+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:24:09.066501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:24:09.066501+0000","last_clean_scrub_stamp":"2024-09-14T11:24:09.066501+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":0,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":311,"num_read_kb":196,"num_write":106,"num_write_kb":28,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"68.7","version":"0'0","reported_seq":42,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:59:23.250462+0000","last_change":"2024-09-14T11:58:43.681439+0000","last_active":"2024-09-14T12:59:23.250462+0000","last_peered":"2024-09-14T12:59:23.250462+0000","last_clean":"2024-09-14T12:59:23.250462+0000","last_became_active":"2024-09-14T11:58:43.680569+0000","last_became_peered":"2024-09-14T11:58:43.680569+0000","last_unstale":"2024-09-14T12:59:23.250462+0000","last_undegraded":"2024-09-14T12:59:23.250462+0000","last_fullsized":"2024-09-14T12:59:23.250462+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:58:42.635024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:58:42.635024+0000","last_clean_scrub_stamp":"2024-09-14T11:58:42.635024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:50:38.486174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.0","version":"267'4","reported_seq":76,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:00:43.071448+0000","last_change":"2024-09-14T11:30:17.519289+0000","last_active":"2024-09-14T13:00:43.071448+0000","last_peered":"2024-09-14T13:00:43.071448+0000","last_clean":"2024-09-14T13:00:43.071448+0000","last_became_active":"2024-09-14T11:30:17.518524+0000","last_became_peered":"2024-09-14T11:30:17.518524+0000","last_unstale":"2024-09-14T13:00:43.071448+0000","last_undegraded":"2024-09-14T13:00:43.071448+0000","last_fullsized":"2024-09-14T13:00:43.071448+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:30:16.474654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:30:16.474654+0000","last_clean_scrub_stamp":"2024-09-14T11:30:16.474654+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:59:22.405921+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":6144,"num_write":4,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.1","version":"267'5","reported_seq":80,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:01:52.878597+0000","last_change":"2024-09-14T11:30:10.465435+0000","last_active":"2024-09-14T13:01:52.878597+0000","last_peered":"2024-09-14T13:01:52.878597+0000","last_clean":"2024-09-14T13:01:52.878597+0000","last_became_active":"2024-09-14T11:30:10.464696+0000","last_became_peered":"2024-09-14T11:30:10.464696+0000","last_unstale":"2024-09-14T13:01:52.878597+0000","last_undegraded":"2024-09-14T13:01:52.878597+0000","last_fullsized":"2024-09-14T13:01:52.878597+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:30:09.411354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:30:09.411354+0000","last_clean_scrub_stamp":"2024-09-14T11:30:09.411354+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:34:28.871663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":1024,"num_write":10,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.2","version":"267'34","reported_seq":176,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:00:03.247188+0000","last_change":"2024-09-14T11:24:10.126827+0000","last_active":"2024-09-14T13:00:03.247188+0000","last_peered":"2024-09-14T13:00:03.247188+0000","last_clean":"2024-09-14T13:00:03.247188+0000","last_became_active":"2024-09-14T11:24:10.125885+0000","last_became_peered":"2024-09-14T11:24:10.125885+0000","last_unstale":"2024-09-14T13:00:03.247188+0000","last_undegraded":"2024-09-14T13:00:03.247188+0000","last_fullsized":"2024-09-14T13:00:03.247188+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:24:09.066501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:24:09.066501+0000","last_clean_scrub_stamp":"2024-09-14T11:24:09.066501+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":284,"num_read_kb":180,"num_write":83,"num_write_kb":28,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"68.4","version":"0'0","reported_seq":43,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:59:08.246950+0000","last_change":"2024-09-14T11:58:43.663976+0000","last_active":"2024-09-14T12:59:08.246950+0000","last_peered":"2024-09-14T12:59:08.246950+0000","last_clean":"2024-09-14T12:59:08.246950+0000","last_became_active":"2024-09-14T11:58:43.662916+0000","last_became_peered":"2024-09-14T11:58:43.662916+0000","last_unstale":"2024-09-14T12:59:08.246950+0000","last_undegraded":"2024-09-14T12:59:08.246950+0000","last_fullsized":"2024-09-14T12:59:08.246950+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:58:42.635024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:58:42.635024+0000","last_clean_scrub_stamp":"2024-09-14T11:58:42.635024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:29:35.878769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.3","version":"264'4","reported_seq":77,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:59:53.441619+0000","last_change":"2024-09-14T11:30:17.549596+0000","last_active":"2024-09-14T12:59:53.441619+0000","last_peered":"2024-09-14T12:59:53.441619+0000","last_clean":"2024-09-14T12:59:53.441619+0000","last_became_active":"2024-09-14T11:30:17.549019+0000","last_became_peered":"2024-09-14T11:30:17.549019+0000","last_unstale":"2024-09-14T12:59:53.441619+0000","last_undegraded":"2024-09-14T12:59:53.441619+0000","last_fullsized":"2024-09-14T12:59:53.441619+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:30:16.474654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:30:16.474654+0000","last_clean_scrub_stamp":"2024-09-14T11:30:16.474654+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:25:28.016466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":4098,"num_write":4,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"66.2","version":"267'4","reported_seq":81,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:01:53.504635+0000","last_change":"2024-09-14T11:30:10.461463+0000","last_active":"2024-09-14T13:01:53.504635+0000","last_peered":"2024-09-14T13:01:53.504635+0000","last_clean":"2024-09-14T13:01:53.504635+0000","last_became_active":"2024-09-14T11:30:10.460643+0000","last_became_peered":"2024-09-14T11:30:10.460643+0000","last_unstale":"2024-09-14T13:01:53.504635+0000","last_undegraded":"2024-09-14T13:01:53.504635+0000","last_fullsized":"2024-09-14T13:01:53.504635+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:30:09.411354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:30:09.411354+0000","last_clean_scrub_stamp":"2024-09-14T11:30:09.411354+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:37:10.801240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":3072,"num_write":4,"num_write_kb":2048,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.1","version":"267'13","reported_seq":115,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:00:03.443847+0000","last_change":"2024-09-14T11:24:10.117369+0000","last_active":"2024-09-14T13:00:03.443847+0000","last_peered":"2024-09-14T13:00:03.443847+0000","last_clean":"2024-09-14T13:00:03.443847+0000","last_became_active":"2024-09-14T11:24:10.116627+0000","last_became_peered":"2024-09-14T11:24:10.116627+0000","last_unstale":"2024-09-14T13:00:03.443847+0000","last_undegraded":"2024-09-14T13:00:03.443847+0000","last_fullsized":"2024-09-14T13:00:03.443847+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:24:09.066501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:24:09.066501+0000","last_clean_scrub_stamp":"2024-09-14T11:24:09.066501+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":96,"num_read_kb":63,"num_write":36,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.5","version":"0'0","reported_seq":43,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:59:32.846067+0000","last_change":"2024-09-14T11:58:43.696722+0000","last_active":"2024-09-14T12:59:32.846067+0000","last_peered":"2024-09-14T12:59:32.846067+0000","last_clean":"2024-09-14T12:59:32.846067+0000","last_became_active":"2024-09-14T11:58:43.695982+0000","last_became_peered":"2024-09-14T11:58:43.695982+0000","last_unstale":"2024-09-14T12:59:32.846067+0000","last_undegraded":"2024-09-14T12:59:32.846067+0000","last_fullsized":"2024-09-14T12:59:32.846067+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:58:42.635024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:58:42.635024+0000","last_clean_scrub_stamp":"2024-09-14T11:58:42.635024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:04:33.126348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.2","version":"264'8","reported_seq":85,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:59:53.244786+0000","last_change":"2024-09-14T11:30:17.513530+0000","last_active":"2024-09-14T12:59:53.244786+0000","last_peered":"2024-09-14T12:59:53.244786+0000","last_clean":"2024-09-14T12:59:53.244786+0000","last_became_active":"2024-09-14T11:30:17.512689+0000","last_became_peered":"2024-09-14T11:30:17.512689+0000","last_unstale":"2024-09-14T12:59:53.244786+0000","last_undegraded":"2024-09-14T12:59:53.244786+0000","last_fullsized":"2024-09-14T12:59:53.244786+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:30:16.474654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:30:16.474654+0000","last_clean_scrub_stamp":"2024-09-14T11:30:16.474654+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:38:38.268473+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":21506,"num_write":8,"num_write_kb":9216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.3","version":"0'0","reported_seq":73,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:59:48.440576+0000","last_change":"2024-09-14T11:30:10.474713+0000","last_active":"2024-09-14T12:59:48.440576+0000","last_peered":"2024-09-14T12:59:48.440576+0000","last_clean":"2024-09-14T12:59:48.440576+0000","last_became_active":"2024-09-14T11:30:10.473880+0000","last_became_peered":"2024-09-14T11:30:10.473880+0000","last_unstale":"2024-09-14T12:59:48.440576+0000","last_undegraded":"2024-09-14T12:59:48.440576+0000","last_fullsized":"2024-09-14T12:59:48.440576+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:30:09.411354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:30:09.411354+0000","last_clean_scrub_stamp":"2024-09-14T11:30:09.411354+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:44:00.695204+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"65.0","version":"264'14","reported_seq":122,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:58:42.834131+0000","last_change":"2024-09-14T11:24:10.116538+0000","last_active":"2024-09-14T12:58:42.834131+0000","last_peered":"2024-09-14T12:58:42.834131+0000","last_clean":"2024-09-14T12:58:42.834131+0000","last_became_active":"2024-09-14T11:24:10.115799+0000","last_became_peered":"2024-09-14T11:24:10.115799+0000","last_unstale":"2024-09-14T12:58:42.834131+0000","last_undegraded":"2024-09-14T12:58:42.834131+0000","last_fullsized":"2024-09-14T12:58:42.834131+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:24:09.066501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:24:09.066501+0000","last_clean_scrub_stamp":"2024-09-14T11:24:09.066501+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:53:06.539792+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":114,"num_read_kb":78,"num_write":35,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3f","version":"267'205","reported_seq":883,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:20.638712+0000","last_change":"2024-09-14T13:02:20.638712+0000","last_active":"2024-09-14T13:02:20.638712+0000","last_peered":"2024-09-14T13:02:20.638712+0000","last_clean":"2024-09-14T13:02:20.638712+0000","last_became_active":"2024-09-14T11:08:21.829676+0000","last_became_peered":"2024-09-14T11:08:21.829676+0000","last_unstale":"2024-09-14T13:02:20.638712+0000","last_undegraded":"2024-09-14T13:02:20.638712+0000","last_fullsized":"2024-09-14T13:02:20.638712+0000","mapping_epoch":24,"log_start":"267'100","ondisk_log_start":"267'100","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'205","last_scrub_stamp":"2024-09-14T13:02:20.638511+0000","last_deep_scrub":"267'205","last_deep_scrub_stamp":"2024-09-14T13:02:20.638511+0000","last_clean_scrub_stamp":"2024-09-14T13:02:20.638511+0000","objects_scrubbed":3,"log_size":105,"log_dups_size":100,"ondisk_log_size":105,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T00:56:48.157172+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":30,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":573,"num_read_kb":18432,"num_write":892,"num_write_kb":26168,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,0],"acting":[7,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.38","version":"267'461","reported_seq":2067,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:59:14.735536+0000","last_change":"2024-09-14T11:08:23.801607+0000","last_active":"2024-09-14T12:59:14.735536+0000","last_peered":"2024-09-14T12:59:14.735536+0000","last_clean":"2024-09-14T12:59:14.735536+0000","last_became_active":"2024-09-14T11:08:23.800936+0000","last_became_peered":"2024-09-14T11:08:23.800936+0000","last_unstale":"2024-09-14T12:59:14.735536+0000","last_undegraded":"2024-09-14T12:59:14.735536+0000","last_fullsized":"2024-09-14T12:59:14.735536+0000","mapping_epoch":26,"log_start":"267'400","ondisk_log_start":"267'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:08:22.750609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:08:22.750609+0000","last_clean_scrub_stamp":"2024-09-14T11:08:22.750609+0000","objects_scrubbed":0,"log_size":61,"log_dups_size":400,"ondisk_log_size":61,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:16:00.073851+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":2476,"num_read_kb":2325,"num_write":550,"num_write_kb":127,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3e","version":"267'229","reported_seq":944,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:15.043489+0000","last_change":"2024-09-14T13:02:15.043489+0000","last_active":"2024-09-14T13:02:15.043489+0000","last_peered":"2024-09-14T13:02:15.043489+0000","last_clean":"2024-09-14T13:02:15.043489+0000","last_became_active":"2024-09-14T11:08:21.808315+0000","last_became_peered":"2024-09-14T11:08:21.808315+0000","last_unstale":"2024-09-14T13:02:15.043489+0000","last_undegraded":"2024-09-14T13:02:15.043489+0000","last_fullsized":"2024-09-14T13:02:15.043489+0000","mapping_epoch":24,"log_start":"267'200","ondisk_log_start":"267'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'229","last_scrub_stamp":"2024-09-14T13:02:15.043275+0000","last_deep_scrub":"267'229","last_deep_scrub_stamp":"2024-09-14T13:02:15.043275+0000","last_clean_scrub_stamp":"2024-09-14T13:02:15.043275+0000","objects_scrubbed":3,"log_size":29,"log_dups_size":200,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:33:02.128503+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1655861,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":605,"num_read_kb":113994,"num_write":1045,"num_write_kb":54817,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,6],"acting":[1,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.39","version":"267'896","reported_seq":2642,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:59:07.757541+0000","last_change":"2024-09-14T11:08:23.802023+0000","last_active":"2024-09-14T12:59:07.757541+0000","last_peered":"2024-09-14T12:59:07.757541+0000","last_clean":"2024-09-14T12:59:07.757541+0000","last_became_active":"2024-09-14T11:08:23.801320+0000","last_became_peered":"2024-09-14T11:08:23.801320+0000","last_unstale":"2024-09-14T12:59:07.757541+0000","last_undegraded":"2024-09-14T12:59:07.757541+0000","last_fullsized":"2024-09-14T12:59:07.757541+0000","mapping_epoch":26,"log_start":"267'800","ondisk_log_start":"267'800","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:08:22.750609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:08:22.750609+0000","last_clean_scrub_stamp":"2024-09-14T11:08:22.750609+0000","objects_scrubbed":0,"log_size":96,"log_dups_size":800,"ondisk_log_size":96,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:41:31.186802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":4549,"num_read_kb":4112,"num_write":1219,"num_write_kb":503,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3d","version":"267'201","reported_seq":856,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:12.135141+0000","last_change":"2024-09-14T13:02:12.135141+0000","last_active":"2024-09-14T13:02:12.135141+0000","last_peered":"2024-09-14T13:02:12.135141+0000","last_clean":"2024-09-14T13:02:12.135141+0000","last_became_active":"2024-09-14T11:08:21.776255+0000","last_became_peered":"2024-09-14T11:08:21.776255+0000","last_unstale":"2024-09-14T13:02:12.135141+0000","last_undegraded":"2024-09-14T13:02:12.135141+0000","last_fullsized":"2024-09-14T13:02:12.135141+0000","mapping_epoch":24,"log_start":"267'100","ondisk_log_start":"267'100","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'201","last_scrub_stamp":"2024-09-14T13:02:12.134852+0000","last_deep_scrub":"267'201","last_deep_scrub_stamp":"2024-09-14T13:02:12.134852+0000","last_clean_scrub_stamp":"2024-09-14T13:02:12.134852+0000","objects_scrubbed":6,"log_size":101,"log_dups_size":100,"ondisk_log_size":101,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:30:34.196127+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":515488,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":487,"num_read_kb":4028,"num_write":961,"num_write_kb":22458,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"267'468","reported_seq":2120,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:59:07.754233+0000","last_change":"2024-09-14T11:08:23.787232+0000","last_active":"2024-09-14T12:59:07.754233+0000","last_peered":"2024-09-14T12:59:07.754233+0000","last_clean":"2024-09-14T12:59:07.754233+0000","last_became_active":"2024-09-14T11:08:23.786481+0000","last_became_peered":"2024-09-14T11:08:23.786481+0000","last_unstale":"2024-09-14T12:59:07.754233+0000","last_undegraded":"2024-09-14T12:59:07.754233+0000","last_fullsized":"2024-09-14T12:59:07.754233+0000","mapping_epoch":26,"log_start":"267'400","ondisk_log_start":"267'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:08:22.750609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:08:22.750609+0000","last_clean_scrub_stamp":"2024-09-14T11:08:22.750609+0000","objects_scrubbed":0,"log_size":68,"log_dups_size":400,"ondisk_log_size":68,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:00:38.268952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2493,"num_read_kb":2352,"num_write":540,"num_write_kb":121,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3c","version":"267'354","reported_seq":1103,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:20.476600+0000","last_change":"2024-09-14T13:02:20.476600+0000","last_active":"2024-09-14T13:02:20.476600+0000","last_peered":"2024-09-14T13:02:20.476600+0000","last_clean":"2024-09-14T13:02:20.476600+0000","last_became_active":"2024-09-14T11:08:21.801787+0000","last_became_peered":"2024-09-14T11:08:21.801787+0000","last_unstale":"2024-09-14T13:02:20.476600+0000","last_undegraded":"2024-09-14T13:02:20.476600+0000","last_fullsized":"2024-09-14T13:02:20.476600+0000","mapping_epoch":24,"log_start":"267'300","ondisk_log_start":"267'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'354","last_scrub_stamp":"2024-09-14T13:02:20.476366+0000","last_deep_scrub":"267'354","last_deep_scrub_stamp":"2024-09-14T13:02:20.476366+0000","last_clean_scrub_stamp":"2024-09-14T13:02:20.476366+0000","objects_scrubbed":4,"log_size":54,"log_dups_size":300,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:53:20.365511+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":72,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1015,"num_read_kb":46026,"num_write":1390,"num_write_kb":39725,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3b","version":"267'451","reported_seq":1992,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:22.995425+0000","last_change":"2024-09-14T13:02:22.995425+0000","last_active":"2024-09-14T13:02:22.995425+0000","last_peered":"2024-09-14T13:02:22.995425+0000","last_clean":"2024-09-14T13:02:22.995425+0000","last_became_active":"2024-09-14T11:08:23.783162+0000","last_became_peered":"2024-09-14T11:08:23.783162+0000","last_unstale":"2024-09-14T13:02:22.995425+0000","last_undegraded":"2024-09-14T13:02:22.995425+0000","last_fullsized":"2024-09-14T13:02:22.995425+0000","mapping_epoch":26,"log_start":"267'400","ondisk_log_start":"267'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'451","last_scrub_stamp":"2024-09-14T13:02:22.995232+0000","last_deep_scrub":"267'451","last_deep_scrub_stamp":"2024-09-14T13:02:22.995232+0000","last_clean_scrub_stamp":"2024-09-14T13:02:22.995232+0000","objects_scrubbed":3,"log_size":51,"log_dups_size":400,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:03:50.107240+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2320,"num_read_kb":2170,"num_write":502,"num_write_kb":112,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":248,"num_omap_keys":1,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3b","version":"267'212","reported_seq":901,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:19.672895+0000","last_change":"2024-09-14T13:02:19.672895+0000","last_active":"2024-09-14T13:02:19.672895+0000","last_peered":"2024-09-14T13:02:19.672895+0000","last_clean":"2024-09-14T13:02:19.672895+0000","last_became_active":"2024-09-14T11:08:21.842260+0000","last_became_peered":"2024-09-14T11:08:21.842260+0000","last_unstale":"2024-09-14T13:02:19.672895+0000","last_undegraded":"2024-09-14T13:02:19.672895+0000","last_fullsized":"2024-09-14T13:02:19.672895+0000","mapping_epoch":24,"log_start":"267'200","ondisk_log_start":"267'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'212","last_scrub_stamp":"2024-09-14T13:02:19.672688+0000","last_deep_scrub":"267'212","last_deep_scrub_stamp":"2024-09-14T13:02:19.672688+0000","last_clean_scrub_stamp":"2024-09-14T13:02:19.672688+0000","objects_scrubbed":1,"log_size":12,"log_dups_size":200,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:47:14.467482+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1655822,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":567,"num_read_kb":28109,"num_write":991,"num_write_kb":35425,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,4],"acting":[7,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3c","version":"267'417","reported_seq":2197,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:20.325518+0000","last_change":"2024-09-14T13:02:20.325518+0000","last_active":"2024-09-14T13:02:20.325518+0000","last_peered":"2024-09-14T13:02:20.325518+0000","last_clean":"2024-09-14T13:02:20.325518+0000","last_became_active":"2024-09-14T11:08:23.804142+0000","last_became_peered":"2024-09-14T11:08:23.804142+0000","last_unstale":"2024-09-14T13:02:20.325518+0000","last_undegraded":"2024-09-14T13:02:20.325518+0000","last_fullsized":"2024-09-14T13:02:20.325518+0000","mapping_epoch":26,"log_start":"267'400","ondisk_log_start":"267'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'417","last_scrub_stamp":"2024-09-14T13:02:20.325334+0000","last_deep_scrub":"267'417","last_deep_scrub_stamp":"2024-09-14T13:02:20.325334+0000","last_clean_scrub_stamp":"2024-09-14T13:02:20.325334+0000","objects_scrubbed":4,"log_size":17,"log_dups_size":400,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:03:20.089650+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":2567,"num_read_kb":2469,"num_write":470,"num_write_kb":86,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2297,"num_omap_keys":9,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.3a","version":"267'155","reported_seq":787,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:19.522599+0000","last_change":"2024-09-14T13:02:19.522599+0000","last_active":"2024-09-14T13:02:19.522599+0000","last_peered":"2024-09-14T13:02:19.522599+0000","last_clean":"2024-09-14T13:02:19.522599+0000","last_became_active":"2024-09-14T11:08:21.791801+0000","last_became_peered":"2024-09-14T11:08:21.791801+0000","last_unstale":"2024-09-14T13:02:19.522599+0000","last_undegraded":"2024-09-14T13:02:19.522599+0000","last_fullsized":"2024-09-14T13:02:19.522599+0000","mapping_epoch":24,"log_start":"267'100","ondisk_log_start":"267'100","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'155","last_scrub_stamp":"2024-09-14T13:02:19.522401+0000","last_deep_scrub":"267'155","last_deep_scrub_stamp":"2024-09-14T13:02:19.522401+0000","last_clean_scrub_stamp":"2024-09-14T13:02:19.522401+0000","objects_scrubbed":1,"log_size":55,"log_dups_size":100,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:24:14.148910+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":30,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":413,"num_read_kb":24131,"num_write":680,"num_write_kb":32915,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,3],"acting":[5,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3d","version":"267'393","reported_seq":1933,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:00:21.252531+0000","last_change":"2024-09-14T11:08:23.787239+0000","last_active":"2024-09-14T13:00:21.252531+0000","last_peered":"2024-09-14T13:00:21.252531+0000","last_clean":"2024-09-14T13:00:21.252531+0000","last_became_active":"2024-09-14T11:08:23.786522+0000","last_became_peered":"2024-09-14T11:08:23.786522+0000","last_unstale":"2024-09-14T13:00:21.252531+0000","last_undegraded":"2024-09-14T13:00:21.252531+0000","last_fullsized":"2024-09-14T13:00:21.252531+0000","mapping_epoch":26,"log_start":"267'300","ondisk_log_start":"267'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:08:22.750609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:08:22.750609+0000","last_clean_scrub_stamp":"2024-09-14T11:08:22.750609+0000","objects_scrubbed":0,"log_size":93,"log_dups_size":300,"ondisk_log_size":93,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:53:44.242192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2147,"num_read_kb":2043,"num_write":454,"num_write_kb":90,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.39","version":"267'266","reported_seq":1039,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:16.621607+0000","last_change":"2024-09-14T13:02:16.621607+0000","last_active":"2024-09-14T13:02:16.621607+0000","last_peered":"2024-09-14T13:02:16.621607+0000","last_clean":"2024-09-14T13:02:16.621607+0000","last_became_active":"2024-09-14T11:08:21.837147+0000","last_became_peered":"2024-09-14T11:08:21.837147+0000","last_unstale":"2024-09-14T13:02:16.621607+0000","last_undegraded":"2024-09-14T13:02:16.621607+0000","last_fullsized":"2024-09-14T13:02:16.621607+0000","mapping_epoch":24,"log_start":"267'200","ondisk_log_start":"267'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'266","last_scrub_stamp":"2024-09-14T13:02:16.621341+0000","last_deep_scrub":"267'266","last_deep_scrub_stamp":"2024-09-14T13:02:16.621341+0000","last_clean_scrub_stamp":"2024-09-14T13:02:16.621341+0000","objects_scrubbed":3,"log_size":66,"log_dups_size":200,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:00:31.402959+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1655838,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1268,"num_read_kb":31286,"num_write":1154,"num_write_kb":25837,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0,4],"acting":[7,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3e","version":"267'508","reported_seq":2123,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:00:11.324764+0000","last_change":"2024-09-14T11:08:23.801317+0000","last_active":"2024-09-14T13:00:11.324764+0000","last_peered":"2024-09-14T13:00:11.324764+0000","last_clean":"2024-09-14T13:00:11.324764+0000","last_became_active":"2024-09-14T11:08:23.800621+0000","last_became_peered":"2024-09-14T11:08:23.800621+0000","last_unstale":"2024-09-14T13:00:11.324764+0000","last_undegraded":"2024-09-14T13:00:11.324764+0000","last_fullsized":"2024-09-14T13:00:11.324764+0000","mapping_epoch":26,"log_start":"267'400","ondisk_log_start":"267'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:08:22.750609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:08:22.750609+0000","last_clean_scrub_stamp":"2024-09-14T11:08:22.750609+0000","objects_scrubbed":0,"log_size":108,"log_dups_size":400,"ondisk_log_size":108,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:34:14.386345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2676,"num_read_kb":2481,"num_write":623,"num_write_kb":172,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.38","version":"267'224","reported_seq":898,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:11.931881+0000","last_change":"2024-09-14T13:02:11.931881+0000","last_active":"2024-09-14T13:02:11.931881+0000","last_peered":"2024-09-14T13:02:11.931881+0000","last_clean":"2024-09-14T13:02:11.931881+0000","last_became_active":"2024-09-14T11:08:21.819029+0000","last_became_peered":"2024-09-14T11:08:21.819029+0000","last_unstale":"2024-09-14T13:02:11.931881+0000","last_undegraded":"2024-09-14T13:02:11.931881+0000","last_fullsized":"2024-09-14T13:02:11.931881+0000","mapping_epoch":24,"log_start":"267'200","ondisk_log_start":"267'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'224","last_scrub_stamp":"2024-09-14T13:02:11.931546+0000","last_deep_scrub":"267'224","last_deep_scrub_stamp":"2024-09-14T13:02:11.931546+0000","last_clean_scrub_stamp":"2024-09-14T13:02:11.931546+0000","objects_scrubbed":3,"log_size":24,"log_dups_size":200,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T00:04:21.176019+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":66,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":538,"num_read_kb":44678,"num_write":942,"num_write_kb":39932,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,6],"acting":[3,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3f","version":"267'919","reported_seq":2573,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:20.133057+0000","last_change":"2024-09-14T13:02:20.133057+0000","last_active":"2024-09-14T13:02:20.133057+0000","last_peered":"2024-09-14T13:02:20.133057+0000","last_clean":"2024-09-14T13:02:20.133057+0000","last_became_active":"2024-09-14T11:08:23.785941+0000","last_became_peered":"2024-09-14T11:08:23.785941+0000","last_unstale":"2024-09-14T13:02:20.133057+0000","last_undegraded":"2024-09-14T13:02:20.133057+0000","last_fullsized":"2024-09-14T13:02:20.133057+0000","mapping_epoch":26,"log_start":"267'900","ondisk_log_start":"267'900","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'919","last_scrub_stamp":"2024-09-14T13:02:20.132814+0000","last_deep_scrub":"267'919","last_deep_scrub_stamp":"2024-09-14T13:02:20.132814+0000","last_clean_scrub_stamp":"2024-09-14T13:02:20.132814+0000","objects_scrubbed":3,"log_size":19,"log_dups_size":900,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:16:06.728821+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":4272,"num_read_kb":3805,"num_write":1224,"num_write_kb":476,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"267'398","reported_seq":1978,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:22.702586+0000","last_change":"2024-09-14T13:02:22.702586+0000","last_active":"2024-09-14T13:02:22.702586+0000","last_peered":"2024-09-14T13:02:22.702586+0000","last_clean":"2024-09-14T13:02:22.702586+0000","last_became_active":"2024-09-14T11:08:23.785439+0000","last_became_peered":"2024-09-14T11:08:23.785439+0000","last_unstale":"2024-09-14T13:02:22.702586+0000","last_undegraded":"2024-09-14T13:02:22.702586+0000","last_fullsized":"2024-09-14T13:02:22.702586+0000","mapping_epoch":26,"log_start":"267'300","ondisk_log_start":"267'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'398","last_scrub_stamp":"2024-09-14T13:02:22.702370+0000","last_deep_scrub":"267'398","last_deep_scrub_stamp":"2024-09-14T13:02:22.702370+0000","last_clean_scrub_stamp":"2024-09-14T13:02:22.702370+0000","objects_scrubbed":1,"log_size":98,"log_dups_size":300,"ondisk_log_size":98,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:20:26.205553+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2124,"num_read_kb":2036,"num_write":427,"num_write_kb":63,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.37","version":"267'275","reported_seq":1015,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:13.622088+0000","last_change":"2024-09-14T13:02:13.622088+0000","last_active":"2024-09-14T13:02:13.622088+0000","last_peered":"2024-09-14T13:02:13.622088+0000","last_clean":"2024-09-14T13:02:13.622088+0000","last_became_active":"2024-09-14T11:08:21.805293+0000","last_became_peered":"2024-09-14T11:08:21.805293+0000","last_unstale":"2024-09-14T13:02:13.622088+0000","last_undegraded":"2024-09-14T13:02:13.622088+0000","last_fullsized":"2024-09-14T13:02:13.622088+0000","mapping_epoch":24,"log_start":"267'200","ondisk_log_start":"267'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'275","last_scrub_stamp":"2024-09-14T13:02:13.621839+0000","last_deep_scrub":"267'275","last_deep_scrub_stamp":"2024-09-14T13:02:13.621839+0000","last_clean_scrub_stamp":"2024-09-14T13:02:13.621839+0000","objects_scrubbed":5,"log_size":75,"log_dups_size":200,"ondisk_log_size":75,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:36:57.835433+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1655894,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":1085,"num_read_kb":13085,"num_write":1149,"num_write_kb":51014,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,0],"acting":[7,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.31","version":"267'698","reported_seq":2408,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:00:21.250245+0000","last_change":"2024-09-14T11:08:23.808916+0000","last_active":"2024-09-14T13:00:21.250245+0000","last_peered":"2024-09-14T13:00:21.250245+0000","last_clean":"2024-09-14T13:00:21.250245+0000","last_became_active":"2024-09-14T11:08:23.808090+0000","last_became_peered":"2024-09-14T11:08:23.808090+0000","last_unstale":"2024-09-14T13:00:21.250245+0000","last_undegraded":"2024-09-14T13:00:21.250245+0000","last_fullsized":"2024-09-14T13:00:21.250245+0000","mapping_epoch":26,"log_start":"267'600","ondisk_log_start":"267'600","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:08:22.750609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:08:22.750609+0000","last_clean_scrub_stamp":"2024-09-14T11:08:22.750609+0000","objects_scrubbed":0,"log_size":98,"log_dups_size":600,"ondisk_log_size":98,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:17:11.316389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":3652,"num_read_kb":3296,"num_write":1024,"num_write_kb":466,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"267'186","reported_seq":829,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:17.374091+0000","last_change":"2024-09-14T13:02:17.374091+0000","last_active":"2024-09-14T13:02:17.374091+0000","last_peered":"2024-09-14T13:02:17.374091+0000","last_clean":"2024-09-14T13:02:17.374091+0000","last_became_active":"2024-09-14T11:08:21.824907+0000","last_became_peered":"2024-09-14T11:08:21.824907+0000","last_unstale":"2024-09-14T13:02:17.374091+0000","last_undegraded":"2024-09-14T13:02:17.374091+0000","last_fullsized":"2024-09-14T13:02:17.374091+0000","mapping_epoch":24,"log_start":"267'100","ondisk_log_start":"267'100","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'186","last_scrub_stamp":"2024-09-14T13:02:17.373793+0000","last_deep_scrub":"267'186","last_deep_scrub_stamp":"2024-09-14T13:02:17.373793+0000","last_clean_scrub_stamp":"2024-09-14T13:02:17.373793+0000","objects_scrubbed":6,"log_size":86,"log_dups_size":100,"ondisk_log_size":86,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:39:09.691991+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":511,"num_read_kb":17563,"num_write":879,"num_write_kb":17084,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,4],"acting":[6,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.32","version":"267'540","reported_seq":2172,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:58:38.043258+0000","last_change":"2024-09-14T11:08:23.804611+0000","last_active":"2024-09-14T12:58:38.043258+0000","last_peered":"2024-09-14T12:58:38.043258+0000","last_clean":"2024-09-14T12:58:38.043258+0000","last_became_active":"2024-09-14T11:08:23.801090+0000","last_became_peered":"2024-09-14T11:08:23.801090+0000","last_unstale":"2024-09-14T12:58:38.043258+0000","last_undegraded":"2024-09-14T12:58:38.043258+0000","last_fullsized":"2024-09-14T12:58:38.043258+0000","mapping_epoch":26,"log_start":"267'500","ondisk_log_start":"267'500","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:08:22.750609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:08:22.750609+0000","last_clean_scrub_stamp":"2024-09-14T11:08:22.750609+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":500,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:20:59.798401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2832,"num_read_kb":2611,"num_write":684,"num_write_kb":208,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.35","version":"267'227","reported_seq":905,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:15.349124+0000","last_change":"2024-09-14T13:02:15.349124+0000","last_active":"2024-09-14T13:02:15.349124+0000","last_peered":"2024-09-14T13:02:15.349124+0000","last_clean":"2024-09-14T13:02:15.349124+0000","last_became_active":"2024-09-14T11:08:21.817113+0000","last_became_peered":"2024-09-14T11:08:21.817113+0000","last_unstale":"2024-09-14T13:02:15.349124+0000","last_undegraded":"2024-09-14T13:02:15.349124+0000","last_fullsized":"2024-09-14T13:02:15.349124+0000","mapping_epoch":24,"log_start":"267'200","ondisk_log_start":"267'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'227","last_scrub_stamp":"2024-09-14T13:02:15.348883+0000","last_deep_scrub":"267'227","last_deep_scrub_stamp":"2024-09-14T13:02:15.348883+0000","last_clean_scrub_stamp":"2024-09-14T13:02:15.348883+0000","objects_scrubbed":5,"log_size":27,"log_dups_size":200,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:20:13.352709+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1655893,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":573,"num_read_kb":71773,"num_write":1062,"num_write_kb":34768,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,0],"acting":[6,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.33","version":"267'480","reported_seq":2202,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:59:37.835877+0000","last_change":"2024-09-14T11:08:23.782419+0000","last_active":"2024-09-14T12:59:37.835877+0000","last_peered":"2024-09-14T12:59:37.835877+0000","last_clean":"2024-09-14T12:59:37.835877+0000","last_became_active":"2024-09-14T11:08:23.782135+0000","last_became_peered":"2024-09-14T11:08:23.782135+0000","last_unstale":"2024-09-14T12:59:37.835877+0000","last_undegraded":"2024-09-14T12:59:37.835877+0000","last_fullsized":"2024-09-14T12:59:37.835877+0000","mapping_epoch":26,"log_start":"267'400","ondisk_log_start":"267'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:08:22.750609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:08:22.750609+0000","last_clean_scrub_stamp":"2024-09-14T11:08:22.750609+0000","objects_scrubbed":0,"log_size":80,"log_dups_size":400,"ondisk_log_size":80,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:10:45.724644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2660,"num_read_kb":2528,"num_write":519,"num_write_kb":93,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.34","version":"267'250","reported_seq":912,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:10.813724+0000","last_change":"2024-09-14T13:02:10.813724+0000","last_active":"2024-09-14T13:02:10.813724+0000","last_peered":"2024-09-14T13:02:10.813724+0000","last_clean":"2024-09-14T13:02:10.813724+0000","last_became_active":"2024-09-14T11:08:21.835636+0000","last_became_peered":"2024-09-14T11:08:21.835636+0000","last_unstale":"2024-09-14T13:02:10.813724+0000","last_undegraded":"2024-09-14T13:02:10.813724+0000","last_fullsized":"2024-09-14T13:02:10.813724+0000","mapping_epoch":24,"log_start":"267'200","ondisk_log_start":"267'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'250","last_scrub_stamp":"2024-09-14T13:02:10.813489+0000","last_deep_scrub":"267'250","last_deep_scrub_stamp":"2024-09-14T13:02:10.813489+0000","last_clean_scrub_stamp":"2024-09-14T13:02:10.813489+0000","objects_scrubbed":2,"log_size":50,"log_dups_size":200,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T00:40:56.666305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1655836,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":575,"num_read_kb":3577,"num_write":1185,"num_write_kb":25395,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6],"acting":[4,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.34","version":"267'554","reported_seq":2220,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:18.141972+0000","last_change":"2024-09-14T13:02:18.141972+0000","last_active":"2024-09-14T13:02:18.141972+0000","last_peered":"2024-09-14T13:02:18.141972+0000","last_clean":"2024-09-14T13:02:18.141972+0000","last_became_active":"2024-09-14T11:08:23.784078+0000","last_became_peered":"2024-09-14T11:08:23.784078+0000","last_unstale":"2024-09-14T13:02:18.141972+0000","last_undegraded":"2024-09-14T13:02:18.141972+0000","last_fullsized":"2024-09-14T13:02:18.141972+0000","mapping_epoch":26,"log_start":"267'500","ondisk_log_start":"267'500","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'554","last_scrub_stamp":"2024-09-14T13:02:18.141748+0000","last_deep_scrub":"267'554","last_deep_scrub_stamp":"2024-09-14T13:02:18.141748+0000","last_clean_scrub_stamp":"2024-09-14T13:02:18.141748+0000","objects_scrubbed":1,"log_size":54,"log_dups_size":500,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:33:55.821825+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3071,"num_read_kb":2852,"num_write":734,"num_write_kb":256,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.33","version":"267'240","reported_seq":882,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:12.917024+0000","last_change":"2024-09-14T13:02:12.917024+0000","last_active":"2024-09-14T13:02:12.917024+0000","last_peered":"2024-09-14T13:02:12.917024+0000","last_clean":"2024-09-14T13:02:12.917024+0000","last_became_active":"2024-09-14T11:08:21.809526+0000","last_became_peered":"2024-09-14T11:08:21.809526+0000","last_unstale":"2024-09-14T13:02:12.917024+0000","last_undegraded":"2024-09-14T13:02:12.917024+0000","last_fullsized":"2024-09-14T13:02:12.917024+0000","mapping_epoch":24,"log_start":"267'200","ondisk_log_start":"267'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'240","last_scrub_stamp":"2024-09-14T13:02:12.916789+0000","last_deep_scrub":"267'240","last_deep_scrub_stamp":"2024-09-14T13:02:12.916789+0000","last_clean_scrub_stamp":"2024-09-14T13:02:12.916789+0000","objects_scrubbed":2,"log_size":40,"log_dups_size":200,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:08:03.665418+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":500,"num_read_kb":25008,"num_write":1059,"num_write_kb":23085,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6,1],"acting":[3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.35","version":"267'800","reported_seq":2456,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:00:11.323529+0000","last_change":"2024-09-14T11:08:23.786757+0000","last_active":"2024-09-14T13:00:11.323529+0000","last_peered":"2024-09-14T13:00:11.323529+0000","last_clean":"2024-09-14T13:00:11.323529+0000","last_became_active":"2024-09-14T11:08:23.785540+0000","last_became_peered":"2024-09-14T11:08:23.785540+0000","last_unstale":"2024-09-14T13:00:11.323529+0000","last_undegraded":"2024-09-14T13:00:11.323529+0000","last_fullsized":"2024-09-14T13:00:11.323529+0000","mapping_epoch":26,"log_start":"267'700","ondisk_log_start":"267'700","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:08:22.750609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:08:22.750609+0000","last_clean_scrub_stamp":"2024-09-14T11:08:22.750609+0000","objects_scrubbed":0,"log_size":100,"log_dups_size":700,"ondisk_log_size":100,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:29:32.957124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3845,"num_read_kb":3496,"num_write":1039,"num_write_kb":364,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.32","version":"267'223","reported_seq":1020,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:11.123809+0000","last_change":"2024-09-14T13:02:11.123809+0000","last_active":"2024-09-14T13:02:11.123809+0000","last_peered":"2024-09-14T13:02:11.123809+0000","last_clean":"2024-09-14T13:02:11.123809+0000","last_became_active":"2024-09-14T11:08:21.780800+0000","last_became_peered":"2024-09-14T11:08:21.780800+0000","last_unstale":"2024-09-14T13:02:11.123809+0000","last_undegraded":"2024-09-14T13:02:11.123809+0000","last_fullsized":"2024-09-14T13:02:11.123809+0000","mapping_epoch":24,"log_start":"267'200","ondisk_log_start":"267'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'223","last_scrub_stamp":"2024-09-14T13:02:11.123576+0000","last_deep_scrub":"267'223","last_deep_scrub_stamp":"2024-09-14T13:02:11.123576+0000","last_clean_scrub_stamp":"2024-09-14T13:02:11.123576+0000","objects_scrubbed":3,"log_size":23,"log_dups_size":200,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:03:24.176635+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1655860,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1400,"num_read_kb":21343,"num_write":1086,"num_write_kb":34809,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,1],"acting":[0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.18","version":"267'195","reported_seq":739,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:00:21.590473+0000","last_change":"2024-09-14T11:08:31.851342+0000","last_active":"2024-09-14T13:00:21.590473+0000","last_peered":"2024-09-14T13:00:21.590473+0000","last_clean":"2024-09-14T13:00:21.590473+0000","last_became_active":"2024-09-14T11:08:31.850605+0000","last_became_peered":"2024-09-14T11:08:31.850605+0000","last_unstale":"2024-09-14T13:00:21.590473+0000","last_undegraded":"2024-09-14T13:00:21.590473+0000","last_fullsized":"2024-09-14T13:00:21.590473+0000","mapping_epoch":34,"log_start":"267'100","ondisk_log_start":"267'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:08:30.789404+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:08:30.789404+0000","last_clean_scrub_stamp":"2024-09-14T11:08:30.789404+0000","objects_scrubbed":0,"log_size":95,"log_dups_size":100,"ondisk_log_size":95,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":204,"num_read_kb":191,"num_write":376,"num_write_kb":86,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.14","version":"267'869","reported_seq":2400,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:17.883495+0000","last_change":"2024-09-14T13:02:17.883495+0000","last_active":"2024-09-14T13:02:17.883495+0000","last_peered":"2024-09-14T13:02:17.883495+0000","last_clean":"2024-09-14T13:02:17.883495+0000","last_became_active":"2024-09-14T11:08:23.779822+0000","last_became_peered":"2024-09-14T11:08:23.779822+0000","last_unstale":"2024-09-14T13:02:17.883495+0000","last_undegraded":"2024-09-14T13:02:17.883495+0000","last_fullsized":"2024-09-14T13:02:17.883495+0000","mapping_epoch":26,"log_start":"267'800","ondisk_log_start":"267'800","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'869","last_scrub_stamp":"2024-09-14T13:02:17.883315+0000","last_deep_scrub":"267'869","last_deep_scrub_stamp":"2024-09-14T13:02:17.883315+0000","last_clean_scrub_stamp":"2024-09-14T13:02:17.883315+0000","objects_scrubbed":4,"log_size":69,"log_dups_size":800,"ondisk_log_size":69,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:49:19.140159+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":4044,"num_read_kb":3595,"num_write":1182,"num_write_kb":452,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"267'245","reported_seq":1021,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:17.612170+0000","last_change":"2024-09-14T13:02:17.612170+0000","last_active":"2024-09-14T13:02:17.612170+0000","last_peered":"2024-09-14T13:02:17.612170+0000","last_clean":"2024-09-14T13:02:17.612170+0000","last_became_active":"2024-09-14T11:08:21.843212+0000","last_became_peered":"2024-09-14T11:08:21.843212+0000","last_unstale":"2024-09-14T13:02:17.612170+0000","last_undegraded":"2024-09-14T13:02:17.612170+0000","last_fullsized":"2024-09-14T13:02:17.612170+0000","mapping_epoch":24,"log_start":"267'200","ondisk_log_start":"267'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'245","last_scrub_stamp":"2024-09-14T13:02:17.611975+0000","last_deep_scrub":"267'245","last_deep_scrub_stamp":"2024-09-14T13:02:17.611975+0000","last_clean_scrub_stamp":"2024-09-14T13:02:17.611975+0000","objects_scrubbed":2,"log_size":45,"log_dups_size":200,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:38:36.738720+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":15,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1021,"num_read_kb":177071,"num_write":1108,"num_write_kb":33961,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,4],"acting":[7,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":526,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:59:38.056657+0000","last_change":"2024-09-14T11:08:25.814095+0000","last_active":"2024-09-14T12:59:38.056657+0000","last_peered":"2024-09-14T12:59:38.056657+0000","last_clean":"2024-09-14T12:59:38.056657+0000","last_became_active":"2024-09-14T11:08:25.803311+0000","last_became_peered":"2024-09-14T11:08:25.803311+0000","last_unstale":"2024-09-14T12:59:38.056657+0000","last_undegraded":"2024-09-14T12:59:38.056657+0000","last_fullsized":"2024-09-14T12:59:38.056657+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:08:24.757170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:08:24.757170+0000","last_clean_scrub_stamp":"2024-09-14T11:08:24.757170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:07:56.109258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.16","version":"267'228","reported_seq":886,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:00.082194+0000","last_change":"2024-09-14T11:08:27.809396+0000","last_active":"2024-09-14T13:02:00.082194+0000","last_peered":"2024-09-14T13:02:00.082194+0000","last_clean":"2024-09-14T13:02:00.082194+0000","last_became_active":"2024-09-14T11:08:27.808834+0000","last_became_peered":"2024-09-14T11:08:27.808834+0000","last_unstale":"2024-09-14T13:02:00.082194+0000","last_undegraded":"2024-09-14T13:02:00.082194+0000","last_fullsized":"2024-09-14T13:02:00.082194+0000","mapping_epoch":30,"log_start":"267'200","ondisk_log_start":"267'200","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:08:26.771628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:08:26.771628+0000","last_clean_scrub_stamp":"2024-09-14T11:08:26.771628+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":200,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:33:46.586543+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4096,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":308,"num_read_kb":323,"num_write":180,"num_write_kb":16,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":519,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:59:42.848486+0000","last_change":"2024-09-14T11:08:29.834235+0000","last_active":"2024-09-14T12:59:42.848486+0000","last_peered":"2024-09-14T12:59:42.848486+0000","last_clean":"2024-09-14T12:59:42.848486+0000","last_became_active":"2024-09-14T11:08:29.833332+0000","last_became_peered":"2024-09-14T11:08:29.833332+0000","last_unstale":"2024-09-14T12:59:42.848486+0000","last_undegraded":"2024-09-14T12:59:42.848486+0000","last_fullsized":"2024-09-14T12:59:42.848486+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:08:28.783586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:08:28.783586+0000","last_clean_scrub_stamp":"2024-09-14T11:08:28.783586+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.19","version":"267'122","reported_seq":639,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:57:48.032017+0000","last_change":"2024-09-14T11:08:31.844405+0000","last_active":"2024-09-14T12:57:48.032017+0000","last_peered":"2024-09-14T12:57:48.032017+0000","last_clean":"2024-09-14T12:57:48.032017+0000","last_became_active":"2024-09-14T11:08:31.843645+0000","last_became_peered":"2024-09-14T11:08:31.843645+0000","last_unstale":"2024-09-14T12:57:48.032017+0000","last_undegraded":"2024-09-14T12:57:48.032017+0000","last_fullsized":"2024-09-14T12:57:48.032017+0000","mapping_epoch":34,"log_start":"267'100","ondisk_log_start":"267'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:08:30.789404+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:08:30.789404+0000","last_clean_scrub_stamp":"2024-09-14T11:08:30.789404+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":100,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:14:31.616675+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":100,"num_read_kb":97,"num_write":289,"num_write_kb":65,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.15","version":"267'1237","reported_seq":3023,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:22.427041+0000","last_change":"2024-09-14T13:02:22.427041+0000","last_active":"2024-09-14T13:02:22.427041+0000","last_peered":"2024-09-14T13:02:22.427041+0000","last_clean":"2024-09-14T13:02:22.427041+0000","last_became_active":"2024-09-14T11:08:23.808015+0000","last_became_peered":"2024-09-14T11:08:23.808015+0000","last_unstale":"2024-09-14T13:02:22.427041+0000","last_undegraded":"2024-09-14T13:02:22.427041+0000","last_fullsized":"2024-09-14T13:02:22.427041+0000","mapping_epoch":26,"log_start":"267'1200","ondisk_log_start":"267'1200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'1237","last_scrub_stamp":"2024-09-14T13:02:22.426850+0000","last_deep_scrub":"267'1237","last_deep_scrub_stamp":"2024-09-14T13:02:22.426850+0000","last_clean_scrub_stamp":"2024-09-14T13:02:22.426850+0000","objects_scrubbed":3,"log_size":37,"log_dups_size":1200,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:18:30.537089+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":5778,"num_read_kb":5143,"num_write":1691,"num_write_kb":698,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2040,"num_omap_keys":8,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.12","version":"267'232","reported_seq":957,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:04.981981+0000","last_change":"2024-09-14T13:02:04.981981+0000","last_active":"2024-09-14T13:02:04.981981+0000","last_peered":"2024-09-14T13:02:04.981981+0000","last_clean":"2024-09-14T13:02:04.981981+0000","last_became_active":"2024-09-14T11:08:21.787257+0000","last_became_peered":"2024-09-14T11:08:21.787257+0000","last_unstale":"2024-09-14T13:02:04.981981+0000","last_undegraded":"2024-09-14T13:02:04.981981+0000","last_fullsized":"2024-09-14T13:02:04.981981+0000","mapping_epoch":24,"log_start":"267'200","ondisk_log_start":"267'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'232","last_scrub_stamp":"2024-09-14T13:02:04.981884+0000","last_deep_scrub":"267'232","last_deep_scrub_stamp":"2024-09-14T13:02:04.981884+0000","last_clean_scrub_stamp":"2024-09-14T13:02:04.981884+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":200,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:03:51.775808+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":660,"num_read_kb":98910,"num_write":982,"num_write_kb":32453,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3],"acting":[0,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":535,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:22.944095+0000","last_change":"2024-09-14T13:02:22.944095+0000","last_active":"2024-09-14T13:02:22.944095+0000","last_peered":"2024-09-14T13:02:22.944095+0000","last_clean":"2024-09-14T13:02:22.944095+0000","last_became_active":"2024-09-14T11:08:25.804100+0000","last_became_peered":"2024-09-14T11:08:25.804100+0000","last_unstale":"2024-09-14T13:02:22.944095+0000","last_undegraded":"2024-09-14T13:02:22.944095+0000","last_fullsized":"2024-09-14T13:02:22.944095+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T13:02:22.943903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T13:02:22.943903+0000","last_clean_scrub_stamp":"2024-09-14T13:02:22.943903+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:47:59.177750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.17","version":"267'129","reported_seq":705,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:59:38.241474+0000","last_change":"2024-09-14T11:08:27.831807+0000","last_active":"2024-09-14T12:59:38.241474+0000","last_peered":"2024-09-14T12:59:38.241474+0000","last_clean":"2024-09-14T12:59:38.241474+0000","last_became_active":"2024-09-14T11:08:27.831010+0000","last_became_peered":"2024-09-14T11:08:27.831010+0000","last_unstale":"2024-09-14T12:59:38.241474+0000","last_undegraded":"2024-09-14T12:59:38.241474+0000","last_fullsized":"2024-09-14T12:59:38.241474+0000","mapping_epoch":30,"log_start":"267'100","ondisk_log_start":"267'100","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:08:26.771628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:08:26.771628+0000","last_clean_scrub_stamp":"2024-09-14T11:08:26.771628+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":100,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:48:05.929304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":152,"num_read_kb":149,"num_write":100,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":520,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:59:43.242611+0000","last_change":"2024-09-14T11:08:29.810149+0000","last_active":"2024-09-14T12:59:43.242611+0000","last_peered":"2024-09-14T12:59:43.242611+0000","last_clean":"2024-09-14T12:59:43.242611+0000","last_became_active":"2024-09-14T11:08:29.809568+0000","last_became_peered":"2024-09-14T11:08:29.809568+0000","last_unstale":"2024-09-14T12:59:43.242611+0000","last_undegraded":"2024-09-14T12:59:43.242611+0000","last_fullsized":"2024-09-14T12:59:43.242611+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:08:28.783586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:08:28.783586+0000","last_clean_scrub_stamp":"2024-09-14T11:08:28.783586+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.1a","version":"267'137","reported_seq":722,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:58:33.237668+0000","last_change":"2024-09-14T11:08:31.846263+0000","last_active":"2024-09-14T12:58:33.237668+0000","last_peered":"2024-09-14T12:58:33.237668+0000","last_clean":"2024-09-14T12:58:33.237668+0000","last_became_active":"2024-09-14T11:08:31.845634+0000","last_became_peered":"2024-09-14T11:08:31.845634+0000","last_unstale":"2024-09-14T12:58:33.237668+0000","last_undegraded":"2024-09-14T12:58:33.237668+0000","last_fullsized":"2024-09-14T12:58:33.237668+0000","mapping_epoch":34,"log_start":"267'100","ondisk_log_start":"267'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:08:30.789404+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:08:30.789404+0000","last_clean_scrub_stamp":"2024-09-14T11:08:30.789404+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":100,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:44:18.672749+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":271,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":347,"num_read_kb":294,"num_write":357,"num_write_kb":85,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"267'412","reported_seq":1938,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:20.980337+0000","last_change":"2024-09-14T13:02:20.980337+0000","last_active":"2024-09-14T13:02:20.980337+0000","last_peered":"2024-09-14T13:02:20.980337+0000","last_clean":"2024-09-14T13:02:20.980337+0000","last_became_active":"2024-09-14T11:08:23.780326+0000","last_became_peered":"2024-09-14T11:08:23.780326+0000","last_unstale":"2024-09-14T13:02:20.980337+0000","last_undegraded":"2024-09-14T13:02:20.980337+0000","last_fullsized":"2024-09-14T13:02:20.980337+0000","mapping_epoch":26,"log_start":"267'400","ondisk_log_start":"267'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'412","last_scrub_stamp":"2024-09-14T13:02:20.980143+0000","last_deep_scrub":"267'412","last_deep_scrub_stamp":"2024-09-14T13:02:20.980143+0000","last_clean_scrub_stamp":"2024-09-14T13:02:20.980143+0000","objects_scrubbed":3,"log_size":12,"log_dups_size":400,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:17:39.736976+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2172,"num_read_kb":2053,"num_write":475,"num_write_kb":100,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.11","version":"267'229","reported_seq":863,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:07.062536+0000","last_change":"2024-09-14T13:02:07.062536+0000","last_active":"2024-09-14T13:02:07.062536+0000","last_peered":"2024-09-14T13:02:07.062536+0000","last_clean":"2024-09-14T13:02:07.062536+0000","last_became_active":"2024-09-14T11:08:56.038815+0000","last_became_peered":"2024-09-14T11:08:56.038815+0000","last_unstale":"2024-09-14T13:02:07.062536+0000","last_undegraded":"2024-09-14T13:02:07.062536+0000","last_fullsized":"2024-09-14T13:02:07.062536+0000","mapping_epoch":37,"log_start":"267'200","ondisk_log_start":"267'200","created":24,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'229","last_scrub_stamp":"2024-09-14T13:02:07.062441+0000","last_deep_scrub":"267'229","last_deep_scrub_stamp":"2024-09-14T13:02:07.062441+0000","last_clean_scrub_stamp":"2024-09-14T13:02:07.062441+0000","objects_scrubbed":2,"log_size":29,"log_dups_size":200,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:34:17.014914+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":52,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":508,"num_read_kb":22051,"num_write":996,"num_write_kb":45213,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4,6],"acting":[2,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":526,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:59:38.476225+0000","last_change":"2024-09-14T11:08:25.798412+0000","last_active":"2024-09-14T12:59:38.476225+0000","last_peered":"2024-09-14T12:59:38.476225+0000","last_clean":"2024-09-14T12:59:38.476225+0000","last_became_active":"2024-09-14T11:08:25.798008+0000","last_became_peered":"2024-09-14T11:08:25.798008+0000","last_unstale":"2024-09-14T12:59:38.476225+0000","last_undegraded":"2024-09-14T12:59:38.476225+0000","last_fullsized":"2024-09-14T12:59:38.476225+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:08:24.757170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:08:24.757170+0000","last_clean_scrub_stamp":"2024-09-14T11:08:24.757170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:17:44.680400+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.14","version":"267'180","reported_seq":783,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:00:11.342120+0000","last_change":"2024-09-14T11:08:27.821531+0000","last_active":"2024-09-14T13:00:11.342120+0000","last_peered":"2024-09-14T13:00:11.342120+0000","last_clean":"2024-09-14T13:00:11.342120+0000","last_became_active":"2024-09-14T11:08:27.820627+0000","last_became_peered":"2024-09-14T11:08:27.820627+0000","last_unstale":"2024-09-14T13:00:11.342120+0000","last_undegraded":"2024-09-14T13:00:11.342120+0000","last_fullsized":"2024-09-14T13:00:11.342120+0000","mapping_epoch":30,"log_start":"267'100","ondisk_log_start":"267'100","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:08:26.771628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:08:26.771628+0000","last_clean_scrub_stamp":"2024-09-14T11:08:26.771628+0000","objects_scrubbed":0,"log_size":80,"log_dups_size":100,"ondisk_log_size":80,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:00:26.336465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":232,"num_read_kb":224,"num_write":158,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.15","version":"267'775","reported_seq":3172,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:00.490109+0000","last_change":"2024-09-14T11:08:29.838884+0000","last_active":"2024-09-14T13:02:00.490109+0000","last_peered":"2024-09-14T13:02:00.490109+0000","last_clean":"2024-09-14T13:02:00.490109+0000","last_became_active":"2024-09-14T11:08:29.838193+0000","last_became_peered":"2024-09-14T11:08:29.838193+0000","last_unstale":"2024-09-14T13:02:00.490109+0000","last_undegraded":"2024-09-14T13:02:00.490109+0000","last_fullsized":"2024-09-14T13:02:00.490109+0000","mapping_epoch":32,"log_start":"267'701","ondisk_log_start":"267'701","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:08:28.783586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:08:28.783586+0000","last_clean_scrub_stamp":"2024-09-14T11:08:28.783586+0000","objects_scrubbed":0,"log_size":74,"log_dups_size":701,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1b","version":"267'210","reported_seq":1068,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:00:21.684009+0000","last_change":"2024-09-14T11:08:31.844271+0000","last_active":"2024-09-14T13:00:21.684009+0000","last_peered":"2024-09-14T13:00:21.684009+0000","last_clean":"2024-09-14T13:00:21.684009+0000","last_became_active":"2024-09-14T11:08:31.843385+0000","last_became_peered":"2024-09-14T11:08:31.843385+0000","last_unstale":"2024-09-14T13:00:21.684009+0000","last_undegraded":"2024-09-14T13:00:21.684009+0000","last_fullsized":"2024-09-14T13:00:21.684009+0000","mapping_epoch":34,"log_start":"267'100","ondisk_log_start":"267'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:08:30.789404+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:08:30.789404+0000","last_clean_scrub_stamp":"2024-09-14T11:08:30.789404+0000","objects_scrubbed":0,"log_size":110,"log_dups_size":100,"ondisk_log_size":110,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:50:52.716773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":642,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":623,"num_read_kb":612,"num_write":468,"num_write_kb":119,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.17","version":"267'422","reported_seq":1919,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:13.138664+0000","last_change":"2024-09-14T13:02:13.138664+0000","last_active":"2024-09-14T13:02:13.138664+0000","last_peered":"2024-09-14T13:02:13.138664+0000","last_clean":"2024-09-14T13:02:13.138664+0000","last_became_active":"2024-09-14T11:09:57.239636+0000","last_became_peered":"2024-09-14T11:09:57.239636+0000","last_unstale":"2024-09-14T13:02:13.138664+0000","last_undegraded":"2024-09-14T13:02:13.138664+0000","last_fullsized":"2024-09-14T13:02:13.138664+0000","mapping_epoch":39,"log_start":"267'400","ondisk_log_start":"267'400","created":26,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'422","last_scrub_stamp":"2024-09-14T13:02:13.138458+0000","last_deep_scrub":"267'422","last_deep_scrub_stamp":"2024-09-14T13:02:13.138458+0000","last_clean_scrub_stamp":"2024-09-14T13:02:13.138458+0000","objects_scrubbed":2,"log_size":22,"log_dups_size":400,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:56:36.716655+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2202,"num_read_kb":2076,"num_write":491,"num_write_kb":104,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.10","version":"267'249","reported_seq":925,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:09.253431+0000","last_change":"2024-09-14T13:02:09.253431+0000","last_active":"2024-09-14T13:02:09.253431+0000","last_peered":"2024-09-14T13:02:09.253431+0000","last_clean":"2024-09-14T13:02:09.253431+0000","last_became_active":"2024-09-14T11:08:21.817332+0000","last_became_peered":"2024-09-14T11:08:21.817332+0000","last_unstale":"2024-09-14T13:02:09.253431+0000","last_undegraded":"2024-09-14T13:02:09.253431+0000","last_fullsized":"2024-09-14T13:02:09.253431+0000","mapping_epoch":24,"log_start":"267'200","ondisk_log_start":"267'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'249","last_scrub_stamp":"2024-09-14T13:02:09.253234+0000","last_deep_scrub":"267'249","last_deep_scrub_stamp":"2024-09-14T13:02:09.253234+0000","last_clean_scrub_stamp":"2024-09-14T13:02:09.253234+0000","objects_scrubbed":1,"log_size":49,"log_dups_size":200,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:02:19.341971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":650,"num_read_kb":50041,"num_write":1009,"num_write_kb":23458,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,5],"acting":[6,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":526,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:59:38.056717+0000","last_change":"2024-09-14T11:08:25.815329+0000","last_active":"2024-09-14T12:59:38.056717+0000","last_peered":"2024-09-14T12:59:38.056717+0000","last_clean":"2024-09-14T12:59:38.056717+0000","last_became_active":"2024-09-14T11:08:25.814645+0000","last_became_peered":"2024-09-14T11:08:25.814645+0000","last_unstale":"2024-09-14T12:59:38.056717+0000","last_undegraded":"2024-09-14T12:59:38.056717+0000","last_fullsized":"2024-09-14T12:59:38.056717+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:08:24.757170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:08:24.757170+0000","last_clean_scrub_stamp":"2024-09-14T11:08:24.757170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:04:57.817252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.15","version":"267'179","reported_seq":799,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:00.470671+0000","last_change":"2024-09-14T11:08:27.828686+0000","last_active":"2024-09-14T13:02:00.470671+0000","last_peered":"2024-09-14T13:02:00.470671+0000","last_clean":"2024-09-14T13:02:00.470671+0000","last_became_active":"2024-09-14T11:08:27.827940+0000","last_became_peered":"2024-09-14T11:08:27.827940+0000","last_unstale":"2024-09-14T13:02:00.470671+0000","last_undegraded":"2024-09-14T13:02:00.470671+0000","last_fullsized":"2024-09-14T13:02:00.470671+0000","mapping_epoch":30,"log_start":"267'100","ondisk_log_start":"267'100","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:08:26.771628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:08:26.771628+0000","last_clean_scrub_stamp":"2024-09-14T11:08:26.771628+0000","objects_scrubbed":0,"log_size":79,"log_dups_size":100,"ondisk_log_size":79,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:53:17.553624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6699,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":229,"num_read_kb":300,"num_write":130,"num_write_kb":20,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.14","version":"267'815","reported_seq":2986,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:00.447904+0000","last_change":"2024-09-14T11:08:29.832482+0000","last_active":"2024-09-14T13:02:00.447904+0000","last_peered":"2024-09-14T13:02:00.447904+0000","last_clean":"2024-09-14T13:02:00.447904+0000","last_became_active":"2024-09-14T11:08:29.831198+0000","last_became_peered":"2024-09-14T11:08:29.831198+0000","last_unstale":"2024-09-14T13:02:00.447904+0000","last_undegraded":"2024-09-14T13:02:00.447904+0000","last_fullsized":"2024-09-14T13:02:00.447904+0000","mapping_epoch":32,"log_start":"267'800","ondisk_log_start":"267'800","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:08:28.783586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:08:28.783586+0000","last_clean_scrub_stamp":"2024-09-14T11:08:28.783586+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":800,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:32:21.362746+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.8","version":"267'443","reported_seq":1996,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:21.471906+0000","last_change":"2024-09-14T13:02:21.471906+0000","last_active":"2024-09-14T13:02:21.471906+0000","last_peered":"2024-09-14T13:02:21.471906+0000","last_clean":"2024-09-14T13:02:21.471906+0000","last_became_active":"2024-09-14T11:08:23.811325+0000","last_became_peered":"2024-09-14T11:08:23.811325+0000","last_unstale":"2024-09-14T13:02:21.471906+0000","last_undegraded":"2024-09-14T13:02:21.471906+0000","last_fullsized":"2024-09-14T13:02:21.471906+0000","mapping_epoch":26,"log_start":"267'400","ondisk_log_start":"267'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'443","last_scrub_stamp":"2024-09-14T13:02:21.471733+0000","last_deep_scrub":"267'443","last_deep_scrub_stamp":"2024-09-14T13:02:21.471733+0000","last_clean_scrub_stamp":"2024-09-14T13:02:21.471733+0000","objects_scrubbed":3,"log_size":43,"log_dups_size":400,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T00:28:13.667148+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2277,"num_read_kb":2143,"num_write":513,"num_write_kb":125,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":217,"num_omap_keys":1,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.f","version":"267'247","reported_seq":939,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:09.651897+0000","last_change":"2024-09-14T13:02:09.651897+0000","last_active":"2024-09-14T13:02:09.651897+0000","last_peered":"2024-09-14T13:02:09.651897+0000","last_clean":"2024-09-14T13:02:09.651897+0000","last_became_active":"2024-09-14T11:08:21.845618+0000","last_became_peered":"2024-09-14T11:08:21.845618+0000","last_unstale":"2024-09-14T13:02:09.651897+0000","last_undegraded":"2024-09-14T13:02:09.651897+0000","last_fullsized":"2024-09-14T13:02:09.651897+0000","mapping_epoch":24,"log_start":"267'200","ondisk_log_start":"267'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'247","last_scrub_stamp":"2024-09-14T13:02:09.651691+0000","last_deep_scrub":"267'247","last_deep_scrub_stamp":"2024-09-14T13:02:09.651691+0000","last_clean_scrub_stamp":"2024-09-14T13:02:09.651691+0000","objects_scrubbed":3,"log_size":47,"log_dups_size":200,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:37:39.121548+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":682,"num_read_kb":36009,"num_write":1081,"num_write_kb":30861,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,0],"acting":[7,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":532,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:58:57.837680+0000","last_change":"2024-09-14T11:08:25.807559+0000","last_active":"2024-09-14T12:58:57.837680+0000","last_peered":"2024-09-14T12:58:57.837680+0000","last_clean":"2024-09-14T12:58:57.837680+0000","last_became_active":"2024-09-14T11:08:25.806427+0000","last_became_peered":"2024-09-14T11:08:25.806427+0000","last_unstale":"2024-09-14T12:58:57.837680+0000","last_undegraded":"2024-09-14T12:58:57.837680+0000","last_fullsized":"2024-09-14T12:58:57.837680+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:08:24.757170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:08:24.757170+0000","last_clean_scrub_stamp":"2024-09-14T11:08:24.757170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:32:34.612298+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.a","version":"267'322","reported_seq":1022,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:00.159114+0000","last_change":"2024-09-14T11:08:27.825865+0000","last_active":"2024-09-14T13:02:00.159114+0000","last_peered":"2024-09-14T13:02:00.159114+0000","last_clean":"2024-09-14T13:02:00.159114+0000","last_became_active":"2024-09-14T11:08:27.825133+0000","last_became_peered":"2024-09-14T11:08:27.825133+0000","last_unstale":"2024-09-14T13:02:00.159114+0000","last_undegraded":"2024-09-14T13:02:00.159114+0000","last_fullsized":"2024-09-14T13:02:00.159114+0000","mapping_epoch":30,"log_start":"267'300","ondisk_log_start":"267'300","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:08:26.771628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:08:26.771628+0000","last_clean_scrub_stamp":"2024-09-14T11:08:26.771628+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":300,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:21:39.269871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6555,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":452,"num_read_kb":512,"num_write":278,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":519,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:58:48.462360+0000","last_change":"2024-09-14T11:08:29.816572+0000","last_active":"2024-09-14T12:58:48.462360+0000","last_peered":"2024-09-14T12:58:48.462360+0000","last_clean":"2024-09-14T12:58:48.462360+0000","last_became_active":"2024-09-14T11:08:29.815620+0000","last_became_peered":"2024-09-14T11:08:29.815620+0000","last_unstale":"2024-09-14T12:58:48.462360+0000","last_undegraded":"2024-09-14T12:58:48.462360+0000","last_fullsized":"2024-09-14T12:58:48.462360+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:08:28.783586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:08:28.783586+0000","last_clean_scrub_stamp":"2024-09-14T11:08:28.783586+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:55:41.020963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.4","version":"267'569","reported_seq":1413,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:01:40.627106+0000","last_change":"2024-09-14T11:08:31.844680+0000","last_active":"2024-09-14T13:01:40.627106+0000","last_peered":"2024-09-14T13:01:40.627106+0000","last_clean":"2024-09-14T13:01:40.627106+0000","last_became_active":"2024-09-14T11:08:31.843834+0000","last_became_peered":"2024-09-14T11:08:31.843834+0000","last_unstale":"2024-09-14T13:01:40.627106+0000","last_undegraded":"2024-09-14T13:01:40.627106+0000","last_fullsized":"2024-09-14T13:01:40.627106+0000","mapping_epoch":34,"log_start":"267'500","ondisk_log_start":"267'500","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:08:30.789404+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:08:30.789404+0000","last_clean_scrub_stamp":"2024-09-14T11:08:30.789404+0000","objects_scrubbed":0,"log_size":69,"log_dups_size":500,"ondisk_log_size":69,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:11:32.026053+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1277,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":1293,"num_read_kb":1292,"num_write":1202,"num_write_kb":404,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.9","version":"267'1172","reported_seq":2712,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:11.831369+0000","last_change":"2024-09-14T13:02:11.831369+0000","last_active":"2024-09-14T13:02:11.831369+0000","last_peered":"2024-09-14T13:02:11.831369+0000","last_clean":"2024-09-14T13:02:11.831369+0000","last_became_active":"2024-09-14T11:08:23.778539+0000","last_became_peered":"2024-09-14T11:08:23.778539+0000","last_unstale":"2024-09-14T13:02:11.831369+0000","last_undegraded":"2024-09-14T13:02:11.831369+0000","last_fullsized":"2024-09-14T13:02:11.831369+0000","mapping_epoch":26,"log_start":"267'1100","ondisk_log_start":"267'1100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'1172","last_scrub_stamp":"2024-09-14T13:02:11.831174+0000","last_deep_scrub":"267'1172","last_deep_scrub_stamp":"2024-09-14T13:02:11.831174+0000","last_clean_scrub_stamp":"2024-09-14T13:02:11.831174+0000","objects_scrubbed":6,"log_size":72,"log_dups_size":1100,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:09:58.666148+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":5272,"num_read_kb":4639,"num_write":1605,"num_write_kb":663,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"267'241","reported_seq":894,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:10.656071+0000","last_change":"2024-09-14T13:02:10.656071+0000","last_active":"2024-09-14T13:02:10.656071+0000","last_peered":"2024-09-14T13:02:10.656071+0000","last_clean":"2024-09-14T13:02:10.656071+0000","last_became_active":"2024-09-14T11:08:21.836948+0000","last_became_peered":"2024-09-14T11:08:21.836948+0000","last_unstale":"2024-09-14T13:02:10.656071+0000","last_undegraded":"2024-09-14T13:02:10.656071+0000","last_fullsized":"2024-09-14T13:02:10.656071+0000","mapping_epoch":24,"log_start":"267'200","ondisk_log_start":"267'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'241","last_scrub_stamp":"2024-09-14T13:02:10.655851+0000","last_deep_scrub":"267'241","last_deep_scrub_stamp":"2024-09-14T13:02:10.655851+0000","last_clean_scrub_stamp":"2024-09-14T13:02:10.655851+0000","objects_scrubbed":3,"log_size":41,"log_dups_size":200,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T00:25:40.160047+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":550,"num_read_kb":30603,"num_write":1007,"num_write_kb":48772,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,1],"acting":[7,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.8","version":"267'5","reported_seq":1020,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:22.163504+0000","last_change":"2024-09-14T13:02:22.163504+0000","last_active":"2024-09-14T13:02:22.163504+0000","last_peered":"2024-09-14T13:02:22.163504+0000","last_clean":"2024-09-14T13:02:22.163504+0000","last_became_active":"2024-09-14T11:08:25.786631+0000","last_became_peered":"2024-09-14T11:08:25.786631+0000","last_unstale":"2024-09-14T13:02:22.163504+0000","last_undegraded":"2024-09-14T13:02:22.163504+0000","last_fullsized":"2024-09-14T13:02:22.163504+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'5","last_scrub_stamp":"2024-09-14T13:02:22.163310+0000","last_deep_scrub":"267'5","last_deep_scrub_stamp":"2024-09-14T13:02:22.163310+0000","last_clean_scrub_stamp":"2024-09-14T13:02:22.163310+0000","objects_scrubbed":1,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:36:41.907237+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1139,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":718,"num_read_kb":1182,"num_write":8,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.b","version":"267'177","reported_seq":799,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:00.345029+0000","last_change":"2024-09-14T11:08:27.822261+0000","last_active":"2024-09-14T13:02:00.345029+0000","last_peered":"2024-09-14T13:02:00.345029+0000","last_clean":"2024-09-14T13:02:00.345029+0000","last_became_active":"2024-09-14T11:08:27.821051+0000","last_became_peered":"2024-09-14T11:08:27.821051+0000","last_unstale":"2024-09-14T13:02:00.345029+0000","last_undegraded":"2024-09-14T13:02:00.345029+0000","last_fullsized":"2024-09-14T13:02:00.345029+0000","mapping_epoch":30,"log_start":"267'100","ondisk_log_start":"267'100","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:08:26.771628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:08:26.771628+0000","last_clean_scrub_stamp":"2024-09-14T11:08:26.771628+0000","objects_scrubbed":0,"log_size":77,"log_dups_size":100,"ondisk_log_size":77,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:27:12.003430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7629,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":234,"num_read_kb":320,"num_write":132,"num_write_kb":26,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":523,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:59:23.472522+0000","last_change":"2024-09-14T11:08:29.836035+0000","last_active":"2024-09-14T12:59:23.472522+0000","last_peered":"2024-09-14T12:59:23.472522+0000","last_clean":"2024-09-14T12:59:23.472522+0000","last_became_active":"2024-09-14T11:08:29.835446+0000","last_became_peered":"2024-09-14T11:08:29.835446+0000","last_unstale":"2024-09-14T12:59:23.472522+0000","last_undegraded":"2024-09-14T12:59:23.472522+0000","last_fullsized":"2024-09-14T12:59:23.472522+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:08:28.783586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:08:28.783586+0000","last_clean_scrub_stamp":"2024-09-14T11:08:28.783586+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:36:19.782325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.5","version":"267'2490","reported_seq":4358,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:01:27.935148+0000","last_change":"2024-09-14T11:08:31.849687+0000","last_active":"2024-09-14T13:01:27.935148+0000","last_peered":"2024-09-14T13:01:27.935148+0000","last_clean":"2024-09-14T13:01:27.935148+0000","last_became_active":"2024-09-14T11:08:31.848959+0000","last_became_peered":"2024-09-14T11:08:31.848959+0000","last_unstale":"2024-09-14T13:01:27.935148+0000","last_undegraded":"2024-09-14T13:01:27.935148+0000","last_fullsized":"2024-09-14T13:01:27.935148+0000","mapping_epoch":34,"log_start":"267'2400","ondisk_log_start":"267'2400","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:08:30.789404+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:08:30.789404+0000","last_clean_scrub_stamp":"2024-09-14T11:08:30.789404+0000","objects_scrubbed":0,"log_size":90,"log_dups_size":2400,"ondisk_log_size":90,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:50:52.716773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":423,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":6223,"num_read_kb":6216,"num_write":5015,"num_write_kb":1852,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.a","version":"267'868","reported_seq":2687,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:14.314869+0000","last_change":"2024-09-14T13:02:14.314869+0000","last_active":"2024-09-14T13:02:14.314869+0000","last_peered":"2024-09-14T13:02:14.314869+0000","last_clean":"2024-09-14T13:02:14.314869+0000","last_became_active":"2024-09-14T11:08:23.811255+0000","last_became_peered":"2024-09-14T11:08:23.811255+0000","last_unstale":"2024-09-14T13:02:14.314869+0000","last_undegraded":"2024-09-14T13:02:14.314869+0000","last_fullsized":"2024-09-14T13:02:14.314869+0000","mapping_epoch":26,"log_start":"267'800","ondisk_log_start":"267'800","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'868","last_scrub_stamp":"2024-09-14T13:02:14.314591+0000","last_deep_scrub":"267'868","last_deep_scrub_stamp":"2024-09-14T13:02:14.314591+0000","last_clean_scrub_stamp":"2024-09-14T13:02:14.314591+0000","objects_scrubbed":2,"log_size":68,"log_dups_size":800,"ondisk_log_size":68,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:09:26.042491+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":4399,"num_read_kb":3998,"num_write":1156,"num_write_kb":415,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"267'213","reported_seq":893,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:12.651148+0000","last_change":"2024-09-14T13:02:12.651148+0000","last_active":"2024-09-14T13:02:12.651148+0000","last_peered":"2024-09-14T13:02:12.651148+0000","last_clean":"2024-09-14T13:02:12.651148+0000","last_became_active":"2024-09-14T11:08:21.804566+0000","last_became_peered":"2024-09-14T11:08:21.804566+0000","last_unstale":"2024-09-14T13:02:12.651148+0000","last_undegraded":"2024-09-14T13:02:12.651148+0000","last_fullsized":"2024-09-14T13:02:12.651148+0000","mapping_epoch":24,"log_start":"267'200","ondisk_log_start":"267'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'213","last_scrub_stamp":"2024-09-14T13:02:12.650904+0000","last_deep_scrub":"267'213","last_deep_scrub_stamp":"2024-09-14T13:02:12.650904+0000","last_clean_scrub_stamp":"2024-09-14T13:02:12.650904+0000","objects_scrubbed":6,"log_size":13,"log_dups_size":200,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:40:39.876331+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3311695,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":558,"num_read_kb":39823,"num_write":955,"num_write_kb":36124,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,3],"acting":[7,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":533,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:58:42.823897+0000","last_change":"2024-09-14T11:08:25.789785+0000","last_active":"2024-09-14T12:58:42.823897+0000","last_peered":"2024-09-14T12:58:42.823897+0000","last_clean":"2024-09-14T12:58:42.823897+0000","last_became_active":"2024-09-14T11:08:25.789075+0000","last_became_peered":"2024-09-14T11:08:25.789075+0000","last_unstale":"2024-09-14T12:58:42.823897+0000","last_undegraded":"2024-09-14T12:58:42.823897+0000","last_fullsized":"2024-09-14T12:58:42.823897+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:08:24.757170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:08:24.757170+0000","last_clean_scrub_stamp":"2024-09-14T11:08:24.757170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:02:16.864399+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.8","version":"267'233","reported_seq":894,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:00.183952+0000","last_change":"2024-09-14T11:08:27.831643+0000","last_active":"2024-09-14T13:02:00.183952+0000","last_peered":"2024-09-14T13:02:00.183952+0000","last_clean":"2024-09-14T13:02:00.183952+0000","last_became_active":"2024-09-14T11:08:27.830862+0000","last_became_peered":"2024-09-14T11:08:27.830862+0000","last_unstale":"2024-09-14T13:02:00.183952+0000","last_undegraded":"2024-09-14T13:02:00.183952+0000","last_fullsized":"2024-09-14T13:02:00.183952+0000","mapping_epoch":30,"log_start":"267'200","ondisk_log_start":"267'200","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:08:26.771628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:08:26.771628+0000","last_clean_scrub_stamp":"2024-09-14T11:08:26.771628+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":200,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:28:29.317319+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4096,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":320,"num_read_kb":327,"num_write":186,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.9","version":"267'785","reported_seq":3473,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:01:59.875618+0000","last_change":"2024-09-14T11:08:29.822652+0000","last_active":"2024-09-14T13:01:59.875618+0000","last_peered":"2024-09-14T13:01:59.875618+0000","last_clean":"2024-09-14T13:01:59.875618+0000","last_became_active":"2024-09-14T11:08:29.821920+0000","last_became_peered":"2024-09-14T11:08:29.821920+0000","last_unstale":"2024-09-14T13:01:59.875618+0000","last_undegraded":"2024-09-14T13:01:59.875618+0000","last_fullsized":"2024-09-14T13:01:59.875618+0000","mapping_epoch":32,"log_start":"267'700","ondisk_log_start":"267'700","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:08:28.783586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:08:28.783586+0000","last_clean_scrub_stamp":"2024-09-14T11:08:28.783586+0000","objects_scrubbed":0,"log_size":85,"log_dups_size":700,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:48:48.100097+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.6","version":"267'126","reported_seq":663,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:01:39.376250+0000","last_change":"2024-09-14T11:08:31.848848+0000","last_active":"2024-09-14T13:01:39.376250+0000","last_peered":"2024-09-14T13:01:39.376250+0000","last_clean":"2024-09-14T13:01:39.376250+0000","last_became_active":"2024-09-14T11:08:31.846373+0000","last_became_peered":"2024-09-14T11:08:31.846373+0000","last_unstale":"2024-09-14T13:01:39.376250+0000","last_undegraded":"2024-09-14T13:01:39.376250+0000","last_fullsized":"2024-09-14T13:01:39.376250+0000","mapping_epoch":34,"log_start":"267'100","ondisk_log_start":"267'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:08:30.789404+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:08:30.789404+0000","last_clean_scrub_stamp":"2024-09-14T11:08:30.789404+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":100,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:47:54.026151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":575,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":123,"num_write":296,"num_write_kb":71,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"267'1041","reported_seq":2685,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:19.068533+0000","last_change":"2024-09-14T13:02:19.068533+0000","last_active":"2024-09-14T13:02:19.068533+0000","last_peered":"2024-09-14T13:02:19.068533+0000","last_clean":"2024-09-14T13:02:19.068533+0000","last_became_active":"2024-09-14T11:08:23.777032+0000","last_became_peered":"2024-09-14T11:08:23.777032+0000","last_unstale":"2024-09-14T13:02:19.068533+0000","last_undegraded":"2024-09-14T13:02:19.068533+0000","last_fullsized":"2024-09-14T13:02:19.068533+0000","mapping_epoch":26,"log_start":"267'1000","ondisk_log_start":"267'1000","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'1041","last_scrub_stamp":"2024-09-14T13:02:19.068315+0000","last_deep_scrub":"267'1041","last_deep_scrub_stamp":"2024-09-14T13:02:19.068315+0000","last_clean_scrub_stamp":"2024-09-14T13:02:19.068315+0000","objects_scrubbed":1,"log_size":41,"log_dups_size":1000,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T00:09:24.080847+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":7372,"num_read_kb":6755,"num_write":1704,"num_write_kb":754,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.c","version":"267'187","reported_seq":835,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:10.302676+0000","last_change":"2024-09-14T13:02:10.302676+0000","last_active":"2024-09-14T13:02:10.302676+0000","last_peered":"2024-09-14T13:02:10.302676+0000","last_clean":"2024-09-14T13:02:10.302676+0000","last_became_active":"2024-09-14T11:08:21.828010+0000","last_became_peered":"2024-09-14T11:08:21.828010+0000","last_unstale":"2024-09-14T13:02:10.302676+0000","last_undegraded":"2024-09-14T13:02:10.302676+0000","last_fullsized":"2024-09-14T13:02:10.302676+0000","mapping_epoch":24,"log_start":"267'100","ondisk_log_start":"267'100","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'187","last_scrub_stamp":"2024-09-14T13:02:10.302469+0000","last_deep_scrub":"267'187","last_deep_scrub_stamp":"2024-09-14T13:02:10.302469+0000","last_clean_scrub_stamp":"2024-09-14T13:02:10.302469+0000","objects_scrubbed":2,"log_size":87,"log_dups_size":100,"ondisk_log_size":87,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T00:03:54.075323+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":29,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":466,"num_read_kb":18086,"num_write":819,"num_write_kb":39275,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,6],"acting":[5,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":543,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:21.173257+0000","last_change":"2024-09-14T13:02:21.173257+0000","last_active":"2024-09-14T13:02:21.173257+0000","last_peered":"2024-09-14T13:02:21.173257+0000","last_clean":"2024-09-14T13:02:21.173257+0000","last_became_active":"2024-09-14T11:08:25.805415+0000","last_became_peered":"2024-09-14T11:08:25.805415+0000","last_unstale":"2024-09-14T13:02:21.173257+0000","last_undegraded":"2024-09-14T13:02:21.173257+0000","last_fullsized":"2024-09-14T13:02:21.173257+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T13:02:21.173074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T13:02:21.173074+0000","last_clean_scrub_stamp":"2024-09-14T13:02:21.173074+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:57:11.797331+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"267'248","reported_seq":938,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:00.375155+0000","last_change":"2024-09-14T11:08:27.812358+0000","last_active":"2024-09-14T13:02:00.375155+0000","last_peered":"2024-09-14T13:02:00.375155+0000","last_clean":"2024-09-14T13:02:00.375155+0000","last_became_active":"2024-09-14T11:08:27.811687+0000","last_became_peered":"2024-09-14T11:08:27.811687+0000","last_unstale":"2024-09-14T13:02:00.375155+0000","last_undegraded":"2024-09-14T13:02:00.375155+0000","last_fullsized":"2024-09-14T13:02:00.375155+0000","mapping_epoch":30,"log_start":"267'200","ondisk_log_start":"267'200","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:08:26.771628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:08:26.771628+0000","last_clean_scrub_stamp":"2024-09-14T11:08:26.771628+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":200,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:53:33.661450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":25927,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":349,"num_read_kb":508,"num_write":186,"num_write_kb":50,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":527,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:59:02.829095+0000","last_change":"2024-09-14T11:08:29.822875+0000","last_active":"2024-09-14T12:59:02.829095+0000","last_peered":"2024-09-14T12:59:02.829095+0000","last_clean":"2024-09-14T12:59:02.829095+0000","last_became_active":"2024-09-14T11:08:29.821747+0000","last_became_peered":"2024-09-14T11:08:29.821747+0000","last_unstale":"2024-09-14T12:59:02.829095+0000","last_undegraded":"2024-09-14T12:59:02.829095+0000","last_fullsized":"2024-09-14T12:59:02.829095+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:08:28.783586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:08:28.783586+0000","last_clean_scrub_stamp":"2024-09-14T11:08:28.783586+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:24:23.302821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.7","version":"267'148","reported_seq":694,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:00:15.969897+0000","last_change":"2024-09-14T11:08:31.839098+0000","last_active":"2024-09-14T13:00:15.969897+0000","last_peered":"2024-09-14T13:00:15.969897+0000","last_clean":"2024-09-14T13:00:15.969897+0000","last_became_active":"2024-09-14T11:08:31.838392+0000","last_became_peered":"2024-09-14T11:08:31.838392+0000","last_unstale":"2024-09-14T13:00:15.969897+0000","last_undegraded":"2024-09-14T13:00:15.969897+0000","last_fullsized":"2024-09-14T13:00:15.969897+0000","mapping_epoch":34,"log_start":"267'100","ondisk_log_start":"267'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:08:30.789404+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:08:30.789404+0000","last_clean_scrub_stamp":"2024-09-14T11:08:30.789404+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":100,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:19:04.951364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":722,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":177,"num_read_kb":165,"num_write":335,"num_write_kb":82,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"267'557","reported_seq":2167,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:12.782223+0000","last_change":"2024-09-14T13:02:12.782223+0000","last_active":"2024-09-14T13:02:12.782223+0000","last_peered":"2024-09-14T13:02:12.782223+0000","last_clean":"2024-09-14T13:02:12.782223+0000","last_became_active":"2024-09-14T11:08:23.788219+0000","last_became_peered":"2024-09-14T11:08:23.788219+0000","last_unstale":"2024-09-14T13:02:12.782223+0000","last_undegraded":"2024-09-14T13:02:12.782223+0000","last_fullsized":"2024-09-14T13:02:12.782223+0000","mapping_epoch":26,"log_start":"267'500","ondisk_log_start":"267'500","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'557","last_scrub_stamp":"2024-09-14T13:02:12.781939+0000","last_deep_scrub":"267'557","last_deep_scrub_stamp":"2024-09-14T13:02:12.781939+0000","last_clean_scrub_stamp":"2024-09-14T13:02:12.781939+0000","objects_scrubbed":0,"log_size":57,"log_dups_size":500,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:01:16.526677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2903,"num_read_kb":2651,"num_write":738,"num_write_kb":289,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"267'322","reported_seq":1077,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:07.945838+0000","last_change":"2024-09-14T13:02:07.945838+0000","last_active":"2024-09-14T13:02:07.945838+0000","last_peered":"2024-09-14T13:02:07.945838+0000","last_clean":"2024-09-14T13:02:07.945838+0000","last_became_active":"2024-09-14T11:08:21.827553+0000","last_became_peered":"2024-09-14T11:08:21.827553+0000","last_unstale":"2024-09-14T13:02:07.945838+0000","last_undegraded":"2024-09-14T13:02:07.945838+0000","last_fullsized":"2024-09-14T13:02:07.945838+0000","mapping_epoch":24,"log_start":"267'300","ondisk_log_start":"267'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'322","last_scrub_stamp":"2024-09-14T13:02:07.945633+0000","last_deep_scrub":"267'322","last_deep_scrub_stamp":"2024-09-14T13:02:07.945633+0000","last_clean_scrub_stamp":"2024-09-14T13:02:07.945633+0000","objects_scrubbed":2,"log_size":22,"log_dups_size":300,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:22:36.317068+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1003,"num_read_kb":39840,"num_write":1278,"num_write_kb":27597,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,4],"acting":[3,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":533,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:58:42.823983+0000","last_change":"2024-09-14T11:08:25.799438+0000","last_active":"2024-09-14T12:58:42.823983+0000","last_peered":"2024-09-14T12:58:42.823983+0000","last_clean":"2024-09-14T12:58:42.823983+0000","last_became_active":"2024-09-14T11:08:25.798931+0000","last_became_peered":"2024-09-14T11:08:25.798931+0000","last_unstale":"2024-09-14T12:58:42.823983+0000","last_undegraded":"2024-09-14T12:58:42.823983+0000","last_fullsized":"2024-09-14T12:58:42.823983+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:08:24.757170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:08:24.757170+0000","last_clean_scrub_stamp":"2024-09-14T11:08:24.757170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:52:24.718713+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.e","version":"267'204","reported_seq":840,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:00.387859+0000","last_change":"2024-09-14T11:08:27.818990+0000","last_active":"2024-09-14T13:02:00.387859+0000","last_peered":"2024-09-14T13:02:00.387859+0000","last_clean":"2024-09-14T13:02:00.387859+0000","last_became_active":"2024-09-14T11:08:27.818219+0000","last_became_peered":"2024-09-14T11:08:27.818219+0000","last_unstale":"2024-09-14T13:02:00.387859+0000","last_undegraded":"2024-09-14T13:02:00.387859+0000","last_fullsized":"2024-09-14T13:02:00.387859+0000","mapping_epoch":30,"log_start":"264'100","ondisk_log_start":"264'100","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:08:26.771628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:08:26.771628+0000","last_clean_scrub_stamp":"2024-09-14T11:08:26.771628+0000","objects_scrubbed":0,"log_size":104,"log_dups_size":100,"ondisk_log_size":104,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:11:59.445867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6420,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":294,"num_read_kb":320,"num_write":220,"num_write_kb":86,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":526,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:59:13.248309+0000","last_change":"2024-09-14T11:08:29.824808+0000","last_active":"2024-09-14T12:59:13.248309+0000","last_peered":"2024-09-14T12:59:13.248309+0000","last_clean":"2024-09-14T12:59:13.248309+0000","last_became_active":"2024-09-14T11:08:29.824057+0000","last_became_peered":"2024-09-14T11:08:29.824057+0000","last_unstale":"2024-09-14T12:59:13.248309+0000","last_undegraded":"2024-09-14T12:59:13.248309+0000","last_fullsized":"2024-09-14T12:59:13.248309+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:08:28.783586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:08:28.783586+0000","last_clean_scrub_stamp":"2024-09-14T11:08:28.783586+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:42:11.422635+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.0","version":"267'127","reported_seq":651,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:00:53.493597+0000","last_change":"2024-09-14T11:08:31.845590+0000","last_active":"2024-09-14T13:00:53.493597+0000","last_peered":"2024-09-14T13:00:53.493597+0000","last_clean":"2024-09-14T13:00:53.493597+0000","last_became_active":"2024-09-14T11:08:31.844832+0000","last_became_peered":"2024-09-14T11:08:31.844832+0000","last_unstale":"2024-09-14T13:00:53.493597+0000","last_undegraded":"2024-09-14T13:00:53.493597+0000","last_fullsized":"2024-09-14T13:00:53.493597+0000","mapping_epoch":34,"log_start":"267'100","ondisk_log_start":"267'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:08:30.789404+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:08:30.789404+0000","last_clean_scrub_stamp":"2024-09-14T11:08:30.789404+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":100,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:04:19.552267+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":910,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":99,"num_read_kb":98,"num_write":310,"num_write_kb":70,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"267'808","reported_seq":2448,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:13.800136+0000","last_change":"2024-09-14T13:02:13.800136+0000","last_active":"2024-09-14T13:02:13.800136+0000","last_peered":"2024-09-14T13:02:13.800136+0000","last_clean":"2024-09-14T13:02:13.800136+0000","last_became_active":"2024-09-14T11:08:23.791966+0000","last_became_peered":"2024-09-14T11:08:23.791966+0000","last_unstale":"2024-09-14T13:02:13.800136+0000","last_undegraded":"2024-09-14T13:02:13.800136+0000","last_fullsized":"2024-09-14T13:02:13.800136+0000","mapping_epoch":26,"log_start":"267'700","ondisk_log_start":"267'700","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'808","last_scrub_stamp":"2024-09-14T13:02:13.799940+0000","last_deep_scrub":"267'808","last_deep_scrub_stamp":"2024-09-14T13:02:13.799940+0000","last_clean_scrub_stamp":"2024-09-14T13:02:13.799940+0000","objects_scrubbed":1,"log_size":108,"log_dups_size":700,"ondisk_log_size":108,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:03:49.959088+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3905,"num_read_kb":3535,"num_write":1083,"num_write_kb":396,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"267'233","reported_seq":916,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:10.262031+0000","last_change":"2024-09-14T13:02:10.262031+0000","last_active":"2024-09-14T13:02:10.262031+0000","last_peered":"2024-09-14T13:02:10.262031+0000","last_clean":"2024-09-14T13:02:10.262031+0000","last_became_active":"2024-09-14T11:08:21.836346+0000","last_became_peered":"2024-09-14T11:08:21.836346+0000","last_unstale":"2024-09-14T13:02:10.262031+0000","last_undegraded":"2024-09-14T13:02:10.262031+0000","last_fullsized":"2024-09-14T13:02:10.262031+0000","mapping_epoch":24,"log_start":"267'200","ondisk_log_start":"267'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'233","last_scrub_stamp":"2024-09-14T13:02:10.261790+0000","last_deep_scrub":"267'233","last_deep_scrub_stamp":"2024-09-14T13:02:10.261790+0000","last_clean_scrub_stamp":"2024-09-14T13:02:10.261790+0000","objects_scrubbed":3,"log_size":33,"log_dups_size":200,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:01:19.068873+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2055072,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":607,"num_read_kb":23439,"num_write":1082,"num_write_kb":33198,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,1],"acting":[6,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":535,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:20.025587+0000","last_change":"2024-09-14T13:02:20.025587+0000","last_active":"2024-09-14T13:02:20.025587+0000","last_peered":"2024-09-14T13:02:20.025587+0000","last_clean":"2024-09-14T13:02:20.025587+0000","last_became_active":"2024-09-14T11:08:25.806502+0000","last_became_peered":"2024-09-14T11:08:25.806502+0000","last_unstale":"2024-09-14T13:02:20.025587+0000","last_undegraded":"2024-09-14T13:02:20.025587+0000","last_fullsized":"2024-09-14T13:02:20.025587+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T13:02:20.025419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T13:02:20.025419+0000","last_clean_scrub_stamp":"2024-09-14T13:02:20.025419+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:06:23.521008+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.f","version":"267'240","reported_seq":902,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:00.312298+0000","last_change":"2024-09-14T11:08:27.819376+0000","last_active":"2024-09-14T13:02:00.312298+0000","last_peered":"2024-09-14T13:02:00.312298+0000","last_clean":"2024-09-14T13:02:00.312298+0000","last_became_active":"2024-09-14T11:08:27.817904+0000","last_became_peered":"2024-09-14T11:08:27.817904+0000","last_unstale":"2024-09-14T13:02:00.312298+0000","last_undegraded":"2024-09-14T13:02:00.312298+0000","last_fullsized":"2024-09-14T13:02:00.312298+0000","mapping_epoch":30,"log_start":"267'200","ondisk_log_start":"267'200","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:08:26.771628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:08:26.771628+0000","last_clean_scrub_stamp":"2024-09-14T11:08:26.771628+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":200,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:38:45.116571+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8985,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":331,"num_read_kb":393,"num_write":194,"num_write_kb":21,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.e","version":"267'763","reported_seq":3235,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:01:59.863086+0000","last_change":"2024-09-14T11:08:29.818281+0000","last_active":"2024-09-14T13:01:59.863086+0000","last_peered":"2024-09-14T13:01:59.863086+0000","last_clean":"2024-09-14T13:01:59.863086+0000","last_became_active":"2024-09-14T11:08:29.817475+0000","last_became_peered":"2024-09-14T11:08:29.817475+0000","last_unstale":"2024-09-14T13:01:59.863086+0000","last_undegraded":"2024-09-14T13:01:59.863086+0000","last_fullsized":"2024-09-14T13:01:59.863086+0000","mapping_epoch":32,"log_start":"267'700","ondisk_log_start":"267'700","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:08:28.783586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:08:28.783586+0000","last_clean_scrub_stamp":"2024-09-14T11:08:28.783586+0000","objects_scrubbed":0,"log_size":63,"log_dups_size":700,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:02:09.839019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1","version":"267'130","reported_seq":668,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:00:15.977882+0000","last_change":"2024-09-14T11:08:31.848332+0000","last_active":"2024-09-14T13:00:15.977882+0000","last_peered":"2024-09-14T13:00:15.977882+0000","last_clean":"2024-09-14T13:00:15.977882+0000","last_became_active":"2024-09-14T11:08:31.847603+0000","last_became_peered":"2024-09-14T11:08:31.847603+0000","last_unstale":"2024-09-14T13:00:15.977882+0000","last_undegraded":"2024-09-14T13:00:15.977882+0000","last_fullsized":"2024-09-14T13:00:15.977882+0000","mapping_epoch":34,"log_start":"267'100","ondisk_log_start":"267'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:08:30.789404+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:08:30.789404+0000","last_clean_scrub_stamp":"2024-09-14T11:08:30.789404+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":100,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:48:10.041330+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1261,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":168,"num_read_kb":154,"num_write":334,"num_write_kb":78,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"267'386","reported_seq":1940,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:14.788852+0000","last_change":"2024-09-14T13:02:14.788852+0000","last_active":"2024-09-14T13:02:14.788852+0000","last_peered":"2024-09-14T13:02:14.788852+0000","last_clean":"2024-09-14T13:02:14.788852+0000","last_became_active":"2024-09-14T11:08:23.814578+0000","last_became_peered":"2024-09-14T11:08:23.814578+0000","last_unstale":"2024-09-14T13:02:14.788852+0000","last_undegraded":"2024-09-14T13:02:14.788852+0000","last_fullsized":"2024-09-14T13:02:14.788852+0000","mapping_epoch":26,"log_start":"267'300","ondisk_log_start":"267'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'386","last_scrub_stamp":"2024-09-14T13:02:14.788668+0000","last_deep_scrub":"267'386","last_deep_scrub_stamp":"2024-09-14T13:02:14.788668+0000","last_clean_scrub_stamp":"2024-09-14T13:02:14.788668+0000","objects_scrubbed":1,"log_size":86,"log_dups_size":300,"ondisk_log_size":86,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:27:33.280225+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2178,"num_read_kb":2072,"num_write":449,"num_write_kb":92,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.9","version":"267'206","reported_seq":870,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:07.861868+0000","last_change":"2024-09-14T13:02:07.861868+0000","last_active":"2024-09-14T13:02:07.861868+0000","last_peered":"2024-09-14T13:02:07.861868+0000","last_clean":"2024-09-14T13:02:07.861868+0000","last_became_active":"2024-09-14T11:08:21.824109+0000","last_became_peered":"2024-09-14T11:08:21.824109+0000","last_unstale":"2024-09-14T13:02:07.861868+0000","last_undegraded":"2024-09-14T13:02:07.861868+0000","last_fullsized":"2024-09-14T13:02:07.861868+0000","mapping_epoch":24,"log_start":"267'100","ondisk_log_start":"267'100","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'206","last_scrub_stamp":"2024-09-14T13:02:07.861610+0000","last_deep_scrub":"267'206","last_deep_scrub_stamp":"2024-09-14T13:02:07.861610+0000","last_clean_scrub_stamp":"2024-09-14T13:02:07.861610+0000","objects_scrubbed":3,"log_size":106,"log_dups_size":100,"ondisk_log_size":106,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:54:21.419194+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1655851,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":552,"num_read_kb":13686,"num_write":959,"num_write_kb":41004,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,7],"acting":[4,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.f","version":"29'2","reported_seq":1477,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:01:59.403010+0000","last_change":"2024-09-14T11:08:25.815830+0000","last_active":"2024-09-14T13:01:59.403010+0000","last_peered":"2024-09-14T13:01:59.403010+0000","last_clean":"2024-09-14T13:01:59.403010+0000","last_became_active":"2024-09-14T11:08:25.815109+0000","last_became_peered":"2024-09-14T11:08:25.815109+0000","last_unstale":"2024-09-14T13:01:59.403010+0000","last_undegraded":"2024-09-14T13:01:59.403010+0000","last_fullsized":"2024-09-14T13:01:59.403010+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:08:24.757170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:08:24.757170+0000","last_clean_scrub_stamp":"2024-09-14T11:08:24.757170+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:31:30.285811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":946,"num_read_kb":946,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.c","version":"267'152","reported_seq":738,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:59:07.715136+0000","last_change":"2024-09-14T11:08:27.799995+0000","last_active":"2024-09-14T12:59:07.715136+0000","last_peered":"2024-09-14T12:59:07.715136+0000","last_clean":"2024-09-14T12:59:07.715136+0000","last_became_active":"2024-09-14T11:08:27.799244+0000","last_became_peered":"2024-09-14T11:08:27.799244+0000","last_unstale":"2024-09-14T12:59:07.715136+0000","last_undegraded":"2024-09-14T12:59:07.715136+0000","last_fullsized":"2024-09-14T12:59:07.715136+0000","mapping_epoch":30,"log_start":"267'100","ondisk_log_start":"267'100","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:08:26.771628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:08:26.771628+0000","last_clean_scrub_stamp":"2024-09-14T11:08:26.771628+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":100,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:30:47.475696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":184,"num_read_kb":178,"num_write":124,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.d","version":"267'769","reported_seq":3164,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:01:59.865013+0000","last_change":"2024-09-14T11:08:29.829055+0000","last_active":"2024-09-14T13:01:59.865013+0000","last_peered":"2024-09-14T13:01:59.865013+0000","last_clean":"2024-09-14T13:01:59.865013+0000","last_became_active":"2024-09-14T11:08:29.828249+0000","last_became_peered":"2024-09-14T11:08:29.828249+0000","last_unstale":"2024-09-14T13:01:59.865013+0000","last_undegraded":"2024-09-14T13:01:59.865013+0000","last_fullsized":"2024-09-14T13:01:59.865013+0000","mapping_epoch":32,"log_start":"267'701","ondisk_log_start":"267'701","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:08:28.783586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:08:28.783586+0000","last_clean_scrub_stamp":"2024-09-14T11:08:28.783586+0000","objects_scrubbed":0,"log_size":68,"log_dups_size":701,"ondisk_log_size":68,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:02:41.662311+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.2","version":"267'160","reported_seq":694,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:58:58.232642+0000","last_change":"2024-09-14T11:08:31.850208+0000","last_active":"2024-09-14T12:58:58.232642+0000","last_peered":"2024-09-14T12:58:58.232642+0000","last_clean":"2024-09-14T12:58:58.232642+0000","last_became_active":"2024-09-14T11:08:31.849463+0000","last_became_peered":"2024-09-14T11:08:31.849463+0000","last_unstale":"2024-09-14T12:58:58.232642+0000","last_undegraded":"2024-09-14T12:58:58.232642+0000","last_fullsized":"2024-09-14T12:58:58.232642+0000","mapping_epoch":34,"log_start":"267'100","ondisk_log_start":"267'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:08:30.789404+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:08:30.789404+0000","last_clean_scrub_stamp":"2024-09-14T11:08:30.789404+0000","objects_scrubbed":0,"log_size":60,"log_dups_size":100,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:42:03.964124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":154,"num_read_kb":144,"num_write":375,"num_write_kb":85,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"267'386","reported_seq":1884,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:16.080785+0000","last_change":"2024-09-14T13:02:16.080785+0000","last_active":"2024-09-14T13:02:16.080785+0000","last_peered":"2024-09-14T13:02:16.080785+0000","last_clean":"2024-09-14T13:02:16.080785+0000","last_became_active":"2024-09-14T11:08:23.783481+0000","last_became_peered":"2024-09-14T11:08:23.783481+0000","last_unstale":"2024-09-14T13:02:16.080785+0000","last_undegraded":"2024-09-14T13:02:16.080785+0000","last_fullsized":"2024-09-14T13:02:16.080785+0000","mapping_epoch":26,"log_start":"267'300","ondisk_log_start":"267'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'386","last_scrub_stamp":"2024-09-14T13:02:16.080562+0000","last_deep_scrub":"267'386","last_deep_scrub_stamp":"2024-09-14T13:02:16.080562+0000","last_clean_scrub_stamp":"2024-09-14T13:02:16.080562+0000","objects_scrubbed":4,"log_size":86,"log_dups_size":300,"ondisk_log_size":86,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:15:42.229866+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":2050,"num_read_kb":1948,"num_write":423,"num_write_kb":74,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"267'177","reported_seq":838,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:09.948319+0000","last_change":"2024-09-14T13:02:09.948319+0000","last_active":"2024-09-14T13:02:09.948319+0000","last_peered":"2024-09-14T13:02:09.948319+0000","last_clean":"2024-09-14T13:02:09.948319+0000","last_became_active":"2024-09-14T11:08:21.786611+0000","last_became_peered":"2024-09-14T11:08:21.786611+0000","last_unstale":"2024-09-14T13:02:09.948319+0000","last_undegraded":"2024-09-14T13:02:09.948319+0000","last_fullsized":"2024-09-14T13:02:09.948319+0000","mapping_epoch":24,"log_start":"267'100","ondisk_log_start":"267'100","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'177","last_scrub_stamp":"2024-09-14T13:02:09.948060+0000","last_deep_scrub":"267'177","last_deep_scrub_stamp":"2024-09-14T13:02:09.948060+0000","last_clean_scrub_stamp":"2024-09-14T13:02:09.948060+0000","objects_scrubbed":4,"log_size":77,"log_dups_size":100,"ondisk_log_size":77,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:07:24.070925+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1655868,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":450,"num_read_kb":66993,"num_write":850,"num_write_kb":21210,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7],"acting":[3,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":531,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:58:43.229298+0000","last_change":"2024-09-14T11:08:25.818495+0000","last_active":"2024-09-14T12:58:43.229298+0000","last_peered":"2024-09-14T12:58:43.229298+0000","last_clean":"2024-09-14T12:58:43.229298+0000","last_became_active":"2024-09-14T11:08:25.817491+0000","last_became_peered":"2024-09-14T11:08:25.817491+0000","last_unstale":"2024-09-14T12:58:43.229298+0000","last_undegraded":"2024-09-14T12:58:43.229298+0000","last_fullsized":"2024-09-14T12:58:43.229298+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:08:24.757170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:08:24.757170+0000","last_clean_scrub_stamp":"2024-09-14T11:08:24.757170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:04:21.111837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.d","version":"267'295","reported_seq":981,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:00.116891+0000","last_change":"2024-09-14T11:08:27.829834+0000","last_active":"2024-09-14T13:02:00.116891+0000","last_peered":"2024-09-14T13:02:00.116891+0000","last_clean":"2024-09-14T13:02:00.116891+0000","last_became_active":"2024-09-14T11:08:27.829060+0000","last_became_peered":"2024-09-14T11:08:27.829060+0000","last_unstale":"2024-09-14T13:02:00.116891+0000","last_undegraded":"2024-09-14T13:02:00.116891+0000","last_fullsized":"2024-09-14T13:02:00.116891+0000","mapping_epoch":30,"log_start":"267'200","ondisk_log_start":"267'200","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:08:26.771628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:08:26.771628+0000","last_clean_scrub_stamp":"2024-09-14T11:08:26.771628+0000","objects_scrubbed":0,"log_size":95,"log_dups_size":200,"ondisk_log_size":95,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:11:07.685536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5925,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":413,"num_read_kb":450,"num_write":250,"num_write_kb":21,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":520,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:58:48.427540+0000","last_change":"2024-09-14T11:08:29.845124+0000","last_active":"2024-09-14T12:58:48.427540+0000","last_peered":"2024-09-14T12:58:48.427540+0000","last_clean":"2024-09-14T12:58:48.427540+0000","last_became_active":"2024-09-14T11:08:29.844374+0000","last_became_peered":"2024-09-14T11:08:29.844374+0000","last_unstale":"2024-09-14T12:58:48.427540+0000","last_undegraded":"2024-09-14T12:58:48.427540+0000","last_fullsized":"2024-09-14T12:58:48.427540+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:08:28.783586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:08:28.783586+0000","last_clean_scrub_stamp":"2024-09-14T11:08:28.783586+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:58:42.113010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.3","version":"267'105","reported_seq":628,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:00:21.230827+0000","last_change":"2024-09-14T11:08:31.836429+0000","last_active":"2024-09-14T13:00:21.230827+0000","last_peered":"2024-09-14T13:00:21.230827+0000","last_clean":"2024-09-14T13:00:21.230827+0000","last_became_active":"2024-09-14T11:08:31.835753+0000","last_became_peered":"2024-09-14T11:08:31.835753+0000","last_unstale":"2024-09-14T13:00:21.230827+0000","last_undegraded":"2024-09-14T13:00:21.230827+0000","last_fullsized":"2024-09-14T13:00:21.230827+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:08:30.789404+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:08:30.789404+0000","last_clean_scrub_stamp":"2024-09-14T11:08:30.789404+0000","objects_scrubbed":0,"log_size":105,"log_dups_size":0,"ondisk_log_size":105,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:10:45.802301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":24,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":102,"num_read_kb":102,"num_write":245,"num_write_kb":60,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"267'868","reported_seq":2554,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:16.363215+0000","last_change":"2024-09-14T13:02:16.363215+0000","last_active":"2024-09-14T13:02:16.363215+0000","last_peered":"2024-09-14T13:02:16.363215+0000","last_clean":"2024-09-14T13:02:16.363215+0000","last_became_active":"2024-09-14T11:08:23.806515+0000","last_became_peered":"2024-09-14T11:08:23.806515+0000","last_unstale":"2024-09-14T13:02:16.363215+0000","last_undegraded":"2024-09-14T13:02:16.363215+0000","last_fullsized":"2024-09-14T13:02:16.363215+0000","mapping_epoch":26,"log_start":"267'800","ondisk_log_start":"267'800","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'868","last_scrub_stamp":"2024-09-14T13:02:16.363033+0000","last_deep_scrub":"267'868","last_deep_scrub_stamp":"2024-09-14T13:02:16.363033+0000","last_clean_scrub_stamp":"2024-09-14T13:02:16.363033+0000","objects_scrubbed":3,"log_size":68,"log_dups_size":800,"ondisk_log_size":68,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:24:22.719515+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":4146,"num_read_kb":3734,"num_write":1154,"num_write_kb":420,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"267'74","reported_seq":664,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:18.631868+0000","last_change":"2024-09-14T13:02:18.631868+0000","last_active":"2024-09-14T13:02:18.631868+0000","last_peered":"2024-09-14T13:02:18.631868+0000","last_clean":"2024-09-14T13:02:18.631868+0000","last_became_active":"2024-09-14T11:08:03.877126+0000","last_became_peered":"2024-09-14T11:08:03.877126+0000","last_unstale":"2024-09-14T13:02:18.631868+0000","last_undegraded":"2024-09-14T13:02:18.631868+0000","last_fullsized":"2024-09-14T13:02:18.631868+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'74","last_scrub_stamp":"2024-09-14T13:02:18.631647+0000","last_deep_scrub":"267'74","last_deep_scrub_stamp":"2024-09-14T13:02:18.631647+0000","last_clean_scrub_stamp":"2024-09-14T13:02:18.631647+0000","objects_scrubbed":2,"log_size":74,"log_dups_size":0,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:28:42.174349+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"267'2","reported_seq":570,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:14.376805+0000","last_change":"2024-09-14T13:02:14.376805+0000","last_active":"2024-09-14T13:02:14.376805+0000","last_peered":"2024-09-14T13:02:14.376805+0000","last_clean":"2024-09-14T13:02:14.376805+0000","last_became_active":"2024-09-14T11:08:08.902043+0000","last_became_peered":"2024-09-14T11:08:08.902043+0000","last_unstale":"2024-09-14T13:02:14.376805+0000","last_undegraded":"2024-09-14T13:02:14.376805+0000","last_fullsized":"2024-09-14T13:02:14.376805+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'2","last_scrub_stamp":"2024-09-14T13:02:14.376621+0000","last_deep_scrub":"267'2","last_deep_scrub_stamp":"2024-09-14T13:02:14.376621+0000","last_clean_scrub_stamp":"2024-09-14T13:02:14.376621+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:25:42.583105+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0.0011624509999999999,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"267'380","reported_seq":1109,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:05.971317+0000","last_change":"2024-09-14T13:02:05.971317+0000","last_active":"2024-09-14T13:02:05.971317+0000","last_peered":"2024-09-14T13:02:05.971317+0000","last_clean":"2024-09-14T13:02:05.971317+0000","last_became_active":"2024-09-14T11:08:21.809523+0000","last_became_peered":"2024-09-14T11:08:21.809523+0000","last_unstale":"2024-09-14T13:02:05.971317+0000","last_undegraded":"2024-09-14T13:02:05.971317+0000","last_fullsized":"2024-09-14T13:02:05.971317+0000","mapping_epoch":24,"log_start":"267'300","ondisk_log_start":"267'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'380","last_scrub_stamp":"2024-09-14T13:02:05.971194+0000","last_deep_scrub":"267'380","last_deep_scrub_stamp":"2024-09-14T13:02:05.971194+0000","last_clean_scrub_stamp":"2024-09-14T13:02:05.971194+0000","objects_scrubbed":3,"log_size":80,"log_dups_size":300,"ondisk_log_size":80,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:17:00.193745+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1030,"num_read_kb":10703,"num_write":1404,"num_write_kb":52429,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,6],"acting":[3,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":534,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:58:52.836590+0000","last_change":"2024-09-14T11:08:25.808691+0000","last_active":"2024-09-14T12:58:52.836590+0000","last_peered":"2024-09-14T12:58:52.836590+0000","last_clean":"2024-09-14T12:58:52.836590+0000","last_became_active":"2024-09-14T11:08:25.807851+0000","last_became_peered":"2024-09-14T11:08:25.807851+0000","last_unstale":"2024-09-14T12:58:52.836590+0000","last_undegraded":"2024-09-14T12:58:52.836590+0000","last_fullsized":"2024-09-14T12:58:52.836590+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:08:24.757170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:08:24.757170+0000","last_clean_scrub_stamp":"2024-09-14T11:08:24.757170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:56:51.066419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.7","version":"267'348","reported_seq":1098,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:00.275733+0000","last_change":"2024-09-14T11:08:27.834071+0000","last_active":"2024-09-14T13:02:00.275733+0000","last_peered":"2024-09-14T13:02:00.275733+0000","last_clean":"2024-09-14T13:02:00.275733+0000","last_became_active":"2024-09-14T11:08:27.829359+0000","last_became_peered":"2024-09-14T11:08:27.829359+0000","last_unstale":"2024-09-14T13:02:00.275733+0000","last_undegraded":"2024-09-14T13:02:00.275733+0000","last_fullsized":"2024-09-14T13:02:00.275733+0000","mapping_epoch":30,"log_start":"267'300","ondisk_log_start":"267'300","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:08:26.771628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:08:26.771628+0000","last_clean_scrub_stamp":"2024-09-14T11:08:26.771628+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":300,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:44:51.169189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":21129,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":651,"num_read_kb":879,"num_write":592,"num_write_kb":412,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":528,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:59:03.245682+0000","last_change":"2024-09-14T11:08:29.827169+0000","last_active":"2024-09-14T12:59:03.245682+0000","last_peered":"2024-09-14T12:59:03.245682+0000","last_clean":"2024-09-14T12:59:03.245682+0000","last_became_active":"2024-09-14T11:08:29.826367+0000","last_became_peered":"2024-09-14T11:08:29.826367+0000","last_unstale":"2024-09-14T12:59:03.245682+0000","last_undegraded":"2024-09-14T12:59:03.245682+0000","last_fullsized":"2024-09-14T12:59:03.245682+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:08:28.783586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:08:28.783586+0000","last_clean_scrub_stamp":"2024-09-14T11:08:28.783586+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:19:54.618304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.9","version":"267'212","reported_seq":968,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:00:21.334917+0000","last_change":"2024-09-14T11:08:31.849513+0000","last_active":"2024-09-14T13:00:21.334917+0000","last_peered":"2024-09-14T13:00:21.334917+0000","last_clean":"2024-09-14T13:00:21.334917+0000","last_became_active":"2024-09-14T11:08:31.848763+0000","last_became_peered":"2024-09-14T11:08:31.848763+0000","last_unstale":"2024-09-14T13:00:21.334917+0000","last_undegraded":"2024-09-14T13:00:21.334917+0000","last_fullsized":"2024-09-14T13:00:21.334917+0000","mapping_epoch":34,"log_start":"267'200","ondisk_log_start":"267'200","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:08:30.789404+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:08:30.789404+0000","last_clean_scrub_stamp":"2024-09-14T11:08:30.789404+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":200,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:22:19.969967+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":408,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":546,"num_read_kb":516,"num_write":465,"num_write_kb":130,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.6","version":"267'599","reported_seq":2285,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:14.132048+0000","last_change":"2024-09-14T13:02:14.132048+0000","last_active":"2024-09-14T13:02:14.132048+0000","last_peered":"2024-09-14T13:02:14.132048+0000","last_clean":"2024-09-14T13:02:14.132048+0000","last_became_active":"2024-09-14T11:08:23.776564+0000","last_became_peered":"2024-09-14T11:08:23.776564+0000","last_unstale":"2024-09-14T13:02:14.132048+0000","last_undegraded":"2024-09-14T13:02:14.132048+0000","last_fullsized":"2024-09-14T13:02:14.132048+0000","mapping_epoch":26,"log_start":"267'500","ondisk_log_start":"267'500","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'599","last_scrub_stamp":"2024-09-14T13:02:14.131858+0000","last_deep_scrub":"267'599","last_deep_scrub_stamp":"2024-09-14T13:02:14.131858+0000","last_clean_scrub_stamp":"2024-09-14T13:02:14.131858+0000","objects_scrubbed":4,"log_size":99,"log_dups_size":500,"ondisk_log_size":99,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:23:37.462516+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":3171,"num_read_kb":2898,"num_write":783,"num_write_kb":298,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":571,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:08.688687+0000","last_change":"2024-09-14T13:02:08.688687+0000","last_active":"2024-09-14T13:02:08.688687+0000","last_peered":"2024-09-14T13:02:08.688687+0000","last_clean":"2024-09-14T13:02:08.688687+0000","last_became_active":"2024-09-14T11:08:08.903386+0000","last_became_peered":"2024-09-14T11:08:08.903386+0000","last_unstale":"2024-09-14T13:02:08.688687+0000","last_undegraded":"2024-09-14T13:02:08.688687+0000","last_fullsized":"2024-09-14T13:02:08.688687+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T13:02:08.688502+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T13:02:08.688502+0000","last_clean_scrub_stamp":"2024-09-14T13:02:08.688502+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:32:18.880899+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0.001192558,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"267'181","reported_seq":879,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:06.030771+0000","last_change":"2024-09-14T13:02:06.030771+0000","last_active":"2024-09-14T13:02:06.030771+0000","last_peered":"2024-09-14T13:02:06.030771+0000","last_clean":"2024-09-14T13:02:06.030771+0000","last_became_active":"2024-09-14T11:08:21.815453+0000","last_became_peered":"2024-09-14T11:08:21.815453+0000","last_unstale":"2024-09-14T13:02:06.030771+0000","last_undegraded":"2024-09-14T13:02:06.030771+0000","last_fullsized":"2024-09-14T13:02:06.030771+0000","mapping_epoch":24,"log_start":"267'100","ondisk_log_start":"267'100","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'181","last_scrub_stamp":"2024-09-14T13:02:06.030660+0000","last_deep_scrub":"267'181","last_deep_scrub_stamp":"2024-09-14T13:02:06.030660+0000","last_clean_scrub_stamp":"2024-09-14T13:02:06.030660+0000","objects_scrubbed":1,"log_size":81,"log_dups_size":100,"ondisk_log_size":81,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:55:29.313268+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":658,"num_read_kb":79122,"num_write":846,"num_write_kb":40267,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,3],"acting":[0,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":531,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:58:58.047972+0000","last_change":"2024-09-14T11:08:25.802329+0000","last_active":"2024-09-14T12:58:58.047972+0000","last_peered":"2024-09-14T12:58:58.047972+0000","last_clean":"2024-09-14T12:58:58.047972+0000","last_became_active":"2024-09-14T11:08:25.801580+0000","last_became_peered":"2024-09-14T11:08:25.801580+0000","last_unstale":"2024-09-14T12:58:58.047972+0000","last_undegraded":"2024-09-14T12:58:58.047972+0000","last_fullsized":"2024-09-14T12:58:58.047972+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:08:24.757170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:08:24.757170+0000","last_clean_scrub_stamp":"2024-09-14T11:08:24.757170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:41:07.671257+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.4","version":"267'1028","reported_seq":3391,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:23.001482+0000","last_change":"2024-09-14T13:02:23.001482+0000","last_active":"2024-09-14T13:02:23.001482+0000","last_peered":"2024-09-14T13:02:23.001482+0000","last_clean":"2024-09-14T13:02:23.001482+0000","last_became_active":"2024-09-14T11:08:27.824703+0000","last_became_peered":"2024-09-14T11:08:27.824703+0000","last_unstale":"2024-09-14T13:02:23.001482+0000","last_undegraded":"2024-09-14T13:02:23.001482+0000","last_fullsized":"2024-09-14T13:02:23.001482+0000","mapping_epoch":30,"log_start":"267'1001","ondisk_log_start":"267'1001","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'1028","last_scrub_stamp":"2024-09-14T13:02:23.001258+0000","last_deep_scrub":"267'1028","last_deep_scrub_stamp":"2024-09-14T13:02:23.001258+0000","last_clean_scrub_stamp":"2024-09-14T13:02:23.001258+0000","objects_scrubbed":12,"log_size":27,"log_dups_size":1001,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:43:35.067903+0000","scrub_duration":19,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":21392,"num_objects":12,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":0,"num_read":1365,"num_read_kb":1481,"num_write":500,"num_write_kb":254,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":6238,"num_omap_keys":18,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":526,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:59:32.846140+0000","last_change":"2024-09-14T11:08:29.837085+0000","last_active":"2024-09-14T12:59:32.846140+0000","last_peered":"2024-09-14T12:59:32.846140+0000","last_clean":"2024-09-14T12:59:32.846140+0000","last_became_active":"2024-09-14T11:08:29.836253+0000","last_became_peered":"2024-09-14T11:08:29.836253+0000","last_unstale":"2024-09-14T12:59:32.846140+0000","last_undegraded":"2024-09-14T12:59:32.846140+0000","last_fullsized":"2024-09-14T12:59:32.846140+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:08:28.783586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:08:28.783586+0000","last_clean_scrub_stamp":"2024-09-14T11:08:28.783586+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:19:31.677337+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.a","version":"267'224","reported_seq":783,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:59:18.468936+0000","last_change":"2024-09-14T11:08:31.836526+0000","last_active":"2024-09-14T12:59:18.468936+0000","last_peered":"2024-09-14T12:59:18.468936+0000","last_clean":"2024-09-14T12:59:18.468936+0000","last_became_active":"2024-09-14T11:08:31.835700+0000","last_became_peered":"2024-09-14T11:08:31.835700+0000","last_unstale":"2024-09-14T12:59:18.468936+0000","last_undegraded":"2024-09-14T12:59:18.468936+0000","last_fullsized":"2024-09-14T12:59:18.468936+0000","mapping_epoch":34,"log_start":"267'200","ondisk_log_start":"267'200","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:08:30.789404+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:08:30.789404+0000","last_clean_scrub_stamp":"2024-09-14T11:08:30.789404+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":200,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:45:49.838871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":435,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":369,"num_read_kb":358,"num_write":505,"num_write_kb":147,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"267'416","reported_seq":2042,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:12.146837+0000","last_change":"2024-09-14T13:02:12.146837+0000","last_active":"2024-09-14T13:02:12.146837+0000","last_peered":"2024-09-14T13:02:12.146837+0000","last_clean":"2024-09-14T13:02:12.146837+0000","last_became_active":"2024-09-14T11:09:57.243168+0000","last_became_peered":"2024-09-14T11:09:57.243168+0000","last_unstale":"2024-09-14T13:02:12.146837+0000","last_undegraded":"2024-09-14T13:02:12.146837+0000","last_fullsized":"2024-09-14T13:02:12.146837+0000","mapping_epoch":39,"log_start":"267'400","ondisk_log_start":"267'400","created":26,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'416","last_scrub_stamp":"2024-09-14T13:02:12.146640+0000","last_deep_scrub":"267'416","last_deep_scrub_stamp":"2024-09-14T13:02:12.146640+0000","last_clean_scrub_stamp":"2024-09-14T13:02:12.146640+0000","objects_scrubbed":3,"log_size":16,"log_dups_size":400,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:25:54.329360+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2397,"num_read_kb":2278,"num_write":464,"num_write_kb":90,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":883,"num_omap_keys":4,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":572,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:08.071321+0000","last_change":"2024-09-14T13:02:08.071321+0000","last_active":"2024-09-14T13:02:08.071321+0000","last_peered":"2024-09-14T13:02:08.071321+0000","last_clean":"2024-09-14T13:02:08.071321+0000","last_became_active":"2024-09-14T11:08:08.957848+0000","last_became_peered":"2024-09-14T11:08:08.957848+0000","last_unstale":"2024-09-14T13:02:08.071321+0000","last_undegraded":"2024-09-14T13:02:08.071321+0000","last_fullsized":"2024-09-14T13:02:08.071321+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T13:02:08.071230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T13:02:08.071230+0000","last_clean_scrub_stamp":"2024-09-14T13:02:08.071230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:34:22.543760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001143142,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"267'236","reported_seq":927,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:07.066246+0000","last_change":"2024-09-14T13:02:07.066246+0000","last_active":"2024-09-14T13:02:07.066246+0000","last_peered":"2024-09-14T13:02:07.066246+0000","last_clean":"2024-09-14T13:02:07.066246+0000","last_became_active":"2024-09-14T11:08:21.817523+0000","last_became_peered":"2024-09-14T11:08:21.817523+0000","last_unstale":"2024-09-14T13:02:07.066246+0000","last_undegraded":"2024-09-14T13:02:07.066246+0000","last_fullsized":"2024-09-14T13:02:07.066246+0000","mapping_epoch":24,"log_start":"267'200","ondisk_log_start":"267'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'236","last_scrub_stamp":"2024-09-14T13:02:07.066157+0000","last_deep_scrub":"267'236","last_deep_scrub_stamp":"2024-09-14T13:02:07.066157+0000","last_clean_scrub_stamp":"2024-09-14T13:02:07.066157+0000","objects_scrubbed":3,"log_size":36,"log_dups_size":200,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:24:04.875361+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":52,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":630,"num_read_kb":70142,"num_write":1046,"num_write_kb":36042,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,6],"acting":[1,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.6","version":"267'2","reported_seq":545,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:19.144585+0000","last_change":"2024-09-14T13:02:19.144585+0000","last_active":"2024-09-14T13:02:19.144585+0000","last_peered":"2024-09-14T13:02:19.144585+0000","last_clean":"2024-09-14T13:02:19.144585+0000","last_became_active":"2024-09-14T11:08:25.807070+0000","last_became_peered":"2024-09-14T11:08:25.807070+0000","last_unstale":"2024-09-14T13:02:19.144585+0000","last_undegraded":"2024-09-14T13:02:19.144585+0000","last_fullsized":"2024-09-14T13:02:19.144585+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'2","last_scrub_stamp":"2024-09-14T13:02:19.144401+0000","last_deep_scrub":"267'2","last_deep_scrub_stamp":"2024-09-14T13:02:19.144401+0000","last_clean_scrub_stamp":"2024-09-14T13:02:19.144401+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T00:26:33.317334+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.5","version":"267'402","reported_seq":2364,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:01:40.687724+0000","last_change":"2024-09-14T11:08:27.831350+0000","last_active":"2024-09-14T13:01:40.687724+0000","last_peered":"2024-09-14T13:01:40.687724+0000","last_clean":"2024-09-14T13:01:40.687724+0000","last_became_active":"2024-09-14T11:08:27.830644+0000","last_became_peered":"2024-09-14T11:08:27.830644+0000","last_unstale":"2024-09-14T13:01:40.687724+0000","last_undegraded":"2024-09-14T13:01:40.687724+0000","last_fullsized":"2024-09-14T13:01:40.687724+0000","mapping_epoch":30,"log_start":"267'300","ondisk_log_start":"267'300","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:08:26.771628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:08:26.771628+0000","last_clean_scrub_stamp":"2024-09-14T11:08:26.771628+0000","objects_scrubbed":0,"log_size":102,"log_dups_size":300,"ondisk_log_size":102,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:05:03.898449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":154,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":380,"num_read_kb":368,"num_write":375,"num_write_kb":193,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":530,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:58:58.243958+0000","last_change":"2024-09-14T11:08:29.802462+0000","last_active":"2024-09-14T12:58:58.243958+0000","last_peered":"2024-09-14T12:58:58.243958+0000","last_clean":"2024-09-14T12:58:58.243958+0000","last_became_active":"2024-09-14T11:08:29.801661+0000","last_became_peered":"2024-09-14T11:08:29.801661+0000","last_unstale":"2024-09-14T12:58:58.243958+0000","last_undegraded":"2024-09-14T12:58:58.243958+0000","last_fullsized":"2024-09-14T12:58:58.243958+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:08:28.783586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:08:28.783586+0000","last_clean_scrub_stamp":"2024-09-14T11:08:28.783586+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:32:48.426887+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.b","version":"267'248","reported_seq":876,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:00:21.845348+0000","last_change":"2024-09-14T11:08:31.842253+0000","last_active":"2024-09-14T13:00:21.845348+0000","last_peered":"2024-09-14T13:00:21.845348+0000","last_clean":"2024-09-14T13:00:21.845348+0000","last_became_active":"2024-09-14T11:08:31.841552+0000","last_became_peered":"2024-09-14T11:08:31.841552+0000","last_unstale":"2024-09-14T13:00:21.845348+0000","last_undegraded":"2024-09-14T13:00:21.845348+0000","last_fullsized":"2024-09-14T13:00:21.845348+0000","mapping_epoch":34,"log_start":"267'200","ondisk_log_start":"267'200","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:08:30.789404+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:08:30.789404+0000","last_clean_scrub_stamp":"2024-09-14T11:08:30.789404+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":200,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:30:40.287699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":202,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":474,"num_read_kb":499,"num_write":548,"num_write_kb":158,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"267'1115","reported_seq":2648,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:11.020600+0000","last_change":"2024-09-14T13:02:11.020600+0000","last_active":"2024-09-14T13:02:11.020600+0000","last_peered":"2024-09-14T13:02:11.020600+0000","last_clean":"2024-09-14T13:02:11.020600+0000","last_became_active":"2024-09-14T11:08:23.777511+0000","last_became_peered":"2024-09-14T11:08:23.777511+0000","last_unstale":"2024-09-14T13:02:11.020600+0000","last_undegraded":"2024-09-14T13:02:11.020600+0000","last_fullsized":"2024-09-14T13:02:11.020600+0000","mapping_epoch":26,"log_start":"267'1100","ondisk_log_start":"267'1100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'1115","last_scrub_stamp":"2024-09-14T13:02:11.020381+0000","last_deep_scrub":"267'1115","last_deep_scrub_stamp":"2024-09-14T13:02:11.020381+0000","last_clean_scrub_stamp":"2024-09-14T13:02:11.020381+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":1100,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:18:14.256119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5086,"num_read_kb":4484,"num_write":1533,"num_write_kb":642,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"267'3","reported_seq":571,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:07.256502+0000","last_change":"2024-09-14T13:02:07.256502+0000","last_active":"2024-09-14T13:02:07.256502+0000","last_peered":"2024-09-14T13:02:07.256502+0000","last_clean":"2024-09-14T13:02:07.256502+0000","last_became_active":"2024-09-14T11:08:08.903062+0000","last_became_peered":"2024-09-14T11:08:08.903062+0000","last_unstale":"2024-09-14T13:02:07.256502+0000","last_undegraded":"2024-09-14T13:02:07.256502+0000","last_fullsized":"2024-09-14T13:02:07.256502+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'3","last_scrub_stamp":"2024-09-14T13:02:07.256289+0000","last_deep_scrub":"267'3","last_deep_scrub_stamp":"2024-09-14T13:02:07.256289+0000","last_clean_scrub_stamp":"2024-09-14T13:02:07.256289+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:37:50.637115+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0.0022728420000000002,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"267'181","reported_seq":876,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:06.906936+0000","last_change":"2024-09-14T13:02:06.906936+0000","last_active":"2024-09-14T13:02:06.906936+0000","last_peered":"2024-09-14T13:02:06.906936+0000","last_clean":"2024-09-14T13:02:06.906936+0000","last_became_active":"2024-09-14T11:08:21.823121+0000","last_became_peered":"2024-09-14T11:08:21.823121+0000","last_unstale":"2024-09-14T13:02:06.906936+0000","last_undegraded":"2024-09-14T13:02:06.906936+0000","last_fullsized":"2024-09-14T13:02:06.906936+0000","mapping_epoch":24,"log_start":"267'100","ondisk_log_start":"267'100","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'181","last_scrub_stamp":"2024-09-14T13:02:06.906725+0000","last_deep_scrub":"267'181","last_deep_scrub_stamp":"2024-09-14T13:02:06.906725+0000","last_clean_scrub_stamp":"2024-09-14T13:02:06.906725+0000","objects_scrubbed":2,"log_size":81,"log_dups_size":100,"ondisk_log_size":81,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:55:40.720442+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":28,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":557,"num_read_kb":32204,"num_write":881,"num_write_kb":26671,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,0],"acting":[4,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":546,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:18.094637+0000","last_change":"2024-09-14T13:02:18.094637+0000","last_active":"2024-09-14T13:02:18.094637+0000","last_peered":"2024-09-14T13:02:18.094637+0000","last_clean":"2024-09-14T13:02:18.094637+0000","last_became_active":"2024-09-14T11:08:25.796526+0000","last_became_peered":"2024-09-14T11:08:25.796526+0000","last_unstale":"2024-09-14T13:02:18.094637+0000","last_undegraded":"2024-09-14T13:02:18.094637+0000","last_fullsized":"2024-09-14T13:02:18.094637+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T13:02:18.094441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T13:02:18.094441+0000","last_clean_scrub_stamp":"2024-09-14T13:02:18.094441+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T00:51:13.768814+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.6","version":"267'234","reported_seq":849,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:01:28.385849+0000","last_change":"2024-09-14T11:08:27.819232+0000","last_active":"2024-09-14T13:01:28.385849+0000","last_peered":"2024-09-14T13:01:28.385849+0000","last_clean":"2024-09-14T13:01:28.385849+0000","last_became_active":"2024-09-14T11:08:27.818482+0000","last_became_peered":"2024-09-14T11:08:27.818482+0000","last_unstale":"2024-09-14T13:01:28.385849+0000","last_undegraded":"2024-09-14T13:01:28.385849+0000","last_fullsized":"2024-09-14T13:01:28.385849+0000","mapping_epoch":30,"log_start":"267'200","ondisk_log_start":"267'200","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:08:26.771628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:08:26.771628+0000","last_clean_scrub_stamp":"2024-09-14T11:08:26.771628+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":200,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:12:06.477100+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":286,"num_read_kb":275,"num_write":214,"num_write_kb":24,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":522,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:59:03.430911+0000","last_change":"2024-09-14T11:08:29.839536+0000","last_active":"2024-09-14T12:59:03.430911+0000","last_peered":"2024-09-14T12:59:03.430911+0000","last_clean":"2024-09-14T12:59:03.430911+0000","last_became_active":"2024-09-14T11:08:29.837840+0000","last_became_peered":"2024-09-14T11:08:29.837840+0000","last_unstale":"2024-09-14T12:59:03.430911+0000","last_undegraded":"2024-09-14T12:59:03.430911+0000","last_fullsized":"2024-09-14T12:59:03.430911+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:08:28.783586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:08:28.783586+0000","last_clean_scrub_stamp":"2024-09-14T11:08:28.783586+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:39:33.744929+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.8","version":"267'111","reported_seq":687,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:00:18.844178+0000","last_change":"2024-09-14T11:08:31.852081+0000","last_active":"2024-09-14T13:00:18.844178+0000","last_peered":"2024-09-14T13:00:18.844178+0000","last_clean":"2024-09-14T13:00:18.844178+0000","last_became_active":"2024-09-14T11:08:31.851269+0000","last_became_peered":"2024-09-14T11:08:31.851269+0000","last_unstale":"2024-09-14T13:00:18.844178+0000","last_undegraded":"2024-09-14T13:00:18.844178+0000","last_fullsized":"2024-09-14T13:00:18.844178+0000","mapping_epoch":34,"log_start":"267'100","ondisk_log_start":"267'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:08:30.789404+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:08:30.789404+0000","last_clean_scrub_stamp":"2024-09-14T11:08:30.789404+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":100,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:52:29.862548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":188,"num_read_kb":187,"num_write":249,"num_write_kb":58,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"267'520","reported_seq":2239,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:12.995460+0000","last_change":"2024-09-14T13:02:12.995460+0000","last_active":"2024-09-14T13:02:12.995460+0000","last_peered":"2024-09-14T13:02:12.995460+0000","last_clean":"2024-09-14T13:02:12.995460+0000","last_became_active":"2024-09-14T11:08:23.793860+0000","last_became_peered":"2024-09-14T11:08:23.793860+0000","last_unstale":"2024-09-14T13:02:12.995460+0000","last_undegraded":"2024-09-14T13:02:12.995460+0000","last_fullsized":"2024-09-14T13:02:12.995460+0000","mapping_epoch":26,"log_start":"267'500","ondisk_log_start":"267'500","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'520","last_scrub_stamp":"2024-09-14T13:02:12.995266+0000","last_deep_scrub":"267'520","last_deep_scrub_stamp":"2024-09-14T13:02:12.995266+0000","last_clean_scrub_stamp":"2024-09-14T13:02:12.995266+0000","objects_scrubbed":3,"log_size":20,"log_dups_size":500,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:38:13.362386+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3013,"num_read_kb":2819,"num_write":641,"num_write_kb":178,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2808,"num_omap_keys":11,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"267'200","reported_seq":887,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:09.308300+0000","last_change":"2024-09-14T13:02:09.308300+0000","last_active":"2024-09-14T13:02:09.308300+0000","last_peered":"2024-09-14T13:02:09.308300+0000","last_clean":"2024-09-14T13:02:09.308300+0000","last_became_active":"2024-09-14T11:08:21.791679+0000","last_became_peered":"2024-09-14T11:08:21.791679+0000","last_unstale":"2024-09-14T13:02:09.308300+0000","last_undegraded":"2024-09-14T13:02:09.308300+0000","last_fullsized":"2024-09-14T13:02:09.308300+0000","mapping_epoch":24,"log_start":"267'100","ondisk_log_start":"267'100","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'200","last_scrub_stamp":"2024-09-14T13:02:09.308096+0000","last_deep_scrub":"267'200","last_deep_scrub_stamp":"2024-09-14T13:02:09.308096+0000","last_clean_scrub_stamp":"2024-09-14T13:02:09.308096+0000","objects_scrubbed":2,"log_size":100,"log_dups_size":100,"ondisk_log_size":100,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:28:27.126433+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":15,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":647,"num_read_kb":55282,"num_write":902,"num_write_kb":39262,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,2],"acting":[5,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":566,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:06.063313+0000","last_change":"2024-09-14T13:02:06.063313+0000","last_active":"2024-09-14T13:02:06.063313+0000","last_peered":"2024-09-14T13:02:06.063313+0000","last_clean":"2024-09-14T13:02:06.063313+0000","last_became_active":"2024-09-14T11:08:08.888921+0000","last_became_peered":"2024-09-14T11:08:08.888921+0000","last_unstale":"2024-09-14T13:02:06.063313+0000","last_undegraded":"2024-09-14T13:02:06.063313+0000","last_fullsized":"2024-09-14T13:02:06.063313+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T13:02:06.063225+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T13:02:06.063225+0000","last_clean_scrub_stamp":"2024-09-14T13:02:06.063225+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:03:25.698483+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001198714,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":538,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:58:53.242581+0000","last_change":"2024-09-14T11:08:25.801820+0000","last_active":"2024-09-14T12:58:53.242581+0000","last_peered":"2024-09-14T12:58:53.242581+0000","last_clean":"2024-09-14T12:58:53.242581+0000","last_became_active":"2024-09-14T11:08:25.792863+0000","last_became_peered":"2024-09-14T11:08:25.792863+0000","last_unstale":"2024-09-14T12:58:53.242581+0000","last_undegraded":"2024-09-14T12:58:53.242581+0000","last_fullsized":"2024-09-14T12:58:53.242581+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:08:24.757170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:08:24.757170+0000","last_clean_scrub_stamp":"2024-09-14T11:08:24.757170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:55:17.257027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"267'470","reported_seq":1225,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:16.091681+0000","last_change":"2024-09-14T13:02:16.091681+0000","last_active":"2024-09-14T13:02:16.091681+0000","last_peered":"2024-09-14T13:02:16.091681+0000","last_clean":"2024-09-14T13:02:16.091681+0000","last_became_active":"2024-09-14T11:08:27.803324+0000","last_became_peered":"2024-09-14T11:08:27.803324+0000","last_unstale":"2024-09-14T13:02:16.091681+0000","last_undegraded":"2024-09-14T13:02:16.091681+0000","last_fullsized":"2024-09-14T13:02:16.091681+0000","mapping_epoch":30,"log_start":"267'400","ondisk_log_start":"267'400","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'470","last_scrub_stamp":"2024-09-14T13:02:16.091442+0000","last_deep_scrub":"267'470","last_deep_scrub_stamp":"2024-09-14T13:02:16.091442+0000","last_clean_scrub_stamp":"2024-09-14T13:02:16.091442+0000","objects_scrubbed":10,"log_size":70,"log_dups_size":400,"ondisk_log_size":70,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T00:12:22.033953+0000","scrub_duration":31,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19948,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":1305,"num_read_kb":1473,"num_write":1890,"num_write_kb":1660,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":530760,"num_omap_keys":1200,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":527,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:58:58.232580+0000","last_change":"2024-09-14T11:08:29.831130+0000","last_active":"2024-09-14T12:58:58.232580+0000","last_peered":"2024-09-14T12:58:58.232580+0000","last_clean":"2024-09-14T12:58:58.232580+0000","last_became_active":"2024-09-14T11:08:29.830303+0000","last_became_peered":"2024-09-14T11:08:29.830303+0000","last_unstale":"2024-09-14T12:58:58.232580+0000","last_undegraded":"2024-09-14T12:58:58.232580+0000","last_fullsized":"2024-09-14T12:58:58.232580+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:08:28.783586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:08:28.783586+0000","last_clean_scrub_stamp":"2024-09-14T11:08:28.783586+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:22:47.627433+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.e","version":"267'153","reported_seq":717,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:00:13.798032+0000","last_change":"2024-09-14T11:08:31.836009+0000","last_active":"2024-09-14T13:00:13.798032+0000","last_peered":"2024-09-14T13:00:13.798032+0000","last_clean":"2024-09-14T13:00:13.798032+0000","last_became_active":"2024-09-14T11:08:31.835335+0000","last_became_peered":"2024-09-14T11:08:31.835335+0000","last_unstale":"2024-09-14T13:00:13.798032+0000","last_undegraded":"2024-09-14T13:00:13.798032+0000","last_fullsized":"2024-09-14T13:00:13.798032+0000","mapping_epoch":34,"log_start":"267'100","ondisk_log_start":"267'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:08:30.789404+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:08:30.789404+0000","last_clean_scrub_stamp":"2024-09-14T11:08:30.789404+0000","objects_scrubbed":0,"log_size":53,"log_dups_size":100,"ondisk_log_size":53,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:46:41.088012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":736,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":226,"num_read_kb":194,"num_write":381,"num_write_kb":93,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"267'738","reported_seq":2294,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:15.091975+0000","last_change":"2024-09-14T13:02:15.091975+0000","last_active":"2024-09-14T13:02:15.091975+0000","last_peered":"2024-09-14T13:02:15.091975+0000","last_clean":"2024-09-14T13:02:15.091975+0000","last_became_active":"2024-09-14T11:08:23.792144+0000","last_became_peered":"2024-09-14T11:08:23.792144+0000","last_unstale":"2024-09-14T13:02:15.091975+0000","last_undegraded":"2024-09-14T13:02:15.091975+0000","last_fullsized":"2024-09-14T13:02:15.091975+0000","mapping_epoch":26,"log_start":"267'700","ondisk_log_start":"267'700","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'738","last_scrub_stamp":"2024-09-14T13:02:15.091782+0000","last_deep_scrub":"267'738","last_deep_scrub_stamp":"2024-09-14T13:02:15.091782+0000","last_clean_scrub_stamp":"2024-09-14T13:02:15.091782+0000","objects_scrubbed":4,"log_size":38,"log_dups_size":700,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:17:17.576090+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":3573,"num_read_kb":3234,"num_write":954,"num_write_kb":344,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":441,"num_omap_keys":2,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.4","version":"267'263","reported_seq":989,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:09.032643+0000","last_change":"2024-09-14T13:02:09.032643+0000","last_active":"2024-09-14T13:02:09.032643+0000","last_peered":"2024-09-14T13:02:09.032643+0000","last_clean":"2024-09-14T13:02:09.032643+0000","last_became_active":"2024-09-14T11:08:21.808278+0000","last_became_peered":"2024-09-14T11:08:21.808278+0000","last_unstale":"2024-09-14T13:02:09.032643+0000","last_undegraded":"2024-09-14T13:02:09.032643+0000","last_fullsized":"2024-09-14T13:02:09.032643+0000","mapping_epoch":24,"log_start":"267'200","ondisk_log_start":"267'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'263","last_scrub_stamp":"2024-09-14T13:02:09.032409+0000","last_deep_scrub":"267'263","last_deep_scrub_stamp":"2024-09-14T13:02:09.032409+0000","last_clean_scrub_stamp":"2024-09-14T13:02:09.032409+0000","objects_scrubbed":7,"log_size":63,"log_dups_size":200,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:47:10.565844+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":105,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":853,"num_read_kb":29781,"num_write":1322,"num_write_kb":30049,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,6],"acting":[1,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":569,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:11.672021+0000","last_change":"2024-09-14T13:02:11.672021+0000","last_active":"2024-09-14T13:02:11.672021+0000","last_peered":"2024-09-14T13:02:11.672021+0000","last_clean":"2024-09-14T13:02:11.672021+0000","last_became_active":"2024-09-14T11:08:08.903905+0000","last_became_peered":"2024-09-14T11:08:08.903905+0000","last_unstale":"2024-09-14T13:02:11.672021+0000","last_undegraded":"2024-09-14T13:02:11.672021+0000","last_fullsized":"2024-09-14T13:02:11.672021+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T13:02:11.671824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T13:02:11.671824+0000","last_clean_scrub_stamp":"2024-09-14T13:02:11.671824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:19:51.277720+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0.001173377,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":540,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:21.282349+0000","last_change":"2024-09-14T13:02:21.282349+0000","last_active":"2024-09-14T13:02:21.282349+0000","last_peered":"2024-09-14T13:02:21.282349+0000","last_clean":"2024-09-14T13:02:21.282349+0000","last_became_active":"2024-09-14T11:08:25.800695+0000","last_became_peered":"2024-09-14T11:08:25.800695+0000","last_unstale":"2024-09-14T13:02:21.282349+0000","last_undegraded":"2024-09-14T13:02:21.282349+0000","last_fullsized":"2024-09-14T13:02:21.282349+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T13:02:21.282162+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T13:02:21.282162+0000","last_clean_scrub_stamp":"2024-09-14T13:02:21.282162+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:49:39.366357+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1","version":"267'350","reported_seq":993,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:00:28.372671+0000","last_change":"2024-09-14T11:08:27.814544+0000","last_active":"2024-09-14T13:00:28.372671+0000","last_peered":"2024-09-14T13:00:28.372671+0000","last_clean":"2024-09-14T13:00:28.372671+0000","last_became_active":"2024-09-14T11:08:27.813857+0000","last_became_peered":"2024-09-14T11:08:27.813857+0000","last_unstale":"2024-09-14T13:00:28.372671+0000","last_undegraded":"2024-09-14T13:00:28.372671+0000","last_fullsized":"2024-09-14T13:00:28.372671+0000","mapping_epoch":30,"log_start":"267'300","ondisk_log_start":"267'300","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:08:26.771628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:08:26.771628+0000","last_clean_scrub_stamp":"2024-09-14T11:08:26.771628+0000","objects_scrubbed":0,"log_size":50,"log_dups_size":300,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:41:50.966231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":441,"num_read_kb":434,"num_write":426,"num_write_kb":202,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.0","version":"267'780","reported_seq":5198,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:00.315663+0000","last_change":"2024-09-14T11:08:29.824227+0000","last_active":"2024-09-14T13:02:00.315663+0000","last_peered":"2024-09-14T13:02:00.315663+0000","last_clean":"2024-09-14T13:02:00.315663+0000","last_became_active":"2024-09-14T11:08:29.823513+0000","last_became_peered":"2024-09-14T11:08:29.823513+0000","last_unstale":"2024-09-14T13:02:00.315663+0000","last_undegraded":"2024-09-14T13:02:00.315663+0000","last_fullsized":"2024-09-14T13:02:00.315663+0000","mapping_epoch":32,"log_start":"267'700","ondisk_log_start":"267'700","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:08:28.783586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:08:28.783586+0000","last_clean_scrub_stamp":"2024-09-14T11:08:28.783586+0000","objects_scrubbed":0,"log_size":80,"log_dups_size":700,"ondisk_log_size":80,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:12:27.111650+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.f","version":"267'148","reported_seq":702,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:01:23.499170+0000","last_change":"2024-09-14T11:08:31.831263+0000","last_active":"2024-09-14T13:01:23.499170+0000","last_peered":"2024-09-14T13:01:23.499170+0000","last_clean":"2024-09-14T13:01:23.499170+0000","last_became_active":"2024-09-14T11:08:31.825708+0000","last_became_peered":"2024-09-14T11:08:31.825708+0000","last_unstale":"2024-09-14T13:01:23.499170+0000","last_undegraded":"2024-09-14T13:01:23.499170+0000","last_fullsized":"2024-09-14T13:01:23.499170+0000","mapping_epoch":34,"log_start":"267'100","ondisk_log_start":"267'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:08:30.789404+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:08:30.789404+0000","last_clean_scrub_stamp":"2024-09-14T11:08:30.789404+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":100,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:10:09.371769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1096,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":219,"num_read_kb":197,"num_write":351,"num_write_kb":86,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"267'1023","reported_seq":2916,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:14.881529+0000","last_change":"2024-09-14T13:02:14.881529+0000","last_active":"2024-09-14T13:02:14.881529+0000","last_peered":"2024-09-14T13:02:14.881529+0000","last_clean":"2024-09-14T13:02:14.881529+0000","last_became_active":"2024-09-14T11:08:23.800388+0000","last_became_peered":"2024-09-14T11:08:23.800388+0000","last_unstale":"2024-09-14T13:02:14.881529+0000","last_undegraded":"2024-09-14T13:02:14.881529+0000","last_fullsized":"2024-09-14T13:02:14.881529+0000","mapping_epoch":26,"log_start":"267'1000","ondisk_log_start":"267'1000","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'1023","last_scrub_stamp":"2024-09-14T13:02:14.881346+0000","last_deep_scrub":"267'1023","last_deep_scrub_stamp":"2024-09-14T13:02:14.881346+0000","last_clean_scrub_stamp":"2024-09-14T13:02:14.881346+0000","objects_scrubbed":2,"log_size":23,"log_dups_size":1000,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:35:05.542600+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":5094,"num_read_kb":4556,"num_write":1418,"num_write_kb":544,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2806,"num_omap_keys":11,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.7","version":"267'189","reported_seq":839,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:06.990334+0000","last_change":"2024-09-14T13:02:06.990334+0000","last_active":"2024-09-14T13:02:06.990334+0000","last_peered":"2024-09-14T13:02:06.990334+0000","last_clean":"2024-09-14T13:02:06.990334+0000","last_became_active":"2024-09-14T11:08:21.797297+0000","last_became_peered":"2024-09-14T11:08:21.797297+0000","last_unstale":"2024-09-14T13:02:06.990334+0000","last_undegraded":"2024-09-14T13:02:06.990334+0000","last_fullsized":"2024-09-14T13:02:06.990334+0000","mapping_epoch":24,"log_start":"267'100","ondisk_log_start":"267'100","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'189","last_scrub_stamp":"2024-09-14T13:02:06.990223+0000","last_deep_scrub":"267'189","last_deep_scrub_stamp":"2024-09-14T13:02:06.990223+0000","last_clean_scrub_stamp":"2024-09-14T13:02:06.990223+0000","objects_scrubbed":5,"log_size":89,"log_dups_size":100,"ondisk_log_size":89,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:27:43.594579+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1655854,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":473,"num_read_kb":20434,"num_write":854,"num_write_kb":40195,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,7],"acting":[3,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":564,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:05.019695+0000","last_change":"2024-09-14T13:02:05.019695+0000","last_active":"2024-09-14T13:02:05.019695+0000","last_peered":"2024-09-14T13:02:05.019695+0000","last_clean":"2024-09-14T13:02:05.019695+0000","last_became_active":"2024-09-14T11:08:08.891458+0000","last_became_peered":"2024-09-14T11:08:08.891458+0000","last_unstale":"2024-09-14T13:02:05.019695+0000","last_undegraded":"2024-09-14T13:02:05.019695+0000","last_fullsized":"2024-09-14T13:02:05.019695+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T13:02:05.019605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T13:02:05.019605+0000","last_clean_scrub_stamp":"2024-09-14T13:02:05.019605+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:50:14.780273+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0011468940000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":535,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:58:53.231411+0000","last_change":"2024-09-14T11:08:25.808446+0000","last_active":"2024-09-14T12:58:53.231411+0000","last_peered":"2024-09-14T12:58:53.231411+0000","last_clean":"2024-09-14T12:58:53.231411+0000","last_became_active":"2024-09-14T11:08:25.807555+0000","last_became_peered":"2024-09-14T11:08:25.807555+0000","last_unstale":"2024-09-14T12:58:53.231411+0000","last_undegraded":"2024-09-14T12:58:53.231411+0000","last_fullsized":"2024-09-14T12:58:53.231411+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:08:24.757170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:08:24.757170+0000","last_clean_scrub_stamp":"2024-09-14T11:08:24.757170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:45:14.993273+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.2","version":"267'172","reported_seq":779,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:59:08.517056+0000","last_change":"2024-09-14T11:08:27.826108+0000","last_active":"2024-09-14T12:59:08.517056+0000","last_peered":"2024-09-14T12:59:08.517056+0000","last_clean":"2024-09-14T12:59:08.517056+0000","last_became_active":"2024-09-14T11:08:27.825292+0000","last_became_peered":"2024-09-14T11:08:27.825292+0000","last_unstale":"2024-09-14T12:59:08.517056+0000","last_undegraded":"2024-09-14T12:59:08.517056+0000","last_fullsized":"2024-09-14T12:59:08.517056+0000","mapping_epoch":30,"log_start":"267'100","ondisk_log_start":"267'100","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:08:26.771628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:08:26.771628+0000","last_clean_scrub_stamp":"2024-09-14T11:08:26.771628+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":100,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:07:03.156677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":226,"num_read_kb":221,"num_write":150,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.3","version":"267'815","reported_seq":5534,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:00.447764+0000","last_change":"2024-09-14T11:08:29.826625+0000","last_active":"2024-09-14T13:02:00.447764+0000","last_peered":"2024-09-14T13:02:00.447764+0000","last_clean":"2024-09-14T13:02:00.447764+0000","last_became_active":"2024-09-14T11:08:29.824268+0000","last_became_peered":"2024-09-14T11:08:29.824268+0000","last_unstale":"2024-09-14T13:02:00.447764+0000","last_undegraded":"2024-09-14T13:02:00.447764+0000","last_fullsized":"2024-09-14T13:02:00.447764+0000","mapping_epoch":32,"log_start":"267'801","ondisk_log_start":"267'801","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:08:28.783586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:08:28.783586+0000","last_clean_scrub_stamp":"2024-09-14T11:08:28.783586+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":801,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:53:34.571934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.c","version":"267'177","reported_seq":726,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:58:48.241226+0000","last_change":"2024-09-14T11:08:31.845141+0000","last_active":"2024-09-14T12:58:48.241226+0000","last_peered":"2024-09-14T12:58:48.241226+0000","last_clean":"2024-09-14T12:58:48.241226+0000","last_became_active":"2024-09-14T11:08:31.844329+0000","last_became_peered":"2024-09-14T11:08:31.844329+0000","last_unstale":"2024-09-14T12:58:48.241226+0000","last_undegraded":"2024-09-14T12:58:48.241226+0000","last_fullsized":"2024-09-14T12:58:48.241226+0000","mapping_epoch":34,"log_start":"267'100","ondisk_log_start":"267'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:08:30.789404+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:08:30.789404+0000","last_clean_scrub_stamp":"2024-09-14T11:08:30.789404+0000","objects_scrubbed":0,"log_size":77,"log_dups_size":100,"ondisk_log_size":77,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:04:50.705908+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":58,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":178,"num_read_kb":162,"num_write":419,"num_write_kb":126,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"267'735","reported_seq":2215,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:09.815280+0000","last_change":"2024-09-14T13:02:09.815280+0000","last_active":"2024-09-14T13:02:09.815280+0000","last_peered":"2024-09-14T13:02:09.815280+0000","last_clean":"2024-09-14T13:02:09.815280+0000","last_became_active":"2024-09-14T11:08:23.800918+0000","last_became_peered":"2024-09-14T11:08:23.800918+0000","last_unstale":"2024-09-14T13:02:09.815280+0000","last_undegraded":"2024-09-14T13:02:09.815280+0000","last_fullsized":"2024-09-14T13:02:09.815280+0000","mapping_epoch":26,"log_start":"267'700","ondisk_log_start":"267'700","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'735","last_scrub_stamp":"2024-09-14T13:02:09.814990+0000","last_deep_scrub":"267'735","last_deep_scrub_stamp":"2024-09-14T13:02:09.814990+0000","last_clean_scrub_stamp":"2024-09-14T13:02:09.814990+0000","objects_scrubbed":3,"log_size":35,"log_dups_size":700,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:05:22.080738+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3552,"num_read_kb":3200,"num_write":979,"num_write_kb":380,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":486,"num_omap_keys":2,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"267'264","reported_seq":972,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:06.104313+0000","last_change":"2024-09-14T13:02:06.104313+0000","last_active":"2024-09-14T13:02:06.104313+0000","last_peered":"2024-09-14T13:02:06.104313+0000","last_clean":"2024-09-14T13:02:06.104313+0000","last_became_active":"2024-09-14T11:08:56.034426+0000","last_became_peered":"2024-09-14T11:08:56.034426+0000","last_unstale":"2024-09-14T13:02:06.104313+0000","last_undegraded":"2024-09-14T13:02:06.104313+0000","last_fullsized":"2024-09-14T13:02:06.104313+0000","mapping_epoch":37,"log_start":"267'200","ondisk_log_start":"267'200","created":24,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'264","last_scrub_stamp":"2024-09-14T13:02:06.104156+0000","last_deep_scrub":"267'264","last_deep_scrub_stamp":"2024-09-14T13:02:06.104156+0000","last_clean_scrub_stamp":"2024-09-14T13:02:06.104156+0000","objects_scrubbed":7,"log_size":64,"log_dups_size":200,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:07:23.324457+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3311697,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":736,"num_read_kb":100890,"num_write":1101,"num_write_kb":33821,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,4],"acting":[2,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":565,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:08.216964+0000","last_change":"2024-09-14T13:02:08.216964+0000","last_active":"2024-09-14T13:02:08.216964+0000","last_peered":"2024-09-14T13:02:08.216964+0000","last_clean":"2024-09-14T13:02:08.216964+0000","last_became_active":"2024-09-14T11:08:08.905736+0000","last_became_peered":"2024-09-14T11:08:08.905736+0000","last_unstale":"2024-09-14T13:02:08.216964+0000","last_undegraded":"2024-09-14T13:02:08.216964+0000","last_fullsized":"2024-09-14T13:02:08.216964+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T13:02:08.216677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T13:02:08.216677+0000","last_clean_scrub_stamp":"2024-09-14T13:02:08.216677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:51:29.945091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0012835290000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":535,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:58:48.463988+0000","last_change":"2024-09-14T11:08:25.803022+0000","last_active":"2024-09-14T12:58:48.463988+0000","last_peered":"2024-09-14T12:58:48.463988+0000","last_clean":"2024-09-14T12:58:48.463988+0000","last_became_active":"2024-09-14T11:08:25.801554+0000","last_became_peered":"2024-09-14T11:08:25.801554+0000","last_unstale":"2024-09-14T12:58:48.463988+0000","last_undegraded":"2024-09-14T12:58:48.463988+0000","last_fullsized":"2024-09-14T12:58:48.463988+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:08:24.757170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:08:24.757170+0000","last_clean_scrub_stamp":"2024-09-14T11:08:24.757170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:30:31.481284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"267'404","reported_seq":1193,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:00.443695+0000","last_change":"2024-09-14T11:08:27.836312+0000","last_active":"2024-09-14T13:02:00.443695+0000","last_peered":"2024-09-14T13:02:00.443695+0000","last_clean":"2024-09-14T13:02:00.443695+0000","last_became_active":"2024-09-14T11:08:27.831653+0000","last_became_peered":"2024-09-14T11:08:27.831653+0000","last_unstale":"2024-09-14T13:02:00.443695+0000","last_undegraded":"2024-09-14T13:02:00.443695+0000","last_fullsized":"2024-09-14T13:02:00.443695+0000","mapping_epoch":30,"log_start":"267'300","ondisk_log_start":"267'300","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:08:26.771628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:08:26.771628+0000","last_clean_scrub_stamp":"2024-09-14T11:08:26.771628+0000","objects_scrubbed":0,"log_size":104,"log_dups_size":300,"ondisk_log_size":104,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:26:55.360414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":31170,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":610,"num_read_kb":890,"num_write":340,"num_write_kb":94,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":525,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:58:58.466673+0000","last_change":"2024-09-14T11:08:29.826424+0000","last_active":"2024-09-14T12:58:58.466673+0000","last_peered":"2024-09-14T12:58:58.466673+0000","last_clean":"2024-09-14T12:58:58.466673+0000","last_became_active":"2024-09-14T11:08:29.825186+0000","last_became_peered":"2024-09-14T11:08:29.825186+0000","last_unstale":"2024-09-14T12:58:58.466673+0000","last_undegraded":"2024-09-14T12:58:58.466673+0000","last_fullsized":"2024-09-14T12:58:58.466673+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:08:28.783586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:08:28.783586+0000","last_clean_scrub_stamp":"2024-09-14T11:08:28.783586+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:49:23.866313+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.d","version":"267'138","reported_seq":663,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:58:48.045619+0000","last_change":"2024-09-14T11:08:31.838408+0000","last_active":"2024-09-14T12:58:48.045619+0000","last_peered":"2024-09-14T12:58:48.045619+0000","last_clean":"2024-09-14T12:58:48.045619+0000","last_became_active":"2024-09-14T11:08:31.837649+0000","last_became_peered":"2024-09-14T11:08:31.837649+0000","last_unstale":"2024-09-14T12:58:48.045619+0000","last_undegraded":"2024-09-14T12:58:48.045619+0000","last_fullsized":"2024-09-14T12:58:48.045619+0000","mapping_epoch":34,"log_start":"267'100","ondisk_log_start":"267'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:08:30.789404+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:08:30.789404+0000","last_clean_scrub_stamp":"2024-09-14T11:08:30.789404+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":100,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:22:41.759152+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":204,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":124,"num_read_kb":124,"num_write":321,"num_write_kb":75,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.1f","version":"267'141","reported_seq":733,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:00:21.741622+0000","last_change":"2024-09-14T11:08:31.854083+0000","last_active":"2024-09-14T13:00:21.741622+0000","last_peered":"2024-09-14T13:00:21.741622+0000","last_clean":"2024-09-14T13:00:21.741622+0000","last_became_active":"2024-09-14T11:08:31.849681+0000","last_became_peered":"2024-09-14T11:08:31.849681+0000","last_unstale":"2024-09-14T13:00:21.741622+0000","last_undegraded":"2024-09-14T13:00:21.741622+0000","last_fullsized":"2024-09-14T13:00:21.741622+0000","mapping_epoch":34,"log_start":"267'100","ondisk_log_start":"267'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:08:30.789404+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:08:30.789404+0000","last_clean_scrub_stamp":"2024-09-14T11:08:30.789404+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":100,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:48:25.310770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":202,"num_read_kb":202,"num_write":327,"num_write_kb":74,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.13","version":"267'451","reported_seq":2158,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:15.812885+0000","last_change":"2024-09-14T13:02:15.812885+0000","last_active":"2024-09-14T13:02:15.812885+0000","last_peered":"2024-09-14T13:02:15.812885+0000","last_clean":"2024-09-14T13:02:15.812885+0000","last_became_active":"2024-09-14T11:08:23.806746+0000","last_became_peered":"2024-09-14T11:08:23.806746+0000","last_unstale":"2024-09-14T13:02:15.812885+0000","last_undegraded":"2024-09-14T13:02:15.812885+0000","last_fullsized":"2024-09-14T13:02:15.812885+0000","mapping_epoch":26,"log_start":"267'400","ondisk_log_start":"267'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'451","last_scrub_stamp":"2024-09-14T13:02:15.812664+0000","last_deep_scrub":"267'451","last_deep_scrub_stamp":"2024-09-14T13:02:15.812664+0000","last_clean_scrub_stamp":"2024-09-14T13:02:15.812664+0000","objects_scrubbed":1,"log_size":51,"log_dups_size":400,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:52:30.280885+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2482,"num_read_kb":2367,"num_write":499,"num_write_kb":86,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.14","version":"267'194","reported_seq":825,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:09.119934+0000","last_change":"2024-09-14T13:02:09.119934+0000","last_active":"2024-09-14T13:02:09.119934+0000","last_peered":"2024-09-14T13:02:09.119934+0000","last_clean":"2024-09-14T13:02:09.119934+0000","last_became_active":"2024-09-14T11:08:56.028924+0000","last_became_peered":"2024-09-14T11:08:56.028924+0000","last_unstale":"2024-09-14T13:02:09.119934+0000","last_undegraded":"2024-09-14T13:02:09.119934+0000","last_fullsized":"2024-09-14T13:02:09.119934+0000","mapping_epoch":37,"log_start":"267'100","ondisk_log_start":"267'100","created":24,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'194","last_scrub_stamp":"2024-09-14T13:02:09.119711+0000","last_deep_scrub":"267'194","last_deep_scrub_stamp":"2024-09-14T13:02:09.119711+0000","last_clean_scrub_stamp":"2024-09-14T13:02:09.119711+0000","objects_scrubbed":2,"log_size":94,"log_dups_size":100,"ondisk_log_size":94,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:09:44.743814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":18,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":488,"num_read_kb":9162,"num_write":891,"num_write_kb":17219,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7,6],"acting":[2,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":533,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:20.978556+0000","last_change":"2024-09-14T13:02:20.978556+0000","last_active":"2024-09-14T13:02:20.978556+0000","last_peered":"2024-09-14T13:02:20.978556+0000","last_clean":"2024-09-14T13:02:20.978556+0000","last_became_active":"2024-09-14T11:08:25.806778+0000","last_became_peered":"2024-09-14T11:08:25.806778+0000","last_unstale":"2024-09-14T13:02:20.978556+0000","last_undegraded":"2024-09-14T13:02:20.978556+0000","last_fullsized":"2024-09-14T13:02:20.978556+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T13:02:20.978330+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T13:02:20.978330+0000","last_clean_scrub_stamp":"2024-09-14T13:02:20.978330+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:00:46.172903+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.11","version":"267'193","reported_seq":825,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:00.171900+0000","last_change":"2024-09-14T11:08:27.803446+0000","last_active":"2024-09-14T13:02:00.171900+0000","last_peered":"2024-09-14T13:02:00.171900+0000","last_clean":"2024-09-14T13:02:00.171900+0000","last_became_active":"2024-09-14T11:08:27.802742+0000","last_became_peered":"2024-09-14T11:08:27.802742+0000","last_unstale":"2024-09-14T13:02:00.171900+0000","last_undegraded":"2024-09-14T13:02:00.171900+0000","last_fullsized":"2024-09-14T13:02:00.171900+0000","mapping_epoch":30,"log_start":"264'100","ondisk_log_start":"264'100","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:08:26.771628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:08:26.771628+0000","last_clean_scrub_stamp":"2024-09-14T11:08:26.771628+0000","objects_scrubbed":0,"log_size":93,"log_dups_size":100,"ondisk_log_size":93,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:28:41.473997+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":14583,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":266,"num_read_kb":357,"num_write":152,"num_write_kb":28,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":519,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:58:13.455830+0000","last_change":"2024-09-14T11:08:29.833602+0000","last_active":"2024-09-14T12:58:13.455830+0000","last_peered":"2024-09-14T12:58:13.455830+0000","last_clean":"2024-09-14T12:58:13.455830+0000","last_became_active":"2024-09-14T11:08:29.832866+0000","last_became_peered":"2024-09-14T11:08:29.832866+0000","last_unstale":"2024-09-14T12:58:13.455830+0000","last_undegraded":"2024-09-14T12:58:13.455830+0000","last_fullsized":"2024-09-14T12:58:13.455830+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:08:28.783586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:08:28.783586+0000","last_clean_scrub_stamp":"2024-09-14T11:08:28.783586+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:47:19.171157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1e","version":"267'153","reported_seq":732,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:00:21.213723+0000","last_change":"2024-09-14T11:08:31.838160+0000","last_active":"2024-09-14T13:00:21.213723+0000","last_peered":"2024-09-14T13:00:21.213723+0000","last_clean":"2024-09-14T13:00:21.213723+0000","last_became_active":"2024-09-14T11:08:31.837431+0000","last_became_peered":"2024-09-14T11:08:31.837431+0000","last_unstale":"2024-09-14T13:00:21.213723+0000","last_undegraded":"2024-09-14T13:00:21.213723+0000","last_fullsized":"2024-09-14T13:00:21.213723+0000","mapping_epoch":34,"log_start":"267'100","ondisk_log_start":"267'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:08:30.789404+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:08:30.789404+0000","last_clean_scrub_stamp":"2024-09-14T11:08:30.789404+0000","objects_scrubbed":0,"log_size":53,"log_dups_size":100,"ondisk_log_size":53,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:03:00.723612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":449,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":316,"num_read_kb":262,"num_write":344,"num_write_kb":81,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.12","version":"267'845","reported_seq":2498,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:17.106870+0000","last_change":"2024-09-14T13:02:17.106870+0000","last_active":"2024-09-14T13:02:17.106870+0000","last_peered":"2024-09-14T13:02:17.106870+0000","last_clean":"2024-09-14T13:02:17.106870+0000","last_became_active":"2024-09-14T11:08:23.805773+0000","last_became_peered":"2024-09-14T11:08:23.805773+0000","last_unstale":"2024-09-14T13:02:17.106870+0000","last_undegraded":"2024-09-14T13:02:17.106870+0000","last_fullsized":"2024-09-14T13:02:17.106870+0000","mapping_epoch":26,"log_start":"267'800","ondisk_log_start":"267'800","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'845","last_scrub_stamp":"2024-09-14T13:02:17.106695+0000","last_deep_scrub":"267'845","last_deep_scrub_stamp":"2024-09-14T13:02:17.106695+0000","last_clean_scrub_stamp":"2024-09-14T13:02:17.106695+0000","objects_scrubbed":3,"log_size":45,"log_dups_size":800,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:00:08.155637+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":4345,"num_read_kb":3935,"num_write":1136,"num_write_kb":447,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2810,"num_omap_keys":11,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"267'286","reported_seq":1007,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:14.595357+0000","last_change":"2024-09-14T13:02:14.595357+0000","last_active":"2024-09-14T13:02:14.595357+0000","last_peered":"2024-09-14T13:02:14.595357+0000","last_clean":"2024-09-14T13:02:14.595357+0000","last_became_active":"2024-09-14T11:08:21.829412+0000","last_became_peered":"2024-09-14T11:08:21.829412+0000","last_unstale":"2024-09-14T13:02:14.595357+0000","last_undegraded":"2024-09-14T13:02:14.595357+0000","last_fullsized":"2024-09-14T13:02:14.595357+0000","mapping_epoch":24,"log_start":"267'200","ondisk_log_start":"267'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'286","last_scrub_stamp":"2024-09-14T13:02:14.595126+0000","last_deep_scrub":"267'286","last_deep_scrub_stamp":"2024-09-14T13:02:14.595126+0000","last_clean_scrub_stamp":"2024-09-14T13:02:14.595126+0000","objects_scrubbed":3,"log_size":86,"log_dups_size":200,"ondisk_log_size":86,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T00:09:31.251389+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":54,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":846,"num_read_kb":41720,"num_write":1221,"num_write_kb":52852,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,6],"acting":[7,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":527,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:58:08.454944+0000","last_change":"2024-09-14T11:08:25.800314+0000","last_active":"2024-09-14T12:58:08.454944+0000","last_peered":"2024-09-14T12:58:08.454944+0000","last_clean":"2024-09-14T12:58:08.454944+0000","last_became_active":"2024-09-14T11:08:25.799473+0000","last_became_peered":"2024-09-14T11:08:25.799473+0000","last_unstale":"2024-09-14T12:58:08.454944+0000","last_undegraded":"2024-09-14T12:58:08.454944+0000","last_fullsized":"2024-09-14T12:58:08.454944+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:08:24.757170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:08:24.757170+0000","last_clean_scrub_stamp":"2024-09-14T11:08:24.757170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:39:41.634975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"267'93","reported_seq":645,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:59:05.331375+0000","last_change":"2024-09-14T11:08:27.824140+0000","last_active":"2024-09-14T12:59:05.331375+0000","last_peered":"2024-09-14T12:59:05.331375+0000","last_clean":"2024-09-14T12:59:05.331375+0000","last_became_active":"2024-09-14T11:08:27.822933+0000","last_became_peered":"2024-09-14T11:08:27.822933+0000","last_unstale":"2024-09-14T12:59:05.331375+0000","last_undegraded":"2024-09-14T12:59:05.331375+0000","last_fullsized":"2024-09-14T12:59:05.331375+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:08:26.771628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:08:26.771628+0000","last_clean_scrub_stamp":"2024-09-14T11:08:26.771628+0000","objects_scrubbed":0,"log_size":93,"log_dups_size":0,"ondisk_log_size":93,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:18:09.511324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":83,"num_read_kb":77,"num_write":62,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":520,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:58:12.827302+0000","last_change":"2024-09-14T11:08:29.839496+0000","last_active":"2024-09-14T12:58:12.827302+0000","last_peered":"2024-09-14T12:58:12.827302+0000","last_clean":"2024-09-14T12:58:12.827302+0000","last_became_active":"2024-09-14T11:08:29.838784+0000","last_became_peered":"2024-09-14T11:08:29.838784+0000","last_unstale":"2024-09-14T12:58:12.827302+0000","last_undegraded":"2024-09-14T12:58:12.827302+0000","last_fullsized":"2024-09-14T12:58:12.827302+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:08:28.783586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:08:28.783586+0000","last_clean_scrub_stamp":"2024-09-14T11:08:28.783586+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:24:04.303207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1d","version":"267'173","reported_seq":722,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:00:18.909877+0000","last_change":"2024-09-14T11:08:31.835747+0000","last_active":"2024-09-14T13:00:18.909877+0000","last_peered":"2024-09-14T13:00:18.909877+0000","last_clean":"2024-09-14T13:00:18.909877+0000","last_became_active":"2024-09-14T11:08:31.835061+0000","last_became_peered":"2024-09-14T11:08:31.835061+0000","last_unstale":"2024-09-14T13:00:18.909877+0000","last_undegraded":"2024-09-14T13:00:18.909877+0000","last_fullsized":"2024-09-14T13:00:18.909877+0000","mapping_epoch":34,"log_start":"267'100","ondisk_log_start":"267'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:08:30.789404+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:08:30.789404+0000","last_clean_scrub_stamp":"2024-09-14T11:08:30.789404+0000","objects_scrubbed":0,"log_size":73,"log_dups_size":100,"ondisk_log_size":73,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:44:11.300438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":257,"num_read_kb":254,"num_write":377,"num_write_kb":108,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"267'375","reported_seq":1949,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:16.881362+0000","last_change":"2024-09-14T13:02:16.881362+0000","last_active":"2024-09-14T13:02:16.881362+0000","last_peered":"2024-09-14T13:02:16.881362+0000","last_clean":"2024-09-14T13:02:16.881362+0000","last_became_active":"2024-09-14T11:08:23.803793+0000","last_became_peered":"2024-09-14T11:08:23.803793+0000","last_unstale":"2024-09-14T13:02:16.881362+0000","last_undegraded":"2024-09-14T13:02:16.881362+0000","last_fullsized":"2024-09-14T13:02:16.881362+0000","mapping_epoch":26,"log_start":"267'300","ondisk_log_start":"267'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'375","last_scrub_stamp":"2024-09-14T13:02:16.881154+0000","last_deep_scrub":"267'375","last_deep_scrub_stamp":"2024-09-14T13:02:16.881154+0000","last_clean_scrub_stamp":"2024-09-14T13:02:16.881154+0000","objects_scrubbed":4,"log_size":75,"log_dups_size":300,"ondisk_log_size":75,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:09:51.952201+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":2158,"num_read_kb":2067,"num_write":426,"num_write_kb":77,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"267'203","reported_seq":861,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:08.282770+0000","last_change":"2024-09-14T13:02:08.282770+0000","last_active":"2024-09-14T13:02:08.282770+0000","last_peered":"2024-09-14T13:02:08.282770+0000","last_clean":"2024-09-14T13:02:08.282770+0000","last_became_active":"2024-09-14T11:08:21.796544+0000","last_became_peered":"2024-09-14T11:08:21.796544+0000","last_unstale":"2024-09-14T13:02:08.282770+0000","last_undegraded":"2024-09-14T13:02:08.282770+0000","last_fullsized":"2024-09-14T13:02:08.282770+0000","mapping_epoch":24,"log_start":"267'100","ondisk_log_start":"267'100","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'203","last_scrub_stamp":"2024-09-14T13:02:08.282561+0000","last_deep_scrub":"267'203","last_deep_scrub_stamp":"2024-09-14T13:02:08.282561+0000","last_clean_scrub_stamp":"2024-09-14T13:02:08.282561+0000","objects_scrubbed":1,"log_size":103,"log_dups_size":100,"ondisk_log_size":103,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:48:38.983992+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":13,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":507,"num_read_kb":19523,"num_write":848,"num_write_kb":34711,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,1],"acting":[5,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":528,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:58:07.825909+0000","last_change":"2024-09-14T11:08:25.812807+0000","last_active":"2024-09-14T12:58:07.825909+0000","last_peered":"2024-09-14T12:58:07.825909+0000","last_clean":"2024-09-14T12:58:07.825909+0000","last_became_active":"2024-09-14T11:08:25.812065+0000","last_became_peered":"2024-09-14T11:08:25.812065+0000","last_unstale":"2024-09-14T12:58:07.825909+0000","last_undegraded":"2024-09-14T12:58:07.825909+0000","last_fullsized":"2024-09-14T12:58:07.825909+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:08:24.757170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:08:24.757170+0000","last_clean_scrub_stamp":"2024-09-14T11:08:24.757170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:55:26.884251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.13","version":"267'225","reported_seq":873,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:00.461643+0000","last_change":"2024-09-14T11:08:27.804649+0000","last_active":"2024-09-14T13:02:00.461643+0000","last_peered":"2024-09-14T13:02:00.461643+0000","last_clean":"2024-09-14T13:02:00.461643+0000","last_became_active":"2024-09-14T11:08:27.803857+0000","last_became_peered":"2024-09-14T11:08:27.803857+0000","last_unstale":"2024-09-14T13:02:00.461643+0000","last_undegraded":"2024-09-14T13:02:00.461643+0000","last_fullsized":"2024-09-14T13:02:00.461643+0000","mapping_epoch":30,"log_start":"267'200","ondisk_log_start":"267'200","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:08:26.771628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:08:26.771628+0000","last_clean_scrub_stamp":"2024-09-14T11:08:26.771628+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":200,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:04:38.254088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":20297,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":321,"num_read_kb":447,"num_write":190,"num_write_kb":46,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":518,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:58:13.419845+0000","last_change":"2024-09-14T11:08:29.831255+0000","last_active":"2024-09-14T12:58:13.419845+0000","last_peered":"2024-09-14T12:58:13.419845+0000","last_clean":"2024-09-14T12:58:13.419845+0000","last_became_active":"2024-09-14T11:08:29.830498+0000","last_became_peered":"2024-09-14T11:08:29.830498+0000","last_unstale":"2024-09-14T12:58:13.419845+0000","last_undegraded":"2024-09-14T12:58:13.419845+0000","last_fullsized":"2024-09-14T12:58:13.419845+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:08:28.783586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:08:28.783586+0000","last_clean_scrub_stamp":"2024-09-14T11:08:28.783586+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:03:30.379314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.1c","version":"267'123","reported_seq":663,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:00:18.860887+0000","last_change":"2024-09-14T11:08:31.830626+0000","last_active":"2024-09-14T13:00:18.860887+0000","last_peered":"2024-09-14T13:00:18.860887+0000","last_clean":"2024-09-14T13:00:18.860887+0000","last_became_active":"2024-09-14T11:08:31.829826+0000","last_became_peered":"2024-09-14T11:08:31.829826+0000","last_unstale":"2024-09-14T13:00:18.860887+0000","last_undegraded":"2024-09-14T13:00:18.860887+0000","last_fullsized":"2024-09-14T13:00:18.860887+0000","mapping_epoch":34,"log_start":"267'100","ondisk_log_start":"267'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:08:30.789404+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:08:30.789404+0000","last_clean_scrub_stamp":"2024-09-14T11:08:30.789404+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":100,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:25:54.911452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":861,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":146,"num_read_kb":140,"num_write":284,"num_write_kb":67,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"267'867","reported_seq":2541,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:15.874501+0000","last_change":"2024-09-14T13:02:15.874501+0000","last_active":"2024-09-14T13:02:15.874501+0000","last_peered":"2024-09-14T13:02:15.874501+0000","last_clean":"2024-09-14T13:02:15.874501+0000","last_became_active":"2024-09-14T11:08:23.781565+0000","last_became_peered":"2024-09-14T11:08:23.781565+0000","last_unstale":"2024-09-14T13:02:15.874501+0000","last_undegraded":"2024-09-14T13:02:15.874501+0000","last_fullsized":"2024-09-14T13:02:15.874501+0000","mapping_epoch":26,"log_start":"267'800","ondisk_log_start":"267'800","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'867","last_scrub_stamp":"2024-09-14T13:02:15.874297+0000","last_deep_scrub":"267'867","last_deep_scrub_stamp":"2024-09-14T13:02:15.874297+0000","last_clean_scrub_stamp":"2024-09-14T13:02:15.874297+0000","objects_scrubbed":2,"log_size":67,"log_dups_size":800,"ondisk_log_size":67,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:44:25.802335+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":4353,"num_read_kb":3923,"num_write":1159,"num_write_kb":442,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1857,"num_omap_keys":8,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"267'273","reported_seq":958,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:09.085166+0000","last_change":"2024-09-14T13:02:09.085166+0000","last_active":"2024-09-14T13:02:09.085166+0000","last_peered":"2024-09-14T13:02:09.085166+0000","last_clean":"2024-09-14T13:02:09.085166+0000","last_became_active":"2024-09-14T11:08:21.780624+0000","last_became_peered":"2024-09-14T11:08:21.780624+0000","last_unstale":"2024-09-14T13:02:09.085166+0000","last_undegraded":"2024-09-14T13:02:09.085166+0000","last_fullsized":"2024-09-14T13:02:09.085166+0000","mapping_epoch":24,"log_start":"267'200","ondisk_log_start":"267'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'273","last_scrub_stamp":"2024-09-14T13:02:09.084972+0000","last_deep_scrub":"267'273","last_deep_scrub_stamp":"2024-09-14T13:02:09.084972+0000","last_clean_scrub_stamp":"2024-09-14T13:02:09.084972+0000","objects_scrubbed":1,"log_size":73,"log_dups_size":200,"ondisk_log_size":73,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:52:41.240236+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":15,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":687,"num_read_kb":19614,"num_write":1225,"num_write_kb":48256,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,3],"acting":[0,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":534,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:19.319030+0000","last_change":"2024-09-14T13:02:19.319030+0000","last_active":"2024-09-14T13:02:19.319030+0000","last_peered":"2024-09-14T13:02:19.319030+0000","last_clean":"2024-09-14T13:02:19.319030+0000","last_became_active":"2024-09-14T11:08:25.812705+0000","last_became_peered":"2024-09-14T11:08:25.812705+0000","last_unstale":"2024-09-14T13:02:19.319030+0000","last_undegraded":"2024-09-14T13:02:19.319030+0000","last_fullsized":"2024-09-14T13:02:19.319030+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T13:02:19.318859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T13:02:19.318859+0000","last_clean_scrub_stamp":"2024-09-14T13:02:19.318859+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:53:09.845136+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.12","version":"267'169","reported_seq":790,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:00.421357+0000","last_change":"2024-09-14T11:08:27.828831+0000","last_active":"2024-09-14T13:02:00.421357+0000","last_peered":"2024-09-14T13:02:00.421357+0000","last_clean":"2024-09-14T13:02:00.421357+0000","last_became_active":"2024-09-14T11:08:27.828095+0000","last_became_peered":"2024-09-14T11:08:27.828095+0000","last_unstale":"2024-09-14T13:02:00.421357+0000","last_undegraded":"2024-09-14T13:02:00.421357+0000","last_fullsized":"2024-09-14T13:02:00.421357+0000","mapping_epoch":30,"log_start":"267'100","ondisk_log_start":"267'100","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:08:26.771628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:08:26.771628+0000","last_clean_scrub_stamp":"2024-09-14T11:08:26.771628+0000","objects_scrubbed":0,"log_size":69,"log_dups_size":100,"ondisk_log_size":69,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:20:07.611701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8744,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":225,"num_read_kb":285,"num_write":126,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":524,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:58:13.451397+0000","last_change":"2024-09-14T11:08:29.820892+0000","last_active":"2024-09-14T12:58:13.451397+0000","last_peered":"2024-09-14T12:58:13.451397+0000","last_clean":"2024-09-14T12:58:13.451397+0000","last_became_active":"2024-09-14T11:08:29.820211+0000","last_became_peered":"2024-09-14T11:08:29.820211+0000","last_unstale":"2024-09-14T12:58:13.451397+0000","last_undegraded":"2024-09-14T12:58:13.451397+0000","last_fullsized":"2024-09-14T12:58:13.451397+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:08:28.783586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:08:28.783586+0000","last_clean_scrub_stamp":"2024-09-14T11:08:28.783586+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:44:35.393022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"267'408","reported_seq":1924,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:22.324486+0000","last_change":"2024-09-14T13:02:22.324486+0000","last_active":"2024-09-14T13:02:22.324486+0000","last_peered":"2024-09-14T13:02:22.324486+0000","last_clean":"2024-09-14T13:02:22.324486+0000","last_became_active":"2024-09-14T11:08:23.812148+0000","last_became_peered":"2024-09-14T11:08:23.812148+0000","last_unstale":"2024-09-14T13:02:22.324486+0000","last_undegraded":"2024-09-14T13:02:22.324486+0000","last_fullsized":"2024-09-14T13:02:22.324486+0000","mapping_epoch":26,"log_start":"267'300","ondisk_log_start":"267'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'408","last_scrub_stamp":"2024-09-14T13:02:22.324302+0000","last_deep_scrub":"267'408","last_deep_scrub_stamp":"2024-09-14T13:02:22.324302+0000","last_clean_scrub_stamp":"2024-09-14T13:02:22.324302+0000","objects_scrubbed":1,"log_size":108,"log_dups_size":300,"ondisk_log_size":108,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:43:05.653161+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2189,"num_read_kb":2068,"num_write":470,"num_write_kb":97,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"267'247","reported_seq":1151,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:08.983777+0000","last_change":"2024-09-14T13:02:08.983777+0000","last_active":"2024-09-14T13:02:08.983777+0000","last_peered":"2024-09-14T13:02:08.983777+0000","last_clean":"2024-09-14T13:02:08.983777+0000","last_became_active":"2024-09-14T11:08:21.778733+0000","last_became_peered":"2024-09-14T11:08:21.778733+0000","last_unstale":"2024-09-14T13:02:08.983777+0000","last_undegraded":"2024-09-14T13:02:08.983777+0000","last_fullsized":"2024-09-14T13:02:08.983777+0000","mapping_epoch":24,"log_start":"267'200","ondisk_log_start":"267'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'247","last_scrub_stamp":"2024-09-14T13:02:08.983565+0000","last_deep_scrub":"267'247","last_deep_scrub_stamp":"2024-09-14T13:02:08.983565+0000","last_clean_scrub_stamp":"2024-09-14T13:02:08.983565+0000","objects_scrubbed":1,"log_size":47,"log_dups_size":200,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:53:58.902570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1357,"num_read_kb":10917,"num_write":1157,"num_write_kb":41642,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":540,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:58:53.242713+0000","last_change":"2024-09-14T11:08:25.800737+0000","last_active":"2024-09-14T12:58:53.242713+0000","last_peered":"2024-09-14T12:58:53.242713+0000","last_clean":"2024-09-14T12:58:53.242713+0000","last_became_active":"2024-09-14T11:08:25.799108+0000","last_became_peered":"2024-09-14T11:08:25.799108+0000","last_unstale":"2024-09-14T12:58:53.242713+0000","last_undegraded":"2024-09-14T12:58:53.242713+0000","last_fullsized":"2024-09-14T12:58:53.242713+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:08:24.757170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:08:24.757170+0000","last_clean_scrub_stamp":"2024-09-14T11:08:24.757170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:38:33.841462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1d","version":"267'252","reported_seq":927,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:00.409214+0000","last_change":"2024-09-14T11:08:27.831458+0000","last_active":"2024-09-14T13:02:00.409214+0000","last_peered":"2024-09-14T13:02:00.409214+0000","last_clean":"2024-09-14T13:02:00.409214+0000","last_became_active":"2024-09-14T11:08:27.830985+0000","last_became_peered":"2024-09-14T11:08:27.830985+0000","last_unstale":"2024-09-14T13:02:00.409214+0000","last_undegraded":"2024-09-14T13:02:00.409214+0000","last_fullsized":"2024-09-14T13:02:00.409214+0000","mapping_epoch":30,"log_start":"267'200","ondisk_log_start":"267'200","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:08:26.771628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:08:26.771628+0000","last_clean_scrub_stamp":"2024-09-14T11:08:26.771628+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":200,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:41:33.796426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":23445,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":387,"num_read_kb":588,"num_write":256,"num_write_kb":158,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":516,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:58:33.042183+0000","last_change":"2024-09-14T11:08:29.835460+0000","last_active":"2024-09-14T12:58:33.042183+0000","last_peered":"2024-09-14T12:58:33.042183+0000","last_clean":"2024-09-14T12:58:33.042183+0000","last_became_active":"2024-09-14T11:08:29.834723+0000","last_became_peered":"2024-09-14T11:08:29.834723+0000","last_unstale":"2024-09-14T12:58:33.042183+0000","last_undegraded":"2024-09-14T12:58:33.042183+0000","last_fullsized":"2024-09-14T12:58:33.042183+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:08:28.783586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:08:28.783586+0000","last_clean_scrub_stamp":"2024-09-14T11:08:28.783586+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:14:47.793017+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.13","version":"267'169","reported_seq":705,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:00:21.576865+0000","last_change":"2024-09-14T11:08:31.838236+0000","last_active":"2024-09-14T13:00:21.576865+0000","last_peered":"2024-09-14T13:00:21.576865+0000","last_clean":"2024-09-14T13:00:21.576865+0000","last_became_active":"2024-09-14T11:08:31.832337+0000","last_became_peered":"2024-09-14T11:08:31.832337+0000","last_unstale":"2024-09-14T13:00:21.576865+0000","last_undegraded":"2024-09-14T13:00:21.576865+0000","last_fullsized":"2024-09-14T13:00:21.576865+0000","mapping_epoch":34,"log_start":"267'100","ondisk_log_start":"267'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:08:30.789404+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:08:30.789404+0000","last_clean_scrub_stamp":"2024-09-14T11:08:30.789404+0000","objects_scrubbed":0,"log_size":69,"log_dups_size":100,"ondisk_log_size":69,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:59:18.877729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":643,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":222,"num_read_kb":226,"num_write":392,"num_write_kb":102,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"267'413","reported_seq":2039,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:20.023797+0000","last_change":"2024-09-14T13:02:20.023797+0000","last_active":"2024-09-14T13:02:20.023797+0000","last_peered":"2024-09-14T13:02:20.023797+0000","last_clean":"2024-09-14T13:02:20.023797+0000","last_became_active":"2024-09-14T11:08:23.800615+0000","last_became_peered":"2024-09-14T11:08:23.800615+0000","last_unstale":"2024-09-14T13:02:20.023797+0000","last_undegraded":"2024-09-14T13:02:20.023797+0000","last_fullsized":"2024-09-14T13:02:20.023797+0000","mapping_epoch":26,"log_start":"267'400","ondisk_log_start":"267'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'413","last_scrub_stamp":"2024-09-14T13:02:20.023496+0000","last_deep_scrub":"267'413","last_deep_scrub_stamp":"2024-09-14T13:02:20.023496+0000","last_clean_scrub_stamp":"2024-09-14T13:02:20.023496+0000","objects_scrubbed":1,"log_size":13,"log_dups_size":400,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:35:57.669124+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2239,"num_read_kb":2142,"num_write":466,"num_write_kb":81,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":254,"num_omap_keys":1,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"267'242","reported_seq":929,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:08.020604+0000","last_change":"2024-09-14T13:02:08.020474+0000","last_active":"2024-09-14T13:02:08.020604+0000","last_peered":"2024-09-14T13:02:08.020604+0000","last_clean":"2024-09-14T13:02:08.020604+0000","last_became_active":"2024-09-14T11:08:56.036673+0000","last_became_peered":"2024-09-14T11:08:56.036673+0000","last_unstale":"2024-09-14T13:02:08.020604+0000","last_undegraded":"2024-09-14T13:02:08.020604+0000","last_fullsized":"2024-09-14T13:02:08.020604+0000","mapping_epoch":37,"log_start":"267'200","ondisk_log_start":"267'200","created":24,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'242","last_scrub_stamp":"2024-09-14T13:02:08.020270+0000","last_deep_scrub":"267'242","last_deep_scrub_stamp":"2024-09-14T13:02:08.020270+0000","last_clean_scrub_stamp":"2024-09-14T13:02:08.020270+0000","objects_scrubbed":4,"log_size":42,"log_dups_size":200,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:26:39.664742+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":60,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":566,"num_read_kb":38876,"num_write":1051,"num_write_kb":52722,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,4],"acting":[1,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1f","version":"267'4","reported_seq":1018,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:23.337823+0000","last_change":"2024-09-14T13:02:23.337823+0000","last_active":"2024-09-14T13:02:23.337823+0000","last_peered":"2024-09-14T13:02:23.337823+0000","last_clean":"2024-09-14T13:02:23.337823+0000","last_became_active":"2024-09-14T11:08:25.812070+0000","last_became_peered":"2024-09-14T11:08:25.812070+0000","last_unstale":"2024-09-14T13:02:23.337823+0000","last_undegraded":"2024-09-14T13:02:23.337823+0000","last_fullsized":"2024-09-14T13:02:23.337823+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'4","last_scrub_stamp":"2024-09-14T13:02:23.337638+0000","last_deep_scrub":"267'4","last_deep_scrub_stamp":"2024-09-14T13:02:23.337638+0000","last_clean_scrub_stamp":"2024-09-14T13:02:23.337638+0000","objects_scrubbed":1,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:25:52.234244+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":470,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":719,"num_read_kb":717,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1c","version":"267'282","reported_seq":936,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:00.428365+0000","last_change":"2024-09-14T11:08:27.839908+0000","last_active":"2024-09-14T13:02:00.428365+0000","last_peered":"2024-09-14T13:02:00.428365+0000","last_clean":"2024-09-14T13:02:00.428365+0000","last_became_active":"2024-09-14T11:08:27.839087+0000","last_became_peered":"2024-09-14T11:08:27.839087+0000","last_unstale":"2024-09-14T13:02:00.428365+0000","last_undegraded":"2024-09-14T13:02:00.428365+0000","last_fullsized":"2024-09-14T13:02:00.428365+0000","mapping_epoch":30,"log_start":"267'200","ondisk_log_start":"267'200","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:08:26.771628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:08:26.771628+0000","last_clean_scrub_stamp":"2024-09-14T11:08:26.771628+0000","objects_scrubbed":0,"log_size":82,"log_dups_size":200,"ondisk_log_size":82,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:00:36.558492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":105157,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":431,"num_read_kb":790,"num_write":316,"num_write_kb":215,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":514,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:58:33.459006+0000","last_change":"2024-09-14T11:08:29.829340+0000","last_active":"2024-09-14T12:58:33.459006+0000","last_peered":"2024-09-14T12:58:33.459006+0000","last_clean":"2024-09-14T12:58:33.459006+0000","last_became_active":"2024-09-14T11:08:29.828451+0000","last_became_peered":"2024-09-14T11:08:29.828451+0000","last_unstale":"2024-09-14T12:58:33.459006+0000","last_undegraded":"2024-09-14T12:58:33.459006+0000","last_fullsized":"2024-09-14T12:58:33.459006+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:08:28.783586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:08:28.783586+0000","last_clean_scrub_stamp":"2024-09-14T11:08:28.783586+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:33:41.255469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.12","version":"267'201","reported_seq":1100,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:00:21.559424+0000","last_change":"2024-09-14T11:08:31.855543+0000","last_active":"2024-09-14T13:00:21.559424+0000","last_peered":"2024-09-14T13:00:21.559424+0000","last_clean":"2024-09-14T13:00:21.559424+0000","last_became_active":"2024-09-14T11:08:31.854650+0000","last_became_peered":"2024-09-14T11:08:31.854650+0000","last_unstale":"2024-09-14T13:00:21.559424+0000","last_undegraded":"2024-09-14T13:00:21.559424+0000","last_fullsized":"2024-09-14T13:00:21.559424+0000","mapping_epoch":34,"log_start":"267'100","ondisk_log_start":"267'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:08:30.789404+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:08:30.789404+0000","last_clean_scrub_stamp":"2024-09-14T11:08:30.789404+0000","objects_scrubbed":0,"log_size":101,"log_dups_size":100,"ondisk_log_size":101,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:48:10.230125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1218,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":620,"num_read_kb":614,"num_write":555,"num_write_kb":141,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1d","version":"267'644","reported_seq":2448,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:20.943243+0000","last_change":"2024-09-14T13:02:20.943243+0000","last_active":"2024-09-14T13:02:20.943243+0000","last_peered":"2024-09-14T13:02:20.943243+0000","last_clean":"2024-09-14T13:02:20.943243+0000","last_became_active":"2024-09-14T11:08:23.779099+0000","last_became_peered":"2024-09-14T11:08:23.779099+0000","last_unstale":"2024-09-14T13:02:20.943243+0000","last_undegraded":"2024-09-14T13:02:20.943243+0000","last_fullsized":"2024-09-14T13:02:20.943243+0000","mapping_epoch":26,"log_start":"267'600","ondisk_log_start":"267'600","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'644","last_scrub_stamp":"2024-09-14T13:02:20.943029+0000","last_deep_scrub":"267'644","last_deep_scrub_stamp":"2024-09-14T13:02:20.943029+0000","last_clean_scrub_stamp":"2024-09-14T13:02:20.943029+0000","objects_scrubbed":2,"log_size":44,"log_dups_size":600,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:46:01.069278+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3438,"num_read_kb":3161,"num_write":830,"num_write_kb":293,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":432,"num_omap_keys":2,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"267'251","reported_seq":1039,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:08.834994+0000","last_change":"2024-09-14T13:02:08.834994+0000","last_active":"2024-09-14T13:02:08.834994+0000","last_peered":"2024-09-14T13:02:08.834994+0000","last_clean":"2024-09-14T13:02:08.834994+0000","last_became_active":"2024-09-14T11:08:21.822349+0000","last_became_peered":"2024-09-14T11:08:21.822349+0000","last_unstale":"2024-09-14T13:02:08.834994+0000","last_undegraded":"2024-09-14T13:02:08.834994+0000","last_fullsized":"2024-09-14T13:02:08.834994+0000","mapping_epoch":24,"log_start":"267'200","ondisk_log_start":"267'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'251","last_scrub_stamp":"2024-09-14T13:02:08.834786+0000","last_deep_scrub":"267'251","last_deep_scrub_stamp":"2024-09-14T13:02:08.834786+0000","last_clean_scrub_stamp":"2024-09-14T13:02:08.834786+0000","objects_scrubbed":3,"log_size":51,"log_dups_size":200,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:07:12.222661+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1655848,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1337,"num_read_kb":40987,"num_write":1078,"num_write_kb":33045,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,5],"acting":[4,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":526,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:58:28.225640+0000","last_change":"2024-09-14T11:08:25.808861+0000","last_active":"2024-09-14T12:58:28.225640+0000","last_peered":"2024-09-14T12:58:28.225640+0000","last_clean":"2024-09-14T12:58:28.225640+0000","last_became_active":"2024-09-14T11:08:25.807820+0000","last_became_peered":"2024-09-14T11:08:25.807820+0000","last_unstale":"2024-09-14T12:58:28.225640+0000","last_undegraded":"2024-09-14T12:58:28.225640+0000","last_fullsized":"2024-09-14T12:58:28.225640+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:08:24.757170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:08:24.757170+0000","last_clean_scrub_stamp":"2024-09-14T11:08:24.757170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:21:06.537600+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1f","version":"267'201","reported_seq":840,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:00.222727+0000","last_change":"2024-09-14T11:08:27.799774+0000","last_active":"2024-09-14T13:02:00.222727+0000","last_peered":"2024-09-14T13:02:00.222727+0000","last_clean":"2024-09-14T13:02:00.222727+0000","last_became_active":"2024-09-14T11:08:27.799019+0000","last_became_peered":"2024-09-14T11:08:27.799019+0000","last_unstale":"2024-09-14T13:02:00.222727+0000","last_undegraded":"2024-09-14T13:02:00.222727+0000","last_fullsized":"2024-09-14T13:02:00.222727+0000","mapping_epoch":30,"log_start":"264'100","ondisk_log_start":"264'100","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:08:26.771628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:08:26.771628+0000","last_clean_scrub_stamp":"2024-09-14T11:08:26.771628+0000","objects_scrubbed":0,"log_size":101,"log_dups_size":100,"ondisk_log_size":101,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:29:21.400017+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":11376,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":267,"num_read_kb":349,"num_write":156,"num_write_kb":26,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":525,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:58:48.462484+0000","last_change":"2024-09-14T11:08:29.821376+0000","last_active":"2024-09-14T12:58:48.462484+0000","last_peered":"2024-09-14T12:58:48.462484+0000","last_clean":"2024-09-14T12:58:48.462484+0000","last_became_active":"2024-09-14T11:08:29.820658+0000","last_became_peered":"2024-09-14T11:08:29.820658+0000","last_unstale":"2024-09-14T12:58:48.462484+0000","last_undegraded":"2024-09-14T12:58:48.462484+0000","last_fullsized":"2024-09-14T12:58:48.462484+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:08:28.783586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:08:28.783586+0000","last_clean_scrub_stamp":"2024-09-14T11:08:28.783586+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:41:05.714746+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.11","version":"267'134","reported_seq":664,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:01:40.625798+0000","last_change":"2024-09-14T11:08:31.837211+0000","last_active":"2024-09-14T13:01:40.625798+0000","last_peered":"2024-09-14T13:01:40.625798+0000","last_clean":"2024-09-14T13:01:40.625798+0000","last_became_active":"2024-09-14T11:08:31.836424+0000","last_became_peered":"2024-09-14T11:08:31.836424+0000","last_unstale":"2024-09-14T13:01:40.625798+0000","last_undegraded":"2024-09-14T13:01:40.625798+0000","last_fullsized":"2024-09-14T13:01:40.625798+0000","mapping_epoch":34,"log_start":"267'100","ondisk_log_start":"267'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:08:30.789404+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:08:30.789404+0000","last_clean_scrub_stamp":"2024-09-14T11:08:30.789404+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":100,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:24:20.926458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":383,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":163,"num_read_kb":148,"num_write":342,"num_write_kb":82,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1c","version":"267'438","reported_seq":2103,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:17.145247+0000","last_change":"2024-09-14T13:02:17.145247+0000","last_active":"2024-09-14T13:02:17.145247+0000","last_peered":"2024-09-14T13:02:17.145247+0000","last_clean":"2024-09-14T13:02:17.145247+0000","last_became_active":"2024-09-14T11:08:23.775491+0000","last_became_peered":"2024-09-14T11:08:23.775491+0000","last_unstale":"2024-09-14T13:02:17.145247+0000","last_undegraded":"2024-09-14T13:02:17.145247+0000","last_fullsized":"2024-09-14T13:02:17.145247+0000","mapping_epoch":26,"log_start":"267'400","ondisk_log_start":"267'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'438","last_scrub_stamp":"2024-09-14T13:02:17.145001+0000","last_deep_scrub":"267'438","last_deep_scrub_stamp":"2024-09-14T13:02:17.145001+0000","last_clean_scrub_stamp":"2024-09-14T13:02:17.145001+0000","objects_scrubbed":1,"log_size":38,"log_dups_size":400,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:24:25.673117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2479,"num_read_kb":2350,"num_write":502,"num_write_kb":107,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":247,"num_omap_keys":1,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"267'223","reported_seq":858,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:11.163011+0000","last_change":"2024-09-14T13:02:11.163011+0000","last_active":"2024-09-14T13:02:11.163011+0000","last_peered":"2024-09-14T13:02:11.163011+0000","last_clean":"2024-09-14T13:02:11.163011+0000","last_became_active":"2024-09-14T11:08:56.033894+0000","last_became_peered":"2024-09-14T11:08:56.033894+0000","last_unstale":"2024-09-14T13:02:11.163011+0000","last_undegraded":"2024-09-14T13:02:11.163011+0000","last_fullsized":"2024-09-14T13:02:11.163011+0000","mapping_epoch":37,"log_start":"267'200","ondisk_log_start":"267'200","created":24,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'223","last_scrub_stamp":"2024-09-14T13:02:11.162701+0000","last_deep_scrub":"267'223","last_deep_scrub_stamp":"2024-09-14T13:02:11.162701+0000","last_clean_scrub_stamp":"2024-09-14T13:02:11.162701+0000","objects_scrubbed":2,"log_size":23,"log_dups_size":200,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:47:28.180376+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":541,"num_read_kb":17888,"num_write":1023,"num_write_kb":32755,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4,7],"acting":[2,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":521,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:58:28.457976+0000","last_change":"2024-09-14T11:08:25.804776+0000","last_active":"2024-09-14T12:58:28.457976+0000","last_peered":"2024-09-14T12:58:28.457976+0000","last_clean":"2024-09-14T12:58:28.457976+0000","last_became_active":"2024-09-14T11:08:25.804388+0000","last_became_peered":"2024-09-14T11:08:25.804388+0000","last_unstale":"2024-09-14T12:58:28.457976+0000","last_undegraded":"2024-09-14T12:58:28.457976+0000","last_fullsized":"2024-09-14T12:58:28.457976+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:08:24.757170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:08:24.757170+0000","last_clean_scrub_stamp":"2024-09-14T11:08:24.757170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:03:59.400683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1e","version":"267'168","reported_seq":761,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:59:08.616998+0000","last_change":"2024-09-14T11:08:27.832039+0000","last_active":"2024-09-14T12:59:08.616998+0000","last_peered":"2024-09-14T12:59:08.616998+0000","last_clean":"2024-09-14T12:59:08.616998+0000","last_became_active":"2024-09-14T11:08:27.830708+0000","last_became_peered":"2024-09-14T11:08:27.830708+0000","last_unstale":"2024-09-14T12:59:08.616998+0000","last_undegraded":"2024-09-14T12:59:08.616998+0000","last_fullsized":"2024-09-14T12:59:08.616998+0000","mapping_epoch":30,"log_start":"267'100","ondisk_log_start":"267'100","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:08:26.771628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:08:26.771628+0000","last_clean_scrub_stamp":"2024-09-14T11:08:26.771628+0000","objects_scrubbed":0,"log_size":68,"log_dups_size":100,"ondisk_log_size":68,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:26:51.532445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":224,"num_read_kb":219,"num_write":208,"num_write_kb":88,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1f","version":"267'769","reported_seq":3157,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:01:59.853910+0000","last_change":"2024-09-14T11:08:29.842740+0000","last_active":"2024-09-14T13:01:59.853910+0000","last_peered":"2024-09-14T13:01:59.853910+0000","last_clean":"2024-09-14T13:01:59.853910+0000","last_became_active":"2024-09-14T11:08:29.840179+0000","last_became_peered":"2024-09-14T11:08:29.840179+0000","last_unstale":"2024-09-14T13:01:59.853910+0000","last_undegraded":"2024-09-14T13:01:59.853910+0000","last_fullsized":"2024-09-14T13:01:59.853910+0000","mapping_epoch":32,"log_start":"267'701","ondisk_log_start":"267'701","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:08:28.783586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:08:28.783586+0000","last_clean_scrub_stamp":"2024-09-14T11:08:28.783586+0000","objects_scrubbed":0,"log_size":68,"log_dups_size":701,"ondisk_log_size":68,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:13:51.334108+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.10","version":"267'110","reported_seq":636,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:00:11.280385+0000","last_change":"2024-09-14T11:08:31.839459+0000","last_active":"2024-09-14T13:00:11.280385+0000","last_peered":"2024-09-14T13:00:11.280385+0000","last_clean":"2024-09-14T13:00:11.280385+0000","last_became_active":"2024-09-14T11:08:31.838761+0000","last_became_peered":"2024-09-14T11:08:31.838761+0000","last_unstale":"2024-09-14T13:00:11.280385+0000","last_undegraded":"2024-09-14T13:00:11.280385+0000","last_fullsized":"2024-09-14T13:00:11.280385+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:08:30.789404+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:08:30.789404+0000","last_clean_scrub_stamp":"2024-09-14T11:08:30.789404+0000","objects_scrubbed":0,"log_size":110,"log_dups_size":0,"ondisk_log_size":110,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:37:29.125988+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":418,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":108,"num_read_kb":106,"num_write":270,"num_write_kb":60,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1b","version":"267'385","reported_seq":1857,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:18.710983+0000","last_change":"2024-09-14T13:02:18.710983+0000","last_active":"2024-09-14T13:02:18.710983+0000","last_peered":"2024-09-14T13:02:18.710983+0000","last_clean":"2024-09-14T13:02:18.710983+0000","last_became_active":"2024-09-14T11:08:23.791753+0000","last_became_peered":"2024-09-14T11:08:23.791753+0000","last_unstale":"2024-09-14T13:02:18.710983+0000","last_undegraded":"2024-09-14T13:02:18.710983+0000","last_fullsized":"2024-09-14T13:02:18.710983+0000","mapping_epoch":26,"log_start":"267'300","ondisk_log_start":"267'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'385","last_scrub_stamp":"2024-09-14T13:02:18.710738+0000","last_deep_scrub":"267'385","last_deep_scrub_stamp":"2024-09-14T13:02:18.710738+0000","last_clean_scrub_stamp":"2024-09-14T13:02:18.710738+0000","objects_scrubbed":1,"log_size":85,"log_dups_size":300,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:43:05.968088+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2049,"num_read_kb":1937,"num_write":432,"num_write_kb":84,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1c","version":"267'213","reported_seq":877,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:11.330388+0000","last_change":"2024-09-14T13:02:11.330388+0000","last_active":"2024-09-14T13:02:11.330388+0000","last_peered":"2024-09-14T13:02:11.330388+0000","last_clean":"2024-09-14T13:02:11.330388+0000","last_became_active":"2024-09-14T11:08:21.825881+0000","last_became_peered":"2024-09-14T11:08:21.825881+0000","last_unstale":"2024-09-14T13:02:11.330388+0000","last_undegraded":"2024-09-14T13:02:11.330388+0000","last_fullsized":"2024-09-14T13:02:11.330388+0000","mapping_epoch":24,"log_start":"267'200","ondisk_log_start":"267'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'213","last_scrub_stamp":"2024-09-14T13:02:11.330181+0000","last_deep_scrub":"267'213","last_deep_scrub_stamp":"2024-09-14T13:02:11.330181+0000","last_clean_scrub_stamp":"2024-09-14T13:02:11.330181+0000","objects_scrubbed":1,"log_size":13,"log_dups_size":200,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:06:15.884484+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1655822,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":555,"num_read_kb":34621,"num_write":949,"num_write_kb":21560,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":525,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:58:27.830750+0000","last_change":"2024-09-14T11:08:25.822606+0000","last_active":"2024-09-14T12:58:27.830750+0000","last_peered":"2024-09-14T12:58:27.830750+0000","last_clean":"2024-09-14T12:58:27.830750+0000","last_became_active":"2024-09-14T11:08:25.822047+0000","last_became_peered":"2024-09-14T11:08:25.822047+0000","last_unstale":"2024-09-14T12:58:27.830750+0000","last_undegraded":"2024-09-14T12:58:27.830750+0000","last_fullsized":"2024-09-14T12:58:27.830750+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:08:24.757170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:08:24.757170+0000","last_clean_scrub_stamp":"2024-09-14T11:08:24.757170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:17:43.121390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.19","version":"267'262","reported_seq":916,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:00.325275+0000","last_change":"2024-09-14T11:08:27.825245+0000","last_active":"2024-09-14T13:02:00.325275+0000","last_peered":"2024-09-14T13:02:00.325275+0000","last_clean":"2024-09-14T13:02:00.325275+0000","last_became_active":"2024-09-14T11:08:27.824464+0000","last_became_peered":"2024-09-14T11:08:27.824464+0000","last_unstale":"2024-09-14T13:02:00.325275+0000","last_undegraded":"2024-09-14T13:02:00.325275+0000","last_fullsized":"2024-09-14T13:02:00.325275+0000","mapping_epoch":30,"log_start":"267'200","ondisk_log_start":"267'200","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:08:26.771628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:08:26.771628+0000","last_clean_scrub_stamp":"2024-09-14T11:08:26.771628+0000","objects_scrubbed":0,"log_size":62,"log_dups_size":200,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:54:45.692895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12812,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":350,"num_read_kb":439,"num_write":214,"num_write_kb":32,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":523,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:59:43.255322+0000","last_change":"2024-09-14T11:08:29.823349+0000","last_active":"2024-09-14T12:59:43.255322+0000","last_peered":"2024-09-14T12:59:43.255322+0000","last_clean":"2024-09-14T12:59:43.255322+0000","last_became_active":"2024-09-14T11:08:29.822623+0000","last_became_peered":"2024-09-14T11:08:29.822623+0000","last_unstale":"2024-09-14T12:59:43.255322+0000","last_undegraded":"2024-09-14T12:59:43.255322+0000","last_fullsized":"2024-09-14T12:59:43.255322+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:08:28.783586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:08:28.783586+0000","last_clean_scrub_stamp":"2024-09-14T11:08:28.783586+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.17","version":"267'127","reported_seq":654,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:00:13.805327+0000","last_change":"2024-09-14T11:08:31.859123+0000","last_active":"2024-09-14T13:00:13.805327+0000","last_peered":"2024-09-14T13:00:13.805327+0000","last_clean":"2024-09-14T13:00:13.805327+0000","last_became_active":"2024-09-14T11:08:31.858388+0000","last_became_peered":"2024-09-14T11:08:31.858388+0000","last_unstale":"2024-09-14T13:00:13.805327+0000","last_undegraded":"2024-09-14T13:00:13.805327+0000","last_fullsized":"2024-09-14T13:00:13.805327+0000","mapping_epoch":34,"log_start":"267'100","ondisk_log_start":"267'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:08:30.789404+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:08:30.789404+0000","last_clean_scrub_stamp":"2024-09-14T11:08:30.789404+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":100,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":200,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":125,"num_read_kb":119,"num_write":310,"num_write_kb":73,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1a","version":"267'853","reported_seq":2580,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:17.760990+0000","last_change":"2024-09-14T13:02:17.760990+0000","last_active":"2024-09-14T13:02:17.760990+0000","last_peered":"2024-09-14T13:02:17.760990+0000","last_clean":"2024-09-14T13:02:17.760990+0000","last_became_active":"2024-09-14T11:08:23.793908+0000","last_became_peered":"2024-09-14T11:08:23.793908+0000","last_unstale":"2024-09-14T13:02:17.760990+0000","last_undegraded":"2024-09-14T13:02:17.760990+0000","last_fullsized":"2024-09-14T13:02:17.760990+0000","mapping_epoch":26,"log_start":"267'800","ondisk_log_start":"267'800","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'853","last_scrub_stamp":"2024-09-14T13:02:17.760808+0000","last_deep_scrub":"267'853","last_deep_scrub_stamp":"2024-09-14T13:02:17.760808+0000","last_clean_scrub_stamp":"2024-09-14T13:02:17.760808+0000","objects_scrubbed":2,"log_size":53,"log_dups_size":800,"ondisk_log_size":53,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:38:18.530322+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":4233,"num_read_kb":3837,"num_write":1135,"num_write_kb":419,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2551,"num_omap_keys":10,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1d","version":"267'248","reported_seq":937,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:12.368968+0000","last_change":"2024-09-14T13:02:12.368968+0000","last_active":"2024-09-14T13:02:12.368968+0000","last_peered":"2024-09-14T13:02:12.368968+0000","last_clean":"2024-09-14T13:02:12.368968+0000","last_became_active":"2024-09-14T11:08:21.820805+0000","last_became_peered":"2024-09-14T11:08:21.820805+0000","last_unstale":"2024-09-14T13:02:12.368968+0000","last_undegraded":"2024-09-14T13:02:12.368968+0000","last_fullsized":"2024-09-14T13:02:12.368968+0000","mapping_epoch":24,"log_start":"267'200","ondisk_log_start":"267'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'248","last_scrub_stamp":"2024-09-14T13:02:12.368755+0000","last_deep_scrub":"267'248","last_deep_scrub_stamp":"2024-09-14T13:02:12.368755+0000","last_clean_scrub_stamp":"2024-09-14T13:02:12.368755+0000","objects_scrubbed":3,"log_size":48,"log_dups_size":200,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:45:17.694226+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":55,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":696,"num_read_kb":13918,"num_write":1169,"num_write_kb":29151,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":524,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:58:28.040986+0000","last_change":"2024-09-14T11:08:25.802519+0000","last_active":"2024-09-14T12:58:28.040986+0000","last_peered":"2024-09-14T12:58:28.040986+0000","last_clean":"2024-09-14T12:58:28.040986+0000","last_became_active":"2024-09-14T11:08:25.801548+0000","last_became_peered":"2024-09-14T11:08:25.801548+0000","last_unstale":"2024-09-14T12:58:28.040986+0000","last_undegraded":"2024-09-14T12:58:28.040986+0000","last_fullsized":"2024-09-14T12:58:28.040986+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:08:24.757170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:08:24.757170+0000","last_clean_scrub_stamp":"2024-09-14T11:08:24.757170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:47:07.228076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.18","version":"267'180","reported_seq":804,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:00.335791+0000","last_change":"2024-09-14T11:08:27.815657+0000","last_active":"2024-09-14T13:02:00.335791+0000","last_peered":"2024-09-14T13:02:00.335791+0000","last_clean":"2024-09-14T13:02:00.335791+0000","last_became_active":"2024-09-14T11:08:27.814938+0000","last_became_peered":"2024-09-14T11:08:27.814938+0000","last_unstale":"2024-09-14T13:02:00.335791+0000","last_undegraded":"2024-09-14T13:02:00.335791+0000","last_fullsized":"2024-09-14T13:02:00.335791+0000","mapping_epoch":30,"log_start":"264'100","ondisk_log_start":"264'100","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:08:26.771628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:08:26.771628+0000","last_clean_scrub_stamp":"2024-09-14T11:08:26.771628+0000","objects_scrubbed":0,"log_size":80,"log_dups_size":100,"ondisk_log_size":80,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:15:03.277896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":31231,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":239,"num_read_kb":376,"num_write":138,"num_write_kb":54,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":516,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:57:33.603105+0000","last_change":"2024-09-14T11:08:29.836990+0000","last_active":"2024-09-14T12:57:33.603105+0000","last_peered":"2024-09-14T12:57:33.603105+0000","last_clean":"2024-09-14T12:57:33.603105+0000","last_became_active":"2024-09-14T11:08:29.829491+0000","last_became_peered":"2024-09-14T11:08:29.829491+0000","last_unstale":"2024-09-14T12:57:33.603105+0000","last_undegraded":"2024-09-14T12:57:33.603105+0000","last_fullsized":"2024-09-14T12:57:33.603105+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:08:28.783586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:08:28.783586+0000","last_clean_scrub_stamp":"2024-09-14T11:08:28.783586+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:58:11.838583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.16","version":"267'128","reported_seq":683,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:59:43.477318+0000","last_change":"2024-09-14T11:08:31.838739+0000","last_active":"2024-09-14T12:59:43.477318+0000","last_peered":"2024-09-14T12:59:43.477318+0000","last_clean":"2024-09-14T12:59:43.477318+0000","last_became_active":"2024-09-14T11:08:31.832264+0000","last_became_peered":"2024-09-14T11:08:31.832264+0000","last_unstale":"2024-09-14T12:59:43.477318+0000","last_undegraded":"2024-09-14T12:59:43.477318+0000","last_fullsized":"2024-09-14T12:59:43.477318+0000","mapping_epoch":34,"log_start":"267'100","ondisk_log_start":"267'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:08:30.789404+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:08:30.789404+0000","last_clean_scrub_stamp":"2024-09-14T11:08:30.789404+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":100,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":539,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":196,"num_read_kb":188,"num_write":306,"num_write_kb":70,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"267'841","reported_seq":2525,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:18.906574+0000","last_change":"2024-09-14T13:02:18.906417+0000","last_active":"2024-09-14T13:02:18.906574+0000","last_peered":"2024-09-14T13:02:18.906574+0000","last_clean":"2024-09-14T13:02:18.906574+0000","last_became_active":"2024-09-14T11:08:23.781730+0000","last_became_peered":"2024-09-14T11:08:23.781730+0000","last_unstale":"2024-09-14T13:02:18.906574+0000","last_undegraded":"2024-09-14T13:02:18.906574+0000","last_fullsized":"2024-09-14T13:02:18.906574+0000","mapping_epoch":26,"log_start":"267'800","ondisk_log_start":"267'800","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'841","last_scrub_stamp":"2024-09-14T13:02:18.906239+0000","last_deep_scrub":"267'841","last_deep_scrub_stamp":"2024-09-14T13:02:18.906239+0000","last_clean_scrub_stamp":"2024-09-14T13:02:18.906239+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":800,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:22:02.089304+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3990,"num_read_kb":3619,"num_write":1102,"num_write_kb":388,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"267'187","reported_seq":835,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:10.973427+0000","last_change":"2024-09-14T13:02:10.973427+0000","last_active":"2024-09-14T13:02:10.973427+0000","last_peered":"2024-09-14T13:02:10.973427+0000","last_clean":"2024-09-14T13:02:10.973427+0000","last_became_active":"2024-09-14T11:08:21.809457+0000","last_became_peered":"2024-09-14T11:08:21.809457+0000","last_unstale":"2024-09-14T13:02:10.973427+0000","last_undegraded":"2024-09-14T13:02:10.973427+0000","last_fullsized":"2024-09-14T13:02:10.973427+0000","mapping_epoch":24,"log_start":"267'100","ondisk_log_start":"267'100","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'187","last_scrub_stamp":"2024-09-14T13:02:10.973179+0000","last_deep_scrub":"267'187","last_deep_scrub_stamp":"2024-09-14T13:02:10.973179+0000","last_clean_scrub_stamp":"2024-09-14T13:02:10.973179+0000","objects_scrubbed":2,"log_size":87,"log_dups_size":100,"ondisk_log_size":87,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:00:13.783400+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":26,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":452,"num_read_kb":5598,"num_write":898,"num_write_kb":20482,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6,7],"acting":[3,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":528,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:59:38.241230+0000","last_change":"2024-09-14T11:08:25.806603+0000","last_active":"2024-09-14T12:59:38.241230+0000","last_peered":"2024-09-14T12:59:38.241230+0000","last_clean":"2024-09-14T12:59:38.241230+0000","last_became_active":"2024-09-14T11:08:25.805777+0000","last_became_peered":"2024-09-14T11:08:25.805777+0000","last_unstale":"2024-09-14T12:59:38.241230+0000","last_undegraded":"2024-09-14T12:59:38.241230+0000","last_fullsized":"2024-09-14T12:59:38.241230+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:08:24.757170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:08:24.757170+0000","last_clean_scrub_stamp":"2024-09-14T11:08:24.757170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:54:18.701609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1b","version":"267'123","reported_seq":716,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:00.194995+0000","last_change":"2024-09-14T11:08:27.823209+0000","last_active":"2024-09-14T13:02:00.194995+0000","last_peered":"2024-09-14T13:02:00.194995+0000","last_clean":"2024-09-14T13:02:00.194995+0000","last_became_active":"2024-09-14T11:08:27.822465+0000","last_became_peered":"2024-09-14T11:08:27.822465+0000","last_unstale":"2024-09-14T13:02:00.194995+0000","last_undegraded":"2024-09-14T13:02:00.194995+0000","last_fullsized":"2024-09-14T13:02:00.194995+0000","mapping_epoch":30,"log_start":"267'100","ondisk_log_start":"267'100","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:08:26.771628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:08:26.771628+0000","last_clean_scrub_stamp":"2024-09-14T11:08:26.771628+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":100,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:13:30.608378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9872,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":162,"num_read_kb":232,"num_write":86,"num_write_kb":20,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":518,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:58:33.226817+0000","last_change":"2024-09-14T11:08:29.832131+0000","last_active":"2024-09-14T12:58:33.226817+0000","last_peered":"2024-09-14T12:58:33.226817+0000","last_clean":"2024-09-14T12:58:33.226817+0000","last_became_active":"2024-09-14T11:08:29.831394+0000","last_became_peered":"2024-09-14T11:08:29.831394+0000","last_unstale":"2024-09-14T12:58:33.226817+0000","last_undegraded":"2024-09-14T12:58:33.226817+0000","last_fullsized":"2024-09-14T12:58:33.226817+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:08:28.783586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:08:28.783586+0000","last_clean_scrub_stamp":"2024-09-14T11:08:28.783586+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:19:42.017615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.15","version":"267'186","reported_seq":1323,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:00:13.468877+0000","last_change":"2024-09-14T11:08:31.838090+0000","last_active":"2024-09-14T13:00:13.468877+0000","last_peered":"2024-09-14T13:00:13.468877+0000","last_clean":"2024-09-14T13:00:13.468877+0000","last_became_active":"2024-09-14T11:08:31.837288+0000","last_became_peered":"2024-09-14T11:08:31.837288+0000","last_unstale":"2024-09-14T13:00:13.468877+0000","last_undegraded":"2024-09-14T13:00:13.468877+0000","last_fullsized":"2024-09-14T13:00:13.468877+0000","mapping_epoch":34,"log_start":"267'100","ondisk_log_start":"267'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:08:30.789404+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:08:30.789404+0000","last_clean_scrub_stamp":"2024-09-14T11:08:30.789404+0000","objects_scrubbed":0,"log_size":86,"log_dups_size":100,"ondisk_log_size":86,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":649,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":776,"num_read_kb":767,"num_write":406,"num_write_kb":131,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.18","version":"267'751","reported_seq":2363,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:16.798485+0000","last_change":"2024-09-14T13:02:16.798485+0000","last_active":"2024-09-14T13:02:16.798485+0000","last_peered":"2024-09-14T13:02:16.798485+0000","last_clean":"2024-09-14T13:02:16.798485+0000","last_became_active":"2024-09-14T11:08:23.806640+0000","last_became_peered":"2024-09-14T11:08:23.806640+0000","last_unstale":"2024-09-14T13:02:16.798485+0000","last_undegraded":"2024-09-14T13:02:16.798485+0000","last_fullsized":"2024-09-14T13:02:16.798485+0000","mapping_epoch":26,"log_start":"267'700","ondisk_log_start":"267'700","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'751","last_scrub_stamp":"2024-09-14T13:02:16.798298+0000","last_deep_scrub":"267'751","last_deep_scrub_stamp":"2024-09-14T13:02:16.798298+0000","last_clean_scrub_stamp":"2024-09-14T13:02:16.798298+0000","objects_scrubbed":1,"log_size":51,"log_dups_size":700,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:34:05.343127+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3938,"num_read_kb":3591,"num_write":982,"num_write_kb":355,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":244,"num_omap_keys":1,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1f","version":"267'170","reported_seq":847,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:10.102208+0000","last_change":"2024-09-14T13:02:10.102208+0000","last_active":"2024-09-14T13:02:10.102208+0000","last_peered":"2024-09-14T13:02:10.102208+0000","last_clean":"2024-09-14T13:02:10.102208+0000","last_became_active":"2024-09-14T11:08:21.801111+0000","last_became_peered":"2024-09-14T11:08:21.801111+0000","last_unstale":"2024-09-14T13:02:10.102208+0000","last_undegraded":"2024-09-14T13:02:10.102208+0000","last_fullsized":"2024-09-14T13:02:10.102208+0000","mapping_epoch":24,"log_start":"267'100","ondisk_log_start":"267'100","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'170","last_scrub_stamp":"2024-09-14T13:02:10.102000+0000","last_deep_scrub":"267'170","last_deep_scrub_stamp":"2024-09-14T13:02:10.102000+0000","last_clean_scrub_stamp":"2024-09-14T13:02:10.102000+0000","objects_scrubbed":1,"log_size":70,"log_dups_size":100,"ondisk_log_size":70,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:52:37.683920+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":26,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":489,"num_read_kb":60837,"num_write":760,"num_write_kb":39194,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,6],"acting":[0,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.19","version":"29'1","reported_seq":525,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:59:53.476478+0000","last_change":"2024-09-14T11:08:25.800454+0000","last_active":"2024-09-14T12:59:53.476478+0000","last_peered":"2024-09-14T12:59:53.476478+0000","last_clean":"2024-09-14T12:59:53.476478+0000","last_became_active":"2024-09-14T11:08:25.799872+0000","last_became_peered":"2024-09-14T11:08:25.799872+0000","last_unstale":"2024-09-14T12:59:53.476478+0000","last_undegraded":"2024-09-14T12:59:53.476478+0000","last_fullsized":"2024-09-14T12:59:53.476478+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:08:24.757170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:08:24.757170+0000","last_clean_scrub_stamp":"2024-09-14T11:08:24.757170+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1a","version":"267'188","reported_seq":823,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:00.231029+0000","last_change":"2024-09-14T11:08:27.831489+0000","last_active":"2024-09-14T13:02:00.231029+0000","last_peered":"2024-09-14T13:02:00.231029+0000","last_clean":"2024-09-14T13:02:00.231029+0000","last_became_active":"2024-09-14T11:08:27.830707+0000","last_became_peered":"2024-09-14T11:08:27.830707+0000","last_unstale":"2024-09-14T13:02:00.231029+0000","last_undegraded":"2024-09-14T13:02:00.231029+0000","last_fullsized":"2024-09-14T13:02:00.231029+0000","mapping_epoch":30,"log_start":"264'100","ondisk_log_start":"264'100","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:08:26.771628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:08:26.771628+0000","last_clean_scrub_stamp":"2024-09-14T11:08:26.771628+0000","objects_scrubbed":0,"log_size":88,"log_dups_size":100,"ondisk_log_size":88,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:02:06.941247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8430,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":268,"num_read_kb":336,"num_write":152,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":521,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:58:33.237720+0000","last_change":"2024-09-14T11:08:29.811093+0000","last_active":"2024-09-14T12:58:33.237720+0000","last_peered":"2024-09-14T12:58:33.237720+0000","last_clean":"2024-09-14T12:58:33.237720+0000","last_became_active":"2024-09-14T11:08:29.810292+0000","last_became_peered":"2024-09-14T11:08:29.810292+0000","last_unstale":"2024-09-14T12:58:33.237720+0000","last_undegraded":"2024-09-14T12:58:33.237720+0000","last_fullsized":"2024-09-14T12:58:33.237720+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:08:28.783586+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:08:28.783586+0000","last_clean_scrub_stamp":"2024-09-14T11:08:28.783586+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:29:49.706509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.14","version":"267'133","reported_seq":660,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:01:39.322888+0000","last_change":"2024-09-14T11:08:31.852213+0000","last_active":"2024-09-14T13:01:39.322888+0000","last_peered":"2024-09-14T13:01:39.322888+0000","last_clean":"2024-09-14T13:01:39.322888+0000","last_became_active":"2024-09-14T11:08:31.851483+0000","last_became_peered":"2024-09-14T11:08:31.851483+0000","last_unstale":"2024-09-14T13:01:39.322888+0000","last_undegraded":"2024-09-14T13:01:39.322888+0000","last_fullsized":"2024-09-14T13:01:39.322888+0000","mapping_epoch":34,"log_start":"267'100","ondisk_log_start":"267'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:08:30.789404+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:08:30.789404+0000","last_clean_scrub_stamp":"2024-09-14T11:08:30.789404+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":100,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:20:02.893934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":227,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":142,"num_read_kb":127,"num_write":323,"num_write_kb":76,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.27","version":"267'1176","reported_seq":2963,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:19.058530+0000","last_change":"2024-09-14T13:02:19.058530+0000","last_active":"2024-09-14T13:02:19.058530+0000","last_peered":"2024-09-14T13:02:19.058530+0000","last_clean":"2024-09-14T13:02:19.058530+0000","last_became_active":"2024-09-14T11:08:23.798225+0000","last_became_peered":"2024-09-14T11:08:23.798225+0000","last_unstale":"2024-09-14T13:02:19.058530+0000","last_undegraded":"2024-09-14T13:02:19.058530+0000","last_fullsized":"2024-09-14T13:02:19.058530+0000","mapping_epoch":26,"log_start":"267'1100","ondisk_log_start":"267'1100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'1176","last_scrub_stamp":"2024-09-14T13:02:19.058334+0000","last_deep_scrub":"267'1176","last_deep_scrub_stamp":"2024-09-14T13:02:19.058334+0000","last_clean_scrub_stamp":"2024-09-14T13:02:19.058334+0000","objects_scrubbed":2,"log_size":76,"log_dups_size":1100,"ondisk_log_size":76,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:40:22.783461+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":5564,"num_read_kb":4974,"num_write":1578,"num_write_kb":634,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2045,"num_omap_keys":8,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.20","version":"267'242","reported_seq":1003,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:12.288173+0000","last_change":"2024-09-14T13:02:12.288173+0000","last_active":"2024-09-14T13:02:12.288173+0000","last_peered":"2024-09-14T13:02:12.288173+0000","last_clean":"2024-09-14T13:02:12.288173+0000","last_became_active":"2024-09-14T11:08:21.816270+0000","last_became_peered":"2024-09-14T11:08:21.816270+0000","last_unstale":"2024-09-14T13:02:12.288173+0000","last_undegraded":"2024-09-14T13:02:12.288173+0000","last_fullsized":"2024-09-14T13:02:12.288173+0000","mapping_epoch":24,"log_start":"267'200","ondisk_log_start":"267'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'242","last_scrub_stamp":"2024-09-14T13:02:12.287850+0000","last_deep_scrub":"267'242","last_deep_scrub_stamp":"2024-09-14T13:02:12.287850+0000","last_clean_scrub_stamp":"2024-09-14T13:02:12.287850+0000","objects_scrubbed":1,"log_size":42,"log_dups_size":200,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:26:32.484498+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":896,"num_read_kb":196583,"num_write":965,"num_write_kb":33610,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,7],"acting":[6,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.26","version":"267'1295","reported_seq":2913,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:22.002876+0000","last_change":"2024-09-14T13:02:22.002876+0000","last_active":"2024-09-14T13:02:22.002876+0000","last_peered":"2024-09-14T13:02:22.002876+0000","last_clean":"2024-09-14T13:02:22.002876+0000","last_became_active":"2024-09-14T11:08:23.776349+0000","last_became_peered":"2024-09-14T11:08:23.776349+0000","last_unstale":"2024-09-14T13:02:22.002876+0000","last_undegraded":"2024-09-14T13:02:22.002876+0000","last_fullsized":"2024-09-14T13:02:22.002876+0000","mapping_epoch":26,"log_start":"267'1200","ondisk_log_start":"267'1200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'1295","last_scrub_stamp":"2024-09-14T13:02:22.002702+0000","last_deep_scrub":"267'1295","last_deep_scrub_stamp":"2024-09-14T13:02:22.002702+0000","last_clean_scrub_stamp":"2024-09-14T13:02:22.002702+0000","objects_scrubbed":3,"log_size":95,"log_dups_size":1200,"ondisk_log_size":95,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:05:44.720042+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":5862,"num_read_kb":5174,"num_write":1823,"num_write_kb":798,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.21","version":"267'158","reported_seq":804,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:10.134026+0000","last_change":"2024-09-14T13:02:10.134026+0000","last_active":"2024-09-14T13:02:10.134026+0000","last_peered":"2024-09-14T13:02:10.134026+0000","last_clean":"2024-09-14T13:02:10.134026+0000","last_became_active":"2024-09-14T11:08:21.778857+0000","last_became_peered":"2024-09-14T11:08:21.778857+0000","last_unstale":"2024-09-14T13:02:10.134026+0000","last_undegraded":"2024-09-14T13:02:10.134026+0000","last_fullsized":"2024-09-14T13:02:10.134026+0000","mapping_epoch":24,"log_start":"267'100","ondisk_log_start":"267'100","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'158","last_scrub_stamp":"2024-09-14T13:02:10.133843+0000","last_deep_scrub":"267'158","last_deep_scrub_stamp":"2024-09-14T13:02:10.133843+0000","last_clean_scrub_stamp":"2024-09-14T13:02:10.133843+0000","objects_scrubbed":0,"log_size":58,"log_dups_size":100,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:18:15.041071+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":436,"num_read_kb":8582,"num_write":806,"num_write_kb":19268,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,6],"acting":[2,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.25","version":"267'856","reported_seq":2578,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:58:58.047892+0000","last_change":"2024-09-14T11:08:23.810261+0000","last_active":"2024-09-14T12:58:58.047892+0000","last_peered":"2024-09-14T12:58:58.047892+0000","last_clean":"2024-09-14T12:58:58.047892+0000","last_became_active":"2024-09-14T11:08:23.808906+0000","last_became_peered":"2024-09-14T11:08:23.808906+0000","last_unstale":"2024-09-14T12:58:58.047892+0000","last_undegraded":"2024-09-14T12:58:58.047892+0000","last_fullsized":"2024-09-14T12:58:58.047892+0000","mapping_epoch":26,"log_start":"267'800","ondisk_log_start":"267'800","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:08:22.750609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:08:22.750609+0000","last_clean_scrub_stamp":"2024-09-14T11:08:22.750609+0000","objects_scrubbed":0,"log_size":56,"log_dups_size":800,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:40:05.413028+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":4244,"num_read_kb":3835,"num_write":1129,"num_write_kb":418,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.22","version":"267'246","reported_seq":963,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:13.387255+0000","last_change":"2024-09-14T13:02:13.387255+0000","last_active":"2024-09-14T13:02:13.387255+0000","last_peered":"2024-09-14T13:02:13.387255+0000","last_clean":"2024-09-14T13:02:13.387255+0000","last_became_active":"2024-09-14T11:08:21.795735+0000","last_became_peered":"2024-09-14T11:08:21.795735+0000","last_unstale":"2024-09-14T13:02:13.387255+0000","last_undegraded":"2024-09-14T13:02:13.387255+0000","last_fullsized":"2024-09-14T13:02:13.387255+0000","mapping_epoch":24,"log_start":"267'200","ondisk_log_start":"267'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'246","last_scrub_stamp":"2024-09-14T13:02:13.387035+0000","last_deep_scrub":"267'246","last_deep_scrub_stamp":"2024-09-14T13:02:13.387035+0000","last_clean_scrub_stamp":"2024-09-14T13:02:13.387035+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":200,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:34:00.780296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":704,"num_read_kb":92956,"num_write":1120,"num_write_kb":50908,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,0],"acting":[5,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.24","version":"267'426","reported_seq":2063,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:18.062230+0000","last_change":"2024-09-14T13:02:18.062230+0000","last_active":"2024-09-14T13:02:18.062230+0000","last_peered":"2024-09-14T13:02:18.062230+0000","last_clean":"2024-09-14T13:02:18.062230+0000","last_became_active":"2024-09-14T11:08:23.800722+0000","last_became_peered":"2024-09-14T11:08:23.800722+0000","last_unstale":"2024-09-14T13:02:18.062230+0000","last_undegraded":"2024-09-14T13:02:18.062230+0000","last_fullsized":"2024-09-14T13:02:18.062230+0000","mapping_epoch":26,"log_start":"267'400","ondisk_log_start":"267'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'426","last_scrub_stamp":"2024-09-14T13:02:18.062016+0000","last_deep_scrub":"267'426","last_deep_scrub_stamp":"2024-09-14T13:02:18.062016+0000","last_clean_scrub_stamp":"2024-09-14T13:02:18.062016+0000","objects_scrubbed":2,"log_size":26,"log_dups_size":400,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:49:37.783760+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2360,"num_read_kb":2243,"num_write":502,"num_write_kb":106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":252,"num_omap_keys":1,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.23","version":"267'220","reported_seq":902,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:08.038394+0000","last_change":"2024-09-14T13:02:08.038394+0000","last_active":"2024-09-14T13:02:08.038394+0000","last_peered":"2024-09-14T13:02:08.038394+0000","last_clean":"2024-09-14T13:02:08.038394+0000","last_became_active":"2024-09-14T11:08:21.815676+0000","last_became_peered":"2024-09-14T11:08:21.815676+0000","last_unstale":"2024-09-14T13:02:08.038394+0000","last_undegraded":"2024-09-14T13:02:08.038394+0000","last_fullsized":"2024-09-14T13:02:08.038394+0000","mapping_epoch":24,"log_start":"267'200","ondisk_log_start":"267'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'220","last_scrub_stamp":"2024-09-14T13:02:08.038198+0000","last_deep_scrub":"267'220","last_deep_scrub_stamp":"2024-09-14T13:02:08.038198+0000","last_clean_scrub_stamp":"2024-09-14T13:02:08.038198+0000","objects_scrubbed":2,"log_size":20,"log_dups_size":200,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:18:15.605049+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1655835,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":599,"num_read_kb":27875,"num_write":904,"num_write_kb":22739,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"267'896","reported_seq":2688,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:21.907268+0000","last_change":"2024-09-14T13:02:21.907268+0000","last_active":"2024-09-14T13:02:21.907268+0000","last_peered":"2024-09-14T13:02:21.907268+0000","last_clean":"2024-09-14T13:02:21.907268+0000","last_became_active":"2024-09-14T11:08:23.801373+0000","last_became_peered":"2024-09-14T11:08:23.801373+0000","last_unstale":"2024-09-14T13:02:21.907268+0000","last_undegraded":"2024-09-14T13:02:21.907268+0000","last_fullsized":"2024-09-14T13:02:21.907268+0000","mapping_epoch":26,"log_start":"267'800","ondisk_log_start":"267'800","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'896","last_scrub_stamp":"2024-09-14T13:02:21.907091+0000","last_deep_scrub":"267'896","last_deep_scrub_stamp":"2024-09-14T13:02:21.907091+0000","last_clean_scrub_stamp":"2024-09-14T13:02:21.907091+0000","objects_scrubbed":2,"log_size":96,"log_dups_size":800,"ondisk_log_size":96,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:05:33.862894+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":4489,"num_read_kb":4053,"num_write":1182,"num_write_kb":453,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2299,"num_omap_keys":9,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.24","version":"267'181","reported_seq":864,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:13.912432+0000","last_change":"2024-09-14T13:02:13.912432+0000","last_active":"2024-09-14T13:02:13.912432+0000","last_peered":"2024-09-14T13:02:13.912432+0000","last_clean":"2024-09-14T13:02:13.912432+0000","last_became_active":"2024-09-14T11:08:21.815768+0000","last_became_peered":"2024-09-14T11:08:21.815768+0000","last_unstale":"2024-09-14T13:02:13.912432+0000","last_undegraded":"2024-09-14T13:02:13.912432+0000","last_fullsized":"2024-09-14T13:02:13.912432+0000","mapping_epoch":24,"log_start":"267'100","ondisk_log_start":"267'100","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'181","last_scrub_stamp":"2024-09-14T13:02:13.912218+0000","last_deep_scrub":"267'181","last_deep_scrub_stamp":"2024-09-14T13:02:13.912218+0000","last_clean_scrub_stamp":"2024-09-14T13:02:13.912218+0000","objects_scrubbed":2,"log_size":81,"log_dups_size":100,"ondisk_log_size":81,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:34:44.221033+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":52,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":600,"num_read_kb":27323,"num_write":897,"num_write_kb":11503,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,0],"acting":[3,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"267'442","reported_seq":2006,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:19.739812+0000","last_change":"2024-09-14T13:02:19.739812+0000","last_active":"2024-09-14T13:02:19.739812+0000","last_peered":"2024-09-14T13:02:19.739812+0000","last_clean":"2024-09-14T13:02:19.739812+0000","last_became_active":"2024-09-14T11:08:23.814703+0000","last_became_peered":"2024-09-14T11:08:23.814703+0000","last_unstale":"2024-09-14T13:02:19.739812+0000","last_undegraded":"2024-09-14T13:02:19.739812+0000","last_fullsized":"2024-09-14T13:02:19.739812+0000","mapping_epoch":26,"log_start":"267'400","ondisk_log_start":"267'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'442","last_scrub_stamp":"2024-09-14T13:02:19.739631+0000","last_deep_scrub":"267'442","last_deep_scrub_stamp":"2024-09-14T13:02:19.739631+0000","last_clean_scrub_stamp":"2024-09-14T13:02:19.739631+0000","objects_scrubbed":1,"log_size":42,"log_dups_size":400,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:51:34.828557+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2315,"num_read_kb":2173,"num_write":509,"num_write_kb":111,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.25","version":"267'228","reported_seq":884,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:14.008418+0000","last_change":"2024-09-14T13:02:14.008418+0000","last_active":"2024-09-14T13:02:14.008418+0000","last_peered":"2024-09-14T13:02:14.008418+0000","last_clean":"2024-09-14T13:02:14.008418+0000","last_became_active":"2024-09-14T11:08:21.782389+0000","last_became_peered":"2024-09-14T11:08:21.782389+0000","last_unstale":"2024-09-14T13:02:14.008418+0000","last_undegraded":"2024-09-14T13:02:14.008418+0000","last_fullsized":"2024-09-14T13:02:14.008418+0000","mapping_epoch":24,"log_start":"267'200","ondisk_log_start":"267'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'228","last_scrub_stamp":"2024-09-14T13:02:14.008210+0000","last_deep_scrub":"267'228","last_deep_scrub_stamp":"2024-09-14T13:02:14.008210+0000","last_clean_scrub_stamp":"2024-09-14T13:02:14.008210+0000","objects_scrubbed":1,"log_size":28,"log_dups_size":200,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:24:23.674651+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":471,"num_read_kb":9844,"num_write":870,"num_write_kb":38372,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"267'1243","reported_seq":2976,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:19.912958+0000","last_change":"2024-09-14T13:02:19.912958+0000","last_active":"2024-09-14T13:02:19.912958+0000","last_peered":"2024-09-14T13:02:19.912958+0000","last_clean":"2024-09-14T13:02:19.912958+0000","last_became_active":"2024-09-14T11:08:23.785820+0000","last_became_peered":"2024-09-14T11:08:23.785820+0000","last_unstale":"2024-09-14T13:02:19.912958+0000","last_undegraded":"2024-09-14T13:02:19.912958+0000","last_fullsized":"2024-09-14T13:02:19.912958+0000","mapping_epoch":26,"log_start":"267'1200","ondisk_log_start":"267'1200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'1243","last_scrub_stamp":"2024-09-14T13:02:19.912720+0000","last_deep_scrub":"267'1243","last_deep_scrub_stamp":"2024-09-14T13:02:19.912720+0000","last_clean_scrub_stamp":"2024-09-14T13:02:19.912720+0000","objects_scrubbed":2,"log_size":43,"log_dups_size":1200,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:30:14.834421+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":5731,"num_read_kb":5079,"num_write":1712,"num_write_kb":696,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"267'214","reported_seq":938,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:11.283668+0000","last_change":"2024-09-14T13:02:11.283668+0000","last_active":"2024-09-14T13:02:11.283668+0000","last_peered":"2024-09-14T13:02:11.283668+0000","last_clean":"2024-09-14T13:02:11.283668+0000","last_became_active":"2024-09-14T11:08:21.824946+0000","last_became_peered":"2024-09-14T11:08:21.824946+0000","last_unstale":"2024-09-14T13:02:11.283668+0000","last_undegraded":"2024-09-14T13:02:11.283668+0000","last_fullsized":"2024-09-14T13:02:11.283668+0000","mapping_epoch":24,"log_start":"267'200","ondisk_log_start":"267'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'214","last_scrub_stamp":"2024-09-14T13:02:11.283441+0000","last_deep_scrub":"267'214","last_deep_scrub_stamp":"2024-09-14T13:02:11.283441+0000","last_clean_scrub_stamp":"2024-09-14T13:02:11.283441+0000","objects_scrubbed":4,"log_size":14,"log_dups_size":200,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T00:21:45.775876+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1655864,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":770,"num_read_kb":179397,"num_write":979,"num_write_kb":35238,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,4],"acting":[6,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.20","version":"267'1216","reported_seq":2946,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:18.359791+0000","last_change":"2024-09-14T13:02:18.359791+0000","last_active":"2024-09-14T13:02:18.359791+0000","last_peered":"2024-09-14T13:02:18.359791+0000","last_clean":"2024-09-14T13:02:18.359791+0000","last_became_active":"2024-09-14T11:08:23.803960+0000","last_became_peered":"2024-09-14T11:08:23.803960+0000","last_unstale":"2024-09-14T13:02:18.359791+0000","last_undegraded":"2024-09-14T13:02:18.359791+0000","last_fullsized":"2024-09-14T13:02:18.359791+0000","mapping_epoch":26,"log_start":"267'1200","ondisk_log_start":"267'1200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'1216","last_scrub_stamp":"2024-09-14T13:02:18.359610+0000","last_deep_scrub":"267'1216","last_deep_scrub_stamp":"2024-09-14T13:02:18.359610+0000","last_clean_scrub_stamp":"2024-09-14T13:02:18.359610+0000","objects_scrubbed":2,"log_size":16,"log_dups_size":1200,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:52:39.823830+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":5500,"num_read_kb":4892,"num_write":1634,"num_write_kb":643,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"267'220","reported_seq":879,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:12.010009+0000","last_change":"2024-09-14T13:02:12.010009+0000","last_active":"2024-09-14T13:02:12.010009+0000","last_peered":"2024-09-14T13:02:12.010009+0000","last_clean":"2024-09-14T13:02:12.010009+0000","last_became_active":"2024-09-14T11:08:56.033948+0000","last_became_peered":"2024-09-14T11:08:56.033948+0000","last_unstale":"2024-09-14T13:02:12.010009+0000","last_undegraded":"2024-09-14T13:02:12.010009+0000","last_fullsized":"2024-09-14T13:02:12.010009+0000","mapping_epoch":37,"log_start":"267'200","ondisk_log_start":"267'200","created":24,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'220","last_scrub_stamp":"2024-09-14T13:02:12.009666+0000","last_deep_scrub":"267'220","last_deep_scrub_stamp":"2024-09-14T13:02:12.009666+0000","last_clean_scrub_stamp":"2024-09-14T13:02:12.009666+0000","objects_scrubbed":2,"log_size":20,"log_dups_size":200,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:53:42.148559+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":41,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":570,"num_read_kb":57833,"num_write":1049,"num_write_kb":21583,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,2],"acting":[1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2f","version":"267'434","reported_seq":2053,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:17.078542+0000","last_change":"2024-09-14T13:02:17.078542+0000","last_active":"2024-09-14T13:02:17.078542+0000","last_peered":"2024-09-14T13:02:17.078542+0000","last_clean":"2024-09-14T13:02:17.078542+0000","last_became_active":"2024-09-14T11:08:23.786094+0000","last_became_peered":"2024-09-14T11:08:23.786094+0000","last_unstale":"2024-09-14T13:02:17.078542+0000","last_undegraded":"2024-09-14T13:02:17.078542+0000","last_fullsized":"2024-09-14T13:02:17.078542+0000","mapping_epoch":26,"log_start":"267'400","ondisk_log_start":"267'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'434","last_scrub_stamp":"2024-09-14T13:02:17.078358+0000","last_deep_scrub":"267'434","last_deep_scrub_stamp":"2024-09-14T13:02:17.078358+0000","last_clean_scrub_stamp":"2024-09-14T13:02:17.078358+0000","objects_scrubbed":1,"log_size":34,"log_dups_size":400,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T00:39:36.056692+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2284,"num_read_kb":2174,"num_write":475,"num_write_kb":81,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.28","version":"267'239","reported_seq":919,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:15.368994+0000","last_change":"2024-09-14T13:02:15.368994+0000","last_active":"2024-09-14T13:02:15.368994+0000","last_peered":"2024-09-14T13:02:15.368994+0000","last_clean":"2024-09-14T13:02:15.368994+0000","last_became_active":"2024-09-14T11:08:21.789114+0000","last_became_peered":"2024-09-14T11:08:21.789114+0000","last_unstale":"2024-09-14T13:02:15.368994+0000","last_undegraded":"2024-09-14T13:02:15.368994+0000","last_fullsized":"2024-09-14T13:02:15.368994+0000","mapping_epoch":24,"log_start":"267'200","ondisk_log_start":"267'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'239","last_scrub_stamp":"2024-09-14T13:02:15.368736+0000","last_deep_scrub":"267'239","last_deep_scrub_stamp":"2024-09-14T13:02:15.368736+0000","last_clean_scrub_stamp":"2024-09-14T13:02:15.368736+0000","objects_scrubbed":1,"log_size":39,"log_dups_size":200,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:43:13.070998+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":15,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":593,"num_read_kb":44666,"num_write":1104,"num_write_kb":41456,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,2],"acting":[5,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2e","version":"267'453","reported_seq":2219,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:21.736679+0000","last_change":"2024-09-14T13:02:21.736679+0000","last_active":"2024-09-14T13:02:21.736679+0000","last_peered":"2024-09-14T13:02:21.736679+0000","last_clean":"2024-09-14T13:02:21.736679+0000","last_became_active":"2024-09-14T11:08:23.792081+0000","last_became_peered":"2024-09-14T11:08:23.792081+0000","last_unstale":"2024-09-14T13:02:21.736679+0000","last_undegraded":"2024-09-14T13:02:21.736679+0000","last_fullsized":"2024-09-14T13:02:21.736679+0000","mapping_epoch":26,"log_start":"267'400","ondisk_log_start":"267'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'453","last_scrub_stamp":"2024-09-14T13:02:21.736487+0000","last_deep_scrub":"267'453","last_deep_scrub_stamp":"2024-09-14T13:02:21.736487+0000","last_clean_scrub_stamp":"2024-09-14T13:02:21.736487+0000","objects_scrubbed":2,"log_size":53,"log_dups_size":400,"ondisk_log_size":53,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:03:31.698697+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2579,"num_read_kb":2481,"num_write":491,"num_write_kb":76,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":220,"num_omap_keys":1,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.29","version":"267'201","reported_seq":905,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:14.155576+0000","last_change":"2024-09-14T13:02:14.155576+0000","last_active":"2024-09-14T13:02:14.155576+0000","last_peered":"2024-09-14T13:02:14.155576+0000","last_clean":"2024-09-14T13:02:14.155576+0000","last_became_active":"2024-09-14T11:08:56.039007+0000","last_became_peered":"2024-09-14T11:08:56.039007+0000","last_unstale":"2024-09-14T13:02:14.155576+0000","last_undegraded":"2024-09-14T13:02:14.155576+0000","last_fullsized":"2024-09-14T13:02:14.155576+0000","mapping_epoch":37,"log_start":"267'100","ondisk_log_start":"267'100","created":24,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'201","last_scrub_stamp":"2024-09-14T13:02:14.155355+0000","last_deep_scrub":"267'201","last_deep_scrub_stamp":"2024-09-14T13:02:14.155355+0000","last_clean_scrub_stamp":"2024-09-14T13:02:14.155355+0000","objects_scrubbed":0,"log_size":101,"log_dups_size":100,"ondisk_log_size":101,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:51:47.112960+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":677,"num_read_kb":34418,"num_write":912,"num_write_kb":30711,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4,1],"acting":[2,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2d","version":"267'383","reported_seq":1953,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:16.174203+0000","last_change":"2024-09-14T13:02:16.174203+0000","last_active":"2024-09-14T13:02:16.174203+0000","last_peered":"2024-09-14T13:02:16.174203+0000","last_clean":"2024-09-14T13:02:16.174203+0000","last_became_active":"2024-09-14T11:08:23.806568+0000","last_became_peered":"2024-09-14T11:08:23.806568+0000","last_unstale":"2024-09-14T13:02:16.174203+0000","last_undegraded":"2024-09-14T13:02:16.174203+0000","last_fullsized":"2024-09-14T13:02:16.174203+0000","mapping_epoch":26,"log_start":"267'300","ondisk_log_start":"267'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'383","last_scrub_stamp":"2024-09-14T13:02:16.173997+0000","last_deep_scrub":"267'383","last_deep_scrub_stamp":"2024-09-14T13:02:16.173997+0000","last_clean_scrub_stamp":"2024-09-14T13:02:16.173997+0000","objects_scrubbed":1,"log_size":83,"log_dups_size":300,"ondisk_log_size":83,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:32:46.305855+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2181,"num_read_kb":2088,"num_write":442,"num_write_kb":83,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":244,"num_omap_keys":1,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2a","version":"267'214","reported_seq":858,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:16.413733+0000","last_change":"2024-09-14T13:02:16.413733+0000","last_active":"2024-09-14T13:02:16.413733+0000","last_peered":"2024-09-14T13:02:16.413733+0000","last_clean":"2024-09-14T13:02:16.413733+0000","last_became_active":"2024-09-14T11:08:55.882680+0000","last_became_peered":"2024-09-14T11:08:55.882680+0000","last_unstale":"2024-09-14T13:02:16.413733+0000","last_undegraded":"2024-09-14T13:02:16.413733+0000","last_fullsized":"2024-09-14T13:02:16.413733+0000","mapping_epoch":37,"log_start":"267'200","ondisk_log_start":"267'200","created":24,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'214","last_scrub_stamp":"2024-09-14T13:02:16.413519+0000","last_deep_scrub":"267'214","last_deep_scrub_stamp":"2024-09-14T13:02:16.413519+0000","last_clean_scrub_stamp":"2024-09-14T13:02:16.413519+0000","objects_scrubbed":3,"log_size":14,"log_dups_size":200,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:42:07.787664+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1655850,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":491,"num_read_kb":10245,"num_write":964,"num_write_kb":42313,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,1],"acting":[5,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2c","version":"267'620","reported_seq":2469,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:20.699544+0000","last_change":"2024-09-14T13:02:20.699544+0000","last_active":"2024-09-14T13:02:20.699544+0000","last_peered":"2024-09-14T13:02:20.699544+0000","last_clean":"2024-09-14T13:02:20.699544+0000","last_became_active":"2024-09-14T11:08:23.815121+0000","last_became_peered":"2024-09-14T11:08:23.815121+0000","last_unstale":"2024-09-14T13:02:20.699544+0000","last_undegraded":"2024-09-14T13:02:20.699544+0000","last_fullsized":"2024-09-14T13:02:20.699544+0000","mapping_epoch":26,"log_start":"267'600","ondisk_log_start":"267'600","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'620","last_scrub_stamp":"2024-09-14T13:02:20.699374+0000","last_deep_scrub":"267'620","last_deep_scrub_stamp":"2024-09-14T13:02:20.699374+0000","last_clean_scrub_stamp":"2024-09-14T13:02:20.699374+0000","objects_scrubbed":3,"log_size":20,"log_dups_size":600,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:26:58.705973+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3483,"num_read_kb":3244,"num_write":793,"num_write_kb":264,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2264,"num_omap_keys":9,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2b","version":"267'200","reported_seq":854,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:07.028318+0000","last_change":"2024-09-14T13:02:07.028318+0000","last_active":"2024-09-14T13:02:07.028318+0000","last_peered":"2024-09-14T13:02:07.028318+0000","last_clean":"2024-09-14T13:02:07.028318+0000","last_became_active":"2024-09-14T11:08:21.788281+0000","last_became_peered":"2024-09-14T11:08:21.788281+0000","last_unstale":"2024-09-14T13:02:07.028318+0000","last_undegraded":"2024-09-14T13:02:07.028318+0000","last_fullsized":"2024-09-14T13:02:07.028318+0000","mapping_epoch":24,"log_start":"267'100","ondisk_log_start":"267'100","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'200","last_scrub_stamp":"2024-09-14T13:02:07.028196+0000","last_deep_scrub":"267'200","last_deep_scrub_stamp":"2024-09-14T13:02:07.028196+0000","last_clean_scrub_stamp":"2024-09-14T13:02:07.028196+0000","objects_scrubbed":2,"log_size":100,"log_dups_size":100,"ondisk_log_size":100,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:49:29.752326+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":52,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":436,"num_read_kb":38929,"num_write":900,"num_write_kb":25858,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,1],"acting":[0,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2b","version":"267'916","reported_seq":2525,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:22.632478+0000","last_change":"2024-09-14T13:02:22.632478+0000","last_active":"2024-09-14T13:02:22.632478+0000","last_peered":"2024-09-14T13:02:22.632478+0000","last_clean":"2024-09-14T13:02:22.632478+0000","last_became_active":"2024-09-14T11:08:23.806952+0000","last_became_peered":"2024-09-14T11:08:23.806952+0000","last_unstale":"2024-09-14T13:02:22.632478+0000","last_undegraded":"2024-09-14T13:02:22.632478+0000","last_fullsized":"2024-09-14T13:02:22.632478+0000","mapping_epoch":26,"log_start":"267'900","ondisk_log_start":"267'900","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'916","last_scrub_stamp":"2024-09-14T13:02:22.632309+0000","last_deep_scrub":"267'916","last_deep_scrub_stamp":"2024-09-14T13:02:22.632309+0000","last_clean_scrub_stamp":"2024-09-14T13:02:22.632309+0000","objects_scrubbed":4,"log_size":16,"log_dups_size":900,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:53:03.488492+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":4419,"num_read_kb":3921,"num_write":1287,"num_write_kb":515,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":267,"num_omap_keys":1,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"267'231","reported_seq":913,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:13.270037+0000","last_change":"2024-09-14T13:02:13.270037+0000","last_active":"2024-09-14T13:02:13.270037+0000","last_peered":"2024-09-14T13:02:13.270037+0000","last_clean":"2024-09-14T13:02:13.270037+0000","last_became_active":"2024-09-14T11:08:21.836420+0000","last_became_peered":"2024-09-14T11:08:21.836420+0000","last_unstale":"2024-09-14T13:02:13.270037+0000","last_undegraded":"2024-09-14T13:02:13.270037+0000","last_fullsized":"2024-09-14T13:02:13.270037+0000","mapping_epoch":24,"log_start":"267'200","ondisk_log_start":"267'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'231","last_scrub_stamp":"2024-09-14T13:02:13.269834+0000","last_deep_scrub":"267'231","last_deep_scrub_stamp":"2024-09-14T13:02:13.269834+0000","last_clean_scrub_stamp":"2024-09-14T13:02:13.269834+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":200,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:47:11.483558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":678,"num_read_kb":43780,"num_write":1054,"num_write_kb":42822,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.2a","version":"267'459","reported_seq":2096,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:13.094279+0000","last_change":"2024-09-14T13:02:13.094279+0000","last_active":"2024-09-14T13:02:13.094279+0000","last_peered":"2024-09-14T13:02:13.094279+0000","last_clean":"2024-09-14T13:02:13.094279+0000","last_became_active":"2024-09-14T11:08:23.776554+0000","last_became_peered":"2024-09-14T11:08:23.776554+0000","last_unstale":"2024-09-14T13:02:13.094279+0000","last_undegraded":"2024-09-14T13:02:13.094279+0000","last_fullsized":"2024-09-14T13:02:13.094279+0000","mapping_epoch":26,"log_start":"267'400","ondisk_log_start":"267'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'459","last_scrub_stamp":"2024-09-14T13:02:13.094066+0000","last_deep_scrub":"267'459","last_deep_scrub_stamp":"2024-09-14T13:02:13.094066+0000","last_clean_scrub_stamp":"2024-09-14T13:02:13.094066+0000","objects_scrubbed":2,"log_size":59,"log_dups_size":400,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:03:41.733902+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2491,"num_read_kb":2349,"num_write":540,"num_write_kb":122,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2d","version":"267'208","reported_seq":864,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:15.639487+0000","last_change":"2024-09-14T13:02:15.639487+0000","last_active":"2024-09-14T13:02:15.639487+0000","last_peered":"2024-09-14T13:02:15.639487+0000","last_clean":"2024-09-14T13:02:15.639487+0000","last_became_active":"2024-09-14T11:08:21.828333+0000","last_became_peered":"2024-09-14T11:08:21.828333+0000","last_unstale":"2024-09-14T13:02:15.639487+0000","last_undegraded":"2024-09-14T13:02:15.639487+0000","last_fullsized":"2024-09-14T13:02:15.639487+0000","mapping_epoch":24,"log_start":"267'100","ondisk_log_start":"267'100","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'208","last_scrub_stamp":"2024-09-14T13:02:15.639239+0000","last_deep_scrub":"267'208","last_deep_scrub_stamp":"2024-09-14T13:02:15.639239+0000","last_clean_scrub_stamp":"2024-09-14T13:02:15.639239+0000","objects_scrubbed":2,"log_size":108,"log_dups_size":100,"ondisk_log_size":108,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:07:15.141985+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":26,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":514,"num_read_kb":35640,"num_write":904,"num_write_kb":31502,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,6],"acting":[7,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.29","version":"267'783","reported_seq":2506,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:58:48.349738+0000","last_change":"2024-09-14T11:08:23.784873+0000","last_active":"2024-09-14T12:58:48.349738+0000","last_peered":"2024-09-14T12:58:48.349738+0000","last_clean":"2024-09-14T12:58:48.349738+0000","last_became_active":"2024-09-14T11:08:23.783522+0000","last_became_peered":"2024-09-14T11:08:23.783522+0000","last_unstale":"2024-09-14T12:58:48.349738+0000","last_undegraded":"2024-09-14T12:58:48.349738+0000","last_fullsized":"2024-09-14T12:58:48.349738+0000","mapping_epoch":26,"log_start":"267'700","ondisk_log_start":"267'700","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:08:22.750609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:08:22.750609+0000","last_clean_scrub_stamp":"2024-09-14T11:08:22.750609+0000","objects_scrubbed":0,"log_size":83,"log_dups_size":700,"ondisk_log_size":83,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:15:28.048272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":4481,"num_read_kb":4083,"num_write":1109,"num_write_kb":423,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"267'190","reported_seq":883,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:15.180078+0000","last_change":"2024-09-14T13:02:15.180078+0000","last_active":"2024-09-14T13:02:15.180078+0000","last_peered":"2024-09-14T13:02:15.180078+0000","last_clean":"2024-09-14T13:02:15.180078+0000","last_became_active":"2024-09-14T11:08:21.808348+0000","last_became_peered":"2024-09-14T11:08:21.808348+0000","last_unstale":"2024-09-14T13:02:15.180078+0000","last_undegraded":"2024-09-14T13:02:15.180078+0000","last_fullsized":"2024-09-14T13:02:15.180078+0000","mapping_epoch":24,"log_start":"267'100","ondisk_log_start":"267'100","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'190","last_scrub_stamp":"2024-09-14T13:02:15.179872+0000","last_deep_scrub":"267'190","last_deep_scrub_stamp":"2024-09-14T13:02:15.179872+0000","last_clean_scrub_stamp":"2024-09-14T13:02:15.179872+0000","objects_scrubbed":2,"log_size":90,"log_dups_size":100,"ondisk_log_size":90,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:01:20.740863+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":26,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":617,"num_read_kb":79967,"num_write":853,"num_write_kb":37043,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,1],"acting":[2,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"267'413","reported_seq":2123,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:21.644417+0000","last_change":"2024-09-14T13:02:21.644417+0000","last_active":"2024-09-14T13:02:21.644417+0000","last_peered":"2024-09-14T13:02:21.644417+0000","last_clean":"2024-09-14T13:02:21.644417+0000","last_became_active":"2024-09-14T11:08:23.802357+0000","last_became_peered":"2024-09-14T11:08:23.802357+0000","last_unstale":"2024-09-14T13:02:21.644417+0000","last_undegraded":"2024-09-14T13:02:21.644417+0000","last_fullsized":"2024-09-14T13:02:21.644417+0000","mapping_epoch":26,"log_start":"267'400","ondisk_log_start":"267'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'413","last_scrub_stamp":"2024-09-14T13:02:21.644233+0000","last_deep_scrub":"267'413","last_deep_scrub_stamp":"2024-09-14T13:02:21.644233+0000","last_clean_scrub_stamp":"2024-09-14T13:02:21.644233+0000","objects_scrubbed":2,"log_size":13,"log_dups_size":400,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:28:20.653691+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2549,"num_read_kb":2448,"num_write":474,"num_write_kb":95,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":640,"num_omap_keys":3,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2f","version":"267'225","reported_seq":957,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:17.443094+0000","last_change":"2024-09-14T13:02:17.443094+0000","last_active":"2024-09-14T13:02:17.443094+0000","last_peered":"2024-09-14T13:02:17.443094+0000","last_clean":"2024-09-14T13:02:17.443094+0000","last_became_active":"2024-09-14T11:08:55.884851+0000","last_became_peered":"2024-09-14T11:08:55.884851+0000","last_unstale":"2024-09-14T13:02:17.443094+0000","last_undegraded":"2024-09-14T13:02:17.443094+0000","last_fullsized":"2024-09-14T13:02:17.443094+0000","mapping_epoch":37,"log_start":"267'200","ondisk_log_start":"267'200","created":24,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'225","last_scrub_stamp":"2024-09-14T13:02:17.442773+0000","last_deep_scrub":"267'225","last_deep_scrub_stamp":"2024-09-14T13:02:17.442773+0000","last_clean_scrub_stamp":"2024-09-14T13:02:17.442773+0000","objects_scrubbed":4,"log_size":25,"log_dups_size":200,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T00:39:22.131524+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":41,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":799,"num_read_kb":23166,"num_write":1000,"num_write_kb":40111,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,1],"acting":[5,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"267'231","reported_seq":926,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:18.475827+0000","last_change":"2024-09-14T13:02:18.475827+0000","last_active":"2024-09-14T13:02:18.475827+0000","last_peered":"2024-09-14T13:02:18.475827+0000","last_clean":"2024-09-14T13:02:18.475827+0000","last_became_active":"2024-09-14T11:08:56.033792+0000","last_became_peered":"2024-09-14T11:08:56.033792+0000","last_unstale":"2024-09-14T13:02:18.475827+0000","last_undegraded":"2024-09-14T13:02:18.475827+0000","last_fullsized":"2024-09-14T13:02:18.475827+0000","mapping_epoch":37,"log_start":"267'200","ondisk_log_start":"267'200","created":24,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'231","last_scrub_stamp":"2024-09-14T13:02:18.475601+0000","last_deep_scrub":"267'231","last_deep_scrub_stamp":"2024-09-14T13:02:18.475601+0000","last_clean_scrub_stamp":"2024-09-14T13:02:18.475601+0000","objects_scrubbed":5,"log_size":31,"log_dups_size":200,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:44:49.980682+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":26,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":576,"num_read_kb":92149,"num_write":1016,"num_write_kb":50173,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,0],"acting":[5,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.37","version":"267'502","reported_seq":2185,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:21.955235+0000","last_change":"2024-09-14T13:02:21.955235+0000","last_active":"2024-09-14T13:02:21.955235+0000","last_peered":"2024-09-14T13:02:21.955235+0000","last_clean":"2024-09-14T13:02:21.955235+0000","last_became_active":"2024-09-14T11:08:23.786473+0000","last_became_peered":"2024-09-14T11:08:23.786473+0000","last_unstale":"2024-09-14T13:02:21.955235+0000","last_undegraded":"2024-09-14T13:02:21.955235+0000","last_fullsized":"2024-09-14T13:02:21.955235+0000","mapping_epoch":26,"log_start":"267'400","ondisk_log_start":"267'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'502","last_scrub_stamp":"2024-09-14T13:02:21.955052+0000","last_deep_scrub":"267'502","last_deep_scrub_stamp":"2024-09-14T13:02:21.955052+0000","last_clean_scrub_stamp":"2024-09-14T13:02:21.955052+0000","objects_scrubbed":2,"log_size":102,"log_dups_size":400,"ondisk_log_size":102,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:16:43.466742+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2870,"num_read_kb":2681,"num_write":627,"num_write_kb":170,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":219,"num_omap_keys":1,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"267'229","reported_seq":907,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:10.024200+0000","last_change":"2024-09-14T13:02:10.024200+0000","last_active":"2024-09-14T13:02:10.024200+0000","last_peered":"2024-09-14T13:02:10.024200+0000","last_clean":"2024-09-14T13:02:10.024200+0000","last_became_active":"2024-09-14T11:08:21.815731+0000","last_became_peered":"2024-09-14T11:08:21.815731+0000","last_unstale":"2024-09-14T13:02:10.024200+0000","last_undegraded":"2024-09-14T13:02:10.024200+0000","last_fullsized":"2024-09-14T13:02:10.024200+0000","mapping_epoch":24,"log_start":"267'200","ondisk_log_start":"267'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'229","last_scrub_stamp":"2024-09-14T13:02:10.023871+0000","last_deep_scrub":"267'229","last_deep_scrub_stamp":"2024-09-14T13:02:10.023871+0000","last_clean_scrub_stamp":"2024-09-14T13:02:10.023871+0000","objects_scrubbed":3,"log_size":29,"log_dups_size":200,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:09:15.766050+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":31,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":597,"num_read_kb":25561,"num_write":1006,"num_write_kb":42149,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,5],"acting":[1,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.36","version":"267'907","reported_seq":2494,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:59:38.056689+0000","last_change":"2024-09-14T11:08:23.797836+0000","last_active":"2024-09-14T12:59:38.056689+0000","last_peered":"2024-09-14T12:59:38.056689+0000","last_clean":"2024-09-14T12:59:38.056689+0000","last_became_active":"2024-09-14T11:08:23.797135+0000","last_became_peered":"2024-09-14T11:08:23.797135+0000","last_unstale":"2024-09-14T12:59:38.056689+0000","last_undegraded":"2024-09-14T12:59:38.056689+0000","last_fullsized":"2024-09-14T12:59:38.056689+0000","mapping_epoch":26,"log_start":"267'800","ondisk_log_start":"267'800","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:08:22.750609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:08:22.750609+0000","last_clean_scrub_stamp":"2024-09-14T11:08:22.750609+0000","objects_scrubbed":0,"log_size":107,"log_dups_size":800,"ondisk_log_size":107,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:35:11.421873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4302,"num_read_kb":3816,"num_write":1266,"num_write_kb":491,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]}],"pool_stats":[{"poolid":65,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10893,"num_read_kb":9222,"num_write":3117,"num_write_kb":1014,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1012,"ondisk_log_size":1012,"up":64,"acting":64,"num_store_stats":8},{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":14831,"num_objects":87,"num_object_clones":0,"num_object_copies":174,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":87,"num_whiteouts":0,"num_read":15223,"num_read_kb":14878,"num_write":17077,"num_write_kb":4995,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":19,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":557056,"data_stored":29662,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1708,"ondisk_log_size":1708,"up":64,"acting":64,"num_store_stats":8},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":467,"ondisk_log_size":467,"up":64,"acting":64,"num_store_stats":8},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":416072,"num_objects":199,"num_object_clones":0,"num_object_copies":398,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":199,"num_whiteouts":0,"num_read":11985,"num_read_kb":14520,"num_write":8681,"num_write_kb":3819,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":23,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":536998,"num_omap_keys":1218,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":278528,"data_stored":7404,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2030,"ondisk_log_size":2030,"up":64,"acting":64,"num_store_stats":8},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":1793,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":2383,"num_read_kb":2845,"num_write":20,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":3586,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":14,"ondisk_log_size":14,"up":64,"acting":64,"num_store_stats":8},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":143,"num_object_clones":0,"num_object_copies":286,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":143,"num_whiteouts":0,"num_read":221865,"num_read_kb":203092,"num_write":56157,"num_write_kb":19250,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":143,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":29071,"num_omap_keys":117,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3689,"ondisk_log_size":3689,"up":128,"acting":128,"num_store_stats":8},{"poolid":68,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":12,"num_read_kb":12,"num_write":18,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":6,"ondisk_log_size":6,"up":64,"acting":64,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":34033097,"num_objects":166,"num_object_clones":0,"num_object_copies":498,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":166,"num_whiteouts":0,"num_read":42946,"num_read_kb":2820718,"num_write":64530,"num_write_kb":2216242,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":52617216,"data_stored":52617216,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3536,"ondisk_log_size":3536,"up":192,"acting":192,"num_store_stats":8},{"poolid":67,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":172,"num_read_kb":198130,"num_write":186,"num_write_kb":125738,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":126,"ondisk_log_size":126,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":5,"ondisk_log_size":5,"up":16,"acting":16,"num_store_stats":7},{"poolid":66,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":168,"num_read_kb":188216,"num_write":186,"num_write_kb":125738,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":126,"ondisk_log_size":126,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":74,"ondisk_log_size":74,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834576222,"num_pgs":106,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":251264,"kb_used_data":13232,"kb_used_omap":1,"kb_used_meta":238014,"kb_avail":94120576,"statfs":{"total":96636764160,"available":96379469824,"internally_reserved":0,"allocated":13549568,"data_stored":11411092,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":243726794},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":13,"seq":55834576228,"num_pgs":99,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":242596,"kb_used_data":8724,"kb_used_omap":1,"kb_used_meta":233854,"kb_avail":94129244,"statfs":{"total":96636764160,"available":96388345856,"internally_reserved":0,"allocated":8933376,"data_stored":6850023,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":239466950},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":13,"seq":55834576226,"num_pgs":103,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":108024,"kb_used_data":10216,"kb_used_omap":1,"kb_used_meta":97790,"kb_avail":94263816,"statfs":{"total":96636764160,"available":96526147584,"internally_reserved":0,"allocated":10461184,"data_stored":8310166,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":100137413},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834576227,"num_pgs":105,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":121100,"kb_used_data":13564,"kb_used_omap":1,"kb_used_meta":107518,"kb_avail":94250740,"statfs":{"total":96636764160,"available":96512757760,"internally_reserved":0,"allocated":13889536,"data_stored":11826037,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":110098885},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":13,"seq":55834576229,"num_pgs":124,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":239884,"kb_used_data":10172,"kb_used_omap":1,"kb_used_meta":229694,"kb_avail":94131956,"statfs":{"total":96636764160,"available":96391122944,"internally_reserved":0,"allocated":10416128,"data_stored":8289369,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":235207111},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834576226,"num_pgs":92,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":79364,"kb_used_data":7924,"kb_used_omap":1,"kb_used_meta":71422,"kb_avail":94292476,"statfs":{"total":96636764160,"available":96555495424,"internally_reserved":0,"allocated":8114176,"data_stored":6032250,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":73136581},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834576229,"num_pgs":112,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":151660,"kb_used_data":12252,"kb_used_omap":1,"kb_used_meta":139390,"kb_avail":94220180,"statfs":{"total":96636764160,"available":96481464320,"internally_reserved":0,"allocated":12546048,"data_stored":10442210,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":142735813},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834576227,"num_pgs":109,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":240708,"kb_used_data":10996,"kb_used_omap":1,"kb_used_meta":229694,"kb_avail":94131132,"statfs":{"total":96636764160,"available":96390279168,"internally_reserved":0,"allocated":11259904,"data_stored":9137303,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":235207109},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":6234112,"data_stored":6234112,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8130560,"data_stored":8130560,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":3719168,"data_stored":3719168,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":5976064,"data_stored":5976064,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":9515008,"data_stored":9515008,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":5996544,"data_stored":5996544,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4538368,"data_stored":4538368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8507392,"data_stored":8507392,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":1139,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":46,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":1185,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":562,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":184,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":470,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":880,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":1018,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":330,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":1210,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":220,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":1458,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":814,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":1474,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":86016,"data_stored":3328,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":3091,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4091,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":86016,"data_stored":4619,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":2771,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":77824,"data_stored":4485,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":2895,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":86016,"data_stored":4382,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-14T13:02:28.537 INFO:tasks.ceph:pgid 68.1a last_scrub_stamp 2024-09-14T11:58:42.635024+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=42, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=2, tm_sec=2, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:02:28.537 INFO:tasks.ceph:pgid 67.1d last_scrub_stamp 2024-09-14T11:30:16.474654+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=30, tm_sec=16, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=2, tm_sec=2, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:02:28.537 INFO:tasks.ceph:pgid 66.1c last_scrub_stamp 2024-09-14T11:30:09.411354+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=30, tm_sec=9, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=2, tm_sec=2, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:02:28.537 INFO:tasks.ceph:pgid 65.1f last_scrub_stamp 2024-09-14T11:24:09.066501+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=24, tm_sec=9, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=2, tm_sec=2, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:02:28.537 INFO:tasks.ceph:pgid 68.1b last_scrub_stamp 2024-09-14T11:58:42.635024+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=42, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=2, tm_sec=2, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:02:28.537 INFO:tasks.ceph:pgid 67.1c last_scrub_stamp 2024-09-14T11:30:16.474654+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=30, tm_sec=16, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=2, tm_sec=2, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:02:28.537 INFO:tasks.ceph:pgid 66.1d last_scrub_stamp 2024-09-14T11:30:09.411354+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=30, tm_sec=9, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=2, tm_sec=2, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:02:28.538 INFO:tasks.ceph:pgid 65.1e last_scrub_stamp 2024-09-14T11:24:09.066501+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=24, tm_sec=9, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=2, tm_sec=2, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:02:28.538 INFO:tasks.ceph:pgid 68.18 last_scrub_stamp 2024-09-14T11:58:42.635024+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=42, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=2, tm_sec=2, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:02:28.538 INFO:tasks.ceph:pgid 67.1f last_scrub_stamp 2024-09-14T11:30:16.474654+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=30, tm_sec=16, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=2, tm_sec=2, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:02:28.538 INFO:tasks.ceph:pgid 66.1e last_scrub_stamp 2024-09-14T11:30:09.411354+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=30, tm_sec=9, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=2, tm_sec=2, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:02:28.538 INFO:tasks.ceph:pgid 65.1d last_scrub_stamp 2024-09-14T11:24:09.066501+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=24, tm_sec=9, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=2, tm_sec=2, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:02:28.538 INFO:tasks.ceph:pgid 68.19 last_scrub_stamp 2024-09-14T11:58:42.635024+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=42, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=2, tm_sec=2, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:02:28.538 INFO:tasks.ceph:pgid 67.1e last_scrub_stamp 2024-09-14T11:30:16.474654+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=30, tm_sec=16, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=2, tm_sec=2, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:02:28.538 INFO:tasks.ceph:pgid 66.1f last_scrub_stamp 2024-09-14T11:30:09.411354+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=30, tm_sec=9, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=2, tm_sec=2, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:02:28.539 INFO:tasks.ceph:pgid 65.1c last_scrub_stamp 2024-09-14T11:24:09.066501+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=24, tm_sec=9, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=2, tm_sec=2, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:02:28.539 INFO:tasks.ceph:pgid 68.1e last_scrub_stamp 2024-09-14T11:58:42.635024+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=42, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=2, tm_sec=2, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:02:28.539 INFO:tasks.ceph:pgid 67.19 last_scrub_stamp 2024-09-14T11:30:16.474654+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=30, tm_sec=16, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=2, tm_sec=2, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:02:28.539 INFO:tasks.ceph:pgid 66.18 last_scrub_stamp 2024-09-14T11:30:09.411354+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=30, tm_sec=9, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=2, tm_sec=2, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:02:28.539 INFO:tasks.ceph:pgid 65.1b last_scrub_stamp 2024-09-14T11:24:09.066501+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=24, tm_sec=9, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=2, tm_sec=2, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:02:28.539 INFO:tasks.ceph:pgid 68.1f last_scrub_stamp 2024-09-14T11:58:42.635024+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=42, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=2, tm_sec=2, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:02:28.539 INFO:tasks.ceph:pgid 67.18 last_scrub_stamp 2024-09-14T11:30:16.474654+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=30, tm_sec=16, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=2, tm_sec=2, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:02:28.539 INFO:tasks.ceph:pgid 66.19 last_scrub_stamp 2024-09-14T11:30:09.411354+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=30, tm_sec=9, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=2, tm_sec=2, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:02:28.540 INFO:tasks.ceph:pgid 65.1a last_scrub_stamp 2024-09-14T11:24:09.066501+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=24, tm_sec=9, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=2, tm_sec=2, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:02:28.540 INFO:tasks.ceph:pgid 68.1c last_scrub_stamp 2024-09-14T11:58:42.635024+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=42, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=2, tm_sec=2, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:02:28.540 INFO:tasks.ceph:pgid 67.1b last_scrub_stamp 2024-09-14T11:30:16.474654+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=30, tm_sec=16, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=2, tm_sec=2, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:02:28.540 INFO:tasks.ceph:pgid 66.1a last_scrub_stamp 2024-09-14T11:30:09.411354+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=30, tm_sec=9, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=2, tm_sec=2, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:02:28.540 INFO:tasks.ceph:pgid 65.19 last_scrub_stamp 2024-09-14T11:24:09.066501+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=24, tm_sec=9, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=2, tm_sec=2, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:02:28.540 INFO:tasks.ceph:pgid 68.1d last_scrub_stamp 2024-09-14T11:58:42.635024+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=42, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=2, tm_sec=2, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:02:28.540 INFO:tasks.ceph:pgid 67.1a last_scrub_stamp 2024-09-14T11:30:16.474654+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=30, tm_sec=16, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=2, tm_sec=2, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:02:28.540 INFO:tasks.ceph:pgid 66.1b last_scrub_stamp 2024-09-14T11:30:09.411354+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=30, tm_sec=9, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=2, tm_sec=2, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:02:28.540 INFO:tasks.ceph:pgid 65.18 last_scrub_stamp 2024-09-14T11:24:09.066501+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=24, tm_sec=9, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=2, tm_sec=2, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:02:28.541 INFO:tasks.ceph:pgid 68.12 last_scrub_stamp 2024-09-14T11:58:42.635024+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=42, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=2, tm_sec=2, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:02:28.541 INFO:tasks.ceph:pgid 67.15 last_scrub_stamp 2024-09-14T11:30:16.474654+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=30, tm_sec=16, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=2, tm_sec=2, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:02:28.541 INFO:tasks.ceph:pgid 66.14 last_scrub_stamp 2024-09-14T11:30:09.411354+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=30, tm_sec=9, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=2, tm_sec=2, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:02:28.541 INFO:tasks.ceph:pgid 65.17 last_scrub_stamp 2024-09-14T11:24:09.066501+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=24, tm_sec=9, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=2, tm_sec=2, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:02:28.541 INFO:tasks.ceph:pgid 68.13 last_scrub_stamp 2024-09-14T11:58:42.635024+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=42, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=2, tm_sec=2, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:02:28.541 INFO:tasks.ceph:pgid 67.14 last_scrub_stamp 2024-09-14T11:30:16.474654+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=30, tm_sec=16, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=2, tm_sec=2, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:02:28.541 INFO:tasks.ceph:pgid 66.15 last_scrub_stamp 2024-09-14T11:30:09.411354+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=30, tm_sec=9, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=2, tm_sec=2, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:02:28.541 INFO:tasks.ceph:pgid 65.16 last_scrub_stamp 2024-09-14T11:24:09.066501+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=24, tm_sec=9, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=2, tm_sec=2, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:02:28.542 INFO:tasks.ceph:pgid 68.10 last_scrub_stamp 2024-09-14T11:58:42.635024+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=42, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=2, tm_sec=2, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:02:28.542 INFO:tasks.ceph:pgid 67.17 last_scrub_stamp 2024-09-14T11:30:16.474654+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=30, tm_sec=16, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=2, tm_sec=2, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:02:28.542 INFO:tasks.ceph:pgid 66.16 last_scrub_stamp 2024-09-14T11:30:09.411354+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=30, tm_sec=9, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=2, tm_sec=2, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:02:28.542 INFO:tasks.ceph:pgid 65.15 last_scrub_stamp 2024-09-14T11:24:09.066501+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=24, tm_sec=9, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=2, tm_sec=2, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:02:28.542 INFO:tasks.ceph:pgid 68.11 last_scrub_stamp 2024-09-14T11:58:42.635024+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=42, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=2, tm_sec=2, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:02:28.542 INFO:tasks.ceph:pgid 67.16 last_scrub_stamp 2024-09-14T11:30:16.474654+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=30, tm_sec=16, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=2, tm_sec=2, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:02:28.542 INFO:tasks.ceph:pgid 66.17 last_scrub_stamp 2024-09-14T11:30:09.411354+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=30, tm_sec=9, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=2, tm_sec=2, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:02:28.542 INFO:tasks.ceph:pgid 65.14 last_scrub_stamp 2024-09-14T11:24:09.066501+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=24, tm_sec=9, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=2, tm_sec=2, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:02:28.542 INFO:tasks.ceph:pgid 68.16 last_scrub_stamp 2024-09-14T11:58:42.635024+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=42, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=2, tm_sec=2, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:02:28.543 INFO:tasks.ceph:pgid 67.11 last_scrub_stamp 2024-09-14T11:30:16.474654+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=30, tm_sec=16, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=2, tm_sec=2, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:02:28.543 INFO:tasks.ceph:pgid 66.10 last_scrub_stamp 2024-09-14T11:30:09.411354+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=30, tm_sec=9, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=2, tm_sec=2, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:02:28.543 INFO:tasks.ceph:pgid 65.13 last_scrub_stamp 2024-09-14T11:24:09.066501+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=24, tm_sec=9, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=2, tm_sec=2, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:02:28.543 INFO:tasks.ceph:pgid 68.17 last_scrub_stamp 2024-09-14T11:58:42.635024+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=42, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=2, tm_sec=2, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:02:28.543 INFO:tasks.ceph:pgid 67.10 last_scrub_stamp 2024-09-14T11:30:16.474654+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=30, tm_sec=16, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=2, tm_sec=2, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:02:28.543 INFO:tasks.ceph:pgid 66.11 last_scrub_stamp 2024-09-14T11:30:09.411354+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=30, tm_sec=9, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=2, tm_sec=2, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:02:28.543 INFO:tasks.ceph:pgid 65.12 last_scrub_stamp 2024-09-14T11:24:09.066501+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=24, tm_sec=9, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=2, tm_sec=2, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:02:28.543 INFO:tasks.ceph:pgid 68.14 last_scrub_stamp 2024-09-14T11:58:42.635024+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=42, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=2, tm_sec=2, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:02:28.544 INFO:tasks.ceph:pgid 67.13 last_scrub_stamp 2024-09-14T11:30:16.474654+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=30, tm_sec=16, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=2, tm_sec=2, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:02:28.544 INFO:tasks.ceph:pgid 66.12 last_scrub_stamp 2024-09-14T11:30:09.411354+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=30, tm_sec=9, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=2, tm_sec=2, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:02:28.544 INFO:tasks.ceph:pgid 65.11 last_scrub_stamp 2024-09-14T11:24:09.066501+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=24, tm_sec=9, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=2, tm_sec=2, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:02:28.544 INFO:tasks.ceph:pgid 68.15 last_scrub_stamp 2024-09-14T11:58:42.635024+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=42, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=2, tm_sec=2, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:02:28.544 INFO:tasks.ceph:pgid 67.12 last_scrub_stamp 2024-09-14T11:30:16.474654+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=30, tm_sec=16, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=2, tm_sec=2, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:02:28.544 INFO:tasks.ceph:pgid 66.13 last_scrub_stamp 2024-09-14T11:30:09.411354+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=30, tm_sec=9, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=2, tm_sec=2, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:02:28.544 INFO:tasks.ceph:pgid 65.10 last_scrub_stamp 2024-09-14T11:24:09.066501+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=24, tm_sec=9, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=2, tm_sec=2, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:02:28.544 INFO:tasks.ceph:pgid 68.a last_scrub_stamp 2024-09-14T11:58:42.635024+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=42, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=2, tm_sec=2, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:02:28.544 INFO:tasks.ceph:pgid 67.d last_scrub_stamp 2024-09-14T11:30:16.474654+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=30, tm_sec=16, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=2, tm_sec=2, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:02:28.545 INFO:tasks.ceph:pgid 66.c last_scrub_stamp 2024-09-14T11:30:09.411354+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=30, tm_sec=9, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=2, tm_sec=2, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:02:28.545 INFO:tasks.ceph:pgid 65.f last_scrub_stamp 2024-09-14T11:24:09.066501+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=24, tm_sec=9, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=2, tm_sec=2, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:02:28.545 INFO:tasks.ceph:pgid 68.b last_scrub_stamp 2024-09-14T11:58:42.635024+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=42, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=2, tm_sec=2, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:02:28.545 INFO:tasks.ceph:pgid 67.c last_scrub_stamp 2024-09-14T11:30:16.474654+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=30, tm_sec=16, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=2, tm_sec=2, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:02:28.545 INFO:tasks.ceph:pgid 66.d last_scrub_stamp 2024-09-14T11:30:09.411354+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=30, tm_sec=9, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=2, tm_sec=2, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:02:28.545 INFO:tasks.ceph:pgid 65.e last_scrub_stamp 2024-09-14T11:24:09.066501+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=24, tm_sec=9, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=2, tm_sec=2, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:02:28.545 INFO:tasks.ceph:pgid 68.8 last_scrub_stamp 2024-09-14T11:58:42.635024+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=42, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=2, tm_sec=2, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:02:28.545 INFO:tasks.ceph:pgid 67.f last_scrub_stamp 2024-09-14T11:30:16.474654+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=30, tm_sec=16, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=2, tm_sec=2, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:02:28.546 INFO:tasks.ceph:pgid 66.e last_scrub_stamp 2024-09-14T11:30:09.411354+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=30, tm_sec=9, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=2, tm_sec=2, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:02:28.546 INFO:tasks.ceph:pgid 65.d last_scrub_stamp 2024-09-14T11:24:09.066501+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=24, tm_sec=9, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=2, tm_sec=2, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:02:28.546 INFO:tasks.ceph:pgid 68.9 last_scrub_stamp 2024-09-14T11:58:42.635024+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=42, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=2, tm_sec=2, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:02:28.546 INFO:tasks.ceph:pgid 67.e last_scrub_stamp 2024-09-14T11:30:16.474654+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=30, tm_sec=16, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=2, tm_sec=2, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:02:28.546 INFO:tasks.ceph:pgid 66.f last_scrub_stamp 2024-09-14T11:30:09.411354+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=30, tm_sec=9, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=2, tm_sec=2, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:02:28.546 INFO:tasks.ceph:pgid 65.c last_scrub_stamp 2024-09-14T11:24:09.066501+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=24, tm_sec=9, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=2, tm_sec=2, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:02:28.546 INFO:tasks.ceph:pgid 68.e last_scrub_stamp 2024-09-14T11:58:42.635024+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=42, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=2, tm_sec=2, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:02:28.546 INFO:tasks.ceph:pgid 67.9 last_scrub_stamp 2024-09-14T11:30:16.474654+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=30, tm_sec=16, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=2, tm_sec=2, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:02:28.546 INFO:tasks.ceph:pgid 66.8 last_scrub_stamp 2024-09-14T11:30:09.411354+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=30, tm_sec=9, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=2, tm_sec=2, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:02:28.547 INFO:tasks.ceph:pgid 65.b last_scrub_stamp 2024-09-14T11:24:09.066501+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=24, tm_sec=9, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=2, tm_sec=2, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:02:28.547 INFO:tasks.ceph:pgid 68.f last_scrub_stamp 2024-09-14T11:58:42.635024+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=42, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=2, tm_sec=2, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:02:28.547 INFO:tasks.ceph:pgid 67.8 last_scrub_stamp 2024-09-14T11:30:16.474654+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=30, tm_sec=16, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=2, tm_sec=2, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:02:28.547 INFO:tasks.ceph:pgid 66.9 last_scrub_stamp 2024-09-14T11:30:09.411354+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=30, tm_sec=9, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=2, tm_sec=2, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:02:28.547 INFO:tasks.ceph:pgid 65.a last_scrub_stamp 2024-09-14T11:24:09.066501+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=24, tm_sec=9, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=2, tm_sec=2, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:02:28.547 INFO:tasks.ceph:pgid 68.c last_scrub_stamp 2024-09-14T11:58:42.635024+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=42, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=2, tm_sec=2, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:02:28.547 INFO:tasks.ceph:pgid 67.b last_scrub_stamp 2024-09-14T11:30:16.474654+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=30, tm_sec=16, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=2, tm_sec=2, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:02:28.547 INFO:tasks.ceph:pgid 66.a last_scrub_stamp 2024-09-14T11:30:09.411354+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=30, tm_sec=9, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=2, tm_sec=2, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:02:28.548 INFO:tasks.ceph:pgid 65.9 last_scrub_stamp 2024-09-14T11:24:09.066501+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=24, tm_sec=9, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=2, tm_sec=2, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:02:28.548 INFO:tasks.ceph:pgid 68.d last_scrub_stamp 2024-09-14T11:58:42.635024+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=42, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=2, tm_sec=2, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:02:28.548 INFO:tasks.ceph:pgid 67.a last_scrub_stamp 2024-09-14T11:30:16.474654+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=30, tm_sec=16, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=2, tm_sec=2, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:02:28.548 INFO:tasks.ceph:pgid 66.b last_scrub_stamp 2024-09-14T11:30:09.411354+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=30, tm_sec=9, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=2, tm_sec=2, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:02:28.548 INFO:tasks.ceph:pgid 65.8 last_scrub_stamp 2024-09-14T11:24:09.066501+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=24, tm_sec=9, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=2, tm_sec=2, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:02:28.548 INFO:tasks.ceph:pgid 68.2 last_scrub_stamp 2024-09-14T11:58:42.635024+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=42, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=2, tm_sec=2, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:02:28.548 INFO:tasks.ceph:pgid 67.5 last_scrub_stamp 2024-09-14T11:30:16.474654+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=30, tm_sec=16, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=2, tm_sec=2, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:02:28.548 INFO:tasks.ceph:pgid 66.4 last_scrub_stamp 2024-09-14T11:30:09.411354+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=30, tm_sec=9, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=2, tm_sec=2, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:02:28.549 INFO:tasks.ceph:pgid 65.7 last_scrub_stamp 2024-09-14T11:24:09.066501+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=24, tm_sec=9, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=2, tm_sec=2, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:02:28.549 INFO:tasks.ceph:pgid 68.3 last_scrub_stamp 2024-09-14T11:58:42.635024+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=42, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=2, tm_sec=2, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:02:28.549 INFO:tasks.ceph:pgid 67.4 last_scrub_stamp 2024-09-14T11:30:16.474654+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=30, tm_sec=16, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=2, tm_sec=2, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:02:28.549 INFO:tasks.ceph:pgid 66.5 last_scrub_stamp 2024-09-14T11:30:09.411354+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=30, tm_sec=9, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=2, tm_sec=2, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:02:28.549 INFO:tasks.ceph:pgid 65.6 last_scrub_stamp 2024-09-14T11:24:09.066501+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=24, tm_sec=9, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=2, tm_sec=2, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:02:28.549 INFO:tasks.ceph:pgid 68.0 last_scrub_stamp 2024-09-14T11:58:42.635024+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=42, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=2, tm_sec=2, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:02:28.549 INFO:tasks.ceph:pgid 67.7 last_scrub_stamp 2024-09-14T11:30:16.474654+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=30, tm_sec=16, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=2, tm_sec=2, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:02:28.549 INFO:tasks.ceph:pgid 66.6 last_scrub_stamp 2024-09-14T11:30:09.411354+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=30, tm_sec=9, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=2, tm_sec=2, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:02:28.549 INFO:tasks.ceph:pgid 65.5 last_scrub_stamp 2024-09-14T11:24:09.066501+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=24, tm_sec=9, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=2, tm_sec=2, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:02:28.550 INFO:tasks.ceph:pgid 68.1 last_scrub_stamp 2024-09-14T11:58:42.635024+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=42, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=2, tm_sec=2, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:02:28.550 INFO:tasks.ceph:pgid 67.6 last_scrub_stamp 2024-09-14T11:30:16.474654+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=30, tm_sec=16, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=2, tm_sec=2, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:02:28.550 INFO:tasks.ceph:pgid 66.7 last_scrub_stamp 2024-09-14T11:30:09.411354+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=30, tm_sec=9, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=2, tm_sec=2, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:02:28.550 INFO:tasks.ceph:pgid 65.4 last_scrub_stamp 2024-09-14T11:24:09.066501+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=24, tm_sec=9, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=2, tm_sec=2, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:02:28.550 INFO:tasks.ceph:pgid 68.6 last_scrub_stamp 2024-09-14T11:58:42.635024+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=42, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=2, tm_sec=2, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:02:28.550 INFO:tasks.ceph:pgid 67.1 last_scrub_stamp 2024-09-14T11:30:16.474654+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=30, tm_sec=16, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=2, tm_sec=2, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:02:28.550 INFO:tasks.ceph:pgid 66.0 last_scrub_stamp 2024-09-14T11:30:09.411354+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=30, tm_sec=9, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=2, tm_sec=2, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:02:28.550 INFO:tasks.ceph:pgid 65.3 last_scrub_stamp 2024-09-14T11:24:09.066501+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=24, tm_sec=9, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=2, tm_sec=2, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:02:28.550 INFO:tasks.ceph:pgid 68.7 last_scrub_stamp 2024-09-14T11:58:42.635024+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=42, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=2, tm_sec=2, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:02:28.551 INFO:tasks.ceph:pgid 67.0 last_scrub_stamp 2024-09-14T11:30:16.474654+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=30, tm_sec=16, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=2, tm_sec=2, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:02:28.551 INFO:tasks.ceph:pgid 66.1 last_scrub_stamp 2024-09-14T11:30:09.411354+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=30, tm_sec=9, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=2, tm_sec=2, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:02:28.551 INFO:tasks.ceph:pgid 65.2 last_scrub_stamp 2024-09-14T11:24:09.066501+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=24, tm_sec=9, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=2, tm_sec=2, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:02:28.551 INFO:tasks.ceph:pgid 68.4 last_scrub_stamp 2024-09-14T11:58:42.635024+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=42, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=2, tm_sec=2, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:02:28.551 INFO:tasks.ceph:pgid 67.3 last_scrub_stamp 2024-09-14T11:30:16.474654+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=30, tm_sec=16, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=2, tm_sec=2, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:02:28.551 INFO:tasks.ceph:pgid 66.2 last_scrub_stamp 2024-09-14T11:30:09.411354+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=30, tm_sec=9, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=2, tm_sec=2, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:02:28.551 INFO:tasks.ceph:pgid 65.1 last_scrub_stamp 2024-09-14T11:24:09.066501+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=24, tm_sec=9, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=2, tm_sec=2, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:02:28.551 INFO:tasks.ceph:pgid 68.5 last_scrub_stamp 2024-09-14T11:58:42.635024+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=42, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=2, tm_sec=2, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:02:28.552 INFO:tasks.ceph:pgid 67.2 last_scrub_stamp 2024-09-14T11:30:16.474654+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=30, tm_sec=16, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=2, tm_sec=2, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:02:28.552 INFO:tasks.ceph:pgid 66.3 last_scrub_stamp 2024-09-14T11:30:09.411354+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=30, tm_sec=9, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=2, tm_sec=2, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:02:28.552 INFO:tasks.ceph:pgid 65.0 last_scrub_stamp 2024-09-14T11:24:09.066501+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=24, tm_sec=9, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=2, tm_sec=2, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:02:28.552 INFO:tasks.ceph:pgid 4.38 last_scrub_stamp 2024-09-14T11:08:22.750609+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=8, tm_sec=22, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=2, tm_sec=2, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:02:28.552 INFO:tasks.ceph:pgid 4.39 last_scrub_stamp 2024-09-14T11:08:22.750609+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=8, tm_sec=22, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=2, tm_sec=2, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:02:28.552 INFO:tasks.ceph:pgid 4.3a last_scrub_stamp 2024-09-14T11:08:22.750609+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=8, tm_sec=22, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=2, tm_sec=2, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:02:28.552 INFO:tasks.ceph:pgid 4.3d last_scrub_stamp 2024-09-14T11:08:22.750609+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=8, tm_sec=22, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=2, tm_sec=2, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:02:28.553 INFO:tasks.ceph:pgid 4.3e last_scrub_stamp 2024-09-14T11:08:22.750609+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=8, tm_sec=22, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=2, tm_sec=2, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:02:28.553 INFO:tasks.ceph:pgid 4.31 last_scrub_stamp 2024-09-14T11:08:22.750609+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=8, tm_sec=22, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=2, tm_sec=2, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:02:28.553 INFO:tasks.ceph:pgid 4.32 last_scrub_stamp 2024-09-14T11:08:22.750609+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=8, tm_sec=22, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=2, tm_sec=2, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:02:28.553 INFO:tasks.ceph:pgid 4.33 last_scrub_stamp 2024-09-14T11:08:22.750609+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=8, tm_sec=22, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=2, tm_sec=2, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:02:28.553 INFO:tasks.ceph:pgid 4.35 last_scrub_stamp 2024-09-14T11:08:22.750609+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=8, tm_sec=22, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=2, tm_sec=2, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:02:28.553 INFO:tasks.ceph:pgid 8.18 last_scrub_stamp 2024-09-14T11:08:30.789404+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=8, tm_sec=30, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=2, tm_sec=2, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:02:28.553 INFO:tasks.ceph:pgid 5.15 last_scrub_stamp 2024-09-14T11:08:24.757170+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=8, tm_sec=24, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=2, tm_sec=2, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:02:28.554 INFO:tasks.ceph:pgid 6.16 last_scrub_stamp 2024-09-14T11:08:26.771628+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=8, tm_sec=26, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=2, tm_sec=2, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:02:28.554 INFO:tasks.ceph:pgid 7.17 last_scrub_stamp 2024-09-14T11:08:28.783586+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=8, tm_sec=28, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=2, tm_sec=2, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:02:28.554 INFO:tasks.ceph:pgid 8.19 last_scrub_stamp 2024-09-14T11:08:30.789404+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=8, tm_sec=30, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=2, tm_sec=2, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:02:28.554 INFO:tasks.ceph:pgid 6.17 last_scrub_stamp 2024-09-14T11:08:26.771628+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=8, tm_sec=26, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=2, tm_sec=2, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:02:28.554 INFO:tasks.ceph:pgid 7.16 last_scrub_stamp 2024-09-14T11:08:28.783586+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=8, tm_sec=28, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=2, tm_sec=2, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:02:28.554 INFO:tasks.ceph:pgid 8.1a last_scrub_stamp 2024-09-14T11:08:30.789404+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=8, tm_sec=30, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=2, tm_sec=2, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:02:28.554 INFO:tasks.ceph:pgid 5.17 last_scrub_stamp 2024-09-14T11:08:24.757170+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=8, tm_sec=24, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=2, tm_sec=2, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:02:28.555 INFO:tasks.ceph:pgid 6.14 last_scrub_stamp 2024-09-14T11:08:26.771628+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=8, tm_sec=26, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=2, tm_sec=2, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:02:28.555 INFO:tasks.ceph:pgid 7.15 last_scrub_stamp 2024-09-14T11:08:28.783586+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=8, tm_sec=28, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=2, tm_sec=2, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:02:28.555 INFO:tasks.ceph:pgid 8.1b last_scrub_stamp 2024-09-14T11:08:30.789404+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=8, tm_sec=30, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=2, tm_sec=2, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:02:28.555 INFO:tasks.ceph:pgid 5.16 last_scrub_stamp 2024-09-14T11:08:24.757170+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=8, tm_sec=24, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=2, tm_sec=2, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:02:28.555 INFO:tasks.ceph:pgid 6.15 last_scrub_stamp 2024-09-14T11:08:26.771628+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=8, tm_sec=26, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=2, tm_sec=2, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:02:28.555 INFO:tasks.ceph:pgid 7.14 last_scrub_stamp 2024-09-14T11:08:28.783586+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=8, tm_sec=28, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=2, tm_sec=2, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:02:28.555 INFO:tasks.ceph:pgid 5.9 last_scrub_stamp 2024-09-14T11:08:24.757170+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=8, tm_sec=24, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=2, tm_sec=2, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:02:28.555 INFO:tasks.ceph:pgid 6.a last_scrub_stamp 2024-09-14T11:08:26.771628+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=8, tm_sec=26, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=2, tm_sec=2, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:02:28.556 INFO:tasks.ceph:pgid 7.b last_scrub_stamp 2024-09-14T11:08:28.783586+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=8, tm_sec=28, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=2, tm_sec=2, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:02:28.556 INFO:tasks.ceph:pgid 8.4 last_scrub_stamp 2024-09-14T11:08:30.789404+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=8, tm_sec=30, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=2, tm_sec=2, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:02:28.556 INFO:tasks.ceph:pgid 6.b last_scrub_stamp 2024-09-14T11:08:26.771628+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=8, tm_sec=26, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=2, tm_sec=2, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:02:28.556 INFO:tasks.ceph:pgid 7.a last_scrub_stamp 2024-09-14T11:08:28.783586+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=8, tm_sec=28, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=2, tm_sec=2, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:02:28.556 INFO:tasks.ceph:pgid 8.5 last_scrub_stamp 2024-09-14T11:08:30.789404+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=8, tm_sec=30, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=2, tm_sec=2, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:02:28.556 INFO:tasks.ceph:pgid 5.b last_scrub_stamp 2024-09-14T11:08:24.757170+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=8, tm_sec=24, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=2, tm_sec=2, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:02:28.556 INFO:tasks.ceph:pgid 6.8 last_scrub_stamp 2024-09-14T11:08:26.771628+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=8, tm_sec=26, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=2, tm_sec=2, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:02:28.556 INFO:tasks.ceph:pgid 7.9 last_scrub_stamp 2024-09-14T11:08:28.783586+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=8, tm_sec=28, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=2, tm_sec=2, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:02:28.556 INFO:tasks.ceph:pgid 8.6 last_scrub_stamp 2024-09-14T11:08:30.789404+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=8, tm_sec=30, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=2, tm_sec=2, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:02:28.557 INFO:tasks.ceph:pgid 6.9 last_scrub_stamp 2024-09-14T11:08:26.771628+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=8, tm_sec=26, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=2, tm_sec=2, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:02:28.557 INFO:tasks.ceph:pgid 7.8 last_scrub_stamp 2024-09-14T11:08:28.783586+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=8, tm_sec=28, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=2, tm_sec=2, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:02:28.557 INFO:tasks.ceph:pgid 8.7 last_scrub_stamp 2024-09-14T11:08:30.789404+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=8, tm_sec=30, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=2, tm_sec=2, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:02:28.557 INFO:tasks.ceph:pgid 5.d last_scrub_stamp 2024-09-14T11:08:24.757170+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=8, tm_sec=24, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=2, tm_sec=2, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:02:28.557 INFO:tasks.ceph:pgid 6.e last_scrub_stamp 2024-09-14T11:08:26.771628+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=8, tm_sec=26, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=2, tm_sec=2, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:02:28.557 INFO:tasks.ceph:pgid 7.f last_scrub_stamp 2024-09-14T11:08:28.783586+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=8, tm_sec=28, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=2, tm_sec=2, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:02:28.557 INFO:tasks.ceph:pgid 8.0 last_scrub_stamp 2024-09-14T11:08:30.789404+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=8, tm_sec=30, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=2, tm_sec=2, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:02:28.558 INFO:tasks.ceph:pgid 6.f last_scrub_stamp 2024-09-14T11:08:26.771628+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=8, tm_sec=26, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=2, tm_sec=2, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:02:28.558 INFO:tasks.ceph:pgid 7.e last_scrub_stamp 2024-09-14T11:08:28.783586+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=8, tm_sec=28, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=2, tm_sec=2, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:02:28.558 INFO:tasks.ceph:pgid 8.1 last_scrub_stamp 2024-09-14T11:08:30.789404+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=8, tm_sec=30, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=2, tm_sec=2, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:02:28.558 INFO:tasks.ceph:pgid 5.f last_scrub_stamp 2024-09-14T11:08:24.757170+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=8, tm_sec=24, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=2, tm_sec=2, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:02:28.558 INFO:tasks.ceph:pgid 6.c last_scrub_stamp 2024-09-14T11:08:26.771628+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=8, tm_sec=26, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=2, tm_sec=2, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:02:28.558 INFO:tasks.ceph:pgid 7.d last_scrub_stamp 2024-09-14T11:08:28.783586+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=8, tm_sec=28, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=2, tm_sec=2, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:02:28.558 INFO:tasks.ceph:pgid 8.2 last_scrub_stamp 2024-09-14T11:08:30.789404+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=8, tm_sec=30, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=2, tm_sec=2, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:02:28.558 INFO:tasks.ceph:pgid 5.e last_scrub_stamp 2024-09-14T11:08:24.757170+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=8, tm_sec=24, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=2, tm_sec=2, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:02:28.558 INFO:tasks.ceph:pgid 6.d last_scrub_stamp 2024-09-14T11:08:26.771628+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=8, tm_sec=26, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=2, tm_sec=2, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:02:28.559 INFO:tasks.ceph:pgid 7.c last_scrub_stamp 2024-09-14T11:08:28.783586+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=8, tm_sec=28, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=2, tm_sec=2, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:02:28.559 INFO:tasks.ceph:pgid 8.3 last_scrub_stamp 2024-09-14T11:08:30.789404+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=8, tm_sec=30, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=2, tm_sec=2, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:02:28.559 INFO:tasks.ceph:pgid 5.4 last_scrub_stamp 2024-09-14T11:08:24.757170+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=8, tm_sec=24, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=2, tm_sec=2, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:02:28.559 INFO:tasks.ceph:pgid 6.7 last_scrub_stamp 2024-09-14T11:08:26.771628+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=8, tm_sec=26, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=2, tm_sec=2, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:02:28.559 INFO:tasks.ceph:pgid 7.6 last_scrub_stamp 2024-09-14T11:08:28.783586+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=8, tm_sec=28, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=2, tm_sec=2, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:02:28.559 INFO:tasks.ceph:pgid 8.9 last_scrub_stamp 2024-09-14T11:08:30.789404+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=8, tm_sec=30, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=2, tm_sec=2, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:02:28.559 INFO:tasks.ceph:pgid 5.7 last_scrub_stamp 2024-09-14T11:08:24.757170+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=8, tm_sec=24, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=2, tm_sec=2, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:02:28.559 INFO:tasks.ceph:pgid 7.5 last_scrub_stamp 2024-09-14T11:08:28.783586+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=8, tm_sec=28, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=2, tm_sec=2, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:02:28.560 INFO:tasks.ceph:pgid 8.a last_scrub_stamp 2024-09-14T11:08:30.789404+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=8, tm_sec=30, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=2, tm_sec=2, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:02:28.560 INFO:tasks.ceph:pgid 6.5 last_scrub_stamp 2024-09-14T11:08:26.771628+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=8, tm_sec=26, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=2, tm_sec=2, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:02:28.560 INFO:tasks.ceph:pgid 7.4 last_scrub_stamp 2024-09-14T11:08:28.783586+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=8, tm_sec=28, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=2, tm_sec=2, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:02:28.560 INFO:tasks.ceph:pgid 8.b last_scrub_stamp 2024-09-14T11:08:30.789404+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=8, tm_sec=30, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=2, tm_sec=2, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:02:28.560 INFO:tasks.ceph:pgid 6.6 last_scrub_stamp 2024-09-14T11:08:26.771628+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=8, tm_sec=26, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=2, tm_sec=2, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:02:28.560 INFO:tasks.ceph:pgid 7.7 last_scrub_stamp 2024-09-14T11:08:28.783586+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=8, tm_sec=28, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=2, tm_sec=2, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:02:28.560 INFO:tasks.ceph:pgid 8.8 last_scrub_stamp 2024-09-14T11:08:30.789404+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=8, tm_sec=30, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=2, tm_sec=2, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:02:28.561 INFO:tasks.ceph:pgid 5.3 last_scrub_stamp 2024-09-14T11:08:24.757170+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=8, tm_sec=24, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=2, tm_sec=2, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:02:28.561 INFO:tasks.ceph:pgid 7.1 last_scrub_stamp 2024-09-14T11:08:28.783586+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=8, tm_sec=28, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=2, tm_sec=2, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:02:28.561 INFO:tasks.ceph:pgid 8.e last_scrub_stamp 2024-09-14T11:08:30.789404+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=8, tm_sec=30, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=2, tm_sec=2, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:02:28.561 INFO:tasks.ceph:pgid 6.1 last_scrub_stamp 2024-09-14T11:08:26.771628+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=8, tm_sec=26, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=2, tm_sec=2, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:02:28.561 INFO:tasks.ceph:pgid 7.0 last_scrub_stamp 2024-09-14T11:08:28.783586+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=8, tm_sec=28, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=2, tm_sec=2, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:02:28.561 INFO:tasks.ceph:pgid 8.f last_scrub_stamp 2024-09-14T11:08:30.789404+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=8, tm_sec=30, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=2, tm_sec=2, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:02:28.561 INFO:tasks.ceph:pgid 5.1 last_scrub_stamp 2024-09-14T11:08:24.757170+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=8, tm_sec=24, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=2, tm_sec=2, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:02:28.561 INFO:tasks.ceph:pgid 6.2 last_scrub_stamp 2024-09-14T11:08:26.771628+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=8, tm_sec=26, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=2, tm_sec=2, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:02:28.562 INFO:tasks.ceph:pgid 7.3 last_scrub_stamp 2024-09-14T11:08:28.783586+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=8, tm_sec=28, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=2, tm_sec=2, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:02:28.562 INFO:tasks.ceph:pgid 8.c last_scrub_stamp 2024-09-14T11:08:30.789404+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=8, tm_sec=30, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=2, tm_sec=2, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:02:28.562 INFO:tasks.ceph:pgid 5.0 last_scrub_stamp 2024-09-14T11:08:24.757170+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=8, tm_sec=24, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=2, tm_sec=2, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:02:28.562 INFO:tasks.ceph:pgid 6.3 last_scrub_stamp 2024-09-14T11:08:26.771628+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=8, tm_sec=26, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=2, tm_sec=2, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:02:28.562 INFO:tasks.ceph:pgid 7.2 last_scrub_stamp 2024-09-14T11:08:28.783586+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=8, tm_sec=28, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=2, tm_sec=2, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:02:28.562 INFO:tasks.ceph:pgid 8.d last_scrub_stamp 2024-09-14T11:08:30.789404+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=8, tm_sec=30, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=2, tm_sec=2, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:02:28.562 INFO:tasks.ceph:pgid 8.1f last_scrub_stamp 2024-09-14T11:08:30.789404+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=8, tm_sec=30, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=2, tm_sec=2, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:02:28.562 INFO:tasks.ceph:pgid 6.11 last_scrub_stamp 2024-09-14T11:08:26.771628+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=8, tm_sec=26, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=2, tm_sec=2, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:02:28.563 INFO:tasks.ceph:pgid 7.10 last_scrub_stamp 2024-09-14T11:08:28.783586+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=8, tm_sec=28, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=2, tm_sec=2, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:02:28.563 INFO:tasks.ceph:pgid 8.1e last_scrub_stamp 2024-09-14T11:08:30.789404+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=8, tm_sec=30, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=2, tm_sec=2, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:02:28.563 INFO:tasks.ceph:pgid 5.13 last_scrub_stamp 2024-09-14T11:08:24.757170+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=8, tm_sec=24, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=2, tm_sec=2, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:02:28.563 INFO:tasks.ceph:pgid 6.10 last_scrub_stamp 2024-09-14T11:08:26.771628+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=8, tm_sec=26, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=2, tm_sec=2, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:02:28.563 INFO:tasks.ceph:pgid 7.11 last_scrub_stamp 2024-09-14T11:08:28.783586+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=8, tm_sec=28, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=2, tm_sec=2, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:02:28.563 INFO:tasks.ceph:pgid 8.1d last_scrub_stamp 2024-09-14T11:08:30.789404+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=8, tm_sec=30, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=2, tm_sec=2, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:02:28.563 INFO:tasks.ceph:pgid 5.10 last_scrub_stamp 2024-09-14T11:08:24.757170+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=8, tm_sec=24, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=2, tm_sec=2, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:02:28.563 INFO:tasks.ceph:pgid 6.13 last_scrub_stamp 2024-09-14T11:08:26.771628+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=8, tm_sec=26, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=2, tm_sec=2, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:02:28.564 INFO:tasks.ceph:pgid 7.12 last_scrub_stamp 2024-09-14T11:08:28.783586+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=8, tm_sec=28, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=2, tm_sec=2, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:02:28.564 INFO:tasks.ceph:pgid 8.1c last_scrub_stamp 2024-09-14T11:08:30.789404+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=8, tm_sec=30, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=2, tm_sec=2, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:02:28.564 INFO:tasks.ceph:pgid 6.12 last_scrub_stamp 2024-09-14T11:08:26.771628+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=8, tm_sec=26, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=2, tm_sec=2, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:02:28.564 INFO:tasks.ceph:pgid 7.13 last_scrub_stamp 2024-09-14T11:08:28.783586+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=8, tm_sec=28, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=2, tm_sec=2, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:02:28.564 INFO:tasks.ceph:pgid 5.1e last_scrub_stamp 2024-09-14T11:08:24.757170+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=8, tm_sec=24, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=2, tm_sec=2, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:02:28.564 INFO:tasks.ceph:pgid 6.1d last_scrub_stamp 2024-09-14T11:08:26.771628+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=8, tm_sec=26, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=2, tm_sec=2, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:02:28.564 INFO:tasks.ceph:pgid 7.1c last_scrub_stamp 2024-09-14T11:08:28.783586+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=8, tm_sec=28, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=2, tm_sec=2, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:02:28.564 INFO:tasks.ceph:pgid 8.13 last_scrub_stamp 2024-09-14T11:08:30.789404+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=8, tm_sec=30, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=2, tm_sec=2, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:02:28.565 INFO:tasks.ceph:pgid 6.1c last_scrub_stamp 2024-09-14T11:08:26.771628+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=8, tm_sec=26, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=2, tm_sec=2, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:02:28.565 INFO:tasks.ceph:pgid 7.1d last_scrub_stamp 2024-09-14T11:08:28.783586+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=8, tm_sec=28, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=2, tm_sec=2, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:02:28.565 INFO:tasks.ceph:pgid 8.12 last_scrub_stamp 2024-09-14T11:08:30.789404+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=8, tm_sec=30, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=2, tm_sec=2, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:02:28.565 INFO:tasks.ceph:pgid 5.1c last_scrub_stamp 2024-09-14T11:08:24.757170+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=8, tm_sec=24, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=2, tm_sec=2, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:02:28.565 INFO:tasks.ceph:pgid 6.1f last_scrub_stamp 2024-09-14T11:08:26.771628+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=8, tm_sec=26, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=2, tm_sec=2, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:02:28.565 INFO:tasks.ceph:pgid 7.1e last_scrub_stamp 2024-09-14T11:08:28.783586+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=8, tm_sec=28, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=2, tm_sec=2, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:02:28.565 INFO:tasks.ceph:pgid 8.11 last_scrub_stamp 2024-09-14T11:08:30.789404+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=8, tm_sec=30, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=2, tm_sec=2, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:02:28.565 INFO:tasks.ceph:pgid 5.1d last_scrub_stamp 2024-09-14T11:08:24.757170+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=8, tm_sec=24, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=2, tm_sec=2, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:02:28.566 INFO:tasks.ceph:pgid 6.1e last_scrub_stamp 2024-09-14T11:08:26.771628+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=8, tm_sec=26, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=2, tm_sec=2, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:02:28.566 INFO:tasks.ceph:pgid 7.1f last_scrub_stamp 2024-09-14T11:08:28.783586+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=8, tm_sec=28, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=2, tm_sec=2, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:02:28.566 INFO:tasks.ceph:pgid 8.10 last_scrub_stamp 2024-09-14T11:08:30.789404+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=8, tm_sec=30, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=2, tm_sec=2, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:02:28.566 INFO:tasks.ceph:pgid 5.1a last_scrub_stamp 2024-09-14T11:08:24.757170+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=8, tm_sec=24, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=2, tm_sec=2, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:02:28.566 INFO:tasks.ceph:pgid 6.19 last_scrub_stamp 2024-09-14T11:08:26.771628+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=8, tm_sec=26, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=2, tm_sec=2, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:02:28.566 INFO:tasks.ceph:pgid 7.18 last_scrub_stamp 2024-09-14T11:08:28.783586+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=8, tm_sec=28, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=2, tm_sec=2, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:02:28.566 INFO:tasks.ceph:pgid 8.17 last_scrub_stamp 2024-09-14T11:08:30.789404+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=8, tm_sec=30, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=2, tm_sec=2, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:02:28.566 INFO:tasks.ceph:pgid 5.1b last_scrub_stamp 2024-09-14T11:08:24.757170+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=8, tm_sec=24, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=2, tm_sec=2, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:02:28.566 INFO:tasks.ceph:pgid 6.18 last_scrub_stamp 2024-09-14T11:08:26.771628+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=8, tm_sec=26, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=2, tm_sec=2, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:02:28.567 INFO:tasks.ceph:pgid 7.19 last_scrub_stamp 2024-09-14T11:08:28.783586+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=8, tm_sec=28, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=2, tm_sec=2, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:02:28.567 INFO:tasks.ceph:pgid 8.16 last_scrub_stamp 2024-09-14T11:08:30.789404+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=8, tm_sec=30, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=2, tm_sec=2, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:02:28.567 INFO:tasks.ceph:pgid 5.18 last_scrub_stamp 2024-09-14T11:08:24.757170+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=8, tm_sec=24, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=2, tm_sec=2, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:02:28.567 INFO:tasks.ceph:pgid 6.1b last_scrub_stamp 2024-09-14T11:08:26.771628+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=8, tm_sec=26, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=2, tm_sec=2, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:02:28.567 INFO:tasks.ceph:pgid 7.1a last_scrub_stamp 2024-09-14T11:08:28.783586+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=8, tm_sec=28, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=2, tm_sec=2, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:02:28.567 INFO:tasks.ceph:pgid 8.15 last_scrub_stamp 2024-09-14T11:08:30.789404+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=8, tm_sec=30, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=2, tm_sec=2, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:02:28.567 INFO:tasks.ceph:pgid 5.19 last_scrub_stamp 2024-09-14T11:08:24.757170+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=8, tm_sec=24, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=2, tm_sec=2, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:02:28.567 INFO:tasks.ceph:pgid 6.1a last_scrub_stamp 2024-09-14T11:08:26.771628+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=8, tm_sec=26, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=2, tm_sec=2, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:02:28.567 INFO:tasks.ceph:pgid 7.1b last_scrub_stamp 2024-09-14T11:08:28.783586+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=8, tm_sec=28, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=2, tm_sec=2, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:02:28.568 INFO:tasks.ceph:pgid 8.14 last_scrub_stamp 2024-09-14T11:08:30.789404+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=8, tm_sec=30, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=2, tm_sec=2, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:02:28.568 INFO:tasks.ceph:pgid 4.25 last_scrub_stamp 2024-09-14T11:08:22.750609+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=8, tm_sec=22, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=2, tm_sec=2, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:02:28.568 INFO:tasks.ceph:pgid 4.29 last_scrub_stamp 2024-09-14T11:08:22.750609+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=8, tm_sec=22, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=2, tm_sec=2, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:02:28.568 INFO:tasks.ceph:pgid 4.36 last_scrub_stamp 2024-09-14T11:08:22.750609+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=8, tm_sec=22, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=2, tm_sec=2, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:02:28.568 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-09-14T13:02:48.569 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-14T13:02:48.932 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-09-14T13:02:48.944 INFO:teuthology.orchestra.run.smithi138.stderr:dumped all 2024-09-14T13:02:48.950 INFO:teuthology.orchestra.run.smithi138.stdout:{"pg_ready":true,"pg_map":{"version":3700,"stamp":"2024-09-14T13:02:47.326544+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":35056180,"num_objects":619,"num_object_clones":0,"num_object_copies":1404,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":619,"num_whiteouts":0,"num_read":305713,"num_read_kb":3451688,"num_write":150075,"num_write_kb":2498451,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":191,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":752034,"num_omap_keys":1795,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":12771,"ondisk_log_size":12771,"up":850,"acting":850,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":850,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":1444328,"kb_used_data":87080,"kb_used_omap":12,"kb_used_meta":1357107,"kb_avail":753530392,"statfs":{"total":773094113280,"available":771615121408,"internally_reserved":0,"allocated":89169920,"data_stored":72298450,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":1389678128},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":32346,"num_omap_keys":88,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.008844"},"pg_stats":[{"pgid":"68.1a","version":"0'0","reported_seq":38,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:58:43.044370+0000","last_change":"2024-09-14T11:58:43.698171+0000","last_active":"2024-09-14T12:58:43.044370+0000","last_peered":"2024-09-14T12:58:43.044370+0000","last_clean":"2024-09-14T12:58:43.044370+0000","last_became_active":"2024-09-14T11:58:43.694936+0000","last_became_peered":"2024-09-14T11:58:43.694936+0000","last_unstale":"2024-09-14T12:58:43.044370+0000","last_undegraded":"2024-09-14T12:58:43.044370+0000","last_fullsized":"2024-09-14T12:58:43.044370+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:58:42.635024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:58:42.635024+0000","last_clean_scrub_stamp":"2024-09-14T11:58:42.635024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:02:52.327879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.1d","version":"264'2","reported_seq":63,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:57:48.032148+0000","last_change":"2024-09-14T11:30:17.527028+0000","last_active":"2024-09-14T12:57:48.032148+0000","last_peered":"2024-09-14T12:57:48.032148+0000","last_clean":"2024-09-14T12:57:48.032148+0000","last_became_active":"2024-09-14T11:30:17.525157+0000","last_became_peered":"2024-09-14T11:30:17.525157+0000","last_unstale":"2024-09-14T12:57:48.032148+0000","last_undegraded":"2024-09-14T12:57:48.032148+0000","last_fullsized":"2024-09-14T12:57:48.032148+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:30:16.474654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:30:16.474654+0000","last_clean_scrub_stamp":"2024-09-14T11:30:16.474654+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:14:59.272162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":4096,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.1c","version":"267'6","reported_seq":77,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:00.396953+0000","last_change":"2024-09-14T11:30:10.466403+0000","last_active":"2024-09-14T13:02:00.396953+0000","last_peered":"2024-09-14T13:02:00.396953+0000","last_clean":"2024-09-14T13:02:00.396953+0000","last_became_active":"2024-09-14T11:30:10.460441+0000","last_became_peered":"2024-09-14T11:30:10.460441+0000","last_unstale":"2024-09-14T13:02:00.396953+0000","last_undegraded":"2024-09-14T13:02:00.396953+0000","last_fullsized":"2024-09-14T13:02:00.396953+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:30:09.411354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:30:09.411354+0000","last_clean_scrub_stamp":"2024-09-14T11:30:09.411354+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":6189,"num_write":6,"num_write_kb":5165,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.1f","version":"267'84","reported_seq":313,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:00:03.259594+0000","last_change":"2024-09-14T11:24:10.106139+0000","last_active":"2024-09-14T13:00:03.259594+0000","last_peered":"2024-09-14T13:00:03.259594+0000","last_clean":"2024-09-14T13:00:03.259594+0000","last_became_active":"2024-09-14T11:24:10.104105+0000","last_became_peered":"2024-09-14T11:24:10.104105+0000","last_unstale":"2024-09-14T13:00:03.259594+0000","last_undegraded":"2024-09-14T13:00:03.259594+0000","last_fullsized":"2024-09-14T13:00:03.259594+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:24:09.066501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:24:09.066501+0000","last_clean_scrub_stamp":"2024-09-14T11:24:09.066501+0000","objects_scrubbed":0,"log_size":84,"log_dups_size":0,"ondisk_log_size":84,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":704,"num_read_kb":504,"num_write":208,"num_write_kb":68,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.1b","version":"0'0","reported_seq":46,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:40.128400+0000","last_change":"2024-09-14T13:02:40.128400+0000","last_active":"2024-09-14T13:02:40.128400+0000","last_peered":"2024-09-14T13:02:40.128400+0000","last_clean":"2024-09-14T13:02:40.128400+0000","last_became_active":"2024-09-14T11:58:43.693847+0000","last_became_peered":"2024-09-14T11:58:43.693847+0000","last_unstale":"2024-09-14T13:02:40.128400+0000","last_undegraded":"2024-09-14T13:02:40.128400+0000","last_fullsized":"2024-09-14T13:02:40.128400+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T13:02:40.128214+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T13:02:40.128214+0000","last_clean_scrub_stamp":"2024-09-14T13:02:40.128214+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:40:52.505545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.1c","version":"267'9","reported_seq":74,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:00.330927+0000","last_change":"2024-09-14T11:30:17.525550+0000","last_active":"2024-09-14T13:02:00.330927+0000","last_peered":"2024-09-14T13:02:00.330927+0000","last_clean":"2024-09-14T13:02:00.330927+0000","last_became_active":"2024-09-14T11:30:17.524810+0000","last_became_peered":"2024-09-14T11:30:17.524810+0000","last_unstale":"2024-09-14T13:02:00.330927+0000","last_undegraded":"2024-09-14T13:02:00.330927+0000","last_fullsized":"2024-09-14T13:02:00.330927+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:30:16.474654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:30:16.474654+0000","last_clean_scrub_stamp":"2024-09-14T11:30:16.474654+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:05:01.153652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":11636,"num_write":14,"num_write_kb":6842,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.1d","version":"0'0","reported_seq":74,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:37.223730+0000","last_change":"2024-09-14T13:02:37.223612+0000","last_active":"2024-09-14T13:02:37.223730+0000","last_peered":"2024-09-14T13:02:37.223730+0000","last_clean":"2024-09-14T13:02:37.223730+0000","last_became_active":"2024-09-14T11:30:10.474889+0000","last_became_peered":"2024-09-14T11:30:10.474889+0000","last_unstale":"2024-09-14T13:02:37.223730+0000","last_undegraded":"2024-09-14T13:02:37.223730+0000","last_fullsized":"2024-09-14T13:02:37.223730+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T13:02:37.223419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T13:02:37.223419+0000","last_clean_scrub_stamp":"2024-09-14T13:02:37.223419+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:31:29.150342+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.1e","version":"267'279","reported_seq":921,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:32.120221+0000","last_change":"2024-09-14T13:02:32.120056+0000","last_active":"2024-09-14T13:02:32.120221+0000","last_peered":"2024-09-14T13:02:32.120221+0000","last_clean":"2024-09-14T13:02:32.120221+0000","last_became_active":"2024-09-14T11:24:10.090434+0000","last_became_peered":"2024-09-14T11:24:10.090434+0000","last_unstale":"2024-09-14T13:02:32.120221+0000","last_undegraded":"2024-09-14T13:02:32.120221+0000","last_fullsized":"2024-09-14T13:02:32.120221+0000","mapping_epoch":254,"log_start":"264'200","ondisk_log_start":"264'200","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'279","last_scrub_stamp":"2024-09-14T13:02:32.119867+0000","last_deep_scrub":"267'279","last_deep_scrub_stamp":"2024-09-14T13:02:32.119867+0000","last_clean_scrub_stamp":"2024-09-14T13:02:32.119867+0000","objects_scrubbed":0,"log_size":79,"log_dups_size":200,"ondisk_log_size":79,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:06:39.963045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2587,"num_read_kb":3188,"num_write":542,"num_write_kb":246,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.18","version":"0'0","reported_seq":39,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:59:08.431805+0000","last_change":"2024-09-14T11:58:43.686083+0000","last_active":"2024-09-14T12:59:08.431805+0000","last_peered":"2024-09-14T12:59:08.431805+0000","last_clean":"2024-09-14T12:59:08.431805+0000","last_became_active":"2024-09-14T11:58:43.685333+0000","last_became_peered":"2024-09-14T11:58:43.685333+0000","last_unstale":"2024-09-14T12:59:08.431805+0000","last_undegraded":"2024-09-14T12:59:08.431805+0000","last_fullsized":"2024-09-14T12:59:08.431805+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:58:42.635024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:58:42.635024+0000","last_clean_scrub_stamp":"2024-09-14T11:58:42.635024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:32:25.076693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"67.1f","version":"267'4","reported_seq":74,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:01:58.286722+0000","last_change":"2024-09-14T11:30:17.501198+0000","last_active":"2024-09-14T13:01:58.286722+0000","last_peered":"2024-09-14T13:01:58.286722+0000","last_clean":"2024-09-14T13:01:58.286722+0000","last_became_active":"2024-09-14T11:30:17.500369+0000","last_became_peered":"2024-09-14T11:30:17.500369+0000","last_unstale":"2024-09-14T13:01:58.286722+0000","last_undegraded":"2024-09-14T13:01:58.286722+0000","last_fullsized":"2024-09-14T13:01:58.286722+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:30:16.474654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:30:16.474654+0000","last_clean_scrub_stamp":"2024-09-14T11:30:16.474654+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:11:41.361082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":8192,"num_write":4,"num_write_kb":8192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.1e","version":"264'4","reported_seq":93,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:35.163956+0000","last_change":"2024-09-14T13:02:35.163772+0000","last_active":"2024-09-14T13:02:35.163956+0000","last_peered":"2024-09-14T13:02:35.163956+0000","last_clean":"2024-09-14T13:02:35.163956+0000","last_became_active":"2024-09-14T11:30:10.445613+0000","last_became_peered":"2024-09-14T11:30:10.445613+0000","last_unstale":"2024-09-14T13:02:35.163956+0000","last_undegraded":"2024-09-14T13:02:35.163956+0000","last_fullsized":"2024-09-14T13:02:35.163956+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'4","last_scrub_stamp":"2024-09-14T13:02:35.163594+0000","last_deep_scrub":"264'4","last_deep_scrub_stamp":"2024-09-14T13:02:35.163594+0000","last_clean_scrub_stamp":"2024-09-14T13:02:35.163594+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:53:06.574290+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":4098,"num_write":4,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.1d","version":"267'16","reported_seq":119,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:59:13.248167+0000","last_change":"2024-09-14T11:24:10.112019+0000","last_active":"2024-09-14T12:59:13.248167+0000","last_peered":"2024-09-14T12:59:13.248167+0000","last_clean":"2024-09-14T12:59:13.248167+0000","last_became_active":"2024-09-14T11:24:10.111323+0000","last_became_peered":"2024-09-14T11:24:10.111323+0000","last_unstale":"2024-09-14T12:59:13.248167+0000","last_undegraded":"2024-09-14T12:59:13.248167+0000","last_fullsized":"2024-09-14T12:59:13.248167+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:24:09.066501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:24:09.066501+0000","last_clean_scrub_stamp":"2024-09-14T11:24:09.066501+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:39:25.435594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":134,"num_read_kb":93,"num_write":40,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.19","version":"0'0","reported_seq":39,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:59:18.471470+0000","last_change":"2024-09-14T11:58:43.701511+0000","last_active":"2024-09-14T12:59:18.471470+0000","last_peered":"2024-09-14T12:59:18.471470+0000","last_clean":"2024-09-14T12:59:18.471470+0000","last_became_active":"2024-09-14T11:58:43.700281+0000","last_became_peered":"2024-09-14T11:58:43.700281+0000","last_unstale":"2024-09-14T12:59:18.471470+0000","last_undegraded":"2024-09-14T12:59:18.471470+0000","last_fullsized":"2024-09-14T12:59:18.471470+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:58:42.635024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:58:42.635024+0000","last_clean_scrub_stamp":"2024-09-14T11:58:42.635024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:42:11.274748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.1e","version":"267'6","reported_seq":78,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:00.468335+0000","last_change":"2024-09-14T11:30:17.539744+0000","last_active":"2024-09-14T13:02:00.468335+0000","last_peered":"2024-09-14T13:02:00.468335+0000","last_clean":"2024-09-14T13:02:00.468335+0000","last_became_active":"2024-09-14T11:30:17.534642+0000","last_became_peered":"2024-09-14T11:30:17.534642+0000","last_unstale":"2024-09-14T13:02:00.468335+0000","last_undegraded":"2024-09-14T13:02:00.468335+0000","last_fullsized":"2024-09-14T13:02:00.468335+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:30:16.474654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:30:16.474654+0000","last_clean_scrub_stamp":"2024-09-14T11:30:16.474654+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":1064,"num_write":6,"num_write_kb":2088,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.1f","version":"267'2","reported_seq":75,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:01:53.070938+0000","last_change":"2024-09-14T11:30:10.443371+0000","last_active":"2024-09-14T13:01:53.070938+0000","last_peered":"2024-09-14T13:01:53.070938+0000","last_clean":"2024-09-14T13:01:53.070938+0000","last_became_active":"2024-09-14T11:30:10.442597+0000","last_became_peered":"2024-09-14T11:30:10.442597+0000","last_unstale":"2024-09-14T13:01:53.070938+0000","last_undegraded":"2024-09-14T13:01:53.070938+0000","last_fullsized":"2024-09-14T13:01:53.070938+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:30:09.411354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:30:09.411354+0000","last_clean_scrub_stamp":"2024-09-14T11:30:09.411354+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:25:51.419864+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.1c","version":"267'41","reported_seq":188,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:59:13.470500+0000","last_change":"2024-09-14T11:24:10.128607+0000","last_active":"2024-09-14T12:59:13.470500+0000","last_peered":"2024-09-14T12:59:13.470500+0000","last_clean":"2024-09-14T12:59:13.470500+0000","last_became_active":"2024-09-14T11:24:10.124422+0000","last_became_peered":"2024-09-14T11:24:10.124422+0000","last_unstale":"2024-09-14T12:59:13.470500+0000","last_undegraded":"2024-09-14T12:59:13.470500+0000","last_fullsized":"2024-09-14T12:59:13.470500+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:24:09.066501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:24:09.066501+0000","last_clean_scrub_stamp":"2024-09-14T11:24:09.066501+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":0,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:13:03.605737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":350,"num_read_kb":247,"num_write":96,"num_write_kb":33,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.1e","version":"0'0","reported_seq":44,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:58:53.465451+0000","last_change":"2024-09-14T11:58:43.694842+0000","last_active":"2024-09-14T12:58:53.465451+0000","last_peered":"2024-09-14T12:58:53.465451+0000","last_clean":"2024-09-14T12:58:53.465451+0000","last_became_active":"2024-09-14T11:58:43.693760+0000","last_became_peered":"2024-09-14T11:58:43.693760+0000","last_unstale":"2024-09-14T12:58:53.465451+0000","last_undegraded":"2024-09-14T12:58:53.465451+0000","last_fullsized":"2024-09-14T12:58:53.465451+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:58:42.635024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:58:42.635024+0000","last_clean_scrub_stamp":"2024-09-14T11:58:42.635024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:18:34.791994+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.19","version":"0'0","reported_seq":61,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:00:08.062917+0000","last_change":"2024-09-14T11:30:17.531794+0000","last_active":"2024-09-14T13:00:08.062917+0000","last_peered":"2024-09-14T13:00:08.062917+0000","last_clean":"2024-09-14T13:00:08.062917+0000","last_became_active":"2024-09-14T11:30:17.531325+0000","last_became_peered":"2024-09-14T11:30:17.531325+0000","last_unstale":"2024-09-14T13:00:08.062917+0000","last_undegraded":"2024-09-14T13:00:08.062917+0000","last_fullsized":"2024-09-14T13:00:08.062917+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:30:16.474654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:30:16.474654+0000","last_clean_scrub_stamp":"2024-09-14T11:30:16.474654+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.18","version":"264'8","reported_seq":83,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:59:38.253969+0000","last_change":"2024-09-14T11:30:10.461819+0000","last_active":"2024-09-14T12:59:38.253969+0000","last_peered":"2024-09-14T12:59:38.253969+0000","last_clean":"2024-09-14T12:59:38.253969+0000","last_became_active":"2024-09-14T11:30:10.461101+0000","last_became_peered":"2024-09-14T11:30:10.461101+0000","last_unstale":"2024-09-14T12:59:38.253969+0000","last_undegraded":"2024-09-14T12:59:38.253969+0000","last_fullsized":"2024-09-14T12:59:38.253969+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:30:09.411354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:30:09.411354+0000","last_clean_scrub_stamp":"2024-09-14T11:30:09.411354+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:19:37.256749+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":8194,"num_write":18,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.1b","version":"264'28","reported_seq":149,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:59:13.470382+0000","last_change":"2024-09-14T11:24:10.130205+0000","last_active":"2024-09-14T12:59:13.470382+0000","last_peered":"2024-09-14T12:59:13.470382+0000","last_clean":"2024-09-14T12:59:13.470382+0000","last_became_active":"2024-09-14T11:24:10.129087+0000","last_became_peered":"2024-09-14T11:24:10.129087+0000","last_unstale":"2024-09-14T12:59:13.470382+0000","last_undegraded":"2024-09-14T12:59:13.470382+0000","last_fullsized":"2024-09-14T12:59:13.470382+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:24:09.066501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:24:09.066501+0000","last_clean_scrub_stamp":"2024-09-14T11:24:09.066501+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:55:41.881393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":229,"num_read_kb":159,"num_write":68,"num_write_kb":22,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.1f","version":"0'0","reported_seq":43,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:59:08.466883+0000","last_change":"2024-09-14T11:58:43.686856+0000","last_active":"2024-09-14T12:59:08.466883+0000","last_peered":"2024-09-14T12:59:08.466883+0000","last_clean":"2024-09-14T12:59:08.466883+0000","last_became_active":"2024-09-14T11:58:43.676679+0000","last_became_peered":"2024-09-14T11:58:43.676679+0000","last_unstale":"2024-09-14T12:59:08.466883+0000","last_undegraded":"2024-09-14T12:59:08.466883+0000","last_fullsized":"2024-09-14T12:59:08.466883+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:58:42.635024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:58:42.635024+0000","last_clean_scrub_stamp":"2024-09-14T11:58:42.635024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:32:45.311295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"67.18","version":"264'8","reported_seq":87,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:41.302766+0000","last_change":"2024-09-14T13:02:41.302766+0000","last_active":"2024-09-14T13:02:41.302766+0000","last_peered":"2024-09-14T13:02:41.302766+0000","last_clean":"2024-09-14T13:02:41.302766+0000","last_became_active":"2024-09-14T11:30:17.545478+0000","last_became_peered":"2024-09-14T11:30:17.545478+0000","last_unstale":"2024-09-14T13:02:41.302766+0000","last_undegraded":"2024-09-14T13:02:41.302766+0000","last_fullsized":"2024-09-14T13:02:41.302766+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'8","last_scrub_stamp":"2024-09-14T13:02:41.302568+0000","last_deep_scrub":"264'8","last_deep_scrub_stamp":"2024-09-14T13:02:41.302568+0000","last_clean_scrub_stamp":"2024-09-14T13:02:41.302568+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T00:55:52.417379+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":4166,"num_write":8,"num_write_kb":1092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"66.19","version":"267'7","reported_seq":77,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:00.285769+0000","last_change":"2024-09-14T11:30:10.467953+0000","last_active":"2024-09-14T13:02:00.285769+0000","last_peered":"2024-09-14T13:02:00.285769+0000","last_clean":"2024-09-14T13:02:00.285769+0000","last_became_active":"2024-09-14T11:30:10.467266+0000","last_became_peered":"2024-09-14T11:30:10.467266+0000","last_unstale":"2024-09-14T13:02:00.285769+0000","last_undegraded":"2024-09-14T13:02:00.285769+0000","last_fullsized":"2024-09-14T13:02:00.285769+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:30:09.411354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:30:09.411354+0000","last_clean_scrub_stamp":"2024-09-14T11:30:09.411354+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":1047,"num_write":12,"num_write_kb":2071,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.1a","version":"267'87","reported_seq":322,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:37.383112+0000","last_change":"2024-09-14T13:02:37.383112+0000","last_active":"2024-09-14T13:02:37.383112+0000","last_peered":"2024-09-14T13:02:37.383112+0000","last_clean":"2024-09-14T13:02:37.383112+0000","last_became_active":"2024-09-14T11:24:10.121048+0000","last_became_peered":"2024-09-14T11:24:10.121048+0000","last_unstale":"2024-09-14T13:02:37.383112+0000","last_undegraded":"2024-09-14T13:02:37.383112+0000","last_fullsized":"2024-09-14T13:02:37.383112+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'87","last_scrub_stamp":"2024-09-14T13:02:37.382930+0000","last_deep_scrub":"267'87","last_deep_scrub_stamp":"2024-09-14T13:02:37.382930+0000","last_clean_scrub_stamp":"2024-09-14T13:02:37.382930+0000","objects_scrubbed":0,"log_size":87,"log_dups_size":0,"ondisk_log_size":87,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:15:49.489042+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":696,"num_read_kb":437,"num_write":216,"num_write_kb":62,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.1c","version":"267'1","reported_seq":39,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:58:47.835392+0000","last_change":"2024-09-14T11:58:43.685706+0000","last_active":"2024-09-14T12:58:47.835392+0000","last_peered":"2024-09-14T12:58:47.835392+0000","last_clean":"2024-09-14T12:58:47.835392+0000","last_became_active":"2024-09-14T11:58:43.684984+0000","last_became_peered":"2024-09-14T11:58:43.684984+0000","last_unstale":"2024-09-14T12:58:47.835392+0000","last_undegraded":"2024-09-14T12:58:47.835392+0000","last_fullsized":"2024-09-14T12:58:47.835392+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:58:42.635024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:58:42.635024+0000","last_clean_scrub_stamp":"2024-09-14T11:58:42.635024+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:29:12.171056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.1b","version":"0'0","reported_seq":59,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:57:48.606470+0000","last_change":"2024-09-14T11:30:17.527032+0000","last_active":"2024-09-14T12:57:48.606470+0000","last_peered":"2024-09-14T12:57:48.606470+0000","last_clean":"2024-09-14T12:57:48.606470+0000","last_became_active":"2024-09-14T11:30:17.526195+0000","last_became_peered":"2024-09-14T11:30:17.526195+0000","last_unstale":"2024-09-14T12:57:48.606470+0000","last_undegraded":"2024-09-14T12:57:48.606470+0000","last_fullsized":"2024-09-14T12:57:48.606470+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:30:16.474654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:30:16.474654+0000","last_clean_scrub_stamp":"2024-09-14T11:30:16.474654+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:49:29.835475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"66.1a","version":"264'2","reported_seq":70,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:00:13.249365+0000","last_change":"2024-09-14T11:30:10.443423+0000","last_active":"2024-09-14T13:00:13.249365+0000","last_peered":"2024-09-14T13:00:13.249365+0000","last_clean":"2024-09-14T13:00:13.249365+0000","last_became_active":"2024-09-14T11:30:10.442753+0000","last_became_peered":"2024-09-14T11:30:10.442753+0000","last_unstale":"2024-09-14T13:00:13.249365+0000","last_undegraded":"2024-09-14T13:00:13.249365+0000","last_fullsized":"2024-09-14T13:00:13.249365+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:30:09.411354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:30:09.411354+0000","last_clean_scrub_stamp":"2024-09-14T11:30:09.411354+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":4096,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.19","version":"267'12","reported_seq":113,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:43.233545+0000","last_change":"2024-09-14T13:02:43.233545+0000","last_active":"2024-09-14T13:02:43.233545+0000","last_peered":"2024-09-14T13:02:43.233545+0000","last_clean":"2024-09-14T13:02:43.233545+0000","last_became_active":"2024-09-14T11:24:10.098890+0000","last_became_peered":"2024-09-14T11:24:10.098890+0000","last_unstale":"2024-09-14T13:02:43.233545+0000","last_undegraded":"2024-09-14T13:02:43.233545+0000","last_fullsized":"2024-09-14T13:02:43.233545+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'12","last_scrub_stamp":"2024-09-14T13:02:43.233322+0000","last_deep_scrub":"267'12","last_deep_scrub_stamp":"2024-09-14T13:02:43.233322+0000","last_clean_scrub_stamp":"2024-09-14T13:02:43.233322+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:54:26.566189+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":81,"num_read_kb":53,"num_write":29,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.1d","version":"0'0","reported_seq":38,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:58:47.835476+0000","last_change":"2024-09-14T11:58:43.688034+0000","last_active":"2024-09-14T12:58:47.835476+0000","last_peered":"2024-09-14T12:58:47.835476+0000","last_clean":"2024-09-14T12:58:47.835476+0000","last_became_active":"2024-09-14T11:58:43.687072+0000","last_became_peered":"2024-09-14T11:58:43.687072+0000","last_unstale":"2024-09-14T12:58:47.835476+0000","last_undegraded":"2024-09-14T12:58:47.835476+0000","last_fullsized":"2024-09-14T12:58:47.835476+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:58:42.635024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:58:42.635024+0000","last_clean_scrub_stamp":"2024-09-14T11:58:42.635024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:54:30.111603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.1a","version":"0'0","reported_seq":59,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:57:48.450199+0000","last_change":"2024-09-14T11:30:17.535485+0000","last_active":"2024-09-14T12:57:48.450199+0000","last_peered":"2024-09-14T12:57:48.450199+0000","last_clean":"2024-09-14T12:57:48.450199+0000","last_became_active":"2024-09-14T11:30:17.534937+0000","last_became_peered":"2024-09-14T11:30:17.534937+0000","last_unstale":"2024-09-14T12:57:48.450199+0000","last_undegraded":"2024-09-14T12:57:48.450199+0000","last_fullsized":"2024-09-14T12:57:48.450199+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:30:16.474654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:30:16.474654+0000","last_clean_scrub_stamp":"2024-09-14T11:30:16.474654+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:48:56.727170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.1b","version":"267'6","reported_seq":77,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:00.428232+0000","last_change":"2024-09-14T11:30:10.461481+0000","last_active":"2024-09-14T13:02:00.428232+0000","last_peered":"2024-09-14T13:02:00.428232+0000","last_clean":"2024-09-14T13:02:00.428232+0000","last_became_active":"2024-09-14T11:30:10.460666+0000","last_became_peered":"2024-09-14T11:30:10.460666+0000","last_unstale":"2024-09-14T13:02:00.428232+0000","last_undegraded":"2024-09-14T13:02:00.428232+0000","last_fullsized":"2024-09-14T13:02:00.428232+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:30:09.411354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:30:09.411354+0000","last_clean_scrub_stamp":"2024-09-14T11:30:09.411354+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":14336,"num_write":6,"num_write_kb":10240,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.18","version":"267'142","reported_seq":503,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:32.108855+0000","last_change":"2024-09-14T13:02:32.108855+0000","last_active":"2024-09-14T13:02:32.108855+0000","last_peered":"2024-09-14T13:02:32.108855+0000","last_clean":"2024-09-14T13:02:32.108855+0000","last_became_active":"2024-09-14T11:24:10.117854+0000","last_became_peered":"2024-09-14T11:24:10.117854+0000","last_unstale":"2024-09-14T13:02:32.108855+0000","last_undegraded":"2024-09-14T13:02:32.108855+0000","last_fullsized":"2024-09-14T13:02:32.108855+0000","mapping_epoch":254,"log_start":"264'100","ondisk_log_start":"264'100","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'142","last_scrub_stamp":"2024-09-14T13:02:32.108644+0000","last_deep_scrub":"267'142","last_deep_scrub_stamp":"2024-09-14T13:02:32.108644+0000","last_clean_scrub_stamp":"2024-09-14T13:02:32.108644+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":100,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:46:31.682718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1285,"num_read_kb":1365,"num_write":297,"num_write_kb":120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"68.12","version":"0'0","reported_seq":40,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:59:23.469971+0000","last_change":"2024-09-14T11:58:43.678310+0000","last_active":"2024-09-14T12:59:23.469971+0000","last_peered":"2024-09-14T12:59:23.469971+0000","last_clean":"2024-09-14T12:59:23.469971+0000","last_became_active":"2024-09-14T11:58:43.675254+0000","last_became_peered":"2024-09-14T11:58:43.675254+0000","last_unstale":"2024-09-14T12:59:23.469971+0000","last_undegraded":"2024-09-14T12:59:23.469971+0000","last_fullsized":"2024-09-14T12:59:23.469971+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:58:42.635024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:58:42.635024+0000","last_clean_scrub_stamp":"2024-09-14T11:58:42.635024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:53:22.218376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"67.15","version":"267'2","reported_seq":65,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:00.038220+0000","last_change":"2024-09-14T11:30:17.539875+0000","last_active":"2024-09-14T13:02:00.038220+0000","last_peered":"2024-09-14T13:02:00.038220+0000","last_clean":"2024-09-14T13:02:00.038220+0000","last_became_active":"2024-09-14T11:30:17.536010+0000","last_became_peered":"2024-09-14T11:30:17.536010+0000","last_unstale":"2024-09-14T13:02:00.038220+0000","last_undegraded":"2024-09-14T13:02:00.038220+0000","last_fullsized":"2024-09-14T13:02:00.038220+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:30:16.474654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:30:16.474654+0000","last_clean_scrub_stamp":"2024-09-14T11:30:16.474654+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":8192,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.14","version":"267'5","reported_seq":76,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:01:38.084001+0000","last_change":"2024-09-14T11:30:10.463826+0000","last_active":"2024-09-14T13:01:38.084001+0000","last_peered":"2024-09-14T13:01:38.084001+0000","last_clean":"2024-09-14T13:01:38.084001+0000","last_became_active":"2024-09-14T11:30:10.462605+0000","last_became_peered":"2024-09-14T11:30:10.462605+0000","last_unstale":"2024-09-14T13:01:38.084001+0000","last_undegraded":"2024-09-14T13:01:38.084001+0000","last_fullsized":"2024-09-14T13:01:38.084001+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:30:09.411354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:30:09.411354+0000","last_clean_scrub_stamp":"2024-09-14T11:30:09.411354+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:10:34.672801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5120,"num_write":10,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.17","version":"267'12","reported_seq":105,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:58:28.236663+0000","last_change":"2024-09-14T11:24:10.104884+0000","last_active":"2024-09-14T12:58:28.236663+0000","last_peered":"2024-09-14T12:58:28.236663+0000","last_clean":"2024-09-14T12:58:28.236663+0000","last_became_active":"2024-09-14T11:24:10.101934+0000","last_became_peered":"2024-09-14T11:24:10.101934+0000","last_unstale":"2024-09-14T12:58:28.236663+0000","last_undegraded":"2024-09-14T12:58:28.236663+0000","last_fullsized":"2024-09-14T12:58:28.236663+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:24:09.066501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:24:09.066501+0000","last_clean_scrub_stamp":"2024-09-14T11:24:09.066501+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:18:41.803884+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":86,"num_read_kb":56,"num_write":31,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.13","version":"267'2","reported_seq":50,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:39.163978+0000","last_change":"2024-09-14T13:02:39.163978+0000","last_active":"2024-09-14T13:02:39.163978+0000","last_peered":"2024-09-14T13:02:39.163978+0000","last_clean":"2024-09-14T13:02:39.163978+0000","last_became_active":"2024-09-14T11:58:43.675526+0000","last_became_peered":"2024-09-14T11:58:43.675526+0000","last_unstale":"2024-09-14T13:02:39.163978+0000","last_undegraded":"2024-09-14T13:02:39.163978+0000","last_fullsized":"2024-09-14T13:02:39.163978+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'2","last_scrub_stamp":"2024-09-14T13:02:39.163783+0000","last_deep_scrub":"267'2","last_deep_scrub_stamp":"2024-09-14T13:02:39.163783+0000","last_clean_scrub_stamp":"2024-09-14T13:02:39.163783+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:02:56.160097+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":188,"num_omap_keys":2,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.14","version":"267'7","reported_seq":76,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:01:38.503480+0000","last_change":"2024-09-14T11:30:17.544306+0000","last_active":"2024-09-14T13:01:38.503480+0000","last_peered":"2024-09-14T13:01:38.503480+0000","last_clean":"2024-09-14T13:01:38.503480+0000","last_became_active":"2024-09-14T11:30:17.543741+0000","last_became_peered":"2024-09-14T11:30:17.543741+0000","last_unstale":"2024-09-14T13:01:38.503480+0000","last_undegraded":"2024-09-14T13:01:38.503480+0000","last_fullsized":"2024-09-14T13:01:38.503480+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:30:16.474654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:30:16.474654+0000","last_clean_scrub_stamp":"2024-09-14T11:30:16.474654+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:33:14.837541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":20482,"num_write":12,"num_write_kb":8192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.15","version":"267'3","reported_seq":72,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:00.466429+0000","last_change":"2024-09-14T11:30:10.468990+0000","last_active":"2024-09-14T13:02:00.466429+0000","last_peered":"2024-09-14T13:02:00.466429+0000","last_clean":"2024-09-14T13:02:00.466429+0000","last_became_active":"2024-09-14T11:30:10.468238+0000","last_became_peered":"2024-09-14T11:30:10.468238+0000","last_unstale":"2024-09-14T13:02:00.466429+0000","last_undegraded":"2024-09-14T13:02:00.466429+0000","last_fullsized":"2024-09-14T13:02:00.466429+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:30:09.411354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:30:09.411354+0000","last_clean_scrub_stamp":"2024-09-14T11:30:09.411354+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:48:16.808159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2048,"num_write":8,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.16","version":"267'33","reported_seq":168,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:58:28.459408+0000","last_change":"2024-09-14T11:24:10.129833+0000","last_active":"2024-09-14T12:58:28.459408+0000","last_peered":"2024-09-14T12:58:28.459408+0000","last_clean":"2024-09-14T12:58:28.459408+0000","last_became_active":"2024-09-14T11:24:10.128354+0000","last_became_peered":"2024-09-14T11:24:10.128354+0000","last_unstale":"2024-09-14T12:58:28.459408+0000","last_undegraded":"2024-09-14T12:58:28.459408+0000","last_fullsized":"2024-09-14T12:58:28.459408+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:24:09.066501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:24:09.066501+0000","last_clean_scrub_stamp":"2024-09-14T11:24:09.066501+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:04:36.875537+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":269,"num_read_kb":173,"num_write":83,"num_write_kb":23,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.10","version":"0'0","reported_seq":40,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:59:27.844631+0000","last_change":"2024-09-14T11:58:43.689414+0000","last_active":"2024-09-14T12:59:27.844631+0000","last_peered":"2024-09-14T12:59:27.844631+0000","last_clean":"2024-09-14T12:59:27.844631+0000","last_became_active":"2024-09-14T11:58:43.688698+0000","last_became_peered":"2024-09-14T11:58:43.688698+0000","last_unstale":"2024-09-14T12:59:27.844631+0000","last_undegraded":"2024-09-14T12:59:27.844631+0000","last_fullsized":"2024-09-14T12:59:27.844631+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:58:42.635024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:58:42.635024+0000","last_clean_scrub_stamp":"2024-09-14T11:58:42.635024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:13:07.184551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.17","version":"267'5","reported_seq":71,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:00.341066+0000","last_change":"2024-09-14T11:30:17.544374+0000","last_active":"2024-09-14T13:02:00.341066+0000","last_peered":"2024-09-14T13:02:00.341066+0000","last_clean":"2024-09-14T13:02:00.341066+0000","last_became_active":"2024-09-14T11:30:17.543802+0000","last_became_peered":"2024-09-14T11:30:17.543802+0000","last_unstale":"2024-09-14T13:02:00.341066+0000","last_undegraded":"2024-09-14T13:02:00.341066+0000","last_fullsized":"2024-09-14T13:02:00.341066+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:30:16.474654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:30:16.474654+0000","last_clean_scrub_stamp":"2024-09-14T11:30:16.474654+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":20480,"num_write":10,"num_write_kb":8192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.16","version":"264'4","reported_seq":85,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:34.136962+0000","last_change":"2024-09-14T13:02:34.136962+0000","last_active":"2024-09-14T13:02:34.136962+0000","last_peered":"2024-09-14T13:02:34.136962+0000","last_clean":"2024-09-14T13:02:34.136962+0000","last_became_active":"2024-09-14T11:30:10.471956+0000","last_became_peered":"2024-09-14T11:30:10.471956+0000","last_unstale":"2024-09-14T13:02:34.136962+0000","last_undegraded":"2024-09-14T13:02:34.136962+0000","last_fullsized":"2024-09-14T13:02:34.136962+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'4","last_scrub_stamp":"2024-09-14T13:02:34.136748+0000","last_deep_scrub":"264'4","last_deep_scrub_stamp":"2024-09-14T13:02:34.136748+0000","last_clean_scrub_stamp":"2024-09-14T13:02:34.136748+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:49:40.325059+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":4098,"num_write":4,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.15","version":"267'34","reported_seq":173,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:31.141513+0000","last_change":"2024-09-14T13:02:31.141513+0000","last_active":"2024-09-14T13:02:31.141513+0000","last_peered":"2024-09-14T13:02:31.141513+0000","last_clean":"2024-09-14T13:02:31.141513+0000","last_became_active":"2024-09-14T11:24:10.097011+0000","last_became_peered":"2024-09-14T11:24:10.097011+0000","last_unstale":"2024-09-14T13:02:31.141513+0000","last_undegraded":"2024-09-14T13:02:31.141513+0000","last_fullsized":"2024-09-14T13:02:31.141513+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'34","last_scrub_stamp":"2024-09-14T13:02:31.141318+0000","last_deep_scrub":"267'34","last_deep_scrub_stamp":"2024-09-14T13:02:31.141318+0000","last_clean_scrub_stamp":"2024-09-14T13:02:31.141318+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:19:52.142240+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":263,"num_read_kb":166,"num_write":89,"num_write_kb":24,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.11","version":"0'0","reported_seq":40,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:59:23.053229+0000","last_change":"2024-09-14T11:58:43.689926+0000","last_active":"2024-09-14T12:59:23.053229+0000","last_peered":"2024-09-14T12:59:23.053229+0000","last_clean":"2024-09-14T12:59:23.053229+0000","last_became_active":"2024-09-14T11:58:43.688315+0000","last_became_peered":"2024-09-14T11:58:43.688315+0000","last_unstale":"2024-09-14T12:59:23.053229+0000","last_undegraded":"2024-09-14T12:59:23.053229+0000","last_fullsized":"2024-09-14T12:59:23.053229+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:58:42.635024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:58:42.635024+0000","last_clean_scrub_stamp":"2024-09-14T11:58:42.635024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:41:40.616158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.16","version":"0'0","reported_seq":61,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:59:43.242563+0000","last_change":"2024-09-14T11:30:17.529543+0000","last_active":"2024-09-14T12:59:43.242563+0000","last_peered":"2024-09-14T12:59:43.242563+0000","last_clean":"2024-09-14T12:59:43.242563+0000","last_became_active":"2024-09-14T11:30:17.528777+0000","last_became_peered":"2024-09-14T11:30:17.528777+0000","last_unstale":"2024-09-14T12:59:43.242563+0000","last_undegraded":"2024-09-14T12:59:43.242563+0000","last_fullsized":"2024-09-14T12:59:43.242563+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:30:16.474654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:30:16.474654+0000","last_clean_scrub_stamp":"2024-09-14T11:30:16.474654+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.17","version":"267'4","reported_seq":73,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:00.395180+0000","last_change":"2024-09-14T11:30:10.473815+0000","last_active":"2024-09-14T13:02:00.395180+0000","last_peered":"2024-09-14T13:02:00.395180+0000","last_clean":"2024-09-14T13:02:00.395180+0000","last_became_active":"2024-09-14T11:30:10.469237+0000","last_became_peered":"2024-09-14T11:30:10.469237+0000","last_unstale":"2024-09-14T13:02:00.395180+0000","last_undegraded":"2024-09-14T13:02:00.395180+0000","last_fullsized":"2024-09-14T13:02:00.395180+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:30:09.411354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:30:09.411354+0000","last_clean_scrub_stamp":"2024-09-14T11:30:09.411354+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:02:16.697692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":4794,"num_write":4,"num_write_kb":4794,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.14","version":"267'34","reported_seq":164,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:00:22.857657+0000","last_change":"2024-09-14T11:24:10.120917+0000","last_active":"2024-09-14T13:00:22.857657+0000","last_peered":"2024-09-14T13:00:22.857657+0000","last_clean":"2024-09-14T13:00:22.857657+0000","last_became_active":"2024-09-14T11:24:10.120143+0000","last_became_peered":"2024-09-14T11:24:10.120143+0000","last_unstale":"2024-09-14T13:00:22.857657+0000","last_undegraded":"2024-09-14T13:00:22.857657+0000","last_fullsized":"2024-09-14T13:00:22.857657+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:24:09.066501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:24:09.066501+0000","last_clean_scrub_stamp":"2024-09-14T11:24:09.066501+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":239,"num_read_kb":157,"num_write":95,"num_write_kb":23,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.16","version":"0'0","reported_seq":39,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:59:08.469272+0000","last_change":"2024-09-14T11:58:43.687060+0000","last_active":"2024-09-14T12:59:08.469272+0000","last_peered":"2024-09-14T12:59:08.469272+0000","last_clean":"2024-09-14T12:59:08.469272+0000","last_became_active":"2024-09-14T11:58:43.685594+0000","last_became_peered":"2024-09-14T11:58:43.685594+0000","last_unstale":"2024-09-14T12:59:08.469272+0000","last_undegraded":"2024-09-14T12:59:08.469272+0000","last_fullsized":"2024-09-14T12:59:08.469272+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:58:42.635024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:58:42.635024+0000","last_clean_scrub_stamp":"2024-09-14T11:58:42.635024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:15:01.961069+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.11","version":"264'4","reported_seq":72,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:58:58.464568+0000","last_change":"2024-09-14T11:30:17.524449+0000","last_active":"2024-09-14T12:58:58.464568+0000","last_peered":"2024-09-14T12:58:58.464568+0000","last_clean":"2024-09-14T12:58:58.464568+0000","last_became_active":"2024-09-14T11:30:17.523720+0000","last_became_peered":"2024-09-14T11:30:17.523720+0000","last_unstale":"2024-09-14T12:58:58.464568+0000","last_undegraded":"2024-09-14T12:58:58.464568+0000","last_fullsized":"2024-09-14T12:58:58.464568+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:30:16.474654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:30:16.474654+0000","last_clean_scrub_stamp":"2024-09-14T11:30:16.474654+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:47:46.829903+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":4098,"num_write":4,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.10","version":"264'2","reported_seq":72,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:58:53.231284+0000","last_change":"2024-09-14T11:30:10.464461+0000","last_active":"2024-09-14T12:58:53.231284+0000","last_peered":"2024-09-14T12:58:53.231284+0000","last_clean":"2024-09-14T12:58:53.231284+0000","last_became_active":"2024-09-14T11:30:10.463671+0000","last_became_peered":"2024-09-14T11:30:10.463671+0000","last_unstale":"2024-09-14T12:58:53.231284+0000","last_undegraded":"2024-09-14T12:58:53.231284+0000","last_fullsized":"2024-09-14T12:58:53.231284+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:30:09.411354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:30:09.411354+0000","last_clean_scrub_stamp":"2024-09-14T11:30:09.411354+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:20:15.603839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":4096,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.13","version":"267'23","reported_seq":140,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:59:52.850626+0000","last_change":"2024-09-14T11:24:10.121802+0000","last_active":"2024-09-14T12:59:52.850626+0000","last_peered":"2024-09-14T12:59:52.850626+0000","last_clean":"2024-09-14T12:59:52.850626+0000","last_became_active":"2024-09-14T11:24:10.120764+0000","last_became_peered":"2024-09-14T11:24:10.120764+0000","last_unstale":"2024-09-14T12:59:52.850626+0000","last_undegraded":"2024-09-14T12:59:52.850626+0000","last_fullsized":"2024-09-14T12:59:52.850626+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:24:09.066501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:24:09.066501+0000","last_clean_scrub_stamp":"2024-09-14T11:24:09.066501+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":187,"num_read_kb":128,"num_write":64,"num_write_kb":17,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.17","version":"0'0","reported_seq":39,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:59:08.247094+0000","last_change":"2024-09-14T11:58:43.677764+0000","last_active":"2024-09-14T12:59:08.247094+0000","last_peered":"2024-09-14T12:59:08.247094+0000","last_clean":"2024-09-14T12:59:08.247094+0000","last_became_active":"2024-09-14T11:58:43.677005+0000","last_became_peered":"2024-09-14T11:58:43.677005+0000","last_unstale":"2024-09-14T12:59:08.247094+0000","last_undegraded":"2024-09-14T12:59:08.247094+0000","last_fullsized":"2024-09-14T12:59:08.247094+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:58:42.635024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:58:42.635024+0000","last_clean_scrub_stamp":"2024-09-14T11:58:42.635024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:38:06.608929+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.10","version":"267'4","reported_seq":76,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:39.233788+0000","last_change":"2024-09-14T13:02:39.233788+0000","last_active":"2024-09-14T13:02:39.233788+0000","last_peered":"2024-09-14T13:02:39.233788+0000","last_clean":"2024-09-14T13:02:39.233788+0000","last_became_active":"2024-09-14T11:30:17.510031+0000","last_became_peered":"2024-09-14T11:30:17.510031+0000","last_unstale":"2024-09-14T13:02:39.233788+0000","last_undegraded":"2024-09-14T13:02:39.233788+0000","last_fullsized":"2024-09-14T13:02:39.233788+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'4","last_scrub_stamp":"2024-09-14T13:02:39.233520+0000","last_deep_scrub":"267'4","last_deep_scrub_stamp":"2024-09-14T13:02:39.233520+0000","last_clean_scrub_stamp":"2024-09-14T13:02:39.233520+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:50:08.145806+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":2048,"num_write":4,"num_write_kb":2048,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.11","version":"0'0","reported_seq":68,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:58:53.465194+0000","last_change":"2024-09-14T11:30:10.468119+0000","last_active":"2024-09-14T12:58:53.465194+0000","last_peered":"2024-09-14T12:58:53.465194+0000","last_clean":"2024-09-14T12:58:53.465194+0000","last_became_active":"2024-09-14T11:30:10.459020+0000","last_became_peered":"2024-09-14T11:30:10.459020+0000","last_unstale":"2024-09-14T12:58:53.465194+0000","last_undegraded":"2024-09-14T12:58:53.465194+0000","last_fullsized":"2024-09-14T12:58:53.465194+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:30:09.411354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:30:09.411354+0000","last_clean_scrub_stamp":"2024-09-14T11:30:09.411354+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:19:33.421651+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.12","version":"267'21","reported_seq":144,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:42.232596+0000","last_change":"2024-09-14T13:02:42.232596+0000","last_active":"2024-09-14T13:02:42.232596+0000","last_peered":"2024-09-14T13:02:42.232596+0000","last_clean":"2024-09-14T13:02:42.232596+0000","last_became_active":"2024-09-14T11:24:10.124482+0000","last_became_peered":"2024-09-14T11:24:10.124482+0000","last_unstale":"2024-09-14T13:02:42.232596+0000","last_undegraded":"2024-09-14T13:02:42.232596+0000","last_fullsized":"2024-09-14T13:02:42.232596+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'21","last_scrub_stamp":"2024-09-14T13:02:42.232388+0000","last_deep_scrub":"267'21","last_deep_scrub_stamp":"2024-09-14T13:02:42.232388+0000","last_clean_scrub_stamp":"2024-09-14T13:02:42.232388+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:21:49.013790+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":165,"num_read_kb":113,"num_write":54,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.14","version":"266'1","reported_seq":41,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:59:43.255487+0000","last_change":"2024-09-14T11:58:43.676454+0000","last_active":"2024-09-14T12:59:43.255487+0000","last_peered":"2024-09-14T12:59:43.255487+0000","last_clean":"2024-09-14T12:59:43.255487+0000","last_became_active":"2024-09-14T11:58:43.675734+0000","last_became_peered":"2024-09-14T11:58:43.675734+0000","last_unstale":"2024-09-14T12:59:43.255487+0000","last_undegraded":"2024-09-14T12:59:43.255487+0000","last_fullsized":"2024-09-14T12:59:43.255487+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:58:42.635024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:58:42.635024+0000","last_clean_scrub_stamp":"2024-09-14T11:58:42.635024+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:41:40.899244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.13","version":"267'8","reported_seq":74,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:00.350845+0000","last_change":"2024-09-14T11:30:17.546653+0000","last_active":"2024-09-14T13:02:00.350845+0000","last_peered":"2024-09-14T13:02:00.350845+0000","last_clean":"2024-09-14T13:02:00.350845+0000","last_became_active":"2024-09-14T11:30:17.545560+0000","last_became_peered":"2024-09-14T11:30:17.545560+0000","last_unstale":"2024-09-14T13:02:00.350845+0000","last_undegraded":"2024-09-14T13:02:00.350845+0000","last_fullsized":"2024-09-14T13:02:00.350845+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:30:16.474654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:30:16.474654+0000","last_clean_scrub_stamp":"2024-09-14T11:30:16.474654+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:05:50.325352+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":9216,"num_write":18,"num_write_kb":9216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.12","version":"267'8","reported_seq":90,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:40.351336+0000","last_change":"2024-09-14T13:02:40.351336+0000","last_active":"2024-09-14T13:02:40.351336+0000","last_peered":"2024-09-14T13:02:40.351336+0000","last_clean":"2024-09-14T13:02:40.351336+0000","last_became_active":"2024-09-14T11:30:10.474328+0000","last_became_peered":"2024-09-14T11:30:10.474328+0000","last_unstale":"2024-09-14T13:02:40.351336+0000","last_undegraded":"2024-09-14T13:02:40.351336+0000","last_fullsized":"2024-09-14T13:02:40.351336+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'8","last_scrub_stamp":"2024-09-14T13:02:40.351142+0000","last_deep_scrub":"267'8","last_deep_scrub_stamp":"2024-09-14T13:02:40.351142+0000","last_clean_scrub_stamp":"2024-09-14T13:02:40.351142+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:55:27.295194+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":16386,"num_write":18,"num_write_kb":8192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"65.11","version":"267'78","reported_seq":293,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:59:53.244704+0000","last_change":"2024-09-14T11:24:10.107937+0000","last_active":"2024-09-14T12:59:53.244704+0000","last_peered":"2024-09-14T12:59:53.244704+0000","last_clean":"2024-09-14T12:59:53.244704+0000","last_became_active":"2024-09-14T11:24:10.107177+0000","last_became_peered":"2024-09-14T11:24:10.107177+0000","last_unstale":"2024-09-14T12:59:53.244704+0000","last_undegraded":"2024-09-14T12:59:53.244704+0000","last_fullsized":"2024-09-14T12:59:53.244704+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:24:09.066501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:24:09.066501+0000","last_clean_scrub_stamp":"2024-09-14T11:24:09.066501+0000","objects_scrubbed":0,"log_size":78,"log_dups_size":0,"ondisk_log_size":78,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":655,"num_read_kb":451,"num_write":184,"num_write_kb":61,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"68.15","version":"267'1","reported_seq":40,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:59:08.469167+0000","last_change":"2024-09-14T11:58:43.694184+0000","last_active":"2024-09-14T12:59:08.469167+0000","last_peered":"2024-09-14T12:59:08.469167+0000","last_clean":"2024-09-14T12:59:08.469167+0000","last_became_active":"2024-09-14T11:58:43.692552+0000","last_became_peered":"2024-09-14T11:58:43.692552+0000","last_unstale":"2024-09-14T12:59:08.469167+0000","last_undegraded":"2024-09-14T12:59:08.469167+0000","last_fullsized":"2024-09-14T12:59:08.469167+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:58:42.635024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:58:42.635024+0000","last_clean_scrub_stamp":"2024-09-14T11:58:42.635024+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:25:30.983665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.12","version":"267'3","reported_seq":73,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:42.335939+0000","last_change":"2024-09-14T13:02:42.335939+0000","last_active":"2024-09-14T13:02:42.335939+0000","last_peered":"2024-09-14T13:02:42.335939+0000","last_clean":"2024-09-14T13:02:42.335939+0000","last_became_active":"2024-09-14T11:30:17.523975+0000","last_became_peered":"2024-09-14T11:30:17.523975+0000","last_unstale":"2024-09-14T13:02:42.335939+0000","last_undegraded":"2024-09-14T13:02:42.335939+0000","last_fullsized":"2024-09-14T13:02:42.335939+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'3","last_scrub_stamp":"2024-09-14T13:02:42.335749+0000","last_deep_scrub":"267'3","last_deep_scrub_stamp":"2024-09-14T13:02:42.335749+0000","last_clean_scrub_stamp":"2024-09-14T13:02:42.335749+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:09:02.602816+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":8,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"66.13","version":"267'2","reported_seq":70,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:01:13.078527+0000","last_change":"2024-09-14T11:30:10.470996+0000","last_active":"2024-09-14T13:01:13.078527+0000","last_peered":"2024-09-14T13:01:13.078527+0000","last_clean":"2024-09-14T13:01:13.078527+0000","last_became_active":"2024-09-14T11:30:10.467218+0000","last_became_peered":"2024-09-14T11:30:10.467218+0000","last_unstale":"2024-09-14T13:01:13.078527+0000","last_undegraded":"2024-09-14T13:01:13.078527+0000","last_fullsized":"2024-09-14T13:01:13.078527+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:30:09.411354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:30:09.411354+0000","last_clean_scrub_stamp":"2024-09-14T11:30:09.411354+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:14:13.258206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.10","version":"267'25","reported_seq":143,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:59:53.479361+0000","last_change":"2024-09-14T11:24:10.128983+0000","last_active":"2024-09-14T12:59:53.479361+0000","last_peered":"2024-09-14T12:59:53.479361+0000","last_clean":"2024-09-14T12:59:53.479361+0000","last_became_active":"2024-09-14T11:24:10.124485+0000","last_became_peered":"2024-09-14T11:24:10.124485+0000","last_unstale":"2024-09-14T12:59:53.479361+0000","last_undegraded":"2024-09-14T12:59:53.479361+0000","last_fullsized":"2024-09-14T12:59:53.479361+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:24:09.066501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:24:09.066501+0000","last_clean_scrub_stamp":"2024-09-14T11:24:09.066501+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":199,"num_read_kb":137,"num_write":62,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.a","version":"0'0","reported_seq":50,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:38.185136+0000","last_change":"2024-09-14T13:02:38.185136+0000","last_active":"2024-09-14T13:02:38.185136+0000","last_peered":"2024-09-14T13:02:38.185136+0000","last_clean":"2024-09-14T13:02:38.185136+0000","last_became_active":"2024-09-14T11:58:43.665150+0000","last_became_peered":"2024-09-14T11:58:43.665150+0000","last_unstale":"2024-09-14T13:02:38.185136+0000","last_undegraded":"2024-09-14T13:02:38.185136+0000","last_fullsized":"2024-09-14T13:02:38.185136+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T13:02:38.184941+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T13:02:38.184941+0000","last_clean_scrub_stamp":"2024-09-14T13:02:38.184941+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T00:23:09.561336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.d","version":"0'0","reported_seq":64,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:00:18.485676+0000","last_change":"2024-09-14T11:30:17.541032+0000","last_active":"2024-09-14T13:00:18.485676+0000","last_peered":"2024-09-14T13:00:18.485676+0000","last_clean":"2024-09-14T13:00:18.485676+0000","last_became_active":"2024-09-14T11:30:17.540505+0000","last_became_peered":"2024-09-14T11:30:17.540505+0000","last_unstale":"2024-09-14T13:00:18.485676+0000","last_undegraded":"2024-09-14T13:00:18.485676+0000","last_fullsized":"2024-09-14T13:00:18.485676+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:30:16.474654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:30:16.474654+0000","last_clean_scrub_stamp":"2024-09-14T11:30:16.474654+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.c","version":"264'2","reported_seq":74,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:00:12.855369+0000","last_change":"2024-09-14T11:30:10.465578+0000","last_active":"2024-09-14T13:00:12.855369+0000","last_peered":"2024-09-14T13:00:12.855369+0000","last_clean":"2024-09-14T13:00:12.855369+0000","last_became_active":"2024-09-14T11:30:10.464846+0000","last_became_peered":"2024-09-14T11:30:10.464846+0000","last_unstale":"2024-09-14T13:00:12.855369+0000","last_undegraded":"2024-09-14T13:00:12.855369+0000","last_fullsized":"2024-09-14T13:00:12.855369+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:30:09.411354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:30:09.411354+0000","last_clean_scrub_stamp":"2024-09-14T11:30:09.411354+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":4096,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.f","version":"267'23","reported_seq":140,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:59:03.468003+0000","last_change":"2024-09-14T11:24:10.122374+0000","last_active":"2024-09-14T12:59:03.468003+0000","last_peered":"2024-09-14T12:59:03.468003+0000","last_clean":"2024-09-14T12:59:03.468003+0000","last_became_active":"2024-09-14T11:24:10.121456+0000","last_became_peered":"2024-09-14T11:24:10.121456+0000","last_unstale":"2024-09-14T12:59:03.468003+0000","last_undegraded":"2024-09-14T12:59:03.468003+0000","last_fullsized":"2024-09-14T12:59:03.468003+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:24:09.066501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:24:09.066501+0000","last_clean_scrub_stamp":"2024-09-14T11:24:09.066501+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:09:06.754571+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":176,"num_read_kb":127,"num_write":57,"num_write_kb":16,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.b","version":"0'0","reported_seq":41,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:59:32.845960+0000","last_change":"2024-09-14T11:58:43.685677+0000","last_active":"2024-09-14T12:59:32.845960+0000","last_peered":"2024-09-14T12:59:32.845960+0000","last_clean":"2024-09-14T12:59:32.845960+0000","last_became_active":"2024-09-14T11:58:43.684927+0000","last_became_peered":"2024-09-14T11:58:43.684927+0000","last_unstale":"2024-09-14T12:59:32.845960+0000","last_undegraded":"2024-09-14T12:59:32.845960+0000","last_fullsized":"2024-09-14T12:59:32.845960+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:58:42.635024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:58:42.635024+0000","last_clean_scrub_stamp":"2024-09-14T11:58:42.635024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:58:14.472771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.c","version":"267'9","reported_seq":79,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:00.320695+0000","last_change":"2024-09-14T11:30:17.535765+0000","last_active":"2024-09-14T13:02:00.320695+0000","last_peered":"2024-09-14T13:02:00.320695+0000","last_clean":"2024-09-14T13:02:00.320695+0000","last_became_active":"2024-09-14T11:30:17.535131+0000","last_became_peered":"2024-09-14T11:30:17.535131+0000","last_unstale":"2024-09-14T13:02:00.320695+0000","last_undegraded":"2024-09-14T13:02:00.320695+0000","last_fullsized":"2024-09-14T13:02:00.320695+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:30:16.474654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:30:16.474654+0000","last_clean_scrub_stamp":"2024-09-14T11:30:16.474654+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":16384,"num_write":14,"num_write_kb":16384,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.d","version":"0'0","reported_seq":78,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:36.205696+0000","last_change":"2024-09-14T13:02:36.205696+0000","last_active":"2024-09-14T13:02:36.205696+0000","last_peered":"2024-09-14T13:02:36.205696+0000","last_clean":"2024-09-14T13:02:36.205696+0000","last_became_active":"2024-09-14T11:30:10.475862+0000","last_became_peered":"2024-09-14T11:30:10.475862+0000","last_unstale":"2024-09-14T13:02:36.205696+0000","last_undegraded":"2024-09-14T13:02:36.205696+0000","last_fullsized":"2024-09-14T13:02:36.205696+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T13:02:36.205496+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T13:02:36.205496+0000","last_clean_scrub_stamp":"2024-09-14T13:02:36.205496+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:14:53.482444+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.e","version":"267'20","reported_seq":131,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:58:43.044517+0000","last_change":"2024-09-14T11:24:10.116821+0000","last_active":"2024-09-14T12:58:43.044517+0000","last_peered":"2024-09-14T12:58:43.044517+0000","last_clean":"2024-09-14T12:58:43.044517+0000","last_became_active":"2024-09-14T11:24:10.116115+0000","last_became_peered":"2024-09-14T11:24:10.116115+0000","last_unstale":"2024-09-14T12:58:43.044517+0000","last_undegraded":"2024-09-14T12:58:43.044517+0000","last_fullsized":"2024-09-14T12:58:43.044517+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:24:09.066501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:24:09.066501+0000","last_clean_scrub_stamp":"2024-09-14T11:24:09.066501+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:27:31.737225+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":147,"num_read_kb":99,"num_write":62,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"68.8","version":"0'0","reported_seq":50,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:43.309200+0000","last_change":"2024-09-14T13:02:43.309200+0000","last_active":"2024-09-14T13:02:43.309200+0000","last_peered":"2024-09-14T13:02:43.309200+0000","last_clean":"2024-09-14T13:02:43.309200+0000","last_became_active":"2024-09-14T11:58:43.689083+0000","last_became_peered":"2024-09-14T11:58:43.689083+0000","last_unstale":"2024-09-14T13:02:43.309200+0000","last_undegraded":"2024-09-14T13:02:43.309200+0000","last_fullsized":"2024-09-14T13:02:43.309200+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T13:02:43.309020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T13:02:43.309020+0000","last_clean_scrub_stamp":"2024-09-14T13:02:43.309020+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:23:55.448786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"67.f","version":"267'7","reported_seq":74,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:00.341402+0000","last_change":"2024-09-14T11:30:17.516991+0000","last_active":"2024-09-14T13:02:00.341402+0000","last_peered":"2024-09-14T13:02:00.341402+0000","last_clean":"2024-09-14T13:02:00.341402+0000","last_became_active":"2024-09-14T11:30:17.514381+0000","last_became_peered":"2024-09-14T11:30:17.514381+0000","last_unstale":"2024-09-14T13:02:00.341402+0000","last_undegraded":"2024-09-14T13:02:00.341402+0000","last_fullsized":"2024-09-14T13:02:00.341402+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:30:16.474654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:30:16.474654+0000","last_clean_scrub_stamp":"2024-09-14T11:30:16.474654+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:49:08.984359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":3072,"num_write":12,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.e","version":"267'6","reported_seq":83,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:00.428425+0000","last_change":"2024-09-14T11:30:10.479004+0000","last_active":"2024-09-14T13:02:00.428425+0000","last_peered":"2024-09-14T13:02:00.428425+0000","last_clean":"2024-09-14T13:02:00.428425+0000","last_became_active":"2024-09-14T11:30:10.473586+0000","last_became_peered":"2024-09-14T11:30:10.473586+0000","last_unstale":"2024-09-14T13:02:00.428425+0000","last_undegraded":"2024-09-14T13:02:00.428425+0000","last_fullsized":"2024-09-14T13:02:00.428425+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:30:09.411354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:30:09.411354+0000","last_clean_scrub_stamp":"2024-09-14T11:30:09.411354+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":7170,"num_write":6,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.d","version":"267'29","reported_seq":167,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:35.416072+0000","last_change":"2024-09-14T13:02:35.416072+0000","last_active":"2024-09-14T13:02:35.416072+0000","last_peered":"2024-09-14T13:02:35.416072+0000","last_clean":"2024-09-14T13:02:35.416072+0000","last_became_active":"2024-09-14T11:24:10.115813+0000","last_became_peered":"2024-09-14T11:24:10.115813+0000","last_unstale":"2024-09-14T13:02:35.416072+0000","last_undegraded":"2024-09-14T13:02:35.416072+0000","last_fullsized":"2024-09-14T13:02:35.416072+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'29","last_scrub_stamp":"2024-09-14T13:02:35.415892+0000","last_deep_scrub":"267'29","last_deep_scrub_stamp":"2024-09-14T13:02:35.415892+0000","last_clean_scrub_stamp":"2024-09-14T13:02:35.415892+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:05:33.386173+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":238,"num_read_kb":154,"num_write":72,"num_write_kb":21,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.9","version":"0'0","reported_seq":42,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:59:27.844748+0000","last_change":"2024-09-14T11:58:43.692113+0000","last_active":"2024-09-14T12:59:27.844748+0000","last_peered":"2024-09-14T12:59:27.844748+0000","last_clean":"2024-09-14T12:59:27.844748+0000","last_became_active":"2024-09-14T11:58:43.691369+0000","last_became_peered":"2024-09-14T11:58:43.691369+0000","last_unstale":"2024-09-14T12:59:27.844748+0000","last_undegraded":"2024-09-14T12:59:27.844748+0000","last_fullsized":"2024-09-14T12:59:27.844748+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:58:42.635024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:58:42.635024+0000","last_clean_scrub_stamp":"2024-09-14T11:58:42.635024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:30:13.996741+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.e","version":"0'0","reported_seq":64,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:00:18.485724+0000","last_change":"2024-09-14T11:30:17.530775+0000","last_active":"2024-09-14T13:00:18.485724+0000","last_peered":"2024-09-14T13:00:18.485724+0000","last_clean":"2024-09-14T13:00:18.485724+0000","last_became_active":"2024-09-14T11:30:17.529982+0000","last_became_peered":"2024-09-14T11:30:17.529982+0000","last_unstale":"2024-09-14T13:00:18.485724+0000","last_undegraded":"2024-09-14T13:00:18.485724+0000","last_fullsized":"2024-09-14T13:00:18.485724+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:30:16.474654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:30:16.474654+0000","last_clean_scrub_stamp":"2024-09-14T11:30:16.474654+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.f","version":"267'3","reported_seq":83,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:31.139213+0000","last_change":"2024-09-14T13:02:31.139077+0000","last_active":"2024-09-14T13:02:31.139213+0000","last_peered":"2024-09-14T13:02:31.139213+0000","last_clean":"2024-09-14T13:02:31.139213+0000","last_became_active":"2024-09-14T11:30:10.465658+0000","last_became_peered":"2024-09-14T11:30:10.465658+0000","last_unstale":"2024-09-14T13:02:31.139213+0000","last_undegraded":"2024-09-14T13:02:31.139213+0000","last_fullsized":"2024-09-14T13:02:31.139213+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'3","last_scrub_stamp":"2024-09-14T13:02:31.138897+0000","last_deep_scrub":"267'3","last_deep_scrub_stamp":"2024-09-14T13:02:31.138897+0000","last_clean_scrub_stamp":"2024-09-14T13:02:31.138897+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:26:50.921553+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":8192,"num_write":8,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.c","version":"267'13","reported_seq":120,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:30.100605+0000","last_change":"2024-09-14T13:02:30.100605+0000","last_active":"2024-09-14T13:02:30.100605+0000","last_peered":"2024-09-14T13:02:30.100605+0000","last_clean":"2024-09-14T13:02:30.100605+0000","last_became_active":"2024-09-14T11:24:10.125123+0000","last_became_peered":"2024-09-14T11:24:10.125123+0000","last_unstale":"2024-09-14T13:02:30.100605+0000","last_undegraded":"2024-09-14T13:02:30.100605+0000","last_fullsized":"2024-09-14T13:02:30.100605+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'13","last_scrub_stamp":"2024-09-14T13:02:30.100437+0000","last_deep_scrub":"267'13","last_deep_scrub_stamp":"2024-09-14T13:02:30.100437+0000","last_clean_scrub_stamp":"2024-09-14T13:02:30.100437+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:50:46.167171+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":97,"num_read_kb":65,"num_write":32,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.e","version":"0'0","reported_seq":41,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:59:28.473804+0000","last_change":"2024-09-14T11:58:43.687782+0000","last_active":"2024-09-14T12:59:28.473804+0000","last_peered":"2024-09-14T12:59:28.473804+0000","last_clean":"2024-09-14T12:59:28.473804+0000","last_became_active":"2024-09-14T11:58:43.686619+0000","last_became_peered":"2024-09-14T11:58:43.686619+0000","last_unstale":"2024-09-14T12:59:28.473804+0000","last_undegraded":"2024-09-14T12:59:28.473804+0000","last_fullsized":"2024-09-14T12:59:28.473804+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:58:42.635024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:58:42.635024+0000","last_clean_scrub_stamp":"2024-09-14T11:58:42.635024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:28:38.861564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.9","version":"264'3","reported_seq":70,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:59:08.234745+0000","last_change":"2024-09-14T11:30:17.539804+0000","last_active":"2024-09-14T12:59:08.234745+0000","last_peered":"2024-09-14T12:59:08.234745+0000","last_clean":"2024-09-14T12:59:08.234745+0000","last_became_active":"2024-09-14T11:30:17.539102+0000","last_became_peered":"2024-09-14T11:30:17.539102+0000","last_unstale":"2024-09-14T12:59:08.234745+0000","last_undegraded":"2024-09-14T12:59:08.234745+0000","last_fullsized":"2024-09-14T12:59:08.234745+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:30:16.474654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:30:16.474654+0000","last_clean_scrub_stamp":"2024-09-14T11:30:16.474654+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:50:58.476074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":4096,"num_write":8,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.8","version":"267'4","reported_seq":78,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:01:13.275300+0000","last_change":"2024-09-14T11:30:10.460045+0000","last_active":"2024-09-14T13:01:13.275300+0000","last_peered":"2024-09-14T13:01:13.275300+0000","last_clean":"2024-09-14T13:01:13.275300+0000","last_became_active":"2024-09-14T11:30:10.452160+0000","last_became_peered":"2024-09-14T11:30:10.452160+0000","last_unstale":"2024-09-14T13:01:13.275300+0000","last_undegraded":"2024-09-14T13:01:13.275300+0000","last_fullsized":"2024-09-14T13:01:13.275300+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:30:09.411354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:30:09.411354+0000","last_clean_scrub_stamp":"2024-09-14T11:30:09.411354+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:23:05.788859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5120,"num_write":4,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.b","version":"267'29","reported_seq":156,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:58:43.240104+0000","last_change":"2024-09-14T11:24:10.106828+0000","last_active":"2024-09-14T12:58:43.240104+0000","last_peered":"2024-09-14T12:58:43.240104+0000","last_clean":"2024-09-14T12:58:43.240104+0000","last_became_active":"2024-09-14T11:24:10.106068+0000","last_became_peered":"2024-09-14T11:24:10.106068+0000","last_unstale":"2024-09-14T12:58:43.240104+0000","last_undegraded":"2024-09-14T12:58:43.240104+0000","last_fullsized":"2024-09-14T12:58:43.240104+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:24:09.066501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:24:09.066501+0000","last_clean_scrub_stamp":"2024-09-14T11:24:09.066501+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:05:03.080475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":230,"num_read_kb":146,"num_write":73,"num_write_kb":21,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.f","version":"0'0","reported_seq":41,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:59:52.850758+0000","last_change":"2024-09-14T11:58:43.692112+0000","last_active":"2024-09-14T12:59:52.850758+0000","last_peered":"2024-09-14T12:59:52.850758+0000","last_clean":"2024-09-14T12:59:52.850758+0000","last_became_active":"2024-09-14T11:58:43.691307+0000","last_became_peered":"2024-09-14T11:58:43.691307+0000","last_unstale":"2024-09-14T12:59:52.850758+0000","last_undegraded":"2024-09-14T12:59:52.850758+0000","last_fullsized":"2024-09-14T12:59:52.850758+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:58:42.635024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:58:42.635024+0000","last_clean_scrub_stamp":"2024-09-14T11:58:42.635024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.8","version":"267'4","reported_seq":73,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:00.039409+0000","last_change":"2024-09-14T11:30:17.506927+0000","last_active":"2024-09-14T13:02:00.039409+0000","last_peered":"2024-09-14T13:02:00.039409+0000","last_clean":"2024-09-14T13:02:00.039409+0000","last_became_active":"2024-09-14T11:30:17.506181+0000","last_became_peered":"2024-09-14T11:30:17.506181+0000","last_unstale":"2024-09-14T13:02:00.039409+0000","last_undegraded":"2024-09-14T13:02:00.039409+0000","last_fullsized":"2024-09-14T13:02:00.039409+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:30:16.474654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:30:16.474654+0000","last_clean_scrub_stamp":"2024-09-14T11:30:16.474654+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:25:09.709853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":10240,"num_write":4,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.9","version":"267'14","reported_seq":104,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:34.171486+0000","last_change":"2024-09-14T13:02:34.171486+0000","last_active":"2024-09-14T13:02:34.171486+0000","last_peered":"2024-09-14T13:02:34.171486+0000","last_clean":"2024-09-14T13:02:34.171486+0000","last_became_active":"2024-09-14T11:30:10.470179+0000","last_became_peered":"2024-09-14T11:30:10.470179+0000","last_unstale":"2024-09-14T13:02:34.171486+0000","last_undegraded":"2024-09-14T13:02:34.171486+0000","last_fullsized":"2024-09-14T13:02:34.171486+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'14","last_scrub_stamp":"2024-09-14T13:02:34.171302+0000","last_deep_scrub":"267'14","last_deep_scrub_stamp":"2024-09-14T13:02:34.171302+0000","last_clean_scrub_stamp":"2024-09-14T13:02:34.171302+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:20:16.343393+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":18,"num_read_kb":28678,"num_write":24,"num_write_kb":16388,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.a","version":"267'15","reported_seq":118,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:00:02.852840+0000","last_change":"2024-09-14T11:24:10.103674+0000","last_active":"2024-09-14T13:00:02.852840+0000","last_peered":"2024-09-14T13:00:02.852840+0000","last_clean":"2024-09-14T13:00:02.852840+0000","last_became_active":"2024-09-14T11:24:10.102918+0000","last_became_peered":"2024-09-14T11:24:10.102918+0000","last_unstale":"2024-09-14T13:00:02.852840+0000","last_undegraded":"2024-09-14T13:00:02.852840+0000","last_fullsized":"2024-09-14T13:00:02.852840+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:24:09.066501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:24:09.066501+0000","last_clean_scrub_stamp":"2024-09-14T11:24:09.066501+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":107,"num_read_kb":71,"num_write":42,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.c","version":"267'1","reported_seq":42,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:59:32.846025+0000","last_change":"2024-09-14T11:58:43.674524+0000","last_active":"2024-09-14T12:59:32.846025+0000","last_peered":"2024-09-14T12:59:32.846025+0000","last_clean":"2024-09-14T12:59:32.846025+0000","last_became_active":"2024-09-14T11:58:43.671065+0000","last_became_peered":"2024-09-14T11:58:43.671065+0000","last_unstale":"2024-09-14T12:59:32.846025+0000","last_undegraded":"2024-09-14T12:59:32.846025+0000","last_fullsized":"2024-09-14T12:59:32.846025+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:58:42.635024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:58:42.635024+0000","last_clean_scrub_stamp":"2024-09-14T11:58:42.635024+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:00:34.168002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.b","version":"267'11","reported_seq":94,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:41.182388+0000","last_change":"2024-09-14T13:02:41.182388+0000","last_active":"2024-09-14T13:02:41.182388+0000","last_peered":"2024-09-14T13:02:41.182388+0000","last_clean":"2024-09-14T13:02:41.182388+0000","last_became_active":"2024-09-14T11:30:17.516646+0000","last_became_peered":"2024-09-14T11:30:17.516646+0000","last_unstale":"2024-09-14T13:02:41.182388+0000","last_undegraded":"2024-09-14T13:02:41.182388+0000","last_fullsized":"2024-09-14T13:02:41.182388+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'11","last_scrub_stamp":"2024-09-14T13:02:41.182201+0000","last_deep_scrub":"267'11","last_deep_scrub_stamp":"2024-09-14T13:02:41.182201+0000","last_clean_scrub_stamp":"2024-09-14T13:02:41.182201+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:08:07.273375+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":17,"num_read_kb":13314,"num_write":16,"num_write_kb":10240,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.a","version":"264'2","reported_seq":75,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:59:28.251530+0000","last_change":"2024-09-14T11:30:10.473981+0000","last_active":"2024-09-14T12:59:28.251530+0000","last_peered":"2024-09-14T12:59:28.251530+0000","last_clean":"2024-09-14T12:59:28.251530+0000","last_became_active":"2024-09-14T11:30:10.473149+0000","last_became_peered":"2024-09-14T11:30:10.473149+0000","last_unstale":"2024-09-14T12:59:28.251530+0000","last_undegraded":"2024-09-14T12:59:28.251530+0000","last_fullsized":"2024-09-14T12:59:28.251530+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:30:09.411354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:30:09.411354+0000","last_clean_scrub_stamp":"2024-09-14T11:30:09.411354+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:31:29.150405+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":1024,"num_write":2,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.9","version":"267'22","reported_seq":138,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:59:33.474897+0000","last_change":"2024-09-14T11:24:10.122150+0000","last_active":"2024-09-14T12:59:33.474897+0000","last_peered":"2024-09-14T12:59:33.474897+0000","last_clean":"2024-09-14T12:59:33.474897+0000","last_became_active":"2024-09-14T11:24:10.121442+0000","last_became_peered":"2024-09-14T11:24:10.121442+0000","last_unstale":"2024-09-14T12:59:33.474897+0000","last_undegraded":"2024-09-14T12:59:33.474897+0000","last_fullsized":"2024-09-14T12:59:33.474897+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:24:09.066501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:24:09.066501+0000","last_clean_scrub_stamp":"2024-09-14T11:24:09.066501+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:07:27.847069+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":163,"num_read_kb":99,"num_write":58,"num_write_kb":15,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.d","version":"0'0","reported_seq":41,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:59:28.251656+0000","last_change":"2024-09-14T11:58:43.694247+0000","last_active":"2024-09-14T12:59:28.251656+0000","last_peered":"2024-09-14T12:59:28.251656+0000","last_clean":"2024-09-14T12:59:28.251656+0000","last_became_active":"2024-09-14T11:58:43.693568+0000","last_became_peered":"2024-09-14T11:58:43.693568+0000","last_unstale":"2024-09-14T12:59:28.251656+0000","last_undegraded":"2024-09-14T12:59:28.251656+0000","last_fullsized":"2024-09-14T12:59:28.251656+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:58:42.635024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:58:42.635024+0000","last_clean_scrub_stamp":"2024-09-14T11:58:42.635024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:56:07.440496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.a","version":"0'0","reported_seq":71,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:59:37.847095+0000","last_change":"2024-09-14T11:30:57.858852+0000","last_active":"2024-09-14T12:59:37.847095+0000","last_peered":"2024-09-14T12:59:37.847095+0000","last_clean":"2024-09-14T12:59:37.847095+0000","last_became_active":"2024-09-14T11:30:57.858040+0000","last_became_peered":"2024-09-14T11:30:57.858040+0000","last_unstale":"2024-09-14T12:59:37.847095+0000","last_undegraded":"2024-09-14T12:59:37.847095+0000","last_fullsized":"2024-09-14T12:59:37.847095+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:30:16.474654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:30:16.474654+0000","last_clean_scrub_stamp":"2024-09-14T11:30:16.474654+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:54:14.176092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.b","version":"267'4","reported_seq":76,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:00.191581+0000","last_change":"2024-09-14T11:30:10.446339+0000","last_active":"2024-09-14T13:02:00.191581+0000","last_peered":"2024-09-14T13:02:00.191581+0000","last_clean":"2024-09-14T13:02:00.191581+0000","last_became_active":"2024-09-14T11:30:10.442635+0000","last_became_peered":"2024-09-14T11:30:10.442635+0000","last_unstale":"2024-09-14T13:02:00.191581+0000","last_undegraded":"2024-09-14T13:02:00.191581+0000","last_fullsized":"2024-09-14T13:02:00.191581+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:30:09.411354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:30:09.411354+0000","last_clean_scrub_stamp":"2024-09-14T11:30:09.411354+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":8192,"num_write":4,"num_write_kb":8192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.8","version":"267'20","reported_seq":140,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:34.365412+0000","last_change":"2024-09-14T13:02:34.365412+0000","last_active":"2024-09-14T13:02:34.365412+0000","last_peered":"2024-09-14T13:02:34.365412+0000","last_clean":"2024-09-14T13:02:34.365412+0000","last_became_active":"2024-09-14T11:24:10.115856+0000","last_became_peered":"2024-09-14T11:24:10.115856+0000","last_unstale":"2024-09-14T13:02:34.365412+0000","last_undegraded":"2024-09-14T13:02:34.365412+0000","last_fullsized":"2024-09-14T13:02:34.365412+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'20","last_scrub_stamp":"2024-09-14T13:02:34.365202+0000","last_deep_scrub":"267'20","last_deep_scrub_stamp":"2024-09-14T13:02:34.365202+0000","last_clean_scrub_stamp":"2024-09-14T13:02:34.365202+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:54:39.800267+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":144,"num_read_kb":94,"num_write":54,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.2","version":"0'0","reported_seq":43,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:59:12.841261+0000","last_change":"2024-09-14T11:58:43.696428+0000","last_active":"2024-09-14T12:59:12.841261+0000","last_peered":"2024-09-14T12:59:12.841261+0000","last_clean":"2024-09-14T12:59:12.841261+0000","last_became_active":"2024-09-14T11:58:43.695896+0000","last_became_peered":"2024-09-14T11:58:43.695896+0000","last_unstale":"2024-09-14T12:59:12.841261+0000","last_undegraded":"2024-09-14T12:59:12.841261+0000","last_fullsized":"2024-09-14T12:59:12.841261+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:58:42.635024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:58:42.635024+0000","last_clean_scrub_stamp":"2024-09-14T11:58:42.635024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:00:52.004945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.5","version":"0'0","reported_seq":67,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:00:18.263426+0000","last_change":"2024-09-14T11:30:17.520310+0000","last_active":"2024-09-14T13:00:18.263426+0000","last_peered":"2024-09-14T13:00:18.263426+0000","last_clean":"2024-09-14T13:00:18.263426+0000","last_became_active":"2024-09-14T11:30:17.519903+0000","last_became_peered":"2024-09-14T11:30:17.519903+0000","last_unstale":"2024-09-14T13:00:18.263426+0000","last_undegraded":"2024-09-14T13:00:18.263426+0000","last_fullsized":"2024-09-14T13:00:18.263426+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:30:16.474654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:30:16.474654+0000","last_clean_scrub_stamp":"2024-09-14T11:30:16.474654+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.4","version":"264'4","reported_seq":82,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:59:47.849496+0000","last_change":"2024-09-14T11:30:10.469781+0000","last_active":"2024-09-14T12:59:47.849496+0000","last_peered":"2024-09-14T12:59:47.849496+0000","last_clean":"2024-09-14T12:59:47.849496+0000","last_became_active":"2024-09-14T11:30:10.468287+0000","last_became_peered":"2024-09-14T11:30:10.468287+0000","last_unstale":"2024-09-14T12:59:47.849496+0000","last_undegraded":"2024-09-14T12:59:47.849496+0000","last_fullsized":"2024-09-14T12:59:47.849496+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:30:09.411354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:30:09.411354+0000","last_clean_scrub_stamp":"2024-09-14T11:30:09.411354+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:43:03.239163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":11264,"num_write":4,"num_write_kb":7168,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.7","version":"267'11","reported_seq":111,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:59:33.252891+0000","last_change":"2024-09-14T11:24:10.097912+0000","last_active":"2024-09-14T12:59:33.252891+0000","last_peered":"2024-09-14T12:59:33.252891+0000","last_clean":"2024-09-14T12:59:33.252891+0000","last_became_active":"2024-09-14T11:24:10.097206+0000","last_became_peered":"2024-09-14T11:24:10.097206+0000","last_unstale":"2024-09-14T12:59:33.252891+0000","last_undegraded":"2024-09-14T12:59:33.252891+0000","last_fullsized":"2024-09-14T12:59:33.252891+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:24:09.066501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:24:09.066501+0000","last_clean_scrub_stamp":"2024-09-14T11:24:09.066501+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:05:42.905472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":88,"num_read_kb":49,"num_write":30,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.3","version":"0'0","reported_seq":43,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:59:08.049987+0000","last_change":"2024-09-14T11:58:43.693608+0000","last_active":"2024-09-14T12:59:08.049987+0000","last_peered":"2024-09-14T12:59:08.049987+0000","last_clean":"2024-09-14T12:59:08.049987+0000","last_became_active":"2024-09-14T11:58:43.689661+0000","last_became_peered":"2024-09-14T11:58:43.689661+0000","last_unstale":"2024-09-14T12:59:08.049987+0000","last_undegraded":"2024-09-14T12:59:08.049987+0000","last_fullsized":"2024-09-14T12:59:08.049987+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:58:42.635024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:58:42.635024+0000","last_clean_scrub_stamp":"2024-09-14T11:58:42.635024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:26:59.844029+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.4","version":"267'5","reported_seq":75,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:00.168550+0000","last_change":"2024-09-14T11:30:17.501104+0000","last_active":"2024-09-14T13:02:00.168550+0000","last_peered":"2024-09-14T13:02:00.168550+0000","last_clean":"2024-09-14T13:02:00.168550+0000","last_became_active":"2024-09-14T11:30:17.500215+0000","last_became_peered":"2024-09-14T11:30:17.500215+0000","last_unstale":"2024-09-14T13:02:00.168550+0000","last_undegraded":"2024-09-14T13:02:00.168550+0000","last_fullsized":"2024-09-14T13:02:00.168550+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:30:16.474654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:30:16.474654+0000","last_clean_scrub_stamp":"2024-09-14T11:30:16.474654+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:46:20.398415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":2052,"num_write":10,"num_write_kb":1028,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.5","version":"267'5","reported_seq":90,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:33.088134+0000","last_change":"2024-09-14T13:02:33.088134+0000","last_active":"2024-09-14T13:02:33.088134+0000","last_peered":"2024-09-14T13:02:33.088134+0000","last_clean":"2024-09-14T13:02:33.088134+0000","last_became_active":"2024-09-14T11:30:10.464076+0000","last_became_peered":"2024-09-14T11:30:10.464076+0000","last_unstale":"2024-09-14T13:02:33.088134+0000","last_undegraded":"2024-09-14T13:02:33.088134+0000","last_fullsized":"2024-09-14T13:02:33.088134+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'5","last_scrub_stamp":"2024-09-14T13:02:33.087943+0000","last_deep_scrub":"267'5","last_deep_scrub_stamp":"2024-09-14T13:02:33.087943+0000","last_clean_scrub_stamp":"2024-09-14T13:02:33.087943+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:50:28.317602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":16384,"num_write":10,"num_write_kb":8192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.6","version":"267'17","reported_seq":137,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:33.318288+0000","last_change":"2024-09-14T13:02:33.318288+0000","last_active":"2024-09-14T13:02:33.318288+0000","last_peered":"2024-09-14T13:02:33.318288+0000","last_clean":"2024-09-14T13:02:33.318288+0000","last_became_active":"2024-09-14T11:24:10.123193+0000","last_became_peered":"2024-09-14T11:24:10.123193+0000","last_unstale":"2024-09-14T13:02:33.318288+0000","last_undegraded":"2024-09-14T13:02:33.318288+0000","last_fullsized":"2024-09-14T13:02:33.318288+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'17","last_scrub_stamp":"2024-09-14T13:02:33.318096+0000","last_deep_scrub":"267'17","last_deep_scrub_stamp":"2024-09-14T13:02:33.318096+0000","last_clean_scrub_stamp":"2024-09-14T13:02:33.318096+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:16:39.854310+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":141,"num_read_kb":98,"num_write":56,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.0","version":"0'0","reported_seq":44,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:58:48.462247+0000","last_change":"2024-09-14T11:58:43.690698+0000","last_active":"2024-09-14T12:58:48.462247+0000","last_peered":"2024-09-14T12:58:48.462247+0000","last_clean":"2024-09-14T12:58:48.462247+0000","last_became_active":"2024-09-14T11:58:43.690036+0000","last_became_peered":"2024-09-14T11:58:43.690036+0000","last_unstale":"2024-09-14T12:58:48.462247+0000","last_undegraded":"2024-09-14T12:58:48.462247+0000","last_fullsized":"2024-09-14T12:58:48.462247+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:58:42.635024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:58:42.635024+0000","last_clean_scrub_stamp":"2024-09-14T11:58:42.635024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:02:37.171544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"67.7","version":"0'0","reported_seq":65,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:59:07.840222+0000","last_change":"2024-09-14T11:30:17.504824+0000","last_active":"2024-09-14T12:59:07.840222+0000","last_peered":"2024-09-14T12:59:07.840222+0000","last_clean":"2024-09-14T12:59:07.840222+0000","last_became_active":"2024-09-14T11:30:17.503548+0000","last_became_peered":"2024-09-14T11:30:17.503548+0000","last_unstale":"2024-09-14T12:59:07.840222+0000","last_undegraded":"2024-09-14T12:59:07.840222+0000","last_fullsized":"2024-09-14T12:59:07.840222+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:30:16.474654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:30:16.474654+0000","last_clean_scrub_stamp":"2024-09-14T11:30:16.474654+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:04:54.678316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.6","version":"264'4","reported_seq":81,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:59:03.048985+0000","last_change":"2024-09-14T11:30:10.463753+0000","last_active":"2024-09-14T12:59:03.048985+0000","last_peered":"2024-09-14T12:59:03.048985+0000","last_clean":"2024-09-14T12:59:03.048985+0000","last_became_active":"2024-09-14T11:30:10.462971+0000","last_became_peered":"2024-09-14T11:30:10.462971+0000","last_unstale":"2024-09-14T12:59:03.048985+0000","last_undegraded":"2024-09-14T12:59:03.048985+0000","last_fullsized":"2024-09-14T12:59:03.048985+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:30:09.411354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:30:09.411354+0000","last_clean_scrub_stamp":"2024-09-14T11:30:09.411354+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:28:19.411905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":16386,"num_write":4,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.5","version":"267'29","reported_seq":157,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:00:32.860035+0000","last_change":"2024-09-14T11:24:10.105209+0000","last_active":"2024-09-14T13:00:32.860035+0000","last_peered":"2024-09-14T13:00:32.860035+0000","last_clean":"2024-09-14T13:00:32.860035+0000","last_became_active":"2024-09-14T11:24:10.104277+0000","last_became_peered":"2024-09-14T11:24:10.104277+0000","last_unstale":"2024-09-14T13:00:32.860035+0000","last_undegraded":"2024-09-14T13:00:32.860035+0000","last_fullsized":"2024-09-14T13:00:32.860035+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:24:09.066501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:24:09.066501+0000","last_clean_scrub_stamp":"2024-09-14T11:24:09.066501+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":210,"num_read_kb":138,"num_write":78,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.1","version":"0'0","reported_seq":43,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:59:08.234700+0000","last_change":"2024-09-14T11:58:43.675560+0000","last_active":"2024-09-14T12:59:08.234700+0000","last_peered":"2024-09-14T12:59:08.234700+0000","last_clean":"2024-09-14T12:59:08.234700+0000","last_became_active":"2024-09-14T11:58:43.674870+0000","last_became_peered":"2024-09-14T11:58:43.674870+0000","last_unstale":"2024-09-14T12:59:08.234700+0000","last_undegraded":"2024-09-14T12:59:08.234700+0000","last_fullsized":"2024-09-14T12:59:08.234700+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:58:42.635024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:58:42.635024+0000","last_clean_scrub_stamp":"2024-09-14T11:58:42.635024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:17:48.384984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"67.6","version":"267'2","reported_seq":68,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:01:18.264763+0000","last_change":"2024-09-14T11:30:17.521153+0000","last_active":"2024-09-14T13:01:18.264763+0000","last_peered":"2024-09-14T13:01:18.264763+0000","last_clean":"2024-09-14T13:01:18.264763+0000","last_became_active":"2024-09-14T11:30:17.520433+0000","last_became_peered":"2024-09-14T11:30:17.520433+0000","last_unstale":"2024-09-14T13:01:18.264763+0000","last_undegraded":"2024-09-14T13:01:18.264763+0000","last_fullsized":"2024-09-14T13:01:18.264763+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:30:16.474654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:30:16.474654+0000","last_clean_scrub_stamp":"2024-09-14T11:30:16.474654+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:46:08.197483+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":4096,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.7","version":"267'4","reported_seq":78,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:00.017794+0000","last_change":"2024-09-14T11:30:10.475293+0000","last_active":"2024-09-14T13:02:00.017794+0000","last_peered":"2024-09-14T13:02:00.017794+0000","last_clean":"2024-09-14T13:02:00.017794+0000","last_became_active":"2024-09-14T11:30:10.474546+0000","last_became_peered":"2024-09-14T11:30:10.474546+0000","last_unstale":"2024-09-14T13:02:00.017794+0000","last_undegraded":"2024-09-14T13:02:00.017794+0000","last_fullsized":"2024-09-14T13:02:00.017794+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:30:09.411354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:30:09.411354+0000","last_clean_scrub_stamp":"2024-09-14T11:30:09.411354+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:09:53.059916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":3072,"num_write":4,"num_write_kb":2048,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.4","version":"267'33","reported_seq":169,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:40.216496+0000","last_change":"2024-09-14T13:02:40.216496+0000","last_active":"2024-09-14T13:02:40.216496+0000","last_peered":"2024-09-14T13:02:40.216496+0000","last_clean":"2024-09-14T13:02:40.216496+0000","last_became_active":"2024-09-14T11:24:10.118333+0000","last_became_peered":"2024-09-14T11:24:10.118333+0000","last_unstale":"2024-09-14T13:02:40.216496+0000","last_undegraded":"2024-09-14T13:02:40.216496+0000","last_fullsized":"2024-09-14T13:02:40.216496+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'33","last_scrub_stamp":"2024-09-14T13:02:40.216319+0000","last_deep_scrub":"267'33","last_deep_scrub_stamp":"2024-09-14T13:02:40.216319+0000","last_clean_scrub_stamp":"2024-09-14T13:02:40.216319+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T00:09:01.124202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":218,"num_read_kb":138,"num_write":85,"num_write_kb":20,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"68.6","version":"267'2","reported_seq":52,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:37.223646+0000","last_change":"2024-09-14T13:02:37.223646+0000","last_active":"2024-09-14T13:02:37.223646+0000","last_peered":"2024-09-14T13:02:37.223646+0000","last_clean":"2024-09-14T13:02:37.223646+0000","last_became_active":"2024-09-14T11:58:43.688251+0000","last_became_peered":"2024-09-14T11:58:43.688251+0000","last_unstale":"2024-09-14T13:02:37.223646+0000","last_undegraded":"2024-09-14T13:02:37.223646+0000","last_fullsized":"2024-09-14T13:02:37.223646+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'2","last_scrub_stamp":"2024-09-14T13:02:37.223463+0000","last_deep_scrub":"267'2","last_deep_scrub_stamp":"2024-09-14T13:02:37.223463+0000","last_clean_scrub_stamp":"2024-09-14T13:02:37.223463+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:01:40.745731+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":188,"num_omap_keys":2,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.1","version":"267'7","reported_seq":89,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:43.139542+0000","last_change":"2024-09-14T13:02:43.139542+0000","last_active":"2024-09-14T13:02:43.139542+0000","last_peered":"2024-09-14T13:02:43.139542+0000","last_clean":"2024-09-14T13:02:43.139542+0000","last_became_active":"2024-09-14T11:30:17.518890+0000","last_became_peered":"2024-09-14T11:30:17.518890+0000","last_unstale":"2024-09-14T13:02:43.139542+0000","last_undegraded":"2024-09-14T13:02:43.139542+0000","last_fullsized":"2024-09-14T13:02:43.139542+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'7","last_scrub_stamp":"2024-09-14T13:02:43.139285+0000","last_deep_scrub":"267'7","last_deep_scrub_stamp":"2024-09-14T13:02:43.139285+0000","last_clean_scrub_stamp":"2024-09-14T13:02:43.139285+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:22:07.656210+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":19458,"num_write":12,"num_write_kb":7168,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.0","version":"267'2","reported_seq":78,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:00.475335+0000","last_change":"2024-09-14T11:30:10.467502+0000","last_active":"2024-09-14T13:02:00.475335+0000","last_peered":"2024-09-14T13:02:00.475335+0000","last_clean":"2024-09-14T13:02:00.475335+0000","last_became_active":"2024-09-14T11:30:10.466391+0000","last_became_peered":"2024-09-14T11:30:10.466391+0000","last_unstale":"2024-09-14T13:02:00.475335+0000","last_undegraded":"2024-09-14T13:02:00.475335+0000","last_fullsized":"2024-09-14T13:02:00.475335+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:30:09.411354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:30:09.411354+0000","last_clean_scrub_stamp":"2024-09-14T11:30:09.411354+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":40,"num_write":2,"num_write_kb":40,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.3","version":"267'41","reported_seq":191,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:00:03.061879+0000","last_change":"2024-09-14T11:24:10.095296+0000","last_active":"2024-09-14T13:00:03.061879+0000","last_peered":"2024-09-14T13:00:03.061879+0000","last_clean":"2024-09-14T13:00:03.061879+0000","last_became_active":"2024-09-14T11:24:10.094515+0000","last_became_peered":"2024-09-14T11:24:10.094515+0000","last_unstale":"2024-09-14T13:00:03.061879+0000","last_undegraded":"2024-09-14T13:00:03.061879+0000","last_fullsized":"2024-09-14T13:00:03.061879+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:24:09.066501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:24:09.066501+0000","last_clean_scrub_stamp":"2024-09-14T11:24:09.066501+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":0,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":311,"num_read_kb":196,"num_write":106,"num_write_kb":28,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"68.7","version":"0'0","reported_seq":42,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:59:23.250462+0000","last_change":"2024-09-14T11:58:43.681439+0000","last_active":"2024-09-14T12:59:23.250462+0000","last_peered":"2024-09-14T12:59:23.250462+0000","last_clean":"2024-09-14T12:59:23.250462+0000","last_became_active":"2024-09-14T11:58:43.680569+0000","last_became_peered":"2024-09-14T11:58:43.680569+0000","last_unstale":"2024-09-14T12:59:23.250462+0000","last_undegraded":"2024-09-14T12:59:23.250462+0000","last_fullsized":"2024-09-14T12:59:23.250462+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:58:42.635024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:58:42.635024+0000","last_clean_scrub_stamp":"2024-09-14T11:58:42.635024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:50:38.486174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.0","version":"267'4","reported_seq":77,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:00.340340+0000","last_change":"2024-09-14T11:30:17.519289+0000","last_active":"2024-09-14T13:02:00.340340+0000","last_peered":"2024-09-14T13:02:00.340340+0000","last_clean":"2024-09-14T13:02:00.340340+0000","last_became_active":"2024-09-14T11:30:17.518524+0000","last_became_peered":"2024-09-14T11:30:17.518524+0000","last_unstale":"2024-09-14T13:02:00.340340+0000","last_undegraded":"2024-09-14T13:02:00.340340+0000","last_fullsized":"2024-09-14T13:02:00.340340+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:30:16.474654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:30:16.474654+0000","last_clean_scrub_stamp":"2024-09-14T11:30:16.474654+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":6144,"num_write":4,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.1","version":"267'5","reported_seq":80,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:01:52.878597+0000","last_change":"2024-09-14T11:30:10.465435+0000","last_active":"2024-09-14T13:01:52.878597+0000","last_peered":"2024-09-14T13:01:52.878597+0000","last_clean":"2024-09-14T13:01:52.878597+0000","last_became_active":"2024-09-14T11:30:10.464696+0000","last_became_peered":"2024-09-14T11:30:10.464696+0000","last_unstale":"2024-09-14T13:01:52.878597+0000","last_undegraded":"2024-09-14T13:01:52.878597+0000","last_fullsized":"2024-09-14T13:01:52.878597+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:30:09.411354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:30:09.411354+0000","last_clean_scrub_stamp":"2024-09-14T11:30:09.411354+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:34:28.871663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":1024,"num_write":10,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.2","version":"267'34","reported_seq":184,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:42.645516+0000","last_change":"2024-09-14T13:02:42.645516+0000","last_active":"2024-09-14T13:02:42.645516+0000","last_peered":"2024-09-14T13:02:42.645516+0000","last_clean":"2024-09-14T13:02:42.645516+0000","last_became_active":"2024-09-14T11:24:10.125885+0000","last_became_peered":"2024-09-14T11:24:10.125885+0000","last_unstale":"2024-09-14T13:02:42.645516+0000","last_undegraded":"2024-09-14T13:02:42.645516+0000","last_fullsized":"2024-09-14T13:02:42.645516+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'34","last_scrub_stamp":"2024-09-14T13:02:42.645335+0000","last_deep_scrub":"267'34","last_deep_scrub_stamp":"2024-09-14T13:02:42.645335+0000","last_clean_scrub_stamp":"2024-09-14T13:02:42.645335+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T00:08:43.424400+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":284,"num_read_kb":180,"num_write":83,"num_write_kb":28,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"68.4","version":"0'0","reported_seq":43,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:59:08.246950+0000","last_change":"2024-09-14T11:58:43.663976+0000","last_active":"2024-09-14T12:59:08.246950+0000","last_peered":"2024-09-14T12:59:08.246950+0000","last_clean":"2024-09-14T12:59:08.246950+0000","last_became_active":"2024-09-14T11:58:43.662916+0000","last_became_peered":"2024-09-14T11:58:43.662916+0000","last_unstale":"2024-09-14T12:59:08.246950+0000","last_undegraded":"2024-09-14T12:59:08.246950+0000","last_fullsized":"2024-09-14T12:59:08.246950+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:58:42.635024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:58:42.635024+0000","last_clean_scrub_stamp":"2024-09-14T11:58:42.635024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:29:35.878769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.3","version":"264'4","reported_seq":85,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:39.341302+0000","last_change":"2024-09-14T13:02:39.341302+0000","last_active":"2024-09-14T13:02:39.341302+0000","last_peered":"2024-09-14T13:02:39.341302+0000","last_clean":"2024-09-14T13:02:39.341302+0000","last_became_active":"2024-09-14T11:30:17.549019+0000","last_became_peered":"2024-09-14T11:30:17.549019+0000","last_unstale":"2024-09-14T13:02:39.341302+0000","last_undegraded":"2024-09-14T13:02:39.341302+0000","last_fullsized":"2024-09-14T13:02:39.341302+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'4","last_scrub_stamp":"2024-09-14T13:02:39.341107+0000","last_deep_scrub":"264'4","last_deep_scrub_stamp":"2024-09-14T13:02:39.341107+0000","last_clean_scrub_stamp":"2024-09-14T13:02:39.341107+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:23:14.529883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":4098,"num_write":4,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"66.2","version":"267'4","reported_seq":89,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:42.159375+0000","last_change":"2024-09-14T13:02:42.159375+0000","last_active":"2024-09-14T13:02:42.159375+0000","last_peered":"2024-09-14T13:02:42.159375+0000","last_clean":"2024-09-14T13:02:42.159375+0000","last_became_active":"2024-09-14T11:30:10.460643+0000","last_became_peered":"2024-09-14T11:30:10.460643+0000","last_unstale":"2024-09-14T13:02:42.159375+0000","last_undegraded":"2024-09-14T13:02:42.159375+0000","last_fullsized":"2024-09-14T13:02:42.159375+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'4","last_scrub_stamp":"2024-09-14T13:02:42.159144+0000","last_deep_scrub":"267'4","last_deep_scrub_stamp":"2024-09-14T13:02:42.159144+0000","last_clean_scrub_stamp":"2024-09-14T13:02:42.159144+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:23:08.151155+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":3072,"num_write":4,"num_write_kb":2048,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.1","version":"267'13","reported_seq":123,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:36.412512+0000","last_change":"2024-09-14T13:02:36.412512+0000","last_active":"2024-09-14T13:02:36.412512+0000","last_peered":"2024-09-14T13:02:36.412512+0000","last_clean":"2024-09-14T13:02:36.412512+0000","last_became_active":"2024-09-14T11:24:10.116627+0000","last_became_peered":"2024-09-14T11:24:10.116627+0000","last_unstale":"2024-09-14T13:02:36.412512+0000","last_undegraded":"2024-09-14T13:02:36.412512+0000","last_fullsized":"2024-09-14T13:02:36.412512+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'13","last_scrub_stamp":"2024-09-14T13:02:36.412325+0000","last_deep_scrub":"267'13","last_deep_scrub_stamp":"2024-09-14T13:02:36.412325+0000","last_clean_scrub_stamp":"2024-09-14T13:02:36.412325+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:23:25.445266+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":96,"num_read_kb":63,"num_write":36,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.5","version":"0'0","reported_seq":43,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:59:32.846067+0000","last_change":"2024-09-14T11:58:43.696722+0000","last_active":"2024-09-14T12:59:32.846067+0000","last_peered":"2024-09-14T12:59:32.846067+0000","last_clean":"2024-09-14T12:59:32.846067+0000","last_became_active":"2024-09-14T11:58:43.695982+0000","last_became_peered":"2024-09-14T11:58:43.695982+0000","last_unstale":"2024-09-14T12:59:32.846067+0000","last_undegraded":"2024-09-14T12:59:32.846067+0000","last_fullsized":"2024-09-14T12:59:32.846067+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:58:42.635024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:58:42.635024+0000","last_clean_scrub_stamp":"2024-09-14T11:58:42.635024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:04:33.126348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.2","version":"264'8","reported_seq":85,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:59:53.244786+0000","last_change":"2024-09-14T11:30:17.513530+0000","last_active":"2024-09-14T12:59:53.244786+0000","last_peered":"2024-09-14T12:59:53.244786+0000","last_clean":"2024-09-14T12:59:53.244786+0000","last_became_active":"2024-09-14T11:30:17.512689+0000","last_became_peered":"2024-09-14T11:30:17.512689+0000","last_unstale":"2024-09-14T12:59:53.244786+0000","last_undegraded":"2024-09-14T12:59:53.244786+0000","last_fullsized":"2024-09-14T12:59:53.244786+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:30:16.474654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:30:16.474654+0000","last_clean_scrub_stamp":"2024-09-14T11:30:16.474654+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:38:38.268473+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":21506,"num_write":8,"num_write_kb":9216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.3","version":"0'0","reported_seq":81,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:38.334921+0000","last_change":"2024-09-14T13:02:38.334921+0000","last_active":"2024-09-14T13:02:38.334921+0000","last_peered":"2024-09-14T13:02:38.334921+0000","last_clean":"2024-09-14T13:02:38.334921+0000","last_became_active":"2024-09-14T11:30:10.473880+0000","last_became_peered":"2024-09-14T11:30:10.473880+0000","last_unstale":"2024-09-14T13:02:38.334921+0000","last_undegraded":"2024-09-14T13:02:38.334921+0000","last_fullsized":"2024-09-14T13:02:38.334921+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T13:02:38.334721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T13:02:38.334721+0000","last_clean_scrub_stamp":"2024-09-14T13:02:38.334721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:23:50.471222+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"65.0","version":"264'14","reported_seq":131,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:42.639617+0000","last_change":"2024-09-14T13:02:42.639341+0000","last_active":"2024-09-14T13:02:42.639617+0000","last_peered":"2024-09-14T13:02:42.639617+0000","last_clean":"2024-09-14T13:02:42.639617+0000","last_became_active":"2024-09-14T11:24:10.115799+0000","last_became_peered":"2024-09-14T11:24:10.115799+0000","last_unstale":"2024-09-14T13:02:42.639617+0000","last_undegraded":"2024-09-14T13:02:42.639617+0000","last_fullsized":"2024-09-14T13:02:42.639617+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'14","last_scrub_stamp":"2024-09-14T13:02:42.639124+0000","last_deep_scrub":"264'14","last_deep_scrub_stamp":"2024-09-14T13:02:42.639124+0000","last_clean_scrub_stamp":"2024-09-14T13:02:42.639124+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:45:09.264335+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":114,"num_read_kb":78,"num_write":35,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3f","version":"267'205","reported_seq":883,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:20.638712+0000","last_change":"2024-09-14T13:02:20.638712+0000","last_active":"2024-09-14T13:02:20.638712+0000","last_peered":"2024-09-14T13:02:20.638712+0000","last_clean":"2024-09-14T13:02:20.638712+0000","last_became_active":"2024-09-14T11:08:21.829676+0000","last_became_peered":"2024-09-14T11:08:21.829676+0000","last_unstale":"2024-09-14T13:02:20.638712+0000","last_undegraded":"2024-09-14T13:02:20.638712+0000","last_fullsized":"2024-09-14T13:02:20.638712+0000","mapping_epoch":24,"log_start":"267'100","ondisk_log_start":"267'100","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'205","last_scrub_stamp":"2024-09-14T13:02:20.638511+0000","last_deep_scrub":"267'205","last_deep_scrub_stamp":"2024-09-14T13:02:20.638511+0000","last_clean_scrub_stamp":"2024-09-14T13:02:20.638511+0000","objects_scrubbed":3,"log_size":105,"log_dups_size":100,"ondisk_log_size":105,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T00:56:48.157172+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":30,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":573,"num_read_kb":18432,"num_write":892,"num_write_kb":26168,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,0],"acting":[7,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.38","version":"267'465","reported_seq":2079,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:26.510841+0000","last_change":"2024-09-14T13:02:26.510841+0000","last_active":"2024-09-14T13:02:26.510841+0000","last_peered":"2024-09-14T13:02:26.510841+0000","last_clean":"2024-09-14T13:02:26.510841+0000","last_became_active":"2024-09-14T11:08:23.800936+0000","last_became_peered":"2024-09-14T11:08:23.800936+0000","last_unstale":"2024-09-14T13:02:26.510841+0000","last_undegraded":"2024-09-14T13:02:26.510841+0000","last_fullsized":"2024-09-14T13:02:26.510841+0000","mapping_epoch":26,"log_start":"267'400","ondisk_log_start":"267'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'465","last_scrub_stamp":"2024-09-14T13:02:26.510658+0000","last_deep_scrub":"267'465","last_deep_scrub_stamp":"2024-09-14T13:02:26.510658+0000","last_clean_scrub_stamp":"2024-09-14T13:02:26.510658+0000","objects_scrubbed":4,"log_size":65,"log_dups_size":400,"ondisk_log_size":65,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:25:43.630955+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":2476,"num_read_kb":2325,"num_write":550,"num_write_kb":127,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":720,"num_omap_keys":3,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3e","version":"267'229","reported_seq":944,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:15.043489+0000","last_change":"2024-09-14T13:02:15.043489+0000","last_active":"2024-09-14T13:02:15.043489+0000","last_peered":"2024-09-14T13:02:15.043489+0000","last_clean":"2024-09-14T13:02:15.043489+0000","last_became_active":"2024-09-14T11:08:21.808315+0000","last_became_peered":"2024-09-14T11:08:21.808315+0000","last_unstale":"2024-09-14T13:02:15.043489+0000","last_undegraded":"2024-09-14T13:02:15.043489+0000","last_fullsized":"2024-09-14T13:02:15.043489+0000","mapping_epoch":24,"log_start":"267'200","ondisk_log_start":"267'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'229","last_scrub_stamp":"2024-09-14T13:02:15.043275+0000","last_deep_scrub":"267'229","last_deep_scrub_stamp":"2024-09-14T13:02:15.043275+0000","last_clean_scrub_stamp":"2024-09-14T13:02:15.043275+0000","objects_scrubbed":3,"log_size":29,"log_dups_size":200,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:33:02.128503+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1655861,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":605,"num_read_kb":113994,"num_write":1045,"num_write_kb":54817,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,6],"acting":[1,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.39","version":"267'900","reported_seq":2654,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:25.597874+0000","last_change":"2024-09-14T13:02:25.597874+0000","last_active":"2024-09-14T13:02:25.597874+0000","last_peered":"2024-09-14T13:02:25.597874+0000","last_clean":"2024-09-14T13:02:25.597874+0000","last_became_active":"2024-09-14T11:08:23.801320+0000","last_became_peered":"2024-09-14T11:08:23.801320+0000","last_unstale":"2024-09-14T13:02:25.597874+0000","last_undegraded":"2024-09-14T13:02:25.597874+0000","last_fullsized":"2024-09-14T13:02:25.597874+0000","mapping_epoch":26,"log_start":"267'800","ondisk_log_start":"267'800","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'900","last_scrub_stamp":"2024-09-14T13:02:25.597694+0000","last_deep_scrub":"267'900","last_deep_scrub_stamp":"2024-09-14T13:02:25.597694+0000","last_clean_scrub_stamp":"2024-09-14T13:02:25.597694+0000","objects_scrubbed":4,"log_size":100,"log_dups_size":800,"ondisk_log_size":100,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:15:17.189583+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":4549,"num_read_kb":4112,"num_write":1219,"num_write_kb":503,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2767,"num_omap_keys":11,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3d","version":"267'201","reported_seq":856,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:12.135141+0000","last_change":"2024-09-14T13:02:12.135141+0000","last_active":"2024-09-14T13:02:12.135141+0000","last_peered":"2024-09-14T13:02:12.135141+0000","last_clean":"2024-09-14T13:02:12.135141+0000","last_became_active":"2024-09-14T11:08:21.776255+0000","last_became_peered":"2024-09-14T11:08:21.776255+0000","last_unstale":"2024-09-14T13:02:12.135141+0000","last_undegraded":"2024-09-14T13:02:12.135141+0000","last_fullsized":"2024-09-14T13:02:12.135141+0000","mapping_epoch":24,"log_start":"267'100","ondisk_log_start":"267'100","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'201","last_scrub_stamp":"2024-09-14T13:02:12.134852+0000","last_deep_scrub":"267'201","last_deep_scrub_stamp":"2024-09-14T13:02:12.134852+0000","last_clean_scrub_stamp":"2024-09-14T13:02:12.134852+0000","objects_scrubbed":6,"log_size":101,"log_dups_size":100,"ondisk_log_size":101,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:30:34.196127+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":515488,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":487,"num_read_kb":4028,"num_write":961,"num_write_kb":22458,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"267'468","reported_seq":2128,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:24.707519+0000","last_change":"2024-09-14T13:02:24.707519+0000","last_active":"2024-09-14T13:02:24.707519+0000","last_peered":"2024-09-14T13:02:24.707519+0000","last_clean":"2024-09-14T13:02:24.707519+0000","last_became_active":"2024-09-14T11:08:23.786481+0000","last_became_peered":"2024-09-14T11:08:23.786481+0000","last_unstale":"2024-09-14T13:02:24.707519+0000","last_undegraded":"2024-09-14T13:02:24.707519+0000","last_fullsized":"2024-09-14T13:02:24.707519+0000","mapping_epoch":26,"log_start":"267'400","ondisk_log_start":"267'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'468","last_scrub_stamp":"2024-09-14T13:02:24.707341+0000","last_deep_scrub":"267'468","last_deep_scrub_stamp":"2024-09-14T13:02:24.707341+0000","last_clean_scrub_stamp":"2024-09-14T13:02:24.707341+0000","objects_scrubbed":0,"log_size":68,"log_dups_size":400,"ondisk_log_size":68,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:51:19.709141+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2493,"num_read_kb":2352,"num_write":540,"num_write_kb":121,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3c","version":"267'354","reported_seq":1103,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:20.476600+0000","last_change":"2024-09-14T13:02:20.476600+0000","last_active":"2024-09-14T13:02:20.476600+0000","last_peered":"2024-09-14T13:02:20.476600+0000","last_clean":"2024-09-14T13:02:20.476600+0000","last_became_active":"2024-09-14T11:08:21.801787+0000","last_became_peered":"2024-09-14T11:08:21.801787+0000","last_unstale":"2024-09-14T13:02:20.476600+0000","last_undegraded":"2024-09-14T13:02:20.476600+0000","last_fullsized":"2024-09-14T13:02:20.476600+0000","mapping_epoch":24,"log_start":"267'300","ondisk_log_start":"267'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'354","last_scrub_stamp":"2024-09-14T13:02:20.476366+0000","last_deep_scrub":"267'354","last_deep_scrub_stamp":"2024-09-14T13:02:20.476366+0000","last_clean_scrub_stamp":"2024-09-14T13:02:20.476366+0000","objects_scrubbed":4,"log_size":54,"log_dups_size":300,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:53:20.365511+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":72,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1015,"num_read_kb":46026,"num_write":1390,"num_write_kb":39725,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3b","version":"267'451","reported_seq":1992,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:22.995425+0000","last_change":"2024-09-14T13:02:22.995425+0000","last_active":"2024-09-14T13:02:22.995425+0000","last_peered":"2024-09-14T13:02:22.995425+0000","last_clean":"2024-09-14T13:02:22.995425+0000","last_became_active":"2024-09-14T11:08:23.783162+0000","last_became_peered":"2024-09-14T11:08:23.783162+0000","last_unstale":"2024-09-14T13:02:22.995425+0000","last_undegraded":"2024-09-14T13:02:22.995425+0000","last_fullsized":"2024-09-14T13:02:22.995425+0000","mapping_epoch":26,"log_start":"267'400","ondisk_log_start":"267'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'451","last_scrub_stamp":"2024-09-14T13:02:22.995232+0000","last_deep_scrub":"267'451","last_deep_scrub_stamp":"2024-09-14T13:02:22.995232+0000","last_clean_scrub_stamp":"2024-09-14T13:02:22.995232+0000","objects_scrubbed":3,"log_size":51,"log_dups_size":400,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:03:50.107240+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2320,"num_read_kb":2170,"num_write":502,"num_write_kb":112,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":248,"num_omap_keys":1,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3b","version":"267'212","reported_seq":901,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:19.672895+0000","last_change":"2024-09-14T13:02:19.672895+0000","last_active":"2024-09-14T13:02:19.672895+0000","last_peered":"2024-09-14T13:02:19.672895+0000","last_clean":"2024-09-14T13:02:19.672895+0000","last_became_active":"2024-09-14T11:08:21.842260+0000","last_became_peered":"2024-09-14T11:08:21.842260+0000","last_unstale":"2024-09-14T13:02:19.672895+0000","last_undegraded":"2024-09-14T13:02:19.672895+0000","last_fullsized":"2024-09-14T13:02:19.672895+0000","mapping_epoch":24,"log_start":"267'200","ondisk_log_start":"267'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'212","last_scrub_stamp":"2024-09-14T13:02:19.672688+0000","last_deep_scrub":"267'212","last_deep_scrub_stamp":"2024-09-14T13:02:19.672688+0000","last_clean_scrub_stamp":"2024-09-14T13:02:19.672688+0000","objects_scrubbed":1,"log_size":12,"log_dups_size":200,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:47:14.467482+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1655822,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":567,"num_read_kb":28109,"num_write":991,"num_write_kb":35425,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,4],"acting":[7,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3c","version":"267'417","reported_seq":2197,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:20.325518+0000","last_change":"2024-09-14T13:02:20.325518+0000","last_active":"2024-09-14T13:02:20.325518+0000","last_peered":"2024-09-14T13:02:20.325518+0000","last_clean":"2024-09-14T13:02:20.325518+0000","last_became_active":"2024-09-14T11:08:23.804142+0000","last_became_peered":"2024-09-14T11:08:23.804142+0000","last_unstale":"2024-09-14T13:02:20.325518+0000","last_undegraded":"2024-09-14T13:02:20.325518+0000","last_fullsized":"2024-09-14T13:02:20.325518+0000","mapping_epoch":26,"log_start":"267'400","ondisk_log_start":"267'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'417","last_scrub_stamp":"2024-09-14T13:02:20.325334+0000","last_deep_scrub":"267'417","last_deep_scrub_stamp":"2024-09-14T13:02:20.325334+0000","last_clean_scrub_stamp":"2024-09-14T13:02:20.325334+0000","objects_scrubbed":4,"log_size":17,"log_dups_size":400,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:03:20.089650+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":2567,"num_read_kb":2469,"num_write":470,"num_write_kb":86,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2297,"num_omap_keys":9,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.3a","version":"267'155","reported_seq":787,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:19.522599+0000","last_change":"2024-09-14T13:02:19.522599+0000","last_active":"2024-09-14T13:02:19.522599+0000","last_peered":"2024-09-14T13:02:19.522599+0000","last_clean":"2024-09-14T13:02:19.522599+0000","last_became_active":"2024-09-14T11:08:21.791801+0000","last_became_peered":"2024-09-14T11:08:21.791801+0000","last_unstale":"2024-09-14T13:02:19.522599+0000","last_undegraded":"2024-09-14T13:02:19.522599+0000","last_fullsized":"2024-09-14T13:02:19.522599+0000","mapping_epoch":24,"log_start":"267'100","ondisk_log_start":"267'100","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'155","last_scrub_stamp":"2024-09-14T13:02:19.522401+0000","last_deep_scrub":"267'155","last_deep_scrub_stamp":"2024-09-14T13:02:19.522401+0000","last_clean_scrub_stamp":"2024-09-14T13:02:19.522401+0000","objects_scrubbed":1,"log_size":55,"log_dups_size":100,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:24:14.148910+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":30,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":413,"num_read_kb":24131,"num_write":680,"num_write_kb":32915,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,3],"acting":[5,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3d","version":"267'395","reported_seq":1943,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:26.706695+0000","last_change":"2024-09-14T13:02:26.706695+0000","last_active":"2024-09-14T13:02:26.706695+0000","last_peered":"2024-09-14T13:02:26.706695+0000","last_clean":"2024-09-14T13:02:26.706695+0000","last_became_active":"2024-09-14T11:08:23.786522+0000","last_became_peered":"2024-09-14T11:08:23.786522+0000","last_unstale":"2024-09-14T13:02:26.706695+0000","last_undegraded":"2024-09-14T13:02:26.706695+0000","last_fullsized":"2024-09-14T13:02:26.706695+0000","mapping_epoch":26,"log_start":"267'300","ondisk_log_start":"267'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'395","last_scrub_stamp":"2024-09-14T13:02:26.706510+0000","last_deep_scrub":"267'395","last_deep_scrub_stamp":"2024-09-14T13:02:26.706510+0000","last_clean_scrub_stamp":"2024-09-14T13:02:26.706510+0000","objects_scrubbed":2,"log_size":95,"log_dups_size":300,"ondisk_log_size":95,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:28:47.678010+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2147,"num_read_kb":2043,"num_write":454,"num_write_kb":90,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.39","version":"267'266","reported_seq":1039,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:16.621607+0000","last_change":"2024-09-14T13:02:16.621607+0000","last_active":"2024-09-14T13:02:16.621607+0000","last_peered":"2024-09-14T13:02:16.621607+0000","last_clean":"2024-09-14T13:02:16.621607+0000","last_became_active":"2024-09-14T11:08:21.837147+0000","last_became_peered":"2024-09-14T11:08:21.837147+0000","last_unstale":"2024-09-14T13:02:16.621607+0000","last_undegraded":"2024-09-14T13:02:16.621607+0000","last_fullsized":"2024-09-14T13:02:16.621607+0000","mapping_epoch":24,"log_start":"267'200","ondisk_log_start":"267'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'266","last_scrub_stamp":"2024-09-14T13:02:16.621341+0000","last_deep_scrub":"267'266","last_deep_scrub_stamp":"2024-09-14T13:02:16.621341+0000","last_clean_scrub_stamp":"2024-09-14T13:02:16.621341+0000","objects_scrubbed":3,"log_size":66,"log_dups_size":200,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:00:31.402959+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1655838,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1268,"num_read_kb":31286,"num_write":1154,"num_write_kb":25837,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0,4],"acting":[7,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3e","version":"267'511","reported_seq":2134,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:28.530721+0000","last_change":"2024-09-14T13:02:28.530721+0000","last_active":"2024-09-14T13:02:28.530721+0000","last_peered":"2024-09-14T13:02:28.530721+0000","last_clean":"2024-09-14T13:02:28.530721+0000","last_became_active":"2024-09-14T11:08:23.800621+0000","last_became_peered":"2024-09-14T11:08:23.800621+0000","last_unstale":"2024-09-14T13:02:28.530721+0000","last_undegraded":"2024-09-14T13:02:28.530721+0000","last_fullsized":"2024-09-14T13:02:28.530721+0000","mapping_epoch":26,"log_start":"267'500","ondisk_log_start":"267'500","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'511","last_scrub_stamp":"2024-09-14T13:02:28.530532+0000","last_deep_scrub":"267'511","last_deep_scrub_stamp":"2024-09-14T13:02:28.530532+0000","last_clean_scrub_stamp":"2024-09-14T13:02:28.530532+0000","objects_scrubbed":3,"log_size":11,"log_dups_size":500,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:19:28.861587+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2676,"num_read_kb":2481,"num_write":623,"num_write_kb":172,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":694,"num_omap_keys":3,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.38","version":"267'224","reported_seq":898,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:11.931881+0000","last_change":"2024-09-14T13:02:11.931881+0000","last_active":"2024-09-14T13:02:11.931881+0000","last_peered":"2024-09-14T13:02:11.931881+0000","last_clean":"2024-09-14T13:02:11.931881+0000","last_became_active":"2024-09-14T11:08:21.819029+0000","last_became_peered":"2024-09-14T11:08:21.819029+0000","last_unstale":"2024-09-14T13:02:11.931881+0000","last_undegraded":"2024-09-14T13:02:11.931881+0000","last_fullsized":"2024-09-14T13:02:11.931881+0000","mapping_epoch":24,"log_start":"267'200","ondisk_log_start":"267'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'224","last_scrub_stamp":"2024-09-14T13:02:11.931546+0000","last_deep_scrub":"267'224","last_deep_scrub_stamp":"2024-09-14T13:02:11.931546+0000","last_clean_scrub_stamp":"2024-09-14T13:02:11.931546+0000","objects_scrubbed":3,"log_size":24,"log_dups_size":200,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T00:04:21.176019+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":66,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":538,"num_read_kb":44678,"num_write":942,"num_write_kb":39932,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,6],"acting":[3,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3f","version":"267'919","reported_seq":2573,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:20.133057+0000","last_change":"2024-09-14T13:02:20.133057+0000","last_active":"2024-09-14T13:02:20.133057+0000","last_peered":"2024-09-14T13:02:20.133057+0000","last_clean":"2024-09-14T13:02:20.133057+0000","last_became_active":"2024-09-14T11:08:23.785941+0000","last_became_peered":"2024-09-14T11:08:23.785941+0000","last_unstale":"2024-09-14T13:02:20.133057+0000","last_undegraded":"2024-09-14T13:02:20.133057+0000","last_fullsized":"2024-09-14T13:02:20.133057+0000","mapping_epoch":26,"log_start":"267'900","ondisk_log_start":"267'900","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'919","last_scrub_stamp":"2024-09-14T13:02:20.132814+0000","last_deep_scrub":"267'919","last_deep_scrub_stamp":"2024-09-14T13:02:20.132814+0000","last_clean_scrub_stamp":"2024-09-14T13:02:20.132814+0000","objects_scrubbed":3,"log_size":19,"log_dups_size":900,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:16:06.728821+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":4272,"num_read_kb":3805,"num_write":1224,"num_write_kb":476,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"267'398","reported_seq":1978,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:22.702586+0000","last_change":"2024-09-14T13:02:22.702586+0000","last_active":"2024-09-14T13:02:22.702586+0000","last_peered":"2024-09-14T13:02:22.702586+0000","last_clean":"2024-09-14T13:02:22.702586+0000","last_became_active":"2024-09-14T11:08:23.785439+0000","last_became_peered":"2024-09-14T11:08:23.785439+0000","last_unstale":"2024-09-14T13:02:22.702586+0000","last_undegraded":"2024-09-14T13:02:22.702586+0000","last_fullsized":"2024-09-14T13:02:22.702586+0000","mapping_epoch":26,"log_start":"267'300","ondisk_log_start":"267'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'398","last_scrub_stamp":"2024-09-14T13:02:22.702370+0000","last_deep_scrub":"267'398","last_deep_scrub_stamp":"2024-09-14T13:02:22.702370+0000","last_clean_scrub_stamp":"2024-09-14T13:02:22.702370+0000","objects_scrubbed":1,"log_size":98,"log_dups_size":300,"ondisk_log_size":98,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:20:26.205553+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2124,"num_read_kb":2036,"num_write":427,"num_write_kb":63,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.37","version":"267'275","reported_seq":1016,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:13.622231+0000","last_change":"2024-09-14T13:02:13.622088+0000","last_active":"2024-09-14T13:02:13.622231+0000","last_peered":"2024-09-14T13:02:13.622231+0000","last_clean":"2024-09-14T13:02:13.622231+0000","last_became_active":"2024-09-14T11:08:21.805293+0000","last_became_peered":"2024-09-14T11:08:21.805293+0000","last_unstale":"2024-09-14T13:02:13.622231+0000","last_undegraded":"2024-09-14T13:02:13.622231+0000","last_fullsized":"2024-09-14T13:02:13.622231+0000","mapping_epoch":24,"log_start":"267'200","ondisk_log_start":"267'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'275","last_scrub_stamp":"2024-09-14T13:02:13.621839+0000","last_deep_scrub":"267'275","last_deep_scrub_stamp":"2024-09-14T13:02:13.621839+0000","last_clean_scrub_stamp":"2024-09-14T13:02:13.621839+0000","objects_scrubbed":5,"log_size":75,"log_dups_size":200,"ondisk_log_size":75,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:36:57.835433+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1655894,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":1085,"num_read_kb":13085,"num_write":1149,"num_write_kb":51014,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,0],"acting":[7,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.31","version":"267'703","reported_seq":2421,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:24.626382+0000","last_change":"2024-09-14T13:02:24.626382+0000","last_active":"2024-09-14T13:02:24.626382+0000","last_peered":"2024-09-14T13:02:24.626382+0000","last_clean":"2024-09-14T13:02:24.626382+0000","last_became_active":"2024-09-14T11:08:23.808090+0000","last_became_peered":"2024-09-14T11:08:23.808090+0000","last_unstale":"2024-09-14T13:02:24.626382+0000","last_undegraded":"2024-09-14T13:02:24.626382+0000","last_fullsized":"2024-09-14T13:02:24.626382+0000","mapping_epoch":26,"log_start":"267'600","ondisk_log_start":"267'600","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'703","last_scrub_stamp":"2024-09-14T13:02:24.626190+0000","last_deep_scrub":"267'703","last_deep_scrub_stamp":"2024-09-14T13:02:24.626190+0000","last_clean_scrub_stamp":"2024-09-14T13:02:24.626190+0000","objects_scrubbed":5,"log_size":103,"log_dups_size":600,"ondisk_log_size":103,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:48:57.287293+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":3652,"num_read_kb":3296,"num_write":1024,"num_write_kb":466,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"267'186","reported_seq":829,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:17.374091+0000","last_change":"2024-09-14T13:02:17.374091+0000","last_active":"2024-09-14T13:02:17.374091+0000","last_peered":"2024-09-14T13:02:17.374091+0000","last_clean":"2024-09-14T13:02:17.374091+0000","last_became_active":"2024-09-14T11:08:21.824907+0000","last_became_peered":"2024-09-14T11:08:21.824907+0000","last_unstale":"2024-09-14T13:02:17.374091+0000","last_undegraded":"2024-09-14T13:02:17.374091+0000","last_fullsized":"2024-09-14T13:02:17.374091+0000","mapping_epoch":24,"log_start":"267'100","ondisk_log_start":"267'100","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'186","last_scrub_stamp":"2024-09-14T13:02:17.373793+0000","last_deep_scrub":"267'186","last_deep_scrub_stamp":"2024-09-14T13:02:17.373793+0000","last_clean_scrub_stamp":"2024-09-14T13:02:17.373793+0000","objects_scrubbed":6,"log_size":86,"log_dups_size":100,"ondisk_log_size":86,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:39:09.691991+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":511,"num_read_kb":17563,"num_write":879,"num_write_kb":17084,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,4],"acting":[6,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.32","version":"267'542","reported_seq":2182,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:23.391820+0000","last_change":"2024-09-14T13:02:23.391820+0000","last_active":"2024-09-14T13:02:23.391820+0000","last_peered":"2024-09-14T13:02:23.391820+0000","last_clean":"2024-09-14T13:02:23.391820+0000","last_became_active":"2024-09-14T11:08:23.801090+0000","last_became_peered":"2024-09-14T11:08:23.801090+0000","last_unstale":"2024-09-14T13:02:23.391820+0000","last_undegraded":"2024-09-14T13:02:23.391820+0000","last_fullsized":"2024-09-14T13:02:23.391820+0000","mapping_epoch":26,"log_start":"267'500","ondisk_log_start":"267'500","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'542","last_scrub_stamp":"2024-09-14T13:02:23.391622+0000","last_deep_scrub":"267'542","last_deep_scrub_stamp":"2024-09-14T13:02:23.391622+0000","last_clean_scrub_stamp":"2024-09-14T13:02:23.391622+0000","objects_scrubbed":2,"log_size":42,"log_dups_size":500,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:37:14.569886+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2832,"num_read_kb":2611,"num_write":684,"num_write_kb":208,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":701,"num_omap_keys":3,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.35","version":"267'227","reported_seq":905,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:15.349124+0000","last_change":"2024-09-14T13:02:15.349124+0000","last_active":"2024-09-14T13:02:15.349124+0000","last_peered":"2024-09-14T13:02:15.349124+0000","last_clean":"2024-09-14T13:02:15.349124+0000","last_became_active":"2024-09-14T11:08:21.817113+0000","last_became_peered":"2024-09-14T11:08:21.817113+0000","last_unstale":"2024-09-14T13:02:15.349124+0000","last_undegraded":"2024-09-14T13:02:15.349124+0000","last_fullsized":"2024-09-14T13:02:15.349124+0000","mapping_epoch":24,"log_start":"267'200","ondisk_log_start":"267'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'227","last_scrub_stamp":"2024-09-14T13:02:15.348883+0000","last_deep_scrub":"267'227","last_deep_scrub_stamp":"2024-09-14T13:02:15.348883+0000","last_clean_scrub_stamp":"2024-09-14T13:02:15.348883+0000","objects_scrubbed":5,"log_size":27,"log_dups_size":200,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:20:13.352709+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1655893,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":573,"num_read_kb":71773,"num_write":1062,"num_write_kb":34768,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,0],"acting":[6,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.33","version":"267'481","reported_seq":2211,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:23.127477+0000","last_change":"2024-09-14T13:02:23.127477+0000","last_active":"2024-09-14T13:02:23.127477+0000","last_peered":"2024-09-14T13:02:23.127477+0000","last_clean":"2024-09-14T13:02:23.127477+0000","last_became_active":"2024-09-14T11:08:23.782135+0000","last_became_peered":"2024-09-14T11:08:23.782135+0000","last_unstale":"2024-09-14T13:02:23.127477+0000","last_undegraded":"2024-09-14T13:02:23.127477+0000","last_fullsized":"2024-09-14T13:02:23.127477+0000","mapping_epoch":26,"log_start":"267'400","ondisk_log_start":"267'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'481","last_scrub_stamp":"2024-09-14T13:02:23.127294+0000","last_deep_scrub":"267'481","last_deep_scrub_stamp":"2024-09-14T13:02:23.127294+0000","last_clean_scrub_stamp":"2024-09-14T13:02:23.127294+0000","objects_scrubbed":1,"log_size":81,"log_dups_size":400,"ondisk_log_size":81,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:48:12.161901+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2660,"num_read_kb":2528,"num_write":519,"num_write_kb":93,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.34","version":"267'250","reported_seq":912,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:10.813724+0000","last_change":"2024-09-14T13:02:10.813724+0000","last_active":"2024-09-14T13:02:10.813724+0000","last_peered":"2024-09-14T13:02:10.813724+0000","last_clean":"2024-09-14T13:02:10.813724+0000","last_became_active":"2024-09-14T11:08:21.835636+0000","last_became_peered":"2024-09-14T11:08:21.835636+0000","last_unstale":"2024-09-14T13:02:10.813724+0000","last_undegraded":"2024-09-14T13:02:10.813724+0000","last_fullsized":"2024-09-14T13:02:10.813724+0000","mapping_epoch":24,"log_start":"267'200","ondisk_log_start":"267'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'250","last_scrub_stamp":"2024-09-14T13:02:10.813489+0000","last_deep_scrub":"267'250","last_deep_scrub_stamp":"2024-09-14T13:02:10.813489+0000","last_clean_scrub_stamp":"2024-09-14T13:02:10.813489+0000","objects_scrubbed":2,"log_size":50,"log_dups_size":200,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T00:40:56.666305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1655836,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":575,"num_read_kb":3577,"num_write":1185,"num_write_kb":25395,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6],"acting":[4,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.34","version":"267'554","reported_seq":2220,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:18.141972+0000","last_change":"2024-09-14T13:02:18.141972+0000","last_active":"2024-09-14T13:02:18.141972+0000","last_peered":"2024-09-14T13:02:18.141972+0000","last_clean":"2024-09-14T13:02:18.141972+0000","last_became_active":"2024-09-14T11:08:23.784078+0000","last_became_peered":"2024-09-14T11:08:23.784078+0000","last_unstale":"2024-09-14T13:02:18.141972+0000","last_undegraded":"2024-09-14T13:02:18.141972+0000","last_fullsized":"2024-09-14T13:02:18.141972+0000","mapping_epoch":26,"log_start":"267'500","ondisk_log_start":"267'500","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'554","last_scrub_stamp":"2024-09-14T13:02:18.141748+0000","last_deep_scrub":"267'554","last_deep_scrub_stamp":"2024-09-14T13:02:18.141748+0000","last_clean_scrub_stamp":"2024-09-14T13:02:18.141748+0000","objects_scrubbed":1,"log_size":54,"log_dups_size":500,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:33:55.821825+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3071,"num_read_kb":2852,"num_write":734,"num_write_kb":256,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.33","version":"267'240","reported_seq":882,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:12.917024+0000","last_change":"2024-09-14T13:02:12.917024+0000","last_active":"2024-09-14T13:02:12.917024+0000","last_peered":"2024-09-14T13:02:12.917024+0000","last_clean":"2024-09-14T13:02:12.917024+0000","last_became_active":"2024-09-14T11:08:21.809526+0000","last_became_peered":"2024-09-14T11:08:21.809526+0000","last_unstale":"2024-09-14T13:02:12.917024+0000","last_undegraded":"2024-09-14T13:02:12.917024+0000","last_fullsized":"2024-09-14T13:02:12.917024+0000","mapping_epoch":24,"log_start":"267'200","ondisk_log_start":"267'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'240","last_scrub_stamp":"2024-09-14T13:02:12.916789+0000","last_deep_scrub":"267'240","last_deep_scrub_stamp":"2024-09-14T13:02:12.916789+0000","last_clean_scrub_stamp":"2024-09-14T13:02:12.916789+0000","objects_scrubbed":2,"log_size":40,"log_dups_size":200,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:08:03.665418+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":500,"num_read_kb":25008,"num_write":1059,"num_write_kb":23085,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6,1],"acting":[3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.35","version":"267'801","reported_seq":2465,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:23.742731+0000","last_change":"2024-09-14T13:02:23.742731+0000","last_active":"2024-09-14T13:02:23.742731+0000","last_peered":"2024-09-14T13:02:23.742731+0000","last_clean":"2024-09-14T13:02:23.742731+0000","last_became_active":"2024-09-14T11:08:23.785540+0000","last_became_peered":"2024-09-14T11:08:23.785540+0000","last_unstale":"2024-09-14T13:02:23.742731+0000","last_undegraded":"2024-09-14T13:02:23.742731+0000","last_fullsized":"2024-09-14T13:02:23.742731+0000","mapping_epoch":26,"log_start":"267'700","ondisk_log_start":"267'700","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'801","last_scrub_stamp":"2024-09-14T13:02:23.742547+0000","last_deep_scrub":"267'801","last_deep_scrub_stamp":"2024-09-14T13:02:23.742547+0000","last_clean_scrub_stamp":"2024-09-14T13:02:23.742547+0000","objects_scrubbed":1,"log_size":101,"log_dups_size":700,"ondisk_log_size":101,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:21:48.998615+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3845,"num_read_kb":3496,"num_write":1039,"num_write_kb":364,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.32","version":"267'223","reported_seq":1020,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:11.123809+0000","last_change":"2024-09-14T13:02:11.123809+0000","last_active":"2024-09-14T13:02:11.123809+0000","last_peered":"2024-09-14T13:02:11.123809+0000","last_clean":"2024-09-14T13:02:11.123809+0000","last_became_active":"2024-09-14T11:08:21.780800+0000","last_became_peered":"2024-09-14T11:08:21.780800+0000","last_unstale":"2024-09-14T13:02:11.123809+0000","last_undegraded":"2024-09-14T13:02:11.123809+0000","last_fullsized":"2024-09-14T13:02:11.123809+0000","mapping_epoch":24,"log_start":"267'200","ondisk_log_start":"267'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'223","last_scrub_stamp":"2024-09-14T13:02:11.123576+0000","last_deep_scrub":"267'223","last_deep_scrub_stamp":"2024-09-14T13:02:11.123576+0000","last_clean_scrub_stamp":"2024-09-14T13:02:11.123576+0000","objects_scrubbed":3,"log_size":23,"log_dups_size":200,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:03:24.176635+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1655860,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1400,"num_read_kb":21343,"num_write":1086,"num_write_kb":34809,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,1],"acting":[0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.18","version":"267'196","reported_seq":748,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:40.652956+0000","last_change":"2024-09-14T13:02:40.652956+0000","last_active":"2024-09-14T13:02:40.652956+0000","last_peered":"2024-09-14T13:02:40.652956+0000","last_clean":"2024-09-14T13:02:40.652956+0000","last_became_active":"2024-09-14T11:08:31.850605+0000","last_became_peered":"2024-09-14T11:08:31.850605+0000","last_unstale":"2024-09-14T13:02:40.652956+0000","last_undegraded":"2024-09-14T13:02:40.652956+0000","last_fullsized":"2024-09-14T13:02:40.652956+0000","mapping_epoch":34,"log_start":"267'100","ondisk_log_start":"267'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'196","last_scrub_stamp":"2024-09-14T13:02:40.652681+0000","last_deep_scrub":"267'196","last_deep_scrub_stamp":"2024-09-14T13:02:40.652681+0000","last_clean_scrub_stamp":"2024-09-14T13:02:40.652681+0000","objects_scrubbed":1,"log_size":96,"log_dups_size":100,"ondisk_log_size":96,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:51:54.305411+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":204,"num_read_kb":191,"num_write":376,"num_write_kb":86,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.14","version":"267'869","reported_seq":2400,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:17.883495+0000","last_change":"2024-09-14T13:02:17.883495+0000","last_active":"2024-09-14T13:02:17.883495+0000","last_peered":"2024-09-14T13:02:17.883495+0000","last_clean":"2024-09-14T13:02:17.883495+0000","last_became_active":"2024-09-14T11:08:23.779822+0000","last_became_peered":"2024-09-14T11:08:23.779822+0000","last_unstale":"2024-09-14T13:02:17.883495+0000","last_undegraded":"2024-09-14T13:02:17.883495+0000","last_fullsized":"2024-09-14T13:02:17.883495+0000","mapping_epoch":26,"log_start":"267'800","ondisk_log_start":"267'800","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'869","last_scrub_stamp":"2024-09-14T13:02:17.883315+0000","last_deep_scrub":"267'869","last_deep_scrub_stamp":"2024-09-14T13:02:17.883315+0000","last_clean_scrub_stamp":"2024-09-14T13:02:17.883315+0000","objects_scrubbed":4,"log_size":69,"log_dups_size":800,"ondisk_log_size":69,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:49:19.140159+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":4044,"num_read_kb":3595,"num_write":1182,"num_write_kb":452,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"267'245","reported_seq":1022,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:17.612499+0000","last_change":"2024-09-14T13:02:17.612170+0000","last_active":"2024-09-14T13:02:17.612499+0000","last_peered":"2024-09-14T13:02:17.612499+0000","last_clean":"2024-09-14T13:02:17.612499+0000","last_became_active":"2024-09-14T11:08:21.843212+0000","last_became_peered":"2024-09-14T11:08:21.843212+0000","last_unstale":"2024-09-14T13:02:17.612499+0000","last_undegraded":"2024-09-14T13:02:17.612499+0000","last_fullsized":"2024-09-14T13:02:17.612499+0000","mapping_epoch":24,"log_start":"267'200","ondisk_log_start":"267'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'245","last_scrub_stamp":"2024-09-14T13:02:17.611975+0000","last_deep_scrub":"267'245","last_deep_scrub_stamp":"2024-09-14T13:02:17.611975+0000","last_clean_scrub_stamp":"2024-09-14T13:02:17.611975+0000","objects_scrubbed":2,"log_size":45,"log_dups_size":200,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:38:36.738720+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":15,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1021,"num_read_kb":177071,"num_write":1108,"num_write_kb":33961,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,4],"acting":[7,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":534,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:30.482417+0000","last_change":"2024-09-14T13:02:30.482417+0000","last_active":"2024-09-14T13:02:30.482417+0000","last_peered":"2024-09-14T13:02:30.482417+0000","last_clean":"2024-09-14T13:02:30.482417+0000","last_became_active":"2024-09-14T11:08:25.803311+0000","last_became_peered":"2024-09-14T11:08:25.803311+0000","last_unstale":"2024-09-14T13:02:30.482417+0000","last_undegraded":"2024-09-14T13:02:30.482417+0000","last_fullsized":"2024-09-14T13:02:30.482417+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T13:02:30.482226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T13:02:30.482226+0000","last_clean_scrub_stamp":"2024-09-14T13:02:30.482226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:45:03.017589+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.16","version":"267'231","reported_seq":897,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:29.031735+0000","last_change":"2024-09-14T13:02:29.031735+0000","last_active":"2024-09-14T13:02:29.031735+0000","last_peered":"2024-09-14T13:02:29.031735+0000","last_clean":"2024-09-14T13:02:29.031735+0000","last_became_active":"2024-09-14T11:08:27.808834+0000","last_became_peered":"2024-09-14T11:08:27.808834+0000","last_unstale":"2024-09-14T13:02:29.031735+0000","last_undegraded":"2024-09-14T13:02:29.031735+0000","last_fullsized":"2024-09-14T13:02:29.031735+0000","mapping_epoch":30,"log_start":"267'200","ondisk_log_start":"267'200","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'231","last_scrub_stamp":"2024-09-14T13:02:29.031545+0000","last_deep_scrub":"267'231","last_deep_scrub_stamp":"2024-09-14T13:02:29.031545+0000","last_clean_scrub_stamp":"2024-09-14T13:02:29.031545+0000","objects_scrubbed":4,"log_size":31,"log_dups_size":200,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:57:52.720132+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4096,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":308,"num_read_kb":323,"num_write":180,"num_write_kb":16,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":527,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:38.519700+0000","last_change":"2024-09-14T13:02:38.519700+0000","last_active":"2024-09-14T13:02:38.519700+0000","last_peered":"2024-09-14T13:02:38.519700+0000","last_clean":"2024-09-14T13:02:38.519700+0000","last_became_active":"2024-09-14T11:08:29.833332+0000","last_became_peered":"2024-09-14T11:08:29.833332+0000","last_unstale":"2024-09-14T13:02:38.519700+0000","last_undegraded":"2024-09-14T13:02:38.519700+0000","last_fullsized":"2024-09-14T13:02:38.519700+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T13:02:38.519446+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T13:02:38.519446+0000","last_clean_scrub_stamp":"2024-09-14T13:02:38.519446+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:00:10.435989+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.19","version":"267'122","reported_seq":640,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:00:13.064033+0000","last_change":"2024-09-14T11:08:31.844405+0000","last_active":"2024-09-14T13:00:13.064033+0000","last_peered":"2024-09-14T13:00:13.064033+0000","last_clean":"2024-09-14T13:00:13.064033+0000","last_became_active":"2024-09-14T11:08:31.843645+0000","last_became_peered":"2024-09-14T11:08:31.843645+0000","last_unstale":"2024-09-14T13:00:13.064033+0000","last_undegraded":"2024-09-14T13:00:13.064033+0000","last_fullsized":"2024-09-14T13:00:13.064033+0000","mapping_epoch":34,"log_start":"267'100","ondisk_log_start":"267'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:08:30.789404+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:08:30.789404+0000","last_clean_scrub_stamp":"2024-09-14T11:08:30.789404+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":100,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":100,"num_read_kb":97,"num_write":289,"num_write_kb":65,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.15","version":"267'1237","reported_seq":3023,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:22.427041+0000","last_change":"2024-09-14T13:02:22.427041+0000","last_active":"2024-09-14T13:02:22.427041+0000","last_peered":"2024-09-14T13:02:22.427041+0000","last_clean":"2024-09-14T13:02:22.427041+0000","last_became_active":"2024-09-14T11:08:23.808015+0000","last_became_peered":"2024-09-14T11:08:23.808015+0000","last_unstale":"2024-09-14T13:02:22.427041+0000","last_undegraded":"2024-09-14T13:02:22.427041+0000","last_fullsized":"2024-09-14T13:02:22.427041+0000","mapping_epoch":26,"log_start":"267'1200","ondisk_log_start":"267'1200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'1237","last_scrub_stamp":"2024-09-14T13:02:22.426850+0000","last_deep_scrub":"267'1237","last_deep_scrub_stamp":"2024-09-14T13:02:22.426850+0000","last_clean_scrub_stamp":"2024-09-14T13:02:22.426850+0000","objects_scrubbed":3,"log_size":37,"log_dups_size":1200,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:18:30.537089+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":5778,"num_read_kb":5143,"num_write":1691,"num_write_kb":698,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2040,"num_omap_keys":8,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.12","version":"267'232","reported_seq":958,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:04.982048+0000","last_change":"2024-09-14T13:02:04.981981+0000","last_active":"2024-09-14T13:02:04.982048+0000","last_peered":"2024-09-14T13:02:04.982048+0000","last_clean":"2024-09-14T13:02:04.982048+0000","last_became_active":"2024-09-14T11:08:21.787257+0000","last_became_peered":"2024-09-14T11:08:21.787257+0000","last_unstale":"2024-09-14T13:02:04.982048+0000","last_undegraded":"2024-09-14T13:02:04.982048+0000","last_fullsized":"2024-09-14T13:02:04.982048+0000","mapping_epoch":24,"log_start":"267'200","ondisk_log_start":"267'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'232","last_scrub_stamp":"2024-09-14T13:02:04.981884+0000","last_deep_scrub":"267'232","last_deep_scrub_stamp":"2024-09-14T13:02:04.981884+0000","last_clean_scrub_stamp":"2024-09-14T13:02:04.981884+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":200,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:03:51.775808+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":660,"num_read_kb":98910,"num_write":982,"num_write_kb":32453,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3],"acting":[0,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":535,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:22.944095+0000","last_change":"2024-09-14T13:02:22.944095+0000","last_active":"2024-09-14T13:02:22.944095+0000","last_peered":"2024-09-14T13:02:22.944095+0000","last_clean":"2024-09-14T13:02:22.944095+0000","last_became_active":"2024-09-14T11:08:25.804100+0000","last_became_peered":"2024-09-14T11:08:25.804100+0000","last_unstale":"2024-09-14T13:02:22.944095+0000","last_undegraded":"2024-09-14T13:02:22.944095+0000","last_fullsized":"2024-09-14T13:02:22.944095+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T13:02:22.943903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T13:02:22.943903+0000","last_clean_scrub_stamp":"2024-09-14T13:02:22.943903+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:47:59.177750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.17","version":"267'132","reported_seq":716,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:33.738666+0000","last_change":"2024-09-14T13:02:33.738666+0000","last_active":"2024-09-14T13:02:33.738666+0000","last_peered":"2024-09-14T13:02:33.738666+0000","last_clean":"2024-09-14T13:02:33.738666+0000","last_became_active":"2024-09-14T11:08:27.831010+0000","last_became_peered":"2024-09-14T11:08:27.831010+0000","last_unstale":"2024-09-14T13:02:33.738666+0000","last_undegraded":"2024-09-14T13:02:33.738666+0000","last_fullsized":"2024-09-14T13:02:33.738666+0000","mapping_epoch":30,"log_start":"267'100","ondisk_log_start":"267'100","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'132","last_scrub_stamp":"2024-09-14T13:02:33.738485+0000","last_deep_scrub":"267'132","last_deep_scrub_stamp":"2024-09-14T13:02:33.738485+0000","last_clean_scrub_stamp":"2024-09-14T13:02:33.738485+0000","objects_scrubbed":3,"log_size":32,"log_dups_size":100,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:36:05.488919+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":152,"num_read_kb":149,"num_write":100,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":528,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:39.633756+0000","last_change":"2024-09-14T13:02:39.633756+0000","last_active":"2024-09-14T13:02:39.633756+0000","last_peered":"2024-09-14T13:02:39.633756+0000","last_clean":"2024-09-14T13:02:39.633756+0000","last_became_active":"2024-09-14T11:08:29.809568+0000","last_became_peered":"2024-09-14T11:08:29.809568+0000","last_unstale":"2024-09-14T13:02:39.633756+0000","last_undegraded":"2024-09-14T13:02:39.633756+0000","last_fullsized":"2024-09-14T13:02:39.633756+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T13:02:39.633574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T13:02:39.633574+0000","last_clean_scrub_stamp":"2024-09-14T13:02:39.633574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:43:20.197341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.1a","version":"267'141","reported_seq":734,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:39.203271+0000","last_change":"2024-09-14T13:02:39.203271+0000","last_active":"2024-09-14T13:02:39.203271+0000","last_peered":"2024-09-14T13:02:39.203271+0000","last_clean":"2024-09-14T13:02:39.203271+0000","last_became_active":"2024-09-14T11:08:31.845634+0000","last_became_peered":"2024-09-14T11:08:31.845634+0000","last_unstale":"2024-09-14T13:02:39.203271+0000","last_undegraded":"2024-09-14T13:02:39.203271+0000","last_fullsized":"2024-09-14T13:02:39.203271+0000","mapping_epoch":34,"log_start":"267'100","ondisk_log_start":"267'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'141","last_scrub_stamp":"2024-09-14T13:02:39.203097+0000","last_deep_scrub":"267'141","last_deep_scrub_stamp":"2024-09-14T13:02:39.203097+0000","last_clean_scrub_stamp":"2024-09-14T13:02:39.203097+0000","objects_scrubbed":4,"log_size":41,"log_dups_size":100,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:04:51.158766+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":271,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":347,"num_read_kb":294,"num_write":357,"num_write_kb":85,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"267'412","reported_seq":1938,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:20.980337+0000","last_change":"2024-09-14T13:02:20.980337+0000","last_active":"2024-09-14T13:02:20.980337+0000","last_peered":"2024-09-14T13:02:20.980337+0000","last_clean":"2024-09-14T13:02:20.980337+0000","last_became_active":"2024-09-14T11:08:23.780326+0000","last_became_peered":"2024-09-14T11:08:23.780326+0000","last_unstale":"2024-09-14T13:02:20.980337+0000","last_undegraded":"2024-09-14T13:02:20.980337+0000","last_fullsized":"2024-09-14T13:02:20.980337+0000","mapping_epoch":26,"log_start":"267'400","ondisk_log_start":"267'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'412","last_scrub_stamp":"2024-09-14T13:02:20.980143+0000","last_deep_scrub":"267'412","last_deep_scrub_stamp":"2024-09-14T13:02:20.980143+0000","last_clean_scrub_stamp":"2024-09-14T13:02:20.980143+0000","objects_scrubbed":3,"log_size":12,"log_dups_size":400,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:17:39.736976+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2172,"num_read_kb":2053,"num_write":475,"num_write_kb":100,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.11","version":"267'229","reported_seq":863,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:07.062536+0000","last_change":"2024-09-14T13:02:07.062536+0000","last_active":"2024-09-14T13:02:07.062536+0000","last_peered":"2024-09-14T13:02:07.062536+0000","last_clean":"2024-09-14T13:02:07.062536+0000","last_became_active":"2024-09-14T11:08:56.038815+0000","last_became_peered":"2024-09-14T11:08:56.038815+0000","last_unstale":"2024-09-14T13:02:07.062536+0000","last_undegraded":"2024-09-14T13:02:07.062536+0000","last_fullsized":"2024-09-14T13:02:07.062536+0000","mapping_epoch":37,"log_start":"267'200","ondisk_log_start":"267'200","created":24,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'229","last_scrub_stamp":"2024-09-14T13:02:07.062441+0000","last_deep_scrub":"267'229","last_deep_scrub_stamp":"2024-09-14T13:02:07.062441+0000","last_clean_scrub_stamp":"2024-09-14T13:02:07.062441+0000","objects_scrubbed":2,"log_size":29,"log_dups_size":200,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:34:17.014914+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":52,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":508,"num_read_kb":22051,"num_write":996,"num_write_kb":45213,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4,6],"acting":[2,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":534,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:24.965066+0000","last_change":"2024-09-14T13:02:24.965066+0000","last_active":"2024-09-14T13:02:24.965066+0000","last_peered":"2024-09-14T13:02:24.965066+0000","last_clean":"2024-09-14T13:02:24.965066+0000","last_became_active":"2024-09-14T11:08:25.798008+0000","last_became_peered":"2024-09-14T11:08:25.798008+0000","last_unstale":"2024-09-14T13:02:24.965066+0000","last_undegraded":"2024-09-14T13:02:24.965066+0000","last_fullsized":"2024-09-14T13:02:24.965066+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T13:02:24.964760+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T13:02:24.964760+0000","last_clean_scrub_stamp":"2024-09-14T13:02:24.964760+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:03:42.094133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.14","version":"267'186","reported_seq":797,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:27.090012+0000","last_change":"2024-09-14T13:02:27.090012+0000","last_active":"2024-09-14T13:02:27.090012+0000","last_peered":"2024-09-14T13:02:27.090012+0000","last_clean":"2024-09-14T13:02:27.090012+0000","last_became_active":"2024-09-14T11:08:27.820627+0000","last_became_peered":"2024-09-14T11:08:27.820627+0000","last_unstale":"2024-09-14T13:02:27.090012+0000","last_undegraded":"2024-09-14T13:02:27.090012+0000","last_fullsized":"2024-09-14T13:02:27.090012+0000","mapping_epoch":30,"log_start":"267'100","ondisk_log_start":"267'100","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'186","last_scrub_stamp":"2024-09-14T13:02:27.089825+0000","last_deep_scrub":"267'186","last_deep_scrub_stamp":"2024-09-14T13:02:27.089825+0000","last_clean_scrub_stamp":"2024-09-14T13:02:27.089825+0000","objects_scrubbed":6,"log_size":86,"log_dups_size":100,"ondisk_log_size":86,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:35:32.897007+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":232,"num_read_kb":224,"num_write":158,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.15","version":"267'776","reported_seq":3181,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:37.570152+0000","last_change":"2024-09-14T13:02:37.570152+0000","last_active":"2024-09-14T13:02:37.570152+0000","last_peered":"2024-09-14T13:02:37.570152+0000","last_clean":"2024-09-14T13:02:37.570152+0000","last_became_active":"2024-09-14T11:08:29.838193+0000","last_became_peered":"2024-09-14T11:08:29.838193+0000","last_unstale":"2024-09-14T13:02:37.570152+0000","last_undegraded":"2024-09-14T13:02:37.570152+0000","last_fullsized":"2024-09-14T13:02:37.570152+0000","mapping_epoch":32,"log_start":"267'701","ondisk_log_start":"267'701","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'776","last_scrub_stamp":"2024-09-14T13:02:37.569957+0000","last_deep_scrub":"267'776","last_deep_scrub_stamp":"2024-09-14T13:02:37.569957+0000","last_clean_scrub_stamp":"2024-09-14T13:02:37.569957+0000","objects_scrubbed":1,"log_size":75,"log_dups_size":701,"ondisk_log_size":75,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:42:49.427217+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1b","version":"267'215","reported_seq":1081,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:41.690416+0000","last_change":"2024-09-14T13:02:41.690416+0000","last_active":"2024-09-14T13:02:41.690416+0000","last_peered":"2024-09-14T13:02:41.690416+0000","last_clean":"2024-09-14T13:02:41.690416+0000","last_became_active":"2024-09-14T11:08:31.843385+0000","last_became_peered":"2024-09-14T11:08:31.843385+0000","last_unstale":"2024-09-14T13:02:41.690416+0000","last_undegraded":"2024-09-14T13:02:41.690416+0000","last_fullsized":"2024-09-14T13:02:41.690416+0000","mapping_epoch":34,"log_start":"267'201","ondisk_log_start":"267'201","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'215","last_scrub_stamp":"2024-09-14T13:02:41.690225+0000","last_deep_scrub":"267'215","last_deep_scrub_stamp":"2024-09-14T13:02:41.690225+0000","last_clean_scrub_stamp":"2024-09-14T13:02:41.690225+0000","objects_scrubbed":5,"log_size":14,"log_dups_size":201,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T00:08:49.260985+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":642,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":623,"num_read_kb":612,"num_write":468,"num_write_kb":119,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":234,"num_omap_keys":2,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.17","version":"267'422","reported_seq":1919,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:13.138664+0000","last_change":"2024-09-14T13:02:13.138664+0000","last_active":"2024-09-14T13:02:13.138664+0000","last_peered":"2024-09-14T13:02:13.138664+0000","last_clean":"2024-09-14T13:02:13.138664+0000","last_became_active":"2024-09-14T11:09:57.239636+0000","last_became_peered":"2024-09-14T11:09:57.239636+0000","last_unstale":"2024-09-14T13:02:13.138664+0000","last_undegraded":"2024-09-14T13:02:13.138664+0000","last_fullsized":"2024-09-14T13:02:13.138664+0000","mapping_epoch":39,"log_start":"267'400","ondisk_log_start":"267'400","created":26,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'422","last_scrub_stamp":"2024-09-14T13:02:13.138458+0000","last_deep_scrub":"267'422","last_deep_scrub_stamp":"2024-09-14T13:02:13.138458+0000","last_clean_scrub_stamp":"2024-09-14T13:02:13.138458+0000","objects_scrubbed":2,"log_size":22,"log_dups_size":400,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:56:36.716655+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2202,"num_read_kb":2076,"num_write":491,"num_write_kb":104,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.10","version":"267'249","reported_seq":926,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:09.253625+0000","last_change":"2024-09-14T13:02:09.253431+0000","last_active":"2024-09-14T13:02:09.253625+0000","last_peered":"2024-09-14T13:02:09.253625+0000","last_clean":"2024-09-14T13:02:09.253625+0000","last_became_active":"2024-09-14T11:08:21.817332+0000","last_became_peered":"2024-09-14T11:08:21.817332+0000","last_unstale":"2024-09-14T13:02:09.253625+0000","last_undegraded":"2024-09-14T13:02:09.253625+0000","last_fullsized":"2024-09-14T13:02:09.253625+0000","mapping_epoch":24,"log_start":"267'200","ondisk_log_start":"267'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'249","last_scrub_stamp":"2024-09-14T13:02:09.253234+0000","last_deep_scrub":"267'249","last_deep_scrub_stamp":"2024-09-14T13:02:09.253234+0000","last_clean_scrub_stamp":"2024-09-14T13:02:09.253234+0000","objects_scrubbed":1,"log_size":49,"log_dups_size":200,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:02:19.341971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":650,"num_read_kb":50041,"num_write":1009,"num_write_kb":23458,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,5],"acting":[6,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":534,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:31.440125+0000","last_change":"2024-09-14T13:02:31.440125+0000","last_active":"2024-09-14T13:02:31.440125+0000","last_peered":"2024-09-14T13:02:31.440125+0000","last_clean":"2024-09-14T13:02:31.440125+0000","last_became_active":"2024-09-14T11:08:25.814645+0000","last_became_peered":"2024-09-14T11:08:25.814645+0000","last_unstale":"2024-09-14T13:02:31.440125+0000","last_undegraded":"2024-09-14T13:02:31.440125+0000","last_fullsized":"2024-09-14T13:02:31.440125+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T13:02:31.439919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T13:02:31.439919+0000","last_clean_scrub_stamp":"2024-09-14T13:02:31.439919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:25:41.343773+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.15","version":"267'184","reported_seq":812,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:33.597620+0000","last_change":"2024-09-14T13:02:33.597620+0000","last_active":"2024-09-14T13:02:33.597620+0000","last_peered":"2024-09-14T13:02:33.597620+0000","last_clean":"2024-09-14T13:02:33.597620+0000","last_became_active":"2024-09-14T11:08:27.827940+0000","last_became_peered":"2024-09-14T11:08:27.827940+0000","last_unstale":"2024-09-14T13:02:33.597620+0000","last_undegraded":"2024-09-14T13:02:33.597620+0000","last_fullsized":"2024-09-14T13:02:33.597620+0000","mapping_epoch":30,"log_start":"267'100","ondisk_log_start":"267'100","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'184","last_scrub_stamp":"2024-09-14T13:02:33.597409+0000","last_deep_scrub":"267'184","last_deep_scrub_stamp":"2024-09-14T13:02:33.597409+0000","last_clean_scrub_stamp":"2024-09-14T13:02:33.597409+0000","objects_scrubbed":5,"log_size":84,"log_dups_size":100,"ondisk_log_size":84,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:01:16.588660+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6699,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":229,"num_read_kb":300,"num_write":130,"num_write_kb":20,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.14","version":"267'816","reported_seq":2995,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:35.955913+0000","last_change":"2024-09-14T13:02:35.955913+0000","last_active":"2024-09-14T13:02:35.955913+0000","last_peered":"2024-09-14T13:02:35.955913+0000","last_clean":"2024-09-14T13:02:35.955913+0000","last_became_active":"2024-09-14T11:08:29.831198+0000","last_became_peered":"2024-09-14T11:08:29.831198+0000","last_unstale":"2024-09-14T13:02:35.955913+0000","last_undegraded":"2024-09-14T13:02:35.955913+0000","last_fullsized":"2024-09-14T13:02:35.955913+0000","mapping_epoch":32,"log_start":"267'800","ondisk_log_start":"267'800","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'816","last_scrub_stamp":"2024-09-14T13:02:35.955719+0000","last_deep_scrub":"267'816","last_deep_scrub_stamp":"2024-09-14T13:02:35.955719+0000","last_clean_scrub_stamp":"2024-09-14T13:02:35.955719+0000","objects_scrubbed":1,"log_size":16,"log_dups_size":800,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:45:59.679413+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.8","version":"267'443","reported_seq":1996,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:21.471906+0000","last_change":"2024-09-14T13:02:21.471906+0000","last_active":"2024-09-14T13:02:21.471906+0000","last_peered":"2024-09-14T13:02:21.471906+0000","last_clean":"2024-09-14T13:02:21.471906+0000","last_became_active":"2024-09-14T11:08:23.811325+0000","last_became_peered":"2024-09-14T11:08:23.811325+0000","last_unstale":"2024-09-14T13:02:21.471906+0000","last_undegraded":"2024-09-14T13:02:21.471906+0000","last_fullsized":"2024-09-14T13:02:21.471906+0000","mapping_epoch":26,"log_start":"267'400","ondisk_log_start":"267'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'443","last_scrub_stamp":"2024-09-14T13:02:21.471733+0000","last_deep_scrub":"267'443","last_deep_scrub_stamp":"2024-09-14T13:02:21.471733+0000","last_clean_scrub_stamp":"2024-09-14T13:02:21.471733+0000","objects_scrubbed":3,"log_size":43,"log_dups_size":400,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T00:28:13.667148+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2277,"num_read_kb":2143,"num_write":513,"num_write_kb":125,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":217,"num_omap_keys":1,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.f","version":"267'247","reported_seq":939,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:09.651897+0000","last_change":"2024-09-14T13:02:09.651897+0000","last_active":"2024-09-14T13:02:09.651897+0000","last_peered":"2024-09-14T13:02:09.651897+0000","last_clean":"2024-09-14T13:02:09.651897+0000","last_became_active":"2024-09-14T11:08:21.845618+0000","last_became_peered":"2024-09-14T11:08:21.845618+0000","last_unstale":"2024-09-14T13:02:09.651897+0000","last_undegraded":"2024-09-14T13:02:09.651897+0000","last_fullsized":"2024-09-14T13:02:09.651897+0000","mapping_epoch":24,"log_start":"267'200","ondisk_log_start":"267'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'247","last_scrub_stamp":"2024-09-14T13:02:09.651691+0000","last_deep_scrub":"267'247","last_deep_scrub_stamp":"2024-09-14T13:02:09.651691+0000","last_clean_scrub_stamp":"2024-09-14T13:02:09.651691+0000","objects_scrubbed":3,"log_size":47,"log_dups_size":200,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:37:39.121548+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":682,"num_read_kb":36009,"num_write":1081,"num_write_kb":30861,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,0],"acting":[7,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":540,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:26.545227+0000","last_change":"2024-09-14T13:02:26.545227+0000","last_active":"2024-09-14T13:02:26.545227+0000","last_peered":"2024-09-14T13:02:26.545227+0000","last_clean":"2024-09-14T13:02:26.545227+0000","last_became_active":"2024-09-14T11:08:25.806427+0000","last_became_peered":"2024-09-14T11:08:25.806427+0000","last_unstale":"2024-09-14T13:02:26.545227+0000","last_undegraded":"2024-09-14T13:02:26.545227+0000","last_fullsized":"2024-09-14T13:02:26.545227+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T13:02:26.545021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T13:02:26.545021+0000","last_clean_scrub_stamp":"2024-09-14T13:02:26.545021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:36:58.214359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.a","version":"267'332","reported_seq":1040,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:34.440856+0000","last_change":"2024-09-14T13:02:34.440856+0000","last_active":"2024-09-14T13:02:34.440856+0000","last_peered":"2024-09-14T13:02:34.440856+0000","last_clean":"2024-09-14T13:02:34.440856+0000","last_became_active":"2024-09-14T11:08:27.825133+0000","last_became_peered":"2024-09-14T11:08:27.825133+0000","last_unstale":"2024-09-14T13:02:34.440856+0000","last_undegraded":"2024-09-14T13:02:34.440856+0000","last_fullsized":"2024-09-14T13:02:34.440856+0000","mapping_epoch":30,"log_start":"267'300","ondisk_log_start":"267'300","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'332","last_scrub_stamp":"2024-09-14T13:02:34.440644+0000","last_deep_scrub":"267'332","last_deep_scrub_stamp":"2024-09-14T13:02:34.440644+0000","last_clean_scrub_stamp":"2024-09-14T13:02:34.440644+0000","objects_scrubbed":10,"log_size":32,"log_dups_size":300,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T00:49:11.129833+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6555,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":452,"num_read_kb":512,"num_write":278,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":527,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:36.180793+0000","last_change":"2024-09-14T13:02:36.180793+0000","last_active":"2024-09-14T13:02:36.180793+0000","last_peered":"2024-09-14T13:02:36.180793+0000","last_clean":"2024-09-14T13:02:36.180793+0000","last_became_active":"2024-09-14T11:08:29.815620+0000","last_became_peered":"2024-09-14T11:08:29.815620+0000","last_unstale":"2024-09-14T13:02:36.180793+0000","last_undegraded":"2024-09-14T13:02:36.180793+0000","last_fullsized":"2024-09-14T13:02:36.180793+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T13:02:36.180603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T13:02:36.180603+0000","last_clean_scrub_stamp":"2024-09-14T13:02:36.180603+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:19:11.606941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.4","version":"267'575","reported_seq":1427,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:39.434130+0000","last_change":"2024-09-14T13:02:39.434130+0000","last_active":"2024-09-14T13:02:39.434130+0000","last_peered":"2024-09-14T13:02:39.434130+0000","last_clean":"2024-09-14T13:02:39.434130+0000","last_became_active":"2024-09-14T11:08:31.843834+0000","last_became_peered":"2024-09-14T11:08:31.843834+0000","last_unstale":"2024-09-14T13:02:39.434130+0000","last_undegraded":"2024-09-14T13:02:39.434130+0000","last_fullsized":"2024-09-14T13:02:39.434130+0000","mapping_epoch":34,"log_start":"267'500","ondisk_log_start":"267'500","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'575","last_scrub_stamp":"2024-09-14T13:02:39.433887+0000","last_deep_scrub":"267'575","last_deep_scrub_stamp":"2024-09-14T13:02:39.433887+0000","last_clean_scrub_stamp":"2024-09-14T13:02:39.433887+0000","objects_scrubbed":6,"log_size":75,"log_dups_size":500,"ondisk_log_size":75,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:35:09.744013+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1277,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":1293,"num_read_kb":1292,"num_write":1202,"num_write_kb":404,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":381,"num_omap_keys":2,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.9","version":"267'1172","reported_seq":2712,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:11.831369+0000","last_change":"2024-09-14T13:02:11.831369+0000","last_active":"2024-09-14T13:02:11.831369+0000","last_peered":"2024-09-14T13:02:11.831369+0000","last_clean":"2024-09-14T13:02:11.831369+0000","last_became_active":"2024-09-14T11:08:23.778539+0000","last_became_peered":"2024-09-14T11:08:23.778539+0000","last_unstale":"2024-09-14T13:02:11.831369+0000","last_undegraded":"2024-09-14T13:02:11.831369+0000","last_fullsized":"2024-09-14T13:02:11.831369+0000","mapping_epoch":26,"log_start":"267'1100","ondisk_log_start":"267'1100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'1172","last_scrub_stamp":"2024-09-14T13:02:11.831174+0000","last_deep_scrub":"267'1172","last_deep_scrub_stamp":"2024-09-14T13:02:11.831174+0000","last_clean_scrub_stamp":"2024-09-14T13:02:11.831174+0000","objects_scrubbed":6,"log_size":72,"log_dups_size":1100,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:09:58.666148+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":5272,"num_read_kb":4639,"num_write":1605,"num_write_kb":663,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"267'241","reported_seq":894,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:10.656071+0000","last_change":"2024-09-14T13:02:10.656071+0000","last_active":"2024-09-14T13:02:10.656071+0000","last_peered":"2024-09-14T13:02:10.656071+0000","last_clean":"2024-09-14T13:02:10.656071+0000","last_became_active":"2024-09-14T11:08:21.836948+0000","last_became_peered":"2024-09-14T11:08:21.836948+0000","last_unstale":"2024-09-14T13:02:10.656071+0000","last_undegraded":"2024-09-14T13:02:10.656071+0000","last_fullsized":"2024-09-14T13:02:10.656071+0000","mapping_epoch":24,"log_start":"267'200","ondisk_log_start":"267'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'241","last_scrub_stamp":"2024-09-14T13:02:10.655851+0000","last_deep_scrub":"267'241","last_deep_scrub_stamp":"2024-09-14T13:02:10.655851+0000","last_clean_scrub_stamp":"2024-09-14T13:02:10.655851+0000","objects_scrubbed":3,"log_size":41,"log_dups_size":200,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T00:25:40.160047+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":550,"num_read_kb":30603,"num_write":1007,"num_write_kb":48772,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,1],"acting":[7,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.8","version":"267'5","reported_seq":1020,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:22.163504+0000","last_change":"2024-09-14T13:02:22.163504+0000","last_active":"2024-09-14T13:02:22.163504+0000","last_peered":"2024-09-14T13:02:22.163504+0000","last_clean":"2024-09-14T13:02:22.163504+0000","last_became_active":"2024-09-14T11:08:25.786631+0000","last_became_peered":"2024-09-14T11:08:25.786631+0000","last_unstale":"2024-09-14T13:02:22.163504+0000","last_undegraded":"2024-09-14T13:02:22.163504+0000","last_fullsized":"2024-09-14T13:02:22.163504+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'5","last_scrub_stamp":"2024-09-14T13:02:22.163310+0000","last_deep_scrub":"267'5","last_deep_scrub_stamp":"2024-09-14T13:02:22.163310+0000","last_clean_scrub_stamp":"2024-09-14T13:02:22.163310+0000","objects_scrubbed":1,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:36:41.907237+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1139,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":718,"num_read_kb":1182,"num_write":8,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.b","version":"267'180","reported_seq":810,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:26.978235+0000","last_change":"2024-09-14T13:02:26.978235+0000","last_active":"2024-09-14T13:02:26.978235+0000","last_peered":"2024-09-14T13:02:26.978235+0000","last_clean":"2024-09-14T13:02:26.978235+0000","last_became_active":"2024-09-14T11:08:27.821051+0000","last_became_peered":"2024-09-14T11:08:27.821051+0000","last_unstale":"2024-09-14T13:02:26.978235+0000","last_undegraded":"2024-09-14T13:02:26.978235+0000","last_fullsized":"2024-09-14T13:02:26.978235+0000","mapping_epoch":30,"log_start":"267'100","ondisk_log_start":"267'100","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'180","last_scrub_stamp":"2024-09-14T13:02:26.978033+0000","last_deep_scrub":"267'180","last_deep_scrub_stamp":"2024-09-14T13:02:26.978033+0000","last_clean_scrub_stamp":"2024-09-14T13:02:26.978033+0000","objects_scrubbed":4,"log_size":80,"log_dups_size":100,"ondisk_log_size":80,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:07:33.857702+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7629,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":234,"num_read_kb":320,"num_write":132,"num_write_kb":26,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":531,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:38.907574+0000","last_change":"2024-09-14T13:02:38.907574+0000","last_active":"2024-09-14T13:02:38.907574+0000","last_peered":"2024-09-14T13:02:38.907574+0000","last_clean":"2024-09-14T13:02:38.907574+0000","last_became_active":"2024-09-14T11:08:29.835446+0000","last_became_peered":"2024-09-14T11:08:29.835446+0000","last_unstale":"2024-09-14T13:02:38.907574+0000","last_undegraded":"2024-09-14T13:02:38.907574+0000","last_fullsized":"2024-09-14T13:02:38.907574+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T13:02:38.907370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T13:02:38.907370+0000","last_clean_scrub_stamp":"2024-09-14T13:02:38.907370+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:54:07.413764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.5","version":"267'2492","reported_seq":4368,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:30.277298+0000","last_change":"2024-09-14T13:02:30.277298+0000","last_active":"2024-09-14T13:02:30.277298+0000","last_peered":"2024-09-14T13:02:30.277298+0000","last_clean":"2024-09-14T13:02:30.277298+0000","last_became_active":"2024-09-14T11:08:31.848959+0000","last_became_peered":"2024-09-14T11:08:31.848959+0000","last_unstale":"2024-09-14T13:02:30.277298+0000","last_undegraded":"2024-09-14T13:02:30.277298+0000","last_fullsized":"2024-09-14T13:02:30.277298+0000","mapping_epoch":34,"log_start":"267'2400","ondisk_log_start":"267'2400","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'2492","last_scrub_stamp":"2024-09-14T13:02:30.277095+0000","last_deep_scrub":"267'2492","last_deep_scrub_stamp":"2024-09-14T13:02:30.277095+0000","last_clean_scrub_stamp":"2024-09-14T13:02:30.277095+0000","objects_scrubbed":2,"log_size":92,"log_dups_size":2400,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:17:08.669349+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":423,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":6223,"num_read_kb":6216,"num_write":5015,"num_write_kb":1852,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":176,"num_omap_keys":1,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.a","version":"267'868","reported_seq":2687,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:14.314869+0000","last_change":"2024-09-14T13:02:14.314869+0000","last_active":"2024-09-14T13:02:14.314869+0000","last_peered":"2024-09-14T13:02:14.314869+0000","last_clean":"2024-09-14T13:02:14.314869+0000","last_became_active":"2024-09-14T11:08:23.811255+0000","last_became_peered":"2024-09-14T11:08:23.811255+0000","last_unstale":"2024-09-14T13:02:14.314869+0000","last_undegraded":"2024-09-14T13:02:14.314869+0000","last_fullsized":"2024-09-14T13:02:14.314869+0000","mapping_epoch":26,"log_start":"267'800","ondisk_log_start":"267'800","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'868","last_scrub_stamp":"2024-09-14T13:02:14.314591+0000","last_deep_scrub":"267'868","last_deep_scrub_stamp":"2024-09-14T13:02:14.314591+0000","last_clean_scrub_stamp":"2024-09-14T13:02:14.314591+0000","objects_scrubbed":2,"log_size":68,"log_dups_size":800,"ondisk_log_size":68,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:09:26.042491+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":4399,"num_read_kb":3998,"num_write":1156,"num_write_kb":415,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"267'213","reported_seq":893,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:12.651148+0000","last_change":"2024-09-14T13:02:12.651148+0000","last_active":"2024-09-14T13:02:12.651148+0000","last_peered":"2024-09-14T13:02:12.651148+0000","last_clean":"2024-09-14T13:02:12.651148+0000","last_became_active":"2024-09-14T11:08:21.804566+0000","last_became_peered":"2024-09-14T11:08:21.804566+0000","last_unstale":"2024-09-14T13:02:12.651148+0000","last_undegraded":"2024-09-14T13:02:12.651148+0000","last_fullsized":"2024-09-14T13:02:12.651148+0000","mapping_epoch":24,"log_start":"267'200","ondisk_log_start":"267'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'213","last_scrub_stamp":"2024-09-14T13:02:12.650904+0000","last_deep_scrub":"267'213","last_deep_scrub_stamp":"2024-09-14T13:02:12.650904+0000","last_clean_scrub_stamp":"2024-09-14T13:02:12.650904+0000","objects_scrubbed":6,"log_size":13,"log_dups_size":200,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:40:39.876331+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3311695,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":558,"num_read_kb":39823,"num_write":955,"num_write_kb":36124,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,3],"acting":[7,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":541,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:28.128083+0000","last_change":"2024-09-14T13:02:28.128083+0000","last_active":"2024-09-14T13:02:28.128083+0000","last_peered":"2024-09-14T13:02:28.128083+0000","last_clean":"2024-09-14T13:02:28.128083+0000","last_became_active":"2024-09-14T11:08:25.789075+0000","last_became_peered":"2024-09-14T11:08:25.789075+0000","last_unstale":"2024-09-14T13:02:28.128083+0000","last_undegraded":"2024-09-14T13:02:28.128083+0000","last_fullsized":"2024-09-14T13:02:28.128083+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T13:02:28.127905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T13:02:28.127905+0000","last_clean_scrub_stamp":"2024-09-14T13:02:28.127905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:54:32.722141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.8","version":"267'240","reported_seq":909,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:31.565905+0000","last_change":"2024-09-14T13:02:31.565905+0000","last_active":"2024-09-14T13:02:31.565905+0000","last_peered":"2024-09-14T13:02:31.565905+0000","last_clean":"2024-09-14T13:02:31.565905+0000","last_became_active":"2024-09-14T11:08:27.830862+0000","last_became_peered":"2024-09-14T11:08:27.830862+0000","last_unstale":"2024-09-14T13:02:31.565905+0000","last_undegraded":"2024-09-14T13:02:31.565905+0000","last_fullsized":"2024-09-14T13:02:31.565905+0000","mapping_epoch":30,"log_start":"267'200","ondisk_log_start":"267'200","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'240","last_scrub_stamp":"2024-09-14T13:02:31.565702+0000","last_deep_scrub":"267'240","last_deep_scrub_stamp":"2024-09-14T13:02:31.565702+0000","last_clean_scrub_stamp":"2024-09-14T13:02:31.565702+0000","objects_scrubbed":7,"log_size":40,"log_dups_size":200,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:48:33.239781+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4096,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":320,"num_read_kb":327,"num_write":186,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.9","version":"267'785","reported_seq":3481,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:30.035900+0000","last_change":"2024-09-14T13:02:30.035900+0000","last_active":"2024-09-14T13:02:30.035900+0000","last_peered":"2024-09-14T13:02:30.035900+0000","last_clean":"2024-09-14T13:02:30.035900+0000","last_became_active":"2024-09-14T11:08:29.821920+0000","last_became_peered":"2024-09-14T11:08:29.821920+0000","last_unstale":"2024-09-14T13:02:30.035900+0000","last_undegraded":"2024-09-14T13:02:30.035900+0000","last_fullsized":"2024-09-14T13:02:30.035900+0000","mapping_epoch":32,"log_start":"267'700","ondisk_log_start":"267'700","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'785","last_scrub_stamp":"2024-09-14T13:02:30.035684+0000","last_deep_scrub":"267'785","last_deep_scrub_stamp":"2024-09-14T13:02:30.035684+0000","last_clean_scrub_stamp":"2024-09-14T13:02:30.035684+0000","objects_scrubbed":1,"log_size":85,"log_dups_size":700,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:32:34.155277+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.6","version":"267'128","reported_seq":673,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:37.211214+0000","last_change":"2024-09-14T13:02:37.211214+0000","last_active":"2024-09-14T13:02:37.211214+0000","last_peered":"2024-09-14T13:02:37.211214+0000","last_clean":"2024-09-14T13:02:37.211214+0000","last_became_active":"2024-09-14T11:08:31.846373+0000","last_became_peered":"2024-09-14T11:08:31.846373+0000","last_unstale":"2024-09-14T13:02:37.211214+0000","last_undegraded":"2024-09-14T13:02:37.211214+0000","last_fullsized":"2024-09-14T13:02:37.211214+0000","mapping_epoch":34,"log_start":"267'100","ondisk_log_start":"267'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'128","last_scrub_stamp":"2024-09-14T13:02:37.211023+0000","last_deep_scrub":"267'128","last_deep_scrub_stamp":"2024-09-14T13:02:37.211023+0000","last_clean_scrub_stamp":"2024-09-14T13:02:37.211023+0000","objects_scrubbed":2,"log_size":28,"log_dups_size":100,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:02:57.592912+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":575,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":123,"num_write":296,"num_write_kb":71,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"267'1041","reported_seq":2685,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:19.068533+0000","last_change":"2024-09-14T13:02:19.068533+0000","last_active":"2024-09-14T13:02:19.068533+0000","last_peered":"2024-09-14T13:02:19.068533+0000","last_clean":"2024-09-14T13:02:19.068533+0000","last_became_active":"2024-09-14T11:08:23.777032+0000","last_became_peered":"2024-09-14T11:08:23.777032+0000","last_unstale":"2024-09-14T13:02:19.068533+0000","last_undegraded":"2024-09-14T13:02:19.068533+0000","last_fullsized":"2024-09-14T13:02:19.068533+0000","mapping_epoch":26,"log_start":"267'1000","ondisk_log_start":"267'1000","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'1041","last_scrub_stamp":"2024-09-14T13:02:19.068315+0000","last_deep_scrub":"267'1041","last_deep_scrub_stamp":"2024-09-14T13:02:19.068315+0000","last_clean_scrub_stamp":"2024-09-14T13:02:19.068315+0000","objects_scrubbed":1,"log_size":41,"log_dups_size":1000,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T00:09:24.080847+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":7372,"num_read_kb":6755,"num_write":1704,"num_write_kb":754,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.c","version":"267'187","reported_seq":835,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:10.302676+0000","last_change":"2024-09-14T13:02:10.302676+0000","last_active":"2024-09-14T13:02:10.302676+0000","last_peered":"2024-09-14T13:02:10.302676+0000","last_clean":"2024-09-14T13:02:10.302676+0000","last_became_active":"2024-09-14T11:08:21.828010+0000","last_became_peered":"2024-09-14T11:08:21.828010+0000","last_unstale":"2024-09-14T13:02:10.302676+0000","last_undegraded":"2024-09-14T13:02:10.302676+0000","last_fullsized":"2024-09-14T13:02:10.302676+0000","mapping_epoch":24,"log_start":"267'100","ondisk_log_start":"267'100","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'187","last_scrub_stamp":"2024-09-14T13:02:10.302469+0000","last_deep_scrub":"267'187","last_deep_scrub_stamp":"2024-09-14T13:02:10.302469+0000","last_clean_scrub_stamp":"2024-09-14T13:02:10.302469+0000","objects_scrubbed":2,"log_size":87,"log_dups_size":100,"ondisk_log_size":87,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T00:03:54.075323+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":29,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":466,"num_read_kb":18086,"num_write":819,"num_write_kb":39275,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,6],"acting":[5,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":543,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:21.173257+0000","last_change":"2024-09-14T13:02:21.173257+0000","last_active":"2024-09-14T13:02:21.173257+0000","last_peered":"2024-09-14T13:02:21.173257+0000","last_clean":"2024-09-14T13:02:21.173257+0000","last_became_active":"2024-09-14T11:08:25.805415+0000","last_became_peered":"2024-09-14T11:08:25.805415+0000","last_unstale":"2024-09-14T13:02:21.173257+0000","last_undegraded":"2024-09-14T13:02:21.173257+0000","last_fullsized":"2024-09-14T13:02:21.173257+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T13:02:21.173074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T13:02:21.173074+0000","last_clean_scrub_stamp":"2024-09-14T13:02:21.173074+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:57:11.797331+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"267'252","reported_seq":950,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:25.973750+0000","last_change":"2024-09-14T13:02:25.973750+0000","last_active":"2024-09-14T13:02:25.973750+0000","last_peered":"2024-09-14T13:02:25.973750+0000","last_clean":"2024-09-14T13:02:25.973750+0000","last_became_active":"2024-09-14T11:08:27.811687+0000","last_became_peered":"2024-09-14T11:08:27.811687+0000","last_unstale":"2024-09-14T13:02:25.973750+0000","last_undegraded":"2024-09-14T13:02:25.973750+0000","last_fullsized":"2024-09-14T13:02:25.973750+0000","mapping_epoch":30,"log_start":"267'200","ondisk_log_start":"267'200","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'252","last_scrub_stamp":"2024-09-14T13:02:25.973551+0000","last_deep_scrub":"267'252","last_deep_scrub_stamp":"2024-09-14T13:02:25.973551+0000","last_clean_scrub_stamp":"2024-09-14T13:02:25.973551+0000","objects_scrubbed":6,"log_size":52,"log_dups_size":200,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:23:33.816144+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":25927,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":349,"num_read_kb":508,"num_write":186,"num_write_kb":50,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":535,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:26.043510+0000","last_change":"2024-09-14T13:02:26.043510+0000","last_active":"2024-09-14T13:02:26.043510+0000","last_peered":"2024-09-14T13:02:26.043510+0000","last_clean":"2024-09-14T13:02:26.043510+0000","last_became_active":"2024-09-14T11:08:29.821747+0000","last_became_peered":"2024-09-14T11:08:29.821747+0000","last_unstale":"2024-09-14T13:02:26.043510+0000","last_undegraded":"2024-09-14T13:02:26.043510+0000","last_fullsized":"2024-09-14T13:02:26.043510+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T13:02:26.043324+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T13:02:26.043324+0000","last_clean_scrub_stamp":"2024-09-14T13:02:26.043324+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:05:56.999647+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.7","version":"267'151","reported_seq":705,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:29.128113+0000","last_change":"2024-09-14T13:02:29.128113+0000","last_active":"2024-09-14T13:02:29.128113+0000","last_peered":"2024-09-14T13:02:29.128113+0000","last_clean":"2024-09-14T13:02:29.128113+0000","last_became_active":"2024-09-14T11:08:31.838392+0000","last_became_peered":"2024-09-14T11:08:31.838392+0000","last_unstale":"2024-09-14T13:02:29.128113+0000","last_undegraded":"2024-09-14T13:02:29.128113+0000","last_fullsized":"2024-09-14T13:02:29.128113+0000","mapping_epoch":34,"log_start":"267'100","ondisk_log_start":"267'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'151","last_scrub_stamp":"2024-09-14T13:02:29.127914+0000","last_deep_scrub":"267'151","last_deep_scrub_stamp":"2024-09-14T13:02:29.127914+0000","last_clean_scrub_stamp":"2024-09-14T13:02:29.127914+0000","objects_scrubbed":3,"log_size":51,"log_dups_size":100,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:09:19.987511+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":722,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":177,"num_read_kb":165,"num_write":335,"num_write_kb":82,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"267'557","reported_seq":2167,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:12.782223+0000","last_change":"2024-09-14T13:02:12.782223+0000","last_active":"2024-09-14T13:02:12.782223+0000","last_peered":"2024-09-14T13:02:12.782223+0000","last_clean":"2024-09-14T13:02:12.782223+0000","last_became_active":"2024-09-14T11:08:23.788219+0000","last_became_peered":"2024-09-14T11:08:23.788219+0000","last_unstale":"2024-09-14T13:02:12.782223+0000","last_undegraded":"2024-09-14T13:02:12.782223+0000","last_fullsized":"2024-09-14T13:02:12.782223+0000","mapping_epoch":26,"log_start":"267'500","ondisk_log_start":"267'500","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'557","last_scrub_stamp":"2024-09-14T13:02:12.781939+0000","last_deep_scrub":"267'557","last_deep_scrub_stamp":"2024-09-14T13:02:12.781939+0000","last_clean_scrub_stamp":"2024-09-14T13:02:12.781939+0000","objects_scrubbed":0,"log_size":57,"log_dups_size":500,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:01:16.526677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2903,"num_read_kb":2651,"num_write":738,"num_write_kb":289,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"267'322","reported_seq":1077,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:07.945838+0000","last_change":"2024-09-14T13:02:07.945838+0000","last_active":"2024-09-14T13:02:07.945838+0000","last_peered":"2024-09-14T13:02:07.945838+0000","last_clean":"2024-09-14T13:02:07.945838+0000","last_became_active":"2024-09-14T11:08:21.827553+0000","last_became_peered":"2024-09-14T11:08:21.827553+0000","last_unstale":"2024-09-14T13:02:07.945838+0000","last_undegraded":"2024-09-14T13:02:07.945838+0000","last_fullsized":"2024-09-14T13:02:07.945838+0000","mapping_epoch":24,"log_start":"267'300","ondisk_log_start":"267'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'322","last_scrub_stamp":"2024-09-14T13:02:07.945633+0000","last_deep_scrub":"267'322","last_deep_scrub_stamp":"2024-09-14T13:02:07.945633+0000","last_clean_scrub_stamp":"2024-09-14T13:02:07.945633+0000","objects_scrubbed":2,"log_size":22,"log_dups_size":300,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:22:36.317068+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1003,"num_read_kb":39840,"num_write":1278,"num_write_kb":27597,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,4],"acting":[3,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":541,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:24.101103+0000","last_change":"2024-09-14T13:02:24.101103+0000","last_active":"2024-09-14T13:02:24.101103+0000","last_peered":"2024-09-14T13:02:24.101103+0000","last_clean":"2024-09-14T13:02:24.101103+0000","last_became_active":"2024-09-14T11:08:25.798931+0000","last_became_peered":"2024-09-14T11:08:25.798931+0000","last_unstale":"2024-09-14T13:02:24.101103+0000","last_undegraded":"2024-09-14T13:02:24.101103+0000","last_fullsized":"2024-09-14T13:02:24.101103+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T13:02:24.100892+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T13:02:24.100892+0000","last_clean_scrub_stamp":"2024-09-14T13:02:24.100892+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:15:17.317882+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.e","version":"267'210","reported_seq":854,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:31.667503+0000","last_change":"2024-09-14T13:02:31.667503+0000","last_active":"2024-09-14T13:02:31.667503+0000","last_peered":"2024-09-14T13:02:31.667503+0000","last_clean":"2024-09-14T13:02:31.667503+0000","last_became_active":"2024-09-14T11:08:27.818219+0000","last_became_peered":"2024-09-14T11:08:27.818219+0000","last_unstale":"2024-09-14T13:02:31.667503+0000","last_undegraded":"2024-09-14T13:02:31.667503+0000","last_fullsized":"2024-09-14T13:02:31.667503+0000","mapping_epoch":30,"log_start":"264'100","ondisk_log_start":"264'100","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'210","last_scrub_stamp":"2024-09-14T13:02:31.667260+0000","last_deep_scrub":"267'210","last_deep_scrub_stamp":"2024-09-14T13:02:31.667260+0000","last_clean_scrub_stamp":"2024-09-14T13:02:31.667260+0000","objects_scrubbed":6,"log_size":110,"log_dups_size":100,"ondisk_log_size":110,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:37:05.528538+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6420,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":294,"num_read_kb":320,"num_write":220,"num_write_kb":86,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":15964,"num_omap_keys":38,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":534,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:34.134567+0000","last_change":"2024-09-14T13:02:34.134567+0000","last_active":"2024-09-14T13:02:34.134567+0000","last_peered":"2024-09-14T13:02:34.134567+0000","last_clean":"2024-09-14T13:02:34.134567+0000","last_became_active":"2024-09-14T11:08:29.824057+0000","last_became_peered":"2024-09-14T11:08:29.824057+0000","last_unstale":"2024-09-14T13:02:34.134567+0000","last_undegraded":"2024-09-14T13:02:34.134567+0000","last_fullsized":"2024-09-14T13:02:34.134567+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T13:02:34.134358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T13:02:34.134358+0000","last_clean_scrub_stamp":"2024-09-14T13:02:34.134358+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:13:01.485748+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.0","version":"267'127","reported_seq":651,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:00:53.493597+0000","last_change":"2024-09-14T11:08:31.845590+0000","last_active":"2024-09-14T13:00:53.493597+0000","last_peered":"2024-09-14T13:00:53.493597+0000","last_clean":"2024-09-14T13:00:53.493597+0000","last_became_active":"2024-09-14T11:08:31.844832+0000","last_became_peered":"2024-09-14T11:08:31.844832+0000","last_unstale":"2024-09-14T13:00:53.493597+0000","last_undegraded":"2024-09-14T13:00:53.493597+0000","last_fullsized":"2024-09-14T13:00:53.493597+0000","mapping_epoch":34,"log_start":"267'100","ondisk_log_start":"267'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:08:30.789404+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:08:30.789404+0000","last_clean_scrub_stamp":"2024-09-14T11:08:30.789404+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":100,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:04:19.552267+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":910,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":99,"num_read_kb":98,"num_write":310,"num_write_kb":70,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"267'808","reported_seq":2448,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:13.800136+0000","last_change":"2024-09-14T13:02:13.800136+0000","last_active":"2024-09-14T13:02:13.800136+0000","last_peered":"2024-09-14T13:02:13.800136+0000","last_clean":"2024-09-14T13:02:13.800136+0000","last_became_active":"2024-09-14T11:08:23.791966+0000","last_became_peered":"2024-09-14T11:08:23.791966+0000","last_unstale":"2024-09-14T13:02:13.800136+0000","last_undegraded":"2024-09-14T13:02:13.800136+0000","last_fullsized":"2024-09-14T13:02:13.800136+0000","mapping_epoch":26,"log_start":"267'700","ondisk_log_start":"267'700","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'808","last_scrub_stamp":"2024-09-14T13:02:13.799940+0000","last_deep_scrub":"267'808","last_deep_scrub_stamp":"2024-09-14T13:02:13.799940+0000","last_clean_scrub_stamp":"2024-09-14T13:02:13.799940+0000","objects_scrubbed":1,"log_size":108,"log_dups_size":700,"ondisk_log_size":108,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:03:49.959088+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3905,"num_read_kb":3535,"num_write":1083,"num_write_kb":396,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"267'233","reported_seq":916,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:10.262031+0000","last_change":"2024-09-14T13:02:10.262031+0000","last_active":"2024-09-14T13:02:10.262031+0000","last_peered":"2024-09-14T13:02:10.262031+0000","last_clean":"2024-09-14T13:02:10.262031+0000","last_became_active":"2024-09-14T11:08:21.836346+0000","last_became_peered":"2024-09-14T11:08:21.836346+0000","last_unstale":"2024-09-14T13:02:10.262031+0000","last_undegraded":"2024-09-14T13:02:10.262031+0000","last_fullsized":"2024-09-14T13:02:10.262031+0000","mapping_epoch":24,"log_start":"267'200","ondisk_log_start":"267'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'233","last_scrub_stamp":"2024-09-14T13:02:10.261790+0000","last_deep_scrub":"267'233","last_deep_scrub_stamp":"2024-09-14T13:02:10.261790+0000","last_clean_scrub_stamp":"2024-09-14T13:02:10.261790+0000","objects_scrubbed":3,"log_size":33,"log_dups_size":200,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:01:19.068873+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2055072,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":607,"num_read_kb":23439,"num_write":1082,"num_write_kb":33198,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,1],"acting":[6,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":535,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:20.025587+0000","last_change":"2024-09-14T13:02:20.025587+0000","last_active":"2024-09-14T13:02:20.025587+0000","last_peered":"2024-09-14T13:02:20.025587+0000","last_clean":"2024-09-14T13:02:20.025587+0000","last_became_active":"2024-09-14T11:08:25.806502+0000","last_became_peered":"2024-09-14T11:08:25.806502+0000","last_unstale":"2024-09-14T13:02:20.025587+0000","last_undegraded":"2024-09-14T13:02:20.025587+0000","last_fullsized":"2024-09-14T13:02:20.025587+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T13:02:20.025419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T13:02:20.025419+0000","last_clean_scrub_stamp":"2024-09-14T13:02:20.025419+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:06:23.521008+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.f","version":"267'246","reported_seq":916,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:25.074588+0000","last_change":"2024-09-14T13:02:25.074588+0000","last_active":"2024-09-14T13:02:25.074588+0000","last_peered":"2024-09-14T13:02:25.074588+0000","last_clean":"2024-09-14T13:02:25.074588+0000","last_became_active":"2024-09-14T11:08:27.817904+0000","last_became_peered":"2024-09-14T11:08:27.817904+0000","last_unstale":"2024-09-14T13:02:25.074588+0000","last_undegraded":"2024-09-14T13:02:25.074588+0000","last_fullsized":"2024-09-14T13:02:25.074588+0000","mapping_epoch":30,"log_start":"267'200","ondisk_log_start":"267'200","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'246","last_scrub_stamp":"2024-09-14T13:02:25.074372+0000","last_deep_scrub":"267'246","last_deep_scrub_stamp":"2024-09-14T13:02:25.074372+0000","last_clean_scrub_stamp":"2024-09-14T13:02:25.074372+0000","objects_scrubbed":7,"log_size":46,"log_dups_size":200,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:02:03.126229+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8985,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":331,"num_read_kb":393,"num_write":194,"num_write_kb":21,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.e","version":"267'763","reported_seq":3243,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:29.123290+0000","last_change":"2024-09-14T13:02:29.123290+0000","last_active":"2024-09-14T13:02:29.123290+0000","last_peered":"2024-09-14T13:02:29.123290+0000","last_clean":"2024-09-14T13:02:29.123290+0000","last_became_active":"2024-09-14T11:08:29.817475+0000","last_became_peered":"2024-09-14T11:08:29.817475+0000","last_unstale":"2024-09-14T13:02:29.123290+0000","last_undegraded":"2024-09-14T13:02:29.123290+0000","last_fullsized":"2024-09-14T13:02:29.123290+0000","mapping_epoch":32,"log_start":"267'700","ondisk_log_start":"267'700","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'763","last_scrub_stamp":"2024-09-14T13:02:29.122983+0000","last_deep_scrub":"267'763","last_deep_scrub_stamp":"2024-09-14T13:02:29.122983+0000","last_clean_scrub_stamp":"2024-09-14T13:02:29.122983+0000","objects_scrubbed":1,"log_size":63,"log_dups_size":700,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T00:20:17.430015+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1","version":"267'134","reported_seq":680,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:30.143565+0000","last_change":"2024-09-14T13:02:30.143565+0000","last_active":"2024-09-14T13:02:30.143565+0000","last_peered":"2024-09-14T13:02:30.143565+0000","last_clean":"2024-09-14T13:02:30.143565+0000","last_became_active":"2024-09-14T11:08:31.847603+0000","last_became_peered":"2024-09-14T11:08:31.847603+0000","last_unstale":"2024-09-14T13:02:30.143565+0000","last_undegraded":"2024-09-14T13:02:30.143565+0000","last_fullsized":"2024-09-14T13:02:30.143565+0000","mapping_epoch":34,"log_start":"267'100","ondisk_log_start":"267'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'134","last_scrub_stamp":"2024-09-14T13:02:30.143380+0000","last_deep_scrub":"267'134","last_deep_scrub_stamp":"2024-09-14T13:02:30.143380+0000","last_clean_scrub_stamp":"2024-09-14T13:02:30.143380+0000","objects_scrubbed":4,"log_size":34,"log_dups_size":100,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:29:36.739368+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1261,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":168,"num_read_kb":154,"num_write":334,"num_write_kb":78,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"267'386","reported_seq":1940,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:14.788852+0000","last_change":"2024-09-14T13:02:14.788852+0000","last_active":"2024-09-14T13:02:14.788852+0000","last_peered":"2024-09-14T13:02:14.788852+0000","last_clean":"2024-09-14T13:02:14.788852+0000","last_became_active":"2024-09-14T11:08:23.814578+0000","last_became_peered":"2024-09-14T11:08:23.814578+0000","last_unstale":"2024-09-14T13:02:14.788852+0000","last_undegraded":"2024-09-14T13:02:14.788852+0000","last_fullsized":"2024-09-14T13:02:14.788852+0000","mapping_epoch":26,"log_start":"267'300","ondisk_log_start":"267'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'386","last_scrub_stamp":"2024-09-14T13:02:14.788668+0000","last_deep_scrub":"267'386","last_deep_scrub_stamp":"2024-09-14T13:02:14.788668+0000","last_clean_scrub_stamp":"2024-09-14T13:02:14.788668+0000","objects_scrubbed":1,"log_size":86,"log_dups_size":300,"ondisk_log_size":86,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:27:33.280225+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2178,"num_read_kb":2072,"num_write":449,"num_write_kb":92,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.9","version":"267'206","reported_seq":870,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:07.861868+0000","last_change":"2024-09-14T13:02:07.861868+0000","last_active":"2024-09-14T13:02:07.861868+0000","last_peered":"2024-09-14T13:02:07.861868+0000","last_clean":"2024-09-14T13:02:07.861868+0000","last_became_active":"2024-09-14T11:08:21.824109+0000","last_became_peered":"2024-09-14T11:08:21.824109+0000","last_unstale":"2024-09-14T13:02:07.861868+0000","last_undegraded":"2024-09-14T13:02:07.861868+0000","last_fullsized":"2024-09-14T13:02:07.861868+0000","mapping_epoch":24,"log_start":"267'100","ondisk_log_start":"267'100","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'206","last_scrub_stamp":"2024-09-14T13:02:07.861610+0000","last_deep_scrub":"267'206","last_deep_scrub_stamp":"2024-09-14T13:02:07.861610+0000","last_clean_scrub_stamp":"2024-09-14T13:02:07.861610+0000","objects_scrubbed":3,"log_size":106,"log_dups_size":100,"ondisk_log_size":106,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:54:21.419194+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1655851,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":552,"num_read_kb":13686,"num_write":959,"num_write_kb":41004,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,7],"acting":[4,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.f","version":"267'4","reported_seq":1487,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:29.522816+0000","last_change":"2024-09-14T13:02:29.522816+0000","last_active":"2024-09-14T13:02:29.522816+0000","last_peered":"2024-09-14T13:02:29.522816+0000","last_clean":"2024-09-14T13:02:29.522816+0000","last_became_active":"2024-09-14T11:08:25.815109+0000","last_became_peered":"2024-09-14T11:08:25.815109+0000","last_unstale":"2024-09-14T13:02:29.522816+0000","last_undegraded":"2024-09-14T13:02:29.522816+0000","last_fullsized":"2024-09-14T13:02:29.522816+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'4","last_scrub_stamp":"2024-09-14T13:02:29.522630+0000","last_deep_scrub":"267'4","last_deep_scrub_stamp":"2024-09-14T13:02:29.522630+0000","last_clean_scrub_stamp":"2024-09-14T13:02:29.522630+0000","objects_scrubbed":2,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T00:08:08.934481+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":946,"num_read_kb":946,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.c","version":"267'157","reported_seq":751,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:29.910731+0000","last_change":"2024-09-14T13:02:29.910731+0000","last_active":"2024-09-14T13:02:29.910731+0000","last_peered":"2024-09-14T13:02:29.910731+0000","last_clean":"2024-09-14T13:02:29.910731+0000","last_became_active":"2024-09-14T11:08:27.799244+0000","last_became_peered":"2024-09-14T11:08:27.799244+0000","last_unstale":"2024-09-14T13:02:29.910731+0000","last_undegraded":"2024-09-14T13:02:29.910731+0000","last_fullsized":"2024-09-14T13:02:29.910731+0000","mapping_epoch":30,"log_start":"267'100","ondisk_log_start":"267'100","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'157","last_scrub_stamp":"2024-09-14T13:02:29.910539+0000","last_deep_scrub":"267'157","last_deep_scrub_stamp":"2024-09-14T13:02:29.910539+0000","last_clean_scrub_stamp":"2024-09-14T13:02:29.910539+0000","objects_scrubbed":5,"log_size":57,"log_dups_size":100,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:53:22.851388+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":184,"num_read_kb":178,"num_write":124,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.d","version":"267'769","reported_seq":3172,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:26.309439+0000","last_change":"2024-09-14T13:02:26.309439+0000","last_active":"2024-09-14T13:02:26.309439+0000","last_peered":"2024-09-14T13:02:26.309439+0000","last_clean":"2024-09-14T13:02:26.309439+0000","last_became_active":"2024-09-14T11:08:29.828249+0000","last_became_peered":"2024-09-14T11:08:29.828249+0000","last_unstale":"2024-09-14T13:02:26.309439+0000","last_undegraded":"2024-09-14T13:02:26.309439+0000","last_fullsized":"2024-09-14T13:02:26.309439+0000","mapping_epoch":32,"log_start":"267'701","ondisk_log_start":"267'701","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'769","last_scrub_stamp":"2024-09-14T13:02:26.309151+0000","last_deep_scrub":"267'769","last_deep_scrub_stamp":"2024-09-14T13:02:26.309151+0000","last_clean_scrub_stamp":"2024-09-14T13:02:26.309151+0000","objects_scrubbed":1,"log_size":68,"log_dups_size":701,"ondisk_log_size":68,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:10:16.372727+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.2","version":"267'160","reported_seq":702,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:37.660489+0000","last_change":"2024-09-14T13:02:37.660489+0000","last_active":"2024-09-14T13:02:37.660489+0000","last_peered":"2024-09-14T13:02:37.660489+0000","last_clean":"2024-09-14T13:02:37.660489+0000","last_became_active":"2024-09-14T11:08:31.849463+0000","last_became_peered":"2024-09-14T11:08:31.849463+0000","last_unstale":"2024-09-14T13:02:37.660489+0000","last_undegraded":"2024-09-14T13:02:37.660489+0000","last_fullsized":"2024-09-14T13:02:37.660489+0000","mapping_epoch":34,"log_start":"267'100","ondisk_log_start":"267'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'160","last_scrub_stamp":"2024-09-14T13:02:37.660251+0000","last_deep_scrub":"267'160","last_deep_scrub_stamp":"2024-09-14T13:02:37.660251+0000","last_clean_scrub_stamp":"2024-09-14T13:02:37.660251+0000","objects_scrubbed":0,"log_size":60,"log_dups_size":100,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:40:12.598378+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":154,"num_read_kb":144,"num_write":375,"num_write_kb":85,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"267'386","reported_seq":1884,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:16.080785+0000","last_change":"2024-09-14T13:02:16.080785+0000","last_active":"2024-09-14T13:02:16.080785+0000","last_peered":"2024-09-14T13:02:16.080785+0000","last_clean":"2024-09-14T13:02:16.080785+0000","last_became_active":"2024-09-14T11:08:23.783481+0000","last_became_peered":"2024-09-14T11:08:23.783481+0000","last_unstale":"2024-09-14T13:02:16.080785+0000","last_undegraded":"2024-09-14T13:02:16.080785+0000","last_fullsized":"2024-09-14T13:02:16.080785+0000","mapping_epoch":26,"log_start":"267'300","ondisk_log_start":"267'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'386","last_scrub_stamp":"2024-09-14T13:02:16.080562+0000","last_deep_scrub":"267'386","last_deep_scrub_stamp":"2024-09-14T13:02:16.080562+0000","last_clean_scrub_stamp":"2024-09-14T13:02:16.080562+0000","objects_scrubbed":4,"log_size":86,"log_dups_size":300,"ondisk_log_size":86,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:15:42.229866+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":2050,"num_read_kb":1948,"num_write":423,"num_write_kb":74,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"267'177","reported_seq":838,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:09.948319+0000","last_change":"2024-09-14T13:02:09.948319+0000","last_active":"2024-09-14T13:02:09.948319+0000","last_peered":"2024-09-14T13:02:09.948319+0000","last_clean":"2024-09-14T13:02:09.948319+0000","last_became_active":"2024-09-14T11:08:21.786611+0000","last_became_peered":"2024-09-14T11:08:21.786611+0000","last_unstale":"2024-09-14T13:02:09.948319+0000","last_undegraded":"2024-09-14T13:02:09.948319+0000","last_fullsized":"2024-09-14T13:02:09.948319+0000","mapping_epoch":24,"log_start":"267'100","ondisk_log_start":"267'100","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'177","last_scrub_stamp":"2024-09-14T13:02:09.948060+0000","last_deep_scrub":"267'177","last_deep_scrub_stamp":"2024-09-14T13:02:09.948060+0000","last_clean_scrub_stamp":"2024-09-14T13:02:09.948060+0000","objects_scrubbed":4,"log_size":77,"log_dups_size":100,"ondisk_log_size":77,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:07:24.070925+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1655868,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":450,"num_read_kb":66993,"num_write":850,"num_write_kb":21210,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7],"acting":[3,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":539,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:28.665844+0000","last_change":"2024-09-14T13:02:28.665844+0000","last_active":"2024-09-14T13:02:28.665844+0000","last_peered":"2024-09-14T13:02:28.665844+0000","last_clean":"2024-09-14T13:02:28.665844+0000","last_became_active":"2024-09-14T11:08:25.817491+0000","last_became_peered":"2024-09-14T11:08:25.817491+0000","last_unstale":"2024-09-14T13:02:28.665844+0000","last_undegraded":"2024-09-14T13:02:28.665844+0000","last_fullsized":"2024-09-14T13:02:28.665844+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T13:02:28.665658+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T13:02:28.665658+0000","last_clean_scrub_stamp":"2024-09-14T13:02:28.665658+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:11:14.212412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.d","version":"267'303","reported_seq":997,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:35.435272+0000","last_change":"2024-09-14T13:02:35.435272+0000","last_active":"2024-09-14T13:02:35.435272+0000","last_peered":"2024-09-14T13:02:35.435272+0000","last_clean":"2024-09-14T13:02:35.435272+0000","last_became_active":"2024-09-14T11:08:27.829060+0000","last_became_peered":"2024-09-14T11:08:27.829060+0000","last_unstale":"2024-09-14T13:02:35.435272+0000","last_undegraded":"2024-09-14T13:02:35.435272+0000","last_fullsized":"2024-09-14T13:02:35.435272+0000","mapping_epoch":30,"log_start":"267'200","ondisk_log_start":"267'200","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'303","last_scrub_stamp":"2024-09-14T13:02:35.435035+0000","last_deep_scrub":"267'303","last_deep_scrub_stamp":"2024-09-14T13:02:35.435035+0000","last_clean_scrub_stamp":"2024-09-14T13:02:35.435035+0000","objects_scrubbed":8,"log_size":103,"log_dups_size":200,"ondisk_log_size":103,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:25:02.104137+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5925,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":413,"num_read_kb":450,"num_write":250,"num_write_kb":21,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":528,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:25.336986+0000","last_change":"2024-09-14T13:02:25.336986+0000","last_active":"2024-09-14T13:02:25.336986+0000","last_peered":"2024-09-14T13:02:25.336986+0000","last_clean":"2024-09-14T13:02:25.336986+0000","last_became_active":"2024-09-14T11:08:29.844374+0000","last_became_peered":"2024-09-14T11:08:29.844374+0000","last_unstale":"2024-09-14T13:02:25.336986+0000","last_undegraded":"2024-09-14T13:02:25.336986+0000","last_fullsized":"2024-09-14T13:02:25.336986+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T13:02:25.336798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T13:02:25.336798+0000","last_clean_scrub_stamp":"2024-09-14T13:02:25.336798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:12:09.425134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.3","version":"267'107","reported_seq":638,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:35.164813+0000","last_change":"2024-09-14T13:02:35.164813+0000","last_active":"2024-09-14T13:02:35.164813+0000","last_peered":"2024-09-14T13:02:35.164813+0000","last_clean":"2024-09-14T13:02:35.164813+0000","last_became_active":"2024-09-14T11:08:31.835753+0000","last_became_peered":"2024-09-14T11:08:31.835753+0000","last_unstale":"2024-09-14T13:02:35.164813+0000","last_undegraded":"2024-09-14T13:02:35.164813+0000","last_fullsized":"2024-09-14T13:02:35.164813+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'107","last_scrub_stamp":"2024-09-14T13:02:35.164528+0000","last_deep_scrub":"267'107","last_deep_scrub_stamp":"2024-09-14T13:02:35.164528+0000","last_clean_scrub_stamp":"2024-09-14T13:02:35.164528+0000","objects_scrubbed":2,"log_size":107,"log_dups_size":0,"ondisk_log_size":107,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:19:26.483679+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":24,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":102,"num_read_kb":102,"num_write":245,"num_write_kb":60,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"267'868","reported_seq":2554,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:16.363215+0000","last_change":"2024-09-14T13:02:16.363215+0000","last_active":"2024-09-14T13:02:16.363215+0000","last_peered":"2024-09-14T13:02:16.363215+0000","last_clean":"2024-09-14T13:02:16.363215+0000","last_became_active":"2024-09-14T11:08:23.806515+0000","last_became_peered":"2024-09-14T11:08:23.806515+0000","last_unstale":"2024-09-14T13:02:16.363215+0000","last_undegraded":"2024-09-14T13:02:16.363215+0000","last_fullsized":"2024-09-14T13:02:16.363215+0000","mapping_epoch":26,"log_start":"267'800","ondisk_log_start":"267'800","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'868","last_scrub_stamp":"2024-09-14T13:02:16.363033+0000","last_deep_scrub":"267'868","last_deep_scrub_stamp":"2024-09-14T13:02:16.363033+0000","last_clean_scrub_stamp":"2024-09-14T13:02:16.363033+0000","objects_scrubbed":3,"log_size":68,"log_dups_size":800,"ondisk_log_size":68,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:24:22.719515+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":4146,"num_read_kb":3734,"num_write":1154,"num_write_kb":420,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"267'74","reported_seq":665,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:18.632013+0000","last_change":"2024-09-14T13:02:18.631868+0000","last_active":"2024-09-14T13:02:18.632013+0000","last_peered":"2024-09-14T13:02:18.632013+0000","last_clean":"2024-09-14T13:02:18.632013+0000","last_became_active":"2024-09-14T11:08:03.877126+0000","last_became_peered":"2024-09-14T11:08:03.877126+0000","last_unstale":"2024-09-14T13:02:18.632013+0000","last_undegraded":"2024-09-14T13:02:18.632013+0000","last_fullsized":"2024-09-14T13:02:18.632013+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'74","last_scrub_stamp":"2024-09-14T13:02:18.631647+0000","last_deep_scrub":"267'74","last_deep_scrub_stamp":"2024-09-14T13:02:18.631647+0000","last_clean_scrub_stamp":"2024-09-14T13:02:18.631647+0000","objects_scrubbed":2,"log_size":74,"log_dups_size":0,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:28:42.174349+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"267'2","reported_seq":570,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:14.376805+0000","last_change":"2024-09-14T13:02:14.376805+0000","last_active":"2024-09-14T13:02:14.376805+0000","last_peered":"2024-09-14T13:02:14.376805+0000","last_clean":"2024-09-14T13:02:14.376805+0000","last_became_active":"2024-09-14T11:08:08.902043+0000","last_became_peered":"2024-09-14T11:08:08.902043+0000","last_unstale":"2024-09-14T13:02:14.376805+0000","last_undegraded":"2024-09-14T13:02:14.376805+0000","last_fullsized":"2024-09-14T13:02:14.376805+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'2","last_scrub_stamp":"2024-09-14T13:02:14.376621+0000","last_deep_scrub":"267'2","last_deep_scrub_stamp":"2024-09-14T13:02:14.376621+0000","last_clean_scrub_stamp":"2024-09-14T13:02:14.376621+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:25:42.583105+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0.0011624509999999999,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"267'380","reported_seq":1109,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:05.971317+0000","last_change":"2024-09-14T13:02:05.971317+0000","last_active":"2024-09-14T13:02:05.971317+0000","last_peered":"2024-09-14T13:02:05.971317+0000","last_clean":"2024-09-14T13:02:05.971317+0000","last_became_active":"2024-09-14T11:08:21.809523+0000","last_became_peered":"2024-09-14T11:08:21.809523+0000","last_unstale":"2024-09-14T13:02:05.971317+0000","last_undegraded":"2024-09-14T13:02:05.971317+0000","last_fullsized":"2024-09-14T13:02:05.971317+0000","mapping_epoch":24,"log_start":"267'300","ondisk_log_start":"267'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'380","last_scrub_stamp":"2024-09-14T13:02:05.971194+0000","last_deep_scrub":"267'380","last_deep_scrub_stamp":"2024-09-14T13:02:05.971194+0000","last_clean_scrub_stamp":"2024-09-14T13:02:05.971194+0000","objects_scrubbed":3,"log_size":80,"log_dups_size":300,"ondisk_log_size":80,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:17:00.193745+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1030,"num_read_kb":10703,"num_write":1404,"num_write_kb":52429,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,6],"acting":[3,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":542,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:23.663891+0000","last_change":"2024-09-14T13:02:23.663891+0000","last_active":"2024-09-14T13:02:23.663891+0000","last_peered":"2024-09-14T13:02:23.663891+0000","last_clean":"2024-09-14T13:02:23.663891+0000","last_became_active":"2024-09-14T11:08:25.807851+0000","last_became_peered":"2024-09-14T11:08:25.807851+0000","last_unstale":"2024-09-14T13:02:23.663891+0000","last_undegraded":"2024-09-14T13:02:23.663891+0000","last_fullsized":"2024-09-14T13:02:23.663891+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T13:02:23.663676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T13:02:23.663676+0000","last_clean_scrub_stamp":"2024-09-14T13:02:23.663676+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:28:55.570418+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.7","version":"267'355","reported_seq":1113,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:32.410565+0000","last_change":"2024-09-14T13:02:32.410565+0000","last_active":"2024-09-14T13:02:32.410565+0000","last_peered":"2024-09-14T13:02:32.410565+0000","last_clean":"2024-09-14T13:02:32.410565+0000","last_became_active":"2024-09-14T11:08:27.829359+0000","last_became_peered":"2024-09-14T11:08:27.829359+0000","last_unstale":"2024-09-14T13:02:32.410565+0000","last_undegraded":"2024-09-14T13:02:32.410565+0000","last_fullsized":"2024-09-14T13:02:32.410565+0000","mapping_epoch":30,"log_start":"267'300","ondisk_log_start":"267'300","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'355","last_scrub_stamp":"2024-09-14T13:02:32.410352+0000","last_deep_scrub":"267'355","last_deep_scrub_stamp":"2024-09-14T13:02:32.410352+0000","last_clean_scrub_stamp":"2024-09-14T13:02:32.410352+0000","objects_scrubbed":7,"log_size":55,"log_dups_size":300,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:16:03.160630+0000","scrub_duration":19,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":21129,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":651,"num_read_kb":879,"num_write":592,"num_write_kb":412,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":89502,"num_omap_keys":214,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":536,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:33.165625+0000","last_change":"2024-09-14T13:02:33.165625+0000","last_active":"2024-09-14T13:02:33.165625+0000","last_peered":"2024-09-14T13:02:33.165625+0000","last_clean":"2024-09-14T13:02:33.165625+0000","last_became_active":"2024-09-14T11:08:29.826367+0000","last_became_peered":"2024-09-14T11:08:29.826367+0000","last_unstale":"2024-09-14T13:02:33.165625+0000","last_undegraded":"2024-09-14T13:02:33.165625+0000","last_fullsized":"2024-09-14T13:02:33.165625+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T13:02:33.165410+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T13:02:33.165410+0000","last_clean_scrub_stamp":"2024-09-14T13:02:33.165410+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:05:13.270417+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.9","version":"267'214","reported_seq":978,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:32.320694+0000","last_change":"2024-09-14T13:02:32.320694+0000","last_active":"2024-09-14T13:02:32.320694+0000","last_peered":"2024-09-14T13:02:32.320694+0000","last_clean":"2024-09-14T13:02:32.320694+0000","last_became_active":"2024-09-14T11:08:31.848763+0000","last_became_peered":"2024-09-14T11:08:31.848763+0000","last_unstale":"2024-09-14T13:02:32.320694+0000","last_undegraded":"2024-09-14T13:02:32.320694+0000","last_fullsized":"2024-09-14T13:02:32.320694+0000","mapping_epoch":34,"log_start":"267'200","ondisk_log_start":"267'200","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'214","last_scrub_stamp":"2024-09-14T13:02:32.320468+0000","last_deep_scrub":"267'214","last_deep_scrub_stamp":"2024-09-14T13:02:32.320468+0000","last_clean_scrub_stamp":"2024-09-14T13:02:32.320468+0000","objects_scrubbed":2,"log_size":14,"log_dups_size":200,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:25:03.300420+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":408,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":546,"num_read_kb":516,"num_write":465,"num_write_kb":130,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":66,"num_omap_keys":1,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.6","version":"267'599","reported_seq":2285,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:14.132048+0000","last_change":"2024-09-14T13:02:14.132048+0000","last_active":"2024-09-14T13:02:14.132048+0000","last_peered":"2024-09-14T13:02:14.132048+0000","last_clean":"2024-09-14T13:02:14.132048+0000","last_became_active":"2024-09-14T11:08:23.776564+0000","last_became_peered":"2024-09-14T11:08:23.776564+0000","last_unstale":"2024-09-14T13:02:14.132048+0000","last_undegraded":"2024-09-14T13:02:14.132048+0000","last_fullsized":"2024-09-14T13:02:14.132048+0000","mapping_epoch":26,"log_start":"267'500","ondisk_log_start":"267'500","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'599","last_scrub_stamp":"2024-09-14T13:02:14.131858+0000","last_deep_scrub":"267'599","last_deep_scrub_stamp":"2024-09-14T13:02:14.131858+0000","last_clean_scrub_stamp":"2024-09-14T13:02:14.131858+0000","objects_scrubbed":4,"log_size":99,"log_dups_size":500,"ondisk_log_size":99,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:23:37.462516+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":3171,"num_read_kb":2898,"num_write":783,"num_write_kb":298,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":571,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:08.688687+0000","last_change":"2024-09-14T13:02:08.688687+0000","last_active":"2024-09-14T13:02:08.688687+0000","last_peered":"2024-09-14T13:02:08.688687+0000","last_clean":"2024-09-14T13:02:08.688687+0000","last_became_active":"2024-09-14T11:08:08.903386+0000","last_became_peered":"2024-09-14T11:08:08.903386+0000","last_unstale":"2024-09-14T13:02:08.688687+0000","last_undegraded":"2024-09-14T13:02:08.688687+0000","last_fullsized":"2024-09-14T13:02:08.688687+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T13:02:08.688502+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T13:02:08.688502+0000","last_clean_scrub_stamp":"2024-09-14T13:02:08.688502+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:32:18.880899+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0.001192558,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"267'181","reported_seq":879,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:06.030771+0000","last_change":"2024-09-14T13:02:06.030771+0000","last_active":"2024-09-14T13:02:06.030771+0000","last_peered":"2024-09-14T13:02:06.030771+0000","last_clean":"2024-09-14T13:02:06.030771+0000","last_became_active":"2024-09-14T11:08:21.815453+0000","last_became_peered":"2024-09-14T11:08:21.815453+0000","last_unstale":"2024-09-14T13:02:06.030771+0000","last_undegraded":"2024-09-14T13:02:06.030771+0000","last_fullsized":"2024-09-14T13:02:06.030771+0000","mapping_epoch":24,"log_start":"267'100","ondisk_log_start":"267'100","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'181","last_scrub_stamp":"2024-09-14T13:02:06.030660+0000","last_deep_scrub":"267'181","last_deep_scrub_stamp":"2024-09-14T13:02:06.030660+0000","last_clean_scrub_stamp":"2024-09-14T13:02:06.030660+0000","objects_scrubbed":1,"log_size":81,"log_dups_size":100,"ondisk_log_size":81,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:55:29.313268+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":658,"num_read_kb":79122,"num_write":846,"num_write_kb":40267,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,3],"acting":[0,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":539,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:27.534865+0000","last_change":"2024-09-14T13:02:27.534865+0000","last_active":"2024-09-14T13:02:27.534865+0000","last_peered":"2024-09-14T13:02:27.534865+0000","last_clean":"2024-09-14T13:02:27.534865+0000","last_became_active":"2024-09-14T11:08:25.801580+0000","last_became_peered":"2024-09-14T11:08:25.801580+0000","last_unstale":"2024-09-14T13:02:27.534865+0000","last_undegraded":"2024-09-14T13:02:27.534865+0000","last_fullsized":"2024-09-14T13:02:27.534865+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T13:02:27.534688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T13:02:27.534688+0000","last_clean_scrub_stamp":"2024-09-14T13:02:27.534688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:09:54.498168+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.4","version":"267'1028","reported_seq":3391,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:23.001482+0000","last_change":"2024-09-14T13:02:23.001482+0000","last_active":"2024-09-14T13:02:23.001482+0000","last_peered":"2024-09-14T13:02:23.001482+0000","last_clean":"2024-09-14T13:02:23.001482+0000","last_became_active":"2024-09-14T11:08:27.824703+0000","last_became_peered":"2024-09-14T11:08:27.824703+0000","last_unstale":"2024-09-14T13:02:23.001482+0000","last_undegraded":"2024-09-14T13:02:23.001482+0000","last_fullsized":"2024-09-14T13:02:23.001482+0000","mapping_epoch":30,"log_start":"267'1001","ondisk_log_start":"267'1001","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'1028","last_scrub_stamp":"2024-09-14T13:02:23.001258+0000","last_deep_scrub":"267'1028","last_deep_scrub_stamp":"2024-09-14T13:02:23.001258+0000","last_clean_scrub_stamp":"2024-09-14T13:02:23.001258+0000","objects_scrubbed":12,"log_size":27,"log_dups_size":1001,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:43:35.067903+0000","scrub_duration":19,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":21392,"num_objects":12,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":0,"num_read":1365,"num_read_kb":1481,"num_write":500,"num_write_kb":254,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":6238,"num_omap_keys":18,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":534,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:35.596654+0000","last_change":"2024-09-14T13:02:35.596654+0000","last_active":"2024-09-14T13:02:35.596654+0000","last_peered":"2024-09-14T13:02:35.596654+0000","last_clean":"2024-09-14T13:02:35.596654+0000","last_became_active":"2024-09-14T11:08:29.836253+0000","last_became_peered":"2024-09-14T11:08:29.836253+0000","last_unstale":"2024-09-14T13:02:35.596654+0000","last_undegraded":"2024-09-14T13:02:35.596654+0000","last_fullsized":"2024-09-14T13:02:35.596654+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T13:02:35.596481+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T13:02:35.596481+0000","last_clean_scrub_stamp":"2024-09-14T13:02:35.596481+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:59:40.876249+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.a","version":"267'227","reported_seq":794,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:38.235308+0000","last_change":"2024-09-14T13:02:38.235308+0000","last_active":"2024-09-14T13:02:38.235308+0000","last_peered":"2024-09-14T13:02:38.235308+0000","last_clean":"2024-09-14T13:02:38.235308+0000","last_became_active":"2024-09-14T11:08:31.835700+0000","last_became_peered":"2024-09-14T11:08:31.835700+0000","last_unstale":"2024-09-14T13:02:38.235308+0000","last_undegraded":"2024-09-14T13:02:38.235308+0000","last_fullsized":"2024-09-14T13:02:38.235308+0000","mapping_epoch":34,"log_start":"267'200","ondisk_log_start":"267'200","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'227","last_scrub_stamp":"2024-09-14T13:02:38.235116+0000","last_deep_scrub":"267'227","last_deep_scrub_stamp":"2024-09-14T13:02:38.235116+0000","last_clean_scrub_stamp":"2024-09-14T13:02:38.235116+0000","objects_scrubbed":3,"log_size":27,"log_dups_size":200,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:17:45.413646+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":435,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":369,"num_read_kb":358,"num_write":505,"num_write_kb":147,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"267'416","reported_seq":2043,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:12.147021+0000","last_change":"2024-09-14T13:02:12.146837+0000","last_active":"2024-09-14T13:02:12.147021+0000","last_peered":"2024-09-14T13:02:12.147021+0000","last_clean":"2024-09-14T13:02:12.147021+0000","last_became_active":"2024-09-14T11:09:57.243168+0000","last_became_peered":"2024-09-14T11:09:57.243168+0000","last_unstale":"2024-09-14T13:02:12.147021+0000","last_undegraded":"2024-09-14T13:02:12.147021+0000","last_fullsized":"2024-09-14T13:02:12.147021+0000","mapping_epoch":39,"log_start":"267'400","ondisk_log_start":"267'400","created":26,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'416","last_scrub_stamp":"2024-09-14T13:02:12.146640+0000","last_deep_scrub":"267'416","last_deep_scrub_stamp":"2024-09-14T13:02:12.146640+0000","last_clean_scrub_stamp":"2024-09-14T13:02:12.146640+0000","objects_scrubbed":3,"log_size":16,"log_dups_size":400,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:25:54.329360+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2397,"num_read_kb":2278,"num_write":464,"num_write_kb":90,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":883,"num_omap_keys":4,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":572,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:08.071321+0000","last_change":"2024-09-14T13:02:08.071321+0000","last_active":"2024-09-14T13:02:08.071321+0000","last_peered":"2024-09-14T13:02:08.071321+0000","last_clean":"2024-09-14T13:02:08.071321+0000","last_became_active":"2024-09-14T11:08:08.957848+0000","last_became_peered":"2024-09-14T11:08:08.957848+0000","last_unstale":"2024-09-14T13:02:08.071321+0000","last_undegraded":"2024-09-14T13:02:08.071321+0000","last_fullsized":"2024-09-14T13:02:08.071321+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T13:02:08.071230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T13:02:08.071230+0000","last_clean_scrub_stamp":"2024-09-14T13:02:08.071230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:34:22.543760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001143142,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"267'236","reported_seq":928,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:07.066298+0000","last_change":"2024-09-14T13:02:07.066246+0000","last_active":"2024-09-14T13:02:07.066298+0000","last_peered":"2024-09-14T13:02:07.066298+0000","last_clean":"2024-09-14T13:02:07.066298+0000","last_became_active":"2024-09-14T11:08:21.817523+0000","last_became_peered":"2024-09-14T11:08:21.817523+0000","last_unstale":"2024-09-14T13:02:07.066298+0000","last_undegraded":"2024-09-14T13:02:07.066298+0000","last_fullsized":"2024-09-14T13:02:07.066298+0000","mapping_epoch":24,"log_start":"267'200","ondisk_log_start":"267'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'236","last_scrub_stamp":"2024-09-14T13:02:07.066157+0000","last_deep_scrub":"267'236","last_deep_scrub_stamp":"2024-09-14T13:02:07.066157+0000","last_clean_scrub_stamp":"2024-09-14T13:02:07.066157+0000","objects_scrubbed":3,"log_size":36,"log_dups_size":200,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:24:04.875361+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":52,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":630,"num_read_kb":70142,"num_write":1046,"num_write_kb":36042,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,6],"acting":[1,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.6","version":"267'2","reported_seq":545,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:19.144585+0000","last_change":"2024-09-14T13:02:19.144585+0000","last_active":"2024-09-14T13:02:19.144585+0000","last_peered":"2024-09-14T13:02:19.144585+0000","last_clean":"2024-09-14T13:02:19.144585+0000","last_became_active":"2024-09-14T11:08:25.807070+0000","last_became_peered":"2024-09-14T11:08:25.807070+0000","last_unstale":"2024-09-14T13:02:19.144585+0000","last_undegraded":"2024-09-14T13:02:19.144585+0000","last_fullsized":"2024-09-14T13:02:19.144585+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'2","last_scrub_stamp":"2024-09-14T13:02:19.144401+0000","last_deep_scrub":"267'2","last_deep_scrub_stamp":"2024-09-14T13:02:19.144401+0000","last_clean_scrub_stamp":"2024-09-14T13:02:19.144401+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T00:26:33.317334+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.5","version":"267'411","reported_seq":2381,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:30.546803+0000","last_change":"2024-09-14T13:02:30.546803+0000","last_active":"2024-09-14T13:02:30.546803+0000","last_peered":"2024-09-14T13:02:30.546803+0000","last_clean":"2024-09-14T13:02:30.546803+0000","last_became_active":"2024-09-14T11:08:27.830644+0000","last_became_peered":"2024-09-14T11:08:27.830644+0000","last_unstale":"2024-09-14T13:02:30.546803+0000","last_undegraded":"2024-09-14T13:02:30.546803+0000","last_fullsized":"2024-09-14T13:02:30.546803+0000","mapping_epoch":30,"log_start":"267'400","ondisk_log_start":"267'400","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'411","last_scrub_stamp":"2024-09-14T13:02:30.546604+0000","last_deep_scrub":"267'411","last_deep_scrub_stamp":"2024-09-14T13:02:30.546604+0000","last_clean_scrub_stamp":"2024-09-14T13:02:30.546604+0000","objects_scrubbed":9,"log_size":11,"log_dups_size":400,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:45:11.963366+0000","scrub_duration":19,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":154,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":380,"num_read_kb":368,"num_write":375,"num_write_kb":193,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5824,"num_omap_keys":14,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":538,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:31.076368+0000","last_change":"2024-09-14T13:02:31.076368+0000","last_active":"2024-09-14T13:02:31.076368+0000","last_peered":"2024-09-14T13:02:31.076368+0000","last_clean":"2024-09-14T13:02:31.076368+0000","last_became_active":"2024-09-14T11:08:29.801661+0000","last_became_peered":"2024-09-14T11:08:29.801661+0000","last_unstale":"2024-09-14T13:02:31.076368+0000","last_undegraded":"2024-09-14T13:02:31.076368+0000","last_fullsized":"2024-09-14T13:02:31.076368+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T13:02:31.076190+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T13:02:31.076190+0000","last_clean_scrub_stamp":"2024-09-14T13:02:31.076190+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:11:46.287087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.b","version":"267'251","reported_seq":887,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:39.956026+0000","last_change":"2024-09-14T13:02:39.956026+0000","last_active":"2024-09-14T13:02:39.956026+0000","last_peered":"2024-09-14T13:02:39.956026+0000","last_clean":"2024-09-14T13:02:39.956026+0000","last_became_active":"2024-09-14T11:08:31.841552+0000","last_became_peered":"2024-09-14T11:08:31.841552+0000","last_unstale":"2024-09-14T13:02:39.956026+0000","last_undegraded":"2024-09-14T13:02:39.956026+0000","last_fullsized":"2024-09-14T13:02:39.956026+0000","mapping_epoch":34,"log_start":"267'200","ondisk_log_start":"267'200","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'251","last_scrub_stamp":"2024-09-14T13:02:39.955851+0000","last_deep_scrub":"267'251","last_deep_scrub_stamp":"2024-09-14T13:02:39.955851+0000","last_clean_scrub_stamp":"2024-09-14T13:02:39.955851+0000","objects_scrubbed":3,"log_size":51,"log_dups_size":200,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:52:44.174304+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":202,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":474,"num_read_kb":499,"num_write":548,"num_write_kb":158,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1193,"num_omap_keys":7,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"267'1115","reported_seq":2648,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:11.020600+0000","last_change":"2024-09-14T13:02:11.020600+0000","last_active":"2024-09-14T13:02:11.020600+0000","last_peered":"2024-09-14T13:02:11.020600+0000","last_clean":"2024-09-14T13:02:11.020600+0000","last_became_active":"2024-09-14T11:08:23.777511+0000","last_became_peered":"2024-09-14T11:08:23.777511+0000","last_unstale":"2024-09-14T13:02:11.020600+0000","last_undegraded":"2024-09-14T13:02:11.020600+0000","last_fullsized":"2024-09-14T13:02:11.020600+0000","mapping_epoch":26,"log_start":"267'1100","ondisk_log_start":"267'1100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'1115","last_scrub_stamp":"2024-09-14T13:02:11.020381+0000","last_deep_scrub":"267'1115","last_deep_scrub_stamp":"2024-09-14T13:02:11.020381+0000","last_clean_scrub_stamp":"2024-09-14T13:02:11.020381+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":1100,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:18:14.256119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5086,"num_read_kb":4484,"num_write":1533,"num_write_kb":642,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"267'3","reported_seq":571,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:07.256502+0000","last_change":"2024-09-14T13:02:07.256502+0000","last_active":"2024-09-14T13:02:07.256502+0000","last_peered":"2024-09-14T13:02:07.256502+0000","last_clean":"2024-09-14T13:02:07.256502+0000","last_became_active":"2024-09-14T11:08:08.903062+0000","last_became_peered":"2024-09-14T11:08:08.903062+0000","last_unstale":"2024-09-14T13:02:07.256502+0000","last_undegraded":"2024-09-14T13:02:07.256502+0000","last_fullsized":"2024-09-14T13:02:07.256502+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'3","last_scrub_stamp":"2024-09-14T13:02:07.256289+0000","last_deep_scrub":"267'3","last_deep_scrub_stamp":"2024-09-14T13:02:07.256289+0000","last_clean_scrub_stamp":"2024-09-14T13:02:07.256289+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:37:50.637115+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0.0022728420000000002,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"267'181","reported_seq":876,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:06.906936+0000","last_change":"2024-09-14T13:02:06.906936+0000","last_active":"2024-09-14T13:02:06.906936+0000","last_peered":"2024-09-14T13:02:06.906936+0000","last_clean":"2024-09-14T13:02:06.906936+0000","last_became_active":"2024-09-14T11:08:21.823121+0000","last_became_peered":"2024-09-14T11:08:21.823121+0000","last_unstale":"2024-09-14T13:02:06.906936+0000","last_undegraded":"2024-09-14T13:02:06.906936+0000","last_fullsized":"2024-09-14T13:02:06.906936+0000","mapping_epoch":24,"log_start":"267'100","ondisk_log_start":"267'100","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'181","last_scrub_stamp":"2024-09-14T13:02:06.906725+0000","last_deep_scrub":"267'181","last_deep_scrub_stamp":"2024-09-14T13:02:06.906725+0000","last_clean_scrub_stamp":"2024-09-14T13:02:06.906725+0000","objects_scrubbed":2,"log_size":81,"log_dups_size":100,"ondisk_log_size":81,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:55:40.720442+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":28,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":557,"num_read_kb":32204,"num_write":881,"num_write_kb":26671,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,0],"acting":[4,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":546,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:18.094637+0000","last_change":"2024-09-14T13:02:18.094637+0000","last_active":"2024-09-14T13:02:18.094637+0000","last_peered":"2024-09-14T13:02:18.094637+0000","last_clean":"2024-09-14T13:02:18.094637+0000","last_became_active":"2024-09-14T11:08:25.796526+0000","last_became_peered":"2024-09-14T11:08:25.796526+0000","last_unstale":"2024-09-14T13:02:18.094637+0000","last_undegraded":"2024-09-14T13:02:18.094637+0000","last_fullsized":"2024-09-14T13:02:18.094637+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T13:02:18.094441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T13:02:18.094441+0000","last_clean_scrub_stamp":"2024-09-14T13:02:18.094441+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T00:51:13.768814+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.6","version":"267'241","reported_seq":864,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:24.003583+0000","last_change":"2024-09-14T13:02:24.003583+0000","last_active":"2024-09-14T13:02:24.003583+0000","last_peered":"2024-09-14T13:02:24.003583+0000","last_clean":"2024-09-14T13:02:24.003583+0000","last_became_active":"2024-09-14T11:08:27.818482+0000","last_became_peered":"2024-09-14T11:08:27.818482+0000","last_unstale":"2024-09-14T13:02:24.003583+0000","last_undegraded":"2024-09-14T13:02:24.003583+0000","last_fullsized":"2024-09-14T13:02:24.003583+0000","mapping_epoch":30,"log_start":"267'200","ondisk_log_start":"267'200","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'241","last_scrub_stamp":"2024-09-14T13:02:24.003387+0000","last_deep_scrub":"267'241","last_deep_scrub_stamp":"2024-09-14T13:02:24.003387+0000","last_clean_scrub_stamp":"2024-09-14T13:02:24.003387+0000","objects_scrubbed":7,"log_size":41,"log_dups_size":200,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:56:28.318209+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":286,"num_read_kb":275,"num_write":214,"num_write_kb":24,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":3226,"num_omap_keys":10,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":530,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:24.378960+0000","last_change":"2024-09-14T13:02:24.378960+0000","last_active":"2024-09-14T13:02:24.378960+0000","last_peered":"2024-09-14T13:02:24.378960+0000","last_clean":"2024-09-14T13:02:24.378960+0000","last_became_active":"2024-09-14T11:08:29.837840+0000","last_became_peered":"2024-09-14T11:08:29.837840+0000","last_unstale":"2024-09-14T13:02:24.378960+0000","last_undegraded":"2024-09-14T13:02:24.378960+0000","last_fullsized":"2024-09-14T13:02:24.378960+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T13:02:24.378768+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T13:02:24.378768+0000","last_clean_scrub_stamp":"2024-09-14T13:02:24.378768+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:57:41.664294+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.8","version":"267'111","reported_seq":695,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:40.468627+0000","last_change":"2024-09-14T13:02:40.468627+0000","last_active":"2024-09-14T13:02:40.468627+0000","last_peered":"2024-09-14T13:02:40.468627+0000","last_clean":"2024-09-14T13:02:40.468627+0000","last_became_active":"2024-09-14T11:08:31.851269+0000","last_became_peered":"2024-09-14T11:08:31.851269+0000","last_unstale":"2024-09-14T13:02:40.468627+0000","last_undegraded":"2024-09-14T13:02:40.468627+0000","last_fullsized":"2024-09-14T13:02:40.468627+0000","mapping_epoch":34,"log_start":"267'100","ondisk_log_start":"267'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'111","last_scrub_stamp":"2024-09-14T13:02:40.468437+0000","last_deep_scrub":"267'111","last_deep_scrub_stamp":"2024-09-14T13:02:40.468437+0000","last_clean_scrub_stamp":"2024-09-14T13:02:40.468437+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":100,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:28:52.613811+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":188,"num_read_kb":187,"num_write":249,"num_write_kb":58,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"267'520","reported_seq":2239,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:12.995460+0000","last_change":"2024-09-14T13:02:12.995460+0000","last_active":"2024-09-14T13:02:12.995460+0000","last_peered":"2024-09-14T13:02:12.995460+0000","last_clean":"2024-09-14T13:02:12.995460+0000","last_became_active":"2024-09-14T11:08:23.793860+0000","last_became_peered":"2024-09-14T11:08:23.793860+0000","last_unstale":"2024-09-14T13:02:12.995460+0000","last_undegraded":"2024-09-14T13:02:12.995460+0000","last_fullsized":"2024-09-14T13:02:12.995460+0000","mapping_epoch":26,"log_start":"267'500","ondisk_log_start":"267'500","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'520","last_scrub_stamp":"2024-09-14T13:02:12.995266+0000","last_deep_scrub":"267'520","last_deep_scrub_stamp":"2024-09-14T13:02:12.995266+0000","last_clean_scrub_stamp":"2024-09-14T13:02:12.995266+0000","objects_scrubbed":3,"log_size":20,"log_dups_size":500,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:38:13.362386+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3013,"num_read_kb":2819,"num_write":641,"num_write_kb":178,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2808,"num_omap_keys":11,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"267'200","reported_seq":887,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:09.308300+0000","last_change":"2024-09-14T13:02:09.308300+0000","last_active":"2024-09-14T13:02:09.308300+0000","last_peered":"2024-09-14T13:02:09.308300+0000","last_clean":"2024-09-14T13:02:09.308300+0000","last_became_active":"2024-09-14T11:08:21.791679+0000","last_became_peered":"2024-09-14T11:08:21.791679+0000","last_unstale":"2024-09-14T13:02:09.308300+0000","last_undegraded":"2024-09-14T13:02:09.308300+0000","last_fullsized":"2024-09-14T13:02:09.308300+0000","mapping_epoch":24,"log_start":"267'100","ondisk_log_start":"267'100","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'200","last_scrub_stamp":"2024-09-14T13:02:09.308096+0000","last_deep_scrub":"267'200","last_deep_scrub_stamp":"2024-09-14T13:02:09.308096+0000","last_clean_scrub_stamp":"2024-09-14T13:02:09.308096+0000","objects_scrubbed":2,"log_size":100,"log_dups_size":100,"ondisk_log_size":100,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:28:27.126433+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":15,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":647,"num_read_kb":55282,"num_write":902,"num_write_kb":39262,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,2],"acting":[5,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":566,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:06.063313+0000","last_change":"2024-09-14T13:02:06.063313+0000","last_active":"2024-09-14T13:02:06.063313+0000","last_peered":"2024-09-14T13:02:06.063313+0000","last_clean":"2024-09-14T13:02:06.063313+0000","last_became_active":"2024-09-14T11:08:08.888921+0000","last_became_peered":"2024-09-14T11:08:08.888921+0000","last_unstale":"2024-09-14T13:02:06.063313+0000","last_undegraded":"2024-09-14T13:02:06.063313+0000","last_fullsized":"2024-09-14T13:02:06.063313+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T13:02:06.063225+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T13:02:06.063225+0000","last_clean_scrub_stamp":"2024-09-14T13:02:06.063225+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:03:25.698483+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001198714,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":546,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:24.000791+0000","last_change":"2024-09-14T13:02:24.000791+0000","last_active":"2024-09-14T13:02:24.000791+0000","last_peered":"2024-09-14T13:02:24.000791+0000","last_clean":"2024-09-14T13:02:24.000791+0000","last_became_active":"2024-09-14T11:08:25.792863+0000","last_became_peered":"2024-09-14T11:08:25.792863+0000","last_unstale":"2024-09-14T13:02:24.000791+0000","last_undegraded":"2024-09-14T13:02:24.000791+0000","last_fullsized":"2024-09-14T13:02:24.000791+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T13:02:24.000552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T13:02:24.000552+0000","last_clean_scrub_stamp":"2024-09-14T13:02:24.000552+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:23:29.987674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"267'470","reported_seq":1225,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:16.091681+0000","last_change":"2024-09-14T13:02:16.091681+0000","last_active":"2024-09-14T13:02:16.091681+0000","last_peered":"2024-09-14T13:02:16.091681+0000","last_clean":"2024-09-14T13:02:16.091681+0000","last_became_active":"2024-09-14T11:08:27.803324+0000","last_became_peered":"2024-09-14T11:08:27.803324+0000","last_unstale":"2024-09-14T13:02:16.091681+0000","last_undegraded":"2024-09-14T13:02:16.091681+0000","last_fullsized":"2024-09-14T13:02:16.091681+0000","mapping_epoch":30,"log_start":"267'400","ondisk_log_start":"267'400","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'470","last_scrub_stamp":"2024-09-14T13:02:16.091442+0000","last_deep_scrub":"267'470","last_deep_scrub_stamp":"2024-09-14T13:02:16.091442+0000","last_clean_scrub_stamp":"2024-09-14T13:02:16.091442+0000","objects_scrubbed":10,"log_size":70,"log_dups_size":400,"ondisk_log_size":70,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T00:12:22.033953+0000","scrub_duration":31,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19948,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":1305,"num_read_kb":1473,"num_write":1890,"num_write_kb":1660,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":530760,"num_omap_keys":1200,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":535,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:34.718365+0000","last_change":"2024-09-14T13:02:34.718365+0000","last_active":"2024-09-14T13:02:34.718365+0000","last_peered":"2024-09-14T13:02:34.718365+0000","last_clean":"2024-09-14T13:02:34.718365+0000","last_became_active":"2024-09-14T11:08:29.830303+0000","last_became_peered":"2024-09-14T11:08:29.830303+0000","last_unstale":"2024-09-14T13:02:34.718365+0000","last_undegraded":"2024-09-14T13:02:34.718365+0000","last_fullsized":"2024-09-14T13:02:34.718365+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T13:02:34.718186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T13:02:34.718186+0000","last_clean_scrub_stamp":"2024-09-14T13:02:34.718186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:31:11.098882+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.e","version":"267'157","reported_seq":729,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:41.232470+0000","last_change":"2024-09-14T13:02:41.232470+0000","last_active":"2024-09-14T13:02:41.232470+0000","last_peered":"2024-09-14T13:02:41.232470+0000","last_clean":"2024-09-14T13:02:41.232470+0000","last_became_active":"2024-09-14T11:08:31.835335+0000","last_became_peered":"2024-09-14T11:08:31.835335+0000","last_unstale":"2024-09-14T13:02:41.232470+0000","last_undegraded":"2024-09-14T13:02:41.232470+0000","last_fullsized":"2024-09-14T13:02:41.232470+0000","mapping_epoch":34,"log_start":"267'100","ondisk_log_start":"267'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'157","last_scrub_stamp":"2024-09-14T13:02:41.232278+0000","last_deep_scrub":"267'157","last_deep_scrub_stamp":"2024-09-14T13:02:41.232278+0000","last_clean_scrub_stamp":"2024-09-14T13:02:41.232278+0000","objects_scrubbed":4,"log_size":57,"log_dups_size":100,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:37:03.058519+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":736,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":226,"num_read_kb":194,"num_write":381,"num_write_kb":93,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"267'738","reported_seq":2294,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:15.091975+0000","last_change":"2024-09-14T13:02:15.091975+0000","last_active":"2024-09-14T13:02:15.091975+0000","last_peered":"2024-09-14T13:02:15.091975+0000","last_clean":"2024-09-14T13:02:15.091975+0000","last_became_active":"2024-09-14T11:08:23.792144+0000","last_became_peered":"2024-09-14T11:08:23.792144+0000","last_unstale":"2024-09-14T13:02:15.091975+0000","last_undegraded":"2024-09-14T13:02:15.091975+0000","last_fullsized":"2024-09-14T13:02:15.091975+0000","mapping_epoch":26,"log_start":"267'700","ondisk_log_start":"267'700","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'738","last_scrub_stamp":"2024-09-14T13:02:15.091782+0000","last_deep_scrub":"267'738","last_deep_scrub_stamp":"2024-09-14T13:02:15.091782+0000","last_clean_scrub_stamp":"2024-09-14T13:02:15.091782+0000","objects_scrubbed":4,"log_size":38,"log_dups_size":700,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:17:17.576090+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":3573,"num_read_kb":3234,"num_write":954,"num_write_kb":344,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":441,"num_omap_keys":2,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.4","version":"267'263","reported_seq":989,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:09.032643+0000","last_change":"2024-09-14T13:02:09.032643+0000","last_active":"2024-09-14T13:02:09.032643+0000","last_peered":"2024-09-14T13:02:09.032643+0000","last_clean":"2024-09-14T13:02:09.032643+0000","last_became_active":"2024-09-14T11:08:21.808278+0000","last_became_peered":"2024-09-14T11:08:21.808278+0000","last_unstale":"2024-09-14T13:02:09.032643+0000","last_undegraded":"2024-09-14T13:02:09.032643+0000","last_fullsized":"2024-09-14T13:02:09.032643+0000","mapping_epoch":24,"log_start":"267'200","ondisk_log_start":"267'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'263","last_scrub_stamp":"2024-09-14T13:02:09.032409+0000","last_deep_scrub":"267'263","last_deep_scrub_stamp":"2024-09-14T13:02:09.032409+0000","last_clean_scrub_stamp":"2024-09-14T13:02:09.032409+0000","objects_scrubbed":7,"log_size":63,"log_dups_size":200,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:47:10.565844+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":105,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":853,"num_read_kb":29781,"num_write":1322,"num_write_kb":30049,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,6],"acting":[1,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":569,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:11.672021+0000","last_change":"2024-09-14T13:02:11.672021+0000","last_active":"2024-09-14T13:02:11.672021+0000","last_peered":"2024-09-14T13:02:11.672021+0000","last_clean":"2024-09-14T13:02:11.672021+0000","last_became_active":"2024-09-14T11:08:08.903905+0000","last_became_peered":"2024-09-14T11:08:08.903905+0000","last_unstale":"2024-09-14T13:02:11.672021+0000","last_undegraded":"2024-09-14T13:02:11.672021+0000","last_fullsized":"2024-09-14T13:02:11.672021+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T13:02:11.671824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T13:02:11.671824+0000","last_clean_scrub_stamp":"2024-09-14T13:02:11.671824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:19:51.277720+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0.001173377,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":540,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:21.282349+0000","last_change":"2024-09-14T13:02:21.282349+0000","last_active":"2024-09-14T13:02:21.282349+0000","last_peered":"2024-09-14T13:02:21.282349+0000","last_clean":"2024-09-14T13:02:21.282349+0000","last_became_active":"2024-09-14T11:08:25.800695+0000","last_became_peered":"2024-09-14T11:08:25.800695+0000","last_unstale":"2024-09-14T13:02:21.282349+0000","last_undegraded":"2024-09-14T13:02:21.282349+0000","last_fullsized":"2024-09-14T13:02:21.282349+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T13:02:21.282162+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T13:02:21.282162+0000","last_clean_scrub_stamp":"2024-09-14T13:02:21.282162+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:49:39.366357+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1","version":"267'358","reported_seq":1009,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:27.127023+0000","last_change":"2024-09-14T13:02:27.127023+0000","last_active":"2024-09-14T13:02:27.127023+0000","last_peered":"2024-09-14T13:02:27.127023+0000","last_clean":"2024-09-14T13:02:27.127023+0000","last_became_active":"2024-09-14T11:08:27.813857+0000","last_became_peered":"2024-09-14T11:08:27.813857+0000","last_unstale":"2024-09-14T13:02:27.127023+0000","last_undegraded":"2024-09-14T13:02:27.127023+0000","last_fullsized":"2024-09-14T13:02:27.127023+0000","mapping_epoch":30,"log_start":"267'300","ondisk_log_start":"267'300","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'358","last_scrub_stamp":"2024-09-14T13:02:27.126798+0000","last_deep_scrub":"267'358","last_deep_scrub_stamp":"2024-09-14T13:02:27.126798+0000","last_clean_scrub_stamp":"2024-09-14T13:02:27.126798+0000","objects_scrubbed":8,"log_size":58,"log_dups_size":300,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:15:05.419456+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":441,"num_read_kb":434,"num_write":426,"num_write_kb":202,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":6602,"num_omap_keys":16,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.0","version":"267'781","reported_seq":5207,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:37.362504+0000","last_change":"2024-09-14T13:02:37.362504+0000","last_active":"2024-09-14T13:02:37.362504+0000","last_peered":"2024-09-14T13:02:37.362504+0000","last_clean":"2024-09-14T13:02:37.362504+0000","last_became_active":"2024-09-14T11:08:29.823513+0000","last_became_peered":"2024-09-14T11:08:29.823513+0000","last_unstale":"2024-09-14T13:02:37.362504+0000","last_undegraded":"2024-09-14T13:02:37.362504+0000","last_fullsized":"2024-09-14T13:02:37.362504+0000","mapping_epoch":32,"log_start":"267'700","ondisk_log_start":"267'700","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'781","last_scrub_stamp":"2024-09-14T13:02:37.362321+0000","last_deep_scrub":"267'781","last_deep_scrub_stamp":"2024-09-14T13:02:37.362321+0000","last_clean_scrub_stamp":"2024-09-14T13:02:37.362321+0000","objects_scrubbed":1,"log_size":81,"log_dups_size":700,"ondisk_log_size":81,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T00:17:52.989734+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.f","version":"267'153","reported_seq":715,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:40.956648+0000","last_change":"2024-09-14T13:02:40.956648+0000","last_active":"2024-09-14T13:02:40.956648+0000","last_peered":"2024-09-14T13:02:40.956648+0000","last_clean":"2024-09-14T13:02:40.956648+0000","last_became_active":"2024-09-14T11:08:31.825708+0000","last_became_peered":"2024-09-14T11:08:31.825708+0000","last_unstale":"2024-09-14T13:02:40.956648+0000","last_undegraded":"2024-09-14T13:02:40.956648+0000","last_fullsized":"2024-09-14T13:02:40.956648+0000","mapping_epoch":34,"log_start":"267'100","ondisk_log_start":"267'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'153","last_scrub_stamp":"2024-09-14T13:02:40.956472+0000","last_deep_scrub":"267'153","last_deep_scrub_stamp":"2024-09-14T13:02:40.956472+0000","last_clean_scrub_stamp":"2024-09-14T13:02:40.956472+0000","objects_scrubbed":5,"log_size":53,"log_dups_size":100,"ondisk_log_size":53,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:50:35.738734+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1096,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":219,"num_read_kb":197,"num_write":351,"num_write_kb":86,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":64,"num_omap_keys":1,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"267'1023","reported_seq":2916,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:14.881529+0000","last_change":"2024-09-14T13:02:14.881529+0000","last_active":"2024-09-14T13:02:14.881529+0000","last_peered":"2024-09-14T13:02:14.881529+0000","last_clean":"2024-09-14T13:02:14.881529+0000","last_became_active":"2024-09-14T11:08:23.800388+0000","last_became_peered":"2024-09-14T11:08:23.800388+0000","last_unstale":"2024-09-14T13:02:14.881529+0000","last_undegraded":"2024-09-14T13:02:14.881529+0000","last_fullsized":"2024-09-14T13:02:14.881529+0000","mapping_epoch":26,"log_start":"267'1000","ondisk_log_start":"267'1000","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'1023","last_scrub_stamp":"2024-09-14T13:02:14.881346+0000","last_deep_scrub":"267'1023","last_deep_scrub_stamp":"2024-09-14T13:02:14.881346+0000","last_clean_scrub_stamp":"2024-09-14T13:02:14.881346+0000","objects_scrubbed":2,"log_size":23,"log_dups_size":1000,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:35:05.542600+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":5094,"num_read_kb":4556,"num_write":1418,"num_write_kb":544,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2806,"num_omap_keys":11,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.7","version":"267'189","reported_seq":839,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:06.990334+0000","last_change":"2024-09-14T13:02:06.990334+0000","last_active":"2024-09-14T13:02:06.990334+0000","last_peered":"2024-09-14T13:02:06.990334+0000","last_clean":"2024-09-14T13:02:06.990334+0000","last_became_active":"2024-09-14T11:08:21.797297+0000","last_became_peered":"2024-09-14T11:08:21.797297+0000","last_unstale":"2024-09-14T13:02:06.990334+0000","last_undegraded":"2024-09-14T13:02:06.990334+0000","last_fullsized":"2024-09-14T13:02:06.990334+0000","mapping_epoch":24,"log_start":"267'100","ondisk_log_start":"267'100","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'189","last_scrub_stamp":"2024-09-14T13:02:06.990223+0000","last_deep_scrub":"267'189","last_deep_scrub_stamp":"2024-09-14T13:02:06.990223+0000","last_clean_scrub_stamp":"2024-09-14T13:02:06.990223+0000","objects_scrubbed":5,"log_size":89,"log_dups_size":100,"ondisk_log_size":89,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:27:43.594579+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1655854,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":473,"num_read_kb":20434,"num_write":854,"num_write_kb":40195,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,7],"acting":[3,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":564,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:05.019695+0000","last_change":"2024-09-14T13:02:05.019695+0000","last_active":"2024-09-14T13:02:05.019695+0000","last_peered":"2024-09-14T13:02:05.019695+0000","last_clean":"2024-09-14T13:02:05.019695+0000","last_became_active":"2024-09-14T11:08:08.891458+0000","last_became_peered":"2024-09-14T11:08:08.891458+0000","last_unstale":"2024-09-14T13:02:05.019695+0000","last_undegraded":"2024-09-14T13:02:05.019695+0000","last_fullsized":"2024-09-14T13:02:05.019695+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T13:02:05.019605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T13:02:05.019605+0000","last_clean_scrub_stamp":"2024-09-14T13:02:05.019605+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:50:14.780273+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0011468940000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":543,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:25.681456+0000","last_change":"2024-09-14T13:02:25.681456+0000","last_active":"2024-09-14T13:02:25.681456+0000","last_peered":"2024-09-14T13:02:25.681456+0000","last_clean":"2024-09-14T13:02:25.681456+0000","last_became_active":"2024-09-14T11:08:25.807555+0000","last_became_peered":"2024-09-14T11:08:25.807555+0000","last_unstale":"2024-09-14T13:02:25.681456+0000","last_undegraded":"2024-09-14T13:02:25.681456+0000","last_fullsized":"2024-09-14T13:02:25.681456+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T13:02:25.681260+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T13:02:25.681260+0000","last_clean_scrub_stamp":"2024-09-14T13:02:25.681260+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:22:04.765928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.2","version":"267'177","reported_seq":792,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:30.668256+0000","last_change":"2024-09-14T13:02:30.668256+0000","last_active":"2024-09-14T13:02:30.668256+0000","last_peered":"2024-09-14T13:02:30.668256+0000","last_clean":"2024-09-14T13:02:30.668256+0000","last_became_active":"2024-09-14T11:08:27.825292+0000","last_became_peered":"2024-09-14T11:08:27.825292+0000","last_unstale":"2024-09-14T13:02:30.668256+0000","last_undegraded":"2024-09-14T13:02:30.668256+0000","last_fullsized":"2024-09-14T13:02:30.668256+0000","mapping_epoch":30,"log_start":"267'100","ondisk_log_start":"267'100","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'177","last_scrub_stamp":"2024-09-14T13:02:30.668074+0000","last_deep_scrub":"267'177","last_deep_scrub_stamp":"2024-09-14T13:02:30.668074+0000","last_clean_scrub_stamp":"2024-09-14T13:02:30.668074+0000","objects_scrubbed":5,"log_size":77,"log_dups_size":100,"ondisk_log_size":77,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:14:57.106472+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":226,"num_read_kb":221,"num_write":150,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.3","version":"267'816","reported_seq":5543,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:33.937947+0000","last_change":"2024-09-14T13:02:33.937947+0000","last_active":"2024-09-14T13:02:33.937947+0000","last_peered":"2024-09-14T13:02:33.937947+0000","last_clean":"2024-09-14T13:02:33.937947+0000","last_became_active":"2024-09-14T11:08:29.824268+0000","last_became_peered":"2024-09-14T11:08:29.824268+0000","last_unstale":"2024-09-14T13:02:33.937947+0000","last_undegraded":"2024-09-14T13:02:33.937947+0000","last_fullsized":"2024-09-14T13:02:33.937947+0000","mapping_epoch":32,"log_start":"267'801","ondisk_log_start":"267'801","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'816","last_scrub_stamp":"2024-09-14T13:02:33.937760+0000","last_deep_scrub":"267'816","last_deep_scrub_stamp":"2024-09-14T13:02:33.937760+0000","last_clean_scrub_stamp":"2024-09-14T13:02:33.937760+0000","objects_scrubbed":1,"log_size":15,"log_dups_size":801,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:58:03.653512+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.c","version":"267'180","reported_seq":737,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:38.228762+0000","last_change":"2024-09-14T13:02:38.228762+0000","last_active":"2024-09-14T13:02:38.228762+0000","last_peered":"2024-09-14T13:02:38.228762+0000","last_clean":"2024-09-14T13:02:38.228762+0000","last_became_active":"2024-09-14T11:08:31.844329+0000","last_became_peered":"2024-09-14T11:08:31.844329+0000","last_unstale":"2024-09-14T13:02:38.228762+0000","last_undegraded":"2024-09-14T13:02:38.228762+0000","last_fullsized":"2024-09-14T13:02:38.228762+0000","mapping_epoch":34,"log_start":"267'100","ondisk_log_start":"267'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'180","last_scrub_stamp":"2024-09-14T13:02:38.228582+0000","last_deep_scrub":"267'180","last_deep_scrub_stamp":"2024-09-14T13:02:38.228582+0000","last_clean_scrub_stamp":"2024-09-14T13:02:38.228582+0000","objects_scrubbed":3,"log_size":80,"log_dups_size":100,"ondisk_log_size":80,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:27:17.206372+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":58,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":178,"num_read_kb":162,"num_write":419,"num_write_kb":126,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"267'735","reported_seq":2215,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:09.815280+0000","last_change":"2024-09-14T13:02:09.815280+0000","last_active":"2024-09-14T13:02:09.815280+0000","last_peered":"2024-09-14T13:02:09.815280+0000","last_clean":"2024-09-14T13:02:09.815280+0000","last_became_active":"2024-09-14T11:08:23.800918+0000","last_became_peered":"2024-09-14T11:08:23.800918+0000","last_unstale":"2024-09-14T13:02:09.815280+0000","last_undegraded":"2024-09-14T13:02:09.815280+0000","last_fullsized":"2024-09-14T13:02:09.815280+0000","mapping_epoch":26,"log_start":"267'700","ondisk_log_start":"267'700","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'735","last_scrub_stamp":"2024-09-14T13:02:09.814990+0000","last_deep_scrub":"267'735","last_deep_scrub_stamp":"2024-09-14T13:02:09.814990+0000","last_clean_scrub_stamp":"2024-09-14T13:02:09.814990+0000","objects_scrubbed":3,"log_size":35,"log_dups_size":700,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:05:22.080738+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3552,"num_read_kb":3200,"num_write":979,"num_write_kb":380,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":486,"num_omap_keys":2,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"267'264","reported_seq":972,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:06.104313+0000","last_change":"2024-09-14T13:02:06.104313+0000","last_active":"2024-09-14T13:02:06.104313+0000","last_peered":"2024-09-14T13:02:06.104313+0000","last_clean":"2024-09-14T13:02:06.104313+0000","last_became_active":"2024-09-14T11:08:56.034426+0000","last_became_peered":"2024-09-14T11:08:56.034426+0000","last_unstale":"2024-09-14T13:02:06.104313+0000","last_undegraded":"2024-09-14T13:02:06.104313+0000","last_fullsized":"2024-09-14T13:02:06.104313+0000","mapping_epoch":37,"log_start":"267'200","ondisk_log_start":"267'200","created":24,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'264","last_scrub_stamp":"2024-09-14T13:02:06.104156+0000","last_deep_scrub":"267'264","last_deep_scrub_stamp":"2024-09-14T13:02:06.104156+0000","last_clean_scrub_stamp":"2024-09-14T13:02:06.104156+0000","objects_scrubbed":7,"log_size":64,"log_dups_size":200,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:07:23.324457+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3311697,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":736,"num_read_kb":100890,"num_write":1101,"num_write_kb":33821,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,4],"acting":[2,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":565,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:08.216964+0000","last_change":"2024-09-14T13:02:08.216964+0000","last_active":"2024-09-14T13:02:08.216964+0000","last_peered":"2024-09-14T13:02:08.216964+0000","last_clean":"2024-09-14T13:02:08.216964+0000","last_became_active":"2024-09-14T11:08:08.905736+0000","last_became_peered":"2024-09-14T11:08:08.905736+0000","last_unstale":"2024-09-14T13:02:08.216964+0000","last_undegraded":"2024-09-14T13:02:08.216964+0000","last_fullsized":"2024-09-14T13:02:08.216964+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T13:02:08.216677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T13:02:08.216677+0000","last_clean_scrub_stamp":"2024-09-14T13:02:08.216677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:51:29.945091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0012835290000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":543,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:25.925119+0000","last_change":"2024-09-14T13:02:25.925119+0000","last_active":"2024-09-14T13:02:25.925119+0000","last_peered":"2024-09-14T13:02:25.925119+0000","last_clean":"2024-09-14T13:02:25.925119+0000","last_became_active":"2024-09-14T11:08:25.801554+0000","last_became_peered":"2024-09-14T11:08:25.801554+0000","last_unstale":"2024-09-14T13:02:25.925119+0000","last_undegraded":"2024-09-14T13:02:25.925119+0000","last_fullsized":"2024-09-14T13:02:25.925119+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T13:02:25.924863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T13:02:25.924863+0000","last_clean_scrub_stamp":"2024-09-14T13:02:25.924863+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T00:42:52.335794+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"267'409","reported_seq":1206,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:29.567953+0000","last_change":"2024-09-14T13:02:29.567953+0000","last_active":"2024-09-14T13:02:29.567953+0000","last_peered":"2024-09-14T13:02:29.567953+0000","last_clean":"2024-09-14T13:02:29.567953+0000","last_became_active":"2024-09-14T11:08:27.831653+0000","last_became_peered":"2024-09-14T11:08:27.831653+0000","last_unstale":"2024-09-14T13:02:29.567953+0000","last_undegraded":"2024-09-14T13:02:29.567953+0000","last_fullsized":"2024-09-14T13:02:29.567953+0000","mapping_epoch":30,"log_start":"267'300","ondisk_log_start":"267'300","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'409","last_scrub_stamp":"2024-09-14T13:02:29.567699+0000","last_deep_scrub":"267'409","last_deep_scrub_stamp":"2024-09-14T13:02:29.567699+0000","last_clean_scrub_stamp":"2024-09-14T13:02:29.567699+0000","objects_scrubbed":8,"log_size":109,"log_dups_size":300,"ondisk_log_size":109,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:06:18.264597+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":31170,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":610,"num_read_kb":890,"num_write":340,"num_write_kb":94,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":533,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:36.969400+0000","last_change":"2024-09-14T13:02:36.969400+0000","last_active":"2024-09-14T13:02:36.969400+0000","last_peered":"2024-09-14T13:02:36.969400+0000","last_clean":"2024-09-14T13:02:36.969400+0000","last_became_active":"2024-09-14T11:08:29.825186+0000","last_became_peered":"2024-09-14T11:08:29.825186+0000","last_unstale":"2024-09-14T13:02:36.969400+0000","last_undegraded":"2024-09-14T13:02:36.969400+0000","last_fullsized":"2024-09-14T13:02:36.969400+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T13:02:36.969177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T13:02:36.969177+0000","last_clean_scrub_stamp":"2024-09-14T13:02:36.969177+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:08:28.903024+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.d","version":"267'140","reported_seq":673,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:41.427667+0000","last_change":"2024-09-14T13:02:41.427667+0000","last_active":"2024-09-14T13:02:41.427667+0000","last_peered":"2024-09-14T13:02:41.427667+0000","last_clean":"2024-09-14T13:02:41.427667+0000","last_became_active":"2024-09-14T11:08:31.837649+0000","last_became_peered":"2024-09-14T11:08:31.837649+0000","last_unstale":"2024-09-14T13:02:41.427667+0000","last_undegraded":"2024-09-14T13:02:41.427667+0000","last_fullsized":"2024-09-14T13:02:41.427667+0000","mapping_epoch":34,"log_start":"267'100","ondisk_log_start":"267'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'140","last_scrub_stamp":"2024-09-14T13:02:41.427470+0000","last_deep_scrub":"267'140","last_deep_scrub_stamp":"2024-09-14T13:02:41.427470+0000","last_clean_scrub_stamp":"2024-09-14T13:02:41.427470+0000","objects_scrubbed":2,"log_size":40,"log_dups_size":100,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:26:46.091468+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":204,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":124,"num_read_kb":124,"num_write":321,"num_write_kb":75,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.1f","version":"267'141","reported_seq":733,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:00:21.741622+0000","last_change":"2024-09-14T11:08:31.854083+0000","last_active":"2024-09-14T13:00:21.741622+0000","last_peered":"2024-09-14T13:00:21.741622+0000","last_clean":"2024-09-14T13:00:21.741622+0000","last_became_active":"2024-09-14T11:08:31.849681+0000","last_became_peered":"2024-09-14T11:08:31.849681+0000","last_unstale":"2024-09-14T13:00:21.741622+0000","last_undegraded":"2024-09-14T13:00:21.741622+0000","last_fullsized":"2024-09-14T13:00:21.741622+0000","mapping_epoch":34,"log_start":"267'100","ondisk_log_start":"267'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:08:30.789404+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:08:30.789404+0000","last_clean_scrub_stamp":"2024-09-14T11:08:30.789404+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":100,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:48:25.310770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":202,"num_read_kb":202,"num_write":327,"num_write_kb":74,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.13","version":"267'451","reported_seq":2158,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:15.812885+0000","last_change":"2024-09-14T13:02:15.812885+0000","last_active":"2024-09-14T13:02:15.812885+0000","last_peered":"2024-09-14T13:02:15.812885+0000","last_clean":"2024-09-14T13:02:15.812885+0000","last_became_active":"2024-09-14T11:08:23.806746+0000","last_became_peered":"2024-09-14T11:08:23.806746+0000","last_unstale":"2024-09-14T13:02:15.812885+0000","last_undegraded":"2024-09-14T13:02:15.812885+0000","last_fullsized":"2024-09-14T13:02:15.812885+0000","mapping_epoch":26,"log_start":"267'400","ondisk_log_start":"267'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'451","last_scrub_stamp":"2024-09-14T13:02:15.812664+0000","last_deep_scrub":"267'451","last_deep_scrub_stamp":"2024-09-14T13:02:15.812664+0000","last_clean_scrub_stamp":"2024-09-14T13:02:15.812664+0000","objects_scrubbed":1,"log_size":51,"log_dups_size":400,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:52:30.280885+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2482,"num_read_kb":2367,"num_write":499,"num_write_kb":86,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.14","version":"267'194","reported_seq":825,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:09.119934+0000","last_change":"2024-09-14T13:02:09.119934+0000","last_active":"2024-09-14T13:02:09.119934+0000","last_peered":"2024-09-14T13:02:09.119934+0000","last_clean":"2024-09-14T13:02:09.119934+0000","last_became_active":"2024-09-14T11:08:56.028924+0000","last_became_peered":"2024-09-14T11:08:56.028924+0000","last_unstale":"2024-09-14T13:02:09.119934+0000","last_undegraded":"2024-09-14T13:02:09.119934+0000","last_fullsized":"2024-09-14T13:02:09.119934+0000","mapping_epoch":37,"log_start":"267'100","ondisk_log_start":"267'100","created":24,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'194","last_scrub_stamp":"2024-09-14T13:02:09.119711+0000","last_deep_scrub":"267'194","last_deep_scrub_stamp":"2024-09-14T13:02:09.119711+0000","last_clean_scrub_stamp":"2024-09-14T13:02:09.119711+0000","objects_scrubbed":2,"log_size":94,"log_dups_size":100,"ondisk_log_size":94,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:09:44.743814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":18,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":488,"num_read_kb":9162,"num_write":891,"num_write_kb":17219,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7,6],"acting":[2,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":533,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:20.978556+0000","last_change":"2024-09-14T13:02:20.978556+0000","last_active":"2024-09-14T13:02:20.978556+0000","last_peered":"2024-09-14T13:02:20.978556+0000","last_clean":"2024-09-14T13:02:20.978556+0000","last_became_active":"2024-09-14T11:08:25.806778+0000","last_became_peered":"2024-09-14T11:08:25.806778+0000","last_unstale":"2024-09-14T13:02:20.978556+0000","last_undegraded":"2024-09-14T13:02:20.978556+0000","last_fullsized":"2024-09-14T13:02:20.978556+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T13:02:20.978330+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T13:02:20.978330+0000","last_clean_scrub_stamp":"2024-09-14T13:02:20.978330+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:00:46.172903+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.11","version":"267'198","reported_seq":838,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:34.968968+0000","last_change":"2024-09-14T13:02:34.968968+0000","last_active":"2024-09-14T13:02:34.968968+0000","last_peered":"2024-09-14T13:02:34.968968+0000","last_clean":"2024-09-14T13:02:34.968968+0000","last_became_active":"2024-09-14T11:08:27.802742+0000","last_became_peered":"2024-09-14T11:08:27.802742+0000","last_unstale":"2024-09-14T13:02:34.968968+0000","last_undegraded":"2024-09-14T13:02:34.968968+0000","last_fullsized":"2024-09-14T13:02:34.968968+0000","mapping_epoch":30,"log_start":"264'100","ondisk_log_start":"264'100","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'198","last_scrub_stamp":"2024-09-14T13:02:34.968678+0000","last_deep_scrub":"267'198","last_deep_scrub_stamp":"2024-09-14T13:02:34.968678+0000","last_clean_scrub_stamp":"2024-09-14T13:02:34.968678+0000","objects_scrubbed":5,"log_size":98,"log_dups_size":100,"ondisk_log_size":98,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:20:44.413916+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":14583,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":266,"num_read_kb":357,"num_write":152,"num_write_kb":28,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":527,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:37.929447+0000","last_change":"2024-09-14T13:02:37.929447+0000","last_active":"2024-09-14T13:02:37.929447+0000","last_peered":"2024-09-14T13:02:37.929447+0000","last_clean":"2024-09-14T13:02:37.929447+0000","last_became_active":"2024-09-14T11:08:29.832866+0000","last_became_peered":"2024-09-14T11:08:29.832866+0000","last_unstale":"2024-09-14T13:02:37.929447+0000","last_undegraded":"2024-09-14T13:02:37.929447+0000","last_fullsized":"2024-09-14T13:02:37.929447+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T13:02:37.929269+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T13:02:37.929269+0000","last_clean_scrub_stamp":"2024-09-14T13:02:37.929269+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:25:25.066701+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1e","version":"267'153","reported_seq":732,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:00:21.213723+0000","last_change":"2024-09-14T11:08:31.838160+0000","last_active":"2024-09-14T13:00:21.213723+0000","last_peered":"2024-09-14T13:00:21.213723+0000","last_clean":"2024-09-14T13:00:21.213723+0000","last_became_active":"2024-09-14T11:08:31.837431+0000","last_became_peered":"2024-09-14T11:08:31.837431+0000","last_unstale":"2024-09-14T13:00:21.213723+0000","last_undegraded":"2024-09-14T13:00:21.213723+0000","last_fullsized":"2024-09-14T13:00:21.213723+0000","mapping_epoch":34,"log_start":"267'100","ondisk_log_start":"267'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:08:30.789404+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:08:30.789404+0000","last_clean_scrub_stamp":"2024-09-14T11:08:30.789404+0000","objects_scrubbed":0,"log_size":53,"log_dups_size":100,"ondisk_log_size":53,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:03:00.723612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":449,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":316,"num_read_kb":262,"num_write":344,"num_write_kb":81,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.12","version":"267'845","reported_seq":2498,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:17.106870+0000","last_change":"2024-09-14T13:02:17.106870+0000","last_active":"2024-09-14T13:02:17.106870+0000","last_peered":"2024-09-14T13:02:17.106870+0000","last_clean":"2024-09-14T13:02:17.106870+0000","last_became_active":"2024-09-14T11:08:23.805773+0000","last_became_peered":"2024-09-14T11:08:23.805773+0000","last_unstale":"2024-09-14T13:02:17.106870+0000","last_undegraded":"2024-09-14T13:02:17.106870+0000","last_fullsized":"2024-09-14T13:02:17.106870+0000","mapping_epoch":26,"log_start":"267'800","ondisk_log_start":"267'800","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'845","last_scrub_stamp":"2024-09-14T13:02:17.106695+0000","last_deep_scrub":"267'845","last_deep_scrub_stamp":"2024-09-14T13:02:17.106695+0000","last_clean_scrub_stamp":"2024-09-14T13:02:17.106695+0000","objects_scrubbed":3,"log_size":45,"log_dups_size":800,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:00:08.155637+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":4345,"num_read_kb":3935,"num_write":1136,"num_write_kb":447,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2810,"num_omap_keys":11,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"267'286","reported_seq":1007,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:14.595357+0000","last_change":"2024-09-14T13:02:14.595357+0000","last_active":"2024-09-14T13:02:14.595357+0000","last_peered":"2024-09-14T13:02:14.595357+0000","last_clean":"2024-09-14T13:02:14.595357+0000","last_became_active":"2024-09-14T11:08:21.829412+0000","last_became_peered":"2024-09-14T11:08:21.829412+0000","last_unstale":"2024-09-14T13:02:14.595357+0000","last_undegraded":"2024-09-14T13:02:14.595357+0000","last_fullsized":"2024-09-14T13:02:14.595357+0000","mapping_epoch":24,"log_start":"267'200","ondisk_log_start":"267'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'286","last_scrub_stamp":"2024-09-14T13:02:14.595126+0000","last_deep_scrub":"267'286","last_deep_scrub_stamp":"2024-09-14T13:02:14.595126+0000","last_clean_scrub_stamp":"2024-09-14T13:02:14.595126+0000","objects_scrubbed":3,"log_size":86,"log_dups_size":200,"ondisk_log_size":86,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T00:09:31.251389+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":54,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":846,"num_read_kb":41720,"num_write":1221,"num_write_kb":52852,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,6],"acting":[7,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":535,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:27.980640+0000","last_change":"2024-09-14T13:02:27.980640+0000","last_active":"2024-09-14T13:02:27.980640+0000","last_peered":"2024-09-14T13:02:27.980640+0000","last_clean":"2024-09-14T13:02:27.980640+0000","last_became_active":"2024-09-14T11:08:25.799473+0000","last_became_peered":"2024-09-14T11:08:25.799473+0000","last_unstale":"2024-09-14T13:02:27.980640+0000","last_undegraded":"2024-09-14T13:02:27.980640+0000","last_fullsized":"2024-09-14T13:02:27.980640+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T13:02:27.980463+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T13:02:27.980463+0000","last_clean_scrub_stamp":"2024-09-14T13:02:27.980463+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:37:30.104380+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"267'96","reported_seq":656,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:24.968219+0000","last_change":"2024-09-14T13:02:24.968219+0000","last_active":"2024-09-14T13:02:24.968219+0000","last_peered":"2024-09-14T13:02:24.968219+0000","last_clean":"2024-09-14T13:02:24.968219+0000","last_became_active":"2024-09-14T11:08:27.822933+0000","last_became_peered":"2024-09-14T11:08:27.822933+0000","last_unstale":"2024-09-14T13:02:24.968219+0000","last_undegraded":"2024-09-14T13:02:24.968219+0000","last_fullsized":"2024-09-14T13:02:24.968219+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'96","last_scrub_stamp":"2024-09-14T13:02:24.968008+0000","last_deep_scrub":"267'96","last_deep_scrub_stamp":"2024-09-14T13:02:24.968008+0000","last_clean_scrub_stamp":"2024-09-14T13:02:24.968008+0000","objects_scrubbed":3,"log_size":96,"log_dups_size":0,"ondisk_log_size":96,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:09:28.512920+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":83,"num_read_kb":77,"num_write":62,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":588,"num_omap_keys":4,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":528,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:36.558460+0000","last_change":"2024-09-14T13:02:36.558460+0000","last_active":"2024-09-14T13:02:36.558460+0000","last_peered":"2024-09-14T13:02:36.558460+0000","last_clean":"2024-09-14T13:02:36.558460+0000","last_became_active":"2024-09-14T11:08:29.838784+0000","last_became_peered":"2024-09-14T11:08:29.838784+0000","last_unstale":"2024-09-14T13:02:36.558460+0000","last_undegraded":"2024-09-14T13:02:36.558460+0000","last_fullsized":"2024-09-14T13:02:36.558460+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T13:02:36.558284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T13:02:36.558284+0000","last_clean_scrub_stamp":"2024-09-14T13:02:36.558284+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:39:19.014441+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1d","version":"267'174","reported_seq":731,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:40.198504+0000","last_change":"2024-09-14T13:02:40.198504+0000","last_active":"2024-09-14T13:02:40.198504+0000","last_peered":"2024-09-14T13:02:40.198504+0000","last_clean":"2024-09-14T13:02:40.198504+0000","last_became_active":"2024-09-14T11:08:31.835061+0000","last_became_peered":"2024-09-14T11:08:31.835061+0000","last_unstale":"2024-09-14T13:02:40.198504+0000","last_undegraded":"2024-09-14T13:02:40.198504+0000","last_fullsized":"2024-09-14T13:02:40.198504+0000","mapping_epoch":34,"log_start":"267'100","ondisk_log_start":"267'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'174","last_scrub_stamp":"2024-09-14T13:02:40.198316+0000","last_deep_scrub":"267'174","last_deep_scrub_stamp":"2024-09-14T13:02:40.198316+0000","last_clean_scrub_stamp":"2024-09-14T13:02:40.198316+0000","objects_scrubbed":1,"log_size":74,"log_dups_size":100,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:26:48.833442+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":257,"num_read_kb":254,"num_write":377,"num_write_kb":108,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":398,"num_omap_keys":2,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"267'375","reported_seq":1949,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:16.881362+0000","last_change":"2024-09-14T13:02:16.881362+0000","last_active":"2024-09-14T13:02:16.881362+0000","last_peered":"2024-09-14T13:02:16.881362+0000","last_clean":"2024-09-14T13:02:16.881362+0000","last_became_active":"2024-09-14T11:08:23.803793+0000","last_became_peered":"2024-09-14T11:08:23.803793+0000","last_unstale":"2024-09-14T13:02:16.881362+0000","last_undegraded":"2024-09-14T13:02:16.881362+0000","last_fullsized":"2024-09-14T13:02:16.881362+0000","mapping_epoch":26,"log_start":"267'300","ondisk_log_start":"267'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'375","last_scrub_stamp":"2024-09-14T13:02:16.881154+0000","last_deep_scrub":"267'375","last_deep_scrub_stamp":"2024-09-14T13:02:16.881154+0000","last_clean_scrub_stamp":"2024-09-14T13:02:16.881154+0000","objects_scrubbed":4,"log_size":75,"log_dups_size":300,"ondisk_log_size":75,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:09:51.952201+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":2158,"num_read_kb":2067,"num_write":426,"num_write_kb":77,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"267'203","reported_seq":861,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:08.282770+0000","last_change":"2024-09-14T13:02:08.282770+0000","last_active":"2024-09-14T13:02:08.282770+0000","last_peered":"2024-09-14T13:02:08.282770+0000","last_clean":"2024-09-14T13:02:08.282770+0000","last_became_active":"2024-09-14T11:08:21.796544+0000","last_became_peered":"2024-09-14T11:08:21.796544+0000","last_unstale":"2024-09-14T13:02:08.282770+0000","last_undegraded":"2024-09-14T13:02:08.282770+0000","last_fullsized":"2024-09-14T13:02:08.282770+0000","mapping_epoch":24,"log_start":"267'100","ondisk_log_start":"267'100","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'203","last_scrub_stamp":"2024-09-14T13:02:08.282561+0000","last_deep_scrub":"267'203","last_deep_scrub_stamp":"2024-09-14T13:02:08.282561+0000","last_clean_scrub_stamp":"2024-09-14T13:02:08.282561+0000","objects_scrubbed":1,"log_size":103,"log_dups_size":100,"ondisk_log_size":103,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:48:38.983992+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":13,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":507,"num_read_kb":19523,"num_write":848,"num_write_kb":34711,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,1],"acting":[5,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":536,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:27.542469+0000","last_change":"2024-09-14T13:02:27.542469+0000","last_active":"2024-09-14T13:02:27.542469+0000","last_peered":"2024-09-14T13:02:27.542469+0000","last_clean":"2024-09-14T13:02:27.542469+0000","last_became_active":"2024-09-14T11:08:25.812065+0000","last_became_peered":"2024-09-14T11:08:25.812065+0000","last_unstale":"2024-09-14T13:02:27.542469+0000","last_undegraded":"2024-09-14T13:02:27.542469+0000","last_fullsized":"2024-09-14T13:02:27.542469+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T13:02:27.542288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T13:02:27.542288+0000","last_clean_scrub_stamp":"2024-09-14T13:02:27.542288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T00:32:03.908244+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.13","version":"267'230","reported_seq":886,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:30.906643+0000","last_change":"2024-09-14T13:02:30.906643+0000","last_active":"2024-09-14T13:02:30.906643+0000","last_peered":"2024-09-14T13:02:30.906643+0000","last_clean":"2024-09-14T13:02:30.906643+0000","last_became_active":"2024-09-14T11:08:27.803857+0000","last_became_peered":"2024-09-14T11:08:27.803857+0000","last_unstale":"2024-09-14T13:02:30.906643+0000","last_undegraded":"2024-09-14T13:02:30.906643+0000","last_fullsized":"2024-09-14T13:02:30.906643+0000","mapping_epoch":30,"log_start":"267'200","ondisk_log_start":"267'200","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'230","last_scrub_stamp":"2024-09-14T13:02:30.906416+0000","last_deep_scrub":"267'230","last_deep_scrub_stamp":"2024-09-14T13:02:30.906416+0000","last_clean_scrub_stamp":"2024-09-14T13:02:30.906416+0000","objects_scrubbed":5,"log_size":30,"log_dups_size":200,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:44:09.351180+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":20297,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":321,"num_read_kb":447,"num_write":190,"num_write_kb":46,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":526,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:27.265918+0000","last_change":"2024-09-14T13:02:27.265918+0000","last_active":"2024-09-14T13:02:27.265918+0000","last_peered":"2024-09-14T13:02:27.265918+0000","last_clean":"2024-09-14T13:02:27.265918+0000","last_became_active":"2024-09-14T11:08:29.830498+0000","last_became_peered":"2024-09-14T11:08:29.830498+0000","last_unstale":"2024-09-14T13:02:27.265918+0000","last_undegraded":"2024-09-14T13:02:27.265918+0000","last_fullsized":"2024-09-14T13:02:27.265918+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T13:02:27.265738+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T13:02:27.265738+0000","last_clean_scrub_stamp":"2024-09-14T13:02:27.265738+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:07:09.501488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.1c","version":"267'123","reported_seq":663,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:00:18.860887+0000","last_change":"2024-09-14T11:08:31.830626+0000","last_active":"2024-09-14T13:00:18.860887+0000","last_peered":"2024-09-14T13:00:18.860887+0000","last_clean":"2024-09-14T13:00:18.860887+0000","last_became_active":"2024-09-14T11:08:31.829826+0000","last_became_peered":"2024-09-14T11:08:31.829826+0000","last_unstale":"2024-09-14T13:00:18.860887+0000","last_undegraded":"2024-09-14T13:00:18.860887+0000","last_fullsized":"2024-09-14T13:00:18.860887+0000","mapping_epoch":34,"log_start":"267'100","ondisk_log_start":"267'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:08:30.789404+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:08:30.789404+0000","last_clean_scrub_stamp":"2024-09-14T11:08:30.789404+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":100,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:25:54.911452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":861,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":146,"num_read_kb":140,"num_write":284,"num_write_kb":67,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"267'867","reported_seq":2541,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:15.874501+0000","last_change":"2024-09-14T13:02:15.874501+0000","last_active":"2024-09-14T13:02:15.874501+0000","last_peered":"2024-09-14T13:02:15.874501+0000","last_clean":"2024-09-14T13:02:15.874501+0000","last_became_active":"2024-09-14T11:08:23.781565+0000","last_became_peered":"2024-09-14T11:08:23.781565+0000","last_unstale":"2024-09-14T13:02:15.874501+0000","last_undegraded":"2024-09-14T13:02:15.874501+0000","last_fullsized":"2024-09-14T13:02:15.874501+0000","mapping_epoch":26,"log_start":"267'800","ondisk_log_start":"267'800","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'867","last_scrub_stamp":"2024-09-14T13:02:15.874297+0000","last_deep_scrub":"267'867","last_deep_scrub_stamp":"2024-09-14T13:02:15.874297+0000","last_clean_scrub_stamp":"2024-09-14T13:02:15.874297+0000","objects_scrubbed":2,"log_size":67,"log_dups_size":800,"ondisk_log_size":67,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:44:25.802335+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":4353,"num_read_kb":3923,"num_write":1159,"num_write_kb":442,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1857,"num_omap_keys":8,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"267'273","reported_seq":958,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:09.085166+0000","last_change":"2024-09-14T13:02:09.085166+0000","last_active":"2024-09-14T13:02:09.085166+0000","last_peered":"2024-09-14T13:02:09.085166+0000","last_clean":"2024-09-14T13:02:09.085166+0000","last_became_active":"2024-09-14T11:08:21.780624+0000","last_became_peered":"2024-09-14T11:08:21.780624+0000","last_unstale":"2024-09-14T13:02:09.085166+0000","last_undegraded":"2024-09-14T13:02:09.085166+0000","last_fullsized":"2024-09-14T13:02:09.085166+0000","mapping_epoch":24,"log_start":"267'200","ondisk_log_start":"267'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'273","last_scrub_stamp":"2024-09-14T13:02:09.084972+0000","last_deep_scrub":"267'273","last_deep_scrub_stamp":"2024-09-14T13:02:09.084972+0000","last_clean_scrub_stamp":"2024-09-14T13:02:09.084972+0000","objects_scrubbed":1,"log_size":73,"log_dups_size":200,"ondisk_log_size":73,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:52:41.240236+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":15,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":687,"num_read_kb":19614,"num_write":1225,"num_write_kb":48256,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,3],"acting":[0,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":534,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:19.319030+0000","last_change":"2024-09-14T13:02:19.319030+0000","last_active":"2024-09-14T13:02:19.319030+0000","last_peered":"2024-09-14T13:02:19.319030+0000","last_clean":"2024-09-14T13:02:19.319030+0000","last_became_active":"2024-09-14T11:08:25.812705+0000","last_became_peered":"2024-09-14T11:08:25.812705+0000","last_unstale":"2024-09-14T13:02:19.319030+0000","last_undegraded":"2024-09-14T13:02:19.319030+0000","last_fullsized":"2024-09-14T13:02:19.319030+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T13:02:19.318859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T13:02:19.318859+0000","last_clean_scrub_stamp":"2024-09-14T13:02:19.318859+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:53:09.845136+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.12","version":"267'173","reported_seq":802,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:32.552951+0000","last_change":"2024-09-14T13:02:32.552951+0000","last_active":"2024-09-14T13:02:32.552951+0000","last_peered":"2024-09-14T13:02:32.552951+0000","last_clean":"2024-09-14T13:02:32.552951+0000","last_became_active":"2024-09-14T11:08:27.828095+0000","last_became_peered":"2024-09-14T11:08:27.828095+0000","last_unstale":"2024-09-14T13:02:32.552951+0000","last_undegraded":"2024-09-14T13:02:32.552951+0000","last_fullsized":"2024-09-14T13:02:32.552951+0000","mapping_epoch":30,"log_start":"267'100","ondisk_log_start":"267'100","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'173","last_scrub_stamp":"2024-09-14T13:02:32.552754+0000","last_deep_scrub":"267'173","last_deep_scrub_stamp":"2024-09-14T13:02:32.552754+0000","last_clean_scrub_stamp":"2024-09-14T13:02:32.552754+0000","objects_scrubbed":4,"log_size":73,"log_dups_size":100,"ondisk_log_size":73,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:22:22.288640+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8744,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":225,"num_read_kb":285,"num_write":126,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":532,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:32.118767+0000","last_change":"2024-09-14T13:02:32.118767+0000","last_active":"2024-09-14T13:02:32.118767+0000","last_peered":"2024-09-14T13:02:32.118767+0000","last_clean":"2024-09-14T13:02:32.118767+0000","last_became_active":"2024-09-14T11:08:29.820211+0000","last_became_peered":"2024-09-14T11:08:29.820211+0000","last_unstale":"2024-09-14T13:02:32.118767+0000","last_undegraded":"2024-09-14T13:02:32.118767+0000","last_fullsized":"2024-09-14T13:02:32.118767+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T13:02:32.118493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T13:02:32.118493+0000","last_clean_scrub_stamp":"2024-09-14T13:02:32.118493+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:24:48.355067+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"267'408","reported_seq":1924,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:22.324486+0000","last_change":"2024-09-14T13:02:22.324486+0000","last_active":"2024-09-14T13:02:22.324486+0000","last_peered":"2024-09-14T13:02:22.324486+0000","last_clean":"2024-09-14T13:02:22.324486+0000","last_became_active":"2024-09-14T11:08:23.812148+0000","last_became_peered":"2024-09-14T11:08:23.812148+0000","last_unstale":"2024-09-14T13:02:22.324486+0000","last_undegraded":"2024-09-14T13:02:22.324486+0000","last_fullsized":"2024-09-14T13:02:22.324486+0000","mapping_epoch":26,"log_start":"267'300","ondisk_log_start":"267'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'408","last_scrub_stamp":"2024-09-14T13:02:22.324302+0000","last_deep_scrub":"267'408","last_deep_scrub_stamp":"2024-09-14T13:02:22.324302+0000","last_clean_scrub_stamp":"2024-09-14T13:02:22.324302+0000","objects_scrubbed":1,"log_size":108,"log_dups_size":300,"ondisk_log_size":108,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:43:05.653161+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2189,"num_read_kb":2068,"num_write":470,"num_write_kb":97,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"267'247","reported_seq":1151,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:08.983777+0000","last_change":"2024-09-14T13:02:08.983777+0000","last_active":"2024-09-14T13:02:08.983777+0000","last_peered":"2024-09-14T13:02:08.983777+0000","last_clean":"2024-09-14T13:02:08.983777+0000","last_became_active":"2024-09-14T11:08:21.778733+0000","last_became_peered":"2024-09-14T11:08:21.778733+0000","last_unstale":"2024-09-14T13:02:08.983777+0000","last_undegraded":"2024-09-14T13:02:08.983777+0000","last_fullsized":"2024-09-14T13:02:08.983777+0000","mapping_epoch":24,"log_start":"267'200","ondisk_log_start":"267'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'247","last_scrub_stamp":"2024-09-14T13:02:08.983565+0000","last_deep_scrub":"267'247","last_deep_scrub_stamp":"2024-09-14T13:02:08.983565+0000","last_clean_scrub_stamp":"2024-09-14T13:02:08.983565+0000","objects_scrubbed":1,"log_size":47,"log_dups_size":200,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:53:58.902570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1357,"num_read_kb":10917,"num_write":1157,"num_write_kb":41642,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":548,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:26.999208+0000","last_change":"2024-09-14T13:02:26.999208+0000","last_active":"2024-09-14T13:02:26.999208+0000","last_peered":"2024-09-14T13:02:26.999208+0000","last_clean":"2024-09-14T13:02:26.999208+0000","last_became_active":"2024-09-14T11:08:25.799108+0000","last_became_peered":"2024-09-14T11:08:25.799108+0000","last_unstale":"2024-09-14T13:02:26.999208+0000","last_undegraded":"2024-09-14T13:02:26.999208+0000","last_fullsized":"2024-09-14T13:02:26.999208+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T13:02:26.999021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T13:02:26.999021+0000","last_clean_scrub_stamp":"2024-09-14T13:02:26.999021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T00:48:32.563816+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1d","version":"267'256","reported_seq":939,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:28.096964+0000","last_change":"2024-09-14T13:02:28.096964+0000","last_active":"2024-09-14T13:02:28.096964+0000","last_peered":"2024-09-14T13:02:28.096964+0000","last_clean":"2024-09-14T13:02:28.096964+0000","last_became_active":"2024-09-14T11:08:27.830985+0000","last_became_peered":"2024-09-14T11:08:27.830985+0000","last_unstale":"2024-09-14T13:02:28.096964+0000","last_undegraded":"2024-09-14T13:02:28.096964+0000","last_fullsized":"2024-09-14T13:02:28.096964+0000","mapping_epoch":30,"log_start":"267'200","ondisk_log_start":"267'200","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'256","last_scrub_stamp":"2024-09-14T13:02:28.096741+0000","last_deep_scrub":"267'256","last_deep_scrub_stamp":"2024-09-14T13:02:28.096741+0000","last_clean_scrub_stamp":"2024-09-14T13:02:28.096741+0000","objects_scrubbed":6,"log_size":56,"log_dups_size":200,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:57:37.009563+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":23445,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":387,"num_read_kb":588,"num_write":256,"num_write_kb":158,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":25256,"num_omap_keys":48,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":524,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:38.404367+0000","last_change":"2024-09-14T13:02:38.404367+0000","last_active":"2024-09-14T13:02:38.404367+0000","last_peered":"2024-09-14T13:02:38.404367+0000","last_clean":"2024-09-14T13:02:38.404367+0000","last_became_active":"2024-09-14T11:08:29.834723+0000","last_became_peered":"2024-09-14T11:08:29.834723+0000","last_unstale":"2024-09-14T13:02:38.404367+0000","last_undegraded":"2024-09-14T13:02:38.404367+0000","last_fullsized":"2024-09-14T13:02:38.404367+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T13:02:38.404182+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T13:02:38.404182+0000","last_clean_scrub_stamp":"2024-09-14T13:02:38.404182+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:53:07.617089+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.13","version":"267'171","reported_seq":715,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:41.983938+0000","last_change":"2024-09-14T13:02:41.983938+0000","last_active":"2024-09-14T13:02:41.983938+0000","last_peered":"2024-09-14T13:02:41.983938+0000","last_clean":"2024-09-14T13:02:41.983938+0000","last_became_active":"2024-09-14T11:08:31.832337+0000","last_became_peered":"2024-09-14T11:08:31.832337+0000","last_unstale":"2024-09-14T13:02:41.983938+0000","last_undegraded":"2024-09-14T13:02:41.983938+0000","last_fullsized":"2024-09-14T13:02:41.983938+0000","mapping_epoch":34,"log_start":"267'100","ondisk_log_start":"267'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'171","last_scrub_stamp":"2024-09-14T13:02:41.983727+0000","last_deep_scrub":"267'171","last_deep_scrub_stamp":"2024-09-14T13:02:41.983727+0000","last_clean_scrub_stamp":"2024-09-14T13:02:41.983727+0000","objects_scrubbed":2,"log_size":71,"log_dups_size":100,"ondisk_log_size":71,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:23:43.504453+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":643,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":222,"num_read_kb":226,"num_write":392,"num_write_kb":102,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"267'413","reported_seq":2039,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:20.023797+0000","last_change":"2024-09-14T13:02:20.023797+0000","last_active":"2024-09-14T13:02:20.023797+0000","last_peered":"2024-09-14T13:02:20.023797+0000","last_clean":"2024-09-14T13:02:20.023797+0000","last_became_active":"2024-09-14T11:08:23.800615+0000","last_became_peered":"2024-09-14T11:08:23.800615+0000","last_unstale":"2024-09-14T13:02:20.023797+0000","last_undegraded":"2024-09-14T13:02:20.023797+0000","last_fullsized":"2024-09-14T13:02:20.023797+0000","mapping_epoch":26,"log_start":"267'400","ondisk_log_start":"267'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'413","last_scrub_stamp":"2024-09-14T13:02:20.023496+0000","last_deep_scrub":"267'413","last_deep_scrub_stamp":"2024-09-14T13:02:20.023496+0000","last_clean_scrub_stamp":"2024-09-14T13:02:20.023496+0000","objects_scrubbed":1,"log_size":13,"log_dups_size":400,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:35:57.669124+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2239,"num_read_kb":2142,"num_write":466,"num_write_kb":81,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":254,"num_omap_keys":1,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"267'242","reported_seq":929,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:08.020604+0000","last_change":"2024-09-14T13:02:08.020474+0000","last_active":"2024-09-14T13:02:08.020604+0000","last_peered":"2024-09-14T13:02:08.020604+0000","last_clean":"2024-09-14T13:02:08.020604+0000","last_became_active":"2024-09-14T11:08:56.036673+0000","last_became_peered":"2024-09-14T11:08:56.036673+0000","last_unstale":"2024-09-14T13:02:08.020604+0000","last_undegraded":"2024-09-14T13:02:08.020604+0000","last_fullsized":"2024-09-14T13:02:08.020604+0000","mapping_epoch":37,"log_start":"267'200","ondisk_log_start":"267'200","created":24,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'242","last_scrub_stamp":"2024-09-14T13:02:08.020270+0000","last_deep_scrub":"267'242","last_deep_scrub_stamp":"2024-09-14T13:02:08.020270+0000","last_clean_scrub_stamp":"2024-09-14T13:02:08.020270+0000","objects_scrubbed":4,"log_size":42,"log_dups_size":200,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:26:39.664742+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":60,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":566,"num_read_kb":38876,"num_write":1051,"num_write_kb":52722,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,4],"acting":[1,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1f","version":"267'4","reported_seq":1018,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:23.337823+0000","last_change":"2024-09-14T13:02:23.337823+0000","last_active":"2024-09-14T13:02:23.337823+0000","last_peered":"2024-09-14T13:02:23.337823+0000","last_clean":"2024-09-14T13:02:23.337823+0000","last_became_active":"2024-09-14T11:08:25.812070+0000","last_became_peered":"2024-09-14T11:08:25.812070+0000","last_unstale":"2024-09-14T13:02:23.337823+0000","last_undegraded":"2024-09-14T13:02:23.337823+0000","last_fullsized":"2024-09-14T13:02:23.337823+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'4","last_scrub_stamp":"2024-09-14T13:02:23.337638+0000","last_deep_scrub":"267'4","last_deep_scrub_stamp":"2024-09-14T13:02:23.337638+0000","last_clean_scrub_stamp":"2024-09-14T13:02:23.337638+0000","objects_scrubbed":1,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:25:52.234244+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":470,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":719,"num_read_kb":717,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1c","version":"267'290","reported_seq":952,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:34.649646+0000","last_change":"2024-09-14T13:02:34.649646+0000","last_active":"2024-09-14T13:02:34.649646+0000","last_peered":"2024-09-14T13:02:34.649646+0000","last_clean":"2024-09-14T13:02:34.649646+0000","last_became_active":"2024-09-14T11:08:27.839087+0000","last_became_peered":"2024-09-14T11:08:27.839087+0000","last_unstale":"2024-09-14T13:02:34.649646+0000","last_undegraded":"2024-09-14T13:02:34.649646+0000","last_fullsized":"2024-09-14T13:02:34.649646+0000","mapping_epoch":30,"log_start":"267'200","ondisk_log_start":"267'200","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'290","last_scrub_stamp":"2024-09-14T13:02:34.649418+0000","last_deep_scrub":"267'290","last_deep_scrub_stamp":"2024-09-14T13:02:34.649418+0000","last_clean_scrub_stamp":"2024-09-14T13:02:34.649418+0000","objects_scrubbed":8,"log_size":90,"log_dups_size":200,"ondisk_log_size":90,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:44:57.415007+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":105157,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":431,"num_read_kb":790,"num_write":316,"num_write_kb":215,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":11460,"num_omap_keys":24,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":522,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:33.128117+0000","last_change":"2024-09-14T13:02:33.128117+0000","last_active":"2024-09-14T13:02:33.128117+0000","last_peered":"2024-09-14T13:02:33.128117+0000","last_clean":"2024-09-14T13:02:33.128117+0000","last_became_active":"2024-09-14T11:08:29.828451+0000","last_became_peered":"2024-09-14T11:08:29.828451+0000","last_unstale":"2024-09-14T13:02:33.128117+0000","last_undegraded":"2024-09-14T13:02:33.128117+0000","last_fullsized":"2024-09-14T13:02:33.128117+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T13:02:33.127924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T13:02:33.127924+0000","last_clean_scrub_stamp":"2024-09-14T13:02:33.127924+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:10:36.512182+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.12","version":"267'207","reported_seq":1114,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:31.278471+0000","last_change":"2024-09-14T13:02:31.278471+0000","last_active":"2024-09-14T13:02:31.278471+0000","last_peered":"2024-09-14T13:02:31.278471+0000","last_clean":"2024-09-14T13:02:31.278471+0000","last_became_active":"2024-09-14T11:08:31.854650+0000","last_became_peered":"2024-09-14T11:08:31.854650+0000","last_unstale":"2024-09-14T13:02:31.278471+0000","last_undegraded":"2024-09-14T13:02:31.278471+0000","last_fullsized":"2024-09-14T13:02:31.278471+0000","mapping_epoch":34,"log_start":"267'100","ondisk_log_start":"267'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'207","last_scrub_stamp":"2024-09-14T13:02:31.278260+0000","last_deep_scrub":"267'207","last_deep_scrub_stamp":"2024-09-14T13:02:31.278260+0000","last_clean_scrub_stamp":"2024-09-14T13:02:31.278260+0000","objects_scrubbed":6,"log_size":107,"log_dups_size":100,"ondisk_log_size":107,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:59:42.042572+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1218,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":620,"num_read_kb":614,"num_write":555,"num_write_kb":141,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1d","version":"267'644","reported_seq":2448,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:20.943243+0000","last_change":"2024-09-14T13:02:20.943243+0000","last_active":"2024-09-14T13:02:20.943243+0000","last_peered":"2024-09-14T13:02:20.943243+0000","last_clean":"2024-09-14T13:02:20.943243+0000","last_became_active":"2024-09-14T11:08:23.779099+0000","last_became_peered":"2024-09-14T11:08:23.779099+0000","last_unstale":"2024-09-14T13:02:20.943243+0000","last_undegraded":"2024-09-14T13:02:20.943243+0000","last_fullsized":"2024-09-14T13:02:20.943243+0000","mapping_epoch":26,"log_start":"267'600","ondisk_log_start":"267'600","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'644","last_scrub_stamp":"2024-09-14T13:02:20.943029+0000","last_deep_scrub":"267'644","last_deep_scrub_stamp":"2024-09-14T13:02:20.943029+0000","last_clean_scrub_stamp":"2024-09-14T13:02:20.943029+0000","objects_scrubbed":2,"log_size":44,"log_dups_size":600,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:46:01.069278+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3438,"num_read_kb":3161,"num_write":830,"num_write_kb":293,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":432,"num_omap_keys":2,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"267'251","reported_seq":1039,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:08.834994+0000","last_change":"2024-09-14T13:02:08.834994+0000","last_active":"2024-09-14T13:02:08.834994+0000","last_peered":"2024-09-14T13:02:08.834994+0000","last_clean":"2024-09-14T13:02:08.834994+0000","last_became_active":"2024-09-14T11:08:21.822349+0000","last_became_peered":"2024-09-14T11:08:21.822349+0000","last_unstale":"2024-09-14T13:02:08.834994+0000","last_undegraded":"2024-09-14T13:02:08.834994+0000","last_fullsized":"2024-09-14T13:02:08.834994+0000","mapping_epoch":24,"log_start":"267'200","ondisk_log_start":"267'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'251","last_scrub_stamp":"2024-09-14T13:02:08.834786+0000","last_deep_scrub":"267'251","last_deep_scrub_stamp":"2024-09-14T13:02:08.834786+0000","last_clean_scrub_stamp":"2024-09-14T13:02:08.834786+0000","objects_scrubbed":3,"log_size":51,"log_dups_size":200,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:07:12.222661+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1655848,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1337,"num_read_kb":40987,"num_write":1078,"num_write_kb":33045,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,5],"acting":[4,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":534,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:29.680153+0000","last_change":"2024-09-14T13:02:29.680153+0000","last_active":"2024-09-14T13:02:29.680153+0000","last_peered":"2024-09-14T13:02:29.680153+0000","last_clean":"2024-09-14T13:02:29.680153+0000","last_became_active":"2024-09-14T11:08:25.807820+0000","last_became_peered":"2024-09-14T11:08:25.807820+0000","last_unstale":"2024-09-14T13:02:29.680153+0000","last_undegraded":"2024-09-14T13:02:29.680153+0000","last_fullsized":"2024-09-14T13:02:29.680153+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T13:02:29.679968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T13:02:29.679968+0000","last_clean_scrub_stamp":"2024-09-14T13:02:29.679968+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:16:44.115139+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1f","version":"267'207","reported_seq":854,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:31.871500+0000","last_change":"2024-09-14T13:02:31.871500+0000","last_active":"2024-09-14T13:02:31.871500+0000","last_peered":"2024-09-14T13:02:31.871500+0000","last_clean":"2024-09-14T13:02:31.871500+0000","last_became_active":"2024-09-14T11:08:27.799019+0000","last_became_peered":"2024-09-14T11:08:27.799019+0000","last_unstale":"2024-09-14T13:02:31.871500+0000","last_undegraded":"2024-09-14T13:02:31.871500+0000","last_fullsized":"2024-09-14T13:02:31.871500+0000","mapping_epoch":30,"log_start":"264'100","ondisk_log_start":"264'100","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'207","last_scrub_stamp":"2024-09-14T13:02:31.871286+0000","last_deep_scrub":"267'207","last_deep_scrub_stamp":"2024-09-14T13:02:31.871286+0000","last_clean_scrub_stamp":"2024-09-14T13:02:31.871286+0000","objects_scrubbed":6,"log_size":107,"log_dups_size":100,"ondisk_log_size":107,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:51:00.124237+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":11376,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":267,"num_read_kb":349,"num_write":156,"num_write_kb":26,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":533,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:26.073717+0000","last_change":"2024-09-14T13:02:26.073717+0000","last_active":"2024-09-14T13:02:26.073717+0000","last_peered":"2024-09-14T13:02:26.073717+0000","last_clean":"2024-09-14T13:02:26.073717+0000","last_became_active":"2024-09-14T11:08:29.820658+0000","last_became_peered":"2024-09-14T11:08:29.820658+0000","last_unstale":"2024-09-14T13:02:26.073717+0000","last_undegraded":"2024-09-14T13:02:26.073717+0000","last_fullsized":"2024-09-14T13:02:26.073717+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T13:02:26.073512+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T13:02:26.073512+0000","last_clean_scrub_stamp":"2024-09-14T13:02:26.073512+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:26:51.195695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.11","version":"267'137","reported_seq":675,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:42.398170+0000","last_change":"2024-09-14T13:02:42.398170+0000","last_active":"2024-09-14T13:02:42.398170+0000","last_peered":"2024-09-14T13:02:42.398170+0000","last_clean":"2024-09-14T13:02:42.398170+0000","last_became_active":"2024-09-14T11:08:31.836424+0000","last_became_peered":"2024-09-14T11:08:31.836424+0000","last_unstale":"2024-09-14T13:02:42.398170+0000","last_undegraded":"2024-09-14T13:02:42.398170+0000","last_fullsized":"2024-09-14T13:02:42.398170+0000","mapping_epoch":34,"log_start":"267'100","ondisk_log_start":"267'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'137","last_scrub_stamp":"2024-09-14T13:02:42.397953+0000","last_deep_scrub":"267'137","last_deep_scrub_stamp":"2024-09-14T13:02:42.397953+0000","last_clean_scrub_stamp":"2024-09-14T13:02:42.397953+0000","objects_scrubbed":3,"log_size":37,"log_dups_size":100,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:33:09.416422+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":383,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":163,"num_read_kb":148,"num_write":342,"num_write_kb":82,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1c","version":"267'438","reported_seq":2103,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:17.145247+0000","last_change":"2024-09-14T13:02:17.145247+0000","last_active":"2024-09-14T13:02:17.145247+0000","last_peered":"2024-09-14T13:02:17.145247+0000","last_clean":"2024-09-14T13:02:17.145247+0000","last_became_active":"2024-09-14T11:08:23.775491+0000","last_became_peered":"2024-09-14T11:08:23.775491+0000","last_unstale":"2024-09-14T13:02:17.145247+0000","last_undegraded":"2024-09-14T13:02:17.145247+0000","last_fullsized":"2024-09-14T13:02:17.145247+0000","mapping_epoch":26,"log_start":"267'400","ondisk_log_start":"267'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'438","last_scrub_stamp":"2024-09-14T13:02:17.145001+0000","last_deep_scrub":"267'438","last_deep_scrub_stamp":"2024-09-14T13:02:17.145001+0000","last_clean_scrub_stamp":"2024-09-14T13:02:17.145001+0000","objects_scrubbed":1,"log_size":38,"log_dups_size":400,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:24:25.673117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2479,"num_read_kb":2350,"num_write":502,"num_write_kb":107,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":247,"num_omap_keys":1,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"267'223","reported_seq":858,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:11.163011+0000","last_change":"2024-09-14T13:02:11.163011+0000","last_active":"2024-09-14T13:02:11.163011+0000","last_peered":"2024-09-14T13:02:11.163011+0000","last_clean":"2024-09-14T13:02:11.163011+0000","last_became_active":"2024-09-14T11:08:56.033894+0000","last_became_peered":"2024-09-14T11:08:56.033894+0000","last_unstale":"2024-09-14T13:02:11.163011+0000","last_undegraded":"2024-09-14T13:02:11.163011+0000","last_fullsized":"2024-09-14T13:02:11.163011+0000","mapping_epoch":37,"log_start":"267'200","ondisk_log_start":"267'200","created":24,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'223","last_scrub_stamp":"2024-09-14T13:02:11.162701+0000","last_deep_scrub":"267'223","last_deep_scrub_stamp":"2024-09-14T13:02:11.162701+0000","last_clean_scrub_stamp":"2024-09-14T13:02:11.162701+0000","objects_scrubbed":2,"log_size":23,"log_dups_size":200,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:47:28.180376+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":541,"num_read_kb":17888,"num_write":1023,"num_write_kb":32755,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4,7],"acting":[2,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":529,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:25.041608+0000","last_change":"2024-09-14T13:02:25.041608+0000","last_active":"2024-09-14T13:02:25.041608+0000","last_peered":"2024-09-14T13:02:25.041608+0000","last_clean":"2024-09-14T13:02:25.041608+0000","last_became_active":"2024-09-14T11:08:25.804388+0000","last_became_peered":"2024-09-14T11:08:25.804388+0000","last_unstale":"2024-09-14T13:02:25.041608+0000","last_undegraded":"2024-09-14T13:02:25.041608+0000","last_fullsized":"2024-09-14T13:02:25.041608+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T13:02:25.041415+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T13:02:25.041415+0000","last_clean_scrub_stamp":"2024-09-14T13:02:25.041415+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:10:25.120032+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1e","version":"267'175","reported_seq":776,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:35.759893+0000","last_change":"2024-09-14T13:02:35.759893+0000","last_active":"2024-09-14T13:02:35.759893+0000","last_peered":"2024-09-14T13:02:35.759893+0000","last_clean":"2024-09-14T13:02:35.759893+0000","last_became_active":"2024-09-14T11:08:27.830708+0000","last_became_peered":"2024-09-14T11:08:27.830708+0000","last_unstale":"2024-09-14T13:02:35.759893+0000","last_undegraded":"2024-09-14T13:02:35.759893+0000","last_fullsized":"2024-09-14T13:02:35.759893+0000","mapping_epoch":30,"log_start":"267'100","ondisk_log_start":"267'100","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'175","last_scrub_stamp":"2024-09-14T13:02:35.759693+0000","last_deep_scrub":"267'175","last_deep_scrub_stamp":"2024-09-14T13:02:35.759693+0000","last_clean_scrub_stamp":"2024-09-14T13:02:35.759693+0000","objects_scrubbed":7,"log_size":75,"log_dups_size":100,"ondisk_log_size":75,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:24:57.090070+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":224,"num_read_kb":219,"num_write":208,"num_write_kb":88,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":18240,"num_omap_keys":46,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1f","version":"267'769","reported_seq":3165,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:29.273311+0000","last_change":"2024-09-14T13:02:29.273311+0000","last_active":"2024-09-14T13:02:29.273311+0000","last_peered":"2024-09-14T13:02:29.273311+0000","last_clean":"2024-09-14T13:02:29.273311+0000","last_became_active":"2024-09-14T11:08:29.840179+0000","last_became_peered":"2024-09-14T11:08:29.840179+0000","last_unstale":"2024-09-14T13:02:29.273311+0000","last_undegraded":"2024-09-14T13:02:29.273311+0000","last_fullsized":"2024-09-14T13:02:29.273311+0000","mapping_epoch":32,"log_start":"267'701","ondisk_log_start":"267'701","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'769","last_scrub_stamp":"2024-09-14T13:02:29.273123+0000","last_deep_scrub":"267'769","last_deep_scrub_stamp":"2024-09-14T13:02:29.273123+0000","last_clean_scrub_stamp":"2024-09-14T13:02:29.273123+0000","objects_scrubbed":1,"log_size":68,"log_dups_size":701,"ondisk_log_size":68,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:27:32.756092+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.10","version":"267'111","reported_seq":645,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:40.561157+0000","last_change":"2024-09-14T13:02:40.561157+0000","last_active":"2024-09-14T13:02:40.561157+0000","last_peered":"2024-09-14T13:02:40.561157+0000","last_clean":"2024-09-14T13:02:40.561157+0000","last_became_active":"2024-09-14T11:08:31.838761+0000","last_became_peered":"2024-09-14T11:08:31.838761+0000","last_unstale":"2024-09-14T13:02:40.561157+0000","last_undegraded":"2024-09-14T13:02:40.561157+0000","last_fullsized":"2024-09-14T13:02:40.561157+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'111","last_scrub_stamp":"2024-09-14T13:02:40.560964+0000","last_deep_scrub":"267'111","last_deep_scrub_stamp":"2024-09-14T13:02:40.560964+0000","last_clean_scrub_stamp":"2024-09-14T13:02:40.560964+0000","objects_scrubbed":1,"log_size":111,"log_dups_size":0,"ondisk_log_size":111,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:00:06.038509+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":418,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":108,"num_read_kb":106,"num_write":270,"num_write_kb":60,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1b","version":"267'385","reported_seq":1857,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:18.710983+0000","last_change":"2024-09-14T13:02:18.710983+0000","last_active":"2024-09-14T13:02:18.710983+0000","last_peered":"2024-09-14T13:02:18.710983+0000","last_clean":"2024-09-14T13:02:18.710983+0000","last_became_active":"2024-09-14T11:08:23.791753+0000","last_became_peered":"2024-09-14T11:08:23.791753+0000","last_unstale":"2024-09-14T13:02:18.710983+0000","last_undegraded":"2024-09-14T13:02:18.710983+0000","last_fullsized":"2024-09-14T13:02:18.710983+0000","mapping_epoch":26,"log_start":"267'300","ondisk_log_start":"267'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'385","last_scrub_stamp":"2024-09-14T13:02:18.710738+0000","last_deep_scrub":"267'385","last_deep_scrub_stamp":"2024-09-14T13:02:18.710738+0000","last_clean_scrub_stamp":"2024-09-14T13:02:18.710738+0000","objects_scrubbed":1,"log_size":85,"log_dups_size":300,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:43:05.968088+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2049,"num_read_kb":1937,"num_write":432,"num_write_kb":84,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1c","version":"267'213","reported_seq":877,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:11.330388+0000","last_change":"2024-09-14T13:02:11.330388+0000","last_active":"2024-09-14T13:02:11.330388+0000","last_peered":"2024-09-14T13:02:11.330388+0000","last_clean":"2024-09-14T13:02:11.330388+0000","last_became_active":"2024-09-14T11:08:21.825881+0000","last_became_peered":"2024-09-14T11:08:21.825881+0000","last_unstale":"2024-09-14T13:02:11.330388+0000","last_undegraded":"2024-09-14T13:02:11.330388+0000","last_fullsized":"2024-09-14T13:02:11.330388+0000","mapping_epoch":24,"log_start":"267'200","ondisk_log_start":"267'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'213","last_scrub_stamp":"2024-09-14T13:02:11.330181+0000","last_deep_scrub":"267'213","last_deep_scrub_stamp":"2024-09-14T13:02:11.330181+0000","last_clean_scrub_stamp":"2024-09-14T13:02:11.330181+0000","objects_scrubbed":1,"log_size":13,"log_dups_size":200,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:06:15.884484+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1655822,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":555,"num_read_kb":34621,"num_write":949,"num_write_kb":21560,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":533,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:28.543122+0000","last_change":"2024-09-14T13:02:28.543122+0000","last_active":"2024-09-14T13:02:28.543122+0000","last_peered":"2024-09-14T13:02:28.543122+0000","last_clean":"2024-09-14T13:02:28.543122+0000","last_became_active":"2024-09-14T11:08:25.822047+0000","last_became_peered":"2024-09-14T11:08:25.822047+0000","last_unstale":"2024-09-14T13:02:28.543122+0000","last_undegraded":"2024-09-14T13:02:28.543122+0000","last_fullsized":"2024-09-14T13:02:28.543122+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T13:02:28.542945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T13:02:28.542945+0000","last_clean_scrub_stamp":"2024-09-14T13:02:28.542945+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:35:34.239314+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.19","version":"267'270","reported_seq":933,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:36.400848+0000","last_change":"2024-09-14T13:02:36.400848+0000","last_active":"2024-09-14T13:02:36.400848+0000","last_peered":"2024-09-14T13:02:36.400848+0000","last_clean":"2024-09-14T13:02:36.400848+0000","last_became_active":"2024-09-14T11:08:27.824464+0000","last_became_peered":"2024-09-14T11:08:27.824464+0000","last_unstale":"2024-09-14T13:02:36.400848+0000","last_undegraded":"2024-09-14T13:02:36.400848+0000","last_fullsized":"2024-09-14T13:02:36.400848+0000","mapping_epoch":30,"log_start":"267'200","ondisk_log_start":"267'200","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'270","last_scrub_stamp":"2024-09-14T13:02:36.400629+0000","last_deep_scrub":"267'270","last_deep_scrub_stamp":"2024-09-14T13:02:36.400629+0000","last_clean_scrub_stamp":"2024-09-14T13:02:36.400629+0000","objects_scrubbed":8,"log_size":70,"log_dups_size":200,"ondisk_log_size":70,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:44:26.595055+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12812,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":350,"num_read_kb":439,"num_write":214,"num_write_kb":32,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":531,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:35.129790+0000","last_change":"2024-09-14T13:02:35.129790+0000","last_active":"2024-09-14T13:02:35.129790+0000","last_peered":"2024-09-14T13:02:35.129790+0000","last_clean":"2024-09-14T13:02:35.129790+0000","last_became_active":"2024-09-14T11:08:29.822623+0000","last_became_peered":"2024-09-14T11:08:29.822623+0000","last_unstale":"2024-09-14T13:02:35.129790+0000","last_undegraded":"2024-09-14T13:02:35.129790+0000","last_fullsized":"2024-09-14T13:02:35.129790+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T13:02:35.129616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T13:02:35.129616+0000","last_clean_scrub_stamp":"2024-09-14T13:02:35.129616+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:00:13.553426+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.17","version":"267'129","reported_seq":664,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:41.608185+0000","last_change":"2024-09-14T13:02:41.608185+0000","last_active":"2024-09-14T13:02:41.608185+0000","last_peered":"2024-09-14T13:02:41.608185+0000","last_clean":"2024-09-14T13:02:41.608185+0000","last_became_active":"2024-09-14T11:08:31.858388+0000","last_became_peered":"2024-09-14T11:08:31.858388+0000","last_unstale":"2024-09-14T13:02:41.608185+0000","last_undegraded":"2024-09-14T13:02:41.608185+0000","last_fullsized":"2024-09-14T13:02:41.608185+0000","mapping_epoch":34,"log_start":"267'100","ondisk_log_start":"267'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'129","last_scrub_stamp":"2024-09-14T13:02:41.607983+0000","last_deep_scrub":"267'129","last_deep_scrub_stamp":"2024-09-14T13:02:41.607983+0000","last_clean_scrub_stamp":"2024-09-14T13:02:41.607983+0000","objects_scrubbed":2,"log_size":29,"log_dups_size":100,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:09:12.823499+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":200,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":125,"num_read_kb":119,"num_write":310,"num_write_kb":73,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1a","version":"267'853","reported_seq":2580,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:17.760990+0000","last_change":"2024-09-14T13:02:17.760990+0000","last_active":"2024-09-14T13:02:17.760990+0000","last_peered":"2024-09-14T13:02:17.760990+0000","last_clean":"2024-09-14T13:02:17.760990+0000","last_became_active":"2024-09-14T11:08:23.793908+0000","last_became_peered":"2024-09-14T11:08:23.793908+0000","last_unstale":"2024-09-14T13:02:17.760990+0000","last_undegraded":"2024-09-14T13:02:17.760990+0000","last_fullsized":"2024-09-14T13:02:17.760990+0000","mapping_epoch":26,"log_start":"267'800","ondisk_log_start":"267'800","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'853","last_scrub_stamp":"2024-09-14T13:02:17.760808+0000","last_deep_scrub":"267'853","last_deep_scrub_stamp":"2024-09-14T13:02:17.760808+0000","last_clean_scrub_stamp":"2024-09-14T13:02:17.760808+0000","objects_scrubbed":2,"log_size":53,"log_dups_size":800,"ondisk_log_size":53,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:38:18.530322+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":4233,"num_read_kb":3837,"num_write":1135,"num_write_kb":419,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2551,"num_omap_keys":10,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1d","version":"267'248","reported_seq":937,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:12.368968+0000","last_change":"2024-09-14T13:02:12.368968+0000","last_active":"2024-09-14T13:02:12.368968+0000","last_peered":"2024-09-14T13:02:12.368968+0000","last_clean":"2024-09-14T13:02:12.368968+0000","last_became_active":"2024-09-14T11:08:21.820805+0000","last_became_peered":"2024-09-14T11:08:21.820805+0000","last_unstale":"2024-09-14T13:02:12.368968+0000","last_undegraded":"2024-09-14T13:02:12.368968+0000","last_fullsized":"2024-09-14T13:02:12.368968+0000","mapping_epoch":24,"log_start":"267'200","ondisk_log_start":"267'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'248","last_scrub_stamp":"2024-09-14T13:02:12.368755+0000","last_deep_scrub":"267'248","last_deep_scrub_stamp":"2024-09-14T13:02:12.368755+0000","last_clean_scrub_stamp":"2024-09-14T13:02:12.368755+0000","objects_scrubbed":3,"log_size":48,"log_dups_size":200,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:45:17.694226+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":55,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":696,"num_read_kb":13918,"num_write":1169,"num_write_kb":29151,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":532,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:33.407269+0000","last_change":"2024-09-14T13:02:33.407269+0000","last_active":"2024-09-14T13:02:33.407269+0000","last_peered":"2024-09-14T13:02:33.407269+0000","last_clean":"2024-09-14T13:02:33.407269+0000","last_became_active":"2024-09-14T11:08:25.801548+0000","last_became_peered":"2024-09-14T11:08:25.801548+0000","last_unstale":"2024-09-14T13:02:33.407269+0000","last_undegraded":"2024-09-14T13:02:33.407269+0000","last_fullsized":"2024-09-14T13:02:33.407269+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T13:02:33.407066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T13:02:33.407066+0000","last_clean_scrub_stamp":"2024-09-14T13:02:33.407066+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:48:43.308728+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.18","version":"267'183","reported_seq":815,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:28.000513+0000","last_change":"2024-09-14T13:02:28.000513+0000","last_active":"2024-09-14T13:02:28.000513+0000","last_peered":"2024-09-14T13:02:28.000513+0000","last_clean":"2024-09-14T13:02:28.000513+0000","last_became_active":"2024-09-14T11:08:27.814938+0000","last_became_peered":"2024-09-14T11:08:27.814938+0000","last_unstale":"2024-09-14T13:02:28.000513+0000","last_undegraded":"2024-09-14T13:02:28.000513+0000","last_fullsized":"2024-09-14T13:02:28.000513+0000","mapping_epoch":30,"log_start":"264'100","ondisk_log_start":"264'100","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'183","last_scrub_stamp":"2024-09-14T13:02:28.000240+0000","last_deep_scrub":"267'183","last_deep_scrub_stamp":"2024-09-14T13:02:28.000240+0000","last_clean_scrub_stamp":"2024-09-14T13:02:28.000240+0000","objects_scrubbed":4,"log_size":83,"log_dups_size":100,"ondisk_log_size":83,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:11:21.026195+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":31231,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":239,"num_read_kb":376,"num_write":138,"num_write_kb":54,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":525,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:28.223406+0000","last_change":"2024-09-14T13:02:28.223264+0000","last_active":"2024-09-14T13:02:28.223406+0000","last_peered":"2024-09-14T13:02:28.223406+0000","last_clean":"2024-09-14T13:02:28.223406+0000","last_became_active":"2024-09-14T11:08:29.829491+0000","last_became_peered":"2024-09-14T11:08:29.829491+0000","last_unstale":"2024-09-14T13:02:28.223406+0000","last_undegraded":"2024-09-14T13:02:28.223406+0000","last_fullsized":"2024-09-14T13:02:28.223406+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T13:02:28.223080+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T13:02:28.223080+0000","last_clean_scrub_stamp":"2024-09-14T13:02:28.223080+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:42:17.487239+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.16","version":"267'129","reported_seq":692,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:42.977781+0000","last_change":"2024-09-14T13:02:42.977781+0000","last_active":"2024-09-14T13:02:42.977781+0000","last_peered":"2024-09-14T13:02:42.977781+0000","last_clean":"2024-09-14T13:02:42.977781+0000","last_became_active":"2024-09-14T11:08:31.832264+0000","last_became_peered":"2024-09-14T11:08:31.832264+0000","last_unstale":"2024-09-14T13:02:42.977781+0000","last_undegraded":"2024-09-14T13:02:42.977781+0000","last_fullsized":"2024-09-14T13:02:42.977781+0000","mapping_epoch":34,"log_start":"267'100","ondisk_log_start":"267'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'129","last_scrub_stamp":"2024-09-14T13:02:42.977606+0000","last_deep_scrub":"267'129","last_deep_scrub_stamp":"2024-09-14T13:02:42.977606+0000","last_clean_scrub_stamp":"2024-09-14T13:02:42.977606+0000","objects_scrubbed":1,"log_size":29,"log_dups_size":100,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:40:45.314824+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":539,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":196,"num_read_kb":188,"num_write":306,"num_write_kb":70,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"267'841","reported_seq":2525,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:18.906574+0000","last_change":"2024-09-14T13:02:18.906417+0000","last_active":"2024-09-14T13:02:18.906574+0000","last_peered":"2024-09-14T13:02:18.906574+0000","last_clean":"2024-09-14T13:02:18.906574+0000","last_became_active":"2024-09-14T11:08:23.781730+0000","last_became_peered":"2024-09-14T11:08:23.781730+0000","last_unstale":"2024-09-14T13:02:18.906574+0000","last_undegraded":"2024-09-14T13:02:18.906574+0000","last_fullsized":"2024-09-14T13:02:18.906574+0000","mapping_epoch":26,"log_start":"267'800","ondisk_log_start":"267'800","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'841","last_scrub_stamp":"2024-09-14T13:02:18.906239+0000","last_deep_scrub":"267'841","last_deep_scrub_stamp":"2024-09-14T13:02:18.906239+0000","last_clean_scrub_stamp":"2024-09-14T13:02:18.906239+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":800,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:22:02.089304+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3990,"num_read_kb":3619,"num_write":1102,"num_write_kb":388,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"267'187","reported_seq":836,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:10.973597+0000","last_change":"2024-09-14T13:02:10.973427+0000","last_active":"2024-09-14T13:02:10.973597+0000","last_peered":"2024-09-14T13:02:10.973597+0000","last_clean":"2024-09-14T13:02:10.973597+0000","last_became_active":"2024-09-14T11:08:21.809457+0000","last_became_peered":"2024-09-14T11:08:21.809457+0000","last_unstale":"2024-09-14T13:02:10.973597+0000","last_undegraded":"2024-09-14T13:02:10.973597+0000","last_fullsized":"2024-09-14T13:02:10.973597+0000","mapping_epoch":24,"log_start":"267'100","ondisk_log_start":"267'100","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'187","last_scrub_stamp":"2024-09-14T13:02:10.973179+0000","last_deep_scrub":"267'187","last_deep_scrub_stamp":"2024-09-14T13:02:10.973179+0000","last_clean_scrub_stamp":"2024-09-14T13:02:10.973179+0000","objects_scrubbed":2,"log_size":87,"log_dups_size":100,"ondisk_log_size":87,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:00:13.783400+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":26,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":452,"num_read_kb":5598,"num_write":898,"num_write_kb":20482,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6,7],"acting":[3,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":536,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:27.675224+0000","last_change":"2024-09-14T13:02:27.675224+0000","last_active":"2024-09-14T13:02:27.675224+0000","last_peered":"2024-09-14T13:02:27.675224+0000","last_clean":"2024-09-14T13:02:27.675224+0000","last_became_active":"2024-09-14T11:08:25.805777+0000","last_became_peered":"2024-09-14T11:08:25.805777+0000","last_unstale":"2024-09-14T13:02:27.675224+0000","last_undegraded":"2024-09-14T13:02:27.675224+0000","last_fullsized":"2024-09-14T13:02:27.675224+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T13:02:27.675019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T13:02:27.675019+0000","last_clean_scrub_stamp":"2024-09-14T13:02:27.675019+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:33:44.670317+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1b","version":"267'125","reported_seq":726,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:32.892063+0000","last_change":"2024-09-14T13:02:32.892063+0000","last_active":"2024-09-14T13:02:32.892063+0000","last_peered":"2024-09-14T13:02:32.892063+0000","last_clean":"2024-09-14T13:02:32.892063+0000","last_became_active":"2024-09-14T11:08:27.822465+0000","last_became_peered":"2024-09-14T11:08:27.822465+0000","last_unstale":"2024-09-14T13:02:32.892063+0000","last_undegraded":"2024-09-14T13:02:32.892063+0000","last_fullsized":"2024-09-14T13:02:32.892063+0000","mapping_epoch":30,"log_start":"267'100","ondisk_log_start":"267'100","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'125","last_scrub_stamp":"2024-09-14T13:02:32.891840+0000","last_deep_scrub":"267'125","last_deep_scrub_stamp":"2024-09-14T13:02:32.891840+0000","last_clean_scrub_stamp":"2024-09-14T13:02:32.891840+0000","objects_scrubbed":2,"log_size":25,"log_dups_size":100,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:18:10.544553+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9872,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":162,"num_read_kb":232,"num_write":86,"num_write_kb":20,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":526,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:36.698390+0000","last_change":"2024-09-14T13:02:36.698390+0000","last_active":"2024-09-14T13:02:36.698390+0000","last_peered":"2024-09-14T13:02:36.698390+0000","last_clean":"2024-09-14T13:02:36.698390+0000","last_became_active":"2024-09-14T11:08:29.831394+0000","last_became_peered":"2024-09-14T11:08:29.831394+0000","last_unstale":"2024-09-14T13:02:36.698390+0000","last_undegraded":"2024-09-14T13:02:36.698390+0000","last_fullsized":"2024-09-14T13:02:36.698390+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T13:02:36.698177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T13:02:36.698177+0000","last_clean_scrub_stamp":"2024-09-14T13:02:36.698177+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:22:59.122651+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.15","version":"267'191","reported_seq":1336,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:39.517014+0000","last_change":"2024-09-14T13:02:39.517014+0000","last_active":"2024-09-14T13:02:39.517014+0000","last_peered":"2024-09-14T13:02:39.517014+0000","last_clean":"2024-09-14T13:02:39.517014+0000","last_became_active":"2024-09-14T11:08:31.837288+0000","last_became_peered":"2024-09-14T11:08:31.837288+0000","last_unstale":"2024-09-14T13:02:39.517014+0000","last_undegraded":"2024-09-14T13:02:39.517014+0000","last_fullsized":"2024-09-14T13:02:39.517014+0000","mapping_epoch":34,"log_start":"267'100","ondisk_log_start":"267'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'191","last_scrub_stamp":"2024-09-14T13:02:39.516820+0000","last_deep_scrub":"267'191","last_deep_scrub_stamp":"2024-09-14T13:02:39.516820+0000","last_clean_scrub_stamp":"2024-09-14T13:02:39.516820+0000","objects_scrubbed":5,"log_size":91,"log_dups_size":100,"ondisk_log_size":91,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:51:46.141392+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":649,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":776,"num_read_kb":767,"num_write":406,"num_write_kb":131,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.18","version":"267'751","reported_seq":2363,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:16.798485+0000","last_change":"2024-09-14T13:02:16.798485+0000","last_active":"2024-09-14T13:02:16.798485+0000","last_peered":"2024-09-14T13:02:16.798485+0000","last_clean":"2024-09-14T13:02:16.798485+0000","last_became_active":"2024-09-14T11:08:23.806640+0000","last_became_peered":"2024-09-14T11:08:23.806640+0000","last_unstale":"2024-09-14T13:02:16.798485+0000","last_undegraded":"2024-09-14T13:02:16.798485+0000","last_fullsized":"2024-09-14T13:02:16.798485+0000","mapping_epoch":26,"log_start":"267'700","ondisk_log_start":"267'700","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'751","last_scrub_stamp":"2024-09-14T13:02:16.798298+0000","last_deep_scrub":"267'751","last_deep_scrub_stamp":"2024-09-14T13:02:16.798298+0000","last_clean_scrub_stamp":"2024-09-14T13:02:16.798298+0000","objects_scrubbed":1,"log_size":51,"log_dups_size":700,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:34:05.343127+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3938,"num_read_kb":3591,"num_write":982,"num_write_kb":355,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":244,"num_omap_keys":1,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1f","version":"267'170","reported_seq":847,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:10.102208+0000","last_change":"2024-09-14T13:02:10.102208+0000","last_active":"2024-09-14T13:02:10.102208+0000","last_peered":"2024-09-14T13:02:10.102208+0000","last_clean":"2024-09-14T13:02:10.102208+0000","last_became_active":"2024-09-14T11:08:21.801111+0000","last_became_peered":"2024-09-14T11:08:21.801111+0000","last_unstale":"2024-09-14T13:02:10.102208+0000","last_undegraded":"2024-09-14T13:02:10.102208+0000","last_fullsized":"2024-09-14T13:02:10.102208+0000","mapping_epoch":24,"log_start":"267'100","ondisk_log_start":"267'100","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'170","last_scrub_stamp":"2024-09-14T13:02:10.102000+0000","last_deep_scrub":"267'170","last_deep_scrub_stamp":"2024-09-14T13:02:10.102000+0000","last_clean_scrub_stamp":"2024-09-14T13:02:10.102000+0000","objects_scrubbed":1,"log_size":70,"log_dups_size":100,"ondisk_log_size":70,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:52:37.683920+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":26,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":489,"num_read_kb":60837,"num_write":760,"num_write_kb":39194,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,6],"acting":[0,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.19","version":"267'2","reported_seq":534,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:24.003466+0000","last_change":"2024-09-14T13:02:24.003466+0000","last_active":"2024-09-14T13:02:24.003466+0000","last_peered":"2024-09-14T13:02:24.003466+0000","last_clean":"2024-09-14T13:02:24.003466+0000","last_became_active":"2024-09-14T11:08:25.799872+0000","last_became_peered":"2024-09-14T11:08:25.799872+0000","last_unstale":"2024-09-14T13:02:24.003466+0000","last_undegraded":"2024-09-14T13:02:24.003466+0000","last_fullsized":"2024-09-14T13:02:24.003466+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'2","last_scrub_stamp":"2024-09-14T13:02:24.003237+0000","last_deep_scrub":"267'2","last_deep_scrub_stamp":"2024-09-14T13:02:24.003237+0000","last_clean_scrub_stamp":"2024-09-14T13:02:24.003237+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:21:44.974939+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1a","version":"267'192","reported_seq":835,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:32.705517+0000","last_change":"2024-09-14T13:02:32.705517+0000","last_active":"2024-09-14T13:02:32.705517+0000","last_peered":"2024-09-14T13:02:32.705517+0000","last_clean":"2024-09-14T13:02:32.705517+0000","last_became_active":"2024-09-14T11:08:27.830707+0000","last_became_peered":"2024-09-14T11:08:27.830707+0000","last_unstale":"2024-09-14T13:02:32.705517+0000","last_undegraded":"2024-09-14T13:02:32.705517+0000","last_fullsized":"2024-09-14T13:02:32.705517+0000","mapping_epoch":30,"log_start":"264'100","ondisk_log_start":"264'100","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'192","last_scrub_stamp":"2024-09-14T13:02:32.705316+0000","last_deep_scrub":"267'192","last_deep_scrub_stamp":"2024-09-14T13:02:32.705316+0000","last_clean_scrub_stamp":"2024-09-14T13:02:32.705316+0000","objects_scrubbed":4,"log_size":92,"log_dups_size":100,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:21:58.094806+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8430,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":268,"num_read_kb":336,"num_write":152,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":529,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:36.162728+0000","last_change":"2024-09-14T13:02:36.162728+0000","last_active":"2024-09-14T13:02:36.162728+0000","last_peered":"2024-09-14T13:02:36.162728+0000","last_clean":"2024-09-14T13:02:36.162728+0000","last_became_active":"2024-09-14T11:08:29.810292+0000","last_became_peered":"2024-09-14T11:08:29.810292+0000","last_unstale":"2024-09-14T13:02:36.162728+0000","last_undegraded":"2024-09-14T13:02:36.162728+0000","last_fullsized":"2024-09-14T13:02:36.162728+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T13:02:36.162509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T13:02:36.162509+0000","last_clean_scrub_stamp":"2024-09-14T13:02:36.162509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T00:17:40.871354+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.14","version":"267'136","reported_seq":671,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:38.671148+0000","last_change":"2024-09-14T13:02:38.671148+0000","last_active":"2024-09-14T13:02:38.671148+0000","last_peered":"2024-09-14T13:02:38.671148+0000","last_clean":"2024-09-14T13:02:38.671148+0000","last_became_active":"2024-09-14T11:08:31.851483+0000","last_became_peered":"2024-09-14T11:08:31.851483+0000","last_unstale":"2024-09-14T13:02:38.671148+0000","last_undegraded":"2024-09-14T13:02:38.671148+0000","last_fullsized":"2024-09-14T13:02:38.671148+0000","mapping_epoch":34,"log_start":"267'100","ondisk_log_start":"267'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'136","last_scrub_stamp":"2024-09-14T13:02:38.670955+0000","last_deep_scrub":"267'136","last_deep_scrub_stamp":"2024-09-14T13:02:38.670955+0000","last_clean_scrub_stamp":"2024-09-14T13:02:38.670955+0000","objects_scrubbed":3,"log_size":36,"log_dups_size":100,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:31:36.294487+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":227,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":142,"num_read_kb":127,"num_write":323,"num_write_kb":76,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.27","version":"267'1176","reported_seq":2963,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:19.058530+0000","last_change":"2024-09-14T13:02:19.058530+0000","last_active":"2024-09-14T13:02:19.058530+0000","last_peered":"2024-09-14T13:02:19.058530+0000","last_clean":"2024-09-14T13:02:19.058530+0000","last_became_active":"2024-09-14T11:08:23.798225+0000","last_became_peered":"2024-09-14T11:08:23.798225+0000","last_unstale":"2024-09-14T13:02:19.058530+0000","last_undegraded":"2024-09-14T13:02:19.058530+0000","last_fullsized":"2024-09-14T13:02:19.058530+0000","mapping_epoch":26,"log_start":"267'1100","ondisk_log_start":"267'1100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'1176","last_scrub_stamp":"2024-09-14T13:02:19.058334+0000","last_deep_scrub":"267'1176","last_deep_scrub_stamp":"2024-09-14T13:02:19.058334+0000","last_clean_scrub_stamp":"2024-09-14T13:02:19.058334+0000","objects_scrubbed":2,"log_size":76,"log_dups_size":1100,"ondisk_log_size":76,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:40:22.783461+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":5564,"num_read_kb":4974,"num_write":1578,"num_write_kb":634,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2045,"num_omap_keys":8,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.20","version":"267'242","reported_seq":1003,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:12.288173+0000","last_change":"2024-09-14T13:02:12.288173+0000","last_active":"2024-09-14T13:02:12.288173+0000","last_peered":"2024-09-14T13:02:12.288173+0000","last_clean":"2024-09-14T13:02:12.288173+0000","last_became_active":"2024-09-14T11:08:21.816270+0000","last_became_peered":"2024-09-14T11:08:21.816270+0000","last_unstale":"2024-09-14T13:02:12.288173+0000","last_undegraded":"2024-09-14T13:02:12.288173+0000","last_fullsized":"2024-09-14T13:02:12.288173+0000","mapping_epoch":24,"log_start":"267'200","ondisk_log_start":"267'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'242","last_scrub_stamp":"2024-09-14T13:02:12.287850+0000","last_deep_scrub":"267'242","last_deep_scrub_stamp":"2024-09-14T13:02:12.287850+0000","last_clean_scrub_stamp":"2024-09-14T13:02:12.287850+0000","objects_scrubbed":1,"log_size":42,"log_dups_size":200,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:26:32.484498+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":896,"num_read_kb":196583,"num_write":965,"num_write_kb":33610,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,7],"acting":[6,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.26","version":"267'1295","reported_seq":2913,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:22.002876+0000","last_change":"2024-09-14T13:02:22.002876+0000","last_active":"2024-09-14T13:02:22.002876+0000","last_peered":"2024-09-14T13:02:22.002876+0000","last_clean":"2024-09-14T13:02:22.002876+0000","last_became_active":"2024-09-14T11:08:23.776349+0000","last_became_peered":"2024-09-14T11:08:23.776349+0000","last_unstale":"2024-09-14T13:02:22.002876+0000","last_undegraded":"2024-09-14T13:02:22.002876+0000","last_fullsized":"2024-09-14T13:02:22.002876+0000","mapping_epoch":26,"log_start":"267'1200","ondisk_log_start":"267'1200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'1295","last_scrub_stamp":"2024-09-14T13:02:22.002702+0000","last_deep_scrub":"267'1295","last_deep_scrub_stamp":"2024-09-14T13:02:22.002702+0000","last_clean_scrub_stamp":"2024-09-14T13:02:22.002702+0000","objects_scrubbed":3,"log_size":95,"log_dups_size":1200,"ondisk_log_size":95,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:05:44.720042+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":5862,"num_read_kb":5174,"num_write":1823,"num_write_kb":798,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.21","version":"267'158","reported_seq":804,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:10.134026+0000","last_change":"2024-09-14T13:02:10.134026+0000","last_active":"2024-09-14T13:02:10.134026+0000","last_peered":"2024-09-14T13:02:10.134026+0000","last_clean":"2024-09-14T13:02:10.134026+0000","last_became_active":"2024-09-14T11:08:21.778857+0000","last_became_peered":"2024-09-14T11:08:21.778857+0000","last_unstale":"2024-09-14T13:02:10.134026+0000","last_undegraded":"2024-09-14T13:02:10.134026+0000","last_fullsized":"2024-09-14T13:02:10.134026+0000","mapping_epoch":24,"log_start":"267'100","ondisk_log_start":"267'100","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'158","last_scrub_stamp":"2024-09-14T13:02:10.133843+0000","last_deep_scrub":"267'158","last_deep_scrub_stamp":"2024-09-14T13:02:10.133843+0000","last_clean_scrub_stamp":"2024-09-14T13:02:10.133843+0000","objects_scrubbed":0,"log_size":58,"log_dups_size":100,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:18:15.041071+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":436,"num_read_kb":8582,"num_write":806,"num_write_kb":19268,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,6],"acting":[2,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.25","version":"267'859","reported_seq":2589,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:25.484480+0000","last_change":"2024-09-14T13:02:25.484480+0000","last_active":"2024-09-14T13:02:25.484480+0000","last_peered":"2024-09-14T13:02:25.484480+0000","last_clean":"2024-09-14T13:02:25.484480+0000","last_became_active":"2024-09-14T11:08:23.808906+0000","last_became_peered":"2024-09-14T11:08:23.808906+0000","last_unstale":"2024-09-14T13:02:25.484480+0000","last_undegraded":"2024-09-14T13:02:25.484480+0000","last_fullsized":"2024-09-14T13:02:25.484480+0000","mapping_epoch":26,"log_start":"267'800","ondisk_log_start":"267'800","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'859","last_scrub_stamp":"2024-09-14T13:02:25.484273+0000","last_deep_scrub":"267'859","last_deep_scrub_stamp":"2024-09-14T13:02:25.484273+0000","last_clean_scrub_stamp":"2024-09-14T13:02:25.484273+0000","objects_scrubbed":3,"log_size":59,"log_dups_size":800,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:24:01.661481+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":4244,"num_read_kb":3835,"num_write":1129,"num_write_kb":418,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1533,"num_omap_keys":6,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.22","version":"267'246","reported_seq":963,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:13.387255+0000","last_change":"2024-09-14T13:02:13.387255+0000","last_active":"2024-09-14T13:02:13.387255+0000","last_peered":"2024-09-14T13:02:13.387255+0000","last_clean":"2024-09-14T13:02:13.387255+0000","last_became_active":"2024-09-14T11:08:21.795735+0000","last_became_peered":"2024-09-14T11:08:21.795735+0000","last_unstale":"2024-09-14T13:02:13.387255+0000","last_undegraded":"2024-09-14T13:02:13.387255+0000","last_fullsized":"2024-09-14T13:02:13.387255+0000","mapping_epoch":24,"log_start":"267'200","ondisk_log_start":"267'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'246","last_scrub_stamp":"2024-09-14T13:02:13.387035+0000","last_deep_scrub":"267'246","last_deep_scrub_stamp":"2024-09-14T13:02:13.387035+0000","last_clean_scrub_stamp":"2024-09-14T13:02:13.387035+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":200,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:34:00.780296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":704,"num_read_kb":92956,"num_write":1120,"num_write_kb":50908,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,0],"acting":[5,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.24","version":"267'426","reported_seq":2063,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:18.062230+0000","last_change":"2024-09-14T13:02:18.062230+0000","last_active":"2024-09-14T13:02:18.062230+0000","last_peered":"2024-09-14T13:02:18.062230+0000","last_clean":"2024-09-14T13:02:18.062230+0000","last_became_active":"2024-09-14T11:08:23.800722+0000","last_became_peered":"2024-09-14T11:08:23.800722+0000","last_unstale":"2024-09-14T13:02:18.062230+0000","last_undegraded":"2024-09-14T13:02:18.062230+0000","last_fullsized":"2024-09-14T13:02:18.062230+0000","mapping_epoch":26,"log_start":"267'400","ondisk_log_start":"267'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'426","last_scrub_stamp":"2024-09-14T13:02:18.062016+0000","last_deep_scrub":"267'426","last_deep_scrub_stamp":"2024-09-14T13:02:18.062016+0000","last_clean_scrub_stamp":"2024-09-14T13:02:18.062016+0000","objects_scrubbed":2,"log_size":26,"log_dups_size":400,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:49:37.783760+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2360,"num_read_kb":2243,"num_write":502,"num_write_kb":106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":252,"num_omap_keys":1,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.23","version":"267'220","reported_seq":902,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:08.038394+0000","last_change":"2024-09-14T13:02:08.038394+0000","last_active":"2024-09-14T13:02:08.038394+0000","last_peered":"2024-09-14T13:02:08.038394+0000","last_clean":"2024-09-14T13:02:08.038394+0000","last_became_active":"2024-09-14T11:08:21.815676+0000","last_became_peered":"2024-09-14T11:08:21.815676+0000","last_unstale":"2024-09-14T13:02:08.038394+0000","last_undegraded":"2024-09-14T13:02:08.038394+0000","last_fullsized":"2024-09-14T13:02:08.038394+0000","mapping_epoch":24,"log_start":"267'200","ondisk_log_start":"267'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'220","last_scrub_stamp":"2024-09-14T13:02:08.038198+0000","last_deep_scrub":"267'220","last_deep_scrub_stamp":"2024-09-14T13:02:08.038198+0000","last_clean_scrub_stamp":"2024-09-14T13:02:08.038198+0000","objects_scrubbed":2,"log_size":20,"log_dups_size":200,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:18:15.605049+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1655835,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":599,"num_read_kb":27875,"num_write":904,"num_write_kb":22739,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"267'896","reported_seq":2688,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:21.907268+0000","last_change":"2024-09-14T13:02:21.907268+0000","last_active":"2024-09-14T13:02:21.907268+0000","last_peered":"2024-09-14T13:02:21.907268+0000","last_clean":"2024-09-14T13:02:21.907268+0000","last_became_active":"2024-09-14T11:08:23.801373+0000","last_became_peered":"2024-09-14T11:08:23.801373+0000","last_unstale":"2024-09-14T13:02:21.907268+0000","last_undegraded":"2024-09-14T13:02:21.907268+0000","last_fullsized":"2024-09-14T13:02:21.907268+0000","mapping_epoch":26,"log_start":"267'800","ondisk_log_start":"267'800","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'896","last_scrub_stamp":"2024-09-14T13:02:21.907091+0000","last_deep_scrub":"267'896","last_deep_scrub_stamp":"2024-09-14T13:02:21.907091+0000","last_clean_scrub_stamp":"2024-09-14T13:02:21.907091+0000","objects_scrubbed":2,"log_size":96,"log_dups_size":800,"ondisk_log_size":96,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:05:33.862894+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":4489,"num_read_kb":4053,"num_write":1182,"num_write_kb":453,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2299,"num_omap_keys":9,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.24","version":"267'181","reported_seq":864,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:13.912432+0000","last_change":"2024-09-14T13:02:13.912432+0000","last_active":"2024-09-14T13:02:13.912432+0000","last_peered":"2024-09-14T13:02:13.912432+0000","last_clean":"2024-09-14T13:02:13.912432+0000","last_became_active":"2024-09-14T11:08:21.815768+0000","last_became_peered":"2024-09-14T11:08:21.815768+0000","last_unstale":"2024-09-14T13:02:13.912432+0000","last_undegraded":"2024-09-14T13:02:13.912432+0000","last_fullsized":"2024-09-14T13:02:13.912432+0000","mapping_epoch":24,"log_start":"267'100","ondisk_log_start":"267'100","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'181","last_scrub_stamp":"2024-09-14T13:02:13.912218+0000","last_deep_scrub":"267'181","last_deep_scrub_stamp":"2024-09-14T13:02:13.912218+0000","last_clean_scrub_stamp":"2024-09-14T13:02:13.912218+0000","objects_scrubbed":2,"log_size":81,"log_dups_size":100,"ondisk_log_size":81,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:34:44.221033+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":52,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":600,"num_read_kb":27323,"num_write":897,"num_write_kb":11503,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,0],"acting":[3,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"267'442","reported_seq":2006,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:19.739812+0000","last_change":"2024-09-14T13:02:19.739812+0000","last_active":"2024-09-14T13:02:19.739812+0000","last_peered":"2024-09-14T13:02:19.739812+0000","last_clean":"2024-09-14T13:02:19.739812+0000","last_became_active":"2024-09-14T11:08:23.814703+0000","last_became_peered":"2024-09-14T11:08:23.814703+0000","last_unstale":"2024-09-14T13:02:19.739812+0000","last_undegraded":"2024-09-14T13:02:19.739812+0000","last_fullsized":"2024-09-14T13:02:19.739812+0000","mapping_epoch":26,"log_start":"267'400","ondisk_log_start":"267'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'442","last_scrub_stamp":"2024-09-14T13:02:19.739631+0000","last_deep_scrub":"267'442","last_deep_scrub_stamp":"2024-09-14T13:02:19.739631+0000","last_clean_scrub_stamp":"2024-09-14T13:02:19.739631+0000","objects_scrubbed":1,"log_size":42,"log_dups_size":400,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:51:34.828557+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2315,"num_read_kb":2173,"num_write":509,"num_write_kb":111,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.25","version":"267'228","reported_seq":884,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:14.008418+0000","last_change":"2024-09-14T13:02:14.008418+0000","last_active":"2024-09-14T13:02:14.008418+0000","last_peered":"2024-09-14T13:02:14.008418+0000","last_clean":"2024-09-14T13:02:14.008418+0000","last_became_active":"2024-09-14T11:08:21.782389+0000","last_became_peered":"2024-09-14T11:08:21.782389+0000","last_unstale":"2024-09-14T13:02:14.008418+0000","last_undegraded":"2024-09-14T13:02:14.008418+0000","last_fullsized":"2024-09-14T13:02:14.008418+0000","mapping_epoch":24,"log_start":"267'200","ondisk_log_start":"267'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'228","last_scrub_stamp":"2024-09-14T13:02:14.008210+0000","last_deep_scrub":"267'228","last_deep_scrub_stamp":"2024-09-14T13:02:14.008210+0000","last_clean_scrub_stamp":"2024-09-14T13:02:14.008210+0000","objects_scrubbed":1,"log_size":28,"log_dups_size":200,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:24:23.674651+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":471,"num_read_kb":9844,"num_write":870,"num_write_kb":38372,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"267'1243","reported_seq":2976,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:19.912958+0000","last_change":"2024-09-14T13:02:19.912958+0000","last_active":"2024-09-14T13:02:19.912958+0000","last_peered":"2024-09-14T13:02:19.912958+0000","last_clean":"2024-09-14T13:02:19.912958+0000","last_became_active":"2024-09-14T11:08:23.785820+0000","last_became_peered":"2024-09-14T11:08:23.785820+0000","last_unstale":"2024-09-14T13:02:19.912958+0000","last_undegraded":"2024-09-14T13:02:19.912958+0000","last_fullsized":"2024-09-14T13:02:19.912958+0000","mapping_epoch":26,"log_start":"267'1200","ondisk_log_start":"267'1200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'1243","last_scrub_stamp":"2024-09-14T13:02:19.912720+0000","last_deep_scrub":"267'1243","last_deep_scrub_stamp":"2024-09-14T13:02:19.912720+0000","last_clean_scrub_stamp":"2024-09-14T13:02:19.912720+0000","objects_scrubbed":2,"log_size":43,"log_dups_size":1200,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:30:14.834421+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":5731,"num_read_kb":5079,"num_write":1712,"num_write_kb":696,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"267'214","reported_seq":938,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:11.283668+0000","last_change":"2024-09-14T13:02:11.283668+0000","last_active":"2024-09-14T13:02:11.283668+0000","last_peered":"2024-09-14T13:02:11.283668+0000","last_clean":"2024-09-14T13:02:11.283668+0000","last_became_active":"2024-09-14T11:08:21.824946+0000","last_became_peered":"2024-09-14T11:08:21.824946+0000","last_unstale":"2024-09-14T13:02:11.283668+0000","last_undegraded":"2024-09-14T13:02:11.283668+0000","last_fullsized":"2024-09-14T13:02:11.283668+0000","mapping_epoch":24,"log_start":"267'200","ondisk_log_start":"267'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'214","last_scrub_stamp":"2024-09-14T13:02:11.283441+0000","last_deep_scrub":"267'214","last_deep_scrub_stamp":"2024-09-14T13:02:11.283441+0000","last_clean_scrub_stamp":"2024-09-14T13:02:11.283441+0000","objects_scrubbed":4,"log_size":14,"log_dups_size":200,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T00:21:45.775876+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1655864,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":770,"num_read_kb":179397,"num_write":979,"num_write_kb":35238,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,4],"acting":[6,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.20","version":"267'1216","reported_seq":2946,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:18.359791+0000","last_change":"2024-09-14T13:02:18.359791+0000","last_active":"2024-09-14T13:02:18.359791+0000","last_peered":"2024-09-14T13:02:18.359791+0000","last_clean":"2024-09-14T13:02:18.359791+0000","last_became_active":"2024-09-14T11:08:23.803960+0000","last_became_peered":"2024-09-14T11:08:23.803960+0000","last_unstale":"2024-09-14T13:02:18.359791+0000","last_undegraded":"2024-09-14T13:02:18.359791+0000","last_fullsized":"2024-09-14T13:02:18.359791+0000","mapping_epoch":26,"log_start":"267'1200","ondisk_log_start":"267'1200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'1216","last_scrub_stamp":"2024-09-14T13:02:18.359610+0000","last_deep_scrub":"267'1216","last_deep_scrub_stamp":"2024-09-14T13:02:18.359610+0000","last_clean_scrub_stamp":"2024-09-14T13:02:18.359610+0000","objects_scrubbed":2,"log_size":16,"log_dups_size":1200,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:52:39.823830+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":5500,"num_read_kb":4892,"num_write":1634,"num_write_kb":643,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"267'220","reported_seq":879,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:12.010009+0000","last_change":"2024-09-14T13:02:12.010009+0000","last_active":"2024-09-14T13:02:12.010009+0000","last_peered":"2024-09-14T13:02:12.010009+0000","last_clean":"2024-09-14T13:02:12.010009+0000","last_became_active":"2024-09-14T11:08:56.033948+0000","last_became_peered":"2024-09-14T11:08:56.033948+0000","last_unstale":"2024-09-14T13:02:12.010009+0000","last_undegraded":"2024-09-14T13:02:12.010009+0000","last_fullsized":"2024-09-14T13:02:12.010009+0000","mapping_epoch":37,"log_start":"267'200","ondisk_log_start":"267'200","created":24,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'220","last_scrub_stamp":"2024-09-14T13:02:12.009666+0000","last_deep_scrub":"267'220","last_deep_scrub_stamp":"2024-09-14T13:02:12.009666+0000","last_clean_scrub_stamp":"2024-09-14T13:02:12.009666+0000","objects_scrubbed":2,"log_size":20,"log_dups_size":200,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:53:42.148559+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":41,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":570,"num_read_kb":57833,"num_write":1049,"num_write_kb":21583,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,2],"acting":[1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2f","version":"267'434","reported_seq":2053,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:17.078542+0000","last_change":"2024-09-14T13:02:17.078542+0000","last_active":"2024-09-14T13:02:17.078542+0000","last_peered":"2024-09-14T13:02:17.078542+0000","last_clean":"2024-09-14T13:02:17.078542+0000","last_became_active":"2024-09-14T11:08:23.786094+0000","last_became_peered":"2024-09-14T11:08:23.786094+0000","last_unstale":"2024-09-14T13:02:17.078542+0000","last_undegraded":"2024-09-14T13:02:17.078542+0000","last_fullsized":"2024-09-14T13:02:17.078542+0000","mapping_epoch":26,"log_start":"267'400","ondisk_log_start":"267'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'434","last_scrub_stamp":"2024-09-14T13:02:17.078358+0000","last_deep_scrub":"267'434","last_deep_scrub_stamp":"2024-09-14T13:02:17.078358+0000","last_clean_scrub_stamp":"2024-09-14T13:02:17.078358+0000","objects_scrubbed":1,"log_size":34,"log_dups_size":400,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T00:39:36.056692+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2284,"num_read_kb":2174,"num_write":475,"num_write_kb":81,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.28","version":"267'239","reported_seq":919,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:15.368994+0000","last_change":"2024-09-14T13:02:15.368994+0000","last_active":"2024-09-14T13:02:15.368994+0000","last_peered":"2024-09-14T13:02:15.368994+0000","last_clean":"2024-09-14T13:02:15.368994+0000","last_became_active":"2024-09-14T11:08:21.789114+0000","last_became_peered":"2024-09-14T11:08:21.789114+0000","last_unstale":"2024-09-14T13:02:15.368994+0000","last_undegraded":"2024-09-14T13:02:15.368994+0000","last_fullsized":"2024-09-14T13:02:15.368994+0000","mapping_epoch":24,"log_start":"267'200","ondisk_log_start":"267'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'239","last_scrub_stamp":"2024-09-14T13:02:15.368736+0000","last_deep_scrub":"267'239","last_deep_scrub_stamp":"2024-09-14T13:02:15.368736+0000","last_clean_scrub_stamp":"2024-09-14T13:02:15.368736+0000","objects_scrubbed":1,"log_size":39,"log_dups_size":200,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:43:13.070998+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":15,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":593,"num_read_kb":44666,"num_write":1104,"num_write_kb":41456,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,2],"acting":[5,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2e","version":"267'453","reported_seq":2219,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:21.736679+0000","last_change":"2024-09-14T13:02:21.736679+0000","last_active":"2024-09-14T13:02:21.736679+0000","last_peered":"2024-09-14T13:02:21.736679+0000","last_clean":"2024-09-14T13:02:21.736679+0000","last_became_active":"2024-09-14T11:08:23.792081+0000","last_became_peered":"2024-09-14T11:08:23.792081+0000","last_unstale":"2024-09-14T13:02:21.736679+0000","last_undegraded":"2024-09-14T13:02:21.736679+0000","last_fullsized":"2024-09-14T13:02:21.736679+0000","mapping_epoch":26,"log_start":"267'400","ondisk_log_start":"267'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'453","last_scrub_stamp":"2024-09-14T13:02:21.736487+0000","last_deep_scrub":"267'453","last_deep_scrub_stamp":"2024-09-14T13:02:21.736487+0000","last_clean_scrub_stamp":"2024-09-14T13:02:21.736487+0000","objects_scrubbed":2,"log_size":53,"log_dups_size":400,"ondisk_log_size":53,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:03:31.698697+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2579,"num_read_kb":2481,"num_write":491,"num_write_kb":76,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":220,"num_omap_keys":1,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.29","version":"267'201","reported_seq":905,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:14.155576+0000","last_change":"2024-09-14T13:02:14.155576+0000","last_active":"2024-09-14T13:02:14.155576+0000","last_peered":"2024-09-14T13:02:14.155576+0000","last_clean":"2024-09-14T13:02:14.155576+0000","last_became_active":"2024-09-14T11:08:56.039007+0000","last_became_peered":"2024-09-14T11:08:56.039007+0000","last_unstale":"2024-09-14T13:02:14.155576+0000","last_undegraded":"2024-09-14T13:02:14.155576+0000","last_fullsized":"2024-09-14T13:02:14.155576+0000","mapping_epoch":37,"log_start":"267'100","ondisk_log_start":"267'100","created":24,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'201","last_scrub_stamp":"2024-09-14T13:02:14.155355+0000","last_deep_scrub":"267'201","last_deep_scrub_stamp":"2024-09-14T13:02:14.155355+0000","last_clean_scrub_stamp":"2024-09-14T13:02:14.155355+0000","objects_scrubbed":0,"log_size":101,"log_dups_size":100,"ondisk_log_size":101,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:51:47.112960+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":677,"num_read_kb":34418,"num_write":912,"num_write_kb":30711,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4,1],"acting":[2,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2d","version":"267'383","reported_seq":1953,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:16.174203+0000","last_change":"2024-09-14T13:02:16.174203+0000","last_active":"2024-09-14T13:02:16.174203+0000","last_peered":"2024-09-14T13:02:16.174203+0000","last_clean":"2024-09-14T13:02:16.174203+0000","last_became_active":"2024-09-14T11:08:23.806568+0000","last_became_peered":"2024-09-14T11:08:23.806568+0000","last_unstale":"2024-09-14T13:02:16.174203+0000","last_undegraded":"2024-09-14T13:02:16.174203+0000","last_fullsized":"2024-09-14T13:02:16.174203+0000","mapping_epoch":26,"log_start":"267'300","ondisk_log_start":"267'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'383","last_scrub_stamp":"2024-09-14T13:02:16.173997+0000","last_deep_scrub":"267'383","last_deep_scrub_stamp":"2024-09-14T13:02:16.173997+0000","last_clean_scrub_stamp":"2024-09-14T13:02:16.173997+0000","objects_scrubbed":1,"log_size":83,"log_dups_size":300,"ondisk_log_size":83,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:32:46.305855+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2181,"num_read_kb":2088,"num_write":442,"num_write_kb":83,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":244,"num_omap_keys":1,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2a","version":"267'214","reported_seq":858,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:16.413733+0000","last_change":"2024-09-14T13:02:16.413733+0000","last_active":"2024-09-14T13:02:16.413733+0000","last_peered":"2024-09-14T13:02:16.413733+0000","last_clean":"2024-09-14T13:02:16.413733+0000","last_became_active":"2024-09-14T11:08:55.882680+0000","last_became_peered":"2024-09-14T11:08:55.882680+0000","last_unstale":"2024-09-14T13:02:16.413733+0000","last_undegraded":"2024-09-14T13:02:16.413733+0000","last_fullsized":"2024-09-14T13:02:16.413733+0000","mapping_epoch":37,"log_start":"267'200","ondisk_log_start":"267'200","created":24,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'214","last_scrub_stamp":"2024-09-14T13:02:16.413519+0000","last_deep_scrub":"267'214","last_deep_scrub_stamp":"2024-09-14T13:02:16.413519+0000","last_clean_scrub_stamp":"2024-09-14T13:02:16.413519+0000","objects_scrubbed":3,"log_size":14,"log_dups_size":200,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:42:07.787664+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1655850,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":491,"num_read_kb":10245,"num_write":964,"num_write_kb":42313,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,1],"acting":[5,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2c","version":"267'620","reported_seq":2469,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:20.699544+0000","last_change":"2024-09-14T13:02:20.699544+0000","last_active":"2024-09-14T13:02:20.699544+0000","last_peered":"2024-09-14T13:02:20.699544+0000","last_clean":"2024-09-14T13:02:20.699544+0000","last_became_active":"2024-09-14T11:08:23.815121+0000","last_became_peered":"2024-09-14T11:08:23.815121+0000","last_unstale":"2024-09-14T13:02:20.699544+0000","last_undegraded":"2024-09-14T13:02:20.699544+0000","last_fullsized":"2024-09-14T13:02:20.699544+0000","mapping_epoch":26,"log_start":"267'600","ondisk_log_start":"267'600","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'620","last_scrub_stamp":"2024-09-14T13:02:20.699374+0000","last_deep_scrub":"267'620","last_deep_scrub_stamp":"2024-09-14T13:02:20.699374+0000","last_clean_scrub_stamp":"2024-09-14T13:02:20.699374+0000","objects_scrubbed":3,"log_size":20,"log_dups_size":600,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:26:58.705973+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3483,"num_read_kb":3244,"num_write":793,"num_write_kb":264,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2264,"num_omap_keys":9,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2b","version":"267'200","reported_seq":854,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:07.028318+0000","last_change":"2024-09-14T13:02:07.028318+0000","last_active":"2024-09-14T13:02:07.028318+0000","last_peered":"2024-09-14T13:02:07.028318+0000","last_clean":"2024-09-14T13:02:07.028318+0000","last_became_active":"2024-09-14T11:08:21.788281+0000","last_became_peered":"2024-09-14T11:08:21.788281+0000","last_unstale":"2024-09-14T13:02:07.028318+0000","last_undegraded":"2024-09-14T13:02:07.028318+0000","last_fullsized":"2024-09-14T13:02:07.028318+0000","mapping_epoch":24,"log_start":"267'100","ondisk_log_start":"267'100","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'200","last_scrub_stamp":"2024-09-14T13:02:07.028196+0000","last_deep_scrub":"267'200","last_deep_scrub_stamp":"2024-09-14T13:02:07.028196+0000","last_clean_scrub_stamp":"2024-09-14T13:02:07.028196+0000","objects_scrubbed":2,"log_size":100,"log_dups_size":100,"ondisk_log_size":100,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:49:29.752326+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":52,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":436,"num_read_kb":38929,"num_write":900,"num_write_kb":25858,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,1],"acting":[0,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2b","version":"267'916","reported_seq":2525,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:22.632478+0000","last_change":"2024-09-14T13:02:22.632478+0000","last_active":"2024-09-14T13:02:22.632478+0000","last_peered":"2024-09-14T13:02:22.632478+0000","last_clean":"2024-09-14T13:02:22.632478+0000","last_became_active":"2024-09-14T11:08:23.806952+0000","last_became_peered":"2024-09-14T11:08:23.806952+0000","last_unstale":"2024-09-14T13:02:22.632478+0000","last_undegraded":"2024-09-14T13:02:22.632478+0000","last_fullsized":"2024-09-14T13:02:22.632478+0000","mapping_epoch":26,"log_start":"267'900","ondisk_log_start":"267'900","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'916","last_scrub_stamp":"2024-09-14T13:02:22.632309+0000","last_deep_scrub":"267'916","last_deep_scrub_stamp":"2024-09-14T13:02:22.632309+0000","last_clean_scrub_stamp":"2024-09-14T13:02:22.632309+0000","objects_scrubbed":4,"log_size":16,"log_dups_size":900,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:53:03.488492+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":4419,"num_read_kb":3921,"num_write":1287,"num_write_kb":515,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":267,"num_omap_keys":1,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"267'231","reported_seq":913,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:13.270037+0000","last_change":"2024-09-14T13:02:13.270037+0000","last_active":"2024-09-14T13:02:13.270037+0000","last_peered":"2024-09-14T13:02:13.270037+0000","last_clean":"2024-09-14T13:02:13.270037+0000","last_became_active":"2024-09-14T11:08:21.836420+0000","last_became_peered":"2024-09-14T11:08:21.836420+0000","last_unstale":"2024-09-14T13:02:13.270037+0000","last_undegraded":"2024-09-14T13:02:13.270037+0000","last_fullsized":"2024-09-14T13:02:13.270037+0000","mapping_epoch":24,"log_start":"267'200","ondisk_log_start":"267'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'231","last_scrub_stamp":"2024-09-14T13:02:13.269834+0000","last_deep_scrub":"267'231","last_deep_scrub_stamp":"2024-09-14T13:02:13.269834+0000","last_clean_scrub_stamp":"2024-09-14T13:02:13.269834+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":200,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:47:11.483558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":678,"num_read_kb":43780,"num_write":1054,"num_write_kb":42822,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.2a","version":"267'459","reported_seq":2096,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:13.094279+0000","last_change":"2024-09-14T13:02:13.094279+0000","last_active":"2024-09-14T13:02:13.094279+0000","last_peered":"2024-09-14T13:02:13.094279+0000","last_clean":"2024-09-14T13:02:13.094279+0000","last_became_active":"2024-09-14T11:08:23.776554+0000","last_became_peered":"2024-09-14T11:08:23.776554+0000","last_unstale":"2024-09-14T13:02:13.094279+0000","last_undegraded":"2024-09-14T13:02:13.094279+0000","last_fullsized":"2024-09-14T13:02:13.094279+0000","mapping_epoch":26,"log_start":"267'400","ondisk_log_start":"267'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'459","last_scrub_stamp":"2024-09-14T13:02:13.094066+0000","last_deep_scrub":"267'459","last_deep_scrub_stamp":"2024-09-14T13:02:13.094066+0000","last_clean_scrub_stamp":"2024-09-14T13:02:13.094066+0000","objects_scrubbed":2,"log_size":59,"log_dups_size":400,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:03:41.733902+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2491,"num_read_kb":2349,"num_write":540,"num_write_kb":122,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2d","version":"267'208","reported_seq":864,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:15.639487+0000","last_change":"2024-09-14T13:02:15.639487+0000","last_active":"2024-09-14T13:02:15.639487+0000","last_peered":"2024-09-14T13:02:15.639487+0000","last_clean":"2024-09-14T13:02:15.639487+0000","last_became_active":"2024-09-14T11:08:21.828333+0000","last_became_peered":"2024-09-14T11:08:21.828333+0000","last_unstale":"2024-09-14T13:02:15.639487+0000","last_undegraded":"2024-09-14T13:02:15.639487+0000","last_fullsized":"2024-09-14T13:02:15.639487+0000","mapping_epoch":24,"log_start":"267'100","ondisk_log_start":"267'100","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'208","last_scrub_stamp":"2024-09-14T13:02:15.639239+0000","last_deep_scrub":"267'208","last_deep_scrub_stamp":"2024-09-14T13:02:15.639239+0000","last_clean_scrub_stamp":"2024-09-14T13:02:15.639239+0000","objects_scrubbed":2,"log_size":108,"log_dups_size":100,"ondisk_log_size":108,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:07:15.141985+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":26,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":514,"num_read_kb":35640,"num_write":904,"num_write_kb":31502,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,6],"acting":[7,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.29","version":"267'786","reported_seq":2517,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:28.948747+0000","last_change":"2024-09-14T13:02:28.948747+0000","last_active":"2024-09-14T13:02:28.948747+0000","last_peered":"2024-09-14T13:02:28.948747+0000","last_clean":"2024-09-14T13:02:28.948747+0000","last_became_active":"2024-09-14T11:08:23.783522+0000","last_became_peered":"2024-09-14T11:08:23.783522+0000","last_unstale":"2024-09-14T13:02:28.948747+0000","last_undegraded":"2024-09-14T13:02:28.948747+0000","last_fullsized":"2024-09-14T13:02:28.948747+0000","mapping_epoch":26,"log_start":"267'700","ondisk_log_start":"267'700","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'786","last_scrub_stamp":"2024-09-14T13:02:28.948565+0000","last_deep_scrub":"267'786","last_deep_scrub_stamp":"2024-09-14T13:02:28.948565+0000","last_clean_scrub_stamp":"2024-09-14T13:02:28.948565+0000","objects_scrubbed":3,"log_size":86,"log_dups_size":700,"ondisk_log_size":86,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T00:05:57.662593+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":4481,"num_read_kb":4083,"num_write":1109,"num_write_kb":423,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"267'190","reported_seq":884,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:15.180254+0000","last_change":"2024-09-14T13:02:15.180078+0000","last_active":"2024-09-14T13:02:15.180254+0000","last_peered":"2024-09-14T13:02:15.180254+0000","last_clean":"2024-09-14T13:02:15.180254+0000","last_became_active":"2024-09-14T11:08:21.808348+0000","last_became_peered":"2024-09-14T11:08:21.808348+0000","last_unstale":"2024-09-14T13:02:15.180254+0000","last_undegraded":"2024-09-14T13:02:15.180254+0000","last_fullsized":"2024-09-14T13:02:15.180254+0000","mapping_epoch":24,"log_start":"267'100","ondisk_log_start":"267'100","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'190","last_scrub_stamp":"2024-09-14T13:02:15.179872+0000","last_deep_scrub":"267'190","last_deep_scrub_stamp":"2024-09-14T13:02:15.179872+0000","last_clean_scrub_stamp":"2024-09-14T13:02:15.179872+0000","objects_scrubbed":2,"log_size":90,"log_dups_size":100,"ondisk_log_size":90,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:01:20.740863+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":26,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":617,"num_read_kb":79967,"num_write":853,"num_write_kb":37043,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,1],"acting":[2,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"267'413","reported_seq":2123,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:21.644417+0000","last_change":"2024-09-14T13:02:21.644417+0000","last_active":"2024-09-14T13:02:21.644417+0000","last_peered":"2024-09-14T13:02:21.644417+0000","last_clean":"2024-09-14T13:02:21.644417+0000","last_became_active":"2024-09-14T11:08:23.802357+0000","last_became_peered":"2024-09-14T11:08:23.802357+0000","last_unstale":"2024-09-14T13:02:21.644417+0000","last_undegraded":"2024-09-14T13:02:21.644417+0000","last_fullsized":"2024-09-14T13:02:21.644417+0000","mapping_epoch":26,"log_start":"267'400","ondisk_log_start":"267'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'413","last_scrub_stamp":"2024-09-14T13:02:21.644233+0000","last_deep_scrub":"267'413","last_deep_scrub_stamp":"2024-09-14T13:02:21.644233+0000","last_clean_scrub_stamp":"2024-09-14T13:02:21.644233+0000","objects_scrubbed":2,"log_size":13,"log_dups_size":400,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:28:20.653691+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2549,"num_read_kb":2448,"num_write":474,"num_write_kb":95,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":640,"num_omap_keys":3,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2f","version":"267'225","reported_seq":958,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:17.443355+0000","last_change":"2024-09-14T13:02:17.443094+0000","last_active":"2024-09-14T13:02:17.443355+0000","last_peered":"2024-09-14T13:02:17.443355+0000","last_clean":"2024-09-14T13:02:17.443355+0000","last_became_active":"2024-09-14T11:08:55.884851+0000","last_became_peered":"2024-09-14T11:08:55.884851+0000","last_unstale":"2024-09-14T13:02:17.443355+0000","last_undegraded":"2024-09-14T13:02:17.443355+0000","last_fullsized":"2024-09-14T13:02:17.443355+0000","mapping_epoch":37,"log_start":"267'200","ondisk_log_start":"267'200","created":24,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'225","last_scrub_stamp":"2024-09-14T13:02:17.442773+0000","last_deep_scrub":"267'225","last_deep_scrub_stamp":"2024-09-14T13:02:17.442773+0000","last_clean_scrub_stamp":"2024-09-14T13:02:17.442773+0000","objects_scrubbed":4,"log_size":25,"log_dups_size":200,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T00:39:22.131524+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":41,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":799,"num_read_kb":23166,"num_write":1000,"num_write_kb":40111,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,1],"acting":[5,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"267'231","reported_seq":927,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:18.476013+0000","last_change":"2024-09-14T13:02:18.475827+0000","last_active":"2024-09-14T13:02:18.476013+0000","last_peered":"2024-09-14T13:02:18.476013+0000","last_clean":"2024-09-14T13:02:18.476013+0000","last_became_active":"2024-09-14T11:08:56.033792+0000","last_became_peered":"2024-09-14T11:08:56.033792+0000","last_unstale":"2024-09-14T13:02:18.476013+0000","last_undegraded":"2024-09-14T13:02:18.476013+0000","last_fullsized":"2024-09-14T13:02:18.476013+0000","mapping_epoch":37,"log_start":"267'200","ondisk_log_start":"267'200","created":24,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'231","last_scrub_stamp":"2024-09-14T13:02:18.475601+0000","last_deep_scrub":"267'231","last_deep_scrub_stamp":"2024-09-14T13:02:18.475601+0000","last_clean_scrub_stamp":"2024-09-14T13:02:18.475601+0000","objects_scrubbed":5,"log_size":31,"log_dups_size":200,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:44:49.980682+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":26,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":576,"num_read_kb":92149,"num_write":1016,"num_write_kb":50173,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,0],"acting":[5,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.37","version":"267'502","reported_seq":2186,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:21.955388+0000","last_change":"2024-09-14T13:02:21.955235+0000","last_active":"2024-09-14T13:02:21.955388+0000","last_peered":"2024-09-14T13:02:21.955388+0000","last_clean":"2024-09-14T13:02:21.955388+0000","last_became_active":"2024-09-14T11:08:23.786473+0000","last_became_peered":"2024-09-14T11:08:23.786473+0000","last_unstale":"2024-09-14T13:02:21.955388+0000","last_undegraded":"2024-09-14T13:02:21.955388+0000","last_fullsized":"2024-09-14T13:02:21.955388+0000","mapping_epoch":26,"log_start":"267'400","ondisk_log_start":"267'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'502","last_scrub_stamp":"2024-09-14T13:02:21.955052+0000","last_deep_scrub":"267'502","last_deep_scrub_stamp":"2024-09-14T13:02:21.955052+0000","last_clean_scrub_stamp":"2024-09-14T13:02:21.955052+0000","objects_scrubbed":2,"log_size":102,"log_dups_size":400,"ondisk_log_size":102,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:16:43.466742+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2870,"num_read_kb":2681,"num_write":627,"num_write_kb":170,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":219,"num_omap_keys":1,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"267'229","reported_seq":908,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:10.024446+0000","last_change":"2024-09-14T13:02:10.024200+0000","last_active":"2024-09-14T13:02:10.024446+0000","last_peered":"2024-09-14T13:02:10.024446+0000","last_clean":"2024-09-14T13:02:10.024446+0000","last_became_active":"2024-09-14T11:08:21.815731+0000","last_became_peered":"2024-09-14T11:08:21.815731+0000","last_unstale":"2024-09-14T13:02:10.024446+0000","last_undegraded":"2024-09-14T13:02:10.024446+0000","last_fullsized":"2024-09-14T13:02:10.024446+0000","mapping_epoch":24,"log_start":"267'200","ondisk_log_start":"267'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'229","last_scrub_stamp":"2024-09-14T13:02:10.023871+0000","last_deep_scrub":"267'229","last_deep_scrub_stamp":"2024-09-14T13:02:10.023871+0000","last_clean_scrub_stamp":"2024-09-14T13:02:10.023871+0000","objects_scrubbed":3,"log_size":29,"log_dups_size":200,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:09:15.766050+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":31,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":597,"num_read_kb":25561,"num_write":1006,"num_write_kb":42149,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,5],"acting":[1,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.36","version":"267'908","reported_seq":2503,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:24.440484+0000","last_change":"2024-09-14T13:02:24.440484+0000","last_active":"2024-09-14T13:02:24.440484+0000","last_peered":"2024-09-14T13:02:24.440484+0000","last_clean":"2024-09-14T13:02:24.440484+0000","last_became_active":"2024-09-14T11:08:23.797135+0000","last_became_peered":"2024-09-14T11:08:23.797135+0000","last_unstale":"2024-09-14T13:02:24.440484+0000","last_undegraded":"2024-09-14T13:02:24.440484+0000","last_fullsized":"2024-09-14T13:02:24.440484+0000","mapping_epoch":26,"log_start":"267'800","ondisk_log_start":"267'800","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'908","last_scrub_stamp":"2024-09-14T13:02:24.440300+0000","last_deep_scrub":"267'908","last_deep_scrub_stamp":"2024-09-14T13:02:24.440300+0000","last_clean_scrub_stamp":"2024-09-14T13:02:24.440300+0000","objects_scrubbed":1,"log_size":108,"log_dups_size":800,"ondisk_log_size":108,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:55:55.201914+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4302,"num_read_kb":3816,"num_write":1266,"num_write_kb":491,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]}],"pool_stats":[{"poolid":65,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10893,"num_read_kb":9222,"num_write":3117,"num_write_kb":1014,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1012,"ondisk_log_size":1012,"up":64,"acting":64,"num_store_stats":8},{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":14831,"num_objects":87,"num_object_clones":0,"num_object_copies":174,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":87,"num_whiteouts":0,"num_read":15223,"num_read_kb":14878,"num_write":17077,"num_write_kb":4995,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":19,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2512,"num_omap_keys":16,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":557056,"data_stored":29662,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1682,"ondisk_log_size":1682,"up":64,"acting":64,"num_store_stats":8},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":471,"ondisk_log_size":471,"up":64,"acting":64,"num_store_stats":8},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":416072,"num_objects":199,"num_object_clones":0,"num_object_copies":398,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":199,"num_whiteouts":0,"num_read":11985,"num_read_kb":14520,"num_write":8681,"num_write_kb":3819,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":23,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":713660,"num_omap_keys":1632,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":278528,"data_stored":7404,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2096,"ondisk_log_size":2096,"up":64,"acting":64,"num_store_stats":8},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":1793,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":2383,"num_read_kb":2845,"num_write":20,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":3586,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":17,"ondisk_log_size":17,"up":64,"acting":64,"num_store_stats":8},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":143,"num_object_clones":0,"num_object_copies":286,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":143,"num_whiteouts":0,"num_read":221865,"num_read_kb":203092,"num_write":56157,"num_write_kb":19250,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":143,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":35486,"num_omap_keys":143,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3618,"ondisk_log_size":3618,"up":128,"acting":128,"num_store_stats":8},{"poolid":68,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":12,"num_read_kb":12,"num_write":18,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":376,"num_omap_keys":4,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":8,"ondisk_log_size":8,"up":64,"acting":64,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":34033097,"num_objects":166,"num_object_clones":0,"num_object_copies":498,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":166,"num_whiteouts":0,"num_read":42946,"num_read_kb":2820718,"num_write":64530,"num_write_kb":2216242,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":52617216,"data_stored":52617216,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3536,"ondisk_log_size":3536,"up":192,"acting":192,"num_store_stats":8},{"poolid":67,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":172,"num_read_kb":198130,"num_write":186,"num_write_kb":125738,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":126,"ondisk_log_size":126,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":5,"ondisk_log_size":5,"up":16,"acting":16,"num_store_stats":7},{"poolid":66,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":168,"num_read_kb":188216,"num_write":186,"num_write_kb":125738,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":126,"ondisk_log_size":126,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":74,"ondisk_log_size":74,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834576226,"num_pgs":106,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":255424,"kb_used_data":13232,"kb_used_omap":1,"kb_used_meta":242174,"kb_avail":94116416,"statfs":{"total":96636764160,"available":96375209984,"internally_reserved":0,"allocated":13549568,"data_stored":11411092,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":247986634},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":13,"seq":55834576232,"num_pgs":99,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":242596,"kb_used_data":8724,"kb_used_omap":1,"kb_used_meta":233854,"kb_avail":94129244,"statfs":{"total":96636764160,"available":96388345856,"internally_reserved":0,"allocated":8933376,"data_stored":6850023,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":239466950},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":13,"seq":55834576230,"num_pgs":103,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":91384,"kb_used_data":10216,"kb_used_omap":1,"kb_used_meta":81150,"kb_avail":94280456,"statfs":{"total":96636764160,"available":96543186944,"internally_reserved":0,"allocated":10461184,"data_stored":8310166,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":83098053},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834576231,"num_pgs":105,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":121100,"kb_used_data":13564,"kb_used_omap":1,"kb_used_meta":107518,"kb_avail":94250740,"statfs":{"total":96636764160,"available":96512757760,"internally_reserved":0,"allocated":13889536,"data_stored":11826037,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":110098885},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":13,"seq":55834576233,"num_pgs":124,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":239884,"kb_used_data":10172,"kb_used_omap":1,"kb_used_meta":229694,"kb_avail":94131956,"statfs":{"total":96636764160,"available":96391122944,"internally_reserved":0,"allocated":10416128,"data_stored":8289369,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":235207111},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834576230,"num_pgs":92,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":97412,"kb_used_data":7924,"kb_used_omap":1,"kb_used_meta":89470,"kb_avail":94274428,"statfs":{"total":96636764160,"available":96537014272,"internally_reserved":0,"allocated":8114176,"data_stored":6032250,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":91617733},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834576233,"num_pgs":112,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":151660,"kb_used_data":12252,"kb_used_omap":1,"kb_used_meta":139390,"kb_avail":94220180,"statfs":{"total":96636764160,"available":96481464320,"internally_reserved":0,"allocated":12546048,"data_stored":10442210,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":142735813},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834576231,"num_pgs":109,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":244868,"kb_used_data":10996,"kb_used_omap":1,"kb_used_meta":233854,"kb_avail":94126972,"statfs":{"total":96636764160,"available":96386019328,"internally_reserved":0,"allocated":11259904,"data_stored":9137303,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":239466949},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":6234112,"data_stored":6234112,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8130560,"data_stored":8130560,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":3719168,"data_stored":3719168,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":5976064,"data_stored":5976064,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":9515008,"data_stored":9515008,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":5996544,"data_stored":5996544,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4538368,"data_stored":4538368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8507392,"data_stored":8507392,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":1139,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":46,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":1185,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":562,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":184,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":470,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":880,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":1018,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":330,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":1210,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":220,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":1458,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":814,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":1474,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":86016,"data_stored":3328,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":3091,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4091,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":86016,"data_stored":4619,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":2771,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":77824,"data_stored":4485,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":2895,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":86016,"data_stored":4382,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-14T13:02:48.964 INFO:tasks.ceph:pgid 68.1a last_scrub_stamp 2024-09-14T11:58:42.635024+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=42, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=2, tm_sec=2, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:02:48.964 INFO:tasks.ceph:pgid 67.1d last_scrub_stamp 2024-09-14T11:30:16.474654+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=30, tm_sec=16, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=2, tm_sec=2, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:02:48.964 INFO:tasks.ceph:pgid 66.1c last_scrub_stamp 2024-09-14T11:30:09.411354+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=30, tm_sec=9, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=2, tm_sec=2, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:02:48.964 INFO:tasks.ceph:pgid 65.1f last_scrub_stamp 2024-09-14T11:24:09.066501+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=24, tm_sec=9, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=2, tm_sec=2, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:02:48.965 INFO:tasks.ceph:pgid 67.1c last_scrub_stamp 2024-09-14T11:30:16.474654+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=30, tm_sec=16, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=2, tm_sec=2, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:02:48.965 INFO:tasks.ceph:pgid 68.18 last_scrub_stamp 2024-09-14T11:58:42.635024+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=42, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=2, tm_sec=2, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:02:48.965 INFO:tasks.ceph:pgid 67.1f last_scrub_stamp 2024-09-14T11:30:16.474654+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=30, tm_sec=16, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=2, tm_sec=2, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:02:48.965 INFO:tasks.ceph:pgid 65.1d last_scrub_stamp 2024-09-14T11:24:09.066501+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=24, tm_sec=9, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=2, tm_sec=2, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:02:48.965 INFO:tasks.ceph:pgid 68.19 last_scrub_stamp 2024-09-14T11:58:42.635024+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=42, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=2, tm_sec=2, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:02:48.965 INFO:tasks.ceph:pgid 67.1e last_scrub_stamp 2024-09-14T11:30:16.474654+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=30, tm_sec=16, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=2, tm_sec=2, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:02:48.965 INFO:tasks.ceph:pgid 66.1f last_scrub_stamp 2024-09-14T11:30:09.411354+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=30, tm_sec=9, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=2, tm_sec=2, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:02:48.965 INFO:tasks.ceph:pgid 65.1c last_scrub_stamp 2024-09-14T11:24:09.066501+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=24, tm_sec=9, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=2, tm_sec=2, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:02:48.965 INFO:tasks.ceph:pgid 68.1e last_scrub_stamp 2024-09-14T11:58:42.635024+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=42, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=2, tm_sec=2, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:02:48.965 INFO:tasks.ceph:pgid 67.19 last_scrub_stamp 2024-09-14T11:30:16.474654+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=30, tm_sec=16, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=2, tm_sec=2, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:02:48.966 INFO:tasks.ceph:pgid 66.18 last_scrub_stamp 2024-09-14T11:30:09.411354+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=30, tm_sec=9, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=2, tm_sec=2, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:02:48.966 INFO:tasks.ceph:pgid 65.1b last_scrub_stamp 2024-09-14T11:24:09.066501+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=24, tm_sec=9, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=2, tm_sec=2, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:02:48.966 INFO:tasks.ceph:pgid 68.1f last_scrub_stamp 2024-09-14T11:58:42.635024+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=42, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=2, tm_sec=2, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:02:48.966 INFO:tasks.ceph:pgid 66.19 last_scrub_stamp 2024-09-14T11:30:09.411354+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=30, tm_sec=9, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=2, tm_sec=2, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:02:48.966 INFO:tasks.ceph:pgid 68.1c last_scrub_stamp 2024-09-14T11:58:42.635024+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=42, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=2, tm_sec=2, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:02:48.966 INFO:tasks.ceph:pgid 67.1b last_scrub_stamp 2024-09-14T11:30:16.474654+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=30, tm_sec=16, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=2, tm_sec=2, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:02:48.966 INFO:tasks.ceph:pgid 66.1a last_scrub_stamp 2024-09-14T11:30:09.411354+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=30, tm_sec=9, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=2, tm_sec=2, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:02:48.966 INFO:tasks.ceph:pgid 68.1d last_scrub_stamp 2024-09-14T11:58:42.635024+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=42, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=2, tm_sec=2, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:02:48.966 INFO:tasks.ceph:pgid 67.1a last_scrub_stamp 2024-09-14T11:30:16.474654+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=30, tm_sec=16, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=2, tm_sec=2, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:02:48.967 INFO:tasks.ceph:pgid 66.1b last_scrub_stamp 2024-09-14T11:30:09.411354+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=30, tm_sec=9, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=2, tm_sec=2, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:02:48.967 INFO:tasks.ceph:pgid 68.12 last_scrub_stamp 2024-09-14T11:58:42.635024+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=42, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=2, tm_sec=2, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:02:48.967 INFO:tasks.ceph:pgid 67.15 last_scrub_stamp 2024-09-14T11:30:16.474654+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=30, tm_sec=16, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=2, tm_sec=2, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:02:48.967 INFO:tasks.ceph:pgid 66.14 last_scrub_stamp 2024-09-14T11:30:09.411354+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=30, tm_sec=9, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=2, tm_sec=2, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:02:48.967 INFO:tasks.ceph:pgid 65.17 last_scrub_stamp 2024-09-14T11:24:09.066501+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=24, tm_sec=9, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=2, tm_sec=2, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:02:48.967 INFO:tasks.ceph:pgid 67.14 last_scrub_stamp 2024-09-14T11:30:16.474654+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=30, tm_sec=16, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=2, tm_sec=2, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:02:48.967 INFO:tasks.ceph:pgid 66.15 last_scrub_stamp 2024-09-14T11:30:09.411354+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=30, tm_sec=9, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=2, tm_sec=2, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:02:48.967 INFO:tasks.ceph:pgid 65.16 last_scrub_stamp 2024-09-14T11:24:09.066501+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=24, tm_sec=9, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=2, tm_sec=2, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:02:48.967 INFO:tasks.ceph:pgid 68.10 last_scrub_stamp 2024-09-14T11:58:42.635024+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=42, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=2, tm_sec=2, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:02:48.968 INFO:tasks.ceph:pgid 67.17 last_scrub_stamp 2024-09-14T11:30:16.474654+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=30, tm_sec=16, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=2, tm_sec=2, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:02:48.968 INFO:tasks.ceph:pgid 68.11 last_scrub_stamp 2024-09-14T11:58:42.635024+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=42, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=2, tm_sec=2, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:02:48.968 INFO:tasks.ceph:pgid 67.16 last_scrub_stamp 2024-09-14T11:30:16.474654+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=30, tm_sec=16, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=2, tm_sec=2, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:02:48.968 INFO:tasks.ceph:pgid 66.17 last_scrub_stamp 2024-09-14T11:30:09.411354+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=30, tm_sec=9, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=2, tm_sec=2, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:02:48.968 INFO:tasks.ceph:pgid 65.14 last_scrub_stamp 2024-09-14T11:24:09.066501+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=24, tm_sec=9, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=2, tm_sec=2, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:02:48.968 INFO:tasks.ceph:pgid 68.16 last_scrub_stamp 2024-09-14T11:58:42.635024+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=42, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=2, tm_sec=2, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:02:48.968 INFO:tasks.ceph:pgid 67.11 last_scrub_stamp 2024-09-14T11:30:16.474654+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=30, tm_sec=16, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=2, tm_sec=2, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:02:48.968 INFO:tasks.ceph:pgid 66.10 last_scrub_stamp 2024-09-14T11:30:09.411354+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=30, tm_sec=9, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=2, tm_sec=2, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:02:48.968 INFO:tasks.ceph:pgid 65.13 last_scrub_stamp 2024-09-14T11:24:09.066501+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=24, tm_sec=9, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=2, tm_sec=2, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:02:48.968 INFO:tasks.ceph:pgid 68.17 last_scrub_stamp 2024-09-14T11:58:42.635024+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=42, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=2, tm_sec=2, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:02:48.969 INFO:tasks.ceph:pgid 66.11 last_scrub_stamp 2024-09-14T11:30:09.411354+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=30, tm_sec=9, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=2, tm_sec=2, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:02:48.969 INFO:tasks.ceph:pgid 68.14 last_scrub_stamp 2024-09-14T11:58:42.635024+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=42, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=2, tm_sec=2, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:02:48.969 INFO:tasks.ceph:pgid 67.13 last_scrub_stamp 2024-09-14T11:30:16.474654+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=30, tm_sec=16, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=2, tm_sec=2, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:02:48.969 INFO:tasks.ceph:pgid 65.11 last_scrub_stamp 2024-09-14T11:24:09.066501+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=24, tm_sec=9, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=2, tm_sec=2, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:02:48.969 INFO:tasks.ceph:pgid 68.15 last_scrub_stamp 2024-09-14T11:58:42.635024+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=42, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=2, tm_sec=2, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:02:48.969 INFO:tasks.ceph:pgid 66.13 last_scrub_stamp 2024-09-14T11:30:09.411354+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=30, tm_sec=9, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=2, tm_sec=2, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:02:48.969 INFO:tasks.ceph:pgid 65.10 last_scrub_stamp 2024-09-14T11:24:09.066501+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=24, tm_sec=9, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=2, tm_sec=2, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:02:48.969 INFO:tasks.ceph:pgid 67.d last_scrub_stamp 2024-09-14T11:30:16.474654+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=30, tm_sec=16, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=2, tm_sec=2, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:02:48.969 INFO:tasks.ceph:pgid 66.c last_scrub_stamp 2024-09-14T11:30:09.411354+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=30, tm_sec=9, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=2, tm_sec=2, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:02:48.970 INFO:tasks.ceph:pgid 65.f last_scrub_stamp 2024-09-14T11:24:09.066501+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=24, tm_sec=9, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=2, tm_sec=2, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:02:48.970 INFO:tasks.ceph:pgid 68.b last_scrub_stamp 2024-09-14T11:58:42.635024+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=42, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=2, tm_sec=2, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:02:48.970 INFO:tasks.ceph:pgid 67.c last_scrub_stamp 2024-09-14T11:30:16.474654+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=30, tm_sec=16, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=2, tm_sec=2, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:02:48.970 INFO:tasks.ceph:pgid 65.e last_scrub_stamp 2024-09-14T11:24:09.066501+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=24, tm_sec=9, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=2, tm_sec=2, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:02:48.970 INFO:tasks.ceph:pgid 67.f last_scrub_stamp 2024-09-14T11:30:16.474654+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=30, tm_sec=16, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=2, tm_sec=2, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:02:48.970 INFO:tasks.ceph:pgid 66.e last_scrub_stamp 2024-09-14T11:30:09.411354+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=30, tm_sec=9, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=2, tm_sec=2, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:02:48.970 INFO:tasks.ceph:pgid 68.9 last_scrub_stamp 2024-09-14T11:58:42.635024+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=42, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=2, tm_sec=2, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:02:48.970 INFO:tasks.ceph:pgid 67.e last_scrub_stamp 2024-09-14T11:30:16.474654+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=30, tm_sec=16, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=2, tm_sec=2, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:02:48.970 INFO:tasks.ceph:pgid 68.e last_scrub_stamp 2024-09-14T11:58:42.635024+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=42, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=2, tm_sec=2, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:02:48.971 INFO:tasks.ceph:pgid 67.9 last_scrub_stamp 2024-09-14T11:30:16.474654+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=30, tm_sec=16, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=2, tm_sec=2, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:02:48.971 INFO:tasks.ceph:pgid 66.8 last_scrub_stamp 2024-09-14T11:30:09.411354+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=30, tm_sec=9, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=2, tm_sec=2, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:02:48.971 INFO:tasks.ceph:pgid 65.b last_scrub_stamp 2024-09-14T11:24:09.066501+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=24, tm_sec=9, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=2, tm_sec=2, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:02:48.971 INFO:tasks.ceph:pgid 68.f last_scrub_stamp 2024-09-14T11:58:42.635024+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=42, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=2, tm_sec=2, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:02:48.971 INFO:tasks.ceph:pgid 67.8 last_scrub_stamp 2024-09-14T11:30:16.474654+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=30, tm_sec=16, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=2, tm_sec=2, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:02:48.971 INFO:tasks.ceph:pgid 65.a last_scrub_stamp 2024-09-14T11:24:09.066501+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=24, tm_sec=9, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=2, tm_sec=2, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:02:48.971 INFO:tasks.ceph:pgid 68.c last_scrub_stamp 2024-09-14T11:58:42.635024+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=42, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=2, tm_sec=2, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:02:48.971 INFO:tasks.ceph:pgid 66.a last_scrub_stamp 2024-09-14T11:30:09.411354+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=30, tm_sec=9, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=2, tm_sec=2, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:02:48.971 INFO:tasks.ceph:pgid 65.9 last_scrub_stamp 2024-09-14T11:24:09.066501+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=24, tm_sec=9, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=2, tm_sec=2, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:02:48.971 INFO:tasks.ceph:pgid 68.d last_scrub_stamp 2024-09-14T11:58:42.635024+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=42, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=2, tm_sec=2, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:02:48.972 INFO:tasks.ceph:pgid 67.a last_scrub_stamp 2024-09-14T11:30:16.474654+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=30, tm_sec=16, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=2, tm_sec=2, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:02:48.972 INFO:tasks.ceph:pgid 66.b last_scrub_stamp 2024-09-14T11:30:09.411354+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=30, tm_sec=9, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=2, tm_sec=2, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:02:48.972 INFO:tasks.ceph:pgid 68.2 last_scrub_stamp 2024-09-14T11:58:42.635024+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=42, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=2, tm_sec=2, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:02:48.972 INFO:tasks.ceph:pgid 67.5 last_scrub_stamp 2024-09-14T11:30:16.474654+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=30, tm_sec=16, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=2, tm_sec=2, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:02:48.972 INFO:tasks.ceph:pgid 66.4 last_scrub_stamp 2024-09-14T11:30:09.411354+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=30, tm_sec=9, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=2, tm_sec=2, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:02:48.972 INFO:tasks.ceph:pgid 65.7 last_scrub_stamp 2024-09-14T11:24:09.066501+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=24, tm_sec=9, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=2, tm_sec=2, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:02:48.972 INFO:tasks.ceph:pgid 68.3 last_scrub_stamp 2024-09-14T11:58:42.635024+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=42, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=2, tm_sec=2, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:02:48.972 INFO:tasks.ceph:pgid 67.4 last_scrub_stamp 2024-09-14T11:30:16.474654+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=30, tm_sec=16, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=2, tm_sec=2, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:02:48.973 INFO:tasks.ceph:pgid 68.0 last_scrub_stamp 2024-09-14T11:58:42.635024+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=42, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=2, tm_sec=2, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:02:48.973 INFO:tasks.ceph:pgid 67.7 last_scrub_stamp 2024-09-14T11:30:16.474654+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=30, tm_sec=16, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=2, tm_sec=2, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:02:48.973 INFO:tasks.ceph:pgid 66.6 last_scrub_stamp 2024-09-14T11:30:09.411354+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=30, tm_sec=9, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=2, tm_sec=2, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:02:48.973 INFO:tasks.ceph:pgid 65.5 last_scrub_stamp 2024-09-14T11:24:09.066501+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=24, tm_sec=9, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=2, tm_sec=2, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:02:48.973 INFO:tasks.ceph:pgid 68.1 last_scrub_stamp 2024-09-14T11:58:42.635024+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=42, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=2, tm_sec=2, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:02:48.973 INFO:tasks.ceph:pgid 67.6 last_scrub_stamp 2024-09-14T11:30:16.474654+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=30, tm_sec=16, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=2, tm_sec=2, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:02:48.973 INFO:tasks.ceph:pgid 66.7 last_scrub_stamp 2024-09-14T11:30:09.411354+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=30, tm_sec=9, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=2, tm_sec=2, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:02:48.973 INFO:tasks.ceph:pgid 66.0 last_scrub_stamp 2024-09-14T11:30:09.411354+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=30, tm_sec=9, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=2, tm_sec=2, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:02:48.973 INFO:tasks.ceph:pgid 65.3 last_scrub_stamp 2024-09-14T11:24:09.066501+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=24, tm_sec=9, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=2, tm_sec=2, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:02:48.973 INFO:tasks.ceph:pgid 68.7 last_scrub_stamp 2024-09-14T11:58:42.635024+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=42, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=2, tm_sec=2, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:02:48.974 INFO:tasks.ceph:pgid 67.0 last_scrub_stamp 2024-09-14T11:30:16.474654+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=30, tm_sec=16, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=2, tm_sec=2, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:02:48.974 INFO:tasks.ceph:pgid 66.1 last_scrub_stamp 2024-09-14T11:30:09.411354+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=30, tm_sec=9, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=2, tm_sec=2, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:02:48.974 INFO:tasks.ceph:pgid 68.4 last_scrub_stamp 2024-09-14T11:58:42.635024+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=42, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=2, tm_sec=2, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:02:48.974 INFO:tasks.ceph:pgid 68.5 last_scrub_stamp 2024-09-14T11:58:42.635024+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=42, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=2, tm_sec=2, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:02:48.974 INFO:tasks.ceph:pgid 67.2 last_scrub_stamp 2024-09-14T11:30:16.474654+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=30, tm_sec=16, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=2, tm_sec=2, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:02:48.974 INFO:tasks.ceph:pgid 8.19 last_scrub_stamp 2024-09-14T11:08:30.789404+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=8, tm_sec=30, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=2, tm_sec=2, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:02:48.975 INFO:tasks.ceph:pgid 8.0 last_scrub_stamp 2024-09-14T11:08:30.789404+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=8, tm_sec=30, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=2, tm_sec=2, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:02:48.976 INFO:tasks.ceph:pgid 8.1f last_scrub_stamp 2024-09-14T11:08:30.789404+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=8, tm_sec=30, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=2, tm_sec=2, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:02:48.976 INFO:tasks.ceph:pgid 8.1e last_scrub_stamp 2024-09-14T11:08:30.789404+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=8, tm_sec=30, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=2, tm_sec=2, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:02:48.976 INFO:tasks.ceph:pgid 8.1c last_scrub_stamp 2024-09-14T11:08:30.789404+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=8, tm_sec=30, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=2, tm_sec=2, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:02:48.977 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-09-14T13:03:08.978 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-14T13:03:09.343 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-09-14T13:03:09.356 INFO:teuthology.orchestra.run.smithi138.stderr:dumped all 2024-09-14T13:03:09.359 INFO:teuthology.orchestra.run.smithi138.stdout:{"pg_ready":true,"pg_map":{"version":3710,"stamp":"2024-09-14T13:03:07.340890+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":35056180,"num_objects":619,"num_object_clones":0,"num_object_copies":1404,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":619,"num_whiteouts":0,"num_read":305713,"num_read_kb":3451688,"num_write":150075,"num_write_kb":2498451,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":191,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":752410,"num_omap_keys":1799,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":12785,"ondisk_log_size":12785,"up":850,"acting":850,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":850,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":1444328,"kb_used_data":87080,"kb_used_omap":12,"kb_used_meta":1357107,"kb_avail":753530392,"statfs":{"total":773094113280,"available":771615121408,"internally_reserved":0,"allocated":89169920,"data_stored":72298450,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":1389678128},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":376,"num_omap_keys":4,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.008604"},"pg_stats":[{"pgid":"68.1a","version":"0'0","reported_seq":46,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:54.300119+0000","last_change":"2024-09-14T13:02:54.300119+0000","last_active":"2024-09-14T13:02:54.300119+0000","last_peered":"2024-09-14T13:02:54.300119+0000","last_clean":"2024-09-14T13:02:54.300119+0000","last_became_active":"2024-09-14T11:58:43.694936+0000","last_became_peered":"2024-09-14T11:58:43.694936+0000","last_unstale":"2024-09-14T13:02:54.300119+0000","last_undegraded":"2024-09-14T13:02:54.300119+0000","last_fullsized":"2024-09-14T13:02:54.300119+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T13:02:54.299919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T13:02:54.299919+0000","last_clean_scrub_stamp":"2024-09-14T13:02:54.299919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:18:11.680663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.1d","version":"264'2","reported_seq":72,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:55.313039+0000","last_change":"2024-09-14T13:02:55.313039+0000","last_active":"2024-09-14T13:02:55.313039+0000","last_peered":"2024-09-14T13:02:55.313039+0000","last_clean":"2024-09-14T13:02:55.313039+0000","last_became_active":"2024-09-14T11:30:17.525157+0000","last_became_peered":"2024-09-14T11:30:17.525157+0000","last_unstale":"2024-09-14T13:02:55.313039+0000","last_undegraded":"2024-09-14T13:02:55.313039+0000","last_fullsized":"2024-09-14T13:02:55.313039+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'2","last_scrub_stamp":"2024-09-14T13:02:55.312848+0000","last_deep_scrub":"264'2","last_deep_scrub_stamp":"2024-09-14T13:02:55.312848+0000","last_clean_scrub_stamp":"2024-09-14T13:02:55.312848+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T00:17:42.418932+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":4096,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.1c","version":"267'6","reported_seq":85,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:51.892891+0000","last_change":"2024-09-14T13:02:51.892891+0000","last_active":"2024-09-14T13:02:51.892891+0000","last_peered":"2024-09-14T13:02:51.892891+0000","last_clean":"2024-09-14T13:02:51.892891+0000","last_became_active":"2024-09-14T11:30:10.460441+0000","last_became_peered":"2024-09-14T11:30:10.460441+0000","last_unstale":"2024-09-14T13:02:51.892891+0000","last_undegraded":"2024-09-14T13:02:51.892891+0000","last_fullsized":"2024-09-14T13:02:51.892891+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'6","last_scrub_stamp":"2024-09-14T13:02:51.892713+0000","last_deep_scrub":"267'6","last_deep_scrub_stamp":"2024-09-14T13:02:51.892713+0000","last_clean_scrub_stamp":"2024-09-14T13:02:51.892713+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:24:14.376066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":6189,"num_write":6,"num_write_kb":5165,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.1f","version":"267'84","reported_seq":321,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:59.133572+0000","last_change":"2024-09-14T13:02:59.133572+0000","last_active":"2024-09-14T13:02:59.133572+0000","last_peered":"2024-09-14T13:02:59.133572+0000","last_clean":"2024-09-14T13:02:59.133572+0000","last_became_active":"2024-09-14T11:24:10.104105+0000","last_became_peered":"2024-09-14T11:24:10.104105+0000","last_unstale":"2024-09-14T13:02:59.133572+0000","last_undegraded":"2024-09-14T13:02:59.133572+0000","last_fullsized":"2024-09-14T13:02:59.133572+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'84","last_scrub_stamp":"2024-09-14T13:02:59.133390+0000","last_deep_scrub":"267'84","last_deep_scrub_stamp":"2024-09-14T13:02:59.133390+0000","last_clean_scrub_stamp":"2024-09-14T13:02:59.133390+0000","objects_scrubbed":0,"log_size":84,"log_dups_size":0,"ondisk_log_size":84,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:37:47.396908+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":704,"num_read_kb":504,"num_write":208,"num_write_kb":68,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.1b","version":"0'0","reported_seq":46,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:40.128400+0000","last_change":"2024-09-14T13:02:40.128400+0000","last_active":"2024-09-14T13:02:40.128400+0000","last_peered":"2024-09-14T13:02:40.128400+0000","last_clean":"2024-09-14T13:02:40.128400+0000","last_became_active":"2024-09-14T11:58:43.693847+0000","last_became_peered":"2024-09-14T11:58:43.693847+0000","last_unstale":"2024-09-14T13:02:40.128400+0000","last_undegraded":"2024-09-14T13:02:40.128400+0000","last_fullsized":"2024-09-14T13:02:40.128400+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T13:02:40.128214+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T13:02:40.128214+0000","last_clean_scrub_stamp":"2024-09-14T13:02:40.128214+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:40:52.505545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.1c","version":"267'9","reported_seq":83,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:53.552632+0000","last_change":"2024-09-14T13:02:53.552632+0000","last_active":"2024-09-14T13:02:53.552632+0000","last_peered":"2024-09-14T13:02:53.552632+0000","last_clean":"2024-09-14T13:02:53.552632+0000","last_became_active":"2024-09-14T11:30:17.524810+0000","last_became_peered":"2024-09-14T11:30:17.524810+0000","last_unstale":"2024-09-14T13:02:53.552632+0000","last_undegraded":"2024-09-14T13:02:53.552632+0000","last_fullsized":"2024-09-14T13:02:53.552632+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'9","last_scrub_stamp":"2024-09-14T13:02:53.552446+0000","last_deep_scrub":"267'9","last_deep_scrub_stamp":"2024-09-14T13:02:53.552446+0000","last_clean_scrub_stamp":"2024-09-14T13:02:53.552446+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:44:48.828432+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":11636,"num_write":14,"num_write_kb":6842,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.1d","version":"0'0","reported_seq":74,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:37.223730+0000","last_change":"2024-09-14T13:02:37.223612+0000","last_active":"2024-09-14T13:02:37.223730+0000","last_peered":"2024-09-14T13:02:37.223730+0000","last_clean":"2024-09-14T13:02:37.223730+0000","last_became_active":"2024-09-14T11:30:10.474889+0000","last_became_peered":"2024-09-14T11:30:10.474889+0000","last_unstale":"2024-09-14T13:02:37.223730+0000","last_undegraded":"2024-09-14T13:02:37.223730+0000","last_fullsized":"2024-09-14T13:02:37.223730+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T13:02:37.223419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T13:02:37.223419+0000","last_clean_scrub_stamp":"2024-09-14T13:02:37.223419+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:31:29.150342+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.1e","version":"267'279","reported_seq":921,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:32.120221+0000","last_change":"2024-09-14T13:02:32.120056+0000","last_active":"2024-09-14T13:02:32.120221+0000","last_peered":"2024-09-14T13:02:32.120221+0000","last_clean":"2024-09-14T13:02:32.120221+0000","last_became_active":"2024-09-14T11:24:10.090434+0000","last_became_peered":"2024-09-14T11:24:10.090434+0000","last_unstale":"2024-09-14T13:02:32.120221+0000","last_undegraded":"2024-09-14T13:02:32.120221+0000","last_fullsized":"2024-09-14T13:02:32.120221+0000","mapping_epoch":254,"log_start":"264'200","ondisk_log_start":"264'200","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'279","last_scrub_stamp":"2024-09-14T13:02:32.119867+0000","last_deep_scrub":"267'279","last_deep_scrub_stamp":"2024-09-14T13:02:32.119867+0000","last_clean_scrub_stamp":"2024-09-14T13:02:32.119867+0000","objects_scrubbed":0,"log_size":79,"log_dups_size":200,"ondisk_log_size":79,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:06:39.963045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2587,"num_read_kb":3188,"num_write":542,"num_write_kb":246,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.18","version":"0'0","reported_seq":47,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:45.276571+0000","last_change":"2024-09-14T13:02:45.276571+0000","last_active":"2024-09-14T13:02:45.276571+0000","last_peered":"2024-09-14T13:02:45.276571+0000","last_clean":"2024-09-14T13:02:45.276571+0000","last_became_active":"2024-09-14T11:58:43.685333+0000","last_became_peered":"2024-09-14T11:58:43.685333+0000","last_unstale":"2024-09-14T13:02:45.276571+0000","last_undegraded":"2024-09-14T13:02:45.276571+0000","last_fullsized":"2024-09-14T13:02:45.276571+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T13:02:45.276410+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T13:02:45.276410+0000","last_clean_scrub_stamp":"2024-09-14T13:02:45.276410+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:00:24.239317+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"67.1f","version":"267'4","reported_seq":82,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:03:01.096868+0000","last_change":"2024-09-14T13:03:01.096868+0000","last_active":"2024-09-14T13:03:01.096868+0000","last_peered":"2024-09-14T13:03:01.096868+0000","last_clean":"2024-09-14T13:03:01.096868+0000","last_became_active":"2024-09-14T11:30:17.500369+0000","last_became_peered":"2024-09-14T11:30:17.500369+0000","last_unstale":"2024-09-14T13:03:01.096868+0000","last_undegraded":"2024-09-14T13:03:01.096868+0000","last_fullsized":"2024-09-14T13:03:01.096868+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'4","last_scrub_stamp":"2024-09-14T13:03:01.096688+0000","last_deep_scrub":"267'4","last_deep_scrub_stamp":"2024-09-14T13:03:01.096688+0000","last_clean_scrub_stamp":"2024-09-14T13:03:01.096688+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:42:18.559215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":8192,"num_write":4,"num_write_kb":8192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.1e","version":"264'4","reported_seq":93,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:35.163956+0000","last_change":"2024-09-14T13:02:35.163772+0000","last_active":"2024-09-14T13:02:35.163956+0000","last_peered":"2024-09-14T13:02:35.163956+0000","last_clean":"2024-09-14T13:02:35.163956+0000","last_became_active":"2024-09-14T11:30:10.445613+0000","last_became_peered":"2024-09-14T11:30:10.445613+0000","last_unstale":"2024-09-14T13:02:35.163956+0000","last_undegraded":"2024-09-14T13:02:35.163956+0000","last_fullsized":"2024-09-14T13:02:35.163956+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'4","last_scrub_stamp":"2024-09-14T13:02:35.163594+0000","last_deep_scrub":"264'4","last_deep_scrub_stamp":"2024-09-14T13:02:35.163594+0000","last_clean_scrub_stamp":"2024-09-14T13:02:35.163594+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:53:06.574290+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":4098,"num_write":4,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.1d","version":"267'16","reported_seq":127,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:48.185175+0000","last_change":"2024-09-14T13:02:48.185175+0000","last_active":"2024-09-14T13:02:48.185175+0000","last_peered":"2024-09-14T13:02:48.185175+0000","last_clean":"2024-09-14T13:02:48.185175+0000","last_became_active":"2024-09-14T11:24:10.111323+0000","last_became_peered":"2024-09-14T11:24:10.111323+0000","last_unstale":"2024-09-14T13:02:48.185175+0000","last_undegraded":"2024-09-14T13:02:48.185175+0000","last_fullsized":"2024-09-14T13:02:48.185175+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'16","last_scrub_stamp":"2024-09-14T13:02:48.184976+0000","last_deep_scrub":"267'16","last_deep_scrub_stamp":"2024-09-14T13:02:48.184976+0000","last_clean_scrub_stamp":"2024-09-14T13:02:48.184976+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T00:41:31.522075+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":134,"num_read_kb":93,"num_write":40,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.19","version":"0'0","reported_seq":39,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:59:18.471470+0000","last_change":"2024-09-14T11:58:43.701511+0000","last_active":"2024-09-14T12:59:18.471470+0000","last_peered":"2024-09-14T12:59:18.471470+0000","last_clean":"2024-09-14T12:59:18.471470+0000","last_became_active":"2024-09-14T11:58:43.700281+0000","last_became_peered":"2024-09-14T11:58:43.700281+0000","last_unstale":"2024-09-14T12:59:18.471470+0000","last_undegraded":"2024-09-14T12:59:18.471470+0000","last_fullsized":"2024-09-14T12:59:18.471470+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:58:42.635024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:58:42.635024+0000","last_clean_scrub_stamp":"2024-09-14T11:58:42.635024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:42:11.274748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.1e","version":"267'6","reported_seq":86,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:57.899407+0000","last_change":"2024-09-14T13:02:57.899407+0000","last_active":"2024-09-14T13:02:57.899407+0000","last_peered":"2024-09-14T13:02:57.899407+0000","last_clean":"2024-09-14T13:02:57.899407+0000","last_became_active":"2024-09-14T11:30:17.534642+0000","last_became_peered":"2024-09-14T11:30:17.534642+0000","last_unstale":"2024-09-14T13:02:57.899407+0000","last_undegraded":"2024-09-14T13:02:57.899407+0000","last_fullsized":"2024-09-14T13:02:57.899407+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'6","last_scrub_stamp":"2024-09-14T13:02:57.899225+0000","last_deep_scrub":"267'6","last_deep_scrub_stamp":"2024-09-14T13:02:57.899225+0000","last_clean_scrub_stamp":"2024-09-14T13:02:57.899225+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:01:41.297988+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":1064,"num_write":6,"num_write_kb":2088,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.1f","version":"267'2","reported_seq":83,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:46.592975+0000","last_change":"2024-09-14T13:02:46.592975+0000","last_active":"2024-09-14T13:02:46.592975+0000","last_peered":"2024-09-14T13:02:46.592975+0000","last_clean":"2024-09-14T13:02:46.592975+0000","last_became_active":"2024-09-14T11:30:10.442597+0000","last_became_peered":"2024-09-14T11:30:10.442597+0000","last_unstale":"2024-09-14T13:02:46.592975+0000","last_undegraded":"2024-09-14T13:02:46.592975+0000","last_fullsized":"2024-09-14T13:02:46.592975+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'2","last_scrub_stamp":"2024-09-14T13:02:46.592723+0000","last_deep_scrub":"267'2","last_deep_scrub_stamp":"2024-09-14T13:02:46.592723+0000","last_clean_scrub_stamp":"2024-09-14T13:02:46.592723+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:28:27.083727+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.1c","version":"267'41","reported_seq":196,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:49.916161+0000","last_change":"2024-09-14T13:02:49.916161+0000","last_active":"2024-09-14T13:02:49.916161+0000","last_peered":"2024-09-14T13:02:49.916161+0000","last_clean":"2024-09-14T13:02:49.916161+0000","last_became_active":"2024-09-14T11:24:10.124422+0000","last_became_peered":"2024-09-14T11:24:10.124422+0000","last_unstale":"2024-09-14T13:02:49.916161+0000","last_undegraded":"2024-09-14T13:02:49.916161+0000","last_fullsized":"2024-09-14T13:02:49.916161+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'41","last_scrub_stamp":"2024-09-14T13:02:49.915973+0000","last_deep_scrub":"267'41","last_deep_scrub_stamp":"2024-09-14T13:02:49.915973+0000","last_clean_scrub_stamp":"2024-09-14T13:02:49.915973+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":0,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:05:58.929256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":350,"num_read_kb":247,"num_write":96,"num_write_kb":33,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.1e","version":"0'0","reported_seq":45,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:00:53.493781+0000","last_change":"2024-09-14T11:58:43.694842+0000","last_active":"2024-09-14T13:00:53.493781+0000","last_peered":"2024-09-14T13:00:53.493781+0000","last_clean":"2024-09-14T13:00:53.493781+0000","last_became_active":"2024-09-14T11:58:43.693760+0000","last_became_peered":"2024-09-14T11:58:43.693760+0000","last_unstale":"2024-09-14T13:00:53.493781+0000","last_undegraded":"2024-09-14T13:00:53.493781+0000","last_fullsized":"2024-09-14T13:00:53.493781+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:58:42.635024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:58:42.635024+0000","last_clean_scrub_stamp":"2024-09-14T11:58:42.635024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.19","version":"0'0","reported_seq":69,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:51.352468+0000","last_change":"2024-09-14T13:02:51.352468+0000","last_active":"2024-09-14T13:02:51.352468+0000","last_peered":"2024-09-14T13:02:51.352468+0000","last_clean":"2024-09-14T13:02:51.352468+0000","last_became_active":"2024-09-14T11:30:17.531325+0000","last_became_peered":"2024-09-14T11:30:17.531325+0000","last_unstale":"2024-09-14T13:02:51.352468+0000","last_undegraded":"2024-09-14T13:02:51.352468+0000","last_fullsized":"2024-09-14T13:02:51.352468+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T13:02:51.352283+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T13:02:51.352283+0000","last_clean_scrub_stamp":"2024-09-14T13:02:51.352283+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:13:22.954226+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.18","version":"264'8","reported_seq":91,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:53.120294+0000","last_change":"2024-09-14T13:02:53.120294+0000","last_active":"2024-09-14T13:02:53.120294+0000","last_peered":"2024-09-14T13:02:53.120294+0000","last_clean":"2024-09-14T13:02:53.120294+0000","last_became_active":"2024-09-14T11:30:10.461101+0000","last_became_peered":"2024-09-14T11:30:10.461101+0000","last_unstale":"2024-09-14T13:02:53.120294+0000","last_undegraded":"2024-09-14T13:02:53.120294+0000","last_fullsized":"2024-09-14T13:02:53.120294+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'8","last_scrub_stamp":"2024-09-14T13:02:53.120111+0000","last_deep_scrub":"264'8","last_deep_scrub_stamp":"2024-09-14T13:02:53.120111+0000","last_clean_scrub_stamp":"2024-09-14T13:02:53.120111+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:52:27.935116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":8194,"num_write":18,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.1b","version":"264'28","reported_seq":157,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:46.913030+0000","last_change":"2024-09-14T13:02:46.913030+0000","last_active":"2024-09-14T13:02:46.913030+0000","last_peered":"2024-09-14T13:02:46.913030+0000","last_clean":"2024-09-14T13:02:46.913030+0000","last_became_active":"2024-09-14T11:24:10.129087+0000","last_became_peered":"2024-09-14T11:24:10.129087+0000","last_unstale":"2024-09-14T13:02:46.913030+0000","last_undegraded":"2024-09-14T13:02:46.913030+0000","last_fullsized":"2024-09-14T13:02:46.913030+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'28","last_scrub_stamp":"2024-09-14T13:02:46.912831+0000","last_deep_scrub":"264'28","last_deep_scrub_stamp":"2024-09-14T13:02:46.912831+0000","last_clean_scrub_stamp":"2024-09-14T13:02:46.912831+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:05:15.158776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":229,"num_read_kb":159,"num_write":68,"num_write_kb":22,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.1f","version":"0'0","reported_seq":51,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:48.032526+0000","last_change":"2024-09-14T13:02:48.032526+0000","last_active":"2024-09-14T13:02:48.032526+0000","last_peered":"2024-09-14T13:02:48.032526+0000","last_clean":"2024-09-14T13:02:48.032526+0000","last_became_active":"2024-09-14T11:58:43.676679+0000","last_became_peered":"2024-09-14T11:58:43.676679+0000","last_unstale":"2024-09-14T13:02:48.032526+0000","last_undegraded":"2024-09-14T13:02:48.032526+0000","last_fullsized":"2024-09-14T13:02:48.032526+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T13:02:48.032306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T13:02:48.032306+0000","last_clean_scrub_stamp":"2024-09-14T13:02:48.032306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:23:53.128955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"67.18","version":"264'8","reported_seq":87,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:41.302766+0000","last_change":"2024-09-14T13:02:41.302766+0000","last_active":"2024-09-14T13:02:41.302766+0000","last_peered":"2024-09-14T13:02:41.302766+0000","last_clean":"2024-09-14T13:02:41.302766+0000","last_became_active":"2024-09-14T11:30:17.545478+0000","last_became_peered":"2024-09-14T11:30:17.545478+0000","last_unstale":"2024-09-14T13:02:41.302766+0000","last_undegraded":"2024-09-14T13:02:41.302766+0000","last_fullsized":"2024-09-14T13:02:41.302766+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'8","last_scrub_stamp":"2024-09-14T13:02:41.302568+0000","last_deep_scrub":"264'8","last_deep_scrub_stamp":"2024-09-14T13:02:41.302568+0000","last_clean_scrub_stamp":"2024-09-14T13:02:41.302568+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T00:55:52.417379+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":4166,"num_write":8,"num_write_kb":1092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"66.19","version":"267'7","reported_seq":85,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:50.546901+0000","last_change":"2024-09-14T13:02:50.546901+0000","last_active":"2024-09-14T13:02:50.546901+0000","last_peered":"2024-09-14T13:02:50.546901+0000","last_clean":"2024-09-14T13:02:50.546901+0000","last_became_active":"2024-09-14T11:30:10.467266+0000","last_became_peered":"2024-09-14T11:30:10.467266+0000","last_unstale":"2024-09-14T13:02:50.546901+0000","last_undegraded":"2024-09-14T13:02:50.546901+0000","last_fullsized":"2024-09-14T13:02:50.546901+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'7","last_scrub_stamp":"2024-09-14T13:02:50.546721+0000","last_deep_scrub":"267'7","last_deep_scrub_stamp":"2024-09-14T13:02:50.546721+0000","last_clean_scrub_stamp":"2024-09-14T13:02:50.546721+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:36:02.585933+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":1047,"num_write":12,"num_write_kb":2071,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.1a","version":"267'87","reported_seq":322,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:37.383112+0000","last_change":"2024-09-14T13:02:37.383112+0000","last_active":"2024-09-14T13:02:37.383112+0000","last_peered":"2024-09-14T13:02:37.383112+0000","last_clean":"2024-09-14T13:02:37.383112+0000","last_became_active":"2024-09-14T11:24:10.121048+0000","last_became_peered":"2024-09-14T11:24:10.121048+0000","last_unstale":"2024-09-14T13:02:37.383112+0000","last_undegraded":"2024-09-14T13:02:37.383112+0000","last_fullsized":"2024-09-14T13:02:37.383112+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'87","last_scrub_stamp":"2024-09-14T13:02:37.382930+0000","last_deep_scrub":"267'87","last_deep_scrub_stamp":"2024-09-14T13:02:37.382930+0000","last_clean_scrub_stamp":"2024-09-14T13:02:37.382930+0000","objects_scrubbed":0,"log_size":87,"log_dups_size":0,"ondisk_log_size":87,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:15:49.489042+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":696,"num_read_kb":437,"num_write":216,"num_write_kb":62,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.1c","version":"267'1","reported_seq":39,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:58:47.835392+0000","last_change":"2024-09-14T11:58:43.685706+0000","last_active":"2024-09-14T12:58:47.835392+0000","last_peered":"2024-09-14T12:58:47.835392+0000","last_clean":"2024-09-14T12:58:47.835392+0000","last_became_active":"2024-09-14T11:58:43.684984+0000","last_became_peered":"2024-09-14T11:58:43.684984+0000","last_unstale":"2024-09-14T12:58:47.835392+0000","last_undegraded":"2024-09-14T12:58:47.835392+0000","last_fullsized":"2024-09-14T12:58:47.835392+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:58:42.635024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:58:42.635024+0000","last_clean_scrub_stamp":"2024-09-14T11:58:42.635024+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:29:12.171056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.1b","version":"0'0","reported_seq":68,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:44.319002+0000","last_change":"2024-09-14T13:02:44.318836+0000","last_active":"2024-09-14T13:02:44.319002+0000","last_peered":"2024-09-14T13:02:44.319002+0000","last_clean":"2024-09-14T13:02:44.319002+0000","last_became_active":"2024-09-14T11:30:17.526195+0000","last_became_peered":"2024-09-14T11:30:17.526195+0000","last_unstale":"2024-09-14T13:02:44.319002+0000","last_undegraded":"2024-09-14T13:02:44.319002+0000","last_fullsized":"2024-09-14T13:02:44.319002+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T13:02:44.318655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T13:02:44.318655+0000","last_clean_scrub_stamp":"2024-09-14T13:02:44.318655+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:24:39.993059+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"66.1a","version":"264'2","reported_seq":78,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:45.625926+0000","last_change":"2024-09-14T13:02:45.625926+0000","last_active":"2024-09-14T13:02:45.625926+0000","last_peered":"2024-09-14T13:02:45.625926+0000","last_clean":"2024-09-14T13:02:45.625926+0000","last_became_active":"2024-09-14T11:30:10.442753+0000","last_became_peered":"2024-09-14T11:30:10.442753+0000","last_unstale":"2024-09-14T13:02:45.625926+0000","last_undegraded":"2024-09-14T13:02:45.625926+0000","last_fullsized":"2024-09-14T13:02:45.625926+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'2","last_scrub_stamp":"2024-09-14T13:02:45.625740+0000","last_deep_scrub":"264'2","last_deep_scrub_stamp":"2024-09-14T13:02:45.625740+0000","last_clean_scrub_stamp":"2024-09-14T13:02:45.625740+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:30:11.844258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":4096,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.19","version":"267'12","reported_seq":113,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:43.233545+0000","last_change":"2024-09-14T13:02:43.233545+0000","last_active":"2024-09-14T13:02:43.233545+0000","last_peered":"2024-09-14T13:02:43.233545+0000","last_clean":"2024-09-14T13:02:43.233545+0000","last_became_active":"2024-09-14T11:24:10.098890+0000","last_became_peered":"2024-09-14T11:24:10.098890+0000","last_unstale":"2024-09-14T13:02:43.233545+0000","last_undegraded":"2024-09-14T13:02:43.233545+0000","last_fullsized":"2024-09-14T13:02:43.233545+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'12","last_scrub_stamp":"2024-09-14T13:02:43.233322+0000","last_deep_scrub":"267'12","last_deep_scrub_stamp":"2024-09-14T13:02:43.233322+0000","last_clean_scrub_stamp":"2024-09-14T13:02:43.233322+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:54:26.566189+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":81,"num_read_kb":53,"num_write":29,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.1d","version":"0'0","reported_seq":38,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:58:47.835476+0000","last_change":"2024-09-14T11:58:43.688034+0000","last_active":"2024-09-14T12:58:47.835476+0000","last_peered":"2024-09-14T12:58:47.835476+0000","last_clean":"2024-09-14T12:58:47.835476+0000","last_became_active":"2024-09-14T11:58:43.687072+0000","last_became_peered":"2024-09-14T11:58:43.687072+0000","last_unstale":"2024-09-14T12:58:47.835476+0000","last_undegraded":"2024-09-14T12:58:47.835476+0000","last_fullsized":"2024-09-14T12:58:47.835476+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:58:42.635024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:58:42.635024+0000","last_clean_scrub_stamp":"2024-09-14T11:58:42.635024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:54:30.111603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.1a","version":"0'0","reported_seq":68,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:59.964067+0000","last_change":"2024-09-14T13:02:59.964067+0000","last_active":"2024-09-14T13:02:59.964067+0000","last_peered":"2024-09-14T13:02:59.964067+0000","last_clean":"2024-09-14T13:02:59.964067+0000","last_became_active":"2024-09-14T11:30:17.534937+0000","last_became_peered":"2024-09-14T11:30:17.534937+0000","last_unstale":"2024-09-14T13:02:59.964067+0000","last_undegraded":"2024-09-14T13:02:59.964067+0000","last_fullsized":"2024-09-14T13:02:59.964067+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T13:02:59.963806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T13:02:59.963806+0000","last_clean_scrub_stamp":"2024-09-14T13:02:59.963806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:05:36.010403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.1b","version":"267'6","reported_seq":85,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:50.129880+0000","last_change":"2024-09-14T13:02:50.129880+0000","last_active":"2024-09-14T13:02:50.129880+0000","last_peered":"2024-09-14T13:02:50.129880+0000","last_clean":"2024-09-14T13:02:50.129880+0000","last_became_active":"2024-09-14T11:30:10.460666+0000","last_became_peered":"2024-09-14T11:30:10.460666+0000","last_unstale":"2024-09-14T13:02:50.129880+0000","last_undegraded":"2024-09-14T13:02:50.129880+0000","last_fullsized":"2024-09-14T13:02:50.129880+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'6","last_scrub_stamp":"2024-09-14T13:02:50.129811+0000","last_deep_scrub":"267'6","last_deep_scrub_stamp":"2024-09-14T13:02:50.129811+0000","last_clean_scrub_stamp":"2024-09-14T13:02:50.129811+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:37:33.767936+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":14336,"num_write":6,"num_write_kb":10240,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.18","version":"267'142","reported_seq":503,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:32.108855+0000","last_change":"2024-09-14T13:02:32.108855+0000","last_active":"2024-09-14T13:02:32.108855+0000","last_peered":"2024-09-14T13:02:32.108855+0000","last_clean":"2024-09-14T13:02:32.108855+0000","last_became_active":"2024-09-14T11:24:10.117854+0000","last_became_peered":"2024-09-14T11:24:10.117854+0000","last_unstale":"2024-09-14T13:02:32.108855+0000","last_undegraded":"2024-09-14T13:02:32.108855+0000","last_fullsized":"2024-09-14T13:02:32.108855+0000","mapping_epoch":254,"log_start":"264'100","ondisk_log_start":"264'100","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'142","last_scrub_stamp":"2024-09-14T13:02:32.108644+0000","last_deep_scrub":"267'142","last_deep_scrub_stamp":"2024-09-14T13:02:32.108644+0000","last_clean_scrub_stamp":"2024-09-14T13:02:32.108644+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":100,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:46:31.682718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1285,"num_read_kb":1365,"num_write":297,"num_write_kb":120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"68.12","version":"0'0","reported_seq":48,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:46.068616+0000","last_change":"2024-09-14T13:02:46.068616+0000","last_active":"2024-09-14T13:02:46.068616+0000","last_peered":"2024-09-14T13:02:46.068616+0000","last_clean":"2024-09-14T13:02:46.068616+0000","last_became_active":"2024-09-14T11:58:43.675254+0000","last_became_peered":"2024-09-14T11:58:43.675254+0000","last_unstale":"2024-09-14T13:02:46.068616+0000","last_undegraded":"2024-09-14T13:02:46.068616+0000","last_fullsized":"2024-09-14T13:02:46.068616+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T13:02:46.068404+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T13:02:46.068404+0000","last_clean_scrub_stamp":"2024-09-14T13:02:46.068404+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:17:57.105487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"67.15","version":"267'2","reported_seq":73,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:58.925851+0000","last_change":"2024-09-14T13:02:58.925851+0000","last_active":"2024-09-14T13:02:58.925851+0000","last_peered":"2024-09-14T13:02:58.925851+0000","last_clean":"2024-09-14T13:02:58.925851+0000","last_became_active":"2024-09-14T11:30:17.536010+0000","last_became_peered":"2024-09-14T11:30:17.536010+0000","last_unstale":"2024-09-14T13:02:58.925851+0000","last_undegraded":"2024-09-14T13:02:58.925851+0000","last_fullsized":"2024-09-14T13:02:58.925851+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'2","last_scrub_stamp":"2024-09-14T13:02:58.925664+0000","last_deep_scrub":"267'2","last_deep_scrub_stamp":"2024-09-14T13:02:58.925664+0000","last_clean_scrub_stamp":"2024-09-14T13:02:58.925664+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:20:24.512417+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":8192,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.14","version":"267'5","reported_seq":84,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:49.396110+0000","last_change":"2024-09-14T13:02:49.396110+0000","last_active":"2024-09-14T13:02:49.396110+0000","last_peered":"2024-09-14T13:02:49.396110+0000","last_clean":"2024-09-14T13:02:49.396110+0000","last_became_active":"2024-09-14T11:30:10.462605+0000","last_became_peered":"2024-09-14T11:30:10.462605+0000","last_unstale":"2024-09-14T13:02:49.396110+0000","last_undegraded":"2024-09-14T13:02:49.396110+0000","last_fullsized":"2024-09-14T13:02:49.396110+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'5","last_scrub_stamp":"2024-09-14T13:02:49.395882+0000","last_deep_scrub":"267'5","last_deep_scrub_stamp":"2024-09-14T13:02:49.395882+0000","last_clean_scrub_stamp":"2024-09-14T13:02:49.395882+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:30:58.135259+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5120,"num_write":10,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.17","version":"267'12","reported_seq":113,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:58.182961+0000","last_change":"2024-09-14T13:02:58.182961+0000","last_active":"2024-09-14T13:02:58.182961+0000","last_peered":"2024-09-14T13:02:58.182961+0000","last_clean":"2024-09-14T13:02:58.182961+0000","last_became_active":"2024-09-14T11:24:10.101934+0000","last_became_peered":"2024-09-14T11:24:10.101934+0000","last_unstale":"2024-09-14T13:02:58.182961+0000","last_undegraded":"2024-09-14T13:02:58.182961+0000","last_fullsized":"2024-09-14T13:02:58.182961+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'12","last_scrub_stamp":"2024-09-14T13:02:58.182770+0000","last_deep_scrub":"267'12","last_deep_scrub_stamp":"2024-09-14T13:02:58.182770+0000","last_clean_scrub_stamp":"2024-09-14T13:02:58.182770+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:55:09.679099+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":86,"num_read_kb":56,"num_write":31,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.13","version":"267'2","reported_seq":50,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:39.163978+0000","last_change":"2024-09-14T13:02:39.163978+0000","last_active":"2024-09-14T13:02:39.163978+0000","last_peered":"2024-09-14T13:02:39.163978+0000","last_clean":"2024-09-14T13:02:39.163978+0000","last_became_active":"2024-09-14T11:58:43.675526+0000","last_became_peered":"2024-09-14T11:58:43.675526+0000","last_unstale":"2024-09-14T13:02:39.163978+0000","last_undegraded":"2024-09-14T13:02:39.163978+0000","last_fullsized":"2024-09-14T13:02:39.163978+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'2","last_scrub_stamp":"2024-09-14T13:02:39.163783+0000","last_deep_scrub":"267'2","last_deep_scrub_stamp":"2024-09-14T13:02:39.163783+0000","last_clean_scrub_stamp":"2024-09-14T13:02:39.163783+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:02:56.160097+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":188,"num_omap_keys":2,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.14","version":"267'7","reported_seq":84,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:56.914539+0000","last_change":"2024-09-14T13:02:56.914539+0000","last_active":"2024-09-14T13:02:56.914539+0000","last_peered":"2024-09-14T13:02:56.914539+0000","last_clean":"2024-09-14T13:02:56.914539+0000","last_became_active":"2024-09-14T11:30:17.543741+0000","last_became_peered":"2024-09-14T11:30:17.543741+0000","last_unstale":"2024-09-14T13:02:56.914539+0000","last_undegraded":"2024-09-14T13:02:56.914539+0000","last_fullsized":"2024-09-14T13:02:56.914539+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'7","last_scrub_stamp":"2024-09-14T13:02:56.914348+0000","last_deep_scrub":"267'7","last_deep_scrub_stamp":"2024-09-14T13:02:56.914348+0000","last_clean_scrub_stamp":"2024-09-14T13:02:56.914348+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:23:56.978385+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":20482,"num_write":12,"num_write_kb":8192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.15","version":"267'3","reported_seq":80,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:52.448531+0000","last_change":"2024-09-14T13:02:52.448531+0000","last_active":"2024-09-14T13:02:52.448531+0000","last_peered":"2024-09-14T13:02:52.448531+0000","last_clean":"2024-09-14T13:02:52.448531+0000","last_became_active":"2024-09-14T11:30:10.468238+0000","last_became_peered":"2024-09-14T11:30:10.468238+0000","last_unstale":"2024-09-14T13:02:52.448531+0000","last_undegraded":"2024-09-14T13:02:52.448531+0000","last_fullsized":"2024-09-14T13:02:52.448531+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'3","last_scrub_stamp":"2024-09-14T13:02:52.448307+0000","last_deep_scrub":"267'3","last_deep_scrub_stamp":"2024-09-14T13:02:52.448307+0000","last_clean_scrub_stamp":"2024-09-14T13:02:52.448307+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:43:13.784604+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2048,"num_write":8,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.16","version":"267'33","reported_seq":176,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:48.914584+0000","last_change":"2024-09-14T13:02:48.914584+0000","last_active":"2024-09-14T13:02:48.914584+0000","last_peered":"2024-09-14T13:02:48.914584+0000","last_clean":"2024-09-14T13:02:48.914584+0000","last_became_active":"2024-09-14T11:24:10.128354+0000","last_became_peered":"2024-09-14T11:24:10.128354+0000","last_unstale":"2024-09-14T13:02:48.914584+0000","last_undegraded":"2024-09-14T13:02:48.914584+0000","last_fullsized":"2024-09-14T13:02:48.914584+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'33","last_scrub_stamp":"2024-09-14T13:02:48.914515+0000","last_deep_scrub":"267'33","last_deep_scrub_stamp":"2024-09-14T13:02:48.914515+0000","last_clean_scrub_stamp":"2024-09-14T13:02:48.914515+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:13:18.720734+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":269,"num_read_kb":173,"num_write":83,"num_write_kb":23,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.10","version":"0'0","reported_seq":48,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:03:02.498246+0000","last_change":"2024-09-14T13:03:02.498246+0000","last_active":"2024-09-14T13:03:02.498246+0000","last_peered":"2024-09-14T13:03:02.498246+0000","last_clean":"2024-09-14T13:03:02.498246+0000","last_became_active":"2024-09-14T11:58:43.688698+0000","last_became_peered":"2024-09-14T11:58:43.688698+0000","last_unstale":"2024-09-14T13:03:02.498246+0000","last_undegraded":"2024-09-14T13:03:02.498246+0000","last_fullsized":"2024-09-14T13:03:02.498246+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T13:03:02.497987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T13:03:02.497987+0000","last_clean_scrub_stamp":"2024-09-14T13:03:02.497987+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:41:23.457569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.17","version":"267'5","reported_seq":79,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:55.960565+0000","last_change":"2024-09-14T13:02:55.960565+0000","last_active":"2024-09-14T13:02:55.960565+0000","last_peered":"2024-09-14T13:02:55.960565+0000","last_clean":"2024-09-14T13:02:55.960565+0000","last_became_active":"2024-09-14T11:30:17.543802+0000","last_became_peered":"2024-09-14T11:30:17.543802+0000","last_unstale":"2024-09-14T13:02:55.960565+0000","last_undegraded":"2024-09-14T13:02:55.960565+0000","last_fullsized":"2024-09-14T13:02:55.960565+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'5","last_scrub_stamp":"2024-09-14T13:02:55.960383+0000","last_deep_scrub":"267'5","last_deep_scrub_stamp":"2024-09-14T13:02:55.960383+0000","last_clean_scrub_stamp":"2024-09-14T13:02:55.960383+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:00:11.092372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":20480,"num_write":10,"num_write_kb":8192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.16","version":"264'4","reported_seq":85,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:34.136962+0000","last_change":"2024-09-14T13:02:34.136962+0000","last_active":"2024-09-14T13:02:34.136962+0000","last_peered":"2024-09-14T13:02:34.136962+0000","last_clean":"2024-09-14T13:02:34.136962+0000","last_became_active":"2024-09-14T11:30:10.471956+0000","last_became_peered":"2024-09-14T11:30:10.471956+0000","last_unstale":"2024-09-14T13:02:34.136962+0000","last_undegraded":"2024-09-14T13:02:34.136962+0000","last_fullsized":"2024-09-14T13:02:34.136962+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'4","last_scrub_stamp":"2024-09-14T13:02:34.136748+0000","last_deep_scrub":"264'4","last_deep_scrub_stamp":"2024-09-14T13:02:34.136748+0000","last_clean_scrub_stamp":"2024-09-14T13:02:34.136748+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:49:40.325059+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":4098,"num_write":4,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.15","version":"267'34","reported_seq":173,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:31.141513+0000","last_change":"2024-09-14T13:02:31.141513+0000","last_active":"2024-09-14T13:02:31.141513+0000","last_peered":"2024-09-14T13:02:31.141513+0000","last_clean":"2024-09-14T13:02:31.141513+0000","last_became_active":"2024-09-14T11:24:10.097011+0000","last_became_peered":"2024-09-14T11:24:10.097011+0000","last_unstale":"2024-09-14T13:02:31.141513+0000","last_undegraded":"2024-09-14T13:02:31.141513+0000","last_fullsized":"2024-09-14T13:02:31.141513+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'34","last_scrub_stamp":"2024-09-14T13:02:31.141318+0000","last_deep_scrub":"267'34","last_deep_scrub_stamp":"2024-09-14T13:02:31.141318+0000","last_clean_scrub_stamp":"2024-09-14T13:02:31.141318+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:19:52.142240+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":263,"num_read_kb":166,"num_write":89,"num_write_kb":24,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.11","version":"0'0","reported_seq":48,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:53.318862+0000","last_change":"2024-09-14T13:02:53.318862+0000","last_active":"2024-09-14T13:02:53.318862+0000","last_peered":"2024-09-14T13:02:53.318862+0000","last_clean":"2024-09-14T13:02:53.318862+0000","last_became_active":"2024-09-14T11:58:43.688315+0000","last_became_peered":"2024-09-14T11:58:43.688315+0000","last_unstale":"2024-09-14T13:02:53.318862+0000","last_undegraded":"2024-09-14T13:02:53.318862+0000","last_fullsized":"2024-09-14T13:02:53.318862+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T13:02:53.318677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T13:02:53.318677+0000","last_clean_scrub_stamp":"2024-09-14T13:02:53.318677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:39:23.632785+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.16","version":"0'0","reported_seq":69,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:52.528345+0000","last_change":"2024-09-14T13:02:52.528345+0000","last_active":"2024-09-14T13:02:52.528345+0000","last_peered":"2024-09-14T13:02:52.528345+0000","last_clean":"2024-09-14T13:02:52.528345+0000","last_became_active":"2024-09-14T11:30:17.528777+0000","last_became_peered":"2024-09-14T11:30:17.528777+0000","last_unstale":"2024-09-14T13:02:52.528345+0000","last_undegraded":"2024-09-14T13:02:52.528345+0000","last_fullsized":"2024-09-14T13:02:52.528345+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T13:02:52.528156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T13:02:52.528156+0000","last_clean_scrub_stamp":"2024-09-14T13:02:52.528156+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:40:48.036099+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.17","version":"267'4","reported_seq":81,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:03:00.107198+0000","last_change":"2024-09-14T13:03:00.107198+0000","last_active":"2024-09-14T13:03:00.107198+0000","last_peered":"2024-09-14T13:03:00.107198+0000","last_clean":"2024-09-14T13:03:00.107198+0000","last_became_active":"2024-09-14T11:30:10.469237+0000","last_became_peered":"2024-09-14T11:30:10.469237+0000","last_unstale":"2024-09-14T13:03:00.107198+0000","last_undegraded":"2024-09-14T13:03:00.107198+0000","last_fullsized":"2024-09-14T13:03:00.107198+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'4","last_scrub_stamp":"2024-09-14T13:03:00.107014+0000","last_deep_scrub":"267'4","last_deep_scrub_stamp":"2024-09-14T13:03:00.107014+0000","last_clean_scrub_stamp":"2024-09-14T13:03:00.107014+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:07:06.365328+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":4794,"num_write":4,"num_write_kb":4794,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.14","version":"267'34","reported_seq":172,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:46.544179+0000","last_change":"2024-09-14T13:02:46.544179+0000","last_active":"2024-09-14T13:02:46.544179+0000","last_peered":"2024-09-14T13:02:46.544179+0000","last_clean":"2024-09-14T13:02:46.544179+0000","last_became_active":"2024-09-14T11:24:10.120143+0000","last_became_peered":"2024-09-14T11:24:10.120143+0000","last_unstale":"2024-09-14T13:02:46.544179+0000","last_undegraded":"2024-09-14T13:02:46.544179+0000","last_fullsized":"2024-09-14T13:02:46.544179+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'34","last_scrub_stamp":"2024-09-14T13:02:46.543898+0000","last_deep_scrub":"267'34","last_deep_scrub_stamp":"2024-09-14T13:02:46.543898+0000","last_clean_scrub_stamp":"2024-09-14T13:02:46.543898+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:58:57.583794+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":239,"num_read_kb":157,"num_write":95,"num_write_kb":23,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.16","version":"0'0","reported_seq":39,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:59:08.469272+0000","last_change":"2024-09-14T11:58:43.687060+0000","last_active":"2024-09-14T12:59:08.469272+0000","last_peered":"2024-09-14T12:59:08.469272+0000","last_clean":"2024-09-14T12:59:08.469272+0000","last_became_active":"2024-09-14T11:58:43.685594+0000","last_became_peered":"2024-09-14T11:58:43.685594+0000","last_unstale":"2024-09-14T12:59:08.469272+0000","last_undegraded":"2024-09-14T12:59:08.469272+0000","last_fullsized":"2024-09-14T12:59:08.469272+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:58:42.635024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:58:42.635024+0000","last_clean_scrub_stamp":"2024-09-14T11:58:42.635024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:15:01.961069+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.11","version":"264'4","reported_seq":80,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:45.073774+0000","last_change":"2024-09-14T13:02:45.073774+0000","last_active":"2024-09-14T13:02:45.073774+0000","last_peered":"2024-09-14T13:02:45.073774+0000","last_clean":"2024-09-14T13:02:45.073774+0000","last_became_active":"2024-09-14T11:30:17.523720+0000","last_became_peered":"2024-09-14T11:30:17.523720+0000","last_unstale":"2024-09-14T13:02:45.073774+0000","last_undegraded":"2024-09-14T13:02:45.073774+0000","last_fullsized":"2024-09-14T13:02:45.073774+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'4","last_scrub_stamp":"2024-09-14T13:02:45.073582+0000","last_deep_scrub":"264'4","last_deep_scrub_stamp":"2024-09-14T13:02:45.073582+0000","last_clean_scrub_stamp":"2024-09-14T13:02:45.073582+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:25:26.782625+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":4098,"num_write":4,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.10","version":"264'2","reported_seq":80,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:44.664674+0000","last_change":"2024-09-14T13:02:44.664674+0000","last_active":"2024-09-14T13:02:44.664674+0000","last_peered":"2024-09-14T13:02:44.664674+0000","last_clean":"2024-09-14T13:02:44.664674+0000","last_became_active":"2024-09-14T11:30:10.463671+0000","last_became_peered":"2024-09-14T11:30:10.463671+0000","last_unstale":"2024-09-14T13:02:44.664674+0000","last_undegraded":"2024-09-14T13:02:44.664674+0000","last_fullsized":"2024-09-14T13:02:44.664674+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'2","last_scrub_stamp":"2024-09-14T13:02:44.664483+0000","last_deep_scrub":"264'2","last_deep_scrub_stamp":"2024-09-14T13:02:44.664483+0000","last_clean_scrub_stamp":"2024-09-14T13:02:44.664483+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:26:59.055271+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":4096,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.13","version":"267'23","reported_seq":148,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:45.589370+0000","last_change":"2024-09-14T13:02:45.589370+0000","last_active":"2024-09-14T13:02:45.589370+0000","last_peered":"2024-09-14T13:02:45.589370+0000","last_clean":"2024-09-14T13:02:45.589370+0000","last_became_active":"2024-09-14T11:24:10.120764+0000","last_became_peered":"2024-09-14T11:24:10.120764+0000","last_unstale":"2024-09-14T13:02:45.589370+0000","last_undegraded":"2024-09-14T13:02:45.589370+0000","last_fullsized":"2024-09-14T13:02:45.589370+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'23","last_scrub_stamp":"2024-09-14T13:02:45.589195+0000","last_deep_scrub":"267'23","last_deep_scrub_stamp":"2024-09-14T13:02:45.589195+0000","last_clean_scrub_stamp":"2024-09-14T13:02:45.589195+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:06:54.718349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":187,"num_read_kb":128,"num_write":64,"num_write_kb":17,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.17","version":"0'0","reported_seq":47,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:03:03.176520+0000","last_change":"2024-09-14T13:03:03.176520+0000","last_active":"2024-09-14T13:03:03.176520+0000","last_peered":"2024-09-14T13:03:03.176520+0000","last_clean":"2024-09-14T13:03:03.176520+0000","last_became_active":"2024-09-14T11:58:43.677005+0000","last_became_peered":"2024-09-14T11:58:43.677005+0000","last_unstale":"2024-09-14T13:03:03.176520+0000","last_undegraded":"2024-09-14T13:03:03.176520+0000","last_fullsized":"2024-09-14T13:03:03.176520+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T13:03:03.176332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T13:03:03.176332+0000","last_clean_scrub_stamp":"2024-09-14T13:03:03.176332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:02:49.794607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.10","version":"267'4","reported_seq":76,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:39.233788+0000","last_change":"2024-09-14T13:02:39.233788+0000","last_active":"2024-09-14T13:02:39.233788+0000","last_peered":"2024-09-14T13:02:39.233788+0000","last_clean":"2024-09-14T13:02:39.233788+0000","last_became_active":"2024-09-14T11:30:17.510031+0000","last_became_peered":"2024-09-14T11:30:17.510031+0000","last_unstale":"2024-09-14T13:02:39.233788+0000","last_undegraded":"2024-09-14T13:02:39.233788+0000","last_fullsized":"2024-09-14T13:02:39.233788+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'4","last_scrub_stamp":"2024-09-14T13:02:39.233520+0000","last_deep_scrub":"267'4","last_deep_scrub_stamp":"2024-09-14T13:02:39.233520+0000","last_clean_scrub_stamp":"2024-09-14T13:02:39.233520+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:50:08.145806+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":2048,"num_write":4,"num_write_kb":2048,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.11","version":"0'0","reported_seq":76,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:53.947064+0000","last_change":"2024-09-14T13:02:53.947064+0000","last_active":"2024-09-14T13:02:53.947064+0000","last_peered":"2024-09-14T13:02:53.947064+0000","last_clean":"2024-09-14T13:02:53.947064+0000","last_became_active":"2024-09-14T11:30:10.459020+0000","last_became_peered":"2024-09-14T11:30:10.459020+0000","last_unstale":"2024-09-14T13:02:53.947064+0000","last_undegraded":"2024-09-14T13:02:53.947064+0000","last_fullsized":"2024-09-14T13:02:53.947064+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T13:02:53.946834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T13:02:53.946834+0000","last_clean_scrub_stamp":"2024-09-14T13:02:53.946834+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:18:29.470299+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.12","version":"267'21","reported_seq":144,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:42.232596+0000","last_change":"2024-09-14T13:02:42.232596+0000","last_active":"2024-09-14T13:02:42.232596+0000","last_peered":"2024-09-14T13:02:42.232596+0000","last_clean":"2024-09-14T13:02:42.232596+0000","last_became_active":"2024-09-14T11:24:10.124482+0000","last_became_peered":"2024-09-14T11:24:10.124482+0000","last_unstale":"2024-09-14T13:02:42.232596+0000","last_undegraded":"2024-09-14T13:02:42.232596+0000","last_fullsized":"2024-09-14T13:02:42.232596+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'21","last_scrub_stamp":"2024-09-14T13:02:42.232388+0000","last_deep_scrub":"267'21","last_deep_scrub_stamp":"2024-09-14T13:02:42.232388+0000","last_clean_scrub_stamp":"2024-09-14T13:02:42.232388+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:21:49.013790+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":165,"num_read_kb":113,"num_write":54,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.14","version":"267'2","reported_seq":50,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:57.167435+0000","last_change":"2024-09-14T13:02:57.167435+0000","last_active":"2024-09-14T13:02:57.167435+0000","last_peered":"2024-09-14T13:02:57.167435+0000","last_clean":"2024-09-14T13:02:57.167435+0000","last_became_active":"2024-09-14T11:58:43.675734+0000","last_became_peered":"2024-09-14T11:58:43.675734+0000","last_unstale":"2024-09-14T13:02:57.167435+0000","last_undegraded":"2024-09-14T13:02:57.167435+0000","last_fullsized":"2024-09-14T13:02:57.167435+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'2","last_scrub_stamp":"2024-09-14T13:02:57.167229+0000","last_deep_scrub":"267'2","last_deep_scrub_stamp":"2024-09-14T13:02:57.167229+0000","last_clean_scrub_stamp":"2024-09-14T13:02:57.167229+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:05:00.813960+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":188,"num_omap_keys":2,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.13","version":"267'8","reported_seq":82,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:03:01.945980+0000","last_change":"2024-09-14T13:03:01.945980+0000","last_active":"2024-09-14T13:03:01.945980+0000","last_peered":"2024-09-14T13:03:01.945980+0000","last_clean":"2024-09-14T13:03:01.945980+0000","last_became_active":"2024-09-14T11:30:17.545560+0000","last_became_peered":"2024-09-14T11:30:17.545560+0000","last_unstale":"2024-09-14T13:03:01.945980+0000","last_undegraded":"2024-09-14T13:03:01.945980+0000","last_fullsized":"2024-09-14T13:03:01.945980+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'8","last_scrub_stamp":"2024-09-14T13:03:01.945774+0000","last_deep_scrub":"267'8","last_deep_scrub_stamp":"2024-09-14T13:03:01.945774+0000","last_clean_scrub_stamp":"2024-09-14T13:03:01.945774+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:40:14.450687+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":9216,"num_write":18,"num_write_kb":9216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.12","version":"267'8","reported_seq":90,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:40.351336+0000","last_change":"2024-09-14T13:02:40.351336+0000","last_active":"2024-09-14T13:02:40.351336+0000","last_peered":"2024-09-14T13:02:40.351336+0000","last_clean":"2024-09-14T13:02:40.351336+0000","last_became_active":"2024-09-14T11:30:10.474328+0000","last_became_peered":"2024-09-14T11:30:10.474328+0000","last_unstale":"2024-09-14T13:02:40.351336+0000","last_undegraded":"2024-09-14T13:02:40.351336+0000","last_fullsized":"2024-09-14T13:02:40.351336+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'8","last_scrub_stamp":"2024-09-14T13:02:40.351142+0000","last_deep_scrub":"267'8","last_deep_scrub_stamp":"2024-09-14T13:02:40.351142+0000","last_clean_scrub_stamp":"2024-09-14T13:02:40.351142+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:55:27.295194+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":16386,"num_write":18,"num_write_kb":8192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"65.11","version":"267'78","reported_seq":301,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:47.566841+0000","last_change":"2024-09-14T13:02:47.566841+0000","last_active":"2024-09-14T13:02:47.566841+0000","last_peered":"2024-09-14T13:02:47.566841+0000","last_clean":"2024-09-14T13:02:47.566841+0000","last_became_active":"2024-09-14T11:24:10.107177+0000","last_became_peered":"2024-09-14T11:24:10.107177+0000","last_unstale":"2024-09-14T13:02:47.566841+0000","last_undegraded":"2024-09-14T13:02:47.566841+0000","last_fullsized":"2024-09-14T13:02:47.566841+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'78","last_scrub_stamp":"2024-09-14T13:02:47.566658+0000","last_deep_scrub":"267'78","last_deep_scrub_stamp":"2024-09-14T13:02:47.566658+0000","last_clean_scrub_stamp":"2024-09-14T13:02:47.566658+0000","objects_scrubbed":0,"log_size":78,"log_dups_size":0,"ondisk_log_size":78,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:13:03.810958+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":655,"num_read_kb":451,"num_write":184,"num_write_kb":61,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"68.15","version":"267'1","reported_seq":40,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T12:59:08.469167+0000","last_change":"2024-09-14T11:58:43.694184+0000","last_active":"2024-09-14T12:59:08.469167+0000","last_peered":"2024-09-14T12:59:08.469167+0000","last_clean":"2024-09-14T12:59:08.469167+0000","last_became_active":"2024-09-14T11:58:43.692552+0000","last_became_peered":"2024-09-14T11:58:43.692552+0000","last_unstale":"2024-09-14T12:59:08.469167+0000","last_undegraded":"2024-09-14T12:59:08.469167+0000","last_fullsized":"2024-09-14T12:59:08.469167+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:58:42.635024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:58:42.635024+0000","last_clean_scrub_stamp":"2024-09-14T11:58:42.635024+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:25:30.983665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.12","version":"267'3","reported_seq":73,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:42.335939+0000","last_change":"2024-09-14T13:02:42.335939+0000","last_active":"2024-09-14T13:02:42.335939+0000","last_peered":"2024-09-14T13:02:42.335939+0000","last_clean":"2024-09-14T13:02:42.335939+0000","last_became_active":"2024-09-14T11:30:17.523975+0000","last_became_peered":"2024-09-14T11:30:17.523975+0000","last_unstale":"2024-09-14T13:02:42.335939+0000","last_undegraded":"2024-09-14T13:02:42.335939+0000","last_fullsized":"2024-09-14T13:02:42.335939+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'3","last_scrub_stamp":"2024-09-14T13:02:42.335749+0000","last_deep_scrub":"267'3","last_deep_scrub_stamp":"2024-09-14T13:02:42.335749+0000","last_clean_scrub_stamp":"2024-09-14T13:02:42.335749+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:09:02.602816+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":8,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"66.13","version":"267'2","reported_seq":78,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:48.367455+0000","last_change":"2024-09-14T13:02:48.367455+0000","last_active":"2024-09-14T13:02:48.367455+0000","last_peered":"2024-09-14T13:02:48.367455+0000","last_clean":"2024-09-14T13:02:48.367455+0000","last_became_active":"2024-09-14T11:30:10.467218+0000","last_became_peered":"2024-09-14T11:30:10.467218+0000","last_unstale":"2024-09-14T13:02:48.367455+0000","last_undegraded":"2024-09-14T13:02:48.367455+0000","last_fullsized":"2024-09-14T13:02:48.367455+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'2","last_scrub_stamp":"2024-09-14T13:02:48.367273+0000","last_deep_scrub":"267'2","last_deep_scrub_stamp":"2024-09-14T13:02:48.367273+0000","last_clean_scrub_stamp":"2024-09-14T13:02:48.367273+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:55:28.969549+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.10","version":"267'25","reported_seq":151,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:45.928684+0000","last_change":"2024-09-14T13:02:45.928684+0000","last_active":"2024-09-14T13:02:45.928684+0000","last_peered":"2024-09-14T13:02:45.928684+0000","last_clean":"2024-09-14T13:02:45.928684+0000","last_became_active":"2024-09-14T11:24:10.124485+0000","last_became_peered":"2024-09-14T11:24:10.124485+0000","last_unstale":"2024-09-14T13:02:45.928684+0000","last_undegraded":"2024-09-14T13:02:45.928684+0000","last_fullsized":"2024-09-14T13:02:45.928684+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'25","last_scrub_stamp":"2024-09-14T13:02:45.928486+0000","last_deep_scrub":"267'25","last_deep_scrub_stamp":"2024-09-14T13:02:45.928486+0000","last_clean_scrub_stamp":"2024-09-14T13:02:45.928486+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:00:10.974512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":199,"num_read_kb":137,"num_write":62,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.a","version":"0'0","reported_seq":50,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:38.185136+0000","last_change":"2024-09-14T13:02:38.185136+0000","last_active":"2024-09-14T13:02:38.185136+0000","last_peered":"2024-09-14T13:02:38.185136+0000","last_clean":"2024-09-14T13:02:38.185136+0000","last_became_active":"2024-09-14T11:58:43.665150+0000","last_became_peered":"2024-09-14T11:58:43.665150+0000","last_unstale":"2024-09-14T13:02:38.185136+0000","last_undegraded":"2024-09-14T13:02:38.185136+0000","last_fullsized":"2024-09-14T13:02:38.185136+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T13:02:38.184941+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T13:02:38.184941+0000","last_clean_scrub_stamp":"2024-09-14T13:02:38.184941+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T00:23:09.561336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.d","version":"0'0","reported_seq":72,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:52.908568+0000","last_change":"2024-09-14T13:02:52.908568+0000","last_active":"2024-09-14T13:02:52.908568+0000","last_peered":"2024-09-14T13:02:52.908568+0000","last_clean":"2024-09-14T13:02:52.908568+0000","last_became_active":"2024-09-14T11:30:17.540505+0000","last_became_peered":"2024-09-14T11:30:17.540505+0000","last_unstale":"2024-09-14T13:02:52.908568+0000","last_undegraded":"2024-09-14T13:02:52.908568+0000","last_fullsized":"2024-09-14T13:02:52.908568+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T13:02:52.908384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T13:02:52.908384+0000","last_clean_scrub_stamp":"2024-09-14T13:02:52.908384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:18:19.033355+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.c","version":"264'2","reported_seq":82,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:51.479410+0000","last_change":"2024-09-14T13:02:51.479410+0000","last_active":"2024-09-14T13:02:51.479410+0000","last_peered":"2024-09-14T13:02:51.479410+0000","last_clean":"2024-09-14T13:02:51.479410+0000","last_became_active":"2024-09-14T11:30:10.464846+0000","last_became_peered":"2024-09-14T11:30:10.464846+0000","last_unstale":"2024-09-14T13:02:51.479410+0000","last_undegraded":"2024-09-14T13:02:51.479410+0000","last_fullsized":"2024-09-14T13:02:51.479410+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'2","last_scrub_stamp":"2024-09-14T13:02:51.479226+0000","last_deep_scrub":"264'2","last_deep_scrub_stamp":"2024-09-14T13:02:51.479226+0000","last_clean_scrub_stamp":"2024-09-14T13:02:51.479226+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:27:49.211177+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":4096,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.f","version":"267'23","reported_seq":148,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:44.921374+0000","last_change":"2024-09-14T13:02:44.921374+0000","last_active":"2024-09-14T13:02:44.921374+0000","last_peered":"2024-09-14T13:02:44.921374+0000","last_clean":"2024-09-14T13:02:44.921374+0000","last_became_active":"2024-09-14T11:24:10.121456+0000","last_became_peered":"2024-09-14T11:24:10.121456+0000","last_unstale":"2024-09-14T13:02:44.921374+0000","last_undegraded":"2024-09-14T13:02:44.921374+0000","last_fullsized":"2024-09-14T13:02:44.921374+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'23","last_scrub_stamp":"2024-09-14T13:02:44.921191+0000","last_deep_scrub":"267'23","last_deep_scrub_stamp":"2024-09-14T13:02:44.921191+0000","last_clean_scrub_stamp":"2024-09-14T13:02:44.921191+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:11:59.492321+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":176,"num_read_kb":127,"num_write":57,"num_write_kb":16,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.b","version":"0'0","reported_seq":49,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:58.497890+0000","last_change":"2024-09-14T13:02:58.497890+0000","last_active":"2024-09-14T13:02:58.497890+0000","last_peered":"2024-09-14T13:02:58.497890+0000","last_clean":"2024-09-14T13:02:58.497890+0000","last_became_active":"2024-09-14T11:58:43.684927+0000","last_became_peered":"2024-09-14T11:58:43.684927+0000","last_unstale":"2024-09-14T13:02:58.497890+0000","last_undegraded":"2024-09-14T13:02:58.497890+0000","last_fullsized":"2024-09-14T13:02:58.497890+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T13:02:58.497711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T13:02:58.497711+0000","last_clean_scrub_stamp":"2024-09-14T13:02:58.497711+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:27:27.036538+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.c","version":"267'9","reported_seq":87,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:03:00.986080+0000","last_change":"2024-09-14T13:03:00.986080+0000","last_active":"2024-09-14T13:03:00.986080+0000","last_peered":"2024-09-14T13:03:00.986080+0000","last_clean":"2024-09-14T13:03:00.986080+0000","last_became_active":"2024-09-14T11:30:17.535131+0000","last_became_peered":"2024-09-14T11:30:17.535131+0000","last_unstale":"2024-09-14T13:03:00.986080+0000","last_undegraded":"2024-09-14T13:03:00.986080+0000","last_fullsized":"2024-09-14T13:03:00.986080+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'9","last_scrub_stamp":"2024-09-14T13:03:00.985884+0000","last_deep_scrub":"267'9","last_deep_scrub_stamp":"2024-09-14T13:03:00.985884+0000","last_clean_scrub_stamp":"2024-09-14T13:03:00.985884+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:13:41.894851+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":16384,"num_write":14,"num_write_kb":16384,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.d","version":"0'0","reported_seq":78,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:36.205696+0000","last_change":"2024-09-14T13:02:36.205696+0000","last_active":"2024-09-14T13:02:36.205696+0000","last_peered":"2024-09-14T13:02:36.205696+0000","last_clean":"2024-09-14T13:02:36.205696+0000","last_became_active":"2024-09-14T11:30:10.475862+0000","last_became_peered":"2024-09-14T11:30:10.475862+0000","last_unstale":"2024-09-14T13:02:36.205696+0000","last_undegraded":"2024-09-14T13:02:36.205696+0000","last_fullsized":"2024-09-14T13:02:36.205696+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T13:02:36.205496+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T13:02:36.205496+0000","last_clean_scrub_stamp":"2024-09-14T13:02:36.205496+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:14:53.482444+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.e","version":"267'20","reported_seq":139,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:45.358962+0000","last_change":"2024-09-14T13:02:45.358962+0000","last_active":"2024-09-14T13:02:45.358962+0000","last_peered":"2024-09-14T13:02:45.358962+0000","last_clean":"2024-09-14T13:02:45.358962+0000","last_became_active":"2024-09-14T11:24:10.116115+0000","last_became_peered":"2024-09-14T11:24:10.116115+0000","last_unstale":"2024-09-14T13:02:45.358962+0000","last_undegraded":"2024-09-14T13:02:45.358962+0000","last_fullsized":"2024-09-14T13:02:45.358962+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'20","last_scrub_stamp":"2024-09-14T13:02:45.358766+0000","last_deep_scrub":"267'20","last_deep_scrub_stamp":"2024-09-14T13:02:45.358766+0000","last_clean_scrub_stamp":"2024-09-14T13:02:45.358766+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:32:46.769223+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":147,"num_read_kb":99,"num_write":62,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"68.8","version":"0'0","reported_seq":50,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:43.309200+0000","last_change":"2024-09-14T13:02:43.309200+0000","last_active":"2024-09-14T13:02:43.309200+0000","last_peered":"2024-09-14T13:02:43.309200+0000","last_clean":"2024-09-14T13:02:43.309200+0000","last_became_active":"2024-09-14T11:58:43.689083+0000","last_became_peered":"2024-09-14T11:58:43.689083+0000","last_unstale":"2024-09-14T13:02:43.309200+0000","last_undegraded":"2024-09-14T13:02:43.309200+0000","last_fullsized":"2024-09-14T13:02:43.309200+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T13:02:43.309020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T13:02:43.309020+0000","last_clean_scrub_stamp":"2024-09-14T13:02:43.309020+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:23:55.448786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"67.f","version":"267'7","reported_seq":83,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:44.092368+0000","last_change":"2024-09-14T13:02:44.092228+0000","last_active":"2024-09-14T13:02:44.092368+0000","last_peered":"2024-09-14T13:02:44.092368+0000","last_clean":"2024-09-14T13:02:44.092368+0000","last_became_active":"2024-09-14T11:30:17.514381+0000","last_became_peered":"2024-09-14T11:30:17.514381+0000","last_unstale":"2024-09-14T13:02:44.092368+0000","last_undegraded":"2024-09-14T13:02:44.092368+0000","last_fullsized":"2024-09-14T13:02:44.092368+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'7","last_scrub_stamp":"2024-09-14T13:02:44.092047+0000","last_deep_scrub":"267'7","last_deep_scrub_stamp":"2024-09-14T13:02:44.092047+0000","last_clean_scrub_stamp":"2024-09-14T13:02:44.092047+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:39:10.285953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":3072,"num_write":12,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.e","version":"267'6","reported_seq":91,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:46.169642+0000","last_change":"2024-09-14T13:02:46.169642+0000","last_active":"2024-09-14T13:02:46.169642+0000","last_peered":"2024-09-14T13:02:46.169642+0000","last_clean":"2024-09-14T13:02:46.169642+0000","last_became_active":"2024-09-14T11:30:10.473586+0000","last_became_peered":"2024-09-14T11:30:10.473586+0000","last_unstale":"2024-09-14T13:02:46.169642+0000","last_undegraded":"2024-09-14T13:02:46.169642+0000","last_fullsized":"2024-09-14T13:02:46.169642+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'6","last_scrub_stamp":"2024-09-14T13:02:46.169413+0000","last_deep_scrub":"267'6","last_deep_scrub_stamp":"2024-09-14T13:02:46.169413+0000","last_clean_scrub_stamp":"2024-09-14T13:02:46.169413+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:50:40.657781+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":7170,"num_write":6,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.d","version":"267'29","reported_seq":167,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:35.416072+0000","last_change":"2024-09-14T13:02:35.416072+0000","last_active":"2024-09-14T13:02:35.416072+0000","last_peered":"2024-09-14T13:02:35.416072+0000","last_clean":"2024-09-14T13:02:35.416072+0000","last_became_active":"2024-09-14T11:24:10.115813+0000","last_became_peered":"2024-09-14T11:24:10.115813+0000","last_unstale":"2024-09-14T13:02:35.416072+0000","last_undegraded":"2024-09-14T13:02:35.416072+0000","last_fullsized":"2024-09-14T13:02:35.416072+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'29","last_scrub_stamp":"2024-09-14T13:02:35.415892+0000","last_deep_scrub":"267'29","last_deep_scrub_stamp":"2024-09-14T13:02:35.415892+0000","last_clean_scrub_stamp":"2024-09-14T13:02:35.415892+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:05:33.386173+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":238,"num_read_kb":154,"num_write":72,"num_write_kb":21,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.9","version":"0'0","reported_seq":50,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:03:00.485812+0000","last_change":"2024-09-14T13:03:00.485812+0000","last_active":"2024-09-14T13:03:00.485812+0000","last_peered":"2024-09-14T13:03:00.485812+0000","last_clean":"2024-09-14T13:03:00.485812+0000","last_became_active":"2024-09-14T11:58:43.691369+0000","last_became_peered":"2024-09-14T11:58:43.691369+0000","last_unstale":"2024-09-14T13:03:00.485812+0000","last_undegraded":"2024-09-14T13:03:00.485812+0000","last_fullsized":"2024-09-14T13:03:00.485812+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T13:03:00.485632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T13:03:00.485632+0000","last_clean_scrub_stamp":"2024-09-14T13:03:00.485632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:06:19.198554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.e","version":"0'0","reported_seq":72,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:54.916711+0000","last_change":"2024-09-14T13:02:54.916711+0000","last_active":"2024-09-14T13:02:54.916711+0000","last_peered":"2024-09-14T13:02:54.916711+0000","last_clean":"2024-09-14T13:02:54.916711+0000","last_became_active":"2024-09-14T11:30:17.529982+0000","last_became_peered":"2024-09-14T11:30:17.529982+0000","last_unstale":"2024-09-14T13:02:54.916711+0000","last_undegraded":"2024-09-14T13:02:54.916711+0000","last_fullsized":"2024-09-14T13:02:54.916711+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T13:02:54.916536+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T13:02:54.916536+0000","last_clean_scrub_stamp":"2024-09-14T13:02:54.916536+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:58:24.758781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.f","version":"267'3","reported_seq":83,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:31.139213+0000","last_change":"2024-09-14T13:02:31.139077+0000","last_active":"2024-09-14T13:02:31.139213+0000","last_peered":"2024-09-14T13:02:31.139213+0000","last_clean":"2024-09-14T13:02:31.139213+0000","last_became_active":"2024-09-14T11:30:10.465658+0000","last_became_peered":"2024-09-14T11:30:10.465658+0000","last_unstale":"2024-09-14T13:02:31.139213+0000","last_undegraded":"2024-09-14T13:02:31.139213+0000","last_fullsized":"2024-09-14T13:02:31.139213+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'3","last_scrub_stamp":"2024-09-14T13:02:31.138897+0000","last_deep_scrub":"267'3","last_deep_scrub_stamp":"2024-09-14T13:02:31.138897+0000","last_clean_scrub_stamp":"2024-09-14T13:02:31.138897+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:26:50.921553+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":8192,"num_write":8,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.c","version":"267'13","reported_seq":120,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:30.100605+0000","last_change":"2024-09-14T13:02:30.100605+0000","last_active":"2024-09-14T13:02:30.100605+0000","last_peered":"2024-09-14T13:02:30.100605+0000","last_clean":"2024-09-14T13:02:30.100605+0000","last_became_active":"2024-09-14T11:24:10.125123+0000","last_became_peered":"2024-09-14T11:24:10.125123+0000","last_unstale":"2024-09-14T13:02:30.100605+0000","last_undegraded":"2024-09-14T13:02:30.100605+0000","last_fullsized":"2024-09-14T13:02:30.100605+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'13","last_scrub_stamp":"2024-09-14T13:02:30.100437+0000","last_deep_scrub":"267'13","last_deep_scrub_stamp":"2024-09-14T13:02:30.100437+0000","last_clean_scrub_stamp":"2024-09-14T13:02:30.100437+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:50:46.167171+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":97,"num_read_kb":65,"num_write":32,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.e","version":"0'0","reported_seq":49,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:03:02.970500+0000","last_change":"2024-09-14T13:03:02.970500+0000","last_active":"2024-09-14T13:03:02.970500+0000","last_peered":"2024-09-14T13:03:02.970500+0000","last_clean":"2024-09-14T13:03:02.970500+0000","last_became_active":"2024-09-14T11:58:43.686619+0000","last_became_peered":"2024-09-14T11:58:43.686619+0000","last_unstale":"2024-09-14T13:03:02.970500+0000","last_undegraded":"2024-09-14T13:03:02.970500+0000","last_fullsized":"2024-09-14T13:03:02.970500+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T13:03:02.970309+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T13:03:02.970309+0000","last_clean_scrub_stamp":"2024-09-14T13:03:02.970309+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:46:17.303284+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.9","version":"264'3","reported_seq":78,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:51.568470+0000","last_change":"2024-09-14T13:02:51.568470+0000","last_active":"2024-09-14T13:02:51.568470+0000","last_peered":"2024-09-14T13:02:51.568470+0000","last_clean":"2024-09-14T13:02:51.568470+0000","last_became_active":"2024-09-14T11:30:17.539102+0000","last_became_peered":"2024-09-14T11:30:17.539102+0000","last_unstale":"2024-09-14T13:02:51.568470+0000","last_undegraded":"2024-09-14T13:02:51.568470+0000","last_fullsized":"2024-09-14T13:02:51.568470+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'3","last_scrub_stamp":"2024-09-14T13:02:51.568280+0000","last_deep_scrub":"264'3","last_deep_scrub_stamp":"2024-09-14T13:02:51.568280+0000","last_clean_scrub_stamp":"2024-09-14T13:02:51.568280+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:49:51.160226+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":4096,"num_write":8,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.8","version":"267'4","reported_seq":86,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:47.162958+0000","last_change":"2024-09-14T13:02:47.162958+0000","last_active":"2024-09-14T13:02:47.162958+0000","last_peered":"2024-09-14T13:02:47.162958+0000","last_clean":"2024-09-14T13:02:47.162958+0000","last_became_active":"2024-09-14T11:30:10.452160+0000","last_became_peered":"2024-09-14T11:30:10.452160+0000","last_unstale":"2024-09-14T13:02:47.162958+0000","last_undegraded":"2024-09-14T13:02:47.162958+0000","last_fullsized":"2024-09-14T13:02:47.162958+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'4","last_scrub_stamp":"2024-09-14T13:02:47.162779+0000","last_deep_scrub":"267'4","last_deep_scrub_stamp":"2024-09-14T13:02:47.162779+0000","last_clean_scrub_stamp":"2024-09-14T13:02:47.162779+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:25:00.782145+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5120,"num_write":4,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.b","version":"267'29","reported_seq":164,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:44.239589+0000","last_change":"2024-09-14T13:02:44.239589+0000","last_active":"2024-09-14T13:02:44.239589+0000","last_peered":"2024-09-14T13:02:44.239589+0000","last_clean":"2024-09-14T13:02:44.239589+0000","last_became_active":"2024-09-14T11:24:10.106068+0000","last_became_peered":"2024-09-14T11:24:10.106068+0000","last_unstale":"2024-09-14T13:02:44.239589+0000","last_undegraded":"2024-09-14T13:02:44.239589+0000","last_fullsized":"2024-09-14T13:02:44.239589+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'29","last_scrub_stamp":"2024-09-14T13:02:44.239323+0000","last_deep_scrub":"267'29","last_deep_scrub_stamp":"2024-09-14T13:02:44.239323+0000","last_clean_scrub_stamp":"2024-09-14T13:02:44.239323+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:07:00.656881+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":230,"num_read_kb":146,"num_write":73,"num_write_kb":21,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.f","version":"0'0","reported_seq":49,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:59.497626+0000","last_change":"2024-09-14T13:02:59.497626+0000","last_active":"2024-09-14T13:02:59.497626+0000","last_peered":"2024-09-14T13:02:59.497626+0000","last_clean":"2024-09-14T13:02:59.497626+0000","last_became_active":"2024-09-14T11:58:43.691307+0000","last_became_peered":"2024-09-14T11:58:43.691307+0000","last_unstale":"2024-09-14T13:02:59.497626+0000","last_undegraded":"2024-09-14T13:02:59.497626+0000","last_fullsized":"2024-09-14T13:02:59.497626+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T13:02:59.497443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T13:02:59.497443+0000","last_clean_scrub_stamp":"2024-09-14T13:02:59.497443+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T00:27:05.287581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.8","version":"267'4","reported_seq":81,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:54.442501+0000","last_change":"2024-09-14T13:02:54.442501+0000","last_active":"2024-09-14T13:02:54.442501+0000","last_peered":"2024-09-14T13:02:54.442501+0000","last_clean":"2024-09-14T13:02:54.442501+0000","last_became_active":"2024-09-14T11:30:17.506181+0000","last_became_peered":"2024-09-14T11:30:17.506181+0000","last_unstale":"2024-09-14T13:02:54.442501+0000","last_undegraded":"2024-09-14T13:02:54.442501+0000","last_fullsized":"2024-09-14T13:02:54.442501+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'4","last_scrub_stamp":"2024-09-14T13:02:54.442287+0000","last_deep_scrub":"267'4","last_deep_scrub_stamp":"2024-09-14T13:02:54.442287+0000","last_clean_scrub_stamp":"2024-09-14T13:02:54.442287+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:08:30.731637+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":10240,"num_write":4,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.9","version":"267'14","reported_seq":104,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:34.171486+0000","last_change":"2024-09-14T13:02:34.171486+0000","last_active":"2024-09-14T13:02:34.171486+0000","last_peered":"2024-09-14T13:02:34.171486+0000","last_clean":"2024-09-14T13:02:34.171486+0000","last_became_active":"2024-09-14T11:30:10.470179+0000","last_became_peered":"2024-09-14T11:30:10.470179+0000","last_unstale":"2024-09-14T13:02:34.171486+0000","last_undegraded":"2024-09-14T13:02:34.171486+0000","last_fullsized":"2024-09-14T13:02:34.171486+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'14","last_scrub_stamp":"2024-09-14T13:02:34.171302+0000","last_deep_scrub":"267'14","last_deep_scrub_stamp":"2024-09-14T13:02:34.171302+0000","last_clean_scrub_stamp":"2024-09-14T13:02:34.171302+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:20:16.343393+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":18,"num_read_kb":28678,"num_write":24,"num_write_kb":16388,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.a","version":"267'15","reported_seq":126,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:44.574245+0000","last_change":"2024-09-14T13:02:44.574245+0000","last_active":"2024-09-14T13:02:44.574245+0000","last_peered":"2024-09-14T13:02:44.574245+0000","last_clean":"2024-09-14T13:02:44.574245+0000","last_became_active":"2024-09-14T11:24:10.102918+0000","last_became_peered":"2024-09-14T11:24:10.102918+0000","last_unstale":"2024-09-14T13:02:44.574245+0000","last_undegraded":"2024-09-14T13:02:44.574245+0000","last_fullsized":"2024-09-14T13:02:44.574245+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'15","last_scrub_stamp":"2024-09-14T13:02:44.574045+0000","last_deep_scrub":"267'15","last_deep_scrub_stamp":"2024-09-14T13:02:44.574045+0000","last_clean_scrub_stamp":"2024-09-14T13:02:44.574045+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:02:32.794342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":107,"num_read_kb":71,"num_write":42,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.c","version":"267'2","reported_seq":51,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:03:01.476928+0000","last_change":"2024-09-14T13:03:01.476928+0000","last_active":"2024-09-14T13:03:01.476928+0000","last_peered":"2024-09-14T13:03:01.476928+0000","last_clean":"2024-09-14T13:03:01.476928+0000","last_became_active":"2024-09-14T11:58:43.671065+0000","last_became_peered":"2024-09-14T11:58:43.671065+0000","last_unstale":"2024-09-14T13:03:01.476928+0000","last_undegraded":"2024-09-14T13:03:01.476928+0000","last_fullsized":"2024-09-14T13:03:01.476928+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'2","last_scrub_stamp":"2024-09-14T13:03:01.476718+0000","last_deep_scrub":"267'2","last_deep_scrub_stamp":"2024-09-14T13:03:01.476718+0000","last_clean_scrub_stamp":"2024-09-14T13:03:01.476718+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:00:42.582456+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":188,"num_omap_keys":2,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.b","version":"267'11","reported_seq":94,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:41.182388+0000","last_change":"2024-09-14T13:02:41.182388+0000","last_active":"2024-09-14T13:02:41.182388+0000","last_peered":"2024-09-14T13:02:41.182388+0000","last_clean":"2024-09-14T13:02:41.182388+0000","last_became_active":"2024-09-14T11:30:17.516646+0000","last_became_peered":"2024-09-14T11:30:17.516646+0000","last_unstale":"2024-09-14T13:02:41.182388+0000","last_undegraded":"2024-09-14T13:02:41.182388+0000","last_fullsized":"2024-09-14T13:02:41.182388+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'11","last_scrub_stamp":"2024-09-14T13:02:41.182201+0000","last_deep_scrub":"267'11","last_deep_scrub_stamp":"2024-09-14T13:02:41.182201+0000","last_clean_scrub_stamp":"2024-09-14T13:02:41.182201+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:08:07.273375+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":17,"num_read_kb":13314,"num_write":16,"num_write_kb":10240,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.a","version":"264'2","reported_seq":83,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:45.204166+0000","last_change":"2024-09-14T13:02:45.204166+0000","last_active":"2024-09-14T13:02:45.204166+0000","last_peered":"2024-09-14T13:02:45.204166+0000","last_clean":"2024-09-14T13:02:45.204166+0000","last_became_active":"2024-09-14T11:30:10.473149+0000","last_became_peered":"2024-09-14T11:30:10.473149+0000","last_unstale":"2024-09-14T13:02:45.204166+0000","last_undegraded":"2024-09-14T13:02:45.204166+0000","last_fullsized":"2024-09-14T13:02:45.204166+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'2","last_scrub_stamp":"2024-09-14T13:02:45.203968+0000","last_deep_scrub":"264'2","last_deep_scrub_stamp":"2024-09-14T13:02:45.203968+0000","last_clean_scrub_stamp":"2024-09-14T13:02:45.203968+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:36:57.921973+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":1024,"num_write":2,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.9","version":"267'22","reported_seq":146,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:50.907100+0000","last_change":"2024-09-14T13:02:50.907100+0000","last_active":"2024-09-14T13:02:50.907100+0000","last_peered":"2024-09-14T13:02:50.907100+0000","last_clean":"2024-09-14T13:02:50.907100+0000","last_became_active":"2024-09-14T11:24:10.121442+0000","last_became_peered":"2024-09-14T11:24:10.121442+0000","last_unstale":"2024-09-14T13:02:50.907100+0000","last_undegraded":"2024-09-14T13:02:50.907100+0000","last_fullsized":"2024-09-14T13:02:50.907100+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'22","last_scrub_stamp":"2024-09-14T13:02:50.906875+0000","last_deep_scrub":"267'22","last_deep_scrub_stamp":"2024-09-14T13:02:50.906875+0000","last_clean_scrub_stamp":"2024-09-14T13:02:50.906875+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T00:27:38.017167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":163,"num_read_kb":99,"num_write":58,"num_write_kb":15,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.d","version":"0'0","reported_seq":49,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:51.121127+0000","last_change":"2024-09-14T13:02:51.121127+0000","last_active":"2024-09-14T13:02:51.121127+0000","last_peered":"2024-09-14T13:02:51.121127+0000","last_clean":"2024-09-14T13:02:51.121127+0000","last_became_active":"2024-09-14T11:58:43.693568+0000","last_became_peered":"2024-09-14T11:58:43.693568+0000","last_unstale":"2024-09-14T13:02:51.121127+0000","last_undegraded":"2024-09-14T13:02:51.121127+0000","last_fullsized":"2024-09-14T13:02:51.121127+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T13:02:51.120942+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T13:02:51.120942+0000","last_clean_scrub_stamp":"2024-09-14T13:02:51.120942+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:54:34.895870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.a","version":"0'0","reported_seq":79,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:55.487264+0000","last_change":"2024-09-14T13:02:55.487264+0000","last_active":"2024-09-14T13:02:55.487264+0000","last_peered":"2024-09-14T13:02:55.487264+0000","last_clean":"2024-09-14T13:02:55.487264+0000","last_became_active":"2024-09-14T11:30:57.858040+0000","last_became_peered":"2024-09-14T11:30:57.858040+0000","last_unstale":"2024-09-14T13:02:55.487264+0000","last_undegraded":"2024-09-14T13:02:55.487264+0000","last_fullsized":"2024-09-14T13:02:55.487264+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T13:02:55.487048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T13:02:55.487048+0000","last_clean_scrub_stamp":"2024-09-14T13:02:55.487048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:43:07.973229+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.b","version":"267'4","reported_seq":84,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:43.689322+0000","last_change":"2024-09-14T13:02:43.689322+0000","last_active":"2024-09-14T13:02:43.689322+0000","last_peered":"2024-09-14T13:02:43.689322+0000","last_clean":"2024-09-14T13:02:43.689322+0000","last_became_active":"2024-09-14T11:30:10.442635+0000","last_became_peered":"2024-09-14T11:30:10.442635+0000","last_unstale":"2024-09-14T13:02:43.689322+0000","last_undegraded":"2024-09-14T13:02:43.689322+0000","last_fullsized":"2024-09-14T13:02:43.689322+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'4","last_scrub_stamp":"2024-09-14T13:02:43.689138+0000","last_deep_scrub":"267'4","last_deep_scrub_stamp":"2024-09-14T13:02:43.689138+0000","last_clean_scrub_stamp":"2024-09-14T13:02:43.689138+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:18:54.238432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":8192,"num_write":4,"num_write_kb":8192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.8","version":"267'20","reported_seq":140,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:34.365412+0000","last_change":"2024-09-14T13:02:34.365412+0000","last_active":"2024-09-14T13:02:34.365412+0000","last_peered":"2024-09-14T13:02:34.365412+0000","last_clean":"2024-09-14T13:02:34.365412+0000","last_became_active":"2024-09-14T11:24:10.115856+0000","last_became_peered":"2024-09-14T11:24:10.115856+0000","last_unstale":"2024-09-14T13:02:34.365412+0000","last_undegraded":"2024-09-14T13:02:34.365412+0000","last_fullsized":"2024-09-14T13:02:34.365412+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'20","last_scrub_stamp":"2024-09-14T13:02:34.365202+0000","last_deep_scrub":"267'20","last_deep_scrub_stamp":"2024-09-14T13:02:34.365202+0000","last_clean_scrub_stamp":"2024-09-14T13:02:34.365202+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:54:39.800267+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":144,"num_read_kb":94,"num_write":54,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.2","version":"0'0","reported_seq":51,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:56.440727+0000","last_change":"2024-09-14T13:02:56.440727+0000","last_active":"2024-09-14T13:02:56.440727+0000","last_peered":"2024-09-14T13:02:56.440727+0000","last_clean":"2024-09-14T13:02:56.440727+0000","last_became_active":"2024-09-14T11:58:43.695896+0000","last_became_peered":"2024-09-14T11:58:43.695896+0000","last_unstale":"2024-09-14T13:02:56.440727+0000","last_undegraded":"2024-09-14T13:02:56.440727+0000","last_fullsized":"2024-09-14T13:02:56.440727+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T13:02:56.440541+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T13:02:56.440541+0000","last_clean_scrub_stamp":"2024-09-14T13:02:56.440541+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:41:20.174481+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.5","version":"0'0","reported_seq":75,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:49.153149+0000","last_change":"2024-09-14T13:02:49.153149+0000","last_active":"2024-09-14T13:02:49.153149+0000","last_peered":"2024-09-14T13:02:49.153149+0000","last_clean":"2024-09-14T13:02:49.153149+0000","last_became_active":"2024-09-14T11:30:17.519903+0000","last_became_peered":"2024-09-14T11:30:17.519903+0000","last_unstale":"2024-09-14T13:02:49.153149+0000","last_undegraded":"2024-09-14T13:02:49.153149+0000","last_fullsized":"2024-09-14T13:02:49.153149+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T13:02:49.152917+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T13:02:49.152917+0000","last_clean_scrub_stamp":"2024-09-14T13:02:49.152917+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:01:06.409022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.4","version":"264'4","reported_seq":90,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:49.538741+0000","last_change":"2024-09-14T13:02:49.538741+0000","last_active":"2024-09-14T13:02:49.538741+0000","last_peered":"2024-09-14T13:02:49.538741+0000","last_clean":"2024-09-14T13:02:49.538741+0000","last_became_active":"2024-09-14T11:30:10.468287+0000","last_became_peered":"2024-09-14T11:30:10.468287+0000","last_unstale":"2024-09-14T13:02:49.538741+0000","last_undegraded":"2024-09-14T13:02:49.538741+0000","last_fullsized":"2024-09-14T13:02:49.538741+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'4","last_scrub_stamp":"2024-09-14T13:02:49.538547+0000","last_deep_scrub":"264'4","last_deep_scrub_stamp":"2024-09-14T13:02:49.538547+0000","last_clean_scrub_stamp":"2024-09-14T13:02:49.538547+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:21:50.386095+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":11264,"num_write":4,"num_write_kb":7168,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.7","version":"267'11","reported_seq":119,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:56.150589+0000","last_change":"2024-09-14T13:02:56.150589+0000","last_active":"2024-09-14T13:02:56.150589+0000","last_peered":"2024-09-14T13:02:56.150589+0000","last_clean":"2024-09-14T13:02:56.150589+0000","last_became_active":"2024-09-14T11:24:10.097206+0000","last_became_peered":"2024-09-14T11:24:10.097206+0000","last_unstale":"2024-09-14T13:02:56.150589+0000","last_undegraded":"2024-09-14T13:02:56.150589+0000","last_fullsized":"2024-09-14T13:02:56.150589+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'11","last_scrub_stamp":"2024-09-14T13:02:56.150363+0000","last_deep_scrub":"267'11","last_deep_scrub_stamp":"2024-09-14T13:02:56.150363+0000","last_clean_scrub_stamp":"2024-09-14T13:02:56.150363+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:43:48.097329+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":88,"num_read_kb":49,"num_write":30,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.3","version":"0'0","reported_seq":51,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:52.333541+0000","last_change":"2024-09-14T13:02:52.333541+0000","last_active":"2024-09-14T13:02:52.333541+0000","last_peered":"2024-09-14T13:02:52.333541+0000","last_clean":"2024-09-14T13:02:52.333541+0000","last_became_active":"2024-09-14T11:58:43.689661+0000","last_became_peered":"2024-09-14T11:58:43.689661+0000","last_unstale":"2024-09-14T13:02:52.333541+0000","last_undegraded":"2024-09-14T13:02:52.333541+0000","last_fullsized":"2024-09-14T13:02:52.333541+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T13:02:52.333261+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T13:02:52.333261+0000","last_clean_scrub_stamp":"2024-09-14T13:02:52.333261+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:52:03.568440+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.4","version":"267'5","reported_seq":83,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:54.070951+0000","last_change":"2024-09-14T13:02:54.070951+0000","last_active":"2024-09-14T13:02:54.070951+0000","last_peered":"2024-09-14T13:02:54.070951+0000","last_clean":"2024-09-14T13:02:54.070951+0000","last_became_active":"2024-09-14T11:30:17.500215+0000","last_became_peered":"2024-09-14T11:30:17.500215+0000","last_unstale":"2024-09-14T13:02:54.070951+0000","last_undegraded":"2024-09-14T13:02:54.070951+0000","last_fullsized":"2024-09-14T13:02:54.070951+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'5","last_scrub_stamp":"2024-09-14T13:02:54.070757+0000","last_deep_scrub":"267'5","last_deep_scrub_stamp":"2024-09-14T13:02:54.070757+0000","last_clean_scrub_stamp":"2024-09-14T13:02:54.070757+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:03:10.267102+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":2052,"num_write":10,"num_write_kb":1028,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.5","version":"267'5","reported_seq":90,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:33.088134+0000","last_change":"2024-09-14T13:02:33.088134+0000","last_active":"2024-09-14T13:02:33.088134+0000","last_peered":"2024-09-14T13:02:33.088134+0000","last_clean":"2024-09-14T13:02:33.088134+0000","last_became_active":"2024-09-14T11:30:10.464076+0000","last_became_peered":"2024-09-14T11:30:10.464076+0000","last_unstale":"2024-09-14T13:02:33.088134+0000","last_undegraded":"2024-09-14T13:02:33.088134+0000","last_fullsized":"2024-09-14T13:02:33.088134+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'5","last_scrub_stamp":"2024-09-14T13:02:33.087943+0000","last_deep_scrub":"267'5","last_deep_scrub_stamp":"2024-09-14T13:02:33.087943+0000","last_clean_scrub_stamp":"2024-09-14T13:02:33.087943+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:50:28.317602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":16384,"num_write":10,"num_write_kb":8192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.6","version":"267'17","reported_seq":137,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:33.318288+0000","last_change":"2024-09-14T13:02:33.318288+0000","last_active":"2024-09-14T13:02:33.318288+0000","last_peered":"2024-09-14T13:02:33.318288+0000","last_clean":"2024-09-14T13:02:33.318288+0000","last_became_active":"2024-09-14T11:24:10.123193+0000","last_became_peered":"2024-09-14T11:24:10.123193+0000","last_unstale":"2024-09-14T13:02:33.318288+0000","last_undegraded":"2024-09-14T13:02:33.318288+0000","last_fullsized":"2024-09-14T13:02:33.318288+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'17","last_scrub_stamp":"2024-09-14T13:02:33.318096+0000","last_deep_scrub":"267'17","last_deep_scrub_stamp":"2024-09-14T13:02:33.318096+0000","last_clean_scrub_stamp":"2024-09-14T13:02:33.318096+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:16:39.854310+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":141,"num_read_kb":98,"num_write":56,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.0","version":"0'0","reported_seq":53,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:47.076857+0000","last_change":"2024-09-14T13:02:47.076589+0000","last_active":"2024-09-14T13:02:47.076857+0000","last_peered":"2024-09-14T13:02:47.076857+0000","last_clean":"2024-09-14T13:02:47.076857+0000","last_became_active":"2024-09-14T11:58:43.690036+0000","last_became_peered":"2024-09-14T11:58:43.690036+0000","last_unstale":"2024-09-14T13:02:47.076857+0000","last_undegraded":"2024-09-14T13:02:47.076857+0000","last_fullsized":"2024-09-14T13:02:47.076857+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T13:02:47.076377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T13:02:47.076377+0000","last_clean_scrub_stamp":"2024-09-14T13:02:47.076377+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:54:26.040343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"67.7","version":"0'0","reported_seq":73,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:53.482037+0000","last_change":"2024-09-14T13:02:53.482037+0000","last_active":"2024-09-14T13:02:53.482037+0000","last_peered":"2024-09-14T13:02:53.482037+0000","last_clean":"2024-09-14T13:02:53.482037+0000","last_became_active":"2024-09-14T11:30:17.503548+0000","last_became_peered":"2024-09-14T11:30:17.503548+0000","last_unstale":"2024-09-14T13:02:53.482037+0000","last_undegraded":"2024-09-14T13:02:53.482037+0000","last_fullsized":"2024-09-14T13:02:53.482037+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T13:02:53.481778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T13:02:53.481778+0000","last_clean_scrub_stamp":"2024-09-14T13:02:53.481778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:42:40.801856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.6","version":"264'4","reported_seq":89,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:47.358743+0000","last_change":"2024-09-14T13:02:47.358743+0000","last_active":"2024-09-14T13:02:47.358743+0000","last_peered":"2024-09-14T13:02:47.358743+0000","last_clean":"2024-09-14T13:02:47.358743+0000","last_became_active":"2024-09-14T11:30:10.462971+0000","last_became_peered":"2024-09-14T11:30:10.462971+0000","last_unstale":"2024-09-14T13:02:47.358743+0000","last_undegraded":"2024-09-14T13:02:47.358743+0000","last_fullsized":"2024-09-14T13:02:47.358743+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'4","last_scrub_stamp":"2024-09-14T13:02:47.358551+0000","last_deep_scrub":"264'4","last_deep_scrub_stamp":"2024-09-14T13:02:47.358551+0000","last_clean_scrub_stamp":"2024-09-14T13:02:47.358551+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:44:50.402528+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":16386,"num_write":4,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.5","version":"267'29","reported_seq":165,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:43.620332+0000","last_change":"2024-09-14T13:02:43.620332+0000","last_active":"2024-09-14T13:02:43.620332+0000","last_peered":"2024-09-14T13:02:43.620332+0000","last_clean":"2024-09-14T13:02:43.620332+0000","last_became_active":"2024-09-14T11:24:10.104277+0000","last_became_peered":"2024-09-14T11:24:10.104277+0000","last_unstale":"2024-09-14T13:02:43.620332+0000","last_undegraded":"2024-09-14T13:02:43.620332+0000","last_fullsized":"2024-09-14T13:02:43.620332+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'29","last_scrub_stamp":"2024-09-14T13:02:43.620147+0000","last_deep_scrub":"267'29","last_deep_scrub_stamp":"2024-09-14T13:02:43.620147+0000","last_clean_scrub_stamp":"2024-09-14T13:02:43.620147+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:56:34.159681+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":210,"num_read_kb":138,"num_write":78,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.1","version":"0'0","reported_seq":51,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:54.555752+0000","last_change":"2024-09-14T13:02:54.555752+0000","last_active":"2024-09-14T13:02:54.555752+0000","last_peered":"2024-09-14T13:02:54.555752+0000","last_clean":"2024-09-14T13:02:54.555752+0000","last_became_active":"2024-09-14T11:58:43.674870+0000","last_became_peered":"2024-09-14T11:58:43.674870+0000","last_unstale":"2024-09-14T13:02:54.555752+0000","last_undegraded":"2024-09-14T13:02:54.555752+0000","last_fullsized":"2024-09-14T13:02:54.555752+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T13:02:54.555562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T13:02:54.555562+0000","last_clean_scrub_stamp":"2024-09-14T13:02:54.555562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:03:57.223865+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"67.6","version":"267'2","reported_seq":76,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:48.571164+0000","last_change":"2024-09-14T13:02:48.571164+0000","last_active":"2024-09-14T13:02:48.571164+0000","last_peered":"2024-09-14T13:02:48.571164+0000","last_clean":"2024-09-14T13:02:48.571164+0000","last_became_active":"2024-09-14T11:30:17.520433+0000","last_became_peered":"2024-09-14T11:30:17.520433+0000","last_unstale":"2024-09-14T13:02:48.571164+0000","last_undegraded":"2024-09-14T13:02:48.571164+0000","last_fullsized":"2024-09-14T13:02:48.571164+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'2","last_scrub_stamp":"2024-09-14T13:02:48.570898+0000","last_deep_scrub":"267'2","last_deep_scrub_stamp":"2024-09-14T13:02:48.570898+0000","last_clean_scrub_stamp":"2024-09-14T13:02:48.570898+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:52:28.372296+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":4096,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.7","version":"267'4","reported_seq":86,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:50.503349+0000","last_change":"2024-09-14T13:02:50.503349+0000","last_active":"2024-09-14T13:02:50.503349+0000","last_peered":"2024-09-14T13:02:50.503349+0000","last_clean":"2024-09-14T13:02:50.503349+0000","last_became_active":"2024-09-14T11:30:10.474546+0000","last_became_peered":"2024-09-14T11:30:10.474546+0000","last_unstale":"2024-09-14T13:02:50.503349+0000","last_undegraded":"2024-09-14T13:02:50.503349+0000","last_fullsized":"2024-09-14T13:02:50.503349+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'4","last_scrub_stamp":"2024-09-14T13:02:50.503156+0000","last_deep_scrub":"267'4","last_deep_scrub_stamp":"2024-09-14T13:02:50.503156+0000","last_clean_scrub_stamp":"2024-09-14T13:02:50.503156+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T00:29:50.537914+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":3072,"num_write":4,"num_write_kb":2048,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.4","version":"267'33","reported_seq":169,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:40.216496+0000","last_change":"2024-09-14T13:02:40.216496+0000","last_active":"2024-09-14T13:02:40.216496+0000","last_peered":"2024-09-14T13:02:40.216496+0000","last_clean":"2024-09-14T13:02:40.216496+0000","last_became_active":"2024-09-14T11:24:10.118333+0000","last_became_peered":"2024-09-14T11:24:10.118333+0000","last_unstale":"2024-09-14T13:02:40.216496+0000","last_undegraded":"2024-09-14T13:02:40.216496+0000","last_fullsized":"2024-09-14T13:02:40.216496+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'33","last_scrub_stamp":"2024-09-14T13:02:40.216319+0000","last_deep_scrub":"267'33","last_deep_scrub_stamp":"2024-09-14T13:02:40.216319+0000","last_clean_scrub_stamp":"2024-09-14T13:02:40.216319+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T00:09:01.124202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":218,"num_read_kb":138,"num_write":85,"num_write_kb":20,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"68.6","version":"267'2","reported_seq":52,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:37.223646+0000","last_change":"2024-09-14T13:02:37.223646+0000","last_active":"2024-09-14T13:02:37.223646+0000","last_peered":"2024-09-14T13:02:37.223646+0000","last_clean":"2024-09-14T13:02:37.223646+0000","last_became_active":"2024-09-14T11:58:43.688251+0000","last_became_peered":"2024-09-14T11:58:43.688251+0000","last_unstale":"2024-09-14T13:02:37.223646+0000","last_undegraded":"2024-09-14T13:02:37.223646+0000","last_fullsized":"2024-09-14T13:02:37.223646+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'2","last_scrub_stamp":"2024-09-14T13:02:37.223463+0000","last_deep_scrub":"267'2","last_deep_scrub_stamp":"2024-09-14T13:02:37.223463+0000","last_clean_scrub_stamp":"2024-09-14T13:02:37.223463+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:01:40.745731+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":188,"num_omap_keys":2,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.1","version":"267'7","reported_seq":89,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:43.139542+0000","last_change":"2024-09-14T13:02:43.139542+0000","last_active":"2024-09-14T13:02:43.139542+0000","last_peered":"2024-09-14T13:02:43.139542+0000","last_clean":"2024-09-14T13:02:43.139542+0000","last_became_active":"2024-09-14T11:30:17.518890+0000","last_became_peered":"2024-09-14T11:30:17.518890+0000","last_unstale":"2024-09-14T13:02:43.139542+0000","last_undegraded":"2024-09-14T13:02:43.139542+0000","last_fullsized":"2024-09-14T13:02:43.139542+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'7","last_scrub_stamp":"2024-09-14T13:02:43.139285+0000","last_deep_scrub":"267'7","last_deep_scrub_stamp":"2024-09-14T13:02:43.139285+0000","last_clean_scrub_stamp":"2024-09-14T13:02:43.139285+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:22:07.656210+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":19458,"num_write":12,"num_write_kb":7168,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.0","version":"267'2","reported_seq":86,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:47.530683+0000","last_change":"2024-09-14T13:02:47.530683+0000","last_active":"2024-09-14T13:02:47.530683+0000","last_peered":"2024-09-14T13:02:47.530683+0000","last_clean":"2024-09-14T13:02:47.530683+0000","last_became_active":"2024-09-14T11:30:10.466391+0000","last_became_peered":"2024-09-14T11:30:10.466391+0000","last_unstale":"2024-09-14T13:02:47.530683+0000","last_undegraded":"2024-09-14T13:02:47.530683+0000","last_fullsized":"2024-09-14T13:02:47.530683+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'2","last_scrub_stamp":"2024-09-14T13:02:47.530492+0000","last_deep_scrub":"267'2","last_deep_scrub_stamp":"2024-09-14T13:02:47.530492+0000","last_clean_scrub_stamp":"2024-09-14T13:02:47.530492+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:09:45.925301+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":40,"num_write":2,"num_write_kb":40,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.3","version":"267'41","reported_seq":199,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:46.405784+0000","last_change":"2024-09-14T13:02:46.405784+0000","last_active":"2024-09-14T13:02:46.405784+0000","last_peered":"2024-09-14T13:02:46.405784+0000","last_clean":"2024-09-14T13:02:46.405784+0000","last_became_active":"2024-09-14T11:24:10.094515+0000","last_became_peered":"2024-09-14T11:24:10.094515+0000","last_unstale":"2024-09-14T13:02:46.405784+0000","last_undegraded":"2024-09-14T13:02:46.405784+0000","last_fullsized":"2024-09-14T13:02:46.405784+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'41","last_scrub_stamp":"2024-09-14T13:02:46.405607+0000","last_deep_scrub":"267'41","last_deep_scrub_stamp":"2024-09-14T13:02:46.405607+0000","last_clean_scrub_stamp":"2024-09-14T13:02:46.405607+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":0,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:44:04.405540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":311,"num_read_kb":196,"num_write":106,"num_write_kb":28,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"68.7","version":"0'0","reported_seq":50,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:03:02.143255+0000","last_change":"2024-09-14T13:03:02.143255+0000","last_active":"2024-09-14T13:03:02.143255+0000","last_peered":"2024-09-14T13:03:02.143255+0000","last_clean":"2024-09-14T13:03:02.143255+0000","last_became_active":"2024-09-14T11:58:43.680569+0000","last_became_peered":"2024-09-14T11:58:43.680569+0000","last_unstale":"2024-09-14T13:03:02.143255+0000","last_undegraded":"2024-09-14T13:03:02.143255+0000","last_fullsized":"2024-09-14T13:03:02.143255+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T13:03:02.143072+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T13:03:02.143072+0000","last_clean_scrub_stamp":"2024-09-14T13:03:02.143072+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:27:10.861975+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.0","version":"267'4","reported_seq":85,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:50.354724+0000","last_change":"2024-09-14T13:02:50.354724+0000","last_active":"2024-09-14T13:02:50.354724+0000","last_peered":"2024-09-14T13:02:50.354724+0000","last_clean":"2024-09-14T13:02:50.354724+0000","last_became_active":"2024-09-14T11:30:17.518524+0000","last_became_peered":"2024-09-14T11:30:17.518524+0000","last_unstale":"2024-09-14T13:02:50.354724+0000","last_undegraded":"2024-09-14T13:02:50.354724+0000","last_fullsized":"2024-09-14T13:02:50.354724+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'4","last_scrub_stamp":"2024-09-14T13:02:50.354507+0000","last_deep_scrub":"267'4","last_deep_scrub_stamp":"2024-09-14T13:02:50.354507+0000","last_clean_scrub_stamp":"2024-09-14T13:02:50.354507+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:50:45.316320+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":6144,"num_write":4,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.1","version":"267'5","reported_seq":88,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:48.565659+0000","last_change":"2024-09-14T13:02:48.565659+0000","last_active":"2024-09-14T13:02:48.565659+0000","last_peered":"2024-09-14T13:02:48.565659+0000","last_clean":"2024-09-14T13:02:48.565659+0000","last_became_active":"2024-09-14T11:30:10.464696+0000","last_became_peered":"2024-09-14T11:30:10.464696+0000","last_unstale":"2024-09-14T13:02:48.565659+0000","last_undegraded":"2024-09-14T13:02:48.565659+0000","last_fullsized":"2024-09-14T13:02:48.565659+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'5","last_scrub_stamp":"2024-09-14T13:02:48.565381+0000","last_deep_scrub":"267'5","last_deep_scrub_stamp":"2024-09-14T13:02:48.565381+0000","last_clean_scrub_stamp":"2024-09-14T13:02:48.565381+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:40:58.606192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":1024,"num_write":10,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.2","version":"267'34","reported_seq":184,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:42.645516+0000","last_change":"2024-09-14T13:02:42.645516+0000","last_active":"2024-09-14T13:02:42.645516+0000","last_peered":"2024-09-14T13:02:42.645516+0000","last_clean":"2024-09-14T13:02:42.645516+0000","last_became_active":"2024-09-14T11:24:10.125885+0000","last_became_peered":"2024-09-14T11:24:10.125885+0000","last_unstale":"2024-09-14T13:02:42.645516+0000","last_undegraded":"2024-09-14T13:02:42.645516+0000","last_fullsized":"2024-09-14T13:02:42.645516+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'34","last_scrub_stamp":"2024-09-14T13:02:42.645335+0000","last_deep_scrub":"267'34","last_deep_scrub_stamp":"2024-09-14T13:02:42.645335+0000","last_clean_scrub_stamp":"2024-09-14T13:02:42.645335+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T00:08:43.424400+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":284,"num_read_kb":180,"num_write":83,"num_write_kb":28,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"68.4","version":"0'0","reported_seq":51,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:55.103746+0000","last_change":"2024-09-14T13:02:55.103746+0000","last_active":"2024-09-14T13:02:55.103746+0000","last_peered":"2024-09-14T13:02:55.103746+0000","last_clean":"2024-09-14T13:02:55.103746+0000","last_became_active":"2024-09-14T11:58:43.662916+0000","last_became_peered":"2024-09-14T11:58:43.662916+0000","last_unstale":"2024-09-14T13:02:55.103746+0000","last_undegraded":"2024-09-14T13:02:55.103746+0000","last_fullsized":"2024-09-14T13:02:55.103746+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T13:02:55.103563+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T13:02:55.103563+0000","last_clean_scrub_stamp":"2024-09-14T13:02:55.103563+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:24:40.380654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.3","version":"264'4","reported_seq":85,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:39.341302+0000","last_change":"2024-09-14T13:02:39.341302+0000","last_active":"2024-09-14T13:02:39.341302+0000","last_peered":"2024-09-14T13:02:39.341302+0000","last_clean":"2024-09-14T13:02:39.341302+0000","last_became_active":"2024-09-14T11:30:17.549019+0000","last_became_peered":"2024-09-14T11:30:17.549019+0000","last_unstale":"2024-09-14T13:02:39.341302+0000","last_undegraded":"2024-09-14T13:02:39.341302+0000","last_fullsized":"2024-09-14T13:02:39.341302+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'4","last_scrub_stamp":"2024-09-14T13:02:39.341107+0000","last_deep_scrub":"264'4","last_deep_scrub_stamp":"2024-09-14T13:02:39.341107+0000","last_clean_scrub_stamp":"2024-09-14T13:02:39.341107+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:23:14.529883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":4098,"num_write":4,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"66.2","version":"267'4","reported_seq":89,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:42.159375+0000","last_change":"2024-09-14T13:02:42.159375+0000","last_active":"2024-09-14T13:02:42.159375+0000","last_peered":"2024-09-14T13:02:42.159375+0000","last_clean":"2024-09-14T13:02:42.159375+0000","last_became_active":"2024-09-14T11:30:10.460643+0000","last_became_peered":"2024-09-14T11:30:10.460643+0000","last_unstale":"2024-09-14T13:02:42.159375+0000","last_undegraded":"2024-09-14T13:02:42.159375+0000","last_fullsized":"2024-09-14T13:02:42.159375+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'4","last_scrub_stamp":"2024-09-14T13:02:42.159144+0000","last_deep_scrub":"267'4","last_deep_scrub_stamp":"2024-09-14T13:02:42.159144+0000","last_clean_scrub_stamp":"2024-09-14T13:02:42.159144+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:23:08.151155+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":3072,"num_write":4,"num_write_kb":2048,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.1","version":"267'13","reported_seq":123,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:36.412512+0000","last_change":"2024-09-14T13:02:36.412512+0000","last_active":"2024-09-14T13:02:36.412512+0000","last_peered":"2024-09-14T13:02:36.412512+0000","last_clean":"2024-09-14T13:02:36.412512+0000","last_became_active":"2024-09-14T11:24:10.116627+0000","last_became_peered":"2024-09-14T11:24:10.116627+0000","last_unstale":"2024-09-14T13:02:36.412512+0000","last_undegraded":"2024-09-14T13:02:36.412512+0000","last_fullsized":"2024-09-14T13:02:36.412512+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'13","last_scrub_stamp":"2024-09-14T13:02:36.412325+0000","last_deep_scrub":"267'13","last_deep_scrub_stamp":"2024-09-14T13:02:36.412325+0000","last_clean_scrub_stamp":"2024-09-14T13:02:36.412325+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:23:25.445266+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":96,"num_read_kb":63,"num_write":36,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.5","version":"0'0","reported_seq":51,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:57.472429+0000","last_change":"2024-09-14T13:02:57.472429+0000","last_active":"2024-09-14T13:02:57.472429+0000","last_peered":"2024-09-14T13:02:57.472429+0000","last_clean":"2024-09-14T13:02:57.472429+0000","last_became_active":"2024-09-14T11:58:43.695982+0000","last_became_peered":"2024-09-14T11:58:43.695982+0000","last_unstale":"2024-09-14T13:02:57.472429+0000","last_undegraded":"2024-09-14T13:02:57.472429+0000","last_fullsized":"2024-09-14T13:02:57.472429+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T13:02:57.472239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T13:02:57.472239+0000","last_clean_scrub_stamp":"2024-09-14T13:02:57.472239+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:10:14.920871+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.2","version":"264'8","reported_seq":93,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:49.591620+0000","last_change":"2024-09-14T13:02:49.591620+0000","last_active":"2024-09-14T13:02:49.591620+0000","last_peered":"2024-09-14T13:02:49.591620+0000","last_clean":"2024-09-14T13:02:49.591620+0000","last_became_active":"2024-09-14T11:30:17.512689+0000","last_became_peered":"2024-09-14T11:30:17.512689+0000","last_unstale":"2024-09-14T13:02:49.591620+0000","last_undegraded":"2024-09-14T13:02:49.591620+0000","last_fullsized":"2024-09-14T13:02:49.591620+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'8","last_scrub_stamp":"2024-09-14T13:02:49.591431+0000","last_deep_scrub":"264'8","last_deep_scrub_stamp":"2024-09-14T13:02:49.591431+0000","last_clean_scrub_stamp":"2024-09-14T13:02:49.591431+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:05:52.156693+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":21506,"num_write":8,"num_write_kb":9216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.3","version":"0'0","reported_seq":81,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:38.334921+0000","last_change":"2024-09-14T13:02:38.334921+0000","last_active":"2024-09-14T13:02:38.334921+0000","last_peered":"2024-09-14T13:02:38.334921+0000","last_clean":"2024-09-14T13:02:38.334921+0000","last_became_active":"2024-09-14T11:30:10.473880+0000","last_became_peered":"2024-09-14T11:30:10.473880+0000","last_unstale":"2024-09-14T13:02:38.334921+0000","last_undegraded":"2024-09-14T13:02:38.334921+0000","last_fullsized":"2024-09-14T13:02:38.334921+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T13:02:38.334721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T13:02:38.334721+0000","last_clean_scrub_stamp":"2024-09-14T13:02:38.334721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:23:50.471222+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"65.0","version":"264'14","reported_seq":131,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:42.639617+0000","last_change":"2024-09-14T13:02:42.639341+0000","last_active":"2024-09-14T13:02:42.639617+0000","last_peered":"2024-09-14T13:02:42.639617+0000","last_clean":"2024-09-14T13:02:42.639617+0000","last_became_active":"2024-09-14T11:24:10.115799+0000","last_became_peered":"2024-09-14T11:24:10.115799+0000","last_unstale":"2024-09-14T13:02:42.639617+0000","last_undegraded":"2024-09-14T13:02:42.639617+0000","last_fullsized":"2024-09-14T13:02:42.639617+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'14","last_scrub_stamp":"2024-09-14T13:02:42.639124+0000","last_deep_scrub":"264'14","last_deep_scrub_stamp":"2024-09-14T13:02:42.639124+0000","last_clean_scrub_stamp":"2024-09-14T13:02:42.639124+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:45:09.264335+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":114,"num_read_kb":78,"num_write":35,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3f","version":"267'205","reported_seq":884,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:20.638860+0000","last_change":"2024-09-14T13:02:20.638712+0000","last_active":"2024-09-14T13:02:20.638860+0000","last_peered":"2024-09-14T13:02:20.638860+0000","last_clean":"2024-09-14T13:02:20.638860+0000","last_became_active":"2024-09-14T11:08:21.829676+0000","last_became_peered":"2024-09-14T11:08:21.829676+0000","last_unstale":"2024-09-14T13:02:20.638860+0000","last_undegraded":"2024-09-14T13:02:20.638860+0000","last_fullsized":"2024-09-14T13:02:20.638860+0000","mapping_epoch":24,"log_start":"267'100","ondisk_log_start":"267'100","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'205","last_scrub_stamp":"2024-09-14T13:02:20.638511+0000","last_deep_scrub":"267'205","last_deep_scrub_stamp":"2024-09-14T13:02:20.638511+0000","last_clean_scrub_stamp":"2024-09-14T13:02:20.638511+0000","objects_scrubbed":3,"log_size":105,"log_dups_size":100,"ondisk_log_size":105,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T00:56:48.157172+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":30,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":573,"num_read_kb":18432,"num_write":892,"num_write_kb":26168,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,0],"acting":[7,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.38","version":"267'465","reported_seq":2079,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:26.510841+0000","last_change":"2024-09-14T13:02:26.510841+0000","last_active":"2024-09-14T13:02:26.510841+0000","last_peered":"2024-09-14T13:02:26.510841+0000","last_clean":"2024-09-14T13:02:26.510841+0000","last_became_active":"2024-09-14T11:08:23.800936+0000","last_became_peered":"2024-09-14T11:08:23.800936+0000","last_unstale":"2024-09-14T13:02:26.510841+0000","last_undegraded":"2024-09-14T13:02:26.510841+0000","last_fullsized":"2024-09-14T13:02:26.510841+0000","mapping_epoch":26,"log_start":"267'400","ondisk_log_start":"267'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'465","last_scrub_stamp":"2024-09-14T13:02:26.510658+0000","last_deep_scrub":"267'465","last_deep_scrub_stamp":"2024-09-14T13:02:26.510658+0000","last_clean_scrub_stamp":"2024-09-14T13:02:26.510658+0000","objects_scrubbed":4,"log_size":65,"log_dups_size":400,"ondisk_log_size":65,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:25:43.630955+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":2476,"num_read_kb":2325,"num_write":550,"num_write_kb":127,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":720,"num_omap_keys":3,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3e","version":"267'229","reported_seq":945,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:15.043632+0000","last_change":"2024-09-14T13:02:15.043489+0000","last_active":"2024-09-14T13:02:15.043632+0000","last_peered":"2024-09-14T13:02:15.043632+0000","last_clean":"2024-09-14T13:02:15.043632+0000","last_became_active":"2024-09-14T11:08:21.808315+0000","last_became_peered":"2024-09-14T11:08:21.808315+0000","last_unstale":"2024-09-14T13:02:15.043632+0000","last_undegraded":"2024-09-14T13:02:15.043632+0000","last_fullsized":"2024-09-14T13:02:15.043632+0000","mapping_epoch":24,"log_start":"267'200","ondisk_log_start":"267'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'229","last_scrub_stamp":"2024-09-14T13:02:15.043275+0000","last_deep_scrub":"267'229","last_deep_scrub_stamp":"2024-09-14T13:02:15.043275+0000","last_clean_scrub_stamp":"2024-09-14T13:02:15.043275+0000","objects_scrubbed":3,"log_size":29,"log_dups_size":200,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:33:02.128503+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1655861,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":605,"num_read_kb":113994,"num_write":1045,"num_write_kb":54817,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,6],"acting":[1,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.39","version":"267'900","reported_seq":2654,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:25.597874+0000","last_change":"2024-09-14T13:02:25.597874+0000","last_active":"2024-09-14T13:02:25.597874+0000","last_peered":"2024-09-14T13:02:25.597874+0000","last_clean":"2024-09-14T13:02:25.597874+0000","last_became_active":"2024-09-14T11:08:23.801320+0000","last_became_peered":"2024-09-14T11:08:23.801320+0000","last_unstale":"2024-09-14T13:02:25.597874+0000","last_undegraded":"2024-09-14T13:02:25.597874+0000","last_fullsized":"2024-09-14T13:02:25.597874+0000","mapping_epoch":26,"log_start":"267'800","ondisk_log_start":"267'800","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'900","last_scrub_stamp":"2024-09-14T13:02:25.597694+0000","last_deep_scrub":"267'900","last_deep_scrub_stamp":"2024-09-14T13:02:25.597694+0000","last_clean_scrub_stamp":"2024-09-14T13:02:25.597694+0000","objects_scrubbed":4,"log_size":100,"log_dups_size":800,"ondisk_log_size":100,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:15:17.189583+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":4549,"num_read_kb":4112,"num_write":1219,"num_write_kb":503,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2767,"num_omap_keys":11,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3d","version":"267'201","reported_seq":857,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:12.135290+0000","last_change":"2024-09-14T13:02:12.135141+0000","last_active":"2024-09-14T13:02:12.135290+0000","last_peered":"2024-09-14T13:02:12.135290+0000","last_clean":"2024-09-14T13:02:12.135290+0000","last_became_active":"2024-09-14T11:08:21.776255+0000","last_became_peered":"2024-09-14T11:08:21.776255+0000","last_unstale":"2024-09-14T13:02:12.135290+0000","last_undegraded":"2024-09-14T13:02:12.135290+0000","last_fullsized":"2024-09-14T13:02:12.135290+0000","mapping_epoch":24,"log_start":"267'100","ondisk_log_start":"267'100","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'201","last_scrub_stamp":"2024-09-14T13:02:12.134852+0000","last_deep_scrub":"267'201","last_deep_scrub_stamp":"2024-09-14T13:02:12.134852+0000","last_clean_scrub_stamp":"2024-09-14T13:02:12.134852+0000","objects_scrubbed":6,"log_size":101,"log_dups_size":100,"ondisk_log_size":101,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:30:34.196127+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":515488,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":487,"num_read_kb":4028,"num_write":961,"num_write_kb":22458,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"267'468","reported_seq":2128,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:24.707519+0000","last_change":"2024-09-14T13:02:24.707519+0000","last_active":"2024-09-14T13:02:24.707519+0000","last_peered":"2024-09-14T13:02:24.707519+0000","last_clean":"2024-09-14T13:02:24.707519+0000","last_became_active":"2024-09-14T11:08:23.786481+0000","last_became_peered":"2024-09-14T11:08:23.786481+0000","last_unstale":"2024-09-14T13:02:24.707519+0000","last_undegraded":"2024-09-14T13:02:24.707519+0000","last_fullsized":"2024-09-14T13:02:24.707519+0000","mapping_epoch":26,"log_start":"267'400","ondisk_log_start":"267'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'468","last_scrub_stamp":"2024-09-14T13:02:24.707341+0000","last_deep_scrub":"267'468","last_deep_scrub_stamp":"2024-09-14T13:02:24.707341+0000","last_clean_scrub_stamp":"2024-09-14T13:02:24.707341+0000","objects_scrubbed":0,"log_size":68,"log_dups_size":400,"ondisk_log_size":68,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:51:19.709141+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2493,"num_read_kb":2352,"num_write":540,"num_write_kb":121,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3c","version":"267'354","reported_seq":1104,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:20.476742+0000","last_change":"2024-09-14T13:02:20.476600+0000","last_active":"2024-09-14T13:02:20.476742+0000","last_peered":"2024-09-14T13:02:20.476742+0000","last_clean":"2024-09-14T13:02:20.476742+0000","last_became_active":"2024-09-14T11:08:21.801787+0000","last_became_peered":"2024-09-14T11:08:21.801787+0000","last_unstale":"2024-09-14T13:02:20.476742+0000","last_undegraded":"2024-09-14T13:02:20.476742+0000","last_fullsized":"2024-09-14T13:02:20.476742+0000","mapping_epoch":24,"log_start":"267'300","ondisk_log_start":"267'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'354","last_scrub_stamp":"2024-09-14T13:02:20.476366+0000","last_deep_scrub":"267'354","last_deep_scrub_stamp":"2024-09-14T13:02:20.476366+0000","last_clean_scrub_stamp":"2024-09-14T13:02:20.476366+0000","objects_scrubbed":4,"log_size":54,"log_dups_size":300,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:53:20.365511+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":72,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1015,"num_read_kb":46026,"num_write":1390,"num_write_kb":39725,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3b","version":"267'451","reported_seq":1992,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:22.995425+0000","last_change":"2024-09-14T13:02:22.995425+0000","last_active":"2024-09-14T13:02:22.995425+0000","last_peered":"2024-09-14T13:02:22.995425+0000","last_clean":"2024-09-14T13:02:22.995425+0000","last_became_active":"2024-09-14T11:08:23.783162+0000","last_became_peered":"2024-09-14T11:08:23.783162+0000","last_unstale":"2024-09-14T13:02:22.995425+0000","last_undegraded":"2024-09-14T13:02:22.995425+0000","last_fullsized":"2024-09-14T13:02:22.995425+0000","mapping_epoch":26,"log_start":"267'400","ondisk_log_start":"267'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'451","last_scrub_stamp":"2024-09-14T13:02:22.995232+0000","last_deep_scrub":"267'451","last_deep_scrub_stamp":"2024-09-14T13:02:22.995232+0000","last_clean_scrub_stamp":"2024-09-14T13:02:22.995232+0000","objects_scrubbed":3,"log_size":51,"log_dups_size":400,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:03:50.107240+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2320,"num_read_kb":2170,"num_write":502,"num_write_kb":112,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":248,"num_omap_keys":1,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3b","version":"267'212","reported_seq":901,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:19.672895+0000","last_change":"2024-09-14T13:02:19.672895+0000","last_active":"2024-09-14T13:02:19.672895+0000","last_peered":"2024-09-14T13:02:19.672895+0000","last_clean":"2024-09-14T13:02:19.672895+0000","last_became_active":"2024-09-14T11:08:21.842260+0000","last_became_peered":"2024-09-14T11:08:21.842260+0000","last_unstale":"2024-09-14T13:02:19.672895+0000","last_undegraded":"2024-09-14T13:02:19.672895+0000","last_fullsized":"2024-09-14T13:02:19.672895+0000","mapping_epoch":24,"log_start":"267'200","ondisk_log_start":"267'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'212","last_scrub_stamp":"2024-09-14T13:02:19.672688+0000","last_deep_scrub":"267'212","last_deep_scrub_stamp":"2024-09-14T13:02:19.672688+0000","last_clean_scrub_stamp":"2024-09-14T13:02:19.672688+0000","objects_scrubbed":1,"log_size":12,"log_dups_size":200,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:47:14.467482+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1655822,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":567,"num_read_kb":28109,"num_write":991,"num_write_kb":35425,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,4],"acting":[7,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3c","version":"267'417","reported_seq":2198,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:20.325699+0000","last_change":"2024-09-14T13:02:20.325518+0000","last_active":"2024-09-14T13:02:20.325699+0000","last_peered":"2024-09-14T13:02:20.325699+0000","last_clean":"2024-09-14T13:02:20.325699+0000","last_became_active":"2024-09-14T11:08:23.804142+0000","last_became_peered":"2024-09-14T11:08:23.804142+0000","last_unstale":"2024-09-14T13:02:20.325699+0000","last_undegraded":"2024-09-14T13:02:20.325699+0000","last_fullsized":"2024-09-14T13:02:20.325699+0000","mapping_epoch":26,"log_start":"267'400","ondisk_log_start":"267'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'417","last_scrub_stamp":"2024-09-14T13:02:20.325334+0000","last_deep_scrub":"267'417","last_deep_scrub_stamp":"2024-09-14T13:02:20.325334+0000","last_clean_scrub_stamp":"2024-09-14T13:02:20.325334+0000","objects_scrubbed":4,"log_size":17,"log_dups_size":400,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:03:20.089650+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":2567,"num_read_kb":2469,"num_write":470,"num_write_kb":86,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2297,"num_omap_keys":9,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.3a","version":"267'155","reported_seq":787,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:19.522599+0000","last_change":"2024-09-14T13:02:19.522599+0000","last_active":"2024-09-14T13:02:19.522599+0000","last_peered":"2024-09-14T13:02:19.522599+0000","last_clean":"2024-09-14T13:02:19.522599+0000","last_became_active":"2024-09-14T11:08:21.791801+0000","last_became_peered":"2024-09-14T11:08:21.791801+0000","last_unstale":"2024-09-14T13:02:19.522599+0000","last_undegraded":"2024-09-14T13:02:19.522599+0000","last_fullsized":"2024-09-14T13:02:19.522599+0000","mapping_epoch":24,"log_start":"267'100","ondisk_log_start":"267'100","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'155","last_scrub_stamp":"2024-09-14T13:02:19.522401+0000","last_deep_scrub":"267'155","last_deep_scrub_stamp":"2024-09-14T13:02:19.522401+0000","last_clean_scrub_stamp":"2024-09-14T13:02:19.522401+0000","objects_scrubbed":1,"log_size":55,"log_dups_size":100,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:24:14.148910+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":30,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":413,"num_read_kb":24131,"num_write":680,"num_write_kb":32915,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,3],"acting":[5,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3d","version":"267'395","reported_seq":1944,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:26.706853+0000","last_change":"2024-09-14T13:02:26.706695+0000","last_active":"2024-09-14T13:02:26.706853+0000","last_peered":"2024-09-14T13:02:26.706853+0000","last_clean":"2024-09-14T13:02:26.706853+0000","last_became_active":"2024-09-14T11:08:23.786522+0000","last_became_peered":"2024-09-14T11:08:23.786522+0000","last_unstale":"2024-09-14T13:02:26.706853+0000","last_undegraded":"2024-09-14T13:02:26.706853+0000","last_fullsized":"2024-09-14T13:02:26.706853+0000","mapping_epoch":26,"log_start":"267'300","ondisk_log_start":"267'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'395","last_scrub_stamp":"2024-09-14T13:02:26.706510+0000","last_deep_scrub":"267'395","last_deep_scrub_stamp":"2024-09-14T13:02:26.706510+0000","last_clean_scrub_stamp":"2024-09-14T13:02:26.706510+0000","objects_scrubbed":2,"log_size":95,"log_dups_size":300,"ondisk_log_size":95,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:28:47.678010+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2147,"num_read_kb":2043,"num_write":454,"num_write_kb":90,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.39","version":"267'266","reported_seq":1039,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:16.621607+0000","last_change":"2024-09-14T13:02:16.621607+0000","last_active":"2024-09-14T13:02:16.621607+0000","last_peered":"2024-09-14T13:02:16.621607+0000","last_clean":"2024-09-14T13:02:16.621607+0000","last_became_active":"2024-09-14T11:08:21.837147+0000","last_became_peered":"2024-09-14T11:08:21.837147+0000","last_unstale":"2024-09-14T13:02:16.621607+0000","last_undegraded":"2024-09-14T13:02:16.621607+0000","last_fullsized":"2024-09-14T13:02:16.621607+0000","mapping_epoch":24,"log_start":"267'200","ondisk_log_start":"267'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'266","last_scrub_stamp":"2024-09-14T13:02:16.621341+0000","last_deep_scrub":"267'266","last_deep_scrub_stamp":"2024-09-14T13:02:16.621341+0000","last_clean_scrub_stamp":"2024-09-14T13:02:16.621341+0000","objects_scrubbed":3,"log_size":66,"log_dups_size":200,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:00:31.402959+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1655838,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1268,"num_read_kb":31286,"num_write":1154,"num_write_kb":25837,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0,4],"acting":[7,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3e","version":"267'511","reported_seq":2135,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:28.530874+0000","last_change":"2024-09-14T13:02:28.530721+0000","last_active":"2024-09-14T13:02:28.530874+0000","last_peered":"2024-09-14T13:02:28.530874+0000","last_clean":"2024-09-14T13:02:28.530874+0000","last_became_active":"2024-09-14T11:08:23.800621+0000","last_became_peered":"2024-09-14T11:08:23.800621+0000","last_unstale":"2024-09-14T13:02:28.530874+0000","last_undegraded":"2024-09-14T13:02:28.530874+0000","last_fullsized":"2024-09-14T13:02:28.530874+0000","mapping_epoch":26,"log_start":"267'500","ondisk_log_start":"267'500","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'511","last_scrub_stamp":"2024-09-14T13:02:28.530532+0000","last_deep_scrub":"267'511","last_deep_scrub_stamp":"2024-09-14T13:02:28.530532+0000","last_clean_scrub_stamp":"2024-09-14T13:02:28.530532+0000","objects_scrubbed":3,"log_size":11,"log_dups_size":500,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:19:28.861587+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2676,"num_read_kb":2481,"num_write":623,"num_write_kb":172,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":694,"num_omap_keys":3,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.38","version":"267'224","reported_seq":898,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:11.931881+0000","last_change":"2024-09-14T13:02:11.931881+0000","last_active":"2024-09-14T13:02:11.931881+0000","last_peered":"2024-09-14T13:02:11.931881+0000","last_clean":"2024-09-14T13:02:11.931881+0000","last_became_active":"2024-09-14T11:08:21.819029+0000","last_became_peered":"2024-09-14T11:08:21.819029+0000","last_unstale":"2024-09-14T13:02:11.931881+0000","last_undegraded":"2024-09-14T13:02:11.931881+0000","last_fullsized":"2024-09-14T13:02:11.931881+0000","mapping_epoch":24,"log_start":"267'200","ondisk_log_start":"267'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'224","last_scrub_stamp":"2024-09-14T13:02:11.931546+0000","last_deep_scrub":"267'224","last_deep_scrub_stamp":"2024-09-14T13:02:11.931546+0000","last_clean_scrub_stamp":"2024-09-14T13:02:11.931546+0000","objects_scrubbed":3,"log_size":24,"log_dups_size":200,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T00:04:21.176019+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":66,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":538,"num_read_kb":44678,"num_write":942,"num_write_kb":39932,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,6],"acting":[3,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3f","version":"267'919","reported_seq":2574,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:20.133214+0000","last_change":"2024-09-14T13:02:20.133057+0000","last_active":"2024-09-14T13:02:20.133214+0000","last_peered":"2024-09-14T13:02:20.133214+0000","last_clean":"2024-09-14T13:02:20.133214+0000","last_became_active":"2024-09-14T11:08:23.785941+0000","last_became_peered":"2024-09-14T11:08:23.785941+0000","last_unstale":"2024-09-14T13:02:20.133214+0000","last_undegraded":"2024-09-14T13:02:20.133214+0000","last_fullsized":"2024-09-14T13:02:20.133214+0000","mapping_epoch":26,"log_start":"267'900","ondisk_log_start":"267'900","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'919","last_scrub_stamp":"2024-09-14T13:02:20.132814+0000","last_deep_scrub":"267'919","last_deep_scrub_stamp":"2024-09-14T13:02:20.132814+0000","last_clean_scrub_stamp":"2024-09-14T13:02:20.132814+0000","objects_scrubbed":3,"log_size":19,"log_dups_size":900,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:16:06.728821+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":4272,"num_read_kb":3805,"num_write":1224,"num_write_kb":476,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"267'398","reported_seq":1979,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:22.702834+0000","last_change":"2024-09-14T13:02:22.702586+0000","last_active":"2024-09-14T13:02:22.702834+0000","last_peered":"2024-09-14T13:02:22.702834+0000","last_clean":"2024-09-14T13:02:22.702834+0000","last_became_active":"2024-09-14T11:08:23.785439+0000","last_became_peered":"2024-09-14T11:08:23.785439+0000","last_unstale":"2024-09-14T13:02:22.702834+0000","last_undegraded":"2024-09-14T13:02:22.702834+0000","last_fullsized":"2024-09-14T13:02:22.702834+0000","mapping_epoch":26,"log_start":"267'300","ondisk_log_start":"267'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'398","last_scrub_stamp":"2024-09-14T13:02:22.702370+0000","last_deep_scrub":"267'398","last_deep_scrub_stamp":"2024-09-14T13:02:22.702370+0000","last_clean_scrub_stamp":"2024-09-14T13:02:22.702370+0000","objects_scrubbed":1,"log_size":98,"log_dups_size":300,"ondisk_log_size":98,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:20:26.205553+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2124,"num_read_kb":2036,"num_write":427,"num_write_kb":63,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.37","version":"267'275","reported_seq":1016,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:13.622231+0000","last_change":"2024-09-14T13:02:13.622088+0000","last_active":"2024-09-14T13:02:13.622231+0000","last_peered":"2024-09-14T13:02:13.622231+0000","last_clean":"2024-09-14T13:02:13.622231+0000","last_became_active":"2024-09-14T11:08:21.805293+0000","last_became_peered":"2024-09-14T11:08:21.805293+0000","last_unstale":"2024-09-14T13:02:13.622231+0000","last_undegraded":"2024-09-14T13:02:13.622231+0000","last_fullsized":"2024-09-14T13:02:13.622231+0000","mapping_epoch":24,"log_start":"267'200","ondisk_log_start":"267'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'275","last_scrub_stamp":"2024-09-14T13:02:13.621839+0000","last_deep_scrub":"267'275","last_deep_scrub_stamp":"2024-09-14T13:02:13.621839+0000","last_clean_scrub_stamp":"2024-09-14T13:02:13.621839+0000","objects_scrubbed":5,"log_size":75,"log_dups_size":200,"ondisk_log_size":75,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:36:57.835433+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1655894,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":1085,"num_read_kb":13085,"num_write":1149,"num_write_kb":51014,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,0],"acting":[7,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.31","version":"267'703","reported_seq":2422,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:24.626546+0000","last_change":"2024-09-14T13:02:24.626382+0000","last_active":"2024-09-14T13:02:24.626546+0000","last_peered":"2024-09-14T13:02:24.626546+0000","last_clean":"2024-09-14T13:02:24.626546+0000","last_became_active":"2024-09-14T11:08:23.808090+0000","last_became_peered":"2024-09-14T11:08:23.808090+0000","last_unstale":"2024-09-14T13:02:24.626546+0000","last_undegraded":"2024-09-14T13:02:24.626546+0000","last_fullsized":"2024-09-14T13:02:24.626546+0000","mapping_epoch":26,"log_start":"267'600","ondisk_log_start":"267'600","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'703","last_scrub_stamp":"2024-09-14T13:02:24.626190+0000","last_deep_scrub":"267'703","last_deep_scrub_stamp":"2024-09-14T13:02:24.626190+0000","last_clean_scrub_stamp":"2024-09-14T13:02:24.626190+0000","objects_scrubbed":5,"log_size":103,"log_dups_size":600,"ondisk_log_size":103,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:48:57.287293+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":3652,"num_read_kb":3296,"num_write":1024,"num_write_kb":466,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"267'186","reported_seq":829,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:17.374091+0000","last_change":"2024-09-14T13:02:17.374091+0000","last_active":"2024-09-14T13:02:17.374091+0000","last_peered":"2024-09-14T13:02:17.374091+0000","last_clean":"2024-09-14T13:02:17.374091+0000","last_became_active":"2024-09-14T11:08:21.824907+0000","last_became_peered":"2024-09-14T11:08:21.824907+0000","last_unstale":"2024-09-14T13:02:17.374091+0000","last_undegraded":"2024-09-14T13:02:17.374091+0000","last_fullsized":"2024-09-14T13:02:17.374091+0000","mapping_epoch":24,"log_start":"267'100","ondisk_log_start":"267'100","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'186","last_scrub_stamp":"2024-09-14T13:02:17.373793+0000","last_deep_scrub":"267'186","last_deep_scrub_stamp":"2024-09-14T13:02:17.373793+0000","last_clean_scrub_stamp":"2024-09-14T13:02:17.373793+0000","objects_scrubbed":6,"log_size":86,"log_dups_size":100,"ondisk_log_size":86,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:39:09.691991+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":511,"num_read_kb":17563,"num_write":879,"num_write_kb":17084,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,4],"acting":[6,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.32","version":"267'542","reported_seq":2182,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:23.391820+0000","last_change":"2024-09-14T13:02:23.391820+0000","last_active":"2024-09-14T13:02:23.391820+0000","last_peered":"2024-09-14T13:02:23.391820+0000","last_clean":"2024-09-14T13:02:23.391820+0000","last_became_active":"2024-09-14T11:08:23.801090+0000","last_became_peered":"2024-09-14T11:08:23.801090+0000","last_unstale":"2024-09-14T13:02:23.391820+0000","last_undegraded":"2024-09-14T13:02:23.391820+0000","last_fullsized":"2024-09-14T13:02:23.391820+0000","mapping_epoch":26,"log_start":"267'500","ondisk_log_start":"267'500","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'542","last_scrub_stamp":"2024-09-14T13:02:23.391622+0000","last_deep_scrub":"267'542","last_deep_scrub_stamp":"2024-09-14T13:02:23.391622+0000","last_clean_scrub_stamp":"2024-09-14T13:02:23.391622+0000","objects_scrubbed":2,"log_size":42,"log_dups_size":500,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:37:14.569886+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2832,"num_read_kb":2611,"num_write":684,"num_write_kb":208,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":701,"num_omap_keys":3,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.35","version":"267'227","reported_seq":905,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:15.349124+0000","last_change":"2024-09-14T13:02:15.349124+0000","last_active":"2024-09-14T13:02:15.349124+0000","last_peered":"2024-09-14T13:02:15.349124+0000","last_clean":"2024-09-14T13:02:15.349124+0000","last_became_active":"2024-09-14T11:08:21.817113+0000","last_became_peered":"2024-09-14T11:08:21.817113+0000","last_unstale":"2024-09-14T13:02:15.349124+0000","last_undegraded":"2024-09-14T13:02:15.349124+0000","last_fullsized":"2024-09-14T13:02:15.349124+0000","mapping_epoch":24,"log_start":"267'200","ondisk_log_start":"267'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'227","last_scrub_stamp":"2024-09-14T13:02:15.348883+0000","last_deep_scrub":"267'227","last_deep_scrub_stamp":"2024-09-14T13:02:15.348883+0000","last_clean_scrub_stamp":"2024-09-14T13:02:15.348883+0000","objects_scrubbed":5,"log_size":27,"log_dups_size":200,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:20:13.352709+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1655893,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":573,"num_read_kb":71773,"num_write":1062,"num_write_kb":34768,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,0],"acting":[6,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.33","version":"267'481","reported_seq":2211,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:23.127477+0000","last_change":"2024-09-14T13:02:23.127477+0000","last_active":"2024-09-14T13:02:23.127477+0000","last_peered":"2024-09-14T13:02:23.127477+0000","last_clean":"2024-09-14T13:02:23.127477+0000","last_became_active":"2024-09-14T11:08:23.782135+0000","last_became_peered":"2024-09-14T11:08:23.782135+0000","last_unstale":"2024-09-14T13:02:23.127477+0000","last_undegraded":"2024-09-14T13:02:23.127477+0000","last_fullsized":"2024-09-14T13:02:23.127477+0000","mapping_epoch":26,"log_start":"267'400","ondisk_log_start":"267'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'481","last_scrub_stamp":"2024-09-14T13:02:23.127294+0000","last_deep_scrub":"267'481","last_deep_scrub_stamp":"2024-09-14T13:02:23.127294+0000","last_clean_scrub_stamp":"2024-09-14T13:02:23.127294+0000","objects_scrubbed":1,"log_size":81,"log_dups_size":400,"ondisk_log_size":81,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:48:12.161901+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2660,"num_read_kb":2528,"num_write":519,"num_write_kb":93,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.34","version":"267'250","reported_seq":912,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:10.813724+0000","last_change":"2024-09-14T13:02:10.813724+0000","last_active":"2024-09-14T13:02:10.813724+0000","last_peered":"2024-09-14T13:02:10.813724+0000","last_clean":"2024-09-14T13:02:10.813724+0000","last_became_active":"2024-09-14T11:08:21.835636+0000","last_became_peered":"2024-09-14T11:08:21.835636+0000","last_unstale":"2024-09-14T13:02:10.813724+0000","last_undegraded":"2024-09-14T13:02:10.813724+0000","last_fullsized":"2024-09-14T13:02:10.813724+0000","mapping_epoch":24,"log_start":"267'200","ondisk_log_start":"267'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'250","last_scrub_stamp":"2024-09-14T13:02:10.813489+0000","last_deep_scrub":"267'250","last_deep_scrub_stamp":"2024-09-14T13:02:10.813489+0000","last_clean_scrub_stamp":"2024-09-14T13:02:10.813489+0000","objects_scrubbed":2,"log_size":50,"log_dups_size":200,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T00:40:56.666305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1655836,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":575,"num_read_kb":3577,"num_write":1185,"num_write_kb":25395,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6],"acting":[4,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.34","version":"267'554","reported_seq":2220,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:18.141972+0000","last_change":"2024-09-14T13:02:18.141972+0000","last_active":"2024-09-14T13:02:18.141972+0000","last_peered":"2024-09-14T13:02:18.141972+0000","last_clean":"2024-09-14T13:02:18.141972+0000","last_became_active":"2024-09-14T11:08:23.784078+0000","last_became_peered":"2024-09-14T11:08:23.784078+0000","last_unstale":"2024-09-14T13:02:18.141972+0000","last_undegraded":"2024-09-14T13:02:18.141972+0000","last_fullsized":"2024-09-14T13:02:18.141972+0000","mapping_epoch":26,"log_start":"267'500","ondisk_log_start":"267'500","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'554","last_scrub_stamp":"2024-09-14T13:02:18.141748+0000","last_deep_scrub":"267'554","last_deep_scrub_stamp":"2024-09-14T13:02:18.141748+0000","last_clean_scrub_stamp":"2024-09-14T13:02:18.141748+0000","objects_scrubbed":1,"log_size":54,"log_dups_size":500,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:33:55.821825+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3071,"num_read_kb":2852,"num_write":734,"num_write_kb":256,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.33","version":"267'240","reported_seq":882,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:12.917024+0000","last_change":"2024-09-14T13:02:12.917024+0000","last_active":"2024-09-14T13:02:12.917024+0000","last_peered":"2024-09-14T13:02:12.917024+0000","last_clean":"2024-09-14T13:02:12.917024+0000","last_became_active":"2024-09-14T11:08:21.809526+0000","last_became_peered":"2024-09-14T11:08:21.809526+0000","last_unstale":"2024-09-14T13:02:12.917024+0000","last_undegraded":"2024-09-14T13:02:12.917024+0000","last_fullsized":"2024-09-14T13:02:12.917024+0000","mapping_epoch":24,"log_start":"267'200","ondisk_log_start":"267'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'240","last_scrub_stamp":"2024-09-14T13:02:12.916789+0000","last_deep_scrub":"267'240","last_deep_scrub_stamp":"2024-09-14T13:02:12.916789+0000","last_clean_scrub_stamp":"2024-09-14T13:02:12.916789+0000","objects_scrubbed":2,"log_size":40,"log_dups_size":200,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:08:03.665418+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":500,"num_read_kb":25008,"num_write":1059,"num_write_kb":23085,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6,1],"acting":[3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.35","version":"267'801","reported_seq":2465,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:23.742731+0000","last_change":"2024-09-14T13:02:23.742731+0000","last_active":"2024-09-14T13:02:23.742731+0000","last_peered":"2024-09-14T13:02:23.742731+0000","last_clean":"2024-09-14T13:02:23.742731+0000","last_became_active":"2024-09-14T11:08:23.785540+0000","last_became_peered":"2024-09-14T11:08:23.785540+0000","last_unstale":"2024-09-14T13:02:23.742731+0000","last_undegraded":"2024-09-14T13:02:23.742731+0000","last_fullsized":"2024-09-14T13:02:23.742731+0000","mapping_epoch":26,"log_start":"267'700","ondisk_log_start":"267'700","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'801","last_scrub_stamp":"2024-09-14T13:02:23.742547+0000","last_deep_scrub":"267'801","last_deep_scrub_stamp":"2024-09-14T13:02:23.742547+0000","last_clean_scrub_stamp":"2024-09-14T13:02:23.742547+0000","objects_scrubbed":1,"log_size":101,"log_dups_size":700,"ondisk_log_size":101,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:21:48.998615+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3845,"num_read_kb":3496,"num_write":1039,"num_write_kb":364,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.32","version":"267'223","reported_seq":1020,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:11.123809+0000","last_change":"2024-09-14T13:02:11.123809+0000","last_active":"2024-09-14T13:02:11.123809+0000","last_peered":"2024-09-14T13:02:11.123809+0000","last_clean":"2024-09-14T13:02:11.123809+0000","last_became_active":"2024-09-14T11:08:21.780800+0000","last_became_peered":"2024-09-14T11:08:21.780800+0000","last_unstale":"2024-09-14T13:02:11.123809+0000","last_undegraded":"2024-09-14T13:02:11.123809+0000","last_fullsized":"2024-09-14T13:02:11.123809+0000","mapping_epoch":24,"log_start":"267'200","ondisk_log_start":"267'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'223","last_scrub_stamp":"2024-09-14T13:02:11.123576+0000","last_deep_scrub":"267'223","last_deep_scrub_stamp":"2024-09-14T13:02:11.123576+0000","last_clean_scrub_stamp":"2024-09-14T13:02:11.123576+0000","objects_scrubbed":3,"log_size":23,"log_dups_size":200,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:03:24.176635+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1655860,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1400,"num_read_kb":21343,"num_write":1086,"num_write_kb":34809,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,1],"acting":[0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.18","version":"267'196","reported_seq":748,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:40.652956+0000","last_change":"2024-09-14T13:02:40.652956+0000","last_active":"2024-09-14T13:02:40.652956+0000","last_peered":"2024-09-14T13:02:40.652956+0000","last_clean":"2024-09-14T13:02:40.652956+0000","last_became_active":"2024-09-14T11:08:31.850605+0000","last_became_peered":"2024-09-14T11:08:31.850605+0000","last_unstale":"2024-09-14T13:02:40.652956+0000","last_undegraded":"2024-09-14T13:02:40.652956+0000","last_fullsized":"2024-09-14T13:02:40.652956+0000","mapping_epoch":34,"log_start":"267'100","ondisk_log_start":"267'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'196","last_scrub_stamp":"2024-09-14T13:02:40.652681+0000","last_deep_scrub":"267'196","last_deep_scrub_stamp":"2024-09-14T13:02:40.652681+0000","last_clean_scrub_stamp":"2024-09-14T13:02:40.652681+0000","objects_scrubbed":1,"log_size":96,"log_dups_size":100,"ondisk_log_size":96,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:51:54.305411+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":204,"num_read_kb":191,"num_write":376,"num_write_kb":86,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.14","version":"267'869","reported_seq":2400,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:17.883495+0000","last_change":"2024-09-14T13:02:17.883495+0000","last_active":"2024-09-14T13:02:17.883495+0000","last_peered":"2024-09-14T13:02:17.883495+0000","last_clean":"2024-09-14T13:02:17.883495+0000","last_became_active":"2024-09-14T11:08:23.779822+0000","last_became_peered":"2024-09-14T11:08:23.779822+0000","last_unstale":"2024-09-14T13:02:17.883495+0000","last_undegraded":"2024-09-14T13:02:17.883495+0000","last_fullsized":"2024-09-14T13:02:17.883495+0000","mapping_epoch":26,"log_start":"267'800","ondisk_log_start":"267'800","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'869","last_scrub_stamp":"2024-09-14T13:02:17.883315+0000","last_deep_scrub":"267'869","last_deep_scrub_stamp":"2024-09-14T13:02:17.883315+0000","last_clean_scrub_stamp":"2024-09-14T13:02:17.883315+0000","objects_scrubbed":4,"log_size":69,"log_dups_size":800,"ondisk_log_size":69,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:49:19.140159+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":4044,"num_read_kb":3595,"num_write":1182,"num_write_kb":452,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"267'245","reported_seq":1022,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:17.612499+0000","last_change":"2024-09-14T13:02:17.612170+0000","last_active":"2024-09-14T13:02:17.612499+0000","last_peered":"2024-09-14T13:02:17.612499+0000","last_clean":"2024-09-14T13:02:17.612499+0000","last_became_active":"2024-09-14T11:08:21.843212+0000","last_became_peered":"2024-09-14T11:08:21.843212+0000","last_unstale":"2024-09-14T13:02:17.612499+0000","last_undegraded":"2024-09-14T13:02:17.612499+0000","last_fullsized":"2024-09-14T13:02:17.612499+0000","mapping_epoch":24,"log_start":"267'200","ondisk_log_start":"267'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'245","last_scrub_stamp":"2024-09-14T13:02:17.611975+0000","last_deep_scrub":"267'245","last_deep_scrub_stamp":"2024-09-14T13:02:17.611975+0000","last_clean_scrub_stamp":"2024-09-14T13:02:17.611975+0000","objects_scrubbed":2,"log_size":45,"log_dups_size":200,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:38:36.738720+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":15,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1021,"num_read_kb":177071,"num_write":1108,"num_write_kb":33961,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,4],"acting":[7,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":534,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:30.482417+0000","last_change":"2024-09-14T13:02:30.482417+0000","last_active":"2024-09-14T13:02:30.482417+0000","last_peered":"2024-09-14T13:02:30.482417+0000","last_clean":"2024-09-14T13:02:30.482417+0000","last_became_active":"2024-09-14T11:08:25.803311+0000","last_became_peered":"2024-09-14T11:08:25.803311+0000","last_unstale":"2024-09-14T13:02:30.482417+0000","last_undegraded":"2024-09-14T13:02:30.482417+0000","last_fullsized":"2024-09-14T13:02:30.482417+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T13:02:30.482226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T13:02:30.482226+0000","last_clean_scrub_stamp":"2024-09-14T13:02:30.482226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:45:03.017589+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.16","version":"267'231","reported_seq":897,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:29.031735+0000","last_change":"2024-09-14T13:02:29.031735+0000","last_active":"2024-09-14T13:02:29.031735+0000","last_peered":"2024-09-14T13:02:29.031735+0000","last_clean":"2024-09-14T13:02:29.031735+0000","last_became_active":"2024-09-14T11:08:27.808834+0000","last_became_peered":"2024-09-14T11:08:27.808834+0000","last_unstale":"2024-09-14T13:02:29.031735+0000","last_undegraded":"2024-09-14T13:02:29.031735+0000","last_fullsized":"2024-09-14T13:02:29.031735+0000","mapping_epoch":30,"log_start":"267'200","ondisk_log_start":"267'200","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'231","last_scrub_stamp":"2024-09-14T13:02:29.031545+0000","last_deep_scrub":"267'231","last_deep_scrub_stamp":"2024-09-14T13:02:29.031545+0000","last_clean_scrub_stamp":"2024-09-14T13:02:29.031545+0000","objects_scrubbed":4,"log_size":31,"log_dups_size":200,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:57:52.720132+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4096,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":308,"num_read_kb":323,"num_write":180,"num_write_kb":16,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":527,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:38.519700+0000","last_change":"2024-09-14T13:02:38.519700+0000","last_active":"2024-09-14T13:02:38.519700+0000","last_peered":"2024-09-14T13:02:38.519700+0000","last_clean":"2024-09-14T13:02:38.519700+0000","last_became_active":"2024-09-14T11:08:29.833332+0000","last_became_peered":"2024-09-14T11:08:29.833332+0000","last_unstale":"2024-09-14T13:02:38.519700+0000","last_undegraded":"2024-09-14T13:02:38.519700+0000","last_fullsized":"2024-09-14T13:02:38.519700+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T13:02:38.519446+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T13:02:38.519446+0000","last_clean_scrub_stamp":"2024-09-14T13:02:38.519446+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:00:10.435989+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.19","version":"267'123","reported_seq":649,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:43.374822+0000","last_change":"2024-09-14T13:02:43.374822+0000","last_active":"2024-09-14T13:02:43.374822+0000","last_peered":"2024-09-14T13:02:43.374822+0000","last_clean":"2024-09-14T13:02:43.374822+0000","last_became_active":"2024-09-14T11:08:31.843645+0000","last_became_peered":"2024-09-14T11:08:31.843645+0000","last_unstale":"2024-09-14T13:02:43.374822+0000","last_undegraded":"2024-09-14T13:02:43.374822+0000","last_fullsized":"2024-09-14T13:02:43.374822+0000","mapping_epoch":34,"log_start":"267'100","ondisk_log_start":"267'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'123","last_scrub_stamp":"2024-09-14T13:02:43.374641+0000","last_deep_scrub":"267'123","last_deep_scrub_stamp":"2024-09-14T13:02:43.374641+0000","last_clean_scrub_stamp":"2024-09-14T13:02:43.374641+0000","objects_scrubbed":1,"log_size":23,"log_dups_size":100,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:50:45.974080+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":100,"num_read_kb":97,"num_write":289,"num_write_kb":65,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.15","version":"267'1237","reported_seq":3023,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:22.427041+0000","last_change":"2024-09-14T13:02:22.427041+0000","last_active":"2024-09-14T13:02:22.427041+0000","last_peered":"2024-09-14T13:02:22.427041+0000","last_clean":"2024-09-14T13:02:22.427041+0000","last_became_active":"2024-09-14T11:08:23.808015+0000","last_became_peered":"2024-09-14T11:08:23.808015+0000","last_unstale":"2024-09-14T13:02:22.427041+0000","last_undegraded":"2024-09-14T13:02:22.427041+0000","last_fullsized":"2024-09-14T13:02:22.427041+0000","mapping_epoch":26,"log_start":"267'1200","ondisk_log_start":"267'1200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'1237","last_scrub_stamp":"2024-09-14T13:02:22.426850+0000","last_deep_scrub":"267'1237","last_deep_scrub_stamp":"2024-09-14T13:02:22.426850+0000","last_clean_scrub_stamp":"2024-09-14T13:02:22.426850+0000","objects_scrubbed":3,"log_size":37,"log_dups_size":1200,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:18:30.537089+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":5778,"num_read_kb":5143,"num_write":1691,"num_write_kb":698,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2040,"num_omap_keys":8,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.12","version":"267'232","reported_seq":958,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:04.982048+0000","last_change":"2024-09-14T13:02:04.981981+0000","last_active":"2024-09-14T13:02:04.982048+0000","last_peered":"2024-09-14T13:02:04.982048+0000","last_clean":"2024-09-14T13:02:04.982048+0000","last_became_active":"2024-09-14T11:08:21.787257+0000","last_became_peered":"2024-09-14T11:08:21.787257+0000","last_unstale":"2024-09-14T13:02:04.982048+0000","last_undegraded":"2024-09-14T13:02:04.982048+0000","last_fullsized":"2024-09-14T13:02:04.982048+0000","mapping_epoch":24,"log_start":"267'200","ondisk_log_start":"267'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'232","last_scrub_stamp":"2024-09-14T13:02:04.981884+0000","last_deep_scrub":"267'232","last_deep_scrub_stamp":"2024-09-14T13:02:04.981884+0000","last_clean_scrub_stamp":"2024-09-14T13:02:04.981884+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":200,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:03:51.775808+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":660,"num_read_kb":98910,"num_write":982,"num_write_kb":32453,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3],"acting":[0,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":535,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:22.944095+0000","last_change":"2024-09-14T13:02:22.944095+0000","last_active":"2024-09-14T13:02:22.944095+0000","last_peered":"2024-09-14T13:02:22.944095+0000","last_clean":"2024-09-14T13:02:22.944095+0000","last_became_active":"2024-09-14T11:08:25.804100+0000","last_became_peered":"2024-09-14T11:08:25.804100+0000","last_unstale":"2024-09-14T13:02:22.944095+0000","last_undegraded":"2024-09-14T13:02:22.944095+0000","last_fullsized":"2024-09-14T13:02:22.944095+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T13:02:22.943903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T13:02:22.943903+0000","last_clean_scrub_stamp":"2024-09-14T13:02:22.943903+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:47:59.177750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.17","version":"267'132","reported_seq":716,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:33.738666+0000","last_change":"2024-09-14T13:02:33.738666+0000","last_active":"2024-09-14T13:02:33.738666+0000","last_peered":"2024-09-14T13:02:33.738666+0000","last_clean":"2024-09-14T13:02:33.738666+0000","last_became_active":"2024-09-14T11:08:27.831010+0000","last_became_peered":"2024-09-14T11:08:27.831010+0000","last_unstale":"2024-09-14T13:02:33.738666+0000","last_undegraded":"2024-09-14T13:02:33.738666+0000","last_fullsized":"2024-09-14T13:02:33.738666+0000","mapping_epoch":30,"log_start":"267'100","ondisk_log_start":"267'100","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'132","last_scrub_stamp":"2024-09-14T13:02:33.738485+0000","last_deep_scrub":"267'132","last_deep_scrub_stamp":"2024-09-14T13:02:33.738485+0000","last_clean_scrub_stamp":"2024-09-14T13:02:33.738485+0000","objects_scrubbed":3,"log_size":32,"log_dups_size":100,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:36:05.488919+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":152,"num_read_kb":149,"num_write":100,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":528,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:39.633756+0000","last_change":"2024-09-14T13:02:39.633756+0000","last_active":"2024-09-14T13:02:39.633756+0000","last_peered":"2024-09-14T13:02:39.633756+0000","last_clean":"2024-09-14T13:02:39.633756+0000","last_became_active":"2024-09-14T11:08:29.809568+0000","last_became_peered":"2024-09-14T11:08:29.809568+0000","last_unstale":"2024-09-14T13:02:39.633756+0000","last_undegraded":"2024-09-14T13:02:39.633756+0000","last_fullsized":"2024-09-14T13:02:39.633756+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T13:02:39.633574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T13:02:39.633574+0000","last_clean_scrub_stamp":"2024-09-14T13:02:39.633574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:43:20.197341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.1a","version":"267'141","reported_seq":734,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:39.203271+0000","last_change":"2024-09-14T13:02:39.203271+0000","last_active":"2024-09-14T13:02:39.203271+0000","last_peered":"2024-09-14T13:02:39.203271+0000","last_clean":"2024-09-14T13:02:39.203271+0000","last_became_active":"2024-09-14T11:08:31.845634+0000","last_became_peered":"2024-09-14T11:08:31.845634+0000","last_unstale":"2024-09-14T13:02:39.203271+0000","last_undegraded":"2024-09-14T13:02:39.203271+0000","last_fullsized":"2024-09-14T13:02:39.203271+0000","mapping_epoch":34,"log_start":"267'100","ondisk_log_start":"267'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'141","last_scrub_stamp":"2024-09-14T13:02:39.203097+0000","last_deep_scrub":"267'141","last_deep_scrub_stamp":"2024-09-14T13:02:39.203097+0000","last_clean_scrub_stamp":"2024-09-14T13:02:39.203097+0000","objects_scrubbed":4,"log_size":41,"log_dups_size":100,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:04:51.158766+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":271,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":347,"num_read_kb":294,"num_write":357,"num_write_kb":85,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"267'412","reported_seq":1938,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:20.980337+0000","last_change":"2024-09-14T13:02:20.980337+0000","last_active":"2024-09-14T13:02:20.980337+0000","last_peered":"2024-09-14T13:02:20.980337+0000","last_clean":"2024-09-14T13:02:20.980337+0000","last_became_active":"2024-09-14T11:08:23.780326+0000","last_became_peered":"2024-09-14T11:08:23.780326+0000","last_unstale":"2024-09-14T13:02:20.980337+0000","last_undegraded":"2024-09-14T13:02:20.980337+0000","last_fullsized":"2024-09-14T13:02:20.980337+0000","mapping_epoch":26,"log_start":"267'400","ondisk_log_start":"267'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'412","last_scrub_stamp":"2024-09-14T13:02:20.980143+0000","last_deep_scrub":"267'412","last_deep_scrub_stamp":"2024-09-14T13:02:20.980143+0000","last_clean_scrub_stamp":"2024-09-14T13:02:20.980143+0000","objects_scrubbed":3,"log_size":12,"log_dups_size":400,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:17:39.736976+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2172,"num_read_kb":2053,"num_write":475,"num_write_kb":100,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.11","version":"267'229","reported_seq":863,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:07.062536+0000","last_change":"2024-09-14T13:02:07.062536+0000","last_active":"2024-09-14T13:02:07.062536+0000","last_peered":"2024-09-14T13:02:07.062536+0000","last_clean":"2024-09-14T13:02:07.062536+0000","last_became_active":"2024-09-14T11:08:56.038815+0000","last_became_peered":"2024-09-14T11:08:56.038815+0000","last_unstale":"2024-09-14T13:02:07.062536+0000","last_undegraded":"2024-09-14T13:02:07.062536+0000","last_fullsized":"2024-09-14T13:02:07.062536+0000","mapping_epoch":37,"log_start":"267'200","ondisk_log_start":"267'200","created":24,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'229","last_scrub_stamp":"2024-09-14T13:02:07.062441+0000","last_deep_scrub":"267'229","last_deep_scrub_stamp":"2024-09-14T13:02:07.062441+0000","last_clean_scrub_stamp":"2024-09-14T13:02:07.062441+0000","objects_scrubbed":2,"log_size":29,"log_dups_size":200,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:34:17.014914+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":52,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":508,"num_read_kb":22051,"num_write":996,"num_write_kb":45213,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4,6],"acting":[2,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":534,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:24.965066+0000","last_change":"2024-09-14T13:02:24.965066+0000","last_active":"2024-09-14T13:02:24.965066+0000","last_peered":"2024-09-14T13:02:24.965066+0000","last_clean":"2024-09-14T13:02:24.965066+0000","last_became_active":"2024-09-14T11:08:25.798008+0000","last_became_peered":"2024-09-14T11:08:25.798008+0000","last_unstale":"2024-09-14T13:02:24.965066+0000","last_undegraded":"2024-09-14T13:02:24.965066+0000","last_fullsized":"2024-09-14T13:02:24.965066+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T13:02:24.964760+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T13:02:24.964760+0000","last_clean_scrub_stamp":"2024-09-14T13:02:24.964760+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:03:42.094133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.14","version":"267'186","reported_seq":797,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:27.090012+0000","last_change":"2024-09-14T13:02:27.090012+0000","last_active":"2024-09-14T13:02:27.090012+0000","last_peered":"2024-09-14T13:02:27.090012+0000","last_clean":"2024-09-14T13:02:27.090012+0000","last_became_active":"2024-09-14T11:08:27.820627+0000","last_became_peered":"2024-09-14T11:08:27.820627+0000","last_unstale":"2024-09-14T13:02:27.090012+0000","last_undegraded":"2024-09-14T13:02:27.090012+0000","last_fullsized":"2024-09-14T13:02:27.090012+0000","mapping_epoch":30,"log_start":"267'100","ondisk_log_start":"267'100","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'186","last_scrub_stamp":"2024-09-14T13:02:27.089825+0000","last_deep_scrub":"267'186","last_deep_scrub_stamp":"2024-09-14T13:02:27.089825+0000","last_clean_scrub_stamp":"2024-09-14T13:02:27.089825+0000","objects_scrubbed":6,"log_size":86,"log_dups_size":100,"ondisk_log_size":86,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:35:32.897007+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":232,"num_read_kb":224,"num_write":158,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.15","version":"267'776","reported_seq":3181,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:37.570152+0000","last_change":"2024-09-14T13:02:37.570152+0000","last_active":"2024-09-14T13:02:37.570152+0000","last_peered":"2024-09-14T13:02:37.570152+0000","last_clean":"2024-09-14T13:02:37.570152+0000","last_became_active":"2024-09-14T11:08:29.838193+0000","last_became_peered":"2024-09-14T11:08:29.838193+0000","last_unstale":"2024-09-14T13:02:37.570152+0000","last_undegraded":"2024-09-14T13:02:37.570152+0000","last_fullsized":"2024-09-14T13:02:37.570152+0000","mapping_epoch":32,"log_start":"267'701","ondisk_log_start":"267'701","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'776","last_scrub_stamp":"2024-09-14T13:02:37.569957+0000","last_deep_scrub":"267'776","last_deep_scrub_stamp":"2024-09-14T13:02:37.569957+0000","last_clean_scrub_stamp":"2024-09-14T13:02:37.569957+0000","objects_scrubbed":1,"log_size":75,"log_dups_size":701,"ondisk_log_size":75,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:42:49.427217+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1b","version":"267'215","reported_seq":1081,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:41.690416+0000","last_change":"2024-09-14T13:02:41.690416+0000","last_active":"2024-09-14T13:02:41.690416+0000","last_peered":"2024-09-14T13:02:41.690416+0000","last_clean":"2024-09-14T13:02:41.690416+0000","last_became_active":"2024-09-14T11:08:31.843385+0000","last_became_peered":"2024-09-14T11:08:31.843385+0000","last_unstale":"2024-09-14T13:02:41.690416+0000","last_undegraded":"2024-09-14T13:02:41.690416+0000","last_fullsized":"2024-09-14T13:02:41.690416+0000","mapping_epoch":34,"log_start":"267'201","ondisk_log_start":"267'201","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'215","last_scrub_stamp":"2024-09-14T13:02:41.690225+0000","last_deep_scrub":"267'215","last_deep_scrub_stamp":"2024-09-14T13:02:41.690225+0000","last_clean_scrub_stamp":"2024-09-14T13:02:41.690225+0000","objects_scrubbed":5,"log_size":14,"log_dups_size":201,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T00:08:49.260985+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":642,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":623,"num_read_kb":612,"num_write":468,"num_write_kb":119,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":234,"num_omap_keys":2,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.17","version":"267'422","reported_seq":1919,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:13.138664+0000","last_change":"2024-09-14T13:02:13.138664+0000","last_active":"2024-09-14T13:02:13.138664+0000","last_peered":"2024-09-14T13:02:13.138664+0000","last_clean":"2024-09-14T13:02:13.138664+0000","last_became_active":"2024-09-14T11:09:57.239636+0000","last_became_peered":"2024-09-14T11:09:57.239636+0000","last_unstale":"2024-09-14T13:02:13.138664+0000","last_undegraded":"2024-09-14T13:02:13.138664+0000","last_fullsized":"2024-09-14T13:02:13.138664+0000","mapping_epoch":39,"log_start":"267'400","ondisk_log_start":"267'400","created":26,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'422","last_scrub_stamp":"2024-09-14T13:02:13.138458+0000","last_deep_scrub":"267'422","last_deep_scrub_stamp":"2024-09-14T13:02:13.138458+0000","last_clean_scrub_stamp":"2024-09-14T13:02:13.138458+0000","objects_scrubbed":2,"log_size":22,"log_dups_size":400,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:56:36.716655+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2202,"num_read_kb":2076,"num_write":491,"num_write_kb":104,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.10","version":"267'249","reported_seq":926,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:09.253625+0000","last_change":"2024-09-14T13:02:09.253431+0000","last_active":"2024-09-14T13:02:09.253625+0000","last_peered":"2024-09-14T13:02:09.253625+0000","last_clean":"2024-09-14T13:02:09.253625+0000","last_became_active":"2024-09-14T11:08:21.817332+0000","last_became_peered":"2024-09-14T11:08:21.817332+0000","last_unstale":"2024-09-14T13:02:09.253625+0000","last_undegraded":"2024-09-14T13:02:09.253625+0000","last_fullsized":"2024-09-14T13:02:09.253625+0000","mapping_epoch":24,"log_start":"267'200","ondisk_log_start":"267'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'249","last_scrub_stamp":"2024-09-14T13:02:09.253234+0000","last_deep_scrub":"267'249","last_deep_scrub_stamp":"2024-09-14T13:02:09.253234+0000","last_clean_scrub_stamp":"2024-09-14T13:02:09.253234+0000","objects_scrubbed":1,"log_size":49,"log_dups_size":200,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:02:19.341971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":650,"num_read_kb":50041,"num_write":1009,"num_write_kb":23458,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,5],"acting":[6,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":534,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:31.440125+0000","last_change":"2024-09-14T13:02:31.440125+0000","last_active":"2024-09-14T13:02:31.440125+0000","last_peered":"2024-09-14T13:02:31.440125+0000","last_clean":"2024-09-14T13:02:31.440125+0000","last_became_active":"2024-09-14T11:08:25.814645+0000","last_became_peered":"2024-09-14T11:08:25.814645+0000","last_unstale":"2024-09-14T13:02:31.440125+0000","last_undegraded":"2024-09-14T13:02:31.440125+0000","last_fullsized":"2024-09-14T13:02:31.440125+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T13:02:31.439919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T13:02:31.439919+0000","last_clean_scrub_stamp":"2024-09-14T13:02:31.439919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:25:41.343773+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.15","version":"267'184","reported_seq":812,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:33.597620+0000","last_change":"2024-09-14T13:02:33.597620+0000","last_active":"2024-09-14T13:02:33.597620+0000","last_peered":"2024-09-14T13:02:33.597620+0000","last_clean":"2024-09-14T13:02:33.597620+0000","last_became_active":"2024-09-14T11:08:27.827940+0000","last_became_peered":"2024-09-14T11:08:27.827940+0000","last_unstale":"2024-09-14T13:02:33.597620+0000","last_undegraded":"2024-09-14T13:02:33.597620+0000","last_fullsized":"2024-09-14T13:02:33.597620+0000","mapping_epoch":30,"log_start":"267'100","ondisk_log_start":"267'100","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'184","last_scrub_stamp":"2024-09-14T13:02:33.597409+0000","last_deep_scrub":"267'184","last_deep_scrub_stamp":"2024-09-14T13:02:33.597409+0000","last_clean_scrub_stamp":"2024-09-14T13:02:33.597409+0000","objects_scrubbed":5,"log_size":84,"log_dups_size":100,"ondisk_log_size":84,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:01:16.588660+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6699,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":229,"num_read_kb":300,"num_write":130,"num_write_kb":20,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.14","version":"267'816","reported_seq":2995,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:35.955913+0000","last_change":"2024-09-14T13:02:35.955913+0000","last_active":"2024-09-14T13:02:35.955913+0000","last_peered":"2024-09-14T13:02:35.955913+0000","last_clean":"2024-09-14T13:02:35.955913+0000","last_became_active":"2024-09-14T11:08:29.831198+0000","last_became_peered":"2024-09-14T11:08:29.831198+0000","last_unstale":"2024-09-14T13:02:35.955913+0000","last_undegraded":"2024-09-14T13:02:35.955913+0000","last_fullsized":"2024-09-14T13:02:35.955913+0000","mapping_epoch":32,"log_start":"267'800","ondisk_log_start":"267'800","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'816","last_scrub_stamp":"2024-09-14T13:02:35.955719+0000","last_deep_scrub":"267'816","last_deep_scrub_stamp":"2024-09-14T13:02:35.955719+0000","last_clean_scrub_stamp":"2024-09-14T13:02:35.955719+0000","objects_scrubbed":1,"log_size":16,"log_dups_size":800,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:45:59.679413+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.8","version":"267'443","reported_seq":1996,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:21.471906+0000","last_change":"2024-09-14T13:02:21.471906+0000","last_active":"2024-09-14T13:02:21.471906+0000","last_peered":"2024-09-14T13:02:21.471906+0000","last_clean":"2024-09-14T13:02:21.471906+0000","last_became_active":"2024-09-14T11:08:23.811325+0000","last_became_peered":"2024-09-14T11:08:23.811325+0000","last_unstale":"2024-09-14T13:02:21.471906+0000","last_undegraded":"2024-09-14T13:02:21.471906+0000","last_fullsized":"2024-09-14T13:02:21.471906+0000","mapping_epoch":26,"log_start":"267'400","ondisk_log_start":"267'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'443","last_scrub_stamp":"2024-09-14T13:02:21.471733+0000","last_deep_scrub":"267'443","last_deep_scrub_stamp":"2024-09-14T13:02:21.471733+0000","last_clean_scrub_stamp":"2024-09-14T13:02:21.471733+0000","objects_scrubbed":3,"log_size":43,"log_dups_size":400,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T00:28:13.667148+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2277,"num_read_kb":2143,"num_write":513,"num_write_kb":125,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":217,"num_omap_keys":1,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.f","version":"267'247","reported_seq":939,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:09.651897+0000","last_change":"2024-09-14T13:02:09.651897+0000","last_active":"2024-09-14T13:02:09.651897+0000","last_peered":"2024-09-14T13:02:09.651897+0000","last_clean":"2024-09-14T13:02:09.651897+0000","last_became_active":"2024-09-14T11:08:21.845618+0000","last_became_peered":"2024-09-14T11:08:21.845618+0000","last_unstale":"2024-09-14T13:02:09.651897+0000","last_undegraded":"2024-09-14T13:02:09.651897+0000","last_fullsized":"2024-09-14T13:02:09.651897+0000","mapping_epoch":24,"log_start":"267'200","ondisk_log_start":"267'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'247","last_scrub_stamp":"2024-09-14T13:02:09.651691+0000","last_deep_scrub":"267'247","last_deep_scrub_stamp":"2024-09-14T13:02:09.651691+0000","last_clean_scrub_stamp":"2024-09-14T13:02:09.651691+0000","objects_scrubbed":3,"log_size":47,"log_dups_size":200,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:37:39.121548+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":682,"num_read_kb":36009,"num_write":1081,"num_write_kb":30861,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,0],"acting":[7,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":540,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:26.545227+0000","last_change":"2024-09-14T13:02:26.545227+0000","last_active":"2024-09-14T13:02:26.545227+0000","last_peered":"2024-09-14T13:02:26.545227+0000","last_clean":"2024-09-14T13:02:26.545227+0000","last_became_active":"2024-09-14T11:08:25.806427+0000","last_became_peered":"2024-09-14T11:08:25.806427+0000","last_unstale":"2024-09-14T13:02:26.545227+0000","last_undegraded":"2024-09-14T13:02:26.545227+0000","last_fullsized":"2024-09-14T13:02:26.545227+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T13:02:26.545021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T13:02:26.545021+0000","last_clean_scrub_stamp":"2024-09-14T13:02:26.545021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:36:58.214359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.a","version":"267'332","reported_seq":1040,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:34.440856+0000","last_change":"2024-09-14T13:02:34.440856+0000","last_active":"2024-09-14T13:02:34.440856+0000","last_peered":"2024-09-14T13:02:34.440856+0000","last_clean":"2024-09-14T13:02:34.440856+0000","last_became_active":"2024-09-14T11:08:27.825133+0000","last_became_peered":"2024-09-14T11:08:27.825133+0000","last_unstale":"2024-09-14T13:02:34.440856+0000","last_undegraded":"2024-09-14T13:02:34.440856+0000","last_fullsized":"2024-09-14T13:02:34.440856+0000","mapping_epoch":30,"log_start":"267'300","ondisk_log_start":"267'300","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'332","last_scrub_stamp":"2024-09-14T13:02:34.440644+0000","last_deep_scrub":"267'332","last_deep_scrub_stamp":"2024-09-14T13:02:34.440644+0000","last_clean_scrub_stamp":"2024-09-14T13:02:34.440644+0000","objects_scrubbed":10,"log_size":32,"log_dups_size":300,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T00:49:11.129833+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6555,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":452,"num_read_kb":512,"num_write":278,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":527,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:36.180793+0000","last_change":"2024-09-14T13:02:36.180793+0000","last_active":"2024-09-14T13:02:36.180793+0000","last_peered":"2024-09-14T13:02:36.180793+0000","last_clean":"2024-09-14T13:02:36.180793+0000","last_became_active":"2024-09-14T11:08:29.815620+0000","last_became_peered":"2024-09-14T11:08:29.815620+0000","last_unstale":"2024-09-14T13:02:36.180793+0000","last_undegraded":"2024-09-14T13:02:36.180793+0000","last_fullsized":"2024-09-14T13:02:36.180793+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T13:02:36.180603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T13:02:36.180603+0000","last_clean_scrub_stamp":"2024-09-14T13:02:36.180603+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:19:11.606941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.4","version":"267'575","reported_seq":1427,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:39.434130+0000","last_change":"2024-09-14T13:02:39.434130+0000","last_active":"2024-09-14T13:02:39.434130+0000","last_peered":"2024-09-14T13:02:39.434130+0000","last_clean":"2024-09-14T13:02:39.434130+0000","last_became_active":"2024-09-14T11:08:31.843834+0000","last_became_peered":"2024-09-14T11:08:31.843834+0000","last_unstale":"2024-09-14T13:02:39.434130+0000","last_undegraded":"2024-09-14T13:02:39.434130+0000","last_fullsized":"2024-09-14T13:02:39.434130+0000","mapping_epoch":34,"log_start":"267'500","ondisk_log_start":"267'500","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'575","last_scrub_stamp":"2024-09-14T13:02:39.433887+0000","last_deep_scrub":"267'575","last_deep_scrub_stamp":"2024-09-14T13:02:39.433887+0000","last_clean_scrub_stamp":"2024-09-14T13:02:39.433887+0000","objects_scrubbed":6,"log_size":75,"log_dups_size":500,"ondisk_log_size":75,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:35:09.744013+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1277,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":1293,"num_read_kb":1292,"num_write":1202,"num_write_kb":404,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":381,"num_omap_keys":2,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.9","version":"267'1172","reported_seq":2712,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:11.831369+0000","last_change":"2024-09-14T13:02:11.831369+0000","last_active":"2024-09-14T13:02:11.831369+0000","last_peered":"2024-09-14T13:02:11.831369+0000","last_clean":"2024-09-14T13:02:11.831369+0000","last_became_active":"2024-09-14T11:08:23.778539+0000","last_became_peered":"2024-09-14T11:08:23.778539+0000","last_unstale":"2024-09-14T13:02:11.831369+0000","last_undegraded":"2024-09-14T13:02:11.831369+0000","last_fullsized":"2024-09-14T13:02:11.831369+0000","mapping_epoch":26,"log_start":"267'1100","ondisk_log_start":"267'1100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'1172","last_scrub_stamp":"2024-09-14T13:02:11.831174+0000","last_deep_scrub":"267'1172","last_deep_scrub_stamp":"2024-09-14T13:02:11.831174+0000","last_clean_scrub_stamp":"2024-09-14T13:02:11.831174+0000","objects_scrubbed":6,"log_size":72,"log_dups_size":1100,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:09:58.666148+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":5272,"num_read_kb":4639,"num_write":1605,"num_write_kb":663,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"267'241","reported_seq":894,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:10.656071+0000","last_change":"2024-09-14T13:02:10.656071+0000","last_active":"2024-09-14T13:02:10.656071+0000","last_peered":"2024-09-14T13:02:10.656071+0000","last_clean":"2024-09-14T13:02:10.656071+0000","last_became_active":"2024-09-14T11:08:21.836948+0000","last_became_peered":"2024-09-14T11:08:21.836948+0000","last_unstale":"2024-09-14T13:02:10.656071+0000","last_undegraded":"2024-09-14T13:02:10.656071+0000","last_fullsized":"2024-09-14T13:02:10.656071+0000","mapping_epoch":24,"log_start":"267'200","ondisk_log_start":"267'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'241","last_scrub_stamp":"2024-09-14T13:02:10.655851+0000","last_deep_scrub":"267'241","last_deep_scrub_stamp":"2024-09-14T13:02:10.655851+0000","last_clean_scrub_stamp":"2024-09-14T13:02:10.655851+0000","objects_scrubbed":3,"log_size":41,"log_dups_size":200,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T00:25:40.160047+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":550,"num_read_kb":30603,"num_write":1007,"num_write_kb":48772,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,1],"acting":[7,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.8","version":"267'5","reported_seq":1020,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:22.163504+0000","last_change":"2024-09-14T13:02:22.163504+0000","last_active":"2024-09-14T13:02:22.163504+0000","last_peered":"2024-09-14T13:02:22.163504+0000","last_clean":"2024-09-14T13:02:22.163504+0000","last_became_active":"2024-09-14T11:08:25.786631+0000","last_became_peered":"2024-09-14T11:08:25.786631+0000","last_unstale":"2024-09-14T13:02:22.163504+0000","last_undegraded":"2024-09-14T13:02:22.163504+0000","last_fullsized":"2024-09-14T13:02:22.163504+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'5","last_scrub_stamp":"2024-09-14T13:02:22.163310+0000","last_deep_scrub":"267'5","last_deep_scrub_stamp":"2024-09-14T13:02:22.163310+0000","last_clean_scrub_stamp":"2024-09-14T13:02:22.163310+0000","objects_scrubbed":1,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:36:41.907237+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1139,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":718,"num_read_kb":1182,"num_write":8,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.b","version":"267'180","reported_seq":810,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:26.978235+0000","last_change":"2024-09-14T13:02:26.978235+0000","last_active":"2024-09-14T13:02:26.978235+0000","last_peered":"2024-09-14T13:02:26.978235+0000","last_clean":"2024-09-14T13:02:26.978235+0000","last_became_active":"2024-09-14T11:08:27.821051+0000","last_became_peered":"2024-09-14T11:08:27.821051+0000","last_unstale":"2024-09-14T13:02:26.978235+0000","last_undegraded":"2024-09-14T13:02:26.978235+0000","last_fullsized":"2024-09-14T13:02:26.978235+0000","mapping_epoch":30,"log_start":"267'100","ondisk_log_start":"267'100","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'180","last_scrub_stamp":"2024-09-14T13:02:26.978033+0000","last_deep_scrub":"267'180","last_deep_scrub_stamp":"2024-09-14T13:02:26.978033+0000","last_clean_scrub_stamp":"2024-09-14T13:02:26.978033+0000","objects_scrubbed":4,"log_size":80,"log_dups_size":100,"ondisk_log_size":80,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:07:33.857702+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7629,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":234,"num_read_kb":320,"num_write":132,"num_write_kb":26,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":531,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:38.907574+0000","last_change":"2024-09-14T13:02:38.907574+0000","last_active":"2024-09-14T13:02:38.907574+0000","last_peered":"2024-09-14T13:02:38.907574+0000","last_clean":"2024-09-14T13:02:38.907574+0000","last_became_active":"2024-09-14T11:08:29.835446+0000","last_became_peered":"2024-09-14T11:08:29.835446+0000","last_unstale":"2024-09-14T13:02:38.907574+0000","last_undegraded":"2024-09-14T13:02:38.907574+0000","last_fullsized":"2024-09-14T13:02:38.907574+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T13:02:38.907370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T13:02:38.907370+0000","last_clean_scrub_stamp":"2024-09-14T13:02:38.907370+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:54:07.413764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.5","version":"267'2492","reported_seq":4368,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:30.277298+0000","last_change":"2024-09-14T13:02:30.277298+0000","last_active":"2024-09-14T13:02:30.277298+0000","last_peered":"2024-09-14T13:02:30.277298+0000","last_clean":"2024-09-14T13:02:30.277298+0000","last_became_active":"2024-09-14T11:08:31.848959+0000","last_became_peered":"2024-09-14T11:08:31.848959+0000","last_unstale":"2024-09-14T13:02:30.277298+0000","last_undegraded":"2024-09-14T13:02:30.277298+0000","last_fullsized":"2024-09-14T13:02:30.277298+0000","mapping_epoch":34,"log_start":"267'2400","ondisk_log_start":"267'2400","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'2492","last_scrub_stamp":"2024-09-14T13:02:30.277095+0000","last_deep_scrub":"267'2492","last_deep_scrub_stamp":"2024-09-14T13:02:30.277095+0000","last_clean_scrub_stamp":"2024-09-14T13:02:30.277095+0000","objects_scrubbed":2,"log_size":92,"log_dups_size":2400,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:17:08.669349+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":423,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":6223,"num_read_kb":6216,"num_write":5015,"num_write_kb":1852,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":176,"num_omap_keys":1,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.a","version":"267'868","reported_seq":2687,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:14.314869+0000","last_change":"2024-09-14T13:02:14.314869+0000","last_active":"2024-09-14T13:02:14.314869+0000","last_peered":"2024-09-14T13:02:14.314869+0000","last_clean":"2024-09-14T13:02:14.314869+0000","last_became_active":"2024-09-14T11:08:23.811255+0000","last_became_peered":"2024-09-14T11:08:23.811255+0000","last_unstale":"2024-09-14T13:02:14.314869+0000","last_undegraded":"2024-09-14T13:02:14.314869+0000","last_fullsized":"2024-09-14T13:02:14.314869+0000","mapping_epoch":26,"log_start":"267'800","ondisk_log_start":"267'800","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'868","last_scrub_stamp":"2024-09-14T13:02:14.314591+0000","last_deep_scrub":"267'868","last_deep_scrub_stamp":"2024-09-14T13:02:14.314591+0000","last_clean_scrub_stamp":"2024-09-14T13:02:14.314591+0000","objects_scrubbed":2,"log_size":68,"log_dups_size":800,"ondisk_log_size":68,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:09:26.042491+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":4399,"num_read_kb":3998,"num_write":1156,"num_write_kb":415,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"267'213","reported_seq":893,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:12.651148+0000","last_change":"2024-09-14T13:02:12.651148+0000","last_active":"2024-09-14T13:02:12.651148+0000","last_peered":"2024-09-14T13:02:12.651148+0000","last_clean":"2024-09-14T13:02:12.651148+0000","last_became_active":"2024-09-14T11:08:21.804566+0000","last_became_peered":"2024-09-14T11:08:21.804566+0000","last_unstale":"2024-09-14T13:02:12.651148+0000","last_undegraded":"2024-09-14T13:02:12.651148+0000","last_fullsized":"2024-09-14T13:02:12.651148+0000","mapping_epoch":24,"log_start":"267'200","ondisk_log_start":"267'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'213","last_scrub_stamp":"2024-09-14T13:02:12.650904+0000","last_deep_scrub":"267'213","last_deep_scrub_stamp":"2024-09-14T13:02:12.650904+0000","last_clean_scrub_stamp":"2024-09-14T13:02:12.650904+0000","objects_scrubbed":6,"log_size":13,"log_dups_size":200,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:40:39.876331+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3311695,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":558,"num_read_kb":39823,"num_write":955,"num_write_kb":36124,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,3],"acting":[7,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":541,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:28.128083+0000","last_change":"2024-09-14T13:02:28.128083+0000","last_active":"2024-09-14T13:02:28.128083+0000","last_peered":"2024-09-14T13:02:28.128083+0000","last_clean":"2024-09-14T13:02:28.128083+0000","last_became_active":"2024-09-14T11:08:25.789075+0000","last_became_peered":"2024-09-14T11:08:25.789075+0000","last_unstale":"2024-09-14T13:02:28.128083+0000","last_undegraded":"2024-09-14T13:02:28.128083+0000","last_fullsized":"2024-09-14T13:02:28.128083+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T13:02:28.127905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T13:02:28.127905+0000","last_clean_scrub_stamp":"2024-09-14T13:02:28.127905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:54:32.722141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.8","version":"267'240","reported_seq":909,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:31.565905+0000","last_change":"2024-09-14T13:02:31.565905+0000","last_active":"2024-09-14T13:02:31.565905+0000","last_peered":"2024-09-14T13:02:31.565905+0000","last_clean":"2024-09-14T13:02:31.565905+0000","last_became_active":"2024-09-14T11:08:27.830862+0000","last_became_peered":"2024-09-14T11:08:27.830862+0000","last_unstale":"2024-09-14T13:02:31.565905+0000","last_undegraded":"2024-09-14T13:02:31.565905+0000","last_fullsized":"2024-09-14T13:02:31.565905+0000","mapping_epoch":30,"log_start":"267'200","ondisk_log_start":"267'200","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'240","last_scrub_stamp":"2024-09-14T13:02:31.565702+0000","last_deep_scrub":"267'240","last_deep_scrub_stamp":"2024-09-14T13:02:31.565702+0000","last_clean_scrub_stamp":"2024-09-14T13:02:31.565702+0000","objects_scrubbed":7,"log_size":40,"log_dups_size":200,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:48:33.239781+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4096,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":320,"num_read_kb":327,"num_write":186,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.9","version":"267'785","reported_seq":3481,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:30.035900+0000","last_change":"2024-09-14T13:02:30.035900+0000","last_active":"2024-09-14T13:02:30.035900+0000","last_peered":"2024-09-14T13:02:30.035900+0000","last_clean":"2024-09-14T13:02:30.035900+0000","last_became_active":"2024-09-14T11:08:29.821920+0000","last_became_peered":"2024-09-14T11:08:29.821920+0000","last_unstale":"2024-09-14T13:02:30.035900+0000","last_undegraded":"2024-09-14T13:02:30.035900+0000","last_fullsized":"2024-09-14T13:02:30.035900+0000","mapping_epoch":32,"log_start":"267'700","ondisk_log_start":"267'700","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'785","last_scrub_stamp":"2024-09-14T13:02:30.035684+0000","last_deep_scrub":"267'785","last_deep_scrub_stamp":"2024-09-14T13:02:30.035684+0000","last_clean_scrub_stamp":"2024-09-14T13:02:30.035684+0000","objects_scrubbed":1,"log_size":85,"log_dups_size":700,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:32:34.155277+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.6","version":"267'128","reported_seq":673,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:37.211214+0000","last_change":"2024-09-14T13:02:37.211214+0000","last_active":"2024-09-14T13:02:37.211214+0000","last_peered":"2024-09-14T13:02:37.211214+0000","last_clean":"2024-09-14T13:02:37.211214+0000","last_became_active":"2024-09-14T11:08:31.846373+0000","last_became_peered":"2024-09-14T11:08:31.846373+0000","last_unstale":"2024-09-14T13:02:37.211214+0000","last_undegraded":"2024-09-14T13:02:37.211214+0000","last_fullsized":"2024-09-14T13:02:37.211214+0000","mapping_epoch":34,"log_start":"267'100","ondisk_log_start":"267'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'128","last_scrub_stamp":"2024-09-14T13:02:37.211023+0000","last_deep_scrub":"267'128","last_deep_scrub_stamp":"2024-09-14T13:02:37.211023+0000","last_clean_scrub_stamp":"2024-09-14T13:02:37.211023+0000","objects_scrubbed":2,"log_size":28,"log_dups_size":100,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:02:57.592912+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":575,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":123,"num_write":296,"num_write_kb":71,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"267'1041","reported_seq":2685,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:19.068533+0000","last_change":"2024-09-14T13:02:19.068533+0000","last_active":"2024-09-14T13:02:19.068533+0000","last_peered":"2024-09-14T13:02:19.068533+0000","last_clean":"2024-09-14T13:02:19.068533+0000","last_became_active":"2024-09-14T11:08:23.777032+0000","last_became_peered":"2024-09-14T11:08:23.777032+0000","last_unstale":"2024-09-14T13:02:19.068533+0000","last_undegraded":"2024-09-14T13:02:19.068533+0000","last_fullsized":"2024-09-14T13:02:19.068533+0000","mapping_epoch":26,"log_start":"267'1000","ondisk_log_start":"267'1000","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'1041","last_scrub_stamp":"2024-09-14T13:02:19.068315+0000","last_deep_scrub":"267'1041","last_deep_scrub_stamp":"2024-09-14T13:02:19.068315+0000","last_clean_scrub_stamp":"2024-09-14T13:02:19.068315+0000","objects_scrubbed":1,"log_size":41,"log_dups_size":1000,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T00:09:24.080847+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":7372,"num_read_kb":6755,"num_write":1704,"num_write_kb":754,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.c","version":"267'187","reported_seq":835,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:10.302676+0000","last_change":"2024-09-14T13:02:10.302676+0000","last_active":"2024-09-14T13:02:10.302676+0000","last_peered":"2024-09-14T13:02:10.302676+0000","last_clean":"2024-09-14T13:02:10.302676+0000","last_became_active":"2024-09-14T11:08:21.828010+0000","last_became_peered":"2024-09-14T11:08:21.828010+0000","last_unstale":"2024-09-14T13:02:10.302676+0000","last_undegraded":"2024-09-14T13:02:10.302676+0000","last_fullsized":"2024-09-14T13:02:10.302676+0000","mapping_epoch":24,"log_start":"267'100","ondisk_log_start":"267'100","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'187","last_scrub_stamp":"2024-09-14T13:02:10.302469+0000","last_deep_scrub":"267'187","last_deep_scrub_stamp":"2024-09-14T13:02:10.302469+0000","last_clean_scrub_stamp":"2024-09-14T13:02:10.302469+0000","objects_scrubbed":2,"log_size":87,"log_dups_size":100,"ondisk_log_size":87,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T00:03:54.075323+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":29,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":466,"num_read_kb":18086,"num_write":819,"num_write_kb":39275,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,6],"acting":[5,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":543,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:21.173257+0000","last_change":"2024-09-14T13:02:21.173257+0000","last_active":"2024-09-14T13:02:21.173257+0000","last_peered":"2024-09-14T13:02:21.173257+0000","last_clean":"2024-09-14T13:02:21.173257+0000","last_became_active":"2024-09-14T11:08:25.805415+0000","last_became_peered":"2024-09-14T11:08:25.805415+0000","last_unstale":"2024-09-14T13:02:21.173257+0000","last_undegraded":"2024-09-14T13:02:21.173257+0000","last_fullsized":"2024-09-14T13:02:21.173257+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T13:02:21.173074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T13:02:21.173074+0000","last_clean_scrub_stamp":"2024-09-14T13:02:21.173074+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:57:11.797331+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"267'252","reported_seq":950,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:25.973750+0000","last_change":"2024-09-14T13:02:25.973750+0000","last_active":"2024-09-14T13:02:25.973750+0000","last_peered":"2024-09-14T13:02:25.973750+0000","last_clean":"2024-09-14T13:02:25.973750+0000","last_became_active":"2024-09-14T11:08:27.811687+0000","last_became_peered":"2024-09-14T11:08:27.811687+0000","last_unstale":"2024-09-14T13:02:25.973750+0000","last_undegraded":"2024-09-14T13:02:25.973750+0000","last_fullsized":"2024-09-14T13:02:25.973750+0000","mapping_epoch":30,"log_start":"267'200","ondisk_log_start":"267'200","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'252","last_scrub_stamp":"2024-09-14T13:02:25.973551+0000","last_deep_scrub":"267'252","last_deep_scrub_stamp":"2024-09-14T13:02:25.973551+0000","last_clean_scrub_stamp":"2024-09-14T13:02:25.973551+0000","objects_scrubbed":6,"log_size":52,"log_dups_size":200,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:23:33.816144+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":25927,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":349,"num_read_kb":508,"num_write":186,"num_write_kb":50,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":535,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:26.043510+0000","last_change":"2024-09-14T13:02:26.043510+0000","last_active":"2024-09-14T13:02:26.043510+0000","last_peered":"2024-09-14T13:02:26.043510+0000","last_clean":"2024-09-14T13:02:26.043510+0000","last_became_active":"2024-09-14T11:08:29.821747+0000","last_became_peered":"2024-09-14T11:08:29.821747+0000","last_unstale":"2024-09-14T13:02:26.043510+0000","last_undegraded":"2024-09-14T13:02:26.043510+0000","last_fullsized":"2024-09-14T13:02:26.043510+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T13:02:26.043324+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T13:02:26.043324+0000","last_clean_scrub_stamp":"2024-09-14T13:02:26.043324+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:05:56.999647+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.7","version":"267'151","reported_seq":705,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:29.128113+0000","last_change":"2024-09-14T13:02:29.128113+0000","last_active":"2024-09-14T13:02:29.128113+0000","last_peered":"2024-09-14T13:02:29.128113+0000","last_clean":"2024-09-14T13:02:29.128113+0000","last_became_active":"2024-09-14T11:08:31.838392+0000","last_became_peered":"2024-09-14T11:08:31.838392+0000","last_unstale":"2024-09-14T13:02:29.128113+0000","last_undegraded":"2024-09-14T13:02:29.128113+0000","last_fullsized":"2024-09-14T13:02:29.128113+0000","mapping_epoch":34,"log_start":"267'100","ondisk_log_start":"267'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'151","last_scrub_stamp":"2024-09-14T13:02:29.127914+0000","last_deep_scrub":"267'151","last_deep_scrub_stamp":"2024-09-14T13:02:29.127914+0000","last_clean_scrub_stamp":"2024-09-14T13:02:29.127914+0000","objects_scrubbed":3,"log_size":51,"log_dups_size":100,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:09:19.987511+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":722,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":177,"num_read_kb":165,"num_write":335,"num_write_kb":82,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"267'557","reported_seq":2167,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:12.782223+0000","last_change":"2024-09-14T13:02:12.782223+0000","last_active":"2024-09-14T13:02:12.782223+0000","last_peered":"2024-09-14T13:02:12.782223+0000","last_clean":"2024-09-14T13:02:12.782223+0000","last_became_active":"2024-09-14T11:08:23.788219+0000","last_became_peered":"2024-09-14T11:08:23.788219+0000","last_unstale":"2024-09-14T13:02:12.782223+0000","last_undegraded":"2024-09-14T13:02:12.782223+0000","last_fullsized":"2024-09-14T13:02:12.782223+0000","mapping_epoch":26,"log_start":"267'500","ondisk_log_start":"267'500","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'557","last_scrub_stamp":"2024-09-14T13:02:12.781939+0000","last_deep_scrub":"267'557","last_deep_scrub_stamp":"2024-09-14T13:02:12.781939+0000","last_clean_scrub_stamp":"2024-09-14T13:02:12.781939+0000","objects_scrubbed":0,"log_size":57,"log_dups_size":500,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:01:16.526677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2903,"num_read_kb":2651,"num_write":738,"num_write_kb":289,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"267'322","reported_seq":1077,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:07.945838+0000","last_change":"2024-09-14T13:02:07.945838+0000","last_active":"2024-09-14T13:02:07.945838+0000","last_peered":"2024-09-14T13:02:07.945838+0000","last_clean":"2024-09-14T13:02:07.945838+0000","last_became_active":"2024-09-14T11:08:21.827553+0000","last_became_peered":"2024-09-14T11:08:21.827553+0000","last_unstale":"2024-09-14T13:02:07.945838+0000","last_undegraded":"2024-09-14T13:02:07.945838+0000","last_fullsized":"2024-09-14T13:02:07.945838+0000","mapping_epoch":24,"log_start":"267'300","ondisk_log_start":"267'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'322","last_scrub_stamp":"2024-09-14T13:02:07.945633+0000","last_deep_scrub":"267'322","last_deep_scrub_stamp":"2024-09-14T13:02:07.945633+0000","last_clean_scrub_stamp":"2024-09-14T13:02:07.945633+0000","objects_scrubbed":2,"log_size":22,"log_dups_size":300,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:22:36.317068+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1003,"num_read_kb":39840,"num_write":1278,"num_write_kb":27597,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,4],"acting":[3,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":541,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:24.101103+0000","last_change":"2024-09-14T13:02:24.101103+0000","last_active":"2024-09-14T13:02:24.101103+0000","last_peered":"2024-09-14T13:02:24.101103+0000","last_clean":"2024-09-14T13:02:24.101103+0000","last_became_active":"2024-09-14T11:08:25.798931+0000","last_became_peered":"2024-09-14T11:08:25.798931+0000","last_unstale":"2024-09-14T13:02:24.101103+0000","last_undegraded":"2024-09-14T13:02:24.101103+0000","last_fullsized":"2024-09-14T13:02:24.101103+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T13:02:24.100892+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T13:02:24.100892+0000","last_clean_scrub_stamp":"2024-09-14T13:02:24.100892+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:15:17.317882+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.e","version":"267'210","reported_seq":854,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:31.667503+0000","last_change":"2024-09-14T13:02:31.667503+0000","last_active":"2024-09-14T13:02:31.667503+0000","last_peered":"2024-09-14T13:02:31.667503+0000","last_clean":"2024-09-14T13:02:31.667503+0000","last_became_active":"2024-09-14T11:08:27.818219+0000","last_became_peered":"2024-09-14T11:08:27.818219+0000","last_unstale":"2024-09-14T13:02:31.667503+0000","last_undegraded":"2024-09-14T13:02:31.667503+0000","last_fullsized":"2024-09-14T13:02:31.667503+0000","mapping_epoch":30,"log_start":"264'100","ondisk_log_start":"264'100","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'210","last_scrub_stamp":"2024-09-14T13:02:31.667260+0000","last_deep_scrub":"267'210","last_deep_scrub_stamp":"2024-09-14T13:02:31.667260+0000","last_clean_scrub_stamp":"2024-09-14T13:02:31.667260+0000","objects_scrubbed":6,"log_size":110,"log_dups_size":100,"ondisk_log_size":110,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:37:05.528538+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6420,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":294,"num_read_kb":320,"num_write":220,"num_write_kb":86,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":15964,"num_omap_keys":38,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":534,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:34.134567+0000","last_change":"2024-09-14T13:02:34.134567+0000","last_active":"2024-09-14T13:02:34.134567+0000","last_peered":"2024-09-14T13:02:34.134567+0000","last_clean":"2024-09-14T13:02:34.134567+0000","last_became_active":"2024-09-14T11:08:29.824057+0000","last_became_peered":"2024-09-14T11:08:29.824057+0000","last_unstale":"2024-09-14T13:02:34.134567+0000","last_undegraded":"2024-09-14T13:02:34.134567+0000","last_fullsized":"2024-09-14T13:02:34.134567+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T13:02:34.134358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T13:02:34.134358+0000","last_clean_scrub_stamp":"2024-09-14T13:02:34.134358+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:13:01.485748+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.0","version":"267'132","reported_seq":665,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:43.934231+0000","last_change":"2024-09-14T13:02:43.934066+0000","last_active":"2024-09-14T13:02:43.934231+0000","last_peered":"2024-09-14T13:02:43.934231+0000","last_clean":"2024-09-14T13:02:43.934231+0000","last_became_active":"2024-09-14T11:08:31.844832+0000","last_became_peered":"2024-09-14T11:08:31.844832+0000","last_unstale":"2024-09-14T13:02:43.934231+0000","last_undegraded":"2024-09-14T13:02:43.934231+0000","last_fullsized":"2024-09-14T13:02:43.934231+0000","mapping_epoch":34,"log_start":"267'100","ondisk_log_start":"267'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'132","last_scrub_stamp":"2024-09-14T13:02:43.933873+0000","last_deep_scrub":"267'132","last_deep_scrub_stamp":"2024-09-14T13:02:43.933873+0000","last_clean_scrub_stamp":"2024-09-14T13:02:43.933873+0000","objects_scrubbed":5,"log_size":32,"log_dups_size":100,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:33:05.732072+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":910,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":99,"num_read_kb":98,"num_write":310,"num_write_kb":70,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"267'808","reported_seq":2448,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:13.800136+0000","last_change":"2024-09-14T13:02:13.800136+0000","last_active":"2024-09-14T13:02:13.800136+0000","last_peered":"2024-09-14T13:02:13.800136+0000","last_clean":"2024-09-14T13:02:13.800136+0000","last_became_active":"2024-09-14T11:08:23.791966+0000","last_became_peered":"2024-09-14T11:08:23.791966+0000","last_unstale":"2024-09-14T13:02:13.800136+0000","last_undegraded":"2024-09-14T13:02:13.800136+0000","last_fullsized":"2024-09-14T13:02:13.800136+0000","mapping_epoch":26,"log_start":"267'700","ondisk_log_start":"267'700","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'808","last_scrub_stamp":"2024-09-14T13:02:13.799940+0000","last_deep_scrub":"267'808","last_deep_scrub_stamp":"2024-09-14T13:02:13.799940+0000","last_clean_scrub_stamp":"2024-09-14T13:02:13.799940+0000","objects_scrubbed":1,"log_size":108,"log_dups_size":700,"ondisk_log_size":108,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:03:49.959088+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3905,"num_read_kb":3535,"num_write":1083,"num_write_kb":396,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"267'233","reported_seq":916,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:10.262031+0000","last_change":"2024-09-14T13:02:10.262031+0000","last_active":"2024-09-14T13:02:10.262031+0000","last_peered":"2024-09-14T13:02:10.262031+0000","last_clean":"2024-09-14T13:02:10.262031+0000","last_became_active":"2024-09-14T11:08:21.836346+0000","last_became_peered":"2024-09-14T11:08:21.836346+0000","last_unstale":"2024-09-14T13:02:10.262031+0000","last_undegraded":"2024-09-14T13:02:10.262031+0000","last_fullsized":"2024-09-14T13:02:10.262031+0000","mapping_epoch":24,"log_start":"267'200","ondisk_log_start":"267'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'233","last_scrub_stamp":"2024-09-14T13:02:10.261790+0000","last_deep_scrub":"267'233","last_deep_scrub_stamp":"2024-09-14T13:02:10.261790+0000","last_clean_scrub_stamp":"2024-09-14T13:02:10.261790+0000","objects_scrubbed":3,"log_size":33,"log_dups_size":200,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:01:19.068873+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2055072,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":607,"num_read_kb":23439,"num_write":1082,"num_write_kb":33198,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,1],"acting":[6,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":535,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:20.025587+0000","last_change":"2024-09-14T13:02:20.025587+0000","last_active":"2024-09-14T13:02:20.025587+0000","last_peered":"2024-09-14T13:02:20.025587+0000","last_clean":"2024-09-14T13:02:20.025587+0000","last_became_active":"2024-09-14T11:08:25.806502+0000","last_became_peered":"2024-09-14T11:08:25.806502+0000","last_unstale":"2024-09-14T13:02:20.025587+0000","last_undegraded":"2024-09-14T13:02:20.025587+0000","last_fullsized":"2024-09-14T13:02:20.025587+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T13:02:20.025419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T13:02:20.025419+0000","last_clean_scrub_stamp":"2024-09-14T13:02:20.025419+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:06:23.521008+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.f","version":"267'246","reported_seq":916,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:25.074588+0000","last_change":"2024-09-14T13:02:25.074588+0000","last_active":"2024-09-14T13:02:25.074588+0000","last_peered":"2024-09-14T13:02:25.074588+0000","last_clean":"2024-09-14T13:02:25.074588+0000","last_became_active":"2024-09-14T11:08:27.817904+0000","last_became_peered":"2024-09-14T11:08:27.817904+0000","last_unstale":"2024-09-14T13:02:25.074588+0000","last_undegraded":"2024-09-14T13:02:25.074588+0000","last_fullsized":"2024-09-14T13:02:25.074588+0000","mapping_epoch":30,"log_start":"267'200","ondisk_log_start":"267'200","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'246","last_scrub_stamp":"2024-09-14T13:02:25.074372+0000","last_deep_scrub":"267'246","last_deep_scrub_stamp":"2024-09-14T13:02:25.074372+0000","last_clean_scrub_stamp":"2024-09-14T13:02:25.074372+0000","objects_scrubbed":7,"log_size":46,"log_dups_size":200,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:02:03.126229+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8985,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":331,"num_read_kb":393,"num_write":194,"num_write_kb":21,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.e","version":"267'763","reported_seq":3243,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:29.123290+0000","last_change":"2024-09-14T13:02:29.123290+0000","last_active":"2024-09-14T13:02:29.123290+0000","last_peered":"2024-09-14T13:02:29.123290+0000","last_clean":"2024-09-14T13:02:29.123290+0000","last_became_active":"2024-09-14T11:08:29.817475+0000","last_became_peered":"2024-09-14T11:08:29.817475+0000","last_unstale":"2024-09-14T13:02:29.123290+0000","last_undegraded":"2024-09-14T13:02:29.123290+0000","last_fullsized":"2024-09-14T13:02:29.123290+0000","mapping_epoch":32,"log_start":"267'700","ondisk_log_start":"267'700","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'763","last_scrub_stamp":"2024-09-14T13:02:29.122983+0000","last_deep_scrub":"267'763","last_deep_scrub_stamp":"2024-09-14T13:02:29.122983+0000","last_clean_scrub_stamp":"2024-09-14T13:02:29.122983+0000","objects_scrubbed":1,"log_size":63,"log_dups_size":700,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T00:20:17.430015+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1","version":"267'134","reported_seq":680,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:30.143565+0000","last_change":"2024-09-14T13:02:30.143565+0000","last_active":"2024-09-14T13:02:30.143565+0000","last_peered":"2024-09-14T13:02:30.143565+0000","last_clean":"2024-09-14T13:02:30.143565+0000","last_became_active":"2024-09-14T11:08:31.847603+0000","last_became_peered":"2024-09-14T11:08:31.847603+0000","last_unstale":"2024-09-14T13:02:30.143565+0000","last_undegraded":"2024-09-14T13:02:30.143565+0000","last_fullsized":"2024-09-14T13:02:30.143565+0000","mapping_epoch":34,"log_start":"267'100","ondisk_log_start":"267'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'134","last_scrub_stamp":"2024-09-14T13:02:30.143380+0000","last_deep_scrub":"267'134","last_deep_scrub_stamp":"2024-09-14T13:02:30.143380+0000","last_clean_scrub_stamp":"2024-09-14T13:02:30.143380+0000","objects_scrubbed":4,"log_size":34,"log_dups_size":100,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:29:36.739368+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1261,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":168,"num_read_kb":154,"num_write":334,"num_write_kb":78,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"267'386","reported_seq":1940,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:14.788852+0000","last_change":"2024-09-14T13:02:14.788852+0000","last_active":"2024-09-14T13:02:14.788852+0000","last_peered":"2024-09-14T13:02:14.788852+0000","last_clean":"2024-09-14T13:02:14.788852+0000","last_became_active":"2024-09-14T11:08:23.814578+0000","last_became_peered":"2024-09-14T11:08:23.814578+0000","last_unstale":"2024-09-14T13:02:14.788852+0000","last_undegraded":"2024-09-14T13:02:14.788852+0000","last_fullsized":"2024-09-14T13:02:14.788852+0000","mapping_epoch":26,"log_start":"267'300","ondisk_log_start":"267'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'386","last_scrub_stamp":"2024-09-14T13:02:14.788668+0000","last_deep_scrub":"267'386","last_deep_scrub_stamp":"2024-09-14T13:02:14.788668+0000","last_clean_scrub_stamp":"2024-09-14T13:02:14.788668+0000","objects_scrubbed":1,"log_size":86,"log_dups_size":300,"ondisk_log_size":86,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:27:33.280225+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2178,"num_read_kb":2072,"num_write":449,"num_write_kb":92,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.9","version":"267'206","reported_seq":870,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:07.861868+0000","last_change":"2024-09-14T13:02:07.861868+0000","last_active":"2024-09-14T13:02:07.861868+0000","last_peered":"2024-09-14T13:02:07.861868+0000","last_clean":"2024-09-14T13:02:07.861868+0000","last_became_active":"2024-09-14T11:08:21.824109+0000","last_became_peered":"2024-09-14T11:08:21.824109+0000","last_unstale":"2024-09-14T13:02:07.861868+0000","last_undegraded":"2024-09-14T13:02:07.861868+0000","last_fullsized":"2024-09-14T13:02:07.861868+0000","mapping_epoch":24,"log_start":"267'100","ondisk_log_start":"267'100","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'206","last_scrub_stamp":"2024-09-14T13:02:07.861610+0000","last_deep_scrub":"267'206","last_deep_scrub_stamp":"2024-09-14T13:02:07.861610+0000","last_clean_scrub_stamp":"2024-09-14T13:02:07.861610+0000","objects_scrubbed":3,"log_size":106,"log_dups_size":100,"ondisk_log_size":106,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:54:21.419194+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1655851,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":552,"num_read_kb":13686,"num_write":959,"num_write_kb":41004,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,7],"acting":[4,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.f","version":"267'4","reported_seq":1487,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:29.522816+0000","last_change":"2024-09-14T13:02:29.522816+0000","last_active":"2024-09-14T13:02:29.522816+0000","last_peered":"2024-09-14T13:02:29.522816+0000","last_clean":"2024-09-14T13:02:29.522816+0000","last_became_active":"2024-09-14T11:08:25.815109+0000","last_became_peered":"2024-09-14T11:08:25.815109+0000","last_unstale":"2024-09-14T13:02:29.522816+0000","last_undegraded":"2024-09-14T13:02:29.522816+0000","last_fullsized":"2024-09-14T13:02:29.522816+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'4","last_scrub_stamp":"2024-09-14T13:02:29.522630+0000","last_deep_scrub":"267'4","last_deep_scrub_stamp":"2024-09-14T13:02:29.522630+0000","last_clean_scrub_stamp":"2024-09-14T13:02:29.522630+0000","objects_scrubbed":2,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T00:08:08.934481+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":946,"num_read_kb":946,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.c","version":"267'157","reported_seq":751,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:29.910731+0000","last_change":"2024-09-14T13:02:29.910731+0000","last_active":"2024-09-14T13:02:29.910731+0000","last_peered":"2024-09-14T13:02:29.910731+0000","last_clean":"2024-09-14T13:02:29.910731+0000","last_became_active":"2024-09-14T11:08:27.799244+0000","last_became_peered":"2024-09-14T11:08:27.799244+0000","last_unstale":"2024-09-14T13:02:29.910731+0000","last_undegraded":"2024-09-14T13:02:29.910731+0000","last_fullsized":"2024-09-14T13:02:29.910731+0000","mapping_epoch":30,"log_start":"267'100","ondisk_log_start":"267'100","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'157","last_scrub_stamp":"2024-09-14T13:02:29.910539+0000","last_deep_scrub":"267'157","last_deep_scrub_stamp":"2024-09-14T13:02:29.910539+0000","last_clean_scrub_stamp":"2024-09-14T13:02:29.910539+0000","objects_scrubbed":5,"log_size":57,"log_dups_size":100,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:53:22.851388+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":184,"num_read_kb":178,"num_write":124,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.d","version":"267'769","reported_seq":3172,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:26.309439+0000","last_change":"2024-09-14T13:02:26.309439+0000","last_active":"2024-09-14T13:02:26.309439+0000","last_peered":"2024-09-14T13:02:26.309439+0000","last_clean":"2024-09-14T13:02:26.309439+0000","last_became_active":"2024-09-14T11:08:29.828249+0000","last_became_peered":"2024-09-14T11:08:29.828249+0000","last_unstale":"2024-09-14T13:02:26.309439+0000","last_undegraded":"2024-09-14T13:02:26.309439+0000","last_fullsized":"2024-09-14T13:02:26.309439+0000","mapping_epoch":32,"log_start":"267'701","ondisk_log_start":"267'701","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'769","last_scrub_stamp":"2024-09-14T13:02:26.309151+0000","last_deep_scrub":"267'769","last_deep_scrub_stamp":"2024-09-14T13:02:26.309151+0000","last_clean_scrub_stamp":"2024-09-14T13:02:26.309151+0000","objects_scrubbed":1,"log_size":68,"log_dups_size":701,"ondisk_log_size":68,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:10:16.372727+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.2","version":"267'160","reported_seq":702,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:37.660489+0000","last_change":"2024-09-14T13:02:37.660489+0000","last_active":"2024-09-14T13:02:37.660489+0000","last_peered":"2024-09-14T13:02:37.660489+0000","last_clean":"2024-09-14T13:02:37.660489+0000","last_became_active":"2024-09-14T11:08:31.849463+0000","last_became_peered":"2024-09-14T11:08:31.849463+0000","last_unstale":"2024-09-14T13:02:37.660489+0000","last_undegraded":"2024-09-14T13:02:37.660489+0000","last_fullsized":"2024-09-14T13:02:37.660489+0000","mapping_epoch":34,"log_start":"267'100","ondisk_log_start":"267'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'160","last_scrub_stamp":"2024-09-14T13:02:37.660251+0000","last_deep_scrub":"267'160","last_deep_scrub_stamp":"2024-09-14T13:02:37.660251+0000","last_clean_scrub_stamp":"2024-09-14T13:02:37.660251+0000","objects_scrubbed":0,"log_size":60,"log_dups_size":100,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:40:12.598378+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":154,"num_read_kb":144,"num_write":375,"num_write_kb":85,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"267'386","reported_seq":1884,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:16.080785+0000","last_change":"2024-09-14T13:02:16.080785+0000","last_active":"2024-09-14T13:02:16.080785+0000","last_peered":"2024-09-14T13:02:16.080785+0000","last_clean":"2024-09-14T13:02:16.080785+0000","last_became_active":"2024-09-14T11:08:23.783481+0000","last_became_peered":"2024-09-14T11:08:23.783481+0000","last_unstale":"2024-09-14T13:02:16.080785+0000","last_undegraded":"2024-09-14T13:02:16.080785+0000","last_fullsized":"2024-09-14T13:02:16.080785+0000","mapping_epoch":26,"log_start":"267'300","ondisk_log_start":"267'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'386","last_scrub_stamp":"2024-09-14T13:02:16.080562+0000","last_deep_scrub":"267'386","last_deep_scrub_stamp":"2024-09-14T13:02:16.080562+0000","last_clean_scrub_stamp":"2024-09-14T13:02:16.080562+0000","objects_scrubbed":4,"log_size":86,"log_dups_size":300,"ondisk_log_size":86,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:15:42.229866+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":2050,"num_read_kb":1948,"num_write":423,"num_write_kb":74,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"267'177","reported_seq":838,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:09.948319+0000","last_change":"2024-09-14T13:02:09.948319+0000","last_active":"2024-09-14T13:02:09.948319+0000","last_peered":"2024-09-14T13:02:09.948319+0000","last_clean":"2024-09-14T13:02:09.948319+0000","last_became_active":"2024-09-14T11:08:21.786611+0000","last_became_peered":"2024-09-14T11:08:21.786611+0000","last_unstale":"2024-09-14T13:02:09.948319+0000","last_undegraded":"2024-09-14T13:02:09.948319+0000","last_fullsized":"2024-09-14T13:02:09.948319+0000","mapping_epoch":24,"log_start":"267'100","ondisk_log_start":"267'100","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'177","last_scrub_stamp":"2024-09-14T13:02:09.948060+0000","last_deep_scrub":"267'177","last_deep_scrub_stamp":"2024-09-14T13:02:09.948060+0000","last_clean_scrub_stamp":"2024-09-14T13:02:09.948060+0000","objects_scrubbed":4,"log_size":77,"log_dups_size":100,"ondisk_log_size":77,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:07:24.070925+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1655868,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":450,"num_read_kb":66993,"num_write":850,"num_write_kb":21210,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7],"acting":[3,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":539,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:28.665844+0000","last_change":"2024-09-14T13:02:28.665844+0000","last_active":"2024-09-14T13:02:28.665844+0000","last_peered":"2024-09-14T13:02:28.665844+0000","last_clean":"2024-09-14T13:02:28.665844+0000","last_became_active":"2024-09-14T11:08:25.817491+0000","last_became_peered":"2024-09-14T11:08:25.817491+0000","last_unstale":"2024-09-14T13:02:28.665844+0000","last_undegraded":"2024-09-14T13:02:28.665844+0000","last_fullsized":"2024-09-14T13:02:28.665844+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T13:02:28.665658+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T13:02:28.665658+0000","last_clean_scrub_stamp":"2024-09-14T13:02:28.665658+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:11:14.212412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.d","version":"267'303","reported_seq":997,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:35.435272+0000","last_change":"2024-09-14T13:02:35.435272+0000","last_active":"2024-09-14T13:02:35.435272+0000","last_peered":"2024-09-14T13:02:35.435272+0000","last_clean":"2024-09-14T13:02:35.435272+0000","last_became_active":"2024-09-14T11:08:27.829060+0000","last_became_peered":"2024-09-14T11:08:27.829060+0000","last_unstale":"2024-09-14T13:02:35.435272+0000","last_undegraded":"2024-09-14T13:02:35.435272+0000","last_fullsized":"2024-09-14T13:02:35.435272+0000","mapping_epoch":30,"log_start":"267'200","ondisk_log_start":"267'200","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'303","last_scrub_stamp":"2024-09-14T13:02:35.435035+0000","last_deep_scrub":"267'303","last_deep_scrub_stamp":"2024-09-14T13:02:35.435035+0000","last_clean_scrub_stamp":"2024-09-14T13:02:35.435035+0000","objects_scrubbed":8,"log_size":103,"log_dups_size":200,"ondisk_log_size":103,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:25:02.104137+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5925,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":413,"num_read_kb":450,"num_write":250,"num_write_kb":21,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":528,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:25.336986+0000","last_change":"2024-09-14T13:02:25.336986+0000","last_active":"2024-09-14T13:02:25.336986+0000","last_peered":"2024-09-14T13:02:25.336986+0000","last_clean":"2024-09-14T13:02:25.336986+0000","last_became_active":"2024-09-14T11:08:29.844374+0000","last_became_peered":"2024-09-14T11:08:29.844374+0000","last_unstale":"2024-09-14T13:02:25.336986+0000","last_undegraded":"2024-09-14T13:02:25.336986+0000","last_fullsized":"2024-09-14T13:02:25.336986+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T13:02:25.336798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T13:02:25.336798+0000","last_clean_scrub_stamp":"2024-09-14T13:02:25.336798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:12:09.425134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.3","version":"267'107","reported_seq":638,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:35.164813+0000","last_change":"2024-09-14T13:02:35.164813+0000","last_active":"2024-09-14T13:02:35.164813+0000","last_peered":"2024-09-14T13:02:35.164813+0000","last_clean":"2024-09-14T13:02:35.164813+0000","last_became_active":"2024-09-14T11:08:31.835753+0000","last_became_peered":"2024-09-14T11:08:31.835753+0000","last_unstale":"2024-09-14T13:02:35.164813+0000","last_undegraded":"2024-09-14T13:02:35.164813+0000","last_fullsized":"2024-09-14T13:02:35.164813+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'107","last_scrub_stamp":"2024-09-14T13:02:35.164528+0000","last_deep_scrub":"267'107","last_deep_scrub_stamp":"2024-09-14T13:02:35.164528+0000","last_clean_scrub_stamp":"2024-09-14T13:02:35.164528+0000","objects_scrubbed":2,"log_size":107,"log_dups_size":0,"ondisk_log_size":107,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:19:26.483679+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":24,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":102,"num_read_kb":102,"num_write":245,"num_write_kb":60,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"267'868","reported_seq":2554,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:16.363215+0000","last_change":"2024-09-14T13:02:16.363215+0000","last_active":"2024-09-14T13:02:16.363215+0000","last_peered":"2024-09-14T13:02:16.363215+0000","last_clean":"2024-09-14T13:02:16.363215+0000","last_became_active":"2024-09-14T11:08:23.806515+0000","last_became_peered":"2024-09-14T11:08:23.806515+0000","last_unstale":"2024-09-14T13:02:16.363215+0000","last_undegraded":"2024-09-14T13:02:16.363215+0000","last_fullsized":"2024-09-14T13:02:16.363215+0000","mapping_epoch":26,"log_start":"267'800","ondisk_log_start":"267'800","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'868","last_scrub_stamp":"2024-09-14T13:02:16.363033+0000","last_deep_scrub":"267'868","last_deep_scrub_stamp":"2024-09-14T13:02:16.363033+0000","last_clean_scrub_stamp":"2024-09-14T13:02:16.363033+0000","objects_scrubbed":3,"log_size":68,"log_dups_size":800,"ondisk_log_size":68,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:24:22.719515+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":4146,"num_read_kb":3734,"num_write":1154,"num_write_kb":420,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"267'74","reported_seq":665,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:18.632013+0000","last_change":"2024-09-14T13:02:18.631868+0000","last_active":"2024-09-14T13:02:18.632013+0000","last_peered":"2024-09-14T13:02:18.632013+0000","last_clean":"2024-09-14T13:02:18.632013+0000","last_became_active":"2024-09-14T11:08:03.877126+0000","last_became_peered":"2024-09-14T11:08:03.877126+0000","last_unstale":"2024-09-14T13:02:18.632013+0000","last_undegraded":"2024-09-14T13:02:18.632013+0000","last_fullsized":"2024-09-14T13:02:18.632013+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'74","last_scrub_stamp":"2024-09-14T13:02:18.631647+0000","last_deep_scrub":"267'74","last_deep_scrub_stamp":"2024-09-14T13:02:18.631647+0000","last_clean_scrub_stamp":"2024-09-14T13:02:18.631647+0000","objects_scrubbed":2,"log_size":74,"log_dups_size":0,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:28:42.174349+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"267'2","reported_seq":571,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:14.376993+0000","last_change":"2024-09-14T13:02:14.376805+0000","last_active":"2024-09-14T13:02:14.376993+0000","last_peered":"2024-09-14T13:02:14.376993+0000","last_clean":"2024-09-14T13:02:14.376993+0000","last_became_active":"2024-09-14T11:08:08.902043+0000","last_became_peered":"2024-09-14T11:08:08.902043+0000","last_unstale":"2024-09-14T13:02:14.376993+0000","last_undegraded":"2024-09-14T13:02:14.376993+0000","last_fullsized":"2024-09-14T13:02:14.376993+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'2","last_scrub_stamp":"2024-09-14T13:02:14.376621+0000","last_deep_scrub":"267'2","last_deep_scrub_stamp":"2024-09-14T13:02:14.376621+0000","last_clean_scrub_stamp":"2024-09-14T13:02:14.376621+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:25:42.583105+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0.0011624509999999999,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"267'380","reported_seq":1110,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:05.971420+0000","last_change":"2024-09-14T13:02:05.971317+0000","last_active":"2024-09-14T13:02:05.971420+0000","last_peered":"2024-09-14T13:02:05.971420+0000","last_clean":"2024-09-14T13:02:05.971420+0000","last_became_active":"2024-09-14T11:08:21.809523+0000","last_became_peered":"2024-09-14T11:08:21.809523+0000","last_unstale":"2024-09-14T13:02:05.971420+0000","last_undegraded":"2024-09-14T13:02:05.971420+0000","last_fullsized":"2024-09-14T13:02:05.971420+0000","mapping_epoch":24,"log_start":"267'300","ondisk_log_start":"267'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'380","last_scrub_stamp":"2024-09-14T13:02:05.971194+0000","last_deep_scrub":"267'380","last_deep_scrub_stamp":"2024-09-14T13:02:05.971194+0000","last_clean_scrub_stamp":"2024-09-14T13:02:05.971194+0000","objects_scrubbed":3,"log_size":80,"log_dups_size":300,"ondisk_log_size":80,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:17:00.193745+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1030,"num_read_kb":10703,"num_write":1404,"num_write_kb":52429,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,6],"acting":[3,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":543,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:23.664133+0000","last_change":"2024-09-14T13:02:23.663891+0000","last_active":"2024-09-14T13:02:23.664133+0000","last_peered":"2024-09-14T13:02:23.664133+0000","last_clean":"2024-09-14T13:02:23.664133+0000","last_became_active":"2024-09-14T11:08:25.807851+0000","last_became_peered":"2024-09-14T11:08:25.807851+0000","last_unstale":"2024-09-14T13:02:23.664133+0000","last_undegraded":"2024-09-14T13:02:23.664133+0000","last_fullsized":"2024-09-14T13:02:23.664133+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T13:02:23.663676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T13:02:23.663676+0000","last_clean_scrub_stamp":"2024-09-14T13:02:23.663676+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:28:55.570418+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.7","version":"267'355","reported_seq":1113,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:32.410565+0000","last_change":"2024-09-14T13:02:32.410565+0000","last_active":"2024-09-14T13:02:32.410565+0000","last_peered":"2024-09-14T13:02:32.410565+0000","last_clean":"2024-09-14T13:02:32.410565+0000","last_became_active":"2024-09-14T11:08:27.829359+0000","last_became_peered":"2024-09-14T11:08:27.829359+0000","last_unstale":"2024-09-14T13:02:32.410565+0000","last_undegraded":"2024-09-14T13:02:32.410565+0000","last_fullsized":"2024-09-14T13:02:32.410565+0000","mapping_epoch":30,"log_start":"267'300","ondisk_log_start":"267'300","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'355","last_scrub_stamp":"2024-09-14T13:02:32.410352+0000","last_deep_scrub":"267'355","last_deep_scrub_stamp":"2024-09-14T13:02:32.410352+0000","last_clean_scrub_stamp":"2024-09-14T13:02:32.410352+0000","objects_scrubbed":7,"log_size":55,"log_dups_size":300,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:16:03.160630+0000","scrub_duration":19,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":21129,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":651,"num_read_kb":879,"num_write":592,"num_write_kb":412,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":89502,"num_omap_keys":214,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":536,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:33.165625+0000","last_change":"2024-09-14T13:02:33.165625+0000","last_active":"2024-09-14T13:02:33.165625+0000","last_peered":"2024-09-14T13:02:33.165625+0000","last_clean":"2024-09-14T13:02:33.165625+0000","last_became_active":"2024-09-14T11:08:29.826367+0000","last_became_peered":"2024-09-14T11:08:29.826367+0000","last_unstale":"2024-09-14T13:02:33.165625+0000","last_undegraded":"2024-09-14T13:02:33.165625+0000","last_fullsized":"2024-09-14T13:02:33.165625+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T13:02:33.165410+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T13:02:33.165410+0000","last_clean_scrub_stamp":"2024-09-14T13:02:33.165410+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:05:13.270417+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.9","version":"267'214","reported_seq":978,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:32.320694+0000","last_change":"2024-09-14T13:02:32.320694+0000","last_active":"2024-09-14T13:02:32.320694+0000","last_peered":"2024-09-14T13:02:32.320694+0000","last_clean":"2024-09-14T13:02:32.320694+0000","last_became_active":"2024-09-14T11:08:31.848763+0000","last_became_peered":"2024-09-14T11:08:31.848763+0000","last_unstale":"2024-09-14T13:02:32.320694+0000","last_undegraded":"2024-09-14T13:02:32.320694+0000","last_fullsized":"2024-09-14T13:02:32.320694+0000","mapping_epoch":34,"log_start":"267'200","ondisk_log_start":"267'200","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'214","last_scrub_stamp":"2024-09-14T13:02:32.320468+0000","last_deep_scrub":"267'214","last_deep_scrub_stamp":"2024-09-14T13:02:32.320468+0000","last_clean_scrub_stamp":"2024-09-14T13:02:32.320468+0000","objects_scrubbed":2,"log_size":14,"log_dups_size":200,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:25:03.300420+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":408,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":546,"num_read_kb":516,"num_write":465,"num_write_kb":130,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":66,"num_omap_keys":1,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.6","version":"267'599","reported_seq":2285,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:14.132048+0000","last_change":"2024-09-14T13:02:14.132048+0000","last_active":"2024-09-14T13:02:14.132048+0000","last_peered":"2024-09-14T13:02:14.132048+0000","last_clean":"2024-09-14T13:02:14.132048+0000","last_became_active":"2024-09-14T11:08:23.776564+0000","last_became_peered":"2024-09-14T11:08:23.776564+0000","last_unstale":"2024-09-14T13:02:14.132048+0000","last_undegraded":"2024-09-14T13:02:14.132048+0000","last_fullsized":"2024-09-14T13:02:14.132048+0000","mapping_epoch":26,"log_start":"267'500","ondisk_log_start":"267'500","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'599","last_scrub_stamp":"2024-09-14T13:02:14.131858+0000","last_deep_scrub":"267'599","last_deep_scrub_stamp":"2024-09-14T13:02:14.131858+0000","last_clean_scrub_stamp":"2024-09-14T13:02:14.131858+0000","objects_scrubbed":4,"log_size":99,"log_dups_size":500,"ondisk_log_size":99,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:23:37.462516+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":3171,"num_read_kb":2898,"num_write":783,"num_write_kb":298,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":572,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:08.688828+0000","last_change":"2024-09-14T13:02:08.688687+0000","last_active":"2024-09-14T13:02:08.688828+0000","last_peered":"2024-09-14T13:02:08.688828+0000","last_clean":"2024-09-14T13:02:08.688828+0000","last_became_active":"2024-09-14T11:08:08.903386+0000","last_became_peered":"2024-09-14T11:08:08.903386+0000","last_unstale":"2024-09-14T13:02:08.688828+0000","last_undegraded":"2024-09-14T13:02:08.688828+0000","last_fullsized":"2024-09-14T13:02:08.688828+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T13:02:08.688502+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T13:02:08.688502+0000","last_clean_scrub_stamp":"2024-09-14T13:02:08.688502+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:32:18.880899+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0.001192558,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"267'181","reported_seq":880,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:06.030831+0000","last_change":"2024-09-14T13:02:06.030771+0000","last_active":"2024-09-14T13:02:06.030831+0000","last_peered":"2024-09-14T13:02:06.030831+0000","last_clean":"2024-09-14T13:02:06.030831+0000","last_became_active":"2024-09-14T11:08:21.815453+0000","last_became_peered":"2024-09-14T11:08:21.815453+0000","last_unstale":"2024-09-14T13:02:06.030831+0000","last_undegraded":"2024-09-14T13:02:06.030831+0000","last_fullsized":"2024-09-14T13:02:06.030831+0000","mapping_epoch":24,"log_start":"267'100","ondisk_log_start":"267'100","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'181","last_scrub_stamp":"2024-09-14T13:02:06.030660+0000","last_deep_scrub":"267'181","last_deep_scrub_stamp":"2024-09-14T13:02:06.030660+0000","last_clean_scrub_stamp":"2024-09-14T13:02:06.030660+0000","objects_scrubbed":1,"log_size":81,"log_dups_size":100,"ondisk_log_size":81,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:55:29.313268+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":658,"num_read_kb":79122,"num_write":846,"num_write_kb":40267,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,3],"acting":[0,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":539,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:27.534865+0000","last_change":"2024-09-14T13:02:27.534865+0000","last_active":"2024-09-14T13:02:27.534865+0000","last_peered":"2024-09-14T13:02:27.534865+0000","last_clean":"2024-09-14T13:02:27.534865+0000","last_became_active":"2024-09-14T11:08:25.801580+0000","last_became_peered":"2024-09-14T11:08:25.801580+0000","last_unstale":"2024-09-14T13:02:27.534865+0000","last_undegraded":"2024-09-14T13:02:27.534865+0000","last_fullsized":"2024-09-14T13:02:27.534865+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T13:02:27.534688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T13:02:27.534688+0000","last_clean_scrub_stamp":"2024-09-14T13:02:27.534688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:09:54.498168+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.4","version":"267'1028","reported_seq":3392,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:23.001654+0000","last_change":"2024-09-14T13:02:23.001482+0000","last_active":"2024-09-14T13:02:23.001654+0000","last_peered":"2024-09-14T13:02:23.001654+0000","last_clean":"2024-09-14T13:02:23.001654+0000","last_became_active":"2024-09-14T11:08:27.824703+0000","last_became_peered":"2024-09-14T11:08:27.824703+0000","last_unstale":"2024-09-14T13:02:23.001654+0000","last_undegraded":"2024-09-14T13:02:23.001654+0000","last_fullsized":"2024-09-14T13:02:23.001654+0000","mapping_epoch":30,"log_start":"267'1001","ondisk_log_start":"267'1001","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'1028","last_scrub_stamp":"2024-09-14T13:02:23.001258+0000","last_deep_scrub":"267'1028","last_deep_scrub_stamp":"2024-09-14T13:02:23.001258+0000","last_clean_scrub_stamp":"2024-09-14T13:02:23.001258+0000","objects_scrubbed":12,"log_size":27,"log_dups_size":1001,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:43:35.067903+0000","scrub_duration":19,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":21392,"num_objects":12,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":0,"num_read":1365,"num_read_kb":1481,"num_write":500,"num_write_kb":254,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":6238,"num_omap_keys":18,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":534,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:35.596654+0000","last_change":"2024-09-14T13:02:35.596654+0000","last_active":"2024-09-14T13:02:35.596654+0000","last_peered":"2024-09-14T13:02:35.596654+0000","last_clean":"2024-09-14T13:02:35.596654+0000","last_became_active":"2024-09-14T11:08:29.836253+0000","last_became_peered":"2024-09-14T11:08:29.836253+0000","last_unstale":"2024-09-14T13:02:35.596654+0000","last_undegraded":"2024-09-14T13:02:35.596654+0000","last_fullsized":"2024-09-14T13:02:35.596654+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T13:02:35.596481+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T13:02:35.596481+0000","last_clean_scrub_stamp":"2024-09-14T13:02:35.596481+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:59:40.876249+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.a","version":"267'227","reported_seq":794,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:38.235308+0000","last_change":"2024-09-14T13:02:38.235308+0000","last_active":"2024-09-14T13:02:38.235308+0000","last_peered":"2024-09-14T13:02:38.235308+0000","last_clean":"2024-09-14T13:02:38.235308+0000","last_became_active":"2024-09-14T11:08:31.835700+0000","last_became_peered":"2024-09-14T11:08:31.835700+0000","last_unstale":"2024-09-14T13:02:38.235308+0000","last_undegraded":"2024-09-14T13:02:38.235308+0000","last_fullsized":"2024-09-14T13:02:38.235308+0000","mapping_epoch":34,"log_start":"267'200","ondisk_log_start":"267'200","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'227","last_scrub_stamp":"2024-09-14T13:02:38.235116+0000","last_deep_scrub":"267'227","last_deep_scrub_stamp":"2024-09-14T13:02:38.235116+0000","last_clean_scrub_stamp":"2024-09-14T13:02:38.235116+0000","objects_scrubbed":3,"log_size":27,"log_dups_size":200,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:17:45.413646+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":435,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":369,"num_read_kb":358,"num_write":505,"num_write_kb":147,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"267'416","reported_seq":2043,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:12.147021+0000","last_change":"2024-09-14T13:02:12.146837+0000","last_active":"2024-09-14T13:02:12.147021+0000","last_peered":"2024-09-14T13:02:12.147021+0000","last_clean":"2024-09-14T13:02:12.147021+0000","last_became_active":"2024-09-14T11:09:57.243168+0000","last_became_peered":"2024-09-14T11:09:57.243168+0000","last_unstale":"2024-09-14T13:02:12.147021+0000","last_undegraded":"2024-09-14T13:02:12.147021+0000","last_fullsized":"2024-09-14T13:02:12.147021+0000","mapping_epoch":39,"log_start":"267'400","ondisk_log_start":"267'400","created":26,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'416","last_scrub_stamp":"2024-09-14T13:02:12.146640+0000","last_deep_scrub":"267'416","last_deep_scrub_stamp":"2024-09-14T13:02:12.146640+0000","last_clean_scrub_stamp":"2024-09-14T13:02:12.146640+0000","objects_scrubbed":3,"log_size":16,"log_dups_size":400,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:25:54.329360+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2397,"num_read_kb":2278,"num_write":464,"num_write_kb":90,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":883,"num_omap_keys":4,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":573,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:08.071389+0000","last_change":"2024-09-14T13:02:08.071321+0000","last_active":"2024-09-14T13:02:08.071389+0000","last_peered":"2024-09-14T13:02:08.071389+0000","last_clean":"2024-09-14T13:02:08.071389+0000","last_became_active":"2024-09-14T11:08:08.957848+0000","last_became_peered":"2024-09-14T11:08:08.957848+0000","last_unstale":"2024-09-14T13:02:08.071389+0000","last_undegraded":"2024-09-14T13:02:08.071389+0000","last_fullsized":"2024-09-14T13:02:08.071389+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T13:02:08.071230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T13:02:08.071230+0000","last_clean_scrub_stamp":"2024-09-14T13:02:08.071230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:34:22.543760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001143142,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"267'236","reported_seq":928,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:07.066298+0000","last_change":"2024-09-14T13:02:07.066246+0000","last_active":"2024-09-14T13:02:07.066298+0000","last_peered":"2024-09-14T13:02:07.066298+0000","last_clean":"2024-09-14T13:02:07.066298+0000","last_became_active":"2024-09-14T11:08:21.817523+0000","last_became_peered":"2024-09-14T11:08:21.817523+0000","last_unstale":"2024-09-14T13:02:07.066298+0000","last_undegraded":"2024-09-14T13:02:07.066298+0000","last_fullsized":"2024-09-14T13:02:07.066298+0000","mapping_epoch":24,"log_start":"267'200","ondisk_log_start":"267'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'236","last_scrub_stamp":"2024-09-14T13:02:07.066157+0000","last_deep_scrub":"267'236","last_deep_scrub_stamp":"2024-09-14T13:02:07.066157+0000","last_clean_scrub_stamp":"2024-09-14T13:02:07.066157+0000","objects_scrubbed":3,"log_size":36,"log_dups_size":200,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:24:04.875361+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":52,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":630,"num_read_kb":70142,"num_write":1046,"num_write_kb":36042,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,6],"acting":[1,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.6","version":"267'2","reported_seq":545,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:19.144585+0000","last_change":"2024-09-14T13:02:19.144585+0000","last_active":"2024-09-14T13:02:19.144585+0000","last_peered":"2024-09-14T13:02:19.144585+0000","last_clean":"2024-09-14T13:02:19.144585+0000","last_became_active":"2024-09-14T11:08:25.807070+0000","last_became_peered":"2024-09-14T11:08:25.807070+0000","last_unstale":"2024-09-14T13:02:19.144585+0000","last_undegraded":"2024-09-14T13:02:19.144585+0000","last_fullsized":"2024-09-14T13:02:19.144585+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'2","last_scrub_stamp":"2024-09-14T13:02:19.144401+0000","last_deep_scrub":"267'2","last_deep_scrub_stamp":"2024-09-14T13:02:19.144401+0000","last_clean_scrub_stamp":"2024-09-14T13:02:19.144401+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T00:26:33.317334+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.5","version":"267'411","reported_seq":2381,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:30.546803+0000","last_change":"2024-09-14T13:02:30.546803+0000","last_active":"2024-09-14T13:02:30.546803+0000","last_peered":"2024-09-14T13:02:30.546803+0000","last_clean":"2024-09-14T13:02:30.546803+0000","last_became_active":"2024-09-14T11:08:27.830644+0000","last_became_peered":"2024-09-14T11:08:27.830644+0000","last_unstale":"2024-09-14T13:02:30.546803+0000","last_undegraded":"2024-09-14T13:02:30.546803+0000","last_fullsized":"2024-09-14T13:02:30.546803+0000","mapping_epoch":30,"log_start":"267'400","ondisk_log_start":"267'400","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'411","last_scrub_stamp":"2024-09-14T13:02:30.546604+0000","last_deep_scrub":"267'411","last_deep_scrub_stamp":"2024-09-14T13:02:30.546604+0000","last_clean_scrub_stamp":"2024-09-14T13:02:30.546604+0000","objects_scrubbed":9,"log_size":11,"log_dups_size":400,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:45:11.963366+0000","scrub_duration":19,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":154,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":380,"num_read_kb":368,"num_write":375,"num_write_kb":193,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5824,"num_omap_keys":14,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":538,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:31.076368+0000","last_change":"2024-09-14T13:02:31.076368+0000","last_active":"2024-09-14T13:02:31.076368+0000","last_peered":"2024-09-14T13:02:31.076368+0000","last_clean":"2024-09-14T13:02:31.076368+0000","last_became_active":"2024-09-14T11:08:29.801661+0000","last_became_peered":"2024-09-14T11:08:29.801661+0000","last_unstale":"2024-09-14T13:02:31.076368+0000","last_undegraded":"2024-09-14T13:02:31.076368+0000","last_fullsized":"2024-09-14T13:02:31.076368+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T13:02:31.076190+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T13:02:31.076190+0000","last_clean_scrub_stamp":"2024-09-14T13:02:31.076190+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:11:46.287087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.b","version":"267'251","reported_seq":887,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:39.956026+0000","last_change":"2024-09-14T13:02:39.956026+0000","last_active":"2024-09-14T13:02:39.956026+0000","last_peered":"2024-09-14T13:02:39.956026+0000","last_clean":"2024-09-14T13:02:39.956026+0000","last_became_active":"2024-09-14T11:08:31.841552+0000","last_became_peered":"2024-09-14T11:08:31.841552+0000","last_unstale":"2024-09-14T13:02:39.956026+0000","last_undegraded":"2024-09-14T13:02:39.956026+0000","last_fullsized":"2024-09-14T13:02:39.956026+0000","mapping_epoch":34,"log_start":"267'200","ondisk_log_start":"267'200","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'251","last_scrub_stamp":"2024-09-14T13:02:39.955851+0000","last_deep_scrub":"267'251","last_deep_scrub_stamp":"2024-09-14T13:02:39.955851+0000","last_clean_scrub_stamp":"2024-09-14T13:02:39.955851+0000","objects_scrubbed":3,"log_size":51,"log_dups_size":200,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:52:44.174304+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":202,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":474,"num_read_kb":499,"num_write":548,"num_write_kb":158,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1193,"num_omap_keys":7,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"267'1115","reported_seq":2649,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:11.020725+0000","last_change":"2024-09-14T13:02:11.020600+0000","last_active":"2024-09-14T13:02:11.020725+0000","last_peered":"2024-09-14T13:02:11.020725+0000","last_clean":"2024-09-14T13:02:11.020725+0000","last_became_active":"2024-09-14T11:08:23.777511+0000","last_became_peered":"2024-09-14T11:08:23.777511+0000","last_unstale":"2024-09-14T13:02:11.020725+0000","last_undegraded":"2024-09-14T13:02:11.020725+0000","last_fullsized":"2024-09-14T13:02:11.020725+0000","mapping_epoch":26,"log_start":"267'1100","ondisk_log_start":"267'1100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'1115","last_scrub_stamp":"2024-09-14T13:02:11.020381+0000","last_deep_scrub":"267'1115","last_deep_scrub_stamp":"2024-09-14T13:02:11.020381+0000","last_clean_scrub_stamp":"2024-09-14T13:02:11.020381+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":1100,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:18:14.256119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5086,"num_read_kb":4484,"num_write":1533,"num_write_kb":642,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"267'3","reported_seq":572,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:07.256751+0000","last_change":"2024-09-14T13:02:07.256502+0000","last_active":"2024-09-14T13:02:07.256751+0000","last_peered":"2024-09-14T13:02:07.256751+0000","last_clean":"2024-09-14T13:02:07.256751+0000","last_became_active":"2024-09-14T11:08:08.903062+0000","last_became_peered":"2024-09-14T11:08:08.903062+0000","last_unstale":"2024-09-14T13:02:07.256751+0000","last_undegraded":"2024-09-14T13:02:07.256751+0000","last_fullsized":"2024-09-14T13:02:07.256751+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'3","last_scrub_stamp":"2024-09-14T13:02:07.256289+0000","last_deep_scrub":"267'3","last_deep_scrub_stamp":"2024-09-14T13:02:07.256289+0000","last_clean_scrub_stamp":"2024-09-14T13:02:07.256289+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:37:50.637115+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0.0022728420000000002,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"267'181","reported_seq":877,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:06.907138+0000","last_change":"2024-09-14T13:02:06.906936+0000","last_active":"2024-09-14T13:02:06.907138+0000","last_peered":"2024-09-14T13:02:06.907138+0000","last_clean":"2024-09-14T13:02:06.907138+0000","last_became_active":"2024-09-14T11:08:21.823121+0000","last_became_peered":"2024-09-14T11:08:21.823121+0000","last_unstale":"2024-09-14T13:02:06.907138+0000","last_undegraded":"2024-09-14T13:02:06.907138+0000","last_fullsized":"2024-09-14T13:02:06.907138+0000","mapping_epoch":24,"log_start":"267'100","ondisk_log_start":"267'100","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'181","last_scrub_stamp":"2024-09-14T13:02:06.906725+0000","last_deep_scrub":"267'181","last_deep_scrub_stamp":"2024-09-14T13:02:06.906725+0000","last_clean_scrub_stamp":"2024-09-14T13:02:06.906725+0000","objects_scrubbed":2,"log_size":81,"log_dups_size":100,"ondisk_log_size":81,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:55:40.720442+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":28,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":557,"num_read_kb":32204,"num_write":881,"num_write_kb":26671,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,0],"acting":[4,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":546,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:18.094637+0000","last_change":"2024-09-14T13:02:18.094637+0000","last_active":"2024-09-14T13:02:18.094637+0000","last_peered":"2024-09-14T13:02:18.094637+0000","last_clean":"2024-09-14T13:02:18.094637+0000","last_became_active":"2024-09-14T11:08:25.796526+0000","last_became_peered":"2024-09-14T11:08:25.796526+0000","last_unstale":"2024-09-14T13:02:18.094637+0000","last_undegraded":"2024-09-14T13:02:18.094637+0000","last_fullsized":"2024-09-14T13:02:18.094637+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T13:02:18.094441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T13:02:18.094441+0000","last_clean_scrub_stamp":"2024-09-14T13:02:18.094441+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T00:51:13.768814+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.6","version":"267'241","reported_seq":864,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:24.003583+0000","last_change":"2024-09-14T13:02:24.003583+0000","last_active":"2024-09-14T13:02:24.003583+0000","last_peered":"2024-09-14T13:02:24.003583+0000","last_clean":"2024-09-14T13:02:24.003583+0000","last_became_active":"2024-09-14T11:08:27.818482+0000","last_became_peered":"2024-09-14T11:08:27.818482+0000","last_unstale":"2024-09-14T13:02:24.003583+0000","last_undegraded":"2024-09-14T13:02:24.003583+0000","last_fullsized":"2024-09-14T13:02:24.003583+0000","mapping_epoch":30,"log_start":"267'200","ondisk_log_start":"267'200","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'241","last_scrub_stamp":"2024-09-14T13:02:24.003387+0000","last_deep_scrub":"267'241","last_deep_scrub_stamp":"2024-09-14T13:02:24.003387+0000","last_clean_scrub_stamp":"2024-09-14T13:02:24.003387+0000","objects_scrubbed":7,"log_size":41,"log_dups_size":200,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:56:28.318209+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":286,"num_read_kb":275,"num_write":214,"num_write_kb":24,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":3226,"num_omap_keys":10,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":530,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:24.378960+0000","last_change":"2024-09-14T13:02:24.378960+0000","last_active":"2024-09-14T13:02:24.378960+0000","last_peered":"2024-09-14T13:02:24.378960+0000","last_clean":"2024-09-14T13:02:24.378960+0000","last_became_active":"2024-09-14T11:08:29.837840+0000","last_became_peered":"2024-09-14T11:08:29.837840+0000","last_unstale":"2024-09-14T13:02:24.378960+0000","last_undegraded":"2024-09-14T13:02:24.378960+0000","last_fullsized":"2024-09-14T13:02:24.378960+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T13:02:24.378768+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T13:02:24.378768+0000","last_clean_scrub_stamp":"2024-09-14T13:02:24.378768+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:57:41.664294+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.8","version":"267'111","reported_seq":695,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:40.468627+0000","last_change":"2024-09-14T13:02:40.468627+0000","last_active":"2024-09-14T13:02:40.468627+0000","last_peered":"2024-09-14T13:02:40.468627+0000","last_clean":"2024-09-14T13:02:40.468627+0000","last_became_active":"2024-09-14T11:08:31.851269+0000","last_became_peered":"2024-09-14T11:08:31.851269+0000","last_unstale":"2024-09-14T13:02:40.468627+0000","last_undegraded":"2024-09-14T13:02:40.468627+0000","last_fullsized":"2024-09-14T13:02:40.468627+0000","mapping_epoch":34,"log_start":"267'100","ondisk_log_start":"267'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'111","last_scrub_stamp":"2024-09-14T13:02:40.468437+0000","last_deep_scrub":"267'111","last_deep_scrub_stamp":"2024-09-14T13:02:40.468437+0000","last_clean_scrub_stamp":"2024-09-14T13:02:40.468437+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":100,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:28:52.613811+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":188,"num_read_kb":187,"num_write":249,"num_write_kb":58,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"267'520","reported_seq":2240,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:12.995600+0000","last_change":"2024-09-14T13:02:12.995460+0000","last_active":"2024-09-14T13:02:12.995600+0000","last_peered":"2024-09-14T13:02:12.995600+0000","last_clean":"2024-09-14T13:02:12.995600+0000","last_became_active":"2024-09-14T11:08:23.793860+0000","last_became_peered":"2024-09-14T11:08:23.793860+0000","last_unstale":"2024-09-14T13:02:12.995600+0000","last_undegraded":"2024-09-14T13:02:12.995600+0000","last_fullsized":"2024-09-14T13:02:12.995600+0000","mapping_epoch":26,"log_start":"267'500","ondisk_log_start":"267'500","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'520","last_scrub_stamp":"2024-09-14T13:02:12.995266+0000","last_deep_scrub":"267'520","last_deep_scrub_stamp":"2024-09-14T13:02:12.995266+0000","last_clean_scrub_stamp":"2024-09-14T13:02:12.995266+0000","objects_scrubbed":3,"log_size":20,"log_dups_size":500,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:38:13.362386+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3013,"num_read_kb":2819,"num_write":641,"num_write_kb":178,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2808,"num_omap_keys":11,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"267'200","reported_seq":887,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:09.308300+0000","last_change":"2024-09-14T13:02:09.308300+0000","last_active":"2024-09-14T13:02:09.308300+0000","last_peered":"2024-09-14T13:02:09.308300+0000","last_clean":"2024-09-14T13:02:09.308300+0000","last_became_active":"2024-09-14T11:08:21.791679+0000","last_became_peered":"2024-09-14T11:08:21.791679+0000","last_unstale":"2024-09-14T13:02:09.308300+0000","last_undegraded":"2024-09-14T13:02:09.308300+0000","last_fullsized":"2024-09-14T13:02:09.308300+0000","mapping_epoch":24,"log_start":"267'100","ondisk_log_start":"267'100","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'200","last_scrub_stamp":"2024-09-14T13:02:09.308096+0000","last_deep_scrub":"267'200","last_deep_scrub_stamp":"2024-09-14T13:02:09.308096+0000","last_clean_scrub_stamp":"2024-09-14T13:02:09.308096+0000","objects_scrubbed":2,"log_size":100,"log_dups_size":100,"ondisk_log_size":100,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:28:27.126433+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":15,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":647,"num_read_kb":55282,"num_write":902,"num_write_kb":39262,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,2],"acting":[5,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":567,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:06.063398+0000","last_change":"2024-09-14T13:02:06.063313+0000","last_active":"2024-09-14T13:02:06.063398+0000","last_peered":"2024-09-14T13:02:06.063398+0000","last_clean":"2024-09-14T13:02:06.063398+0000","last_became_active":"2024-09-14T11:08:08.888921+0000","last_became_peered":"2024-09-14T11:08:08.888921+0000","last_unstale":"2024-09-14T13:02:06.063398+0000","last_undegraded":"2024-09-14T13:02:06.063398+0000","last_fullsized":"2024-09-14T13:02:06.063398+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T13:02:06.063225+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T13:02:06.063225+0000","last_clean_scrub_stamp":"2024-09-14T13:02:06.063225+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:03:25.698483+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001198714,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":547,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:24.001002+0000","last_change":"2024-09-14T13:02:24.000791+0000","last_active":"2024-09-14T13:02:24.001002+0000","last_peered":"2024-09-14T13:02:24.001002+0000","last_clean":"2024-09-14T13:02:24.001002+0000","last_became_active":"2024-09-14T11:08:25.792863+0000","last_became_peered":"2024-09-14T11:08:25.792863+0000","last_unstale":"2024-09-14T13:02:24.001002+0000","last_undegraded":"2024-09-14T13:02:24.001002+0000","last_fullsized":"2024-09-14T13:02:24.001002+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T13:02:24.000552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T13:02:24.000552+0000","last_clean_scrub_stamp":"2024-09-14T13:02:24.000552+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:23:29.987674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"267'470","reported_seq":1226,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:16.091820+0000","last_change":"2024-09-14T13:02:16.091681+0000","last_active":"2024-09-14T13:02:16.091820+0000","last_peered":"2024-09-14T13:02:16.091820+0000","last_clean":"2024-09-14T13:02:16.091820+0000","last_became_active":"2024-09-14T11:08:27.803324+0000","last_became_peered":"2024-09-14T11:08:27.803324+0000","last_unstale":"2024-09-14T13:02:16.091820+0000","last_undegraded":"2024-09-14T13:02:16.091820+0000","last_fullsized":"2024-09-14T13:02:16.091820+0000","mapping_epoch":30,"log_start":"267'400","ondisk_log_start":"267'400","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'470","last_scrub_stamp":"2024-09-14T13:02:16.091442+0000","last_deep_scrub":"267'470","last_deep_scrub_stamp":"2024-09-14T13:02:16.091442+0000","last_clean_scrub_stamp":"2024-09-14T13:02:16.091442+0000","objects_scrubbed":10,"log_size":70,"log_dups_size":400,"ondisk_log_size":70,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T00:12:22.033953+0000","scrub_duration":31,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19948,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":1305,"num_read_kb":1473,"num_write":1890,"num_write_kb":1660,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":530760,"num_omap_keys":1200,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":535,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:34.718365+0000","last_change":"2024-09-14T13:02:34.718365+0000","last_active":"2024-09-14T13:02:34.718365+0000","last_peered":"2024-09-14T13:02:34.718365+0000","last_clean":"2024-09-14T13:02:34.718365+0000","last_became_active":"2024-09-14T11:08:29.830303+0000","last_became_peered":"2024-09-14T11:08:29.830303+0000","last_unstale":"2024-09-14T13:02:34.718365+0000","last_undegraded":"2024-09-14T13:02:34.718365+0000","last_fullsized":"2024-09-14T13:02:34.718365+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T13:02:34.718186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T13:02:34.718186+0000","last_clean_scrub_stamp":"2024-09-14T13:02:34.718186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:31:11.098882+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.e","version":"267'157","reported_seq":729,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:41.232470+0000","last_change":"2024-09-14T13:02:41.232470+0000","last_active":"2024-09-14T13:02:41.232470+0000","last_peered":"2024-09-14T13:02:41.232470+0000","last_clean":"2024-09-14T13:02:41.232470+0000","last_became_active":"2024-09-14T11:08:31.835335+0000","last_became_peered":"2024-09-14T11:08:31.835335+0000","last_unstale":"2024-09-14T13:02:41.232470+0000","last_undegraded":"2024-09-14T13:02:41.232470+0000","last_fullsized":"2024-09-14T13:02:41.232470+0000","mapping_epoch":34,"log_start":"267'100","ondisk_log_start":"267'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'157","last_scrub_stamp":"2024-09-14T13:02:41.232278+0000","last_deep_scrub":"267'157","last_deep_scrub_stamp":"2024-09-14T13:02:41.232278+0000","last_clean_scrub_stamp":"2024-09-14T13:02:41.232278+0000","objects_scrubbed":4,"log_size":57,"log_dups_size":100,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:37:03.058519+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":736,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":226,"num_read_kb":194,"num_write":381,"num_write_kb":93,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"267'738","reported_seq":2295,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:15.092125+0000","last_change":"2024-09-14T13:02:15.091975+0000","last_active":"2024-09-14T13:02:15.092125+0000","last_peered":"2024-09-14T13:02:15.092125+0000","last_clean":"2024-09-14T13:02:15.092125+0000","last_became_active":"2024-09-14T11:08:23.792144+0000","last_became_peered":"2024-09-14T11:08:23.792144+0000","last_unstale":"2024-09-14T13:02:15.092125+0000","last_undegraded":"2024-09-14T13:02:15.092125+0000","last_fullsized":"2024-09-14T13:02:15.092125+0000","mapping_epoch":26,"log_start":"267'700","ondisk_log_start":"267'700","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'738","last_scrub_stamp":"2024-09-14T13:02:15.091782+0000","last_deep_scrub":"267'738","last_deep_scrub_stamp":"2024-09-14T13:02:15.091782+0000","last_clean_scrub_stamp":"2024-09-14T13:02:15.091782+0000","objects_scrubbed":4,"log_size":38,"log_dups_size":700,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:17:17.576090+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":3573,"num_read_kb":3234,"num_write":954,"num_write_kb":344,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":441,"num_omap_keys":2,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.4","version":"267'263","reported_seq":990,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:09.032812+0000","last_change":"2024-09-14T13:02:09.032643+0000","last_active":"2024-09-14T13:02:09.032812+0000","last_peered":"2024-09-14T13:02:09.032812+0000","last_clean":"2024-09-14T13:02:09.032812+0000","last_became_active":"2024-09-14T11:08:21.808278+0000","last_became_peered":"2024-09-14T11:08:21.808278+0000","last_unstale":"2024-09-14T13:02:09.032812+0000","last_undegraded":"2024-09-14T13:02:09.032812+0000","last_fullsized":"2024-09-14T13:02:09.032812+0000","mapping_epoch":24,"log_start":"267'200","ondisk_log_start":"267'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'263","last_scrub_stamp":"2024-09-14T13:02:09.032409+0000","last_deep_scrub":"267'263","last_deep_scrub_stamp":"2024-09-14T13:02:09.032409+0000","last_clean_scrub_stamp":"2024-09-14T13:02:09.032409+0000","objects_scrubbed":7,"log_size":63,"log_dups_size":200,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:47:10.565844+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":105,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":853,"num_read_kb":29781,"num_write":1322,"num_write_kb":30049,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,6],"acting":[1,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":569,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:11.672021+0000","last_change":"2024-09-14T13:02:11.672021+0000","last_active":"2024-09-14T13:02:11.672021+0000","last_peered":"2024-09-14T13:02:11.672021+0000","last_clean":"2024-09-14T13:02:11.672021+0000","last_became_active":"2024-09-14T11:08:08.903905+0000","last_became_peered":"2024-09-14T11:08:08.903905+0000","last_unstale":"2024-09-14T13:02:11.672021+0000","last_undegraded":"2024-09-14T13:02:11.672021+0000","last_fullsized":"2024-09-14T13:02:11.672021+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T13:02:11.671824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T13:02:11.671824+0000","last_clean_scrub_stamp":"2024-09-14T13:02:11.671824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:19:51.277720+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0.001173377,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":541,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:21.282498+0000","last_change":"2024-09-14T13:02:21.282349+0000","last_active":"2024-09-14T13:02:21.282498+0000","last_peered":"2024-09-14T13:02:21.282498+0000","last_clean":"2024-09-14T13:02:21.282498+0000","last_became_active":"2024-09-14T11:08:25.800695+0000","last_became_peered":"2024-09-14T11:08:25.800695+0000","last_unstale":"2024-09-14T13:02:21.282498+0000","last_undegraded":"2024-09-14T13:02:21.282498+0000","last_fullsized":"2024-09-14T13:02:21.282498+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T13:02:21.282162+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T13:02:21.282162+0000","last_clean_scrub_stamp":"2024-09-14T13:02:21.282162+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:49:39.366357+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1","version":"267'358","reported_seq":1010,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:27.127176+0000","last_change":"2024-09-14T13:02:27.127023+0000","last_active":"2024-09-14T13:02:27.127176+0000","last_peered":"2024-09-14T13:02:27.127176+0000","last_clean":"2024-09-14T13:02:27.127176+0000","last_became_active":"2024-09-14T11:08:27.813857+0000","last_became_peered":"2024-09-14T11:08:27.813857+0000","last_unstale":"2024-09-14T13:02:27.127176+0000","last_undegraded":"2024-09-14T13:02:27.127176+0000","last_fullsized":"2024-09-14T13:02:27.127176+0000","mapping_epoch":30,"log_start":"267'300","ondisk_log_start":"267'300","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'358","last_scrub_stamp":"2024-09-14T13:02:27.126798+0000","last_deep_scrub":"267'358","last_deep_scrub_stamp":"2024-09-14T13:02:27.126798+0000","last_clean_scrub_stamp":"2024-09-14T13:02:27.126798+0000","objects_scrubbed":8,"log_size":58,"log_dups_size":300,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:15:05.419456+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":441,"num_read_kb":434,"num_write":426,"num_write_kb":202,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":6602,"num_omap_keys":16,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.0","version":"267'781","reported_seq":5208,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:37.362655+0000","last_change":"2024-09-14T13:02:37.362504+0000","last_active":"2024-09-14T13:02:37.362655+0000","last_peered":"2024-09-14T13:02:37.362655+0000","last_clean":"2024-09-14T13:02:37.362655+0000","last_became_active":"2024-09-14T11:08:29.823513+0000","last_became_peered":"2024-09-14T11:08:29.823513+0000","last_unstale":"2024-09-14T13:02:37.362655+0000","last_undegraded":"2024-09-14T13:02:37.362655+0000","last_fullsized":"2024-09-14T13:02:37.362655+0000","mapping_epoch":32,"log_start":"267'700","ondisk_log_start":"267'700","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'781","last_scrub_stamp":"2024-09-14T13:02:37.362321+0000","last_deep_scrub":"267'781","last_deep_scrub_stamp":"2024-09-14T13:02:37.362321+0000","last_clean_scrub_stamp":"2024-09-14T13:02:37.362321+0000","objects_scrubbed":1,"log_size":81,"log_dups_size":700,"ondisk_log_size":81,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T00:17:52.989734+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.f","version":"267'153","reported_seq":715,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:40.956648+0000","last_change":"2024-09-14T13:02:40.956648+0000","last_active":"2024-09-14T13:02:40.956648+0000","last_peered":"2024-09-14T13:02:40.956648+0000","last_clean":"2024-09-14T13:02:40.956648+0000","last_became_active":"2024-09-14T11:08:31.825708+0000","last_became_peered":"2024-09-14T11:08:31.825708+0000","last_unstale":"2024-09-14T13:02:40.956648+0000","last_undegraded":"2024-09-14T13:02:40.956648+0000","last_fullsized":"2024-09-14T13:02:40.956648+0000","mapping_epoch":34,"log_start":"267'100","ondisk_log_start":"267'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'153","last_scrub_stamp":"2024-09-14T13:02:40.956472+0000","last_deep_scrub":"267'153","last_deep_scrub_stamp":"2024-09-14T13:02:40.956472+0000","last_clean_scrub_stamp":"2024-09-14T13:02:40.956472+0000","objects_scrubbed":5,"log_size":53,"log_dups_size":100,"ondisk_log_size":53,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:50:35.738734+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1096,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":219,"num_read_kb":197,"num_write":351,"num_write_kb":86,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":64,"num_omap_keys":1,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"267'1023","reported_seq":2917,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:14.881687+0000","last_change":"2024-09-14T13:02:14.881529+0000","last_active":"2024-09-14T13:02:14.881687+0000","last_peered":"2024-09-14T13:02:14.881687+0000","last_clean":"2024-09-14T13:02:14.881687+0000","last_became_active":"2024-09-14T11:08:23.800388+0000","last_became_peered":"2024-09-14T11:08:23.800388+0000","last_unstale":"2024-09-14T13:02:14.881687+0000","last_undegraded":"2024-09-14T13:02:14.881687+0000","last_fullsized":"2024-09-14T13:02:14.881687+0000","mapping_epoch":26,"log_start":"267'1000","ondisk_log_start":"267'1000","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'1023","last_scrub_stamp":"2024-09-14T13:02:14.881346+0000","last_deep_scrub":"267'1023","last_deep_scrub_stamp":"2024-09-14T13:02:14.881346+0000","last_clean_scrub_stamp":"2024-09-14T13:02:14.881346+0000","objects_scrubbed":2,"log_size":23,"log_dups_size":1000,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:35:05.542600+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":5094,"num_read_kb":4556,"num_write":1418,"num_write_kb":544,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2806,"num_omap_keys":11,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.7","version":"267'189","reported_seq":839,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:06.990334+0000","last_change":"2024-09-14T13:02:06.990334+0000","last_active":"2024-09-14T13:02:06.990334+0000","last_peered":"2024-09-14T13:02:06.990334+0000","last_clean":"2024-09-14T13:02:06.990334+0000","last_became_active":"2024-09-14T11:08:21.797297+0000","last_became_peered":"2024-09-14T11:08:21.797297+0000","last_unstale":"2024-09-14T13:02:06.990334+0000","last_undegraded":"2024-09-14T13:02:06.990334+0000","last_fullsized":"2024-09-14T13:02:06.990334+0000","mapping_epoch":24,"log_start":"267'100","ondisk_log_start":"267'100","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'189","last_scrub_stamp":"2024-09-14T13:02:06.990223+0000","last_deep_scrub":"267'189","last_deep_scrub_stamp":"2024-09-14T13:02:06.990223+0000","last_clean_scrub_stamp":"2024-09-14T13:02:06.990223+0000","objects_scrubbed":5,"log_size":89,"log_dups_size":100,"ondisk_log_size":89,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:27:43.594579+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1655854,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":473,"num_read_kb":20434,"num_write":854,"num_write_kb":40195,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,7],"acting":[3,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":565,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:05.019767+0000","last_change":"2024-09-14T13:02:05.019695+0000","last_active":"2024-09-14T13:02:05.019767+0000","last_peered":"2024-09-14T13:02:05.019767+0000","last_clean":"2024-09-14T13:02:05.019767+0000","last_became_active":"2024-09-14T11:08:08.891458+0000","last_became_peered":"2024-09-14T11:08:08.891458+0000","last_unstale":"2024-09-14T13:02:05.019767+0000","last_undegraded":"2024-09-14T13:02:05.019767+0000","last_fullsized":"2024-09-14T13:02:05.019767+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T13:02:05.019605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T13:02:05.019605+0000","last_clean_scrub_stamp":"2024-09-14T13:02:05.019605+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:50:14.780273+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0011468940000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":544,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:25.681738+0000","last_change":"2024-09-14T13:02:25.681456+0000","last_active":"2024-09-14T13:02:25.681738+0000","last_peered":"2024-09-14T13:02:25.681738+0000","last_clean":"2024-09-14T13:02:25.681738+0000","last_became_active":"2024-09-14T11:08:25.807555+0000","last_became_peered":"2024-09-14T11:08:25.807555+0000","last_unstale":"2024-09-14T13:02:25.681738+0000","last_undegraded":"2024-09-14T13:02:25.681738+0000","last_fullsized":"2024-09-14T13:02:25.681738+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T13:02:25.681260+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T13:02:25.681260+0000","last_clean_scrub_stamp":"2024-09-14T13:02:25.681260+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:22:04.765928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.2","version":"267'177","reported_seq":793,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:30.668394+0000","last_change":"2024-09-14T13:02:30.668256+0000","last_active":"2024-09-14T13:02:30.668394+0000","last_peered":"2024-09-14T13:02:30.668394+0000","last_clean":"2024-09-14T13:02:30.668394+0000","last_became_active":"2024-09-14T11:08:27.825292+0000","last_became_peered":"2024-09-14T11:08:27.825292+0000","last_unstale":"2024-09-14T13:02:30.668394+0000","last_undegraded":"2024-09-14T13:02:30.668394+0000","last_fullsized":"2024-09-14T13:02:30.668394+0000","mapping_epoch":30,"log_start":"267'100","ondisk_log_start":"267'100","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'177","last_scrub_stamp":"2024-09-14T13:02:30.668074+0000","last_deep_scrub":"267'177","last_deep_scrub_stamp":"2024-09-14T13:02:30.668074+0000","last_clean_scrub_stamp":"2024-09-14T13:02:30.668074+0000","objects_scrubbed":5,"log_size":77,"log_dups_size":100,"ondisk_log_size":77,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:14:57.106472+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":226,"num_read_kb":221,"num_write":150,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.3","version":"267'816","reported_seq":5543,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:33.937947+0000","last_change":"2024-09-14T13:02:33.937947+0000","last_active":"2024-09-14T13:02:33.937947+0000","last_peered":"2024-09-14T13:02:33.937947+0000","last_clean":"2024-09-14T13:02:33.937947+0000","last_became_active":"2024-09-14T11:08:29.824268+0000","last_became_peered":"2024-09-14T11:08:29.824268+0000","last_unstale":"2024-09-14T13:02:33.937947+0000","last_undegraded":"2024-09-14T13:02:33.937947+0000","last_fullsized":"2024-09-14T13:02:33.937947+0000","mapping_epoch":32,"log_start":"267'801","ondisk_log_start":"267'801","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'816","last_scrub_stamp":"2024-09-14T13:02:33.937760+0000","last_deep_scrub":"267'816","last_deep_scrub_stamp":"2024-09-14T13:02:33.937760+0000","last_clean_scrub_stamp":"2024-09-14T13:02:33.937760+0000","objects_scrubbed":1,"log_size":15,"log_dups_size":801,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:58:03.653512+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.c","version":"267'180","reported_seq":737,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:38.228762+0000","last_change":"2024-09-14T13:02:38.228762+0000","last_active":"2024-09-14T13:02:38.228762+0000","last_peered":"2024-09-14T13:02:38.228762+0000","last_clean":"2024-09-14T13:02:38.228762+0000","last_became_active":"2024-09-14T11:08:31.844329+0000","last_became_peered":"2024-09-14T11:08:31.844329+0000","last_unstale":"2024-09-14T13:02:38.228762+0000","last_undegraded":"2024-09-14T13:02:38.228762+0000","last_fullsized":"2024-09-14T13:02:38.228762+0000","mapping_epoch":34,"log_start":"267'100","ondisk_log_start":"267'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'180","last_scrub_stamp":"2024-09-14T13:02:38.228582+0000","last_deep_scrub":"267'180","last_deep_scrub_stamp":"2024-09-14T13:02:38.228582+0000","last_clean_scrub_stamp":"2024-09-14T13:02:38.228582+0000","objects_scrubbed":3,"log_size":80,"log_dups_size":100,"ondisk_log_size":80,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:27:17.206372+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":58,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":178,"num_read_kb":162,"num_write":419,"num_write_kb":126,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"267'735","reported_seq":2216,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:09.815434+0000","last_change":"2024-09-14T13:02:09.815280+0000","last_active":"2024-09-14T13:02:09.815434+0000","last_peered":"2024-09-14T13:02:09.815434+0000","last_clean":"2024-09-14T13:02:09.815434+0000","last_became_active":"2024-09-14T11:08:23.800918+0000","last_became_peered":"2024-09-14T11:08:23.800918+0000","last_unstale":"2024-09-14T13:02:09.815434+0000","last_undegraded":"2024-09-14T13:02:09.815434+0000","last_fullsized":"2024-09-14T13:02:09.815434+0000","mapping_epoch":26,"log_start":"267'700","ondisk_log_start":"267'700","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'735","last_scrub_stamp":"2024-09-14T13:02:09.814990+0000","last_deep_scrub":"267'735","last_deep_scrub_stamp":"2024-09-14T13:02:09.814990+0000","last_clean_scrub_stamp":"2024-09-14T13:02:09.814990+0000","objects_scrubbed":3,"log_size":35,"log_dups_size":700,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:05:22.080738+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3552,"num_read_kb":3200,"num_write":979,"num_write_kb":380,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":486,"num_omap_keys":2,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"267'264","reported_seq":972,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:06.104313+0000","last_change":"2024-09-14T13:02:06.104313+0000","last_active":"2024-09-14T13:02:06.104313+0000","last_peered":"2024-09-14T13:02:06.104313+0000","last_clean":"2024-09-14T13:02:06.104313+0000","last_became_active":"2024-09-14T11:08:56.034426+0000","last_became_peered":"2024-09-14T11:08:56.034426+0000","last_unstale":"2024-09-14T13:02:06.104313+0000","last_undegraded":"2024-09-14T13:02:06.104313+0000","last_fullsized":"2024-09-14T13:02:06.104313+0000","mapping_epoch":37,"log_start":"267'200","ondisk_log_start":"267'200","created":24,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'264","last_scrub_stamp":"2024-09-14T13:02:06.104156+0000","last_deep_scrub":"267'264","last_deep_scrub_stamp":"2024-09-14T13:02:06.104156+0000","last_clean_scrub_stamp":"2024-09-14T13:02:06.104156+0000","objects_scrubbed":7,"log_size":64,"log_dups_size":200,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:07:23.324457+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3311697,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":736,"num_read_kb":100890,"num_write":1101,"num_write_kb":33821,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,4],"acting":[2,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":566,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:08.217198+0000","last_change":"2024-09-14T13:02:08.216964+0000","last_active":"2024-09-14T13:02:08.217198+0000","last_peered":"2024-09-14T13:02:08.217198+0000","last_clean":"2024-09-14T13:02:08.217198+0000","last_became_active":"2024-09-14T11:08:08.905736+0000","last_became_peered":"2024-09-14T11:08:08.905736+0000","last_unstale":"2024-09-14T13:02:08.217198+0000","last_undegraded":"2024-09-14T13:02:08.217198+0000","last_fullsized":"2024-09-14T13:02:08.217198+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T13:02:08.216677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T13:02:08.216677+0000","last_clean_scrub_stamp":"2024-09-14T13:02:08.216677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:51:29.945091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0012835290000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":544,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:25.925375+0000","last_change":"2024-09-14T13:02:25.925119+0000","last_active":"2024-09-14T13:02:25.925375+0000","last_peered":"2024-09-14T13:02:25.925375+0000","last_clean":"2024-09-14T13:02:25.925375+0000","last_became_active":"2024-09-14T11:08:25.801554+0000","last_became_peered":"2024-09-14T11:08:25.801554+0000","last_unstale":"2024-09-14T13:02:25.925375+0000","last_undegraded":"2024-09-14T13:02:25.925375+0000","last_fullsized":"2024-09-14T13:02:25.925375+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T13:02:25.924863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T13:02:25.924863+0000","last_clean_scrub_stamp":"2024-09-14T13:02:25.924863+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T00:42:52.335794+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"267'409","reported_seq":1207,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:29.568207+0000","last_change":"2024-09-14T13:02:29.567953+0000","last_active":"2024-09-14T13:02:29.568207+0000","last_peered":"2024-09-14T13:02:29.568207+0000","last_clean":"2024-09-14T13:02:29.568207+0000","last_became_active":"2024-09-14T11:08:27.831653+0000","last_became_peered":"2024-09-14T11:08:27.831653+0000","last_unstale":"2024-09-14T13:02:29.568207+0000","last_undegraded":"2024-09-14T13:02:29.568207+0000","last_fullsized":"2024-09-14T13:02:29.568207+0000","mapping_epoch":30,"log_start":"267'300","ondisk_log_start":"267'300","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'409","last_scrub_stamp":"2024-09-14T13:02:29.567699+0000","last_deep_scrub":"267'409","last_deep_scrub_stamp":"2024-09-14T13:02:29.567699+0000","last_clean_scrub_stamp":"2024-09-14T13:02:29.567699+0000","objects_scrubbed":8,"log_size":109,"log_dups_size":300,"ondisk_log_size":109,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:06:18.264597+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":31170,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":610,"num_read_kb":890,"num_write":340,"num_write_kb":94,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":533,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:36.969400+0000","last_change":"2024-09-14T13:02:36.969400+0000","last_active":"2024-09-14T13:02:36.969400+0000","last_peered":"2024-09-14T13:02:36.969400+0000","last_clean":"2024-09-14T13:02:36.969400+0000","last_became_active":"2024-09-14T11:08:29.825186+0000","last_became_peered":"2024-09-14T11:08:29.825186+0000","last_unstale":"2024-09-14T13:02:36.969400+0000","last_undegraded":"2024-09-14T13:02:36.969400+0000","last_fullsized":"2024-09-14T13:02:36.969400+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T13:02:36.969177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T13:02:36.969177+0000","last_clean_scrub_stamp":"2024-09-14T13:02:36.969177+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:08:28.903024+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.d","version":"267'140","reported_seq":673,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:41.427667+0000","last_change":"2024-09-14T13:02:41.427667+0000","last_active":"2024-09-14T13:02:41.427667+0000","last_peered":"2024-09-14T13:02:41.427667+0000","last_clean":"2024-09-14T13:02:41.427667+0000","last_became_active":"2024-09-14T11:08:31.837649+0000","last_became_peered":"2024-09-14T11:08:31.837649+0000","last_unstale":"2024-09-14T13:02:41.427667+0000","last_undegraded":"2024-09-14T13:02:41.427667+0000","last_fullsized":"2024-09-14T13:02:41.427667+0000","mapping_epoch":34,"log_start":"267'100","ondisk_log_start":"267'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'140","last_scrub_stamp":"2024-09-14T13:02:41.427470+0000","last_deep_scrub":"267'140","last_deep_scrub_stamp":"2024-09-14T13:02:41.427470+0000","last_clean_scrub_stamp":"2024-09-14T13:02:41.427470+0000","objects_scrubbed":2,"log_size":40,"log_dups_size":100,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:26:46.091468+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":204,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":124,"num_read_kb":124,"num_write":321,"num_write_kb":75,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.1f","version":"267'142","reported_seq":742,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:52.150540+0000","last_change":"2024-09-14T13:02:52.150540+0000","last_active":"2024-09-14T13:02:52.150540+0000","last_peered":"2024-09-14T13:02:52.150540+0000","last_clean":"2024-09-14T13:02:52.150540+0000","last_became_active":"2024-09-14T11:08:31.849681+0000","last_became_peered":"2024-09-14T11:08:31.849681+0000","last_unstale":"2024-09-14T13:02:52.150540+0000","last_undegraded":"2024-09-14T13:02:52.150540+0000","last_fullsized":"2024-09-14T13:02:52.150540+0000","mapping_epoch":34,"log_start":"267'100","ondisk_log_start":"267'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'142","last_scrub_stamp":"2024-09-14T13:02:52.150365+0000","last_deep_scrub":"267'142","last_deep_scrub_stamp":"2024-09-14T13:02:52.150365+0000","last_clean_scrub_stamp":"2024-09-14T13:02:52.150365+0000","objects_scrubbed":1,"log_size":42,"log_dups_size":100,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:25:06.705605+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":202,"num_read_kb":202,"num_write":327,"num_write_kb":74,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.13","version":"267'451","reported_seq":2159,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:15.813156+0000","last_change":"2024-09-14T13:02:15.812885+0000","last_active":"2024-09-14T13:02:15.813156+0000","last_peered":"2024-09-14T13:02:15.813156+0000","last_clean":"2024-09-14T13:02:15.813156+0000","last_became_active":"2024-09-14T11:08:23.806746+0000","last_became_peered":"2024-09-14T11:08:23.806746+0000","last_unstale":"2024-09-14T13:02:15.813156+0000","last_undegraded":"2024-09-14T13:02:15.813156+0000","last_fullsized":"2024-09-14T13:02:15.813156+0000","mapping_epoch":26,"log_start":"267'400","ondisk_log_start":"267'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'451","last_scrub_stamp":"2024-09-14T13:02:15.812664+0000","last_deep_scrub":"267'451","last_deep_scrub_stamp":"2024-09-14T13:02:15.812664+0000","last_clean_scrub_stamp":"2024-09-14T13:02:15.812664+0000","objects_scrubbed":1,"log_size":51,"log_dups_size":400,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:52:30.280885+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2482,"num_read_kb":2367,"num_write":499,"num_write_kb":86,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.14","version":"267'194","reported_seq":825,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:09.119934+0000","last_change":"2024-09-14T13:02:09.119934+0000","last_active":"2024-09-14T13:02:09.119934+0000","last_peered":"2024-09-14T13:02:09.119934+0000","last_clean":"2024-09-14T13:02:09.119934+0000","last_became_active":"2024-09-14T11:08:56.028924+0000","last_became_peered":"2024-09-14T11:08:56.028924+0000","last_unstale":"2024-09-14T13:02:09.119934+0000","last_undegraded":"2024-09-14T13:02:09.119934+0000","last_fullsized":"2024-09-14T13:02:09.119934+0000","mapping_epoch":37,"log_start":"267'100","ondisk_log_start":"267'100","created":24,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'194","last_scrub_stamp":"2024-09-14T13:02:09.119711+0000","last_deep_scrub":"267'194","last_deep_scrub_stamp":"2024-09-14T13:02:09.119711+0000","last_clean_scrub_stamp":"2024-09-14T13:02:09.119711+0000","objects_scrubbed":2,"log_size":94,"log_dups_size":100,"ondisk_log_size":94,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:09:44.743814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":18,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":488,"num_read_kb":9162,"num_write":891,"num_write_kb":17219,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7,6],"acting":[2,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":534,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:20.978730+0000","last_change":"2024-09-14T13:02:20.978556+0000","last_active":"2024-09-14T13:02:20.978730+0000","last_peered":"2024-09-14T13:02:20.978730+0000","last_clean":"2024-09-14T13:02:20.978730+0000","last_became_active":"2024-09-14T11:08:25.806778+0000","last_became_peered":"2024-09-14T11:08:25.806778+0000","last_unstale":"2024-09-14T13:02:20.978730+0000","last_undegraded":"2024-09-14T13:02:20.978730+0000","last_fullsized":"2024-09-14T13:02:20.978730+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T13:02:20.978330+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T13:02:20.978330+0000","last_clean_scrub_stamp":"2024-09-14T13:02:20.978330+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:00:46.172903+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.11","version":"267'198","reported_seq":839,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:34.969205+0000","last_change":"2024-09-14T13:02:34.968968+0000","last_active":"2024-09-14T13:02:34.969205+0000","last_peered":"2024-09-14T13:02:34.969205+0000","last_clean":"2024-09-14T13:02:34.969205+0000","last_became_active":"2024-09-14T11:08:27.802742+0000","last_became_peered":"2024-09-14T11:08:27.802742+0000","last_unstale":"2024-09-14T13:02:34.969205+0000","last_undegraded":"2024-09-14T13:02:34.969205+0000","last_fullsized":"2024-09-14T13:02:34.969205+0000","mapping_epoch":30,"log_start":"264'100","ondisk_log_start":"264'100","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'198","last_scrub_stamp":"2024-09-14T13:02:34.968678+0000","last_deep_scrub":"267'198","last_deep_scrub_stamp":"2024-09-14T13:02:34.968678+0000","last_clean_scrub_stamp":"2024-09-14T13:02:34.968678+0000","objects_scrubbed":5,"log_size":98,"log_dups_size":100,"ondisk_log_size":98,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:20:44.413916+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":14583,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":266,"num_read_kb":357,"num_write":152,"num_write_kb":28,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":528,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:37.929603+0000","last_change":"2024-09-14T13:02:37.929447+0000","last_active":"2024-09-14T13:02:37.929603+0000","last_peered":"2024-09-14T13:02:37.929603+0000","last_clean":"2024-09-14T13:02:37.929603+0000","last_became_active":"2024-09-14T11:08:29.832866+0000","last_became_peered":"2024-09-14T11:08:29.832866+0000","last_unstale":"2024-09-14T13:02:37.929603+0000","last_undegraded":"2024-09-14T13:02:37.929603+0000","last_fullsized":"2024-09-14T13:02:37.929603+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T13:02:37.929269+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T13:02:37.929269+0000","last_clean_scrub_stamp":"2024-09-14T13:02:37.929269+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:25:25.066701+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1e","version":"267'155","reported_seq":743,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:47.900102+0000","last_change":"2024-09-14T13:02:47.899820+0000","last_active":"2024-09-14T13:02:47.900102+0000","last_peered":"2024-09-14T13:02:47.900102+0000","last_clean":"2024-09-14T13:02:47.900102+0000","last_became_active":"2024-09-14T11:08:31.837431+0000","last_became_peered":"2024-09-14T11:08:31.837431+0000","last_unstale":"2024-09-14T13:02:47.900102+0000","last_undegraded":"2024-09-14T13:02:47.900102+0000","last_fullsized":"2024-09-14T13:02:47.900102+0000","mapping_epoch":34,"log_start":"267'100","ondisk_log_start":"267'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'155","last_scrub_stamp":"2024-09-14T13:02:47.899599+0000","last_deep_scrub":"267'155","last_deep_scrub_stamp":"2024-09-14T13:02:47.899599+0000","last_clean_scrub_stamp":"2024-09-14T13:02:47.899599+0000","objects_scrubbed":2,"log_size":55,"log_dups_size":100,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:37:50.930383+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":449,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":316,"num_read_kb":262,"num_write":344,"num_write_kb":81,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.12","version":"267'845","reported_seq":2499,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:17.107014+0000","last_change":"2024-09-14T13:02:17.106870+0000","last_active":"2024-09-14T13:02:17.107014+0000","last_peered":"2024-09-14T13:02:17.107014+0000","last_clean":"2024-09-14T13:02:17.107014+0000","last_became_active":"2024-09-14T11:08:23.805773+0000","last_became_peered":"2024-09-14T11:08:23.805773+0000","last_unstale":"2024-09-14T13:02:17.107014+0000","last_undegraded":"2024-09-14T13:02:17.107014+0000","last_fullsized":"2024-09-14T13:02:17.107014+0000","mapping_epoch":26,"log_start":"267'800","ondisk_log_start":"267'800","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'845","last_scrub_stamp":"2024-09-14T13:02:17.106695+0000","last_deep_scrub":"267'845","last_deep_scrub_stamp":"2024-09-14T13:02:17.106695+0000","last_clean_scrub_stamp":"2024-09-14T13:02:17.106695+0000","objects_scrubbed":3,"log_size":45,"log_dups_size":800,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:00:08.155637+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":4345,"num_read_kb":3935,"num_write":1136,"num_write_kb":447,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2810,"num_omap_keys":11,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"267'286","reported_seq":1007,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:14.595357+0000","last_change":"2024-09-14T13:02:14.595357+0000","last_active":"2024-09-14T13:02:14.595357+0000","last_peered":"2024-09-14T13:02:14.595357+0000","last_clean":"2024-09-14T13:02:14.595357+0000","last_became_active":"2024-09-14T11:08:21.829412+0000","last_became_peered":"2024-09-14T11:08:21.829412+0000","last_unstale":"2024-09-14T13:02:14.595357+0000","last_undegraded":"2024-09-14T13:02:14.595357+0000","last_fullsized":"2024-09-14T13:02:14.595357+0000","mapping_epoch":24,"log_start":"267'200","ondisk_log_start":"267'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'286","last_scrub_stamp":"2024-09-14T13:02:14.595126+0000","last_deep_scrub":"267'286","last_deep_scrub_stamp":"2024-09-14T13:02:14.595126+0000","last_clean_scrub_stamp":"2024-09-14T13:02:14.595126+0000","objects_scrubbed":3,"log_size":86,"log_dups_size":200,"ondisk_log_size":86,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T00:09:31.251389+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":54,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":846,"num_read_kb":41720,"num_write":1221,"num_write_kb":52852,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,6],"acting":[7,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":536,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:27.980775+0000","last_change":"2024-09-14T13:02:27.980640+0000","last_active":"2024-09-14T13:02:27.980775+0000","last_peered":"2024-09-14T13:02:27.980775+0000","last_clean":"2024-09-14T13:02:27.980775+0000","last_became_active":"2024-09-14T11:08:25.799473+0000","last_became_peered":"2024-09-14T11:08:25.799473+0000","last_unstale":"2024-09-14T13:02:27.980775+0000","last_undegraded":"2024-09-14T13:02:27.980775+0000","last_fullsized":"2024-09-14T13:02:27.980775+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T13:02:27.980463+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T13:02:27.980463+0000","last_clean_scrub_stamp":"2024-09-14T13:02:27.980463+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:37:30.104380+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"267'96","reported_seq":657,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:24.968369+0000","last_change":"2024-09-14T13:02:24.968219+0000","last_active":"2024-09-14T13:02:24.968369+0000","last_peered":"2024-09-14T13:02:24.968369+0000","last_clean":"2024-09-14T13:02:24.968369+0000","last_became_active":"2024-09-14T11:08:27.822933+0000","last_became_peered":"2024-09-14T11:08:27.822933+0000","last_unstale":"2024-09-14T13:02:24.968369+0000","last_undegraded":"2024-09-14T13:02:24.968369+0000","last_fullsized":"2024-09-14T13:02:24.968369+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'96","last_scrub_stamp":"2024-09-14T13:02:24.968008+0000","last_deep_scrub":"267'96","last_deep_scrub_stamp":"2024-09-14T13:02:24.968008+0000","last_clean_scrub_stamp":"2024-09-14T13:02:24.968008+0000","objects_scrubbed":3,"log_size":96,"log_dups_size":0,"ondisk_log_size":96,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:09:28.512920+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":83,"num_read_kb":77,"num_write":62,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":588,"num_omap_keys":4,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":529,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:36.558623+0000","last_change":"2024-09-14T13:02:36.558460+0000","last_active":"2024-09-14T13:02:36.558623+0000","last_peered":"2024-09-14T13:02:36.558623+0000","last_clean":"2024-09-14T13:02:36.558623+0000","last_became_active":"2024-09-14T11:08:29.838784+0000","last_became_peered":"2024-09-14T11:08:29.838784+0000","last_unstale":"2024-09-14T13:02:36.558623+0000","last_undegraded":"2024-09-14T13:02:36.558623+0000","last_fullsized":"2024-09-14T13:02:36.558623+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T13:02:36.558284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T13:02:36.558284+0000","last_clean_scrub_stamp":"2024-09-14T13:02:36.558284+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:39:19.014441+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1d","version":"267'174","reported_seq":731,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:40.198504+0000","last_change":"2024-09-14T13:02:40.198504+0000","last_active":"2024-09-14T13:02:40.198504+0000","last_peered":"2024-09-14T13:02:40.198504+0000","last_clean":"2024-09-14T13:02:40.198504+0000","last_became_active":"2024-09-14T11:08:31.835061+0000","last_became_peered":"2024-09-14T11:08:31.835061+0000","last_unstale":"2024-09-14T13:02:40.198504+0000","last_undegraded":"2024-09-14T13:02:40.198504+0000","last_fullsized":"2024-09-14T13:02:40.198504+0000","mapping_epoch":34,"log_start":"267'100","ondisk_log_start":"267'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'174","last_scrub_stamp":"2024-09-14T13:02:40.198316+0000","last_deep_scrub":"267'174","last_deep_scrub_stamp":"2024-09-14T13:02:40.198316+0000","last_clean_scrub_stamp":"2024-09-14T13:02:40.198316+0000","objects_scrubbed":1,"log_size":74,"log_dups_size":100,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:26:48.833442+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":257,"num_read_kb":254,"num_write":377,"num_write_kb":108,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":398,"num_omap_keys":2,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"267'375","reported_seq":1950,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:16.881500+0000","last_change":"2024-09-14T13:02:16.881362+0000","last_active":"2024-09-14T13:02:16.881500+0000","last_peered":"2024-09-14T13:02:16.881500+0000","last_clean":"2024-09-14T13:02:16.881500+0000","last_became_active":"2024-09-14T11:08:23.803793+0000","last_became_peered":"2024-09-14T11:08:23.803793+0000","last_unstale":"2024-09-14T13:02:16.881500+0000","last_undegraded":"2024-09-14T13:02:16.881500+0000","last_fullsized":"2024-09-14T13:02:16.881500+0000","mapping_epoch":26,"log_start":"267'300","ondisk_log_start":"267'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'375","last_scrub_stamp":"2024-09-14T13:02:16.881154+0000","last_deep_scrub":"267'375","last_deep_scrub_stamp":"2024-09-14T13:02:16.881154+0000","last_clean_scrub_stamp":"2024-09-14T13:02:16.881154+0000","objects_scrubbed":4,"log_size":75,"log_dups_size":300,"ondisk_log_size":75,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:09:51.952201+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":2158,"num_read_kb":2067,"num_write":426,"num_write_kb":77,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"267'203","reported_seq":861,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:08.282770+0000","last_change":"2024-09-14T13:02:08.282770+0000","last_active":"2024-09-14T13:02:08.282770+0000","last_peered":"2024-09-14T13:02:08.282770+0000","last_clean":"2024-09-14T13:02:08.282770+0000","last_became_active":"2024-09-14T11:08:21.796544+0000","last_became_peered":"2024-09-14T11:08:21.796544+0000","last_unstale":"2024-09-14T13:02:08.282770+0000","last_undegraded":"2024-09-14T13:02:08.282770+0000","last_fullsized":"2024-09-14T13:02:08.282770+0000","mapping_epoch":24,"log_start":"267'100","ondisk_log_start":"267'100","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'203","last_scrub_stamp":"2024-09-14T13:02:08.282561+0000","last_deep_scrub":"267'203","last_deep_scrub_stamp":"2024-09-14T13:02:08.282561+0000","last_clean_scrub_stamp":"2024-09-14T13:02:08.282561+0000","objects_scrubbed":1,"log_size":103,"log_dups_size":100,"ondisk_log_size":103,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:48:38.983992+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":13,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":507,"num_read_kb":19523,"num_write":848,"num_write_kb":34711,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,1],"acting":[5,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":537,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:27.542650+0000","last_change":"2024-09-14T13:02:27.542469+0000","last_active":"2024-09-14T13:02:27.542650+0000","last_peered":"2024-09-14T13:02:27.542650+0000","last_clean":"2024-09-14T13:02:27.542650+0000","last_became_active":"2024-09-14T11:08:25.812065+0000","last_became_peered":"2024-09-14T11:08:25.812065+0000","last_unstale":"2024-09-14T13:02:27.542650+0000","last_undegraded":"2024-09-14T13:02:27.542650+0000","last_fullsized":"2024-09-14T13:02:27.542650+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T13:02:27.542288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T13:02:27.542288+0000","last_clean_scrub_stamp":"2024-09-14T13:02:27.542288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T00:32:03.908244+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.13","version":"267'230","reported_seq":887,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:30.906904+0000","last_change":"2024-09-14T13:02:30.906643+0000","last_active":"2024-09-14T13:02:30.906904+0000","last_peered":"2024-09-14T13:02:30.906904+0000","last_clean":"2024-09-14T13:02:30.906904+0000","last_became_active":"2024-09-14T11:08:27.803857+0000","last_became_peered":"2024-09-14T11:08:27.803857+0000","last_unstale":"2024-09-14T13:02:30.906904+0000","last_undegraded":"2024-09-14T13:02:30.906904+0000","last_fullsized":"2024-09-14T13:02:30.906904+0000","mapping_epoch":30,"log_start":"267'200","ondisk_log_start":"267'200","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'230","last_scrub_stamp":"2024-09-14T13:02:30.906416+0000","last_deep_scrub":"267'230","last_deep_scrub_stamp":"2024-09-14T13:02:30.906416+0000","last_clean_scrub_stamp":"2024-09-14T13:02:30.906416+0000","objects_scrubbed":5,"log_size":30,"log_dups_size":200,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:44:09.351180+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":20297,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":321,"num_read_kb":447,"num_write":190,"num_write_kb":46,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":527,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:27.266099+0000","last_change":"2024-09-14T13:02:27.265918+0000","last_active":"2024-09-14T13:02:27.266099+0000","last_peered":"2024-09-14T13:02:27.266099+0000","last_clean":"2024-09-14T13:02:27.266099+0000","last_became_active":"2024-09-14T11:08:29.830498+0000","last_became_peered":"2024-09-14T11:08:29.830498+0000","last_unstale":"2024-09-14T13:02:27.266099+0000","last_undegraded":"2024-09-14T13:02:27.266099+0000","last_fullsized":"2024-09-14T13:02:27.266099+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T13:02:27.265738+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T13:02:27.265738+0000","last_clean_scrub_stamp":"2024-09-14T13:02:27.265738+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:07:09.501488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.1c","version":"267'126","reported_seq":674,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:44.338425+0000","last_change":"2024-09-14T13:02:44.338425+0000","last_active":"2024-09-14T13:02:44.338425+0000","last_peered":"2024-09-14T13:02:44.338425+0000","last_clean":"2024-09-14T13:02:44.338425+0000","last_became_active":"2024-09-14T11:08:31.829826+0000","last_became_peered":"2024-09-14T11:08:31.829826+0000","last_unstale":"2024-09-14T13:02:44.338425+0000","last_undegraded":"2024-09-14T13:02:44.338425+0000","last_fullsized":"2024-09-14T13:02:44.338425+0000","mapping_epoch":34,"log_start":"267'100","ondisk_log_start":"267'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'126","last_scrub_stamp":"2024-09-14T13:02:44.338238+0000","last_deep_scrub":"267'126","last_deep_scrub_stamp":"2024-09-14T13:02:44.338238+0000","last_clean_scrub_stamp":"2024-09-14T13:02:44.338238+0000","objects_scrubbed":3,"log_size":26,"log_dups_size":100,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:33:04.317217+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":861,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":146,"num_read_kb":140,"num_write":284,"num_write_kb":67,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"267'867","reported_seq":2542,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:15.874662+0000","last_change":"2024-09-14T13:02:15.874501+0000","last_active":"2024-09-14T13:02:15.874662+0000","last_peered":"2024-09-14T13:02:15.874662+0000","last_clean":"2024-09-14T13:02:15.874662+0000","last_became_active":"2024-09-14T11:08:23.781565+0000","last_became_peered":"2024-09-14T11:08:23.781565+0000","last_unstale":"2024-09-14T13:02:15.874662+0000","last_undegraded":"2024-09-14T13:02:15.874662+0000","last_fullsized":"2024-09-14T13:02:15.874662+0000","mapping_epoch":26,"log_start":"267'800","ondisk_log_start":"267'800","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'867","last_scrub_stamp":"2024-09-14T13:02:15.874297+0000","last_deep_scrub":"267'867","last_deep_scrub_stamp":"2024-09-14T13:02:15.874297+0000","last_clean_scrub_stamp":"2024-09-14T13:02:15.874297+0000","objects_scrubbed":2,"log_size":67,"log_dups_size":800,"ondisk_log_size":67,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:44:25.802335+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":4353,"num_read_kb":3923,"num_write":1159,"num_write_kb":442,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1857,"num_omap_keys":8,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"267'273","reported_seq":958,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:09.085166+0000","last_change":"2024-09-14T13:02:09.085166+0000","last_active":"2024-09-14T13:02:09.085166+0000","last_peered":"2024-09-14T13:02:09.085166+0000","last_clean":"2024-09-14T13:02:09.085166+0000","last_became_active":"2024-09-14T11:08:21.780624+0000","last_became_peered":"2024-09-14T11:08:21.780624+0000","last_unstale":"2024-09-14T13:02:09.085166+0000","last_undegraded":"2024-09-14T13:02:09.085166+0000","last_fullsized":"2024-09-14T13:02:09.085166+0000","mapping_epoch":24,"log_start":"267'200","ondisk_log_start":"267'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'273","last_scrub_stamp":"2024-09-14T13:02:09.084972+0000","last_deep_scrub":"267'273","last_deep_scrub_stamp":"2024-09-14T13:02:09.084972+0000","last_clean_scrub_stamp":"2024-09-14T13:02:09.084972+0000","objects_scrubbed":1,"log_size":73,"log_dups_size":200,"ondisk_log_size":73,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:52:41.240236+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":15,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":687,"num_read_kb":19614,"num_write":1225,"num_write_kb":48256,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,3],"acting":[0,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":535,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:19.319200+0000","last_change":"2024-09-14T13:02:19.319030+0000","last_active":"2024-09-14T13:02:19.319200+0000","last_peered":"2024-09-14T13:02:19.319200+0000","last_clean":"2024-09-14T13:02:19.319200+0000","last_became_active":"2024-09-14T11:08:25.812705+0000","last_became_peered":"2024-09-14T11:08:25.812705+0000","last_unstale":"2024-09-14T13:02:19.319200+0000","last_undegraded":"2024-09-14T13:02:19.319200+0000","last_fullsized":"2024-09-14T13:02:19.319200+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T13:02:19.318859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T13:02:19.318859+0000","last_clean_scrub_stamp":"2024-09-14T13:02:19.318859+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:53:09.845136+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.12","version":"267'173","reported_seq":803,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:32.553092+0000","last_change":"2024-09-14T13:02:32.552951+0000","last_active":"2024-09-14T13:02:32.553092+0000","last_peered":"2024-09-14T13:02:32.553092+0000","last_clean":"2024-09-14T13:02:32.553092+0000","last_became_active":"2024-09-14T11:08:27.828095+0000","last_became_peered":"2024-09-14T11:08:27.828095+0000","last_unstale":"2024-09-14T13:02:32.553092+0000","last_undegraded":"2024-09-14T13:02:32.553092+0000","last_fullsized":"2024-09-14T13:02:32.553092+0000","mapping_epoch":30,"log_start":"267'100","ondisk_log_start":"267'100","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'173","last_scrub_stamp":"2024-09-14T13:02:32.552754+0000","last_deep_scrub":"267'173","last_deep_scrub_stamp":"2024-09-14T13:02:32.552754+0000","last_clean_scrub_stamp":"2024-09-14T13:02:32.552754+0000","objects_scrubbed":4,"log_size":73,"log_dups_size":100,"ondisk_log_size":73,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:22:22.288640+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8744,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":225,"num_read_kb":285,"num_write":126,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":533,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:32.119040+0000","last_change":"2024-09-14T13:02:32.118767+0000","last_active":"2024-09-14T13:02:32.119040+0000","last_peered":"2024-09-14T13:02:32.119040+0000","last_clean":"2024-09-14T13:02:32.119040+0000","last_became_active":"2024-09-14T11:08:29.820211+0000","last_became_peered":"2024-09-14T11:08:29.820211+0000","last_unstale":"2024-09-14T13:02:32.119040+0000","last_undegraded":"2024-09-14T13:02:32.119040+0000","last_fullsized":"2024-09-14T13:02:32.119040+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T13:02:32.118493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T13:02:32.118493+0000","last_clean_scrub_stamp":"2024-09-14T13:02:32.118493+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:24:48.355067+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"267'408","reported_seq":1925,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:22.324669+0000","last_change":"2024-09-14T13:02:22.324486+0000","last_active":"2024-09-14T13:02:22.324669+0000","last_peered":"2024-09-14T13:02:22.324669+0000","last_clean":"2024-09-14T13:02:22.324669+0000","last_became_active":"2024-09-14T11:08:23.812148+0000","last_became_peered":"2024-09-14T11:08:23.812148+0000","last_unstale":"2024-09-14T13:02:22.324669+0000","last_undegraded":"2024-09-14T13:02:22.324669+0000","last_fullsized":"2024-09-14T13:02:22.324669+0000","mapping_epoch":26,"log_start":"267'300","ondisk_log_start":"267'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'408","last_scrub_stamp":"2024-09-14T13:02:22.324302+0000","last_deep_scrub":"267'408","last_deep_scrub_stamp":"2024-09-14T13:02:22.324302+0000","last_clean_scrub_stamp":"2024-09-14T13:02:22.324302+0000","objects_scrubbed":1,"log_size":108,"log_dups_size":300,"ondisk_log_size":108,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:43:05.653161+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2189,"num_read_kb":2068,"num_write":470,"num_write_kb":97,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"267'247","reported_seq":1151,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:08.983777+0000","last_change":"2024-09-14T13:02:08.983777+0000","last_active":"2024-09-14T13:02:08.983777+0000","last_peered":"2024-09-14T13:02:08.983777+0000","last_clean":"2024-09-14T13:02:08.983777+0000","last_became_active":"2024-09-14T11:08:21.778733+0000","last_became_peered":"2024-09-14T11:08:21.778733+0000","last_unstale":"2024-09-14T13:02:08.983777+0000","last_undegraded":"2024-09-14T13:02:08.983777+0000","last_fullsized":"2024-09-14T13:02:08.983777+0000","mapping_epoch":24,"log_start":"267'200","ondisk_log_start":"267'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'247","last_scrub_stamp":"2024-09-14T13:02:08.983565+0000","last_deep_scrub":"267'247","last_deep_scrub_stamp":"2024-09-14T13:02:08.983565+0000","last_clean_scrub_stamp":"2024-09-14T13:02:08.983565+0000","objects_scrubbed":1,"log_size":47,"log_dups_size":200,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:53:58.902570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1357,"num_read_kb":10917,"num_write":1157,"num_write_kb":41642,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":549,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:26.999344+0000","last_change":"2024-09-14T13:02:26.999208+0000","last_active":"2024-09-14T13:02:26.999344+0000","last_peered":"2024-09-14T13:02:26.999344+0000","last_clean":"2024-09-14T13:02:26.999344+0000","last_became_active":"2024-09-14T11:08:25.799108+0000","last_became_peered":"2024-09-14T11:08:25.799108+0000","last_unstale":"2024-09-14T13:02:26.999344+0000","last_undegraded":"2024-09-14T13:02:26.999344+0000","last_fullsized":"2024-09-14T13:02:26.999344+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T13:02:26.999021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T13:02:26.999021+0000","last_clean_scrub_stamp":"2024-09-14T13:02:26.999021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T00:48:32.563816+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1d","version":"267'256","reported_seq":939,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:28.096964+0000","last_change":"2024-09-14T13:02:28.096964+0000","last_active":"2024-09-14T13:02:28.096964+0000","last_peered":"2024-09-14T13:02:28.096964+0000","last_clean":"2024-09-14T13:02:28.096964+0000","last_became_active":"2024-09-14T11:08:27.830985+0000","last_became_peered":"2024-09-14T11:08:27.830985+0000","last_unstale":"2024-09-14T13:02:28.096964+0000","last_undegraded":"2024-09-14T13:02:28.096964+0000","last_fullsized":"2024-09-14T13:02:28.096964+0000","mapping_epoch":30,"log_start":"267'200","ondisk_log_start":"267'200","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'256","last_scrub_stamp":"2024-09-14T13:02:28.096741+0000","last_deep_scrub":"267'256","last_deep_scrub_stamp":"2024-09-14T13:02:28.096741+0000","last_clean_scrub_stamp":"2024-09-14T13:02:28.096741+0000","objects_scrubbed":6,"log_size":56,"log_dups_size":200,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:57:37.009563+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":23445,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":387,"num_read_kb":588,"num_write":256,"num_write_kb":158,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":25256,"num_omap_keys":48,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":524,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:38.404367+0000","last_change":"2024-09-14T13:02:38.404367+0000","last_active":"2024-09-14T13:02:38.404367+0000","last_peered":"2024-09-14T13:02:38.404367+0000","last_clean":"2024-09-14T13:02:38.404367+0000","last_became_active":"2024-09-14T11:08:29.834723+0000","last_became_peered":"2024-09-14T11:08:29.834723+0000","last_unstale":"2024-09-14T13:02:38.404367+0000","last_undegraded":"2024-09-14T13:02:38.404367+0000","last_fullsized":"2024-09-14T13:02:38.404367+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T13:02:38.404182+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T13:02:38.404182+0000","last_clean_scrub_stamp":"2024-09-14T13:02:38.404182+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:53:07.617089+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.13","version":"267'171","reported_seq":716,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:41.984083+0000","last_change":"2024-09-14T13:02:41.983938+0000","last_active":"2024-09-14T13:02:41.984083+0000","last_peered":"2024-09-14T13:02:41.984083+0000","last_clean":"2024-09-14T13:02:41.984083+0000","last_became_active":"2024-09-14T11:08:31.832337+0000","last_became_peered":"2024-09-14T11:08:31.832337+0000","last_unstale":"2024-09-14T13:02:41.984083+0000","last_undegraded":"2024-09-14T13:02:41.984083+0000","last_fullsized":"2024-09-14T13:02:41.984083+0000","mapping_epoch":34,"log_start":"267'100","ondisk_log_start":"267'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'171","last_scrub_stamp":"2024-09-14T13:02:41.983727+0000","last_deep_scrub":"267'171","last_deep_scrub_stamp":"2024-09-14T13:02:41.983727+0000","last_clean_scrub_stamp":"2024-09-14T13:02:41.983727+0000","objects_scrubbed":2,"log_size":71,"log_dups_size":100,"ondisk_log_size":71,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:23:43.504453+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":643,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":222,"num_read_kb":226,"num_write":392,"num_write_kb":102,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"267'413","reported_seq":2040,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:20.024032+0000","last_change":"2024-09-14T13:02:20.023797+0000","last_active":"2024-09-14T13:02:20.024032+0000","last_peered":"2024-09-14T13:02:20.024032+0000","last_clean":"2024-09-14T13:02:20.024032+0000","last_became_active":"2024-09-14T11:08:23.800615+0000","last_became_peered":"2024-09-14T11:08:23.800615+0000","last_unstale":"2024-09-14T13:02:20.024032+0000","last_undegraded":"2024-09-14T13:02:20.024032+0000","last_fullsized":"2024-09-14T13:02:20.024032+0000","mapping_epoch":26,"log_start":"267'400","ondisk_log_start":"267'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'413","last_scrub_stamp":"2024-09-14T13:02:20.023496+0000","last_deep_scrub":"267'413","last_deep_scrub_stamp":"2024-09-14T13:02:20.023496+0000","last_clean_scrub_stamp":"2024-09-14T13:02:20.023496+0000","objects_scrubbed":1,"log_size":13,"log_dups_size":400,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:35:57.669124+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2239,"num_read_kb":2142,"num_write":466,"num_write_kb":81,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":254,"num_omap_keys":1,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"267'242","reported_seq":929,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:08.020604+0000","last_change":"2024-09-14T13:02:08.020474+0000","last_active":"2024-09-14T13:02:08.020604+0000","last_peered":"2024-09-14T13:02:08.020604+0000","last_clean":"2024-09-14T13:02:08.020604+0000","last_became_active":"2024-09-14T11:08:56.036673+0000","last_became_peered":"2024-09-14T11:08:56.036673+0000","last_unstale":"2024-09-14T13:02:08.020604+0000","last_undegraded":"2024-09-14T13:02:08.020604+0000","last_fullsized":"2024-09-14T13:02:08.020604+0000","mapping_epoch":37,"log_start":"267'200","ondisk_log_start":"267'200","created":24,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'242","last_scrub_stamp":"2024-09-14T13:02:08.020270+0000","last_deep_scrub":"267'242","last_deep_scrub_stamp":"2024-09-14T13:02:08.020270+0000","last_clean_scrub_stamp":"2024-09-14T13:02:08.020270+0000","objects_scrubbed":4,"log_size":42,"log_dups_size":200,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:26:39.664742+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":60,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":566,"num_read_kb":38876,"num_write":1051,"num_write_kb":52722,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,4],"acting":[1,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1f","version":"267'4","reported_seq":1019,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:23.337973+0000","last_change":"2024-09-14T13:02:23.337823+0000","last_active":"2024-09-14T13:02:23.337973+0000","last_peered":"2024-09-14T13:02:23.337973+0000","last_clean":"2024-09-14T13:02:23.337973+0000","last_became_active":"2024-09-14T11:08:25.812070+0000","last_became_peered":"2024-09-14T11:08:25.812070+0000","last_unstale":"2024-09-14T13:02:23.337973+0000","last_undegraded":"2024-09-14T13:02:23.337973+0000","last_fullsized":"2024-09-14T13:02:23.337973+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'4","last_scrub_stamp":"2024-09-14T13:02:23.337638+0000","last_deep_scrub":"267'4","last_deep_scrub_stamp":"2024-09-14T13:02:23.337638+0000","last_clean_scrub_stamp":"2024-09-14T13:02:23.337638+0000","objects_scrubbed":1,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:25:52.234244+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":470,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":719,"num_read_kb":717,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1c","version":"267'290","reported_seq":952,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:34.649646+0000","last_change":"2024-09-14T13:02:34.649646+0000","last_active":"2024-09-14T13:02:34.649646+0000","last_peered":"2024-09-14T13:02:34.649646+0000","last_clean":"2024-09-14T13:02:34.649646+0000","last_became_active":"2024-09-14T11:08:27.839087+0000","last_became_peered":"2024-09-14T11:08:27.839087+0000","last_unstale":"2024-09-14T13:02:34.649646+0000","last_undegraded":"2024-09-14T13:02:34.649646+0000","last_fullsized":"2024-09-14T13:02:34.649646+0000","mapping_epoch":30,"log_start":"267'200","ondisk_log_start":"267'200","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'290","last_scrub_stamp":"2024-09-14T13:02:34.649418+0000","last_deep_scrub":"267'290","last_deep_scrub_stamp":"2024-09-14T13:02:34.649418+0000","last_clean_scrub_stamp":"2024-09-14T13:02:34.649418+0000","objects_scrubbed":8,"log_size":90,"log_dups_size":200,"ondisk_log_size":90,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:44:57.415007+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":105157,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":431,"num_read_kb":790,"num_write":316,"num_write_kb":215,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":11460,"num_omap_keys":24,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":522,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:33.128117+0000","last_change":"2024-09-14T13:02:33.128117+0000","last_active":"2024-09-14T13:02:33.128117+0000","last_peered":"2024-09-14T13:02:33.128117+0000","last_clean":"2024-09-14T13:02:33.128117+0000","last_became_active":"2024-09-14T11:08:29.828451+0000","last_became_peered":"2024-09-14T11:08:29.828451+0000","last_unstale":"2024-09-14T13:02:33.128117+0000","last_undegraded":"2024-09-14T13:02:33.128117+0000","last_fullsized":"2024-09-14T13:02:33.128117+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T13:02:33.127924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T13:02:33.127924+0000","last_clean_scrub_stamp":"2024-09-14T13:02:33.127924+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:10:36.512182+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.12","version":"267'207","reported_seq":1115,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:31.278615+0000","last_change":"2024-09-14T13:02:31.278471+0000","last_active":"2024-09-14T13:02:31.278615+0000","last_peered":"2024-09-14T13:02:31.278615+0000","last_clean":"2024-09-14T13:02:31.278615+0000","last_became_active":"2024-09-14T11:08:31.854650+0000","last_became_peered":"2024-09-14T11:08:31.854650+0000","last_unstale":"2024-09-14T13:02:31.278615+0000","last_undegraded":"2024-09-14T13:02:31.278615+0000","last_fullsized":"2024-09-14T13:02:31.278615+0000","mapping_epoch":34,"log_start":"267'100","ondisk_log_start":"267'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'207","last_scrub_stamp":"2024-09-14T13:02:31.278260+0000","last_deep_scrub":"267'207","last_deep_scrub_stamp":"2024-09-14T13:02:31.278260+0000","last_clean_scrub_stamp":"2024-09-14T13:02:31.278260+0000","objects_scrubbed":6,"log_size":107,"log_dups_size":100,"ondisk_log_size":107,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:59:42.042572+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1218,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":620,"num_read_kb":614,"num_write":555,"num_write_kb":141,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1d","version":"267'644","reported_seq":2448,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:20.943243+0000","last_change":"2024-09-14T13:02:20.943243+0000","last_active":"2024-09-14T13:02:20.943243+0000","last_peered":"2024-09-14T13:02:20.943243+0000","last_clean":"2024-09-14T13:02:20.943243+0000","last_became_active":"2024-09-14T11:08:23.779099+0000","last_became_peered":"2024-09-14T11:08:23.779099+0000","last_unstale":"2024-09-14T13:02:20.943243+0000","last_undegraded":"2024-09-14T13:02:20.943243+0000","last_fullsized":"2024-09-14T13:02:20.943243+0000","mapping_epoch":26,"log_start":"267'600","ondisk_log_start":"267'600","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'644","last_scrub_stamp":"2024-09-14T13:02:20.943029+0000","last_deep_scrub":"267'644","last_deep_scrub_stamp":"2024-09-14T13:02:20.943029+0000","last_clean_scrub_stamp":"2024-09-14T13:02:20.943029+0000","objects_scrubbed":2,"log_size":44,"log_dups_size":600,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:46:01.069278+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3438,"num_read_kb":3161,"num_write":830,"num_write_kb":293,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":432,"num_omap_keys":2,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"267'251","reported_seq":1039,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:08.834994+0000","last_change":"2024-09-14T13:02:08.834994+0000","last_active":"2024-09-14T13:02:08.834994+0000","last_peered":"2024-09-14T13:02:08.834994+0000","last_clean":"2024-09-14T13:02:08.834994+0000","last_became_active":"2024-09-14T11:08:21.822349+0000","last_became_peered":"2024-09-14T11:08:21.822349+0000","last_unstale":"2024-09-14T13:02:08.834994+0000","last_undegraded":"2024-09-14T13:02:08.834994+0000","last_fullsized":"2024-09-14T13:02:08.834994+0000","mapping_epoch":24,"log_start":"267'200","ondisk_log_start":"267'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'251","last_scrub_stamp":"2024-09-14T13:02:08.834786+0000","last_deep_scrub":"267'251","last_deep_scrub_stamp":"2024-09-14T13:02:08.834786+0000","last_clean_scrub_stamp":"2024-09-14T13:02:08.834786+0000","objects_scrubbed":3,"log_size":51,"log_dups_size":200,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:07:12.222661+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1655848,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1337,"num_read_kb":40987,"num_write":1078,"num_write_kb":33045,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,5],"acting":[4,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":534,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:29.680153+0000","last_change":"2024-09-14T13:02:29.680153+0000","last_active":"2024-09-14T13:02:29.680153+0000","last_peered":"2024-09-14T13:02:29.680153+0000","last_clean":"2024-09-14T13:02:29.680153+0000","last_became_active":"2024-09-14T11:08:25.807820+0000","last_became_peered":"2024-09-14T11:08:25.807820+0000","last_unstale":"2024-09-14T13:02:29.680153+0000","last_undegraded":"2024-09-14T13:02:29.680153+0000","last_fullsized":"2024-09-14T13:02:29.680153+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T13:02:29.679968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T13:02:29.679968+0000","last_clean_scrub_stamp":"2024-09-14T13:02:29.679968+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:16:44.115139+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1f","version":"267'207","reported_seq":855,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:31.871640+0000","last_change":"2024-09-14T13:02:31.871500+0000","last_active":"2024-09-14T13:02:31.871640+0000","last_peered":"2024-09-14T13:02:31.871640+0000","last_clean":"2024-09-14T13:02:31.871640+0000","last_became_active":"2024-09-14T11:08:27.799019+0000","last_became_peered":"2024-09-14T11:08:27.799019+0000","last_unstale":"2024-09-14T13:02:31.871640+0000","last_undegraded":"2024-09-14T13:02:31.871640+0000","last_fullsized":"2024-09-14T13:02:31.871640+0000","mapping_epoch":30,"log_start":"264'100","ondisk_log_start":"264'100","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'207","last_scrub_stamp":"2024-09-14T13:02:31.871286+0000","last_deep_scrub":"267'207","last_deep_scrub_stamp":"2024-09-14T13:02:31.871286+0000","last_clean_scrub_stamp":"2024-09-14T13:02:31.871286+0000","objects_scrubbed":6,"log_size":107,"log_dups_size":100,"ondisk_log_size":107,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:51:00.124237+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":11376,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":267,"num_read_kb":349,"num_write":156,"num_write_kb":26,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":534,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:26.073940+0000","last_change":"2024-09-14T13:02:26.073717+0000","last_active":"2024-09-14T13:02:26.073940+0000","last_peered":"2024-09-14T13:02:26.073940+0000","last_clean":"2024-09-14T13:02:26.073940+0000","last_became_active":"2024-09-14T11:08:29.820658+0000","last_became_peered":"2024-09-14T11:08:29.820658+0000","last_unstale":"2024-09-14T13:02:26.073940+0000","last_undegraded":"2024-09-14T13:02:26.073940+0000","last_fullsized":"2024-09-14T13:02:26.073940+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T13:02:26.073512+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T13:02:26.073512+0000","last_clean_scrub_stamp":"2024-09-14T13:02:26.073512+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:26:51.195695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.11","version":"267'137","reported_seq":676,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:42.398323+0000","last_change":"2024-09-14T13:02:42.398170+0000","last_active":"2024-09-14T13:02:42.398323+0000","last_peered":"2024-09-14T13:02:42.398323+0000","last_clean":"2024-09-14T13:02:42.398323+0000","last_became_active":"2024-09-14T11:08:31.836424+0000","last_became_peered":"2024-09-14T11:08:31.836424+0000","last_unstale":"2024-09-14T13:02:42.398323+0000","last_undegraded":"2024-09-14T13:02:42.398323+0000","last_fullsized":"2024-09-14T13:02:42.398323+0000","mapping_epoch":34,"log_start":"267'100","ondisk_log_start":"267'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'137","last_scrub_stamp":"2024-09-14T13:02:42.397953+0000","last_deep_scrub":"267'137","last_deep_scrub_stamp":"2024-09-14T13:02:42.397953+0000","last_clean_scrub_stamp":"2024-09-14T13:02:42.397953+0000","objects_scrubbed":3,"log_size":37,"log_dups_size":100,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:33:09.416422+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":383,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":163,"num_read_kb":148,"num_write":342,"num_write_kb":82,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1c","version":"267'438","reported_seq":2103,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:17.145247+0000","last_change":"2024-09-14T13:02:17.145247+0000","last_active":"2024-09-14T13:02:17.145247+0000","last_peered":"2024-09-14T13:02:17.145247+0000","last_clean":"2024-09-14T13:02:17.145247+0000","last_became_active":"2024-09-14T11:08:23.775491+0000","last_became_peered":"2024-09-14T11:08:23.775491+0000","last_unstale":"2024-09-14T13:02:17.145247+0000","last_undegraded":"2024-09-14T13:02:17.145247+0000","last_fullsized":"2024-09-14T13:02:17.145247+0000","mapping_epoch":26,"log_start":"267'400","ondisk_log_start":"267'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'438","last_scrub_stamp":"2024-09-14T13:02:17.145001+0000","last_deep_scrub":"267'438","last_deep_scrub_stamp":"2024-09-14T13:02:17.145001+0000","last_clean_scrub_stamp":"2024-09-14T13:02:17.145001+0000","objects_scrubbed":1,"log_size":38,"log_dups_size":400,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:24:25.673117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2479,"num_read_kb":2350,"num_write":502,"num_write_kb":107,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":247,"num_omap_keys":1,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"267'223","reported_seq":858,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:11.163011+0000","last_change":"2024-09-14T13:02:11.163011+0000","last_active":"2024-09-14T13:02:11.163011+0000","last_peered":"2024-09-14T13:02:11.163011+0000","last_clean":"2024-09-14T13:02:11.163011+0000","last_became_active":"2024-09-14T11:08:56.033894+0000","last_became_peered":"2024-09-14T11:08:56.033894+0000","last_unstale":"2024-09-14T13:02:11.163011+0000","last_undegraded":"2024-09-14T13:02:11.163011+0000","last_fullsized":"2024-09-14T13:02:11.163011+0000","mapping_epoch":37,"log_start":"267'200","ondisk_log_start":"267'200","created":24,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'223","last_scrub_stamp":"2024-09-14T13:02:11.162701+0000","last_deep_scrub":"267'223","last_deep_scrub_stamp":"2024-09-14T13:02:11.162701+0000","last_clean_scrub_stamp":"2024-09-14T13:02:11.162701+0000","objects_scrubbed":2,"log_size":23,"log_dups_size":200,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:47:28.180376+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":541,"num_read_kb":17888,"num_write":1023,"num_write_kb":32755,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4,7],"acting":[2,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":529,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:25.041608+0000","last_change":"2024-09-14T13:02:25.041608+0000","last_active":"2024-09-14T13:02:25.041608+0000","last_peered":"2024-09-14T13:02:25.041608+0000","last_clean":"2024-09-14T13:02:25.041608+0000","last_became_active":"2024-09-14T11:08:25.804388+0000","last_became_peered":"2024-09-14T11:08:25.804388+0000","last_unstale":"2024-09-14T13:02:25.041608+0000","last_undegraded":"2024-09-14T13:02:25.041608+0000","last_fullsized":"2024-09-14T13:02:25.041608+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T13:02:25.041415+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T13:02:25.041415+0000","last_clean_scrub_stamp":"2024-09-14T13:02:25.041415+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:10:25.120032+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1e","version":"267'175","reported_seq":777,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:35.760034+0000","last_change":"2024-09-14T13:02:35.759893+0000","last_active":"2024-09-14T13:02:35.760034+0000","last_peered":"2024-09-14T13:02:35.760034+0000","last_clean":"2024-09-14T13:02:35.760034+0000","last_became_active":"2024-09-14T11:08:27.830708+0000","last_became_peered":"2024-09-14T11:08:27.830708+0000","last_unstale":"2024-09-14T13:02:35.760034+0000","last_undegraded":"2024-09-14T13:02:35.760034+0000","last_fullsized":"2024-09-14T13:02:35.760034+0000","mapping_epoch":30,"log_start":"267'100","ondisk_log_start":"267'100","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'175","last_scrub_stamp":"2024-09-14T13:02:35.759693+0000","last_deep_scrub":"267'175","last_deep_scrub_stamp":"2024-09-14T13:02:35.759693+0000","last_clean_scrub_stamp":"2024-09-14T13:02:35.759693+0000","objects_scrubbed":7,"log_size":75,"log_dups_size":100,"ondisk_log_size":75,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:24:57.090070+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":224,"num_read_kb":219,"num_write":208,"num_write_kb":88,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":18240,"num_omap_keys":46,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1f","version":"267'769","reported_seq":3165,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:29.273311+0000","last_change":"2024-09-14T13:02:29.273311+0000","last_active":"2024-09-14T13:02:29.273311+0000","last_peered":"2024-09-14T13:02:29.273311+0000","last_clean":"2024-09-14T13:02:29.273311+0000","last_became_active":"2024-09-14T11:08:29.840179+0000","last_became_peered":"2024-09-14T11:08:29.840179+0000","last_unstale":"2024-09-14T13:02:29.273311+0000","last_undegraded":"2024-09-14T13:02:29.273311+0000","last_fullsized":"2024-09-14T13:02:29.273311+0000","mapping_epoch":32,"log_start":"267'701","ondisk_log_start":"267'701","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'769","last_scrub_stamp":"2024-09-14T13:02:29.273123+0000","last_deep_scrub":"267'769","last_deep_scrub_stamp":"2024-09-14T13:02:29.273123+0000","last_clean_scrub_stamp":"2024-09-14T13:02:29.273123+0000","objects_scrubbed":1,"log_size":68,"log_dups_size":701,"ondisk_log_size":68,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:27:32.756092+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.10","version":"267'111","reported_seq":646,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:40.561293+0000","last_change":"2024-09-14T13:02:40.561157+0000","last_active":"2024-09-14T13:02:40.561293+0000","last_peered":"2024-09-14T13:02:40.561293+0000","last_clean":"2024-09-14T13:02:40.561293+0000","last_became_active":"2024-09-14T11:08:31.838761+0000","last_became_peered":"2024-09-14T11:08:31.838761+0000","last_unstale":"2024-09-14T13:02:40.561293+0000","last_undegraded":"2024-09-14T13:02:40.561293+0000","last_fullsized":"2024-09-14T13:02:40.561293+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'111","last_scrub_stamp":"2024-09-14T13:02:40.560964+0000","last_deep_scrub":"267'111","last_deep_scrub_stamp":"2024-09-14T13:02:40.560964+0000","last_clean_scrub_stamp":"2024-09-14T13:02:40.560964+0000","objects_scrubbed":1,"log_size":111,"log_dups_size":0,"ondisk_log_size":111,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:00:06.038509+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":418,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":108,"num_read_kb":106,"num_write":270,"num_write_kb":60,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1b","version":"267'385","reported_seq":1857,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:18.710983+0000","last_change":"2024-09-14T13:02:18.710983+0000","last_active":"2024-09-14T13:02:18.710983+0000","last_peered":"2024-09-14T13:02:18.710983+0000","last_clean":"2024-09-14T13:02:18.710983+0000","last_became_active":"2024-09-14T11:08:23.791753+0000","last_became_peered":"2024-09-14T11:08:23.791753+0000","last_unstale":"2024-09-14T13:02:18.710983+0000","last_undegraded":"2024-09-14T13:02:18.710983+0000","last_fullsized":"2024-09-14T13:02:18.710983+0000","mapping_epoch":26,"log_start":"267'300","ondisk_log_start":"267'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'385","last_scrub_stamp":"2024-09-14T13:02:18.710738+0000","last_deep_scrub":"267'385","last_deep_scrub_stamp":"2024-09-14T13:02:18.710738+0000","last_clean_scrub_stamp":"2024-09-14T13:02:18.710738+0000","objects_scrubbed":1,"log_size":85,"log_dups_size":300,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:43:05.968088+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2049,"num_read_kb":1937,"num_write":432,"num_write_kb":84,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1c","version":"267'213","reported_seq":877,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:11.330388+0000","last_change":"2024-09-14T13:02:11.330388+0000","last_active":"2024-09-14T13:02:11.330388+0000","last_peered":"2024-09-14T13:02:11.330388+0000","last_clean":"2024-09-14T13:02:11.330388+0000","last_became_active":"2024-09-14T11:08:21.825881+0000","last_became_peered":"2024-09-14T11:08:21.825881+0000","last_unstale":"2024-09-14T13:02:11.330388+0000","last_undegraded":"2024-09-14T13:02:11.330388+0000","last_fullsized":"2024-09-14T13:02:11.330388+0000","mapping_epoch":24,"log_start":"267'200","ondisk_log_start":"267'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'213","last_scrub_stamp":"2024-09-14T13:02:11.330181+0000","last_deep_scrub":"267'213","last_deep_scrub_stamp":"2024-09-14T13:02:11.330181+0000","last_clean_scrub_stamp":"2024-09-14T13:02:11.330181+0000","objects_scrubbed":1,"log_size":13,"log_dups_size":200,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:06:15.884484+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1655822,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":555,"num_read_kb":34621,"num_write":949,"num_write_kb":21560,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":533,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:28.543122+0000","last_change":"2024-09-14T13:02:28.543122+0000","last_active":"2024-09-14T13:02:28.543122+0000","last_peered":"2024-09-14T13:02:28.543122+0000","last_clean":"2024-09-14T13:02:28.543122+0000","last_became_active":"2024-09-14T11:08:25.822047+0000","last_became_peered":"2024-09-14T11:08:25.822047+0000","last_unstale":"2024-09-14T13:02:28.543122+0000","last_undegraded":"2024-09-14T13:02:28.543122+0000","last_fullsized":"2024-09-14T13:02:28.543122+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T13:02:28.542945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T13:02:28.542945+0000","last_clean_scrub_stamp":"2024-09-14T13:02:28.542945+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:35:34.239314+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.19","version":"267'270","reported_seq":933,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:36.400848+0000","last_change":"2024-09-14T13:02:36.400848+0000","last_active":"2024-09-14T13:02:36.400848+0000","last_peered":"2024-09-14T13:02:36.400848+0000","last_clean":"2024-09-14T13:02:36.400848+0000","last_became_active":"2024-09-14T11:08:27.824464+0000","last_became_peered":"2024-09-14T11:08:27.824464+0000","last_unstale":"2024-09-14T13:02:36.400848+0000","last_undegraded":"2024-09-14T13:02:36.400848+0000","last_fullsized":"2024-09-14T13:02:36.400848+0000","mapping_epoch":30,"log_start":"267'200","ondisk_log_start":"267'200","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'270","last_scrub_stamp":"2024-09-14T13:02:36.400629+0000","last_deep_scrub":"267'270","last_deep_scrub_stamp":"2024-09-14T13:02:36.400629+0000","last_clean_scrub_stamp":"2024-09-14T13:02:36.400629+0000","objects_scrubbed":8,"log_size":70,"log_dups_size":200,"ondisk_log_size":70,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:44:26.595055+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12812,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":350,"num_read_kb":439,"num_write":214,"num_write_kb":32,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":531,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:35.129790+0000","last_change":"2024-09-14T13:02:35.129790+0000","last_active":"2024-09-14T13:02:35.129790+0000","last_peered":"2024-09-14T13:02:35.129790+0000","last_clean":"2024-09-14T13:02:35.129790+0000","last_became_active":"2024-09-14T11:08:29.822623+0000","last_became_peered":"2024-09-14T11:08:29.822623+0000","last_unstale":"2024-09-14T13:02:35.129790+0000","last_undegraded":"2024-09-14T13:02:35.129790+0000","last_fullsized":"2024-09-14T13:02:35.129790+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T13:02:35.129616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T13:02:35.129616+0000","last_clean_scrub_stamp":"2024-09-14T13:02:35.129616+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:00:13.553426+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.17","version":"267'129","reported_seq":664,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:41.608185+0000","last_change":"2024-09-14T13:02:41.608185+0000","last_active":"2024-09-14T13:02:41.608185+0000","last_peered":"2024-09-14T13:02:41.608185+0000","last_clean":"2024-09-14T13:02:41.608185+0000","last_became_active":"2024-09-14T11:08:31.858388+0000","last_became_peered":"2024-09-14T11:08:31.858388+0000","last_unstale":"2024-09-14T13:02:41.608185+0000","last_undegraded":"2024-09-14T13:02:41.608185+0000","last_fullsized":"2024-09-14T13:02:41.608185+0000","mapping_epoch":34,"log_start":"267'100","ondisk_log_start":"267'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'129","last_scrub_stamp":"2024-09-14T13:02:41.607983+0000","last_deep_scrub":"267'129","last_deep_scrub_stamp":"2024-09-14T13:02:41.607983+0000","last_clean_scrub_stamp":"2024-09-14T13:02:41.607983+0000","objects_scrubbed":2,"log_size":29,"log_dups_size":100,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:09:12.823499+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":200,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":125,"num_read_kb":119,"num_write":310,"num_write_kb":73,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1a","version":"267'853","reported_seq":2580,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:17.760990+0000","last_change":"2024-09-14T13:02:17.760990+0000","last_active":"2024-09-14T13:02:17.760990+0000","last_peered":"2024-09-14T13:02:17.760990+0000","last_clean":"2024-09-14T13:02:17.760990+0000","last_became_active":"2024-09-14T11:08:23.793908+0000","last_became_peered":"2024-09-14T11:08:23.793908+0000","last_unstale":"2024-09-14T13:02:17.760990+0000","last_undegraded":"2024-09-14T13:02:17.760990+0000","last_fullsized":"2024-09-14T13:02:17.760990+0000","mapping_epoch":26,"log_start":"267'800","ondisk_log_start":"267'800","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'853","last_scrub_stamp":"2024-09-14T13:02:17.760808+0000","last_deep_scrub":"267'853","last_deep_scrub_stamp":"2024-09-14T13:02:17.760808+0000","last_clean_scrub_stamp":"2024-09-14T13:02:17.760808+0000","objects_scrubbed":2,"log_size":53,"log_dups_size":800,"ondisk_log_size":53,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:38:18.530322+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":4233,"num_read_kb":3837,"num_write":1135,"num_write_kb":419,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2551,"num_omap_keys":10,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1d","version":"267'248","reported_seq":937,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:12.368968+0000","last_change":"2024-09-14T13:02:12.368968+0000","last_active":"2024-09-14T13:02:12.368968+0000","last_peered":"2024-09-14T13:02:12.368968+0000","last_clean":"2024-09-14T13:02:12.368968+0000","last_became_active":"2024-09-14T11:08:21.820805+0000","last_became_peered":"2024-09-14T11:08:21.820805+0000","last_unstale":"2024-09-14T13:02:12.368968+0000","last_undegraded":"2024-09-14T13:02:12.368968+0000","last_fullsized":"2024-09-14T13:02:12.368968+0000","mapping_epoch":24,"log_start":"267'200","ondisk_log_start":"267'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'248","last_scrub_stamp":"2024-09-14T13:02:12.368755+0000","last_deep_scrub":"267'248","last_deep_scrub_stamp":"2024-09-14T13:02:12.368755+0000","last_clean_scrub_stamp":"2024-09-14T13:02:12.368755+0000","objects_scrubbed":3,"log_size":48,"log_dups_size":200,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:45:17.694226+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":55,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":696,"num_read_kb":13918,"num_write":1169,"num_write_kb":29151,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":532,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:33.407269+0000","last_change":"2024-09-14T13:02:33.407269+0000","last_active":"2024-09-14T13:02:33.407269+0000","last_peered":"2024-09-14T13:02:33.407269+0000","last_clean":"2024-09-14T13:02:33.407269+0000","last_became_active":"2024-09-14T11:08:25.801548+0000","last_became_peered":"2024-09-14T11:08:25.801548+0000","last_unstale":"2024-09-14T13:02:33.407269+0000","last_undegraded":"2024-09-14T13:02:33.407269+0000","last_fullsized":"2024-09-14T13:02:33.407269+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T13:02:33.407066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T13:02:33.407066+0000","last_clean_scrub_stamp":"2024-09-14T13:02:33.407066+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:48:43.308728+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.18","version":"267'183","reported_seq":815,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:28.000513+0000","last_change":"2024-09-14T13:02:28.000513+0000","last_active":"2024-09-14T13:02:28.000513+0000","last_peered":"2024-09-14T13:02:28.000513+0000","last_clean":"2024-09-14T13:02:28.000513+0000","last_became_active":"2024-09-14T11:08:27.814938+0000","last_became_peered":"2024-09-14T11:08:27.814938+0000","last_unstale":"2024-09-14T13:02:28.000513+0000","last_undegraded":"2024-09-14T13:02:28.000513+0000","last_fullsized":"2024-09-14T13:02:28.000513+0000","mapping_epoch":30,"log_start":"264'100","ondisk_log_start":"264'100","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'183","last_scrub_stamp":"2024-09-14T13:02:28.000240+0000","last_deep_scrub":"267'183","last_deep_scrub_stamp":"2024-09-14T13:02:28.000240+0000","last_clean_scrub_stamp":"2024-09-14T13:02:28.000240+0000","objects_scrubbed":4,"log_size":83,"log_dups_size":100,"ondisk_log_size":83,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:11:21.026195+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":31231,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":239,"num_read_kb":376,"num_write":138,"num_write_kb":54,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":525,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:28.223406+0000","last_change":"2024-09-14T13:02:28.223264+0000","last_active":"2024-09-14T13:02:28.223406+0000","last_peered":"2024-09-14T13:02:28.223406+0000","last_clean":"2024-09-14T13:02:28.223406+0000","last_became_active":"2024-09-14T11:08:29.829491+0000","last_became_peered":"2024-09-14T11:08:29.829491+0000","last_unstale":"2024-09-14T13:02:28.223406+0000","last_undegraded":"2024-09-14T13:02:28.223406+0000","last_fullsized":"2024-09-14T13:02:28.223406+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T13:02:28.223080+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T13:02:28.223080+0000","last_clean_scrub_stamp":"2024-09-14T13:02:28.223080+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:42:17.487239+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.16","version":"267'129","reported_seq":692,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:42.977781+0000","last_change":"2024-09-14T13:02:42.977781+0000","last_active":"2024-09-14T13:02:42.977781+0000","last_peered":"2024-09-14T13:02:42.977781+0000","last_clean":"2024-09-14T13:02:42.977781+0000","last_became_active":"2024-09-14T11:08:31.832264+0000","last_became_peered":"2024-09-14T11:08:31.832264+0000","last_unstale":"2024-09-14T13:02:42.977781+0000","last_undegraded":"2024-09-14T13:02:42.977781+0000","last_fullsized":"2024-09-14T13:02:42.977781+0000","mapping_epoch":34,"log_start":"267'100","ondisk_log_start":"267'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'129","last_scrub_stamp":"2024-09-14T13:02:42.977606+0000","last_deep_scrub":"267'129","last_deep_scrub_stamp":"2024-09-14T13:02:42.977606+0000","last_clean_scrub_stamp":"2024-09-14T13:02:42.977606+0000","objects_scrubbed":1,"log_size":29,"log_dups_size":100,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:40:45.314824+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":539,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":196,"num_read_kb":188,"num_write":306,"num_write_kb":70,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"267'841","reported_seq":2525,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:18.906574+0000","last_change":"2024-09-14T13:02:18.906417+0000","last_active":"2024-09-14T13:02:18.906574+0000","last_peered":"2024-09-14T13:02:18.906574+0000","last_clean":"2024-09-14T13:02:18.906574+0000","last_became_active":"2024-09-14T11:08:23.781730+0000","last_became_peered":"2024-09-14T11:08:23.781730+0000","last_unstale":"2024-09-14T13:02:18.906574+0000","last_undegraded":"2024-09-14T13:02:18.906574+0000","last_fullsized":"2024-09-14T13:02:18.906574+0000","mapping_epoch":26,"log_start":"267'800","ondisk_log_start":"267'800","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'841","last_scrub_stamp":"2024-09-14T13:02:18.906239+0000","last_deep_scrub":"267'841","last_deep_scrub_stamp":"2024-09-14T13:02:18.906239+0000","last_clean_scrub_stamp":"2024-09-14T13:02:18.906239+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":800,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:22:02.089304+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3990,"num_read_kb":3619,"num_write":1102,"num_write_kb":388,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"267'187","reported_seq":836,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:10.973597+0000","last_change":"2024-09-14T13:02:10.973427+0000","last_active":"2024-09-14T13:02:10.973597+0000","last_peered":"2024-09-14T13:02:10.973597+0000","last_clean":"2024-09-14T13:02:10.973597+0000","last_became_active":"2024-09-14T11:08:21.809457+0000","last_became_peered":"2024-09-14T11:08:21.809457+0000","last_unstale":"2024-09-14T13:02:10.973597+0000","last_undegraded":"2024-09-14T13:02:10.973597+0000","last_fullsized":"2024-09-14T13:02:10.973597+0000","mapping_epoch":24,"log_start":"267'100","ondisk_log_start":"267'100","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'187","last_scrub_stamp":"2024-09-14T13:02:10.973179+0000","last_deep_scrub":"267'187","last_deep_scrub_stamp":"2024-09-14T13:02:10.973179+0000","last_clean_scrub_stamp":"2024-09-14T13:02:10.973179+0000","objects_scrubbed":2,"log_size":87,"log_dups_size":100,"ondisk_log_size":87,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:00:13.783400+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":26,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":452,"num_read_kb":5598,"num_write":898,"num_write_kb":20482,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6,7],"acting":[3,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":536,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:27.675224+0000","last_change":"2024-09-14T13:02:27.675224+0000","last_active":"2024-09-14T13:02:27.675224+0000","last_peered":"2024-09-14T13:02:27.675224+0000","last_clean":"2024-09-14T13:02:27.675224+0000","last_became_active":"2024-09-14T11:08:25.805777+0000","last_became_peered":"2024-09-14T11:08:25.805777+0000","last_unstale":"2024-09-14T13:02:27.675224+0000","last_undegraded":"2024-09-14T13:02:27.675224+0000","last_fullsized":"2024-09-14T13:02:27.675224+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T13:02:27.675019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T13:02:27.675019+0000","last_clean_scrub_stamp":"2024-09-14T13:02:27.675019+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:33:44.670317+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1b","version":"267'125","reported_seq":726,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:32.892063+0000","last_change":"2024-09-14T13:02:32.892063+0000","last_active":"2024-09-14T13:02:32.892063+0000","last_peered":"2024-09-14T13:02:32.892063+0000","last_clean":"2024-09-14T13:02:32.892063+0000","last_became_active":"2024-09-14T11:08:27.822465+0000","last_became_peered":"2024-09-14T11:08:27.822465+0000","last_unstale":"2024-09-14T13:02:32.892063+0000","last_undegraded":"2024-09-14T13:02:32.892063+0000","last_fullsized":"2024-09-14T13:02:32.892063+0000","mapping_epoch":30,"log_start":"267'100","ondisk_log_start":"267'100","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'125","last_scrub_stamp":"2024-09-14T13:02:32.891840+0000","last_deep_scrub":"267'125","last_deep_scrub_stamp":"2024-09-14T13:02:32.891840+0000","last_clean_scrub_stamp":"2024-09-14T13:02:32.891840+0000","objects_scrubbed":2,"log_size":25,"log_dups_size":100,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:18:10.544553+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9872,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":162,"num_read_kb":232,"num_write":86,"num_write_kb":20,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":526,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:36.698390+0000","last_change":"2024-09-14T13:02:36.698390+0000","last_active":"2024-09-14T13:02:36.698390+0000","last_peered":"2024-09-14T13:02:36.698390+0000","last_clean":"2024-09-14T13:02:36.698390+0000","last_became_active":"2024-09-14T11:08:29.831394+0000","last_became_peered":"2024-09-14T11:08:29.831394+0000","last_unstale":"2024-09-14T13:02:36.698390+0000","last_undegraded":"2024-09-14T13:02:36.698390+0000","last_fullsized":"2024-09-14T13:02:36.698390+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T13:02:36.698177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T13:02:36.698177+0000","last_clean_scrub_stamp":"2024-09-14T13:02:36.698177+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:22:59.122651+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.15","version":"267'191","reported_seq":1336,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:39.517014+0000","last_change":"2024-09-14T13:02:39.517014+0000","last_active":"2024-09-14T13:02:39.517014+0000","last_peered":"2024-09-14T13:02:39.517014+0000","last_clean":"2024-09-14T13:02:39.517014+0000","last_became_active":"2024-09-14T11:08:31.837288+0000","last_became_peered":"2024-09-14T11:08:31.837288+0000","last_unstale":"2024-09-14T13:02:39.517014+0000","last_undegraded":"2024-09-14T13:02:39.517014+0000","last_fullsized":"2024-09-14T13:02:39.517014+0000","mapping_epoch":34,"log_start":"267'100","ondisk_log_start":"267'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'191","last_scrub_stamp":"2024-09-14T13:02:39.516820+0000","last_deep_scrub":"267'191","last_deep_scrub_stamp":"2024-09-14T13:02:39.516820+0000","last_clean_scrub_stamp":"2024-09-14T13:02:39.516820+0000","objects_scrubbed":5,"log_size":91,"log_dups_size":100,"ondisk_log_size":91,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:51:46.141392+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":649,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":776,"num_read_kb":767,"num_write":406,"num_write_kb":131,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.18","version":"267'751","reported_seq":2363,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:16.798485+0000","last_change":"2024-09-14T13:02:16.798485+0000","last_active":"2024-09-14T13:02:16.798485+0000","last_peered":"2024-09-14T13:02:16.798485+0000","last_clean":"2024-09-14T13:02:16.798485+0000","last_became_active":"2024-09-14T11:08:23.806640+0000","last_became_peered":"2024-09-14T11:08:23.806640+0000","last_unstale":"2024-09-14T13:02:16.798485+0000","last_undegraded":"2024-09-14T13:02:16.798485+0000","last_fullsized":"2024-09-14T13:02:16.798485+0000","mapping_epoch":26,"log_start":"267'700","ondisk_log_start":"267'700","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'751","last_scrub_stamp":"2024-09-14T13:02:16.798298+0000","last_deep_scrub":"267'751","last_deep_scrub_stamp":"2024-09-14T13:02:16.798298+0000","last_clean_scrub_stamp":"2024-09-14T13:02:16.798298+0000","objects_scrubbed":1,"log_size":51,"log_dups_size":700,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:34:05.343127+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3938,"num_read_kb":3591,"num_write":982,"num_write_kb":355,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":244,"num_omap_keys":1,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1f","version":"267'170","reported_seq":848,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:10.102344+0000","last_change":"2024-09-14T13:02:10.102208+0000","last_active":"2024-09-14T13:02:10.102344+0000","last_peered":"2024-09-14T13:02:10.102344+0000","last_clean":"2024-09-14T13:02:10.102344+0000","last_became_active":"2024-09-14T11:08:21.801111+0000","last_became_peered":"2024-09-14T11:08:21.801111+0000","last_unstale":"2024-09-14T13:02:10.102344+0000","last_undegraded":"2024-09-14T13:02:10.102344+0000","last_fullsized":"2024-09-14T13:02:10.102344+0000","mapping_epoch":24,"log_start":"267'100","ondisk_log_start":"267'100","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'170","last_scrub_stamp":"2024-09-14T13:02:10.102000+0000","last_deep_scrub":"267'170","last_deep_scrub_stamp":"2024-09-14T13:02:10.102000+0000","last_clean_scrub_stamp":"2024-09-14T13:02:10.102000+0000","objects_scrubbed":1,"log_size":70,"log_dups_size":100,"ondisk_log_size":70,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:52:37.683920+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":26,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":489,"num_read_kb":60837,"num_write":760,"num_write_kb":39194,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,6],"acting":[0,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.19","version":"267'2","reported_seq":534,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:24.003466+0000","last_change":"2024-09-14T13:02:24.003466+0000","last_active":"2024-09-14T13:02:24.003466+0000","last_peered":"2024-09-14T13:02:24.003466+0000","last_clean":"2024-09-14T13:02:24.003466+0000","last_became_active":"2024-09-14T11:08:25.799872+0000","last_became_peered":"2024-09-14T11:08:25.799872+0000","last_unstale":"2024-09-14T13:02:24.003466+0000","last_undegraded":"2024-09-14T13:02:24.003466+0000","last_fullsized":"2024-09-14T13:02:24.003466+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'2","last_scrub_stamp":"2024-09-14T13:02:24.003237+0000","last_deep_scrub":"267'2","last_deep_scrub_stamp":"2024-09-14T13:02:24.003237+0000","last_clean_scrub_stamp":"2024-09-14T13:02:24.003237+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:21:44.974939+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1a","version":"267'192","reported_seq":835,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:32.705517+0000","last_change":"2024-09-14T13:02:32.705517+0000","last_active":"2024-09-14T13:02:32.705517+0000","last_peered":"2024-09-14T13:02:32.705517+0000","last_clean":"2024-09-14T13:02:32.705517+0000","last_became_active":"2024-09-14T11:08:27.830707+0000","last_became_peered":"2024-09-14T11:08:27.830707+0000","last_unstale":"2024-09-14T13:02:32.705517+0000","last_undegraded":"2024-09-14T13:02:32.705517+0000","last_fullsized":"2024-09-14T13:02:32.705517+0000","mapping_epoch":30,"log_start":"264'100","ondisk_log_start":"264'100","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'192","last_scrub_stamp":"2024-09-14T13:02:32.705316+0000","last_deep_scrub":"267'192","last_deep_scrub_stamp":"2024-09-14T13:02:32.705316+0000","last_clean_scrub_stamp":"2024-09-14T13:02:32.705316+0000","objects_scrubbed":4,"log_size":92,"log_dups_size":100,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:21:58.094806+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8430,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":268,"num_read_kb":336,"num_write":152,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":529,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:36.162728+0000","last_change":"2024-09-14T13:02:36.162728+0000","last_active":"2024-09-14T13:02:36.162728+0000","last_peered":"2024-09-14T13:02:36.162728+0000","last_clean":"2024-09-14T13:02:36.162728+0000","last_became_active":"2024-09-14T11:08:29.810292+0000","last_became_peered":"2024-09-14T11:08:29.810292+0000","last_unstale":"2024-09-14T13:02:36.162728+0000","last_undegraded":"2024-09-14T13:02:36.162728+0000","last_fullsized":"2024-09-14T13:02:36.162728+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T13:02:36.162509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T13:02:36.162509+0000","last_clean_scrub_stamp":"2024-09-14T13:02:36.162509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T00:17:40.871354+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.14","version":"267'136","reported_seq":671,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:38.671148+0000","last_change":"2024-09-14T13:02:38.671148+0000","last_active":"2024-09-14T13:02:38.671148+0000","last_peered":"2024-09-14T13:02:38.671148+0000","last_clean":"2024-09-14T13:02:38.671148+0000","last_became_active":"2024-09-14T11:08:31.851483+0000","last_became_peered":"2024-09-14T11:08:31.851483+0000","last_unstale":"2024-09-14T13:02:38.671148+0000","last_undegraded":"2024-09-14T13:02:38.671148+0000","last_fullsized":"2024-09-14T13:02:38.671148+0000","mapping_epoch":34,"log_start":"267'100","ondisk_log_start":"267'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'136","last_scrub_stamp":"2024-09-14T13:02:38.670955+0000","last_deep_scrub":"267'136","last_deep_scrub_stamp":"2024-09-14T13:02:38.670955+0000","last_clean_scrub_stamp":"2024-09-14T13:02:38.670955+0000","objects_scrubbed":3,"log_size":36,"log_dups_size":100,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:31:36.294487+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":227,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":142,"num_read_kb":127,"num_write":323,"num_write_kb":76,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.27","version":"267'1176","reported_seq":2963,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:19.058530+0000","last_change":"2024-09-14T13:02:19.058530+0000","last_active":"2024-09-14T13:02:19.058530+0000","last_peered":"2024-09-14T13:02:19.058530+0000","last_clean":"2024-09-14T13:02:19.058530+0000","last_became_active":"2024-09-14T11:08:23.798225+0000","last_became_peered":"2024-09-14T11:08:23.798225+0000","last_unstale":"2024-09-14T13:02:19.058530+0000","last_undegraded":"2024-09-14T13:02:19.058530+0000","last_fullsized":"2024-09-14T13:02:19.058530+0000","mapping_epoch":26,"log_start":"267'1100","ondisk_log_start":"267'1100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'1176","last_scrub_stamp":"2024-09-14T13:02:19.058334+0000","last_deep_scrub":"267'1176","last_deep_scrub_stamp":"2024-09-14T13:02:19.058334+0000","last_clean_scrub_stamp":"2024-09-14T13:02:19.058334+0000","objects_scrubbed":2,"log_size":76,"log_dups_size":1100,"ondisk_log_size":76,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:40:22.783461+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":5564,"num_read_kb":4974,"num_write":1578,"num_write_kb":634,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2045,"num_omap_keys":8,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.20","version":"267'242","reported_seq":1004,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:12.288437+0000","last_change":"2024-09-14T13:02:12.288173+0000","last_active":"2024-09-14T13:02:12.288437+0000","last_peered":"2024-09-14T13:02:12.288437+0000","last_clean":"2024-09-14T13:02:12.288437+0000","last_became_active":"2024-09-14T11:08:21.816270+0000","last_became_peered":"2024-09-14T11:08:21.816270+0000","last_unstale":"2024-09-14T13:02:12.288437+0000","last_undegraded":"2024-09-14T13:02:12.288437+0000","last_fullsized":"2024-09-14T13:02:12.288437+0000","mapping_epoch":24,"log_start":"267'200","ondisk_log_start":"267'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'242","last_scrub_stamp":"2024-09-14T13:02:12.287850+0000","last_deep_scrub":"267'242","last_deep_scrub_stamp":"2024-09-14T13:02:12.287850+0000","last_clean_scrub_stamp":"2024-09-14T13:02:12.287850+0000","objects_scrubbed":1,"log_size":42,"log_dups_size":200,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:26:32.484498+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":896,"num_read_kb":196583,"num_write":965,"num_write_kb":33610,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,7],"acting":[6,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.26","version":"267'1295","reported_seq":2913,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:22.002876+0000","last_change":"2024-09-14T13:02:22.002876+0000","last_active":"2024-09-14T13:02:22.002876+0000","last_peered":"2024-09-14T13:02:22.002876+0000","last_clean":"2024-09-14T13:02:22.002876+0000","last_became_active":"2024-09-14T11:08:23.776349+0000","last_became_peered":"2024-09-14T11:08:23.776349+0000","last_unstale":"2024-09-14T13:02:22.002876+0000","last_undegraded":"2024-09-14T13:02:22.002876+0000","last_fullsized":"2024-09-14T13:02:22.002876+0000","mapping_epoch":26,"log_start":"267'1200","ondisk_log_start":"267'1200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'1295","last_scrub_stamp":"2024-09-14T13:02:22.002702+0000","last_deep_scrub":"267'1295","last_deep_scrub_stamp":"2024-09-14T13:02:22.002702+0000","last_clean_scrub_stamp":"2024-09-14T13:02:22.002702+0000","objects_scrubbed":3,"log_size":95,"log_dups_size":1200,"ondisk_log_size":95,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:05:44.720042+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":5862,"num_read_kb":5174,"num_write":1823,"num_write_kb":798,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.21","version":"267'158","reported_seq":805,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:10.134206+0000","last_change":"2024-09-14T13:02:10.134026+0000","last_active":"2024-09-14T13:02:10.134206+0000","last_peered":"2024-09-14T13:02:10.134206+0000","last_clean":"2024-09-14T13:02:10.134206+0000","last_became_active":"2024-09-14T11:08:21.778857+0000","last_became_peered":"2024-09-14T11:08:21.778857+0000","last_unstale":"2024-09-14T13:02:10.134206+0000","last_undegraded":"2024-09-14T13:02:10.134206+0000","last_fullsized":"2024-09-14T13:02:10.134206+0000","mapping_epoch":24,"log_start":"267'100","ondisk_log_start":"267'100","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'158","last_scrub_stamp":"2024-09-14T13:02:10.133843+0000","last_deep_scrub":"267'158","last_deep_scrub_stamp":"2024-09-14T13:02:10.133843+0000","last_clean_scrub_stamp":"2024-09-14T13:02:10.133843+0000","objects_scrubbed":0,"log_size":58,"log_dups_size":100,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:18:15.041071+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":436,"num_read_kb":8582,"num_write":806,"num_write_kb":19268,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,6],"acting":[2,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.25","version":"267'859","reported_seq":2589,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:25.484480+0000","last_change":"2024-09-14T13:02:25.484480+0000","last_active":"2024-09-14T13:02:25.484480+0000","last_peered":"2024-09-14T13:02:25.484480+0000","last_clean":"2024-09-14T13:02:25.484480+0000","last_became_active":"2024-09-14T11:08:23.808906+0000","last_became_peered":"2024-09-14T11:08:23.808906+0000","last_unstale":"2024-09-14T13:02:25.484480+0000","last_undegraded":"2024-09-14T13:02:25.484480+0000","last_fullsized":"2024-09-14T13:02:25.484480+0000","mapping_epoch":26,"log_start":"267'800","ondisk_log_start":"267'800","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'859","last_scrub_stamp":"2024-09-14T13:02:25.484273+0000","last_deep_scrub":"267'859","last_deep_scrub_stamp":"2024-09-14T13:02:25.484273+0000","last_clean_scrub_stamp":"2024-09-14T13:02:25.484273+0000","objects_scrubbed":3,"log_size":59,"log_dups_size":800,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:24:01.661481+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":4244,"num_read_kb":3835,"num_write":1129,"num_write_kb":418,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1533,"num_omap_keys":6,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.22","version":"267'246","reported_seq":964,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:13.387496+0000","last_change":"2024-09-14T13:02:13.387255+0000","last_active":"2024-09-14T13:02:13.387496+0000","last_peered":"2024-09-14T13:02:13.387496+0000","last_clean":"2024-09-14T13:02:13.387496+0000","last_became_active":"2024-09-14T11:08:21.795735+0000","last_became_peered":"2024-09-14T11:08:21.795735+0000","last_unstale":"2024-09-14T13:02:13.387496+0000","last_undegraded":"2024-09-14T13:02:13.387496+0000","last_fullsized":"2024-09-14T13:02:13.387496+0000","mapping_epoch":24,"log_start":"267'200","ondisk_log_start":"267'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'246","last_scrub_stamp":"2024-09-14T13:02:13.387035+0000","last_deep_scrub":"267'246","last_deep_scrub_stamp":"2024-09-14T13:02:13.387035+0000","last_clean_scrub_stamp":"2024-09-14T13:02:13.387035+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":200,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:34:00.780296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":704,"num_read_kb":92956,"num_write":1120,"num_write_kb":50908,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,0],"acting":[5,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.24","version":"267'426","reported_seq":2063,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:18.062230+0000","last_change":"2024-09-14T13:02:18.062230+0000","last_active":"2024-09-14T13:02:18.062230+0000","last_peered":"2024-09-14T13:02:18.062230+0000","last_clean":"2024-09-14T13:02:18.062230+0000","last_became_active":"2024-09-14T11:08:23.800722+0000","last_became_peered":"2024-09-14T11:08:23.800722+0000","last_unstale":"2024-09-14T13:02:18.062230+0000","last_undegraded":"2024-09-14T13:02:18.062230+0000","last_fullsized":"2024-09-14T13:02:18.062230+0000","mapping_epoch":26,"log_start":"267'400","ondisk_log_start":"267'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'426","last_scrub_stamp":"2024-09-14T13:02:18.062016+0000","last_deep_scrub":"267'426","last_deep_scrub_stamp":"2024-09-14T13:02:18.062016+0000","last_clean_scrub_stamp":"2024-09-14T13:02:18.062016+0000","objects_scrubbed":2,"log_size":26,"log_dups_size":400,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:49:37.783760+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2360,"num_read_kb":2243,"num_write":502,"num_write_kb":106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":252,"num_omap_keys":1,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.23","version":"267'220","reported_seq":902,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:08.038394+0000","last_change":"2024-09-14T13:02:08.038394+0000","last_active":"2024-09-14T13:02:08.038394+0000","last_peered":"2024-09-14T13:02:08.038394+0000","last_clean":"2024-09-14T13:02:08.038394+0000","last_became_active":"2024-09-14T11:08:21.815676+0000","last_became_peered":"2024-09-14T11:08:21.815676+0000","last_unstale":"2024-09-14T13:02:08.038394+0000","last_undegraded":"2024-09-14T13:02:08.038394+0000","last_fullsized":"2024-09-14T13:02:08.038394+0000","mapping_epoch":24,"log_start":"267'200","ondisk_log_start":"267'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'220","last_scrub_stamp":"2024-09-14T13:02:08.038198+0000","last_deep_scrub":"267'220","last_deep_scrub_stamp":"2024-09-14T13:02:08.038198+0000","last_clean_scrub_stamp":"2024-09-14T13:02:08.038198+0000","objects_scrubbed":2,"log_size":20,"log_dups_size":200,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:18:15.605049+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1655835,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":599,"num_read_kb":27875,"num_write":904,"num_write_kb":22739,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"267'896","reported_seq":2688,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:21.907268+0000","last_change":"2024-09-14T13:02:21.907268+0000","last_active":"2024-09-14T13:02:21.907268+0000","last_peered":"2024-09-14T13:02:21.907268+0000","last_clean":"2024-09-14T13:02:21.907268+0000","last_became_active":"2024-09-14T11:08:23.801373+0000","last_became_peered":"2024-09-14T11:08:23.801373+0000","last_unstale":"2024-09-14T13:02:21.907268+0000","last_undegraded":"2024-09-14T13:02:21.907268+0000","last_fullsized":"2024-09-14T13:02:21.907268+0000","mapping_epoch":26,"log_start":"267'800","ondisk_log_start":"267'800","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'896","last_scrub_stamp":"2024-09-14T13:02:21.907091+0000","last_deep_scrub":"267'896","last_deep_scrub_stamp":"2024-09-14T13:02:21.907091+0000","last_clean_scrub_stamp":"2024-09-14T13:02:21.907091+0000","objects_scrubbed":2,"log_size":96,"log_dups_size":800,"ondisk_log_size":96,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:05:33.862894+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":4489,"num_read_kb":4053,"num_write":1182,"num_write_kb":453,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2299,"num_omap_keys":9,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.24","version":"267'181","reported_seq":864,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:13.912432+0000","last_change":"2024-09-14T13:02:13.912432+0000","last_active":"2024-09-14T13:02:13.912432+0000","last_peered":"2024-09-14T13:02:13.912432+0000","last_clean":"2024-09-14T13:02:13.912432+0000","last_became_active":"2024-09-14T11:08:21.815768+0000","last_became_peered":"2024-09-14T11:08:21.815768+0000","last_unstale":"2024-09-14T13:02:13.912432+0000","last_undegraded":"2024-09-14T13:02:13.912432+0000","last_fullsized":"2024-09-14T13:02:13.912432+0000","mapping_epoch":24,"log_start":"267'100","ondisk_log_start":"267'100","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'181","last_scrub_stamp":"2024-09-14T13:02:13.912218+0000","last_deep_scrub":"267'181","last_deep_scrub_stamp":"2024-09-14T13:02:13.912218+0000","last_clean_scrub_stamp":"2024-09-14T13:02:13.912218+0000","objects_scrubbed":2,"log_size":81,"log_dups_size":100,"ondisk_log_size":81,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:34:44.221033+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":52,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":600,"num_read_kb":27323,"num_write":897,"num_write_kb":11503,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,0],"acting":[3,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"267'442","reported_seq":2007,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:19.739977+0000","last_change":"2024-09-14T13:02:19.739812+0000","last_active":"2024-09-14T13:02:19.739977+0000","last_peered":"2024-09-14T13:02:19.739977+0000","last_clean":"2024-09-14T13:02:19.739977+0000","last_became_active":"2024-09-14T11:08:23.814703+0000","last_became_peered":"2024-09-14T11:08:23.814703+0000","last_unstale":"2024-09-14T13:02:19.739977+0000","last_undegraded":"2024-09-14T13:02:19.739977+0000","last_fullsized":"2024-09-14T13:02:19.739977+0000","mapping_epoch":26,"log_start":"267'400","ondisk_log_start":"267'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'442","last_scrub_stamp":"2024-09-14T13:02:19.739631+0000","last_deep_scrub":"267'442","last_deep_scrub_stamp":"2024-09-14T13:02:19.739631+0000","last_clean_scrub_stamp":"2024-09-14T13:02:19.739631+0000","objects_scrubbed":1,"log_size":42,"log_dups_size":400,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:51:34.828557+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2315,"num_read_kb":2173,"num_write":509,"num_write_kb":111,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.25","version":"267'228","reported_seq":884,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:14.008418+0000","last_change":"2024-09-14T13:02:14.008418+0000","last_active":"2024-09-14T13:02:14.008418+0000","last_peered":"2024-09-14T13:02:14.008418+0000","last_clean":"2024-09-14T13:02:14.008418+0000","last_became_active":"2024-09-14T11:08:21.782389+0000","last_became_peered":"2024-09-14T11:08:21.782389+0000","last_unstale":"2024-09-14T13:02:14.008418+0000","last_undegraded":"2024-09-14T13:02:14.008418+0000","last_fullsized":"2024-09-14T13:02:14.008418+0000","mapping_epoch":24,"log_start":"267'200","ondisk_log_start":"267'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'228","last_scrub_stamp":"2024-09-14T13:02:14.008210+0000","last_deep_scrub":"267'228","last_deep_scrub_stamp":"2024-09-14T13:02:14.008210+0000","last_clean_scrub_stamp":"2024-09-14T13:02:14.008210+0000","objects_scrubbed":1,"log_size":28,"log_dups_size":200,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:24:23.674651+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":471,"num_read_kb":9844,"num_write":870,"num_write_kb":38372,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"267'1243","reported_seq":2977,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:19.913197+0000","last_change":"2024-09-14T13:02:19.912958+0000","last_active":"2024-09-14T13:02:19.913197+0000","last_peered":"2024-09-14T13:02:19.913197+0000","last_clean":"2024-09-14T13:02:19.913197+0000","last_became_active":"2024-09-14T11:08:23.785820+0000","last_became_peered":"2024-09-14T11:08:23.785820+0000","last_unstale":"2024-09-14T13:02:19.913197+0000","last_undegraded":"2024-09-14T13:02:19.913197+0000","last_fullsized":"2024-09-14T13:02:19.913197+0000","mapping_epoch":26,"log_start":"267'1200","ondisk_log_start":"267'1200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'1243","last_scrub_stamp":"2024-09-14T13:02:19.912720+0000","last_deep_scrub":"267'1243","last_deep_scrub_stamp":"2024-09-14T13:02:19.912720+0000","last_clean_scrub_stamp":"2024-09-14T13:02:19.912720+0000","objects_scrubbed":2,"log_size":43,"log_dups_size":1200,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:30:14.834421+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":5731,"num_read_kb":5079,"num_write":1712,"num_write_kb":696,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"267'214","reported_seq":938,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:11.283668+0000","last_change":"2024-09-14T13:02:11.283668+0000","last_active":"2024-09-14T13:02:11.283668+0000","last_peered":"2024-09-14T13:02:11.283668+0000","last_clean":"2024-09-14T13:02:11.283668+0000","last_became_active":"2024-09-14T11:08:21.824946+0000","last_became_peered":"2024-09-14T11:08:21.824946+0000","last_unstale":"2024-09-14T13:02:11.283668+0000","last_undegraded":"2024-09-14T13:02:11.283668+0000","last_fullsized":"2024-09-14T13:02:11.283668+0000","mapping_epoch":24,"log_start":"267'200","ondisk_log_start":"267'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'214","last_scrub_stamp":"2024-09-14T13:02:11.283441+0000","last_deep_scrub":"267'214","last_deep_scrub_stamp":"2024-09-14T13:02:11.283441+0000","last_clean_scrub_stamp":"2024-09-14T13:02:11.283441+0000","objects_scrubbed":4,"log_size":14,"log_dups_size":200,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T00:21:45.775876+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1655864,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":770,"num_read_kb":179397,"num_write":979,"num_write_kb":35238,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,4],"acting":[6,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.20","version":"267'1216","reported_seq":2947,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:18.359938+0000","last_change":"2024-09-14T13:02:18.359791+0000","last_active":"2024-09-14T13:02:18.359938+0000","last_peered":"2024-09-14T13:02:18.359938+0000","last_clean":"2024-09-14T13:02:18.359938+0000","last_became_active":"2024-09-14T11:08:23.803960+0000","last_became_peered":"2024-09-14T11:08:23.803960+0000","last_unstale":"2024-09-14T13:02:18.359938+0000","last_undegraded":"2024-09-14T13:02:18.359938+0000","last_fullsized":"2024-09-14T13:02:18.359938+0000","mapping_epoch":26,"log_start":"267'1200","ondisk_log_start":"267'1200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'1216","last_scrub_stamp":"2024-09-14T13:02:18.359610+0000","last_deep_scrub":"267'1216","last_deep_scrub_stamp":"2024-09-14T13:02:18.359610+0000","last_clean_scrub_stamp":"2024-09-14T13:02:18.359610+0000","objects_scrubbed":2,"log_size":16,"log_dups_size":1200,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:52:39.823830+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":5500,"num_read_kb":4892,"num_write":1634,"num_write_kb":643,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"267'220","reported_seq":879,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:12.010009+0000","last_change":"2024-09-14T13:02:12.010009+0000","last_active":"2024-09-14T13:02:12.010009+0000","last_peered":"2024-09-14T13:02:12.010009+0000","last_clean":"2024-09-14T13:02:12.010009+0000","last_became_active":"2024-09-14T11:08:56.033948+0000","last_became_peered":"2024-09-14T11:08:56.033948+0000","last_unstale":"2024-09-14T13:02:12.010009+0000","last_undegraded":"2024-09-14T13:02:12.010009+0000","last_fullsized":"2024-09-14T13:02:12.010009+0000","mapping_epoch":37,"log_start":"267'200","ondisk_log_start":"267'200","created":24,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'220","last_scrub_stamp":"2024-09-14T13:02:12.009666+0000","last_deep_scrub":"267'220","last_deep_scrub_stamp":"2024-09-14T13:02:12.009666+0000","last_clean_scrub_stamp":"2024-09-14T13:02:12.009666+0000","objects_scrubbed":2,"log_size":20,"log_dups_size":200,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:53:42.148559+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":41,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":570,"num_read_kb":57833,"num_write":1049,"num_write_kb":21583,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,2],"acting":[1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2f","version":"267'434","reported_seq":2054,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:17.078698+0000","last_change":"2024-09-14T13:02:17.078542+0000","last_active":"2024-09-14T13:02:17.078698+0000","last_peered":"2024-09-14T13:02:17.078698+0000","last_clean":"2024-09-14T13:02:17.078698+0000","last_became_active":"2024-09-14T11:08:23.786094+0000","last_became_peered":"2024-09-14T11:08:23.786094+0000","last_unstale":"2024-09-14T13:02:17.078698+0000","last_undegraded":"2024-09-14T13:02:17.078698+0000","last_fullsized":"2024-09-14T13:02:17.078698+0000","mapping_epoch":26,"log_start":"267'400","ondisk_log_start":"267'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'434","last_scrub_stamp":"2024-09-14T13:02:17.078358+0000","last_deep_scrub":"267'434","last_deep_scrub_stamp":"2024-09-14T13:02:17.078358+0000","last_clean_scrub_stamp":"2024-09-14T13:02:17.078358+0000","objects_scrubbed":1,"log_size":34,"log_dups_size":400,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T00:39:36.056692+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2284,"num_read_kb":2174,"num_write":475,"num_write_kb":81,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.28","version":"267'239","reported_seq":919,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:15.368994+0000","last_change":"2024-09-14T13:02:15.368994+0000","last_active":"2024-09-14T13:02:15.368994+0000","last_peered":"2024-09-14T13:02:15.368994+0000","last_clean":"2024-09-14T13:02:15.368994+0000","last_became_active":"2024-09-14T11:08:21.789114+0000","last_became_peered":"2024-09-14T11:08:21.789114+0000","last_unstale":"2024-09-14T13:02:15.368994+0000","last_undegraded":"2024-09-14T13:02:15.368994+0000","last_fullsized":"2024-09-14T13:02:15.368994+0000","mapping_epoch":24,"log_start":"267'200","ondisk_log_start":"267'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'239","last_scrub_stamp":"2024-09-14T13:02:15.368736+0000","last_deep_scrub":"267'239","last_deep_scrub_stamp":"2024-09-14T13:02:15.368736+0000","last_clean_scrub_stamp":"2024-09-14T13:02:15.368736+0000","objects_scrubbed":1,"log_size":39,"log_dups_size":200,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:43:13.070998+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":15,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":593,"num_read_kb":44666,"num_write":1104,"num_write_kb":41456,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,2],"acting":[5,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2e","version":"267'453","reported_seq":2220,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:21.736863+0000","last_change":"2024-09-14T13:02:21.736679+0000","last_active":"2024-09-14T13:02:21.736863+0000","last_peered":"2024-09-14T13:02:21.736863+0000","last_clean":"2024-09-14T13:02:21.736863+0000","last_became_active":"2024-09-14T11:08:23.792081+0000","last_became_peered":"2024-09-14T11:08:23.792081+0000","last_unstale":"2024-09-14T13:02:21.736863+0000","last_undegraded":"2024-09-14T13:02:21.736863+0000","last_fullsized":"2024-09-14T13:02:21.736863+0000","mapping_epoch":26,"log_start":"267'400","ondisk_log_start":"267'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'453","last_scrub_stamp":"2024-09-14T13:02:21.736487+0000","last_deep_scrub":"267'453","last_deep_scrub_stamp":"2024-09-14T13:02:21.736487+0000","last_clean_scrub_stamp":"2024-09-14T13:02:21.736487+0000","objects_scrubbed":2,"log_size":53,"log_dups_size":400,"ondisk_log_size":53,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:03:31.698697+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2579,"num_read_kb":2481,"num_write":491,"num_write_kb":76,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":220,"num_omap_keys":1,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.29","version":"267'201","reported_seq":905,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:14.155576+0000","last_change":"2024-09-14T13:02:14.155576+0000","last_active":"2024-09-14T13:02:14.155576+0000","last_peered":"2024-09-14T13:02:14.155576+0000","last_clean":"2024-09-14T13:02:14.155576+0000","last_became_active":"2024-09-14T11:08:56.039007+0000","last_became_peered":"2024-09-14T11:08:56.039007+0000","last_unstale":"2024-09-14T13:02:14.155576+0000","last_undegraded":"2024-09-14T13:02:14.155576+0000","last_fullsized":"2024-09-14T13:02:14.155576+0000","mapping_epoch":37,"log_start":"267'100","ondisk_log_start":"267'100","created":24,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'201","last_scrub_stamp":"2024-09-14T13:02:14.155355+0000","last_deep_scrub":"267'201","last_deep_scrub_stamp":"2024-09-14T13:02:14.155355+0000","last_clean_scrub_stamp":"2024-09-14T13:02:14.155355+0000","objects_scrubbed":0,"log_size":101,"log_dups_size":100,"ondisk_log_size":101,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:51:47.112960+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":677,"num_read_kb":34418,"num_write":912,"num_write_kb":30711,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4,1],"acting":[2,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2d","version":"267'383","reported_seq":1953,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:16.174203+0000","last_change":"2024-09-14T13:02:16.174203+0000","last_active":"2024-09-14T13:02:16.174203+0000","last_peered":"2024-09-14T13:02:16.174203+0000","last_clean":"2024-09-14T13:02:16.174203+0000","last_became_active":"2024-09-14T11:08:23.806568+0000","last_became_peered":"2024-09-14T11:08:23.806568+0000","last_unstale":"2024-09-14T13:02:16.174203+0000","last_undegraded":"2024-09-14T13:02:16.174203+0000","last_fullsized":"2024-09-14T13:02:16.174203+0000","mapping_epoch":26,"log_start":"267'300","ondisk_log_start":"267'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'383","last_scrub_stamp":"2024-09-14T13:02:16.173997+0000","last_deep_scrub":"267'383","last_deep_scrub_stamp":"2024-09-14T13:02:16.173997+0000","last_clean_scrub_stamp":"2024-09-14T13:02:16.173997+0000","objects_scrubbed":1,"log_size":83,"log_dups_size":300,"ondisk_log_size":83,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:32:46.305855+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2181,"num_read_kb":2088,"num_write":442,"num_write_kb":83,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":244,"num_omap_keys":1,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2a","version":"267'214","reported_seq":858,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:16.413733+0000","last_change":"2024-09-14T13:02:16.413733+0000","last_active":"2024-09-14T13:02:16.413733+0000","last_peered":"2024-09-14T13:02:16.413733+0000","last_clean":"2024-09-14T13:02:16.413733+0000","last_became_active":"2024-09-14T11:08:55.882680+0000","last_became_peered":"2024-09-14T11:08:55.882680+0000","last_unstale":"2024-09-14T13:02:16.413733+0000","last_undegraded":"2024-09-14T13:02:16.413733+0000","last_fullsized":"2024-09-14T13:02:16.413733+0000","mapping_epoch":37,"log_start":"267'200","ondisk_log_start":"267'200","created":24,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'214","last_scrub_stamp":"2024-09-14T13:02:16.413519+0000","last_deep_scrub":"267'214","last_deep_scrub_stamp":"2024-09-14T13:02:16.413519+0000","last_clean_scrub_stamp":"2024-09-14T13:02:16.413519+0000","objects_scrubbed":3,"log_size":14,"log_dups_size":200,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:42:07.787664+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1655850,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":491,"num_read_kb":10245,"num_write":964,"num_write_kb":42313,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,1],"acting":[5,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2c","version":"267'620","reported_seq":2469,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:20.699544+0000","last_change":"2024-09-14T13:02:20.699544+0000","last_active":"2024-09-14T13:02:20.699544+0000","last_peered":"2024-09-14T13:02:20.699544+0000","last_clean":"2024-09-14T13:02:20.699544+0000","last_became_active":"2024-09-14T11:08:23.815121+0000","last_became_peered":"2024-09-14T11:08:23.815121+0000","last_unstale":"2024-09-14T13:02:20.699544+0000","last_undegraded":"2024-09-14T13:02:20.699544+0000","last_fullsized":"2024-09-14T13:02:20.699544+0000","mapping_epoch":26,"log_start":"267'600","ondisk_log_start":"267'600","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'620","last_scrub_stamp":"2024-09-14T13:02:20.699374+0000","last_deep_scrub":"267'620","last_deep_scrub_stamp":"2024-09-14T13:02:20.699374+0000","last_clean_scrub_stamp":"2024-09-14T13:02:20.699374+0000","objects_scrubbed":3,"log_size":20,"log_dups_size":600,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:26:58.705973+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3483,"num_read_kb":3244,"num_write":793,"num_write_kb":264,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2264,"num_omap_keys":9,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2b","version":"267'200","reported_seq":854,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:07.028318+0000","last_change":"2024-09-14T13:02:07.028318+0000","last_active":"2024-09-14T13:02:07.028318+0000","last_peered":"2024-09-14T13:02:07.028318+0000","last_clean":"2024-09-14T13:02:07.028318+0000","last_became_active":"2024-09-14T11:08:21.788281+0000","last_became_peered":"2024-09-14T11:08:21.788281+0000","last_unstale":"2024-09-14T13:02:07.028318+0000","last_undegraded":"2024-09-14T13:02:07.028318+0000","last_fullsized":"2024-09-14T13:02:07.028318+0000","mapping_epoch":24,"log_start":"267'100","ondisk_log_start":"267'100","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'200","last_scrub_stamp":"2024-09-14T13:02:07.028196+0000","last_deep_scrub":"267'200","last_deep_scrub_stamp":"2024-09-14T13:02:07.028196+0000","last_clean_scrub_stamp":"2024-09-14T13:02:07.028196+0000","objects_scrubbed":2,"log_size":100,"log_dups_size":100,"ondisk_log_size":100,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:49:29.752326+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":52,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":436,"num_read_kb":38929,"num_write":900,"num_write_kb":25858,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,1],"acting":[0,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2b","version":"267'916","reported_seq":2525,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:22.632478+0000","last_change":"2024-09-14T13:02:22.632478+0000","last_active":"2024-09-14T13:02:22.632478+0000","last_peered":"2024-09-14T13:02:22.632478+0000","last_clean":"2024-09-14T13:02:22.632478+0000","last_became_active":"2024-09-14T11:08:23.806952+0000","last_became_peered":"2024-09-14T11:08:23.806952+0000","last_unstale":"2024-09-14T13:02:22.632478+0000","last_undegraded":"2024-09-14T13:02:22.632478+0000","last_fullsized":"2024-09-14T13:02:22.632478+0000","mapping_epoch":26,"log_start":"267'900","ondisk_log_start":"267'900","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'916","last_scrub_stamp":"2024-09-14T13:02:22.632309+0000","last_deep_scrub":"267'916","last_deep_scrub_stamp":"2024-09-14T13:02:22.632309+0000","last_clean_scrub_stamp":"2024-09-14T13:02:22.632309+0000","objects_scrubbed":4,"log_size":16,"log_dups_size":900,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:53:03.488492+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":4419,"num_read_kb":3921,"num_write":1287,"num_write_kb":515,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":267,"num_omap_keys":1,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"267'231","reported_seq":913,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:13.270037+0000","last_change":"2024-09-14T13:02:13.270037+0000","last_active":"2024-09-14T13:02:13.270037+0000","last_peered":"2024-09-14T13:02:13.270037+0000","last_clean":"2024-09-14T13:02:13.270037+0000","last_became_active":"2024-09-14T11:08:21.836420+0000","last_became_peered":"2024-09-14T11:08:21.836420+0000","last_unstale":"2024-09-14T13:02:13.270037+0000","last_undegraded":"2024-09-14T13:02:13.270037+0000","last_fullsized":"2024-09-14T13:02:13.270037+0000","mapping_epoch":24,"log_start":"267'200","ondisk_log_start":"267'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'231","last_scrub_stamp":"2024-09-14T13:02:13.269834+0000","last_deep_scrub":"267'231","last_deep_scrub_stamp":"2024-09-14T13:02:13.269834+0000","last_clean_scrub_stamp":"2024-09-14T13:02:13.269834+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":200,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:47:11.483558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":678,"num_read_kb":43780,"num_write":1054,"num_write_kb":42822,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.2a","version":"267'459","reported_seq":2096,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:13.094279+0000","last_change":"2024-09-14T13:02:13.094279+0000","last_active":"2024-09-14T13:02:13.094279+0000","last_peered":"2024-09-14T13:02:13.094279+0000","last_clean":"2024-09-14T13:02:13.094279+0000","last_became_active":"2024-09-14T11:08:23.776554+0000","last_became_peered":"2024-09-14T11:08:23.776554+0000","last_unstale":"2024-09-14T13:02:13.094279+0000","last_undegraded":"2024-09-14T13:02:13.094279+0000","last_fullsized":"2024-09-14T13:02:13.094279+0000","mapping_epoch":26,"log_start":"267'400","ondisk_log_start":"267'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'459","last_scrub_stamp":"2024-09-14T13:02:13.094066+0000","last_deep_scrub":"267'459","last_deep_scrub_stamp":"2024-09-14T13:02:13.094066+0000","last_clean_scrub_stamp":"2024-09-14T13:02:13.094066+0000","objects_scrubbed":2,"log_size":59,"log_dups_size":400,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:03:41.733902+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2491,"num_read_kb":2349,"num_write":540,"num_write_kb":122,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2d","version":"267'208","reported_seq":864,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:15.639487+0000","last_change":"2024-09-14T13:02:15.639487+0000","last_active":"2024-09-14T13:02:15.639487+0000","last_peered":"2024-09-14T13:02:15.639487+0000","last_clean":"2024-09-14T13:02:15.639487+0000","last_became_active":"2024-09-14T11:08:21.828333+0000","last_became_peered":"2024-09-14T11:08:21.828333+0000","last_unstale":"2024-09-14T13:02:15.639487+0000","last_undegraded":"2024-09-14T13:02:15.639487+0000","last_fullsized":"2024-09-14T13:02:15.639487+0000","mapping_epoch":24,"log_start":"267'100","ondisk_log_start":"267'100","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'208","last_scrub_stamp":"2024-09-14T13:02:15.639239+0000","last_deep_scrub":"267'208","last_deep_scrub_stamp":"2024-09-14T13:02:15.639239+0000","last_clean_scrub_stamp":"2024-09-14T13:02:15.639239+0000","objects_scrubbed":2,"log_size":108,"log_dups_size":100,"ondisk_log_size":108,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:07:15.141985+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":26,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":514,"num_read_kb":35640,"num_write":904,"num_write_kb":31502,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,6],"acting":[7,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.29","version":"267'786","reported_seq":2517,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:28.948747+0000","last_change":"2024-09-14T13:02:28.948747+0000","last_active":"2024-09-14T13:02:28.948747+0000","last_peered":"2024-09-14T13:02:28.948747+0000","last_clean":"2024-09-14T13:02:28.948747+0000","last_became_active":"2024-09-14T11:08:23.783522+0000","last_became_peered":"2024-09-14T11:08:23.783522+0000","last_unstale":"2024-09-14T13:02:28.948747+0000","last_undegraded":"2024-09-14T13:02:28.948747+0000","last_fullsized":"2024-09-14T13:02:28.948747+0000","mapping_epoch":26,"log_start":"267'700","ondisk_log_start":"267'700","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'786","last_scrub_stamp":"2024-09-14T13:02:28.948565+0000","last_deep_scrub":"267'786","last_deep_scrub_stamp":"2024-09-14T13:02:28.948565+0000","last_clean_scrub_stamp":"2024-09-14T13:02:28.948565+0000","objects_scrubbed":3,"log_size":86,"log_dups_size":700,"ondisk_log_size":86,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T00:05:57.662593+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":4481,"num_read_kb":4083,"num_write":1109,"num_write_kb":423,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"267'190","reported_seq":884,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:15.180254+0000","last_change":"2024-09-14T13:02:15.180078+0000","last_active":"2024-09-14T13:02:15.180254+0000","last_peered":"2024-09-14T13:02:15.180254+0000","last_clean":"2024-09-14T13:02:15.180254+0000","last_became_active":"2024-09-14T11:08:21.808348+0000","last_became_peered":"2024-09-14T11:08:21.808348+0000","last_unstale":"2024-09-14T13:02:15.180254+0000","last_undegraded":"2024-09-14T13:02:15.180254+0000","last_fullsized":"2024-09-14T13:02:15.180254+0000","mapping_epoch":24,"log_start":"267'100","ondisk_log_start":"267'100","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'190","last_scrub_stamp":"2024-09-14T13:02:15.179872+0000","last_deep_scrub":"267'190","last_deep_scrub_stamp":"2024-09-14T13:02:15.179872+0000","last_clean_scrub_stamp":"2024-09-14T13:02:15.179872+0000","objects_scrubbed":2,"log_size":90,"log_dups_size":100,"ondisk_log_size":90,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:01:20.740863+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":26,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":617,"num_read_kb":79967,"num_write":853,"num_write_kb":37043,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,1],"acting":[2,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"267'413","reported_seq":2123,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:21.644417+0000","last_change":"2024-09-14T13:02:21.644417+0000","last_active":"2024-09-14T13:02:21.644417+0000","last_peered":"2024-09-14T13:02:21.644417+0000","last_clean":"2024-09-14T13:02:21.644417+0000","last_became_active":"2024-09-14T11:08:23.802357+0000","last_became_peered":"2024-09-14T11:08:23.802357+0000","last_unstale":"2024-09-14T13:02:21.644417+0000","last_undegraded":"2024-09-14T13:02:21.644417+0000","last_fullsized":"2024-09-14T13:02:21.644417+0000","mapping_epoch":26,"log_start":"267'400","ondisk_log_start":"267'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'413","last_scrub_stamp":"2024-09-14T13:02:21.644233+0000","last_deep_scrub":"267'413","last_deep_scrub_stamp":"2024-09-14T13:02:21.644233+0000","last_clean_scrub_stamp":"2024-09-14T13:02:21.644233+0000","objects_scrubbed":2,"log_size":13,"log_dups_size":400,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:28:20.653691+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2549,"num_read_kb":2448,"num_write":474,"num_write_kb":95,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":640,"num_omap_keys":3,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2f","version":"267'225","reported_seq":958,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:17.443355+0000","last_change":"2024-09-14T13:02:17.443094+0000","last_active":"2024-09-14T13:02:17.443355+0000","last_peered":"2024-09-14T13:02:17.443355+0000","last_clean":"2024-09-14T13:02:17.443355+0000","last_became_active":"2024-09-14T11:08:55.884851+0000","last_became_peered":"2024-09-14T11:08:55.884851+0000","last_unstale":"2024-09-14T13:02:17.443355+0000","last_undegraded":"2024-09-14T13:02:17.443355+0000","last_fullsized":"2024-09-14T13:02:17.443355+0000","mapping_epoch":37,"log_start":"267'200","ondisk_log_start":"267'200","created":24,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'225","last_scrub_stamp":"2024-09-14T13:02:17.442773+0000","last_deep_scrub":"267'225","last_deep_scrub_stamp":"2024-09-14T13:02:17.442773+0000","last_clean_scrub_stamp":"2024-09-14T13:02:17.442773+0000","objects_scrubbed":4,"log_size":25,"log_dups_size":200,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T00:39:22.131524+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":41,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":799,"num_read_kb":23166,"num_write":1000,"num_write_kb":40111,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,1],"acting":[5,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"267'231","reported_seq":927,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:18.476013+0000","last_change":"2024-09-14T13:02:18.475827+0000","last_active":"2024-09-14T13:02:18.476013+0000","last_peered":"2024-09-14T13:02:18.476013+0000","last_clean":"2024-09-14T13:02:18.476013+0000","last_became_active":"2024-09-14T11:08:56.033792+0000","last_became_peered":"2024-09-14T11:08:56.033792+0000","last_unstale":"2024-09-14T13:02:18.476013+0000","last_undegraded":"2024-09-14T13:02:18.476013+0000","last_fullsized":"2024-09-14T13:02:18.476013+0000","mapping_epoch":37,"log_start":"267'200","ondisk_log_start":"267'200","created":24,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'231","last_scrub_stamp":"2024-09-14T13:02:18.475601+0000","last_deep_scrub":"267'231","last_deep_scrub_stamp":"2024-09-14T13:02:18.475601+0000","last_clean_scrub_stamp":"2024-09-14T13:02:18.475601+0000","objects_scrubbed":5,"log_size":31,"log_dups_size":200,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:44:49.980682+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":26,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":576,"num_read_kb":92149,"num_write":1016,"num_write_kb":50173,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,0],"acting":[5,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.37","version":"267'502","reported_seq":2186,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:21.955388+0000","last_change":"2024-09-14T13:02:21.955235+0000","last_active":"2024-09-14T13:02:21.955388+0000","last_peered":"2024-09-14T13:02:21.955388+0000","last_clean":"2024-09-14T13:02:21.955388+0000","last_became_active":"2024-09-14T11:08:23.786473+0000","last_became_peered":"2024-09-14T11:08:23.786473+0000","last_unstale":"2024-09-14T13:02:21.955388+0000","last_undegraded":"2024-09-14T13:02:21.955388+0000","last_fullsized":"2024-09-14T13:02:21.955388+0000","mapping_epoch":26,"log_start":"267'400","ondisk_log_start":"267'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'502","last_scrub_stamp":"2024-09-14T13:02:21.955052+0000","last_deep_scrub":"267'502","last_deep_scrub_stamp":"2024-09-14T13:02:21.955052+0000","last_clean_scrub_stamp":"2024-09-14T13:02:21.955052+0000","objects_scrubbed":2,"log_size":102,"log_dups_size":400,"ondisk_log_size":102,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:16:43.466742+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2870,"num_read_kb":2681,"num_write":627,"num_write_kb":170,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":219,"num_omap_keys":1,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"267'229","reported_seq":908,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:10.024446+0000","last_change":"2024-09-14T13:02:10.024200+0000","last_active":"2024-09-14T13:02:10.024446+0000","last_peered":"2024-09-14T13:02:10.024446+0000","last_clean":"2024-09-14T13:02:10.024446+0000","last_became_active":"2024-09-14T11:08:21.815731+0000","last_became_peered":"2024-09-14T11:08:21.815731+0000","last_unstale":"2024-09-14T13:02:10.024446+0000","last_undegraded":"2024-09-14T13:02:10.024446+0000","last_fullsized":"2024-09-14T13:02:10.024446+0000","mapping_epoch":24,"log_start":"267'200","ondisk_log_start":"267'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'229","last_scrub_stamp":"2024-09-14T13:02:10.023871+0000","last_deep_scrub":"267'229","last_deep_scrub_stamp":"2024-09-14T13:02:10.023871+0000","last_clean_scrub_stamp":"2024-09-14T13:02:10.023871+0000","objects_scrubbed":3,"log_size":29,"log_dups_size":200,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:09:15.766050+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":31,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":597,"num_read_kb":25561,"num_write":1006,"num_write_kb":42149,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,5],"acting":[1,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.36","version":"267'908","reported_seq":2503,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:24.440484+0000","last_change":"2024-09-14T13:02:24.440484+0000","last_active":"2024-09-14T13:02:24.440484+0000","last_peered":"2024-09-14T13:02:24.440484+0000","last_clean":"2024-09-14T13:02:24.440484+0000","last_became_active":"2024-09-14T11:08:23.797135+0000","last_became_peered":"2024-09-14T11:08:23.797135+0000","last_unstale":"2024-09-14T13:02:24.440484+0000","last_undegraded":"2024-09-14T13:02:24.440484+0000","last_fullsized":"2024-09-14T13:02:24.440484+0000","mapping_epoch":26,"log_start":"267'800","ondisk_log_start":"267'800","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'908","last_scrub_stamp":"2024-09-14T13:02:24.440300+0000","last_deep_scrub":"267'908","last_deep_scrub_stamp":"2024-09-14T13:02:24.440300+0000","last_clean_scrub_stamp":"2024-09-14T13:02:24.440300+0000","objects_scrubbed":1,"log_size":108,"log_dups_size":800,"ondisk_log_size":108,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:55:55.201914+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4302,"num_read_kb":3816,"num_write":1266,"num_write_kb":491,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]}],"pool_stats":[{"poolid":65,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10893,"num_read_kb":9222,"num_write":3117,"num_write_kb":1014,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1012,"ondisk_log_size":1012,"up":64,"acting":64,"num_store_stats":8},{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":14831,"num_objects":87,"num_object_clones":0,"num_object_copies":174,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":87,"num_whiteouts":0,"num_read":15223,"num_read_kb":14878,"num_write":17077,"num_write_kb":4995,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":19,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2512,"num_omap_keys":16,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":557056,"data_stored":29662,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1694,"ondisk_log_size":1694,"up":64,"acting":64,"num_store_stats":8},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":471,"ondisk_log_size":471,"up":64,"acting":64,"num_store_stats":8},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":416072,"num_objects":199,"num_object_clones":0,"num_object_copies":398,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":199,"num_whiteouts":0,"num_read":11985,"num_read_kb":14520,"num_write":8681,"num_write_kb":3819,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":23,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":713660,"num_omap_keys":1632,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":278528,"data_stored":7404,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2096,"ondisk_log_size":2096,"up":64,"acting":64,"num_store_stats":8},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":1793,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":2383,"num_read_kb":2845,"num_write":20,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":3586,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":17,"ondisk_log_size":17,"up":64,"acting":64,"num_store_stats":8},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":143,"num_object_clones":0,"num_object_copies":286,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":143,"num_whiteouts":0,"num_read":221865,"num_read_kb":203092,"num_write":56157,"num_write_kb":19250,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":143,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":35486,"num_omap_keys":143,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3618,"ondisk_log_size":3618,"up":128,"acting":128,"num_store_stats":8},{"poolid":68,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":12,"num_read_kb":12,"num_write":18,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":752,"num_omap_keys":8,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":10,"ondisk_log_size":10,"up":64,"acting":64,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":34033097,"num_objects":166,"num_object_clones":0,"num_object_copies":498,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":166,"num_whiteouts":0,"num_read":42946,"num_read_kb":2820718,"num_write":64530,"num_write_kb":2216242,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":52617216,"data_stored":52617216,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3536,"ondisk_log_size":3536,"up":192,"acting":192,"num_store_stats":8},{"poolid":67,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":172,"num_read_kb":198130,"num_write":186,"num_write_kb":125738,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":126,"ondisk_log_size":126,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":5,"ondisk_log_size":5,"up":16,"acting":16,"num_store_stats":7},{"poolid":66,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":168,"num_read_kb":188216,"num_write":186,"num_write_kb":125738,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":126,"ondisk_log_size":126,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":74,"ondisk_log_size":74,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834576230,"num_pgs":106,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":255424,"kb_used_data":13232,"kb_used_omap":1,"kb_used_meta":242174,"kb_avail":94116416,"statfs":{"total":96636764160,"available":96375209984,"internally_reserved":0,"allocated":13549568,"data_stored":11411092,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":247986634},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":13,"seq":55834576236,"num_pgs":99,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":242596,"kb_used_data":8724,"kb_used_omap":1,"kb_used_meta":233854,"kb_avail":94129244,"statfs":{"total":96636764160,"available":96388345856,"internally_reserved":0,"allocated":8933376,"data_stored":6850023,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":239466950},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":13,"seq":55834576234,"num_pgs":103,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":91384,"kb_used_data":10216,"kb_used_omap":1,"kb_used_meta":81150,"kb_avail":94280456,"statfs":{"total":96636764160,"available":96543186944,"internally_reserved":0,"allocated":10461184,"data_stored":8310166,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":83098053},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834576235,"num_pgs":105,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":121100,"kb_used_data":13564,"kb_used_omap":1,"kb_used_meta":107518,"kb_avail":94250740,"statfs":{"total":96636764160,"available":96512757760,"internally_reserved":0,"allocated":13889536,"data_stored":11826037,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":110098885},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":13,"seq":55834576237,"num_pgs":124,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":239884,"kb_used_data":10172,"kb_used_omap":1,"kb_used_meta":229694,"kb_avail":94131956,"statfs":{"total":96636764160,"available":96391122944,"internally_reserved":0,"allocated":10416128,"data_stored":8289369,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":235207111},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834576234,"num_pgs":92,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":97412,"kb_used_data":7924,"kb_used_omap":1,"kb_used_meta":89470,"kb_avail":94274428,"statfs":{"total":96636764160,"available":96537014272,"internally_reserved":0,"allocated":8114176,"data_stored":6032250,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":91617733},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834576237,"num_pgs":112,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":151660,"kb_used_data":12252,"kb_used_omap":1,"kb_used_meta":139390,"kb_avail":94220180,"statfs":{"total":96636764160,"available":96481464320,"internally_reserved":0,"allocated":12546048,"data_stored":10442210,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":142735813},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834576235,"num_pgs":109,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":244868,"kb_used_data":10996,"kb_used_omap":1,"kb_used_meta":233854,"kb_avail":94126972,"statfs":{"total":96636764160,"available":96386019328,"internally_reserved":0,"allocated":11259904,"data_stored":9137303,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":239466949},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":6234112,"data_stored":6234112,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8130560,"data_stored":8130560,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":3719168,"data_stored":3719168,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":5976064,"data_stored":5976064,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":9515008,"data_stored":9515008,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":5996544,"data_stored":5996544,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4538368,"data_stored":4538368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8507392,"data_stored":8507392,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":1139,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":46,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":1185,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":562,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":184,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":470,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":880,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":1018,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":330,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":1210,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":220,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":1458,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":814,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":1474,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":86016,"data_stored":3328,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":3091,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4091,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":86016,"data_stored":4619,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":2771,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":77824,"data_stored":4485,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":2895,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":86016,"data_stored":4382,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-14T13:03:09.373 INFO:tasks.ceph:pgid 68.19 last_scrub_stamp 2024-09-14T11:58:42.635024+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=42, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=2, tm_sec=2, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:03:09.373 INFO:tasks.ceph:pgid 68.1e last_scrub_stamp 2024-09-14T11:58:42.635024+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=42, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=2, tm_sec=2, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:03:09.373 INFO:tasks.ceph:pgid 68.1c last_scrub_stamp 2024-09-14T11:58:42.635024+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=42, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=2, tm_sec=2, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:03:09.374 INFO:tasks.ceph:pgid 68.1d last_scrub_stamp 2024-09-14T11:58:42.635024+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=42, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=2, tm_sec=2, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:03:09.374 INFO:tasks.ceph:pgid 68.16 last_scrub_stamp 2024-09-14T11:58:42.635024+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=42, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=2, tm_sec=2, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:03:09.374 INFO:tasks.ceph:pgid 68.15 last_scrub_stamp 2024-09-14T11:58:42.635024+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=58, tm_sec=42, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=13, tm_min=2, tm_sec=2, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T13:03:09.377 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-09-14T13:03:29.379 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-14T13:03:29.742 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-09-14T13:03:29.759 INFO:teuthology.orchestra.run.smithi138.stderr:dumped all 2024-09-14T13:03:29.761 INFO:teuthology.orchestra.run.smithi138.stdout:{"pg_ready":true,"pg_map":{"version":3721,"stamp":"2024-09-14T13:03:29.356324+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":35056180,"num_objects":619,"num_object_clones":0,"num_object_copies":1404,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":619,"num_whiteouts":0,"num_read":305713,"num_read_kb":3451688,"num_write":150075,"num_write_kb":2498451,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":191,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":752786,"num_omap_keys":1803,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":12787,"ondisk_log_size":12787,"up":850,"acting":850,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":850,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":1444328,"kb_used_data":87080,"kb_used_omap":12,"kb_used_meta":1357107,"kb_avail":753530392,"statfs":{"total":773094113280,"available":771615121408,"internally_reserved":0,"allocated":89169920,"data_stored":72298450,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":1389678128},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.007918"},"pg_stats":[{"pgid":"68.1a","version":"0'0","reported_seq":46,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:54.300119+0000","last_change":"2024-09-14T13:02:54.300119+0000","last_active":"2024-09-14T13:02:54.300119+0000","last_peered":"2024-09-14T13:02:54.300119+0000","last_clean":"2024-09-14T13:02:54.300119+0000","last_became_active":"2024-09-14T11:58:43.694936+0000","last_became_peered":"2024-09-14T11:58:43.694936+0000","last_unstale":"2024-09-14T13:02:54.300119+0000","last_undegraded":"2024-09-14T13:02:54.300119+0000","last_fullsized":"2024-09-14T13:02:54.300119+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T13:02:54.299919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T13:02:54.299919+0000","last_clean_scrub_stamp":"2024-09-14T13:02:54.299919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:18:11.680663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.1d","version":"264'2","reported_seq":72,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:55.313039+0000","last_change":"2024-09-14T13:02:55.313039+0000","last_active":"2024-09-14T13:02:55.313039+0000","last_peered":"2024-09-14T13:02:55.313039+0000","last_clean":"2024-09-14T13:02:55.313039+0000","last_became_active":"2024-09-14T11:30:17.525157+0000","last_became_peered":"2024-09-14T11:30:17.525157+0000","last_unstale":"2024-09-14T13:02:55.313039+0000","last_undegraded":"2024-09-14T13:02:55.313039+0000","last_fullsized":"2024-09-14T13:02:55.313039+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'2","last_scrub_stamp":"2024-09-14T13:02:55.312848+0000","last_deep_scrub":"264'2","last_deep_scrub_stamp":"2024-09-14T13:02:55.312848+0000","last_clean_scrub_stamp":"2024-09-14T13:02:55.312848+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T00:17:42.418932+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":4096,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.1c","version":"267'6","reported_seq":85,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:51.892891+0000","last_change":"2024-09-14T13:02:51.892891+0000","last_active":"2024-09-14T13:02:51.892891+0000","last_peered":"2024-09-14T13:02:51.892891+0000","last_clean":"2024-09-14T13:02:51.892891+0000","last_became_active":"2024-09-14T11:30:10.460441+0000","last_became_peered":"2024-09-14T11:30:10.460441+0000","last_unstale":"2024-09-14T13:02:51.892891+0000","last_undegraded":"2024-09-14T13:02:51.892891+0000","last_fullsized":"2024-09-14T13:02:51.892891+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'6","last_scrub_stamp":"2024-09-14T13:02:51.892713+0000","last_deep_scrub":"267'6","last_deep_scrub_stamp":"2024-09-14T13:02:51.892713+0000","last_clean_scrub_stamp":"2024-09-14T13:02:51.892713+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:24:14.376066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":6189,"num_write":6,"num_write_kb":5165,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.1f","version":"267'84","reported_seq":321,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:59.133572+0000","last_change":"2024-09-14T13:02:59.133572+0000","last_active":"2024-09-14T13:02:59.133572+0000","last_peered":"2024-09-14T13:02:59.133572+0000","last_clean":"2024-09-14T13:02:59.133572+0000","last_became_active":"2024-09-14T11:24:10.104105+0000","last_became_peered":"2024-09-14T11:24:10.104105+0000","last_unstale":"2024-09-14T13:02:59.133572+0000","last_undegraded":"2024-09-14T13:02:59.133572+0000","last_fullsized":"2024-09-14T13:02:59.133572+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'84","last_scrub_stamp":"2024-09-14T13:02:59.133390+0000","last_deep_scrub":"267'84","last_deep_scrub_stamp":"2024-09-14T13:02:59.133390+0000","last_clean_scrub_stamp":"2024-09-14T13:02:59.133390+0000","objects_scrubbed":0,"log_size":84,"log_dups_size":0,"ondisk_log_size":84,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:37:47.396908+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":704,"num_read_kb":504,"num_write":208,"num_write_kb":68,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.1b","version":"0'0","reported_seq":46,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:40.128400+0000","last_change":"2024-09-14T13:02:40.128400+0000","last_active":"2024-09-14T13:02:40.128400+0000","last_peered":"2024-09-14T13:02:40.128400+0000","last_clean":"2024-09-14T13:02:40.128400+0000","last_became_active":"2024-09-14T11:58:43.693847+0000","last_became_peered":"2024-09-14T11:58:43.693847+0000","last_unstale":"2024-09-14T13:02:40.128400+0000","last_undegraded":"2024-09-14T13:02:40.128400+0000","last_fullsized":"2024-09-14T13:02:40.128400+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T13:02:40.128214+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T13:02:40.128214+0000","last_clean_scrub_stamp":"2024-09-14T13:02:40.128214+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:40:52.505545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.1c","version":"267'9","reported_seq":83,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:53.552632+0000","last_change":"2024-09-14T13:02:53.552632+0000","last_active":"2024-09-14T13:02:53.552632+0000","last_peered":"2024-09-14T13:02:53.552632+0000","last_clean":"2024-09-14T13:02:53.552632+0000","last_became_active":"2024-09-14T11:30:17.524810+0000","last_became_peered":"2024-09-14T11:30:17.524810+0000","last_unstale":"2024-09-14T13:02:53.552632+0000","last_undegraded":"2024-09-14T13:02:53.552632+0000","last_fullsized":"2024-09-14T13:02:53.552632+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'9","last_scrub_stamp":"2024-09-14T13:02:53.552446+0000","last_deep_scrub":"267'9","last_deep_scrub_stamp":"2024-09-14T13:02:53.552446+0000","last_clean_scrub_stamp":"2024-09-14T13:02:53.552446+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:44:48.828432+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":11636,"num_write":14,"num_write_kb":6842,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.1d","version":"0'0","reported_seq":74,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:37.223730+0000","last_change":"2024-09-14T13:02:37.223612+0000","last_active":"2024-09-14T13:02:37.223730+0000","last_peered":"2024-09-14T13:02:37.223730+0000","last_clean":"2024-09-14T13:02:37.223730+0000","last_became_active":"2024-09-14T11:30:10.474889+0000","last_became_peered":"2024-09-14T11:30:10.474889+0000","last_unstale":"2024-09-14T13:02:37.223730+0000","last_undegraded":"2024-09-14T13:02:37.223730+0000","last_fullsized":"2024-09-14T13:02:37.223730+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T13:02:37.223419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T13:02:37.223419+0000","last_clean_scrub_stamp":"2024-09-14T13:02:37.223419+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:31:29.150342+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.1e","version":"267'279","reported_seq":921,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:32.120221+0000","last_change":"2024-09-14T13:02:32.120056+0000","last_active":"2024-09-14T13:02:32.120221+0000","last_peered":"2024-09-14T13:02:32.120221+0000","last_clean":"2024-09-14T13:02:32.120221+0000","last_became_active":"2024-09-14T11:24:10.090434+0000","last_became_peered":"2024-09-14T11:24:10.090434+0000","last_unstale":"2024-09-14T13:02:32.120221+0000","last_undegraded":"2024-09-14T13:02:32.120221+0000","last_fullsized":"2024-09-14T13:02:32.120221+0000","mapping_epoch":254,"log_start":"264'200","ondisk_log_start":"264'200","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'279","last_scrub_stamp":"2024-09-14T13:02:32.119867+0000","last_deep_scrub":"267'279","last_deep_scrub_stamp":"2024-09-14T13:02:32.119867+0000","last_clean_scrub_stamp":"2024-09-14T13:02:32.119867+0000","objects_scrubbed":0,"log_size":79,"log_dups_size":200,"ondisk_log_size":79,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:06:39.963045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2587,"num_read_kb":3188,"num_write":542,"num_write_kb":246,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.18","version":"0'0","reported_seq":47,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:45.276571+0000","last_change":"2024-09-14T13:02:45.276571+0000","last_active":"2024-09-14T13:02:45.276571+0000","last_peered":"2024-09-14T13:02:45.276571+0000","last_clean":"2024-09-14T13:02:45.276571+0000","last_became_active":"2024-09-14T11:58:43.685333+0000","last_became_peered":"2024-09-14T11:58:43.685333+0000","last_unstale":"2024-09-14T13:02:45.276571+0000","last_undegraded":"2024-09-14T13:02:45.276571+0000","last_fullsized":"2024-09-14T13:02:45.276571+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T13:02:45.276410+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T13:02:45.276410+0000","last_clean_scrub_stamp":"2024-09-14T13:02:45.276410+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:00:24.239317+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"67.1f","version":"267'4","reported_seq":82,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:03:01.096868+0000","last_change":"2024-09-14T13:03:01.096868+0000","last_active":"2024-09-14T13:03:01.096868+0000","last_peered":"2024-09-14T13:03:01.096868+0000","last_clean":"2024-09-14T13:03:01.096868+0000","last_became_active":"2024-09-14T11:30:17.500369+0000","last_became_peered":"2024-09-14T11:30:17.500369+0000","last_unstale":"2024-09-14T13:03:01.096868+0000","last_undegraded":"2024-09-14T13:03:01.096868+0000","last_fullsized":"2024-09-14T13:03:01.096868+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'4","last_scrub_stamp":"2024-09-14T13:03:01.096688+0000","last_deep_scrub":"267'4","last_deep_scrub_stamp":"2024-09-14T13:03:01.096688+0000","last_clean_scrub_stamp":"2024-09-14T13:03:01.096688+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:42:18.559215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":8192,"num_write":4,"num_write_kb":8192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.1e","version":"264'4","reported_seq":93,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:35.163956+0000","last_change":"2024-09-14T13:02:35.163772+0000","last_active":"2024-09-14T13:02:35.163956+0000","last_peered":"2024-09-14T13:02:35.163956+0000","last_clean":"2024-09-14T13:02:35.163956+0000","last_became_active":"2024-09-14T11:30:10.445613+0000","last_became_peered":"2024-09-14T11:30:10.445613+0000","last_unstale":"2024-09-14T13:02:35.163956+0000","last_undegraded":"2024-09-14T13:02:35.163956+0000","last_fullsized":"2024-09-14T13:02:35.163956+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'4","last_scrub_stamp":"2024-09-14T13:02:35.163594+0000","last_deep_scrub":"264'4","last_deep_scrub_stamp":"2024-09-14T13:02:35.163594+0000","last_clean_scrub_stamp":"2024-09-14T13:02:35.163594+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:53:06.574290+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":4098,"num_write":4,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.1d","version":"267'16","reported_seq":127,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:48.185175+0000","last_change":"2024-09-14T13:02:48.185175+0000","last_active":"2024-09-14T13:02:48.185175+0000","last_peered":"2024-09-14T13:02:48.185175+0000","last_clean":"2024-09-14T13:02:48.185175+0000","last_became_active":"2024-09-14T11:24:10.111323+0000","last_became_peered":"2024-09-14T11:24:10.111323+0000","last_unstale":"2024-09-14T13:02:48.185175+0000","last_undegraded":"2024-09-14T13:02:48.185175+0000","last_fullsized":"2024-09-14T13:02:48.185175+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'16","last_scrub_stamp":"2024-09-14T13:02:48.184976+0000","last_deep_scrub":"267'16","last_deep_scrub_stamp":"2024-09-14T13:02:48.184976+0000","last_clean_scrub_stamp":"2024-09-14T13:02:48.184976+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T00:41:31.522075+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":134,"num_read_kb":93,"num_write":40,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.19","version":"0'0","reported_seq":47,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:03:05.029434+0000","last_change":"2024-09-14T13:03:05.029434+0000","last_active":"2024-09-14T13:03:05.029434+0000","last_peered":"2024-09-14T13:03:05.029434+0000","last_clean":"2024-09-14T13:03:05.029434+0000","last_became_active":"2024-09-14T11:58:43.700281+0000","last_became_peered":"2024-09-14T11:58:43.700281+0000","last_unstale":"2024-09-14T13:03:05.029434+0000","last_undegraded":"2024-09-14T13:03:05.029434+0000","last_fullsized":"2024-09-14T13:03:05.029434+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T13:03:05.029257+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T13:03:05.029257+0000","last_clean_scrub_stamp":"2024-09-14T13:03:05.029257+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:26:42.328674+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.1e","version":"267'6","reported_seq":86,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:57.899407+0000","last_change":"2024-09-14T13:02:57.899407+0000","last_active":"2024-09-14T13:02:57.899407+0000","last_peered":"2024-09-14T13:02:57.899407+0000","last_clean":"2024-09-14T13:02:57.899407+0000","last_became_active":"2024-09-14T11:30:17.534642+0000","last_became_peered":"2024-09-14T11:30:17.534642+0000","last_unstale":"2024-09-14T13:02:57.899407+0000","last_undegraded":"2024-09-14T13:02:57.899407+0000","last_fullsized":"2024-09-14T13:02:57.899407+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'6","last_scrub_stamp":"2024-09-14T13:02:57.899225+0000","last_deep_scrub":"267'6","last_deep_scrub_stamp":"2024-09-14T13:02:57.899225+0000","last_clean_scrub_stamp":"2024-09-14T13:02:57.899225+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:01:41.297988+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":1064,"num_write":6,"num_write_kb":2088,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.1f","version":"267'2","reported_seq":83,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:46.592975+0000","last_change":"2024-09-14T13:02:46.592975+0000","last_active":"2024-09-14T13:02:46.592975+0000","last_peered":"2024-09-14T13:02:46.592975+0000","last_clean":"2024-09-14T13:02:46.592975+0000","last_became_active":"2024-09-14T11:30:10.442597+0000","last_became_peered":"2024-09-14T11:30:10.442597+0000","last_unstale":"2024-09-14T13:02:46.592975+0000","last_undegraded":"2024-09-14T13:02:46.592975+0000","last_fullsized":"2024-09-14T13:02:46.592975+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'2","last_scrub_stamp":"2024-09-14T13:02:46.592723+0000","last_deep_scrub":"267'2","last_deep_scrub_stamp":"2024-09-14T13:02:46.592723+0000","last_clean_scrub_stamp":"2024-09-14T13:02:46.592723+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:28:27.083727+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.1c","version":"267'41","reported_seq":196,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:49.916161+0000","last_change":"2024-09-14T13:02:49.916161+0000","last_active":"2024-09-14T13:02:49.916161+0000","last_peered":"2024-09-14T13:02:49.916161+0000","last_clean":"2024-09-14T13:02:49.916161+0000","last_became_active":"2024-09-14T11:24:10.124422+0000","last_became_peered":"2024-09-14T11:24:10.124422+0000","last_unstale":"2024-09-14T13:02:49.916161+0000","last_undegraded":"2024-09-14T13:02:49.916161+0000","last_fullsized":"2024-09-14T13:02:49.916161+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'41","last_scrub_stamp":"2024-09-14T13:02:49.915973+0000","last_deep_scrub":"267'41","last_deep_scrub_stamp":"2024-09-14T13:02:49.915973+0000","last_clean_scrub_stamp":"2024-09-14T13:02:49.915973+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":0,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:05:58.929256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":350,"num_read_kb":247,"num_write":96,"num_write_kb":33,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.1e","version":"0'0","reported_seq":53,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:03:07.033330+0000","last_change":"2024-09-14T13:03:07.033330+0000","last_active":"2024-09-14T13:03:07.033330+0000","last_peered":"2024-09-14T13:03:07.033330+0000","last_clean":"2024-09-14T13:03:07.033330+0000","last_became_active":"2024-09-14T11:58:43.693760+0000","last_became_peered":"2024-09-14T11:58:43.693760+0000","last_unstale":"2024-09-14T13:03:07.033330+0000","last_undegraded":"2024-09-14T13:03:07.033330+0000","last_fullsized":"2024-09-14T13:03:07.033330+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T13:03:07.033137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T13:03:07.033137+0000","last_clean_scrub_stamp":"2024-09-14T13:03:07.033137+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:53:17.052339+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.19","version":"0'0","reported_seq":69,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:51.352468+0000","last_change":"2024-09-14T13:02:51.352468+0000","last_active":"2024-09-14T13:02:51.352468+0000","last_peered":"2024-09-14T13:02:51.352468+0000","last_clean":"2024-09-14T13:02:51.352468+0000","last_became_active":"2024-09-14T11:30:17.531325+0000","last_became_peered":"2024-09-14T11:30:17.531325+0000","last_unstale":"2024-09-14T13:02:51.352468+0000","last_undegraded":"2024-09-14T13:02:51.352468+0000","last_fullsized":"2024-09-14T13:02:51.352468+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T13:02:51.352283+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T13:02:51.352283+0000","last_clean_scrub_stamp":"2024-09-14T13:02:51.352283+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:13:22.954226+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.18","version":"264'8","reported_seq":91,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:53.120294+0000","last_change":"2024-09-14T13:02:53.120294+0000","last_active":"2024-09-14T13:02:53.120294+0000","last_peered":"2024-09-14T13:02:53.120294+0000","last_clean":"2024-09-14T13:02:53.120294+0000","last_became_active":"2024-09-14T11:30:10.461101+0000","last_became_peered":"2024-09-14T11:30:10.461101+0000","last_unstale":"2024-09-14T13:02:53.120294+0000","last_undegraded":"2024-09-14T13:02:53.120294+0000","last_fullsized":"2024-09-14T13:02:53.120294+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'8","last_scrub_stamp":"2024-09-14T13:02:53.120111+0000","last_deep_scrub":"264'8","last_deep_scrub_stamp":"2024-09-14T13:02:53.120111+0000","last_clean_scrub_stamp":"2024-09-14T13:02:53.120111+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:52:27.935116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":8194,"num_write":18,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.1b","version":"264'28","reported_seq":157,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:46.913030+0000","last_change":"2024-09-14T13:02:46.913030+0000","last_active":"2024-09-14T13:02:46.913030+0000","last_peered":"2024-09-14T13:02:46.913030+0000","last_clean":"2024-09-14T13:02:46.913030+0000","last_became_active":"2024-09-14T11:24:10.129087+0000","last_became_peered":"2024-09-14T11:24:10.129087+0000","last_unstale":"2024-09-14T13:02:46.913030+0000","last_undegraded":"2024-09-14T13:02:46.913030+0000","last_fullsized":"2024-09-14T13:02:46.913030+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'28","last_scrub_stamp":"2024-09-14T13:02:46.912831+0000","last_deep_scrub":"264'28","last_deep_scrub_stamp":"2024-09-14T13:02:46.912831+0000","last_clean_scrub_stamp":"2024-09-14T13:02:46.912831+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:05:15.158776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":229,"num_read_kb":159,"num_write":68,"num_write_kb":22,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.1f","version":"0'0","reported_seq":52,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:48.032772+0000","last_change":"2024-09-14T13:02:48.032526+0000","last_active":"2024-09-14T13:02:48.032772+0000","last_peered":"2024-09-14T13:02:48.032772+0000","last_clean":"2024-09-14T13:02:48.032772+0000","last_became_active":"2024-09-14T11:58:43.676679+0000","last_became_peered":"2024-09-14T11:58:43.676679+0000","last_unstale":"2024-09-14T13:02:48.032772+0000","last_undegraded":"2024-09-14T13:02:48.032772+0000","last_fullsized":"2024-09-14T13:02:48.032772+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T13:02:48.032306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T13:02:48.032306+0000","last_clean_scrub_stamp":"2024-09-14T13:02:48.032306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:23:53.128955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"67.18","version":"264'8","reported_seq":87,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:41.302766+0000","last_change":"2024-09-14T13:02:41.302766+0000","last_active":"2024-09-14T13:02:41.302766+0000","last_peered":"2024-09-14T13:02:41.302766+0000","last_clean":"2024-09-14T13:02:41.302766+0000","last_became_active":"2024-09-14T11:30:17.545478+0000","last_became_peered":"2024-09-14T11:30:17.545478+0000","last_unstale":"2024-09-14T13:02:41.302766+0000","last_undegraded":"2024-09-14T13:02:41.302766+0000","last_fullsized":"2024-09-14T13:02:41.302766+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'8","last_scrub_stamp":"2024-09-14T13:02:41.302568+0000","last_deep_scrub":"264'8","last_deep_scrub_stamp":"2024-09-14T13:02:41.302568+0000","last_clean_scrub_stamp":"2024-09-14T13:02:41.302568+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T00:55:52.417379+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":4166,"num_write":8,"num_write_kb":1092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"66.19","version":"267'7","reported_seq":85,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:50.546901+0000","last_change":"2024-09-14T13:02:50.546901+0000","last_active":"2024-09-14T13:02:50.546901+0000","last_peered":"2024-09-14T13:02:50.546901+0000","last_clean":"2024-09-14T13:02:50.546901+0000","last_became_active":"2024-09-14T11:30:10.467266+0000","last_became_peered":"2024-09-14T11:30:10.467266+0000","last_unstale":"2024-09-14T13:02:50.546901+0000","last_undegraded":"2024-09-14T13:02:50.546901+0000","last_fullsized":"2024-09-14T13:02:50.546901+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'7","last_scrub_stamp":"2024-09-14T13:02:50.546721+0000","last_deep_scrub":"267'7","last_deep_scrub_stamp":"2024-09-14T13:02:50.546721+0000","last_clean_scrub_stamp":"2024-09-14T13:02:50.546721+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:36:02.585933+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":1047,"num_write":12,"num_write_kb":2071,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.1a","version":"267'87","reported_seq":322,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:37.383112+0000","last_change":"2024-09-14T13:02:37.383112+0000","last_active":"2024-09-14T13:02:37.383112+0000","last_peered":"2024-09-14T13:02:37.383112+0000","last_clean":"2024-09-14T13:02:37.383112+0000","last_became_active":"2024-09-14T11:24:10.121048+0000","last_became_peered":"2024-09-14T11:24:10.121048+0000","last_unstale":"2024-09-14T13:02:37.383112+0000","last_undegraded":"2024-09-14T13:02:37.383112+0000","last_fullsized":"2024-09-14T13:02:37.383112+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'87","last_scrub_stamp":"2024-09-14T13:02:37.382930+0000","last_deep_scrub":"267'87","last_deep_scrub_stamp":"2024-09-14T13:02:37.382930+0000","last_clean_scrub_stamp":"2024-09-14T13:02:37.382930+0000","objects_scrubbed":0,"log_size":87,"log_dups_size":0,"ondisk_log_size":87,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:15:49.489042+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":696,"num_read_kb":437,"num_write":216,"num_write_kb":62,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.1c","version":"267'2","reported_seq":48,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:03:03.512075+0000","last_change":"2024-09-14T13:03:03.512075+0000","last_active":"2024-09-14T13:03:03.512075+0000","last_peered":"2024-09-14T13:03:03.512075+0000","last_clean":"2024-09-14T13:03:03.512075+0000","last_became_active":"2024-09-14T11:58:43.684984+0000","last_became_peered":"2024-09-14T11:58:43.684984+0000","last_unstale":"2024-09-14T13:03:03.512075+0000","last_undegraded":"2024-09-14T13:03:03.512075+0000","last_fullsized":"2024-09-14T13:03:03.512075+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'2","last_scrub_stamp":"2024-09-14T13:03:03.511886+0000","last_deep_scrub":"267'2","last_deep_scrub_stamp":"2024-09-14T13:03:03.511886+0000","last_clean_scrub_stamp":"2024-09-14T13:03:03.511886+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:14:22.021632+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":188,"num_omap_keys":2,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.1b","version":"0'0","reported_seq":68,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:44.319002+0000","last_change":"2024-09-14T13:02:44.318836+0000","last_active":"2024-09-14T13:02:44.319002+0000","last_peered":"2024-09-14T13:02:44.319002+0000","last_clean":"2024-09-14T13:02:44.319002+0000","last_became_active":"2024-09-14T11:30:17.526195+0000","last_became_peered":"2024-09-14T11:30:17.526195+0000","last_unstale":"2024-09-14T13:02:44.319002+0000","last_undegraded":"2024-09-14T13:02:44.319002+0000","last_fullsized":"2024-09-14T13:02:44.319002+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T13:02:44.318655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T13:02:44.318655+0000","last_clean_scrub_stamp":"2024-09-14T13:02:44.318655+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:24:39.993059+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"66.1a","version":"264'2","reported_seq":78,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:45.625926+0000","last_change":"2024-09-14T13:02:45.625926+0000","last_active":"2024-09-14T13:02:45.625926+0000","last_peered":"2024-09-14T13:02:45.625926+0000","last_clean":"2024-09-14T13:02:45.625926+0000","last_became_active":"2024-09-14T11:30:10.442753+0000","last_became_peered":"2024-09-14T11:30:10.442753+0000","last_unstale":"2024-09-14T13:02:45.625926+0000","last_undegraded":"2024-09-14T13:02:45.625926+0000","last_fullsized":"2024-09-14T13:02:45.625926+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'2","last_scrub_stamp":"2024-09-14T13:02:45.625740+0000","last_deep_scrub":"264'2","last_deep_scrub_stamp":"2024-09-14T13:02:45.625740+0000","last_clean_scrub_stamp":"2024-09-14T13:02:45.625740+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:30:11.844258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":4096,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.19","version":"267'12","reported_seq":113,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:43.233545+0000","last_change":"2024-09-14T13:02:43.233545+0000","last_active":"2024-09-14T13:02:43.233545+0000","last_peered":"2024-09-14T13:02:43.233545+0000","last_clean":"2024-09-14T13:02:43.233545+0000","last_became_active":"2024-09-14T11:24:10.098890+0000","last_became_peered":"2024-09-14T11:24:10.098890+0000","last_unstale":"2024-09-14T13:02:43.233545+0000","last_undegraded":"2024-09-14T13:02:43.233545+0000","last_fullsized":"2024-09-14T13:02:43.233545+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'12","last_scrub_stamp":"2024-09-14T13:02:43.233322+0000","last_deep_scrub":"267'12","last_deep_scrub_stamp":"2024-09-14T13:02:43.233322+0000","last_clean_scrub_stamp":"2024-09-14T13:02:43.233322+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:54:26.566189+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":81,"num_read_kb":53,"num_write":29,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.1d","version":"0'0","reported_seq":46,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:03:04.521286+0000","last_change":"2024-09-14T13:03:04.521286+0000","last_active":"2024-09-14T13:03:04.521286+0000","last_peered":"2024-09-14T13:03:04.521286+0000","last_clean":"2024-09-14T13:03:04.521286+0000","last_became_active":"2024-09-14T11:58:43.687072+0000","last_became_peered":"2024-09-14T11:58:43.687072+0000","last_unstale":"2024-09-14T13:03:04.521286+0000","last_undegraded":"2024-09-14T13:03:04.521286+0000","last_fullsized":"2024-09-14T13:03:04.521286+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T13:03:04.521114+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T13:03:04.521114+0000","last_clean_scrub_stamp":"2024-09-14T13:03:04.521114+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:14:06.278158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.1a","version":"0'0","reported_seq":68,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:59.964067+0000","last_change":"2024-09-14T13:02:59.964067+0000","last_active":"2024-09-14T13:02:59.964067+0000","last_peered":"2024-09-14T13:02:59.964067+0000","last_clean":"2024-09-14T13:02:59.964067+0000","last_became_active":"2024-09-14T11:30:17.534937+0000","last_became_peered":"2024-09-14T11:30:17.534937+0000","last_unstale":"2024-09-14T13:02:59.964067+0000","last_undegraded":"2024-09-14T13:02:59.964067+0000","last_fullsized":"2024-09-14T13:02:59.964067+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T13:02:59.963806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T13:02:59.963806+0000","last_clean_scrub_stamp":"2024-09-14T13:02:59.963806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:05:36.010403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.1b","version":"267'6","reported_seq":85,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:50.129880+0000","last_change":"2024-09-14T13:02:50.129880+0000","last_active":"2024-09-14T13:02:50.129880+0000","last_peered":"2024-09-14T13:02:50.129880+0000","last_clean":"2024-09-14T13:02:50.129880+0000","last_became_active":"2024-09-14T11:30:10.460666+0000","last_became_peered":"2024-09-14T11:30:10.460666+0000","last_unstale":"2024-09-14T13:02:50.129880+0000","last_undegraded":"2024-09-14T13:02:50.129880+0000","last_fullsized":"2024-09-14T13:02:50.129880+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'6","last_scrub_stamp":"2024-09-14T13:02:50.129811+0000","last_deep_scrub":"267'6","last_deep_scrub_stamp":"2024-09-14T13:02:50.129811+0000","last_clean_scrub_stamp":"2024-09-14T13:02:50.129811+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:37:33.767936+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":14336,"num_write":6,"num_write_kb":10240,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.18","version":"267'142","reported_seq":504,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:32.109017+0000","last_change":"2024-09-14T13:02:32.108855+0000","last_active":"2024-09-14T13:02:32.109017+0000","last_peered":"2024-09-14T13:02:32.109017+0000","last_clean":"2024-09-14T13:02:32.109017+0000","last_became_active":"2024-09-14T11:24:10.117854+0000","last_became_peered":"2024-09-14T11:24:10.117854+0000","last_unstale":"2024-09-14T13:02:32.109017+0000","last_undegraded":"2024-09-14T13:02:32.109017+0000","last_fullsized":"2024-09-14T13:02:32.109017+0000","mapping_epoch":254,"log_start":"264'100","ondisk_log_start":"264'100","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'142","last_scrub_stamp":"2024-09-14T13:02:32.108644+0000","last_deep_scrub":"267'142","last_deep_scrub_stamp":"2024-09-14T13:02:32.108644+0000","last_clean_scrub_stamp":"2024-09-14T13:02:32.108644+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":100,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:46:31.682718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1285,"num_read_kb":1365,"num_write":297,"num_write_kb":120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"68.12","version":"0'0","reported_seq":48,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:46.068616+0000","last_change":"2024-09-14T13:02:46.068616+0000","last_active":"2024-09-14T13:02:46.068616+0000","last_peered":"2024-09-14T13:02:46.068616+0000","last_clean":"2024-09-14T13:02:46.068616+0000","last_became_active":"2024-09-14T11:58:43.675254+0000","last_became_peered":"2024-09-14T11:58:43.675254+0000","last_unstale":"2024-09-14T13:02:46.068616+0000","last_undegraded":"2024-09-14T13:02:46.068616+0000","last_fullsized":"2024-09-14T13:02:46.068616+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T13:02:46.068404+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T13:02:46.068404+0000","last_clean_scrub_stamp":"2024-09-14T13:02:46.068404+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:17:57.105487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"67.15","version":"267'2","reported_seq":73,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:58.925851+0000","last_change":"2024-09-14T13:02:58.925851+0000","last_active":"2024-09-14T13:02:58.925851+0000","last_peered":"2024-09-14T13:02:58.925851+0000","last_clean":"2024-09-14T13:02:58.925851+0000","last_became_active":"2024-09-14T11:30:17.536010+0000","last_became_peered":"2024-09-14T11:30:17.536010+0000","last_unstale":"2024-09-14T13:02:58.925851+0000","last_undegraded":"2024-09-14T13:02:58.925851+0000","last_fullsized":"2024-09-14T13:02:58.925851+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'2","last_scrub_stamp":"2024-09-14T13:02:58.925664+0000","last_deep_scrub":"267'2","last_deep_scrub_stamp":"2024-09-14T13:02:58.925664+0000","last_clean_scrub_stamp":"2024-09-14T13:02:58.925664+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:20:24.512417+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":8192,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.14","version":"267'5","reported_seq":84,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:49.396110+0000","last_change":"2024-09-14T13:02:49.396110+0000","last_active":"2024-09-14T13:02:49.396110+0000","last_peered":"2024-09-14T13:02:49.396110+0000","last_clean":"2024-09-14T13:02:49.396110+0000","last_became_active":"2024-09-14T11:30:10.462605+0000","last_became_peered":"2024-09-14T11:30:10.462605+0000","last_unstale":"2024-09-14T13:02:49.396110+0000","last_undegraded":"2024-09-14T13:02:49.396110+0000","last_fullsized":"2024-09-14T13:02:49.396110+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'5","last_scrub_stamp":"2024-09-14T13:02:49.395882+0000","last_deep_scrub":"267'5","last_deep_scrub_stamp":"2024-09-14T13:02:49.395882+0000","last_clean_scrub_stamp":"2024-09-14T13:02:49.395882+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:30:58.135259+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5120,"num_write":10,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.17","version":"267'12","reported_seq":114,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:58.183096+0000","last_change":"2024-09-14T13:02:58.182961+0000","last_active":"2024-09-14T13:02:58.183096+0000","last_peered":"2024-09-14T13:02:58.183096+0000","last_clean":"2024-09-14T13:02:58.183096+0000","last_became_active":"2024-09-14T11:24:10.101934+0000","last_became_peered":"2024-09-14T11:24:10.101934+0000","last_unstale":"2024-09-14T13:02:58.183096+0000","last_undegraded":"2024-09-14T13:02:58.183096+0000","last_fullsized":"2024-09-14T13:02:58.183096+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'12","last_scrub_stamp":"2024-09-14T13:02:58.182770+0000","last_deep_scrub":"267'12","last_deep_scrub_stamp":"2024-09-14T13:02:58.182770+0000","last_clean_scrub_stamp":"2024-09-14T13:02:58.182770+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:55:09.679099+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":86,"num_read_kb":56,"num_write":31,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.13","version":"267'2","reported_seq":50,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:39.163978+0000","last_change":"2024-09-14T13:02:39.163978+0000","last_active":"2024-09-14T13:02:39.163978+0000","last_peered":"2024-09-14T13:02:39.163978+0000","last_clean":"2024-09-14T13:02:39.163978+0000","last_became_active":"2024-09-14T11:58:43.675526+0000","last_became_peered":"2024-09-14T11:58:43.675526+0000","last_unstale":"2024-09-14T13:02:39.163978+0000","last_undegraded":"2024-09-14T13:02:39.163978+0000","last_fullsized":"2024-09-14T13:02:39.163978+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'2","last_scrub_stamp":"2024-09-14T13:02:39.163783+0000","last_deep_scrub":"267'2","last_deep_scrub_stamp":"2024-09-14T13:02:39.163783+0000","last_clean_scrub_stamp":"2024-09-14T13:02:39.163783+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:02:56.160097+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":188,"num_omap_keys":2,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.14","version":"267'7","reported_seq":84,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:56.914539+0000","last_change":"2024-09-14T13:02:56.914539+0000","last_active":"2024-09-14T13:02:56.914539+0000","last_peered":"2024-09-14T13:02:56.914539+0000","last_clean":"2024-09-14T13:02:56.914539+0000","last_became_active":"2024-09-14T11:30:17.543741+0000","last_became_peered":"2024-09-14T11:30:17.543741+0000","last_unstale":"2024-09-14T13:02:56.914539+0000","last_undegraded":"2024-09-14T13:02:56.914539+0000","last_fullsized":"2024-09-14T13:02:56.914539+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'7","last_scrub_stamp":"2024-09-14T13:02:56.914348+0000","last_deep_scrub":"267'7","last_deep_scrub_stamp":"2024-09-14T13:02:56.914348+0000","last_clean_scrub_stamp":"2024-09-14T13:02:56.914348+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:23:56.978385+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":20482,"num_write":12,"num_write_kb":8192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.15","version":"267'3","reported_seq":80,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:52.448531+0000","last_change":"2024-09-14T13:02:52.448531+0000","last_active":"2024-09-14T13:02:52.448531+0000","last_peered":"2024-09-14T13:02:52.448531+0000","last_clean":"2024-09-14T13:02:52.448531+0000","last_became_active":"2024-09-14T11:30:10.468238+0000","last_became_peered":"2024-09-14T11:30:10.468238+0000","last_unstale":"2024-09-14T13:02:52.448531+0000","last_undegraded":"2024-09-14T13:02:52.448531+0000","last_fullsized":"2024-09-14T13:02:52.448531+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'3","last_scrub_stamp":"2024-09-14T13:02:52.448307+0000","last_deep_scrub":"267'3","last_deep_scrub_stamp":"2024-09-14T13:02:52.448307+0000","last_clean_scrub_stamp":"2024-09-14T13:02:52.448307+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:43:13.784604+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2048,"num_write":8,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.16","version":"267'33","reported_seq":177,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:48.914640+0000","last_change":"2024-09-14T13:02:48.914584+0000","last_active":"2024-09-14T13:02:48.914640+0000","last_peered":"2024-09-14T13:02:48.914640+0000","last_clean":"2024-09-14T13:02:48.914640+0000","last_became_active":"2024-09-14T11:24:10.128354+0000","last_became_peered":"2024-09-14T11:24:10.128354+0000","last_unstale":"2024-09-14T13:02:48.914640+0000","last_undegraded":"2024-09-14T13:02:48.914640+0000","last_fullsized":"2024-09-14T13:02:48.914640+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'33","last_scrub_stamp":"2024-09-14T13:02:48.914515+0000","last_deep_scrub":"267'33","last_deep_scrub_stamp":"2024-09-14T13:02:48.914515+0000","last_clean_scrub_stamp":"2024-09-14T13:02:48.914515+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:13:18.720734+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":269,"num_read_kb":173,"num_write":83,"num_write_kb":23,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.10","version":"0'0","reported_seq":48,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:03:02.498246+0000","last_change":"2024-09-14T13:03:02.498246+0000","last_active":"2024-09-14T13:03:02.498246+0000","last_peered":"2024-09-14T13:03:02.498246+0000","last_clean":"2024-09-14T13:03:02.498246+0000","last_became_active":"2024-09-14T11:58:43.688698+0000","last_became_peered":"2024-09-14T11:58:43.688698+0000","last_unstale":"2024-09-14T13:03:02.498246+0000","last_undegraded":"2024-09-14T13:03:02.498246+0000","last_fullsized":"2024-09-14T13:03:02.498246+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T13:03:02.497987+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T13:03:02.497987+0000","last_clean_scrub_stamp":"2024-09-14T13:03:02.497987+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:41:23.457569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.17","version":"267'5","reported_seq":79,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:55.960565+0000","last_change":"2024-09-14T13:02:55.960565+0000","last_active":"2024-09-14T13:02:55.960565+0000","last_peered":"2024-09-14T13:02:55.960565+0000","last_clean":"2024-09-14T13:02:55.960565+0000","last_became_active":"2024-09-14T11:30:17.543802+0000","last_became_peered":"2024-09-14T11:30:17.543802+0000","last_unstale":"2024-09-14T13:02:55.960565+0000","last_undegraded":"2024-09-14T13:02:55.960565+0000","last_fullsized":"2024-09-14T13:02:55.960565+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'5","last_scrub_stamp":"2024-09-14T13:02:55.960383+0000","last_deep_scrub":"267'5","last_deep_scrub_stamp":"2024-09-14T13:02:55.960383+0000","last_clean_scrub_stamp":"2024-09-14T13:02:55.960383+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:00:11.092372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":20480,"num_write":10,"num_write_kb":8192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.16","version":"264'4","reported_seq":85,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:34.136962+0000","last_change":"2024-09-14T13:02:34.136962+0000","last_active":"2024-09-14T13:02:34.136962+0000","last_peered":"2024-09-14T13:02:34.136962+0000","last_clean":"2024-09-14T13:02:34.136962+0000","last_became_active":"2024-09-14T11:30:10.471956+0000","last_became_peered":"2024-09-14T11:30:10.471956+0000","last_unstale":"2024-09-14T13:02:34.136962+0000","last_undegraded":"2024-09-14T13:02:34.136962+0000","last_fullsized":"2024-09-14T13:02:34.136962+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'4","last_scrub_stamp":"2024-09-14T13:02:34.136748+0000","last_deep_scrub":"264'4","last_deep_scrub_stamp":"2024-09-14T13:02:34.136748+0000","last_clean_scrub_stamp":"2024-09-14T13:02:34.136748+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:49:40.325059+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":4098,"num_write":4,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.15","version":"267'34","reported_seq":174,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:31.141648+0000","last_change":"2024-09-14T13:02:31.141513+0000","last_active":"2024-09-14T13:02:31.141648+0000","last_peered":"2024-09-14T13:02:31.141648+0000","last_clean":"2024-09-14T13:02:31.141648+0000","last_became_active":"2024-09-14T11:24:10.097011+0000","last_became_peered":"2024-09-14T11:24:10.097011+0000","last_unstale":"2024-09-14T13:02:31.141648+0000","last_undegraded":"2024-09-14T13:02:31.141648+0000","last_fullsized":"2024-09-14T13:02:31.141648+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'34","last_scrub_stamp":"2024-09-14T13:02:31.141318+0000","last_deep_scrub":"267'34","last_deep_scrub_stamp":"2024-09-14T13:02:31.141318+0000","last_clean_scrub_stamp":"2024-09-14T13:02:31.141318+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:19:52.142240+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":263,"num_read_kb":166,"num_write":89,"num_write_kb":24,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.11","version":"0'0","reported_seq":48,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:53.318862+0000","last_change":"2024-09-14T13:02:53.318862+0000","last_active":"2024-09-14T13:02:53.318862+0000","last_peered":"2024-09-14T13:02:53.318862+0000","last_clean":"2024-09-14T13:02:53.318862+0000","last_became_active":"2024-09-14T11:58:43.688315+0000","last_became_peered":"2024-09-14T11:58:43.688315+0000","last_unstale":"2024-09-14T13:02:53.318862+0000","last_undegraded":"2024-09-14T13:02:53.318862+0000","last_fullsized":"2024-09-14T13:02:53.318862+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T13:02:53.318677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T13:02:53.318677+0000","last_clean_scrub_stamp":"2024-09-14T13:02:53.318677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:39:23.632785+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.16","version":"0'0","reported_seq":69,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:52.528345+0000","last_change":"2024-09-14T13:02:52.528345+0000","last_active":"2024-09-14T13:02:52.528345+0000","last_peered":"2024-09-14T13:02:52.528345+0000","last_clean":"2024-09-14T13:02:52.528345+0000","last_became_active":"2024-09-14T11:30:17.528777+0000","last_became_peered":"2024-09-14T11:30:17.528777+0000","last_unstale":"2024-09-14T13:02:52.528345+0000","last_undegraded":"2024-09-14T13:02:52.528345+0000","last_fullsized":"2024-09-14T13:02:52.528345+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T13:02:52.528156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T13:02:52.528156+0000","last_clean_scrub_stamp":"2024-09-14T13:02:52.528156+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:40:48.036099+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.17","version":"267'4","reported_seq":81,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:03:00.107198+0000","last_change":"2024-09-14T13:03:00.107198+0000","last_active":"2024-09-14T13:03:00.107198+0000","last_peered":"2024-09-14T13:03:00.107198+0000","last_clean":"2024-09-14T13:03:00.107198+0000","last_became_active":"2024-09-14T11:30:10.469237+0000","last_became_peered":"2024-09-14T11:30:10.469237+0000","last_unstale":"2024-09-14T13:03:00.107198+0000","last_undegraded":"2024-09-14T13:03:00.107198+0000","last_fullsized":"2024-09-14T13:03:00.107198+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'4","last_scrub_stamp":"2024-09-14T13:03:00.107014+0000","last_deep_scrub":"267'4","last_deep_scrub_stamp":"2024-09-14T13:03:00.107014+0000","last_clean_scrub_stamp":"2024-09-14T13:03:00.107014+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:07:06.365328+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":4794,"num_write":4,"num_write_kb":4794,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.14","version":"267'34","reported_seq":172,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:46.544179+0000","last_change":"2024-09-14T13:02:46.544179+0000","last_active":"2024-09-14T13:02:46.544179+0000","last_peered":"2024-09-14T13:02:46.544179+0000","last_clean":"2024-09-14T13:02:46.544179+0000","last_became_active":"2024-09-14T11:24:10.120143+0000","last_became_peered":"2024-09-14T11:24:10.120143+0000","last_unstale":"2024-09-14T13:02:46.544179+0000","last_undegraded":"2024-09-14T13:02:46.544179+0000","last_fullsized":"2024-09-14T13:02:46.544179+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'34","last_scrub_stamp":"2024-09-14T13:02:46.543898+0000","last_deep_scrub":"267'34","last_deep_scrub_stamp":"2024-09-14T13:02:46.543898+0000","last_clean_scrub_stamp":"2024-09-14T13:02:46.543898+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:58:57.583794+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":239,"num_read_kb":157,"num_write":95,"num_write_kb":23,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.16","version":"0'0","reported_seq":47,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:03:06.060298+0000","last_change":"2024-09-14T13:03:06.060298+0000","last_active":"2024-09-14T13:03:06.060298+0000","last_peered":"2024-09-14T13:03:06.060298+0000","last_clean":"2024-09-14T13:03:06.060298+0000","last_became_active":"2024-09-14T11:58:43.685594+0000","last_became_peered":"2024-09-14T11:58:43.685594+0000","last_unstale":"2024-09-14T13:03:06.060298+0000","last_undegraded":"2024-09-14T13:03:06.060298+0000","last_fullsized":"2024-09-14T13:03:06.060298+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T13:03:06.060104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T13:03:06.060104+0000","last_clean_scrub_stamp":"2024-09-14T13:03:06.060104+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:19:12.962994+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.11","version":"264'4","reported_seq":80,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:45.073774+0000","last_change":"2024-09-14T13:02:45.073774+0000","last_active":"2024-09-14T13:02:45.073774+0000","last_peered":"2024-09-14T13:02:45.073774+0000","last_clean":"2024-09-14T13:02:45.073774+0000","last_became_active":"2024-09-14T11:30:17.523720+0000","last_became_peered":"2024-09-14T11:30:17.523720+0000","last_unstale":"2024-09-14T13:02:45.073774+0000","last_undegraded":"2024-09-14T13:02:45.073774+0000","last_fullsized":"2024-09-14T13:02:45.073774+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'4","last_scrub_stamp":"2024-09-14T13:02:45.073582+0000","last_deep_scrub":"264'4","last_deep_scrub_stamp":"2024-09-14T13:02:45.073582+0000","last_clean_scrub_stamp":"2024-09-14T13:02:45.073582+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:25:26.782625+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":4098,"num_write":4,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.10","version":"264'2","reported_seq":80,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:44.664674+0000","last_change":"2024-09-14T13:02:44.664674+0000","last_active":"2024-09-14T13:02:44.664674+0000","last_peered":"2024-09-14T13:02:44.664674+0000","last_clean":"2024-09-14T13:02:44.664674+0000","last_became_active":"2024-09-14T11:30:10.463671+0000","last_became_peered":"2024-09-14T11:30:10.463671+0000","last_unstale":"2024-09-14T13:02:44.664674+0000","last_undegraded":"2024-09-14T13:02:44.664674+0000","last_fullsized":"2024-09-14T13:02:44.664674+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'2","last_scrub_stamp":"2024-09-14T13:02:44.664483+0000","last_deep_scrub":"264'2","last_deep_scrub_stamp":"2024-09-14T13:02:44.664483+0000","last_clean_scrub_stamp":"2024-09-14T13:02:44.664483+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:26:59.055271+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":4096,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.13","version":"267'23","reported_seq":148,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:45.589370+0000","last_change":"2024-09-14T13:02:45.589370+0000","last_active":"2024-09-14T13:02:45.589370+0000","last_peered":"2024-09-14T13:02:45.589370+0000","last_clean":"2024-09-14T13:02:45.589370+0000","last_became_active":"2024-09-14T11:24:10.120764+0000","last_became_peered":"2024-09-14T11:24:10.120764+0000","last_unstale":"2024-09-14T13:02:45.589370+0000","last_undegraded":"2024-09-14T13:02:45.589370+0000","last_fullsized":"2024-09-14T13:02:45.589370+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'23","last_scrub_stamp":"2024-09-14T13:02:45.589195+0000","last_deep_scrub":"267'23","last_deep_scrub_stamp":"2024-09-14T13:02:45.589195+0000","last_clean_scrub_stamp":"2024-09-14T13:02:45.589195+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:06:54.718349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":187,"num_read_kb":128,"num_write":64,"num_write_kb":17,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.17","version":"0'0","reported_seq":47,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:03:03.176520+0000","last_change":"2024-09-14T13:03:03.176520+0000","last_active":"2024-09-14T13:03:03.176520+0000","last_peered":"2024-09-14T13:03:03.176520+0000","last_clean":"2024-09-14T13:03:03.176520+0000","last_became_active":"2024-09-14T11:58:43.677005+0000","last_became_peered":"2024-09-14T11:58:43.677005+0000","last_unstale":"2024-09-14T13:03:03.176520+0000","last_undegraded":"2024-09-14T13:03:03.176520+0000","last_fullsized":"2024-09-14T13:03:03.176520+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T13:03:03.176332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T13:03:03.176332+0000","last_clean_scrub_stamp":"2024-09-14T13:03:03.176332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:02:49.794607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.10","version":"267'4","reported_seq":76,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:39.233788+0000","last_change":"2024-09-14T13:02:39.233788+0000","last_active":"2024-09-14T13:02:39.233788+0000","last_peered":"2024-09-14T13:02:39.233788+0000","last_clean":"2024-09-14T13:02:39.233788+0000","last_became_active":"2024-09-14T11:30:17.510031+0000","last_became_peered":"2024-09-14T11:30:17.510031+0000","last_unstale":"2024-09-14T13:02:39.233788+0000","last_undegraded":"2024-09-14T13:02:39.233788+0000","last_fullsized":"2024-09-14T13:02:39.233788+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'4","last_scrub_stamp":"2024-09-14T13:02:39.233520+0000","last_deep_scrub":"267'4","last_deep_scrub_stamp":"2024-09-14T13:02:39.233520+0000","last_clean_scrub_stamp":"2024-09-14T13:02:39.233520+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:50:08.145806+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":2048,"num_write":4,"num_write_kb":2048,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.11","version":"0'0","reported_seq":76,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:53.947064+0000","last_change":"2024-09-14T13:02:53.947064+0000","last_active":"2024-09-14T13:02:53.947064+0000","last_peered":"2024-09-14T13:02:53.947064+0000","last_clean":"2024-09-14T13:02:53.947064+0000","last_became_active":"2024-09-14T11:30:10.459020+0000","last_became_peered":"2024-09-14T11:30:10.459020+0000","last_unstale":"2024-09-14T13:02:53.947064+0000","last_undegraded":"2024-09-14T13:02:53.947064+0000","last_fullsized":"2024-09-14T13:02:53.947064+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T13:02:53.946834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T13:02:53.946834+0000","last_clean_scrub_stamp":"2024-09-14T13:02:53.946834+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:18:29.470299+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.12","version":"267'21","reported_seq":144,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:42.232596+0000","last_change":"2024-09-14T13:02:42.232596+0000","last_active":"2024-09-14T13:02:42.232596+0000","last_peered":"2024-09-14T13:02:42.232596+0000","last_clean":"2024-09-14T13:02:42.232596+0000","last_became_active":"2024-09-14T11:24:10.124482+0000","last_became_peered":"2024-09-14T11:24:10.124482+0000","last_unstale":"2024-09-14T13:02:42.232596+0000","last_undegraded":"2024-09-14T13:02:42.232596+0000","last_fullsized":"2024-09-14T13:02:42.232596+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'21","last_scrub_stamp":"2024-09-14T13:02:42.232388+0000","last_deep_scrub":"267'21","last_deep_scrub_stamp":"2024-09-14T13:02:42.232388+0000","last_clean_scrub_stamp":"2024-09-14T13:02:42.232388+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:21:49.013790+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":165,"num_read_kb":113,"num_write":54,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.14","version":"267'2","reported_seq":50,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:57.167435+0000","last_change":"2024-09-14T13:02:57.167435+0000","last_active":"2024-09-14T13:02:57.167435+0000","last_peered":"2024-09-14T13:02:57.167435+0000","last_clean":"2024-09-14T13:02:57.167435+0000","last_became_active":"2024-09-14T11:58:43.675734+0000","last_became_peered":"2024-09-14T11:58:43.675734+0000","last_unstale":"2024-09-14T13:02:57.167435+0000","last_undegraded":"2024-09-14T13:02:57.167435+0000","last_fullsized":"2024-09-14T13:02:57.167435+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'2","last_scrub_stamp":"2024-09-14T13:02:57.167229+0000","last_deep_scrub":"267'2","last_deep_scrub_stamp":"2024-09-14T13:02:57.167229+0000","last_clean_scrub_stamp":"2024-09-14T13:02:57.167229+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:05:00.813960+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":188,"num_omap_keys":2,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.13","version":"267'8","reported_seq":82,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:03:01.945980+0000","last_change":"2024-09-14T13:03:01.945980+0000","last_active":"2024-09-14T13:03:01.945980+0000","last_peered":"2024-09-14T13:03:01.945980+0000","last_clean":"2024-09-14T13:03:01.945980+0000","last_became_active":"2024-09-14T11:30:17.545560+0000","last_became_peered":"2024-09-14T11:30:17.545560+0000","last_unstale":"2024-09-14T13:03:01.945980+0000","last_undegraded":"2024-09-14T13:03:01.945980+0000","last_fullsized":"2024-09-14T13:03:01.945980+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'8","last_scrub_stamp":"2024-09-14T13:03:01.945774+0000","last_deep_scrub":"267'8","last_deep_scrub_stamp":"2024-09-14T13:03:01.945774+0000","last_clean_scrub_stamp":"2024-09-14T13:03:01.945774+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:40:14.450687+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":9216,"num_write":18,"num_write_kb":9216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.12","version":"267'8","reported_seq":90,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:40.351336+0000","last_change":"2024-09-14T13:02:40.351336+0000","last_active":"2024-09-14T13:02:40.351336+0000","last_peered":"2024-09-14T13:02:40.351336+0000","last_clean":"2024-09-14T13:02:40.351336+0000","last_became_active":"2024-09-14T11:30:10.474328+0000","last_became_peered":"2024-09-14T11:30:10.474328+0000","last_unstale":"2024-09-14T13:02:40.351336+0000","last_undegraded":"2024-09-14T13:02:40.351336+0000","last_fullsized":"2024-09-14T13:02:40.351336+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'8","last_scrub_stamp":"2024-09-14T13:02:40.351142+0000","last_deep_scrub":"267'8","last_deep_scrub_stamp":"2024-09-14T13:02:40.351142+0000","last_clean_scrub_stamp":"2024-09-14T13:02:40.351142+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:55:27.295194+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":16386,"num_write":18,"num_write_kb":8192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"65.11","version":"267'78","reported_seq":301,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:47.566841+0000","last_change":"2024-09-14T13:02:47.566841+0000","last_active":"2024-09-14T13:02:47.566841+0000","last_peered":"2024-09-14T13:02:47.566841+0000","last_clean":"2024-09-14T13:02:47.566841+0000","last_became_active":"2024-09-14T11:24:10.107177+0000","last_became_peered":"2024-09-14T11:24:10.107177+0000","last_unstale":"2024-09-14T13:02:47.566841+0000","last_undegraded":"2024-09-14T13:02:47.566841+0000","last_fullsized":"2024-09-14T13:02:47.566841+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'78","last_scrub_stamp":"2024-09-14T13:02:47.566658+0000","last_deep_scrub":"267'78","last_deep_scrub_stamp":"2024-09-14T13:02:47.566658+0000","last_clean_scrub_stamp":"2024-09-14T13:02:47.566658+0000","objects_scrubbed":0,"log_size":78,"log_dups_size":0,"ondisk_log_size":78,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:13:03.810958+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":655,"num_read_kb":451,"num_write":184,"num_write_kb":61,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"68.15","version":"267'2","reported_seq":49,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:03:03.995055+0000","last_change":"2024-09-14T13:03:03.995055+0000","last_active":"2024-09-14T13:03:03.995055+0000","last_peered":"2024-09-14T13:03:03.995055+0000","last_clean":"2024-09-14T13:03:03.995055+0000","last_became_active":"2024-09-14T11:58:43.692552+0000","last_became_peered":"2024-09-14T11:58:43.692552+0000","last_unstale":"2024-09-14T13:03:03.995055+0000","last_undegraded":"2024-09-14T13:03:03.995055+0000","last_fullsized":"2024-09-14T13:03:03.995055+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'2","last_scrub_stamp":"2024-09-14T13:03:03.994868+0000","last_deep_scrub":"267'2","last_deep_scrub_stamp":"2024-09-14T13:03:03.994868+0000","last_clean_scrub_stamp":"2024-09-14T13:03:03.994868+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:10:31.874726+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":188,"num_omap_keys":2,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.12","version":"267'3","reported_seq":73,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:42.335939+0000","last_change":"2024-09-14T13:02:42.335939+0000","last_active":"2024-09-14T13:02:42.335939+0000","last_peered":"2024-09-14T13:02:42.335939+0000","last_clean":"2024-09-14T13:02:42.335939+0000","last_became_active":"2024-09-14T11:30:17.523975+0000","last_became_peered":"2024-09-14T11:30:17.523975+0000","last_unstale":"2024-09-14T13:02:42.335939+0000","last_undegraded":"2024-09-14T13:02:42.335939+0000","last_fullsized":"2024-09-14T13:02:42.335939+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'3","last_scrub_stamp":"2024-09-14T13:02:42.335749+0000","last_deep_scrub":"267'3","last_deep_scrub_stamp":"2024-09-14T13:02:42.335749+0000","last_clean_scrub_stamp":"2024-09-14T13:02:42.335749+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:09:02.602816+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":8,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"66.13","version":"267'2","reported_seq":78,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:48.367455+0000","last_change":"2024-09-14T13:02:48.367455+0000","last_active":"2024-09-14T13:02:48.367455+0000","last_peered":"2024-09-14T13:02:48.367455+0000","last_clean":"2024-09-14T13:02:48.367455+0000","last_became_active":"2024-09-14T11:30:10.467218+0000","last_became_peered":"2024-09-14T11:30:10.467218+0000","last_unstale":"2024-09-14T13:02:48.367455+0000","last_undegraded":"2024-09-14T13:02:48.367455+0000","last_fullsized":"2024-09-14T13:02:48.367455+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'2","last_scrub_stamp":"2024-09-14T13:02:48.367273+0000","last_deep_scrub":"267'2","last_deep_scrub_stamp":"2024-09-14T13:02:48.367273+0000","last_clean_scrub_stamp":"2024-09-14T13:02:48.367273+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:55:28.969549+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.10","version":"267'25","reported_seq":151,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:45.928684+0000","last_change":"2024-09-14T13:02:45.928684+0000","last_active":"2024-09-14T13:02:45.928684+0000","last_peered":"2024-09-14T13:02:45.928684+0000","last_clean":"2024-09-14T13:02:45.928684+0000","last_became_active":"2024-09-14T11:24:10.124485+0000","last_became_peered":"2024-09-14T11:24:10.124485+0000","last_unstale":"2024-09-14T13:02:45.928684+0000","last_undegraded":"2024-09-14T13:02:45.928684+0000","last_fullsized":"2024-09-14T13:02:45.928684+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'25","last_scrub_stamp":"2024-09-14T13:02:45.928486+0000","last_deep_scrub":"267'25","last_deep_scrub_stamp":"2024-09-14T13:02:45.928486+0000","last_clean_scrub_stamp":"2024-09-14T13:02:45.928486+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:00:10.974512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":199,"num_read_kb":137,"num_write":62,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.a","version":"0'0","reported_seq":50,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:38.185136+0000","last_change":"2024-09-14T13:02:38.185136+0000","last_active":"2024-09-14T13:02:38.185136+0000","last_peered":"2024-09-14T13:02:38.185136+0000","last_clean":"2024-09-14T13:02:38.185136+0000","last_became_active":"2024-09-14T11:58:43.665150+0000","last_became_peered":"2024-09-14T11:58:43.665150+0000","last_unstale":"2024-09-14T13:02:38.185136+0000","last_undegraded":"2024-09-14T13:02:38.185136+0000","last_fullsized":"2024-09-14T13:02:38.185136+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T13:02:38.184941+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T13:02:38.184941+0000","last_clean_scrub_stamp":"2024-09-14T13:02:38.184941+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T00:23:09.561336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.d","version":"0'0","reported_seq":72,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:52.908568+0000","last_change":"2024-09-14T13:02:52.908568+0000","last_active":"2024-09-14T13:02:52.908568+0000","last_peered":"2024-09-14T13:02:52.908568+0000","last_clean":"2024-09-14T13:02:52.908568+0000","last_became_active":"2024-09-14T11:30:17.540505+0000","last_became_peered":"2024-09-14T11:30:17.540505+0000","last_unstale":"2024-09-14T13:02:52.908568+0000","last_undegraded":"2024-09-14T13:02:52.908568+0000","last_fullsized":"2024-09-14T13:02:52.908568+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T13:02:52.908384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T13:02:52.908384+0000","last_clean_scrub_stamp":"2024-09-14T13:02:52.908384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:18:19.033355+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.c","version":"264'2","reported_seq":82,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:51.479410+0000","last_change":"2024-09-14T13:02:51.479410+0000","last_active":"2024-09-14T13:02:51.479410+0000","last_peered":"2024-09-14T13:02:51.479410+0000","last_clean":"2024-09-14T13:02:51.479410+0000","last_became_active":"2024-09-14T11:30:10.464846+0000","last_became_peered":"2024-09-14T11:30:10.464846+0000","last_unstale":"2024-09-14T13:02:51.479410+0000","last_undegraded":"2024-09-14T13:02:51.479410+0000","last_fullsized":"2024-09-14T13:02:51.479410+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'2","last_scrub_stamp":"2024-09-14T13:02:51.479226+0000","last_deep_scrub":"264'2","last_deep_scrub_stamp":"2024-09-14T13:02:51.479226+0000","last_clean_scrub_stamp":"2024-09-14T13:02:51.479226+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:27:49.211177+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":4096,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.f","version":"267'23","reported_seq":148,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:44.921374+0000","last_change":"2024-09-14T13:02:44.921374+0000","last_active":"2024-09-14T13:02:44.921374+0000","last_peered":"2024-09-14T13:02:44.921374+0000","last_clean":"2024-09-14T13:02:44.921374+0000","last_became_active":"2024-09-14T11:24:10.121456+0000","last_became_peered":"2024-09-14T11:24:10.121456+0000","last_unstale":"2024-09-14T13:02:44.921374+0000","last_undegraded":"2024-09-14T13:02:44.921374+0000","last_fullsized":"2024-09-14T13:02:44.921374+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'23","last_scrub_stamp":"2024-09-14T13:02:44.921191+0000","last_deep_scrub":"267'23","last_deep_scrub_stamp":"2024-09-14T13:02:44.921191+0000","last_clean_scrub_stamp":"2024-09-14T13:02:44.921191+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:11:59.492321+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":176,"num_read_kb":127,"num_write":57,"num_write_kb":16,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.b","version":"0'0","reported_seq":49,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:58.497890+0000","last_change":"2024-09-14T13:02:58.497890+0000","last_active":"2024-09-14T13:02:58.497890+0000","last_peered":"2024-09-14T13:02:58.497890+0000","last_clean":"2024-09-14T13:02:58.497890+0000","last_became_active":"2024-09-14T11:58:43.684927+0000","last_became_peered":"2024-09-14T11:58:43.684927+0000","last_unstale":"2024-09-14T13:02:58.497890+0000","last_undegraded":"2024-09-14T13:02:58.497890+0000","last_fullsized":"2024-09-14T13:02:58.497890+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T13:02:58.497711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T13:02:58.497711+0000","last_clean_scrub_stamp":"2024-09-14T13:02:58.497711+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:27:27.036538+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.c","version":"267'9","reported_seq":87,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:03:00.986080+0000","last_change":"2024-09-14T13:03:00.986080+0000","last_active":"2024-09-14T13:03:00.986080+0000","last_peered":"2024-09-14T13:03:00.986080+0000","last_clean":"2024-09-14T13:03:00.986080+0000","last_became_active":"2024-09-14T11:30:17.535131+0000","last_became_peered":"2024-09-14T11:30:17.535131+0000","last_unstale":"2024-09-14T13:03:00.986080+0000","last_undegraded":"2024-09-14T13:03:00.986080+0000","last_fullsized":"2024-09-14T13:03:00.986080+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'9","last_scrub_stamp":"2024-09-14T13:03:00.985884+0000","last_deep_scrub":"267'9","last_deep_scrub_stamp":"2024-09-14T13:03:00.985884+0000","last_clean_scrub_stamp":"2024-09-14T13:03:00.985884+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:13:41.894851+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":16384,"num_write":14,"num_write_kb":16384,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.d","version":"0'0","reported_seq":78,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:36.205696+0000","last_change":"2024-09-14T13:02:36.205696+0000","last_active":"2024-09-14T13:02:36.205696+0000","last_peered":"2024-09-14T13:02:36.205696+0000","last_clean":"2024-09-14T13:02:36.205696+0000","last_became_active":"2024-09-14T11:30:10.475862+0000","last_became_peered":"2024-09-14T11:30:10.475862+0000","last_unstale":"2024-09-14T13:02:36.205696+0000","last_undegraded":"2024-09-14T13:02:36.205696+0000","last_fullsized":"2024-09-14T13:02:36.205696+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T13:02:36.205496+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T13:02:36.205496+0000","last_clean_scrub_stamp":"2024-09-14T13:02:36.205496+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:14:53.482444+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.e","version":"267'20","reported_seq":140,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:45.359120+0000","last_change":"2024-09-14T13:02:45.358962+0000","last_active":"2024-09-14T13:02:45.359120+0000","last_peered":"2024-09-14T13:02:45.359120+0000","last_clean":"2024-09-14T13:02:45.359120+0000","last_became_active":"2024-09-14T11:24:10.116115+0000","last_became_peered":"2024-09-14T11:24:10.116115+0000","last_unstale":"2024-09-14T13:02:45.359120+0000","last_undegraded":"2024-09-14T13:02:45.359120+0000","last_fullsized":"2024-09-14T13:02:45.359120+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'20","last_scrub_stamp":"2024-09-14T13:02:45.358766+0000","last_deep_scrub":"267'20","last_deep_scrub_stamp":"2024-09-14T13:02:45.358766+0000","last_clean_scrub_stamp":"2024-09-14T13:02:45.358766+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:32:46.769223+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":147,"num_read_kb":99,"num_write":62,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"68.8","version":"0'0","reported_seq":50,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:43.309200+0000","last_change":"2024-09-14T13:02:43.309200+0000","last_active":"2024-09-14T13:02:43.309200+0000","last_peered":"2024-09-14T13:02:43.309200+0000","last_clean":"2024-09-14T13:02:43.309200+0000","last_became_active":"2024-09-14T11:58:43.689083+0000","last_became_peered":"2024-09-14T11:58:43.689083+0000","last_unstale":"2024-09-14T13:02:43.309200+0000","last_undegraded":"2024-09-14T13:02:43.309200+0000","last_fullsized":"2024-09-14T13:02:43.309200+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T13:02:43.309020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T13:02:43.309020+0000","last_clean_scrub_stamp":"2024-09-14T13:02:43.309020+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:23:55.448786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"67.f","version":"267'7","reported_seq":83,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:44.092368+0000","last_change":"2024-09-14T13:02:44.092228+0000","last_active":"2024-09-14T13:02:44.092368+0000","last_peered":"2024-09-14T13:02:44.092368+0000","last_clean":"2024-09-14T13:02:44.092368+0000","last_became_active":"2024-09-14T11:30:17.514381+0000","last_became_peered":"2024-09-14T11:30:17.514381+0000","last_unstale":"2024-09-14T13:02:44.092368+0000","last_undegraded":"2024-09-14T13:02:44.092368+0000","last_fullsized":"2024-09-14T13:02:44.092368+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'7","last_scrub_stamp":"2024-09-14T13:02:44.092047+0000","last_deep_scrub":"267'7","last_deep_scrub_stamp":"2024-09-14T13:02:44.092047+0000","last_clean_scrub_stamp":"2024-09-14T13:02:44.092047+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:39:10.285953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":3072,"num_write":12,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.e","version":"267'6","reported_seq":91,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:46.169642+0000","last_change":"2024-09-14T13:02:46.169642+0000","last_active":"2024-09-14T13:02:46.169642+0000","last_peered":"2024-09-14T13:02:46.169642+0000","last_clean":"2024-09-14T13:02:46.169642+0000","last_became_active":"2024-09-14T11:30:10.473586+0000","last_became_peered":"2024-09-14T11:30:10.473586+0000","last_unstale":"2024-09-14T13:02:46.169642+0000","last_undegraded":"2024-09-14T13:02:46.169642+0000","last_fullsized":"2024-09-14T13:02:46.169642+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'6","last_scrub_stamp":"2024-09-14T13:02:46.169413+0000","last_deep_scrub":"267'6","last_deep_scrub_stamp":"2024-09-14T13:02:46.169413+0000","last_clean_scrub_stamp":"2024-09-14T13:02:46.169413+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:50:40.657781+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":7170,"num_write":6,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.d","version":"267'29","reported_seq":168,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:35.416247+0000","last_change":"2024-09-14T13:02:35.416072+0000","last_active":"2024-09-14T13:02:35.416247+0000","last_peered":"2024-09-14T13:02:35.416247+0000","last_clean":"2024-09-14T13:02:35.416247+0000","last_became_active":"2024-09-14T11:24:10.115813+0000","last_became_peered":"2024-09-14T11:24:10.115813+0000","last_unstale":"2024-09-14T13:02:35.416247+0000","last_undegraded":"2024-09-14T13:02:35.416247+0000","last_fullsized":"2024-09-14T13:02:35.416247+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'29","last_scrub_stamp":"2024-09-14T13:02:35.415892+0000","last_deep_scrub":"267'29","last_deep_scrub_stamp":"2024-09-14T13:02:35.415892+0000","last_clean_scrub_stamp":"2024-09-14T13:02:35.415892+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:05:33.386173+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":238,"num_read_kb":154,"num_write":72,"num_write_kb":21,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.9","version":"0'0","reported_seq":50,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:03:00.485812+0000","last_change":"2024-09-14T13:03:00.485812+0000","last_active":"2024-09-14T13:03:00.485812+0000","last_peered":"2024-09-14T13:03:00.485812+0000","last_clean":"2024-09-14T13:03:00.485812+0000","last_became_active":"2024-09-14T11:58:43.691369+0000","last_became_peered":"2024-09-14T11:58:43.691369+0000","last_unstale":"2024-09-14T13:03:00.485812+0000","last_undegraded":"2024-09-14T13:03:00.485812+0000","last_fullsized":"2024-09-14T13:03:00.485812+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T13:03:00.485632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T13:03:00.485632+0000","last_clean_scrub_stamp":"2024-09-14T13:03:00.485632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:06:19.198554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.e","version":"0'0","reported_seq":72,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:54.916711+0000","last_change":"2024-09-14T13:02:54.916711+0000","last_active":"2024-09-14T13:02:54.916711+0000","last_peered":"2024-09-14T13:02:54.916711+0000","last_clean":"2024-09-14T13:02:54.916711+0000","last_became_active":"2024-09-14T11:30:17.529982+0000","last_became_peered":"2024-09-14T11:30:17.529982+0000","last_unstale":"2024-09-14T13:02:54.916711+0000","last_undegraded":"2024-09-14T13:02:54.916711+0000","last_fullsized":"2024-09-14T13:02:54.916711+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T13:02:54.916536+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T13:02:54.916536+0000","last_clean_scrub_stamp":"2024-09-14T13:02:54.916536+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:58:24.758781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.f","version":"267'3","reported_seq":83,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:31.139213+0000","last_change":"2024-09-14T13:02:31.139077+0000","last_active":"2024-09-14T13:02:31.139213+0000","last_peered":"2024-09-14T13:02:31.139213+0000","last_clean":"2024-09-14T13:02:31.139213+0000","last_became_active":"2024-09-14T11:30:10.465658+0000","last_became_peered":"2024-09-14T11:30:10.465658+0000","last_unstale":"2024-09-14T13:02:31.139213+0000","last_undegraded":"2024-09-14T13:02:31.139213+0000","last_fullsized":"2024-09-14T13:02:31.139213+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'3","last_scrub_stamp":"2024-09-14T13:02:31.138897+0000","last_deep_scrub":"267'3","last_deep_scrub_stamp":"2024-09-14T13:02:31.138897+0000","last_clean_scrub_stamp":"2024-09-14T13:02:31.138897+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:26:50.921553+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":8192,"num_write":8,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.c","version":"267'13","reported_seq":121,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:30.100803+0000","last_change":"2024-09-14T13:02:30.100605+0000","last_active":"2024-09-14T13:02:30.100803+0000","last_peered":"2024-09-14T13:02:30.100803+0000","last_clean":"2024-09-14T13:02:30.100803+0000","last_became_active":"2024-09-14T11:24:10.125123+0000","last_became_peered":"2024-09-14T11:24:10.125123+0000","last_unstale":"2024-09-14T13:02:30.100803+0000","last_undegraded":"2024-09-14T13:02:30.100803+0000","last_fullsized":"2024-09-14T13:02:30.100803+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'13","last_scrub_stamp":"2024-09-14T13:02:30.100437+0000","last_deep_scrub":"267'13","last_deep_scrub_stamp":"2024-09-14T13:02:30.100437+0000","last_clean_scrub_stamp":"2024-09-14T13:02:30.100437+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:50:46.167171+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":97,"num_read_kb":65,"num_write":32,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.e","version":"0'0","reported_seq":49,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:03:02.970500+0000","last_change":"2024-09-14T13:03:02.970500+0000","last_active":"2024-09-14T13:03:02.970500+0000","last_peered":"2024-09-14T13:03:02.970500+0000","last_clean":"2024-09-14T13:03:02.970500+0000","last_became_active":"2024-09-14T11:58:43.686619+0000","last_became_peered":"2024-09-14T11:58:43.686619+0000","last_unstale":"2024-09-14T13:03:02.970500+0000","last_undegraded":"2024-09-14T13:03:02.970500+0000","last_fullsized":"2024-09-14T13:03:02.970500+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T13:03:02.970309+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T13:03:02.970309+0000","last_clean_scrub_stamp":"2024-09-14T13:03:02.970309+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:46:17.303284+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.9","version":"264'3","reported_seq":79,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:51.568650+0000","last_change":"2024-09-14T13:02:51.568470+0000","last_active":"2024-09-14T13:02:51.568650+0000","last_peered":"2024-09-14T13:02:51.568650+0000","last_clean":"2024-09-14T13:02:51.568650+0000","last_became_active":"2024-09-14T11:30:17.539102+0000","last_became_peered":"2024-09-14T11:30:17.539102+0000","last_unstale":"2024-09-14T13:02:51.568650+0000","last_undegraded":"2024-09-14T13:02:51.568650+0000","last_fullsized":"2024-09-14T13:02:51.568650+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'3","last_scrub_stamp":"2024-09-14T13:02:51.568280+0000","last_deep_scrub":"264'3","last_deep_scrub_stamp":"2024-09-14T13:02:51.568280+0000","last_clean_scrub_stamp":"2024-09-14T13:02:51.568280+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:49:51.160226+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":4096,"num_write":8,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.8","version":"267'4","reported_seq":87,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:47.163112+0000","last_change":"2024-09-14T13:02:47.162958+0000","last_active":"2024-09-14T13:02:47.163112+0000","last_peered":"2024-09-14T13:02:47.163112+0000","last_clean":"2024-09-14T13:02:47.163112+0000","last_became_active":"2024-09-14T11:30:10.452160+0000","last_became_peered":"2024-09-14T11:30:10.452160+0000","last_unstale":"2024-09-14T13:02:47.163112+0000","last_undegraded":"2024-09-14T13:02:47.163112+0000","last_fullsized":"2024-09-14T13:02:47.163112+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'4","last_scrub_stamp":"2024-09-14T13:02:47.162779+0000","last_deep_scrub":"267'4","last_deep_scrub_stamp":"2024-09-14T13:02:47.162779+0000","last_clean_scrub_stamp":"2024-09-14T13:02:47.162779+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:25:00.782145+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5120,"num_write":4,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.b","version":"267'29","reported_seq":165,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:44.239839+0000","last_change":"2024-09-14T13:02:44.239589+0000","last_active":"2024-09-14T13:02:44.239839+0000","last_peered":"2024-09-14T13:02:44.239839+0000","last_clean":"2024-09-14T13:02:44.239839+0000","last_became_active":"2024-09-14T11:24:10.106068+0000","last_became_peered":"2024-09-14T11:24:10.106068+0000","last_unstale":"2024-09-14T13:02:44.239839+0000","last_undegraded":"2024-09-14T13:02:44.239839+0000","last_fullsized":"2024-09-14T13:02:44.239839+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'29","last_scrub_stamp":"2024-09-14T13:02:44.239323+0000","last_deep_scrub":"267'29","last_deep_scrub_stamp":"2024-09-14T13:02:44.239323+0000","last_clean_scrub_stamp":"2024-09-14T13:02:44.239323+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:07:00.656881+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":230,"num_read_kb":146,"num_write":73,"num_write_kb":21,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.f","version":"0'0","reported_seq":49,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:59.497626+0000","last_change":"2024-09-14T13:02:59.497626+0000","last_active":"2024-09-14T13:02:59.497626+0000","last_peered":"2024-09-14T13:02:59.497626+0000","last_clean":"2024-09-14T13:02:59.497626+0000","last_became_active":"2024-09-14T11:58:43.691307+0000","last_became_peered":"2024-09-14T11:58:43.691307+0000","last_unstale":"2024-09-14T13:02:59.497626+0000","last_undegraded":"2024-09-14T13:02:59.497626+0000","last_fullsized":"2024-09-14T13:02:59.497626+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T13:02:59.497443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T13:02:59.497443+0000","last_clean_scrub_stamp":"2024-09-14T13:02:59.497443+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T00:27:05.287581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.8","version":"267'4","reported_seq":82,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:54.442739+0000","last_change":"2024-09-14T13:02:54.442501+0000","last_active":"2024-09-14T13:02:54.442739+0000","last_peered":"2024-09-14T13:02:54.442739+0000","last_clean":"2024-09-14T13:02:54.442739+0000","last_became_active":"2024-09-14T11:30:17.506181+0000","last_became_peered":"2024-09-14T11:30:17.506181+0000","last_unstale":"2024-09-14T13:02:54.442739+0000","last_undegraded":"2024-09-14T13:02:54.442739+0000","last_fullsized":"2024-09-14T13:02:54.442739+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'4","last_scrub_stamp":"2024-09-14T13:02:54.442287+0000","last_deep_scrub":"267'4","last_deep_scrub_stamp":"2024-09-14T13:02:54.442287+0000","last_clean_scrub_stamp":"2024-09-14T13:02:54.442287+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:08:30.731637+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":10240,"num_write":4,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.9","version":"267'14","reported_seq":105,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:34.171638+0000","last_change":"2024-09-14T13:02:34.171486+0000","last_active":"2024-09-14T13:02:34.171638+0000","last_peered":"2024-09-14T13:02:34.171638+0000","last_clean":"2024-09-14T13:02:34.171638+0000","last_became_active":"2024-09-14T11:30:10.470179+0000","last_became_peered":"2024-09-14T11:30:10.470179+0000","last_unstale":"2024-09-14T13:02:34.171638+0000","last_undegraded":"2024-09-14T13:02:34.171638+0000","last_fullsized":"2024-09-14T13:02:34.171638+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'14","last_scrub_stamp":"2024-09-14T13:02:34.171302+0000","last_deep_scrub":"267'14","last_deep_scrub_stamp":"2024-09-14T13:02:34.171302+0000","last_clean_scrub_stamp":"2024-09-14T13:02:34.171302+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:20:16.343393+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":18,"num_read_kb":28678,"num_write":24,"num_write_kb":16388,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.a","version":"267'15","reported_seq":126,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:44.574245+0000","last_change":"2024-09-14T13:02:44.574245+0000","last_active":"2024-09-14T13:02:44.574245+0000","last_peered":"2024-09-14T13:02:44.574245+0000","last_clean":"2024-09-14T13:02:44.574245+0000","last_became_active":"2024-09-14T11:24:10.102918+0000","last_became_peered":"2024-09-14T11:24:10.102918+0000","last_unstale":"2024-09-14T13:02:44.574245+0000","last_undegraded":"2024-09-14T13:02:44.574245+0000","last_fullsized":"2024-09-14T13:02:44.574245+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'15","last_scrub_stamp":"2024-09-14T13:02:44.574045+0000","last_deep_scrub":"267'15","last_deep_scrub_stamp":"2024-09-14T13:02:44.574045+0000","last_clean_scrub_stamp":"2024-09-14T13:02:44.574045+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:02:32.794342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":107,"num_read_kb":71,"num_write":42,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.c","version":"267'2","reported_seq":51,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:03:01.476928+0000","last_change":"2024-09-14T13:03:01.476928+0000","last_active":"2024-09-14T13:03:01.476928+0000","last_peered":"2024-09-14T13:03:01.476928+0000","last_clean":"2024-09-14T13:03:01.476928+0000","last_became_active":"2024-09-14T11:58:43.671065+0000","last_became_peered":"2024-09-14T11:58:43.671065+0000","last_unstale":"2024-09-14T13:03:01.476928+0000","last_undegraded":"2024-09-14T13:03:01.476928+0000","last_fullsized":"2024-09-14T13:03:01.476928+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'2","last_scrub_stamp":"2024-09-14T13:03:01.476718+0000","last_deep_scrub":"267'2","last_deep_scrub_stamp":"2024-09-14T13:03:01.476718+0000","last_clean_scrub_stamp":"2024-09-14T13:03:01.476718+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:00:42.582456+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":188,"num_omap_keys":2,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.b","version":"267'11","reported_seq":94,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:41.182388+0000","last_change":"2024-09-14T13:02:41.182388+0000","last_active":"2024-09-14T13:02:41.182388+0000","last_peered":"2024-09-14T13:02:41.182388+0000","last_clean":"2024-09-14T13:02:41.182388+0000","last_became_active":"2024-09-14T11:30:17.516646+0000","last_became_peered":"2024-09-14T11:30:17.516646+0000","last_unstale":"2024-09-14T13:02:41.182388+0000","last_undegraded":"2024-09-14T13:02:41.182388+0000","last_fullsized":"2024-09-14T13:02:41.182388+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'11","last_scrub_stamp":"2024-09-14T13:02:41.182201+0000","last_deep_scrub":"267'11","last_deep_scrub_stamp":"2024-09-14T13:02:41.182201+0000","last_clean_scrub_stamp":"2024-09-14T13:02:41.182201+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:08:07.273375+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":17,"num_read_kb":13314,"num_write":16,"num_write_kb":10240,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.a","version":"264'2","reported_seq":83,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:45.204166+0000","last_change":"2024-09-14T13:02:45.204166+0000","last_active":"2024-09-14T13:02:45.204166+0000","last_peered":"2024-09-14T13:02:45.204166+0000","last_clean":"2024-09-14T13:02:45.204166+0000","last_became_active":"2024-09-14T11:30:10.473149+0000","last_became_peered":"2024-09-14T11:30:10.473149+0000","last_unstale":"2024-09-14T13:02:45.204166+0000","last_undegraded":"2024-09-14T13:02:45.204166+0000","last_fullsized":"2024-09-14T13:02:45.204166+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'2","last_scrub_stamp":"2024-09-14T13:02:45.203968+0000","last_deep_scrub":"264'2","last_deep_scrub_stamp":"2024-09-14T13:02:45.203968+0000","last_clean_scrub_stamp":"2024-09-14T13:02:45.203968+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:36:57.921973+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":1024,"num_write":2,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.9","version":"267'22","reported_seq":146,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:50.907100+0000","last_change":"2024-09-14T13:02:50.907100+0000","last_active":"2024-09-14T13:02:50.907100+0000","last_peered":"2024-09-14T13:02:50.907100+0000","last_clean":"2024-09-14T13:02:50.907100+0000","last_became_active":"2024-09-14T11:24:10.121442+0000","last_became_peered":"2024-09-14T11:24:10.121442+0000","last_unstale":"2024-09-14T13:02:50.907100+0000","last_undegraded":"2024-09-14T13:02:50.907100+0000","last_fullsized":"2024-09-14T13:02:50.907100+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'22","last_scrub_stamp":"2024-09-14T13:02:50.906875+0000","last_deep_scrub":"267'22","last_deep_scrub_stamp":"2024-09-14T13:02:50.906875+0000","last_clean_scrub_stamp":"2024-09-14T13:02:50.906875+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T00:27:38.017167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":163,"num_read_kb":99,"num_write":58,"num_write_kb":15,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.d","version":"0'0","reported_seq":49,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:51.121127+0000","last_change":"2024-09-14T13:02:51.121127+0000","last_active":"2024-09-14T13:02:51.121127+0000","last_peered":"2024-09-14T13:02:51.121127+0000","last_clean":"2024-09-14T13:02:51.121127+0000","last_became_active":"2024-09-14T11:58:43.693568+0000","last_became_peered":"2024-09-14T11:58:43.693568+0000","last_unstale":"2024-09-14T13:02:51.121127+0000","last_undegraded":"2024-09-14T13:02:51.121127+0000","last_fullsized":"2024-09-14T13:02:51.121127+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T13:02:51.120942+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T13:02:51.120942+0000","last_clean_scrub_stamp":"2024-09-14T13:02:51.120942+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:54:34.895870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.a","version":"0'0","reported_seq":79,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:55.487264+0000","last_change":"2024-09-14T13:02:55.487264+0000","last_active":"2024-09-14T13:02:55.487264+0000","last_peered":"2024-09-14T13:02:55.487264+0000","last_clean":"2024-09-14T13:02:55.487264+0000","last_became_active":"2024-09-14T11:30:57.858040+0000","last_became_peered":"2024-09-14T11:30:57.858040+0000","last_unstale":"2024-09-14T13:02:55.487264+0000","last_undegraded":"2024-09-14T13:02:55.487264+0000","last_fullsized":"2024-09-14T13:02:55.487264+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T13:02:55.487048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T13:02:55.487048+0000","last_clean_scrub_stamp":"2024-09-14T13:02:55.487048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:43:07.973229+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.b","version":"267'4","reported_seq":84,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:43.689322+0000","last_change":"2024-09-14T13:02:43.689322+0000","last_active":"2024-09-14T13:02:43.689322+0000","last_peered":"2024-09-14T13:02:43.689322+0000","last_clean":"2024-09-14T13:02:43.689322+0000","last_became_active":"2024-09-14T11:30:10.442635+0000","last_became_peered":"2024-09-14T11:30:10.442635+0000","last_unstale":"2024-09-14T13:02:43.689322+0000","last_undegraded":"2024-09-14T13:02:43.689322+0000","last_fullsized":"2024-09-14T13:02:43.689322+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'4","last_scrub_stamp":"2024-09-14T13:02:43.689138+0000","last_deep_scrub":"267'4","last_deep_scrub_stamp":"2024-09-14T13:02:43.689138+0000","last_clean_scrub_stamp":"2024-09-14T13:02:43.689138+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:18:54.238432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":8192,"num_write":4,"num_write_kb":8192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.8","version":"267'20","reported_seq":140,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:34.365412+0000","last_change":"2024-09-14T13:02:34.365412+0000","last_active":"2024-09-14T13:02:34.365412+0000","last_peered":"2024-09-14T13:02:34.365412+0000","last_clean":"2024-09-14T13:02:34.365412+0000","last_became_active":"2024-09-14T11:24:10.115856+0000","last_became_peered":"2024-09-14T11:24:10.115856+0000","last_unstale":"2024-09-14T13:02:34.365412+0000","last_undegraded":"2024-09-14T13:02:34.365412+0000","last_fullsized":"2024-09-14T13:02:34.365412+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'20","last_scrub_stamp":"2024-09-14T13:02:34.365202+0000","last_deep_scrub":"267'20","last_deep_scrub_stamp":"2024-09-14T13:02:34.365202+0000","last_clean_scrub_stamp":"2024-09-14T13:02:34.365202+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:54:39.800267+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":144,"num_read_kb":94,"num_write":54,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.2","version":"0'0","reported_seq":52,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:56.440864+0000","last_change":"2024-09-14T13:02:56.440727+0000","last_active":"2024-09-14T13:02:56.440864+0000","last_peered":"2024-09-14T13:02:56.440864+0000","last_clean":"2024-09-14T13:02:56.440864+0000","last_became_active":"2024-09-14T11:58:43.695896+0000","last_became_peered":"2024-09-14T11:58:43.695896+0000","last_unstale":"2024-09-14T13:02:56.440864+0000","last_undegraded":"2024-09-14T13:02:56.440864+0000","last_fullsized":"2024-09-14T13:02:56.440864+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T13:02:56.440541+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T13:02:56.440541+0000","last_clean_scrub_stamp":"2024-09-14T13:02:56.440541+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:41:20.174481+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.5","version":"0'0","reported_seq":75,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:49.153149+0000","last_change":"2024-09-14T13:02:49.153149+0000","last_active":"2024-09-14T13:02:49.153149+0000","last_peered":"2024-09-14T13:02:49.153149+0000","last_clean":"2024-09-14T13:02:49.153149+0000","last_became_active":"2024-09-14T11:30:17.519903+0000","last_became_peered":"2024-09-14T11:30:17.519903+0000","last_unstale":"2024-09-14T13:02:49.153149+0000","last_undegraded":"2024-09-14T13:02:49.153149+0000","last_fullsized":"2024-09-14T13:02:49.153149+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T13:02:49.152917+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T13:02:49.152917+0000","last_clean_scrub_stamp":"2024-09-14T13:02:49.152917+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:01:06.409022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.4","version":"264'4","reported_seq":90,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:49.538741+0000","last_change":"2024-09-14T13:02:49.538741+0000","last_active":"2024-09-14T13:02:49.538741+0000","last_peered":"2024-09-14T13:02:49.538741+0000","last_clean":"2024-09-14T13:02:49.538741+0000","last_became_active":"2024-09-14T11:30:10.468287+0000","last_became_peered":"2024-09-14T11:30:10.468287+0000","last_unstale":"2024-09-14T13:02:49.538741+0000","last_undegraded":"2024-09-14T13:02:49.538741+0000","last_fullsized":"2024-09-14T13:02:49.538741+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'4","last_scrub_stamp":"2024-09-14T13:02:49.538547+0000","last_deep_scrub":"264'4","last_deep_scrub_stamp":"2024-09-14T13:02:49.538547+0000","last_clean_scrub_stamp":"2024-09-14T13:02:49.538547+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:21:50.386095+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":11264,"num_write":4,"num_write_kb":7168,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.7","version":"267'11","reported_seq":119,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:56.150589+0000","last_change":"2024-09-14T13:02:56.150589+0000","last_active":"2024-09-14T13:02:56.150589+0000","last_peered":"2024-09-14T13:02:56.150589+0000","last_clean":"2024-09-14T13:02:56.150589+0000","last_became_active":"2024-09-14T11:24:10.097206+0000","last_became_peered":"2024-09-14T11:24:10.097206+0000","last_unstale":"2024-09-14T13:02:56.150589+0000","last_undegraded":"2024-09-14T13:02:56.150589+0000","last_fullsized":"2024-09-14T13:02:56.150589+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'11","last_scrub_stamp":"2024-09-14T13:02:56.150363+0000","last_deep_scrub":"267'11","last_deep_scrub_stamp":"2024-09-14T13:02:56.150363+0000","last_clean_scrub_stamp":"2024-09-14T13:02:56.150363+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:43:48.097329+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":88,"num_read_kb":49,"num_write":30,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.3","version":"0'0","reported_seq":52,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:52.333770+0000","last_change":"2024-09-14T13:02:52.333541+0000","last_active":"2024-09-14T13:02:52.333770+0000","last_peered":"2024-09-14T13:02:52.333770+0000","last_clean":"2024-09-14T13:02:52.333770+0000","last_became_active":"2024-09-14T11:58:43.689661+0000","last_became_peered":"2024-09-14T11:58:43.689661+0000","last_unstale":"2024-09-14T13:02:52.333770+0000","last_undegraded":"2024-09-14T13:02:52.333770+0000","last_fullsized":"2024-09-14T13:02:52.333770+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T13:02:52.333261+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T13:02:52.333261+0000","last_clean_scrub_stamp":"2024-09-14T13:02:52.333261+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:52:03.568440+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.4","version":"267'5","reported_seq":83,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:54.070951+0000","last_change":"2024-09-14T13:02:54.070951+0000","last_active":"2024-09-14T13:02:54.070951+0000","last_peered":"2024-09-14T13:02:54.070951+0000","last_clean":"2024-09-14T13:02:54.070951+0000","last_became_active":"2024-09-14T11:30:17.500215+0000","last_became_peered":"2024-09-14T11:30:17.500215+0000","last_unstale":"2024-09-14T13:02:54.070951+0000","last_undegraded":"2024-09-14T13:02:54.070951+0000","last_fullsized":"2024-09-14T13:02:54.070951+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'5","last_scrub_stamp":"2024-09-14T13:02:54.070757+0000","last_deep_scrub":"267'5","last_deep_scrub_stamp":"2024-09-14T13:02:54.070757+0000","last_clean_scrub_stamp":"2024-09-14T13:02:54.070757+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:03:10.267102+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":2052,"num_write":10,"num_write_kb":1028,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.5","version":"267'5","reported_seq":90,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:33.088134+0000","last_change":"2024-09-14T13:02:33.088134+0000","last_active":"2024-09-14T13:02:33.088134+0000","last_peered":"2024-09-14T13:02:33.088134+0000","last_clean":"2024-09-14T13:02:33.088134+0000","last_became_active":"2024-09-14T11:30:10.464076+0000","last_became_peered":"2024-09-14T11:30:10.464076+0000","last_unstale":"2024-09-14T13:02:33.088134+0000","last_undegraded":"2024-09-14T13:02:33.088134+0000","last_fullsized":"2024-09-14T13:02:33.088134+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'5","last_scrub_stamp":"2024-09-14T13:02:33.087943+0000","last_deep_scrub":"267'5","last_deep_scrub_stamp":"2024-09-14T13:02:33.087943+0000","last_clean_scrub_stamp":"2024-09-14T13:02:33.087943+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:50:28.317602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":16384,"num_write":10,"num_write_kb":8192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.6","version":"267'17","reported_seq":137,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:33.318288+0000","last_change":"2024-09-14T13:02:33.318288+0000","last_active":"2024-09-14T13:02:33.318288+0000","last_peered":"2024-09-14T13:02:33.318288+0000","last_clean":"2024-09-14T13:02:33.318288+0000","last_became_active":"2024-09-14T11:24:10.123193+0000","last_became_peered":"2024-09-14T11:24:10.123193+0000","last_unstale":"2024-09-14T13:02:33.318288+0000","last_undegraded":"2024-09-14T13:02:33.318288+0000","last_fullsized":"2024-09-14T13:02:33.318288+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'17","last_scrub_stamp":"2024-09-14T13:02:33.318096+0000","last_deep_scrub":"267'17","last_deep_scrub_stamp":"2024-09-14T13:02:33.318096+0000","last_clean_scrub_stamp":"2024-09-14T13:02:33.318096+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:16:39.854310+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":141,"num_read_kb":98,"num_write":56,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.0","version":"0'0","reported_seq":53,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:47.076857+0000","last_change":"2024-09-14T13:02:47.076589+0000","last_active":"2024-09-14T13:02:47.076857+0000","last_peered":"2024-09-14T13:02:47.076857+0000","last_clean":"2024-09-14T13:02:47.076857+0000","last_became_active":"2024-09-14T11:58:43.690036+0000","last_became_peered":"2024-09-14T11:58:43.690036+0000","last_unstale":"2024-09-14T13:02:47.076857+0000","last_undegraded":"2024-09-14T13:02:47.076857+0000","last_fullsized":"2024-09-14T13:02:47.076857+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T13:02:47.076377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T13:02:47.076377+0000","last_clean_scrub_stamp":"2024-09-14T13:02:47.076377+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:54:26.040343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"67.7","version":"0'0","reported_seq":74,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:53.482186+0000","last_change":"2024-09-14T13:02:53.482037+0000","last_active":"2024-09-14T13:02:53.482186+0000","last_peered":"2024-09-14T13:02:53.482186+0000","last_clean":"2024-09-14T13:02:53.482186+0000","last_became_active":"2024-09-14T11:30:17.503548+0000","last_became_peered":"2024-09-14T11:30:17.503548+0000","last_unstale":"2024-09-14T13:02:53.482186+0000","last_undegraded":"2024-09-14T13:02:53.482186+0000","last_fullsized":"2024-09-14T13:02:53.482186+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T13:02:53.481778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T13:02:53.481778+0000","last_clean_scrub_stamp":"2024-09-14T13:02:53.481778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:42:40.801856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.6","version":"264'4","reported_seq":90,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:47.358909+0000","last_change":"2024-09-14T13:02:47.358743+0000","last_active":"2024-09-14T13:02:47.358909+0000","last_peered":"2024-09-14T13:02:47.358909+0000","last_clean":"2024-09-14T13:02:47.358909+0000","last_became_active":"2024-09-14T11:30:10.462971+0000","last_became_peered":"2024-09-14T11:30:10.462971+0000","last_unstale":"2024-09-14T13:02:47.358909+0000","last_undegraded":"2024-09-14T13:02:47.358909+0000","last_fullsized":"2024-09-14T13:02:47.358909+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'4","last_scrub_stamp":"2024-09-14T13:02:47.358551+0000","last_deep_scrub":"264'4","last_deep_scrub_stamp":"2024-09-14T13:02:47.358551+0000","last_clean_scrub_stamp":"2024-09-14T13:02:47.358551+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:44:50.402528+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":16386,"num_write":4,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.5","version":"267'29","reported_seq":165,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:43.620332+0000","last_change":"2024-09-14T13:02:43.620332+0000","last_active":"2024-09-14T13:02:43.620332+0000","last_peered":"2024-09-14T13:02:43.620332+0000","last_clean":"2024-09-14T13:02:43.620332+0000","last_became_active":"2024-09-14T11:24:10.104277+0000","last_became_peered":"2024-09-14T11:24:10.104277+0000","last_unstale":"2024-09-14T13:02:43.620332+0000","last_undegraded":"2024-09-14T13:02:43.620332+0000","last_fullsized":"2024-09-14T13:02:43.620332+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'29","last_scrub_stamp":"2024-09-14T13:02:43.620147+0000","last_deep_scrub":"267'29","last_deep_scrub_stamp":"2024-09-14T13:02:43.620147+0000","last_clean_scrub_stamp":"2024-09-14T13:02:43.620147+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:56:34.159681+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":210,"num_read_kb":138,"num_write":78,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.1","version":"0'0","reported_seq":52,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:54.555915+0000","last_change":"2024-09-14T13:02:54.555752+0000","last_active":"2024-09-14T13:02:54.555915+0000","last_peered":"2024-09-14T13:02:54.555915+0000","last_clean":"2024-09-14T13:02:54.555915+0000","last_became_active":"2024-09-14T11:58:43.674870+0000","last_became_peered":"2024-09-14T11:58:43.674870+0000","last_unstale":"2024-09-14T13:02:54.555915+0000","last_undegraded":"2024-09-14T13:02:54.555915+0000","last_fullsized":"2024-09-14T13:02:54.555915+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T13:02:54.555562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T13:02:54.555562+0000","last_clean_scrub_stamp":"2024-09-14T13:02:54.555562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:03:57.223865+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"67.6","version":"267'2","reported_seq":77,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:48.571412+0000","last_change":"2024-09-14T13:02:48.571164+0000","last_active":"2024-09-14T13:02:48.571412+0000","last_peered":"2024-09-14T13:02:48.571412+0000","last_clean":"2024-09-14T13:02:48.571412+0000","last_became_active":"2024-09-14T11:30:17.520433+0000","last_became_peered":"2024-09-14T11:30:17.520433+0000","last_unstale":"2024-09-14T13:02:48.571412+0000","last_undegraded":"2024-09-14T13:02:48.571412+0000","last_fullsized":"2024-09-14T13:02:48.571412+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'2","last_scrub_stamp":"2024-09-14T13:02:48.570898+0000","last_deep_scrub":"267'2","last_deep_scrub_stamp":"2024-09-14T13:02:48.570898+0000","last_clean_scrub_stamp":"2024-09-14T13:02:48.570898+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:52:28.372296+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":4096,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.7","version":"267'4","reported_seq":87,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:50.503511+0000","last_change":"2024-09-14T13:02:50.503349+0000","last_active":"2024-09-14T13:02:50.503511+0000","last_peered":"2024-09-14T13:02:50.503511+0000","last_clean":"2024-09-14T13:02:50.503511+0000","last_became_active":"2024-09-14T11:30:10.474546+0000","last_became_peered":"2024-09-14T11:30:10.474546+0000","last_unstale":"2024-09-14T13:02:50.503511+0000","last_undegraded":"2024-09-14T13:02:50.503511+0000","last_fullsized":"2024-09-14T13:02:50.503511+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'4","last_scrub_stamp":"2024-09-14T13:02:50.503156+0000","last_deep_scrub":"267'4","last_deep_scrub_stamp":"2024-09-14T13:02:50.503156+0000","last_clean_scrub_stamp":"2024-09-14T13:02:50.503156+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T00:29:50.537914+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":3072,"num_write":4,"num_write_kb":2048,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.4","version":"267'33","reported_seq":169,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:40.216496+0000","last_change":"2024-09-14T13:02:40.216496+0000","last_active":"2024-09-14T13:02:40.216496+0000","last_peered":"2024-09-14T13:02:40.216496+0000","last_clean":"2024-09-14T13:02:40.216496+0000","last_became_active":"2024-09-14T11:24:10.118333+0000","last_became_peered":"2024-09-14T11:24:10.118333+0000","last_unstale":"2024-09-14T13:02:40.216496+0000","last_undegraded":"2024-09-14T13:02:40.216496+0000","last_fullsized":"2024-09-14T13:02:40.216496+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'33","last_scrub_stamp":"2024-09-14T13:02:40.216319+0000","last_deep_scrub":"267'33","last_deep_scrub_stamp":"2024-09-14T13:02:40.216319+0000","last_clean_scrub_stamp":"2024-09-14T13:02:40.216319+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T00:09:01.124202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":218,"num_read_kb":138,"num_write":85,"num_write_kb":20,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"68.6","version":"267'2","reported_seq":52,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:37.223646+0000","last_change":"2024-09-14T13:02:37.223646+0000","last_active":"2024-09-14T13:02:37.223646+0000","last_peered":"2024-09-14T13:02:37.223646+0000","last_clean":"2024-09-14T13:02:37.223646+0000","last_became_active":"2024-09-14T11:58:43.688251+0000","last_became_peered":"2024-09-14T11:58:43.688251+0000","last_unstale":"2024-09-14T13:02:37.223646+0000","last_undegraded":"2024-09-14T13:02:37.223646+0000","last_fullsized":"2024-09-14T13:02:37.223646+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'2","last_scrub_stamp":"2024-09-14T13:02:37.223463+0000","last_deep_scrub":"267'2","last_deep_scrub_stamp":"2024-09-14T13:02:37.223463+0000","last_clean_scrub_stamp":"2024-09-14T13:02:37.223463+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:01:40.745731+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":188,"num_omap_keys":2,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.1","version":"267'7","reported_seq":89,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:43.139542+0000","last_change":"2024-09-14T13:02:43.139542+0000","last_active":"2024-09-14T13:02:43.139542+0000","last_peered":"2024-09-14T13:02:43.139542+0000","last_clean":"2024-09-14T13:02:43.139542+0000","last_became_active":"2024-09-14T11:30:17.518890+0000","last_became_peered":"2024-09-14T11:30:17.518890+0000","last_unstale":"2024-09-14T13:02:43.139542+0000","last_undegraded":"2024-09-14T13:02:43.139542+0000","last_fullsized":"2024-09-14T13:02:43.139542+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'7","last_scrub_stamp":"2024-09-14T13:02:43.139285+0000","last_deep_scrub":"267'7","last_deep_scrub_stamp":"2024-09-14T13:02:43.139285+0000","last_clean_scrub_stamp":"2024-09-14T13:02:43.139285+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:22:07.656210+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":19458,"num_write":12,"num_write_kb":7168,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.0","version":"267'2","reported_seq":86,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:47.530683+0000","last_change":"2024-09-14T13:02:47.530683+0000","last_active":"2024-09-14T13:02:47.530683+0000","last_peered":"2024-09-14T13:02:47.530683+0000","last_clean":"2024-09-14T13:02:47.530683+0000","last_became_active":"2024-09-14T11:30:10.466391+0000","last_became_peered":"2024-09-14T11:30:10.466391+0000","last_unstale":"2024-09-14T13:02:47.530683+0000","last_undegraded":"2024-09-14T13:02:47.530683+0000","last_fullsized":"2024-09-14T13:02:47.530683+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'2","last_scrub_stamp":"2024-09-14T13:02:47.530492+0000","last_deep_scrub":"267'2","last_deep_scrub_stamp":"2024-09-14T13:02:47.530492+0000","last_clean_scrub_stamp":"2024-09-14T13:02:47.530492+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:09:45.925301+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":40,"num_write":2,"num_write_kb":40,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.3","version":"267'41","reported_seq":199,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:46.405784+0000","last_change":"2024-09-14T13:02:46.405784+0000","last_active":"2024-09-14T13:02:46.405784+0000","last_peered":"2024-09-14T13:02:46.405784+0000","last_clean":"2024-09-14T13:02:46.405784+0000","last_became_active":"2024-09-14T11:24:10.094515+0000","last_became_peered":"2024-09-14T11:24:10.094515+0000","last_unstale":"2024-09-14T13:02:46.405784+0000","last_undegraded":"2024-09-14T13:02:46.405784+0000","last_fullsized":"2024-09-14T13:02:46.405784+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'41","last_scrub_stamp":"2024-09-14T13:02:46.405607+0000","last_deep_scrub":"267'41","last_deep_scrub_stamp":"2024-09-14T13:02:46.405607+0000","last_clean_scrub_stamp":"2024-09-14T13:02:46.405607+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":0,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:44:04.405540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":311,"num_read_kb":196,"num_write":106,"num_write_kb":28,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"68.7","version":"0'0","reported_seq":50,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:03:02.143255+0000","last_change":"2024-09-14T13:03:02.143255+0000","last_active":"2024-09-14T13:03:02.143255+0000","last_peered":"2024-09-14T13:03:02.143255+0000","last_clean":"2024-09-14T13:03:02.143255+0000","last_became_active":"2024-09-14T11:58:43.680569+0000","last_became_peered":"2024-09-14T11:58:43.680569+0000","last_unstale":"2024-09-14T13:03:02.143255+0000","last_undegraded":"2024-09-14T13:03:02.143255+0000","last_fullsized":"2024-09-14T13:03:02.143255+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T13:03:02.143072+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T13:03:02.143072+0000","last_clean_scrub_stamp":"2024-09-14T13:03:02.143072+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:27:10.861975+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.0","version":"267'4","reported_seq":85,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:50.354724+0000","last_change":"2024-09-14T13:02:50.354724+0000","last_active":"2024-09-14T13:02:50.354724+0000","last_peered":"2024-09-14T13:02:50.354724+0000","last_clean":"2024-09-14T13:02:50.354724+0000","last_became_active":"2024-09-14T11:30:17.518524+0000","last_became_peered":"2024-09-14T11:30:17.518524+0000","last_unstale":"2024-09-14T13:02:50.354724+0000","last_undegraded":"2024-09-14T13:02:50.354724+0000","last_fullsized":"2024-09-14T13:02:50.354724+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'4","last_scrub_stamp":"2024-09-14T13:02:50.354507+0000","last_deep_scrub":"267'4","last_deep_scrub_stamp":"2024-09-14T13:02:50.354507+0000","last_clean_scrub_stamp":"2024-09-14T13:02:50.354507+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:50:45.316320+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":6144,"num_write":4,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.1","version":"267'5","reported_seq":88,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:48.565659+0000","last_change":"2024-09-14T13:02:48.565659+0000","last_active":"2024-09-14T13:02:48.565659+0000","last_peered":"2024-09-14T13:02:48.565659+0000","last_clean":"2024-09-14T13:02:48.565659+0000","last_became_active":"2024-09-14T11:30:10.464696+0000","last_became_peered":"2024-09-14T11:30:10.464696+0000","last_unstale":"2024-09-14T13:02:48.565659+0000","last_undegraded":"2024-09-14T13:02:48.565659+0000","last_fullsized":"2024-09-14T13:02:48.565659+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'5","last_scrub_stamp":"2024-09-14T13:02:48.565381+0000","last_deep_scrub":"267'5","last_deep_scrub_stamp":"2024-09-14T13:02:48.565381+0000","last_clean_scrub_stamp":"2024-09-14T13:02:48.565381+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:40:58.606192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":1024,"num_write":10,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.2","version":"267'34","reported_seq":184,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:42.645516+0000","last_change":"2024-09-14T13:02:42.645516+0000","last_active":"2024-09-14T13:02:42.645516+0000","last_peered":"2024-09-14T13:02:42.645516+0000","last_clean":"2024-09-14T13:02:42.645516+0000","last_became_active":"2024-09-14T11:24:10.125885+0000","last_became_peered":"2024-09-14T11:24:10.125885+0000","last_unstale":"2024-09-14T13:02:42.645516+0000","last_undegraded":"2024-09-14T13:02:42.645516+0000","last_fullsized":"2024-09-14T13:02:42.645516+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'34","last_scrub_stamp":"2024-09-14T13:02:42.645335+0000","last_deep_scrub":"267'34","last_deep_scrub_stamp":"2024-09-14T13:02:42.645335+0000","last_clean_scrub_stamp":"2024-09-14T13:02:42.645335+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T00:08:43.424400+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":284,"num_read_kb":180,"num_write":83,"num_write_kb":28,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"68.4","version":"0'0","reported_seq":52,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:55.103877+0000","last_change":"2024-09-14T13:02:55.103746+0000","last_active":"2024-09-14T13:02:55.103877+0000","last_peered":"2024-09-14T13:02:55.103877+0000","last_clean":"2024-09-14T13:02:55.103877+0000","last_became_active":"2024-09-14T11:58:43.662916+0000","last_became_peered":"2024-09-14T11:58:43.662916+0000","last_unstale":"2024-09-14T13:02:55.103877+0000","last_undegraded":"2024-09-14T13:02:55.103877+0000","last_fullsized":"2024-09-14T13:02:55.103877+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T13:02:55.103563+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T13:02:55.103563+0000","last_clean_scrub_stamp":"2024-09-14T13:02:55.103563+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:24:40.380654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.3","version":"264'4","reported_seq":85,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:39.341302+0000","last_change":"2024-09-14T13:02:39.341302+0000","last_active":"2024-09-14T13:02:39.341302+0000","last_peered":"2024-09-14T13:02:39.341302+0000","last_clean":"2024-09-14T13:02:39.341302+0000","last_became_active":"2024-09-14T11:30:17.549019+0000","last_became_peered":"2024-09-14T11:30:17.549019+0000","last_unstale":"2024-09-14T13:02:39.341302+0000","last_undegraded":"2024-09-14T13:02:39.341302+0000","last_fullsized":"2024-09-14T13:02:39.341302+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'4","last_scrub_stamp":"2024-09-14T13:02:39.341107+0000","last_deep_scrub":"264'4","last_deep_scrub_stamp":"2024-09-14T13:02:39.341107+0000","last_clean_scrub_stamp":"2024-09-14T13:02:39.341107+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:23:14.529883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":4098,"num_write":4,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"66.2","version":"267'4","reported_seq":89,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:42.159375+0000","last_change":"2024-09-14T13:02:42.159375+0000","last_active":"2024-09-14T13:02:42.159375+0000","last_peered":"2024-09-14T13:02:42.159375+0000","last_clean":"2024-09-14T13:02:42.159375+0000","last_became_active":"2024-09-14T11:30:10.460643+0000","last_became_peered":"2024-09-14T11:30:10.460643+0000","last_unstale":"2024-09-14T13:02:42.159375+0000","last_undegraded":"2024-09-14T13:02:42.159375+0000","last_fullsized":"2024-09-14T13:02:42.159375+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'4","last_scrub_stamp":"2024-09-14T13:02:42.159144+0000","last_deep_scrub":"267'4","last_deep_scrub_stamp":"2024-09-14T13:02:42.159144+0000","last_clean_scrub_stamp":"2024-09-14T13:02:42.159144+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:23:08.151155+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":3072,"num_write":4,"num_write_kb":2048,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.1","version":"267'13","reported_seq":123,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:36.412512+0000","last_change":"2024-09-14T13:02:36.412512+0000","last_active":"2024-09-14T13:02:36.412512+0000","last_peered":"2024-09-14T13:02:36.412512+0000","last_clean":"2024-09-14T13:02:36.412512+0000","last_became_active":"2024-09-14T11:24:10.116627+0000","last_became_peered":"2024-09-14T11:24:10.116627+0000","last_unstale":"2024-09-14T13:02:36.412512+0000","last_undegraded":"2024-09-14T13:02:36.412512+0000","last_fullsized":"2024-09-14T13:02:36.412512+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'13","last_scrub_stamp":"2024-09-14T13:02:36.412325+0000","last_deep_scrub":"267'13","last_deep_scrub_stamp":"2024-09-14T13:02:36.412325+0000","last_clean_scrub_stamp":"2024-09-14T13:02:36.412325+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:23:25.445266+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":96,"num_read_kb":63,"num_write":36,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.5","version":"0'0","reported_seq":51,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:57.472429+0000","last_change":"2024-09-14T13:02:57.472429+0000","last_active":"2024-09-14T13:02:57.472429+0000","last_peered":"2024-09-14T13:02:57.472429+0000","last_clean":"2024-09-14T13:02:57.472429+0000","last_became_active":"2024-09-14T11:58:43.695982+0000","last_became_peered":"2024-09-14T11:58:43.695982+0000","last_unstale":"2024-09-14T13:02:57.472429+0000","last_undegraded":"2024-09-14T13:02:57.472429+0000","last_fullsized":"2024-09-14T13:02:57.472429+0000","mapping_epoch":265,"log_start":"0'0","ondisk_log_start":"0'0","created":265,"last_epoch_clean":266,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T13:02:57.472239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T13:02:57.472239+0000","last_clean_scrub_stamp":"2024-09-14T13:02:57.472239+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:10:14.920871+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.2","version":"264'8","reported_seq":93,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:49.591620+0000","last_change":"2024-09-14T13:02:49.591620+0000","last_active":"2024-09-14T13:02:49.591620+0000","last_peered":"2024-09-14T13:02:49.591620+0000","last_clean":"2024-09-14T13:02:49.591620+0000","last_became_active":"2024-09-14T11:30:17.512689+0000","last_became_peered":"2024-09-14T11:30:17.512689+0000","last_unstale":"2024-09-14T13:02:49.591620+0000","last_undegraded":"2024-09-14T13:02:49.591620+0000","last_fullsized":"2024-09-14T13:02:49.591620+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'8","last_scrub_stamp":"2024-09-14T13:02:49.591431+0000","last_deep_scrub":"264'8","last_deep_scrub_stamp":"2024-09-14T13:02:49.591431+0000","last_clean_scrub_stamp":"2024-09-14T13:02:49.591431+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:05:52.156693+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":21506,"num_write":8,"num_write_kb":9216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.3","version":"0'0","reported_seq":81,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:38.334921+0000","last_change":"2024-09-14T13:02:38.334921+0000","last_active":"2024-09-14T13:02:38.334921+0000","last_peered":"2024-09-14T13:02:38.334921+0000","last_clean":"2024-09-14T13:02:38.334921+0000","last_became_active":"2024-09-14T11:30:10.473880+0000","last_became_peered":"2024-09-14T11:30:10.473880+0000","last_unstale":"2024-09-14T13:02:38.334921+0000","last_undegraded":"2024-09-14T13:02:38.334921+0000","last_fullsized":"2024-09-14T13:02:38.334921+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T13:02:38.334721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T13:02:38.334721+0000","last_clean_scrub_stamp":"2024-09-14T13:02:38.334721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:23:50.471222+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"65.0","version":"264'14","reported_seq":131,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:42.639617+0000","last_change":"2024-09-14T13:02:42.639341+0000","last_active":"2024-09-14T13:02:42.639617+0000","last_peered":"2024-09-14T13:02:42.639617+0000","last_clean":"2024-09-14T13:02:42.639617+0000","last_became_active":"2024-09-14T11:24:10.115799+0000","last_became_peered":"2024-09-14T11:24:10.115799+0000","last_unstale":"2024-09-14T13:02:42.639617+0000","last_undegraded":"2024-09-14T13:02:42.639617+0000","last_fullsized":"2024-09-14T13:02:42.639617+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'14","last_scrub_stamp":"2024-09-14T13:02:42.639124+0000","last_deep_scrub":"264'14","last_deep_scrub_stamp":"2024-09-14T13:02:42.639124+0000","last_clean_scrub_stamp":"2024-09-14T13:02:42.639124+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:45:09.264335+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":114,"num_read_kb":78,"num_write":35,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3f","version":"267'205","reported_seq":884,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:20.638860+0000","last_change":"2024-09-14T13:02:20.638712+0000","last_active":"2024-09-14T13:02:20.638860+0000","last_peered":"2024-09-14T13:02:20.638860+0000","last_clean":"2024-09-14T13:02:20.638860+0000","last_became_active":"2024-09-14T11:08:21.829676+0000","last_became_peered":"2024-09-14T11:08:21.829676+0000","last_unstale":"2024-09-14T13:02:20.638860+0000","last_undegraded":"2024-09-14T13:02:20.638860+0000","last_fullsized":"2024-09-14T13:02:20.638860+0000","mapping_epoch":24,"log_start":"267'100","ondisk_log_start":"267'100","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'205","last_scrub_stamp":"2024-09-14T13:02:20.638511+0000","last_deep_scrub":"267'205","last_deep_scrub_stamp":"2024-09-14T13:02:20.638511+0000","last_clean_scrub_stamp":"2024-09-14T13:02:20.638511+0000","objects_scrubbed":3,"log_size":105,"log_dups_size":100,"ondisk_log_size":105,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T00:56:48.157172+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":30,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":573,"num_read_kb":18432,"num_write":892,"num_write_kb":26168,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,0],"acting":[7,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.38","version":"267'465","reported_seq":2080,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:26.511010+0000","last_change":"2024-09-14T13:02:26.510841+0000","last_active":"2024-09-14T13:02:26.511010+0000","last_peered":"2024-09-14T13:02:26.511010+0000","last_clean":"2024-09-14T13:02:26.511010+0000","last_became_active":"2024-09-14T11:08:23.800936+0000","last_became_peered":"2024-09-14T11:08:23.800936+0000","last_unstale":"2024-09-14T13:02:26.511010+0000","last_undegraded":"2024-09-14T13:02:26.511010+0000","last_fullsized":"2024-09-14T13:02:26.511010+0000","mapping_epoch":26,"log_start":"267'400","ondisk_log_start":"267'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'465","last_scrub_stamp":"2024-09-14T13:02:26.510658+0000","last_deep_scrub":"267'465","last_deep_scrub_stamp":"2024-09-14T13:02:26.510658+0000","last_clean_scrub_stamp":"2024-09-14T13:02:26.510658+0000","objects_scrubbed":4,"log_size":65,"log_dups_size":400,"ondisk_log_size":65,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:25:43.630955+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":2476,"num_read_kb":2325,"num_write":550,"num_write_kb":127,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":720,"num_omap_keys":3,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3e","version":"267'229","reported_seq":945,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:15.043632+0000","last_change":"2024-09-14T13:02:15.043489+0000","last_active":"2024-09-14T13:02:15.043632+0000","last_peered":"2024-09-14T13:02:15.043632+0000","last_clean":"2024-09-14T13:02:15.043632+0000","last_became_active":"2024-09-14T11:08:21.808315+0000","last_became_peered":"2024-09-14T11:08:21.808315+0000","last_unstale":"2024-09-14T13:02:15.043632+0000","last_undegraded":"2024-09-14T13:02:15.043632+0000","last_fullsized":"2024-09-14T13:02:15.043632+0000","mapping_epoch":24,"log_start":"267'200","ondisk_log_start":"267'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'229","last_scrub_stamp":"2024-09-14T13:02:15.043275+0000","last_deep_scrub":"267'229","last_deep_scrub_stamp":"2024-09-14T13:02:15.043275+0000","last_clean_scrub_stamp":"2024-09-14T13:02:15.043275+0000","objects_scrubbed":3,"log_size":29,"log_dups_size":200,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:33:02.128503+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1655861,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":605,"num_read_kb":113994,"num_write":1045,"num_write_kb":54817,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,6],"acting":[1,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.39","version":"267'900","reported_seq":2655,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:25.598032+0000","last_change":"2024-09-14T13:02:25.597874+0000","last_active":"2024-09-14T13:02:25.598032+0000","last_peered":"2024-09-14T13:02:25.598032+0000","last_clean":"2024-09-14T13:02:25.598032+0000","last_became_active":"2024-09-14T11:08:23.801320+0000","last_became_peered":"2024-09-14T11:08:23.801320+0000","last_unstale":"2024-09-14T13:02:25.598032+0000","last_undegraded":"2024-09-14T13:02:25.598032+0000","last_fullsized":"2024-09-14T13:02:25.598032+0000","mapping_epoch":26,"log_start":"267'800","ondisk_log_start":"267'800","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'900","last_scrub_stamp":"2024-09-14T13:02:25.597694+0000","last_deep_scrub":"267'900","last_deep_scrub_stamp":"2024-09-14T13:02:25.597694+0000","last_clean_scrub_stamp":"2024-09-14T13:02:25.597694+0000","objects_scrubbed":4,"log_size":100,"log_dups_size":800,"ondisk_log_size":100,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:15:17.189583+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":4549,"num_read_kb":4112,"num_write":1219,"num_write_kb":503,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2767,"num_omap_keys":11,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3d","version":"267'201","reported_seq":857,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:12.135290+0000","last_change":"2024-09-14T13:02:12.135141+0000","last_active":"2024-09-14T13:02:12.135290+0000","last_peered":"2024-09-14T13:02:12.135290+0000","last_clean":"2024-09-14T13:02:12.135290+0000","last_became_active":"2024-09-14T11:08:21.776255+0000","last_became_peered":"2024-09-14T11:08:21.776255+0000","last_unstale":"2024-09-14T13:02:12.135290+0000","last_undegraded":"2024-09-14T13:02:12.135290+0000","last_fullsized":"2024-09-14T13:02:12.135290+0000","mapping_epoch":24,"log_start":"267'100","ondisk_log_start":"267'100","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'201","last_scrub_stamp":"2024-09-14T13:02:12.134852+0000","last_deep_scrub":"267'201","last_deep_scrub_stamp":"2024-09-14T13:02:12.134852+0000","last_clean_scrub_stamp":"2024-09-14T13:02:12.134852+0000","objects_scrubbed":6,"log_size":101,"log_dups_size":100,"ondisk_log_size":101,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:30:34.196127+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":515488,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":487,"num_read_kb":4028,"num_write":961,"num_write_kb":22458,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"267'468","reported_seq":2129,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:24.707700+0000","last_change":"2024-09-14T13:02:24.707519+0000","last_active":"2024-09-14T13:02:24.707700+0000","last_peered":"2024-09-14T13:02:24.707700+0000","last_clean":"2024-09-14T13:02:24.707700+0000","last_became_active":"2024-09-14T11:08:23.786481+0000","last_became_peered":"2024-09-14T11:08:23.786481+0000","last_unstale":"2024-09-14T13:02:24.707700+0000","last_undegraded":"2024-09-14T13:02:24.707700+0000","last_fullsized":"2024-09-14T13:02:24.707700+0000","mapping_epoch":26,"log_start":"267'400","ondisk_log_start":"267'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'468","last_scrub_stamp":"2024-09-14T13:02:24.707341+0000","last_deep_scrub":"267'468","last_deep_scrub_stamp":"2024-09-14T13:02:24.707341+0000","last_clean_scrub_stamp":"2024-09-14T13:02:24.707341+0000","objects_scrubbed":0,"log_size":68,"log_dups_size":400,"ondisk_log_size":68,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:51:19.709141+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2493,"num_read_kb":2352,"num_write":540,"num_write_kb":121,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3c","version":"267'354","reported_seq":1104,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:20.476742+0000","last_change":"2024-09-14T13:02:20.476600+0000","last_active":"2024-09-14T13:02:20.476742+0000","last_peered":"2024-09-14T13:02:20.476742+0000","last_clean":"2024-09-14T13:02:20.476742+0000","last_became_active":"2024-09-14T11:08:21.801787+0000","last_became_peered":"2024-09-14T11:08:21.801787+0000","last_unstale":"2024-09-14T13:02:20.476742+0000","last_undegraded":"2024-09-14T13:02:20.476742+0000","last_fullsized":"2024-09-14T13:02:20.476742+0000","mapping_epoch":24,"log_start":"267'300","ondisk_log_start":"267'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'354","last_scrub_stamp":"2024-09-14T13:02:20.476366+0000","last_deep_scrub":"267'354","last_deep_scrub_stamp":"2024-09-14T13:02:20.476366+0000","last_clean_scrub_stamp":"2024-09-14T13:02:20.476366+0000","objects_scrubbed":4,"log_size":54,"log_dups_size":300,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:53:20.365511+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":72,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1015,"num_read_kb":46026,"num_write":1390,"num_write_kb":39725,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3b","version":"267'451","reported_seq":1993,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:22.995659+0000","last_change":"2024-09-14T13:02:22.995425+0000","last_active":"2024-09-14T13:02:22.995659+0000","last_peered":"2024-09-14T13:02:22.995659+0000","last_clean":"2024-09-14T13:02:22.995659+0000","last_became_active":"2024-09-14T11:08:23.783162+0000","last_became_peered":"2024-09-14T11:08:23.783162+0000","last_unstale":"2024-09-14T13:02:22.995659+0000","last_undegraded":"2024-09-14T13:02:22.995659+0000","last_fullsized":"2024-09-14T13:02:22.995659+0000","mapping_epoch":26,"log_start":"267'400","ondisk_log_start":"267'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'451","last_scrub_stamp":"2024-09-14T13:02:22.995232+0000","last_deep_scrub":"267'451","last_deep_scrub_stamp":"2024-09-14T13:02:22.995232+0000","last_clean_scrub_stamp":"2024-09-14T13:02:22.995232+0000","objects_scrubbed":3,"log_size":51,"log_dups_size":400,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:03:50.107240+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2320,"num_read_kb":2170,"num_write":502,"num_write_kb":112,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":248,"num_omap_keys":1,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3b","version":"267'212","reported_seq":902,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:19.673067+0000","last_change":"2024-09-14T13:02:19.672895+0000","last_active":"2024-09-14T13:02:19.673067+0000","last_peered":"2024-09-14T13:02:19.673067+0000","last_clean":"2024-09-14T13:02:19.673067+0000","last_became_active":"2024-09-14T11:08:21.842260+0000","last_became_peered":"2024-09-14T11:08:21.842260+0000","last_unstale":"2024-09-14T13:02:19.673067+0000","last_undegraded":"2024-09-14T13:02:19.673067+0000","last_fullsized":"2024-09-14T13:02:19.673067+0000","mapping_epoch":24,"log_start":"267'200","ondisk_log_start":"267'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'212","last_scrub_stamp":"2024-09-14T13:02:19.672688+0000","last_deep_scrub":"267'212","last_deep_scrub_stamp":"2024-09-14T13:02:19.672688+0000","last_clean_scrub_stamp":"2024-09-14T13:02:19.672688+0000","objects_scrubbed":1,"log_size":12,"log_dups_size":200,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:47:14.467482+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1655822,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":567,"num_read_kb":28109,"num_write":991,"num_write_kb":35425,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,4],"acting":[7,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3c","version":"267'417","reported_seq":2198,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:20.325699+0000","last_change":"2024-09-14T13:02:20.325518+0000","last_active":"2024-09-14T13:02:20.325699+0000","last_peered":"2024-09-14T13:02:20.325699+0000","last_clean":"2024-09-14T13:02:20.325699+0000","last_became_active":"2024-09-14T11:08:23.804142+0000","last_became_peered":"2024-09-14T11:08:23.804142+0000","last_unstale":"2024-09-14T13:02:20.325699+0000","last_undegraded":"2024-09-14T13:02:20.325699+0000","last_fullsized":"2024-09-14T13:02:20.325699+0000","mapping_epoch":26,"log_start":"267'400","ondisk_log_start":"267'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'417","last_scrub_stamp":"2024-09-14T13:02:20.325334+0000","last_deep_scrub":"267'417","last_deep_scrub_stamp":"2024-09-14T13:02:20.325334+0000","last_clean_scrub_stamp":"2024-09-14T13:02:20.325334+0000","objects_scrubbed":4,"log_size":17,"log_dups_size":400,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:03:20.089650+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":2567,"num_read_kb":2469,"num_write":470,"num_write_kb":86,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2297,"num_omap_keys":9,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.3a","version":"267'155","reported_seq":788,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:19.522766+0000","last_change":"2024-09-14T13:02:19.522599+0000","last_active":"2024-09-14T13:02:19.522766+0000","last_peered":"2024-09-14T13:02:19.522766+0000","last_clean":"2024-09-14T13:02:19.522766+0000","last_became_active":"2024-09-14T11:08:21.791801+0000","last_became_peered":"2024-09-14T11:08:21.791801+0000","last_unstale":"2024-09-14T13:02:19.522766+0000","last_undegraded":"2024-09-14T13:02:19.522766+0000","last_fullsized":"2024-09-14T13:02:19.522766+0000","mapping_epoch":24,"log_start":"267'100","ondisk_log_start":"267'100","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'155","last_scrub_stamp":"2024-09-14T13:02:19.522401+0000","last_deep_scrub":"267'155","last_deep_scrub_stamp":"2024-09-14T13:02:19.522401+0000","last_clean_scrub_stamp":"2024-09-14T13:02:19.522401+0000","objects_scrubbed":1,"log_size":55,"log_dups_size":100,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:24:14.148910+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":30,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":413,"num_read_kb":24131,"num_write":680,"num_write_kb":32915,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,3],"acting":[5,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3d","version":"267'395","reported_seq":1944,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:26.706853+0000","last_change":"2024-09-14T13:02:26.706695+0000","last_active":"2024-09-14T13:02:26.706853+0000","last_peered":"2024-09-14T13:02:26.706853+0000","last_clean":"2024-09-14T13:02:26.706853+0000","last_became_active":"2024-09-14T11:08:23.786522+0000","last_became_peered":"2024-09-14T11:08:23.786522+0000","last_unstale":"2024-09-14T13:02:26.706853+0000","last_undegraded":"2024-09-14T13:02:26.706853+0000","last_fullsized":"2024-09-14T13:02:26.706853+0000","mapping_epoch":26,"log_start":"267'300","ondisk_log_start":"267'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'395","last_scrub_stamp":"2024-09-14T13:02:26.706510+0000","last_deep_scrub":"267'395","last_deep_scrub_stamp":"2024-09-14T13:02:26.706510+0000","last_clean_scrub_stamp":"2024-09-14T13:02:26.706510+0000","objects_scrubbed":2,"log_size":95,"log_dups_size":300,"ondisk_log_size":95,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:28:47.678010+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2147,"num_read_kb":2043,"num_write":454,"num_write_kb":90,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.39","version":"267'266","reported_seq":1040,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:16.621769+0000","last_change":"2024-09-14T13:02:16.621607+0000","last_active":"2024-09-14T13:02:16.621769+0000","last_peered":"2024-09-14T13:02:16.621769+0000","last_clean":"2024-09-14T13:02:16.621769+0000","last_became_active":"2024-09-14T11:08:21.837147+0000","last_became_peered":"2024-09-14T11:08:21.837147+0000","last_unstale":"2024-09-14T13:02:16.621769+0000","last_undegraded":"2024-09-14T13:02:16.621769+0000","last_fullsized":"2024-09-14T13:02:16.621769+0000","mapping_epoch":24,"log_start":"267'200","ondisk_log_start":"267'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'266","last_scrub_stamp":"2024-09-14T13:02:16.621341+0000","last_deep_scrub":"267'266","last_deep_scrub_stamp":"2024-09-14T13:02:16.621341+0000","last_clean_scrub_stamp":"2024-09-14T13:02:16.621341+0000","objects_scrubbed":3,"log_size":66,"log_dups_size":200,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:00:31.402959+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1655838,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1268,"num_read_kb":31286,"num_write":1154,"num_write_kb":25837,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0,4],"acting":[7,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3e","version":"267'511","reported_seq":2135,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:28.530874+0000","last_change":"2024-09-14T13:02:28.530721+0000","last_active":"2024-09-14T13:02:28.530874+0000","last_peered":"2024-09-14T13:02:28.530874+0000","last_clean":"2024-09-14T13:02:28.530874+0000","last_became_active":"2024-09-14T11:08:23.800621+0000","last_became_peered":"2024-09-14T11:08:23.800621+0000","last_unstale":"2024-09-14T13:02:28.530874+0000","last_undegraded":"2024-09-14T13:02:28.530874+0000","last_fullsized":"2024-09-14T13:02:28.530874+0000","mapping_epoch":26,"log_start":"267'500","ondisk_log_start":"267'500","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'511","last_scrub_stamp":"2024-09-14T13:02:28.530532+0000","last_deep_scrub":"267'511","last_deep_scrub_stamp":"2024-09-14T13:02:28.530532+0000","last_clean_scrub_stamp":"2024-09-14T13:02:28.530532+0000","objects_scrubbed":3,"log_size":11,"log_dups_size":500,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:19:28.861587+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2676,"num_read_kb":2481,"num_write":623,"num_write_kb":172,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":694,"num_omap_keys":3,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.38","version":"267'224","reported_seq":899,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:11.932147+0000","last_change":"2024-09-14T13:02:11.931881+0000","last_active":"2024-09-14T13:02:11.932147+0000","last_peered":"2024-09-14T13:02:11.932147+0000","last_clean":"2024-09-14T13:02:11.932147+0000","last_became_active":"2024-09-14T11:08:21.819029+0000","last_became_peered":"2024-09-14T11:08:21.819029+0000","last_unstale":"2024-09-14T13:02:11.932147+0000","last_undegraded":"2024-09-14T13:02:11.932147+0000","last_fullsized":"2024-09-14T13:02:11.932147+0000","mapping_epoch":24,"log_start":"267'200","ondisk_log_start":"267'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'224","last_scrub_stamp":"2024-09-14T13:02:11.931546+0000","last_deep_scrub":"267'224","last_deep_scrub_stamp":"2024-09-14T13:02:11.931546+0000","last_clean_scrub_stamp":"2024-09-14T13:02:11.931546+0000","objects_scrubbed":3,"log_size":24,"log_dups_size":200,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T00:04:21.176019+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":66,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":538,"num_read_kb":44678,"num_write":942,"num_write_kb":39932,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,6],"acting":[3,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3f","version":"267'919","reported_seq":2574,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:20.133214+0000","last_change":"2024-09-14T13:02:20.133057+0000","last_active":"2024-09-14T13:02:20.133214+0000","last_peered":"2024-09-14T13:02:20.133214+0000","last_clean":"2024-09-14T13:02:20.133214+0000","last_became_active":"2024-09-14T11:08:23.785941+0000","last_became_peered":"2024-09-14T11:08:23.785941+0000","last_unstale":"2024-09-14T13:02:20.133214+0000","last_undegraded":"2024-09-14T13:02:20.133214+0000","last_fullsized":"2024-09-14T13:02:20.133214+0000","mapping_epoch":26,"log_start":"267'900","ondisk_log_start":"267'900","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'919","last_scrub_stamp":"2024-09-14T13:02:20.132814+0000","last_deep_scrub":"267'919","last_deep_scrub_stamp":"2024-09-14T13:02:20.132814+0000","last_clean_scrub_stamp":"2024-09-14T13:02:20.132814+0000","objects_scrubbed":3,"log_size":19,"log_dups_size":900,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:16:06.728821+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":4272,"num_read_kb":3805,"num_write":1224,"num_write_kb":476,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"267'398","reported_seq":1979,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:22.702834+0000","last_change":"2024-09-14T13:02:22.702586+0000","last_active":"2024-09-14T13:02:22.702834+0000","last_peered":"2024-09-14T13:02:22.702834+0000","last_clean":"2024-09-14T13:02:22.702834+0000","last_became_active":"2024-09-14T11:08:23.785439+0000","last_became_peered":"2024-09-14T11:08:23.785439+0000","last_unstale":"2024-09-14T13:02:22.702834+0000","last_undegraded":"2024-09-14T13:02:22.702834+0000","last_fullsized":"2024-09-14T13:02:22.702834+0000","mapping_epoch":26,"log_start":"267'300","ondisk_log_start":"267'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'398","last_scrub_stamp":"2024-09-14T13:02:22.702370+0000","last_deep_scrub":"267'398","last_deep_scrub_stamp":"2024-09-14T13:02:22.702370+0000","last_clean_scrub_stamp":"2024-09-14T13:02:22.702370+0000","objects_scrubbed":1,"log_size":98,"log_dups_size":300,"ondisk_log_size":98,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:20:26.205553+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2124,"num_read_kb":2036,"num_write":427,"num_write_kb":63,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.37","version":"267'275","reported_seq":1016,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:13.622231+0000","last_change":"2024-09-14T13:02:13.622088+0000","last_active":"2024-09-14T13:02:13.622231+0000","last_peered":"2024-09-14T13:02:13.622231+0000","last_clean":"2024-09-14T13:02:13.622231+0000","last_became_active":"2024-09-14T11:08:21.805293+0000","last_became_peered":"2024-09-14T11:08:21.805293+0000","last_unstale":"2024-09-14T13:02:13.622231+0000","last_undegraded":"2024-09-14T13:02:13.622231+0000","last_fullsized":"2024-09-14T13:02:13.622231+0000","mapping_epoch":24,"log_start":"267'200","ondisk_log_start":"267'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'275","last_scrub_stamp":"2024-09-14T13:02:13.621839+0000","last_deep_scrub":"267'275","last_deep_scrub_stamp":"2024-09-14T13:02:13.621839+0000","last_clean_scrub_stamp":"2024-09-14T13:02:13.621839+0000","objects_scrubbed":5,"log_size":75,"log_dups_size":200,"ondisk_log_size":75,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:36:57.835433+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1655894,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":1085,"num_read_kb":13085,"num_write":1149,"num_write_kb":51014,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,0],"acting":[7,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.31","version":"267'703","reported_seq":2422,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:24.626546+0000","last_change":"2024-09-14T13:02:24.626382+0000","last_active":"2024-09-14T13:02:24.626546+0000","last_peered":"2024-09-14T13:02:24.626546+0000","last_clean":"2024-09-14T13:02:24.626546+0000","last_became_active":"2024-09-14T11:08:23.808090+0000","last_became_peered":"2024-09-14T11:08:23.808090+0000","last_unstale":"2024-09-14T13:02:24.626546+0000","last_undegraded":"2024-09-14T13:02:24.626546+0000","last_fullsized":"2024-09-14T13:02:24.626546+0000","mapping_epoch":26,"log_start":"267'600","ondisk_log_start":"267'600","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'703","last_scrub_stamp":"2024-09-14T13:02:24.626190+0000","last_deep_scrub":"267'703","last_deep_scrub_stamp":"2024-09-14T13:02:24.626190+0000","last_clean_scrub_stamp":"2024-09-14T13:02:24.626190+0000","objects_scrubbed":5,"log_size":103,"log_dups_size":600,"ondisk_log_size":103,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:48:57.287293+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":3652,"num_read_kb":3296,"num_write":1024,"num_write_kb":466,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"267'186","reported_seq":829,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:17.374091+0000","last_change":"2024-09-14T13:02:17.374091+0000","last_active":"2024-09-14T13:02:17.374091+0000","last_peered":"2024-09-14T13:02:17.374091+0000","last_clean":"2024-09-14T13:02:17.374091+0000","last_became_active":"2024-09-14T11:08:21.824907+0000","last_became_peered":"2024-09-14T11:08:21.824907+0000","last_unstale":"2024-09-14T13:02:17.374091+0000","last_undegraded":"2024-09-14T13:02:17.374091+0000","last_fullsized":"2024-09-14T13:02:17.374091+0000","mapping_epoch":24,"log_start":"267'100","ondisk_log_start":"267'100","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'186","last_scrub_stamp":"2024-09-14T13:02:17.373793+0000","last_deep_scrub":"267'186","last_deep_scrub_stamp":"2024-09-14T13:02:17.373793+0000","last_clean_scrub_stamp":"2024-09-14T13:02:17.373793+0000","objects_scrubbed":6,"log_size":86,"log_dups_size":100,"ondisk_log_size":86,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:39:09.691991+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":511,"num_read_kb":17563,"num_write":879,"num_write_kb":17084,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,4],"acting":[6,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.32","version":"267'542","reported_seq":2183,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:23.392006+0000","last_change":"2024-09-14T13:02:23.391820+0000","last_active":"2024-09-14T13:02:23.392006+0000","last_peered":"2024-09-14T13:02:23.392006+0000","last_clean":"2024-09-14T13:02:23.392006+0000","last_became_active":"2024-09-14T11:08:23.801090+0000","last_became_peered":"2024-09-14T11:08:23.801090+0000","last_unstale":"2024-09-14T13:02:23.392006+0000","last_undegraded":"2024-09-14T13:02:23.392006+0000","last_fullsized":"2024-09-14T13:02:23.392006+0000","mapping_epoch":26,"log_start":"267'500","ondisk_log_start":"267'500","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'542","last_scrub_stamp":"2024-09-14T13:02:23.391622+0000","last_deep_scrub":"267'542","last_deep_scrub_stamp":"2024-09-14T13:02:23.391622+0000","last_clean_scrub_stamp":"2024-09-14T13:02:23.391622+0000","objects_scrubbed":2,"log_size":42,"log_dups_size":500,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:37:14.569886+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2832,"num_read_kb":2611,"num_write":684,"num_write_kb":208,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":701,"num_omap_keys":3,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.35","version":"267'227","reported_seq":905,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:15.349124+0000","last_change":"2024-09-14T13:02:15.349124+0000","last_active":"2024-09-14T13:02:15.349124+0000","last_peered":"2024-09-14T13:02:15.349124+0000","last_clean":"2024-09-14T13:02:15.349124+0000","last_became_active":"2024-09-14T11:08:21.817113+0000","last_became_peered":"2024-09-14T11:08:21.817113+0000","last_unstale":"2024-09-14T13:02:15.349124+0000","last_undegraded":"2024-09-14T13:02:15.349124+0000","last_fullsized":"2024-09-14T13:02:15.349124+0000","mapping_epoch":24,"log_start":"267'200","ondisk_log_start":"267'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'227","last_scrub_stamp":"2024-09-14T13:02:15.348883+0000","last_deep_scrub":"267'227","last_deep_scrub_stamp":"2024-09-14T13:02:15.348883+0000","last_clean_scrub_stamp":"2024-09-14T13:02:15.348883+0000","objects_scrubbed":5,"log_size":27,"log_dups_size":200,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:20:13.352709+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1655893,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":573,"num_read_kb":71773,"num_write":1062,"num_write_kb":34768,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,0],"acting":[6,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.33","version":"267'481","reported_seq":2211,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:23.127477+0000","last_change":"2024-09-14T13:02:23.127477+0000","last_active":"2024-09-14T13:02:23.127477+0000","last_peered":"2024-09-14T13:02:23.127477+0000","last_clean":"2024-09-14T13:02:23.127477+0000","last_became_active":"2024-09-14T11:08:23.782135+0000","last_became_peered":"2024-09-14T11:08:23.782135+0000","last_unstale":"2024-09-14T13:02:23.127477+0000","last_undegraded":"2024-09-14T13:02:23.127477+0000","last_fullsized":"2024-09-14T13:02:23.127477+0000","mapping_epoch":26,"log_start":"267'400","ondisk_log_start":"267'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'481","last_scrub_stamp":"2024-09-14T13:02:23.127294+0000","last_deep_scrub":"267'481","last_deep_scrub_stamp":"2024-09-14T13:02:23.127294+0000","last_clean_scrub_stamp":"2024-09-14T13:02:23.127294+0000","objects_scrubbed":1,"log_size":81,"log_dups_size":400,"ondisk_log_size":81,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:48:12.161901+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2660,"num_read_kb":2528,"num_write":519,"num_write_kb":93,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.34","version":"267'250","reported_seq":912,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:10.813724+0000","last_change":"2024-09-14T13:02:10.813724+0000","last_active":"2024-09-14T13:02:10.813724+0000","last_peered":"2024-09-14T13:02:10.813724+0000","last_clean":"2024-09-14T13:02:10.813724+0000","last_became_active":"2024-09-14T11:08:21.835636+0000","last_became_peered":"2024-09-14T11:08:21.835636+0000","last_unstale":"2024-09-14T13:02:10.813724+0000","last_undegraded":"2024-09-14T13:02:10.813724+0000","last_fullsized":"2024-09-14T13:02:10.813724+0000","mapping_epoch":24,"log_start":"267'200","ondisk_log_start":"267'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'250","last_scrub_stamp":"2024-09-14T13:02:10.813489+0000","last_deep_scrub":"267'250","last_deep_scrub_stamp":"2024-09-14T13:02:10.813489+0000","last_clean_scrub_stamp":"2024-09-14T13:02:10.813489+0000","objects_scrubbed":2,"log_size":50,"log_dups_size":200,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T00:40:56.666305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1655836,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":575,"num_read_kb":3577,"num_write":1185,"num_write_kb":25395,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6],"acting":[4,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.34","version":"267'554","reported_seq":2220,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:18.141972+0000","last_change":"2024-09-14T13:02:18.141972+0000","last_active":"2024-09-14T13:02:18.141972+0000","last_peered":"2024-09-14T13:02:18.141972+0000","last_clean":"2024-09-14T13:02:18.141972+0000","last_became_active":"2024-09-14T11:08:23.784078+0000","last_became_peered":"2024-09-14T11:08:23.784078+0000","last_unstale":"2024-09-14T13:02:18.141972+0000","last_undegraded":"2024-09-14T13:02:18.141972+0000","last_fullsized":"2024-09-14T13:02:18.141972+0000","mapping_epoch":26,"log_start":"267'500","ondisk_log_start":"267'500","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'554","last_scrub_stamp":"2024-09-14T13:02:18.141748+0000","last_deep_scrub":"267'554","last_deep_scrub_stamp":"2024-09-14T13:02:18.141748+0000","last_clean_scrub_stamp":"2024-09-14T13:02:18.141748+0000","objects_scrubbed":1,"log_size":54,"log_dups_size":500,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:33:55.821825+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3071,"num_read_kb":2852,"num_write":734,"num_write_kb":256,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.33","version":"267'240","reported_seq":882,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:12.917024+0000","last_change":"2024-09-14T13:02:12.917024+0000","last_active":"2024-09-14T13:02:12.917024+0000","last_peered":"2024-09-14T13:02:12.917024+0000","last_clean":"2024-09-14T13:02:12.917024+0000","last_became_active":"2024-09-14T11:08:21.809526+0000","last_became_peered":"2024-09-14T11:08:21.809526+0000","last_unstale":"2024-09-14T13:02:12.917024+0000","last_undegraded":"2024-09-14T13:02:12.917024+0000","last_fullsized":"2024-09-14T13:02:12.917024+0000","mapping_epoch":24,"log_start":"267'200","ondisk_log_start":"267'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'240","last_scrub_stamp":"2024-09-14T13:02:12.916789+0000","last_deep_scrub":"267'240","last_deep_scrub_stamp":"2024-09-14T13:02:12.916789+0000","last_clean_scrub_stamp":"2024-09-14T13:02:12.916789+0000","objects_scrubbed":2,"log_size":40,"log_dups_size":200,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:08:03.665418+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":500,"num_read_kb":25008,"num_write":1059,"num_write_kb":23085,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6,1],"acting":[3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.35","version":"267'801","reported_seq":2465,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:23.742731+0000","last_change":"2024-09-14T13:02:23.742731+0000","last_active":"2024-09-14T13:02:23.742731+0000","last_peered":"2024-09-14T13:02:23.742731+0000","last_clean":"2024-09-14T13:02:23.742731+0000","last_became_active":"2024-09-14T11:08:23.785540+0000","last_became_peered":"2024-09-14T11:08:23.785540+0000","last_unstale":"2024-09-14T13:02:23.742731+0000","last_undegraded":"2024-09-14T13:02:23.742731+0000","last_fullsized":"2024-09-14T13:02:23.742731+0000","mapping_epoch":26,"log_start":"267'700","ondisk_log_start":"267'700","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'801","last_scrub_stamp":"2024-09-14T13:02:23.742547+0000","last_deep_scrub":"267'801","last_deep_scrub_stamp":"2024-09-14T13:02:23.742547+0000","last_clean_scrub_stamp":"2024-09-14T13:02:23.742547+0000","objects_scrubbed":1,"log_size":101,"log_dups_size":700,"ondisk_log_size":101,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:21:48.998615+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3845,"num_read_kb":3496,"num_write":1039,"num_write_kb":364,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.32","version":"267'223","reported_seq":1021,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:11.123983+0000","last_change":"2024-09-14T13:02:11.123809+0000","last_active":"2024-09-14T13:02:11.123983+0000","last_peered":"2024-09-14T13:02:11.123983+0000","last_clean":"2024-09-14T13:02:11.123983+0000","last_became_active":"2024-09-14T11:08:21.780800+0000","last_became_peered":"2024-09-14T11:08:21.780800+0000","last_unstale":"2024-09-14T13:02:11.123983+0000","last_undegraded":"2024-09-14T13:02:11.123983+0000","last_fullsized":"2024-09-14T13:02:11.123983+0000","mapping_epoch":24,"log_start":"267'200","ondisk_log_start":"267'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'223","last_scrub_stamp":"2024-09-14T13:02:11.123576+0000","last_deep_scrub":"267'223","last_deep_scrub_stamp":"2024-09-14T13:02:11.123576+0000","last_clean_scrub_stamp":"2024-09-14T13:02:11.123576+0000","objects_scrubbed":3,"log_size":23,"log_dups_size":200,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:03:24.176635+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1655860,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1400,"num_read_kb":21343,"num_write":1086,"num_write_kb":34809,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,1],"acting":[0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.18","version":"267'196","reported_seq":748,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:40.652956+0000","last_change":"2024-09-14T13:02:40.652956+0000","last_active":"2024-09-14T13:02:40.652956+0000","last_peered":"2024-09-14T13:02:40.652956+0000","last_clean":"2024-09-14T13:02:40.652956+0000","last_became_active":"2024-09-14T11:08:31.850605+0000","last_became_peered":"2024-09-14T11:08:31.850605+0000","last_unstale":"2024-09-14T13:02:40.652956+0000","last_undegraded":"2024-09-14T13:02:40.652956+0000","last_fullsized":"2024-09-14T13:02:40.652956+0000","mapping_epoch":34,"log_start":"267'100","ondisk_log_start":"267'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'196","last_scrub_stamp":"2024-09-14T13:02:40.652681+0000","last_deep_scrub":"267'196","last_deep_scrub_stamp":"2024-09-14T13:02:40.652681+0000","last_clean_scrub_stamp":"2024-09-14T13:02:40.652681+0000","objects_scrubbed":1,"log_size":96,"log_dups_size":100,"ondisk_log_size":96,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:51:54.305411+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":204,"num_read_kb":191,"num_write":376,"num_write_kb":86,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.14","version":"267'869","reported_seq":2401,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:17.883663+0000","last_change":"2024-09-14T13:02:17.883495+0000","last_active":"2024-09-14T13:02:17.883663+0000","last_peered":"2024-09-14T13:02:17.883663+0000","last_clean":"2024-09-14T13:02:17.883663+0000","last_became_active":"2024-09-14T11:08:23.779822+0000","last_became_peered":"2024-09-14T11:08:23.779822+0000","last_unstale":"2024-09-14T13:02:17.883663+0000","last_undegraded":"2024-09-14T13:02:17.883663+0000","last_fullsized":"2024-09-14T13:02:17.883663+0000","mapping_epoch":26,"log_start":"267'800","ondisk_log_start":"267'800","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'869","last_scrub_stamp":"2024-09-14T13:02:17.883315+0000","last_deep_scrub":"267'869","last_deep_scrub_stamp":"2024-09-14T13:02:17.883315+0000","last_clean_scrub_stamp":"2024-09-14T13:02:17.883315+0000","objects_scrubbed":4,"log_size":69,"log_dups_size":800,"ondisk_log_size":69,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:49:19.140159+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":4044,"num_read_kb":3595,"num_write":1182,"num_write_kb":452,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"267'245","reported_seq":1022,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:17.612499+0000","last_change":"2024-09-14T13:02:17.612170+0000","last_active":"2024-09-14T13:02:17.612499+0000","last_peered":"2024-09-14T13:02:17.612499+0000","last_clean":"2024-09-14T13:02:17.612499+0000","last_became_active":"2024-09-14T11:08:21.843212+0000","last_became_peered":"2024-09-14T11:08:21.843212+0000","last_unstale":"2024-09-14T13:02:17.612499+0000","last_undegraded":"2024-09-14T13:02:17.612499+0000","last_fullsized":"2024-09-14T13:02:17.612499+0000","mapping_epoch":24,"log_start":"267'200","ondisk_log_start":"267'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'245","last_scrub_stamp":"2024-09-14T13:02:17.611975+0000","last_deep_scrub":"267'245","last_deep_scrub_stamp":"2024-09-14T13:02:17.611975+0000","last_clean_scrub_stamp":"2024-09-14T13:02:17.611975+0000","objects_scrubbed":2,"log_size":45,"log_dups_size":200,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:38:36.738720+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":15,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1021,"num_read_kb":177071,"num_write":1108,"num_write_kb":33961,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,4],"acting":[7,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":534,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:30.482417+0000","last_change":"2024-09-14T13:02:30.482417+0000","last_active":"2024-09-14T13:02:30.482417+0000","last_peered":"2024-09-14T13:02:30.482417+0000","last_clean":"2024-09-14T13:02:30.482417+0000","last_became_active":"2024-09-14T11:08:25.803311+0000","last_became_peered":"2024-09-14T11:08:25.803311+0000","last_unstale":"2024-09-14T13:02:30.482417+0000","last_undegraded":"2024-09-14T13:02:30.482417+0000","last_fullsized":"2024-09-14T13:02:30.482417+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T13:02:30.482226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T13:02:30.482226+0000","last_clean_scrub_stamp":"2024-09-14T13:02:30.482226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:45:03.017589+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.16","version":"267'231","reported_seq":897,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:29.031735+0000","last_change":"2024-09-14T13:02:29.031735+0000","last_active":"2024-09-14T13:02:29.031735+0000","last_peered":"2024-09-14T13:02:29.031735+0000","last_clean":"2024-09-14T13:02:29.031735+0000","last_became_active":"2024-09-14T11:08:27.808834+0000","last_became_peered":"2024-09-14T11:08:27.808834+0000","last_unstale":"2024-09-14T13:02:29.031735+0000","last_undegraded":"2024-09-14T13:02:29.031735+0000","last_fullsized":"2024-09-14T13:02:29.031735+0000","mapping_epoch":30,"log_start":"267'200","ondisk_log_start":"267'200","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'231","last_scrub_stamp":"2024-09-14T13:02:29.031545+0000","last_deep_scrub":"267'231","last_deep_scrub_stamp":"2024-09-14T13:02:29.031545+0000","last_clean_scrub_stamp":"2024-09-14T13:02:29.031545+0000","objects_scrubbed":4,"log_size":31,"log_dups_size":200,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:57:52.720132+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4096,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":308,"num_read_kb":323,"num_write":180,"num_write_kb":16,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":527,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:38.519700+0000","last_change":"2024-09-14T13:02:38.519700+0000","last_active":"2024-09-14T13:02:38.519700+0000","last_peered":"2024-09-14T13:02:38.519700+0000","last_clean":"2024-09-14T13:02:38.519700+0000","last_became_active":"2024-09-14T11:08:29.833332+0000","last_became_peered":"2024-09-14T11:08:29.833332+0000","last_unstale":"2024-09-14T13:02:38.519700+0000","last_undegraded":"2024-09-14T13:02:38.519700+0000","last_fullsized":"2024-09-14T13:02:38.519700+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T13:02:38.519446+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T13:02:38.519446+0000","last_clean_scrub_stamp":"2024-09-14T13:02:38.519446+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:00:10.435989+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.19","version":"267'123","reported_seq":649,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:43.374822+0000","last_change":"2024-09-14T13:02:43.374822+0000","last_active":"2024-09-14T13:02:43.374822+0000","last_peered":"2024-09-14T13:02:43.374822+0000","last_clean":"2024-09-14T13:02:43.374822+0000","last_became_active":"2024-09-14T11:08:31.843645+0000","last_became_peered":"2024-09-14T11:08:31.843645+0000","last_unstale":"2024-09-14T13:02:43.374822+0000","last_undegraded":"2024-09-14T13:02:43.374822+0000","last_fullsized":"2024-09-14T13:02:43.374822+0000","mapping_epoch":34,"log_start":"267'100","ondisk_log_start":"267'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'123","last_scrub_stamp":"2024-09-14T13:02:43.374641+0000","last_deep_scrub":"267'123","last_deep_scrub_stamp":"2024-09-14T13:02:43.374641+0000","last_clean_scrub_stamp":"2024-09-14T13:02:43.374641+0000","objects_scrubbed":1,"log_size":23,"log_dups_size":100,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:50:45.974080+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":100,"num_read_kb":97,"num_write":289,"num_write_kb":65,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.15","version":"267'1237","reported_seq":3023,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:22.427041+0000","last_change":"2024-09-14T13:02:22.427041+0000","last_active":"2024-09-14T13:02:22.427041+0000","last_peered":"2024-09-14T13:02:22.427041+0000","last_clean":"2024-09-14T13:02:22.427041+0000","last_became_active":"2024-09-14T11:08:23.808015+0000","last_became_peered":"2024-09-14T11:08:23.808015+0000","last_unstale":"2024-09-14T13:02:22.427041+0000","last_undegraded":"2024-09-14T13:02:22.427041+0000","last_fullsized":"2024-09-14T13:02:22.427041+0000","mapping_epoch":26,"log_start":"267'1200","ondisk_log_start":"267'1200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'1237","last_scrub_stamp":"2024-09-14T13:02:22.426850+0000","last_deep_scrub":"267'1237","last_deep_scrub_stamp":"2024-09-14T13:02:22.426850+0000","last_clean_scrub_stamp":"2024-09-14T13:02:22.426850+0000","objects_scrubbed":3,"log_size":37,"log_dups_size":1200,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:18:30.537089+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":5778,"num_read_kb":5143,"num_write":1691,"num_write_kb":698,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2040,"num_omap_keys":8,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.12","version":"267'232","reported_seq":958,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:04.982048+0000","last_change":"2024-09-14T13:02:04.981981+0000","last_active":"2024-09-14T13:02:04.982048+0000","last_peered":"2024-09-14T13:02:04.982048+0000","last_clean":"2024-09-14T13:02:04.982048+0000","last_became_active":"2024-09-14T11:08:21.787257+0000","last_became_peered":"2024-09-14T11:08:21.787257+0000","last_unstale":"2024-09-14T13:02:04.982048+0000","last_undegraded":"2024-09-14T13:02:04.982048+0000","last_fullsized":"2024-09-14T13:02:04.982048+0000","mapping_epoch":24,"log_start":"267'200","ondisk_log_start":"267'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'232","last_scrub_stamp":"2024-09-14T13:02:04.981884+0000","last_deep_scrub":"267'232","last_deep_scrub_stamp":"2024-09-14T13:02:04.981884+0000","last_clean_scrub_stamp":"2024-09-14T13:02:04.981884+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":200,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:03:51.775808+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":660,"num_read_kb":98910,"num_write":982,"num_write_kb":32453,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3],"acting":[0,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":536,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:22.944279+0000","last_change":"2024-09-14T13:02:22.944095+0000","last_active":"2024-09-14T13:02:22.944279+0000","last_peered":"2024-09-14T13:02:22.944279+0000","last_clean":"2024-09-14T13:02:22.944279+0000","last_became_active":"2024-09-14T11:08:25.804100+0000","last_became_peered":"2024-09-14T11:08:25.804100+0000","last_unstale":"2024-09-14T13:02:22.944279+0000","last_undegraded":"2024-09-14T13:02:22.944279+0000","last_fullsized":"2024-09-14T13:02:22.944279+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T13:02:22.943903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T13:02:22.943903+0000","last_clean_scrub_stamp":"2024-09-14T13:02:22.943903+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:47:59.177750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.17","version":"267'132","reported_seq":716,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:33.738666+0000","last_change":"2024-09-14T13:02:33.738666+0000","last_active":"2024-09-14T13:02:33.738666+0000","last_peered":"2024-09-14T13:02:33.738666+0000","last_clean":"2024-09-14T13:02:33.738666+0000","last_became_active":"2024-09-14T11:08:27.831010+0000","last_became_peered":"2024-09-14T11:08:27.831010+0000","last_unstale":"2024-09-14T13:02:33.738666+0000","last_undegraded":"2024-09-14T13:02:33.738666+0000","last_fullsized":"2024-09-14T13:02:33.738666+0000","mapping_epoch":30,"log_start":"267'100","ondisk_log_start":"267'100","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'132","last_scrub_stamp":"2024-09-14T13:02:33.738485+0000","last_deep_scrub":"267'132","last_deep_scrub_stamp":"2024-09-14T13:02:33.738485+0000","last_clean_scrub_stamp":"2024-09-14T13:02:33.738485+0000","objects_scrubbed":3,"log_size":32,"log_dups_size":100,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:36:05.488919+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":152,"num_read_kb":149,"num_write":100,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":528,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:39.633756+0000","last_change":"2024-09-14T13:02:39.633756+0000","last_active":"2024-09-14T13:02:39.633756+0000","last_peered":"2024-09-14T13:02:39.633756+0000","last_clean":"2024-09-14T13:02:39.633756+0000","last_became_active":"2024-09-14T11:08:29.809568+0000","last_became_peered":"2024-09-14T11:08:29.809568+0000","last_unstale":"2024-09-14T13:02:39.633756+0000","last_undegraded":"2024-09-14T13:02:39.633756+0000","last_fullsized":"2024-09-14T13:02:39.633756+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T13:02:39.633574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T13:02:39.633574+0000","last_clean_scrub_stamp":"2024-09-14T13:02:39.633574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:43:20.197341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.1a","version":"267'141","reported_seq":734,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:39.203271+0000","last_change":"2024-09-14T13:02:39.203271+0000","last_active":"2024-09-14T13:02:39.203271+0000","last_peered":"2024-09-14T13:02:39.203271+0000","last_clean":"2024-09-14T13:02:39.203271+0000","last_became_active":"2024-09-14T11:08:31.845634+0000","last_became_peered":"2024-09-14T11:08:31.845634+0000","last_unstale":"2024-09-14T13:02:39.203271+0000","last_undegraded":"2024-09-14T13:02:39.203271+0000","last_fullsized":"2024-09-14T13:02:39.203271+0000","mapping_epoch":34,"log_start":"267'100","ondisk_log_start":"267'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'141","last_scrub_stamp":"2024-09-14T13:02:39.203097+0000","last_deep_scrub":"267'141","last_deep_scrub_stamp":"2024-09-14T13:02:39.203097+0000","last_clean_scrub_stamp":"2024-09-14T13:02:39.203097+0000","objects_scrubbed":4,"log_size":41,"log_dups_size":100,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:04:51.158766+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":271,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":347,"num_read_kb":294,"num_write":357,"num_write_kb":85,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"267'412","reported_seq":1938,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:20.980337+0000","last_change":"2024-09-14T13:02:20.980337+0000","last_active":"2024-09-14T13:02:20.980337+0000","last_peered":"2024-09-14T13:02:20.980337+0000","last_clean":"2024-09-14T13:02:20.980337+0000","last_became_active":"2024-09-14T11:08:23.780326+0000","last_became_peered":"2024-09-14T11:08:23.780326+0000","last_unstale":"2024-09-14T13:02:20.980337+0000","last_undegraded":"2024-09-14T13:02:20.980337+0000","last_fullsized":"2024-09-14T13:02:20.980337+0000","mapping_epoch":26,"log_start":"267'400","ondisk_log_start":"267'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'412","last_scrub_stamp":"2024-09-14T13:02:20.980143+0000","last_deep_scrub":"267'412","last_deep_scrub_stamp":"2024-09-14T13:02:20.980143+0000","last_clean_scrub_stamp":"2024-09-14T13:02:20.980143+0000","objects_scrubbed":3,"log_size":12,"log_dups_size":400,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:17:39.736976+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2172,"num_read_kb":2053,"num_write":475,"num_write_kb":100,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.11","version":"267'229","reported_seq":864,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:07.062585+0000","last_change":"2024-09-14T13:02:07.062536+0000","last_active":"2024-09-14T13:02:07.062585+0000","last_peered":"2024-09-14T13:02:07.062585+0000","last_clean":"2024-09-14T13:02:07.062585+0000","last_became_active":"2024-09-14T11:08:56.038815+0000","last_became_peered":"2024-09-14T11:08:56.038815+0000","last_unstale":"2024-09-14T13:02:07.062585+0000","last_undegraded":"2024-09-14T13:02:07.062585+0000","last_fullsized":"2024-09-14T13:02:07.062585+0000","mapping_epoch":37,"log_start":"267'200","ondisk_log_start":"267'200","created":24,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'229","last_scrub_stamp":"2024-09-14T13:02:07.062441+0000","last_deep_scrub":"267'229","last_deep_scrub_stamp":"2024-09-14T13:02:07.062441+0000","last_clean_scrub_stamp":"2024-09-14T13:02:07.062441+0000","objects_scrubbed":2,"log_size":29,"log_dups_size":200,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:34:17.014914+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":52,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":508,"num_read_kb":22051,"num_write":996,"num_write_kb":45213,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4,6],"acting":[2,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":534,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:24.965066+0000","last_change":"2024-09-14T13:02:24.965066+0000","last_active":"2024-09-14T13:02:24.965066+0000","last_peered":"2024-09-14T13:02:24.965066+0000","last_clean":"2024-09-14T13:02:24.965066+0000","last_became_active":"2024-09-14T11:08:25.798008+0000","last_became_peered":"2024-09-14T11:08:25.798008+0000","last_unstale":"2024-09-14T13:02:24.965066+0000","last_undegraded":"2024-09-14T13:02:24.965066+0000","last_fullsized":"2024-09-14T13:02:24.965066+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T13:02:24.964760+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T13:02:24.964760+0000","last_clean_scrub_stamp":"2024-09-14T13:02:24.964760+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:03:42.094133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.14","version":"267'186","reported_seq":798,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:27.090163+0000","last_change":"2024-09-14T13:02:27.090012+0000","last_active":"2024-09-14T13:02:27.090163+0000","last_peered":"2024-09-14T13:02:27.090163+0000","last_clean":"2024-09-14T13:02:27.090163+0000","last_became_active":"2024-09-14T11:08:27.820627+0000","last_became_peered":"2024-09-14T11:08:27.820627+0000","last_unstale":"2024-09-14T13:02:27.090163+0000","last_undegraded":"2024-09-14T13:02:27.090163+0000","last_fullsized":"2024-09-14T13:02:27.090163+0000","mapping_epoch":30,"log_start":"267'100","ondisk_log_start":"267'100","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'186","last_scrub_stamp":"2024-09-14T13:02:27.089825+0000","last_deep_scrub":"267'186","last_deep_scrub_stamp":"2024-09-14T13:02:27.089825+0000","last_clean_scrub_stamp":"2024-09-14T13:02:27.089825+0000","objects_scrubbed":6,"log_size":86,"log_dups_size":100,"ondisk_log_size":86,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:35:32.897007+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":232,"num_read_kb":224,"num_write":158,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.15","version":"267'776","reported_seq":3181,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:37.570152+0000","last_change":"2024-09-14T13:02:37.570152+0000","last_active":"2024-09-14T13:02:37.570152+0000","last_peered":"2024-09-14T13:02:37.570152+0000","last_clean":"2024-09-14T13:02:37.570152+0000","last_became_active":"2024-09-14T11:08:29.838193+0000","last_became_peered":"2024-09-14T11:08:29.838193+0000","last_unstale":"2024-09-14T13:02:37.570152+0000","last_undegraded":"2024-09-14T13:02:37.570152+0000","last_fullsized":"2024-09-14T13:02:37.570152+0000","mapping_epoch":32,"log_start":"267'701","ondisk_log_start":"267'701","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'776","last_scrub_stamp":"2024-09-14T13:02:37.569957+0000","last_deep_scrub":"267'776","last_deep_scrub_stamp":"2024-09-14T13:02:37.569957+0000","last_clean_scrub_stamp":"2024-09-14T13:02:37.569957+0000","objects_scrubbed":1,"log_size":75,"log_dups_size":701,"ondisk_log_size":75,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:42:49.427217+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1b","version":"267'215","reported_seq":1081,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:41.690416+0000","last_change":"2024-09-14T13:02:41.690416+0000","last_active":"2024-09-14T13:02:41.690416+0000","last_peered":"2024-09-14T13:02:41.690416+0000","last_clean":"2024-09-14T13:02:41.690416+0000","last_became_active":"2024-09-14T11:08:31.843385+0000","last_became_peered":"2024-09-14T11:08:31.843385+0000","last_unstale":"2024-09-14T13:02:41.690416+0000","last_undegraded":"2024-09-14T13:02:41.690416+0000","last_fullsized":"2024-09-14T13:02:41.690416+0000","mapping_epoch":34,"log_start":"267'201","ondisk_log_start":"267'201","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'215","last_scrub_stamp":"2024-09-14T13:02:41.690225+0000","last_deep_scrub":"267'215","last_deep_scrub_stamp":"2024-09-14T13:02:41.690225+0000","last_clean_scrub_stamp":"2024-09-14T13:02:41.690225+0000","objects_scrubbed":5,"log_size":14,"log_dups_size":201,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T00:08:49.260985+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":642,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":623,"num_read_kb":612,"num_write":468,"num_write_kb":119,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":234,"num_omap_keys":2,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.17","version":"267'422","reported_seq":1919,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:13.138664+0000","last_change":"2024-09-14T13:02:13.138664+0000","last_active":"2024-09-14T13:02:13.138664+0000","last_peered":"2024-09-14T13:02:13.138664+0000","last_clean":"2024-09-14T13:02:13.138664+0000","last_became_active":"2024-09-14T11:09:57.239636+0000","last_became_peered":"2024-09-14T11:09:57.239636+0000","last_unstale":"2024-09-14T13:02:13.138664+0000","last_undegraded":"2024-09-14T13:02:13.138664+0000","last_fullsized":"2024-09-14T13:02:13.138664+0000","mapping_epoch":39,"log_start":"267'400","ondisk_log_start":"267'400","created":26,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'422","last_scrub_stamp":"2024-09-14T13:02:13.138458+0000","last_deep_scrub":"267'422","last_deep_scrub_stamp":"2024-09-14T13:02:13.138458+0000","last_clean_scrub_stamp":"2024-09-14T13:02:13.138458+0000","objects_scrubbed":2,"log_size":22,"log_dups_size":400,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:56:36.716655+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2202,"num_read_kb":2076,"num_write":491,"num_write_kb":104,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.10","version":"267'249","reported_seq":926,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:09.253625+0000","last_change":"2024-09-14T13:02:09.253431+0000","last_active":"2024-09-14T13:02:09.253625+0000","last_peered":"2024-09-14T13:02:09.253625+0000","last_clean":"2024-09-14T13:02:09.253625+0000","last_became_active":"2024-09-14T11:08:21.817332+0000","last_became_peered":"2024-09-14T11:08:21.817332+0000","last_unstale":"2024-09-14T13:02:09.253625+0000","last_undegraded":"2024-09-14T13:02:09.253625+0000","last_fullsized":"2024-09-14T13:02:09.253625+0000","mapping_epoch":24,"log_start":"267'200","ondisk_log_start":"267'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'249","last_scrub_stamp":"2024-09-14T13:02:09.253234+0000","last_deep_scrub":"267'249","last_deep_scrub_stamp":"2024-09-14T13:02:09.253234+0000","last_clean_scrub_stamp":"2024-09-14T13:02:09.253234+0000","objects_scrubbed":1,"log_size":49,"log_dups_size":200,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:02:19.341971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":650,"num_read_kb":50041,"num_write":1009,"num_write_kb":23458,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,5],"acting":[6,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":534,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:31.440125+0000","last_change":"2024-09-14T13:02:31.440125+0000","last_active":"2024-09-14T13:02:31.440125+0000","last_peered":"2024-09-14T13:02:31.440125+0000","last_clean":"2024-09-14T13:02:31.440125+0000","last_became_active":"2024-09-14T11:08:25.814645+0000","last_became_peered":"2024-09-14T11:08:25.814645+0000","last_unstale":"2024-09-14T13:02:31.440125+0000","last_undegraded":"2024-09-14T13:02:31.440125+0000","last_fullsized":"2024-09-14T13:02:31.440125+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T13:02:31.439919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T13:02:31.439919+0000","last_clean_scrub_stamp":"2024-09-14T13:02:31.439919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:25:41.343773+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.15","version":"267'184","reported_seq":812,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:33.597620+0000","last_change":"2024-09-14T13:02:33.597620+0000","last_active":"2024-09-14T13:02:33.597620+0000","last_peered":"2024-09-14T13:02:33.597620+0000","last_clean":"2024-09-14T13:02:33.597620+0000","last_became_active":"2024-09-14T11:08:27.827940+0000","last_became_peered":"2024-09-14T11:08:27.827940+0000","last_unstale":"2024-09-14T13:02:33.597620+0000","last_undegraded":"2024-09-14T13:02:33.597620+0000","last_fullsized":"2024-09-14T13:02:33.597620+0000","mapping_epoch":30,"log_start":"267'100","ondisk_log_start":"267'100","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'184","last_scrub_stamp":"2024-09-14T13:02:33.597409+0000","last_deep_scrub":"267'184","last_deep_scrub_stamp":"2024-09-14T13:02:33.597409+0000","last_clean_scrub_stamp":"2024-09-14T13:02:33.597409+0000","objects_scrubbed":5,"log_size":84,"log_dups_size":100,"ondisk_log_size":84,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:01:16.588660+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6699,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":229,"num_read_kb":300,"num_write":130,"num_write_kb":20,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.14","version":"267'816","reported_seq":2996,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:35.956092+0000","last_change":"2024-09-14T13:02:35.955913+0000","last_active":"2024-09-14T13:02:35.956092+0000","last_peered":"2024-09-14T13:02:35.956092+0000","last_clean":"2024-09-14T13:02:35.956092+0000","last_became_active":"2024-09-14T11:08:29.831198+0000","last_became_peered":"2024-09-14T11:08:29.831198+0000","last_unstale":"2024-09-14T13:02:35.956092+0000","last_undegraded":"2024-09-14T13:02:35.956092+0000","last_fullsized":"2024-09-14T13:02:35.956092+0000","mapping_epoch":32,"log_start":"267'800","ondisk_log_start":"267'800","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'816","last_scrub_stamp":"2024-09-14T13:02:35.955719+0000","last_deep_scrub":"267'816","last_deep_scrub_stamp":"2024-09-14T13:02:35.955719+0000","last_clean_scrub_stamp":"2024-09-14T13:02:35.955719+0000","objects_scrubbed":1,"log_size":16,"log_dups_size":800,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:45:59.679413+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.8","version":"267'443","reported_seq":1997,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:21.472063+0000","last_change":"2024-09-14T13:02:21.471906+0000","last_active":"2024-09-14T13:02:21.472063+0000","last_peered":"2024-09-14T13:02:21.472063+0000","last_clean":"2024-09-14T13:02:21.472063+0000","last_became_active":"2024-09-14T11:08:23.811325+0000","last_became_peered":"2024-09-14T11:08:23.811325+0000","last_unstale":"2024-09-14T13:02:21.472063+0000","last_undegraded":"2024-09-14T13:02:21.472063+0000","last_fullsized":"2024-09-14T13:02:21.472063+0000","mapping_epoch":26,"log_start":"267'400","ondisk_log_start":"267'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'443","last_scrub_stamp":"2024-09-14T13:02:21.471733+0000","last_deep_scrub":"267'443","last_deep_scrub_stamp":"2024-09-14T13:02:21.471733+0000","last_clean_scrub_stamp":"2024-09-14T13:02:21.471733+0000","objects_scrubbed":3,"log_size":43,"log_dups_size":400,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T00:28:13.667148+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2277,"num_read_kb":2143,"num_write":513,"num_write_kb":125,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":217,"num_omap_keys":1,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.f","version":"267'247","reported_seq":939,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:09.651897+0000","last_change":"2024-09-14T13:02:09.651897+0000","last_active":"2024-09-14T13:02:09.651897+0000","last_peered":"2024-09-14T13:02:09.651897+0000","last_clean":"2024-09-14T13:02:09.651897+0000","last_became_active":"2024-09-14T11:08:21.845618+0000","last_became_peered":"2024-09-14T11:08:21.845618+0000","last_unstale":"2024-09-14T13:02:09.651897+0000","last_undegraded":"2024-09-14T13:02:09.651897+0000","last_fullsized":"2024-09-14T13:02:09.651897+0000","mapping_epoch":24,"log_start":"267'200","ondisk_log_start":"267'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'247","last_scrub_stamp":"2024-09-14T13:02:09.651691+0000","last_deep_scrub":"267'247","last_deep_scrub_stamp":"2024-09-14T13:02:09.651691+0000","last_clean_scrub_stamp":"2024-09-14T13:02:09.651691+0000","objects_scrubbed":3,"log_size":47,"log_dups_size":200,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:37:39.121548+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":682,"num_read_kb":36009,"num_write":1081,"num_write_kb":30861,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,0],"acting":[7,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":541,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:26.545499+0000","last_change":"2024-09-14T13:02:26.545227+0000","last_active":"2024-09-14T13:02:26.545499+0000","last_peered":"2024-09-14T13:02:26.545499+0000","last_clean":"2024-09-14T13:02:26.545499+0000","last_became_active":"2024-09-14T11:08:25.806427+0000","last_became_peered":"2024-09-14T11:08:25.806427+0000","last_unstale":"2024-09-14T13:02:26.545499+0000","last_undegraded":"2024-09-14T13:02:26.545499+0000","last_fullsized":"2024-09-14T13:02:26.545499+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T13:02:26.545021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T13:02:26.545021+0000","last_clean_scrub_stamp":"2024-09-14T13:02:26.545021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:36:58.214359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.a","version":"267'332","reported_seq":1040,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:34.440856+0000","last_change":"2024-09-14T13:02:34.440856+0000","last_active":"2024-09-14T13:02:34.440856+0000","last_peered":"2024-09-14T13:02:34.440856+0000","last_clean":"2024-09-14T13:02:34.440856+0000","last_became_active":"2024-09-14T11:08:27.825133+0000","last_became_peered":"2024-09-14T11:08:27.825133+0000","last_unstale":"2024-09-14T13:02:34.440856+0000","last_undegraded":"2024-09-14T13:02:34.440856+0000","last_fullsized":"2024-09-14T13:02:34.440856+0000","mapping_epoch":30,"log_start":"267'300","ondisk_log_start":"267'300","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'332","last_scrub_stamp":"2024-09-14T13:02:34.440644+0000","last_deep_scrub":"267'332","last_deep_scrub_stamp":"2024-09-14T13:02:34.440644+0000","last_clean_scrub_stamp":"2024-09-14T13:02:34.440644+0000","objects_scrubbed":10,"log_size":32,"log_dups_size":300,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T00:49:11.129833+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6555,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":452,"num_read_kb":512,"num_write":278,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":528,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:36.180973+0000","last_change":"2024-09-14T13:02:36.180793+0000","last_active":"2024-09-14T13:02:36.180973+0000","last_peered":"2024-09-14T13:02:36.180973+0000","last_clean":"2024-09-14T13:02:36.180973+0000","last_became_active":"2024-09-14T11:08:29.815620+0000","last_became_peered":"2024-09-14T11:08:29.815620+0000","last_unstale":"2024-09-14T13:02:36.180973+0000","last_undegraded":"2024-09-14T13:02:36.180973+0000","last_fullsized":"2024-09-14T13:02:36.180973+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T13:02:36.180603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T13:02:36.180603+0000","last_clean_scrub_stamp":"2024-09-14T13:02:36.180603+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:19:11.606941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.4","version":"267'575","reported_seq":1428,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:39.434276+0000","last_change":"2024-09-14T13:02:39.434130+0000","last_active":"2024-09-14T13:02:39.434276+0000","last_peered":"2024-09-14T13:02:39.434276+0000","last_clean":"2024-09-14T13:02:39.434276+0000","last_became_active":"2024-09-14T11:08:31.843834+0000","last_became_peered":"2024-09-14T11:08:31.843834+0000","last_unstale":"2024-09-14T13:02:39.434276+0000","last_undegraded":"2024-09-14T13:02:39.434276+0000","last_fullsized":"2024-09-14T13:02:39.434276+0000","mapping_epoch":34,"log_start":"267'500","ondisk_log_start":"267'500","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'575","last_scrub_stamp":"2024-09-14T13:02:39.433887+0000","last_deep_scrub":"267'575","last_deep_scrub_stamp":"2024-09-14T13:02:39.433887+0000","last_clean_scrub_stamp":"2024-09-14T13:02:39.433887+0000","objects_scrubbed":6,"log_size":75,"log_dups_size":500,"ondisk_log_size":75,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:35:09.744013+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1277,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":1293,"num_read_kb":1292,"num_write":1202,"num_write_kb":404,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":381,"num_omap_keys":2,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.9","version":"267'1172","reported_seq":2713,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:11.831510+0000","last_change":"2024-09-14T13:02:11.831369+0000","last_active":"2024-09-14T13:02:11.831510+0000","last_peered":"2024-09-14T13:02:11.831510+0000","last_clean":"2024-09-14T13:02:11.831510+0000","last_became_active":"2024-09-14T11:08:23.778539+0000","last_became_peered":"2024-09-14T11:08:23.778539+0000","last_unstale":"2024-09-14T13:02:11.831510+0000","last_undegraded":"2024-09-14T13:02:11.831510+0000","last_fullsized":"2024-09-14T13:02:11.831510+0000","mapping_epoch":26,"log_start":"267'1100","ondisk_log_start":"267'1100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'1172","last_scrub_stamp":"2024-09-14T13:02:11.831174+0000","last_deep_scrub":"267'1172","last_deep_scrub_stamp":"2024-09-14T13:02:11.831174+0000","last_clean_scrub_stamp":"2024-09-14T13:02:11.831174+0000","objects_scrubbed":6,"log_size":72,"log_dups_size":1100,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:09:58.666148+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":5272,"num_read_kb":4639,"num_write":1605,"num_write_kb":663,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"267'241","reported_seq":895,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:10.656227+0000","last_change":"2024-09-14T13:02:10.656071+0000","last_active":"2024-09-14T13:02:10.656227+0000","last_peered":"2024-09-14T13:02:10.656227+0000","last_clean":"2024-09-14T13:02:10.656227+0000","last_became_active":"2024-09-14T11:08:21.836948+0000","last_became_peered":"2024-09-14T11:08:21.836948+0000","last_unstale":"2024-09-14T13:02:10.656227+0000","last_undegraded":"2024-09-14T13:02:10.656227+0000","last_fullsized":"2024-09-14T13:02:10.656227+0000","mapping_epoch":24,"log_start":"267'200","ondisk_log_start":"267'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'241","last_scrub_stamp":"2024-09-14T13:02:10.655851+0000","last_deep_scrub":"267'241","last_deep_scrub_stamp":"2024-09-14T13:02:10.655851+0000","last_clean_scrub_stamp":"2024-09-14T13:02:10.655851+0000","objects_scrubbed":3,"log_size":41,"log_dups_size":200,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T00:25:40.160047+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":550,"num_read_kb":30603,"num_write":1007,"num_write_kb":48772,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,1],"acting":[7,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.8","version":"267'5","reported_seq":1021,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:22.163686+0000","last_change":"2024-09-14T13:02:22.163504+0000","last_active":"2024-09-14T13:02:22.163686+0000","last_peered":"2024-09-14T13:02:22.163686+0000","last_clean":"2024-09-14T13:02:22.163686+0000","last_became_active":"2024-09-14T11:08:25.786631+0000","last_became_peered":"2024-09-14T11:08:25.786631+0000","last_unstale":"2024-09-14T13:02:22.163686+0000","last_undegraded":"2024-09-14T13:02:22.163686+0000","last_fullsized":"2024-09-14T13:02:22.163686+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'5","last_scrub_stamp":"2024-09-14T13:02:22.163310+0000","last_deep_scrub":"267'5","last_deep_scrub_stamp":"2024-09-14T13:02:22.163310+0000","last_clean_scrub_stamp":"2024-09-14T13:02:22.163310+0000","objects_scrubbed":1,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:36:41.907237+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1139,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":718,"num_read_kb":1182,"num_write":8,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.b","version":"267'180","reported_seq":811,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:26.978408+0000","last_change":"2024-09-14T13:02:26.978235+0000","last_active":"2024-09-14T13:02:26.978408+0000","last_peered":"2024-09-14T13:02:26.978408+0000","last_clean":"2024-09-14T13:02:26.978408+0000","last_became_active":"2024-09-14T11:08:27.821051+0000","last_became_peered":"2024-09-14T11:08:27.821051+0000","last_unstale":"2024-09-14T13:02:26.978408+0000","last_undegraded":"2024-09-14T13:02:26.978408+0000","last_fullsized":"2024-09-14T13:02:26.978408+0000","mapping_epoch":30,"log_start":"267'100","ondisk_log_start":"267'100","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'180","last_scrub_stamp":"2024-09-14T13:02:26.978033+0000","last_deep_scrub":"267'180","last_deep_scrub_stamp":"2024-09-14T13:02:26.978033+0000","last_clean_scrub_stamp":"2024-09-14T13:02:26.978033+0000","objects_scrubbed":4,"log_size":80,"log_dups_size":100,"ondisk_log_size":80,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:07:33.857702+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7629,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":234,"num_read_kb":320,"num_write":132,"num_write_kb":26,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":531,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:38.907574+0000","last_change":"2024-09-14T13:02:38.907574+0000","last_active":"2024-09-14T13:02:38.907574+0000","last_peered":"2024-09-14T13:02:38.907574+0000","last_clean":"2024-09-14T13:02:38.907574+0000","last_became_active":"2024-09-14T11:08:29.835446+0000","last_became_peered":"2024-09-14T11:08:29.835446+0000","last_unstale":"2024-09-14T13:02:38.907574+0000","last_undegraded":"2024-09-14T13:02:38.907574+0000","last_fullsized":"2024-09-14T13:02:38.907574+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T13:02:38.907370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T13:02:38.907370+0000","last_clean_scrub_stamp":"2024-09-14T13:02:38.907370+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:54:07.413764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.5","version":"267'2492","reported_seq":4369,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:30.277450+0000","last_change":"2024-09-14T13:02:30.277298+0000","last_active":"2024-09-14T13:02:30.277450+0000","last_peered":"2024-09-14T13:02:30.277450+0000","last_clean":"2024-09-14T13:02:30.277450+0000","last_became_active":"2024-09-14T11:08:31.848959+0000","last_became_peered":"2024-09-14T11:08:31.848959+0000","last_unstale":"2024-09-14T13:02:30.277450+0000","last_undegraded":"2024-09-14T13:02:30.277450+0000","last_fullsized":"2024-09-14T13:02:30.277450+0000","mapping_epoch":34,"log_start":"267'2400","ondisk_log_start":"267'2400","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'2492","last_scrub_stamp":"2024-09-14T13:02:30.277095+0000","last_deep_scrub":"267'2492","last_deep_scrub_stamp":"2024-09-14T13:02:30.277095+0000","last_clean_scrub_stamp":"2024-09-14T13:02:30.277095+0000","objects_scrubbed":2,"log_size":92,"log_dups_size":2400,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:17:08.669349+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":423,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":6223,"num_read_kb":6216,"num_write":5015,"num_write_kb":1852,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":176,"num_omap_keys":1,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.a","version":"267'868","reported_seq":2687,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:14.314869+0000","last_change":"2024-09-14T13:02:14.314869+0000","last_active":"2024-09-14T13:02:14.314869+0000","last_peered":"2024-09-14T13:02:14.314869+0000","last_clean":"2024-09-14T13:02:14.314869+0000","last_became_active":"2024-09-14T11:08:23.811255+0000","last_became_peered":"2024-09-14T11:08:23.811255+0000","last_unstale":"2024-09-14T13:02:14.314869+0000","last_undegraded":"2024-09-14T13:02:14.314869+0000","last_fullsized":"2024-09-14T13:02:14.314869+0000","mapping_epoch":26,"log_start":"267'800","ondisk_log_start":"267'800","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'868","last_scrub_stamp":"2024-09-14T13:02:14.314591+0000","last_deep_scrub":"267'868","last_deep_scrub_stamp":"2024-09-14T13:02:14.314591+0000","last_clean_scrub_stamp":"2024-09-14T13:02:14.314591+0000","objects_scrubbed":2,"log_size":68,"log_dups_size":800,"ondisk_log_size":68,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:09:26.042491+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":4399,"num_read_kb":3998,"num_write":1156,"num_write_kb":415,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"267'213","reported_seq":894,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:12.651292+0000","last_change":"2024-09-14T13:02:12.651148+0000","last_active":"2024-09-14T13:02:12.651292+0000","last_peered":"2024-09-14T13:02:12.651292+0000","last_clean":"2024-09-14T13:02:12.651292+0000","last_became_active":"2024-09-14T11:08:21.804566+0000","last_became_peered":"2024-09-14T11:08:21.804566+0000","last_unstale":"2024-09-14T13:02:12.651292+0000","last_undegraded":"2024-09-14T13:02:12.651292+0000","last_fullsized":"2024-09-14T13:02:12.651292+0000","mapping_epoch":24,"log_start":"267'200","ondisk_log_start":"267'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'213","last_scrub_stamp":"2024-09-14T13:02:12.650904+0000","last_deep_scrub":"267'213","last_deep_scrub_stamp":"2024-09-14T13:02:12.650904+0000","last_clean_scrub_stamp":"2024-09-14T13:02:12.650904+0000","objects_scrubbed":6,"log_size":13,"log_dups_size":200,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:40:39.876331+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3311695,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":558,"num_read_kb":39823,"num_write":955,"num_write_kb":36124,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,3],"acting":[7,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":542,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:28.128223+0000","last_change":"2024-09-14T13:02:28.128083+0000","last_active":"2024-09-14T13:02:28.128223+0000","last_peered":"2024-09-14T13:02:28.128223+0000","last_clean":"2024-09-14T13:02:28.128223+0000","last_became_active":"2024-09-14T11:08:25.789075+0000","last_became_peered":"2024-09-14T11:08:25.789075+0000","last_unstale":"2024-09-14T13:02:28.128223+0000","last_undegraded":"2024-09-14T13:02:28.128223+0000","last_fullsized":"2024-09-14T13:02:28.128223+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T13:02:28.127905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T13:02:28.127905+0000","last_clean_scrub_stamp":"2024-09-14T13:02:28.127905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:54:32.722141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.8","version":"267'240","reported_seq":910,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:31.566097+0000","last_change":"2024-09-14T13:02:31.565905+0000","last_active":"2024-09-14T13:02:31.566097+0000","last_peered":"2024-09-14T13:02:31.566097+0000","last_clean":"2024-09-14T13:02:31.566097+0000","last_became_active":"2024-09-14T11:08:27.830862+0000","last_became_peered":"2024-09-14T11:08:27.830862+0000","last_unstale":"2024-09-14T13:02:31.566097+0000","last_undegraded":"2024-09-14T13:02:31.566097+0000","last_fullsized":"2024-09-14T13:02:31.566097+0000","mapping_epoch":30,"log_start":"267'200","ondisk_log_start":"267'200","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'240","last_scrub_stamp":"2024-09-14T13:02:31.565702+0000","last_deep_scrub":"267'240","last_deep_scrub_stamp":"2024-09-14T13:02:31.565702+0000","last_clean_scrub_stamp":"2024-09-14T13:02:31.565702+0000","objects_scrubbed":7,"log_size":40,"log_dups_size":200,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:48:33.239781+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4096,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":320,"num_read_kb":327,"num_write":186,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.9","version":"267'785","reported_seq":3482,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:30.036046+0000","last_change":"2024-09-14T13:02:30.035900+0000","last_active":"2024-09-14T13:02:30.036046+0000","last_peered":"2024-09-14T13:02:30.036046+0000","last_clean":"2024-09-14T13:02:30.036046+0000","last_became_active":"2024-09-14T11:08:29.821920+0000","last_became_peered":"2024-09-14T11:08:29.821920+0000","last_unstale":"2024-09-14T13:02:30.036046+0000","last_undegraded":"2024-09-14T13:02:30.036046+0000","last_fullsized":"2024-09-14T13:02:30.036046+0000","mapping_epoch":32,"log_start":"267'700","ondisk_log_start":"267'700","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'785","last_scrub_stamp":"2024-09-14T13:02:30.035684+0000","last_deep_scrub":"267'785","last_deep_scrub_stamp":"2024-09-14T13:02:30.035684+0000","last_clean_scrub_stamp":"2024-09-14T13:02:30.035684+0000","objects_scrubbed":1,"log_size":85,"log_dups_size":700,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:32:34.155277+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.6","version":"267'128","reported_seq":674,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:37.211349+0000","last_change":"2024-09-14T13:02:37.211214+0000","last_active":"2024-09-14T13:02:37.211349+0000","last_peered":"2024-09-14T13:02:37.211349+0000","last_clean":"2024-09-14T13:02:37.211349+0000","last_became_active":"2024-09-14T11:08:31.846373+0000","last_became_peered":"2024-09-14T11:08:31.846373+0000","last_unstale":"2024-09-14T13:02:37.211349+0000","last_undegraded":"2024-09-14T13:02:37.211349+0000","last_fullsized":"2024-09-14T13:02:37.211349+0000","mapping_epoch":34,"log_start":"267'100","ondisk_log_start":"267'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'128","last_scrub_stamp":"2024-09-14T13:02:37.211023+0000","last_deep_scrub":"267'128","last_deep_scrub_stamp":"2024-09-14T13:02:37.211023+0000","last_clean_scrub_stamp":"2024-09-14T13:02:37.211023+0000","objects_scrubbed":2,"log_size":28,"log_dups_size":100,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:02:57.592912+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":575,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":123,"num_write":296,"num_write_kb":71,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"267'1041","reported_seq":2686,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:19.068780+0000","last_change":"2024-09-14T13:02:19.068533+0000","last_active":"2024-09-14T13:02:19.068780+0000","last_peered":"2024-09-14T13:02:19.068780+0000","last_clean":"2024-09-14T13:02:19.068780+0000","last_became_active":"2024-09-14T11:08:23.777032+0000","last_became_peered":"2024-09-14T11:08:23.777032+0000","last_unstale":"2024-09-14T13:02:19.068780+0000","last_undegraded":"2024-09-14T13:02:19.068780+0000","last_fullsized":"2024-09-14T13:02:19.068780+0000","mapping_epoch":26,"log_start":"267'1000","ondisk_log_start":"267'1000","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'1041","last_scrub_stamp":"2024-09-14T13:02:19.068315+0000","last_deep_scrub":"267'1041","last_deep_scrub_stamp":"2024-09-14T13:02:19.068315+0000","last_clean_scrub_stamp":"2024-09-14T13:02:19.068315+0000","objects_scrubbed":1,"log_size":41,"log_dups_size":1000,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T00:09:24.080847+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":7372,"num_read_kb":6755,"num_write":1704,"num_write_kb":754,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.c","version":"267'187","reported_seq":836,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:10.302841+0000","last_change":"2024-09-14T13:02:10.302676+0000","last_active":"2024-09-14T13:02:10.302841+0000","last_peered":"2024-09-14T13:02:10.302841+0000","last_clean":"2024-09-14T13:02:10.302841+0000","last_became_active":"2024-09-14T11:08:21.828010+0000","last_became_peered":"2024-09-14T11:08:21.828010+0000","last_unstale":"2024-09-14T13:02:10.302841+0000","last_undegraded":"2024-09-14T13:02:10.302841+0000","last_fullsized":"2024-09-14T13:02:10.302841+0000","mapping_epoch":24,"log_start":"267'100","ondisk_log_start":"267'100","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'187","last_scrub_stamp":"2024-09-14T13:02:10.302469+0000","last_deep_scrub":"267'187","last_deep_scrub_stamp":"2024-09-14T13:02:10.302469+0000","last_clean_scrub_stamp":"2024-09-14T13:02:10.302469+0000","objects_scrubbed":2,"log_size":87,"log_dups_size":100,"ondisk_log_size":87,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T00:03:54.075323+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":29,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":466,"num_read_kb":18086,"num_write":819,"num_write_kb":39275,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,6],"acting":[5,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":543,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:21.173257+0000","last_change":"2024-09-14T13:02:21.173257+0000","last_active":"2024-09-14T13:02:21.173257+0000","last_peered":"2024-09-14T13:02:21.173257+0000","last_clean":"2024-09-14T13:02:21.173257+0000","last_became_active":"2024-09-14T11:08:25.805415+0000","last_became_peered":"2024-09-14T11:08:25.805415+0000","last_unstale":"2024-09-14T13:02:21.173257+0000","last_undegraded":"2024-09-14T13:02:21.173257+0000","last_fullsized":"2024-09-14T13:02:21.173257+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T13:02:21.173074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T13:02:21.173074+0000","last_clean_scrub_stamp":"2024-09-14T13:02:21.173074+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:57:11.797331+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"267'252","reported_seq":951,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:25.973888+0000","last_change":"2024-09-14T13:02:25.973750+0000","last_active":"2024-09-14T13:02:25.973888+0000","last_peered":"2024-09-14T13:02:25.973888+0000","last_clean":"2024-09-14T13:02:25.973888+0000","last_became_active":"2024-09-14T11:08:27.811687+0000","last_became_peered":"2024-09-14T11:08:27.811687+0000","last_unstale":"2024-09-14T13:02:25.973888+0000","last_undegraded":"2024-09-14T13:02:25.973888+0000","last_fullsized":"2024-09-14T13:02:25.973888+0000","mapping_epoch":30,"log_start":"267'200","ondisk_log_start":"267'200","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'252","last_scrub_stamp":"2024-09-14T13:02:25.973551+0000","last_deep_scrub":"267'252","last_deep_scrub_stamp":"2024-09-14T13:02:25.973551+0000","last_clean_scrub_stamp":"2024-09-14T13:02:25.973551+0000","objects_scrubbed":6,"log_size":52,"log_dups_size":200,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:23:33.816144+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":25927,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":349,"num_read_kb":508,"num_write":186,"num_write_kb":50,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":536,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:26.043663+0000","last_change":"2024-09-14T13:02:26.043510+0000","last_active":"2024-09-14T13:02:26.043663+0000","last_peered":"2024-09-14T13:02:26.043663+0000","last_clean":"2024-09-14T13:02:26.043663+0000","last_became_active":"2024-09-14T11:08:29.821747+0000","last_became_peered":"2024-09-14T11:08:29.821747+0000","last_unstale":"2024-09-14T13:02:26.043663+0000","last_undegraded":"2024-09-14T13:02:26.043663+0000","last_fullsized":"2024-09-14T13:02:26.043663+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T13:02:26.043324+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T13:02:26.043324+0000","last_clean_scrub_stamp":"2024-09-14T13:02:26.043324+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:05:56.999647+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.7","version":"267'151","reported_seq":706,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:29.128252+0000","last_change":"2024-09-14T13:02:29.128113+0000","last_active":"2024-09-14T13:02:29.128252+0000","last_peered":"2024-09-14T13:02:29.128252+0000","last_clean":"2024-09-14T13:02:29.128252+0000","last_became_active":"2024-09-14T11:08:31.838392+0000","last_became_peered":"2024-09-14T11:08:31.838392+0000","last_unstale":"2024-09-14T13:02:29.128252+0000","last_undegraded":"2024-09-14T13:02:29.128252+0000","last_fullsized":"2024-09-14T13:02:29.128252+0000","mapping_epoch":34,"log_start":"267'100","ondisk_log_start":"267'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'151","last_scrub_stamp":"2024-09-14T13:02:29.127914+0000","last_deep_scrub":"267'151","last_deep_scrub_stamp":"2024-09-14T13:02:29.127914+0000","last_clean_scrub_stamp":"2024-09-14T13:02:29.127914+0000","objects_scrubbed":3,"log_size":51,"log_dups_size":100,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:09:19.987511+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":722,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":177,"num_read_kb":165,"num_write":335,"num_write_kb":82,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"267'557","reported_seq":2168,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:12.782478+0000","last_change":"2024-09-14T13:02:12.782223+0000","last_active":"2024-09-14T13:02:12.782478+0000","last_peered":"2024-09-14T13:02:12.782478+0000","last_clean":"2024-09-14T13:02:12.782478+0000","last_became_active":"2024-09-14T11:08:23.788219+0000","last_became_peered":"2024-09-14T11:08:23.788219+0000","last_unstale":"2024-09-14T13:02:12.782478+0000","last_undegraded":"2024-09-14T13:02:12.782478+0000","last_fullsized":"2024-09-14T13:02:12.782478+0000","mapping_epoch":26,"log_start":"267'500","ondisk_log_start":"267'500","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'557","last_scrub_stamp":"2024-09-14T13:02:12.781939+0000","last_deep_scrub":"267'557","last_deep_scrub_stamp":"2024-09-14T13:02:12.781939+0000","last_clean_scrub_stamp":"2024-09-14T13:02:12.781939+0000","objects_scrubbed":0,"log_size":57,"log_dups_size":500,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:01:16.526677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2903,"num_read_kb":2651,"num_write":738,"num_write_kb":289,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"267'322","reported_seq":1078,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:07.945984+0000","last_change":"2024-09-14T13:02:07.945838+0000","last_active":"2024-09-14T13:02:07.945984+0000","last_peered":"2024-09-14T13:02:07.945984+0000","last_clean":"2024-09-14T13:02:07.945984+0000","last_became_active":"2024-09-14T11:08:21.827553+0000","last_became_peered":"2024-09-14T11:08:21.827553+0000","last_unstale":"2024-09-14T13:02:07.945984+0000","last_undegraded":"2024-09-14T13:02:07.945984+0000","last_fullsized":"2024-09-14T13:02:07.945984+0000","mapping_epoch":24,"log_start":"267'300","ondisk_log_start":"267'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'322","last_scrub_stamp":"2024-09-14T13:02:07.945633+0000","last_deep_scrub":"267'322","last_deep_scrub_stamp":"2024-09-14T13:02:07.945633+0000","last_clean_scrub_stamp":"2024-09-14T13:02:07.945633+0000","objects_scrubbed":2,"log_size":22,"log_dups_size":300,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:22:36.317068+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1003,"num_read_kb":39840,"num_write":1278,"num_write_kb":27597,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,4],"acting":[3,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":542,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:24.101276+0000","last_change":"2024-09-14T13:02:24.101103+0000","last_active":"2024-09-14T13:02:24.101276+0000","last_peered":"2024-09-14T13:02:24.101276+0000","last_clean":"2024-09-14T13:02:24.101276+0000","last_became_active":"2024-09-14T11:08:25.798931+0000","last_became_peered":"2024-09-14T11:08:25.798931+0000","last_unstale":"2024-09-14T13:02:24.101276+0000","last_undegraded":"2024-09-14T13:02:24.101276+0000","last_fullsized":"2024-09-14T13:02:24.101276+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T13:02:24.100892+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T13:02:24.100892+0000","last_clean_scrub_stamp":"2024-09-14T13:02:24.100892+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:15:17.317882+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.e","version":"267'210","reported_seq":855,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:31.667742+0000","last_change":"2024-09-14T13:02:31.667503+0000","last_active":"2024-09-14T13:02:31.667742+0000","last_peered":"2024-09-14T13:02:31.667742+0000","last_clean":"2024-09-14T13:02:31.667742+0000","last_became_active":"2024-09-14T11:08:27.818219+0000","last_became_peered":"2024-09-14T11:08:27.818219+0000","last_unstale":"2024-09-14T13:02:31.667742+0000","last_undegraded":"2024-09-14T13:02:31.667742+0000","last_fullsized":"2024-09-14T13:02:31.667742+0000","mapping_epoch":30,"log_start":"264'100","ondisk_log_start":"264'100","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'210","last_scrub_stamp":"2024-09-14T13:02:31.667260+0000","last_deep_scrub":"267'210","last_deep_scrub_stamp":"2024-09-14T13:02:31.667260+0000","last_clean_scrub_stamp":"2024-09-14T13:02:31.667260+0000","objects_scrubbed":6,"log_size":110,"log_dups_size":100,"ondisk_log_size":110,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:37:05.528538+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6420,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":294,"num_read_kb":320,"num_write":220,"num_write_kb":86,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":15964,"num_omap_keys":38,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":534,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:34.134567+0000","last_change":"2024-09-14T13:02:34.134567+0000","last_active":"2024-09-14T13:02:34.134567+0000","last_peered":"2024-09-14T13:02:34.134567+0000","last_clean":"2024-09-14T13:02:34.134567+0000","last_became_active":"2024-09-14T11:08:29.824057+0000","last_became_peered":"2024-09-14T11:08:29.824057+0000","last_unstale":"2024-09-14T13:02:34.134567+0000","last_undegraded":"2024-09-14T13:02:34.134567+0000","last_fullsized":"2024-09-14T13:02:34.134567+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T13:02:34.134358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T13:02:34.134358+0000","last_clean_scrub_stamp":"2024-09-14T13:02:34.134358+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:13:01.485748+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.0","version":"267'132","reported_seq":665,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:43.934231+0000","last_change":"2024-09-14T13:02:43.934066+0000","last_active":"2024-09-14T13:02:43.934231+0000","last_peered":"2024-09-14T13:02:43.934231+0000","last_clean":"2024-09-14T13:02:43.934231+0000","last_became_active":"2024-09-14T11:08:31.844832+0000","last_became_peered":"2024-09-14T11:08:31.844832+0000","last_unstale":"2024-09-14T13:02:43.934231+0000","last_undegraded":"2024-09-14T13:02:43.934231+0000","last_fullsized":"2024-09-14T13:02:43.934231+0000","mapping_epoch":34,"log_start":"267'100","ondisk_log_start":"267'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'132","last_scrub_stamp":"2024-09-14T13:02:43.933873+0000","last_deep_scrub":"267'132","last_deep_scrub_stamp":"2024-09-14T13:02:43.933873+0000","last_clean_scrub_stamp":"2024-09-14T13:02:43.933873+0000","objects_scrubbed":5,"log_size":32,"log_dups_size":100,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:33:05.732072+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":910,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":99,"num_read_kb":98,"num_write":310,"num_write_kb":70,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"267'808","reported_seq":2449,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:13.800269+0000","last_change":"2024-09-14T13:02:13.800136+0000","last_active":"2024-09-14T13:02:13.800269+0000","last_peered":"2024-09-14T13:02:13.800269+0000","last_clean":"2024-09-14T13:02:13.800269+0000","last_became_active":"2024-09-14T11:08:23.791966+0000","last_became_peered":"2024-09-14T11:08:23.791966+0000","last_unstale":"2024-09-14T13:02:13.800269+0000","last_undegraded":"2024-09-14T13:02:13.800269+0000","last_fullsized":"2024-09-14T13:02:13.800269+0000","mapping_epoch":26,"log_start":"267'700","ondisk_log_start":"267'700","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'808","last_scrub_stamp":"2024-09-14T13:02:13.799940+0000","last_deep_scrub":"267'808","last_deep_scrub_stamp":"2024-09-14T13:02:13.799940+0000","last_clean_scrub_stamp":"2024-09-14T13:02:13.799940+0000","objects_scrubbed":1,"log_size":108,"log_dups_size":700,"ondisk_log_size":108,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:03:49.959088+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3905,"num_read_kb":3535,"num_write":1083,"num_write_kb":396,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"267'233","reported_seq":916,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:10.262031+0000","last_change":"2024-09-14T13:02:10.262031+0000","last_active":"2024-09-14T13:02:10.262031+0000","last_peered":"2024-09-14T13:02:10.262031+0000","last_clean":"2024-09-14T13:02:10.262031+0000","last_became_active":"2024-09-14T11:08:21.836346+0000","last_became_peered":"2024-09-14T11:08:21.836346+0000","last_unstale":"2024-09-14T13:02:10.262031+0000","last_undegraded":"2024-09-14T13:02:10.262031+0000","last_fullsized":"2024-09-14T13:02:10.262031+0000","mapping_epoch":24,"log_start":"267'200","ondisk_log_start":"267'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'233","last_scrub_stamp":"2024-09-14T13:02:10.261790+0000","last_deep_scrub":"267'233","last_deep_scrub_stamp":"2024-09-14T13:02:10.261790+0000","last_clean_scrub_stamp":"2024-09-14T13:02:10.261790+0000","objects_scrubbed":3,"log_size":33,"log_dups_size":200,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:01:19.068873+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2055072,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":607,"num_read_kb":23439,"num_write":1082,"num_write_kb":33198,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,1],"acting":[6,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":536,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:20.025738+0000","last_change":"2024-09-14T13:02:20.025587+0000","last_active":"2024-09-14T13:02:20.025738+0000","last_peered":"2024-09-14T13:02:20.025738+0000","last_clean":"2024-09-14T13:02:20.025738+0000","last_became_active":"2024-09-14T11:08:25.806502+0000","last_became_peered":"2024-09-14T11:08:25.806502+0000","last_unstale":"2024-09-14T13:02:20.025738+0000","last_undegraded":"2024-09-14T13:02:20.025738+0000","last_fullsized":"2024-09-14T13:02:20.025738+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T13:02:20.025419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T13:02:20.025419+0000","last_clean_scrub_stamp":"2024-09-14T13:02:20.025419+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:06:23.521008+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.f","version":"267'246","reported_seq":916,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:25.074588+0000","last_change":"2024-09-14T13:02:25.074588+0000","last_active":"2024-09-14T13:02:25.074588+0000","last_peered":"2024-09-14T13:02:25.074588+0000","last_clean":"2024-09-14T13:02:25.074588+0000","last_became_active":"2024-09-14T11:08:27.817904+0000","last_became_peered":"2024-09-14T11:08:27.817904+0000","last_unstale":"2024-09-14T13:02:25.074588+0000","last_undegraded":"2024-09-14T13:02:25.074588+0000","last_fullsized":"2024-09-14T13:02:25.074588+0000","mapping_epoch":30,"log_start":"267'200","ondisk_log_start":"267'200","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'246","last_scrub_stamp":"2024-09-14T13:02:25.074372+0000","last_deep_scrub":"267'246","last_deep_scrub_stamp":"2024-09-14T13:02:25.074372+0000","last_clean_scrub_stamp":"2024-09-14T13:02:25.074372+0000","objects_scrubbed":7,"log_size":46,"log_dups_size":200,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:02:03.126229+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8985,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":331,"num_read_kb":393,"num_write":194,"num_write_kb":21,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.e","version":"267'763","reported_seq":3244,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:29.123531+0000","last_change":"2024-09-14T13:02:29.123290+0000","last_active":"2024-09-14T13:02:29.123531+0000","last_peered":"2024-09-14T13:02:29.123531+0000","last_clean":"2024-09-14T13:02:29.123531+0000","last_became_active":"2024-09-14T11:08:29.817475+0000","last_became_peered":"2024-09-14T11:08:29.817475+0000","last_unstale":"2024-09-14T13:02:29.123531+0000","last_undegraded":"2024-09-14T13:02:29.123531+0000","last_fullsized":"2024-09-14T13:02:29.123531+0000","mapping_epoch":32,"log_start":"267'700","ondisk_log_start":"267'700","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'763","last_scrub_stamp":"2024-09-14T13:02:29.122983+0000","last_deep_scrub":"267'763","last_deep_scrub_stamp":"2024-09-14T13:02:29.122983+0000","last_clean_scrub_stamp":"2024-09-14T13:02:29.122983+0000","objects_scrubbed":1,"log_size":63,"log_dups_size":700,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T00:20:17.430015+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1","version":"267'134","reported_seq":681,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:30.143752+0000","last_change":"2024-09-14T13:02:30.143565+0000","last_active":"2024-09-14T13:02:30.143752+0000","last_peered":"2024-09-14T13:02:30.143752+0000","last_clean":"2024-09-14T13:02:30.143752+0000","last_became_active":"2024-09-14T11:08:31.847603+0000","last_became_peered":"2024-09-14T11:08:31.847603+0000","last_unstale":"2024-09-14T13:02:30.143752+0000","last_undegraded":"2024-09-14T13:02:30.143752+0000","last_fullsized":"2024-09-14T13:02:30.143752+0000","mapping_epoch":34,"log_start":"267'100","ondisk_log_start":"267'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'134","last_scrub_stamp":"2024-09-14T13:02:30.143380+0000","last_deep_scrub":"267'134","last_deep_scrub_stamp":"2024-09-14T13:02:30.143380+0000","last_clean_scrub_stamp":"2024-09-14T13:02:30.143380+0000","objects_scrubbed":4,"log_size":34,"log_dups_size":100,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:29:36.739368+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1261,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":168,"num_read_kb":154,"num_write":334,"num_write_kb":78,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"267'386","reported_seq":1941,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:14.788998+0000","last_change":"2024-09-14T13:02:14.788852+0000","last_active":"2024-09-14T13:02:14.788998+0000","last_peered":"2024-09-14T13:02:14.788998+0000","last_clean":"2024-09-14T13:02:14.788998+0000","last_became_active":"2024-09-14T11:08:23.814578+0000","last_became_peered":"2024-09-14T11:08:23.814578+0000","last_unstale":"2024-09-14T13:02:14.788998+0000","last_undegraded":"2024-09-14T13:02:14.788998+0000","last_fullsized":"2024-09-14T13:02:14.788998+0000","mapping_epoch":26,"log_start":"267'300","ondisk_log_start":"267'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'386","last_scrub_stamp":"2024-09-14T13:02:14.788668+0000","last_deep_scrub":"267'386","last_deep_scrub_stamp":"2024-09-14T13:02:14.788668+0000","last_clean_scrub_stamp":"2024-09-14T13:02:14.788668+0000","objects_scrubbed":1,"log_size":86,"log_dups_size":300,"ondisk_log_size":86,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:27:33.280225+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2178,"num_read_kb":2072,"num_write":449,"num_write_kb":92,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.9","version":"267'206","reported_seq":871,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:07.862176+0000","last_change":"2024-09-14T13:02:07.861868+0000","last_active":"2024-09-14T13:02:07.862176+0000","last_peered":"2024-09-14T13:02:07.862176+0000","last_clean":"2024-09-14T13:02:07.862176+0000","last_became_active":"2024-09-14T11:08:21.824109+0000","last_became_peered":"2024-09-14T11:08:21.824109+0000","last_unstale":"2024-09-14T13:02:07.862176+0000","last_undegraded":"2024-09-14T13:02:07.862176+0000","last_fullsized":"2024-09-14T13:02:07.862176+0000","mapping_epoch":24,"log_start":"267'100","ondisk_log_start":"267'100","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'206","last_scrub_stamp":"2024-09-14T13:02:07.861610+0000","last_deep_scrub":"267'206","last_deep_scrub_stamp":"2024-09-14T13:02:07.861610+0000","last_clean_scrub_stamp":"2024-09-14T13:02:07.861610+0000","objects_scrubbed":3,"log_size":106,"log_dups_size":100,"ondisk_log_size":106,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:54:21.419194+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1655851,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":552,"num_read_kb":13686,"num_write":959,"num_write_kb":41004,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,7],"acting":[4,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.f","version":"267'4","reported_seq":1487,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:29.522816+0000","last_change":"2024-09-14T13:02:29.522816+0000","last_active":"2024-09-14T13:02:29.522816+0000","last_peered":"2024-09-14T13:02:29.522816+0000","last_clean":"2024-09-14T13:02:29.522816+0000","last_became_active":"2024-09-14T11:08:25.815109+0000","last_became_peered":"2024-09-14T11:08:25.815109+0000","last_unstale":"2024-09-14T13:02:29.522816+0000","last_undegraded":"2024-09-14T13:02:29.522816+0000","last_fullsized":"2024-09-14T13:02:29.522816+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'4","last_scrub_stamp":"2024-09-14T13:02:29.522630+0000","last_deep_scrub":"267'4","last_deep_scrub_stamp":"2024-09-14T13:02:29.522630+0000","last_clean_scrub_stamp":"2024-09-14T13:02:29.522630+0000","objects_scrubbed":2,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T00:08:08.934481+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":946,"num_read_kb":946,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.c","version":"267'157","reported_seq":752,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:29.910866+0000","last_change":"2024-09-14T13:02:29.910731+0000","last_active":"2024-09-14T13:02:29.910866+0000","last_peered":"2024-09-14T13:02:29.910866+0000","last_clean":"2024-09-14T13:02:29.910866+0000","last_became_active":"2024-09-14T11:08:27.799244+0000","last_became_peered":"2024-09-14T11:08:27.799244+0000","last_unstale":"2024-09-14T13:02:29.910866+0000","last_undegraded":"2024-09-14T13:02:29.910866+0000","last_fullsized":"2024-09-14T13:02:29.910866+0000","mapping_epoch":30,"log_start":"267'100","ondisk_log_start":"267'100","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'157","last_scrub_stamp":"2024-09-14T13:02:29.910539+0000","last_deep_scrub":"267'157","last_deep_scrub_stamp":"2024-09-14T13:02:29.910539+0000","last_clean_scrub_stamp":"2024-09-14T13:02:29.910539+0000","objects_scrubbed":5,"log_size":57,"log_dups_size":100,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:53:22.851388+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":184,"num_read_kb":178,"num_write":124,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.d","version":"267'769","reported_seq":3173,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:26.309579+0000","last_change":"2024-09-14T13:02:26.309439+0000","last_active":"2024-09-14T13:02:26.309579+0000","last_peered":"2024-09-14T13:02:26.309579+0000","last_clean":"2024-09-14T13:02:26.309579+0000","last_became_active":"2024-09-14T11:08:29.828249+0000","last_became_peered":"2024-09-14T11:08:29.828249+0000","last_unstale":"2024-09-14T13:02:26.309579+0000","last_undegraded":"2024-09-14T13:02:26.309579+0000","last_fullsized":"2024-09-14T13:02:26.309579+0000","mapping_epoch":32,"log_start":"267'701","ondisk_log_start":"267'701","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'769","last_scrub_stamp":"2024-09-14T13:02:26.309151+0000","last_deep_scrub":"267'769","last_deep_scrub_stamp":"2024-09-14T13:02:26.309151+0000","last_clean_scrub_stamp":"2024-09-14T13:02:26.309151+0000","objects_scrubbed":1,"log_size":68,"log_dups_size":701,"ondisk_log_size":68,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:10:16.372727+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.2","version":"267'160","reported_seq":703,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:37.660676+0000","last_change":"2024-09-14T13:02:37.660489+0000","last_active":"2024-09-14T13:02:37.660676+0000","last_peered":"2024-09-14T13:02:37.660676+0000","last_clean":"2024-09-14T13:02:37.660676+0000","last_became_active":"2024-09-14T11:08:31.849463+0000","last_became_peered":"2024-09-14T11:08:31.849463+0000","last_unstale":"2024-09-14T13:02:37.660676+0000","last_undegraded":"2024-09-14T13:02:37.660676+0000","last_fullsized":"2024-09-14T13:02:37.660676+0000","mapping_epoch":34,"log_start":"267'100","ondisk_log_start":"267'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'160","last_scrub_stamp":"2024-09-14T13:02:37.660251+0000","last_deep_scrub":"267'160","last_deep_scrub_stamp":"2024-09-14T13:02:37.660251+0000","last_clean_scrub_stamp":"2024-09-14T13:02:37.660251+0000","objects_scrubbed":0,"log_size":60,"log_dups_size":100,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:40:12.598378+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":154,"num_read_kb":144,"num_write":375,"num_write_kb":85,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"267'386","reported_seq":1885,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:16.081071+0000","last_change":"2024-09-14T13:02:16.080785+0000","last_active":"2024-09-14T13:02:16.081071+0000","last_peered":"2024-09-14T13:02:16.081071+0000","last_clean":"2024-09-14T13:02:16.081071+0000","last_became_active":"2024-09-14T11:08:23.783481+0000","last_became_peered":"2024-09-14T11:08:23.783481+0000","last_unstale":"2024-09-14T13:02:16.081071+0000","last_undegraded":"2024-09-14T13:02:16.081071+0000","last_fullsized":"2024-09-14T13:02:16.081071+0000","mapping_epoch":26,"log_start":"267'300","ondisk_log_start":"267'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'386","last_scrub_stamp":"2024-09-14T13:02:16.080562+0000","last_deep_scrub":"267'386","last_deep_scrub_stamp":"2024-09-14T13:02:16.080562+0000","last_clean_scrub_stamp":"2024-09-14T13:02:16.080562+0000","objects_scrubbed":4,"log_size":86,"log_dups_size":300,"ondisk_log_size":86,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:15:42.229866+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":2050,"num_read_kb":1948,"num_write":423,"num_write_kb":74,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"267'177","reported_seq":839,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:09.948463+0000","last_change":"2024-09-14T13:02:09.948319+0000","last_active":"2024-09-14T13:02:09.948463+0000","last_peered":"2024-09-14T13:02:09.948463+0000","last_clean":"2024-09-14T13:02:09.948463+0000","last_became_active":"2024-09-14T11:08:21.786611+0000","last_became_peered":"2024-09-14T11:08:21.786611+0000","last_unstale":"2024-09-14T13:02:09.948463+0000","last_undegraded":"2024-09-14T13:02:09.948463+0000","last_fullsized":"2024-09-14T13:02:09.948463+0000","mapping_epoch":24,"log_start":"267'100","ondisk_log_start":"267'100","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'177","last_scrub_stamp":"2024-09-14T13:02:09.948060+0000","last_deep_scrub":"267'177","last_deep_scrub_stamp":"2024-09-14T13:02:09.948060+0000","last_clean_scrub_stamp":"2024-09-14T13:02:09.948060+0000","objects_scrubbed":4,"log_size":77,"log_dups_size":100,"ondisk_log_size":77,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:07:24.070925+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1655868,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":450,"num_read_kb":66993,"num_write":850,"num_write_kb":21210,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7],"acting":[3,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":540,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:28.666043+0000","last_change":"2024-09-14T13:02:28.665844+0000","last_active":"2024-09-14T13:02:28.666043+0000","last_peered":"2024-09-14T13:02:28.666043+0000","last_clean":"2024-09-14T13:02:28.666043+0000","last_became_active":"2024-09-14T11:08:25.817491+0000","last_became_peered":"2024-09-14T11:08:25.817491+0000","last_unstale":"2024-09-14T13:02:28.666043+0000","last_undegraded":"2024-09-14T13:02:28.666043+0000","last_fullsized":"2024-09-14T13:02:28.666043+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T13:02:28.665658+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T13:02:28.665658+0000","last_clean_scrub_stamp":"2024-09-14T13:02:28.665658+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:11:14.212412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.d","version":"267'303","reported_seq":998,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:35.435509+0000","last_change":"2024-09-14T13:02:35.435272+0000","last_active":"2024-09-14T13:02:35.435509+0000","last_peered":"2024-09-14T13:02:35.435509+0000","last_clean":"2024-09-14T13:02:35.435509+0000","last_became_active":"2024-09-14T11:08:27.829060+0000","last_became_peered":"2024-09-14T11:08:27.829060+0000","last_unstale":"2024-09-14T13:02:35.435509+0000","last_undegraded":"2024-09-14T13:02:35.435509+0000","last_fullsized":"2024-09-14T13:02:35.435509+0000","mapping_epoch":30,"log_start":"267'200","ondisk_log_start":"267'200","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'303","last_scrub_stamp":"2024-09-14T13:02:35.435035+0000","last_deep_scrub":"267'303","last_deep_scrub_stamp":"2024-09-14T13:02:35.435035+0000","last_clean_scrub_stamp":"2024-09-14T13:02:35.435035+0000","objects_scrubbed":8,"log_size":103,"log_dups_size":200,"ondisk_log_size":103,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:25:02.104137+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5925,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":413,"num_read_kb":450,"num_write":250,"num_write_kb":21,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":529,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:25.337153+0000","last_change":"2024-09-14T13:02:25.336986+0000","last_active":"2024-09-14T13:02:25.337153+0000","last_peered":"2024-09-14T13:02:25.337153+0000","last_clean":"2024-09-14T13:02:25.337153+0000","last_became_active":"2024-09-14T11:08:29.844374+0000","last_became_peered":"2024-09-14T11:08:29.844374+0000","last_unstale":"2024-09-14T13:02:25.337153+0000","last_undegraded":"2024-09-14T13:02:25.337153+0000","last_fullsized":"2024-09-14T13:02:25.337153+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T13:02:25.336798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T13:02:25.336798+0000","last_clean_scrub_stamp":"2024-09-14T13:02:25.336798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:12:09.425134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.3","version":"267'107","reported_seq":639,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:35.165098+0000","last_change":"2024-09-14T13:02:35.164813+0000","last_active":"2024-09-14T13:02:35.165098+0000","last_peered":"2024-09-14T13:02:35.165098+0000","last_clean":"2024-09-14T13:02:35.165098+0000","last_became_active":"2024-09-14T11:08:31.835753+0000","last_became_peered":"2024-09-14T11:08:31.835753+0000","last_unstale":"2024-09-14T13:02:35.165098+0000","last_undegraded":"2024-09-14T13:02:35.165098+0000","last_fullsized":"2024-09-14T13:02:35.165098+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'107","last_scrub_stamp":"2024-09-14T13:02:35.164528+0000","last_deep_scrub":"267'107","last_deep_scrub_stamp":"2024-09-14T13:02:35.164528+0000","last_clean_scrub_stamp":"2024-09-14T13:02:35.164528+0000","objects_scrubbed":2,"log_size":107,"log_dups_size":0,"ondisk_log_size":107,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:19:26.483679+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":24,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":102,"num_read_kb":102,"num_write":245,"num_write_kb":60,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"267'868","reported_seq":2555,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:16.363354+0000","last_change":"2024-09-14T13:02:16.363215+0000","last_active":"2024-09-14T13:02:16.363354+0000","last_peered":"2024-09-14T13:02:16.363354+0000","last_clean":"2024-09-14T13:02:16.363354+0000","last_became_active":"2024-09-14T11:08:23.806515+0000","last_became_peered":"2024-09-14T11:08:23.806515+0000","last_unstale":"2024-09-14T13:02:16.363354+0000","last_undegraded":"2024-09-14T13:02:16.363354+0000","last_fullsized":"2024-09-14T13:02:16.363354+0000","mapping_epoch":26,"log_start":"267'800","ondisk_log_start":"267'800","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'868","last_scrub_stamp":"2024-09-14T13:02:16.363033+0000","last_deep_scrub":"267'868","last_deep_scrub_stamp":"2024-09-14T13:02:16.363033+0000","last_clean_scrub_stamp":"2024-09-14T13:02:16.363033+0000","objects_scrubbed":3,"log_size":68,"log_dups_size":800,"ondisk_log_size":68,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:24:22.719515+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":4146,"num_read_kb":3734,"num_write":1154,"num_write_kb":420,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"267'74","reported_seq":665,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:18.632013+0000","last_change":"2024-09-14T13:02:18.631868+0000","last_active":"2024-09-14T13:02:18.632013+0000","last_peered":"2024-09-14T13:02:18.632013+0000","last_clean":"2024-09-14T13:02:18.632013+0000","last_became_active":"2024-09-14T11:08:03.877126+0000","last_became_peered":"2024-09-14T11:08:03.877126+0000","last_unstale":"2024-09-14T13:02:18.632013+0000","last_undegraded":"2024-09-14T13:02:18.632013+0000","last_fullsized":"2024-09-14T13:02:18.632013+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'74","last_scrub_stamp":"2024-09-14T13:02:18.631647+0000","last_deep_scrub":"267'74","last_deep_scrub_stamp":"2024-09-14T13:02:18.631647+0000","last_clean_scrub_stamp":"2024-09-14T13:02:18.631647+0000","objects_scrubbed":2,"log_size":74,"log_dups_size":0,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:28:42.174349+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"267'2","reported_seq":571,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:14.376993+0000","last_change":"2024-09-14T13:02:14.376805+0000","last_active":"2024-09-14T13:02:14.376993+0000","last_peered":"2024-09-14T13:02:14.376993+0000","last_clean":"2024-09-14T13:02:14.376993+0000","last_became_active":"2024-09-14T11:08:08.902043+0000","last_became_peered":"2024-09-14T11:08:08.902043+0000","last_unstale":"2024-09-14T13:02:14.376993+0000","last_undegraded":"2024-09-14T13:02:14.376993+0000","last_fullsized":"2024-09-14T13:02:14.376993+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'2","last_scrub_stamp":"2024-09-14T13:02:14.376621+0000","last_deep_scrub":"267'2","last_deep_scrub_stamp":"2024-09-14T13:02:14.376621+0000","last_clean_scrub_stamp":"2024-09-14T13:02:14.376621+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:25:42.583105+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0.0011624509999999999,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"267'380","reported_seq":1110,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:05.971420+0000","last_change":"2024-09-14T13:02:05.971317+0000","last_active":"2024-09-14T13:02:05.971420+0000","last_peered":"2024-09-14T13:02:05.971420+0000","last_clean":"2024-09-14T13:02:05.971420+0000","last_became_active":"2024-09-14T11:08:21.809523+0000","last_became_peered":"2024-09-14T11:08:21.809523+0000","last_unstale":"2024-09-14T13:02:05.971420+0000","last_undegraded":"2024-09-14T13:02:05.971420+0000","last_fullsized":"2024-09-14T13:02:05.971420+0000","mapping_epoch":24,"log_start":"267'300","ondisk_log_start":"267'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'380","last_scrub_stamp":"2024-09-14T13:02:05.971194+0000","last_deep_scrub":"267'380","last_deep_scrub_stamp":"2024-09-14T13:02:05.971194+0000","last_clean_scrub_stamp":"2024-09-14T13:02:05.971194+0000","objects_scrubbed":3,"log_size":80,"log_dups_size":300,"ondisk_log_size":80,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:17:00.193745+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1030,"num_read_kb":10703,"num_write":1404,"num_write_kb":52429,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,6],"acting":[3,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":543,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:23.664133+0000","last_change":"2024-09-14T13:02:23.663891+0000","last_active":"2024-09-14T13:02:23.664133+0000","last_peered":"2024-09-14T13:02:23.664133+0000","last_clean":"2024-09-14T13:02:23.664133+0000","last_became_active":"2024-09-14T11:08:25.807851+0000","last_became_peered":"2024-09-14T11:08:25.807851+0000","last_unstale":"2024-09-14T13:02:23.664133+0000","last_undegraded":"2024-09-14T13:02:23.664133+0000","last_fullsized":"2024-09-14T13:02:23.664133+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T13:02:23.663676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T13:02:23.663676+0000","last_clean_scrub_stamp":"2024-09-14T13:02:23.663676+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:28:55.570418+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.7","version":"267'355","reported_seq":1114,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:32.410725+0000","last_change":"2024-09-14T13:02:32.410565+0000","last_active":"2024-09-14T13:02:32.410725+0000","last_peered":"2024-09-14T13:02:32.410725+0000","last_clean":"2024-09-14T13:02:32.410725+0000","last_became_active":"2024-09-14T11:08:27.829359+0000","last_became_peered":"2024-09-14T11:08:27.829359+0000","last_unstale":"2024-09-14T13:02:32.410725+0000","last_undegraded":"2024-09-14T13:02:32.410725+0000","last_fullsized":"2024-09-14T13:02:32.410725+0000","mapping_epoch":30,"log_start":"267'300","ondisk_log_start":"267'300","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'355","last_scrub_stamp":"2024-09-14T13:02:32.410352+0000","last_deep_scrub":"267'355","last_deep_scrub_stamp":"2024-09-14T13:02:32.410352+0000","last_clean_scrub_stamp":"2024-09-14T13:02:32.410352+0000","objects_scrubbed":7,"log_size":55,"log_dups_size":300,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:16:03.160630+0000","scrub_duration":19,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":21129,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":651,"num_read_kb":879,"num_write":592,"num_write_kb":412,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":89502,"num_omap_keys":214,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":537,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:33.165854+0000","last_change":"2024-09-14T13:02:33.165625+0000","last_active":"2024-09-14T13:02:33.165854+0000","last_peered":"2024-09-14T13:02:33.165854+0000","last_clean":"2024-09-14T13:02:33.165854+0000","last_became_active":"2024-09-14T11:08:29.826367+0000","last_became_peered":"2024-09-14T11:08:29.826367+0000","last_unstale":"2024-09-14T13:02:33.165854+0000","last_undegraded":"2024-09-14T13:02:33.165854+0000","last_fullsized":"2024-09-14T13:02:33.165854+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T13:02:33.165410+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T13:02:33.165410+0000","last_clean_scrub_stamp":"2024-09-14T13:02:33.165410+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:05:13.270417+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.9","version":"267'214","reported_seq":979,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:32.320925+0000","last_change":"2024-09-14T13:02:32.320694+0000","last_active":"2024-09-14T13:02:32.320925+0000","last_peered":"2024-09-14T13:02:32.320925+0000","last_clean":"2024-09-14T13:02:32.320925+0000","last_became_active":"2024-09-14T11:08:31.848763+0000","last_became_peered":"2024-09-14T11:08:31.848763+0000","last_unstale":"2024-09-14T13:02:32.320925+0000","last_undegraded":"2024-09-14T13:02:32.320925+0000","last_fullsized":"2024-09-14T13:02:32.320925+0000","mapping_epoch":34,"log_start":"267'200","ondisk_log_start":"267'200","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'214","last_scrub_stamp":"2024-09-14T13:02:32.320468+0000","last_deep_scrub":"267'214","last_deep_scrub_stamp":"2024-09-14T13:02:32.320468+0000","last_clean_scrub_stamp":"2024-09-14T13:02:32.320468+0000","objects_scrubbed":2,"log_size":14,"log_dups_size":200,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:25:03.300420+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":408,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":546,"num_read_kb":516,"num_write":465,"num_write_kb":130,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":66,"num_omap_keys":1,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.6","version":"267'599","reported_seq":2286,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:14.132188+0000","last_change":"2024-09-14T13:02:14.132048+0000","last_active":"2024-09-14T13:02:14.132188+0000","last_peered":"2024-09-14T13:02:14.132188+0000","last_clean":"2024-09-14T13:02:14.132188+0000","last_became_active":"2024-09-14T11:08:23.776564+0000","last_became_peered":"2024-09-14T11:08:23.776564+0000","last_unstale":"2024-09-14T13:02:14.132188+0000","last_undegraded":"2024-09-14T13:02:14.132188+0000","last_fullsized":"2024-09-14T13:02:14.132188+0000","mapping_epoch":26,"log_start":"267'500","ondisk_log_start":"267'500","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'599","last_scrub_stamp":"2024-09-14T13:02:14.131858+0000","last_deep_scrub":"267'599","last_deep_scrub_stamp":"2024-09-14T13:02:14.131858+0000","last_clean_scrub_stamp":"2024-09-14T13:02:14.131858+0000","objects_scrubbed":4,"log_size":99,"log_dups_size":500,"ondisk_log_size":99,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:23:37.462516+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":3171,"num_read_kb":2898,"num_write":783,"num_write_kb":298,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":572,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:08.688828+0000","last_change":"2024-09-14T13:02:08.688687+0000","last_active":"2024-09-14T13:02:08.688828+0000","last_peered":"2024-09-14T13:02:08.688828+0000","last_clean":"2024-09-14T13:02:08.688828+0000","last_became_active":"2024-09-14T11:08:08.903386+0000","last_became_peered":"2024-09-14T11:08:08.903386+0000","last_unstale":"2024-09-14T13:02:08.688828+0000","last_undegraded":"2024-09-14T13:02:08.688828+0000","last_fullsized":"2024-09-14T13:02:08.688828+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T13:02:08.688502+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T13:02:08.688502+0000","last_clean_scrub_stamp":"2024-09-14T13:02:08.688502+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:32:18.880899+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0.001192558,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"267'181","reported_seq":880,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:06.030831+0000","last_change":"2024-09-14T13:02:06.030771+0000","last_active":"2024-09-14T13:02:06.030831+0000","last_peered":"2024-09-14T13:02:06.030831+0000","last_clean":"2024-09-14T13:02:06.030831+0000","last_became_active":"2024-09-14T11:08:21.815453+0000","last_became_peered":"2024-09-14T11:08:21.815453+0000","last_unstale":"2024-09-14T13:02:06.030831+0000","last_undegraded":"2024-09-14T13:02:06.030831+0000","last_fullsized":"2024-09-14T13:02:06.030831+0000","mapping_epoch":24,"log_start":"267'100","ondisk_log_start":"267'100","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'181","last_scrub_stamp":"2024-09-14T13:02:06.030660+0000","last_deep_scrub":"267'181","last_deep_scrub_stamp":"2024-09-14T13:02:06.030660+0000","last_clean_scrub_stamp":"2024-09-14T13:02:06.030660+0000","objects_scrubbed":1,"log_size":81,"log_dups_size":100,"ondisk_log_size":81,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:55:29.313268+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":658,"num_read_kb":79122,"num_write":846,"num_write_kb":40267,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,3],"acting":[0,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":540,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:27.535000+0000","last_change":"2024-09-14T13:02:27.534865+0000","last_active":"2024-09-14T13:02:27.535000+0000","last_peered":"2024-09-14T13:02:27.535000+0000","last_clean":"2024-09-14T13:02:27.535000+0000","last_became_active":"2024-09-14T11:08:25.801580+0000","last_became_peered":"2024-09-14T11:08:25.801580+0000","last_unstale":"2024-09-14T13:02:27.535000+0000","last_undegraded":"2024-09-14T13:02:27.535000+0000","last_fullsized":"2024-09-14T13:02:27.535000+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T13:02:27.534688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T13:02:27.534688+0000","last_clean_scrub_stamp":"2024-09-14T13:02:27.534688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:09:54.498168+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.4","version":"267'1028","reported_seq":3392,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:23.001654+0000","last_change":"2024-09-14T13:02:23.001482+0000","last_active":"2024-09-14T13:02:23.001654+0000","last_peered":"2024-09-14T13:02:23.001654+0000","last_clean":"2024-09-14T13:02:23.001654+0000","last_became_active":"2024-09-14T11:08:27.824703+0000","last_became_peered":"2024-09-14T11:08:27.824703+0000","last_unstale":"2024-09-14T13:02:23.001654+0000","last_undegraded":"2024-09-14T13:02:23.001654+0000","last_fullsized":"2024-09-14T13:02:23.001654+0000","mapping_epoch":30,"log_start":"267'1001","ondisk_log_start":"267'1001","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'1028","last_scrub_stamp":"2024-09-14T13:02:23.001258+0000","last_deep_scrub":"267'1028","last_deep_scrub_stamp":"2024-09-14T13:02:23.001258+0000","last_clean_scrub_stamp":"2024-09-14T13:02:23.001258+0000","objects_scrubbed":12,"log_size":27,"log_dups_size":1001,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:43:35.067903+0000","scrub_duration":19,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":21392,"num_objects":12,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":0,"num_read":1365,"num_read_kb":1481,"num_write":500,"num_write_kb":254,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":6238,"num_omap_keys":18,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":534,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:35.596654+0000","last_change":"2024-09-14T13:02:35.596654+0000","last_active":"2024-09-14T13:02:35.596654+0000","last_peered":"2024-09-14T13:02:35.596654+0000","last_clean":"2024-09-14T13:02:35.596654+0000","last_became_active":"2024-09-14T11:08:29.836253+0000","last_became_peered":"2024-09-14T11:08:29.836253+0000","last_unstale":"2024-09-14T13:02:35.596654+0000","last_undegraded":"2024-09-14T13:02:35.596654+0000","last_fullsized":"2024-09-14T13:02:35.596654+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T13:02:35.596481+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T13:02:35.596481+0000","last_clean_scrub_stamp":"2024-09-14T13:02:35.596481+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:59:40.876249+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.a","version":"267'227","reported_seq":794,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:38.235308+0000","last_change":"2024-09-14T13:02:38.235308+0000","last_active":"2024-09-14T13:02:38.235308+0000","last_peered":"2024-09-14T13:02:38.235308+0000","last_clean":"2024-09-14T13:02:38.235308+0000","last_became_active":"2024-09-14T11:08:31.835700+0000","last_became_peered":"2024-09-14T11:08:31.835700+0000","last_unstale":"2024-09-14T13:02:38.235308+0000","last_undegraded":"2024-09-14T13:02:38.235308+0000","last_fullsized":"2024-09-14T13:02:38.235308+0000","mapping_epoch":34,"log_start":"267'200","ondisk_log_start":"267'200","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'227","last_scrub_stamp":"2024-09-14T13:02:38.235116+0000","last_deep_scrub":"267'227","last_deep_scrub_stamp":"2024-09-14T13:02:38.235116+0000","last_clean_scrub_stamp":"2024-09-14T13:02:38.235116+0000","objects_scrubbed":3,"log_size":27,"log_dups_size":200,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:17:45.413646+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":435,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":369,"num_read_kb":358,"num_write":505,"num_write_kb":147,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"267'416","reported_seq":2043,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:12.147021+0000","last_change":"2024-09-14T13:02:12.146837+0000","last_active":"2024-09-14T13:02:12.147021+0000","last_peered":"2024-09-14T13:02:12.147021+0000","last_clean":"2024-09-14T13:02:12.147021+0000","last_became_active":"2024-09-14T11:09:57.243168+0000","last_became_peered":"2024-09-14T11:09:57.243168+0000","last_unstale":"2024-09-14T13:02:12.147021+0000","last_undegraded":"2024-09-14T13:02:12.147021+0000","last_fullsized":"2024-09-14T13:02:12.147021+0000","mapping_epoch":39,"log_start":"267'400","ondisk_log_start":"267'400","created":26,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'416","last_scrub_stamp":"2024-09-14T13:02:12.146640+0000","last_deep_scrub":"267'416","last_deep_scrub_stamp":"2024-09-14T13:02:12.146640+0000","last_clean_scrub_stamp":"2024-09-14T13:02:12.146640+0000","objects_scrubbed":3,"log_size":16,"log_dups_size":400,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:25:54.329360+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2397,"num_read_kb":2278,"num_write":464,"num_write_kb":90,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":883,"num_omap_keys":4,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":573,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:08.071389+0000","last_change":"2024-09-14T13:02:08.071321+0000","last_active":"2024-09-14T13:02:08.071389+0000","last_peered":"2024-09-14T13:02:08.071389+0000","last_clean":"2024-09-14T13:02:08.071389+0000","last_became_active":"2024-09-14T11:08:08.957848+0000","last_became_peered":"2024-09-14T11:08:08.957848+0000","last_unstale":"2024-09-14T13:02:08.071389+0000","last_undegraded":"2024-09-14T13:02:08.071389+0000","last_fullsized":"2024-09-14T13:02:08.071389+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T13:02:08.071230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T13:02:08.071230+0000","last_clean_scrub_stamp":"2024-09-14T13:02:08.071230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:34:22.543760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001143142,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"267'236","reported_seq":928,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:07.066298+0000","last_change":"2024-09-14T13:02:07.066246+0000","last_active":"2024-09-14T13:02:07.066298+0000","last_peered":"2024-09-14T13:02:07.066298+0000","last_clean":"2024-09-14T13:02:07.066298+0000","last_became_active":"2024-09-14T11:08:21.817523+0000","last_became_peered":"2024-09-14T11:08:21.817523+0000","last_unstale":"2024-09-14T13:02:07.066298+0000","last_undegraded":"2024-09-14T13:02:07.066298+0000","last_fullsized":"2024-09-14T13:02:07.066298+0000","mapping_epoch":24,"log_start":"267'200","ondisk_log_start":"267'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'236","last_scrub_stamp":"2024-09-14T13:02:07.066157+0000","last_deep_scrub":"267'236","last_deep_scrub_stamp":"2024-09-14T13:02:07.066157+0000","last_clean_scrub_stamp":"2024-09-14T13:02:07.066157+0000","objects_scrubbed":3,"log_size":36,"log_dups_size":200,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:24:04.875361+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":52,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":630,"num_read_kb":70142,"num_write":1046,"num_write_kb":36042,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,6],"acting":[1,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.6","version":"267'2","reported_seq":546,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:19.144725+0000","last_change":"2024-09-14T13:02:19.144585+0000","last_active":"2024-09-14T13:02:19.144725+0000","last_peered":"2024-09-14T13:02:19.144725+0000","last_clean":"2024-09-14T13:02:19.144725+0000","last_became_active":"2024-09-14T11:08:25.807070+0000","last_became_peered":"2024-09-14T11:08:25.807070+0000","last_unstale":"2024-09-14T13:02:19.144725+0000","last_undegraded":"2024-09-14T13:02:19.144725+0000","last_fullsized":"2024-09-14T13:02:19.144725+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'2","last_scrub_stamp":"2024-09-14T13:02:19.144401+0000","last_deep_scrub":"267'2","last_deep_scrub_stamp":"2024-09-14T13:02:19.144401+0000","last_clean_scrub_stamp":"2024-09-14T13:02:19.144401+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T00:26:33.317334+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.5","version":"267'411","reported_seq":2381,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:30.546803+0000","last_change":"2024-09-14T13:02:30.546803+0000","last_active":"2024-09-14T13:02:30.546803+0000","last_peered":"2024-09-14T13:02:30.546803+0000","last_clean":"2024-09-14T13:02:30.546803+0000","last_became_active":"2024-09-14T11:08:27.830644+0000","last_became_peered":"2024-09-14T11:08:27.830644+0000","last_unstale":"2024-09-14T13:02:30.546803+0000","last_undegraded":"2024-09-14T13:02:30.546803+0000","last_fullsized":"2024-09-14T13:02:30.546803+0000","mapping_epoch":30,"log_start":"267'400","ondisk_log_start":"267'400","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'411","last_scrub_stamp":"2024-09-14T13:02:30.546604+0000","last_deep_scrub":"267'411","last_deep_scrub_stamp":"2024-09-14T13:02:30.546604+0000","last_clean_scrub_stamp":"2024-09-14T13:02:30.546604+0000","objects_scrubbed":9,"log_size":11,"log_dups_size":400,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:45:11.963366+0000","scrub_duration":19,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":154,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":380,"num_read_kb":368,"num_write":375,"num_write_kb":193,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5824,"num_omap_keys":14,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":539,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:31.076513+0000","last_change":"2024-09-14T13:02:31.076368+0000","last_active":"2024-09-14T13:02:31.076513+0000","last_peered":"2024-09-14T13:02:31.076513+0000","last_clean":"2024-09-14T13:02:31.076513+0000","last_became_active":"2024-09-14T11:08:29.801661+0000","last_became_peered":"2024-09-14T11:08:29.801661+0000","last_unstale":"2024-09-14T13:02:31.076513+0000","last_undegraded":"2024-09-14T13:02:31.076513+0000","last_fullsized":"2024-09-14T13:02:31.076513+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T13:02:31.076190+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T13:02:31.076190+0000","last_clean_scrub_stamp":"2024-09-14T13:02:31.076190+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:11:46.287087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.b","version":"267'251","reported_seq":888,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:39.956158+0000","last_change":"2024-09-14T13:02:39.956026+0000","last_active":"2024-09-14T13:02:39.956158+0000","last_peered":"2024-09-14T13:02:39.956158+0000","last_clean":"2024-09-14T13:02:39.956158+0000","last_became_active":"2024-09-14T11:08:31.841552+0000","last_became_peered":"2024-09-14T11:08:31.841552+0000","last_unstale":"2024-09-14T13:02:39.956158+0000","last_undegraded":"2024-09-14T13:02:39.956158+0000","last_fullsized":"2024-09-14T13:02:39.956158+0000","mapping_epoch":34,"log_start":"267'200","ondisk_log_start":"267'200","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'251","last_scrub_stamp":"2024-09-14T13:02:39.955851+0000","last_deep_scrub":"267'251","last_deep_scrub_stamp":"2024-09-14T13:02:39.955851+0000","last_clean_scrub_stamp":"2024-09-14T13:02:39.955851+0000","objects_scrubbed":3,"log_size":51,"log_dups_size":200,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:52:44.174304+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":202,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":474,"num_read_kb":499,"num_write":548,"num_write_kb":158,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1193,"num_omap_keys":7,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"267'1115","reported_seq":2649,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:11.020725+0000","last_change":"2024-09-14T13:02:11.020600+0000","last_active":"2024-09-14T13:02:11.020725+0000","last_peered":"2024-09-14T13:02:11.020725+0000","last_clean":"2024-09-14T13:02:11.020725+0000","last_became_active":"2024-09-14T11:08:23.777511+0000","last_became_peered":"2024-09-14T11:08:23.777511+0000","last_unstale":"2024-09-14T13:02:11.020725+0000","last_undegraded":"2024-09-14T13:02:11.020725+0000","last_fullsized":"2024-09-14T13:02:11.020725+0000","mapping_epoch":26,"log_start":"267'1100","ondisk_log_start":"267'1100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'1115","last_scrub_stamp":"2024-09-14T13:02:11.020381+0000","last_deep_scrub":"267'1115","last_deep_scrub_stamp":"2024-09-14T13:02:11.020381+0000","last_clean_scrub_stamp":"2024-09-14T13:02:11.020381+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":1100,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:18:14.256119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5086,"num_read_kb":4484,"num_write":1533,"num_write_kb":642,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"267'3","reported_seq":572,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:07.256751+0000","last_change":"2024-09-14T13:02:07.256502+0000","last_active":"2024-09-14T13:02:07.256751+0000","last_peered":"2024-09-14T13:02:07.256751+0000","last_clean":"2024-09-14T13:02:07.256751+0000","last_became_active":"2024-09-14T11:08:08.903062+0000","last_became_peered":"2024-09-14T11:08:08.903062+0000","last_unstale":"2024-09-14T13:02:07.256751+0000","last_undegraded":"2024-09-14T13:02:07.256751+0000","last_fullsized":"2024-09-14T13:02:07.256751+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'3","last_scrub_stamp":"2024-09-14T13:02:07.256289+0000","last_deep_scrub":"267'3","last_deep_scrub_stamp":"2024-09-14T13:02:07.256289+0000","last_clean_scrub_stamp":"2024-09-14T13:02:07.256289+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:37:50.637115+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0.0022728420000000002,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"267'181","reported_seq":877,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:06.907138+0000","last_change":"2024-09-14T13:02:06.906936+0000","last_active":"2024-09-14T13:02:06.907138+0000","last_peered":"2024-09-14T13:02:06.907138+0000","last_clean":"2024-09-14T13:02:06.907138+0000","last_became_active":"2024-09-14T11:08:21.823121+0000","last_became_peered":"2024-09-14T11:08:21.823121+0000","last_unstale":"2024-09-14T13:02:06.907138+0000","last_undegraded":"2024-09-14T13:02:06.907138+0000","last_fullsized":"2024-09-14T13:02:06.907138+0000","mapping_epoch":24,"log_start":"267'100","ondisk_log_start":"267'100","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'181","last_scrub_stamp":"2024-09-14T13:02:06.906725+0000","last_deep_scrub":"267'181","last_deep_scrub_stamp":"2024-09-14T13:02:06.906725+0000","last_clean_scrub_stamp":"2024-09-14T13:02:06.906725+0000","objects_scrubbed":2,"log_size":81,"log_dups_size":100,"ondisk_log_size":81,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:55:40.720442+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":28,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":557,"num_read_kb":32204,"num_write":881,"num_write_kb":26671,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,0],"acting":[4,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":547,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:18.094770+0000","last_change":"2024-09-14T13:02:18.094637+0000","last_active":"2024-09-14T13:02:18.094770+0000","last_peered":"2024-09-14T13:02:18.094770+0000","last_clean":"2024-09-14T13:02:18.094770+0000","last_became_active":"2024-09-14T11:08:25.796526+0000","last_became_peered":"2024-09-14T11:08:25.796526+0000","last_unstale":"2024-09-14T13:02:18.094770+0000","last_undegraded":"2024-09-14T13:02:18.094770+0000","last_fullsized":"2024-09-14T13:02:18.094770+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T13:02:18.094441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T13:02:18.094441+0000","last_clean_scrub_stamp":"2024-09-14T13:02:18.094441+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T00:51:13.768814+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.6","version":"267'241","reported_seq":865,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:24.003725+0000","last_change":"2024-09-14T13:02:24.003583+0000","last_active":"2024-09-14T13:02:24.003725+0000","last_peered":"2024-09-14T13:02:24.003725+0000","last_clean":"2024-09-14T13:02:24.003725+0000","last_became_active":"2024-09-14T11:08:27.818482+0000","last_became_peered":"2024-09-14T11:08:27.818482+0000","last_unstale":"2024-09-14T13:02:24.003725+0000","last_undegraded":"2024-09-14T13:02:24.003725+0000","last_fullsized":"2024-09-14T13:02:24.003725+0000","mapping_epoch":30,"log_start":"267'200","ondisk_log_start":"267'200","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'241","last_scrub_stamp":"2024-09-14T13:02:24.003387+0000","last_deep_scrub":"267'241","last_deep_scrub_stamp":"2024-09-14T13:02:24.003387+0000","last_clean_scrub_stamp":"2024-09-14T13:02:24.003387+0000","objects_scrubbed":7,"log_size":41,"log_dups_size":200,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:56:28.318209+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":286,"num_read_kb":275,"num_write":214,"num_write_kb":24,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":3226,"num_omap_keys":10,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":531,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:24.379098+0000","last_change":"2024-09-14T13:02:24.378960+0000","last_active":"2024-09-14T13:02:24.379098+0000","last_peered":"2024-09-14T13:02:24.379098+0000","last_clean":"2024-09-14T13:02:24.379098+0000","last_became_active":"2024-09-14T11:08:29.837840+0000","last_became_peered":"2024-09-14T11:08:29.837840+0000","last_unstale":"2024-09-14T13:02:24.379098+0000","last_undegraded":"2024-09-14T13:02:24.379098+0000","last_fullsized":"2024-09-14T13:02:24.379098+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T13:02:24.378768+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T13:02:24.378768+0000","last_clean_scrub_stamp":"2024-09-14T13:02:24.378768+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:57:41.664294+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.8","version":"267'111","reported_seq":696,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:40.468843+0000","last_change":"2024-09-14T13:02:40.468627+0000","last_active":"2024-09-14T13:02:40.468843+0000","last_peered":"2024-09-14T13:02:40.468843+0000","last_clean":"2024-09-14T13:02:40.468843+0000","last_became_active":"2024-09-14T11:08:31.851269+0000","last_became_peered":"2024-09-14T11:08:31.851269+0000","last_unstale":"2024-09-14T13:02:40.468843+0000","last_undegraded":"2024-09-14T13:02:40.468843+0000","last_fullsized":"2024-09-14T13:02:40.468843+0000","mapping_epoch":34,"log_start":"267'100","ondisk_log_start":"267'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'111","last_scrub_stamp":"2024-09-14T13:02:40.468437+0000","last_deep_scrub":"267'111","last_deep_scrub_stamp":"2024-09-14T13:02:40.468437+0000","last_clean_scrub_stamp":"2024-09-14T13:02:40.468437+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":100,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:28:52.613811+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":188,"num_read_kb":187,"num_write":249,"num_write_kb":58,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"267'520","reported_seq":2240,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:12.995600+0000","last_change":"2024-09-14T13:02:12.995460+0000","last_active":"2024-09-14T13:02:12.995600+0000","last_peered":"2024-09-14T13:02:12.995600+0000","last_clean":"2024-09-14T13:02:12.995600+0000","last_became_active":"2024-09-14T11:08:23.793860+0000","last_became_peered":"2024-09-14T11:08:23.793860+0000","last_unstale":"2024-09-14T13:02:12.995600+0000","last_undegraded":"2024-09-14T13:02:12.995600+0000","last_fullsized":"2024-09-14T13:02:12.995600+0000","mapping_epoch":26,"log_start":"267'500","ondisk_log_start":"267'500","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'520","last_scrub_stamp":"2024-09-14T13:02:12.995266+0000","last_deep_scrub":"267'520","last_deep_scrub_stamp":"2024-09-14T13:02:12.995266+0000","last_clean_scrub_stamp":"2024-09-14T13:02:12.995266+0000","objects_scrubbed":3,"log_size":20,"log_dups_size":500,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:38:13.362386+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3013,"num_read_kb":2819,"num_write":641,"num_write_kb":178,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2808,"num_omap_keys":11,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"267'200","reported_seq":888,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:09.308468+0000","last_change":"2024-09-14T13:02:09.308300+0000","last_active":"2024-09-14T13:02:09.308468+0000","last_peered":"2024-09-14T13:02:09.308468+0000","last_clean":"2024-09-14T13:02:09.308468+0000","last_became_active":"2024-09-14T11:08:21.791679+0000","last_became_peered":"2024-09-14T11:08:21.791679+0000","last_unstale":"2024-09-14T13:02:09.308468+0000","last_undegraded":"2024-09-14T13:02:09.308468+0000","last_fullsized":"2024-09-14T13:02:09.308468+0000","mapping_epoch":24,"log_start":"267'100","ondisk_log_start":"267'100","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'200","last_scrub_stamp":"2024-09-14T13:02:09.308096+0000","last_deep_scrub":"267'200","last_deep_scrub_stamp":"2024-09-14T13:02:09.308096+0000","last_clean_scrub_stamp":"2024-09-14T13:02:09.308096+0000","objects_scrubbed":2,"log_size":100,"log_dups_size":100,"ondisk_log_size":100,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:28:27.126433+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":15,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":647,"num_read_kb":55282,"num_write":902,"num_write_kb":39262,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,2],"acting":[5,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":567,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:06.063398+0000","last_change":"2024-09-14T13:02:06.063313+0000","last_active":"2024-09-14T13:02:06.063398+0000","last_peered":"2024-09-14T13:02:06.063398+0000","last_clean":"2024-09-14T13:02:06.063398+0000","last_became_active":"2024-09-14T11:08:08.888921+0000","last_became_peered":"2024-09-14T11:08:08.888921+0000","last_unstale":"2024-09-14T13:02:06.063398+0000","last_undegraded":"2024-09-14T13:02:06.063398+0000","last_fullsized":"2024-09-14T13:02:06.063398+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T13:02:06.063225+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T13:02:06.063225+0000","last_clean_scrub_stamp":"2024-09-14T13:02:06.063225+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:03:25.698483+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001198714,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":547,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:24.001002+0000","last_change":"2024-09-14T13:02:24.000791+0000","last_active":"2024-09-14T13:02:24.001002+0000","last_peered":"2024-09-14T13:02:24.001002+0000","last_clean":"2024-09-14T13:02:24.001002+0000","last_became_active":"2024-09-14T11:08:25.792863+0000","last_became_peered":"2024-09-14T11:08:25.792863+0000","last_unstale":"2024-09-14T13:02:24.001002+0000","last_undegraded":"2024-09-14T13:02:24.001002+0000","last_fullsized":"2024-09-14T13:02:24.001002+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T13:02:24.000552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T13:02:24.000552+0000","last_clean_scrub_stamp":"2024-09-14T13:02:24.000552+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:23:29.987674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"267'470","reported_seq":1226,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:16.091820+0000","last_change":"2024-09-14T13:02:16.091681+0000","last_active":"2024-09-14T13:02:16.091820+0000","last_peered":"2024-09-14T13:02:16.091820+0000","last_clean":"2024-09-14T13:02:16.091820+0000","last_became_active":"2024-09-14T11:08:27.803324+0000","last_became_peered":"2024-09-14T11:08:27.803324+0000","last_unstale":"2024-09-14T13:02:16.091820+0000","last_undegraded":"2024-09-14T13:02:16.091820+0000","last_fullsized":"2024-09-14T13:02:16.091820+0000","mapping_epoch":30,"log_start":"267'400","ondisk_log_start":"267'400","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'470","last_scrub_stamp":"2024-09-14T13:02:16.091442+0000","last_deep_scrub":"267'470","last_deep_scrub_stamp":"2024-09-14T13:02:16.091442+0000","last_clean_scrub_stamp":"2024-09-14T13:02:16.091442+0000","objects_scrubbed":10,"log_size":70,"log_dups_size":400,"ondisk_log_size":70,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T00:12:22.033953+0000","scrub_duration":31,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19948,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":1305,"num_read_kb":1473,"num_write":1890,"num_write_kb":1660,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":530760,"num_omap_keys":1200,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":536,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:34.718536+0000","last_change":"2024-09-14T13:02:34.718365+0000","last_active":"2024-09-14T13:02:34.718536+0000","last_peered":"2024-09-14T13:02:34.718536+0000","last_clean":"2024-09-14T13:02:34.718536+0000","last_became_active":"2024-09-14T11:08:29.830303+0000","last_became_peered":"2024-09-14T11:08:29.830303+0000","last_unstale":"2024-09-14T13:02:34.718536+0000","last_undegraded":"2024-09-14T13:02:34.718536+0000","last_fullsized":"2024-09-14T13:02:34.718536+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T13:02:34.718186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T13:02:34.718186+0000","last_clean_scrub_stamp":"2024-09-14T13:02:34.718186+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:31:11.098882+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.e","version":"267'157","reported_seq":730,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:41.232608+0000","last_change":"2024-09-14T13:02:41.232470+0000","last_active":"2024-09-14T13:02:41.232608+0000","last_peered":"2024-09-14T13:02:41.232608+0000","last_clean":"2024-09-14T13:02:41.232608+0000","last_became_active":"2024-09-14T11:08:31.835335+0000","last_became_peered":"2024-09-14T11:08:31.835335+0000","last_unstale":"2024-09-14T13:02:41.232608+0000","last_undegraded":"2024-09-14T13:02:41.232608+0000","last_fullsized":"2024-09-14T13:02:41.232608+0000","mapping_epoch":34,"log_start":"267'100","ondisk_log_start":"267'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'157","last_scrub_stamp":"2024-09-14T13:02:41.232278+0000","last_deep_scrub":"267'157","last_deep_scrub_stamp":"2024-09-14T13:02:41.232278+0000","last_clean_scrub_stamp":"2024-09-14T13:02:41.232278+0000","objects_scrubbed":4,"log_size":57,"log_dups_size":100,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:37:03.058519+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":736,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":226,"num_read_kb":194,"num_write":381,"num_write_kb":93,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"267'738","reported_seq":2295,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:15.092125+0000","last_change":"2024-09-14T13:02:15.091975+0000","last_active":"2024-09-14T13:02:15.092125+0000","last_peered":"2024-09-14T13:02:15.092125+0000","last_clean":"2024-09-14T13:02:15.092125+0000","last_became_active":"2024-09-14T11:08:23.792144+0000","last_became_peered":"2024-09-14T11:08:23.792144+0000","last_unstale":"2024-09-14T13:02:15.092125+0000","last_undegraded":"2024-09-14T13:02:15.092125+0000","last_fullsized":"2024-09-14T13:02:15.092125+0000","mapping_epoch":26,"log_start":"267'700","ondisk_log_start":"267'700","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'738","last_scrub_stamp":"2024-09-14T13:02:15.091782+0000","last_deep_scrub":"267'738","last_deep_scrub_stamp":"2024-09-14T13:02:15.091782+0000","last_clean_scrub_stamp":"2024-09-14T13:02:15.091782+0000","objects_scrubbed":4,"log_size":38,"log_dups_size":700,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:17:17.576090+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":3573,"num_read_kb":3234,"num_write":954,"num_write_kb":344,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":441,"num_omap_keys":2,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.4","version":"267'263","reported_seq":990,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:09.032812+0000","last_change":"2024-09-14T13:02:09.032643+0000","last_active":"2024-09-14T13:02:09.032812+0000","last_peered":"2024-09-14T13:02:09.032812+0000","last_clean":"2024-09-14T13:02:09.032812+0000","last_became_active":"2024-09-14T11:08:21.808278+0000","last_became_peered":"2024-09-14T11:08:21.808278+0000","last_unstale":"2024-09-14T13:02:09.032812+0000","last_undegraded":"2024-09-14T13:02:09.032812+0000","last_fullsized":"2024-09-14T13:02:09.032812+0000","mapping_epoch":24,"log_start":"267'200","ondisk_log_start":"267'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'263","last_scrub_stamp":"2024-09-14T13:02:09.032409+0000","last_deep_scrub":"267'263","last_deep_scrub_stamp":"2024-09-14T13:02:09.032409+0000","last_clean_scrub_stamp":"2024-09-14T13:02:09.032409+0000","objects_scrubbed":7,"log_size":63,"log_dups_size":200,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:47:10.565844+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":105,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":853,"num_read_kb":29781,"num_write":1322,"num_write_kb":30049,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,6],"acting":[1,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":570,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:11.672197+0000","last_change":"2024-09-14T13:02:11.672021+0000","last_active":"2024-09-14T13:02:11.672197+0000","last_peered":"2024-09-14T13:02:11.672197+0000","last_clean":"2024-09-14T13:02:11.672197+0000","last_became_active":"2024-09-14T11:08:08.903905+0000","last_became_peered":"2024-09-14T11:08:08.903905+0000","last_unstale":"2024-09-14T13:02:11.672197+0000","last_undegraded":"2024-09-14T13:02:11.672197+0000","last_fullsized":"2024-09-14T13:02:11.672197+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T13:02:11.671824+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T13:02:11.671824+0000","last_clean_scrub_stamp":"2024-09-14T13:02:11.671824+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:19:51.277720+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0.001173377,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":541,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:21.282498+0000","last_change":"2024-09-14T13:02:21.282349+0000","last_active":"2024-09-14T13:02:21.282498+0000","last_peered":"2024-09-14T13:02:21.282498+0000","last_clean":"2024-09-14T13:02:21.282498+0000","last_became_active":"2024-09-14T11:08:25.800695+0000","last_became_peered":"2024-09-14T11:08:25.800695+0000","last_unstale":"2024-09-14T13:02:21.282498+0000","last_undegraded":"2024-09-14T13:02:21.282498+0000","last_fullsized":"2024-09-14T13:02:21.282498+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T13:02:21.282162+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T13:02:21.282162+0000","last_clean_scrub_stamp":"2024-09-14T13:02:21.282162+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:49:39.366357+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1","version":"267'358","reported_seq":1010,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:27.127176+0000","last_change":"2024-09-14T13:02:27.127023+0000","last_active":"2024-09-14T13:02:27.127176+0000","last_peered":"2024-09-14T13:02:27.127176+0000","last_clean":"2024-09-14T13:02:27.127176+0000","last_became_active":"2024-09-14T11:08:27.813857+0000","last_became_peered":"2024-09-14T11:08:27.813857+0000","last_unstale":"2024-09-14T13:02:27.127176+0000","last_undegraded":"2024-09-14T13:02:27.127176+0000","last_fullsized":"2024-09-14T13:02:27.127176+0000","mapping_epoch":30,"log_start":"267'300","ondisk_log_start":"267'300","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'358","last_scrub_stamp":"2024-09-14T13:02:27.126798+0000","last_deep_scrub":"267'358","last_deep_scrub_stamp":"2024-09-14T13:02:27.126798+0000","last_clean_scrub_stamp":"2024-09-14T13:02:27.126798+0000","objects_scrubbed":8,"log_size":58,"log_dups_size":300,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:15:05.419456+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":441,"num_read_kb":434,"num_write":426,"num_write_kb":202,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":6602,"num_omap_keys":16,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.0","version":"267'781","reported_seq":5208,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:37.362655+0000","last_change":"2024-09-14T13:02:37.362504+0000","last_active":"2024-09-14T13:02:37.362655+0000","last_peered":"2024-09-14T13:02:37.362655+0000","last_clean":"2024-09-14T13:02:37.362655+0000","last_became_active":"2024-09-14T11:08:29.823513+0000","last_became_peered":"2024-09-14T11:08:29.823513+0000","last_unstale":"2024-09-14T13:02:37.362655+0000","last_undegraded":"2024-09-14T13:02:37.362655+0000","last_fullsized":"2024-09-14T13:02:37.362655+0000","mapping_epoch":32,"log_start":"267'700","ondisk_log_start":"267'700","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'781","last_scrub_stamp":"2024-09-14T13:02:37.362321+0000","last_deep_scrub":"267'781","last_deep_scrub_stamp":"2024-09-14T13:02:37.362321+0000","last_clean_scrub_stamp":"2024-09-14T13:02:37.362321+0000","objects_scrubbed":1,"log_size":81,"log_dups_size":700,"ondisk_log_size":81,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T00:17:52.989734+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.f","version":"267'153","reported_seq":715,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:40.956648+0000","last_change":"2024-09-14T13:02:40.956648+0000","last_active":"2024-09-14T13:02:40.956648+0000","last_peered":"2024-09-14T13:02:40.956648+0000","last_clean":"2024-09-14T13:02:40.956648+0000","last_became_active":"2024-09-14T11:08:31.825708+0000","last_became_peered":"2024-09-14T11:08:31.825708+0000","last_unstale":"2024-09-14T13:02:40.956648+0000","last_undegraded":"2024-09-14T13:02:40.956648+0000","last_fullsized":"2024-09-14T13:02:40.956648+0000","mapping_epoch":34,"log_start":"267'100","ondisk_log_start":"267'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'153","last_scrub_stamp":"2024-09-14T13:02:40.956472+0000","last_deep_scrub":"267'153","last_deep_scrub_stamp":"2024-09-14T13:02:40.956472+0000","last_clean_scrub_stamp":"2024-09-14T13:02:40.956472+0000","objects_scrubbed":5,"log_size":53,"log_dups_size":100,"ondisk_log_size":53,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:50:35.738734+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1096,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":219,"num_read_kb":197,"num_write":351,"num_write_kb":86,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":64,"num_omap_keys":1,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"267'1023","reported_seq":2917,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:14.881687+0000","last_change":"2024-09-14T13:02:14.881529+0000","last_active":"2024-09-14T13:02:14.881687+0000","last_peered":"2024-09-14T13:02:14.881687+0000","last_clean":"2024-09-14T13:02:14.881687+0000","last_became_active":"2024-09-14T11:08:23.800388+0000","last_became_peered":"2024-09-14T11:08:23.800388+0000","last_unstale":"2024-09-14T13:02:14.881687+0000","last_undegraded":"2024-09-14T13:02:14.881687+0000","last_fullsized":"2024-09-14T13:02:14.881687+0000","mapping_epoch":26,"log_start":"267'1000","ondisk_log_start":"267'1000","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'1023","last_scrub_stamp":"2024-09-14T13:02:14.881346+0000","last_deep_scrub":"267'1023","last_deep_scrub_stamp":"2024-09-14T13:02:14.881346+0000","last_clean_scrub_stamp":"2024-09-14T13:02:14.881346+0000","objects_scrubbed":2,"log_size":23,"log_dups_size":1000,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:35:05.542600+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":5094,"num_read_kb":4556,"num_write":1418,"num_write_kb":544,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2806,"num_omap_keys":11,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.7","version":"267'189","reported_seq":840,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:06.990387+0000","last_change":"2024-09-14T13:02:06.990334+0000","last_active":"2024-09-14T13:02:06.990387+0000","last_peered":"2024-09-14T13:02:06.990387+0000","last_clean":"2024-09-14T13:02:06.990387+0000","last_became_active":"2024-09-14T11:08:21.797297+0000","last_became_peered":"2024-09-14T11:08:21.797297+0000","last_unstale":"2024-09-14T13:02:06.990387+0000","last_undegraded":"2024-09-14T13:02:06.990387+0000","last_fullsized":"2024-09-14T13:02:06.990387+0000","mapping_epoch":24,"log_start":"267'100","ondisk_log_start":"267'100","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'189","last_scrub_stamp":"2024-09-14T13:02:06.990223+0000","last_deep_scrub":"267'189","last_deep_scrub_stamp":"2024-09-14T13:02:06.990223+0000","last_clean_scrub_stamp":"2024-09-14T13:02:06.990223+0000","objects_scrubbed":5,"log_size":89,"log_dups_size":100,"ondisk_log_size":89,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:27:43.594579+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1655854,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":473,"num_read_kb":20434,"num_write":854,"num_write_kb":40195,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,7],"acting":[3,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":565,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:05.019767+0000","last_change":"2024-09-14T13:02:05.019695+0000","last_active":"2024-09-14T13:02:05.019767+0000","last_peered":"2024-09-14T13:02:05.019767+0000","last_clean":"2024-09-14T13:02:05.019767+0000","last_became_active":"2024-09-14T11:08:08.891458+0000","last_became_peered":"2024-09-14T11:08:08.891458+0000","last_unstale":"2024-09-14T13:02:05.019767+0000","last_undegraded":"2024-09-14T13:02:05.019767+0000","last_fullsized":"2024-09-14T13:02:05.019767+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T13:02:05.019605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T13:02:05.019605+0000","last_clean_scrub_stamp":"2024-09-14T13:02:05.019605+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:50:14.780273+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0011468940000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":544,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:25.681738+0000","last_change":"2024-09-14T13:02:25.681456+0000","last_active":"2024-09-14T13:02:25.681738+0000","last_peered":"2024-09-14T13:02:25.681738+0000","last_clean":"2024-09-14T13:02:25.681738+0000","last_became_active":"2024-09-14T11:08:25.807555+0000","last_became_peered":"2024-09-14T11:08:25.807555+0000","last_unstale":"2024-09-14T13:02:25.681738+0000","last_undegraded":"2024-09-14T13:02:25.681738+0000","last_fullsized":"2024-09-14T13:02:25.681738+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T13:02:25.681260+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T13:02:25.681260+0000","last_clean_scrub_stamp":"2024-09-14T13:02:25.681260+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:22:04.765928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.2","version":"267'177","reported_seq":793,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:30.668394+0000","last_change":"2024-09-14T13:02:30.668256+0000","last_active":"2024-09-14T13:02:30.668394+0000","last_peered":"2024-09-14T13:02:30.668394+0000","last_clean":"2024-09-14T13:02:30.668394+0000","last_became_active":"2024-09-14T11:08:27.825292+0000","last_became_peered":"2024-09-14T11:08:27.825292+0000","last_unstale":"2024-09-14T13:02:30.668394+0000","last_undegraded":"2024-09-14T13:02:30.668394+0000","last_fullsized":"2024-09-14T13:02:30.668394+0000","mapping_epoch":30,"log_start":"267'100","ondisk_log_start":"267'100","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'177","last_scrub_stamp":"2024-09-14T13:02:30.668074+0000","last_deep_scrub":"267'177","last_deep_scrub_stamp":"2024-09-14T13:02:30.668074+0000","last_clean_scrub_stamp":"2024-09-14T13:02:30.668074+0000","objects_scrubbed":5,"log_size":77,"log_dups_size":100,"ondisk_log_size":77,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:14:57.106472+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":226,"num_read_kb":221,"num_write":150,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.3","version":"267'816","reported_seq":5544,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:33.938085+0000","last_change":"2024-09-14T13:02:33.937947+0000","last_active":"2024-09-14T13:02:33.938085+0000","last_peered":"2024-09-14T13:02:33.938085+0000","last_clean":"2024-09-14T13:02:33.938085+0000","last_became_active":"2024-09-14T11:08:29.824268+0000","last_became_peered":"2024-09-14T11:08:29.824268+0000","last_unstale":"2024-09-14T13:02:33.938085+0000","last_undegraded":"2024-09-14T13:02:33.938085+0000","last_fullsized":"2024-09-14T13:02:33.938085+0000","mapping_epoch":32,"log_start":"267'801","ondisk_log_start":"267'801","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'816","last_scrub_stamp":"2024-09-14T13:02:33.937760+0000","last_deep_scrub":"267'816","last_deep_scrub_stamp":"2024-09-14T13:02:33.937760+0000","last_clean_scrub_stamp":"2024-09-14T13:02:33.937760+0000","objects_scrubbed":1,"log_size":15,"log_dups_size":801,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:58:03.653512+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.c","version":"267'180","reported_seq":738,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:38.228897+0000","last_change":"2024-09-14T13:02:38.228762+0000","last_active":"2024-09-14T13:02:38.228897+0000","last_peered":"2024-09-14T13:02:38.228897+0000","last_clean":"2024-09-14T13:02:38.228897+0000","last_became_active":"2024-09-14T11:08:31.844329+0000","last_became_peered":"2024-09-14T11:08:31.844329+0000","last_unstale":"2024-09-14T13:02:38.228897+0000","last_undegraded":"2024-09-14T13:02:38.228897+0000","last_fullsized":"2024-09-14T13:02:38.228897+0000","mapping_epoch":34,"log_start":"267'100","ondisk_log_start":"267'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'180","last_scrub_stamp":"2024-09-14T13:02:38.228582+0000","last_deep_scrub":"267'180","last_deep_scrub_stamp":"2024-09-14T13:02:38.228582+0000","last_clean_scrub_stamp":"2024-09-14T13:02:38.228582+0000","objects_scrubbed":3,"log_size":80,"log_dups_size":100,"ondisk_log_size":80,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:27:17.206372+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":58,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":178,"num_read_kb":162,"num_write":419,"num_write_kb":126,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"267'735","reported_seq":2216,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:09.815434+0000","last_change":"2024-09-14T13:02:09.815280+0000","last_active":"2024-09-14T13:02:09.815434+0000","last_peered":"2024-09-14T13:02:09.815434+0000","last_clean":"2024-09-14T13:02:09.815434+0000","last_became_active":"2024-09-14T11:08:23.800918+0000","last_became_peered":"2024-09-14T11:08:23.800918+0000","last_unstale":"2024-09-14T13:02:09.815434+0000","last_undegraded":"2024-09-14T13:02:09.815434+0000","last_fullsized":"2024-09-14T13:02:09.815434+0000","mapping_epoch":26,"log_start":"267'700","ondisk_log_start":"267'700","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'735","last_scrub_stamp":"2024-09-14T13:02:09.814990+0000","last_deep_scrub":"267'735","last_deep_scrub_stamp":"2024-09-14T13:02:09.814990+0000","last_clean_scrub_stamp":"2024-09-14T13:02:09.814990+0000","objects_scrubbed":3,"log_size":35,"log_dups_size":700,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:05:22.080738+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3552,"num_read_kb":3200,"num_write":979,"num_write_kb":380,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":486,"num_omap_keys":2,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"267'264","reported_seq":972,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:06.104313+0000","last_change":"2024-09-14T13:02:06.104313+0000","last_active":"2024-09-14T13:02:06.104313+0000","last_peered":"2024-09-14T13:02:06.104313+0000","last_clean":"2024-09-14T13:02:06.104313+0000","last_became_active":"2024-09-14T11:08:56.034426+0000","last_became_peered":"2024-09-14T11:08:56.034426+0000","last_unstale":"2024-09-14T13:02:06.104313+0000","last_undegraded":"2024-09-14T13:02:06.104313+0000","last_fullsized":"2024-09-14T13:02:06.104313+0000","mapping_epoch":37,"log_start":"267'200","ondisk_log_start":"267'200","created":24,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'264","last_scrub_stamp":"2024-09-14T13:02:06.104156+0000","last_deep_scrub":"267'264","last_deep_scrub_stamp":"2024-09-14T13:02:06.104156+0000","last_clean_scrub_stamp":"2024-09-14T13:02:06.104156+0000","objects_scrubbed":7,"log_size":64,"log_dups_size":200,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:07:23.324457+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3311697,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":736,"num_read_kb":100890,"num_write":1101,"num_write_kb":33821,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,4],"acting":[2,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":566,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:08.217198+0000","last_change":"2024-09-14T13:02:08.216964+0000","last_active":"2024-09-14T13:02:08.217198+0000","last_peered":"2024-09-14T13:02:08.217198+0000","last_clean":"2024-09-14T13:02:08.217198+0000","last_became_active":"2024-09-14T11:08:08.905736+0000","last_became_peered":"2024-09-14T11:08:08.905736+0000","last_unstale":"2024-09-14T13:02:08.217198+0000","last_undegraded":"2024-09-14T13:02:08.217198+0000","last_fullsized":"2024-09-14T13:02:08.217198+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T13:02:08.216677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T13:02:08.216677+0000","last_clean_scrub_stamp":"2024-09-14T13:02:08.216677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:51:29.945091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0012835290000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":544,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:25.925375+0000","last_change":"2024-09-14T13:02:25.925119+0000","last_active":"2024-09-14T13:02:25.925375+0000","last_peered":"2024-09-14T13:02:25.925375+0000","last_clean":"2024-09-14T13:02:25.925375+0000","last_became_active":"2024-09-14T11:08:25.801554+0000","last_became_peered":"2024-09-14T11:08:25.801554+0000","last_unstale":"2024-09-14T13:02:25.925375+0000","last_undegraded":"2024-09-14T13:02:25.925375+0000","last_fullsized":"2024-09-14T13:02:25.925375+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T13:02:25.924863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T13:02:25.924863+0000","last_clean_scrub_stamp":"2024-09-14T13:02:25.924863+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T00:42:52.335794+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"267'409","reported_seq":1207,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:29.568207+0000","last_change":"2024-09-14T13:02:29.567953+0000","last_active":"2024-09-14T13:02:29.568207+0000","last_peered":"2024-09-14T13:02:29.568207+0000","last_clean":"2024-09-14T13:02:29.568207+0000","last_became_active":"2024-09-14T11:08:27.831653+0000","last_became_peered":"2024-09-14T11:08:27.831653+0000","last_unstale":"2024-09-14T13:02:29.568207+0000","last_undegraded":"2024-09-14T13:02:29.568207+0000","last_fullsized":"2024-09-14T13:02:29.568207+0000","mapping_epoch":30,"log_start":"267'300","ondisk_log_start":"267'300","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'409","last_scrub_stamp":"2024-09-14T13:02:29.567699+0000","last_deep_scrub":"267'409","last_deep_scrub_stamp":"2024-09-14T13:02:29.567699+0000","last_clean_scrub_stamp":"2024-09-14T13:02:29.567699+0000","objects_scrubbed":8,"log_size":109,"log_dups_size":300,"ondisk_log_size":109,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:06:18.264597+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":31170,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":610,"num_read_kb":890,"num_write":340,"num_write_kb":94,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":534,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:36.969655+0000","last_change":"2024-09-14T13:02:36.969400+0000","last_active":"2024-09-14T13:02:36.969655+0000","last_peered":"2024-09-14T13:02:36.969655+0000","last_clean":"2024-09-14T13:02:36.969655+0000","last_became_active":"2024-09-14T11:08:29.825186+0000","last_became_peered":"2024-09-14T11:08:29.825186+0000","last_unstale":"2024-09-14T13:02:36.969655+0000","last_undegraded":"2024-09-14T13:02:36.969655+0000","last_fullsized":"2024-09-14T13:02:36.969655+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T13:02:36.969177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T13:02:36.969177+0000","last_clean_scrub_stamp":"2024-09-14T13:02:36.969177+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:08:28.903024+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.d","version":"267'140","reported_seq":674,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:41.427831+0000","last_change":"2024-09-14T13:02:41.427667+0000","last_active":"2024-09-14T13:02:41.427831+0000","last_peered":"2024-09-14T13:02:41.427831+0000","last_clean":"2024-09-14T13:02:41.427831+0000","last_became_active":"2024-09-14T11:08:31.837649+0000","last_became_peered":"2024-09-14T11:08:31.837649+0000","last_unstale":"2024-09-14T13:02:41.427831+0000","last_undegraded":"2024-09-14T13:02:41.427831+0000","last_fullsized":"2024-09-14T13:02:41.427831+0000","mapping_epoch":34,"log_start":"267'100","ondisk_log_start":"267'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'140","last_scrub_stamp":"2024-09-14T13:02:41.427470+0000","last_deep_scrub":"267'140","last_deep_scrub_stamp":"2024-09-14T13:02:41.427470+0000","last_clean_scrub_stamp":"2024-09-14T13:02:41.427470+0000","objects_scrubbed":2,"log_size":40,"log_dups_size":100,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:26:46.091468+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":204,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":124,"num_read_kb":124,"num_write":321,"num_write_kb":75,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.1f","version":"267'142","reported_seq":743,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:52.150697+0000","last_change":"2024-09-14T13:02:52.150540+0000","last_active":"2024-09-14T13:02:52.150697+0000","last_peered":"2024-09-14T13:02:52.150697+0000","last_clean":"2024-09-14T13:02:52.150697+0000","last_became_active":"2024-09-14T11:08:31.849681+0000","last_became_peered":"2024-09-14T11:08:31.849681+0000","last_unstale":"2024-09-14T13:02:52.150697+0000","last_undegraded":"2024-09-14T13:02:52.150697+0000","last_fullsized":"2024-09-14T13:02:52.150697+0000","mapping_epoch":34,"log_start":"267'100","ondisk_log_start":"267'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'142","last_scrub_stamp":"2024-09-14T13:02:52.150365+0000","last_deep_scrub":"267'142","last_deep_scrub_stamp":"2024-09-14T13:02:52.150365+0000","last_clean_scrub_stamp":"2024-09-14T13:02:52.150365+0000","objects_scrubbed":1,"log_size":42,"log_dups_size":100,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:25:06.705605+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":202,"num_read_kb":202,"num_write":327,"num_write_kb":74,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.13","version":"267'451","reported_seq":2159,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:15.813156+0000","last_change":"2024-09-14T13:02:15.812885+0000","last_active":"2024-09-14T13:02:15.813156+0000","last_peered":"2024-09-14T13:02:15.813156+0000","last_clean":"2024-09-14T13:02:15.813156+0000","last_became_active":"2024-09-14T11:08:23.806746+0000","last_became_peered":"2024-09-14T11:08:23.806746+0000","last_unstale":"2024-09-14T13:02:15.813156+0000","last_undegraded":"2024-09-14T13:02:15.813156+0000","last_fullsized":"2024-09-14T13:02:15.813156+0000","mapping_epoch":26,"log_start":"267'400","ondisk_log_start":"267'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'451","last_scrub_stamp":"2024-09-14T13:02:15.812664+0000","last_deep_scrub":"267'451","last_deep_scrub_stamp":"2024-09-14T13:02:15.812664+0000","last_clean_scrub_stamp":"2024-09-14T13:02:15.812664+0000","objects_scrubbed":1,"log_size":51,"log_dups_size":400,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:52:30.280885+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2482,"num_read_kb":2367,"num_write":499,"num_write_kb":86,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.14","version":"267'194","reported_seq":825,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:09.119934+0000","last_change":"2024-09-14T13:02:09.119934+0000","last_active":"2024-09-14T13:02:09.119934+0000","last_peered":"2024-09-14T13:02:09.119934+0000","last_clean":"2024-09-14T13:02:09.119934+0000","last_became_active":"2024-09-14T11:08:56.028924+0000","last_became_peered":"2024-09-14T11:08:56.028924+0000","last_unstale":"2024-09-14T13:02:09.119934+0000","last_undegraded":"2024-09-14T13:02:09.119934+0000","last_fullsized":"2024-09-14T13:02:09.119934+0000","mapping_epoch":37,"log_start":"267'100","ondisk_log_start":"267'100","created":24,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'194","last_scrub_stamp":"2024-09-14T13:02:09.119711+0000","last_deep_scrub":"267'194","last_deep_scrub_stamp":"2024-09-14T13:02:09.119711+0000","last_clean_scrub_stamp":"2024-09-14T13:02:09.119711+0000","objects_scrubbed":2,"log_size":94,"log_dups_size":100,"ondisk_log_size":94,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:09:44.743814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":18,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":488,"num_read_kb":9162,"num_write":891,"num_write_kb":17219,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7,6],"acting":[2,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":534,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:20.978730+0000","last_change":"2024-09-14T13:02:20.978556+0000","last_active":"2024-09-14T13:02:20.978730+0000","last_peered":"2024-09-14T13:02:20.978730+0000","last_clean":"2024-09-14T13:02:20.978730+0000","last_became_active":"2024-09-14T11:08:25.806778+0000","last_became_peered":"2024-09-14T11:08:25.806778+0000","last_unstale":"2024-09-14T13:02:20.978730+0000","last_undegraded":"2024-09-14T13:02:20.978730+0000","last_fullsized":"2024-09-14T13:02:20.978730+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T13:02:20.978330+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T13:02:20.978330+0000","last_clean_scrub_stamp":"2024-09-14T13:02:20.978330+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:00:46.172903+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.11","version":"267'198","reported_seq":839,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:34.969205+0000","last_change":"2024-09-14T13:02:34.968968+0000","last_active":"2024-09-14T13:02:34.969205+0000","last_peered":"2024-09-14T13:02:34.969205+0000","last_clean":"2024-09-14T13:02:34.969205+0000","last_became_active":"2024-09-14T11:08:27.802742+0000","last_became_peered":"2024-09-14T11:08:27.802742+0000","last_unstale":"2024-09-14T13:02:34.969205+0000","last_undegraded":"2024-09-14T13:02:34.969205+0000","last_fullsized":"2024-09-14T13:02:34.969205+0000","mapping_epoch":30,"log_start":"264'100","ondisk_log_start":"264'100","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'198","last_scrub_stamp":"2024-09-14T13:02:34.968678+0000","last_deep_scrub":"267'198","last_deep_scrub_stamp":"2024-09-14T13:02:34.968678+0000","last_clean_scrub_stamp":"2024-09-14T13:02:34.968678+0000","objects_scrubbed":5,"log_size":98,"log_dups_size":100,"ondisk_log_size":98,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:20:44.413916+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":14583,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":266,"num_read_kb":357,"num_write":152,"num_write_kb":28,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":528,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:37.929603+0000","last_change":"2024-09-14T13:02:37.929447+0000","last_active":"2024-09-14T13:02:37.929603+0000","last_peered":"2024-09-14T13:02:37.929603+0000","last_clean":"2024-09-14T13:02:37.929603+0000","last_became_active":"2024-09-14T11:08:29.832866+0000","last_became_peered":"2024-09-14T11:08:29.832866+0000","last_unstale":"2024-09-14T13:02:37.929603+0000","last_undegraded":"2024-09-14T13:02:37.929603+0000","last_fullsized":"2024-09-14T13:02:37.929603+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T13:02:37.929269+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T13:02:37.929269+0000","last_clean_scrub_stamp":"2024-09-14T13:02:37.929269+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:25:25.066701+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1e","version":"267'155","reported_seq":743,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:47.900102+0000","last_change":"2024-09-14T13:02:47.899820+0000","last_active":"2024-09-14T13:02:47.900102+0000","last_peered":"2024-09-14T13:02:47.900102+0000","last_clean":"2024-09-14T13:02:47.900102+0000","last_became_active":"2024-09-14T11:08:31.837431+0000","last_became_peered":"2024-09-14T11:08:31.837431+0000","last_unstale":"2024-09-14T13:02:47.900102+0000","last_undegraded":"2024-09-14T13:02:47.900102+0000","last_fullsized":"2024-09-14T13:02:47.900102+0000","mapping_epoch":34,"log_start":"267'100","ondisk_log_start":"267'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'155","last_scrub_stamp":"2024-09-14T13:02:47.899599+0000","last_deep_scrub":"267'155","last_deep_scrub_stamp":"2024-09-14T13:02:47.899599+0000","last_clean_scrub_stamp":"2024-09-14T13:02:47.899599+0000","objects_scrubbed":2,"log_size":55,"log_dups_size":100,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:37:50.930383+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":449,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":316,"num_read_kb":262,"num_write":344,"num_write_kb":81,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.12","version":"267'845","reported_seq":2499,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:17.107014+0000","last_change":"2024-09-14T13:02:17.106870+0000","last_active":"2024-09-14T13:02:17.107014+0000","last_peered":"2024-09-14T13:02:17.107014+0000","last_clean":"2024-09-14T13:02:17.107014+0000","last_became_active":"2024-09-14T11:08:23.805773+0000","last_became_peered":"2024-09-14T11:08:23.805773+0000","last_unstale":"2024-09-14T13:02:17.107014+0000","last_undegraded":"2024-09-14T13:02:17.107014+0000","last_fullsized":"2024-09-14T13:02:17.107014+0000","mapping_epoch":26,"log_start":"267'800","ondisk_log_start":"267'800","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'845","last_scrub_stamp":"2024-09-14T13:02:17.106695+0000","last_deep_scrub":"267'845","last_deep_scrub_stamp":"2024-09-14T13:02:17.106695+0000","last_clean_scrub_stamp":"2024-09-14T13:02:17.106695+0000","objects_scrubbed":3,"log_size":45,"log_dups_size":800,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:00:08.155637+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":4345,"num_read_kb":3935,"num_write":1136,"num_write_kb":447,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2810,"num_omap_keys":11,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"267'286","reported_seq":1007,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:14.595357+0000","last_change":"2024-09-14T13:02:14.595357+0000","last_active":"2024-09-14T13:02:14.595357+0000","last_peered":"2024-09-14T13:02:14.595357+0000","last_clean":"2024-09-14T13:02:14.595357+0000","last_became_active":"2024-09-14T11:08:21.829412+0000","last_became_peered":"2024-09-14T11:08:21.829412+0000","last_unstale":"2024-09-14T13:02:14.595357+0000","last_undegraded":"2024-09-14T13:02:14.595357+0000","last_fullsized":"2024-09-14T13:02:14.595357+0000","mapping_epoch":24,"log_start":"267'200","ondisk_log_start":"267'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'286","last_scrub_stamp":"2024-09-14T13:02:14.595126+0000","last_deep_scrub":"267'286","last_deep_scrub_stamp":"2024-09-14T13:02:14.595126+0000","last_clean_scrub_stamp":"2024-09-14T13:02:14.595126+0000","objects_scrubbed":3,"log_size":86,"log_dups_size":200,"ondisk_log_size":86,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T00:09:31.251389+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":54,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":846,"num_read_kb":41720,"num_write":1221,"num_write_kb":52852,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,6],"acting":[7,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":536,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:27.980775+0000","last_change":"2024-09-14T13:02:27.980640+0000","last_active":"2024-09-14T13:02:27.980775+0000","last_peered":"2024-09-14T13:02:27.980775+0000","last_clean":"2024-09-14T13:02:27.980775+0000","last_became_active":"2024-09-14T11:08:25.799473+0000","last_became_peered":"2024-09-14T11:08:25.799473+0000","last_unstale":"2024-09-14T13:02:27.980775+0000","last_undegraded":"2024-09-14T13:02:27.980775+0000","last_fullsized":"2024-09-14T13:02:27.980775+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T13:02:27.980463+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T13:02:27.980463+0000","last_clean_scrub_stamp":"2024-09-14T13:02:27.980463+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:37:30.104380+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"267'96","reported_seq":657,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:24.968369+0000","last_change":"2024-09-14T13:02:24.968219+0000","last_active":"2024-09-14T13:02:24.968369+0000","last_peered":"2024-09-14T13:02:24.968369+0000","last_clean":"2024-09-14T13:02:24.968369+0000","last_became_active":"2024-09-14T11:08:27.822933+0000","last_became_peered":"2024-09-14T11:08:27.822933+0000","last_unstale":"2024-09-14T13:02:24.968369+0000","last_undegraded":"2024-09-14T13:02:24.968369+0000","last_fullsized":"2024-09-14T13:02:24.968369+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'96","last_scrub_stamp":"2024-09-14T13:02:24.968008+0000","last_deep_scrub":"267'96","last_deep_scrub_stamp":"2024-09-14T13:02:24.968008+0000","last_clean_scrub_stamp":"2024-09-14T13:02:24.968008+0000","objects_scrubbed":3,"log_size":96,"log_dups_size":0,"ondisk_log_size":96,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:09:28.512920+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":83,"num_read_kb":77,"num_write":62,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":588,"num_omap_keys":4,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":529,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:36.558623+0000","last_change":"2024-09-14T13:02:36.558460+0000","last_active":"2024-09-14T13:02:36.558623+0000","last_peered":"2024-09-14T13:02:36.558623+0000","last_clean":"2024-09-14T13:02:36.558623+0000","last_became_active":"2024-09-14T11:08:29.838784+0000","last_became_peered":"2024-09-14T11:08:29.838784+0000","last_unstale":"2024-09-14T13:02:36.558623+0000","last_undegraded":"2024-09-14T13:02:36.558623+0000","last_fullsized":"2024-09-14T13:02:36.558623+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T13:02:36.558284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T13:02:36.558284+0000","last_clean_scrub_stamp":"2024-09-14T13:02:36.558284+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:39:19.014441+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1d","version":"267'174","reported_seq":731,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:40.198504+0000","last_change":"2024-09-14T13:02:40.198504+0000","last_active":"2024-09-14T13:02:40.198504+0000","last_peered":"2024-09-14T13:02:40.198504+0000","last_clean":"2024-09-14T13:02:40.198504+0000","last_became_active":"2024-09-14T11:08:31.835061+0000","last_became_peered":"2024-09-14T11:08:31.835061+0000","last_unstale":"2024-09-14T13:02:40.198504+0000","last_undegraded":"2024-09-14T13:02:40.198504+0000","last_fullsized":"2024-09-14T13:02:40.198504+0000","mapping_epoch":34,"log_start":"267'100","ondisk_log_start":"267'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'174","last_scrub_stamp":"2024-09-14T13:02:40.198316+0000","last_deep_scrub":"267'174","last_deep_scrub_stamp":"2024-09-14T13:02:40.198316+0000","last_clean_scrub_stamp":"2024-09-14T13:02:40.198316+0000","objects_scrubbed":1,"log_size":74,"log_dups_size":100,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:26:48.833442+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":257,"num_read_kb":254,"num_write":377,"num_write_kb":108,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":398,"num_omap_keys":2,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"267'375","reported_seq":1950,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:16.881500+0000","last_change":"2024-09-14T13:02:16.881362+0000","last_active":"2024-09-14T13:02:16.881500+0000","last_peered":"2024-09-14T13:02:16.881500+0000","last_clean":"2024-09-14T13:02:16.881500+0000","last_became_active":"2024-09-14T11:08:23.803793+0000","last_became_peered":"2024-09-14T11:08:23.803793+0000","last_unstale":"2024-09-14T13:02:16.881500+0000","last_undegraded":"2024-09-14T13:02:16.881500+0000","last_fullsized":"2024-09-14T13:02:16.881500+0000","mapping_epoch":26,"log_start":"267'300","ondisk_log_start":"267'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'375","last_scrub_stamp":"2024-09-14T13:02:16.881154+0000","last_deep_scrub":"267'375","last_deep_scrub_stamp":"2024-09-14T13:02:16.881154+0000","last_clean_scrub_stamp":"2024-09-14T13:02:16.881154+0000","objects_scrubbed":4,"log_size":75,"log_dups_size":300,"ondisk_log_size":75,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:09:51.952201+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":2158,"num_read_kb":2067,"num_write":426,"num_write_kb":77,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"267'203","reported_seq":861,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:08.282770+0000","last_change":"2024-09-14T13:02:08.282770+0000","last_active":"2024-09-14T13:02:08.282770+0000","last_peered":"2024-09-14T13:02:08.282770+0000","last_clean":"2024-09-14T13:02:08.282770+0000","last_became_active":"2024-09-14T11:08:21.796544+0000","last_became_peered":"2024-09-14T11:08:21.796544+0000","last_unstale":"2024-09-14T13:02:08.282770+0000","last_undegraded":"2024-09-14T13:02:08.282770+0000","last_fullsized":"2024-09-14T13:02:08.282770+0000","mapping_epoch":24,"log_start":"267'100","ondisk_log_start":"267'100","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'203","last_scrub_stamp":"2024-09-14T13:02:08.282561+0000","last_deep_scrub":"267'203","last_deep_scrub_stamp":"2024-09-14T13:02:08.282561+0000","last_clean_scrub_stamp":"2024-09-14T13:02:08.282561+0000","objects_scrubbed":1,"log_size":103,"log_dups_size":100,"ondisk_log_size":103,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:48:38.983992+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":13,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":507,"num_read_kb":19523,"num_write":848,"num_write_kb":34711,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,1],"acting":[5,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":537,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:27.542650+0000","last_change":"2024-09-14T13:02:27.542469+0000","last_active":"2024-09-14T13:02:27.542650+0000","last_peered":"2024-09-14T13:02:27.542650+0000","last_clean":"2024-09-14T13:02:27.542650+0000","last_became_active":"2024-09-14T11:08:25.812065+0000","last_became_peered":"2024-09-14T11:08:25.812065+0000","last_unstale":"2024-09-14T13:02:27.542650+0000","last_undegraded":"2024-09-14T13:02:27.542650+0000","last_fullsized":"2024-09-14T13:02:27.542650+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T13:02:27.542288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T13:02:27.542288+0000","last_clean_scrub_stamp":"2024-09-14T13:02:27.542288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T00:32:03.908244+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.13","version":"267'230","reported_seq":887,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:30.906904+0000","last_change":"2024-09-14T13:02:30.906643+0000","last_active":"2024-09-14T13:02:30.906904+0000","last_peered":"2024-09-14T13:02:30.906904+0000","last_clean":"2024-09-14T13:02:30.906904+0000","last_became_active":"2024-09-14T11:08:27.803857+0000","last_became_peered":"2024-09-14T11:08:27.803857+0000","last_unstale":"2024-09-14T13:02:30.906904+0000","last_undegraded":"2024-09-14T13:02:30.906904+0000","last_fullsized":"2024-09-14T13:02:30.906904+0000","mapping_epoch":30,"log_start":"267'200","ondisk_log_start":"267'200","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'230","last_scrub_stamp":"2024-09-14T13:02:30.906416+0000","last_deep_scrub":"267'230","last_deep_scrub_stamp":"2024-09-14T13:02:30.906416+0000","last_clean_scrub_stamp":"2024-09-14T13:02:30.906416+0000","objects_scrubbed":5,"log_size":30,"log_dups_size":200,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:44:09.351180+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":20297,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":321,"num_read_kb":447,"num_write":190,"num_write_kb":46,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":527,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:27.266099+0000","last_change":"2024-09-14T13:02:27.265918+0000","last_active":"2024-09-14T13:02:27.266099+0000","last_peered":"2024-09-14T13:02:27.266099+0000","last_clean":"2024-09-14T13:02:27.266099+0000","last_became_active":"2024-09-14T11:08:29.830498+0000","last_became_peered":"2024-09-14T11:08:29.830498+0000","last_unstale":"2024-09-14T13:02:27.266099+0000","last_undegraded":"2024-09-14T13:02:27.266099+0000","last_fullsized":"2024-09-14T13:02:27.266099+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T13:02:27.265738+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T13:02:27.265738+0000","last_clean_scrub_stamp":"2024-09-14T13:02:27.265738+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:07:09.501488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.1c","version":"267'126","reported_seq":674,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:44.338425+0000","last_change":"2024-09-14T13:02:44.338425+0000","last_active":"2024-09-14T13:02:44.338425+0000","last_peered":"2024-09-14T13:02:44.338425+0000","last_clean":"2024-09-14T13:02:44.338425+0000","last_became_active":"2024-09-14T11:08:31.829826+0000","last_became_peered":"2024-09-14T11:08:31.829826+0000","last_unstale":"2024-09-14T13:02:44.338425+0000","last_undegraded":"2024-09-14T13:02:44.338425+0000","last_fullsized":"2024-09-14T13:02:44.338425+0000","mapping_epoch":34,"log_start":"267'100","ondisk_log_start":"267'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'126","last_scrub_stamp":"2024-09-14T13:02:44.338238+0000","last_deep_scrub":"267'126","last_deep_scrub_stamp":"2024-09-14T13:02:44.338238+0000","last_clean_scrub_stamp":"2024-09-14T13:02:44.338238+0000","objects_scrubbed":3,"log_size":26,"log_dups_size":100,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:33:04.317217+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":861,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":146,"num_read_kb":140,"num_write":284,"num_write_kb":67,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"267'867","reported_seq":2542,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:15.874662+0000","last_change":"2024-09-14T13:02:15.874501+0000","last_active":"2024-09-14T13:02:15.874662+0000","last_peered":"2024-09-14T13:02:15.874662+0000","last_clean":"2024-09-14T13:02:15.874662+0000","last_became_active":"2024-09-14T11:08:23.781565+0000","last_became_peered":"2024-09-14T11:08:23.781565+0000","last_unstale":"2024-09-14T13:02:15.874662+0000","last_undegraded":"2024-09-14T13:02:15.874662+0000","last_fullsized":"2024-09-14T13:02:15.874662+0000","mapping_epoch":26,"log_start":"267'800","ondisk_log_start":"267'800","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'867","last_scrub_stamp":"2024-09-14T13:02:15.874297+0000","last_deep_scrub":"267'867","last_deep_scrub_stamp":"2024-09-14T13:02:15.874297+0000","last_clean_scrub_stamp":"2024-09-14T13:02:15.874297+0000","objects_scrubbed":2,"log_size":67,"log_dups_size":800,"ondisk_log_size":67,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:44:25.802335+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":4353,"num_read_kb":3923,"num_write":1159,"num_write_kb":442,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1857,"num_omap_keys":8,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"267'273","reported_seq":958,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:09.085166+0000","last_change":"2024-09-14T13:02:09.085166+0000","last_active":"2024-09-14T13:02:09.085166+0000","last_peered":"2024-09-14T13:02:09.085166+0000","last_clean":"2024-09-14T13:02:09.085166+0000","last_became_active":"2024-09-14T11:08:21.780624+0000","last_became_peered":"2024-09-14T11:08:21.780624+0000","last_unstale":"2024-09-14T13:02:09.085166+0000","last_undegraded":"2024-09-14T13:02:09.085166+0000","last_fullsized":"2024-09-14T13:02:09.085166+0000","mapping_epoch":24,"log_start":"267'200","ondisk_log_start":"267'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'273","last_scrub_stamp":"2024-09-14T13:02:09.084972+0000","last_deep_scrub":"267'273","last_deep_scrub_stamp":"2024-09-14T13:02:09.084972+0000","last_clean_scrub_stamp":"2024-09-14T13:02:09.084972+0000","objects_scrubbed":1,"log_size":73,"log_dups_size":200,"ondisk_log_size":73,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:52:41.240236+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":15,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":687,"num_read_kb":19614,"num_write":1225,"num_write_kb":48256,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,3],"acting":[0,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":535,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:19.319200+0000","last_change":"2024-09-14T13:02:19.319030+0000","last_active":"2024-09-14T13:02:19.319200+0000","last_peered":"2024-09-14T13:02:19.319200+0000","last_clean":"2024-09-14T13:02:19.319200+0000","last_became_active":"2024-09-14T11:08:25.812705+0000","last_became_peered":"2024-09-14T11:08:25.812705+0000","last_unstale":"2024-09-14T13:02:19.319200+0000","last_undegraded":"2024-09-14T13:02:19.319200+0000","last_fullsized":"2024-09-14T13:02:19.319200+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T13:02:19.318859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T13:02:19.318859+0000","last_clean_scrub_stamp":"2024-09-14T13:02:19.318859+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:53:09.845136+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.12","version":"267'173","reported_seq":803,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:32.553092+0000","last_change":"2024-09-14T13:02:32.552951+0000","last_active":"2024-09-14T13:02:32.553092+0000","last_peered":"2024-09-14T13:02:32.553092+0000","last_clean":"2024-09-14T13:02:32.553092+0000","last_became_active":"2024-09-14T11:08:27.828095+0000","last_became_peered":"2024-09-14T11:08:27.828095+0000","last_unstale":"2024-09-14T13:02:32.553092+0000","last_undegraded":"2024-09-14T13:02:32.553092+0000","last_fullsized":"2024-09-14T13:02:32.553092+0000","mapping_epoch":30,"log_start":"267'100","ondisk_log_start":"267'100","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'173","last_scrub_stamp":"2024-09-14T13:02:32.552754+0000","last_deep_scrub":"267'173","last_deep_scrub_stamp":"2024-09-14T13:02:32.552754+0000","last_clean_scrub_stamp":"2024-09-14T13:02:32.552754+0000","objects_scrubbed":4,"log_size":73,"log_dups_size":100,"ondisk_log_size":73,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:22:22.288640+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8744,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":225,"num_read_kb":285,"num_write":126,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":533,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:32.119040+0000","last_change":"2024-09-14T13:02:32.118767+0000","last_active":"2024-09-14T13:02:32.119040+0000","last_peered":"2024-09-14T13:02:32.119040+0000","last_clean":"2024-09-14T13:02:32.119040+0000","last_became_active":"2024-09-14T11:08:29.820211+0000","last_became_peered":"2024-09-14T11:08:29.820211+0000","last_unstale":"2024-09-14T13:02:32.119040+0000","last_undegraded":"2024-09-14T13:02:32.119040+0000","last_fullsized":"2024-09-14T13:02:32.119040+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T13:02:32.118493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T13:02:32.118493+0000","last_clean_scrub_stamp":"2024-09-14T13:02:32.118493+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:24:48.355067+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"267'408","reported_seq":1925,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:22.324669+0000","last_change":"2024-09-14T13:02:22.324486+0000","last_active":"2024-09-14T13:02:22.324669+0000","last_peered":"2024-09-14T13:02:22.324669+0000","last_clean":"2024-09-14T13:02:22.324669+0000","last_became_active":"2024-09-14T11:08:23.812148+0000","last_became_peered":"2024-09-14T11:08:23.812148+0000","last_unstale":"2024-09-14T13:02:22.324669+0000","last_undegraded":"2024-09-14T13:02:22.324669+0000","last_fullsized":"2024-09-14T13:02:22.324669+0000","mapping_epoch":26,"log_start":"267'300","ondisk_log_start":"267'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'408","last_scrub_stamp":"2024-09-14T13:02:22.324302+0000","last_deep_scrub":"267'408","last_deep_scrub_stamp":"2024-09-14T13:02:22.324302+0000","last_clean_scrub_stamp":"2024-09-14T13:02:22.324302+0000","objects_scrubbed":1,"log_size":108,"log_dups_size":300,"ondisk_log_size":108,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:43:05.653161+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2189,"num_read_kb":2068,"num_write":470,"num_write_kb":97,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"267'247","reported_seq":1151,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:08.983777+0000","last_change":"2024-09-14T13:02:08.983777+0000","last_active":"2024-09-14T13:02:08.983777+0000","last_peered":"2024-09-14T13:02:08.983777+0000","last_clean":"2024-09-14T13:02:08.983777+0000","last_became_active":"2024-09-14T11:08:21.778733+0000","last_became_peered":"2024-09-14T11:08:21.778733+0000","last_unstale":"2024-09-14T13:02:08.983777+0000","last_undegraded":"2024-09-14T13:02:08.983777+0000","last_fullsized":"2024-09-14T13:02:08.983777+0000","mapping_epoch":24,"log_start":"267'200","ondisk_log_start":"267'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'247","last_scrub_stamp":"2024-09-14T13:02:08.983565+0000","last_deep_scrub":"267'247","last_deep_scrub_stamp":"2024-09-14T13:02:08.983565+0000","last_clean_scrub_stamp":"2024-09-14T13:02:08.983565+0000","objects_scrubbed":1,"log_size":47,"log_dups_size":200,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:53:58.902570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1357,"num_read_kb":10917,"num_write":1157,"num_write_kb":41642,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":549,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:26.999344+0000","last_change":"2024-09-14T13:02:26.999208+0000","last_active":"2024-09-14T13:02:26.999344+0000","last_peered":"2024-09-14T13:02:26.999344+0000","last_clean":"2024-09-14T13:02:26.999344+0000","last_became_active":"2024-09-14T11:08:25.799108+0000","last_became_peered":"2024-09-14T11:08:25.799108+0000","last_unstale":"2024-09-14T13:02:26.999344+0000","last_undegraded":"2024-09-14T13:02:26.999344+0000","last_fullsized":"2024-09-14T13:02:26.999344+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T13:02:26.999021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T13:02:26.999021+0000","last_clean_scrub_stamp":"2024-09-14T13:02:26.999021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T00:48:32.563816+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1d","version":"267'256","reported_seq":940,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:28.097193+0000","last_change":"2024-09-14T13:02:28.096964+0000","last_active":"2024-09-14T13:02:28.097193+0000","last_peered":"2024-09-14T13:02:28.097193+0000","last_clean":"2024-09-14T13:02:28.097193+0000","last_became_active":"2024-09-14T11:08:27.830985+0000","last_became_peered":"2024-09-14T11:08:27.830985+0000","last_unstale":"2024-09-14T13:02:28.097193+0000","last_undegraded":"2024-09-14T13:02:28.097193+0000","last_fullsized":"2024-09-14T13:02:28.097193+0000","mapping_epoch":30,"log_start":"267'200","ondisk_log_start":"267'200","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'256","last_scrub_stamp":"2024-09-14T13:02:28.096741+0000","last_deep_scrub":"267'256","last_deep_scrub_stamp":"2024-09-14T13:02:28.096741+0000","last_clean_scrub_stamp":"2024-09-14T13:02:28.096741+0000","objects_scrubbed":6,"log_size":56,"log_dups_size":200,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:57:37.009563+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":23445,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":387,"num_read_kb":588,"num_write":256,"num_write_kb":158,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":25256,"num_omap_keys":48,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":524,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:38.404367+0000","last_change":"2024-09-14T13:02:38.404367+0000","last_active":"2024-09-14T13:02:38.404367+0000","last_peered":"2024-09-14T13:02:38.404367+0000","last_clean":"2024-09-14T13:02:38.404367+0000","last_became_active":"2024-09-14T11:08:29.834723+0000","last_became_peered":"2024-09-14T11:08:29.834723+0000","last_unstale":"2024-09-14T13:02:38.404367+0000","last_undegraded":"2024-09-14T13:02:38.404367+0000","last_fullsized":"2024-09-14T13:02:38.404367+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T13:02:38.404182+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T13:02:38.404182+0000","last_clean_scrub_stamp":"2024-09-14T13:02:38.404182+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:53:07.617089+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.13","version":"267'171","reported_seq":716,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:41.984083+0000","last_change":"2024-09-14T13:02:41.983938+0000","last_active":"2024-09-14T13:02:41.984083+0000","last_peered":"2024-09-14T13:02:41.984083+0000","last_clean":"2024-09-14T13:02:41.984083+0000","last_became_active":"2024-09-14T11:08:31.832337+0000","last_became_peered":"2024-09-14T11:08:31.832337+0000","last_unstale":"2024-09-14T13:02:41.984083+0000","last_undegraded":"2024-09-14T13:02:41.984083+0000","last_fullsized":"2024-09-14T13:02:41.984083+0000","mapping_epoch":34,"log_start":"267'100","ondisk_log_start":"267'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'171","last_scrub_stamp":"2024-09-14T13:02:41.983727+0000","last_deep_scrub":"267'171","last_deep_scrub_stamp":"2024-09-14T13:02:41.983727+0000","last_clean_scrub_stamp":"2024-09-14T13:02:41.983727+0000","objects_scrubbed":2,"log_size":71,"log_dups_size":100,"ondisk_log_size":71,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:23:43.504453+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":643,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":222,"num_read_kb":226,"num_write":392,"num_write_kb":102,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"267'413","reported_seq":2040,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:20.024032+0000","last_change":"2024-09-14T13:02:20.023797+0000","last_active":"2024-09-14T13:02:20.024032+0000","last_peered":"2024-09-14T13:02:20.024032+0000","last_clean":"2024-09-14T13:02:20.024032+0000","last_became_active":"2024-09-14T11:08:23.800615+0000","last_became_peered":"2024-09-14T11:08:23.800615+0000","last_unstale":"2024-09-14T13:02:20.024032+0000","last_undegraded":"2024-09-14T13:02:20.024032+0000","last_fullsized":"2024-09-14T13:02:20.024032+0000","mapping_epoch":26,"log_start":"267'400","ondisk_log_start":"267'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'413","last_scrub_stamp":"2024-09-14T13:02:20.023496+0000","last_deep_scrub":"267'413","last_deep_scrub_stamp":"2024-09-14T13:02:20.023496+0000","last_clean_scrub_stamp":"2024-09-14T13:02:20.023496+0000","objects_scrubbed":1,"log_size":13,"log_dups_size":400,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:35:57.669124+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2239,"num_read_kb":2142,"num_write":466,"num_write_kb":81,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":254,"num_omap_keys":1,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"267'242","reported_seq":929,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:08.020604+0000","last_change":"2024-09-14T13:02:08.020474+0000","last_active":"2024-09-14T13:02:08.020604+0000","last_peered":"2024-09-14T13:02:08.020604+0000","last_clean":"2024-09-14T13:02:08.020604+0000","last_became_active":"2024-09-14T11:08:56.036673+0000","last_became_peered":"2024-09-14T11:08:56.036673+0000","last_unstale":"2024-09-14T13:02:08.020604+0000","last_undegraded":"2024-09-14T13:02:08.020604+0000","last_fullsized":"2024-09-14T13:02:08.020604+0000","mapping_epoch":37,"log_start":"267'200","ondisk_log_start":"267'200","created":24,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'242","last_scrub_stamp":"2024-09-14T13:02:08.020270+0000","last_deep_scrub":"267'242","last_deep_scrub_stamp":"2024-09-14T13:02:08.020270+0000","last_clean_scrub_stamp":"2024-09-14T13:02:08.020270+0000","objects_scrubbed":4,"log_size":42,"log_dups_size":200,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:26:39.664742+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":60,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":566,"num_read_kb":38876,"num_write":1051,"num_write_kb":52722,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,4],"acting":[1,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1f","version":"267'4","reported_seq":1019,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:23.337973+0000","last_change":"2024-09-14T13:02:23.337823+0000","last_active":"2024-09-14T13:02:23.337973+0000","last_peered":"2024-09-14T13:02:23.337973+0000","last_clean":"2024-09-14T13:02:23.337973+0000","last_became_active":"2024-09-14T11:08:25.812070+0000","last_became_peered":"2024-09-14T11:08:25.812070+0000","last_unstale":"2024-09-14T13:02:23.337973+0000","last_undegraded":"2024-09-14T13:02:23.337973+0000","last_fullsized":"2024-09-14T13:02:23.337973+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'4","last_scrub_stamp":"2024-09-14T13:02:23.337638+0000","last_deep_scrub":"267'4","last_deep_scrub_stamp":"2024-09-14T13:02:23.337638+0000","last_clean_scrub_stamp":"2024-09-14T13:02:23.337638+0000","objects_scrubbed":1,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:25:52.234244+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":470,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":719,"num_read_kb":717,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1c","version":"267'290","reported_seq":953,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:34.649792+0000","last_change":"2024-09-14T13:02:34.649646+0000","last_active":"2024-09-14T13:02:34.649792+0000","last_peered":"2024-09-14T13:02:34.649792+0000","last_clean":"2024-09-14T13:02:34.649792+0000","last_became_active":"2024-09-14T11:08:27.839087+0000","last_became_peered":"2024-09-14T11:08:27.839087+0000","last_unstale":"2024-09-14T13:02:34.649792+0000","last_undegraded":"2024-09-14T13:02:34.649792+0000","last_fullsized":"2024-09-14T13:02:34.649792+0000","mapping_epoch":30,"log_start":"267'200","ondisk_log_start":"267'200","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'290","last_scrub_stamp":"2024-09-14T13:02:34.649418+0000","last_deep_scrub":"267'290","last_deep_scrub_stamp":"2024-09-14T13:02:34.649418+0000","last_clean_scrub_stamp":"2024-09-14T13:02:34.649418+0000","objects_scrubbed":8,"log_size":90,"log_dups_size":200,"ondisk_log_size":90,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:44:57.415007+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":105157,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":431,"num_read_kb":790,"num_write":316,"num_write_kb":215,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":11460,"num_omap_keys":24,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":522,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:33.128117+0000","last_change":"2024-09-14T13:02:33.128117+0000","last_active":"2024-09-14T13:02:33.128117+0000","last_peered":"2024-09-14T13:02:33.128117+0000","last_clean":"2024-09-14T13:02:33.128117+0000","last_became_active":"2024-09-14T11:08:29.828451+0000","last_became_peered":"2024-09-14T11:08:29.828451+0000","last_unstale":"2024-09-14T13:02:33.128117+0000","last_undegraded":"2024-09-14T13:02:33.128117+0000","last_fullsized":"2024-09-14T13:02:33.128117+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T13:02:33.127924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T13:02:33.127924+0000","last_clean_scrub_stamp":"2024-09-14T13:02:33.127924+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:10:36.512182+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.12","version":"267'207","reported_seq":1115,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:31.278615+0000","last_change":"2024-09-14T13:02:31.278471+0000","last_active":"2024-09-14T13:02:31.278615+0000","last_peered":"2024-09-14T13:02:31.278615+0000","last_clean":"2024-09-14T13:02:31.278615+0000","last_became_active":"2024-09-14T11:08:31.854650+0000","last_became_peered":"2024-09-14T11:08:31.854650+0000","last_unstale":"2024-09-14T13:02:31.278615+0000","last_undegraded":"2024-09-14T13:02:31.278615+0000","last_fullsized":"2024-09-14T13:02:31.278615+0000","mapping_epoch":34,"log_start":"267'100","ondisk_log_start":"267'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'207","last_scrub_stamp":"2024-09-14T13:02:31.278260+0000","last_deep_scrub":"267'207","last_deep_scrub_stamp":"2024-09-14T13:02:31.278260+0000","last_clean_scrub_stamp":"2024-09-14T13:02:31.278260+0000","objects_scrubbed":6,"log_size":107,"log_dups_size":100,"ondisk_log_size":107,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:59:42.042572+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1218,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":620,"num_read_kb":614,"num_write":555,"num_write_kb":141,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1d","version":"267'644","reported_seq":2449,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:20.943430+0000","last_change":"2024-09-14T13:02:20.943243+0000","last_active":"2024-09-14T13:02:20.943430+0000","last_peered":"2024-09-14T13:02:20.943430+0000","last_clean":"2024-09-14T13:02:20.943430+0000","last_became_active":"2024-09-14T11:08:23.779099+0000","last_became_peered":"2024-09-14T11:08:23.779099+0000","last_unstale":"2024-09-14T13:02:20.943430+0000","last_undegraded":"2024-09-14T13:02:20.943430+0000","last_fullsized":"2024-09-14T13:02:20.943430+0000","mapping_epoch":26,"log_start":"267'600","ondisk_log_start":"267'600","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'644","last_scrub_stamp":"2024-09-14T13:02:20.943029+0000","last_deep_scrub":"267'644","last_deep_scrub_stamp":"2024-09-14T13:02:20.943029+0000","last_clean_scrub_stamp":"2024-09-14T13:02:20.943029+0000","objects_scrubbed":2,"log_size":44,"log_dups_size":600,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:46:01.069278+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3438,"num_read_kb":3161,"num_write":830,"num_write_kb":293,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":432,"num_omap_keys":2,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"267'251","reported_seq":1040,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:08.835192+0000","last_change":"2024-09-14T13:02:08.834994+0000","last_active":"2024-09-14T13:02:08.835192+0000","last_peered":"2024-09-14T13:02:08.835192+0000","last_clean":"2024-09-14T13:02:08.835192+0000","last_became_active":"2024-09-14T11:08:21.822349+0000","last_became_peered":"2024-09-14T11:08:21.822349+0000","last_unstale":"2024-09-14T13:02:08.835192+0000","last_undegraded":"2024-09-14T13:02:08.835192+0000","last_fullsized":"2024-09-14T13:02:08.835192+0000","mapping_epoch":24,"log_start":"267'200","ondisk_log_start":"267'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'251","last_scrub_stamp":"2024-09-14T13:02:08.834786+0000","last_deep_scrub":"267'251","last_deep_scrub_stamp":"2024-09-14T13:02:08.834786+0000","last_clean_scrub_stamp":"2024-09-14T13:02:08.834786+0000","objects_scrubbed":3,"log_size":51,"log_dups_size":200,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:07:12.222661+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1655848,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1337,"num_read_kb":40987,"num_write":1078,"num_write_kb":33045,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,5],"acting":[4,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":535,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:29.680297+0000","last_change":"2024-09-14T13:02:29.680153+0000","last_active":"2024-09-14T13:02:29.680297+0000","last_peered":"2024-09-14T13:02:29.680297+0000","last_clean":"2024-09-14T13:02:29.680297+0000","last_became_active":"2024-09-14T11:08:25.807820+0000","last_became_peered":"2024-09-14T11:08:25.807820+0000","last_unstale":"2024-09-14T13:02:29.680297+0000","last_undegraded":"2024-09-14T13:02:29.680297+0000","last_fullsized":"2024-09-14T13:02:29.680297+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T13:02:29.679968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T13:02:29.679968+0000","last_clean_scrub_stamp":"2024-09-14T13:02:29.679968+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:16:44.115139+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1f","version":"267'207","reported_seq":855,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:31.871640+0000","last_change":"2024-09-14T13:02:31.871500+0000","last_active":"2024-09-14T13:02:31.871640+0000","last_peered":"2024-09-14T13:02:31.871640+0000","last_clean":"2024-09-14T13:02:31.871640+0000","last_became_active":"2024-09-14T11:08:27.799019+0000","last_became_peered":"2024-09-14T11:08:27.799019+0000","last_unstale":"2024-09-14T13:02:31.871640+0000","last_undegraded":"2024-09-14T13:02:31.871640+0000","last_fullsized":"2024-09-14T13:02:31.871640+0000","mapping_epoch":30,"log_start":"264'100","ondisk_log_start":"264'100","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'207","last_scrub_stamp":"2024-09-14T13:02:31.871286+0000","last_deep_scrub":"267'207","last_deep_scrub_stamp":"2024-09-14T13:02:31.871286+0000","last_clean_scrub_stamp":"2024-09-14T13:02:31.871286+0000","objects_scrubbed":6,"log_size":107,"log_dups_size":100,"ondisk_log_size":107,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:51:00.124237+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":11376,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":267,"num_read_kb":349,"num_write":156,"num_write_kb":26,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":534,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:26.073940+0000","last_change":"2024-09-14T13:02:26.073717+0000","last_active":"2024-09-14T13:02:26.073940+0000","last_peered":"2024-09-14T13:02:26.073940+0000","last_clean":"2024-09-14T13:02:26.073940+0000","last_became_active":"2024-09-14T11:08:29.820658+0000","last_became_peered":"2024-09-14T11:08:29.820658+0000","last_unstale":"2024-09-14T13:02:26.073940+0000","last_undegraded":"2024-09-14T13:02:26.073940+0000","last_fullsized":"2024-09-14T13:02:26.073940+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T13:02:26.073512+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T13:02:26.073512+0000","last_clean_scrub_stamp":"2024-09-14T13:02:26.073512+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:26:51.195695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.11","version":"267'137","reported_seq":676,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:42.398323+0000","last_change":"2024-09-14T13:02:42.398170+0000","last_active":"2024-09-14T13:02:42.398323+0000","last_peered":"2024-09-14T13:02:42.398323+0000","last_clean":"2024-09-14T13:02:42.398323+0000","last_became_active":"2024-09-14T11:08:31.836424+0000","last_became_peered":"2024-09-14T11:08:31.836424+0000","last_unstale":"2024-09-14T13:02:42.398323+0000","last_undegraded":"2024-09-14T13:02:42.398323+0000","last_fullsized":"2024-09-14T13:02:42.398323+0000","mapping_epoch":34,"log_start":"267'100","ondisk_log_start":"267'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'137","last_scrub_stamp":"2024-09-14T13:02:42.397953+0000","last_deep_scrub":"267'137","last_deep_scrub_stamp":"2024-09-14T13:02:42.397953+0000","last_clean_scrub_stamp":"2024-09-14T13:02:42.397953+0000","objects_scrubbed":3,"log_size":37,"log_dups_size":100,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:33:09.416422+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":383,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":163,"num_read_kb":148,"num_write":342,"num_write_kb":82,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1c","version":"267'438","reported_seq":2104,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:17.145488+0000","last_change":"2024-09-14T13:02:17.145247+0000","last_active":"2024-09-14T13:02:17.145488+0000","last_peered":"2024-09-14T13:02:17.145488+0000","last_clean":"2024-09-14T13:02:17.145488+0000","last_became_active":"2024-09-14T11:08:23.775491+0000","last_became_peered":"2024-09-14T11:08:23.775491+0000","last_unstale":"2024-09-14T13:02:17.145488+0000","last_undegraded":"2024-09-14T13:02:17.145488+0000","last_fullsized":"2024-09-14T13:02:17.145488+0000","mapping_epoch":26,"log_start":"267'400","ondisk_log_start":"267'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'438","last_scrub_stamp":"2024-09-14T13:02:17.145001+0000","last_deep_scrub":"267'438","last_deep_scrub_stamp":"2024-09-14T13:02:17.145001+0000","last_clean_scrub_stamp":"2024-09-14T13:02:17.145001+0000","objects_scrubbed":1,"log_size":38,"log_dups_size":400,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:24:25.673117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2479,"num_read_kb":2350,"num_write":502,"num_write_kb":107,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":247,"num_omap_keys":1,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"267'223","reported_seq":858,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:11.163011+0000","last_change":"2024-09-14T13:02:11.163011+0000","last_active":"2024-09-14T13:02:11.163011+0000","last_peered":"2024-09-14T13:02:11.163011+0000","last_clean":"2024-09-14T13:02:11.163011+0000","last_became_active":"2024-09-14T11:08:56.033894+0000","last_became_peered":"2024-09-14T11:08:56.033894+0000","last_unstale":"2024-09-14T13:02:11.163011+0000","last_undegraded":"2024-09-14T13:02:11.163011+0000","last_fullsized":"2024-09-14T13:02:11.163011+0000","mapping_epoch":37,"log_start":"267'200","ondisk_log_start":"267'200","created":24,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'223","last_scrub_stamp":"2024-09-14T13:02:11.162701+0000","last_deep_scrub":"267'223","last_deep_scrub_stamp":"2024-09-14T13:02:11.162701+0000","last_clean_scrub_stamp":"2024-09-14T13:02:11.162701+0000","objects_scrubbed":2,"log_size":23,"log_dups_size":200,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:47:28.180376+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":541,"num_read_kb":17888,"num_write":1023,"num_write_kb":32755,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4,7],"acting":[2,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":530,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:25.041746+0000","last_change":"2024-09-14T13:02:25.041608+0000","last_active":"2024-09-14T13:02:25.041746+0000","last_peered":"2024-09-14T13:02:25.041746+0000","last_clean":"2024-09-14T13:02:25.041746+0000","last_became_active":"2024-09-14T11:08:25.804388+0000","last_became_peered":"2024-09-14T11:08:25.804388+0000","last_unstale":"2024-09-14T13:02:25.041746+0000","last_undegraded":"2024-09-14T13:02:25.041746+0000","last_fullsized":"2024-09-14T13:02:25.041746+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T13:02:25.041415+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T13:02:25.041415+0000","last_clean_scrub_stamp":"2024-09-14T13:02:25.041415+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:10:25.120032+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1e","version":"267'175","reported_seq":777,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:35.760034+0000","last_change":"2024-09-14T13:02:35.759893+0000","last_active":"2024-09-14T13:02:35.760034+0000","last_peered":"2024-09-14T13:02:35.760034+0000","last_clean":"2024-09-14T13:02:35.760034+0000","last_became_active":"2024-09-14T11:08:27.830708+0000","last_became_peered":"2024-09-14T11:08:27.830708+0000","last_unstale":"2024-09-14T13:02:35.760034+0000","last_undegraded":"2024-09-14T13:02:35.760034+0000","last_fullsized":"2024-09-14T13:02:35.760034+0000","mapping_epoch":30,"log_start":"267'100","ondisk_log_start":"267'100","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'175","last_scrub_stamp":"2024-09-14T13:02:35.759693+0000","last_deep_scrub":"267'175","last_deep_scrub_stamp":"2024-09-14T13:02:35.759693+0000","last_clean_scrub_stamp":"2024-09-14T13:02:35.759693+0000","objects_scrubbed":7,"log_size":75,"log_dups_size":100,"ondisk_log_size":75,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:24:57.090070+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":224,"num_read_kb":219,"num_write":208,"num_write_kb":88,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":18240,"num_omap_keys":46,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1f","version":"267'769","reported_seq":3166,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:29.273471+0000","last_change":"2024-09-14T13:02:29.273311+0000","last_active":"2024-09-14T13:02:29.273471+0000","last_peered":"2024-09-14T13:02:29.273471+0000","last_clean":"2024-09-14T13:02:29.273471+0000","last_became_active":"2024-09-14T11:08:29.840179+0000","last_became_peered":"2024-09-14T11:08:29.840179+0000","last_unstale":"2024-09-14T13:02:29.273471+0000","last_undegraded":"2024-09-14T13:02:29.273471+0000","last_fullsized":"2024-09-14T13:02:29.273471+0000","mapping_epoch":32,"log_start":"267'701","ondisk_log_start":"267'701","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'769","last_scrub_stamp":"2024-09-14T13:02:29.273123+0000","last_deep_scrub":"267'769","last_deep_scrub_stamp":"2024-09-14T13:02:29.273123+0000","last_clean_scrub_stamp":"2024-09-14T13:02:29.273123+0000","objects_scrubbed":1,"log_size":68,"log_dups_size":701,"ondisk_log_size":68,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:27:32.756092+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.10","version":"267'111","reported_seq":646,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:40.561293+0000","last_change":"2024-09-14T13:02:40.561157+0000","last_active":"2024-09-14T13:02:40.561293+0000","last_peered":"2024-09-14T13:02:40.561293+0000","last_clean":"2024-09-14T13:02:40.561293+0000","last_became_active":"2024-09-14T11:08:31.838761+0000","last_became_peered":"2024-09-14T11:08:31.838761+0000","last_unstale":"2024-09-14T13:02:40.561293+0000","last_undegraded":"2024-09-14T13:02:40.561293+0000","last_fullsized":"2024-09-14T13:02:40.561293+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'111","last_scrub_stamp":"2024-09-14T13:02:40.560964+0000","last_deep_scrub":"267'111","last_deep_scrub_stamp":"2024-09-14T13:02:40.560964+0000","last_clean_scrub_stamp":"2024-09-14T13:02:40.560964+0000","objects_scrubbed":1,"log_size":111,"log_dups_size":0,"ondisk_log_size":111,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:00:06.038509+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":418,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":108,"num_read_kb":106,"num_write":270,"num_write_kb":60,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1b","version":"267'385","reported_seq":1858,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:18.711214+0000","last_change":"2024-09-14T13:02:18.710983+0000","last_active":"2024-09-14T13:02:18.711214+0000","last_peered":"2024-09-14T13:02:18.711214+0000","last_clean":"2024-09-14T13:02:18.711214+0000","last_became_active":"2024-09-14T11:08:23.791753+0000","last_became_peered":"2024-09-14T11:08:23.791753+0000","last_unstale":"2024-09-14T13:02:18.711214+0000","last_undegraded":"2024-09-14T13:02:18.711214+0000","last_fullsized":"2024-09-14T13:02:18.711214+0000","mapping_epoch":26,"log_start":"267'300","ondisk_log_start":"267'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'385","last_scrub_stamp":"2024-09-14T13:02:18.710738+0000","last_deep_scrub":"267'385","last_deep_scrub_stamp":"2024-09-14T13:02:18.710738+0000","last_clean_scrub_stamp":"2024-09-14T13:02:18.710738+0000","objects_scrubbed":1,"log_size":85,"log_dups_size":300,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:43:05.968088+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2049,"num_read_kb":1937,"num_write":432,"num_write_kb":84,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1c","version":"267'213","reported_seq":878,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:11.330591+0000","last_change":"2024-09-14T13:02:11.330388+0000","last_active":"2024-09-14T13:02:11.330591+0000","last_peered":"2024-09-14T13:02:11.330591+0000","last_clean":"2024-09-14T13:02:11.330591+0000","last_became_active":"2024-09-14T11:08:21.825881+0000","last_became_peered":"2024-09-14T11:08:21.825881+0000","last_unstale":"2024-09-14T13:02:11.330591+0000","last_undegraded":"2024-09-14T13:02:11.330591+0000","last_fullsized":"2024-09-14T13:02:11.330591+0000","mapping_epoch":24,"log_start":"267'200","ondisk_log_start":"267'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'213","last_scrub_stamp":"2024-09-14T13:02:11.330181+0000","last_deep_scrub":"267'213","last_deep_scrub_stamp":"2024-09-14T13:02:11.330181+0000","last_clean_scrub_stamp":"2024-09-14T13:02:11.330181+0000","objects_scrubbed":1,"log_size":13,"log_dups_size":200,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:06:15.884484+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1655822,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":555,"num_read_kb":34621,"num_write":949,"num_write_kb":21560,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":534,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:28.543288+0000","last_change":"2024-09-14T13:02:28.543122+0000","last_active":"2024-09-14T13:02:28.543288+0000","last_peered":"2024-09-14T13:02:28.543288+0000","last_clean":"2024-09-14T13:02:28.543288+0000","last_became_active":"2024-09-14T11:08:25.822047+0000","last_became_peered":"2024-09-14T11:08:25.822047+0000","last_unstale":"2024-09-14T13:02:28.543288+0000","last_undegraded":"2024-09-14T13:02:28.543288+0000","last_fullsized":"2024-09-14T13:02:28.543288+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T13:02:28.542945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T13:02:28.542945+0000","last_clean_scrub_stamp":"2024-09-14T13:02:28.542945+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:35:34.239314+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.19","version":"267'270","reported_seq":933,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:36.400848+0000","last_change":"2024-09-14T13:02:36.400848+0000","last_active":"2024-09-14T13:02:36.400848+0000","last_peered":"2024-09-14T13:02:36.400848+0000","last_clean":"2024-09-14T13:02:36.400848+0000","last_became_active":"2024-09-14T11:08:27.824464+0000","last_became_peered":"2024-09-14T11:08:27.824464+0000","last_unstale":"2024-09-14T13:02:36.400848+0000","last_undegraded":"2024-09-14T13:02:36.400848+0000","last_fullsized":"2024-09-14T13:02:36.400848+0000","mapping_epoch":30,"log_start":"267'200","ondisk_log_start":"267'200","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'270","last_scrub_stamp":"2024-09-14T13:02:36.400629+0000","last_deep_scrub":"267'270","last_deep_scrub_stamp":"2024-09-14T13:02:36.400629+0000","last_clean_scrub_stamp":"2024-09-14T13:02:36.400629+0000","objects_scrubbed":8,"log_size":70,"log_dups_size":200,"ondisk_log_size":70,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:44:26.595055+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12812,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":350,"num_read_kb":439,"num_write":214,"num_write_kb":32,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":531,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:35.129790+0000","last_change":"2024-09-14T13:02:35.129790+0000","last_active":"2024-09-14T13:02:35.129790+0000","last_peered":"2024-09-14T13:02:35.129790+0000","last_clean":"2024-09-14T13:02:35.129790+0000","last_became_active":"2024-09-14T11:08:29.822623+0000","last_became_peered":"2024-09-14T11:08:29.822623+0000","last_unstale":"2024-09-14T13:02:35.129790+0000","last_undegraded":"2024-09-14T13:02:35.129790+0000","last_fullsized":"2024-09-14T13:02:35.129790+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T13:02:35.129616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T13:02:35.129616+0000","last_clean_scrub_stamp":"2024-09-14T13:02:35.129616+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:00:13.553426+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.17","version":"267'129","reported_seq":664,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:41.608185+0000","last_change":"2024-09-14T13:02:41.608185+0000","last_active":"2024-09-14T13:02:41.608185+0000","last_peered":"2024-09-14T13:02:41.608185+0000","last_clean":"2024-09-14T13:02:41.608185+0000","last_became_active":"2024-09-14T11:08:31.858388+0000","last_became_peered":"2024-09-14T11:08:31.858388+0000","last_unstale":"2024-09-14T13:02:41.608185+0000","last_undegraded":"2024-09-14T13:02:41.608185+0000","last_fullsized":"2024-09-14T13:02:41.608185+0000","mapping_epoch":34,"log_start":"267'100","ondisk_log_start":"267'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'129","last_scrub_stamp":"2024-09-14T13:02:41.607983+0000","last_deep_scrub":"267'129","last_deep_scrub_stamp":"2024-09-14T13:02:41.607983+0000","last_clean_scrub_stamp":"2024-09-14T13:02:41.607983+0000","objects_scrubbed":2,"log_size":29,"log_dups_size":100,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:09:12.823499+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":200,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":125,"num_read_kb":119,"num_write":310,"num_write_kb":73,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1a","version":"267'853","reported_seq":2581,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:17.761142+0000","last_change":"2024-09-14T13:02:17.760990+0000","last_active":"2024-09-14T13:02:17.761142+0000","last_peered":"2024-09-14T13:02:17.761142+0000","last_clean":"2024-09-14T13:02:17.761142+0000","last_became_active":"2024-09-14T11:08:23.793908+0000","last_became_peered":"2024-09-14T11:08:23.793908+0000","last_unstale":"2024-09-14T13:02:17.761142+0000","last_undegraded":"2024-09-14T13:02:17.761142+0000","last_fullsized":"2024-09-14T13:02:17.761142+0000","mapping_epoch":26,"log_start":"267'800","ondisk_log_start":"267'800","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'853","last_scrub_stamp":"2024-09-14T13:02:17.760808+0000","last_deep_scrub":"267'853","last_deep_scrub_stamp":"2024-09-14T13:02:17.760808+0000","last_clean_scrub_stamp":"2024-09-14T13:02:17.760808+0000","objects_scrubbed":2,"log_size":53,"log_dups_size":800,"ondisk_log_size":53,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:38:18.530322+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":4233,"num_read_kb":3837,"num_write":1135,"num_write_kb":419,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2551,"num_omap_keys":10,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1d","version":"267'248","reported_seq":938,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:12.369153+0000","last_change":"2024-09-14T13:02:12.368968+0000","last_active":"2024-09-14T13:02:12.369153+0000","last_peered":"2024-09-14T13:02:12.369153+0000","last_clean":"2024-09-14T13:02:12.369153+0000","last_became_active":"2024-09-14T11:08:21.820805+0000","last_became_peered":"2024-09-14T11:08:21.820805+0000","last_unstale":"2024-09-14T13:02:12.369153+0000","last_undegraded":"2024-09-14T13:02:12.369153+0000","last_fullsized":"2024-09-14T13:02:12.369153+0000","mapping_epoch":24,"log_start":"267'200","ondisk_log_start":"267'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'248","last_scrub_stamp":"2024-09-14T13:02:12.368755+0000","last_deep_scrub":"267'248","last_deep_scrub_stamp":"2024-09-14T13:02:12.368755+0000","last_clean_scrub_stamp":"2024-09-14T13:02:12.368755+0000","objects_scrubbed":3,"log_size":48,"log_dups_size":200,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:45:17.694226+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":55,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":696,"num_read_kb":13918,"num_write":1169,"num_write_kb":29151,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":533,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:33.407411+0000","last_change":"2024-09-14T13:02:33.407269+0000","last_active":"2024-09-14T13:02:33.407411+0000","last_peered":"2024-09-14T13:02:33.407411+0000","last_clean":"2024-09-14T13:02:33.407411+0000","last_became_active":"2024-09-14T11:08:25.801548+0000","last_became_peered":"2024-09-14T11:08:25.801548+0000","last_unstale":"2024-09-14T13:02:33.407411+0000","last_undegraded":"2024-09-14T13:02:33.407411+0000","last_fullsized":"2024-09-14T13:02:33.407411+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T13:02:33.407066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T13:02:33.407066+0000","last_clean_scrub_stamp":"2024-09-14T13:02:33.407066+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:48:43.308728+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.18","version":"267'183","reported_seq":815,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:28.000513+0000","last_change":"2024-09-14T13:02:28.000513+0000","last_active":"2024-09-14T13:02:28.000513+0000","last_peered":"2024-09-14T13:02:28.000513+0000","last_clean":"2024-09-14T13:02:28.000513+0000","last_became_active":"2024-09-14T11:08:27.814938+0000","last_became_peered":"2024-09-14T11:08:27.814938+0000","last_unstale":"2024-09-14T13:02:28.000513+0000","last_undegraded":"2024-09-14T13:02:28.000513+0000","last_fullsized":"2024-09-14T13:02:28.000513+0000","mapping_epoch":30,"log_start":"264'100","ondisk_log_start":"264'100","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'183","last_scrub_stamp":"2024-09-14T13:02:28.000240+0000","last_deep_scrub":"267'183","last_deep_scrub_stamp":"2024-09-14T13:02:28.000240+0000","last_clean_scrub_stamp":"2024-09-14T13:02:28.000240+0000","objects_scrubbed":4,"log_size":83,"log_dups_size":100,"ondisk_log_size":83,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:11:21.026195+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":31231,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":239,"num_read_kb":376,"num_write":138,"num_write_kb":54,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":525,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:28.223406+0000","last_change":"2024-09-14T13:02:28.223264+0000","last_active":"2024-09-14T13:02:28.223406+0000","last_peered":"2024-09-14T13:02:28.223406+0000","last_clean":"2024-09-14T13:02:28.223406+0000","last_became_active":"2024-09-14T11:08:29.829491+0000","last_became_peered":"2024-09-14T11:08:29.829491+0000","last_unstale":"2024-09-14T13:02:28.223406+0000","last_undegraded":"2024-09-14T13:02:28.223406+0000","last_fullsized":"2024-09-14T13:02:28.223406+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T13:02:28.223080+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T13:02:28.223080+0000","last_clean_scrub_stamp":"2024-09-14T13:02:28.223080+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:42:17.487239+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.16","version":"267'129","reported_seq":692,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:42.977781+0000","last_change":"2024-09-14T13:02:42.977781+0000","last_active":"2024-09-14T13:02:42.977781+0000","last_peered":"2024-09-14T13:02:42.977781+0000","last_clean":"2024-09-14T13:02:42.977781+0000","last_became_active":"2024-09-14T11:08:31.832264+0000","last_became_peered":"2024-09-14T11:08:31.832264+0000","last_unstale":"2024-09-14T13:02:42.977781+0000","last_undegraded":"2024-09-14T13:02:42.977781+0000","last_fullsized":"2024-09-14T13:02:42.977781+0000","mapping_epoch":34,"log_start":"267'100","ondisk_log_start":"267'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'129","last_scrub_stamp":"2024-09-14T13:02:42.977606+0000","last_deep_scrub":"267'129","last_deep_scrub_stamp":"2024-09-14T13:02:42.977606+0000","last_clean_scrub_stamp":"2024-09-14T13:02:42.977606+0000","objects_scrubbed":1,"log_size":29,"log_dups_size":100,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:40:45.314824+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":539,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":196,"num_read_kb":188,"num_write":306,"num_write_kb":70,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"267'841","reported_seq":2525,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:18.906574+0000","last_change":"2024-09-14T13:02:18.906417+0000","last_active":"2024-09-14T13:02:18.906574+0000","last_peered":"2024-09-14T13:02:18.906574+0000","last_clean":"2024-09-14T13:02:18.906574+0000","last_became_active":"2024-09-14T11:08:23.781730+0000","last_became_peered":"2024-09-14T11:08:23.781730+0000","last_unstale":"2024-09-14T13:02:18.906574+0000","last_undegraded":"2024-09-14T13:02:18.906574+0000","last_fullsized":"2024-09-14T13:02:18.906574+0000","mapping_epoch":26,"log_start":"267'800","ondisk_log_start":"267'800","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'841","last_scrub_stamp":"2024-09-14T13:02:18.906239+0000","last_deep_scrub":"267'841","last_deep_scrub_stamp":"2024-09-14T13:02:18.906239+0000","last_clean_scrub_stamp":"2024-09-14T13:02:18.906239+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":800,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:22:02.089304+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3990,"num_read_kb":3619,"num_write":1102,"num_write_kb":388,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"267'187","reported_seq":836,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:10.973597+0000","last_change":"2024-09-14T13:02:10.973427+0000","last_active":"2024-09-14T13:02:10.973597+0000","last_peered":"2024-09-14T13:02:10.973597+0000","last_clean":"2024-09-14T13:02:10.973597+0000","last_became_active":"2024-09-14T11:08:21.809457+0000","last_became_peered":"2024-09-14T11:08:21.809457+0000","last_unstale":"2024-09-14T13:02:10.973597+0000","last_undegraded":"2024-09-14T13:02:10.973597+0000","last_fullsized":"2024-09-14T13:02:10.973597+0000","mapping_epoch":24,"log_start":"267'100","ondisk_log_start":"267'100","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'187","last_scrub_stamp":"2024-09-14T13:02:10.973179+0000","last_deep_scrub":"267'187","last_deep_scrub_stamp":"2024-09-14T13:02:10.973179+0000","last_clean_scrub_stamp":"2024-09-14T13:02:10.973179+0000","objects_scrubbed":2,"log_size":87,"log_dups_size":100,"ondisk_log_size":87,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:00:13.783400+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":26,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":452,"num_read_kb":5598,"num_write":898,"num_write_kb":20482,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6,7],"acting":[3,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":536,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:27.675224+0000","last_change":"2024-09-14T13:02:27.675224+0000","last_active":"2024-09-14T13:02:27.675224+0000","last_peered":"2024-09-14T13:02:27.675224+0000","last_clean":"2024-09-14T13:02:27.675224+0000","last_became_active":"2024-09-14T11:08:25.805777+0000","last_became_peered":"2024-09-14T11:08:25.805777+0000","last_unstale":"2024-09-14T13:02:27.675224+0000","last_undegraded":"2024-09-14T13:02:27.675224+0000","last_fullsized":"2024-09-14T13:02:27.675224+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T13:02:27.675019+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T13:02:27.675019+0000","last_clean_scrub_stamp":"2024-09-14T13:02:27.675019+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:33:44.670317+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1b","version":"267'125","reported_seq":727,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:32.892365+0000","last_change":"2024-09-14T13:02:32.892063+0000","last_active":"2024-09-14T13:02:32.892365+0000","last_peered":"2024-09-14T13:02:32.892365+0000","last_clean":"2024-09-14T13:02:32.892365+0000","last_became_active":"2024-09-14T11:08:27.822465+0000","last_became_peered":"2024-09-14T11:08:27.822465+0000","last_unstale":"2024-09-14T13:02:32.892365+0000","last_undegraded":"2024-09-14T13:02:32.892365+0000","last_fullsized":"2024-09-14T13:02:32.892365+0000","mapping_epoch":30,"log_start":"267'100","ondisk_log_start":"267'100","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'125","last_scrub_stamp":"2024-09-14T13:02:32.891840+0000","last_deep_scrub":"267'125","last_deep_scrub_stamp":"2024-09-14T13:02:32.891840+0000","last_clean_scrub_stamp":"2024-09-14T13:02:32.891840+0000","objects_scrubbed":2,"log_size":25,"log_dups_size":100,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:18:10.544553+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9872,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":162,"num_read_kb":232,"num_write":86,"num_write_kb":20,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":526,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:36.698390+0000","last_change":"2024-09-14T13:02:36.698390+0000","last_active":"2024-09-14T13:02:36.698390+0000","last_peered":"2024-09-14T13:02:36.698390+0000","last_clean":"2024-09-14T13:02:36.698390+0000","last_became_active":"2024-09-14T11:08:29.831394+0000","last_became_peered":"2024-09-14T11:08:29.831394+0000","last_unstale":"2024-09-14T13:02:36.698390+0000","last_undegraded":"2024-09-14T13:02:36.698390+0000","last_fullsized":"2024-09-14T13:02:36.698390+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T13:02:36.698177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T13:02:36.698177+0000","last_clean_scrub_stamp":"2024-09-14T13:02:36.698177+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:22:59.122651+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.15","version":"267'191","reported_seq":1336,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:39.517014+0000","last_change":"2024-09-14T13:02:39.517014+0000","last_active":"2024-09-14T13:02:39.517014+0000","last_peered":"2024-09-14T13:02:39.517014+0000","last_clean":"2024-09-14T13:02:39.517014+0000","last_became_active":"2024-09-14T11:08:31.837288+0000","last_became_peered":"2024-09-14T11:08:31.837288+0000","last_unstale":"2024-09-14T13:02:39.517014+0000","last_undegraded":"2024-09-14T13:02:39.517014+0000","last_fullsized":"2024-09-14T13:02:39.517014+0000","mapping_epoch":34,"log_start":"267'100","ondisk_log_start":"267'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'191","last_scrub_stamp":"2024-09-14T13:02:39.516820+0000","last_deep_scrub":"267'191","last_deep_scrub_stamp":"2024-09-14T13:02:39.516820+0000","last_clean_scrub_stamp":"2024-09-14T13:02:39.516820+0000","objects_scrubbed":5,"log_size":91,"log_dups_size":100,"ondisk_log_size":91,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:51:46.141392+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":649,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":776,"num_read_kb":767,"num_write":406,"num_write_kb":131,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.18","version":"267'751","reported_seq":2363,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:16.798485+0000","last_change":"2024-09-14T13:02:16.798485+0000","last_active":"2024-09-14T13:02:16.798485+0000","last_peered":"2024-09-14T13:02:16.798485+0000","last_clean":"2024-09-14T13:02:16.798485+0000","last_became_active":"2024-09-14T11:08:23.806640+0000","last_became_peered":"2024-09-14T11:08:23.806640+0000","last_unstale":"2024-09-14T13:02:16.798485+0000","last_undegraded":"2024-09-14T13:02:16.798485+0000","last_fullsized":"2024-09-14T13:02:16.798485+0000","mapping_epoch":26,"log_start":"267'700","ondisk_log_start":"267'700","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'751","last_scrub_stamp":"2024-09-14T13:02:16.798298+0000","last_deep_scrub":"267'751","last_deep_scrub_stamp":"2024-09-14T13:02:16.798298+0000","last_clean_scrub_stamp":"2024-09-14T13:02:16.798298+0000","objects_scrubbed":1,"log_size":51,"log_dups_size":700,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:34:05.343127+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3938,"num_read_kb":3591,"num_write":982,"num_write_kb":355,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":244,"num_omap_keys":1,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1f","version":"267'170","reported_seq":848,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:10.102344+0000","last_change":"2024-09-14T13:02:10.102208+0000","last_active":"2024-09-14T13:02:10.102344+0000","last_peered":"2024-09-14T13:02:10.102344+0000","last_clean":"2024-09-14T13:02:10.102344+0000","last_became_active":"2024-09-14T11:08:21.801111+0000","last_became_peered":"2024-09-14T11:08:21.801111+0000","last_unstale":"2024-09-14T13:02:10.102344+0000","last_undegraded":"2024-09-14T13:02:10.102344+0000","last_fullsized":"2024-09-14T13:02:10.102344+0000","mapping_epoch":24,"log_start":"267'100","ondisk_log_start":"267'100","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'170","last_scrub_stamp":"2024-09-14T13:02:10.102000+0000","last_deep_scrub":"267'170","last_deep_scrub_stamp":"2024-09-14T13:02:10.102000+0000","last_clean_scrub_stamp":"2024-09-14T13:02:10.102000+0000","objects_scrubbed":1,"log_size":70,"log_dups_size":100,"ondisk_log_size":70,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:52:37.683920+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":26,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":489,"num_read_kb":60837,"num_write":760,"num_write_kb":39194,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,6],"acting":[0,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.19","version":"267'2","reported_seq":534,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:24.003466+0000","last_change":"2024-09-14T13:02:24.003466+0000","last_active":"2024-09-14T13:02:24.003466+0000","last_peered":"2024-09-14T13:02:24.003466+0000","last_clean":"2024-09-14T13:02:24.003466+0000","last_became_active":"2024-09-14T11:08:25.799872+0000","last_became_peered":"2024-09-14T11:08:25.799872+0000","last_unstale":"2024-09-14T13:02:24.003466+0000","last_undegraded":"2024-09-14T13:02:24.003466+0000","last_fullsized":"2024-09-14T13:02:24.003466+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'2","last_scrub_stamp":"2024-09-14T13:02:24.003237+0000","last_deep_scrub":"267'2","last_deep_scrub_stamp":"2024-09-14T13:02:24.003237+0000","last_clean_scrub_stamp":"2024-09-14T13:02:24.003237+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:21:44.974939+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1a","version":"267'192","reported_seq":836,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:32.705662+0000","last_change":"2024-09-14T13:02:32.705517+0000","last_active":"2024-09-14T13:02:32.705662+0000","last_peered":"2024-09-14T13:02:32.705662+0000","last_clean":"2024-09-14T13:02:32.705662+0000","last_became_active":"2024-09-14T11:08:27.830707+0000","last_became_peered":"2024-09-14T11:08:27.830707+0000","last_unstale":"2024-09-14T13:02:32.705662+0000","last_undegraded":"2024-09-14T13:02:32.705662+0000","last_fullsized":"2024-09-14T13:02:32.705662+0000","mapping_epoch":30,"log_start":"264'100","ondisk_log_start":"264'100","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'192","last_scrub_stamp":"2024-09-14T13:02:32.705316+0000","last_deep_scrub":"267'192","last_deep_scrub_stamp":"2024-09-14T13:02:32.705316+0000","last_clean_scrub_stamp":"2024-09-14T13:02:32.705316+0000","objects_scrubbed":4,"log_size":92,"log_dups_size":100,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:21:58.094806+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8430,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":268,"num_read_kb":336,"num_write":152,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":529,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:36.162728+0000","last_change":"2024-09-14T13:02:36.162728+0000","last_active":"2024-09-14T13:02:36.162728+0000","last_peered":"2024-09-14T13:02:36.162728+0000","last_clean":"2024-09-14T13:02:36.162728+0000","last_became_active":"2024-09-14T11:08:29.810292+0000","last_became_peered":"2024-09-14T11:08:29.810292+0000","last_unstale":"2024-09-14T13:02:36.162728+0000","last_undegraded":"2024-09-14T13:02:36.162728+0000","last_fullsized":"2024-09-14T13:02:36.162728+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T13:02:36.162509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T13:02:36.162509+0000","last_clean_scrub_stamp":"2024-09-14T13:02:36.162509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T00:17:40.871354+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.14","version":"267'136","reported_seq":672,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:38.671315+0000","last_change":"2024-09-14T13:02:38.671148+0000","last_active":"2024-09-14T13:02:38.671315+0000","last_peered":"2024-09-14T13:02:38.671315+0000","last_clean":"2024-09-14T13:02:38.671315+0000","last_became_active":"2024-09-14T11:08:31.851483+0000","last_became_peered":"2024-09-14T11:08:31.851483+0000","last_unstale":"2024-09-14T13:02:38.671315+0000","last_undegraded":"2024-09-14T13:02:38.671315+0000","last_fullsized":"2024-09-14T13:02:38.671315+0000","mapping_epoch":34,"log_start":"267'100","ondisk_log_start":"267'100","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'136","last_scrub_stamp":"2024-09-14T13:02:38.670955+0000","last_deep_scrub":"267'136","last_deep_scrub_stamp":"2024-09-14T13:02:38.670955+0000","last_clean_scrub_stamp":"2024-09-14T13:02:38.670955+0000","objects_scrubbed":3,"log_size":36,"log_dups_size":100,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:31:36.294487+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":227,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":142,"num_read_kb":127,"num_write":323,"num_write_kb":76,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.27","version":"267'1176","reported_seq":2964,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:19.058691+0000","last_change":"2024-09-14T13:02:19.058530+0000","last_active":"2024-09-14T13:02:19.058691+0000","last_peered":"2024-09-14T13:02:19.058691+0000","last_clean":"2024-09-14T13:02:19.058691+0000","last_became_active":"2024-09-14T11:08:23.798225+0000","last_became_peered":"2024-09-14T11:08:23.798225+0000","last_unstale":"2024-09-14T13:02:19.058691+0000","last_undegraded":"2024-09-14T13:02:19.058691+0000","last_fullsized":"2024-09-14T13:02:19.058691+0000","mapping_epoch":26,"log_start":"267'1100","ondisk_log_start":"267'1100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'1176","last_scrub_stamp":"2024-09-14T13:02:19.058334+0000","last_deep_scrub":"267'1176","last_deep_scrub_stamp":"2024-09-14T13:02:19.058334+0000","last_clean_scrub_stamp":"2024-09-14T13:02:19.058334+0000","objects_scrubbed":2,"log_size":76,"log_dups_size":1100,"ondisk_log_size":76,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:40:22.783461+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":5564,"num_read_kb":4974,"num_write":1578,"num_write_kb":634,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2045,"num_omap_keys":8,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.20","version":"267'242","reported_seq":1004,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:12.288437+0000","last_change":"2024-09-14T13:02:12.288173+0000","last_active":"2024-09-14T13:02:12.288437+0000","last_peered":"2024-09-14T13:02:12.288437+0000","last_clean":"2024-09-14T13:02:12.288437+0000","last_became_active":"2024-09-14T11:08:21.816270+0000","last_became_peered":"2024-09-14T11:08:21.816270+0000","last_unstale":"2024-09-14T13:02:12.288437+0000","last_undegraded":"2024-09-14T13:02:12.288437+0000","last_fullsized":"2024-09-14T13:02:12.288437+0000","mapping_epoch":24,"log_start":"267'200","ondisk_log_start":"267'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'242","last_scrub_stamp":"2024-09-14T13:02:12.287850+0000","last_deep_scrub":"267'242","last_deep_scrub_stamp":"2024-09-14T13:02:12.287850+0000","last_clean_scrub_stamp":"2024-09-14T13:02:12.287850+0000","objects_scrubbed":1,"log_size":42,"log_dups_size":200,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:26:32.484498+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":896,"num_read_kb":196583,"num_write":965,"num_write_kb":33610,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,7],"acting":[6,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.26","version":"267'1295","reported_seq":2914,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:22.003013+0000","last_change":"2024-09-14T13:02:22.002876+0000","last_active":"2024-09-14T13:02:22.003013+0000","last_peered":"2024-09-14T13:02:22.003013+0000","last_clean":"2024-09-14T13:02:22.003013+0000","last_became_active":"2024-09-14T11:08:23.776349+0000","last_became_peered":"2024-09-14T11:08:23.776349+0000","last_unstale":"2024-09-14T13:02:22.003013+0000","last_undegraded":"2024-09-14T13:02:22.003013+0000","last_fullsized":"2024-09-14T13:02:22.003013+0000","mapping_epoch":26,"log_start":"267'1200","ondisk_log_start":"267'1200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'1295","last_scrub_stamp":"2024-09-14T13:02:22.002702+0000","last_deep_scrub":"267'1295","last_deep_scrub_stamp":"2024-09-14T13:02:22.002702+0000","last_clean_scrub_stamp":"2024-09-14T13:02:22.002702+0000","objects_scrubbed":3,"log_size":95,"log_dups_size":1200,"ondisk_log_size":95,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:05:44.720042+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":5862,"num_read_kb":5174,"num_write":1823,"num_write_kb":798,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.21","version":"267'158","reported_seq":805,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:10.134206+0000","last_change":"2024-09-14T13:02:10.134026+0000","last_active":"2024-09-14T13:02:10.134206+0000","last_peered":"2024-09-14T13:02:10.134206+0000","last_clean":"2024-09-14T13:02:10.134206+0000","last_became_active":"2024-09-14T11:08:21.778857+0000","last_became_peered":"2024-09-14T11:08:21.778857+0000","last_unstale":"2024-09-14T13:02:10.134206+0000","last_undegraded":"2024-09-14T13:02:10.134206+0000","last_fullsized":"2024-09-14T13:02:10.134206+0000","mapping_epoch":24,"log_start":"267'100","ondisk_log_start":"267'100","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'158","last_scrub_stamp":"2024-09-14T13:02:10.133843+0000","last_deep_scrub":"267'158","last_deep_scrub_stamp":"2024-09-14T13:02:10.133843+0000","last_clean_scrub_stamp":"2024-09-14T13:02:10.133843+0000","objects_scrubbed":0,"log_size":58,"log_dups_size":100,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:18:15.041071+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":436,"num_read_kb":8582,"num_write":806,"num_write_kb":19268,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,6],"acting":[2,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.25","version":"267'859","reported_seq":2590,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:25.484618+0000","last_change":"2024-09-14T13:02:25.484480+0000","last_active":"2024-09-14T13:02:25.484618+0000","last_peered":"2024-09-14T13:02:25.484618+0000","last_clean":"2024-09-14T13:02:25.484618+0000","last_became_active":"2024-09-14T11:08:23.808906+0000","last_became_peered":"2024-09-14T11:08:23.808906+0000","last_unstale":"2024-09-14T13:02:25.484618+0000","last_undegraded":"2024-09-14T13:02:25.484618+0000","last_fullsized":"2024-09-14T13:02:25.484618+0000","mapping_epoch":26,"log_start":"267'800","ondisk_log_start":"267'800","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'859","last_scrub_stamp":"2024-09-14T13:02:25.484273+0000","last_deep_scrub":"267'859","last_deep_scrub_stamp":"2024-09-14T13:02:25.484273+0000","last_clean_scrub_stamp":"2024-09-14T13:02:25.484273+0000","objects_scrubbed":3,"log_size":59,"log_dups_size":800,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:24:01.661481+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":4244,"num_read_kb":3835,"num_write":1129,"num_write_kb":418,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1533,"num_omap_keys":6,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.22","version":"267'246","reported_seq":964,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:13.387496+0000","last_change":"2024-09-14T13:02:13.387255+0000","last_active":"2024-09-14T13:02:13.387496+0000","last_peered":"2024-09-14T13:02:13.387496+0000","last_clean":"2024-09-14T13:02:13.387496+0000","last_became_active":"2024-09-14T11:08:21.795735+0000","last_became_peered":"2024-09-14T11:08:21.795735+0000","last_unstale":"2024-09-14T13:02:13.387496+0000","last_undegraded":"2024-09-14T13:02:13.387496+0000","last_fullsized":"2024-09-14T13:02:13.387496+0000","mapping_epoch":24,"log_start":"267'200","ondisk_log_start":"267'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'246","last_scrub_stamp":"2024-09-14T13:02:13.387035+0000","last_deep_scrub":"267'246","last_deep_scrub_stamp":"2024-09-14T13:02:13.387035+0000","last_clean_scrub_stamp":"2024-09-14T13:02:13.387035+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":200,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:34:00.780296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":704,"num_read_kb":92956,"num_write":1120,"num_write_kb":50908,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,0],"acting":[5,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.24","version":"267'426","reported_seq":2064,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:18.062374+0000","last_change":"2024-09-14T13:02:18.062230+0000","last_active":"2024-09-14T13:02:18.062374+0000","last_peered":"2024-09-14T13:02:18.062374+0000","last_clean":"2024-09-14T13:02:18.062374+0000","last_became_active":"2024-09-14T11:08:23.800722+0000","last_became_peered":"2024-09-14T11:08:23.800722+0000","last_unstale":"2024-09-14T13:02:18.062374+0000","last_undegraded":"2024-09-14T13:02:18.062374+0000","last_fullsized":"2024-09-14T13:02:18.062374+0000","mapping_epoch":26,"log_start":"267'400","ondisk_log_start":"267'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'426","last_scrub_stamp":"2024-09-14T13:02:18.062016+0000","last_deep_scrub":"267'426","last_deep_scrub_stamp":"2024-09-14T13:02:18.062016+0000","last_clean_scrub_stamp":"2024-09-14T13:02:18.062016+0000","objects_scrubbed":2,"log_size":26,"log_dups_size":400,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:49:37.783760+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2360,"num_read_kb":2243,"num_write":502,"num_write_kb":106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":252,"num_omap_keys":1,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.23","version":"267'220","reported_seq":903,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:08.038503+0000","last_change":"2024-09-14T13:02:08.038394+0000","last_active":"2024-09-14T13:02:08.038503+0000","last_peered":"2024-09-14T13:02:08.038503+0000","last_clean":"2024-09-14T13:02:08.038503+0000","last_became_active":"2024-09-14T11:08:21.815676+0000","last_became_peered":"2024-09-14T11:08:21.815676+0000","last_unstale":"2024-09-14T13:02:08.038503+0000","last_undegraded":"2024-09-14T13:02:08.038503+0000","last_fullsized":"2024-09-14T13:02:08.038503+0000","mapping_epoch":24,"log_start":"267'200","ondisk_log_start":"267'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'220","last_scrub_stamp":"2024-09-14T13:02:08.038198+0000","last_deep_scrub":"267'220","last_deep_scrub_stamp":"2024-09-14T13:02:08.038198+0000","last_clean_scrub_stamp":"2024-09-14T13:02:08.038198+0000","objects_scrubbed":2,"log_size":20,"log_dups_size":200,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:18:15.605049+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1655835,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":599,"num_read_kb":27875,"num_write":904,"num_write_kb":22739,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"267'896","reported_seq":2689,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:21.907435+0000","last_change":"2024-09-14T13:02:21.907268+0000","last_active":"2024-09-14T13:02:21.907435+0000","last_peered":"2024-09-14T13:02:21.907435+0000","last_clean":"2024-09-14T13:02:21.907435+0000","last_became_active":"2024-09-14T11:08:23.801373+0000","last_became_peered":"2024-09-14T11:08:23.801373+0000","last_unstale":"2024-09-14T13:02:21.907435+0000","last_undegraded":"2024-09-14T13:02:21.907435+0000","last_fullsized":"2024-09-14T13:02:21.907435+0000","mapping_epoch":26,"log_start":"267'800","ondisk_log_start":"267'800","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'896","last_scrub_stamp":"2024-09-14T13:02:21.907091+0000","last_deep_scrub":"267'896","last_deep_scrub_stamp":"2024-09-14T13:02:21.907091+0000","last_clean_scrub_stamp":"2024-09-14T13:02:21.907091+0000","objects_scrubbed":2,"log_size":96,"log_dups_size":800,"ondisk_log_size":96,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:05:33.862894+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":4489,"num_read_kb":4053,"num_write":1182,"num_write_kb":453,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2299,"num_omap_keys":9,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.24","version":"267'181","reported_seq":865,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:13.912598+0000","last_change":"2024-09-14T13:02:13.912432+0000","last_active":"2024-09-14T13:02:13.912598+0000","last_peered":"2024-09-14T13:02:13.912598+0000","last_clean":"2024-09-14T13:02:13.912598+0000","last_became_active":"2024-09-14T11:08:21.815768+0000","last_became_peered":"2024-09-14T11:08:21.815768+0000","last_unstale":"2024-09-14T13:02:13.912598+0000","last_undegraded":"2024-09-14T13:02:13.912598+0000","last_fullsized":"2024-09-14T13:02:13.912598+0000","mapping_epoch":24,"log_start":"267'100","ondisk_log_start":"267'100","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'181","last_scrub_stamp":"2024-09-14T13:02:13.912218+0000","last_deep_scrub":"267'181","last_deep_scrub_stamp":"2024-09-14T13:02:13.912218+0000","last_clean_scrub_stamp":"2024-09-14T13:02:13.912218+0000","objects_scrubbed":2,"log_size":81,"log_dups_size":100,"ondisk_log_size":81,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:34:44.221033+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":52,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":600,"num_read_kb":27323,"num_write":897,"num_write_kb":11503,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,0],"acting":[3,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"267'442","reported_seq":2007,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:19.739977+0000","last_change":"2024-09-14T13:02:19.739812+0000","last_active":"2024-09-14T13:02:19.739977+0000","last_peered":"2024-09-14T13:02:19.739977+0000","last_clean":"2024-09-14T13:02:19.739977+0000","last_became_active":"2024-09-14T11:08:23.814703+0000","last_became_peered":"2024-09-14T11:08:23.814703+0000","last_unstale":"2024-09-14T13:02:19.739977+0000","last_undegraded":"2024-09-14T13:02:19.739977+0000","last_fullsized":"2024-09-14T13:02:19.739977+0000","mapping_epoch":26,"log_start":"267'400","ondisk_log_start":"267'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'442","last_scrub_stamp":"2024-09-14T13:02:19.739631+0000","last_deep_scrub":"267'442","last_deep_scrub_stamp":"2024-09-14T13:02:19.739631+0000","last_clean_scrub_stamp":"2024-09-14T13:02:19.739631+0000","objects_scrubbed":1,"log_size":42,"log_dups_size":400,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:51:34.828557+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2315,"num_read_kb":2173,"num_write":509,"num_write_kb":111,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.25","version":"267'228","reported_seq":885,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:14.008565+0000","last_change":"2024-09-14T13:02:14.008418+0000","last_active":"2024-09-14T13:02:14.008565+0000","last_peered":"2024-09-14T13:02:14.008565+0000","last_clean":"2024-09-14T13:02:14.008565+0000","last_became_active":"2024-09-14T11:08:21.782389+0000","last_became_peered":"2024-09-14T11:08:21.782389+0000","last_unstale":"2024-09-14T13:02:14.008565+0000","last_undegraded":"2024-09-14T13:02:14.008565+0000","last_fullsized":"2024-09-14T13:02:14.008565+0000","mapping_epoch":24,"log_start":"267'200","ondisk_log_start":"267'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'228","last_scrub_stamp":"2024-09-14T13:02:14.008210+0000","last_deep_scrub":"267'228","last_deep_scrub_stamp":"2024-09-14T13:02:14.008210+0000","last_clean_scrub_stamp":"2024-09-14T13:02:14.008210+0000","objects_scrubbed":1,"log_size":28,"log_dups_size":200,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:24:23.674651+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":471,"num_read_kb":9844,"num_write":870,"num_write_kb":38372,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"267'1243","reported_seq":2977,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:19.913197+0000","last_change":"2024-09-14T13:02:19.912958+0000","last_active":"2024-09-14T13:02:19.913197+0000","last_peered":"2024-09-14T13:02:19.913197+0000","last_clean":"2024-09-14T13:02:19.913197+0000","last_became_active":"2024-09-14T11:08:23.785820+0000","last_became_peered":"2024-09-14T11:08:23.785820+0000","last_unstale":"2024-09-14T13:02:19.913197+0000","last_undegraded":"2024-09-14T13:02:19.913197+0000","last_fullsized":"2024-09-14T13:02:19.913197+0000","mapping_epoch":26,"log_start":"267'1200","ondisk_log_start":"267'1200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'1243","last_scrub_stamp":"2024-09-14T13:02:19.912720+0000","last_deep_scrub":"267'1243","last_deep_scrub_stamp":"2024-09-14T13:02:19.912720+0000","last_clean_scrub_stamp":"2024-09-14T13:02:19.912720+0000","objects_scrubbed":2,"log_size":43,"log_dups_size":1200,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:30:14.834421+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":5731,"num_read_kb":5079,"num_write":1712,"num_write_kb":696,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"267'214","reported_seq":939,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:11.283819+0000","last_change":"2024-09-14T13:02:11.283668+0000","last_active":"2024-09-14T13:02:11.283819+0000","last_peered":"2024-09-14T13:02:11.283819+0000","last_clean":"2024-09-14T13:02:11.283819+0000","last_became_active":"2024-09-14T11:08:21.824946+0000","last_became_peered":"2024-09-14T11:08:21.824946+0000","last_unstale":"2024-09-14T13:02:11.283819+0000","last_undegraded":"2024-09-14T13:02:11.283819+0000","last_fullsized":"2024-09-14T13:02:11.283819+0000","mapping_epoch":24,"log_start":"267'200","ondisk_log_start":"267'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'214","last_scrub_stamp":"2024-09-14T13:02:11.283441+0000","last_deep_scrub":"267'214","last_deep_scrub_stamp":"2024-09-14T13:02:11.283441+0000","last_clean_scrub_stamp":"2024-09-14T13:02:11.283441+0000","objects_scrubbed":4,"log_size":14,"log_dups_size":200,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T00:21:45.775876+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1655864,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":770,"num_read_kb":179397,"num_write":979,"num_write_kb":35238,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,4],"acting":[6,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.20","version":"267'1216","reported_seq":2947,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:18.359938+0000","last_change":"2024-09-14T13:02:18.359791+0000","last_active":"2024-09-14T13:02:18.359938+0000","last_peered":"2024-09-14T13:02:18.359938+0000","last_clean":"2024-09-14T13:02:18.359938+0000","last_became_active":"2024-09-14T11:08:23.803960+0000","last_became_peered":"2024-09-14T11:08:23.803960+0000","last_unstale":"2024-09-14T13:02:18.359938+0000","last_undegraded":"2024-09-14T13:02:18.359938+0000","last_fullsized":"2024-09-14T13:02:18.359938+0000","mapping_epoch":26,"log_start":"267'1200","ondisk_log_start":"267'1200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'1216","last_scrub_stamp":"2024-09-14T13:02:18.359610+0000","last_deep_scrub":"267'1216","last_deep_scrub_stamp":"2024-09-14T13:02:18.359610+0000","last_clean_scrub_stamp":"2024-09-14T13:02:18.359610+0000","objects_scrubbed":2,"log_size":16,"log_dups_size":1200,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:52:39.823830+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":5500,"num_read_kb":4892,"num_write":1634,"num_write_kb":643,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"267'220","reported_seq":879,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:12.010009+0000","last_change":"2024-09-14T13:02:12.010009+0000","last_active":"2024-09-14T13:02:12.010009+0000","last_peered":"2024-09-14T13:02:12.010009+0000","last_clean":"2024-09-14T13:02:12.010009+0000","last_became_active":"2024-09-14T11:08:56.033948+0000","last_became_peered":"2024-09-14T11:08:56.033948+0000","last_unstale":"2024-09-14T13:02:12.010009+0000","last_undegraded":"2024-09-14T13:02:12.010009+0000","last_fullsized":"2024-09-14T13:02:12.010009+0000","mapping_epoch":37,"log_start":"267'200","ondisk_log_start":"267'200","created":24,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'220","last_scrub_stamp":"2024-09-14T13:02:12.009666+0000","last_deep_scrub":"267'220","last_deep_scrub_stamp":"2024-09-14T13:02:12.009666+0000","last_clean_scrub_stamp":"2024-09-14T13:02:12.009666+0000","objects_scrubbed":2,"log_size":20,"log_dups_size":200,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:53:42.148559+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":41,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":570,"num_read_kb":57833,"num_write":1049,"num_write_kb":21583,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,2],"acting":[1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2f","version":"267'434","reported_seq":2054,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:17.078698+0000","last_change":"2024-09-14T13:02:17.078542+0000","last_active":"2024-09-14T13:02:17.078698+0000","last_peered":"2024-09-14T13:02:17.078698+0000","last_clean":"2024-09-14T13:02:17.078698+0000","last_became_active":"2024-09-14T11:08:23.786094+0000","last_became_peered":"2024-09-14T11:08:23.786094+0000","last_unstale":"2024-09-14T13:02:17.078698+0000","last_undegraded":"2024-09-14T13:02:17.078698+0000","last_fullsized":"2024-09-14T13:02:17.078698+0000","mapping_epoch":26,"log_start":"267'400","ondisk_log_start":"267'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'434","last_scrub_stamp":"2024-09-14T13:02:17.078358+0000","last_deep_scrub":"267'434","last_deep_scrub_stamp":"2024-09-14T13:02:17.078358+0000","last_clean_scrub_stamp":"2024-09-14T13:02:17.078358+0000","objects_scrubbed":1,"log_size":34,"log_dups_size":400,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T00:39:36.056692+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2284,"num_read_kb":2174,"num_write":475,"num_write_kb":81,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.28","version":"267'239","reported_seq":919,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:15.368994+0000","last_change":"2024-09-14T13:02:15.368994+0000","last_active":"2024-09-14T13:02:15.368994+0000","last_peered":"2024-09-14T13:02:15.368994+0000","last_clean":"2024-09-14T13:02:15.368994+0000","last_became_active":"2024-09-14T11:08:21.789114+0000","last_became_peered":"2024-09-14T11:08:21.789114+0000","last_unstale":"2024-09-14T13:02:15.368994+0000","last_undegraded":"2024-09-14T13:02:15.368994+0000","last_fullsized":"2024-09-14T13:02:15.368994+0000","mapping_epoch":24,"log_start":"267'200","ondisk_log_start":"267'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'239","last_scrub_stamp":"2024-09-14T13:02:15.368736+0000","last_deep_scrub":"267'239","last_deep_scrub_stamp":"2024-09-14T13:02:15.368736+0000","last_clean_scrub_stamp":"2024-09-14T13:02:15.368736+0000","objects_scrubbed":1,"log_size":39,"log_dups_size":200,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:43:13.070998+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":15,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":593,"num_read_kb":44666,"num_write":1104,"num_write_kb":41456,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,2],"acting":[5,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2e","version":"267'453","reported_seq":2220,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:21.736863+0000","last_change":"2024-09-14T13:02:21.736679+0000","last_active":"2024-09-14T13:02:21.736863+0000","last_peered":"2024-09-14T13:02:21.736863+0000","last_clean":"2024-09-14T13:02:21.736863+0000","last_became_active":"2024-09-14T11:08:23.792081+0000","last_became_peered":"2024-09-14T11:08:23.792081+0000","last_unstale":"2024-09-14T13:02:21.736863+0000","last_undegraded":"2024-09-14T13:02:21.736863+0000","last_fullsized":"2024-09-14T13:02:21.736863+0000","mapping_epoch":26,"log_start":"267'400","ondisk_log_start":"267'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'453","last_scrub_stamp":"2024-09-14T13:02:21.736487+0000","last_deep_scrub":"267'453","last_deep_scrub_stamp":"2024-09-14T13:02:21.736487+0000","last_clean_scrub_stamp":"2024-09-14T13:02:21.736487+0000","objects_scrubbed":2,"log_size":53,"log_dups_size":400,"ondisk_log_size":53,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:03:31.698697+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2579,"num_read_kb":2481,"num_write":491,"num_write_kb":76,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":220,"num_omap_keys":1,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.29","version":"267'201","reported_seq":905,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:14.155576+0000","last_change":"2024-09-14T13:02:14.155576+0000","last_active":"2024-09-14T13:02:14.155576+0000","last_peered":"2024-09-14T13:02:14.155576+0000","last_clean":"2024-09-14T13:02:14.155576+0000","last_became_active":"2024-09-14T11:08:56.039007+0000","last_became_peered":"2024-09-14T11:08:56.039007+0000","last_unstale":"2024-09-14T13:02:14.155576+0000","last_undegraded":"2024-09-14T13:02:14.155576+0000","last_fullsized":"2024-09-14T13:02:14.155576+0000","mapping_epoch":37,"log_start":"267'100","ondisk_log_start":"267'100","created":24,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'201","last_scrub_stamp":"2024-09-14T13:02:14.155355+0000","last_deep_scrub":"267'201","last_deep_scrub_stamp":"2024-09-14T13:02:14.155355+0000","last_clean_scrub_stamp":"2024-09-14T13:02:14.155355+0000","objects_scrubbed":0,"log_size":101,"log_dups_size":100,"ondisk_log_size":101,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:51:47.112960+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":677,"num_read_kb":34418,"num_write":912,"num_write_kb":30711,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4,1],"acting":[2,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2d","version":"267'383","reported_seq":1953,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:16.174203+0000","last_change":"2024-09-14T13:02:16.174203+0000","last_active":"2024-09-14T13:02:16.174203+0000","last_peered":"2024-09-14T13:02:16.174203+0000","last_clean":"2024-09-14T13:02:16.174203+0000","last_became_active":"2024-09-14T11:08:23.806568+0000","last_became_peered":"2024-09-14T11:08:23.806568+0000","last_unstale":"2024-09-14T13:02:16.174203+0000","last_undegraded":"2024-09-14T13:02:16.174203+0000","last_fullsized":"2024-09-14T13:02:16.174203+0000","mapping_epoch":26,"log_start":"267'300","ondisk_log_start":"267'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'383","last_scrub_stamp":"2024-09-14T13:02:16.173997+0000","last_deep_scrub":"267'383","last_deep_scrub_stamp":"2024-09-14T13:02:16.173997+0000","last_clean_scrub_stamp":"2024-09-14T13:02:16.173997+0000","objects_scrubbed":1,"log_size":83,"log_dups_size":300,"ondisk_log_size":83,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:32:46.305855+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2181,"num_read_kb":2088,"num_write":442,"num_write_kb":83,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":244,"num_omap_keys":1,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2a","version":"267'214","reported_seq":859,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:16.413925+0000","last_change":"2024-09-14T13:02:16.413733+0000","last_active":"2024-09-14T13:02:16.413925+0000","last_peered":"2024-09-14T13:02:16.413925+0000","last_clean":"2024-09-14T13:02:16.413925+0000","last_became_active":"2024-09-14T11:08:55.882680+0000","last_became_peered":"2024-09-14T11:08:55.882680+0000","last_unstale":"2024-09-14T13:02:16.413925+0000","last_undegraded":"2024-09-14T13:02:16.413925+0000","last_fullsized":"2024-09-14T13:02:16.413925+0000","mapping_epoch":37,"log_start":"267'200","ondisk_log_start":"267'200","created":24,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'214","last_scrub_stamp":"2024-09-14T13:02:16.413519+0000","last_deep_scrub":"267'214","last_deep_scrub_stamp":"2024-09-14T13:02:16.413519+0000","last_clean_scrub_stamp":"2024-09-14T13:02:16.413519+0000","objects_scrubbed":3,"log_size":14,"log_dups_size":200,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:42:07.787664+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1655850,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":491,"num_read_kb":10245,"num_write":964,"num_write_kb":42313,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,1],"acting":[5,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2c","version":"267'620","reported_seq":2470,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:20.699706+0000","last_change":"2024-09-14T13:02:20.699544+0000","last_active":"2024-09-14T13:02:20.699706+0000","last_peered":"2024-09-14T13:02:20.699706+0000","last_clean":"2024-09-14T13:02:20.699706+0000","last_became_active":"2024-09-14T11:08:23.815121+0000","last_became_peered":"2024-09-14T11:08:23.815121+0000","last_unstale":"2024-09-14T13:02:20.699706+0000","last_undegraded":"2024-09-14T13:02:20.699706+0000","last_fullsized":"2024-09-14T13:02:20.699706+0000","mapping_epoch":26,"log_start":"267'600","ondisk_log_start":"267'600","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'620","last_scrub_stamp":"2024-09-14T13:02:20.699374+0000","last_deep_scrub":"267'620","last_deep_scrub_stamp":"2024-09-14T13:02:20.699374+0000","last_clean_scrub_stamp":"2024-09-14T13:02:20.699374+0000","objects_scrubbed":3,"log_size":20,"log_dups_size":600,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:26:58.705973+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3483,"num_read_kb":3244,"num_write":793,"num_write_kb":264,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2264,"num_omap_keys":9,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2b","version":"267'200","reported_seq":855,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:07.028411+0000","last_change":"2024-09-14T13:02:07.028318+0000","last_active":"2024-09-14T13:02:07.028411+0000","last_peered":"2024-09-14T13:02:07.028411+0000","last_clean":"2024-09-14T13:02:07.028411+0000","last_became_active":"2024-09-14T11:08:21.788281+0000","last_became_peered":"2024-09-14T11:08:21.788281+0000","last_unstale":"2024-09-14T13:02:07.028411+0000","last_undegraded":"2024-09-14T13:02:07.028411+0000","last_fullsized":"2024-09-14T13:02:07.028411+0000","mapping_epoch":24,"log_start":"267'100","ondisk_log_start":"267'100","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'200","last_scrub_stamp":"2024-09-14T13:02:07.028196+0000","last_deep_scrub":"267'200","last_deep_scrub_stamp":"2024-09-14T13:02:07.028196+0000","last_clean_scrub_stamp":"2024-09-14T13:02:07.028196+0000","objects_scrubbed":2,"log_size":100,"log_dups_size":100,"ondisk_log_size":100,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:49:29.752326+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":52,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":436,"num_read_kb":38929,"num_write":900,"num_write_kb":25858,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,1],"acting":[0,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2b","version":"267'916","reported_seq":2526,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:22.632644+0000","last_change":"2024-09-14T13:02:22.632478+0000","last_active":"2024-09-14T13:02:22.632644+0000","last_peered":"2024-09-14T13:02:22.632644+0000","last_clean":"2024-09-14T13:02:22.632644+0000","last_became_active":"2024-09-14T11:08:23.806952+0000","last_became_peered":"2024-09-14T11:08:23.806952+0000","last_unstale":"2024-09-14T13:02:22.632644+0000","last_undegraded":"2024-09-14T13:02:22.632644+0000","last_fullsized":"2024-09-14T13:02:22.632644+0000","mapping_epoch":26,"log_start":"267'900","ondisk_log_start":"267'900","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'916","last_scrub_stamp":"2024-09-14T13:02:22.632309+0000","last_deep_scrub":"267'916","last_deep_scrub_stamp":"2024-09-14T13:02:22.632309+0000","last_clean_scrub_stamp":"2024-09-14T13:02:22.632309+0000","objects_scrubbed":4,"log_size":16,"log_dups_size":900,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:53:03.488492+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":4419,"num_read_kb":3921,"num_write":1287,"num_write_kb":515,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":267,"num_omap_keys":1,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"267'231","reported_seq":914,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:13.270202+0000","last_change":"2024-09-14T13:02:13.270037+0000","last_active":"2024-09-14T13:02:13.270202+0000","last_peered":"2024-09-14T13:02:13.270202+0000","last_clean":"2024-09-14T13:02:13.270202+0000","last_became_active":"2024-09-14T11:08:21.836420+0000","last_became_peered":"2024-09-14T11:08:21.836420+0000","last_unstale":"2024-09-14T13:02:13.270202+0000","last_undegraded":"2024-09-14T13:02:13.270202+0000","last_fullsized":"2024-09-14T13:02:13.270202+0000","mapping_epoch":24,"log_start":"267'200","ondisk_log_start":"267'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'231","last_scrub_stamp":"2024-09-14T13:02:13.269834+0000","last_deep_scrub":"267'231","last_deep_scrub_stamp":"2024-09-14T13:02:13.269834+0000","last_clean_scrub_stamp":"2024-09-14T13:02:13.269834+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":200,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:47:11.483558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":678,"num_read_kb":43780,"num_write":1054,"num_write_kb":42822,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.2a","version":"267'459","reported_seq":2097,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:13.094412+0000","last_change":"2024-09-14T13:02:13.094279+0000","last_active":"2024-09-14T13:02:13.094412+0000","last_peered":"2024-09-14T13:02:13.094412+0000","last_clean":"2024-09-14T13:02:13.094412+0000","last_became_active":"2024-09-14T11:08:23.776554+0000","last_became_peered":"2024-09-14T11:08:23.776554+0000","last_unstale":"2024-09-14T13:02:13.094412+0000","last_undegraded":"2024-09-14T13:02:13.094412+0000","last_fullsized":"2024-09-14T13:02:13.094412+0000","mapping_epoch":26,"log_start":"267'400","ondisk_log_start":"267'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'459","last_scrub_stamp":"2024-09-14T13:02:13.094066+0000","last_deep_scrub":"267'459","last_deep_scrub_stamp":"2024-09-14T13:02:13.094066+0000","last_clean_scrub_stamp":"2024-09-14T13:02:13.094066+0000","objects_scrubbed":2,"log_size":59,"log_dups_size":400,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:03:41.733902+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2491,"num_read_kb":2349,"num_write":540,"num_write_kb":122,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2d","version":"267'208","reported_seq":864,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:15.639487+0000","last_change":"2024-09-14T13:02:15.639487+0000","last_active":"2024-09-14T13:02:15.639487+0000","last_peered":"2024-09-14T13:02:15.639487+0000","last_clean":"2024-09-14T13:02:15.639487+0000","last_became_active":"2024-09-14T11:08:21.828333+0000","last_became_peered":"2024-09-14T11:08:21.828333+0000","last_unstale":"2024-09-14T13:02:15.639487+0000","last_undegraded":"2024-09-14T13:02:15.639487+0000","last_fullsized":"2024-09-14T13:02:15.639487+0000","mapping_epoch":24,"log_start":"267'100","ondisk_log_start":"267'100","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'208","last_scrub_stamp":"2024-09-14T13:02:15.639239+0000","last_deep_scrub":"267'208","last_deep_scrub_stamp":"2024-09-14T13:02:15.639239+0000","last_clean_scrub_stamp":"2024-09-14T13:02:15.639239+0000","objects_scrubbed":2,"log_size":108,"log_dups_size":100,"ondisk_log_size":108,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:07:15.141985+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":26,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":514,"num_read_kb":35640,"num_write":904,"num_write_kb":31502,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,6],"acting":[7,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.29","version":"267'786","reported_seq":2518,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:28.948891+0000","last_change":"2024-09-14T13:02:28.948747+0000","last_active":"2024-09-14T13:02:28.948891+0000","last_peered":"2024-09-14T13:02:28.948891+0000","last_clean":"2024-09-14T13:02:28.948891+0000","last_became_active":"2024-09-14T11:08:23.783522+0000","last_became_peered":"2024-09-14T11:08:23.783522+0000","last_unstale":"2024-09-14T13:02:28.948891+0000","last_undegraded":"2024-09-14T13:02:28.948891+0000","last_fullsized":"2024-09-14T13:02:28.948891+0000","mapping_epoch":26,"log_start":"267'700","ondisk_log_start":"267'700","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'786","last_scrub_stamp":"2024-09-14T13:02:28.948565+0000","last_deep_scrub":"267'786","last_deep_scrub_stamp":"2024-09-14T13:02:28.948565+0000","last_clean_scrub_stamp":"2024-09-14T13:02:28.948565+0000","objects_scrubbed":3,"log_size":86,"log_dups_size":700,"ondisk_log_size":86,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T00:05:57.662593+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":4481,"num_read_kb":4083,"num_write":1109,"num_write_kb":423,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"267'190","reported_seq":884,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:15.180254+0000","last_change":"2024-09-14T13:02:15.180078+0000","last_active":"2024-09-14T13:02:15.180254+0000","last_peered":"2024-09-14T13:02:15.180254+0000","last_clean":"2024-09-14T13:02:15.180254+0000","last_became_active":"2024-09-14T11:08:21.808348+0000","last_became_peered":"2024-09-14T11:08:21.808348+0000","last_unstale":"2024-09-14T13:02:15.180254+0000","last_undegraded":"2024-09-14T13:02:15.180254+0000","last_fullsized":"2024-09-14T13:02:15.180254+0000","mapping_epoch":24,"log_start":"267'100","ondisk_log_start":"267'100","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'190","last_scrub_stamp":"2024-09-14T13:02:15.179872+0000","last_deep_scrub":"267'190","last_deep_scrub_stamp":"2024-09-14T13:02:15.179872+0000","last_clean_scrub_stamp":"2024-09-14T13:02:15.179872+0000","objects_scrubbed":2,"log_size":90,"log_dups_size":100,"ondisk_log_size":90,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:01:20.740863+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":26,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":617,"num_read_kb":79967,"num_write":853,"num_write_kb":37043,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,1],"acting":[2,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"267'413","reported_seq":2123,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:21.644417+0000","last_change":"2024-09-14T13:02:21.644417+0000","last_active":"2024-09-14T13:02:21.644417+0000","last_peered":"2024-09-14T13:02:21.644417+0000","last_clean":"2024-09-14T13:02:21.644417+0000","last_became_active":"2024-09-14T11:08:23.802357+0000","last_became_peered":"2024-09-14T11:08:23.802357+0000","last_unstale":"2024-09-14T13:02:21.644417+0000","last_undegraded":"2024-09-14T13:02:21.644417+0000","last_fullsized":"2024-09-14T13:02:21.644417+0000","mapping_epoch":26,"log_start":"267'400","ondisk_log_start":"267'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'413","last_scrub_stamp":"2024-09-14T13:02:21.644233+0000","last_deep_scrub":"267'413","last_deep_scrub_stamp":"2024-09-14T13:02:21.644233+0000","last_clean_scrub_stamp":"2024-09-14T13:02:21.644233+0000","objects_scrubbed":2,"log_size":13,"log_dups_size":400,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:28:20.653691+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2549,"num_read_kb":2448,"num_write":474,"num_write_kb":95,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":640,"num_omap_keys":3,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2f","version":"267'225","reported_seq":958,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:17.443355+0000","last_change":"2024-09-14T13:02:17.443094+0000","last_active":"2024-09-14T13:02:17.443355+0000","last_peered":"2024-09-14T13:02:17.443355+0000","last_clean":"2024-09-14T13:02:17.443355+0000","last_became_active":"2024-09-14T11:08:55.884851+0000","last_became_peered":"2024-09-14T11:08:55.884851+0000","last_unstale":"2024-09-14T13:02:17.443355+0000","last_undegraded":"2024-09-14T13:02:17.443355+0000","last_fullsized":"2024-09-14T13:02:17.443355+0000","mapping_epoch":37,"log_start":"267'200","ondisk_log_start":"267'200","created":24,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'225","last_scrub_stamp":"2024-09-14T13:02:17.442773+0000","last_deep_scrub":"267'225","last_deep_scrub_stamp":"2024-09-14T13:02:17.442773+0000","last_clean_scrub_stamp":"2024-09-14T13:02:17.442773+0000","objects_scrubbed":4,"log_size":25,"log_dups_size":200,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T00:39:22.131524+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":41,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":799,"num_read_kb":23166,"num_write":1000,"num_write_kb":40111,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,1],"acting":[5,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"267'231","reported_seq":927,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:18.476013+0000","last_change":"2024-09-14T13:02:18.475827+0000","last_active":"2024-09-14T13:02:18.476013+0000","last_peered":"2024-09-14T13:02:18.476013+0000","last_clean":"2024-09-14T13:02:18.476013+0000","last_became_active":"2024-09-14T11:08:56.033792+0000","last_became_peered":"2024-09-14T11:08:56.033792+0000","last_unstale":"2024-09-14T13:02:18.476013+0000","last_undegraded":"2024-09-14T13:02:18.476013+0000","last_fullsized":"2024-09-14T13:02:18.476013+0000","mapping_epoch":37,"log_start":"267'200","ondisk_log_start":"267'200","created":24,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'231","last_scrub_stamp":"2024-09-14T13:02:18.475601+0000","last_deep_scrub":"267'231","last_deep_scrub_stamp":"2024-09-14T13:02:18.475601+0000","last_clean_scrub_stamp":"2024-09-14T13:02:18.475601+0000","objects_scrubbed":5,"log_size":31,"log_dups_size":200,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:44:49.980682+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":26,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":576,"num_read_kb":92149,"num_write":1016,"num_write_kb":50173,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,0],"acting":[5,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.37","version":"267'502","reported_seq":2186,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:21.955388+0000","last_change":"2024-09-14T13:02:21.955235+0000","last_active":"2024-09-14T13:02:21.955388+0000","last_peered":"2024-09-14T13:02:21.955388+0000","last_clean":"2024-09-14T13:02:21.955388+0000","last_became_active":"2024-09-14T11:08:23.786473+0000","last_became_peered":"2024-09-14T11:08:23.786473+0000","last_unstale":"2024-09-14T13:02:21.955388+0000","last_undegraded":"2024-09-14T13:02:21.955388+0000","last_fullsized":"2024-09-14T13:02:21.955388+0000","mapping_epoch":26,"log_start":"267'400","ondisk_log_start":"267'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'502","last_scrub_stamp":"2024-09-14T13:02:21.955052+0000","last_deep_scrub":"267'502","last_deep_scrub_stamp":"2024-09-14T13:02:21.955052+0000","last_clean_scrub_stamp":"2024-09-14T13:02:21.955052+0000","objects_scrubbed":2,"log_size":102,"log_dups_size":400,"ondisk_log_size":102,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:16:43.466742+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2870,"num_read_kb":2681,"num_write":627,"num_write_kb":170,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":219,"num_omap_keys":1,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"267'229","reported_seq":908,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:10.024446+0000","last_change":"2024-09-14T13:02:10.024200+0000","last_active":"2024-09-14T13:02:10.024446+0000","last_peered":"2024-09-14T13:02:10.024446+0000","last_clean":"2024-09-14T13:02:10.024446+0000","last_became_active":"2024-09-14T11:08:21.815731+0000","last_became_peered":"2024-09-14T11:08:21.815731+0000","last_unstale":"2024-09-14T13:02:10.024446+0000","last_undegraded":"2024-09-14T13:02:10.024446+0000","last_fullsized":"2024-09-14T13:02:10.024446+0000","mapping_epoch":24,"log_start":"267'200","ondisk_log_start":"267'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'229","last_scrub_stamp":"2024-09-14T13:02:10.023871+0000","last_deep_scrub":"267'229","last_deep_scrub_stamp":"2024-09-14T13:02:10.023871+0000","last_clean_scrub_stamp":"2024-09-14T13:02:10.023871+0000","objects_scrubbed":3,"log_size":29,"log_dups_size":200,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:09:15.766050+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":31,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":597,"num_read_kb":25561,"num_write":1006,"num_write_kb":42149,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,5],"acting":[1,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.36","version":"267'908","reported_seq":2503,"reported_epoch":267,"state":"active+clean","last_fresh":"2024-09-14T13:02:24.440484+0000","last_change":"2024-09-14T13:02:24.440484+0000","last_active":"2024-09-14T13:02:24.440484+0000","last_peered":"2024-09-14T13:02:24.440484+0000","last_clean":"2024-09-14T13:02:24.440484+0000","last_became_active":"2024-09-14T11:08:23.797135+0000","last_became_peered":"2024-09-14T11:08:23.797135+0000","last_unstale":"2024-09-14T13:02:24.440484+0000","last_undegraded":"2024-09-14T13:02:24.440484+0000","last_fullsized":"2024-09-14T13:02:24.440484+0000","mapping_epoch":26,"log_start":"267'800","ondisk_log_start":"267'800","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"267'908","last_scrub_stamp":"2024-09-14T13:02:24.440300+0000","last_deep_scrub":"267'908","last_deep_scrub_stamp":"2024-09-14T13:02:24.440300+0000","last_clean_scrub_stamp":"2024-09-14T13:02:24.440300+0000","objects_scrubbed":1,"log_size":108,"log_dups_size":800,"ondisk_log_size":108,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:55:55.201914+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4302,"num_read_kb":3816,"num_write":1266,"num_write_kb":491,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]}],"pool_stats":[{"poolid":65,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10893,"num_read_kb":9222,"num_write":3117,"num_write_kb":1014,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1012,"ondisk_log_size":1012,"up":64,"acting":64,"num_store_stats":8},{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":14831,"num_objects":87,"num_object_clones":0,"num_object_copies":174,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":87,"num_whiteouts":0,"num_read":15223,"num_read_kb":14878,"num_write":17077,"num_write_kb":4995,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":19,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2512,"num_omap_keys":16,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":557056,"data_stored":29662,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1694,"ondisk_log_size":1694,"up":64,"acting":64,"num_store_stats":8},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":471,"ondisk_log_size":471,"up":64,"acting":64,"num_store_stats":8},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":416072,"num_objects":199,"num_object_clones":0,"num_object_copies":398,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":199,"num_whiteouts":0,"num_read":11985,"num_read_kb":14520,"num_write":8681,"num_write_kb":3819,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":23,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":713660,"num_omap_keys":1632,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":278528,"data_stored":7404,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2096,"ondisk_log_size":2096,"up":64,"acting":64,"num_store_stats":8},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":1793,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":2383,"num_read_kb":2845,"num_write":20,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":3586,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":17,"ondisk_log_size":17,"up":64,"acting":64,"num_store_stats":8},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":143,"num_object_clones":0,"num_object_copies":286,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":143,"num_whiteouts":0,"num_read":221865,"num_read_kb":203092,"num_write":56157,"num_write_kb":19250,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":143,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":35486,"num_omap_keys":143,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3618,"ondisk_log_size":3618,"up":128,"acting":128,"num_store_stats":8},{"poolid":68,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":12,"num_read_kb":12,"num_write":18,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1128,"num_omap_keys":12,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":12,"ondisk_log_size":12,"up":64,"acting":64,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":34033097,"num_objects":166,"num_object_clones":0,"num_object_copies":498,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":166,"num_whiteouts":0,"num_read":42946,"num_read_kb":2820718,"num_write":64530,"num_write_kb":2216242,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":52617216,"data_stored":52617216,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3536,"ondisk_log_size":3536,"up":192,"acting":192,"num_store_stats":8},{"poolid":67,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":172,"num_read_kb":198130,"num_write":186,"num_write_kb":125738,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":126,"ondisk_log_size":126,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":5,"ondisk_log_size":5,"up":16,"acting":16,"num_store_stats":7},{"poolid":66,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":168,"num_read_kb":188216,"num_write":186,"num_write_kb":125738,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":126,"ondisk_log_size":126,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":74,"ondisk_log_size":74,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834576235,"num_pgs":106,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":255424,"kb_used_data":13232,"kb_used_omap":1,"kb_used_meta":242174,"kb_avail":94116416,"statfs":{"total":96636764160,"available":96375209984,"internally_reserved":0,"allocated":13549568,"data_stored":11411092,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":247986634},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":13,"seq":55834576241,"num_pgs":99,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":242596,"kb_used_data":8724,"kb_used_omap":1,"kb_used_meta":233854,"kb_avail":94129244,"statfs":{"total":96636764160,"available":96388345856,"internally_reserved":0,"allocated":8933376,"data_stored":6850023,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":239466950},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":13,"seq":55834576239,"num_pgs":103,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":91384,"kb_used_data":10216,"kb_used_omap":1,"kb_used_meta":81150,"kb_avail":94280456,"statfs":{"total":96636764160,"available":96543186944,"internally_reserved":0,"allocated":10461184,"data_stored":8310166,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":83098053},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834576240,"num_pgs":105,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":121100,"kb_used_data":13564,"kb_used_omap":1,"kb_used_meta":107518,"kb_avail":94250740,"statfs":{"total":96636764160,"available":96512757760,"internally_reserved":0,"allocated":13889536,"data_stored":11826037,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":110098885},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":13,"seq":55834576242,"num_pgs":124,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":239884,"kb_used_data":10172,"kb_used_omap":1,"kb_used_meta":229694,"kb_avail":94131956,"statfs":{"total":96636764160,"available":96391122944,"internally_reserved":0,"allocated":10416128,"data_stored":8289369,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":235207111},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834576239,"num_pgs":92,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":97412,"kb_used_data":7924,"kb_used_omap":1,"kb_used_meta":89470,"kb_avail":94274428,"statfs":{"total":96636764160,"available":96537014272,"internally_reserved":0,"allocated":8114176,"data_stored":6032250,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":91617733},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834576242,"num_pgs":112,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":151660,"kb_used_data":12252,"kb_used_omap":1,"kb_used_meta":139390,"kb_avail":94220180,"statfs":{"total":96636764160,"available":96481464320,"internally_reserved":0,"allocated":12546048,"data_stored":10442210,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":142735813},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834576240,"num_pgs":109,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":244868,"kb_used_data":10996,"kb_used_omap":1,"kb_used_meta":233854,"kb_avail":94126972,"statfs":{"total":96636764160,"available":96386019328,"internally_reserved":0,"allocated":11259904,"data_stored":9137303,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":239466949},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":6234112,"data_stored":6234112,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8130560,"data_stored":8130560,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":3719168,"data_stored":3719168,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":5976064,"data_stored":5976064,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":9515008,"data_stored":9515008,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":5996544,"data_stored":5996544,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4538368,"data_stored":4538368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8507392,"data_stored":8507392,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":1139,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":46,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":1185,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":562,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":184,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":470,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":880,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":1018,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":330,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":1210,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":220,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":1458,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":814,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":1474,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":86016,"data_stored":3328,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":3091,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4091,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":86016,"data_stored":4619,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":2771,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":77824,"data_stored":4485,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":2895,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":86016,"data_stored":4382,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-14T13:03:29.781 DEBUG:teuthology.orchestra.run.smithi138:> sudo ceph --cluster ceph config set global mon_health_to_clog false 2024-09-14T13:03:30.126 INFO:teuthology.misc:Shutting down mds daemons... 2024-09-14T13:03:30.126 INFO:teuthology.misc:Shutting down osd daemons... 2024-09-14T13:03:30.126 DEBUG:tasks.ceph.osd.0:waiting for process to exit 2024-09-14T13:03:30.126 INFO:teuthology.orchestra.run:waiting for 300 2024-09-14T13:03:30.201 INFO:tasks.ceph.osd.0:Stopped 2024-09-14T13:03:30.201 DEBUG:tasks.ceph.osd.1:waiting for process to exit 2024-09-14T13:03:30.201 INFO:teuthology.orchestra.run:waiting for 300 2024-09-14T13:03:33.909 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 is failed for ~0s 2024-09-14T13:03:36.303 INFO:tasks.ceph.osd.1:Stopped 2024-09-14T13:03:36.304 DEBUG:tasks.ceph.osd.2:waiting for process to exit 2024-09-14T13:03:36.304 INFO:teuthology.orchestra.run:waiting for 300 2024-09-14T13:03:36.388 INFO:tasks.ceph.osd.2:Stopped 2024-09-14T13:03:36.389 DEBUG:tasks.ceph.osd.3:waiting for process to exit 2024-09-14T13:03:36.389 INFO:teuthology.orchestra.run:waiting for 300 2024-09-14T13:03:36.484 INFO:tasks.ceph.osd.3:Stopped 2024-09-14T13:03:36.485 DEBUG:tasks.ceph.osd.4:waiting for process to exit 2024-09-14T13:03:36.485 INFO:teuthology.orchestra.run:waiting for 300 2024-09-14T13:03:36.572 INFO:tasks.ceph.osd.4:Stopped 2024-09-14T13:03:36.572 DEBUG:tasks.ceph.osd.5:waiting for process to exit 2024-09-14T13:03:36.572 INFO:teuthology.orchestra.run:waiting for 300 2024-09-14T13:03:39.616 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.5 is failed for ~0s 2024-09-14T13:03:39.617 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 has been restored 2024-09-14T13:03:42.674 INFO:tasks.ceph.osd.5:Stopped 2024-09-14T13:03:42.674 DEBUG:tasks.ceph.osd.6:waiting for process to exit 2024-09-14T13:03:42.675 INFO:teuthology.orchestra.run:waiting for 300 2024-09-14T13:03:42.761 INFO:tasks.ceph.osd.6:Stopped 2024-09-14T13:03:42.761 DEBUG:tasks.ceph.osd.7:waiting for process to exit 2024-09-14T13:03:42.762 INFO:teuthology.orchestra.run:waiting for 300 2024-09-14T13:03:45.121 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.7 is failed for ~0s 2024-09-14T13:03:45.121 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.5 has been restored 2024-09-14T13:03:48.863 INFO:tasks.ceph.osd.7:Stopped 2024-09-14T13:03:48.864 INFO:teuthology.misc:Shutting down mgr daemons... 2024-09-14T13:03:48.864 DEBUG:tasks.ceph.mgr.y:waiting for process to exit 2024-09-14T13:03:48.864 INFO:teuthology.orchestra.run:waiting for 300 2024-09-14T13:03:48.896 INFO:tasks.ceph.mgr.y:Stopped 2024-09-14T13:03:48.896 DEBUG:tasks.ceph.mgr.x:waiting for process to exit 2024-09-14T13:03:48.896 INFO:teuthology.orchestra.run:waiting for 300 2024-09-14T13:03:48.925 INFO:tasks.ceph.mgr.x:Stopped 2024-09-14T13:03:48.925 INFO:teuthology.misc:Shutting down mon daemons... 2024-09-14T13:03:48.925 DEBUG:tasks.ceph.mon.a:waiting for process to exit 2024-09-14T13:03:48.925 INFO:teuthology.orchestra.run:waiting for 300 2024-09-14T13:03:48.969 INFO:tasks.ceph.mon.a:Stopped 2024-09-14T13:03:48.969 DEBUG:tasks.ceph.mon.c:waiting for process to exit 2024-09-14T13:03:48.969 INFO:teuthology.orchestra.run:waiting for 300 2024-09-14T13:03:49.029 INFO:tasks.ceph.mon.c:Stopped 2024-09-14T13:03:49.030 DEBUG:tasks.ceph.mon.b:waiting for process to exit 2024-09-14T13:03:49.030 INFO:teuthology.orchestra.run:waiting for 300 2024-09-14T13:03:49.058 INFO:tasks.ceph.mon.b:Stopped 2024-09-14T13:03:49.059 INFO:tasks.ceph:Checking cluster log for badness... 2024-09-14T13:03:49.059 DEBUG:teuthology.orchestra.run.smithi138:> sudo egrep '\[ERR\]|\[WRN\]|\[SEC\]' /var/log/ceph/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v '\(PG_AVAILABILITY\)' | egrep -v '\(PG_DEGRADED\)' | egrep -v '\(POOL_APP_NOT_ENABLED\)' | egrep -v 'not have an application enabled' | egrep -v '\(OSD_SLOW_PING_TIME' | head -n 1 2024-09-14T13:03:49.088 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-0 on ubuntu@smithi138.front.sepia.ceph.com 2024-09-14T13:03:49.088 DEBUG:teuthology.orchestra.run.smithi138:> sync && sudo umount -f /var/lib/ceph/osd/ceph-0 2024-09-14T13:03:49.510 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-1 on ubuntu@smithi138.front.sepia.ceph.com 2024-09-14T13:03:49.511 DEBUG:teuthology.orchestra.run.smithi138:> sync && sudo umount -f /var/lib/ceph/osd/ceph-1 2024-09-14T13:03:49.790 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-2 on ubuntu@smithi138.front.sepia.ceph.com 2024-09-14T13:03:49.791 DEBUG:teuthology.orchestra.run.smithi138:> sync && sudo umount -f /var/lib/ceph/osd/ceph-2 2024-09-14T13:03:49.954 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-3 on ubuntu@smithi138.front.sepia.ceph.com 2024-09-14T13:03:49.954 DEBUG:teuthology.orchestra.run.smithi138:> sync && sudo umount -f /var/lib/ceph/osd/ceph-3 2024-09-14T13:03:50.121 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-4 on ubuntu@smithi154.front.sepia.ceph.com 2024-09-14T13:03:50.121 DEBUG:teuthology.orchestra.run.smithi154:> sync && sudo umount -f /var/lib/ceph/osd/ceph-4 2024-09-14T13:03:50.121 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.7 has been restored 2024-09-14T13:03:50.273 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-5 on ubuntu@smithi154.front.sepia.ceph.com 2024-09-14T13:03:50.273 DEBUG:teuthology.orchestra.run.smithi154:> sync && sudo umount -f /var/lib/ceph/osd/ceph-5 2024-09-14T13:03:50.441 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-6 on ubuntu@smithi154.front.sepia.ceph.com 2024-09-14T13:03:50.441 DEBUG:teuthology.orchestra.run.smithi154:> sync && sudo umount -f /var/lib/ceph/osd/ceph-6 2024-09-14T13:03:50.601 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-7 on ubuntu@smithi154.front.sepia.ceph.com 2024-09-14T13:03:50.601 DEBUG:teuthology.orchestra.run.smithi154:> sync && sudo umount -f /var/lib/ceph/osd/ceph-7 2024-09-14T13:03:50.749 INFO:tasks.ceph:Archiving mon data... 2024-09-14T13:03:50.750 DEBUG:teuthology.misc:Transferring archived files from smithi138:/var/lib/ceph/mon/ceph-a to /home/teuthworker/archive/teuthology-2024-09-13_20:40:18-rgw-main-distro-default-smithi/7904155/data/mon.a.tgz 2024-09-14T13:03:50.750 DEBUG:teuthology.orchestra.run.smithi138:> mktemp 2024-09-14T13:03:50.757 INFO:teuthology.orchestra.run.smithi138.stdout:/tmp/tmp.gb0U9tVPtW 2024-09-14T13:03:50.757 DEBUG:teuthology.orchestra.run.smithi138:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-a -- . > /tmp/tmp.gb0U9tVPtW 2024-09-14T13:03:50.955 DEBUG:teuthology.orchestra.run.smithi138:> sudo chmod 0666 /tmp/tmp.gb0U9tVPtW 2024-09-14T13:03:51.016 DEBUG:teuthology.orchestra.remote:smithi138:/tmp/tmp.gb0U9tVPtW is 598KB 2024-09-14T13:03:51.078 DEBUG:teuthology.orchestra.run.smithi138:> rm -fr /tmp/tmp.gb0U9tVPtW 2024-09-14T13:03:51.083 DEBUG:teuthology.misc:Transferring archived files from smithi138:/var/lib/ceph/mon/ceph-c to /home/teuthworker/archive/teuthology-2024-09-13_20:40:18-rgw-main-distro-default-smithi/7904155/data/mon.c.tgz 2024-09-14T13:03:51.083 DEBUG:teuthology.orchestra.run.smithi138:> mktemp 2024-09-14T13:03:51.128 INFO:teuthology.orchestra.run.smithi138.stdout:/tmp/tmp.LdOCCZERGu 2024-09-14T13:03:51.128 DEBUG:teuthology.orchestra.run.smithi138:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-c -- . > /tmp/tmp.LdOCCZERGu 2024-09-14T13:03:51.336 DEBUG:teuthology.orchestra.run.smithi138:> sudo chmod 0666 /tmp/tmp.LdOCCZERGu 2024-09-14T13:03:51.396 DEBUG:teuthology.orchestra.remote:smithi138:/tmp/tmp.LdOCCZERGu is 630KB 2024-09-14T13:03:51.458 DEBUG:teuthology.orchestra.run.smithi138:> rm -fr /tmp/tmp.LdOCCZERGu 2024-09-14T13:03:51.463 DEBUG:teuthology.misc:Transferring archived files from smithi154:/var/lib/ceph/mon/ceph-b to /home/teuthworker/archive/teuthology-2024-09-13_20:40:18-rgw-main-distro-default-smithi/7904155/data/mon.b.tgz 2024-09-14T13:03:51.464 DEBUG:teuthology.orchestra.run.smithi154:> mktemp 2024-09-14T13:03:51.469 INFO:teuthology.orchestra.run.smithi154.stdout:/tmp/tmp.7raOrTRlw0 2024-09-14T13:03:51.470 DEBUG:teuthology.orchestra.run.smithi154:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-b -- . > /tmp/tmp.7raOrTRlw0 2024-09-14T13:03:51.670 DEBUG:teuthology.orchestra.run.smithi154:> sudo chmod 0666 /tmp/tmp.7raOrTRlw0 2024-09-14T13:03:51.734 DEBUG:teuthology.orchestra.remote:smithi154:/tmp/tmp.7raOrTRlw0 is 630KB 2024-09-14T13:03:51.796 DEBUG:teuthology.orchestra.run.smithi154:> rm -fr /tmp/tmp.7raOrTRlw0 2024-09-14T13:03:51.802 INFO:tasks.ceph:Cleaning ceph cluster... 2024-09-14T13:03:51.802 DEBUG:teuthology.orchestra.run.smithi138:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2024-09-14T13:03:51.804 DEBUG:teuthology.orchestra.run.smithi154:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2024-09-14T13:03:51.915 INFO:teuthology.util.scanner:summary_data or yaml_file is empty! 2024-09-14T13:03:51.921 INFO:teuthology.util.scanner:summary_data or yaml_file is empty! 2024-09-14T13:03:51.921 INFO:tasks.ceph:Archiving crash dumps... 2024-09-14T13:03:51.922 DEBUG:teuthology.misc:Transferring archived files from smithi138:/var/lib/ceph/crash to /home/teuthworker/archive/teuthology-2024-09-13_20:40:18-rgw-main-distro-default-smithi/7904155/remote/smithi138/crash 2024-09-14T13:03:51.923 DEBUG:teuthology.orchestra.run.smithi138:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2024-09-14T13:03:51.936 DEBUG:teuthology.misc:Transferring archived files from smithi154:/var/lib/ceph/crash to /home/teuthworker/archive/teuthology-2024-09-13_20:40:18-rgw-main-distro-default-smithi/7904155/remote/smithi154/crash 2024-09-14T13:03:51.937 DEBUG:teuthology.orchestra.run.smithi154:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2024-09-14T13:03:51.978 INFO:tasks.ceph:Compressing logs... 2024-09-14T13:03:51.979 DEBUG:teuthology.orchestra.run.smithi138:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-09-14T13:03:51.982 DEBUG:teuthology.orchestra.run.smithi154:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-09-14T13:03:52.006 INFO:teuthology.orchestra.run.smithi138.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.170082.log 2024-09-14T13:03:52.007 INFO:teuthology.orchestra.run.smithi138.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.180733.log 2024-09-14T13:03:52.008 INFO:teuthology.orchestra.run.smithi138.stderr:/var/log/ceph/ceph-client.0.170082.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.168902.log 2024-09-14T13:03:52.008 INFO:teuthology.orchestra.run.smithi138.stderr: 80.3% -- replaced with /var/log/ceph/ceph-client.0.170082.log.gz 2024-09-14T13:03:52.008 INFO:teuthology.orchestra.run.smithi138.stderr:/var/log/ceph/ceph-client.0.180733.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.152799.log 2024-09-14T13:03:52.008 INFO:teuthology.orchestra.run.smithi138.stderr:/var/log/ceph/ceph-client.0.168902.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.84330.log 2024-09-14T13:03:52.009 INFO:teuthology.orchestra.run.smithi138.stderr: 80.3% -- replaced with /var/log/ceph/ceph-client.0.168902.log.gz 2024-09-14T13:03:52.010 INFO:teuthology.orchestra.run.smithi138.stderr:/var/log/ceph/ceph-client.admin.152799.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54786.log 2024-09-14T13:03:52.010 INFO:teuthology.orchestra.run.smithi138.stderr: 81.0% -- replaced with /var/log/ceph/ceph-client.admin.152799.log.gz 2024-09-14T13:03:52.010 INFO:teuthology.orchestra.run.smithi138.stderr:gzip -5 --verbose --/var/log/ceph/ceph-client.admin.84330.log: /var/log/ceph/ceph-client.admin.86100.log 2024-09-14T13:03:52.010 INFO:teuthology.orchestra.run.smithi138.stderr: 82.3% -- replaced with /var/log/ceph/ceph-client.admin.84330.log.gz 2024-09-14T13:03:52.010 INFO:teuthology.orchestra.run.smithi138.stderr:/var/log/ceph/ceph-client.admin.54786.log: 91.5% -- replaced with /var/log/ceph/ceph-client.0.180733.log.gz 2024-09-14T13:03:52.010 INFO:teuthology.orchestra.run.smithi138.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.126224.log 2024-09-14T13:03:52.011 INFO:teuthology.orchestra.run.smithi138.stderr:/var/log/ceph/ceph-client.admin.86100.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.154569.log 2024-09-14T13:03:52.012 INFO:teuthology.orchestra.run.smithi138.stderr: 82.2% -- replaced with /var/log/ceph/ceph-client.admin.86100.log.gz 2024-09-14T13:03:52.012 INFO:teuthology.orchestra.run.smithi138.stderr:/var/log/ceph/ceph-client.admin.126224.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.175982.log 2024-09-14T13:03:52.012 INFO:teuthology.orchestra.run.smithi138.stderr: 81.8% -- replaced with /var/log/ceph/ceph-client.admin.126224.log.gz 2024-09-14T13:03:52.012 INFO:teuthology.orchestra.run.smithi138.stderr:/var/log/ceph/ceph-client.admin.154569.log: gzip -5 --verbose -- /var/log/ceph/rgw.ceph.client.0.log 2024-09-14T13:03:52.012 INFO:teuthology.orchestra.run.smithi138.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.154569.log.gz 2024-09-14T13:03:52.012 INFO:teuthology.orchestra.run.smithi138.stderr:/var/log/ceph/ceph-client.0.175982.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32751.log 2024-09-14T13:03:52.012 INFO:teuthology.orchestra.run.smithi138.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.72528.log 2024-09-14T13:03:52.012 INFO:teuthology.orchestra.run.smithi138.stderr: 84.6% -- replaced with /var/log/ceph/ceph-client.0.175982.log.gz 2024-09-14T13:03:52.013 INFO:teuthology.orchestra.run.smithi138.stderr:/var/log/ceph/rgw.ceph.client.0.log: /var/log/ceph/ceph-client.admin.32751.log: gzip 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32751.log.gz -5 2024-09-14T13:03:52.013 INFO:teuthology.orchestra.run.smithi138.stderr: --verbose -- /var/log/ceph/ceph-client.admin.178824.log 2024-09-14T13:03:52.014 INFO:teuthology.orchestra.run.smithi138.stderr:/var/log/ceph/ceph-client.admin.72528.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.105573.log 2024-09-14T13:03:52.014 INFO:teuthology.orchestra.run.smithi138.stderr:/var/log/ceph/ceph-client.admin.178824.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39220.log 2024-09-14T13:03:52.014 INFO:teuthology.orchestra.run.smithi138.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.72528.log.gz 2024-09-14T13:03:52.014 INFO:teuthology.orchestra.run.smithi138.stderr: 85.5% -- replaced with /var/log/ceph/ceph-client.admin.178824.log.gz 2024-09-14T13:03:52.014 INFO:teuthology.orchestra.run.smithi138.stderr:/var/log/ceph/ceph-client.admin.105573.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.182692.log 2024-09-14T13:03:52.014 INFO:teuthology.orchestra.run.smithi138.stderr: 82.2% -- replaced with /var/log/ceph/ceph-client.admin.105573.log.gz 2024-09-14T13:03:52.016 INFO:teuthology.orchestra.run.smithi138.stderr:/var/log/ceph/ceph-client.admin.39220.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.93773.log 2024-09-14T13:03:52.016 INFO:teuthology.orchestra.run.smithi138.stderr: 83.0% -- replaced with /var/log/ceph/ceph-client.admin.39220.log.gz 2024-09-14T13:03:52.016 INFO:teuthology.orchestra.run.smithi138.stderr:/var/log/ceph/ceph-client.admin.182692.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.94363.log 2024-09-14T13:03:52.016 INFO:teuthology.orchestra.run.smithi138.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.182692.log.gz 2024-09-14T13:03:52.016 INFO:teuthology.orchestra.run.smithi138.stderr:/var/log/ceph/ceph-client.admin.93773.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.182252.log 2024-09-14T13:03:52.016 INFO:teuthology.orchestra.run.smithi138.stderr: 83.0% -- replaced with /var/log/ceph/ceph-client.admin.93773.log.gz 2024-09-14T13:03:52.016 INFO:teuthology.orchestra.run.smithi138.stderr:/var/log/ceph/ceph-client.admin.94363.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59853.log 2024-09-14T13:03:52.016 INFO:teuthology.orchestra.run.smithi138.stderr: 81.8% -- replaced with /var/log/ceph/ceph-client.admin.94363.log.gz 2024-09-14T13:03:52.016 INFO:teuthology.orchestra.run.smithi138.stderr:/var/log/ceph/ceph-client.admin.182252.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.182252.log.gz 2024-09-14T13:03:52.016 INFO:teuthology.orchestra.run.smithi138.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mgr.y.log 2024-09-14T13:03:52.018 INFO:teuthology.orchestra.run.smithi138.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43400.log 2024-09-14T13:03:52.018 INFO:teuthology.orchestra.run.smithi138.stderr:/var/log/ceph/ceph-client.admin.59853.log: /var/log/ceph/ceph-mgr.y.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32653.log 2024-09-14T13:03:52.018 INFO:teuthology.orchestra.run.smithi138.stderr:/var/log/ceph/ceph-client.admin.43400.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.146876.log 2024-09-14T13:03:52.019 INFO:teuthology.orchestra.run.smithi138.stderr: 85.6%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44040.log/var/log/ceph/ceph-client.admin.32653.log: 2024-09-14T13:03:52.019 INFO:teuthology.orchestra.run.smithi138.stderr: -- replaced with /var/log/ceph/ceph-client.admin.43400.log.gz 2024-09-14T13:03:52.019 INFO:teuthology.orchestra.run.smithi138.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32653.log.gz 2024-09-14T13:03:52.019 INFO:teuthology.orchestra.run.smithi138.stderr:/var/log/ceph/ceph-client.admin.146876.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.162730.log 2024-09-14T13:03:52.019 INFO:teuthology.orchestra.run.smithi138.stderr: 85.6% -- replaced with /var/log/ceph/ceph-client.admin.146876.log.gz 2024-09-14T13:03:52.019 INFO:teuthology.orchestra.run.smithi138.stderr:/var/log/ceph/ceph-client.admin.44040.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60499.log 2024-09-14T13:03:52.020 INFO:teuthology.orchestra.run.smithi138.stderr: 89.5%/var/log/ceph/ceph-client.admin.162730.log: -- replaced with /var/log/ceph/ceph-client.admin.59853.log.gz 2024-09-14T13:03:52.020 INFO:teuthology.orchestra.run.smithi138.stderr: 84.4% -- replaced with /var/log/ceph/ceph-client.admin.44040.log.gz 2024-09-14T13:03:52.020 INFO:teuthology.orchestra.run.smithi138.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50580.log 2024-09-14T13:03:52.020 INFO:teuthology.orchestra.run.smithi138.stderr:/var/log/ceph/ceph-client.admin.60499.log: 92.3% -- replaced with /var/log/ceph/ceph-client.admin.162730.log.gz 2024-09-14T13:03:52.020 INFO:teuthology.orchestra.run.smithi138.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.120914.log 2024-09-14T13:03:52.020 INFO:teuthology.orchestra.run.smithi138.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.102623.log 2024-09-14T13:03:52.021 INFO:teuthology.orchestra.run.smithi138.stderr:/var/log/ceph/ceph-client.admin.50580.log: /var/log/ceph/ceph-client.admin.120914.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.156439.log 2024-09-14T13:03:52.021 INFO:teuthology.orchestra.run.smithi138.stderr: 85.7% -- replaced with /var/log/ceph/ceph-client.admin.50580.log.gz 2024-09-14T13:03:52.021 INFO:teuthology.orchestra.run.smithi138.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.182070.log 2024-09-14T13:03:52.021 INFO:teuthology.orchestra.run.smithi138.stderr: 89.0%/var/log/ceph/ceph-client.admin.102623.log: -- replaced with /var/log/ceph/ceph-client.admin.120914.log.gz 2024-09-14T13:03:52.021 INFO:teuthology.orchestra.run.smithi138.stderr: 82.0% -- replaced with /var/log/ceph/ceph-client.admin.102623.log.gz 2024-09-14T13:03:52.021 INFO:teuthology.orchestra.run.smithi138.stderr:/var/log/ceph/ceph-client.admin.156439.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.164635.log 2024-09-14T13:03:52.023 INFO:teuthology.orchestra.run.smithi138.stderr:/var/log/ceph/ceph-client.admin.182070.log: 90.4%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52400.log 2024-09-14T13:03:52.024 INFO:teuthology.orchestra.run.smithi138.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.182070.log.gz 2024-09-14T13:03:52.024 INFO:teuthology.orchestra.run.smithi138.stderr: -- replaced with /var/log/ceph/ceph-client.admin.156439.log.gz 2024-09-14T13:03:52.024 INFO:teuthology.orchestra.run.smithi138.stderr:/var/log/ceph/ceph-client.admin.164635.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.153389.log 2024-09-14T13:03:52.024 INFO:teuthology.orchestra.run.smithi138.stderr:/var/log/ceph/ceph-client.admin.52400.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55981.log 2024-09-14T13:03:52.024 INFO:teuthology.orchestra.run.smithi138.stderr: 92.3% 83.8% -- replaced with /var/log/ceph/ceph-client.admin.52400.log.gz 2024-09-14T13:03:52.024 INFO:teuthology.orchestra.run.smithi138.stderr: -- replaced with /var/log/ceph/ceph-client.admin.164635.log.gz 2024-09-14T13:03:52.024 INFO:teuthology.orchestra.run.smithi138.stderr:/var/log/ceph/ceph-client.admin.153389.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.89640.log 2024-09-14T13:03:52.024 INFO:teuthology.orchestra.run.smithi138.stderr: 82.1% -- replaced with /var/log/ceph/ceph-client.admin.153389.log.gz 2024-09-14T13:03:52.024 INFO:teuthology.orchestra.run.smithi138.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.182564.log 2024-09-14T13:03:52.027 INFO:teuthology.orchestra.run.smithi138.stderr:/var/log/ceph/ceph-client.admin.55981.log: /var/log/ceph/ceph-client.admin.89640.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.94953.log 2024-09-14T13:03:52.027 INFO:teuthology.orchestra.run.smithi138.stderr: 81.9%/var/log/ceph/ceph-client.admin.182564.log: -- replaced with /var/log/ceph/ceph-client.admin.89640.log.gzgzip -5 --verbose -- /var/log/ceph/ceph-client.admin.112653.log 2024-09-14T13:03:52.027 INFO:teuthology.orchestra.run.smithi138.stderr: 2024-09-14T13:03:52.027 INFO:teuthology.orchestra.run.smithi138.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.182564.log.gz 2024-09-14T13:03:52.027 INFO:teuthology.orchestra.run.smithi138.stderr:/var/log/ceph/ceph-client.admin.94953.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.54786.log.gz 2024-09-14T13:03:52.027 INFO:teuthology.orchestra.run.smithi138.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.94953.log.gz 2024-09-14T13:03:52.027 INFO:teuthology.orchestra.run.smithi138.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.0.log 2024-09-14T13:03:52.028 INFO:teuthology.orchestra.run.smithi138.stderr:/var/log/ceph/ceph-client.admin.112653.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.116784.log 2024-09-14T13:03:52.028 INFO:teuthology.orchestra.run.smithi138.stderr: 82.0% -- replaced with /var/log/ceph/ceph-client.admin.112653.log.gz 2024-09-14T13:03:52.028 INFO:teuthology.orchestra.run.smithi138.stderr:/var/log/ceph/ceph-osd.0.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.182356.log 2024-09-14T13:03:52.028 INFO:teuthology.orchestra.run.smithi138.stderr:/var/log/ceph/ceph-client.admin.116784.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.104983.log 2024-09-14T13:03:52.028 INFO:teuthology.orchestra.run.smithi138.stderr: 82.0% -- replaced with /var/log/ceph/ceph-client.admin.116784.log.gz 2024-09-14T13:03:52.028 INFO:teuthology.orchestra.run.smithi138.stderr:/var/log/ceph/ceph-client.admin.182356.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.171262.log 2024-09-14T13:03:52.028 INFO:teuthology.orchestra.run.smithi138.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.182356.log.gz 2024-09-14T13:03:52.030 INFO:teuthology.orchestra.run.smithi138.stderr:/var/log/ceph/ceph-client.admin.104983.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.133895.log 2024-09-14T13:03:52.030 INFO:teuthology.orchestra.run.smithi138.stderr:/var/log/ceph/ceph-client.0.171262.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.179538.log 2024-09-14T13:03:52.030 INFO:teuthology.orchestra.run.smithi138.stderr: 80.7% -- replaced with /var/log/ceph/ceph-client.0.171262.log.gz 87.1% -- replaced with /var/log/ceph/ceph-client.admin.104983.log.gz 2024-09-14T13:03:52.030 INFO:teuthology.orchestra.run.smithi138.stderr: 2024-09-14T13:03:52.030 INFO:teuthology.orchestra.run.smithi138.stderr:/var/log/ceph/ceph-client.admin.133895.log: 86.9% -- replaced with /var/log/ceph/ceph-client.admin.133895.log.gz 2024-09-14T13:03:52.031 INFO:teuthology.orchestra.run.smithi138.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.97313.log 2024-09-14T13:03:52.032 INFO:teuthology.orchestra.run.smithi138.stderr:/var/log/ceph/ceph-client.admin.179538.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.179487.log 2024-09-14T13:03:52.032 INFO:teuthology.orchestra.run.smithi138.stderr: 85.0% -- replaced with /var/log/ceph/ceph-client.admin.179538.log.gz/var/log/ceph/ceph-client.admin.97313.log: 2024-09-14T13:03:52.032 INFO:teuthology.orchestra.run.smithi138.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.82558.log 2024-09-14T13:03:52.032 INFO:teuthology.orchestra.run.smithi138.stderr: 82.3% -- replaced with /var/log/ceph/ceph-client.admin.97313.log.gz 2024-09-14T13:03:52.033 INFO:teuthology.orchestra.run.smithi138.stderr:/var/log/ceph/ceph-client.admin.179487.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.179487.log.gz 2024-09-14T13:03:52.033 INFO:teuthology.orchestra.run.smithi138.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.178799.log 2024-09-14T13:03:52.033 INFO:teuthology.orchestra.run.smithi138.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.151619.log 2024-09-14T13:03:52.034 INFO:teuthology.orchestra.run.smithi138.stderr:/var/log/ceph/ceph-client.admin.82558.log: 82.3%/var/log/ceph/ceph-client.admin.178799.log: -- replaced with /var/log/ceph/ceph-client.admin.82558.log.gzgzip -5 --verbose -- /var/log/ceph/ceph-client.0.158517.log 2024-09-14T13:03:52.034 INFO:teuthology.orchestra.run.smithi138.stderr: 2024-09-14T13:03:52.034 INFO:teuthology.orchestra.run.smithi138.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.178799.log.gz 2024-09-14T13:03:52.034 INFO:teuthology.orchestra.run.smithi138.stderr:/var/log/ceph/ceph-client.admin.151619.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.151619.log.gz 2024-09-14T13:03:52.035 INFO:teuthology.orchestra.run.smithi138.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.85510.log 2024-09-14T13:03:52.035 INFO:teuthology.orchestra.run.smithi138.stderr:/var/log/ceph/ceph-client.0.158517.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32705.log 2024-09-14T13:03:52.035 INFO:teuthology.orchestra.run.smithi138.stderr: 84.2% -- replaced with /var/log/ceph/ceph-client.0.158517.log.gz/var/log/ceph/ceph-client.admin.85510.log: 2024-09-14T13:03:52.036 INFO:teuthology.orchestra.run.smithi138.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32747.log 2024-09-14T13:03:52.036 INFO:teuthology.orchestra.run.smithi138.stderr: 81.4% -- replaced with /var/log/ceph/ceph-client.admin.85510.log.gz 2024-09-14T13:03:52.036 INFO:teuthology.orchestra.run.smithi138.stderr:/var/log/ceph/ceph-client.admin.32705.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32705.log.gz 2024-09-14T13:03:52.036 INFO:teuthology.orchestra.run.smithi138.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53580.log 2024-09-14T13:03:52.037 INFO:teuthology.orchestra.run.smithi138.stderr:/var/log/ceph/ceph-client.admin.32747.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.145696.log 2024-09-14T13:03:52.037 INFO:teuthology.orchestra.run.smithi138.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32747.log.gz 2024-09-14T13:03:52.037 INFO:teuthology.orchestra.run.smithi138.stderr:/var/log/ceph/ceph-client.admin.53580.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.91410.log 2024-09-14T13:03:52.038 INFO:teuthology.orchestra.run.smithi138.stderr:/var/log/ceph/ceph-client.admin.145696.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.118554.log 2024-09-14T13:03:52.038 INFO:teuthology.orchestra.run.smithi138.stderr: 82.2% -- replaced with /var/log/ceph/ceph-client.admin.53580.log.gz 2024-09-14T13:03:52.038 INFO:teuthology.orchestra.run.smithi138.stderr:/var/log/ceph/ceph-client.admin.91410.log: 81.4% -- replaced with /var/log/ceph/ceph-client.admin.91410.log.gz 2024-09-14T13:03:52.038 INFO:teuthology.orchestra.run.smithi138.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.26943.log 2024-09-14T13:03:52.039 INFO:teuthology.orchestra.run.smithi138.stderr:/var/log/ceph/ceph-client.admin.118554.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.154619.log 2024-09-14T13:03:52.039 INFO:teuthology.orchestra.run.smithi138.stderr: 86.2% -- replaced with /var/log/ceph/ceph-client.admin.145696.log.gz 2024-09-14T13:03:52.039 INFO:teuthology.orchestra.run.smithi138.stderr: 82.2% -- replaced with /var/log/ceph/ceph-client.admin.118554.log.gz 2024-09-14T13:03:52.039 INFO:teuthology.orchestra.run.smithi138.stderr:/var/log/ceph/ceph-client.admin.26943.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.26943.log.gz 2024-09-14T13:03:52.041 INFO:teuthology.orchestra.run.smithi138.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.87280.log 2024-09-14T13:03:52.041 INFO:teuthology.orchestra.run.smithi138.stderr:/var/log/ceph/ceph-client.admin.154619.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.179437.log 2024-09-14T13:03:52.041 INFO:teuthology.orchestra.run.smithi138.stderr: 93.9% -- replaced with /var/log/ceph/ceph-client.admin.55981.log.gz 2024-09-14T13:03:52.041 INFO:teuthology.orchestra.run.smithi138.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.154619.log.gz/var/log/ceph/ceph-client.admin.87280.log: 2024-09-14T13:03:52.041 INFO:teuthology.orchestra.run.smithi138.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.155209.log 2024-09-14T13:03:52.041 INFO:teuthology.orchestra.run.smithi138.stderr: 82.0% -- replaced with /var/log/ceph/ceph-client.admin.87280.log.gz 2024-09-14T13:03:52.041 INFO:teuthology.orchestra.run.smithi138.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.117374.log 2024-09-14T13:03:52.043 INFO:teuthology.orchestra.run.smithi138.stderr:/var/log/ceph/ceph-client.admin.179437.log: /var/log/ceph/ceph-client.admin.155209.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.179437.log.gz 2024-09-14T13:03:52.043 INFO:teuthology.orchestra.run.smithi138.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.182044.log 2024-09-14T13:03:52.043 INFO:teuthology.orchestra.run.smithi138.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.155209.log.gz 2024-09-14T13:03:52.043 INFO:teuthology.orchestra.run.smithi138.stderr:/var/log/ceph/ceph-client.admin.117374.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.115014.log 2024-09-14T13:03:52.043 INFO:teuthology.orchestra.run.smithi138.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34300.log 2024-09-14T13:03:52.043 INFO:teuthology.orchestra.run.smithi138.stderr:/var/log/ceph/ceph-client.admin.182044.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.117374.log.gz 2024-09-14T13:03:52.043 INFO:teuthology.orchestra.run.smithi138.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.182044.log.gz 2024-09-14T13:03:52.043 INFO:teuthology.orchestra.run.smithi138.stderr:/var/log/ceph/ceph-client.admin.115014.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.117964.log 2024-09-14T13:03:52.043 INFO:teuthology.orchestra.run.smithi138.stderr: 82.1% -- replaced with /var/log/ceph/ceph-client.admin.115014.log.gz 2024-09-14T13:03:52.043 INFO:teuthology.orchestra.run.smithi138.stderr:/var/log/ceph/ceph-client.admin.34300.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.26694.log 2024-09-14T13:03:52.043 INFO:teuthology.orchestra.run.smithi138.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.34300.log.gz 2024-09-14T13:03:52.046 INFO:teuthology.orchestra.run.smithi138.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.90820.log 2024-09-14T13:03:52.046 INFO:teuthology.orchestra.run.smithi138.stderr:/var/log/ceph/ceph-client.admin.117964.log: /var/log/ceph/ceph-client.admin.26694.log: 82.1% -- replaced with /var/log/ceph/ceph-client.admin.117964.log.gz 2024-09-14T13:03:52.046 INFO:teuthology.orchestra.run.smithi138.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58563.log 2024-09-14T13:03:52.046 INFO:teuthology.orchestra.run.smithi138.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.26694.log.gz 2024-09-14T13:03:52.046 INFO:teuthology.orchestra.run.smithi138.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.123274.log 2024-09-14T13:03:52.046 INFO:teuthology.orchestra.run.smithi138.stderr:/var/log/ceph/ceph-client.admin.90820.log: /var/log/ceph/ceph-client.admin.58563.log: 82.0% -- replaced with /var/log/ceph/ceph-client.admin.90820.log.gz 2024-09-14T13:03:52.046 INFO:teuthology.orchestra.run.smithi138.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.109703.log 2024-09-14T13:03:52.046 INFO:teuthology.orchestra.run.smithi138.stderr:/var/log/ceph/ceph-client.admin.123274.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.37255.log 2024-09-14T13:03:52.046 INFO:teuthology.orchestra.run.smithi138.stderr: 81.9%/var/log/ceph/ceph-client.admin.109703.log: -- replaced with /var/log/ceph/ceph-client.admin.123274.log.gz 2024-09-14T13:03:52.046 INFO:teuthology.orchestra.run.smithi138.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.182408.log 2024-09-14T13:03:52.046 INFO:teuthology.orchestra.run.smithi138.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.109703.log.gz 2024-09-14T13:03:52.046 INFO:teuthology.orchestra.run.smithi138.stderr:/var/log/ceph/ceph-client.0.37255.log: 43.9% -- replaced with /var/log/ceph/ceph-client.0.37255.log.gz 2024-09-14T13:03:52.053 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.26722.log 2024-09-14T13:03:52.054 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.7.log 2024-09-14T13:03:52.054 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.26722.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.6.log 2024-09-14T13:03:52.054 INFO:teuthology.orchestra.run.smithi154.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.26722.log.gz 2024-09-14T13:03:52.054 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-osd.7.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.26786.log 2024-09-14T13:03:52.054 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.26906.log 2024-09-14T13:03:52.054 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-osd.6.log: /var/log/ceph/ceph-client.admin.26786.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.5.log 2024-09-14T13:03:52.054 INFO:teuthology.orchestra.run.smithi154.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.26786.log.gz 2024-09-14T13:03:52.054 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.26906.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.26762.log 2024-09-14T13:03:52.054 INFO:teuthology.orchestra.run.smithi154.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.26906.log.gz 2024-09-14T13:03:52.054 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-osd.5.log: gzip -5 --verbose -- /var/log/ceph/ceph-mgr.x.log 2024-09-14T13:03:52.054 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.26762.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.26762.log.gz 2024-09-14T13:03:52.054 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.log 2024-09-14T13:03:52.055 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.26882.log 2024-09-14T13:03:52.055 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-mgr.x.log: /var/log/ceph/ceph.log: gzip -5 --verbose -- /var/log/ceph/ceph.audit.log 2024-09-14T13:03:52.055 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.26882.log: gzip -5 --verbose -- /var/log/ceph/ceph-mon.b.log 2024-09-14T13:03:52.055 INFO:teuthology.orchestra.run.smithi154.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.26882.log.gz 2024-09-14T13:03:52.055 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.4.log 2024-09-14T13:03:52.055 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph.audit.log: /var/log/ceph/ceph-mon.b.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.26858.log 2024-09-14T13:03:52.055 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-osd.4.log: 90.9% -- replaced with /var/log/ceph/ceph.audit.log.gz 2024-09-14T13:03:52.062 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.26810.log 2024-09-14T13:03:52.062 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.26858.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.26858.log.gz 2024-09-14T13:03:52.062 INFO:teuthology.orchestra.run.smithi154.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.26834.log 2024-09-14T13:03:52.062 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.26810.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.26810.log.gz 2024-09-14T13:03:52.062 INFO:teuthology.orchestra.run.smithi154.stderr:/var/log/ceph/ceph-client.admin.26834.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.26834.log.gz 2024-09-14T13:03:52.062 INFO:teuthology.orchestra.run.smithi154.stderr: 88.4% -- replaced with /var/log/ceph/ceph.log.gz 2024-09-14T13:03:52.068 INFO:teuthology.orchestra.run.smithi138.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.96723.log 2024-09-14T13:03:52.068 INFO:teuthology.orchestra.run.smithi138.stderr:/var/log/ceph/ceph-client.admin.182408.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.155799.log 2024-09-14T13:03:52.068 INFO:teuthology.orchestra.run.smithi138.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.182408.log.gz 2024-09-14T13:03:52.068 INFO:teuthology.orchestra.run.smithi138.stderr: 95.2% -- replaced with /var/log/ceph/ceph-client.admin.60499.log.gz 2024-09-14T13:03:52.068 INFO:teuthology.orchestra.run.smithi138.stderr:/var/log/ceph/ceph-client.admin.96723.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.139796.log 2024-09-14T13:03:52.068 INFO:teuthology.orchestra.run.smithi138.stderr: 87.4%/var/log/ceph/ceph-client.admin.155799.log: -- replaced with /var/log/ceph/ceph-client.admin.96723.log.gzgzip -5 --verbose -- /var/log/ceph/ceph-client.admin.125634.log 2024-09-14T13:03:52.068 INFO:teuthology.orchestra.run.smithi138.stderr: 2024-09-14T13:03:52.068 INFO:teuthology.orchestra.run.smithi138.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.155799.log.gz 2024-09-14T13:03:52.069 INFO:teuthology.orchestra.run.smithi138.stderr:/var/log/ceph/ceph-client.admin.139796.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.93183.log 2024-09-14T13:03:52.069 INFO:teuthology.orchestra.run.smithi138.stderr: 82.0% -- replaced with /var/log/ceph/ceph-client.admin.139796.log.gz 2024-09-14T13:03:52.069 INFO:teuthology.orchestra.run.smithi138.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51760.log 2024-09-14T13:03:52.069 INFO:teuthology.orchestra.run.smithi138.stderr:/var/log/ceph/ceph-client.admin.125634.log: gzip/var/log/ceph/ceph-client.admin.93183.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.44015.log 2024-09-14T13:03:52.069 INFO:teuthology.orchestra.run.smithi138.stderr: 81.9%/var/log/ceph/ceph-client.admin.51760.log: -- replaced with /var/log/ceph/ceph-client.admin.93183.log.gz 2024-09-14T13:03:52.069 INFO:teuthology.orchestra.run.smithi138.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.143336.log 2024-09-14T13:03:52.069 INFO:teuthology.orchestra.run.smithi138.stderr: 85.6% -- replaced with /var/log/ceph/ceph-client.admin.51760.log.gz 2024-09-14T13:03:52.069 INFO:teuthology.orchestra.run.smithi138.stderr: 93.1% -- replaced with /var/log/ceph/ceph-client.admin.58563.log.gz 2024-09-14T13:03:52.069 INFO:teuthology.orchestra.run.smithi138.stderr:/var/log/ceph/ceph-client.admin.44015.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.44015.log.gz 2024-09-14T13:03:52.069 INFO:teuthology.orchestra.run.smithi138.stderr: 86.3% -- replaced with /var/log/ceph/ceph-client.admin.125634.log.gz 2024-09-14T13:03:52.069 INFO:teuthology.orchestra.run.smithi138.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.167722.log 2024-09-14T13:03:52.069 INFO:teuthology.orchestra.run.smithi138.stderr:/var/log/ceph/ceph-client.admin.143336.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.147467.log 2024-09-14T13:03:52.069 INFO:teuthology.orchestra.run.smithi138.stderr: 85.7% -- replaced with /var/log/ceph/ceph-client.admin.143336.log.gz 2024-09-14T13:03:52.070 INFO:teuthology.orchestra.run.smithi138.stderr:/var/log/ceph/ceph-client.0.167722.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.122094.log 2024-09-14T13:03:52.070 INFO:teuthology.orchestra.run.smithi138.stderr: 84.1% -- replaced with /var/log/ceph/ceph-client.0.167722.log.gz 2024-09-14T13:03:52.070 INFO:teuthology.orchestra.run.smithi138.stderr:/var/log/ceph/ceph-client.admin.147467.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32758.log 2024-09-14T13:03:52.070 INFO:teuthology.orchestra.run.smithi138.stderr: 81.8% -- replaced with /var/log/ceph/ceph-client.admin.147467.log.gz 2024-09-14T13:03:52.070 INFO:teuthology.orchestra.run.smithi138.stderr:/var/log/ceph/ceph-client.admin.122094.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.162141.log 2024-09-14T13:03:52.070 INFO:teuthology.orchestra.run.smithi138.stderr: 81.9% -- replaced with /var/log/ceph/ceph-client.admin.122094.log.gz 2024-09-14T13:03:52.070 INFO:teuthology.orchestra.run.smithi138.stderr:/var/log/ceph/ceph-client.admin.32758.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.139205.log 2024-09-14T13:03:52.070 INFO:teuthology.orchestra.run.smithi138.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32758.log.gz 2024-09-14T13:03:52.070 INFO:teuthology.orchestra.run.smithi138.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.2.log 2024-09-14T13:03:52.070 INFO:teuthology.orchestra.run.smithi138.stderr:/var/log/ceph/ceph-client.admin.162141.log: /var/log/ceph/ceph-client.admin.139205.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.179414.log 2024-09-14T13:03:52.070 INFO:teuthology.orchestra.run.smithi138.stderr: 92.4% -- replaced with /var/log/ceph/ceph-client.admin.162141.log.gz 2024-09-14T13:03:52.070 INFO:teuthology.orchestra.run.smithi138.stderr: 85.5% -- replaced with /var/log/ceph/ceph-client.admin.139205.log.gz 2024-09-14T13:03:52.070 INFO:teuthology.orchestra.run.smithi138.stderr:/var/log/ceph/ceph-osd.2.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.35497.log 2024-09-14T13:03:52.070 INFO:teuthology.orchestra.run.smithi138.stderr:/var/log/ceph/ceph-client.admin.179414.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45220.log 2024-09-14T13:03:52.071 INFO:teuthology.orchestra.run.smithi138.stderr: 24.6% -- replaced with /var/log/ceph/ceph-client.admin.179414.log.gz 2024-09-14T13:03:52.071 INFO:teuthology.orchestra.run.smithi138.stderr:/var/log/ceph/ceph-client.0.35497.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41605.log 2024-09-14T13:03:52.071 INFO:teuthology.orchestra.run.smithi138.stderr: 81.1% -- replaced with /var/log/ceph/ceph-client.0.35497.log.gz 2024-09-14T13:03:52.071 INFO:teuthology.orchestra.run.smithi138.stderr:/var/log/ceph/ceph-client.admin.45220.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.87870.log 2024-09-14T13:03:52.071 INFO:teuthology.orchestra.run.smithi138.stderr: 84.5% -- replaced with /var/log/ceph/ceph-client.admin.45220.log.gz 2024-09-14T13:03:52.071 INFO:teuthology.orchestra.run.smithi138.stderr:/var/log/ceph/ceph-client.admin.41605.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.178161.log 2024-09-14T13:03:52.071 INFO:teuthology.orchestra.run.smithi138.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.41605.log.gz 2024-09-14T13:03:52.071 INFO:teuthology.orchestra.run.smithi138.stderr:/var/log/ceph/ceph-client.admin.87870.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33199.log 2024-09-14T13:03:52.071 INFO:teuthology.orchestra.run.smithi138.stderr: 82.1% -- replaced with /var/log/ceph/ceph-client.admin.87870.log.gz 2024-09-14T13:03:52.071 INFO:teuthology.orchestra.run.smithi138.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.174212.log 2024-09-14T13:03:52.071 INFO:teuthology.orchestra.run.smithi138.stderr:/var/log/ceph/ceph-client.admin.178161.log: /var/log/ceph/ceph-client.admin.33199.log: 85.6%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.125044.log 2024-09-14T13:03:52.071 INFO:teuthology.orchestra.run.smithi138.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.33199.log.gz 2024-09-14T13:03:52.071 INFO:teuthology.orchestra.run.smithi138.stderr: -- replaced with /var/log/ceph/ceph-client.admin.178161.log.gz 2024-09-14T13:03:52.072 INFO:teuthology.orchestra.run.smithi138.stderr:/var/log/ceph/ceph-client.0.174212.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.68882.log 2024-09-14T13:03:52.072 INFO:teuthology.orchestra.run.smithi138.stderr:/var/log/ceph/ceph-client.admin.125044.log: gzip 84.5% -5 -- replaced with /var/log/ceph/ceph-client.0.174212.log.gz --verbose 2024-09-14T13:03:52.072 INFO:teuthology.orchestra.run.smithi138.stderr: -- /var/log/ceph/ceph-mon.a.log 2024-09-14T13:03:52.072 INFO:teuthology.orchestra.run.smithi138.stderr: 82.3% -- replaced with /var/log/ceph/ceph-client.admin.125044.log.gz 2024-09-14T13:03:52.072 INFO:teuthology.orchestra.run.smithi138.stderr:/var/log/ceph/ceph-client.0.68882.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34204.log 2024-09-14T13:03:52.072 INFO:teuthology.orchestra.run.smithi138.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.80198.log 2024-09-14T13:03:52.072 INFO:teuthology.orchestra.run.smithi138.stderr:/var/log/ceph/ceph-mon.a.log: /var/log/ceph/ceph-client.admin.34204.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.113834.log 2024-09-14T13:03:52.072 INFO:teuthology.orchestra.run.smithi138.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.34204.log.gz 2024-09-14T13:03:52.072 INFO:teuthology.orchestra.run.smithi138.stderr:/var/log/ceph/ceph-client.admin.80198.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.80198.log.gz 2024-09-14T13:03:52.072 INFO:teuthology.orchestra.run.smithi138.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.130355.log 2024-09-14T13:03:52.072 INFO:teuthology.orchestra.run.smithi138.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51170.log 2024-09-14T13:03:52.072 INFO:teuthology.orchestra.run.smithi138.stderr:/var/log/ceph/ceph-client.admin.113834.log: 92.1% -- replaced with /var/log/ceph/ceph-client.0.68882.log.gz 2024-09-14T13:03:52.072 INFO:teuthology.orchestra.run.smithi138.stderr: 82.0% -- replaced with /var/log/ceph/ceph-client.admin.113834.log.gz 2024-09-14T13:03:52.072 INFO:teuthology.orchestra.run.smithi138.stderr:/var/log/ceph/ceph-client.admin.130355.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49350.log 2024-09-14T13:03:52.073 INFO:teuthology.orchestra.run.smithi138.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.130355.log.gz 2024-09-14T13:03:52.073 INFO:teuthology.orchestra.run.smithi138.stderr:/var/log/ceph/ceph-client.admin.51170.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.121504.log 2024-09-14T13:03:52.073 INFO:teuthology.orchestra.run.smithi138.stderr: 86.0% -- replaced with /var/log/ceph/ceph-client.admin.51170.log.gzgzip -5 --verbose -- /var/log/ceph/ceph-client.admin.113243.log 2024-09-14T13:03:52.073 INFO:teuthology.orchestra.run.smithi138.stderr: 2024-09-14T13:03:52.073 INFO:teuthology.orchestra.run.smithi138.stderr:/var/log/ceph/ceph-client.admin.49350.log: /var/log/ceph/ceph-client.admin.121504.log: 84.5% -- replaced with /var/log/ceph/ceph-client.admin.49350.log.gz 2024-09-14T13:03:52.073 INFO:teuthology.orchestra.run.smithi138.stderr: 82.1% -- replaced with /var/log/ceph/ceph-client.admin.121504.log.gz 2024-09-14T13:03:52.073 INFO:teuthology.orchestra.run.smithi138.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.148647.log 2024-09-14T13:03:52.073 INFO:teuthology.orchestra.run.smithi138.stderr:/var/log/ceph/ceph-client.admin.113243.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.76068.log 2024-09-14T13:03:52.073 INFO:teuthology.orchestra.run.smithi138.stderr:/var/log/ceph/ceph-client.admin.148647.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.149237.log 2024-09-14T13:03:52.073 INFO:teuthology.orchestra.run.smithi138.stderr: 82.1% -- replaced with /var/log/ceph/ceph-client.admin.148647.log.gz 2024-09-14T13:03:52.073 INFO:teuthology.orchestra.run.smithi138.stderr:/var/log/ceph/ceph-client.admin.76068.log: 81.9% -- replaced with /var/log/ceph/ceph-client.admin.76068.log.gz 2024-09-14T13:03:52.073 INFO:teuthology.orchestra.run.smithi138.stderr: 87.4%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49965.log 2024-09-14T13:03:52.073 INFO:teuthology.orchestra.run.smithi138.stderr: -- replaced with /var/log/ceph/ceph-client.admin.113243.log.gz 2024-09-14T13:03:52.073 INFO:teuthology.orchestra.run.smithi138.stderr:/var/log/ceph/ceph-client.admin.149237.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39810.log 2024-09-14T13:03:52.073 INFO:teuthology.orchestra.run.smithi138.stderr: 89.1%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.148057.log 2024-09-14T13:03:52.074 INFO:teuthology.orchestra.run.smithi138.stderr: -- replaced with /var/log/ceph/ceph-client.admin.149237.log.gz 2024-09-14T13:03:52.074 INFO:teuthology.orchestra.run.smithi138.stderr:/var/log/ceph/ceph-client.admin.49965.log: /var/log/ceph/ceph-client.admin.39810.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.49965.log.gz 2024-09-14T13:03:52.074 INFO:teuthology.orchestra.run.smithi138.stderr: 83.6% -- replaced with /var/log/ceph/ceph-client.admin.39810.log.gz 2024-09-14T13:03:52.074 INFO:teuthology.orchestra.run.smithi138.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.182148.log 2024-09-14T13:03:52.074 INFO:teuthology.orchestra.run.smithi138.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.71348.log 2024-09-14T13:03:52.074 INFO:teuthology.orchestra.run.smithi138.stderr:/var/log/ceph/ceph-client.admin.148057.log: /var/log/ceph/ceph-client.admin.182148.log: 85.7% -- replaced with /var/log/ceph/ceph-client.admin.148057.log.gz 2024-09-14T13:03:52.074 INFO:teuthology.orchestra.run.smithi138.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.71938.log 2024-09-14T13:03:52.074 INFO:teuthology.orchestra.run.smithi138.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.182148.log.gz 2024-09-14T13:03:52.074 INFO:teuthology.orchestra.run.smithi138.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.114424.log 2024-09-14T13:03:52.074 INFO:teuthology.orchestra.run.smithi138.stderr:/var/log/ceph/ceph-client.admin.71348.log: /var/log/ceph/ceph-client.admin.71938.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.69472.log 2024-09-14T13:03:52.074 INFO:teuthology.orchestra.run.smithi138.stderr: 81.1%/var/log/ceph/ceph-client.admin.114424.log: -- replaced with /var/log/ceph/ceph-client.admin.71938.log.gz 2024-09-14T13:03:52.074 INFO:teuthology.orchestra.run.smithi138.stderr: 81.9% -- replaced with /var/log/ceph/ceph-client.admin.71348.log.gz 2024-09-14T13:03:52.074 INFO:teuthology.orchestra.run.smithi138.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.157619.log 2024-09-14T13:03:52.075 INFO:teuthology.orchestra.run.smithi138.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.114424.log.gz 2024-09-14T13:03:52.075 INFO:teuthology.orchestra.run.smithi138.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62436.log 2024-09-14T13:03:52.075 INFO:teuthology.orchestra.run.smithi138.stderr:/var/log/ceph/ceph-client.0.69472.log: /var/log/ceph/ceph-client.admin.157619.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.79608.log 2024-09-14T13:03:52.082 INFO:teuthology.orchestra.run.smithi138.stderr: 82.1% -- replaced with /var/log/ceph/ceph-client.admin.157619.log.gz/var/log/ceph/ceph-client.admin.62436.log: 79.5% -- replaced with /var/log/ceph/ceph-client.0.69472.log.gz 2024-09-14T13:03:52.082 INFO:teuthology.orchestra.run.smithi138.stderr: 2024-09-14T13:03:52.082 INFO:teuthology.orchestra.run.smithi138.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.80788.log 2024-09-14T13:03:52.082 INFO:teuthology.orchestra.run.smithi138.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.182538.log 2024-09-14T13:03:52.082 INFO:teuthology.orchestra.run.smithi138.stderr:/var/log/ceph/ceph-client.admin.79608.log: /var/log/ceph/ceph-client.admin.80788.log: 82.3% 89.0% -- replaced with /var/log/ceph/ceph-client.admin.62436.log.gz 2024-09-14T13:03:52.082 INFO:teuthology.orchestra.run.smithi138.stderr: 82.4% -- replaced with /var/log/ceph/ceph-client.admin.79608.log.gz 2024-09-14T13:03:52.083 INFO:teuthology.orchestra.run.smithi138.stderr: -- replaced with /var/log/ceph/ceph-client.admin.80788.log.gz 2024-09-14T13:03:52.083 INFO:teuthology.orchestra.run.smithi138.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.120324.log 2024-09-14T13:03:52.083 INFO:teuthology.orchestra.run.smithi138.stderr:/var/log/ceph/ceph-client.admin.182538.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.161552.log 2024-09-14T13:03:52.083 INFO:teuthology.orchestra.run.smithi138.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.182538.log.gz 2024-09-14T13:03:52.083 INFO:teuthology.orchestra.run.smithi138.stderr:/var/log/ceph/ceph-client.admin.120324.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.182616.log 2024-09-14T13:03:52.083 INFO:teuthology.orchestra.run.smithi138.stderr: 81.4% -- replaced with /var/log/ceph/ceph-client.admin.120324.log.gz 2024-09-14T13:03:52.083 INFO:teuthology.orchestra.run.smithi138.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.92593.log 2024-09-14T13:03:52.083 INFO:teuthology.orchestra.run.smithi138.stderr:/var/log/ceph/ceph-client.admin.161552.log: /var/log/ceph/ceph-client.admin.182616.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.182616.log.gz 2024-09-14T13:03:52.083 INFO:teuthology.orchestra.run.smithi138.stderr: 92.4% -- replaced with /var/log/ceph/ceph-client.admin.161552.log.gz 2024-09-14T13:03:52.083 INFO:teuthology.orchestra.run.smithi138.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65796.log 2024-09-14T13:03:52.083 INFO:teuthology.orchestra.run.smithi138.stderr:/var/log/ceph/ceph-client.admin.92593.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55392.log 2024-09-14T13:03:52.083 INFO:teuthology.orchestra.run.smithi138.stderr: 82.2% -- replaced with /var/log/ceph/ceph-client.admin.92593.log.gz 2024-09-14T13:03:52.083 INFO:teuthology.orchestra.run.smithi138.stderr:/var/log/ceph/ceph-client.admin.65796.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64612.log 2024-09-14T13:03:52.083 INFO:teuthology.orchestra.run.smithi138.stderr:/var/log/ceph/ceph-client.admin.55392.log: 91.6% -- replaced with /var/log/ceph/ceph-client.admin.65796.log.gz 2024-09-14T13:03:52.084 INFO:teuthology.orchestra.run.smithi138.stderr: 84.1% -- replaced with /var/log/ceph/ceph-client.admin.55392.log.gz 2024-09-14T13:03:52.084 INFO:teuthology.orchestra.run.smithi138.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48170.log 2024-09-14T13:03:52.084 INFO:teuthology.orchestra.run.smithi138.stderr:/var/log/ceph/ceph-client.admin.64612.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.90230.log 2024-09-14T13:03:52.084 INFO:teuthology.orchestra.run.smithi138.stderr:/var/log/ceph/ceph-client.admin.48170.log: 81.5% -- replaced with /var/log/ceph/ceph-client.admin.64612.log.gz 2024-09-14T13:03:52.084 INFO:teuthology.orchestra.run.smithi138.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.133305.log 2024-09-14T13:03:52.084 INFO:teuthology.orchestra.run.smithi138.stderr: 85.8% -- replaced with /var/log/ceph/ceph-client.admin.48170.log.gz 2024-09-14T13:03:52.084 INFO:teuthology.orchestra.run.smithi138.stderr:/var/log/ceph/ceph-client.admin.90230.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.103803.log 2024-09-14T13:03:52.084 INFO:teuthology.orchestra.run.smithi138.stderr:/var/log/ceph/ceph-client.admin.133305.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32679.log 2024-09-14T13:03:52.084 INFO:teuthology.orchestra.run.smithi138.stderr: 86.4% -- replaced with /var/log/ceph/ceph-client.admin.90230.log.gz 2024-09-14T13:03:52.084 INFO:teuthology.orchestra.run.smithi138.stderr:/var/log/ceph/ceph-client.admin.103803.log: 82.2% -- replaced with /var/log/ceph/ceph-client.admin.133305.log.gz 2024-09-14T13:03:52.084 INFO:teuthology.orchestra.run.smithi138.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.156414.log 2024-09-14T13:03:52.084 INFO:teuthology.orchestra.run.smithi138.stderr: 82.1% -- replaced with /var/log/ceph/ceph-client.admin.103803.log.gz 2024-09-14T13:03:52.084 INFO:teuthology.orchestra.run.smithi138.stderr:/var/log/ceph/ceph-client.admin.32679.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32679.log.gz 2024-09-14T13:03:52.085 INFO:teuthology.orchestra.run.smithi138.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.36671.log 2024-09-14T13:03:52.085 INFO:teuthology.orchestra.run.smithi138.stderr:/var/log/ceph/ceph-client.admin.156414.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.103213.log 2024-09-14T13:03:52.085 INFO:teuthology.orchestra.run.smithi138.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.156414.log.gz 2024-09-14T13:03:52.085 INFO:teuthology.orchestra.run.smithi138.stderr:/var/log/ceph/ceph-client.0.36671.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32757.log 2024-09-14T13:03:52.085 INFO:teuthology.orchestra.run.smithi138.stderr: 43.9% -- replaced with /var/log/ceph/ceph-client.0.36671.log.gz 2024-09-14T13:03:52.085 INFO:teuthology.orchestra.run.smithi138.stderr:/var/log/ceph/ceph-client.admin.103213.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.103213.log.gz 2024-09-14T13:03:52.085 INFO:teuthology.orchestra.run.smithi138.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.140976.log 2024-09-14T13:03:52.085 INFO:teuthology.orchestra.run.smithi138.stderr:/var/log/ceph/ceph-client.admin.32757.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.74298.log 2024-09-14T13:03:52.085 INFO:teuthology.orchestra.run.smithi138.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32757.log.gz 2024-09-14T13:03:52.085 INFO:teuthology.orchestra.run.smithi138.stderr:/var/log/ceph/ceph-client.admin.140976.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47580.log 2024-09-14T13:03:52.085 INFO:teuthology.orchestra.run.smithi138.stderr: 81.9% -- replaced with /var/log/ceph/ceph-client.admin.140976.log.gz 2024-09-14T13:03:52.085 INFO:teuthology.orchestra.run.smithi138.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.3.log 2024-09-14T13:03:52.085 INFO:teuthology.orchestra.run.smithi138.stderr:/var/log/ceph/ceph-client.admin.74298.log: /var/log/ceph/ceph-client.admin.47580.log: 81.9% -- replaced with /var/log/ceph/ceph-client.admin.74298.log.gz 2024-09-14T13:03:52.085 INFO:teuthology.orchestra.run.smithi138.stderr: 84.3% -- replaced with /var/log/ceph/ceph-client.admin.47580.log.gz 2024-09-14T13:03:52.085 INFO:teuthology.orchestra.run.smithi138.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.182590.log 2024-09-14T13:03:52.090 INFO:teuthology.orchestra.run.smithi138.stderr:/var/log/ceph/ceph-osd.3.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32584.log 2024-09-14T13:03:52.090 INFO:teuthology.orchestra.run.smithi138.stderr:/var/log/ceph/ceph-client.admin.182590.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55358.log 2024-09-14T13:03:52.090 INFO:teuthology.orchestra.run.smithi138.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.182590.log.gz 2024-09-14T13:03:52.090 INFO:teuthology.orchestra.run.smithi138.stderr:/var/log/ceph/ceph-client.admin.32584.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32584.log.gz 2024-09-14T13:03:52.090 INFO:teuthology.orchestra.run.smithi138.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.83148.log 2024-09-14T13:03:52.090 INFO:teuthology.orchestra.run.smithi138.stderr:/var/log/ceph/ceph-client.admin.55358.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54267.log 2024-09-14T13:03:52.090 INFO:teuthology.orchestra.run.smithi138.stderr: 19.9% -- replaced with /var/log/ceph/ceph-client.admin.55358.log.gz 2024-09-14T13:03:52.090 INFO:teuthology.orchestra.run.smithi138.stderr:/var/log/ceph/ceph-client.admin.83148.log: 81.8% -- replaced with /var/log/ceph/ceph-client.admin.83148.log.gz 2024-09-14T13:03:52.090 INFO:teuthology.orchestra.run.smithi138.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.97903.log 2024-09-14T13:03:52.090 INFO:teuthology.orchestra.run.smithi138.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.73118.log 2024-09-14T13:03:52.090 INFO:teuthology.orchestra.run.smithi138.stderr:/var/log/ceph/ceph-client.admin.54267.log: /var/log/ceph/ceph-client.admin.97903.log: 59.6% -- replaced with /var/log/ceph/ceph-client.admin.54267.log.gz 2024-09-14T13:03:52.090 INFO:teuthology.orchestra.run.smithi138.stderr: 82.1% -- replaced with /var/log/ceph/ceph-client.admin.97903.log.gz 2024-09-14T13:03:52.090 INFO:teuthology.orchestra.run.smithi138.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.106163.log 2024-09-14T13:03:52.091 INFO:teuthology.orchestra.run.smithi138.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.137435.log 2024-09-14T13:03:52.091 INFO:teuthology.orchestra.run.smithi138.stderr:/var/log/ceph/ceph-client.admin.73118.log: /var/log/ceph/ceph-client.admin.106163.log: 82.0% -- replaced with /var/log/ceph/ceph-client.admin.73118.log.gz 2024-09-14T13:03:52.091 INFO:teuthology.orchestra.run.smithi138.stderr: 81.4% -- replaced with /var/log/ceph/ceph-client.admin.106163.log.gz 2024-09-14T13:03:52.091 INFO:teuthology.orchestra.run.smithi138.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.175392.log 2024-09-14T13:03:52.091 INFO:teuthology.orchestra.run.smithi138.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.70758.log 2024-09-14T13:03:52.091 INFO:teuthology.orchestra.run.smithi138.stderr:/var/log/ceph/ceph-client.admin.137435.log: /var/log/ceph/ceph-client.0.175392.log: 82.1% -- replaced with /var/log/ceph/ceph-client.admin.137435.log.gz 2024-09-14T13:03:52.091 INFO:teuthology.orchestra.run.smithi138.stderr:gzip 84.2% -5 --verbose -- /var/log/ceph/ceph-client.admin.32627.log 2024-09-14T13:03:52.091 INFO:teuthology.orchestra.run.smithi138.stderr: -- replaced with /var/log/ceph/ceph-client.0.175392.log.gz 2024-09-14T13:03:52.091 INFO:teuthology.orchestra.run.smithi138.stderr:/var/log/ceph/ceph-client.admin.70758.log: 82.3% -- replaced with /var/log/ceph/ceph-client.admin.70758.log.gz 2024-09-14T13:03:52.092 INFO:teuthology.orchestra.run.smithi138.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.149827.log 2024-09-14T13:03:52.092 INFO:teuthology.orchestra.run.smithi138.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63082.log 2024-09-14T13:03:52.093 INFO:teuthology.orchestra.run.smithi138.stderr:/var/log/ceph/ceph-client.admin.32627.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32627.log.gz 2024-09-14T13:03:52.093 INFO:teuthology.orchestra.run.smithi138.stderr:/var/log/ceph/ceph-client.admin.149827.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.67620.log 2024-09-14T13:03:52.093 INFO:teuthology.orchestra.run.smithi138.stderr: 82.1% -- replaced with /var/log/ceph/ceph-client.admin.149827.log.gz 2024-09-14T13:03:52.093 INFO:teuthology.orchestra.run.smithi138.stderr:/var/log/ceph/ceph-client.admin.63082.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.100853.log 2024-09-14T13:03:52.093 INFO:teuthology.orchestra.run.smithi138.stderr:/var/log/ceph/ceph-client.0.67620.log: 84.2% -- replaced with /var/log/ceph/ceph-client.0.67620.log.gz 2024-09-14T13:03:52.094 INFO:teuthology.orchestra.run.smithi138.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32750.log 2024-09-14T13:03:52.094 INFO:teuthology.orchestra.run.smithi138.stderr:/var/log/ceph/ceph-client.admin.100853.log: 82.0% -- replaced with /var/log/ceph/ceph-client.admin.100853.log.gz 2024-09-14T13:03:52.095 INFO:teuthology.orchestra.run.smithi138.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.182304.log 2024-09-14T13:03:52.096 INFO:teuthology.orchestra.run.smithi138.stderr: 92.2% -- replaced with /var/log/ceph/ceph-client.admin.63082.log.gz 2024-09-14T13:03:52.096 INFO:teuthology.orchestra.run.smithi138.stderr:/var/log/ceph/ceph-client.admin.32750.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32750.log.gz 2024-09-14T13:03:52.096 INFO:teuthology.orchestra.run.smithi138.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.111473.log 2024-09-14T13:03:52.096 INFO:teuthology.orchestra.run.smithi138.stderr:/var/log/ceph/ceph-client.admin.182304.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41580.log 2024-09-14T13:03:52.096 INFO:teuthology.orchestra.run.smithi138.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.182304.log.gz 2024-09-14T13:03:52.097 INFO:teuthology.orchestra.run.smithi138.stderr:/var/log/ceph/ceph-client.admin.111473.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.111473.log.gz 2024-09-14T13:03:52.097 INFO:teuthology.orchestra.run.smithi138.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40400.log 2024-09-14T13:03:52.098 INFO:teuthology.orchestra.run.smithi138.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52350.log 2024-09-14T13:03:52.098 INFO:teuthology.orchestra.run.smithi138.stderr:/var/log/ceph/ceph-client.admin.41580.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.41580.log.gz 2024-09-14T13:03:52.099 INFO:teuthology.orchestra.run.smithi138.stderr:/var/log/ceph/ceph-client.admin.40400.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.129175.log 2024-09-14T13:03:52.099 INFO:teuthology.orchestra.run.smithi138.stderr: 82.0% -- replaced with /var/log/ceph/ceph-client.admin.40400.log.gz 2024-09-14T13:03:52.099 INFO:teuthology.orchestra.run.smithi138.stderr:/var/log/ceph/ceph-client.admin.52350.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.52350.log.gz 2024-09-14T13:03:52.100 INFO:teuthology.orchestra.run.smithi138.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.179513.log 2024-09-14T13:03:52.100 INFO:teuthology.orchestra.run.smithi138.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32755.log 2024-09-14T13:03:52.101 INFO:teuthology.orchestra.run.smithi138.stderr:/var/log/ceph/ceph-client.admin.129175.log: /var/log/ceph/ceph-client.admin.179513.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.129175.log.gz 2024-09-14T13:03:52.101 INFO:teuthology.orchestra.run.smithi138.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.179513.log.gz 2024-09-14T13:03:52.101 INFO:teuthology.orchestra.run.smithi138.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49990.log 2024-09-14T13:03:52.102 INFO:teuthology.orchestra.run.smithi138.stderr:gzip -5 --verbose -- /var/log/ceph/ops-log-ceph-client.admin.log 2024-09-14T13:03:52.102 INFO:teuthology.orchestra.run.smithi138.stderr:/var/log/ceph/ceph-client.admin.32755.log: /var/log/ceph/ceph-client.admin.49990.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32755.log.gz 2024-09-14T13:03:52.102 INFO:teuthology.orchestra.run.smithi138.stderr: 85.6% -- replaced with /var/log/ceph/ceph-client.admin.49990.log.gzgzip -5 --verbose -- /var/log/ceph/ceph-client.admin.75478.log 2024-09-14T13:03:52.102 INFO:teuthology.orchestra.run.smithi138.stderr: 2024-09-14T13:03:52.107 INFO:teuthology.orchestra.run.smithi138.stderr:/var/log/ceph/ops-log-ceph-client.admin.log: 94.1% -- replaced with /var/log/ceph/ops-log-ceph-client.admin.log.gz 2024-09-14T13:03:52.107 INFO:teuthology.orchestra.run.smithi138.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.160963.log 2024-09-14T13:03:52.108 INFO:teuthology.orchestra.run.smithi138.stderr:/var/log/ceph/ceph-client.admin.75478.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.146286.log 2024-09-14T13:03:52.109 INFO:teuthology.orchestra.run.smithi138.stderr:/var/log/ceph/ceph-client.admin.160963.log: 90.0% -- replaced with /var/log/ceph/ceph-client.admin.75478.log.gz 2024-09-14T13:03:52.109 INFO:teuthology.orchestra.run.smithi138.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.1.log 2024-09-14T13:03:52.110 INFO:teuthology.orchestra.run.smithi138.stderr:/var/log/ceph/ceph-client.admin.146286.log: 82.5% -- replaced with /var/log/ceph/ceph-client.admin.146286.log.gz 2024-09-14T13:03:52.110 INFO:teuthology.orchestra.run.smithi138.stderr: 94.1% -- replaced with /var/log/ceph/ceph-client.admin.160963.log.gz 2024-09-14T13:03:52.110 INFO:teuthology.orchestra.run.smithi138.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.132125.log 2024-09-14T13:03:52.111 INFO:teuthology.orchestra.run.smithi138.stderr:/var/log/ceph/ceph-osd.1.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52990.log 2024-09-14T13:03:52.111 INFO:teuthology.orchestra.run.smithi138.stderr:/var/log/ceph/ceph-client.admin.132125.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.132125.log.gz 2024-09-14T13:03:52.112 INFO:teuthology.orchestra.run.smithi138.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.112063.log 2024-09-14T13:03:52.113 INFO:teuthology.orchestra.run.smithi138.stderr:/var/log/ceph/ceph-client.admin.52990.log: 86.6% -- replaced with /var/log/ceph/ceph-client.admin.52990.log.gz 2024-09-14T13:03:52.113 INFO:teuthology.orchestra.run.smithi138.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33147.log 2024-09-14T13:03:52.114 INFO:teuthology.orchestra.run.smithi138.stderr:/var/log/ceph/ceph-client.admin.112063.log: 82.4% -- replaced with /var/log/ceph/ceph-client.admin.112063.log.gz 2024-09-14T13:03:52.114 INFO:teuthology.orchestra.run.smithi138.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.128585.log 2024-09-14T13:03:52.115 INFO:teuthology.orchestra.run.smithi138.stderr:/var/log/ceph/ceph-client.admin.33147.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.33147.log.gz 2024-09-14T13:03:52.115 INFO:teuthology.orchestra.run.smithi138.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.176572.log 2024-09-14T13:03:52.116 INFO:teuthology.orchestra.run.smithi138.stderr:/var/log/ceph/ceph-client.admin.128585.log: 82.0% -- replaced with /var/log/ceph/ceph-client.admin.128585.log.gz 2024-09-14T13:03:52.117 INFO:teuthology.orchestra.run.smithi138.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.163457.log 2024-09-14T13:03:52.118 INFO:teuthology.orchestra.run.smithi138.stderr:/var/log/ceph/ceph-client.0.176572.log: 81.0% -- replaced with /var/log/ceph/ceph-client.0.176572.log.gz 2024-09-14T13:03:52.118 INFO:teuthology.orchestra.run.smithi138.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32965.log 2024-09-14T13:03:52.119 INFO:teuthology.orchestra.run.smithi138.stderr:/var/log/ceph/ceph-client.admin.163457.log: 92.5% -- replaced with /var/log/ceph/ceph-client.admin.163457.log.gz 2024-09-14T13:03:52.119 INFO:teuthology.orchestra.run.smithi138.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.119144.log 2024-09-14T13:03:52.120 INFO:teuthology.orchestra.run.smithi138.stderr:/var/log/ceph/ceph-client.admin.32965.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32965.log.gz 2024-09-14T13:03:52.121 INFO:teuthology.orchestra.run.smithi138.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.182330.log 2024-09-14T13:03:52.123 INFO:teuthology.orchestra.run.smithi138.stderr:/var/log/ceph/ceph-client.admin.119144.log: 86.2% -- replaced with /var/log/ceph/ceph-client.admin.119144.log.gz 2024-09-14T13:03:52.123 INFO:teuthology.orchestra.run.smithi138.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.136255.log 2024-09-14T13:03:52.124 INFO:teuthology.orchestra.run.smithi138.stderr:/var/log/ceph/ceph-client.admin.182330.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.182330.log.gz 2024-09-14T13:03:52.124 INFO:teuthology.orchestra.run.smithi138.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.100263.log 2024-09-14T13:03:52.125 INFO:teuthology.orchestra.run.smithi138.stderr:/var/log/ceph/ceph-client.admin.136255.log: 82.1% -- replaced with /var/log/ceph/ceph-client.admin.136255.log.gz 2024-09-14T13:03:52.125 INFO:teuthology.orchestra.run.smithi138.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.99083.log 2024-09-14T13:03:52.126 INFO:teuthology.orchestra.run.smithi138.stderr:/var/log/ceph/ceph-client.admin.100263.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.100263.log.gz 2024-09-14T13:03:52.127 INFO:teuthology.orchestra.run.smithi138.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.34323.log 2024-09-14T13:03:52.128 INFO:teuthology.orchestra.run.smithi138.stderr:/var/log/ceph/ceph-client.admin.99083.log: 82.0% -- replaced with /var/log/ceph/ceph-client.admin.99083.log.gz 2024-09-14T13:03:52.128 INFO:teuthology.orchestra.run.smithi138.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63733.log 2024-09-14T13:03:52.130 INFO:teuthology.orchestra.run.smithi138.stderr:/var/log/ceph/ceph-client.0.34323.log: 96.0% -- replaced with /var/log/ceph/ceph-client.0.34323.log.gz 2024-09-14T13:03:52.130 INFO:teuthology.orchestra.run.smithi138.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32559.log 2024-09-14T13:03:52.131 INFO:teuthology.orchestra.run.smithi138.stderr:/var/log/ceph/ceph-client.admin.63733.log: 84.4% -- replaced with /var/log/ceph/ceph-client.admin.63733.log.gz 2024-09-14T13:03:52.131 INFO:teuthology.orchestra.run.smithi138.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.131535.log 2024-09-14T13:03:52.132 INFO:teuthology.orchestra.run.smithi154.stderr: 95.2% -- replaced with /var/log/ceph/ceph-mgr.x.log.gz 2024-09-14T13:03:52.133 INFO:teuthology.orchestra.run.smithi138.stderr:/var/log/ceph/ceph-client.admin.32559.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32559.log.gz 2024-09-14T13:03:52.133 INFO:teuthology.orchestra.run.smithi138.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.134485.log 2024-09-14T13:03:52.133 INFO:teuthology.orchestra.run.smithi138.stderr:/var/log/ceph/ceph-client.admin.131535.log: 82.1% -- replaced with /var/log/ceph/ceph-client.admin.131535.log.gz 2024-09-14T13:03:52.134 INFO:teuthology.orchestra.run.smithi138.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52375.log 2024-09-14T13:03:52.135 INFO:teuthology.orchestra.run.smithi138.stderr:/var/log/ceph/ceph-client.admin.134485.log: 82.3% -- replaced with /var/log/ceph/ceph-client.admin.134485.log.gz 2024-09-14T13:03:52.135 INFO:teuthology.orchestra.run.smithi138.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54480.log 2024-09-14T13:03:52.136 INFO:teuthology.orchestra.run.smithi138.stderr:/var/log/ceph/ceph-client.admin.52375.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.52375.log.gz 2024-09-14T13:03:52.136 INFO:teuthology.orchestra.run.smithi138.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.98493.log 2024-09-14T13:03:52.137 INFO:teuthology.orchestra.run.smithi138.stderr:/var/log/ceph/ceph-client.admin.54480.log: 57.9% -- replaced with /var/log/ceph/ceph-client.admin.54480.log.gz 2024-09-14T13:03:52.137 INFO:teuthology.orchestra.run.smithi138.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.79018.log 2024-09-14T13:03:52.140 INFO:teuthology.orchestra.run.smithi138.stderr:/var/log/ceph/ceph-client.admin.98493.log: 86.4% -- replaced with /var/log/ceph/ceph-client.admin.98493.log.gz 2024-09-14T13:03:52.140 INFO:teuthology.orchestra.run.smithi138.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.74888.log 2024-09-14T13:03:52.141 INFO:teuthology.orchestra.run.smithi138.stderr:/var/log/ceph/ceph-client.admin.79018.log: 82.0% -- replaced with /var/log/ceph/ceph-client.admin.79018.log.gz 2024-09-14T13:03:52.141 INFO:teuthology.orchestra.run.smithi138.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34252.log 2024-09-14T13:03:52.142 INFO:teuthology.orchestra.run.smithi138.stderr:/var/log/ceph/ceph-client.admin.74888.log: 80.6% -- replaced with /var/log/ceph/ceph-client.admin.74888.log.gz 2024-09-14T13:03:52.142 INFO:teuthology.orchestra.run.smithi138.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.81968.log 2024-09-14T13:03:52.143 INFO:teuthology.orchestra.run.smithi138.stderr:/var/log/ceph/ceph-client.admin.34252.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.34252.log.gz 2024-09-14T13:03:52.143 INFO:teuthology.orchestra.run.smithi138.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44630.log 2024-09-14T13:03:52.145 INFO:teuthology.orchestra.run.smithi138.stderr:/var/log/ceph/ceph-client.admin.81968.log: 86.4% -- replaced with /var/log/ceph/ceph-client.admin.81968.log.gz 2024-09-14T13:03:52.146 INFO:teuthology.orchestra.run.smithi138.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.151597.log 2024-09-14T13:03:52.147 INFO:teuthology.orchestra.run.smithi138.stderr:/var/log/ceph/ceph-client.admin.44630.log: 86.6% -- replaced with /var/log/ceph/ceph-client.admin.44630.log.gz 2024-09-14T13:03:52.147 INFO:teuthology.orchestra.run.smithi138.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.110293.log 2024-09-14T13:03:52.148 INFO:teuthology.orchestra.run.smithi138.stderr:/var/log/ceph/ceph-client.admin.151597.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.151597.log.gz 2024-09-14T13:03:52.148 INFO:teuthology.orchestra.run.smithi138.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.143926.log 2024-09-14T13:03:52.149 INFO:teuthology.orchestra.run.smithi138.stderr:/var/log/ceph/ceph-client.admin.110293.log: 82.2% -- replaced with /var/log/ceph/ceph-client.admin.110293.log.gz 2024-09-14T13:03:52.150 INFO:teuthology.orchestra.run.smithi138.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.145106.log 2024-09-14T13:03:52.152 INFO:teuthology.orchestra.run.smithi138.stderr:/var/log/ceph/ceph-client.admin.143926.log: 86.1% -- replaced with /var/log/ceph/ceph-client.admin.143926.log.gz 2024-09-14T13:03:52.152 INFO:teuthology.orchestra.run.smithi138.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.70168.log 2024-09-14T13:03:52.153 INFO:teuthology.orchestra.run.smithi138.stderr:/var/log/ceph/ceph-client.admin.145106.log: 82.4% -- replaced with /var/log/ceph/ceph-client.admin.145106.log.gz 2024-09-14T13:03:52.153 INFO:teuthology.orchestra.run.smithi138.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.157029.log 2024-09-14T13:03:52.154 INFO:teuthology.orchestra.run.smithi138.stderr:/var/log/ceph/ceph-client.admin.70168.log: 82.9% -- replaced with /var/log/ceph/ceph-client.admin.70168.log.gz 2024-09-14T13:03:52.155 INFO:teuthology.orchestra.run.smithi138.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.178774.log 2024-09-14T13:03:52.156 INFO:teuthology.orchestra.run.smithi138.stderr:/var/log/ceph/ceph-client.admin.157029.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.157029.log.gz 2024-09-14T13:03:52.156 INFO:teuthology.orchestra.run.smithi138.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.182668.log 2024-09-14T13:03:52.157 INFO:teuthology.orchestra.run.smithi138.stderr:/var/log/ceph/ceph-client.admin.178774.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.178774.log.gz 2024-09-14T13:03:52.157 INFO:teuthology.orchestra.run.smithi138.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.log 2024-09-14T13:03:52.158 INFO:teuthology.orchestra.run.smithi138.stderr:/var/log/ceph/ceph-client.admin.182668.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.182668.log.gz 2024-09-14T13:03:52.158 INFO:teuthology.orchestra.run.smithi138.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.122684.log 2024-09-14T13:03:52.173 INFO:teuthology.orchestra.run.smithi138.stderr:/var/log/ceph/ceph.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41630.log 2024-09-14T13:03:52.174 INFO:teuthology.orchestra.run.smithi138.stderr:/var/log/ceph/ceph-client.admin.122684.log: 85.3% -- replaced with /var/log/ceph/ceph-client.admin.122684.log.gz 2024-09-14T13:03:52.181 INFO:teuthology.orchestra.run.smithi138.stderr: 93.8%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.123864.log 2024-09-14T13:03:52.183 INFO:teuthology.orchestra.run.smithi138.stderr:/var/log/ceph/ceph-client.admin.41630.log: 85.5% -- replaced with /var/log/ceph/ceph-client.admin.41630.log.gz 2024-09-14T13:03:52.183 INFO:teuthology.orchestra.run.smithi138.stderr: -- replaced with /var/log/ceph/ceph.log.gz 2024-09-14T13:03:52.185 INFO:teuthology.orchestra.run.smithi138.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.127995.log 2024-09-14T13:03:52.190 INFO:teuthology.orchestra.run.smithi138.stderr:/var/log/ceph/ceph-client.admin.123864.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.123864.log.gz 2024-09-14T13:03:52.190 INFO:teuthology.orchestra.run.smithi138.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.182122.log 2024-09-14T13:03:52.190 INFO:teuthology.orchestra.run.smithi138.stderr:/var/log/ceph/ceph-client.admin.127995.log: 81.9% -- replaced with /var/log/ceph/ceph-client.admin.127995.log.gz 2024-09-14T13:03:52.190 INFO:teuthology.orchestra.run.smithi138.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.182512.log 2024-09-14T13:03:52.190 INFO:teuthology.orchestra.run.smithi138.stderr:/var/log/ceph/ceph-client.admin.182122.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.182122.log.gz 2024-09-14T13:03:52.190 INFO:teuthology.orchestra.run.smithi138.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57918.log 2024-09-14T13:03:52.191 INFO:teuthology.orchestra.run.smithi138.stderr:/var/log/ceph/ceph-client.admin.182512.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.182512.log.gz 2024-09-14T13:03:52.191 INFO:teuthology.orchestra.run.smithi138.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40990.log 2024-09-14T13:03:52.195 INFO:teuthology.orchestra.run.smithi138.stderr:/var/log/ceph/ceph-client.admin.57918.log: 93.2% -- replaced with /var/log/ceph/ceph-client.admin.57918.log.gz 2024-09-14T13:03:52.195 INFO:teuthology.orchestra.run.smithi138.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.107343.log 2024-09-14T13:03:52.196 INFO:teuthology.orchestra.run.smithi138.stderr:/var/log/ceph/ceph-client.admin.40990.log: 84.8% -- replaced with /var/log/ceph/ceph-client.admin.40990.log.gz 2024-09-14T13:03:52.196 INFO:teuthology.orchestra.run.smithi138.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32966.log 2024-09-14T13:03:52.197 INFO:teuthology.orchestra.run.smithi138.stderr:/var/log/ceph/ceph-client.admin.107343.log: 82.0% -- replaced with /var/log/ceph/ceph-client.admin.107343.log.gz 2024-09-14T13:03:52.197 INFO:teuthology.orchestra.run.smithi138.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34228.log 2024-09-14T13:03:52.198 INFO:teuthology.orchestra.run.smithi138.stderr:/var/log/ceph/ceph-client.admin.32966.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32966.log.gz 2024-09-14T13:03:52.198 INFO:teuthology.orchestra.run.smithi138.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45810.log 2024-09-14T13:03:52.199 INFO:teuthology.orchestra.run.smithi138.stderr:/var/log/ceph/ceph-client.admin.34228.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.34228.log.gz 2024-09-14T13:03:52.199 INFO:teuthology.orchestra.run.smithi138.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59208.log 2024-09-14T13:03:52.200 INFO:teuthology.orchestra.run.smithi138.stderr:/var/log/ceph/ceph-client.admin.45810.log: 85.7% -- replaced with /var/log/ceph/ceph-client.admin.45810.log.gz 2024-09-14T13:03:52.201 INFO:teuthology.orchestra.run.smithi138.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.83740.log 2024-09-14T13:03:52.203 INFO:teuthology.orchestra.run.smithi138.stderr:/var/log/ceph/ceph-client.admin.59208.log: 90.0% -- replaced with /var/log/ceph/ceph-client.admin.59208.log.gz 2024-09-14T13:03:52.203 INFO:teuthology.orchestra.run.smithi138.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.169492.log 2024-09-14T13:03:52.204 INFO:teuthology.orchestra.run.smithi138.stderr:/var/log/ceph/ceph-client.admin.83740.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.83740.log.gz 2024-09-14T13:03:52.205 INFO:teuthology.orchestra.run.smithi138.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.152209.log 2024-09-14T13:03:52.205 INFO:teuthology.orchestra.run.smithi138.stderr:/var/log/ceph/ceph-client.0.169492.log: 84.1% -- replaced with /var/log/ceph/ceph-client.0.169492.log.gz 2024-09-14T13:03:52.206 INFO:teuthology.orchestra.run.smithi138.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54551.log 2024-09-14T13:03:52.207 INFO:teuthology.orchestra.run.smithi138.stderr:/var/log/ceph/ceph-client.admin.152209.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.152209.log.gz 2024-09-14T13:03:52.207 INFO:teuthology.orchestra.run.smithi138.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.144516.log 2024-09-14T13:03:52.208 INFO:teuthology.orchestra.run.smithi138.stderr:/var/log/ceph/ceph-client.admin.54551.log: 50.7% -- replaced with /var/log/ceph/ceph-client.admin.54551.log.gz 2024-09-14T13:03:52.208 INFO:teuthology.orchestra.run.smithi138.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54834.log 2024-09-14T13:03:52.209 INFO:teuthology.orchestra.run.smithi138.stderr:/var/log/ceph/ceph-client.admin.144516.log: 85.6% -- replaced with /var/log/ceph/ceph-client.admin.144516.log.gz 2024-09-14T13:03:52.209 INFO:teuthology.orchestra.run.smithi138.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.92003.log 2024-09-14T13:03:52.210 INFO:teuthology.orchestra.run.smithi138.stderr:/var/log/ceph/ceph-client.admin.54834.log: 92.0% -- replaced with /var/log/ceph/ceph-client.admin.54834.log.gz 2024-09-14T13:03:52.211 INFO:teuthology.orchestra.run.smithi138.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32967.log 2024-09-14T13:03:52.212 INFO:teuthology.orchestra.run.smithi138.stderr:/var/log/ceph/ceph-client.admin.92003.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.92003.log.gz 2024-09-14T13:03:52.212 INFO:teuthology.orchestra.run.smithi138.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.101443.log 2024-09-14T13:03:52.213 INFO:teuthology.orchestra.run.smithi138.stderr:/var/log/ceph/ceph-client.admin.32967.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32967.log.gz 2024-09-14T13:03:52.213 INFO:teuthology.orchestra.run.smithi138.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.116194.log 2024-09-14T13:03:52.214 INFO:teuthology.orchestra.run.smithi138.stderr:/var/log/ceph/ceph-client.admin.101443.log: 82.3% -- replaced with /var/log/ceph/ceph-client.admin.101443.log.gz 2024-09-14T13:03:52.214 INFO:teuthology.orchestra.run.smithi138.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57273.log 2024-09-14T13:03:52.215 INFO:teuthology.orchestra.run.smithi138.stderr:/var/log/ceph/ceph-client.admin.116194.log: 85.1% -- replaced with /var/log/ceph/ceph-client.admin.116194.log.gz 2024-09-14T13:03:52.215 INFO:teuthology.orchestra.run.smithi138.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.129765.log 2024-09-14T13:03:52.223 INFO:teuthology.orchestra.run.smithi138.stderr:/var/log/ceph/ceph-client.admin.57273.log: 93.5%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.127405.log 2024-09-14T13:03:52.224 INFO:teuthology.orchestra.run.smithi138.stderr:/var/log/ceph/ceph-client.admin.129765.log: 81.9% -- replaced with /var/log/ceph/ceph-client.admin.57273.log.gz 2024-09-14T13:03:52.224 INFO:teuthology.orchestra.run.smithi138.stderr: -- replaced with /var/log/ceph/ceph-client.admin.129765.log.gz 2024-09-14T13:03:52.224 INFO:teuthology.orchestra.run.smithi138.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.68210.log 2024-09-14T13:03:52.225 INFO:teuthology.orchestra.run.smithi138.stderr:/var/log/ceph/ceph-client.admin.127405.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.127405.log.gz 2024-09-14T13:03:52.226 INFO:teuthology.orchestra.run.smithi138.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mon.c.log 2024-09-14T13:03:52.227 INFO:teuthology.orchestra.run.smithi138.stderr:/var/log/ceph/ceph-client.0.68210.log: 84.4% -- replaced with /var/log/ceph/ceph-client.0.68210.log.gz 2024-09-14T13:03:52.227 INFO:teuthology.orchestra.run.smithi138.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.174802.log 2024-09-14T13:03:52.237 INFO:teuthology.orchestra.run.smithi138.stderr:/var/log/ceph/ceph-mon.c.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.126814.log 2024-09-14T13:03:52.238 INFO:teuthology.orchestra.run.smithi138.stderr:/var/log/ceph/ceph-client.0.174802.log: 80.7% -- replaced with /var/log/ceph/ceph-client.0.174802.log.gz 2024-09-14T13:03:52.256 INFO:teuthology.orchestra.run.smithi138.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32949.log 2024-09-14T13:03:52.257 INFO:teuthology.orchestra.run.smithi138.stderr:/var/log/ceph/ceph-client.admin.126814.log: 81.4% -- replaced with /var/log/ceph/ceph-client.admin.126814.log.gz 2024-09-14T13:03:52.258 INFO:teuthology.orchestra.run.smithi138.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.171852.log 2024-09-14T13:03:52.258 INFO:teuthology.orchestra.run.smithi138.stderr:/var/log/ceph/ceph-client.admin.32949.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32949.log.gz 2024-09-14T13:03:52.276 INFO:teuthology.orchestra.run.smithi138.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.141566.log 2024-09-14T13:03:52.277 INFO:teuthology.orchestra.run.smithi138.stderr:/var/log/ceph/ceph-client.0.171852.log: 84.3% -- replaced with /var/log/ceph/ceph-client.0.171852.log.gz 2024-09-14T13:03:52.285 INFO:teuthology.orchestra.run.smithi138.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.107933.log 2024-09-14T13:03:52.285 INFO:teuthology.orchestra.run.smithi138.stderr:/var/log/ceph/ceph-client.admin.141566.log: 82.2% -- replaced with /var/log/ceph/ceph-client.admin.141566.log.gz 2024-09-14T13:03:52.293 INFO:teuthology.orchestra.run.smithi138.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.159698.log 2024-09-14T13:03:52.293 INFO:teuthology.orchestra.run.smithi138.stderr:/var/log/ceph/ceph-client.admin.107933.log: 82.2% -- replaced with /var/log/ceph/ceph-client.admin.107933.log.gz 2024-09-14T13:03:52.301 INFO:teuthology.orchestra.run.smithi138.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.172442.log 2024-09-14T13:03:52.301 INFO:teuthology.orchestra.run.smithi138.stderr:/var/log/ceph/ceph-client.admin.159698.log: 92.3% -- replaced with /var/log/ceph/ceph-client.admin.159698.log.gz 2024-09-14T13:03:52.309 INFO:teuthology.orchestra.run.smithi138.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49940.log 2024-09-14T13:03:52.309 INFO:teuthology.orchestra.run.smithi138.stderr:/var/log/ceph/ceph-client.0.172442.log: 80.5% -- replaced with /var/log/ceph/ceph-client.0.172442.log.gz 2024-09-14T13:03:52.329 INFO:teuthology.orchestra.run.smithi138.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61791.log 2024-09-14T13:03:52.329 INFO:teuthology.orchestra.run.smithi138.stderr:/var/log/ceph/ceph-client.admin.49940.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.49940.log.gz 2024-09-14T13:03:52.337 INFO:teuthology.orchestra.run.smithi138.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.159109.log 2024-09-14T13:03:52.345 INFO:teuthology.orchestra.run.smithi138.stderr:/var/log/ceph/ceph-client.admin.61791.log: 88.5%gzip -5 --verbose -- /var/log/ceph/ceph-client.0.37839.log 2024-09-14T13:03:52.345 INFO:teuthology.orchestra.run.smithi138.stderr:/var/log/ceph/ceph-client.admin.159109.log: 90.8% -- replaced with /var/log/ceph/ceph-client.admin.159109.log.gz 2024-09-14T13:03:52.353 INFO:teuthology.orchestra.run.smithi138.stderr: -- replaced with /var/log/ceph/ceph-client.admin.61791.log.gz 2024-09-14T13:03:52.353 INFO:teuthology.orchestra.run.smithi138.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42220.log 2024-09-14T13:03:52.353 INFO:teuthology.orchestra.run.smithi138.stderr:/var/log/ceph/ceph-client.0.37839.log: 44.2% -- replaced with /var/log/ceph/ceph-client.0.37839.log.gz 2024-09-14T13:03:52.360 INFO:teuthology.orchestra.run.smithi138.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.76658.log 2024-09-14T13:03:52.361 INFO:teuthology.orchestra.run.smithi138.stderr:/var/log/ceph/ceph-client.admin.42220.log: 85.5% -- replaced with /var/log/ceph/ceph-client.admin.42220.log.gz 2024-09-14T13:03:52.373 INFO:teuthology.orchestra.run.smithi138.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.170672.log 2024-09-14T13:03:52.373 INFO:teuthology.orchestra.run.smithi138.stderr:/var/log/ceph/ceph-client.admin.76658.log: 82.2% -- replaced with /var/log/ceph/ceph-client.admin.76658.log.gz 2024-09-14T13:03:52.373 INFO:teuthology.orchestra.run.smithi138.stderr:gzip -5 --verbose -- /var/log/ceph/ops-log-ceph-client.0.log 2024-09-14T13:03:52.374 INFO:teuthology.orchestra.run.smithi138.stderr:/var/log/ceph/ceph-client.0.170672.log: 84.4% -- replaced with /var/log/ceph/ceph-client.0.170672.log.gz 2024-09-14T13:03:52.381 INFO:teuthology.orchestra.run.smithi138.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46400.log 2024-09-14T13:03:52.405 INFO:teuthology.orchestra.run.smithi138.stderr:/var/log/ceph/ops-log-ceph-client.0.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.182278.log 2024-09-14T13:03:52.405 INFO:teuthology.orchestra.run.smithi138.stderr:/var/log/ceph/ceph-client.admin.46400.log: 85.5% -- replaced with /var/log/ceph/ceph-client.admin.46400.log.gz 2024-09-14T13:03:52.421 INFO:teuthology.orchestra.run.smithi138.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32202.log 2024-09-14T13:03:52.421 INFO:teuthology.orchestra.run.smithi138.stderr:/var/log/ceph/ceph-client.admin.182278.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.182278.log.gz 2024-09-14T13:03:52.429 INFO:teuthology.orchestra.run.smithi138.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.84920.log 2024-09-14T13:03:52.429 INFO:teuthology.orchestra.run.smithi138.stderr:/var/log/ceph/ceph-client.admin.32202.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32202.log.gz 2024-09-14T13:03:52.437 INFO:teuthology.orchestra.run.smithi138.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.173032.log 2024-09-14T13:03:52.437 INFO:teuthology.orchestra.run.smithi138.stderr:/var/log/ceph/ceph-client.admin.84920.log: 81.0% -- replaced with /var/log/ceph/ceph-client.admin.84920.log.gz 2024-09-14T13:03:52.445 INFO:teuthology.orchestra.run.smithi138.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.audit.log 2024-09-14T13:03:52.445 INFO:teuthology.orchestra.run.smithi138.stderr:/var/log/ceph/ceph-client.0.173032.log: 80.4% -- replaced with /var/log/ceph/ceph-client.0.173032.log.gz 2024-09-14T13:03:52.465 INFO:teuthology.orchestra.run.smithi138.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42810.log 2024-09-14T13:03:52.468 INFO:teuthology.orchestra.run.smithi138.stderr:/var/log/ceph/ceph.audit.log: 94.7% -- replaced with /var/log/ceph/ceph.audit.log.gz 2024-09-14T13:03:52.473 INFO:teuthology.orchestra.run.smithi138.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.182642.log 2024-09-14T13:03:52.473 INFO:teuthology.orchestra.run.smithi138.stderr:/var/log/ceph/ceph-client.admin.42810.log: 85.7% -- replaced with /var/log/ceph/ceph-client.admin.42810.log.gz 2024-09-14T13:03:52.481 INFO:teuthology.orchestra.run.smithi138.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.135075.log 2024-09-14T13:03:52.481 INFO:teuthology.orchestra.run.smithi138.stderr:/var/log/ceph/ceph-client.admin.182642.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.182642.log.gz 2024-09-14T13:03:52.489 INFO:teuthology.orchestra.run.smithi138.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.88460.log 2024-09-14T13:03:52.489 INFO:teuthology.orchestra.run.smithi138.stderr:/var/log/ceph/ceph-client.admin.135075.log: 81.9% -- replaced with /var/log/ceph/ceph-client.admin.135075.log.gz 2024-09-14T13:03:52.497 INFO:teuthology.orchestra.run.smithi138.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.102033.log 2024-09-14T13:03:52.497 INFO:teuthology.orchestra.run.smithi138.stderr:/var/log/ceph/ceph-client.admin.88460.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.88460.log.gz 2024-09-14T13:03:52.505 INFO:teuthology.orchestra.run.smithi138.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.115604.log 2024-09-14T13:03:52.505 INFO:teuthology.orchestra.run.smithi138.stderr:/var/log/ceph/ceph-client.admin.102033.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.102033.log.gz 2024-09-14T13:03:52.513 INFO:teuthology.orchestra.run.smithi138.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.177571.log 2024-09-14T13:03:52.513 INFO:teuthology.orchestra.run.smithi138.stderr:/var/log/ceph/ceph-client.admin.115604.log: 82.0% -- replaced with /var/log/ceph/ceph-client.admin.115604.log.gz 2024-09-14T13:03:52.533 INFO:teuthology.orchestra.run.smithi138.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.99673.log 2024-09-14T13:03:52.533 INFO:teuthology.orchestra.run.smithi138.stderr:/var/log/ceph/ceph-client.admin.177571.log: 82.9% -- replaced with /var/log/ceph/ceph-client.admin.177571.log.gz 2024-09-14T13:03:52.541 INFO:teuthology.orchestra.run.smithi138.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33173.log 2024-09-14T13:03:52.541 INFO:teuthology.orchestra.run.smithi138.stderr:/var/log/ceph/ceph-client.admin.99673.log: 81.6% -- replaced with /var/log/ceph/ceph-client.admin.99673.log.gz 2024-09-14T13:03:52.549 INFO:teuthology.orchestra.run.smithi138.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.164046.log 2024-09-14T13:03:52.549 INFO:teuthology.orchestra.run.smithi138.stderr:/var/log/ceph/ceph-client.admin.33173.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.33173.log.gz 2024-09-14T13:03:52.557 INFO:teuthology.orchestra.run.smithi138.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.95543.log 2024-09-14T13:03:52.557 INFO:teuthology.orchestra.run.smithi138.stderr:/var/log/ceph/ceph-client.admin.164046.log: 92.4% -- replaced with /var/log/ceph/ceph-client.admin.164046.log.gz 2024-09-14T13:03:52.565 INFO:teuthology.orchestra.run.smithi138.stderr:gzip -5 --verbose -- /var/log/ceph/valgrind/ceph.client.0.log 2024-09-14T13:03:52.565 INFO:teuthology.orchestra.run.smithi138.stderr:/var/log/ceph/ceph-client.admin.95543.log: 81.9% -- replaced with /var/log/ceph/ceph-client.admin.95543.log.gz 2024-09-14T13:03:52.573 INFO:teuthology.orchestra.run.smithi138.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.154594.log 2024-09-14T13:03:52.573 INFO:teuthology.orchestra.run.smithi138.stderr:/var/log/ceph/valgrind/ceph.client.0.log: 63.0% -- replaced with /var/log/ceph/valgrind/ceph.client.0.log.gz 2024-09-14T13:03:52.581 INFO:teuthology.orchestra.run.smithi138.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32759.log 2024-09-14T13:03:52.581 INFO:teuthology.orchestra.run.smithi138.stderr:/var/log/ceph/ceph-client.admin.154594.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.154594.log.gz 2024-09-14T13:03:52.589 INFO:teuthology.orchestra.run.smithi138.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.138025.log 2024-09-14T13:03:52.589 INFO:teuthology.orchestra.run.smithi138.stderr:/var/log/ceph/ceph-client.admin.32759.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32759.log.gz 2024-09-14T13:03:52.597 INFO:teuthology.orchestra.run.smithi138.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67568.log 2024-09-14T13:03:52.598 INFO:teuthology.orchestra.run.smithi138.stderr:/var/log/ceph/ceph-client.admin.138025.log: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.138025.log.gz 2024-09-14T13:03:52.605 INFO:teuthology.orchestra.run.smithi138.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.182226.log 2024-09-14T13:03:52.605 INFO:teuthology.orchestra.run.smithi138.stderr:/var/log/ceph/ceph-client.admin.67568.log: 24.8% -- replaced with /var/log/ceph/ceph-client.admin.67568.log.gz 2024-09-14T13:03:52.613 INFO:teuthology.orchestra.run.smithi138.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32607.log 2024-09-14T13:03:52.613 INFO:teuthology.orchestra.run.smithi138.stderr:/var/log/ceph/ceph-client.admin.182226.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.182226.log.gz 2024-09-14T13:03:52.621 INFO:teuthology.orchestra.run.smithi138.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.tmp-client.admin.21901.log 2024-09-14T13:03:52.621 INFO:teuthology.orchestra.run.smithi138.stderr:/var/log/ceph/ceph-client.admin.32607.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32607.log.gz 2024-09-14T13:03:52.641 INFO:teuthology.orchestra.run.smithi138.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.182200.log 2024-09-14T13:03:52.641 INFO:teuthology.orchestra.run.smithi138.stderr:/var/log/ceph/ceph.tmp-client.admin.21901.log: 0.0% -- replaced with /var/log/ceph/ceph.tmp-client.admin.21901.log.gz 2024-09-14T13:03:52.641 INFO:teuthology.orchestra.run.smithi138.stderr: 94.2% -- replaced with /var/log/ceph/ops-log-ceph-client.0.log.gz 2024-09-14T13:03:52.648 INFO:teuthology.orchestra.run.smithi138.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.77838.log 2024-09-14T13:03:52.649 INFO:teuthology.orchestra.run.smithi138.stderr:/var/log/ceph/ceph-client.admin.182200.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.182200.log.gz 2024-09-14T13:03:52.650 INFO:teuthology.orchestra.run.smithi138.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.182382.log 2024-09-14T13:03:52.650 INFO:teuthology.orchestra.run.smithi138.stderr:/var/log/ceph/ceph-client.admin.77838.log: 82.4% -- replaced with /var/log/ceph/ceph-client.admin.77838.log.gz 2024-09-14T13:03:52.651 INFO:teuthology.orchestra.run.smithi138.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.167121.log 2024-09-14T13:03:52.651 INFO:teuthology.orchestra.run.smithi138.stderr:/var/log/ceph/ceph-client.admin.182382.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.182382.log.gz 2024-09-14T13:03:52.652 INFO:teuthology.orchestra.run.smithi138.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32939.log 2024-09-14T13:03:52.653 INFO:teuthology.orchestra.run.smithi138.stderr:/var/log/ceph/ceph-client.admin.167121.log: 92.4% -- replaced with /var/log/ceph/ceph-client.admin.167121.log.gz 2024-09-14T13:03:52.653 INFO:teuthology.orchestra.run.smithi138.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.182460.log 2024-09-14T13:03:52.654 INFO:teuthology.orchestra.run.smithi138.stderr:/var/log/ceph/ceph-client.admin.32939.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32939.log.gz 2024-09-14T13:03:52.654 INFO:teuthology.orchestra.run.smithi138.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.108523.log 2024-09-14T13:03:52.655 INFO:teuthology.orchestra.run.smithi138.stderr:/var/log/ceph/ceph-client.admin.182460.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.182460.log.gz 2024-09-14T13:03:52.655 INFO:teuthology.orchestra.run.smithi138.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61146.log 2024-09-14T13:03:52.656 INFO:teuthology.orchestra.run.smithi138.stderr:/var/log/ceph/ceph-client.admin.108523.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.108523.log.gz 2024-09-14T13:03:52.656 INFO:teuthology.orchestra.run.smithi138.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.81378.log 2024-09-14T13:03:52.659 INFO:teuthology.orchestra.run.smithi138.stderr:/var/log/ceph/ceph-client.admin.61146.log: 92.5% -- replaced with /var/log/ceph/ceph-client.admin.61146.log.gz 2024-09-14T13:03:52.660 INFO:teuthology.orchestra.run.smithi138.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.168312.log 2024-09-14T13:03:52.660 INFO:teuthology.orchestra.run.smithi138.stderr:/var/log/ceph/ceph-client.admin.81378.log: 82.3% -- replaced with /var/log/ceph/ceph-client.admin.81378.log.gz 2024-09-14T13:03:52.660 INFO:teuthology.orchestra.run.smithi138.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.109113.log 2024-09-14T13:03:52.661 INFO:teuthology.orchestra.run.smithi138.stderr:/var/log/ceph/ceph-client.0.168312.log: 84.3% -- replaced with /var/log/ceph/ceph-client.0.168312.log.gz 2024-09-14T13:03:52.662 INFO:teuthology.orchestra.run.smithi138.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54811.log 2024-09-14T13:03:52.662 INFO:teuthology.orchestra.run.smithi138.stderr:/var/log/ceph/ceph-client.admin.109113.log: 82.0% -- replaced with /var/log/ceph/ceph-client.admin.109113.log.gz 2024-09-14T13:03:52.663 INFO:teuthology.orchestra.run.smithi138.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.165224.log 2024-09-14T13:03:52.663 INFO:teuthology.orchestra.run.smithi138.stderr:/var/log/ceph/ceph-client.admin.54811.log: 57.3% -- replaced with /var/log/ceph/ceph-client.admin.54811.log.gz 2024-09-14T13:03:52.664 INFO:teuthology.orchestra.run.smithi138.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.182486.log 2024-09-14T13:03:52.665 INFO:teuthology.orchestra.run.smithi138.stderr:/var/log/ceph/ceph-client.admin.165224.log: 92.3% -- replaced with /var/log/ceph/ceph-client.admin.165224.log.gz 2024-09-14T13:03:52.665 INFO:teuthology.orchestra.run.smithi138.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.153979.log 2024-09-14T13:03:52.666 INFO:teuthology.orchestra.run.smithi138.stderr:/var/log/ceph/ceph-client.admin.182486.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.182486.log.gz 2024-09-14T13:03:52.666 INFO:teuthology.orchestra.run.smithi138.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.89050.log 2024-09-14T13:03:52.667 INFO:teuthology.orchestra.run.smithi138.stderr:/var/log/ceph/ceph-client.admin.153979.log: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.153979.log.gz 2024-09-14T13:03:52.667 INFO:teuthology.orchestra.run.smithi138.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.150417.log 2024-09-14T13:03:52.668 INFO:teuthology.orchestra.run.smithi138.stderr:/var/log/ceph/ceph-client.admin.89050.log: 82.1% -- replaced with /var/log/ceph/ceph-client.admin.89050.log.gz 2024-09-14T13:03:52.669 INFO:teuthology.orchestra.run.smithi138.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.135665.log 2024-09-14T13:03:52.669 INFO:teuthology.orchestra.run.smithi138.stderr:/var/log/ceph/ceph-client.admin.150417.log: 81.9% -- replaced with /var/log/ceph/ceph-client.admin.150417.log.gz 2024-09-14T13:03:52.670 INFO:teuthology.orchestra.run.smithi138.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.132715.log 2024-09-14T13:03:52.671 INFO:teuthology.orchestra.run.smithi138.stderr:/var/log/ceph/ceph-client.admin.135665.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.135665.log.gz 2024-09-14T13:03:52.671 INFO:teuthology.orchestra.run.smithi138.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32951.log 2024-09-14T13:03:52.672 INFO:teuthology.orchestra.run.smithi138.stderr:/var/log/ceph/ceph-client.admin.132715.log: 82.6% -- replaced with /var/log/ceph/ceph-client.admin.132715.log.gz 2024-09-14T13:03:52.672 INFO:teuthology.orchestra.run.smithi138.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.96133.log 2024-09-14T13:03:52.673 INFO:teuthology.orchestra.run.smithi138.stderr:/var/log/ceph/ceph-client.admin.32951.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32951.log.gz 2024-09-14T13:03:52.673 INFO:teuthology.orchestra.run.smithi138.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.142156.log 2024-09-14T13:03:52.674 INFO:teuthology.orchestra.run.smithi138.stderr:/var/log/ceph/ceph-client.admin.96133.log: 82.2% -- replaced with /var/log/ceph/ceph-client.admin.96133.log.gz 2024-09-14T13:03:52.674 INFO:teuthology.orchestra.run.smithi138.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46990.log 2024-09-14T13:03:52.676 INFO:teuthology.orchestra.run.smithi138.stderr:/var/log/ceph/ceph-client.admin.142156.log: 86.3% -- replaced with /var/log/ceph/ceph-client.admin.142156.log.gz 2024-09-14T13:03:52.677 INFO:teuthology.orchestra.run.smithi138.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.104393.log 2024-09-14T13:03:52.677 INFO:teuthology.orchestra.run.smithi138.stderr:/var/log/ceph/ceph-client.admin.46990.log: 84.7% -- replaced with /var/log/ceph/ceph-client.admin.46990.log.gz 2024-09-14T13:03:52.678 INFO:teuthology.orchestra.run.smithi138.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.182174.log 2024-09-14T13:03:52.679 INFO:teuthology.orchestra.run.smithi138.stderr:/var/log/ceph/ceph-client.admin.104393.log: 82.0% -- replaced with /var/log/ceph/ceph-client.admin.104393.log.gz 2024-09-14T13:03:52.679 INFO:teuthology.orchestra.run.smithi138.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.73708.log 2024-09-14T13:03:52.680 INFO:teuthology.orchestra.run.smithi138.stderr:/var/log/ceph/ceph-client.admin.182174.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.182174.log.gz 2024-09-14T13:03:52.680 INFO:teuthology.orchestra.run.smithi138.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.166532.log 2024-09-14T13:03:52.681 INFO:teuthology.orchestra.run.smithi138.stderr:/var/log/ceph/ceph-client.admin.73708.log: 81.9% -- replaced with /var/log/ceph/ceph-client.admin.73708.log.gz 2024-09-14T13:03:52.681 INFO:teuthology.orchestra.run.smithi138.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.179462.log 2024-09-14T13:03:52.684 INFO:teuthology.orchestra.run.smithi138.stderr:/var/log/ceph/ceph-client.admin.166532.log: 94.8% -- replaced with /var/log/ceph/ceph-client.admin.166532.log.gz 2024-09-14T13:03:52.684 INFO:teuthology.orchestra.run.smithi138.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.178751.log 2024-09-14T13:03:52.685 INFO:teuthology.orchestra.run.smithi138.stderr:/var/log/ceph/ceph-client.admin.179462.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.179462.log.gz 2024-09-14T13:03:52.685 INFO:teuthology.orchestra.run.smithi138.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.68848.log 2024-09-14T13:03:52.686 INFO:teuthology.orchestra.run.smithi138.stderr:/var/log/ceph/ceph-client.admin.178751.log: 25.5% -- replaced with /var/log/ceph/ceph-client.admin.178751.log.gz 2024-09-14T13:03:52.686 INFO:teuthology.orchestra.run.smithi138.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.77248.log 2024-09-14T13:03:52.687 INFO:teuthology.orchestra.run.smithi138.stderr:/var/log/ceph/ceph-client.admin.68848.log: 52.9% -- replaced with /var/log/ceph/ceph-client.admin.68848.log.gz 2024-09-14T13:03:52.687 INFO:teuthology.orchestra.run.smithi138.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.26841.log 2024-09-14T13:03:52.688 INFO:teuthology.orchestra.run.smithi138.stderr:/var/log/ceph/ceph-client.admin.77248.log: 81.8% -- replaced with /var/log/ceph/ceph-client.admin.77248.log.gz 2024-09-14T13:03:52.688 INFO:teuthology.orchestra.run.smithi138.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.36087.log 2024-09-14T13:03:52.689 INFO:teuthology.orchestra.run.smithi138.stderr:/var/log/ceph/ceph-client.admin.26841.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.26841.log.gz 2024-09-14T13:03:52.689 INFO:teuthology.orchestra.run.smithi138.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.86690.log 2024-09-14T13:03:52.690 INFO:teuthology.orchestra.run.smithi138.stderr:/var/log/ceph/ceph-client.0.36087.log: 43.5% -- replaced with /var/log/ceph/ceph-client.0.36087.log.gz 2024-09-14T13:03:52.690 INFO:teuthology.orchestra.run.smithi138.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.110883.log 2024-09-14T13:03:52.691 INFO:teuthology.orchestra.run.smithi138.stderr:/var/log/ceph/ceph-client.admin.86690.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.86690.log.gz 2024-09-14T13:03:52.692 INFO:teuthology.orchestra.run.smithi138.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.182096.log 2024-09-14T13:03:52.692 INFO:teuthology.orchestra.run.smithi138.stderr:/var/log/ceph/ceph-client.admin.110883.log: 81.7% -- replaced with /var/log/ceph/ceph-client.admin.110883.log.gz 2024-09-14T13:03:52.693 INFO:teuthology.orchestra.run.smithi138.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.136845.log 2024-09-14T13:03:52.693 INFO:teuthology.orchestra.run.smithi138.stderr:/var/log/ceph/ceph-client.admin.182096.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.182096.log.gz 2024-09-14T13:03:52.694 INFO:teuthology.orchestra.run.smithi138.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.78428.log 2024-09-14T13:03:52.694 INFO:teuthology.orchestra.run.smithi138.stderr:/var/log/ceph/ceph-client.admin.136845.log: 82.1% -- replaced with /var/log/ceph/ceph-client.admin.136845.log.gz 2024-09-14T13:03:52.695 INFO:teuthology.orchestra.run.smithi138.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.156389.log 2024-09-14T13:03:52.696 INFO:teuthology.orchestra.run.smithi138.stderr:/var/log/ceph/ceph-client.admin.78428.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.78428.log.gz 2024-09-14T13:03:52.696 INFO:teuthology.orchestra.run.smithi138.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65201.log 2024-09-14T13:03:52.697 INFO:teuthology.orchestra.run.smithi138.stderr:/var/log/ceph/ceph-client.admin.156389.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.156389.log.gz 2024-09-14T13:03:52.697 INFO:teuthology.orchestra.run.smithi138.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.142746.log 2024-09-14T13:03:52.698 INFO:teuthology.orchestra.run.smithi138.stderr:/var/log/ceph/ceph-client.admin.65201.log: 84.4% -- replaced with /var/log/ceph/ceph-client.admin.65201.log.gz 2024-09-14T13:03:52.698 INFO:teuthology.orchestra.run.smithi138.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.182434.log 2024-09-14T13:03:52.699 INFO:teuthology.orchestra.run.smithi138.stderr:/var/log/ceph/ceph-client.admin.142746.log: 82.2% -- replaced with /var/log/ceph/ceph-client.admin.142746.log.gz 2024-09-14T13:03:52.699 INFO:teuthology.orchestra.run.smithi138.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.124454.log 2024-09-14T13:03:52.700 INFO:teuthology.orchestra.run.smithi138.stderr:/var/log/ceph/ceph-client.admin.182434.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.182434.log.gz 2024-09-14T13:03:52.700 INFO:teuthology.orchestra.run.smithi138.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48760.log 2024-09-14T13:03:52.701 INFO:teuthology.orchestra.run.smithi138.stderr:/var/log/ceph/ceph-client.admin.124454.log: 82.2% -- replaced with /var/log/ceph/ceph-client.admin.124454.log.gz 2024-09-14T13:03:52.702 INFO:teuthology.orchestra.run.smithi138.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.180135.log 2024-09-14T13:03:52.702 INFO:teuthology.orchestra.run.smithi138.stderr:/var/log/ceph/ceph-client.admin.48760.log: 85.6% -- replaced with /var/log/ceph/ceph-client.admin.48760.log.gz 2024-09-14T13:03:52.703 INFO:teuthology.orchestra.run.smithi138.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54721.log 2024-09-14T13:03:52.704 INFO:teuthology.orchestra.run.smithi138.stderr:/var/log/ceph/ceph-client.0.180135.log: 80.8% -- replaced with /var/log/ceph/ceph-client.0.180135.log.gz 2024-09-14T13:03:52.704 INFO:teuthology.orchestra.run.smithi138.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66977.log 2024-09-14T13:03:52.705 INFO:teuthology.orchestra.run.smithi138.stderr:/var/log/ceph/ceph-client.admin.54721.log: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.54721.log.gz 2024-09-14T13:03:52.705 INFO:teuthology.orchestra.run.smithi138.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32754.log 2024-09-14T13:03:52.706 INFO:teuthology.orchestra.run.smithi138.stderr:/var/log/ceph/ceph-client.admin.66977.log: 81.9% -- replaced with /var/log/ceph/ceph-client.admin.66977.log.gz 2024-09-14T13:03:52.706 INFO:teuthology.orchestra.run.smithi138.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43990.log 2024-09-14T13:03:52.707 INFO:teuthology.orchestra.run.smithi138.stderr:/var/log/ceph/ceph-client.admin.32754.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32754.log.gz 2024-09-14T13:03:52.707 INFO:teuthology.orchestra.run.smithi138.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34276.log 2024-09-14T13:03:52.708 INFO:teuthology.orchestra.run.smithi138.stderr:/var/log/ceph/ceph-client.admin.43990.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.43990.log.gz 2024-09-14T13:03:52.709 INFO:teuthology.orchestra.run.smithi138.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.119734.log 2024-09-14T13:03:52.709 INFO:teuthology.orchestra.run.smithi138.stderr:/var/log/ceph/ceph-client.admin.34276.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.34276.log.gz 2024-09-14T13:03:52.709 INFO:teuthology.orchestra.run.smithi138.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55333.log 2024-09-14T13:03:52.710 INFO:teuthology.orchestra.run.smithi138.stderr:/var/log/ceph/ceph-client.admin.119734.log: 82.2% -- replaced with /var/log/ceph/ceph-client.admin.119734.log.gz 2024-09-14T13:03:52.710 INFO:teuthology.orchestra.run.smithi138.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.173622.log 2024-09-14T13:03:52.711 INFO:teuthology.orchestra.run.smithi138.stderr:/var/log/ceph/ceph-client.admin.55333.log: 20.3% -- replaced with /var/log/ceph/ceph-client.admin.55333.log.gz 2024-09-14T13:03:52.711 INFO:teuthology.orchestra.run.smithi138.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66386.log 2024-09-14T13:03:52.712 INFO:teuthology.orchestra.run.smithi138.stderr:/var/log/ceph/ceph-client.0.173622.log: 83.9% -- replaced with /var/log/ceph/ceph-client.0.173622.log.gz 2024-09-14T13:03:52.713 INFO:teuthology.orchestra.run.smithi138.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.106753.log 2024-09-14T13:03:52.713 INFO:teuthology.orchestra.run.smithi138.stderr:/var/log/ceph/ceph-client.admin.66386.log: 81.2% -- replaced with /var/log/ceph/ceph-client.admin.66386.log.gz 2024-09-14T13:03:52.714 INFO:teuthology.orchestra.run.smithi138.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.140386.log 2024-09-14T13:03:52.715 INFO:teuthology.orchestra.run.smithi138.stderr:/var/log/ceph/ceph-client.admin.106753.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.106753.log.gz 2024-09-14T13:03:52.715 INFO:teuthology.orchestra.run.smithi138.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.151007.log 2024-09-14T13:03:52.716 INFO:teuthology.orchestra.run.smithi138.stderr:/var/log/ceph/ceph-client.admin.140386.log: 85.6% -- replaced with /var/log/ceph/ceph-client.admin.140386.log.gz 2024-09-14T13:03:52.716 INFO:teuthology.orchestra.run.smithi138.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.34913.log 2024-09-14T13:03:52.717 INFO:teuthology.orchestra.run.smithi138.stderr:/var/log/ceph/ceph-client.admin.151007.log: 81.2% -- replaced with /var/log/ceph/ceph-client.admin.151007.log.gz 2024-09-14T13:03:52.717 INFO:teuthology.orchestra.run.smithi138.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.130945.log 2024-09-14T13:03:52.718 INFO:teuthology.orchestra.run.smithi138.stderr:/var/log/ceph/ceph-client.0.34913.log: 43.9% -- replaced with /var/log/ceph/ceph-client.0.34913.log.gz 2024-09-14T13:03:52.719 INFO:teuthology.orchestra.run.smithi138.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.138615.log 2024-09-14T13:03:52.719 INFO:teuthology.orchestra.run.smithi138.stderr:/var/log/ceph/ceph-client.admin.130945.log: 82.1% -- replaced with /var/log/ceph/ceph-client.admin.130945.log.gz 2024-09-14T13:03:52.720 INFO:teuthology.orchestra.run.smithi138.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54763.log 2024-09-14T13:03:52.720 INFO:teuthology.orchestra.run.smithi138.stderr:/var/log/ceph/ceph-client.admin.138615.log: 82.6% -- replaced with /var/log/ceph/ceph-client.admin.138615.log.gz 2024-09-14T13:03:52.721 INFO:teuthology.orchestra.run.smithi138.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32948.log 2024-09-14T13:03:52.721 INFO:teuthology.orchestra.run.smithi138.stderr:/var/log/ceph/ceph-client.admin.54763.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.54763.log.gz 2024-09-14T13:03:52.722 INFO:teuthology.orchestra.run.smithi138.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32964.log 2024-09-14T13:03:52.722 INFO:teuthology.orchestra.run.smithi138.stderr:/var/log/ceph/ceph-client.admin.32948.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32948.log.gz 2024-09-14T13:03:52.723 INFO:teuthology.orchestra.run.smithi138.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56628.log 2024-09-14T13:03:52.723 INFO:teuthology.orchestra.run.smithi138.stderr:/var/log/ceph/ceph-client.admin.32964.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32964.log.gz 2024-09-14T13:03:52.725 INFO:teuthology.orchestra.run.smithi138.stderr:/var/log/ceph/ceph-client.admin.56628.log: 86.3% -- replaced with /var/log/ceph/ceph-client.admin.56628.log.gz 2024-09-14T13:03:53.099 INFO:teuthology.orchestra.run.smithi138.stderr: 91.7% -- replaced with /var/log/ceph/ceph-mgr.y.log.gz 2024-09-14T13:03:53.273 INFO:teuthology.orchestra.run.smithi154.stderr: 92.8% -- replaced with /var/log/ceph/ceph-mon.b.log.gz 2024-09-14T13:03:54.167 INFO:teuthology.orchestra.run.smithi138.stderr: 92.8% -- replaced with /var/log/ceph/ceph-mon.c.log.gz 2024-09-14T13:03:56.138 INFO:teuthology.orchestra.run.smithi138.stderr: 92.5% -- replaced with /var/log/ceph/rgw.ceph.client.0.log.gz 2024-09-14T13:03:56.866 INFO:teuthology.orchestra.run.smithi138.stderr: 91.2% -- replaced with /var/log/ceph/ceph-mon.a.log.gz 2024-09-14T13:04:02.004 INFO:teuthology.orchestra.run.smithi138.stderr: 93.3% -- replaced with /var/log/ceph/ceph-osd.2.log.gz 2024-09-14T13:04:02.791 INFO:teuthology.orchestra.run.smithi154.stderr: 93.5% -- replaced with /var/log/ceph/ceph-osd.5.log.gz 2024-09-14T13:04:03.286 INFO:teuthology.orchestra.run.smithi154.stderr: 93.6% -- replaced with /var/log/ceph/ceph-osd.4.log.gz 2024-09-14T13:04:03.421 INFO:teuthology.orchestra.run.smithi154.stderr: 93.6% -- replaced with /var/log/ceph/ceph-osd.7.log.gz 2024-09-14T13:04:03.787 INFO:teuthology.orchestra.run.smithi138.stderr: 93.6% -- replaced with /var/log/ceph/ceph-osd.1.log.gz 2024-09-14T13:04:07.033 INFO:teuthology.orchestra.run.smithi138.stderr: 94.1% -- replaced with /var/log/ceph/ceph-osd.3.log.gz 2024-09-14T13:04:08.381 INFO:teuthology.orchestra.run.smithi154.stderr: 93.9% -- replaced with /var/log/ceph/ceph-osd.6.log.gz 2024-09-14T13:04:08.383 INFO:teuthology.orchestra.run.smithi154.stderr: 2024-09-14T13:04:08.383 INFO:teuthology.orchestra.run.smithi154.stderr:real 0m16.355s 2024-09-14T13:04:08.383 INFO:teuthology.orchestra.run.smithi154.stderr:user 0m49.259s 2024-09-14T13:04:08.383 INFO:teuthology.orchestra.run.smithi154.stderr:sys 0m1.786s 2024-09-14T13:04:13.334 INFO:teuthology.orchestra.run.smithi138.stderr: 94.4% -- replaced with /var/log/ceph/ceph-osd.0.log.gz 2024-09-14T13:04:13.336 INFO:teuthology.orchestra.run.smithi138.stderr: 2024-09-14T13:04:13.336 INFO:teuthology.orchestra.run.smithi138.stderr:real 0m21.352s 2024-09-14T13:04:13.336 INFO:teuthology.orchestra.run.smithi138.stderr:user 1m7.737s 2024-09-14T13:04:13.336 INFO:teuthology.orchestra.run.smithi138.stderr:sys 0m2.486s 2024-09-14T13:04:13.337 INFO:tasks.ceph:Archiving logs... 2024-09-14T13:04:13.337 DEBUG:teuthology.misc:Transferring archived files from smithi138:/var/log/ceph to /home/teuthworker/archive/teuthology-2024-09-13_20:40:18-rgw-main-distro-default-smithi/7904155/remote/smithi138/log 2024-09-14T13:04:13.338 DEBUG:teuthology.orchestra.run.smithi138:> sudo tar c -f - -C /var/log/ceph -- . 2024-09-14T13:04:20.653 DEBUG:teuthology.misc:Transferring archived files from smithi154:/var/log/ceph to /home/teuthworker/archive/teuthology-2024-09-13_20:40:18-rgw-main-distro-default-smithi/7904155/remote/smithi154/log 2024-09-14T13:04:20.654 DEBUG:teuthology.orchestra.run.smithi154:> sudo tar c -f - -C /var/log/ceph -- . 2024-09-14T13:04:26.495 DEBUG:teuthology.run_tasks:Unwinding manager install 2024-09-14T13:04:26.506 INFO:teuthology.task.install.util:Removing shipped files: /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer... 2024-09-14T13:04:26.506 DEBUG:teuthology.orchestra.run.smithi138:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-09-14T13:04:26.509 DEBUG:teuthology.orchestra.run.smithi154:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-09-14T13:04:26.576 DEBUG:teuthology.run_tasks:Unwinding manager clock 2024-09-14T13:04:26.586 INFO:teuthology.task.clock:Checking final clock skew... 2024-09-14T13:04:26.586 DEBUG:teuthology.orchestra.run.smithi138:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-14T13:04:26.589 DEBUG:teuthology.orchestra.run.smithi154:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-14T13:04:26.603 INFO:teuthology.orchestra.run.smithi138.stdout: remote refid st t when poll reach delay offset jitter 2024-09-14T13:04:26.603 INFO:teuthology.orchestra.run.smithi138.stdout:============================================================================== 2024-09-14T13:04:26.603 INFO:teuthology.orchestra.run.smithi138.stdout:*hv01.front.sepi 67.205.162.81 3 u 167 256 377 0.101 -7.375 1.850 2024-09-14T13:04:26.603 INFO:teuthology.orchestra.run.smithi138.stdout:+hv02.front.sepi 63.231.80.2 3 u 158 256 377 0.116 -10.674 2.005 2024-09-14T13:04:26.604 INFO:teuthology.orchestra.run.smithi138.stdout:+hv03.front.sepi 74.6.168.72 3 u 217 256 377 0.099 +2.488 2.564 2024-09-14T13:04:26.604 INFO:teuthology.orchestra.run.smithi138.stdout: hv04.front.sepi .INIT. 16 u - 1024 0 0.000 +0.000 0.000 2024-09-14T13:04:26.605 INFO:teuthology.orchestra.run.smithi154.stdout: remote refid st t when poll reach delay offset jitter 2024-09-14T13:04:26.605 INFO:teuthology.orchestra.run.smithi154.stdout:============================================================================== 2024-09-14T13:04:26.605 INFO:teuthology.orchestra.run.smithi154.stdout:+hv01.front.sepi 67.205.162.81 3 u 238 256 377 0.108 -7.492 0.845 2024-09-14T13:04:26.605 INFO:teuthology.orchestra.run.smithi154.stdout:*hv02.front.sepi 63.231.80.2 3 u 15 256 377 0.106 -9.699 0.867 2024-09-14T13:04:26.605 INFO:teuthology.orchestra.run.smithi154.stdout:+hv03.front.sepi 74.6.168.72 3 u 22 256 377 0.114 +2.093 1.944 2024-09-14T13:04:26.605 INFO:teuthology.orchestra.run.smithi154.stdout: hv04.front.sepi .INIT. 16 u - 1024 0 0.000 +0.000 0.000 2024-09-14T13:04:26.605 DEBUG:teuthology.run_tasks:Unwinding manager ansible.cephlab 2024-09-14T13:04:26.615 INFO:teuthology.task.ansible:Skipping ansible cleanup... 2024-09-14T13:04:26.615 DEBUG:teuthology.run_tasks:Unwinding manager selinux 2024-09-14T13:04:26.648 DEBUG:teuthology.run_tasks:Unwinding manager pcp 2024-09-14T13:04:26.683 DEBUG:teuthology.run_tasks:Unwinding manager internal.timer 2024-09-14T13:04:26.715 INFO:teuthology.task.internal:Duration was 7633.227619 seconds 2024-09-14T13:04:26.715 DEBUG:teuthology.run_tasks:Unwinding manager internal.syslog 2024-09-14T13:04:26.747 INFO:teuthology.task.internal.syslog:Shutting down syslog monitoring... 2024-09-14T13:04:26.748 DEBUG:teuthology.orchestra.run.smithi138:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-09-14T13:04:26.750 DEBUG:teuthology.orchestra.run.smithi154:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-09-14T13:04:26.790 INFO:teuthology.task.internal.syslog:Checking logs for errors... 2024-09-14T13:04:26.790 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi138.front.sepia.ceph.com 2024-09-14T13:04:26.790 DEBUG:teuthology.orchestra.run.smithi138:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-09-14T13:04:26.837 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi154.front.sepia.ceph.com 2024-09-14T13:04:26.838 DEBUG:teuthology.orchestra.run.smithi154:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-09-14T13:04:26.848 INFO:teuthology.task.internal.syslog:Compressing syslogs... 2024-09-14T13:04:26.848 DEBUG:teuthology.orchestra.run.smithi138:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-09-14T13:04:26.882 DEBUG:teuthology.orchestra.run.smithi154:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-09-14T13:04:26.917 INFO:teuthology.task.internal.syslog:Gathering journactl -b0... 2024-09-14T13:04:26.917 DEBUG:teuthology.orchestra.run.smithi138:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-09-14T13:04:26.950 DEBUG:teuthology.orchestra.run.smithi154:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-09-14T13:04:27.017 DEBUG:teuthology.run_tasks:Unwinding manager internal.sudo 2024-09-14T13:04:27.028 INFO:teuthology.task.internal:Restoring /etc/sudoers... 2024-09-14T13:04:27.028 DEBUG:teuthology.orchestra.run.smithi138:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-09-14T13:04:27.039 DEBUG:teuthology.orchestra.run.smithi154:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-09-14T13:04:27.051 DEBUG:teuthology.run_tasks:Unwinding manager internal.coredump 2024-09-14T13:04:27.061 DEBUG:teuthology.orchestra.run.smithi138:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-09-14T13:04:27.082 DEBUG:teuthology.orchestra.run.smithi154:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-09-14T13:04:27.090 INFO:teuthology.orchestra.run.smithi138.stdout:kernel.core_pattern = core 2024-09-14T13:04:27.103 INFO:teuthology.orchestra.run.smithi154.stdout:kernel.core_pattern = core 2024-09-14T13:04:27.215 DEBUG:teuthology.orchestra.run.smithi138:> test -e /home/ubuntu/cephtest/archive/coredump 2024-09-14T13:04:27.220 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-14T13:04:27.221 DEBUG:teuthology.orchestra.run.smithi154:> test -e /home/ubuntu/cephtest/archive/coredump 2024-09-14T13:04:27.262 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-14T13:04:27.263 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive 2024-09-14T13:04:27.275 INFO:teuthology.task.internal:Transferring archived files... 2024-09-14T13:04:27.276 DEBUG:teuthology.misc:Transferring archived files from smithi138:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/teuthology-2024-09-13_20:40:18-rgw-main-distro-default-smithi/7904155/remote/smithi138 2024-09-14T13:04:27.276 DEBUG:teuthology.orchestra.run.smithi138:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-09-14T13:04:27.301 DEBUG:teuthology.misc:Transferring archived files from smithi154:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/teuthology-2024-09-13_20:40:18-rgw-main-distro-default-smithi/7904155/remote/smithi154 2024-09-14T13:04:27.302 DEBUG:teuthology.orchestra.run.smithi154:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-09-14T13:04:27.328 INFO:teuthology.task.internal:Removing archive directory... 2024-09-14T13:04:27.328 DEBUG:teuthology.orchestra.run.smithi138:> rm -rf -- /home/ubuntu/cephtest/archive 2024-09-14T13:04:27.338 DEBUG:teuthology.orchestra.run.smithi154:> rm -rf -- /home/ubuntu/cephtest/archive 2024-09-14T13:04:27.371 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive_upload 2024-09-14T13:04:27.383 INFO:teuthology.task.internal:Not uploading archives. 2024-09-14T13:04:27.383 DEBUG:teuthology.run_tasks:Unwinding manager internal.base 2024-09-14T13:04:27.408 INFO:teuthology.task.internal:Tidying up after the test... 2024-09-14T13:04:27.408 DEBUG:teuthology.orchestra.run.smithi138:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-09-14T13:04:27.411 DEBUG:teuthology.orchestra.run.smithi154:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-09-14T13:04:27.415 INFO:teuthology.orchestra.run.smithi138.stdout: 658640 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Sep 14 13:04 /home/ubuntu/cephtest 2024-09-14T13:04:27.419 INFO:teuthology.orchestra.run.smithi154.stdout: 658615 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Sep 14 13:04 /home/ubuntu/cephtest 2024-09-14T13:04:27.420 DEBUG:teuthology.run_tasks:Unwinding manager kernel 2024-09-14T13:04:27.441 DEBUG:teuthology.run_tasks:Unwinding manager console_log 2024-09-14T13:04:27.512 INFO:teuthology.run:Summary data: description: rgw/verify/{0-install accounts$/{main} clusters/fixed-2 datacache/no_datacache frontend/beast ignore-pg-availability inline-data$/{on} msgr-failures/few objectstore/bluestore-bitmap overrides proto/https rgw_pool_type/ec s3tests-branch sharding$/{default} striping$/{stripe-equals-chunk} supported-random-distro$/{ubuntu_latest} tasks/{bucket-check cls mp_reupload ragweed reshard s3tests-java s3tests versioning} validater/valgrind} duration: 7633.227618932724 flavor: default owner: scheduled_teuthology@teuthology success: true 2024-09-14T13:04:27.512 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-09-14T13:04:27.608 INFO:teuthology.run:pass